2024-02-19T21:05:38.982 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-19T21:05:38.983 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2024-02-19_19:25:49-rados-pacific-release-distro-default-smithi/7566756 --verbose --description rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} --name yuriw-2024-02-19_19:25:49-rados-pacific-release-distro-default-smithi --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2024-02-19_19:25:49-rados-pacific-release-distro-default-smithi/7566756/orig.config.yaml 2024-02-19T21:05:39.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T21:05:39.101 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-02-19_19:25:49-rados-pacific-release-distro-default-smithi/7566756 branch: pacific-release description: rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} email: null first_in_suite: false job_id: '7566756' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2024-02-19_19:25:49-rados-pacific-release-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: pacific-release ceph: conf: client.0: debug ms: 1 debug objecter: 20 debug rados: 20 global: ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug ms: 1 debug osd: 20 osd debug reject backfill probability: 0.3 osd delete sleep: 1 osd max backfills: 3 osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd snap trim sleep: 2 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - but it is still running - objects unfound and apparently lost - \(MON_DOWN\) - \(OSDMAP_FLAGS\) - flag\(s\) set - \(CACHE_POOL_NO_HIT_SET\) - \(PG_ - \(OSD_ - mons down: null sha1: 81bd20d634209c7cb82c18be12b4b5a05643ebf1 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} cephadm: cephadm_mode: root install: ceph: flavor: default sha1: 81bd20d634209c7cb82c18be12b4b5a05643ebf1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: pacific-release sha1: 81bd20d634209c7cb82c18be12b4b5a05643ebf1 owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.foo.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a seed: 264 sha1: 81bd20d634209c7cb82c18be12b4b5a05643ebf1 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: pacific-release suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_81bd20d634209c7cb82c18be12b4b5a05643ebf1/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 81bd20d634209c7cb82c18be12b4b5a05643ebf1 targets: smithi080.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE1xQ9LkYG6xoTRTY0IPhqUJRe9mMMC2O6N+C/8e/6K9M0mKeLdAH/rVLICKrQ/ChjD0CvjTsHA41Wa5uk11lRk= smithi157.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOR5P2f4oz2tMNmlBw8vtjlVgQ2Put/SYHDMPs91lwfIpR8Ub3P+Wk+Huv05lEsnwz1199PHt40N7FXjLa1Yl1E= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - thrashosds: chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 timeout: 1200 - full_sequential: - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-19_19:25:49 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-19T21:05:39.102 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_81bd20d634209c7cb82c18be12b4b5a05643ebf1/qa; will attempt to use it 2024-02-19T21:05:39.102 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_81bd20d634209c7cb82c18be12b4b5a05643ebf1/qa/tasks 2024-02-19T21:05:39.102 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-19T21:05:39.104 INFO:teuthology.task.internal:Checking packages... 2024-02-19T21:05:39.127 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '81bd20d634209c7cb82c18be12b4b5a05643ebf1' 2024-02-19T21:05:39.128 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-19T21:05:39.128 INFO:teuthology.packaging:ref: None 2024-02-19T21:05:39.128 INFO:teuthology.packaging:tag: None 2024-02-19T21:05:39.128 INFO:teuthology.packaging:branch: pacific-release 2024-02-19T21:05:39.128 INFO:teuthology.packaging:sha1: 81bd20d634209c7cb82c18be12b4b5a05643ebf1 2024-02-19T21:05:39.128 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific-release 2024-02-19T21:05:39.432 INFO:teuthology.task.internal:Found packages for ceph version 16.2.14-548.g81bd20d6 2024-02-19T21:05:39.433 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-19T21:05:39.444 INFO:teuthology.task.internal:no buildpackages task found 2024-02-19T21:05:39.444 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-19T21:05:39.457 INFO:teuthology.task.internal:Saving configuration 2024-02-19T21:05:39.470 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-19T21:05:39.480 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-19T21:05:39.506 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-19_19:25:49-rados-pacific-release-distro-default-smithi/7566756', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-19 20:59:35.872406', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE1xQ9LkYG6xoTRTY0IPhqUJRe9mMMC2O6N+C/8e/6K9M0mKeLdAH/rVLICKrQ/ChjD0CvjTsHA41Wa5uk11lRk='} 2024-02-19T21:05:39.530 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-19_19:25:49-rados-pacific-release-distro-default-smithi/7566756', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-19 20:59:35.870433', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOR5P2f4oz2tMNmlBw8vtjlVgQ2Put/SYHDMPs91lwfIpR8Ub3P+Wk+Huv05lEsnwz1199PHt40N7FXjLa1Yl1E='} 2024-02-19T21:05:39.530 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-19T21:05:39.541 INFO:teuthology.task.internal:roles: ubuntu@smithi080.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2024-02-19T21:05:39.541 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2024-02-19T21:05:39.541 INFO:teuthology.run_tasks:Running task console_log... 2024-02-19T21:05:39.641 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f292d5c40d0>, signals=[15]) 2024-02-19T21:05:39.641 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-19T21:05:39.650 INFO:teuthology.task.internal:Opening connections... 2024-02-19T21:05:39.650 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi080.front.sepia.ceph.com 2024-02-19T21:05:39.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T21:05:39.726 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi157.front.sepia.ceph.com 2024-02-19T21:05:39.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T21:05:39.796 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-19T21:05:39.807 DEBUG:teuthology.orchestra.run.smithi080:> uname -m 2024-02-19T21:05:39.828 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2024-02-19T21:05:39.829 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-02-19T21:05:39.887 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="CentOS Stream" 2024-02-19T21:05:39.887 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="8" 2024-02-19T21:05:39.888 INFO:teuthology.orchestra.run.smithi080.stdout:ID="centos" 2024-02-19T21:05:39.888 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="rhel fedora" 2024-02-19T21:05:39.888 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="8" 2024-02-19T21:05:39.888 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el8" 2024-02-19T21:05:39.888 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-19T21:05:39.888 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2024-02-19T21:05:39.888 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-19T21:05:39.888 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://centos.org/" 2024-02-19T21:05:39.888 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T21:05:39.888 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-19T21:05:39.888 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T21:05:39.889 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-02-19T21:05:39.913 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2024-02-19T21:05:39.935 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2024-02-19T21:05:39.935 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2024-02-19T21:05:39.995 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream" 2024-02-19T21:05:39.995 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8" 2024-02-19T21:05:39.996 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos" 2024-02-19T21:05:39.996 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora" 2024-02-19T21:05:39.996 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8" 2024-02-19T21:05:39.996 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2024-02-19T21:05:39.996 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-19T21:05:39.996 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2024-02-19T21:05:39.996 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-19T21:05:39.996 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/" 2024-02-19T21:05:39.996 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T21:05:39.996 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-19T21:05:39.996 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T21:05:39.997 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2024-02-19T21:05:40.012 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-19T21:05:40.024 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-19T21:05:40.037 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-19T21:05:40.037 DEBUG:teuthology.orchestra.run.smithi080:> test '!' -e /home/ubuntu/cephtest 2024-02-19T21:05:40.040 DEBUG:teuthology.orchestra.run.smithi157:> test '!' -e /home/ubuntu/cephtest 2024-02-19T21:05:40.059 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-19T21:05:40.071 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-19T21:05:40.071 DEBUG:teuthology.orchestra.run.smithi080:> test -z $(ls -A /var/lib/ceph) 2024-02-19T21:05:40.100 DEBUG:teuthology.orchestra.run.smithi157:> test -z $(ls -A /var/lib/ceph) 2024-02-19T21:05:40.134 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-19T21:05:40.190 INFO:teuthology.run_tasks:Running task kernel... 2024-02-19T21:05:40.207 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-19T21:05:40.207 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-19T21:05:40.207 DEBUG:teuthology.orchestra.run.smithi080:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-19T21:05:40.207 DEBUG:teuthology.orchestra.run.smithi157:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-19T21:05:40.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T21:05:40.226 DEBUG:teuthology.orchestra.run.smithi080:> uname -r 2024-02-19T21:05:40.227 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T21:05:40.228 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2024-02-19T21:05:40.285 INFO:teuthology.orchestra.run.smithi080.stdout:4.18.0-489.el8.x86_64 2024-02-19T21:05:40.285 INFO:teuthology.task.kernel:Running kernel on smithi080: 4.18.0-489.el8.x86_64 2024-02-19T21:05:40.286 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum install -y kernel 2024-02-19T21:05:40.289 INFO:teuthology.orchestra.run.smithi157.stdout:4.18.0-489.el8.x86_64 2024-02-19T21:05:40.289 INFO:teuthology.task.kernel:Running kernel on smithi157: 4.18.0-489.el8.x86_64 2024-02-19T21:05:40.289 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum install -y kernel 2024-02-19T21:06:05.644 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 8 - AppStream 1.2 MB/s | 27 MB 00:22 2024-02-19T21:06:05.831 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 8 - AppStream 1.2 MB/s | 27 MB 00:22 2024-02-19T21:06:10.902 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 8 - BaseOS 23 MB/s | 10 MB 00:00 2024-02-19T21:06:11.314 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 8 - BaseOS 16 MB/s | 10 MB 00:00 2024-02-19T21:06:12.929 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 8 - Extras 42 kB/s | 18 kB 00:00 2024-02-19T21:06:13.223 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 8 - Extras 61 kB/s | 18 kB 00:00 2024-02-19T21:06:13.320 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 8 - Extras common packages 25 kB/s | 6.9 kB 00:00 2024-02-19T21:06:13.614 INFO:teuthology.orchestra.run.smithi157.stdout:Copr repo for python3-asyncssh owned by ceph 17 kB/s | 3.5 kB 00:00 2024-02-19T21:06:13.815 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 8 - Extras common packages 14 kB/s | 6.9 kB 00:00 2024-02-19T21:06:14.142 INFO:teuthology.orchestra.run.smithi080.stdout:Copr repo for python3-asyncssh owned by ceph 15 kB/s | 3.5 kB 00:00 2024-02-19T21:06:15.914 INFO:teuthology.orchestra.run.smithi157.stdout:Extra Packages for Enterprise Linux 7.3 MB/s | 16 MB 00:02 2024-02-19T21:06:19.697 INFO:teuthology.orchestra.run.smithi157.stdout:lab-extras 451 kB/s | 24 kB 00:00 2024-02-19T21:06:22.636 INFO:teuthology.orchestra.run.smithi157.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-02-19T21:06:22.636 INFO:teuthology.orchestra.run.smithi157.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-02-19T21:06:22.770 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-19T21:06:22.771 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:06:22.771 INFO:teuthology.orchestra.run.smithi157.stdout: Package Architecture Version Repository Size 2024-02-19T21:06:22.771 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:06:22.771 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-19T21:06:22.771 INFO:teuthology.orchestra.run.smithi157.stdout: kernel x86_64 4.18.0-539.el8 baseos 10 M 2024-02-19T21:06:22.771 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-02-19T21:06:22.771 INFO:teuthology.orchestra.run.smithi157.stdout: kernel-core x86_64 4.18.0-539.el8 baseos 43 M 2024-02-19T21:06:22.771 INFO:teuthology.orchestra.run.smithi157.stdout: kernel-modules x86_64 4.18.0-539.el8 baseos 36 M 2024-02-19T21:06:22.771 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:06:22.772 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-19T21:06:22.772 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:06:22.772 INFO:teuthology.orchestra.run.smithi157.stdout:Install 3 Packages 2024-02-19T21:06:22.772 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:06:22.772 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 90 M 2024-02-19T21:06:22.772 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 97 M 2024-02-19T21:06:22.773 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-19T21:06:23.415 INFO:teuthology.orchestra.run.smithi157.stdout:(1/3): kernel-4.18.0-539.el8.x86_64.rpm 28 MB/s | 10 MB 00:00 2024-02-19T21:06:23.932 INFO:teuthology.orchestra.run.smithi157.stdout:(2/3): kernel-modules-4.18.0-539.el8.x86_64.rpm 41 MB/s | 36 MB 00:00 2024-02-19T21:06:24.399 INFO:teuthology.orchestra.run.smithi157.stdout:(3/3): kernel-core-4.18.0-539.el8.x86_64.rpm 32 MB/s | 43 MB 00:01 2024-02-19T21:06:24.400 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:06:24.400 INFO:teuthology.orchestra.run.smithi157.stdout:Total 55 MB/s | 90 MB 00:01 2024-02-19T21:06:25.080 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-19T21:06:25.518 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-19T21:06:25.518 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-19T21:06:26.753 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-19T21:06:26.777 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-19T21:06:29.563 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-19T21:06:30.070 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : kernel-core-4.18.0-539.el8.x86_64 1/3 2024-02-19T21:06:33.642 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: kernel-core-4.18.0-539.el8.x86_64 1/3 2024-02-19T21:06:34.053 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : kernel-modules-4.18.0-539.el8.x86_64 2/3 2024-02-19T21:06:37.483 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: kernel-modules-4.18.0-539.el8.x86_64 2/3 2024-02-19T21:06:37.803 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : kernel-4.18.0-539.el8.x86_64 3/3 2024-02-19T21:07:00.117 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: kernel-core-4.18.0-539.el8.x86_64 3/3 2024-02-19T21:07:00.140 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: kernel-modules-4.18.0-539.el8.x86_64 3/3 2024-02-19T21:07:00.657 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: kernel-4.18.0-539.el8.x86_64 3/3 2024-02-19T21:07:00.657 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : kernel-4.18.0-539.el8.x86_64 1/3 2024-02-19T21:07:00.658 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : kernel-core-4.18.0-539.el8.x86_64 2/3 2024-02-19T21:07:01.157 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : kernel-modules-4.18.0-539.el8.x86_64 3/3 2024-02-19T21:07:01.157 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:07:01.157 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-19T21:07:01.157 INFO:teuthology.orchestra.run.smithi157.stdout: kernel-4.18.0-539.el8.x86_64 kernel-core-4.18.0-539.el8.x86_64 2024-02-19T21:07:01.157 INFO:teuthology.orchestra.run.smithi157.stdout: kernel-modules-4.18.0-539.el8.x86_64 2024-02-19T21:07:01.157 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:07:01.158 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-19T21:07:01.307 DEBUG:teuthology.orchestra.run.smithi157:> rpm -q kernel | sort -rV | head -n 1 2024-02-19T21:07:01.567 INFO:teuthology.orchestra.run.smithi157.stdout:kernel-4.18.0-539.el8.x86_64 2024-02-19T21:07:01.567 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-539.el8.x86_64 2024-02-19T21:07:01.567 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-539.el8.x86_64 2024-02-19T21:07:01.567 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-19T21:07:01.567 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-19T21:07:01.568 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-02-19T21:07:01.568 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi157.front.sepia.ceph.com, path=None, version=distro) 2024-02-19T21:07:01.568 DEBUG:teuthology.orchestra.run.smithi157:> rpm -q kernel | sort -rV | head -n 1 2024-02-19T21:07:01.782 INFO:teuthology.orchestra.run.smithi157.stdout:kernel-4.18.0-539.el8.x86_64 2024-02-19T21:07:01.782 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-539.el8.x86_64 2024-02-19T21:07:01.782 DEBUG:teuthology.orchestra.run.smithi157:> sudo rpm -qi grub2-tools 2024-02-19T21:07:01.816 INFO:teuthology.orchestra.run.smithi157.stdout:Name : grub2-tools 2024-02-19T21:07:01.816 INFO:teuthology.orchestra.run.smithi157.stdout:Epoch : 1 2024-02-19T21:07:01.816 INFO:teuthology.orchestra.run.smithi157.stdout:Version : 2.02 2024-02-19T21:07:01.816 INFO:teuthology.orchestra.run.smithi157.stdout:Release : 129.el8 2024-02-19T21:07:01.816 INFO:teuthology.orchestra.run.smithi157.stdout:Architecture: x86_64 2024-02-19T21:07:01.816 INFO:teuthology.orchestra.run.smithi157.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-02-19T21:07:01.817 INFO:teuthology.orchestra.run.smithi157.stdout:Group : System Environment/Base 2024-02-19T21:07:01.817 INFO:teuthology.orchestra.run.smithi157.stdout:Size : 9265586 2024-02-19T21:07:01.817 INFO:teuthology.orchestra.run.smithi157.stdout:License : GPLv3+ 2024-02-19T21:07:01.817 INFO:teuthology.orchestra.run.smithi157.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-02-19T21:07:01.817 INFO:teuthology.orchestra.run.smithi157.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-02-19T21:07:01.817 INFO:teuthology.orchestra.run.smithi157.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-02-19T21:07:01.817 INFO:teuthology.orchestra.run.smithi157.stdout:Build Host : kbuilder.bsys.centos.org 2024-02-19T21:07:01.817 INFO:teuthology.orchestra.run.smithi157.stdout:Relocations : (not relocatable) 2024-02-19T21:07:01.817 INFO:teuthology.orchestra.run.smithi157.stdout:Packager : CentOS BuildSystem 2024-02-19T21:07:01.817 INFO:teuthology.orchestra.run.smithi157.stdout:Vendor : CentOS 2024-02-19T21:07:01.817 INFO:teuthology.orchestra.run.smithi157.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-19T21:07:01.817 INFO:teuthology.orchestra.run.smithi157.stdout:Summary : Support tools for GRUB. 2024-02-19T21:07:01.817 INFO:teuthology.orchestra.run.smithi157.stdout:Description : 2024-02-19T21:07:01.818 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:07:01.818 INFO:teuthology.orchestra.run.smithi157.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-19T21:07:01.818 INFO:teuthology.orchestra.run.smithi157.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-19T21:07:01.818 INFO:teuthology.orchestra.run.smithi157.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-19T21:07:01.818 INFO:teuthology.orchestra.run.smithi157.stdout:hardware devices. 2024-02-19T21:07:01.818 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:07:01.818 INFO:teuthology.orchestra.run.smithi157.stdout:This subpackage provides tools for support of all platforms. 2024-02-19T21:07:01.819 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-19T21:07:01.819 INFO:teuthology.task.kernel:Updating grub on smithi157 to boot 4.18.0-539.el8.x86_64 2024-02-19T21:07:01.819 DEBUG:teuthology.orchestra.run.smithi157:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-19T21:07:03.348 INFO:teuthology.orchestra.run.smithi157.stderr:Generating grub configuration file ... 2024-02-19T21:07:05.280 INFO:teuthology.orchestra.run.smithi157.stderr:done 2024-02-19T21:07:05.282 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-02-19T21:07:05.323 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.JEiSAFqPZA 2024-02-19T21:07:05.323 DEBUG:teuthology.orchestra.run.smithi157:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.JEiSAFqPZA 2024-02-19T21:07:05.396 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.JEiSAFqPZA 2024-02-19T21:07:05.542 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.JEiSAFqPZA is 6KB 2024-02-19T21:07:05.589 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.JEiSAFqPZA 2024-02-19T21:07:05.607 DEBUG:teuthology.orchestra.run.smithi157:> sudo /bin/ls /boot/loader/entries || true 2024-02-19T21:07:05.678 INFO:teuthology.orchestra.run.smithi157.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-02-19T21:07:05.679 INFO:teuthology.orchestra.run.smithi157.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-02-19T21:07:05.679 INFO:teuthology.orchestra.run.smithi157.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-02-19T21:07:05.679 INFO:teuthology.orchestra.run.smithi157.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-539.el8.x86_64.conf 2024-02-19T21:07:05.680 DEBUG:teuthology.orchestra.run.smithi157:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-539.el8.x86_64 2024-02-19T21:07:05.869 DEBUG:teuthology.orchestra.run.smithi157:> sudo shutdown -r now 2024-02-19T21:07:35.873 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-02-19T21:07:35.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-02-19T21:07:35.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T21:07:54.300 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-02-19T21:08:01.948 INFO:teuthology.orchestra.run.smithi080.stdout:Extra Packages for Enterprise Linux 153 kB/s | 16 MB 01:47 2024-02-19T21:08:03.301 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-02-19T21:08:03.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T21:08:05.648 INFO:teuthology.orchestra.run.smithi080.stdout:lab-extras 584 kB/s | 24 kB 00:00 2024-02-19T21:08:06.368 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-02-19T21:08:08.628 INFO:teuthology.orchestra.run.smithi080.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-02-19T21:08:08.628 INFO:teuthology.orchestra.run.smithi080.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-02-19T21:08:08.759 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-19T21:08:08.759 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:08:08.759 INFO:teuthology.orchestra.run.smithi080.stdout: Package Architecture Version Repository Size 2024-02-19T21:08:08.760 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:08:08.760 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-02-19T21:08:08.760 INFO:teuthology.orchestra.run.smithi080.stdout: kernel x86_64 4.18.0-539.el8 baseos 10 M 2024-02-19T21:08:08.760 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-02-19T21:08:08.760 INFO:teuthology.orchestra.run.smithi080.stdout: kernel-core x86_64 4.18.0-539.el8 baseos 43 M 2024-02-19T21:08:08.760 INFO:teuthology.orchestra.run.smithi080.stdout: kernel-modules x86_64 4.18.0-539.el8 baseos 36 M 2024-02-19T21:08:08.760 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:08:08.760 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-02-19T21:08:08.760 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:08:08.760 INFO:teuthology.orchestra.run.smithi080.stdout:Install 3 Packages 2024-02-19T21:08:08.760 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:08:08.761 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 90 M 2024-02-19T21:08:08.761 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 97 M 2024-02-19T21:08:08.761 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-02-19T21:08:10.341 INFO:teuthology.orchestra.run.smithi080.stdout:(1/3): kernel-4.18.0-539.el8.x86_64.rpm 27 MB/s | 10 MB 00:00 2024-02-19T21:08:10.824 INFO:teuthology.orchestra.run.smithi080.stdout:(2/3): kernel-modules-4.18.0-539.el8.x86_64.rpm 42 MB/s | 36 MB 00:00 2024-02-19T21:08:11.258 INFO:teuthology.orchestra.run.smithi080.stdout:(3/3): kernel-core-4.18.0-539.el8.x86_64.rpm 33 MB/s | 43 MB 00:01 2024-02-19T21:08:11.258 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:08:11.258 INFO:teuthology.orchestra.run.smithi080.stdout:Total 36 MB/s | 90 MB 00:02 2024-02-19T21:08:11.945 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-02-19T21:08:12.366 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-02-19T21:08:12.366 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-02-19T21:08:13.608 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-02-19T21:08:13.630 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-02-19T21:08:16.383 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-02-19T21:08:16.928 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : kernel-core-4.18.0-539.el8.x86_64 1/3 2024-02-19T21:08:18.369 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-02-19T21:08:18.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T21:08:20.480 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: kernel-core-4.18.0-539.el8.x86_64 1/3 2024-02-19T21:08:20.877 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : kernel-modules-4.18.0-539.el8.x86_64 2/3 2024-02-19T21:08:21.436 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-02-19T21:08:24.305 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: kernel-modules-4.18.0-539.el8.x86_64 2/3 2024-02-19T21:08:24.602 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : kernel-4.18.0-539.el8.x86_64 3/3 2024-02-19T21:08:36.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-02-19T21:08:36.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T21:08:46.895 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: kernel-core-4.18.0-539.el8.x86_64 3/3 2024-02-19T21:08:46.918 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: kernel-modules-4.18.0-539.el8.x86_64 3/3 2024-02-19T21:08:47.266 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: kernel-4.18.0-539.el8.x86_64 3/3 2024-02-19T21:08:47.266 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : kernel-4.18.0-539.el8.x86_64 1/3 2024-02-19T21:08:47.266 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : kernel-core-4.18.0-539.el8.x86_64 2/3 2024-02-19T21:08:48.271 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : kernel-modules-4.18.0-539.el8.x86_64 3/3 2024-02-19T21:08:48.271 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:08:48.271 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-02-19T21:08:48.271 INFO:teuthology.orchestra.run.smithi080.stdout: kernel-4.18.0-539.el8.x86_64 kernel-core-4.18.0-539.el8.x86_64 2024-02-19T21:08:48.271 INFO:teuthology.orchestra.run.smithi080.stdout: kernel-modules-4.18.0-539.el8.x86_64 2024-02-19T21:08:48.271 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:08:48.271 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-19T21:08:48.456 DEBUG:teuthology.orchestra.run.smithi080:> rpm -q kernel | sort -rV | head -n 1 2024-02-19T21:08:48.676 INFO:teuthology.orchestra.run.smithi080.stdout:kernel-4.18.0-539.el8.x86_64 2024-02-19T21:08:48.676 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-539.el8.x86_64 2024-02-19T21:08:48.677 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-539.el8.x86_64 2024-02-19T21:08:48.677 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-19T21:08:48.677 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-19T21:08:48.677 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-02-19T21:08:48.677 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi080.front.sepia.ceph.com, path=None, version=distro) 2024-02-19T21:08:48.677 DEBUG:teuthology.orchestra.run.smithi080:> rpm -q kernel | sort -rV | head -n 1 2024-02-19T21:08:48.887 INFO:teuthology.orchestra.run.smithi080.stdout:kernel-4.18.0-539.el8.x86_64 2024-02-19T21:08:48.887 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-539.el8.x86_64 2024-02-19T21:08:48.888 DEBUG:teuthology.orchestra.run.smithi080:> sudo rpm -qi grub2-tools 2024-02-19T21:08:48.922 INFO:teuthology.orchestra.run.smithi080.stdout:Name : grub2-tools 2024-02-19T21:08:48.922 INFO:teuthology.orchestra.run.smithi080.stdout:Epoch : 1 2024-02-19T21:08:48.922 INFO:teuthology.orchestra.run.smithi080.stdout:Version : 2.02 2024-02-19T21:08:48.922 INFO:teuthology.orchestra.run.smithi080.stdout:Release : 129.el8 2024-02-19T21:08:48.922 INFO:teuthology.orchestra.run.smithi080.stdout:Architecture: x86_64 2024-02-19T21:08:48.922 INFO:teuthology.orchestra.run.smithi080.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-02-19T21:08:48.922 INFO:teuthology.orchestra.run.smithi080.stdout:Group : System Environment/Base 2024-02-19T21:08:48.923 INFO:teuthology.orchestra.run.smithi080.stdout:Size : 9265586 2024-02-19T21:08:48.923 INFO:teuthology.orchestra.run.smithi080.stdout:License : GPLv3+ 2024-02-19T21:08:48.923 INFO:teuthology.orchestra.run.smithi080.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-02-19T21:08:48.923 INFO:teuthology.orchestra.run.smithi080.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-02-19T21:08:48.923 INFO:teuthology.orchestra.run.smithi080.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-02-19T21:08:48.923 INFO:teuthology.orchestra.run.smithi080.stdout:Build Host : kbuilder.bsys.centos.org 2024-02-19T21:08:48.923 INFO:teuthology.orchestra.run.smithi080.stdout:Relocations : (not relocatable) 2024-02-19T21:08:48.923 INFO:teuthology.orchestra.run.smithi080.stdout:Packager : CentOS BuildSystem 2024-02-19T21:08:48.923 INFO:teuthology.orchestra.run.smithi080.stdout:Vendor : CentOS 2024-02-19T21:08:48.923 INFO:teuthology.orchestra.run.smithi080.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-19T21:08:48.923 INFO:teuthology.orchestra.run.smithi080.stdout:Summary : Support tools for GRUB. 2024-02-19T21:08:48.923 INFO:teuthology.orchestra.run.smithi080.stdout:Description : 2024-02-19T21:08:48.923 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:08:48.923 INFO:teuthology.orchestra.run.smithi080.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-19T21:08:48.923 INFO:teuthology.orchestra.run.smithi080.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-19T21:08:48.924 INFO:teuthology.orchestra.run.smithi080.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-19T21:08:48.924 INFO:teuthology.orchestra.run.smithi080.stdout:hardware devices. 2024-02-19T21:08:48.924 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:08:48.929 INFO:teuthology.orchestra.run.smithi080.stdout:This subpackage provides tools for support of all platforms. 2024-02-19T21:08:48.930 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-19T21:08:48.930 INFO:teuthology.task.kernel:Updating grub on smithi080 to boot 4.18.0-539.el8.x86_64 2024-02-19T21:08:48.931 DEBUG:teuthology.orchestra.run.smithi080:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-19T21:08:50.355 INFO:teuthology.orchestra.run.smithi080.stderr:Generating grub configuration file ... 2024-02-19T21:08:52.158 INFO:teuthology.orchestra.run.smithi080.stderr:done 2024-02-19T21:08:52.159 DEBUG:teuthology.orchestra.run.smithi080:> mktemp 2024-02-19T21:08:52.182 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.s2sXg2JdD3 2024-02-19T21:08:52.182 DEBUG:teuthology.orchestra.run.smithi080:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.s2sXg2JdD3 2024-02-19T21:08:52.255 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.s2sXg2JdD3 2024-02-19T21:08:52.409 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.s2sXg2JdD3 is 6KB 2024-02-19T21:08:52.457 DEBUG:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.s2sXg2JdD3 2024-02-19T21:08:52.474 DEBUG:teuthology.orchestra.run.smithi080:> sudo /bin/ls /boot/loader/entries || true 2024-02-19T21:08:52.555 INFO:teuthology.orchestra.run.smithi080.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-02-19T21:08:52.556 INFO:teuthology.orchestra.run.smithi080.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-02-19T21:08:52.556 INFO:teuthology.orchestra.run.smithi080.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-02-19T21:08:52.556 INFO:teuthology.orchestra.run.smithi080.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-539.el8.x86_64.conf 2024-02-19T21:08:52.557 DEBUG:teuthology.orchestra.run.smithi080:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-539.el8.x86_64 2024-02-19T21:08:52.704 DEBUG:teuthology.orchestra.run.smithi080:> sudo shutdown -r now 2024-02-19T21:08:54.972 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-02-19T21:09:12.988 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-02-19T21:09:12.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T21:09:13.306 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-02-19T21:09:13.598 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-02-19T21:09:13.598 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-539.el8.x86_64"... 2024-02-19T21:09:13.598 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2024-02-19T21:09:13.617 INFO:teuthology.orchestra.run.smithi157.stdout:4.18.0-539.el8.x86_64 2024-02-19T21:09:13.617 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-539.el8.x86_64 vs 4.18.0-539.el8.x86_64 2024-02-19T21:09:13.617 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-19T21:09:13.617 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-19T21:09:14.618 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-02-19T21:09:14.619 DEBUG:teuthology.orchestra.run.smithi157:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-19T21:09:14.695 INFO:teuthology.orchestra.run.smithi157.stdout:ttyS1 2024-02-19T21:09:14.708 DEBUG:teuthology.parallel:result is None 2024-02-19T21:09:22.707 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-02-19T21:09:22.708 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-02-19T21:09:22.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T21:09:41.052 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-02-19T21:09:50.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-02-19T21:09:50.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T21:09:53.120 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-02-19T21:10:05.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-02-19T21:10:05.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T21:10:37.551 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-02-19T21:10:38.344 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-02-19T21:10:38.345 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-539.el8.x86_64"... 2024-02-19T21:10:38.345 DEBUG:teuthology.orchestra.run.smithi080:> uname -r 2024-02-19T21:10:38.362 INFO:teuthology.orchestra.run.smithi080.stdout:4.18.0-539.el8.x86_64 2024-02-19T21:10:38.362 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-539.el8.x86_64 vs 4.18.0-539.el8.x86_64 2024-02-19T21:10:38.362 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-19T21:10:38.363 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-19T21:10:39.364 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-02-19T21:10:39.364 DEBUG:teuthology.orchestra.run.smithi080:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-19T21:10:39.431 INFO:teuthology.orchestra.run.smithi080.stdout:ttyS1 2024-02-19T21:10:39.448 DEBUG:teuthology.parallel:result is None 2024-02-19T21:10:39.449 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-19T21:10:39.455 INFO:teuthology.task.internal:Creating test directory... 2024-02-19T21:10:39.456 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-19T21:10:39.458 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-19T21:10:39.481 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-19T21:10:39.488 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-19T21:10:39.497 INFO:teuthology.task.internal:Creating archive directory... 2024-02-19T21:10:39.497 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-19T21:10:39.515 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-19T21:10:39.560 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-19T21:10:39.568 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-19T21:10:39.568 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-19T21:10:39.598 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-19T21:10:39.634 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-19T21:10:39.643 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-19T21:10:39.648 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-19T21:10:39.660 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-19T21:10:39.661 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-19T21:10:39.670 INFO:teuthology.task.internal:Configuring sudo... 2024-02-19T21:10:39.670 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-19T21:10:39.687 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-19T21:10:39.717 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-19T21:10:39.726 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-19T21:10:39.726 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-19T21:10:39.755 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-19T21:10:39.776 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-19T21:10:39.858 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-19T21:10:39.904 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-19T21:10:39.988 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-19T21:10:40.030 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-19T21:10:40.030 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-19T21:10:40.096 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-19T21:10:40.144 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-19T21:10:40.199 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-19T21:10:40.285 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-19T21:10:40.329 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-02-19T21:10:40.329 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-19T21:10:40.398 DEBUG:teuthology.orchestra.run.smithi080:> sudo service rsyslog restart 2024-02-19T21:10:40.400 DEBUG:teuthology.orchestra.run.smithi157:> sudo service rsyslog restart 2024-02-19T21:10:40.461 INFO:teuthology.orchestra.run.smithi080.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-19T21:10:40.504 INFO:teuthology.orchestra.run.smithi157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-19T21:10:40.932 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-19T21:10:40.941 INFO:teuthology.task.internal:Starting timer... 2024-02-19T21:10:40.941 INFO:teuthology.run_tasks:Running task pcp... 2024-02-19T21:10:40.959 INFO:teuthology.run_tasks:Running task selinux... 2024-02-19T21:10:40.974 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-02-19T21:10:40.974 DEBUG:teuthology.orchestra.run.smithi080:> sudo service auditd rotate 2024-02-19T21:10:41.058 INFO:teuthology.orchestra.run.smithi080.stdout:Rotating logs: 2024-02-19T21:10:41.060 DEBUG:teuthology.orchestra.run.smithi157:> sudo service auditd rotate 2024-02-19T21:10:41.138 INFO:teuthology.orchestra.run.smithi157.stdout:Rotating logs: 2024-02-19T21:10:41.140 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-19T21:10:41.140 DEBUG:teuthology.orchestra.run.smithi080:> /usr/sbin/getenforce 2024-02-19T21:10:41.206 INFO:teuthology.orchestra.run.smithi080.stdout:Permissive 2024-02-19T21:10:41.207 DEBUG:teuthology.orchestra.run.smithi157:> /usr/sbin/getenforce 2024-02-19T21:10:41.234 INFO:teuthology.orchestra.run.smithi157.stdout:Permissive 2024-02-19T21:10:41.234 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi080.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi157.front.sepia.ceph.com': 'permissive'} 2024-02-19T21:10:41.235 DEBUG:teuthology.orchestra.run.smithi080:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-19T21:10:41.261 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T21:10:41.262 DEBUG:teuthology.orchestra.run.smithi157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-19T21:10:41.302 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T21:10:41.302 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-19T21:10:41.303 DEBUG:teuthology.orchestra.run.smithi080:> sudo /usr/sbin/setenforce permissive 2024-02-19T21:10:41.329 DEBUG:teuthology.orchestra.run.smithi157:> sudo /usr/sbin/setenforce permissive 2024-02-19T21:10:41.371 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-19T21:10:41.380 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-02-19T21:10:41.385 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-02-19T21:10:41.563 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-19T21:10:41.578 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-19T21:10:41.579 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi080.front.sepia.ceph.com,smithi157.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-19T21:16:49.634 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi080.front.sepia.ceph.com'), Remote(name='ubuntu@smithi157.front.sepia.ceph.com')] 2024-02-19T21:16:49.635 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-02-19T21:16:49.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T21:16:49.713 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-02-19T21:16:49.739 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-02-19T21:16:49.739 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-02-19T21:16:49.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T21:16:49.808 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-02-19T21:16:49.874 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-02-19T21:16:49.875 INFO:teuthology.run_tasks:Running task clock... 2024-02-19T21:16:49.887 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-19T21:16:49.887 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-19T21:16:49.888 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-19T21:16:49.890 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-19T21:16:49.890 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-19T21:16:49.919 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-19T21:16:49.933 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-19T21:16:49.947 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-19T21:16:49.960 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-19T21:16:50.001 INFO:teuthology.orchestra.run.smithi080.stderr:sudo: ntpd: command not found 2024-02-19T21:16:50.011 INFO:teuthology.orchestra.run.smithi080.stdout:506 Cannot talk to daemon 2024-02-19T21:16:50.025 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-19T21:16:50.026 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: ntpd: command not found 2024-02-19T21:16:50.036 INFO:teuthology.orchestra.run.smithi157.stdout:506 Cannot talk to daemon 2024-02-19T21:16:50.038 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-19T21:16:50.049 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-19T21:16:50.062 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-19T21:16:50.101 INFO:teuthology.orchestra.run.smithi080.stderr:bash: ntpq: command not found 2024-02-19T21:16:50.104 INFO:teuthology.orchestra.run.smithi080.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-19T21:16:50.105 INFO:teuthology.orchestra.run.smithi080.stdout:=============================================================================== 2024-02-19T21:16:50.105 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T21:16:50.105 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T21:16:50.105 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T21:16:50.105 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T21:16:50.129 INFO:teuthology.orchestra.run.smithi157.stderr:bash: ntpq: command not found 2024-02-19T21:16:50.132 INFO:teuthology.orchestra.run.smithi157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-19T21:16:50.133 INFO:teuthology.orchestra.run.smithi157.stdout:=============================================================================== 2024-02-19T21:16:50.133 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T21:16:50.133 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T21:16:50.133 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T21:16:50.133 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T21:16:50.134 INFO:teuthology.run_tasks:Running task pexec... 2024-02-19T21:16:50.144 INFO:teuthology.task.pexec:Executing custom commands... 2024-02-19T21:16:50.144 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi080.front.sepia.ceph.com 2024-02-19T21:16:50.144 DEBUG:teuthology.orchestra.run.smithi080:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-02-19T21:16:50.145 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi157.front.sepia.ceph.com 2024-02-19T21:16:50.145 DEBUG:teuthology.orchestra.run.smithi157:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-02-19T21:16:50.927 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:01:36 ago on Mon 19 Feb 2024 09:15:14 PM UTC. 2024-02-19T21:16:50.962 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:34 ago on Mon 19 Feb 2024 09:15:16 PM UTC. 2024-02-19T21:16:52.926 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-19T21:16:52.926 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:16:52.926 INFO:teuthology.orchestra.run.smithi080.stdout: Package Architecture Version Repository Size 2024-02-19T21:16:52.926 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:16:52.926 INFO:teuthology.orchestra.run.smithi080.stdout:Resetting modules: 2024-02-19T21:16:52.927 INFO:teuthology.orchestra.run.smithi080.stdout: container-tools 2024-02-19T21:16:52.927 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:16:52.927 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-02-19T21:16:52.927 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:16:52.927 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:16:53.020 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-19T21:16:53.021 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:16:53.021 INFO:teuthology.orchestra.run.smithi157.stdout: Package Architecture Version Repository Size 2024-02-19T21:16:53.021 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:16:53.021 INFO:teuthology.orchestra.run.smithi157.stdout:Resetting modules: 2024-02-19T21:16:53.021 INFO:teuthology.orchestra.run.smithi157.stdout: container-tools 2024-02-19T21:16:53.021 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:16:53.022 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-19T21:16:53.022 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:16:53.022 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:16:53.172 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-19T21:16:53.276 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-19T21:16:54.019 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:01:39 ago on Mon 19 Feb 2024 09:15:14 PM UTC. 2024-02-19T21:16:54.139 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:37 ago on Mon 19 Feb 2024 09:15:16 PM UTC. 2024-02-19T21:16:56.046 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-19T21:16:56.081 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:16:56.082 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-02-19T21:16:56.082 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:16:56.082 INFO:teuthology.orchestra.run.smithi080.stdout:Installing group/module packages: 2024-02-19T21:16:56.082 INFO:teuthology.orchestra.run.smithi080.stdout: aardvark-dns x86_64 2:1.10.0-1.module_el8+871+552be958 appstream 1.0 M 2024-02-19T21:16:56.082 INFO:teuthology.orchestra.run.smithi080.stdout: buildah x86_64 2:1.33.5-1.module_el8+885+7da147f3 appstream 9.7 M 2024-02-19T21:16:56.082 INFO:teuthology.orchestra.run.smithi080.stdout: cockpit-podman noarch 83-1.module_el8+847+7863d4e6 appstream 688 k 2024-02-19T21:16:56.083 INFO:teuthology.orchestra.run.smithi080.stdout: crun x86_64 1.14-1.module_el8+871+552be958 appstream 257 k 2024-02-19T21:16:56.083 INFO:teuthology.orchestra.run.smithi080.stdout: netavark x86_64 2:1.10.2-1.module_el8+885+7da147f3 appstream 4.3 M 2024-02-19T21:16:56.083 INFO:teuthology.orchestra.run.smithi080.stdout: python3-podman noarch 4.9.0-1.module_el8+847+7863d4e6 appstream 180 k 2024-02-19T21:16:56.083 INFO:teuthology.orchestra.run.smithi080.stdout: skopeo x86_64 2:1.14.3-0.1.module_el8+885+7da147f3 appstream 8.8 M 2024-02-19T21:16:56.083 INFO:teuthology.orchestra.run.smithi080.stdout: toolbox x86_64 0.0.99.5-1.module_el8+847+7863d4e6 appstream 2.5 M 2024-02-19T21:16:56.083 INFO:teuthology.orchestra.run.smithi080.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-02-19T21:16:56.084 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-02-19T21:16:56.084 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-02-19T21:16:56.084 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-02-19T21:16:56.084 INFO:teuthology.orchestra.run.smithi080.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-02-19T21:16:56.084 INFO:teuthology.orchestra.run.smithi080.stdout:Installing weak dependencies: 2024-02-19T21:16:56.084 INFO:teuthology.orchestra.run.smithi080.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2024-02-19T21:16:56.085 INFO:teuthology.orchestra.run.smithi080.stdout:Installing module profiles: 2024-02-19T21:16:56.085 INFO:teuthology.orchestra.run.smithi080.stdout: container-tools/common 2024-02-19T21:16:56.085 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:16:56.085 INFO:teuthology.orchestra.run.smithi080.stdout:Enabling module streams: 2024-02-19T21:16:56.085 INFO:teuthology.orchestra.run.smithi080.stdout: container-tools rhel8 2024-02-19T21:16:56.085 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:16:56.086 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-02-19T21:16:56.086 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:16:56.086 INFO:teuthology.orchestra.run.smithi080.stdout:Install 13 Packages 2024-02-19T21:16:56.086 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:16:56.087 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 28 M 2024-02-19T21:16:56.087 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 92 M 2024-02-19T21:16:56.087 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-02-19T21:16:56.152 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-19T21:16:56.189 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:16:56.189 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-02-19T21:16:56.190 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:16:56.190 INFO:teuthology.orchestra.run.smithi157.stdout:Installing group/module packages: 2024-02-19T21:16:56.190 INFO:teuthology.orchestra.run.smithi157.stdout: aardvark-dns x86_64 2:1.10.0-1.module_el8+871+552be958 appstream 1.0 M 2024-02-19T21:16:56.190 INFO:teuthology.orchestra.run.smithi157.stdout: buildah x86_64 2:1.33.5-1.module_el8+885+7da147f3 appstream 9.7 M 2024-02-19T21:16:56.190 INFO:teuthology.orchestra.run.smithi157.stdout: cockpit-podman noarch 83-1.module_el8+847+7863d4e6 appstream 688 k 2024-02-19T21:16:56.190 INFO:teuthology.orchestra.run.smithi157.stdout: crun x86_64 1.14-1.module_el8+871+552be958 appstream 257 k 2024-02-19T21:16:56.190 INFO:teuthology.orchestra.run.smithi157.stdout: netavark x86_64 2:1.10.2-1.module_el8+885+7da147f3 appstream 4.3 M 2024-02-19T21:16:56.191 INFO:teuthology.orchestra.run.smithi157.stdout: python3-podman noarch 4.9.0-1.module_el8+847+7863d4e6 appstream 180 k 2024-02-19T21:16:56.191 INFO:teuthology.orchestra.run.smithi157.stdout: skopeo x86_64 2:1.14.3-0.1.module_el8+885+7da147f3 appstream 8.8 M 2024-02-19T21:16:56.191 INFO:teuthology.orchestra.run.smithi157.stdout: toolbox x86_64 0.0.99.5-1.module_el8+847+7863d4e6 appstream 2.5 M 2024-02-19T21:16:56.191 INFO:teuthology.orchestra.run.smithi157.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-02-19T21:16:56.191 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-02-19T21:16:56.191 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-02-19T21:16:56.192 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-02-19T21:16:56.192 INFO:teuthology.orchestra.run.smithi157.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-02-19T21:16:56.192 INFO:teuthology.orchestra.run.smithi157.stdout:Installing weak dependencies: 2024-02-19T21:16:56.192 INFO:teuthology.orchestra.run.smithi157.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2024-02-19T21:16:56.192 INFO:teuthology.orchestra.run.smithi157.stdout:Installing module profiles: 2024-02-19T21:16:56.192 INFO:teuthology.orchestra.run.smithi157.stdout: container-tools/common 2024-02-19T21:16:56.193 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:16:56.193 INFO:teuthology.orchestra.run.smithi157.stdout:Enabling module streams: 2024-02-19T21:16:56.193 INFO:teuthology.orchestra.run.smithi157.stdout: container-tools rhel8 2024-02-19T21:16:56.193 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:16:56.193 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-19T21:16:56.193 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:16:56.193 INFO:teuthology.orchestra.run.smithi157.stdout:Install 13 Packages 2024-02-19T21:16:56.194 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:16:56.195 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 28 M 2024-02-19T21:16:56.195 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 92 M 2024-02-19T21:16:56.195 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-19T21:16:56.568 INFO:teuthology.orchestra.run.smithi157.stdout:(1/13): aardvark-dns-1.10.0-1.module_el8+871+55 3.1 MB/s | 1.0 MB 00:00 2024-02-19T21:16:56.609 INFO:teuthology.orchestra.run.smithi157.stdout:(2/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 911 kB/s | 38 kB 00:00 2024-02-19T21:16:56.634 INFO:teuthology.orchestra.run.smithi080.stdout:(1/13): aardvark-dns-1.10.0-1.module_el8+871+55 2.9 MB/s | 1.0 MB 00:00 2024-02-19T21:16:56.668 INFO:teuthology.orchestra.run.smithi157.stdout:(3/13): crun-1.14-1.module_el8+871+552be958.x86 4.3 MB/s | 257 kB 00:00 2024-02-19T21:16:56.692 INFO:teuthology.orchestra.run.smithi080.stdout:(2/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 651 kB/s | 38 kB 00:00 2024-02-19T21:16:56.726 INFO:teuthology.orchestra.run.smithi080.stdout:(3/13): cockpit-podman-83-1.module_el8+847+7863 1.5 MB/s | 688 kB 00:00 2024-02-19T21:16:56.727 INFO:teuthology.orchestra.run.smithi157.stdout:(4/13): cockpit-podman-83-1.module_el8+847+7863 1.4 MB/s | 688 kB 00:00 2024-02-19T21:16:56.776 INFO:teuthology.orchestra.run.smithi080.stdout:(4/13): crun-1.14-1.module_el8+871+552be958.x86 3.0 MB/s | 257 kB 00:00 2024-02-19T21:16:57.085 INFO:teuthology.orchestra.run.smithi080.stdout:(5/13): python3-podman-4.9.0-1.module_el8+847+7 585 kB/s | 180 kB 00:00 2024-02-19T21:16:57.127 INFO:teuthology.orchestra.run.smithi080.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 594 kB/s | 25 kB 00:00 2024-02-19T21:16:57.160 INFO:teuthology.orchestra.run.smithi157.stdout:(5/13): python3-podman-4.9.0-1.module_el8+847+7 416 kB/s | 180 kB 00:00 2024-02-19T21:16:57.194 INFO:teuthology.orchestra.run.smithi080.stdout:(7/13): python3-pyxdg-0.25-16.el8.noarch.rpm 1.4 MB/s | 94 kB 00:00 2024-02-19T21:16:57.236 INFO:teuthology.orchestra.run.smithi157.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 330 kB/s | 25 kB 00:00 2024-02-19T21:16:57.369 INFO:teuthology.orchestra.run.smithi157.stdout:(7/13): python3-pyxdg-0.25-16.el8.noarch.rpm 704 kB/s | 94 kB 00:00 2024-02-19T21:16:57.511 INFO:teuthology.orchestra.run.smithi157.stdout:(8/13): netavark-1.10.2-1.module_el8+885+7da147 5.1 MB/s | 4.3 MB 00:00 2024-02-19T21:16:58.212 INFO:teuthology.orchestra.run.smithi157.stdout:(9/13): toolbox-0.0.99.5-1.module_el8+847+7863d 3.6 MB/s | 2.5 MB 00:00 2024-02-19T21:16:58.287 INFO:teuthology.orchestra.run.smithi157.stdout:(10/13): udica-0.2.6-20.module_el8+804+f131391c 703 kB/s | 53 kB 00:00 2024-02-19T21:16:58.387 INFO:teuthology.orchestra.run.smithi157.stdout:(11/13): yajl-2.1.0-12.el8.x86_64.rpm 410 kB/s | 41 kB 00:00 2024-02-19T21:17:00.378 INFO:teuthology.orchestra.run.smithi080.stdout:(8/13): netavark-1.10.2-1.module_el8+885+7da147 1.2 MB/s | 4.3 MB 00:03 2024-02-19T21:17:03.477 INFO:teuthology.orchestra.run.smithi080.stdout:(9/13): toolbox-0.0.99.5-1.module_el8+847+7863d 835 kB/s | 2.5 MB 00:03 2024-02-19T21:17:03.552 INFO:teuthology.orchestra.run.smithi080.stdout:(10/13): udica-0.2.6-20.module_el8+804+f131391c 704 kB/s | 53 kB 00:00 2024-02-19T21:17:03.611 INFO:teuthology.orchestra.run.smithi080.stdout:(11/13): yajl-2.1.0-12.el8.x86_64.rpm 704 kB/s | 41 kB 00:00 2024-02-19T21:17:04.111 INFO:teuthology.orchestra.run.smithi080.stdout:(12/13): skopeo-1.14.3-0.1.module_el8+885+7da14 1.3 MB/s | 8.8 MB 00:06 2024-02-19T21:17:05.104 INFO:teuthology.orchestra.run.smithi157.stdout:(12/13): buildah-1.33.5-1.module_el8+885+7da147 1.1 MB/s | 9.7 MB 00:08 2024-02-19T21:17:05.744 INFO:teuthology.orchestra.run.smithi157.stdout:(13/13): skopeo-1.14.3-0.1.module_el8+885+7da14 1.1 MB/s | 8.8 MB 00:08 2024-02-19T21:17:05.745 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:17:05.745 INFO:teuthology.orchestra.run.smithi157.stdout:Total 2.9 MB/s | 28 MB 00:09 2024-02-19T21:17:05.945 INFO:teuthology.orchestra.run.smithi080.stdout:(13/13): buildah-1.33.5-1.module_el8+885+7da147 1.0 MB/s | 9.7 MB 00:09 2024-02-19T21:17:05.945 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:17:05.945 INFO:teuthology.orchestra.run.smithi080.stdout:Total 2.8 MB/s | 28 MB 00:09 2024-02-19T21:17:06.022 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-19T21:17:06.044 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-19T21:17:06.044 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-19T21:17:06.216 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-02-19T21:17:06.236 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-02-19T21:17:06.236 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-02-19T21:17:06.311 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-19T21:17:06.315 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-19T21:17:06.520 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-02-19T21:17:06.524 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-02-19T21:17:07.000 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-19T21:17:07.254 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-02-19T21:17:07.927 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2024-02-19T21:17:08.154 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2/13 2024-02-19T21:17:08.349 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/13 2024-02-19T21:17:08.421 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2024-02-19T21:17:08.555 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 4/13 2024-02-19T21:17:08.649 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2/13 2024-02-19T21:17:08.820 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 5/13 2024-02-19T21:17:08.836 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/13 2024-02-19T21:17:09.067 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 4/13 2024-02-19T21:17:09.333 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 5/13 2024-02-19T21:17:09.397 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 6/13 2024-02-19T21:17:09.916 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 6/13 2024-02-19T21:17:10.397 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : netavark-2:1.10.2-1.module_el8+885+7da147f3.x86_64 7/13 2024-02-19T21:17:10.655 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 8/13 2024-02-19T21:17:10.859 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : crun-1.14-1.module_el8+871+552be958.x86_64 9/13 2024-02-19T21:17:10.897 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : netavark-2:1.10.2-1.module_el8+885+7da147f3.x86_64 7/13 2024-02-19T21:17:11.138 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 8/13 2024-02-19T21:17:11.308 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 10/13 2024-02-19T21:17:11.333 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : crun-1.14-1.module_el8+871+552be958.x86_64 9/13 2024-02-19T21:17:11.547 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 11/13 2024-02-19T21:17:11.812 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-02-19T21:17:11.844 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 10/13 2024-02-19T21:17:11.998 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 13/13 2024-02-19T21:17:12.095 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 11/13 2024-02-19T21:17:12.347 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-02-19T21:17:12.432 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 13/13 2024-02-19T21:17:12.432 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 1/13 2024-02-19T21:17:12.433 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 2/13 2024-02-19T21:17:12.433 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 3/13 2024-02-19T21:17:12.433 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-02-19T21:17:12.433 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : crun-1.14-1.module_el8+871+552be958.x86_64 5/13 2024-02-19T21:17:12.433 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : netavark-2:1.10.2-1.module_el8+885+7da147f3.x86_64 6/13 2024-02-19T21:17:12.433 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 7/13 2024-02-19T21:17:12.433 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2024-02-19T21:17:12.433 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2024-02-19T21:17:12.433 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 10/13 2024-02-19T21:17:12.433 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 11/13 2024-02-19T21:17:12.433 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-02-19T21:17:12.551 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 13/13 2024-02-19T21:17:12.978 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 13/13 2024-02-19T21:17:12.978 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 1/13 2024-02-19T21:17:12.979 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 2/13 2024-02-19T21:17:12.979 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 3/13 2024-02-19T21:17:12.979 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-02-19T21:17:12.979 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : crun-1.14-1.module_el8+871+552be958.x86_64 5/13 2024-02-19T21:17:12.979 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : netavark-2:1.10.2-1.module_el8+885+7da147f3.x86_64 6/13 2024-02-19T21:17:12.979 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 7/13 2024-02-19T21:17:12.979 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2024-02-19T21:17:12.979 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2024-02-19T21:17:12.979 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 10/13 2024-02-19T21:17:12.979 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 11/13 2024-02-19T21:17:12.979 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-02-19T21:17:12.998 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2024-02-19T21:17:12.998 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:17:12.998 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-19T21:17:12.998 INFO:teuthology.orchestra.run.smithi157.stdout: aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x86_64 2024-02-19T21:17:12.998 INFO:teuthology.orchestra.run.smithi157.stdout: buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 2024-02-19T21:17:12.998 INFO:teuthology.orchestra.run.smithi157.stdout: cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 2024-02-19T21:17:12.998 INFO:teuthology.orchestra.run.smithi157.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2024-02-19T21:17:12.999 INFO:teuthology.orchestra.run.smithi157.stdout: crun-1.14-1.module_el8+871+552be958.x86_64 2024-02-19T21:17:12.999 INFO:teuthology.orchestra.run.smithi157.stdout: netavark-2:1.10.2-1.module_el8+885+7da147f3.x86_64 2024-02-19T21:17:12.999 INFO:teuthology.orchestra.run.smithi157.stdout: python3-podman-4.9.0-1.module_el8+847+7863d4e6.noarch 2024-02-19T21:17:12.999 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-02-19T21:17:12.999 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-02-19T21:17:12.999 INFO:teuthology.orchestra.run.smithi157.stdout: skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2024-02-19T21:17:12.999 INFO:teuthology.orchestra.run.smithi157.stdout: toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 2024-02-19T21:17:12.999 INFO:teuthology.orchestra.run.smithi157.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-02-19T21:17:12.999 INFO:teuthology.orchestra.run.smithi157.stdout: yajl-2.1.0-12.el8.x86_64 2024-02-19T21:17:12.999 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:17:12.999 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-19T21:17:13.337 DEBUG:teuthology.parallel:result is None 2024-02-19T21:17:13.581 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2024-02-19T21:17:13.581 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:17:13.581 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-02-19T21:17:13.581 INFO:teuthology.orchestra.run.smithi080.stdout: aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x86_64 2024-02-19T21:17:13.581 INFO:teuthology.orchestra.run.smithi080.stdout: buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 2024-02-19T21:17:13.582 INFO:teuthology.orchestra.run.smithi080.stdout: cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 2024-02-19T21:17:13.582 INFO:teuthology.orchestra.run.smithi080.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2024-02-19T21:17:13.582 INFO:teuthology.orchestra.run.smithi080.stdout: crun-1.14-1.module_el8+871+552be958.x86_64 2024-02-19T21:17:13.582 INFO:teuthology.orchestra.run.smithi080.stdout: netavark-2:1.10.2-1.module_el8+885+7da147f3.x86_64 2024-02-19T21:17:13.582 INFO:teuthology.orchestra.run.smithi080.stdout: python3-podman-4.9.0-1.module_el8+847+7863d4e6.noarch 2024-02-19T21:17:13.582 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-02-19T21:17:13.582 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-02-19T21:17:13.582 INFO:teuthology.orchestra.run.smithi080.stdout: skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2024-02-19T21:17:13.582 INFO:teuthology.orchestra.run.smithi080.stdout: toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 2024-02-19T21:17:13.582 INFO:teuthology.orchestra.run.smithi080.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-02-19T21:17:13.582 INFO:teuthology.orchestra.run.smithi080.stdout: yajl-2.1.0-12.el8.x86_64 2024-02-19T21:17:13.582 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:17:13.582 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-19T21:17:13.861 DEBUG:teuthology.parallel:result is None 2024-02-19T21:17:13.862 INFO:teuthology.run_tasks:Running task install... 2024-02-19T21:17:13.872 DEBUG:teuthology.task.install:project ceph 2024-02-19T21:17:13.872 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '81bd20d634209c7cb82c18be12b4b5a05643ebf1'}} 2024-02-19T21:17:13.872 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '81bd20d634209c7cb82c18be12b4b5a05643ebf1'} 2024-02-19T21:17:13.872 INFO:teuthology.task.install:Using flavor: default 2024-02-19T21:17:13.878 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-19T21:17:13.878 INFO:teuthology.task.install:extra packages: [] 2024-02-19T21:17:13.878 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81bd20d634209c7cb82c18be12b4b5a05643ebf1', 'tag': None, 'wait_for_package': False} 2024-02-19T21:17:13.879 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=81bd20d634209c7cb82c18be12b4b5a05643ebf1 2024-02-19T21:17:13.881 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81bd20d634209c7cb82c18be12b4b5a05643ebf1', 'tag': None, 'wait_for_package': False} 2024-02-19T21:17:13.881 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=81bd20d634209c7cb82c18be12b4b5a05643ebf1 2024-02-19T21:17:14.034 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/pacific/81bd20d634209c7cb82c18be12b4b5a05643ebf1/centos/8/flavors/default/ 2024-02-19T21:17:14.089 INFO:teuthology.task.install.rpm:Package version is 16.2.14-548.g81bd20d6 2024-02-19T21:17:14.239 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/pacific/81bd20d634209c7cb82c18be12b4b5a05643ebf1/centos/8/flavors/default/ 2024-02-19T21:17:14.239 INFO:teuthology.task.install.rpm:Package version is 16.2.14-548.g81bd20d6 2024-02-19T21:17:14.262 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/pacific/81bd20d634209c7cb82c18be12b4b5a05643ebf1/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/pacific/81bd20d634209c7cb82c18be12b4b5a05643ebf1/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/pacific/81bd20d634209c7cb82c18be12b4b5a05643ebf1/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-19T21:17:14.262 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-19T21:17:14.262 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-19T21:17:14.291 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-19T21:17:14.292 DEBUG:teuthology.orchestra.run.smithi080:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81bd20d634209c7cb82c18be12b4b5a05643ebf1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-19T21:17:14.359 DEBUG:teuthology.orchestra.run.smithi080:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-19T21:17:14.435 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/pacific/81bd20d634209c7cb82c18be12b4b5a05643ebf1/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/pacific/81bd20d634209c7cb82c18be12b4b5a05643ebf1/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/pacific/81bd20d634209c7cb82c18be12b4b5a05643ebf1/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-19T21:17:14.435 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-02-19T21:17:14.436 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-19T21:17:14.437 DEBUG:teuthology.orchestra.run.smithi080:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-19T21:17:14.467 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-19T21:17:14.467 DEBUG:teuthology.orchestra.run.smithi157:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81bd20d634209c7cb82c18be12b4b5a05643ebf1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-19T21:17:14.503 INFO:teuthology.orchestra.run.smithi080.stdout:check_obsoletes = 1 2024-02-19T21:17:14.504 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum clean all 2024-02-19T21:17:14.537 DEBUG:teuthology.orchestra.run.smithi157:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-19T21:17:14.615 DEBUG:teuthology.orchestra.run.smithi157:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-19T21:17:14.682 INFO:teuthology.orchestra.run.smithi157.stdout:check_obsoletes = 1 2024-02-19T21:17:14.683 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum clean all 2024-02-19T21:17:14.768 INFO:teuthology.orchestra.run.smithi080.stdout:76 files removed 2024-02-19T21:17:14.796 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-radosgw 2024-02-19T21:17:14.955 INFO:teuthology.orchestra.run.smithi157.stdout:76 files removed 2024-02-19T21:17:14.986 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-radosgw 2024-02-19T21:17:16.282 INFO:teuthology.orchestra.run.smithi080.stdout:ceph packages for x86_64 71 kB/s | 76 kB 00:01 2024-02-19T21:17:16.339 INFO:teuthology.orchestra.run.smithi157.stdout:ceph packages for x86_64 81 kB/s | 76 kB 00:00 2024-02-19T21:17:16.990 INFO:teuthology.orchestra.run.smithi157.stdout:ceph noarch packages 25 kB/s | 15 kB 00:00 2024-02-19T21:17:17.024 INFO:teuthology.orchestra.run.smithi080.stdout:ceph noarch packages 22 kB/s | 15 kB 00:00 2024-02-19T21:17:17.749 INFO:teuthology.orchestra.run.smithi157.stdout:ceph source packages 2.0 kB/s | 1.4 kB 00:00 2024-02-19T21:17:17.799 INFO:teuthology.orchestra.run.smithi080.stdout:ceph source packages 1.9 kB/s | 1.4 kB 00:00 2024-02-19T21:17:40.674 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 8 - AppStream 1.2 MB/s | 27 MB 00:22 2024-02-19T21:17:42.550 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 8 - AppStream 1.1 MB/s | 27 MB 00:24 2024-02-19T21:17:46.322 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 8 - BaseOS 12 MB/s | 10 MB 00:00 2024-02-19T21:17:48.272 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 8 - Extras 56 kB/s | 18 kB 00:00 2024-02-19T21:17:48.330 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 8 - BaseOS 11 MB/s | 10 MB 00:00 2024-02-19T21:17:48.631 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 8 - Extras common packages 28 kB/s | 6.9 kB 00:00 2024-02-19T21:17:49.799 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 8 - PowerTools 4.5 MB/s | 4.8 MB 00:01 2024-02-19T21:17:50.140 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 8 - Extras 98 kB/s | 18 kB 00:00 2024-02-19T21:17:50.557 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 8 - Extras common packages 22 kB/s | 6.9 kB 00:00 2024-02-19T21:17:51.025 INFO:teuthology.orchestra.run.smithi080.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2024-02-19T21:17:51.892 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 8 - PowerTools 3.9 MB/s | 4.8 MB 00:01 2024-02-19T21:17:53.201 INFO:teuthology.orchestra.run.smithi157.stdout:Copr repo for python3-asyncssh owned by ceph 8.9 kB/s | 3.5 kB 00:00 2024-02-19T21:17:53.679 INFO:teuthology.orchestra.run.smithi080.stdout:Extra Packages for Enterprise Linux 6.4 MB/s | 16 MB 00:02 2024-02-19T21:17:54.502 INFO:teuthology.orchestra.run.smithi157.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2024-02-19T21:17:57.451 INFO:teuthology.orchestra.run.smithi080.stdout:lab-extras 406 kB/s | 24 kB 00:00 2024-02-19T21:17:58.261 INFO:teuthology.orchestra.run.smithi157.stdout:lab-extras 454 kB/s | 24 kB 00:00 2024-02-19T21:18:01.026 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-19T21:18:01.028 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:18:01.028 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-02-19T21:18:01.028 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:18:01.029 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-02-19T21:18:01.029 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-radosgw x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 12 M 2024-02-19T21:18:01.029 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrading: 2024-02-19T21:18:01.029 INFO:teuthology.orchestra.run.smithi080.stdout: librados2 x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 3.7 M 2024-02-19T21:18:01.029 INFO:teuthology.orchestra.run.smithi080.stdout: librbd1 x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 4.2 M 2024-02-19T21:18:01.029 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-02-19T21:18:01.029 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-base x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 6.1 M 2024-02-19T21:18:01.029 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-common x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 24 M 2024-02-19T21:18:01.029 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-selinux x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 26 k 2024-02-19T21:18:01.029 INFO:teuthology.orchestra.run.smithi080.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-02-19T21:18:01.029 INFO:teuthology.orchestra.run.smithi080.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-02-19T21:18:01.029 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs2 x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 825 k 2024-02-19T21:18:01.029 INFO:teuthology.orchestra.run.smithi080.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-02-19T21:18:01.030 INFO:teuthology.orchestra.run.smithi080.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-02-19T21:18:01.030 INFO:teuthology.orchestra.run.smithi080.stdout: libradosstriper1 x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 494 k 2024-02-19T21:18:01.030 INFO:teuthology.orchestra.run.smithi080.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-02-19T21:18:01.030 INFO:teuthology.orchestra.run.smithi080.stdout: librgw2 x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 3.8 M 2024-02-19T21:18:01.030 INFO:teuthology.orchestra.run.smithi080.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-02-19T21:18:01.030 INFO:teuthology.orchestra.run.smithi080.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-02-19T21:18:01.030 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-argparse x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 45 k 2024-02-19T21:18:01.030 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-common x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 99 k 2024-02-19T21:18:01.030 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cephfs x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 215 k 2024-02-19T21:18:01.030 INFO:teuthology.orchestra.run.smithi080.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-02-19T21:18:01.030 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rados x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 389 k 2024-02-19T21:18:01.030 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rbd x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 369 k 2024-02-19T21:18:01.030 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rgw x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 114 k 2024-02-19T21:18:01.031 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:18:01.031 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-02-19T21:18:01.031 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:18:01.031 INFO:teuthology.orchestra.run.smithi080.stdout:Install 21 Packages 2024-02-19T21:18:01.031 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrade 2 Packages 2024-02-19T21:18:01.031 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:18:01.031 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 58 M 2024-02-19T21:18:01.031 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-02-19T21:18:01.794 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-19T21:18:01.797 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:18:01.797 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-02-19T21:18:01.797 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:18:01.797 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-19T21:18:01.797 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 12 M 2024-02-19T21:18:01.798 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrading: 2024-02-19T21:18:01.798 INFO:teuthology.orchestra.run.smithi157.stdout: librados2 x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 3.7 M 2024-02-19T21:18:01.798 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1 x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 4.2 M 2024-02-19T21:18:01.798 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-02-19T21:18:01.798 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 6.1 M 2024-02-19T21:18:01.798 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 24 M 2024-02-19T21:18:01.798 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 26 k 2024-02-19T21:18:01.798 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-02-19T21:18:01.798 INFO:teuthology.orchestra.run.smithi157.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-02-19T21:18:01.798 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2 x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 825 k 2024-02-19T21:18:01.798 INFO:teuthology.orchestra.run.smithi157.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-02-19T21:18:01.798 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-02-19T21:18:01.798 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1 x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 494 k 2024-02-19T21:18:01.798 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-02-19T21:18:01.798 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2 x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 3.8 M 2024-02-19T21:18:01.799 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-02-19T21:18:01.799 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-02-19T21:18:01.799 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 45 k 2024-02-19T21:18:01.799 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 99 k 2024-02-19T21:18:01.799 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 215 k 2024-02-19T21:18:01.799 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-02-19T21:18:01.799 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 389 k 2024-02-19T21:18:01.799 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 369 k 2024-02-19T21:18:01.799 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 114 k 2024-02-19T21:18:01.799 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:18:01.799 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-19T21:18:01.799 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:18:01.799 INFO:teuthology.orchestra.run.smithi157.stdout:Install 21 Packages 2024-02-19T21:18:01.799 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrade 2 Packages 2024-02-19T21:18:01.800 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:18:01.800 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 58 M 2024-02-19T21:18:01.800 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-19T21:18:02.235 INFO:teuthology.orchestra.run.smithi080.stdout:(1/23): ceph-base-16.2.14-548.g81bd20d6.el8.x86 6.7 MB/s | 6.1 MB 00:00 2024-02-19T21:18:02.352 INFO:teuthology.orchestra.run.smithi080.stdout:(2/23): ceph-selinux-16.2.14-548.g81bd20d6.el8. 219 kB/s | 26 kB 00:00 2024-02-19T21:18:02.544 INFO:teuthology.orchestra.run.smithi080.stdout:(3/23): libcephfs2-16.2.14-548.g81bd20d6.el8.x8 4.2 MB/s | 825 kB 00:00 2024-02-19T21:18:02.669 INFO:teuthology.orchestra.run.smithi080.stdout:(4/23): libradosstriper1-16.2.14-548.g81bd20d6. 3.9 MB/s | 494 kB 00:00 2024-02-19T21:18:03.111 INFO:teuthology.orchestra.run.smithi080.stdout:(5/23): librgw2-16.2.14-548.g81bd20d6.el8.x86_6 8.6 MB/s | 3.8 MB 00:00 2024-02-19T21:18:03.236 INFO:teuthology.orchestra.run.smithi080.stdout:(6/23): ceph-radosgw-16.2.14-548.g81bd20d6.el8. 6.0 MB/s | 12 MB 00:01 2024-02-19T21:18:03.262 INFO:teuthology.orchestra.run.smithi080.stdout:(7/23): python3-ceph-argparse-16.2.14-548.g81bd 299 kB/s | 45 kB 00:00 2024-02-19T21:18:03.303 INFO:teuthology.orchestra.run.smithi080.stdout:(8/23): python3-ceph-common-16.2.14-548.g81bd20 1.4 MB/s | 99 kB 00:00 2024-02-19T21:18:03.329 INFO:teuthology.orchestra.run.smithi080.stdout:(9/23): python3-cephfs-16.2.14-548.g81bd20d6.el 3.1 MB/s | 215 kB 00:00 2024-02-19T21:18:03.416 INFO:teuthology.orchestra.run.smithi080.stdout:(10/23): python3-rados-16.2.14-548.g81bd20d6.el 3.4 MB/s | 389 kB 00:00 2024-02-19T21:18:03.446 INFO:teuthology.orchestra.run.smithi080.stdout:(11/23): python3-rbd-16.2.14-548.g81bd20d6.el8. 3.1 MB/s | 369 kB 00:00 2024-02-19T21:18:03.488 INFO:teuthology.orchestra.run.smithi080.stdout:(12/23): python3-rgw-16.2.14-548.g81bd20d6.el8. 1.6 MB/s | 114 kB 00:00 2024-02-19T21:18:03.822 INFO:teuthology.orchestra.run.smithi080.stdout:(13/23): ceph-common-16.2.14-548.g81bd20d6.el8. 9.7 MB/s | 24 MB 00:02 2024-02-19T21:18:03.897 INFO:teuthology.orchestra.run.smithi080.stdout:(14/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 635 kB/s | 259 kB 00:00 2024-02-19T21:18:03.947 INFO:teuthology.orchestra.run.smithi080.stdout:(15/23): python3-prettytable-0.7.2-14.el8.noarc 351 kB/s | 44 kB 00:00 2024-02-19T21:18:03.973 INFO:teuthology.orchestra.run.smithi080.stdout:(16/23): librabbitmq-0.9.0-5.el8.x86_64.rpm 625 kB/s | 47 kB 00:00 2024-02-19T21:18:04.148 INFO:teuthology.orchestra.run.smithi080.stdout:(17/23): librdkafka-1.6.1-1.el8.x86_64.rpm 965 kB/s | 677 kB 00:00 2024-02-19T21:18:04.428 INFO:teuthology.orchestra.run.smithi157.stdout:(1/23): ceph-base-16.2.14-548.g81bd20d6.el8.x86 2.7 MB/s | 6.1 MB 00:02 2024-02-19T21:18:04.495 INFO:teuthology.orchestra.run.smithi157.stdout:(2/23): ceph-selinux-16.2.14-548.g81bd20d6.el8. 386 kB/s | 26 kB 00:00 2024-02-19T21:18:04.637 INFO:teuthology.orchestra.run.smithi157.stdout:(3/23): libcephfs2-16.2.14-548.g81bd20d6.el8.x8 5.7 MB/s | 825 kB 00:00 2024-02-19T21:18:04.762 INFO:teuthology.orchestra.run.smithi157.stdout:(4/23): libradosstriper1-16.2.14-548.g81bd20d6. 3.9 MB/s | 494 kB 00:00 2024-02-19T21:18:05.229 INFO:teuthology.orchestra.run.smithi157.stdout:(5/23): librgw2-16.2.14-548.g81bd20d6.el8.x86_6 8.1 MB/s | 3.8 MB 00:00 2024-02-19T21:18:05.288 INFO:teuthology.orchestra.run.smithi157.stdout:(6/23): python3-ceph-argparse-16.2.14-548.g81bd 774 kB/s | 45 kB 00:00 2024-02-19T21:18:05.371 INFO:teuthology.orchestra.run.smithi157.stdout:(7/23): python3-ceph-common-16.2.14-548.g81bd20 1.2 MB/s | 99 kB 00:00 2024-02-19T21:18:05.471 INFO:teuthology.orchestra.run.smithi157.stdout:(8/23): python3-cephfs-16.2.14-548.g81bd20d6.el 2.1 MB/s | 215 kB 00:00 2024-02-19T21:18:05.705 INFO:teuthology.orchestra.run.smithi157.stdout:(9/23): ceph-common-16.2.14-548.g81bd20d6.el8.x 6.9 MB/s | 24 MB 00:03 2024-02-19T21:18:05.730 INFO:teuthology.orchestra.run.smithi157.stdout:(10/23): python3-rados-16.2.14-548.g81bd20d6.el 1.5 MB/s | 389 kB 00:00 2024-02-19T21:18:05.775 INFO:teuthology.orchestra.run.smithi157.stdout:(11/23): python3-rbd-16.2.14-548.g81bd20d6.el8. 5.2 MB/s | 369 kB 00:00 2024-02-19T21:18:05.825 INFO:teuthology.orchestra.run.smithi157.stdout:(12/23): python3-rgw-16.2.14-548.g81bd20d6.el8. 1.2 MB/s | 114 kB 00:00 2024-02-19T21:18:06.209 INFO:teuthology.orchestra.run.smithi157.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 678 kB/s | 259 kB 00:00 2024-02-19T21:18:06.459 INFO:teuthology.orchestra.run.smithi157.stdout:(14/23): ceph-radosgw-16.2.14-548.g81bd20d6.el8 2.7 MB/s | 12 MB 00:04 2024-02-19T21:18:06.476 INFO:teuthology.orchestra.run.smithi157.stdout:(15/23): python3-prettytable-0.7.2-14.el8.noarc 164 kB/s | 44 kB 00:00 2024-02-19T21:18:06.509 INFO:teuthology.orchestra.run.smithi157.stdout:(16/23): librdkafka-1.6.1-1.el8.x86_64.rpm 921 kB/s | 677 kB 00:00 2024-02-19T21:18:06.568 INFO:teuthology.orchestra.run.smithi157.stdout:(17/23): librabbitmq-0.9.0-5.el8.x86_64.rpm 433 kB/s | 47 kB 00:00 2024-02-19T21:18:06.635 INFO:teuthology.orchestra.run.smithi157.stdout:(18/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.9 MB/s | 306 kB 00:00 2024-02-19T21:18:06.660 INFO:teuthology.orchestra.run.smithi157.stdout:(19/23): liboath-2.6.2-3.el8.x86_64.rpm 645 kB/s | 59 kB 00:00 2024-02-19T21:18:06.686 INFO:teuthology.orchestra.run.smithi157.stdout:(20/23): leveldb-1.22-1.el8.x86_64.rpm 1.0 MB/s | 181 kB 00:00 2024-02-19T21:18:06.711 INFO:teuthology.orchestra.run.smithi157.stdout:(21/23): libunwind-1.3.1-3.el8.x86_64.rpm 996 kB/s | 75 kB 00:00 2024-02-19T21:18:07.086 INFO:teuthology.orchestra.run.smithi157.stdout:(22/23): librbd1-16.2.14-548.g81bd20d6.el8.x86_ 10 MB/s | 4.2 MB 00:00 2024-02-19T21:18:07.153 INFO:teuthology.orchestra.run.smithi157.stdout:(23/23): librados2-16.2.14-548.g81bd20d6.el8.x8 7.6 MB/s | 3.7 MB 00:00 2024-02-19T21:18:07.157 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:18:07.158 INFO:teuthology.orchestra.run.smithi157.stdout:Total 11 MB/s | 58 MB 00:05 2024-02-19T21:18:07.199 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-19T21:18:07.248 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-19T21:18:07.248 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-19T21:18:07.603 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-19T21:18:07.606 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-19T21:18:08.642 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-19T21:18:08.868 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2024-02-19T21:18:09.023 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-02-19T21:18:09.388 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-02-19T21:18:09.547 INFO:teuthology.orchestra.run.smithi080.stdout:(18/23): leveldb-1.22-1.el8.x86_64.rpm 32 kB/s | 181 kB 00:05 2024-02-19T21:18:09.573 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librados2-2:16.2.14-548.g81bd20d6.el8.x86_64 3/25 2024-02-19T21:18:09.647 INFO:teuthology.orchestra.run.smithi080.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 751 kB/s | 75 kB 00:00 2024-02-19T21:18:09.660 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-2:16.2.14-548.g81bd20d6.el8.x86_64 3/25 2024-02-19T21:18:09.901 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rados-2:16.2.14-548.g81bd20d6.el8.x86_64 4/25 2024-02-19T21:18:10.073 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs2-2:16.2.14-548.g81bd20d6.el8.x86_64 5/25 2024-02-19T21:18:10.106 INFO:teuthology.orchestra.run.smithi080.stdout:(20/23): librados2-16.2.14-548.g81bd20d6.el8.x8 8.2 MB/s | 3.7 MB 00:00 2024-02-19T21:18:10.123 INFO:teuthology.orchestra.run.smithi080.stdout:(21/23): liboath-2.6.2-3.el8.x86_64.rpm 9.8 kB/s | 59 kB 00:05 2024-02-19T21:18:10.148 INFO:teuthology.orchestra.run.smithi080.stdout:(22/23): gperftools-libs-2.7-9.el8.x86_64.rpm 49 kB/s | 306 kB 00:06 2024-02-19T21:18:10.407 INFO:teuthology.orchestra.run.smithi080.stdout:(23/23): librbd1-16.2.14-548.g81bd20d6.el8.x86_ 14 MB/s | 4.2 MB 00:00 2024-02-19T21:18:10.408 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:18:10.408 INFO:teuthology.orchestra.run.smithi080.stdout:Total 6.2 MB/s | 58 MB 00:09 2024-02-19T21:18:10.447 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-02-19T21:18:10.490 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephfs2-2:16.2.14-548.g81bd20d6.el8.x86_64 5/25 2024-02-19T21:18:10.493 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-02-19T21:18:10.493 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-02-19T21:18:10.698 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librbd1-2:16.2.14-548.g81bd20d6.el8.x86_64 6/25 2024-02-19T21:18:10.750 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-2:16.2.14-548.g81bd20d6.el8.x86_64 6/25 2024-02-19T21:18:10.856 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-02-19T21:18:10.859 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-02-19T21:18:10.940 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/25 2024-02-19T21:18:11.460 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 8/25 2024-02-19T21:18:11.598 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librgw2-2:16.2.14-548.g81bd20d6.el8.x86_64 9/25 2024-02-19T21:18:11.672 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librgw2-2:16.2.14-548.g81bd20d6.el8.x86_64 9/25 2024-02-19T21:18:11.878 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2024-02-19T21:18:11.909 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-02-19T21:18:12.028 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-argparse-2:16.2.14-548.g81bd20d6.el8. 11/25 2024-02-19T21:18:12.143 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2024-02-19T21:18:12.217 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cephfs-2:16.2.14-548.g81bd20d6.el8.x86_64 12/25 2024-02-19T21:18:12.347 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-02-19T21:18:12.407 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rgw-2:16.2.14-548.g81bd20d6.el8.x86_64 13/25 2024-02-19T21:18:12.647 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rbd-2:16.2.14-548.g81bd20d6.el8.x86_64 14/25 2024-02-19T21:18:12.748 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-02-19T21:18:12.773 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libradosstriper1-2:16.2.14-548.g81bd20d6.el8.x86_6 15/25 2024-02-19T21:18:12.843 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libradosstriper1-2:16.2.14-548.g81bd20d6.el8.x86_6 15/25 2024-02-19T21:18:13.006 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : librados2-2:16.2.14-548.g81bd20d6.el8.x86_64 3/25 2024-02-19T21:18:13.116 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2024-02-19T21:18:13.119 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librados2-2:16.2.14-548.g81bd20d6.el8.x86_64 3/25 2024-02-19T21:18:13.317 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2024-02-19T21:18:13.378 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rados-2:16.2.14-548.g81bd20d6.el8.x86_64 4/25 2024-02-19T21:18:13.500 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2024-02-19T21:18:13.580 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephfs2-2:16.2.14-548.g81bd20d6.el8.x86_64 5/25 2024-02-19T21:18:13.706 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-common-2:16.2.14-548.g81bd20d6.el8.x8 19/25 2024-02-19T21:18:14.013 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libcephfs2-2:16.2.14-548.g81bd20d6.el8.x86_64 5/25 2024-02-19T21:18:14.222 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : librbd1-2:16.2.14-548.g81bd20d6.el8.x86_64 6/25 2024-02-19T21:18:14.287 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librbd1-2:16.2.14-548.g81bd20d6.el8.x86_64 6/25 2024-02-19T21:18:14.497 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/25 2024-02-19T21:18:14.962 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 8/25 2024-02-19T21:18:15.122 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librgw2-2:16.2.14-548.g81bd20d6.el8.x86_64 9/25 2024-02-19T21:18:15.201 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librgw2-2:16.2.14-548.g81bd20d6.el8.x86_64 9/25 2024-02-19T21:18:15.422 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2024-02-19T21:18:16.002 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ceph-argparse-2:16.2.14-548.g81bd20d6.el8. 11/25 2024-02-19T21:18:16.217 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:16.2.14-548.g81bd20d6.el8.x86_64 20/25 2024-02-19T21:18:16.233 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cephfs-2:16.2.14-548.g81bd20d6.el8.x86_64 12/25 2024-02-19T21:18:16.431 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-common-2:16.2.14-548.g81bd20d6.el8.x86_64 20/25 2024-02-19T21:18:16.439 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rgw-2:16.2.14-548.g81bd20d6.el8.x86_64 13/25 2024-02-19T21:18:16.646 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rbd-2:16.2.14-548.g81bd20d6.el8.x86_64 14/25 2024-02-19T21:18:16.830 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libradosstriper1-2:16.2.14-548.g81bd20d6.el8.x86_6 15/25 2024-02-19T21:18:16.898 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libradosstriper1-2:16.2.14-548.g81bd20d6.el8.x86_6 15/25 2024-02-19T21:18:17.149 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:16.2.14-548.g81bd20d6.el8.x86_64 20/25 2024-02-19T21:18:17.180 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2024-02-19T21:18:17.380 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2024-02-19T21:18:17.449 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-base-2:16.2.14-548.g81bd20d6.el8.x86_64 21/25 2024-02-19T21:18:17.552 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2024-02-19T21:18:17.561 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-base-2:16.2.14-548.g81bd20d6.el8.x86_64 21/25 2024-02-19T21:18:17.747 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-selinux-2:16.2.14-548.g81bd20d6.el8.x86_64 22/25 2024-02-19T21:18:17.755 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ceph-common-2:16.2.14-548.g81bd20d6.el8.x8 19/25 2024-02-19T21:18:20.342 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-common-2:16.2.14-548.g81bd20d6.el8.x86_64 20/25 2024-02-19T21:18:20.613 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-common-2:16.2.14-548.g81bd20d6.el8.x86_64 20/25 2024-02-19T21:18:21.313 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-common-2:16.2.14-548.g81bd20d6.el8.x86_64 20/25 2024-02-19T21:18:21.627 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-base-2:16.2.14-548.g81bd20d6.el8.x86_64 21/25 2024-02-19T21:18:21.771 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-base-2:16.2.14-548.g81bd20d6.el8.x86_64 21/25 2024-02-19T21:18:21.945 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-selinux-2:16.2.14-548.g81bd20d6.el8.x86_64 22/25 2024-02-19T21:18:37.713 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-selinux-2:16.2.14-548.g81bd20d6.el8.x86_64 22/25 2024-02-19T21:18:37.713 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /sys 2024-02-19T21:18:37.713 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /proc 2024-02-19T21:18:37.713 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /dev 2024-02-19T21:18:37.714 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /run 2024-02-19T21:18:37.714 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /mnt 2024-02-19T21:18:37.714 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /var/tmp 2024-02-19T21:18:37.714 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /home 2024-02-19T21:18:37.714 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /tmp 2024-02-19T21:18:37.714 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /dev 2024-02-19T21:18:37.714 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:18:38.904 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-radosgw-2:16.2.14-548.g81bd20d6.el8.x86_64 23/25 2024-02-19T21:18:38.982 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-548.g81bd20d6.el8.x86_64 23/25 2024-02-19T21:18:38.982 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-02-19T21:18:39.195 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-02-19T21:18:39.196 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2024-02-19T21:18:39.871 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2024-02-19T21:18:39.872 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-base-2:16.2.14-548.g81bd20d6.el8.x86_64 1/25 2024-02-19T21:18:39.872 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-common-2:16.2.14-548.g81bd20d6.el8.x86_64 2/25 2024-02-19T21:18:39.872 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-radosgw-2:16.2.14-548.g81bd20d6.el8.x86_64 3/25 2024-02-19T21:18:39.872 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-selinux-2:16.2.14-548.g81bd20d6.el8.x86_64 4/25 2024-02-19T21:18:39.872 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs2-2:16.2.14-548.g81bd20d6.el8.x86_64 5/25 2024-02-19T21:18:39.872 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libradosstriper1-2:16.2.14-548.g81bd20d6.el8.x86_6 6/25 2024-02-19T21:18:39.872 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librgw2-2:16.2.14-548.g81bd20d6.el8.x86_64 7/25 2024-02-19T21:18:39.872 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-argparse-2:16.2.14-548.g81bd20d6.el8. 8/25 2024-02-19T21:18:39.872 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-common-2:16.2.14-548.g81bd20d6.el8.x8 9/25 2024-02-19T21:18:39.872 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cephfs-2:16.2.14-548.g81bd20d6.el8.x86_64 10/25 2024-02-19T21:18:39.872 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rados-2:16.2.14-548.g81bd20d6.el8.x86_64 11/25 2024-02-19T21:18:39.872 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rbd-2:16.2.14-548.g81bd20d6.el8.x86_64 12/25 2024-02-19T21:18:39.872 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rgw-2:16.2.14-548.g81bd20d6.el8.x86_64 13/25 2024-02-19T21:18:39.873 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2024-02-19T21:18:39.873 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2024-02-19T21:18:39.873 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2024-02-19T21:18:39.873 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/25 2024-02-19T21:18:39.873 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2024-02-19T21:18:39.873 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2024-02-19T21:18:39.873 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2024-02-19T21:18:39.873 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2024-02-19T21:18:39.873 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-2:16.2.14-548.g81bd20d6.el8.x86_64 22/25 2024-02-19T21:18:39.873 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2024-02-19T21:18:39.873 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-2:16.2.14-548.g81bd20d6.el8.x86_64 24/25 2024-02-19T21:18:40.828 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2024-02-19T21:18:40.828 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:18:40.829 INFO:teuthology.orchestra.run.smithi157.stdout:Upgraded: 2024-02-19T21:18:40.829 INFO:teuthology.orchestra.run.smithi157.stdout: librados2-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:40.829 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:40.829 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-19T21:18:40.829 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:40.829 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:40.829 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:40.829 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:40.829 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-02-19T21:18:40.829 INFO:teuthology.orchestra.run.smithi157.stdout: leveldb-1.22-1.el8.x86_64 2024-02-19T21:18:40.829 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:40.829 INFO:teuthology.orchestra.run.smithi157.stdout: liboath-2.6.2-3.el8.x86_64 2024-02-19T21:18:40.829 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-02-19T21:18:40.830 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:40.830 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-02-19T21:18:40.830 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:40.830 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind-1.3.1-3.el8.x86_64 2024-02-19T21:18:40.830 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-02-19T21:18:40.830 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:40.830 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:40.830 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:40.830 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-02-19T21:18:40.830 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:40.830 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:40.830 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:40.830 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:18:40.831 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-19T21:18:41.185 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-test 2024-02-19T21:18:41.788 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-selinux-2:16.2.14-548.g81bd20d6.el8.x86_64 22/25 2024-02-19T21:18:41.788 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /sys 2024-02-19T21:18:41.789 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /proc 2024-02-19T21:18:41.789 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /dev 2024-02-19T21:18:41.789 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /run 2024-02-19T21:18:41.789 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /mnt 2024-02-19T21:18:41.789 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /var/tmp 2024-02-19T21:18:41.789 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /home 2024-02-19T21:18:41.789 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /tmp 2024-02-19T21:18:41.789 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /dev 2024-02-19T21:18:41.790 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:18:41.950 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:00:43 ago on Mon 19 Feb 2024 09:17:58 PM UTC. 2024-02-19T21:18:42.972 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-radosgw-2:16.2.14-548.g81bd20d6.el8.x86_64 23/25 2024-02-19T21:18:43.069 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-548.g81bd20d6.el8.x86_64 23/25 2024-02-19T21:18:43.069 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-02-19T21:18:43.309 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-02-19T21:18:43.309 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2024-02-19T21:18:43.499 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-19T21:18:43.500 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:18:43.500 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-02-19T21:18:43.500 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:18:43.500 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-19T21:18:43.500 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 52 M 2024-02-19T21:18:43.500 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-02-19T21:18:43.501 INFO:teuthology.orchestra.run.smithi157.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-02-19T21:18:43.501 INFO:teuthology.orchestra.run.smithi157.stdout: libcephsqlite x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 174 k 2024-02-19T21:18:43.501 INFO:teuthology.orchestra.run.smithi157.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-02-19T21:18:43.501 INFO:teuthology.orchestra.run.smithi157.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-02-19T21:18:43.501 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-02-19T21:18:43.501 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:18:43.501 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-19T21:18:43.501 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:18:43.501 INFO:teuthology.orchestra.run.smithi157.stdout:Install 6 Packages 2024-02-19T21:18:43.501 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:18:43.502 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 53 M 2024-02-19T21:18:43.502 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 197 M 2024-02-19T21:18:43.502 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-19T21:18:43.990 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2024-02-19T21:18:43.990 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-base-2:16.2.14-548.g81bd20d6.el8.x86_64 1/25 2024-02-19T21:18:43.990 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-common-2:16.2.14-548.g81bd20d6.el8.x86_64 2/25 2024-02-19T21:18:43.990 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-radosgw-2:16.2.14-548.g81bd20d6.el8.x86_64 3/25 2024-02-19T21:18:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-selinux-2:16.2.14-548.g81bd20d6.el8.x86_64 4/25 2024-02-19T21:18:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephfs2-2:16.2.14-548.g81bd20d6.el8.x86_64 5/25 2024-02-19T21:18:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libradosstriper1-2:16.2.14-548.g81bd20d6.el8.x86_6 6/25 2024-02-19T21:18:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librgw2-2:16.2.14-548.g81bd20d6.el8.x86_64 7/25 2024-02-19T21:18:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ceph-argparse-2:16.2.14-548.g81bd20d6.el8. 8/25 2024-02-19T21:18:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ceph-common-2:16.2.14-548.g81bd20d6.el8.x8 9/25 2024-02-19T21:18:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cephfs-2:16.2.14-548.g81bd20d6.el8.x86_64 10/25 2024-02-19T21:18:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rados-2:16.2.14-548.g81bd20d6.el8.x86_64 11/25 2024-02-19T21:18:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rbd-2:16.2.14-548.g81bd20d6.el8.x86_64 12/25 2024-02-19T21:18:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rgw-2:16.2.14-548.g81bd20d6.el8.x86_64 13/25 2024-02-19T21:18:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2024-02-19T21:18:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2024-02-19T21:18:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2024-02-19T21:18:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/25 2024-02-19T21:18:43.992 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2024-02-19T21:18:43.992 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2024-02-19T21:18:43.992 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2024-02-19T21:18:43.992 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2024-02-19T21:18:43.992 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados2-2:16.2.14-548.g81bd20d6.el8.x86_64 22/25 2024-02-19T21:18:43.992 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2024-02-19T21:18:43.992 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librbd1-2:16.2.14-548.g81bd20d6.el8.x86_64 24/25 2024-02-19T21:18:44.048 INFO:teuthology.orchestra.run.smithi157.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 574 kB/s | 203 kB 00:00 2024-02-19T21:18:44.232 INFO:teuthology.orchestra.run.smithi157.stdout:(2/6): oniguruma-6.8.2-3.el8.x86_64.rpm 1.0 MB/s | 188 kB 00:00 2024-02-19T21:18:44.357 INFO:teuthology.orchestra.run.smithi157.stdout:(3/6): libcephsqlite-16.2.14-548.g81bd20d6.el8. 262 kB/s | 174 kB 00:00 2024-02-19T21:18:44.616 INFO:teuthology.orchestra.run.smithi157.stdout:(4/6): socat-1.7.4.1-1.el8.x86_64.rpm 842 kB/s | 323 kB 00:00 2024-02-19T21:18:44.649 INFO:teuthology.orchestra.run.smithi157.stdout:(5/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 242 kB/s | 71 kB 00:00 2024-02-19T21:18:44.809 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2024-02-19T21:18:44.810 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:18:44.810 INFO:teuthology.orchestra.run.smithi080.stdout:Upgraded: 2024-02-19T21:18:44.810 INFO:teuthology.orchestra.run.smithi080.stdout: librados2-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:44.810 INFO:teuthology.orchestra.run.smithi080.stdout: librbd1-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:44.810 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-02-19T21:18:44.810 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-base-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:44.810 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-common-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:44.810 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-radosgw-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:44.810 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-selinux-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:44.810 INFO:teuthology.orchestra.run.smithi080.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-02-19T21:18:44.810 INFO:teuthology.orchestra.run.smithi080.stdout: leveldb-1.22-1.el8.x86_64 2024-02-19T21:18:44.810 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs2-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:44.810 INFO:teuthology.orchestra.run.smithi080.stdout: liboath-2.6.2-3.el8.x86_64 2024-02-19T21:18:44.811 INFO:teuthology.orchestra.run.smithi080.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-02-19T21:18:44.811 INFO:teuthology.orchestra.run.smithi080.stdout: libradosstriper1-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:44.811 INFO:teuthology.orchestra.run.smithi080.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-02-19T21:18:44.811 INFO:teuthology.orchestra.run.smithi080.stdout: librgw2-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:44.811 INFO:teuthology.orchestra.run.smithi080.stdout: libunwind-1.3.1-3.el8.x86_64 2024-02-19T21:18:44.811 INFO:teuthology.orchestra.run.smithi080.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-02-19T21:18:44.811 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-argparse-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:44.811 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-common-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:44.811 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cephfs-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:44.811 INFO:teuthology.orchestra.run.smithi080.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-02-19T21:18:44.811 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rados-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:44.811 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rbd-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:44.811 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rgw-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:18:44.811 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:18:44.812 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-19T21:18:45.088 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-test 2024-02-19T21:18:45.846 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:00:48 ago on Mon 19 Feb 2024 09:17:57 PM UTC. 2024-02-19T21:18:47.405 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-19T21:18:47.405 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:18:47.406 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-02-19T21:18:47.406 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:18:47.406 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-02-19T21:18:47.406 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-test x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 52 M 2024-02-19T21:18:47.406 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-02-19T21:18:47.406 INFO:teuthology.orchestra.run.smithi080.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-02-19T21:18:47.406 INFO:teuthology.orchestra.run.smithi080.stdout: libcephsqlite x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 174 k 2024-02-19T21:18:47.406 INFO:teuthology.orchestra.run.smithi080.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-02-19T21:18:47.406 INFO:teuthology.orchestra.run.smithi080.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-02-19T21:18:47.406 INFO:teuthology.orchestra.run.smithi080.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-02-19T21:18:47.406 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:18:47.406 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-02-19T21:18:47.407 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:18:47.407 INFO:teuthology.orchestra.run.smithi080.stdout:Install 6 Packages 2024-02-19T21:18:47.407 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:18:47.407 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 53 M 2024-02-19T21:18:47.407 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 197 M 2024-02-19T21:18:47.407 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-02-19T21:18:47.877 INFO:teuthology.orchestra.run.smithi080.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 716 kB/s | 203 kB 00:00 2024-02-19T21:18:48.179 INFO:teuthology.orchestra.run.smithi080.stdout:(2/6): libcephsqlite-16.2.14-548.g81bd20d6.el8. 297 kB/s | 174 kB 00:00 2024-02-19T21:18:48.453 INFO:teuthology.orchestra.run.smithi080.stdout:(3/6): oniguruma-6.8.2-3.el8.x86_64.rpm 327 kB/s | 188 kB 00:00 2024-02-19T21:18:48.478 INFO:teuthology.orchestra.run.smithi080.stdout:(4/6): socat-1.7.4.1-1.el8.x86_64.rpm 1.1 MB/s | 323 kB 00:00 2024-02-19T21:18:48.587 INFO:teuthology.orchestra.run.smithi080.stdout:(5/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 529 kB/s | 71 kB 00:00 2024-02-19T21:19:05.397 INFO:teuthology.orchestra.run.smithi157.stdout:(6/6): ceph-test-16.2.14-548.g81bd20d6.el8.x86_ 2.4 MB/s | 52 MB 00:21 2024-02-19T21:19:05.398 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:19:05.399 INFO:teuthology.orchestra.run.smithi157.stdout:Total 2.4 MB/s | 53 MB 00:21 2024-02-19T21:19:05.441 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-19T21:19:05.462 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-19T21:19:05.462 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-19T21:19:05.750 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-19T21:19:05.753 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-19T21:19:06.222 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-19T21:19:06.488 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2024-02-19T21:19:06.667 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2024-02-19T21:19:06.814 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/6 2024-02-19T21:19:06.876 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/6 2024-02-19T21:19:07.054 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2024-02-19T21:19:07.239 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephsqlite-2:16.2.14-548.g81bd20d6.el8.x86_64 5/6 2024-02-19T21:19:07.458 INFO:teuthology.orchestra.run.smithi080.stdout:(6/6): ceph-test-16.2.14-548.g81bd20d6.el8.x86_ 2.6 MB/s | 52 MB 00:19 2024-02-19T21:19:07.460 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:19:07.461 INFO:teuthology.orchestra.run.smithi080.stdout:Total 2.6 MB/s | 53 MB 00:20 2024-02-19T21:19:07.501 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-02-19T21:19:07.521 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-02-19T21:19:07.521 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-02-19T21:19:07.808 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-02-19T21:19:07.811 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-02-19T21:19:08.294 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-02-19T21:19:08.535 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2024-02-19T21:19:08.746 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2024-02-19T21:19:08.902 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/6 2024-02-19T21:19:08.980 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/6 2024-02-19T21:19:09.210 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2024-02-19T21:19:09.360 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephsqlite-2:16.2.14-548.g81bd20d6.el8.x86_64 5/6 2024-02-19T21:19:11.865 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephsqlite-2:16.2.14-548.g81bd20d6.el8.x86_64 5/6 2024-02-19T21:19:12.128 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-test-2:16.2.14-548.g81bd20d6.el8.x86_64 6/6 2024-02-19T21:19:12.420 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-test-2:16.2.14-548.g81bd20d6.el8.x86_64 6/6 2024-02-19T21:19:12.421 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-test-2:16.2.14-548.g81bd20d6.el8.x86_64 1/6 2024-02-19T21:19:12.421 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephsqlite-2:16.2.14-548.g81bd20d6.el8.x86_64 2/6 2024-02-19T21:19:12.421 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2024-02-19T21:19:12.421 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 4/6 2024-02-19T21:19:12.421 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2024-02-19T21:19:13.546 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2024-02-19T21:19:13.546 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:19:13.546 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-19T21:19:13.546 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:19:13.546 INFO:teuthology.orchestra.run.smithi157.stdout: jq-1.6-8.el8.x86_64 2024-02-19T21:19:13.546 INFO:teuthology.orchestra.run.smithi157.stdout: libcephsqlite-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:19:13.546 INFO:teuthology.orchestra.run.smithi157.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-02-19T21:19:13.546 INFO:teuthology.orchestra.run.smithi157.stdout: socat-1.7.4.1-1.el8.x86_64 2024-02-19T21:19:13.546 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-02-19T21:19:13.546 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:19:13.547 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-19T21:19:13.771 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph 2024-02-19T21:19:14.037 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libcephsqlite-2:16.2.14-548.g81bd20d6.el8.x86_64 5/6 2024-02-19T21:19:14.316 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-test-2:16.2.14-548.g81bd20d6.el8.x86_64 6/6 2024-02-19T21:19:14.532 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:16 ago on Mon 19 Feb 2024 09:17:58 PM UTC. 2024-02-19T21:19:14.623 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-test-2:16.2.14-548.g81bd20d6.el8.x86_64 6/6 2024-02-19T21:19:14.624 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-test-2:16.2.14-548.g81bd20d6.el8.x86_64 1/6 2024-02-19T21:19:14.624 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephsqlite-2:16.2.14-548.g81bd20d6.el8.x86_64 2/6 2024-02-19T21:19:14.624 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2024-02-19T21:19:14.624 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 4/6 2024-02-19T21:19:14.624 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2024-02-19T21:19:15.055 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2024-02-19T21:19:15.055 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:19:15.055 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-02-19T21:19:15.056 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-test-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:19:15.056 INFO:teuthology.orchestra.run.smithi080.stdout: jq-1.6-8.el8.x86_64 2024-02-19T21:19:15.056 INFO:teuthology.orchestra.run.smithi080.stdout: libcephsqlite-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:19:15.056 INFO:teuthology.orchestra.run.smithi080.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-02-19T21:19:15.056 INFO:teuthology.orchestra.run.smithi080.stdout: socat-1.7.4.1-1.el8.x86_64 2024-02-19T21:19:15.056 INFO:teuthology.orchestra.run.smithi080.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-02-19T21:19:15.056 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:19:15.056 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-19T21:19:15.318 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph 2024-02-19T21:19:16.073 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:01:19 ago on Mon 19 Feb 2024 09:17:57 PM UTC. 2024-02-19T21:19:16.095 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-19T21:19:16.099 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:19:16.099 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-02-19T21:19:16.099 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:19:16.099 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-19T21:19:16.099 INFO:teuthology.orchestra.run.smithi157.stdout: ceph x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 6.4 k 2024-02-19T21:19:16.099 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-02-19T21:19:16.099 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 2.4 M 2024-02-19T21:19:16.099 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 1.6 M 2024-02-19T21:19:16.099 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 245 k 2024-02-19T21:19:16.099 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 5.2 M 2024-02-19T21:19:16.099 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 19 M 2024-02-19T21:19:16.100 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-02-19T21:19:16.100 INFO:teuthology.orchestra.run.smithi157.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-02-19T21:19:16.100 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-02-19T21:19:16.100 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-02-19T21:19:16.100 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-02-19T21:19:16.100 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-02-19T21:19:16.100 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-02-19T21:19:16.100 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-02-19T21:19:16.100 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-02-19T21:19:16.100 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-02-19T21:19:16.100 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-02-19T21:19:16.100 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-02-19T21:19:16.100 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-02-19T21:19:16.101 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-02-19T21:19:16.101 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-02-19T21:19:16.101 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-02-19T21:19:16.101 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-02-19T21:19:16.101 INFO:teuthology.orchestra.run.smithi157.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-02-19T21:19:16.101 INFO:teuthology.orchestra.run.smithi157.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-02-19T21:19:16.101 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-02-19T21:19:16.101 INFO:teuthology.orchestra.run.smithi157.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-02-19T21:19:16.101 INFO:teuthology.orchestra.run.smithi157.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-02-19T21:19:16.101 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-02-19T21:19:16.101 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-02-19T21:19:16.101 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-02-19T21:19:16.101 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-02-19T21:19:16.101 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:19:16.101 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-19T21:19:16.102 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:19:16.102 INFO:teuthology.orchestra.run.smithi157.stdout:Install 32 Packages 2024-02-19T21:19:16.102 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:19:16.102 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 32 M 2024-02-19T21:19:16.102 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 104 M 2024-02-19T21:19:16.103 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-19T21:19:16.707 INFO:teuthology.orchestra.run.smithi157.stdout:(1/32): ceph-16.2.14-548.g81bd20d6.el8.x86_64.r 52 kB/s | 6.4 kB 00:00 2024-02-19T21:19:16.865 INFO:teuthology.orchestra.run.smithi157.stdout:(2/32): ceph-mgr-16.2.14-548.g81bd20d6.el8.x86_ 5.8 MB/s | 1.6 MB 00:00 2024-02-19T21:19:17.233 INFO:teuthology.orchestra.run.smithi157.stdout:(3/32): ceph-mon-16.2.14-548.g81bd20d6.el8.x86_ 9.9 MB/s | 5.2 MB 00:00 2024-02-19T21:19:17.291 INFO:teuthology.orchestra.run.smithi157.stdout:(4/32): ceph-mgr-modules-core-16.2.14-548.g81bd 4.1 MB/s | 245 kB 00:00 2024-02-19T21:19:17.628 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-19T21:19:17.631 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:19:17.631 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-02-19T21:19:17.631 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:19:17.631 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-02-19T21:19:17.631 INFO:teuthology.orchestra.run.smithi080.stdout: ceph x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 6.4 k 2024-02-19T21:19:17.631 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-02-19T21:19:17.632 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mds x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 2.4 M 2024-02-19T21:19:17.632 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 1.6 M 2024-02-19T21:19:17.632 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-modules-core noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 245 k 2024-02-19T21:19:17.632 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mon x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 5.2 M 2024-02-19T21:19:17.632 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-osd x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 19 M 2024-02-19T21:19:17.632 INFO:teuthology.orchestra.run.smithi080.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-02-19T21:19:17.632 INFO:teuthology.orchestra.run.smithi080.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-02-19T21:19:17.632 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-02-19T21:19:17.632 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-02-19T21:19:17.632 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-02-19T21:19:17.632 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-02-19T21:19:17.632 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-02-19T21:19:17.632 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-02-19T21:19:17.633 INFO:teuthology.orchestra.run.smithi080.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-02-19T21:19:17.633 INFO:teuthology.orchestra.run.smithi080.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-02-19T21:19:17.633 INFO:teuthology.orchestra.run.smithi080.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-02-19T21:19:17.633 INFO:teuthology.orchestra.run.smithi080.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-02-19T21:19:17.633 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-02-19T21:19:17.633 INFO:teuthology.orchestra.run.smithi080.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-02-19T21:19:17.633 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-02-19T21:19:17.633 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-02-19T21:19:17.633 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-02-19T21:19:17.633 INFO:teuthology.orchestra.run.smithi080.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-02-19T21:19:17.633 INFO:teuthology.orchestra.run.smithi080.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-02-19T21:19:17.633 INFO:teuthology.orchestra.run.smithi080.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-02-19T21:19:17.633 INFO:teuthology.orchestra.run.smithi080.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-02-19T21:19:17.633 INFO:teuthology.orchestra.run.smithi080.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-02-19T21:19:17.634 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-02-19T21:19:17.634 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-02-19T21:19:17.634 INFO:teuthology.orchestra.run.smithi080.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-02-19T21:19:17.634 INFO:teuthology.orchestra.run.smithi080.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-02-19T21:19:17.634 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:19:17.634 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-02-19T21:19:17.634 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:19:17.634 INFO:teuthology.orchestra.run.smithi080.stdout:Install 32 Packages 2024-02-19T21:19:17.634 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:19:17.635 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 32 M 2024-02-19T21:19:17.635 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 104 M 2024-02-19T21:19:17.635 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-02-19T21:19:17.683 INFO:teuthology.orchestra.run.smithi157.stdout:(5/32): python3-mako-1.0.6-14.el8.noarch.rpm 401 kB/s | 157 kB 00:00 2024-02-19T21:19:17.934 INFO:teuthology.orchestra.run.smithi157.stdout:(6/32): ceph-osd-16.2.14-548.g81bd20d6.el8.x86_ 17 MB/s | 19 MB 00:01 2024-02-19T21:19:17.950 INFO:teuthology.orchestra.run.smithi157.stdout:(7/32): python3-markupsafe-0.23-19.el8.x86_64.r 145 kB/s | 39 kB 00:00 2024-02-19T21:19:18.109 INFO:teuthology.orchestra.run.smithi157.stdout:(8/32): ceph-mds-16.2.14-548.g81bd20d6.el8.x86_ 1.6 MB/s | 2.4 MB 00:01 2024-02-19T21:19:18.126 INFO:teuthology.orchestra.run.smithi157.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 325 kB/s | 57 kB 00:00 2024-02-19T21:19:18.185 INFO:teuthology.orchestra.run.smithi157.stdout:(10/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 413 kB/s | 103 kB 00:00 2024-02-19T21:19:18.227 INFO:teuthology.orchestra.run.smithi157.stdout:(11/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.4 MB/s | 249 kB 00:00 2024-02-19T21:19:18.235 INFO:teuthology.orchestra.run.smithi080.stdout:(1/32): ceph-16.2.14-548.g81bd20d6.el8.x86_64.r 35 kB/s | 6.4 kB 00:00 2024-02-19T21:19:18.289 INFO:teuthology.orchestra.run.smithi157.stdout:(12/32): python3-werkzeug-0.12.2-4.el8.noarch.r 2.5 MB/s | 457 kB 00:00 2024-02-19T21:19:18.319 INFO:teuthology.orchestra.run.smithi157.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 1.2 MB/s | 109 kB 00:00 2024-02-19T21:19:18.386 INFO:teuthology.orchestra.run.smithi157.stdout:(14/32): python3-cryptography-3.2.1-7.el8.x86_6 3.1 MB/s | 641 kB 00:00 2024-02-19T21:19:18.411 INFO:teuthology.orchestra.run.smithi080.stdout:(2/32): ceph-mds-16.2.14-548.g81bd20d6.el8.x86_ 6.8 MB/s | 2.4 MB 00:00 2024-02-19T21:19:18.411 INFO:teuthology.orchestra.run.smithi157.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 357 kB/s | 44 kB 00:00 2024-02-19T21:19:18.461 INFO:teuthology.orchestra.run.smithi157.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.3 MB/s | 185 kB 00:00 2024-02-19T21:19:18.531 INFO:teuthology.orchestra.run.smithi157.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.2 MB/s | 173 kB 00:00 2024-02-19T21:19:18.587 INFO:teuthology.orchestra.run.smithi157.stdout:(18/32): python3-jaraco-functools-2.0-4.el8.noa 302 kB/s | 18 kB 00:00 2024-02-19T21:19:18.621 INFO:teuthology.orchestra.run.smithi157.stdout:(19/32): python3-jaraco-6.2-6.el8.noarch.rpm 70 kB/s | 11 kB 00:00 2024-02-19T21:19:18.679 INFO:teuthology.orchestra.run.smithi157.stdout:(20/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.4 MB/s | 384 kB 00:00 2024-02-19T21:19:18.704 INFO:teuthology.orchestra.run.smithi157.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 416 kB/s | 49 kB 00:00 2024-02-19T21:19:18.729 INFO:teuthology.orchestra.run.smithi157.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 540 kB/s | 59 kB 00:00 2024-02-19T21:19:18.763 INFO:teuthology.orchestra.run.smithi157.stdout:(23/32): python3-simplegeneric-0.8.1-17.el8.noa 566 kB/s | 19 kB 00:00 2024-02-19T21:19:18.797 INFO:teuthology.orchestra.run.smithi157.stdout:(24/32): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2024-02-19T21:19:18.822 INFO:teuthology.orchestra.run.smithi157.stdout:(25/32): python3-portend-2.6-1.el8.noarch.rpm 169 kB/s | 16 kB 00:00 2024-02-19T21:19:18.847 INFO:teuthology.orchestra.run.smithi157.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 584 kB/s | 29 kB 00:00 2024-02-19T21:19:18.873 INFO:teuthology.orchestra.run.smithi157.stdout:(27/32): python3-trustme-0.6.0-4.el8.noarch.rpm 550 kB/s | 27 kB 00:00 2024-02-19T21:19:18.898 INFO:teuthology.orchestra.run.smithi157.stdout:(28/32): python3-waitress-1.4.3-1.el8.noarch.rp 5.0 MB/s | 255 kB 00:00 2024-02-19T21:19:18.940 INFO:teuthology.orchestra.run.smithi157.stdout:(29/32): python3-webtest-2.0.33-1.el8.noarch.rp 2.0 MB/s | 85 kB 00:00 2024-02-19T21:19:18.953 INFO:teuthology.orchestra.run.smithi080.stdout:(3/32): ceph-mgr-16.2.14-548.g81bd20d6.el8.x86_ 1.8 MB/s | 1.6 MB 00:00 2024-02-19T21:19:18.965 INFO:teuthology.orchestra.run.smithi157.stdout:(30/32): python3-singledispatch-3.4.0.3-18.el8. 118 kB/s | 24 kB 00:00 2024-02-19T21:19:18.990 INFO:teuthology.orchestra.run.smithi157.stdout:(31/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.1 MB/s | 251 kB 00:00 2024-02-19T21:19:19.039 INFO:teuthology.orchestra.run.smithi157.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 232 kB/s | 23 kB 00:00 2024-02-19T21:19:19.044 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:19:19.044 INFO:teuthology.orchestra.run.smithi157.stdout:Total 11 MB/s | 32 MB 00:02 2024-02-19T21:19:19.126 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-19T21:19:19.165 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-19T21:19:19.165 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-19T21:19:19.178 INFO:teuthology.orchestra.run.smithi080.stdout:(4/32): ceph-mon-16.2.14-548.g81bd20d6.el8.x86_ 5.5 MB/s | 5.2 MB 00:00 2024-02-19T21:19:19.203 INFO:teuthology.orchestra.run.smithi080.stdout:(5/32): ceph-mgr-modules-core-16.2.14-548.g81bd 978 kB/s | 245 kB 00:00 2024-02-19T21:19:19.476 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-19T21:19:19.479 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-19T21:19:19.504 INFO:teuthology.orchestra.run.smithi080.stdout:(6/32): ceph-osd-16.2.14-548.g81bd20d6.el8.x86_ 17 MB/s | 19 MB 00:01 2024-02-19T21:19:19.529 INFO:teuthology.orchestra.run.smithi080.stdout:(7/32): python3-markupsafe-0.23-19.el8.x86_64.r 119 kB/s | 39 kB 00:00 2024-02-19T21:19:19.554 INFO:teuthology.orchestra.run.smithi080.stdout:(8/32): python3-mako-1.0.6-14.el8.noarch.rpm 418 kB/s | 157 kB 00:00 2024-02-19T21:19:19.656 INFO:teuthology.orchestra.run.smithi080.stdout:(9/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 688 kB/s | 103 kB 00:00 2024-02-19T21:19:19.672 INFO:teuthology.orchestra.run.smithi080.stdout:(10/32): python3-pytz-2017.2-11.el8.noarch.rpm 400 kB/s | 57 kB 00:00 2024-02-19T21:19:19.781 INFO:teuthology.orchestra.run.smithi080.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 2.0 MB/s | 457 kB 00:00 2024-02-19T21:19:19.806 INFO:teuthology.orchestra.run.smithi080.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.6 MB/s | 249 kB 00:00 2024-02-19T21:19:19.916 INFO:teuthology.orchestra.run.smithi080.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 809 kB/s | 109 kB 00:00 2024-02-19T21:19:19.948 INFO:teuthology.orchestra.run.smithi080.stdout:(14/32): python3-cryptography-3.2.1-7.el8.x86_6 2.3 MB/s | 641 kB 00:00 2024-02-19T21:19:19.973 INFO:teuthology.orchestra.run.smithi080.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 261 kB/s | 44 kB 00:00 2024-02-19T21:19:20.148 INFO:teuthology.orchestra.run.smithi080.stdout:(16/32): python3-cherrypy-18.4.0-1.el8.noarch.r 2.1 MB/s | 384 kB 00:00 2024-02-19T21:19:20.199 INFO:teuthology.orchestra.run.smithi080.stdout:(17/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 655 kB/s | 185 kB 00:00 2024-02-19T21:19:20.224 INFO:teuthology.orchestra.run.smithi080.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 147 kB/s | 11 kB 00:00 2024-02-19T21:19:20.249 INFO:teuthology.orchestra.run.smithi080.stdout:(19/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 573 kB/s | 173 kB 00:00 2024-02-19T21:19:20.275 INFO:teuthology.orchestra.run.smithi080.stdout:(20/32): python3-jaraco-functools-2.0-4.el8.noa 233 kB/s | 18 kB 00:00 2024-02-19T21:19:20.300 INFO:teuthology.orchestra.run.smithi080.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 645 kB/s | 49 kB 00:00 2024-02-19T21:19:20.325 INFO:teuthology.orchestra.run.smithi080.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 778 kB/s | 59 kB 00:00 2024-02-19T21:19:20.350 INFO:teuthology.orchestra.run.smithi080.stdout:(23/32): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2024-02-19T21:19:20.376 INFO:teuthology.orchestra.run.smithi080.stdout:(24/32): python3-portend-2.6-1.el8.noarch.rpm 206 kB/s | 16 kB 00:00 2024-02-19T21:19:20.401 INFO:teuthology.orchestra.run.smithi080.stdout:(25/32): python3-simplegeneric-0.8.1-17.el8.noa 248 kB/s | 19 kB 00:00 2024-02-19T21:19:20.426 INFO:teuthology.orchestra.run.smithi080.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 316 kB/s | 24 kB 00:00 2024-02-19T21:19:20.477 INFO:teuthology.orchestra.run.smithi080.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 291 kB/s | 29 kB 00:00 2024-02-19T21:19:20.502 INFO:teuthology.orchestra.run.smithi080.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 274 kB/s | 27 kB 00:00 2024-02-19T21:19:20.527 INFO:teuthology.orchestra.run.smithi080.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 2.5 MB/s | 255 kB 00:00 2024-02-19T21:19:20.561 INFO:teuthology.orchestra.run.smithi080.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.9 MB/s | 251 kB 00:00 2024-02-19T21:19:20.586 INFO:teuthology.orchestra.run.smithi080.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 393 kB/s | 23 kB 00:00 2024-02-19T21:19:20.611 INFO:teuthology.orchestra.run.smithi080.stdout:(32/32): python3-webtest-2.0.33-1.el8.noarch.rp 782 kB/s | 85 kB 00:00 2024-02-19T21:19:20.612 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:19:20.613 INFO:teuthology.orchestra.run.smithi080.stdout:Total 11 MB/s | 32 MB 00:02 2024-02-19T21:19:20.624 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-19T21:19:20.695 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-02-19T21:19:20.734 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-02-19T21:19:20.734 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-02-19T21:19:20.834 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-02-19T21:19:21.058 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-02-19T21:19:21.062 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-02-19T21:19:21.072 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-02-19T21:19:21.311 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-02-19T21:19:21.568 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-02-19T21:19:21.807 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-02-19T21:19:21.996 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-02-19T21:19:22.223 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-02-19T21:19:22.250 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-02-19T21:19:22.434 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-02-19T21:19:22.504 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-02-19T21:19:22.668 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-02-19T21:19:22.723 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-02-19T21:19:22.947 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-02-19T21:19:23.023 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-02-19T21:19:23.227 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-02-19T21:19:23.288 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-02-19T21:19:23.458 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-02-19T21:19:23.503 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-02-19T21:19:23.700 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-02-19T21:19:23.888 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-02-19T21:19:23.912 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-02-19T21:19:24.104 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-02-19T21:19:24.155 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-02-19T21:19:24.337 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-02-19T21:19:24.428 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-02-19T21:19:24.608 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-02-19T21:19:24.697 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-02-19T21:19:24.879 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-02-19T21:19:24.937 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-19T21:19:25.111 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-02-19T21:19:25.292 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-02-19T21:19:25.496 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-02-19T21:19:25.575 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-02-19T21:19:25.767 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-02-19T21:19:25.798 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-02-19T21:19:25.999 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-02-19T21:19:26.000 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-02-19T21:19:26.239 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-02-19T21:19:26.289 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-02-19T21:19:26.465 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-02-19T21:19:26.524 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-19T21:19:26.735 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-02-19T21:19:26.866 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-02-19T21:19:27.121 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-02-19T21:19:27.169 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-02-19T21:19:27.333 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-02-19T21:19:27.474 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-02-19T21:19:27.511 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-02-19T21:19:27.781 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-02-19T21:19:27.898 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-548.g81bd20d6.el8. 27/32 2024-02-19T21:19:28.035 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-02-19T21:19:28.137 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-2:16.2.14-548.g81bd20d6.el8.x86_64 28/32 2024-02-19T21:19:28.277 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-02-19T21:19:28.631 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-02-19T21:19:28.969 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-02-19T21:19:29.331 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-548.g81bd20d6.el8. 27/32 2024-02-19T21:19:29.546 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-2:16.2.14-548.g81bd20d6.el8.x86_64 28/32 2024-02-19T21:19:29.661 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-2:16.2.14-548.g81bd20d6.el8.x86_64 28/32 2024-02-19T21:19:29.835 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-osd-2:16.2.14-548.g81bd20d6.el8.x86_64 29/32 2024-02-19T21:19:30.281 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-osd-2:16.2.14-548.g81bd20d6.el8.x86_64 29/32 2024-02-19T21:19:30.469 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mon-2:16.2.14-548.g81bd20d6.el8.x86_64 30/32 2024-02-19T21:19:30.685 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mon-2:16.2.14-548.g81bd20d6.el8.x86_64 30/32 2024-02-19T21:19:30.860 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mds-2:16.2.14-548.g81bd20d6.el8.x86_64 31/32 2024-02-19T21:19:30.878 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mds-2:16.2.14-548.g81bd20d6.el8.x86_64 31/32 2024-02-19T21:19:31.043 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-2:16.2.14-548.g81bd20d6.el8.x86_64 32/32 2024-02-19T21:19:31.066 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-2:16.2.14-548.g81bd20d6.el8.x86_64 28/32 2024-02-19T21:19:31.281 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-osd-2:16.2.14-548.g81bd20d6.el8.x86_64 29/32 2024-02-19T21:19:31.460 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-2:16.2.14-548.g81bd20d6.el8.x86_64 32/32 2024-02-19T21:19:31.461 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-2:16.2.14-548.g81bd20d6.el8.x86_64 1/32 2024-02-19T21:19:31.461 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mds-2:16.2.14-548.g81bd20d6.el8.x86_64 2/32 2024-02-19T21:19:31.461 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-2:16.2.14-548.g81bd20d6.el8.x86_64 3/32 2024-02-19T21:19:31.461 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mon-2:16.2.14-548.g81bd20d6.el8.x86_64 4/32 2024-02-19T21:19:31.461 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-osd-2:16.2.14-548.g81bd20d6.el8.x86_64 5/32 2024-02-19T21:19:31.461 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-548.g81bd20d6.el8. 6/32 2024-02-19T21:19:31.461 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-02-19T21:19:31.461 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-02-19T21:19:31.461 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-02-19T21:19:31.461 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-02-19T21:19:31.461 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-02-19T21:19:31.462 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-02-19T21:19:31.462 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-02-19T21:19:31.462 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-02-19T21:19:31.462 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-02-19T21:19:31.462 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-02-19T21:19:31.462 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-19T21:19:31.462 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-02-19T21:19:31.462 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-02-19T21:19:31.462 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-02-19T21:19:31.462 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-02-19T21:19:31.462 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-02-19T21:19:31.462 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-02-19T21:19:31.462 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-02-19T21:19:31.462 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-02-19T21:19:31.463 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-02-19T21:19:31.463 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-02-19T21:19:31.463 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-02-19T21:19:31.463 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-02-19T21:19:31.463 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-02-19T21:19:31.463 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-02-19T21:19:31.724 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-osd-2:16.2.14-548.g81bd20d6.el8.x86_64 29/32 2024-02-19T21:19:31.922 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mon-2:16.2.14-548.g81bd20d6.el8.x86_64 30/32 2024-02-19T21:19:32.139 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mon-2:16.2.14-548.g81bd20d6.el8.x86_64 30/32 2024-02-19T21:19:32.259 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-02-19T21:19:32.259 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:19:32.259 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-19T21:19:32.259 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:19:32.259 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:19:32.260 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:19:32.260 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:19:32.260 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:19:32.260 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:19:32.260 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-02-19T21:19:32.260 INFO:teuthology.orchestra.run.smithi157.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-02-19T21:19:32.260 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-02-19T21:19:32.260 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-02-19T21:19:32.260 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-02-19T21:19:32.260 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-02-19T21:19:32.260 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-6.2-6.el8.noarch 2024-02-19T21:19:32.260 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-02-19T21:19:32.261 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-02-19T21:19:32.261 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako-1.0.6-14.el8.noarch 2024-02-19T21:19:32.261 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-02-19T21:19:32.262 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-02-19T21:19:32.262 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-02-19T21:19:32.262 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend-2.6-1.el8.noarch 2024-02-19T21:19:32.262 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-02-19T21:19:32.262 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pycparser-2.14-14.el8.noarch 2024-02-19T21:19:32.262 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz-2017.2-11.el8.noarch 2024-02-19T21:19:32.262 INFO:teuthology.orchestra.run.smithi157.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-02-19T21:19:32.262 INFO:teuthology.orchestra.run.smithi157.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-02-19T21:19:32.262 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-02-19T21:19:32.262 INFO:teuthology.orchestra.run.smithi157.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-02-19T21:19:32.262 INFO:teuthology.orchestra.run.smithi157.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-02-19T21:19:32.262 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-02-19T21:19:32.263 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-02-19T21:19:32.263 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-02-19T21:19:32.263 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-02-19T21:19:32.263 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:19:32.263 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-19T21:19:32.339 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mds-2:16.2.14-548.g81bd20d6.el8.x86_64 31/32 2024-02-19T21:19:32.362 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mds-2:16.2.14-548.g81bd20d6.el8.x86_64 31/32 2024-02-19T21:19:32.489 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-2:16.2.14-548.g81bd20d6.el8.x86_64 32/32 2024-02-19T21:19:32.508 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-base 2024-02-19T21:19:32.921 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-2:16.2.14-548.g81bd20d6.el8.x86_64 32/32 2024-02-19T21:19:32.922 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-2:16.2.14-548.g81bd20d6.el8.x86_64 1/32 2024-02-19T21:19:32.922 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mds-2:16.2.14-548.g81bd20d6.el8.x86_64 2/32 2024-02-19T21:19:32.922 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-2:16.2.14-548.g81bd20d6.el8.x86_64 3/32 2024-02-19T21:19:32.922 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mon-2:16.2.14-548.g81bd20d6.el8.x86_64 4/32 2024-02-19T21:19:32.922 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-osd-2:16.2.14-548.g81bd20d6.el8.x86_64 5/32 2024-02-19T21:19:32.922 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-548.g81bd20d6.el8. 6/32 2024-02-19T21:19:32.922 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-02-19T21:19:32.922 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-02-19T21:19:32.922 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-02-19T21:19:32.922 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-02-19T21:19:32.922 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-02-19T21:19:32.922 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-02-19T21:19:32.922 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-02-19T21:19:32.923 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-02-19T21:19:32.923 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-02-19T21:19:32.923 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-02-19T21:19:32.923 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-19T21:19:32.923 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-02-19T21:19:32.923 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-02-19T21:19:32.923 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-02-19T21:19:32.923 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-02-19T21:19:32.923 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-02-19T21:19:32.923 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-02-19T21:19:32.923 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-02-19T21:19:32.923 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-02-19T21:19:32.923 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-02-19T21:19:32.923 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-02-19T21:19:32.923 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-02-19T21:19:32.924 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-02-19T21:19:32.924 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-02-19T21:19:32.924 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-02-19T21:19:33.271 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:35 ago on Mon 19 Feb 2024 09:17:58 PM UTC. 2024-02-19T21:19:33.830 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-02-19T21:19:33.830 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:19:33.830 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-02-19T21:19:33.830 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:19:33.830 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mds-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:19:33.830 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:19:33.830 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-modules-core-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:19:33.830 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mon-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:19:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-osd-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:19:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-02-19T21:19:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-02-19T21:19:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-02-19T21:19:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-02-19T21:19:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-02-19T21:19:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-02-19T21:19:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-6.2-6.el8.noarch 2024-02-19T21:19:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-02-19T21:19:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-02-19T21:19:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: python3-mako-1.0.6-14.el8.noarch 2024-02-19T21:19:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-02-19T21:19:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-02-19T21:19:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-02-19T21:19:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: python3-portend-2.6-1.el8.noarch 2024-02-19T21:19:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-02-19T21:19:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pycparser-2.14-14.el8.noarch 2024-02-19T21:19:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pytz-2017.2-11.el8.noarch 2024-02-19T21:19:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-02-19T21:19:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-02-19T21:19:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-02-19T21:19:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-02-19T21:19:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-02-19T21:19:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-02-19T21:19:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-02-19T21:19:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-02-19T21:19:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-02-19T21:19:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:19:33.833 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-19T21:19:34.122 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-base 2024-02-19T21:19:34.793 INFO:teuthology.orchestra.run.smithi157.stdout:Package ceph-base-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:19:34.841 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-19T21:19:34.842 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-02-19T21:19:34.842 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-19T21:19:34.877 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:01:37 ago on Mon 19 Feb 2024 09:17:57 PM UTC. 2024-02-19T21:19:34.940 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install cephadm 2024-02-19T21:19:35.693 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:37 ago on Mon 19 Feb 2024 09:17:58 PM UTC. 2024-02-19T21:19:36.392 INFO:teuthology.orchestra.run.smithi080.stdout:Package ceph-base-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:19:36.441 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-19T21:19:36.442 INFO:teuthology.orchestra.run.smithi080.stdout:Nothing to do. 2024-02-19T21:19:36.442 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-19T21:19:36.555 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install cephadm 2024-02-19T21:19:37.257 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-19T21:19:37.258 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:19:37.258 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-02-19T21:19:37.258 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:19:37.258 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-19T21:19:37.258 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 85 k 2024-02-19T21:19:37.258 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:19:37.258 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-19T21:19:37.258 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:19:37.258 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2024-02-19T21:19:37.258 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:19:37.258 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 85 k 2024-02-19T21:19:37.259 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 352 k 2024-02-19T21:19:37.259 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-19T21:19:37.302 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:01:40 ago on Mon 19 Feb 2024 09:17:57 PM UTC. 2024-02-19T21:19:37.696 INFO:teuthology.orchestra.run.smithi157.stdout:cephadm-16.2.14-548.g81bd20d6.el8.noarch.rpm 195 kB/s | 85 kB 00:00 2024-02-19T21:19:37.697 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:19:37.697 INFO:teuthology.orchestra.run.smithi157.stdout:Total 194 kB/s | 85 kB 00:00 2024-02-19T21:19:37.697 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-19T21:19:37.705 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-19T21:19:37.705 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-19T21:19:37.707 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-19T21:19:37.710 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-19T21:19:37.750 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-19T21:19:38.262 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 1/1 2024-02-19T21:19:38.702 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 1/1 2024-02-19T21:19:38.847 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-19T21:19:38.847 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:19:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-02-19T21:19:38.847 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:19:38.848 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-02-19T21:19:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: cephadm noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 85 k 2024-02-19T21:19:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:19:38.848 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-02-19T21:19:38.848 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:19:38.848 INFO:teuthology.orchestra.run.smithi080.stdout:Install 1 Package 2024-02-19T21:19:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:19:38.849 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 85 k 2024-02-19T21:19:38.849 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 352 k 2024-02-19T21:19:38.849 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-02-19T21:19:38.937 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 1/1 2024-02-19T21:19:39.259 INFO:teuthology.orchestra.run.smithi080.stdout:cephadm-16.2.14-548.g81bd20d6.el8.noarch.rpm 208 kB/s | 85 kB 00:00 2024-02-19T21:19:39.259 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:19:39.259 INFO:teuthology.orchestra.run.smithi080.stdout:Total 207 kB/s | 85 kB 00:00 2024-02-19T21:19:39.260 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-02-19T21:19:39.267 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-02-19T21:19:39.267 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-02-19T21:19:39.269 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-02-19T21:19:39.272 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-02-19T21:19:39.311 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-02-19T21:19:39.691 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 1/1 2024-02-19T21:19:39.692 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:19:39.692 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-19T21:19:39.692 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:19:39.692 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:19:39.692 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-19T21:19:39.860 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 1/1 2024-02-19T21:19:39.920 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-immutable-object-cache 2024-02-19T21:19:40.056 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 1/1 2024-02-19T21:19:40.283 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 1/1 2024-02-19T21:19:40.682 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:42 ago on Mon 19 Feb 2024 09:17:58 PM UTC. 2024-02-19T21:19:40.696 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 1/1 2024-02-19T21:19:40.696 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:19:40.696 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-02-19T21:19:40.696 INFO:teuthology.orchestra.run.smithi080.stdout: cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:19:40.696 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:19:40.696 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-19T21:19:40.957 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-immutable-object-cache 2024-02-19T21:19:41.716 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:01:44 ago on Mon 19 Feb 2024 09:17:57 PM UTC. 2024-02-19T21:19:42.229 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-19T21:19:42.230 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:19:42.230 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repo Size 2024-02-19T21:19:42.230 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:19:42.230 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-19T21:19:42.230 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 161 k 2024-02-19T21:19:42.230 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:19:42.230 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-19T21:19:42.230 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:19:42.230 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2024-02-19T21:19:42.231 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:19:42.231 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 161 k 2024-02-19T21:19:42.231 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 470 k 2024-02-19T21:19:42.231 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-19T21:19:42.518 INFO:teuthology.orchestra.run.smithi157.stdout:ceph-immutable-object-cache-16.2.14-548.g81bd20 563 kB/s | 161 kB 00:00 2024-02-19T21:19:42.518 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:19:42.518 INFO:teuthology.orchestra.run.smithi157.stdout:Total 560 kB/s | 161 kB 00:00 2024-02-19T21:19:42.518 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-19T21:19:42.529 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-19T21:19:42.529 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-19T21:19:42.576 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-19T21:19:42.579 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-19T21:19:42.688 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-19T21:19:42.875 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-immutable-object-cache-2:16.2.14-548.g81bd20d6. 1/1 2024-02-19T21:19:43.254 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-19T21:19:43.254 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:19:43.255 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repo Size 2024-02-19T21:19:43.255 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:19:43.255 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-02-19T21:19:43.255 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-immutable-object-cache x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 161 k 2024-02-19T21:19:43.255 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:19:43.255 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-02-19T21:19:43.255 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:19:43.255 INFO:teuthology.orchestra.run.smithi080.stdout:Install 1 Package 2024-02-19T21:19:43.255 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:19:43.256 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 161 k 2024-02-19T21:19:43.256 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 470 k 2024-02-19T21:19:43.256 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-02-19T21:19:43.296 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.14-548.g81bd20d6. 1/1 2024-02-19T21:19:43.696 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-immutable-object-cache-2:16.2.14-548.g81bd20d6. 1/1 2024-02-19T21:19:43.696 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:19:43.696 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-19T21:19:43.696 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:19:43.697 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:19:43.697 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-19T21:19:43.941 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr 2024-02-19T21:19:44.464 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-immutable-object-cache-16.2.14-548.g81bd20 133 kB/s | 161 kB 00:01 2024-02-19T21:19:44.465 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:19:44.465 INFO:teuthology.orchestra.run.smithi080.stdout:Total 133 kB/s | 161 kB 00:01 2024-02-19T21:19:44.466 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-02-19T21:19:44.477 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-02-19T21:19:44.477 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-02-19T21:19:44.528 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-02-19T21:19:44.531 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-02-19T21:19:44.705 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:46 ago on Mon 19 Feb 2024 09:17:58 PM UTC. 2024-02-19T21:19:44.970 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-02-19T21:19:45.194 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-immutable-object-cache-2:16.2.14-548.g81bd20d6. 1/1 2024-02-19T21:19:45.606 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.14-548.g81bd20d6. 1/1 2024-02-19T21:19:46.048 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-immutable-object-cache-2:16.2.14-548.g81bd20d6. 1/1 2024-02-19T21:19:46.049 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:19:46.049 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-02-19T21:19:46.049 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-immutable-object-cache-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:19:46.049 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:19:46.049 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-19T21:19:46.204 INFO:teuthology.orchestra.run.smithi157.stdout:Package ceph-mgr-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:19:46.250 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-19T21:19:46.251 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-02-19T21:19:46.251 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-19T21:19:46.297 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-mgr 2024-02-19T21:19:46.345 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr-dashboard 2024-02-19T21:19:47.063 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:01:50 ago on Mon 19 Feb 2024 09:17:57 PM UTC. 2024-02-19T21:19:47.092 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:49 ago on Mon 19 Feb 2024 09:17:58 PM UTC. 2024-02-19T21:19:48.578 INFO:teuthology.orchestra.run.smithi080.stdout:Package ceph-mgr-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:19:48.622 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-19T21:19:48.623 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:19:48.624 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-02-19T21:19:48.624 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:19:48.624 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-19T21:19:48.624 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 3.1 M 2024-02-19T21:19:48.624 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-02-19T21:19:48.624 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 24 k 2024-02-19T21:19:48.624 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-prometheus-alerts noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 15 k 2024-02-19T21:19:48.624 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-02-19T21:19:48.624 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-02-19T21:19:48.624 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-02-19T21:19:48.624 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:19:48.624 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-19T21:19:48.625 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:19:48.625 INFO:teuthology.orchestra.run.smithi157.stdout:Install 6 Packages 2024-02-19T21:19:48.625 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:19:48.625 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-19T21:19:48.626 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 3.4 M 2024-02-19T21:19:48.626 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 22 M 2024-02-19T21:19:48.626 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-19T21:19:48.626 INFO:teuthology.orchestra.run.smithi080.stdout:Nothing to do. 2024-02-19T21:19:48.626 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-19T21:19:48.749 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-mgr-dashboard 2024-02-19T21:19:48.988 INFO:teuthology.orchestra.run.smithi157.stdout:(1/6): ceph-grafana-dashboards-16.2.14-548.g81b 164 kB/s | 24 kB 00:00 2024-02-19T21:19:49.036 INFO:teuthology.orchestra.run.smithi157.stdout:(2/6): ceph-prometheus-alerts-16.2.14-548.g81bd 75 kB/s | 15 kB 00:00 2024-02-19T21:19:49.105 INFO:teuthology.orchestra.run.smithi157.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 364 kB/s | 43 kB 00:00 2024-02-19T21:19:49.172 INFO:teuthology.orchestra.run.smithi157.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 249 kB/s | 34 kB 00:00 2024-02-19T21:19:49.222 INFO:teuthology.orchestra.run.smithi157.stdout:(5/6): ceph-mgr-dashboard-16.2.14-548.g81bd20d6 8.2 MB/s | 3.1 MB 00:00 2024-02-19T21:19:49.289 INFO:teuthology.orchestra.run.smithi157.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.0 MB/s | 196 kB 00:00 2024-02-19T21:19:49.292 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:19:49.292 INFO:teuthology.orchestra.run.smithi157.stdout:Total 5.1 MB/s | 3.4 MB 00:00 2024-02-19T21:19:49.303 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-19T21:19:49.312 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-19T21:19:49.313 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-19T21:19:49.467 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-19T21:19:49.470 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-19T21:19:49.496 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:01:52 ago on Mon 19 Feb 2024 09:17:57 PM UTC. 2024-02-19T21:19:49.767 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-19T21:19:49.996 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2024-02-19T21:19:50.283 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2024-02-19T21:19:50.492 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2024-02-19T21:19:50.638 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-548.g81bd20d6.el8.n 4/6 2024-02-19T21:19:51.018 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-19T21:19:51.019 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:19:51.019 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-02-19T21:19:51.019 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:19:51.019 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-02-19T21:19:51.020 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-dashboard noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 3.1 M 2024-02-19T21:19:51.020 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-02-19T21:19:51.020 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-grafana-dashboards noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 24 k 2024-02-19T21:19:51.020 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-prometheus-alerts noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 15 k 2024-02-19T21:19:51.020 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-02-19T21:19:51.020 INFO:teuthology.orchestra.run.smithi080.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-02-19T21:19:51.020 INFO:teuthology.orchestra.run.smithi080.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-02-19T21:19:51.020 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:19:51.020 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-02-19T21:19:51.020 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:19:51.020 INFO:teuthology.orchestra.run.smithi080.stdout:Install 6 Packages 2024-02-19T21:19:51.020 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:19:51.021 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 3.4 M 2024-02-19T21:19:51.021 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 22 M 2024-02-19T21:19:51.021 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-02-19T21:19:51.692 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-548.g81bd20d6.el8. 5/6 2024-02-19T21:19:51.792 INFO:teuthology.orchestra.run.smithi080.stdout:(1/6): ceph-grafana-dashboards-16.2.14-548.g81b 104 kB/s | 24 kB 00:00 2024-02-19T21:19:51.817 INFO:teuthology.orchestra.run.smithi080.stdout:(2/6): ceph-prometheus-alerts-16.2.14-548.g81bd 57 kB/s | 15 kB 00:00 2024-02-19T21:19:51.884 INFO:teuthology.orchestra.run.smithi080.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 463 kB/s | 43 kB 00:00 2024-02-19T21:19:51.909 INFO:teuthology.orchestra.run.smithi080.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 366 kB/s | 34 kB 00:00 2024-02-19T21:19:51.958 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-548.g81bd20d6.el8.noarc 6/6 2024-02-19T21:19:51.995 INFO:teuthology.orchestra.run.smithi080.stdout:(5/6): ceph-mgr-dashboard-16.2.14-548.g81bd20d6 7.2 MB/s | 3.1 MB 00:00 2024-02-19T21:19:52.068 INFO:teuthology.orchestra.run.smithi080.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.0 MB/s | 196 kB 00:00 2024-02-19T21:19:52.072 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:19:52.072 INFO:teuthology.orchestra.run.smithi080.stdout:Total 3.3 MB/s | 3.4 MB 00:01 2024-02-19T21:19:52.083 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-02-19T21:19:52.093 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-02-19T21:19:52.094 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-02-19T21:19:52.241 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-548.g81bd20d6.el8.noarc 6/6 2024-02-19T21:19:52.241 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-548.g81bd20d6.el8. 1/6 2024-02-19T21:19:52.241 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-548.g81bd20d6.el8.noarc 2/6 2024-02-19T21:19:52.241 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-548.g81bd20d6.el8.n 3/6 2024-02-19T21:19:52.241 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2024-02-19T21:19:52.242 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2024-02-19T21:19:52.249 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-02-19T21:19:52.253 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-02-19T21:19:52.545 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-02-19T21:19:52.624 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2024-02-19T21:19:52.624 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:19:52.624 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-19T21:19:52.624 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:19:52.624 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:19:52.624 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-prometheus-alerts-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:19:52.624 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-02-19T21:19:52.624 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-02-19T21:19:52.624 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes-2.4.1-12.el8.noarch 2024-02-19T21:19:52.624 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:19:52.624 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-19T21:19:52.742 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-19T21:19:52.756 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2024-02-19T21:19:53.018 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2024-02-19T21:19:53.253 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2024-02-19T21:19:53.390 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-548.g81bd20d6.el8.n 4/6 2024-02-19T21:19:53.502 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:55 ago on Mon 19 Feb 2024 09:17:58 PM UTC. 2024-02-19T21:19:54.421 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-548.g81bd20d6.el8. 5/6 2024-02-19T21:19:54.742 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-548.g81bd20d6.el8.noarc 6/6 2024-02-19T21:19:55.033 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-548.g81bd20d6.el8.noarc 6/6 2024-02-19T21:19:55.033 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-548.g81bd20d6.el8. 1/6 2024-02-19T21:19:55.033 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-548.g81bd20d6.el8.noarc 2/6 2024-02-19T21:19:55.033 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-548.g81bd20d6.el8.n 3/6 2024-02-19T21:19:55.033 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2024-02-19T21:19:55.033 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2024-02-19T21:19:55.045 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-19T21:19:55.046 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================================ 2024-02-19T21:19:55.046 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-02-19T21:19:55.046 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================================ 2024-02-19T21:19:55.046 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-19T21:19:55.046 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 8.6 M 2024-02-19T21:19:55.046 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-02-19T21:19:55.046 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-02-19T21:19:55.046 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-02-19T21:19:55.047 INFO:teuthology.orchestra.run.smithi157.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-02-19T21:19:55.047 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-02-19T21:19:55.047 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-02-19T21:19:55.047 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-02-19T21:19:55.047 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-02-19T21:19:55.047 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:19:55.047 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-19T21:19:55.047 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================================ 2024-02-19T21:19:55.047 INFO:teuthology.orchestra.run.smithi157.stdout:Install 8 Packages 2024-02-19T21:19:55.047 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:19:55.048 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 37 M 2024-02-19T21:19:55.048 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 210 M 2024-02-19T21:19:55.048 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-19T21:19:55.534 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2024-02-19T21:19:55.534 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:19:55.534 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-02-19T21:19:55.534 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-grafana-dashboards-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:19:55.534 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-dashboard-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:19:55.534 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-prometheus-alerts-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:19:55.534 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-02-19T21:19:55.534 INFO:teuthology.orchestra.run.smithi080.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-02-19T21:19:55.535 INFO:teuthology.orchestra.run.smithi080.stdout: python3-routes-2.4.1-12.el8.noarch 2024-02-19T21:19:55.535 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:19:55.535 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-19T21:19:55.681 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-19T21:19:56.428 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:01:59 ago on Mon 19 Feb 2024 09:17:57 PM UTC. 2024-02-19T21:19:56.877 INFO:teuthology.orchestra.run.smithi157.stdout:(1/8): ceph-mgr-diskprediction-local-16.2.14-54 15 MB/s | 8.6 MB 00:00 2024-02-19T21:19:57.979 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-19T21:19:57.980 INFO:teuthology.orchestra.run.smithi080.stdout:============================================================================================ 2024-02-19T21:19:57.981 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-02-19T21:19:57.981 INFO:teuthology.orchestra.run.smithi080.stdout:============================================================================================ 2024-02-19T21:19:57.981 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-02-19T21:19:57.981 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 8.6 M 2024-02-19T21:19:57.981 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-02-19T21:19:57.981 INFO:teuthology.orchestra.run.smithi080.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-02-19T21:19:57.981 INFO:teuthology.orchestra.run.smithi080.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-02-19T21:19:57.981 INFO:teuthology.orchestra.run.smithi080.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-02-19T21:19:57.981 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-02-19T21:19:57.981 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-02-19T21:19:57.981 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-02-19T21:19:57.981 INFO:teuthology.orchestra.run.smithi080.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-02-19T21:19:57.981 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:19:57.982 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-02-19T21:19:57.982 INFO:teuthology.orchestra.run.smithi080.stdout:============================================================================================ 2024-02-19T21:19:57.982 INFO:teuthology.orchestra.run.smithi080.stdout:Install 8 Packages 2024-02-19T21:19:57.982 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:19:57.982 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 37 M 2024-02-19T21:19:57.982 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 210 M 2024-02-19T21:19:57.982 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-02-19T21:19:58.202 INFO:teuthology.orchestra.run.smithi157.stdout:(2/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 2.8 MB/s | 3.7 MB 00:01 2024-02-19T21:19:58.299 INFO:teuthology.orchestra.run.smithi157.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 2.3 MB/s | 225 kB 00:00 2024-02-19T21:19:59.023 INFO:teuthology.orchestra.run.smithi080.stdout:(1/8): openblas-0.3.15-4.el8.x86_64.rpm 6.8 MB/s | 4.7 MB 00:00 2024-02-19T21:19:59.215 INFO:teuthology.orchestra.run.smithi080.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 5.5 MB/s | 4.9 MB 00:00 2024-02-19T21:19:59.315 INFO:teuthology.orchestra.run.smithi080.stdout:(3/8): ceph-mgr-diskprediction-local-16.2.14-54 8.7 MB/s | 8.6 MB 00:00 2024-02-19T21:19:59.332 INFO:teuthology.orchestra.run.smithi080.stdout:(4/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 1.9 MB/s | 225 kB 00:00 2024-02-19T21:19:59.440 INFO:teuthology.orchestra.run.smithi080.stdout:(5/8): libgfortran-8.5.0-21.el8.x86_64.rpm 5.8 MB/s | 645 kB 00:00 2024-02-19T21:19:59.516 INFO:teuthology.orchestra.run.smithi080.stdout:(6/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 7.6 MB/s | 3.7 MB 00:00 2024-02-19T21:19:59.541 INFO:teuthology.orchestra.run.smithi080.stdout:(7/8): libquadmath-8.5.0-21.el8.x86_64.rpm 1.7 MB/s | 172 kB 00:00 2024-02-19T21:19:59.695 INFO:teuthology.orchestra.run.smithi157.stdout:(4/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 1.4 MB/s | 4.9 MB 00:03 2024-02-19T21:19:59.820 INFO:teuthology.orchestra.run.smithi157.stdout:(5/8): libgfortran-8.5.0-21.el8.x86_64.rpm 5.0 MB/s | 645 kB 00:00 2024-02-19T21:19:59.862 INFO:teuthology.orchestra.run.smithi157.stdout:(6/8): libquadmath-8.5.0-21.el8.x86_64.rpm 4.1 MB/s | 172 kB 00:00 2024-02-19T21:20:00.221 INFO:teuthology.orchestra.run.smithi157.stdout:(7/8): openblas-0.3.15-4.el8.x86_64.rpm 1.2 MB/s | 4.7 MB 00:03 2024-02-19T21:20:07.713 INFO:teuthology.orchestra.run.smithi157.stdout:(8/8): python3-scipy-1.0.0-21.module_el8+762+77 1.5 MB/s | 14 MB 00:09 2024-02-19T21:20:07.713 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:20:07.713 INFO:teuthology.orchestra.run.smithi157.stdout:Total 2.9 MB/s | 37 MB 00:12 2024-02-19T21:20:07.946 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-19T21:20:07.965 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-19T21:20:07.965 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-19T21:20:08.312 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-19T21:20:08.316 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-19T21:20:08.892 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-19T21:20:09.062 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2024-02-19T21:20:09.179 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2024-02-19T21:20:09.331 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2024-02-19T21:20:09.952 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2024-02-19T21:20:10.153 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2024-02-19T21:20:10.656 INFO:teuthology.orchestra.run.smithi080.stdout:(8/8): python3-scipy-1.0.0-21.module_el8+762+77 1.2 MB/s | 14 MB 00:11 2024-02-19T21:20:10.656 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:20:10.656 INFO:teuthology.orchestra.run.smithi080.stdout:Total 2.9 MB/s | 37 MB 00:12 2024-02-19T21:20:10.764 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2024-02-19T21:20:10.887 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-02-19T21:20:10.905 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-02-19T21:20:10.905 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-02-19T21:20:10.956 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-02-19T21:20:11.237 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-02-19T21:20:11.240 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-02-19T21:20:11.647 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-02-19T21:20:11.835 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-02-19T21:20:11.982 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-02-19T21:20:11.988 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2024-02-19T21:20:12.132 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2024-02-19T21:20:12.264 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-02-19T21:20:12.321 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2024-02-19T21:20:12.922 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2024-02-19T21:20:13.080 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2024-02-19T21:20:13.723 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2024-02-19T21:20:13.888 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-02-19T21:20:14.053 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-02-19T21:20:14.596 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-02-19T21:20:14.957 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-02-19T21:20:15.221 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-02-19T21:20:15.369 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2024-02-19T21:20:15.556 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-548.g81bd20d 8/8 2024-02-19T21:20:15.881 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-548.g81bd20d 8/8 2024-02-19T21:20:15.882 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-548.g81bd20d 1/8 2024-02-19T21:20:15.882 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2024-02-19T21:20:15.882 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2024-02-19T21:20:15.882 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2024-02-19T21:20:15.882 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2024-02-19T21:20:15.882 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2024-02-19T21:20:15.882 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2024-02-19T21:20:16.296 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2024-02-19T21:20:16.296 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:20:16.296 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-19T21:20:16.296 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:20:16.296 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-02-19T21:20:16.296 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-02-19T21:20:16.296 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-0.3.15-4.el8.x86_64 2024-02-19T21:20:16.296 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-02-19T21:20:16.296 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-02-19T21:20:16.296 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-02-19T21:20:16.296 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-02-19T21:20:16.296 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:20:16.297 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-19T21:20:16.419 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr-rook 2024-02-19T21:20:16.979 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-02-19T21:20:17.175 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:19 ago on Mon 19 Feb 2024 09:17:58 PM UTC. 2024-02-19T21:20:18.317 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2024-02-19T21:20:18.512 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-548.g81bd20d 8/8 2024-02-19T21:20:19.369 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-19T21:20:19.369 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:20:19.369 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-02-19T21:20:19.369 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:20:19.369 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-19T21:20:19.369 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 27 k 2024-02-19T21:20:19.369 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-02-19T21:20:19.369 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-02-19T21:20:19.369 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-02-19T21:20:19.369 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-02-19T21:20:19.370 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-02-19T21:20:19.370 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-02-19T21:20:19.370 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-02-19T21:20:19.370 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-02-19T21:20:19.370 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-02-19T21:20:19.370 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-02-19T21:20:19.370 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-02-19T21:20:19.370 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-02-19T21:20:19.370 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-02-19T21:20:19.370 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:20:19.370 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-19T21:20:19.370 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:20:19.370 INFO:teuthology.orchestra.run.smithi157.stdout:Install 13 Packages 2024-02-19T21:20:19.370 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:20:19.371 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 1.9 M 2024-02-19T21:20:19.371 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 24 M 2024-02-19T21:20:19.371 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-19T21:20:19.371 INFO:teuthology.orchestra.run.smithi157.stdout:(1/13): python3-jsonpointer-1.10-11.el8.noarch. 144 kB/s | 20 kB 00:00 2024-02-19T21:20:19.371 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-548.g81bd20d 8/8 2024-02-19T21:20:19.371 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-548.g81bd20d 1/8 2024-02-19T21:20:19.371 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2024-02-19T21:20:19.371 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2024-02-19T21:20:19.372 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2024-02-19T21:20:19.372 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2024-02-19T21:20:19.372 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2024-02-19T21:20:19.372 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2024-02-19T21:20:19.372 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2024-02-19T21:20:19.372 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:20:19.372 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-02-19T21:20:19.372 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-diskprediction-local-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:20:19.372 INFO:teuthology.orchestra.run.smithi080.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-02-19T21:20:19.372 INFO:teuthology.orchestra.run.smithi080.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-02-19T21:20:19.372 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-0.3.15-4.el8.x86_64 2024-02-19T21:20:19.372 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-02-19T21:20:19.372 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-02-19T21:20:19.372 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-02-19T21:20:19.373 INFO:teuthology.orchestra.run.smithi080.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-02-19T21:20:19.373 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:20:19.373 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-19T21:20:19.385 INFO:teuthology.orchestra.run.smithi157.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 141 kB/s | 27 kB 00:00 2024-02-19T21:20:19.402 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-mgr-rook 2024-02-19T21:20:19.410 INFO:teuthology.orchestra.run.smithi157.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.6 MB/s | 126 kB 00:00 2024-02-19T21:20:19.486 INFO:teuthology.orchestra.run.smithi157.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 1.1 MB/s | 110 kB 00:00 2024-02-19T21:20:19.686 INFO:teuthology.orchestra.run.smithi157.stdout:(5/13): ceph-mgr-rook-16.2.14-548.g81bd20d6.el8 56 kB/s | 27 kB 00:00 2024-02-19T21:20:19.711 INFO:teuthology.orchestra.run.smithi157.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 189 kB/s | 43 kB 00:00 2024-02-19T21:20:19.736 INFO:teuthology.orchestra.run.smithi157.stdout:(7/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 475 kB/s | 155 kB 00:00 2024-02-19T21:20:20.062 INFO:teuthology.orchestra.run.smithi157.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 47 kB/s | 16 kB 00:00 2024-02-19T21:20:20.087 INFO:teuthology.orchestra.run.smithi157.stdout:(9/13): python3-cachetools-3.1.1-4.el8.noarch.r 82 kB/s | 33 kB 00:00 2024-02-19T21:20:20.155 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:02:23 ago on Mon 19 Feb 2024 09:17:57 PM UTC. 2024-02-19T21:20:20.195 INFO:teuthology.orchestra.run.smithi157.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 177 kB/s | 81 kB 00:00 2024-02-19T21:20:20.312 INFO:teuthology.orchestra.run.smithi157.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 285 kB/s | 64 kB 00:00 2024-02-19T21:20:20.363 INFO:teuthology.orchestra.run.smithi157.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 367 kB/s | 61 kB 00:00 2024-02-19T21:20:20.855 INFO:teuthology.orchestra.run.smithi157.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 1.5 MB/s | 1.2 MB 00:00 2024-02-19T21:20:20.857 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:20:20.858 INFO:teuthology.orchestra.run.smithi157.stdout:Total 923 kB/s | 1.9 MB 00:02 2024-02-19T21:20:20.914 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-19T21:20:20.930 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-19T21:20:20.930 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-19T21:20:21.018 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-19T21:20:21.023 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-19T21:20:21.625 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-19T21:20:21.717 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-19T21:20:21.719 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:20:21.719 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-02-19T21:20:21.719 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:20:21.719 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-02-19T21:20:21.719 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-rook noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 27 k 2024-02-19T21:20:21.719 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-02-19T21:20:21.719 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-02-19T21:20:21.720 INFO:teuthology.orchestra.run.smithi080.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-02-19T21:20:21.720 INFO:teuthology.orchestra.run.smithi080.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-02-19T21:20:21.720 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-02-19T21:20:21.720 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-02-19T21:20:21.720 INFO:teuthology.orchestra.run.smithi080.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-02-19T21:20:21.720 INFO:teuthology.orchestra.run.smithi080.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-02-19T21:20:21.720 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-02-19T21:20:21.720 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-02-19T21:20:21.720 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-02-19T21:20:21.720 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-02-19T21:20:21.720 INFO:teuthology.orchestra.run.smithi080.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-02-19T21:20:21.720 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:20:21.720 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-02-19T21:20:21.721 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:20:21.721 INFO:teuthology.orchestra.run.smithi080.stdout:Install 13 Packages 2024-02-19T21:20:21.721 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:20:21.721 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 1.9 M 2024-02-19T21:20:21.721 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 24 M 2024-02-19T21:20:21.721 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-02-19T21:20:21.878 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2024-02-19T21:20:22.141 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2024-02-19T21:20:22.222 INFO:teuthology.orchestra.run.smithi080.stdout:(1/13): python3-jsonpointer-1.10-11.el8.noarch. 108 kB/s | 20 kB 00:00 2024-02-19T21:20:22.247 INFO:teuthology.orchestra.run.smithi080.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 127 kB/s | 27 kB 00:00 2024-02-19T21:20:22.297 INFO:teuthology.orchestra.run.smithi080.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.8 MB/s | 126 kB 00:00 2024-02-19T21:20:22.354 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2024-02-19T21:20:22.398 INFO:teuthology.orchestra.run.smithi080.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 729 kB/s | 110 kB 00:00 2024-02-19T21:20:22.473 INFO:teuthology.orchestra.run.smithi080.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 883 kB/s | 155 kB 00:00 2024-02-19T21:20:22.498 INFO:teuthology.orchestra.run.smithi080.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 427 kB/s | 43 kB 00:00 2024-02-19T21:20:22.615 INFO:teuthology.orchestra.run.smithi080.stdout:(7/13): ceph-mgr-rook-16.2.14-548.g81bd20d6.el8 47 kB/s | 27 kB 00:00 2024-02-19T21:20:23.218 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2024-02-19T21:20:23.516 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2024-02-19T21:20:23.791 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2024-02-19T21:20:24.126 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2024-02-19T21:20:24.382 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2024-02-19T21:20:25.447 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2024-02-19T21:20:25.766 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2024-02-19T21:20:25.873 INFO:teuthology.orchestra.run.smithi080.stdout:(8/13): python3-google-auth-1.1.1-10.el8.noarch 25 kB/s | 81 kB 00:03 2024-02-19T21:20:26.019 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2024-02-19T21:20:26.217 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2024-02-19T21:20:26.409 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-rook-2:16.2.14-548.g81bd20d6.el8.noarch 13/13 2024-02-19T21:20:26.457 INFO:teuthology.orchestra.run.smithi080.stdout:(9/13): python3-kubernetes-11.0.0-6.el8.noarch. 2.0 MB/s | 1.2 MB 00:00 2024-02-19T21:20:26.524 INFO:teuthology.orchestra.run.smithi080.stdout:(10/13): python3-rsa-4.9-2.el8.noarch.rpm 963 kB/s | 64 kB 00:00 2024-02-19T21:20:26.582 INFO:teuthology.orchestra.run.smithi080.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 1.0 MB/s | 61 kB 00:00 2024-02-19T21:20:26.705 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-548.g81bd20d6.el8.noarch 13/13 2024-02-19T21:20:26.706 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-rook-2:16.2.14-548.g81bd20d6.el8.noarch 1/13 2024-02-19T21:20:26.706 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2024-02-19T21:20:26.706 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2024-02-19T21:20:26.706 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2024-02-19T21:20:26.706 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2024-02-19T21:20:26.706 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2024-02-19T21:20:26.706 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2024-02-19T21:20:26.706 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2024-02-19T21:20:26.706 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2024-02-19T21:20:26.706 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2024-02-19T21:20:26.706 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2024-02-19T21:20:26.706 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2024-02-19T21:20:27.161 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2024-02-19T21:20:27.161 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:20:27.161 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-19T21:20:27.161 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:20:27.161 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-02-19T21:20:27.161 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-02-19T21:20:27.162 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-02-19T21:20:27.162 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-02-19T21:20:27.162 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-02-19T21:20:27.162 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-02-19T21:20:27.162 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-02-19T21:20:27.162 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-02-19T21:20:27.162 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-02-19T21:20:27.162 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-02-19T21:20:27.162 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa-4.9-2.el8.noarch 2024-02-19T21:20:27.162 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-02-19T21:20:27.162 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:20:27.162 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-19T21:20:27.274 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr-cephadm 2024-02-19T21:20:28.030 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:30 ago on Mon 19 Feb 2024 09:17:58 PM UTC. 2024-02-19T21:20:29.592 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-19T21:20:29.593 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:20:29.593 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-02-19T21:20:29.593 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:20:29.593 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-19T21:20:29.594 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 116 k 2024-02-19T21:20:29.594 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-02-19T21:20:29.594 INFO:teuthology.orchestra.run.smithi157.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2024-02-19T21:20:29.594 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-02-19T21:20:29.594 INFO:teuthology.orchestra.run.smithi157.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2024-02-19T21:20:29.594 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-02-19T21:20:29.594 INFO:teuthology.orchestra.run.smithi157.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2024-02-19T21:20:29.594 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:20:29.594 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-19T21:20:29.594 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:20:29.594 INFO:teuthology.orchestra.run.smithi157.stdout:Install 6 Packages 2024-02-19T21:20:29.594 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:20:29.595 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 5.9 M 2024-02-19T21:20:29.595 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 24 M 2024-02-19T21:20:29.595 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-19T21:20:30.339 INFO:teuthology.orchestra.run.smithi157.stdout:(1/6): ceph-mgr-cephadm-16.2.14-548.g81bd20d6.e 607 kB/s | 116 kB 00:00 2024-02-19T21:20:30.393 INFO:teuthology.orchestra.run.smithi157.stdout:(2/6): python3-jinja2-2.10.1-4.el8.noarch.rpm 2.3 MB/s | 578 kB 00:00 2024-02-19T21:20:30.647 INFO:teuthology.orchestra.run.smithi157.stdout:(3/6): python3-apipkg-1.5-6.el8.noarch.rpm 69 kB/s | 21 kB 00:00 2024-02-19T21:20:30.881 INFO:teuthology.orchestra.run.smithi157.stdout:(4/6): python3-remoto-1.2.1-1.el8.noarch.rpm 209 kB/s | 49 kB 00:00 2024-02-19T21:20:31.006 INFO:teuthology.orchestra.run.smithi157.stdout:(5/6): python3-execnet-1.7.1-1.el8.noarch.rpm 580 kB/s | 355 kB 00:00 2024-02-19T21:20:31.448 INFO:teuthology.orchestra.run.smithi157.stdout:(6/6): python3-babel-2.5.1-7.el8.noarch.rpm 3.7 MB/s | 4.8 MB 00:01 2024-02-19T21:20:31.448 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:20:31.449 INFO:teuthology.orchestra.run.smithi157.stdout:Total 3.2 MB/s | 5.9 MB 00:01 2024-02-19T21:20:31.501 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-19T21:20:31.511 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-19T21:20:31.511 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-19T21:20:31.618 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-19T21:20:31.621 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-19T21:20:31.902 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-19T21:20:32.174 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2024-02-19T21:20:32.503 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2024-02-19T21:20:33.467 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2024-02-19T21:20:33.815 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2024-02-19T21:20:34.096 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 5/6 2024-02-19T21:20:34.316 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 6/6 2024-02-19T21:20:34.609 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 6/6 2024-02-19T21:20:34.609 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 1/6 2024-02-19T21:20:34.609 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2024-02-19T21:20:34.609 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 3/6 2024-02-19T21:20:34.610 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2024-02-19T21:20:34.610 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2024-02-19T21:20:34.992 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2024-02-19T21:20:34.993 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:20:34.993 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-19T21:20:34.993 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:20:34.993 INFO:teuthology.orchestra.run.smithi157.stdout: python3-apipkg-1.5-6.el8.noarch 2024-02-19T21:20:34.993 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel-2.5.1-7.el8.noarch 2024-02-19T21:20:34.993 INFO:teuthology.orchestra.run.smithi157.stdout: python3-execnet-1.7.1-1.el8.noarch 2024-02-19T21:20:34.993 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-02-19T21:20:34.993 INFO:teuthology.orchestra.run.smithi157.stdout: python3-remoto-1.2.1-1.el8.noarch 2024-02-19T21:20:34.993 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:20:34.993 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-19T21:20:35.124 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-fuse 2024-02-19T21:20:35.882 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:37 ago on Mon 19 Feb 2024 09:17:58 PM UTC. 2024-02-19T21:20:37.441 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-19T21:20:37.442 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:20:37.442 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-02-19T21:20:37.442 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:20:37.443 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-19T21:20:37.443 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 911 k 2024-02-19T21:20:37.443 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-02-19T21:20:37.443 INFO:teuthology.orchestra.run.smithi157.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2024-02-19T21:20:37.443 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:20:37.443 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-19T21:20:37.443 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:20:37.443 INFO:teuthology.orchestra.run.smithi157.stdout:Install 2 Packages 2024-02-19T21:20:37.443 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:20:37.443 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 994 k 2024-02-19T21:20:37.443 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 2.8 M 2024-02-19T21:20:37.443 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-19T21:20:37.566 INFO:teuthology.orchestra.run.smithi157.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 1.0 MB/s | 83 kB 00:00 2024-02-19T21:20:37.782 INFO:teuthology.orchestra.run.smithi157.stdout:(2/2): ceph-fuse-16.2.14-548.g81bd20d6.el8.x86_ 3.0 MB/s | 911 kB 00:00 2024-02-19T21:20:37.783 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:20:37.783 INFO:teuthology.orchestra.run.smithi157.stdout:Total 2.8 MB/s | 994 kB 00:00 2024-02-19T21:20:37.793 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-19T21:20:37.814 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-19T21:20:37.814 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-19T21:20:37.900 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-19T21:20:37.903 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-19T21:20:38.075 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-19T21:20:38.372 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2024-02-19T21:20:38.618 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 2/2 2024-02-19T21:20:38.996 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 2/2 2024-02-19T21:20:38.996 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 1/2 2024-02-19T21:20:39.399 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2024-02-19T21:20:39.400 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:20:39.400 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-19T21:20:39.400 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2024-02-19T21:20:39.400 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:20:39.400 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-19T21:20:39.621 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install librados-devel 2024-02-19T21:20:40.388 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:42 ago on Mon 19 Feb 2024 09:17:58 PM UTC. 2024-02-19T21:20:41.947 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-19T21:20:41.948 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:20:41.948 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repo Size 2024-02-19T21:20:41.948 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:20:41.948 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-19T21:20:41.948 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 131 k 2024-02-19T21:20:41.948 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:20:41.948 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-19T21:20:41.948 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:20:41.948 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2024-02-19T21:20:41.948 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:20:41.949 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 131 k 2024-02-19T21:20:41.949 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 432 k 2024-02-19T21:20:41.949 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-19T21:20:42.388 INFO:teuthology.orchestra.run.smithi157.stdout:librados-devel-16.2.14-548.g81bd20d6.el8.x86_64 298 kB/s | 131 kB 00:00 2024-02-19T21:20:42.389 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:20:42.389 INFO:teuthology.orchestra.run.smithi157.stdout:Total 297 kB/s | 131 kB 00:00 2024-02-19T21:20:42.389 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-19T21:20:42.395 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-19T21:20:42.395 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-19T21:20:42.447 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-19T21:20:42.450 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-19T21:20:42.560 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-19T21:20:42.781 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librados-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:20:43.071 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:20:43.422 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:20:43.422 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:20:43.422 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-19T21:20:43.422 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:20:43.422 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:20:43.423 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-19T21:20:43.620 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install libcephfs2 2024-02-19T21:20:44.390 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:46 ago on Mon 19 Feb 2024 09:17:58 PM UTC. 2024-02-19T21:20:45.899 INFO:teuthology.orchestra.run.smithi157.stdout:Package libcephfs2-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:20:45.946 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-19T21:20:45.947 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-02-19T21:20:45.947 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-19T21:20:46.190 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install libcephfs-devel 2024-02-19T21:20:46.952 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:48 ago on Mon 19 Feb 2024 09:17:58 PM UTC. 2024-02-19T21:20:48.486 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-19T21:20:48.486 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:20:48.487 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repo Size 2024-02-19T21:20:48.487 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:20:48.487 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-19T21:20:48.487 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 25 k 2024-02-19T21:20:48.487 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:20:48.487 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-19T21:20:48.487 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:20:48.487 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2024-02-19T21:20:48.487 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:20:48.488 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 25 k 2024-02-19T21:20:48.488 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 107 k 2024-02-19T21:20:48.488 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-19T21:20:48.778 INFO:teuthology.orchestra.run.smithi157.stdout:libcephfs-devel-16.2.14-548.g81bd20d6.el8.x86_6 88 kB/s | 25 kB 00:00 2024-02-19T21:20:48.779 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:20:48.779 INFO:teuthology.orchestra.run.smithi157.stdout:Total 87 kB/s | 25 kB 00:00 2024-02-19T21:20:48.779 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-19T21:20:48.783 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-19T21:20:48.783 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-19T21:20:48.785 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-19T21:20:48.788 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-19T21:20:48.867 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-19T21:20:49.063 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:20:49.342 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephfs-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:20:49.705 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:20:49.705 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:20:49.705 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-19T21:20:49.705 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:20:49.706 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:20:49.706 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-19T21:20:49.829 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install librados2 2024-02-19T21:20:50.587 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:52 ago on Mon 19 Feb 2024 09:17:58 PM UTC. 2024-02-19T21:20:52.082 INFO:teuthology.orchestra.run.smithi157.stdout:Package librados2-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:20:52.129 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-19T21:20:52.130 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-02-19T21:20:52.130 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-19T21:20:52.218 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install librbd1 2024-02-19T21:20:52.974 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:54 ago on Mon 19 Feb 2024 09:17:58 PM UTC. 2024-02-19T21:20:54.489 INFO:teuthology.orchestra.run.smithi157.stdout:Package librbd1-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:20:54.536 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-19T21:20:54.537 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-02-19T21:20:54.537 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-19T21:20:54.628 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install python3-rados 2024-02-19T21:20:55.381 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:57 ago on Mon 19 Feb 2024 09:17:58 PM UTC. 2024-02-19T21:20:56.896 INFO:teuthology.orchestra.run.smithi157.stdout:Package python3-rados-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:20:56.942 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-19T21:20:56.944 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-02-19T21:20:56.944 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-19T21:20:57.068 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install python3-rgw 2024-02-19T21:20:57.819 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:59 ago on Mon 19 Feb 2024 09:17:58 PM UTC. 2024-02-19T21:20:59.342 INFO:teuthology.orchestra.run.smithi157.stdout:Package python3-rgw-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:20:59.388 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-19T21:20:59.389 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-02-19T21:20:59.389 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-19T21:20:59.487 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install python3-cephfs 2024-02-19T21:21:00.252 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:03:02 ago on Mon 19 Feb 2024 09:17:58 PM UTC. 2024-02-19T21:21:01.753 INFO:teuthology.orchestra.run.smithi157.stdout:Package python3-cephfs-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:21:01.799 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-19T21:21:01.800 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-02-19T21:21:01.800 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-19T21:21:01.908 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install python3-rbd 2024-02-19T21:21:02.656 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:03:04 ago on Mon 19 Feb 2024 09:17:58 PM UTC. 2024-02-19T21:21:04.171 INFO:teuthology.orchestra.run.smithi157.stdout:Package python3-rbd-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:21:04.218 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-19T21:21:04.219 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-02-19T21:21:04.219 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-19T21:21:04.325 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install rbd-fuse 2024-02-19T21:21:05.083 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:03:07 ago on Mon 19 Feb 2024 09:17:58 PM UTC. 2024-02-19T21:21:06.646 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-19T21:21:06.646 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:21:06.647 INFO:teuthology.orchestra.run.smithi157.stdout: Package Architecture Version Repository Size 2024-02-19T21:21:06.647 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:21:06.647 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-19T21:21:06.647 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 88 k 2024-02-19T21:21:06.647 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:21:06.647 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-19T21:21:06.647 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:21:06.647 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2024-02-19T21:21:06.647 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:21:06.648 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 88 k 2024-02-19T21:21:06.648 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 240 k 2024-02-19T21:21:06.648 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-19T21:21:07.209 INFO:teuthology.orchestra.run.smithi157.stdout:rbd-fuse-16.2.14-548.g81bd20d6.el8.x86_64.rpm 158 kB/s | 88 kB 00:00 2024-02-19T21:21:07.209 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:21:07.210 INFO:teuthology.orchestra.run.smithi157.stdout:Total 157 kB/s | 88 kB 00:00 2024-02-19T21:21:07.210 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-19T21:21:07.220 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-19T21:21:07.220 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-19T21:21:07.271 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-19T21:21:07.274 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-19T21:21:07.433 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-19T21:21:07.618 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:21:07.932 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: rbd-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:21:08.334 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:21:08.334 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:21:08.334 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-19T21:21:08.334 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:21:08.334 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:21:08.334 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-19T21:21:08.577 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install rbd-mirror 2024-02-19T21:21:09.341 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:03:11 ago on Mon 19 Feb 2024 09:17:58 PM UTC. 2024-02-19T21:21:10.884 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-19T21:21:10.885 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:21:10.885 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repo Size 2024-02-19T21:21:10.885 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:21:10.885 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-19T21:21:10.885 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 3.7 M 2024-02-19T21:21:10.885 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:21:10.885 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-19T21:21:10.886 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:21:10.886 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2024-02-19T21:21:10.886 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:21:10.886 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 3.7 M 2024-02-19T21:21:10.886 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 15 M 2024-02-19T21:21:10.886 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-19T21:21:11.512 INFO:teuthology.orchestra.run.smithi157.stdout:rbd-mirror-16.2.14-548.g81bd20d6.el8.x86_64.rpm 5.9 MB/s | 3.7 MB 00:00 2024-02-19T21:21:11.512 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:21:11.513 INFO:teuthology.orchestra.run.smithi157.stdout:Total 5.9 MB/s | 3.7 MB 00:00 2024-02-19T21:21:11.513 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-19T21:21:11.524 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-19T21:21:11.524 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-19T21:21:11.586 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-19T21:21:11.589 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-19T21:21:12.019 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-19T21:21:12.230 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-mirror-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:21:12.655 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: rbd-mirror-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:21:13.108 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-mirror-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:21:13.108 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:21:13.108 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-19T21:21:13.108 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:21:13.108 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:21:13.108 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-19T21:21:13.365 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install rbd-nbd 2024-02-19T21:21:14.131 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:03:16 ago on Mon 19 Feb 2024 09:17:58 PM UTC. 2024-02-19T21:21:15.687 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-19T21:21:15.688 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:21:15.688 INFO:teuthology.orchestra.run.smithi157.stdout: Package Architecture Version Repository Size 2024-02-19T21:21:15.688 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:21:15.688 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-19T21:21:15.688 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 175 k 2024-02-19T21:21:15.688 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:21:15.688 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-19T21:21:15.688 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-19T21:21:15.689 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2024-02-19T21:21:15.689 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:21:15.689 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 175 k 2024-02-19T21:21:15.689 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 523 k 2024-02-19T21:21:15.689 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-19T21:21:16.023 INFO:teuthology.orchestra.run.smithi157.stdout:rbd-nbd-16.2.14-548.g81bd20d6.el8.x86_64.rpm 524 kB/s | 175 kB 00:00 2024-02-19T21:21:16.024 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:21:16.024 INFO:teuthology.orchestra.run.smithi157.stdout:Total 522 kB/s | 175 kB 00:00 2024-02-19T21:21:16.024 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-19T21:21:16.035 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-19T21:21:16.035 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-19T21:21:16.084 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-19T21:21:16.087 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-19T21:21:16.197 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-19T21:21:16.425 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-nbd-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:21:16.728 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: rbd-nbd-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:21:17.112 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-nbd-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:21:17.113 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:21:17.113 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-19T21:21:17.113 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:21:17.113 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:21:17.113 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-19T21:21:17.322 DEBUG:teuthology.parallel:result is None 2024-02-19T21:22:34.180 INFO:teuthology.orchestra.run.smithi080.stdout:[MIRROR] python3-cachetools-3.1.1-4.el8.noarch.rpm: Curl error (7): Couldn't connect to server for http://epel.stl.us.ssimn.org/8/Everything/x86_64/Packages/p/python3-cachetools-3.1.1-4.el8.noarch.rpm [Failed to connect to epel.stl.us.ssimn.org port 80: Connection timed out] 2024-02-19T21:22:34.181 INFO:teuthology.orchestra.run.smithi080.stdout:[MIRROR] python3-certifi-2018.10.15-7.el8.noarch.rpm: Curl error (7): Couldn't connect to server for http://epel.stl.us.ssimn.org/8/Everything/x86_64/Packages/p/python3-certifi-2018.10.15-7.el8.noarch.rpm [Failed to connect to epel.stl.us.ssimn.org port 80: Connection timed out] 2024-02-19T21:22:41.457 INFO:teuthology.orchestra.run.smithi080.stdout:(12/13): python3-cachetools-3.1.1-4.el8.noarch. 243 B/s | 33 kB 02:18 2024-02-19T21:24:45.049 INFO:teuthology.orchestra.run.smithi080.stdout:[MIRROR] python3-certifi-2018.10.15-7.el8.noarch.rpm: Curl error (7): Couldn't connect to server for https://epel.stl.us.ssimn.org/8/Everything/x86_64/Packages/p/python3-certifi-2018.10.15-7.el8.noarch.rpm [Failed to connect to epel.stl.us.ssimn.org port 443: Connection timed out] 2024-02-19T21:24:45.488 INFO:teuthology.orchestra.run.smithi080.stdout:(13/13): python3-certifi-2018.10.15-7.el8.noarc 63 B/s | 16 kB 04:22 2024-02-19T21:24:45.489 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:24:45.489 INFO:teuthology.orchestra.run.smithi080.stdout:Total 7.4 kB/s | 1.9 MB 04:23 2024-02-19T21:24:45.540 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-02-19T21:24:45.556 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-02-19T21:24:45.557 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-02-19T21:24:45.645 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-02-19T21:24:45.648 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-02-19T21:24:46.322 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-02-19T21:24:46.573 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2024-02-19T21:24:46.809 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2024-02-19T21:24:47.064 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2024-02-19T21:24:47.302 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2024-02-19T21:24:47.501 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2024-02-19T21:24:47.759 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2024-02-19T21:24:48.101 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2024-02-19T21:24:48.383 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2024-02-19T21:24:49.389 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2024-02-19T21:24:49.684 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2024-02-19T21:24:49.926 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2024-02-19T21:24:50.151 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2024-02-19T21:24:50.352 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-rook-2:16.2.14-548.g81bd20d6.el8.noarch 13/13 2024-02-19T21:24:50.637 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-548.g81bd20d6.el8.noarch 13/13 2024-02-19T21:24:50.637 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-rook-2:16.2.14-548.g81bd20d6.el8.noarch 1/13 2024-02-19T21:24:50.638 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2024-02-19T21:24:50.638 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2024-02-19T21:24:50.638 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2024-02-19T21:24:50.638 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2024-02-19T21:24:50.638 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2024-02-19T21:24:50.638 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2024-02-19T21:24:50.638 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2024-02-19T21:24:50.638 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2024-02-19T21:24:50.638 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2024-02-19T21:24:50.638 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2024-02-19T21:24:50.638 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2024-02-19T21:24:51.068 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2024-02-19T21:24:51.068 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:24:51.068 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-02-19T21:24:51.068 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-rook-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:24:51.068 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-02-19T21:24:51.069 INFO:teuthology.orchestra.run.smithi080.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-02-19T21:24:51.069 INFO:teuthology.orchestra.run.smithi080.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-02-19T21:24:51.069 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-02-19T21:24:51.069 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-02-19T21:24:51.069 INFO:teuthology.orchestra.run.smithi080.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-02-19T21:24:51.069 INFO:teuthology.orchestra.run.smithi080.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-02-19T21:24:51.069 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-02-19T21:24:51.069 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-02-19T21:24:51.069 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-02-19T21:24:51.069 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rsa-4.9-2.el8.noarch 2024-02-19T21:24:51.069 INFO:teuthology.orchestra.run.smithi080.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-02-19T21:24:51.069 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:24:51.070 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-19T21:24:51.235 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-mgr-cephadm 2024-02-19T21:24:51.988 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:06:54 ago on Mon 19 Feb 2024 09:17:57 PM UTC. 2024-02-19T21:24:53.513 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-19T21:24:53.514 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:24:53.514 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-02-19T21:24:53.514 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:24:53.514 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-02-19T21:24:53.514 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-cephadm noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 116 k 2024-02-19T21:24:53.514 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-02-19T21:24:53.514 INFO:teuthology.orchestra.run.smithi080.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2024-02-19T21:24:53.514 INFO:teuthology.orchestra.run.smithi080.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-02-19T21:24:53.514 INFO:teuthology.orchestra.run.smithi080.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2024-02-19T21:24:53.514 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-02-19T21:24:53.515 INFO:teuthology.orchestra.run.smithi080.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2024-02-19T21:24:53.515 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:24:53.515 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-02-19T21:24:53.515 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:24:53.515 INFO:teuthology.orchestra.run.smithi080.stdout:Install 6 Packages 2024-02-19T21:24:53.515 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:24:53.515 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 5.9 M 2024-02-19T21:24:53.516 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 24 M 2024-02-19T21:24:53.516 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-02-19T21:24:53.912 INFO:teuthology.orchestra.run.smithi080.stdout:(1/6): ceph-mgr-cephadm-16.2.14-548.g81bd20d6.e 645 kB/s | 116 kB 00:00 2024-02-19T21:24:54.154 INFO:teuthology.orchestra.run.smithi080.stdout:(2/6): python3-apipkg-1.5-6.el8.noarch.rpm 88 kB/s | 21 kB 00:00 2024-02-19T21:24:54.213 INFO:teuthology.orchestra.run.smithi080.stdout:(3/6): python3-jinja2-2.10.1-4.el8.noarch.rpm 1.2 MB/s | 578 kB 00:00 2024-02-19T21:24:54.421 INFO:teuthology.orchestra.run.smithi080.stdout:(4/6): python3-execnet-1.7.1-1.el8.noarch.rpm 1.3 MB/s | 355 kB 00:00 2024-02-19T21:24:54.472 INFO:teuthology.orchestra.run.smithi080.stdout:(5/6): python3-remoto-1.2.1-1.el8.noarch.rpm 189 kB/s | 49 kB 00:00 2024-02-19T21:24:55.264 INFO:teuthology.orchestra.run.smithi080.stdout:(6/6): python3-babel-2.5.1-7.el8.noarch.rpm 3.1 MB/s | 4.8 MB 00:01 2024-02-19T21:24:55.266 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:24:55.266 INFO:teuthology.orchestra.run.smithi080.stdout:Total 3.4 MB/s | 5.9 MB 00:01 2024-02-19T21:24:55.317 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-02-19T21:24:55.327 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-02-19T21:24:55.327 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-02-19T21:24:55.431 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-02-19T21:24:55.435 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-02-19T21:24:55.742 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-02-19T21:24:56.034 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2024-02-19T21:24:56.304 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2024-02-19T21:24:57.244 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2024-02-19T21:24:57.613 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2024-02-19T21:24:57.886 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 5/6 2024-02-19T21:24:58.092 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 6/6 2024-02-19T21:24:58.363 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 6/6 2024-02-19T21:24:58.363 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 1/6 2024-02-19T21:24:58.363 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2024-02-19T21:24:58.363 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 3/6 2024-02-19T21:24:58.364 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2024-02-19T21:24:58.364 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2024-02-19T21:24:58.751 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2024-02-19T21:24:58.751 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:24:58.751 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-02-19T21:24:58.751 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:24:58.751 INFO:teuthology.orchestra.run.smithi080.stdout: python3-apipkg-1.5-6.el8.noarch 2024-02-19T21:24:58.751 INFO:teuthology.orchestra.run.smithi080.stdout: python3-babel-2.5.1-7.el8.noarch 2024-02-19T21:24:58.751 INFO:teuthology.orchestra.run.smithi080.stdout: python3-execnet-1.7.1-1.el8.noarch 2024-02-19T21:24:58.751 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-02-19T21:24:58.751 INFO:teuthology.orchestra.run.smithi080.stdout: python3-remoto-1.2.1-1.el8.noarch 2024-02-19T21:24:58.751 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:24:58.751 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-19T21:24:58.937 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-fuse 2024-02-19T21:24:59.688 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:07:02 ago on Mon 19 Feb 2024 09:17:57 PM UTC. 2024-02-19T21:25:01.239 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-19T21:25:01.240 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:25:01.240 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-02-19T21:25:01.240 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:25:01.240 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-02-19T21:25:01.240 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-fuse x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 911 k 2024-02-19T21:25:01.240 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-02-19T21:25:01.240 INFO:teuthology.orchestra.run.smithi080.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2024-02-19T21:25:01.240 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:25:01.240 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-02-19T21:25:01.240 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:25:01.240 INFO:teuthology.orchestra.run.smithi080.stdout:Install 2 Packages 2024-02-19T21:25:01.241 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:25:01.241 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 994 k 2024-02-19T21:25:01.241 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 2.8 M 2024-02-19T21:25:01.241 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-02-19T21:25:01.389 INFO:teuthology.orchestra.run.smithi080.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 877 kB/s | 83 kB 00:00 2024-02-19T21:25:01.614 INFO:teuthology.orchestra.run.smithi080.stdout:(2/2): ceph-fuse-16.2.14-548.g81bd20d6.el8.x86_ 2.8 MB/s | 911 kB 00:00 2024-02-19T21:25:01.615 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:25:01.615 INFO:teuthology.orchestra.run.smithi080.stdout:Total 2.6 MB/s | 994 kB 00:00 2024-02-19T21:25:01.625 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-02-19T21:25:01.646 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-02-19T21:25:01.646 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-02-19T21:25:01.734 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-02-19T21:25:01.737 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-02-19T21:25:01.907 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-02-19T21:25:02.165 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2024-02-19T21:25:02.358 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 2/2 2024-02-19T21:25:02.759 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 2/2 2024-02-19T21:25:02.760 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 1/2 2024-02-19T21:25:03.151 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2024-02-19T21:25:03.151 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:25:03.151 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-02-19T21:25:03.151 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2024-02-19T21:25:03.151 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:25:03.151 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-19T21:25:03.391 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install librados-devel 2024-02-19T21:25:04.155 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:07:07 ago on Mon 19 Feb 2024 09:17:57 PM UTC. 2024-02-19T21:25:05.704 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-19T21:25:05.705 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:25:05.705 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repo Size 2024-02-19T21:25:05.705 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:25:05.705 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-02-19T21:25:05.705 INFO:teuthology.orchestra.run.smithi080.stdout: librados-devel x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 131 k 2024-02-19T21:25:05.705 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:25:05.705 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-02-19T21:25:05.705 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:25:05.705 INFO:teuthology.orchestra.run.smithi080.stdout:Install 1 Package 2024-02-19T21:25:05.705 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:25:05.706 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 131 k 2024-02-19T21:25:05.706 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 432 k 2024-02-19T21:25:05.706 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-02-19T21:25:06.035 INFO:teuthology.orchestra.run.smithi080.stdout:librados-devel-16.2.14-548.g81bd20d6.el8.x86_64 399 kB/s | 131 kB 00:00 2024-02-19T21:25:06.035 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:25:06.035 INFO:teuthology.orchestra.run.smithi080.stdout:Total 397 kB/s | 131 kB 00:00 2024-02-19T21:25:06.036 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-02-19T21:25:06.043 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-02-19T21:25:06.043 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-02-19T21:25:06.090 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-02-19T21:25:06.093 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-02-19T21:25:06.206 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-02-19T21:25:06.440 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librados-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:25:06.759 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librados-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:25:07.181 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:25:07.181 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:25:07.181 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-02-19T21:25:07.181 INFO:teuthology.orchestra.run.smithi080.stdout: librados-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:25:07.181 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:25:07.181 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-19T21:25:07.454 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install libcephfs2 2024-02-19T21:25:08.215 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:07:11 ago on Mon 19 Feb 2024 09:17:57 PM UTC. 2024-02-19T21:25:09.721 INFO:teuthology.orchestra.run.smithi080.stdout:Package libcephfs2-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:25:09.767 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-19T21:25:09.768 INFO:teuthology.orchestra.run.smithi080.stdout:Nothing to do. 2024-02-19T21:25:09.768 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-19T21:25:09.890 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install libcephfs-devel 2024-02-19T21:25:10.644 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:07:13 ago on Mon 19 Feb 2024 09:17:57 PM UTC. 2024-02-19T21:25:12.203 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-19T21:25:12.204 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:25:12.204 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repo Size 2024-02-19T21:25:12.204 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:25:12.204 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-02-19T21:25:12.204 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs-devel x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 25 k 2024-02-19T21:25:12.204 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:25:12.204 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-02-19T21:25:12.205 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:25:12.205 INFO:teuthology.orchestra.run.smithi080.stdout:Install 1 Package 2024-02-19T21:25:12.205 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:25:12.205 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 25 k 2024-02-19T21:25:12.205 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 107 k 2024-02-19T21:25:12.205 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-02-19T21:25:12.628 INFO:teuthology.orchestra.run.smithi080.stdout:libcephfs-devel-16.2.14-548.g81bd20d6.el8.x86_6 60 kB/s | 25 kB 00:00 2024-02-19T21:25:12.629 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:25:12.629 INFO:teuthology.orchestra.run.smithi080.stdout:Total 60 kB/s | 25 kB 00:00 2024-02-19T21:25:12.629 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-02-19T21:25:12.633 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-02-19T21:25:12.633 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-02-19T21:25:12.635 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-02-19T21:25:12.638 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-02-19T21:25:12.692 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-02-19T21:25:12.938 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephfs-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:25:13.200 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libcephfs-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:25:13.545 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephfs-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:25:13.546 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:25:13.546 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-02-19T21:25:13.546 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:25:13.546 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:25:13.546 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-19T21:25:13.675 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install librados2 2024-02-19T21:25:14.430 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:07:17 ago on Mon 19 Feb 2024 09:17:57 PM UTC. 2024-02-19T21:25:15.971 INFO:teuthology.orchestra.run.smithi080.stdout:Package librados2-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:25:16.018 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-19T21:25:16.019 INFO:teuthology.orchestra.run.smithi080.stdout:Nothing to do. 2024-02-19T21:25:16.019 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-19T21:25:16.125 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install librbd1 2024-02-19T21:25:16.891 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:07:19 ago on Mon 19 Feb 2024 09:17:57 PM UTC. 2024-02-19T21:25:18.431 INFO:teuthology.orchestra.run.smithi080.stdout:Package librbd1-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:25:18.477 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-19T21:25:18.478 INFO:teuthology.orchestra.run.smithi080.stdout:Nothing to do. 2024-02-19T21:25:18.478 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-19T21:25:18.595 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install python3-rados 2024-02-19T21:25:19.340 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:07:22 ago on Mon 19 Feb 2024 09:17:57 PM UTC. 2024-02-19T21:25:20.833 INFO:teuthology.orchestra.run.smithi080.stdout:Package python3-rados-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:25:20.879 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-19T21:25:20.880 INFO:teuthology.orchestra.run.smithi080.stdout:Nothing to do. 2024-02-19T21:25:20.880 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-19T21:25:20.993 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install python3-rgw 2024-02-19T21:25:21.741 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:07:24 ago on Mon 19 Feb 2024 09:17:57 PM UTC. 2024-02-19T21:25:23.248 INFO:teuthology.orchestra.run.smithi080.stdout:Package python3-rgw-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:25:23.294 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-19T21:25:23.295 INFO:teuthology.orchestra.run.smithi080.stdout:Nothing to do. 2024-02-19T21:25:23.295 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-19T21:25:23.421 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install python3-cephfs 2024-02-19T21:25:24.175 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:07:27 ago on Mon 19 Feb 2024 09:17:57 PM UTC. 2024-02-19T21:25:25.667 INFO:teuthology.orchestra.run.smithi080.stdout:Package python3-cephfs-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:25:25.713 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-19T21:25:25.715 INFO:teuthology.orchestra.run.smithi080.stdout:Nothing to do. 2024-02-19T21:25:25.715 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-19T21:25:25.831 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install python3-rbd 2024-02-19T21:25:26.576 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:07:29 ago on Mon 19 Feb 2024 09:17:57 PM UTC. 2024-02-19T21:25:28.129 INFO:teuthology.orchestra.run.smithi080.stdout:Package python3-rbd-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:25:28.175 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-19T21:25:28.176 INFO:teuthology.orchestra.run.smithi080.stdout:Nothing to do. 2024-02-19T21:25:28.176 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-19T21:25:28.291 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install rbd-fuse 2024-02-19T21:25:29.057 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:07:32 ago on Mon 19 Feb 2024 09:17:57 PM UTC. 2024-02-19T21:25:30.596 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-19T21:25:30.596 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:25:30.596 INFO:teuthology.orchestra.run.smithi080.stdout: Package Architecture Version Repository Size 2024-02-19T21:25:30.596 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:25:30.597 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-02-19T21:25:30.597 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-fuse x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 88 k 2024-02-19T21:25:30.597 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:25:30.597 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-02-19T21:25:30.597 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:25:30.597 INFO:teuthology.orchestra.run.smithi080.stdout:Install 1 Package 2024-02-19T21:25:30.597 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:25:30.597 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 88 k 2024-02-19T21:25:30.597 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 240 k 2024-02-19T21:25:30.597 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-02-19T21:25:31.067 INFO:teuthology.orchestra.run.smithi080.stdout:rbd-fuse-16.2.14-548.g81bd20d6.el8.x86_64.rpm 188 kB/s | 88 kB 00:00 2024-02-19T21:25:31.068 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:25:31.068 INFO:teuthology.orchestra.run.smithi080.stdout:Total 188 kB/s | 88 kB 00:00 2024-02-19T21:25:31.068 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-02-19T21:25:31.078 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-02-19T21:25:31.078 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-02-19T21:25:31.128 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-02-19T21:25:31.131 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-02-19T21:25:31.266 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-02-19T21:25:31.501 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:25:31.773 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: rbd-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:25:32.162 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:25:32.162 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:25:32.162 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-02-19T21:25:32.162 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:25:32.162 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:25:32.162 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-19T21:25:32.438 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install rbd-mirror 2024-02-19T21:25:33.195 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:07:36 ago on Mon 19 Feb 2024 09:17:57 PM UTC. 2024-02-19T21:25:34.747 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-19T21:25:34.748 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:25:34.748 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repo Size 2024-02-19T21:25:34.748 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:25:34.748 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-02-19T21:25:34.748 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-mirror x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 3.7 M 2024-02-19T21:25:34.748 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:25:34.748 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-02-19T21:25:34.748 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:25:34.748 INFO:teuthology.orchestra.run.smithi080.stdout:Install 1 Package 2024-02-19T21:25:34.748 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:25:34.749 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 3.7 M 2024-02-19T21:25:34.749 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 15 M 2024-02-19T21:25:34.749 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-02-19T21:25:35.445 INFO:teuthology.orchestra.run.smithi080.stdout:rbd-mirror-16.2.14-548.g81bd20d6.el8.x86_64.rpm 5.3 MB/s | 3.7 MB 00:00 2024-02-19T21:25:35.446 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:25:35.446 INFO:teuthology.orchestra.run.smithi080.stdout:Total 5.3 MB/s | 3.7 MB 00:00 2024-02-19T21:25:35.446 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-02-19T21:25:35.459 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-02-19T21:25:35.459 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-02-19T21:25:35.521 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-02-19T21:25:35.524 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-02-19T21:25:35.995 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-02-19T21:25:36.210 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-mirror-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:25:36.628 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: rbd-mirror-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:25:37.072 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-mirror-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:25:37.072 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:25:37.072 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-02-19T21:25:37.072 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-mirror-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:25:37.072 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:25:37.072 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-19T21:25:37.360 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install rbd-nbd 2024-02-19T21:25:38.129 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:07:41 ago on Mon 19 Feb 2024 09:17:57 PM UTC. 2024-02-19T21:25:39.669 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-19T21:25:39.670 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:25:39.670 INFO:teuthology.orchestra.run.smithi080.stdout: Package Architecture Version Repository Size 2024-02-19T21:25:39.670 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:25:39.670 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-02-19T21:25:39.670 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-nbd x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 175 k 2024-02-19T21:25:39.670 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:25:39.670 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-02-19T21:25:39.670 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-19T21:25:39.670 INFO:teuthology.orchestra.run.smithi080.stdout:Install 1 Package 2024-02-19T21:25:39.670 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:25:39.671 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 175 k 2024-02-19T21:25:39.671 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 523 k 2024-02-19T21:25:39.671 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-02-19T21:25:39.866 INFO:teuthology.orchestra.run.smithi080.stdout:rbd-nbd-16.2.14-548.g81bd20d6.el8.x86_64.rpm 902 kB/s | 175 kB 00:00 2024-02-19T21:25:39.866 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:25:39.866 INFO:teuthology.orchestra.run.smithi080.stdout:Total 896 kB/s | 175 kB 00:00 2024-02-19T21:25:39.867 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-02-19T21:25:39.877 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-02-19T21:25:39.877 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-02-19T21:25:39.926 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-02-19T21:25:39.929 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-02-19T21:25:40.072 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-02-19T21:25:40.307 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-nbd-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:25:40.586 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: rbd-nbd-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:25:40.952 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-nbd-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:25:40.952 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:25:40.952 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-02-19T21:25:40.952 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-nbd-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:25:40.952 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:25:40.952 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-19T21:25:41.199 DEBUG:teuthology.parallel:result is None 2024-02-19T21:25:41.199 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=81bd20d634209c7cb82c18be12b4b5a05643ebf1 2024-02-19T21:25:41.423 DEBUG:teuthology.orchestra.run.smithi080:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-19T21:25:41.446 INFO:teuthology.orchestra.run.smithi080.stdout:16.2.14-548.g81bd20d6.el8 2024-02-19T21:25:41.446 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-548.g81bd20d6.el8 2024-02-19T21:25:41.446 INFO:teuthology.task.install:The correct ceph version 16.2.14-548.g81bd20d6 is installed. 2024-02-19T21:25:41.448 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=81bd20d634209c7cb82c18be12b4b5a05643ebf1 2024-02-19T21:25:41.592 DEBUG:teuthology.orchestra.run.smithi157:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-19T21:25:41.621 INFO:teuthology.orchestra.run.smithi157.stdout:16.2.14-548.g81bd20d6.el8 2024-02-19T21:25:41.621 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-548.g81bd20d6.el8 2024-02-19T21:25:41.621 INFO:teuthology.task.install:The correct ceph version 16.2.14-548.g81bd20d6 is installed. 2024-02-19T21:25:41.623 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-19T21:25:41.623 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-19T21:25:41.624 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-19T21:25:41.651 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-02-19T21:25:41.652 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-19T21:25:41.696 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-19T21:25:41.696 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-19T21:25:41.696 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/daemon-helper 2024-02-19T21:25:41.723 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-19T21:25:41.789 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-02-19T21:25:41.790 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/daemon-helper 2024-02-19T21:25:41.820 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-19T21:25:41.889 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-19T21:25:41.889 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-19T21:25:41.889 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-19T21:25:41.916 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-19T21:25:41.983 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-02-19T21:25:41.983 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-19T21:25:42.012 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-19T21:25:42.080 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-19T21:25:42.081 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-19T21:25:42.081 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/stdin-killer 2024-02-19T21:25:42.107 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-19T21:25:42.173 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-02-19T21:25:42.173 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/stdin-killer 2024-02-19T21:25:42.201 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-19T21:25:42.268 INFO:teuthology.run_tasks:Running task cephadm... 2024-02-19T21:25:42.346 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'ms type': 'async'}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'but it is still running', 'objects unfound and apparently lost', '\\(MON_DOWN\\)', '\\(OSDMAP_FLAGS\\)', 'flag\\(s\\) set', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(PG_', '\\(OSD_', {'mons down': None}], 'sha1': '81bd20d634209c7cb82c18be12b4b5a05643ebf1', 'cephadm_mode': 'root'} 2024-02-19T21:25:42.346 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 2024-02-19T21:25:42.346 INFO:tasks.cephadm:Cluster fsid is 6f763558-cf6d-11ee-95bb-87774f69a715 2024-02-19T21:25:42.346 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-02-19T21:25:42.347 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.80', 'mon.c': '[v2:172.21.15.80:3301,v1:172.21.15.80:6790]', 'mon.b': '172.21.15.157'} 2024-02-19T21:25:42.347 INFO:tasks.cephadm:First mon is mon.a on smithi080 2024-02-19T21:25:42.347 INFO:tasks.cephadm:First mgr is y 2024-02-19T21:25:42.347 INFO:tasks.cephadm:Normalizing hostnames... 2024-02-19T21:25:42.347 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname $(hostname -s) 2024-02-19T21:25:42.374 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname $(hostname -s) 2024-02-19T21:25:42.401 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph-ci.git ref 81bd20d634209c7cb82c18be12b4b5a05643ebf1)... 2024-02-19T21:25:42.402 DEBUG:teuthology.orchestra.run.smithi080:> curl --silent https://raw.githubusercontent.com/ceph/ceph-ci/81bd20d634209c7cb82c18be12b4b5a05643ebf1/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-19T21:25:42.566 INFO:teuthology.orchestra.run.smithi080.stdout:-rw-rw-r--. 1 ubuntu ubuntu 355729 Feb 19 21:25 /home/ubuntu/cephtest/cephadm 2024-02-19T21:25:42.566 DEBUG:teuthology.orchestra.run.smithi157:> curl --silent https://raw.githubusercontent.com/ceph/ceph-ci/81bd20d634209c7cb82c18be12b4b5a05643ebf1/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-19T21:25:42.698 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-rw-r--. 1 ubuntu ubuntu 355729 Feb 19 21:25 /home/ubuntu/cephtest/cephadm 2024-02-19T21:25:42.698 DEBUG:teuthology.orchestra.run.smithi080:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-19T21:25:42.717 DEBUG:teuthology.orchestra.run.smithi157:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-19T21:25:42.746 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /etc/ceph 2024-02-19T21:25:42.783 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /etc/ceph 2024-02-19T21:25:42.809 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 777 /etc/ceph 2024-02-19T21:25:42.849 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 777 /etc/ceph 2024-02-19T21:25:42.877 INFO:tasks.cephadm:Writing seed config... 2024-02-19T21:25:42.878 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-02-19T21:25:42.878 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-02-19T21:25:42.878 INFO:tasks.cephadm: override: [client.0] debug ms = 1 2024-02-19T21:25:42.878 INFO:tasks.cephadm: override: [client.0] debug objecter = 20 2024-02-19T21:25:42.878 INFO:tasks.cephadm: override: [client.0] debug rados = 20 2024-02-19T21:25:42.878 INFO:tasks.cephadm: override: [global] ms type = async 2024-02-19T21:25:42.878 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-02-19T21:25:42.878 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-02-19T21:25:42.878 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-02-19T21:25:42.878 INFO:tasks.cephadm: override: [mon] mon min osdmap epochs = 50 2024-02-19T21:25:42.878 INFO:tasks.cephadm: override: [mon] mon osdmap full prune interval = 2 2024-02-19T21:25:42.878 INFO:tasks.cephadm: override: [mon] mon osdmap full prune min = 15 2024-02-19T21:25:42.879 INFO:tasks.cephadm: override: [mon] mon osdmap full prune txsize = 2 2024-02-19T21:25:42.879 INFO:tasks.cephadm: override: [mon] paxos service trim min = 10 2024-02-19T21:25:42.879 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-02-19T21:25:42.879 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-02-19T21:25:42.879 INFO:tasks.cephadm: override: [osd] osd debug reject backfill probability = 0.3 2024-02-19T21:25:42.879 INFO:tasks.cephadm: override: [osd] osd delete sleep = 1 2024-02-19T21:25:42.879 INFO:tasks.cephadm: override: [osd] osd max backfills = 3 2024-02-19T21:25:42.879 INFO:tasks.cephadm: override: [osd] osd scrub max interval = 120 2024-02-19T21:25:42.879 INFO:tasks.cephadm: override: [osd] osd scrub min interval = 60 2024-02-19T21:25:42.879 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-02-19T21:25:42.879 INFO:tasks.cephadm: override: [osd] osd snap trim sleep = 2 2024-02-19T21:25:42.880 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-19T21:25:42.880 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-02-19T21:25:42.906 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 6f763558-cf6d-11ee-95bb-87774f69a715 ms type = async [osd] osd scrub load threshold = 5.0 osd scrub max interval = 120 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 osd debug reject backfill probability = 0.3 osd delete sleep = 1 osd max backfills = 3 osd scrub min interval = 60 osd snap trim sleep = 2 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon min osdmap epochs = 50 mon osdmap full prune interval = 2 mon osdmap full prune min = 15 mon osdmap full prune txsize = 2 paxos service trim min = 10 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client.0] debug ms = 1 debug objecter = 20 debug rados = 20 2024-02-19T21:25:42.907 DEBUG:teuthology.orchestra.run.smithi080:mon.a> sudo journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@mon.a.service 2024-02-19T21:25:42.949 DEBUG:teuthology.orchestra.run.smithi080:mgr.y> sudo journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@mgr.y.service 2024-02-19T21:25:42.975 INFO:journalctl@ceph.mon.a.smithi080.stdout:-- Logs begin at Mon 2024-02-19 21:10:15 UTC. -- 2024-02-19T21:25:42.976 INFO:tasks.cephadm:Bootstrapping... 2024-02-19T21:25:42.976 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 -v bootstrap --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.80 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-02-19T21:25:43.001 INFO:journalctl@ceph.mgr.y.smithi080.stdout:-- Logs begin at Mon 2024-02-19 21:10:15 UTC. -- 2024-02-19T21:25:43.274 INFO:teuthology.orchestra.run.smithi080.stderr:-------------------------------------------------------------------------------- 2024-02-19T21:25:43.274 INFO:teuthology.orchestra.run.smithi080.stderr:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1', '-v', 'bootstrap', '--fsid', '6f763558-cf6d-11ee-95bb-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.80', '--skip-admin-label'] 2024-02-19T21:25:44.467 INFO:teuthology.orchestra.run.smithi080.stderr:/bin/podman: 4.9.3-dev 2024-02-19T21:25:44.481 INFO:teuthology.orchestra.run.smithi080.stderr:Verifying podman|docker is present... 2024-02-19T21:25:44.504 INFO:teuthology.orchestra.run.smithi080.stderr:/bin/podman: 4.9.3-dev 2024-02-19T21:25:44.522 INFO:teuthology.orchestra.run.smithi080.stderr:Verifying lvm2 is present... 2024-02-19T21:25:44.523 INFO:teuthology.orchestra.run.smithi080.stderr:Verifying time synchronization is in place... 2024-02-19T21:25:44.530 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-02-19T21:25:44.537 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: inactive 2024-02-19T21:25:44.543 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: enabled 2024-02-19T21:25:44.549 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: active 2024-02-19T21:25:44.550 INFO:teuthology.orchestra.run.smithi080.stderr:Unit chronyd.service is enabled and running 2024-02-19T21:25:44.550 INFO:teuthology.orchestra.run.smithi080.stderr:Repeating the final host check... 2024-02-19T21:25:44.571 INFO:teuthology.orchestra.run.smithi080.stderr:/bin/podman: 4.9.3-dev 2024-02-19T21:25:44.581 INFO:teuthology.orchestra.run.smithi080.stderr:podman (/bin/podman) version 4.9.3 is present 2024-02-19T21:25:44.581 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl is present 2024-02-19T21:25:44.581 INFO:teuthology.orchestra.run.smithi080.stderr:lvcreate is present 2024-02-19T21:25:44.587 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-02-19T21:25:44.592 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: inactive 2024-02-19T21:25:44.598 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: enabled 2024-02-19T21:25:44.604 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: active 2024-02-19T21:25:44.605 INFO:teuthology.orchestra.run.smithi080.stderr:Unit chronyd.service is enabled and running 2024-02-19T21:25:44.605 INFO:teuthology.orchestra.run.smithi080.stderr:Host looks OK 2024-02-19T21:25:44.605 INFO:teuthology.orchestra.run.smithi080.stderr:Cluster fsid: 6f763558-cf6d-11ee-95bb-87774f69a715 2024-02-19T21:25:44.605 INFO:teuthology.orchestra.run.smithi080.stderr:Acquiring lock 139937146239464 on /run/cephadm/6f763558-cf6d-11ee-95bb-87774f69a715.lock 2024-02-19T21:25:44.605 INFO:teuthology.orchestra.run.smithi080.stderr:Lock 139937146239464 acquired on /run/cephadm/6f763558-cf6d-11ee-95bb-87774f69a715.lock 2024-02-19T21:25:44.606 INFO:teuthology.orchestra.run.smithi080.stderr:Verifying IP 172.21.15.80 port 3300 ... 2024-02-19T21:25:44.606 INFO:teuthology.orchestra.run.smithi080.stderr:Verifying IP 172.21.15.80 port 6789 ... 2024-02-19T21:25:44.606 INFO:teuthology.orchestra.run.smithi080.stderr:Base mon IP(s) is [172.21.15.80:3300, 172.21.15.80:6789], mon addrv is [v2:172.21.15.80:3300,v1:172.21.15.80:6789] 2024-02-19T21:25:44.609 INFO:teuthology.orchestra.run.smithi080.stderr:/sbin/ip: default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.80 metric 100 2024-02-19T21:25:44.609 INFO:teuthology.orchestra.run.smithi080.stderr:/sbin/ip: 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.80 metric 100 2024-02-19T21:25:44.612 INFO:teuthology.orchestra.run.smithi080.stderr:/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2024-02-19T21:25:44.612 INFO:teuthology.orchestra.run.smithi080.stderr:/sbin/ip: fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-02-19T21:25:44.612 INFO:teuthology.orchestra.run.smithi080.stderr:/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1750sec hoplimit 64 pref medium 2024-02-19T21:25:44.615 INFO:teuthology.orchestra.run.smithi080.stderr:/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-02-19T21:25:44.615 INFO:teuthology.orchestra.run.smithi080.stderr:/sbin/ip: inet6 ::1/128 scope host 2024-02-19T21:25:44.615 INFO:teuthology.orchestra.run.smithi080.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-02-19T21:25:44.615 INFO:teuthology.orchestra.run.smithi080.stderr:/sbin/ip: 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-02-19T21:25:44.615 INFO:teuthology.orchestra.run.smithi080.stderr:/sbin/ip: inet6 fe80::ec4:7aff:fe8f:cba9/64 scope link 2024-02-19T21:25:44.615 INFO:teuthology.orchestra.run.smithi080.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-02-19T21:25:44.616 INFO:teuthology.orchestra.run.smithi080.stderr:Mon IP `172.21.15.80` is in CIDR network `172.21.0.0/20` 2024-02-19T21:25:44.616 INFO:teuthology.orchestra.run.smithi080.stderr:Mon IP `172.21.15.80` is in CIDR network `172.21.0.0/20` 2024-02-19T21:25:44.616 INFO:teuthology.orchestra.run.smithi080.stderr:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-02-19T21:25:44.617 INFO:teuthology.orchestra.run.smithi080.stderr:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-02-19T21:25:44.618 INFO:teuthology.orchestra.run.smithi080.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1... 2024-02-19T21:25:44.714 INFO:teuthology.orchestra.run.smithi080.stderr:/bin/podman: Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1... 2024-02-19T21:25:44.912 INFO:teuthology.orchestra.run.smithi080.stderr:/bin/podman: Getting image source signatures 2024-02-19T21:25:44.916 INFO:teuthology.orchestra.run.smithi080.stderr:/bin/podman: Copying blob sha256:0f642e61a11afb42c0ccb5b05f5809250ad643ed143780d6ff49a5a4c492fc38 2024-02-19T21:25:44.916 INFO:teuthology.orchestra.run.smithi080.stderr:/bin/podman: Copying blob sha256:ec93555fb25f6296fcd66f232359fb768587e082c45b15dd379853eb0f28a963 2024-02-19T21:26:06.730 INFO:teuthology.orchestra.run.smithi080.stderr:/bin/podman: Copying config sha256:823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa 2024-02-19T21:26:06.914 INFO:teuthology.orchestra.run.smithi080.stderr:/bin/podman: Writing manifest to image destination 2024-02-19T21:26:07.172 INFO:teuthology.orchestra.run.smithi080.stderr:/bin/podman: 823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa 2024-02-19T21:26:07.823 INFO:teuthology.orchestra.run.smithi080.stderr:ceph: ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable) 2024-02-19T21:26:08.458 INFO:teuthology.orchestra.run.smithi080.stderr:Ceph version: ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable) 2024-02-19T21:26:08.459 INFO:teuthology.orchestra.run.smithi080.stderr:Extracting ceph user uid/gid from container image... 2024-02-19T21:26:08.968 INFO:teuthology.orchestra.run.smithi080.stderr:stat: 167 167 2024-02-19T21:26:09.569 INFO:teuthology.orchestra.run.smithi080.stderr:Creating initial keys... 2024-02-19T21:26:10.183 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-authtool: AQByx9NlQClyAhAAxbxBuU0yH4vyHqMIRDHOsg== 2024-02-19T21:26:11.278 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-authtool: AQBzx9NldNZSCRAA09LNOfNua2/S8ALT/HwAVg== 2024-02-19T21:26:12.429 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-authtool: AQB0x9NlcqimExAA4wisV0KbJWXir5sJjJD9cA== 2024-02-19T21:26:13.025 INFO:teuthology.orchestra.run.smithi080.stderr:Creating initial monmap... 2024-02-19T21:26:13.569 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-19T21:26:13.569 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to 6f763558-cf6d-11ee-95bb-87774f69a715 2024-02-19T21:26:13.569 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-19T21:26:14.187 INFO:teuthology.orchestra.run.smithi080.stderr:monmaptool for a [v2:172.21.15.80:3300,v1:172.21.15.80:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-19T21:26:14.187 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/monmaptool: set fsid to 6f763558-cf6d-11ee-95bb-87774f69a715 2024-02-19T21:26:14.187 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-19T21:26:14.187 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-02-19T21:26:14.187 INFO:teuthology.orchestra.run.smithi080.stderr:Creating mon... 2024-02-19T21:26:14.743 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.676+0000 7f22984b5880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-19T21:26:14.743 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.676+0000 7f22984b5880 1 imported monmap: 2024-02-19T21:26:14.743 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: epoch 0 2024-02-19T21:26:14.743 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: fsid 6f763558-cf6d-11ee-95bb-87774f69a715 2024-02-19T21:26:14.744 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: last_changed 2024-02-19T21:26:13.490441+0000 2024-02-19T21:26:14.744 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: created 2024-02-19T21:26:13.490441+0000 2024-02-19T21:26:14.773 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: min_mon_release 0 (unknown) 2024-02-19T21:26:14.773 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: election_strategy: 1 2024-02-19T21:26:14.773 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 0: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.a 2024-02-19T21:26:14.773 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-19T21:26:14.773 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.676+0000 7f22984b5880 0 /usr/bin/ceph-mon: set fsid to 6f763558-cf6d-11ee-95bb-87774f69a715 2024-02-19T21:26:14.773 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: RocksDB version: 6.8.1 2024-02-19T21:26:14.773 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-19T21:26:14.773 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-19T21:26:14.774 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Compile date Feb 17 2024 2024-02-19T21:26:14.774 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: DB SUMMARY 2024-02-19T21:26:14.774 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-19T21:26:14.774 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2024-02-19T21:26:14.774 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-19T21:26:14.774 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2024-02-19T21:26:14.774 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-19T21:26:14.774 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.error_if_exists: 0 2024-02-19T21:26:14.775 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.create_if_missing: 1 2024-02-19T21:26:14.775 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.paranoid_checks: 1 2024-02-19T21:26:14.775 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.env: 0x5604ccb6a080 2024-02-19T21:26:14.775 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.fs: Posix File System 2024-02-19T21:26:14.775 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.info_log: 0x5604cdf43a00 2024-02-19T21:26:14.775 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-19T21:26:14.775 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.statistics: (nil) 2024-02-19T21:26:14.775 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.use_fsync: 0 2024-02-19T21:26:14.776 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.max_log_file_size: 0 2024-02-19T21:26:14.776 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-19T21:26:14.776 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-19T21:26:14.776 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-19T21:26:14.776 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-19T21:26:14.776 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.allow_fallocate: 1 2024-02-19T21:26:14.776 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-19T21:26:14.776 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-19T21:26:14.776 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.use_direct_reads: 0 2024-02-19T21:26:14.776 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-19T21:26:14.777 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-19T21:26:14.777 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.db_log_dir: 2024-02-19T21:26:14.777 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-02-19T21:26:14.777 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-19T21:26:14.777 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.max_subcompactions: 1 2024-02-19T21:26:14.777 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.max_background_flushes: -1 2024-02-19T21:26:14.777 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-19T21:26:14.777 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-19T21:26:14.777 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-19T21:26:14.777 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-19T21:26:14.777 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-19T21:26:14.777 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-19T21:26:14.778 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-19T21:26:14.778 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.write_buffer_manager: 0x5604cdf49920 2024-02-19T21:26:14.778 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-19T21:26:14.778 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-19T21:26:14.778 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-19T21:26:14.778 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-19T21:26:14.778 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-19T21:26:14.778 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-19T21:26:14.778 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-19T21:26:14.778 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-19T21:26:14.778 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-19T21:26:14.778 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.unordered_write: 0 2024-02-19T21:26:14.779 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-19T21:26:14.779 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-19T21:26:14.779 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-19T21:26:14.779 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-19T21:26:14.779 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.row_cache: None 2024-02-19T21:26:14.779 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.wal_filter: None 2024-02-19T21:26:14.779 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-19T21:26:14.779 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-19T21:26:14.779 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.preserve_deletes: 0 2024-02-19T21:26:14.779 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.two_write_queues: 0 2024-02-19T21:26:14.779 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-19T21:26:14.779 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.atomic_flush: 0 2024-02-19T21:26:14.779 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-19T21:26:14.779 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-19T21:26:14.780 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-19T21:26:14.780 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.log_readahead_size: 0 2024-02-19T21:26:14.780 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-19T21:26:14.780 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.max_background_jobs: 2 2024-02-19T21:26:14.780 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.max_background_compactions: -1 2024-02-19T21:26:14.780 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-19T21:26:14.780 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-19T21:26:14.780 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-19T21:26:14.780 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-19T21:26:14.780 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-19T21:26:14.780 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-19T21:26:14.780 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-19T21:26:14.781 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-19T21:26:14.781 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.max_open_files: -1 2024-02-19T21:26:14.781 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-19T21:26:14.781 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-19T21:26:14.781 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-19T21:26:14.781 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-19T21:26:14.781 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Compression algorithms supported: 2024-02-19T21:26:14.781 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-19T21:26:14.782 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: kZSTD supported: 0 2024-02-19T21:26:14.782 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: kXpressCompression supported: 0 2024-02-19T21:26:14.782 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-19T21:26:14.782 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: kLZ4Compression supported: 1 2024-02-19T21:26:14.782 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: kBZip2Compression supported: 0 2024-02-19T21:26:14.782 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: kZlibCompression supported: 1 2024-02-19T21:26:14.782 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: kSnappyCompression supported: 1 2024-02-19T21:26:14.782 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-19T21:26:14.782 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: [db_impl/db_impl_open.cc:273] Creating manifest 1 2024-02-19T21:26:14.782 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-19T21:26:14.782 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2024-02-19T21:26:14.782 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-19T21:26:14.783 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-19T21:26:14.783 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-19T21:26:14.783 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-19T21:26:14.783 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.merge_operator: 2024-02-19T21:26:14.783 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.compaction_filter: None 2024-02-19T21:26:14.783 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-19T21:26:14.783 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-19T21:26:14.783 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-19T21:26:14.783 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.677+0000 7f22984b5880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5604cde59d18) 2024-02-19T21:26:14.783 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks: 1 2024-02-19T21:26:14.783 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-19T21:26:14.784 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-19T21:26:14.784 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: pin_top_level_index_and_filter: 1 2024-02-19T21:26:14.784 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: index_type: 0 2024-02-19T21:26:14.784 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: data_block_index_type: 0 2024-02-19T21:26:14.784 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: index_shortening: 1 2024-02-19T21:26:14.784 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: data_block_hash_table_util_ratio: 0.750000 2024-02-19T21:26:14.784 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: hash_index_allow_collision: 1 2024-02-19T21:26:14.784 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: checksum: 1 2024-02-19T21:26:14.784 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: no_block_cache: 0 2024-02-19T21:26:14.784 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: block_cache: 0x5604cde8ed10 2024-02-19T21:26:14.785 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: block_cache_name: BinnedLRUCache 2024-02-19T21:26:14.785 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: block_cache_options: 2024-02-19T21:26:14.785 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: capacity : 536870912 2024-02-19T21:26:14.785 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: num_shard_bits : 4 2024-02-19T21:26:14.785 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: strict_capacity_limit : 0 2024-02-19T21:26:14.785 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: high_pri_pool_ratio: 0.000 2024-02-19T21:26:14.785 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: block_cache_compressed: (nil) 2024-02-19T21:26:14.785 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: persistent_cache: (nil) 2024-02-19T21:26:14.785 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: block_size: 4096 2024-02-19T21:26:14.785 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: block_size_deviation: 10 2024-02-19T21:26:14.785 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: block_restart_interval: 16 2024-02-19T21:26:14.785 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: index_block_restart_interval: 1 2024-02-19T21:26:14.785 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: metadata_block_size: 4096 2024-02-19T21:26:14.785 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: partition_filters: 0 2024-02-19T21:26:14.786 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: use_delta_encoding: 1 2024-02-19T21:26:14.786 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-19T21:26:14.786 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: whole_key_filtering: 1 2024-02-19T21:26:14.786 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: verify_compression: 0 2024-02-19T21:26:14.786 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: read_amp_bytes_per_bit: 0 2024-02-19T21:26:14.786 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: format_version: 2 2024-02-19T21:26:14.786 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: enable_index_compression: 1 2024-02-19T21:26:14.786 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: block_align: 0 2024-02-19T21:26:14.786 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-19T21:26:14.786 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-19T21:26:14.786 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-19T21:26:14.786 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.compression: NoCompression 2024-02-19T21:26:14.786 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-19T21:26:14.787 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-19T21:26:14.787 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-19T21:26:14.787 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.num_levels: 7 2024-02-19T21:26:14.787 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-19T21:26:14.787 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-19T21:26:14.787 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-19T21:26:14.787 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-19T21:26:14.787 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-19T21:26:14.787 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-19T21:26:14.787 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-19T21:26:14.787 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-19T21:26:14.787 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-19T21:26:14.787 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-19T21:26:14.788 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-19T21:26:14.788 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-19T21:26:14.788 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-19T21:26:14.788 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-19T21:26:14.788 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-19T21:26:14.788 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-19T21:26:14.788 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-19T21:26:14.788 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-19T21:26:14.788 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-19T21:26:14.788 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-19T21:26:14.788 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-19T21:26:14.789 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-19T21:26:14.789 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-19T21:26:14.789 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-19T21:26:14.789 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-19T21:26:14.789 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-19T21:26:14.789 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-19T21:26:14.789 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-19T21:26:14.789 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-19T21:26:14.789 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-19T21:26:14.789 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-19T21:26:14.789 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-19T21:26:14.789 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-19T21:26:14.790 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-19T21:26:14.790 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-19T21:26:14.790 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-19T21:26:14.790 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-19T21:26:14.790 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-19T21:26:14.790 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-19T21:26:14.790 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-19T21:26:14.790 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-19T21:26:14.790 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-19T21:26:14.790 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-19T21:26:14.790 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-19T21:26:14.790 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-19T21:26:14.790 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-19T21:26:14.790 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-19T21:26:14.791 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.table_properties_collectors: 2024-02-19T21:26:14.791 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.inplace_update_support: 0 2024-02-19T21:26:14.791 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-19T21:26:14.791 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-19T21:26:14.791 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-19T21:26:14.791 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-19T21:26:14.791 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.bloom_locality: 0 2024-02-19T21:26:14.791 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.max_successive_merges: 0 2024-02-19T21:26:14.791 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-19T21:26:14.791 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-19T21:26:14.791 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-19T21:26:14.791 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-19T21:26:14.792 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.ttl: 2592000 2024-02-19T21:26:14.792 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-19T21:26:14.792 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-19T21:26:14.792 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-19T21:26:14.792 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.678+0000 7f22984b5880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2024-02-19T21:26:14.792 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-19T21:26:14.792 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.679+0000 7f22984b5880 4 rocksdb: DB pointer 0x5604cdf57800 2024-02-19T21:26:14.793 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.679+0000 7f2281328700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-19T21:26:14.793 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.679+0000 7f2281328700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-19T21:26:14.793 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: ** DB Stats ** 2024-02-19T21:26:14.793 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T21:26:14.793 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-19T21:26:14.793 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-19T21:26:14.793 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-19T21:26:14.793 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-19T21:26:14.793 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-19T21:26:14.793 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-19T21:26:14.793 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-19T21:26:14.793 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-02-19T21:26:14.793 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-19T21:26:14.793 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T21:26:14.794 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-19T21:26:14.794 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-19T21:26:14.794 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-19T21:26:14.794 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-02-19T21:26:14.794 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-19T21:26:14.794 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T21:26:14.794 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T21:26:14.794 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2024-02-19T21:26:14.794 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-19T21:26:14.794 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2024-02-19T21:26:14.795 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2024-02-19T21:26:14.795 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2024-02-19T21:26:14.795 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T21:26:14.795 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T21:26:14.795 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-19T21:26:14.795 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-19T21:26:14.795 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2024-02-19T21:26:14.795 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-19T21:26:14.795 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-02-19T21:26:14.795 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-19T21:26:14.796 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T21:26:14.796 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-19T21:26:14.796 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-19T21:26:14.796 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-19T21:26:14.796 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-02-19T21:26:14.796 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-19T21:26:14.796 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T21:26:14.796 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T21:26:14.796 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2024-02-19T21:26:14.796 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-19T21:26:14.796 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2024-02-19T21:26:14.796 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2024-02-19T21:26:14.797 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2024-02-19T21:26:14.797 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T21:26:14.797 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T21:26:14.797 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-19T21:26:14.797 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-19T21:26:14.797 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2024-02-19T21:26:14.797 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-19T21:26:14.797 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.680+0000 7f22984b5880 4 rocksdb: [db_impl/db_impl.cc:397] Shutdown: canceling all background work 2024-02-19T21:26:14.797 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.680+0000 7f22984b5880 4 rocksdb: [db_impl/db_impl.cc:573] Shutdown complete 2024-02-19T21:26:14.797 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:26:14.680+0000 7f22984b5880 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2024-02-19T21:26:15.773 INFO:teuthology.orchestra.run.smithi080.stderr:create mon.a on 2024-02-19T21:26:15.786 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-02-19T21:26:15.880 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-02-19T21:26:15.971 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-6f763558-cf6d-11ee-95bb-87774f69a715.target → /etc/systemd/system/ceph-6f763558-cf6d-11ee-95bb-87774f69a715.target. 2024-02-19T21:26:15.972 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-6f763558-cf6d-11ee-95bb-87774f69a715.target → /etc/systemd/system/ceph-6f763558-cf6d-11ee-95bb-87774f69a715.target. 2024-02-19T21:26:16.173 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: Failed to reset failed state of unit ceph-6f763558-cf6d-11ee-95bb-87774f69a715@mon.a.service: Unit ceph-6f763558-cf6d-11ee-95bb-87774f69a715@mon.a.service not loaded. 2024-02-19T21:26:16.180 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: Created symlink /etc/systemd/system/ceph-6f763558-cf6d-11ee-95bb-87774f69a715.target.wants/ceph-6f763558-cf6d-11ee-95bb-87774f69a715@mon.a.service → /etc/systemd/system/ceph-6f763558-cf6d-11ee-95bb-87774f69a715@.service. 2024-02-19T21:26:16.306 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:16 smithi080 systemd[1]: Starting Ceph mon.a for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T21:26:16.954 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: disabled 2024-02-19T21:26:16.962 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: inactive 2024-02-19T21:26:16.962 INFO:teuthology.orchestra.run.smithi080.stderr:firewalld.service is not enabled 2024-02-19T21:26:16.963 INFO:teuthology.orchestra.run.smithi080.stderr:Not possible to enable service . firewalld.service is not available 2024-02-19T21:26:16.963 INFO:teuthology.orchestra.run.smithi080.stderr:Waiting for mon to start... 2024-02-19T21:26:16.963 INFO:teuthology.orchestra.run.smithi080.stderr:Waiting for mon... 2024-02-19T21:26:17.178 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[37718]: cluster 2024-02-19T21:26:16.880379+0000 mon.a (mon.0) 0 : [INF] mkfs 6f763558-cf6d-11ee-95bb-87774f69a715 2024-02-19T21:26:17.178 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[37718]: cluster 2024-02-19T21:26:16.874723+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-02-19T21:26:17.178 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:16 smithi080 bash[37703]: 9fa908ad1f2d8bd58fa1bab38122851c3785e0f212c64439ae525e3fbdfbc985 2024-02-19T21:26:17.178 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:16 smithi080 systemd[1]: Started Ceph mon.a for 6f763558-cf6d-11ee-95bb-87774f69a715. 2024-02-19T21:26:17.580 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: cluster: 2024-02-19T21:26:17.580 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: id: 6f763558-cf6d-11ee-95bb-87774f69a715 2024-02-19T21:26:17.580 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: health: HEALTH_OK 2024-02-19T21:26:17.580 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-19T21:26:17.580 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: services: 2024-02-19T21:26:17.580 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: mon: 1 daemons, quorum a (age 0.69733s) 2024-02-19T21:26:17.580 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: mgr: no daemons active 2024-02-19T21:26:17.580 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2024-02-19T21:26:17.580 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-19T21:26:17.580 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: data: 2024-02-19T21:26:17.580 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2024-02-19T21:26:17.581 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2024-02-19T21:26:17.581 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2024-02-19T21:26:17.581 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: pgs: 2024-02-19T21:26:17.581 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-19T21:26:18.252 INFO:teuthology.orchestra.run.smithi080.stderr:mon is available 2024-02-19T21:26:18.252 INFO:teuthology.orchestra.run.smithi080.stderr:Assimilating anything we can from ceph.conf... 2024-02-19T21:26:18.254 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[37718]: cluster 2024-02-19T21:26:16.878703+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-02-19T21:26:18.255 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[37718]: cluster 2024-02-19T21:26:16.879191+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0]} removed_ranks: {} 2024-02-19T21:26:18.255 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[37718]: cluster 2024-02-19T21:26:16.882387+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2024-02-19T21:26:18.255 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[37718]: cluster 2024-02-19T21:26:16.884203+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-02-19T21:26:18.255 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[37718]: cluster 2024-02-19T21:26:16.884600+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2024-02-19T21:26:18.255 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[37718]: audit 2024-02-19T21:26:17.575996+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.80:0/2920764765' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-19T21:26:18.811 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-19T21:26:18.811 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: [global] 2024-02-19T21:26:18.811 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: fsid = 6f763558-cf6d-11ee-95bb-87774f69a715 2024-02-19T21:26:18.812 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: log_to_journald = false 2024-02-19T21:26:18.812 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.80:3300,v1:172.21.15.80:6789] 2024-02-19T21:26:18.812 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-02-19T21:26:18.812 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-02-19T21:26:18.812 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-02-19T21:26:18.812 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-02-19T21:26:18.812 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-19T21:26:18.812 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: [mgr] 2024-02-19T21:26:18.812 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-02-19T21:26:18.812 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-19T21:26:18.812 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: [osd] 2024-02-19T21:26:18.812 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-02-19T21:26:18.812 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-02-19T21:26:19.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[37718]: audit 2024-02-19T21:26:18.804082+0000 mon.a (mon.0) 8 : audit [INF] from='client.? 172.21.15.80:0/1412797152' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-19T21:26:19.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[37718]: audit 2024-02-19T21:26:18.806958+0000 mon.a (mon.0) 9 : audit [INF] from='client.? 172.21.15.80:0/1412797152' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-02-19T21:26:19.308 INFO:teuthology.orchestra.run.smithi080.stderr:Generating new minimal ceph.conf... 2024-02-19T21:26:20.204 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[37718]: audit 2024-02-19T21:26:19.883708+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.80:0/1571332648' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:26:20.491 INFO:teuthology.orchestra.run.smithi080.stderr:Restarting the monitor... 2024-02-19T21:26:20.756 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:20 smithi080 systemd[1]: Stopping Ceph mon.a for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T21:26:20.756 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:20 smithi080 bash[38043]: Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon.a" found: no such container 2024-02-19T21:26:20.756 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[37718]: debug 2024-02-19T21:26:20.752+0000 7fcb4fe17700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-19T21:26:21.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[37718]: debug 2024-02-19T21:26:20.752+0000 7fcb4fe17700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-02-19T21:26:24.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:23 smithi080 bash[38083]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a 2024-02-19T21:26:24.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 systemd[1]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715@mon.a.service: Succeeded. 2024-02-19T21:26:24.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 systemd[1]: Stopped Ceph mon.a for 6f763558-cf6d-11ee-95bb-87774f69a715. 2024-02-19T21:26:24.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 systemd[1]: Starting Ceph mon.a for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T21:26:24.780 INFO:teuthology.orchestra.run.smithi080.stderr:Setting public_network to 172.21.0.0/20 in mon config section 2024-02-19T21:26:25.030 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.735+0000 7f2499e40880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-19T21:26:25.030 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.735+0000 7f2499e40880 0 ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable), process ceph-mon, pid 7 2024-02-19T21:26:25.030 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.735+0000 7f2499e40880 0 pidfile_write: ignore empty --pid-file 2024-02-19T21:26:25.030 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.739+0000 7f2499e40880 0 load: jerasure load: lrc load: isa 2024-02-19T21:26:25.030 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: RocksDB version: 6.8.1 2024-02-19T21:26:25.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: 2024-02-19T21:26:25.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-19T21:26:25.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Compile date Feb 17 2024 2024-02-19T21:26:25.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: DB SUMMARY 2024-02-19T21:26:25.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: 2024-02-19T21:26:25.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: CURRENT file: CURRENT 2024-02-19T21:26:25.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: 2024-02-19T21:26:25.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: IDENTITY file: IDENTITY 2024-02-19T21:26:25.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: 2024-02-19T21:26:25.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 131 Bytes 2024-02-19T21:26:25.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: 2024-02-19T21:26:25.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000004.sst 2024-02-19T21:26:25.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: 2024-02-19T21:26:25.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000006.log size: 92851 ; 2024-02-19T21:26:25.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: 2024-02-19T21:26:25.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.error_if_exists: 0 2024-02-19T21:26:25.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.create_if_missing: 0 2024-02-19T21:26:25.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.paranoid_checks: 1 2024-02-19T21:26:25.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.env: 0x55d823a26080 2024-02-19T21:26:25.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.fs: Posix File System 2024-02-19T21:26:25.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.info_log: 0x55d824e3c260 2024-02-19T21:26:25.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-19T21:26:25.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.statistics: (nil) 2024-02-19T21:26:25.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.use_fsync: 0 2024-02-19T21:26:25.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.max_log_file_size: 0 2024-02-19T21:26:25.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-19T21:26:25.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-19T21:26:25.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-19T21:26:25.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-19T21:26:25.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.allow_fallocate: 1 2024-02-19T21:26:25.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-19T21:26:25.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-19T21:26:25.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.use_direct_reads: 0 2024-02-19T21:26:25.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-19T21:26:25.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-19T21:26:25.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.db_log_dir: 2024-02-19T21:26:25.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-02-19T21:26:25.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-19T21:26:25.034 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.max_subcompactions: 1 2024-02-19T21:26:25.034 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.max_background_flushes: -1 2024-02-19T21:26:25.034 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-19T21:26:25.034 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-19T21:26:25.034 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-19T21:26:25.034 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-19T21:26:25.034 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-19T21:26:25.034 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-19T21:26:25.034 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-19T21:26:25.034 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.write_buffer_manager: 0x55d825b2e3c0 2024-02-19T21:26:25.034 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-19T21:26:25.034 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-19T21:26:25.034 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-19T21:26:25.034 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-19T21:26:25.035 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-19T21:26:25.035 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-19T21:26:25.035 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-19T21:26:25.035 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-19T21:26:25.035 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-19T21:26:25.035 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.unordered_write: 0 2024-02-19T21:26:25.035 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-19T21:26:25.035 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-19T21:26:25.035 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-19T21:26:25.035 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-19T21:26:25.037 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.row_cache: None 2024-02-19T21:26:25.037 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.wal_filter: None 2024-02-19T21:26:25.037 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-19T21:26:25.038 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-19T21:26:25.038 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.preserve_deletes: 0 2024-02-19T21:26:25.038 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.two_write_queues: 0 2024-02-19T21:26:25.038 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-19T21:26:25.038 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.atomic_flush: 0 2024-02-19T21:26:25.038 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-19T21:26:25.038 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-19T21:26:25.038 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-19T21:26:25.038 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.log_readahead_size: 0 2024-02-19T21:26:25.038 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-19T21:26:25.038 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.max_background_jobs: 2 2024-02-19T21:26:25.038 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.max_background_compactions: -1 2024-02-19T21:26:25.038 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-19T21:26:25.038 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-19T21:26:25.039 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-19T21:26:25.039 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-19T21:26:25.039 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-19T21:26:25.039 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-19T21:26:25.039 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-19T21:26:25.039 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-19T21:26:25.039 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.max_open_files: -1 2024-02-19T21:26:25.039 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-19T21:26:25.039 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-19T21:26:25.039 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-19T21:26:25.039 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-19T21:26:25.039 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Compression algorithms supported: 2024-02-19T21:26:25.039 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-19T21:26:25.039 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: kZSTD supported: 0 2024-02-19T21:26:25.039 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: kXpressCompression supported: 0 2024-02-19T21:26:25.040 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-19T21:26:25.040 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: kLZ4Compression supported: 1 2024-02-19T21:26:25.040 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: kBZip2Compression supported: 0 2024-02-19T21:26:25.040 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: kZlibCompression supported: 1 2024-02-19T21:26:25.040 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: kSnappyCompression supported: 1 2024-02-19T21:26:25.040 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-19T21:26:25.040 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2024-02-19T21:26:25.040 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: 2024-02-19T21:26:25.040 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-19T21:26:25.040 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: 2024-02-19T21:26:25.040 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-19T21:26:25.040 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.merge_operator: 2024-02-19T21:26:25.040 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.compaction_filter: None 2024-02-19T21:26:25.041 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-19T21:26:25.041 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-19T21:26:25.041 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-19T21:26:25.041 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d824de1d10) 2024-02-19T21:26:25.041 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cache_index_and_filter_blocks: 1 2024-02-19T21:26:25.041 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-19T21:26:25.041 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-19T21:26:25.041 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: pin_top_level_index_and_filter: 1 2024-02-19T21:26:25.041 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: index_type: 0 2024-02-19T21:26:25.041 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: data_block_index_type: 0 2024-02-19T21:26:25.041 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: index_shortening: 1 2024-02-19T21:26:25.041 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: data_block_hash_table_util_ratio: 0.750000 2024-02-19T21:26:25.041 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: hash_index_allow_collision: 1 2024-02-19T21:26:25.041 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: checksum: 1 2024-02-19T21:26:25.041 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: no_block_cache: 0 2024-02-19T21:26:25.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: block_cache: 0x55d824e16f10 2024-02-19T21:26:25.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: block_cache_name: BinnedLRUCache 2024-02-19T21:26:25.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: block_cache_options: 2024-02-19T21:26:25.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: capacity : 536870912 2024-02-19T21:26:25.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: num_shard_bits : 4 2024-02-19T21:26:25.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: strict_capacity_limit : 0 2024-02-19T21:26:25.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: high_pri_pool_ratio: 0.000 2024-02-19T21:26:25.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: block_cache_compressed: (nil) 2024-02-19T21:26:25.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: persistent_cache: (nil) 2024-02-19T21:26:25.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: block_size: 4096 2024-02-19T21:26:25.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: block_size_deviation: 10 2024-02-19T21:26:25.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: block_restart_interval: 16 2024-02-19T21:26:25.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: index_block_restart_interval: 1 2024-02-19T21:26:25.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: metadata_block_size: 4096 2024-02-19T21:26:25.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: partition_filters: 0 2024-02-19T21:26:25.043 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: use_delta_encoding: 1 2024-02-19T21:26:25.043 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-19T21:26:25.043 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: whole_key_filtering: 1 2024-02-19T21:26:25.043 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: verify_compression: 0 2024-02-19T21:26:25.043 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: read_amp_bytes_per_bit: 0 2024-02-19T21:26:25.043 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: format_version: 2 2024-02-19T21:26:25.043 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: enable_index_compression: 1 2024-02-19T21:26:25.043 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: block_align: 0 2024-02-19T21:26:25.043 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: 2024-02-19T21:26:25.043 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-19T21:26:25.043 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-19T21:26:25.043 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.compression: NoCompression 2024-02-19T21:26:25.043 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-19T21:26:25.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-19T21:26:25.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-19T21:26:25.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.num_levels: 7 2024-02-19T21:26:25.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-19T21:26:25.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-19T21:26:25.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-19T21:26:25.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-19T21:26:25.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-19T21:26:25.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-19T21:26:25.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-19T21:26:25.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-19T21:26:25.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-19T21:26:25.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-19T21:26:25.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-19T21:26:25.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-19T21:26:25.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-19T21:26:25.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-19T21:26:25.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-19T21:26:25.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-19T21:26:25.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-19T21:26:25.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-19T21:26:25.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-19T21:26:25.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-19T21:26:25.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-19T21:26:25.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-19T21:26:25.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-19T21:26:25.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-19T21:26:25.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-19T21:26:25.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-19T21:26:25.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-19T21:26:25.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-19T21:26:25.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-19T21:26:25.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-19T21:26:25.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-19T21:26:25.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-19T21:26:25.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-19T21:26:25.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-19T21:26:25.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-19T21:26:25.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-19T21:26:25.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-19T21:26:25.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-19T21:26:25.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-19T21:26:25.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-19T21:26:25.047 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-19T21:26:25.047 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-19T21:26:25.047 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-19T21:26:25.047 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-19T21:26:25.047 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-19T21:26:25.047 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-19T21:26:25.047 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-19T21:26:25.047 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.table_properties_collectors: 2024-02-19T21:26:25.047 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.inplace_update_support: 0 2024-02-19T21:26:25.047 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-19T21:26:25.047 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-19T21:26:25.047 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-19T21:26:25.047 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-19T21:26:25.047 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.bloom_locality: 0 2024-02-19T21:26:25.047 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.max_successive_merges: 0 2024-02-19T21:26:25.048 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-19T21:26:25.048 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-19T21:26:25.048 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-19T21:26:25.048 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-19T21:26:25.048 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.ttl: 2592000 2024-02-19T21:26:25.048 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.740+0000 7f2499e40880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-19T21:26:25.048 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.741+0000 7f2499e40880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-19T21:26:25.048 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: 2024-02-19T21:26:25.048 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.741+0000 7f2499e40880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 4 2024-02-19T21:26:25.048 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: 2024-02-19T21:26:25.048 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.741+0000 7f2499e40880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708377984741560, "job": 1, "event": "recovery_started", "log_files": [6]} 2024-02-19T21:26:25.048 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.741+0000 7f2499e40880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #6 mode 2 2024-02-19T21:26:25.048 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.741+0000 7f2499e40880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-19T21:26:25.048 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.742+0000 7f2499e40880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708377984742626, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 88756, "table_properties": {"data_size": 87009, "index_size": 352, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 581, "raw_key_size": 11158, "raw_average_key_size": 48, "raw_value_size": 80826, "raw_average_value_size": 354, "num_data_blocks": 11, "num_entries": 228, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1708377984, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-19T21:26:25.049 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.742+0000 7f2499e40880 4 rocksdb: [version_set.cc:3826] Creating manifest 8 2024-02-19T21:26:25.049 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: 2024-02-19T21:26:25.049 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.743+0000 7f2499e40880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708377984743769, "job": 1, "event": "recovery_finished"} 2024-02-19T21:26:25.049 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.744+0000 7f2499e40880 4 rocksdb: DB pointer 0x55d824edf800 2024-02-19T21:26:25.049 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.744+0000 7f2480c32700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-19T21:26:25.049 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.744+0000 7f2480c32700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-19T21:26:25.049 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: ** DB Stats ** 2024-02-19T21:26:25.049 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T21:26:25.049 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-19T21:26:25.049 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-19T21:26:25.049 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-19T21:26:25.049 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-19T21:26:25.049 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-19T21:26:25.049 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-19T21:26:25.049 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: 2024-02-19T21:26:25.050 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: ** Compaction Stats [default] ** 2024-02-19T21:26:25.050 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-19T21:26:25.050 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T21:26:25.050 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: L0 2/0 88.33 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 104.6 0.00 0.00 1 0.001 0 0 2024-02-19T21:26:25.050 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: Sum 2/0 88.33 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 104.6 0.00 0.00 1 0.001 0 0 2024-02-19T21:26:25.050 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 104.6 0.00 0.00 1 0.001 0 0 2024-02-19T21:26:25.050 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: 2024-02-19T21:26:25.050 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: ** Compaction Stats [default] ** 2024-02-19T21:26:25.050 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-19T21:26:25.050 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T21:26:25.050 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 104.6 0.00 0.00 1 0.001 0 0 2024-02-19T21:26:25.050 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T21:26:25.050 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-19T21:26:25.050 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-19T21:26:25.050 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: AddFile(Total Files): cumulative 0, interval 0 2024-02-19T21:26:25.051 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-19T21:26:25.051 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: AddFile(Keys): cumulative 0, interval 0 2024-02-19T21:26:25.051 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: Cumulative compaction: 0.00 GB write, 22.85 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T21:26:25.051 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: Interval compaction: 0.00 GB write, 22.85 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T21:26:25.051 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-19T21:26:25.051 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: 2024-02-19T21:26:25.051 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: ** File Read Latency Histogram By Level [default] ** 2024-02-19T21:26:25.051 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: 2024-02-19T21:26:25.051 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: ** Compaction Stats [default] ** 2024-02-19T21:26:25.051 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-19T21:26:25.051 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T21:26:25.051 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: L0 2/0 88.33 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 104.6 0.00 0.00 1 0.001 0 0 2024-02-19T21:26:25.051 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: Sum 2/0 88.33 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 104.6 0.00 0.00 1 0.001 0 0 2024-02-19T21:26:25.051 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-19T21:26:25.052 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: 2024-02-19T21:26:25.052 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: ** Compaction Stats [default] ** 2024-02-19T21:26:25.052 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-19T21:26:25.052 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T21:26:25.052 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 104.6 0.00 0.00 1 0.001 0 0 2024-02-19T21:26:25.052 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T21:26:25.052 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-19T21:26:25.052 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-19T21:26:25.052 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: AddFile(Total Files): cumulative 0, interval 0 2024-02-19T21:26:25.052 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-19T21:26:25.052 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: AddFile(Keys): cumulative 0, interval 0 2024-02-19T21:26:25.052 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: Cumulative compaction: 0.00 GB write, 22.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T21:26:25.052 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T21:26:25.052 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-19T21:26:25.053 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: 2024-02-19T21:26:25.053 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: ** File Read Latency Histogram By Level [default] ** 2024-02-19T21:26:25.053 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: 2024-02-19T21:26:25.053 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.745+0000 7f2499e40880 0 starting mon.a rank 0 at public addrs [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] at bind addrs [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 6f763558-cf6d-11ee-95bb-87774f69a715 2024-02-19T21:26:25.053 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.745+0000 7f2499e40880 1 mon.a@-1(???) e1 preinit fsid 6f763558-cf6d-11ee-95bb-87774f69a715 2024-02-19T21:26:25.053 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.746+0000 7f2499e40880 0 mon.a@-1(???).mds e1 new map 2024-02-19T21:26:25.053 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.746+0000 7f2499e40880 0 mon.a@-1(???).mds e1 print_map 2024-02-19T21:26:25.053 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: e1 2024-02-19T21:26:25.053 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T21:26:25.053 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T21:26:25.053 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: legacy client fscid: -1 2024-02-19T21:26:25.053 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: 2024-02-19T21:26:25.053 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: No filesystems configured 2024-02-19T21:26:25.053 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: 2024-02-19T21:26:25.054 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.746+0000 7f2499e40880 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-19T21:26:25.054 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.746+0000 7f2499e40880 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-19T21:26:25.054 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.746+0000 7f2499e40880 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-19T21:26:25.054 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.746+0000 7f2499e40880 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-19T21:26:25.054 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:19.883708+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.80:0/1571332648' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:26:25.054 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:26:24.746+0000 7f2499e40880 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-02-19T21:26:25.054 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 bash[38205]: e33ed3dceab43872d296d42f2ea4dda70564603ba28296fa2b76a85a972c6d50 2024-02-19T21:26:25.054 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 systemd[1]: Started Ceph mon.a for 6f763558-cf6d-11ee-95bb-87774f69a715. 2024-02-19T21:26:25.054 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:26:24.761699+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-02-19T21:26:25.054 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:26:24.761760+0000 mon.a (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0]} removed_ranks: {} 2024-02-19T21:26:25.054 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:26:24.762114+0000 mon.a (mon.0) 3 : cluster [DBG] fsmap 2024-02-19T21:26:25.054 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:26:24.762141+0000 mon.a (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-02-19T21:26:25.054 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:26:24.762508+0000 mon.a (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2024-02-19T21:26:25.945 INFO:teuthology.orchestra.run.smithi080.stderr:Wrote config to /etc/ceph/ceph.conf 2024-02-19T21:26:25.945 INFO:teuthology.orchestra.run.smithi080.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-02-19T21:26:25.945 INFO:teuthology.orchestra.run.smithi080.stderr:Creating mgr... 2024-02-19T21:26:25.945 INFO:teuthology.orchestra.run.smithi080.stderr:Verifying port 9283 ... 2024-02-19T21:26:26.076 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: Failed to reset failed state of unit ceph-6f763558-cf6d-11ee-95bb-87774f69a715@mgr.y.service: Unit ceph-6f763558-cf6d-11ee-95bb-87774f69a715@mgr.y.service not loaded. 2024-02-19T21:26:26.083 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: Created symlink /etc/systemd/system/ceph-6f763558-cf6d-11ee-95bb-87774f69a715.target.wants/ceph-6f763558-cf6d-11ee-95bb-87774f69a715@mgr.y.service → /etc/systemd/system/ceph-6f763558-cf6d-11ee-95bb-87774f69a715@.service. 2024-02-19T21:26:26.349 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:26 smithi080 systemd[1]: Starting Ceph mgr.y for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T21:26:26.720 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:25.441225+0000 mon.a (mon.0) 6 : audit [INF] from='client.? 172.21.15.80:0/1062329521' entity='client.admin' 2024-02-19T21:26:26.732 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: disabled 2024-02-19T21:26:26.740 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: inactive 2024-02-19T21:26:26.740 INFO:teuthology.orchestra.run.smithi080.stderr:firewalld.service is not enabled 2024-02-19T21:26:26.740 INFO:teuthology.orchestra.run.smithi080.stderr:Not possible to enable service . firewalld.service is not available 2024-02-19T21:26:26.748 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: disabled 2024-02-19T21:26:26.755 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: inactive 2024-02-19T21:26:26.756 INFO:teuthology.orchestra.run.smithi080.stderr:firewalld.service is not enabled 2024-02-19T21:26:26.756 INFO:teuthology.orchestra.run.smithi080.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2024-02-19T21:26:26.756 INFO:teuthology.orchestra.run.smithi080.stderr:Waiting for mgr to start... 2024-02-19T21:26:26.756 INFO:teuthology.orchestra.run.smithi080.stderr:Waiting for mgr... 2024-02-19T21:26:26.993 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:26 smithi080 bash[38481]: cee23abc29a39a7acdb8e1967cf4ab69ef20315d5ba651c7137a407b6a4ce616 2024-02-19T21:26:26.993 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:26 smithi080 systemd[1]: Started Ceph mgr.y for 6f763558-cf6d-11ee-95bb-87774f69a715. 2024-02-19T21:26:26.993 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:26.768+0000 7f4b08ee8680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-19T21:26:26.993 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:26.852+0000 7f4b08ee8680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-19T21:26:27.349 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:27.228+0000 7f4b08ee8680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-19T21:26:27.404 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-19T21:26:27.407 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: { 2024-02-19T21:26:27.407 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "fsid": "6f763558-cf6d-11ee-95bb-87774f69a715", 2024-02-19T21:26:27.407 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "health": { 2024-02-19T21:26:27.407 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-02-19T21:26:27.407 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "checks": {}, 2024-02-19T21:26:27.408 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "mutes": [] 2024-02-19T21:26:27.408 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-19T21:26:27.408 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-02-19T21:26:27.408 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "quorum": [ 2024-02-19T21:26:27.408 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 0 2024-02-19T21:26:27.408 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: ], 2024-02-19T21:26:27.408 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "quorum_names": [ 2024-02-19T21:26:27.408 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "a" 2024-02-19T21:26:27.408 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: ], 2024-02-19T21:26:27.408 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "quorum_age": 2, 2024-02-19T21:26:27.408 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "monmap": { 2024-02-19T21:26:27.408 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-19T21:26:27.408 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-02-19T21:26:27.408 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_mons": 1 2024-02-19T21:26:27.409 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-19T21:26:27.409 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "osdmap": { 2024-02-19T21:26:27.409 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-19T21:26:27.409 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_osds": 0, 2024-02-19T21:26:27.409 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-02-19T21:26:27.413 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-02-19T21:26:27.413 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-02-19T21:26:27.413 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-02-19T21:26:27.413 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-02-19T21:26:27.413 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-19T21:26:27.413 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "pgmap": { 2024-02-19T21:26:27.413 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-02-19T21:26:27.413 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-02-19T21:26:27.413 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_pools": 0, 2024-02-19T21:26:27.413 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_objects": 0, 2024-02-19T21:26:27.413 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-02-19T21:26:27.414 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-02-19T21:26:27.414 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-02-19T21:26:27.414 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "bytes_total": 0 2024-02-19T21:26:27.414 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-19T21:26:27.414 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "fsmap": { 2024-02-19T21:26:27.414 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-19T21:26:27.414 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "by_rank": [], 2024-02-19T21:26:27.414 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "up:standby": 0 2024-02-19T21:26:27.414 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-19T21:26:27.414 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "mgrmap": { 2024-02-19T21:26:27.414 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "available": false, 2024-02-19T21:26:27.414 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-02-19T21:26:27.414 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "modules": [ 2024-02-19T21:26:27.414 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "iostat", 2024-02-19T21:26:27.414 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "nfs", 2024-02-19T21:26:27.414 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "restful" 2024-02-19T21:26:27.415 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: ], 2024-02-19T21:26:27.415 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "services": {} 2024-02-19T21:26:27.415 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-19T21:26:27.415 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "servicemap": { 2024-02-19T21:26:27.415 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-19T21:26:27.415 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "modified": "2024-02-19T21:26:16.880742+0000", 2024-02-19T21:26:27.415 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "services": {} 2024-02-19T21:26:27.415 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-19T21:26:27.415 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "progress_events": {} 2024-02-19T21:26:27.415 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: } 2024-02-19T21:26:27.801 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:27.401677+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.80:0/1463081652' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-19T21:26:28.080 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:27.993+0000 7f4b08ee8680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-19T21:26:28.130 INFO:teuthology.orchestra.run.smithi080.stderr:mgr not available, waiting (1/15)... 2024-02-19T21:26:28.349 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:28.076+0000 7f4b08ee8680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-19T21:26:28.349 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:28.286+0000 7f4b08ee8680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-19T21:26:29.506 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:29.213+0000 7f4b08ee8680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-19T21:26:29.507 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:29.338+0000 7f4b08ee8680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-19T21:26:29.507 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:29.414+0000 7f4b08ee8680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-19T21:26:29.849 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:29.503+0000 7f4b08ee8680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-19T21:26:29.849 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:29.694+0000 7f4b08ee8680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-19T21:26:30.329 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:29.970+0000 7f4b08ee8680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-19T21:26:30.329 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:30.066+0000 7f4b08ee8680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-19T21:26:30.737 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-19T21:26:30.737 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: { 2024-02-19T21:26:30.737 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "fsid": "6f763558-cf6d-11ee-95bb-87774f69a715", 2024-02-19T21:26:30.737 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "health": { 2024-02-19T21:26:30.737 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-02-19T21:26:30.737 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "checks": {}, 2024-02-19T21:26:30.737 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "mutes": [] 2024-02-19T21:26:30.737 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-19T21:26:30.737 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-02-19T21:26:30.737 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "quorum": [ 2024-02-19T21:26:30.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 0 2024-02-19T21:26:30.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: ], 2024-02-19T21:26:30.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "quorum_names": [ 2024-02-19T21:26:30.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "a" 2024-02-19T21:26:30.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: ], 2024-02-19T21:26:30.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "quorum_age": 5, 2024-02-19T21:26:30.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "monmap": { 2024-02-19T21:26:30.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-19T21:26:30.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-02-19T21:26:30.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_mons": 1 2024-02-19T21:26:30.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-19T21:26:30.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "osdmap": { 2024-02-19T21:26:30.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-19T21:26:30.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_osds": 0, 2024-02-19T21:26:30.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-02-19T21:26:30.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-02-19T21:26:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-02-19T21:26:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-02-19T21:26:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-02-19T21:26:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-19T21:26:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "pgmap": { 2024-02-19T21:26:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-02-19T21:26:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-02-19T21:26:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_pools": 0, 2024-02-19T21:26:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_objects": 0, 2024-02-19T21:26:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-02-19T21:26:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-02-19T21:26:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-02-19T21:26:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "bytes_total": 0 2024-02-19T21:26:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-19T21:26:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "fsmap": { 2024-02-19T21:26:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-19T21:26:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "by_rank": [], 2024-02-19T21:26:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "up:standby": 0 2024-02-19T21:26:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-19T21:26:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "mgrmap": { 2024-02-19T21:26:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "available": false, 2024-02-19T21:26:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-02-19T21:26:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "modules": [ 2024-02-19T21:26:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "iostat", 2024-02-19T21:26:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "nfs", 2024-02-19T21:26:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "restful" 2024-02-19T21:26:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: ], 2024-02-19T21:26:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "services": {} 2024-02-19T21:26:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-19T21:26:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "servicemap": { 2024-02-19T21:26:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-19T21:26:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "modified": "2024-02-19T21:26:16.880742+0000", 2024-02-19T21:26:30.741 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "services": {} 2024-02-19T21:26:30.741 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-19T21:26:30.741 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "progress_events": {} 2024-02-19T21:26:30.741 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: } 2024-02-19T21:26:31.092 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:30.729293+0000 mon.a (mon.0) 8 : audit [DBG] from='client.? 172.21.15.80:0/984907286' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-19T21:26:31.093 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:30.813+0000 7f4b08ee8680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-19T21:26:31.093 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:30.894+0000 7f4b08ee8680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-19T21:26:31.093 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:30.983+0000 7f4b08ee8680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-19T21:26:31.349 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:31.159+0000 7f4b08ee8680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-19T21:26:31.370 INFO:teuthology.orchestra.run.smithi080.stderr:mgr not available, waiting (2/15)... 2024-02-19T21:26:31.681 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:31.418+0000 7f4b08ee8680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-19T21:26:31.681 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:31.546+0000 7f4b08ee8680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-19T21:26:31.995 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:31.677+0000 7f4b08ee8680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-19T21:26:31.995 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:31.846+0000 7f4b08ee8680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-19T21:26:31.995 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:31.927+0000 7f4b08ee8680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-19T21:26:32.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:26:31.942035+0000 mon.a (mon.0) 9 : cluster [INF] Activating manager daemon y 2024-02-19T21:26:32.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:26:31.944599+0000 mon.a (mon.0) 10 : cluster [DBG] mgrmap e2: y(active, starting, since 0.00266071s) 2024-02-19T21:26:32.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:31.945172+0000 mon.a (mon.0) 11 : audit [DBG] from='mgr.14100 172.21.15.80:0/197579996' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T21:26:32.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:31.945334+0000 mon.a (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.80:0/197579996' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T21:26:32.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:31.945521+0000 mon.a (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.80:0/197579996' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T21:26:32.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:31.945703+0000 mon.a (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.80:0/197579996' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-19T21:26:32.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:31.946232+0000 mon.a (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.80:0/197579996' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-19T21:26:32.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:26:31.959876+0000 mon.a (mon.0) 16 : cluster [INF] Manager daemon y is now available 2024-02-19T21:26:32.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:31.968317+0000 mon.a (mon.0) 17 : audit [INF] from='mgr.14100 172.21.15.80:0/197579996' entity='mgr.y' 2024-02-19T21:26:32.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:31.973538+0000 mon.a (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.80:0/197579996' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-19T21:26:32.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:31.976192+0000 mon.a (mon.0) 19 : audit [INF] from='mgr.14100 172.21.15.80:0/197579996' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-19T21:26:32.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:31.978980+0000 mon.a (mon.0) 20 : audit [INF] from='mgr.14100 172.21.15.80:0/197579996' entity='mgr.y' 2024-02-19T21:26:32.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:31.980763+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.14100 172.21.15.80:0/197579996' entity='mgr.y' 2024-02-19T21:26:34.141 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-19T21:26:34.141 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: { 2024-02-19T21:26:34.141 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "fsid": "6f763558-cf6d-11ee-95bb-87774f69a715", 2024-02-19T21:26:34.141 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "health": { 2024-02-19T21:26:34.141 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-02-19T21:26:34.141 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "checks": {}, 2024-02-19T21:26:34.141 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "mutes": [] 2024-02-19T21:26:34.142 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-19T21:26:34.142 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-02-19T21:26:34.142 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "quorum": [ 2024-02-19T21:26:34.142 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 0 2024-02-19T21:26:34.142 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: ], 2024-02-19T21:26:34.142 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "quorum_names": [ 2024-02-19T21:26:34.142 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "a" 2024-02-19T21:26:34.142 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: ], 2024-02-19T21:26:34.142 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "quorum_age": 9, 2024-02-19T21:26:34.142 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "monmap": { 2024-02-19T21:26:34.142 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-19T21:26:34.142 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-02-19T21:26:34.142 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_mons": 1 2024-02-19T21:26:34.142 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-19T21:26:34.142 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "osdmap": { 2024-02-19T21:26:34.142 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-19T21:26:34.143 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_osds": 0, 2024-02-19T21:26:34.143 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-02-19T21:26:34.143 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-02-19T21:26:34.143 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-02-19T21:26:34.143 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-02-19T21:26:34.143 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-02-19T21:26:34.143 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-19T21:26:34.143 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "pgmap": { 2024-02-19T21:26:34.143 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-02-19T21:26:34.143 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-02-19T21:26:34.143 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_pools": 0, 2024-02-19T21:26:34.143 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_objects": 0, 2024-02-19T21:26:34.143 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-02-19T21:26:34.143 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-02-19T21:26:34.143 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-02-19T21:26:34.144 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "bytes_total": 0 2024-02-19T21:26:34.144 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-19T21:26:34.144 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "fsmap": { 2024-02-19T21:26:34.144 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-19T21:26:34.144 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "by_rank": [], 2024-02-19T21:26:34.144 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "up:standby": 0 2024-02-19T21:26:34.144 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-19T21:26:34.144 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "mgrmap": { 2024-02-19T21:26:34.144 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "available": true, 2024-02-19T21:26:34.144 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-02-19T21:26:34.144 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "modules": [ 2024-02-19T21:26:34.144 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "iostat", 2024-02-19T21:26:34.144 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "nfs", 2024-02-19T21:26:34.144 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "restful" 2024-02-19T21:26:34.144 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: ], 2024-02-19T21:26:34.145 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "services": {} 2024-02-19T21:26:34.145 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-19T21:26:34.145 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "servicemap": { 2024-02-19T21:26:34.145 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-19T21:26:34.145 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "modified": "2024-02-19T21:26:16.880742+0000", 2024-02-19T21:26:34.145 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "services": {} 2024-02-19T21:26:34.145 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-19T21:26:34.145 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "progress_events": {} 2024-02-19T21:26:34.145 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: } 2024-02-19T21:26:34.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:26:32.947765+0000 mon.a (mon.0) 22 : cluster [DBG] mgrmap e3: y(active, since 1.00582s) 2024-02-19T21:26:35.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:34.133218+0000 mon.a (mon.0) 23 : audit [DBG] from='client.? 172.21.15.80:0/2062485999' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-19T21:26:36.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:26:34.948049+0000 mon.a (mon.0) 24 : cluster [DBG] mgrmap e4: y(active, since 3s) 2024-02-19T21:26:38.593 INFO:teuthology.orchestra.run.smithi080.stderr:mgr is available 2024-02-19T21:26:42.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:42.317321+0000 mon.a (mon.0) 25 : audit [INF] from='client.? 172.21.15.80:0/3358744920' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-19T21:26:42.938 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-19T21:26:42.938 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: [global] 2024-02-19T21:26:42.938 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: fsid = 6f763558-cf6d-11ee-95bb-87774f69a715 2024-02-19T21:26:42.938 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: log_to_journald = false 2024-02-19T21:26:42.939 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-02-19T21:26:42.939 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-02-19T21:26:42.939 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-02-19T21:26:42.939 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-02-19T21:26:42.939 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-19T21:26:42.939 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: [mgr] 2024-02-19T21:26:42.939 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-02-19T21:26:42.939 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-19T21:26:42.939 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: [osd] 2024-02-19T21:26:42.939 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-02-19T21:26:42.939 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-02-19T21:26:45.209 INFO:teuthology.orchestra.run.smithi080.stderr:Enabling cephadm module... 2024-02-19T21:26:46.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:45.918760+0000 mon.a (mon.0) 26 : audit [INF] from='client.? 172.21.15.80:0/2217670243' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-02-19T21:26:46.350 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ignoring --setuser ceph since I am not root 2024-02-19T21:26:46.350 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ignoring --setgroup ceph since I am not root 2024-02-19T21:26:46.350 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:46.126+0000 7fa0bc4fa680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-19T21:26:46.350 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:46.206+0000 7fa0bc4fa680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-19T21:26:46.710 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:46.568+0000 7fa0bc4fa680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-19T21:26:47.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:45.971869+0000 mon.a (mon.0) 27 : audit [INF] from='client.? 172.21.15.80:0/2217670243' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-02-19T21:26:47.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:26:45.971915+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e5: y(active, since 14s) 2024-02-19T21:26:47.561 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: { 2024-02-19T21:26:47.562 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "epoch": 5, 2024-02-19T21:26:47.562 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "available": true, 2024-02-19T21:26:47.562 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "active_name": "y", 2024-02-19T21:26:47.562 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_standby": 0 2024-02-19T21:26:47.562 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: } 2024-02-19T21:26:47.586 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:47.320+0000 7fa0bc4fa680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-19T21:26:47.587 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:47.408+0000 7fa0bc4fa680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-19T21:26:47.849 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:47.625+0000 7fa0bc4fa680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-19T21:26:48.290 INFO:teuthology.orchestra.run.smithi080.stderr:Waiting for the mgr to restart... 2024-02-19T21:26:48.290 INFO:teuthology.orchestra.run.smithi080.stderr:Waiting for mgr epoch 5... 2024-02-19T21:26:48.293 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:47.558422+0000 mon.a (mon.0) 29 : audit [DBG] from='client.? 172.21.15.80:0/1184946387' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-19T21:26:48.849 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:48.572+0000 7fa0bc4fa680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-19T21:26:48.849 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:48.701+0000 7fa0bc4fa680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-19T21:26:48.849 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:48.784+0000 7fa0bc4fa680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-19T21:26:49.344 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:48.875+0000 7fa0bc4fa680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-19T21:26:49.345 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:49.067+0000 7fa0bc4fa680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-19T21:26:49.345 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:49.341+0000 7fa0bc4fa680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-19T21:26:49.599 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:49.436+0000 7fa0bc4fa680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-19T21:26:50.488 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:50.145+0000 7fa0bc4fa680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-19T21:26:50.488 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:50.225+0000 7fa0bc4fa680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-19T21:26:50.488 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:50.315+0000 7fa0bc4fa680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-19T21:26:50.489 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:50.484+0000 7fa0bc4fa680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-19T21:26:51.002 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:50.738+0000 7fa0bc4fa680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-19T21:26:51.002 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:50.868+0000 7fa0bc4fa680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-19T21:26:51.315 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:50.998+0000 7fa0bc4fa680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-19T21:26:51.315 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:51.166+0000 7fa0bc4fa680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-19T21:26:51.316 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:26:51.248+0000 7fa0bc4fa680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-19T21:26:51.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:26:51.262059+0000 mon.a (mon.0) 30 : cluster [INF] Active manager daemon y restarted 2024-02-19T21:26:51.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:26:51.262278+0000 mon.a (mon.0) 31 : cluster [INF] Activating manager daemon y 2024-02-19T21:26:51.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:26:51.265195+0000 mon.a (mon.0) 32 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-02-19T21:26:51.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:26:51.265301+0000 mon.a (mon.0) 33 : cluster [DBG] mgrmap e6: y(active, starting, since 0.00310354s) 2024-02-19T21:26:51.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:51.266319+0000 mon.a (mon.0) 34 : audit [DBG] from='mgr.14116 172.21.15.80:0/562652008' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-19T21:26:51.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:51.266848+0000 mon.a (mon.0) 35 : audit [DBG] from='mgr.14116 172.21.15.80:0/562652008' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-19T21:26:51.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:51.267466+0000 mon.a (mon.0) 36 : audit [DBG] from='mgr.14116 172.21.15.80:0/562652008' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T21:26:51.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:51.267594+0000 mon.a (mon.0) 37 : audit [DBG] from='mgr.14116 172.21.15.80:0/562652008' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T21:26:51.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:51.267712+0000 mon.a (mon.0) 38 : audit [DBG] from='mgr.14116 172.21.15.80:0/562652008' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T21:26:51.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:26:51.281715+0000 mon.a (mon.0) 39 : cluster [INF] Manager daemon y is now available 2024-02-19T21:26:51.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:51.293343+0000 mon.a (mon.0) 40 : audit [INF] from='mgr.14116 172.21.15.80:0/562652008' entity='mgr.y' 2024-02-19T21:26:52.276 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: { 2024-02-19T21:26:52.276 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2024-02-19T21:26:52.277 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "initialized": true 2024-02-19T21:26:52.277 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: } 2024-02-19T21:26:52.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:26:51.290816+0000 mgr.y (mgr.14116) 1 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-02-19T21:26:52.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:51.378214+0000 mon.a (mon.0) 41 : audit [INF] from='mgr.14116 172.21.15.80:0/562652008' entity='mgr.y' 2024-02-19T21:26:52.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:51.379174+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14116 172.21.15.80:0/562652008' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:26:52.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:51.380785+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.14116 172.21.15.80:0/562652008' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:26:52.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:51.382245+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14116 172.21.15.80:0/562652008' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:26:52.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:51.395782+0000 mon.a (mon.0) 45 : audit [INF] from='mgr.14116 172.21.15.80:0/562652008' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-19T21:26:52.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:51.397914+0000 mon.a (mon.0) 46 : audit [INF] from='mgr.14116 172.21.15.80:0/562652008' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-19T21:26:52.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:26:52.267617+0000 mon.a (mon.0) 47 : cluster [DBG] mgrmap e7: y(active, since 1.00542s) 2024-02-19T21:26:52.998 INFO:teuthology.orchestra.run.smithi080.stderr:mgr epoch 5 is available 2024-02-19T21:26:52.998 INFO:teuthology.orchestra.run.smithi080.stderr:Setting orchestrator backend to cephadm... 2024-02-19T21:26:53.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:52.266724+0000 mgr.y (mgr.14116) 2 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-19T21:26:53.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:52.273358+0000 mgr.y (mgr.14116) 3 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-19T21:26:54.637 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:26:53.380613+0000 mon.a (mon.0) 48 : cluster [DBG] mgrmap e8: y(active, since 2s) 2024-02-19T21:26:54.637 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:53.775030+0000 mgr.y (mgr.14116) 4 : audit [DBG] from='client.14126 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:26:54.637 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:53.779673+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.14116 172.21.15.80:0/562652008' entity='mgr.y' 2024-02-19T21:26:54.638 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:53.806833+0000 mon.a (mon.0) 50 : audit [DBG] from='mgr.14116 172.21.15.80:0/562652008' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:26:55.145 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: value unchanged 2024-02-19T21:26:55.778 INFO:teuthology.orchestra.run.smithi080.stderr:Generating ssh key... 2024-02-19T21:26:56.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:55.142887+0000 mgr.y (mgr.14116) 5 : audit [DBG] from='client.14128 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:26:57.074 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: Generating public/private rsa key pair. 2024-02-19T21:26:57.074 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: Your identification has been saved in /tmp/tmpbjx90gu2/key. 2024-02-19T21:26:57.074 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: Your public key has been saved in /tmp/tmpbjx90gu2/key.pub. 2024-02-19T21:26:57.074 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: The key fingerprint is: 2024-02-19T21:26:57.074 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: SHA256:rAwM2F87hGFc9/XtKHopsUoovsJMUmfugZOhjcCSkHg ceph-6f763558-cf6d-11ee-95bb-87774f69a715 2024-02-19T21:26:57.074 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: The key's randomart image is: 2024-02-19T21:26:57.074 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: +---[RSA 3072]----+ 2024-02-19T21:26:57.074 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: |.. .o.. . . | 2024-02-19T21:26:57.075 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: |+oE..o . . . . . | 2024-02-19T21:26:57.075 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: |+oo . o . . .| 2024-02-19T21:26:57.075 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: |+.o+oo o o | 2024-02-19T21:26:57.075 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: |o= B+ o S . . . .| 2024-02-19T21:26:57.075 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: |+ * oo + + o | 2024-02-19T21:26:57.075 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: | = o..+ . + o | 2024-02-19T21:26:57.075 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: | +... . . o | 2024-02-19T21:26:57.075 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: | .o. . | 2024-02-19T21:26:57.075 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: +----[SHA256]-----+ 2024-02-19T21:26:58.040 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC08pXPsRK0mYadadRd7SUW5BDaNyLJ3QsxVldMda7gvqQtcQTweu2D0N9Vv1W0ZCE30rEk6BsU0jwXiR0lfTA3/HzUi5Eb2KxS4gbX03bGYOPZBlU3iFBaoJpVzhlGyVW2L2knaCB+5tZ0hgv03LN2yEDTv+/pZUVKODYldRkNFFEJXUIKP0A9TTqVNxiLGFzysBzHO9p5cK7LxIcDuiZz8B8KlrPARTHSwFaTa/9ykFCfUk2bKwYvqfEys0pAeQTaFAfqk/2ULN5DLy4/IHLuwVKaMAEUPd+w2RPEM0C7n/ZmoDpQeDd+rjJNEB7sJQ4gPkBHdy+Vc2xV/8Ahd9ks0+4oRgNE4pWV8te4B+q5oaTuzJJrODUrl26CX0soUtKYsT1Ie9sjeYe1ipSyjrbuArbOoqBg8eY/QC18oVNCG/lpNUkrPju4wpLODGphO9UPu3imXGOmBp1J2sUuw2SLkph9Pjybdv7tWTq5+GLWVZt3KLCLtz+ah/KahccgOmU= ceph-6f763558-cf6d-11ee-95bb-87774f69a715 2024-02-19T21:26:58.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:56.518738+0000 mgr.y (mgr.14116) 6 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:26:58.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:26:56.518925+0000 mgr.y (mgr.14116) 7 : cephadm [INF] Generating ssh key... 2024-02-19T21:26:58.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:56.706968+0000 mon.a (mon.0) 51 : audit [INF] from='mgr.14116 172.21.15.80:0/562652008' entity='mgr.y' 2024-02-19T21:26:58.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:56.708688+0000 mon.a (mon.0) 52 : audit [INF] from='mgr.14116 172.21.15.80:0/562652008' entity='mgr.y' 2024-02-19T21:26:58.706 INFO:teuthology.orchestra.run.smithi080.stderr:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-02-19T21:26:58.706 INFO:teuthology.orchestra.run.smithi080.stderr:Adding key to root@localhost authorized_keys... 2024-02-19T21:26:58.706 INFO:teuthology.orchestra.run.smithi080.stderr:Adding host smithi080... 2024-02-19T21:26:59.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:26:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:58.037336+0000 mgr.y (mgr.14116) 8 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:26:59.849 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:26:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [79B blob data] 2024-02-19T21:26:59.999 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: Added host 'smithi080' with addr '172.21.15.80' 2024-02-19T21:27:00.735 INFO:teuthology.orchestra.run.smithi080.stderr:Deploying unmanaged mon service... 2024-02-19T21:27:01.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:59.376241+0000 mgr.y (mgr.14116) 9 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi080", "addr": "172.21.15.80", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:27:01.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:26:59.994586+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14116 172.21.15.80:0/562652008' entity='mgr.y' 2024-02-19T21:27:01.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:26:59.994855+0000 mgr.y (mgr.14116) 10 : cephadm [INF] Added host smithi080 2024-02-19T21:27:01.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:00.035587+0000 mon.a (mon.0) 54 : audit [DBG] from='mgr.14116 172.21.15.80:0/562652008' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:27:01.827 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: Scheduled mon update... 2024-02-19T21:27:02.859 INFO:teuthology.orchestra.run.smithi080.stderr:Deploying unmanaged mgr service... 2024-02-19T21:27:03.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:01.820626+0000 mgr.y (mgr.14116) 11 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:27:03.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:27:01.821791+0000 mgr.y (mgr.14116) 12 : cephadm [INF] Saving service mon spec with placement count:5 2024-02-19T21:27:03.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:01.824065+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14116 172.21.15.80:0/562652008' entity='mgr.y' 2024-02-19T21:27:04.046 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: Scheduled mgr update... 2024-02-19T21:27:04.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:03.211781+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.14116 172.21.15.80:0/562652008' entity='mgr.y' 2024-02-19T21:27:04.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:03.536076+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.14116 172.21.15.80:0/562652008' entity='mgr.y' 2024-02-19T21:27:04.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:04.043046+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14116 172.21.15.80:0/562652008' entity='mgr.y' 2024-02-19T21:27:05.433 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:04.039791+0000 mgr.y (mgr.14116) 13 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:27:05.433 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:27:04.040691+0000 mgr.y (mgr.14116) 14 : cephadm [INF] Saving service mgr spec with placement count:2 2024-02-19T21:27:06.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:05.738771+0000 mon.a (mon.0) 59 : audit [INF] from='mgr.14116 172.21.15.80:0/562652008' entity='mgr.y' 2024-02-19T21:27:06.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:06.210047+0000 mon.a (mon.0) 60 : audit [INF] from='client.? 172.21.15.80:0/3089535716' entity='client.admin' 2024-02-19T21:27:09.287 INFO:teuthology.orchestra.run.smithi080.stderr:Enabling the dashboard module... 2024-02-19T21:27:09.543 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:08.490081+0000 mon.a (mon.0) 61 : audit [INF] from='client.? 172.21.15.80:0/3246770697' entity='client.admin' 2024-02-19T21:27:10.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:10.122529+0000 mon.a (mon.0) 62 : audit [INF] from='client.? 172.21.15.80:0/1104757834' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-02-19T21:27:10.850 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:27:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ignoring --setuser ceph since I am not root 2024-02-19T21:27:10.850 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:27:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ignoring --setgroup ceph since I am not root 2024-02-19T21:27:10.850 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:27:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:27:10.654+0000 7fab96859680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-19T21:27:10.850 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:27:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:27:10.734+0000 7fab96859680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-19T21:27:11.272 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:27:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:27:11.098+0000 7fab96859680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-19T21:27:11.543 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:10.494250+0000 mon.a (mon.0) 63 : audit [INF] from='client.? 172.21.15.80:0/1104757834' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-02-19T21:27:11.544 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:27:10.494312+0000 mon.a (mon.0) 64 : cluster [DBG] mgrmap e9: y(active, since 19s) 2024-02-19T21:27:12.115 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: { 2024-02-19T21:27:12.115 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "epoch": 9, 2024-02-19T21:27:12.116 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "available": true, 2024-02-19T21:27:12.116 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "active_name": "y", 2024-02-19T21:27:12.116 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_standby": 0 2024-02-19T21:27:12.116 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: } 2024-02-19T21:27:12.137 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:27:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:27:11.856+0000 7fab96859680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-19T21:27:12.137 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:27:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:27:11.946+0000 7fab96859680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-19T21:27:12.495 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:27:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:27:12.162+0000 7fab96859680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-19T21:27:12.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:12.111631+0000 mon.a (mon.0) 65 : audit [DBG] from='client.? 172.21.15.80:0/778454919' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-19T21:27:12.886 INFO:teuthology.orchestra.run.smithi080.stderr:Waiting for the mgr to restart... 2024-02-19T21:27:12.886 INFO:teuthology.orchestra.run.smithi080.stderr:Waiting for mgr epoch 9... 2024-02-19T21:27:13.157 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:27:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:27:13.105+0000 7fab96859680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-19T21:27:13.429 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:27:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:27:13.244+0000 7fab96859680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-19T21:27:13.429 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:27:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:27:13.333+0000 7fab96859680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-19T21:27:13.849 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:27:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:27:13.425+0000 7fab96859680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-19T21:27:13.849 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:27:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:27:13.620+0000 7fab96859680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-19T21:27:14.349 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:27:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:27:13.897+0000 7fab96859680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-19T21:27:14.349 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:27:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:27:13.993+0000 7fab96859680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-19T21:27:15.073 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:27:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:27:14.722+0000 7fab96859680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-19T21:27:15.073 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:27:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:27:14.802+0000 7fab96859680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-19T21:27:15.073 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:27:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:27:14.895+0000 7fab96859680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-19T21:27:15.073 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:27:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:27:15.069+0000 7fab96859680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-19T21:27:15.616 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:27:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:27:15.346+0000 7fab96859680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-19T21:27:15.616 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:27:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:27:15.476+0000 7fab96859680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-19T21:27:15.616 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:27:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:27:15.611+0000 7fab96859680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-19T21:27:15.870 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:27:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:27:15.783+0000 7fab96859680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-19T21:27:16.349 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:27:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:27:15.866+0000 7fab96859680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-19T21:27:16.349 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:27:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [79B blob data] 2024-02-19T21:27:16.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:27:15.880860+0000 mon.a (mon.0) 66 : cluster [INF] Active manager daemon y restarted 2024-02-19T21:27:16.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:27:15.881083+0000 mon.a (mon.0) 67 : cluster [INF] Activating manager daemon y 2024-02-19T21:27:16.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:27:15.886834+0000 mon.a (mon.0) 68 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-02-19T21:27:16.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:27:15.886930+0000 mon.a (mon.0) 69 : cluster [DBG] mgrmap e10: y(active, starting, since 0.00594313s) 2024-02-19T21:27:16.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:15.887863+0000 mon.a (mon.0) 70 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-19T21:27:16.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:15.888503+0000 mon.a (mon.0) 71 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-19T21:27:16.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:15.889179+0000 mon.a (mon.0) 72 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T21:27:16.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:15.889316+0000 mon.a (mon.0) 73 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T21:27:16.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:15.889443+0000 mon.a (mon.0) 74 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T21:27:16.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:27:15.891486+0000 mon.a (mon.0) 75 : cluster [INF] Manager daemon y is now available 2024-02-19T21:27:16.894 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: { 2024-02-19T21:27:16.894 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "mgrmap_epoch": 11, 2024-02-19T21:27:16.894 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "initialized": true 2024-02-19T21:27:16.894 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: } 2024-02-19T21:27:17.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:15.984725+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:27:17.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:15.985992+0000 mon.a (mon.0) 77 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:27:17.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:16.010342+0000 mon.a (mon.0) 78 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-19T21:27:17.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:16.014204+0000 mon.a (mon.0) 79 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-19T21:27:17.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:27:16.885705+0000 mon.a (mon.0) 80 : cluster [DBG] mgrmap e11: y(active, since 1.00472s) 2024-02-19T21:27:18.018 INFO:teuthology.orchestra.run.smithi080.stderr:mgr epoch 9 is available 2024-02-19T21:27:18.018 INFO:teuthology.orchestra.run.smithi080.stderr:Generating a dashboard self-signed certificate... 2024-02-19T21:27:18.786 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: Self-signed certificate created 2024-02-19T21:27:18.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:16.884868+0000 mgr.y (mgr.14146) 1 : audit [DBG] from='client.14150 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-19T21:27:18.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:16.891079+0000 mgr.y (mgr.14146) 2 : audit [DBG] from='client.14150 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-19T21:27:18.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:17.350360+0000 mon.a (mon.0) 81 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:27:19.590 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:27:18.351687+0000 mon.a (mon.0) 82 : cluster [DBG] mgrmap e12: y(active, since 2s) 2024-02-19T21:27:19.590 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:18.781593+0000 mon.a (mon.0) 83 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:27:19.590 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:18.783492+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:27:20.513 INFO:teuthology.orchestra.run.smithi080.stderr:Creating initial admin user... 2024-02-19T21:27:20.838 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:18.736282+0000 mgr.y (mgr.14146) 3 : audit [DBG] from='client.14156 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:27:21.623 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$ZCMD7cvGNaS5Bax7bK0OLuu.kQ3E4Dm2Ca1bZnanORfGNKWZPYnde", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1708378041, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-02-19T21:27:21.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:21.401856+0000 mgr.y (mgr.14146) 4 : audit [DBG] from='client.14158 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:27:22.338 INFO:teuthology.orchestra.run.smithi080.stderr:Fetching dashboard port number... 2024-02-19T21:27:23.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:21.620075+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:27:23.112 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 8443 2024-02-19T21:27:23.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:27:22.622169+0000 mon.a (mon.0) 86 : cluster [DBG] mgrmap e13: y(active, since 6s) 2024-02-19T21:27:23.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:23.109080+0000 mon.a (mon.0) 87 : audit [DBG] from='client.? 172.21.15.80:0/2540975694' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-02-19T21:27:23.889 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: disabled 2024-02-19T21:27:23.897 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: inactive 2024-02-19T21:27:23.897 INFO:teuthology.orchestra.run.smithi080.stderr:firewalld.service is not enabled 2024-02-19T21:27:23.897 INFO:teuthology.orchestra.run.smithi080.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2024-02-19T21:27:23.900 INFO:teuthology.orchestra.run.smithi080.stderr:Ceph Dashboard is now available at: 2024-02-19T21:27:23.901 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-02-19T21:27:23.901 INFO:teuthology.orchestra.run.smithi080.stderr: URL: https://smithi080.front.sepia.ceph.com:8443/ 2024-02-19T21:27:23.901 INFO:teuthology.orchestra.run.smithi080.stderr: User: admin 2024-02-19T21:27:23.901 INFO:teuthology.orchestra.run.smithi080.stderr: Password: g42tpuiy29 2024-02-19T21:27:23.901 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-02-19T21:27:23.901 INFO:teuthology.orchestra.run.smithi080.stderr:Enabling autotune for osd_memory_target 2024-02-19T21:27:26.544 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: set mgr/dashboard/cluster/status 2024-02-19T21:27:27.317 INFO:teuthology.orchestra.run.smithi080.stderr:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-02-19T21:27:27.317 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-02-19T21:27:27.317 INFO:teuthology.orchestra.run.smithi080.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-02-19T21:27:27.317 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-02-19T21:27:27.317 INFO:teuthology.orchestra.run.smithi080.stderr:Or, if you are only running a single cluster on this host: 2024-02-19T21:27:27.317 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-02-19T21:27:27.317 INFO:teuthology.orchestra.run.smithi080.stderr: sudo /home/ubuntu/cephtest/cephadm shell 2024-02-19T21:27:27.317 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-02-19T21:27:27.317 INFO:teuthology.orchestra.run.smithi080.stderr:Please consider enabling telemetry to help improve Ceph: 2024-02-19T21:27:27.317 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-02-19T21:27:27.317 INFO:teuthology.orchestra.run.smithi080.stderr: ceph telemetry on 2024-02-19T21:27:27.317 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-02-19T21:27:27.317 INFO:teuthology.orchestra.run.smithi080.stderr:For more information see: 2024-02-19T21:27:27.318 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-02-19T21:27:27.318 INFO:teuthology.orchestra.run.smithi080.stderr: https://docs.ceph.com/en/pacific/mgr/telemetry/ 2024-02-19T21:27:27.318 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-02-19T21:27:27.318 INFO:teuthology.orchestra.run.smithi080.stderr:Bootstrap complete. 2024-02-19T21:27:27.357 INFO:tasks.cephadm:Fetching config... 2024-02-19T21:27:27.357 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-19T21:27:27.357 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-02-19T21:27:27.377 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-02-19T21:27:27.377 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-19T21:27:27.377 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-02-19T21:27:27.436 INFO:tasks.cephadm:Fetching mon keyring... 2024-02-19T21:27:27.436 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-19T21:27:27.437 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/keyring of=/dev/stdout 2024-02-19T21:27:27.504 INFO:tasks.cephadm:Fetching pub ssh key... 2024-02-19T21:27:27.504 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-19T21:27:27.504 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-02-19T21:27:27.562 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-02-19T21:27:27.563 DEBUG:teuthology.orchestra.run.smithi080:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC08pXPsRK0mYadadRd7SUW5BDaNyLJ3QsxVldMda7gvqQtcQTweu2D0N9Vv1W0ZCE30rEk6BsU0jwXiR0lfTA3/HzUi5Eb2KxS4gbX03bGYOPZBlU3iFBaoJpVzhlGyVW2L2knaCB+5tZ0hgv03LN2yEDTv+/pZUVKODYldRkNFFEJXUIKP0A9TTqVNxiLGFzysBzHO9p5cK7LxIcDuiZz8B8KlrPARTHSwFaTa/9ykFCfUk2bKwYvqfEys0pAeQTaFAfqk/2ULN5DLy4/IHLuwVKaMAEUPd+w2RPEM0C7n/ZmoDpQeDd+rjJNEB7sJQ4gPkBHdy+Vc2xV/8Ahd9ks0+4oRgNE4pWV8te4B+q5oaTuzJJrODUrl26CX0soUtKYsT1Ie9sjeYe1ipSyjrbuArbOoqBg8eY/QC18oVNCG/lpNUkrPju4wpLODGphO9UPu3imXGOmBp1J2sUuw2SLkph9Pjybdv7tWTq5+GLWVZt3KLCLtz+ah/KahccgOmU= ceph-6f763558-cf6d-11ee-95bb-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-19T21:27:27.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:26.539154+0000 mon.a (mon.0) 88 : audit [INF] from='client.? 172.21.15.80:0/1633304247' entity='client.admin' 2024-02-19T21:27:27.634 INFO:teuthology.orchestra.run.smithi080.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC08pXPsRK0mYadadRd7SUW5BDaNyLJ3QsxVldMda7gvqQtcQTweu2D0N9Vv1W0ZCE30rEk6BsU0jwXiR0lfTA3/HzUi5Eb2KxS4gbX03bGYOPZBlU3iFBaoJpVzhlGyVW2L2knaCB+5tZ0hgv03LN2yEDTv+/pZUVKODYldRkNFFEJXUIKP0A9TTqVNxiLGFzysBzHO9p5cK7LxIcDuiZz8B8KlrPARTHSwFaTa/9ykFCfUk2bKwYvqfEys0pAeQTaFAfqk/2ULN5DLy4/IHLuwVKaMAEUPd+w2RPEM0C7n/ZmoDpQeDd+rjJNEB7sJQ4gPkBHdy+Vc2xV/8Ahd9ks0+4oRgNE4pWV8te4B+q5oaTuzJJrODUrl26CX0soUtKYsT1Ie9sjeYe1ipSyjrbuArbOoqBg8eY/QC18oVNCG/lpNUkrPju4wpLODGphO9UPu3imXGOmBp1J2sUuw2SLkph9Pjybdv7tWTq5+GLWVZt3KLCLtz+ah/KahccgOmU= ceph-6f763558-cf6d-11ee-95bb-87774f69a715 2024-02-19T21:27:27.644 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC08pXPsRK0mYadadRd7SUW5BDaNyLJ3QsxVldMda7gvqQtcQTweu2D0N9Vv1W0ZCE30rEk6BsU0jwXiR0lfTA3/HzUi5Eb2KxS4gbX03bGYOPZBlU3iFBaoJpVzhlGyVW2L2knaCB+5tZ0hgv03LN2yEDTv+/pZUVKODYldRkNFFEJXUIKP0A9TTqVNxiLGFzysBzHO9p5cK7LxIcDuiZz8B8KlrPARTHSwFaTa/9ykFCfUk2bKwYvqfEys0pAeQTaFAfqk/2ULN5DLy4/IHLuwVKaMAEUPd+w2RPEM0C7n/ZmoDpQeDd+rjJNEB7sJQ4gPkBHdy+Vc2xV/8Ahd9ks0+4oRgNE4pWV8te4B+q5oaTuzJJrODUrl26CX0soUtKYsT1Ie9sjeYe1ipSyjrbuArbOoqBg8eY/QC18oVNCG/lpNUkrPju4wpLODGphO9UPu3imXGOmBp1J2sUuw2SLkph9Pjybdv7tWTq5+GLWVZt3KLCLtz+ah/KahccgOmU= ceph-6f763558-cf6d-11ee-95bb-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-19T21:27:27.688 INFO:teuthology.orchestra.run.smithi157.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC08pXPsRK0mYadadRd7SUW5BDaNyLJ3QsxVldMda7gvqQtcQTweu2D0N9Vv1W0ZCE30rEk6BsU0jwXiR0lfTA3/HzUi5Eb2KxS4gbX03bGYOPZBlU3iFBaoJpVzhlGyVW2L2knaCB+5tZ0hgv03LN2yEDTv+/pZUVKODYldRkNFFEJXUIKP0A9TTqVNxiLGFzysBzHO9p5cK7LxIcDuiZz8B8KlrPARTHSwFaTa/9ykFCfUk2bKwYvqfEys0pAeQTaFAfqk/2ULN5DLy4/IHLuwVKaMAEUPd+w2RPEM0C7n/ZmoDpQeDd+rjJNEB7sJQ4gPkBHdy+Vc2xV/8Ahd9ks0+4oRgNE4pWV8te4B+q5oaTuzJJrODUrl26CX0soUtKYsT1Ie9sjeYe1ipSyjrbuArbOoqBg8eY/QC18oVNCG/lpNUkrPju4wpLODGphO9UPu3imXGOmBp1J2sUuw2SLkph9Pjybdv7tWTq5+GLWVZt3KLCLtz+ah/KahccgOmU= ceph-6f763558-cf6d-11ee-95bb-87774f69a715 2024-02-19T21:27:27.699 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-02-19T21:27:31.769 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:30.528921+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:27:31.769 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:30.865495+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi080", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:27:31.769 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:30.868693+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:27:31.769 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:30.870021+0000 mon.a (mon.0) 92 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:27:31.769 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:30.875701+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:27:31.769 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:30.923107+0000 mon.a (mon.0) 94 : audit [INF] from='client.? 172.21.15.80:0/731611117' entity='client.admin' 2024-02-19T21:27:31.769 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:30.940099+0000 mon.a (mon.0) 95 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:27:31.769 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:30.944624+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:27:31.789 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-02-19T21:27:31.789 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-02-19T21:27:35.136 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi157 2024-02-19T21:27:35.136 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-02-19T21:27:35.136 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/etc/ceph/ceph.conf 2024-02-19T21:27:35.157 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-02-19T21:27:35.157 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-19T21:27:35.219 INFO:tasks.cephadm:Adding host smithi157 to orchestrator... 2024-02-19T21:27:35.219 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph orch host add smithi157 2024-02-19T21:27:35.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:34.416946+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:27:35.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:34.466206+0000 mon.a (mon.0) 98 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:27:35.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:34.467885+0000 mon.a (mon.0) 99 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:27:35.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:34.468549+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:27:35.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:27:34.469672+0000 mgr.y (mgr.14146) 6 : cephadm [INF] Updating smithi080:/etc/ceph/ceph.conf 2024-02-19T21:27:35.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:27:34.492265+0000 mgr.y (mgr.14146) 7 : cephadm [INF] Updating smithi080:/etc/ceph/ceph.client.admin.keyring 2024-02-19T21:27:35.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:34.537276+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:27:35.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:27:34.540164+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:27:37.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:27:35.890624+0000 mgr.y (mgr.14146) 8 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:27:39.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:27:37.891042+0000 mgr.y (mgr.14146) 9 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:27:41.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:27:39.891421+0000 mgr.y (mgr.14146) 10 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:27:43.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:27:41.891762+0000 mgr.y (mgr.14146) 11 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:27:45.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:27:43.892158+0000 mgr.y (mgr.14146) 12 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:27:47.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:27:45.892425+0000 mgr.y (mgr.14146) 13 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:27:49.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:27:47.892657+0000 mgr.y (mgr.14146) 14 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:27:51.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:27:49.893001+0000 mgr.y (mgr.14146) 15 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:27:53.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:27:51.893294+0000 mgr.y (mgr.14146) 16 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:27:55.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:27:53.893576+0000 mgr.y (mgr.14146) 17 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:27:57.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:27:55.893980+0000 mgr.y (mgr.14146) 18 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:27:59.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:27:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:27:57.894335+0000 mgr.y (mgr.14146) 19 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:01.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:27:59.894763+0000 mgr.y (mgr.14146) 20 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:01.350 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:28:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [90B blob data] 2024-02-19T21:28:01.597 INFO:teuthology.orchestra.run.smithi157.stdout:Added host 'smithi157' with addr '172.21.15.157' 2024-02-19T21:28:01.911 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:28:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [80B blob data] 2024-02-19T21:28:02.321 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph orch host ls --format=json 2024-02-19T21:28:02.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:00.978804+0000 mgr.y (mgr.14146) 21 : audit [DBG] from='client.14170 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi157", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:28:02.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:01.592953+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:02.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:01.623448+0000 mon.a (mon.0) 104 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:28:03.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:28:01.593360+0000 mgr.y (mgr.14146) 22 : cephadm [INF] Added host smithi157 2024-02-19T21:28:03.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:01.895172+0000 mgr.y (mgr.14146) 23 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:03.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:02.400964+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:04.263 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:28:04.263 INFO:teuthology.orchestra.run.smithi157.stdout:[{"addr": "172.21.15.80", "hostname": "smithi080", "labels": [], "status": ""}, {"addr": "172.21.15.157", "hostname": "smithi157", "labels": [], "status": ""}] 2024-02-19T21:28:05.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:03.658488+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:05.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:03.895484+0000 mgr.y (mgr.14146) 24 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:05.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:04.259545+0000 mgr.y (mgr.14146) 25 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:28:06.276 INFO:tasks.cephadm:Setting crush tunables to default 2024-02-19T21:28:06.276 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd crush tunables default 2024-02-19T21:28:07.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:05.895730+0000 mgr.y (mgr.14146) 26 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:08.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:07.134934+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:08.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:07.687330+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:08.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:07.688188+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:28:08.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:07.689035+0000 mon.a (mon.0) 110 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:08.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:07.689696+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:28:08.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:07.778699+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:08.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:07.781782+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:09.144 INFO:teuthology.orchestra.run.smithi080.stderr:adjusted tunables profile to default 2024-02-19T21:28:09.556 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:28:07.690713+0000 mgr.y (mgr.14146) 27 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.conf 2024-02-19T21:28:09.556 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:28:07.716745+0000 mgr.y (mgr.14146) 28 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-02-19T21:28:09.557 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:07.895986+0000 mgr.y (mgr.14146) 29 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:09.557 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:08.441485+0000 mon.a (mon.0) 114 : audit [INF] from='client.? 172.21.15.80:0/302408654' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-19T21:28:09.885 INFO:tasks.cephadm:Adding mon.a on smithi080 2024-02-19T21:28:09.885 INFO:tasks.cephadm:Adding mon.c on smithi080 2024-02-19T21:28:09.885 INFO:tasks.cephadm:Adding mon.b on smithi157 2024-02-19T21:28:09.886 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph orch apply mon '3;smithi080:172.21.15.80=a;smithi080:[v2:172.21.15.80:3301,v1:172.21.15.80:6790]=c;smithi157:172.21.15.157=b' 2024-02-19T21:28:10.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:09.138915+0000 mon.a (mon.0) 115 : audit [INF] from='client.? 172.21.15.80:0/302408654' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-19T21:28:10.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:09.138973+0000 mon.a (mon.0) 116 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-19T21:28:11.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:09.896274+0000 mgr.y (mgr.14146) 30 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:11.813 INFO:teuthology.orchestra.run.smithi157.stdout:Scheduled mon update... 2024-02-19T21:28:12.536 DEBUG:teuthology.orchestra.run.smithi080:mon.c> sudo journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@mon.c.service 2024-02-19T21:28:12.538 DEBUG:teuthology.orchestra.run.smithi157:mon.b> sudo journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@mon.b.service 2024-02-19T21:28:12.541 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-02-19T21:28:12.541 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T21:28:12.571 INFO:journalctl@ceph.mon.b.smithi157.stdout:-- Logs begin at Mon 2024-02-19 21:08:46 UTC. -- 2024-02-19T21:28:12.574 INFO:journalctl@ceph.mon.c.smithi080.stdout:-- Logs begin at Mon 2024-02-19 21:10:15 UTC. -- 2024-02-19T21:28:12.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:11.804309+0000 mgr.y (mgr.14146) 31 : audit [DBG] from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi080:172.21.15.80=a;smithi080:[v2:172.21.15.80:3301,v1:172.21.15.80:6790]=c;smithi157:172.21.15.157=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:28:12.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:28:11.806451+0000 mgr.y (mgr.14146) 32 : cephadm [INF] Saving service mon spec with placement smithi080:172.21.15.80=a;smithi080:[v2:172.21.15.80:3301,v1:172.21.15.80:6790]=c;smithi157:172.21.15.157=b;count:3 2024-02-19T21:28:12.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:11.809058+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:12.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:11.855809+0000 mon.a (mon.0) 118 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:28:12.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:11.857462+0000 mon.a (mon.0) 119 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:12.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:11.858190+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:28:12.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:11.864316+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:12.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:11.866065+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T21:28:12.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:11.866842+0000 mon.a (mon.0) 123 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:12.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:28:11.867545+0000 mgr.y (mgr.14146) 33 : cephadm [INF] Deploying daemon mon.b on smithi157 2024-02-19T21:28:12.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:11.896535+0000 mgr.y (mgr.14146) 34 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:15.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:13.896862+0000 mgr.y (mgr.14146) 35 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:16.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 systemd[1]: Starting Ceph mon.b for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T21:28:16.762 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:28:16.763 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"6f763558-cf6d-11ee-95bb-87774f69a715","modified":"2024-02-19T21:26:13.490441Z","created":"2024-02-19T21:26:13.490441Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:3300","nonce":0},{"type":"v1","addr":"172.21.15.80:6789","nonce":0}]},"addr":"172.21.15.80:6789/0","public_addr":"172.21.15.80:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T21:28:16.765 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-02-19T21:28:17.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.908+0000 7f01a7239880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-19T21:28:17.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.909+0000 7f01a7239880 0 ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable), process ceph-mon, pid 7 2024-02-19T21:28:17.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.909+0000 7f01a7239880 0 pidfile_write: ignore empty --pid-file 2024-02-19T21:28:17.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.913+0000 7f01a7239880 0 load: jerasure load: lrc load: isa 2024-02-19T21:28:17.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: RocksDB version: 6.8.1 2024-02-19T21:28:17.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: 2024-02-19T21:28:17.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-19T21:28:17.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Compile date Feb 17 2024 2024-02-19T21:28:17.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: DB SUMMARY 2024-02-19T21:28:17.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: 2024-02-19T21:28:17.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: CURRENT file: CURRENT 2024-02-19T21:28:17.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: 2024-02-19T21:28:17.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: IDENTITY file: IDENTITY 2024-02-19T21:28:17.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: 2024-02-19T21:28:17.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2024-02-19T21:28:17.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: 2024-02-19T21:28:17.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-02-19T21:28:17.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: 2024-02-19T21:28:17.062 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000003.log size: 511 ; 2024-02-19T21:28:17.062 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: 2024-02-19T21:28:17.062 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.error_if_exists: 0 2024-02-19T21:28:17.062 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.create_if_missing: 0 2024-02-19T21:28:17.062 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.paranoid_checks: 1 2024-02-19T21:28:17.062 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.env: 0x56012fa49080 2024-02-19T21:28:17.062 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.fs: Posix File System 2024-02-19T21:28:17.062 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.info_log: 0x560130c72260 2024-02-19T21:28:17.062 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-19T21:28:17.062 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.statistics: (nil) 2024-02-19T21:28:17.062 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.use_fsync: 0 2024-02-19T21:28:17.062 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.max_log_file_size: 0 2024-02-19T21:28:17.062 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-19T21:28:17.063 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-19T21:28:17.063 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-19T21:28:17.063 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-19T21:28:17.063 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.allow_fallocate: 1 2024-02-19T21:28:17.063 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-19T21:28:17.063 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-19T21:28:17.063 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.use_direct_reads: 0 2024-02-19T21:28:17.063 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-19T21:28:17.063 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-19T21:28:17.063 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.db_log_dir: 2024-02-19T21:28:17.063 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2024-02-19T21:28:17.063 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-19T21:28:17.063 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.max_subcompactions: 1 2024-02-19T21:28:17.063 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.max_background_flushes: -1 2024-02-19T21:28:17.063 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-19T21:28:17.064 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-19T21:28:17.064 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-19T21:28:17.064 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-19T21:28:17.064 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-19T21:28:17.064 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-19T21:28:17.064 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-19T21:28:17.064 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.write_buffer_manager: 0x5601319643c0 2024-02-19T21:28:17.064 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-19T21:28:17.064 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-19T21:28:17.064 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-19T21:28:17.064 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-19T21:28:17.064 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-19T21:28:17.064 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-19T21:28:17.064 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-19T21:28:17.065 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-19T21:28:17.065 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-19T21:28:17.065 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.unordered_write: 0 2024-02-19T21:28:17.065 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-19T21:28:17.065 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-19T21:28:17.065 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-19T21:28:17.065 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-19T21:28:17.065 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.row_cache: None 2024-02-19T21:28:17.065 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.wal_filter: None 2024-02-19T21:28:17.065 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-19T21:28:17.065 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-19T21:28:17.065 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.preserve_deletes: 0 2024-02-19T21:28:17.065 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.two_write_queues: 0 2024-02-19T21:28:17.065 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-19T21:28:17.065 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.atomic_flush: 0 2024-02-19T21:28:17.066 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-19T21:28:17.066 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-19T21:28:17.066 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-19T21:28:17.066 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.log_readahead_size: 0 2024-02-19T21:28:17.066 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-19T21:28:17.066 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.max_background_jobs: 2 2024-02-19T21:28:17.066 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.max_background_compactions: -1 2024-02-19T21:28:17.066 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-19T21:28:17.066 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-19T21:28:17.066 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-19T21:28:17.066 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-19T21:28:17.066 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-19T21:28:17.066 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-19T21:28:17.066 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-19T21:28:17.067 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-19T21:28:17.067 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.max_open_files: -1 2024-02-19T21:28:17.067 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-19T21:28:17.067 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-19T21:28:17.067 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-19T21:28:17.067 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-19T21:28:17.067 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Compression algorithms supported: 2024-02-19T21:28:17.067 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-19T21:28:17.067 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: kZSTD supported: 0 2024-02-19T21:28:17.067 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: kXpressCompression supported: 0 2024-02-19T21:28:17.067 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-19T21:28:17.067 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: kLZ4Compression supported: 1 2024-02-19T21:28:17.067 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: kBZip2Compression supported: 0 2024-02-19T21:28:17.067 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: kZlibCompression supported: 1 2024-02-19T21:28:17.067 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: kSnappyCompression supported: 1 2024-02-19T21:28:17.067 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-19T21:28:17.068 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 2024-02-19T21:28:17.068 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: 2024-02-19T21:28:17.068 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-19T21:28:17.068 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: 2024-02-19T21:28:17.068 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-19T21:28:17.068 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.merge_operator: 2024-02-19T21:28:17.070 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.compaction_filter: None 2024-02-19T21:28:17.070 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-19T21:28:17.070 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-19T21:28:17.070 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-19T21:28:17.070 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560130c17d10) 2024-02-19T21:28:17.070 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cache_index_and_filter_blocks: 1 2024-02-19T21:28:17.070 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-19T21:28:17.070 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-19T21:28:17.070 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: pin_top_level_index_and_filter: 1 2024-02-19T21:28:17.070 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: index_type: 0 2024-02-19T21:28:17.070 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: data_block_index_type: 0 2024-02-19T21:28:17.070 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: index_shortening: 1 2024-02-19T21:28:17.071 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: data_block_hash_table_util_ratio: 0.750000 2024-02-19T21:28:17.071 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: hash_index_allow_collision: 1 2024-02-19T21:28:17.071 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: checksum: 1 2024-02-19T21:28:17.071 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: no_block_cache: 0 2024-02-19T21:28:17.071 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: block_cache: 0x560130c4cf10 2024-02-19T21:28:17.071 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: block_cache_name: BinnedLRUCache 2024-02-19T21:28:17.071 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: block_cache_options: 2024-02-19T21:28:17.071 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: capacity : 536870912 2024-02-19T21:28:17.071 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: num_shard_bits : 4 2024-02-19T21:28:17.071 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: strict_capacity_limit : 0 2024-02-19T21:28:17.071 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: high_pri_pool_ratio: 0.000 2024-02-19T21:28:17.071 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: block_cache_compressed: (nil) 2024-02-19T21:28:17.071 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: persistent_cache: (nil) 2024-02-19T21:28:17.071 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: block_size: 4096 2024-02-19T21:28:17.071 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: block_size_deviation: 10 2024-02-19T21:28:17.072 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: block_restart_interval: 16 2024-02-19T21:28:17.072 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: index_block_restart_interval: 1 2024-02-19T21:28:17.072 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: metadata_block_size: 4096 2024-02-19T21:28:17.072 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: partition_filters: 0 2024-02-19T21:28:17.072 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: use_delta_encoding: 1 2024-02-19T21:28:17.072 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-19T21:28:17.072 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: whole_key_filtering: 1 2024-02-19T21:28:17.072 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: verify_compression: 0 2024-02-19T21:28:17.072 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: read_amp_bytes_per_bit: 0 2024-02-19T21:28:17.072 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: format_version: 2 2024-02-19T21:28:17.072 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: enable_index_compression: 1 2024-02-19T21:28:17.072 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: block_align: 0 2024-02-19T21:28:17.072 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: 2024-02-19T21:28:17.073 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-19T21:28:17.073 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-19T21:28:17.073 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.compression: NoCompression 2024-02-19T21:28:17.073 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-19T21:28:17.073 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-19T21:28:17.073 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-19T21:28:17.073 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.num_levels: 7 2024-02-19T21:28:17.073 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-19T21:28:17.073 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-19T21:28:17.073 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-19T21:28:17.073 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-19T21:28:17.073 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-19T21:28:17.074 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-19T21:28:17.074 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-19T21:28:17.074 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-19T21:28:17.074 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-19T21:28:17.074 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-19T21:28:17.074 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-19T21:28:17.074 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-19T21:28:17.074 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-19T21:28:17.074 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-19T21:28:17.074 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-19T21:28:17.075 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-19T21:28:17.075 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-19T21:28:17.075 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-19T21:28:17.075 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-19T21:28:17.075 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-19T21:28:17.075 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-19T21:28:17.075 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-19T21:28:17.075 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-19T21:28:17.075 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-19T21:28:17.075 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-19T21:28:17.075 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-19T21:28:17.075 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-19T21:28:17.075 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-19T21:28:17.076 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-19T21:28:17.076 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-19T21:28:17.076 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-19T21:28:17.076 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-19T21:28:17.076 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-19T21:28:17.076 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-19T21:28:17.077 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-19T21:28:17.077 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-19T21:28:17.077 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-19T21:28:17.077 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-19T21:28:17.078 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-19T21:28:17.078 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-19T21:28:17.078 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-19T21:28:17.078 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-19T21:28:17.078 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-19T21:28:17.078 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-19T21:28:17.078 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-19T21:28:17.078 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-19T21:28:17.078 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-19T21:28:17.078 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.table_properties_collectors: 2024-02-19T21:28:17.078 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.inplace_update_support: 0 2024-02-19T21:28:17.078 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-19T21:28:17.078 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-19T21:28:17.078 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-19T21:28:17.079 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-19T21:28:17.079 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.bloom_locality: 0 2024-02-19T21:28:17.079 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.max_successive_merges: 0 2024-02-19T21:28:17.079 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-19T21:28:17.079 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-19T21:28:17.079 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-19T21:28:17.079 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-19T21:28:17.079 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.ttl: 2592000 2024-02-19T21:28:17.079 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-19T21:28:17.079 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-19T21:28:17.079 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: 2024-02-19T21:28:17.079 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2024-02-19T21:28:17.079 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: 2024-02-19T21:28:17.079 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708378096916215, "job": 1, "event": "recovery_started", "log_files": [3]} 2024-02-19T21:28:17.080 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.914+0000 7f01a7239880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2024-02-19T21:28:17.080 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.915+0000 7f01a7239880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-19T21:28:17.080 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.915+0000 7f01a7239880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708378096916654, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1437, "table_properties": {"data_size": 523, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1708378096, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-19T21:28:17.080 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.915+0000 7f01a7239880 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2024-02-19T21:28:17.080 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: 2024-02-19T21:28:17.080 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.915+0000 7f01a7239880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708378096917034, "job": 1, "event": "recovery_finished"} 2024-02-19T21:28:17.080 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.916+0000 7f01a7239880 4 rocksdb: DB pointer 0x560130d15800 2024-02-19T21:28:17.080 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.916+0000 7f018e02b700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-19T21:28:17.080 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.916+0000 7f018e02b700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-19T21:28:17.080 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: ** DB Stats ** 2024-02-19T21:28:17.080 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T21:28:17.080 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-19T21:28:17.080 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-19T21:28:17.080 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-19T21:28:17.081 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-19T21:28:17.081 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-19T21:28:17.081 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-19T21:28:17.081 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: 2024-02-19T21:28:17.081 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: ** Compaction Stats [default] ** 2024-02-19T21:28:17.081 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-19T21:28:17.081 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T21:28:17.081 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.5 0.00 0.00 1 0.000 0 0 2024-02-19T21:28:17.081 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.5 0.00 0.00 1 0.000 0 0 2024-02-19T21:28:17.081 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.5 0.00 0.00 1 0.000 0 0 2024-02-19T21:28:17.081 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: 2024-02-19T21:28:17.081 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: ** Compaction Stats [default] ** 2024-02-19T21:28:17.081 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-19T21:28:17.081 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T21:28:17.082 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.5 0.00 0.00 1 0.000 0 0 2024-02-19T21:28:17.082 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T21:28:17.082 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-19T21:28:17.082 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-19T21:28:17.082 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: AddFile(Total Files): cumulative 0, interval 0 2024-02-19T21:28:17.082 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-19T21:28:17.082 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: AddFile(Keys): cumulative 0, interval 0 2024-02-19T21:28:17.082 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: Cumulative compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T21:28:17.082 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: Interval compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T21:28:17.082 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-19T21:28:17.082 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: 2024-02-19T21:28:17.082 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: ** File Read Latency Histogram By Level [default] ** 2024-02-19T21:28:17.082 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: 2024-02-19T21:28:17.082 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: ** Compaction Stats [default] ** 2024-02-19T21:28:17.082 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-19T21:28:17.083 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T21:28:17.083 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.5 0.00 0.00 1 0.000 0 0 2024-02-19T21:28:17.083 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.5 0.00 0.00 1 0.000 0 0 2024-02-19T21:28:17.083 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-19T21:28:17.083 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: 2024-02-19T21:28:17.083 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: ** Compaction Stats [default] ** 2024-02-19T21:28:17.083 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-19T21:28:17.083 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T21:28:17.083 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.5 0.00 0.00 1 0.000 0 0 2024-02-19T21:28:17.083 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T21:28:17.083 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-19T21:28:17.083 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-19T21:28:17.083 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: AddFile(Total Files): cumulative 0, interval 0 2024-02-19T21:28:17.083 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-19T21:28:17.084 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: AddFile(Keys): cumulative 0, interval 0 2024-02-19T21:28:17.084 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: Cumulative compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T21:28:17.084 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T21:28:17.084 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-19T21:28:17.084 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: 2024-02-19T21:28:17.084 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: ** File Read Latency Histogram By Level [default] ** 2024-02-19T21:28:17.084 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: 2024-02-19T21:28:17.084 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.916+0000 7f01a7239880 0 mon.b does not exist in monmap, will attempt to join an existing cluster 2024-02-19T21:28:17.084 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.916+0000 7f01a7239880 0 using public_addr v2:172.21.15.157:0/0 -> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-02-19T21:28:17.084 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.917+0000 7f01a7239880 0 starting mon.b rank -1 at public addrs [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] at bind addrs [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 6f763558-cf6d-11ee-95bb-87774f69a715 2024-02-19T21:28:17.084 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.918+0000 7f01a7239880 1 mon.b@-1(???) e0 preinit fsid 6f763558-cf6d-11ee-95bb-87774f69a715 2024-02-19T21:28:17.084 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.936+0000 7f0190830700 0 mon.b@-1(synchronizing).mds e1 new map 2024-02-19T21:28:17.084 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.936+0000 7f0190830700 0 mon.b@-1(synchronizing).mds e1 print_map 2024-02-19T21:28:17.084 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: e1 2024-02-19T21:28:17.085 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T21:28:17.085 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T21:28:17.085 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: legacy client fscid: -1 2024-02-19T21:28:17.085 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: 2024-02-19T21:28:17.085 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: No filesystems configured 2024-02-19T21:28:17.085 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: 2024-02-19T21:28:17.085 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.936+0000 7f0190830700 1 mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-02-19T21:28:17.085 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.936+0000 7f018c027700 4 rocksdb: [db_impl/db_impl_write.cc:1668] [default] New memtable created with log file: #9. Immutable memtables: 0. 2024-02-19T21:28:17.085 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: 2024-02-19T21:28:17.085 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.936+0000 7f019603b700 4 rocksdb: (Original Log Time 2024/02/19-21:28:16.938163) [db_impl/db_impl_compaction_flush.cc:2198] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 0 2024-02-19T21:28:17.085 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.936+0000 7f019603b700 4 rocksdb: [flush_job.cc:321] [default] [JOB 3] Flushing memtable with next log file: 9 2024-02-19T21:28:17.085 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: 2024-02-19T21:28:17.085 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.937+0000 7f019603b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708378096938282, "job": 3, "event": "flush_started", "num_memtables": 1, "num_entries": 908, "num_deletes": 13, "total_data_size": 3735495, "memory_usage": 3752744, "flush_reason": "Manual Compaction"} 2024-02-19T21:28:17.085 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.937+0000 7f019603b700 4 rocksdb: [flush_job.cc:350] [default] [JOB 3] Level-0 flush table #10: started 2024-02-19T21:28:17.086 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.937+0000 7f0190830700 1 mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-02-19T21:28:17.086 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.937+0000 7f0190830700 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-02-19T21:28:17.086 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.937+0000 7f0190830700 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-02-19T21:28:17.086 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.937+0000 7f0190830700 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-02-19T21:28:17.086 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.937+0000 7f0190830700 1 mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-02-19T21:28:17.086 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.937+0000 7f0190830700 0 mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-19T21:28:17.086 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.937+0000 7f0190830700 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-19T21:28:17.086 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.937+0000 7f0190830700 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-19T21:28:17.086 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.937+0000 7f0190830700 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-19T21:28:17.086 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:13.896862+0000 mgr.y (mgr.14146) 35 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:17.086 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T21:28:16.937+0000 7f0190830700 1 mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-02-19T21:28:17.086 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 bash[39555]: de4f702bf2d8589dade765dfe82c8760705500ce8fc6a21796a40a619f0b2ea9 2024-02-19T21:28:17.086 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:16 smithi157 systemd[1]: Started Ceph mon.b for 6f763558-cf6d-11ee-95bb-87774f69a715. 2024-02-19T21:28:18.713 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-02-19T21:28:18.713 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T21:28:22.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:16.945048+0000 mon.a (mon.0) 126 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-19T21:28:22.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:16.945312+0000 mon.a (mon.0) 127 : cluster [INF] mon.a calling monitor election 2024-02-19T21:28:22.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:16.959038+0000 mon.a (mon.0) 128 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-19T21:28:22.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:17.897510+0000 mgr.y (mgr.14146) 37 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:22.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:17.942568+0000 mon.a (mon.0) 129 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-19T21:28:22.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:18.942518+0000 mon.a (mon.0) 130 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-19T21:28:22.311 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:18.943495+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-02-19T21:28:22.311 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:19.897826+0000 mgr.y (mgr.14146) 38 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:22.311 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:19.942356+0000 mon.a (mon.0) 131 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-19T21:28:22.311 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:20.942610+0000 mon.a (mon.0) 132 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-19T21:28:22.311 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:21.942800+0000 mon.a (mon.0) 133 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-19T21:28:22.311 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:21.973839+0000 mon.a (mon.0) 134 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-02-19T21:28:22.311 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:21.976993+0000 mon.a (mon.0) 135 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0]} removed_ranks: {} 2024-02-19T21:28:22.311 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:21.977457+0000 mon.a (mon.0) 136 : cluster [DBG] fsmap 2024-02-19T21:28:22.311 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:21.977504+0000 mon.a (mon.0) 137 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-19T21:28:22.311 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:21.977723+0000 mon.a (mon.0) 138 : cluster [DBG] mgrmap e13: y(active, since 66s) 2024-02-19T21:28:22.311 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:21.977856+0000 mon.a (mon.0) 139 : cluster [INF] overall HEALTH_OK 2024-02-19T21:28:22.311 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:21.982830+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:22.311 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:21.983803+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T21:28:22.311 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:21.984585+0000 mon.a (mon.0) 142 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:22.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:16.945048+0000 mon.a (mon.0) 126 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-19T21:28:22.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:16.945312+0000 mon.a (mon.0) 127 : cluster [INF] mon.a calling monitor election 2024-02-19T21:28:22.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:16.959038+0000 mon.a (mon.0) 128 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-19T21:28:22.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:17.897510+0000 mgr.y (mgr.14146) 37 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:22.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:17.942568+0000 mon.a (mon.0) 129 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-19T21:28:22.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:18.942518+0000 mon.a (mon.0) 130 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-19T21:28:22.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:18.943495+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-02-19T21:28:22.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:19.897826+0000 mgr.y (mgr.14146) 38 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:22.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:19.942356+0000 mon.a (mon.0) 131 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-19T21:28:22.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:20.942610+0000 mon.a (mon.0) 132 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-19T21:28:22.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:21.942800+0000 mon.a (mon.0) 133 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-19T21:28:22.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:21.973839+0000 mon.a (mon.0) 134 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-02-19T21:28:22.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:21.976993+0000 mon.a (mon.0) 135 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0]} removed_ranks: {} 2024-02-19T21:28:22.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:21.977457+0000 mon.a (mon.0) 136 : cluster [DBG] fsmap 2024-02-19T21:28:22.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:21.977504+0000 mon.a (mon.0) 137 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-19T21:28:22.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:21.977723+0000 mon.a (mon.0) 138 : cluster [DBG] mgrmap e13: y(active, since 66s) 2024-02-19T21:28:22.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:21.977856+0000 mon.a (mon.0) 139 : cluster [INF] overall HEALTH_OK 2024-02-19T21:28:22.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:21.982830+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:22.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:21.983803+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T21:28:22.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:21.984585+0000 mon.a (mon.0) 142 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:23.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:21.898164+0000 mgr.y (mgr.14146) 39 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:23.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:28:21.985250+0000 mgr.y (mgr.14146) 40 : cephadm [INF] Deploying daemon mon.c on smithi080 2024-02-19T21:28:23.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:22.942917+0000 mon.a (mon.0) 143 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-19T21:28:23.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:21.898164+0000 mgr.y (mgr.14146) 39 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:23.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:28:21.985250+0000 mgr.y (mgr.14146) 40 : cephadm [INF] Deploying daemon mon.c on smithi080 2024-02-19T21:28:23.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:22.942917+0000 mon.a (mon.0) 143 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-19T21:28:23.823 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:28:23.823 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":2,"fsid":"6f763558-cf6d-11ee-95bb-87774f69a715","modified":"2024-02-19T21:28:16.942439Z","created":"2024-02-19T21:26:13.490441Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:3300","nonce":0},{"type":"v1","addr":"172.21.15.80:6789","nonce":0}]},"addr":"172.21.15.80:6789/0","public_addr":"172.21.15.80:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-02-19T21:28:23.824 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 2 2024-02-19T21:28:24.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:23.819476+0000 mon.a (mon.0) 144 : audit [DBG] from='client.? 172.21.15.157:0/1202342428' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T21:28:24.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:23.819476+0000 mon.a (mon.0) 144 : audit [DBG] from='client.? 172.21.15.157:0/1202342428' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T21:28:25.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:23.898431+0000 mgr.y (mgr.14146) 41 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:25.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:23.898431+0000 mgr.y (mgr.14146) 41 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:25.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 systemd[1]: Starting Ceph mon.c for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T21:28:25.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.567+0000 7f1b8dd9c880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-19T21:28:25.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.567+0000 7f1b8dd9c880 0 ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable), process ceph-mon, pid 7 2024-02-19T21:28:25.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.567+0000 7f1b8dd9c880 0 pidfile_write: ignore empty --pid-file 2024-02-19T21:28:25.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.571+0000 7f1b8dd9c880 0 load: jerasure load: lrc load: isa 2024-02-19T21:28:25.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: RocksDB version: 6.8.1 2024-02-19T21:28:25.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: 2024-02-19T21:28:25.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-19T21:28:25.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Compile date Feb 17 2024 2024-02-19T21:28:25.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: DB SUMMARY 2024-02-19T21:28:25.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: 2024-02-19T21:28:25.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: CURRENT file: CURRENT 2024-02-19T21:28:25.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: 2024-02-19T21:28:25.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: IDENTITY file: IDENTITY 2024-02-19T21:28:25.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: 2024-02-19T21:28:25.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2024-02-19T21:28:25.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: 2024-02-19T21:28:25.853 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-02-19T21:28:25.853 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: 2024-02-19T21:28:25.853 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000003.log size: 636 ; 2024-02-19T21:28:25.853 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: 2024-02-19T21:28:25.853 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.error_if_exists: 0 2024-02-19T21:28:25.853 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.create_if_missing: 0 2024-02-19T21:28:25.853 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.paranoid_checks: 1 2024-02-19T21:28:25.853 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.env: 0x557d59dcd080 2024-02-19T21:28:25.853 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.fs: Posix File System 2024-02-19T21:28:25.853 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.info_log: 0x557d5b3e0260 2024-02-19T21:28:25.853 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-19T21:28:25.853 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.statistics: (nil) 2024-02-19T21:28:25.853 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.use_fsync: 0 2024-02-19T21:28:25.853 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.max_log_file_size: 0 2024-02-19T21:28:25.854 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-19T21:28:25.854 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-19T21:28:25.854 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-19T21:28:25.854 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-19T21:28:25.854 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.allow_fallocate: 1 2024-02-19T21:28:25.854 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-19T21:28:25.854 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-19T21:28:25.854 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.use_direct_reads: 0 2024-02-19T21:28:25.854 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-19T21:28:25.854 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-19T21:28:25.854 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.db_log_dir: 2024-02-19T21:28:25.854 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2024-02-19T21:28:25.854 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-19T21:28:25.854 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.max_subcompactions: 1 2024-02-19T21:28:25.854 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.max_background_flushes: -1 2024-02-19T21:28:25.855 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-19T21:28:25.855 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-19T21:28:25.855 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-19T21:28:25.855 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-19T21:28:25.855 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-19T21:28:25.855 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-19T21:28:25.855 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-19T21:28:25.855 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.write_buffer_manager: 0x557d5c0d2390 2024-02-19T21:28:25.855 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-19T21:28:25.855 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-19T21:28:25.855 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-19T21:28:25.855 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-19T21:28:25.855 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-19T21:28:25.856 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-19T21:28:25.856 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-19T21:28:25.856 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-19T21:28:25.856 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-19T21:28:25.856 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.unordered_write: 0 2024-02-19T21:28:25.856 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-19T21:28:25.856 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-19T21:28:25.856 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-19T21:28:25.856 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-19T21:28:25.856 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.row_cache: None 2024-02-19T21:28:25.856 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.wal_filter: None 2024-02-19T21:28:25.856 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-19T21:28:25.856 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-19T21:28:25.856 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.preserve_deletes: 0 2024-02-19T21:28:25.857 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.two_write_queues: 0 2024-02-19T21:28:25.857 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-19T21:28:25.857 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.atomic_flush: 0 2024-02-19T21:28:25.857 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-19T21:28:25.857 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-19T21:28:25.857 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-19T21:28:25.857 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.log_readahead_size: 0 2024-02-19T21:28:25.857 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-19T21:28:25.857 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.max_background_jobs: 2 2024-02-19T21:28:25.857 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.max_background_compactions: -1 2024-02-19T21:28:25.857 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-19T21:28:25.857 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-19T21:28:25.857 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-19T21:28:25.857 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-19T21:28:25.858 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-19T21:28:25.858 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-19T21:28:25.858 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-19T21:28:25.858 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-19T21:28:25.858 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.max_open_files: -1 2024-02-19T21:28:25.858 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-19T21:28:25.858 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-19T21:28:25.858 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-19T21:28:25.858 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-19T21:28:25.858 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Compression algorithms supported: 2024-02-19T21:28:25.858 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-19T21:28:25.858 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: kZSTD supported: 0 2024-02-19T21:28:25.858 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: kXpressCompression supported: 0 2024-02-19T21:28:25.858 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-19T21:28:25.858 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: kLZ4Compression supported: 1 2024-02-19T21:28:25.859 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: kBZip2Compression supported: 0 2024-02-19T21:28:25.859 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: kZlibCompression supported: 1 2024-02-19T21:28:25.859 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: kSnappyCompression supported: 1 2024-02-19T21:28:25.859 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-19T21:28:25.859 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.572+0000 7f1b8dd9c880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 2024-02-19T21:28:25.859 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: 2024-02-19T21:28:25.859 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-19T21:28:25.859 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: 2024-02-19T21:28:25.859 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-19T21:28:25.859 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.merge_operator: 2024-02-19T21:28:25.859 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.compaction_filter: None 2024-02-19T21:28:25.859 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-19T21:28:25.859 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-19T21:28:25.859 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-19T21:28:25.860 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557d5b385d10) 2024-02-19T21:28:25.860 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cache_index_and_filter_blocks: 1 2024-02-19T21:28:25.860 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-19T21:28:25.860 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-19T21:28:25.860 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: pin_top_level_index_and_filter: 1 2024-02-19T21:28:25.860 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: index_type: 0 2024-02-19T21:28:25.860 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: data_block_index_type: 0 2024-02-19T21:28:25.860 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: index_shortening: 1 2024-02-19T21:28:25.860 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: data_block_hash_table_util_ratio: 0.750000 2024-02-19T21:28:25.860 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: hash_index_allow_collision: 1 2024-02-19T21:28:25.860 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: checksum: 1 2024-02-19T21:28:25.860 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: no_block_cache: 0 2024-02-19T21:28:25.860 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: block_cache: 0x557d5b3baf10 2024-02-19T21:28:25.860 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: block_cache_name: BinnedLRUCache 2024-02-19T21:28:25.860 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: block_cache_options: 2024-02-19T21:28:25.861 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: capacity : 536870912 2024-02-19T21:28:25.861 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: num_shard_bits : 4 2024-02-19T21:28:25.861 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: strict_capacity_limit : 0 2024-02-19T21:28:25.861 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: high_pri_pool_ratio: 0.000 2024-02-19T21:28:25.861 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: block_cache_compressed: (nil) 2024-02-19T21:28:25.861 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: persistent_cache: (nil) 2024-02-19T21:28:25.861 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: block_size: 4096 2024-02-19T21:28:25.861 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: block_size_deviation: 10 2024-02-19T21:28:25.861 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: block_restart_interval: 16 2024-02-19T21:28:25.861 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: index_block_restart_interval: 1 2024-02-19T21:28:25.861 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: metadata_block_size: 4096 2024-02-19T21:28:25.861 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: partition_filters: 0 2024-02-19T21:28:25.861 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: use_delta_encoding: 1 2024-02-19T21:28:25.861 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-19T21:28:25.861 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: whole_key_filtering: 1 2024-02-19T21:28:25.861 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: verify_compression: 0 2024-02-19T21:28:25.862 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: read_amp_bytes_per_bit: 0 2024-02-19T21:28:25.862 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: format_version: 2 2024-02-19T21:28:25.862 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: enable_index_compression: 1 2024-02-19T21:28:25.862 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: block_align: 0 2024-02-19T21:28:25.862 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: 2024-02-19T21:28:25.862 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-19T21:28:25.862 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-19T21:28:25.862 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.compression: NoCompression 2024-02-19T21:28:25.862 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-19T21:28:25.862 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-19T21:28:25.862 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-19T21:28:25.862 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.num_levels: 7 2024-02-19T21:28:25.862 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-19T21:28:25.862 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-19T21:28:25.862 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-19T21:28:25.863 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-19T21:28:25.863 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-19T21:28:25.863 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-19T21:28:25.863 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-19T21:28:25.863 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-19T21:28:25.863 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-19T21:28:25.863 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-19T21:28:25.863 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-19T21:28:25.863 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-19T21:28:25.863 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-19T21:28:25.863 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-19T21:28:25.863 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-19T21:28:25.863 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-19T21:28:25.863 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-19T21:28:25.863 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-19T21:28:25.864 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-19T21:28:25.864 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-19T21:28:25.864 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-19T21:28:25.864 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-19T21:28:25.864 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-19T21:28:25.864 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-19T21:28:25.864 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-19T21:28:25.864 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-19T21:28:25.864 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-19T21:28:25.864 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-19T21:28:25.864 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-19T21:28:25.864 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-19T21:28:25.864 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-19T21:28:25.865 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-19T21:28:25.865 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-19T21:28:25.865 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-19T21:28:25.865 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-19T21:28:25.865 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-19T21:28:25.865 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-19T21:28:25.865 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-19T21:28:25.865 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-19T21:28:25.865 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-19T21:28:25.865 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-19T21:28:25.865 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-19T21:28:25.865 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-19T21:28:25.865 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-19T21:28:25.865 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-19T21:28:25.865 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-19T21:28:25.866 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-19T21:28:25.866 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.table_properties_collectors: 2024-02-19T21:28:25.866 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.inplace_update_support: 0 2024-02-19T21:28:25.866 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-19T21:28:25.866 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-19T21:28:25.866 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-19T21:28:25.866 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-19T21:28:25.866 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.bloom_locality: 0 2024-02-19T21:28:25.866 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.max_successive_merges: 0 2024-02-19T21:28:25.866 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-19T21:28:25.866 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-19T21:28:25.866 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-19T21:28:25.866 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-19T21:28:25.866 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.ttl: 2592000 2024-02-19T21:28:25.866 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-19T21:28:25.867 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-19T21:28:25.867 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: 2024-02-19T21:28:25.867 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2024-02-19T21:28:25.867 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: 2024-02-19T21:28:25.867 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708378105574884, "job": 1, "event": "recovery_started", "log_files": [3]} 2024-02-19T21:28:25.867 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2024-02-19T21:28:25.867 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.573+0000 7f1b8dd9c880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-19T21:28:25.867 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.574+0000 7f1b8dd9c880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708378105575346, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1562, "table_properties": {"data_size": 648, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1708378105, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-19T21:28:25.867 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.574+0000 7f1b8dd9c880 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2024-02-19T21:28:25.867 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: 2024-02-19T21:28:25.867 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.574+0000 7f1b8dd9c880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708378105575729, "job": 1, "event": "recovery_finished"} 2024-02-19T21:28:25.867 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.575+0000 7f1b8dd9c880 4 rocksdb: DB pointer 0x557d5b483800 2024-02-19T21:28:25.867 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.575+0000 7f1b74b8e700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-19T21:28:25.867 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.575+0000 7f1b74b8e700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-19T21:28:25.868 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: ** DB Stats ** 2024-02-19T21:28:25.868 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T21:28:25.868 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-19T21:28:25.868 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-19T21:28:25.868 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-19T21:28:25.868 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-19T21:28:25.868 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-19T21:28:25.868 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-19T21:28:25.868 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: 2024-02-19T21:28:25.868 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: ** Compaction Stats [default] ** 2024-02-19T21:28:25.868 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-19T21:28:25.868 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T21:28:25.868 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: L0 1/0 1.53 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 2024-02-19T21:28:25.868 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: Sum 1/0 1.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 2024-02-19T21:28:25.869 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 2024-02-19T21:28:25.869 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: 2024-02-19T21:28:25.869 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: ** Compaction Stats [default] ** 2024-02-19T21:28:25.869 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-19T21:28:25.870 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T21:28:25.870 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.6 0.00 0.00 1 0.000 0 0 2024-02-19T21:28:25.870 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T21:28:25.870 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-19T21:28:25.870 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-19T21:28:25.870 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: AddFile(Total Files): cumulative 0, interval 0 2024-02-19T21:28:25.870 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-19T21:28:25.870 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: AddFile(Keys): cumulative 0, interval 0 2024-02-19T21:28:25.870 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: Cumulative compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T21:28:25.870 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: Interval compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T21:28:25.870 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-19T21:28:25.870 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: 2024-02-19T21:28:25.870 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: ** File Read Latency Histogram By Level [default] ** 2024-02-19T21:28:25.870 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: 2024-02-19T21:28:25.871 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: ** Compaction Stats [default] ** 2024-02-19T21:28:25.871 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-19T21:28:25.871 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T21:28:25.871 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: L0 1/0 1.53 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 2024-02-19T21:28:25.871 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: Sum 1/0 1.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 2024-02-19T21:28:25.871 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-19T21:28:25.871 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: 2024-02-19T21:28:25.871 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: ** Compaction Stats [default] ** 2024-02-19T21:28:25.871 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-19T21:28:25.871 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T21:28:25.871 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.6 0.00 0.00 1 0.000 0 0 2024-02-19T21:28:25.871 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T21:28:25.871 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-19T21:28:25.871 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-19T21:28:25.872 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: AddFile(Total Files): cumulative 0, interval 0 2024-02-19T21:28:25.872 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-19T21:28:25.872 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: AddFile(Keys): cumulative 0, interval 0 2024-02-19T21:28:25.872 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: Cumulative compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T21:28:25.872 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T21:28:25.872 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-19T21:28:25.872 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: 2024-02-19T21:28:25.872 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: ** File Read Latency Histogram By Level [default] ** 2024-02-19T21:28:25.872 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: 2024-02-19T21:28:25.872 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.575+0000 7f1b8dd9c880 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2024-02-19T21:28:25.872 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.575+0000 7f1b8dd9c880 0 using public_addrv [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] 2024-02-19T21:28:25.872 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.576+0000 7f1b8dd9c880 0 starting mon.c rank -1 at public addrs [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] at bind addrs [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 6f763558-cf6d-11ee-95bb-87774f69a715 2024-02-19T21:28:25.872 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.577+0000 7f1b8dd9c880 1 mon.c@-1(???) e0 preinit fsid 6f763558-cf6d-11ee-95bb-87774f69a715 2024-02-19T21:28:25.872 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.592+0000 7f1b72b8a700 4 rocksdb: [db_impl/db_impl_write.cc:1668] [default] New memtable created with log file: #9. Immutable memtables: 0. 2024-02-19T21:28:25.873 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: 2024-02-19T21:28:25.873 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.592+0000 7f1b7cb9e700 4 rocksdb: (Original Log Time 2024/02/19-21:28:25.593551) [db_impl/db_impl_compaction_flush.cc:2198] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 0 2024-02-19T21:28:25.873 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.592+0000 7f1b7cb9e700 4 rocksdb: [flush_job.cc:321] [default] [JOB 3] Flushing memtable with next log file: 9 2024-02-19T21:28:25.873 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: 2024-02-19T21:28:25.873 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.592+0000 7f1b7cb9e700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708378105593606, "job": 3, "event": "flush_started", "num_memtables": 1, "num_entries": 942, "num_deletes": 10, "total_data_size": 3944319, "memory_usage": 3962264, "flush_reason": "Manual Compaction"} 2024-02-19T21:28:25.873 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.592+0000 7f1b7cb9e700 4 rocksdb: [flush_job.cc:350] [default] [JOB 3] Level-0 flush table #10: started 2024-02-19T21:28:25.873 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.592+0000 7f1b77393700 0 mon.c@-1(synchronizing).mds e1 new map 2024-02-19T21:28:25.873 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.592+0000 7f1b77393700 0 mon.c@-1(synchronizing).mds e1 print_map 2024-02-19T21:28:25.873 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: e1 2024-02-19T21:28:25.873 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T21:28:25.873 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T21:28:25.873 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: legacy client fscid: -1 2024-02-19T21:28:25.873 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: 2024-02-19T21:28:25.874 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: No filesystems configured 2024-02-19T21:28:25.874 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: 2024-02-19T21:28:25.874 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.592+0000 7f1b77393700 1 mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-02-19T21:28:25.874 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.593+0000 7f1b77393700 1 mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-02-19T21:28:25.874 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.593+0000 7f1b77393700 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-02-19T21:28:25.874 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.593+0000 7f1b77393700 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-02-19T21:28:25.874 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.593+0000 7f1b77393700 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-02-19T21:28:25.874 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.593+0000 7f1b77393700 1 mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-02-19T21:28:25.874 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.593+0000 7f1b77393700 0 mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-19T21:28:25.874 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.593+0000 7f1b77393700 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-19T21:28:25.874 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.593+0000 7f1b77393700 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-19T21:28:25.874 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.593+0000 7f1b77393700 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-19T21:28:25.874 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:23.898431+0000 mgr.y (mgr.14146) 41 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:25.874 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T21:28:25.593+0000 7f1b77393700 1 mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-02-19T21:28:25.874 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 bash[45145]: c7c06b39fc7b4700ac5740e1d034c3b0ba745a5faa02d287f959368bad9e232e 2024-02-19T21:28:25.875 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:25 smithi080 systemd[1]: Started Ceph mon.c for 6f763558-cf6d-11ee-95bb-87774f69a715. 2024-02-19T21:28:30.619 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-02-19T21:28:30.620 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T21:28:31.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:25.604762+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-19T21:28:31.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:25.604769+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-02-19T21:28:31.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:25.604948+0000 mon.a (mon.0) 147 : cluster [INF] mon.a calling monitor election 2024-02-19T21:28:31.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:25.617791+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-19T21:28:31.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:25.617912+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-19T21:28:31.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:25.898764+0000 mgr.y (mgr.14146) 42 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:31.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:26.598913+0000 mon.a (mon.0) 150 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-19T21:28:31.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:27.599011+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-19T21:28:31.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:27.898999+0000 mgr.y (mgr.14146) 43 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:31.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:28.598948+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-19T21:28:31.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:29.599034+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-19T21:28:31.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:29.899247+0000 mgr.y (mgr.14146) 44 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:31.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:30.599337+0000 mon.a (mon.0) 154 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-19T21:28:31.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:30.618029+0000 mon.a (mon.0) 155 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-02-19T21:28:31.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:30.621051+0000 mon.a (mon.0) 156 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],c=[v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0]} removed_ranks: {} 2024-02-19T21:28:31.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:30.633535+0000 mon.a (mon.0) 157 : cluster [DBG] fsmap 2024-02-19T21:28:31.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:30.633578+0000 mon.a (mon.0) 158 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-19T21:28:31.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:30.633773+0000 mon.a (mon.0) 159 : cluster [DBG] mgrmap e13: y(active, since 74s) 2024-02-19T21:28:31.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:30.634016+0000 mon.a (mon.0) 160 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2024-02-19T21:28:31.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:30.637281+0000 mon.a (mon.0) 161 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,b 2024-02-19T21:28:31.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:30.637302+0000 mon.a (mon.0) 162 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-02-19T21:28:31.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:30.637317+0000 mon.a (mon.0) 163 : cluster [WRN] mon.c (rank 2) addr [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] is down (out of quorum) 2024-02-19T21:28:31.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:30.639914+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:31.062 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:30.641155+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:28:31.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:25.604762+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-19T21:28:31.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:25.604769+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-02-19T21:28:31.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:25.604948+0000 mon.a (mon.0) 147 : cluster [INF] mon.a calling monitor election 2024-02-19T21:28:31.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:25.617791+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-19T21:28:31.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:25.617912+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-19T21:28:31.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:25.898764+0000 mgr.y (mgr.14146) 42 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:31.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:26.598913+0000 mon.a (mon.0) 150 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-19T21:28:31.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:27.599011+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-19T21:28:31.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:27.898999+0000 mgr.y (mgr.14146) 43 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:31.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:28.598948+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-19T21:28:31.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:29.599034+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-19T21:28:31.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:29.899247+0000 mgr.y (mgr.14146) 44 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:31.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:30.599337+0000 mon.a (mon.0) 154 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-19T21:28:31.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:30.618029+0000 mon.a (mon.0) 155 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-02-19T21:28:31.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:30.621051+0000 mon.a (mon.0) 156 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],c=[v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0]} removed_ranks: {} 2024-02-19T21:28:31.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:30.633535+0000 mon.a (mon.0) 157 : cluster [DBG] fsmap 2024-02-19T21:28:31.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:30.633578+0000 mon.a (mon.0) 158 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-19T21:28:31.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:30.633773+0000 mon.a (mon.0) 159 : cluster [DBG] mgrmap e13: y(active, since 74s) 2024-02-19T21:28:31.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:30.634016+0000 mon.a (mon.0) 160 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2024-02-19T21:28:31.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:30.637281+0000 mon.a (mon.0) 161 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,b 2024-02-19T21:28:31.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:30.637302+0000 mon.a (mon.0) 162 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-02-19T21:28:31.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:30.637317+0000 mon.a (mon.0) 163 : cluster [WRN] mon.c (rank 2) addr [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] is down (out of quorum) 2024-02-19T21:28:31.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:30.639914+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:31.102 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:30.641155+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:28:32.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:31.016524+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:32.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:31.599528+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-19T21:28:32.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:31.680298+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:32.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:31.016524+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:32.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:31.599528+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-19T21:28:32.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:31.680298+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:33.023 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:31.016524+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:33.023 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:31.599528+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-19T21:28:33.023 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:31.680298+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:33.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:27.600687+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-02-19T21:28:33.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:32.614645+0000 mon.c (mon.2) 2 : cluster [INF] mon.c calling monitor election 2024-02-19T21:28:33.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:32.614970+0000 mon.a (mon.0) 170 : cluster [INF] mon.a calling monitor election 2024-02-19T21:28:33.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:32.615136+0000 mon.b (mon.1) 3 : cluster [INF] mon.b calling monitor election 2024-02-19T21:28:33.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:32.628623+0000 mon.a (mon.0) 171 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-02-19T21:28:33.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:32.633709+0000 mon.a (mon.0) 172 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],c=[v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0]} removed_ranks: {} 2024-02-19T21:28:33.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:32.634117+0000 mon.a (mon.0) 173 : cluster [DBG] fsmap 2024-02-19T21:28:33.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:32.634141+0000 mon.a (mon.0) 174 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-19T21:28:33.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:32.634305+0000 mon.a (mon.0) 175 : cluster [DBG] mgrmap e13: y(active, since 76s) 2024-02-19T21:28:33.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:32.634510+0000 mon.a (mon.0) 176 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-02-19T21:28:33.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:32.634532+0000 mon.a (mon.0) 177 : cluster [INF] Cluster is now healthy 2024-02-19T21:28:33.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:32.647750+0000 mon.a (mon.0) 178 : cluster [INF] overall HEALTH_OK 2024-02-19T21:28:33.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:27.600687+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-02-19T21:28:33.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:32.614645+0000 mon.c (mon.2) 2 : cluster [INF] mon.c calling monitor election 2024-02-19T21:28:33.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:32.614970+0000 mon.a (mon.0) 170 : cluster [INF] mon.a calling monitor election 2024-02-19T21:28:33.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:32.615136+0000 mon.b (mon.1) 3 : cluster [INF] mon.b calling monitor election 2024-02-19T21:28:33.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:32.628623+0000 mon.a (mon.0) 171 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-02-19T21:28:33.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:32.633709+0000 mon.a (mon.0) 172 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],c=[v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0]} removed_ranks: {} 2024-02-19T21:28:33.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:32.634117+0000 mon.a (mon.0) 173 : cluster [DBG] fsmap 2024-02-19T21:28:33.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:32.634141+0000 mon.a (mon.0) 174 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-19T21:28:33.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:32.634305+0000 mon.a (mon.0) 175 : cluster [DBG] mgrmap e13: y(active, since 76s) 2024-02-19T21:28:33.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:32.634510+0000 mon.a (mon.0) 176 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-02-19T21:28:33.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:32.634532+0000 mon.a (mon.0) 177 : cluster [INF] Cluster is now healthy 2024-02-19T21:28:33.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:32.647750+0000 mon.a (mon.0) 178 : cluster [INF] overall HEALTH_OK 2024-02-19T21:28:33.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:27.600687+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-02-19T21:28:33.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:32.614645+0000 mon.c (mon.2) 2 : cluster [INF] mon.c calling monitor election 2024-02-19T21:28:33.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:32.614970+0000 mon.a (mon.0) 170 : cluster [INF] mon.a calling monitor election 2024-02-19T21:28:33.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:32.615136+0000 mon.b (mon.1) 3 : cluster [INF] mon.b calling monitor election 2024-02-19T21:28:33.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:32.628623+0000 mon.a (mon.0) 171 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-02-19T21:28:33.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:32.633709+0000 mon.a (mon.0) 172 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],c=[v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0]} removed_ranks: {} 2024-02-19T21:28:33.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:32.634117+0000 mon.a (mon.0) 173 : cluster [DBG] fsmap 2024-02-19T21:28:33.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:32.634141+0000 mon.a (mon.0) 174 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-19T21:28:33.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:32.634305+0000 mon.a (mon.0) 175 : cluster [DBG] mgrmap e13: y(active, since 76s) 2024-02-19T21:28:33.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:32.634510+0000 mon.a (mon.0) 176 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-02-19T21:28:33.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:32.634532+0000 mon.a (mon.0) 177 : cluster [INF] Cluster is now healthy 2024-02-19T21:28:33.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:32.647750+0000 mon.a (mon.0) 178 : cluster [INF] overall HEALTH_OK 2024-02-19T21:28:34.080 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:33.599867+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-19T21:28:34.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:33.599867+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-19T21:28:34.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:33.599867+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-19T21:28:34.811 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-19T21:28:34.811 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":3,"fsid":"6f763558-cf6d-11ee-95bb-87774f69a715","modified":"2024-02-19T21:28:25.599649Z","created":"2024-02-19T21:26:13.490441Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:3300","nonce":0},{"type":"v1","addr":"172.21.15.80:6789","nonce":0}]},"addr":"172.21.15.80:6789/0","public_addr":"172.21.15.80:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:3301","nonce":0},{"type":"v1","addr":"172.21.15.80:6790","nonce":0}]},"addr":"172.21.15.80:6790/0","public_addr":"172.21.15.80:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-02-19T21:28:34.814 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 3 2024-02-19T21:28:35.467 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:33.899776+0000 mgr.y (mgr.14146) 46 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:35.467 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:34.349851+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:35.467 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:34.350548+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:35.467 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:34.351420+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:28:35.468 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:28:34.352510+0000 mgr.y (mgr.14146) 47 : cephadm [INF] Updating smithi080:/etc/ceph/ceph.conf 2024-02-19T21:28:35.468 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:28:34.352790+0000 mgr.y (mgr.14146) 48 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.conf 2024-02-19T21:28:35.468 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:34.424735+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:35.468 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:34.431738+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:35.468 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:34.438904+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:35.468 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:28:34.440123+0000 mgr.y (mgr.14146) 49 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-02-19T21:28:35.468 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:34.440392+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T21:28:35.468 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:34.441190+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T21:28:35.468 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:34.441961+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:35.468 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:28:34.442668+0000 mgr.y (mgr.14146) 50 : cephadm [INF] Reconfiguring daemon mon.a on smithi080 2024-02-19T21:28:35.469 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:34.808733+0000 mon.b (mon.1) 4 : audit [DBG] from='client.? 172.21.15.157:0/1183385429' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T21:28:35.486 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-02-19T21:28:35.487 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph config generate-minimal-conf 2024-02-19T21:28:35.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:33.899776+0000 mgr.y (mgr.14146) 46 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:35.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:34.349851+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:35.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:34.350548+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:35.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:34.351420+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:28:35.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:28:34.352510+0000 mgr.y (mgr.14146) 47 : cephadm [INF] Updating smithi080:/etc/ceph/ceph.conf 2024-02-19T21:28:35.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:28:34.352790+0000 mgr.y (mgr.14146) 48 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.conf 2024-02-19T21:28:35.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:34.424735+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:35.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:34.431738+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:35.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:34.438904+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:35.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:28:34.440123+0000 mgr.y (mgr.14146) 49 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-02-19T21:28:35.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:34.440392+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T21:28:35.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:34.441190+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T21:28:35.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:34.441961+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:35.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:28:34.442668+0000 mgr.y (mgr.14146) 50 : cephadm [INF] Reconfiguring daemon mon.a on smithi080 2024-02-19T21:28:35.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:34.808733+0000 mon.b (mon.1) 4 : audit [DBG] from='client.? 172.21.15.157:0/1183385429' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T21:28:35.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:33.899776+0000 mgr.y (mgr.14146) 46 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:35.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:34.349851+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:35.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:34.350548+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:35.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:34.351420+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:28:35.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:28:34.352510+0000 mgr.y (mgr.14146) 47 : cephadm [INF] Updating smithi080:/etc/ceph/ceph.conf 2024-02-19T21:28:35.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:28:34.352790+0000 mgr.y (mgr.14146) 48 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.conf 2024-02-19T21:28:35.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:34.424735+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:35.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:34.431738+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:35.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:34.438904+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:35.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:28:34.440123+0000 mgr.y (mgr.14146) 49 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-02-19T21:28:35.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:34.440392+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T21:28:35.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:34.441190+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T21:28:35.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:34.441961+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:35.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:28:34.442668+0000 mgr.y (mgr.14146) 50 : cephadm [INF] Reconfiguring daemon mon.a on smithi080 2024-02-19T21:28:35.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:34.808733+0000 mon.b (mon.1) 4 : audit [DBG] from='client.? 172.21.15.157:0/1183385429' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T21:28:37.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:35.900134+0000 mgr.y (mgr.14146) 51 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:37.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:36.017003+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:37.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:28:36.017416+0000 mgr.y (mgr.14146) 52 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-19T21:28:37.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:36.017604+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T21:28:37.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:36.018143+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T21:28:37.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:36.018644+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:37.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:28:36.019180+0000 mgr.y (mgr.14146) 53 : cephadm [INF] Reconfiguring daemon mon.c on smithi080 2024-02-19T21:28:37.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:35.900134+0000 mgr.y (mgr.14146) 51 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:37.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:36.017003+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:37.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:28:36.017416+0000 mgr.y (mgr.14146) 52 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-19T21:28:37.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:36.017604+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T21:28:37.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:36.018143+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T21:28:37.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:36.018644+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:37.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:28:36.019180+0000 mgr.y (mgr.14146) 53 : cephadm [INF] Reconfiguring daemon mon.c on smithi080 2024-02-19T21:28:37.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:35.900134+0000 mgr.y (mgr.14146) 51 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:37.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:36.017003+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:37.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:28:36.017416+0000 mgr.y (mgr.14146) 52 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-19T21:28:37.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:36.017604+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T21:28:37.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:36.018143+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T21:28:37.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:36.018644+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:37.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:28:36.019180+0000 mgr.y (mgr.14146) 53 : cephadm [INF] Reconfiguring daemon mon.c on smithi080 2024-02-19T21:28:39.024 INFO:teuthology.orchestra.run.smithi080.stdout:# minimal ceph.conf for 6f763558-cf6d-11ee-95bb-87774f69a715 2024-02-19T21:28:39.024 INFO:teuthology.orchestra.run.smithi080.stdout:[global] 2024-02-19T21:28:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: fsid = 6f763558-cf6d-11ee-95bb-87774f69a715 2024-02-19T21:28:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: mon_host = [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] 2024-02-19T21:28:39.775 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:37.900574+0000 mgr.y (mgr.14146) 54 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:39.775 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:38.396626+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:39.776 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:28:38.397141+0000 mgr.y (mgr.14146) 55 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-19T21:28:39.776 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:38.397363+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T21:28:39.776 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:38.397947+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T21:28:39.776 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:38.398465+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:39.776 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:28:38.398930+0000 mgr.y (mgr.14146) 56 : cephadm [INF] Reconfiguring daemon mon.b on smithi157 2024-02-19T21:28:39.776 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:39.021840+0000 mon.a (mon.0) 197 : audit [DBG] from='client.? 172.21.15.80:0/2803872771' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:39.776 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:37.900574+0000 mgr.y (mgr.14146) 54 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:39.776 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:38.396626+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:39.776 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:28:38.397141+0000 mgr.y (mgr.14146) 55 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-19T21:28:39.776 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:38.397363+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T21:28:39.776 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:38.397947+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T21:28:39.777 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:38.398465+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:39.777 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:28:38.398930+0000 mgr.y (mgr.14146) 56 : cephadm [INF] Reconfiguring daemon mon.b on smithi157 2024-02-19T21:28:39.777 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:39.021840+0000 mon.a (mon.0) 197 : audit [DBG] from='client.? 172.21.15.80:0/2803872771' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:39.795 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-02-19T21:28:39.795 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-19T21:28:39.795 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.conf 2024-02-19T21:28:39.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:37.900574+0000 mgr.y (mgr.14146) 54 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:39.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:38.396626+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:39.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:28:38.397141+0000 mgr.y (mgr.14146) 55 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-19T21:28:39.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:38.397363+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T21:28:39.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:38.397947+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T21:28:39.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:38.398465+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:39.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:28:38.398930+0000 mgr.y (mgr.14146) 56 : cephadm [INF] Reconfiguring daemon mon.b on smithi157 2024-02-19T21:28:39.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:39.021840+0000 mon.a (mon.0) 197 : audit [DBG] from='client.? 172.21.15.80:0/2803872771' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:39.826 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-19T21:28:39.826 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-19T21:28:39.895 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-02-19T21:28:39.895 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.conf 2024-02-19T21:28:39.926 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-02-19T21:28:39.926 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-19T21:28:39.994 INFO:tasks.cephadm:Adding mgr.y on smithi080 2024-02-19T21:28:39.994 INFO:tasks.cephadm:Adding mgr.x on smithi157 2024-02-19T21:28:39.995 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph orch apply mgr '2;smithi080=y;smithi157=x' 2024-02-19T21:28:41.165 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:39.879437+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:41.165 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:39.880213+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:28:41.165 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:39.881482+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:41.165 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:39.882169+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:28:41.165 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:39.889872+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:41.165 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:39.900845+0000 mgr.y (mgr.14146) 57 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:41.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:39.879437+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:41.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:39.880213+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:28:41.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:39.881482+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:41.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:39.882169+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:28:41.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:39.889872+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:41.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:39.900845+0000 mgr.y (mgr.14146) 57 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:41.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:39.879437+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:41.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:39.880213+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:28:41.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:39.881482+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:41.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:39.882169+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:28:41.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:39.889872+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:41.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:39.900845+0000 mgr.y (mgr.14146) 57 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:42.050 INFO:teuthology.orchestra.run.smithi157.stdout:Scheduled mgr update... 2024-02-19T21:28:42.746 DEBUG:teuthology.orchestra.run.smithi157:mgr.x> sudo journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@mgr.x.service 2024-02-19T21:28:42.748 INFO:tasks.cephadm:Deploying OSDs... 2024-02-19T21:28:42.748 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-19T21:28:42.748 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/scratch_devs of=/dev/stdout 2024-02-19T21:28:42.770 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-19T21:28:42.771 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_1 2024-02-19T21:28:42.778 INFO:journalctl@ceph.mgr.x.smithi157.stdout:-- Logs begin at Mon 2024-02-19 21:08:46 UTC. -- 2024-02-19T21:28:42.832 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-19T21:28:42.832 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T21:28:42.833 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 6h/6d Inode: 168067 Links: 1 2024-02-19T21:28:42.833 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T21:28:42.833 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T21:28:42.833 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-02-19 21:28:25.071182862 +0000 2024-02-19T21:28:42.833 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-02-19 21:16:06.463316289 +0000 2024-02-19T21:28:42.833 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-02-19 21:16:06.463316289 +0000 2024-02-19T21:28:42.833 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-02-19T21:28:42.833 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-19T21:28:42.904 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-02-19T21:28:42.904 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-02-19T21:28:42.904 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000250409 s, 2.0 MB/s 2024-02-19T21:28:42.905 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-19T21:28:42.970 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_2 2024-02-19T21:28:43.031 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-19T21:28:43.031 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T21:28:43.031 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 6h/6d Inode: 168986 Links: 1 2024-02-19T21:28:43.031 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T21:28:43.031 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T21:28:43.031 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-02-19 21:28:25.071182862 +0000 2024-02-19T21:28:43.031 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-02-19 21:16:06.810308190 +0000 2024-02-19T21:28:43.031 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-02-19 21:16:06.810308190 +0000 2024-02-19T21:28:43.031 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-02-19T21:28:43.032 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-19T21:28:43.103 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-02-19T21:28:43.103 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-02-19T21:28:43.103 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000267403 s, 1.9 MB/s 2024-02-19T21:28:43.105 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-19T21:28:43.167 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_3 2024-02-19T21:28:43.229 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-19T21:28:43.229 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T21:28:43.230 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 6h/6d Inode: 168205 Links: 1 2024-02-19T21:28:43.230 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T21:28:43.230 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T21:28:43.230 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-02-19 21:28:25.072182839 +0000 2024-02-19T21:28:43.230 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-02-19 21:16:07.159300046 +0000 2024-02-19T21:28:43.230 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-02-19 21:16:07.159300046 +0000 2024-02-19T21:28:43.230 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-02-19T21:28:43.230 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-19T21:28:43.299 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:41.901212+0000 mgr.y (mgr.14146) 58 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:43.299 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:42.042369+0000 mgr.y (mgr.14146) 59 : audit [DBG] from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi080=y;smithi157=x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:28:43.299 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:28:42.043842+0000 mgr.y (mgr.14146) 60 : cephadm [INF] Saving service mgr spec with placement smithi080=y;smithi157=x;count:2 2024-02-19T21:28:43.299 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:42.047439+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:43.299 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:42.060468+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:28:43.299 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:42.062078+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:43.299 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:42.062888+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:28:43.299 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:42.067879+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:43.299 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:42.069288+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T21:28:43.299 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:42.072288+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-19T21:28:43.299 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:42.073004+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T21:28:43.300 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:42.073959+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:43.300 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:28:42.074561+0000 mgr.y (mgr.14146) 61 : cephadm [INF] Deploying daemon mgr.x on smithi157 2024-02-19T21:28:43.300 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:41.901212+0000 mgr.y (mgr.14146) 58 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:43.300 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:42.042369+0000 mgr.y (mgr.14146) 59 : audit [DBG] from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi080=y;smithi157=x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:28:43.300 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:28:42.043842+0000 mgr.y (mgr.14146) 60 : cephadm [INF] Saving service mgr spec with placement smithi080=y;smithi157=x;count:2 2024-02-19T21:28:43.300 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:42.047439+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:43.300 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:42.060468+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:28:43.300 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:42.062078+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:43.300 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:42.062888+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:28:43.300 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:42.067879+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:43.300 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:42.069288+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T21:28:43.301 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:42.072288+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-19T21:28:43.301 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:42.073004+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T21:28:43.301 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:42.073959+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:43.301 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:28:42.074561+0000 mgr.y (mgr.14146) 61 : cephadm [INF] Deploying daemon mgr.x on smithi157 2024-02-19T21:28:43.301 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-02-19T21:28:43.301 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-02-19T21:28:43.301 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000204283 s, 2.5 MB/s 2024-02-19T21:28:43.302 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-19T21:28:43.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:41.901212+0000 mgr.y (mgr.14146) 58 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:43.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:42.042369+0000 mgr.y (mgr.14146) 59 : audit [DBG] from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi080=y;smithi157=x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:28:43.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:28:42.043842+0000 mgr.y (mgr.14146) 60 : cephadm [INF] Saving service mgr spec with placement smithi080=y;smithi157=x;count:2 2024-02-19T21:28:43.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:42.047439+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:43.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:42.060468+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:28:43.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:42.062078+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:43.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:42.062888+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:28:43.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:42.067879+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:43.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:42.069288+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T21:28:43.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:42.072288+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-19T21:28:43.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:42.073004+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T21:28:43.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:42.073959+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:43.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:28:42.074561+0000 mgr.y (mgr.14146) 61 : cephadm [INF] Deploying daemon mgr.x on smithi157 2024-02-19T21:28:43.365 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_4 2024-02-19T21:28:43.427 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-19T21:28:43.427 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T21:28:43.427 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 6h/6d Inode: 168261 Links: 1 2024-02-19T21:28:43.427 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T21:28:43.427 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T21:28:43.428 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-02-19 21:28:25.072182839 +0000 2024-02-19T21:28:43.428 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-02-19 21:16:07.530291387 +0000 2024-02-19T21:28:43.428 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-02-19 21:16:07.530291387 +0000 2024-02-19T21:28:43.428 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-02-19T21:28:43.428 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-19T21:28:43.499 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-02-19T21:28:43.499 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-02-19T21:28:43.499 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000272268 s, 1.9 MB/s 2024-02-19T21:28:43.500 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-19T21:28:43.563 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-02-19T21:28:43.564 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/scratch_devs of=/dev/stdout 2024-02-19T21:28:43.583 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-19T21:28:43.583 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_1 2024-02-19T21:28:43.641 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-19T21:28:43.641 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T21:28:43.641 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 6h/6d Inode: 169034 Links: 1 2024-02-19T21:28:43.641 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T21:28:43.641 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T21:28:43.641 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-02-19 21:28:16.309513325 +0000 2024-02-19T21:28:43.641 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-02-19 21:16:06.469050703 +0000 2024-02-19T21:28:43.642 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-02-19 21:16:06.469050703 +0000 2024-02-19T21:28:43.642 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-02-19T21:28:43.642 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-19T21:28:43.708 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-02-19T21:28:43.708 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-02-19T21:28:43.708 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000121135 s, 4.2 MB/s 2024-02-19T21:28:43.709 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-19T21:28:43.768 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_2 2024-02-19T21:28:43.826 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-19T21:28:43.826 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T21:28:43.827 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 6h/6d Inode: 160700 Links: 1 2024-02-19T21:28:43.827 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T21:28:43.827 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T21:28:43.827 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-02-19 21:28:16.309513325 +0000 2024-02-19T21:28:43.827 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-02-19 21:16:06.806044725 +0000 2024-02-19T21:28:43.827 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-02-19 21:16:06.806044725 +0000 2024-02-19T21:28:43.827 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-02-19T21:28:43.827 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-19T21:28:43.891 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-02-19T21:28:43.891 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-02-19T21:28:43.891 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 8.0204e-05 s, 6.4 MB/s 2024-02-19T21:28:43.892 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-19T21:28:43.951 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_3 2024-02-19T21:28:44.017 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-19T21:28:44.017 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T21:28:44.017 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 6h/6d Inode: 170025 Links: 1 2024-02-19T21:28:44.017 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T21:28:44.017 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T21:28:44.017 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-02-19 21:28:16.309513325 +0000 2024-02-19T21:28:44.017 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-02-19 21:16:07.158038480 +0000 2024-02-19T21:28:44.017 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-02-19 21:16:07.158038480 +0000 2024-02-19T21:28:44.017 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-02-19T21:28:44.017 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-19T21:28:44.085 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-02-19T21:28:44.085 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-02-19T21:28:44.085 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 8.5893e-05 s, 6.0 MB/s 2024-02-19T21:28:44.087 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-19T21:28:44.153 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_4 2024-02-19T21:28:44.212 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-19T21:28:44.212 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T21:28:44.212 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 6h/6d Inode: 168323 Links: 1 2024-02-19T21:28:44.212 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T21:28:44.212 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T21:28:44.212 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-02-19 21:28:44.162009056 +0000 2024-02-19T21:28:44.212 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-02-19 21:16:07.516032130 +0000 2024-02-19T21:28:44.212 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-02-19 21:16:07.516032130 +0000 2024-02-19T21:28:44.213 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-02-19T21:28:44.213 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-19T21:28:44.280 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:28:44 smithi157 systemd[1]: Starting Ceph mgr.x for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T21:28:44.282 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-02-19T21:28:44.283 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-02-19T21:28:44.283 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 8.6686e-05 s, 5.9 MB/s 2024-02-19T21:28:44.284 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-19T21:28:44.342 INFO:tasks.cephadm:Deploying osd.0 on smithi080 with /dev/vg_nvme/lv_4... 2024-02-19T21:28:44.342 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-19T21:28:45.054 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:28:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:28:44.749+0000 7fdc3711d700 1 -- 172.21.15.157:0/1791093895 <== mon.1 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561968c984e0 con 0x561968c6d400 2024-02-19T21:28:45.054 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:28:44 smithi157 bash[41024]: 7b727afbbcbc629c47507f82e500c80eeacff9420cc50fc498d32c874e219fdb 2024-02-19T21:28:45.054 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:28:44 smithi157 systemd[1]: Started Ceph mgr.x for 6f763558-cf6d-11ee-95bb-87774f69a715. 2024-02-19T21:28:45.054 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:28:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:28:44.876+0000 7fdc47718680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-19T21:28:45.054 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:28:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:28:44.960+0000 7fdc47718680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-19T21:28:45.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:43.901588+0000 mgr.y (mgr.14146) 62 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:45.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:44.840265+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:45.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:44.841629+0000 mon.a (mon.0) 213 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:28:45.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:43.901588+0000 mgr.y (mgr.14146) 62 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:45.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:44.840265+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:45.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:44.841629+0000 mon.a (mon.0) 213 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:28:45.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:43.901588+0000 mgr.y (mgr.14146) 62 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:45.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:44.840265+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:45.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:44.841629+0000 mon.a (mon.0) 213 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:28:45.809 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:28:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:28:45.361+0000 7fdc47718680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-19T21:28:46.428 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:28:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:28:46.133+0000 7fdc47718680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-19T21:28:46.428 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:28:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:28:46.215+0000 7fdc47718680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-19T21:28:46.694 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-19T21:28:46.694 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-19T21:28:46.694 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2024-02-19T21:28:46.694 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2024-02-19T21:28:46.694 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111368 s, 942 MB/s 2024-02-19T21:28:46.694 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2024-02-19T21:28:47.286 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:45.901958+0000 mgr.y (mgr.14146) 63 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:47.287 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:45.924212+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:47.287 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:45.924778+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:47.287 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:45.925390+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:28:47.287 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:45.929328+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:47.287 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:28:45.930619+0000 mgr.y (mgr.14146) 64 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-02-19T21:28:47.287 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:45.930862+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T21:28:47.287 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:45.931483+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T21:28:47.287 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:45.931973+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:47.287 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:28:45.932433+0000 mgr.y (mgr.14146) 65 : cephadm [INF] Reconfiguring daemon mgr.y on smithi080 2024-02-19T21:28:47.287 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:46.021198+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:47.287 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:45.901958+0000 mgr.y (mgr.14146) 63 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:47.288 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:45.924212+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:47.288 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:45.924778+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:47.288 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:45.925390+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:28:47.288 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:45.929328+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:47.288 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:28:45.930619+0000 mgr.y (mgr.14146) 64 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-02-19T21:28:47.288 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:45.930862+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T21:28:47.288 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:45.931483+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T21:28:47.288 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:45.931973+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:47.288 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:28:45.932433+0000 mgr.y (mgr.14146) 65 : cephadm [INF] Reconfiguring daemon mgr.y on smithi080 2024-02-19T21:28:47.288 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:46.021198+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:47.309 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:28:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:28:46.424+0000 7fdc47718680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-19T21:28:47.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:45.901958+0000 mgr.y (mgr.14146) 63 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:47.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:45.924212+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:47.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:45.924778+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:47.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:45.925390+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:28:47.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:45.929328+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:47.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:28:45.930619+0000 mgr.y (mgr.14146) 64 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-02-19T21:28:47.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:45.930862+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T21:28:47.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:45.931483+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T21:28:47.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:45.931973+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:47.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:28:45.932433+0000 mgr.y (mgr.14146) 65 : cephadm [INF] Reconfiguring daemon mgr.y on smithi080 2024-02-19T21:28:47.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:46.021198+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:47.657 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:28:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:28:47.361+0000 7fdc47718680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-19T21:28:47.657 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:28:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:28:47.487+0000 7fdc47718680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-19T21:28:47.657 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:28:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:28:47.564+0000 7fdc47718680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-19T21:28:48.059 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:28:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:28:47.653+0000 7fdc47718680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-19T21:28:48.060 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:28:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:28:47.849+0000 7fdc47718680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-19T21:28:48.309 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi080:vg_nvme/lv_4 2024-02-19T21:28:48.559 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:28:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:28:48.124+0000 7fdc47718680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-19T21:28:48.560 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:28:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:28:48.221+0000 7fdc47718680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-19T21:28:48.961 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:47.664329+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:48.985 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:47.665158+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:28:48.985 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:47.666229+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:48.985 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:47.666703+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:28:48.986 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:47.669782+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:48.986 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:47.902362+0000 mgr.y (mgr.14146) 66 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:49.094 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:47.664329+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:49.095 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:47.665158+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:28:49.095 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:47.666229+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:49.095 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:47.666703+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:28:49.095 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:47.669782+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:49.095 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:47.902362+0000 mgr.y (mgr.14146) 66 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:49.095 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:47.664329+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:49.095 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:47.665158+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:28:49.095 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:47.666229+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:49.095 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:47.666703+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:28:49.095 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:47.669782+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:28:49.095 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:47.902362+0000 mgr.y (mgr.14146) 66 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:49.303 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:28:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:28:48.957+0000 7fdc47718680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-19T21:28:49.303 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:28:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:28:49.037+0000 7fdc47718680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-19T21:28:49.303 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:28:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:28:49.128+0000 7fdc47718680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-19T21:28:49.559 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:28:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:28:49.299+0000 7fdc47718680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-19T21:28:49.826 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:28:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:28:49.559+0000 7fdc47718680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-19T21:28:49.826 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:28:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:28:49.687+0000 7fdc47718680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-19T21:28:50.078 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:28:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:28:49.822+0000 7fdc47718680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-19T21:28:50.078 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:28:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:28:49.992+0000 7fdc47718680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-19T21:28:50.559 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:28:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:28:50.074+0000 7fdc47718680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-19T21:28:51.041 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:49.902752+0000 mgr.y (mgr.14146) 67 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:51.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:50.088720+0000 mon.a (mon.0) 227 : cluster [DBG] Standby manager daemon x started 2024-02-19T21:28:51.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:50.089903+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.157:0/2890976948' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-19T21:28:51.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:50.090189+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.157:0/2890976948' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T21:28:51.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:50.091098+0000 mon.b (mon.1) 7 : audit [DBG] from='mgr.? 172.21.15.157:0/2890976948' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-19T21:28:51.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:50.091333+0000 mon.b (mon.1) 8 : audit [DBG] from='mgr.? 172.21.15.157:0/2890976948' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T21:28:51.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:50.494281+0000 mgr.y (mgr.14146) 68 : audit [DBG] from='client.24119 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:28:51.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:50.496501+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:28:51.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:50.498343+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:28:51.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:50.498874+0000 mon.a (mon.0) 230 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:51.042 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:49.902752+0000 mgr.y (mgr.14146) 67 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:51.042 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:50.088720+0000 mon.a (mon.0) 227 : cluster [DBG] Standby manager daemon x started 2024-02-19T21:28:51.043 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:50.089903+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.157:0/2890976948' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-19T21:28:51.043 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:50.090189+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.157:0/2890976948' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T21:28:51.043 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:50.091098+0000 mon.b (mon.1) 7 : audit [DBG] from='mgr.? 172.21.15.157:0/2890976948' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-19T21:28:51.043 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:50.091333+0000 mon.b (mon.1) 8 : audit [DBG] from='mgr.? 172.21.15.157:0/2890976948' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T21:28:51.043 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:50.494281+0000 mgr.y (mgr.14146) 68 : audit [DBG] from='client.24119 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:28:51.043 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:50.496501+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:28:51.043 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:50.498343+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:28:51.043 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:50.498874+0000 mon.a (mon.0) 230 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:51.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:49.902752+0000 mgr.y (mgr.14146) 67 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:51.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:50.088720+0000 mon.a (mon.0) 227 : cluster [DBG] Standby manager daemon x started 2024-02-19T21:28:51.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:50.089903+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.157:0/2890976948' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-19T21:28:51.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:50.090189+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.157:0/2890976948' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T21:28:51.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:50.091098+0000 mon.b (mon.1) 7 : audit [DBG] from='mgr.? 172.21.15.157:0/2890976948' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-19T21:28:51.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:50.091333+0000 mon.b (mon.1) 8 : audit [DBG] from='mgr.? 172.21.15.157:0/2890976948' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T21:28:51.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:50.494281+0000 mgr.y (mgr.14146) 68 : audit [DBG] from='client.24119 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:28:51.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:50.496501+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:28:51.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:50.498343+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:28:51.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:50.498874+0000 mon.a (mon.0) 230 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:28:52.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:50.777348+0000 mon.a (mon.0) 231 : cluster [DBG] mgrmap e14: y(active, since 94s), standbys: x 2024-02-19T21:28:52.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:50.777462+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-19T21:28:52.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:50.777348+0000 mon.a (mon.0) 231 : cluster [DBG] mgrmap e14: y(active, since 94s), standbys: x 2024-02-19T21:28:52.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:50.777462+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-19T21:28:52.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:50.777348+0000 mon.a (mon.0) 231 : cluster [DBG] mgrmap e14: y(active, since 94s), standbys: x 2024-02-19T21:28:52.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:50.777462+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-19T21:28:53.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:51.902970+0000 mgr.y (mgr.14146) 69 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:53.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:51.902970+0000 mgr.y (mgr.14146) 69 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:53.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:51.902970+0000 mgr.y (mgr.14146) 69 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:54.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:53.218537+0000 mon.c (mon.2) 3 : audit [INF] from='client.? 172.21.15.80:0/1717252063' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a72c63f6-46b3-4202-99da-7b0c92b799a5"}]: dispatch 2024-02-19T21:28:54.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:53.218940+0000 mon.a (mon.0) 233 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a72c63f6-46b3-4202-99da-7b0c92b799a5"}]: dispatch 2024-02-19T21:28:54.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:53.222846+0000 mon.a (mon.0) 234 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a72c63f6-46b3-4202-99da-7b0c92b799a5"}]': finished 2024-02-19T21:28:54.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:53.222917+0000 mon.a (mon.0) 235 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-02-19T21:28:54.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:53.223022+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:28:54.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:53.218537+0000 mon.c (mon.2) 3 : audit [INF] from='client.? 172.21.15.80:0/1717252063' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a72c63f6-46b3-4202-99da-7b0c92b799a5"}]: dispatch 2024-02-19T21:28:54.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:53.218940+0000 mon.a (mon.0) 233 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a72c63f6-46b3-4202-99da-7b0c92b799a5"}]: dispatch 2024-02-19T21:28:54.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:53.222846+0000 mon.a (mon.0) 234 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a72c63f6-46b3-4202-99da-7b0c92b799a5"}]': finished 2024-02-19T21:28:54.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:53.222917+0000 mon.a (mon.0) 235 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-02-19T21:28:54.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:53.223022+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:28:54.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:53.218537+0000 mon.c (mon.2) 3 : audit [INF] from='client.? 172.21.15.80:0/1717252063' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a72c63f6-46b3-4202-99da-7b0c92b799a5"}]: dispatch 2024-02-19T21:28:54.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:53.218940+0000 mon.a (mon.0) 233 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a72c63f6-46b3-4202-99da-7b0c92b799a5"}]: dispatch 2024-02-19T21:28:54.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:53.222846+0000 mon.a (mon.0) 234 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a72c63f6-46b3-4202-99da-7b0c92b799a5"}]': finished 2024-02-19T21:28:54.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:53.222917+0000 mon.a (mon.0) 235 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-02-19T21:28:54.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:53.223022+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:28:55.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:53.828515+0000 mon.a (mon.0) 237 : audit [DBG] from='client.? 172.21.15.80:0/2806332368' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:28:55.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:53.903229+0000 mgr.y (mgr.14146) 70 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:55.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:53.828515+0000 mon.a (mon.0) 237 : audit [DBG] from='client.? 172.21.15.80:0/2806332368' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:28:55.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:53.903229+0000 mgr.y (mgr.14146) 70 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:55.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:53.828515+0000 mon.a (mon.0) 237 : audit [DBG] from='client.? 172.21.15.80:0/2806332368' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:28:55.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:53.903229+0000 mgr.y (mgr.14146) 70 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:57.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:55.903593+0000 mgr.y (mgr.14146) 71 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:57.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:55.903593+0000 mgr.y (mgr.14146) 71 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:57.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:55.903593+0000 mgr.y (mgr.14146) 71 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:59.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:28:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:57.903960+0000 mgr.y (mgr.14146) 72 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:59.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:28:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:57.903960+0000 mgr.y (mgr.14146) 72 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:28:59.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:28:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:57.903960+0000 mgr.y (mgr.14146) 72 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:29:01.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:28:59.904364+0000 mgr.y (mgr.14146) 73 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:29:01.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:59.968965+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-19T21:29:01.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:28:59.969629+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:29:01.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:28:59.970133+0000 mgr.y (mgr.14146) 74 : cephadm [INF] Deploying daemon osd.0 on smithi080 2024-02-19T21:29:01.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:28:59.904364+0000 mgr.y (mgr.14146) 73 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:29:01.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:59.968965+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-19T21:29:01.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:28:59.969629+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:29:01.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:28:59.970133+0000 mgr.y (mgr.14146) 74 : cephadm [INF] Deploying daemon osd.0 on smithi080 2024-02-19T21:29:01.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:28:59.904364+0000 mgr.y (mgr.14146) 73 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:29:01.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:59.968965+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-19T21:29:01.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:28:59.969629+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:29:01.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:28:59.970133+0000 mgr.y (mgr.14146) 74 : cephadm [INF] Deploying daemon osd.0 on smithi080 2024-02-19T21:29:03.181 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:01.904604+0000 mgr.y (mgr.14146) 75 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:29:03.181 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:01.904604+0000 mgr.y (mgr.14146) 75 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:29:03.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:01.904604+0000 mgr.y (mgr.14146) 75 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:29:05.236 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:03.904864+0000 mgr.y (mgr.14146) 76 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:29:05.236 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:03.904864+0000 mgr.y (mgr.14146) 76 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:29:05.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:03.904864+0000 mgr.y (mgr.14146) 76 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:29:06.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:05.547805+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:06.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:05.569533+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:29:06.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:05.547805+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:06.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:05.569533+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:29:06.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:05.547805+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:06.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:05.569533+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:29:07.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:05.905186+0000 mgr.y (mgr.14146) 77 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:29:07.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:05.905186+0000 mgr.y (mgr.14146) 77 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:29:07.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:05.905186+0000 mgr.y (mgr.14146) 77 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:29:09.304 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 0 on host 'smithi080' 2024-02-19T21:29:09.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:07.905429+0000 mgr.y (mgr.14146) 78 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:29:09.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:08.176204+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:09.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:08.176828+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:29:09.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:08.177452+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:29:09.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:08.181486+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:09.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:08.697562+0000 mon.c (mon.2) 4 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/3531298825,v1:172.21.15.80:6803/3531298825]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-19T21:29:09.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:08.697866+0000 mon.a (mon.0) 246 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-19T21:29:09.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:07.905429+0000 mgr.y (mgr.14146) 78 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:29:09.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:08.176204+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:09.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:08.176828+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:29:09.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:08.177452+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:29:09.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:08.181486+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:09.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:08.697562+0000 mon.c (mon.2) 4 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/3531298825,v1:172.21.15.80:6803/3531298825]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-19T21:29:09.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:08.697866+0000 mon.a (mon.0) 246 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-19T21:29:09.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:07.905429+0000 mgr.y (mgr.14146) 78 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:29:09.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:08.176204+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:09.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:08.176828+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:29:09.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:08.177452+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:29:09.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:08.181486+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:09.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:08.697562+0000 mon.c (mon.2) 4 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/3531298825,v1:172.21.15.80:6803/3531298825]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-19T21:29:09.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:08.697866+0000 mon.a (mon.0) 246 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-19T21:29:10.104 DEBUG:teuthology.orchestra.run.smithi080:osd.0> sudo journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.0.service 2024-02-19T21:29:10.106 INFO:tasks.cephadm:Deploying osd.1 on smithi080 with /dev/vg_nvme/lv_3... 2024-02-19T21:29:10.106 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-19T21:29:10.137 INFO:journalctl@ceph.osd.0.smithi080.stdout:-- Logs begin at Mon 2024-02-19 21:10:15 UTC. -- 2024-02-19T21:29:10.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:09.300369+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:10.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:09.300591+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:29:10.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:09.556951+0000 mon.a (mon.0) 249 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-19T21:29:10.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:09.557016+0000 mon.a (mon.0) 250 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-02-19T21:29:10.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:09.557124+0000 mon.a (mon.0) 251 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:29:10.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:09.557673+0000 mon.c (mon.2) 5 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/3531298825,v1:172.21.15.80:6803/3531298825]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-19T21:29:10.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:09.557962+0000 mon.a (mon.0) 252 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-19T21:29:10.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:09.300369+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:10.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:09.300591+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:29:10.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:09.556951+0000 mon.a (mon.0) 249 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-19T21:29:10.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:09.557016+0000 mon.a (mon.0) 250 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-02-19T21:29:10.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:09.557124+0000 mon.a (mon.0) 251 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:29:10.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:09.557673+0000 mon.c (mon.2) 5 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/3531298825,v1:172.21.15.80:6803/3531298825]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-19T21:29:10.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:09.557962+0000 mon.a (mon.0) 252 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-19T21:29:10.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:09.300369+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:10.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:09.300591+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:29:10.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:09.556951+0000 mon.a (mon.0) 249 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-19T21:29:10.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:09.557016+0000 mon.a (mon.0) 250 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-02-19T21:29:10.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:09.557124+0000 mon.a (mon.0) 251 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:29:10.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:09.557673+0000 mon.c (mon.2) 5 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/3531298825,v1:172.21.15.80:6803/3531298825]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-19T21:29:10.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:09.557962+0000 mon.a (mon.0) 252 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-19T21:29:10.711 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 21:29:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-0[48652]: debug 2024-02-19T21:29:10.562+0000 7f0b6dc89700 -1 osd.0 0 waiting for initial osdmap 2024-02-19T21:29:10.711 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 21:29:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-0[48652]: debug 2024-02-19T21:29:10.564+0000 7f0b6a405700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T21:29:11.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:09.905758+0000 mgr.y (mgr.14146) 79 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:29:11.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:10.559471+0000 mon.a (mon.0) 253 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-19T21:29:11.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:10.559546+0000 mon.a (mon.0) 254 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-02-19T21:29:11.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:10.559838+0000 mon.a (mon.0) 255 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:29:11.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:10.563643+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:29:11.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:09.905758+0000 mgr.y (mgr.14146) 79 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:29:11.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:10.559471+0000 mon.a (mon.0) 253 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-19T21:29:11.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:10.559546+0000 mon.a (mon.0) 254 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-02-19T21:29:11.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:10.559838+0000 mon.a (mon.0) 255 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:29:11.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:10.563643+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:29:11.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:09.905758+0000 mgr.y (mgr.14146) 79 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:29:11.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:10.559471+0000 mon.a (mon.0) 253 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-19T21:29:11.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:10.559546+0000 mon.a (mon.0) 254 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-02-19T21:29:11.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:10.559838+0000 mon.a (mon.0) 255 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:29:11.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:10.563643+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:29:12.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:09.725413+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:29:12.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:09.725452+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:29:12.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:11.563250+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:29:12.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:11.567321+0000 mon.a (mon.0) 258 : cluster [INF] osd.0 [v2:172.21.15.80:6802/3531298825,v1:172.21.15.80:6803/3531298825] boot 2024-02-19T21:29:12.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:11.567374+0000 mon.a (mon.0) 259 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-02-19T21:29:12.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:11.567527+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:29:12.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:09.725413+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:29:12.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:09.725452+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:29:12.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:11.563250+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:29:12.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:11.567321+0000 mon.a (mon.0) 258 : cluster [INF] osd.0 [v2:172.21.15.80:6802/3531298825,v1:172.21.15.80:6803/3531298825] boot 2024-02-19T21:29:12.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:11.567374+0000 mon.a (mon.0) 259 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-02-19T21:29:12.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:11.567527+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:29:12.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:09.725413+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:29:12.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:09.725452+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:29:12.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:11.563250+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:29:12.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:11.567321+0000 mon.a (mon.0) 258 : cluster [INF] osd.0 [v2:172.21.15.80:6802/3531298825,v1:172.21.15.80:6803/3531298825] boot 2024-02-19T21:29:12.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:11.567374+0000 mon.a (mon.0) 259 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-02-19T21:29:12.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:11.567527+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:29:13.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:11.906090+0000 mgr.y (mgr.14146) 80 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:29:13.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:12.569986+0000 mon.a (mon.0) 261 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-02-19T21:29:13.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:11.906090+0000 mgr.y (mgr.14146) 80 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:29:13.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:12.569986+0000 mon.a (mon.0) 261 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-02-19T21:29:13.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:11.906090+0000 mgr.y (mgr.14146) 80 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:29:13.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:12.569986+0000 mon.a (mon.0) 261 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-02-19T21:29:14.833 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-19T21:29:14.834 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-19T21:29:14.834 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2024-02-19T21:29:14.834 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2024-02-19T21:29:14.834 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114384 s, 917 MB/s 2024-02-19T21:29:14.834 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2024-02-19T21:29:15.224 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:13.906431+0000 mgr.y (mgr.14146) 81 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:15.224 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:29:14.042076+0000 mgr.y (mgr.14146) 82 : cephadm [INF] Detected new or changed devices on smithi080 2024-02-19T21:29:15.224 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:14.046121+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:15.224 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:14.046841+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:29:15.224 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:29:14.047284+0000 mgr.y (mgr.14146) 83 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 16098M 2024-02-19T21:29:15.224 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:14.053250+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:15.224 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:14.054067+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:29:15.224 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:14.054630+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:29:15.224 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:14.060879+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:15.225 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:13.906431+0000 mgr.y (mgr.14146) 81 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:15.225 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:29:14.042076+0000 mgr.y (mgr.14146) 82 : cephadm [INF] Detected new or changed devices on smithi080 2024-02-19T21:29:15.225 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:14.046121+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:15.225 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:14.046841+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:29:15.225 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:29:14.047284+0000 mgr.y (mgr.14146) 83 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 16098M 2024-02-19T21:29:15.225 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:14.053250+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:15.225 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:14.054067+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:29:15.225 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:14.054630+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:29:15.225 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:14.060879+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:15.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:13.906431+0000 mgr.y (mgr.14146) 81 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:15.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:29:14.042076+0000 mgr.y (mgr.14146) 82 : cephadm [INF] Detected new or changed devices on smithi080 2024-02-19T21:29:15.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:14.046121+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:15.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:14.046841+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:29:15.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:29:14.047284+0000 mgr.y (mgr.14146) 83 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 16098M 2024-02-19T21:29:15.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:14.053250+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:15.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:14.054067+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:29:15.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:14.054630+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:29:15.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:14.060879+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:15.542 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi080:vg_nvme/lv_3 2024-02-19T21:29:17.179 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:15.906782+0000 mgr.y (mgr.14146) 84 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:17.179 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:15.906782+0000 mgr.y (mgr.14146) 84 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:17.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:15.906782+0000 mgr.y (mgr.14146) 84 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:18.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:17.906525+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:29:18.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:17.908378+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:29:18.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:17.908849+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:29:18.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:17.906525+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:29:18.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:17.908378+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:29:18.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:17.908849+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:29:18.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:17.906525+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:29:18.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:17.908378+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:29:18.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:17.908849+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:29:19.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:17.904567+0000 mgr.y (mgr.14146) 85 : audit [DBG] from='client.14232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:29:19.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:17.907000+0000 mgr.y (mgr.14146) 86 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:19.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:17.904567+0000 mgr.y (mgr.14146) 85 : audit [DBG] from='client.14232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:29:19.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:17.907000+0000 mgr.y (mgr.14146) 86 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:19.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:17.904567+0000 mgr.y (mgr.14146) 85 : audit [DBG] from='client.14232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:29:19.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:17.907000+0000 mgr.y (mgr.14146) 86 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:21.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:19.907263+0000 mgr.y (mgr.14146) 87 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:21.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:20.431359+0000 mon.a (mon.0) 271 : audit [INF] from='client.? 172.21.15.80:0/599983209' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d4e170e-b0ca-4e19-be35-4038ca126ee6"}]: dispatch 2024-02-19T21:29:21.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:20.435047+0000 mon.a (mon.0) 272 : audit [INF] from='client.? 172.21.15.80:0/599983209' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7d4e170e-b0ca-4e19-be35-4038ca126ee6"}]': finished 2024-02-19T21:29:21.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:20.435098+0000 mon.a (mon.0) 273 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-02-19T21:29:21.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:20.435193+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T21:29:21.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:19.907263+0000 mgr.y (mgr.14146) 87 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:21.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:20.431359+0000 mon.a (mon.0) 271 : audit [INF] from='client.? 172.21.15.80:0/599983209' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d4e170e-b0ca-4e19-be35-4038ca126ee6"}]: dispatch 2024-02-19T21:29:21.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:20.435047+0000 mon.a (mon.0) 272 : audit [INF] from='client.? 172.21.15.80:0/599983209' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7d4e170e-b0ca-4e19-be35-4038ca126ee6"}]': finished 2024-02-19T21:29:21.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:20.435098+0000 mon.a (mon.0) 273 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-02-19T21:29:21.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:20.435193+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T21:29:21.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:19.907263+0000 mgr.y (mgr.14146) 87 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:21.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:20.431359+0000 mon.a (mon.0) 271 : audit [INF] from='client.? 172.21.15.80:0/599983209' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d4e170e-b0ca-4e19-be35-4038ca126ee6"}]: dispatch 2024-02-19T21:29:21.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:20.435047+0000 mon.a (mon.0) 272 : audit [INF] from='client.? 172.21.15.80:0/599983209' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7d4e170e-b0ca-4e19-be35-4038ca126ee6"}]': finished 2024-02-19T21:29:21.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:20.435098+0000 mon.a (mon.0) 273 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-02-19T21:29:21.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:20.435193+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T21:29:22.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:21.059360+0000 mon.a (mon.0) 275 : audit [DBG] from='client.? 172.21.15.80:0/2741181' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:29:22.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:21.059360+0000 mon.a (mon.0) 275 : audit [DBG] from='client.? 172.21.15.80:0/2741181' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:29:22.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:21.059360+0000 mon.a (mon.0) 275 : audit [DBG] from='client.? 172.21.15.80:0/2741181' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:29:23.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:21.907500+0000 mgr.y (mgr.14146) 88 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:23.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:21.907500+0000 mgr.y (mgr.14146) 88 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:23.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:21.907500+0000 mgr.y (mgr.14146) 88 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:25.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:23.907955+0000 mgr.y (mgr.14146) 89 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:25.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:23.907955+0000 mgr.y (mgr.14146) 89 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:25.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:23.907955+0000 mgr.y (mgr.14146) 89 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:27.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:25.908411+0000 mgr.y (mgr.14146) 90 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:27.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:25.908411+0000 mgr.y (mgr.14146) 90 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:27.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:25.908411+0000 mgr.y (mgr.14146) 90 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:28.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:27.042469+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-19T21:29:28.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:27.043030+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:29:28.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:29:27.043507+0000 mgr.y (mgr.14146) 91 : cephadm [INF] Deploying daemon osd.1 on smithi080 2024-02-19T21:29:28.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:27.042469+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-19T21:29:28.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:27.043030+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:29:28.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:29:27.043507+0000 mgr.y (mgr.14146) 91 : cephadm [INF] Deploying daemon osd.1 on smithi080 2024-02-19T21:29:28.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:27.042469+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-19T21:29:28.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:27.043030+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:29:28.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:29:27.043507+0000 mgr.y (mgr.14146) 91 : cephadm [INF] Deploying daemon osd.1 on smithi080 2024-02-19T21:29:29.090 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:27.908701+0000 mgr.y (mgr.14146) 92 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:29.090 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:27.908701+0000 mgr.y (mgr.14146) 92 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:29.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:27.908701+0000 mgr.y (mgr.14146) 92 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:31.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:29.908985+0000 mgr.y (mgr.14146) 93 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:31.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:29.908985+0000 mgr.y (mgr.14146) 93 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:31.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:29.908985+0000 mgr.y (mgr.14146) 93 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:33.238 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:31.909411+0000 mgr.y (mgr.14146) 94 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:33.238 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:32.687250+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:33.238 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:32.716387+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:29:33.238 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:31.909411+0000 mgr.y (mgr.14146) 94 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:33.239 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:32.687250+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:33.239 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:32.716387+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:29:33.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:31.909411+0000 mgr.y (mgr.14146) 94 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:33.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:32.687250+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:33.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:32.716387+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:29:35.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:33.909698+0000 mgr.y (mgr.14146) 95 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:35.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:33.909698+0000 mgr.y (mgr.14146) 95 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:35.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:33.909698+0000 mgr.y (mgr.14146) 95 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:36.234 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:35.117303+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:36.234 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:35.454001+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:29:36.234 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:35.454626+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:29:36.234 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:35.461997+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:36.234 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:35.807681+0000 mon.a (mon.0) 284 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/1497235950,v1:172.21.15.80:6811/1497235950]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-19T21:29:36.234 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:35.117303+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:36.235 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:35.454001+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:29:36.235 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:35.454626+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:29:36.235 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:35.461997+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:36.235 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:35.807681+0000 mon.a (mon.0) 284 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/1497235950,v1:172.21.15.80:6811/1497235950]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-19T21:29:36.256 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 1 on host 'smithi080' 2024-02-19T21:29:36.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:35.117303+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:36.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:35.454001+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:29:36.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:35.454626+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:29:36.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:35.461997+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:36.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:35.807681+0000 mon.a (mon.0) 284 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/1497235950,v1:172.21.15.80:6811/1497235950]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-19T21:29:36.957 DEBUG:teuthology.orchestra.run.smithi080:osd.1> sudo journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.1.service 2024-02-19T21:29:36.960 INFO:tasks.cephadm:Deploying osd.2 on smithi080 with /dev/vg_nvme/lv_2... 2024-02-19T21:29:36.960 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-19T21:29:36.989 INFO:journalctl@ceph.osd.1.smithi080.stdout:-- Logs begin at Mon 2024-02-19 21:10:15 UTC. -- 2024-02-19T21:29:37.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:35.909978+0000 mgr.y (mgr.14146) 96 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:37.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:36.252872+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:37.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:36.279145+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:29:37.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:36.466228+0000 mon.a (mon.0) 287 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/1497235950,v1:172.21.15.80:6811/1497235950]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-19T21:29:37.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:36.466295+0000 mon.a (mon.0) 288 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-02-19T21:29:37.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:36.466433+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T21:29:37.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:36.466815+0000 mon.a (mon.0) 290 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/1497235950,v1:172.21.15.80:6811/1497235950]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-19T21:29:37.577 INFO:journalctl@ceph.osd.1.smithi080.stdout:Feb 19 21:29:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-1[53250]: debug 2024-02-19T21:29:37.468+0000 7f8b8e727700 -1 osd.1 0 waiting for initial osdmap 2024-02-19T21:29:37.577 INFO:journalctl@ceph.osd.1.smithi080.stdout:Feb 19 21:29:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-1[53250]: debug 2024-02-19T21:29:37.471+0000 7f8b89ea1700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T21:29:37.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:35.909978+0000 mgr.y (mgr.14146) 96 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:37.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:36.252872+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:37.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:36.279145+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:29:37.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:36.466228+0000 mon.a (mon.0) 287 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/1497235950,v1:172.21.15.80:6811/1497235950]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-19T21:29:37.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:36.466295+0000 mon.a (mon.0) 288 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-02-19T21:29:37.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:36.466433+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T21:29:37.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:36.466815+0000 mon.a (mon.0) 290 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/1497235950,v1:172.21.15.80:6811/1497235950]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-19T21:29:37.578 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:35.909978+0000 mgr.y (mgr.14146) 96 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:37.578 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:36.252872+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:37.578 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:36.279145+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:29:37.579 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:36.466228+0000 mon.a (mon.0) 287 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/1497235950,v1:172.21.15.80:6811/1497235950]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-19T21:29:37.579 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:36.466295+0000 mon.a (mon.0) 288 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-02-19T21:29:37.579 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:36.466433+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T21:29:37.579 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:36.466815+0000 mon.a (mon.0) 290 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/1497235950,v1:172.21.15.80:6811/1497235950]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-19T21:29:38.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:37.466979+0000 mon.a (mon.0) 291 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/1497235950,v1:172.21.15.80:6811/1497235950]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-19T21:29:38.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:37.467039+0000 mon.a (mon.0) 292 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-02-19T21:29:38.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:37.467164+0000 mon.a (mon.0) 293 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T21:29:38.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:37.470067+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T21:29:38.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:37.466979+0000 mon.a (mon.0) 291 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/1497235950,v1:172.21.15.80:6811/1497235950]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-19T21:29:38.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:37.467039+0000 mon.a (mon.0) 292 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-02-19T21:29:38.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:37.467164+0000 mon.a (mon.0) 293 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T21:29:38.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:37.470067+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T21:29:38.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:37.466979+0000 mon.a (mon.0) 291 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/1497235950,v1:172.21.15.80:6811/1497235950]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-19T21:29:38.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:37.467039+0000 mon.a (mon.0) 292 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-02-19T21:29:38.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:37.467164+0000 mon.a (mon.0) 293 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T21:29:38.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:37.470067+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T21:29:39.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:36.791652+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:29:39.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:36.791725+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:29:39.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:37.910258+0000 mgr.y (mgr.14146) 97 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:39.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:38.468558+0000 mon.a (mon.0) 295 : cluster [INF] osd.1 [v2:172.21.15.80:6810/1497235950,v1:172.21.15.80:6811/1497235950] boot 2024-02-19T21:29:39.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:38.468591+0000 mon.a (mon.0) 296 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-02-19T21:29:39.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:38.469066+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T21:29:39.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:36.791652+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:29:39.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:36.791725+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:29:39.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:37.910258+0000 mgr.y (mgr.14146) 97 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:39.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:38.468558+0000 mon.a (mon.0) 295 : cluster [INF] osd.1 [v2:172.21.15.80:6810/1497235950,v1:172.21.15.80:6811/1497235950] boot 2024-02-19T21:29:39.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:38.468591+0000 mon.a (mon.0) 296 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-02-19T21:29:39.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:38.469066+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T21:29:39.845 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:36.791652+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:29:39.845 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:36.791725+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:29:39.845 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:37.910258+0000 mgr.y (mgr.14146) 97 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:29:39.845 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:38.468558+0000 mon.a (mon.0) 295 : cluster [INF] osd.1 [v2:172.21.15.80:6810/1497235950,v1:172.21.15.80:6811/1497235950] boot 2024-02-19T21:29:39.845 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:38.468591+0000 mon.a (mon.0) 296 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-02-19T21:29:39.845 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:38.469066+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T21:29:40.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:39.472798+0000 mon.a (mon.0) 298 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-02-19T21:29:40.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:39.472798+0000 mon.a (mon.0) 298 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-02-19T21:29:40.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:39.472798+0000 mon.a (mon.0) 298 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-02-19T21:29:41.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:39.910635+0000 mgr.y (mgr.14146) 98 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:41.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:41.289433+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:41.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:41.290356+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:29:41.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:41.290937+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:29:41.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:41.295440+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:41.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:41.296360+0000 mon.a (mon.0) 303 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:29:41.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:41.296917+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:29:41.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:41.301424+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:41.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:39.910635+0000 mgr.y (mgr.14146) 98 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:41.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:41.289433+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:41.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:41.290356+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:29:41.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:41.290937+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:29:41.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:41.295440+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:41.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:41.296360+0000 mon.a (mon.0) 303 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:29:41.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:41.296917+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:29:41.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:41.301424+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:41.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:39.910635+0000 mgr.y (mgr.14146) 98 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:41.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:41.289433+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:41.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:41.290356+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:29:41.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:41.290937+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:29:41.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:41.295440+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:41.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:41.296360+0000 mon.a (mon.0) 303 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:29:41.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:41.296917+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:29:41.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:41.301424+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:29:41.830 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-19T21:29:41.831 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-19T21:29:41.831 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2024-02-19T21:29:41.831 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2024-02-19T21:29:41.831 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111233 s, 943 MB/s 2024-02-19T21:29:41.831 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2024-02-19T21:29:42.585 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:29:41.285216+0000 mgr.y (mgr.14146) 99 : cephadm [INF] Detected new or changed devices on smithi080 2024-02-19T21:29:42.585 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:29:41.291350+0000 mgr.y (mgr.14146) 100 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 8049M 2024-02-19T21:29:42.585 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:29:41.285216+0000 mgr.y (mgr.14146) 99 : cephadm [INF] Detected new or changed devices on smithi080 2024-02-19T21:29:42.585 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:29:41.291350+0000 mgr.y (mgr.14146) 100 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 8049M 2024-02-19T21:29:42.604 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi080:vg_nvme/lv_2 2024-02-19T21:29:42.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:29:41.285216+0000 mgr.y (mgr.14146) 99 : cephadm [INF] Detected new or changed devices on smithi080 2024-02-19T21:29:42.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:29:41.291350+0000 mgr.y (mgr.14146) 100 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 8049M 2024-02-19T21:29:43.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:41.911178+0000 mgr.y (mgr.14146) 101 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:43.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:41.911178+0000 mgr.y (mgr.14146) 101 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:43.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:41.911178+0000 mgr.y (mgr.14146) 101 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:45.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:43.911480+0000 mgr.y (mgr.14146) 102 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:45.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:44.859656+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:29:45.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:44.861562+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:29:45.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:44.862101+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:29:45.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:43.911480+0000 mgr.y (mgr.14146) 102 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:45.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:44.859656+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:29:45.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:44.861562+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:29:45.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:44.862101+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:29:45.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:43.911480+0000 mgr.y (mgr.14146) 102 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:45.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:44.859656+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:29:45.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:44.861562+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:29:45.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:44.862101+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:29:46.666 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:44.857699+0000 mgr.y (mgr.14146) 103 : audit [DBG] from='client.14259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:29:46.667 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:44.857699+0000 mgr.y (mgr.14146) 103 : audit [DBG] from='client.14259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:29:46.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:44.857699+0000 mgr.y (mgr.14146) 103 : audit [DBG] from='client.14259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:29:47.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:45.911789+0000 mgr.y (mgr.14146) 104 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:47.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:47.447399+0000 mon.a (mon.0) 309 : audit [INF] from='client.? 172.21.15.80:0/3510616460' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cf461b67-f3e8-45e9-b2f6-777752ba5574"}]: dispatch 2024-02-19T21:29:47.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:47.453625+0000 mon.a (mon.0) 310 : audit [INF] from='client.? 172.21.15.80:0/3510616460' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cf461b67-f3e8-45e9-b2f6-777752ba5574"}]': finished 2024-02-19T21:29:47.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:47.453682+0000 mon.a (mon.0) 311 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-02-19T21:29:47.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:47.453791+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:29:47.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:45.911789+0000 mgr.y (mgr.14146) 104 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:47.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:47.447399+0000 mon.a (mon.0) 309 : audit [INF] from='client.? 172.21.15.80:0/3510616460' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cf461b67-f3e8-45e9-b2f6-777752ba5574"}]: dispatch 2024-02-19T21:29:47.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:47.453625+0000 mon.a (mon.0) 310 : audit [INF] from='client.? 172.21.15.80:0/3510616460' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cf461b67-f3e8-45e9-b2f6-777752ba5574"}]': finished 2024-02-19T21:29:47.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:47.453682+0000 mon.a (mon.0) 311 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-02-19T21:29:47.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:47.453791+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:29:47.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:45.911789+0000 mgr.y (mgr.14146) 104 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:47.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:47.447399+0000 mon.a (mon.0) 309 : audit [INF] from='client.? 172.21.15.80:0/3510616460' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cf461b67-f3e8-45e9-b2f6-777752ba5574"}]: dispatch 2024-02-19T21:29:47.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:47.453625+0000 mon.a (mon.0) 310 : audit [INF] from='client.? 172.21.15.80:0/3510616460' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cf461b67-f3e8-45e9-b2f6-777752ba5574"}]': finished 2024-02-19T21:29:47.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:47.453682+0000 mon.a (mon.0) 311 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-02-19T21:29:47.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:47.453791+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:29:48.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:48.049208+0000 mon.c (mon.2) 6 : audit [DBG] from='client.? 172.21.15.80:0/1375629676' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:29:48.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:48.049208+0000 mon.c (mon.2) 6 : audit [DBG] from='client.? 172.21.15.80:0/1375629676' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:29:48.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:48.049208+0000 mon.c (mon.2) 6 : audit [DBG] from='client.? 172.21.15.80:0/1375629676' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:29:49.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:47.912086+0000 mgr.y (mgr.14146) 105 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:49.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:47.912086+0000 mgr.y (mgr.14146) 105 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:49.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:47.912086+0000 mgr.y (mgr.14146) 105 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:51.765 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:49.912424+0000 mgr.y (mgr.14146) 106 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:51.765 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:49.912424+0000 mgr.y (mgr.14146) 106 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:51.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:49.912424+0000 mgr.y (mgr.14146) 106 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:53.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:51.912807+0000 mgr.y (mgr.14146) 107 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:53.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:51.912807+0000 mgr.y (mgr.14146) 107 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:53.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:51.912807+0000 mgr.y (mgr.14146) 107 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:54.781 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:53.982459+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-19T21:29:54.781 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:53.983079+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:29:54.781 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:53.982459+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-19T21:29:54.781 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:53.983079+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:29:54.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:53.982459+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-19T21:29:54.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:53.983079+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:29:55.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:53.913137+0000 mgr.y (mgr.14146) 108 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:55.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:29:53.983640+0000 mgr.y (mgr.14146) 109 : cephadm [INF] Deploying daemon osd.2 on smithi080 2024-02-19T21:29:55.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:53.913137+0000 mgr.y (mgr.14146) 108 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:55.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:29:53.983640+0000 mgr.y (mgr.14146) 109 : cephadm [INF] Deploying daemon osd.2 on smithi080 2024-02-19T21:29:55.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:53.913137+0000 mgr.y (mgr.14146) 108 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:55.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:29:53.983640+0000 mgr.y (mgr.14146) 109 : cephadm [INF] Deploying daemon osd.2 on smithi080 2024-02-19T21:29:57.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:55.913470+0000 mgr.y (mgr.14146) 110 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:57.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:55.913470+0000 mgr.y (mgr.14146) 110 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:57.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:55.913470+0000 mgr.y (mgr.14146) 110 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:59.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:29:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:57.913773+0000 mgr.y (mgr.14146) 111 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:59.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:29:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:57.913773+0000 mgr.y (mgr.14146) 111 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:29:59.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:29:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:57.913773+0000 mgr.y (mgr.14146) 111 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:30:01.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:59.691746+0000 mon.a (mon.0) 315 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:01.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:29:59.705579+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:30:01.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:29:59.914084+0000 mgr.y (mgr.14146) 112 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:30:01.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:00.000129+0000 mon.a (mon.0) 317 : cluster [INF] overall HEALTH_OK 2024-02-19T21:30:01.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:59.691746+0000 mon.a (mon.0) 315 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:01.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:29:59.705579+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:30:01.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:29:59.914084+0000 mgr.y (mgr.14146) 112 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:30:01.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:00.000129+0000 mon.a (mon.0) 317 : cluster [INF] overall HEALTH_OK 2024-02-19T21:30:01.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:59.691746+0000 mon.a (mon.0) 315 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:01.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:29:59.705579+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:30:01.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:29:59.914084+0000 mgr.y (mgr.14146) 112 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:30:01.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:00.000129+0000 mon.a (mon.0) 317 : cluster [INF] overall HEALTH_OK 2024-02-19T21:30:03.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:01.914305+0000 mgr.y (mgr.14146) 113 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:30:03.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:02.686623+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:03.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:02.687327+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:03.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:02.687901+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:30:03.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:02.692059+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:03.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:02.778847+0000 mon.a (mon.0) 322 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/3131848307,v1:172.21.15.80:6819/3131848307]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-19T21:30:03.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:01.914305+0000 mgr.y (mgr.14146) 113 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:30:03.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:02.686623+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:03.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:02.687327+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:03.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:02.687901+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:30:03.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:02.692059+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:03.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:02.778847+0000 mon.a (mon.0) 322 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/3131848307,v1:172.21.15.80:6819/3131848307]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-19T21:30:03.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:01.914305+0000 mgr.y (mgr.14146) 113 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:30:03.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:02.686623+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:03.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:02.687327+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:03.352 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:02.687901+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:30:03.352 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:02.692059+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:03.352 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:02.778847+0000 mon.a (mon.0) 322 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/3131848307,v1:172.21.15.80:6819/3131848307]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-19T21:30:03.384 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 2 on host 'smithi080' 2024-02-19T21:30:04.213 DEBUG:teuthology.orchestra.run.smithi080:osd.2> sudo journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.2.service 2024-02-19T21:30:04.215 INFO:tasks.cephadm:Deploying osd.3 on smithi080 with /dev/vg_nvme/lv_1... 2024-02-19T21:30:04.215 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-02-19T21:30:04.244 INFO:journalctl@ceph.osd.2.smithi080.stdout:-- Logs begin at Mon 2024-02-19 21:10:15 UTC. -- 2024-02-19T21:30:04.549 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:03.380935+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:04.549 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:03.409195+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:30:04.549 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:03.695551+0000 mon.a (mon.0) 325 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/3131848307,v1:172.21.15.80:6819/3131848307]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-19T21:30:04.549 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:03.695614+0000 mon.a (mon.0) 326 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-02-19T21:30:04.549 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:03.695717+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:30:04.549 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:03.696039+0000 mon.a (mon.0) 328 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/3131848307,v1:172.21.15.80:6819/3131848307]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-19T21:30:04.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:03.380935+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:04.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:03.409195+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:30:04.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:03.695551+0000 mon.a (mon.0) 325 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/3131848307,v1:172.21.15.80:6819/3131848307]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-19T21:30:04.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:03.695614+0000 mon.a (mon.0) 326 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-02-19T21:30:04.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:03.695717+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:30:04.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:03.696039+0000 mon.a (mon.0) 328 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/3131848307,v1:172.21.15.80:6819/3131848307]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-19T21:30:04.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:03.380935+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:04.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:03.409195+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:30:04.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:03.695551+0000 mon.a (mon.0) 325 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/3131848307,v1:172.21.15.80:6819/3131848307]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-19T21:30:04.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:03.695614+0000 mon.a (mon.0) 326 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-02-19T21:30:04.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:03.695717+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:30:04.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:03.696039+0000 mon.a (mon.0) 328 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/3131848307,v1:172.21.15.80:6819/3131848307]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-19T21:30:04.827 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 21:30:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-2[57744]: debug 2024-02-19T21:30:04.699+0000 7f77502a8700 -1 osd.2 0 waiting for initial osdmap 2024-02-19T21:30:04.827 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 21:30:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-2[57744]: debug 2024-02-19T21:30:04.702+0000 7f7749a1e700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T21:30:05.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:03.914580+0000 mgr.y (mgr.14146) 114 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:30:05.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:04.696959+0000 mon.a (mon.0) 329 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/3131848307,v1:172.21.15.80:6819/3131848307]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-19T21:30:05.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:04.697023+0000 mon.a (mon.0) 330 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-02-19T21:30:05.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:04.697316+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:30:05.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:04.700762+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:30:05.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:03.914580+0000 mgr.y (mgr.14146) 114 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:30:05.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:04.696959+0000 mon.a (mon.0) 329 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/3131848307,v1:172.21.15.80:6819/3131848307]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-19T21:30:05.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:04.697023+0000 mon.a (mon.0) 330 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-02-19T21:30:05.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:04.697316+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:30:05.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:04.700762+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:30:05.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:03.914580+0000 mgr.y (mgr.14146) 114 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:30:05.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:04.696959+0000 mon.a (mon.0) 329 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/3131848307,v1:172.21.15.80:6819/3131848307]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-19T21:30:05.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:04.697023+0000 mon.a (mon.0) 330 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-02-19T21:30:05.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:04.697316+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:30:05.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:04.700762+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:30:07.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:03.798519+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:30:07.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:03.798561+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:30:07.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:05.701695+0000 mon.a (mon.0) 333 : cluster [INF] osd.2 [v2:172.21.15.80:6818/3131848307,v1:172.21.15.80:6819/3131848307] boot 2024-02-19T21:30:07.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:05.701740+0000 mon.a (mon.0) 334 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-02-19T21:30:07.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:05.701974+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:30:07.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:05.702218+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-19T21:30:07.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:05.914855+0000 mgr.y (mgr.14146) 115 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:30:07.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:03.798519+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:30:07.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:03.798561+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:30:07.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:05.701695+0000 mon.a (mon.0) 333 : cluster [INF] osd.2 [v2:172.21.15.80:6818/3131848307,v1:172.21.15.80:6819/3131848307] boot 2024-02-19T21:30:07.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:05.701740+0000 mon.a (mon.0) 334 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-02-19T21:30:07.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:05.701974+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:30:07.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:05.702218+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-19T21:30:07.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:05.914855+0000 mgr.y (mgr.14146) 115 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:30:07.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:03.798519+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:30:07.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:03.798561+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:30:07.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:05.701695+0000 mon.a (mon.0) 333 : cluster [INF] osd.2 [v2:172.21.15.80:6818/3131848307,v1:172.21.15.80:6819/3131848307] boot 2024-02-19T21:30:07.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:05.701740+0000 mon.a (mon.0) 334 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-02-19T21:30:07.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:05.701974+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:30:07.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:05.702218+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-19T21:30:07.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:05.914855+0000 mgr.y (mgr.14146) 115 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:30:07.611 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-02-19T21:30:07.612 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-02-19T21:30:07.612 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2024-02-19T21:30:07.612 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2024-02-19T21:30:07.612 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0127641 s, 822 MB/s 2024-02-19T21:30:07.612 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2024-02-19T21:30:08.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:06.706956+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-02-19T21:30:08.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:06.707030+0000 mon.a (mon.0) 338 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-02-19T21:30:08.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:06.707864+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-19T21:30:08.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:06.706956+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-02-19T21:30:08.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:06.707030+0000 mon.a (mon.0) 338 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-02-19T21:30:08.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:06.707864+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-19T21:30:08.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:06.706956+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-02-19T21:30:08.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:06.707030+0000 mon.a (mon.0) 338 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-02-19T21:30:08.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:06.707864+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-19T21:30:08.649 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi080:vg_nvme/lv_1 2024-02-19T21:30:09.004 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:07.707840+0000 mon.a (mon.0) 340 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-19T21:30:09.004 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:07.707926+0000 mon.a (mon.0) 341 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-02-19T21:30:09.004 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:07.915197+0000 mgr.y (mgr.14146) 116 : cluster [DBG] pgmap v96: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:09.004 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:07.707840+0000 mon.a (mon.0) 340 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-19T21:30:09.004 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:07.707926+0000 mon.a (mon.0) 341 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-02-19T21:30:09.004 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:07.915197+0000 mgr.y (mgr.14146) 116 : cluster [DBG] pgmap v96: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:09.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:07.707840+0000 mon.a (mon.0) 340 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-19T21:30:09.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:07.707926+0000 mon.a (mon.0) 341 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-02-19T21:30:09.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:07.915197+0000 mgr.y (mgr.14146) 116 : cluster [DBG] pgmap v96: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:10.057 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:08.720064+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-02-19T21:30:10.057 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:30:09.557057+0000 mgr.y (mgr.14146) 117 : cephadm [INF] Detected new or changed devices on smithi080 2024-02-19T21:30:10.057 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:09.562226+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:10.057 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:09.563154+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:30:10.057 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:09.563747+0000 mon.a (mon.0) 345 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:30:10.057 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:09.564293+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:30:10.057 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:09.571748+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:10.057 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:09.572680+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:10.057 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:09.573232+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:30:10.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:09.579654+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:10.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:08.720064+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-02-19T21:30:10.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:30:09.557057+0000 mgr.y (mgr.14146) 117 : cephadm [INF] Detected new or changed devices on smithi080 2024-02-19T21:30:10.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:09.562226+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:10.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:09.563154+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:30:10.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:09.563747+0000 mon.a (mon.0) 345 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:30:10.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:09.564293+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:30:10.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:09.571748+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:10.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:09.572680+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:10.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:09.573232+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:30:10.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:09.579654+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:10.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:08.720064+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-02-19T21:30:10.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:30:09.557057+0000 mgr.y (mgr.14146) 117 : cephadm [INF] Detected new or changed devices on smithi080 2024-02-19T21:30:10.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:09.562226+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:10.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:09.563154+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:30:10.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:09.563747+0000 mon.a (mon.0) 345 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:30:10.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:09.564293+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:30:10.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:09.571748+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:10.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:09.572680+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:10.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:09.573232+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:30:10.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:09.579654+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:10.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:30:09.564718+0000 mgr.y (mgr.14146) 118 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 5366M 2024-02-19T21:30:10.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:09.915665+0000 mgr.y (mgr.14146) 119 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:10.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:30:09.564718+0000 mgr.y (mgr.14146) 118 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 5366M 2024-02-19T21:30:10.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:09.915665+0000 mgr.y (mgr.14146) 119 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:11.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:30:09.564718+0000 mgr.y (mgr.14146) 118 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 5366M 2024-02-19T21:30:11.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:09.915665+0000 mgr.y (mgr.14146) 119 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:12.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:11.636596+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:30:12.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:11.638435+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:30:12.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:11.638906+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:12.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:11.636596+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:30:12.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:11.638435+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:30:12.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:11.638906+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:12.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:11.636596+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:30:12.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:11.638435+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:30:12.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:11.638906+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:13.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:11.634634+0000 mgr.y (mgr.14146) 120 : audit [DBG] from='client.24197 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:30:13.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:11.916035+0000 mgr.y (mgr.14146) 121 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:13.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:11.634634+0000 mgr.y (mgr.14146) 120 : audit [DBG] from='client.24197 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:30:13.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:11.916035+0000 mgr.y (mgr.14146) 121 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:13.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:11.634634+0000 mgr.y (mgr.14146) 120 : audit [DBG] from='client.24197 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:30:13.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:11.916035+0000 mgr.y (mgr.14146) 121 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:15.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:13.916430+0000 mgr.y (mgr.14146) 122 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:15.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:14.157649+0000 mon.a (mon.0) 354 : audit [INF] from='client.? 172.21.15.80:0/1887100983' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76318cdd-5fce-4a40-95c9-300d55c34820"}]: dispatch 2024-02-19T21:30:15.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:14.161737+0000 mon.a (mon.0) 355 : audit [INF] from='client.? 172.21.15.80:0/1887100983' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76318cdd-5fce-4a40-95c9-300d55c34820"}]': finished 2024-02-19T21:30:15.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:14.161791+0000 mon.a (mon.0) 356 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2024-02-19T21:30:15.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:14.161934+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:30:15.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:14.731468+0000 mon.c (mon.2) 7 : audit [DBG] from='client.? 172.21.15.80:0/1833469887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:30:15.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:13.916430+0000 mgr.y (mgr.14146) 122 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:15.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:14.157649+0000 mon.a (mon.0) 354 : audit [INF] from='client.? 172.21.15.80:0/1887100983' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76318cdd-5fce-4a40-95c9-300d55c34820"}]: dispatch 2024-02-19T21:30:15.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:14.161737+0000 mon.a (mon.0) 355 : audit [INF] from='client.? 172.21.15.80:0/1887100983' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76318cdd-5fce-4a40-95c9-300d55c34820"}]': finished 2024-02-19T21:30:15.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:14.161791+0000 mon.a (mon.0) 356 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2024-02-19T21:30:15.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:14.161934+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:30:15.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:14.731468+0000 mon.c (mon.2) 7 : audit [DBG] from='client.? 172.21.15.80:0/1833469887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:30:15.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:13.916430+0000 mgr.y (mgr.14146) 122 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:15.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:14.157649+0000 mon.a (mon.0) 354 : audit [INF] from='client.? 172.21.15.80:0/1887100983' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76318cdd-5fce-4a40-95c9-300d55c34820"}]: dispatch 2024-02-19T21:30:15.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:14.161737+0000 mon.a (mon.0) 355 : audit [INF] from='client.? 172.21.15.80:0/1887100983' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76318cdd-5fce-4a40-95c9-300d55c34820"}]': finished 2024-02-19T21:30:15.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:14.161791+0000 mon.a (mon.0) 356 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2024-02-19T21:30:15.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:14.161934+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:30:15.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:14.731468+0000 mon.c (mon.2) 7 : audit [DBG] from='client.? 172.21.15.80:0/1833469887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:30:17.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:15.916706+0000 mgr.y (mgr.14146) 123 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:17.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:15.916706+0000 mgr.y (mgr.14146) 123 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:17.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:15.916706+0000 mgr.y (mgr.14146) 123 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:19.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:17.916995+0000 mgr.y (mgr.14146) 124 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:19.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:17.997001+0000 osd.0 (osd.0) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:30:19.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:17.997070+0000 osd.0 (osd.0) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:30:19.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:17.916995+0000 mgr.y (mgr.14146) 124 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:19.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:17.997001+0000 osd.0 (osd.0) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:30:19.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:17.997070+0000 osd.0 (osd.0) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:30:19.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:17.916995+0000 mgr.y (mgr.14146) 124 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:19.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:17.997001+0000 osd.0 (osd.0) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:30:19.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:17.997070+0000 osd.0 (osd.0) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:30:20.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:18.977816+0000 mon.a (mon.0) 358 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-02-19T21:30:20.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:18.978193+0000 mon.a (mon.0) 359 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:30:20.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:18.977816+0000 mon.a (mon.0) 358 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-02-19T21:30:20.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:18.978193+0000 mon.a (mon.0) 359 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:30:20.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:18.977816+0000 mon.a (mon.0) 358 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-02-19T21:30:20.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:18.978193+0000 mon.a (mon.0) 359 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:30:21.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:19.917296+0000 mgr.y (mgr.14146) 125 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:21.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:20.810461+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-19T21:30:21.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:20.811156+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:21.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:19.917296+0000 mgr.y (mgr.14146) 125 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:21.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:20.810461+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-19T21:30:21.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:20.811156+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:21.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:19.917296+0000 mgr.y (mgr.14146) 125 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:21.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:20.810461+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-19T21:30:21.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:20.811156+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:22.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:30:20.811686+0000 mgr.y (mgr.14146) 126 : cephadm [INF] Deploying daemon osd.3 on smithi080 2024-02-19T21:30:22.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:30:20.811686+0000 mgr.y (mgr.14146) 126 : cephadm [INF] Deploying daemon osd.3 on smithi080 2024-02-19T21:30:22.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:30:20.811686+0000 mgr.y (mgr.14146) 126 : cephadm [INF] Deploying daemon osd.3 on smithi080 2024-02-19T21:30:23.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:21.917703+0000 mgr.y (mgr.14146) 127 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:23.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:21.917703+0000 mgr.y (mgr.14146) 127 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:23.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:21.917703+0000 mgr.y (mgr.14146) 127 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:25.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:23.918058+0000 mgr.y (mgr.14146) 128 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:25.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:23.918058+0000 mgr.y (mgr.14146) 128 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:25.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:23.918058+0000 mgr.y (mgr.14146) 128 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:27.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:25.918370+0000 mgr.y (mgr.14146) 129 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:27.603 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:26.422961+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:27.604 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:26.433905+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:30:27.604 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:25.918370+0000 mgr.y (mgr.14146) 129 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:27.604 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:26.422961+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:27.605 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:26.433905+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:30:27.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:25.918370+0000 mgr.y (mgr.14146) 129 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:27.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:26.422961+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:27.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:26.433905+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:30:29.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:27.918686+0000 mgr.y (mgr.14146) 130 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:29.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:27.918686+0000 mgr.y (mgr.14146) 130 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:29.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:27.918686+0000 mgr.y (mgr.14146) 130 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:30.365 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 3 on host 'smithi080' 2024-02-19T21:30:30.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:29.550386+0000 mon.a (mon.0) 364 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/2007978078,v1:172.21.15.80:6827/2007978078]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-19T21:30:30.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:29.609506+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:30.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:29.610199+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:30.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:29.610751+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:30:30.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:29.614700+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:30.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:30.361172+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:30.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:30.381935+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:30:30.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:29.550386+0000 mon.a (mon.0) 364 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/2007978078,v1:172.21.15.80:6827/2007978078]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-19T21:30:30.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:29.609506+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:30.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:29.610199+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:30.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:29.610751+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:30:30.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:29.614700+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:30.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:30.361172+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:30.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:30.381935+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:30:30.720 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:29.550386+0000 mon.a (mon.0) 364 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/2007978078,v1:172.21.15.80:6827/2007978078]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-19T21:30:30.720 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:29.609506+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:30.720 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:29.610199+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:30.720 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:29.610751+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:30:30.720 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:29.614700+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:30.720 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:30.361172+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:30.720 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:30.381935+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:30:31.255 DEBUG:teuthology.orchestra.run.smithi080:osd.3> sudo journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.3.service 2024-02-19T21:30:31.257 INFO:tasks.cephadm:Deploying osd.4 on smithi157 with /dev/vg_nvme/lv_4... 2024-02-19T21:30:31.257 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-19T21:30:31.289 INFO:journalctl@ceph.osd.3.smithi080.stdout:-- Logs begin at Mon 2024-02-19 21:10:15 UTC. -- 2024-02-19T21:30:31.520 INFO:journalctl@ceph.osd.3.smithi080.stdout:Feb 19 21:30:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-3[62193]: debug 2024-02-19T21:30:31.436+0000 7f1a76f1b700 -1 osd.3 0 waiting for initial osdmap 2024-02-19T21:30:31.520 INFO:journalctl@ceph.osd.3.smithi080.stdout:Feb 19 21:30:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-3[62193]: debug 2024-02-19T21:30:31.440+0000 7f1a71e94700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T21:30:31.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:29.919191+0000 mgr.y (mgr.14146) 131 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:31.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:30.433740+0000 mon.a (mon.0) 371 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/2007978078,v1:172.21.15.80:6827/2007978078]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-19T21:30:31.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:30.433806+0000 mon.a (mon.0) 372 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-02-19T21:30:31.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:30.433914+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:30:31.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:30.434334+0000 mon.a (mon.0) 374 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/2007978078,v1:172.21.15.80:6827/2007978078]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-19T21:30:31.521 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:29.919191+0000 mgr.y (mgr.14146) 131 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:31.521 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:30.433740+0000 mon.a (mon.0) 371 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/2007978078,v1:172.21.15.80:6827/2007978078]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-19T21:30:31.522 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:30.433806+0000 mon.a (mon.0) 372 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-02-19T21:30:31.522 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:30.433914+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:30:31.522 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:30.434334+0000 mon.a (mon.0) 374 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/2007978078,v1:172.21.15.80:6827/2007978078]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-19T21:30:31.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:29.919191+0000 mgr.y (mgr.14146) 131 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:31.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:30.433740+0000 mon.a (mon.0) 371 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/2007978078,v1:172.21.15.80:6827/2007978078]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-19T21:30:31.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:30.433806+0000 mon.a (mon.0) 372 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-02-19T21:30:31.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:30.433914+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:30:31.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:30.434334+0000 mon.a (mon.0) 374 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/2007978078,v1:172.21.15.80:6827/2007978078]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-19T21:30:32.679 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:31.434395+0000 mon.a (mon.0) 375 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/2007978078,v1:172.21.15.80:6827/2007978078]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-19T21:30:32.679 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:31.434461+0000 mon.a (mon.0) 376 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-02-19T21:30:32.679 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:31.434793+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:30:32.679 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:31.438716+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:30:32.681 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:31.434395+0000 mon.a (mon.0) 375 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/2007978078,v1:172.21.15.80:6827/2007978078]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-19T21:30:32.681 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:31.434461+0000 mon.a (mon.0) 376 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-02-19T21:30:32.681 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:31.434793+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:30:32.681 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:31.438716+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:30:32.682 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:31.434395+0000 mon.a (mon.0) 375 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/2007978078,v1:172.21.15.80:6827/2007978078]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-19T21:30:32.682 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:31.434461+0000 mon.a (mon.0) 376 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-02-19T21:30:32.682 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:31.434793+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:30:32.682 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:31.438716+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:30:33.468 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-19T21:30:33.468 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-19T21:30:33.468 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10+0 records in 2024-02-19T21:30:33.468 INFO:teuthology.orchestra.run.smithi157.stderr:10+0 records out 2024-02-19T21:30:33.468 INFO:teuthology.orchestra.run.smithi157.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.008166 s, 1.3 GB/s 2024-02-19T21:30:33.468 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping successful for: 2024-02-19T21:30:33.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:30.554811+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:30:33.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:30.554880+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:30:33.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:31.919472+0000 mgr.y (mgr.14146) 132 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:33.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:32.439166+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:30:33.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:32.443890+0000 mon.a (mon.0) 380 : cluster [INF] osd.3 [v2:172.21.15.80:6826/2007978078,v1:172.21.15.80:6827/2007978078] boot 2024-02-19T21:30:33.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:32.443924+0000 mon.a (mon.0) 381 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-02-19T21:30:33.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:32.444399+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:30:33.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:30.554811+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:30:33.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:30.554880+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:30:33.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:31.919472+0000 mgr.y (mgr.14146) 132 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:33.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:32.439166+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:30:33.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:32.443890+0000 mon.a (mon.0) 380 : cluster [INF] osd.3 [v2:172.21.15.80:6826/2007978078,v1:172.21.15.80:6827/2007978078] boot 2024-02-19T21:30:33.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:32.443924+0000 mon.a (mon.0) 381 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-02-19T21:30:33.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:32.444399+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:30:33.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:30.554811+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:30:33.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:30.554880+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:30:33.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:31.919472+0000 mgr.y (mgr.14146) 132 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:30:33.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:32.439166+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:30:33.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:32.443890+0000 mon.a (mon.0) 380 : cluster [INF] osd.3 [v2:172.21.15.80:6826/2007978078,v1:172.21.15.80:6827/2007978078] boot 2024-02-19T21:30:33.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:32.443924+0000 mon.a (mon.0) 381 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-02-19T21:30:33.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:32.444399+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:30:34.098 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi157:vg_nvme/lv_4 2024-02-19T21:30:34.499 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:33.449284+0000 mon.a (mon.0) 383 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-02-19T21:30:34.499 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:33.449284+0000 mon.a (mon.0) 383 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-02-19T21:30:34.775 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:33.449284+0000 mon.a (mon.0) 383 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-02-19T21:30:35.551 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:33.919997+0000 mgr.y (mgr.14146) 133 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:35.551 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:34.734489+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:35.551 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:34.735305+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:30:35.551 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:34.735802+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:30:35.551 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:34.736237+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:30:35.551 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:34.736654+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:30:35.551 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:34.740026+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:35.551 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:34.741600+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:35.551 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:34.742144+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:30:35.551 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:34.745949+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:35.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:33.919997+0000 mgr.y (mgr.14146) 133 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:35.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:34.734489+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:35.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:34.735305+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:30:35.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:34.735802+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:30:35.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:34.736237+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:30:35.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:34.736654+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:30:35.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:34.740026+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:35.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:34.741600+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:35.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:34.742144+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:30:35.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:34.745949+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:35.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:33.919997+0000 mgr.y (mgr.14146) 133 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:35.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:34.734489+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:35.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:34.735305+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:30:35.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:34.735802+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:30:35.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:34.736237+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:30:35.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:34.736654+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:30:35.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:34.740026+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:35.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:34.741600+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:35.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:34.742144+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:30:35.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:34.745949+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:36.792 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:30:34.730208+0000 mgr.y (mgr.14146) 134 : cephadm [INF] Detected new or changed devices on smithi080 2024-02-19T21:30:36.793 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:30:34.736997+0000 mgr.y (mgr.14146) 135 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 4024M 2024-02-19T21:30:36.793 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:36.296139+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:30:36.793 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:36.298432+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:30:36.793 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:36.299150+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:36.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:30:34.730208+0000 mgr.y (mgr.14146) 134 : cephadm [INF] Detected new or changed devices on smithi080 2024-02-19T21:30:36.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:30:34.736997+0000 mgr.y (mgr.14146) 135 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 4024M 2024-02-19T21:30:36.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:36.296139+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:30:36.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:36.298432+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:30:36.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:36.299150+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:36.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:30:34.730208+0000 mgr.y (mgr.14146) 134 : cephadm [INF] Detected new or changed devices on smithi080 2024-02-19T21:30:36.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:30:34.736997+0000 mgr.y (mgr.14146) 135 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 4024M 2024-02-19T21:30:36.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:36.296139+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:30:36.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:36.298432+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:30:36.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:36.299150+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:37.794 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:35.920428+0000 mgr.y (mgr.14146) 136 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:37.794 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:36.293723+0000 mgr.y (mgr.14146) 137 : audit [DBG] from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:30:37.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:35.920428+0000 mgr.y (mgr.14146) 136 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:37.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:36.293723+0000 mgr.y (mgr.14146) 137 : audit [DBG] from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:30:37.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:35.920428+0000 mgr.y (mgr.14146) 136 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:37.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:36.293723+0000 mgr.y (mgr.14146) 137 : audit [DBG] from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:30:39.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:37.920950+0000 mgr.y (mgr.14146) 138 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:39.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:38.869234+0000 mon.b (mon.1) 9 : audit [INF] from='client.? 172.21.15.157:0/4056694715' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6484964f-3391-4e1d-a56c-813f46124062"}]: dispatch 2024-02-19T21:30:39.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:38.869822+0000 mon.a (mon.0) 396 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6484964f-3391-4e1d-a56c-813f46124062"}]: dispatch 2024-02-19T21:30:39.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:38.874720+0000 mon.a (mon.0) 397 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6484964f-3391-4e1d-a56c-813f46124062"}]': finished 2024-02-19T21:30:39.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:38.874776+0000 mon.a (mon.0) 398 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2024-02-19T21:30:39.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:38.874925+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:30:39.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:39.433458+0000 mon.b (mon.1) 10 : audit [DBG] from='client.? 172.21.15.157:0/2366103116' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:30:39.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:37.920950+0000 mgr.y (mgr.14146) 138 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:39.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:38.869234+0000 mon.b (mon.1) 9 : audit [INF] from='client.? 172.21.15.157:0/4056694715' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6484964f-3391-4e1d-a56c-813f46124062"}]: dispatch 2024-02-19T21:30:39.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:38.869822+0000 mon.a (mon.0) 396 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6484964f-3391-4e1d-a56c-813f46124062"}]: dispatch 2024-02-19T21:30:39.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:38.874720+0000 mon.a (mon.0) 397 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6484964f-3391-4e1d-a56c-813f46124062"}]': finished 2024-02-19T21:30:39.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:38.874776+0000 mon.a (mon.0) 398 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2024-02-19T21:30:39.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:38.874925+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:30:39.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:39.433458+0000 mon.b (mon.1) 10 : audit [DBG] from='client.? 172.21.15.157:0/2366103116' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:30:39.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:37.920950+0000 mgr.y (mgr.14146) 138 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:39.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:38.869234+0000 mon.b (mon.1) 9 : audit [INF] from='client.? 172.21.15.157:0/4056694715' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6484964f-3391-4e1d-a56c-813f46124062"}]: dispatch 2024-02-19T21:30:39.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:38.869822+0000 mon.a (mon.0) 396 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6484964f-3391-4e1d-a56c-813f46124062"}]: dispatch 2024-02-19T21:30:39.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:38.874720+0000 mon.a (mon.0) 397 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6484964f-3391-4e1d-a56c-813f46124062"}]': finished 2024-02-19T21:30:39.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:38.874776+0000 mon.a (mon.0) 398 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2024-02-19T21:30:39.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:38.874925+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:30:39.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:39.433458+0000 mon.b (mon.1) 10 : audit [DBG] from='client.? 172.21.15.157:0/2366103116' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:30:41.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:39.921312+0000 mgr.y (mgr.14146) 139 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:41.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:39.921312+0000 mgr.y (mgr.14146) 139 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:41.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:39.921312+0000 mgr.y (mgr.14146) 139 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:43.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:41.921620+0000 mgr.y (mgr.14146) 140 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:43.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:41.921620+0000 mgr.y (mgr.14146) 140 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:43.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:41.921620+0000 mgr.y (mgr.14146) 140 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:44.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:43.008933+0000 osd.1 (osd.1) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:30:44.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:43.009031+0000 osd.1 (osd.1) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:30:44.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:43.008933+0000 osd.1 (osd.1) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:30:44.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:43.009031+0000 osd.1 (osd.1) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:30:44.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:43.008933+0000 osd.1 (osd.1) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:30:44.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:43.009031+0000 osd.1 (osd.1) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:30:45.210 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:43.922091+0000 mgr.y (mgr.14146) 141 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:45.210 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:43.983281+0000 mon.a (mon.0) 400 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-02-19T21:30:45.210 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:43.983489+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:30:45.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:43.922091+0000 mgr.y (mgr.14146) 141 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:45.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:43.983281+0000 mon.a (mon.0) 400 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-02-19T21:30:45.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:43.983489+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:30:45.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:43.922091+0000 mgr.y (mgr.14146) 141 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:45.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:43.983281+0000 mon.a (mon.0) 400 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-02-19T21:30:45.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:43.983489+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:30:46.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:45.225642+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-19T21:30:46.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:45.226420+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:46.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:30:45.227100+0000 mgr.y (mgr.14146) 142 : cephadm [INF] Deploying daemon osd.4 on smithi157 2024-02-19T21:30:46.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:45.225642+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-19T21:30:46.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:45.226420+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:46.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:30:45.227100+0000 mgr.y (mgr.14146) 142 : cephadm [INF] Deploying daemon osd.4 on smithi157 2024-02-19T21:30:46.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:45.225642+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-19T21:30:46.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:45.226420+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:46.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:30:45.227100+0000 mgr.y (mgr.14146) 142 : cephadm [INF] Deploying daemon osd.4 on smithi157 2024-02-19T21:30:47.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:45.922443+0000 mgr.y (mgr.14146) 143 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:47.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:45.922443+0000 mgr.y (mgr.14146) 143 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:47.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:45.922443+0000 mgr.y (mgr.14146) 143 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:49.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:47.922918+0000 mgr.y (mgr.14146) 144 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:49.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:47.922918+0000 mgr.y (mgr.14146) 144 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:49.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:47.922918+0000 mgr.y (mgr.14146) 144 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:51.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:49.923334+0000 mgr.y (mgr.14146) 145 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:51.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:50.428850+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:51.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:50.451883+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:30:51.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:49.923334+0000 mgr.y (mgr.14146) 145 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:51.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:50.428850+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:51.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:50.451883+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:30:51.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:49.923334+0000 mgr.y (mgr.14146) 145 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:51.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:50.428850+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:51.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:50.451883+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:30:53.497 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:51.923703+0000 mgr.y (mgr.14146) 146 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:53.497 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:52.202003+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:53.497 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:52.202889+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:53.497 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:52.203861+0000 mon.a (mon.0) 408 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:30:53.497 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:52.211585+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:53.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:51.923703+0000 mgr.y (mgr.14146) 146 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:53.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:52.202003+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:53.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:52.202889+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:53.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:52.203861+0000 mon.a (mon.0) 408 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:30:53.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:52.211585+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:53.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:51.923703+0000 mgr.y (mgr.14146) 146 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:53.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:52.202003+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:53.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:52.202889+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:53.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:52.203861+0000 mon.a (mon.0) 408 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:30:53.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:52.211585+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:53.960 INFO:teuthology.orchestra.run.smithi157.stdout:Created osd(s) 4 on host 'smithi157' 2024-02-19T21:30:54.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:53.497091+0000 mon.b (mon.1) 11 : audit [INF] from='osd.4 [v2:172.21.15.157:6800/1922002860,v1:172.21.15.157:6801/1922002860]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-19T21:30:54.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:53.497375+0000 mon.a (mon.0) 410 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-19T21:30:54.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:53.955465+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:54.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:53.981962+0000 mon.a (mon.0) 412 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:30:54.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:53.497091+0000 mon.b (mon.1) 11 : audit [INF] from='osd.4 [v2:172.21.15.157:6800/1922002860,v1:172.21.15.157:6801/1922002860]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-19T21:30:54.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:53.497375+0000 mon.a (mon.0) 410 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-19T21:30:54.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:53.955465+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:54.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:53.981962+0000 mon.a (mon.0) 412 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:30:54.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:53.497091+0000 mon.b (mon.1) 11 : audit [INF] from='osd.4 [v2:172.21.15.157:6800/1922002860,v1:172.21.15.157:6801/1922002860]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-19T21:30:54.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:53.497375+0000 mon.a (mon.0) 410 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-19T21:30:54.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:53.955465+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:54.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:53.981962+0000 mon.a (mon.0) 412 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:30:54.624 DEBUG:teuthology.orchestra.run.smithi157:osd.4> sudo journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.4.service 2024-02-19T21:30:54.626 INFO:tasks.cephadm:Deploying osd.5 on smithi157 with /dev/vg_nvme/lv_3... 2024-02-19T21:30:54.627 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-19T21:30:54.657 INFO:journalctl@ceph.osd.4.smithi157.stdout:-- Logs begin at Mon 2024-02-19 21:08:46 UTC. -- 2024-02-19T21:30:55.560 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 19 21:30:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-4[43854]: debug 2024-02-19T21:30:55.218+0000 7f778b89a700 -1 osd.4 0 waiting for initial osdmap 2024-02-19T21:30:55.560 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 19 21:30:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-4[43854]: debug 2024-02-19T21:30:55.222+0000 7f778480f700 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T21:30:55.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:53.924179+0000 mgr.y (mgr.14146) 147 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:55.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:54.209298+0000 mon.a (mon.0) 413 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-19T21:30:55.561 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:54.209359+0000 mon.a (mon.0) 414 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-02-19T21:30:55.561 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:54.209492+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:30:55.561 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:54.210002+0000 mon.b (mon.1) 12 : audit [INF] from='osd.4 [v2:172.21.15.157:6800/1922002860,v1:172.21.15.157:6801/1922002860]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-19T21:30:55.561 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:54.210280+0000 mon.a (mon.0) 416 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-19T21:30:55.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:53.924179+0000 mgr.y (mgr.14146) 147 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:55.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:54.209298+0000 mon.a (mon.0) 413 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-19T21:30:55.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:54.209359+0000 mon.a (mon.0) 414 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-02-19T21:30:55.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:54.209492+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:30:55.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:54.210002+0000 mon.b (mon.1) 12 : audit [INF] from='osd.4 [v2:172.21.15.157:6800/1922002860,v1:172.21.15.157:6801/1922002860]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-19T21:30:55.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:54.210280+0000 mon.a (mon.0) 416 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-19T21:30:55.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:53.924179+0000 mgr.y (mgr.14146) 147 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:55.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:54.209298+0000 mon.a (mon.0) 413 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-19T21:30:55.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:54.209359+0000 mon.a (mon.0) 414 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-02-19T21:30:55.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:54.209492+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:30:55.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:54.210002+0000 mon.b (mon.1) 12 : audit [INF] from='osd.4 [v2:172.21.15.157:6800/1922002860,v1:172.21.15.157:6801/1922002860]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-19T21:30:55.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:54.210280+0000 mon.a (mon.0) 416 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-19T21:30:56.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:55.213328+0000 mon.a (mon.0) 417 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-02-19T21:30:56.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:55.213409+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e31: 5 total, 4 up, 5 in 2024-02-19T21:30:56.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:55.213925+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:30:56.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:55.219886+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:30:56.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:56.217711+0000 mon.a (mon.0) 421 : cluster [INF] osd.4 [v2:172.21.15.157:6800/1922002860,v1:172.21.15.157:6801/1922002860] boot 2024-02-19T21:30:56.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:55.213328+0000 mon.a (mon.0) 417 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-02-19T21:30:56.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:55.213409+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e31: 5 total, 4 up, 5 in 2024-02-19T21:30:56.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:55.213925+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:30:56.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:55.219886+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:30:56.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:56.217711+0000 mon.a (mon.0) 421 : cluster [INF] osd.4 [v2:172.21.15.157:6800/1922002860,v1:172.21.15.157:6801/1922002860] boot 2024-02-19T21:30:56.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:55.213328+0000 mon.a (mon.0) 417 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-02-19T21:30:56.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:55.213409+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e31: 5 total, 4 up, 5 in 2024-02-19T21:30:56.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:55.213925+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:30:56.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:55.219886+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:30:56.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:56.217711+0000 mon.a (mon.0) 421 : cluster [INF] osd.4 [v2:172.21.15.157:6800/1922002860,v1:172.21.15.157:6801/1922002860] boot 2024-02-19T21:30:57.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:54.463643+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:30:57.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:54.463698+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:30:57.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:55.924530+0000 mgr.y (mgr.14146) 148 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:57.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:56.217758+0000 mon.a (mon.0) 422 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-02-19T21:30:57.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:56.217947+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:30:57.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:57.215629+0000 mon.a (mon.0) 424 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-02-19T21:30:57.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:54.463643+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:30:57.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:54.463698+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:30:57.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:55.924530+0000 mgr.y (mgr.14146) 148 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:57.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:56.217758+0000 mon.a (mon.0) 422 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-02-19T21:30:57.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:56.217947+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:30:57.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:57.215629+0000 mon.a (mon.0) 424 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-02-19T21:30:57.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:54.463643+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:30:57.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:54.463698+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:30:57.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:55.924530+0000 mgr.y (mgr.14146) 148 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:30:57.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:56.217758+0000 mon.a (mon.0) 422 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-02-19T21:30:57.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:56.217947+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:30:57.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:57.215629+0000 mon.a (mon.0) 424 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-02-19T21:30:59.065 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-19T21:30:59.065 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-19T21:30:59.065 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10+0 records in 2024-02-19T21:30:59.065 INFO:teuthology.orchestra.run.smithi157.stderr:10+0 records out 2024-02-19T21:30:59.065 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0082481 s, 1.3 GB/s 2024-02-19T21:30:59.065 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping successful for: 2024-02-19T21:30:59.512 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:57.925016+0000 mgr.y (mgr.14146) 149 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:30:59.512 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:58.215688+0000 mon.a (mon.0) 425 : cluster [DBG] osdmap e34: 5 total, 5 up, 5 in 2024-02-19T21:30:59.512 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:30:58.310337+0000 mgr.y (mgr.14146) 150 : cephadm [INF] Detected new or changed devices on smithi157 2024-02-19T21:30:59.513 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:58.317667+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:59.513 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:58.318860+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:30:59.513 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:30:58.319570+0000 mgr.y (mgr.14146) 151 : cephadm [INF] Adjusting osd_memory_target on smithi157 to 17122M 2024-02-19T21:30:59.513 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:58.324063+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:59.513 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:58.325169+0000 mon.a (mon.0) 429 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:59.513 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:58.325968+0000 mon.a (mon.0) 430 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:30:59.513 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:30:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:30:58.333035+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:59.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:57.925016+0000 mgr.y (mgr.14146) 149 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:30:59.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:58.215688+0000 mon.a (mon.0) 425 : cluster [DBG] osdmap e34: 5 total, 5 up, 5 in 2024-02-19T21:30:59.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:30:58.310337+0000 mgr.y (mgr.14146) 150 : cephadm [INF] Detected new or changed devices on smithi157 2024-02-19T21:30:59.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:58.317667+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:59.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:58.318860+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:30:59.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:30:58.319570+0000 mgr.y (mgr.14146) 151 : cephadm [INF] Adjusting osd_memory_target on smithi157 to 17122M 2024-02-19T21:30:59.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:58.324063+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:59.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:58.325169+0000 mon.a (mon.0) 429 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:59.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:58.325968+0000 mon.a (mon.0) 430 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:30:59.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:30:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:30:58.333035+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:59.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:57.925016+0000 mgr.y (mgr.14146) 149 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:30:59.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:58.215688+0000 mon.a (mon.0) 425 : cluster [DBG] osdmap e34: 5 total, 5 up, 5 in 2024-02-19T21:30:59.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:30:58.310337+0000 mgr.y (mgr.14146) 150 : cephadm [INF] Detected new or changed devices on smithi157 2024-02-19T21:30:59.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:58.317667+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:59.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:58.318860+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:30:59.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:30:58.319570+0000 mgr.y (mgr.14146) 151 : cephadm [INF] Adjusting osd_memory_target on smithi157 to 17122M 2024-02-19T21:30:59.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:58.324063+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:59.602 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:58.325169+0000 mon.a (mon.0) 429 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:30:59.602 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:58.325968+0000 mon.a (mon.0) 430 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:30:59.602 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:30:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:30:58.333035+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:30:59.827 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi157:vg_nvme/lv_3 2024-02-19T21:31:01.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:30:59.925523+0000 mgr.y (mgr.14146) 152 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:01.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:30:59.925523+0000 mgr.y (mgr.14146) 152 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:01.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:30:59.925523+0000 mgr.y (mgr.14146) 152 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:03.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:01.925876+0000 mgr.y (mgr.14146) 153 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:03.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:01.985404+0000 mgr.y (mgr.14146) 154 : audit [DBG] from='client.24214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:31:03.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:01.987544+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:31:03.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:01.989925+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:31:03.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:01.990702+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:31:03.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:01.925876+0000 mgr.y (mgr.14146) 153 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:03.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:01.985404+0000 mgr.y (mgr.14146) 154 : audit [DBG] from='client.24214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:31:03.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:01.987544+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:31:03.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:01.989925+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:31:03.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:01.990702+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:31:03.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:01.925876+0000 mgr.y (mgr.14146) 153 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:03.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:01.985404+0000 mgr.y (mgr.14146) 154 : audit [DBG] from='client.24214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:31:03.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:01.987544+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:31:03.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:01.989925+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:31:03.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:01.990702+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:31:05.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:03.926351+0000 mgr.y (mgr.14146) 155 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:05.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:04.669086+0000 mon.b (mon.1) 13 : audit [INF] from='client.? 172.21.15.157:0/4105109319' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c7e0309-8c3b-40b9-99d9-96620e52742f"}]: dispatch 2024-02-19T21:31:05.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:04.669645+0000 mon.a (mon.0) 435 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c7e0309-8c3b-40b9-99d9-96620e52742f"}]: dispatch 2024-02-19T21:31:05.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:04.674446+0000 mon.a (mon.0) 436 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8c7e0309-8c3b-40b9-99d9-96620e52742f"}]': finished 2024-02-19T21:31:05.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:04.674500+0000 mon.a (mon.0) 437 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-02-19T21:31:05.311 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:04.674634+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:31:05.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:03.926351+0000 mgr.y (mgr.14146) 155 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:05.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:04.669086+0000 mon.b (mon.1) 13 : audit [INF] from='client.? 172.21.15.157:0/4105109319' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c7e0309-8c3b-40b9-99d9-96620e52742f"}]: dispatch 2024-02-19T21:31:05.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:04.669645+0000 mon.a (mon.0) 435 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c7e0309-8c3b-40b9-99d9-96620e52742f"}]: dispatch 2024-02-19T21:31:05.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:04.674446+0000 mon.a (mon.0) 436 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8c7e0309-8c3b-40b9-99d9-96620e52742f"}]': finished 2024-02-19T21:31:05.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:04.674500+0000 mon.a (mon.0) 437 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-02-19T21:31:05.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:04.674634+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:31:05.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:03.926351+0000 mgr.y (mgr.14146) 155 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:05.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:04.669086+0000 mon.b (mon.1) 13 : audit [INF] from='client.? 172.21.15.157:0/4105109319' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c7e0309-8c3b-40b9-99d9-96620e52742f"}]: dispatch 2024-02-19T21:31:05.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:04.669645+0000 mon.a (mon.0) 435 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c7e0309-8c3b-40b9-99d9-96620e52742f"}]: dispatch 2024-02-19T21:31:05.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:04.674446+0000 mon.a (mon.0) 436 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8c7e0309-8c3b-40b9-99d9-96620e52742f"}]': finished 2024-02-19T21:31:05.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:04.674500+0000 mon.a (mon.0) 437 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-02-19T21:31:05.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:04.674634+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:31:06.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:05.298416+0000 mon.b (mon.1) 14 : audit [DBG] from='client.? 172.21.15.157:0/320525749' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:31:06.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:05.298416+0000 mon.b (mon.1) 14 : audit [DBG] from='client.? 172.21.15.157:0/320525749' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:31:06.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:05.298416+0000 mon.b (mon.1) 14 : audit [DBG] from='client.? 172.21.15.157:0/320525749' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:31:07.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:05.926793+0000 mgr.y (mgr.14146) 156 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:07.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:05.926793+0000 mgr.y (mgr.14146) 156 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:07.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:05.926793+0000 mgr.y (mgr.14146) 156 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:09.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:07.927295+0000 mgr.y (mgr.14146) 157 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:09.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:07.927295+0000 mgr.y (mgr.14146) 157 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:09.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:07.927295+0000 mgr.y (mgr.14146) 157 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:11.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:09.927698+0000 mgr.y (mgr.14146) 158 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:11.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:09.927698+0000 mgr.y (mgr.14146) 158 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:11.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:09.927698+0000 mgr.y (mgr.14146) 158 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:12.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:11.130389+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-19T21:31:12.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:11.131209+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:31:12.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:31:11.131862+0000 mgr.y (mgr.14146) 159 : cephadm [INF] Deploying daemon osd.5 on smithi157 2024-02-19T21:31:12.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:11.130389+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-19T21:31:12.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:11.131209+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:31:12.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:31:11.131862+0000 mgr.y (mgr.14146) 159 : cephadm [INF] Deploying daemon osd.5 on smithi157 2024-02-19T21:31:12.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:11.130389+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-19T21:31:12.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:11.131209+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:31:12.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:31:11.131862+0000 mgr.y (mgr.14146) 159 : cephadm [INF] Deploying daemon osd.5 on smithi157 2024-02-19T21:31:13.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:11.928203+0000 mgr.y (mgr.14146) 160 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:13.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:11.928203+0000 mgr.y (mgr.14146) 160 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:13.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:11.928203+0000 mgr.y (mgr.14146) 160 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:15.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:13.928765+0000 mgr.y (mgr.14146) 161 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:15.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:13.928765+0000 mgr.y (mgr.14146) 161 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:15.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:13.928765+0000 mgr.y (mgr.14146) 161 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:17.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:15.929313+0000 mgr.y (mgr.14146) 162 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:17.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:16.691774+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:17.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:16.696211+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:31:17.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:15.929313+0000 mgr.y (mgr.14146) 162 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:17.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:16.691774+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:17.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:16.696211+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:31:17.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:15.929313+0000 mgr.y (mgr.14146) 162 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:17.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:16.691774+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:17.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:16.696211+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:31:19.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:17.929743+0000 mgr.y (mgr.14146) 163 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:19.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:17.929743+0000 mgr.y (mgr.14146) 163 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:19.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:17.929743+0000 mgr.y (mgr.14146) 163 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:20.155 INFO:teuthology.orchestra.run.smithi157.stdout:Created osd(s) 5 on host 'smithi157' 2024-02-19T21:31:20.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:18.912655+0000 osd.1 (osd.1) 5 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:31:20.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:18.915698+0000 osd.1 (osd.1) 6 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:31:20.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:19.363946+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:20.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:19.364764+0000 mon.a (mon.0) 444 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:31:20.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:19.365589+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:31:20.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:19.370727+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:20.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:19.805568+0000 mon.b (mon.1) 15 : audit [INF] from='osd.5 [v2:172.21.15.157:6808/960889603,v1:172.21.15.157:6809/960889603]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-19T21:31:20.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:19.805981+0000 mon.a (mon.0) 447 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-19T21:31:20.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:20.151507+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:20.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:20.188781+0000 mon.a (mon.0) 449 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:31:20.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:18.912655+0000 osd.1 (osd.1) 5 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:31:20.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:18.915698+0000 osd.1 (osd.1) 6 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:31:20.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:19.363946+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:20.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:19.364764+0000 mon.a (mon.0) 444 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:31:20.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:19.365589+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:31:20.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:19.370727+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:20.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:19.805568+0000 mon.b (mon.1) 15 : audit [INF] from='osd.5 [v2:172.21.15.157:6808/960889603,v1:172.21.15.157:6809/960889603]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-19T21:31:20.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:19.805981+0000 mon.a (mon.0) 447 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-19T21:31:20.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:20.151507+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:20.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:20.188781+0000 mon.a (mon.0) 449 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:31:20.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:18.912655+0000 osd.1 (osd.1) 5 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:31:20.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:18.915698+0000 osd.1 (osd.1) 6 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:31:20.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:19.363946+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:20.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:19.364764+0000 mon.a (mon.0) 444 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:31:20.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:19.365589+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:31:20.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:19.370727+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:20.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:19.805568+0000 mon.b (mon.1) 15 : audit [INF] from='osd.5 [v2:172.21.15.157:6808/960889603,v1:172.21.15.157:6809/960889603]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-19T21:31:20.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:19.805981+0000 mon.a (mon.0) 447 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-19T21:31:20.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:20.151507+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:20.852 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:20.188781+0000 mon.a (mon.0) 449 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:31:20.975 DEBUG:teuthology.orchestra.run.smithi157:osd.5> sudo journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.5.service 2024-02-19T21:31:20.977 INFO:tasks.cephadm:Deploying osd.6 on smithi157 with /dev/vg_nvme/lv_2... 2024-02-19T21:31:20.978 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-19T21:31:21.010 INFO:journalctl@ceph.osd.5.smithi157.stdout:-- Logs begin at Mon 2024-02-19 21:08:46 UTC. -- 2024-02-19T21:31:21.516 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:19.930214+0000 mgr.y (mgr.14146) 164 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:21.516 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:20.808333+0000 mon.a (mon.0) 450 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-19T21:31:21.516 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:20.808456+0000 mon.a (mon.0) 451 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-02-19T21:31:21.516 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:20.808586+0000 mon.a (mon.0) 452 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:31:21.516 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:20.809061+0000 mon.b (mon.1) 16 : audit [INF] from='osd.5 [v2:172.21.15.157:6808/960889603,v1:172.21.15.157:6809/960889603]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-19T21:31:21.516 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:20.809308+0000 mon.a (mon.0) 453 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-19T21:31:21.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:19.930214+0000 mgr.y (mgr.14146) 164 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:21.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:20.808333+0000 mon.a (mon.0) 450 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-19T21:31:21.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:20.808456+0000 mon.a (mon.0) 451 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-02-19T21:31:21.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:20.808586+0000 mon.a (mon.0) 452 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:31:21.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:20.809061+0000 mon.b (mon.1) 16 : audit [INF] from='osd.5 [v2:172.21.15.157:6808/960889603,v1:172.21.15.157:6809/960889603]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-19T21:31:21.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:20.809308+0000 mon.a (mon.0) 453 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-19T21:31:21.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:19.930214+0000 mgr.y (mgr.14146) 164 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:21.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:20.808333+0000 mon.a (mon.0) 450 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-19T21:31:21.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:20.808456+0000 mon.a (mon.0) 451 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-02-19T21:31:21.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:20.808586+0000 mon.a (mon.0) 452 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:31:21.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:20.809061+0000 mon.b (mon.1) 16 : audit [INF] from='osd.5 [v2:172.21.15.157:6808/960889603,v1:172.21.15.157:6809/960889603]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-19T21:31:21.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:20.809308+0000 mon.a (mon.0) 453 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-19T21:31:22.297 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 21:31:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T21:31:21.813+0000 7f32d0904700 -1 osd.5 0 waiting for initial osdmap 2024-02-19T21:31:22.297 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 21:31:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T21:31:21.818+0000 7f32cb07c700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T21:31:23.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:20.762369+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:31:23.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:20.762414+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:31:23.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:21.810356+0000 mon.a (mon.0) 454 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-02-19T21:31:23.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:21.810468+0000 mon.a (mon.0) 455 : cluster [DBG] osdmap e37: 6 total, 5 up, 6 in 2024-02-19T21:31:23.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:21.810635+0000 mon.a (mon.0) 456 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:31:23.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:21.813514+0000 mon.a (mon.0) 457 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:31:23.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:21.930521+0000 mgr.y (mgr.14146) 165 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:23.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:20.762369+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:31:23.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:20.762414+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:31:23.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:21.810356+0000 mon.a (mon.0) 454 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-02-19T21:31:23.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:21.810468+0000 mon.a (mon.0) 455 : cluster [DBG] osdmap e37: 6 total, 5 up, 6 in 2024-02-19T21:31:23.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:21.810635+0000 mon.a (mon.0) 456 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:31:23.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:21.813514+0000 mon.a (mon.0) 457 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:31:23.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:21.930521+0000 mgr.y (mgr.14146) 165 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:23.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:20.762369+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:31:23.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:20.762414+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:31:23.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:21.810356+0000 mon.a (mon.0) 454 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-02-19T21:31:23.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:21.810468+0000 mon.a (mon.0) 455 : cluster [DBG] osdmap e37: 6 total, 5 up, 6 in 2024-02-19T21:31:23.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:21.810635+0000 mon.a (mon.0) 456 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:31:23.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:21.813514+0000 mon.a (mon.0) 457 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:31:23.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:21.930521+0000 mgr.y (mgr.14146) 165 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:31:24.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:22.813554+0000 mon.a (mon.0) 458 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:31:24.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:22.821810+0000 mon.a (mon.0) 459 : cluster [INF] osd.5 [v2:172.21.15.157:6808/960889603,v1:172.21.15.157:6809/960889603] boot 2024-02-19T21:31:24.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:22.821880+0000 mon.a (mon.0) 460 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-02-19T21:31:24.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:22.822390+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:31:24.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:22.813554+0000 mon.a (mon.0) 458 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:31:24.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:22.821810+0000 mon.a (mon.0) 459 : cluster [INF] osd.5 [v2:172.21.15.157:6808/960889603,v1:172.21.15.157:6809/960889603] boot 2024-02-19T21:31:24.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:22.821880+0000 mon.a (mon.0) 460 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-02-19T21:31:24.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:22.822390+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:31:24.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:22.813554+0000 mon.a (mon.0) 458 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:31:24.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:22.821810+0000 mon.a (mon.0) 459 : cluster [INF] osd.5 [v2:172.21.15.157:6808/960889603,v1:172.21.15.157:6809/960889603] boot 2024-02-19T21:31:24.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:22.821880+0000 mon.a (mon.0) 460 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-02-19T21:31:24.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:22.822390+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:31:24.323 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-19T21:31:24.323 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-19T21:31:24.323 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10+0 records in 2024-02-19T21:31:24.323 INFO:teuthology.orchestra.run.smithi157.stderr:10+0 records out 2024-02-19T21:31:24.323 INFO:teuthology.orchestra.run.smithi157.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00813595 s, 1.3 GB/s 2024-02-19T21:31:24.323 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping successful for: 2024-02-19T21:31:25.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:23.825526+0000 mon.a (mon.0) 462 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-02-19T21:31:25.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:23.930892+0000 mgr.y (mgr.14146) 166 : cluster [DBG] pgmap v153: 1 pgs: 1 peering; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:25.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:24.821781+0000 mon.a (mon.0) 463 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2024-02-19T21:31:25.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:23.825526+0000 mon.a (mon.0) 462 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-02-19T21:31:25.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:23.930892+0000 mgr.y (mgr.14146) 166 : cluster [DBG] pgmap v153: 1 pgs: 1 peering; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:25.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:24.821781+0000 mon.a (mon.0) 463 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2024-02-19T21:31:25.285 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:23.825526+0000 mon.a (mon.0) 462 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-02-19T21:31:25.285 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:23.930892+0000 mgr.y (mgr.14146) 166 : cluster [DBG] pgmap v153: 1 pgs: 1 peering; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:25.285 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:24.821781+0000 mon.a (mon.0) 463 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2024-02-19T21:31:25.772 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi157:vg_nvme/lv_2 2024-02-19T21:31:27.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:31:25.855032+0000 mgr.y (mgr.14146) 167 : cephadm [INF] Detected new or changed devices on smithi157 2024-02-19T21:31:27.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:25.860368+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:27.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:25.861313+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:31:27.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:25.862003+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:31:27.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:31:25.862483+0000 mgr.y (mgr.14146) 168 : cephadm [INF] Adjusting osd_memory_target on smithi157 to 8561M 2024-02-19T21:31:27.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:25.866606+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:27.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:25.867429+0000 mon.a (mon.0) 468 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:31:27.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:25.868157+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:31:27.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:25.872864+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:27.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:25.931168+0000 mgr.y (mgr.14146) 169 : cluster [DBG] pgmap v155: 1 pgs: 1 peering; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:27.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:31:25.855032+0000 mgr.y (mgr.14146) 167 : cephadm [INF] Detected new or changed devices on smithi157 2024-02-19T21:31:27.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:25.860368+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:27.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:25.861313+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:31:27.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:25.862003+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:31:27.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:31:25.862483+0000 mgr.y (mgr.14146) 168 : cephadm [INF] Adjusting osd_memory_target on smithi157 to 8561M 2024-02-19T21:31:27.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:25.866606+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:27.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:25.867429+0000 mon.a (mon.0) 468 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:31:27.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:25.868157+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:31:27.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:25.872864+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:27.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:25.931168+0000 mgr.y (mgr.14146) 169 : cluster [DBG] pgmap v155: 1 pgs: 1 peering; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:27.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:31:25.855032+0000 mgr.y (mgr.14146) 167 : cephadm [INF] Detected new or changed devices on smithi157 2024-02-19T21:31:27.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:25.860368+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:27.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:25.861313+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:31:27.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:25.862003+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:31:27.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:31:25.862483+0000 mgr.y (mgr.14146) 168 : cephadm [INF] Adjusting osd_memory_target on smithi157 to 8561M 2024-02-19T21:31:27.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:25.866606+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:27.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:25.867429+0000 mon.a (mon.0) 468 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:31:27.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:25.868157+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:31:27.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:25.872864+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:27.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:25.931168+0000 mgr.y (mgr.14146) 169 : cluster [DBG] pgmap v155: 1 pgs: 1 peering; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:29.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:27.931414+0000 mgr.y (mgr.14146) 170 : cluster [DBG] pgmap v156: 1 pgs: 1 peering; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:29.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:28.187851+0000 mgr.y (mgr.14146) 171 : audit [DBG] from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:31:29.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:28.190116+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:31:29.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:28.192440+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:31:29.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:28.193125+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:31:29.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:27.931414+0000 mgr.y (mgr.14146) 170 : cluster [DBG] pgmap v156: 1 pgs: 1 peering; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:29.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:28.187851+0000 mgr.y (mgr.14146) 171 : audit [DBG] from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:31:29.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:28.190116+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:31:29.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:28.192440+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:31:29.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:28.193125+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:31:29.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:27.931414+0000 mgr.y (mgr.14146) 170 : cluster [DBG] pgmap v156: 1 pgs: 1 peering; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:29.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:28.187851+0000 mgr.y (mgr.14146) 171 : audit [DBG] from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:31:29.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:28.190116+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:31:29.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:28.192440+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:31:29.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:28.193125+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:31:31.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:29.931757+0000 mgr.y (mgr.14146) 172 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:31.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:30.729276+0000 mon.b (mon.1) 17 : audit [INF] from='client.? 172.21.15.157:0/2495208233' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5b7d44a3-197d-482c-bf9e-de5e9013a851"}]: dispatch 2024-02-19T21:31:31.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:30.729704+0000 mon.a (mon.0) 474 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5b7d44a3-197d-482c-bf9e-de5e9013a851"}]: dispatch 2024-02-19T21:31:31.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:30.739886+0000 mon.a (mon.0) 475 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5b7d44a3-197d-482c-bf9e-de5e9013a851"}]': finished 2024-02-19T21:31:31.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:30.739985+0000 mon.a (mon.0) 476 : cluster [DBG] osdmap e41: 7 total, 6 up, 7 in 2024-02-19T21:31:31.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:30.740153+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:31:31.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:29.931757+0000 mgr.y (mgr.14146) 172 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:31.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:30.729276+0000 mon.b (mon.1) 17 : audit [INF] from='client.? 172.21.15.157:0/2495208233' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5b7d44a3-197d-482c-bf9e-de5e9013a851"}]: dispatch 2024-02-19T21:31:31.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:30.729704+0000 mon.a (mon.0) 474 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5b7d44a3-197d-482c-bf9e-de5e9013a851"}]: dispatch 2024-02-19T21:31:31.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:30.739886+0000 mon.a (mon.0) 475 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5b7d44a3-197d-482c-bf9e-de5e9013a851"}]': finished 2024-02-19T21:31:31.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:30.739985+0000 mon.a (mon.0) 476 : cluster [DBG] osdmap e41: 7 total, 6 up, 7 in 2024-02-19T21:31:31.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:30.740153+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:31:31.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:29.931757+0000 mgr.y (mgr.14146) 172 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:31.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:30.729276+0000 mon.b (mon.1) 17 : audit [INF] from='client.? 172.21.15.157:0/2495208233' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5b7d44a3-197d-482c-bf9e-de5e9013a851"}]: dispatch 2024-02-19T21:31:31.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:30.729704+0000 mon.a (mon.0) 474 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5b7d44a3-197d-482c-bf9e-de5e9013a851"}]: dispatch 2024-02-19T21:31:31.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:30.739886+0000 mon.a (mon.0) 475 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5b7d44a3-197d-482c-bf9e-de5e9013a851"}]': finished 2024-02-19T21:31:31.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:30.739985+0000 mon.a (mon.0) 476 : cluster [DBG] osdmap e41: 7 total, 6 up, 7 in 2024-02-19T21:31:31.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:30.740153+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:31:32.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:31.339747+0000 mon.b (mon.1) 18 : audit [DBG] from='client.? 172.21.15.157:0/1976597458' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:31:32.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:31.339747+0000 mon.b (mon.1) 18 : audit [DBG] from='client.? 172.21.15.157:0/1976597458' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:31:32.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:31.339747+0000 mon.b (mon.1) 18 : audit [DBG] from='client.? 172.21.15.157:0/1976597458' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:31:33.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:31.932057+0000 mgr.y (mgr.14146) 173 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:33.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:31.939887+0000 osd.0 (osd.0) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:31:33.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:31.939944+0000 osd.0 (osd.0) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:31:33.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:31.932057+0000 mgr.y (mgr.14146) 173 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:33.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:31.939887+0000 osd.0 (osd.0) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:31:33.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:31.939944+0000 osd.0 (osd.0) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:31:33.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:31.932057+0000 mgr.y (mgr.14146) 173 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:33.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:31.939887+0000 osd.0 (osd.0) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:31:33.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:31.939944+0000 osd.0 (osd.0) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:31:33.932 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:32.817414+0000 mon.a (mon.0) 478 : cluster [DBG] osdmap e42: 7 total, 6 up, 7 in 2024-02-19T21:31:33.932 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:32.817772+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:31:34.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:32.817414+0000 mon.a (mon.0) 478 : cluster [DBG] osdmap e42: 7 total, 6 up, 7 in 2024-02-19T21:31:34.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:32.817772+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:31:34.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:32.817414+0000 mon.a (mon.0) 478 : cluster [DBG] osdmap e42: 7 total, 6 up, 7 in 2024-02-19T21:31:34.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:32.817772+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:31:34.997 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:33.932452+0000 mgr.y (mgr.14146) 174 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:34.997 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:34.009713+0000 osd.2 (osd.2) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:31:34.997 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:34.009803+0000 osd.2 (osd.2) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:31:35.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:33.932452+0000 mgr.y (mgr.14146) 174 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:35.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:34.009713+0000 osd.2 (osd.2) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:31:35.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:34.009803+0000 osd.2 (osd.2) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:31:35.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:33.932452+0000 mgr.y (mgr.14146) 174 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:35.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:34.009713+0000 osd.2 (osd.2) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:31:35.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:34.009803+0000 osd.2 (osd.2) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:31:35.943 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:34.823970+0000 mon.a (mon.0) 480 : cluster [DBG] osdmap e43: 7 total, 6 up, 7 in 2024-02-19T21:31:35.943 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:34.824147+0000 mon.a (mon.0) 481 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:31:35.943 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:35.463667+0000 osd.3 (osd.3) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:31:35.943 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:35.463731+0000 osd.3 (osd.3) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:31:36.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:34.823970+0000 mon.a (mon.0) 480 : cluster [DBG] osdmap e43: 7 total, 6 up, 7 in 2024-02-19T21:31:36.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:34.824147+0000 mon.a (mon.0) 481 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:31:36.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:35.463667+0000 osd.3 (osd.3) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:31:36.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:35.463731+0000 osd.3 (osd.3) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:31:36.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:34.823970+0000 mon.a (mon.0) 480 : cluster [DBG] osdmap e43: 7 total, 6 up, 7 in 2024-02-19T21:31:36.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:34.824147+0000 mon.a (mon.0) 481 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:31:36.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:35.463667+0000 osd.3 (osd.3) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:31:36.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:35.463731+0000 osd.3 (osd.3) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:31:37.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:35.829759+0000 mon.a (mon.0) 482 : cluster [DBG] osdmap e44: 7 total, 6 up, 7 in 2024-02-19T21:31:37.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:35.829905+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:31:37.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:35.932827+0000 mgr.y (mgr.14146) 175 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:37.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:35.829759+0000 mon.a (mon.0) 482 : cluster [DBG] osdmap e44: 7 total, 6 up, 7 in 2024-02-19T21:31:37.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:35.829905+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:31:37.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:35.932827+0000 mgr.y (mgr.14146) 175 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:37.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:35.829759+0000 mon.a (mon.0) 482 : cluster [DBG] osdmap e44: 7 total, 6 up, 7 in 2024-02-19T21:31:37.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:35.829905+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:31:37.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:35.932827+0000 mgr.y (mgr.14146) 175 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:37.972 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:37.141545+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-19T21:31:37.972 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:37.142371+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:31:37.972 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:31:37.143014+0000 mgr.y (mgr.14146) 176 : cephadm [INF] Deploying daemon osd.6 on smithi157 2024-02-19T21:31:38.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:37.141545+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-19T21:31:38.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:37.142371+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:31:38.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:31:37.143014+0000 mgr.y (mgr.14146) 176 : cephadm [INF] Deploying daemon osd.6 on smithi157 2024-02-19T21:31:38.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:37.141545+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-19T21:31:38.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:37.142371+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:31:38.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:31:37.143014+0000 mgr.y (mgr.14146) 176 : cephadm [INF] Deploying daemon osd.6 on smithi157 2024-02-19T21:31:39.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:37.933346+0000 mgr.y (mgr.14146) 177 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:39.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:37.933346+0000 mgr.y (mgr.14146) 177 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:39.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:37.933346+0000 mgr.y (mgr.14146) 177 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:41.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:39.933759+0000 mgr.y (mgr.14146) 178 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:41.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:39.933759+0000 mgr.y (mgr.14146) 178 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:41.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:39.933759+0000 mgr.y (mgr.14146) 178 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:43.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:41.934174+0000 mgr.y (mgr.14146) 179 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:43.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:42.637385+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:43.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:42.681020+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:31:43.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:41.934174+0000 mgr.y (mgr.14146) 179 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:43.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:42.637385+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:43.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:42.681020+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:31:43.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:41.934174+0000 mgr.y (mgr.14146) 179 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:43.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:42.637385+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:43.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:42.681020+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:31:45.260 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:43.934481+0000 mgr.y (mgr.14146) 180 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:45.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:43.934481+0000 mgr.y (mgr.14146) 180 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:45.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:43.934481+0000 mgr.y (mgr.14146) 180 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:46.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:45.783034+0000 mon.b (mon.1) 19 : audit [INF] from='osd.6 [v2:172.21.15.157:6816/2598265223,v1:172.21.15.157:6817/2598265223]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-19T21:31:46.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:45.783376+0000 mon.a (mon.0) 488 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-19T21:31:46.252 INFO:teuthology.orchestra.run.smithi157.stdout:Created osd(s) 6 on host 'smithi157' 2024-02-19T21:31:46.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:45.783034+0000 mon.b (mon.1) 19 : audit [INF] from='osd.6 [v2:172.21.15.157:6816/2598265223,v1:172.21.15.157:6817/2598265223]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-19T21:31:46.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:45.783376+0000 mon.a (mon.0) 488 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-19T21:31:46.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:45.783034+0000 mon.b (mon.1) 19 : audit [INF] from='osd.6 [v2:172.21.15.157:6816/2598265223,v1:172.21.15.157:6817/2598265223]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-19T21:31:46.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:45.783376+0000 mon.a (mon.0) 488 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-19T21:31:47.063 DEBUG:teuthology.orchestra.run.smithi157:osd.6> sudo journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.6.service 2024-02-19T21:31:47.066 INFO:tasks.cephadm:Deploying osd.7 on smithi157 with /dev/vg_nvme/lv_1... 2024-02-19T21:31:47.066 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-02-19T21:31:47.095 INFO:journalctl@ceph.osd.6.smithi157.stdout:-- Logs begin at Mon 2024-02-19 21:08:46 UTC. -- 2024-02-19T21:31:47.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:45.934797+0000 mgr.y (mgr.14146) 181 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:47.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:45.999555+0000 mon.a (mon.0) 489 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-19T21:31:47.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:45.999610+0000 mon.a (mon.0) 490 : cluster [DBG] osdmap e45: 7 total, 6 up, 7 in 2024-02-19T21:31:47.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:45.999758+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:31:47.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:46.000192+0000 mon.b (mon.1) 20 : audit [INF] from='osd.6 [v2:172.21.15.157:6816/2598265223,v1:172.21.15.157:6817/2598265223]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-19T21:31:47.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:46.000356+0000 mon.a (mon.0) 492 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-19T21:31:47.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:46.248760+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:47.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:46.573458+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:47.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:45.934797+0000 mgr.y (mgr.14146) 181 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:47.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:45.999555+0000 mon.a (mon.0) 489 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-19T21:31:47.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:45.999610+0000 mon.a (mon.0) 490 : cluster [DBG] osdmap e45: 7 total, 6 up, 7 in 2024-02-19T21:31:47.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:45.999758+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:31:47.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:46.000192+0000 mon.b (mon.1) 20 : audit [INF] from='osd.6 [v2:172.21.15.157:6816/2598265223,v1:172.21.15.157:6817/2598265223]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-19T21:31:47.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:46.000356+0000 mon.a (mon.0) 492 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-19T21:31:47.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:46.248760+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:47.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:46.573458+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:47.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:45.934797+0000 mgr.y (mgr.14146) 181 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:47.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:45.999555+0000 mon.a (mon.0) 489 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-19T21:31:47.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:45.999610+0000 mon.a (mon.0) 490 : cluster [DBG] osdmap e45: 7 total, 6 up, 7 in 2024-02-19T21:31:47.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:45.999758+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:31:47.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:46.000192+0000 mon.b (mon.1) 20 : audit [INF] from='osd.6 [v2:172.21.15.157:6816/2598265223,v1:172.21.15.157:6817/2598265223]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-19T21:31:47.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:46.000356+0000 mon.a (mon.0) 492 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-19T21:31:47.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:46.248760+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:47.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:46.573458+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:48.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:47.001351+0000 mon.a (mon.0) 495 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-02-19T21:31:48.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:47.001465+0000 mon.a (mon.0) 496 : cluster [DBG] osdmap e46: 7 total, 6 up, 7 in 2024-02-19T21:31:48.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:47.001996+0000 mon.a (mon.0) 497 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:31:48.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:47.006045+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:31:48.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:47.001351+0000 mon.a (mon.0) 495 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-02-19T21:31:48.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:47.001465+0000 mon.a (mon.0) 496 : cluster [DBG] osdmap e46: 7 total, 6 up, 7 in 2024-02-19T21:31:48.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:47.001996+0000 mon.a (mon.0) 497 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:31:48.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:47.006045+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:31:48.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:47.001351+0000 mon.a (mon.0) 495 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-02-19T21:31:48.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:47.001465+0000 mon.a (mon.0) 496 : cluster [DBG] osdmap e46: 7 total, 6 up, 7 in 2024-02-19T21:31:48.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:47.001996+0000 mon.a (mon.0) 497 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:31:48.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:47.006045+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:31:49.282 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:46.754692+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:31:49.282 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:46.754750+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:31:49.282 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:47.935272+0000 mgr.y (mgr.14146) 182 : cluster [DBG] pgmap v172: 1 pgs: 1 peering; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:49.282 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:48.002551+0000 mon.a (mon.0) 499 : cluster [INF] osd.6 [v2:172.21.15.157:6816/2598265223,v1:172.21.15.157:6817/2598265223] boot 2024-02-19T21:31:49.283 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:48.002589+0000 mon.a (mon.0) 500 : cluster [DBG] osdmap e47: 7 total, 7 up, 7 in 2024-02-19T21:31:49.283 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:48.003565+0000 mon.a (mon.0) 501 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:31:49.283 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:49.004522+0000 mon.a (mon.0) 502 : cluster [DBG] osdmap e48: 7 total, 7 up, 7 in 2024-02-19T21:31:49.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:46.754692+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:31:49.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:46.754750+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:31:49.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:47.935272+0000 mgr.y (mgr.14146) 182 : cluster [DBG] pgmap v172: 1 pgs: 1 peering; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:49.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:48.002551+0000 mon.a (mon.0) 499 : cluster [INF] osd.6 [v2:172.21.15.157:6816/2598265223,v1:172.21.15.157:6817/2598265223] boot 2024-02-19T21:31:49.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:48.002589+0000 mon.a (mon.0) 500 : cluster [DBG] osdmap e47: 7 total, 7 up, 7 in 2024-02-19T21:31:49.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:48.003565+0000 mon.a (mon.0) 501 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:31:49.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:49.004522+0000 mon.a (mon.0) 502 : cluster [DBG] osdmap e48: 7 total, 7 up, 7 in 2024-02-19T21:31:49.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:46.754692+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:31:49.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:46.754750+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:31:49.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:47.935272+0000 mgr.y (mgr.14146) 182 : cluster [DBG] pgmap v172: 1 pgs: 1 peering; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:31:49.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:48.002551+0000 mon.a (mon.0) 499 : cluster [INF] osd.6 [v2:172.21.15.157:6816/2598265223,v1:172.21.15.157:6817/2598265223] boot 2024-02-19T21:31:49.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:48.002589+0000 mon.a (mon.0) 500 : cluster [DBG] osdmap e47: 7 total, 7 up, 7 in 2024-02-19T21:31:49.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:48.003565+0000 mon.a (mon.0) 501 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:31:49.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:49.004522+0000 mon.a (mon.0) 502 : cluster [DBG] osdmap e48: 7 total, 7 up, 7 in 2024-02-19T21:31:49.847 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-02-19T21:31:49.847 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-02-19T21:31:49.847 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10+0 records in 2024-02-19T21:31:49.847 INFO:teuthology.orchestra.run.smithi157.stderr:10+0 records out 2024-02-19T21:31:49.847 INFO:teuthology.orchestra.run.smithi157.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00846778 s, 1.2 GB/s 2024-02-19T21:31:49.848 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping successful for: 2024-02-19T21:31:51.237 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi157:vg_nvme/lv_1 2024-02-19T21:31:51.265 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:49.935583+0000 mgr.y (mgr.14146) 183 : cluster [DBG] pgmap v175: 1 pgs: 1 peering; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:31:51.265 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:50.007005+0000 mon.a (mon.0) 503 : cluster [DBG] osdmap e49: 7 total, 7 up, 7 in 2024-02-19T21:31:51.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:49.935583+0000 mgr.y (mgr.14146) 183 : cluster [DBG] pgmap v175: 1 pgs: 1 peering; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:31:51.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:50.007005+0000 mon.a (mon.0) 503 : cluster [DBG] osdmap e49: 7 total, 7 up, 7 in 2024-02-19T21:31:51.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:49.935583+0000 mgr.y (mgr.14146) 183 : cluster [DBG] pgmap v175: 1 pgs: 1 peering; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:31:51.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:50.007005+0000 mon.a (mon.0) 503 : cluster [DBG] osdmap e49: 7 total, 7 up, 7 in 2024-02-19T21:31:53.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:51.935967+0000 mgr.y (mgr.14146) 184 : cluster [DBG] pgmap v177: 1 pgs: 1 peering; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:31:53.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:31:52.568083+0000 mgr.y (mgr.14146) 185 : cephadm [INF] Detected new or changed devices on smithi157 2024-02-19T21:31:53.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:52.573032+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:53.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:52.865846+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:31:53.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:52.866731+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:31:53.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:52.867518+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:31:53.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:52.872818+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:53.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:52.873847+0000 mon.a (mon.0) 509 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:31:53.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:52.874592+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:31:53.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:52.879197+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:53.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:52.881447+0000 mon.a (mon.0) 512 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:31:53.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:53.166587+0000 mon.a (mon.0) 513 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:31:53.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:53.167231+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:31:53.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:53.171887+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:53.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:51.935967+0000 mgr.y (mgr.14146) 184 : cluster [DBG] pgmap v177: 1 pgs: 1 peering; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:31:53.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:31:52.568083+0000 mgr.y (mgr.14146) 185 : cephadm [INF] Detected new or changed devices on smithi157 2024-02-19T21:31:53.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:52.573032+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:53.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:52.865846+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:31:53.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:52.866731+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:31:53.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:52.867518+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:31:53.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:52.872818+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:53.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:52.873847+0000 mon.a (mon.0) 509 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:31:53.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:52.874592+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:31:53.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:52.879197+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:53.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:52.881447+0000 mon.a (mon.0) 512 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:31:53.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:53.166587+0000 mon.a (mon.0) 513 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:31:53.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:53.167231+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:31:53.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:53.171887+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:53.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:51.935967+0000 mgr.y (mgr.14146) 184 : cluster [DBG] pgmap v177: 1 pgs: 1 peering; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:31:53.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:31:52.568083+0000 mgr.y (mgr.14146) 185 : cephadm [INF] Detected new or changed devices on smithi157 2024-02-19T21:31:53.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:52.573032+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:53.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:52.865846+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:31:53.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:52.866731+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:31:53.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:52.867518+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:31:53.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:52.872818+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:53.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:52.873847+0000 mon.a (mon.0) 509 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:31:53.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:52.874592+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:31:53.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:52.879197+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:53.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:52.881447+0000 mon.a (mon.0) 512 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:31:53.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:53.166587+0000 mon.a (mon.0) 513 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:31:53.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:53.167231+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:31:53.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:53.171887+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:31:54.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:31:52.868152+0000 mgr.y (mgr.14146) 186 : cephadm [INF] Adjusting osd_memory_target on smithi157 to 5707M 2024-02-19T21:31:54.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:54.228199+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:31:54.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:54.230847+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:31:54.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:54.231546+0000 mon.a (mon.0) 518 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:31:54.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:31:52.868152+0000 mgr.y (mgr.14146) 186 : cephadm [INF] Adjusting osd_memory_target on smithi157 to 5707M 2024-02-19T21:31:54.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:54.228199+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:31:54.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:54.230847+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:31:54.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:54.231546+0000 mon.a (mon.0) 518 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:31:54.970 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:31:52.868152+0000 mgr.y (mgr.14146) 186 : cephadm [INF] Adjusting osd_memory_target on smithi157 to 5707M 2024-02-19T21:31:54.971 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:54.228199+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:31:54.971 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:54.230847+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:31:54.971 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:54.231546+0000 mon.a (mon.0) 518 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:31:55.801 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:53.936513+0000 mgr.y (mgr.14146) 187 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:31:55.801 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:54.225886+0000 mgr.y (mgr.14146) 188 : audit [DBG] from='client.24268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:31:55.801 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:54.591993+0000 osd.4 (osd.4) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:31:55.801 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:54.592081+0000 osd.4 (osd.4) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:31:55.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:53.936513+0000 mgr.y (mgr.14146) 187 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:31:55.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:54.225886+0000 mgr.y (mgr.14146) 188 : audit [DBG] from='client.24268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:31:55.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:54.591993+0000 osd.4 (osd.4) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:31:55.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:54.592081+0000 osd.4 (osd.4) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:31:55.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:53.936513+0000 mgr.y (mgr.14146) 187 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:31:55.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:54.225886+0000 mgr.y (mgr.14146) 188 : audit [DBG] from='client.24268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:31:55.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:54.591993+0000 osd.4 (osd.4) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:31:55.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:54.592081+0000 osd.4 (osd.4) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:31:56.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:55.581337+0000 mon.a (mon.0) 519 : cluster [DBG] osdmap e50: 7 total, 7 up, 7 in 2024-02-19T21:31:56.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:55.936926+0000 mgr.y (mgr.14146) 189 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:31:56.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:55.581337+0000 mon.a (mon.0) 519 : cluster [DBG] osdmap e50: 7 total, 7 up, 7 in 2024-02-19T21:31:56.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:55.936926+0000 mgr.y (mgr.14146) 189 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:31:57.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:55.581337+0000 mon.a (mon.0) 519 : cluster [DBG] osdmap e50: 7 total, 7 up, 7 in 2024-02-19T21:31:57.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:55.936926+0000 mgr.y (mgr.14146) 189 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:31:57.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:56.518690+0000 osd.1 (osd.1) 7 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:31:57.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:56.518765+0000 osd.1 (osd.1) 8 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:31:57.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:56.592524+0000 mon.a (mon.0) 520 : cluster [DBG] osdmap e51: 7 total, 7 up, 7 in 2024-02-19T21:31:57.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:56.866117+0000 mon.b (mon.1) 21 : audit [INF] from='client.? 172.21.15.157:0/2733481345' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7e2d0287-928d-40f8-841b-6c2077fc08ac"}]: dispatch 2024-02-19T21:31:57.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:56.866581+0000 mon.a (mon.0) 521 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7e2d0287-928d-40f8-841b-6c2077fc08ac"}]: dispatch 2024-02-19T21:31:57.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:56.876485+0000 mon.a (mon.0) 522 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7e2d0287-928d-40f8-841b-6c2077fc08ac"}]': finished 2024-02-19T21:31:57.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:56.876569+0000 mon.a (mon.0) 523 : cluster [DBG] osdmap e52: 8 total, 7 up, 8 in 2024-02-19T21:31:57.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:56.876703+0000 mon.a (mon.0) 524 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-19T21:31:57.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:31:57.500676+0000 mon.b (mon.1) 22 : audit [DBG] from='client.? 172.21.15.157:0/2575637351' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:31:57.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:56.518690+0000 osd.1 (osd.1) 7 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:31:57.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:56.518765+0000 osd.1 (osd.1) 8 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:31:57.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:56.592524+0000 mon.a (mon.0) 520 : cluster [DBG] osdmap e51: 7 total, 7 up, 7 in 2024-02-19T21:31:57.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:56.866117+0000 mon.b (mon.1) 21 : audit [INF] from='client.? 172.21.15.157:0/2733481345' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7e2d0287-928d-40f8-841b-6c2077fc08ac"}]: dispatch 2024-02-19T21:31:57.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:56.866581+0000 mon.a (mon.0) 521 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7e2d0287-928d-40f8-841b-6c2077fc08ac"}]: dispatch 2024-02-19T21:31:57.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:56.876485+0000 mon.a (mon.0) 522 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7e2d0287-928d-40f8-841b-6c2077fc08ac"}]': finished 2024-02-19T21:31:57.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:56.876569+0000 mon.a (mon.0) 523 : cluster [DBG] osdmap e52: 8 total, 7 up, 8 in 2024-02-19T21:31:57.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:56.876703+0000 mon.a (mon.0) 524 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-19T21:31:57.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:31:57.500676+0000 mon.b (mon.1) 22 : audit [DBG] from='client.? 172.21.15.157:0/2575637351' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:31:58.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:56.518690+0000 osd.1 (osd.1) 7 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:31:58.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:56.518765+0000 osd.1 (osd.1) 8 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:31:58.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:56.592524+0000 mon.a (mon.0) 520 : cluster [DBG] osdmap e51: 7 total, 7 up, 7 in 2024-02-19T21:31:58.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:56.866117+0000 mon.b (mon.1) 21 : audit [INF] from='client.? 172.21.15.157:0/2733481345' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7e2d0287-928d-40f8-841b-6c2077fc08ac"}]: dispatch 2024-02-19T21:31:58.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:56.866581+0000 mon.a (mon.0) 521 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7e2d0287-928d-40f8-841b-6c2077fc08ac"}]: dispatch 2024-02-19T21:31:58.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:56.876485+0000 mon.a (mon.0) 522 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7e2d0287-928d-40f8-841b-6c2077fc08ac"}]': finished 2024-02-19T21:31:58.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:56.876569+0000 mon.a (mon.0) 523 : cluster [DBG] osdmap e52: 8 total, 7 up, 8 in 2024-02-19T21:31:58.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:56.876703+0000 mon.a (mon.0) 524 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-19T21:31:58.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:31:57.500676+0000 mon.b (mon.1) 22 : audit [DBG] from='client.? 172.21.15.157:0/2575637351' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:31:59.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:31:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:57.937364+0000 mgr.y (mgr.14146) 190 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:31:59.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:31:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:57.937364+0000 mgr.y (mgr.14146) 190 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:31:59.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:31:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:57.937364+0000 mgr.y (mgr.14146) 190 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:32:01.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:31:59.937858+0000 mgr.y (mgr.14146) 191 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:32:01.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:31:59.937858+0000 mgr.y (mgr.14146) 191 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:32:01.271 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:31:59.937858+0000 mgr.y (mgr.14146) 191 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:32:03.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:01.938333+0000 mgr.y (mgr.14146) 192 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:32:03.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:01.938333+0000 mgr.y (mgr.14146) 192 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:32:03.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:01.938333+0000 mgr.y (mgr.14146) 192 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:32:04.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:03.616547+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-19T21:32:04.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:03.617334+0000 mon.a (mon.0) 526 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:32:04.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:03.616547+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-19T21:32:04.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:03.617334+0000 mon.a (mon.0) 526 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:32:04.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:03.616547+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-19T21:32:04.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:03.617334+0000 mon.a (mon.0) 526 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:32:05.238 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:32:03.617935+0000 mgr.y (mgr.14146) 193 : cephadm [INF] Deploying daemon osd.7 on smithi157 2024-02-19T21:32:05.238 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:03.938777+0000 mgr.y (mgr.14146) 194 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:32:05.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:32:03.617935+0000 mgr.y (mgr.14146) 193 : cephadm [INF] Deploying daemon osd.7 on smithi157 2024-02-19T21:32:05.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:03.938777+0000 mgr.y (mgr.14146) 194 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:32:05.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:32:03.617935+0000 mgr.y (mgr.14146) 193 : cephadm [INF] Deploying daemon osd.7 on smithi157 2024-02-19T21:32:05.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:03.938777+0000 mgr.y (mgr.14146) 194 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:32:07.305 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:05.939084+0000 mgr.y (mgr.14146) 195 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:32:07.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:05.939084+0000 mgr.y (mgr.14146) 195 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:32:07.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:05.939084+0000 mgr.y (mgr.14146) 195 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:32:09.185 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:07.939390+0000 mgr.y (mgr.14146) 196 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:32:09.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:07.939390+0000 mgr.y (mgr.14146) 196 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:32:09.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:07.939390+0000 mgr.y (mgr.14146) 196 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:32:10.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:09.229049+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:10.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:09.229369+0000 mon.a (mon.0) 528 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:32:10.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:09.229049+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:10.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:09.229369+0000 mon.a (mon.0) 528 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:32:10.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:09.229049+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:10.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:09.229369+0000 mon.a (mon.0) 528 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:32:11.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:09.939711+0000 mgr.y (mgr.14146) 197 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:32:11.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:09.939711+0000 mgr.y (mgr.14146) 197 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:32:11.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:09.939711+0000 mgr.y (mgr.14146) 197 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:32:12.965 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:11.900945+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:12.965 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:11.901862+0000 mon.a (mon.0) 530 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:32:12.966 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:11.902679+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:32:12.966 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:11.908210+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:12.966 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:11.940189+0000 mgr.y (mgr.14146) 198 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:32:12.966 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:12.318966+0000 mon.b (mon.1) 23 : audit [INF] from='osd.7 [v2:172.21.15.157:6824/3619345894,v1:172.21.15.157:6825/3619345894]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-19T21:32:12.966 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:12.319264+0000 mon.a (mon.0) 533 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-19T21:32:12.990 INFO:teuthology.orchestra.run.smithi157.stdout:Created osd(s) 7 on host 'smithi157' 2024-02-19T21:32:13.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:11.900945+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:13.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:11.901862+0000 mon.a (mon.0) 530 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:32:13.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:11.902679+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:32:13.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:11.908210+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:13.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:11.940189+0000 mgr.y (mgr.14146) 198 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:32:13.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:12.318966+0000 mon.b (mon.1) 23 : audit [INF] from='osd.7 [v2:172.21.15.157:6824/3619345894,v1:172.21.15.157:6825/3619345894]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-19T21:32:13.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:12.319264+0000 mon.a (mon.0) 533 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-19T21:32:13.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:11.900945+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:13.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:11.901862+0000 mon.a (mon.0) 530 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:32:13.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:11.902679+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:32:13.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:11.908210+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:13.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:11.940189+0000 mgr.y (mgr.14146) 198 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:32:13.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:12.318966+0000 mon.b (mon.1) 23 : audit [INF] from='osd.7 [v2:172.21.15.157:6824/3619345894,v1:172.21.15.157:6825/3619345894]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-19T21:32:13.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:12.319264+0000 mon.a (mon.0) 533 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-19T21:32:13.745 DEBUG:teuthology.orchestra.run.smithi157:osd.7> sudo journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.7.service 2024-02-19T21:32:13.747 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-02-19T21:32:13.748 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd stat -f json 2024-02-19T21:32:13.778 INFO:journalctl@ceph.osd.7.smithi157.stdout:-- Logs begin at Mon 2024-02-19 21:08:46 UTC. -- 2024-02-19T21:32:14.059 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 21:32:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T21:32:13.918+0000 7f477efaa700 -1 osd.7 0 waiting for initial osdmap 2024-02-19T21:32:14.059 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 21:32:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T21:32:13.925+0000 7f4777f1f700 -1 osd.7 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T21:32:14.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:12.911713+0000 mon.a (mon.0) 534 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-19T21:32:14.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:12.911847+0000 mon.a (mon.0) 535 : cluster [DBG] osdmap e53: 8 total, 7 up, 8 in 2024-02-19T21:32:14.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:12.911990+0000 mon.a (mon.0) 536 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-19T21:32:14.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:12.912523+0000 mon.b (mon.1) 24 : audit [INF] from='osd.7 [v2:172.21.15.157:6824/3619345894,v1:172.21.15.157:6825/3619345894]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-19T21:32:14.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:12.912710+0000 mon.a (mon.0) 537 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-19T21:32:14.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:12.986911+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:14.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:13.027161+0000 mon.a (mon.0) 539 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:32:14.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:12.911713+0000 mon.a (mon.0) 534 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-19T21:32:14.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:12.911847+0000 mon.a (mon.0) 535 : cluster [DBG] osdmap e53: 8 total, 7 up, 8 in 2024-02-19T21:32:14.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:12.911990+0000 mon.a (mon.0) 536 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-19T21:32:14.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:12.912523+0000 mon.b (mon.1) 24 : audit [INF] from='osd.7 [v2:172.21.15.157:6824/3619345894,v1:172.21.15.157:6825/3619345894]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-19T21:32:14.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:12.912710+0000 mon.a (mon.0) 537 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-19T21:32:14.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:12.986911+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:14.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:13.027161+0000 mon.a (mon.0) 539 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:32:14.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:12.911713+0000 mon.a (mon.0) 534 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-19T21:32:14.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:12.911847+0000 mon.a (mon.0) 535 : cluster [DBG] osdmap e53: 8 total, 7 up, 8 in 2024-02-19T21:32:14.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:12.911990+0000 mon.a (mon.0) 536 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-19T21:32:14.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:12.912523+0000 mon.b (mon.1) 24 : audit [INF] from='osd.7 [v2:172.21.15.157:6824/3619345894,v1:172.21.15.157:6825/3619345894]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-19T21:32:14.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:12.912710+0000 mon.a (mon.0) 537 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-19T21:32:14.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:12.986911+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:14.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:13.027161+0000 mon.a (mon.0) 539 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:32:15.177 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:13.913205+0000 mon.a (mon.0) 540 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-02-19T21:32:15.177 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:13.913276+0000 mon.a (mon.0) 541 : cluster [DBG] osdmap e54: 8 total, 7 up, 8 in 2024-02-19T21:32:15.177 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:13.913668+0000 mon.a (mon.0) 542 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-19T21:32:15.177 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:13.917809+0000 mon.a (mon.0) 543 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-19T21:32:15.178 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:13.940535+0000 mgr.y (mgr.14146) 199 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:32:15.178 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:14.810464+0000 mon.a (mon.0) 544 : cluster [INF] osd.7 [v2:172.21.15.157:6824/3619345894,v1:172.21.15.157:6825/3619345894] boot 2024-02-19T21:32:15.178 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:14.810493+0000 mon.a (mon.0) 545 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-02-19T21:32:15.178 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:14.810813+0000 mon.a (mon.0) 546 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-19T21:32:15.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:13.913205+0000 mon.a (mon.0) 540 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-02-19T21:32:15.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:13.913276+0000 mon.a (mon.0) 541 : cluster [DBG] osdmap e54: 8 total, 7 up, 8 in 2024-02-19T21:32:15.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:13.913668+0000 mon.a (mon.0) 542 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-19T21:32:15.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:13.917809+0000 mon.a (mon.0) 543 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-19T21:32:15.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:13.940535+0000 mgr.y (mgr.14146) 199 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:32:15.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:14.810464+0000 mon.a (mon.0) 544 : cluster [INF] osd.7 [v2:172.21.15.157:6824/3619345894,v1:172.21.15.157:6825/3619345894] boot 2024-02-19T21:32:15.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:14.810493+0000 mon.a (mon.0) 545 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-02-19T21:32:15.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:14.810813+0000 mon.a (mon.0) 546 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-19T21:32:15.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:13.913205+0000 mon.a (mon.0) 540 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-02-19T21:32:15.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:13.913276+0000 mon.a (mon.0) 541 : cluster [DBG] osdmap e54: 8 total, 7 up, 8 in 2024-02-19T21:32:15.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:13.913668+0000 mon.a (mon.0) 542 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-19T21:32:15.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:13.917809+0000 mon.a (mon.0) 543 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-19T21:32:15.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:13.940535+0000 mgr.y (mgr.14146) 199 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:32:15.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:14.810464+0000 mon.a (mon.0) 544 : cluster [INF] osd.7 [v2:172.21.15.157:6824/3619345894,v1:172.21.15.157:6825/3619345894] boot 2024-02-19T21:32:15.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:14.810493+0000 mon.a (mon.0) 545 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-02-19T21:32:15.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:14.810813+0000 mon.a (mon.0) 546 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-19T21:32:16.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:13.288896+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:32:16.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:13.288951+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:32:16.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:15.811513+0000 mon.a (mon.0) 547 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-02-19T21:32:16.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:13.288896+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:32:16.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:13.288951+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:32:16.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:15.811513+0000 mon.a (mon.0) 547 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-02-19T21:32:16.126 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:32:16.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:13.288896+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:32:16.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:13.288951+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:32:16.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:15.811513+0000 mon.a (mon.0) 547 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-02-19T21:32:16.870 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":56,"num_osds":8,"num_up_osds":8,"osd_up_since":1708378334,"num_in_osds":8,"osd_in_since":1708378316,"num_remapped_pgs":0} 2024-02-19T21:32:16.870 INFO:tasks.cephadm:Adding ceph.rgw.foo.a on smithi080 2024-02-19T21:32:16.870 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph orch apply rgw foo.a --placement '1;smithi080=foo.a' 2024-02-19T21:32:17.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:15.940830+0000 mgr.y (mgr.14146) 200 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:32:17.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:16.123852+0000 mon.a (mon.0) 548 : audit [DBG] from='client.? 172.21.15.80:0/864617242' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-19T21:32:17.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:16.811857+0000 mon.a (mon.0) 549 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-02-19T21:32:17.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:15.940830+0000 mgr.y (mgr.14146) 200 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:32:17.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:16.123852+0000 mon.a (mon.0) 548 : audit [DBG] from='client.? 172.21.15.80:0/864617242' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-19T21:32:17.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:16.811857+0000 mon.a (mon.0) 549 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-02-19T21:32:17.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:15.940830+0000 mgr.y (mgr.14146) 200 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:32:17.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:16.123852+0000 mon.a (mon.0) 548 : audit [DBG] from='client.? 172.21.15.80:0/864617242' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-19T21:32:17.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:16.811857+0000 mon.a (mon.0) 549 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-02-19T21:32:18.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:32:17.036719+0000 mgr.y (mgr.14146) 201 : cephadm [INF] Detected new or changed devices on smithi157 2024-02-19T21:32:18.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:17.041209+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:18.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:17.042149+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:18.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:17.042821+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:18.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:17.043413+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:18.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:17.044022+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:18.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:32:17.044492+0000 mgr.y (mgr.14146) 202 : cephadm [INF] Adjusting osd_memory_target on smithi157 to 4280M 2024-02-19T21:32:18.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:17.047769+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:18.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:17.048573+0000 mon.a (mon.0) 556 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:32:18.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:17.049135+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:32:18.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:17.053166+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:18.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:32:17.036719+0000 mgr.y (mgr.14146) 201 : cephadm [INF] Detected new or changed devices on smithi157 2024-02-19T21:32:18.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:17.041209+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:18.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:17.042149+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:18.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:17.042821+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:18.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:17.043413+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:18.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:17.044022+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:18.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:32:17.044492+0000 mgr.y (mgr.14146) 202 : cephadm [INF] Adjusting osd_memory_target on smithi157 to 4280M 2024-02-19T21:32:18.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:17.047769+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:18.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:17.048573+0000 mon.a (mon.0) 556 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:32:18.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:17.049135+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:32:18.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:17.053166+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:18.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:32:17.036719+0000 mgr.y (mgr.14146) 201 : cephadm [INF] Detected new or changed devices on smithi157 2024-02-19T21:32:18.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:17.041209+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:18.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:17.042149+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:18.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:17.042821+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:18.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:17.043413+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:18.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:17.044022+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:18.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:32:17.044492+0000 mgr.y (mgr.14146) 202 : cephadm [INF] Adjusting osd_memory_target on smithi157 to 4280M 2024-02-19T21:32:18.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:17.047769+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:18.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:17.048573+0000 mon.a (mon.0) 556 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:32:18.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:17.049135+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:32:18.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:17.053166+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:19.119 INFO:teuthology.orchestra.run.smithi157.stdout:Scheduled rgw.foo.a update... 2024-02-19T21:32:19.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:17.941133+0000 mgr.y (mgr.14146) 203 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:32:19.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:17.941133+0000 mgr.y (mgr.14146) 203 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:32:19.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:17.941133+0000 mgr.y (mgr.14146) 203 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:32:19.822 DEBUG:teuthology.orchestra.run.smithi080:rgw.foo.a> sudo journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@rgw.foo.a.service 2024-02-19T21:32:19.824 INFO:tasks.cephadm:Adding ceph.iscsi.iscsi.a on smithi157 2024-02-19T21:32:19.824 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool create iscsi 3 3 replicated 2024-02-19T21:32:19.854 INFO:journalctl@ceph.rgw.foo.a.smithi080.stdout:-- Logs begin at Mon 2024-02-19 21:10:15 UTC. -- 2024-02-19T21:32:20.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:19.110476+0000 mgr.y (mgr.14146) 204 : audit [DBG] from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi080=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:32:20.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:32:19.111921+0000 mgr.y (mgr.14146) 205 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi080=foo.a;count:1 2024-02-19T21:32:20.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:19.115470+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:20.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:19.123752+0000 mon.a (mon.0) 560 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:32:20.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:19.125397+0000 mon.a (mon.0) 561 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:32:20.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:19.126134+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:32:20.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:19.130874+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:20.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:32:19.133081+0000 mgr.y (mgr.14146) 206 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi080=foo.a;count:1 2024-02-19T21:32:20.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:19.136324+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:20.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:19.136941+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-19T21:32:20.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:19.140768+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-19T21:32:20.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:19.144719+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:20.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:19.145598+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:32:20.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:32:19.146254+0000 mgr.y (mgr.14146) 207 : cephadm [INF] Deploying daemon rgw.foo.a on smithi080 2024-02-19T21:32:20.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:19.110476+0000 mgr.y (mgr.14146) 204 : audit [DBG] from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi080=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:32:20.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:32:19.111921+0000 mgr.y (mgr.14146) 205 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi080=foo.a;count:1 2024-02-19T21:32:20.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:19.115470+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:20.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:19.123752+0000 mon.a (mon.0) 560 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:32:20.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:19.125397+0000 mon.a (mon.0) 561 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:32:20.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:19.126134+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:32:20.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:19.130874+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:20.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:32:19.133081+0000 mgr.y (mgr.14146) 206 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi080=foo.a;count:1 2024-02-19T21:32:20.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:19.136324+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:20.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:19.136941+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-19T21:32:20.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:19.140768+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-19T21:32:20.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:19.144719+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:20.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:19.145598+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:32:20.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:32:19.146254+0000 mgr.y (mgr.14146) 207 : cephadm [INF] Deploying daemon rgw.foo.a on smithi080 2024-02-19T21:32:20.527 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:19.110476+0000 mgr.y (mgr.14146) 204 : audit [DBG] from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi080=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:32:20.527 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:32:19.111921+0000 mgr.y (mgr.14146) 205 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi080=foo.a;count:1 2024-02-19T21:32:20.527 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:19.115470+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:20.527 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:19.123752+0000 mon.a (mon.0) 560 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:32:20.527 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:19.125397+0000 mon.a (mon.0) 561 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:32:20.527 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:19.126134+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:32:20.527 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:19.130874+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:20.527 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:32:19.133081+0000 mgr.y (mgr.14146) 206 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi080=foo.a;count:1 2024-02-19T21:32:20.527 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:19.136324+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:20.527 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:19.136941+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-19T21:32:20.527 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:19.140768+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-19T21:32:20.527 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:19.144719+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:20.527 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:19.145598+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:32:20.528 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:32:19.146254+0000 mgr.y (mgr.14146) 207 : cephadm [INF] Deploying daemon rgw.foo.a on smithi080 2024-02-19T21:32:21.176 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:19.941437+0000 mgr.y (mgr.14146) 208 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:32:21.177 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:19.941437+0000 mgr.y (mgr.14146) 208 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:32:21.375 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:19.941437+0000 mgr.y (mgr.14146) 208 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:32:21.599 INFO:journalctl@ceph.rgw.foo.a.smithi080.stdout:Feb 19 21:32:21 smithi080 systemd[1]: Starting Ceph rgw.foo.a for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T21:32:22.349 INFO:journalctl@ceph.rgw.foo.a.smithi080.stdout:Feb 19 21:32:21 smithi080 bash[65009]: db01c02d267b80eeb08561133e04704323428baf4410798b544fc24a802ee69f 2024-02-19T21:32:22.349 INFO:journalctl@ceph.rgw.foo.a.smithi080.stdout:Feb 19 21:32:21 smithi080 systemd[1]: Started Ceph rgw.foo.a for 6f763558-cf6d-11ee-95bb-87774f69a715. 2024-02-19T21:32:22.355 INFO:teuthology.orchestra.run.smithi157.stderr:pool 'iscsi' created 2024-02-19T21:32:23.125 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool application enable iscsi rbd 2024-02-19T21:32:23.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:21.941708+0000 mgr.y (mgr.14146) 209 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:32:23.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:22.087178+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:23.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:22.088260+0000 mon.a (mon.0) 570 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:32:23.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:22.093407+0000 mon.b (mon.1) 25 : audit [INF] from='client.? 172.21.15.157:0/353664675' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-19T21:32:23.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:22.093734+0000 mon.a (mon.0) 571 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-19T21:32:23.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:22.347050+0000 mon.a (mon.0) 572 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-02-19T21:32:23.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:22.347172+0000 mon.a (mon.0) 573 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-02-19T21:32:23.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:22.357326+0000 mon.c (mon.2) 8 : audit [INF] from='client.? 172.21.15.80:0/3365055276' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-19T21:32:23.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:22.357948+0000 mon.a (mon.0) 574 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-19T21:32:23.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:21.941708+0000 mgr.y (mgr.14146) 209 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:32:23.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:22.087178+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:23.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:22.088260+0000 mon.a (mon.0) 570 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:32:23.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:22.093407+0000 mon.b (mon.1) 25 : audit [INF] from='client.? 172.21.15.157:0/353664675' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-19T21:32:23.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:22.093734+0000 mon.a (mon.0) 571 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-19T21:32:23.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:22.347050+0000 mon.a (mon.0) 572 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-02-19T21:32:23.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:22.347172+0000 mon.a (mon.0) 573 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-02-19T21:32:23.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:22.357326+0000 mon.c (mon.2) 8 : audit [INF] from='client.? 172.21.15.80:0/3365055276' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-19T21:32:23.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:22.357948+0000 mon.a (mon.0) 574 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-19T21:32:23.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:21.941708+0000 mgr.y (mgr.14146) 209 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:32:23.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:22.087178+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:23.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:22.088260+0000 mon.a (mon.0) 570 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:32:23.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:22.093407+0000 mon.b (mon.1) 25 : audit [INF] from='client.? 172.21.15.157:0/353664675' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-19T21:32:23.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:22.093734+0000 mon.a (mon.0) 571 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-19T21:32:23.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:22.347050+0000 mon.a (mon.0) 572 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-02-19T21:32:23.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:22.347172+0000 mon.a (mon.0) 573 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-02-19T21:32:23.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:22.357326+0000 mon.c (mon.2) 8 : audit [INF] from='client.? 172.21.15.80:0/3365055276' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-19T21:32:23.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:22.357948+0000 mon.a (mon.0) 574 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-19T21:32:24.766 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:23.347268+0000 mon.a (mon.0) 575 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-02-19T21:32:24.767 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:23.347338+0000 mon.a (mon.0) 576 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-02-19T21:32:24.767 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:23.636450+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:24.767 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:23.637188+0000 mon.a (mon.0) 578 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:32:24.767 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:23.637824+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:32:24.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:23.347268+0000 mon.a (mon.0) 575 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-02-19T21:32:24.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:23.347338+0000 mon.a (mon.0) 576 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-02-19T21:32:24.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:23.636450+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:24.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:23.637188+0000 mon.a (mon.0) 578 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:32:24.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:23.637824+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:32:24.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:23.347268+0000 mon.a (mon.0) 575 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-02-19T21:32:24.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:23.347338+0000 mon.a (mon.0) 576 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-02-19T21:32:24.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:23.636450+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:24.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:23.637188+0000 mon.a (mon.0) 578 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:32:24.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:23.637824+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:32:25.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:32:23.641915+0000 mgr.y (mgr.14146) 210 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-02-19T21:32:25.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:23.942162+0000 mgr.y (mgr.14146) 211 : cluster [DBG] pgmap v203: 36 pgs: 8 creating+peering, 17 active+clean, 11 unknown; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:32:25.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:24.352210+0000 mon.a (mon.0) 580 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-02-19T21:32:25.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:24.354694+0000 mon.c (mon.2) 9 : audit [INF] from='client.? 172.21.15.80:0/3365055276' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-19T21:32:25.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:24.358445+0000 mon.a (mon.0) 581 : audit [INF] from='client.? 172.21.15.80:0/1472912058' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-19T21:32:25.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:24.360230+0000 mon.a (mon.0) 582 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-19T21:32:25.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:25.351102+0000 mon.a (mon.0) 583 : audit [INF] from='client.? 172.21.15.80:0/1472912058' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-02-19T21:32:25.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:25.351184+0000 mon.a (mon.0) 584 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-02-19T21:32:25.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:25.351256+0000 mon.a (mon.0) 585 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-02-19T21:32:25.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:32:23.641915+0000 mgr.y (mgr.14146) 210 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-02-19T21:32:25.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:23.942162+0000 mgr.y (mgr.14146) 211 : cluster [DBG] pgmap v203: 36 pgs: 8 creating+peering, 17 active+clean, 11 unknown; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:32:25.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:24.352210+0000 mon.a (mon.0) 580 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-02-19T21:32:25.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:24.354694+0000 mon.c (mon.2) 9 : audit [INF] from='client.? 172.21.15.80:0/3365055276' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-19T21:32:25.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:24.358445+0000 mon.a (mon.0) 581 : audit [INF] from='client.? 172.21.15.80:0/1472912058' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-19T21:32:25.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:24.360230+0000 mon.a (mon.0) 582 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-19T21:32:25.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:25.351102+0000 mon.a (mon.0) 583 : audit [INF] from='client.? 172.21.15.80:0/1472912058' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-02-19T21:32:25.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:25.351184+0000 mon.a (mon.0) 584 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-02-19T21:32:25.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:25.351256+0000 mon.a (mon.0) 585 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-02-19T21:32:25.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:32:23.641915+0000 mgr.y (mgr.14146) 210 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-02-19T21:32:25.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:23.942162+0000 mgr.y (mgr.14146) 211 : cluster [DBG] pgmap v203: 36 pgs: 8 creating+peering, 17 active+clean, 11 unknown; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:32:25.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:24.352210+0000 mon.a (mon.0) 580 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-02-19T21:32:25.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:24.354694+0000 mon.c (mon.2) 9 : audit [INF] from='client.? 172.21.15.80:0/3365055276' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-19T21:32:25.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:24.358445+0000 mon.a (mon.0) 581 : audit [INF] from='client.? 172.21.15.80:0/1472912058' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-19T21:32:25.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:24.360230+0000 mon.a (mon.0) 582 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-19T21:32:25.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:25.351102+0000 mon.a (mon.0) 583 : audit [INF] from='client.? 172.21.15.80:0/1472912058' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-02-19T21:32:25.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:25.351184+0000 mon.a (mon.0) 584 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-02-19T21:32:25.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:25.351256+0000 mon.a (mon.0) 585 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-02-19T21:32:26.362 INFO:teuthology.orchestra.run.smithi157.stderr:enabled application 'rbd' on pool 'iscsi' 2024-02-19T21:32:26.793 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:25.474432+0000 mon.b (mon.1) 26 : audit [INF] from='client.? 172.21.15.157:0/1094289918' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2024-02-19T21:32:26.793 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:25.831470+0000 mon.a (mon.0) 586 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2024-02-19T21:32:26.793 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:26.059108+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:26.794 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:26.353382+0000 mon.a (mon.0) 588 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2024-02-19T21:32:26.794 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:26.353511+0000 mon.a (mon.0) 589 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-02-19T21:32:26.794 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:26.355465+0000 mon.a (mon.0) 590 : audit [INF] from='client.? 172.21.15.80:0/1472912058' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-19T21:32:26.794 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:26.355870+0000 mon.c (mon.2) 10 : audit [INF] from='client.? 172.21.15.80:0/3365055276' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-19T21:32:26.794 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:26.356713+0000 mon.a (mon.0) 591 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-19T21:32:26.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:25.474432+0000 mon.b (mon.1) 26 : audit [INF] from='client.? 172.21.15.157:0/1094289918' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2024-02-19T21:32:26.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:25.831470+0000 mon.a (mon.0) 586 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2024-02-19T21:32:26.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:26.059108+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:26.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:26.353382+0000 mon.a (mon.0) 588 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2024-02-19T21:32:26.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:26.353511+0000 mon.a (mon.0) 589 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-02-19T21:32:26.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:26.355465+0000 mon.a (mon.0) 590 : audit [INF] from='client.? 172.21.15.80:0/1472912058' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-19T21:32:26.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:26.355870+0000 mon.c (mon.2) 10 : audit [INF] from='client.? 172.21.15.80:0/3365055276' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-19T21:32:26.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:26.356713+0000 mon.a (mon.0) 591 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-19T21:32:26.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:25.474432+0000 mon.b (mon.1) 26 : audit [INF] from='client.? 172.21.15.157:0/1094289918' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2024-02-19T21:32:26.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:25.831470+0000 mon.a (mon.0) 586 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2024-02-19T21:32:26.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:26.059108+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:26.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:26.353382+0000 mon.a (mon.0) 588 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2024-02-19T21:32:26.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:26.353511+0000 mon.a (mon.0) 589 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-02-19T21:32:26.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:26.355465+0000 mon.a (mon.0) 590 : audit [INF] from='client.? 172.21.15.80:0/1472912058' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-19T21:32:26.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:26.355870+0000 mon.c (mon.2) 10 : audit [INF] from='client.? 172.21.15.80:0/3365055276' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-19T21:32:26.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:26.356713+0000 mon.a (mon.0) 591 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-19T21:32:27.115 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph orch apply iscsi iscsi user password --placement '1;smithi157=iscsi.a' 2024-02-19T21:32:27.638 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:25.942468+0000 mgr.y (mgr.14146) 212 : cluster [DBG] pgmap v206: 68 pgs: 8 creating+peering, 23 active+clean, 37 unknown; 873 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:32:27.639 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:27.356925+0000 mon.a (mon.0) 592 : audit [INF] from='client.? 172.21.15.80:0/1472912058' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-02-19T21:32:27.639 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:27.357132+0000 mon.a (mon.0) 593 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-02-19T21:32:27.639 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:27.357269+0000 mon.a (mon.0) 594 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-19T21:32:27.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:25.942468+0000 mgr.y (mgr.14146) 212 : cluster [DBG] pgmap v206: 68 pgs: 8 creating+peering, 23 active+clean, 37 unknown; 873 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:32:27.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:27.356925+0000 mon.a (mon.0) 592 : audit [INF] from='client.? 172.21.15.80:0/1472912058' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-02-19T21:32:27.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:27.357132+0000 mon.a (mon.0) 593 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-02-19T21:32:27.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:27.357269+0000 mon.a (mon.0) 594 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-19T21:32:27.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:25.942468+0000 mgr.y (mgr.14146) 212 : cluster [DBG] pgmap v206: 68 pgs: 8 creating+peering, 23 active+clean, 37 unknown; 873 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:32:27.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:27.356925+0000 mon.a (mon.0) 592 : audit [INF] from='client.? 172.21.15.80:0/1472912058' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-02-19T21:32:27.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:27.357132+0000 mon.a (mon.0) 593 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-02-19T21:32:27.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:27.357269+0000 mon.a (mon.0) 594 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-19T21:32:29.518 INFO:teuthology.orchestra.run.smithi157.stdout:Scheduled iscsi.iscsi update... 2024-02-19T21:32:29.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:27.942821+0000 mgr.y (mgr.14146) 213 : cluster [DBG] pgmap v209: 100 pgs: 10 creating+peering, 49 active+clean, 41 unknown; 1.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-02-19T21:32:29.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:28.356295+0000 mon.a (mon.0) 595 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-02-19T21:32:29.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:28.360635+0000 mon.a (mon.0) 596 : audit [INF] from='client.? 172.21.15.80:0/3356347629' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-19T21:32:29.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:28.363493+0000 mon.a (mon.0) 597 : audit [INF] from='client.? 172.21.15.80:0/10763483' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-19T21:32:29.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:27.942821+0000 mgr.y (mgr.14146) 213 : cluster [DBG] pgmap v209: 100 pgs: 10 creating+peering, 49 active+clean, 41 unknown; 1.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-02-19T21:32:29.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:28.356295+0000 mon.a (mon.0) 595 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-02-19T21:32:29.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:28.360635+0000 mon.a (mon.0) 596 : audit [INF] from='client.? 172.21.15.80:0/3356347629' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-19T21:32:29.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:28.363493+0000 mon.a (mon.0) 597 : audit [INF] from='client.? 172.21.15.80:0/10763483' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-19T21:32:29.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:27.942821+0000 mgr.y (mgr.14146) 213 : cluster [DBG] pgmap v209: 100 pgs: 10 creating+peering, 49 active+clean, 41 unknown; 1.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-02-19T21:32:29.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:28.356295+0000 mon.a (mon.0) 595 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-02-19T21:32:29.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:28.360635+0000 mon.a (mon.0) 596 : audit [INF] from='client.? 172.21.15.80:0/3356347629' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-19T21:32:29.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:28.363493+0000 mon.a (mon.0) 597 : audit [INF] from='client.? 172.21.15.80:0/10763483' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-19T21:32:30.232 DEBUG:teuthology.orchestra.run.smithi157:iscsi.iscsi.a> sudo journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@iscsi.iscsi.a.service 2024-02-19T21:32:30.234 INFO:tasks.cephadm:Adding prometheus.a on smithi157 2024-02-19T21:32:30.234 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph orch apply prometheus '1;smithi157=a' 2024-02-19T21:32:30.262 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:-- Logs begin at Mon 2024-02-19 21:08:46 UTC. -- 2024-02-19T21:32:30.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:29.362472+0000 mon.a (mon.0) 598 : audit [INF] from='client.? 172.21.15.80:0/3356347629' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-19T21:32:30.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:29.362664+0000 mon.a (mon.0) 599 : audit [INF] from='client.? 172.21.15.80:0/10763483' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-19T21:32:30.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:29.362726+0000 mon.a (mon.0) 600 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-19T21:32:30.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:29.368414+0000 mon.a (mon.0) 601 : audit [INF] from='client.? 172.21.15.80:0/10763483' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-19T21:32:30.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:29.378519+0000 mon.a (mon.0) 602 : audit [INF] from='client.? 172.21.15.80:0/3356347629' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-19T21:32:30.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:29.509457+0000 mgr.y (mgr.14146) 214 : audit [DBG] from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi157=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:32:30.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:32:29.511696+0000 mgr.y (mgr.14146) 215 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi157=iscsi.a;count:1 2024-02-19T21:32:30.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:29.515707+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:30.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:29.362472+0000 mon.a (mon.0) 598 : audit [INF] from='client.? 172.21.15.80:0/3356347629' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-19T21:32:30.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:29.362664+0000 mon.a (mon.0) 599 : audit [INF] from='client.? 172.21.15.80:0/10763483' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-19T21:32:30.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:29.362726+0000 mon.a (mon.0) 600 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-19T21:32:30.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:29.368414+0000 mon.a (mon.0) 601 : audit [INF] from='client.? 172.21.15.80:0/10763483' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-19T21:32:30.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:29.378519+0000 mon.a (mon.0) 602 : audit [INF] from='client.? 172.21.15.80:0/3356347629' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-19T21:32:30.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:29.509457+0000 mgr.y (mgr.14146) 214 : audit [DBG] from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi157=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:32:30.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:32:29.511696+0000 mgr.y (mgr.14146) 215 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi157=iscsi.a;count:1 2024-02-19T21:32:30.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:29.515707+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:30.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:29.362472+0000 mon.a (mon.0) 598 : audit [INF] from='client.? 172.21.15.80:0/3356347629' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-19T21:32:30.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:29.362664+0000 mon.a (mon.0) 599 : audit [INF] from='client.? 172.21.15.80:0/10763483' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-19T21:32:30.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:29.362726+0000 mon.a (mon.0) 600 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-19T21:32:30.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:29.368414+0000 mon.a (mon.0) 601 : audit [INF] from='client.? 172.21.15.80:0/10763483' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-19T21:32:30.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:29.378519+0000 mon.a (mon.0) 602 : audit [INF] from='client.? 172.21.15.80:0/3356347629' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-19T21:32:30.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:29.509457+0000 mgr.y (mgr.14146) 214 : audit [DBG] from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi157=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:32:30.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:32:29.511696+0000 mgr.y (mgr.14146) 215 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi157=iscsi.a;count:1 2024-02-19T21:32:30.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:29.515707+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:31.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:29.943529+0000 mgr.y (mgr.14146) 216 : cluster [DBG] pgmap v212: 132 pgs: 19 creating+peering, 97 active+clean, 16 unknown; 1.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-02-19T21:32:31.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:30.364207+0000 mon.a (mon.0) 604 : audit [INF] from='client.? 172.21.15.80:0/10763483' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-19T21:32:31.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:30.364304+0000 mon.a (mon.0) 605 : audit [INF] from='client.? 172.21.15.80:0/3356347629' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-19T21:32:31.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:30.364366+0000 mon.a (mon.0) 606 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-19T21:32:31.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:30.533216+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:31.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:30.539527+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:31.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:30.546624+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:31.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:32:30.549798+0000 mgr.y (mgr.14146) 217 : cephadm [INF] Checking pool "iscsi" exists for service iscsi.iscsi 2024-02-19T21:32:31.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:30.557168+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-19T21:32:31.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:30.563072+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-02-19T21:32:31.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:30.570643+0000 mon.a (mon.0) 612 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:32:31.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:32:30.571314+0000 mgr.y (mgr.14146) 218 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi157 2024-02-19T21:32:31.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:29.943529+0000 mgr.y (mgr.14146) 216 : cluster [DBG] pgmap v212: 132 pgs: 19 creating+peering, 97 active+clean, 16 unknown; 1.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-02-19T21:32:31.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:30.364207+0000 mon.a (mon.0) 604 : audit [INF] from='client.? 172.21.15.80:0/10763483' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-19T21:32:31.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:30.364304+0000 mon.a (mon.0) 605 : audit [INF] from='client.? 172.21.15.80:0/3356347629' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-19T21:32:31.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:30.364366+0000 mon.a (mon.0) 606 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-19T21:32:31.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:30.533216+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:31.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:30.539527+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:31.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:30.546624+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:31.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:32:30.549798+0000 mgr.y (mgr.14146) 217 : cephadm [INF] Checking pool "iscsi" exists for service iscsi.iscsi 2024-02-19T21:32:31.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:30.557168+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-19T21:32:31.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:30.563072+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-02-19T21:32:31.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:30.570643+0000 mon.a (mon.0) 612 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:32:31.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:32:30.571314+0000 mgr.y (mgr.14146) 218 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi157 2024-02-19T21:32:31.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:29.943529+0000 mgr.y (mgr.14146) 216 : cluster [DBG] pgmap v212: 132 pgs: 19 creating+peering, 97 active+clean, 16 unknown; 1.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-02-19T21:32:31.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:30.364207+0000 mon.a (mon.0) 604 : audit [INF] from='client.? 172.21.15.80:0/10763483' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-19T21:32:31.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:30.364304+0000 mon.a (mon.0) 605 : audit [INF] from='client.? 172.21.15.80:0/3356347629' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-19T21:32:31.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:30.364366+0000 mon.a (mon.0) 606 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-19T21:32:31.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:30.533216+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:31.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:30.539527+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:31.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:30.546624+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:31.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:32:30.549798+0000 mgr.y (mgr.14146) 217 : cephadm [INF] Checking pool "iscsi" exists for service iscsi.iscsi 2024-02-19T21:32:31.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:30.557168+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-19T21:32:31.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:30.563072+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-02-19T21:32:31.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:30.570643+0000 mon.a (mon.0) 612 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:32:31.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:32:30.571314+0000 mgr.y (mgr.14146) 218 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi157 2024-02-19T21:32:32.700 INFO:teuthology.orchestra.run.smithi157.stdout:Scheduled prometheus update... 2024-02-19T21:32:33.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:31.944320+0000 mgr.y (mgr.14146) 219 : cluster [DBG] pgmap v214: 132 pgs: 14 creating+peering, 113 active+clean, 5 unknown; 2.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 31 KiB/s rd, 2.4 KiB/s wr, 74 op/s 2024-02-19T21:32:33.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:32.381513+0000 mon.a (mon.0) 613 : cluster [DBG] mgrmap e15: y(active, since 5m), standbys: x 2024-02-19T21:32:33.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:32.697519+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:33.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:33.298733+0000 osd.7 (osd.7) 3 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:32:33.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:33.301684+0000 osd.7 (osd.7) 4 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:32:33.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:31.944320+0000 mgr.y (mgr.14146) 219 : cluster [DBG] pgmap v214: 132 pgs: 14 creating+peering, 113 active+clean, 5 unknown; 2.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 31 KiB/s rd, 2.4 KiB/s wr, 74 op/s 2024-02-19T21:32:33.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:32.381513+0000 mon.a (mon.0) 613 : cluster [DBG] mgrmap e15: y(active, since 5m), standbys: x 2024-02-19T21:32:33.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:32.697519+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:33.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:33.298733+0000 osd.7 (osd.7) 3 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:32:33.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:33.301684+0000 osd.7 (osd.7) 4 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:32:33.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:31.944320+0000 mgr.y (mgr.14146) 219 : cluster [DBG] pgmap v214: 132 pgs: 14 creating+peering, 113 active+clean, 5 unknown; 2.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 31 KiB/s rd, 2.4 KiB/s wr, 74 op/s 2024-02-19T21:32:33.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:32.381513+0000 mon.a (mon.0) 613 : cluster [DBG] mgrmap e15: y(active, since 5m), standbys: x 2024-02-19T21:32:33.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:32.697519+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:33.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:33.298733+0000 osd.7 (osd.7) 3 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:32:33.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:33.301684+0000 osd.7 (osd.7) 4 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:32:34.473 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:32.692108+0000 mgr.y (mgr.14146) 220 : audit [DBG] from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi157=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:32:34.474 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:32:32.693642+0000 mgr.y (mgr.14146) 221 : cephadm [INF] Saving service prometheus spec with placement smithi157=a;count:1 2024-02-19T21:32:34.720 DEBUG:teuthology.orchestra.run.smithi157:prometheus.a> sudo journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@prometheus.a.service 2024-02-19T21:32:34.722 INFO:tasks.cephadm:Adding node-exporter.a on smithi080 2024-02-19T21:32:34.722 INFO:tasks.cephadm:Adding node-exporter.b on smithi157 2024-02-19T21:32:34.722 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph orch apply node-exporter '2;smithi080=a;smithi157=b' 2024-02-19T21:32:34.755 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:-- Logs begin at Mon 2024-02-19 21:08:46 UTC. -- 2024-02-19T21:32:34.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:32.692108+0000 mgr.y (mgr.14146) 220 : audit [DBG] from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi157=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:32:34.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:32:32.693642+0000 mgr.y (mgr.14146) 221 : cephadm [INF] Saving service prometheus spec with placement smithi157=a;count:1 2024-02-19T21:32:34.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:32.692108+0000 mgr.y (mgr.14146) 220 : audit [DBG] from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi157=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:32:34.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:32:32.693642+0000 mgr.y (mgr.14146) 221 : cephadm [INF] Saving service prometheus spec with placement smithi157=a;count:1 2024-02-19T21:32:35.602 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:33.945110+0000 mgr.y (mgr.14146) 222 : cluster [DBG] pgmap v215: 132 pgs: 132 active+clean; 4.9 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 77 KiB/s rd, 5.8 KiB/s wr, 187 op/s 2024-02-19T21:32:35.602 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:34.817108+0000 mon.a (mon.0) 615 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-02-19T21:32:35.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:33.945110+0000 mgr.y (mgr.14146) 222 : cluster [DBG] pgmap v215: 132 pgs: 132 active+clean; 4.9 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 77 KiB/s rd, 5.8 KiB/s wr, 187 op/s 2024-02-19T21:32:35.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:34.817108+0000 mon.a (mon.0) 615 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-02-19T21:32:35.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:33.945110+0000 mgr.y (mgr.14146) 222 : cluster [DBG] pgmap v215: 132 pgs: 132 active+clean; 4.9 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 77 KiB/s rd, 5.8 KiB/s wr, 187 op/s 2024-02-19T21:32:35.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:34.817108+0000 mon.a (mon.0) 615 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-02-19T21:32:36.696 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:32:36 smithi157 bash[60854]: 1e4720ccf6637c0471791c7534df55a524c3b3ec823a939a09b137df6426c816 2024-02-19T21:32:36.696 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:32:36 smithi157 systemd[1]: Started Ceph iscsi.iscsi.a for 6f763558-cf6d-11ee-95bb-87774f69a715. 2024-02-19T21:32:36.992 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:32:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug Started the configuration object watcher 2024-02-19T21:32:36.992 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:32:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug Checking for config object changes every 1s 2024-02-19T21:32:36.992 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:32:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug Processing osd blocklist entries for this node 2024-02-19T21:32:37.273 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:32:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug Reading the configuration object to update local LIO configuration 2024-02-19T21:32:37.273 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:32:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug Configuration does not have an entry for this host(smithi157.front.sepia.ceph.com) - nothing to define to LIO 2024-02-19T21:32:37.273 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:32:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug * Running on http://[::]:5000/ (Press CTRL+C to quit) 2024-02-19T21:32:37.748 INFO:teuthology.orchestra.run.smithi157.stdout:Scheduled node-exporter update... 2024-02-19T21:32:37.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:35.945558+0000 mgr.y (mgr.14146) 223 : cluster [DBG] pgmap v217: 132 pgs: 132 active+clean; 5.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 70 KiB/s rd, 5.2 KiB/s wr, 169 op/s 2024-02-19T21:32:37.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:36.581869+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:37.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:36.583328+0000 mon.a (mon.0) 617 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:32:37.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:36.980480+0000 mon.b (mon.1) 27 : audit [DBG] from='client.? 172.21.15.157:0/1095579598' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-19T21:32:37.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:35.945558+0000 mgr.y (mgr.14146) 223 : cluster [DBG] pgmap v217: 132 pgs: 132 active+clean; 5.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 70 KiB/s rd, 5.2 KiB/s wr, 169 op/s 2024-02-19T21:32:37.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:36.581869+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:37.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:36.583328+0000 mon.a (mon.0) 617 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:32:37.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:36.980480+0000 mon.b (mon.1) 27 : audit [DBG] from='client.? 172.21.15.157:0/1095579598' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-19T21:32:37.937 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:35.945558+0000 mgr.y (mgr.14146) 223 : cluster [DBG] pgmap v217: 132 pgs: 132 active+clean; 5.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 70 KiB/s rd, 5.2 KiB/s wr, 169 op/s 2024-02-19T21:32:37.937 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:36.581869+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:37.937 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:36.583328+0000 mon.a (mon.0) 617 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:32:37.937 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:36.980480+0000 mon.b (mon.1) 27 : audit [DBG] from='client.? 172.21.15.157:0/1095579598' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-19T21:32:38.588 DEBUG:teuthology.orchestra.run.smithi080:node-exporter.a> sudo journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@node-exporter.a.service 2024-02-19T21:32:38.591 DEBUG:teuthology.orchestra.run.smithi157:node-exporter.b> sudo journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@node-exporter.b.service 2024-02-19T21:32:38.593 INFO:tasks.cephadm:Adding alertmanager.a on smithi080 2024-02-19T21:32:38.594 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph orch apply alertmanager '1;smithi080=a' 2024-02-19T21:32:38.623 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:-- Logs begin at Mon 2024-02-19 21:08:46 UTC. -- 2024-02-19T21:32:38.629 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:-- Logs begin at Mon 2024-02-19 21:10:15 UTC. -- 2024-02-19T21:32:39.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:37.740297+0000 mgr.y (mgr.14146) 224 : audit [DBG] from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi080=a;smithi157=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:32:39.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:32:37.741654+0000 mgr.y (mgr.14146) 225 : cephadm [INF] Saving service node-exporter spec with placement smithi080=a;smithi157=b;count:2 2024-02-19T21:32:39.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:37.745261+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:39.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:37.946199+0000 mgr.y (mgr.14146) 226 : cluster [DBG] pgmap v218: 132 pgs: 132 active+clean; 5.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 57 KiB/s rd, 4.2 KiB/s wr, 139 op/s 2024-02-19T21:32:39.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:38.224821+0000 osd.3 (osd.3) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:32:39.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:38.224911+0000 osd.3 (osd.3) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:32:39.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:37.740297+0000 mgr.y (mgr.14146) 224 : audit [DBG] from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi080=a;smithi157=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:32:39.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:32:37.741654+0000 mgr.y (mgr.14146) 225 : cephadm [INF] Saving service node-exporter spec with placement smithi080=a;smithi157=b;count:2 2024-02-19T21:32:39.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:37.745261+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:39.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:37.946199+0000 mgr.y (mgr.14146) 226 : cluster [DBG] pgmap v218: 132 pgs: 132 active+clean; 5.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 57 KiB/s rd, 4.2 KiB/s wr, 139 op/s 2024-02-19T21:32:39.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:38.224821+0000 osd.3 (osd.3) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:32:39.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:38.224911+0000 osd.3 (osd.3) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:32:39.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:37.740297+0000 mgr.y (mgr.14146) 224 : audit [DBG] from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi080=a;smithi157=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:32:39.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:32:37.741654+0000 mgr.y (mgr.14146) 225 : cephadm [INF] Saving service node-exporter spec with placement smithi080=a;smithi157=b;count:2 2024-02-19T21:32:39.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:37.745261+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:39.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:37.946199+0000 mgr.y (mgr.14146) 226 : cluster [DBG] pgmap v218: 132 pgs: 132 active+clean; 5.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 57 KiB/s rd, 4.2 KiB/s wr, 139 op/s 2024-02-19T21:32:39.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:38.224821+0000 osd.3 (osd.3) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:32:39.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:38.224911+0000 osd.3 (osd.3) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:32:40.027 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:38.754058+0000 mon.a (mon.0) 619 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2024-02-19T21:32:40.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:38.754058+0000 mon.a (mon.0) 619 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2024-02-19T21:32:40.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:38.754058+0000 mon.a (mon.0) 619 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2024-02-19T21:32:41.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:39.816473+0000 mon.a (mon.0) 620 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2024-02-19T21:32:41.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:39.946650+0000 mgr.y (mgr.14146) 227 : cluster [DBG] pgmap v221: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 682 B/s rd, 341 B/s wr, 2 op/s 2024-02-19T21:32:41.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:39.816473+0000 mon.a (mon.0) 620 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2024-02-19T21:32:41.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:39.946650+0000 mgr.y (mgr.14146) 227 : cluster [DBG] pgmap v221: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 682 B/s rd, 341 B/s wr, 2 op/s 2024-02-19T21:32:41.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:39.816473+0000 mon.a (mon.0) 620 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2024-02-19T21:32:41.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:39.946650+0000 mgr.y (mgr.14146) 227 : cluster [DBG] pgmap v221: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 682 B/s rd, 341 B/s wr, 2 op/s 2024-02-19T21:32:41.169 INFO:teuthology.orchestra.run.smithi157.stdout:Scheduled alertmanager update... 2024-02-19T21:32:42.087 DEBUG:teuthology.orchestra.run.smithi080:alertmanager.a> sudo journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@alertmanager.a.service 2024-02-19T21:32:42.090 INFO:tasks.cephadm:Adding grafana.a on smithi157 2024-02-19T21:32:42.090 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph orch apply grafana '1;smithi157=a' 2024-02-19T21:32:42.123 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:-- Logs begin at Mon 2024-02-19 21:10:15 UTC. -- 2024-02-19T21:32:42.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:41.072203+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:42.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:41.159358+0000 mgr.y (mgr.14146) 228 : audit [DBG] from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi080=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:32:42.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:32:41.160624+0000 mgr.y (mgr.14146) 229 : cephadm [INF] Saving service alertmanager spec with placement smithi080=a;count:1 2024-02-19T21:32:42.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:41.166577+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:42.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:41.072203+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:42.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:41.159358+0000 mgr.y (mgr.14146) 228 : audit [DBG] from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi080=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:32:42.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:32:41.160624+0000 mgr.y (mgr.14146) 229 : cephadm [INF] Saving service alertmanager spec with placement smithi080=a;count:1 2024-02-19T21:32:42.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:41.166577+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:42.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:41.072203+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:42.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:41.159358+0000 mgr.y (mgr.14146) 228 : audit [DBG] from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi080=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:32:42.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:32:41.160624+0000 mgr.y (mgr.14146) 229 : cephadm [INF] Saving service alertmanager spec with placement smithi080=a;count:1 2024-02-19T21:32:42.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:41.166577+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:43.719 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:41.947383+0000 mgr.y (mgr.14146) 230 : cluster [DBG] pgmap v222: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 574 B/s rd, 287 B/s wr, 2 op/s 2024-02-19T21:32:43.719 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:42.461121+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:43.719 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:42.462059+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:32:43.719 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:42.462934+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:32:43.719 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:42.471611+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:43.719 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:42.476787+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-19T21:32:43.720 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ignoring --setuser ceph since I am not root 2024-02-19T21:32:43.720 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ignoring --setgroup ceph since I am not root 2024-02-19T21:32:43.720 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:32:43.634+0000 7f3ade037680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-19T21:32:43.720 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:32:43.715+0000 7f3ade037680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-19T21:32:43.724 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:41.947383+0000 mgr.y (mgr.14146) 230 : cluster [DBG] pgmap v222: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 574 B/s rd, 287 B/s wr, 2 op/s 2024-02-19T21:32:43.724 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:42.461121+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:43.724 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:42.462059+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:32:43.724 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:42.462934+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:32:43.724 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:42.471611+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:43.724 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:42.476787+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-19T21:32:43.725 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:41.947383+0000 mgr.y (mgr.14146) 230 : cluster [DBG] pgmap v222: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 574 B/s rd, 287 B/s wr, 2 op/s 2024-02-19T21:32:43.725 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:42.461121+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:43.725 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:42.462059+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:32:43.725 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:42.462934+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:32:43.725 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:42.471611+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' 2024-02-19T21:32:43.725 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:42.476787+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-19T21:32:43.725 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ignoring --setuser ceph since I am not root 2024-02-19T21:32:43.725 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ignoring --setgroup ceph since I am not root 2024-02-19T21:32:43.726 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:32:43.519+0000 7fb10ecb9700 1 -- 172.21.15.80:0/1535836755 <== mon.2 v2:172.21.15.80:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56540d02e4e0 con 0x56540d005400 2024-02-19T21:32:43.726 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:32:43.640+0000 7fb11ee96680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-19T21:32:43.726 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:32:43.721+0000 7fb11ee96680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-19T21:32:44.349 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:32:44.078+0000 7fb11ee96680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-19T21:32:44.479 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:32:44.094+0000 7f3ade037680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-19T21:32:44.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:43.482479+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-19T21:32:44.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:43.482556+0000 mon.a (mon.0) 629 : cluster [DBG] mgrmap e16: y(active, since 5m), standbys: x 2024-02-19T21:32:44.818 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:43.482479+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-19T21:32:44.818 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:43.482556+0000 mon.a (mon.0) 629 : cluster [DBG] mgrmap e16: y(active, since 5m), standbys: x 2024-02-19T21:32:44.818 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:43.482479+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14146 172.21.15.80:0/3416507344' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-19T21:32:44.818 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:43.482556+0000 mon.a (mon.0) 629 : cluster [DBG] mgrmap e16: y(active, since 5m), standbys: x 2024-02-19T21:32:45.099 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:32:44.814+0000 7fb11ee96680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-19T21:32:45.099 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:32:44.904+0000 7fb11ee96680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-19T21:32:45.159 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:32:44.860+0000 7f3ade037680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-19T21:32:45.159 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:32:44.943+0000 7f3ade037680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-19T21:32:45.559 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:32:45.156+0000 7f3ade037680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-19T21:32:45.599 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:32:45.115+0000 7fb11ee96680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-19T21:32:46.093 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:44.817406+0000 mon.a (mon.0) 630 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2024-02-19T21:32:46.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:44.817406+0000 mon.a (mon.0) 630 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2024-02-19T21:32:46.099 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:32:46.044+0000 7fb11ee96680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-19T21:32:46.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:44.817406+0000 mon.a (mon.0) 630 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2024-02-19T21:32:46.388 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:32:46.089+0000 7f3ade037680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-19T21:32:46.389 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:32:46.217+0000 7f3ade037680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-19T21:32:46.389 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:32:46.296+0000 7f3ade037680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-19T21:32:46.536 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:32:46.172+0000 7fb11ee96680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-19T21:32:46.536 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:32:46.250+0000 7fb11ee96680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-19T21:32:46.536 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:32:46.339+0000 7fb11ee96680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-19T21:32:46.536 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:32:46.533+0000 7fb11ee96680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-19T21:32:46.809 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:32:46.385+0000 7f3ade037680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-19T21:32:46.809 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:32:46.584+0000 7f3ade037680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-19T21:32:47.099 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:32:46.809+0000 7fb11ee96680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-19T21:32:47.099 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:32:46.907+0000 7fb11ee96680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-19T21:32:47.309 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:32:46.861+0000 7f3ade037680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-19T21:32:47.309 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:32:46.957+0000 7f3ade037680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-19T21:32:47.970 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:32:47.621+0000 7fb11ee96680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-19T21:32:47.970 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:32:47.703+0000 7fb11ee96680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-19T21:32:47.970 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:32:47.794+0000 7fb11ee96680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-19T21:32:47.970 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:32:47.967+0000 7fb11ee96680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-19T21:32:48.026 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:32:47.679+0000 7f3ade037680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-19T21:32:48.027 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:32:47.761+0000 7f3ade037680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-19T21:32:48.027 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:32:47.850+0000 7f3ade037680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-19T21:32:48.225 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:47.061811+0000 osd.5 (osd.5) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:32:48.225 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:47.061864+0000 osd.5 (osd.5) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:32:48.225 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:47.119294+0000 mon.a (mon.0) 631 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2024-02-19T21:32:48.226 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:47.061811+0000 osd.5 (osd.5) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:32:48.226 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:47.061864+0000 osd.5 (osd.5) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:32:48.226 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:47.119294+0000 mon.a (mon.0) 631 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2024-02-19T21:32:48.287 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:32:48.023+0000 7f3ade037680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-19T21:32:48.287 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:47.061811+0000 osd.5 (osd.5) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:32:48.287 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:47.061864+0000 osd.5 (osd.5) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:32:48.287 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:47.119294+0000 mon.a (mon.0) 631 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2024-02-19T21:32:48.485 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:32:48.223+0000 7fb11ee96680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-19T21:32:48.485 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:32:48.352+0000 7fb11ee96680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-19T21:32:48.550 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:32:48.283+0000 7f3ade037680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-19T21:32:48.550 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:32:48.414+0000 7f3ade037680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-19T21:32:48.738 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:32:48.483+0000 7fb11ee96680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-19T21:32:48.739 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:32:48.653+0000 7fb11ee96680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-19T21:32:48.807 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:32:48.546+0000 7f3ade037680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-19T21:32:48.807 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:32:48.717+0000 7f3ade037680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-19T21:32:48.994 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T21:32:48.736+0000 7fb11ee96680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-19T21:32:48.994 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:32:48] ENGINE Bus STARTING 2024-02-19T21:32:48.994 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [79B blob data] 2024-02-19T21:32:48.994 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [80B blob data] 2024-02-19T21:32:49.059 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: debug 2024-02-19T21:32:48.804+0000 7f3ade037680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-19T21:32:49.059 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: [19/Feb/2024:21:32:48] ENGINE Bus STARTING 2024-02-19T21:32:49.059 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: CherryPy Checker: 2024-02-19T21:32:49.059 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: The Application mounted at '' has an empty config. 2024-02-19T21:32:49.059 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: 2024-02-19T21:32:49.059 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: [19/Feb/2024:21:32:48] ENGINE Serving on http://:::9283 2024-02-19T21:32:49.059 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:32:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: [19/Feb/2024:21:32:48] ENGINE Bus STARTED 2024-02-19T21:32:49.349 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: CherryPy Checker: 2024-02-19T21:32:49.349 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: The Application mounted at '' has an empty config. 2024-02-19T21:32:49.349 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: 2024-02-19T21:32:49.349 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:32:49] ENGINE Serving on http://:::9283 2024-02-19T21:32:49.349 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:32:49] ENGINE Bus STARTED 2024-02-19T21:32:49.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:48.748946+0000 mon.a (mon.0) 632 : cluster [INF] Active manager daemon y restarted 2024-02-19T21:32:49.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:48.749286+0000 mon.a (mon.0) 633 : cluster [INF] Activating manager daemon y 2024-02-19T21:32:49.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:48.756459+0000 mon.a (mon.0) 634 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2024-02-19T21:32:49.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:48.757267+0000 mon.a (mon.0) 635 : cluster [DBG] mgrmap e17: y(active, starting, since 0.00805817s), standbys: x 2024-02-19T21:32:49.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:48.758834+0000 mon.a (mon.0) 636 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-19T21:32:49.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:48.759014+0000 mon.a (mon.0) 637 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-19T21:32:49.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:48.759195+0000 mon.a (mon.0) 638 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-19T21:32:49.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:48.759888+0000 mon.a (mon.0) 639 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-19T21:32:49.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:48.760108+0000 mon.a (mon.0) 640 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-19T21:32:49.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:48.760332+0000 mon.a (mon.0) 641 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:32:49.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:48.760580+0000 mon.a (mon.0) 642 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T21:32:49.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:48.760810+0000 mon.a (mon.0) 643 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:32:49.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:48.761054+0000 mon.a (mon.0) 644 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:32:49.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:48.761245+0000 mon.a (mon.0) 645 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:32:49.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:48.761410+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:32:49.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:48.761565+0000 mon.a (mon.0) 647 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:32:49.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:48.748946+0000 mon.a (mon.0) 632 : cluster [INF] Active manager daemon y restarted 2024-02-19T21:32:49.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:48.749286+0000 mon.a (mon.0) 633 : cluster [INF] Activating manager daemon y 2024-02-19T21:32:49.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:48.756459+0000 mon.a (mon.0) 634 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2024-02-19T21:32:49.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:48.757267+0000 mon.a (mon.0) 635 : cluster [DBG] mgrmap e17: y(active, starting, since 0.00805817s), standbys: x 2024-02-19T21:32:49.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:48.758834+0000 mon.a (mon.0) 636 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-19T21:32:49.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:48.759014+0000 mon.a (mon.0) 637 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-19T21:32:49.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:48.759195+0000 mon.a (mon.0) 638 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-19T21:32:49.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:48.759888+0000 mon.a (mon.0) 639 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-19T21:32:49.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:48.760108+0000 mon.a (mon.0) 640 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-19T21:32:49.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:48.760332+0000 mon.a (mon.0) 641 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:32:49.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:48.760580+0000 mon.a (mon.0) 642 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T21:32:49.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:48.760810+0000 mon.a (mon.0) 643 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:32:49.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:48.761054+0000 mon.a (mon.0) 644 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:32:49.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:48.761245+0000 mon.a (mon.0) 645 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:32:49.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:48.761410+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:32:49.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:48.761565+0000 mon.a (mon.0) 647 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:32:49.352 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:48.761796+0000 mon.a (mon.0) 648 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-19T21:32:49.353 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:48.762044+0000 mon.a (mon.0) 649 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T21:32:49.353 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:48.762207+0000 mon.a (mon.0) 650 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T21:32:49.353 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:48.762641+0000 mon.a (mon.0) 651 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T21:32:49.353 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:48.776457+0000 mon.a (mon.0) 652 : cluster [INF] Manager daemon y is now available 2024-02-19T21:32:49.353 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:48.818723+0000 mon.a (mon.0) 653 : cluster [DBG] Standby manager daemon x restarted 2024-02-19T21:32:49.353 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:48.818834+0000 mon.a (mon.0) 654 : cluster [DBG] Standby manager daemon x started 2024-02-19T21:32:49.353 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:48.820638+0000 mon.b (mon.1) 28 : audit [DBG] from='mgr.? 172.21.15.157:0/1049936409' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-19T21:32:49.353 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:48.821182+0000 mon.b (mon.1) 29 : audit [DBG] from='mgr.? 172.21.15.157:0/1049936409' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T21:32:49.353 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:48.822983+0000 mon.b (mon.1) 30 : audit [DBG] from='mgr.? 172.21.15.157:0/1049936409' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-19T21:32:49.353 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:48.823960+0000 mon.b (mon.1) 31 : audit [DBG] from='mgr.? 172.21.15.157:0/1049936409' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T21:32:49.353 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:48.873197+0000 mon.a (mon.0) 655 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:32:49.353 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:48.874513+0000 mon.a (mon.0) 656 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:32:49.353 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:48.908880+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:32:49.353 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:48.928349+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-19T21:32:49.354 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:48.941296+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-19T21:32:49.354 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:48.761796+0000 mon.a (mon.0) 648 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-19T21:32:49.354 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:48.762044+0000 mon.a (mon.0) 649 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T21:32:49.354 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:48.762207+0000 mon.a (mon.0) 650 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T21:32:49.354 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:48.762641+0000 mon.a (mon.0) 651 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T21:32:49.354 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:48.776457+0000 mon.a (mon.0) 652 : cluster [INF] Manager daemon y is now available 2024-02-19T21:32:49.354 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:48.818723+0000 mon.a (mon.0) 653 : cluster [DBG] Standby manager daemon x restarted 2024-02-19T21:32:49.354 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:48.818834+0000 mon.a (mon.0) 654 : cluster [DBG] Standby manager daemon x started 2024-02-19T21:32:49.354 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:48.820638+0000 mon.b (mon.1) 28 : audit [DBG] from='mgr.? 172.21.15.157:0/1049936409' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-19T21:32:49.354 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:48.821182+0000 mon.b (mon.1) 29 : audit [DBG] from='mgr.? 172.21.15.157:0/1049936409' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T21:32:49.354 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:48.822983+0000 mon.b (mon.1) 30 : audit [DBG] from='mgr.? 172.21.15.157:0/1049936409' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-19T21:32:49.355 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:48.823960+0000 mon.b (mon.1) 31 : audit [DBG] from='mgr.? 172.21.15.157:0/1049936409' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T21:32:49.355 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:48.873197+0000 mon.a (mon.0) 655 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:32:49.355 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:48.874513+0000 mon.a (mon.0) 656 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:32:49.355 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:48.908880+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:32:49.355 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:48.928349+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-19T21:32:49.355 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:48.941296+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-19T21:32:49.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:48.748946+0000 mon.a (mon.0) 632 : cluster [INF] Active manager daemon y restarted 2024-02-19T21:32:49.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:48.749286+0000 mon.a (mon.0) 633 : cluster [INF] Activating manager daemon y 2024-02-19T21:32:49.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:48.756459+0000 mon.a (mon.0) 634 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2024-02-19T21:32:49.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:48.757267+0000 mon.a (mon.0) 635 : cluster [DBG] mgrmap e17: y(active, starting, since 0.00805817s), standbys: x 2024-02-19T21:32:49.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:48.758834+0000 mon.a (mon.0) 636 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-19T21:32:49.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:48.759014+0000 mon.a (mon.0) 637 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-19T21:32:49.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:48.759195+0000 mon.a (mon.0) 638 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-19T21:32:49.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:48.759888+0000 mon.a (mon.0) 639 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-19T21:32:49.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:48.760108+0000 mon.a (mon.0) 640 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-19T21:32:49.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:48.760332+0000 mon.a (mon.0) 641 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:32:49.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:48.760580+0000 mon.a (mon.0) 642 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T21:32:49.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:48.760810+0000 mon.a (mon.0) 643 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:32:49.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:48.761054+0000 mon.a (mon.0) 644 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:32:49.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:48.761245+0000 mon.a (mon.0) 645 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:32:49.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:48.761410+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:32:49.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:48.761565+0000 mon.a (mon.0) 647 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:32:49.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:48.761796+0000 mon.a (mon.0) 648 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-19T21:32:49.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:48.762044+0000 mon.a (mon.0) 649 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T21:32:49.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:48.762207+0000 mon.a (mon.0) 650 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T21:32:49.561 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:48.762641+0000 mon.a (mon.0) 651 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T21:32:49.561 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:48.776457+0000 mon.a (mon.0) 652 : cluster [INF] Manager daemon y is now available 2024-02-19T21:32:49.561 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:48.818723+0000 mon.a (mon.0) 653 : cluster [DBG] Standby manager daemon x restarted 2024-02-19T21:32:49.561 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:48.818834+0000 mon.a (mon.0) 654 : cluster [DBG] Standby manager daemon x started 2024-02-19T21:32:49.561 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:48.820638+0000 mon.b (mon.1) 28 : audit [DBG] from='mgr.? 172.21.15.157:0/1049936409' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-19T21:32:49.561 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:48.821182+0000 mon.b (mon.1) 29 : audit [DBG] from='mgr.? 172.21.15.157:0/1049936409' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T21:32:49.561 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:48.822983+0000 mon.b (mon.1) 30 : audit [DBG] from='mgr.? 172.21.15.157:0/1049936409' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-19T21:32:49.561 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:48.823960+0000 mon.b (mon.1) 31 : audit [DBG] from='mgr.? 172.21.15.157:0/1049936409' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T21:32:49.561 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:48.873197+0000 mon.a (mon.0) 655 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:32:49.561 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:48.874513+0000 mon.a (mon.0) 656 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:32:49.561 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:48.908880+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:32:49.561 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:48.928349+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-19T21:32:49.561 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:48.941296+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-19T21:32:49.770 INFO:teuthology.orchestra.run.smithi157.stdout:Scheduled grafana update... 2024-02-19T21:32:50.059 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:32:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:32:50.482 DEBUG:teuthology.orchestra.run.smithi157:grafana.a> sudo journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@grafana.a.service 2024-02-19T21:32:50.484 INFO:tasks.cephadm:Setting up client nodes... 2024-02-19T21:32:50.484 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-19T21:32:50.515 INFO:journalctl@ceph.grafana.a.smithi157.stdout:-- Logs begin at Mon 2024-02-19 21:08:46 UTC. -- 2024-02-19T21:32:50.763 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:49.759612+0000 mon.a (mon.0) 660 : cluster [DBG] mgrmap e18: y(active, since 1.01039s), standbys: x 2024-02-19T21:32:50.763 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:32:49.764562+0000 mgr.y (mgr.14514) 4 : cephadm [INF] Saving service grafana spec with placement smithi157=a;count:1 2024-02-19T21:32:50.763 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:49.767484+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:32:50.763 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:50.536757+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:32:50.763 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:49.759612+0000 mon.a (mon.0) 660 : cluster [DBG] mgrmap e18: y(active, since 1.01039s), standbys: x 2024-02-19T21:32:50.763 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:32:49.764562+0000 mgr.y (mgr.14514) 4 : cephadm [INF] Saving service grafana spec with placement smithi157=a;count:1 2024-02-19T21:32:50.763 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:49.767484+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:32:50.763 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:50.536757+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:32:51.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:49.759612+0000 mon.a (mon.0) 660 : cluster [DBG] mgrmap e18: y(active, since 1.01039s), standbys: x 2024-02-19T21:32:51.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:32:49.764562+0000 mgr.y (mgr.14514) 4 : cephadm [INF] Saving service grafana spec with placement smithi157=a;count:1 2024-02-19T21:32:51.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:49.767484+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:32:51.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:50.536757+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:32:52.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:50.572181+0000 osd.6 (osd.6) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:32:52.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:50.572309+0000 osd.6 (osd.6) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:32:52.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:50.761304+0000 mgr.y (mgr.14514) 5 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:32:52.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:50.828812+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:52.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:50.829460+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:52.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:50.829919+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:52.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:50.830379+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:52.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:32:50.830734+0000 mgr.y (mgr.14514) 6 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 3768M 2024-02-19T21:32:52.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:50.834678+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:32:52.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:51.540528+0000 mon.a (mon.0) 668 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2024-02-19T21:32:52.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:51.540976+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-19T21:32:52.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:51.541672+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-19T21:32:52.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:50.572181+0000 osd.6 (osd.6) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:32:52.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:50.572309+0000 osd.6 (osd.6) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:32:52.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:50.761304+0000 mgr.y (mgr.14514) 5 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:32:52.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:50.828812+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:52.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:50.829460+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:52.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:50.829919+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:52.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:50.830379+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:52.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:32:50.830734+0000 mgr.y (mgr.14514) 6 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 3768M 2024-02-19T21:32:52.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:50.834678+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:32:52.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:51.540528+0000 mon.a (mon.0) 668 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2024-02-19T21:32:52.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:51.540976+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-19T21:32:52.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:51.541672+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-19T21:32:52.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:50.572181+0000 osd.6 (osd.6) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:32:52.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:50.572309+0000 osd.6 (osd.6) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:32:52.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:50.761304+0000 mgr.y (mgr.14514) 5 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:32:52.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:50.828812+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:52.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:50.829460+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:52.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:50.829919+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:52.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:50.830379+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:52.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:32:50.830734+0000 mgr.y (mgr.14514) 6 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 3768M 2024-02-19T21:32:52.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:50.834678+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:32:52.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:51.540528+0000 mon.a (mon.0) 668 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2024-02-19T21:32:52.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:51.540976+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-19T21:32:52.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:51.541672+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-19T21:32:53.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:51.761843+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:32:53.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:51.769062+0000 mon.a (mon.0) 672 : cluster [DBG] mgrmap e19: y(active, since 3s), standbys: x 2024-02-19T21:32:53.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:52.034677+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:53.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:52.035327+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:53.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:52.035872+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:53.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:52.036415+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:53.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:32:52.036829+0000 mgr.y (mgr.14514) 7 : cephadm [INF] Adjusting osd_memory_target on smithi157 to 4024M 2024-02-19T21:32:53.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:52.040490+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:32:53.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:52.041225+0000 mon.a (mon.0) 678 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:32:53.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:52.041795+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:32:53.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:32:52.042859+0000 mgr.y (mgr.14514) 8 : cephadm [INF] Updating smithi080:/etc/ceph/ceph.conf 2024-02-19T21:32:53.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:32:52.043128+0000 mgr.y (mgr.14514) 9 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.conf 2024-02-19T21:32:53.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:32:52.088209+0000 mgr.y (mgr.14514) 10 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-02-19T21:32:53.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:52.113633+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:32:53.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:32:52.119357+0000 mgr.y (mgr.14514) 11 : cephadm [INF] Updating smithi080:/etc/ceph/ceph.client.admin.keyring 2024-02-19T21:32:53.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:52.179480+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:32:53.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:52.184936+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:32:53.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:32:52.194001+0000 mgr.y (mgr.14514) 12 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-02-19T21:32:53.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:52.540793+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-19T21:32:53.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:52.540860+0000 mon.a (mon.0) 684 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2024-02-19T21:32:53.096 INFO:teuthology.orchestra.run.smithi080.stdout:[client.0] 2024-02-19T21:32:53.096 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQAFydNlafFBBRAANxfKrvB1W3yONZ9nNVm9Og== 2024-02-19T21:32:53.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:51.761843+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:32:53.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:51.769062+0000 mon.a (mon.0) 672 : cluster [DBG] mgrmap e19: y(active, since 3s), standbys: x 2024-02-19T21:32:53.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:52.034677+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:53.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:52.035327+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:53.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:52.035872+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:53.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:52.036415+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:53.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:32:52.036829+0000 mgr.y (mgr.14514) 7 : cephadm [INF] Adjusting osd_memory_target on smithi157 to 4024M 2024-02-19T21:32:53.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:52.040490+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:32:53.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:52.041225+0000 mon.a (mon.0) 678 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:32:53.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:52.041795+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:32:53.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:32:52.042859+0000 mgr.y (mgr.14514) 8 : cephadm [INF] Updating smithi080:/etc/ceph/ceph.conf 2024-02-19T21:32:53.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:32:52.043128+0000 mgr.y (mgr.14514) 9 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.conf 2024-02-19T21:32:53.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:32:52.088209+0000 mgr.y (mgr.14514) 10 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-02-19T21:32:53.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:52.113633+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:32:53.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:32:52.119357+0000 mgr.y (mgr.14514) 11 : cephadm [INF] Updating smithi080:/etc/ceph/ceph.client.admin.keyring 2024-02-19T21:32:53.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:52.179480+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:32:53.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:52.184936+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:32:53.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:51.761843+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:32:53.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:51.769062+0000 mon.a (mon.0) 672 : cluster [DBG] mgrmap e19: y(active, since 3s), standbys: x 2024-02-19T21:32:53.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:52.034677+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:53.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:52.035327+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:53.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:52.035872+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:53.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:52.036415+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:32:53.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:32:52.036829+0000 mgr.y (mgr.14514) 7 : cephadm [INF] Adjusting osd_memory_target on smithi157 to 4024M 2024-02-19T21:32:53.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:52.040490+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:32:53.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:52.041225+0000 mon.a (mon.0) 678 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:32:53.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:52.041795+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:32:53.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:32:52.042859+0000 mgr.y (mgr.14514) 8 : cephadm [INF] Updating smithi080:/etc/ceph/ceph.conf 2024-02-19T21:32:53.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:32:52.043128+0000 mgr.y (mgr.14514) 9 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.conf 2024-02-19T21:32:53.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:32:52.088209+0000 mgr.y (mgr.14514) 10 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-02-19T21:32:53.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:52.113633+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:32:53.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:32:52.119357+0000 mgr.y (mgr.14514) 11 : cephadm [INF] Updating smithi080:/etc/ceph/ceph.client.admin.keyring 2024-02-19T21:32:53.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:52.179480+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:32:53.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:52.184936+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:32:53.102 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:32:52.194001+0000 mgr.y (mgr.14514) 12 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-02-19T21:32:53.102 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:52.540793+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-19T21:32:53.102 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:52.540860+0000 mon.a (mon.0) 684 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2024-02-19T21:32:53.102 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:32:52.194001+0000 mgr.y (mgr.14514) 12 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-02-19T21:32:53.102 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:52.540793+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-19T21:32:53.102 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:52.540860+0000 mon.a (mon.0) 684 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2024-02-19T21:32:54.017 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-19T21:32:54.017 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-02-19T21:32:54.017 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-19T21:32:54.043 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:52.761674+0000 mgr.y (mgr.14514) 13 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:32:54.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:52.789315+0000 osd.2 (osd.2) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:32:54.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:52.789360+0000 osd.2 (osd.2) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:32:54.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:53.087729+0000 mon.c (mon.2) 11 : audit [INF] from='client.? 172.21.15.80:0/3799820127' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T21:32:54.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:53.088034+0000 mon.a (mon.0) 685 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T21:32:54.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:53.093791+0000 mon.a (mon.0) 686 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-19T21:32:54.044 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:52.761674+0000 mgr.y (mgr.14514) 13 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:32:54.044 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:52.789315+0000 osd.2 (osd.2) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:32:54.044 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:52.789360+0000 osd.2 (osd.2) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:32:54.044 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:53.087729+0000 mon.c (mon.2) 11 : audit [INF] from='client.? 172.21.15.80:0/3799820127' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T21:32:54.044 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:53.088034+0000 mon.a (mon.0) 685 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T21:32:54.044 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:53.093791+0000 mon.a (mon.0) 686 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-19T21:32:54.058 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-19T21:32:54.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:52.761674+0000 mgr.y (mgr.14514) 13 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:32:54.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:52.789315+0000 osd.2 (osd.2) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:32:54.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:52.789360+0000 osd.2 (osd.2) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:32:54.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:53.087729+0000 mon.c (mon.2) 11 : audit [INF] from='client.? 172.21.15.80:0/3799820127' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T21:32:54.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:53.088034+0000 mon.a (mon.0) 685 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T21:32:54.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:53.093791+0000 mon.a (mon.0) 686 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-19T21:32:55.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:53.776629+0000 mon.a (mon.0) 687 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2024-02-19T21:32:55.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:53.776629+0000 mon.a (mon.0) 687 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2024-02-19T21:32:55.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:53.776629+0000 mon.a (mon.0) 687 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2024-02-19T21:32:56.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:54.762172+0000 mgr.y (mgr.14514) 14 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1 KiB/s rd, 1 op/s 2024-02-19T21:32:56.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:54.820947+0000 mon.a (mon.0) 688 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2024-02-19T21:32:56.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:54.762172+0000 mgr.y (mgr.14514) 14 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1 KiB/s rd, 1 op/s 2024-02-19T21:32:56.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:54.820947+0000 mon.a (mon.0) 688 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2024-02-19T21:32:56.268 INFO:teuthology.orchestra.run.smithi157.stdout:[client.1] 2024-02-19T21:32:56.268 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQAIydNlIMeiDxAAEFd0SPwCH2gyOhGkSsv5oA== 2024-02-19T21:32:56.298 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:54.762172+0000 mgr.y (mgr.14514) 14 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1 KiB/s rd, 1 op/s 2024-02-19T21:32:56.298 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:54.820947+0000 mon.a (mon.0) 688 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2024-02-19T21:32:56.946 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:56.261745+0000 mon.b (mon.1) 32 : audit [INF] from='client.? 172.21.15.157:0/972642311' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T21:32:56.946 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:56.262187+0000 mon.a (mon.0) 689 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T21:32:56.946 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:56.265325+0000 mon.a (mon.0) 690 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-19T21:32:56.965 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-02-19T21:32:56.965 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-02-19T21:32:56.965 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-19T21:32:57.005 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd dump --format=json 2024-02-19T21:32:57.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:56.261745+0000 mon.b (mon.1) 32 : audit [INF] from='client.? 172.21.15.157:0/972642311' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T21:32:57.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:56.262187+0000 mon.a (mon.0) 689 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T21:32:57.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:56.265325+0000 mon.a (mon.0) 690 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-19T21:32:57.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:56.261745+0000 mon.b (mon.1) 32 : audit [INF] from='client.? 172.21.15.157:0/972642311' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T21:32:57.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:56.262187+0000 mon.a (mon.0) 689 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T21:32:57.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:56.265325+0000 mon.a (mon.0) 690 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-19T21:32:58.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:56.762660+0000 mgr.y (mgr.14514) 15 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 980 B/s rd, 0 op/s 2024-02-19T21:32:58.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:56.927835+0000 osd.0 (osd.0) 7 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:32:58.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:56.927878+0000 osd.0 (osd.0) 8 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:32:58.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:32:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:57.828527+0000 mon.a (mon.0) 691 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2024-02-19T21:32:58.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:56.762660+0000 mgr.y (mgr.14514) 15 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 980 B/s rd, 0 op/s 2024-02-19T21:32:58.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:56.927835+0000 osd.0 (osd.0) 7 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:32:58.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:56.927878+0000 osd.0 (osd.0) 8 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:32:58.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:32:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:57.828527+0000 mon.a (mon.0) 691 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2024-02-19T21:32:58.420 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:32:58.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:56.762660+0000 mgr.y (mgr.14514) 15 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 980 B/s rd, 0 op/s 2024-02-19T21:32:58.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:56.927835+0000 osd.0 (osd.0) 7 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:32:58.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:56.927878+0000 osd.0 (osd.0) 8 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:32:58.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:32:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:57.828527+0000 mon.a (mon.0) 691 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2024-02-19T21:33:00.059 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:32:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:33:00.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:58.763027+0000 mgr.y (mgr.14514) 16 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:33:00.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:32:59.825162+0000 mon.a (mon.0) 692 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2024-02-19T21:33:00.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:58.763027+0000 mgr.y (mgr.14514) 16 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:33:00.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:32:59.825162+0000 mon.a (mon.0) 692 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2024-02-19T21:33:00.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:58.763027+0000 mgr.y (mgr.14514) 16 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:33:00.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:32:59.825162+0000 mon.a (mon.0) 692 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2024-02-19T21:33:01.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:32:59.772695+0000 mgr.y (mgr.14514) 17 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:33:01.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:00.050974+0000 osd.4 (osd.4) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:33:01.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:00.051048+0000 osd.4 (osd.4) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:33:01.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:00.822722+0000 mon.a (mon.0) 693 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2024-02-19T21:33:01.569 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:32:59.772695+0000 mgr.y (mgr.14514) 17 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:33:01.569 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:00.050974+0000 osd.4 (osd.4) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:33:01.569 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:00.051048+0000 osd.4 (osd.4) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:33:01.569 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:00.822722+0000 mon.a (mon.0) 693 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2024-02-19T21:33:01.569 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:32:59.772695+0000 mgr.y (mgr.14514) 17 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:33:01.569 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:00.050974+0000 osd.4 (osd.4) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:33:01.569 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:00.051048+0000 osd.4 (osd.4) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:33:01.569 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:00.822722+0000 mon.a (mon.0) 693 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2024-02-19T21:33:02.241 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:33:02.241 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":79,"fsid":"6f763558-cf6d-11ee-95bb-87774f69a715","created":"2024-02-19T21:26:16.880265+0000","modified":"2024-02-19T21:33:00.818620+0000","last_up_change":"2024-02-19T21:32:14.805693+0000","last_in_change":"2024-02-19T21:31:56.867171+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-19T21:30:05.947623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-02-19T21:32:22.082250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2024-02-19T21:32:22.333164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2024-02-19T21:32:23.632615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-02-19T21:32:25.600876+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-02-19T21:32:27.661242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"a72c63f6-46b3-4202-99da-7b0c92b799a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":3531298825},{"type":"v1","addr":"172.21.15.80:6803","nonce":3531298825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":3531298825},{"type":"v1","addr":"172.21.15.80:6805","nonce":3531298825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":3531298825},{"type":"v1","addr":"172.21.15.80:6809","nonce":3531298825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":3531298825},{"type":"v1","addr":"172.21.15.80:6807","nonce":3531298825}]},"public_addr":"172.21.15.80:6803/3531298825","cluster_addr":"172.21.15.80:6805/3531298825","heartbeat_back_addr":"172.21.15.80:6809/3531298825","heartbeat_front_addr":"172.21.15.80:6807/3531298825","state":["exists","up"]},{"osd":1,"uuid":"7d4e170e-b0ca-4e19-be35-4038ca126ee6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1497235950},{"type":"v1","addr":"172.21.15.80:6811","nonce":1497235950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1497235950},{"type":"v1","addr":"172.21.15.80:6813","nonce":1497235950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1497235950},{"type":"v1","addr":"172.21.15.80:6817","nonce":1497235950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1497235950},{"type":"v1","addr":"172.21.15.80:6815","nonce":1497235950}]},"public_addr":"172.21.15.80:6811/1497235950","cluster_addr":"172.21.15.80:6813/1497235950","heartbeat_back_addr":"172.21.15.80:6817/1497235950","heartbeat_front_addr":"172.21.15.80:6815/1497235950","state":["exists","up"]},{"osd":2,"uuid":"cf461b67-f3e8-45e9-b2f6-777752ba5574","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3131848307},{"type":"v1","addr":"172.21.15.80:6819","nonce":3131848307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3131848307},{"type":"v1","addr":"172.21.15.80:6821","nonce":3131848307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3131848307},{"type":"v1","addr":"172.21.15.80:6825","nonce":3131848307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3131848307},{"type":"v1","addr":"172.21.15.80:6823","nonce":3131848307}]},"public_addr":"172.21.15.80:6819/3131848307","cluster_addr":"172.21.15.80:6821/3131848307","heartbeat_back_addr":"172.21.15.80:6825/3131848307","heartbeat_front_addr":"172.21.15.80:6823/3131848307","state":["exists","up"]},{"osd":3,"uuid":"76318cdd-5fce-4a40-95c9-300d55c34820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2007978078},{"type":"v1","addr":"172.21.15.80:6827","nonce":2007978078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2007978078},{"type":"v1","addr":"172.21.15.80:6829","nonce":2007978078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2007978078},{"type":"v1","addr":"172.21.15.80:6833","nonce":2007978078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2007978078},{"type":"v1","addr":"172.21.15.80:6831","nonce":2007978078}]},"public_addr":"172.21.15.80:6827/2007978078","cluster_addr":"172.21.15.80:6829/2007978078","heartbeat_back_addr":"172.21.15.80:6833/2007978078","heartbeat_front_addr":"172.21.15.80:6831/2007978078","state":["exists","up"]},{"osd":4,"uuid":"6484964f-3391-4e1d-a56c-813f46124062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1922002860},{"type":"v1","addr":"172.21.15.157:6801","nonce":1922002860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1922002860},{"type":"v1","addr":"172.21.15.157:6803","nonce":1922002860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1922002860},{"type":"v1","addr":"172.21.15.157:6807","nonce":1922002860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1922002860},{"type":"v1","addr":"172.21.15.157:6805","nonce":1922002860}]},"public_addr":"172.21.15.157:6801/1922002860","cluster_addr":"172.21.15.157:6803/1922002860","heartbeat_back_addr":"172.21.15.157:6807/1922002860","heartbeat_front_addr":"172.21.15.157:6805/1922002860","state":["exists","up"]},{"osd":5,"uuid":"8c7e0309-8c3b-40b9-99d9-96620e52742f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":960889603},{"type":"v1","addr":"172.21.15.157:6809","nonce":960889603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":960889603},{"type":"v1","addr":"172.21.15.157:6811","nonce":960889603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":960889603},{"type":"v1","addr":"172.21.15.157:6815","nonce":960889603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":960889603},{"type":"v1","addr":"172.21.15.157:6813","nonce":960889603}]},"public_addr":"172.21.15.157:6809/960889603","cluster_addr":"172.21.15.157:6811/960889603","heartbeat_back_addr":"172.21.15.157:6815/960889603","heartbeat_front_addr":"172.21.15.157:6813/960889603","state":["exists","up"]},{"osd":6,"uuid":"5b7d44a3-197d-482c-bf9e-de5e9013a851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":2598265223},{"type":"v1","addr":"172.21.15.157:6817","nonce":2598265223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":2598265223},{"type":"v1","addr":"172.21.15.157:6819","nonce":2598265223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":2598265223},{"type":"v1","addr":"172.21.15.157:6823","nonce":2598265223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":2598265223},{"type":"v1","addr":"172.21.15.157:6821","nonce":2598265223}]},"public_addr":"172.21.15.157:6817/2598265223","cluster_addr":"172.21.15.157:6819/2598265223","heartbeat_back_addr":"172.21.15.157:6823/2598265223","heartbeat_front_addr":"172.21.15.157:6821/2598265223","state":["exists","up"]},{"osd":7,"uuid":"7e2d0287-928d-40f8-841b-6c2077fc08ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3619345894},{"type":"v1","addr":"172.21.15.157:6825","nonce":3619345894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3619345894},{"type":"v1","addr":"172.21.15.157:6827","nonce":3619345894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3619345894},{"type":"v1","addr":"172.21.15.157:6831","nonce":3619345894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3619345894},{"type":"v1","addr":"172.21.15.157:6829","nonce":3619345894}]},"public_addr":"172.21.15.157:6825/3619345894","cluster_addr":"172.21.15.157:6827/3619345894","heartbeat_back_addr":"172.21.15.157:6831/3619345894","heartbeat_front_addr":"172.21.15.157:6829/3619345894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:32:56.927881+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:31:56.518768+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:32:52.789375+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:32:38.224945+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:33:00.051050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:32:47.061866+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:32:50.572313+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:32:13.288953+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6800/2867197629":"2024-02-20T21:32:48.748960+0000","172.21.15.80:0/1659656010":"2024-02-20T21:32:48.748960+0000","172.21.15.80:6801/2272739550":"2024-02-20T21:27:15.880876+0000","172.21.15.80:0/867908385":"2024-02-20T21:27:15.880876+0000","172.21.15.80:0/398750494":"2024-02-20T21:32:48.748960+0000","172.21.15.80:0/2833137430":"2024-02-20T21:27:15.880876+0000","172.21.15.80:0/2520755315":"2024-02-20T21:32:48.748960+0000","172.21.15.80:6800/2094869828":"2024-02-20T21:26:51.262073+0000","172.21.15.80:6800/2272739550":"2024-02-20T21:27:15.880876+0000","172.21.15.80:6801/2094869828":"2024-02-20T21:26:51.262073+0000","172.21.15.80:0/2130852198":"2024-02-20T21:26:51.262073+0000","172.21.15.80:6801/2867197629":"2024-02-20T21:32:48.748960+0000","172.21.15.80:0/1952386920":"2024-02-20T21:26:51.262073+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T21:33:02.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:00.763484+0000 mgr.y (mgr.14514) 18 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:33:02.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:01.478314+0000 mon.c (mon.2) 12 : audit [DBG] from='client.? 172.21.15.80:0/2578805348' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:33:02.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:00.763484+0000 mgr.y (mgr.14514) 18 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:33:02.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:01.478314+0000 mon.c (mon.2) 12 : audit [DBG] from='client.? 172.21.15.80:0/2578805348' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:33:02.316 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:02 smithi080 systemd[1]: Starting Ceph alertmanager.a for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T21:33:02.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:00.763484+0000 mgr.y (mgr.14514) 18 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:33:02.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:01.478314+0000 mon.c (mon.2) 12 : audit [DBG] from='client.? 172.21.15.80:0/2578805348' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:33:02.943 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-19T21:30:05.947623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2024-02-19T21:32:22.082250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2024-02-19T21:32:22.333164+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 3, 'pg_placement_num': 3, 'pg_placement_num_target': 3, 'pg_num_target': 3, 'pg_num_pending': 3, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2024-02-19T21:32:23.632615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2024-02-19T21:32:25.600876+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2024-02-19T21:32:27.661242+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}}] 2024-02-19T21:33:02.943 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool get device_health_metrics pg_num 2024-02-19T21:33:03.849 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:33:04.099 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-alertmanager-a[67585]: level=info ts=2024-02-19T21:33:03.717Z caller=main.go:225 msg="Starting Alertmanager" version="(version=0.23.0, branch=HEAD, revision=61046b17771a57cfd4c4a51be370ab930a4d7d54)" 2024-02-19T21:33:04.099 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-alertmanager-a[67585]: level=info ts=2024-02-19T21:33:03.717Z caller=main.go:226 build_context="(go=go1.16.7, user=root@e21a959be8d2, date=20210825-10:48:55)" 2024-02-19T21:33:04.099 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-alertmanager-a[67585]: level=info ts=2024-02-19T21:33:03.718Z caller=cluster.go:184 component=cluster msg="setting advertise address explicitly" addr=172.21.15.80 port=9094 2024-02-19T21:33:04.099 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-alertmanager-a[67585]: level=info ts=2024-02-19T21:33:03.719Z caller=cluster.go:671 component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-02-19T21:33:04.099 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-alertmanager-a[67585]: level=info ts=2024-02-19T21:33:03.744Z caller=coordinator.go:113 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-19T21:33:04.099 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-alertmanager-a[67585]: level=info ts=2024-02-19T21:33:03.745Z caller=coordinator.go:126 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-19T21:33:04.099 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-alertmanager-a[67585]: level=info ts=2024-02-19T21:33:03.747Z caller=main.go:518 msg=Listening address=:9093 2024-02-19T21:33:04.099 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-alertmanager-a[67585]: level=info ts=2024-02-19T21:33:03.747Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2024-02-19T21:33:04.099 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:03 smithi080 bash[67544]: 16426370d85aa938cd985ae4ad2cd56ee463849e95a5136336046a12f083c922 2024-02-19T21:33:04.100 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:03 smithi080 systemd[1]: Started Ceph alertmanager.a for 6f763558-cf6d-11ee-95bb-87774f69a715. 2024-02-19T21:33:04.483 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:02.763928+0000 mgr.y (mgr.14514) 19 : cluster [DBG] pgmap v17: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:33:04.483 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:03.879564+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:04.483 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:03.916504+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:04.483 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:02.763928+0000 mgr.y (mgr.14514) 19 : cluster [DBG] pgmap v17: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:33:04.483 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:03.879564+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:04.483 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:03.916504+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:04.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:02.763928+0000 mgr.y (mgr.14514) 19 : cluster [DBG] pgmap v17: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:33:04.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:03.879564+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:04.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:03.916504+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:05.523 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:33:03.882635+0000 mgr.y (mgr.14514) 20 : cephadm [INF] Deploying daemon node-exporter.a on smithi080 2024-02-19T21:33:05.523 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:04.823253+0000 mon.a (mon.0) 696 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2024-02-19T21:33:05.523 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:33:03.882635+0000 mgr.y (mgr.14514) 20 : cephadm [INF] Deploying daemon node-exporter.a on smithi080 2024-02-19T21:33:05.523 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:04.823253+0000 mon.a (mon.0) 696 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2024-02-19T21:33:05.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:33:03.882635+0000 mgr.y (mgr.14514) 20 : cephadm [INF] Deploying daemon node-exporter.a on smithi080 2024-02-19T21:33:05.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:04.823253+0000 mon.a (mon.0) 696 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2024-02-19T21:33:05.849 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:05 smithi080 bash[67866]: Trying to pull quay.io/prometheus/node-exporter:v1.3.1... 2024-02-19T21:33:05.849 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-alertmanager-a[67585]: level=info ts=2024-02-19T21:33:05.720Z caller=cluster.go:696 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000491055s 2024-02-19T21:33:06.292 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:06 smithi080 bash[67866]: Getting image source signatures 2024-02-19T21:33:06.292 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:06 smithi080 bash[67866]: Copying blob sha256:aa2a8d90b84cb2a9c422e7005cd166a008ccf22ef5d7d4f07128478585ce35ea 2024-02-19T21:33:06.292 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:06 smithi080 bash[67866]: Copying blob sha256:b45d31ee2d7f9f452678a85b0c837c29e12089f31ee8dbac6c8c24dfa4054a30 2024-02-19T21:33:06.292 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:06 smithi080 bash[67866]: Copying blob sha256:b5db1e299295edf3005515ab7879c1df64a33c185d3a7a23aa4dcaa17d26f7b3 2024-02-19T21:33:06.311 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-02-19T21:33:06.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:04.764424+0000 mgr.y (mgr.14514) 21 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-19T21:33:06.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:04.764424+0000 mgr.y (mgr.14514) 21 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-19T21:33:06.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:04.764424+0000 mgr.y (mgr.14514) 21 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-19T21:33:07.295 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:06 smithi080 bash[67866]: Copying config sha256:1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 2024-02-19T21:33:07.295 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:07 smithi080 bash[67866]: Writing manifest to image destination 2024-02-19T21:33:07.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:06.308536+0000 mon.a (mon.0) 697 : audit [DBG] from='client.? 172.21.15.80:0/1745625958' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-19T21:33:07.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:06.308536+0000 mon.a (mon.0) 697 : audit [DBG] from='client.? 172.21.15.80:0/1745625958' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-19T21:33:07.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:06.308536+0000 mon.a (mon.0) 697 : audit [DBG] from='client.? 172.21.15.80:0/1745625958' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-19T21:33:07.747 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool get .rgw.root pg_num 2024-02-19T21:33:08.297 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.228Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-02-19T21:33:08.297 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.228Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-02-19T21:33:08.297 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-02-19T21:33:08.298 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-02-19T21:33:08.298 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-02-19T21:33:08.298 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=arp 2024-02-19T21:33:08.298 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=bcache 2024-02-19T21:33:08.298 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=bonding 2024-02-19T21:33:08.298 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=btrfs 2024-02-19T21:33:08.298 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=conntrack 2024-02-19T21:33:08.298 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=cpu 2024-02-19T21:33:08.298 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-02-19T21:33:08.298 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=diskstats 2024-02-19T21:33:08.298 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=dmi 2024-02-19T21:33:08.299 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=edac 2024-02-19T21:33:08.299 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=entropy 2024-02-19T21:33:08.299 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-02-19T21:33:08.299 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=filefd 2024-02-19T21:33:08.299 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=filesystem 2024-02-19T21:33:08.299 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=hwmon 2024-02-19T21:33:08.299 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=infiniband 2024-02-19T21:33:08.299 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=ipvs 2024-02-19T21:33:08.299 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=loadavg 2024-02-19T21:33:08.299 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=mdadm 2024-02-19T21:33:08.300 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=meminfo 2024-02-19T21:33:08.300 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=netclass 2024-02-19T21:33:08.300 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=netdev 2024-02-19T21:33:08.300 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=netstat 2024-02-19T21:33:08.300 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=nfs 2024-02-19T21:33:08.301 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=nfsd 2024-02-19T21:33:08.301 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=nvme 2024-02-19T21:33:08.301 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=os 2024-02-19T21:33:08.301 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-02-19T21:33:08.301 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=pressure 2024-02-19T21:33:08.301 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=rapl 2024-02-19T21:33:08.301 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=schedstat 2024-02-19T21:33:08.302 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=sockstat 2024-02-19T21:33:08.302 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=softnet 2024-02-19T21:33:08.302 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=stat 2024-02-19T21:33:08.302 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=tapestats 2024-02-19T21:33:08.302 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=textfile 2024-02-19T21:33:08.302 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-02-19T21:33:08.302 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=time 2024-02-19T21:33:08.302 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-02-19T21:33:08.302 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=uname 2024-02-19T21:33:08.302 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=vmstat 2024-02-19T21:33:08.302 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=xfs 2024-02-19T21:33:08.302 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:115 level=info collector=zfs 2024-02-19T21:33:08.302 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-02-19T21:33:08.303 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a[68019]: ts=2024-02-19T21:33:08.229Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-02-19T21:33:08.344 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:33:08.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:06.764964+0000 mgr.y (mgr.14514) 22 : cluster [DBG] pgmap v20: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 737 B/s rd, 0 op/s 2024-02-19T21:33:08.599 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 bash[67866]: 6b6fb1b639a2662f60c0b3c89c53b95215e2b211e3b502f1fb85896e7bf27f74 2024-02-19T21:33:08.599 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 21:33:08 smithi080 systemd[1]: Started Ceph node-exporter.a for 6f763558-cf6d-11ee-95bb-87774f69a715. 2024-02-19T21:33:08.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:06.764964+0000 mgr.y (mgr.14514) 22 : cluster [DBG] pgmap v20: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 737 B/s rd, 0 op/s 2024-02-19T21:33:08.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:06.764964+0000 mgr.y (mgr.14514) 22 : cluster [DBG] pgmap v20: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 737 B/s rd, 0 op/s 2024-02-19T21:33:09.309 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:08 smithi157 systemd[1]: Starting Ceph node-exporter.b for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T21:33:09.309 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:09 smithi157 bash[62583]: Trying to pull quay.io/prometheus/node-exporter:v1.3.1... 2024-02-19T21:33:09.786 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:08.374418+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:09.786 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:33:08.375304+0000 mgr.y (mgr.14514) 23 : cephadm [INF] Deploying daemon node-exporter.b on smithi157 2024-02-19T21:33:09.786 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:09 smithi157 bash[62583]: Getting image source signatures 2024-02-19T21:33:09.786 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:09 smithi157 bash[62583]: Copying blob sha256:b45d31ee2d7f9f452678a85b0c837c29e12089f31ee8dbac6c8c24dfa4054a30 2024-02-19T21:33:09.786 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:09 smithi157 bash[62583]: Copying blob sha256:b5db1e299295edf3005515ab7879c1df64a33c185d3a7a23aa4dcaa17d26f7b3 2024-02-19T21:33:09.786 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:09 smithi157 bash[62583]: Copying blob sha256:aa2a8d90b84cb2a9c422e7005cd166a008ccf22ef5d7d4f07128478585ce35ea 2024-02-19T21:33:09.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:08.374418+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:09.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:33:08.375304+0000 mgr.y (mgr.14514) 23 : cephadm [INF] Deploying daemon node-exporter.b on smithi157 2024-02-19T21:33:09.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:08.374418+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:09.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:33:08.375304+0000 mgr.y (mgr.14514) 23 : cephadm [INF] Deploying daemon node-exporter.b on smithi157 2024-02-19T21:33:10.059 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:33:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:33:10.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:08.765323+0000 mgr.y (mgr.14514) 24 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:33:10.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:08.765323+0000 mgr.y (mgr.14514) 24 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:33:10.608 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-02-19T21:33:10.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:08.765323+0000 mgr.y (mgr.14514) 24 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:33:11.359 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool get iscsi pg_num 2024-02-19T21:33:11.559 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:11 smithi157 bash[62583]: Copying config sha256:1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 2024-02-19T21:33:11.559 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:11 smithi157 bash[62583]: Writing manifest to image destination 2024-02-19T21:33:11.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:09.783720+0000 mgr.y (mgr.14514) 25 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:33:11.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:10.606357+0000 mon.c (mon.2) 13 : audit [DBG] from='client.? 172.21.15.80:0/512653366' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2024-02-19T21:33:11.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:10.728331+0000 osd.1 (osd.1) 9 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:33:11.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:10.728375+0000 osd.1 (osd.1) 10 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:33:11.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:09.783720+0000 mgr.y (mgr.14514) 25 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:33:11.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:10.606357+0000 mon.c (mon.2) 13 : audit [DBG] from='client.? 172.21.15.80:0/512653366' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2024-02-19T21:33:11.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:10.728331+0000 osd.1 (osd.1) 9 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:33:11.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:10.728375+0000 osd.1 (osd.1) 10 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:33:11.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:09.783720+0000 mgr.y (mgr.14514) 25 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:33:11.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:10.606357+0000 mon.c (mon.2) 13 : audit [DBG] from='client.? 172.21.15.80:0/512653366' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2024-02-19T21:33:11.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:10.728331+0000 osd.1 (osd.1) 9 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:33:11.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:10.728375+0000 osd.1 (osd.1) 10 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:33:11.632 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:33:12.393 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.074Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-02-19T21:33:12.393 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.074Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-02-19T21:33:12.393 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.074Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-02-19T21:33:12.393 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.074Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-02-19T21:33:12.393 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-02-19T21:33:12.393 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=arp 2024-02-19T21:33:12.394 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=bcache 2024-02-19T21:33:12.394 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=bonding 2024-02-19T21:33:12.394 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=btrfs 2024-02-19T21:33:12.394 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=conntrack 2024-02-19T21:33:12.394 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=cpu 2024-02-19T21:33:12.394 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-02-19T21:33:12.394 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=diskstats 2024-02-19T21:33:12.394 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=dmi 2024-02-19T21:33:12.394 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=edac 2024-02-19T21:33:12.394 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=entropy 2024-02-19T21:33:12.394 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-02-19T21:33:12.394 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=filefd 2024-02-19T21:33:12.394 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=filesystem 2024-02-19T21:33:12.395 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=hwmon 2024-02-19T21:33:12.395 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=infiniband 2024-02-19T21:33:12.395 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=ipvs 2024-02-19T21:33:12.395 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=loadavg 2024-02-19T21:33:12.395 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=mdadm 2024-02-19T21:33:12.395 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=meminfo 2024-02-19T21:33:12.395 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=netclass 2024-02-19T21:33:12.395 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=netdev 2024-02-19T21:33:12.395 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=netstat 2024-02-19T21:33:12.395 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=nfs 2024-02-19T21:33:12.395 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=nfsd 2024-02-19T21:33:12.396 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=nvme 2024-02-19T21:33:12.396 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=os 2024-02-19T21:33:12.396 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-02-19T21:33:12.396 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=pressure 2024-02-19T21:33:12.396 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=rapl 2024-02-19T21:33:12.396 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=schedstat 2024-02-19T21:33:12.396 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=sockstat 2024-02-19T21:33:12.396 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=softnet 2024-02-19T21:33:12.396 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=stat 2024-02-19T21:33:12.396 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=tapestats 2024-02-19T21:33:12.396 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=textfile 2024-02-19T21:33:12.396 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-02-19T21:33:12.396 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=time 2024-02-19T21:33:12.397 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-02-19T21:33:12.397 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=uname 2024-02-19T21:33:12.397 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=vmstat 2024-02-19T21:33:12.397 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=xfs 2024-02-19T21:33:12.397 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:115 level=info collector=zfs 2024-02-19T21:33:12.397 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-02-19T21:33:12.397 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b[62636]: ts=2024-02-19T21:33:12.075Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-02-19T21:33:12.397 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 bash[62583]: 992b68455a6d5a781739f2fc676394dec36ab0ed5a0ad3876ad87b052eaf589a 2024-02-19T21:33:12.397 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 21:33:12 smithi157 systemd[1]: Started Ceph node-exporter.b for 6f763558-cf6d-11ee-95bb-87774f69a715. 2024-02-19T21:33:12.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:10.765896+0000 mgr.y (mgr.14514) 26 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-19T21:33:12.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:11.394764+0000 mon.a (mon.0) 699 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2024-02-19T21:33:12.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:12.270683+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:12.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:10.765896+0000 mgr.y (mgr.14514) 26 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-19T21:33:12.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:11.394764+0000 mon.a (mon.0) 699 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2024-02-19T21:33:12.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:12.270683+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:12.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:10.765896+0000 mgr.y (mgr.14514) 26 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-19T21:33:12.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:11.394764+0000 mon.a (mon.0) 699 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2024-02-19T21:33:12.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:12.270683+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:13.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:33:12.280502+0000 mgr.y (mgr.14514) 27 : cephadm [INF] Deploying daemon prometheus.a on smithi157 2024-02-19T21:33:13.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:33:12.280502+0000 mgr.y (mgr.14514) 27 : cephadm [INF] Deploying daemon prometheus.a on smithi157 2024-02-19T21:33:13.797 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 3 2024-02-19T21:33:13.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:33:12.280502+0000 mgr.y (mgr.14514) 27 : cephadm [INF] Deploying daemon prometheus.a on smithi157 2024-02-19T21:33:14.099 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-alertmanager-a[67585]: level=info ts=2024-02-19T21:33:13.722Z caller=cluster.go:688 component=cluster msg="gossip settled; proceeding" elapsed=10.002317924s 2024-02-19T21:33:14.562 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:12.766451+0000 mgr.y (mgr.14514) 28 : cluster [DBG] pgmap v24: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:33:14.562 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:13.795223+0000 mon.c (mon.2) 14 : audit [DBG] from='client.? 172.21.15.80:0/1160636759' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2024-02-19T21:33:14.562 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:13.923684+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:14.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:12.766451+0000 mgr.y (mgr.14514) 28 : cluster [DBG] pgmap v24: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:33:14.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:13.795223+0000 mon.c (mon.2) 14 : audit [DBG] from='client.? 172.21.15.80:0/1160636759' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2024-02-19T21:33:14.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:13.923684+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:14.583 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool get default.rgw.log pg_num 2024-02-19T21:33:14.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:12.766451+0000 mgr.y (mgr.14514) 28 : cluster [DBG] pgmap v24: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:33:14.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:13.795223+0000 mon.c (mon.2) 14 : audit [DBG] from='client.? 172.21.15.80:0/1160636759' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2024-02-19T21:33:14.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:13.923684+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:14.854 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:33:16.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:14.766953+0000 mgr.y (mgr.14514) 29 : cluster [DBG] pgmap v25: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 926 B/s rd, 0 op/s 2024-02-19T21:33:16.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:14.826377+0000 mon.a (mon.0) 702 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2024-02-19T21:33:16.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:14.766953+0000 mgr.y (mgr.14514) 29 : cluster [DBG] pgmap v25: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 926 B/s rd, 0 op/s 2024-02-19T21:33:16.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:14.826377+0000 mon.a (mon.0) 702 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2024-02-19T21:33:16.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:14.766953+0000 mgr.y (mgr.14514) 29 : cluster [DBG] pgmap v25: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 926 B/s rd, 0 op/s 2024-02-19T21:33:16.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:14.826377+0000 mon.a (mon.0) 702 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2024-02-19T21:33:17.098 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-02-19T21:33:17.936 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool get default.rgw.control pg_num 2024-02-19T21:33:18.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:16.767307+0000 mgr.y (mgr.14514) 30 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-19T21:33:18.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:17.095672+0000 mon.a (mon.0) 703 : audit [DBG] from='client.? 172.21.15.80:0/2591456120' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.log", "var": "pg_num"}]: dispatch 2024-02-19T21:33:18.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:16.767307+0000 mgr.y (mgr.14514) 30 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-19T21:33:18.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:17.095672+0000 mon.a (mon.0) 703 : audit [DBG] from='client.? 172.21.15.80:0/2591456120' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.log", "var": "pg_num"}]: dispatch 2024-02-19T21:33:18.204 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:33:18.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:16.767307+0000 mgr.y (mgr.14514) 30 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-19T21:33:18.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:17.095672+0000 mon.a (mon.0) 703 : audit [DBG] from='client.? 172.21.15.80:0/2591456120' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.log", "var": "pg_num"}]: dispatch 2024-02-19T21:33:20.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:18.767633+0000 mgr.y (mgr.14514) 31 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-02-19T21:33:20.059 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:33:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:33:20.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:18.767633+0000 mgr.y (mgr.14514) 31 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-02-19T21:33:20.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:18.767633+0000 mgr.y (mgr.14514) 31 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-02-19T21:33:20.461 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-02-19T21:33:21.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:19.794695+0000 mgr.y (mgr.14514) 32 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:33:21.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:20.459469+0000 mon.c (mon.2) 15 : audit [DBG] from='client.? 172.21.15.80:0/2404292926' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.control", "var": "pg_num"}]: dispatch 2024-02-19T21:33:21.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:19.794695+0000 mgr.y (mgr.14514) 32 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:33:21.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:20.459469+0000 mon.c (mon.2) 15 : audit [DBG] from='client.? 172.21.15.80:0/2404292926' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.control", "var": "pg_num"}]: dispatch 2024-02-19T21:33:21.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:19.794695+0000 mgr.y (mgr.14514) 32 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:33:21.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:20.459469+0000 mon.c (mon.2) 15 : audit [DBG] from='client.? 172.21.15.80:0/2404292926' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.control", "var": "pg_num"}]: dispatch 2024-02-19T21:33:21.400 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool get default.rgw.meta pg_num 2024-02-19T21:33:21.666 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:33:22.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:20.768359+0000 mgr.y (mgr.14514) 33 : cluster [DBG] pgmap v29: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 983 B/s rd, 0 op/s 2024-02-19T21:33:22.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:20.768359+0000 mgr.y (mgr.14514) 33 : cluster [DBG] pgmap v29: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 983 B/s rd, 0 op/s 2024-02-19T21:33:22.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:20.768359+0000 mgr.y (mgr.14514) 33 : cluster [DBG] pgmap v29: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 983 B/s rd, 0 op/s 2024-02-19T21:33:23.758 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-02-19T21:33:24.059 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 21:33:23 smithi157 systemd[1]: Starting Ceph prometheus.a for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T21:33:24.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:22.768720+0000 mgr.y (mgr.14514) 34 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 921 B/s rd, 0 op/s 2024-02-19T21:33:24.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:23.125375+0000 osd.6 (osd.6) 5 : cluster [DBG] 2.1a scrub starts 2024-02-19T21:33:24.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:23.128324+0000 osd.6 (osd.6) 6 : cluster [DBG] 2.1a scrub ok 2024-02-19T21:33:24.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:23.756070+0000 mon.c (mon.2) 16 : audit [DBG] from='client.? 172.21.15.80:0/731244021' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.meta", "var": "pg_num"}]: dispatch 2024-02-19T21:33:24.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:22.768720+0000 mgr.y (mgr.14514) 34 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 921 B/s rd, 0 op/s 2024-02-19T21:33:24.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:23.125375+0000 osd.6 (osd.6) 5 : cluster [DBG] 2.1a scrub starts 2024-02-19T21:33:24.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:23.128324+0000 osd.6 (osd.6) 6 : cluster [DBG] 2.1a scrub ok 2024-02-19T21:33:24.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:23.756070+0000 mon.c (mon.2) 16 : audit [DBG] from='client.? 172.21.15.80:0/731244021' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.meta", "var": "pg_num"}]: dispatch 2024-02-19T21:33:24.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:22.768720+0000 mgr.y (mgr.14514) 34 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 921 B/s rd, 0 op/s 2024-02-19T21:33:24.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:23.125375+0000 osd.6 (osd.6) 5 : cluster [DBG] 2.1a scrub starts 2024-02-19T21:33:24.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:23.128324+0000 osd.6 (osd.6) 6 : cluster [DBG] 2.1a scrub ok 2024-02-19T21:33:24.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:23.756070+0000 mon.c (mon.2) 16 : audit [DBG] from='client.? 172.21.15.80:0/731244021' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.meta", "var": "pg_num"}]: dispatch 2024-02-19T21:33:24.520 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:33:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:33:24] ENGINE Bus STOPPING 2024-02-19T21:33:24.622 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-19T21:33:24.622 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-02-19T21:33:24.622 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph mgr dump --format=json 2024-02-19T21:33:24.809 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 21:33:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T21:33:24.328Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-02-19T21:33:24.809 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 21:33:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T21:33:24.328Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-02-19T21:33:24.809 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 21:33:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T21:33:24.328Z caller=main.go:518 level=info host_details="(Linux 4.18.0-539.el8.x86_64 #1 SMP Mon Feb 5 18:34:56 UTC 2024 x86_64 smithi157 (none))" 2024-02-19T21:33:24.809 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 21:33:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T21:33:24.328Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-02-19T21:33:24.809 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 21:33:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T21:33:24.328Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-02-19T21:33:24.809 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 21:33:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T21:33:24.329Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-02-19T21:33:24.809 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 21:33:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T21:33:24.330Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-02-19T21:33:24.809 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 21:33:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T21:33:24.330Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-02-19T21:33:24.810 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 21:33:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T21:33:24.332Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-02-19T21:33:24.810 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 21:33:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T21:33:24.332Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.895µs 2024-02-19T21:33:24.810 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 21:33:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T21:33:24.332Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-02-19T21:33:24.810 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 21:33:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T21:33:24.332Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2024-02-19T21:33:24.810 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 21:33:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T21:33:24.332Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=23.523µs wal_replay_duration=155.058µs total_replay_duration=192.084µs 2024-02-19T21:33:24.810 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 21:33:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T21:33:24.332Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-02-19T21:33:24.810 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 21:33:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T21:33:24.332Z caller=main.go:947 level=info msg="TSDB started" 2024-02-19T21:33:24.810 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 21:33:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T21:33:24.332Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-02-19T21:33:24.810 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 21:33:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T21:33:24.349Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=16.109784ms db_storage=1.142µs remote_storage=1.12µs web_handler=223ns query_engine=575ns scrape=435.988µs scrape_sd=21.501µs notify=18.334µs notify_sd=5.269µs rules=15.247535ms 2024-02-19T21:33:24.810 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 21:33:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T21:33:24.349Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-02-19T21:33:24.810 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 21:33:24 smithi157 bash[63104]: 4017e69d5e4ba986cc2a5c7dad3edda14bf50daab3525745289d7cda650638ca 2024-02-19T21:33:24.810 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 21:33:24 smithi157 systemd[1]: Started Ceph prometheus.a for 6f763558-cf6d-11ee-95bb-87774f69a715. 2024-02-19T21:33:24.848 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:33:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:33:24] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-19T21:33:24.849 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:33:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:33:24] ENGINE Bus STOPPED 2024-02-19T21:33:24.849 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:33:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:33:24] ENGINE Bus STARTING 2024-02-19T21:33:24.849 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:33:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:33:24] ENGINE Serving on http://:::9283 2024-02-19T21:33:24.849 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:33:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:33:24] ENGINE Bus STARTED 2024-02-19T21:33:24.899 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:33:25.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:24.446432+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:25.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:24.506321+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:25.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:24.509149+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:25.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:24.511354+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-19T21:33:25.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:24.511716+0000 mgr.y (mgr.14514) 35 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-19T21:33:25.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:24.515317+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:25.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:33:24.524316+0000 mgr.y (mgr.14514) 36 : cephadm [INF] Deploying daemon grafana.a on smithi157 2024-02-19T21:33:25.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:24.446432+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:25.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:24.506321+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:25.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:24.509149+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:25.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:24.511354+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-19T21:33:25.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:24.511716+0000 mgr.y (mgr.14514) 35 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-19T21:33:25.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:24.515317+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:25.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:33:24.524316+0000 mgr.y (mgr.14514) 36 : cephadm [INF] Deploying daemon grafana.a on smithi157 2024-02-19T21:33:25.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:24.446432+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:25.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:24.506321+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:25.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:24.509149+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:25.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:24.511354+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-19T21:33:25.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:24.511716+0000 mgr.y (mgr.14514) 35 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-19T21:33:25.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:24.515317+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:25.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:33:24.524316+0000 mgr.y (mgr.14514) 36 : cephadm [INF] Deploying daemon grafana.a on smithi157 2024-02-19T21:33:26.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:24.769202+0000 mgr.y (mgr.14514) 37 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:33:26.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:25.089518+0000 osd.2 (osd.2) 7 : cluster [DBG] 2.1 scrub starts 2024-02-19T21:33:26.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:25.090388+0000 osd.2 (osd.2) 8 : cluster [DBG] 2.1 scrub ok 2024-02-19T21:33:26.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:24.769202+0000 mgr.y (mgr.14514) 37 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:33:26.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:25.089518+0000 osd.2 (osd.2) 7 : cluster [DBG] 2.1 scrub starts 2024-02-19T21:33:26.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:25.090388+0000 osd.2 (osd.2) 8 : cluster [DBG] 2.1 scrub ok 2024-02-19T21:33:26.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:24.769202+0000 mgr.y (mgr.14514) 37 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:33:26.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:25.089518+0000 osd.2 (osd.2) 7 : cluster [DBG] 2.1 scrub starts 2024-02-19T21:33:26.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:25.090388+0000 osd.2 (osd.2) 8 : cluster [DBG] 2.1 scrub ok 2024-02-19T21:33:27.140 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:33:27.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:26.169710+0000 osd.4 (osd.4) 7 : cluster [DBG] 4.1b scrub starts 2024-02-19T21:33:27.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:26.173192+0000 osd.4 (osd.4) 8 : cluster [DBG] 4.1b scrub ok 2024-02-19T21:33:27.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:27.134215+0000 mon.a (mon.0) 709 : audit [DBG] from='client.? 172.21.15.80:0/2926561457' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-19T21:33:27.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:27.188976+0000 osd.4 (osd.4) 9 : cluster [DBG] 4.c scrub starts 2024-02-19T21:33:27.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:27.192575+0000 osd.4 (osd.4) 10 : cluster [DBG] 4.c scrub ok 2024-02-19T21:33:27.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:26.169710+0000 osd.4 (osd.4) 7 : cluster [DBG] 4.1b scrub starts 2024-02-19T21:33:27.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:26.173192+0000 osd.4 (osd.4) 8 : cluster [DBG] 4.1b scrub ok 2024-02-19T21:33:27.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:27.134215+0000 mon.a (mon.0) 709 : audit [DBG] from='client.? 172.21.15.80:0/2926561457' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-19T21:33:27.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:27.188976+0000 osd.4 (osd.4) 9 : cluster [DBG] 4.c scrub starts 2024-02-19T21:33:27.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:27.192575+0000 osd.4 (osd.4) 10 : cluster [DBG] 4.c scrub ok 2024-02-19T21:33:27.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:26.169710+0000 osd.4 (osd.4) 7 : cluster [DBG] 4.1b scrub starts 2024-02-19T21:33:27.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:26.173192+0000 osd.4 (osd.4) 8 : cluster [DBG] 4.1b scrub ok 2024-02-19T21:33:27.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:27.134215+0000 mon.a (mon.0) 709 : audit [DBG] from='client.? 172.21.15.80:0/2926561457' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-19T21:33:27.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:27.188976+0000 osd.4 (osd.4) 9 : cluster [DBG] 4.c scrub starts 2024-02-19T21:33:27.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:27.192575+0000 osd.4 (osd.4) 10 : cluster [DBG] 4.c scrub ok 2024-02-19T21:33:28.023 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":19,"active_gid":14514,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4064039187},{"type":"v1","addr":"172.21.15.80:6801","nonce":4064039187}]},"active_addr":"172.21.15.80:6801/4064039187","active_change":"2024-02-19T21:32:48.749193+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":24427,"name":"x","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.80:8443/","prometheus":"http://172.21.15.80:9283/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":72,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":349336892}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":3436776577}]}]} 2024-02-19T21:33:28.026 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-02-19T21:33:28.026 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-02-19T21:33:28.027 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd dump --format=json 2024-02-19T21:33:28.295 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:33:28.807 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:26.769537+0000 mgr.y (mgr.14514) 38 : cluster [DBG] pgmap v32: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 857 B/s rd, 0 op/s 2024-02-19T21:33:28.808 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:26.769537+0000 mgr.y (mgr.14514) 38 : cluster [DBG] pgmap v32: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 857 B/s rd, 0 op/s 2024-02-19T21:33:28.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:26.769537+0000 mgr.y (mgr.14514) 38 : cluster [DBG] pgmap v32: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 857 B/s rd, 0 op/s 2024-02-19T21:33:29.742 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:28.113962+0000 osd.6 (osd.6) 7 : cluster [DBG] 5.11 scrub starts 2024-02-19T21:33:29.742 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:28.116856+0000 osd.6 (osd.6) 8 : cluster [DBG] 5.11 scrub ok 2024-02-19T21:33:29.742 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:28.596569+0000 osd.5 (osd.5) 5 : cluster [DBG] 4.15 scrub starts 2024-02-19T21:33:29.742 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:28.598261+0000 osd.5 (osd.5) 6 : cluster [DBG] 4.15 scrub ok 2024-02-19T21:33:29.742 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:28.932475+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:29.742 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:28.113962+0000 osd.6 (osd.6) 7 : cluster [DBG] 5.11 scrub starts 2024-02-19T21:33:29.742 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:28.116856+0000 osd.6 (osd.6) 8 : cluster [DBG] 5.11 scrub ok 2024-02-19T21:33:29.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:28.596569+0000 osd.5 (osd.5) 5 : cluster [DBG] 4.15 scrub starts 2024-02-19T21:33:29.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:28.598261+0000 osd.5 (osd.5) 6 : cluster [DBG] 4.15 scrub ok 2024-02-19T21:33:29.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:28.932475+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:29.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:28.113962+0000 osd.6 (osd.6) 7 : cluster [DBG] 5.11 scrub starts 2024-02-19T21:33:29.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:28.116856+0000 osd.6 (osd.6) 8 : cluster [DBG] 5.11 scrub ok 2024-02-19T21:33:29.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:28.596569+0000 osd.5 (osd.5) 5 : cluster [DBG] 4.15 scrub starts 2024-02-19T21:33:29.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:28.598261+0000 osd.5 (osd.5) 6 : cluster [DBG] 4.15 scrub ok 2024-02-19T21:33:29.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:28.932475+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:29.808 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:33:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:33:30.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:28.591750+0000 osd.3 (osd.3) 7 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:33:30.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:28.595348+0000 osd.3 (osd.3) 8 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:33:30.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:28.769954+0000 mgr.y (mgr.14514) 39 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:33:30.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:29.161053+0000 osd.6 (osd.6) 9 : cluster [DBG] 4.a scrub starts 2024-02-19T21:33:30.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:29.164637+0000 osd.6 (osd.6) 10 : cluster [DBG] 4.a scrub ok 2024-02-19T21:33:30.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:29.774980+0000 osd.7 (osd.7) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:33:30.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:29.775029+0000 osd.7 (osd.7) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:33:30.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:30.228699+0000 osd.4 (osd.4) 11 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:33:30.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:30.232280+0000 osd.4 (osd.4) 12 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:33:30.849 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:33:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:33:30] "GET /metrics HTTP/1.1" 200 172118 "" "Prometheus/2.33.4" 2024-02-19T21:33:30.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:28.591750+0000 osd.3 (osd.3) 7 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:33:30.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:28.595348+0000 osd.3 (osd.3) 8 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:33:30.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:28.769954+0000 mgr.y (mgr.14514) 39 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:33:30.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:29.161053+0000 osd.6 (osd.6) 9 : cluster [DBG] 4.a scrub starts 2024-02-19T21:33:30.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:29.164637+0000 osd.6 (osd.6) 10 : cluster [DBG] 4.a scrub ok 2024-02-19T21:33:30.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:29.774980+0000 osd.7 (osd.7) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:33:30.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:29.775029+0000 osd.7 (osd.7) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:33:30.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:30.228699+0000 osd.4 (osd.4) 11 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:33:30.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:30.232280+0000 osd.4 (osd.4) 12 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:33:30.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:28.591750+0000 osd.3 (osd.3) 7 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:33:30.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:28.595348+0000 osd.3 (osd.3) 8 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:33:30.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:28.769954+0000 mgr.y (mgr.14514) 39 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:33:30.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:29.161053+0000 osd.6 (osd.6) 9 : cluster [DBG] 4.a scrub starts 2024-02-19T21:33:30.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:29.164637+0000 osd.6 (osd.6) 10 : cluster [DBG] 4.a scrub ok 2024-02-19T21:33:30.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:29.774980+0000 osd.7 (osd.7) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:33:30.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:29.775029+0000 osd.7 (osd.7) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:33:30.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:30.228699+0000 osd.4 (osd.4) 11 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:33:30.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:30.232280+0000 osd.4 (osd.4) 12 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:33:31.044 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:33:31.044 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":83,"fsid":"6f763558-cf6d-11ee-95bb-87774f69a715","created":"2024-02-19T21:26:16.880265+0000","modified":"2024-02-19T21:33:30.525770+0000","last_up_change":"2024-02-19T21:32:14.805693+0000","last_in_change":"2024-02-19T21:31:56.867171+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-19T21:30:05.947623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-02-19T21:32:22.082250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2024-02-19T21:32:22.333164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2024-02-19T21:32:23.632615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-02-19T21:32:25.600876+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-02-19T21:32:27.661242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"a72c63f6-46b3-4202-99da-7b0c92b799a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":3531298825},{"type":"v1","addr":"172.21.15.80:6803","nonce":3531298825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":3531298825},{"type":"v1","addr":"172.21.15.80:6805","nonce":3531298825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":3531298825},{"type":"v1","addr":"172.21.15.80:6809","nonce":3531298825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":3531298825},{"type":"v1","addr":"172.21.15.80:6807","nonce":3531298825}]},"public_addr":"172.21.15.80:6803/3531298825","cluster_addr":"172.21.15.80:6805/3531298825","heartbeat_back_addr":"172.21.15.80:6809/3531298825","heartbeat_front_addr":"172.21.15.80:6807/3531298825","state":["exists","up"]},{"osd":1,"uuid":"7d4e170e-b0ca-4e19-be35-4038ca126ee6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1497235950},{"type":"v1","addr":"172.21.15.80:6811","nonce":1497235950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1497235950},{"type":"v1","addr":"172.21.15.80:6813","nonce":1497235950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1497235950},{"type":"v1","addr":"172.21.15.80:6817","nonce":1497235950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1497235950},{"type":"v1","addr":"172.21.15.80:6815","nonce":1497235950}]},"public_addr":"172.21.15.80:6811/1497235950","cluster_addr":"172.21.15.80:6813/1497235950","heartbeat_back_addr":"172.21.15.80:6817/1497235950","heartbeat_front_addr":"172.21.15.80:6815/1497235950","state":["exists","up"]},{"osd":2,"uuid":"cf461b67-f3e8-45e9-b2f6-777752ba5574","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3131848307},{"type":"v1","addr":"172.21.15.80:6819","nonce":3131848307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3131848307},{"type":"v1","addr":"172.21.15.80:6821","nonce":3131848307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3131848307},{"type":"v1","addr":"172.21.15.80:6825","nonce":3131848307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3131848307},{"type":"v1","addr":"172.21.15.80:6823","nonce":3131848307}]},"public_addr":"172.21.15.80:6819/3131848307","cluster_addr":"172.21.15.80:6821/3131848307","heartbeat_back_addr":"172.21.15.80:6825/3131848307","heartbeat_front_addr":"172.21.15.80:6823/3131848307","state":["exists","up"]},{"osd":3,"uuid":"76318cdd-5fce-4a40-95c9-300d55c34820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2007978078},{"type":"v1","addr":"172.21.15.80:6827","nonce":2007978078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2007978078},{"type":"v1","addr":"172.21.15.80:6829","nonce":2007978078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2007978078},{"type":"v1","addr":"172.21.15.80:6833","nonce":2007978078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2007978078},{"type":"v1","addr":"172.21.15.80:6831","nonce":2007978078}]},"public_addr":"172.21.15.80:6827/2007978078","cluster_addr":"172.21.15.80:6829/2007978078","heartbeat_back_addr":"172.21.15.80:6833/2007978078","heartbeat_front_addr":"172.21.15.80:6831/2007978078","state":["exists","up"]},{"osd":4,"uuid":"6484964f-3391-4e1d-a56c-813f46124062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1922002860},{"type":"v1","addr":"172.21.15.157:6801","nonce":1922002860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1922002860},{"type":"v1","addr":"172.21.15.157:6803","nonce":1922002860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1922002860},{"type":"v1","addr":"172.21.15.157:6807","nonce":1922002860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1922002860},{"type":"v1","addr":"172.21.15.157:6805","nonce":1922002860}]},"public_addr":"172.21.15.157:6801/1922002860","cluster_addr":"172.21.15.157:6803/1922002860","heartbeat_back_addr":"172.21.15.157:6807/1922002860","heartbeat_front_addr":"172.21.15.157:6805/1922002860","state":["exists","up"]},{"osd":5,"uuid":"8c7e0309-8c3b-40b9-99d9-96620e52742f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":960889603},{"type":"v1","addr":"172.21.15.157:6809","nonce":960889603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":960889603},{"type":"v1","addr":"172.21.15.157:6811","nonce":960889603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":960889603},{"type":"v1","addr":"172.21.15.157:6815","nonce":960889603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":960889603},{"type":"v1","addr":"172.21.15.157:6813","nonce":960889603}]},"public_addr":"172.21.15.157:6809/960889603","cluster_addr":"172.21.15.157:6811/960889603","heartbeat_back_addr":"172.21.15.157:6815/960889603","heartbeat_front_addr":"172.21.15.157:6813/960889603","state":["exists","up"]},{"osd":6,"uuid":"5b7d44a3-197d-482c-bf9e-de5e9013a851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":2598265223},{"type":"v1","addr":"172.21.15.157:6817","nonce":2598265223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":2598265223},{"type":"v1","addr":"172.21.15.157:6819","nonce":2598265223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":2598265223},{"type":"v1","addr":"172.21.15.157:6823","nonce":2598265223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":2598265223},{"type":"v1","addr":"172.21.15.157:6821","nonce":2598265223}]},"public_addr":"172.21.15.157:6817/2598265223","cluster_addr":"172.21.15.157:6819/2598265223","heartbeat_back_addr":"172.21.15.157:6823/2598265223","heartbeat_front_addr":"172.21.15.157:6821/2598265223","state":["exists","up"]},{"osd":7,"uuid":"7e2d0287-928d-40f8-841b-6c2077fc08ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3619345894},{"type":"v1","addr":"172.21.15.157:6825","nonce":3619345894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3619345894},{"type":"v1","addr":"172.21.15.157:6827","nonce":3619345894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3619345894},{"type":"v1","addr":"172.21.15.157:6831","nonce":3619345894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3619345894},{"type":"v1","addr":"172.21.15.157:6829","nonce":3619345894}]},"public_addr":"172.21.15.157:6825/3619345894","cluster_addr":"172.21.15.157:6827/3619345894","heartbeat_back_addr":"172.21.15.157:6831/3619345894","heartbeat_front_addr":"172.21.15.157:6829/3619345894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:32:56.927881+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:33:10.728380+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:32:52.789375+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:32:38.224945+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:33:00.051050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:32:47.061866+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:32:50.572313+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:33:29.775032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6800/2867197629":"2024-02-20T21:32:48.748960+0000","172.21.15.80:0/1659656010":"2024-02-20T21:32:48.748960+0000","172.21.15.80:6801/2272739550":"2024-02-20T21:27:15.880876+0000","172.21.15.80:0/867908385":"2024-02-20T21:27:15.880876+0000","172.21.15.80:0/398750494":"2024-02-20T21:32:48.748960+0000","172.21.15.80:0/2833137430":"2024-02-20T21:27:15.880876+0000","172.21.15.80:0/2520755315":"2024-02-20T21:32:48.748960+0000","172.21.15.80:6800/2094869828":"2024-02-20T21:26:51.262073+0000","172.21.15.80:6800/2272739550":"2024-02-20T21:27:15.880876+0000","172.21.15.80:6801/2094869828":"2024-02-20T21:26:51.262073+0000","172.21.15.80:0/2130852198":"2024-02-20T21:26:51.262073+0000","172.21.15.80:6801/2867197629":"2024-02-20T21:32:48.748960+0000","172.21.15.80:0/1952386920":"2024-02-20T21:26:51.262073+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T21:33:31.735 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:29.805473+0000 mgr.y (mgr.14514) 40 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:33:31.735 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:30.534828+0000 mon.a (mon.0) 711 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2024-02-19T21:33:31.735 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:30.565521+0000 osd.3 (osd.3) 9 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:33:31.735 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:30.566727+0000 osd.3 (osd.3) 10 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:33:31.735 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:30.640249+0000 osd.5 (osd.5) 7 : cluster [DBG] 2.18 scrub starts 2024-02-19T21:33:31.735 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:30.643300+0000 osd.5 (osd.5) 8 : cluster [DBG] 2.18 scrub ok 2024-02-19T21:33:31.735 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:31.040988+0000 mon.c (mon.2) 17 : audit [DBG] from='client.? 172.21.15.80:0/1313843205' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:33:31.735 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:31.251417+0000 osd.4 (osd.4) 13 : cluster [DBG] 4.d scrub starts 2024-02-19T21:33:31.736 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:31.255085+0000 osd.4 (osd.4) 14 : cluster [DBG] 4.d scrub ok 2024-02-19T21:33:31.736 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:29.805473+0000 mgr.y (mgr.14514) 40 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:33:31.736 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:30.534828+0000 mon.a (mon.0) 711 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2024-02-19T21:33:31.736 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:30.565521+0000 osd.3 (osd.3) 9 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:33:31.736 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:30.566727+0000 osd.3 (osd.3) 10 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:33:31.736 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:30.640249+0000 osd.5 (osd.5) 7 : cluster [DBG] 2.18 scrub starts 2024-02-19T21:33:31.736 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:30.643300+0000 osd.5 (osd.5) 8 : cluster [DBG] 2.18 scrub ok 2024-02-19T21:33:31.736 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:31.040988+0000 mon.c (mon.2) 17 : audit [DBG] from='client.? 172.21.15.80:0/1313843205' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:33:31.736 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:31.251417+0000 osd.4 (osd.4) 13 : cluster [DBG] 4.d scrub starts 2024-02-19T21:33:31.736 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:31.255085+0000 osd.4 (osd.4) 14 : cluster [DBG] 4.d scrub ok 2024-02-19T21:33:31.754 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-02-19T21:33:31.755 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd dump --format=json 2024-02-19T21:33:31.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:29.805473+0000 mgr.y (mgr.14514) 40 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:33:31.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:30.534828+0000 mon.a (mon.0) 711 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2024-02-19T21:33:31.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:30.565521+0000 osd.3 (osd.3) 9 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:33:31.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:30.566727+0000 osd.3 (osd.3) 10 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:33:31.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:30.640249+0000 osd.5 (osd.5) 7 : cluster [DBG] 2.18 scrub starts 2024-02-19T21:33:31.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:30.643300+0000 osd.5 (osd.5) 8 : cluster [DBG] 2.18 scrub ok 2024-02-19T21:33:31.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:31.040988+0000 mon.c (mon.2) 17 : audit [DBG] from='client.? 172.21.15.80:0/1313843205' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:33:31.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:31.251417+0000 osd.4 (osd.4) 13 : cluster [DBG] 4.d scrub starts 2024-02-19T21:33:31.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:31.255085+0000 osd.4 (osd.4) 14 : cluster [DBG] 4.d scrub ok 2024-02-19T21:33:32.022 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:33:32.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:30.770316+0000 mgr.y (mgr.14514) 41 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:33:32.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:31.150112+0000 osd.6 (osd.6) 11 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:33:32.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:31.153013+0000 osd.6 (osd.6) 12 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:33:32.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:31.415150+0000 osd.7 (osd.7) 7 : cluster [DBG] 2.1c scrub starts 2024-02-19T21:33:32.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:31.418046+0000 osd.7 (osd.7) 8 : cluster [DBG] 2.1c scrub ok 2024-02-19T21:33:32.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:31.628625+0000 osd.0 (osd.0) 9 : cluster [DBG] 4.1e scrub starts 2024-02-19T21:33:32.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:31.630362+0000 osd.0 (osd.0) 10 : cluster [DBG] 4.1e scrub ok 2024-02-19T21:33:32.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:30.770316+0000 mgr.y (mgr.14514) 41 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:33:32.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:31.150112+0000 osd.6 (osd.6) 11 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:33:32.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:31.153013+0000 osd.6 (osd.6) 12 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:33:32.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:31.415150+0000 osd.7 (osd.7) 7 : cluster [DBG] 2.1c scrub starts 2024-02-19T21:33:32.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:31.418046+0000 osd.7 (osd.7) 8 : cluster [DBG] 2.1c scrub ok 2024-02-19T21:33:32.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:31.628625+0000 osd.0 (osd.0) 9 : cluster [DBG] 4.1e scrub starts 2024-02-19T21:33:32.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:31.630362+0000 osd.0 (osd.0) 10 : cluster [DBG] 4.1e scrub ok 2024-02-19T21:33:32.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:30.770316+0000 mgr.y (mgr.14514) 41 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:33:32.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:31.150112+0000 osd.6 (osd.6) 11 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:33:32.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:31.153013+0000 osd.6 (osd.6) 12 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:33:32.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:31.415150+0000 osd.7 (osd.7) 7 : cluster [DBG] 2.1c scrub starts 2024-02-19T21:33:32.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:31.418046+0000 osd.7 (osd.7) 8 : cluster [DBG] 2.1c scrub ok 2024-02-19T21:33:32.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:31.628625+0000 osd.0 (osd.0) 9 : cluster [DBG] 4.1e scrub starts 2024-02-19T21:33:32.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:31.630362+0000 osd.0 (osd.0) 10 : cluster [DBG] 4.1e scrub ok 2024-02-19T21:33:33.715 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:32.120320+0000 osd.2 (osd.2) 9 : cluster [DBG] 2.10 deep-scrub starts 2024-02-19T21:33:33.716 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:32.121196+0000 osd.2 (osd.2) 10 : cluster [DBG] 2.10 deep-scrub ok 2024-02-19T21:33:33.716 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:32.419251+0000 osd.7 (osd.7) 9 : cluster [DBG] 5.4 scrub starts 2024-02-19T21:33:33.716 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:32.422145+0000 osd.7 (osd.7) 10 : cluster [DBG] 5.4 scrub ok 2024-02-19T21:33:33.716 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:32.579754+0000 osd.0 (osd.0) 11 : cluster [DBG] 6.9 scrub starts 2024-02-19T21:33:33.716 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:32.580568+0000 osd.0 (osd.0) 12 : cluster [DBG] 6.9 scrub ok 2024-02-19T21:33:33.716 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:32.646573+0000 osd.5 (osd.5) 9 : cluster [DBG] 2.12 scrub starts 2024-02-19T21:33:33.716 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:32.647903+0000 osd.5 (osd.5) 10 : cluster [DBG] 2.12 scrub ok 2024-02-19T21:33:33.716 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:32.770649+0000 mgr.y (mgr.14514) 42 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:33:33.716 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:32.120320+0000 osd.2 (osd.2) 9 : cluster [DBG] 2.10 deep-scrub starts 2024-02-19T21:33:33.716 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:32.121196+0000 osd.2 (osd.2) 10 : cluster [DBG] 2.10 deep-scrub ok 2024-02-19T21:33:33.716 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:32.419251+0000 osd.7 (osd.7) 9 : cluster [DBG] 5.4 scrub starts 2024-02-19T21:33:33.717 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:32.422145+0000 osd.7 (osd.7) 10 : cluster [DBG] 5.4 scrub ok 2024-02-19T21:33:33.717 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:32.579754+0000 osd.0 (osd.0) 11 : cluster [DBG] 6.9 scrub starts 2024-02-19T21:33:33.717 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:32.580568+0000 osd.0 (osd.0) 12 : cluster [DBG] 6.9 scrub ok 2024-02-19T21:33:33.717 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:32.646573+0000 osd.5 (osd.5) 9 : cluster [DBG] 2.12 scrub starts 2024-02-19T21:33:33.717 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:32.647903+0000 osd.5 (osd.5) 10 : cluster [DBG] 2.12 scrub ok 2024-02-19T21:33:33.717 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:32.770649+0000 mgr.y (mgr.14514) 42 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:33:33.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:32.120320+0000 osd.2 (osd.2) 9 : cluster [DBG] 2.10 deep-scrub starts 2024-02-19T21:33:33.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:32.121196+0000 osd.2 (osd.2) 10 : cluster [DBG] 2.10 deep-scrub ok 2024-02-19T21:33:33.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:32.419251+0000 osd.7 (osd.7) 9 : cluster [DBG] 5.4 scrub starts 2024-02-19T21:33:33.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:32.422145+0000 osd.7 (osd.7) 10 : cluster [DBG] 5.4 scrub ok 2024-02-19T21:33:33.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:32.579754+0000 osd.0 (osd.0) 11 : cluster [DBG] 6.9 scrub starts 2024-02-19T21:33:33.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:32.580568+0000 osd.0 (osd.0) 12 : cluster [DBG] 6.9 scrub ok 2024-02-19T21:33:33.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:32.646573+0000 osd.5 (osd.5) 9 : cluster [DBG] 2.12 scrub starts 2024-02-19T21:33:33.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:32.647903+0000 osd.5 (osd.5) 10 : cluster [DBG] 2.12 scrub ok 2024-02-19T21:33:33.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:32.770649+0000 mgr.y (mgr.14514) 42 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:33:34.200 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:33:34.200 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":83,"fsid":"6f763558-cf6d-11ee-95bb-87774f69a715","created":"2024-02-19T21:26:16.880265+0000","modified":"2024-02-19T21:33:30.525770+0000","last_up_change":"2024-02-19T21:32:14.805693+0000","last_in_change":"2024-02-19T21:31:56.867171+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-19T21:30:05.947623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-02-19T21:32:22.082250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2024-02-19T21:32:22.333164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2024-02-19T21:32:23.632615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-02-19T21:32:25.600876+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-02-19T21:32:27.661242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"a72c63f6-46b3-4202-99da-7b0c92b799a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":3531298825},{"type":"v1","addr":"172.21.15.80:6803","nonce":3531298825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":3531298825},{"type":"v1","addr":"172.21.15.80:6805","nonce":3531298825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":3531298825},{"type":"v1","addr":"172.21.15.80:6809","nonce":3531298825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":3531298825},{"type":"v1","addr":"172.21.15.80:6807","nonce":3531298825}]},"public_addr":"172.21.15.80:6803/3531298825","cluster_addr":"172.21.15.80:6805/3531298825","heartbeat_back_addr":"172.21.15.80:6809/3531298825","heartbeat_front_addr":"172.21.15.80:6807/3531298825","state":["exists","up"]},{"osd":1,"uuid":"7d4e170e-b0ca-4e19-be35-4038ca126ee6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1497235950},{"type":"v1","addr":"172.21.15.80:6811","nonce":1497235950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1497235950},{"type":"v1","addr":"172.21.15.80:6813","nonce":1497235950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1497235950},{"type":"v1","addr":"172.21.15.80:6817","nonce":1497235950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1497235950},{"type":"v1","addr":"172.21.15.80:6815","nonce":1497235950}]},"public_addr":"172.21.15.80:6811/1497235950","cluster_addr":"172.21.15.80:6813/1497235950","heartbeat_back_addr":"172.21.15.80:6817/1497235950","heartbeat_front_addr":"172.21.15.80:6815/1497235950","state":["exists","up"]},{"osd":2,"uuid":"cf461b67-f3e8-45e9-b2f6-777752ba5574","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3131848307},{"type":"v1","addr":"172.21.15.80:6819","nonce":3131848307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3131848307},{"type":"v1","addr":"172.21.15.80:6821","nonce":3131848307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3131848307},{"type":"v1","addr":"172.21.15.80:6825","nonce":3131848307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3131848307},{"type":"v1","addr":"172.21.15.80:6823","nonce":3131848307}]},"public_addr":"172.21.15.80:6819/3131848307","cluster_addr":"172.21.15.80:6821/3131848307","heartbeat_back_addr":"172.21.15.80:6825/3131848307","heartbeat_front_addr":"172.21.15.80:6823/3131848307","state":["exists","up"]},{"osd":3,"uuid":"76318cdd-5fce-4a40-95c9-300d55c34820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2007978078},{"type":"v1","addr":"172.21.15.80:6827","nonce":2007978078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2007978078},{"type":"v1","addr":"172.21.15.80:6829","nonce":2007978078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2007978078},{"type":"v1","addr":"172.21.15.80:6833","nonce":2007978078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2007978078},{"type":"v1","addr":"172.21.15.80:6831","nonce":2007978078}]},"public_addr":"172.21.15.80:6827/2007978078","cluster_addr":"172.21.15.80:6829/2007978078","heartbeat_back_addr":"172.21.15.80:6833/2007978078","heartbeat_front_addr":"172.21.15.80:6831/2007978078","state":["exists","up"]},{"osd":4,"uuid":"6484964f-3391-4e1d-a56c-813f46124062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1922002860},{"type":"v1","addr":"172.21.15.157:6801","nonce":1922002860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1922002860},{"type":"v1","addr":"172.21.15.157:6803","nonce":1922002860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1922002860},{"type":"v1","addr":"172.21.15.157:6807","nonce":1922002860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1922002860},{"type":"v1","addr":"172.21.15.157:6805","nonce":1922002860}]},"public_addr":"172.21.15.157:6801/1922002860","cluster_addr":"172.21.15.157:6803/1922002860","heartbeat_back_addr":"172.21.15.157:6807/1922002860","heartbeat_front_addr":"172.21.15.157:6805/1922002860","state":["exists","up"]},{"osd":5,"uuid":"8c7e0309-8c3b-40b9-99d9-96620e52742f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":960889603},{"type":"v1","addr":"172.21.15.157:6809","nonce":960889603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":960889603},{"type":"v1","addr":"172.21.15.157:6811","nonce":960889603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":960889603},{"type":"v1","addr":"172.21.15.157:6815","nonce":960889603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":960889603},{"type":"v1","addr":"172.21.15.157:6813","nonce":960889603}]},"public_addr":"172.21.15.157:6809/960889603","cluster_addr":"172.21.15.157:6811/960889603","heartbeat_back_addr":"172.21.15.157:6815/960889603","heartbeat_front_addr":"172.21.15.157:6813/960889603","state":["exists","up"]},{"osd":6,"uuid":"5b7d44a3-197d-482c-bf9e-de5e9013a851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":2598265223},{"type":"v1","addr":"172.21.15.157:6817","nonce":2598265223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":2598265223},{"type":"v1","addr":"172.21.15.157:6819","nonce":2598265223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":2598265223},{"type":"v1","addr":"172.21.15.157:6823","nonce":2598265223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":2598265223},{"type":"v1","addr":"172.21.15.157:6821","nonce":2598265223}]},"public_addr":"172.21.15.157:6817/2598265223","cluster_addr":"172.21.15.157:6819/2598265223","heartbeat_back_addr":"172.21.15.157:6823/2598265223","heartbeat_front_addr":"172.21.15.157:6821/2598265223","state":["exists","up"]},{"osd":7,"uuid":"7e2d0287-928d-40f8-841b-6c2077fc08ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3619345894},{"type":"v1","addr":"172.21.15.157:6825","nonce":3619345894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3619345894},{"type":"v1","addr":"172.21.15.157:6827","nonce":3619345894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3619345894},{"type":"v1","addr":"172.21.15.157:6831","nonce":3619345894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3619345894},{"type":"v1","addr":"172.21.15.157:6829","nonce":3619345894}]},"public_addr":"172.21.15.157:6825/3619345894","cluster_addr":"172.21.15.157:6827/3619345894","heartbeat_back_addr":"172.21.15.157:6831/3619345894","heartbeat_front_addr":"172.21.15.157:6829/3619345894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:32:56.927881+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:33:10.728380+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:32:52.789375+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:32:38.224945+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:33:00.051050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:32:47.061866+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:32:50.572313+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:33:29.775032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6800/2867197629":"2024-02-20T21:32:48.748960+0000","172.21.15.80:0/1659656010":"2024-02-20T21:32:48.748960+0000","172.21.15.80:6801/2272739550":"2024-02-20T21:27:15.880876+0000","172.21.15.80:0/867908385":"2024-02-20T21:27:15.880876+0000","172.21.15.80:0/398750494":"2024-02-20T21:32:48.748960+0000","172.21.15.80:0/2833137430":"2024-02-20T21:27:15.880876+0000","172.21.15.80:0/2520755315":"2024-02-20T21:32:48.748960+0000","172.21.15.80:6800/2094869828":"2024-02-20T21:26:51.262073+0000","172.21.15.80:6800/2272739550":"2024-02-20T21:27:15.880876+0000","172.21.15.80:6801/2094869828":"2024-02-20T21:26:51.262073+0000","172.21.15.80:0/2130852198":"2024-02-20T21:26:51.262073+0000","172.21.15.80:6801/2867197629":"2024-02-20T21:32:48.748960+0000","172.21.15.80:0/1952386920":"2024-02-20T21:26:51.262073+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T21:33:34.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:33.549641+0000 osd.0 (osd.0) 13 : cluster [DBG] 2.13 deep-scrub starts 2024-02-19T21:33:34.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:33.550649+0000 osd.0 (osd.0) 14 : cluster [DBG] 2.13 deep-scrub ok 2024-02-19T21:33:34.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:34.196953+0000 mon.c (mon.2) 18 : audit [DBG] from='client.? 172.21.15.80:0/4007782992' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:33:34.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:33.549641+0000 osd.0 (osd.0) 13 : cluster [DBG] 2.13 deep-scrub starts 2024-02-19T21:33:34.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:33.550649+0000 osd.0 (osd.0) 14 : cluster [DBG] 2.13 deep-scrub ok 2024-02-19T21:33:34.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:34.196953+0000 mon.c (mon.2) 18 : audit [DBG] from='client.? 172.21.15.80:0/4007782992' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:33:34.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:33.549641+0000 osd.0 (osd.0) 13 : cluster [DBG] 2.13 deep-scrub starts 2024-02-19T21:33:34.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:33.550649+0000 osd.0 (osd.0) 14 : cluster [DBG] 2.13 deep-scrub ok 2024-02-19T21:33:34.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:34.196953+0000 mon.c (mon.2) 18 : audit [DBG] from='client.? 172.21.15.80:0/4007782992' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:33:35.020 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-02-19T21:33:35.285 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:33:35.663 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:34.771420+0000 mgr.y (mgr.14514) 43 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:33:35.663 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:33:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:33:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:33:35.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:34.771420+0000 mgr.y (mgr.14514) 43 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:33:35.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:34.771420+0000 mgr.y (mgr.14514) 43 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:33:36.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:35.275010+0000 osd.6 (osd.6) 13 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:33:36.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:35.277900+0000 osd.6 (osd.6) 14 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:33:36.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:35.526046+0000 osd.0 (osd.0) 15 : cluster [DBG] 6.16 scrub starts 2024-02-19T21:33:36.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:35.526860+0000 osd.0 (osd.0) 16 : cluster [DBG] 6.16 scrub ok 2024-02-19T21:33:36.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:36.338804+0000 osd.4 (osd.4) 15 : cluster [DBG] 5.18 scrub starts 2024-02-19T21:33:36.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:36.341928+0000 osd.4 (osd.4) 16 : cluster [DBG] 5.18 scrub ok 2024-02-19T21:33:36.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:35.275010+0000 osd.6 (osd.6) 13 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:33:36.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:35.277900+0000 osd.6 (osd.6) 14 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:33:36.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:35.526046+0000 osd.0 (osd.0) 15 : cluster [DBG] 6.16 scrub starts 2024-02-19T21:33:36.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:35.526860+0000 osd.0 (osd.0) 16 : cluster [DBG] 6.16 scrub ok 2024-02-19T21:33:36.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:36.338804+0000 osd.4 (osd.4) 15 : cluster [DBG] 5.18 scrub starts 2024-02-19T21:33:36.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:36.341928+0000 osd.4 (osd.4) 16 : cluster [DBG] 5.18 scrub ok 2024-02-19T21:33:36.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:35.275010+0000 osd.6 (osd.6) 13 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:33:36.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:35.277900+0000 osd.6 (osd.6) 14 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:33:36.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:35.526046+0000 osd.0 (osd.0) 15 : cluster [DBG] 6.16 scrub starts 2024-02-19T21:33:36.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:35.526860+0000 osd.0 (osd.0) 16 : cluster [DBG] 6.16 scrub ok 2024-02-19T21:33:36.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:36.338804+0000 osd.4 (osd.4) 15 : cluster [DBG] 5.18 scrub starts 2024-02-19T21:33:36.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:36.341928+0000 osd.4 (osd.4) 16 : cluster [DBG] 5.18 scrub ok 2024-02-19T21:33:37.707 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:35.581733+0000 osd.3 (osd.3) 11 : cluster [DBG] 3.2 scrub starts 2024-02-19T21:33:37.707 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:35.584716+0000 osd.3 (osd.3) 12 : cluster [DBG] 3.2 scrub ok 2024-02-19T21:33:37.707 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:36.647023+0000 osd.5 (osd.5) 11 : cluster [DBG] 6.a deep-scrub starts 2024-02-19T21:33:37.707 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:36.648087+0000 osd.5 (osd.5) 12 : cluster [DBG] 6.a deep-scrub ok 2024-02-19T21:33:37.707 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:36.772000+0000 mgr.y (mgr.14514) 44 : cluster [DBG] pgmap v38: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:33:37.708 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:35.581733+0000 osd.3 (osd.3) 11 : cluster [DBG] 3.2 scrub starts 2024-02-19T21:33:37.708 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:35.584716+0000 osd.3 (osd.3) 12 : cluster [DBG] 3.2 scrub ok 2024-02-19T21:33:37.708 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:36.647023+0000 osd.5 (osd.5) 11 : cluster [DBG] 6.a deep-scrub starts 2024-02-19T21:33:37.708 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:36.648087+0000 osd.5 (osd.5) 12 : cluster [DBG] 6.a deep-scrub ok 2024-02-19T21:33:37.708 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:36.772000+0000 mgr.y (mgr.14514) 44 : cluster [DBG] pgmap v38: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:33:38.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:35.581733+0000 osd.3 (osd.3) 11 : cluster [DBG] 3.2 scrub starts 2024-02-19T21:33:38.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:35.584716+0000 osd.3 (osd.3) 12 : cluster [DBG] 3.2 scrub ok 2024-02-19T21:33:38.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:36.647023+0000 osd.5 (osd.5) 11 : cluster [DBG] 6.a deep-scrub starts 2024-02-19T21:33:38.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:36.648087+0000 osd.5 (osd.5) 12 : cluster [DBG] 6.a deep-scrub ok 2024-02-19T21:33:38.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:36.772000+0000 mgr.y (mgr.14514) 44 : cluster [DBG] pgmap v38: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:33:38.591 INFO:teuthology.orchestra.run.smithi080.stdout:34359738424 2024-02-19T21:33:38.592 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-02-19T21:33:38.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:37.682087+0000 osd.5 (osd.5) 13 : cluster [DBG] 2.2 deep-scrub starts 2024-02-19T21:33:38.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:37.683085+0000 osd.5 (osd.5) 14 : cluster [DBG] 2.2 deep-scrub ok 2024-02-19T21:33:38.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:38.344811+0000 osd.4 (osd.4) 17 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:33:38.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:38.348359+0000 osd.4 (osd.4) 18 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:33:38.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:37.682087+0000 osd.5 (osd.5) 13 : cluster [DBG] 2.2 deep-scrub starts 2024-02-19T21:33:38.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:37.683085+0000 osd.5 (osd.5) 14 : cluster [DBG] 2.2 deep-scrub ok 2024-02-19T21:33:38.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:38.344811+0000 osd.4 (osd.4) 17 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:33:38.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:38.348359+0000 osd.4 (osd.4) 18 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:33:38.860 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:33:39.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:37.682087+0000 osd.5 (osd.5) 13 : cluster [DBG] 2.2 deep-scrub starts 2024-02-19T21:33:39.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:37.683085+0000 osd.5 (osd.5) 14 : cluster [DBG] 2.2 deep-scrub ok 2024-02-19T21:33:39.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:38.344811+0000 osd.4 (osd.4) 17 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:33:39.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:38.348359+0000 osd.4 (osd.4) 18 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:33:39.452 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:39 smithi157 systemd[1]: Starting Ceph grafana.a for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T21:33:39.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:37.908035+0000 osd.1 (osd.1) 11 : cluster [DBG] 2.9 deep-scrub starts 2024-02-19T21:33:39.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:37.911139+0000 osd.1 (osd.1) 12 : cluster [DBG] 2.9 deep-scrub ok 2024-02-19T21:33:39.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:38.205046+0000 osd.6 (osd.6) 15 : cluster [DBG] 5.2 deep-scrub starts 2024-02-19T21:33:39.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:38.208031+0000 osd.6 (osd.6) 16 : cluster [DBG] 5.2 deep-scrub ok 2024-02-19T21:33:39.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:38.441935+0000 osd.7 (osd.7) 11 : cluster [DBG] 5.9 scrub starts 2024-02-19T21:33:39.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:38.445420+0000 osd.7 (osd.7) 12 : cluster [DBG] 5.9 scrub ok 2024-02-19T21:33:39.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:38.548309+0000 osd.0 (osd.0) 17 : cluster [DBG] 4.b scrub starts 2024-02-19T21:33:39.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:38.550243+0000 osd.0 (osd.0) 18 : cluster [DBG] 4.b scrub ok 2024-02-19T21:33:39.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:38.772365+0000 mgr.y (mgr.14514) 45 : cluster [DBG] pgmap v39: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:33:39.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:37.908035+0000 osd.1 (osd.1) 11 : cluster [DBG] 2.9 deep-scrub starts 2024-02-19T21:33:39.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:37.911139+0000 osd.1 (osd.1) 12 : cluster [DBG] 2.9 deep-scrub ok 2024-02-19T21:33:39.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:38.205046+0000 osd.6 (osd.6) 15 : cluster [DBG] 5.2 deep-scrub starts 2024-02-19T21:33:39.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:38.208031+0000 osd.6 (osd.6) 16 : cluster [DBG] 5.2 deep-scrub ok 2024-02-19T21:33:39.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:38.441935+0000 osd.7 (osd.7) 11 : cluster [DBG] 5.9 scrub starts 2024-02-19T21:33:39.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:38.445420+0000 osd.7 (osd.7) 12 : cluster [DBG] 5.9 scrub ok 2024-02-19T21:33:39.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:38.548309+0000 osd.0 (osd.0) 17 : cluster [DBG] 4.b scrub starts 2024-02-19T21:33:39.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:38.550243+0000 osd.0 (osd.0) 18 : cluster [DBG] 4.b scrub ok 2024-02-19T21:33:39.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:38.772365+0000 mgr.y (mgr.14514) 45 : cluster [DBG] pgmap v39: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:33:39.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:37.908035+0000 osd.1 (osd.1) 11 : cluster [DBG] 2.9 deep-scrub starts 2024-02-19T21:33:39.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:37.911139+0000 osd.1 (osd.1) 12 : cluster [DBG] 2.9 deep-scrub ok 2024-02-19T21:33:39.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:38.205046+0000 osd.6 (osd.6) 15 : cluster [DBG] 5.2 deep-scrub starts 2024-02-19T21:33:39.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:38.208031+0000 osd.6 (osd.6) 16 : cluster [DBG] 5.2 deep-scrub ok 2024-02-19T21:33:39.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:38.441935+0000 osd.7 (osd.7) 11 : cluster [DBG] 5.9 scrub starts 2024-02-19T21:33:39.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:38.445420+0000 osd.7 (osd.7) 12 : cluster [DBG] 5.9 scrub ok 2024-02-19T21:33:39.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:38.548309+0000 osd.0 (osd.0) 17 : cluster [DBG] 4.b scrub starts 2024-02-19T21:33:39.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:38.550243+0000 osd.0 (osd.0) 18 : cluster [DBG] 4.b scrub ok 2024-02-19T21:33:39.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:38.772365+0000 mgr.y (mgr.14514) 45 : cluster [DBG] pgmap v39: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:33:40.078 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:33:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:33:40.381 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="The state of unified alerting is still not defined. The decision will be made during as we run the database migrations" logger=settings 2024-02-19T21:33:40.381 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=warn msg="falling back to legacy setting of 'min_interval_seconds'; please use the configuration option in the `unified_alerting` section if Grafana 8 alerts are enabled." logger=settings 2024-02-19T21:33:40.381 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2024-02-19T21:33:40.381 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2024-02-19T21:33:40.382 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2024-02-19T21:33:40.382 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2024-02-19T21:33:40.382 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-02-19T21:33:40.382 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-02-19T21:33:40.382 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2024-02-19T21:33:40.382 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2024-02-19T21:33:40.382 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2024-02-19T21:33:40.382 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2024-02-19T21:33:40.382 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2024-02-19T21:33:40.382 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="App mode production" logger=settings 2024-02-19T21:33:40.382 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2024-02-19T21:33:40.383 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=warn msg="SQLite database file has broader permissions than it should" logger=sqlstore path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-02-19T21:33:40.383 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Starting DB migrations" logger=migrator 2024-02-19T21:33:40.383 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2024-02-19T21:33:40.383 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2024-02-19T21:33:40.383 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2024-02-19T21:33:40.383 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2024-02-19T21:33:40.383 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2024-02-19T21:33:40.383 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2024-02-19T21:33:40.383 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2024-02-19T21:33:40.383 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2024-02-19T21:33:40.384 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2024-02-19T21:33:40.384 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2024-02-19T21:33:40.384 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-02-19T21:33:40.384 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2024-02-19T21:33:40.384 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2024-02-19T21:33:40.384 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2024-02-19T21:33:40.384 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2024-02-19T21:33:40.384 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2024-02-19T21:33:40.384 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2024-02-19T21:33:40.384 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add index user.login/user.email" 2024-02-19T21:33:40.384 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_service_account column to user" 2024-02-19T21:33:40.384 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2024-02-19T21:33:40.384 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2024-02-19T21:33:40.385 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2024-02-19T21:33:40.385 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2024-02-19T21:33:40.385 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2024-02-19T21:33:40.385 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2024-02-19T21:33:40.385 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_email - v1" 2024-02-19T21:33:40.385 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_org_id - v1" 2024-02-19T21:33:40.385 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_code - v1" 2024-02-19T21:33:40.385 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_status - v1" 2024-02-19T21:33:40.385 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-02-19T21:33:40.385 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create temp_user v2" 2024-02-19T21:33:40.385 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v2" 2024-02-19T21:33:40.385 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v2" 2024-02-19T21:33:40.385 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v2" 2024-02-19T21:33:40.385 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v2" 2024-02-19T21:33:40.386 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="copy temp_user v1 to v2" 2024-02-19T21:33:40.386 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop temp_user_tmp_qwerty" 2024-02-19T21:33:40.386 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Set created for temp users that will otherwise prematurely expire" 2024-02-19T21:33:40.386 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2024-02-19T21:33:40.386 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2024-02-19T21:33:40.386 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2024-02-19T21:33:40.386 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2024-02-19T21:33:40.386 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2024-02-19T21:33:40.386 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2024-02-19T21:33:40.386 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2024-02-19T21:33:40.386 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_user_id - v1" 2024-02-19T21:33:40.386 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2024-02-19T21:33:40.386 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2024-02-19T21:33:40.386 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2024-02-19T21:33:40.387 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2024-02-19T21:33:40.387 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2024-02-19T21:33:40.387 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2024-02-19T21:33:40.387 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2024-02-19T21:33:40.387 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2024-02-19T21:33:40.387 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-02-19T21:33:40.387 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2024-02-19T21:33:40.387 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2024-02-19T21:33:40.387 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2024-02-19T21:33:40.387 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2024-02-19T21:33:40.387 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2024-02-19T21:33:40.387 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2024-02-19T21:33:40.387 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2024-02-19T21:33:40.388 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2024-02-19T21:33:40.388 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2024-02-19T21:33:40.388 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2024-02-19T21:33:40.388 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2024-02-19T21:33:40.388 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2024-02-19T21:33:40.388 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2024-02-19T21:33:40.388 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2024-02-19T21:33:40.388 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2024-02-19T21:33:40.388 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2024-02-19T21:33:40.388 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2024-02-19T21:33:40.388 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2024-02-19T21:33:40.388 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2024-02-19T21:33:40.388 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2024-02-19T21:33:40.389 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2024-02-19T21:33:40.389 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2024-02-19T21:33:40.389 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2024-02-19T21:33:40.389 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2024-02-19T21:33:40.389 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2024-02-19T21:33:40.389 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2024-02-19T21:33:40.389 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-02-19T21:33:40.389 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2024-02-19T21:33:40.389 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-02-19T21:33:40.389 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-02-19T21:33:40.389 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2024-02-19T21:33:40.389 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2024-02-19T21:33:40.389 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2024-02-19T21:33:40.389 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_title" 2024-02-19T21:33:40.390 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="delete tags for deleted dashboards" 2024-02-19T21:33:40.390 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="delete stars for deleted dashboards" 2024-02-19T21:33:40.390 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_is_folder" 2024-02-19T21:33:40.390 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2024-02-19T21:33:40.390 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2024-02-19T21:33:40.390 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2024-02-19T21:33:40.390 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2024-02-19T21:33:40.390 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2024-02-19T21:33:40.390 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2024-02-19T21:33:40.390 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2024-02-19T21:33:40.390 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2024-02-19T21:33:40.390 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2024-02-19T21:33:40.390 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-02-19T21:33:40.390 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2024-02-19T21:33:40.390 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2024-02-19T21:33:40.391 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2024-02-19T21:33:40.391 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2024-02-19T21:33:40.391 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2024-02-19T21:33:40.391 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2024-02-19T21:33:40.391 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2024-02-19T21:33:40.391 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2024-02-19T21:33:40.391 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add uid column" 2024-02-19T21:33:40.391 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid value" 2024-02-19T21:33:40.391 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index datasource_org_id_uid" 2024-02-19T21:33:40.391 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index datasource_org_id_is_default" 2024-02-19T21:33:40.391 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2024-02-19T21:33:40.391 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2024-02-19T21:33:40.392 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2024-02-19T21:33:40.392 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2024-02-19T21:33:40.392 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2024-02-19T21:33:40.392 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2024-02-19T21:33:40.392 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2024-02-19T21:33:40.392 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2024-02-19T21:33:40.392 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2024-02-19T21:33:40.392 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2024-02-19T21:33:40.392 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2024-02-19T21:33:40.392 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2024-02-19T21:33:40.392 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2024-02-19T21:33:40.392 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2024-02-19T21:33:40.392 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2024-02-19T21:33:40.392 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2024-02-19T21:33:40.393 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add service account foreign key" 2024-02-19T21:33:40.393 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2024-02-19T21:33:40.393 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2024-02-19T21:33:40.393 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2024-02-19T21:33:40.393 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2024-02-19T21:33:40.393 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-02-19T21:33:40.393 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2024-02-19T21:33:40.393 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2024-02-19T21:33:40.393 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2024-02-19T21:33:40.393 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2024-02-19T21:33:40.393 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add encrypted dashboard json column" 2024-02-19T21:33:40.393 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-02-19T21:33:40.393 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2024-02-19T21:33:40.394 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2024-02-19T21:33:40.394 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2024-02-19T21:33:40.394 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2024-02-19T21:33:40.394 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-02-19T21:33:40.394 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2024-02-19T21:33:40.394 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2024-02-19T21:33:40.394 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2024-02-19T21:33:40.394 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2024-02-19T21:33:40.394 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2024-02-19T21:33:40.394 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2024-02-19T21:33:40.394 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2024-02-19T21:33:40.394 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2024-02-19T21:33:40.394 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2024-02-19T21:33:40.395 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2024-02-19T21:33:40.395 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2024-02-19T21:33:40.395 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2024-02-19T21:33:40.395 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2024-02-19T21:33:40.395 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2024-02-19T21:33:40.395 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2024-02-19T21:33:40.395 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column week_start in preferences" 2024-02-19T21:33:40.397 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2024-02-19T21:33:40.397 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2024-02-19T21:33:40.397 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2024-02-19T21:33:40.397 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2024-02-19T21:33:40.397 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2024-02-19T21:33:40.397 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-02-19T21:33:40.397 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-02-19T21:33:40.397 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-02-19T21:33:40.397 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v2" 2024-02-19T21:33:40.397 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-02-19T21:33:40.397 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="copy alert_rule_tag v1 to v2" 2024-02-19T21:33:40.397 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop table alert_rule_tag_v1" 2024-02-19T21:33:40.397 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2024-02-19T21:33:40.397 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2024-02-19T21:33:40.398 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2024-02-19T21:33:40.398 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2024-02-19T21:33:40.398 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2024-02-19T21:33:40.398 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2024-02-19T21:33:40.398 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2024-02-19T21:33:40.398 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2024-02-19T21:33:40.398 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2024-02-19T21:33:40.398 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2024-02-19T21:33:40.398 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2024-02-19T21:33:40.398 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2024-02-19T21:33:40.398 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-02-19T21:33:40.398 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2024-02-19T21:33:40.398 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2024-02-19T21:33:40.398 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2024-02-19T21:33:40.398 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2024-02-19T21:33:40.398 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 bash[63474]: 7eebff417fd8aa59ba401ade78ac437c9410ecbbb6c56898441a3bc76887fdf4 2024-02-19T21:33:40.399 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2024-02-19T21:33:40.399 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column secure_settings in alert_notification" 2024-02-19T21:33:40.399 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert.settings to mediumtext" 2024-02-19T21:33:40.399 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add non-unique index alert_notification_state_alert_id" 2024-02-19T21:33:40.399 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add non-unique index alert_rule_tag_alert_id" 2024-02-19T21:33:40.399 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2024-02-19T21:33:40.399 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 systemd[1]: Started Ceph grafana.a for 6f763558-cf6d-11ee-95bb-87774f69a715. 2024-02-19T21:33:40.399 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2024-02-19T21:33:40.399 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2024-02-19T21:33:40.399 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2024-02-19T21:33:40.400 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2024-02-19T21:33:40.400 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2024-02-19T21:33:40.400 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2024-02-19T21:33:40.400 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2024-02-19T21:33:40.400 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2024-02-19T21:33:40.400 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2024-02-19T21:33:40.400 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2024-02-19T21:33:40.400 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2024-02-19T21:33:40.400 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2024-02-19T21:33:40.400 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-02-19T21:33:40.400 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-02-19T21:33:40.400 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v3" 2024-02-19T21:33:40.401 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-02-19T21:33:40.401 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="copy annotation_tag v2 to v3" 2024-02-19T21:33:40.401 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop table annotation_tag_v2" 2024-02-19T21:33:40.401 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2024-02-19T21:33:40.401 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2024-02-19T21:33:40.401 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2024-02-19T21:33:40.401 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2024-02-19T21:33:40.401 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2024-02-19T21:33:40.401 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2024-02-19T21:33:40.401 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2024-02-19T21:33:40.401 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2024-02-19T21:33:40.401 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2024-02-19T21:33:40.402 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2024-02-19T21:33:40.402 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2024-02-19T21:33:40.402 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-02-19T21:33:40.402 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-02-19T21:33:40.402 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2024-02-19T21:33:40.402 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2024-02-19T21:33:40.402 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for alert_id on annotation table" 2024-02-19T21:33:40.402 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2024-02-19T21:33:40.402 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2024-02-19T21:33:40.402 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2024-02-19T21:33:40.402 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-02-19T21:33:40.402 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2024-02-19T21:33:40.402 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2024-02-19T21:33:40.403 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2024-02-19T21:33:40.403 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2024-02-19T21:33:40.403 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2024-02-19T21:33:40.403 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2024-02-19T21:33:40.403 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2024-02-19T21:33:40.403 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2024-02-19T21:33:40.403 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2024-02-19T21:33:40.403 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.team_id" 2024-02-19T21:33:40.403 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2024-02-19T21:33:40.403 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2024-02-19T21:33:40.403 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2024-02-19T21:33:40.403 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2024-02-19T21:33:40.403 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2024-02-19T21:33:40.403 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2024-02-19T21:33:40.404 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2024-02-19T21:33:40.404 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_user_id" 2024-02-19T21:33:40.404 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_team_id" 2024-02-19T21:33:40.404 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_org_id_role" 2024-02-19T21:33:40.404 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_permission" 2024-02-19T21:33:40.404 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2024-02-19T21:33:40.404 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="delete acl rules for deleted dashboards and folders" 2024-02-19T21:33:40.404 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2024-02-19T21:33:40.404 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2024-02-19T21:33:40.404 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2024-02-19T21:33:40.404 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2024-02-19T21:33:40.404 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2024-02-19T21:33:40.404 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-02-19T21:33:40.405 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2024-02-19T21:33:40.405 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2024-02-19T21:33:40.405 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2024-02-19T21:33:40.405 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2024-02-19T21:33:40.405 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2024-02-19T21:33:40.405 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-02-19T21:33:40.405 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2024-02-19T21:33:40.405 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2024-02-19T21:33:40.405 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2024-02-19T21:33:40.405 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2024-02-19T21:33:40.405 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2024-02-19T21:33:40.405 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2024-02-19T21:33:40.405 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2024-02-19T21:33:40.405 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2024-02-19T21:33:40.405 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2024-02-19T21:33:40.406 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2024-02-19T21:33:40.406 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2024-02-19T21:33:40.406 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_auth_token.user_id" 2024-02-19T21:33:40.406 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add revoked_at to the user auth token" 2024-02-19T21:33:40.406 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2024-02-19T21:33:40.406 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2024-02-19T21:33:40.406 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create short_url table v1" 2024-02-19T21:33:40.406 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index short_url.org_id-uid" 2024-02-19T21:33:40.406 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="delete alert_definition table" 2024-02-19T21:33:40.406 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="recreate alert_definition table" 2024-02-19T21:33:40.406 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition on org_id and title columns" 2024-02-19T21:33:40.406 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition on org_id and uid columns" 2024-02-19T21:33:40.407 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_definition table data column to mediumtext in mysql" 2024-02-19T21:33:40.407 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop index in alert_definition on org_id and title columns" 2024-02-19T21:33:40.407 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop index in alert_definition on org_id and uid columns" 2024-02-19T21:33:40.407 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index in alert_definition on org_id and title columns" 2024-02-19T21:33:40.407 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index in alert_definition on org_id and uid columns" 2024-02-19T21:33:40.407 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column paused in alert_definition" 2024-02-19T21:33:40.407 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_definition table" 2024-02-19T21:33:40.407 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="delete alert_definition_version table" 2024-02-19T21:33:40.407 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="recreate alert_definition_version table" 2024-02-19T21:33:40.407 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-02-19T21:33:40.407 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-02-19T21:33:40.407 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_definition_version table data column to mediumtext in mysql" 2024-02-19T21:33:40.407 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_definition_version table" 2024-02-19T21:33:40.408 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_instance table" 2024-02-19T21:33:40.408 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-02-19T21:33:40.408 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_instance table on def_org_id, current_state columns" 2024-02-19T21:33:40.408 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add column current_state_end to alert_instance" 2024-02-19T21:33:40.408 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-02-19T21:33:40.408 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="remove index def_org_id, current_state on alert_instance" 2024-02-19T21:33:40.408 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="rename def_org_id to rule_org_id in alert_instance" 2024-02-19T21:33:40.408 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="rename def_uid to rule_uid in alert_instance" 2024-02-19T21:33:40.408 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-02-19T21:33:40.408 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index rule_org_id, current_state on alert_instance" 2024-02-19T21:33:40.408 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_rule table" 2024-02-19T21:33:40.408 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id and title columns" 2024-02-19T21:33:40.409 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id and uid columns" 2024-02-19T21:33:40.409 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-02-19T21:33:40.409 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_rule table data column to mediumtext in mysql" 2024-02-19T21:33:40.409 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add column for to alert_rule" 2024-02-19T21:33:40.409 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add column annotations to alert_rule" 2024-02-19T21:33:40.409 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add column labels to alert_rule" 2024-02-19T21:33:40.409 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="remove unique index from alert_rule on org_id, title columns" 2024-02-19T21:33:40.409 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-02-19T21:33:40.409 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add dashboard_uid column to alert_rule" 2024-02-19T21:33:40.409 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add panel_id column to alert_rule" 2024-02-19T21:33:40.409 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-02-19T21:33:40.409 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_rule_version table" 2024-02-19T21:33:40.409 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-02-19T21:33:40.409 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-02-19T21:33:40.410 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_rule_version table data column to mediumtext in mysql" 2024-02-19T21:33:40.410 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add column for to alert_rule_version" 2024-02-19T21:33:40.410 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add column annotations to alert_rule_version" 2024-02-19T21:33:40.410 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add column labels to alert_rule_version" 2024-02-19T21:33:40.410 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id=create_alert_configuration_table 2024-02-19T21:33:40.410 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column default in alert_configuration" 2024-02-19T21:33:40.410 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-02-19T21:33:40.410 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add column org_id in alert_configuration" 2024-02-19T21:33:40.410 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_configuration table on org_id column" 2024-02-19T21:33:40.410 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id=create_ngalert_configuration_table 2024-02-19T21:33:40.410 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index in ngalert_configuration on org_id column" 2024-02-19T21:33:40.410 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="clear migration entry \"remove unified alerting data\"" 2024-02-19T21:33:40.410 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="move dashboard alerts to unified alerting" 2024-02-19T21:33:40.410 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create library_element table v1" 2024-02-19T21:33:40.410 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index library_element org_id-folder_id-name-kind" 2024-02-19T21:33:40.410 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create library_element_connection table v1" 2024-02-19T21:33:40.411 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index library_element_connection element_id-kind-connection_id" 2024-02-19T21:33:40.411 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index library_element org_id_uid" 2024-02-19T21:33:40.411 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="clone move dashboard alerts to unified alerting" 2024-02-19T21:33:40.411 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create data_keys table" 2024-02-19T21:33:40.411 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create kv_store table v1" 2024-02-19T21:33:40.411 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index kv_store.org_id-namespace-key" 2024-02-19T21:33:40.411 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="update dashboard_uid and panel_id from existing annotations" 2024-02-19T21:33:40.412 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create permission table" 2024-02-19T21:33:40.412 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index permission.role_id" 2024-02-19T21:33:40.412 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role_id_action_scope" 2024-02-19T21:33:40.412 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create role table" 2024-02-19T21:33:40.412 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add column display_name" 2024-02-19T21:33:40.412 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add column group_name" 2024-02-19T21:33:40.412 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index role.org_id" 2024-02-19T21:33:40.412 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role_org_id_name" 2024-02-19T21:33:40.412 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index role_org_id_uid" 2024-02-19T21:33:40.412 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create team role table" 2024-02-19T21:33:40.412 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_role.org_id" 2024-02-19T21:33:40.412 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_role_org_id_team_id_role_id" 2024-02-19T21:33:40.412 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_role.team_id" 2024-02-19T21:33:40.413 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create user role table" 2024-02-19T21:33:40.413 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_role.org_id" 2024-02-19T21:33:40.413 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_role_org_id_user_id_role_id" 2024-02-19T21:33:40.413 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_role.user_id" 2024-02-19T21:33:40.413 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create builtin role table" 2024-02-19T21:33:40.413 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.role_id" 2024-02-19T21:33:40.413 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.name" 2024-02-19T21:33:40.413 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column org_id to builtin_role table" 2024-02-19T21:33:40.413 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.org_id" 2024-02-19T21:33:40.413 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index builtin_role_org_id_role_id_role" 2024-02-19T21:33:40.413 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index role_org_id_uid" 2024-02-19T21:33:40.413 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role.uid" 2024-02-19T21:33:40.413 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="create seed assignment table" 2024-02-19T21:33:40.413 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index builtin_role_role_name" 2024-02-19T21:33:40.413 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="migrations completed" logger=migrator performed=381 skipped=0 duration=175.375976ms 2024-02-19T21:33:40.413 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Created default organization" logger=sqlstore 2024-02-19T21:33:40.414 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Initialising plugins" logger=plugin.manager 2024-02-19T21:33:40.414 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=input 2024-02-19T21:33:40.414 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=grafana-piechart-panel 2024-02-19T21:33:40.414 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=vonage-status-panel 2024-02-19T21:33:40.414 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="Live Push Gateway initialization" logger=live.push_http 2024-02-19T21:33:40.414 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2024-02-19T21:33:40.414 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Dashboard1 uid=P43CA22E17D0F9596 2024-02-19T21:33:40.414 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="warming cache for startup" logger=ngalert 2024-02-19T21:33:40.414 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="starting MultiOrg Alertmanager" logger=ngalert.multiorg.alertmanager 2024-02-19T21:33:40.414 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:33:40+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2024-02-19T21:33:40.738 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:39.412175+0000 osd.7 (osd.7) 13 : cluster [DBG] 2.b deep-scrub starts 2024-02-19T21:33:40.738 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:39.415065+0000 osd.7 (osd.7) 14 : cluster [DBG] 2.b deep-scrub ok 2024-02-19T21:33:40.738 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:39.537845+0000 osd.0 (osd.0) 19 : cluster [DBG] 4.16 scrub starts 2024-02-19T21:33:40.738 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:39.539462+0000 osd.0 (osd.0) 20 : cluster [DBG] 4.16 scrub ok 2024-02-19T21:33:40.738 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:39.815639+0000 mgr.y (mgr.14514) 46 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:33:40.739 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:40.225759+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:40.739 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:40.226932+0000 mon.a (mon.0) 713 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:33:40.739 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:40.382486+0000 osd.4 (osd.4) 19 : cluster [DBG] 4.e scrub starts 2024-02-19T21:33:40.739 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:40.386071+0000 osd.4 (osd.4) 20 : cluster [DBG] 4.e scrub ok 2024-02-19T21:33:40.739 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:39.412175+0000 osd.7 (osd.7) 13 : cluster [DBG] 2.b deep-scrub starts 2024-02-19T21:33:40.739 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:39.415065+0000 osd.7 (osd.7) 14 : cluster [DBG] 2.b deep-scrub ok 2024-02-19T21:33:40.739 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:39.537845+0000 osd.0 (osd.0) 19 : cluster [DBG] 4.16 scrub starts 2024-02-19T21:33:40.739 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:39.539462+0000 osd.0 (osd.0) 20 : cluster [DBG] 4.16 scrub ok 2024-02-19T21:33:40.739 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:39.815639+0000 mgr.y (mgr.14514) 46 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:33:40.739 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:40.225759+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:40.739 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:40.226932+0000 mon.a (mon.0) 713 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:33:40.739 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:40.382486+0000 osd.4 (osd.4) 19 : cluster [DBG] 4.e scrub starts 2024-02-19T21:33:40.740 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:40.386071+0000 osd.4 (osd.4) 20 : cluster [DBG] 4.e scrub ok 2024-02-19T21:33:40.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:39.412175+0000 osd.7 (osd.7) 13 : cluster [DBG] 2.b deep-scrub starts 2024-02-19T21:33:40.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:39.415065+0000 osd.7 (osd.7) 14 : cluster [DBG] 2.b deep-scrub ok 2024-02-19T21:33:40.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:39.537845+0000 osd.0 (osd.0) 19 : cluster [DBG] 4.16 scrub starts 2024-02-19T21:33:40.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:39.539462+0000 osd.0 (osd.0) 20 : cluster [DBG] 4.16 scrub ok 2024-02-19T21:33:40.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:39.815639+0000 mgr.y (mgr.14514) 46 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:33:40.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:40.225759+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:40.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:40.226932+0000 mon.a (mon.0) 713 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:33:40.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:40.382486+0000 osd.4 (osd.4) 19 : cluster [DBG] 4.e scrub starts 2024-02-19T21:33:40.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:40.386071+0000 osd.4 (osd.4) 20 : cluster [DBG] 4.e scrub ok 2024-02-19T21:33:41.052 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:33:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:33:40] "GET /metrics HTTP/1.1" 200 172130 "" "Prometheus/2.33.4" 2024-02-19T21:33:41.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:40.212233+0000 osd.2 (osd.2) 11 : cluster [DBG] 4.1c scrub starts 2024-02-19T21:33:41.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:40.215700+0000 osd.2 (osd.2) 12 : cluster [DBG] 4.1c scrub ok 2024-02-19T21:33:41.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:40.680026+0000 osd.5 (osd.5) 15 : cluster [DBG] 6.d scrub starts 2024-02-19T21:33:41.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:40.680815+0000 osd.5 (osd.5) 16 : cluster [DBG] 6.d scrub ok 2024-02-19T21:33:41.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:40.772941+0000 mgr.y (mgr.14514) 47 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1000 B/s rd, 0 op/s 2024-02-19T21:33:41.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:41.428722+0000 osd.4 (osd.4) 21 : cluster [DBG] 6.2 scrub starts 2024-02-19T21:33:41.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:41.431851+0000 osd.4 (osd.4) 22 : cluster [DBG] 6.2 scrub ok 2024-02-19T21:33:41.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:40.212233+0000 osd.2 (osd.2) 11 : cluster [DBG] 4.1c scrub starts 2024-02-19T21:33:41.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:40.215700+0000 osd.2 (osd.2) 12 : cluster [DBG] 4.1c scrub ok 2024-02-19T21:33:41.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:40.680026+0000 osd.5 (osd.5) 15 : cluster [DBG] 6.d scrub starts 2024-02-19T21:33:41.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:40.680815+0000 osd.5 (osd.5) 16 : cluster [DBG] 6.d scrub ok 2024-02-19T21:33:41.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:40.772941+0000 mgr.y (mgr.14514) 47 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1000 B/s rd, 0 op/s 2024-02-19T21:33:41.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:41.428722+0000 osd.4 (osd.4) 21 : cluster [DBG] 6.2 scrub starts 2024-02-19T21:33:41.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:41.431851+0000 osd.4 (osd.4) 22 : cluster [DBG] 6.2 scrub ok 2024-02-19T21:33:41.917 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:40.212233+0000 osd.2 (osd.2) 11 : cluster [DBG] 4.1c scrub starts 2024-02-19T21:33:41.917 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:40.215700+0000 osd.2 (osd.2) 12 : cluster [DBG] 4.1c scrub ok 2024-02-19T21:33:41.917 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:40.680026+0000 osd.5 (osd.5) 15 : cluster [DBG] 6.d scrub starts 2024-02-19T21:33:41.917 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:40.680815+0000 osd.5 (osd.5) 16 : cluster [DBG] 6.d scrub ok 2024-02-19T21:33:41.918 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:40.772941+0000 mgr.y (mgr.14514) 47 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1000 B/s rd, 0 op/s 2024-02-19T21:33:41.918 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:41.428722+0000 osd.4 (osd.4) 21 : cluster [DBG] 6.2 scrub starts 2024-02-19T21:33:41.918 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:41.431851+0000 osd.4 (osd.4) 22 : cluster [DBG] 6.2 scrub ok 2024-02-19T21:33:42.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:42.434066+0000 osd.3 (osd.3) 13 : cluster [DBG] 6.b scrub starts 2024-02-19T21:33:42.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:42.435028+0000 osd.3 (osd.3) 14 : cluster [DBG] 6.b scrub ok 2024-02-19T21:33:42.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:42.454787+0000 osd.4 (osd.4) 23 : cluster [DBG] 6.1a scrub starts 2024-02-19T21:33:42.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:42.457676+0000 osd.4 (osd.4) 24 : cluster [DBG] 6.1a scrub ok 2024-02-19T21:33:42.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:42.434066+0000 osd.3 (osd.3) 13 : cluster [DBG] 6.b scrub starts 2024-02-19T21:33:42.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:42.435028+0000 osd.3 (osd.3) 14 : cluster [DBG] 6.b scrub ok 2024-02-19T21:33:42.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:42.454787+0000 osd.4 (osd.4) 23 : cluster [DBG] 6.1a scrub starts 2024-02-19T21:33:42.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:42.457676+0000 osd.4 (osd.4) 24 : cluster [DBG] 6.1a scrub ok 2024-02-19T21:33:42.923 INFO:teuthology.orchestra.run.smithi080.stdout:55834574899 2024-02-19T21:33:42.923 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-02-19T21:33:43.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:42.434066+0000 osd.3 (osd.3) 13 : cluster [DBG] 6.b scrub starts 2024-02-19T21:33:43.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:42.435028+0000 osd.3 (osd.3) 14 : cluster [DBG] 6.b scrub ok 2024-02-19T21:33:43.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:42.454787+0000 osd.4 (osd.4) 23 : cluster [DBG] 6.1a scrub starts 2024-02-19T21:33:43.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:42.457676+0000 osd.4 (osd.4) 24 : cluster [DBG] 6.1a scrub ok 2024-02-19T21:33:43.228 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:33:43.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:42.169788+0000 osd.6 (osd.6) 17 : cluster [DBG] 4.1f scrub starts 2024-02-19T21:33:43.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:42.173254+0000 osd.6 (osd.6) 18 : cluster [DBG] 4.1f scrub ok 2024-02-19T21:33:43.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:42.198206+0000 osd.2 (osd.2) 13 : cluster [DBG] 5.b scrub starts 2024-02-19T21:33:43.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:42.201091+0000 osd.2 (osd.2) 14 : cluster [DBG] 5.b scrub ok 2024-02-19T21:33:43.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:42.527048+0000 osd.0 (osd.0) 21 : cluster [DBG] 6.10 deep-scrub starts 2024-02-19T21:33:43.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:42.527845+0000 osd.0 (osd.0) 22 : cluster [DBG] 6.10 deep-scrub ok 2024-02-19T21:33:43.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:42.773412+0000 mgr.y (mgr.14514) 48 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:33:43.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:43.412858+0000 osd.4 (osd.4) 25 : cluster [DBG] 4.9 deep-scrub starts 2024-02-19T21:33:43.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:43.418442+0000 osd.4 (osd.4) 26 : cluster [DBG] 4.9 deep-scrub ok 2024-02-19T21:33:43.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:42.169788+0000 osd.6 (osd.6) 17 : cluster [DBG] 4.1f scrub starts 2024-02-19T21:33:43.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:42.173254+0000 osd.6 (osd.6) 18 : cluster [DBG] 4.1f scrub ok 2024-02-19T21:33:43.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:42.198206+0000 osd.2 (osd.2) 13 : cluster [DBG] 5.b scrub starts 2024-02-19T21:33:43.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:42.201091+0000 osd.2 (osd.2) 14 : cluster [DBG] 5.b scrub ok 2024-02-19T21:33:43.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:42.527048+0000 osd.0 (osd.0) 21 : cluster [DBG] 6.10 deep-scrub starts 2024-02-19T21:33:43.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:42.527845+0000 osd.0 (osd.0) 22 : cluster [DBG] 6.10 deep-scrub ok 2024-02-19T21:33:43.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:42.773412+0000 mgr.y (mgr.14514) 48 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:33:43.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:43.412858+0000 osd.4 (osd.4) 25 : cluster [DBG] 4.9 deep-scrub starts 2024-02-19T21:33:43.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:43.418442+0000 osd.4 (osd.4) 26 : cluster [DBG] 4.9 deep-scrub ok 2024-02-19T21:33:43.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:42.169788+0000 osd.6 (osd.6) 17 : cluster [DBG] 4.1f scrub starts 2024-02-19T21:33:43.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:42.173254+0000 osd.6 (osd.6) 18 : cluster [DBG] 4.1f scrub ok 2024-02-19T21:33:43.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:42.198206+0000 osd.2 (osd.2) 13 : cluster [DBG] 5.b scrub starts 2024-02-19T21:33:43.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:42.201091+0000 osd.2 (osd.2) 14 : cluster [DBG] 5.b scrub ok 2024-02-19T21:33:43.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:42.527048+0000 osd.0 (osd.0) 21 : cluster [DBG] 6.10 deep-scrub starts 2024-02-19T21:33:43.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:42.527845+0000 osd.0 (osd.0) 22 : cluster [DBG] 6.10 deep-scrub ok 2024-02-19T21:33:43.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:42.773412+0000 mgr.y (mgr.14514) 48 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:33:43.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:43.412858+0000 osd.4 (osd.4) 25 : cluster [DBG] 4.9 deep-scrub starts 2024-02-19T21:33:43.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:43.418442+0000 osd.4 (osd.4) 26 : cluster [DBG] 4.9 deep-scrub ok 2024-02-19T21:33:44.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:43.194074+0000 osd.6 (osd.6) 19 : cluster [DBG] 5.1f scrub starts 2024-02-19T21:33:44.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:43.197546+0000 osd.6 (osd.6) 20 : cluster [DBG] 5.1f scrub ok 2024-02-19T21:33:44.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:43.430386+0000 osd.7 (osd.7) 15 : cluster [DBG] 6.15 scrub starts 2024-02-19T21:33:44.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:43.433283+0000 osd.7 (osd.7) 16 : cluster [DBG] 6.15 scrub ok 2024-02-19T21:33:44.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:43.946495+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:44.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:43.194074+0000 osd.6 (osd.6) 19 : cluster [DBG] 5.1f scrub starts 2024-02-19T21:33:44.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:43.197546+0000 osd.6 (osd.6) 20 : cluster [DBG] 5.1f scrub ok 2024-02-19T21:33:44.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:43.430386+0000 osd.7 (osd.7) 15 : cluster [DBG] 6.15 scrub starts 2024-02-19T21:33:44.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:43.433283+0000 osd.7 (osd.7) 16 : cluster [DBG] 6.15 scrub ok 2024-02-19T21:33:44.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:43.946495+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:45.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:43.194074+0000 osd.6 (osd.6) 19 : cluster [DBG] 5.1f scrub starts 2024-02-19T21:33:45.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:43.197546+0000 osd.6 (osd.6) 20 : cluster [DBG] 5.1f scrub ok 2024-02-19T21:33:45.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:43.430386+0000 osd.7 (osd.7) 15 : cluster [DBG] 6.15 scrub starts 2024-02-19T21:33:45.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:43.433283+0000 osd.7 (osd.7) 16 : cluster [DBG] 6.15 scrub ok 2024-02-19T21:33:45.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:43.946495+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:46.059 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:33:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:33:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:33:46.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:44.206660+0000 osd.6 (osd.6) 21 : cluster [DBG] 2.14 scrub starts 2024-02-19T21:33:46.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:44.209639+0000 osd.6 (osd.6) 22 : cluster [DBG] 2.14 scrub ok 2024-02-19T21:33:46.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:44.406185+0000 osd.7 (osd.7) 17 : cluster [DBG] 2.8 scrub starts 2024-02-19T21:33:46.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:44.409652+0000 osd.7 (osd.7) 18 : cluster [DBG] 2.8 scrub ok 2024-02-19T21:33:46.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:44.719263+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:46.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:44.773977+0000 mgr.y (mgr.14514) 49 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:33:46.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:45.415855+0000 osd.4 (osd.4) 27 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:33:46.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:45.418860+0000 osd.4 (osd.4) 28 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:33:46.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:44.206660+0000 osd.6 (osd.6) 21 : cluster [DBG] 2.14 scrub starts 2024-02-19T21:33:46.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:44.209639+0000 osd.6 (osd.6) 22 : cluster [DBG] 2.14 scrub ok 2024-02-19T21:33:46.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:44.406185+0000 osd.7 (osd.7) 17 : cluster [DBG] 2.8 scrub starts 2024-02-19T21:33:46.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:44.409652+0000 osd.7 (osd.7) 18 : cluster [DBG] 2.8 scrub ok 2024-02-19T21:33:46.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:44.719263+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:46.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:44.773977+0000 mgr.y (mgr.14514) 49 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:33:46.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:45.415855+0000 osd.4 (osd.4) 27 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:33:46.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:45.418860+0000 osd.4 (osd.4) 28 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:33:46.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:44.206660+0000 osd.6 (osd.6) 21 : cluster [DBG] 2.14 scrub starts 2024-02-19T21:33:46.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:44.209639+0000 osd.6 (osd.6) 22 : cluster [DBG] 2.14 scrub ok 2024-02-19T21:33:46.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:44.406185+0000 osd.7 (osd.7) 17 : cluster [DBG] 2.8 scrub starts 2024-02-19T21:33:46.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:44.409652+0000 osd.7 (osd.7) 18 : cluster [DBG] 2.8 scrub ok 2024-02-19T21:33:46.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:44.719263+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:46.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:44.773977+0000 mgr.y (mgr.14514) 49 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:33:46.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:45.415855+0000 osd.4 (osd.4) 27 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:33:46.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:45.418860+0000 osd.4 (osd.4) 28 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:33:46.831 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:44.931292+0000 osd.1 (osd.1) 13 : cluster [DBG] 4.7 scrub starts 2024-02-19T21:33:46.831 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:44.933082+0000 osd.1 (osd.1) 14 : cluster [DBG] 4.7 scrub ok 2024-02-19T21:33:46.831 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:45.127537+0000 osd.2 (osd.2) 15 : cluster [DBG] 5.a scrub starts 2024-02-19T21:33:46.831 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:45.130641+0000 osd.2 (osd.2) 16 : cluster [DBG] 5.a scrub ok 2024-02-19T21:33:46.831 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:45.552289+0000 osd.5 (osd.5) 17 : cluster [DBG] 5.f scrub starts 2024-02-19T21:33:46.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:45.555222+0000 osd.5 (osd.5) 18 : cluster [DBG] 5.f scrub ok 2024-02-19T21:33:46.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:46.191878+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:46.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:46.192638+0000 mon.a (mon.0) 717 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:33:46.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:46.193346+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:33:46.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:46.197360+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:46.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:33:46.200548+0000 mgr.y (mgr.14514) 50 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-19T21:33:46.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:33:46.203511+0000 mgr.y (mgr.14514) 51 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi080 2024-02-19T21:33:46.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:46.450700+0000 osd.3 (osd.3) 15 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:33:46.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:46.451633+0000 osd.3 (osd.3) 16 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:33:46.832 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:44.931292+0000 osd.1 (osd.1) 13 : cluster [DBG] 4.7 scrub starts 2024-02-19T21:33:46.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:44.933082+0000 osd.1 (osd.1) 14 : cluster [DBG] 4.7 scrub ok 2024-02-19T21:33:46.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:45.127537+0000 osd.2 (osd.2) 15 : cluster [DBG] 5.a scrub starts 2024-02-19T21:33:46.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:45.130641+0000 osd.2 (osd.2) 16 : cluster [DBG] 5.a scrub ok 2024-02-19T21:33:46.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:45.552289+0000 osd.5 (osd.5) 17 : cluster [DBG] 5.f scrub starts 2024-02-19T21:33:46.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:45.555222+0000 osd.5 (osd.5) 18 : cluster [DBG] 5.f scrub ok 2024-02-19T21:33:46.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:46.191878+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:46.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:46.192638+0000 mon.a (mon.0) 717 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:33:46.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:46.193346+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:33:46.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:46.197360+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:46.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:33:46.200548+0000 mgr.y (mgr.14514) 50 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-19T21:33:46.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:33:46.203511+0000 mgr.y (mgr.14514) 51 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi080 2024-02-19T21:33:46.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:46.450700+0000 osd.3 (osd.3) 15 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:33:46.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:46.451633+0000 osd.3 (osd.3) 16 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:33:47.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:44.931292+0000 osd.1 (osd.1) 13 : cluster [DBG] 4.7 scrub starts 2024-02-19T21:33:47.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:44.933082+0000 osd.1 (osd.1) 14 : cluster [DBG] 4.7 scrub ok 2024-02-19T21:33:47.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:45.127537+0000 osd.2 (osd.2) 15 : cluster [DBG] 5.a scrub starts 2024-02-19T21:33:47.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:45.130641+0000 osd.2 (osd.2) 16 : cluster [DBG] 5.a scrub ok 2024-02-19T21:33:47.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:45.552289+0000 osd.5 (osd.5) 17 : cluster [DBG] 5.f scrub starts 2024-02-19T21:33:47.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:45.555222+0000 osd.5 (osd.5) 18 : cluster [DBG] 5.f scrub ok 2024-02-19T21:33:47.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:46.191878+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:47.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:46.192638+0000 mon.a (mon.0) 717 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:33:47.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:46.193346+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:33:47.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:46.197360+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:47.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:33:46.200548+0000 mgr.y (mgr.14514) 50 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-19T21:33:47.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:33:46.203511+0000 mgr.y (mgr.14514) 51 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi080 2024-02-19T21:33:47.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:46.450700+0000 osd.3 (osd.3) 15 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:33:47.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:46.451633+0000 osd.3 (osd.3) 16 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:33:48.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:46.386885+0000 osd.7 (osd.7) 19 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:33:48.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:46.390062+0000 osd.7 (osd.7) 20 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:33:48.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:46.542322+0000 osd.5 (osd.5) 19 : cluster [DBG] 5.1b deep-scrub starts 2024-02-19T21:33:48.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:46.543252+0000 osd.5 (osd.5) 20 : cluster [DBG] 5.1b deep-scrub ok 2024-02-19T21:33:48.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:46.774318+0000 mgr.y (mgr.14514) 52 : cluster [DBG] pgmap v43: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:33:48.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:46.386885+0000 osd.7 (osd.7) 19 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:33:48.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:46.390062+0000 osd.7 (osd.7) 20 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:33:48.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:46.542322+0000 osd.5 (osd.5) 19 : cluster [DBG] 5.1b deep-scrub starts 2024-02-19T21:33:48.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:46.543252+0000 osd.5 (osd.5) 20 : cluster [DBG] 5.1b deep-scrub ok 2024-02-19T21:33:48.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:46.774318+0000 mgr.y (mgr.14514) 52 : cluster [DBG] pgmap v43: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:33:48.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:46.386885+0000 osd.7 (osd.7) 19 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:33:48.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:46.390062+0000 osd.7 (osd.7) 20 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:33:48.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:46.542322+0000 osd.5 (osd.5) 19 : cluster [DBG] 5.1b deep-scrub starts 2024-02-19T21:33:48.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:46.543252+0000 osd.5 (osd.5) 20 : cluster [DBG] 5.1b deep-scrub ok 2024-02-19T21:33:48.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:46.774318+0000 mgr.y (mgr.14514) 52 : cluster [DBG] pgmap v43: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:33:48.669 INFO:teuthology.orchestra.run.smithi080.stdout:77309411375 2024-02-19T21:33:48.670 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-02-19T21:33:49.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:46.879764+0000 osd.1 (osd.1) 15 : cluster [DBG] 3.0 scrub starts 2024-02-19T21:33:49.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:46.883411+0000 osd.1 (osd.1) 16 : cluster [DBG] 3.0 scrub ok 2024-02-19T21:33:49.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:47.037342+0000 osd.2 (osd.2) 17 : cluster [DBG] 2.e scrub starts 2024-02-19T21:33:49.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:47.040264+0000 osd.2 (osd.2) 18 : cluster [DBG] 2.e scrub ok 2024-02-19T21:33:49.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:47.222645+0000 osd.6 (osd.6) 23 : cluster [DBG] 4.5 scrub starts 2024-02-19T21:33:49.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:47.226305+0000 osd.6 (osd.6) 24 : cluster [DBG] 4.5 scrub ok 2024-02-19T21:33:49.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:47.549761+0000 osd.0 (osd.0) 23 : cluster [DBG] 6.0 scrub starts 2024-02-19T21:33:49.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:47.550555+0000 osd.0 (osd.0) 24 : cluster [DBG] 6.0 scrub ok 2024-02-19T21:33:49.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:47.552718+0000 osd.5 (osd.5) 21 : cluster [DBG] 5.15 scrub starts 2024-02-19T21:33:49.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:47.553955+0000 osd.5 (osd.5) 22 : cluster [DBG] 5.15 scrub ok 2024-02-19T21:33:49.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:48.478559+0000 osd.3 (osd.3) 17 : cluster [DBG] 5.0 scrub starts 2024-02-19T21:33:49.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:48.482072+0000 osd.3 (osd.3) 18 : cluster [DBG] 5.0 scrub ok 2024-02-19T21:33:49.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:48.586305+0000 osd.0 (osd.0) 25 : cluster [DBG] 4.3 deep-scrub starts 2024-02-19T21:33:49.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:48.591664+0000 osd.0 (osd.0) 26 : cluster [DBG] 4.3 deep-scrub ok 2024-02-19T21:33:49.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:46.879764+0000 osd.1 (osd.1) 15 : cluster [DBG] 3.0 scrub starts 2024-02-19T21:33:49.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:46.883411+0000 osd.1 (osd.1) 16 : cluster [DBG] 3.0 scrub ok 2024-02-19T21:33:49.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:47.037342+0000 osd.2 (osd.2) 17 : cluster [DBG] 2.e scrub starts 2024-02-19T21:33:49.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:47.040264+0000 osd.2 (osd.2) 18 : cluster [DBG] 2.e scrub ok 2024-02-19T21:33:49.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:47.222645+0000 osd.6 (osd.6) 23 : cluster [DBG] 4.5 scrub starts 2024-02-19T21:33:49.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:47.226305+0000 osd.6 (osd.6) 24 : cluster [DBG] 4.5 scrub ok 2024-02-19T21:33:49.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:47.549761+0000 osd.0 (osd.0) 23 : cluster [DBG] 6.0 scrub starts 2024-02-19T21:33:49.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:47.550555+0000 osd.0 (osd.0) 24 : cluster [DBG] 6.0 scrub ok 2024-02-19T21:33:49.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:47.552718+0000 osd.5 (osd.5) 21 : cluster [DBG] 5.15 scrub starts 2024-02-19T21:33:49.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:47.553955+0000 osd.5 (osd.5) 22 : cluster [DBG] 5.15 scrub ok 2024-02-19T21:33:49.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:48.478559+0000 osd.3 (osd.3) 17 : cluster [DBG] 5.0 scrub starts 2024-02-19T21:33:49.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:48.482072+0000 osd.3 (osd.3) 18 : cluster [DBG] 5.0 scrub ok 2024-02-19T21:33:49.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:48.586305+0000 osd.0 (osd.0) 25 : cluster [DBG] 4.3 deep-scrub starts 2024-02-19T21:33:49.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:48.591664+0000 osd.0 (osd.0) 26 : cluster [DBG] 4.3 deep-scrub ok 2024-02-19T21:33:49.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:46.879764+0000 osd.1 (osd.1) 15 : cluster [DBG] 3.0 scrub starts 2024-02-19T21:33:49.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:46.883411+0000 osd.1 (osd.1) 16 : cluster [DBG] 3.0 scrub ok 2024-02-19T21:33:49.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:47.037342+0000 osd.2 (osd.2) 17 : cluster [DBG] 2.e scrub starts 2024-02-19T21:33:49.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:47.040264+0000 osd.2 (osd.2) 18 : cluster [DBG] 2.e scrub ok 2024-02-19T21:33:49.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:47.222645+0000 osd.6 (osd.6) 23 : cluster [DBG] 4.5 scrub starts 2024-02-19T21:33:49.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:47.226305+0000 osd.6 (osd.6) 24 : cluster [DBG] 4.5 scrub ok 2024-02-19T21:33:49.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:47.549761+0000 osd.0 (osd.0) 23 : cluster [DBG] 6.0 scrub starts 2024-02-19T21:33:49.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:47.550555+0000 osd.0 (osd.0) 24 : cluster [DBG] 6.0 scrub ok 2024-02-19T21:33:49.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:47.552718+0000 osd.5 (osd.5) 21 : cluster [DBG] 5.15 scrub starts 2024-02-19T21:33:49.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:47.553955+0000 osd.5 (osd.5) 22 : cluster [DBG] 5.15 scrub ok 2024-02-19T21:33:49.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:48.478559+0000 osd.3 (osd.3) 17 : cluster [DBG] 5.0 scrub starts 2024-02-19T21:33:49.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:48.482072+0000 osd.3 (osd.3) 18 : cluster [DBG] 5.0 scrub ok 2024-02-19T21:33:49.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:48.586305+0000 osd.0 (osd.0) 25 : cluster [DBG] 4.3 deep-scrub starts 2024-02-19T21:33:49.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:48.591664+0000 osd.0 (osd.0) 26 : cluster [DBG] 4.3 deep-scrub ok 2024-02-19T21:33:50.058 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:33:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:33:50.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:48.774656+0000 mgr.y (mgr.14514) 53 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:33:50.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:48.780828+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2024-02-19T21:33:50.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:48.781133+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-19T21:33:50.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:48.781395+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-02-19T21:33:50.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:48.781661+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2024-02-19T21:33:50.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:49.387233+0000 osd.4 (osd.4) 29 : cluster [DBG] 6.17 scrub starts 2024-02-19T21:33:50.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:49.388216+0000 osd.4 (osd.4) 30 : cluster [DBG] 6.17 scrub ok 2024-02-19T21:33:50.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:49.601835+0000 osd.0 (osd.0) 27 : cluster [DBG] 5.1e scrub starts 2024-02-19T21:33:50.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:49.602636+0000 osd.0 (osd.0) 28 : cluster [DBG] 5.1e scrub ok 2024-02-19T21:33:50.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:48.774656+0000 mgr.y (mgr.14514) 53 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:33:50.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:48.780828+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2024-02-19T21:33:50.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:48.781133+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-19T21:33:50.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:48.781395+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-02-19T21:33:50.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:48.781661+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2024-02-19T21:33:50.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:49.387233+0000 osd.4 (osd.4) 29 : cluster [DBG] 6.17 scrub starts 2024-02-19T21:33:50.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:49.388216+0000 osd.4 (osd.4) 30 : cluster [DBG] 6.17 scrub ok 2024-02-19T21:33:50.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:49.601835+0000 osd.0 (osd.0) 27 : cluster [DBG] 5.1e scrub starts 2024-02-19T21:33:50.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:49.602636+0000 osd.0 (osd.0) 28 : cluster [DBG] 5.1e scrub ok 2024-02-19T21:33:50.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:48.774656+0000 mgr.y (mgr.14514) 53 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:33:50.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:48.780828+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2024-02-19T21:33:50.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:48.781133+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-19T21:33:50.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:48.781395+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-02-19T21:33:50.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:48.781661+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2024-02-19T21:33:50.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:49.387233+0000 osd.4 (osd.4) 29 : cluster [DBG] 6.17 scrub starts 2024-02-19T21:33:50.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:49.388216+0000 osd.4 (osd.4) 30 : cluster [DBG] 6.17 scrub ok 2024-02-19T21:33:50.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:49.601835+0000 osd.0 (osd.0) 27 : cluster [DBG] 5.1e scrub starts 2024-02-19T21:33:50.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:49.602636+0000 osd.0 (osd.0) 28 : cluster [DBG] 5.1e scrub ok 2024-02-19T21:33:50.849 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:33:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:33:50] "GET /metrics HTTP/1.1" 200 172123 "" "Prometheus/2.33.4" 2024-02-19T21:33:50.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:49.117078+0000 osd.2 (osd.2) 19 : cluster [DBG] 5.d deep-scrub starts 2024-02-19T21:33:50.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:49.121234+0000 osd.2 (osd.2) 20 : cluster [DBG] 5.d deep-scrub ok 2024-02-19T21:33:50.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:49.397700+0000 osd.7 (osd.7) 21 : cluster [DBG] 6.1c scrub starts 2024-02-19T21:33:50.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:49.401199+0000 osd.7 (osd.7) 22 : cluster [DBG] 6.1c scrub ok 2024-02-19T21:33:50.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:49.497113+0000 osd.5 (osd.5) 23 : cluster [DBG] 6.7 deep-scrub starts 2024-02-19T21:33:50.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:49.500201+0000 osd.5 (osd.5) 24 : cluster [DBG] 6.7 deep-scrub ok 2024-02-19T21:33:50.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:49.745442+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]': finished 2024-02-19T21:33:50.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:49.745517+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]': finished 2024-02-19T21:33:50.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:49.745553+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]': finished 2024-02-19T21:33:50.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:49.745595+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]': finished 2024-02-19T21:33:50.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:49.745641+0000 mon.a (mon.0) 728 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2024-02-19T21:33:50.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:49.826444+0000 mgr.y (mgr.14514) 54 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:33:50.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:49.117078+0000 osd.2 (osd.2) 19 : cluster [DBG] 5.d deep-scrub starts 2024-02-19T21:33:50.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:49.121234+0000 osd.2 (osd.2) 20 : cluster [DBG] 5.d deep-scrub ok 2024-02-19T21:33:50.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:49.397700+0000 osd.7 (osd.7) 21 : cluster [DBG] 6.1c scrub starts 2024-02-19T21:33:50.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:49.401199+0000 osd.7 (osd.7) 22 : cluster [DBG] 6.1c scrub ok 2024-02-19T21:33:50.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:49.497113+0000 osd.5 (osd.5) 23 : cluster [DBG] 6.7 deep-scrub starts 2024-02-19T21:33:50.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:49.500201+0000 osd.5 (osd.5) 24 : cluster [DBG] 6.7 deep-scrub ok 2024-02-19T21:33:50.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:49.745442+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]': finished 2024-02-19T21:33:50.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:49.745517+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]': finished 2024-02-19T21:33:50.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:49.745553+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]': finished 2024-02-19T21:33:50.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:49.745595+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]': finished 2024-02-19T21:33:50.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:49.745641+0000 mon.a (mon.0) 728 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2024-02-19T21:33:50.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:49.826444+0000 mgr.y (mgr.14514) 54 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:33:51.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:49.117078+0000 osd.2 (osd.2) 19 : cluster [DBG] 5.d deep-scrub starts 2024-02-19T21:33:51.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:49.121234+0000 osd.2 (osd.2) 20 : cluster [DBG] 5.d deep-scrub ok 2024-02-19T21:33:51.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:49.397700+0000 osd.7 (osd.7) 21 : cluster [DBG] 6.1c scrub starts 2024-02-19T21:33:51.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:49.401199+0000 osd.7 (osd.7) 22 : cluster [DBG] 6.1c scrub ok 2024-02-19T21:33:51.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:49.497113+0000 osd.5 (osd.5) 23 : cluster [DBG] 6.7 deep-scrub starts 2024-02-19T21:33:51.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:49.500201+0000 osd.5 (osd.5) 24 : cluster [DBG] 6.7 deep-scrub ok 2024-02-19T21:33:51.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:49.745442+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]': finished 2024-02-19T21:33:51.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:49.745517+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]': finished 2024-02-19T21:33:51.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:49.745553+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]': finished 2024-02-19T21:33:51.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:49.745595+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]': finished 2024-02-19T21:33:51.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:49.745641+0000 mon.a (mon.0) 728 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2024-02-19T21:33:51.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:49.826444+0000 mgr.y (mgr.14514) 54 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:33:51.221 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:33:51.593 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:51 smithi080 systemd[1]: Stopping Ceph alertmanager.a for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T21:33:51.593 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:51 smithi080 bash[71082]: Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-alertmanager.a" found: no such container 2024-02-19T21:33:51.849 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-alertmanager-a[67585]: level=info ts=2024-02-19T21:33:51.797Z caller=main.go:557 msg="Received SIGTERM, exiting gracefully..." 2024-02-19T21:33:51.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:50.746693+0000 mon.a (mon.0) 729 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2024-02-19T21:33:51.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:50.775000+0000 mgr.y (mgr.14514) 55 : cluster [DBG] pgmap v47: 132 pgs: 4 peering, 128 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:33:51.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:50.746693+0000 mon.a (mon.0) 729 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2024-02-19T21:33:51.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:50.775000+0000 mgr.y (mgr.14514) 55 : cluster [DBG] pgmap v47: 132 pgs: 4 peering, 128 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:33:52.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:50.746693+0000 mon.a (mon.0) 729 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2024-02-19T21:33:52.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:50.775000+0000 mgr.y (mgr.14514) 55 : cluster [DBG] pgmap v47: 132 pgs: 4 peering, 128 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:33:52.598 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:52 smithi080 bash[71151]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715-alertmanager-a 2024-02-19T21:33:54.082 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:52.775524+0000 mgr.y (mgr.14514) 56 : cluster [DBG] pgmap v48: 132 pgs: 4 peering, 128 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:33:54.082 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:52.847792+0000 osd.6 (osd.6) 25 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:33:54.082 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:52.847870+0000 osd.6 (osd.6) 26 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:33:54.082 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:52.775524+0000 mgr.y (mgr.14514) 56 : cluster [DBG] pgmap v48: 132 pgs: 4 peering, 128 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:33:54.082 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:52.847792+0000 osd.6 (osd.6) 25 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:33:54.082 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:52.847870+0000 osd.6 (osd.6) 26 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:33:54.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:52.775524+0000 mgr.y (mgr.14514) 56 : cluster [DBG] pgmap v48: 132 pgs: 4 peering, 128 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:33:54.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:52.847792+0000 osd.6 (osd.6) 25 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:33:54.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:52.847870+0000 osd.6 (osd.6) 26 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:33:54.731 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:54 smithi080 systemd[1]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715@alertmanager.a.service: Succeeded. 2024-02-19T21:33:54.731 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:54 smithi080 systemd[1]: Stopped Ceph alertmanager.a for 6f763558-cf6d-11ee-95bb-87774f69a715. 2024-02-19T21:33:54.732 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:54 smithi080 systemd[1]: Starting Ceph alertmanager.a for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T21:33:55.029 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:52.932638+0000 osd.1 (osd.1) 17 : cluster [DBG] 2.15 deep-scrub starts 2024-02-19T21:33:55.029 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:52.933683+0000 osd.1 (osd.1) 18 : cluster [DBG] 2.15 deep-scrub ok 2024-02-19T21:33:55.029 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:53.842701+0000 mon.a (mon.0) 730 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2024-02-19T21:33:55.029 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:54.224665+0000 osd.6 (osd.6) 27 : cluster [DBG] 2.7 scrub starts 2024-02-19T21:33:55.030 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:54.227669+0000 osd.6 (osd.6) 28 : cluster [DBG] 2.7 scrub ok 2024-02-19T21:33:55.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:52.932638+0000 osd.1 (osd.1) 17 : cluster [DBG] 2.15 deep-scrub starts 2024-02-19T21:33:55.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:52.933683+0000 osd.1 (osd.1) 18 : cluster [DBG] 2.15 deep-scrub ok 2024-02-19T21:33:55.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:53.842701+0000 mon.a (mon.0) 730 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2024-02-19T21:33:55.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:54.224665+0000 osd.6 (osd.6) 27 : cluster [DBG] 2.7 scrub starts 2024-02-19T21:33:55.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:54.227669+0000 osd.6 (osd.6) 28 : cluster [DBG] 2.7 scrub ok 2024-02-19T21:33:55.049 INFO:teuthology.orchestra.run.smithi080.stdout:111669149739 2024-02-19T21:33:55.049 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-02-19T21:33:55.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:52.932638+0000 osd.1 (osd.1) 17 : cluster [DBG] 2.15 deep-scrub starts 2024-02-19T21:33:55.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:52.933683+0000 osd.1 (osd.1) 18 : cluster [DBG] 2.15 deep-scrub ok 2024-02-19T21:33:55.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:53.842701+0000 mon.a (mon.0) 730 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2024-02-19T21:33:55.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:54.224665+0000 osd.6 (osd.6) 27 : cluster [DBG] 2.7 scrub starts 2024-02-19T21:33:55.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:54.227669+0000 osd.6 (osd.6) 28 : cluster [DBG] 2.7 scrub ok 2024-02-19T21:33:55.943 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:33:56.058 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:33:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:33:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:33:56.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:54.776307+0000 mgr.y (mgr.14514) 57 : cluster [DBG] pgmap v50: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 18 B/s, 2 objects/s recovering 2024-02-19T21:33:56.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:55.127483+0000 osd.2 (osd.2) 21 : cluster [DBG] 4.2 scrub starts 2024-02-19T21:33:56.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:55.131036+0000 osd.2 (osd.2) 22 : cluster [DBG] 4.2 scrub ok 2024-02-19T21:33:56.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:55.408284+0000 osd.3 (osd.3) 19 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:33:56.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:55.409138+0000 osd.3 (osd.3) 20 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:33:56.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:55.642831+0000 osd.0 (osd.0) 29 : cluster [DBG] 4.6 scrub starts 2024-02-19T21:33:56.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:55.644679+0000 osd.0 (osd.0) 30 : cluster [DBG] 4.6 scrub ok 2024-02-19T21:33:56.078 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:33:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:33:55] ENGINE Bus STOPPING 2024-02-19T21:33:56.078 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:33:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:33:55] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-19T21:33:56.078 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:33:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:33:55] ENGINE Bus STOPPED 2024-02-19T21:33:56.078 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:33:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:33:55] ENGINE Bus STARTING 2024-02-19T21:33:56.078 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:33:56] ENGINE Serving on http://:::9283 2024-02-19T21:33:56.078 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:33:56] ENGINE Bus STARTED 2024-02-19T21:33:56.078 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:33:56] ENGINE Bus STOPPING 2024-02-19T21:33:56.078 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:33:56] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-19T21:33:56.079 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:54.776307+0000 mgr.y (mgr.14514) 57 : cluster [DBG] pgmap v50: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 18 B/s, 2 objects/s recovering 2024-02-19T21:33:56.079 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:55.127483+0000 osd.2 (osd.2) 21 : cluster [DBG] 4.2 scrub starts 2024-02-19T21:33:56.079 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:55.131036+0000 osd.2 (osd.2) 22 : cluster [DBG] 4.2 scrub ok 2024-02-19T21:33:56.079 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:55.408284+0000 osd.3 (osd.3) 19 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:33:56.079 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:55.409138+0000 osd.3 (osd.3) 20 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:33:56.079 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:55.642831+0000 osd.0 (osd.0) 29 : cluster [DBG] 4.6 scrub starts 2024-02-19T21:33:56.079 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:55.644679+0000 osd.0 (osd.0) 30 : cluster [DBG] 4.6 scrub ok 2024-02-19T21:33:56.079 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:54.776307+0000 mgr.y (mgr.14514) 57 : cluster [DBG] pgmap v50: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 18 B/s, 2 objects/s recovering 2024-02-19T21:33:56.080 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:55.127483+0000 osd.2 (osd.2) 21 : cluster [DBG] 4.2 scrub starts 2024-02-19T21:33:56.080 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:55.131036+0000 osd.2 (osd.2) 22 : cluster [DBG] 4.2 scrub ok 2024-02-19T21:33:56.080 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:55.408284+0000 osd.3 (osd.3) 19 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:33:56.080 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:55.409138+0000 osd.3 (osd.3) 20 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:33:56.080 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:55.642831+0000 osd.0 (osd.0) 29 : cluster [DBG] 4.6 scrub starts 2024-02-19T21:33:56.080 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:55.644679+0000 osd.0 (osd.0) 30 : cluster [DBG] 4.6 scrub ok 2024-02-19T21:33:56.080 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-alertmanager-a[71459]: level=info ts=2024-02-19T21:33:55.821Z caller=main.go:225 msg="Starting Alertmanager" version="(version=0.23.0, branch=HEAD, revision=61046b17771a57cfd4c4a51be370ab930a4d7d54)" 2024-02-19T21:33:56.080 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-alertmanager-a[71459]: level=info ts=2024-02-19T21:33:55.821Z caller=main.go:226 build_context="(go=go1.16.7, user=root@e21a959be8d2, date=20210825-10:48:55)" 2024-02-19T21:33:56.080 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-alertmanager-a[71459]: level=info ts=2024-02-19T21:33:55.822Z caller=cluster.go:184 component=cluster msg="setting advertise address explicitly" addr=172.21.15.80 port=9094 2024-02-19T21:33:56.080 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-alertmanager-a[71459]: level=info ts=2024-02-19T21:33:55.823Z caller=cluster.go:671 component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-02-19T21:33:56.080 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-alertmanager-a[71459]: level=info ts=2024-02-19T21:33:55.849Z caller=coordinator.go:113 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-19T21:33:56.080 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-alertmanager-a[71459]: level=info ts=2024-02-19T21:33:55.850Z caller=coordinator.go:126 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-19T21:33:56.081 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-alertmanager-a[71459]: level=info ts=2024-02-19T21:33:55.852Z caller=main.go:518 msg=Listening address=:9093 2024-02-19T21:33:56.081 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-alertmanager-a[71459]: level=info ts=2024-02-19T21:33:55.852Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2024-02-19T21:33:56.081 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:55 smithi080 bash[71416]: 102e17150348ace98b173353e2435a22e3169e105b4d9b9dabc4e4fc0cc2fc69 2024-02-19T21:33:56.081 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:55 smithi080 systemd[1]: Started Ceph alertmanager.a for 6f763558-cf6d-11ee-95bb-87774f69a715. 2024-02-19T21:33:56.349 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:33:56] ENGINE Bus STOPPED 2024-02-19T21:33:56.349 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:33:56] ENGINE Bus STARTING 2024-02-19T21:33:56.349 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:33:56] ENGINE Serving on http://:::9283 2024-02-19T21:33:56.349 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:33:56] ENGINE Bus STARTED 2024-02-19T21:33:56.349 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:33:56] ENGINE Bus STOPPING 2024-02-19T21:33:56.349 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:33:56] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-19T21:33:56.349 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:33:56] ENGINE Bus STOPPED 2024-02-19T21:33:56.349 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:33:56] ENGINE Bus STARTING 2024-02-19T21:33:56.349 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:33:56] ENGINE Serving on http://:::9283 2024-02-19T21:33:56.349 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:33:56] ENGINE Bus STARTED 2024-02-19T21:33:57.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:54.887623+0000 osd.1 (osd.1) 19 : cluster [DBG] 4.f scrub starts 2024-02-19T21:33:57.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:54.889126+0000 osd.1 (osd.1) 20 : cluster [DBG] 4.f scrub ok 2024-02-19T21:33:57.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:55.934593+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:57.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:55.938400+0000 mon.a (mon.0) 732 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-19T21:33:57.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:55.938862+0000 mgr.y (mgr.14514) 58 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-19T21:33:57.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:55.939736+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi080.front.sepia.ceph.com:9093"}]: dispatch 2024-02-19T21:33:57.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:55.940110+0000 mgr.y (mgr.14514) 59 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi080.front.sepia.ceph.com:9093"}]: dispatch 2024-02-19T21:33:57.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:55.944507+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:57.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:55.951781+0000 mon.a (mon.0) 735 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T21:33:57.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:55.952226+0000 mgr.y (mgr.14514) 60 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T21:33:57.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:55.953667+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi157.front.sepia.ceph.com:9095"}]: dispatch 2024-02-19T21:33:57.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:55.953975+0000 mgr.y (mgr.14514) 61 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi157.front.sepia.ceph.com:9095"}]: dispatch 2024-02-19T21:33:57.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:55.958512+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:57.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:55.963560+0000 mon.a (mon.0) 738 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-19T21:33:57.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:55.963962+0000 mgr.y (mgr.14514) 62 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-19T21:33:57.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:55.968642+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi157.front.sepia.ceph.com:3000"}]: dispatch 2024-02-19T21:33:57.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:55.969027+0000 mgr.y (mgr.14514) 63 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi157.front.sepia.ceph.com:3000"}]: dispatch 2024-02-19T21:33:57.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:55.973534+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:57.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:55.977030+0000 mon.a (mon.0) 741 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:33:57.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:56.644577+0000 osd.0 (osd.0) 31 : cluster [DBG] 5.3 scrub starts 2024-02-19T21:33:57.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:56.646245+0000 osd.0 (osd.0) 32 : cluster [DBG] 5.3 scrub ok 2024-02-19T21:33:57.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:54.887623+0000 osd.1 (osd.1) 19 : cluster [DBG] 4.f scrub starts 2024-02-19T21:33:57.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:54.889126+0000 osd.1 (osd.1) 20 : cluster [DBG] 4.f scrub ok 2024-02-19T21:33:57.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:55.934593+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:57.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:55.938400+0000 mon.a (mon.0) 732 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-19T21:33:57.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:55.938862+0000 mgr.y (mgr.14514) 58 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-19T21:33:57.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:55.939736+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi080.front.sepia.ceph.com:9093"}]: dispatch 2024-02-19T21:33:57.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:55.940110+0000 mgr.y (mgr.14514) 59 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi080.front.sepia.ceph.com:9093"}]: dispatch 2024-02-19T21:33:57.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:55.944507+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:57.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:55.951781+0000 mon.a (mon.0) 735 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T21:33:57.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:55.952226+0000 mgr.y (mgr.14514) 60 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T21:33:57.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:55.953667+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi157.front.sepia.ceph.com:9095"}]: dispatch 2024-02-19T21:33:57.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:55.953975+0000 mgr.y (mgr.14514) 61 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi157.front.sepia.ceph.com:9095"}]: dispatch 2024-02-19T21:33:57.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:55.958512+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:57.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:55.963560+0000 mon.a (mon.0) 738 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-19T21:33:57.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:55.963962+0000 mgr.y (mgr.14514) 62 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-19T21:33:57.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:55.968642+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi157.front.sepia.ceph.com:3000"}]: dispatch 2024-02-19T21:33:57.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:55.969027+0000 mgr.y (mgr.14514) 63 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi157.front.sepia.ceph.com:3000"}]: dispatch 2024-02-19T21:33:57.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:55.973534+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:57.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:55.977030+0000 mon.a (mon.0) 741 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:33:57.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:56.644577+0000 osd.0 (osd.0) 31 : cluster [DBG] 5.3 scrub starts 2024-02-19T21:33:57.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:56.646245+0000 osd.0 (osd.0) 32 : cluster [DBG] 5.3 scrub ok 2024-02-19T21:33:57.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:54.887623+0000 osd.1 (osd.1) 19 : cluster [DBG] 4.f scrub starts 2024-02-19T21:33:57.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:54.889126+0000 osd.1 (osd.1) 20 : cluster [DBG] 4.f scrub ok 2024-02-19T21:33:57.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:55.934593+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:57.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:55.938400+0000 mon.a (mon.0) 732 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-19T21:33:57.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:55.938862+0000 mgr.y (mgr.14514) 58 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-19T21:33:57.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:55.939736+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi080.front.sepia.ceph.com:9093"}]: dispatch 2024-02-19T21:33:57.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:55.940110+0000 mgr.y (mgr.14514) 59 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi080.front.sepia.ceph.com:9093"}]: dispatch 2024-02-19T21:33:57.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:55.944507+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:57.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:55.951781+0000 mon.a (mon.0) 735 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T21:33:57.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:55.952226+0000 mgr.y (mgr.14514) 60 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T21:33:57.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:55.953667+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi157.front.sepia.ceph.com:9095"}]: dispatch 2024-02-19T21:33:57.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:55.953975+0000 mgr.y (mgr.14514) 61 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi157.front.sepia.ceph.com:9095"}]: dispatch 2024-02-19T21:33:57.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:55.958512+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:57.102 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:55.963560+0000 mon.a (mon.0) 738 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-19T21:33:57.102 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:55.963962+0000 mgr.y (mgr.14514) 62 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-19T21:33:57.102 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:55.968642+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi157.front.sepia.ceph.com:3000"}]: dispatch 2024-02-19T21:33:57.102 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:55.969027+0000 mgr.y (mgr.14514) 63 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi157.front.sepia.ceph.com:3000"}]: dispatch 2024-02-19T21:33:57.102 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:55.973534+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:33:57.102 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:55.977030+0000 mon.a (mon.0) 741 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:33:57.102 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:56.644577+0000 osd.0 (osd.0) 31 : cluster [DBG] 5.3 scrub starts 2024-02-19T21:33:57.102 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:56.646245+0000 osd.0 (osd.0) 32 : cluster [DBG] 5.3 scrub ok 2024-02-19T21:33:57.969 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:33:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-alertmanager-a[71459]: level=info ts=2024-02-19T21:33:57.823Z caller=cluster.go:696 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000185689s 2024-02-19T21:33:58.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:56.447573+0000 osd.7 (osd.7) 23 : cluster [DBG] 6.5 scrub starts 2024-02-19T21:33:58.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:56.450488+0000 osd.7 (osd.7) 24 : cluster [DBG] 6.5 scrub ok 2024-02-19T21:33:58.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:56.776786+0000 mgr.y (mgr.14514) 64 : cluster [DBG] pgmap v51: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 15 B/s, 1 objects/s recovering 2024-02-19T21:33:58.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:57.080040+0000 osd.3 (osd.3) 21 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:33:58.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:57.080086+0000 osd.3 (osd.3) 22 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:33:58.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:56.447573+0000 osd.7 (osd.7) 23 : cluster [DBG] 6.5 scrub starts 2024-02-19T21:33:58.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:56.450488+0000 osd.7 (osd.7) 24 : cluster [DBG] 6.5 scrub ok 2024-02-19T21:33:58.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:56.776786+0000 mgr.y (mgr.14514) 64 : cluster [DBG] pgmap v51: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 15 B/s, 1 objects/s recovering 2024-02-19T21:33:58.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:57.080040+0000 osd.3 (osd.3) 21 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:33:58.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:57.080086+0000 osd.3 (osd.3) 22 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:33:58.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:56.447573+0000 osd.7 (osd.7) 23 : cluster [DBG] 6.5 scrub starts 2024-02-19T21:33:58.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:56.450488+0000 osd.7 (osd.7) 24 : cluster [DBG] 6.5 scrub ok 2024-02-19T21:33:58.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:56.776786+0000 mgr.y (mgr.14514) 64 : cluster [DBG] pgmap v51: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 15 B/s, 1 objects/s recovering 2024-02-19T21:33:58.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:57.080040+0000 osd.3 (osd.3) 21 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:33:58.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:57.080086+0000 osd.3 (osd.3) 22 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:33:59.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:57.496250+0000 osd.7 (osd.7) 25 : cluster [DBG] 2.5 scrub starts 2024-02-19T21:33:59.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:57.499141+0000 osd.7 (osd.7) 26 : cluster [DBG] 2.5 scrub ok 2024-02-19T21:33:59.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:57.980833+0000 mon.a (mon.0) 742 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2024-02-19T21:33:59.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:58.441821+0000 osd.3 (osd.3) 23 : cluster [DBG] 6.13 scrub starts 2024-02-19T21:33:59.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:58.442851+0000 osd.3 (osd.3) 24 : cluster [DBG] 6.13 scrub ok 2024-02-19T21:33:59.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:58.612531+0000 osd.5 (osd.5) 25 : cluster [DBG] 2.3 scrub starts 2024-02-19T21:33:59.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:58.613382+0000 osd.5 (osd.5) 26 : cluster [DBG] 2.3 scrub ok 2024-02-19T21:33:59.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:57.496250+0000 osd.7 (osd.7) 25 : cluster [DBG] 2.5 scrub starts 2024-02-19T21:33:59.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:57.499141+0000 osd.7 (osd.7) 26 : cluster [DBG] 2.5 scrub ok 2024-02-19T21:33:59.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:57.980833+0000 mon.a (mon.0) 742 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2024-02-19T21:33:59.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:58.441821+0000 osd.3 (osd.3) 23 : cluster [DBG] 6.13 scrub starts 2024-02-19T21:33:59.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:58.442851+0000 osd.3 (osd.3) 24 : cluster [DBG] 6.13 scrub ok 2024-02-19T21:33:59.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:58.612531+0000 osd.5 (osd.5) 25 : cluster [DBG] 2.3 scrub starts 2024-02-19T21:33:59.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:58.613382+0000 osd.5 (osd.5) 26 : cluster [DBG] 2.3 scrub ok 2024-02-19T21:33:59.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:57.496250+0000 osd.7 (osd.7) 25 : cluster [DBG] 2.5 scrub starts 2024-02-19T21:33:59.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:57.499141+0000 osd.7 (osd.7) 26 : cluster [DBG] 2.5 scrub ok 2024-02-19T21:33:59.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:57.980833+0000 mon.a (mon.0) 742 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2024-02-19T21:33:59.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:58.441821+0000 osd.3 (osd.3) 23 : cluster [DBG] 6.13 scrub starts 2024-02-19T21:33:59.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:58.442851+0000 osd.3 (osd.3) 24 : cluster [DBG] 6.13 scrub ok 2024-02-19T21:33:59.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:58.612531+0000 osd.5 (osd.5) 25 : cluster [DBG] 2.3 scrub starts 2024-02-19T21:33:59.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:58.613382+0000 osd.5 (osd.5) 26 : cluster [DBG] 2.3 scrub ok 2024-02-19T21:33:59.694 INFO:teuthology.orchestra.run.smithi080.stdout:137438953509 2024-02-19T21:33:59.695 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-02-19T21:34:00.308 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:33:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:34:00.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:58.777189+0000 mgr.y (mgr.14514) 65 : cluster [DBG] pgmap v53: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s; 13 B/s, 1 objects/s recovering 2024-02-19T21:34:00.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:59.138778+0000 osd.2 (osd.2) 23 : cluster [DBG] 5.6 scrub starts 2024-02-19T21:34:00.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:59.141740+0000 osd.2 (osd.2) 24 : cluster [DBG] 5.6 scrub ok 2024-02-19T21:34:00.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:59.314648+0000 osd.4 (osd.4) 31 : cluster [DBG] 2.f scrub starts 2024-02-19T21:34:00.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:33:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:59.315683+0000 osd.4 (osd.4) 32 : cluster [DBG] 2.f scrub ok 2024-02-19T21:34:00.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:58.777189+0000 mgr.y (mgr.14514) 65 : cluster [DBG] pgmap v53: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s; 13 B/s, 1 objects/s recovering 2024-02-19T21:34:00.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:59.138778+0000 osd.2 (osd.2) 23 : cluster [DBG] 5.6 scrub starts 2024-02-19T21:34:00.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:59.141740+0000 osd.2 (osd.2) 24 : cluster [DBG] 5.6 scrub ok 2024-02-19T21:34:00.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:59.314648+0000 osd.4 (osd.4) 31 : cluster [DBG] 2.f scrub starts 2024-02-19T21:34:00.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:33:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:59.315683+0000 osd.4 (osd.4) 32 : cluster [DBG] 2.f scrub ok 2024-02-19T21:34:00.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:58.777189+0000 mgr.y (mgr.14514) 65 : cluster [DBG] pgmap v53: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s; 13 B/s, 1 objects/s recovering 2024-02-19T21:34:00.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:59.138778+0000 osd.2 (osd.2) 23 : cluster [DBG] 5.6 scrub starts 2024-02-19T21:34:00.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:59.141740+0000 osd.2 (osd.2) 24 : cluster [DBG] 5.6 scrub ok 2024-02-19T21:34:00.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:59.314648+0000 osd.4 (osd.4) 31 : cluster [DBG] 2.f scrub starts 2024-02-19T21:34:00.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:33:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:59.315683+0000 osd.4 (osd.4) 32 : cluster [DBG] 2.f scrub ok 2024-02-19T21:34:00.673 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:34:01.099 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:34:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:34:00] "GET /metrics HTTP/1.1" 200 172123 "" "Prometheus/2.33.4" 2024-02-19T21:34:01.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:33:59.836443+0000 mgr.y (mgr.14514) 66 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:34:01.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:59.902353+0000 osd.1 (osd.1) 21 : cluster [DBG] 2.6 scrub starts 2024-02-19T21:34:01.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:59.903362+0000 osd.1 (osd.1) 22 : cluster [DBG] 2.6 scrub ok 2024-02-19T21:34:01.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:59.925525+0000 osd.0 (osd.0) 33 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:34:01.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:33:59.925584+0000 osd.0 (osd.0) 34 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:34:01.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:00.101223+0000 osd.2 (osd.2) 25 : cluster [DBG] 2.c scrub starts 2024-02-19T21:34:01.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:00.104116+0000 osd.2 (osd.2) 26 : cluster [DBG] 2.c scrub ok 2024-02-19T21:34:01.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:00.558332+0000 osd.5 (osd.5) 27 : cluster [DBG] 4.8 scrub starts 2024-02-19T21:34:01.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:00.561878+0000 osd.5 (osd.5) 28 : cluster [DBG] 4.8 scrub ok 2024-02-19T21:34:01.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:00.723006+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:34:01.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:00.841609+0000 mon.a (mon.0) 744 : cluster [DBG] osdmap e88: 8 total, 8 up, 8 in 2024-02-19T21:34:01.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:33:59.836443+0000 mgr.y (mgr.14514) 66 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:34:01.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:59.902353+0000 osd.1 (osd.1) 21 : cluster [DBG] 2.6 scrub starts 2024-02-19T21:34:01.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:59.903362+0000 osd.1 (osd.1) 22 : cluster [DBG] 2.6 scrub ok 2024-02-19T21:34:01.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:59.925525+0000 osd.0 (osd.0) 33 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:34:01.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:33:59.925584+0000 osd.0 (osd.0) 34 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:34:01.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:00.101223+0000 osd.2 (osd.2) 25 : cluster [DBG] 2.c scrub starts 2024-02-19T21:34:01.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:00.104116+0000 osd.2 (osd.2) 26 : cluster [DBG] 2.c scrub ok 2024-02-19T21:34:01.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:00.558332+0000 osd.5 (osd.5) 27 : cluster [DBG] 4.8 scrub starts 2024-02-19T21:34:01.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:00.561878+0000 osd.5 (osd.5) 28 : cluster [DBG] 4.8 scrub ok 2024-02-19T21:34:01.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:00.723006+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:34:01.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:00.841609+0000 mon.a (mon.0) 744 : cluster [DBG] osdmap e88: 8 total, 8 up, 8 in 2024-02-19T21:34:01.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:33:59.836443+0000 mgr.y (mgr.14514) 66 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:34:01.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:59.902353+0000 osd.1 (osd.1) 21 : cluster [DBG] 2.6 scrub starts 2024-02-19T21:34:01.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:59.903362+0000 osd.1 (osd.1) 22 : cluster [DBG] 2.6 scrub ok 2024-02-19T21:34:01.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:59.925525+0000 osd.0 (osd.0) 33 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:34:01.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:33:59.925584+0000 osd.0 (osd.0) 34 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:34:01.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:00.101223+0000 osd.2 (osd.2) 25 : cluster [DBG] 2.c scrub starts 2024-02-19T21:34:01.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:00.104116+0000 osd.2 (osd.2) 26 : cluster [DBG] 2.c scrub ok 2024-02-19T21:34:01.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:00.558332+0000 osd.5 (osd.5) 27 : cluster [DBG] 4.8 scrub starts 2024-02-19T21:34:01.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:00.561878+0000 osd.5 (osd.5) 28 : cluster [DBG] 4.8 scrub ok 2024-02-19T21:34:01.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:00.723006+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:34:01.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:00.841609+0000 mon.a (mon.0) 744 : cluster [DBG] osdmap e88: 8 total, 8 up, 8 in 2024-02-19T21:34:02.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:00.529442+0000 osd.7 (osd.7) 27 : cluster [DBG] 2.1d scrub starts 2024-02-19T21:34:02.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:00.532396+0000 osd.7 (osd.7) 28 : cluster [DBG] 2.1d scrub ok 2024-02-19T21:34:02.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:00.777742+0000 mgr.y (mgr.14514) 67 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s; 13 B/s, 1 objects/s recovering 2024-02-19T21:34:02.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:01.343178+0000 osd.4 (osd.4) 33 : cluster [DBG] 5.e scrub starts 2024-02-19T21:34:02.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:01.346643+0000 osd.4 (osd.4) 34 : cluster [DBG] 5.e scrub ok 2024-02-19T21:34:02.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:00.529442+0000 osd.7 (osd.7) 27 : cluster [DBG] 2.1d scrub starts 2024-02-19T21:34:02.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:00.532396+0000 osd.7 (osd.7) 28 : cluster [DBG] 2.1d scrub ok 2024-02-19T21:34:02.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:00.777742+0000 mgr.y (mgr.14514) 67 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s; 13 B/s, 1 objects/s recovering 2024-02-19T21:34:02.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:01.343178+0000 osd.4 (osd.4) 33 : cluster [DBG] 5.e scrub starts 2024-02-19T21:34:02.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:01.346643+0000 osd.4 (osd.4) 34 : cluster [DBG] 5.e scrub ok 2024-02-19T21:34:02.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:00.529442+0000 osd.7 (osd.7) 27 : cluster [DBG] 2.1d scrub starts 2024-02-19T21:34:02.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:00.532396+0000 osd.7 (osd.7) 28 : cluster [DBG] 2.1d scrub ok 2024-02-19T21:34:02.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:00.777742+0000 mgr.y (mgr.14514) 67 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s; 13 B/s, 1 objects/s recovering 2024-02-19T21:34:02.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:01.343178+0000 osd.4 (osd.4) 33 : cluster [DBG] 5.e scrub starts 2024-02-19T21:34:02.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:01.346643+0000 osd.4 (osd.4) 34 : cluster [DBG] 5.e scrub ok 2024-02-19T21:34:03.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:01.537028+0000 osd.7 (osd.7) 29 : cluster [DBG] 6.12 deep-scrub starts 2024-02-19T21:34:03.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:01.539918+0000 osd.7 (osd.7) 30 : cluster [DBG] 6.12 deep-scrub ok 2024-02-19T21:34:03.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:01.905223+0000 osd.1 (osd.1) 23 : cluster [DBG] 2.a scrub starts 2024-02-19T21:34:03.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:01.906170+0000 osd.1 (osd.1) 24 : cluster [DBG] 2.a scrub ok 2024-02-19T21:34:03.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:02.224223+0000 osd.5 (osd.5) 29 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:34:03.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:02.224286+0000 osd.5 (osd.5) 30 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:34:03.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:02.535542+0000 osd.3 (osd.3) 25 : cluster [DBG] 4.0 scrub starts 2024-02-19T21:34:03.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:02.539122+0000 osd.3 (osd.3) 26 : cluster [DBG] 4.0 scrub ok 2024-02-19T21:34:03.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:01.537028+0000 osd.7 (osd.7) 29 : cluster [DBG] 6.12 deep-scrub starts 2024-02-19T21:34:03.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:01.539918+0000 osd.7 (osd.7) 30 : cluster [DBG] 6.12 deep-scrub ok 2024-02-19T21:34:03.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:01.905223+0000 osd.1 (osd.1) 23 : cluster [DBG] 2.a scrub starts 2024-02-19T21:34:03.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:01.906170+0000 osd.1 (osd.1) 24 : cluster [DBG] 2.a scrub ok 2024-02-19T21:34:03.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:02.224223+0000 osd.5 (osd.5) 29 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:34:03.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:02.224286+0000 osd.5 (osd.5) 30 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:34:03.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:02.535542+0000 osd.3 (osd.3) 25 : cluster [DBG] 4.0 scrub starts 2024-02-19T21:34:03.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:02.539122+0000 osd.3 (osd.3) 26 : cluster [DBG] 4.0 scrub ok 2024-02-19T21:34:03.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:01.537028+0000 osd.7 (osd.7) 29 : cluster [DBG] 6.12 deep-scrub starts 2024-02-19T21:34:03.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:01.539918+0000 osd.7 (osd.7) 30 : cluster [DBG] 6.12 deep-scrub ok 2024-02-19T21:34:03.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:01.905223+0000 osd.1 (osd.1) 23 : cluster [DBG] 2.a scrub starts 2024-02-19T21:34:03.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:01.906170+0000 osd.1 (osd.1) 24 : cluster [DBG] 2.a scrub ok 2024-02-19T21:34:03.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:02.224223+0000 osd.5 (osd.5) 29 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:34:03.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:02.224286+0000 osd.5 (osd.5) 30 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:34:03.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:02.535542+0000 osd.3 (osd.3) 25 : cluster [DBG] 4.0 scrub starts 2024-02-19T21:34:03.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:02.539122+0000 osd.3 (osd.3) 26 : cluster [DBG] 4.0 scrub ok 2024-02-19T21:34:04.212 INFO:teuthology.orchestra.run.smithi080.stdout:163208757282 2024-02-19T21:34:04.213 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2024-02-19T21:34:04.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:02.498418+0000 osd.7 (osd.7) 31 : cluster [DBG] 2.0 scrub starts 2024-02-19T21:34:04.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:02.501522+0000 osd.7 (osd.7) 32 : cluster [DBG] 2.0 scrub ok 2024-02-19T21:34:04.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:02.778080+0000 mgr.y (mgr.14514) 68 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:34:04.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:02.997357+0000 mon.a (mon.0) 745 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in 2024-02-19T21:34:04.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:03.203314+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:34:04.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:03.503123+0000 osd.3 (osd.3) 27 : cluster [DBG] 4.14 scrub starts 2024-02-19T21:34:04.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:03.508251+0000 osd.3 (osd.3) 28 : cluster [DBG] 4.14 scrub ok 2024-02-19T21:34:04.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:03.707811+0000 mon.a (mon.0) 747 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:34:04.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:03.708415+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:34:04.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:03.712821+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:34:04.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:03.716671+0000 mon.a (mon.0) 750 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:34:04.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:02.498418+0000 osd.7 (osd.7) 31 : cluster [DBG] 2.0 scrub starts 2024-02-19T21:34:04.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:02.501522+0000 osd.7 (osd.7) 32 : cluster [DBG] 2.0 scrub ok 2024-02-19T21:34:04.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:02.778080+0000 mgr.y (mgr.14514) 68 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:34:04.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:02.997357+0000 mon.a (mon.0) 745 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in 2024-02-19T21:34:04.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:03.203314+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:34:04.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:03.503123+0000 osd.3 (osd.3) 27 : cluster [DBG] 4.14 scrub starts 2024-02-19T21:34:04.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:03.508251+0000 osd.3 (osd.3) 28 : cluster [DBG] 4.14 scrub ok 2024-02-19T21:34:04.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:03.707811+0000 mon.a (mon.0) 747 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:34:04.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:03.708415+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:34:04.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:03.712821+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:34:04.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:03.716671+0000 mon.a (mon.0) 750 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:34:04.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:02.498418+0000 osd.7 (osd.7) 31 : cluster [DBG] 2.0 scrub starts 2024-02-19T21:34:04.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:02.501522+0000 osd.7 (osd.7) 32 : cluster [DBG] 2.0 scrub ok 2024-02-19T21:34:04.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:02.778080+0000 mgr.y (mgr.14514) 68 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:34:04.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:02.997357+0000 mon.a (mon.0) 745 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in 2024-02-19T21:34:04.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:03.203314+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:34:04.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:03.503123+0000 osd.3 (osd.3) 27 : cluster [DBG] 4.14 scrub starts 2024-02-19T21:34:04.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:03.508251+0000 osd.3 (osd.3) 28 : cluster [DBG] 4.14 scrub ok 2024-02-19T21:34:04.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:03.707811+0000 mon.a (mon.0) 747 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:34:04.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:03.708415+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:34:04.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:03.712821+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:34:04.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:03.716671+0000 mon.a (mon.0) 750 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:34:05.140 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:34:05.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:03.454841+0000 osd.7 (osd.7) 33 : cluster [DBG] 5.10 deep-scrub starts 2024-02-19T21:34:05.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:03.457852+0000 osd.7 (osd.7) 34 : cluster [DBG] 5.10 deep-scrub ok 2024-02-19T21:34:05.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:04.045262+0000 osd.2 (osd.2) 27 : cluster [DBG] 6.f scrub starts 2024-02-19T21:34:05.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:04.048183+0000 osd.2 (osd.2) 28 : cluster [DBG] 6.f scrub ok 2024-02-19T21:34:05.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:04.271732+0000 osd.4 (osd.4) 35 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:34:05.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:04.274640+0000 osd.4 (osd.4) 36 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:34:05.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:04.492298+0000 osd.3 (osd.3) 29 : cluster [DBG] 4.1d scrub starts 2024-02-19T21:34:05.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:04.494222+0000 osd.3 (osd.3) 30 : cluster [DBG] 4.1d scrub ok 2024-02-19T21:34:05.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:04.789891+0000 osd.1 (osd.1) 25 : cluster [DBG] 6.1 scrub starts 2024-02-19T21:34:05.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:04.792784+0000 osd.1 (osd.1) 26 : cluster [DBG] 6.1 scrub ok 2024-02-19T21:34:05.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:03.454841+0000 osd.7 (osd.7) 33 : cluster [DBG] 5.10 deep-scrub starts 2024-02-19T21:34:05.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:03.457852+0000 osd.7 (osd.7) 34 : cluster [DBG] 5.10 deep-scrub ok 2024-02-19T21:34:05.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:04.045262+0000 osd.2 (osd.2) 27 : cluster [DBG] 6.f scrub starts 2024-02-19T21:34:05.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:04.048183+0000 osd.2 (osd.2) 28 : cluster [DBG] 6.f scrub ok 2024-02-19T21:34:05.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:04.271732+0000 osd.4 (osd.4) 35 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:34:05.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:04.274640+0000 osd.4 (osd.4) 36 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:34:05.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:04.492298+0000 osd.3 (osd.3) 29 : cluster [DBG] 4.1d scrub starts 2024-02-19T21:34:05.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:04.494222+0000 osd.3 (osd.3) 30 : cluster [DBG] 4.1d scrub ok 2024-02-19T21:34:05.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:04.789891+0000 osd.1 (osd.1) 25 : cluster [DBG] 6.1 scrub starts 2024-02-19T21:34:05.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:04.792784+0000 osd.1 (osd.1) 26 : cluster [DBG] 6.1 scrub ok 2024-02-19T21:34:05.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:03.454841+0000 osd.7 (osd.7) 33 : cluster [DBG] 5.10 deep-scrub starts 2024-02-19T21:34:05.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:03.457852+0000 osd.7 (osd.7) 34 : cluster [DBG] 5.10 deep-scrub ok 2024-02-19T21:34:05.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:04.045262+0000 osd.2 (osd.2) 27 : cluster [DBG] 6.f scrub starts 2024-02-19T21:34:05.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:04.048183+0000 osd.2 (osd.2) 28 : cluster [DBG] 6.f scrub ok 2024-02-19T21:34:05.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:04.271732+0000 osd.4 (osd.4) 35 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:34:05.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:04.274640+0000 osd.4 (osd.4) 36 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:34:05.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:04.492298+0000 osd.3 (osd.3) 29 : cluster [DBG] 4.1d scrub starts 2024-02-19T21:34:05.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:04.494222+0000 osd.3 (osd.3) 30 : cluster [DBG] 4.1d scrub ok 2024-02-19T21:34:05.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:04.789891+0000 osd.1 (osd.1) 25 : cluster [DBG] 6.1 scrub starts 2024-02-19T21:34:05.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:04.792784+0000 osd.1 (osd.1) 26 : cluster [DBG] 6.1 scrub ok 2024-02-19T21:34:05.808 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:34:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:34:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:34:06.003 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 21:34:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-alertmanager-a[71459]: level=info ts=2024-02-19T21:34:05.824Z caller=cluster.go:688 component=cluster msg="gossip settled; proceeding" elapsed=10.001561155s 2024-02-19T21:34:06.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:04.419668+0000 osd.7 (osd.7) 35 : cluster [DBG] 6.8 scrub starts 2024-02-19T21:34:06.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:04.422576+0000 osd.7 (osd.7) 36 : cluster [DBG] 6.8 scrub ok 2024-02-19T21:34:06.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:04.778655+0000 mgr.y (mgr.14514) 69 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-19T21:34:06.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:05.502968+0000 osd.3 (osd.3) 31 : cluster [DBG] 6.11 scrub starts 2024-02-19T21:34:06.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:05.505897+0000 osd.3 (osd.3) 32 : cluster [DBG] 6.11 scrub ok 2024-02-19T21:34:06.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:04.419668+0000 osd.7 (osd.7) 35 : cluster [DBG] 6.8 scrub starts 2024-02-19T21:34:06.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:04.422576+0000 osd.7 (osd.7) 36 : cluster [DBG] 6.8 scrub ok 2024-02-19T21:34:06.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:04.778655+0000 mgr.y (mgr.14514) 69 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-19T21:34:06.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:05.502968+0000 osd.3 (osd.3) 31 : cluster [DBG] 6.11 scrub starts 2024-02-19T21:34:06.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:05.505897+0000 osd.3 (osd.3) 32 : cluster [DBG] 6.11 scrub ok 2024-02-19T21:34:06.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:04.419668+0000 osd.7 (osd.7) 35 : cluster [DBG] 6.8 scrub starts 2024-02-19T21:34:06.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:04.422576+0000 osd.7 (osd.7) 36 : cluster [DBG] 6.8 scrub ok 2024-02-19T21:34:06.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:04.778655+0000 mgr.y (mgr.14514) 69 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-19T21:34:06.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:05.502968+0000 osd.3 (osd.3) 31 : cluster [DBG] 6.11 scrub starts 2024-02-19T21:34:06.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:05.505897+0000 osd.3 (osd.3) 32 : cluster [DBG] 6.11 scrub ok 2024-02-19T21:34:08.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:06.779004+0000 mgr.y (mgr.14514) 70 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:34:08.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:07.308601+0000 osd.4 (osd.4) 37 : cluster [DBG] 4.1a deep-scrub starts 2024-02-19T21:34:08.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:07.313560+0000 osd.4 (osd.4) 38 : cluster [DBG] 4.1a deep-scrub ok 2024-02-19T21:34:08.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:07.515086+0000 osd.3 (osd.3) 33 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:34:08.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:07.518651+0000 osd.3 (osd.3) 34 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:34:08.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:07.771723+0000 osd.1 (osd.1) 27 : cluster [DBG] 2.4 scrub starts 2024-02-19T21:34:08.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:07.772416+0000 osd.1 (osd.1) 28 : cluster [DBG] 2.4 scrub ok 2024-02-19T21:34:08.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:06.779004+0000 mgr.y (mgr.14514) 70 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:34:08.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:07.308601+0000 osd.4 (osd.4) 37 : cluster [DBG] 4.1a deep-scrub starts 2024-02-19T21:34:08.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:07.313560+0000 osd.4 (osd.4) 38 : cluster [DBG] 4.1a deep-scrub ok 2024-02-19T21:34:08.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:07.515086+0000 osd.3 (osd.3) 33 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:34:08.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:07.518651+0000 osd.3 (osd.3) 34 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:34:08.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:07.771723+0000 osd.1 (osd.1) 27 : cluster [DBG] 2.4 scrub starts 2024-02-19T21:34:08.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:07.772416+0000 osd.1 (osd.1) 28 : cluster [DBG] 2.4 scrub ok 2024-02-19T21:34:08.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:06.779004+0000 mgr.y (mgr.14514) 70 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:34:08.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:07.308601+0000 osd.4 (osd.4) 37 : cluster [DBG] 4.1a deep-scrub starts 2024-02-19T21:34:08.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:07.313560+0000 osd.4 (osd.4) 38 : cluster [DBG] 4.1a deep-scrub ok 2024-02-19T21:34:08.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:07.515086+0000 osd.3 (osd.3) 33 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:34:08.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:07.518651+0000 osd.3 (osd.3) 34 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:34:08.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:07.771723+0000 osd.1 (osd.1) 27 : cluster [DBG] 2.4 scrub starts 2024-02-19T21:34:08.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:07.772416+0000 osd.1 (osd.1) 28 : cluster [DBG] 2.4 scrub ok 2024-02-19T21:34:08.769 INFO:teuthology.orchestra.run.smithi080.stdout:201863462942 2024-02-19T21:34:08.769 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2024-02-19T21:34:09.133 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:34:09.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:07.475356+0000 osd.7 (osd.7) 37 : cluster [DBG] 5.1a scrub starts 2024-02-19T21:34:09.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:07.478315+0000 osd.7 (osd.7) 38 : cluster [DBG] 5.1a scrub ok 2024-02-19T21:34:09.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:07.754050+0000 osd.0 (osd.0) 35 : cluster [DBG] 2.1f scrub starts 2024-02-19T21:34:09.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:07.754961+0000 osd.0 (osd.0) 36 : cluster [DBG] 2.1f scrub ok 2024-02-19T21:34:09.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:08.540513+0000 osd.5 (osd.5) 31 : cluster [DBG] 2.16 scrub starts 2024-02-19T21:34:09.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:08.543417+0000 osd.5 (osd.5) 32 : cluster [DBG] 2.16 scrub ok 2024-02-19T21:34:09.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:08.557694+0000 osd.3 (osd.3) 35 : cluster [DBG] 6.1b scrub starts 2024-02-19T21:34:09.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:08.558975+0000 osd.3 (osd.3) 36 : cluster [DBG] 6.1b scrub ok 2024-02-19T21:34:09.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:07.475356+0000 osd.7 (osd.7) 37 : cluster [DBG] 5.1a scrub starts 2024-02-19T21:34:09.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:07.478315+0000 osd.7 (osd.7) 38 : cluster [DBG] 5.1a scrub ok 2024-02-19T21:34:09.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:07.754050+0000 osd.0 (osd.0) 35 : cluster [DBG] 2.1f scrub starts 2024-02-19T21:34:09.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:07.754961+0000 osd.0 (osd.0) 36 : cluster [DBG] 2.1f scrub ok 2024-02-19T21:34:09.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:08.540513+0000 osd.5 (osd.5) 31 : cluster [DBG] 2.16 scrub starts 2024-02-19T21:34:09.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:08.543417+0000 osd.5 (osd.5) 32 : cluster [DBG] 2.16 scrub ok 2024-02-19T21:34:09.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:08.557694+0000 osd.3 (osd.3) 35 : cluster [DBG] 6.1b scrub starts 2024-02-19T21:34:09.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:08.558975+0000 osd.3 (osd.3) 36 : cluster [DBG] 6.1b scrub ok 2024-02-19T21:34:09.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:07.475356+0000 osd.7 (osd.7) 37 : cluster [DBG] 5.1a scrub starts 2024-02-19T21:34:09.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:07.478315+0000 osd.7 (osd.7) 38 : cluster [DBG] 5.1a scrub ok 2024-02-19T21:34:09.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:07.754050+0000 osd.0 (osd.0) 35 : cluster [DBG] 2.1f scrub starts 2024-02-19T21:34:09.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:07.754961+0000 osd.0 (osd.0) 36 : cluster [DBG] 2.1f scrub ok 2024-02-19T21:34:09.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:08.540513+0000 osd.5 (osd.5) 31 : cluster [DBG] 2.16 scrub starts 2024-02-19T21:34:09.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:08.543417+0000 osd.5 (osd.5) 32 : cluster [DBG] 2.16 scrub ok 2024-02-19T21:34:09.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:08.557694+0000 osd.3 (osd.3) 35 : cluster [DBG] 6.1b scrub starts 2024-02-19T21:34:09.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:08.558975+0000 osd.3 (osd.3) 36 : cluster [DBG] 6.1b scrub ok 2024-02-19T21:34:10.308 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:34:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:34:10.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:08.779374+0000 mgr.y (mgr.14514) 71 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:34:10.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:09.300403+0000 osd.4 (osd.4) 39 : cluster [DBG] 6.e scrub starts 2024-02-19T21:34:10.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:09.303496+0000 osd.4 (osd.4) 40 : cluster [DBG] 6.e scrub ok 2024-02-19T21:34:10.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:09.552365+0000 osd.3 (osd.3) 37 : cluster [DBG] 6.c scrub starts 2024-02-19T21:34:10.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:09.553576+0000 osd.3 (osd.3) 38 : cluster [DBG] 6.c scrub ok 2024-02-19T21:34:10.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:09.726040+0000 osd.1 (osd.1) 29 : cluster [DBG] 4.4 scrub starts 2024-02-19T21:34:10.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:09.727953+0000 osd.1 (osd.1) 30 : cluster [DBG] 4.4 scrub ok 2024-02-19T21:34:10.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:08.779374+0000 mgr.y (mgr.14514) 71 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:34:10.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:09.300403+0000 osd.4 (osd.4) 39 : cluster [DBG] 6.e scrub starts 2024-02-19T21:34:10.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:09.303496+0000 osd.4 (osd.4) 40 : cluster [DBG] 6.e scrub ok 2024-02-19T21:34:10.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:09.552365+0000 osd.3 (osd.3) 37 : cluster [DBG] 6.c scrub starts 2024-02-19T21:34:10.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:09.553576+0000 osd.3 (osd.3) 38 : cluster [DBG] 6.c scrub ok 2024-02-19T21:34:10.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:09.726040+0000 osd.1 (osd.1) 29 : cluster [DBG] 4.4 scrub starts 2024-02-19T21:34:10.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:09.727953+0000 osd.1 (osd.1) 30 : cluster [DBG] 4.4 scrub ok 2024-02-19T21:34:10.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:08.779374+0000 mgr.y (mgr.14514) 71 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:34:10.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:09.300403+0000 osd.4 (osd.4) 39 : cluster [DBG] 6.e scrub starts 2024-02-19T21:34:10.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:09.303496+0000 osd.4 (osd.4) 40 : cluster [DBG] 6.e scrub ok 2024-02-19T21:34:10.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:09.552365+0000 osd.3 (osd.3) 37 : cluster [DBG] 6.c scrub starts 2024-02-19T21:34:10.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:09.553576+0000 osd.3 (osd.3) 38 : cluster [DBG] 6.c scrub ok 2024-02-19T21:34:10.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:09.726040+0000 osd.1 (osd.1) 29 : cluster [DBG] 4.4 scrub starts 2024-02-19T21:34:10.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:09.727953+0000 osd.1 (osd.1) 30 : cluster [DBG] 4.4 scrub ok 2024-02-19T21:34:11.075 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:34:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:34:10] "GET /metrics HTTP/1.1" 200 172131 "" "Prometheus/2.33.4" 2024-02-19T21:34:11.343 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:09.837691+0000 mgr.y (mgr.14514) 72 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:34:11.343 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:10.069198+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:34:11.343 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:10.345145+0000 osd.4 (osd.4) 41 : cluster [DBG] 4.1 scrub starts 2024-02-19T21:34:11.343 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:10.348818+0000 osd.4 (osd.4) 42 : cluster [DBG] 4.1 scrub ok 2024-02-19T21:34:11.343 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:10.562206+0000 osd.3 (osd.3) 39 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:34:11.343 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:10.565160+0000 osd.3 (osd.3) 40 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:34:11.343 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:10.710370+0000 osd.1 (osd.1) 31 : cluster [DBG] 4.12 scrub starts 2024-02-19T21:34:11.343 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:10.712075+0000 osd.1 (osd.1) 32 : cluster [DBG] 4.12 scrub ok 2024-02-19T21:34:11.343 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:09.837691+0000 mgr.y (mgr.14514) 72 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:34:11.343 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:10.069198+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:34:11.343 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:10.345145+0000 osd.4 (osd.4) 41 : cluster [DBG] 4.1 scrub starts 2024-02-19T21:34:11.344 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:10.348818+0000 osd.4 (osd.4) 42 : cluster [DBG] 4.1 scrub ok 2024-02-19T21:34:11.344 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:10.562206+0000 osd.3 (osd.3) 39 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:34:11.344 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:10.565160+0000 osd.3 (osd.3) 40 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:34:11.344 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:10.710370+0000 osd.1 (osd.1) 31 : cluster [DBG] 4.12 scrub starts 2024-02-19T21:34:11.344 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:10.712075+0000 osd.1 (osd.1) 32 : cluster [DBG] 4.12 scrub ok 2024-02-19T21:34:11.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:09.837691+0000 mgr.y (mgr.14514) 72 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:34:11.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:10.069198+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:34:11.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:10.345145+0000 osd.4 (osd.4) 41 : cluster [DBG] 4.1 scrub starts 2024-02-19T21:34:11.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:10.348818+0000 osd.4 (osd.4) 42 : cluster [DBG] 4.1 scrub ok 2024-02-19T21:34:11.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:10.562206+0000 osd.3 (osd.3) 39 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:34:11.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:10.565160+0000 osd.3 (osd.3) 40 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:34:11.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:10.710370+0000 osd.1 (osd.1) 31 : cluster [DBG] 4.12 scrub starts 2024-02-19T21:34:11.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:10.712075+0000 osd.1 (osd.1) 32 : cluster [DBG] 4.12 scrub ok 2024-02-19T21:34:12.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:10.780027+0000 mgr.y (mgr.14514) 73 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-19T21:34:12.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:11.108682+0000 osd.2 (osd.2) 29 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:34:12.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:11.111825+0000 osd.2 (osd.2) 30 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:34:12.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:11.589992+0000 osd.5 (osd.5) 33 : cluster [DBG] 5.7 scrub starts 2024-02-19T21:34:12.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:11.592900+0000 osd.5 (osd.5) 34 : cluster [DBG] 5.7 scrub ok 2024-02-19T21:34:12.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:10.780027+0000 mgr.y (mgr.14514) 73 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-19T21:34:12.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:11.108682+0000 osd.2 (osd.2) 29 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:34:12.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:11.111825+0000 osd.2 (osd.2) 30 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:34:12.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:11.589992+0000 osd.5 (osd.5) 33 : cluster [DBG] 5.7 scrub starts 2024-02-19T21:34:12.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:11.592900+0000 osd.5 (osd.5) 34 : cluster [DBG] 5.7 scrub ok 2024-02-19T21:34:12.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:10.780027+0000 mgr.y (mgr.14514) 73 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-19T21:34:12.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:11.108682+0000 osd.2 (osd.2) 29 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:34:12.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:11.111825+0000 osd.2 (osd.2) 30 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:34:12.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:11.589992+0000 osd.5 (osd.5) 33 : cluster [DBG] 5.7 scrub starts 2024-02-19T21:34:12.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:11.592900+0000 osd.5 (osd.5) 34 : cluster [DBG] 5.7 scrub ok 2024-02-19T21:34:12.514 INFO:teuthology.orchestra.run.smithi080.stdout:236223201304 2024-02-19T21:34:12.515 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-02-19T21:34:12.789 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:34:13.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:12.529167+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:34:13.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:12.530133+0000 mon.a (mon.0) 753 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:34:13.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:12.530838+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:34:13.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:12.535389+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:34:13.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:12.639259+0000 osd.5 (osd.5) 35 : cluster [DBG] 6.19 scrub starts 2024-02-19T21:34:13.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:12.642152+0000 osd.5 (osd.5) 36 : cluster [DBG] 6.19 scrub ok 2024-02-19T21:34:13.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:12.904460+0000 osd.4 (osd.4) 43 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:34:13.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:12.904505+0000 osd.4 (osd.4) 44 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:34:13.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:13.415384+0000 osd.4 (osd.4) 45 : cluster [DBG] 5.1c scrub starts 2024-02-19T21:34:13.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:13.418319+0000 osd.4 (osd.4) 46 : cluster [DBG] 5.1c scrub ok 2024-02-19T21:34:13.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:12.529167+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:34:13.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:12.530133+0000 mon.a (mon.0) 753 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:34:13.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:12.530838+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:34:13.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:12.535389+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:34:13.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:12.639259+0000 osd.5 (osd.5) 35 : cluster [DBG] 6.19 scrub starts 2024-02-19T21:34:13.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:12.642152+0000 osd.5 (osd.5) 36 : cluster [DBG] 6.19 scrub ok 2024-02-19T21:34:13.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:12.904460+0000 osd.4 (osd.4) 43 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:34:13.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:12.904505+0000 osd.4 (osd.4) 44 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:34:13.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:13.415384+0000 osd.4 (osd.4) 45 : cluster [DBG] 5.1c scrub starts 2024-02-19T21:34:13.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:13.418319+0000 osd.4 (osd.4) 46 : cluster [DBG] 5.1c scrub ok 2024-02-19T21:34:13.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:12.529167+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:34:13.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:12.530133+0000 mon.a (mon.0) 753 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:34:13.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:12.530838+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:34:13.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:12.535389+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:34:13.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:12.639259+0000 osd.5 (osd.5) 35 : cluster [DBG] 6.19 scrub starts 2024-02-19T21:34:13.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:12.642152+0000 osd.5 (osd.5) 36 : cluster [DBG] 6.19 scrub ok 2024-02-19T21:34:13.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:12.904460+0000 osd.4 (osd.4) 43 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:34:13.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:12.904505+0000 osd.4 (osd.4) 44 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:34:13.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:13.415384+0000 osd.4 (osd.4) 45 : cluster [DBG] 5.1c scrub starts 2024-02-19T21:34:13.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:13.418319+0000 osd.4 (osd.4) 46 : cluster [DBG] 5.1c scrub ok 2024-02-19T21:34:14.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:12.756097+0000 osd.0 (osd.0) 37 : cluster [DBG] 3.1 scrub starts 2024-02-19T21:34:14.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:12.756938+0000 osd.0 (osd.0) 38 : cluster [DBG] 3.1 scrub ok 2024-02-19T21:34:14.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:12.780375+0000 mgr.y (mgr.14514) 74 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:34:14.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:13.539607+0000 mon.a (mon.0) 756 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2024-02-19T21:34:14.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:13.556226+0000 osd.7 (osd.7) 39 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:34:14.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:13.559599+0000 osd.7 (osd.7) 40 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:34:14.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:13.595194+0000 osd.2 (osd.2) 31 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:34:14.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:13.595227+0000 osd.2 (osd.2) 32 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:34:14.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:12.756097+0000 osd.0 (osd.0) 37 : cluster [DBG] 3.1 scrub starts 2024-02-19T21:34:14.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:12.756938+0000 osd.0 (osd.0) 38 : cluster [DBG] 3.1 scrub ok 2024-02-19T21:34:14.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:12.780375+0000 mgr.y (mgr.14514) 74 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:34:14.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:13.539607+0000 mon.a (mon.0) 756 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2024-02-19T21:34:14.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:13.556226+0000 osd.7 (osd.7) 39 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:34:14.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:13.559599+0000 osd.7 (osd.7) 40 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:34:14.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:13.595194+0000 osd.2 (osd.2) 31 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:34:14.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:13.595227+0000 osd.2 (osd.2) 32 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:34:14.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:12.756097+0000 osd.0 (osd.0) 37 : cluster [DBG] 3.1 scrub starts 2024-02-19T21:34:14.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:12.756938+0000 osd.0 (osd.0) 38 : cluster [DBG] 3.1 scrub ok 2024-02-19T21:34:14.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:12.780375+0000 mgr.y (mgr.14514) 74 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:34:14.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:13.539607+0000 mon.a (mon.0) 756 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2024-02-19T21:34:14.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:13.556226+0000 osd.7 (osd.7) 39 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:34:14.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:13.559599+0000 osd.7 (osd.7) 40 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:34:14.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:13.595194+0000 osd.2 (osd.2) 31 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:34:14.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:13.595227+0000 osd.2 (osd.2) 32 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:34:14.938 INFO:teuthology.orchestra.run.smithi080.stdout:34359738431 2024-02-19T21:34:15.727 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738424 got 34359738431 for osd.0 2024-02-19T21:34:15.728 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-02-19T21:34:15.808 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:34:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:34:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:34:15.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:13.750143+0000 osd.0 (osd.0) 39 : cluster [DBG] 6.18 scrub starts 2024-02-19T21:34:15.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:13.751721+0000 osd.0 (osd.0) 40 : cluster [DBG] 6.18 scrub ok 2024-02-19T21:34:15.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:14.542104+0000 mon.a (mon.0) 757 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2024-02-19T21:34:15.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:14.756624+0000 osd.1 (osd.1) 33 : cluster [DBG] 2.d scrub starts 2024-02-19T21:34:15.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:14.757656+0000 osd.1 (osd.1) 34 : cluster [DBG] 2.d scrub ok 2024-02-19T21:34:15.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:14.780834+0000 mgr.y (mgr.14514) 75 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:34:15.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:14.936676+0000 mon.c (mon.2) 19 : audit [DBG] from='client.? 172.21.15.80:0/1136802728' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-19T21:34:15.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:13.750143+0000 osd.0 (osd.0) 39 : cluster [DBG] 6.18 scrub starts 2024-02-19T21:34:15.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:13.751721+0000 osd.0 (osd.0) 40 : cluster [DBG] 6.18 scrub ok 2024-02-19T21:34:15.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:14.542104+0000 mon.a (mon.0) 757 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2024-02-19T21:34:15.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:14.756624+0000 osd.1 (osd.1) 33 : cluster [DBG] 2.d scrub starts 2024-02-19T21:34:15.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:14.757656+0000 osd.1 (osd.1) 34 : cluster [DBG] 2.d scrub ok 2024-02-19T21:34:15.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:14.780834+0000 mgr.y (mgr.14514) 75 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:34:15.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:14.936676+0000 mon.c (mon.2) 19 : audit [DBG] from='client.? 172.21.15.80:0/1136802728' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-19T21:34:15.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:13.750143+0000 osd.0 (osd.0) 39 : cluster [DBG] 6.18 scrub starts 2024-02-19T21:34:15.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:13.751721+0000 osd.0 (osd.0) 40 : cluster [DBG] 6.18 scrub ok 2024-02-19T21:34:15.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:14.542104+0000 mon.a (mon.0) 757 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2024-02-19T21:34:15.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:14.756624+0000 osd.1 (osd.1) 33 : cluster [DBG] 2.d scrub starts 2024-02-19T21:34:15.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:14.757656+0000 osd.1 (osd.1) 34 : cluster [DBG] 2.d scrub ok 2024-02-19T21:34:15.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:14.780834+0000 mgr.y (mgr.14514) 75 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:34:15.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:14.936676+0000 mon.c (mon.2) 19 : audit [DBG] from='client.? 172.21.15.80:0/1136802728' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-19T21:34:15.997 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:34:16.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:15.249808+0000 osd.2 (osd.2) 33 : cluster [DBG] 5.8 scrub starts 2024-02-19T21:34:16.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:15.250603+0000 osd.2 (osd.2) 34 : cluster [DBG] 5.8 scrub ok 2024-02-19T21:34:16.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:15.559607+0000 osd.3 (osd.3) 41 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:34:16.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:15.560427+0000 osd.3 (osd.3) 42 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:34:16.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:15.664386+0000 osd.5 (osd.5) 37 : cluster [DBG] 5.16 scrub starts 2024-02-19T21:34:16.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:15.667374+0000 osd.5 (osd.5) 38 : cluster [DBG] 5.16 scrub ok 2024-02-19T21:34:16.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:15.249808+0000 osd.2 (osd.2) 33 : cluster [DBG] 5.8 scrub starts 2024-02-19T21:34:16.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:15.250603+0000 osd.2 (osd.2) 34 : cluster [DBG] 5.8 scrub ok 2024-02-19T21:34:16.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:15.559607+0000 osd.3 (osd.3) 41 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:34:16.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:15.560427+0000 osd.3 (osd.3) 42 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:34:16.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:15.664386+0000 osd.5 (osd.5) 37 : cluster [DBG] 5.16 scrub starts 2024-02-19T21:34:16.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:15.667374+0000 osd.5 (osd.5) 38 : cluster [DBG] 5.16 scrub ok 2024-02-19T21:34:16.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:15.249808+0000 osd.2 (osd.2) 33 : cluster [DBG] 5.8 scrub starts 2024-02-19T21:34:16.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:15.250603+0000 osd.2 (osd.2) 34 : cluster [DBG] 5.8 scrub ok 2024-02-19T21:34:16.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:15.559607+0000 osd.3 (osd.3) 41 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:34:16.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:15.560427+0000 osd.3 (osd.3) 42 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:34:16.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:15.664386+0000 osd.5 (osd.5) 37 : cluster [DBG] 5.16 scrub starts 2024-02-19T21:34:16.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:15.667374+0000 osd.5 (osd.5) 38 : cluster [DBG] 5.16 scrub ok 2024-02-19T21:34:17.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:16.527826+0000 osd.3 (osd.3) 43 : cluster [DBG] 4.19 scrub starts 2024-02-19T21:34:17.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:16.531296+0000 osd.3 (osd.3) 44 : cluster [DBG] 4.19 scrub ok 2024-02-19T21:34:17.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:16.781362+0000 mgr.y (mgr.14514) 76 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:34:17.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:16.784571+0000 osd.1 (osd.1) 35 : cluster [DBG] 5.c scrub starts 2024-02-19T21:34:17.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:16.785685+0000 osd.1 (osd.1) 36 : cluster [DBG] 5.c scrub ok 2024-02-19T21:34:17.837 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:16.527826+0000 osd.3 (osd.3) 43 : cluster [DBG] 4.19 scrub starts 2024-02-19T21:34:17.837 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:16.531296+0000 osd.3 (osd.3) 44 : cluster [DBG] 4.19 scrub ok 2024-02-19T21:34:17.837 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:16.781362+0000 mgr.y (mgr.14514) 76 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:34:17.837 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:16.784571+0000 osd.1 (osd.1) 35 : cluster [DBG] 5.c scrub starts 2024-02-19T21:34:17.837 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:16.785685+0000 osd.1 (osd.1) 36 : cluster [DBG] 5.c scrub ok 2024-02-19T21:34:17.838 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:16.527826+0000 osd.3 (osd.3) 43 : cluster [DBG] 4.19 scrub starts 2024-02-19T21:34:17.838 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:16.531296+0000 osd.3 (osd.3) 44 : cluster [DBG] 4.19 scrub ok 2024-02-19T21:34:17.838 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:16.781362+0000 mgr.y (mgr.14514) 76 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:34:17.838 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:16.784571+0000 osd.1 (osd.1) 35 : cluster [DBG] 5.c scrub starts 2024-02-19T21:34:17.838 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:16.785685+0000 osd.1 (osd.1) 36 : cluster [DBG] 5.c scrub ok 2024-02-19T21:34:18.267 INFO:teuthology.orchestra.run.smithi080.stdout:55834574906 2024-02-19T21:34:18.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:17.561778+0000 osd.3 (osd.3) 45 : cluster [DBG] 5.14 scrub starts 2024-02-19T21:34:18.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:17.563469+0000 osd.3 (osd.3) 46 : cluster [DBG] 5.14 scrub ok 2024-02-19T21:34:18.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:17.808403+0000 osd.1 (osd.1) 37 : cluster [DBG] 5.1d scrub starts 2024-02-19T21:34:18.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:17.809241+0000 osd.1 (osd.1) 38 : cluster [DBG] 5.1d scrub ok 2024-02-19T21:34:18.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:18.265608+0000 mon.c (mon.2) 20 : audit [DBG] from='client.? 172.21.15.80:0/1048903119' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-19T21:34:18.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:17.561778+0000 osd.3 (osd.3) 45 : cluster [DBG] 5.14 scrub starts 2024-02-19T21:34:18.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:17.563469+0000 osd.3 (osd.3) 46 : cluster [DBG] 5.14 scrub ok 2024-02-19T21:34:18.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:17.808403+0000 osd.1 (osd.1) 37 : cluster [DBG] 5.1d scrub starts 2024-02-19T21:34:18.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:17.809241+0000 osd.1 (osd.1) 38 : cluster [DBG] 5.1d scrub ok 2024-02-19T21:34:18.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:18.265608+0000 mon.c (mon.2) 20 : audit [DBG] from='client.? 172.21.15.80:0/1048903119' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-19T21:34:19.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:17.561778+0000 osd.3 (osd.3) 45 : cluster [DBG] 5.14 scrub starts 2024-02-19T21:34:19.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:17.563469+0000 osd.3 (osd.3) 46 : cluster [DBG] 5.14 scrub ok 2024-02-19T21:34:19.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:17.808403+0000 osd.1 (osd.1) 37 : cluster [DBG] 5.1d scrub starts 2024-02-19T21:34:19.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:17.809241+0000 osd.1 (osd.1) 38 : cluster [DBG] 5.1d scrub ok 2024-02-19T21:34:19.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:18.265608+0000 mon.c (mon.2) 20 : audit [DBG] from='client.? 172.21.15.80:0/1048903119' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-19T21:34:19.099 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574899 got 55834574906 for osd.1 2024-02-19T21:34:19.099 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-02-19T21:34:19.365 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:34:19.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:18.781913+0000 mgr.y (mgr.14514) 77 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:34:19.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:18.781913+0000 mgr.y (mgr.14514) 77 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:34:19.850 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:18.781913+0000 mgr.y (mgr.14514) 77 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:34:20.308 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:34:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:34:21.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:19.848486+0000 mgr.y (mgr.14514) 78 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:34:21.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:20.567787+0000 osd.3 (osd.3) 47 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:34:21.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:20.569118+0000 osd.3 (osd.3) 48 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:34:21.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:20.614925+0000 osd.0 (osd.0) 41 : cluster [DBG] 5.5 scrub starts 2024-02-19T21:34:21.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:20.616138+0000 osd.0 (osd.0) 42 : cluster [DBG] 5.5 scrub ok 2024-02-19T21:34:21.011 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:34:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:34:20] "GET /metrics HTTP/1.1" 200 172152 "" "Prometheus/2.33.4" 2024-02-19T21:34:21.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:19.848486+0000 mgr.y (mgr.14514) 78 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:34:21.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:20.567787+0000 osd.3 (osd.3) 47 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:34:21.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:20.569118+0000 osd.3 (osd.3) 48 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:34:21.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:20.614925+0000 osd.0 (osd.0) 41 : cluster [DBG] 5.5 scrub starts 2024-02-19T21:34:21.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:20.616138+0000 osd.0 (osd.0) 42 : cluster [DBG] 5.5 scrub ok 2024-02-19T21:34:21.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:19.848486+0000 mgr.y (mgr.14514) 78 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:34:21.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:20.567787+0000 osd.3 (osd.3) 47 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:34:21.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:20.569118+0000 osd.3 (osd.3) 48 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:34:21.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:20.614925+0000 osd.0 (osd.0) 41 : cluster [DBG] 5.5 scrub starts 2024-02-19T21:34:21.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:20.616138+0000 osd.0 (osd.0) 42 : cluster [DBG] 5.5 scrub ok 2024-02-19T21:34:21.473 INFO:teuthology.orchestra.run.smithi080.stdout:77309411382 2024-02-19T21:34:22.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:20.782696+0000 mgr.y (mgr.14514) 79 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:34:22.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:21.471881+0000 mon.a (mon.0) 758 : audit [DBG] from='client.? 172.21.15.80:0/976237187' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-19T21:34:22.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:20.782696+0000 mgr.y (mgr.14514) 79 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:34:22.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:21.471881+0000 mon.a (mon.0) 758 : audit [DBG] from='client.? 172.21.15.80:0/976237187' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-19T21:34:22.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:20.782696+0000 mgr.y (mgr.14514) 79 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:34:22.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:21.471881+0000 mon.a (mon.0) 758 : audit [DBG] from='client.? 172.21.15.80:0/976237187' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-19T21:34:22.331 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411375 got 77309411382 for osd.2 2024-02-19T21:34:22.332 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-02-19T21:34:22.598 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:34:24.249 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:22.783224+0000 mgr.y (mgr.14514) 80 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-19T21:34:24.249 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:22.783224+0000 mgr.y (mgr.14514) 80 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-19T21:34:24.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:22.783224+0000 mgr.y (mgr.14514) 80 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-19T21:34:24.737 INFO:teuthology.orchestra.run.smithi080.stdout:111669149745 2024-02-19T21:34:25.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:23.950267+0000 osd.1 (osd.1) 39 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:34:25.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:23.950367+0000 osd.1 (osd.1) 40 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:34:25.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:24.526306+0000 osd.3 (osd.3) 49 : cluster [DBG] 5.17 scrub starts 2024-02-19T21:34:25.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:24.527277+0000 osd.3 (osd.3) 50 : cluster [DBG] 5.17 scrub ok 2024-02-19T21:34:25.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:24.735057+0000 mon.a (mon.0) 759 : audit [DBG] from='client.? 172.21.15.80:0/3868082836' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-19T21:34:25.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:24.737677+0000 osd.1 (osd.1) 41 : cluster [DBG] 5.12 scrub starts 2024-02-19T21:34:25.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:24.738607+0000 osd.1 (osd.1) 42 : cluster [DBG] 5.12 scrub ok 2024-02-19T21:34:25.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:23.950267+0000 osd.1 (osd.1) 39 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:34:25.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:23.950367+0000 osd.1 (osd.1) 40 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:34:25.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:24.526306+0000 osd.3 (osd.3) 49 : cluster [DBG] 5.17 scrub starts 2024-02-19T21:34:25.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:24.527277+0000 osd.3 (osd.3) 50 : cluster [DBG] 5.17 scrub ok 2024-02-19T21:34:25.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:24.735057+0000 mon.a (mon.0) 759 : audit [DBG] from='client.? 172.21.15.80:0/3868082836' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-19T21:34:25.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:24.737677+0000 osd.1 (osd.1) 41 : cluster [DBG] 5.12 scrub starts 2024-02-19T21:34:25.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:24.738607+0000 osd.1 (osd.1) 42 : cluster [DBG] 5.12 scrub ok 2024-02-19T21:34:25.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:23.950267+0000 osd.1 (osd.1) 39 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:34:25.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:23.950367+0000 osd.1 (osd.1) 40 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:34:25.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:24.526306+0000 osd.3 (osd.3) 49 : cluster [DBG] 5.17 scrub starts 2024-02-19T21:34:25.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:24.527277+0000 osd.3 (osd.3) 50 : cluster [DBG] 5.17 scrub ok 2024-02-19T21:34:25.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:24.735057+0000 mon.a (mon.0) 759 : audit [DBG] from='client.? 172.21.15.80:0/3868082836' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-19T21:34:25.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:24.737677+0000 osd.1 (osd.1) 41 : cluster [DBG] 5.12 scrub starts 2024-02-19T21:34:25.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:24.738607+0000 osd.1 (osd.1) 42 : cluster [DBG] 5.12 scrub ok 2024-02-19T21:34:25.593 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149739 got 111669149745 for osd.3 2024-02-19T21:34:25.593 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-02-19T21:34:25.861 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:34:26.058 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:34:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:34:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:34:26.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:24.783996+0000 mgr.y (mgr.14514) 81 : cluster [DBG] pgmap v70: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-19T21:34:26.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:24.863646+0000 mon.a (mon.0) 760 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2024-02-19T21:34:26.162 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:24.783996+0000 mgr.y (mgr.14514) 81 : cluster [DBG] pgmap v70: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-19T21:34:26.162 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:24.863646+0000 mon.a (mon.0) 760 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2024-02-19T21:34:26.162 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:24.783996+0000 mgr.y (mgr.14514) 81 : cluster [DBG] pgmap v70: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-19T21:34:26.162 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:24.863646+0000 mon.a (mon.0) 760 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2024-02-19T21:34:28.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:26.784530+0000 mgr.y (mgr.14514) 82 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:34:28.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:27.479254+0000 osd.3 (osd.3) 51 : cluster [DBG] 4.17 scrub starts 2024-02-19T21:34:28.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:27.480717+0000 osd.3 (osd.3) 52 : cluster [DBG] 4.17 scrub ok 2024-02-19T21:34:28.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:26.784530+0000 mgr.y (mgr.14514) 82 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:34:28.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:27.479254+0000 osd.3 (osd.3) 51 : cluster [DBG] 4.17 scrub starts 2024-02-19T21:34:28.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:27.480717+0000 osd.3 (osd.3) 52 : cluster [DBG] 4.17 scrub ok 2024-02-19T21:34:28.100 INFO:teuthology.orchestra.run.smithi080.stdout:137438953515 2024-02-19T21:34:28.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:26.784530+0000 mgr.y (mgr.14514) 82 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:34:28.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:27.479254+0000 osd.3 (osd.3) 51 : cluster [DBG] 4.17 scrub starts 2024-02-19T21:34:28.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:27.480717+0000 osd.3 (osd.3) 52 : cluster [DBG] 4.17 scrub ok 2024-02-19T21:34:28.952 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953509 got 137438953515 for osd.4 2024-02-19T21:34:28.952 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-02-19T21:34:29.220 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:34:29.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:28.099329+0000 mon.a (mon.0) 761 : audit [DBG] from='client.? 172.21.15.80:0/3580377696' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-19T21:34:29.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:28.753541+0000 osd.1 (osd.1) 43 : cluster [DBG] 6.4 scrub starts 2024-02-19T21:34:29.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:28.754580+0000 osd.1 (osd.1) 44 : cluster [DBG] 6.4 scrub ok 2024-02-19T21:34:29.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:28.099329+0000 mon.a (mon.0) 761 : audit [DBG] from='client.? 172.21.15.80:0/3580377696' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-19T21:34:29.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:28.753541+0000 osd.1 (osd.1) 43 : cluster [DBG] 6.4 scrub starts 2024-02-19T21:34:29.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:28.754580+0000 osd.1 (osd.1) 44 : cluster [DBG] 6.4 scrub ok 2024-02-19T21:34:29.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:28.099329+0000 mon.a (mon.0) 761 : audit [DBG] from='client.? 172.21.15.80:0/3580377696' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-19T21:34:29.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:28.753541+0000 osd.1 (osd.1) 43 : cluster [DBG] 6.4 scrub starts 2024-02-19T21:34:29.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:28.754580+0000 osd.1 (osd.1) 44 : cluster [DBG] 6.4 scrub ok 2024-02-19T21:34:30.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:28.784844+0000 mgr.y (mgr.14514) 83 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:34:30.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:29.776670+0000 osd.1 (osd.1) 45 : cluster [DBG] 5.19 scrub starts 2024-02-19T21:34:30.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:29.779775+0000 osd.1 (osd.1) 46 : cluster [DBG] 5.19 scrub ok 2024-02-19T21:34:30.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:28.784844+0000 mgr.y (mgr.14514) 83 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:34:30.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:29.776670+0000 osd.1 (osd.1) 45 : cluster [DBG] 5.19 scrub starts 2024-02-19T21:34:30.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:29.779775+0000 osd.1 (osd.1) 46 : cluster [DBG] 5.19 scrub ok 2024-02-19T21:34:30.308 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:34:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:34:30.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:28.784844+0000 mgr.y (mgr.14514) 83 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:34:30.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:29.776670+0000 osd.1 (osd.1) 45 : cluster [DBG] 5.19 scrub starts 2024-02-19T21:34:30.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:29.779775+0000 osd.1 (osd.1) 46 : cluster [DBG] 5.19 scrub ok 2024-02-19T21:34:30.893 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:34:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:34:30] "GET /metrics HTTP/1.1" 200 172152 "" "Prometheus/2.33.4" 2024-02-19T21:34:31.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:29.859441+0000 mgr.y (mgr.14514) 84 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:34:31.329 INFO:teuthology.orchestra.run.smithi080.stdout:163208757288 2024-02-19T21:34:31.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:29.859441+0000 mgr.y (mgr.14514) 84 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:34:31.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:29.859441+0000 mgr.y (mgr.14514) 84 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:34:32.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:30.785464+0000 mgr.y (mgr.14514) 85 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:34:32.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:31.327723+0000 mon.a (mon.0) 762 : audit [DBG] from='client.? 172.21.15.80:0/2112196944' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-19T21:34:32.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:31.721041+0000 osd.5 (osd.5) 39 : cluster [DBG] 2.18 scrub starts 2024-02-19T21:34:32.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:31.724019+0000 osd.5 (osd.5) 40 : cluster [DBG] 2.18 scrub ok 2024-02-19T21:34:32.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:30.785464+0000 mgr.y (mgr.14514) 85 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:34:32.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:31.327723+0000 mon.a (mon.0) 762 : audit [DBG] from='client.? 172.21.15.80:0/2112196944' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-19T21:34:32.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:31.721041+0000 osd.5 (osd.5) 39 : cluster [DBG] 2.18 scrub starts 2024-02-19T21:34:32.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:31.724019+0000 osd.5 (osd.5) 40 : cluster [DBG] 2.18 scrub ok 2024-02-19T21:34:32.188 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757282 got 163208757288 for osd.5 2024-02-19T21:34:32.188 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.6 2024-02-19T21:34:32.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:30.785464+0000 mgr.y (mgr.14514) 85 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:34:32.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:31.327723+0000 mon.a (mon.0) 762 : audit [DBG] from='client.? 172.21.15.80:0/2112196944' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-19T21:34:32.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:31.721041+0000 osd.5 (osd.5) 39 : cluster [DBG] 2.18 scrub starts 2024-02-19T21:34:32.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:31.724019+0000 osd.5 (osd.5) 40 : cluster [DBG] 2.18 scrub ok 2024-02-19T21:34:32.456 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:34:34.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:32.785848+0000 mgr.y (mgr.14514) 86 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:34:34.338 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:32.785848+0000 mgr.y (mgr.14514) 86 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:34:34.338 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:32.785848+0000 mgr.y (mgr.14514) 86 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:34:34.774 INFO:teuthology.orchestra.run.smithi080.stdout:201863462947 2024-02-19T21:34:35.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:34.772853+0000 mon.a (mon.0) 763 : audit [DBG] from='client.? 172.21.15.80:0/269513000' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-19T21:34:35.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:34.775202+0000 osd.1 (osd.1) 47 : cluster [DBG] 6.1d scrub starts 2024-02-19T21:34:35.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:34.776186+0000 osd.1 (osd.1) 48 : cluster [DBG] 6.1d scrub ok 2024-02-19T21:34:35.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:34.772853+0000 mon.a (mon.0) 763 : audit [DBG] from='client.? 172.21.15.80:0/269513000' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-19T21:34:35.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:34.775202+0000 osd.1 (osd.1) 47 : cluster [DBG] 6.1d scrub starts 2024-02-19T21:34:35.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:34.776186+0000 osd.1 (osd.1) 48 : cluster [DBG] 6.1d scrub ok 2024-02-19T21:34:35.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:34.772853+0000 mon.a (mon.0) 763 : audit [DBG] from='client.? 172.21.15.80:0/269513000' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-19T21:34:35.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:34.775202+0000 osd.1 (osd.1) 47 : cluster [DBG] 6.1d scrub starts 2024-02-19T21:34:35.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:34.776186+0000 osd.1 (osd.1) 48 : cluster [DBG] 6.1d scrub ok 2024-02-19T21:34:35.642 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462942 got 201863462947 for osd.6 2024-02-19T21:34:35.642 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.7 2024-02-19T21:34:35.916 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:34:35.924 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:34:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:34:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:34:36.189 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:34.786537+0000 mgr.y (mgr.14514) 87 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:34:36.189 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:34.786537+0000 mgr.y (mgr.14514) 87 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:34:36.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:34.786537+0000 mgr.y (mgr.14514) 87 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:34:38.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:36.786918+0000 mgr.y (mgr.14514) 88 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 858 B/s rd, 0 op/s 2024-02-19T21:34:38.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:37.255191+0000 osd.4 (osd.4) 47 : cluster [DBG] 4.d scrub starts 2024-02-19T21:34:38.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:37.259016+0000 osd.4 (osd.4) 48 : cluster [DBG] 4.d scrub ok 2024-02-19T21:34:38.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:36.786918+0000 mgr.y (mgr.14514) 88 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 858 B/s rd, 0 op/s 2024-02-19T21:34:38.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:37.255191+0000 osd.4 (osd.4) 47 : cluster [DBG] 4.d scrub starts 2024-02-19T21:34:38.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:37.259016+0000 osd.4 (osd.4) 48 : cluster [DBG] 4.d scrub ok 2024-02-19T21:34:38.300 INFO:teuthology.orchestra.run.smithi080.stdout:236223201309 2024-02-19T21:34:38.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:36.786918+0000 mgr.y (mgr.14514) 88 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 858 B/s rd, 0 op/s 2024-02-19T21:34:38.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:37.255191+0000 osd.4 (osd.4) 47 : cluster [DBG] 4.d scrub starts 2024-02-19T21:34:38.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:37.259016+0000 osd.4 (osd.4) 48 : cluster [DBG] 4.d scrub ok 2024-02-19T21:34:39.047 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:38.298534+0000 mon.a (mon.0) 764 : audit [DBG] from='client.? 172.21.15.80:0/2224548927' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-19T21:34:39.047 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:38.713699+0000 osd.5 (osd.5) 41 : cluster [DBG] 2.2 scrub starts 2024-02-19T21:34:39.047 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:38.714710+0000 osd.5 (osd.5) 42 : cluster [DBG] 2.2 scrub ok 2024-02-19T21:34:39.048 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:38.298534+0000 mon.a (mon.0) 764 : audit [DBG] from='client.? 172.21.15.80:0/2224548927' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-19T21:34:39.048 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:38.713699+0000 osd.5 (osd.5) 41 : cluster [DBG] 2.2 scrub starts 2024-02-19T21:34:39.048 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:38.714710+0000 osd.5 (osd.5) 42 : cluster [DBG] 2.2 scrub ok 2024-02-19T21:34:39.067 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201304 got 236223201309 for osd.7 2024-02-19T21:34:39.067 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-02-19T21:34:39.068 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:34:39.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:38.298534+0000 mon.a (mon.0) 764 : audit [DBG] from='client.? 172.21.15.80:0/2224548927' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-19T21:34:39.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:38.713699+0000 osd.5 (osd.5) 41 : cluster [DBG] 2.2 scrub starts 2024-02-19T21:34:39.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:38.714710+0000 osd.5 (osd.5) 42 : cluster [DBG] 2.2 scrub ok 2024-02-19T21:34:39.336 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:34:40.240 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:38.787288+0000 mgr.y (mgr.14514) 89 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:34:40.240 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:39.019322+0000 osd.6 (osd.6) 29 : cluster [DBG] 2.1a scrub starts 2024-02-19T21:34:40.240 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:39.022335+0000 osd.6 (osd.6) 30 : cluster [DBG] 2.1a scrub ok 2024-02-19T21:34:40.240 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:38.787288+0000 mgr.y (mgr.14514) 89 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:34:40.241 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:39.019322+0000 osd.6 (osd.6) 29 : cluster [DBG] 2.1a scrub starts 2024-02-19T21:34:40.241 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:39.022335+0000 osd.6 (osd.6) 30 : cluster [DBG] 2.1a scrub ok 2024-02-19T21:34:40.308 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:34:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:34:40.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:38.787288+0000 mgr.y (mgr.14514) 89 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:34:40.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:39.019322+0000 osd.6 (osd.6) 29 : cluster [DBG] 2.1a scrub starts 2024-02-19T21:34:40.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:39.022335+0000 osd.6 (osd.6) 30 : cluster [DBG] 2.1a scrub ok 2024-02-19T21:34:41.062 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:39.866182+0000 mgr.y (mgr.14514) 90 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:34:41.062 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:40.260011+0000 osd.4 (osd.4) 49 : cluster [DBG] 4.1b scrub starts 2024-02-19T21:34:41.062 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:40.263558+0000 osd.4 (osd.4) 50 : cluster [DBG] 4.1b scrub ok 2024-02-19T21:34:41.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:34:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:34:40] "GET /metrics HTTP/1.1" 200 172154 "" "Prometheus/2.33.4" 2024-02-19T21:34:41.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:39.866182+0000 mgr.y (mgr.14514) 90 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:34:41.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:40.260011+0000 osd.4 (osd.4) 49 : cluster [DBG] 4.1b scrub starts 2024-02-19T21:34:41.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:40.263558+0000 osd.4 (osd.4) 50 : cluster [DBG] 4.1b scrub ok 2024-02-19T21:34:41.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:39.866182+0000 mgr.y (mgr.14514) 90 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:34:41.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:40.260011+0000 osd.4 (osd.4) 49 : cluster [DBG] 4.1b scrub starts 2024-02-19T21:34:41.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:40.263558+0000 osd.4 (osd.4) 50 : cluster [DBG] 4.1b scrub ok 2024-02-19T21:34:41.515 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:34:41.518 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:34:42.287 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:40.787845+0000 mgr.y (mgr.14514) 91 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:34:42.287 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:41.498955+0000 mgr.y (mgr.14514) 92 : audit [DBG] from='client.14706 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:34:42.288 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:40.787845+0000 mgr.y (mgr.14514) 91 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:34:42.288 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:41.498955+0000 mgr.y (mgr.14514) 92 : audit [DBG] from='client.14706 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:34:42.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:40.787845+0000 mgr.y (mgr.14514) 91 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:34:42.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:41.498955+0000 mgr.y (mgr.14514) 92 : audit [DBG] from='client.14706 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:34:42.311 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-02-19T21:34:40.787441+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5796,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":848,"num_read_kb":600,"num_write":428,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":2382976,"kb_used_data":6208,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":747578240,"statfs":{"total":767960285184,"available":765520117760,"internally_reserved":0,"allocated":6356992,"data_stored":3181563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002749"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542704+0000","last_change":"2024-02-19T21:34:08.559052+0000","last_active":"2024-02-19T21:34:14.542704+0000","last_peered":"2024-02-19T21:34:14.542704+0000","last_clean":"2024-02-19T21:34:14.542704+0000","last_became_active":"2024-02-19T21:32:29.599674+0000","last_became_peered":"2024-02-19T21:32:29.599674+0000","last_unstale":"2024-02-19T21:34:14.542704+0000","last_undegraded":"2024-02-19T21:34:14.542704+0000","last_fullsized":"2024-02-19T21:34:14.542704+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:08.558980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:08.558980+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541179+0000","last_change":"2024-02-19T21:33:36.342047+0000","last_active":"2024-02-19T21:34:14.541179+0000","last_peered":"2024-02-19T21:34:14.541179+0000","last_clean":"2024-02-19T21:34:14.541179+0000","last_became_active":"2024-02-19T21:32:27.364767+0000","last_became_peered":"2024-02-19T21:32:27.364767+0000","last_unstale":"2024-02-19T21:34:14.541179+0000","last_undegraded":"2024-02-19T21:34:14.541179+0000","last_fullsized":"2024-02-19T21:34:14.541179+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:36.341941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:36.341941+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541781+0000","last_change":"2024-02-19T21:34:07.755067+0000","last_active":"2024-02-19T21:34:14.541781+0000","last_peered":"2024-02-19T21:34:14.541781+0000","last_clean":"2024-02-19T21:34:14.541781+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:34:14.541781+0000","last_undegraded":"2024-02-19T21:34:14.541781+0000","last_fullsized":"2024-02-19T21:34:14.541781+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:07.754969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:07.754969+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"66'15","reported_seq":69,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:16.531398+0000","last_change":"2024-02-19T21:34:16.531368+0000","last_active":"2024-02-19T21:34:16.531398+0000","last_peered":"2024-02-19T21:34:16.531398+0000","last_clean":"2024-02-19T21:34:16.531398+0000","last_became_active":"2024-02-19T21:32:25.365996+0000","last_became_peered":"2024-02-19T21:32:25.365996+0000","last_unstale":"2024-02-19T21:34:16.531398+0000","last_undegraded":"2024-02-19T21:34:16.531398+0000","last_fullsized":"2024-02-19T21:34:16.531398+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:34:16.531300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:16.531300+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541496+0000","last_change":"2024-02-19T21:33:42.457750+0000","last_active":"2024-02-19T21:34:14.541496+0000","last_peered":"2024-02-19T21:34:14.541496+0000","last_clean":"2024-02-19T21:34:14.541496+0000","last_became_active":"2024-02-19T21:32:29.373546+0000","last_became_peered":"2024-02-19T21:32:29.373546+0000","last_unstale":"2024-02-19T21:34:14.541496+0000","last_undegraded":"2024-02-19T21:34:14.541496+0000","last_fullsized":"2024-02-19T21:34:14.541496+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:42.457680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:42.457680+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:29.779862+0000","last_change":"2024-02-19T21:34:29.779862+0000","last_active":"2024-02-19T21:34:29.779862+0000","last_peered":"2024-02-19T21:34:29.779862+0000","last_clean":"2024-02-19T21:34:29.779862+0000","last_became_active":"2024-02-19T21:32:27.372466+0000","last_became_peered":"2024-02-19T21:32:27.372466+0000","last_unstale":"2024-02-19T21:34:29.779862+0000","last_undegraded":"2024-02-19T21:34:29.779862+0000","last_fullsized":"2024-02-19T21:34:29.779862+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:29.779779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:29.779779+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541304+0000","last_change":"2024-02-19T21:33:46.451703+0000","last_active":"2024-02-19T21:34:14.541304+0000","last_peered":"2024-02-19T21:34:14.541304+0000","last_clean":"2024-02-19T21:34:14.541304+0000","last_became_active":"2024-02-19T21:32:23.356975+0000","last_became_peered":"2024-02-19T21:32:23.356975+0000","last_unstale":"2024-02-19T21:34:14.541304+0000","last_undegraded":"2024-02-19T21:34:14.541304+0000","last_fullsized":"2024-02-19T21:34:14.541304+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:46.451637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:46.451637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"66'9","reported_seq":61,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541378+0000","last_change":"2024-02-19T21:33:38.348440+0000","last_active":"2024-02-19T21:34:14.541378+0000","last_peered":"2024-02-19T21:34:14.541378+0000","last_clean":"2024-02-19T21:34:14.541378+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:34:14.541378+0000","last_undegraded":"2024-02-19T21:34:14.541378+0000","last_fullsized":"2024-02-19T21:34:14.541378+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:33:38.348364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:38.348364+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.383261+0000","last_change":"2024-02-19T21:34:12.642234+0000","last_active":"2024-02-19T21:34:15.383261+0000","last_peered":"2024-02-19T21:34:15.383261+0000","last_clean":"2024-02-19T21:34:15.383261+0000","last_became_active":"2024-02-19T21:32:29.373648+0000","last_became_peered":"2024-02-19T21:32:29.373648+0000","last_unstale":"2024-02-19T21:34:15.383261+0000","last_undegraded":"2024-02-19T21:34:15.383261+0000","last_fullsized":"2024-02-19T21:34:15.383261+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:12.642155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:12.642155+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.383871+0000","last_change":"2024-02-19T21:34:07.478398+0000","last_active":"2024-02-19T21:34:15.383871+0000","last_peered":"2024-02-19T21:34:15.383871+0000","last_clean":"2024-02-19T21:34:15.383871+0000","last_became_active":"2024-02-19T21:32:27.370308+0000","last_became_peered":"2024-02-19T21:32:27.370308+0000","last_unstale":"2024-02-19T21:34:15.383871+0000","last_undegraded":"2024-02-19T21:34:15.383871+0000","last_fullsized":"2024-02-19T21:34:15.383871+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:07.478319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:07.478319+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.383203+0000","last_change":"2024-02-19T21:34:00.532471+0000","last_active":"2024-02-19T21:34:15.383203+0000","last_peered":"2024-02-19T21:34:15.383203+0000","last_clean":"2024-02-19T21:34:15.383203+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:34:15.383203+0000","last_undegraded":"2024-02-19T21:34:15.383203+0000","last_fullsized":"2024-02-19T21:34:15.383203+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:00.532402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:00.532402+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"66'5","reported_seq":70,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541782+0000","last_change":"2024-02-19T21:33:50.926690+0000","last_active":"2024-02-19T21:34:14.541782+0000","last_peered":"2024-02-19T21:34:14.541782+0000","last_clean":"2024-02-19T21:34:14.541782+0000","last_became_active":"2024-02-19T21:33:50.753208+0000","last_became_peered":"2024-02-19T21:33:50.753208+0000","last_unstale":"2024-02-19T21:34:14.541782+0000","last_undegraded":"2024-02-19T21:34:14.541782+0000","last_fullsized":"2024-02-19T21:34:14.541782+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'5","last_scrub_stamp":"2024-02-19T21:33:26.173202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:26.173202+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542778+0000","last_change":"2024-02-19T21:34:13.751793+0000","last_active":"2024-02-19T21:34:14.542778+0000","last_peered":"2024-02-19T21:34:14.542778+0000","last_clean":"2024-02-19T21:34:14.542778+0000","last_became_active":"2024-02-19T21:32:29.373010+0000","last_became_peered":"2024-02-19T21:32:29.373010+0000","last_unstale":"2024-02-19T21:34:14.542778+0000","last_undegraded":"2024-02-19T21:34:14.542778+0000","last_fullsized":"2024-02-19T21:34:14.542778+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:34:13.751725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:13.751725+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.383883+0000","last_change":"2024-02-19T21:33:46.543340+0000","last_active":"2024-02-19T21:34:15.383883+0000","last_peered":"2024-02-19T21:34:15.383883+0000","last_clean":"2024-02-19T21:34:15.383883+0000","last_became_active":"2024-02-19T21:32:27.368241+0000","last_became_peered":"2024-02-19T21:32:27.368241+0000","last_unstale":"2024-02-19T21:34:15.383883+0000","last_undegraded":"2024-02-19T21:34:15.383883+0000","last_fullsized":"2024-02-19T21:34:15.383883+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:46.543259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:46.543259+0000","last_clean_scrub_stamp":"2024-02-19T21:33:46.543259+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.383330+0000","last_change":"2024-02-19T21:33:31.418127+0000","last_active":"2024-02-19T21:34:15.383330+0000","last_peered":"2024-02-19T21:34:15.383330+0000","last_clean":"2024-02-19T21:34:15.383330+0000","last_became_active":"2024-02-19T21:32:23.357179+0000","last_became_peered":"2024-02-19T21:32:23.357179+0000","last_unstale":"2024-02-19T21:34:15.383330+0000","last_undegraded":"2024-02-19T21:34:15.383330+0000","last_fullsized":"2024-02-19T21:34:15.383330+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:31.418051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:31.418051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"89'13","reported_seq":65,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541500+0000","last_change":"2024-02-19T21:34:07.313636+0000","last_active":"2024-02-19T21:34:14.541500+0000","last_peered":"2024-02-19T21:34:14.541500+0000","last_clean":"2024-02-19T21:34:14.541500+0000","last_became_active":"2024-02-19T21:32:25.364237+0000","last_became_peered":"2024-02-19T21:32:25.364237+0000","last_unstale":"2024-02-19T21:34:14.541500+0000","last_undegraded":"2024-02-19T21:34:14.541500+0000","last_fullsized":"2024-02-19T21:34:14.541500+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'13","last_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:34:07.313566+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:20.569229+0000","last_change":"2024-02-19T21:34:20.569197+0000","last_active":"2024-02-19T21:34:20.569229+0000","last_peered":"2024-02-19T21:34:20.569229+0000","last_clean":"2024-02-19T21:34:20.569229+0000","last_became_active":"2024-02-19T21:32:29.597266+0000","last_became_peered":"2024-02-19T21:32:29.597266+0000","last_unstale":"2024-02-19T21:34:20.569229+0000","last_undegraded":"2024-02-19T21:34:20.569229+0000","last_fullsized":"2024-02-19T21:34:20.569229+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:20.569124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:20.569124+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541843+0000","last_change":"2024-02-19T21:34:13.418409+0000","last_active":"2024-02-19T21:34:14.541843+0000","last_peered":"2024-02-19T21:34:14.541843+0000","last_clean":"2024-02-19T21:34:14.541843+0000","last_became_active":"2024-02-19T21:32:27.368233+0000","last_became_peered":"2024-02-19T21:32:27.368233+0000","last_unstale":"2024-02-19T21:34:14.541843+0000","last_undegraded":"2024-02-19T21:34:14.541843+0000","last_fullsized":"2024-02-19T21:34:14.541843+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:13.418325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:13.418325+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":55,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542865+0000","last_change":"2024-02-19T21:33:55.409204+0000","last_active":"2024-02-19T21:34:14.542865+0000","last_peered":"2024-02-19T21:34:14.542865+0000","last_clean":"2024-02-19T21:34:14.542865+0000","last_became_active":"2024-02-19T21:33:50.753994+0000","last_became_peered":"2024-02-19T21:33:50.753994+0000","last_unstale":"2024-02-19T21:34:14.542865+0000","last_undegraded":"2024-02-19T21:34:14.542865+0000","last_fullsized":"2024-02-19T21:34:14.542865+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:55.409142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:55.409142+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"66'12","reported_seq":67,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541158+0000","last_change":"2024-02-19T21:34:04.494293+0000","last_active":"2024-02-19T21:34:14.541158+0000","last_peered":"2024-02-19T21:34:14.541158+0000","last_clean":"2024-02-19T21:34:14.541158+0000","last_became_active":"2024-02-19T21:32:25.369040+0000","last_became_peered":"2024-02-19T21:32:25.369040+0000","last_unstale":"2024-02-19T21:34:14.541158+0000","last_undegraded":"2024-02-19T21:34:14.541158+0000","last_fullsized":"2024-02-19T21:34:14.541158+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'12","last_scrub_stamp":"2024-02-19T21:34:04.494227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:04.494227+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542069+0000","last_change":"2024-02-19T21:33:45.418945+0000","last_active":"2024-02-19T21:34:14.542069+0000","last_peered":"2024-02-19T21:34:14.542069+0000","last_clean":"2024-02-19T21:34:14.542069+0000","last_became_active":"2024-02-19T21:32:29.597365+0000","last_became_peered":"2024-02-19T21:32:29.597365+0000","last_unstale":"2024-02-19T21:34:14.542069+0000","last_undegraded":"2024-02-19T21:34:14.542069+0000","last_fullsized":"2024-02-19T21:34:14.542069+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:45.418867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:45.418867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:17.809341+0000","last_change":"2024-02-19T21:34:17.809314+0000","last_active":"2024-02-19T21:34:17.809341+0000","last_peered":"2024-02-19T21:34:17.809341+0000","last_clean":"2024-02-19T21:34:17.809341+0000","last_became_active":"2024-02-19T21:32:27.369757+0000","last_became_peered":"2024-02-19T21:32:27.369757+0000","last_unstale":"2024-02-19T21:34:17.809341+0000","last_undegraded":"2024-02-19T21:34:17.809341+0000","last_fullsized":"2024-02-19T21:34:17.809341+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:17.809245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:17.809245+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:39.022454+0000","last_change":"2024-02-19T21:34:39.022454+0000","last_active":"2024-02-19T21:34:39.022454+0000","last_peered":"2024-02-19T21:34:39.022454+0000","last_clean":"2024-02-19T21:34:39.022454+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:34:39.022454+0000","last_undegraded":"2024-02-19T21:34:39.022454+0000","last_fullsized":"2024-02-19T21:34:39.022454+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:39.022344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:39.022344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"66'15","reported_seq":69,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.209302+0000","last_change":"2024-02-19T21:33:40.215778+0000","last_active":"2024-02-19T21:34:15.209302+0000","last_peered":"2024-02-19T21:34:15.209302+0000","last_clean":"2024-02-19T21:34:15.209302+0000","last_became_active":"2024-02-19T21:32:25.365267+0000","last_became_peered":"2024-02-19T21:32:25.365267+0000","last_unstale":"2024-02-19T21:34:15.209302+0000","last_undegraded":"2024-02-19T21:34:15.209302+0000","last_fullsized":"2024-02-19T21:34:15.209302+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:33:40.215704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:40.215704+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:34.776259+0000","last_change":"2024-02-19T21:34:34.776259+0000","last_active":"2024-02-19T21:34:34.776259+0000","last_peered":"2024-02-19T21:34:34.776259+0000","last_clean":"2024-02-19T21:34:34.776259+0000","last_became_active":"2024-02-19T21:32:29.373361+0000","last_became_peered":"2024-02-19T21:32:29.373361+0000","last_unstale":"2024-02-19T21:34:34.776259+0000","last_undegraded":"2024-02-19T21:34:34.776259+0000","last_fullsized":"2024-02-19T21:34:34.776259+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:34.776190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:34.776190+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542112+0000","last_change":"2024-02-19T21:33:49.602701+0000","last_active":"2024-02-19T21:34:14.542112+0000","last_peered":"2024-02-19T21:34:14.542112+0000","last_clean":"2024-02-19T21:34:14.542112+0000","last_became_active":"2024-02-19T21:32:27.367741+0000","last_became_peered":"2024-02-19T21:32:27.367741+0000","last_unstale":"2024-02-19T21:34:14.542112+0000","last_undegraded":"2024-02-19T21:34:14.542112+0000","last_fullsized":"2024-02-19T21:34:14.542112+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:49.602639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:49.602639+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541726+0000","last_change":"2024-02-19T21:34:10.565228+0000","last_active":"2024-02-19T21:34:14.541726+0000","last_peered":"2024-02-19T21:34:14.541726+0000","last_clean":"2024-02-19T21:34:14.541726+0000","last_became_active":"2024-02-19T21:32:23.355085+0000","last_became_peered":"2024-02-19T21:32:23.355085+0000","last_unstale":"2024-02-19T21:34:14.541726+0000","last_undegraded":"2024-02-19T21:34:14.541726+0000","last_fullsized":"2024-02-19T21:34:14.541726+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:10.565163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:10.565163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"66'11","reported_seq":63,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.002341+0000","last_change":"2024-02-19T21:33:42.173352+0000","last_active":"2024-02-19T21:34:15.002341+0000","last_peered":"2024-02-19T21:34:15.002341+0000","last_clean":"2024-02-19T21:34:15.002341+0000","last_became_active":"2024-02-19T21:32:25.355939+0000","last_became_peered":"2024-02-19T21:32:25.355939+0000","last_unstale":"2024-02-19T21:34:15.002341+0000","last_undegraded":"2024-02-19T21:34:15.002341+0000","last_fullsized":"2024-02-19T21:34:15.002341+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:33:42.173259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:42.173259+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.384408+0000","last_change":"2024-02-19T21:33:49.401282+0000","last_active":"2024-02-19T21:34:15.384408+0000","last_peered":"2024-02-19T21:34:15.384408+0000","last_clean":"2024-02-19T21:34:15.384408+0000","last_became_active":"2024-02-19T21:32:29.372503+0000","last_became_peered":"2024-02-19T21:32:29.372503+0000","last_unstale":"2024-02-19T21:34:15.384408+0000","last_undegraded":"2024-02-19T21:34:15.384408+0000","last_fullsized":"2024-02-19T21:34:15.384408+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:33:49.401203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:49.401203+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"66'8","reported_seq":80,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:31.866028+0000","last_change":"2024-02-19T21:33:43.197645+0000","last_active":"2024-02-19T21:34:31.866028+0000","last_peered":"2024-02-19T21:34:31.866028+0000","last_clean":"2024-02-19T21:34:31.866028+0000","last_became_active":"2024-02-19T21:32:27.366465+0000","last_became_peered":"2024-02-19T21:32:27.366465+0000","last_unstale":"2024-02-19T21:34:31.866028+0000","last_undegraded":"2024-02-19T21:34:31.866028+0000","last_fullsized":"2024-02-19T21:34:31.866028+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:33:43.197552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:43.197552+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:31.724113+0000","last_change":"2024-02-19T21:34:31.724113+0000","last_active":"2024-02-19T21:34:31.724113+0000","last_peered":"2024-02-19T21:34:31.724113+0000","last_clean":"2024-02-19T21:34:31.724113+0000","last_became_active":"2024-02-19T21:32:23.356323+0000","last_became_peered":"2024-02-19T21:32:23.356323+0000","last_unstale":"2024-02-19T21:34:31.724113+0000","last_undegraded":"2024-02-19T21:34:31.724113+0000","last_fullsized":"2024-02-19T21:34:31.724113+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:31.724027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:31.724027+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"66'10","reported_seq":60,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542016+0000","last_change":"2024-02-19T21:33:31.630440+0000","last_active":"2024-02-19T21:34:14.542016+0000","last_peered":"2024-02-19T21:34:14.542016+0000","last_clean":"2024-02-19T21:34:14.542016+0000","last_became_active":"2024-02-19T21:32:25.372236+0000","last_became_peered":"2024-02-19T21:32:25.372236+0000","last_unstale":"2024-02-19T21:34:14.542016+0000","last_undegraded":"2024-02-19T21:34:14.542016+0000","last_fullsized":"2024-02-19T21:34:14.542016+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:33:31.630368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:31.630368+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.543022+0000","last_change":"2024-02-19T21:33:58.442925+0000","last_active":"2024-02-19T21:34:14.543022+0000","last_peered":"2024-02-19T21:34:14.543022+0000","last_clean":"2024-02-19T21:34:14.543022+0000","last_became_active":"2024-02-19T21:32:29.599396+0000","last_became_peered":"2024-02-19T21:32:29.599396+0000","last_unstale":"2024-02-19T21:34:14.543022+0000","last_undegraded":"2024-02-19T21:34:14.543022+0000","last_fullsized":"2024-02-19T21:34:14.543022+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:58.442855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:58.442855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.383675+0000","last_change":"2024-02-19T21:34:03.457957+0000","last_active":"2024-02-19T21:34:15.383675+0000","last_peered":"2024-02-19T21:34:15.383675+0000","last_clean":"2024-02-19T21:34:15.383675+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:34:15.383675+0000","last_undegraded":"2024-02-19T21:34:15.383675+0000","last_fullsized":"2024-02-19T21:34:15.383675+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:34:03.457856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.002439+0000","last_change":"2024-02-19T21:33:31.153117+0000","last_active":"2024-02-19T21:34:15.002439+0000","last_peered":"2024-02-19T21:34:15.002439+0000","last_clean":"2024-02-19T21:34:15.002439+0000","last_became_active":"2024-02-19T21:32:23.355525+0000","last_became_peered":"2024-02-19T21:32:23.355525+0000","last_unstale":"2024-02-19T21:34:15.002439+0000","last_undegraded":"2024-02-19T21:34:15.002439+0000","last_fullsized":"2024-02-19T21:34:15.002439+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:31.153022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:31.153022+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"66'11","reported_seq":63,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541916+0000","last_change":"2024-02-19T21:33:28.595457+0000","last_active":"2024-02-19T21:34:14.541916+0000","last_peered":"2024-02-19T21:34:14.541916+0000","last_clean":"2024-02-19T21:34:14.541916+0000","last_became_active":"2024-02-19T21:32:25.372039+0000","last_became_peered":"2024-02-19T21:32:25.372039+0000","last_unstale":"2024-02-19T21:34:14.541916+0000","last_undegraded":"2024-02-19T21:34:14.541916+0000","last_fullsized":"2024-02-19T21:34:14.541916+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:33:28.595355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:28.595355+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.383609+0000","last_change":"2024-02-19T21:34:01.539989+0000","last_active":"2024-02-19T21:34:15.383609+0000","last_peered":"2024-02-19T21:34:15.383609+0000","last_clean":"2024-02-19T21:34:15.383609+0000","last_became_active":"2024-02-19T21:32:29.372163+0000","last_became_peered":"2024-02-19T21:32:29.372163+0000","last_unstale":"2024-02-19T21:34:15.383609+0000","last_undegraded":"2024-02-19T21:34:15.383609+0000","last_fullsized":"2024-02-19T21:34:15.383609+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:34:01.539921+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.001668+0000","last_change":"2024-02-19T21:33:28.116929+0000","last_active":"2024-02-19T21:34:15.001668+0000","last_peered":"2024-02-19T21:34:15.001668+0000","last_clean":"2024-02-19T21:34:15.001668+0000","last_became_active":"2024-02-19T21:32:27.366281+0000","last_became_peered":"2024-02-19T21:32:27.366281+0000","last_unstale":"2024-02-19T21:34:15.001668+0000","last_undegraded":"2024-02-19T21:34:15.001668+0000","last_fullsized":"2024-02-19T21:34:15.001668+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:28.116860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:28.116860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.382763+0000","last_change":"2024-02-19T21:34:08.543506+0000","last_active":"2024-02-19T21:34:15.382763+0000","last_peered":"2024-02-19T21:34:15.382763+0000","last_clean":"2024-02-19T21:34:15.382763+0000","last_became_active":"2024-02-19T21:32:23.355103+0000","last_became_peered":"2024-02-19T21:32:23.355103+0000","last_unstale":"2024-02-19T21:34:15.382763+0000","last_undegraded":"2024-02-19T21:34:15.382763+0000","last_fullsized":"2024-02-19T21:34:15.382763+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:08.543422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:08.543422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"66'4","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.540942+0000","last_change":"2024-02-19T21:34:07.518745+0000","last_active":"2024-02-19T21:34:14.540942+0000","last_peered":"2024-02-19T21:34:14.540942+0000","last_clean":"2024-02-19T21:34:14.540942+0000","last_became_active":"2024-02-19T21:32:25.369139+0000","last_became_peered":"2024-02-19T21:32:25.369139+0000","last_unstale":"2024-02-19T21:34:14.540942+0000","last_undegraded":"2024-02-19T21:34:14.540942+0000","last_fullsized":"2024-02-19T21:34:14.540942+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'4","last_scrub_stamp":"2024-02-19T21:34:07.518657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:07.518657+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541576+0000","last_change":"2024-02-19T21:34:05.506026+0000","last_active":"2024-02-19T21:34:14.541576+0000","last_peered":"2024-02-19T21:34:14.541576+0000","last_clean":"2024-02-19T21:34:14.541576+0000","last_became_active":"2024-02-19T21:32:29.377302+0000","last_became_peered":"2024-02-19T21:32:29.377302+0000","last_unstale":"2024-02-19T21:34:14.541576+0000","last_undegraded":"2024-02-19T21:34:14.541576+0000","last_fullsized":"2024-02-19T21:34:14.541576+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:05.505905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:05.505905+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.738738+0000","last_change":"2024-02-19T21:34:24.738692+0000","last_active":"2024-02-19T21:34:24.738738+0000","last_peered":"2024-02-19T21:34:24.738738+0000","last_clean":"2024-02-19T21:34:24.738738+0000","last_became_active":"2024-02-19T21:32:27.374451+0000","last_became_peered":"2024-02-19T21:32:27.374451+0000","last_unstale":"2024-02-19T21:34:24.738738+0000","last_undegraded":"2024-02-19T21:34:24.738738+0000","last_fullsized":"2024-02-19T21:34:24.738738+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:24.738612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:24.738612+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.758235+0000","last_change":"2024-02-19T21:33:52.933780+0000","last_active":"2024-02-19T21:34:14.758235+0000","last_peered":"2024-02-19T21:34:14.758235+0000","last_clean":"2024-02-19T21:34:14.758235+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:34:14.758235+0000","last_undegraded":"2024-02-19T21:34:14.758235+0000","last_fullsized":"2024-02-19T21:34:14.758235+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:33:52.933689+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"66'11","reported_seq":64,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541700+0000","last_change":"2024-02-19T21:33:30.232415+0000","last_active":"2024-02-19T21:34:14.541700+0000","last_peered":"2024-02-19T21:34:14.541700+0000","last_clean":"2024-02-19T21:34:14.541700+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:34:14.541700+0000","last_undegraded":"2024-02-19T21:34:14.541700+0000","last_fullsized":"2024-02-19T21:34:14.541700+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:33:30.232291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:30.232291+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542439+0000","last_change":"2024-02-19T21:33:42.527908+0000","last_active":"2024-02-19T21:34:14.542439+0000","last_peered":"2024-02-19T21:34:14.542439+0000","last_clean":"2024-02-19T21:34:14.542439+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:34:14.542439+0000","last_undegraded":"2024-02-19T21:34:14.542439+0000","last_fullsized":"2024-02-19T21:34:14.542439+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:42.527849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:42.527849+0000","last_clean_scrub_stamp":"2024-02-19T21:33:42.527849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.560525+0000","last_change":"2024-02-19T21:34:15.560500+0000","last_active":"2024-02-19T21:34:15.560525+0000","last_peered":"2024-02-19T21:34:15.560525+0000","last_clean":"2024-02-19T21:34:15.560525+0000","last_became_active":"2024-02-19T21:32:27.369279+0000","last_became_peered":"2024-02-19T21:32:27.369279+0000","last_unstale":"2024-02-19T21:34:15.560525+0000","last_undegraded":"2024-02-19T21:34:15.560525+0000","last_fullsized":"2024-02-19T21:34:15.560525+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:15.560432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:15.560432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.001961+0000","last_change":"2024-02-19T21:33:44.209744+0000","last_active":"2024-02-19T21:34:15.001961+0000","last_peered":"2024-02-19T21:34:15.001961+0000","last_clean":"2024-02-19T21:34:15.001961+0000","last_became_active":"2024-02-19T21:32:23.357338+0000","last_became_peered":"2024-02-19T21:32:23.357338+0000","last_unstale":"2024-02-19T21:34:15.001961+0000","last_undegraded":"2024-02-19T21:34:15.001961+0000","last_fullsized":"2024-02-19T21:34:15.001961+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:44.209646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:44.209646+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"66'9","reported_seq":61,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.757627+0000","last_change":"2024-02-19T21:34:10.712156+0000","last_active":"2024-02-19T21:34:14.757627+0000","last_peered":"2024-02-19T21:34:14.757627+0000","last_clean":"2024-02-19T21:34:14.757627+0000","last_became_active":"2024-02-19T21:32:25.359777+0000","last_became_peered":"2024-02-19T21:32:25.359777+0000","last_unstale":"2024-02-19T21:34:14.757627+0000","last_undegraded":"2024-02-19T21:34:14.757627+0000","last_fullsized":"2024-02-19T21:34:14.757627+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:34:10.712079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:10.712079+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542319+0000","last_change":"2024-02-19T21:33:49.388307+0000","last_active":"2024-02-19T21:34:14.542319+0000","last_peered":"2024-02-19T21:34:14.542319+0000","last_clean":"2024-02-19T21:34:14.542319+0000","last_became_active":"2024-02-19T21:32:29.371406+0000","last_became_peered":"2024-02-19T21:32:29.371406+0000","last_unstale":"2024-02-19T21:34:14.542319+0000","last_undegraded":"2024-02-19T21:34:14.542319+0000","last_fullsized":"2024-02-19T21:34:14.542319+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:49.388220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:49.388220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"66'8","reported_seq":77,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:31.865927+0000","last_change":"2024-02-19T21:34:17.563543+0000","last_active":"2024-02-19T21:34:31.865927+0000","last_peered":"2024-02-19T21:34:31.865927+0000","last_clean":"2024-02-19T21:34:31.865927+0000","last_became_active":"2024-02-19T21:32:27.365865+0000","last_became_peered":"2024-02-19T21:32:27.365865+0000","last_unstale":"2024-02-19T21:34:31.865927+0000","last_undegraded":"2024-02-19T21:34:31.865927+0000","last_fullsized":"2024-02-19T21:34:31.865927+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:34:17.563474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:17.563474+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542235+0000","last_change":"2024-02-19T21:33:33.550724+0000","last_active":"2024-02-19T21:34:14.542235+0000","last_peered":"2024-02-19T21:34:14.542235+0000","last_clean":"2024-02-19T21:34:14.542235+0000","last_became_active":"2024-02-19T21:32:23.361680+0000","last_became_peered":"2024-02-19T21:32:23.361680+0000","last_unstale":"2024-02-19T21:34:14.542235+0000","last_undegraded":"2024-02-19T21:34:14.542235+0000","last_fullsized":"2024-02-19T21:34:14.542235+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:33.550655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:33.550655+0000","last_clean_scrub_stamp":"2024-02-19T21:33:33.550655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"66'9","reported_seq":60,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.384391+0000","last_change":"2024-02-19T21:33:28.598343+0000","last_active":"2024-02-19T21:34:15.384391+0000","last_peered":"2024-02-19T21:34:15.384391+0000","last_clean":"2024-02-19T21:34:15.384391+0000","last_became_active":"2024-02-19T21:32:25.372206+0000","last_became_peered":"2024-02-19T21:32:25.372206+0000","last_unstale":"2024-02-19T21:34:15.384391+0000","last_undegraded":"2024-02-19T21:34:15.384391+0000","last_fullsized":"2024-02-19T21:34:15.384391+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:33:28.598281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:28.598281+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541643+0000","last_change":"2024-02-19T21:33:35.526933+0000","last_active":"2024-02-19T21:34:14.541643+0000","last_peered":"2024-02-19T21:34:14.541643+0000","last_clean":"2024-02-19T21:34:14.541643+0000","last_became_active":"2024-02-19T21:32:29.376980+0000","last_became_peered":"2024-02-19T21:32:29.376980+0000","last_unstale":"2024-02-19T21:34:14.541643+0000","last_undegraded":"2024-02-19T21:34:14.541643+0000","last_fullsized":"2024-02-19T21:34:14.541643+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:35.526865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:35.526865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"66'8","reported_seq":77,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:31.866032+0000","last_change":"2024-02-19T21:33:47.554077+0000","last_active":"2024-02-19T21:34:31.866032+0000","last_peered":"2024-02-19T21:34:31.866032+0000","last_clean":"2024-02-19T21:34:31.866032+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:34:31.866032+0000","last_undegraded":"2024-02-19T21:34:31.866032+0000","last_fullsized":"2024-02-19T21:34:31.866032+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:33:47.553965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:47.553965+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.382639+0000","last_change":"2024-02-19T21:33:32.648024+0000","last_active":"2024-02-19T21:34:15.382639+0000","last_peered":"2024-02-19T21:34:15.382639+0000","last_clean":"2024-02-19T21:34:15.382639+0000","last_became_active":"2024-02-19T21:32:23.360838+0000","last_became_peered":"2024-02-19T21:32:23.360838+0000","last_unstale":"2024-02-19T21:34:15.382639+0000","last_undegraded":"2024-02-19T21:34:15.382639+0000","last_fullsized":"2024-02-19T21:34:15.382639+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:32.647912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:32.647912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"66'10","reported_seq":59,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542021+0000","last_change":"2024-02-19T21:34:03.508324+0000","last_active":"2024-02-19T21:34:14.542021+0000","last_peered":"2024-02-19T21:34:14.542021+0000","last_clean":"2024-02-19T21:34:14.542021+0000","last_became_active":"2024-02-19T21:32:25.372060+0000","last_became_peered":"2024-02-19T21:32:25.372060+0000","last_unstale":"2024-02-19T21:34:14.542021+0000","last_undegraded":"2024-02-19T21:34:14.542021+0000","last_fullsized":"2024-02-19T21:34:14.542021+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:34:03.508256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:03.508256+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.384150+0000","last_change":"2024-02-19T21:33:43.433355+0000","last_active":"2024-02-19T21:34:15.384150+0000","last_peered":"2024-02-19T21:34:15.384150+0000","last_clean":"2024-02-19T21:34:15.384150+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:34:15.384150+0000","last_undegraded":"2024-02-19T21:34:15.384150+0000","last_fullsized":"2024-02-19T21:34:15.384150+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:43.433289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:43.433289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.667508+0000","last_change":"2024-02-19T21:34:15.667458+0000","last_active":"2024-02-19T21:34:15.667508+0000","last_peered":"2024-02-19T21:34:15.667508+0000","last_clean":"2024-02-19T21:34:15.667508+0000","last_became_active":"2024-02-19T21:32:27.369002+0000","last_became_peered":"2024-02-19T21:32:27.369002+0000","last_unstale":"2024-02-19T21:34:15.667508+0000","last_undegraded":"2024-02-19T21:34:15.667508+0000","last_fullsized":"2024-02-19T21:34:15.667508+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:15.667380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:15.667380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.001702+0000","last_change":"2024-02-19T21:33:35.277987+0000","last_active":"2024-02-19T21:34:15.001702+0000","last_peered":"2024-02-19T21:34:15.001702+0000","last_clean":"2024-02-19T21:34:15.001702+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:34:15.001702+0000","last_undegraded":"2024-02-19T21:34:15.001702+0000","last_fullsized":"2024-02-19T21:34:15.001702+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:35.277904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:35.277904+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"66'6","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:27.480792+0000","last_change":"2024-02-19T21:34:27.480792+0000","last_active":"2024-02-19T21:34:27.480792+0000","last_peered":"2024-02-19T21:34:27.480792+0000","last_clean":"2024-02-19T21:34:27.480792+0000","last_became_active":"2024-02-19T21:32:25.372212+0000","last_became_peered":"2024-02-19T21:32:25.372212+0000","last_unstale":"2024-02-19T21:34:27.480792+0000","last_undegraded":"2024-02-19T21:34:27.480792+0000","last_fullsized":"2024-02-19T21:34:27.480792+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'6","last_scrub_stamp":"2024-02-19T21:34:27.480723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:27.480723+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.209072+0000","last_change":"2024-02-19T21:34:11.111909+0000","last_active":"2024-02-19T21:34:15.209072+0000","last_peered":"2024-02-19T21:34:15.209072+0000","last_clean":"2024-02-19T21:34:15.209072+0000","last_became_active":"2024-02-19T21:32:29.371977+0000","last_became_peered":"2024-02-19T21:32:29.371977+0000","last_unstale":"2024-02-19T21:34:15.209072+0000","last_undegraded":"2024-02-19T21:34:15.209072+0000","last_fullsized":"2024-02-19T21:34:15.209072+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:11.111829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:11.111829+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.527434+0000","last_change":"2024-02-19T21:34:24.527387+0000","last_active":"2024-02-19T21:34:24.527434+0000","last_peered":"2024-02-19T21:34:24.527434+0000","last_clean":"2024-02-19T21:34:24.527434+0000","last_became_active":"2024-02-19T21:32:27.366748+0000","last_became_peered":"2024-02-19T21:32:27.366748+0000","last_unstale":"2024-02-19T21:34:24.527434+0000","last_undegraded":"2024-02-19T21:34:24.527434+0000","last_fullsized":"2024-02-19T21:34:24.527434+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:24.527285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:24.527285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.208843+0000","last_change":"2024-02-19T21:33:32.121300+0000","last_active":"2024-02-19T21:34:15.208843+0000","last_peered":"2024-02-19T21:34:15.208843+0000","last_clean":"2024-02-19T21:34:15.208843+0000","last_became_active":"2024-02-19T21:32:23.358939+0000","last_became_peered":"2024-02-19T21:32:23.358939+0000","last_unstale":"2024-02-19T21:34:15.208843+0000","last_undegraded":"2024-02-19T21:34:15.208843+0000","last_fullsized":"2024-02-19T21:34:15.208843+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:33:32.121205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"66'9","reported_seq":61,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541819+0000","last_change":"2024-02-19T21:33:39.539536+0000","last_active":"2024-02-19T21:34:14.541819+0000","last_peered":"2024-02-19T21:34:14.541819+0000","last_clean":"2024-02-19T21:34:14.541819+0000","last_became_active":"2024-02-19T21:32:25.372106+0000","last_became_peered":"2024-02-19T21:32:25.372106+0000","last_unstale":"2024-02-19T21:34:14.541819+0000","last_undegraded":"2024-02-19T21:34:14.541819+0000","last_fullsized":"2024-02-19T21:34:14.541819+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:33:39.539467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:39.539467+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542973+0000","last_change":"2024-02-19T21:33:42.435113+0000","last_active":"2024-02-19T21:34:14.542973+0000","last_peered":"2024-02-19T21:34:14.542973+0000","last_clean":"2024-02-19T21:34:14.542973+0000","last_became_active":"2024-02-19T21:32:29.376027+0000","last_became_peered":"2024-02-19T21:32:29.376027+0000","last_unstale":"2024-02-19T21:34:14.542973+0000","last_undegraded":"2024-02-19T21:34:14.542973+0000","last_fullsized":"2024-02-19T21:34:14.542973+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:42.435033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:42.435033+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"59'2","reported_seq":60,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542202+0000","last_change":"2024-02-19T21:33:59.315758+0000","last_active":"2024-02-19T21:34:14.542202+0000","last_peered":"2024-02-19T21:34:14.542202+0000","last_clean":"2024-02-19T21:34:14.542202+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:34:14.542202+0000","last_undegraded":"2024-02-19T21:34:14.542202+0000","last_fullsized":"2024-02-19T21:34:14.542202+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-02-19T21:33:59.315689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:59.315689+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"83'17","reported_seq":73,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541463+0000","last_change":"2024-02-19T21:33:43.418544+0000","last_active":"2024-02-19T21:34:14.541463+0000","last_peered":"2024-02-19T21:34:14.541463+0000","last_clean":"2024-02-19T21:34:14.541463+0000","last_became_active":"2024-02-19T21:32:25.366999+0000","last_became_peered":"2024-02-19T21:32:25.366999+0000","last_unstale":"2024-02-19T21:34:14.541463+0000","last_undegraded":"2024-02-19T21:34:14.541463+0000","last_fullsized":"2024-02-19T21:34:14.541463+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'17","last_scrub_stamp":"2024-02-19T21:33:43.418450+0000","last_deep_scrub":"83'17","last_deep_scrub_stamp":"2024-02-19T21:33:43.418450+0000","last_clean_scrub_stamp":"2024-02-19T21:33:43.418450+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.250716+0000","last_change":"2024-02-19T21:34:15.250680+0000","last_active":"2024-02-19T21:34:15.250716+0000","last_peered":"2024-02-19T21:34:15.250716+0000","last_clean":"2024-02-19T21:34:15.250716+0000","last_became_active":"2024-02-19T21:32:27.367022+0000","last_became_peered":"2024-02-19T21:32:27.367022+0000","last_unstale":"2024-02-19T21:34:15.250716+0000","last_undegraded":"2024-02-19T21:34:15.250716+0000","last_fullsized":"2024-02-19T21:34:15.250716+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:15.250615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:15.250615+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542485+0000","last_change":"2024-02-19T21:33:47.550627+0000","last_active":"2024-02-19T21:34:14.542485+0000","last_peered":"2024-02-19T21:34:14.542485+0000","last_clean":"2024-02-19T21:34:14.542485+0000","last_became_active":"2024-02-19T21:32:29.374999+0000","last_became_peered":"2024-02-19T21:32:29.374999+0000","last_unstale":"2024-02-19T21:34:14.542485+0000","last_undegraded":"2024-02-19T21:34:14.542485+0000","last_fullsized":"2024-02-19T21:34:14.542485+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:47.550562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:47.550562+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.758021+0000","last_change":"2024-02-19T21:34:07.772488+0000","last_active":"2024-02-19T21:34:14.758021+0000","last_peered":"2024-02-19T21:34:14.758021+0000","last_clean":"2024-02-19T21:34:14.758021+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:34:14.758021+0000","last_undegraded":"2024-02-19T21:34:14.758021+0000","last_fullsized":"2024-02-19T21:34:14.758021+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:07.772420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:07.772420+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"66'10","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.208625+0000","last_change":"2024-02-19T21:33:55.131166+0000","last_active":"2024-02-19T21:34:15.208625+0000","last_peered":"2024-02-19T21:34:15.208625+0000","last_clean":"2024-02-19T21:34:15.208625+0000","last_became_active":"2024-02-19T21:33:50.752293+0000","last_became_peered":"2024-02-19T21:33:50.752293+0000","last_unstale":"2024-02-19T21:34:15.208625+0000","last_undegraded":"2024-02-19T21:34:15.208625+0000","last_fullsized":"2024-02-19T21:34:15.208625+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:33:55.131045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:55.131045+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":78,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:31.865897+0000","last_change":"2024-02-19T21:33:56.646321+0000","last_active":"2024-02-19T21:34:31.865897+0000","last_peered":"2024-02-19T21:34:31.865897+0000","last_clean":"2024-02-19T21:34:31.865897+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:34:31.865897+0000","last_undegraded":"2024-02-19T21:34:31.865897+0000","last_fullsized":"2024-02-19T21:34:31.865897+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:33:56.646250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:56.646250+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541378+0000","last_change":"2024-02-19T21:33:30.566865+0000","last_active":"2024-02-19T21:34:14.541378+0000","last_peered":"2024-02-19T21:34:14.541378+0000","last_clean":"2024-02-19T21:34:14.541378+0000","last_became_active":"2024-02-19T21:32:29.372330+0000","last_became_peered":"2024-02-19T21:32:29.372330+0000","last_unstale":"2024-02-19T21:34:14.541378+0000","last_undegraded":"2024-02-19T21:34:14.541378+0000","last_fullsized":"2024-02-19T21:34:14.541378+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:30.566737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:30.566737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:38.714799+0000","last_change":"2024-02-19T21:34:38.714799+0000","last_active":"2024-02-19T21:34:38.714799+0000","last_peered":"2024-02-19T21:34:38.714799+0000","last_clean":"2024-02-19T21:34:38.714799+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:34:38.714799+0000","last_undegraded":"2024-02-19T21:34:38.714799+0000","last_fullsized":"2024-02-19T21:34:38.714799+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:38.714714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:34:38.714714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"66'28","reported_seq":120,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:31.866140+0000","last_change":"2024-02-19T21:34:09.728029+0000","last_active":"2024-02-19T21:34:31.866140+0000","last_peered":"2024-02-19T21:34:31.866140+0000","last_clean":"2024-02-19T21:34:31.866140+0000","last_became_active":"2024-02-19T21:32:25.367594+0000","last_became_peered":"2024-02-19T21:32:25.367594+0000","last_unstale":"2024-02-19T21:34:31.866140+0000","last_undegraded":"2024-02-19T21:34:31.866140+0000","last_fullsized":"2024-02-19T21:34:31.866140+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'28","last_scrub_stamp":"2024-02-19T21:34:09.727958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:09.727958+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:20.616240+0000","last_change":"2024-02-19T21:34:20.616213+0000","last_active":"2024-02-19T21:34:20.616240+0000","last_peered":"2024-02-19T21:34:20.616240+0000","last_clean":"2024-02-19T21:34:20.616240+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:34:20.616240+0000","last_undegraded":"2024-02-19T21:34:20.616240+0000","last_fullsized":"2024-02-19T21:34:20.616240+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:20.616142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:20.616142+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.384433+0000","last_change":"2024-02-19T21:33:56.450607+0000","last_active":"2024-02-19T21:34:15.384433+0000","last_peered":"2024-02-19T21:34:15.384433+0000","last_clean":"2024-02-19T21:34:15.384433+0000","last_became_active":"2024-02-19T21:32:29.597365+0000","last_became_peered":"2024-02-19T21:32:29.597365+0000","last_unstale":"2024-02-19T21:34:15.384433+0000","last_undegraded":"2024-02-19T21:34:15.384433+0000","last_fullsized":"2024-02-19T21:34:15.384433+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:56.450495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:56.450495+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"67'5","reported_seq":178,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:37.889864+0000","last_change":"2024-02-19T21:33:46.883485+0000","last_active":"2024-02-19T21:34:37.889864+0000","last_peered":"2024-02-19T21:34:37.889864+0000","last_clean":"2024-02-19T21:34:37.889864+0000","last_became_active":"2024-02-19T21:32:23.354539+0000","last_became_peered":"2024-02-19T21:32:23.354539+0000","last_unstale":"2024-02-19T21:34:37.889864+0000","last_undegraded":"2024-02-19T21:34:37.889864+0000","last_fullsized":"2024-02-19T21:34:37.889864+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5","last_scrub_stamp":"2024-02-19T21:33:46.883416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:46.883416+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":128,"num_read_kb":123,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.208796+0000","last_change":"2024-02-19T21:33:25.090459+0000","last_active":"2024-02-19T21:34:15.208796+0000","last_peered":"2024-02-19T21:34:15.208796+0000","last_clean":"2024-02-19T21:34:15.208796+0000","last_became_active":"2024-02-19T21:32:23.358321+0000","last_became_peered":"2024-02-19T21:32:23.358321+0000","last_unstale":"2024-02-19T21:34:15.208796+0000","last_undegraded":"2024-02-19T21:34:15.208796+0000","last_fullsized":"2024-02-19T21:34:15.208796+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:25.090392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:25.090392+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"66'13","reported_seq":72,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.758060+0000","last_change":"2024-02-19T21:33:44.933158+0000","last_active":"2024-02-19T21:34:14.758060+0000","last_peered":"2024-02-19T21:34:14.758060+0000","last_clean":"2024-02-19T21:34:14.758060+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:34:14.758060+0000","last_undegraded":"2024-02-19T21:34:14.758060+0000","last_fullsized":"2024-02-19T21:34:14.758060+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'13","last_scrub_stamp":"2024-02-19T21:33:44.933086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:44.933086+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.209120+0000","last_change":"2024-02-19T21:33:59.141840+0000","last_active":"2024-02-19T21:34:15.209120+0000","last_peered":"2024-02-19T21:34:15.209120+0000","last_clean":"2024-02-19T21:34:15.209120+0000","last_became_active":"2024-02-19T21:32:27.363740+0000","last_became_peered":"2024-02-19T21:32:27.363740+0000","last_unstale":"2024-02-19T21:34:15.209120+0000","last_undegraded":"2024-02-19T21:34:15.209120+0000","last_fullsized":"2024-02-19T21:34:15.209120+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:59.141746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:59.141746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.385029+0000","last_change":"2024-02-19T21:33:49.500303+0000","last_active":"2024-02-19T21:34:15.385029+0000","last_peered":"2024-02-19T21:34:15.385029+0000","last_clean":"2024-02-19T21:34:15.385029+0000","last_became_active":"2024-02-19T21:32:29.372547+0000","last_became_peered":"2024-02-19T21:32:29.372547+0000","last_unstale":"2024-02-19T21:34:15.385029+0000","last_undegraded":"2024-02-19T21:34:15.385029+0000","last_fullsized":"2024-02-19T21:34:15.385029+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:33:49.500205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541030+0000","last_change":"2024-02-19T21:33:35.584787+0000","last_active":"2024-02-19T21:34:14.541030+0000","last_peered":"2024-02-19T21:34:14.541030+0000","last_clean":"2024-02-19T21:34:14.541030+0000","last_became_active":"2024-02-19T21:32:23.356886+0000","last_became_peered":"2024-02-19T21:32:23.356886+0000","last_unstale":"2024-02-19T21:34:14.541030+0000","last_undegraded":"2024-02-19T21:34:14.541030+0000","last_fullsized":"2024-02-19T21:34:14.541030+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:35.584719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:35.584719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.382764+0000","last_change":"2024-02-19T21:33:58.613482+0000","last_active":"2024-02-19T21:34:15.382764+0000","last_peered":"2024-02-19T21:34:15.382764+0000","last_clean":"2024-02-19T21:34:15.382764+0000","last_became_active":"2024-02-19T21:32:23.361163+0000","last_became_peered":"2024-02-19T21:32:23.361163+0000","last_unstale":"2024-02-19T21:34:15.382764+0000","last_undegraded":"2024-02-19T21:34:15.382764+0000","last_fullsized":"2024-02-19T21:34:15.382764+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:58.613390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:58.613390+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.383453+0000","last_change":"2024-02-19T21:34:13.559724+0000","last_active":"2024-02-19T21:34:15.383453+0000","last_peered":"2024-02-19T21:34:15.383453+0000","last_clean":"2024-02-19T21:34:15.383453+0000","last_became_active":"2024-02-19T21:32:16.878022+0000","last_became_peered":"2024-02-19T21:32:16.878022+0000","last_unstale":"2024-02-19T21:34:15.383453+0000","last_undegraded":"2024-02-19T21:34:15.383453+0000","last_fullsized":"2024-02-19T21:34:15.383453+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:13.559611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:34:13.559611+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"66'14","reported_seq":66,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.002142+0000","last_change":"2024-02-19T21:33:47.226393+0000","last_active":"2024-02-19T21:34:15.002142+0000","last_peered":"2024-02-19T21:34:15.002142+0000","last_clean":"2024-02-19T21:34:15.002142+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:34:15.002142+0000","last_undegraded":"2024-02-19T21:34:15.002142+0000","last_fullsized":"2024-02-19T21:34:15.002142+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'14","last_scrub_stamp":"2024-02-19T21:33:47.226311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:47.226311+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.384296+0000","last_change":"2024-02-19T21:33:32.422229+0000","last_active":"2024-02-19T21:34:15.384296+0000","last_peered":"2024-02-19T21:34:15.384296+0000","last_clean":"2024-02-19T21:34:15.384296+0000","last_became_active":"2024-02-19T21:32:27.373579+0000","last_became_peered":"2024-02-19T21:32:27.373579+0000","last_unstale":"2024-02-19T21:34:15.384296+0000","last_undegraded":"2024-02-19T21:34:15.384296+0000","last_fullsized":"2024-02-19T21:34:15.384296+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:32.422149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:32.422149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:28.754654+0000","last_change":"2024-02-19T21:34:28.754654+0000","last_active":"2024-02-19T21:34:28.754654+0000","last_peered":"2024-02-19T21:34:28.754654+0000","last_clean":"2024-02-19T21:34:28.754654+0000","last_became_active":"2024-02-19T21:32:29.373625+0000","last_became_peered":"2024-02-19T21:32:29.373625+0000","last_unstale":"2024-02-19T21:34:28.754654+0000","last_undegraded":"2024-02-19T21:34:28.754654+0000","last_fullsized":"2024-02-19T21:34:28.754654+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:28.754584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:28.754584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541422+0000","last_change":"2024-02-19T21:34:12.757010+0000","last_active":"2024-02-19T21:34:14.541422+0000","last_peered":"2024-02-19T21:34:14.541422+0000","last_clean":"2024-02-19T21:34:14.541422+0000","last_became_active":"2024-02-19T21:32:23.359538+0000","last_became_peered":"2024-02-19T21:32:23.359538+0000","last_unstale":"2024-02-19T21:34:14.541422+0000","last_undegraded":"2024-02-19T21:34:14.541422+0000","last_fullsized":"2024-02-19T21:34:14.541422+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:12.756942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:12.756942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.382588+0000","last_change":"2024-02-19T21:34:02.501610+0000","last_active":"2024-02-19T21:34:15.382588+0000","last_peered":"2024-02-19T21:34:15.382588+0000","last_clean":"2024-02-19T21:34:15.382588+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:34:15.382588+0000","last_undegraded":"2024-02-19T21:34:15.382588+0000","last_fullsized":"2024-02-19T21:34:15.382588+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:02.501526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:02.501526+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"66'12","reported_seq":88,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541731+0000","last_change":"2024-02-19T21:33:55.644754+0000","last_active":"2024-02-19T21:34:14.541731+0000","last_peered":"2024-02-19T21:34:14.541731+0000","last_clean":"2024-02-19T21:34:14.541731+0000","last_became_active":"2024-02-19T21:33:50.750727+0000","last_became_peered":"2024-02-19T21:33:50.750727+0000","last_unstale":"2024-02-19T21:34:14.541731+0000","last_undegraded":"2024-02-19T21:34:14.541731+0000","last_fullsized":"2024-02-19T21:34:14.541731+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'12","last_scrub_stamp":"2024-02-19T21:33:55.644685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:55.644685+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.384939+0000","last_change":"2024-02-19T21:34:11.592972+0000","last_active":"2024-02-19T21:34:15.384939+0000","last_peered":"2024-02-19T21:34:15.384939+0000","last_clean":"2024-02-19T21:34:15.384939+0000","last_became_active":"2024-02-19T21:32:27.372460+0000","last_became_peered":"2024-02-19T21:32:27.372460+0000","last_unstale":"2024-02-19T21:34:15.384939+0000","last_undegraded":"2024-02-19T21:34:15.384939+0000","last_fullsized":"2024-02-19T21:34:15.384939+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:11.592905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:11.592905+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.757365+0000","last_change":"2024-02-19T21:34:04.792894+0000","last_active":"2024-02-19T21:34:14.757365+0000","last_peered":"2024-02-19T21:34:14.757365+0000","last_clean":"2024-02-19T21:34:14.757365+0000","last_became_active":"2024-02-19T21:32:29.597270+0000","last_became_peered":"2024-02-19T21:32:29.597270+0000","last_unstale":"2024-02-19T21:34:14.757365+0000","last_undegraded":"2024-02-19T21:34:14.757365+0000","last_fullsized":"2024-02-19T21:34:14.757365+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:04.792805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:04.792805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.383033+0000","last_change":"2024-02-19T21:33:57.499205+0000","last_active":"2024-02-19T21:34:15.383033+0000","last_peered":"2024-02-19T21:34:15.383033+0000","last_clean":"2024-02-19T21:34:15.383033+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:34:15.383033+0000","last_undegraded":"2024-02-19T21:34:15.383033+0000","last_fullsized":"2024-02-19T21:34:15.383033+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:57.499146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:57.499146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"83'27","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542165+0000","last_change":"2024-02-19T21:33:48.591748+0000","last_active":"2024-02-19T21:34:14.542165+0000","last_peered":"2024-02-19T21:34:14.542165+0000","last_clean":"2024-02-19T21:34:14.542165+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:34:14.542165+0000","last_undegraded":"2024-02-19T21:34:14.542165+0000","last_fullsized":"2024-02-19T21:34:14.542165+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'27","last_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:33:48.591669+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.002055+0000","last_change":"2024-02-19T21:33:38.208119+0000","last_active":"2024-02-19T21:34:15.002055+0000","last_peered":"2024-02-19T21:34:15.002055+0000","last_clean":"2024-02-19T21:34:15.002055+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:34:15.002055+0000","last_undegraded":"2024-02-19T21:34:15.002055+0000","last_fullsized":"2024-02-19T21:34:15.002055+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:33:38.208037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541808+0000","last_change":"2024-02-19T21:33:41.431931+0000","last_active":"2024-02-19T21:34:14.541808+0000","last_peered":"2024-02-19T21:34:14.541808+0000","last_clean":"2024-02-19T21:34:14.541808+0000","last_became_active":"2024-02-19T21:32:29.370626+0000","last_became_peered":"2024-02-19T21:32:29.370626+0000","last_unstale":"2024-02-19T21:34:14.541808+0000","last_undegraded":"2024-02-19T21:34:14.541808+0000","last_fullsized":"2024-02-19T21:34:14.541808+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:41.431855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:41.431855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.757941+0000","last_change":"2024-02-19T21:33:59.903426+0000","last_active":"2024-02-19T21:34:14.757941+0000","last_peered":"2024-02-19T21:34:14.757941+0000","last_clean":"2024-02-19T21:34:14.757941+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:34:14.757941+0000","last_undegraded":"2024-02-19T21:34:14.757941+0000","last_fullsized":"2024-02-19T21:34:14.757941+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:59.903366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:59.903366+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"66'18","reported_seq":76,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.540856+0000","last_change":"2024-02-19T21:34:02.539201+0000","last_active":"2024-02-19T21:34:14.540856+0000","last_peered":"2024-02-19T21:34:14.540856+0000","last_clean":"2024-02-19T21:34:14.540856+0000","last_became_active":"2024-02-19T21:32:25.372700+0000","last_became_peered":"2024-02-19T21:32:25.372700+0000","last_unstale":"2024-02-19T21:34:14.540856+0000","last_undegraded":"2024-02-19T21:34:14.540856+0000","last_fullsized":"2024-02-19T21:34:14.540856+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'18","last_scrub_stamp":"2024-02-19T21:34:02.539127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:02.539127+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541529+0000","last_change":"2024-02-19T21:34:04.274710+0000","last_active":"2024-02-19T21:34:14.541529+0000","last_peered":"2024-02-19T21:34:14.541529+0000","last_clean":"2024-02-19T21:34:14.541529+0000","last_became_active":"2024-02-19T21:32:27.363698+0000","last_became_peered":"2024-02-19T21:32:27.363698+0000","last_unstale":"2024-02-19T21:34:14.541529+0000","last_undegraded":"2024-02-19T21:34:14.541529+0000","last_fullsized":"2024-02-19T21:34:14.541529+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:04.274644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:04.274644+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.384295+0000","last_change":"2024-02-19T21:33:46.390169+0000","last_active":"2024-02-19T21:34:15.384295+0000","last_peered":"2024-02-19T21:34:15.384295+0000","last_clean":"2024-02-19T21:34:15.384295+0000","last_became_active":"2024-02-19T21:32:29.597309+0000","last_became_peered":"2024-02-19T21:32:29.597309+0000","last_unstale":"2024-02-19T21:34:15.384295+0000","last_undegraded":"2024-02-19T21:34:15.384295+0000","last_fullsized":"2024-02-19T21:34:15.384295+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:46.390066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:46.390066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.002397+0000","last_change":"2024-02-19T21:33:54.227769+0000","last_active":"2024-02-19T21:34:15.002397+0000","last_peered":"2024-02-19T21:34:15.002397+0000","last_clean":"2024-02-19T21:34:15.002397+0000","last_became_active":"2024-02-19T21:32:23.354215+0000","last_became_peered":"2024-02-19T21:32:23.354215+0000","last_unstale":"2024-02-19T21:34:15.002397+0000","last_undegraded":"2024-02-19T21:34:15.002397+0000","last_fullsized":"2024-02-19T21:34:15.002397+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:54.227674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:54.227674+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"66'14","reported_seq":66,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541383+0000","last_change":"2024-02-19T21:34:10.348935+0000","last_active":"2024-02-19T21:34:14.541383+0000","last_peered":"2024-02-19T21:34:14.541383+0000","last_clean":"2024-02-19T21:34:14.541383+0000","last_became_active":"2024-02-19T21:32:25.358770+0000","last_became_peered":"2024-02-19T21:32:25.358770+0000","last_unstale":"2024-02-19T21:34:14.541383+0000","last_undegraded":"2024-02-19T21:34:14.541383+0000","last_fullsized":"2024-02-19T21:34:14.541383+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'14","last_scrub_stamp":"2024-02-19T21:34:10.348822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:10.348822+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"66'8","reported_seq":80,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:31.865908+0000","last_change":"2024-02-19T21:33:48.482173+0000","last_active":"2024-02-19T21:34:31.865908+0000","last_peered":"2024-02-19T21:34:31.865908+0000","last_clean":"2024-02-19T21:34:31.865908+0000","last_became_active":"2024-02-19T21:32:27.368914+0000","last_became_peered":"2024-02-19T21:32:27.368914+0000","last_unstale":"2024-02-19T21:34:31.865908+0000","last_undegraded":"2024-02-19T21:34:31.865908+0000","last_fullsized":"2024-02-19T21:34:31.865908+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:33:48.482077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:48.482077+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541915+0000","last_change":"2024-02-19T21:34:09.553708+0000","last_active":"2024-02-19T21:34:14.541915+0000","last_peered":"2024-02-19T21:34:14.541915+0000","last_clean":"2024-02-19T21:34:14.541915+0000","last_became_active":"2024-02-19T21:32:29.597229+0000","last_became_peered":"2024-02-19T21:32:29.597229+0000","last_unstale":"2024-02-19T21:34:14.541915+0000","last_undegraded":"2024-02-19T21:34:14.541915+0000","last_fullsized":"2024-02-19T21:34:14.541915+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:09.553584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:09.553584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.384911+0000","last_change":"2024-02-19T21:33:45.555316+0000","last_active":"2024-02-19T21:34:15.384911+0000","last_peered":"2024-02-19T21:34:15.384911+0000","last_clean":"2024-02-19T21:34:15.384911+0000","last_became_active":"2024-02-19T21:32:27.362497+0000","last_became_peered":"2024-02-19T21:32:27.362497+0000","last_unstale":"2024-02-19T21:34:15.384911+0000","last_undegraded":"2024-02-19T21:34:15.384911+0000","last_fullsized":"2024-02-19T21:34:15.384911+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:45.555228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:45.555228+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.382423+0000","last_change":"2024-02-19T21:33:44.409745+0000","last_active":"2024-02-19T21:34:15.382423+0000","last_peered":"2024-02-19T21:34:15.382423+0000","last_clean":"2024-02-19T21:34:15.382423+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:34:15.382423+0000","last_undegraded":"2024-02-19T21:34:15.382423+0000","last_fullsized":"2024-02-19T21:34:15.382423+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:33:44.409655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:44.409655+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"66'11","reported_seq":64,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542090+0000","last_change":"2024-02-19T21:33:40.386202+0000","last_active":"2024-02-19T21:34:14.542090+0000","last_peered":"2024-02-19T21:34:14.542090+0000","last_clean":"2024-02-19T21:34:14.542090+0000","last_became_active":"2024-02-19T21:32:25.361035+0000","last_became_peered":"2024-02-19T21:32:25.361035+0000","last_unstale":"2024-02-19T21:34:14.542090+0000","last_undegraded":"2024-02-19T21:34:14.542090+0000","last_fullsized":"2024-02-19T21:34:14.542090+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:33:40.386081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:40.386081+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.384262+0000","last_change":"2024-02-19T21:33:40.680884+0000","last_active":"2024-02-19T21:34:15.384262+0000","last_peered":"2024-02-19T21:34:15.384262+0000","last_clean":"2024-02-19T21:34:15.384262+0000","last_became_active":"2024-02-19T21:32:29.378462+0000","last_became_peered":"2024-02-19T21:32:29.378462+0000","last_unstale":"2024-02-19T21:34:15.384262+0000","last_undegraded":"2024-02-19T21:34:15.384262+0000","last_fullsized":"2024-02-19T21:34:15.384262+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:40.680819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:40.680819+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"66'8","reported_seq":78,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:31.866115+0000","last_change":"2024-02-19T21:34:01.346726+0000","last_active":"2024-02-19T21:34:31.866115+0000","last_peered":"2024-02-19T21:34:31.866115+0000","last_clean":"2024-02-19T21:34:31.866115+0000","last_became_active":"2024-02-19T21:32:27.367867+0000","last_became_peered":"2024-02-19T21:32:27.367867+0000","last_unstale":"2024-02-19T21:34:31.866115+0000","last_undegraded":"2024-02-19T21:34:31.866115+0000","last_fullsized":"2024-02-19T21:34:31.866115+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:34:01.346647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:01.346647+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.757611+0000","last_change":"2024-02-19T21:33:37.911205+0000","last_active":"2024-02-19T21:34:14.757611+0000","last_peered":"2024-02-19T21:34:14.757611+0000","last_clean":"2024-02-19T21:34:14.757611+0000","last_became_active":"2024-02-19T21:32:23.362738+0000","last_became_peered":"2024-02-19T21:32:23.362738+0000","last_unstale":"2024-02-19T21:34:14.757611+0000","last_undegraded":"2024-02-19T21:34:14.757611+0000","last_fullsized":"2024-02-19T21:34:14.757611+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:33:37.911143+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"66'15","reported_seq":70,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.758056+0000","last_change":"2024-02-19T21:33:54.889202+0000","last_active":"2024-02-19T21:34:14.758056+0000","last_peered":"2024-02-19T21:34:14.758056+0000","last_clean":"2024-02-19T21:34:14.758056+0000","last_became_active":"2024-02-19T21:32:25.367511+0000","last_became_peered":"2024-02-19T21:32:25.367511+0000","last_unstale":"2024-02-19T21:34:14.758056+0000","last_undegraded":"2024-02-19T21:34:14.758056+0000","last_fullsized":"2024-02-19T21:34:14.758056+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:33:54.889130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:54.889130+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541847+0000","last_change":"2024-02-19T21:34:09.303641+0000","last_active":"2024-02-19T21:34:14.541847+0000","last_peered":"2024-02-19T21:34:14.541847+0000","last_clean":"2024-02-19T21:34:14.541847+0000","last_became_active":"2024-02-19T21:32:29.370710+0000","last_became_peered":"2024-02-19T21:32:29.370710+0000","last_unstale":"2024-02-19T21:34:14.541847+0000","last_undegraded":"2024-02-19T21:34:14.541847+0000","last_fullsized":"2024-02-19T21:34:14.541847+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:09.303502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:09.303502+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"83'9","reported_seq":78,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:31.865901+0000","last_change":"2024-02-19T21:33:49.121296+0000","last_active":"2024-02-19T21:34:31.865901+0000","last_peered":"2024-02-19T21:34:31.865901+0000","last_clean":"2024-02-19T21:34:31.865901+0000","last_became_active":"2024-02-19T21:32:27.363859+0000","last_became_peered":"2024-02-19T21:32:27.363859+0000","last_unstale":"2024-02-19T21:34:31.865901+0000","last_undegraded":"2024-02-19T21:34:31.865901+0000","last_fullsized":"2024-02-19T21:34:31.865901+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'9","last_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:33:49.121238+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.757920+0000","last_change":"2024-02-19T21:34:01.906245+0000","last_active":"2024-02-19T21:34:14.757920+0000","last_peered":"2024-02-19T21:34:14.757920+0000","last_clean":"2024-02-19T21:34:14.757920+0000","last_became_active":"2024-02-19T21:32:23.363155+0000","last_became_peered":"2024-02-19T21:32:23.363155+0000","last_unstale":"2024-02-19T21:34:14.757920+0000","last_undegraded":"2024-02-19T21:34:14.757920+0000","last_fullsized":"2024-02-19T21:34:14.757920+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:01.906174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:01.906174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"66'10","reported_seq":60,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541689+0000","last_change":"2024-02-19T21:33:27.192698+0000","last_active":"2024-02-19T21:34:14.541689+0000","last_peered":"2024-02-19T21:34:14.541689+0000","last_clean":"2024-02-19T21:34:14.541689+0000","last_became_active":"2024-02-19T21:32:25.364180+0000","last_became_peered":"2024-02-19T21:32:25.364180+0000","last_unstale":"2024-02-19T21:34:14.541689+0000","last_undegraded":"2024-02-19T21:34:14.541689+0000","last_fullsized":"2024-02-19T21:34:14.541689+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:33:27.192584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:27.192584+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.209250+0000","last_change":"2024-02-19T21:34:04.048256+0000","last_active":"2024-02-19T21:34:15.209250+0000","last_peered":"2024-02-19T21:34:15.209250+0000","last_clean":"2024-02-19T21:34:15.209250+0000","last_became_active":"2024-02-19T21:32:29.371946+0000","last_became_peered":"2024-02-19T21:32:29.371946+0000","last_unstale":"2024-02-19T21:34:15.209250+0000","last_undegraded":"2024-02-19T21:34:15.209250+0000","last_fullsized":"2024-02-19T21:34:15.209250+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:04.048187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:04.048187+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:16.785782+0000","last_change":"2024-02-19T21:34:16.785756+0000","last_active":"2024-02-19T21:34:16.785782+0000","last_peered":"2024-02-19T21:34:16.785782+0000","last_clean":"2024-02-19T21:34:16.785782+0000","last_became_active":"2024-02-19T21:32:27.369452+0000","last_became_peered":"2024-02-19T21:32:27.369452+0000","last_unstale":"2024-02-19T21:34:16.785782+0000","last_undegraded":"2024-02-19T21:34:16.785782+0000","last_fullsized":"2024-02-19T21:34:16.785782+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:16.785689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:16.785689+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.382898+0000","last_change":"2024-02-19T21:33:39.415142+0000","last_active":"2024-02-19T21:34:15.382898+0000","last_peered":"2024-02-19T21:34:15.382898+0000","last_clean":"2024-02-19T21:34:15.382898+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:34:15.382898+0000","last_undegraded":"2024-02-19T21:34:15.382898+0000","last_fullsized":"2024-02-19T21:34:15.382898+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:33:39.415072+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"66'17","reported_seq":78,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:37.259118+0000","last_change":"2024-02-19T21:34:37.259118+0000","last_active":"2024-02-19T21:34:37.259118+0000","last_peered":"2024-02-19T21:34:37.259118+0000","last_clean":"2024-02-19T21:34:37.259118+0000","last_became_active":"2024-02-19T21:32:25.362454+0000","last_became_peered":"2024-02-19T21:32:25.362454+0000","last_unstale":"2024-02-19T21:34:37.259118+0000","last_undegraded":"2024-02-19T21:34:37.259118+0000","last_fullsized":"2024-02-19T21:34:37.259118+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'17","last_scrub_stamp":"2024-02-19T21:34:37.259020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:37.259020+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.383347+0000","last_change":"2024-02-19T21:34:04.422674+0000","last_active":"2024-02-19T21:34:15.383347+0000","last_peered":"2024-02-19T21:34:15.383347+0000","last_clean":"2024-02-19T21:34:15.383347+0000","last_became_active":"2024-02-19T21:32:29.373442+0000","last_became_peered":"2024-02-19T21:32:29.373442+0000","last_unstale":"2024-02-19T21:34:15.383347+0000","last_undegraded":"2024-02-19T21:34:15.383347+0000","last_fullsized":"2024-02-19T21:34:15.383347+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:04.422580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:04.422580+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.209049+0000","last_change":"2024-02-19T21:33:42.201180+0000","last_active":"2024-02-19T21:34:15.209049+0000","last_peered":"2024-02-19T21:34:15.209049+0000","last_clean":"2024-02-19T21:34:15.209049+0000","last_became_active":"2024-02-19T21:32:27.369020+0000","last_became_peered":"2024-02-19T21:32:27.369020+0000","last_unstale":"2024-02-19T21:34:15.209049+0000","last_undegraded":"2024-02-19T21:34:15.209049+0000","last_fullsized":"2024-02-19T21:34:15.209049+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:42.201115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:42.201115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"59'1","reported_seq":52,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.209256+0000","last_change":"2024-02-19T21:34:00.104194+0000","last_active":"2024-02-19T21:34:15.209256+0000","last_peered":"2024-02-19T21:34:15.209256+0000","last_clean":"2024-02-19T21:34:15.209256+0000","last_became_active":"2024-02-19T21:32:23.359474+0000","last_became_peered":"2024-02-19T21:32:23.359474+0000","last_unstale":"2024-02-19T21:34:15.209256+0000","last_undegraded":"2024-02-19T21:34:15.209256+0000","last_fullsized":"2024-02-19T21:34:15.209256+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:34:00.104130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:00.104130+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"66'19","reported_seq":75,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.001942+0000","last_change":"2024-02-19T21:33:29.164745+0000","last_active":"2024-02-19T21:34:15.001942+0000","last_peered":"2024-02-19T21:34:15.001942+0000","last_clean":"2024-02-19T21:34:15.001942+0000","last_became_active":"2024-02-19T21:32:25.372284+0000","last_became_peered":"2024-02-19T21:32:25.372284+0000","last_unstale":"2024-02-19T21:34:15.001942+0000","last_undegraded":"2024-02-19T21:34:15.001942+0000","last_fullsized":"2024-02-19T21:34:15.001942+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'19","last_scrub_stamp":"2024-02-19T21:33:29.164641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:29.164641+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541216+0000","last_change":"2024-02-19T21:33:32.580636+0000","last_active":"2024-02-19T21:34:14.541216+0000","last_peered":"2024-02-19T21:34:14.541216+0000","last_clean":"2024-02-19T21:34:14.541216+0000","last_became_active":"2024-02-19T21:32:29.375689+0000","last_became_peered":"2024-02-19T21:32:29.375689+0000","last_unstale":"2024-02-19T21:34:14.541216+0000","last_undegraded":"2024-02-19T21:34:14.541216+0000","last_fullsized":"2024-02-19T21:34:14.541216+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:32.580572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:32.580572+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.209230+0000","last_change":"2024-02-19T21:33:45.130720+0000","last_active":"2024-02-19T21:34:15.209230+0000","last_peered":"2024-02-19T21:34:15.209230+0000","last_clean":"2024-02-19T21:34:15.209230+0000","last_became_active":"2024-02-19T21:32:27.361539+0000","last_became_peered":"2024-02-19T21:32:27.361539+0000","last_unstale":"2024-02-19T21:34:15.209230+0000","last_undegraded":"2024-02-19T21:34:15.209230+0000","last_fullsized":"2024-02-19T21:34:15.209230+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:45.130644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:45.130644+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.758517+0000","last_change":"2024-02-19T21:34:14.758310+0000","last_active":"2024-02-19T21:34:14.758517+0000","last_peered":"2024-02-19T21:34:14.758517+0000","last_clean":"2024-02-19T21:34:14.758517+0000","last_became_active":"2024-02-19T21:32:23.357438+0000","last_became_peered":"2024-02-19T21:32:23.357438+0000","last_unstale":"2024-02-19T21:34:14.758517+0000","last_undegraded":"2024-02-19T21:34:14.758517+0000","last_fullsized":"2024-02-19T21:34:14.758517+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:14.757665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:14.757665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"66'9","reported_seq":61,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542310+0000","last_change":"2024-02-19T21:33:38.550327+0000","last_active":"2024-02-19T21:34:14.542310+0000","last_peered":"2024-02-19T21:34:14.542310+0000","last_clean":"2024-02-19T21:34:14.542310+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:34:14.542310+0000","last_undegraded":"2024-02-19T21:34:14.542310+0000","last_fullsized":"2024-02-19T21:34:14.542310+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:33:38.550249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:38.550249+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.383147+0000","last_change":"2024-02-19T21:33:36.648174+0000","last_active":"2024-02-19T21:34:15.383147+0000","last_peered":"2024-02-19T21:34:15.383147+0000","last_clean":"2024-02-19T21:34:15.383147+0000","last_became_active":"2024-02-19T21:32:29.597248+0000","last_became_peered":"2024-02-19T21:32:29.597248+0000","last_unstale":"2024-02-19T21:34:15.383147+0000","last_undegraded":"2024-02-19T21:34:15.383147+0000","last_fullsized":"2024-02-19T21:34:15.383147+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:36.648092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:36.648092+0000","last_clean_scrub_stamp":"2024-02-19T21:33:36.648092+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.209184+0000","last_change":"2024-02-19T21:33:47.040363+0000","last_active":"2024-02-19T21:34:15.209184+0000","last_peered":"2024-02-19T21:34:15.209184+0000","last_clean":"2024-02-19T21:34:15.209184+0000","last_became_active":"2024-02-19T21:32:23.357486+0000","last_became_peered":"2024-02-19T21:32:23.357486+0000","last_unstale":"2024-02-19T21:34:15.209184+0000","last_undegraded":"2024-02-19T21:34:15.209184+0000","last_fullsized":"2024-02-19T21:34:15.209184+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:47.040272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:47.040272+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"66'15","reported_seq":69,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.383017+0000","last_change":"2024-02-19T21:34:00.561967+0000","last_active":"2024-02-19T21:34:15.383017+0000","last_peered":"2024-02-19T21:34:15.383017+0000","last_clean":"2024-02-19T21:34:15.383017+0000","last_became_active":"2024-02-19T21:32:25.372170+0000","last_became_peered":"2024-02-19T21:32:25.372170+0000","last_unstale":"2024-02-19T21:34:15.383017+0000","last_undegraded":"2024-02-19T21:34:15.383017+0000","last_fullsized":"2024-02-19T21:34:15.383017+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:34:00.561883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:00.561883+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"66'8","reported_seq":77,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:31.866025+0000","last_change":"2024-02-19T21:33:38.445505+0000","last_active":"2024-02-19T21:34:31.866025+0000","last_peered":"2024-02-19T21:34:31.866025+0000","last_clean":"2024-02-19T21:34:31.866025+0000","last_became_active":"2024-02-19T21:32:27.369840+0000","last_became_peered":"2024-02-19T21:32:27.369840+0000","last_unstale":"2024-02-19T21:34:31.866025+0000","last_undegraded":"2024-02-19T21:34:31.866025+0000","last_fullsized":"2024-02-19T21:34:31.866025+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:33:38.445424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:38.445424+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65,"ondisk_log_size":65,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":698,"num_read_kb":455,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":408,"ondisk_log_size":408,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":128,"num_read_kb":123,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201310,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297872,"kb_used_data":776,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447280,"statfs":{"total":95995035648,"available":95690014720,"internally_reserved":0,"allocated":794624,"data_stored":397926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53900000000000003,"15min":0.54500000000000004},"min":{"1min":0.33000000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54200000000000004,"15min":0.54500000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.52200000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.32300000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.53200000000000003,"15min":0.54000000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.48499999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.315,"5min":0.313,"15min":0.313},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.53700000000000003}]},{"osd":3,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53300000000000003,"15min":0.53200000000000003},"min":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.57199999999999995}]},{"osd":4,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.70399999999999996,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.434},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69799999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.58599999999999997}]},{"osd":5,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.63400000000000001,"15min":0.65800000000000003},"min":{"1min":0.33800000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.69099999999999995,"5min":4.6390000000000002,"15min":4.6390000000000002},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.48099999999999998,"15min":0.47799999999999998},"min":{"1min":0.34699999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55900000000000005}]},{"osd":6,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73199999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.86699999999999999,"15min":0.92200000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80300000000000005,"5min":8.8030000000000008,"15min":8.8030000000000008},"last":0.63200000000000001}]}]},{"osd":6,"up_from":47,"seq":201863462949,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297844,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447308,"statfs":{"total":95995035648,"available":95690043392,"internally_reserved":0,"allocated":765952,"data_stored":396433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:33:50 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.48999999999999999,"15min":0.48599999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.437},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.48499999999999999,"15min":0.47899999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.46200000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:33:50 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.504,"15min":0.502},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.47399999999999998,"15min":0.47099999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.45100000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:33:50 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.505,"15min":0.503},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.503,"5min":0.47399999999999998,"15min":0.46899999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.53100000000000003}]},{"osd":3,"last update":"Mon Feb 19 21:33:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51200000000000001,"15min":0.50800000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.626},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.49199999999999999,"15min":0.48799999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.54300000000000004}]},{"osd":4,"last update":"Mon Feb 19 21:33:50 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.39300000000000002,"15min":0.38300000000000001},"min":{"1min":0.29999999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.443,"5min":0.41099999999999998,"15min":0.40500000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.66400000000000003}]},{"osd":5,"last update":"Mon Feb 19 21:33:50 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.42099999999999999,"15min":0.41599999999999998},"min":{"1min":0.32400000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.41599999999999998,"15min":0.40600000000000003},"min":{"1min":0.33600000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.70099999999999996}]},{"osd":7,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.48999999999999999,"15min":0.48199999999999998},"min":{"1min":0.35599999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.38600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.77500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297908,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447244,"statfs":{"total":95995035648,"available":95689977856,"internally_reserved":0,"allocated":831488,"data_stored":399143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:33:41 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.36199999999999999,"15min":0.34200000000000003},"min":{"1min":0.246,"5min":0.193,"15min":0.193},"max":{"1min":0.502,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.36499999999999999,"15min":0.34100000000000003},"min":{"1min":0.23000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.495,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.30199999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:34:13 2024","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.36399999999999999,"15min":0.36299999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.51600000000000001,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.316},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.39800000000000002,"15min":0.38900000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.45800000000000002,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.35299999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:33:36 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.433,"15min":0.434},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.55200000000000005,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.29099999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.54000000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.34200000000000003}]},{"osd":4,"last update":"Mon Feb 19 21:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.59499999999999997,"15min":0.61499999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.66600000000000004,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.59399999999999997,"15min":0.61399999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.69499999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.53400000000000003}]},{"osd":5,"last update":"Mon Feb 19 21:34:27 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.55400000000000005,"15min":0.57399999999999995},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.72099999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.57699999999999996,"15min":0.60099999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80000000000000004,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.57099999999999995}]},{"osd":6,"last update":"Mon Feb 19 21:33:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.59499999999999997,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73499999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.625},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.60899999999999999,"15min":0.62},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.55000000000000004}]},{"osd":7,"last update":"Mon Feb 19 21:34:18 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.73399999999999999,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.72799999999999998,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.52700000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297880,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447272,"statfs":{"total":95995035648,"available":95690006528,"internally_reserved":0,"allocated":802816,"data_stored":398296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:33:45 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33600000000000002,"15min":0.30399999999999999},"min":{"1min":0.23999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.19800000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.371,"15min":0.31900000000000001},"min":{"1min":0.222,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.403,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.21099999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:34:19 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.39700000000000002,"15min":0.373},"min":{"1min":0.28100000000000003,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.40899999999999997,"15min":0.38200000000000001},"min":{"1min":0.26100000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.25600000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:34:36 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.41399999999999998,"15min":0.40400000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.53100000000000003,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.441,"15min":0.443},"min":{"1min":0.317,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.54000000000000004,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.28599999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:34:03 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59099999999999997,"15min":0.58999999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.59699999999999998,"15min":0.60799999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73999999999999999,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.42899999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.621,"15min":0.629},"min":{"1min":0.42299999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84399999999999997,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.629,"15min":0.63},"min":{"1min":0.40500000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.98799999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.54700000000000004}]},{"osd":6,"last update":"Mon Feb 19 21:33:51 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.622,"15min":0.63400000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77200000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59999999999999998,"15min":0.60399999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.46600000000000003}]},{"osd":7,"last update":"Mon Feb 19 21:34:19 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.62,"15min":0.60999999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.498},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64800000000000002,"15min":0.65000000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91700000000000004,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.50600000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411386,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297860,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447292,"statfs":{"total":95995035648,"available":95690027008,"internally_reserved":0,"allocated":782336,"data_stored":397664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:34:12 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.36399999999999999,"15min":0.34799999999999998},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52100000000000002,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.40200000000000002,"15min":0.40600000000000003},"min":{"1min":0.26700000000000002,"5min":0.193,"15min":0.193},"max":{"1min":0.504,"5min":0.624,"15min":0.624},"last":0.26000000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:34:12 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.376,"15min":0.37},"min":{"1min":0.23100000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.55600000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.25},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.38600000000000001,"15min":0.38400000000000001},"min":{"1min":0.23200000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.48799999999999999,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.23400000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:33:41 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.40500000000000003,"15min":0.40300000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.504,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.372,"5min":0.41199999999999998,"15min":0.41399999999999998},"min":{"1min":0.27700000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.56000000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.28699999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:34:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56499999999999995,"15min":0.57499999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75700000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57399999999999995,"15min":0.57699999999999996},"min":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69899999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.498}]},{"osd":5,"last update":"Mon Feb 19 21:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.59299999999999997,"15min":0.61099999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89400000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.56999999999999995,"15min":0.58399999999999996},"min":{"1min":0.36799999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.39900000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:33:53 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55800000000000005,"15min":0.56499999999999995},"min":{"1min":0.39900000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.73499999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59299999999999997,"15min":0.59899999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.77900000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.47499999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:34:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60299999999999998,"15min":0.60999999999999999},"min":{"1min":0.40100000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80000000000000004,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.38800000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75800000000000001,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.48099999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149749,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297884,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447268,"statfs":{"total":95995035648,"available":95690002432,"internally_reserved":0,"allocated":806912,"data_stored":397538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:33:41 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.40400000000000003,"15min":0.41699999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.42899999999999999,"15min":0.44400000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.52800000000000002,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.40000000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:33:41 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.38400000000000001,"15min":0.39700000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.41399999999999998,"15min":0.432},"min":{"1min":0.27200000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.55000000000000004,"5min":0.625,"15min":0.625},"last":0.32800000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:33:41 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.439,"15min":0.45500000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.53500000000000003,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.377},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.41699999999999998,"15min":0.438},"min":{"1min":0.255,"5min":0.253,"15min":0.253},"max":{"1min":0.59399999999999997,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.35099999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:34:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.57999999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57399999999999995,"15min":0.57799999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.85299999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.53700000000000003}]},{"osd":5,"last update":"Mon Feb 19 21:34:27 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.69999999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.77600000000000002,"5min":0.876,"15min":0.876},"last":0.50900000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:33:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56200000000000006,"15min":0.56399999999999995},"min":{"1min":0.40500000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75600000000000001,"5min":0.87,"15min":0.87},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.59399999999999997}]},{"osd":7,"last update":"Mon Feb 19 21:34:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.432,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.495}]}]},{"osd":4,"up_from":32,"seq":137438953518,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297872,"kb_used_data":776,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447280,"statfs":{"total":95995035648,"available":95690014720,"internally_reserved":0,"allocated":794624,"data_stored":397206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.50600000000000001,"15min":0.51400000000000001},"min":{"1min":0.33100000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.70699999999999996,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79900000000000004,"5min":1.149,"15min":1.149},"last":0.375}]},{"osd":1,"last update":"Mon Feb 19 21:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.51900000000000002,"15min":0.53700000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.66500000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55000000000000004,"15min":0.55800000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.876,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.51800000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54600000000000004,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73399999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.77300000000000002,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.54800000000000004}]},{"osd":3,"last update":"Mon Feb 19 21:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.377,"5min":0.376,"15min":0.376},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.53400000000000003,"15min":0.54400000000000004},"min":{"1min":0.35299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.64400000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.41799999999999998,"15min":0.40000000000000002},"min":{"1min":0.28199999999999997,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.71199999999999997,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.434,"15min":0.41099999999999998},"min":{"1min":0.33700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.65800000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.622}]},{"osd":6,"last update":"Mon Feb 19 21:33:51 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.44500000000000001,"15min":0.438},"min":{"1min":0.32300000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.46500000000000002,"15min":0.45600000000000002},"min":{"1min":0.32000000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.61499999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:34:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52200000000000002,"15min":0.51900000000000002},"min":{"1min":0.36399999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71799999999999997,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.67600000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.59299999999999997}]}]},{"osd":5,"up_from":38,"seq":163208757290,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297856,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447296,"statfs":{"total":95995035648,"available":95690031104,"internally_reserved":0,"allocated":778240,"data_stored":397357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:34:28 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53000000000000003,"15min":0.55000000000000004},"min":{"1min":0.34999999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70599999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64400000000000002,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.71399999999999997}]},{"osd":1,"last update":"Mon Feb 19 21:34:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53900000000000003,"15min":0.55600000000000005},"min":{"1min":0.39400000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.626},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.51100000000000001,"15min":0.52900000000000003},"min":{"1min":0.35099999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.61199999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.68300000000000005}]},{"osd":2,"last update":"Mon Feb 19 21:34:28 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53400000000000003,"15min":0.54200000000000004},"min":{"1min":0.40400000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79600000000000004,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53900000000000003,"15min":0.55100000000000005},"min":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70499999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.75}]},{"osd":3,"last update":"Mon Feb 19 21:34:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55900000000000005,"15min":0.56799999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.76200000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59599999999999997,"15min":0.61499999999999999},"min":{"1min":0.42099999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.748,"5min":0.875,"15min":0.875},"last":0.78000000000000003}]},{"osd":4,"last update":"Mon Feb 19 21:34:28 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.40600000000000003,"15min":0.40400000000000003},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.41999999999999998,"15min":0.41199999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.501}]},{"osd":6,"last update":"Mon Feb 19 21:33:54 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.44900000000000001,"15min":0.439},"min":{"1min":0.33600000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.45100000000000001,"15min":0.435},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.66700000000000004}]},{"osd":7,"last update":"Mon Feb 19 21:34:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80000000000000004,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.73799999999999999,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.59299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:34:42.319 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:34:42.591 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:34:43.081 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:41.516802+0000 osd.7 (osd.7) 41 : cluster [DBG] 2.1c scrub starts 2024-02-19T21:34:43.081 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:41.519710+0000 osd.7 (osd.7) 42 : cluster [DBG] 2.1c scrub ok 2024-02-19T21:34:43.081 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:41.516802+0000 osd.7 (osd.7) 41 : cluster [DBG] 2.1c scrub starts 2024-02-19T21:34:43.082 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:41.519710+0000 osd.7 (osd.7) 42 : cluster [DBG] 2.1c scrub ok 2024-02-19T21:34:43.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:41.516802+0000 osd.7 (osd.7) 41 : cluster [DBG] 2.1c scrub starts 2024-02-19T21:34:43.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:41.519710+0000 osd.7 (osd.7) 42 : cluster [DBG] 2.1c scrub ok 2024-02-19T21:34:44.292 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:42.521094+0000 osd.7 (osd.7) 43 : cluster [DBG] 5.4 scrub starts 2024-02-19T21:34:44.292 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:42.524054+0000 osd.7 (osd.7) 44 : cluster [DBG] 5.4 scrub ok 2024-02-19T21:34:44.292 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:42.788280+0000 mgr.y (mgr.14514) 93 : cluster [DBG] pgmap v80: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:34:44.292 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:42.962440+0000 osd.6 (osd.6) 31 : cluster [DBG] 5.11 scrub starts 2024-02-19T21:34:44.292 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:42.965372+0000 osd.6 (osd.6) 32 : cluster [DBG] 5.11 scrub ok 2024-02-19T21:34:44.292 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:43.253210+0000 osd.4 (osd.4) 51 : cluster [DBG] 6.2 scrub starts 2024-02-19T21:34:44.292 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:43.256175+0000 osd.4 (osd.4) 52 : cluster [DBG] 6.2 scrub ok 2024-02-19T21:34:44.293 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:42.521094+0000 osd.7 (osd.7) 43 : cluster [DBG] 5.4 scrub starts 2024-02-19T21:34:44.293 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:42.524054+0000 osd.7 (osd.7) 44 : cluster [DBG] 5.4 scrub ok 2024-02-19T21:34:44.293 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:42.788280+0000 mgr.y (mgr.14514) 93 : cluster [DBG] pgmap v80: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:34:44.293 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:42.962440+0000 osd.6 (osd.6) 31 : cluster [DBG] 5.11 scrub starts 2024-02-19T21:34:44.293 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:42.965372+0000 osd.6 (osd.6) 32 : cluster [DBG] 5.11 scrub ok 2024-02-19T21:34:44.293 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:43.253210+0000 osd.4 (osd.4) 51 : cluster [DBG] 6.2 scrub starts 2024-02-19T21:34:44.293 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:43.256175+0000 osd.4 (osd.4) 52 : cluster [DBG] 6.2 scrub ok 2024-02-19T21:34:44.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:42.521094+0000 osd.7 (osd.7) 43 : cluster [DBG] 5.4 scrub starts 2024-02-19T21:34:44.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:42.524054+0000 osd.7 (osd.7) 44 : cluster [DBG] 5.4 scrub ok 2024-02-19T21:34:44.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:42.788280+0000 mgr.y (mgr.14514) 93 : cluster [DBG] pgmap v80: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:34:44.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:42.962440+0000 osd.6 (osd.6) 31 : cluster [DBG] 5.11 scrub starts 2024-02-19T21:34:44.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:42.965372+0000 osd.6 (osd.6) 32 : cluster [DBG] 5.11 scrub ok 2024-02-19T21:34:44.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:43.253210+0000 osd.4 (osd.4) 51 : cluster [DBG] 6.2 scrub starts 2024-02-19T21:34:44.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:43.256175+0000 osd.4 (osd.4) 52 : cluster [DBG] 6.2 scrub ok 2024-02-19T21:34:44.698 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:34:44.701 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:34:45.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:44.290004+0000 osd.4 (osd.4) 53 : cluster [DBG] 4.c scrub starts 2024-02-19T21:34:45.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:44.293565+0000 osd.4 (osd.4) 54 : cluster [DBG] 4.c scrub ok 2024-02-19T21:34:45.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:44.290004+0000 osd.4 (osd.4) 53 : cluster [DBG] 4.c scrub starts 2024-02-19T21:34:45.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:44.293565+0000 osd.4 (osd.4) 54 : cluster [DBG] 4.c scrub ok 2024-02-19T21:34:45.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:44.290004+0000 osd.4 (osd.4) 53 : cluster [DBG] 4.c scrub starts 2024-02-19T21:34:45.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:44.293565+0000 osd.4 (osd.4) 54 : cluster [DBG] 4.c scrub ok 2024-02-19T21:34:45.512 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2024-02-19T21:34:42.788081+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5796,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":848,"num_read_kb":600,"num_write":428,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":2382976,"kb_used_data":6208,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":747578240,"statfs":{"total":767960285184,"available":765520117760,"internally_reserved":0,"allocated":6356992,"data_stored":3181563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003041"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542704+0000","last_change":"2024-02-19T21:34:08.559052+0000","last_active":"2024-02-19T21:34:14.542704+0000","last_peered":"2024-02-19T21:34:14.542704+0000","last_clean":"2024-02-19T21:34:14.542704+0000","last_became_active":"2024-02-19T21:32:29.599674+0000","last_became_peered":"2024-02-19T21:32:29.599674+0000","last_unstale":"2024-02-19T21:34:14.542704+0000","last_undegraded":"2024-02-19T21:34:14.542704+0000","last_fullsized":"2024-02-19T21:34:14.542704+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:08.558980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:08.558980+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541179+0000","last_change":"2024-02-19T21:33:36.342047+0000","last_active":"2024-02-19T21:34:14.541179+0000","last_peered":"2024-02-19T21:34:14.541179+0000","last_clean":"2024-02-19T21:34:14.541179+0000","last_became_active":"2024-02-19T21:32:27.364767+0000","last_became_peered":"2024-02-19T21:32:27.364767+0000","last_unstale":"2024-02-19T21:34:14.541179+0000","last_undegraded":"2024-02-19T21:34:14.541179+0000","last_fullsized":"2024-02-19T21:34:14.541179+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:36.341941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:36.341941+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541781+0000","last_change":"2024-02-19T21:34:07.755067+0000","last_active":"2024-02-19T21:34:14.541781+0000","last_peered":"2024-02-19T21:34:14.541781+0000","last_clean":"2024-02-19T21:34:14.541781+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:34:14.541781+0000","last_undegraded":"2024-02-19T21:34:14.541781+0000","last_fullsized":"2024-02-19T21:34:14.541781+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:07.754969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:07.754969+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"66'15","reported_seq":69,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:16.531398+0000","last_change":"2024-02-19T21:34:16.531368+0000","last_active":"2024-02-19T21:34:16.531398+0000","last_peered":"2024-02-19T21:34:16.531398+0000","last_clean":"2024-02-19T21:34:16.531398+0000","last_became_active":"2024-02-19T21:32:25.365996+0000","last_became_peered":"2024-02-19T21:32:25.365996+0000","last_unstale":"2024-02-19T21:34:16.531398+0000","last_undegraded":"2024-02-19T21:34:16.531398+0000","last_fullsized":"2024-02-19T21:34:16.531398+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:34:16.531300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:16.531300+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541496+0000","last_change":"2024-02-19T21:33:42.457750+0000","last_active":"2024-02-19T21:34:14.541496+0000","last_peered":"2024-02-19T21:34:14.541496+0000","last_clean":"2024-02-19T21:34:14.541496+0000","last_became_active":"2024-02-19T21:32:29.373546+0000","last_became_peered":"2024-02-19T21:32:29.373546+0000","last_unstale":"2024-02-19T21:34:14.541496+0000","last_undegraded":"2024-02-19T21:34:14.541496+0000","last_fullsized":"2024-02-19T21:34:14.541496+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:42.457680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:42.457680+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:29.779862+0000","last_change":"2024-02-19T21:34:29.779862+0000","last_active":"2024-02-19T21:34:29.779862+0000","last_peered":"2024-02-19T21:34:29.779862+0000","last_clean":"2024-02-19T21:34:29.779862+0000","last_became_active":"2024-02-19T21:32:27.372466+0000","last_became_peered":"2024-02-19T21:32:27.372466+0000","last_unstale":"2024-02-19T21:34:29.779862+0000","last_undegraded":"2024-02-19T21:34:29.779862+0000","last_fullsized":"2024-02-19T21:34:29.779862+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:29.779779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:29.779779+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541304+0000","last_change":"2024-02-19T21:33:46.451703+0000","last_active":"2024-02-19T21:34:14.541304+0000","last_peered":"2024-02-19T21:34:14.541304+0000","last_clean":"2024-02-19T21:34:14.541304+0000","last_became_active":"2024-02-19T21:32:23.356975+0000","last_became_peered":"2024-02-19T21:32:23.356975+0000","last_unstale":"2024-02-19T21:34:14.541304+0000","last_undegraded":"2024-02-19T21:34:14.541304+0000","last_fullsized":"2024-02-19T21:34:14.541304+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:46.451637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:46.451637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"66'9","reported_seq":61,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541378+0000","last_change":"2024-02-19T21:33:38.348440+0000","last_active":"2024-02-19T21:34:14.541378+0000","last_peered":"2024-02-19T21:34:14.541378+0000","last_clean":"2024-02-19T21:34:14.541378+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:34:14.541378+0000","last_undegraded":"2024-02-19T21:34:14.541378+0000","last_fullsized":"2024-02-19T21:34:14.541378+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:33:38.348364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:38.348364+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.383261+0000","last_change":"2024-02-19T21:34:12.642234+0000","last_active":"2024-02-19T21:34:15.383261+0000","last_peered":"2024-02-19T21:34:15.383261+0000","last_clean":"2024-02-19T21:34:15.383261+0000","last_became_active":"2024-02-19T21:32:29.373648+0000","last_became_peered":"2024-02-19T21:32:29.373648+0000","last_unstale":"2024-02-19T21:34:15.383261+0000","last_undegraded":"2024-02-19T21:34:15.383261+0000","last_fullsized":"2024-02-19T21:34:15.383261+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:12.642155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:12.642155+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.383871+0000","last_change":"2024-02-19T21:34:07.478398+0000","last_active":"2024-02-19T21:34:15.383871+0000","last_peered":"2024-02-19T21:34:15.383871+0000","last_clean":"2024-02-19T21:34:15.383871+0000","last_became_active":"2024-02-19T21:32:27.370308+0000","last_became_peered":"2024-02-19T21:32:27.370308+0000","last_unstale":"2024-02-19T21:34:15.383871+0000","last_undegraded":"2024-02-19T21:34:15.383871+0000","last_fullsized":"2024-02-19T21:34:15.383871+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:07.478319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:07.478319+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.383203+0000","last_change":"2024-02-19T21:34:00.532471+0000","last_active":"2024-02-19T21:34:15.383203+0000","last_peered":"2024-02-19T21:34:15.383203+0000","last_clean":"2024-02-19T21:34:15.383203+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:34:15.383203+0000","last_undegraded":"2024-02-19T21:34:15.383203+0000","last_fullsized":"2024-02-19T21:34:15.383203+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:00.532402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:00.532402+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"66'5","reported_seq":70,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541782+0000","last_change":"2024-02-19T21:33:50.926690+0000","last_active":"2024-02-19T21:34:14.541782+0000","last_peered":"2024-02-19T21:34:14.541782+0000","last_clean":"2024-02-19T21:34:14.541782+0000","last_became_active":"2024-02-19T21:33:50.753208+0000","last_became_peered":"2024-02-19T21:33:50.753208+0000","last_unstale":"2024-02-19T21:34:14.541782+0000","last_undegraded":"2024-02-19T21:34:14.541782+0000","last_fullsized":"2024-02-19T21:34:14.541782+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'5","last_scrub_stamp":"2024-02-19T21:33:26.173202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:26.173202+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542778+0000","last_change":"2024-02-19T21:34:13.751793+0000","last_active":"2024-02-19T21:34:14.542778+0000","last_peered":"2024-02-19T21:34:14.542778+0000","last_clean":"2024-02-19T21:34:14.542778+0000","last_became_active":"2024-02-19T21:32:29.373010+0000","last_became_peered":"2024-02-19T21:32:29.373010+0000","last_unstale":"2024-02-19T21:34:14.542778+0000","last_undegraded":"2024-02-19T21:34:14.542778+0000","last_fullsized":"2024-02-19T21:34:14.542778+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:34:13.751725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:13.751725+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.383883+0000","last_change":"2024-02-19T21:33:46.543340+0000","last_active":"2024-02-19T21:34:15.383883+0000","last_peered":"2024-02-19T21:34:15.383883+0000","last_clean":"2024-02-19T21:34:15.383883+0000","last_became_active":"2024-02-19T21:32:27.368241+0000","last_became_peered":"2024-02-19T21:32:27.368241+0000","last_unstale":"2024-02-19T21:34:15.383883+0000","last_undegraded":"2024-02-19T21:34:15.383883+0000","last_fullsized":"2024-02-19T21:34:15.383883+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:46.543259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:46.543259+0000","last_clean_scrub_stamp":"2024-02-19T21:33:46.543259+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.383330+0000","last_change":"2024-02-19T21:33:31.418127+0000","last_active":"2024-02-19T21:34:15.383330+0000","last_peered":"2024-02-19T21:34:15.383330+0000","last_clean":"2024-02-19T21:34:15.383330+0000","last_became_active":"2024-02-19T21:32:23.357179+0000","last_became_peered":"2024-02-19T21:32:23.357179+0000","last_unstale":"2024-02-19T21:34:15.383330+0000","last_undegraded":"2024-02-19T21:34:15.383330+0000","last_fullsized":"2024-02-19T21:34:15.383330+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:31.418051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:31.418051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"89'13","reported_seq":65,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541500+0000","last_change":"2024-02-19T21:34:07.313636+0000","last_active":"2024-02-19T21:34:14.541500+0000","last_peered":"2024-02-19T21:34:14.541500+0000","last_clean":"2024-02-19T21:34:14.541500+0000","last_became_active":"2024-02-19T21:32:25.364237+0000","last_became_peered":"2024-02-19T21:32:25.364237+0000","last_unstale":"2024-02-19T21:34:14.541500+0000","last_undegraded":"2024-02-19T21:34:14.541500+0000","last_fullsized":"2024-02-19T21:34:14.541500+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'13","last_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:34:07.313566+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:20.569229+0000","last_change":"2024-02-19T21:34:20.569197+0000","last_active":"2024-02-19T21:34:20.569229+0000","last_peered":"2024-02-19T21:34:20.569229+0000","last_clean":"2024-02-19T21:34:20.569229+0000","last_became_active":"2024-02-19T21:32:29.597266+0000","last_became_peered":"2024-02-19T21:32:29.597266+0000","last_unstale":"2024-02-19T21:34:20.569229+0000","last_undegraded":"2024-02-19T21:34:20.569229+0000","last_fullsized":"2024-02-19T21:34:20.569229+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:20.569124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:20.569124+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541843+0000","last_change":"2024-02-19T21:34:13.418409+0000","last_active":"2024-02-19T21:34:14.541843+0000","last_peered":"2024-02-19T21:34:14.541843+0000","last_clean":"2024-02-19T21:34:14.541843+0000","last_became_active":"2024-02-19T21:32:27.368233+0000","last_became_peered":"2024-02-19T21:32:27.368233+0000","last_unstale":"2024-02-19T21:34:14.541843+0000","last_undegraded":"2024-02-19T21:34:14.541843+0000","last_fullsized":"2024-02-19T21:34:14.541843+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:13.418325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:13.418325+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":55,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542865+0000","last_change":"2024-02-19T21:33:55.409204+0000","last_active":"2024-02-19T21:34:14.542865+0000","last_peered":"2024-02-19T21:34:14.542865+0000","last_clean":"2024-02-19T21:34:14.542865+0000","last_became_active":"2024-02-19T21:33:50.753994+0000","last_became_peered":"2024-02-19T21:33:50.753994+0000","last_unstale":"2024-02-19T21:34:14.542865+0000","last_undegraded":"2024-02-19T21:34:14.542865+0000","last_fullsized":"2024-02-19T21:34:14.542865+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:55.409142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:55.409142+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"66'12","reported_seq":67,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541158+0000","last_change":"2024-02-19T21:34:04.494293+0000","last_active":"2024-02-19T21:34:14.541158+0000","last_peered":"2024-02-19T21:34:14.541158+0000","last_clean":"2024-02-19T21:34:14.541158+0000","last_became_active":"2024-02-19T21:32:25.369040+0000","last_became_peered":"2024-02-19T21:32:25.369040+0000","last_unstale":"2024-02-19T21:34:14.541158+0000","last_undegraded":"2024-02-19T21:34:14.541158+0000","last_fullsized":"2024-02-19T21:34:14.541158+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'12","last_scrub_stamp":"2024-02-19T21:34:04.494227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:04.494227+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542069+0000","last_change":"2024-02-19T21:33:45.418945+0000","last_active":"2024-02-19T21:34:14.542069+0000","last_peered":"2024-02-19T21:34:14.542069+0000","last_clean":"2024-02-19T21:34:14.542069+0000","last_became_active":"2024-02-19T21:32:29.597365+0000","last_became_peered":"2024-02-19T21:32:29.597365+0000","last_unstale":"2024-02-19T21:34:14.542069+0000","last_undegraded":"2024-02-19T21:34:14.542069+0000","last_fullsized":"2024-02-19T21:34:14.542069+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:45.418867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:45.418867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:17.809341+0000","last_change":"2024-02-19T21:34:17.809314+0000","last_active":"2024-02-19T21:34:17.809341+0000","last_peered":"2024-02-19T21:34:17.809341+0000","last_clean":"2024-02-19T21:34:17.809341+0000","last_became_active":"2024-02-19T21:32:27.369757+0000","last_became_peered":"2024-02-19T21:32:27.369757+0000","last_unstale":"2024-02-19T21:34:17.809341+0000","last_undegraded":"2024-02-19T21:34:17.809341+0000","last_fullsized":"2024-02-19T21:34:17.809341+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:17.809245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:17.809245+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:39.022454+0000","last_change":"2024-02-19T21:34:39.022454+0000","last_active":"2024-02-19T21:34:39.022454+0000","last_peered":"2024-02-19T21:34:39.022454+0000","last_clean":"2024-02-19T21:34:39.022454+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:34:39.022454+0000","last_undegraded":"2024-02-19T21:34:39.022454+0000","last_fullsized":"2024-02-19T21:34:39.022454+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:39.022344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:39.022344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"66'15","reported_seq":69,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.209302+0000","last_change":"2024-02-19T21:33:40.215778+0000","last_active":"2024-02-19T21:34:15.209302+0000","last_peered":"2024-02-19T21:34:15.209302+0000","last_clean":"2024-02-19T21:34:15.209302+0000","last_became_active":"2024-02-19T21:32:25.365267+0000","last_became_peered":"2024-02-19T21:32:25.365267+0000","last_unstale":"2024-02-19T21:34:15.209302+0000","last_undegraded":"2024-02-19T21:34:15.209302+0000","last_fullsized":"2024-02-19T21:34:15.209302+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:33:40.215704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:40.215704+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:34.776259+0000","last_change":"2024-02-19T21:34:34.776259+0000","last_active":"2024-02-19T21:34:34.776259+0000","last_peered":"2024-02-19T21:34:34.776259+0000","last_clean":"2024-02-19T21:34:34.776259+0000","last_became_active":"2024-02-19T21:32:29.373361+0000","last_became_peered":"2024-02-19T21:32:29.373361+0000","last_unstale":"2024-02-19T21:34:34.776259+0000","last_undegraded":"2024-02-19T21:34:34.776259+0000","last_fullsized":"2024-02-19T21:34:34.776259+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:34.776190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:34.776190+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542112+0000","last_change":"2024-02-19T21:33:49.602701+0000","last_active":"2024-02-19T21:34:14.542112+0000","last_peered":"2024-02-19T21:34:14.542112+0000","last_clean":"2024-02-19T21:34:14.542112+0000","last_became_active":"2024-02-19T21:32:27.367741+0000","last_became_peered":"2024-02-19T21:32:27.367741+0000","last_unstale":"2024-02-19T21:34:14.542112+0000","last_undegraded":"2024-02-19T21:34:14.542112+0000","last_fullsized":"2024-02-19T21:34:14.542112+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:49.602639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:49.602639+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541726+0000","last_change":"2024-02-19T21:34:10.565228+0000","last_active":"2024-02-19T21:34:14.541726+0000","last_peered":"2024-02-19T21:34:14.541726+0000","last_clean":"2024-02-19T21:34:14.541726+0000","last_became_active":"2024-02-19T21:32:23.355085+0000","last_became_peered":"2024-02-19T21:32:23.355085+0000","last_unstale":"2024-02-19T21:34:14.541726+0000","last_undegraded":"2024-02-19T21:34:14.541726+0000","last_fullsized":"2024-02-19T21:34:14.541726+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:10.565163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:10.565163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"66'11","reported_seq":63,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.002341+0000","last_change":"2024-02-19T21:33:42.173352+0000","last_active":"2024-02-19T21:34:15.002341+0000","last_peered":"2024-02-19T21:34:15.002341+0000","last_clean":"2024-02-19T21:34:15.002341+0000","last_became_active":"2024-02-19T21:32:25.355939+0000","last_became_peered":"2024-02-19T21:32:25.355939+0000","last_unstale":"2024-02-19T21:34:15.002341+0000","last_undegraded":"2024-02-19T21:34:15.002341+0000","last_fullsized":"2024-02-19T21:34:15.002341+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:33:42.173259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:42.173259+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.384408+0000","last_change":"2024-02-19T21:33:49.401282+0000","last_active":"2024-02-19T21:34:15.384408+0000","last_peered":"2024-02-19T21:34:15.384408+0000","last_clean":"2024-02-19T21:34:15.384408+0000","last_became_active":"2024-02-19T21:32:29.372503+0000","last_became_peered":"2024-02-19T21:32:29.372503+0000","last_unstale":"2024-02-19T21:34:15.384408+0000","last_undegraded":"2024-02-19T21:34:15.384408+0000","last_fullsized":"2024-02-19T21:34:15.384408+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:33:49.401203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:49.401203+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"66'8","reported_seq":80,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:31.866028+0000","last_change":"2024-02-19T21:33:43.197645+0000","last_active":"2024-02-19T21:34:31.866028+0000","last_peered":"2024-02-19T21:34:31.866028+0000","last_clean":"2024-02-19T21:34:31.866028+0000","last_became_active":"2024-02-19T21:32:27.366465+0000","last_became_peered":"2024-02-19T21:32:27.366465+0000","last_unstale":"2024-02-19T21:34:31.866028+0000","last_undegraded":"2024-02-19T21:34:31.866028+0000","last_fullsized":"2024-02-19T21:34:31.866028+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:33:43.197552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:43.197552+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:31.724113+0000","last_change":"2024-02-19T21:34:31.724113+0000","last_active":"2024-02-19T21:34:31.724113+0000","last_peered":"2024-02-19T21:34:31.724113+0000","last_clean":"2024-02-19T21:34:31.724113+0000","last_became_active":"2024-02-19T21:32:23.356323+0000","last_became_peered":"2024-02-19T21:32:23.356323+0000","last_unstale":"2024-02-19T21:34:31.724113+0000","last_undegraded":"2024-02-19T21:34:31.724113+0000","last_fullsized":"2024-02-19T21:34:31.724113+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:31.724027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:31.724027+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"66'10","reported_seq":60,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542016+0000","last_change":"2024-02-19T21:33:31.630440+0000","last_active":"2024-02-19T21:34:14.542016+0000","last_peered":"2024-02-19T21:34:14.542016+0000","last_clean":"2024-02-19T21:34:14.542016+0000","last_became_active":"2024-02-19T21:32:25.372236+0000","last_became_peered":"2024-02-19T21:32:25.372236+0000","last_unstale":"2024-02-19T21:34:14.542016+0000","last_undegraded":"2024-02-19T21:34:14.542016+0000","last_fullsized":"2024-02-19T21:34:14.542016+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:33:31.630368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:31.630368+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.543022+0000","last_change":"2024-02-19T21:33:58.442925+0000","last_active":"2024-02-19T21:34:14.543022+0000","last_peered":"2024-02-19T21:34:14.543022+0000","last_clean":"2024-02-19T21:34:14.543022+0000","last_became_active":"2024-02-19T21:32:29.599396+0000","last_became_peered":"2024-02-19T21:32:29.599396+0000","last_unstale":"2024-02-19T21:34:14.543022+0000","last_undegraded":"2024-02-19T21:34:14.543022+0000","last_fullsized":"2024-02-19T21:34:14.543022+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:58.442855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:58.442855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.383675+0000","last_change":"2024-02-19T21:34:03.457957+0000","last_active":"2024-02-19T21:34:15.383675+0000","last_peered":"2024-02-19T21:34:15.383675+0000","last_clean":"2024-02-19T21:34:15.383675+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:34:15.383675+0000","last_undegraded":"2024-02-19T21:34:15.383675+0000","last_fullsized":"2024-02-19T21:34:15.383675+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:34:03.457856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.002439+0000","last_change":"2024-02-19T21:33:31.153117+0000","last_active":"2024-02-19T21:34:15.002439+0000","last_peered":"2024-02-19T21:34:15.002439+0000","last_clean":"2024-02-19T21:34:15.002439+0000","last_became_active":"2024-02-19T21:32:23.355525+0000","last_became_peered":"2024-02-19T21:32:23.355525+0000","last_unstale":"2024-02-19T21:34:15.002439+0000","last_undegraded":"2024-02-19T21:34:15.002439+0000","last_fullsized":"2024-02-19T21:34:15.002439+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:31.153022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:31.153022+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"66'11","reported_seq":63,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541916+0000","last_change":"2024-02-19T21:33:28.595457+0000","last_active":"2024-02-19T21:34:14.541916+0000","last_peered":"2024-02-19T21:34:14.541916+0000","last_clean":"2024-02-19T21:34:14.541916+0000","last_became_active":"2024-02-19T21:32:25.372039+0000","last_became_peered":"2024-02-19T21:32:25.372039+0000","last_unstale":"2024-02-19T21:34:14.541916+0000","last_undegraded":"2024-02-19T21:34:14.541916+0000","last_fullsized":"2024-02-19T21:34:14.541916+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:33:28.595355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:28.595355+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.383609+0000","last_change":"2024-02-19T21:34:01.539989+0000","last_active":"2024-02-19T21:34:15.383609+0000","last_peered":"2024-02-19T21:34:15.383609+0000","last_clean":"2024-02-19T21:34:15.383609+0000","last_became_active":"2024-02-19T21:32:29.372163+0000","last_became_peered":"2024-02-19T21:32:29.372163+0000","last_unstale":"2024-02-19T21:34:15.383609+0000","last_undegraded":"2024-02-19T21:34:15.383609+0000","last_fullsized":"2024-02-19T21:34:15.383609+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:34:01.539921+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.001668+0000","last_change":"2024-02-19T21:33:28.116929+0000","last_active":"2024-02-19T21:34:15.001668+0000","last_peered":"2024-02-19T21:34:15.001668+0000","last_clean":"2024-02-19T21:34:15.001668+0000","last_became_active":"2024-02-19T21:32:27.366281+0000","last_became_peered":"2024-02-19T21:32:27.366281+0000","last_unstale":"2024-02-19T21:34:15.001668+0000","last_undegraded":"2024-02-19T21:34:15.001668+0000","last_fullsized":"2024-02-19T21:34:15.001668+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:28.116860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:28.116860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.382763+0000","last_change":"2024-02-19T21:34:08.543506+0000","last_active":"2024-02-19T21:34:15.382763+0000","last_peered":"2024-02-19T21:34:15.382763+0000","last_clean":"2024-02-19T21:34:15.382763+0000","last_became_active":"2024-02-19T21:32:23.355103+0000","last_became_peered":"2024-02-19T21:32:23.355103+0000","last_unstale":"2024-02-19T21:34:15.382763+0000","last_undegraded":"2024-02-19T21:34:15.382763+0000","last_fullsized":"2024-02-19T21:34:15.382763+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:08.543422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:08.543422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"66'4","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.540942+0000","last_change":"2024-02-19T21:34:07.518745+0000","last_active":"2024-02-19T21:34:14.540942+0000","last_peered":"2024-02-19T21:34:14.540942+0000","last_clean":"2024-02-19T21:34:14.540942+0000","last_became_active":"2024-02-19T21:32:25.369139+0000","last_became_peered":"2024-02-19T21:32:25.369139+0000","last_unstale":"2024-02-19T21:34:14.540942+0000","last_undegraded":"2024-02-19T21:34:14.540942+0000","last_fullsized":"2024-02-19T21:34:14.540942+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'4","last_scrub_stamp":"2024-02-19T21:34:07.518657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:07.518657+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541576+0000","last_change":"2024-02-19T21:34:05.506026+0000","last_active":"2024-02-19T21:34:14.541576+0000","last_peered":"2024-02-19T21:34:14.541576+0000","last_clean":"2024-02-19T21:34:14.541576+0000","last_became_active":"2024-02-19T21:32:29.377302+0000","last_became_peered":"2024-02-19T21:32:29.377302+0000","last_unstale":"2024-02-19T21:34:14.541576+0000","last_undegraded":"2024-02-19T21:34:14.541576+0000","last_fullsized":"2024-02-19T21:34:14.541576+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:05.505905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:05.505905+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.738738+0000","last_change":"2024-02-19T21:34:24.738692+0000","last_active":"2024-02-19T21:34:24.738738+0000","last_peered":"2024-02-19T21:34:24.738738+0000","last_clean":"2024-02-19T21:34:24.738738+0000","last_became_active":"2024-02-19T21:32:27.374451+0000","last_became_peered":"2024-02-19T21:32:27.374451+0000","last_unstale":"2024-02-19T21:34:24.738738+0000","last_undegraded":"2024-02-19T21:34:24.738738+0000","last_fullsized":"2024-02-19T21:34:24.738738+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:24.738612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:24.738612+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.758235+0000","last_change":"2024-02-19T21:33:52.933780+0000","last_active":"2024-02-19T21:34:14.758235+0000","last_peered":"2024-02-19T21:34:14.758235+0000","last_clean":"2024-02-19T21:34:14.758235+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:34:14.758235+0000","last_undegraded":"2024-02-19T21:34:14.758235+0000","last_fullsized":"2024-02-19T21:34:14.758235+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:33:52.933689+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"66'11","reported_seq":64,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541700+0000","last_change":"2024-02-19T21:33:30.232415+0000","last_active":"2024-02-19T21:34:14.541700+0000","last_peered":"2024-02-19T21:34:14.541700+0000","last_clean":"2024-02-19T21:34:14.541700+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:34:14.541700+0000","last_undegraded":"2024-02-19T21:34:14.541700+0000","last_fullsized":"2024-02-19T21:34:14.541700+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:33:30.232291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:30.232291+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542439+0000","last_change":"2024-02-19T21:33:42.527908+0000","last_active":"2024-02-19T21:34:14.542439+0000","last_peered":"2024-02-19T21:34:14.542439+0000","last_clean":"2024-02-19T21:34:14.542439+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:34:14.542439+0000","last_undegraded":"2024-02-19T21:34:14.542439+0000","last_fullsized":"2024-02-19T21:34:14.542439+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:42.527849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:42.527849+0000","last_clean_scrub_stamp":"2024-02-19T21:33:42.527849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.560525+0000","last_change":"2024-02-19T21:34:15.560500+0000","last_active":"2024-02-19T21:34:15.560525+0000","last_peered":"2024-02-19T21:34:15.560525+0000","last_clean":"2024-02-19T21:34:15.560525+0000","last_became_active":"2024-02-19T21:32:27.369279+0000","last_became_peered":"2024-02-19T21:32:27.369279+0000","last_unstale":"2024-02-19T21:34:15.560525+0000","last_undegraded":"2024-02-19T21:34:15.560525+0000","last_fullsized":"2024-02-19T21:34:15.560525+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:15.560432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:15.560432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.001961+0000","last_change":"2024-02-19T21:33:44.209744+0000","last_active":"2024-02-19T21:34:15.001961+0000","last_peered":"2024-02-19T21:34:15.001961+0000","last_clean":"2024-02-19T21:34:15.001961+0000","last_became_active":"2024-02-19T21:32:23.357338+0000","last_became_peered":"2024-02-19T21:32:23.357338+0000","last_unstale":"2024-02-19T21:34:15.001961+0000","last_undegraded":"2024-02-19T21:34:15.001961+0000","last_fullsized":"2024-02-19T21:34:15.001961+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:44.209646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:44.209646+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"66'9","reported_seq":61,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.757627+0000","last_change":"2024-02-19T21:34:10.712156+0000","last_active":"2024-02-19T21:34:14.757627+0000","last_peered":"2024-02-19T21:34:14.757627+0000","last_clean":"2024-02-19T21:34:14.757627+0000","last_became_active":"2024-02-19T21:32:25.359777+0000","last_became_peered":"2024-02-19T21:32:25.359777+0000","last_unstale":"2024-02-19T21:34:14.757627+0000","last_undegraded":"2024-02-19T21:34:14.757627+0000","last_fullsized":"2024-02-19T21:34:14.757627+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:34:10.712079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:10.712079+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542319+0000","last_change":"2024-02-19T21:33:49.388307+0000","last_active":"2024-02-19T21:34:14.542319+0000","last_peered":"2024-02-19T21:34:14.542319+0000","last_clean":"2024-02-19T21:34:14.542319+0000","last_became_active":"2024-02-19T21:32:29.371406+0000","last_became_peered":"2024-02-19T21:32:29.371406+0000","last_unstale":"2024-02-19T21:34:14.542319+0000","last_undegraded":"2024-02-19T21:34:14.542319+0000","last_fullsized":"2024-02-19T21:34:14.542319+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:49.388220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:49.388220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"66'8","reported_seq":77,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:31.865927+0000","last_change":"2024-02-19T21:34:17.563543+0000","last_active":"2024-02-19T21:34:31.865927+0000","last_peered":"2024-02-19T21:34:31.865927+0000","last_clean":"2024-02-19T21:34:31.865927+0000","last_became_active":"2024-02-19T21:32:27.365865+0000","last_became_peered":"2024-02-19T21:32:27.365865+0000","last_unstale":"2024-02-19T21:34:31.865927+0000","last_undegraded":"2024-02-19T21:34:31.865927+0000","last_fullsized":"2024-02-19T21:34:31.865927+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:34:17.563474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:17.563474+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542235+0000","last_change":"2024-02-19T21:33:33.550724+0000","last_active":"2024-02-19T21:34:14.542235+0000","last_peered":"2024-02-19T21:34:14.542235+0000","last_clean":"2024-02-19T21:34:14.542235+0000","last_became_active":"2024-02-19T21:32:23.361680+0000","last_became_peered":"2024-02-19T21:32:23.361680+0000","last_unstale":"2024-02-19T21:34:14.542235+0000","last_undegraded":"2024-02-19T21:34:14.542235+0000","last_fullsized":"2024-02-19T21:34:14.542235+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:33.550655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:33.550655+0000","last_clean_scrub_stamp":"2024-02-19T21:33:33.550655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"66'9","reported_seq":60,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.384391+0000","last_change":"2024-02-19T21:33:28.598343+0000","last_active":"2024-02-19T21:34:15.384391+0000","last_peered":"2024-02-19T21:34:15.384391+0000","last_clean":"2024-02-19T21:34:15.384391+0000","last_became_active":"2024-02-19T21:32:25.372206+0000","last_became_peered":"2024-02-19T21:32:25.372206+0000","last_unstale":"2024-02-19T21:34:15.384391+0000","last_undegraded":"2024-02-19T21:34:15.384391+0000","last_fullsized":"2024-02-19T21:34:15.384391+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:33:28.598281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:28.598281+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541643+0000","last_change":"2024-02-19T21:33:35.526933+0000","last_active":"2024-02-19T21:34:14.541643+0000","last_peered":"2024-02-19T21:34:14.541643+0000","last_clean":"2024-02-19T21:34:14.541643+0000","last_became_active":"2024-02-19T21:32:29.376980+0000","last_became_peered":"2024-02-19T21:32:29.376980+0000","last_unstale":"2024-02-19T21:34:14.541643+0000","last_undegraded":"2024-02-19T21:34:14.541643+0000","last_fullsized":"2024-02-19T21:34:14.541643+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:35.526865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:35.526865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"66'8","reported_seq":77,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:31.866032+0000","last_change":"2024-02-19T21:33:47.554077+0000","last_active":"2024-02-19T21:34:31.866032+0000","last_peered":"2024-02-19T21:34:31.866032+0000","last_clean":"2024-02-19T21:34:31.866032+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:34:31.866032+0000","last_undegraded":"2024-02-19T21:34:31.866032+0000","last_fullsized":"2024-02-19T21:34:31.866032+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:33:47.553965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:47.553965+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.382639+0000","last_change":"2024-02-19T21:33:32.648024+0000","last_active":"2024-02-19T21:34:15.382639+0000","last_peered":"2024-02-19T21:34:15.382639+0000","last_clean":"2024-02-19T21:34:15.382639+0000","last_became_active":"2024-02-19T21:32:23.360838+0000","last_became_peered":"2024-02-19T21:32:23.360838+0000","last_unstale":"2024-02-19T21:34:15.382639+0000","last_undegraded":"2024-02-19T21:34:15.382639+0000","last_fullsized":"2024-02-19T21:34:15.382639+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:32.647912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:32.647912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"66'10","reported_seq":59,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542021+0000","last_change":"2024-02-19T21:34:03.508324+0000","last_active":"2024-02-19T21:34:14.542021+0000","last_peered":"2024-02-19T21:34:14.542021+0000","last_clean":"2024-02-19T21:34:14.542021+0000","last_became_active":"2024-02-19T21:32:25.372060+0000","last_became_peered":"2024-02-19T21:32:25.372060+0000","last_unstale":"2024-02-19T21:34:14.542021+0000","last_undegraded":"2024-02-19T21:34:14.542021+0000","last_fullsized":"2024-02-19T21:34:14.542021+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:34:03.508256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:03.508256+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.384150+0000","last_change":"2024-02-19T21:33:43.433355+0000","last_active":"2024-02-19T21:34:15.384150+0000","last_peered":"2024-02-19T21:34:15.384150+0000","last_clean":"2024-02-19T21:34:15.384150+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:34:15.384150+0000","last_undegraded":"2024-02-19T21:34:15.384150+0000","last_fullsized":"2024-02-19T21:34:15.384150+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:43.433289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:43.433289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.667508+0000","last_change":"2024-02-19T21:34:15.667458+0000","last_active":"2024-02-19T21:34:15.667508+0000","last_peered":"2024-02-19T21:34:15.667508+0000","last_clean":"2024-02-19T21:34:15.667508+0000","last_became_active":"2024-02-19T21:32:27.369002+0000","last_became_peered":"2024-02-19T21:32:27.369002+0000","last_unstale":"2024-02-19T21:34:15.667508+0000","last_undegraded":"2024-02-19T21:34:15.667508+0000","last_fullsized":"2024-02-19T21:34:15.667508+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:15.667380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:15.667380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.001702+0000","last_change":"2024-02-19T21:33:35.277987+0000","last_active":"2024-02-19T21:34:15.001702+0000","last_peered":"2024-02-19T21:34:15.001702+0000","last_clean":"2024-02-19T21:34:15.001702+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:34:15.001702+0000","last_undegraded":"2024-02-19T21:34:15.001702+0000","last_fullsized":"2024-02-19T21:34:15.001702+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:35.277904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:35.277904+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"66'6","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:27.480792+0000","last_change":"2024-02-19T21:34:27.480792+0000","last_active":"2024-02-19T21:34:27.480792+0000","last_peered":"2024-02-19T21:34:27.480792+0000","last_clean":"2024-02-19T21:34:27.480792+0000","last_became_active":"2024-02-19T21:32:25.372212+0000","last_became_peered":"2024-02-19T21:32:25.372212+0000","last_unstale":"2024-02-19T21:34:27.480792+0000","last_undegraded":"2024-02-19T21:34:27.480792+0000","last_fullsized":"2024-02-19T21:34:27.480792+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'6","last_scrub_stamp":"2024-02-19T21:34:27.480723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:27.480723+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.209072+0000","last_change":"2024-02-19T21:34:11.111909+0000","last_active":"2024-02-19T21:34:15.209072+0000","last_peered":"2024-02-19T21:34:15.209072+0000","last_clean":"2024-02-19T21:34:15.209072+0000","last_became_active":"2024-02-19T21:32:29.371977+0000","last_became_peered":"2024-02-19T21:32:29.371977+0000","last_unstale":"2024-02-19T21:34:15.209072+0000","last_undegraded":"2024-02-19T21:34:15.209072+0000","last_fullsized":"2024-02-19T21:34:15.209072+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:11.111829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:11.111829+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.527434+0000","last_change":"2024-02-19T21:34:24.527387+0000","last_active":"2024-02-19T21:34:24.527434+0000","last_peered":"2024-02-19T21:34:24.527434+0000","last_clean":"2024-02-19T21:34:24.527434+0000","last_became_active":"2024-02-19T21:32:27.366748+0000","last_became_peered":"2024-02-19T21:32:27.366748+0000","last_unstale":"2024-02-19T21:34:24.527434+0000","last_undegraded":"2024-02-19T21:34:24.527434+0000","last_fullsized":"2024-02-19T21:34:24.527434+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:24.527285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:24.527285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.208843+0000","last_change":"2024-02-19T21:33:32.121300+0000","last_active":"2024-02-19T21:34:15.208843+0000","last_peered":"2024-02-19T21:34:15.208843+0000","last_clean":"2024-02-19T21:34:15.208843+0000","last_became_active":"2024-02-19T21:32:23.358939+0000","last_became_peered":"2024-02-19T21:32:23.358939+0000","last_unstale":"2024-02-19T21:34:15.208843+0000","last_undegraded":"2024-02-19T21:34:15.208843+0000","last_fullsized":"2024-02-19T21:34:15.208843+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:33:32.121205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"66'9","reported_seq":61,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541819+0000","last_change":"2024-02-19T21:33:39.539536+0000","last_active":"2024-02-19T21:34:14.541819+0000","last_peered":"2024-02-19T21:34:14.541819+0000","last_clean":"2024-02-19T21:34:14.541819+0000","last_became_active":"2024-02-19T21:32:25.372106+0000","last_became_peered":"2024-02-19T21:32:25.372106+0000","last_unstale":"2024-02-19T21:34:14.541819+0000","last_undegraded":"2024-02-19T21:34:14.541819+0000","last_fullsized":"2024-02-19T21:34:14.541819+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:33:39.539467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:39.539467+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542973+0000","last_change":"2024-02-19T21:33:42.435113+0000","last_active":"2024-02-19T21:34:14.542973+0000","last_peered":"2024-02-19T21:34:14.542973+0000","last_clean":"2024-02-19T21:34:14.542973+0000","last_became_active":"2024-02-19T21:32:29.376027+0000","last_became_peered":"2024-02-19T21:32:29.376027+0000","last_unstale":"2024-02-19T21:34:14.542973+0000","last_undegraded":"2024-02-19T21:34:14.542973+0000","last_fullsized":"2024-02-19T21:34:14.542973+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:42.435033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:42.435033+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"59'2","reported_seq":60,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542202+0000","last_change":"2024-02-19T21:33:59.315758+0000","last_active":"2024-02-19T21:34:14.542202+0000","last_peered":"2024-02-19T21:34:14.542202+0000","last_clean":"2024-02-19T21:34:14.542202+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:34:14.542202+0000","last_undegraded":"2024-02-19T21:34:14.542202+0000","last_fullsized":"2024-02-19T21:34:14.542202+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-02-19T21:33:59.315689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:59.315689+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"83'17","reported_seq":73,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541463+0000","last_change":"2024-02-19T21:33:43.418544+0000","last_active":"2024-02-19T21:34:14.541463+0000","last_peered":"2024-02-19T21:34:14.541463+0000","last_clean":"2024-02-19T21:34:14.541463+0000","last_became_active":"2024-02-19T21:32:25.366999+0000","last_became_peered":"2024-02-19T21:32:25.366999+0000","last_unstale":"2024-02-19T21:34:14.541463+0000","last_undegraded":"2024-02-19T21:34:14.541463+0000","last_fullsized":"2024-02-19T21:34:14.541463+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'17","last_scrub_stamp":"2024-02-19T21:33:43.418450+0000","last_deep_scrub":"83'17","last_deep_scrub_stamp":"2024-02-19T21:33:43.418450+0000","last_clean_scrub_stamp":"2024-02-19T21:33:43.418450+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.250716+0000","last_change":"2024-02-19T21:34:15.250680+0000","last_active":"2024-02-19T21:34:15.250716+0000","last_peered":"2024-02-19T21:34:15.250716+0000","last_clean":"2024-02-19T21:34:15.250716+0000","last_became_active":"2024-02-19T21:32:27.367022+0000","last_became_peered":"2024-02-19T21:32:27.367022+0000","last_unstale":"2024-02-19T21:34:15.250716+0000","last_undegraded":"2024-02-19T21:34:15.250716+0000","last_fullsized":"2024-02-19T21:34:15.250716+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:15.250615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:15.250615+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542485+0000","last_change":"2024-02-19T21:33:47.550627+0000","last_active":"2024-02-19T21:34:14.542485+0000","last_peered":"2024-02-19T21:34:14.542485+0000","last_clean":"2024-02-19T21:34:14.542485+0000","last_became_active":"2024-02-19T21:32:29.374999+0000","last_became_peered":"2024-02-19T21:32:29.374999+0000","last_unstale":"2024-02-19T21:34:14.542485+0000","last_undegraded":"2024-02-19T21:34:14.542485+0000","last_fullsized":"2024-02-19T21:34:14.542485+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:47.550562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:47.550562+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.758021+0000","last_change":"2024-02-19T21:34:07.772488+0000","last_active":"2024-02-19T21:34:14.758021+0000","last_peered":"2024-02-19T21:34:14.758021+0000","last_clean":"2024-02-19T21:34:14.758021+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:34:14.758021+0000","last_undegraded":"2024-02-19T21:34:14.758021+0000","last_fullsized":"2024-02-19T21:34:14.758021+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:07.772420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:07.772420+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"66'10","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.208625+0000","last_change":"2024-02-19T21:33:55.131166+0000","last_active":"2024-02-19T21:34:15.208625+0000","last_peered":"2024-02-19T21:34:15.208625+0000","last_clean":"2024-02-19T21:34:15.208625+0000","last_became_active":"2024-02-19T21:33:50.752293+0000","last_became_peered":"2024-02-19T21:33:50.752293+0000","last_unstale":"2024-02-19T21:34:15.208625+0000","last_undegraded":"2024-02-19T21:34:15.208625+0000","last_fullsized":"2024-02-19T21:34:15.208625+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:33:55.131045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:55.131045+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":78,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:31.865897+0000","last_change":"2024-02-19T21:33:56.646321+0000","last_active":"2024-02-19T21:34:31.865897+0000","last_peered":"2024-02-19T21:34:31.865897+0000","last_clean":"2024-02-19T21:34:31.865897+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:34:31.865897+0000","last_undegraded":"2024-02-19T21:34:31.865897+0000","last_fullsized":"2024-02-19T21:34:31.865897+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:33:56.646250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:56.646250+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541378+0000","last_change":"2024-02-19T21:33:30.566865+0000","last_active":"2024-02-19T21:34:14.541378+0000","last_peered":"2024-02-19T21:34:14.541378+0000","last_clean":"2024-02-19T21:34:14.541378+0000","last_became_active":"2024-02-19T21:32:29.372330+0000","last_became_peered":"2024-02-19T21:32:29.372330+0000","last_unstale":"2024-02-19T21:34:14.541378+0000","last_undegraded":"2024-02-19T21:34:14.541378+0000","last_fullsized":"2024-02-19T21:34:14.541378+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:30.566737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:30.566737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:38.714799+0000","last_change":"2024-02-19T21:34:38.714799+0000","last_active":"2024-02-19T21:34:38.714799+0000","last_peered":"2024-02-19T21:34:38.714799+0000","last_clean":"2024-02-19T21:34:38.714799+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:34:38.714799+0000","last_undegraded":"2024-02-19T21:34:38.714799+0000","last_fullsized":"2024-02-19T21:34:38.714799+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:38.714714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:34:38.714714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"66'28","reported_seq":120,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:31.866140+0000","last_change":"2024-02-19T21:34:09.728029+0000","last_active":"2024-02-19T21:34:31.866140+0000","last_peered":"2024-02-19T21:34:31.866140+0000","last_clean":"2024-02-19T21:34:31.866140+0000","last_became_active":"2024-02-19T21:32:25.367594+0000","last_became_peered":"2024-02-19T21:32:25.367594+0000","last_unstale":"2024-02-19T21:34:31.866140+0000","last_undegraded":"2024-02-19T21:34:31.866140+0000","last_fullsized":"2024-02-19T21:34:31.866140+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'28","last_scrub_stamp":"2024-02-19T21:34:09.727958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:09.727958+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:20.616240+0000","last_change":"2024-02-19T21:34:20.616213+0000","last_active":"2024-02-19T21:34:20.616240+0000","last_peered":"2024-02-19T21:34:20.616240+0000","last_clean":"2024-02-19T21:34:20.616240+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:34:20.616240+0000","last_undegraded":"2024-02-19T21:34:20.616240+0000","last_fullsized":"2024-02-19T21:34:20.616240+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:20.616142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:20.616142+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.384433+0000","last_change":"2024-02-19T21:33:56.450607+0000","last_active":"2024-02-19T21:34:15.384433+0000","last_peered":"2024-02-19T21:34:15.384433+0000","last_clean":"2024-02-19T21:34:15.384433+0000","last_became_active":"2024-02-19T21:32:29.597365+0000","last_became_peered":"2024-02-19T21:32:29.597365+0000","last_unstale":"2024-02-19T21:34:15.384433+0000","last_undegraded":"2024-02-19T21:34:15.384433+0000","last_fullsized":"2024-02-19T21:34:15.384433+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:56.450495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:56.450495+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"67'5","reported_seq":178,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:37.889864+0000","last_change":"2024-02-19T21:33:46.883485+0000","last_active":"2024-02-19T21:34:37.889864+0000","last_peered":"2024-02-19T21:34:37.889864+0000","last_clean":"2024-02-19T21:34:37.889864+0000","last_became_active":"2024-02-19T21:32:23.354539+0000","last_became_peered":"2024-02-19T21:32:23.354539+0000","last_unstale":"2024-02-19T21:34:37.889864+0000","last_undegraded":"2024-02-19T21:34:37.889864+0000","last_fullsized":"2024-02-19T21:34:37.889864+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5","last_scrub_stamp":"2024-02-19T21:33:46.883416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:46.883416+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":128,"num_read_kb":123,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.208796+0000","last_change":"2024-02-19T21:33:25.090459+0000","last_active":"2024-02-19T21:34:15.208796+0000","last_peered":"2024-02-19T21:34:15.208796+0000","last_clean":"2024-02-19T21:34:15.208796+0000","last_became_active":"2024-02-19T21:32:23.358321+0000","last_became_peered":"2024-02-19T21:32:23.358321+0000","last_unstale":"2024-02-19T21:34:15.208796+0000","last_undegraded":"2024-02-19T21:34:15.208796+0000","last_fullsized":"2024-02-19T21:34:15.208796+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:25.090392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:25.090392+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"66'13","reported_seq":72,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.758060+0000","last_change":"2024-02-19T21:33:44.933158+0000","last_active":"2024-02-19T21:34:14.758060+0000","last_peered":"2024-02-19T21:34:14.758060+0000","last_clean":"2024-02-19T21:34:14.758060+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:34:14.758060+0000","last_undegraded":"2024-02-19T21:34:14.758060+0000","last_fullsized":"2024-02-19T21:34:14.758060+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'13","last_scrub_stamp":"2024-02-19T21:33:44.933086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:44.933086+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.209120+0000","last_change":"2024-02-19T21:33:59.141840+0000","last_active":"2024-02-19T21:34:15.209120+0000","last_peered":"2024-02-19T21:34:15.209120+0000","last_clean":"2024-02-19T21:34:15.209120+0000","last_became_active":"2024-02-19T21:32:27.363740+0000","last_became_peered":"2024-02-19T21:32:27.363740+0000","last_unstale":"2024-02-19T21:34:15.209120+0000","last_undegraded":"2024-02-19T21:34:15.209120+0000","last_fullsized":"2024-02-19T21:34:15.209120+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:59.141746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:59.141746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.385029+0000","last_change":"2024-02-19T21:33:49.500303+0000","last_active":"2024-02-19T21:34:15.385029+0000","last_peered":"2024-02-19T21:34:15.385029+0000","last_clean":"2024-02-19T21:34:15.385029+0000","last_became_active":"2024-02-19T21:32:29.372547+0000","last_became_peered":"2024-02-19T21:32:29.372547+0000","last_unstale":"2024-02-19T21:34:15.385029+0000","last_undegraded":"2024-02-19T21:34:15.385029+0000","last_fullsized":"2024-02-19T21:34:15.385029+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:33:49.500205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541030+0000","last_change":"2024-02-19T21:33:35.584787+0000","last_active":"2024-02-19T21:34:14.541030+0000","last_peered":"2024-02-19T21:34:14.541030+0000","last_clean":"2024-02-19T21:34:14.541030+0000","last_became_active":"2024-02-19T21:32:23.356886+0000","last_became_peered":"2024-02-19T21:32:23.356886+0000","last_unstale":"2024-02-19T21:34:14.541030+0000","last_undegraded":"2024-02-19T21:34:14.541030+0000","last_fullsized":"2024-02-19T21:34:14.541030+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:35.584719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:35.584719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.382764+0000","last_change":"2024-02-19T21:33:58.613482+0000","last_active":"2024-02-19T21:34:15.382764+0000","last_peered":"2024-02-19T21:34:15.382764+0000","last_clean":"2024-02-19T21:34:15.382764+0000","last_became_active":"2024-02-19T21:32:23.361163+0000","last_became_peered":"2024-02-19T21:32:23.361163+0000","last_unstale":"2024-02-19T21:34:15.382764+0000","last_undegraded":"2024-02-19T21:34:15.382764+0000","last_fullsized":"2024-02-19T21:34:15.382764+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:58.613390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:58.613390+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.383453+0000","last_change":"2024-02-19T21:34:13.559724+0000","last_active":"2024-02-19T21:34:15.383453+0000","last_peered":"2024-02-19T21:34:15.383453+0000","last_clean":"2024-02-19T21:34:15.383453+0000","last_became_active":"2024-02-19T21:32:16.878022+0000","last_became_peered":"2024-02-19T21:32:16.878022+0000","last_unstale":"2024-02-19T21:34:15.383453+0000","last_undegraded":"2024-02-19T21:34:15.383453+0000","last_fullsized":"2024-02-19T21:34:15.383453+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:13.559611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:34:13.559611+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"66'14","reported_seq":66,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.002142+0000","last_change":"2024-02-19T21:33:47.226393+0000","last_active":"2024-02-19T21:34:15.002142+0000","last_peered":"2024-02-19T21:34:15.002142+0000","last_clean":"2024-02-19T21:34:15.002142+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:34:15.002142+0000","last_undegraded":"2024-02-19T21:34:15.002142+0000","last_fullsized":"2024-02-19T21:34:15.002142+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'14","last_scrub_stamp":"2024-02-19T21:33:47.226311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:47.226311+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.384296+0000","last_change":"2024-02-19T21:33:32.422229+0000","last_active":"2024-02-19T21:34:15.384296+0000","last_peered":"2024-02-19T21:34:15.384296+0000","last_clean":"2024-02-19T21:34:15.384296+0000","last_became_active":"2024-02-19T21:32:27.373579+0000","last_became_peered":"2024-02-19T21:32:27.373579+0000","last_unstale":"2024-02-19T21:34:15.384296+0000","last_undegraded":"2024-02-19T21:34:15.384296+0000","last_fullsized":"2024-02-19T21:34:15.384296+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:32.422149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:32.422149+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:28.754654+0000","last_change":"2024-02-19T21:34:28.754654+0000","last_active":"2024-02-19T21:34:28.754654+0000","last_peered":"2024-02-19T21:34:28.754654+0000","last_clean":"2024-02-19T21:34:28.754654+0000","last_became_active":"2024-02-19T21:32:29.373625+0000","last_became_peered":"2024-02-19T21:32:29.373625+0000","last_unstale":"2024-02-19T21:34:28.754654+0000","last_undegraded":"2024-02-19T21:34:28.754654+0000","last_fullsized":"2024-02-19T21:34:28.754654+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:28.754584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:28.754584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541422+0000","last_change":"2024-02-19T21:34:12.757010+0000","last_active":"2024-02-19T21:34:14.541422+0000","last_peered":"2024-02-19T21:34:14.541422+0000","last_clean":"2024-02-19T21:34:14.541422+0000","last_became_active":"2024-02-19T21:32:23.359538+0000","last_became_peered":"2024-02-19T21:32:23.359538+0000","last_unstale":"2024-02-19T21:34:14.541422+0000","last_undegraded":"2024-02-19T21:34:14.541422+0000","last_fullsized":"2024-02-19T21:34:14.541422+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:12.756942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:12.756942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.382588+0000","last_change":"2024-02-19T21:34:02.501610+0000","last_active":"2024-02-19T21:34:15.382588+0000","last_peered":"2024-02-19T21:34:15.382588+0000","last_clean":"2024-02-19T21:34:15.382588+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:34:15.382588+0000","last_undegraded":"2024-02-19T21:34:15.382588+0000","last_fullsized":"2024-02-19T21:34:15.382588+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:02.501526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:02.501526+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"66'12","reported_seq":88,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541731+0000","last_change":"2024-02-19T21:33:55.644754+0000","last_active":"2024-02-19T21:34:14.541731+0000","last_peered":"2024-02-19T21:34:14.541731+0000","last_clean":"2024-02-19T21:34:14.541731+0000","last_became_active":"2024-02-19T21:33:50.750727+0000","last_became_peered":"2024-02-19T21:33:50.750727+0000","last_unstale":"2024-02-19T21:34:14.541731+0000","last_undegraded":"2024-02-19T21:34:14.541731+0000","last_fullsized":"2024-02-19T21:34:14.541731+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'12","last_scrub_stamp":"2024-02-19T21:33:55.644685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:55.644685+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.384939+0000","last_change":"2024-02-19T21:34:11.592972+0000","last_active":"2024-02-19T21:34:15.384939+0000","last_peered":"2024-02-19T21:34:15.384939+0000","last_clean":"2024-02-19T21:34:15.384939+0000","last_became_active":"2024-02-19T21:32:27.372460+0000","last_became_peered":"2024-02-19T21:32:27.372460+0000","last_unstale":"2024-02-19T21:34:15.384939+0000","last_undegraded":"2024-02-19T21:34:15.384939+0000","last_fullsized":"2024-02-19T21:34:15.384939+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:11.592905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:11.592905+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.757365+0000","last_change":"2024-02-19T21:34:04.792894+0000","last_active":"2024-02-19T21:34:14.757365+0000","last_peered":"2024-02-19T21:34:14.757365+0000","last_clean":"2024-02-19T21:34:14.757365+0000","last_became_active":"2024-02-19T21:32:29.597270+0000","last_became_peered":"2024-02-19T21:32:29.597270+0000","last_unstale":"2024-02-19T21:34:14.757365+0000","last_undegraded":"2024-02-19T21:34:14.757365+0000","last_fullsized":"2024-02-19T21:34:14.757365+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:04.792805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:04.792805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.383033+0000","last_change":"2024-02-19T21:33:57.499205+0000","last_active":"2024-02-19T21:34:15.383033+0000","last_peered":"2024-02-19T21:34:15.383033+0000","last_clean":"2024-02-19T21:34:15.383033+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:34:15.383033+0000","last_undegraded":"2024-02-19T21:34:15.383033+0000","last_fullsized":"2024-02-19T21:34:15.383033+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:57.499146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:57.499146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"83'27","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542165+0000","last_change":"2024-02-19T21:33:48.591748+0000","last_active":"2024-02-19T21:34:14.542165+0000","last_peered":"2024-02-19T21:34:14.542165+0000","last_clean":"2024-02-19T21:34:14.542165+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:34:14.542165+0000","last_undegraded":"2024-02-19T21:34:14.542165+0000","last_fullsized":"2024-02-19T21:34:14.542165+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'27","last_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:33:48.591669+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.002055+0000","last_change":"2024-02-19T21:33:38.208119+0000","last_active":"2024-02-19T21:34:15.002055+0000","last_peered":"2024-02-19T21:34:15.002055+0000","last_clean":"2024-02-19T21:34:15.002055+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:34:15.002055+0000","last_undegraded":"2024-02-19T21:34:15.002055+0000","last_fullsized":"2024-02-19T21:34:15.002055+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:33:38.208037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541808+0000","last_change":"2024-02-19T21:33:41.431931+0000","last_active":"2024-02-19T21:34:14.541808+0000","last_peered":"2024-02-19T21:34:14.541808+0000","last_clean":"2024-02-19T21:34:14.541808+0000","last_became_active":"2024-02-19T21:32:29.370626+0000","last_became_peered":"2024-02-19T21:32:29.370626+0000","last_unstale":"2024-02-19T21:34:14.541808+0000","last_undegraded":"2024-02-19T21:34:14.541808+0000","last_fullsized":"2024-02-19T21:34:14.541808+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:41.431855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:41.431855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.757941+0000","last_change":"2024-02-19T21:33:59.903426+0000","last_active":"2024-02-19T21:34:14.757941+0000","last_peered":"2024-02-19T21:34:14.757941+0000","last_clean":"2024-02-19T21:34:14.757941+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:34:14.757941+0000","last_undegraded":"2024-02-19T21:34:14.757941+0000","last_fullsized":"2024-02-19T21:34:14.757941+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:59.903366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:59.903366+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"66'18","reported_seq":76,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.540856+0000","last_change":"2024-02-19T21:34:02.539201+0000","last_active":"2024-02-19T21:34:14.540856+0000","last_peered":"2024-02-19T21:34:14.540856+0000","last_clean":"2024-02-19T21:34:14.540856+0000","last_became_active":"2024-02-19T21:32:25.372700+0000","last_became_peered":"2024-02-19T21:32:25.372700+0000","last_unstale":"2024-02-19T21:34:14.540856+0000","last_undegraded":"2024-02-19T21:34:14.540856+0000","last_fullsized":"2024-02-19T21:34:14.540856+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'18","last_scrub_stamp":"2024-02-19T21:34:02.539127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:02.539127+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541529+0000","last_change":"2024-02-19T21:34:04.274710+0000","last_active":"2024-02-19T21:34:14.541529+0000","last_peered":"2024-02-19T21:34:14.541529+0000","last_clean":"2024-02-19T21:34:14.541529+0000","last_became_active":"2024-02-19T21:32:27.363698+0000","last_became_peered":"2024-02-19T21:32:27.363698+0000","last_unstale":"2024-02-19T21:34:14.541529+0000","last_undegraded":"2024-02-19T21:34:14.541529+0000","last_fullsized":"2024-02-19T21:34:14.541529+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:04.274644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:04.274644+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.384295+0000","last_change":"2024-02-19T21:33:46.390169+0000","last_active":"2024-02-19T21:34:15.384295+0000","last_peered":"2024-02-19T21:34:15.384295+0000","last_clean":"2024-02-19T21:34:15.384295+0000","last_became_active":"2024-02-19T21:32:29.597309+0000","last_became_peered":"2024-02-19T21:32:29.597309+0000","last_unstale":"2024-02-19T21:34:15.384295+0000","last_undegraded":"2024-02-19T21:34:15.384295+0000","last_fullsized":"2024-02-19T21:34:15.384295+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:46.390066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:46.390066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.002397+0000","last_change":"2024-02-19T21:33:54.227769+0000","last_active":"2024-02-19T21:34:15.002397+0000","last_peered":"2024-02-19T21:34:15.002397+0000","last_clean":"2024-02-19T21:34:15.002397+0000","last_became_active":"2024-02-19T21:32:23.354215+0000","last_became_peered":"2024-02-19T21:32:23.354215+0000","last_unstale":"2024-02-19T21:34:15.002397+0000","last_undegraded":"2024-02-19T21:34:15.002397+0000","last_fullsized":"2024-02-19T21:34:15.002397+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:54.227674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:54.227674+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"66'14","reported_seq":66,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541383+0000","last_change":"2024-02-19T21:34:10.348935+0000","last_active":"2024-02-19T21:34:14.541383+0000","last_peered":"2024-02-19T21:34:14.541383+0000","last_clean":"2024-02-19T21:34:14.541383+0000","last_became_active":"2024-02-19T21:32:25.358770+0000","last_became_peered":"2024-02-19T21:32:25.358770+0000","last_unstale":"2024-02-19T21:34:14.541383+0000","last_undegraded":"2024-02-19T21:34:14.541383+0000","last_fullsized":"2024-02-19T21:34:14.541383+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'14","last_scrub_stamp":"2024-02-19T21:34:10.348822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:10.348822+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"66'8","reported_seq":80,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:31.865908+0000","last_change":"2024-02-19T21:33:48.482173+0000","last_active":"2024-02-19T21:34:31.865908+0000","last_peered":"2024-02-19T21:34:31.865908+0000","last_clean":"2024-02-19T21:34:31.865908+0000","last_became_active":"2024-02-19T21:32:27.368914+0000","last_became_peered":"2024-02-19T21:32:27.368914+0000","last_unstale":"2024-02-19T21:34:31.865908+0000","last_undegraded":"2024-02-19T21:34:31.865908+0000","last_fullsized":"2024-02-19T21:34:31.865908+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:33:48.482077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:48.482077+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541915+0000","last_change":"2024-02-19T21:34:09.553708+0000","last_active":"2024-02-19T21:34:14.541915+0000","last_peered":"2024-02-19T21:34:14.541915+0000","last_clean":"2024-02-19T21:34:14.541915+0000","last_became_active":"2024-02-19T21:32:29.597229+0000","last_became_peered":"2024-02-19T21:32:29.597229+0000","last_unstale":"2024-02-19T21:34:14.541915+0000","last_undegraded":"2024-02-19T21:34:14.541915+0000","last_fullsized":"2024-02-19T21:34:14.541915+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:09.553584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:09.553584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.384911+0000","last_change":"2024-02-19T21:33:45.555316+0000","last_active":"2024-02-19T21:34:15.384911+0000","last_peered":"2024-02-19T21:34:15.384911+0000","last_clean":"2024-02-19T21:34:15.384911+0000","last_became_active":"2024-02-19T21:32:27.362497+0000","last_became_peered":"2024-02-19T21:32:27.362497+0000","last_unstale":"2024-02-19T21:34:15.384911+0000","last_undegraded":"2024-02-19T21:34:15.384911+0000","last_fullsized":"2024-02-19T21:34:15.384911+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:45.555228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:45.555228+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.382423+0000","last_change":"2024-02-19T21:33:44.409745+0000","last_active":"2024-02-19T21:34:15.382423+0000","last_peered":"2024-02-19T21:34:15.382423+0000","last_clean":"2024-02-19T21:34:15.382423+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:34:15.382423+0000","last_undegraded":"2024-02-19T21:34:15.382423+0000","last_fullsized":"2024-02-19T21:34:15.382423+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:33:44.409655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:44.409655+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"66'11","reported_seq":64,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542090+0000","last_change":"2024-02-19T21:33:40.386202+0000","last_active":"2024-02-19T21:34:14.542090+0000","last_peered":"2024-02-19T21:34:14.542090+0000","last_clean":"2024-02-19T21:34:14.542090+0000","last_became_active":"2024-02-19T21:32:25.361035+0000","last_became_peered":"2024-02-19T21:32:25.361035+0000","last_unstale":"2024-02-19T21:34:14.542090+0000","last_undegraded":"2024-02-19T21:34:14.542090+0000","last_fullsized":"2024-02-19T21:34:14.542090+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:33:40.386081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:40.386081+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.384262+0000","last_change":"2024-02-19T21:33:40.680884+0000","last_active":"2024-02-19T21:34:15.384262+0000","last_peered":"2024-02-19T21:34:15.384262+0000","last_clean":"2024-02-19T21:34:15.384262+0000","last_became_active":"2024-02-19T21:32:29.378462+0000","last_became_peered":"2024-02-19T21:32:29.378462+0000","last_unstale":"2024-02-19T21:34:15.384262+0000","last_undegraded":"2024-02-19T21:34:15.384262+0000","last_fullsized":"2024-02-19T21:34:15.384262+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:40.680819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:40.680819+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"66'8","reported_seq":78,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:31.866115+0000","last_change":"2024-02-19T21:34:01.346726+0000","last_active":"2024-02-19T21:34:31.866115+0000","last_peered":"2024-02-19T21:34:31.866115+0000","last_clean":"2024-02-19T21:34:31.866115+0000","last_became_active":"2024-02-19T21:32:27.367867+0000","last_became_peered":"2024-02-19T21:32:27.367867+0000","last_unstale":"2024-02-19T21:34:31.866115+0000","last_undegraded":"2024-02-19T21:34:31.866115+0000","last_fullsized":"2024-02-19T21:34:31.866115+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:34:01.346647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:01.346647+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.757611+0000","last_change":"2024-02-19T21:33:37.911205+0000","last_active":"2024-02-19T21:34:14.757611+0000","last_peered":"2024-02-19T21:34:14.757611+0000","last_clean":"2024-02-19T21:34:14.757611+0000","last_became_active":"2024-02-19T21:32:23.362738+0000","last_became_peered":"2024-02-19T21:32:23.362738+0000","last_unstale":"2024-02-19T21:34:14.757611+0000","last_undegraded":"2024-02-19T21:34:14.757611+0000","last_fullsized":"2024-02-19T21:34:14.757611+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:33:37.911143+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"66'15","reported_seq":70,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.758056+0000","last_change":"2024-02-19T21:33:54.889202+0000","last_active":"2024-02-19T21:34:14.758056+0000","last_peered":"2024-02-19T21:34:14.758056+0000","last_clean":"2024-02-19T21:34:14.758056+0000","last_became_active":"2024-02-19T21:32:25.367511+0000","last_became_peered":"2024-02-19T21:32:25.367511+0000","last_unstale":"2024-02-19T21:34:14.758056+0000","last_undegraded":"2024-02-19T21:34:14.758056+0000","last_fullsized":"2024-02-19T21:34:14.758056+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:33:54.889130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:54.889130+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541847+0000","last_change":"2024-02-19T21:34:09.303641+0000","last_active":"2024-02-19T21:34:14.541847+0000","last_peered":"2024-02-19T21:34:14.541847+0000","last_clean":"2024-02-19T21:34:14.541847+0000","last_became_active":"2024-02-19T21:32:29.370710+0000","last_became_peered":"2024-02-19T21:32:29.370710+0000","last_unstale":"2024-02-19T21:34:14.541847+0000","last_undegraded":"2024-02-19T21:34:14.541847+0000","last_fullsized":"2024-02-19T21:34:14.541847+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:09.303502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:09.303502+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"83'9","reported_seq":78,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:31.865901+0000","last_change":"2024-02-19T21:33:49.121296+0000","last_active":"2024-02-19T21:34:31.865901+0000","last_peered":"2024-02-19T21:34:31.865901+0000","last_clean":"2024-02-19T21:34:31.865901+0000","last_became_active":"2024-02-19T21:32:27.363859+0000","last_became_peered":"2024-02-19T21:32:27.363859+0000","last_unstale":"2024-02-19T21:34:31.865901+0000","last_undegraded":"2024-02-19T21:34:31.865901+0000","last_fullsized":"2024-02-19T21:34:31.865901+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'9","last_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:33:49.121238+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.757920+0000","last_change":"2024-02-19T21:34:01.906245+0000","last_active":"2024-02-19T21:34:14.757920+0000","last_peered":"2024-02-19T21:34:14.757920+0000","last_clean":"2024-02-19T21:34:14.757920+0000","last_became_active":"2024-02-19T21:32:23.363155+0000","last_became_peered":"2024-02-19T21:32:23.363155+0000","last_unstale":"2024-02-19T21:34:14.757920+0000","last_undegraded":"2024-02-19T21:34:14.757920+0000","last_fullsized":"2024-02-19T21:34:14.757920+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:01.906174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:01.906174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"66'10","reported_seq":60,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541689+0000","last_change":"2024-02-19T21:33:27.192698+0000","last_active":"2024-02-19T21:34:14.541689+0000","last_peered":"2024-02-19T21:34:14.541689+0000","last_clean":"2024-02-19T21:34:14.541689+0000","last_became_active":"2024-02-19T21:32:25.364180+0000","last_became_peered":"2024-02-19T21:32:25.364180+0000","last_unstale":"2024-02-19T21:34:14.541689+0000","last_undegraded":"2024-02-19T21:34:14.541689+0000","last_fullsized":"2024-02-19T21:34:14.541689+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:33:27.192584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:27.192584+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.209250+0000","last_change":"2024-02-19T21:34:04.048256+0000","last_active":"2024-02-19T21:34:15.209250+0000","last_peered":"2024-02-19T21:34:15.209250+0000","last_clean":"2024-02-19T21:34:15.209250+0000","last_became_active":"2024-02-19T21:32:29.371946+0000","last_became_peered":"2024-02-19T21:32:29.371946+0000","last_unstale":"2024-02-19T21:34:15.209250+0000","last_undegraded":"2024-02-19T21:34:15.209250+0000","last_fullsized":"2024-02-19T21:34:15.209250+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:04.048187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:04.048187+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:16.785782+0000","last_change":"2024-02-19T21:34:16.785756+0000","last_active":"2024-02-19T21:34:16.785782+0000","last_peered":"2024-02-19T21:34:16.785782+0000","last_clean":"2024-02-19T21:34:16.785782+0000","last_became_active":"2024-02-19T21:32:27.369452+0000","last_became_peered":"2024-02-19T21:32:27.369452+0000","last_unstale":"2024-02-19T21:34:16.785782+0000","last_undegraded":"2024-02-19T21:34:16.785782+0000","last_fullsized":"2024-02-19T21:34:16.785782+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:16.785689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:16.785689+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.382898+0000","last_change":"2024-02-19T21:33:39.415142+0000","last_active":"2024-02-19T21:34:15.382898+0000","last_peered":"2024-02-19T21:34:15.382898+0000","last_clean":"2024-02-19T21:34:15.382898+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:34:15.382898+0000","last_undegraded":"2024-02-19T21:34:15.382898+0000","last_fullsized":"2024-02-19T21:34:15.382898+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:33:39.415072+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"66'17","reported_seq":78,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:37.259118+0000","last_change":"2024-02-19T21:34:37.259118+0000","last_active":"2024-02-19T21:34:37.259118+0000","last_peered":"2024-02-19T21:34:37.259118+0000","last_clean":"2024-02-19T21:34:37.259118+0000","last_became_active":"2024-02-19T21:32:25.362454+0000","last_became_peered":"2024-02-19T21:32:25.362454+0000","last_unstale":"2024-02-19T21:34:37.259118+0000","last_undegraded":"2024-02-19T21:34:37.259118+0000","last_fullsized":"2024-02-19T21:34:37.259118+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'17","last_scrub_stamp":"2024-02-19T21:34:37.259020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:37.259020+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.383347+0000","last_change":"2024-02-19T21:34:04.422674+0000","last_active":"2024-02-19T21:34:15.383347+0000","last_peered":"2024-02-19T21:34:15.383347+0000","last_clean":"2024-02-19T21:34:15.383347+0000","last_became_active":"2024-02-19T21:32:29.373442+0000","last_became_peered":"2024-02-19T21:32:29.373442+0000","last_unstale":"2024-02-19T21:34:15.383347+0000","last_undegraded":"2024-02-19T21:34:15.383347+0000","last_fullsized":"2024-02-19T21:34:15.383347+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:04.422580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:04.422580+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.209049+0000","last_change":"2024-02-19T21:33:42.201180+0000","last_active":"2024-02-19T21:34:15.209049+0000","last_peered":"2024-02-19T21:34:15.209049+0000","last_clean":"2024-02-19T21:34:15.209049+0000","last_became_active":"2024-02-19T21:32:27.369020+0000","last_became_peered":"2024-02-19T21:32:27.369020+0000","last_unstale":"2024-02-19T21:34:15.209049+0000","last_undegraded":"2024-02-19T21:34:15.209049+0000","last_fullsized":"2024-02-19T21:34:15.209049+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:42.201115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:42.201115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"59'1","reported_seq":52,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.209256+0000","last_change":"2024-02-19T21:34:00.104194+0000","last_active":"2024-02-19T21:34:15.209256+0000","last_peered":"2024-02-19T21:34:15.209256+0000","last_clean":"2024-02-19T21:34:15.209256+0000","last_became_active":"2024-02-19T21:32:23.359474+0000","last_became_peered":"2024-02-19T21:32:23.359474+0000","last_unstale":"2024-02-19T21:34:15.209256+0000","last_undegraded":"2024-02-19T21:34:15.209256+0000","last_fullsized":"2024-02-19T21:34:15.209256+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:34:00.104130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:00.104130+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"66'19","reported_seq":75,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.001942+0000","last_change":"2024-02-19T21:33:29.164745+0000","last_active":"2024-02-19T21:34:15.001942+0000","last_peered":"2024-02-19T21:34:15.001942+0000","last_clean":"2024-02-19T21:34:15.001942+0000","last_became_active":"2024-02-19T21:32:25.372284+0000","last_became_peered":"2024-02-19T21:32:25.372284+0000","last_unstale":"2024-02-19T21:34:15.001942+0000","last_undegraded":"2024-02-19T21:34:15.001942+0000","last_fullsized":"2024-02-19T21:34:15.001942+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'19","last_scrub_stamp":"2024-02-19T21:33:29.164641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:29.164641+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.541216+0000","last_change":"2024-02-19T21:33:32.580636+0000","last_active":"2024-02-19T21:34:14.541216+0000","last_peered":"2024-02-19T21:34:14.541216+0000","last_clean":"2024-02-19T21:34:14.541216+0000","last_became_active":"2024-02-19T21:32:29.375689+0000","last_became_peered":"2024-02-19T21:32:29.375689+0000","last_unstale":"2024-02-19T21:34:14.541216+0000","last_undegraded":"2024-02-19T21:34:14.541216+0000","last_fullsized":"2024-02-19T21:34:14.541216+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:32.580572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:32.580572+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.209230+0000","last_change":"2024-02-19T21:33:45.130720+0000","last_active":"2024-02-19T21:34:15.209230+0000","last_peered":"2024-02-19T21:34:15.209230+0000","last_clean":"2024-02-19T21:34:15.209230+0000","last_became_active":"2024-02-19T21:32:27.361539+0000","last_became_peered":"2024-02-19T21:32:27.361539+0000","last_unstale":"2024-02-19T21:34:15.209230+0000","last_undegraded":"2024-02-19T21:34:15.209230+0000","last_fullsized":"2024-02-19T21:34:15.209230+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:45.130644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:45.130644+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.758517+0000","last_change":"2024-02-19T21:34:14.758310+0000","last_active":"2024-02-19T21:34:14.758517+0000","last_peered":"2024-02-19T21:34:14.758517+0000","last_clean":"2024-02-19T21:34:14.758517+0000","last_became_active":"2024-02-19T21:32:23.357438+0000","last_became_peered":"2024-02-19T21:32:23.357438+0000","last_unstale":"2024-02-19T21:34:14.758517+0000","last_undegraded":"2024-02-19T21:34:14.758517+0000","last_fullsized":"2024-02-19T21:34:14.758517+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:14.757665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:14.757665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"66'9","reported_seq":61,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:14.542310+0000","last_change":"2024-02-19T21:33:38.550327+0000","last_active":"2024-02-19T21:34:14.542310+0000","last_peered":"2024-02-19T21:34:14.542310+0000","last_clean":"2024-02-19T21:34:14.542310+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:34:14.542310+0000","last_undegraded":"2024-02-19T21:34:14.542310+0000","last_fullsized":"2024-02-19T21:34:14.542310+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:33:38.550249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:38.550249+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.383147+0000","last_change":"2024-02-19T21:33:36.648174+0000","last_active":"2024-02-19T21:34:15.383147+0000","last_peered":"2024-02-19T21:34:15.383147+0000","last_clean":"2024-02-19T21:34:15.383147+0000","last_became_active":"2024-02-19T21:32:29.597248+0000","last_became_peered":"2024-02-19T21:32:29.597248+0000","last_unstale":"2024-02-19T21:34:15.383147+0000","last_undegraded":"2024-02-19T21:34:15.383147+0000","last_fullsized":"2024-02-19T21:34:15.383147+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:36.648092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:36.648092+0000","last_clean_scrub_stamp":"2024-02-19T21:33:36.648092+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.209184+0000","last_change":"2024-02-19T21:33:47.040363+0000","last_active":"2024-02-19T21:34:15.209184+0000","last_peered":"2024-02-19T21:34:15.209184+0000","last_clean":"2024-02-19T21:34:15.209184+0000","last_became_active":"2024-02-19T21:32:23.357486+0000","last_became_peered":"2024-02-19T21:32:23.357486+0000","last_unstale":"2024-02-19T21:34:15.209184+0000","last_undegraded":"2024-02-19T21:34:15.209184+0000","last_fullsized":"2024-02-19T21:34:15.209184+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:47.040272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:47.040272+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"66'15","reported_seq":69,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-02-19T21:34:15.383017+0000","last_change":"2024-02-19T21:34:00.561967+0000","last_active":"2024-02-19T21:34:15.383017+0000","last_peered":"2024-02-19T21:34:15.383017+0000","last_clean":"2024-02-19T21:34:15.383017+0000","last_became_active":"2024-02-19T21:32:25.372170+0000","last_became_peered":"2024-02-19T21:32:25.372170+0000","last_unstale":"2024-02-19T21:34:15.383017+0000","last_undegraded":"2024-02-19T21:34:15.383017+0000","last_fullsized":"2024-02-19T21:34:15.383017+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:34:00.561883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:00.561883+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"66'8","reported_seq":77,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:31.866025+0000","last_change":"2024-02-19T21:33:38.445505+0000","last_active":"2024-02-19T21:34:31.866025+0000","last_peered":"2024-02-19T21:34:31.866025+0000","last_clean":"2024-02-19T21:34:31.866025+0000","last_became_active":"2024-02-19T21:32:27.369840+0000","last_became_peered":"2024-02-19T21:32:27.369840+0000","last_unstale":"2024-02-19T21:34:31.866025+0000","last_undegraded":"2024-02-19T21:34:31.866025+0000","last_fullsized":"2024-02-19T21:34:31.866025+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:33:38.445424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:38.445424+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65,"ondisk_log_size":65,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":698,"num_read_kb":455,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":408,"ondisk_log_size":408,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":128,"num_read_kb":123,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201310,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297872,"kb_used_data":776,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447280,"statfs":{"total":95995035648,"available":95690014720,"internally_reserved":0,"allocated":794624,"data_stored":397926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53900000000000003,"15min":0.54500000000000004},"min":{"1min":0.33000000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54200000000000004,"15min":0.54500000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.52200000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.32300000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.53200000000000003,"15min":0.54000000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.48499999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.315,"5min":0.313,"15min":0.313},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.53700000000000003}]},{"osd":3,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53300000000000003,"15min":0.53200000000000003},"min":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.57199999999999995}]},{"osd":4,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.70399999999999996,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.434},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69799999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.58599999999999997}]},{"osd":5,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.63400000000000001,"15min":0.65800000000000003},"min":{"1min":0.33800000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.69099999999999995,"5min":4.6390000000000002,"15min":4.6390000000000002},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.48099999999999998,"15min":0.47799999999999998},"min":{"1min":0.34699999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55900000000000005}]},{"osd":6,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73199999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.86699999999999999,"15min":0.92200000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80300000000000005,"5min":8.8030000000000008,"15min":8.8030000000000008},"last":0.63200000000000001}]}]},{"osd":6,"up_from":47,"seq":201863462949,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297844,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447308,"statfs":{"total":95995035648,"available":95690043392,"internally_reserved":0,"allocated":765952,"data_stored":396433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:33:50 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.48999999999999999,"15min":0.48599999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.437},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.48499999999999999,"15min":0.47899999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.46200000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:33:50 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.504,"15min":0.502},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.47399999999999998,"15min":0.47099999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.45100000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:33:50 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.505,"15min":0.503},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.503,"5min":0.47399999999999998,"15min":0.46899999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.53100000000000003}]},{"osd":3,"last update":"Mon Feb 19 21:33:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51200000000000001,"15min":0.50800000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.626},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.49199999999999999,"15min":0.48799999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.54300000000000004}]},{"osd":4,"last update":"Mon Feb 19 21:33:50 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.39300000000000002,"15min":0.38300000000000001},"min":{"1min":0.29999999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.443,"5min":0.41099999999999998,"15min":0.40500000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.66400000000000003}]},{"osd":5,"last update":"Mon Feb 19 21:33:50 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.42099999999999999,"15min":0.41599999999999998},"min":{"1min":0.32400000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.41599999999999998,"15min":0.40600000000000003},"min":{"1min":0.33600000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.70099999999999996}]},{"osd":7,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.48999999999999999,"15min":0.48199999999999998},"min":{"1min":0.35599999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.38600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.77500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297908,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447244,"statfs":{"total":95995035648,"available":95689977856,"internally_reserved":0,"allocated":831488,"data_stored":399143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:33:41 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.36199999999999999,"15min":0.34200000000000003},"min":{"1min":0.246,"5min":0.193,"15min":0.193},"max":{"1min":0.502,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.36499999999999999,"15min":0.34100000000000003},"min":{"1min":0.23000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.495,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.30199999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:34:13 2024","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.36399999999999999,"15min":0.36299999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.51600000000000001,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.316},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.39800000000000002,"15min":0.38900000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.45800000000000002,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.35299999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:33:36 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.433,"15min":0.434},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.55200000000000005,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.29099999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.54000000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.34200000000000003}]},{"osd":4,"last update":"Mon Feb 19 21:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.59499999999999997,"15min":0.61499999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.66600000000000004,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.59399999999999997,"15min":0.61399999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.69499999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.53400000000000003}]},{"osd":5,"last update":"Mon Feb 19 21:34:27 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.55400000000000005,"15min":0.57399999999999995},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.72099999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.57699999999999996,"15min":0.60099999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80000000000000004,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.57099999999999995}]},{"osd":6,"last update":"Mon Feb 19 21:33:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.59499999999999997,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73499999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.625},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.60899999999999999,"15min":0.62},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.55000000000000004}]},{"osd":7,"last update":"Mon Feb 19 21:34:18 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.73399999999999999,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.72799999999999998,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.52700000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297880,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447272,"statfs":{"total":95995035648,"available":95690006528,"internally_reserved":0,"allocated":802816,"data_stored":398296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:33:45 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33600000000000002,"15min":0.30399999999999999},"min":{"1min":0.23999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.19800000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.371,"15min":0.31900000000000001},"min":{"1min":0.222,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.403,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.21099999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:34:19 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.39700000000000002,"15min":0.373},"min":{"1min":0.28100000000000003,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.40899999999999997,"15min":0.38200000000000001},"min":{"1min":0.26100000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.25600000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:34:36 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.41399999999999998,"15min":0.40400000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.53100000000000003,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.441,"15min":0.443},"min":{"1min":0.317,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.54000000000000004,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.28599999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:34:03 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59099999999999997,"15min":0.58999999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.59699999999999998,"15min":0.60799999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73999999999999999,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.42899999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.621,"15min":0.629},"min":{"1min":0.42299999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84399999999999997,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.629,"15min":0.63},"min":{"1min":0.40500000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.98799999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.54700000000000004}]},{"osd":6,"last update":"Mon Feb 19 21:33:51 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.622,"15min":0.63400000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77200000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59999999999999998,"15min":0.60399999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.46600000000000003}]},{"osd":7,"last update":"Mon Feb 19 21:34:19 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.62,"15min":0.60999999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.498},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64800000000000002,"15min":0.65000000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91700000000000004,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.50600000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411386,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297860,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447292,"statfs":{"total":95995035648,"available":95690027008,"internally_reserved":0,"allocated":782336,"data_stored":397664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:34:12 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.36399999999999999,"15min":0.34799999999999998},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52100000000000002,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.40200000000000002,"15min":0.40600000000000003},"min":{"1min":0.26700000000000002,"5min":0.193,"15min":0.193},"max":{"1min":0.504,"5min":0.624,"15min":0.624},"last":0.26000000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:34:12 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.376,"15min":0.37},"min":{"1min":0.23100000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.55600000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.25},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.38600000000000001,"15min":0.38400000000000001},"min":{"1min":0.23200000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.48799999999999999,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.23400000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:33:41 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.40500000000000003,"15min":0.40300000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.504,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.372,"5min":0.41199999999999998,"15min":0.41399999999999998},"min":{"1min":0.27700000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.56000000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.28699999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:34:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56499999999999995,"15min":0.57499999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75700000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57399999999999995,"15min":0.57699999999999996},"min":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69899999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.498}]},{"osd":5,"last update":"Mon Feb 19 21:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.59299999999999997,"15min":0.61099999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89400000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.56999999999999995,"15min":0.58399999999999996},"min":{"1min":0.36799999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.39900000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:33:53 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55800000000000005,"15min":0.56499999999999995},"min":{"1min":0.39900000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.73499999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59299999999999997,"15min":0.59899999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.77900000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.47499999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:34:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60299999999999998,"15min":0.60999999999999999},"min":{"1min":0.40100000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80000000000000004,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.38800000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75800000000000001,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.48099999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149749,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297884,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447268,"statfs":{"total":95995035648,"available":95690002432,"internally_reserved":0,"allocated":806912,"data_stored":397538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:33:41 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.40400000000000003,"15min":0.41699999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.42899999999999999,"15min":0.44400000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.52800000000000002,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.40000000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:33:41 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.38400000000000001,"15min":0.39700000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.41399999999999998,"15min":0.432},"min":{"1min":0.27200000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.55000000000000004,"5min":0.625,"15min":0.625},"last":0.32800000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:33:41 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.439,"15min":0.45500000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.53500000000000003,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.377},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.41699999999999998,"15min":0.438},"min":{"1min":0.255,"5min":0.253,"15min":0.253},"max":{"1min":0.59399999999999997,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.35099999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:34:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.57999999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57399999999999995,"15min":0.57799999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.85299999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.53700000000000003}]},{"osd":5,"last update":"Mon Feb 19 21:34:27 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.69999999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.77600000000000002,"5min":0.876,"15min":0.876},"last":0.50900000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:33:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56200000000000006,"15min":0.56399999999999995},"min":{"1min":0.40500000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75600000000000001,"5min":0.87,"15min":0.87},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.59399999999999997}]},{"osd":7,"last update":"Mon Feb 19 21:34:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.432,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.495}]}]},{"osd":4,"up_from":32,"seq":137438953518,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297872,"kb_used_data":776,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447280,"statfs":{"total":95995035648,"available":95690014720,"internally_reserved":0,"allocated":794624,"data_stored":397206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.50600000000000001,"15min":0.51400000000000001},"min":{"1min":0.33100000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.70699999999999996,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79900000000000004,"5min":1.149,"15min":1.149},"last":0.375}]},{"osd":1,"last update":"Mon Feb 19 21:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.51900000000000002,"15min":0.53700000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.66500000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55000000000000004,"15min":0.55800000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.876,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.51800000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54600000000000004,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73399999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.77300000000000002,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.54800000000000004}]},{"osd":3,"last update":"Mon Feb 19 21:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.377,"5min":0.376,"15min":0.376},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.53400000000000003,"15min":0.54400000000000004},"min":{"1min":0.35299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.64400000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.41799999999999998,"15min":0.40000000000000002},"min":{"1min":0.28199999999999997,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.71199999999999997,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.434,"15min":0.41099999999999998},"min":{"1min":0.33700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.65800000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.622}]},{"osd":6,"last update":"Mon Feb 19 21:33:51 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.44500000000000001,"15min":0.438},"min":{"1min":0.32300000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.46500000000000002,"15min":0.45600000000000002},"min":{"1min":0.32000000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.61499999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:34:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52200000000000002,"15min":0.51900000000000002},"min":{"1min":0.36399999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71799999999999997,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.67600000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.59299999999999997}]}]},{"osd":5,"up_from":38,"seq":163208757290,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297856,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447296,"statfs":{"total":95995035648,"available":95690031104,"internally_reserved":0,"allocated":778240,"data_stored":397357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:34:28 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53000000000000003,"15min":0.55000000000000004},"min":{"1min":0.34999999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70599999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64400000000000002,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.71399999999999997}]},{"osd":1,"last update":"Mon Feb 19 21:34:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53900000000000003,"15min":0.55600000000000005},"min":{"1min":0.39400000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.626},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.51100000000000001,"15min":0.52900000000000003},"min":{"1min":0.35099999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.61199999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.68300000000000005}]},{"osd":2,"last update":"Mon Feb 19 21:34:28 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53400000000000003,"15min":0.54200000000000004},"min":{"1min":0.40400000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79600000000000004,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53900000000000003,"15min":0.55100000000000005},"min":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70499999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.75}]},{"osd":3,"last update":"Mon Feb 19 21:34:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55900000000000005,"15min":0.56799999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.76200000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59599999999999997,"15min":0.61499999999999999},"min":{"1min":0.42099999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.748,"5min":0.875,"15min":0.875},"last":0.78000000000000003}]},{"osd":4,"last update":"Mon Feb 19 21:34:28 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.40600000000000003,"15min":0.40400000000000003},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.41999999999999998,"15min":0.41199999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.501}]},{"osd":6,"last update":"Mon Feb 19 21:33:54 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.44900000000000001,"15min":0.439},"min":{"1min":0.33600000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.45100000000000001,"15min":0.435},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.66700000000000004}]},{"osd":7,"last update":"Mon Feb 19 21:34:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80000000000000004,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.73799999999999999,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.59299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:34:45.518 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-02-19T21:34:45.518 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-19T21:34:45.518 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-02-19T21:34:45.518 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph health --format=json 2024-02-19T21:34:45.784 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:34:45.956 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:34:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:34:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:34:46.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:44.682510+0000 mgr.y (mgr.14514) 94 : audit [DBG] from='client.14712 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:34:46.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:44.788785+0000 mgr.y (mgr.14514) 95 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:34:46.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:44.682510+0000 mgr.y (mgr.14514) 94 : audit [DBG] from='client.14712 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:34:46.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:44.788785+0000 mgr.y (mgr.14514) 95 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:34:46.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:44.682510+0000 mgr.y (mgr.14514) 94 : audit [DBG] from='client.14712 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:34:46.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:44.788785+0000 mgr.y (mgr.14514) 95 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:34:47.234 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:46.368920+0000 osd.2 (osd.2) 35 : cluster [DBG] 5.b deep-scrub starts 2024-02-19T21:34:47.234 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:46.372177+0000 osd.2 (osd.2) 36 : cluster [DBG] 5.b deep-scrub ok 2024-02-19T21:34:47.234 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:46.368920+0000 osd.2 (osd.2) 35 : cluster [DBG] 5.b deep-scrub starts 2024-02-19T21:34:47.234 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:46.372177+0000 osd.2 (osd.2) 36 : cluster [DBG] 5.b deep-scrub ok 2024-02-19T21:34:47.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:46.368920+0000 osd.2 (osd.2) 35 : cluster [DBG] 5.b deep-scrub starts 2024-02-19T21:34:47.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:46.372177+0000 osd.2 (osd.2) 36 : cluster [DBG] 5.b deep-scrub ok 2024-02-19T21:34:48.119 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:34:48.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:46.597976+0000 osd.7 (osd.7) 45 : cluster [DBG] 2.b scrub starts 2024-02-19T21:34:48.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:46.600911+0000 osd.7 (osd.7) 46 : cluster [DBG] 2.b scrub ok 2024-02-19T21:34:48.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:46.789166+0000 mgr.y (mgr.14514) 96 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:34:48.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:47.336303+0000 osd.4 (osd.4) 55 : cluster [DBG] 6.1a scrub starts 2024-02-19T21:34:48.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:47.339174+0000 osd.4 (osd.4) 56 : cluster [DBG] 6.1a scrub ok 2024-02-19T21:34:48.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:46.597976+0000 osd.7 (osd.7) 45 : cluster [DBG] 2.b scrub starts 2024-02-19T21:34:48.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:46.600911+0000 osd.7 (osd.7) 46 : cluster [DBG] 2.b scrub ok 2024-02-19T21:34:48.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:46.789166+0000 mgr.y (mgr.14514) 96 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:34:48.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:47.336303+0000 osd.4 (osd.4) 55 : cluster [DBG] 6.1a scrub starts 2024-02-19T21:34:48.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:47.339174+0000 osd.4 (osd.4) 56 : cluster [DBG] 6.1a scrub ok 2024-02-19T21:34:48.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:46.597976+0000 osd.7 (osd.7) 45 : cluster [DBG] 2.b scrub starts 2024-02-19T21:34:48.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:46.600911+0000 osd.7 (osd.7) 46 : cluster [DBG] 2.b scrub ok 2024-02-19T21:34:48.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:46.789166+0000 mgr.y (mgr.14514) 96 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:34:48.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:47.336303+0000 osd.4 (osd.4) 55 : cluster [DBG] 6.1a scrub starts 2024-02-19T21:34:48.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:47.339174+0000 osd.4 (osd.4) 56 : cluster [DBG] 6.1a scrub ok 2024-02-19T21:34:48.886 INFO:teuthology.orchestra.run.smithi080.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-19T21:34:48.887 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-02-19T21:34:48.887 INFO:tasks.cephadm:Setup complete, yielding 2024-02-19T21:34:48.887 INFO:teuthology.run_tasks:Running task thrashosds... 2024-02-19T21:34:48.903 INFO:tasks.thrashosds:config is {'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-02-19T21:34:48.903 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'pacific-release'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'but it is still running', 'objects unfound and apparently lost', '\\(MON_DOWN\\)', '\\(OSDMAP_FLAGS\\)', 'flag\\(s\\) set', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(PG_', '\\(OSD_', {'mons down': None}], 'sha1': '81bd20d634209c7cb82c18be12b4b5a05643ebf1'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'cephadm': {'cephadm_mode': 'root'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '81bd20d634209c7cb82c18be12b4b5a05643ebf1'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'workunit': {'branch': 'pacific-release', 'sha1': '81bd20d634209c7cb82c18be12b4b5a05643ebf1'}} 2024-02-19T21:34:48.903 INFO:tasks.thrashosds:config is {'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-02-19T21:34:48.904 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-02-19T21:34:49.174 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:34:49.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:48.118251+0000 mon.a (mon.0) 765 : audit [DBG] from='client.? 172.21.15.80:0/1921100249' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-19T21:34:49.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:48.569414+0000 osd.3 (osd.3) 53 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:34:49.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:48.573063+0000 osd.3 (osd.3) 54 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:34:49.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:48.118251+0000 mon.a (mon.0) 765 : audit [DBG] from='client.? 172.21.15.80:0/1921100249' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-19T21:34:49.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:48.569414+0000 osd.3 (osd.3) 53 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:34:49.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:48.573063+0000 osd.3 (osd.3) 54 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:34:49.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:48.118251+0000 mon.a (mon.0) 765 : audit [DBG] from='client.? 172.21.15.80:0/1921100249' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-19T21:34:49.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:48.569414+0000 osd.3 (osd.3) 53 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:34:49.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:48.573063+0000 osd.3 (osd.3) 54 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:34:50.249 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:48.789643+0000 mgr.y (mgr.14514) 97 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:34:50.249 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:49.326306+0000 osd.4 (osd.4) 57 : cluster [DBG] 4.18 deep-scrub starts 2024-02-19T21:34:50.249 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:49.331643+0000 osd.4 (osd.4) 58 : cluster [DBG] 4.18 deep-scrub ok 2024-02-19T21:34:50.249 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:49.369941+0000 osd.2 (osd.2) 37 : cluster [DBG] 2.1 scrub starts 2024-02-19T21:34:50.249 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:49.373097+0000 osd.2 (osd.2) 38 : cluster [DBG] 2.1 scrub ok 2024-02-19T21:34:50.249 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:48.789643+0000 mgr.y (mgr.14514) 97 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:34:50.249 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:49.326306+0000 osd.4 (osd.4) 57 : cluster [DBG] 4.18 deep-scrub starts 2024-02-19T21:34:50.249 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:49.331643+0000 osd.4 (osd.4) 58 : cluster [DBG] 4.18 deep-scrub ok 2024-02-19T21:34:50.250 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:49.369941+0000 osd.2 (osd.2) 37 : cluster [DBG] 2.1 scrub starts 2024-02-19T21:34:50.250 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:49.373097+0000 osd.2 (osd.2) 38 : cluster [DBG] 2.1 scrub ok 2024-02-19T21:34:50.308 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:34:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:34:50.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:48.789643+0000 mgr.y (mgr.14514) 97 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:34:50.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:49.326306+0000 osd.4 (osd.4) 57 : cluster [DBG] 4.18 deep-scrub starts 2024-02-19T21:34:50.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:49.331643+0000 osd.4 (osd.4) 58 : cluster [DBG] 4.18 deep-scrub ok 2024-02-19T21:34:50.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:49.369941+0000 osd.2 (osd.2) 37 : cluster [DBG] 2.1 scrub starts 2024-02-19T21:34:50.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:49.373097+0000 osd.2 (osd.2) 38 : cluster [DBG] 2.1 scrub ok 2024-02-19T21:34:50.976 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:34:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:34:50] "GET /metrics HTTP/1.1" 200 172149 "" "Prometheus/2.33.4" 2024-02-19T21:34:50.977 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:49.517126+0000 osd.7 (osd.7) 47 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:34:50.977 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:49.520021+0000 osd.7 (osd.7) 48 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:34:50.977 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:49.877183+0000 mgr.y (mgr.14514) 98 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:34:50.977 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:50.432286+0000 osd.0 (osd.0) 43 : cluster [DBG] 4.1e scrub starts 2024-02-19T21:34:50.977 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:50.434278+0000 osd.0 (osd.0) 44 : cluster [DBG] 4.1e scrub ok 2024-02-19T21:34:51.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:49.517126+0000 osd.7 (osd.7) 47 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:34:51.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:49.520021+0000 osd.7 (osd.7) 48 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:34:51.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:49.877183+0000 mgr.y (mgr.14514) 98 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:34:51.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:50.432286+0000 osd.0 (osd.0) 43 : cluster [DBG] 4.1e scrub starts 2024-02-19T21:34:51.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:50.434278+0000 osd.0 (osd.0) 44 : cluster [DBG] 4.1e scrub ok 2024-02-19T21:34:51.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:49.517126+0000 osd.7 (osd.7) 47 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:34:51.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:49.520021+0000 osd.7 (osd.7) 48 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:34:51.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:49.877183+0000 mgr.y (mgr.14514) 98 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:34:51.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:50.432286+0000 osd.0 (osd.0) 43 : cluster [DBG] 4.1e scrub starts 2024-02-19T21:34:51.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:50.434278+0000 osd.0 (osd.0) 44 : cluster [DBG] 4.1e scrub ok 2024-02-19T21:34:51.831 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:34:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:34:51] ENGINE Bus STOPPING 2024-02-19T21:34:51.831 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:34:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:34:51] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-19T21:34:51.831 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:34:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:34:51] ENGINE Bus STOPPED 2024-02-19T21:34:51.831 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:34:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:34:51] ENGINE Bus STARTING 2024-02-19T21:34:51.831 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:34:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:34:51] ENGINE Serving on http://:::9283 2024-02-19T21:34:51.831 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:34:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:21:34:51] ENGINE Bus STARTED 2024-02-19T21:34:52.295 INFO:tasks.thrashosds:Beginning thrashosds... 2024-02-19T21:34:52.296 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-02-19T21:34:52.296 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:34:52.572 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:34:52.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:50.790334+0000 mgr.y (mgr.14514) 99 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:34:52.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:51.329996+0000 osd.4 (osd.4) 59 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:34:52.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:51.333520+0000 osd.4 (osd.4) 60 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:34:52.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:51.422230+0000 mon.a (mon.0) 766 : audit [INF] from='client.? 172.21.15.80:0/2133819259' entity='client.admin' 2024-02-19T21:34:52.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:51.480024+0000 mon.a (mon.0) 767 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:34:52.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:51.481400+0000 mon.a (mon.0) 768 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:34:52.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:51.481927+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:34:52.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:51.488254+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:34:52.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:51.518873+0000 osd.5 (osd.5) 43 : cluster [DBG] 6.a scrub starts 2024-02-19T21:34:52.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:51.519807+0000 osd.5 (osd.5) 44 : cluster [DBG] 6.a scrub ok 2024-02-19T21:34:52.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:50.790334+0000 mgr.y (mgr.14514) 99 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:34:52.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:51.329996+0000 osd.4 (osd.4) 59 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:34:52.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:51.333520+0000 osd.4 (osd.4) 60 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:34:52.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:51.422230+0000 mon.a (mon.0) 766 : audit [INF] from='client.? 172.21.15.80:0/2133819259' entity='client.admin' 2024-02-19T21:34:52.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:51.480024+0000 mon.a (mon.0) 767 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:34:52.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:51.481400+0000 mon.a (mon.0) 768 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:34:52.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:51.481927+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:34:52.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:51.488254+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:34:52.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:51.518873+0000 osd.5 (osd.5) 43 : cluster [DBG] 6.a scrub starts 2024-02-19T21:34:52.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:51.519807+0000 osd.5 (osd.5) 44 : cluster [DBG] 6.a scrub ok 2024-02-19T21:34:52.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:50.790334+0000 mgr.y (mgr.14514) 99 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:34:52.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:51.329996+0000 osd.4 (osd.4) 59 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:34:52.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:51.333520+0000 osd.4 (osd.4) 60 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:34:52.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:51.422230+0000 mon.a (mon.0) 766 : audit [INF] from='client.? 172.21.15.80:0/2133819259' entity='client.admin' 2024-02-19T21:34:52.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:51.480024+0000 mon.a (mon.0) 767 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:34:52.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:51.481400+0000 mon.a (mon.0) 768 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:34:52.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:51.481927+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:34:52.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:51.488254+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:34:52.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:51.518873+0000 osd.5 (osd.5) 43 : cluster [DBG] 6.a scrub starts 2024-02-19T21:34:52.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:51.519807+0000 osd.5 (osd.5) 44 : cluster [DBG] 6.a scrub ok 2024-02-19T21:34:53.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:51.878926+0000 osd.6 (osd.6) 33 : cluster [DBG] 4.a scrub starts 2024-02-19T21:34:53.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:51.882608+0000 osd.6 (osd.6) 34 : cluster [DBG] 4.a scrub ok 2024-02-19T21:34:53.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:52.334566+0000 osd.2 (osd.2) 39 : cluster [DBG] 5.a scrub starts 2024-02-19T21:34:53.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:52.337476+0000 osd.2 (osd.2) 40 : cluster [DBG] 5.a scrub ok 2024-02-19T21:34:53.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:51.878926+0000 osd.6 (osd.6) 33 : cluster [DBG] 4.a scrub starts 2024-02-19T21:34:53.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:51.882608+0000 osd.6 (osd.6) 34 : cluster [DBG] 4.a scrub ok 2024-02-19T21:34:53.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:52.334566+0000 osd.2 (osd.2) 39 : cluster [DBG] 5.a scrub starts 2024-02-19T21:34:53.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:52.337476+0000 osd.2 (osd.2) 40 : cluster [DBG] 5.a scrub ok 2024-02-19T21:34:53.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:51.878926+0000 osd.6 (osd.6) 33 : cluster [DBG] 4.a scrub starts 2024-02-19T21:34:53.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:51.882608+0000 osd.6 (osd.6) 34 : cluster [DBG] 4.a scrub ok 2024-02-19T21:34:53.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:52.334566+0000 osd.2 (osd.2) 39 : cluster [DBG] 5.a scrub starts 2024-02-19T21:34:53.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:52.337476+0000 osd.2 (osd.2) 40 : cluster [DBG] 5.a scrub ok 2024-02-19T21:34:54.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:52.790828+0000 mgr.y (mgr.14514) 100 : cluster [DBG] pgmap v85: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:34:54.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:53.406200+0000 osd.0 (osd.0) 45 : cluster [DBG] 2.13 scrub starts 2024-02-19T21:34:54.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:53.407320+0000 osd.0 (osd.0) 46 : cluster [DBG] 2.13 scrub ok 2024-02-19T21:34:54.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:53.563920+0000 osd.5 (osd.5) 45 : cluster [DBG] 5.1b scrub starts 2024-02-19T21:34:54.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:53.564859+0000 osd.5 (osd.5) 46 : cluster [DBG] 5.1b scrub ok 2024-02-19T21:34:54.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:53.890673+0000 osd.7 (osd.7) 49 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:34:54.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:53.890720+0000 osd.7 (osd.7) 50 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:34:54.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:52.790828+0000 mgr.y (mgr.14514) 100 : cluster [DBG] pgmap v85: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:34:54.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:53.406200+0000 osd.0 (osd.0) 45 : cluster [DBG] 2.13 scrub starts 2024-02-19T21:34:54.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:53.407320+0000 osd.0 (osd.0) 46 : cluster [DBG] 2.13 scrub ok 2024-02-19T21:34:54.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:53.563920+0000 osd.5 (osd.5) 45 : cluster [DBG] 5.1b scrub starts 2024-02-19T21:34:54.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:53.564859+0000 osd.5 (osd.5) 46 : cluster [DBG] 5.1b scrub ok 2024-02-19T21:34:54.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:53.890673+0000 osd.7 (osd.7) 49 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:34:54.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:53.890720+0000 osd.7 (osd.7) 50 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:34:54.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:52.790828+0000 mgr.y (mgr.14514) 100 : cluster [DBG] pgmap v85: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:34:54.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:53.406200+0000 osd.0 (osd.0) 45 : cluster [DBG] 2.13 scrub starts 2024-02-19T21:34:54.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:53.407320+0000 osd.0 (osd.0) 46 : cluster [DBG] 2.13 scrub ok 2024-02-19T21:34:54.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:53.563920+0000 osd.5 (osd.5) 45 : cluster [DBG] 5.1b scrub starts 2024-02-19T21:34:54.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:53.564859+0000 osd.5 (osd.5) 46 : cluster [DBG] 5.1b scrub ok 2024-02-19T21:34:54.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:53.890673+0000 osd.7 (osd.7) 49 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:34:54.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:53.890720+0000 osd.7 (osd.7) 50 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:34:54.872 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:34:54.874 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:34:55.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:54.397405+0000 osd.0 (osd.0) 47 : cluster [DBG] 4.b scrub starts 2024-02-19T21:34:55.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:54.399373+0000 osd.0 (osd.0) 48 : cluster [DBG] 4.b scrub ok 2024-02-19T21:34:55.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:54.430260+0000 mon.a (mon.0) 771 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2024-02-19T21:34:55.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:54.714959+0000 osd.1 (osd.1) 49 : cluster [DBG] 3.0 scrub starts 2024-02-19T21:34:55.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:54.718478+0000 osd.1 (osd.1) 50 : cluster [DBG] 3.0 scrub ok 2024-02-19T21:34:55.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:54.397405+0000 osd.0 (osd.0) 47 : cluster [DBG] 4.b scrub starts 2024-02-19T21:34:55.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:54.399373+0000 osd.0 (osd.0) 48 : cluster [DBG] 4.b scrub ok 2024-02-19T21:34:55.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:54.430260+0000 mon.a (mon.0) 771 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2024-02-19T21:34:55.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:54.714959+0000 osd.1 (osd.1) 49 : cluster [DBG] 3.0 scrub starts 2024-02-19T21:34:55.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:54.718478+0000 osd.1 (osd.1) 50 : cluster [DBG] 3.0 scrub ok 2024-02-19T21:34:55.756 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2024-02-19T21:34:54.791130+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5796,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":863,"num_read_kb":615,"num_write":428,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":488,"ondisk_log_size":488,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":2383024,"kb_used_data":5872,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":747578192,"statfs":{"total":767960285184,"available":765520068608,"internally_reserved":0,"allocated":6012928,"data_stored":3025491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002707"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934325+0000","last_change":"2024-02-19T21:34:08.559052+0000","last_active":"2024-02-19T21:34:24.934325+0000","last_peered":"2024-02-19T21:34:24.934325+0000","last_clean":"2024-02-19T21:34:24.934325+0000","last_became_active":"2024-02-19T21:32:29.599674+0000","last_became_peered":"2024-02-19T21:32:29.599674+0000","last_unstale":"2024-02-19T21:34:24.934325+0000","last_undegraded":"2024-02-19T21:34:24.934325+0000","last_fullsized":"2024-02-19T21:34:24.934325+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:08.558980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:08.558980+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935949+0000","last_change":"2024-02-19T21:33:36.342047+0000","last_active":"2024-02-19T21:34:24.935949+0000","last_peered":"2024-02-19T21:34:24.935949+0000","last_clean":"2024-02-19T21:34:24.935949+0000","last_became_active":"2024-02-19T21:32:27.364767+0000","last_became_peered":"2024-02-19T21:32:27.364767+0000","last_unstale":"2024-02-19T21:34:24.935949+0000","last_undegraded":"2024-02-19T21:34:24.935949+0000","last_fullsized":"2024-02-19T21:34:24.935949+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:36.341941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:36.341941+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898631+0000","last_change":"2024-02-19T21:34:07.755067+0000","last_active":"2024-02-19T21:34:24.898631+0000","last_peered":"2024-02-19T21:34:24.898631+0000","last_clean":"2024-02-19T21:34:24.898631+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:34:24.898631+0000","last_undegraded":"2024-02-19T21:34:24.898631+0000","last_fullsized":"2024-02-19T21:34:24.898631+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:07.754969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:07.754969+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"66'15","reported_seq":70,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934586+0000","last_change":"2024-02-19T21:34:16.531368+0000","last_active":"2024-02-19T21:34:24.934586+0000","last_peered":"2024-02-19T21:34:24.934586+0000","last_clean":"2024-02-19T21:34:24.934586+0000","last_became_active":"2024-02-19T21:32:25.365996+0000","last_became_peered":"2024-02-19T21:32:25.365996+0000","last_unstale":"2024-02-19T21:34:24.934586+0000","last_undegraded":"2024-02-19T21:34:24.934586+0000","last_fullsized":"2024-02-19T21:34:24.934586+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:34:16.531300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:16.531300+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:47.339303+0000","last_change":"2024-02-19T21:34:47.339254+0000","last_active":"2024-02-19T21:34:47.339303+0000","last_peered":"2024-02-19T21:34:47.339303+0000","last_clean":"2024-02-19T21:34:47.339303+0000","last_became_active":"2024-02-19T21:32:29.373546+0000","last_became_peered":"2024-02-19T21:32:29.373546+0000","last_unstale":"2024-02-19T21:34:47.339303+0000","last_undegraded":"2024-02-19T21:34:47.339303+0000","last_fullsized":"2024-02-19T21:34:47.339303+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:47.339178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:47.339178+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:29.779889+0000","last_change":"2024-02-19T21:34:29.779862+0000","last_active":"2024-02-19T21:34:29.779889+0000","last_peered":"2024-02-19T21:34:29.779889+0000","last_clean":"2024-02-19T21:34:29.779889+0000","last_became_active":"2024-02-19T21:32:27.372466+0000","last_became_peered":"2024-02-19T21:32:27.372466+0000","last_unstale":"2024-02-19T21:34:29.779889+0000","last_undegraded":"2024-02-19T21:34:29.779889+0000","last_fullsized":"2024-02-19T21:34:29.779889+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:29.779779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:29.779779+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935460+0000","last_change":"2024-02-19T21:33:46.451703+0000","last_active":"2024-02-19T21:34:24.935460+0000","last_peered":"2024-02-19T21:34:24.935460+0000","last_clean":"2024-02-19T21:34:24.935460+0000","last_became_active":"2024-02-19T21:32:23.356975+0000","last_became_peered":"2024-02-19T21:32:23.356975+0000","last_unstale":"2024-02-19T21:34:24.935460+0000","last_undegraded":"2024-02-19T21:34:24.935460+0000","last_fullsized":"2024-02-19T21:34:24.935460+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:46.451637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:46.451637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"92'13","reported_seq":71,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:49.331762+0000","last_change":"2024-02-19T21:34:49.331728+0000","last_active":"2024-02-19T21:34:49.331762+0000","last_peered":"2024-02-19T21:34:49.331762+0000","last_clean":"2024-02-19T21:34:49.331762+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:34:49.331762+0000","last_undegraded":"2024-02-19T21:34:49.331762+0000","last_fullsized":"2024-02-19T21:34:49.331762+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"92'13","last_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:34:49.331650+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934872+0000","last_change":"2024-02-19T21:34:12.642234+0000","last_active":"2024-02-19T21:34:24.934872+0000","last_peered":"2024-02-19T21:34:24.934872+0000","last_clean":"2024-02-19T21:34:24.934872+0000","last_became_active":"2024-02-19T21:32:29.373648+0000","last_became_peered":"2024-02-19T21:32:29.373648+0000","last_unstale":"2024-02-19T21:34:24.934872+0000","last_undegraded":"2024-02-19T21:34:24.934872+0000","last_fullsized":"2024-02-19T21:34:24.934872+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:12.642155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:12.642155+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.871226+0000","last_change":"2024-02-19T21:34:07.478398+0000","last_active":"2024-02-19T21:34:24.871226+0000","last_peered":"2024-02-19T21:34:24.871226+0000","last_clean":"2024-02-19T21:34:24.871226+0000","last_became_active":"2024-02-19T21:32:27.370308+0000","last_became_peered":"2024-02-19T21:32:27.370308+0000","last_unstale":"2024-02-19T21:34:24.871226+0000","last_undegraded":"2024-02-19T21:34:24.871226+0000","last_fullsized":"2024-02-19T21:34:24.871226+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:07.478319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:07.478319+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.871255+0000","last_change":"2024-02-19T21:34:00.532471+0000","last_active":"2024-02-19T21:34:24.871255+0000","last_peered":"2024-02-19T21:34:24.871255+0000","last_clean":"2024-02-19T21:34:24.871255+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:34:24.871255+0000","last_undegraded":"2024-02-19T21:34:24.871255+0000","last_fullsized":"2024-02-19T21:34:24.871255+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:00.532402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:00.532402+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"66'5","reported_seq":76,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:40.263688+0000","last_change":"2024-02-19T21:34:40.263657+0000","last_active":"2024-02-19T21:34:40.263688+0000","last_peered":"2024-02-19T21:34:40.263688+0000","last_clean":"2024-02-19T21:34:40.263688+0000","last_became_active":"2024-02-19T21:33:50.753208+0000","last_became_peered":"2024-02-19T21:33:50.753208+0000","last_unstale":"2024-02-19T21:34:40.263688+0000","last_undegraded":"2024-02-19T21:34:40.263688+0000","last_fullsized":"2024-02-19T21:34:40.263688+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'5","last_scrub_stamp":"2024-02-19T21:34:40.263564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:40.263564+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898163+0000","last_change":"2024-02-19T21:34:13.751793+0000","last_active":"2024-02-19T21:34:24.898163+0000","last_peered":"2024-02-19T21:34:24.898163+0000","last_clean":"2024-02-19T21:34:24.898163+0000","last_became_active":"2024-02-19T21:32:29.373010+0000","last_became_peered":"2024-02-19T21:32:29.373010+0000","last_unstale":"2024-02-19T21:34:24.898163+0000","last_undegraded":"2024-02-19T21:34:24.898163+0000","last_fullsized":"2024-02-19T21:34:24.898163+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:34:13.751725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:13.751725+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:53.564981+0000","last_change":"2024-02-19T21:34:53.564949+0000","last_active":"2024-02-19T21:34:53.564981+0000","last_peered":"2024-02-19T21:34:53.564981+0000","last_clean":"2024-02-19T21:34:53.564981+0000","last_became_active":"2024-02-19T21:32:27.368241+0000","last_became_peered":"2024-02-19T21:32:27.368241+0000","last_unstale":"2024-02-19T21:34:53.564981+0000","last_undegraded":"2024-02-19T21:34:53.564981+0000","last_fullsized":"2024-02-19T21:34:53.564981+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:53.564866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:46.543259+0000","last_clean_scrub_stamp":"2024-02-19T21:34:53.564866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:41.519877+0000","last_change":"2024-02-19T21:34:41.519821+0000","last_active":"2024-02-19T21:34:41.519877+0000","last_peered":"2024-02-19T21:34:41.519877+0000","last_clean":"2024-02-19T21:34:41.519877+0000","last_became_active":"2024-02-19T21:32:23.357179+0000","last_became_peered":"2024-02-19T21:32:23.357179+0000","last_unstale":"2024-02-19T21:34:41.519877+0000","last_undegraded":"2024-02-19T21:34:41.519877+0000","last_fullsized":"2024-02-19T21:34:41.519877+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:41.519714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:41.519714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"89'13","reported_seq":66,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934976+0000","last_change":"2024-02-19T21:34:07.313636+0000","last_active":"2024-02-19T21:34:24.934976+0000","last_peered":"2024-02-19T21:34:24.934976+0000","last_clean":"2024-02-19T21:34:24.934976+0000","last_became_active":"2024-02-19T21:32:25.364237+0000","last_became_peered":"2024-02-19T21:32:25.364237+0000","last_unstale":"2024-02-19T21:34:24.934976+0000","last_undegraded":"2024-02-19T21:34:24.934976+0000","last_fullsized":"2024-02-19T21:34:24.934976+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'13","last_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:34:07.313566+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935509+0000","last_change":"2024-02-19T21:34:20.569197+0000","last_active":"2024-02-19T21:34:24.935509+0000","last_peered":"2024-02-19T21:34:24.935509+0000","last_clean":"2024-02-19T21:34:24.935509+0000","last_became_active":"2024-02-19T21:32:29.597266+0000","last_became_peered":"2024-02-19T21:32:29.597266+0000","last_unstale":"2024-02-19T21:34:24.935509+0000","last_undegraded":"2024-02-19T21:34:24.935509+0000","last_fullsized":"2024-02-19T21:34:24.935509+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:20.569124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:20.569124+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.936914+0000","last_change":"2024-02-19T21:34:13.418409+0000","last_active":"2024-02-19T21:34:24.936914+0000","last_peered":"2024-02-19T21:34:24.936914+0000","last_clean":"2024-02-19T21:34:24.936914+0000","last_became_active":"2024-02-19T21:32:27.368233+0000","last_became_peered":"2024-02-19T21:32:27.368233+0000","last_unstale":"2024-02-19T21:34:24.936914+0000","last_undegraded":"2024-02-19T21:34:24.936914+0000","last_fullsized":"2024-02-19T21:34:24.936914+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:13.418325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:13.418325+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":56,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934496+0000","last_change":"2024-02-19T21:33:55.409204+0000","last_active":"2024-02-19T21:34:24.934496+0000","last_peered":"2024-02-19T21:34:24.934496+0000","last_clean":"2024-02-19T21:34:24.934496+0000","last_became_active":"2024-02-19T21:33:50.753994+0000","last_became_peered":"2024-02-19T21:33:50.753994+0000","last_unstale":"2024-02-19T21:34:24.934496+0000","last_undegraded":"2024-02-19T21:34:24.934496+0000","last_fullsized":"2024-02-19T21:34:24.934496+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:55.409142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:55.409142+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"66'12","reported_seq":68,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935224+0000","last_change":"2024-02-19T21:34:04.494293+0000","last_active":"2024-02-19T21:34:24.935224+0000","last_peered":"2024-02-19T21:34:24.935224+0000","last_clean":"2024-02-19T21:34:24.935224+0000","last_became_active":"2024-02-19T21:32:25.369040+0000","last_became_peered":"2024-02-19T21:32:25.369040+0000","last_unstale":"2024-02-19T21:34:24.935224+0000","last_undegraded":"2024-02-19T21:34:24.935224+0000","last_fullsized":"2024-02-19T21:34:24.935224+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'12","last_scrub_stamp":"2024-02-19T21:34:04.494227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:04.494227+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935670+0000","last_change":"2024-02-19T21:33:45.418945+0000","last_active":"2024-02-19T21:34:24.935670+0000","last_peered":"2024-02-19T21:34:24.935670+0000","last_clean":"2024-02-19T21:34:24.935670+0000","last_became_active":"2024-02-19T21:32:29.597365+0000","last_became_peered":"2024-02-19T21:32:29.597365+0000","last_unstale":"2024-02-19T21:34:24.935670+0000","last_undegraded":"2024-02-19T21:34:24.935670+0000","last_fullsized":"2024-02-19T21:34:24.935670+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:45.418867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:45.418867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.899001+0000","last_change":"2024-02-19T21:34:17.809314+0000","last_active":"2024-02-19T21:34:24.899001+0000","last_peered":"2024-02-19T21:34:24.899001+0000","last_clean":"2024-02-19T21:34:24.899001+0000","last_became_active":"2024-02-19T21:32:27.369757+0000","last_became_peered":"2024-02-19T21:32:27.369757+0000","last_unstale":"2024-02-19T21:34:24.899001+0000","last_undegraded":"2024-02-19T21:34:24.899001+0000","last_fullsized":"2024-02-19T21:34:24.899001+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:17.809245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:17.809245+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:39.022497+0000","last_change":"2024-02-19T21:34:39.022454+0000","last_active":"2024-02-19T21:34:39.022497+0000","last_peered":"2024-02-19T21:34:39.022497+0000","last_clean":"2024-02-19T21:34:39.022497+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:34:39.022497+0000","last_undegraded":"2024-02-19T21:34:39.022497+0000","last_fullsized":"2024-02-19T21:34:39.022497+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:39.022344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:39.022344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"66'15","reported_seq":70,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935242+0000","last_change":"2024-02-19T21:33:40.215778+0000","last_active":"2024-02-19T21:34:24.935242+0000","last_peered":"2024-02-19T21:34:24.935242+0000","last_clean":"2024-02-19T21:34:24.935242+0000","last_became_active":"2024-02-19T21:32:25.365267+0000","last_became_peered":"2024-02-19T21:32:25.365267+0000","last_unstale":"2024-02-19T21:34:24.935242+0000","last_undegraded":"2024-02-19T21:34:24.935242+0000","last_fullsized":"2024-02-19T21:34:24.935242+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:33:40.215704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:40.215704+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:34.776286+0000","last_change":"2024-02-19T21:34:34.776259+0000","last_active":"2024-02-19T21:34:34.776286+0000","last_peered":"2024-02-19T21:34:34.776286+0000","last_clean":"2024-02-19T21:34:34.776286+0000","last_became_active":"2024-02-19T21:32:29.373361+0000","last_became_peered":"2024-02-19T21:32:29.373361+0000","last_unstale":"2024-02-19T21:34:34.776286+0000","last_undegraded":"2024-02-19T21:34:34.776286+0000","last_fullsized":"2024-02-19T21:34:34.776286+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:34.776190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:34.776190+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.899185+0000","last_change":"2024-02-19T21:33:49.602701+0000","last_active":"2024-02-19T21:34:24.899185+0000","last_peered":"2024-02-19T21:34:24.899185+0000","last_clean":"2024-02-19T21:34:24.899185+0000","last_became_active":"2024-02-19T21:32:27.367741+0000","last_became_peered":"2024-02-19T21:32:27.367741+0000","last_unstale":"2024-02-19T21:34:24.899185+0000","last_undegraded":"2024-02-19T21:34:24.899185+0000","last_fullsized":"2024-02-19T21:34:24.899185+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:49.602639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:49.602639+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934606+0000","last_change":"2024-02-19T21:34:10.565228+0000","last_active":"2024-02-19T21:34:24.934606+0000","last_peered":"2024-02-19T21:34:24.934606+0000","last_clean":"2024-02-19T21:34:24.934606+0000","last_became_active":"2024-02-19T21:32:23.355085+0000","last_became_peered":"2024-02-19T21:32:23.355085+0000","last_unstale":"2024-02-19T21:34:24.934606+0000","last_undegraded":"2024-02-19T21:34:24.934606+0000","last_fullsized":"2024-02-19T21:34:24.934606+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:10.565163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:10.565163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"66'11","reported_seq":64,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.936324+0000","last_change":"2024-02-19T21:33:42.173352+0000","last_active":"2024-02-19T21:34:24.936324+0000","last_peered":"2024-02-19T21:34:24.936324+0000","last_clean":"2024-02-19T21:34:24.936324+0000","last_became_active":"2024-02-19T21:32:25.355939+0000","last_became_peered":"2024-02-19T21:32:25.355939+0000","last_unstale":"2024-02-19T21:34:24.936324+0000","last_undegraded":"2024-02-19T21:34:24.936324+0000","last_fullsized":"2024-02-19T21:34:24.936324+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:33:42.173259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:42.173259+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.871426+0000","last_change":"2024-02-19T21:33:49.401282+0000","last_active":"2024-02-19T21:34:24.871426+0000","last_peered":"2024-02-19T21:34:24.871426+0000","last_clean":"2024-02-19T21:34:24.871426+0000","last_became_active":"2024-02-19T21:32:29.372503+0000","last_became_peered":"2024-02-19T21:32:29.372503+0000","last_unstale":"2024-02-19T21:34:24.871426+0000","last_undegraded":"2024-02-19T21:34:24.871426+0000","last_fullsized":"2024-02-19T21:34:24.871426+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:33:49.401203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:49.401203+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"66'8","reported_seq":84,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:51.869831+0000","last_change":"2024-02-19T21:33:43.197645+0000","last_active":"2024-02-19T21:34:51.869831+0000","last_peered":"2024-02-19T21:34:51.869831+0000","last_clean":"2024-02-19T21:34:51.869831+0000","last_became_active":"2024-02-19T21:32:27.366465+0000","last_became_peered":"2024-02-19T21:32:27.366465+0000","last_unstale":"2024-02-19T21:34:51.869831+0000","last_undegraded":"2024-02-19T21:34:51.869831+0000","last_fullsized":"2024-02-19T21:34:51.869831+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:33:43.197552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:43.197552+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:31.724147+0000","last_change":"2024-02-19T21:34:31.724113+0000","last_active":"2024-02-19T21:34:31.724147+0000","last_peered":"2024-02-19T21:34:31.724147+0000","last_clean":"2024-02-19T21:34:31.724147+0000","last_became_active":"2024-02-19T21:32:23.356323+0000","last_became_peered":"2024-02-19T21:32:23.356323+0000","last_unstale":"2024-02-19T21:34:31.724147+0000","last_undegraded":"2024-02-19T21:34:31.724147+0000","last_fullsized":"2024-02-19T21:34:31.724147+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:31.724027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:31.724027+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"66'10","reported_seq":66,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:50.434383+0000","last_change":"2024-02-19T21:34:50.434355+0000","last_active":"2024-02-19T21:34:50.434383+0000","last_peered":"2024-02-19T21:34:50.434383+0000","last_clean":"2024-02-19T21:34:50.434383+0000","last_became_active":"2024-02-19T21:32:25.372236+0000","last_became_peered":"2024-02-19T21:32:25.372236+0000","last_unstale":"2024-02-19T21:34:50.434383+0000","last_undegraded":"2024-02-19T21:34:50.434383+0000","last_fullsized":"2024-02-19T21:34:50.434383+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:34:50.434284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:50.434284+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934716+0000","last_change":"2024-02-19T21:33:58.442925+0000","last_active":"2024-02-19T21:34:24.934716+0000","last_peered":"2024-02-19T21:34:24.934716+0000","last_clean":"2024-02-19T21:34:24.934716+0000","last_became_active":"2024-02-19T21:32:29.599396+0000","last_became_peered":"2024-02-19T21:32:29.599396+0000","last_unstale":"2024-02-19T21:34:24.934716+0000","last_undegraded":"2024-02-19T21:34:24.934716+0000","last_fullsized":"2024-02-19T21:34:24.934716+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:58.442855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:58.442855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.871398+0000","last_change":"2024-02-19T21:34:03.457957+0000","last_active":"2024-02-19T21:34:24.871398+0000","last_peered":"2024-02-19T21:34:24.871398+0000","last_clean":"2024-02-19T21:34:24.871398+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:34:24.871398+0000","last_undegraded":"2024-02-19T21:34:24.871398+0000","last_fullsized":"2024-02-19T21:34:24.871398+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:34:03.457856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.936585+0000","last_change":"2024-02-19T21:33:31.153117+0000","last_active":"2024-02-19T21:34:24.936585+0000","last_peered":"2024-02-19T21:34:24.936585+0000","last_clean":"2024-02-19T21:34:24.936585+0000","last_became_active":"2024-02-19T21:32:23.355525+0000","last_became_peered":"2024-02-19T21:32:23.355525+0000","last_unstale":"2024-02-19T21:34:24.936585+0000","last_undegraded":"2024-02-19T21:34:24.936585+0000","last_fullsized":"2024-02-19T21:34:24.936585+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:31.153022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:31.153022+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"66'11","reported_seq":69,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:48.573182+0000","last_change":"2024-02-19T21:34:48.573155+0000","last_active":"2024-02-19T21:34:48.573182+0000","last_peered":"2024-02-19T21:34:48.573182+0000","last_clean":"2024-02-19T21:34:48.573182+0000","last_became_active":"2024-02-19T21:32:25.372039+0000","last_became_peered":"2024-02-19T21:32:25.372039+0000","last_unstale":"2024-02-19T21:34:48.573182+0000","last_undegraded":"2024-02-19T21:34:48.573182+0000","last_fullsized":"2024-02-19T21:34:48.573182+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:34:48.573067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:48.573067+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.870910+0000","last_change":"2024-02-19T21:34:01.539989+0000","last_active":"2024-02-19T21:34:24.870910+0000","last_peered":"2024-02-19T21:34:24.870910+0000","last_clean":"2024-02-19T21:34:24.870910+0000","last_became_active":"2024-02-19T21:32:29.372163+0000","last_became_peered":"2024-02-19T21:32:29.372163+0000","last_unstale":"2024-02-19T21:34:24.870910+0000","last_undegraded":"2024-02-19T21:34:24.870910+0000","last_fullsized":"2024-02-19T21:34:24.870910+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:34:01.539921+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:42.965511+0000","last_change":"2024-02-19T21:34:42.965473+0000","last_active":"2024-02-19T21:34:42.965511+0000","last_peered":"2024-02-19T21:34:42.965511+0000","last_clean":"2024-02-19T21:34:42.965511+0000","last_became_active":"2024-02-19T21:32:27.366281+0000","last_became_peered":"2024-02-19T21:32:27.366281+0000","last_unstale":"2024-02-19T21:34:42.965511+0000","last_undegraded":"2024-02-19T21:34:42.965511+0000","last_fullsized":"2024-02-19T21:34:42.965511+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:42.965390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:42.965390+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935105+0000","last_change":"2024-02-19T21:34:08.543506+0000","last_active":"2024-02-19T21:34:24.935105+0000","last_peered":"2024-02-19T21:34:24.935105+0000","last_clean":"2024-02-19T21:34:24.935105+0000","last_became_active":"2024-02-19T21:32:23.355103+0000","last_became_peered":"2024-02-19T21:32:23.355103+0000","last_unstale":"2024-02-19T21:34:24.935105+0000","last_undegraded":"2024-02-19T21:34:24.935105+0000","last_fullsized":"2024-02-19T21:34:24.935105+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:08.543422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:08.543422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"66'4","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934295+0000","last_change":"2024-02-19T21:34:07.518745+0000","last_active":"2024-02-19T21:34:24.934295+0000","last_peered":"2024-02-19T21:34:24.934295+0000","last_clean":"2024-02-19T21:34:24.934295+0000","last_became_active":"2024-02-19T21:32:25.369139+0000","last_became_peered":"2024-02-19T21:32:25.369139+0000","last_unstale":"2024-02-19T21:34:24.934295+0000","last_undegraded":"2024-02-19T21:34:24.934295+0000","last_fullsized":"2024-02-19T21:34:24.934295+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'4","last_scrub_stamp":"2024-02-19T21:34:07.518657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:07.518657+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934435+0000","last_change":"2024-02-19T21:34:05.506026+0000","last_active":"2024-02-19T21:34:24.934435+0000","last_peered":"2024-02-19T21:34:24.934435+0000","last_clean":"2024-02-19T21:34:24.934435+0000","last_became_active":"2024-02-19T21:32:29.377302+0000","last_became_peered":"2024-02-19T21:32:29.377302+0000","last_unstale":"2024-02-19T21:34:24.934435+0000","last_undegraded":"2024-02-19T21:34:24.934435+0000","last_fullsized":"2024-02-19T21:34:24.934435+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:05.505905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:05.505905+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898377+0000","last_change":"2024-02-19T21:34:24.738692+0000","last_active":"2024-02-19T21:34:24.898377+0000","last_peered":"2024-02-19T21:34:24.898377+0000","last_clean":"2024-02-19T21:34:24.898377+0000","last_became_active":"2024-02-19T21:32:27.374451+0000","last_became_peered":"2024-02-19T21:32:27.374451+0000","last_unstale":"2024-02-19T21:34:24.898377+0000","last_undegraded":"2024-02-19T21:34:24.898377+0000","last_fullsized":"2024-02-19T21:34:24.898377+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:24.738612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:24.738612+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898731+0000","last_change":"2024-02-19T21:33:52.933780+0000","last_active":"2024-02-19T21:34:24.898731+0000","last_peered":"2024-02-19T21:34:24.898731+0000","last_clean":"2024-02-19T21:34:24.898731+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:34:24.898731+0000","last_undegraded":"2024-02-19T21:34:24.898731+0000","last_fullsized":"2024-02-19T21:34:24.898731+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:33:52.933689+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"66'11","reported_seq":70,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:51.333643+0000","last_change":"2024-02-19T21:34:51.333606+0000","last_active":"2024-02-19T21:34:51.333643+0000","last_peered":"2024-02-19T21:34:51.333643+0000","last_clean":"2024-02-19T21:34:51.333643+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:34:51.333643+0000","last_undegraded":"2024-02-19T21:34:51.333643+0000","last_fullsized":"2024-02-19T21:34:51.333643+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:34:51.333524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:51.333524+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.897746+0000","last_change":"2024-02-19T21:33:42.527908+0000","last_active":"2024-02-19T21:34:24.897746+0000","last_peered":"2024-02-19T21:34:24.897746+0000","last_clean":"2024-02-19T21:34:24.897746+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:34:24.897746+0000","last_undegraded":"2024-02-19T21:34:24.897746+0000","last_fullsized":"2024-02-19T21:34:24.897746+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:42.527849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:42.527849+0000","last_clean_scrub_stamp":"2024-02-19T21:33:42.527849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934572+0000","last_change":"2024-02-19T21:34:15.560500+0000","last_active":"2024-02-19T21:34:24.934572+0000","last_peered":"2024-02-19T21:34:24.934572+0000","last_clean":"2024-02-19T21:34:24.934572+0000","last_became_active":"2024-02-19T21:32:27.369279+0000","last_became_peered":"2024-02-19T21:32:27.369279+0000","last_unstale":"2024-02-19T21:34:24.934572+0000","last_undegraded":"2024-02-19T21:34:24.934572+0000","last_fullsized":"2024-02-19T21:34:24.934572+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:15.560432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:15.560432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935734+0000","last_change":"2024-02-19T21:33:44.209744+0000","last_active":"2024-02-19T21:34:24.935734+0000","last_peered":"2024-02-19T21:34:24.935734+0000","last_clean":"2024-02-19T21:34:24.935734+0000","last_became_active":"2024-02-19T21:32:23.357338+0000","last_became_peered":"2024-02-19T21:32:23.357338+0000","last_unstale":"2024-02-19T21:34:24.935734+0000","last_undegraded":"2024-02-19T21:34:24.935734+0000","last_fullsized":"2024-02-19T21:34:24.935734+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:44.209646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:44.209646+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"66'9","reported_seq":62,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898349+0000","last_change":"2024-02-19T21:34:10.712156+0000","last_active":"2024-02-19T21:34:24.898349+0000","last_peered":"2024-02-19T21:34:24.898349+0000","last_clean":"2024-02-19T21:34:24.898349+0000","last_became_active":"2024-02-19T21:32:25.359777+0000","last_became_peered":"2024-02-19T21:32:25.359777+0000","last_unstale":"2024-02-19T21:34:24.898349+0000","last_undegraded":"2024-02-19T21:34:24.898349+0000","last_fullsized":"2024-02-19T21:34:24.898349+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:34:10.712079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:10.712079+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.936183+0000","last_change":"2024-02-19T21:33:49.388307+0000","last_active":"2024-02-19T21:34:24.936183+0000","last_peered":"2024-02-19T21:34:24.936183+0000","last_clean":"2024-02-19T21:34:24.936183+0000","last_became_active":"2024-02-19T21:32:29.371406+0000","last_became_peered":"2024-02-19T21:32:29.371406+0000","last_unstale":"2024-02-19T21:34:24.936183+0000","last_undegraded":"2024-02-19T21:34:24.936183+0000","last_fullsized":"2024-02-19T21:34:24.936183+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:49.388220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:49.388220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"66'8","reported_seq":81,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:51.869691+0000","last_change":"2024-02-19T21:34:17.563543+0000","last_active":"2024-02-19T21:34:51.869691+0000","last_peered":"2024-02-19T21:34:51.869691+0000","last_clean":"2024-02-19T21:34:51.869691+0000","last_became_active":"2024-02-19T21:32:27.365865+0000","last_became_peered":"2024-02-19T21:32:27.365865+0000","last_unstale":"2024-02-19T21:34:51.869691+0000","last_undegraded":"2024-02-19T21:34:51.869691+0000","last_fullsized":"2024-02-19T21:34:51.869691+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:34:17.563474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:17.563474+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:53.407416+0000","last_change":"2024-02-19T21:34:53.407392+0000","last_active":"2024-02-19T21:34:53.407416+0000","last_peered":"2024-02-19T21:34:53.407416+0000","last_clean":"2024-02-19T21:34:53.407416+0000","last_became_active":"2024-02-19T21:32:23.361680+0000","last_became_peered":"2024-02-19T21:32:23.361680+0000","last_unstale":"2024-02-19T21:34:53.407416+0000","last_undegraded":"2024-02-19T21:34:53.407416+0000","last_fullsized":"2024-02-19T21:34:53.407416+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:53.407323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:33.550655+0000","last_clean_scrub_stamp":"2024-02-19T21:34:53.407323+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"66'9","reported_seq":61,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935890+0000","last_change":"2024-02-19T21:33:28.598343+0000","last_active":"2024-02-19T21:34:24.935890+0000","last_peered":"2024-02-19T21:34:24.935890+0000","last_clean":"2024-02-19T21:34:24.935890+0000","last_became_active":"2024-02-19T21:32:25.372206+0000","last_became_peered":"2024-02-19T21:32:25.372206+0000","last_unstale":"2024-02-19T21:34:24.935890+0000","last_undegraded":"2024-02-19T21:34:24.935890+0000","last_fullsized":"2024-02-19T21:34:24.935890+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:33:28.598281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:28.598281+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898771+0000","last_change":"2024-02-19T21:33:35.526933+0000","last_active":"2024-02-19T21:34:24.898771+0000","last_peered":"2024-02-19T21:34:24.898771+0000","last_clean":"2024-02-19T21:34:24.898771+0000","last_became_active":"2024-02-19T21:32:29.376980+0000","last_became_peered":"2024-02-19T21:32:29.376980+0000","last_unstale":"2024-02-19T21:34:24.898771+0000","last_undegraded":"2024-02-19T21:34:24.898771+0000","last_fullsized":"2024-02-19T21:34:24.898771+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:35.526865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:35.526865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"66'8","reported_seq":81,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:51.869866+0000","last_change":"2024-02-19T21:33:47.554077+0000","last_active":"2024-02-19T21:34:51.869866+0000","last_peered":"2024-02-19T21:34:51.869866+0000","last_clean":"2024-02-19T21:34:51.869866+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:34:51.869866+0000","last_undegraded":"2024-02-19T21:34:51.869866+0000","last_fullsized":"2024-02-19T21:34:51.869866+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:33:47.553965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:47.553965+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935831+0000","last_change":"2024-02-19T21:33:32.648024+0000","last_active":"2024-02-19T21:34:24.935831+0000","last_peered":"2024-02-19T21:34:24.935831+0000","last_clean":"2024-02-19T21:34:24.935831+0000","last_became_active":"2024-02-19T21:32:23.360838+0000","last_became_peered":"2024-02-19T21:32:23.360838+0000","last_unstale":"2024-02-19T21:34:24.935831+0000","last_undegraded":"2024-02-19T21:34:24.935831+0000","last_fullsized":"2024-02-19T21:34:24.935831+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:32.647912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:32.647912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"66'10","reported_seq":60,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934916+0000","last_change":"2024-02-19T21:34:03.508324+0000","last_active":"2024-02-19T21:34:24.934916+0000","last_peered":"2024-02-19T21:34:24.934916+0000","last_clean":"2024-02-19T21:34:24.934916+0000","last_became_active":"2024-02-19T21:32:25.372060+0000","last_became_peered":"2024-02-19T21:32:25.372060+0000","last_unstale":"2024-02-19T21:34:24.934916+0000","last_undegraded":"2024-02-19T21:34:24.934916+0000","last_fullsized":"2024-02-19T21:34:24.934916+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:34:03.508256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:03.508256+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.871093+0000","last_change":"2024-02-19T21:33:43.433355+0000","last_active":"2024-02-19T21:34:24.871093+0000","last_peered":"2024-02-19T21:34:24.871093+0000","last_clean":"2024-02-19T21:34:24.871093+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:34:24.871093+0000","last_undegraded":"2024-02-19T21:34:24.871093+0000","last_fullsized":"2024-02-19T21:34:24.871093+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:43.433289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:43.433289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934879+0000","last_change":"2024-02-19T21:34:15.667458+0000","last_active":"2024-02-19T21:34:24.934879+0000","last_peered":"2024-02-19T21:34:24.934879+0000","last_clean":"2024-02-19T21:34:24.934879+0000","last_became_active":"2024-02-19T21:32:27.369002+0000","last_became_peered":"2024-02-19T21:32:27.369002+0000","last_unstale":"2024-02-19T21:34:24.934879+0000","last_undegraded":"2024-02-19T21:34:24.934879+0000","last_fullsized":"2024-02-19T21:34:24.934879+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:15.667380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:15.667380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.936705+0000","last_change":"2024-02-19T21:33:35.277987+0000","last_active":"2024-02-19T21:34:24.936705+0000","last_peered":"2024-02-19T21:34:24.936705+0000","last_clean":"2024-02-19T21:34:24.936705+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:34:24.936705+0000","last_undegraded":"2024-02-19T21:34:24.936705+0000","last_fullsized":"2024-02-19T21:34:24.936705+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:35.277904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:35.277904+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"66'6","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:27.480819+0000","last_change":"2024-02-19T21:34:27.480792+0000","last_active":"2024-02-19T21:34:27.480819+0000","last_peered":"2024-02-19T21:34:27.480819+0000","last_clean":"2024-02-19T21:34:27.480819+0000","last_became_active":"2024-02-19T21:32:25.372212+0000","last_became_peered":"2024-02-19T21:32:25.372212+0000","last_unstale":"2024-02-19T21:34:27.480819+0000","last_undegraded":"2024-02-19T21:34:27.480819+0000","last_fullsized":"2024-02-19T21:34:27.480819+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'6","last_scrub_stamp":"2024-02-19T21:34:27.480723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:27.480723+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934975+0000","last_change":"2024-02-19T21:34:11.111909+0000","last_active":"2024-02-19T21:34:24.934975+0000","last_peered":"2024-02-19T21:34:24.934975+0000","last_clean":"2024-02-19T21:34:24.934975+0000","last_became_active":"2024-02-19T21:32:29.371977+0000","last_became_peered":"2024-02-19T21:32:29.371977+0000","last_unstale":"2024-02-19T21:34:24.934975+0000","last_undegraded":"2024-02-19T21:34:24.934975+0000","last_fullsized":"2024-02-19T21:34:24.934975+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:11.111829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:11.111829+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935511+0000","last_change":"2024-02-19T21:34:24.527387+0000","last_active":"2024-02-19T21:34:24.935511+0000","last_peered":"2024-02-19T21:34:24.935511+0000","last_clean":"2024-02-19T21:34:24.935511+0000","last_became_active":"2024-02-19T21:32:27.366748+0000","last_became_peered":"2024-02-19T21:32:27.366748+0000","last_unstale":"2024-02-19T21:34:24.935511+0000","last_undegraded":"2024-02-19T21:34:24.935511+0000","last_fullsized":"2024-02-19T21:34:24.935511+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:24.527285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:24.527285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934206+0000","last_change":"2024-02-19T21:33:32.121300+0000","last_active":"2024-02-19T21:34:24.934206+0000","last_peered":"2024-02-19T21:34:24.934206+0000","last_clean":"2024-02-19T21:34:24.934206+0000","last_became_active":"2024-02-19T21:32:23.358939+0000","last_became_peered":"2024-02-19T21:32:23.358939+0000","last_unstale":"2024-02-19T21:34:24.934206+0000","last_undegraded":"2024-02-19T21:34:24.934206+0000","last_fullsized":"2024-02-19T21:34:24.934206+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:33:32.121205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"66'9","reported_seq":62,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898927+0000","last_change":"2024-02-19T21:33:39.539536+0000","last_active":"2024-02-19T21:34:24.898927+0000","last_peered":"2024-02-19T21:34:24.898927+0000","last_clean":"2024-02-19T21:34:24.898927+0000","last_became_active":"2024-02-19T21:32:25.372106+0000","last_became_peered":"2024-02-19T21:32:25.372106+0000","last_unstale":"2024-02-19T21:34:24.898927+0000","last_undegraded":"2024-02-19T21:34:24.898927+0000","last_fullsized":"2024-02-19T21:34:24.898927+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:33:39.539467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:39.539467+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934648+0000","last_change":"2024-02-19T21:33:42.435113+0000","last_active":"2024-02-19T21:34:24.934648+0000","last_peered":"2024-02-19T21:34:24.934648+0000","last_clean":"2024-02-19T21:34:24.934648+0000","last_became_active":"2024-02-19T21:32:29.376027+0000","last_became_peered":"2024-02-19T21:32:29.376027+0000","last_unstale":"2024-02-19T21:34:24.934648+0000","last_undegraded":"2024-02-19T21:34:24.934648+0000","last_fullsized":"2024-02-19T21:34:24.934648+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:42.435033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:42.435033+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"59'2","reported_seq":61,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935978+0000","last_change":"2024-02-19T21:33:59.315758+0000","last_active":"2024-02-19T21:34:24.935978+0000","last_peered":"2024-02-19T21:34:24.935978+0000","last_clean":"2024-02-19T21:34:24.935978+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:34:24.935978+0000","last_undegraded":"2024-02-19T21:34:24.935978+0000","last_fullsized":"2024-02-19T21:34:24.935978+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-02-19T21:33:59.315689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:59.315689+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"83'17","reported_seq":74,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.936962+0000","last_change":"2024-02-19T21:33:43.418544+0000","last_active":"2024-02-19T21:34:24.936962+0000","last_peered":"2024-02-19T21:34:24.936962+0000","last_clean":"2024-02-19T21:34:24.936962+0000","last_became_active":"2024-02-19T21:32:25.366999+0000","last_became_peered":"2024-02-19T21:32:25.366999+0000","last_unstale":"2024-02-19T21:34:24.936962+0000","last_undegraded":"2024-02-19T21:34:24.936962+0000","last_fullsized":"2024-02-19T21:34:24.936962+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'17","last_scrub_stamp":"2024-02-19T21:33:43.418450+0000","last_deep_scrub":"83'17","last_deep_scrub_stamp":"2024-02-19T21:33:43.418450+0000","last_clean_scrub_stamp":"2024-02-19T21:33:43.418450+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934859+0000","last_change":"2024-02-19T21:34:15.250680+0000","last_active":"2024-02-19T21:34:24.934859+0000","last_peered":"2024-02-19T21:34:24.934859+0000","last_clean":"2024-02-19T21:34:24.934859+0000","last_became_active":"2024-02-19T21:32:27.367022+0000","last_became_peered":"2024-02-19T21:32:27.367022+0000","last_unstale":"2024-02-19T21:34:24.934859+0000","last_undegraded":"2024-02-19T21:34:24.934859+0000","last_fullsized":"2024-02-19T21:34:24.934859+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:15.250615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:15.250615+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.897829+0000","last_change":"2024-02-19T21:33:47.550627+0000","last_active":"2024-02-19T21:34:24.897829+0000","last_peered":"2024-02-19T21:34:24.897829+0000","last_clean":"2024-02-19T21:34:24.897829+0000","last_became_active":"2024-02-19T21:32:29.374999+0000","last_became_peered":"2024-02-19T21:32:29.374999+0000","last_unstale":"2024-02-19T21:34:24.897829+0000","last_undegraded":"2024-02-19T21:34:24.897829+0000","last_fullsized":"2024-02-19T21:34:24.897829+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:47.550562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:47.550562+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898696+0000","last_change":"2024-02-19T21:34:07.772488+0000","last_active":"2024-02-19T21:34:24.898696+0000","last_peered":"2024-02-19T21:34:24.898696+0000","last_clean":"2024-02-19T21:34:24.898696+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:34:24.898696+0000","last_undegraded":"2024-02-19T21:34:24.898696+0000","last_fullsized":"2024-02-19T21:34:24.898696+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:07.772420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:07.772420+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"66'10","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934235+0000","last_change":"2024-02-19T21:33:55.131166+0000","last_active":"2024-02-19T21:34:24.934235+0000","last_peered":"2024-02-19T21:34:24.934235+0000","last_clean":"2024-02-19T21:34:24.934235+0000","last_became_active":"2024-02-19T21:33:50.752293+0000","last_became_peered":"2024-02-19T21:33:50.752293+0000","last_unstale":"2024-02-19T21:34:24.934235+0000","last_undegraded":"2024-02-19T21:34:24.934235+0000","last_fullsized":"2024-02-19T21:34:24.934235+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:33:55.131045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:55.131045+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":82,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:51.869658+0000","last_change":"2024-02-19T21:33:56.646321+0000","last_active":"2024-02-19T21:34:51.869658+0000","last_peered":"2024-02-19T21:34:51.869658+0000","last_clean":"2024-02-19T21:34:51.869658+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:34:51.869658+0000","last_undegraded":"2024-02-19T21:34:51.869658+0000","last_fullsized":"2024-02-19T21:34:51.869658+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:33:56.646250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:56.646250+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935458+0000","last_change":"2024-02-19T21:33:30.566865+0000","last_active":"2024-02-19T21:34:24.935458+0000","last_peered":"2024-02-19T21:34:24.935458+0000","last_clean":"2024-02-19T21:34:24.935458+0000","last_became_active":"2024-02-19T21:32:29.372330+0000","last_became_peered":"2024-02-19T21:32:29.372330+0000","last_unstale":"2024-02-19T21:34:24.935458+0000","last_undegraded":"2024-02-19T21:34:24.935458+0000","last_fullsized":"2024-02-19T21:34:24.935458+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:30.566737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:30.566737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:38.714846+0000","last_change":"2024-02-19T21:34:38.714799+0000","last_active":"2024-02-19T21:34:38.714846+0000","last_peered":"2024-02-19T21:34:38.714846+0000","last_clean":"2024-02-19T21:34:38.714846+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:34:38.714846+0000","last_undegraded":"2024-02-19T21:34:38.714846+0000","last_fullsized":"2024-02-19T21:34:38.714846+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:38.714714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:34:38.714714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"66'28","reported_seq":124,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:51.869650+0000","last_change":"2024-02-19T21:34:09.728029+0000","last_active":"2024-02-19T21:34:51.869650+0000","last_peered":"2024-02-19T21:34:51.869650+0000","last_clean":"2024-02-19T21:34:51.869650+0000","last_became_active":"2024-02-19T21:32:25.367594+0000","last_became_peered":"2024-02-19T21:32:25.367594+0000","last_unstale":"2024-02-19T21:34:51.869650+0000","last_undegraded":"2024-02-19T21:34:51.869650+0000","last_fullsized":"2024-02-19T21:34:51.869650+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'28","last_scrub_stamp":"2024-02-19T21:34:09.727958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:09.727958+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898720+0000","last_change":"2024-02-19T21:34:20.616213+0000","last_active":"2024-02-19T21:34:24.898720+0000","last_peered":"2024-02-19T21:34:24.898720+0000","last_clean":"2024-02-19T21:34:24.898720+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:34:24.898720+0000","last_undegraded":"2024-02-19T21:34:24.898720+0000","last_fullsized":"2024-02-19T21:34:24.898720+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:20.616142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:20.616142+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.871460+0000","last_change":"2024-02-19T21:33:56.450607+0000","last_active":"2024-02-19T21:34:24.871460+0000","last_peered":"2024-02-19T21:34:24.871460+0000","last_clean":"2024-02-19T21:34:24.871460+0000","last_became_active":"2024-02-19T21:32:29.597365+0000","last_became_peered":"2024-02-19T21:32:29.597365+0000","last_unstale":"2024-02-19T21:34:24.871460+0000","last_undegraded":"2024-02-19T21:34:24.871460+0000","last_fullsized":"2024-02-19T21:34:24.871460+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:56.450495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:56.450495+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"67'5","reported_seq":199,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-02-19T21:34:54.718563+0000","last_change":"2024-02-19T21:34:54.718563+0000","last_active":"2024-02-19T21:34:54.718563+0000","last_peered":"2024-02-19T21:34:54.718563+0000","last_clean":"2024-02-19T21:34:54.718563+0000","last_became_active":"2024-02-19T21:32:23.354539+0000","last_became_peered":"2024-02-19T21:32:23.354539+0000","last_unstale":"2024-02-19T21:34:54.718563+0000","last_undegraded":"2024-02-19T21:34:54.718563+0000","last_fullsized":"2024-02-19T21:34:54.718563+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5","last_scrub_stamp":"2024-02-19T21:34:54.718482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:54.718482+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":143,"num_read_kb":138,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:49.373249+0000","last_change":"2024-02-19T21:34:49.373211+0000","last_active":"2024-02-19T21:34:49.373249+0000","last_peered":"2024-02-19T21:34:49.373249+0000","last_clean":"2024-02-19T21:34:49.373249+0000","last_became_active":"2024-02-19T21:32:23.358321+0000","last_became_peered":"2024-02-19T21:32:23.358321+0000","last_unstale":"2024-02-19T21:34:49.373249+0000","last_undegraded":"2024-02-19T21:34:49.373249+0000","last_fullsized":"2024-02-19T21:34:49.373249+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:49.373106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:49.373106+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"66'13","reported_seq":73,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.899413+0000","last_change":"2024-02-19T21:33:44.933158+0000","last_active":"2024-02-19T21:34:24.899413+0000","last_peered":"2024-02-19T21:34:24.899413+0000","last_clean":"2024-02-19T21:34:24.899413+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:34:24.899413+0000","last_undegraded":"2024-02-19T21:34:24.899413+0000","last_fullsized":"2024-02-19T21:34:24.899413+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'13","last_scrub_stamp":"2024-02-19T21:33:44.933086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:44.933086+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934620+0000","last_change":"2024-02-19T21:33:59.141840+0000","last_active":"2024-02-19T21:34:24.934620+0000","last_peered":"2024-02-19T21:34:24.934620+0000","last_clean":"2024-02-19T21:34:24.934620+0000","last_became_active":"2024-02-19T21:32:27.363740+0000","last_became_peered":"2024-02-19T21:32:27.363740+0000","last_unstale":"2024-02-19T21:34:24.934620+0000","last_undegraded":"2024-02-19T21:34:24.934620+0000","last_fullsized":"2024-02-19T21:34:24.934620+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:59.141746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:59.141746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935511+0000","last_change":"2024-02-19T21:33:49.500303+0000","last_active":"2024-02-19T21:34:24.935511+0000","last_peered":"2024-02-19T21:34:24.935511+0000","last_clean":"2024-02-19T21:34:24.935511+0000","last_became_active":"2024-02-19T21:32:29.372547+0000","last_became_peered":"2024-02-19T21:32:29.372547+0000","last_unstale":"2024-02-19T21:34:24.935511+0000","last_undegraded":"2024-02-19T21:34:24.935511+0000","last_fullsized":"2024-02-19T21:34:24.935511+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:33:49.500205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934998+0000","last_change":"2024-02-19T21:33:35.584787+0000","last_active":"2024-02-19T21:34:24.934998+0000","last_peered":"2024-02-19T21:34:24.934998+0000","last_clean":"2024-02-19T21:34:24.934998+0000","last_became_active":"2024-02-19T21:32:23.356886+0000","last_became_peered":"2024-02-19T21:32:23.356886+0000","last_unstale":"2024-02-19T21:34:24.934998+0000","last_undegraded":"2024-02-19T21:34:24.934998+0000","last_fullsized":"2024-02-19T21:34:24.934998+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:35.584719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:35.584719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935112+0000","last_change":"2024-02-19T21:33:58.613482+0000","last_active":"2024-02-19T21:34:24.935112+0000","last_peered":"2024-02-19T21:34:24.935112+0000","last_clean":"2024-02-19T21:34:24.935112+0000","last_became_active":"2024-02-19T21:32:23.361163+0000","last_became_peered":"2024-02-19T21:32:23.361163+0000","last_unstale":"2024-02-19T21:34:24.935112+0000","last_undegraded":"2024-02-19T21:34:24.935112+0000","last_fullsized":"2024-02-19T21:34:24.935112+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:58.613390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:58.613390+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.870818+0000","last_change":"2024-02-19T21:34:13.559724+0000","last_active":"2024-02-19T21:34:24.870818+0000","last_peered":"2024-02-19T21:34:24.870818+0000","last_clean":"2024-02-19T21:34:24.870818+0000","last_became_active":"2024-02-19T21:32:16.878022+0000","last_became_peered":"2024-02-19T21:32:16.878022+0000","last_unstale":"2024-02-19T21:34:24.870818+0000","last_undegraded":"2024-02-19T21:34:24.870818+0000","last_fullsized":"2024-02-19T21:34:24.870818+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:13.559611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:34:13.559611+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"66'14","reported_seq":67,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.936082+0000","last_change":"2024-02-19T21:33:47.226393+0000","last_active":"2024-02-19T21:34:24.936082+0000","last_peered":"2024-02-19T21:34:24.936082+0000","last_clean":"2024-02-19T21:34:24.936082+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:34:24.936082+0000","last_undegraded":"2024-02-19T21:34:24.936082+0000","last_fullsized":"2024-02-19T21:34:24.936082+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'14","last_scrub_stamp":"2024-02-19T21:33:47.226311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:47.226311+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:42.524221+0000","last_change":"2024-02-19T21:34:42.524189+0000","last_active":"2024-02-19T21:34:42.524221+0000","last_peered":"2024-02-19T21:34:42.524221+0000","last_clean":"2024-02-19T21:34:42.524221+0000","last_became_active":"2024-02-19T21:32:27.373579+0000","last_became_peered":"2024-02-19T21:32:27.373579+0000","last_unstale":"2024-02-19T21:34:42.524221+0000","last_undegraded":"2024-02-19T21:34:42.524221+0000","last_fullsized":"2024-02-19T21:34:42.524221+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:42.524061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:42.524061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:28.754694+0000","last_change":"2024-02-19T21:34:28.754654+0000","last_active":"2024-02-19T21:34:28.754694+0000","last_peered":"2024-02-19T21:34:28.754694+0000","last_clean":"2024-02-19T21:34:28.754694+0000","last_became_active":"2024-02-19T21:32:29.373625+0000","last_became_peered":"2024-02-19T21:32:29.373625+0000","last_unstale":"2024-02-19T21:34:28.754694+0000","last_undegraded":"2024-02-19T21:34:28.754694+0000","last_fullsized":"2024-02-19T21:34:28.754694+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:28.754584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:28.754584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898114+0000","last_change":"2024-02-19T21:34:12.757010+0000","last_active":"2024-02-19T21:34:24.898114+0000","last_peered":"2024-02-19T21:34:24.898114+0000","last_clean":"2024-02-19T21:34:24.898114+0000","last_became_active":"2024-02-19T21:32:23.359538+0000","last_became_peered":"2024-02-19T21:32:23.359538+0000","last_unstale":"2024-02-19T21:34:24.898114+0000","last_undegraded":"2024-02-19T21:34:24.898114+0000","last_fullsized":"2024-02-19T21:34:24.898114+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:12.756942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:12.756942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.870816+0000","last_change":"2024-02-19T21:34:02.501610+0000","last_active":"2024-02-19T21:34:24.870816+0000","last_peered":"2024-02-19T21:34:24.870816+0000","last_clean":"2024-02-19T21:34:24.870816+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:34:24.870816+0000","last_undegraded":"2024-02-19T21:34:24.870816+0000","last_fullsized":"2024-02-19T21:34:24.870816+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:02.501526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:02.501526+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"66'12","reported_seq":89,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898851+0000","last_change":"2024-02-19T21:33:55.644754+0000","last_active":"2024-02-19T21:34:24.898851+0000","last_peered":"2024-02-19T21:34:24.898851+0000","last_clean":"2024-02-19T21:34:24.898851+0000","last_became_active":"2024-02-19T21:33:50.750727+0000","last_became_peered":"2024-02-19T21:33:50.750727+0000","last_unstale":"2024-02-19T21:34:24.898851+0000","last_undegraded":"2024-02-19T21:34:24.898851+0000","last_fullsized":"2024-02-19T21:34:24.898851+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'12","last_scrub_stamp":"2024-02-19T21:33:55.644685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:55.644685+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935422+0000","last_change":"2024-02-19T21:34:11.592972+0000","last_active":"2024-02-19T21:34:24.935422+0000","last_peered":"2024-02-19T21:34:24.935422+0000","last_clean":"2024-02-19T21:34:24.935422+0000","last_became_active":"2024-02-19T21:32:27.372460+0000","last_became_peered":"2024-02-19T21:32:27.372460+0000","last_unstale":"2024-02-19T21:34:24.935422+0000","last_undegraded":"2024-02-19T21:34:24.935422+0000","last_fullsized":"2024-02-19T21:34:24.935422+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:11.592905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:11.592905+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898932+0000","last_change":"2024-02-19T21:34:04.792894+0000","last_active":"2024-02-19T21:34:24.898932+0000","last_peered":"2024-02-19T21:34:24.898932+0000","last_clean":"2024-02-19T21:34:24.898932+0000","last_became_active":"2024-02-19T21:32:29.597270+0000","last_became_peered":"2024-02-19T21:32:29.597270+0000","last_unstale":"2024-02-19T21:34:24.898932+0000","last_undegraded":"2024-02-19T21:34:24.898932+0000","last_fullsized":"2024-02-19T21:34:24.898932+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:04.792805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:04.792805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.871678+0000","last_change":"2024-02-19T21:33:57.499205+0000","last_active":"2024-02-19T21:34:24.871678+0000","last_peered":"2024-02-19T21:34:24.871678+0000","last_clean":"2024-02-19T21:34:24.871678+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:34:24.871678+0000","last_undegraded":"2024-02-19T21:34:24.871678+0000","last_fullsized":"2024-02-19T21:34:24.871678+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:57.499146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:57.499146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"83'27","reported_seq":90,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.899056+0000","last_change":"2024-02-19T21:33:48.591748+0000","last_active":"2024-02-19T21:34:24.899056+0000","last_peered":"2024-02-19T21:34:24.899056+0000","last_clean":"2024-02-19T21:34:24.899056+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:34:24.899056+0000","last_undegraded":"2024-02-19T21:34:24.899056+0000","last_fullsized":"2024-02-19T21:34:24.899056+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'27","last_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:33:48.591669+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935176+0000","last_change":"2024-02-19T21:33:38.208119+0000","last_active":"2024-02-19T21:34:24.935176+0000","last_peered":"2024-02-19T21:34:24.935176+0000","last_clean":"2024-02-19T21:34:24.935176+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:34:24.935176+0000","last_undegraded":"2024-02-19T21:34:24.935176+0000","last_fullsized":"2024-02-19T21:34:24.935176+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:33:38.208037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:43.256311+0000","last_change":"2024-02-19T21:34:43.256275+0000","last_active":"2024-02-19T21:34:43.256311+0000","last_peered":"2024-02-19T21:34:43.256311+0000","last_clean":"2024-02-19T21:34:43.256311+0000","last_became_active":"2024-02-19T21:32:29.370626+0000","last_became_peered":"2024-02-19T21:32:29.370626+0000","last_unstale":"2024-02-19T21:34:43.256311+0000","last_undegraded":"2024-02-19T21:34:43.256311+0000","last_fullsized":"2024-02-19T21:34:43.256311+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:43.256178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:43.256178+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.899148+0000","last_change":"2024-02-19T21:33:59.903426+0000","last_active":"2024-02-19T21:34:24.899148+0000","last_peered":"2024-02-19T21:34:24.899148+0000","last_clean":"2024-02-19T21:34:24.899148+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:34:24.899148+0000","last_undegraded":"2024-02-19T21:34:24.899148+0000","last_fullsized":"2024-02-19T21:34:24.899148+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:59.903366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:59.903366+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"66'18","reported_seq":77,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934213+0000","last_change":"2024-02-19T21:34:02.539201+0000","last_active":"2024-02-19T21:34:24.934213+0000","last_peered":"2024-02-19T21:34:24.934213+0000","last_clean":"2024-02-19T21:34:24.934213+0000","last_became_active":"2024-02-19T21:32:25.372700+0000","last_became_peered":"2024-02-19T21:32:25.372700+0000","last_unstale":"2024-02-19T21:34:24.934213+0000","last_undegraded":"2024-02-19T21:34:24.934213+0000","last_fullsized":"2024-02-19T21:34:24.934213+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'18","last_scrub_stamp":"2024-02-19T21:34:02.539127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:02.539127+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.937016+0000","last_change":"2024-02-19T21:34:04.274710+0000","last_active":"2024-02-19T21:34:24.937016+0000","last_peered":"2024-02-19T21:34:24.937016+0000","last_clean":"2024-02-19T21:34:24.937016+0000","last_became_active":"2024-02-19T21:32:27.363698+0000","last_became_peered":"2024-02-19T21:32:27.363698+0000","last_unstale":"2024-02-19T21:34:24.937016+0000","last_undegraded":"2024-02-19T21:34:24.937016+0000","last_fullsized":"2024-02-19T21:34:24.937016+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:04.274644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:04.274644+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:49.520146+0000","last_change":"2024-02-19T21:34:49.520113+0000","last_active":"2024-02-19T21:34:49.520146+0000","last_peered":"2024-02-19T21:34:49.520146+0000","last_clean":"2024-02-19T21:34:49.520146+0000","last_became_active":"2024-02-19T21:32:29.597309+0000","last_became_peered":"2024-02-19T21:32:29.597309+0000","last_unstale":"2024-02-19T21:34:49.520146+0000","last_undegraded":"2024-02-19T21:34:49.520146+0000","last_fullsized":"2024-02-19T21:34:49.520146+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:49.520026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:49.520026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.936505+0000","last_change":"2024-02-19T21:33:54.227769+0000","last_active":"2024-02-19T21:34:24.936505+0000","last_peered":"2024-02-19T21:34:24.936505+0000","last_clean":"2024-02-19T21:34:24.936505+0000","last_became_active":"2024-02-19T21:32:23.354215+0000","last_became_peered":"2024-02-19T21:32:23.354215+0000","last_unstale":"2024-02-19T21:34:24.936505+0000","last_undegraded":"2024-02-19T21:34:24.936505+0000","last_fullsized":"2024-02-19T21:34:24.936505+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:54.227674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:54.227674+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"66'14","reported_seq":67,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.936959+0000","last_change":"2024-02-19T21:34:10.348935+0000","last_active":"2024-02-19T21:34:24.936959+0000","last_peered":"2024-02-19T21:34:24.936959+0000","last_clean":"2024-02-19T21:34:24.936959+0000","last_became_active":"2024-02-19T21:32:25.358770+0000","last_became_peered":"2024-02-19T21:32:25.358770+0000","last_unstale":"2024-02-19T21:34:24.936959+0000","last_undegraded":"2024-02-19T21:34:24.936959+0000","last_fullsized":"2024-02-19T21:34:24.936959+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'14","last_scrub_stamp":"2024-02-19T21:34:10.348822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:10.348822+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"66'8","reported_seq":84,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:51.869669+0000","last_change":"2024-02-19T21:33:48.482173+0000","last_active":"2024-02-19T21:34:51.869669+0000","last_peered":"2024-02-19T21:34:51.869669+0000","last_clean":"2024-02-19T21:34:51.869669+0000","last_became_active":"2024-02-19T21:32:27.368914+0000","last_became_peered":"2024-02-19T21:32:27.368914+0000","last_unstale":"2024-02-19T21:34:51.869669+0000","last_undegraded":"2024-02-19T21:34:51.869669+0000","last_fullsized":"2024-02-19T21:34:51.869669+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:33:48.482077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:48.482077+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934828+0000","last_change":"2024-02-19T21:34:09.553708+0000","last_active":"2024-02-19T21:34:24.934828+0000","last_peered":"2024-02-19T21:34:24.934828+0000","last_clean":"2024-02-19T21:34:24.934828+0000","last_became_active":"2024-02-19T21:32:29.597229+0000","last_became_peered":"2024-02-19T21:32:29.597229+0000","last_unstale":"2024-02-19T21:34:24.934828+0000","last_undegraded":"2024-02-19T21:34:24.934828+0000","last_fullsized":"2024-02-19T21:34:24.934828+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:09.553584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:09.553584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935340+0000","last_change":"2024-02-19T21:33:45.555316+0000","last_active":"2024-02-19T21:34:24.935340+0000","last_peered":"2024-02-19T21:34:24.935340+0000","last_clean":"2024-02-19T21:34:24.935340+0000","last_became_active":"2024-02-19T21:32:27.362497+0000","last_became_peered":"2024-02-19T21:32:27.362497+0000","last_unstale":"2024-02-19T21:34:24.935340+0000","last_undegraded":"2024-02-19T21:34:24.935340+0000","last_fullsized":"2024-02-19T21:34:24.935340+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:45.555228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:45.555228+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.870942+0000","last_change":"2024-02-19T21:33:44.409745+0000","last_active":"2024-02-19T21:34:24.870942+0000","last_peered":"2024-02-19T21:34:24.870942+0000","last_clean":"2024-02-19T21:34:24.870942+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:34:24.870942+0000","last_undegraded":"2024-02-19T21:34:24.870942+0000","last_fullsized":"2024-02-19T21:34:24.870942+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:33:44.409655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:44.409655+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"66'11","reported_seq":65,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935758+0000","last_change":"2024-02-19T21:33:40.386202+0000","last_active":"2024-02-19T21:34:24.935758+0000","last_peered":"2024-02-19T21:34:24.935758+0000","last_clean":"2024-02-19T21:34:24.935758+0000","last_became_active":"2024-02-19T21:32:25.361035+0000","last_became_peered":"2024-02-19T21:32:25.361035+0000","last_unstale":"2024-02-19T21:34:24.935758+0000","last_undegraded":"2024-02-19T21:34:24.935758+0000","last_fullsized":"2024-02-19T21:34:24.935758+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:33:40.386081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:40.386081+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935663+0000","last_change":"2024-02-19T21:33:40.680884+0000","last_active":"2024-02-19T21:34:24.935663+0000","last_peered":"2024-02-19T21:34:24.935663+0000","last_clean":"2024-02-19T21:34:24.935663+0000","last_became_active":"2024-02-19T21:32:29.378462+0000","last_became_peered":"2024-02-19T21:32:29.378462+0000","last_unstale":"2024-02-19T21:34:24.935663+0000","last_undegraded":"2024-02-19T21:34:24.935663+0000","last_fullsized":"2024-02-19T21:34:24.935663+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:40.680819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:40.680819+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"66'8","reported_seq":82,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:51.869900+0000","last_change":"2024-02-19T21:34:01.346726+0000","last_active":"2024-02-19T21:34:51.869900+0000","last_peered":"2024-02-19T21:34:51.869900+0000","last_clean":"2024-02-19T21:34:51.869900+0000","last_became_active":"2024-02-19T21:32:27.367867+0000","last_became_peered":"2024-02-19T21:32:27.367867+0000","last_unstale":"2024-02-19T21:34:51.869900+0000","last_undegraded":"2024-02-19T21:34:51.869900+0000","last_fullsized":"2024-02-19T21:34:51.869900+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:34:01.346647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:01.346647+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.899154+0000","last_change":"2024-02-19T21:33:37.911205+0000","last_active":"2024-02-19T21:34:24.899154+0000","last_peered":"2024-02-19T21:34:24.899154+0000","last_clean":"2024-02-19T21:34:24.899154+0000","last_became_active":"2024-02-19T21:32:23.362738+0000","last_became_peered":"2024-02-19T21:32:23.362738+0000","last_unstale":"2024-02-19T21:34:24.899154+0000","last_undegraded":"2024-02-19T21:34:24.899154+0000","last_fullsized":"2024-02-19T21:34:24.899154+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:33:37.911143+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"66'15","reported_seq":71,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.899366+0000","last_change":"2024-02-19T21:33:54.889202+0000","last_active":"2024-02-19T21:34:24.899366+0000","last_peered":"2024-02-19T21:34:24.899366+0000","last_clean":"2024-02-19T21:34:24.899366+0000","last_became_active":"2024-02-19T21:32:25.367511+0000","last_became_peered":"2024-02-19T21:32:25.367511+0000","last_unstale":"2024-02-19T21:34:24.899366+0000","last_undegraded":"2024-02-19T21:34:24.899366+0000","last_fullsized":"2024-02-19T21:34:24.899366+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:33:54.889130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:54.889130+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935444+0000","last_change":"2024-02-19T21:34:09.303641+0000","last_active":"2024-02-19T21:34:24.935444+0000","last_peered":"2024-02-19T21:34:24.935444+0000","last_clean":"2024-02-19T21:34:24.935444+0000","last_became_active":"2024-02-19T21:32:29.370710+0000","last_became_peered":"2024-02-19T21:32:29.370710+0000","last_unstale":"2024-02-19T21:34:24.935444+0000","last_undegraded":"2024-02-19T21:34:24.935444+0000","last_fullsized":"2024-02-19T21:34:24.935444+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:09.303502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:09.303502+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"83'9","reported_seq":82,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:51.869674+0000","last_change":"2024-02-19T21:33:49.121296+0000","last_active":"2024-02-19T21:34:51.869674+0000","last_peered":"2024-02-19T21:34:51.869674+0000","last_clean":"2024-02-19T21:34:51.869674+0000","last_became_active":"2024-02-19T21:32:27.363859+0000","last_became_peered":"2024-02-19T21:32:27.363859+0000","last_unstale":"2024-02-19T21:34:51.869674+0000","last_undegraded":"2024-02-19T21:34:51.869674+0000","last_fullsized":"2024-02-19T21:34:51.869674+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'9","last_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:33:49.121238+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898299+0000","last_change":"2024-02-19T21:34:01.906245+0000","last_active":"2024-02-19T21:34:24.898299+0000","last_peered":"2024-02-19T21:34:24.898299+0000","last_clean":"2024-02-19T21:34:24.898299+0000","last_became_active":"2024-02-19T21:32:23.363155+0000","last_became_peered":"2024-02-19T21:32:23.363155+0000","last_unstale":"2024-02-19T21:34:24.898299+0000","last_undegraded":"2024-02-19T21:34:24.898299+0000","last_fullsized":"2024-02-19T21:34:24.898299+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:01.906174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:01.906174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"66'10","reported_seq":66,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:44.293711+0000","last_change":"2024-02-19T21:34:44.293678+0000","last_active":"2024-02-19T21:34:44.293711+0000","last_peered":"2024-02-19T21:34:44.293711+0000","last_clean":"2024-02-19T21:34:44.293711+0000","last_became_active":"2024-02-19T21:32:25.364180+0000","last_became_peered":"2024-02-19T21:32:25.364180+0000","last_unstale":"2024-02-19T21:34:44.293711+0000","last_undegraded":"2024-02-19T21:34:44.293711+0000","last_fullsized":"2024-02-19T21:34:44.293711+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:34:44.293570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:44.293570+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934672+0000","last_change":"2024-02-19T21:34:04.048256+0000","last_active":"2024-02-19T21:34:24.934672+0000","last_peered":"2024-02-19T21:34:24.934672+0000","last_clean":"2024-02-19T21:34:24.934672+0000","last_became_active":"2024-02-19T21:32:29.371946+0000","last_became_peered":"2024-02-19T21:32:29.371946+0000","last_unstale":"2024-02-19T21:34:24.934672+0000","last_undegraded":"2024-02-19T21:34:24.934672+0000","last_fullsized":"2024-02-19T21:34:24.934672+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:04.048187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:04.048187+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898516+0000","last_change":"2024-02-19T21:34:16.785756+0000","last_active":"2024-02-19T21:34:24.898516+0000","last_peered":"2024-02-19T21:34:24.898516+0000","last_clean":"2024-02-19T21:34:24.898516+0000","last_became_active":"2024-02-19T21:32:27.369452+0000","last_became_peered":"2024-02-19T21:32:27.369452+0000","last_unstale":"2024-02-19T21:34:24.898516+0000","last_undegraded":"2024-02-19T21:34:24.898516+0000","last_fullsized":"2024-02-19T21:34:24.898516+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:16.785689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:16.785689+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:46.601045+0000","last_change":"2024-02-19T21:34:46.601011+0000","last_active":"2024-02-19T21:34:46.601045+0000","last_peered":"2024-02-19T21:34:46.601045+0000","last_clean":"2024-02-19T21:34:46.601045+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:34:46.601045+0000","last_undegraded":"2024-02-19T21:34:46.601045+0000","last_fullsized":"2024-02-19T21:34:46.601045+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:46.600917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:34:46.600917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"66'17","reported_seq":79,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:37.259188+0000","last_change":"2024-02-19T21:34:37.259118+0000","last_active":"2024-02-19T21:34:37.259188+0000","last_peered":"2024-02-19T21:34:37.259188+0000","last_clean":"2024-02-19T21:34:37.259188+0000","last_became_active":"2024-02-19T21:32:25.362454+0000","last_became_peered":"2024-02-19T21:32:25.362454+0000","last_unstale":"2024-02-19T21:34:37.259188+0000","last_undegraded":"2024-02-19T21:34:37.259188+0000","last_fullsized":"2024-02-19T21:34:37.259188+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'17","last_scrub_stamp":"2024-02-19T21:34:37.259020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:37.259020+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.870727+0000","last_change":"2024-02-19T21:34:04.422674+0000","last_active":"2024-02-19T21:34:24.870727+0000","last_peered":"2024-02-19T21:34:24.870727+0000","last_clean":"2024-02-19T21:34:24.870727+0000","last_became_active":"2024-02-19T21:32:29.373442+0000","last_became_peered":"2024-02-19T21:32:29.373442+0000","last_unstale":"2024-02-19T21:34:24.870727+0000","last_undegraded":"2024-02-19T21:34:24.870727+0000","last_fullsized":"2024-02-19T21:34:24.870727+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:04.422580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:04.422580+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:46.372315+0000","last_change":"2024-02-19T21:34:46.372277+0000","last_active":"2024-02-19T21:34:46.372315+0000","last_peered":"2024-02-19T21:34:46.372315+0000","last_clean":"2024-02-19T21:34:46.372315+0000","last_became_active":"2024-02-19T21:32:27.369020+0000","last_became_peered":"2024-02-19T21:32:27.369020+0000","last_unstale":"2024-02-19T21:34:46.372315+0000","last_undegraded":"2024-02-19T21:34:46.372315+0000","last_fullsized":"2024-02-19T21:34:46.372315+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:46.372184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:46.372184+0000","last_clean_scrub_stamp":"2024-02-19T21:34:46.372184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"59'1","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935217+0000","last_change":"2024-02-19T21:34:00.104194+0000","last_active":"2024-02-19T21:34:24.935217+0000","last_peered":"2024-02-19T21:34:24.935217+0000","last_clean":"2024-02-19T21:34:24.935217+0000","last_became_active":"2024-02-19T21:32:23.359474+0000","last_became_peered":"2024-02-19T21:32:23.359474+0000","last_unstale":"2024-02-19T21:34:24.935217+0000","last_undegraded":"2024-02-19T21:34:24.935217+0000","last_fullsized":"2024-02-19T21:34:24.935217+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:34:00.104130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:00.104130+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"66'19","reported_seq":81,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:51.882778+0000","last_change":"2024-02-19T21:34:51.882728+0000","last_active":"2024-02-19T21:34:51.882778+0000","last_peered":"2024-02-19T21:34:51.882778+0000","last_clean":"2024-02-19T21:34:51.882778+0000","last_became_active":"2024-02-19T21:32:25.372284+0000","last_became_peered":"2024-02-19T21:32:25.372284+0000","last_unstale":"2024-02-19T21:34:51.882778+0000","last_undegraded":"2024-02-19T21:34:51.882778+0000","last_fullsized":"2024-02-19T21:34:51.882778+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'19","last_scrub_stamp":"2024-02-19T21:34:51.882617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:51.882617+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.897900+0000","last_change":"2024-02-19T21:33:32.580636+0000","last_active":"2024-02-19T21:34:24.897900+0000","last_peered":"2024-02-19T21:34:24.897900+0000","last_clean":"2024-02-19T21:34:24.897900+0000","last_became_active":"2024-02-19T21:32:29.375689+0000","last_became_peered":"2024-02-19T21:32:29.375689+0000","last_unstale":"2024-02-19T21:34:24.897900+0000","last_undegraded":"2024-02-19T21:34:24.897900+0000","last_fullsized":"2024-02-19T21:34:24.897900+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:32.580572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:32.580572+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:52.337575+0000","last_change":"2024-02-19T21:34:52.337549+0000","last_active":"2024-02-19T21:34:52.337575+0000","last_peered":"2024-02-19T21:34:52.337575+0000","last_clean":"2024-02-19T21:34:52.337575+0000","last_became_active":"2024-02-19T21:32:27.361539+0000","last_became_peered":"2024-02-19T21:32:27.361539+0000","last_unstale":"2024-02-19T21:34:52.337575+0000","last_undegraded":"2024-02-19T21:34:52.337575+0000","last_fullsized":"2024-02-19T21:34:52.337575+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:52.337480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:52.337480+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898912+0000","last_change":"2024-02-19T21:34:14.758310+0000","last_active":"2024-02-19T21:34:24.898912+0000","last_peered":"2024-02-19T21:34:24.898912+0000","last_clean":"2024-02-19T21:34:24.898912+0000","last_became_active":"2024-02-19T21:32:23.357438+0000","last_became_peered":"2024-02-19T21:32:23.357438+0000","last_unstale":"2024-02-19T21:34:24.898912+0000","last_undegraded":"2024-02-19T21:34:24.898912+0000","last_fullsized":"2024-02-19T21:34:24.898912+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:14.757665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:14.757665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"66'9","reported_seq":67,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:54.399537+0000","last_change":"2024-02-19T21:34:54.399492+0000","last_active":"2024-02-19T21:34:54.399537+0000","last_peered":"2024-02-19T21:34:54.399537+0000","last_clean":"2024-02-19T21:34:54.399537+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:34:54.399537+0000","last_undegraded":"2024-02-19T21:34:54.399537+0000","last_fullsized":"2024-02-19T21:34:54.399537+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:34:54.399382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:54.399382+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:51.519937+0000","last_change":"2024-02-19T21:34:51.519893+0000","last_active":"2024-02-19T21:34:51.519937+0000","last_peered":"2024-02-19T21:34:51.519937+0000","last_clean":"2024-02-19T21:34:51.519937+0000","last_became_active":"2024-02-19T21:32:29.597248+0000","last_became_peered":"2024-02-19T21:32:29.597248+0000","last_unstale":"2024-02-19T21:34:51.519937+0000","last_undegraded":"2024-02-19T21:34:51.519937+0000","last_fullsized":"2024-02-19T21:34:51.519937+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:51.519812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:36.648092+0000","last_clean_scrub_stamp":"2024-02-19T21:34:51.519812+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934745+0000","last_change":"2024-02-19T21:33:47.040363+0000","last_active":"2024-02-19T21:34:24.934745+0000","last_peered":"2024-02-19T21:34:24.934745+0000","last_clean":"2024-02-19T21:34:24.934745+0000","last_became_active":"2024-02-19T21:32:23.357486+0000","last_became_peered":"2024-02-19T21:32:23.357486+0000","last_unstale":"2024-02-19T21:34:24.934745+0000","last_undegraded":"2024-02-19T21:34:24.934745+0000","last_fullsized":"2024-02-19T21:34:24.934745+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:47.040272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:47.040272+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"66'15","reported_seq":70,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934683+0000","last_change":"2024-02-19T21:34:00.561967+0000","last_active":"2024-02-19T21:34:24.934683+0000","last_peered":"2024-02-19T21:34:24.934683+0000","last_clean":"2024-02-19T21:34:24.934683+0000","last_became_active":"2024-02-19T21:32:25.372170+0000","last_became_peered":"2024-02-19T21:32:25.372170+0000","last_unstale":"2024-02-19T21:34:24.934683+0000","last_undegraded":"2024-02-19T21:34:24.934683+0000","last_fullsized":"2024-02-19T21:34:24.934683+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:34:00.561883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:00.561883+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"66'8","reported_seq":81,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:51.869857+0000","last_change":"2024-02-19T21:33:38.445505+0000","last_active":"2024-02-19T21:34:51.869857+0000","last_peered":"2024-02-19T21:34:51.869857+0000","last_clean":"2024-02-19T21:34:51.869857+0000","last_became_active":"2024-02-19T21:32:27.369840+0000","last_became_peered":"2024-02-19T21:32:27.369840+0000","last_unstale":"2024-02-19T21:34:51.869857+0000","last_undegraded":"2024-02-19T21:34:51.869857+0000","last_fullsized":"2024-02-19T21:34:51.869857+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:33:38.445424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:38.445424+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65,"ondisk_log_size":65,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":698,"num_read_kb":455,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":412,"ondisk_log_size":412,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":143,"num_read_kb":138,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201313,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297884,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447268,"statfs":{"total":95995035648,"available":95690002432,"internally_reserved":0,"allocated":708608,"data_stored":358908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53900000000000003,"15min":0.54500000000000004},"min":{"1min":0.33000000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54200000000000004,"15min":0.54500000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.57999999999999996}]},{"osd":1,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.32300000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.53200000000000003,"15min":0.54000000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.53700000000000003}]},{"osd":2,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.315,"5min":0.313,"15min":0.313},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.56499999999999995}]},{"osd":3,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53300000000000003,"15min":0.53200000000000003},"min":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.65500000000000003}]},{"osd":4,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.70399999999999996,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.44},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69799999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.61399999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.63400000000000001,"15min":0.65800000000000003},"min":{"1min":0.33800000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.69099999999999995,"5min":4.6390000000000002,"15min":4.6390000000000002},"last":0.623},{"interface":"front","average":{"1min":0.5,"5min":0.48099999999999998,"15min":0.47799999999999998},"min":{"1min":0.34699999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.48999999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73199999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.86699999999999999,"15min":0.92200000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80300000000000005,"5min":8.8030000000000008,"15min":8.8030000000000008},"last":0.63700000000000001}]}]},{"osd":6,"up_from":47,"seq":201863462952,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297844,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447308,"statfs":{"total":95995035648,"available":95690043392,"internally_reserved":0,"allocated":765952,"data_stored":396433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:34:53 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.5,"15min":0.48899999999999999},"min":{"1min":0.35099999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65100000000000002,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.47999999999999998},"min":{"1min":0.37,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.60599999999999998,"5min":0.755,"15min":0.755},"last":0.60599999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:34:53 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.50700000000000001,"15min":0.503},"min":{"1min":0.41699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.60999999999999999,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.442},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.48099999999999998,"15min":0.47299999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65200000000000002,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.56699999999999995}]},{"osd":2,"last update":"Mon Feb 19 21:34:53 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.50700000000000001,"15min":0.504},"min":{"1min":0.41399999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.61899999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.49399999999999999,"15min":0.47599999999999998},"min":{"1min":0.45400000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.64500000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:34:53 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52000000000000002,"15min":0.51000000000000001},"min":{"1min":0.39300000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.68100000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.499,"15min":0.48999999999999999},"min":{"1min":0.38400000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.622,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.622}]},{"osd":4,"last update":"Mon Feb 19 21:34:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.41099999999999998,"15min":0.38900000000000001},"min":{"1min":0.35699999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.59799999999999998,"5min":0.628,"15min":0.628},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.42899999999999999,"15min":0.41099999999999998},"min":{"1min":0.373,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.58899999999999997}]},{"osd":5,"last update":"Mon Feb 19 21:34:53 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.44,"15min":0.42199999999999999},"min":{"1min":0.36099999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.441,"15min":0.41399999999999998},"min":{"1min":0.379,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.65900000000000003}]},{"osd":7,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.48999999999999999,"15min":0.48199999999999998},"min":{"1min":0.35599999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.38600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.68799999999999994}]}]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297920,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447232,"statfs":{"total":95995035648,"available":95689965568,"internally_reserved":0,"allocated":745472,"data_stored":360125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:34:42 2024","interfaces":[{"interface":"back","average":{"1min":0.28100000000000003,"5min":0.35099999999999998,"15min":0.33900000000000002},"min":{"1min":0.221,"5min":0.193,"15min":0.193},"max":{"1min":0.39700000000000002,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.379},{"interface":"front","average":{"1min":0.317,"5min":0.36199999999999999,"15min":0.34000000000000002},"min":{"1min":0.23799999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.41399999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.32300000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:34:13 2024","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.36399999999999999,"15min":0.36299999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.51600000000000001,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.39800000000000002,"15min":0.38900000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.45800000000000002,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.374}]},{"osd":3,"last update":"Mon Feb 19 21:34:42 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.41699999999999998,"15min":0.42899999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.46999999999999997,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.41499999999999998,"15min":0.42299999999999999},"min":{"1min":0.30399999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.46899999999999997,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.35799999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.59499999999999997,"15min":0.61499999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.66600000000000004,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.59399999999999997,"15min":0.61399999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.69499999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.84799999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:34:27 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.55400000000000005,"15min":0.57399999999999995},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.72099999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.57699999999999996,"15min":0.60099999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80000000000000004,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.625}]},{"osd":6,"last update":"Mon Feb 19 21:34:53 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58799999999999997,"15min":0.60199999999999998},"min":{"1min":0.40300000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.70599999999999996,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59999999999999998,"15min":0.61699999999999999},"min":{"1min":0.433,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.75600000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.72199999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:34:18 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.73399999999999999,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.72799999999999998,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.621}]}]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297880,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447272,"statfs":{"total":95995035648,"available":95690006528,"internally_reserved":0,"allocated":802816,"data_stored":398296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:34:46 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.34599999999999997,"15min":0.307},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.38500000000000001,"15min":0.32400000000000001},"min":{"1min":0.21099999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48899999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.28499999999999998}]},{"osd":2,"last update":"Mon Feb 19 21:34:19 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.39700000000000002,"15min":0.373},"min":{"1min":0.28100000000000003,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.40899999999999997,"15min":0.38200000000000001},"min":{"1min":0.26100000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.35199999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:34:36 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.41399999999999998,"15min":0.40400000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.53100000000000003,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.441,"15min":0.443},"min":{"1min":0.317,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.54000000000000004,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.36899999999999999}]},{"osd":4,"last update":"Mon Feb 19 21:34:03 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59099999999999997,"15min":0.58999999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.59699999999999998,"15min":0.60799999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73999999999999999,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.69999999999999996}]},{"osd":5,"last update":"Mon Feb 19 21:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.621,"15min":0.629},"min":{"1min":0.42299999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84399999999999997,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.629,"15min":0.63},"min":{"1min":0.40500000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.98799999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.64700000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:34:52 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.40999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82799999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89700000000000002,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.61599999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:34:19 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.62,"15min":0.60999999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64800000000000002,"15min":0.65000000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91700000000000004,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.628}]}]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297860,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447292,"statfs":{"total":95995035648,"available":95690027008,"internally_reserved":0,"allocated":782336,"data_stored":397664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:34:12 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.36399999999999999,"15min":0.34799999999999998},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52100000000000002,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.40200000000000002,"15min":0.40600000000000003},"min":{"1min":0.26700000000000002,"5min":0.193,"15min":0.193},"max":{"1min":0.504,"5min":0.624,"15min":0.624},"last":0.313}]},{"osd":1,"last update":"Mon Feb 19 21:34:12 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.376,"15min":0.37},"min":{"1min":0.23100000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.55600000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.38600000000000001,"15min":0.38400000000000001},"min":{"1min":0.23200000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.48799999999999999,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.28799999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:34:44 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.39700000000000002,"15min":0.40100000000000002},"min":{"1min":0.29599999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.52700000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.40100000000000002,"15min":0.40999999999999998},"min":{"1min":0.27600000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.53900000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.32600000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:34:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56499999999999995,"15min":0.57499999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75700000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57399999999999995,"15min":0.57699999999999996},"min":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69899999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.36699999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.59299999999999997,"15min":0.61099999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89400000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.438},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.56999999999999995,"15min":0.58399999999999996},"min":{"1min":0.36799999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.39000000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:33:53 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55800000000000005,"15min":0.56499999999999995},"min":{"1min":0.39900000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.73499999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59299999999999997,"15min":0.59899999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.77900000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.38500000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:34:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60299999999999998,"15min":0.60999999999999999},"min":{"1min":0.40100000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80000000000000004,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.38800000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75800000000000001,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.47799999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149752,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297896,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447256,"statfs":{"total":95995035648,"available":95689990144,"internally_reserved":0,"allocated":720896,"data_stored":358520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:34:42 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.38800000000000001,"15min":0.41199999999999998},"min":{"1min":0.253,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.49199999999999999,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.41099999999999998,"15min":0.438},"min":{"1min":0.28699999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.51500000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.307}]},{"osd":1,"last update":"Mon Feb 19 21:34:42 2024","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.37,"15min":0.39200000000000002},"min":{"1min":0.245,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.44400000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.39400000000000002,"15min":0.42599999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.434,"5min":0.625,"15min":0.625},"last":0.29399999999999998}]},{"osd":2,"last update":"Mon Feb 19 21:34:42 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.42099999999999999,"15min":0.44900000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.52800000000000002,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.39400000000000002,"15min":0.42999999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.48099999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.22900000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:34:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.57999999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57399999999999995,"15min":0.57799999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.85299999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.68500000000000005}]},{"osd":5,"last update":"Mon Feb 19 21:34:27 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.69999999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.77600000000000002,"5min":0.876,"15min":0.876},"last":0.58499999999999996}]},{"osd":6,"last update":"Mon Feb 19 21:34:53 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.46500000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76400000000000001,"5min":0.87,"15min":0.87},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.503,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.70799999999999996,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.625}]},{"osd":7,"last update":"Mon Feb 19 21:34:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.432,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.67400000000000004}]}]},{"osd":4,"up_from":32,"seq":137438953521,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297872,"kb_used_data":776,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447280,"statfs":{"total":95995035648,"available":95690014720,"internally_reserved":0,"allocated":794624,"data_stored":397206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.50600000000000001,"15min":0.51400000000000001},"min":{"1min":0.33100000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.70699999999999996,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79900000000000004,"5min":1.149,"15min":1.149},"last":0.52100000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.51900000000000002,"15min":0.53700000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.66500000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.438},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55000000000000004,"15min":0.55800000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.876,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.59299999999999997}]},{"osd":2,"last update":"Mon Feb 19 21:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54600000000000004,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73399999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.77300000000000002,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.41499999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.377,"5min":0.376,"15min":0.376},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.496},{"interface":"front","average":{"1min":0.5,"5min":0.53400000000000003,"15min":0.54400000000000004},"min":{"1min":0.35299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.46999999999999997}]},{"osd":5,"last update":"Mon Feb 19 21:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.41799999999999998,"15min":0.40000000000000002},"min":{"1min":0.28199999999999997,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.71199999999999997,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.434,"15min":0.41099999999999998},"min":{"1min":0.33700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.65800000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.44500000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:33:51 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.44500000000000001,"15min":0.438},"min":{"1min":0.32300000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.46500000000000002,"15min":0.45600000000000002},"min":{"1min":0.32000000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.42599999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:34:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52200000000000002,"15min":0.51900000000000002},"min":{"1min":0.36399999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71799999999999997,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.67600000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.53600000000000003}]}]},{"osd":5,"up_from":38,"seq":163208757293,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297868,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447284,"statfs":{"total":95995035648,"available":95690018816,"internally_reserved":0,"allocated":692224,"data_stored":358339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:34:28 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53000000000000003,"15min":0.55000000000000004},"min":{"1min":0.34999999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70599999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64400000000000002,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.40500000000000003}]},{"osd":1,"last update":"Mon Feb 19 21:34:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53900000000000003,"15min":0.55600000000000005},"min":{"1min":0.39400000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.51100000000000001,"15min":0.52900000000000003},"min":{"1min":0.35099999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.61199999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.38400000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:34:28 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53400000000000003,"15min":0.54200000000000004},"min":{"1min":0.40400000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79600000000000004,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53900000000000003,"15min":0.55100000000000005},"min":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70499999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59499999999999997}]},{"osd":3,"last update":"Mon Feb 19 21:34:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55900000000000005,"15min":0.56799999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.76200000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59599999999999997,"15min":0.61499999999999999},"min":{"1min":0.42099999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.748,"5min":0.875,"15min":0.875},"last":0.51500000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:34:28 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.40600000000000003,"15min":0.40400000000000003},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.41999999999999998,"15min":0.41199999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.58799999999999997}]},{"osd":6,"last update":"Mon Feb 19 21:33:54 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.44900000000000001,"15min":0.439},"min":{"1min":0.33600000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.45100000000000001,"15min":0.435},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.56999999999999995}]},{"osd":7,"last update":"Mon Feb 19 21:34:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80000000000000004,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.626},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.73799999999999999,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.53900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:34:55.762 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:34:55.808 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:34:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:34:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:34:55.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:54.397405+0000 osd.0 (osd.0) 47 : cluster [DBG] 4.b scrub starts 2024-02-19T21:34:55.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:54.399373+0000 osd.0 (osd.0) 48 : cluster [DBG] 4.b scrub ok 2024-02-19T21:34:55.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:54.430260+0000 mon.a (mon.0) 771 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2024-02-19T21:34:55.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:54.714959+0000 osd.1 (osd.1) 49 : cluster [DBG] 3.0 scrub starts 2024-02-19T21:34:55.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:54.718478+0000 osd.1 (osd.1) 50 : cluster [DBG] 3.0 scrub ok 2024-02-19T21:34:56.029 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:34:56.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:54.791620+0000 mgr.y (mgr.14514) 101 : cluster [DBG] pgmap v87: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:34:56.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:54.857281+0000 mgr.y (mgr.14514) 102 : audit [DBG] from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:34:56.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:55.372354+0000 osd.0 (osd.0) 49 : cluster [DBG] 4.16 scrub starts 2024-02-19T21:34:56.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:55.374272+0000 osd.0 (osd.0) 50 : cluster [DBG] 4.16 scrub ok 2024-02-19T21:34:56.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:55.551320+0000 osd.5 (osd.5) 47 : cluster [DBG] 6.d scrub starts 2024-02-19T21:34:56.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:55.552478+0000 osd.5 (osd.5) 48 : cluster [DBG] 6.d scrub ok 2024-02-19T21:34:56.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:54.791620+0000 mgr.y (mgr.14514) 101 : cluster [DBG] pgmap v87: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:34:56.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:54.857281+0000 mgr.y (mgr.14514) 102 : audit [DBG] from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:34:56.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:55.372354+0000 osd.0 (osd.0) 49 : cluster [DBG] 4.16 scrub starts 2024-02-19T21:34:56.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:55.374272+0000 osd.0 (osd.0) 50 : cluster [DBG] 4.16 scrub ok 2024-02-19T21:34:56.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:55.551320+0000 osd.5 (osd.5) 47 : cluster [DBG] 6.d scrub starts 2024-02-19T21:34:56.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:55.552478+0000 osd.5 (osd.5) 48 : cluster [DBG] 6.d scrub ok 2024-02-19T21:34:56.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:54.791620+0000 mgr.y (mgr.14514) 101 : cluster [DBG] pgmap v87: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:34:56.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:54.857281+0000 mgr.y (mgr.14514) 102 : audit [DBG] from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:34:56.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:55.372354+0000 osd.0 (osd.0) 49 : cluster [DBG] 4.16 scrub starts 2024-02-19T21:34:56.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:55.374272+0000 osd.0 (osd.0) 50 : cluster [DBG] 4.16 scrub ok 2024-02-19T21:34:56.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:55.551320+0000 osd.5 (osd.5) 47 : cluster [DBG] 6.d scrub starts 2024-02-19T21:34:56.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:55.552478+0000 osd.5 (osd.5) 48 : cluster [DBG] 6.d scrub ok 2024-02-19T21:34:58.245 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:34:58.247 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:34:58.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:56.792207+0000 mgr.y (mgr.14514) 103 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:34:58.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:57.362896+0000 osd.2 (osd.2) 41 : cluster [DBG] 2.10 scrub starts 2024-02-19T21:34:58.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:57.363735+0000 osd.2 (osd.2) 42 : cluster [DBG] 2.10 scrub ok 2024-02-19T21:34:58.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:57.564025+0000 osd.5 (osd.5) 49 : cluster [DBG] 2.12 scrub starts 2024-02-19T21:34:58.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:57.565078+0000 osd.5 (osd.5) 50 : cluster [DBG] 2.12 scrub ok 2024-02-19T21:34:58.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:56.792207+0000 mgr.y (mgr.14514) 103 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:34:58.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:57.362896+0000 osd.2 (osd.2) 41 : cluster [DBG] 2.10 scrub starts 2024-02-19T21:34:58.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:57.363735+0000 osd.2 (osd.2) 42 : cluster [DBG] 2.10 scrub ok 2024-02-19T21:34:58.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:57.564025+0000 osd.5 (osd.5) 49 : cluster [DBG] 2.12 scrub starts 2024-02-19T21:34:58.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:57.565078+0000 osd.5 (osd.5) 50 : cluster [DBG] 2.12 scrub ok 2024-02-19T21:34:58.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:56.792207+0000 mgr.y (mgr.14514) 103 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:34:58.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:57.362896+0000 osd.2 (osd.2) 41 : cluster [DBG] 2.10 scrub starts 2024-02-19T21:34:58.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:57.363735+0000 osd.2 (osd.2) 42 : cluster [DBG] 2.10 scrub ok 2024-02-19T21:34:58.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:57.564025+0000 osd.5 (osd.5) 49 : cluster [DBG] 2.12 scrub starts 2024-02-19T21:34:58.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:57.565078+0000 osd.5 (osd.5) 50 : cluster [DBG] 2.12 scrub ok 2024-02-19T21:34:59.146 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2024-02-19T21:34:56.791874+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5796,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":863,"num_read_kb":615,"num_write":428,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":488,"ondisk_log_size":488,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":2383024,"kb_used_data":5872,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":747578192,"statfs":{"total":767960285184,"available":765520068608,"internally_reserved":0,"allocated":6012928,"data_stored":3025491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002906"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934325+0000","last_change":"2024-02-19T21:34:08.559052+0000","last_active":"2024-02-19T21:34:24.934325+0000","last_peered":"2024-02-19T21:34:24.934325+0000","last_clean":"2024-02-19T21:34:24.934325+0000","last_became_active":"2024-02-19T21:32:29.599674+0000","last_became_peered":"2024-02-19T21:32:29.599674+0000","last_unstale":"2024-02-19T21:34:24.934325+0000","last_undegraded":"2024-02-19T21:34:24.934325+0000","last_fullsized":"2024-02-19T21:34:24.934325+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:08.558980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:08.558980+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935949+0000","last_change":"2024-02-19T21:33:36.342047+0000","last_active":"2024-02-19T21:34:24.935949+0000","last_peered":"2024-02-19T21:34:24.935949+0000","last_clean":"2024-02-19T21:34:24.935949+0000","last_became_active":"2024-02-19T21:32:27.364767+0000","last_became_peered":"2024-02-19T21:32:27.364767+0000","last_unstale":"2024-02-19T21:34:24.935949+0000","last_undegraded":"2024-02-19T21:34:24.935949+0000","last_fullsized":"2024-02-19T21:34:24.935949+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:36.341941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:36.341941+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898631+0000","last_change":"2024-02-19T21:34:07.755067+0000","last_active":"2024-02-19T21:34:24.898631+0000","last_peered":"2024-02-19T21:34:24.898631+0000","last_clean":"2024-02-19T21:34:24.898631+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:34:24.898631+0000","last_undegraded":"2024-02-19T21:34:24.898631+0000","last_fullsized":"2024-02-19T21:34:24.898631+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:07.754969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:07.754969+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"66'15","reported_seq":70,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934586+0000","last_change":"2024-02-19T21:34:16.531368+0000","last_active":"2024-02-19T21:34:24.934586+0000","last_peered":"2024-02-19T21:34:24.934586+0000","last_clean":"2024-02-19T21:34:24.934586+0000","last_became_active":"2024-02-19T21:32:25.365996+0000","last_became_peered":"2024-02-19T21:32:25.365996+0000","last_unstale":"2024-02-19T21:34:24.934586+0000","last_undegraded":"2024-02-19T21:34:24.934586+0000","last_fullsized":"2024-02-19T21:34:24.934586+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:34:16.531300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:16.531300+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:47.339303+0000","last_change":"2024-02-19T21:34:47.339254+0000","last_active":"2024-02-19T21:34:47.339303+0000","last_peered":"2024-02-19T21:34:47.339303+0000","last_clean":"2024-02-19T21:34:47.339303+0000","last_became_active":"2024-02-19T21:32:29.373546+0000","last_became_peered":"2024-02-19T21:32:29.373546+0000","last_unstale":"2024-02-19T21:34:47.339303+0000","last_undegraded":"2024-02-19T21:34:47.339303+0000","last_fullsized":"2024-02-19T21:34:47.339303+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:47.339178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:47.339178+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:29.779889+0000","last_change":"2024-02-19T21:34:29.779862+0000","last_active":"2024-02-19T21:34:29.779889+0000","last_peered":"2024-02-19T21:34:29.779889+0000","last_clean":"2024-02-19T21:34:29.779889+0000","last_became_active":"2024-02-19T21:32:27.372466+0000","last_became_peered":"2024-02-19T21:32:27.372466+0000","last_unstale":"2024-02-19T21:34:29.779889+0000","last_undegraded":"2024-02-19T21:34:29.779889+0000","last_fullsized":"2024-02-19T21:34:29.779889+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:29.779779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:29.779779+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935460+0000","last_change":"2024-02-19T21:33:46.451703+0000","last_active":"2024-02-19T21:34:24.935460+0000","last_peered":"2024-02-19T21:34:24.935460+0000","last_clean":"2024-02-19T21:34:24.935460+0000","last_became_active":"2024-02-19T21:32:23.356975+0000","last_became_peered":"2024-02-19T21:32:23.356975+0000","last_unstale":"2024-02-19T21:34:24.935460+0000","last_undegraded":"2024-02-19T21:34:24.935460+0000","last_fullsized":"2024-02-19T21:34:24.935460+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:46.451637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:46.451637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"92'13","reported_seq":71,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:49.331762+0000","last_change":"2024-02-19T21:34:49.331728+0000","last_active":"2024-02-19T21:34:49.331762+0000","last_peered":"2024-02-19T21:34:49.331762+0000","last_clean":"2024-02-19T21:34:49.331762+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:34:49.331762+0000","last_undegraded":"2024-02-19T21:34:49.331762+0000","last_fullsized":"2024-02-19T21:34:49.331762+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"92'13","last_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:34:49.331650+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934872+0000","last_change":"2024-02-19T21:34:12.642234+0000","last_active":"2024-02-19T21:34:24.934872+0000","last_peered":"2024-02-19T21:34:24.934872+0000","last_clean":"2024-02-19T21:34:24.934872+0000","last_became_active":"2024-02-19T21:32:29.373648+0000","last_became_peered":"2024-02-19T21:32:29.373648+0000","last_unstale":"2024-02-19T21:34:24.934872+0000","last_undegraded":"2024-02-19T21:34:24.934872+0000","last_fullsized":"2024-02-19T21:34:24.934872+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:12.642155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:12.642155+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.871226+0000","last_change":"2024-02-19T21:34:07.478398+0000","last_active":"2024-02-19T21:34:24.871226+0000","last_peered":"2024-02-19T21:34:24.871226+0000","last_clean":"2024-02-19T21:34:24.871226+0000","last_became_active":"2024-02-19T21:32:27.370308+0000","last_became_peered":"2024-02-19T21:32:27.370308+0000","last_unstale":"2024-02-19T21:34:24.871226+0000","last_undegraded":"2024-02-19T21:34:24.871226+0000","last_fullsized":"2024-02-19T21:34:24.871226+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:07.478319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:07.478319+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.871255+0000","last_change":"2024-02-19T21:34:00.532471+0000","last_active":"2024-02-19T21:34:24.871255+0000","last_peered":"2024-02-19T21:34:24.871255+0000","last_clean":"2024-02-19T21:34:24.871255+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:34:24.871255+0000","last_undegraded":"2024-02-19T21:34:24.871255+0000","last_fullsized":"2024-02-19T21:34:24.871255+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:00.532402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:00.532402+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"66'5","reported_seq":76,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:40.263688+0000","last_change":"2024-02-19T21:34:40.263657+0000","last_active":"2024-02-19T21:34:40.263688+0000","last_peered":"2024-02-19T21:34:40.263688+0000","last_clean":"2024-02-19T21:34:40.263688+0000","last_became_active":"2024-02-19T21:33:50.753208+0000","last_became_peered":"2024-02-19T21:33:50.753208+0000","last_unstale":"2024-02-19T21:34:40.263688+0000","last_undegraded":"2024-02-19T21:34:40.263688+0000","last_fullsized":"2024-02-19T21:34:40.263688+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'5","last_scrub_stamp":"2024-02-19T21:34:40.263564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:40.263564+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898163+0000","last_change":"2024-02-19T21:34:13.751793+0000","last_active":"2024-02-19T21:34:24.898163+0000","last_peered":"2024-02-19T21:34:24.898163+0000","last_clean":"2024-02-19T21:34:24.898163+0000","last_became_active":"2024-02-19T21:32:29.373010+0000","last_became_peered":"2024-02-19T21:32:29.373010+0000","last_unstale":"2024-02-19T21:34:24.898163+0000","last_undegraded":"2024-02-19T21:34:24.898163+0000","last_fullsized":"2024-02-19T21:34:24.898163+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:34:13.751725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:13.751725+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:53.564981+0000","last_change":"2024-02-19T21:34:53.564949+0000","last_active":"2024-02-19T21:34:53.564981+0000","last_peered":"2024-02-19T21:34:53.564981+0000","last_clean":"2024-02-19T21:34:53.564981+0000","last_became_active":"2024-02-19T21:32:27.368241+0000","last_became_peered":"2024-02-19T21:32:27.368241+0000","last_unstale":"2024-02-19T21:34:53.564981+0000","last_undegraded":"2024-02-19T21:34:53.564981+0000","last_fullsized":"2024-02-19T21:34:53.564981+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:53.564866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:46.543259+0000","last_clean_scrub_stamp":"2024-02-19T21:34:53.564866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:41.519877+0000","last_change":"2024-02-19T21:34:41.519821+0000","last_active":"2024-02-19T21:34:41.519877+0000","last_peered":"2024-02-19T21:34:41.519877+0000","last_clean":"2024-02-19T21:34:41.519877+0000","last_became_active":"2024-02-19T21:32:23.357179+0000","last_became_peered":"2024-02-19T21:32:23.357179+0000","last_unstale":"2024-02-19T21:34:41.519877+0000","last_undegraded":"2024-02-19T21:34:41.519877+0000","last_fullsized":"2024-02-19T21:34:41.519877+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:41.519714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:41.519714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"89'13","reported_seq":66,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934976+0000","last_change":"2024-02-19T21:34:07.313636+0000","last_active":"2024-02-19T21:34:24.934976+0000","last_peered":"2024-02-19T21:34:24.934976+0000","last_clean":"2024-02-19T21:34:24.934976+0000","last_became_active":"2024-02-19T21:32:25.364237+0000","last_became_peered":"2024-02-19T21:32:25.364237+0000","last_unstale":"2024-02-19T21:34:24.934976+0000","last_undegraded":"2024-02-19T21:34:24.934976+0000","last_fullsized":"2024-02-19T21:34:24.934976+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'13","last_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:34:07.313566+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935509+0000","last_change":"2024-02-19T21:34:20.569197+0000","last_active":"2024-02-19T21:34:24.935509+0000","last_peered":"2024-02-19T21:34:24.935509+0000","last_clean":"2024-02-19T21:34:24.935509+0000","last_became_active":"2024-02-19T21:32:29.597266+0000","last_became_peered":"2024-02-19T21:32:29.597266+0000","last_unstale":"2024-02-19T21:34:24.935509+0000","last_undegraded":"2024-02-19T21:34:24.935509+0000","last_fullsized":"2024-02-19T21:34:24.935509+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:20.569124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:20.569124+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.936914+0000","last_change":"2024-02-19T21:34:13.418409+0000","last_active":"2024-02-19T21:34:24.936914+0000","last_peered":"2024-02-19T21:34:24.936914+0000","last_clean":"2024-02-19T21:34:24.936914+0000","last_became_active":"2024-02-19T21:32:27.368233+0000","last_became_peered":"2024-02-19T21:32:27.368233+0000","last_unstale":"2024-02-19T21:34:24.936914+0000","last_undegraded":"2024-02-19T21:34:24.936914+0000","last_fullsized":"2024-02-19T21:34:24.936914+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:13.418325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:13.418325+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":56,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934496+0000","last_change":"2024-02-19T21:33:55.409204+0000","last_active":"2024-02-19T21:34:24.934496+0000","last_peered":"2024-02-19T21:34:24.934496+0000","last_clean":"2024-02-19T21:34:24.934496+0000","last_became_active":"2024-02-19T21:33:50.753994+0000","last_became_peered":"2024-02-19T21:33:50.753994+0000","last_unstale":"2024-02-19T21:34:24.934496+0000","last_undegraded":"2024-02-19T21:34:24.934496+0000","last_fullsized":"2024-02-19T21:34:24.934496+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:55.409142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:55.409142+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"66'12","reported_seq":68,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935224+0000","last_change":"2024-02-19T21:34:04.494293+0000","last_active":"2024-02-19T21:34:24.935224+0000","last_peered":"2024-02-19T21:34:24.935224+0000","last_clean":"2024-02-19T21:34:24.935224+0000","last_became_active":"2024-02-19T21:32:25.369040+0000","last_became_peered":"2024-02-19T21:32:25.369040+0000","last_unstale":"2024-02-19T21:34:24.935224+0000","last_undegraded":"2024-02-19T21:34:24.935224+0000","last_fullsized":"2024-02-19T21:34:24.935224+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'12","last_scrub_stamp":"2024-02-19T21:34:04.494227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:04.494227+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935670+0000","last_change":"2024-02-19T21:33:45.418945+0000","last_active":"2024-02-19T21:34:24.935670+0000","last_peered":"2024-02-19T21:34:24.935670+0000","last_clean":"2024-02-19T21:34:24.935670+0000","last_became_active":"2024-02-19T21:32:29.597365+0000","last_became_peered":"2024-02-19T21:32:29.597365+0000","last_unstale":"2024-02-19T21:34:24.935670+0000","last_undegraded":"2024-02-19T21:34:24.935670+0000","last_fullsized":"2024-02-19T21:34:24.935670+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:45.418867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:45.418867+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.899001+0000","last_change":"2024-02-19T21:34:17.809314+0000","last_active":"2024-02-19T21:34:24.899001+0000","last_peered":"2024-02-19T21:34:24.899001+0000","last_clean":"2024-02-19T21:34:24.899001+0000","last_became_active":"2024-02-19T21:32:27.369757+0000","last_became_peered":"2024-02-19T21:32:27.369757+0000","last_unstale":"2024-02-19T21:34:24.899001+0000","last_undegraded":"2024-02-19T21:34:24.899001+0000","last_fullsized":"2024-02-19T21:34:24.899001+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:17.809245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:17.809245+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:39.022497+0000","last_change":"2024-02-19T21:34:39.022454+0000","last_active":"2024-02-19T21:34:39.022497+0000","last_peered":"2024-02-19T21:34:39.022497+0000","last_clean":"2024-02-19T21:34:39.022497+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:34:39.022497+0000","last_undegraded":"2024-02-19T21:34:39.022497+0000","last_fullsized":"2024-02-19T21:34:39.022497+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:39.022344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:39.022344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"66'15","reported_seq":70,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935242+0000","last_change":"2024-02-19T21:33:40.215778+0000","last_active":"2024-02-19T21:34:24.935242+0000","last_peered":"2024-02-19T21:34:24.935242+0000","last_clean":"2024-02-19T21:34:24.935242+0000","last_became_active":"2024-02-19T21:32:25.365267+0000","last_became_peered":"2024-02-19T21:32:25.365267+0000","last_unstale":"2024-02-19T21:34:24.935242+0000","last_undegraded":"2024-02-19T21:34:24.935242+0000","last_fullsized":"2024-02-19T21:34:24.935242+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:33:40.215704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:40.215704+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:34.776286+0000","last_change":"2024-02-19T21:34:34.776259+0000","last_active":"2024-02-19T21:34:34.776286+0000","last_peered":"2024-02-19T21:34:34.776286+0000","last_clean":"2024-02-19T21:34:34.776286+0000","last_became_active":"2024-02-19T21:32:29.373361+0000","last_became_peered":"2024-02-19T21:32:29.373361+0000","last_unstale":"2024-02-19T21:34:34.776286+0000","last_undegraded":"2024-02-19T21:34:34.776286+0000","last_fullsized":"2024-02-19T21:34:34.776286+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:34.776190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:34.776190+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.899185+0000","last_change":"2024-02-19T21:33:49.602701+0000","last_active":"2024-02-19T21:34:24.899185+0000","last_peered":"2024-02-19T21:34:24.899185+0000","last_clean":"2024-02-19T21:34:24.899185+0000","last_became_active":"2024-02-19T21:32:27.367741+0000","last_became_peered":"2024-02-19T21:32:27.367741+0000","last_unstale":"2024-02-19T21:34:24.899185+0000","last_undegraded":"2024-02-19T21:34:24.899185+0000","last_fullsized":"2024-02-19T21:34:24.899185+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:49.602639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:49.602639+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934606+0000","last_change":"2024-02-19T21:34:10.565228+0000","last_active":"2024-02-19T21:34:24.934606+0000","last_peered":"2024-02-19T21:34:24.934606+0000","last_clean":"2024-02-19T21:34:24.934606+0000","last_became_active":"2024-02-19T21:32:23.355085+0000","last_became_peered":"2024-02-19T21:32:23.355085+0000","last_unstale":"2024-02-19T21:34:24.934606+0000","last_undegraded":"2024-02-19T21:34:24.934606+0000","last_fullsized":"2024-02-19T21:34:24.934606+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:10.565163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:10.565163+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"66'11","reported_seq":64,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.936324+0000","last_change":"2024-02-19T21:33:42.173352+0000","last_active":"2024-02-19T21:34:24.936324+0000","last_peered":"2024-02-19T21:34:24.936324+0000","last_clean":"2024-02-19T21:34:24.936324+0000","last_became_active":"2024-02-19T21:32:25.355939+0000","last_became_peered":"2024-02-19T21:32:25.355939+0000","last_unstale":"2024-02-19T21:34:24.936324+0000","last_undegraded":"2024-02-19T21:34:24.936324+0000","last_fullsized":"2024-02-19T21:34:24.936324+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:33:42.173259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:42.173259+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.871426+0000","last_change":"2024-02-19T21:33:49.401282+0000","last_active":"2024-02-19T21:34:24.871426+0000","last_peered":"2024-02-19T21:34:24.871426+0000","last_clean":"2024-02-19T21:34:24.871426+0000","last_became_active":"2024-02-19T21:32:29.372503+0000","last_became_peered":"2024-02-19T21:32:29.372503+0000","last_unstale":"2024-02-19T21:34:24.871426+0000","last_undegraded":"2024-02-19T21:34:24.871426+0000","last_fullsized":"2024-02-19T21:34:24.871426+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:33:49.401203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:49.401203+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"66'8","reported_seq":84,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:51.869831+0000","last_change":"2024-02-19T21:33:43.197645+0000","last_active":"2024-02-19T21:34:51.869831+0000","last_peered":"2024-02-19T21:34:51.869831+0000","last_clean":"2024-02-19T21:34:51.869831+0000","last_became_active":"2024-02-19T21:32:27.366465+0000","last_became_peered":"2024-02-19T21:32:27.366465+0000","last_unstale":"2024-02-19T21:34:51.869831+0000","last_undegraded":"2024-02-19T21:34:51.869831+0000","last_fullsized":"2024-02-19T21:34:51.869831+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:33:43.197552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:43.197552+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:31.724147+0000","last_change":"2024-02-19T21:34:31.724113+0000","last_active":"2024-02-19T21:34:31.724147+0000","last_peered":"2024-02-19T21:34:31.724147+0000","last_clean":"2024-02-19T21:34:31.724147+0000","last_became_active":"2024-02-19T21:32:23.356323+0000","last_became_peered":"2024-02-19T21:32:23.356323+0000","last_unstale":"2024-02-19T21:34:31.724147+0000","last_undegraded":"2024-02-19T21:34:31.724147+0000","last_fullsized":"2024-02-19T21:34:31.724147+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:31.724027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:31.724027+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"66'10","reported_seq":66,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:50.434383+0000","last_change":"2024-02-19T21:34:50.434355+0000","last_active":"2024-02-19T21:34:50.434383+0000","last_peered":"2024-02-19T21:34:50.434383+0000","last_clean":"2024-02-19T21:34:50.434383+0000","last_became_active":"2024-02-19T21:32:25.372236+0000","last_became_peered":"2024-02-19T21:32:25.372236+0000","last_unstale":"2024-02-19T21:34:50.434383+0000","last_undegraded":"2024-02-19T21:34:50.434383+0000","last_fullsized":"2024-02-19T21:34:50.434383+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:34:50.434284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:50.434284+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934716+0000","last_change":"2024-02-19T21:33:58.442925+0000","last_active":"2024-02-19T21:34:24.934716+0000","last_peered":"2024-02-19T21:34:24.934716+0000","last_clean":"2024-02-19T21:34:24.934716+0000","last_became_active":"2024-02-19T21:32:29.599396+0000","last_became_peered":"2024-02-19T21:32:29.599396+0000","last_unstale":"2024-02-19T21:34:24.934716+0000","last_undegraded":"2024-02-19T21:34:24.934716+0000","last_fullsized":"2024-02-19T21:34:24.934716+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:58.442855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:58.442855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.871398+0000","last_change":"2024-02-19T21:34:03.457957+0000","last_active":"2024-02-19T21:34:24.871398+0000","last_peered":"2024-02-19T21:34:24.871398+0000","last_clean":"2024-02-19T21:34:24.871398+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:34:24.871398+0000","last_undegraded":"2024-02-19T21:34:24.871398+0000","last_fullsized":"2024-02-19T21:34:24.871398+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:34:03.457856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.936585+0000","last_change":"2024-02-19T21:33:31.153117+0000","last_active":"2024-02-19T21:34:24.936585+0000","last_peered":"2024-02-19T21:34:24.936585+0000","last_clean":"2024-02-19T21:34:24.936585+0000","last_became_active":"2024-02-19T21:32:23.355525+0000","last_became_peered":"2024-02-19T21:32:23.355525+0000","last_unstale":"2024-02-19T21:34:24.936585+0000","last_undegraded":"2024-02-19T21:34:24.936585+0000","last_fullsized":"2024-02-19T21:34:24.936585+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:31.153022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:31.153022+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"66'11","reported_seq":69,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:48.573182+0000","last_change":"2024-02-19T21:34:48.573155+0000","last_active":"2024-02-19T21:34:48.573182+0000","last_peered":"2024-02-19T21:34:48.573182+0000","last_clean":"2024-02-19T21:34:48.573182+0000","last_became_active":"2024-02-19T21:32:25.372039+0000","last_became_peered":"2024-02-19T21:32:25.372039+0000","last_unstale":"2024-02-19T21:34:48.573182+0000","last_undegraded":"2024-02-19T21:34:48.573182+0000","last_fullsized":"2024-02-19T21:34:48.573182+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:34:48.573067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:48.573067+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.870910+0000","last_change":"2024-02-19T21:34:01.539989+0000","last_active":"2024-02-19T21:34:24.870910+0000","last_peered":"2024-02-19T21:34:24.870910+0000","last_clean":"2024-02-19T21:34:24.870910+0000","last_became_active":"2024-02-19T21:32:29.372163+0000","last_became_peered":"2024-02-19T21:32:29.372163+0000","last_unstale":"2024-02-19T21:34:24.870910+0000","last_undegraded":"2024-02-19T21:34:24.870910+0000","last_fullsized":"2024-02-19T21:34:24.870910+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:34:01.539921+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:42.965511+0000","last_change":"2024-02-19T21:34:42.965473+0000","last_active":"2024-02-19T21:34:42.965511+0000","last_peered":"2024-02-19T21:34:42.965511+0000","last_clean":"2024-02-19T21:34:42.965511+0000","last_became_active":"2024-02-19T21:32:27.366281+0000","last_became_peered":"2024-02-19T21:32:27.366281+0000","last_unstale":"2024-02-19T21:34:42.965511+0000","last_undegraded":"2024-02-19T21:34:42.965511+0000","last_fullsized":"2024-02-19T21:34:42.965511+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:42.965390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:42.965390+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935105+0000","last_change":"2024-02-19T21:34:08.543506+0000","last_active":"2024-02-19T21:34:24.935105+0000","last_peered":"2024-02-19T21:34:24.935105+0000","last_clean":"2024-02-19T21:34:24.935105+0000","last_became_active":"2024-02-19T21:32:23.355103+0000","last_became_peered":"2024-02-19T21:32:23.355103+0000","last_unstale":"2024-02-19T21:34:24.935105+0000","last_undegraded":"2024-02-19T21:34:24.935105+0000","last_fullsized":"2024-02-19T21:34:24.935105+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:08.543422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:08.543422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"66'4","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934295+0000","last_change":"2024-02-19T21:34:07.518745+0000","last_active":"2024-02-19T21:34:24.934295+0000","last_peered":"2024-02-19T21:34:24.934295+0000","last_clean":"2024-02-19T21:34:24.934295+0000","last_became_active":"2024-02-19T21:32:25.369139+0000","last_became_peered":"2024-02-19T21:32:25.369139+0000","last_unstale":"2024-02-19T21:34:24.934295+0000","last_undegraded":"2024-02-19T21:34:24.934295+0000","last_fullsized":"2024-02-19T21:34:24.934295+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'4","last_scrub_stamp":"2024-02-19T21:34:07.518657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:07.518657+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934435+0000","last_change":"2024-02-19T21:34:05.506026+0000","last_active":"2024-02-19T21:34:24.934435+0000","last_peered":"2024-02-19T21:34:24.934435+0000","last_clean":"2024-02-19T21:34:24.934435+0000","last_became_active":"2024-02-19T21:32:29.377302+0000","last_became_peered":"2024-02-19T21:32:29.377302+0000","last_unstale":"2024-02-19T21:34:24.934435+0000","last_undegraded":"2024-02-19T21:34:24.934435+0000","last_fullsized":"2024-02-19T21:34:24.934435+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:05.505905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:05.505905+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898377+0000","last_change":"2024-02-19T21:34:24.738692+0000","last_active":"2024-02-19T21:34:24.898377+0000","last_peered":"2024-02-19T21:34:24.898377+0000","last_clean":"2024-02-19T21:34:24.898377+0000","last_became_active":"2024-02-19T21:32:27.374451+0000","last_became_peered":"2024-02-19T21:32:27.374451+0000","last_unstale":"2024-02-19T21:34:24.898377+0000","last_undegraded":"2024-02-19T21:34:24.898377+0000","last_fullsized":"2024-02-19T21:34:24.898377+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:24.738612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:24.738612+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898731+0000","last_change":"2024-02-19T21:33:52.933780+0000","last_active":"2024-02-19T21:34:24.898731+0000","last_peered":"2024-02-19T21:34:24.898731+0000","last_clean":"2024-02-19T21:34:24.898731+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:34:24.898731+0000","last_undegraded":"2024-02-19T21:34:24.898731+0000","last_fullsized":"2024-02-19T21:34:24.898731+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:33:52.933689+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"66'11","reported_seq":70,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:51.333643+0000","last_change":"2024-02-19T21:34:51.333606+0000","last_active":"2024-02-19T21:34:51.333643+0000","last_peered":"2024-02-19T21:34:51.333643+0000","last_clean":"2024-02-19T21:34:51.333643+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:34:51.333643+0000","last_undegraded":"2024-02-19T21:34:51.333643+0000","last_fullsized":"2024-02-19T21:34:51.333643+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:34:51.333524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:51.333524+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.897746+0000","last_change":"2024-02-19T21:33:42.527908+0000","last_active":"2024-02-19T21:34:24.897746+0000","last_peered":"2024-02-19T21:34:24.897746+0000","last_clean":"2024-02-19T21:34:24.897746+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:34:24.897746+0000","last_undegraded":"2024-02-19T21:34:24.897746+0000","last_fullsized":"2024-02-19T21:34:24.897746+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:42.527849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:42.527849+0000","last_clean_scrub_stamp":"2024-02-19T21:33:42.527849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934572+0000","last_change":"2024-02-19T21:34:15.560500+0000","last_active":"2024-02-19T21:34:24.934572+0000","last_peered":"2024-02-19T21:34:24.934572+0000","last_clean":"2024-02-19T21:34:24.934572+0000","last_became_active":"2024-02-19T21:32:27.369279+0000","last_became_peered":"2024-02-19T21:32:27.369279+0000","last_unstale":"2024-02-19T21:34:24.934572+0000","last_undegraded":"2024-02-19T21:34:24.934572+0000","last_fullsized":"2024-02-19T21:34:24.934572+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:15.560432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:15.560432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935734+0000","last_change":"2024-02-19T21:33:44.209744+0000","last_active":"2024-02-19T21:34:24.935734+0000","last_peered":"2024-02-19T21:34:24.935734+0000","last_clean":"2024-02-19T21:34:24.935734+0000","last_became_active":"2024-02-19T21:32:23.357338+0000","last_became_peered":"2024-02-19T21:32:23.357338+0000","last_unstale":"2024-02-19T21:34:24.935734+0000","last_undegraded":"2024-02-19T21:34:24.935734+0000","last_fullsized":"2024-02-19T21:34:24.935734+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:44.209646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:44.209646+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"66'9","reported_seq":62,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898349+0000","last_change":"2024-02-19T21:34:10.712156+0000","last_active":"2024-02-19T21:34:24.898349+0000","last_peered":"2024-02-19T21:34:24.898349+0000","last_clean":"2024-02-19T21:34:24.898349+0000","last_became_active":"2024-02-19T21:32:25.359777+0000","last_became_peered":"2024-02-19T21:32:25.359777+0000","last_unstale":"2024-02-19T21:34:24.898349+0000","last_undegraded":"2024-02-19T21:34:24.898349+0000","last_fullsized":"2024-02-19T21:34:24.898349+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:34:10.712079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:10.712079+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.936183+0000","last_change":"2024-02-19T21:33:49.388307+0000","last_active":"2024-02-19T21:34:24.936183+0000","last_peered":"2024-02-19T21:34:24.936183+0000","last_clean":"2024-02-19T21:34:24.936183+0000","last_became_active":"2024-02-19T21:32:29.371406+0000","last_became_peered":"2024-02-19T21:32:29.371406+0000","last_unstale":"2024-02-19T21:34:24.936183+0000","last_undegraded":"2024-02-19T21:34:24.936183+0000","last_fullsized":"2024-02-19T21:34:24.936183+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:49.388220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:49.388220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"66'8","reported_seq":81,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:51.869691+0000","last_change":"2024-02-19T21:34:17.563543+0000","last_active":"2024-02-19T21:34:51.869691+0000","last_peered":"2024-02-19T21:34:51.869691+0000","last_clean":"2024-02-19T21:34:51.869691+0000","last_became_active":"2024-02-19T21:32:27.365865+0000","last_became_peered":"2024-02-19T21:32:27.365865+0000","last_unstale":"2024-02-19T21:34:51.869691+0000","last_undegraded":"2024-02-19T21:34:51.869691+0000","last_fullsized":"2024-02-19T21:34:51.869691+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:34:17.563474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:17.563474+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:53.407416+0000","last_change":"2024-02-19T21:34:53.407392+0000","last_active":"2024-02-19T21:34:53.407416+0000","last_peered":"2024-02-19T21:34:53.407416+0000","last_clean":"2024-02-19T21:34:53.407416+0000","last_became_active":"2024-02-19T21:32:23.361680+0000","last_became_peered":"2024-02-19T21:32:23.361680+0000","last_unstale":"2024-02-19T21:34:53.407416+0000","last_undegraded":"2024-02-19T21:34:53.407416+0000","last_fullsized":"2024-02-19T21:34:53.407416+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:53.407323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:33.550655+0000","last_clean_scrub_stamp":"2024-02-19T21:34:53.407323+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"66'9","reported_seq":61,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935890+0000","last_change":"2024-02-19T21:33:28.598343+0000","last_active":"2024-02-19T21:34:24.935890+0000","last_peered":"2024-02-19T21:34:24.935890+0000","last_clean":"2024-02-19T21:34:24.935890+0000","last_became_active":"2024-02-19T21:32:25.372206+0000","last_became_peered":"2024-02-19T21:32:25.372206+0000","last_unstale":"2024-02-19T21:34:24.935890+0000","last_undegraded":"2024-02-19T21:34:24.935890+0000","last_fullsized":"2024-02-19T21:34:24.935890+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:33:28.598281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:28.598281+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898771+0000","last_change":"2024-02-19T21:33:35.526933+0000","last_active":"2024-02-19T21:34:24.898771+0000","last_peered":"2024-02-19T21:34:24.898771+0000","last_clean":"2024-02-19T21:34:24.898771+0000","last_became_active":"2024-02-19T21:32:29.376980+0000","last_became_peered":"2024-02-19T21:32:29.376980+0000","last_unstale":"2024-02-19T21:34:24.898771+0000","last_undegraded":"2024-02-19T21:34:24.898771+0000","last_fullsized":"2024-02-19T21:34:24.898771+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:35.526865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:35.526865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"66'8","reported_seq":81,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:51.869866+0000","last_change":"2024-02-19T21:33:47.554077+0000","last_active":"2024-02-19T21:34:51.869866+0000","last_peered":"2024-02-19T21:34:51.869866+0000","last_clean":"2024-02-19T21:34:51.869866+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:34:51.869866+0000","last_undegraded":"2024-02-19T21:34:51.869866+0000","last_fullsized":"2024-02-19T21:34:51.869866+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:33:47.553965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:47.553965+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935831+0000","last_change":"2024-02-19T21:33:32.648024+0000","last_active":"2024-02-19T21:34:24.935831+0000","last_peered":"2024-02-19T21:34:24.935831+0000","last_clean":"2024-02-19T21:34:24.935831+0000","last_became_active":"2024-02-19T21:32:23.360838+0000","last_became_peered":"2024-02-19T21:32:23.360838+0000","last_unstale":"2024-02-19T21:34:24.935831+0000","last_undegraded":"2024-02-19T21:34:24.935831+0000","last_fullsized":"2024-02-19T21:34:24.935831+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:32.647912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:32.647912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"66'10","reported_seq":60,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934916+0000","last_change":"2024-02-19T21:34:03.508324+0000","last_active":"2024-02-19T21:34:24.934916+0000","last_peered":"2024-02-19T21:34:24.934916+0000","last_clean":"2024-02-19T21:34:24.934916+0000","last_became_active":"2024-02-19T21:32:25.372060+0000","last_became_peered":"2024-02-19T21:32:25.372060+0000","last_unstale":"2024-02-19T21:34:24.934916+0000","last_undegraded":"2024-02-19T21:34:24.934916+0000","last_fullsized":"2024-02-19T21:34:24.934916+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:34:03.508256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:03.508256+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.871093+0000","last_change":"2024-02-19T21:33:43.433355+0000","last_active":"2024-02-19T21:34:24.871093+0000","last_peered":"2024-02-19T21:34:24.871093+0000","last_clean":"2024-02-19T21:34:24.871093+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:34:24.871093+0000","last_undegraded":"2024-02-19T21:34:24.871093+0000","last_fullsized":"2024-02-19T21:34:24.871093+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:43.433289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:43.433289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934879+0000","last_change":"2024-02-19T21:34:15.667458+0000","last_active":"2024-02-19T21:34:24.934879+0000","last_peered":"2024-02-19T21:34:24.934879+0000","last_clean":"2024-02-19T21:34:24.934879+0000","last_became_active":"2024-02-19T21:32:27.369002+0000","last_became_peered":"2024-02-19T21:32:27.369002+0000","last_unstale":"2024-02-19T21:34:24.934879+0000","last_undegraded":"2024-02-19T21:34:24.934879+0000","last_fullsized":"2024-02-19T21:34:24.934879+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:15.667380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:15.667380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.936705+0000","last_change":"2024-02-19T21:33:35.277987+0000","last_active":"2024-02-19T21:34:24.936705+0000","last_peered":"2024-02-19T21:34:24.936705+0000","last_clean":"2024-02-19T21:34:24.936705+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:34:24.936705+0000","last_undegraded":"2024-02-19T21:34:24.936705+0000","last_fullsized":"2024-02-19T21:34:24.936705+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:35.277904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:35.277904+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"66'6","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:27.480819+0000","last_change":"2024-02-19T21:34:27.480792+0000","last_active":"2024-02-19T21:34:27.480819+0000","last_peered":"2024-02-19T21:34:27.480819+0000","last_clean":"2024-02-19T21:34:27.480819+0000","last_became_active":"2024-02-19T21:32:25.372212+0000","last_became_peered":"2024-02-19T21:32:25.372212+0000","last_unstale":"2024-02-19T21:34:27.480819+0000","last_undegraded":"2024-02-19T21:34:27.480819+0000","last_fullsized":"2024-02-19T21:34:27.480819+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'6","last_scrub_stamp":"2024-02-19T21:34:27.480723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:27.480723+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934975+0000","last_change":"2024-02-19T21:34:11.111909+0000","last_active":"2024-02-19T21:34:24.934975+0000","last_peered":"2024-02-19T21:34:24.934975+0000","last_clean":"2024-02-19T21:34:24.934975+0000","last_became_active":"2024-02-19T21:32:29.371977+0000","last_became_peered":"2024-02-19T21:32:29.371977+0000","last_unstale":"2024-02-19T21:34:24.934975+0000","last_undegraded":"2024-02-19T21:34:24.934975+0000","last_fullsized":"2024-02-19T21:34:24.934975+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:11.111829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:11.111829+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935511+0000","last_change":"2024-02-19T21:34:24.527387+0000","last_active":"2024-02-19T21:34:24.935511+0000","last_peered":"2024-02-19T21:34:24.935511+0000","last_clean":"2024-02-19T21:34:24.935511+0000","last_became_active":"2024-02-19T21:32:27.366748+0000","last_became_peered":"2024-02-19T21:32:27.366748+0000","last_unstale":"2024-02-19T21:34:24.935511+0000","last_undegraded":"2024-02-19T21:34:24.935511+0000","last_fullsized":"2024-02-19T21:34:24.935511+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:24.527285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:24.527285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934206+0000","last_change":"2024-02-19T21:33:32.121300+0000","last_active":"2024-02-19T21:34:24.934206+0000","last_peered":"2024-02-19T21:34:24.934206+0000","last_clean":"2024-02-19T21:34:24.934206+0000","last_became_active":"2024-02-19T21:32:23.358939+0000","last_became_peered":"2024-02-19T21:32:23.358939+0000","last_unstale":"2024-02-19T21:34:24.934206+0000","last_undegraded":"2024-02-19T21:34:24.934206+0000","last_fullsized":"2024-02-19T21:34:24.934206+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:33:32.121205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"66'9","reported_seq":62,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898927+0000","last_change":"2024-02-19T21:33:39.539536+0000","last_active":"2024-02-19T21:34:24.898927+0000","last_peered":"2024-02-19T21:34:24.898927+0000","last_clean":"2024-02-19T21:34:24.898927+0000","last_became_active":"2024-02-19T21:32:25.372106+0000","last_became_peered":"2024-02-19T21:32:25.372106+0000","last_unstale":"2024-02-19T21:34:24.898927+0000","last_undegraded":"2024-02-19T21:34:24.898927+0000","last_fullsized":"2024-02-19T21:34:24.898927+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:33:39.539467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:39.539467+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934648+0000","last_change":"2024-02-19T21:33:42.435113+0000","last_active":"2024-02-19T21:34:24.934648+0000","last_peered":"2024-02-19T21:34:24.934648+0000","last_clean":"2024-02-19T21:34:24.934648+0000","last_became_active":"2024-02-19T21:32:29.376027+0000","last_became_peered":"2024-02-19T21:32:29.376027+0000","last_unstale":"2024-02-19T21:34:24.934648+0000","last_undegraded":"2024-02-19T21:34:24.934648+0000","last_fullsized":"2024-02-19T21:34:24.934648+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:42.435033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:42.435033+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"59'2","reported_seq":61,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935978+0000","last_change":"2024-02-19T21:33:59.315758+0000","last_active":"2024-02-19T21:34:24.935978+0000","last_peered":"2024-02-19T21:34:24.935978+0000","last_clean":"2024-02-19T21:34:24.935978+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:34:24.935978+0000","last_undegraded":"2024-02-19T21:34:24.935978+0000","last_fullsized":"2024-02-19T21:34:24.935978+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-02-19T21:33:59.315689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:59.315689+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"83'17","reported_seq":74,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.936962+0000","last_change":"2024-02-19T21:33:43.418544+0000","last_active":"2024-02-19T21:34:24.936962+0000","last_peered":"2024-02-19T21:34:24.936962+0000","last_clean":"2024-02-19T21:34:24.936962+0000","last_became_active":"2024-02-19T21:32:25.366999+0000","last_became_peered":"2024-02-19T21:32:25.366999+0000","last_unstale":"2024-02-19T21:34:24.936962+0000","last_undegraded":"2024-02-19T21:34:24.936962+0000","last_fullsized":"2024-02-19T21:34:24.936962+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'17","last_scrub_stamp":"2024-02-19T21:33:43.418450+0000","last_deep_scrub":"83'17","last_deep_scrub_stamp":"2024-02-19T21:33:43.418450+0000","last_clean_scrub_stamp":"2024-02-19T21:33:43.418450+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934859+0000","last_change":"2024-02-19T21:34:15.250680+0000","last_active":"2024-02-19T21:34:24.934859+0000","last_peered":"2024-02-19T21:34:24.934859+0000","last_clean":"2024-02-19T21:34:24.934859+0000","last_became_active":"2024-02-19T21:32:27.367022+0000","last_became_peered":"2024-02-19T21:32:27.367022+0000","last_unstale":"2024-02-19T21:34:24.934859+0000","last_undegraded":"2024-02-19T21:34:24.934859+0000","last_fullsized":"2024-02-19T21:34:24.934859+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:15.250615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:15.250615+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.897829+0000","last_change":"2024-02-19T21:33:47.550627+0000","last_active":"2024-02-19T21:34:24.897829+0000","last_peered":"2024-02-19T21:34:24.897829+0000","last_clean":"2024-02-19T21:34:24.897829+0000","last_became_active":"2024-02-19T21:32:29.374999+0000","last_became_peered":"2024-02-19T21:32:29.374999+0000","last_unstale":"2024-02-19T21:34:24.897829+0000","last_undegraded":"2024-02-19T21:34:24.897829+0000","last_fullsized":"2024-02-19T21:34:24.897829+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:47.550562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:47.550562+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898696+0000","last_change":"2024-02-19T21:34:07.772488+0000","last_active":"2024-02-19T21:34:24.898696+0000","last_peered":"2024-02-19T21:34:24.898696+0000","last_clean":"2024-02-19T21:34:24.898696+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:34:24.898696+0000","last_undegraded":"2024-02-19T21:34:24.898696+0000","last_fullsized":"2024-02-19T21:34:24.898696+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:07.772420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:07.772420+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"66'10","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934235+0000","last_change":"2024-02-19T21:33:55.131166+0000","last_active":"2024-02-19T21:34:24.934235+0000","last_peered":"2024-02-19T21:34:24.934235+0000","last_clean":"2024-02-19T21:34:24.934235+0000","last_became_active":"2024-02-19T21:33:50.752293+0000","last_became_peered":"2024-02-19T21:33:50.752293+0000","last_unstale":"2024-02-19T21:34:24.934235+0000","last_undegraded":"2024-02-19T21:34:24.934235+0000","last_fullsized":"2024-02-19T21:34:24.934235+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:33:55.131045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:55.131045+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":82,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:51.869658+0000","last_change":"2024-02-19T21:33:56.646321+0000","last_active":"2024-02-19T21:34:51.869658+0000","last_peered":"2024-02-19T21:34:51.869658+0000","last_clean":"2024-02-19T21:34:51.869658+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:34:51.869658+0000","last_undegraded":"2024-02-19T21:34:51.869658+0000","last_fullsized":"2024-02-19T21:34:51.869658+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:33:56.646250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:56.646250+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935458+0000","last_change":"2024-02-19T21:33:30.566865+0000","last_active":"2024-02-19T21:34:24.935458+0000","last_peered":"2024-02-19T21:34:24.935458+0000","last_clean":"2024-02-19T21:34:24.935458+0000","last_became_active":"2024-02-19T21:32:29.372330+0000","last_became_peered":"2024-02-19T21:32:29.372330+0000","last_unstale":"2024-02-19T21:34:24.935458+0000","last_undegraded":"2024-02-19T21:34:24.935458+0000","last_fullsized":"2024-02-19T21:34:24.935458+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:30.566737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:30.566737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:38.714846+0000","last_change":"2024-02-19T21:34:38.714799+0000","last_active":"2024-02-19T21:34:38.714846+0000","last_peered":"2024-02-19T21:34:38.714846+0000","last_clean":"2024-02-19T21:34:38.714846+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:34:38.714846+0000","last_undegraded":"2024-02-19T21:34:38.714846+0000","last_fullsized":"2024-02-19T21:34:38.714846+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:38.714714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:34:38.714714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"66'28","reported_seq":124,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:51.869650+0000","last_change":"2024-02-19T21:34:09.728029+0000","last_active":"2024-02-19T21:34:51.869650+0000","last_peered":"2024-02-19T21:34:51.869650+0000","last_clean":"2024-02-19T21:34:51.869650+0000","last_became_active":"2024-02-19T21:32:25.367594+0000","last_became_peered":"2024-02-19T21:32:25.367594+0000","last_unstale":"2024-02-19T21:34:51.869650+0000","last_undegraded":"2024-02-19T21:34:51.869650+0000","last_fullsized":"2024-02-19T21:34:51.869650+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'28","last_scrub_stamp":"2024-02-19T21:34:09.727958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:09.727958+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898720+0000","last_change":"2024-02-19T21:34:20.616213+0000","last_active":"2024-02-19T21:34:24.898720+0000","last_peered":"2024-02-19T21:34:24.898720+0000","last_clean":"2024-02-19T21:34:24.898720+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:34:24.898720+0000","last_undegraded":"2024-02-19T21:34:24.898720+0000","last_fullsized":"2024-02-19T21:34:24.898720+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:20.616142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:20.616142+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.871460+0000","last_change":"2024-02-19T21:33:56.450607+0000","last_active":"2024-02-19T21:34:24.871460+0000","last_peered":"2024-02-19T21:34:24.871460+0000","last_clean":"2024-02-19T21:34:24.871460+0000","last_became_active":"2024-02-19T21:32:29.597365+0000","last_became_peered":"2024-02-19T21:32:29.597365+0000","last_unstale":"2024-02-19T21:34:24.871460+0000","last_undegraded":"2024-02-19T21:34:24.871460+0000","last_fullsized":"2024-02-19T21:34:24.871460+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:56.450495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:56.450495+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"67'5","reported_seq":199,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-02-19T21:34:54.718563+0000","last_change":"2024-02-19T21:34:54.718563+0000","last_active":"2024-02-19T21:34:54.718563+0000","last_peered":"2024-02-19T21:34:54.718563+0000","last_clean":"2024-02-19T21:34:54.718563+0000","last_became_active":"2024-02-19T21:32:23.354539+0000","last_became_peered":"2024-02-19T21:32:23.354539+0000","last_unstale":"2024-02-19T21:34:54.718563+0000","last_undegraded":"2024-02-19T21:34:54.718563+0000","last_fullsized":"2024-02-19T21:34:54.718563+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5","last_scrub_stamp":"2024-02-19T21:34:54.718482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:54.718482+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":143,"num_read_kb":138,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:49.373249+0000","last_change":"2024-02-19T21:34:49.373211+0000","last_active":"2024-02-19T21:34:49.373249+0000","last_peered":"2024-02-19T21:34:49.373249+0000","last_clean":"2024-02-19T21:34:49.373249+0000","last_became_active":"2024-02-19T21:32:23.358321+0000","last_became_peered":"2024-02-19T21:32:23.358321+0000","last_unstale":"2024-02-19T21:34:49.373249+0000","last_undegraded":"2024-02-19T21:34:49.373249+0000","last_fullsized":"2024-02-19T21:34:49.373249+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:49.373106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:49.373106+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"66'13","reported_seq":73,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.899413+0000","last_change":"2024-02-19T21:33:44.933158+0000","last_active":"2024-02-19T21:34:24.899413+0000","last_peered":"2024-02-19T21:34:24.899413+0000","last_clean":"2024-02-19T21:34:24.899413+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:34:24.899413+0000","last_undegraded":"2024-02-19T21:34:24.899413+0000","last_fullsized":"2024-02-19T21:34:24.899413+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'13","last_scrub_stamp":"2024-02-19T21:33:44.933086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:44.933086+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934620+0000","last_change":"2024-02-19T21:33:59.141840+0000","last_active":"2024-02-19T21:34:24.934620+0000","last_peered":"2024-02-19T21:34:24.934620+0000","last_clean":"2024-02-19T21:34:24.934620+0000","last_became_active":"2024-02-19T21:32:27.363740+0000","last_became_peered":"2024-02-19T21:32:27.363740+0000","last_unstale":"2024-02-19T21:34:24.934620+0000","last_undegraded":"2024-02-19T21:34:24.934620+0000","last_fullsized":"2024-02-19T21:34:24.934620+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:59.141746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:59.141746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935511+0000","last_change":"2024-02-19T21:33:49.500303+0000","last_active":"2024-02-19T21:34:24.935511+0000","last_peered":"2024-02-19T21:34:24.935511+0000","last_clean":"2024-02-19T21:34:24.935511+0000","last_became_active":"2024-02-19T21:32:29.372547+0000","last_became_peered":"2024-02-19T21:32:29.372547+0000","last_unstale":"2024-02-19T21:34:24.935511+0000","last_undegraded":"2024-02-19T21:34:24.935511+0000","last_fullsized":"2024-02-19T21:34:24.935511+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:33:49.500205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934998+0000","last_change":"2024-02-19T21:33:35.584787+0000","last_active":"2024-02-19T21:34:24.934998+0000","last_peered":"2024-02-19T21:34:24.934998+0000","last_clean":"2024-02-19T21:34:24.934998+0000","last_became_active":"2024-02-19T21:32:23.356886+0000","last_became_peered":"2024-02-19T21:32:23.356886+0000","last_unstale":"2024-02-19T21:34:24.934998+0000","last_undegraded":"2024-02-19T21:34:24.934998+0000","last_fullsized":"2024-02-19T21:34:24.934998+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:35.584719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:35.584719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935112+0000","last_change":"2024-02-19T21:33:58.613482+0000","last_active":"2024-02-19T21:34:24.935112+0000","last_peered":"2024-02-19T21:34:24.935112+0000","last_clean":"2024-02-19T21:34:24.935112+0000","last_became_active":"2024-02-19T21:32:23.361163+0000","last_became_peered":"2024-02-19T21:32:23.361163+0000","last_unstale":"2024-02-19T21:34:24.935112+0000","last_undegraded":"2024-02-19T21:34:24.935112+0000","last_fullsized":"2024-02-19T21:34:24.935112+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:58.613390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:58.613390+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.870818+0000","last_change":"2024-02-19T21:34:13.559724+0000","last_active":"2024-02-19T21:34:24.870818+0000","last_peered":"2024-02-19T21:34:24.870818+0000","last_clean":"2024-02-19T21:34:24.870818+0000","last_became_active":"2024-02-19T21:32:16.878022+0000","last_became_peered":"2024-02-19T21:32:16.878022+0000","last_unstale":"2024-02-19T21:34:24.870818+0000","last_undegraded":"2024-02-19T21:34:24.870818+0000","last_fullsized":"2024-02-19T21:34:24.870818+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:13.559611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:34:13.559611+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"66'14","reported_seq":67,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.936082+0000","last_change":"2024-02-19T21:33:47.226393+0000","last_active":"2024-02-19T21:34:24.936082+0000","last_peered":"2024-02-19T21:34:24.936082+0000","last_clean":"2024-02-19T21:34:24.936082+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:34:24.936082+0000","last_undegraded":"2024-02-19T21:34:24.936082+0000","last_fullsized":"2024-02-19T21:34:24.936082+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'14","last_scrub_stamp":"2024-02-19T21:33:47.226311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:47.226311+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:42.524221+0000","last_change":"2024-02-19T21:34:42.524189+0000","last_active":"2024-02-19T21:34:42.524221+0000","last_peered":"2024-02-19T21:34:42.524221+0000","last_clean":"2024-02-19T21:34:42.524221+0000","last_became_active":"2024-02-19T21:32:27.373579+0000","last_became_peered":"2024-02-19T21:32:27.373579+0000","last_unstale":"2024-02-19T21:34:42.524221+0000","last_undegraded":"2024-02-19T21:34:42.524221+0000","last_fullsized":"2024-02-19T21:34:42.524221+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:42.524061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:42.524061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:28.754694+0000","last_change":"2024-02-19T21:34:28.754654+0000","last_active":"2024-02-19T21:34:28.754694+0000","last_peered":"2024-02-19T21:34:28.754694+0000","last_clean":"2024-02-19T21:34:28.754694+0000","last_became_active":"2024-02-19T21:32:29.373625+0000","last_became_peered":"2024-02-19T21:32:29.373625+0000","last_unstale":"2024-02-19T21:34:28.754694+0000","last_undegraded":"2024-02-19T21:34:28.754694+0000","last_fullsized":"2024-02-19T21:34:28.754694+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:28.754584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:28.754584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898114+0000","last_change":"2024-02-19T21:34:12.757010+0000","last_active":"2024-02-19T21:34:24.898114+0000","last_peered":"2024-02-19T21:34:24.898114+0000","last_clean":"2024-02-19T21:34:24.898114+0000","last_became_active":"2024-02-19T21:32:23.359538+0000","last_became_peered":"2024-02-19T21:32:23.359538+0000","last_unstale":"2024-02-19T21:34:24.898114+0000","last_undegraded":"2024-02-19T21:34:24.898114+0000","last_fullsized":"2024-02-19T21:34:24.898114+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:12.756942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:12.756942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.870816+0000","last_change":"2024-02-19T21:34:02.501610+0000","last_active":"2024-02-19T21:34:24.870816+0000","last_peered":"2024-02-19T21:34:24.870816+0000","last_clean":"2024-02-19T21:34:24.870816+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:34:24.870816+0000","last_undegraded":"2024-02-19T21:34:24.870816+0000","last_fullsized":"2024-02-19T21:34:24.870816+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:02.501526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:02.501526+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"66'12","reported_seq":89,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898851+0000","last_change":"2024-02-19T21:33:55.644754+0000","last_active":"2024-02-19T21:34:24.898851+0000","last_peered":"2024-02-19T21:34:24.898851+0000","last_clean":"2024-02-19T21:34:24.898851+0000","last_became_active":"2024-02-19T21:33:50.750727+0000","last_became_peered":"2024-02-19T21:33:50.750727+0000","last_unstale":"2024-02-19T21:34:24.898851+0000","last_undegraded":"2024-02-19T21:34:24.898851+0000","last_fullsized":"2024-02-19T21:34:24.898851+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'12","last_scrub_stamp":"2024-02-19T21:33:55.644685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:55.644685+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935422+0000","last_change":"2024-02-19T21:34:11.592972+0000","last_active":"2024-02-19T21:34:24.935422+0000","last_peered":"2024-02-19T21:34:24.935422+0000","last_clean":"2024-02-19T21:34:24.935422+0000","last_became_active":"2024-02-19T21:32:27.372460+0000","last_became_peered":"2024-02-19T21:32:27.372460+0000","last_unstale":"2024-02-19T21:34:24.935422+0000","last_undegraded":"2024-02-19T21:34:24.935422+0000","last_fullsized":"2024-02-19T21:34:24.935422+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:11.592905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:11.592905+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898932+0000","last_change":"2024-02-19T21:34:04.792894+0000","last_active":"2024-02-19T21:34:24.898932+0000","last_peered":"2024-02-19T21:34:24.898932+0000","last_clean":"2024-02-19T21:34:24.898932+0000","last_became_active":"2024-02-19T21:32:29.597270+0000","last_became_peered":"2024-02-19T21:32:29.597270+0000","last_unstale":"2024-02-19T21:34:24.898932+0000","last_undegraded":"2024-02-19T21:34:24.898932+0000","last_fullsized":"2024-02-19T21:34:24.898932+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:04.792805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:04.792805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.871678+0000","last_change":"2024-02-19T21:33:57.499205+0000","last_active":"2024-02-19T21:34:24.871678+0000","last_peered":"2024-02-19T21:34:24.871678+0000","last_clean":"2024-02-19T21:34:24.871678+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:34:24.871678+0000","last_undegraded":"2024-02-19T21:34:24.871678+0000","last_fullsized":"2024-02-19T21:34:24.871678+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:57.499146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:57.499146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"83'27","reported_seq":90,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.899056+0000","last_change":"2024-02-19T21:33:48.591748+0000","last_active":"2024-02-19T21:34:24.899056+0000","last_peered":"2024-02-19T21:34:24.899056+0000","last_clean":"2024-02-19T21:34:24.899056+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:34:24.899056+0000","last_undegraded":"2024-02-19T21:34:24.899056+0000","last_fullsized":"2024-02-19T21:34:24.899056+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'27","last_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:33:48.591669+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935176+0000","last_change":"2024-02-19T21:33:38.208119+0000","last_active":"2024-02-19T21:34:24.935176+0000","last_peered":"2024-02-19T21:34:24.935176+0000","last_clean":"2024-02-19T21:34:24.935176+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:34:24.935176+0000","last_undegraded":"2024-02-19T21:34:24.935176+0000","last_fullsized":"2024-02-19T21:34:24.935176+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:33:38.208037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:43.256311+0000","last_change":"2024-02-19T21:34:43.256275+0000","last_active":"2024-02-19T21:34:43.256311+0000","last_peered":"2024-02-19T21:34:43.256311+0000","last_clean":"2024-02-19T21:34:43.256311+0000","last_became_active":"2024-02-19T21:32:29.370626+0000","last_became_peered":"2024-02-19T21:32:29.370626+0000","last_unstale":"2024-02-19T21:34:43.256311+0000","last_undegraded":"2024-02-19T21:34:43.256311+0000","last_fullsized":"2024-02-19T21:34:43.256311+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:43.256178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:43.256178+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.899148+0000","last_change":"2024-02-19T21:33:59.903426+0000","last_active":"2024-02-19T21:34:24.899148+0000","last_peered":"2024-02-19T21:34:24.899148+0000","last_clean":"2024-02-19T21:34:24.899148+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:34:24.899148+0000","last_undegraded":"2024-02-19T21:34:24.899148+0000","last_fullsized":"2024-02-19T21:34:24.899148+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:59.903366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:59.903366+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"66'18","reported_seq":77,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934213+0000","last_change":"2024-02-19T21:34:02.539201+0000","last_active":"2024-02-19T21:34:24.934213+0000","last_peered":"2024-02-19T21:34:24.934213+0000","last_clean":"2024-02-19T21:34:24.934213+0000","last_became_active":"2024-02-19T21:32:25.372700+0000","last_became_peered":"2024-02-19T21:32:25.372700+0000","last_unstale":"2024-02-19T21:34:24.934213+0000","last_undegraded":"2024-02-19T21:34:24.934213+0000","last_fullsized":"2024-02-19T21:34:24.934213+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'18","last_scrub_stamp":"2024-02-19T21:34:02.539127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:02.539127+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.937016+0000","last_change":"2024-02-19T21:34:04.274710+0000","last_active":"2024-02-19T21:34:24.937016+0000","last_peered":"2024-02-19T21:34:24.937016+0000","last_clean":"2024-02-19T21:34:24.937016+0000","last_became_active":"2024-02-19T21:32:27.363698+0000","last_became_peered":"2024-02-19T21:32:27.363698+0000","last_unstale":"2024-02-19T21:34:24.937016+0000","last_undegraded":"2024-02-19T21:34:24.937016+0000","last_fullsized":"2024-02-19T21:34:24.937016+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:04.274644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:04.274644+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:49.520146+0000","last_change":"2024-02-19T21:34:49.520113+0000","last_active":"2024-02-19T21:34:49.520146+0000","last_peered":"2024-02-19T21:34:49.520146+0000","last_clean":"2024-02-19T21:34:49.520146+0000","last_became_active":"2024-02-19T21:32:29.597309+0000","last_became_peered":"2024-02-19T21:32:29.597309+0000","last_unstale":"2024-02-19T21:34:49.520146+0000","last_undegraded":"2024-02-19T21:34:49.520146+0000","last_fullsized":"2024-02-19T21:34:49.520146+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:49.520026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:49.520026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.936505+0000","last_change":"2024-02-19T21:33:54.227769+0000","last_active":"2024-02-19T21:34:24.936505+0000","last_peered":"2024-02-19T21:34:24.936505+0000","last_clean":"2024-02-19T21:34:24.936505+0000","last_became_active":"2024-02-19T21:32:23.354215+0000","last_became_peered":"2024-02-19T21:32:23.354215+0000","last_unstale":"2024-02-19T21:34:24.936505+0000","last_undegraded":"2024-02-19T21:34:24.936505+0000","last_fullsized":"2024-02-19T21:34:24.936505+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:54.227674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:54.227674+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"66'14","reported_seq":67,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.936959+0000","last_change":"2024-02-19T21:34:10.348935+0000","last_active":"2024-02-19T21:34:24.936959+0000","last_peered":"2024-02-19T21:34:24.936959+0000","last_clean":"2024-02-19T21:34:24.936959+0000","last_became_active":"2024-02-19T21:32:25.358770+0000","last_became_peered":"2024-02-19T21:32:25.358770+0000","last_unstale":"2024-02-19T21:34:24.936959+0000","last_undegraded":"2024-02-19T21:34:24.936959+0000","last_fullsized":"2024-02-19T21:34:24.936959+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'14","last_scrub_stamp":"2024-02-19T21:34:10.348822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:10.348822+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"66'8","reported_seq":84,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:51.869669+0000","last_change":"2024-02-19T21:33:48.482173+0000","last_active":"2024-02-19T21:34:51.869669+0000","last_peered":"2024-02-19T21:34:51.869669+0000","last_clean":"2024-02-19T21:34:51.869669+0000","last_became_active":"2024-02-19T21:32:27.368914+0000","last_became_peered":"2024-02-19T21:32:27.368914+0000","last_unstale":"2024-02-19T21:34:51.869669+0000","last_undegraded":"2024-02-19T21:34:51.869669+0000","last_fullsized":"2024-02-19T21:34:51.869669+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:33:48.482077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:48.482077+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934828+0000","last_change":"2024-02-19T21:34:09.553708+0000","last_active":"2024-02-19T21:34:24.934828+0000","last_peered":"2024-02-19T21:34:24.934828+0000","last_clean":"2024-02-19T21:34:24.934828+0000","last_became_active":"2024-02-19T21:32:29.597229+0000","last_became_peered":"2024-02-19T21:32:29.597229+0000","last_unstale":"2024-02-19T21:34:24.934828+0000","last_undegraded":"2024-02-19T21:34:24.934828+0000","last_fullsized":"2024-02-19T21:34:24.934828+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:09.553584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:09.553584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935340+0000","last_change":"2024-02-19T21:33:45.555316+0000","last_active":"2024-02-19T21:34:24.935340+0000","last_peered":"2024-02-19T21:34:24.935340+0000","last_clean":"2024-02-19T21:34:24.935340+0000","last_became_active":"2024-02-19T21:32:27.362497+0000","last_became_peered":"2024-02-19T21:32:27.362497+0000","last_unstale":"2024-02-19T21:34:24.935340+0000","last_undegraded":"2024-02-19T21:34:24.935340+0000","last_fullsized":"2024-02-19T21:34:24.935340+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:45.555228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:45.555228+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.870942+0000","last_change":"2024-02-19T21:33:44.409745+0000","last_active":"2024-02-19T21:34:24.870942+0000","last_peered":"2024-02-19T21:34:24.870942+0000","last_clean":"2024-02-19T21:34:24.870942+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:34:24.870942+0000","last_undegraded":"2024-02-19T21:34:24.870942+0000","last_fullsized":"2024-02-19T21:34:24.870942+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:33:44.409655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:44.409655+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"66'11","reported_seq":65,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935758+0000","last_change":"2024-02-19T21:33:40.386202+0000","last_active":"2024-02-19T21:34:24.935758+0000","last_peered":"2024-02-19T21:34:24.935758+0000","last_clean":"2024-02-19T21:34:24.935758+0000","last_became_active":"2024-02-19T21:32:25.361035+0000","last_became_peered":"2024-02-19T21:32:25.361035+0000","last_unstale":"2024-02-19T21:34:24.935758+0000","last_undegraded":"2024-02-19T21:34:24.935758+0000","last_fullsized":"2024-02-19T21:34:24.935758+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:33:40.386081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:40.386081+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935663+0000","last_change":"2024-02-19T21:33:40.680884+0000","last_active":"2024-02-19T21:34:24.935663+0000","last_peered":"2024-02-19T21:34:24.935663+0000","last_clean":"2024-02-19T21:34:24.935663+0000","last_became_active":"2024-02-19T21:32:29.378462+0000","last_became_peered":"2024-02-19T21:32:29.378462+0000","last_unstale":"2024-02-19T21:34:24.935663+0000","last_undegraded":"2024-02-19T21:34:24.935663+0000","last_fullsized":"2024-02-19T21:34:24.935663+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:40.680819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:40.680819+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"66'8","reported_seq":82,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:51.869900+0000","last_change":"2024-02-19T21:34:01.346726+0000","last_active":"2024-02-19T21:34:51.869900+0000","last_peered":"2024-02-19T21:34:51.869900+0000","last_clean":"2024-02-19T21:34:51.869900+0000","last_became_active":"2024-02-19T21:32:27.367867+0000","last_became_peered":"2024-02-19T21:32:27.367867+0000","last_unstale":"2024-02-19T21:34:51.869900+0000","last_undegraded":"2024-02-19T21:34:51.869900+0000","last_fullsized":"2024-02-19T21:34:51.869900+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:34:01.346647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:01.346647+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.899154+0000","last_change":"2024-02-19T21:33:37.911205+0000","last_active":"2024-02-19T21:34:24.899154+0000","last_peered":"2024-02-19T21:34:24.899154+0000","last_clean":"2024-02-19T21:34:24.899154+0000","last_became_active":"2024-02-19T21:32:23.362738+0000","last_became_peered":"2024-02-19T21:32:23.362738+0000","last_unstale":"2024-02-19T21:34:24.899154+0000","last_undegraded":"2024-02-19T21:34:24.899154+0000","last_fullsized":"2024-02-19T21:34:24.899154+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:33:37.911143+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"66'15","reported_seq":71,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.899366+0000","last_change":"2024-02-19T21:33:54.889202+0000","last_active":"2024-02-19T21:34:24.899366+0000","last_peered":"2024-02-19T21:34:24.899366+0000","last_clean":"2024-02-19T21:34:24.899366+0000","last_became_active":"2024-02-19T21:32:25.367511+0000","last_became_peered":"2024-02-19T21:32:25.367511+0000","last_unstale":"2024-02-19T21:34:24.899366+0000","last_undegraded":"2024-02-19T21:34:24.899366+0000","last_fullsized":"2024-02-19T21:34:24.899366+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:33:54.889130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:33:54.889130+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935444+0000","last_change":"2024-02-19T21:34:09.303641+0000","last_active":"2024-02-19T21:34:24.935444+0000","last_peered":"2024-02-19T21:34:24.935444+0000","last_clean":"2024-02-19T21:34:24.935444+0000","last_became_active":"2024-02-19T21:32:29.370710+0000","last_became_peered":"2024-02-19T21:32:29.370710+0000","last_unstale":"2024-02-19T21:34:24.935444+0000","last_undegraded":"2024-02-19T21:34:24.935444+0000","last_fullsized":"2024-02-19T21:34:24.935444+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:09.303502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:09.303502+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"83'9","reported_seq":82,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:51.869674+0000","last_change":"2024-02-19T21:33:49.121296+0000","last_active":"2024-02-19T21:34:51.869674+0000","last_peered":"2024-02-19T21:34:51.869674+0000","last_clean":"2024-02-19T21:34:51.869674+0000","last_became_active":"2024-02-19T21:32:27.363859+0000","last_became_peered":"2024-02-19T21:32:27.363859+0000","last_unstale":"2024-02-19T21:34:51.869674+0000","last_undegraded":"2024-02-19T21:34:51.869674+0000","last_fullsized":"2024-02-19T21:34:51.869674+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'9","last_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:33:49.121238+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898299+0000","last_change":"2024-02-19T21:34:01.906245+0000","last_active":"2024-02-19T21:34:24.898299+0000","last_peered":"2024-02-19T21:34:24.898299+0000","last_clean":"2024-02-19T21:34:24.898299+0000","last_became_active":"2024-02-19T21:32:23.363155+0000","last_became_peered":"2024-02-19T21:32:23.363155+0000","last_unstale":"2024-02-19T21:34:24.898299+0000","last_undegraded":"2024-02-19T21:34:24.898299+0000","last_fullsized":"2024-02-19T21:34:24.898299+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:01.906174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:01.906174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"66'10","reported_seq":66,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:44.293711+0000","last_change":"2024-02-19T21:34:44.293678+0000","last_active":"2024-02-19T21:34:44.293711+0000","last_peered":"2024-02-19T21:34:44.293711+0000","last_clean":"2024-02-19T21:34:44.293711+0000","last_became_active":"2024-02-19T21:32:25.364180+0000","last_became_peered":"2024-02-19T21:32:25.364180+0000","last_unstale":"2024-02-19T21:34:44.293711+0000","last_undegraded":"2024-02-19T21:34:44.293711+0000","last_fullsized":"2024-02-19T21:34:44.293711+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:34:44.293570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:44.293570+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934672+0000","last_change":"2024-02-19T21:34:04.048256+0000","last_active":"2024-02-19T21:34:24.934672+0000","last_peered":"2024-02-19T21:34:24.934672+0000","last_clean":"2024-02-19T21:34:24.934672+0000","last_became_active":"2024-02-19T21:32:29.371946+0000","last_became_peered":"2024-02-19T21:32:29.371946+0000","last_unstale":"2024-02-19T21:34:24.934672+0000","last_undegraded":"2024-02-19T21:34:24.934672+0000","last_fullsized":"2024-02-19T21:34:24.934672+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:04.048187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:04.048187+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898516+0000","last_change":"2024-02-19T21:34:16.785756+0000","last_active":"2024-02-19T21:34:24.898516+0000","last_peered":"2024-02-19T21:34:24.898516+0000","last_clean":"2024-02-19T21:34:24.898516+0000","last_became_active":"2024-02-19T21:32:27.369452+0000","last_became_peered":"2024-02-19T21:32:27.369452+0000","last_unstale":"2024-02-19T21:34:24.898516+0000","last_undegraded":"2024-02-19T21:34:24.898516+0000","last_fullsized":"2024-02-19T21:34:24.898516+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:16.785689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:16.785689+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:46.601045+0000","last_change":"2024-02-19T21:34:46.601011+0000","last_active":"2024-02-19T21:34:46.601045+0000","last_peered":"2024-02-19T21:34:46.601045+0000","last_clean":"2024-02-19T21:34:46.601045+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:34:46.601045+0000","last_undegraded":"2024-02-19T21:34:46.601045+0000","last_fullsized":"2024-02-19T21:34:46.601045+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:46.600917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:34:46.600917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"66'17","reported_seq":79,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:37.259188+0000","last_change":"2024-02-19T21:34:37.259118+0000","last_active":"2024-02-19T21:34:37.259188+0000","last_peered":"2024-02-19T21:34:37.259188+0000","last_clean":"2024-02-19T21:34:37.259188+0000","last_became_active":"2024-02-19T21:32:25.362454+0000","last_became_peered":"2024-02-19T21:32:25.362454+0000","last_unstale":"2024-02-19T21:34:37.259188+0000","last_undegraded":"2024-02-19T21:34:37.259188+0000","last_fullsized":"2024-02-19T21:34:37.259188+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'17","last_scrub_stamp":"2024-02-19T21:34:37.259020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:37.259020+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.870727+0000","last_change":"2024-02-19T21:34:04.422674+0000","last_active":"2024-02-19T21:34:24.870727+0000","last_peered":"2024-02-19T21:34:24.870727+0000","last_clean":"2024-02-19T21:34:24.870727+0000","last_became_active":"2024-02-19T21:32:29.373442+0000","last_became_peered":"2024-02-19T21:32:29.373442+0000","last_unstale":"2024-02-19T21:34:24.870727+0000","last_undegraded":"2024-02-19T21:34:24.870727+0000","last_fullsized":"2024-02-19T21:34:24.870727+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:04.422580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:34:04.422580+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:46.372315+0000","last_change":"2024-02-19T21:34:46.372277+0000","last_active":"2024-02-19T21:34:46.372315+0000","last_peered":"2024-02-19T21:34:46.372315+0000","last_clean":"2024-02-19T21:34:46.372315+0000","last_became_active":"2024-02-19T21:32:27.369020+0000","last_became_peered":"2024-02-19T21:32:27.369020+0000","last_unstale":"2024-02-19T21:34:46.372315+0000","last_undegraded":"2024-02-19T21:34:46.372315+0000","last_fullsized":"2024-02-19T21:34:46.372315+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:46.372184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:46.372184+0000","last_clean_scrub_stamp":"2024-02-19T21:34:46.372184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"59'1","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.935217+0000","last_change":"2024-02-19T21:34:00.104194+0000","last_active":"2024-02-19T21:34:24.935217+0000","last_peered":"2024-02-19T21:34:24.935217+0000","last_clean":"2024-02-19T21:34:24.935217+0000","last_became_active":"2024-02-19T21:32:23.359474+0000","last_became_peered":"2024-02-19T21:32:23.359474+0000","last_unstale":"2024-02-19T21:34:24.935217+0000","last_undegraded":"2024-02-19T21:34:24.935217+0000","last_fullsized":"2024-02-19T21:34:24.935217+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:34:00.104130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:00.104130+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"66'19","reported_seq":81,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:51.882778+0000","last_change":"2024-02-19T21:34:51.882728+0000","last_active":"2024-02-19T21:34:51.882778+0000","last_peered":"2024-02-19T21:34:51.882778+0000","last_clean":"2024-02-19T21:34:51.882778+0000","last_became_active":"2024-02-19T21:32:25.372284+0000","last_became_peered":"2024-02-19T21:32:25.372284+0000","last_unstale":"2024-02-19T21:34:51.882778+0000","last_undegraded":"2024-02-19T21:34:51.882778+0000","last_fullsized":"2024-02-19T21:34:51.882778+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'19","last_scrub_stamp":"2024-02-19T21:34:51.882617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:51.882617+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.897900+0000","last_change":"2024-02-19T21:33:32.580636+0000","last_active":"2024-02-19T21:34:24.897900+0000","last_peered":"2024-02-19T21:34:24.897900+0000","last_clean":"2024-02-19T21:34:24.897900+0000","last_became_active":"2024-02-19T21:32:29.375689+0000","last_became_peered":"2024-02-19T21:32:29.375689+0000","last_unstale":"2024-02-19T21:34:24.897900+0000","last_undegraded":"2024-02-19T21:34:24.897900+0000","last_fullsized":"2024-02-19T21:34:24.897900+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:32.580572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:33:32.580572+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:52.337575+0000","last_change":"2024-02-19T21:34:52.337549+0000","last_active":"2024-02-19T21:34:52.337575+0000","last_peered":"2024-02-19T21:34:52.337575+0000","last_clean":"2024-02-19T21:34:52.337575+0000","last_became_active":"2024-02-19T21:32:27.361539+0000","last_became_peered":"2024-02-19T21:32:27.361539+0000","last_unstale":"2024-02-19T21:34:52.337575+0000","last_undegraded":"2024-02-19T21:34:52.337575+0000","last_fullsized":"2024-02-19T21:34:52.337575+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:52.337480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:34:52.337480+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.898912+0000","last_change":"2024-02-19T21:34:14.758310+0000","last_active":"2024-02-19T21:34:24.898912+0000","last_peered":"2024-02-19T21:34:24.898912+0000","last_clean":"2024-02-19T21:34:24.898912+0000","last_became_active":"2024-02-19T21:32:23.357438+0000","last_became_peered":"2024-02-19T21:32:23.357438+0000","last_unstale":"2024-02-19T21:34:24.898912+0000","last_undegraded":"2024-02-19T21:34:24.898912+0000","last_fullsized":"2024-02-19T21:34:24.898912+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:14.757665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:14.757665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"66'9","reported_seq":67,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:54.399537+0000","last_change":"2024-02-19T21:34:54.399492+0000","last_active":"2024-02-19T21:34:54.399537+0000","last_peered":"2024-02-19T21:34:54.399537+0000","last_clean":"2024-02-19T21:34:54.399537+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:34:54.399537+0000","last_undegraded":"2024-02-19T21:34:54.399537+0000","last_fullsized":"2024-02-19T21:34:54.399537+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:34:54.399382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:54.399382+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:51.519937+0000","last_change":"2024-02-19T21:34:51.519893+0000","last_active":"2024-02-19T21:34:51.519937+0000","last_peered":"2024-02-19T21:34:51.519937+0000","last_clean":"2024-02-19T21:34:51.519937+0000","last_became_active":"2024-02-19T21:32:29.597248+0000","last_became_peered":"2024-02-19T21:32:29.597248+0000","last_unstale":"2024-02-19T21:34:51.519937+0000","last_undegraded":"2024-02-19T21:34:51.519937+0000","last_fullsized":"2024-02-19T21:34:51.519937+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:34:51.519812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:36.648092+0000","last_clean_scrub_stamp":"2024-02-19T21:34:51.519812+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934745+0000","last_change":"2024-02-19T21:33:47.040363+0000","last_active":"2024-02-19T21:34:24.934745+0000","last_peered":"2024-02-19T21:34:24.934745+0000","last_clean":"2024-02-19T21:34:24.934745+0000","last_became_active":"2024-02-19T21:32:23.357486+0000","last_became_peered":"2024-02-19T21:32:23.357486+0000","last_unstale":"2024-02-19T21:34:24.934745+0000","last_undegraded":"2024-02-19T21:34:24.934745+0000","last_fullsized":"2024-02-19T21:34:24.934745+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:33:47.040272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:33:47.040272+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"66'15","reported_seq":70,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:24.934683+0000","last_change":"2024-02-19T21:34:00.561967+0000","last_active":"2024-02-19T21:34:24.934683+0000","last_peered":"2024-02-19T21:34:24.934683+0000","last_clean":"2024-02-19T21:34:24.934683+0000","last_became_active":"2024-02-19T21:32:25.372170+0000","last_became_peered":"2024-02-19T21:32:25.372170+0000","last_unstale":"2024-02-19T21:34:24.934683+0000","last_undegraded":"2024-02-19T21:34:24.934683+0000","last_fullsized":"2024-02-19T21:34:24.934683+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:34:00.561883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:34:00.561883+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"66'8","reported_seq":81,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-02-19T21:34:51.869857+0000","last_change":"2024-02-19T21:33:38.445505+0000","last_active":"2024-02-19T21:34:51.869857+0000","last_peered":"2024-02-19T21:34:51.869857+0000","last_clean":"2024-02-19T21:34:51.869857+0000","last_became_active":"2024-02-19T21:32:27.369840+0000","last_became_peered":"2024-02-19T21:32:27.369840+0000","last_unstale":"2024-02-19T21:34:51.869857+0000","last_undegraded":"2024-02-19T21:34:51.869857+0000","last_fullsized":"2024-02-19T21:34:51.869857+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:33:38.445424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:33:38.445424+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65,"ondisk_log_size":65,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":698,"num_read_kb":455,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":412,"ondisk_log_size":412,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":143,"num_read_kb":138,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201313,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297884,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447268,"statfs":{"total":95995035648,"available":95690002432,"internally_reserved":0,"allocated":708608,"data_stored":358908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53900000000000003,"15min":0.54500000000000004},"min":{"1min":0.33000000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54200000000000004,"15min":0.54500000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.57999999999999996}]},{"osd":1,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.32300000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.53200000000000003,"15min":0.54000000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.53700000000000003}]},{"osd":2,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.315,"5min":0.313,"15min":0.313},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.56499999999999995}]},{"osd":3,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53300000000000003,"15min":0.53200000000000003},"min":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.65500000000000003}]},{"osd":4,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.70399999999999996,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.44},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69799999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.61399999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.63400000000000001,"15min":0.65800000000000003},"min":{"1min":0.33800000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.69099999999999995,"5min":4.6390000000000002,"15min":4.6390000000000002},"last":0.623},{"interface":"front","average":{"1min":0.5,"5min":0.48099999999999998,"15min":0.47799999999999998},"min":{"1min":0.34699999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.48999999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73199999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.86699999999999999,"15min":0.92200000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80300000000000005,"5min":8.8030000000000008,"15min":8.8030000000000008},"last":0.63700000000000001}]}]},{"osd":6,"up_from":47,"seq":201863462952,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297844,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447308,"statfs":{"total":95995035648,"available":95690043392,"internally_reserved":0,"allocated":765952,"data_stored":396433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:34:53 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.5,"15min":0.48899999999999999},"min":{"1min":0.35099999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65100000000000002,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.47999999999999998},"min":{"1min":0.37,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.60599999999999998,"5min":0.755,"15min":0.755},"last":0.60599999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:34:53 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.50700000000000001,"15min":0.503},"min":{"1min":0.41699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.60999999999999999,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.442},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.48099999999999998,"15min":0.47299999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65200000000000002,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.56699999999999995}]},{"osd":2,"last update":"Mon Feb 19 21:34:53 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.50700000000000001,"15min":0.504},"min":{"1min":0.41399999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.61899999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.49399999999999999,"15min":0.47599999999999998},"min":{"1min":0.45400000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.64500000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:34:53 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52000000000000002,"15min":0.51000000000000001},"min":{"1min":0.39300000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.68100000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.499,"15min":0.48999999999999999},"min":{"1min":0.38400000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.622,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.622}]},{"osd":4,"last update":"Mon Feb 19 21:34:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.41099999999999998,"15min":0.38900000000000001},"min":{"1min":0.35699999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.59799999999999998,"5min":0.628,"15min":0.628},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.42899999999999999,"15min":0.41099999999999998},"min":{"1min":0.373,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.58899999999999997}]},{"osd":5,"last update":"Mon Feb 19 21:34:53 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.44,"15min":0.42199999999999999},"min":{"1min":0.36099999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.441,"15min":0.41399999999999998},"min":{"1min":0.379,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.65900000000000003}]},{"osd":7,"last update":"Mon Feb 19 21:34:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.48999999999999999,"15min":0.48199999999999998},"min":{"1min":0.35599999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.38600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.68799999999999994}]}]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297920,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447232,"statfs":{"total":95995035648,"available":95689965568,"internally_reserved":0,"allocated":745472,"data_stored":360125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:34:42 2024","interfaces":[{"interface":"back","average":{"1min":0.28100000000000003,"5min":0.35099999999999998,"15min":0.33900000000000002},"min":{"1min":0.221,"5min":0.193,"15min":0.193},"max":{"1min":0.39700000000000002,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.379},{"interface":"front","average":{"1min":0.317,"5min":0.36199999999999999,"15min":0.34000000000000002},"min":{"1min":0.23799999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.41399999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.32300000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:34:13 2024","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.36399999999999999,"15min":0.36299999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.51600000000000001,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.39800000000000002,"15min":0.38900000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.45800000000000002,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.374}]},{"osd":3,"last update":"Mon Feb 19 21:34:42 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.41699999999999998,"15min":0.42899999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.46999999999999997,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.41499999999999998,"15min":0.42299999999999999},"min":{"1min":0.30399999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.46899999999999997,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.35799999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.59499999999999997,"15min":0.61499999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.66600000000000004,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.59399999999999997,"15min":0.61399999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.69499999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.84799999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:34:27 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.55400000000000005,"15min":0.57399999999999995},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.72099999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.57699999999999996,"15min":0.60099999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80000000000000004,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.625}]},{"osd":6,"last update":"Mon Feb 19 21:34:53 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58799999999999997,"15min":0.60199999999999998},"min":{"1min":0.40300000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.70599999999999996,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59999999999999998,"15min":0.61699999999999999},"min":{"1min":0.433,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.75600000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.72199999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:34:18 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.73399999999999999,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.72799999999999998,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.621}]}]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297880,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447272,"statfs":{"total":95995035648,"available":95690006528,"internally_reserved":0,"allocated":802816,"data_stored":398296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:34:46 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.34599999999999997,"15min":0.307},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.38500000000000001,"15min":0.32400000000000001},"min":{"1min":0.21099999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48899999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.28499999999999998}]},{"osd":2,"last update":"Mon Feb 19 21:34:19 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.39700000000000002,"15min":0.373},"min":{"1min":0.28100000000000003,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.40899999999999997,"15min":0.38200000000000001},"min":{"1min":0.26100000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.35199999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:34:36 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.41399999999999998,"15min":0.40400000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.53100000000000003,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.441,"15min":0.443},"min":{"1min":0.317,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.54000000000000004,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.36899999999999999}]},{"osd":4,"last update":"Mon Feb 19 21:34:03 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59099999999999997,"15min":0.58999999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.59699999999999998,"15min":0.60799999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73999999999999999,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.69999999999999996}]},{"osd":5,"last update":"Mon Feb 19 21:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.621,"15min":0.629},"min":{"1min":0.42299999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84399999999999997,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.629,"15min":0.63},"min":{"1min":0.40500000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.98799999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.64700000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:34:52 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.40999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82799999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89700000000000002,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.61599999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:34:19 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.62,"15min":0.60999999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64800000000000002,"15min":0.65000000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91700000000000004,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.628}]}]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297860,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447292,"statfs":{"total":95995035648,"available":95690027008,"internally_reserved":0,"allocated":782336,"data_stored":397664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:34:12 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.36399999999999999,"15min":0.34799999999999998},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52100000000000002,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.40200000000000002,"15min":0.40600000000000003},"min":{"1min":0.26700000000000002,"5min":0.193,"15min":0.193},"max":{"1min":0.504,"5min":0.624,"15min":0.624},"last":0.313}]},{"osd":1,"last update":"Mon Feb 19 21:34:12 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.376,"15min":0.37},"min":{"1min":0.23100000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.55600000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.38600000000000001,"15min":0.38400000000000001},"min":{"1min":0.23200000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.48799999999999999,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.28799999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:34:44 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.39700000000000002,"15min":0.40100000000000002},"min":{"1min":0.29599999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.52700000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.40100000000000002,"15min":0.40999999999999998},"min":{"1min":0.27600000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.53900000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.32600000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:34:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56499999999999995,"15min":0.57499999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75700000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57399999999999995,"15min":0.57699999999999996},"min":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69899999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.36699999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.59299999999999997,"15min":0.61099999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89400000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.438},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.56999999999999995,"15min":0.58399999999999996},"min":{"1min":0.36799999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.39000000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:33:53 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55800000000000005,"15min":0.56499999999999995},"min":{"1min":0.39900000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.73499999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59299999999999997,"15min":0.59899999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.77900000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.38500000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:34:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60299999999999998,"15min":0.60999999999999999},"min":{"1min":0.40100000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80000000000000004,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.38800000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75800000000000001,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.47799999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149752,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297896,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447256,"statfs":{"total":95995035648,"available":95689990144,"internally_reserved":0,"allocated":720896,"data_stored":358520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:34:42 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.38800000000000001,"15min":0.41199999999999998},"min":{"1min":0.253,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.49199999999999999,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.41099999999999998,"15min":0.438},"min":{"1min":0.28699999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.51500000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.307}]},{"osd":1,"last update":"Mon Feb 19 21:34:42 2024","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.37,"15min":0.39200000000000002},"min":{"1min":0.245,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.44400000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.39400000000000002,"15min":0.42599999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.434,"5min":0.625,"15min":0.625},"last":0.29399999999999998}]},{"osd":2,"last update":"Mon Feb 19 21:34:42 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.42099999999999999,"15min":0.44900000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.52800000000000002,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.39400000000000002,"15min":0.42999999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.48099999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.22900000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:34:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.57999999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57399999999999995,"15min":0.57799999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.85299999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.68500000000000005}]},{"osd":5,"last update":"Mon Feb 19 21:34:27 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.69999999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.77600000000000002,"5min":0.876,"15min":0.876},"last":0.58499999999999996}]},{"osd":6,"last update":"Mon Feb 19 21:34:53 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.46500000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76400000000000001,"5min":0.87,"15min":0.87},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.503,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.70799999999999996,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.625}]},{"osd":7,"last update":"Mon Feb 19 21:34:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.432,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.67400000000000004}]}]},{"osd":4,"up_from":32,"seq":137438953521,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297872,"kb_used_data":776,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447280,"statfs":{"total":95995035648,"available":95690014720,"internally_reserved":0,"allocated":794624,"data_stored":397206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.50600000000000001,"15min":0.51400000000000001},"min":{"1min":0.33100000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.70699999999999996,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79900000000000004,"5min":1.149,"15min":1.149},"last":0.52100000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.51900000000000002,"15min":0.53700000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.66500000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.438},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55000000000000004,"15min":0.55800000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.876,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.59299999999999997}]},{"osd":2,"last update":"Mon Feb 19 21:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54600000000000004,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73399999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.77300000000000002,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.41499999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.377,"5min":0.376,"15min":0.376},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.496},{"interface":"front","average":{"1min":0.5,"5min":0.53400000000000003,"15min":0.54400000000000004},"min":{"1min":0.35299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.46999999999999997}]},{"osd":5,"last update":"Mon Feb 19 21:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.41799999999999998,"15min":0.40000000000000002},"min":{"1min":0.28199999999999997,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.71199999999999997,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.434,"15min":0.41099999999999998},"min":{"1min":0.33700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.65800000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.44500000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:33:51 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.44500000000000001,"15min":0.438},"min":{"1min":0.32300000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.46500000000000002,"15min":0.45600000000000002},"min":{"1min":0.32000000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.42599999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:34:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52200000000000002,"15min":0.51900000000000002},"min":{"1min":0.36399999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71799999999999997,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.67600000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.53600000000000003}]}]},{"osd":5,"up_from":38,"seq":163208757293,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297868,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447284,"statfs":{"total":95995035648,"available":95690018816,"internally_reserved":0,"allocated":692224,"data_stored":358339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:34:28 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53000000000000003,"15min":0.55000000000000004},"min":{"1min":0.34999999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70599999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64400000000000002,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.40500000000000003}]},{"osd":1,"last update":"Mon Feb 19 21:34:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53900000000000003,"15min":0.55600000000000005},"min":{"1min":0.39400000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.51100000000000001,"15min":0.52900000000000003},"min":{"1min":0.35099999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.61199999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.38400000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:34:28 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53400000000000003,"15min":0.54200000000000004},"min":{"1min":0.40400000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79600000000000004,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53900000000000003,"15min":0.55100000000000005},"min":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70499999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59499999999999997}]},{"osd":3,"last update":"Mon Feb 19 21:34:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55900000000000005,"15min":0.56799999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.76200000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59599999999999997,"15min":0.61499999999999999},"min":{"1min":0.42099999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.748,"5min":0.875,"15min":0.875},"last":0.51500000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:34:28 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.40600000000000003,"15min":0.40400000000000003},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.41999999999999998,"15min":0.41199999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.58799999999999997}]},{"osd":6,"last update":"Mon Feb 19 21:33:54 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.44900000000000001,"15min":0.439},"min":{"1min":0.33600000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.45100000000000001,"15min":0.435},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.56999999999999995}]},{"osd":7,"last update":"Mon Feb 19 21:34:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80000000000000004,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.626},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.73799999999999999,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.53900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:34:59.152 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-02-19T21:34:59.152 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd dump 2024-02-19T21:34:59.423 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:34:59.448 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:57.883306+0000 osd.6 (osd.6) 35 : cluster [DBG] 4.1f scrub starts 2024-02-19T21:34:59.448 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:57.886808+0000 osd.6 (osd.6) 36 : cluster [DBG] 4.1f scrub ok 2024-02-19T21:34:59.448 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:58.229804+0000 mgr.y (mgr.14514) 104 : audit [DBG] from='client.24647 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:34:59.448 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:58.488500+0000 osd.3 (osd.3) 55 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:34:59.449 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:58.489838+0000 osd.3 (osd.3) 56 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:34:59.449 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:58.602746+0000 osd.5 (osd.5) 51 : cluster [DBG] 4.15 scrub starts 2024-02-19T21:34:59.449 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:58.604488+0000 osd.5 (osd.5) 52 : cluster [DBG] 4.15 scrub ok 2024-02-19T21:34:59.449 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:58.724869+0000 osd.1 (osd.1) 51 : cluster [DBG] 2.9 scrub starts 2024-02-19T21:34:59.449 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:34:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:58.727802+0000 osd.1 (osd.1) 52 : cluster [DBG] 2.9 scrub ok 2024-02-19T21:34:59.707 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:57.883306+0000 osd.6 (osd.6) 35 : cluster [DBG] 4.1f scrub starts 2024-02-19T21:34:59.707 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:57.886808+0000 osd.6 (osd.6) 36 : cluster [DBG] 4.1f scrub ok 2024-02-19T21:34:59.707 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:58.229804+0000 mgr.y (mgr.14514) 104 : audit [DBG] from='client.24647 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:34:59.707 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:58.488500+0000 osd.3 (osd.3) 55 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:34:59.707 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:58.489838+0000 osd.3 (osd.3) 56 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:34:59.708 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:58.602746+0000 osd.5 (osd.5) 51 : cluster [DBG] 4.15 scrub starts 2024-02-19T21:34:59.708 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:58.604488+0000 osd.5 (osd.5) 52 : cluster [DBG] 4.15 scrub ok 2024-02-19T21:34:59.708 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:58.724869+0000 osd.1 (osd.1) 51 : cluster [DBG] 2.9 scrub starts 2024-02-19T21:34:59.708 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:34:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:58.727802+0000 osd.1 (osd.1) 52 : cluster [DBG] 2.9 scrub ok 2024-02-19T21:34:59.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:57.883306+0000 osd.6 (osd.6) 35 : cluster [DBG] 4.1f scrub starts 2024-02-19T21:34:59.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:57.886808+0000 osd.6 (osd.6) 36 : cluster [DBG] 4.1f scrub ok 2024-02-19T21:34:59.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:58.229804+0000 mgr.y (mgr.14514) 104 : audit [DBG] from='client.24647 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:34:59.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:58.488500+0000 osd.3 (osd.3) 55 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:34:59.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:58.489838+0000 osd.3 (osd.3) 56 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:34:59.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:58.602746+0000 osd.5 (osd.5) 51 : cluster [DBG] 4.15 scrub starts 2024-02-19T21:34:59.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:58.604488+0000 osd.5 (osd.5) 52 : cluster [DBG] 4.15 scrub ok 2024-02-19T21:34:59.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:58.724869+0000 osd.1 (osd.1) 51 : cluster [DBG] 2.9 scrub starts 2024-02-19T21:34:59.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:34:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:58.727802+0000 osd.1 (osd.1) 52 : cluster [DBG] 2.9 scrub ok 2024-02-19T21:35:00.308 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:34:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:35:00.773 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:58.792729+0000 mgr.y (mgr.14514) 105 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:35:00.773 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:58.920946+0000 osd.6 (osd.6) 37 : cluster [DBG] 2.14 scrub starts 2024-02-19T21:35:00.773 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:58.923860+0000 osd.6 (osd.6) 38 : cluster [DBG] 2.14 scrub ok 2024-02-19T21:35:00.773 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:59.353890+0000 osd.0 (osd.0) 51 : cluster [DBG] 6.16 scrub starts 2024-02-19T21:35:00.773 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:59.354816+0000 osd.0 (osd.0) 52 : cluster [DBG] 6.16 scrub ok 2024-02-19T21:35:00.773 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:59.483881+0000 osd.3 (osd.3) 57 : cluster [DBG] 5.0 scrub starts 2024-02-19T21:35:00.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:59.487529+0000 osd.3 (osd.3) 58 : cluster [DBG] 5.0 scrub ok 2024-02-19T21:35:00.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:59.625390+0000 osd.5 (osd.5) 53 : cluster [DBG] 5.f scrub starts 2024-02-19T21:35:00.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:59.628321+0000 osd.5 (osd.5) 54 : cluster [DBG] 5.f scrub ok 2024-02-19T21:35:00.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:59.699733+0000 osd.1 (osd.1) 53 : cluster [DBG] 4.f scrub starts 2024-02-19T21:35:00.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:34:59.701324+0000 osd.1 (osd.1) 54 : cluster [DBG] 4.f scrub ok 2024-02-19T21:35:00.774 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:58.792729+0000 mgr.y (mgr.14514) 105 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:35:00.774 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:58.920946+0000 osd.6 (osd.6) 37 : cluster [DBG] 2.14 scrub starts 2024-02-19T21:35:00.774 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:58.923860+0000 osd.6 (osd.6) 38 : cluster [DBG] 2.14 scrub ok 2024-02-19T21:35:00.774 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:59.353890+0000 osd.0 (osd.0) 51 : cluster [DBG] 6.16 scrub starts 2024-02-19T21:35:00.774 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:59.354816+0000 osd.0 (osd.0) 52 : cluster [DBG] 6.16 scrub ok 2024-02-19T21:35:00.775 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:59.483881+0000 osd.3 (osd.3) 57 : cluster [DBG] 5.0 scrub starts 2024-02-19T21:35:00.775 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:59.487529+0000 osd.3 (osd.3) 58 : cluster [DBG] 5.0 scrub ok 2024-02-19T21:35:00.775 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:59.625390+0000 osd.5 (osd.5) 53 : cluster [DBG] 5.f scrub starts 2024-02-19T21:35:00.775 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:59.628321+0000 osd.5 (osd.5) 54 : cluster [DBG] 5.f scrub ok 2024-02-19T21:35:00.775 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:59.699733+0000 osd.1 (osd.1) 53 : cluster [DBG] 4.f scrub starts 2024-02-19T21:35:00.775 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:34:59.701324+0000 osd.1 (osd.1) 54 : cluster [DBG] 4.f scrub ok 2024-02-19T21:35:00.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:58.792729+0000 mgr.y (mgr.14514) 105 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:35:00.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:58.920946+0000 osd.6 (osd.6) 37 : cluster [DBG] 2.14 scrub starts 2024-02-19T21:35:00.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:58.923860+0000 osd.6 (osd.6) 38 : cluster [DBG] 2.14 scrub ok 2024-02-19T21:35:00.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:59.353890+0000 osd.0 (osd.0) 51 : cluster [DBG] 6.16 scrub starts 2024-02-19T21:35:00.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:59.354816+0000 osd.0 (osd.0) 52 : cluster [DBG] 6.16 scrub ok 2024-02-19T21:35:00.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:59.483881+0000 osd.3 (osd.3) 57 : cluster [DBG] 5.0 scrub starts 2024-02-19T21:35:00.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:59.487529+0000 osd.3 (osd.3) 58 : cluster [DBG] 5.0 scrub ok 2024-02-19T21:35:00.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:59.625390+0000 osd.5 (osd.5) 53 : cluster [DBG] 5.f scrub starts 2024-02-19T21:35:00.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:59.628321+0000 osd.5 (osd.5) 54 : cluster [DBG] 5.f scrub ok 2024-02-19T21:35:00.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:59.699733+0000 osd.1 (osd.1) 53 : cluster [DBG] 4.f scrub starts 2024-02-19T21:35:00.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:34:59.701324+0000 osd.1 (osd.1) 54 : cluster [DBG] 4.f scrub ok 2024-02-19T21:35:01.098 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:35:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:35:00] "GET /metrics HTTP/1.1" 200 172149 "" "Prometheus/2.33.4" 2024-02-19T21:35:01.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:34:59.888331+0000 mgr.y (mgr.14514) 106 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:35:01.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:00.467642+0000 osd.3 (osd.3) 59 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:35:01.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:00.468769+0000 osd.3 (osd.3) 60 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:35:01.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:34:59.888331+0000 mgr.y (mgr.14514) 106 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:35:01.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:00.467642+0000 osd.3 (osd.3) 59 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:35:01.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:00.468769+0000 osd.3 (osd.3) 60 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:35:01.748 INFO:teuthology.orchestra.run.smithi080.stdout:epoch 93 2024-02-19T21:35:01.748 INFO:teuthology.orchestra.run.smithi080.stdout:fsid 6f763558-cf6d-11ee-95bb-87774f69a715 2024-02-19T21:35:01.748 INFO:teuthology.orchestra.run.smithi080.stdout:created 2024-02-19T21:26:16.880265+0000 2024-02-19T21:35:01.748 INFO:teuthology.orchestra.run.smithi080.stdout:modified 2024-02-19T21:34:54.425409+0000 2024-02-19T21:35:01.749 INFO:teuthology.orchestra.run.smithi080.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-02-19T21:35:01.749 INFO:teuthology.orchestra.run.smithi080.stdout:crush_version 18 2024-02-19T21:35:01.749 INFO:teuthology.orchestra.run.smithi080.stdout:full_ratio 0.95 2024-02-19T21:35:01.749 INFO:teuthology.orchestra.run.smithi080.stdout:backfillfull_ratio 0.9 2024-02-19T21:35:01.749 INFO:teuthology.orchestra.run.smithi080.stdout:nearfull_ratio 0.85 2024-02-19T21:35:01.749 INFO:teuthology.orchestra.run.smithi080.stdout:require_min_compat_client luminous 2024-02-19T21:35:01.749 INFO:teuthology.orchestra.run.smithi080.stdout:min_compat_client luminous 2024-02-19T21:35:01.749 INFO:teuthology.orchestra.run.smithi080.stdout:require_osd_release pacific 2024-02-19T21:35:01.749 INFO:teuthology.orchestra.run.smithi080.stdout:stretch_mode_enabled false 2024-02-19T21:35:01.749 INFO:teuthology.orchestra.run.smithi080.stdout:pool 1 'device_health_metrics' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 74 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr_devicehealth 2024-02-19T21:35:01.749 INFO:teuthology.orchestra.run.smithi080.stdout:pool 2 '.rgw.root' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 60 flags hashpspool stripe_width 0 application rgw 2024-02-19T21:35:01.749 INFO:teuthology.orchestra.run.smithi080.stdout:pool 3 'iscsi' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 3 pgp_num 3 autoscale_mode off last_change 62 flags hashpspool stripe_width 0 application rbd 2024-02-19T21:35:01.749 INFO:teuthology.orchestra.run.smithi080.stdout:pool 4 'default.rgw.log' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 62 flags hashpspool stripe_width 0 application rgw 2024-02-19T21:35:01.749 INFO:teuthology.orchestra.run.smithi080.stdout:pool 5 'default.rgw.control' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 64 flags hashpspool stripe_width 0 application rgw 2024-02-19T21:35:01.750 INFO:teuthology.orchestra.run.smithi080.stdout:pool 6 'default.rgw.meta' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 66 flags hashpspool stripe_width 0 pg_autoscale_bias 4 application rgw 2024-02-19T21:35:01.750 INFO:teuthology.orchestra.run.smithi080.stdout:max_osd 8 2024-02-19T21:35:01.750 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0 up in weight 1 up_from 8 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6802/3531298825,v1:172.21.15.80:6803/3531298825] [v2:172.21.15.80:6804/3531298825,v1:172.21.15.80:6805/3531298825] exists,up a72c63f6-46b3-4202-99da-7b0c92b799a5 2024-02-19T21:35:01.750 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1 up in weight 1 up_from 13 up_thru 64 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6810/1497235950,v1:172.21.15.80:6811/1497235950] [v2:172.21.15.80:6812/1497235950,v1:172.21.15.80:6813/1497235950] exists,up 7d4e170e-b0ca-4e19-be35-4038ca126ee6 2024-02-19T21:35:01.750 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2 up in weight 1 up_from 18 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6818/3131848307,v1:172.21.15.80:6819/3131848307] [v2:172.21.15.80:6820/3131848307,v1:172.21.15.80:6821/3131848307] exists,up cf461b67-f3e8-45e9-b2f6-777752ba5574 2024-02-19T21:35:01.750 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3 up in weight 1 up_from 26 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6826/2007978078,v1:172.21.15.80:6827/2007978078] [v2:172.21.15.80:6828/2007978078,v1:172.21.15.80:6829/2007978078] exists,up 76318cdd-5fce-4a40-95c9-300d55c34820 2024-02-19T21:35:01.750 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4 up in weight 1 up_from 32 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.157:6800/1922002860,v1:172.21.15.157:6801/1922002860] [v2:172.21.15.157:6802/1922002860,v1:172.21.15.157:6803/1922002860] exists,up 6484964f-3391-4e1d-a56c-813f46124062 2024-02-19T21:35:01.750 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5 up in weight 1 up_from 38 up_thru 64 down_at 0 last_clean_interval [0,0) [v2:172.21.15.157:6808/960889603,v1:172.21.15.157:6809/960889603] [v2:172.21.15.157:6810/960889603,v1:172.21.15.157:6811/960889603] exists,up 8c7e0309-8c3b-40b9-99d9-96620e52742f 2024-02-19T21:35:01.750 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6 up in weight 1 up_from 47 up_thru 62 down_at 0 last_clean_interval [0,0) [v2:172.21.15.157:6816/2598265223,v1:172.21.15.157:6817/2598265223] [v2:172.21.15.157:6818/2598265223,v1:172.21.15.157:6819/2598265223] exists,up 5b7d44a3-197d-482c-bf9e-de5e9013a851 2024-02-19T21:35:01.750 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7 up in weight 1 up_from 55 up_thru 64 down_at 0 last_clean_interval [0,0) [v2:172.21.15.157:6824/3619345894,v1:172.21.15.157:6825/3619345894] [v2:172.21.15.157:6826/3619345894,v1:172.21.15.157:6827/3619345894] exists,up 7e2d0287-928d-40f8-841b-6c2077fc08ac 2024-02-19T21:35:01.750 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 2.1b [7,2] 2024-02-19T21:35:01.750 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 4.2 [1,2] 2024-02-19T21:35:01.750 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 4.6 [1,5] 2024-02-19T21:35:01.750 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 4.1b [1,2] 2024-02-19T21:35:01.751 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:6800/2867197629 expires 2024-02-20T21:32:48.748960+0000 2024-02-19T21:35:01.751 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:0/1659656010 expires 2024-02-20T21:32:48.748960+0000 2024-02-19T21:35:01.751 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:6801/2272739550 expires 2024-02-20T21:27:15.880876+0000 2024-02-19T21:35:01.751 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:0/867908385 expires 2024-02-20T21:27:15.880876+0000 2024-02-19T21:35:01.751 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:0/398750494 expires 2024-02-20T21:32:48.748960+0000 2024-02-19T21:35:01.751 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:0/2833137430 expires 2024-02-20T21:27:15.880876+0000 2024-02-19T21:35:01.751 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:0/2520755315 expires 2024-02-20T21:32:48.748960+0000 2024-02-19T21:35:01.751 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:6800/2094869828 expires 2024-02-20T21:26:51.262073+0000 2024-02-19T21:35:01.751 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:6800/2272739550 expires 2024-02-20T21:27:15.880876+0000 2024-02-19T21:35:01.751 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:6801/2094869828 expires 2024-02-20T21:26:51.262073+0000 2024-02-19T21:35:01.751 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:0/2130852198 expires 2024-02-20T21:26:51.262073+0000 2024-02-19T21:35:01.751 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:6801/2867197629 expires 2024-02-20T21:32:48.748960+0000 2024-02-19T21:35:01.751 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:0/1952386920 expires 2024-02-20T21:26:51.262073+0000 2024-02-19T21:35:01.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:34:59.888331+0000 mgr.y (mgr.14514) 106 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:35:01.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:00.467642+0000 osd.3 (osd.3) 59 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:35:01.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:00.468769+0000 osd.3 (osd.3) 60 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:35:02.630 INFO:tasks.cephadm.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6802/3531298825,v1:172.21.15.80:6803/3531298825] [v2:172.21.15.80:6804/3531298825,v1:172.21.15.80:6805/3531298825] exists,up a72c63f6-46b3-4202-99da-7b0c92b799a5', 'osd.1 up in weight 1 up_from 13 up_thru 64 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6810/1497235950,v1:172.21.15.80:6811/1497235950] [v2:172.21.15.80:6812/1497235950,v1:172.21.15.80:6813/1497235950] exists,up 7d4e170e-b0ca-4e19-be35-4038ca126ee6', 'osd.2 up in weight 1 up_from 18 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6818/3131848307,v1:172.21.15.80:6819/3131848307] [v2:172.21.15.80:6820/3131848307,v1:172.21.15.80:6821/3131848307] exists,up cf461b67-f3e8-45e9-b2f6-777752ba5574', 'osd.3 up in weight 1 up_from 26 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6826/2007978078,v1:172.21.15.80:6827/2007978078] [v2:172.21.15.80:6828/2007978078,v1:172.21.15.80:6829/2007978078] exists,up 76318cdd-5fce-4a40-95c9-300d55c34820', 'osd.4 up in weight 1 up_from 32 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.157:6800/1922002860,v1:172.21.15.157:6801/1922002860] [v2:172.21.15.157:6802/1922002860,v1:172.21.15.157:6803/1922002860] exists,up 6484964f-3391-4e1d-a56c-813f46124062', 'osd.5 up in weight 1 up_from 38 up_thru 64 down_at 0 last_clean_interval [0,0) [v2:172.21.15.157:6808/960889603,v1:172.21.15.157:6809/960889603] [v2:172.21.15.157:6810/960889603,v1:172.21.15.157:6811/960889603] exists,up 8c7e0309-8c3b-40b9-99d9-96620e52742f', 'osd.6 up in weight 1 up_from 47 up_thru 62 down_at 0 last_clean_interval [0,0) [v2:172.21.15.157:6816/2598265223,v1:172.21.15.157:6817/2598265223] [v2:172.21.15.157:6818/2598265223,v1:172.21.15.157:6819/2598265223] exists,up 5b7d44a3-197d-482c-bf9e-de5e9013a851', 'osd.7 up in weight 1 up_from 55 up_thru 64 down_at 0 last_clean_interval [0,0) [v2:172.21.15.157:6824/3619345894,v1:172.21.15.157:6825/3619345894] [v2:172.21.15.157:6826/3619345894,v1:172.21.15.157:6827/3619345894] exists,up 7e2d0287-928d-40f8-841b-6c2077fc08ac'] 2024-02-19T21:35:02.630 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon mon.a config show 2024-02-19T21:35:02.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:00.793387+0000 mgr.y (mgr.14514) 107 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:35:02.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:01.504485+0000 osd.3 (osd.3) 61 : cluster [DBG] 3.2 deep-scrub starts 2024-02-19T21:35:02.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:01.507414+0000 osd.3 (osd.3) 62 : cluster [DBG] 3.2 deep-scrub ok 2024-02-19T21:35:02.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:01.541709+0000 osd.7 (osd.7) 51 : cluster [DBG] 6.15 scrub starts 2024-02-19T21:35:02.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:01.544658+0000 osd.7 (osd.7) 52 : cluster [DBG] 6.15 scrub ok 2024-02-19T21:35:02.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:01.746830+0000 mon.c (mon.2) 21 : audit [DBG] from='client.? 172.21.15.80:0/2585388254' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-02-19T21:35:02.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:00.793387+0000 mgr.y (mgr.14514) 107 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:35:02.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:01.504485+0000 osd.3 (osd.3) 61 : cluster [DBG] 3.2 deep-scrub starts 2024-02-19T21:35:02.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:01.507414+0000 osd.3 (osd.3) 62 : cluster [DBG] 3.2 deep-scrub ok 2024-02-19T21:35:02.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:01.541709+0000 osd.7 (osd.7) 51 : cluster [DBG] 6.15 scrub starts 2024-02-19T21:35:02.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:01.544658+0000 osd.7 (osd.7) 52 : cluster [DBG] 6.15 scrub ok 2024-02-19T21:35:02.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:01.746830+0000 mon.c (mon.2) 21 : audit [DBG] from='client.? 172.21.15.80:0/2585388254' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-02-19T21:35:02.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:00.793387+0000 mgr.y (mgr.14514) 107 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:35:02.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:01.504485+0000 osd.3 (osd.3) 61 : cluster [DBG] 3.2 deep-scrub starts 2024-02-19T21:35:02.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:01.507414+0000 osd.3 (osd.3) 62 : cluster [DBG] 3.2 deep-scrub ok 2024-02-19T21:35:02.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:01.541709+0000 osd.7 (osd.7) 51 : cluster [DBG] 6.15 scrub starts 2024-02-19T21:35:02.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:01.544658+0000 osd.7 (osd.7) 52 : cluster [DBG] 6.15 scrub ok 2024-02-19T21:35:02.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:01.746830+0000 mon.c (mon.2) 21 : audit [DBG] from='client.? 172.21.15.80:0/2585388254' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-02-19T21:35:02.900 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:35:03.465 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:01.963630+0000 osd.6 (osd.6) 39 : cluster [DBG] 5.1f scrub starts 2024-02-19T21:35:03.466 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:01.967098+0000 osd.6 (osd.6) 40 : cluster [DBG] 5.1f scrub ok 2024-02-19T21:35:03.466 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:02.198682+0000 osd.2 (osd.2) 43 : cluster [DBG] 4.1c deep-scrub starts 2024-02-19T21:35:03.466 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:02.204549+0000 osd.2 (osd.2) 44 : cluster [DBG] 4.1c deep-scrub ok 2024-02-19T21:35:03.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:01.963630+0000 osd.6 (osd.6) 39 : cluster [DBG] 5.1f scrub starts 2024-02-19T21:35:03.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:01.967098+0000 osd.6 (osd.6) 40 : cluster [DBG] 5.1f scrub ok 2024-02-19T21:35:03.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:02.198682+0000 osd.2 (osd.2) 43 : cluster [DBG] 4.1c deep-scrub starts 2024-02-19T21:35:03.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:02.204549+0000 osd.2 (osd.2) 44 : cluster [DBG] 4.1c deep-scrub ok 2024-02-19T21:35:03.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:01.963630+0000 osd.6 (osd.6) 39 : cluster [DBG] 5.1f scrub starts 2024-02-19T21:35:03.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:01.967098+0000 osd.6 (osd.6) 40 : cluster [DBG] 5.1f scrub ok 2024-02-19T21:35:03.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:02.198682+0000 osd.2 (osd.2) 43 : cluster [DBG] 4.1c deep-scrub starts 2024-02-19T21:35:03.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:02.204549+0000 osd.2 (osd.2) 44 : cluster [DBG] 4.1c deep-scrub ok 2024-02-19T21:35:04.732 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:02.793742+0000 mgr.y (mgr.14514) 108 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:35:04.732 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:03.422698+0000 osd.0 (osd.0) 53 : cluster [DBG] 6.9 scrub starts 2024-02-19T21:35:04.732 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:03.423933+0000 osd.0 (osd.0) 54 : cluster [DBG] 6.9 scrub ok 2024-02-19T21:35:04.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:03.795858+0000 osd.1 (osd.1) 55 : cluster [DBG] 4.7 scrub starts 2024-02-19T21:35:04.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:03.797745+0000 osd.1 (osd.1) 56 : cluster [DBG] 4.7 scrub ok 2024-02-19T21:35:04.733 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:02.793742+0000 mgr.y (mgr.14514) 108 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:35:04.733 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:03.422698+0000 osd.0 (osd.0) 53 : cluster [DBG] 6.9 scrub starts 2024-02-19T21:35:04.733 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:03.423933+0000 osd.0 (osd.0) 54 : cluster [DBG] 6.9 scrub ok 2024-02-19T21:35:04.733 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:03.795858+0000 osd.1 (osd.1) 55 : cluster [DBG] 4.7 scrub starts 2024-02-19T21:35:04.733 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:03.797745+0000 osd.1 (osd.1) 56 : cluster [DBG] 4.7 scrub ok 2024-02-19T21:35:04.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:02.793742+0000 mgr.y (mgr.14514) 108 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:35:04.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:03.422698+0000 osd.0 (osd.0) 53 : cluster [DBG] 6.9 scrub starts 2024-02-19T21:35:04.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:03.423933+0000 osd.0 (osd.0) 54 : cluster [DBG] 6.9 scrub ok 2024-02-19T21:35:04.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:03.795858+0000 osd.1 (osd.1) 55 : cluster [DBG] 4.7 scrub starts 2024-02-19T21:35:04.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:03.797745+0000 osd.1 (osd.1) 56 : cluster [DBG] 4.7 scrub ok 2024-02-19T21:35:05.025 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:35:05.025 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mon.a", 2024-02-19T21:35:05.025 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster": "ceph", 2024-02-19T21:35:05.025 INFO:teuthology.orchestra.run.smithi080.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-02-19T21:35:05.025 INFO:teuthology.orchestra.run.smithi080.stdout: "admin_socket_mode": "", 2024-02-19T21:35:05.025 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_allow_insecure_global_id_reclaim": "false", 2024-02-19T21:35:05.026 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_client_required": "cephx, none", 2024-02-19T21:35:05.026 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_cluster_required": "cephx", 2024-02-19T21:35:05.026 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_debug": "true", 2024-02-19T21:35:05.026 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-02-19T21:35:05.026 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-02-19T21:35:05.026 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_service_required": "cephx", 2024-02-19T21:35:05.026 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_service_ticket_ttl": "240.000000", 2024-02-19T21:35:05.026 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_supported": "", 2024-02-19T21:35:05.026 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_aio": "true", 2024-02-19T21:35:05.026 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_aio_max_queue_depth": "1024", 2024-02-19T21:35:05.026 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_aio_poll_ms": "250", 2024-02-19T21:35:05.026 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_aio_reap_max": "16", 2024-02-19T21:35:05.026 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_async_discard": "false", 2024-02-19T21:35:05.026 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_block_size": "4096", 2024-02-19T21:35:05.026 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_debug_aio": "false", 2024-02-19T21:35:05.027 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-02-19T21:35:05.027 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-02-19T21:35:05.027 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_debug_inflight_ios": "false", 2024-02-19T21:35:05.027 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_enable_discard": "false", 2024-02-19T21:35:05.027 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_flock_retry": "3", 2024-02-19T21:35:05.027 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_flock_retry_interval": "0.100000", 2024-02-19T21:35:05.027 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_inject_crash": "0", 2024-02-19T21:35:05.027 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_inject_crash_flush_delay": "2", 2024-02-19T21:35:05.027 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_ioring": "false", 2024-02-19T21:35:05.027 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_ioring_hipri": "false", 2024-02-19T21:35:05.027 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_ioring_sqthread_poll": "false", 2024-02-19T21:35:05.027 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-02-19T21:35:05.027 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_type": "", 2024-02-19T21:35:05.027 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_alloc_size": "1048576", 2024-02-19T21:35:05.028 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_allocator": "hybrid", 2024-02-19T21:35:05.028 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_buffered_io": "true", 2024-02-19T21:35:05.028 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_check_for_zeros": "false", 2024-02-19T21:35:05.028 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_check_volume_selector_often": "false", 2024-02-19T21:35:05.028 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-02-19T21:35:05.028 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_compact_log_sync": "false", 2024-02-19T21:35:05.028 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-02-19T21:35:05.028 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-02-19T21:35:05.028 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_log_compact_min_size": "16777216", 2024-02-19T21:35:05.028 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_log_replay_check_allocations": "true", 2024-02-19T21:35:05.028 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_max_log_runway": "4194304", 2024-02-19T21:35:05.028 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_max_prefetch": "1048576", 2024-02-19T21:35:05.028 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_min_flush_size": "524288", 2024-02-19T21:35:05.028 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_min_log_runway": "1048576", 2024-02-19T21:35:05.028 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_replay_recovery": "false", 2024-02-19T21:35:05.029 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-02-19T21:35:05.029 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_shared_alloc_size": "65536", 2024-02-19T21:35:05.029 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_sync_write": "false", 2024-02-19T21:35:05.029 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-02-19T21:35:05.029 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-02-19T21:35:05.029 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-02-19T21:35:05.029 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_allocator": "hybrid", 2024-02-19T21:35:05.029 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-02-19T21:35:05.029 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-02-19T21:35:05.029 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-02-19T21:35:05.029 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-02-19T21:35:05.029 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-02-19T21:35:05.029 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-02-19T21:35:05.029 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_blobid_prealloc": "10240", 2024-02-19T21:35:05.030 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_block_create": "true", 2024-02-19T21:35:05.030 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_block_db_create": "false", 2024-02-19T21:35:05.030 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_block_db_path": "", 2024-02-19T21:35:05.030 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_block_db_size": "0", 2024-02-19T21:35:05.030 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_block_path": "", 2024-02-19T21:35:05.030 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_block_preallocate_file": "false", 2024-02-19T21:35:05.030 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_block_size": "107374182400", 2024-02-19T21:35:05.030 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_block_wal_create": "false", 2024-02-19T21:35:05.030 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_block_wal_path": "", 2024-02-19T21:35:05.030 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_block_wal_size": "100663296", 2024-02-19T21:35:05.030 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_bluefs": "true", 2024-02-19T21:35:05.030 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-02-19T21:35:05.030 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_bluefs_env_mirror": "false", 2024-02-19T21:35:05.030 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_autotune": "true", 2024-02-19T21:35:05.030 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-02-19T21:35:05.031 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-02-19T21:35:05.031 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-02-19T21:35:05.031 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-02-19T21:35:05.031 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_size": "0", 2024-02-19T21:35:05.031 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-02-19T21:35:05.031 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-02-19T21:35:05.031 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-02-19T21:35:05.031 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-02-19T21:35:05.031 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_type": "2q", 2024-02-19T21:35:05.031 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_clone_cow": "true", 2024-02-19T21:35:05.031 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_compression_algorithm": "snappy", 2024-02-19T21:35:05.031 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_compression_max_blob_size": "0", 2024-02-19T21:35:05.031 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-02-19T21:35:05.031 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-02-19T21:35:05.031 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_compression_min_blob_size": "0", 2024-02-19T21:35:05.032 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-02-19T21:35:05.032 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_compression_min_blob_size_ssd": "8192", 2024-02-19T21:35:05.032 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_compression_mode": "none", 2024-02-19T21:35:05.032 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-02-19T21:35:05.032 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_csum_type": "crc32c", 2024-02-19T21:35:05.032 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_enforce_settings": "default", 2024-02-19T21:35:05.032 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_freelist": "false", 2024-02-19T21:35:05.032 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_fsck_abort": "false", 2024-02-19T21:35:05.032 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_inject_bug21040": "false", 2024-02-19T21:35:05.032 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-02-19T21:35:05.032 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_inject_read_err": "false", 2024-02-19T21:35:05.032 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_legacy_omap": "false", 2024-02-19T21:35:05.032 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-02-19T21:35:05.032 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-02-19T21:35:05.033 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-02-19T21:35:05.033 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-02-19T21:35:05.033 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_prefill": "0.000000", 2024-02-19T21:35:05.033 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-02-19T21:35:05.033 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-02-19T21:35:05.033 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-02-19T21:35:05.033 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_small_allocations": "0", 2024-02-19T21:35:05.033 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-02-19T21:35:05.033 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_default_buffered_read": "true", 2024-02-19T21:35:05.033 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_default_buffered_write": "false", 2024-02-19T21:35:05.033 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_deferred_batch_ops": "0", 2024-02-19T21:35:05.033 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-02-19T21:35:05.033 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-02-19T21:35:05.033 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-02-19T21:35:05.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-02-19T21:35:05.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-02-19T21:35:05.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-02-19T21:35:05.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-02-19T21:35:05.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-02-19T21:35:05.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-02-19T21:35:05.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-02-19T21:35:05.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-02-19T21:35:05.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_on_mkfs": "true", 2024-02-19T21:35:05.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-02-19T21:35:05.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_on_mount": "false", 2024-02-19T21:35:05.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-02-19T21:35:05.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_on_umount": "false", 2024-02-19T21:35:05.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-02-19T21:35:05.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-02-19T21:35:05.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-02-19T21:35:05.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-02-19T21:35:05.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-02-19T21:35:05.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-02-19T21:35:05.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-02-19T21:35:05.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-02-19T21:35:05.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_ignore_data_csum": "false", 2024-02-19T21:35:05.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-02-19T21:35:05.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_kvbackend": "rocksdb", 2024-02-19T21:35:05.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-02-19T21:35:05.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-02-19T21:35:05.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_log_op_age": "5.000000", 2024-02-19T21:35:05.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_max_alloc_size": "0", 2024-02-19T21:35:05.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_max_blob_size": "0", 2024-02-19T21:35:05.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-02-19T21:35:05.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-02-19T21:35:05.036 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_max_defer_interval": "3.000000", 2024-02-19T21:35:05.036 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_max_deferred_txc": "32", 2024-02-19T21:35:05.036 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_min_alloc_size": "0", 2024-02-19T21:35:05.036 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-02-19T21:35:05.036 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-02-19T21:35:05.036 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_nid_prealloc": "1024", 2024-02-19T21:35:05.036 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_prefer_deferred_size": "0", 2024-02-19T21:35:05.036 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-02-19T21:35:05.036 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-02-19T21:35:05.036 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_retry_disk_reads": "3", 2024-02-19T21:35:05.036 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_rocksdb_cf": "true", 2024-02-19T21:35:05.036 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L P", 2024-02-19T21:35:05.036 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_rocksdb_options": "compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152,max_background_compactions=2,max_total_wal_size=1073741824", 2024-02-19T21:35:05.036 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_rocksdb_options_annex": "", 2024-02-19T21:35:05.037 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_spdk_coremask": "0x1", 2024-02-19T21:35:05.037 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_spdk_io_sleep": "5", 2024-02-19T21:35:05.037 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_spdk_max_io_completion": "0", 2024-02-19T21:35:05.037 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_spdk_mem": "512", 2024-02-19T21:35:05.037 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_sync_submit_transaction": "false", 2024-02-19T21:35:05.037 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_throttle_bytes": "67108864", 2024-02-19T21:35:05.037 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_throttle_cost_per_io": "0", 2024-02-19T21:35:05.037 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-02-19T21:35:05.037 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-02-19T21:35:05.037 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-02-19T21:35:05.037 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-02-19T21:35:05.037 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_tracing": "false", 2024-02-19T21:35:05.037 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-02-19T21:35:05.037 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_volume_selection_reserved": "0", 2024-02-19T21:35:05.038 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-02-19T21:35:05.038 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-02-19T21:35:05.038 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-02-19T21:35:05.038 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-02-19T21:35:05.038 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-02-19T21:35:05.038 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-02-19T21:35:05.038 INFO:teuthology.orchestra.run.smithi080.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-02-19T21:35:05.038 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_mirror_action_update_interval": "2", 2024-02-19T21:35:05.038 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-02-19T21:35:05.038 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-02-19T21:35:05.038 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-02-19T21:35:05.038 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-02-19T21:35:05.038 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_mirror_mount_timeout": "10", 2024-02-19T21:35:05.038 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-02-19T21:35:05.038 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-02-19T21:35:05.039 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-02-19T21:35:05.039 INFO:teuthology.orchestra.run.smithi080.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-02-19T21:35:05.039 INFO:teuthology.orchestra.run.smithi080.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-02-19T21:35:05.039 INFO:teuthology.orchestra.run.smithi080.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-02-19T21:35:05.039 INFO:teuthology.orchestra.run.smithi080.stdout: "cephx_cluster_require_signatures": "false", 2024-02-19T21:35:05.039 INFO:teuthology.orchestra.run.smithi080.stdout: "cephx_cluster_require_version": "2", 2024-02-19T21:35:05.039 INFO:teuthology.orchestra.run.smithi080.stdout: "cephx_require_signatures": "false", 2024-02-19T21:35:05.039 INFO:teuthology.orchestra.run.smithi080.stdout: "cephx_require_version": "2", 2024-02-19T21:35:05.039 INFO:teuthology.orchestra.run.smithi080.stdout: "cephx_service_require_signatures": "false", 2024-02-19T21:35:05.039 INFO:teuthology.orchestra.run.smithi080.stdout: "cephx_service_require_version": "2", 2024-02-19T21:35:05.039 INFO:teuthology.orchestra.run.smithi080.stdout: "cephx_sign_messages": "true", 2024-02-19T21:35:05.040 INFO:teuthology.orchestra.run.smithi080.stdout: "chdir": "", 2024-02-19T21:35:05.040 INFO:teuthology.orchestra.run.smithi080.stdout: "client_acl_type": "", 2024-02-19T21:35:05.040 INFO:teuthology.orchestra.run.smithi080.stdout: "client_asio_thread_count": "2", 2024-02-19T21:35:05.040 INFO:teuthology.orchestra.run.smithi080.stdout: "client_cache_mid": "0.750000", 2024-02-19T21:35:05.040 INFO:teuthology.orchestra.run.smithi080.stdout: "client_cache_size": "16384", 2024-02-19T21:35:05.040 INFO:teuthology.orchestra.run.smithi080.stdout: "client_caps_release_delay": "5", 2024-02-19T21:35:05.040 INFO:teuthology.orchestra.run.smithi080.stdout: "client_check_pool_perm": "true", 2024-02-19T21:35:05.040 INFO:teuthology.orchestra.run.smithi080.stdout: "client_collect_and_send_global_metrics": "false", 2024-02-19T21:35:05.040 INFO:teuthology.orchestra.run.smithi080.stdout: "client_debug_force_sync_read": "false", 2024-02-19T21:35:05.040 INFO:teuthology.orchestra.run.smithi080.stdout: "client_debug_getattr_caps": "false", 2024-02-19T21:35:05.040 INFO:teuthology.orchestra.run.smithi080.stdout: "client_debug_inject_tick_delay": "0", 2024-02-19T21:35:05.040 INFO:teuthology.orchestra.run.smithi080.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-02-19T21:35:05.040 INFO:teuthology.orchestra.run.smithi080.stdout: "client_die_on_failed_remount": "false", 2024-02-19T21:35:05.040 INFO:teuthology.orchestra.run.smithi080.stdout: "client_dirsize_rbytes": "true", 2024-02-19T21:35:05.041 INFO:teuthology.orchestra.run.smithi080.stdout: "client_force_lazyio": "false", 2024-02-19T21:35:05.041 INFO:teuthology.orchestra.run.smithi080.stdout: "client_fs": "", 2024-02-19T21:35:05.041 INFO:teuthology.orchestra.run.smithi080.stdout: "client_inject_fixed_oldest_tid": "false", 2024-02-19T21:35:05.041 INFO:teuthology.orchestra.run.smithi080.stdout: "client_inject_release_failure": "false", 2024-02-19T21:35:05.041 INFO:teuthology.orchestra.run.smithi080.stdout: "client_max_inline_size": "4096", 2024-02-19T21:35:05.041 INFO:teuthology.orchestra.run.smithi080.stdout: "client_max_retries_on_remount_failure": "5", 2024-02-19T21:35:05.041 INFO:teuthology.orchestra.run.smithi080.stdout: "client_mds_namespace": "", 2024-02-19T21:35:05.041 INFO:teuthology.orchestra.run.smithi080.stdout: "client_metadata": "", 2024-02-19T21:35:05.041 INFO:teuthology.orchestra.run.smithi080.stdout: "client_mount_gid": "-1", 2024-02-19T21:35:05.041 INFO:teuthology.orchestra.run.smithi080.stdout: "client_mount_timeout": "300", 2024-02-19T21:35:05.041 INFO:teuthology.orchestra.run.smithi080.stdout: "client_mount_uid": "-1", 2024-02-19T21:35:05.041 INFO:teuthology.orchestra.run.smithi080.stdout: "client_mountpoint": "/", 2024-02-19T21:35:05.041 INFO:teuthology.orchestra.run.smithi080.stdout: "client_notify_timeout": "10", 2024-02-19T21:35:05.041 INFO:teuthology.orchestra.run.smithi080.stdout: "client_oc": "true", 2024-02-19T21:35:05.041 INFO:teuthology.orchestra.run.smithi080.stdout: "client_oc_max_dirty": "104857600", 2024-02-19T21:35:05.042 INFO:teuthology.orchestra.run.smithi080.stdout: "client_oc_max_dirty_age": "5.000000", 2024-02-19T21:35:05.042 INFO:teuthology.orchestra.run.smithi080.stdout: "client_oc_max_objects": "1000", 2024-02-19T21:35:05.042 INFO:teuthology.orchestra.run.smithi080.stdout: "client_oc_size": "209715200", 2024-02-19T21:35:05.042 INFO:teuthology.orchestra.run.smithi080.stdout: "client_oc_target_dirty": "8388608", 2024-02-19T21:35:05.042 INFO:teuthology.orchestra.run.smithi080.stdout: "client_permissions": "true", 2024-02-19T21:35:05.042 INFO:teuthology.orchestra.run.smithi080.stdout: "client_quota": "true", 2024-02-19T21:35:05.042 INFO:teuthology.orchestra.run.smithi080.stdout: "client_quota_df": "true", 2024-02-19T21:35:05.042 INFO:teuthology.orchestra.run.smithi080.stdout: "client_readahead_max_bytes": "0", 2024-02-19T21:35:05.042 INFO:teuthology.orchestra.run.smithi080.stdout: "client_readahead_max_periods": "4", 2024-02-19T21:35:05.042 INFO:teuthology.orchestra.run.smithi080.stdout: "client_readahead_min": "131072", 2024-02-19T21:35:05.042 INFO:teuthology.orchestra.run.smithi080.stdout: "client_reconnect_stale": "false", 2024-02-19T21:35:05.042 INFO:teuthology.orchestra.run.smithi080.stdout: "client_shutdown_timeout": "30", 2024-02-19T21:35:05.042 INFO:teuthology.orchestra.run.smithi080.stdout: "client_snapdir": ".snap", 2024-02-19T21:35:05.042 INFO:teuthology.orchestra.run.smithi080.stdout: "client_tick_interval": "1", 2024-02-19T21:35:05.042 INFO:teuthology.orchestra.run.smithi080.stdout: "client_trace": "", 2024-02-19T21:35:05.042 INFO:teuthology.orchestra.run.smithi080.stdout: "client_try_dentry_invalidate": "false", 2024-02-19T21:35:05.043 INFO:teuthology.orchestra.run.smithi080.stdout: "client_use_faked_inos": "false", 2024-02-19T21:35:05.043 INFO:teuthology.orchestra.run.smithi080.stdout: "client_use_random_mds": "false", 2024-02-19T21:35:05.043 INFO:teuthology.orchestra.run.smithi080.stdout: "clog_to_graylog": "false", 2024-02-19T21:35:05.043 INFO:teuthology.orchestra.run.smithi080.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-02-19T21:35:05.043 INFO:teuthology.orchestra.run.smithi080.stdout: "clog_to_graylog_port": "12201", 2024-02-19T21:35:05.043 INFO:teuthology.orchestra.run.smithi080.stdout: "clog_to_monitors": "default=true", 2024-02-19T21:35:05.043 INFO:teuthology.orchestra.run.smithi080.stdout: "clog_to_syslog": "false", 2024-02-19T21:35:05.043 INFO:teuthology.orchestra.run.smithi080.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-02-19T21:35:05.043 INFO:teuthology.orchestra.run.smithi080.stdout: "clog_to_syslog_level": "info", 2024-02-19T21:35:05.043 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "-", 2024-02-19T21:35:05.043 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_network": "", 2024-02-19T21:35:05.043 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_network_interface": "", 2024-02-19T21:35:05.043 INFO:teuthology.orchestra.run.smithi080.stdout: "compressor_zlib_isal": "false", 2024-02-19T21:35:05.043 INFO:teuthology.orchestra.run.smithi080.stdout: "compressor_zlib_level": "5", 2024-02-19T21:35:05.044 INFO:teuthology.orchestra.run.smithi080.stdout: "compressor_zlib_winsize": "-15", 2024-02-19T21:35:05.044 INFO:teuthology.orchestra.run.smithi080.stdout: "compressor_zstd_level": "1", 2024-02-19T21:35:05.044 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", 2024-02-19T21:35:05.044 INFO:teuthology.orchestra.run.smithi080.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-02-19T21:35:05.044 INFO:teuthology.orchestra.run.smithi080.stdout: "crimson_osd_obc_lru_size": "10", 2024-02-19T21:35:05.044 INFO:teuthology.orchestra.run.smithi080.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-02-19T21:35:05.044 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_location": "", 2024-02-19T21:35:05.044 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_location_hook": "", 2024-02-19T21:35:05.044 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_location_hook_timeout": "10", 2024-02-19T21:35:05.044 INFO:teuthology.orchestra.run.smithi080.stdout: "daemonize": "false", 2024-02-19T21:35:05.044 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_allow_any_pool_priority": "false", 2024-02-19T21:35:05.044 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_asok": "1/5", 2024-02-19T21:35:05.044 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_asok_assert_abort": "false", 2024-02-19T21:35:05.044 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_asserts_on_shutdown": "true", 2024-02-19T21:35:05.045 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_auth": "1/5", 2024-02-19T21:35:05.045 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_bdev": "1/3", 2024-02-19T21:35:05.045 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_bluefs": "1/5", 2024-02-19T21:35:05.045 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_bluestore": "1/5", 2024-02-19T21:35:05.045 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_buffer": "0/1", 2024-02-19T21:35:05.045 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_cephfs_mirror": "0/5", 2024-02-19T21:35:05.045 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_cephsqlite": "0/5", 2024-02-19T21:35:05.045 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_civetweb": "1/10", 2024-02-19T21:35:05.045 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_client": "0/5", 2024-02-19T21:35:05.045 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_compressor": "1/5", 2024-02-19T21:35:05.045 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_context": "0/1", 2024-02-19T21:35:05.045 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_crush": "1/1", 2024-02-19T21:35:05.045 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_crypto": "1/5", 2024-02-19T21:35:05.045 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_deliberately_leak_memory": "false", 2024-02-19T21:35:05.046 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_disable_randomized_ping": "false", 2024-02-19T21:35:05.046 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_dpdk": "1/5", 2024-02-19T21:35:05.046 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_eventtrace": "1/5", 2024-02-19T21:35:05.046 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_filer": "0/1", 2024-02-19T21:35:05.046 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_filestore": "1/3", 2024-02-19T21:35:05.046 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_finisher": "1/1", 2024-02-19T21:35:05.046 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_fuse": "1/5", 2024-02-19T21:35:05.046 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_heartbeat_testing_span": "0", 2024-02-19T21:35:05.046 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_heartbeatmap": "1/5", 2024-02-19T21:35:05.046 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_immutable_obj_cache": "0/5", 2024-02-19T21:35:05.046 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_javaclient": "1/5", 2024-02-19T21:35:05.046 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_journal": "1/3", 2024-02-19T21:35:05.046 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_journaler": "0/5", 2024-02-19T21:35:05.046 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_kstore": "1/5", 2024-02-19T21:35:05.046 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_leveldb": "4/5", 2024-02-19T21:35:05.046 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_lockdep": "0/1", 2024-02-19T21:35:05.047 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_mds": "1/5", 2024-02-19T21:35:05.047 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_mds_balancer": "1/5", 2024-02-19T21:35:05.047 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_mds_locker": "1/5", 2024-02-19T21:35:05.047 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_mds_log": "1/5", 2024-02-19T21:35:05.047 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_mds_log_expire": "1/5", 2024-02-19T21:35:05.047 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_mds_migrator": "1/5", 2024-02-19T21:35:05.047 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_memdb": "4/5", 2024-02-19T21:35:05.047 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_mgr": "2/5", 2024-02-19T21:35:05.047 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_mgrc": "1/5", 2024-02-19T21:35:05.047 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_mon": "20/20", 2024-02-19T21:35:05.047 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_monc": "0/10", 2024-02-19T21:35:05.047 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_ms": "1/1", 2024-02-19T21:35:05.047 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_none": "0/5", 2024-02-19T21:35:05.047 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_objclass": "0/5", 2024-02-19T21:35:05.047 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_objectcacher": "0/5", 2024-02-19T21:35:05.047 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_objecter": "0/1", 2024-02-19T21:35:05.048 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_optracker": "0/5", 2024-02-19T21:35:05.048 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_osd": "1/5", 2024-02-19T21:35:05.048 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_paxos": "20/20", 2024-02-19T21:35:05.048 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_perfcounter": "1/5", 2024-02-19T21:35:05.048 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_prioritycache": "1/5", 2024-02-19T21:35:05.048 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_rados": "0/5", 2024-02-19T21:35:05.048 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_rbd": "0/5", 2024-02-19T21:35:05.048 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_rbd_mirror": "0/5", 2024-02-19T21:35:05.048 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_rbd_pwl": "0/5", 2024-02-19T21:35:05.048 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_rbd_replay": "0/5", 2024-02-19T21:35:05.048 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_refs": "0/0", 2024-02-19T21:35:05.048 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_reserver": "1/1", 2024-02-19T21:35:05.048 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_rgw": "1/5", 2024-02-19T21:35:05.048 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_rgw_sync": "1/5", 2024-02-19T21:35:05.048 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_rocksdb": "4/5", 2024-02-19T21:35:05.048 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_striper": "0/1", 2024-02-19T21:35:05.049 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_test": "0/5", 2024-02-19T21:35:05.049 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_throttle": "1/1", 2024-02-19T21:35:05.049 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_timer": "0/1", 2024-02-19T21:35:05.049 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_tp": "0/5", 2024-02-19T21:35:05.049 INFO:teuthology.orchestra.run.smithi080.stdout: "defer_client_eviction_on_laggy_osds": "true", 2024-02-19T21:35:05.049 INFO:teuthology.orchestra.run.smithi080.stdout: "device_failure_prediction_mode": "none", 2024-02-19T21:35:05.049 INFO:teuthology.orchestra.run.smithi080.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-02-19T21:35:05.049 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-02-19T21:35:05.049 INFO:teuthology.orchestra.run.smithi080.stdout: "err_to_graylog": "false", 2024-02-19T21:35:05.049 INFO:teuthology.orchestra.run.smithi080.stdout: "err_to_stderr": "true", 2024-02-19T21:35:05.049 INFO:teuthology.orchestra.run.smithi080.stdout: "err_to_syslog": "false", 2024-02-19T21:35:05.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event_tracing": "false", 2024-02-19T21:35:05.049 INFO:teuthology.orchestra.run.smithi080.stdout: "fake_statfs_for_testing": "0", 2024-02-19T21:35:05.049 INFO:teuthology.orchestra.run.smithi080.stdout: "fatal_signal_handlers": "true", 2024-02-19T21:35:05.049 INFO:teuthology.orchestra.run.smithi080.stdout: "filer_max_purge_ops": "10", 2024-02-19T21:35:05.049 INFO:teuthology.orchestra.run.smithi080.stdout: "filer_max_truncate_ops": "128", 2024-02-19T21:35:05.050 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_apply_finisher_threads": "1", 2024-02-19T21:35:05.050 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_blackhole": "false", 2024-02-19T21:35:05.050 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_btrfs_clone_range": "true", 2024-02-19T21:35:05.050 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_btrfs_snap": "true", 2024-02-19T21:35:05.050 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_caller_concurrency": "10", 2024-02-19T21:35:05.050 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_collect_device_partition_information": "true", 2024-02-19T21:35:05.050 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_commit_timeout": "600.000000", 2024-02-19T21:35:05.050 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_debug_inject_read_err": "false", 2024-02-19T21:35:05.050 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_debug_omap_check": "false", 2024-02-19T21:35:05.050 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_debug_random_read_err": "0.000000", 2024-02-19T21:35:05.050 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_debug_verify_split": "false", 2024-02-19T21:35:05.050 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_dump_file": "", 2024-02-19T21:35:05.050 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-02-19T21:35:05.050 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-02-19T21:35:05.050 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_fadvise": "true", 2024-02-19T21:35:05.050 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_fail_eio": "true", 2024-02-19T21:35:05.051 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_fd_cache_shards": "16", 2024-02-19T21:35:05.051 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_fd_cache_size": "128", 2024-02-19T21:35:05.051 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_fiemap": "false", 2024-02-19T21:35:05.051 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_fiemap_threshold": "4096", 2024-02-19T21:35:05.051 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-02-19T21:35:05.051 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_index_retry_probability": "0.000000", 2024-02-19T21:35:05.051 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_inject_stall": "0", 2024-02-19T21:35:05.051 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_journal_parallel": "false", 2024-02-19T21:35:05.051 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_journal_trailing": "false", 2024-02-19T21:35:05.051 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_journal_writeahead": "false", 2024-02-19T21:35:05.051 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_kill_at": "0", 2024-02-19T21:35:05.051 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-02-19T21:35:05.051 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_max_inline_xattr_size": "0", 2024-02-19T21:35:05.051 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-02-19T21:35:05.051 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-02-19T21:35:05.051 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-02-19T21:35:05.051 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_max_inline_xattrs": "0", 2024-02-19T21:35:05.052 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-02-19T21:35:05.052 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_max_inline_xattrs_other": "2", 2024-02-19T21:35:05.052 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-02-19T21:35:05.052 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_max_sync_interval": "5.000000", 2024-02-19T21:35:05.052 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_max_xattr_value_size": "0", 2024-02-19T21:35:05.052 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-02-19T21:35:05.052 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-02-19T21:35:05.052 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-02-19T21:35:05.052 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_merge_threshold": "-10", 2024-02-19T21:35:05.052 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_min_sync_interval": "0.010000", 2024-02-19T21:35:05.052 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_odsync_write": "false", 2024-02-19T21:35:05.052 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_omap_backend": "rocksdb", 2024-02-19T21:35:05.052 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_omap_backend_path": "", 2024-02-19T21:35:05.053 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_omap_header_cache_size": "1024", 2024-02-19T21:35:05.053 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_ondisk_finisher_threads": "1", 2024-02-19T21:35:05.053 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-02-19T21:35:05.053 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_op_thread_timeout": "60", 2024-02-19T21:35:05.053 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_op_threads": "2", 2024-02-19T21:35:05.053 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_punch_hole": "false", 2024-02-19T21:35:05.053 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-02-19T21:35:05.053 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-02-19T21:35:05.053 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-02-19T21:35:05.053 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-02-19T21:35:05.053 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-02-19T21:35:05.053 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_queue_max_bytes": "104857600", 2024-02-19T21:35:05.053 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-02-19T21:35:05.053 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-02-19T21:35:05.053 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-02-19T21:35:05.053 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_queue_max_ops": "50", 2024-02-19T21:35:05.053 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-02-19T21:35:05.054 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_seek_data_hole": "false", 2024-02-19T21:35:05.054 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_sloppy_crc": "false", 2024-02-19T21:35:05.054 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-02-19T21:35:05.054 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_splice": "false", 2024-02-19T21:35:05.054 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_split_multiple": "2", 2024-02-19T21:35:05.054 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_split_rand_factor": "20", 2024-02-19T21:35:05.054 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_update_to": "1000", 2024-02-19T21:35:05.054 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-02-19T21:35:05.054 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-02-19T21:35:05.054 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-02-19T21:35:05.054 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-02-19T21:35:05.054 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-02-19T21:35:05.054 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-02-19T21:35:05.054 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_wbthrottle_enable": "true", 2024-02-19T21:35:05.054 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-02-19T21:35:05.055 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-02-19T21:35:05.055 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-02-19T21:35:05.055 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-02-19T21:35:05.055 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-02-19T21:35:05.055 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-02-19T21:35:05.055 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_xfs_extsize": "false", 2024-02-19T21:35:05.055 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_zfs_snap": "false", 2024-02-19T21:35:05.055 INFO:teuthology.orchestra.run.smithi080.stdout: "fio_dir": "/tmp/fio", 2024-02-19T21:35:05.055 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "6f763558-cf6d-11ee-95bb-87774f69a715", 2024-02-19T21:35:05.055 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_allow_other": "true", 2024-02-19T21:35:05.055 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_atomic_o_trunc": "true", 2024-02-19T21:35:05.055 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_big_writes": "true", 2024-02-19T21:35:05.055 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_debug": "false", 2024-02-19T21:35:05.055 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_default_permissions": "false", 2024-02-19T21:35:05.055 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_disable_pagecache": "false", 2024-02-19T21:35:05.055 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_max_write": "0", 2024-02-19T21:35:05.056 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_multithreaded": "true", 2024-02-19T21:35:05.056 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_require_active_mds": "true", 2024-02-19T21:35:05.056 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_set_user_groups": "true", 2024-02-19T21:35:05.056 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_splice_move": "true", 2024-02-19T21:35:05.056 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_splice_read": "true", 2024-02-19T21:35:05.056 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_splice_write": "true", 2024-02-19T21:35:05.056 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_syncfs_on_mksnap": "true", 2024-02-19T21:35:05.056 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_use_invalidate_cb": "true", 2024-02-19T21:35:05.056 INFO:teuthology.orchestra.run.smithi080.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-02-19T21:35:05.056 INFO:teuthology.orchestra.run.smithi080.stdout: "gss_target_name": "ceph", 2024-02-19T21:35:05.056 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_file": "", 2024-02-19T21:35:05.056 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_inject_failure": "0", 2024-02-19T21:35:05.056 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_interval": "5", 2024-02-19T21:35:05.056 INFO:teuthology.orchestra.run.smithi080.stdout: "host": "", 2024-02-19T21:35:05.056 INFO:teuthology.orchestra.run.smithi080.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-02-19T21:35:05.057 INFO:teuthology.orchestra.run.smithi080.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-02-19T21:35:05.057 INFO:teuthology.orchestra.run.smithi080.stdout: "immutable_object_cache_max_size": "1073741824", 2024-02-19T21:35:05.057 INFO:teuthology.orchestra.run.smithi080.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-02-19T21:35:05.057 INFO:teuthology.orchestra.run.smithi080.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-02-19T21:35:05.057 INFO:teuthology.orchestra.run.smithi080.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-02-19T21:35:05.057 INFO:teuthology.orchestra.run.smithi080.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-02-19T21:35:05.057 INFO:teuthology.orchestra.run.smithi080.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-02-19T21:35:05.057 INFO:teuthology.orchestra.run.smithi080.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-02-19T21:35:05.057 INFO:teuthology.orchestra.run.smithi080.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-02-19T21:35:05.057 INFO:teuthology.orchestra.run.smithi080.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-02-19T21:35:05.057 INFO:teuthology.orchestra.run.smithi080.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-02-19T21:35:05.057 INFO:teuthology.orchestra.run.smithi080.stdout: "immutable_object_cache_watermark": "0.900000", 2024-02-19T21:35:05.057 INFO:teuthology.orchestra.run.smithi080.stdout: "inject_early_sigterm": "false", 2024-02-19T21:35:05.057 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_aio": "true", 2024-02-19T21:35:05.057 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_align_min_size": "65536", 2024-02-19T21:35:05.058 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_block_align": "true", 2024-02-19T21:35:05.058 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_block_size": "4096", 2024-02-19T21:35:05.058 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_dio": "true", 2024-02-19T21:35:05.058 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_discard": "false", 2024-02-19T21:35:05.058 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_force_aio": "false", 2024-02-19T21:35:05.058 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_ignore_corruption": "false", 2024-02-19T21:35:05.058 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_max_write_bytes": "10485760", 2024-02-19T21:35:05.058 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_max_write_entries": "100", 2024-02-19T21:35:05.058 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_replay_from": "0", 2024-02-19T21:35:05.058 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_throttle_high_multiple": "0.000000", 2024-02-19T21:35:05.058 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-02-19T21:35:05.058 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-02-19T21:35:05.058 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_throttle_max_multiple": "0.000000", 2024-02-19T21:35:05.058 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_write_header_frequency": "0", 2024-02-19T21:35:05.058 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_zero_on_create": "false", 2024-02-19T21:35:05.059 INFO:teuthology.orchestra.run.smithi080.stdout: "journaler_prefetch_periods": "10", 2024-02-19T21:35:05.059 INFO:teuthology.orchestra.run.smithi080.stdout: "journaler_prezero_periods": "5", 2024-02-19T21:35:05.059 INFO:teuthology.orchestra.run.smithi080.stdout: "journaler_write_head_interval": "15", 2024-02-19T21:35:05.059 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "", 2024-02-19T21:35:05.059 INFO:teuthology.orchestra.run.smithi080.stdout: "keyfile": "", 2024-02-19T21:35:05.059 INFO:teuthology.orchestra.run.smithi080.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-02-19T21:35:05.059 INFO:teuthology.orchestra.run.smithi080.stdout: "kstore_backend": "rocksdb", 2024-02-19T21:35:05.059 INFO:teuthology.orchestra.run.smithi080.stdout: "kstore_default_stripe_size": "65536", 2024-02-19T21:35:05.059 INFO:teuthology.orchestra.run.smithi080.stdout: "kstore_fsck_on_mount": "false", 2024-02-19T21:35:05.059 INFO:teuthology.orchestra.run.smithi080.stdout: "kstore_fsck_on_mount_deep": "true", 2024-02-19T21:35:05.059 INFO:teuthology.orchestra.run.smithi080.stdout: "kstore_max_bytes": "67108864", 2024-02-19T21:35:05.059 INFO:teuthology.orchestra.run.smithi080.stdout: "kstore_max_ops": "512", 2024-02-19T21:35:05.059 INFO:teuthology.orchestra.run.smithi080.stdout: "kstore_nid_prealloc": "1024", 2024-02-19T21:35:05.059 INFO:teuthology.orchestra.run.smithi080.stdout: "kstore_onode_map_size": "1024", 2024-02-19T21:35:05.060 INFO:teuthology.orchestra.run.smithi080.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-02-19T21:35:05.060 INFO:teuthology.orchestra.run.smithi080.stdout: "kstore_sync_submit_transaction": "false", 2024-02-19T21:35:05.060 INFO:teuthology.orchestra.run.smithi080.stdout: "kstore_sync_transaction": "false", 2024-02-19T21:35:05.060 INFO:teuthology.orchestra.run.smithi080.stdout: "leveldb_block_size": "65536", 2024-02-19T21:35:05.060 INFO:teuthology.orchestra.run.smithi080.stdout: "leveldb_bloom_size": "0", 2024-02-19T21:35:05.060 INFO:teuthology.orchestra.run.smithi080.stdout: "leveldb_cache_size": "536870912", 2024-02-19T21:35:05.060 INFO:teuthology.orchestra.run.smithi080.stdout: "leveldb_compact_on_mount": "false", 2024-02-19T21:35:05.060 INFO:teuthology.orchestra.run.smithi080.stdout: "leveldb_compression": "false", 2024-02-19T21:35:05.060 INFO:teuthology.orchestra.run.smithi080.stdout: "leveldb_log": "", 2024-02-19T21:35:05.060 INFO:teuthology.orchestra.run.smithi080.stdout: "leveldb_log_to_ceph_log": "true", 2024-02-19T21:35:05.060 INFO:teuthology.orchestra.run.smithi080.stdout: "leveldb_max_open_files": "0", 2024-02-19T21:35:05.060 INFO:teuthology.orchestra.run.smithi080.stdout: "leveldb_paranoid": "false", 2024-02-19T21:35:05.060 INFO:teuthology.orchestra.run.smithi080.stdout: "leveldb_write_buffer_size": "33554432", 2024-02-19T21:35:05.060 INFO:teuthology.orchestra.run.smithi080.stdout: "librados_thread_count": "2", 2024-02-19T21:35:05.061 INFO:teuthology.orchestra.run.smithi080.stdout: "lockdep": "false", 2024-02-19T21:35:05.061 INFO:teuthology.orchestra.run.smithi080.stdout: "lockdep_force_backtrace": "false", 2024-02-19T21:35:05.061 INFO:teuthology.orchestra.run.smithi080.stdout: "log_coarse_timestamps": "true", 2024-02-19T21:35:05.061 INFO:teuthology.orchestra.run.smithi080.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-02-19T21:35:05.061 INFO:teuthology.orchestra.run.smithi080.stdout: "log_flush_on_exit": "false", 2024-02-19T21:35:05.061 INFO:teuthology.orchestra.run.smithi080.stdout: "log_graylog_host": "127.0.0.1", 2024-02-19T21:35:05.061 INFO:teuthology.orchestra.run.smithi080.stdout: "log_graylog_port": "12201", 2024-02-19T21:35:05.061 INFO:teuthology.orchestra.run.smithi080.stdout: "log_max_new": "1000", 2024-02-19T21:35:05.061 INFO:teuthology.orchestra.run.smithi080.stdout: "log_max_recent": "10000", 2024-02-19T21:35:05.061 INFO:teuthology.orchestra.run.smithi080.stdout: "log_stderr_prefix": "debug ", 2024-02-19T21:35:05.061 INFO:teuthology.orchestra.run.smithi080.stdout: "log_stop_at_utilization": "0.970000", 2024-02-19T21:35:05.061 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": "true", 2024-02-19T21:35:05.061 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_graylog": "false", 2024-02-19T21:35:05.061 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_stderr": "false", 2024-02-19T21:35:05.062 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_syslog": "false", 2024-02-19T21:35:05.062 INFO:teuthology.orchestra.run.smithi080.stdout: "max_rotating_auth_attempts": "10", 2024-02-19T21:35:05.062 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-02-19T21:35:05.062 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_action_on_write_error": "1", 2024-02-19T21:35:05.062 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_alternate_name_max": "8192", 2024-02-19T21:35:05.062 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_asio_thread_count": "2", 2024-02-19T21:35:05.062 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_export_pin": "true", 2024-02-19T21:35:05.062 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_fragment_dirs": "true", 2024-02-19T21:35:05.062 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-02-19T21:35:05.062 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_fragment_interval": "5", 2024-02-19T21:35:05.062 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_fragment_size_max": "100000", 2024-02-19T21:35:05.062 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_idle_threshold": "0.000000", 2024-02-19T21:35:05.062 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_interval": "10", 2024-02-19T21:35:05.062 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_max": "-1", 2024-02-19T21:35:05.062 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_max_until": "-1", 2024-02-19T21:35:05.062 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_merge_size": "50", 2024-02-19T21:35:05.063 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_midchunk": "0.300000", 2024-02-19T21:35:05.063 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_min_rebalance": "0.100000", 2024-02-19T21:35:05.063 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_min_start": "0.200000", 2024-02-19T21:35:05.063 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_minchunk": "0.001000", 2024-02-19T21:35:05.063 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_mode": "0", 2024-02-19T21:35:05.063 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_need_max": "1.200000", 2024-02-19T21:35:05.063 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_need_min": "0.800000", 2024-02-19T21:35:05.063 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-02-19T21:35:05.063 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_sample_interval": "3.000000", 2024-02-19T21:35:05.063 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_split_bits": "3", 2024-02-19T21:35:05.063 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_split_rd": "25000.000000", 2024-02-19T21:35:05.063 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_split_size": "10000", 2024-02-19T21:35:05.063 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_split_wr": "10000.000000", 2024-02-19T21:35:05.063 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_target_decay": "10.000000", 2024-02-19T21:35:05.063 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-02-19T21:35:05.063 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_beacon_grace": "15.000000", 2024-02-19T21:35:05.064 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_beacon_interval": "4.000000", 2024-02-19T21:35:05.064 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_beacon_mon_down_grace": "60", 2024-02-19T21:35:05.064 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cache_memory_limit": "4294967296", 2024-02-19T21:35:05.064 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cache_mid": "0.700000", 2024-02-19T21:35:05.064 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cache_release_free_interval": "10", 2024-02-19T21:35:05.064 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cache_reservation": "0.050000", 2024-02-19T21:35:05.064 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-02-19T21:35:05.064 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cache_trim_interval": "1", 2024-02-19T21:35:05.064 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cache_trim_threshold": "262144", 2024-02-19T21:35:05.064 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-02-19T21:35:05.065 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-02-19T21:35:05.065 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_client_delegate_inos_pct": "50", 2024-02-19T21:35:05.065 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_client_prealloc_inos": "1000", 2024-02-19T21:35:05.065 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-02-19T21:35:05.065 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_connect_bootstrapping": "false", 2024-02-19T21:35:05.065 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_damage_table_max_entries": "10000", 2024-02-19T21:35:05.065 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-02-19T21:35:05.065 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_debug_auth_pins": "false", 2024-02-19T21:35:05.065 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_debug_frag": "false", 2024-02-19T21:35:05.065 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_debug_scatterstat": "false", 2024-02-19T21:35:05.065 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_debug_subtrees": "false", 2024-02-19T21:35:05.065 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_decay_halflife": "5.000000", 2024-02-19T21:35:05.065 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_default_dir_hash": "2", 2024-02-19T21:35:05.065 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_defer_session_stale": "true", 2024-02-19T21:35:05.065 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_deny_all_reconnect": "false", 2024-02-19T21:35:05.066 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_dir_keys_per_op": "16384", 2024-02-19T21:35:05.066 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_dir_max_commit_size": "10", 2024-02-19T21:35:05.066 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_dir_max_entries": "0", 2024-02-19T21:35:05.066 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_dirstat_min_interval": "1.000000", 2024-02-19T21:35:05.066 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_dump_cache_after_rejoin": "false", 2024-02-19T21:35:05.066 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_dump_cache_on_map": "false", 2024-02-19T21:35:05.066 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_dump_cache_threshold_file": "0", 2024-02-19T21:35:05.066 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-02-19T21:35:05.066 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_early_reply": "true", 2024-02-19T21:35:05.066 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_enable_op_tracker": "true", 2024-02-19T21:35:05.066 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_enforce_unique_name": "true", 2024-02-19T21:35:05.066 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_export_ephemeral_distributed": "true", 2024-02-19T21:35:05.066 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-02-19T21:35:05.066 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_export_ephemeral_random": "true", 2024-02-19T21:35:05.067 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-02-19T21:35:05.067 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_forward_all_requests_to_auth": "false", 2024-02-19T21:35:05.067 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-02-19T21:35:05.067 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-02-19T21:35:05.067 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-02-19T21:35:05.067 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_health_cache_threshold": "1.500000", 2024-02-19T21:35:05.067 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_health_summarize_threshold": "10", 2024-02-19T21:35:05.067 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_heartbeat_grace": "15.000000", 2024-02-19T21:35:05.067 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_heartbeat_reset_grace": "1000", 2024-02-19T21:35:05.067 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_inject_health_dummy": "false", 2024-02-19T21:35:05.067 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-02-19T21:35:05.067 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_inject_migrator_session_race": "false", 2024-02-19T21:35:05.067 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-02-19T21:35:05.067 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-02-19T21:35:05.067 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-02-19T21:35:05.068 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_join_fs": "", 2024-02-19T21:35:05.068 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_journal_format": "1", 2024-02-19T21:35:05.068 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_kill_create_at": "0", 2024-02-19T21:35:05.068 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_kill_export_at": "0", 2024-02-19T21:35:05.068 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_kill_import_at": "0", 2024-02-19T21:35:05.068 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_kill_journal_at": "0", 2024-02-19T21:35:05.068 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_kill_journal_expire_at": "0", 2024-02-19T21:35:05.068 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_kill_journal_replay_at": "0", 2024-02-19T21:35:05.068 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_kill_link_at": "0", 2024-02-19T21:35:05.068 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_kill_mdstable_at": "0", 2024-02-19T21:35:05.068 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_kill_openc_at": "0", 2024-02-19T21:35:05.068 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_kill_rename_at": "0", 2024-02-19T21:35:05.068 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-02-19T21:35:05.068 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_log_events_per_segment": "1024", 2024-02-19T21:35:05.069 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_log_max_events": "-1", 2024-02-19T21:35:05.069 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_log_max_segments": "128", 2024-02-19T21:35:05.069 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_log_pause": "false", 2024-02-19T21:35:05.069 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_log_segment_size": "0", 2024-02-19T21:35:05.069 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_log_skip_corrupt_events": "false", 2024-02-19T21:35:05.069 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_log_warn_factor": "2.000000", 2024-02-19T21:35:05.069 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_max_caps_per_client": "1048576", 2024-02-19T21:35:05.069 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_max_completed_flushes": "100000", 2024-02-19T21:35:05.069 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_max_completed_requests": "100000", 2024-02-19T21:35:05.069 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_max_export_size": "20971520", 2024-02-19T21:35:05.069 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_max_file_recover": "32", 2024-02-19T21:35:05.070 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_max_purge_files": "64", 2024-02-19T21:35:05.070 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_max_purge_ops": "8192", 2024-02-19T21:35:05.070 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-02-19T21:35:05.070 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-02-19T21:35:05.070 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_max_snaps_per_dir": "100", 2024-02-19T21:35:05.070 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_max_xattr_pairs_size": "65536", 2024-02-19T21:35:05.070 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_metrics_update_interval": "2", 2024-02-19T21:35:05.070 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_min_caps_per_client": "100", 2024-02-19T21:35:05.070 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_min_caps_working_set": "10000", 2024-02-19T21:35:05.070 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-02-19T21:35:05.070 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_numa_node": "-1", 2024-02-19T21:35:05.070 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-02-19T21:35:05.070 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_op_complaint_time": "30.000000", 2024-02-19T21:35:05.070 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_op_history_duration": "600", 2024-02-19T21:35:05.070 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_op_history_size": "20", 2024-02-19T21:35:05.071 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_op_log_threshold": "5", 2024-02-19T21:35:05.071 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_ping_grace": "15", 2024-02-19T21:35:05.071 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_ping_interval": "5", 2024-02-19T21:35:05.071 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-02-19T21:35:05.071 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-02-19T21:35:05.071 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_recall_max_caps": "30000", 2024-02-19T21:35:05.071 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-02-19T21:35:05.071 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_recall_max_decay_threshold": "131072", 2024-02-19T21:35:05.071 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-02-19T21:35:05.071 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_recall_warning_threshold": "262144", 2024-02-19T21:35:05.071 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_reconnect_timeout": "45.000000", 2024-02-19T21:35:05.071 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_replay_interval": "1.000000", 2024-02-19T21:35:05.071 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-02-19T21:35:05.071 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-02-19T21:35:05.072 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_root_ino_gid": "0", 2024-02-19T21:35:05.072 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_root_ino_uid": "0", 2024-02-19T21:35:05.072 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-02-19T21:35:05.072 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_session_blocklist_on_evict": "true", 2024-02-19T21:35:05.072 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_session_blocklist_on_timeout": "true", 2024-02-19T21:35:05.072 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-02-19T21:35:05.072 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-02-19T21:35:05.072 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-02-19T21:35:05.072 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-02-19T21:35:05.072 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-02-19T21:35:05.072 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_session_metadata_threshold": "16777216", 2024-02-19T21:35:05.073 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-02-19T21:35:05.073 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_shutdown_check": "0", 2024-02-19T21:35:05.073 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_skip_ino": "0", 2024-02-19T21:35:05.073 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_sleep_rank_change": "0.000000", 2024-02-19T21:35:05.073 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_snap_max_uid": "4294967294", 2024-02-19T21:35:05.073 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_snap_min_uid": "0", 2024-02-19T21:35:05.073 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_snap_rstat": "false", 2024-02-19T21:35:05.073 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_standby_replay_damaged": "false", 2024-02-19T21:35:05.073 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_task_status_update_interval": "2.000000", 2024-02-19T21:35:05.073 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_thrash_exports": "0", 2024-02-19T21:35:05.074 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_thrash_fragments": "0", 2024-02-19T21:35:05.074 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_tick_interval": "5.000000", 2024-02-19T21:35:05.074 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_valgrind_exit": "false", 2024-02-19T21:35:05.074 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_verify_backtrace": "1", 2024-02-19T21:35:05.074 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_verify_scatter": "false", 2024-02-19T21:35:05.074 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_wipe_ino_prealloc": "false", 2024-02-19T21:35:05.074 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_wipe_sessions": "false", 2024-02-19T21:35:05.074 INFO:teuthology.orchestra.run.smithi080.stdout: "mempool_debug": "false", 2024-02-19T21:35:05.074 INFO:teuthology.orchestra.run.smithi080.stdout: "memstore_debug_omit_block_device_write": "false", 2024-02-19T21:35:05.074 INFO:teuthology.orchestra.run.smithi080.stdout: "memstore_device_bytes": "1073741824", 2024-02-19T21:35:05.074 INFO:teuthology.orchestra.run.smithi080.stdout: "memstore_page_set": "false", 2024-02-19T21:35:05.074 INFO:teuthology.orchestra.run.smithi080.stdout: "memstore_page_size": "65536", 2024-02-19T21:35:05.074 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_client_bytes": "134217728", 2024-02-19T21:35:05.074 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_client_messages": "512", 2024-02-19T21:35:05.074 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-02-19T21:35:05.074 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_connect_retry_interval": "1.000000", 2024-02-19T21:35:05.075 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-02-19T21:35:05.075 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-02-19T21:35:05.075 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_disabled_modules": "", 2024-02-19T21:35:05.075 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-02-19T21:35:05.075 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_max_pg_num_change": "128", 2024-02-19T21:35:05.075 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_mds_bytes": "134217728", 2024-02-19T21:35:05.075 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_mds_messages": "128", 2024-02-19T21:35:05.075 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-02-19T21:35:05.075 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_mon_bytes": "134217728", 2024-02-19T21:35:05.075 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_mon_messages": "128", 2024-02-19T21:35:05.075 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_osd_bytes": "536870912", 2024-02-19T21:35:05.075 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_osd_messages": "8192", 2024-02-19T21:35:05.075 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_service_beacon_grace": "60.000000", 2024-02-19T21:35:05.075 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_standby_modules": "true", 2024-02-19T21:35:05.075 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_stats_period": "5", 2024-02-19T21:35:05.076 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_stats_threshold": "5", 2024-02-19T21:35:05.076 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_tick_period": "2", 2024-02-19T21:35:05.076 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-02-19T21:35:05.076 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_accept_timeout_factor": "2.000000", 2024-02-19T21:35:05.076 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_allow_pool_delete": "true", 2024-02-19T21:35:05.076 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_allow_pool_size_one": "false", 2024-02-19T21:35:05.076 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_auth_validate_all_caps": "true", 2024-02-19T21:35:05.076 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-02-19T21:35:05.076 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-02-19T21:35:05.076 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_client_bytes": "104857600", 2024-02-19T21:35:05.076 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_client_directed_command_retry": "2", 2024-02-19T21:35:05.076 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_client_hunt_interval": "3.000000", 2024-02-19T21:35:05.076 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-02-19T21:35:05.077 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-02-19T21:35:05.077 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-02-19T21:35:05.077 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_client_hunt_parallel": "3", 2024-02-19T21:35:05.077 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_client_log_interval": "1.000000", 2024-02-19T21:35:05.077 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-02-19T21:35:05.077 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_client_ping_interval": "10.000000", 2024-02-19T21:35:05.077 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_client_ping_timeout": "30.000000", 2024-02-19T21:35:05.077 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_clock_drift_allowed": "1.000000", 2024-02-19T21:35:05.077 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-02-19T21:35:05.077 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-02-19T21:35:05.077 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_cluster_log_file_level": "debug", 2024-02-19T21:35:05.077 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_cluster_log_to_file": "true", 2024-02-19T21:35:05.078 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_cluster_log_to_graylog": "false", 2024-02-19T21:35:05.078 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-02-19T21:35:05.078 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-02-19T21:35:05.078 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_cluster_log_to_stderr": "true", 2024-02-19T21:35:05.078 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-02-19T21:35:05.078 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-02-19T21:35:05.078 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-02-19T21:35:05.078 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_compact_on_bootstrap": "false", 2024-02-19T21:35:05.078 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_compact_on_start": "false", 2024-02-19T21:35:05.078 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_compact_on_trim": "true", 2024-02-19T21:35:05.078 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_con_tracker_persist_interval": "10", 2024-02-19T21:35:05.078 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_con_tracker_score_halflife": "43200", 2024-02-19T21:35:05.078 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_config_key_max_entry_size": "65536", 2024-02-19T21:35:05.078 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_cpu_threads": "4", 2024-02-19T21:35:05.078 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_crush_min_required_version": "hammer", 2024-02-19T21:35:05.079 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_daemon_bytes": "419430400", 2024-02-19T21:35:05.079 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-02-19T21:35:05.079 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_data_avail_crit": "5", 2024-02-19T21:35:05.079 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_data_avail_warn": "5", 2024-02-19T21:35:05.079 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_data_size_warn": "16106127360", 2024-02-19T21:35:05.079 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_debug_block_osdmap_trim": "false", 2024-02-19T21:35:05.079 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-02-19T21:35:05.079 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_debug_dump_json": "false", 2024-02-19T21:35:05.079 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-02-19T21:35:05.079 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_debug_dump_transactions": "false", 2024-02-19T21:35:05.079 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_debug_extra_checks": "false", 2024-02-19T21:35:05.079 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-02-19T21:35:05.079 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-02-19T21:35:05.079 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_debug_no_require_octopus": "false", 2024-02-19T21:35:05.079 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_debug_no_require_pacific": "false", 2024-02-19T21:35:05.080 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-02-19T21:35:05.080 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_delta_reset_interval": "10.000000", 2024-02-19T21:35:05.080 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_dns_srv_name": "ceph-mon", 2024-02-19T21:35:05.080 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_down_mkfs_grace": "60", 2024-02-19T21:35:05.080 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_election_default_strategy": "1", 2024-02-19T21:35:05.080 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_election_timeout": "5.000000", 2024-02-19T21:35:05.080 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-02-19T21:35:05.080 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_elector_ping_divisor": "2", 2024-02-19T21:35:05.080 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_elector_ping_timeout": "2.000000", 2024-02-19T21:35:05.080 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_enable_op_tracker": "true", 2024-02-19T21:35:05.080 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_fake_pool_delete": "false", 2024-02-19T21:35:05.080 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_force_quorum_join": "false", 2024-02-19T21:35:05.080 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_globalid_prealloc": "10000", 2024-02-19T21:35:05.080 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_health_detail_to_clog": "true", 2024-02-19T21:35:05.081 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_health_log_update_period": "5", 2024-02-19T21:35:05.081 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_health_max_detail": "50", 2024-02-19T21:35:05.081 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_health_to_clog": "true", 2024-02-19T21:35:05.081 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_health_to_clog_interval": "600", 2024-02-19T21:35:05.081 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-02-19T21:35:05.081 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_host": "[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0]", 2024-02-19T21:35:05.081 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_host_override": "", 2024-02-19T21:35:05.081 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_initial_members": "", 2024-02-19T21:35:05.081 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-02-19T21:35:05.081 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-02-19T21:35:05.081 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-02-19T21:35:05.081 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-02-19T21:35:05.081 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_keyvaluedb": "rocksdb", 2024-02-19T21:35:05.081 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_lease": "5.000000", 2024-02-19T21:35:05.081 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-02-19T21:35:05.082 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-02-19T21:35:05.082 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_log_max_summary": "50", 2024-02-19T21:35:05.082 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_max_log_entries_per_event": "4096", 2024-02-19T21:35:05.082 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_max_log_epochs": "500", 2024-02-19T21:35:05.082 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_max_mdsmap_epochs": "500", 2024-02-19T21:35:05.082 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_max_mgrmap_epochs": "500", 2024-02-19T21:35:05.082 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_max_osd": "10000", 2024-02-19T21:35:05.082 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_max_pg_per_osd": "10000", 2024-02-19T21:35:05.082 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_max_pool_pg_num": "65536", 2024-02-19T21:35:05.082 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-02-19T21:35:05.082 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-02-19T21:35:05.082 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_mds_force_trim_to": "0", 2024-02-19T21:35:05.082 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_mds_skip_sanity": "false", 2024-02-19T21:35:05.082 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_memory_autotune": "true", 2024-02-19T21:35:05.082 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_memory_target": "2147483648", 2024-02-19T21:35:05.082 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_mgr_beacon_grace": "30", 2024-02-19T21:35:05.083 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-02-19T21:35:05.083 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_mgr_digest_period": "5", 2024-02-19T21:35:05.083 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_mgr_inactive_grace": "60", 2024-02-19T21:35:05.083 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_mgr_mkfs_grace": "240", 2024-02-19T21:35:05.083 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-02-19T21:35:05.083 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_min_osdmap_epochs": "50", 2024-02-19T21:35:05.083 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_op_complaint_time": "30", 2024-02-19T21:35:05.083 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_op_history_duration": "600", 2024-02-19T21:35:05.083 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_op_history_size": "20", 2024-02-19T21:35:05.083 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_op_history_slow_op_size": "20", 2024-02-19T21:35:05.083 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_op_history_slow_op_threshold": "10", 2024-02-19T21:35:05.083 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_op_log_threshold": "5", 2024-02-19T21:35:05.083 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-02-19T21:35:05.083 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-02-19T21:35:05.083 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-02-19T21:35:05.084 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_auto_mark_in": "false", 2024-02-19T21:35:05.084 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_auto_mark_new_in": "true", 2024-02-19T21:35:05.084 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-02-19T21:35:05.084 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-02-19T21:35:05.084 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_cache_size": "500", 2024-02-19T21:35:05.084 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_cache_size_min": "134217728", 2024-02-19T21:35:05.084 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_crush_smoke_test": "true", 2024-02-19T21:35:05.084 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_destroyed_out_interval": "600", 2024-02-19T21:35:05.084 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_down_out_interval": "600", 2024-02-19T21:35:05.084 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-02-19T21:35:05.084 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-02-19T21:35:05.085 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_force_trim_to": "0", 2024-02-19T21:35:05.085 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_full_ratio": "0.950000", 2024-02-19T21:35:05.085 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-02-19T21:35:05.085 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_laggy_halflife": "3600", 2024-02-19T21:35:05.085 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_laggy_max_interval": "300", 2024-02-19T21:35:05.085 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_laggy_weight": "0.300000", 2024-02-19T21:35:05.085 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-02-19T21:35:05.085 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_max_creating_pgs": "1024", 2024-02-19T21:35:05.085 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_max_initial_pgs": "1024", 2024-02-19T21:35:05.085 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_min_down_reporters": "2", 2024-02-19T21:35:05.085 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-02-19T21:35:05.085 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-02-19T21:35:05.085 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-02-19T21:35:05.086 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_prime_pg_temp": "true", 2024-02-19T21:35:05.086 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-02-19T21:35:05.086 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-02-19T21:35:05.086 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_report_timeout": "900", 2024-02-19T21:35:05.086 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-02-19T21:35:05.086 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-02-19T21:35:05.086 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_warn_num_repaired": "10", 2024-02-19T21:35:05.086 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_warn_op_age": "32.000000", 2024-02-19T21:35:05.086 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-02-19T21:35:05.086 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osdmap_full_prune_interval": "2", 2024-02-19T21:35:05.086 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osdmap_full_prune_min": "15", 2024-02-19T21:35:05.086 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osdmap_full_prune_txsize": "2", 2024-02-19T21:35:05.086 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-02-19T21:35:05.086 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_pg_stuck_threshold": "60", 2024-02-19T21:35:05.087 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-02-19T21:35:05.087 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_pg_warn_min_objects": "10000", 2024-02-19T21:35:05.087 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_pg_warn_min_per_osd": "0", 2024-02-19T21:35:05.087 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-02-19T21:35:05.087 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_pool_quota_crit_threshold": "0", 2024-02-19T21:35:05.087 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_pool_quota_warn_threshold": "0", 2024-02-19T21:35:05.087 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_probe_timeout": "2.000000", 2024-02-19T21:35:05.087 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_reweight_max_change": "0.050000", 2024-02-19T21:35:05.087 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_reweight_max_osds": "4", 2024-02-19T21:35:05.087 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-02-19T21:35:05.087 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-02-19T21:35:05.087 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-02-19T21:35:05.087 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-02-19T21:35:05.087 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-02-19T21:35:05.088 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_scrub_interval": "86400", 2024-02-19T21:35:05.088 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_scrub_max_keys": "100", 2024-02-19T21:35:05.088 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_scrub_timeout": "300", 2024-02-19T21:35:05.088 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_session_timeout": "300", 2024-02-19T21:35:05.088 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_smart_report_timeout": "5", 2024-02-19T21:35:05.088 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_stat_smooth_intervals": "6", 2024-02-19T21:35:05.088 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-02-19T21:35:05.088 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_stretch_pool_min_size": "2", 2024-02-19T21:35:05.088 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_stretch_pool_size": "4", 2024-02-19T21:35:05.088 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-02-19T21:35:05.088 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_subscribe_interval": "86400.000000", 2024-02-19T21:35:05.088 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_sync_debug": "false", 2024-02-19T21:35:05.088 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_sync_max_payload_keys": "2000", 2024-02-19T21:35:05.089 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_sync_max_payload_size": "1048576", 2024-02-19T21:35:05.089 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_sync_provider_kill_at": "0", 2024-02-19T21:35:05.089 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_sync_requester_kill_at": "0", 2024-02-19T21:35:05.089 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_sync_timeout": "60.000000", 2024-02-19T21:35:05.089 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_target_pg_per_osd": "100", 2024-02-19T21:35:05.089 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_tick_interval": "5", 2024-02-19T21:35:05.089 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_timecheck_interval": "300.000000", 2024-02-19T21:35:05.089 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-02-19T21:35:05.089 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_older_version_delay": "604800", 2024-02-19T21:35:05.089 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-02-19T21:35:05.089 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-02-19T21:35:05.090 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-02-19T21:35:05.090 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-02-19T21:35:05.090 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-02-19T21:35:05.090 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-02-19T21:35:05.090 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_misplaced": "false", 2024-02-19T21:35:05.090 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-02-19T21:35:05.090 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_older_version": "true", 2024-02-19T21:35:05.090 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-02-19T21:35:05.090 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_pool_no_app": "true", 2024-02-19T21:35:05.090 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_pool_no_redundancy": "true", 2024-02-19T21:35:05.090 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-02-19T21:35:05.090 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-02-19T21:35:05.091 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-02-19T21:35:05.091 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_too_few_osds": "false", 2024-02-19T21:35:05.091 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-02-19T21:35:05.091 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-02-19T21:35:05.091 INFO:teuthology.orchestra.run.smithi080.stdout: "monmap": "", 2024-02-19T21:35:05.091 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_op_threads": "3", 2024-02-19T21:35:05.091 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_buffer_size": "131072", 2024-02-19T21:35:05.091 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_cm": "false", 2024-02-19T21:35:05.091 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_device_name": "", 2024-02-19T21:35:05.091 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_dscp": "96", 2024-02-19T21:35:05.091 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-02-19T21:35:05.091 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_gid_idx": "0", 2024-02-19T21:35:05.091 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_local_gid": "", 2024-02-19T21:35:05.091 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_polling_us": "1000", 2024-02-19T21:35:05.091 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_port_num": "1", 2024-02-19T21:35:05.092 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-02-19T21:35:05.092 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-02-19T21:35:05.092 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_roce_ver": "1", 2024-02-19T21:35:05.092 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_send_buffers": "1024", 2024-02-19T21:35:05.092 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_sl": "3", 2024-02-19T21:35:05.092 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_support_srq": "true", 2024-02-19T21:35:05.092 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_type": "ib", 2024-02-19T21:35:05.092 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_reap_threshold": "5", 2024-02-19T21:35:05.092 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_bind_before_connect": "false", 2024-02-19T21:35:05.092 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_bind_ipv4": "true", 2024-02-19T21:35:05.092 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_bind_ipv6": "false", 2024-02-19T21:35:05.092 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_bind_msgr1": "true", 2024-02-19T21:35:05.092 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_bind_msgr2": "true", 2024-02-19T21:35:05.092 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_bind_port_max": "7300", 2024-02-19T21:35:05.093 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_bind_port_min": "6800", 2024-02-19T21:35:05.093 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_bind_prefer_ipv4": "false", 2024-02-19T21:35:05.093 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_bind_retry_count": "3", 2024-02-19T21:35:05.093 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_bind_retry_delay": "5", 2024-02-19T21:35:05.093 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_blackhole_client": "false", 2024-02-19T21:35:05.093 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_blackhole_mds": "false", 2024-02-19T21:35:05.093 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_blackhole_mgr": "false", 2024-02-19T21:35:05.093 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_blackhole_mon": "false", 2024-02-19T21:35:05.093 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_blackhole_osd": "false", 2024-02-19T21:35:05.093 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_client_mode": "crc secure", 2024-02-19T21:35:05.093 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_cluster_mode": "crc secure", 2024-02-19T21:35:05.093 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_cluster_type": "", 2024-02-19T21:35:05.093 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_connection_idle_timeout": "900", 2024-02-19T21:35:05.093 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_connection_ready_timeout": "10", 2024-02-19T21:35:05.094 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_crc_data": "true", 2024-02-19T21:35:05.094 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_crc_header": "true", 2024-02-19T21:35:05.094 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_die_on_bad_msg": "false", 2024-02-19T21:35:05.094 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_die_on_bug": "true", 2024-02-19T21:35:05.094 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_die_on_old_message": "true", 2024-02-19T21:35:05.094 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_die_on_skipped_message": "false", 2024-02-19T21:35:05.094 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_die_on_unhandled_msg": "false", 2024-02-19T21:35:05.094 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-02-19T21:35:05.094 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dpdk_coremask": "0xF", 2024-02-19T21:35:05.094 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-02-19T21:35:05.094 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-02-19T21:35:05.094 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-02-19T21:35:05.094 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dpdk_hugepages": "", 2024-02-19T21:35:05.094 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dpdk_hw_flow_control": "true", 2024-02-19T21:35:05.094 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-02-19T21:35:05.094 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dpdk_lro": "true", 2024-02-19T21:35:05.095 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dpdk_memory_channel": "4", 2024-02-19T21:35:05.095 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-02-19T21:35:05.095 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dpdk_pmd": "", 2024-02-19T21:35:05.095 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dpdk_port_id": "0", 2024-02-19T21:35:05.095 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-02-19T21:35:05.095 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dump_corrupt_message_level": "1", 2024-02-19T21:35:05.095 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dump_on_send": "false", 2024-02-19T21:35:05.095 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_initial_backoff": "0.200000", 2024-02-19T21:35:05.095 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_inject_delay_max": "1.000000", 2024-02-19T21:35:05.095 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_inject_delay_probability": "0.000000", 2024-02-19T21:35:05.095 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_inject_delay_type": "", 2024-02-19T21:35:05.095 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_inject_internal_delays": "0.000000", 2024-02-19T21:35:05.095 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_inject_socket_failures": "0", 2024-02-19T21:35:05.095 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_learn_addr_from_peer": "true", 2024-02-19T21:35:05.095 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_max_accept_failures": "4", 2024-02-19T21:35:05.095 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_max_backoff": "15.000000", 2024-02-19T21:35:05.096 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_mon_client_mode": "secure crc", 2024-02-19T21:35:05.096 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_mon_cluster_mode": "secure crc", 2024-02-19T21:35:05.096 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_mon_service_mode": "secure crc", 2024-02-19T21:35:05.096 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-02-19T21:35:05.096 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_pq_min_cost": "65536", 2024-02-19T21:35:05.096 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_public_type": "", 2024-02-19T21:35:05.096 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_service_mode": "crc secure", 2024-02-19T21:35:05.096 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_tcp_listen_backlog": "512", 2024-02-19T21:35:05.096 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_tcp_nodelay": "true", 2024-02-19T21:35:05.096 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-02-19T21:35:05.096 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_tcp_rcvbuf": "0", 2024-02-19T21:35:05.096 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_type": "async+posix", 2024-02-19T21:35:05.096 INFO:teuthology.orchestra.run.smithi080.stdout: "no_config_file": "false", 2024-02-19T21:35:05.097 INFO:teuthology.orchestra.run.smithi080.stdout: "objecter_completion_locks_per_session": "32", 2024-02-19T21:35:05.097 INFO:teuthology.orchestra.run.smithi080.stdout: "objecter_debug_inject_relock_delay": "false", 2024-02-19T21:35:05.097 INFO:teuthology.orchestra.run.smithi080.stdout: "objecter_inflight_op_bytes": "104857600", 2024-02-19T21:35:05.097 INFO:teuthology.orchestra.run.smithi080.stdout: "objecter_inflight_ops": "1024", 2024-02-19T21:35:05.097 INFO:teuthology.orchestra.run.smithi080.stdout: "objecter_inject_no_watch_ping": "false", 2024-02-19T21:35:05.097 INFO:teuthology.orchestra.run.smithi080.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-02-19T21:35:05.097 INFO:teuthology.orchestra.run.smithi080.stdout: "objecter_tick_interval": "5.000000", 2024-02-19T21:35:05.097 INFO:teuthology.orchestra.run.smithi080.stdout: "objecter_timeout": "10.000000", 2024-02-19T21:35:05.097 INFO:teuthology.orchestra.run.smithi080.stdout: "objectstore_blackhole": "false", 2024-02-19T21:35:05.097 INFO:teuthology.orchestra.run.smithi080.stdout: "openssl_engine_opts": "", 2024-02-19T21:35:05.097 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_agent_delay_time": "5.000000", 2024-02-19T21:35:05.097 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_agent_hist_halflife": "1000", 2024-02-19T21:35:05.097 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_agent_max_low_ops": "2", 2024-02-19T21:35:05.097 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_agent_max_ops": "4", 2024-02-19T21:35:05.097 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-02-19T21:35:05.098 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_agent_quantize_effort": "0.100000", 2024-02-19T21:35:05.098 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_agent_slop": "0.020000", 2024-02-19T21:35:05.098 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-02-19T21:35:05.098 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_allow_recovery_below_min_size": "true", 2024-02-19T21:35:05.098 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_asio_thread_count": "2", 2024-02-19T21:35:05.098 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_async_recovery_min_cost": "100", 2024-02-19T21:35:05.098 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_auto_mark_unfound_lost": "false", 2024-02-19T21:35:05.098 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_backfill_retry_interval": "30.000000", 2024-02-19T21:35:05.098 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_backfill_scan_max": "512", 2024-02-19T21:35:05.098 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_backfill_scan_min": "64", 2024-02-19T21:35:05.098 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_backoff_on_degraded": "false", 2024-02-19T21:35:05.098 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_backoff_on_peering": "false", 2024-02-19T21:35:05.098 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_backoff_on_unfound": "true", 2024-02-19T21:35:05.098 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_beacon_report_interval": "300", 2024-02-19T21:35:05.098 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_bench_duration": "30", 2024-02-19T21:35:05.099 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-02-19T21:35:05.099 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_bench_max_block_size": "67108864", 2024-02-19T21:35:05.099 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_bench_small_size_max_iops": "100", 2024-02-19T21:35:05.099 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_blkin_trace_all": "false", 2024-02-19T21:35:05.099 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-02-19T21:35:05.099 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-02-19T21:35:05.099 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_check_for_log_corruption": "false", 2024-02-19T21:35:05.099 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-02-19T21:35:05.099 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-02-19T21:35:05.099 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-02-19T21:35:05.099 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-02-19T21:35:05.099 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_class_update_on_start": "true", 2024-02-19T21:35:05.099 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_client_message_cap": "256", 2024-02-19T21:35:05.099 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_client_message_size_cap": "524288000", 2024-02-19T21:35:05.099 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_client_op_priority": "63", 2024-02-19T21:35:05.099 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_client_watch_timeout": "30", 2024-02-19T21:35:05.100 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_command_max_records": "256", 2024-02-19T21:35:05.100 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_command_thread_suicide_timeout": "900", 2024-02-19T21:35:05.100 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_command_thread_timeout": "600", 2024-02-19T21:35:05.100 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_compact_on_start": "false", 2024-02-19T21:35:05.100 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-02-19T21:35:05.100 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_crush_chooseleaf_type": "1", 2024-02-19T21:35:05.100 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_crush_initial_weight": "-1.000000", 2024-02-19T21:35:05.100 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_crush_update_on_start": "true", 2024-02-19T21:35:05.100 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_crush_update_weight_set": "true", 2024-02-19T21:35:05.100 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-02-19T21:35:05.100 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-02-19T21:35:05.100 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-02-19T21:35:05.100 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_drop_ping_duration": "0", 2024-02-19T21:35:05.100 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-02-19T21:35:05.100 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_feed_pullee": "-1", 2024-02-19T21:35:05.101 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-02-19T21:35:05.101 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-02-19T21:35:05.101 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-02-19T21:35:05.101 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_misdirected_ops": "false", 2024-02-19T21:35:05.101 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_no_acting_change": "false", 2024-02-19T21:35:05.101 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_no_purge_strays": "false", 2024-02-19T21:35:05.101 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_op_order": "false", 2024-02-19T21:35:05.101 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_pg_log_writeout": "false", 2024-02-19T21:35:05.101 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_pretend_recovery_active": "false", 2024-02-19T21:35:05.101 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-02-19T21:35:05.101 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-02-19T21:35:05.101 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_shutdown": "false", 2024-02-19T21:35:05.101 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-02-19T21:35:05.101 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-02-19T21:35:05.102 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_verify_cached_snaps": "false", 2024-02-19T21:35:05.102 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_verify_missing_on_start": "false", 2024-02-19T21:35:05.102 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_verify_snaps": "false", 2024-02-19T21:35:05.102 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-02-19T21:35:05.102 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-02-19T21:35:05.102 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_deep_scrub_keys": "1024", 2024-02-19T21:35:05.102 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-02-19T21:35:05.102 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-02-19T21:35:05.102 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-02-19T21:35:05.102 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_deep_scrub_stride": "524288", 2024-02-19T21:35:05.102 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-02-19T21:35:05.102 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_default_data_pool_replay_window": "45", 2024-02-19T21:35:05.103 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_default_notify_timeout": "30", 2024-02-19T21:35:05.103 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_delete_sleep": "0.000000", 2024-02-19T21:35:05.103 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-02-19T21:35:05.103 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-02-19T21:35:05.103 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-02-19T21:35:05.103 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_discard_disconnected_ops": "true", 2024-02-19T21:35:05.103 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_enable_op_tracker": "true", 2024-02-19T21:35:05.103 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_erasure_code_plugins": "jerasure lrc isa", 2024-02-19T21:35:05.103 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-02-19T21:35:05.103 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-02-19T21:35:05.104 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_fast_info": "true", 2024-02-19T21:35:05.104 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_fast_shutdown": "true", 2024-02-19T21:35:05.104 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-02-19T21:35:05.104 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-02-19T21:35:05.104 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-02-19T21:35:05.104 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-02-19T21:35:05.104 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_function_tracing": "false", 2024-02-19T21:35:05.104 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_heartbeat_grace": "20", 2024-02-19T21:35:05.105 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_heartbeat_interval": "6", 2024-02-19T21:35:05.105 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-02-19T21:35:05.105 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_heartbeat_min_peers": "10", 2024-02-19T21:35:05.105 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_heartbeat_min_size": "2000", 2024-02-19T21:35:05.105 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_heartbeat_stale": "600", 2024-02-19T21:35:05.105 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-02-19T21:35:05.105 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_hit_set_max_size": "100000", 2024-02-19T21:35:05.105 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_hit_set_min_size": "1000", 2024-02-19T21:35:05.106 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-02-19T21:35:05.106 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-02-19T21:35:05.106 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-02-19T21:35:05.106 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-02-19T21:35:05.106 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-02-19T21:35:05.106 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_journal_flush_on_shutdown": "true", 2024-02-19T21:35:05.106 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_journal_size": "5120", 2024-02-19T21:35:05.106 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_kill_backfill_at": "0", 2024-02-19T21:35:05.106 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_loop_before_reset_tphandle": "64", 2024-02-19T21:35:05.107 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_map_cache_size": "50", 2024-02-19T21:35:05.107 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_map_dedup": "true", 2024-02-19T21:35:05.107 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_map_message_max": "40", 2024-02-19T21:35:05.107 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_map_message_max_bytes": "10485760", 2024-02-19T21:35:05.107 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_map_share_max_epochs": "40", 2024-02-19T21:35:05.107 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_attr_name_len": "100", 2024-02-19T21:35:05.107 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_attr_size": "0", 2024-02-19T21:35:05.107 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_backfills": "1", 2024-02-19T21:35:05.107 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_markdown_count": "5", 2024-02-19T21:35:05.108 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_markdown_period": "600", 2024-02-19T21:35:05.108 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_object_name_len": "2048", 2024-02-19T21:35:05.108 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_object_namespace_len": "256", 2024-02-19T21:35:05.108 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_object_size": "134217728", 2024-02-19T21:35:05.108 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-02-19T21:35:05.108 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_omap_entries_per_request": "1024", 2024-02-19T21:35:05.108 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_pg_blocked_by": "16", 2024-02-19T21:35:05.108 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_pg_log_entries": "10000", 2024-02-19T21:35:05.109 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-02-19T21:35:05.109 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_pgls": "1024", 2024-02-19T21:35:05.109 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_push_cost": "8388608", 2024-02-19T21:35:05.109 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_push_objects": "10", 2024-02-19T21:35:05.109 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_scrubs": "1", 2024-02-19T21:35:05.109 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-02-19T21:35:05.109 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_trimming_pgs": "2", 2024-02-19T21:35:05.109 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_write_op_reply_len": "64", 2024-02-19T21:35:05.109 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_write_size": "90", 2024-02-19T21:35:05.109 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_cost_per_byte_usec": "0.000000", 2024-02-19T21:35:05.110 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_cost_per_byte_usec_hdd": "5.200000", 2024-02-19T21:35:05.110 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_cost_per_byte_usec_ssd": "0.011000", 2024-02-19T21:35:05.110 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_cost_per_io_usec": "0.000000", 2024-02-19T21:35:05.110 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_cost_per_io_usec_hdd": "25000.000000", 2024-02-19T21:35:05.110 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_cost_per_io_usec_ssd": "50.000000", 2024-02-19T21:35:05.110 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-02-19T21:35:05.110 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-02-19T21:35:05.110 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-02-19T21:35:05.110 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_profile": "high_client_ops", 2024-02-19T21:35:05.111 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-02-19T21:35:05.111 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_scheduler_background_best_effort_lim": "999999", 2024-02-19T21:35:05.111 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_scheduler_background_best_effort_res": "1", 2024-02-19T21:35:05.111 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-02-19T21:35:05.111 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_scheduler_background_recovery_lim": "999999", 2024-02-19T21:35:05.111 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_scheduler_background_recovery_res": "1", 2024-02-19T21:35:05.111 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-02-19T21:35:05.111 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_scheduler_client_lim": "999999", 2024-02-19T21:35:05.112 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_scheduler_client_res": "1", 2024-02-19T21:35:05.112 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-02-19T21:35:05.112 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_skip_benchmark": "false", 2024-02-19T21:35:05.112 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_memory_base": "805306368", 2024-02-19T21:35:05.112 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_memory_cache_min": "134217728", 2024-02-19T21:35:05.112 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-02-19T21:35:05.112 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-02-19T21:35:05.112 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_memory_target": "4294967296", 2024-02-19T21:35:05.112 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_memory_target_autotune": "false", 2024-02-19T21:35:05.113 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-02-19T21:35:05.113 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_min_pg_log_entries": "250", 2024-02-19T21:35:05.113 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_min_recovery_priority": "0", 2024-02-19T21:35:05.113 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mon_heartbeat_interval": "30", 2024-02-19T21:35:05.113 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-02-19T21:35:05.113 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mon_report_interval": "5", 2024-02-19T21:35:05.113 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mon_report_max_in_flight": "2", 2024-02-19T21:35:05.113 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-02-19T21:35:05.113 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_num_cache_shards": "32", 2024-02-19T21:35:05.113 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_num_op_tracker_shard": "32", 2024-02-19T21:35:05.114 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_numa_auto_affinity": "true", 2024-02-19T21:35:05.114 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_numa_node": "-1", 2024-02-19T21:35:05.114 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_numa_prefer_iface": "true", 2024-02-19T21:35:05.114 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-02-19T21:35:05.114 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_objecter_finishers": "1", 2024-02-19T21:35:05.114 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_objectstore": "bluestore", 2024-02-19T21:35:05.114 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_objectstore_fuse": "false", 2024-02-19T21:35:05.114 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_objectstore_tracing": "false", 2024-02-19T21:35:05.115 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_complaint_time": "30.000000", 2024-02-19T21:35:05.115 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_history_duration": "600", 2024-02-19T21:35:05.115 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_history_size": "20", 2024-02-19T21:35:05.115 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_history_slow_op_size": "20", 2024-02-19T21:35:05.115 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-02-19T21:35:05.115 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_log_threshold": "5", 2024-02-19T21:35:05.115 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_num_shards": "0", 2024-02-19T21:35:05.115 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_num_shards_hdd": "5", 2024-02-19T21:35:05.115 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_num_shards_ssd": "8", 2024-02-19T21:35:05.116 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_num_threads_per_shard": "0", 2024-02-19T21:35:05.116 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-02-19T21:35:05.116 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-02-19T21:35:05.116 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-02-19T21:35:05.116 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_pq_min_cost": "65536", 2024-02-19T21:35:05.116 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_queue": "wpq", 2024-02-19T21:35:05.116 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_queue_cut_off": "high", 2024-02-19T21:35:05.116 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_thread_suicide_timeout": "150", 2024-02-19T21:35:05.116 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_thread_timeout": "15", 2024-02-19T21:35:05.117 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_open_classes_on_start": "true", 2024-02-19T21:35:05.117 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_os_flags": "0", 2024-02-19T21:35:05.117 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_peering_op_priority": "255", 2024-02-19T21:35:05.117 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pg_delete_cost": "1048576", 2024-02-19T21:35:05.117 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pg_delete_priority": "5", 2024-02-19T21:35:05.117 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-02-19T21:35:05.117 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-02-19T21:35:05.117 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pg_log_dups_tracked": "3000", 2024-02-19T21:35:05.117 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pg_log_trim_max": "10000", 2024-02-19T21:35:05.117 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pg_log_trim_min": "100", 2024-02-19T21:35:05.117 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-02-19T21:35:05.117 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pg_object_context_cache_count": "64", 2024-02-19T21:35:05.117 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pg_stat_report_interval_max": "500", 2024-02-19T21:35:05.117 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-02-19T21:35:05.117 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-02-19T21:35:05.117 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-02-19T21:35:05.117 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-02-19T21:35:05.118 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-02-19T21:35:05.118 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-02-19T21:35:05.118 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_crush_rule": "-1", 2024-02-19T21:35:05.118 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_ec_fast_read": "false", 2024-02-19T21:35:05.118 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd", 2024-02-19T21:35:05.118 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_flag_bulk": "false", 2024-02-19T21:35:05.118 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-02-19T21:35:05.118 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_flag_nodelete": "false", 2024-02-19T21:35:05.118 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-02-19T21:35:05.118 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-02-19T21:35:05.118 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_flags": "0", 2024-02-19T21:35:05.118 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-02-19T21:35:05.118 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_min_size": "0", 2024-02-19T21:35:05.118 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-02-19T21:35:05.119 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_pg_num": "32", 2024-02-19T21:35:05.119 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_pgp_num": "0", 2024-02-19T21:35:05.119 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-02-19T21:35:05.119 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_size": "3", 2024-02-19T21:35:05.119 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_type": "replicated", 2024-02-19T21:35:05.119 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-02-19T21:35:05.119 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_use_gmt_hitset": "true", 2024-02-19T21:35:05.119 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_push_per_object_cost": "1000", 2024-02-19T21:35:05.119 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_read_ec_check_for_errors": "false", 2024-02-19T21:35:05.119 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recover_clone_overlap": "true", 2024-02-19T21:35:05.119 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recover_clone_overlap_limit": "10", 2024-02-19T21:35:05.119 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_cost": "20971520", 2024-02-19T21:35:05.119 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_delay_start": "0.000000", 2024-02-19T21:35:05.119 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_max_active": "0", 2024-02-19T21:35:05.119 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_max_active_hdd": "3", 2024-02-19T21:35:05.119 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_max_active_ssd": "10", 2024-02-19T21:35:05.120 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_max_chunk": "8388608", 2024-02-19T21:35:05.120 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-02-19T21:35:05.120 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_max_single_start": "1", 2024-02-19T21:35:05.120 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_op_priority": "3", 2024-02-19T21:35:05.120 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_op_warn_multiple": "16", 2024-02-19T21:35:05.120 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_priority": "5", 2024-02-19T21:35:05.120 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_retry_interval": "30.000000", 2024-02-19T21:35:05.120 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_sleep": "0.000000", 2024-02-19T21:35:05.120 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-02-19T21:35:05.120 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-02-19T21:35:05.121 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-02-19T21:35:05.121 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_repair_during_recovery": "false", 2024-02-19T21:35:05.121 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_requested_scrub_priority": "120", 2024-02-19T21:35:05.121 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-02-19T21:35:05.121 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_rollback_to_cluster_snap": "", 2024-02-19T21:35:05.121 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_auto_repair": "false", 2024-02-19T21:35:05.121 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-02-19T21:35:05.121 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-02-19T21:35:05.121 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_begin_hour": "0", 2024-02-19T21:35:05.121 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_begin_week_day": "0", 2024-02-19T21:35:05.121 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_chunk_max": "25", 2024-02-19T21:35:05.122 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_chunk_min": "5", 2024-02-19T21:35:05.122 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_cost": "52428800", 2024-02-19T21:35:05.122 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_during_recovery": "false", 2024-02-19T21:35:05.122 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_end_hour": "0", 2024-02-19T21:35:05.122 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_end_week_day": "0", 2024-02-19T21:35:05.122 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-02-19T21:35:05.122 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-02-19T21:35:05.122 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_invalid_stats": "true", 2024-02-19T21:35:05.122 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_load_threshold": "0.500000", 2024-02-19T21:35:05.122 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_max_interval": "604800.000000", 2024-02-19T21:35:05.122 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_max_preemptions": "5", 2024-02-19T21:35:05.122 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_min_interval": "86400.000000", 2024-02-19T21:35:05.122 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_priority": "5", 2024-02-19T21:35:05.122 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_sleep": "0.000000", 2024-02-19T21:35:05.122 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_shutdown_pgref_assert": "false", 2024-02-19T21:35:05.122 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_skip_data_digest": "false", 2024-02-19T21:35:05.123 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_smart_report_timeout": "5", 2024-02-19T21:35:05.123 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_snap_trim_cost": "1048576", 2024-02-19T21:35:05.123 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_snap_trim_priority": "5", 2024-02-19T21:35:05.123 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_snap_trim_sleep": "0.000000", 2024-02-19T21:35:05.123 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-02-19T21:35:05.123 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-02-19T21:35:05.123 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-02-19T21:35:05.123 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-02-19T21:35:05.123 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_target_transaction_size": "30", 2024-02-19T21:35:05.123 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-02-19T21:35:05.123 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-02-19T21:35:05.123 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-02-19T21:35:05.123 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-02-19T21:35:05.123 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-02-19T21:35:05.123 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-02-19T21:35:05.123 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-02-19T21:35:05.123 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_tier_default_cache_mode": "writeback", 2024-02-19T21:35:05.124 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-02-19T21:35:05.124 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-02-19T21:35:05.124 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_tracing": "false", 2024-02-19T21:35:05.124 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_use_stale_snap": "false", 2024-02-19T21:35:05.124 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-02-19T21:35:05.124 INFO:teuthology.orchestra.run.smithi080.stdout: "osdc_blkin_trace_all": "false", 2024-02-19T21:35:05.124 INFO:teuthology.orchestra.run.smithi080.stdout: "paxos_kill_at": "0", 2024-02-19T21:35:05.124 INFO:teuthology.orchestra.run.smithi080.stdout: "paxos_max_join_drift": "10", 2024-02-19T21:35:05.124 INFO:teuthology.orchestra.run.smithi080.stdout: "paxos_min": "500", 2024-02-19T21:35:05.124 INFO:teuthology.orchestra.run.smithi080.stdout: "paxos_min_wait": "0.050000", 2024-02-19T21:35:05.124 INFO:teuthology.orchestra.run.smithi080.stdout: "paxos_propose_interval": "1.000000", 2024-02-19T21:35:05.124 INFO:teuthology.orchestra.run.smithi080.stdout: "paxos_service_trim_max": "500", 2024-02-19T21:35:05.124 INFO:teuthology.orchestra.run.smithi080.stdout: "paxos_service_trim_max_multiplier": "20", 2024-02-19T21:35:05.124 INFO:teuthology.orchestra.run.smithi080.stdout: "paxos_service_trim_min": "10", 2024-02-19T21:35:05.124 INFO:teuthology.orchestra.run.smithi080.stdout: "paxos_stash_full_interval": "25", 2024-02-19T21:35:05.125 INFO:teuthology.orchestra.run.smithi080.stdout: "paxos_trim_max": "500", 2024-02-19T21:35:05.125 INFO:teuthology.orchestra.run.smithi080.stdout: "paxos_trim_min": "250", 2024-02-19T21:35:05.125 INFO:teuthology.orchestra.run.smithi080.stdout: "perf": "true", 2024-02-19T21:35:05.125 INFO:teuthology.orchestra.run.smithi080.stdout: "pid_file": "", 2024-02-19T21:35:05.125 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-02-19T21:35:05.125 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-02-19T21:35:05.125 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "-", 2024-02-19T21:35:05.125 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrv": "", 2024-02-19T21:35:05.125 INFO:teuthology.orchestra.run.smithi080.stdout: "public_bind_addr": "-", 2024-02-19T21:35:05.125 INFO:teuthology.orchestra.run.smithi080.stdout: "public_network": "", 2024-02-19T21:35:05.125 INFO:teuthology.orchestra.run.smithi080.stdout: "public_network_interface": "", 2024-02-19T21:35:05.125 INFO:teuthology.orchestra.run.smithi080.stdout: "qat_compressor_enabled": "false", 2024-02-19T21:35:05.125 INFO:teuthology.orchestra.run.smithi080.stdout: "rados_mon_op_timeout": "0", 2024-02-19T21:35:05.125 INFO:teuthology.orchestra.run.smithi080.stdout: "rados_osd_op_timeout": "0", 2024-02-19T21:35:05.125 INFO:teuthology.orchestra.run.smithi080.stdout: "rados_tracing": "false", 2024-02-19T21:35:05.126 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_atime_update_interval": "60", 2024-02-19T21:35:05.126 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-02-19T21:35:05.126 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_balance_parent_reads": "false", 2024-02-19T21:35:05.126 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_balance_snap_reads": "false", 2024-02-19T21:35:05.126 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_blkin_trace_all": "false", 2024-02-19T21:35:05.126 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_blocklist_expire_seconds": "0", 2024-02-19T21:35:05.126 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_blocklist_on_break_lock": "true", 2024-02-19T21:35:05.126 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_cache": "true", 2024-02-19T21:35:05.126 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_cache_block_writes_upfront": "false", 2024-02-19T21:35:05.126 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_cache_max_dirty": "25165824", 2024-02-19T21:35:05.126 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-02-19T21:35:05.126 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_cache_max_dirty_object": "0", 2024-02-19T21:35:05.126 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_cache_policy": "writearound", 2024-02-19T21:35:05.126 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_cache_size": "33554432", 2024-02-19T21:35:05.127 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_cache_target_dirty": "16777216", 2024-02-19T21:35:05.127 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-02-19T21:35:05.127 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_clone_copy_on_read": "false", 2024-02-19T21:35:05.127 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_compression_hint": "none", 2024-02-19T21:35:05.127 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_concurrent_management_ops": "10", 2024-02-19T21:35:05.127 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-02-19T21:35:05.127 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_default_clone_format": "auto", 2024-02-19T21:35:05.127 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_default_data_pool": "", 2024-02-19T21:35:05.127 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_default_features": "61", 2024-02-19T21:35:05.127 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_default_format": "2", 2024-02-19T21:35:05.127 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_default_map_options": "", 2024-02-19T21:35:05.127 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_default_order": "22", 2024-02-19T21:35:05.127 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_default_pool": "rbd", 2024-02-19T21:35:05.127 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-02-19T21:35:05.127 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_default_stripe_count": "0", 2024-02-19T21:35:05.127 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_default_stripe_unit": "0", 2024-02-19T21:35:05.127 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_disable_zero_copy_writes": "true", 2024-02-19T21:35:05.128 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_discard_granularity_bytes": "65536", 2024-02-19T21:35:05.128 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-02-19T21:35:05.128 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_enable_alloc_hint": "true", 2024-02-19T21:35:05.128 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-02-19T21:35:05.128 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_io_scheduler": "simple", 2024-02-19T21:35:05.128 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-02-19T21:35:05.128 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_journal_commit_age": "5.000000", 2024-02-19T21:35:05.128 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-02-19T21:35:05.128 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-02-19T21:35:05.128 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-02-19T21:35:05.128 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-02-19T21:35:05.128 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_journal_object_flush_interval": "0", 2024-02-19T21:35:05.128 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-02-19T21:35:05.128 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-02-19T21:35:05.128 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_journal_order": "24", 2024-02-19T21:35:05.129 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_journal_pool": "", 2024-02-19T21:35:05.129 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_journal_splay_width": "4", 2024-02-19T21:35:05.129 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_localize_parent_reads": "false", 2024-02-19T21:35:05.129 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_localize_snap_reads": "false", 2024-02-19T21:35:05.129 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-02-19T21:35:05.129 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-02-19T21:35:05.129 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-02-19T21:35:05.129 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-02-19T21:35:05.129 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-02-19T21:35:05.129 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-02-19T21:35:05.129 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_image_policy_type": "simple", 2024-02-19T21:35:05.129 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-02-19T21:35:05.129 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-02-19T21:35:05.129 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-02-19T21:35:05.129 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-02-19T21:35:05.129 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-02-19T21:35:05.129 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-02-19T21:35:05.130 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-02-19T21:35:05.130 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_memory_autotune": "true", 2024-02-19T21:35:05.130 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_memory_base": "805306368", 2024-02-19T21:35:05.130 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-02-19T21:35:05.130 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-02-19T21:35:05.130 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-02-19T21:35:05.130 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-02-19T21:35:05.130 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_memory_target": "4294967296", 2024-02-19T21:35:05.130 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-02-19T21:35:05.130 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-02-19T21:35:05.130 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-02-19T21:35:05.130 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirroring_delete_delay": "0", 2024-02-19T21:35:05.130 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-02-19T21:35:05.130 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirroring_replay_delay": "0", 2024-02-19T21:35:05.130 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-02-19T21:35:05.131 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-02-19T21:35:05.131 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_move_to_trash_on_remove": "false", 2024-02-19T21:35:05.131 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-02-19T21:35:05.131 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mtime_update_interval": "60", 2024-02-19T21:35:05.131 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_non_blocking_aio": "true", 2024-02-19T21:35:05.131 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_op_thread_timeout": "60", 2024-02-19T21:35:05.131 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_op_threads": "1", 2024-02-19T21:35:05.131 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_parent_cache_enabled": "false", 2024-02-19T21:35:05.131 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_persistent_cache_mode": "disabled", 2024-02-19T21:35:05.131 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_persistent_cache_path": "/tmp", 2024-02-19T21:35:05.131 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_persistent_cache_size": "1073741824", 2024-02-19T21:35:05.131 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_plugins": "", 2024-02-19T21:35:05.131 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_bps_burst": "0", 2024-02-19T21:35:05.131 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-02-19T21:35:05.131 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_bps_limit": "0", 2024-02-19T21:35:05.131 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_iops_burst": "0", 2024-02-19T21:35:05.132 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-02-19T21:35:05.132 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_iops_limit": "0", 2024-02-19T21:35:05.132 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_read_bps_burst": "0", 2024-02-19T21:35:05.132 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-02-19T21:35:05.132 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_read_bps_limit": "0", 2024-02-19T21:35:05.132 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_read_iops_burst": "0", 2024-02-19T21:35:05.132 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-02-19T21:35:05.132 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_read_iops_limit": "0", 2024-02-19T21:35:05.132 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_schedule_tick_min": "50", 2024-02-19T21:35:05.132 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_write_bps_burst": "0", 2024-02-19T21:35:05.132 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-02-19T21:35:05.132 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_write_bps_limit": "0", 2024-02-19T21:35:05.132 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_write_iops_burst": "0", 2024-02-19T21:35:05.132 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-02-19T21:35:05.132 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_write_iops_limit": "0", 2024-02-19T21:35:05.133 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_quiesce_notification_attempts": "10", 2024-02-19T21:35:05.133 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_read_from_replica_policy": "default", 2024-02-19T21:35:05.133 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-02-19T21:35:05.133 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_readahead_max_bytes": "524288", 2024-02-19T21:35:05.133 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_readahead_trigger_requests": "10", 2024-02-19T21:35:05.133 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_request_timed_out_seconds": "30", 2024-02-19T21:35:05.133 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_skip_partial_discard": "true", 2024-02-19T21:35:05.133 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-02-19T21:35:05.133 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_tracing": "false", 2024-02-19T21:35:05.133 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_validate_names": "true", 2024-02-19T21:35:05.133 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_validate_pool": "true", 2024-02-19T21:35:05.133 INFO:teuthology.orchestra.run.smithi080.stdout: "restapi_base_url": "", 2024-02-19T21:35:05.133 INFO:teuthology.orchestra.run.smithi080.stdout: "restapi_log_level": "", 2024-02-19T21:35:05.133 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_acl_grants_max_num": "100", 2024-02-19T21:35:05.133 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_admin_entry": "admin", 2024-02-19T21:35:05.133 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_barbican_url": "", 2024-02-19T21:35:05.133 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-02-19T21:35:05.134 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-02-19T21:35:05.134 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_bucket_index_max_aio": "128", 2024-02-19T21:35:05.134 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-02-19T21:35:05.134 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_bucket_quota_ttl": "600", 2024-02-19T21:35:05.134 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_cache_enabled": "true", 2024-02-19T21:35:05.134 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_cache_expiry_interval": "900", 2024-02-19T21:35:05.134 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_cache_lru_size": "10000", 2024-02-19T21:35:05.134 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_content_length_compat": "false", 2024-02-19T21:35:05.134 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_copy_obj_progress": "true", 2024-02-19T21:35:05.134 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-02-19T21:35:05.134 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_cors_rules_max_num": "100", 2024-02-19T21:35:05.134 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_cross_domain_policy": "", 2024-02-19T21:35:05.134 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_default_encryption_key": "", 2024-02-19T21:35:05.134 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_kmip_addr": "", 2024-02-19T21:35:05.134 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_kmip_ca_path": "", 2024-02-19T21:35:05.134 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_kmip_client_cert": "", 2024-02-19T21:35:05.135 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_kmip_client_key": "", 2024-02-19T21:35:05.135 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-02-19T21:35:05.135 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_kmip_password": "", 2024-02-19T21:35:05.135 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-02-19T21:35:05.135 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_kmip_username": "", 2024-02-19T21:35:05.135 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_require_ssl": "true", 2024-02-19T21:35:05.135 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-02-19T21:35:05.135 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-02-19T21:35:05.135 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_suppress_logs": "true", 2024-02-19T21:35:05.135 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_vault_addr": "", 2024-02-19T21:35:05.135 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_vault_auth": "token", 2024-02-19T21:35:05.135 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_vault_namespace": "", 2024-02-19T21:35:05.135 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_vault_prefix": "", 2024-02-19T21:35:05.135 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-02-19T21:35:05.135 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-02-19T21:35:05.135 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-02-19T21:35:05.135 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-02-19T21:35:05.136 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_vault_token_file": "", 2024-02-19T21:35:05.136 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-02-19T21:35:05.136 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_curl_buffersize": "524288", 2024-02-19T21:35:05.136 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_curl_low_speed_limit": "1024", 2024-02-19T21:35:05.136 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_curl_low_speed_time": "300", 2024-02-19T21:35:05.136 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-02-19T21:35:05.136 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-02-19T21:35:05.136 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_data_log_changes_size": "1000", 2024-02-19T21:35:05.136 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_data_log_num_shards": "128", 2024-02-19T21:35:05.136 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-02-19T21:35:05.136 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_data_log_window": "30", 2024-02-19T21:35:05.136 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_data_notify_interval_msec": "200", 2024-02-19T21:35:05.136 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-02-19T21:35:05.136 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-02-19T21:35:05.136 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_default_data_log_backing": "fifo", 2024-02-19T21:35:05.137 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-02-19T21:35:05.137 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_default_region_info_oid": "default.region", 2024-02-19T21:35:05.137 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-02-19T21:35:05.137 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-02-19T21:35:05.137 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_defer_to_bucket_acls": "", 2024-02-19T21:35:05.137 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-02-19T21:35:05.137 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-02-19T21:35:05.137 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-02-19T21:35:05.137 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-02-19T21:35:05.137 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-02-19T21:35:05.137 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-02-19T21:35:05.137 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-02-19T21:35:05.137 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-02-19T21:35:05.137 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dmclock_data_res": "500.000000", 2024-02-19T21:35:05.137 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-02-19T21:35:05.137 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-02-19T21:35:05.138 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-02-19T21:35:05.138 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-02-19T21:35:05.138 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dns_name": "", 2024-02-19T21:35:05.138 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dns_s3website_name": "", 2024-02-19T21:35:05.138 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dynamic_resharding": "true", 2024-02-19T21:35:05.138 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-02-19T21:35:05.138 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_enable_gc_threads": "true", 2024-02-19T21:35:05.138 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_enable_lc_threads": "true", 2024-02-19T21:35:05.138 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_enable_ops_log": "false", 2024-02-19T21:35:05.138 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_enable_quota_threads": "true", 2024-02-19T21:35:05.138 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_enable_static_website": "false", 2024-02-19T21:35:05.138 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_enable_usage_log": "false", 2024-02-19T21:35:05.138 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_enforce_swift_acls": "true", 2024-02-19T21:35:05.138 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_exit_timeout_secs": "120", 2024-02-19T21:35:05.138 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_expose_bucket": "false", 2024-02-19T21:35:05.138 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_extended_http_attrs": "", 2024-02-19T21:35:05.139 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_fcgi_socket_backlog": "1024", 2024-02-19T21:35:05.139 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-02-19T21:35:05.139 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_frontends": "beast port=7480", 2024-02-19T21:35:05.139 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_gc_max_concurrent_io": "10", 2024-02-19T21:35:05.139 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_gc_max_deferred": "50", 2024-02-19T21:35:05.139 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-02-19T21:35:05.139 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_gc_max_objs": "32", 2024-02-19T21:35:05.139 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_gc_max_queue_size": "134213632", 2024-02-19T21:35:05.139 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_gc_max_trim_chunk": "16", 2024-02-19T21:35:05.139 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_gc_obj_min_wait": "7200", 2024-02-19T21:35:05.139 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_gc_processor_max_time": "3600", 2024-02-19T21:35:05.139 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_gc_processor_period": "3600", 2024-02-19T21:35:05.140 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-02-19T21:35:05.140 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_get_obj_window_size": "16777216", 2024-02-19T21:35:05.140 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_healthcheck_disabling_path": "", 2024-02-19T21:35:05.140 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_host": "", 2024-02-19T21:35:05.140 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_ignore_get_invalid_range": "false", 2024-02-19T21:35:05.140 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_init_timeout": "300", 2024-02-19T21:35:05.140 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-02-19T21:35:05.140 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-02-19T21:35:05.140 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-02-19T21:35:05.140 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_admin_domain": "", 2024-02-19T21:35:05.140 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_admin_password": "", 2024-02-19T21:35:05.140 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_admin_password_path": "", 2024-02-19T21:35:05.140 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_admin_project": "", 2024-02-19T21:35:05.140 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_admin_tenant": "", 2024-02-19T21:35:05.141 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_admin_token": "", 2024-02-19T21:35:05.141 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_admin_token_path": "", 2024-02-19T21:35:05.141 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_admin_user": "", 2024-02-19T21:35:05.141 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_api_version": "2", 2024-02-19T21:35:05.141 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_barbican_domain": "", 2024-02-19T21:35:05.141 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_barbican_password": "", 2024-02-19T21:35:05.141 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_barbican_project": "", 2024-02-19T21:35:05.141 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_barbican_tenant": "", 2024-02-19T21:35:05.141 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_barbican_user": "", 2024-02-19T21:35:05.141 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_implicit_tenants": "false", 2024-02-19T21:35:05.141 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_token_cache_size": "10000", 2024-02-19T21:35:05.141 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_url": "", 2024-02-19T21:35:05.141 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_verify_ssl": "true", 2024-02-19T21:35:05.141 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_lc_debug_interval": "-1", 2024-02-19T21:35:05.141 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_lc_lock_max_time": "90", 2024-02-19T21:35:05.141 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_lc_max_objs": "32", 2024-02-19T21:35:05.141 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_lc_max_rules": "1000", 2024-02-19T21:35:05.142 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_lc_max_worker": "3", 2024-02-19T21:35:05.142 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_lc_max_wp_worker": "3", 2024-02-19T21:35:05.142 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_lc_thread_delay": "0", 2024-02-19T21:35:05.142 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-02-19T21:35:05.142 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_ldap_dnattr": "uid", 2024-02-19T21:35:05.142 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-02-19T21:35:05.142 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_ldap_searchfilter": "", 2024-02-19T21:35:05.142 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-02-19T21:35:05.142 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_ldap_uri": "ldaps://", 2024-02-19T21:35:05.142 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-02-19T21:35:05.142 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-02-19T21:35:05.142 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-02-19T21:35:05.142 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_log_http_headers": "", 2024-02-19T21:35:05.142 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_log_nonexistent_bucket": "false", 2024-02-19T21:35:05.142 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-02-19T21:35:05.143 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_log_object_name_utc": "false", 2024-02-19T21:35:05.143 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2024-02-19T21:35:05.143 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_max_attr_name_len": "0", 2024-02-19T21:35:05.143 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_max_attr_size": "0", 2024-02-19T21:35:05.143 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_max_attrs_num_in_req": "0", 2024-02-19T21:35:05.143 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_max_chunk_size": "4194304", 2024-02-19T21:35:05.143 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_max_concurrent_requests": "1024", 2024-02-19T21:35:05.143 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_max_dynamic_shards": "1999", 2024-02-19T21:35:05.143 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_max_listing_results": "1000", 2024-02-19T21:35:05.143 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_max_notify_retries": "10", 2024-02-19T21:35:05.143 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_max_objs_per_shard": "100000", 2024-02-19T21:35:05.143 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_max_put_param_size": "1048576", 2024-02-19T21:35:05.143 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_max_put_size": "5368709120", 2024-02-19T21:35:05.143 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_max_slo_entries": "1000", 2024-02-19T21:35:05.144 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_md_log_max_shards": "64", 2024-02-19T21:35:05.144 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_md_notify_interval_msec": "200", 2024-02-19T21:35:05.144 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-02-19T21:35:05.144 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_mp_lock_max_time": "600", 2024-02-19T21:35:05.144 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-02-19T21:35:05.144 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_multipart_min_part_size": "5242880", 2024-02-19T21:35:05.144 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-02-19T21:35:05.144 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-02-19T21:35:05.144 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_nfs_fhcache_size": "2017", 2024-02-19T21:35:05.144 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-02-19T21:35:05.144 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_nfs_lru_lanes": "5", 2024-02-19T21:35:05.144 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_nfs_max_gc": "300", 2024-02-19T21:35:05.144 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-02-19T21:35:05.144 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_nfs_run_gc_threads": "false", 2024-02-19T21:35:05.144 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_nfs_run_lc_threads": "false", 2024-02-19T21:35:05.145 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_nfs_run_quota_threads": "false", 2024-02-19T21:35:05.145 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_nfs_run_sync_thread": "false", 2024-02-19T21:35:05.145 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-02-19T21:35:05.145 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-02-19T21:35:05.145 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_num_async_rados_threads": "32", 2024-02-19T21:35:05.145 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_num_control_oids": "8", 2024-02-19T21:35:05.145 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_num_rados_handles": "1", 2024-02-19T21:35:05.145 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_numa_node": "-1", 2024-02-19T21:35:05.145 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_obj_stripe_size": "4194304", 2024-02-19T21:35:05.145 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-02-19T21:35:05.145 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_objexp_chunk_size": "100", 2024-02-19T21:35:05.145 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_objexp_gc_interval": "600", 2024-02-19T21:35:05.145 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_objexp_hints_num_shards": "127", 2024-02-19T21:35:05.145 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-02-19T21:35:05.145 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-02-19T21:35:05.146 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_op_thread_timeout": "600", 2024-02-19T21:35:05.146 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_op_tracing": "false", 2024-02-19T21:35:05.146 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_opa_token": "", 2024-02-19T21:35:05.146 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_opa_url": "", 2024-02-19T21:35:05.146 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_opa_verify_ssl": "true", 2024-02-19T21:35:05.146 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-02-19T21:35:05.146 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_ops_log_file_path": "", 2024-02-19T21:35:05.146 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_ops_log_rados": "true", 2024-02-19T21:35:05.146 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_ops_log_socket_path": "", 2024-02-19T21:35:05.146 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-02-19T21:35:05.146 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-02-19T21:35:05.146 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_period_push_interval": "2.000000", 2024-02-19T21:35:05.146 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_period_push_interval_max": "30.000000", 2024-02-19T21:35:05.146 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_period_root_pool": ".rgw.root", 2024-02-19T21:35:05.147 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_port": "", 2024-02-19T21:35:05.147 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_print_continue": "true", 2024-02-19T21:35:05.147 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_print_prohibited_content_length": "false", 2024-02-19T21:35:05.147 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-02-19T21:35:05.147 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-02-19T21:35:05.147 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-02-19T21:35:05.147 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-02-19T21:35:05.147 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_rados_tracing": "false", 2024-02-19T21:35:05.147 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_realm": "", 2024-02-19T21:35:05.147 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-02-19T21:35:05.147 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_region": "", 2024-02-19T21:35:05.147 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_region_root_pool": ".rgw.root", 2024-02-19T21:35:05.147 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_relaxed_region_enforcement": "false", 2024-02-19T21:35:05.147 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-02-19T21:35:05.147 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-02-19T21:35:05.147 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_request_uri": "", 2024-02-19T21:35:05.148 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_reshard_batch_size": "64", 2024-02-19T21:35:05.148 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-02-19T21:35:05.148 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_reshard_max_aio": "128", 2024-02-19T21:35:05.148 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_reshard_num_logs": "16", 2024-02-19T21:35:05.148 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_reshard_thread_interval": "600", 2024-02-19T21:35:05.148 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_resolve_cname": "false", 2024-02-19T21:35:05.148 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_rest_getusage_op_compat": "false", 2024-02-19T21:35:05.148 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_run_sync_thread": "true", 2024-02-19T21:35:05.148 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-02-19T21:35:05.148 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_s3_auth_use_keystone": "false", 2024-02-19T21:35:05.148 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_s3_auth_use_ldap": "false", 2024-02-19T21:35:05.148 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_s3_auth_use_rados": "true", 2024-02-19T21:35:05.148 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_s3_auth_use_sts": "false", 2024-02-19T21:35:05.148 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_s3_success_create_obj_status": "0", 2024-02-19T21:35:05.148 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-02-19T21:35:05.148 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_scheduler_type": "throttler", 2024-02-19T21:35:05.149 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_script_uri": "", 2024-02-19T21:35:05.149 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_service_provider_name": "", 2024-02-19T21:35:05.149 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-02-19T21:35:05.149 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_socket_path": "", 2024-02-19T21:35:05.149 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sts_client_id": "", 2024-02-19T21:35:05.149 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sts_client_secret": "", 2024-02-19T21:35:05.149 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sts_entry": "sts", 2024-02-19T21:35:05.149 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sts_key": "sts", 2024-02-19T21:35:05.149 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sts_max_session_duration": "43200", 2024-02-19T21:35:05.149 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sts_min_session_duration": "900", 2024-02-19T21:35:05.149 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sts_token_introspection_url": "", 2024-02-19T21:35:05.149 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_swift_account_in_url": "false", 2024-02-19T21:35:05.149 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_swift_auth_entry": "auth", 2024-02-19T21:35:05.149 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_swift_auth_url": "", 2024-02-19T21:35:05.149 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_swift_custom_header": "", 2024-02-19T21:35:05.149 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_swift_enforce_content_length": "false", 2024-02-19T21:35:05.150 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_swift_need_stats": "true", 2024-02-19T21:35:05.150 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_swift_tenant_name": "", 2024-02-19T21:35:05.150 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_swift_token_expiration": "86400", 2024-02-19T21:35:05.150 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_swift_url": "", 2024-02-19T21:35:05.150 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_swift_url_prefix": "swift", 2024-02-19T21:35:05.150 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_swift_versioning_enabled": "false", 2024-02-19T21:35:05.150 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-02-19T21:35:05.150 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sync_lease_period": "120", 2024-02-19T21:35:05.150 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-02-19T21:35:05.150 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sync_log_trim_interval": "1200", 2024-02-19T21:35:05.150 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-02-19T21:35:05.150 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-02-19T21:35:05.150 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-02-19T21:35:05.150 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sync_obj_etag_verify": "false", 2024-02-19T21:35:05.150 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sync_trace_history_size": "4096", 2024-02-19T21:35:05.150 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-02-19T21:35:05.150 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-02-19T21:35:05.151 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_thread_pool_size": "512", 2024-02-19T21:35:05.151 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_torrent_comment": "", 2024-02-19T21:35:05.151 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_torrent_createby": "", 2024-02-19T21:35:05.151 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_torrent_encoding": "", 2024-02-19T21:35:05.151 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_torrent_flag": "false", 2024-02-19T21:35:05.151 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_torrent_origin": "", 2024-02-19T21:35:05.151 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_torrent_sha_unit": "524288", 2024-02-19T21:35:05.151 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_torrent_tracker": "", 2024-02-19T21:35:05.151 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_trust_forwarded_https": "false", 2024-02-19T21:35:05.151 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-02-19T21:35:05.151 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_usage_log_tick_interval": "30", 2024-02-19T21:35:05.151 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_usage_max_shards": "32", 2024-02-19T21:35:05.151 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_usage_max_user_shards": "1", 2024-02-19T21:35:05.151 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_use_opa_authz": "false", 2024-02-19T21:35:05.151 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-02-19T21:35:05.151 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_user_default_quota_max_size": "-1", 2024-02-19T21:35:05.151 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_user_max_buckets": "1000", 2024-02-19T21:35:05.152 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-02-19T21:35:05.152 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-02-19T21:35:05.152 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_user_quota_sync_interval": "86400", 2024-02-19T21:35:05.152 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-02-19T21:35:05.152 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_user_unique_email": "true", 2024-02-19T21:35:05.152 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_verify_ssl": "true", 2024-02-19T21:35:05.152 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_website_routing_rules_max_num": "50", 2024-02-19T21:35:05.152 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_zone": "", 2024-02-19T21:35:05.152 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-02-19T21:35:05.152 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_zonegroup": "", 2024-02-19T21:35:05.152 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-02-19T21:35:05.152 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_block_size": "4096", 2024-02-19T21:35:05.152 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-02-19T21:35:05.152 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-02-19T21:35:05.152 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-02-19T21:35:05.153 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-02-19T21:35:05.153 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_cache_shard_bits": "4", 2024-02-19T21:35:05.153 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_cache_size": "536870912", 2024-02-19T21:35:05.153 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_cache_type": "binned_lru", 2024-02-19T21:35:05.153 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_cf_compact_on_deletion": "false", 2024-02-19T21:35:05.153 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-02-19T21:35:05.153 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-02-19T21:35:05.153 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_collect_compaction_stats": "false", 2024-02-19T21:35:05.153 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_collect_extended_stats": "false", 2024-02-19T21:35:05.153 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_collect_memory_stats": "false", 2024-02-19T21:35:05.153 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-02-19T21:35:05.153 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_index_type": "binary_search", 2024-02-19T21:35:05.153 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_log_to_ceph_log": "true", 2024-02-19T21:35:05.153 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_metadata_block_size": "4096", 2024-02-19T21:35:05.153 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_partition_filters": "false", 2024-02-19T21:35:05.153 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_perf": "false", 2024-02-19T21:35:05.154 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-02-19T21:35:05.154 INFO:teuthology.orchestra.run.smithi080.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-02-19T21:35:05.154 INFO:teuthology.orchestra.run.smithi080.stdout: "rotating_keys_renewal_timeout": "10", 2024-02-19T21:35:05.154 INFO:teuthology.orchestra.run.smithi080.stdout: "run_dir": "/var/run/ceph", 2024-02-19T21:35:05.154 INFO:teuthology.orchestra.run.smithi080.stdout: "setgroup": "ceph", 2024-02-19T21:35:05.154 INFO:teuthology.orchestra.run.smithi080.stdout: "setuser": "ceph", 2024-02-19T21:35:05.154 INFO:teuthology.orchestra.run.smithi080.stdout: "setuser_match_path": "", 2024-02-19T21:35:05.154 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_misplaced_ratio": "0.050000", 2024-02-19T21:35:05.154 INFO:teuthology.orchestra.run.smithi080.stdout: "thp": "false", 2024-02-19T21:35:05.154 INFO:teuthology.orchestra.run.smithi080.stdout: "threadpool_default_timeout": "60", 2024-02-19T21:35:05.154 INFO:teuthology.orchestra.run.smithi080.stdout: "threadpool_empty_queue_max_wait": "2", 2024-02-19T21:35:05.154 INFO:teuthology.orchestra.run.smithi080.stdout: "throttler_perf_counter": "true" 2024-02-19T21:35:05.154 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:35:05.808 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:35:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:35:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:35:05.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:04.301210+0000 osd.4 (osd.4) 61 : cluster [DBG] 6.17 scrub starts 2024-02-19T21:35:05.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:04.302221+0000 osd.4 (osd.4) 62 : cluster [DBG] 6.17 scrub ok 2024-02-19T21:35:05.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:04.766820+0000 osd.1 (osd.1) 57 : cluster [DBG] 2.a deep-scrub starts 2024-02-19T21:35:05.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:04.767976+0000 osd.1 (osd.1) 58 : cluster [DBG] 2.a deep-scrub ok 2024-02-19T21:35:05.826 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:04.301210+0000 osd.4 (osd.4) 61 : cluster [DBG] 6.17 scrub starts 2024-02-19T21:35:05.826 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:04.302221+0000 osd.4 (osd.4) 62 : cluster [DBG] 6.17 scrub ok 2024-02-19T21:35:05.826 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:04.766820+0000 osd.1 (osd.1) 57 : cluster [DBG] 2.a deep-scrub starts 2024-02-19T21:35:05.826 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:04.767976+0000 osd.1 (osd.1) 58 : cluster [DBG] 2.a deep-scrub ok 2024-02-19T21:35:05.826 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:04.301210+0000 osd.4 (osd.4) 61 : cluster [DBG] 6.17 scrub starts 2024-02-19T21:35:05.826 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:04.302221+0000 osd.4 (osd.4) 62 : cluster [DBG] 6.17 scrub ok 2024-02-19T21:35:05.826 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:04.766820+0000 osd.1 (osd.1) 57 : cluster [DBG] 2.a deep-scrub starts 2024-02-19T21:35:05.826 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:04.767976+0000 osd.1 (osd.1) 58 : cluster [DBG] 2.a deep-scrub ok 2024-02-19T21:35:05.846 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-02-19T21:35:06.117 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:35:06.715 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:04.794494+0000 mgr.y (mgr.14514) 109 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-19T21:35:06.715 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:05.221967+0000 osd.6 (osd.6) 41 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:35:06.715 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:05.222027+0000 osd.6 (osd.6) 42 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:35:06.715 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:05.453714+0000 osd.7 (osd.7) 53 : cluster [DBG] 2.8 scrub starts 2024-02-19T21:35:06.715 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:05.457501+0000 osd.7 (osd.7) 54 : cluster [DBG] 2.8 scrub ok 2024-02-19T21:35:06.716 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:05.853248+0000 mon.a (mon.0) 772 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2024-02-19T21:35:06.716 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:04.794494+0000 mgr.y (mgr.14514) 109 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-19T21:35:06.716 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:05.221967+0000 osd.6 (osd.6) 41 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:35:06.716 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:05.222027+0000 osd.6 (osd.6) 42 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:35:06.716 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:05.453714+0000 osd.7 (osd.7) 53 : cluster [DBG] 2.8 scrub starts 2024-02-19T21:35:06.716 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:05.457501+0000 osd.7 (osd.7) 54 : cluster [DBG] 2.8 scrub ok 2024-02-19T21:35:06.716 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:05.853248+0000 mon.a (mon.0) 772 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2024-02-19T21:35:06.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:04.794494+0000 mgr.y (mgr.14514) 109 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-19T21:35:06.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:05.221967+0000 osd.6 (osd.6) 41 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:35:06.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:05.222027+0000 osd.6 (osd.6) 42 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:35:06.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:05.453714+0000 osd.7 (osd.7) 53 : cluster [DBG] 2.8 scrub starts 2024-02-19T21:35:06.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:05.457501+0000 osd.7 (osd.7) 54 : cluster [DBG] 2.8 scrub ok 2024-02-19T21:35:06.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:05.853248+0000 mon.a (mon.0) 772 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2024-02-19T21:35:07.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:05.953053+0000 osd.6 (osd.6) 43 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:35:07.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:05.956168+0000 osd.6 (osd.6) 44 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:35:07.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:06.503960+0000 osd.7 (osd.7) 55 : cluster [DBG] 5.9 scrub starts 2024-02-19T21:35:07.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:06.507455+0000 osd.7 (osd.7) 56 : cluster [DBG] 5.9 scrub ok 2024-02-19T21:35:07.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:05.953053+0000 osd.6 (osd.6) 43 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:35:07.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:05.956168+0000 osd.6 (osd.6) 44 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:35:07.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:06.503960+0000 osd.7 (osd.7) 55 : cluster [DBG] 5.9 scrub starts 2024-02-19T21:35:07.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:06.507455+0000 osd.7 (osd.7) 56 : cluster [DBG] 5.9 scrub ok 2024-02-19T21:35:07.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:05.953053+0000 osd.6 (osd.6) 43 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:35:07.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:05.956168+0000 osd.6 (osd.6) 44 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:35:07.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:06.503960+0000 osd.7 (osd.7) 55 : cluster [DBG] 5.9 scrub starts 2024-02-19T21:35:07.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:06.507455+0000 osd.7 (osd.7) 56 : cluster [DBG] 5.9 scrub ok 2024-02-19T21:35:08.530 INFO:teuthology.orchestra.run.smithi080.stdout:mon.a: {} 2024-02-19T21:35:08.540 INFO:teuthology.orchestra.run.smithi080.stdout:mon.b: {} 2024-02-19T21:35:08.548 INFO:teuthology.orchestra.run.smithi080.stdout:mon.c: {} 2024-02-19T21:35:08.549 INFO:teuthology.orchestra.run.smithi080.stderr:mon.a: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2024-02-19T21:35:08.550 INFO:teuthology.orchestra.run.smithi080.stderr:mon.b: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2024-02-19T21:35:08.550 INFO:teuthology.orchestra.run.smithi080.stderr:mon.c: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2024-02-19T21:35:08.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:06.794912+0000 mgr.y (mgr.14514) 110 : cluster [DBG] pgmap v94: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:35:08.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:07.518499+0000 osd.3 (osd.3) 63 : cluster [DBG] 6.b deep-scrub starts 2024-02-19T21:35:08.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:07.519523+0000 osd.3 (osd.3) 64 : cluster [DBG] 6.b deep-scrub ok 2024-02-19T21:35:08.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:07.576115+0000 osd.5 (osd.5) 55 : cluster [DBG] 5.15 scrub starts 2024-02-19T21:35:08.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:07.577694+0000 osd.5 (osd.5) 56 : cluster [DBG] 5.15 scrub ok 2024-02-19T21:35:08.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:06.794912+0000 mgr.y (mgr.14514) 110 : cluster [DBG] pgmap v94: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:35:08.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:07.518499+0000 osd.3 (osd.3) 63 : cluster [DBG] 6.b deep-scrub starts 2024-02-19T21:35:08.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:07.519523+0000 osd.3 (osd.3) 64 : cluster [DBG] 6.b deep-scrub ok 2024-02-19T21:35:08.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:07.576115+0000 osd.5 (osd.5) 55 : cluster [DBG] 5.15 scrub starts 2024-02-19T21:35:08.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:07.577694+0000 osd.5 (osd.5) 56 : cluster [DBG] 5.15 scrub ok 2024-02-19T21:35:08.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:06.794912+0000 mgr.y (mgr.14514) 110 : cluster [DBG] pgmap v94: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:35:08.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:07.518499+0000 osd.3 (osd.3) 63 : cluster [DBG] 6.b deep-scrub starts 2024-02-19T21:35:08.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:07.519523+0000 osd.3 (osd.3) 64 : cluster [DBG] 6.b deep-scrub ok 2024-02-19T21:35:08.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:07.576115+0000 osd.5 (osd.5) 55 : cluster [DBG] 5.15 scrub starts 2024-02-19T21:35:08.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:07.577694+0000 osd.5 (osd.5) 56 : cluster [DBG] 5.15 scrub ok 2024-02-19T21:35:09.455 INFO:teuthology.run_tasks:Running task full_sequential... 2024-02-19T21:35:09.464 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-02-19T21:35:09.466 INFO:tasks.radosbench:Beginning radosbench... 2024-02-19T21:35:09.466 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_0 2024-02-19T21:35:09.466 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool create unique_pool_0 16 2024-02-19T21:35:09.466 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-02-19T21:35:09.466 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:35:09.467 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:35:09.467 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-02-19T21:35:09.467 INFO:tasks.thrashosds.thrasher:Setting osd 4 primary_affinity to 0.427414 2024-02-19T21:35:09.467 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd primary-affinity 4 0.4274135583093771 2024-02-19T21:35:09.467 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-02-19T21:35:09.468 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:35:09.468 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-02-19T21:35:09.468 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:35:09.468 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-02-19T21:35:09.469 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_ops_in_flight 2024-02-19T21:35:09.469 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-02-19T21:35:09.469 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set noscrub 2024-02-19T21:35:09.510 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:09.533 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:35:09.536 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:09.537 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:35:09.637 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:35:09.670 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:09.693 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:35:09.698 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:09.698 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:07.956342+0000 osd.6 (osd.6) 45 : cluster [DBG] 5.2 scrub starts 2024-02-19T21:35:09.698 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:07.959230+0000 osd.6 (osd.6) 46 : cluster [DBG] 5.2 scrub ok 2024-02-19T21:35:09.698 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:08.398491+0000 osd.5 (osd.5) 57 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:35:09.698 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:08.398563+0000 osd.5 (osd.5) 58 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:35:09.698 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:08.487125+0000 osd.7 (osd.7) 57 : cluster [DBG] 2.1d deep-scrub starts 2024-02-19T21:35:09.698 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:08.490153+0000 mon.a (mon.0) 773 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2024-02-19T21:35:09.698 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:08.490780+0000 osd.7 (osd.7) 58 : cluster [DBG] 2.1d deep-scrub ok 2024-02-19T21:35:09.698 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:08.519310+0000 mon.a (mon.0) 774 : audit [DBG] from='client.? 172.21.15.80:0/786435655' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T21:35:09.699 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:35:09.699 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:07.956342+0000 osd.6 (osd.6) 45 : cluster [DBG] 5.2 scrub starts 2024-02-19T21:35:09.699 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:07.959230+0000 osd.6 (osd.6) 46 : cluster [DBG] 5.2 scrub ok 2024-02-19T21:35:09.700 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:08.398491+0000 osd.5 (osd.5) 57 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:35:09.700 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:08.398563+0000 osd.5 (osd.5) 58 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:35:09.700 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:08.487125+0000 osd.7 (osd.7) 57 : cluster [DBG] 2.1d deep-scrub starts 2024-02-19T21:35:09.700 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:08.490153+0000 mon.a (mon.0) 773 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2024-02-19T21:35:09.700 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:08.490780+0000 osd.7 (osd.7) 58 : cluster [DBG] 2.1d deep-scrub ok 2024-02-19T21:35:09.700 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:08.519310+0000 mon.a (mon.0) 774 : audit [DBG] from='client.? 172.21.15.80:0/786435655' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T21:35:09.800 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:35:09.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:07.956342+0000 osd.6 (osd.6) 45 : cluster [DBG] 5.2 scrub starts 2024-02-19T21:35:09.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:07.959230+0000 osd.6 (osd.6) 46 : cluster [DBG] 5.2 scrub ok 2024-02-19T21:35:09.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:08.398491+0000 osd.5 (osd.5) 57 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:35:09.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:08.398563+0000 osd.5 (osd.5) 58 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:35:09.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:08.487125+0000 osd.7 (osd.7) 57 : cluster [DBG] 2.1d deep-scrub starts 2024-02-19T21:35:09.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:08.490153+0000 mon.a (mon.0) 773 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2024-02-19T21:35:09.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:08.490780+0000 osd.7 (osd.7) 58 : cluster [DBG] 2.1d deep-scrub ok 2024-02-19T21:35:09.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:08.519310+0000 mon.a (mon.0) 774 : audit [DBG] from='client.? 172.21.15.80:0/786435655' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T21:35:09.832 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:09.852 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:35:09.859 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:09.860 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:35:09.861 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:35:09.862 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:35:09.862 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:35:09.908 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:35:09.960 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:35:09.993 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:10.014 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:35:10.017 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:10.017 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:35:10.118 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:35:10.147 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:10.153 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:35:10.308 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:35:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:35:10.403 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:35:10.406 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:10.407 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:35:10.507 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:35:10.536 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:10.691 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:08.795281+0000 mgr.y (mgr.14514) 111 : cluster [DBG] pgmap v96: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:35:10.692 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:09.351305+0000 osd.4 (osd.4) 63 : cluster [DBG] 4.9 scrub starts 2024-02-19T21:35:10.692 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:09.354987+0000 osd.4 (osd.4) 64 : cluster [DBG] 4.9 scrub ok 2024-02-19T21:35:10.692 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:09.537556+0000 osd.3 (osd.3) 65 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:35:10.692 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:09.538787+0000 osd.3 (osd.3) 66 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:35:10.692 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:08.795281+0000 mgr.y (mgr.14514) 111 : cluster [DBG] pgmap v96: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:35:10.692 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:09.351305+0000 osd.4 (osd.4) 63 : cluster [DBG] 4.9 scrub starts 2024-02-19T21:35:10.692 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:09.354987+0000 osd.4 (osd.4) 64 : cluster [DBG] 4.9 scrub ok 2024-02-19T21:35:10.692 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:09.537556+0000 osd.3 (osd.3) 65 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:35:10.692 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:09.538787+0000 osd.3 (osd.3) 66 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:35:10.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:08.795281+0000 mgr.y (mgr.14514) 111 : cluster [DBG] pgmap v96: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:35:10.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:09.351305+0000 osd.4 (osd.4) 63 : cluster [DBG] 4.9 scrub starts 2024-02-19T21:35:10.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:09.354987+0000 osd.4 (osd.4) 64 : cluster [DBG] 4.9 scrub ok 2024-02-19T21:35:10.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:09.537556+0000 osd.3 (osd.3) 65 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:35:10.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:09.538787+0000 osd.3 (osd.3) 66 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:35:11.098 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:35:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:35:10] "GET /metrics HTTP/1.1" 200 172168 "" "Prometheus/2.33.4" 2024-02-19T21:35:11.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:09.896224+0000 mgr.y (mgr.14514) 112 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:35:11.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:10.362786+0000 osd.0 (osd.0) 55 : cluster [DBG] 6.10 scrub starts 2024-02-19T21:35:11.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:10.363746+0000 osd.0 (osd.0) 56 : cluster [DBG] 6.10 scrub ok 2024-02-19T21:35:11.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:09.896224+0000 mgr.y (mgr.14514) 112 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:35:11.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:10.362786+0000 osd.0 (osd.0) 55 : cluster [DBG] 6.10 scrub starts 2024-02-19T21:35:11.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:10.363746+0000 osd.0 (osd.0) 56 : cluster [DBG] 6.10 scrub ok 2024-02-19T21:35:11.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:09.896224+0000 mgr.y (mgr.14514) 112 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:35:11.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:10.362786+0000 osd.0 (osd.0) 55 : cluster [DBG] 6.10 scrub starts 2024-02-19T21:35:11.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:10.363746+0000 osd.0 (osd.0) 56 : cluster [DBG] 6.10 scrub ok 2024-02-19T21:35:12.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:10.585074+0000 osd.3 (osd.3) 67 : cluster [DBG] 4.1d scrub starts 2024-02-19T21:35:12.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:10.586993+0000 osd.3 (osd.3) 68 : cluster [DBG] 4.1d scrub ok 2024-02-19T21:35:12.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:10.796013+0000 mgr.y (mgr.14514) 113 : cluster [DBG] pgmap v97: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:35:12.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:11.382038+0000 osd.4 (osd.4) 65 : cluster [DBG] 5.18 scrub starts 2024-02-19T21:35:12.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:11.384924+0000 osd.4 (osd.4) 66 : cluster [DBG] 5.18 scrub ok 2024-02-19T21:35:12.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:11.384975+0000 osd.0 (osd.0) 57 : cluster [DBG] 5.1e scrub starts 2024-02-19T21:35:12.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:11.385825+0000 osd.0 (osd.0) 58 : cluster [DBG] 5.1e scrub ok 2024-02-19T21:35:12.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:11.478605+0000 osd.3 (osd.3) 69 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:35:12.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:11.478683+0000 osd.3 (osd.3) 70 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:35:12.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:11.505659+0000 mon.a (mon.0) 775 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2024-02-19T21:35:12.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:11.512449+0000 osd.5 (osd.5) 59 : cluster [DBG] 6.7 scrub starts 2024-02-19T21:35:12.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:11.515651+0000 osd.5 (osd.5) 60 : cluster [DBG] 6.7 scrub ok 2024-02-19T21:35:12.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:10.585074+0000 osd.3 (osd.3) 67 : cluster [DBG] 4.1d scrub starts 2024-02-19T21:35:12.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:10.586993+0000 osd.3 (osd.3) 68 : cluster [DBG] 4.1d scrub ok 2024-02-19T21:35:12.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:10.796013+0000 mgr.y (mgr.14514) 113 : cluster [DBG] pgmap v97: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:35:12.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:11.382038+0000 osd.4 (osd.4) 65 : cluster [DBG] 5.18 scrub starts 2024-02-19T21:35:12.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:11.384924+0000 osd.4 (osd.4) 66 : cluster [DBG] 5.18 scrub ok 2024-02-19T21:35:12.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:11.384975+0000 osd.0 (osd.0) 57 : cluster [DBG] 5.1e scrub starts 2024-02-19T21:35:12.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:11.385825+0000 osd.0 (osd.0) 58 : cluster [DBG] 5.1e scrub ok 2024-02-19T21:35:12.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:11.478605+0000 osd.3 (osd.3) 69 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:35:12.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:11.478683+0000 osd.3 (osd.3) 70 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:35:12.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:11.505659+0000 mon.a (mon.0) 775 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2024-02-19T21:35:12.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:11.512449+0000 osd.5 (osd.5) 59 : cluster [DBG] 6.7 scrub starts 2024-02-19T21:35:12.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:11.515651+0000 osd.5 (osd.5) 60 : cluster [DBG] 6.7 scrub ok 2024-02-19T21:35:12.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:10.585074+0000 osd.3 (osd.3) 67 : cluster [DBG] 4.1d scrub starts 2024-02-19T21:35:12.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:10.586993+0000 osd.3 (osd.3) 68 : cluster [DBG] 4.1d scrub ok 2024-02-19T21:35:12.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:10.796013+0000 mgr.y (mgr.14514) 113 : cluster [DBG] pgmap v97: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:35:12.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:11.382038+0000 osd.4 (osd.4) 65 : cluster [DBG] 5.18 scrub starts 2024-02-19T21:35:12.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:11.384924+0000 osd.4 (osd.4) 66 : cluster [DBG] 5.18 scrub ok 2024-02-19T21:35:12.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:11.384975+0000 osd.0 (osd.0) 57 : cluster [DBG] 5.1e scrub starts 2024-02-19T21:35:12.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:11.385825+0000 osd.0 (osd.0) 58 : cluster [DBG] 5.1e scrub ok 2024-02-19T21:35:12.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:11.478605+0000 osd.3 (osd.3) 69 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:35:12.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:11.478683+0000 osd.3 (osd.3) 70 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:35:12.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:11.505659+0000 mon.a (mon.0) 775 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2024-02-19T21:35:12.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:11.512449+0000 osd.5 (osd.5) 59 : cluster [DBG] 6.7 scrub starts 2024-02-19T21:35:12.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:11.515651+0000 osd.5 (osd.5) 60 : cluster [DBG] 6.7 scrub ok 2024-02-19T21:35:13.387 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:35:13.390 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:13.390 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:35:13.491 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:35:13.518 INFO:teuthology.orchestra.run.smithi080.stderr:set osd.4 primary-affinity to 0.427414 (8280102) 2024-02-19T21:35:13.527 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:13.547 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:35:13.550 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:13.550 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:35:13.651 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:35:13.680 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:13.684 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:12.191951+0000 osd.2 (osd.2) 45 : cluster [DBG] 2.c scrub starts 2024-02-19T21:35:13.685 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:12.195430+0000 osd.2 (osd.2) 46 : cluster [DBG] 2.c scrub ok 2024-02-19T21:35:13.685 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:13.083065+0000 mon.a (mon.0) 776 : audit [INF] from='client.? 172.21.15.80:0/2278469686' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 4, "weight": 0.4274135583093771}]: dispatch 2024-02-19T21:35:13.685 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:12.191951+0000 osd.2 (osd.2) 45 : cluster [DBG] 2.c scrub starts 2024-02-19T21:35:13.685 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:12.195430+0000 osd.2 (osd.2) 46 : cluster [DBG] 2.c scrub ok 2024-02-19T21:35:13.685 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:13.083065+0000 mon.a (mon.0) 776 : audit [INF] from='client.? 172.21.15.80:0/2278469686' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 4, "weight": 0.4274135583093771}]: dispatch 2024-02-19T21:35:13.700 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:35:13.703 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:13.703 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:35:13.804 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:35:13.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:12.191951+0000 osd.2 (osd.2) 45 : cluster [DBG] 2.c scrub starts 2024-02-19T21:35:13.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:12.195430+0000 osd.2 (osd.2) 46 : cluster [DBG] 2.c scrub ok 2024-02-19T21:35:13.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:13.083065+0000 mon.a (mon.0) 776 : audit [INF] from='client.? 172.21.15.80:0/2278469686' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 4, "weight": 0.4274135583093771}]: dispatch 2024-02-19T21:35:13.833 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:13.853 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:35:13.856 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:13.856 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:35:13.957 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:35:13.987 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:14.636 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:35:14.639 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:14.640 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:35:14.740 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:35:14.768 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:14.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:12.796483+0000 mgr.y (mgr.14514) 114 : cluster [DBG] pgmap v99: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 737 B/s rd, 0 op/s 2024-02-19T21:35:14.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:13.236603+0000 osd.2 (osd.2) 47 : cluster [DBG] 5.d scrub starts 2024-02-19T21:35:14.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:13.240156+0000 osd.2 (osd.2) 48 : cluster [DBG] 5.d scrub ok 2024-02-19T21:35:14.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:13.376083+0000 osd.4 (osd.4) 67 : cluster [DBG] 2.f scrub starts 2024-02-19T21:35:14.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:13.377262+0000 osd.4 (osd.4) 68 : cluster [DBG] 2.f scrub ok 2024-02-19T21:35:14.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:13.507220+0000 mon.a (mon.0) 777 : audit [INF] from='client.? 172.21.15.80:0/2278469686' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 4, "weight": 0.4274135583093771}]': finished 2024-02-19T21:35:14.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:13.507280+0000 mon.a (mon.0) 778 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2024-02-19T21:35:14.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:13.586615+0000 osd.5 (osd.5) 61 : cluster [DBG] 4.8 scrub starts 2024-02-19T21:35:14.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:13.590173+0000 osd.5 (osd.5) 62 : cluster [DBG] 4.8 scrub ok 2024-02-19T21:35:14.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:12.796483+0000 mgr.y (mgr.14514) 114 : cluster [DBG] pgmap v99: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 737 B/s rd, 0 op/s 2024-02-19T21:35:14.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:13.236603+0000 osd.2 (osd.2) 47 : cluster [DBG] 5.d scrub starts 2024-02-19T21:35:14.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:13.240156+0000 osd.2 (osd.2) 48 : cluster [DBG] 5.d scrub ok 2024-02-19T21:35:14.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:13.376083+0000 osd.4 (osd.4) 67 : cluster [DBG] 2.f scrub starts 2024-02-19T21:35:14.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:13.377262+0000 osd.4 (osd.4) 68 : cluster [DBG] 2.f scrub ok 2024-02-19T21:35:14.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:13.507220+0000 mon.a (mon.0) 777 : audit [INF] from='client.? 172.21.15.80:0/2278469686' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 4, "weight": 0.4274135583093771}]': finished 2024-02-19T21:35:14.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:13.507280+0000 mon.a (mon.0) 778 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2024-02-19T21:35:14.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:13.586615+0000 osd.5 (osd.5) 61 : cluster [DBG] 4.8 scrub starts 2024-02-19T21:35:14.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:13.590173+0000 osd.5 (osd.5) 62 : cluster [DBG] 4.8 scrub ok 2024-02-19T21:35:14.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:12.796483+0000 mgr.y (mgr.14514) 114 : cluster [DBG] pgmap v99: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 737 B/s rd, 0 op/s 2024-02-19T21:35:14.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:13.236603+0000 osd.2 (osd.2) 47 : cluster [DBG] 5.d scrub starts 2024-02-19T21:35:14.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:13.240156+0000 osd.2 (osd.2) 48 : cluster [DBG] 5.d scrub ok 2024-02-19T21:35:14.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:13.376083+0000 osd.4 (osd.4) 67 : cluster [DBG] 2.f scrub starts 2024-02-19T21:35:14.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:13.377262+0000 osd.4 (osd.4) 68 : cluster [DBG] 2.f scrub ok 2024-02-19T21:35:14.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:13.507220+0000 mon.a (mon.0) 777 : audit [INF] from='client.? 172.21.15.80:0/2278469686' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 4, "weight": 0.4274135583093771}]': finished 2024-02-19T21:35:14.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:13.507280+0000 mon.a (mon.0) 778 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2024-02-19T21:35:14.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:13.586615+0000 osd.5 (osd.5) 61 : cluster [DBG] 4.8 scrub starts 2024-02-19T21:35:14.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:13.590173+0000 osd.5 (osd.5) 62 : cluster [DBG] 4.8 scrub ok 2024-02-19T21:35:14.967 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:35:14.970 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:14.971 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:35:15.071 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:35:15.099 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:15.756 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:14.324564+0000 osd.0 (osd.0) 59 : cluster [DBG] 5.3 scrub starts 2024-02-19T21:35:15.756 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:14.326285+0000 osd.0 (osd.0) 60 : cluster [DBG] 5.3 scrub ok 2024-02-19T21:35:15.756 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:14.508241+0000 mon.a (mon.0) 779 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2024-02-19T21:35:15.756 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:14.514985+0000 osd.7 (osd.7) 59 : cluster [DBG] 6.1c scrub starts 2024-02-19T21:35:15.756 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:14.520345+0000 osd.7 (osd.7) 60 : cluster [DBG] 6.1c scrub ok 2024-02-19T21:35:15.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:14.753609+0000 osd.1 (osd.1) 59 : cluster [DBG] 2.4 scrub starts 2024-02-19T21:35:15.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:14.754471+0000 osd.1 (osd.1) 60 : cluster [DBG] 2.4 scrub ok 2024-02-19T21:35:15.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:14.324564+0000 osd.0 (osd.0) 59 : cluster [DBG] 5.3 scrub starts 2024-02-19T21:35:15.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:14.326285+0000 osd.0 (osd.0) 60 : cluster [DBG] 5.3 scrub ok 2024-02-19T21:35:15.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:14.508241+0000 mon.a (mon.0) 779 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2024-02-19T21:35:15.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:14.514985+0000 osd.7 (osd.7) 59 : cluster [DBG] 6.1c scrub starts 2024-02-19T21:35:15.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:14.520345+0000 osd.7 (osd.7) 60 : cluster [DBG] 6.1c scrub ok 2024-02-19T21:35:15.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:14.753609+0000 osd.1 (osd.1) 59 : cluster [DBG] 2.4 scrub starts 2024-02-19T21:35:15.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:14.754471+0000 osd.1 (osd.1) 60 : cluster [DBG] 2.4 scrub ok 2024-02-19T21:35:15.808 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:35:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:35:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:35:15.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:14.324564+0000 osd.0 (osd.0) 59 : cluster [DBG] 5.3 scrub starts 2024-02-19T21:35:15.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:14.326285+0000 osd.0 (osd.0) 60 : cluster [DBG] 5.3 scrub ok 2024-02-19T21:35:15.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:14.508241+0000 mon.a (mon.0) 779 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2024-02-19T21:35:15.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:14.514985+0000 osd.7 (osd.7) 59 : cluster [DBG] 6.1c scrub starts 2024-02-19T21:35:15.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:14.520345+0000 osd.7 (osd.7) 60 : cluster [DBG] 6.1c scrub ok 2024-02-19T21:35:15.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:14.753609+0000 osd.1 (osd.1) 59 : cluster [DBG] 2.4 scrub starts 2024-02-19T21:35:15.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:14.754471+0000 osd.1 (osd.1) 60 : cluster [DBG] 2.4 scrub ok 2024-02-19T21:35:16.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:14.588079+0000 osd.3 (osd.3) 71 : cluster [DBG] 4.14 scrub starts 2024-02-19T21:35:16.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:14.590044+0000 osd.3 (osd.3) 72 : cluster [DBG] 4.14 scrub ok 2024-02-19T21:35:16.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:14.797388+0000 mgr.y (mgr.14514) 115 : cluster [DBG] pgmap v102: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:35:16.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:15.024390+0000 osd.6 (osd.6) 47 : cluster [DBG] 4.e scrub starts 2024-02-19T21:35:16.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:15.027896+0000 osd.6 (osd.6) 48 : cluster [DBG] 4.e scrub ok 2024-02-19T21:35:16.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:15.408695+0000 osd.4 (osd.4) 69 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:35:16.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:15.411824+0000 osd.4 (osd.4) 70 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:35:16.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:14.588079+0000 osd.3 (osd.3) 71 : cluster [DBG] 4.14 scrub starts 2024-02-19T21:35:16.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:14.590044+0000 osd.3 (osd.3) 72 : cluster [DBG] 4.14 scrub ok 2024-02-19T21:35:16.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:14.797388+0000 mgr.y (mgr.14514) 115 : cluster [DBG] pgmap v102: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:35:16.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:15.024390+0000 osd.6 (osd.6) 47 : cluster [DBG] 4.e scrub starts 2024-02-19T21:35:16.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:15.027896+0000 osd.6 (osd.6) 48 : cluster [DBG] 4.e scrub ok 2024-02-19T21:35:16.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:15.408695+0000 osd.4 (osd.4) 69 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:35:16.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:15.411824+0000 osd.4 (osd.4) 70 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:35:16.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:14.588079+0000 osd.3 (osd.3) 71 : cluster [DBG] 4.14 scrub starts 2024-02-19T21:35:16.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:14.590044+0000 osd.3 (osd.3) 72 : cluster [DBG] 4.14 scrub ok 2024-02-19T21:35:16.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:14.797388+0000 mgr.y (mgr.14514) 115 : cluster [DBG] pgmap v102: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:35:16.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:15.024390+0000 osd.6 (osd.6) 47 : cluster [DBG] 4.e scrub starts 2024-02-19T21:35:16.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:15.027896+0000 osd.6 (osd.6) 48 : cluster [DBG] 4.e scrub ok 2024-02-19T21:35:16.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:15.408695+0000 osd.4 (osd.4) 69 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:35:16.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:15.411824+0000 osd.4 (osd.4) 70 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:35:17.007 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:35:17.007 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:35:17.008 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:35:17.008 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:35:17.008 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:35:17.008 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:35:17.008 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:35:17.008 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:35:17.008 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:35:17.008 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:35:17.008 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:35:17.008 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:35:17.008 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:35:17.009 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:35:17.009 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:35:17.009 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:35:17.249 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:35:17.251 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:17.252 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:35:17.353 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:35:17.386 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:17.408 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:35:17.410 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:17.411 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:35:17.512 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:35:17.544 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:17.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:16.759207+0000 osd.1 (osd.1) 61 : cluster [DBG] 2.d scrub starts 2024-02-19T21:35:17.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:16.760230+0000 osd.1 (osd.1) 62 : cluster [DBG] 2.d scrub ok 2024-02-19T21:35:17.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:16.779421+0000 mon.c (mon.2) 22 : audit [DBG] from='client.? 172.21.15.80:0/3055468051' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:35:17.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:16.759207+0000 osd.1 (osd.1) 61 : cluster [DBG] 2.d scrub starts 2024-02-19T21:35:17.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:16.760230+0000 osd.1 (osd.1) 62 : cluster [DBG] 2.d scrub ok 2024-02-19T21:35:17.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:16.779421+0000 mon.c (mon.2) 22 : audit [DBG] from='client.? 172.21.15.80:0/3055468051' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:35:17.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:16.759207+0000 osd.1 (osd.1) 61 : cluster [DBG] 2.d scrub starts 2024-02-19T21:35:17.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:16.760230+0000 osd.1 (osd.1) 62 : cluster [DBG] 2.d scrub ok 2024-02-19T21:35:17.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:16.779421+0000 mon.c (mon.2) 22 : audit [DBG] from='client.? 172.21.15.80:0/3055468051' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:35:18.636 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'unique_pool_0' created 2024-02-19T21:35:18.655 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:16.589428+0000 osd.3 (osd.3) 73 : cluster [DBG] 6.13 deep-scrub starts 2024-02-19T21:35:18.656 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:16.590427+0000 osd.3 (osd.3) 74 : cluster [DBG] 6.13 deep-scrub ok 2024-02-19T21:35:18.656 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:16.797729+0000 mgr.y (mgr.14514) 116 : cluster [DBG] pgmap v103: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:35:18.656 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:16.959454+0000 osd.0 (osd.0) 61 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:35:18.656 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:16.959503+0000 osd.0 (osd.0) 62 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:35:18.656 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:17.458688+0000 osd.4 (osd.4) 71 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:35:18.656 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:17.461593+0000 osd.4 (osd.4) 72 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:35:18.656 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:17.532855+0000 mon.a (mon.0) 780 : cluster [DBG] osdmap e99: 8 total, 8 up, 8 in 2024-02-19T21:35:18.656 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:16.589428+0000 osd.3 (osd.3) 73 : cluster [DBG] 6.13 deep-scrub starts 2024-02-19T21:35:18.656 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:16.590427+0000 osd.3 (osd.3) 74 : cluster [DBG] 6.13 deep-scrub ok 2024-02-19T21:35:18.656 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:16.797729+0000 mgr.y (mgr.14514) 116 : cluster [DBG] pgmap v103: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:35:18.657 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:16.959454+0000 osd.0 (osd.0) 61 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:35:18.657 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:16.959503+0000 osd.0 (osd.0) 62 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:35:18.657 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:17.458688+0000 osd.4 (osd.4) 71 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:35:18.657 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:17.461593+0000 osd.4 (osd.4) 72 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:35:18.657 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:17.532855+0000 mon.a (mon.0) 780 : cluster [DBG] osdmap e99: 8 total, 8 up, 8 in 2024-02-19T21:35:19.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:16.589428+0000 osd.3 (osd.3) 73 : cluster [DBG] 6.13 deep-scrub starts 2024-02-19T21:35:19.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:16.590427+0000 osd.3 (osd.3) 74 : cluster [DBG] 6.13 deep-scrub ok 2024-02-19T21:35:19.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:16.797729+0000 mgr.y (mgr.14514) 116 : cluster [DBG] pgmap v103: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:35:19.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:16.959454+0000 osd.0 (osd.0) 61 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:35:19.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:16.959503+0000 osd.0 (osd.0) 62 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:35:19.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:17.458688+0000 osd.4 (osd.4) 71 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:35:19.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:17.461593+0000 osd.4 (osd.4) 72 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:35:19.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:17.532855+0000 mon.a (mon.0) 780 : cluster [DBG] osdmap e99: 8 total, 8 up, 8 in 2024-02-19T21:35:19.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:18.276030+0000 osd.2 (osd.2) 49 : cluster [DBG] 2.e scrub starts 2024-02-19T21:35:19.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:18.279064+0000 osd.2 (osd.2) 50 : cluster [DBG] 2.e scrub ok 2024-02-19T21:35:19.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:18.332204+0000 mon.a (mon.0) 781 : audit [INF] from='client.? 172.21.15.80:0/3885681570' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]: dispatch 2024-02-19T21:35:19.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:18.360182+0000 osd.0 (osd.0) 63 : cluster [DBG] 4.3 scrub starts 2024-02-19T21:35:19.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:18.362189+0000 osd.0 (osd.0) 64 : cluster [DBG] 4.3 scrub ok 2024-02-19T21:35:19.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:18.478070+0000 osd.7 (osd.7) 61 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:35:19.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:18.480977+0000 osd.7 (osd.7) 62 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:35:19.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:18.625696+0000 mon.a (mon.0) 782 : audit [INF] from='client.? 172.21.15.80:0/3885681570' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]': finished 2024-02-19T21:35:19.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:18.625773+0000 mon.a (mon.0) 783 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2024-02-19T21:35:19.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:18.707518+0000 osd.1 (osd.1) 63 : cluster [DBG] 6.e scrub starts 2024-02-19T21:35:19.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:18.708526+0000 osd.1 (osd.1) 64 : cluster [DBG] 6.e scrub ok 2024-02-19T21:35:19.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:18.798242+0000 mgr.y (mgr.14514) 117 : cluster [DBG] pgmap v106: 148 pgs: 16 unknown, 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:35:19.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:18.276030+0000 osd.2 (osd.2) 49 : cluster [DBG] 2.e scrub starts 2024-02-19T21:35:19.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:18.279064+0000 osd.2 (osd.2) 50 : cluster [DBG] 2.e scrub ok 2024-02-19T21:35:19.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:18.332204+0000 mon.a (mon.0) 781 : audit [INF] from='client.? 172.21.15.80:0/3885681570' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]: dispatch 2024-02-19T21:35:19.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:18.360182+0000 osd.0 (osd.0) 63 : cluster [DBG] 4.3 scrub starts 2024-02-19T21:35:19.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:18.362189+0000 osd.0 (osd.0) 64 : cluster [DBG] 4.3 scrub ok 2024-02-19T21:35:19.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:18.478070+0000 osd.7 (osd.7) 61 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:35:19.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:18.480977+0000 osd.7 (osd.7) 62 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:35:19.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:18.625696+0000 mon.a (mon.0) 782 : audit [INF] from='client.? 172.21.15.80:0/3885681570' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]': finished 2024-02-19T21:35:19.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:18.625773+0000 mon.a (mon.0) 783 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2024-02-19T21:35:19.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:18.707518+0000 osd.1 (osd.1) 63 : cluster [DBG] 6.e scrub starts 2024-02-19T21:35:19.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:18.708526+0000 osd.1 (osd.1) 64 : cluster [DBG] 6.e scrub ok 2024-02-19T21:35:19.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:18.798242+0000 mgr.y (mgr.14514) 117 : cluster [DBG] pgmap v106: 148 pgs: 16 unknown, 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:35:19.907 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:18.276030+0000 osd.2 (osd.2) 49 : cluster [DBG] 2.e scrub starts 2024-02-19T21:35:19.907 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:18.279064+0000 osd.2 (osd.2) 50 : cluster [DBG] 2.e scrub ok 2024-02-19T21:35:19.907 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:18.332204+0000 mon.a (mon.0) 781 : audit [INF] from='client.? 172.21.15.80:0/3885681570' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]: dispatch 2024-02-19T21:35:19.907 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:18.360182+0000 osd.0 (osd.0) 63 : cluster [DBG] 4.3 scrub starts 2024-02-19T21:35:19.907 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:18.362189+0000 osd.0 (osd.0) 64 : cluster [DBG] 4.3 scrub ok 2024-02-19T21:35:19.907 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:18.478070+0000 osd.7 (osd.7) 61 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:35:19.907 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:18.480977+0000 osd.7 (osd.7) 62 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:35:19.908 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:18.625696+0000 mon.a (mon.0) 782 : audit [INF] from='client.? 172.21.15.80:0/3885681570' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]': finished 2024-02-19T21:35:19.908 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:18.625773+0000 mon.a (mon.0) 783 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2024-02-19T21:35:19.908 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:18.707518+0000 osd.1 (osd.1) 63 : cluster [DBG] 6.e scrub starts 2024-02-19T21:35:19.908 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:18.708526+0000 osd.1 (osd.1) 64 : cluster [DBG] 6.e scrub ok 2024-02-19T21:35:19.908 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:18.798242+0000 mgr.y (mgr.14514) 117 : cluster [DBG] pgmap v106: 148 pgs: 16 unknown, 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:35:20.095 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:35:20.099 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:20.099 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:35:20.120 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-02-19T21:35:20.200 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:35:20.231 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:20.308 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:35:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:35:20.773 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:19.285346+0000 osd.2 (osd.2) 51 : cluster [DBG] 6.f scrub starts 2024-02-19T21:35:20.773 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:19.288524+0000 osd.2 (osd.2) 52 : cluster [DBG] 6.f scrub ok 2024-02-19T21:35:20.773 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:19.568465+0000 osd.3 (osd.3) 75 : cluster [DBG] 6.c deep-scrub starts 2024-02-19T21:35:20.774 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:19.569435+0000 osd.3 (osd.3) 76 : cluster [DBG] 6.c deep-scrub ok 2024-02-19T21:35:20.774 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:19.631565+0000 mon.a (mon.0) 784 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2024-02-19T21:35:20.774 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:19.905725+0000 mgr.y (mgr.14514) 118 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:35:20.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:19.285346+0000 osd.2 (osd.2) 51 : cluster [DBG] 6.f scrub starts 2024-02-19T21:35:20.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:19.288524+0000 osd.2 (osd.2) 52 : cluster [DBG] 6.f scrub ok 2024-02-19T21:35:20.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:19.568465+0000 osd.3 (osd.3) 75 : cluster [DBG] 6.c deep-scrub starts 2024-02-19T21:35:20.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:19.569435+0000 osd.3 (osd.3) 76 : cluster [DBG] 6.c deep-scrub ok 2024-02-19T21:35:20.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:19.631565+0000 mon.a (mon.0) 784 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2024-02-19T21:35:20.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:19.905725+0000 mgr.y (mgr.14514) 118 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:35:21.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:19.285346+0000 osd.2 (osd.2) 51 : cluster [DBG] 6.f scrub starts 2024-02-19T21:35:21.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:19.288524+0000 osd.2 (osd.2) 52 : cluster [DBG] 6.f scrub ok 2024-02-19T21:35:21.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:19.568465+0000 osd.3 (osd.3) 75 : cluster [DBG] 6.c deep-scrub starts 2024-02-19T21:35:21.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:19.569435+0000 osd.3 (osd.3) 76 : cluster [DBG] 6.c deep-scrub ok 2024-02-19T21:35:21.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:19.631565+0000 mon.a (mon.0) 784 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2024-02-19T21:35:21.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:19.905725+0000 mgr.y (mgr.14514) 118 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:35:21.098 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:35:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:35:20] "GET /metrics HTTP/1.1" 200 174576 "" "Prometheus/2.33.4" 2024-02-19T21:35:21.388 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:35:21.391 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:21.391 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:35:21.492 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:35:21.524 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:21.546 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:35:21.548 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:21.549 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:35:21.650 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:35:21.679 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:21.699 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:35:21.701 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:21.701 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:35:21.802 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:35:21.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:20.501911+0000 osd.7 (osd.7) 63 : cluster [DBG] 6.8 scrub starts 2024-02-19T21:35:21.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:20.504799+0000 osd.7 (osd.7) 64 : cluster [DBG] 6.8 scrub ok 2024-02-19T21:35:21.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:20.551856+0000 osd.3 (osd.3) 77 : cluster [DBG] 4.1a scrub starts 2024-02-19T21:35:21.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:20.555570+0000 osd.3 (osd.3) 78 : cluster [DBG] 4.1a scrub ok 2024-02-19T21:35:21.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:20.631150+0000 mon.a (mon.0) 785 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2024-02-19T21:35:21.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:20.730825+0000 osd.1 (osd.1) 65 : cluster [DBG] 2.6 deep-scrub starts 2024-02-19T21:35:21.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:20.731654+0000 osd.1 (osd.1) 66 : cluster [DBG] 2.6 deep-scrub ok 2024-02-19T21:35:21.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:20.798547+0000 mgr.y (mgr.14514) 119 : cluster [DBG] pgmap v109: 148 pgs: 5 creating+activating, 143 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:35:21.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:20.919229+0000 osd.4 (osd.4) 73 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:35:21.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:20.919290+0000 osd.4 (osd.4) 74 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:35:21.830 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:21.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:20.501911+0000 osd.7 (osd.7) 63 : cluster [DBG] 6.8 scrub starts 2024-02-19T21:35:21.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:20.504799+0000 osd.7 (osd.7) 64 : cluster [DBG] 6.8 scrub ok 2024-02-19T21:35:21.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:20.551856+0000 osd.3 (osd.3) 77 : cluster [DBG] 4.1a scrub starts 2024-02-19T21:35:21.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:20.555570+0000 osd.3 (osd.3) 78 : cluster [DBG] 4.1a scrub ok 2024-02-19T21:35:21.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:20.631150+0000 mon.a (mon.0) 785 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2024-02-19T21:35:21.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:20.730825+0000 osd.1 (osd.1) 65 : cluster [DBG] 2.6 deep-scrub starts 2024-02-19T21:35:21.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:20.731654+0000 osd.1 (osd.1) 66 : cluster [DBG] 2.6 deep-scrub ok 2024-02-19T21:35:21.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:20.798547+0000 mgr.y (mgr.14514) 119 : cluster [DBG] pgmap v109: 148 pgs: 5 creating+activating, 143 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:35:21.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:20.919229+0000 osd.4 (osd.4) 73 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:35:21.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:20.919290+0000 osd.4 (osd.4) 74 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:35:21.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:20.501911+0000 osd.7 (osd.7) 63 : cluster [DBG] 6.8 scrub starts 2024-02-19T21:35:21.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:20.504799+0000 osd.7 (osd.7) 64 : cluster [DBG] 6.8 scrub ok 2024-02-19T21:35:21.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:20.551856+0000 osd.3 (osd.3) 77 : cluster [DBG] 4.1a scrub starts 2024-02-19T21:35:21.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:20.555570+0000 osd.3 (osd.3) 78 : cluster [DBG] 4.1a scrub ok 2024-02-19T21:35:21.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:20.631150+0000 mon.a (mon.0) 785 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2024-02-19T21:35:21.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:20.730825+0000 osd.1 (osd.1) 65 : cluster [DBG] 2.6 deep-scrub starts 2024-02-19T21:35:21.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:20.731654+0000 osd.1 (osd.1) 66 : cluster [DBG] 2.6 deep-scrub ok 2024-02-19T21:35:21.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:20.798547+0000 mgr.y (mgr.14514) 119 : cluster [DBG] pgmap v109: 148 pgs: 5 creating+activating, 143 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:35:21.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:20.919229+0000 osd.4 (osd.4) 73 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:35:21.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:20.919290+0000 osd.4 (osd.4) 74 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:35:21.850 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:35:21.852 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:21.852 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:35:21.869 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:35:21.869 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:35:21.953 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:35:21.980 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:21.998 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:35:22.001 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:22.001 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:35:22.102 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:35:22.131 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:22.204 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:35:22.223 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:22.223 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:35:22.324 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:35:22.352 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:22.371 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:35:22.373 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:22.374 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:35:22.474 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:35:22.501 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:22.521 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:35:22.523 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:22.524 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:35:22.624 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:35:22.647 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-02-19T21:35:22.655 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:22.730 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:35:22.733 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:22.733 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:35:22.741 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_blocked_ops 2024-02-19T21:35:22.834 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:35:22.860 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:22.920 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:35:22.920 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:35:22.920 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-02-19T21:35:22.920 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-02-19T21:35:22.920 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-02-19T21:35:22.920 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.1 config set filestore_inject_stall 3 2024-02-19T21:35:22.944 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:21.227943+0000 osd.2 (osd.2) 53 : cluster [DBG] 4.2 scrub starts 2024-02-19T21:35:22.944 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:21.231511+0000 osd.2 (osd.2) 54 : cluster [DBG] 4.2 scrub ok 2024-02-19T21:35:22.945 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:21.634815+0000 mon.a (mon.0) 786 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2024-02-19T21:35:22.945 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:21.712557+0000 osd.1 (osd.1) 67 : cluster [DBG] 2.15 scrub starts 2024-02-19T21:35:22.945 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:21.713359+0000 osd.1 (osd.1) 68 : cluster [DBG] 2.15 scrub ok 2024-02-19T21:35:22.945 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:21.839439+0000 mon.c (mon.2) 23 : audit [INF] from='client.? 172.21.15.80:0/1623793591' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:35:22.945 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:21.839731+0000 mon.a (mon.0) 787 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:35:22.945 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:22.513815+0000 osd.3 (osd.3) 79 : cluster [DBG] 6.11 deep-scrub starts 2024-02-19T21:35:22.945 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:22.516704+0000 osd.3 (osd.3) 80 : cluster [DBG] 6.11 deep-scrub ok 2024-02-19T21:35:22.945 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:21.227943+0000 osd.2 (osd.2) 53 : cluster [DBG] 4.2 scrub starts 2024-02-19T21:35:22.945 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:21.231511+0000 osd.2 (osd.2) 54 : cluster [DBG] 4.2 scrub ok 2024-02-19T21:35:22.945 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:21.634815+0000 mon.a (mon.0) 786 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2024-02-19T21:35:22.945 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:21.712557+0000 osd.1 (osd.1) 67 : cluster [DBG] 2.15 scrub starts 2024-02-19T21:35:22.945 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:21.713359+0000 osd.1 (osd.1) 68 : cluster [DBG] 2.15 scrub ok 2024-02-19T21:35:22.946 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:21.839439+0000 mon.c (mon.2) 23 : audit [INF] from='client.? 172.21.15.80:0/1623793591' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:35:22.946 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:21.839731+0000 mon.a (mon.0) 787 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:35:22.946 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:22.513815+0000 osd.3 (osd.3) 79 : cluster [DBG] 6.11 deep-scrub starts 2024-02-19T21:35:22.946 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:22.516704+0000 osd.3 (osd.3) 80 : cluster [DBG] 6.11 deep-scrub ok 2024-02-19T21:35:22.946 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:35:23.009 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:35:23.012 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:23.013 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:35:23.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:21.227943+0000 osd.2 (osd.2) 53 : cluster [DBG] 4.2 scrub starts 2024-02-19T21:35:23.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:21.231511+0000 osd.2 (osd.2) 54 : cluster [DBG] 4.2 scrub ok 2024-02-19T21:35:23.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:21.634815+0000 mon.a (mon.0) 786 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2024-02-19T21:35:23.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:21.712557+0000 osd.1 (osd.1) 67 : cluster [DBG] 2.15 scrub starts 2024-02-19T21:35:23.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:21.713359+0000 osd.1 (osd.1) 68 : cluster [DBG] 2.15 scrub ok 2024-02-19T21:35:23.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:21.839439+0000 mon.c (mon.2) 23 : audit [INF] from='client.? 172.21.15.80:0/1623793591' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:35:23.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:21.839731+0000 mon.a (mon.0) 787 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:35:23.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:22.513815+0000 osd.3 (osd.3) 79 : cluster [DBG] 6.11 deep-scrub starts 2024-02-19T21:35:23.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:22.516704+0000 osd.3 (osd.3) 80 : cluster [DBG] 6.11 deep-scrub ok 2024-02-19T21:35:23.068 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:35:23.078 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:35:23.114 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:35:23.141 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:23.160 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:35:23.162 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:23.163 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:35:23.264 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:35:23.291 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:23.363 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:35:23.365 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:23.366 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:35:23.466 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:35:23.494 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:23.514 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:35:23.516 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:23.517 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:35:23.618 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:35:23.645 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:23.663 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:35:23.668 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:23.669 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:35:23.769 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:35:23.797 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:23.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:22.633125+0000 mon.a (mon.0) 788 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:35:23.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:22.642130+0000 mon.a (mon.0) 789 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:35:23.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:22.642195+0000 mon.a (mon.0) 790 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2024-02-19T21:35:23.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:22.746421+0000 osd.5 (osd.5) 63 : cluster [DBG] 5.e scrub starts 2024-02-19T21:35:23.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:22.798875+0000 mgr.y (mgr.14514) 120 : cluster [DBG] pgmap v112: 148 pgs: 5 creating+activating, 143 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:35:24.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:22.633125+0000 mon.a (mon.0) 788 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:35:24.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:22.642130+0000 mon.a (mon.0) 789 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:35:24.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:22.642195+0000 mon.a (mon.0) 790 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2024-02-19T21:35:24.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:22.746421+0000 osd.5 (osd.5) 63 : cluster [DBG] 5.e scrub starts 2024-02-19T21:35:24.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:22.798875+0000 mgr.y (mgr.14514) 120 : cluster [DBG] pgmap v112: 148 pgs: 5 creating+activating, 143 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:35:24.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:22.633125+0000 mon.a (mon.0) 788 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:35:24.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:22.642130+0000 mon.a (mon.0) 789 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:35:24.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:22.642195+0000 mon.a (mon.0) 790 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2024-02-19T21:35:24.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:22.746421+0000 osd.5 (osd.5) 63 : cluster [DBG] 5.e scrub starts 2024-02-19T21:35:24.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:22.798875+0000 mgr.y (mgr.14514) 120 : cluster [DBG] pgmap v112: 148 pgs: 5 creating+activating, 143 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:35:24.145 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:35:24.147 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:24.147 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:35:24.248 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:35:24.279 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:24.300 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:35:24.303 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:24.304 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:35:24.405 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:35:24.434 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:25.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:23.196307+0000 osd.2 (osd.2) 55 : cluster [DBG] 5.6 scrub starts 2024-02-19T21:35:25.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:23.196307+0000 osd.2 (osd.2) 55 : cluster [DBG] 5.6 scrub starts 2024-02-19T21:35:25.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:23.196307+0000 osd.2 (osd.2) 55 : cluster [DBG] 5.6 scrub starts 2024-02-19T21:35:25.592 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:35:25.594 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:25.595 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:35:25.695 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:35:25.728 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:25.748 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:35:25.751 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:25.751 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:35:25.852 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:35:25.880 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:24.799393+0000 mgr.y (mgr.14514) 121 : cluster [DBG] pgmap v113: 148 pgs: 148 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-02-19T21:35:25.880 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:35:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:35:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:35:25.882 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:25.902 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:35:25.905 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:25.905 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:35:26.006 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:35:26.036 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:26.056 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:35:26.058 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:26.059 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:35:26.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:24.799393+0000 mgr.y (mgr.14514) 121 : cluster [DBG] pgmap v113: 148 pgs: 148 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-02-19T21:35:26.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:24.799393+0000 mgr.y (mgr.14514) 121 : cluster [DBG] pgmap v113: 148 pgs: 148 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-02-19T21:35:26.142 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-19T21:35:26.159 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:35:26.187 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:26.207 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:35:26.210 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:26.210 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:35:26.311 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:35:26.338 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:26.357 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:35:26.359 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:26.360 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:35:26.461 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:35:26.488 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:26.874 INFO:teuthology.orchestra.run.smithi080.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-02-19T21:35:27.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:26.277037+0000 mon.c (mon.2) 24 : audit [INF] from='client.? 172.21.15.80:0/1226580172' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T21:35:27.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:26.277411+0000 mon.a (mon.0) 791 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T21:35:27.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:26.277037+0000 mon.c (mon.2) 24 : audit [INF] from='client.? 172.21.15.80:0/1226580172' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T21:35:27.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:26.277411+0000 mon.a (mon.0) 791 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T21:35:27.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:26.277037+0000 mon.c (mon.2) 24 : audit [INF] from='client.? 172.21.15.80:0/1226580172' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T21:35:27.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:26.277411+0000 mon.a (mon.0) 791 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T21:35:27.823 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:35:27.824 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:35:27.837 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:35:27.840 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:27.840 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:35:27.873 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:35:27.941 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:35:27.969 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:28.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:26.799735+0000 mgr.y (mgr.14514) 122 : cluster [DBG] pgmap v114: 148 pgs: 148 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 829 B/s rd, 0 op/s 2024-02-19T21:35:28.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:26.868858+0000 mon.a (mon.0) 792 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-19T21:35:28.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:26.868960+0000 mon.a (mon.0) 793 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2024-02-19T21:35:28.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:26.799735+0000 mgr.y (mgr.14514) 122 : cluster [DBG] pgmap v114: 148 pgs: 148 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 829 B/s rd, 0 op/s 2024-02-19T21:35:28.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:26.868858+0000 mon.a (mon.0) 792 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-19T21:35:28.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:26.868960+0000 mon.a (mon.0) 793 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2024-02-19T21:35:28.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:26.799735+0000 mgr.y (mgr.14514) 122 : cluster [DBG] pgmap v114: 148 pgs: 148 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 829 B/s rd, 0 op/s 2024-02-19T21:35:28.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:26.868858+0000 mon.a (mon.0) 792 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-19T21:35:28.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:26.868960+0000 mon.a (mon.0) 793 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2024-02-19T21:35:28.618 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:35:28.621 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:28.621 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:35:28.641 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:35:28.642 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:35:28.722 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:35:28.754 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:28.775 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:35:28.778 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:28.778 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:35:28.779 DEBUG:teuthology.orchestra.run.smithi080:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_0 bench 90 write' 2024-02-19T21:35:28.782 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-02-19T21:35:28.782 INFO:teuthology.orchestra.run:waiting for 3000 2024-02-19T21:35:28.878 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:35:28.908 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:29.157 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:hints = 1 2024-02-19T21:35:29.157 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-02-19T21:35:29.157 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Object prefix: benchmark_data_smithi080_79222 2024-02-19T21:35:29.157 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-19T21:35:29.157 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 0 0 0 0 0 0 - 0 2024-02-19T21:35:29.357 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:35:29.366 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:29.366 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:35:29.467 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:35:29.517 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:29.824 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_historic_ops 2024-02-19T21:35:30.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:28.800166+0000 mgr.y (mgr.14514) 123 : cluster [DBG] pgmap v116: 148 pgs: 148 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 714 B/s rd, 0 op/s 2024-02-19T21:35:30.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:28.800166+0000 mgr.y (mgr.14514) 123 : cluster [DBG] pgmap v116: 148 pgs: 148 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 714 B/s rd, 0 op/s 2024-02-19T21:35:30.157 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 1 16 3180 3164 197.738 197.75 0.00651266 0.00501793 2024-02-19T21:35:30.285 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:35:30.288 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:30.289 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:35:30.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:28.800166+0000 mgr.y (mgr.14514) 123 : cluster [DBG] pgmap v116: 148 pgs: 148 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 714 B/s rd, 0 op/s 2024-02-19T21:35:30.308 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:35:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:35:30.390 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:35:30.423 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:30.448 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:35:30.452 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:30.452 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:35:30.553 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:35:30.588 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:30.611 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:35:30.613 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:30.614 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:35:30.715 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:35:30.766 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:30.797 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:35:30.800 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:30.801 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:35:30.902 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:35:30.936 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:30.960 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:35:30.963 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:30.964 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:35:31.027 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:29.915505+0000 mgr.y (mgr.14514) 124 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:35:31.027 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:35:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:35:30] "GET /metrics HTTP/1.1" 200 174576 "" "Prometheus/2.33.4" 2024-02-19T21:35:31.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:29.915505+0000 mgr.y (mgr.14514) 124 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:35:31.064 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:35:31.097 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:31.124 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:35:31.126 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:31.126 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:35:31.158 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 2 16 6098 6082 189.993 182.375 0.00762348 0.00525477 2024-02-19T21:35:31.227 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:35:31.287 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:31.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:29.915505+0000 mgr.y (mgr.14514) 124 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:35:32.158 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 3 16 9070 9054 188.556 185.75 0.00359619 0.00529287 2024-02-19T21:35:32.250 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:35:32.256 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:32.257 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:35:32.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:30.801153+0000 mgr.y (mgr.14514) 125 : cluster [DBG] pgmap v117: 148 pgs: 148 active+clean; 132 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 16 MiB/s wr, 260 op/s 2024-02-19T21:35:32.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:30.801153+0000 mgr.y (mgr.14514) 125 : cluster [DBG] pgmap v117: 148 pgs: 148 active+clean; 132 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 16 MiB/s wr, 260 op/s 2024-02-19T21:35:32.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:30.801153+0000 mgr.y (mgr.14514) 125 : cluster [DBG] pgmap v117: 148 pgs: 148 active+clean; 132 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 16 MiB/s wr, 260 op/s 2024-02-19T21:35:32.358 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:35:32.389 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:32.414 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:35:32.416 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:32.416 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:35:32.517 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:35:32.563 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:32.672 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:35:32.679 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:32.679 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:35:32.780 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:35:32.831 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:33.158 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 4 16 11724 11708 182.884 165.875 0.00576229 0.00546038 2024-02-19T21:35:33.192 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:35:33.197 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:33.197 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:35:33.298 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:35:33.346 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:33.504 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:35:33.508 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:33.508 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:35:33.609 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:35:33.656 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:33.922 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:35:33.928 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:33.929 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:35:34.030 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:35:34.065 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:34.091 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:35:34.095 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:34.095 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:35:34.159 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 5 16 14108 14092 176.095 149 0.00578824 0.00567177 2024-02-19T21:35:34.196 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:35:34.254 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:32.801786+0000 mgr.y (mgr.14514) 126 : cluster [DBG] pgmap v118: 148 pgs: 148 active+clean; 132 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 13 MiB/s wr, 212 op/s 2024-02-19T21:35:34.254 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:32.801786+0000 mgr.y (mgr.14514) 126 : cluster [DBG] pgmap v118: 148 pgs: 148 active+clean; 132 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 13 MiB/s wr, 212 op/s 2024-02-19T21:35:34.257 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:34.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:32.801786+0000 mgr.y (mgr.14514) 126 : cluster [DBG] pgmap v118: 148 pgs: 148 active+clean; 132 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 13 MiB/s wr, 212 op/s 2024-02-19T21:35:34.327 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:35:34.327 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:35:34.362 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:35:34.402 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:35:34.437 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:35:34.473 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:35:34.474 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:35:34.482 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:34.483 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:35:34.510 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:35:34.544 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:35:34.545 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:35:34.559 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:35:34.559 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:35:34.559 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:35:34.559 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:35:34.559 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:35:34.559 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:35:34.559 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:35:34.560 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:35:34.584 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:35:34.637 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:34.904 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:35:34.910 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:34.910 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:35:34.969 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-02-19T21:35:35.011 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:35:35.059 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:35.159 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 6 16 16095 16079 167.443 124.188 0.00398629 0.00596612 2024-02-19T21:35:35.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:33.926912+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:35:35.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:34.256272+0000 mon.b (mon.1) 33 : audit [DBG] from='client.? 172.21.15.80:0/731978064' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:35:35.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:34.723375+0000 mon.c (mon.2) 25 : audit [INF] from='client.? 172.21.15.80:0/4121823379' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:35:35.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:34.723824+0000 mon.a (mon.0) 795 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:35:35.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:33.926912+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:35:35.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:34.256272+0000 mon.b (mon.1) 33 : audit [DBG] from='client.? 172.21.15.80:0/731978064' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:35:35.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:34.723375+0000 mon.c (mon.2) 25 : audit [INF] from='client.? 172.21.15.80:0/4121823379' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:35:35.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:34.723824+0000 mon.a (mon.0) 795 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:35:35.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:33.926912+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:35:35.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:34.256272+0000 mon.b (mon.1) 33 : audit [DBG] from='client.? 172.21.15.80:0/731978064' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:35:35.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:34.723375+0000 mon.c (mon.2) 25 : audit [INF] from='client.? 172.21.15.80:0/4121823379' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:35:35.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:34.723824+0000 mon.a (mon.0) 795 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:35:35.717 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:35:35.722 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:35.723 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:35:35.824 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:35:35.889 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:35.938 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:35:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:35:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:35:36.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:34.802626+0000 mgr.y (mgr.14514) 127 : cluster [DBG] pgmap v119: 148 pgs: 148 active+clean; 951 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 95 MiB/s wr, 1.52k op/s 2024-02-19T21:35:36.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:34.928417+0000 mon.a (mon.0) 796 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:35:36.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:34.946442+0000 mon.a (mon.0) 797 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:35:36.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:34.946500+0000 mon.a (mon.0) 798 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2024-02-19T21:35:36.029 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:34.802626+0000 mgr.y (mgr.14514) 127 : cluster [DBG] pgmap v119: 148 pgs: 148 active+clean; 951 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 95 MiB/s wr, 1.52k op/s 2024-02-19T21:35:36.029 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:34.928417+0000 mon.a (mon.0) 796 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:35:36.029 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:34.946442+0000 mon.a (mon.0) 797 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:35:36.029 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:34.946500+0000 mon.a (mon.0) 798 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2024-02-19T21:35:36.159 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 7 15 18332 18317 163.504 139.875 0.011335 0.00610977 2024-02-19T21:35:36.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:34.802626+0000 mgr.y (mgr.14514) 127 : cluster [DBG] pgmap v119: 148 pgs: 148 active+clean; 951 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 95 MiB/s wr, 1.52k op/s 2024-02-19T21:35:36.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:34.928417+0000 mon.a (mon.0) 796 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:35:36.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:34.946442+0000 mon.a (mon.0) 797 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:35:36.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:34.946500+0000 mon.a (mon.0) 798 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2024-02-19T21:35:36.651 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:35:36.655 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:36.656 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:35:36.757 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:35:36.813 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:36.958 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:35:36.968 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:36.968 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:35:37.069 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:35:37.103 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:37.129 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:35:37.133 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:37.134 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:35:37.160 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 8 16 20520 20504 160.134 136.688 0.00642224 0.0062396 2024-02-19T21:35:37.234 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:35:37.290 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:37.340 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:35:37.347 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:37.347 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:35:37.448 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:35:37.483 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:37.510 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:35:37.513 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:37.513 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:35:37.614 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:35:37.648 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:37.675 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:35:37.677 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:37.678 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:35:37.766 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:35:37.766 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2024-02-19T21:35:37.766 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:35:37.778 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:35:37.813 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:37.840 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:35:37.843 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:37.844 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:35:37.944 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:35:37.994 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:38.109 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:35:38.117 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:38.118 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:35:38.160 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 9 16 22691 22675 157.417 135.688 0.0089518 0.00634794 2024-02-19T21:35:38.218 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:35:38.252 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:36.803024+0000 mgr.y (mgr.14514) 128 : cluster [DBG] pgmap v121: 148 pgs: 148 active+clean; 951 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 1.0 KiB/s rd, 96 MiB/s wr, 1.53k op/s 2024-02-19T21:35:38.254 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:38.284 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:35:38.287 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:38.288 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:35:38.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:36.803024+0000 mgr.y (mgr.14514) 128 : cluster [DBG] pgmap v121: 148 pgs: 148 active+clean; 951 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 1.0 KiB/s rd, 96 MiB/s wr, 1.53k op/s 2024-02-19T21:35:38.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:36.803024+0000 mgr.y (mgr.14514) 128 : cluster [DBG] pgmap v121: 148 pgs: 148 active+clean; 951 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 1.0 KiB/s rd, 96 MiB/s wr, 1.53k op/s 2024-02-19T21:35:38.389 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:35:38.442 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:39.013 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:35:39.017 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:39.018 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:35:39.120 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:35:39.154 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:39.160 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 10 16 24803 24787 154.875 132 0.00643258 0.00645125 2024-02-19T21:35:39.179 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:35:39.182 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:39.183 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:35:39.284 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:35:39.318 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:39.343 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:35:39.346 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:39.346 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:35:39.373 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:35:39.448 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:35:39.480 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:39.505 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:35:39.509 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:39.509 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:35:39.610 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:35:39.678 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:39.954 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:38.803923+0000 mgr.y (mgr.14514) 129 : cluster [DBG] pgmap v122: 148 pgs: 148 active+clean; 951 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 95 MiB/s wr, 1.52k op/s 2024-02-19T21:35:39.954 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:38.803923+0000 mgr.y (mgr.14514) 129 : cluster [DBG] pgmap v122: 148 pgs: 148 active+clean; 951 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 95 MiB/s wr, 1.52k op/s 2024-02-19T21:35:40.160 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 11 16 26713 26697 151.647 119.375 0.00862067 0.00658895 2024-02-19T21:35:40.308 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:35:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:35:40.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:38.803923+0000 mgr.y (mgr.14514) 129 : cluster [DBG] pgmap v122: 148 pgs: 148 active+clean; 951 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 95 MiB/s wr, 1.52k op/s 2024-02-19T21:35:40.749 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:35:40.755 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:40.755 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:35:40.856 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:35:40.887 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:40.916 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:35:40.919 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:40.920 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:35:40.966 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:39.926276+0000 mgr.y (mgr.14514) 130 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:35:40.967 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:40.210365+0000 osd.2 (osd.2) 56 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:35:40.967 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:40.210420+0000 osd.2 (osd.2) 57 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:35:40.967 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:35:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:35:40] "GET /metrics HTTP/1.1" 200 174899 "" "Prometheus/2.33.4" 2024-02-19T21:35:41.020 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:35:41.044 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:39.926276+0000 mgr.y (mgr.14514) 130 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:35:41.044 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:40.210365+0000 osd.2 (osd.2) 56 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:35:41.044 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:40.210420+0000 osd.2 (osd.2) 57 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:35:41.046 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:41.160 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 12 16 28549 28533 148.57 114.75 0.0109048 0.00672553 2024-02-19T21:35:41.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:39.926276+0000 mgr.y (mgr.14514) 130 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:35:41.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:40.210365+0000 osd.2 (osd.2) 56 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:35:41.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:40.210420+0000 osd.2 (osd.2) 57 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:35:41.999 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:35:42.006 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:42.006 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:35:42.107 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:35:42.161 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 13 16 30468 30452 146.361 119.938 0.00598052 0.00682672 2024-02-19T21:35:42.171 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:42.287 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:35:42.292 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:42.293 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:40.804847+0000 mgr.y (mgr.14514) 131 : cluster [DBG] pgmap v123: 148 pgs: 148 active+clean; 1.6 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 1023 B/s rd, 149 MiB/s wr, 2.38k op/s 2024-02-19T21:35:42.293 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:40.966309+0000 mon.a (mon.0) 799 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2024-02-19T21:35:42.293 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:35:42.295 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:40.804847+0000 mgr.y (mgr.14514) 131 : cluster [DBG] pgmap v123: 148 pgs: 148 active+clean; 1.6 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 1023 B/s rd, 149 MiB/s wr, 2.38k op/s 2024-02-19T21:35:42.295 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:40.966309+0000 mon.a (mon.0) 799 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2024-02-19T21:35:42.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:40.804847+0000 mgr.y (mgr.14514) 131 : cluster [DBG] pgmap v123: 148 pgs: 148 active+clean; 1.6 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 1023 B/s rd, 149 MiB/s wr, 2.38k op/s 2024-02-19T21:35:42.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:40.966309+0000 mon.a (mon.0) 799 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2024-02-19T21:35:42.394 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:35:42.454 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:42.472 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:35:42.482 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:35:42.482 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-02-19T21:35:42.482 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-02-19T21:35:42.482 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-02-19T21:35:42.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.482 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.14793.0:26355 7.e e106/100 7:76389257:::benchmark_data_smithi080_79222_object26354:head v 106'1605, mlcod=106'1603)", 2024-02-19T21:35:42.482 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:39.959411+0000", 2024-02-19T21:35:42.482 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 2.5059279500000002, 2024-02-19T21:35:42.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.030243796, 2024-02-19T21:35:42.483 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:35:42.483 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:35:42.483 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:35:42.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.483 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:35:42.483 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.959411+0000", 2024-02-19T21:35:42.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:35:42.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.483 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:35:42.483 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.959411+0000", 2024-02-19T21:35:42.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:35:42.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.484 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:35:42.484 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.959410+0000", 2024-02-19T21:35:42.484 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2033999999999999e-05 2024-02-19T21:35:42.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.484 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:35:42.484 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.959432+0000", 2024-02-19T21:35:42.484 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0915e-05 2024-02-19T21:35:42.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.484 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:35:42.484 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.959443+0000", 2024-02-19T21:35:42.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.631e-06 2024-02-19T21:35:42.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:35:42.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.959449+0000", 2024-02-19T21:35:42.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0020393759999999999 2024-02-19T21:35:42.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:35:42.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.961488+0000", 2024-02-19T21:35:42.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8870999999999999e-05 2024-02-19T21:35:42.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:35:42.486 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.961507+0000", 2024-02-19T21:35:42.486 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.028106448999999999 2024-02-19T21:35:42.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.486 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:35:42.486 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.989614+0000", 2024-02-19T21:35:42.486 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1326999999999999e-05 2024-02-19T21:35:42.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.486 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:35:42.487 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.989655+0000", 2024-02-19T21:35:42.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.030243796 2024-02-19T21:35:42.487 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.487 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:35:42.488 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.488 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:26360 7.4 7:263f3097:::benchmark_data_smithi080_79222_object26359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e106)", 2024-02-19T21:35:42.488 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:39.959898+0000", 2024-02-19T21:35:42.488 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 2.505441319, 2024-02-19T21:35:42.489 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.030057298, 2024-02-19T21:35:42.489 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:35:42.489 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:35:42.489 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:35:42.489 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:35:42.489 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:35:42.489 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 26360 2024-02-19T21:35:42.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.490 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:35:42.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.490 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:35:42.490 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.959898+0000", 2024-02-19T21:35:42.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:35:42.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.491 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:35:42.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.959898+0000", 2024-02-19T21:35:42.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:35:42.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.492 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:35:42.492 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.959897+0000", 2024-02-19T21:35:42.492 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9534999999999998e-05 2024-02-19T21:35:42.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.492 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:35:42.493 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.959916+0000", 2024-02-19T21:35:42.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0059e-05 2024-02-19T21:35:42.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.493 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:35:42.493 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.959926+0000", 2024-02-19T21:35:42.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7250000000000002e-06 2024-02-19T21:35:42.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:35:42.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.959932+0000", 2024-02-19T21:35:42.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034824399999999999 2024-02-19T21:35:42.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:35:42.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.960280+0000", 2024-02-19T21:35:42.495 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112037 2024-02-19T21:35:42.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.495 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:35:42.495 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.960392+0000", 2024-02-19T21:35:42.495 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013822699999999999 2024-02-19T21:35:42.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.496 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,4", 2024-02-19T21:35:42.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.960530+0000", 2024-02-19T21:35:42.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022271700000000001 2024-02-19T21:35:42.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:35:42.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.962758+0000", 2024-02-19T21:35:42.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.026932174 2024-02-19T21:35:42.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.498 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:35:42.498 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.989690+0000", 2024-02-19T21:35:42.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000178116 2024-02-19T21:35:42.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.498 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:35:42.498 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.989868+0000", 2024-02-19T21:35:42.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7494999999999998e-05 2024-02-19T21:35:42.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.499 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:35:42.499 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.989915+0000", 2024-02-19T21:35:42.499 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9530000000000003e-05 2024-02-19T21:35:42.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.499 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:35:42.499 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.989955+0000", 2024-02-19T21:35:42.500 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.030057298 2024-02-19T21:35:42.500 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.500 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:35:42.500 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.500 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.14793.0:26359 7.7 e106/100 7:edbf15d6:::benchmark_data_smithi080_79222_object26358:head v 106'1655, mlcod=106'1651)", 2024-02-19T21:35:42.500 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:39.960024+0000", 2024-02-19T21:35:42.501 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 2.5053151319999998, 2024-02-19T21:35:42.501 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.031252954999999999, 2024-02-19T21:35:42.501 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:35:42.501 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:35:42.501 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:35:42.501 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.501 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:35:42.501 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.960024+0000", 2024-02-19T21:35:42.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:35:42.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.502 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:35:42.502 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.960024+0000", 2024-02-19T21:35:42.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:35:42.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.503 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:35:42.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.960024+0000", 2024-02-19T21:35:42.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010577 2024-02-19T21:35:42.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.503 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:35:42.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.960129+0000", 2024-02-19T21:35:42.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.204e-06 2024-02-19T21:35:42.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.504 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:35:42.504 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.960137+0000", 2024-02-19T21:35:42.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0149999999999997e-06 2024-02-19T21:35:42.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.504 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:35:42.504 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.960141+0000", 2024-02-19T21:35:42.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00086561199999999998 2024-02-19T21:35:42.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:35:42.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.961006+0000", 2024-02-19T21:35:42.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4504e-05 2024-02-19T21:35:42.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:35:42.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.961021+0000", 2024-02-19T21:35:42.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.030216966000000001 2024-02-19T21:35:42.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:35:42.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.991238+0000", 2024-02-19T21:35:42.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9168000000000002e-05 2024-02-19T21:35:42.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:35:42.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.991277+0000", 2024-02-19T21:35:42.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.031252954999999999 2024-02-19T21:35:42.507 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.507 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:35:42.507 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.508 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.14793.0:26361 7.d e106/100 7:b33fed14:::benchmark_data_smithi080_79222_object26360:head v 106'1609, mlcod=106'1607)", 2024-02-19T21:35:42.508 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:39.960160+0000", 2024-02-19T21:35:42.508 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 2.5051792530000001, 2024-02-19T21:35:42.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.029668006, 2024-02-19T21:35:42.508 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:35:42.508 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:35:42.508 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:35:42.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:35:42.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.960160+0000", 2024-02-19T21:35:42.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:35:42.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:35:42.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.960160+0000", 2024-02-19T21:35:42.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:35:42.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:35:42.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.960159+0000", 2024-02-19T21:35:42.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000114362 2024-02-19T21:35:42.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:35:42.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.960274+0000", 2024-02-19T21:35:42.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3829999999999998e-06 2024-02-19T21:35:42.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:35:42.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.960283+0000", 2024-02-19T21:35:42.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9640000000000002e-06 2024-02-19T21:35:42.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:35:42.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.960288+0000", 2024-02-19T21:35:42.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3529999999999997e-05 2024-02-19T21:35:42.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:35:42.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.960341+0000", 2024-02-19T21:35:42.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8915000000000001e-05 2024-02-19T21:35:42.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:35:42.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.960360+0000", 2024-02-19T21:35:42.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039024419999999999 2024-02-19T21:35:42.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:35:42.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.964263+0000", 2024-02-19T21:35:42.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025564883 2024-02-19T21:35:42.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:35:42.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.989828+0000", 2024-02-19T21:35:42.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.029668006 2024-02-19T21:35:42.512 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.512 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:35:42.513 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.513 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:26368 7.f 7:fbac2556:::benchmark_data_smithi080_79222_object26367:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e106)", 2024-02-19T21:35:42.513 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:39.962742+0000", 2024-02-19T21:35:42.513 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 2.5025969369999999, 2024-02-19T21:35:42.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.033025394, 2024-02-19T21:35:42.513 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:35:42.513 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:35:42.513 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:35:42.513 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:35:42.513 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:35:42.513 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 26368 2024-02-19T21:35:42.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.513 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:35:42.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:35:42.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.962742+0000", 2024-02-19T21:35:42.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:35:42.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:35:42.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.962742+0000", 2024-02-19T21:35:42.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:35:42.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:35:42.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.962740+0000", 2024-02-19T21:35:42.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2946e-05 2024-02-19T21:35:42.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:35:42.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.962763+0000", 2024-02-19T21:35:42.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1205e-05 2024-02-19T21:35:42.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:35:42.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.962774+0000", 2024-02-19T21:35:42.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3199999999999996e-06 2024-02-19T21:35:42.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:35:42.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.962781+0000", 2024-02-19T21:35:42.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.026798389999999998 2024-02-19T21:35:42.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:35:42.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.989579+0000", 2024-02-19T21:35:42.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125523 2024-02-19T21:35:42.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:35:42.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.989705+0000", 2024-02-19T21:35:42.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040109 2024-02-19T21:35:42.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:35:42.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.990106+0000", 2024-02-19T21:35:42.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00139751 2024-02-19T21:35:42.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:35:42.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.991503+0000", 2024-02-19T21:35:42.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010473539999999999 2024-02-19T21:35:42.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:35:42.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.992551+0000", 2024-02-19T21:35:42.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031430009999999999 2024-02-19T21:35:42.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:35:42.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.995694+0000", 2024-02-19T21:35:42.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0669e-05 2024-02-19T21:35:42.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:35:42.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.995734+0000", 2024-02-19T21:35:42.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3087999999999999e-05 2024-02-19T21:35:42.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:35:42.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.995767+0000", 2024-02-19T21:35:42.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.033025394 2024-02-19T21:35:42.518 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.519 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:35:42.519 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.519 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:26371 7.6 7:62a2548d:::benchmark_data_smithi080_79222_object26370:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e106)", 2024-02-19T21:35:42.519 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:39.964169+0000", 2024-02-19T21:35:42.519 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 2.5011699709999999, 2024-02-19T21:35:42.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.031202009999999999, 2024-02-19T21:35:42.519 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:35:42.519 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:35:42.519 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:35:42.519 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:35:42.519 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:35:42.519 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 26371 2024-02-19T21:35:42.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.520 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:35:42.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:35:42.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.964169+0000", 2024-02-19T21:35:42.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:35:42.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:35:42.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.964169+0000", 2024-02-19T21:35:42.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:35:42.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:35:42.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.964168+0000", 2024-02-19T21:35:42.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8587e-05 2024-02-19T21:35:42.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:35:42.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.964187+0000", 2024-02-19T21:35:42.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025780319999999999 2024-02-19T21:35:42.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:35:42.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.989967+0000", 2024-02-19T21:35:42.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5369999999999997e-06 2024-02-19T21:35:42.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:35:42.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.989976+0000", 2024-02-19T21:35:42.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0704000000000002e-05 2024-02-19T21:35:42.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:35:42.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.990016+0000", 2024-02-19T21:35:42.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013092299999999999 2024-02-19T21:35:42.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:35:42.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.990147+0000", 2024-02-19T21:35:42.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013590999999999999 2024-02-19T21:35:42.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:35:42.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.990283+0000", 2024-02-19T21:35:42.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001469541 2024-02-19T21:35:42.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:35:42.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.991753+0000", 2024-02-19T21:35:42.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00078544900000000002 2024-02-19T21:35:42.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:35:42.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.992538+0000", 2024-02-19T21:35:42.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002743962 2024-02-19T21:35:42.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:35:42.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.995282+0000", 2024-02-19T21:35:42.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0692999999999997e-05 2024-02-19T21:35:42.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:35:42.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.995333+0000", 2024-02-19T21:35:42.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8229000000000003e-05 2024-02-19T21:35:42.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:35:42.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.995371+0000", 2024-02-19T21:35:42.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.031202009999999999 2024-02-19T21:35:42.525 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.525 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:35:42.525 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.525 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop_reply(client.14793.0:26360 7.4 e106/100 ondisk, result = 0)", 2024-02-19T21:35:42.525 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:39.965034+0000", 2024-02-19T21:35:42.525 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 2.5003052750000001, 2024-02-19T21:35:42.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024925577000000001, 2024-02-19T21:35:42.525 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:35:42.526 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:35:42.526 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:35:42.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:35:42.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.965034+0000", 2024-02-19T21:35:42.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:35:42.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:35:42.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.965034+0000", 2024-02-19T21:35:42.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:35:42.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:35:42.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.965033+0000", 2024-02-19T21:35:42.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.665e-06 2024-02-19T21:35:42.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:35:42.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.965039+0000", 2024-02-19T21:35:42.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024734657 2024-02-19T21:35:42.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:35:42.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.989773+0000", 2024-02-19T21:35:42.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3570000000000004e-06 2024-02-19T21:35:42.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:35:42.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.989783+0000", 2024-02-19T21:35:42.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0055999999999995e-05 2024-02-19T21:35:42.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:35:42.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.989853+0000", 2024-02-19T21:35:42.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8760000000000005e-06 2024-02-19T21:35:42.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:35:42.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.989861+0000", 2024-02-19T21:35:42.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8686999999999999e-05 2024-02-19T21:35:42.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:35:42.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.989959+0000", 2024-02-19T21:35:42.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024925577000000001 2024-02-19T21:35:42.529 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.529 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:35:42.529 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.529 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:26377 7.f 7:fed576f9:::benchmark_data_smithi080_79222_object26376:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e106)", 2024-02-19T21:35:42.529 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:39.992857+0000", 2024-02-19T21:35:42.529 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 2.4724818580000001, 2024-02-19T21:35:42.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024326679, 2024-02-19T21:35:42.529 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:35:42.529 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:35:42.529 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:35:42.530 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:35:42.530 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:35:42.530 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 26377 2024-02-19T21:35:42.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.530 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:35:42.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:35:42.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.992857+0000", 2024-02-19T21:35:42.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:35:42.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:35:42.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.992857+0000", 2024-02-19T21:35:42.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:35:42.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:35:42.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.992855+0000", 2024-02-19T21:35:42.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1217999999999999e-05 2024-02-19T21:35:42.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:35:42.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.992877+0000", 2024-02-19T21:35:42.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1286e-05 2024-02-19T21:35:42.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:35:42.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.992888+0000", 2024-02-19T21:35:42.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8239999999999996e-06 2024-02-19T21:35:42.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:35:42.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.992894+0000", 2024-02-19T21:35:42.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000227712 2024-02-19T21:35:42.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:35:42.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.993122+0000", 2024-02-19T21:35:42.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121045 2024-02-19T21:35:42.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:35:42.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.993243+0000", 2024-02-19T21:35:42.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015104199999999999 2024-02-19T21:35:42.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:35:42.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.993394+0000", 2024-02-19T21:35:42.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036572639999999999 2024-02-19T21:35:42.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:35:42.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.997051+0000", 2024-02-19T21:35:42.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020030286000000001 2024-02-19T21:35:42.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:35:42.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:40.017081+0000", 2024-02-19T21:35:42.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4319999999999999e-06 2024-02-19T21:35:42.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:35:42.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:40.017090+0000", 2024-02-19T21:35:42.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4379999999999998e-05 2024-02-19T21:35:42.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:35:42.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:40.017144+0000", 2024-02-19T21:35:42.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9839000000000003e-05 2024-02-19T21:35:42.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:35:42.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:40.017184+0000", 2024-02-19T21:35:42.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024326679 2024-02-19T21:35:42.535 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.535 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:35:42.535 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.535 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:26381 7.6 7:65fcf908:::benchmark_data_smithi080_79222_object26380:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e106)", 2024-02-19T21:35:42.535 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:39.993165+0000", 2024-02-19T21:35:42.535 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 2.472174055, 2024-02-19T21:35:42.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024254293999999999, 2024-02-19T21:35:42.535 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:35:42.535 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:35:42.535 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:35:42.535 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:35:42.535 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:35:42.535 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 26381 2024-02-19T21:35:42.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.536 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:35:42.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:35:42.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.993165+0000", 2024-02-19T21:35:42.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:35:42.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:35:42.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.993165+0000", 2024-02-19T21:35:42.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:35:42.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:35:42.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.993164+0000", 2024-02-19T21:35:42.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7110000000000001e-05 2024-02-19T21:35:42.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:35:42.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.993182+0000", 2024-02-19T21:35:42.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6229999999999999e-06 2024-02-19T21:35:42.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:35:42.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.993188+0000", 2024-02-19T21:35:42.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8670000000000004e-06 2024-02-19T21:35:42.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:35:42.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.993192+0000", 2024-02-19T21:35:42.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022044830000000001 2024-02-19T21:35:42.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:35:42.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.995397+0000", 2024-02-19T21:35:42.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011891 2024-02-19T21:35:42.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:35:42.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.995515+0000", 2024-02-19T21:35:42.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000145752 2024-02-19T21:35:42.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:35:42.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.995661+0000", 2024-02-19T21:35:42.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021468638000000002 2024-02-19T21:35:42.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:35:42.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:40.017130+0000", 2024-02-19T21:35:42.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5620000000000001e-05 2024-02-19T21:35:42.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:35:42.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:40.017165+0000", 2024-02-19T21:35:42.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000182998 2024-02-19T21:35:42.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:35:42.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:40.017348+0000", 2024-02-19T21:35:42.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8773000000000003e-05 2024-02-19T21:35:42.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:35:42.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:40.017387+0000", 2024-02-19T21:35:42.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2024999999999999e-05 2024-02-19T21:35:42.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:35:42.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:40.017419+0000", 2024-02-19T21:35:42.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024254293999999999 2024-02-19T21:35:42.540 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.540 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:35:42.541 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.541 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:26387 7.f 7:fc2dfc65:::benchmark_data_smithi080_79222_object26386:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e106)", 2024-02-19T21:35:42.541 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:39.996109+0000", 2024-02-19T21:35:42.541 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 2.4692295770000001, 2024-02-19T21:35:42.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.028079722000000001, 2024-02-19T21:35:42.541 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:35:42.541 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:35:42.541 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:35:42.541 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:35:42.541 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:35:42.541 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 26387 2024-02-19T21:35:42.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.542 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:35:42.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:35:42.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.996109+0000", 2024-02-19T21:35:42.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:35:42.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:35:42.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.996109+0000", 2024-02-19T21:35:42.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:35:42.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:35:42.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.996108+0000", 2024-02-19T21:35:42.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1250000000000002e-05 2024-02-19T21:35:42.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:35:42.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.996130+0000", 2024-02-19T21:35:42.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.102e-05 2024-02-19T21:35:42.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:35:42.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.996141+0000", 2024-02-19T21:35:42.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6620000000000002e-06 2024-02-19T21:35:42.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:35:42.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.996146+0000", 2024-02-19T21:35:42.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021324968 2024-02-19T21:35:42.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:35:42.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:40.017471+0000", 2024-02-19T21:35:42.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013201200000000001 2024-02-19T21:35:42.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:35:42.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:40.017603+0000", 2024-02-19T21:35:42.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000168954 2024-02-19T21:35:42.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:35:42.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:40.017772+0000", 2024-02-19T21:35:42.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040960559999999998 2024-02-19T21:35:42.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:35:42.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:40.021868+0000", 2024-02-19T21:35:42.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4357e-05 2024-02-19T21:35:42.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:35:42.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:40.021883+0000", 2024-02-19T21:35:42.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002197849 2024-02-19T21:35:42.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:35:42.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:40.024080+0000", 2024-02-19T21:35:42.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8208999999999997e-05 2024-02-19T21:35:42.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:35:42.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:40.024149+0000", 2024-02-19T21:35:42.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0537000000000002e-05 2024-02-19T21:35:42.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:35:42.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:40.024189+0000", 2024-02-19T21:35:42.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.028079722000000001 2024-02-19T21:35:42.546 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.546 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:35:42.546 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.547 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.14793.0:26388 7.7 e106/100 7:e8ed91de:::benchmark_data_smithi080_79222_object26387:head v 106'1657, mlcod=106'1655)", 2024-02-19T21:35:42.547 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:39.996627+0000", 2024-02-19T21:35:42.547 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 2.4687121579999998, 2024-02-19T21:35:42.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025235647999999999, 2024-02-19T21:35:42.547 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:35:42.547 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:35:42.547 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:35:42.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:35:42.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.996627+0000", 2024-02-19T21:35:42.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:35:42.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:35:42.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.996627+0000", 2024-02-19T21:35:42.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:35:42.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:35:42.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.996626+0000", 2024-02-19T21:35:42.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023902600000000001 2024-02-19T21:35:42.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:35:42.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.996865+0000", 2024-02-19T21:35:42.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3490000000000003e-06 2024-02-19T21:35:42.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:35:42.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.996873+0000", 2024-02-19T21:35:42.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3919999999999996e-06 2024-02-19T21:35:42.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:35:42.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.996877+0000", 2024-02-19T21:35:42.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019550000000000001 2024-02-19T21:35:42.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:35:42.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:39.997072+0000", 2024-02-19T21:35:42.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019942683999999999 2024-02-19T21:35:42.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:35:42.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:40.017015+0000", 2024-02-19T21:35:42.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0048253819999999996 2024-02-19T21:35:42.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:35:42.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:40.021840+0000", 2024-02-19T21:35:42.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1994999999999999e-05 2024-02-19T21:35:42.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:35:42.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:40.021862+0000", 2024-02-19T21:35:42.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025235647999999999 2024-02-19T21:35:42.550 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.550 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:35:42.551 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.551 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.14793.0:28357 7.7 e107/100 7:e6d67b87:::benchmark_data_smithi080_79222_object28356:head v 107'1778, mlcod=107'1775)", 2024-02-19T21:35:42.551 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:41.011656+0000", 2024-02-19T21:35:42.551 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.4536832390000001, 2024-02-19T21:35:42.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.066072080000000005, 2024-02-19T21:35:42.551 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:35:42.551 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:35:42.551 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:35:42.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:35:42.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.011656+0000", 2024-02-19T21:35:42.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:35:42.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:35:42.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.011656+0000", 2024-02-19T21:35:42.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:35:42.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:35:42.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.011655+0000", 2024-02-19T21:35:42.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8175999999999999e-05 2024-02-19T21:35:42.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:35:42.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.011683+0000", 2024-02-19T21:35:42.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8209999999999997e-06 2024-02-19T21:35:42.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:35:42.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.011693+0000", 2024-02-19T21:35:42.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.468e-06 2024-02-19T21:35:42.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:35:42.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.011699+0000", 2024-02-19T21:35:42.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019787519999999999 2024-02-19T21:35:42.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:35:42.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.013677+0000", 2024-02-19T21:35:42.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9199e-05 2024-02-19T21:35:42.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:35:42.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.013697+0000", 2024-02-19T21:35:42.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.063992858 2024-02-19T21:35:42.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:35:42.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.077689+0000", 2024-02-19T21:35:42.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8451999999999997e-05 2024-02-19T21:35:42.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:35:42.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.077728+0000", 2024-02-19T21:35:42.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.066072080000000005 2024-02-19T21:35:42.555 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.555 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:35:42.555 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.555 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:28358 7.6 7:62c4b301:::benchmark_data_smithi080_79222_object28357:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-19T21:35:42.555 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:41.013494+0000", 2024-02-19T21:35:42.555 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.4518451889999999, 2024-02-19T21:35:42.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.067900700999999994, 2024-02-19T21:35:42.555 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:35:42.555 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:35:42.555 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:35:42.555 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:35:42.555 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:35:42.555 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 28358 2024-02-19T21:35:42.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.556 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:35:42.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:35:42.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.013494+0000", 2024-02-19T21:35:42.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:35:42.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:35:42.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.013494+0000", 2024-02-19T21:35:42.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:35:42.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:35:42.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.013492+0000", 2024-02-19T21:35:42.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5541000000000002e-05 2024-02-19T21:35:42.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:35:42.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.013518+0000", 2024-02-19T21:35:42.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0369e-05 2024-02-19T21:35:42.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:35:42.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.013528+0000", 2024-02-19T21:35:42.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3589999999999996e-06 2024-02-19T21:35:42.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:35:42.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.013535+0000", 2024-02-19T21:35:42.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9306e-05 2024-02-19T21:35:42.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:35:42.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.013564+0000", 2024-02-19T21:35:42.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104353 2024-02-19T21:35:42.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:35:42.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.013668+0000", 2024-02-19T21:35:42.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117321 2024-02-19T21:35:42.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:35:42.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.013786+0000", 2024-02-19T21:35:42.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001247901 2024-02-19T21:35:42.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:35:42.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015033+0000", 2024-02-19T21:35:42.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010704099999999999 2024-02-19T21:35:42.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:35:42.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015141+0000", 2024-02-19T21:35:42.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.066151082999999999 2024-02-19T21:35:42.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:35:42.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.081292+0000", 2024-02-19T21:35:42.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2419000000000001e-05 2024-02-19T21:35:42.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:35:42.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.081344+0000", 2024-02-19T21:35:42.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0457999999999997e-05 2024-02-19T21:35:42.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:35:42.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.081394+0000", 2024-02-19T21:35:42.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.067900700999999994 2024-02-19T21:35:42.560 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.560 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:35:42.561 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.561 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:28363 7.f 7:fa662df9:::benchmark_data_smithi080_79222_object28362:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-19T21:35:42.561 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:41.015704+0000", 2024-02-19T21:35:42.561 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.449635062, 2024-02-19T21:35:42.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.065919781999999996, 2024-02-19T21:35:42.561 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:35:42.561 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:35:42.561 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:35:42.561 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:35:42.561 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:35:42.561 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 28363 2024-02-19T21:35:42.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.562 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:35:42.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:35:42.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015704+0000", 2024-02-19T21:35:42.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:35:42.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:35:42.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015704+0000", 2024-02-19T21:35:42.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:35:42.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:35:42.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015702+0000", 2024-02-19T21:35:42.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3244999999999999e-05 2024-02-19T21:35:42.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:35:42.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015726+0000", 2024-02-19T21:35:42.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1303e-05 2024-02-19T21:35:42.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:35:42.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015737+0000", 2024-02-19T21:35:42.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.122e-06 2024-02-19T21:35:42.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:35:42.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015743+0000", 2024-02-19T21:35:42.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.062013323000000002 2024-02-19T21:35:42.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:35:42.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.077756+0000", 2024-02-19T21:35:42.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000126735 2024-02-19T21:35:42.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:35:42.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.077883+0000", 2024-02-19T21:35:42.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000176964 2024-02-19T21:35:42.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:35:42.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.078060+0000", 2024-02-19T21:35:42.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028742989999999999 2024-02-19T21:35:42.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:35:42.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.080934+0000", 2024-02-19T21:35:42.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00048814099999999999 2024-02-19T21:35:42.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:35:42.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.081423+0000", 2024-02-19T21:35:42.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012581499999999999 2024-02-19T21:35:42.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:35:42.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.081548+0000", 2024-02-19T21:35:42.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0614000000000001e-05 2024-02-19T21:35:42.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:35:42.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.081589+0000", 2024-02-19T21:35:42.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4700000000000003e-05 2024-02-19T21:35:42.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:35:42.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.081624+0000", 2024-02-19T21:35:42.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.065919781999999996 2024-02-19T21:35:42.566 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.566 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:35:42.566 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.567 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:28365 7.6 7:6630916d:::benchmark_data_smithi080_79222_object28364:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-19T21:35:42.567 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:41.015763+0000", 2024-02-19T21:35:42.567 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.4495757229999999, 2024-02-19T21:35:42.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.067336030000000005, 2024-02-19T21:35:42.567 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:35:42.567 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:35:42.567 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:35:42.567 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:35:42.567 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:35:42.567 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 28365 2024-02-19T21:35:42.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.567 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:35:42.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:35:42.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015763+0000", 2024-02-19T21:35:42.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:35:42.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:35:42.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015763+0000", 2024-02-19T21:35:42.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:35:42.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:35:42.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015763+0000", 2024-02-19T21:35:42.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8924e-05 2024-02-19T21:35:42.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:35:42.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015782+0000", 2024-02-19T21:35:42.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1609999999999997e-06 2024-02-19T21:35:42.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:35:42.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015789+0000", 2024-02-19T21:35:42.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2010000000000001e-06 2024-02-19T21:35:42.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:35:42.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015793+0000", 2024-02-19T21:35:42.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9889000000000001e-05 2024-02-19T21:35:42.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:35:42.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015823+0000", 2024-02-19T21:35:42.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010322700000000001 2024-02-19T21:35:42.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:35:42.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015926+0000", 2024-02-19T21:35:42.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014153899999999999 2024-02-19T21:35:42.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:35:42.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016068+0000", 2024-02-19T21:35:42.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.065189599000000001 2024-02-19T21:35:42.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:35:42.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.081257+0000", 2024-02-19T21:35:42.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020753500000000001 2024-02-19T21:35:42.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:35:42.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.081465+0000", 2024-02-19T21:35:42.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001541564 2024-02-19T21:35:42.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:35:42.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.083006+0000", 2024-02-19T21:35:42.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4091000000000001e-05 2024-02-19T21:35:42.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:35:42.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.083060+0000", 2024-02-19T21:35:42.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8958000000000002e-05 2024-02-19T21:35:42.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:35:42.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.083099+0000", 2024-02-19T21:35:42.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.067336030000000005 2024-02-19T21:35:42.572 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.572 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:35:42.572 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.573 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:28367 7.4 7:236c3c8b:::benchmark_data_smithi080_79222_object28366:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-19T21:35:42.573 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:41.015801+0000", 2024-02-19T21:35:42.573 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.4495378620000001, 2024-02-19T21:35:42.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.065338538000000002, 2024-02-19T21:35:42.573 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:35:42.573 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:35:42.573 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:35:42.573 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:35:42.573 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:35:42.573 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 28367 2024-02-19T21:35:42.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.573 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:35:42.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:35:42.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015801+0000", 2024-02-19T21:35:42.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:35:42.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:35:42.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015801+0000", 2024-02-19T21:35:42.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:35:42.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:35:42.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015801+0000", 2024-02-19T21:35:42.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8814999999999999e-05 2024-02-19T21:35:42.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:35:42.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015819+0000", 2024-02-19T21:35:42.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2670000000000003e-06 2024-02-19T21:35:42.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:35:42.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015826+0000", 2024-02-19T21:35:42.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.284e-06 2024-02-19T21:35:42.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:35:42.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015830+0000", 2024-02-19T21:35:42.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0560000000000002e-05 2024-02-19T21:35:42.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:35:42.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015901+0000", 2024-02-19T21:35:42.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000105497 2024-02-19T21:35:42.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:35:42.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016006+0000", 2024-02-19T21:35:42.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000141726 2024-02-19T21:35:42.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,4", 2024-02-19T21:35:42.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016148+0000", 2024-02-19T21:35:42.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.061939556 2024-02-19T21:35:42.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:35:42.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.078087+0000", 2024-02-19T21:35:42.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7703999999999997e-05 2024-02-19T21:35:42.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:35:42.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.078125+0000", 2024-02-19T21:35:42.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029155520000000001 2024-02-19T21:35:42.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:35:42.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.081041+0000", 2024-02-19T21:35:42.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7815000000000001e-05 2024-02-19T21:35:42.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:35:42.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.081098+0000", 2024-02-19T21:35:42.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.125e-05 2024-02-19T21:35:42.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:35:42.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.081140+0000", 2024-02-19T21:35:42.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.065338538000000002 2024-02-19T21:35:42.578 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.578 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:35:42.578 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.578 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.14793.0:28366 7.7 e107/100 7:ee863d9d:::benchmark_data_smithi080_79222_object28365:head v 107'1779, mlcod=107'1776)", 2024-02-19T21:35:42.578 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:41.015868+0000", 2024-02-19T21:35:42.579 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.449471414, 2024-02-19T21:35:42.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.065673013000000002, 2024-02-19T21:35:42.579 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:35:42.579 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:35:42.579 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:35:42.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:35:42.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015868+0000", 2024-02-19T21:35:42.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:35:42.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:35:42.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015868+0000", 2024-02-19T21:35:42.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:35:42.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:35:42.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015867+0000", 2024-02-19T21:35:42.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000100413 2024-02-19T21:35:42.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:35:42.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015967+0000", 2024-02-19T21:35:42.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8049999999999996e-06 2024-02-19T21:35:42.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:35:42.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015976+0000", 2024-02-19T21:35:42.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2150000000000003e-06 2024-02-19T21:35:42.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:35:42.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015980+0000", 2024-02-19T21:35:42.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.060693186000000003 2024-02-19T21:35:42.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:35:42.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.076674+0000", 2024-02-19T21:35:42.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3781000000000002e-05 2024-02-19T21:35:42.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:35:42.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.076697+0000", 2024-02-19T21:35:42.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0048209669999999998 2024-02-19T21:35:42.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:35:42.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.081518+0000", 2024-02-19T21:35:42.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2218999999999999e-05 2024-02-19T21:35:42.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:35:42.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.081541+0000", 2024-02-19T21:35:42.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.065673013000000002 2024-02-19T21:35:42.582 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.582 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:35:42.582 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.583 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:28370 7.6 7:6388ec67:::benchmark_data_smithi080_79222_object28369:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-19T21:35:42.583 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:41.016156+0000", 2024-02-19T21:35:42.583 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.449183238, 2024-02-19T21:35:42.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.067016632000000007, 2024-02-19T21:35:42.583 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:35:42.583 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:35:42.583 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:35:42.583 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:35:42.583 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:35:42.583 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 28370 2024-02-19T21:35:42.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.583 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:35:42.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:35:42.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016156+0000", 2024-02-19T21:35:42.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:35:42.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:35:42.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016156+0000", 2024-02-19T21:35:42.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:35:42.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:35:42.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016155+0000", 2024-02-19T21:35:42.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3410000000000001e-05 2024-02-19T21:35:42.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:35:42.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016178+0000", 2024-02-19T21:35:42.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1056999999999999e-05 2024-02-19T21:35:42.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:35:42.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016189+0000", 2024-02-19T21:35:42.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9619999999999998e-06 2024-02-19T21:35:42.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:35:42.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016195+0000", 2024-02-19T21:35:42.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.059865475000000001 2024-02-19T21:35:42.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:35:42.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.076061+0000", 2024-02-19T21:35:42.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019724799999999999 2024-02-19T21:35:42.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:35:42.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.076258+0000", 2024-02-19T21:35:42.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020447600000000001 2024-02-19T21:35:42.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:35:42.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.076462+0000", 2024-02-19T21:35:42.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049709050000000003 2024-02-19T21:35:42.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:35:42.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.081433+0000", 2024-02-19T21:35:42.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6152e-05 2024-02-19T21:35:42.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:35:42.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.081499+0000", 2024-02-19T21:35:42.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016086500000000001 2024-02-19T21:35:42.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:35:42.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.083108+0000", 2024-02-19T21:35:42.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5012999999999998e-05 2024-02-19T21:35:42.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:35:42.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.083143+0000", 2024-02-19T21:35:42.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9247999999999998e-05 2024-02-19T21:35:42.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:35:42.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.083172+0000", 2024-02-19T21:35:42.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.067016632000000007 2024-02-19T21:35:42.588 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.588 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:35:42.588 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.588 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:28372 7.4 7:2ea6f35b:::benchmark_data_smithi080_79222_object28371:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-19T21:35:42.589 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:41.018007+0000", 2024-02-19T21:35:42.589 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.447331538, 2024-02-19T21:35:42.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.063796414999999995, 2024-02-19T21:35:42.589 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:35:42.589 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:35:42.589 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:35:42.589 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:35:42.589 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:35:42.589 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 28372 2024-02-19T21:35:42.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.589 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:35:42.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:35:42.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.018007+0000", 2024-02-19T21:35:42.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:35:42.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:35:42.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.018007+0000", 2024-02-19T21:35:42.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:35:42.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:35:42.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.018006+0000", 2024-02-19T21:35:42.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6315000000000001e-05 2024-02-19T21:35:42.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:35:42.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.018032+0000", 2024-02-19T21:35:42.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.058027699000000002 2024-02-19T21:35:42.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:35:42.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.076060+0000", 2024-02-19T21:35:42.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2943e-05 2024-02-19T21:35:42.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:35:42.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.076083+0000", 2024-02-19T21:35:42.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010376499999999999 2024-02-19T21:35:42.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:35:42.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.076187+0000", 2024-02-19T21:35:42.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012881899999999999 2024-02-19T21:35:42.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:35:42.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.076315+0000", 2024-02-19T21:35:42.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015368700000000001 2024-02-19T21:35:42.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,4", 2024-02-19T21:35:42.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.076469+0000", 2024-02-19T21:35:42.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029700389999999998 2024-02-19T21:35:42.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:35:42.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.079439+0000", 2024-02-19T21:35:42.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001878911 2024-02-19T21:35:42.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:35:42.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.081318+0000", 2024-02-19T21:35:42.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040342900000000002 2024-02-19T21:35:42.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:35:42.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.081721+0000", 2024-02-19T21:35:42.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6137999999999998e-05 2024-02-19T21:35:42.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:35:42.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.081768+0000", 2024-02-19T21:35:42.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6334999999999997e-05 2024-02-19T21:35:42.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:35:42.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.081804+0000", 2024-02-19T21:35:42.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.063796414999999995 2024-02-19T21:35:42.594 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.594 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:35:42.594 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.594 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop_reply(client.14793.0:28365 7.6 e107/100 ondisk, result = 0)", 2024-02-19T21:35:42.594 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:41.018342+0000", 2024-02-19T21:35:42.594 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.4469972840000001, 2024-02-19T21:35:42.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.062917307000000006, 2024-02-19T21:35:42.595 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:35:42.595 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:35:42.595 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:35:42.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:35:42.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.018342+0000", 2024-02-19T21:35:42.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:35:42.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:35:42.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.018342+0000", 2024-02-19T21:35:42.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:35:42.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:35:42.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.018341+0000", 2024-02-19T21:35:42.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9169999999999999e-06 2024-02-19T21:35:42.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:35:42.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.018345+0000", 2024-02-19T21:35:42.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.057756014000000001 2024-02-19T21:35:42.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:35:42.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.076101+0000", 2024-02-19T21:35:42.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0719e-05 2024-02-19T21:35:42.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:35:42.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.076112+0000", 2024-02-19T21:35:42.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0051300690000000001 2024-02-19T21:35:42.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:35:42.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.081242+0000", 2024-02-19T21:35:42.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4910000000000002e-06 2024-02-19T21:35:42.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:35:42.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.081248+0000", 2024-02-19T21:35:42.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0706999999999999e-05 2024-02-19T21:35:42.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:35:42.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:35:42.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:35:42.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.081259+0000", 2024-02-19T21:35:42.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.062917307000000006 2024-02-19T21:35:42.598 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.598 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:35:42.598 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.598 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:35:42.598 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:35:42.598 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:35:42.599 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:42.600 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:35:42.600 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:35:42.700 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:35:42.750 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:42.761 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset noscrub 2024-02-19T21:35:42.779 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:35:42.782 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:42.783 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:35:42.884 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:35:42.948 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:42.997 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:42.463200+0000 osd.1 (osd.1) 69 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:35:42.997 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:42.463242+0000 osd.1 (osd.1) 70 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:35:43.162 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 14 16 32024 32008 142.844 97.25 0.00562477 0.00699433 2024-02-19T21:35:43.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:42.463200+0000 osd.1 (osd.1) 69 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:35:43.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:42.463242+0000 osd.1 (osd.1) 70 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:35:43.342 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:42.463200+0000 osd.1 (osd.1) 69 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:35:43.342 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:42.463242+0000 osd.1 (osd.1) 70 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:35:43.375 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.1 dump_ops_in_flight 2024-02-19T21:35:43.716 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:35:43.718 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:43.718 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:35:43.819 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:35:43.870 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:43.920 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:35:43.923 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:43.924 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:35:44.024 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:35:44.035 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:35:44.035 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:35:44.036 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-02-19T21:35:44.036 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-02-19T21:35:44.036 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-02-19T21:35:44.036 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 config set filestore_inject_stall 3 2024-02-19T21:35:44.061 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:44.087 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:35:44.090 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:44.090 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:35:44.162 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 15 16 33623 33607 139.983 99.9375 0.00750018 0.00713893 2024-02-19T21:35:44.191 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:35:44.225 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:44.251 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:35:44.253 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:42.805400+0000 mgr.y (mgr.14514) 132 : cluster [DBG] pgmap v125: 148 pgs: 148 active+clean; 1.6 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 639 B/s rd, 84 MiB/s wr, 1.34k op/s 2024-02-19T21:35:44.254 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:42.994633+0000 mon.a (mon.0) 800 : cluster [DBG] osdmap e108: 8 total, 8 up, 8 in 2024-02-19T21:35:44.254 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:44.255 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:35:44.319 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:35:44.333 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:35:44.353 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:42.805400+0000 mgr.y (mgr.14514) 132 : cluster [DBG] pgmap v125: 148 pgs: 148 active+clean; 1.6 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 639 B/s rd, 84 MiB/s wr, 1.34k op/s 2024-02-19T21:35:44.353 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:42.994633+0000 mon.a (mon.0) 800 : cluster [DBG] osdmap e108: 8 total, 8 up, 8 in 2024-02-19T21:35:44.353 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:42.805400+0000 mgr.y (mgr.14514) 132 : cluster [DBG] pgmap v125: 148 pgs: 148 active+clean; 1.6 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 639 B/s rd, 84 MiB/s wr, 1.34k op/s 2024-02-19T21:35:44.353 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:42.994633+0000 mon.a (mon.0) 800 : cluster [DBG] osdmap e108: 8 total, 8 up, 8 in 2024-02-19T21:35:44.355 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:35:44.385 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:44.409 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:35:44.412 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:44.413 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:35:44.514 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:35:44.550 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:44.579 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:35:44.584 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:44.585 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:35:44.686 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:35:44.720 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:44.745 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:35:44.748 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:44.749 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:35:44.849 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:35:44.896 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:45.101 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:35:45.104 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:45.105 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:35:45.162 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 16 16 35085 35069 136.945 91.375 0.00750434 0.00729467 2024-02-19T21:35:45.206 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:35:45.243 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:45.267 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:35:45.270 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:45.270 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:35:45.371 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:35:45.406 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:45.430 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:35:45.433 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:45.433 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:35:45.534 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:35:45.597 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:46.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:44.806216+0000 mgr.y (mgr.14514) 133 : cluster [DBG] pgmap v127: 148 pgs: 148 active+clean; 2.1 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 151 MiB/s wr, 2.42k op/s 2024-02-19T21:35:46.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:44.867269+0000 mon.a (mon.0) 801 : cluster [DBG] osdmap e109: 8 total, 8 up, 8 in 2024-02-19T21:35:46.058 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:35:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:35:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:35:46.162 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 17 16 36737 36721 134.963 103.25 0.0116999 0.00740378 2024-02-19T21:35:46.182 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:35:46.215 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:35:46.254 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:35:46.295 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:35:46.333 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:35:46.354 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:44.806216+0000 mgr.y (mgr.14514) 133 : cluster [DBG] pgmap v127: 148 pgs: 148 active+clean; 2.1 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 151 MiB/s wr, 2.42k op/s 2024-02-19T21:35:46.354 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:44.867269+0000 mon.a (mon.0) 801 : cluster [DBG] osdmap e109: 8 total, 8 up, 8 in 2024-02-19T21:35:46.354 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:44.806216+0000 mgr.y (mgr.14514) 133 : cluster [DBG] pgmap v127: 148 pgs: 148 active+clean; 2.1 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 151 MiB/s wr, 2.42k op/s 2024-02-19T21:35:46.354 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:44.867269+0000 mon.a (mon.0) 801 : cluster [DBG] osdmap e109: 8 total, 8 up, 8 in 2024-02-19T21:35:46.372 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:35:46.410 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:35:46.442 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:35:46.444 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:35:46.444 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:35:46.444 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:35:46.444 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:35:46.444 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:35:46.444 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:35:46.444 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:35:46.444 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:35:46.465 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:35:46.469 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:46.470 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:35:46.571 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:35:46.609 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:46.631 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:35:46.633 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:46.634 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:35:46.734 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:35:46.794 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:47.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:46.150235+0000 mon.b (mon.1) 34 : audit [DBG] from='client.? 172.21.15.80:0/117249425' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:35:47.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:46.150235+0000 mon.b (mon.1) 34 : audit [DBG] from='client.? 172.21.15.80:0/117249425' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:35:47.163 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 18 16 38267 38251 132.773 95.625 0.007115 0.00752623 2024-02-19T21:35:47.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:46.150235+0000 mon.b (mon.1) 34 : audit [DBG] from='client.? 172.21.15.80:0/117249425' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:35:47.551 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:35:47.555 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:47.556 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:35:47.657 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:35:47.706 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:48.079 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:35:48.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:46.806572+0000 mgr.y (mgr.14514) 134 : cluster [DBG] pgmap v129: 148 pgs: 148 active+clean; 2.1 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 90 MiB/s wr, 1.44k op/s 2024-02-19T21:35:48.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:46.806572+0000 mgr.y (mgr.14514) 134 : cluster [DBG] pgmap v129: 148 pgs: 148 active+clean; 2.1 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 90 MiB/s wr, 1.44k op/s 2024-02-19T21:35:48.163 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 19 16 39900 39884 131.157 102.062 0.00837098 0.00761972 2024-02-19T21:35:48.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:46.806572+0000 mgr.y (mgr.14514) 134 : cluster [DBG] pgmap v129: 148 pgs: 148 active+clean; 2.1 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 90 MiB/s wr, 1.44k op/s 2024-02-19T21:35:49.074 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:35:49.078 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:49.079 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:35:49.163 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:2024-02-19T21:35:49.162811+0000 min lat: 0.00133551 max lat: 0.105691 avg lat: 0.0077235 2024-02-19T21:35:49.163 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-19T21:35:49.164 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 20 16 41431 41415 129.383 95.6875 0.0234215 0.0077235 2024-02-19T21:35:49.180 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:35:49.211 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:49.214 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:35:49.214 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:35:49.235 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:35:49.240 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:49.240 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:35:49.341 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:35:49.404 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:49.468 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:35:49.476 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:49.477 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:35:49.577 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:35:49.636 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:50.036 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.1 dump_blocked_ops 2024-02-19T21:35:50.163 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 21 16 42966 42950 127.79 95.9375 0.00626325 0.00781994 2024-02-19T21:35:50.308 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:35:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:35:50.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:48.806947+0000 mgr.y (mgr.14514) 135 : cluster [DBG] pgmap v130: 148 pgs: 148 active+clean; 2.1 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 653 B/s rd, 69 MiB/s wr, 1.10k op/s 2024-02-19T21:35:50.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:49.867221+0000 mon.a (mon.0) 802 : cluster [DBG] osdmap e110: 8 total, 8 up, 8 in 2024-02-19T21:35:50.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:48.806947+0000 mgr.y (mgr.14514) 135 : cluster [DBG] pgmap v130: 148 pgs: 148 active+clean; 2.1 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 653 B/s rd, 69 MiB/s wr, 1.10k op/s 2024-02-19T21:35:50.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:49.867221+0000 mon.a (mon.0) 802 : cluster [DBG] osdmap e110: 8 total, 8 up, 8 in 2024-02-19T21:35:50.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:48.806947+0000 mgr.y (mgr.14514) 135 : cluster [DBG] pgmap v130: 148 pgs: 148 active+clean; 2.1 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 653 B/s rd, 69 MiB/s wr, 1.10k op/s 2024-02-19T21:35:50.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:49.867221+0000 mon.a (mon.0) 802 : cluster [DBG] osdmap e110: 8 total, 8 up, 8 in 2024-02-19T21:35:50.507 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:35:50.512 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:50.513 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:35:50.614 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:35:50.630 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:35:50.677 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:50.775 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:35:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:35:50] "GET /metrics HTTP/1.1" 200 175226 "" "Prometheus/2.33.4" 2024-02-19T21:35:51.080 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:49.936505+0000 mgr.y (mgr.14514) 136 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:35:51.081 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:49.936505+0000 mgr.y (mgr.14514) 136 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:35:51.164 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 22 16 44345 44329 125.894 86.1875 0.00432135 0.00793839 2024-02-19T21:35:51.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:49.936505+0000 mgr.y (mgr.14514) 136 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:35:51.877 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:35:51.883 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:51.884 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:35:51.985 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:35:52.061 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:52.164 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 23 16 45652 45636 123.972 81.6875 0.00584645 0.00806099 2024-02-19T21:35:52.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:50.807904+0000 mgr.y (mgr.14514) 137 : cluster [DBG] pgmap v132: 148 pgs: 148 active+clean; 2.6 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.3 KiB/s rd, 131 MiB/s wr, 2.10k op/s 2024-02-19T21:35:52.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:51.492480+0000 mon.a (mon.0) 803 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:35:52.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:50.807904+0000 mgr.y (mgr.14514) 137 : cluster [DBG] pgmap v132: 148 pgs: 148 active+clean; 2.6 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.3 KiB/s rd, 131 MiB/s wr, 2.10k op/s 2024-02-19T21:35:52.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:51.492480+0000 mon.a (mon.0) 803 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:35:52.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:50.807904+0000 mgr.y (mgr.14514) 137 : cluster [DBG] pgmap v132: 148 pgs: 148 active+clean; 2.6 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.3 KiB/s rd, 131 MiB/s wr, 2.10k op/s 2024-02-19T21:35:52.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:51.492480+0000 mon.a (mon.0) 803 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:35:52.725 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:35:52.737 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:52.738 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:35:52.838 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:35:52.871 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:52.899 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:35:52.903 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:52.904 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:35:52.930 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:52.042396+0000 mon.a (mon.0) 804 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:35:52.931 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:52.047224+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:35:52.931 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:52.054994+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:35:52.931 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:52.231355+0000 mon.a (mon.0) 807 : audit [INF] from='client.? 172.21.15.80:0/1822795958' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:35:53.004 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:35:53.055 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:53.081 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:35:53.088 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:53.088 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:35:53.102 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-02-19T21:35:53.165 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 24 16 47080 47064 122.525 89.25 0.00790255 0.00815682 2024-02-19T21:35:53.189 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:35:53.218 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:52.042396+0000 mon.a (mon.0) 804 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:35:53.218 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:52.047224+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:35:53.218 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:52.054994+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:35:53.219 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:52.231355+0000 mon.a (mon.0) 807 : audit [INF] from='client.? 172.21.15.80:0/1822795958' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:35:53.221 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:53.243 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:35:53.246 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:53.246 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:35:53.347 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:35:53.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:52.042396+0000 mon.a (mon.0) 804 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:35:53.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:52.047224+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:35:53.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:52.054994+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:35:53.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:52.231355+0000 mon.a (mon.0) 807 : audit [INF] from='client.? 172.21.15.80:0/1822795958' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:35:53.403 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:53.499 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:35:53.508 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:53.509 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:35:53.610 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:35:53.640 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:53.666 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:35:53.666 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2024-02-19T21:35:53.666 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:35:53.667 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:35:53.671 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:53.671 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:35:53.772 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:35:53.806 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:53.834 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:35:53.837 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:53.838 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:35:53.918 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:35:53.939 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:35:53.990 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:54.165 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 25 16 48438 48422 121.017 84.875 0.00868324 0.0082583 2024-02-19T21:35:54.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:52.808341+0000 mgr.y (mgr.14514) 138 : cluster [DBG] pgmap v133: 148 pgs: 148 active+clean; 2.6 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 61 MiB/s wr, 974 op/s 2024-02-19T21:35:54.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:53.053794+0000 mon.a (mon.0) 808 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:35:54.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:53.069899+0000 mon.a (mon.0) 809 : audit [INF] from='client.? 172.21.15.80:0/1822795958' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:35:54.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:53.069965+0000 mon.a (mon.0) 810 : cluster [DBG] osdmap e111: 8 total, 8 up, 8 in 2024-02-19T21:35:54.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:53.652374+0000 osd.5 (osd.5) 64 : cluster [DBG] 5.e scrub starts 2024-02-19T21:35:54.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:53.660109+0000 osd.5 (osd.5) 65 : cluster [DBG] 5.e scrub ok 2024-02-19T21:35:54.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:52.808341+0000 mgr.y (mgr.14514) 138 : cluster [DBG] pgmap v133: 148 pgs: 148 active+clean; 2.6 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 61 MiB/s wr, 974 op/s 2024-02-19T21:35:54.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:53.053794+0000 mon.a (mon.0) 808 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:35:54.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:53.069899+0000 mon.a (mon.0) 809 : audit [INF] from='client.? 172.21.15.80:0/1822795958' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:35:54.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:53.069965+0000 mon.a (mon.0) 810 : cluster [DBG] osdmap e111: 8 total, 8 up, 8 in 2024-02-19T21:35:54.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:53.652374+0000 osd.5 (osd.5) 64 : cluster [DBG] 5.e scrub starts 2024-02-19T21:35:54.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:53.660109+0000 osd.5 (osd.5) 65 : cluster [DBG] 5.e scrub ok 2024-02-19T21:35:54.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:52.808341+0000 mgr.y (mgr.14514) 138 : cluster [DBG] pgmap v133: 148 pgs: 148 active+clean; 2.6 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 639 B/s rd, 61 MiB/s wr, 974 op/s 2024-02-19T21:35:54.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:53.053794+0000 mon.a (mon.0) 808 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:35:54.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:53.069899+0000 mon.a (mon.0) 809 : audit [INF] from='client.? 172.21.15.80:0/1822795958' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:35:54.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:53.069965+0000 mon.a (mon.0) 810 : cluster [DBG] osdmap e111: 8 total, 8 up, 8 in 2024-02-19T21:35:54.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:53.652374+0000 osd.5 (osd.5) 64 : cluster [DBG] 5.e scrub starts 2024-02-19T21:35:54.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:53.660109+0000 osd.5 (osd.5) 65 : cluster [DBG] 5.e scrub ok 2024-02-19T21:35:54.558 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:35:54.562 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:54.563 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:35:54.663 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:35:54.717 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:55.162 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:35:55.166 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 26 16 49839 49823 119.726 87.5625 0.0129573 0.00834677 2024-02-19T21:35:55.193 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:35:55.206 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:55.206 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:54.184960+0000 osd.2 (osd.2) 58 : cluster [DBG] 5.6 scrub starts 2024-02-19T21:35:55.206 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:54.189491+0000 osd.2 (osd.2) 59 : cluster [DBG] 5.6 scrub ok 2024-02-19T21:35:55.206 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:54.385536+0000 osd.0 (osd.0) 65 : cluster [DBG] 4.6 scrub starts 2024-02-19T21:35:55.206 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:54.395131+0000 osd.0 (osd.0) 66 : cluster [DBG] 4.6 scrub ok 2024-02-19T21:35:55.207 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:54.868301+0000 mon.a (mon.0) 811 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-02-19T21:35:55.207 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:54.184960+0000 osd.2 (osd.2) 58 : cluster [DBG] 5.6 scrub starts 2024-02-19T21:35:55.207 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:54.189491+0000 osd.2 (osd.2) 59 : cluster [DBG] 5.6 scrub ok 2024-02-19T21:35:55.207 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:54.385536+0000 osd.0 (osd.0) 65 : cluster [DBG] 4.6 scrub starts 2024-02-19T21:35:55.207 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:54.395131+0000 osd.0 (osd.0) 66 : cluster [DBG] 4.6 scrub ok 2024-02-19T21:35:55.207 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:54.868301+0000 mon.a (mon.0) 811 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-02-19T21:35:55.207 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:35:55.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:54.184960+0000 osd.2 (osd.2) 58 : cluster [DBG] 5.6 scrub starts 2024-02-19T21:35:55.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:54.189491+0000 osd.2 (osd.2) 59 : cluster [DBG] 5.6 scrub ok 2024-02-19T21:35:55.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:54.385536+0000 osd.0 (osd.0) 65 : cluster [DBG] 4.6 scrub starts 2024-02-19T21:35:55.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:54.395131+0000 osd.0 (osd.0) 66 : cluster [DBG] 4.6 scrub ok 2024-02-19T21:35:55.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:54.868301+0000 mon.a (mon.0) 811 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-02-19T21:35:55.308 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:35:55.345 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:55.371 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:35:55.375 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:55.376 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:35:55.477 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:35:55.509 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:55.534 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:35:55.540 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:55.540 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:35:55.641 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:35:55.675 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:55.699 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:35:55.702 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:55.702 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:35:55.803 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:35:55.837 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:55.860 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:35:55.863 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:55.864 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:35:55.947 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:35:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:35:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:35:55.965 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:35:55.999 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:56.023 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:35:56.026 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:56.026 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:35:56.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:54.634650+0000 osd.3 (osd.3) 81 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:35:56.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:54.642088+0000 osd.3 (osd.3) 82 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:35:56.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:54.809002+0000 mgr.y (mgr.14514) 139 : cluster [DBG] pgmap v135: 148 pgs: 148 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 115 MiB/s wr, 1.84k op/s 2024-02-19T21:35:56.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:54.871291+0000 osd.1 (osd.1) 71 : cluster [DBG] 4.4 scrub starts 2024-02-19T21:35:56.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:54.882809+0000 osd.1 (osd.1) 72 : cluster [DBG] 4.4 scrub ok 2024-02-19T21:35:56.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:55.054473+0000 osd.6 (osd.6) 49 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:35:56.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:55.058398+0000 osd.6 (osd.6) 50 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:35:56.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:55.833235+0000 osd.1 (osd.1) 73 : cluster [DBG] 6.1 scrub starts 2024-02-19T21:35:56.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:55.838946+0000 osd.1 (osd.1) 74 : cluster [DBG] 6.1 scrub ok 2024-02-19T21:35:56.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:54.634650+0000 osd.3 (osd.3) 81 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:35:56.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:54.642088+0000 osd.3 (osd.3) 82 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:35:56.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:54.809002+0000 mgr.y (mgr.14514) 139 : cluster [DBG] pgmap v135: 148 pgs: 148 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 115 MiB/s wr, 1.84k op/s 2024-02-19T21:35:56.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:54.871291+0000 osd.1 (osd.1) 71 : cluster [DBG] 4.4 scrub starts 2024-02-19T21:35:56.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:54.882809+0000 osd.1 (osd.1) 72 : cluster [DBG] 4.4 scrub ok 2024-02-19T21:35:56.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:55.054473+0000 osd.6 (osd.6) 49 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:35:56.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:55.058398+0000 osd.6 (osd.6) 50 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:35:56.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:55.833235+0000 osd.1 (osd.1) 73 : cluster [DBG] 6.1 scrub starts 2024-02-19T21:35:56.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:55.838946+0000 osd.1 (osd.1) 74 : cluster [DBG] 6.1 scrub ok 2024-02-19T21:35:56.128 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:35:56.166 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 27 16 51203 51187 118.449 85.25 0.011425 0.00843692 2024-02-19T21:35:56.184 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:56.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:54.634650+0000 osd.3 (osd.3) 81 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:35:56.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:54.642088+0000 osd.3 (osd.3) 82 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:35:56.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:54.809002+0000 mgr.y (mgr.14514) 139 : cluster [DBG] pgmap v135: 148 pgs: 148 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 115 MiB/s wr, 1.84k op/s 2024-02-19T21:35:56.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:54.871291+0000 osd.1 (osd.1) 71 : cluster [DBG] 4.4 scrub starts 2024-02-19T21:35:56.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:54.882809+0000 osd.1 (osd.1) 72 : cluster [DBG] 4.4 scrub ok 2024-02-19T21:35:56.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:55.054473+0000 osd.6 (osd.6) 49 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:35:56.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:55.058398+0000 osd.6 (osd.6) 50 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:35:56.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:55.833235+0000 osd.1 (osd.1) 73 : cluster [DBG] 6.1 scrub starts 2024-02-19T21:35:56.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:55.838946+0000 osd.1 (osd.1) 74 : cluster [DBG] 6.1 scrub ok 2024-02-19T21:35:57.166 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 28 16 52617 52601 117.375 88.375 0.00552086 0.00851458 2024-02-19T21:35:57.209 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-19T21:35:57.266 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:56.237579+0000 osd.7 (osd.7) 65 : cluster [DBG] 6.12 scrub starts 2024-02-19T21:35:57.266 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:56.241921+0000 osd.7 (osd.7) 66 : cluster [DBG] 6.12 scrub ok 2024-02-19T21:35:57.266 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:56.310751+0000 osd.0 (osd.0) 67 : cluster [DBG] 6.0 scrub starts 2024-02-19T21:35:57.266 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:56.316055+0000 osd.0 (osd.0) 68 : cluster [DBG] 6.0 scrub ok 2024-02-19T21:35:57.266 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:56.620015+0000 osd.5 (osd.5) 66 : cluster [DBG] 4.1 scrub starts 2024-02-19T21:35:57.266 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:56.624879+0000 osd.5 (osd.5) 67 : cluster [DBG] 4.1 scrub ok 2024-02-19T21:35:57.267 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:56.237579+0000 osd.7 (osd.7) 65 : cluster [DBG] 6.12 scrub starts 2024-02-19T21:35:57.267 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:56.241921+0000 osd.7 (osd.7) 66 : cluster [DBG] 6.12 scrub ok 2024-02-19T21:35:57.267 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:56.310751+0000 osd.0 (osd.0) 67 : cluster [DBG] 6.0 scrub starts 2024-02-19T21:35:57.267 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:56.316055+0000 osd.0 (osd.0) 68 : cluster [DBG] 6.0 scrub ok 2024-02-19T21:35:57.267 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:56.620015+0000 osd.5 (osd.5) 66 : cluster [DBG] 4.1 scrub starts 2024-02-19T21:35:57.268 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:56.624879+0000 osd.5 (osd.5) 67 : cluster [DBG] 4.1 scrub ok 2024-02-19T21:35:57.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:56.237579+0000 osd.7 (osd.7) 65 : cluster [DBG] 6.12 scrub starts 2024-02-19T21:35:57.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:56.241921+0000 osd.7 (osd.7) 66 : cluster [DBG] 6.12 scrub ok 2024-02-19T21:35:57.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:56.310751+0000 osd.0 (osd.0) 67 : cluster [DBG] 6.0 scrub starts 2024-02-19T21:35:57.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:56.316055+0000 osd.0 (osd.0) 68 : cluster [DBG] 6.0 scrub ok 2024-02-19T21:35:57.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:56.620015+0000 osd.5 (osd.5) 66 : cluster [DBG] 4.1 scrub starts 2024-02-19T21:35:57.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:56.624879+0000 osd.5 (osd.5) 67 : cluster [DBG] 4.1 scrub ok 2024-02-19T21:35:57.650 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:35:57.653 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:57.653 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:35:57.754 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:35:57.789 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:57.815 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:35:57.818 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:57.818 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:35:57.919 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:35:57.949 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:57.974 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:35:57.977 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:57.978 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:35:58.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:56.809441+0000 mgr.y (mgr.14514) 140 : cluster [DBG] pgmap v137: 148 pgs: 148 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 738 B/s rd, 62 MiB/s wr, 998 op/s 2024-02-19T21:35:58.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:57.283088+0000 osd.0 (osd.0) 69 : cluster [DBG] 6.18 scrub starts 2024-02-19T21:35:58.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:57.291857+0000 osd.0 (osd.0) 70 : cluster [DBG] 6.18 scrub ok 2024-02-19T21:35:58.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:57.572258+0000 osd.5 (osd.5) 68 : cluster [DBG] 2.3 scrub starts 2024-02-19T21:35:58.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:57.573008+0000 osd.5 (osd.5) 69 : cluster [DBG] 2.3 scrub ok 2024-02-19T21:35:58.079 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:35:58.134 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:58.166 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 29 16 53901 53885 116.095 80.25 0.0120757 0.00860796 2024-02-19T21:35:58.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:56.809441+0000 mgr.y (mgr.14514) 140 : cluster [DBG] pgmap v137: 148 pgs: 148 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 738 B/s rd, 62 MiB/s wr, 998 op/s 2024-02-19T21:35:58.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:57.283088+0000 osd.0 (osd.0) 69 : cluster [DBG] 6.18 scrub starts 2024-02-19T21:35:58.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:57.291857+0000 osd.0 (osd.0) 70 : cluster [DBG] 6.18 scrub ok 2024-02-19T21:35:58.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:57.572258+0000 osd.5 (osd.5) 68 : cluster [DBG] 2.3 scrub starts 2024-02-19T21:35:58.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:57.573008+0000 osd.5 (osd.5) 69 : cluster [DBG] 2.3 scrub ok 2024-02-19T21:35:58.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:56.809441+0000 mgr.y (mgr.14514) 140 : cluster [DBG] pgmap v137: 148 pgs: 148 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 738 B/s rd, 62 MiB/s wr, 998 op/s 2024-02-19T21:35:58.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:57.283088+0000 osd.0 (osd.0) 69 : cluster [DBG] 6.18 scrub starts 2024-02-19T21:35:58.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:57.291857+0000 osd.0 (osd.0) 70 : cluster [DBG] 6.18 scrub ok 2024-02-19T21:35:58.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:57.572258+0000 osd.5 (osd.5) 68 : cluster [DBG] 2.3 scrub starts 2024-02-19T21:35:58.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:57.573008+0000 osd.5 (osd.5) 69 : cluster [DBG] 2.3 scrub ok 2024-02-19T21:35:59.166 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 30 16 55229 55213 114.991 83 0.00711496 0.00869114 2024-02-19T21:35:59.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:58.295352+0000 osd.0 (osd.0) 71 : cluster [DBG] 2.1f scrub starts 2024-02-19T21:35:59.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:58.301222+0000 osd.0 (osd.0) 72 : cluster [DBG] 2.1f scrub ok 2024-02-19T21:35:59.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:58.571948+0000 osd.5 (osd.5) 70 : cluster [DBG] 6.19 scrub starts 2024-02-19T21:35:59.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:58.577977+0000 osd.5 (osd.5) 71 : cluster [DBG] 6.19 scrub ok 2024-02-19T21:35:59.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:58.295352+0000 osd.0 (osd.0) 71 : cluster [DBG] 2.1f scrub starts 2024-02-19T21:35:59.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:58.301222+0000 osd.0 (osd.0) 72 : cluster [DBG] 2.1f scrub ok 2024-02-19T21:35:59.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:58.571948+0000 osd.5 (osd.5) 70 : cluster [DBG] 6.19 scrub starts 2024-02-19T21:35:59.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:58.577977+0000 osd.5 (osd.5) 71 : cluster [DBG] 6.19 scrub ok 2024-02-19T21:35:59.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:58.295352+0000 osd.0 (osd.0) 71 : cluster [DBG] 2.1f scrub starts 2024-02-19T21:35:59.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:58.301222+0000 osd.0 (osd.0) 72 : cluster [DBG] 2.1f scrub ok 2024-02-19T21:35:59.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:58.571948+0000 osd.5 (osd.5) 70 : cluster [DBG] 6.19 scrub starts 2024-02-19T21:35:59.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:58.577977+0000 osd.5 (osd.5) 71 : cluster [DBG] 6.19 scrub ok 2024-02-19T21:35:59.511 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:35:59.511 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd reweight 0 1 2024-02-19T21:35:59.541 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:35:59.548 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:59.548 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:35:59.649 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:35:59.719 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:35:59.896 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:35:59.901 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:35:59.901 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:36:00.002 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:36:00.034 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:00.059 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:36:00.062 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:00.062 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:36:00.163 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:36:00.168 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 31 16 56406 56390 113.653 73.5625 0.010177 0.00879262 2024-02-19T21:36:00.215 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:00.307 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:35:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:36:00.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:58.809836+0000 mgr.y (mgr.14514) 141 : cluster [DBG] pgmap v138: 148 pgs: 148 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 639 B/s rd, 54 MiB/s wr, 865 op/s 2024-02-19T21:36:00.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:58.886205+0000 osd.1 (osd.1) 75 : cluster [DBG] 5.c scrub starts 2024-02-19T21:36:00.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:58.886933+0000 osd.1 (osd.1) 76 : cluster [DBG] 5.c scrub ok 2024-02-19T21:36:00.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:59.210434+0000 osd.7 (osd.7) 67 : cluster [DBG] 2.5 scrub starts 2024-02-19T21:36:00.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:59.218688+0000 osd.7 (osd.7) 68 : cluster [DBG] 2.5 scrub ok 2024-02-19T21:36:00.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:59.435035+0000 osd.4 (osd.4) 75 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:36:00.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:59.441316+0000 osd.4 (osd.4) 76 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:36:00.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:59.612905+0000 osd.5 (osd.5) 72 : cluster [DBG] 5.16 scrub starts 2024-02-19T21:36:00.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:59.616843+0000 osd.5 (osd.5) 73 : cluster [DBG] 5.16 scrub ok 2024-02-19T21:36:00.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:35:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:35:59.876118+0000 mon.a (mon.0) 812 : cluster [DBG] osdmap e113: 8 total, 8 up, 8 in 2024-02-19T21:36:00.316 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:36:00.329 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:36:00.358 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:58.809836+0000 mgr.y (mgr.14514) 141 : cluster [DBG] pgmap v138: 148 pgs: 148 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 639 B/s rd, 54 MiB/s wr, 865 op/s 2024-02-19T21:36:00.358 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:58.886205+0000 osd.1 (osd.1) 75 : cluster [DBG] 5.c scrub starts 2024-02-19T21:36:00.358 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:58.886933+0000 osd.1 (osd.1) 76 : cluster [DBG] 5.c scrub ok 2024-02-19T21:36:00.358 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:59.210434+0000 osd.7 (osd.7) 67 : cluster [DBG] 2.5 scrub starts 2024-02-19T21:36:00.358 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:59.218688+0000 osd.7 (osd.7) 68 : cluster [DBG] 2.5 scrub ok 2024-02-19T21:36:00.358 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:59.435035+0000 osd.4 (osd.4) 75 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:36:00.358 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:59.441316+0000 osd.4 (osd.4) 76 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:36:00.358 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:59.612905+0000 osd.5 (osd.5) 72 : cluster [DBG] 5.16 scrub starts 2024-02-19T21:36:00.358 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:59.616843+0000 osd.5 (osd.5) 73 : cluster [DBG] 5.16 scrub ok 2024-02-19T21:36:00.358 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:35:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:35:59.876118+0000 mon.a (mon.0) 812 : cluster [DBG] osdmap e113: 8 total, 8 up, 8 in 2024-02-19T21:36:00.359 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:58.809836+0000 mgr.y (mgr.14514) 141 : cluster [DBG] pgmap v138: 148 pgs: 148 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 639 B/s rd, 54 MiB/s wr, 865 op/s 2024-02-19T21:36:00.359 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:58.886205+0000 osd.1 (osd.1) 75 : cluster [DBG] 5.c scrub starts 2024-02-19T21:36:00.359 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:58.886933+0000 osd.1 (osd.1) 76 : cluster [DBG] 5.c scrub ok 2024-02-19T21:36:00.359 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:59.210434+0000 osd.7 (osd.7) 67 : cluster [DBG] 2.5 scrub starts 2024-02-19T21:36:00.359 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:59.218688+0000 osd.7 (osd.7) 68 : cluster [DBG] 2.5 scrub ok 2024-02-19T21:36:00.359 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:59.435035+0000 osd.4 (osd.4) 75 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:36:00.359 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:59.441316+0000 osd.4 (osd.4) 76 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:36:00.359 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:59.612905+0000 osd.5 (osd.5) 72 : cluster [DBG] 5.16 scrub starts 2024-02-19T21:36:00.359 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:59.616843+0000 osd.5 (osd.5) 73 : cluster [DBG] 5.16 scrub ok 2024-02-19T21:36:00.359 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:35:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:35:59.876118+0000 mon.a (mon.0) 812 : cluster [DBG] osdmap e113: 8 total, 8 up, 8 in 2024-02-19T21:36:00.375 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:36:00.438 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:36:00.479 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:36:00.500 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:36:00.500 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-02-19T21:36:00.500 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-02-19T21:36:00.500 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-02-19T21:36:00.500 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:36:00.511 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:36:00.543 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:36:00.580 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:36:00.612 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:36:00.637 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:36:00.637 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:36:00.637 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:36:00.637 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:36:00.637 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:36:00.637 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:36:00.637 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:36:00.638 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:36:00.777 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:36:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:36:00] "GET /metrics HTTP/1.1" 200 175226 "" "Prometheus/2.33.4" 2024-02-19T21:36:00.992 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:36:00.995 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:00.995 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:36:01.090 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:35:59.947640+0000 mgr.y (mgr.14514) 142 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:36:01.090 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:00.060113+0000 osd.2 (osd.2) 60 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:36:01.090 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:00.067929+0000 osd.2 (osd.2) 61 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:36:01.090 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:00.244041+0000 mon.c (mon.2) 26 : audit [DBG] from='client.? 172.21.15.80:0/611691615' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:36:01.090 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:00.254195+0000 osd.0 (osd.0) 73 : cluster [DBG] 3.1 scrub starts 2024-02-19T21:36:01.090 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:00.256472+0000 osd.0 (osd.0) 74 : cluster [DBG] 3.1 scrub ok 2024-02-19T21:36:01.090 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:00.588396+0000 osd.5 (osd.5) 74 : cluster [DBG] 5.7 scrub starts 2024-02-19T21:36:01.090 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:00.594843+0000 osd.5 (osd.5) 75 : cluster [DBG] 5.7 scrub ok 2024-02-19T21:36:01.090 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:35:59.947640+0000 mgr.y (mgr.14514) 142 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:36:01.091 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:00.060113+0000 osd.2 (osd.2) 60 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:36:01.091 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:00.067929+0000 osd.2 (osd.2) 61 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:36:01.091 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:00.244041+0000 mon.c (mon.2) 26 : audit [DBG] from='client.? 172.21.15.80:0/611691615' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:36:01.091 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:00.254195+0000 osd.0 (osd.0) 73 : cluster [DBG] 3.1 scrub starts 2024-02-19T21:36:01.091 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:00.256472+0000 osd.0 (osd.0) 74 : cluster [DBG] 3.1 scrub ok 2024-02-19T21:36:01.091 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:00.588396+0000 osd.5 (osd.5) 74 : cluster [DBG] 5.7 scrub starts 2024-02-19T21:36:01.091 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:00.594843+0000 osd.5 (osd.5) 75 : cluster [DBG] 5.7 scrub ok 2024-02-19T21:36:01.096 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:36:01.161 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:01.167 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 32 16 57580 57564 112.394 73.375 0.0160158 0.00889225 2024-02-19T21:36:01.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:35:59.947640+0000 mgr.y (mgr.14514) 142 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:36:01.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:00.060113+0000 osd.2 (osd.2) 60 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:36:01.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:00.067929+0000 osd.2 (osd.2) 61 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:36:01.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:00.244041+0000 mon.c (mon.2) 26 : audit [DBG] from='client.? 172.21.15.80:0/611691615' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:36:01.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:00.254195+0000 osd.0 (osd.0) 73 : cluster [DBG] 3.1 scrub starts 2024-02-19T21:36:01.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:00.256472+0000 osd.0 (osd.0) 74 : cluster [DBG] 3.1 scrub ok 2024-02-19T21:36:01.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:00.588396+0000 osd.5 (osd.5) 74 : cluster [DBG] 5.7 scrub starts 2024-02-19T21:36:01.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:00.594843+0000 osd.5 (osd.5) 75 : cluster [DBG] 5.7 scrub ok 2024-02-19T21:36:01.533 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:36:01.546 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:01.546 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:36:01.647 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:36:01.711 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:02.129 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:36:02.138 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.1 dump_historic_ops 2024-02-19T21:36:02.168 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 33 16 58847 58831 111.385 79.1875 0.0114018 0.00897272 2024-02-19T21:36:02.274 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:36:02.280 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:00.810272+0000 mgr.y (mgr.14514) 143 : cluster [DBG] pgmap v140: 148 pgs: 148 active+clean; 3.4 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.3 KiB/s rd, 110 MiB/s wr, 1.75k op/s 2024-02-19T21:36:02.280 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:01.047367+0000 osd.6 (osd.6) 51 : cluster [DBG] 4.5 scrub starts 2024-02-19T21:36:02.280 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:01.053227+0000 osd.6 (osd.6) 52 : cluster [DBG] 4.5 scrub ok 2024-02-19T21:36:02.280 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:01.601492+0000 osd.5 (osd.5) 76 : cluster [DBG] 2.16 scrub starts 2024-02-19T21:36:02.280 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:01.607737+0000 osd.5 (osd.5) 77 : cluster [DBG] 2.16 scrub ok 2024-02-19T21:36:02.280 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:00.810272+0000 mgr.y (mgr.14514) 143 : cluster [DBG] pgmap v140: 148 pgs: 148 active+clean; 3.4 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.3 KiB/s rd, 110 MiB/s wr, 1.75k op/s 2024-02-19T21:36:02.281 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:01.047367+0000 osd.6 (osd.6) 51 : cluster [DBG] 4.5 scrub starts 2024-02-19T21:36:02.281 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:01.053227+0000 osd.6 (osd.6) 52 : cluster [DBG] 4.5 scrub ok 2024-02-19T21:36:02.281 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:01.601492+0000 osd.5 (osd.5) 76 : cluster [DBG] 2.16 scrub starts 2024-02-19T21:36:02.281 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:01.607737+0000 osd.5 (osd.5) 77 : cluster [DBG] 2.16 scrub ok 2024-02-19T21:36:02.281 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:02.282 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:36:02.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:00.810272+0000 mgr.y (mgr.14514) 143 : cluster [DBG] pgmap v140: 148 pgs: 148 active+clean; 3.4 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.3 KiB/s rd, 110 MiB/s wr, 1.75k op/s 2024-02-19T21:36:02.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:01.047367+0000 osd.6 (osd.6) 51 : cluster [DBG] 4.5 scrub starts 2024-02-19T21:36:02.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:01.053227+0000 osd.6 (osd.6) 52 : cluster [DBG] 4.5 scrub ok 2024-02-19T21:36:02.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:01.601492+0000 osd.5 (osd.5) 76 : cluster [DBG] 2.16 scrub starts 2024-02-19T21:36:02.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:01.607737+0000 osd.5 (osd.5) 77 : cluster [DBG] 2.16 scrub ok 2024-02-19T21:36:02.382 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:36:02.412 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:02.438 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:36:02.440 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:02.441 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:36:02.541 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:36:02.587 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:02.805 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:36:02.808 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:02.809 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:36:02.909 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:36:02.966 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:03.168 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 34 16 59957 59941 110.149 69.375 0.00694265 0.00907431 2024-02-19T21:36:03.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:02.018302+0000 osd.2 (osd.2) 62 : cluster [DBG] 5.8 scrub starts 2024-02-19T21:36:03.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:02.020263+0000 osd.2 (osd.2) 63 : cluster [DBG] 5.8 scrub ok 2024-02-19T21:36:03.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:02.166477+0000 osd.7 (osd.7) 69 : cluster [DBG] 5.10 scrub starts 2024-02-19T21:36:03.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:02.169515+0000 osd.7 (osd.7) 70 : cluster [DBG] 5.10 scrub ok 2024-02-19T21:36:03.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:02.269324+0000 osd.0 (osd.0) 75 : cluster [DBG] 5.5 scrub starts 2024-02-19T21:36:03.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:02.282028+0000 osd.0 (osd.0) 76 : cluster [DBG] 5.5 scrub ok 2024-02-19T21:36:03.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:02.863226+0000 osd.1 (osd.1) 77 : cluster [DBG] 5.19 scrub starts 2024-02-19T21:36:03.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:02.866400+0000 osd.1 (osd.1) 78 : cluster [DBG] 5.19 scrub ok 2024-02-19T21:36:03.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:02.018302+0000 osd.2 (osd.2) 62 : cluster [DBG] 5.8 scrub starts 2024-02-19T21:36:03.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:02.020263+0000 osd.2 (osd.2) 63 : cluster [DBG] 5.8 scrub ok 2024-02-19T21:36:03.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:02.166477+0000 osd.7 (osd.7) 69 : cluster [DBG] 5.10 scrub starts 2024-02-19T21:36:03.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:02.169515+0000 osd.7 (osd.7) 70 : cluster [DBG] 5.10 scrub ok 2024-02-19T21:36:03.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:02.269324+0000 osd.0 (osd.0) 75 : cluster [DBG] 5.5 scrub starts 2024-02-19T21:36:03.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:02.282028+0000 osd.0 (osd.0) 76 : cluster [DBG] 5.5 scrub ok 2024-02-19T21:36:03.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:02.863226+0000 osd.1 (osd.1) 77 : cluster [DBG] 5.19 scrub starts 2024-02-19T21:36:03.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:02.866400+0000 osd.1 (osd.1) 78 : cluster [DBG] 5.19 scrub ok 2024-02-19T21:36:03.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:02.018302+0000 osd.2 (osd.2) 62 : cluster [DBG] 5.8 scrub starts 2024-02-19T21:36:03.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:02.020263+0000 osd.2 (osd.2) 63 : cluster [DBG] 5.8 scrub ok 2024-02-19T21:36:03.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:02.166477+0000 osd.7 (osd.7) 69 : cluster [DBG] 5.10 scrub starts 2024-02-19T21:36:03.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:02.169515+0000 osd.7 (osd.7) 70 : cluster [DBG] 5.10 scrub ok 2024-02-19T21:36:03.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:02.269324+0000 osd.0 (osd.0) 75 : cluster [DBG] 5.5 scrub starts 2024-02-19T21:36:03.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:02.282028+0000 osd.0 (osd.0) 76 : cluster [DBG] 5.5 scrub ok 2024-02-19T21:36:03.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:02.863226+0000 osd.1 (osd.1) 77 : cluster [DBG] 5.19 scrub starts 2024-02-19T21:36:03.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:02.866400+0000 osd.1 (osd.1) 78 : cluster [DBG] 5.19 scrub ok 2024-02-19T21:36:03.536 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:36:03.543 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:03.544 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:36:03.562 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:36:03.644 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:36:03.676 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:03.700 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:36:03.704 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:03.704 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:36:03.805 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:36:03.872 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:04.045 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:36:04.056 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:04.056 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:36:04.157 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:36:04.168 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 35 16 61076 61060 109 69.9375 0.0110833 0.00916903 2024-02-19T21:36:04.192 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:04.216 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:36:04.219 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:04.219 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:36:04.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:02.716169+0000 osd.3 (osd.3) 83 : cluster [DBG] 5.14 scrub starts 2024-02-19T21:36:04.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:02.725909+0000 osd.3 (osd.3) 84 : cluster [DBG] 5.14 scrub ok 2024-02-19T21:36:04.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:02.810675+0000 mgr.y (mgr.14514) 144 : cluster [DBG] pgmap v141: 148 pgs: 148 active+clean; 3.4 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 639 B/s rd, 52 MiB/s wr, 830 op/s 2024-02-19T21:36:04.320 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:36:04.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:02.716169+0000 osd.3 (osd.3) 83 : cluster [DBG] 5.14 scrub starts 2024-02-19T21:36:04.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:02.725909+0000 osd.3 (osd.3) 84 : cluster [DBG] 5.14 scrub ok 2024-02-19T21:36:04.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:02.810675+0000 mgr.y (mgr.14514) 144 : cluster [DBG] pgmap v141: 148 pgs: 148 active+clean; 3.4 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 639 B/s rd, 52 MiB/s wr, 830 op/s 2024-02-19T21:36:04.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:02.716169+0000 osd.3 (osd.3) 83 : cluster [DBG] 5.14 scrub starts 2024-02-19T21:36:04.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:02.725909+0000 osd.3 (osd.3) 84 : cluster [DBG] 5.14 scrub ok 2024-02-19T21:36:04.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:02.810675+0000 mgr.y (mgr.14514) 144 : cluster [DBG] pgmap v141: 148 pgs: 148 active+clean; 3.4 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 639 B/s rd, 52 MiB/s wr, 830 op/s 2024-02-19T21:36:04.353 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:04.378 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:36:04.382 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:04.382 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:36:04.482 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:36:04.519 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:04.546 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:36:04.550 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:04.550 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:36:04.651 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:36:04.704 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:04.931 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:36:04.935 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:04.936 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:36:05.037 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:36:05.071 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:05.101 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:36:05.104 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:05.105 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:36:05.169 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 36 16 62274 62258 108.052 74.875 0.00447165 0.00924868 2024-02-19T21:36:05.205 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:36:05.259 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:05.623 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:36:05.634 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:05.634 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:36:05.735 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:36:05.762 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:05.787 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:36:05.790 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:05.791 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:36:05.880 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:36:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:36:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:36:05.892 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:36:05.942 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:03.910805+0000 osd.1 (osd.1) 79 : cluster [DBG] 5.1d scrub starts 2024-02-19T21:36:05.942 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:03.917862+0000 osd.1 (osd.1) 80 : cluster [DBG] 5.1d scrub ok 2024-02-19T21:36:05.942 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:04.813502+0000 mgr.y (mgr.14514) 145 : cluster [DBG] pgmap v142: 148 pgs: 148 active+clean; 3.8 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.0 KiB/s rd, 79 MiB/s wr, 1.26k op/s 2024-02-19T21:36:05.942 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:04.963256+0000 osd.6 (osd.6) 53 : cluster [DBG] 2.7 scrub starts 2024-02-19T21:36:05.942 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:04.967912+0000 osd.6 (osd.6) 54 : cluster [DBG] 2.7 scrub ok 2024-02-19T21:36:05.942 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:05.025116+0000 osd.2 (osd.2) 64 : cluster [DBG] 2.1 scrub starts 2024-02-19T21:36:05.942 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:05.032648+0000 osd.2 (osd.2) 65 : cluster [DBG] 2.1 scrub ok 2024-02-19T21:36:05.942 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:05.237766+0000 osd.7 (osd.7) 71 : cluster [DBG] 2.0 scrub starts 2024-02-19T21:36:05.943 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:05.241382+0000 osd.7 (osd.7) 72 : cluster [DBG] 2.0 scrub ok 2024-02-19T21:36:05.943 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:05.646780+0000 osd.5 (osd.5) 78 : cluster [DBG] 2.2 scrub starts 2024-02-19T21:36:05.943 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:05.647713+0000 osd.5 (osd.5) 79 : cluster [DBG] 2.2 scrub ok 2024-02-19T21:36:05.943 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:03.910805+0000 osd.1 (osd.1) 79 : cluster [DBG] 5.1d scrub starts 2024-02-19T21:36:05.943 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:03.917862+0000 osd.1 (osd.1) 80 : cluster [DBG] 5.1d scrub ok 2024-02-19T21:36:05.943 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:04.813502+0000 mgr.y (mgr.14514) 145 : cluster [DBG] pgmap v142: 148 pgs: 148 active+clean; 3.8 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.0 KiB/s rd, 79 MiB/s wr, 1.26k op/s 2024-02-19T21:36:05.943 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:04.963256+0000 osd.6 (osd.6) 53 : cluster [DBG] 2.7 scrub starts 2024-02-19T21:36:05.943 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:04.967912+0000 osd.6 (osd.6) 54 : cluster [DBG] 2.7 scrub ok 2024-02-19T21:36:05.943 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:05.025116+0000 osd.2 (osd.2) 64 : cluster [DBG] 2.1 scrub starts 2024-02-19T21:36:05.943 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:05.032648+0000 osd.2 (osd.2) 65 : cluster [DBG] 2.1 scrub ok 2024-02-19T21:36:05.943 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:05.237766+0000 osd.7 (osd.7) 71 : cluster [DBG] 2.0 scrub starts 2024-02-19T21:36:05.943 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:05.241382+0000 osd.7 (osd.7) 72 : cluster [DBG] 2.0 scrub ok 2024-02-19T21:36:05.943 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:05.646780+0000 osd.5 (osd.5) 78 : cluster [DBG] 2.2 scrub starts 2024-02-19T21:36:05.944 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:05.647713+0000 osd.5 (osd.5) 79 : cluster [DBG] 2.2 scrub ok 2024-02-19T21:36:05.946 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:06.007 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:36:06.010 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:06.011 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:36:06.111 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:36:06.146 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:03.910805+0000 osd.1 (osd.1) 79 : cluster [DBG] 5.1d scrub starts 2024-02-19T21:36:06.146 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:03.917862+0000 osd.1 (osd.1) 80 : cluster [DBG] 5.1d scrub ok 2024-02-19T21:36:06.146 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:04.813502+0000 mgr.y (mgr.14514) 145 : cluster [DBG] pgmap v142: 148 pgs: 148 active+clean; 3.8 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1.0 KiB/s rd, 79 MiB/s wr, 1.26k op/s 2024-02-19T21:36:06.146 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:04.963256+0000 osd.6 (osd.6) 53 : cluster [DBG] 2.7 scrub starts 2024-02-19T21:36:06.146 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:04.967912+0000 osd.6 (osd.6) 54 : cluster [DBG] 2.7 scrub ok 2024-02-19T21:36:06.146 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:05.025116+0000 osd.2 (osd.2) 64 : cluster [DBG] 2.1 scrub starts 2024-02-19T21:36:06.147 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:05.032648+0000 osd.2 (osd.2) 65 : cluster [DBG] 2.1 scrub ok 2024-02-19T21:36:06.147 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:05.237766+0000 osd.7 (osd.7) 71 : cluster [DBG] 2.0 scrub starts 2024-02-19T21:36:06.147 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:05.241382+0000 osd.7 (osd.7) 72 : cluster [DBG] 2.0 scrub ok 2024-02-19T21:36:06.147 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:05.646780+0000 osd.5 (osd.5) 78 : cluster [DBG] 2.2 scrub starts 2024-02-19T21:36:06.147 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:05.647713+0000 osd.5 (osd.5) 79 : cluster [DBG] 2.2 scrub ok 2024-02-19T21:36:06.149 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:06.169 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 37 16 63414 63398 107.057 71.25 0.00925349 0.00933578 2024-02-19T21:36:06.177 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:36:06.181 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:06.181 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:36:06.282 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:36:06.317 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:06.341 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:36:06.345 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:06.345 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:36:06.419 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:36:06.446 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:36:06.514 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:06.734 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:36:06.739 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:06.740 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:36:06.797 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:36:06.841 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:36:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:06.928 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-02-19T21:36:06.953 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:36:06.961 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:06.961 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:36:07.062 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:36:07.092 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:07.118 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:36:07.120 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:07.121 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:36:07.173 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 38 16 64413 64397 105.878 62.4375 0.0135884 0.00943989 2024-02-19T21:36:07.221 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:36:07.249 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:05.759879+0000 osd.3 (osd.3) 85 : cluster [DBG] 4.0 scrub starts 2024-02-19T21:36:07.249 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:05.769249+0000 osd.3 (osd.3) 86 : cluster [DBG] 4.0 scrub ok 2024-02-19T21:36:07.249 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:05.929201+0000 osd.1 (osd.1) 81 : cluster [DBG] 4.12 scrub starts 2024-02-19T21:36:07.249 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:05.935949+0000 osd.1 (osd.1) 82 : cluster [DBG] 4.12 scrub ok 2024-02-19T21:36:07.249 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:06.287774+0000 osd.0 (osd.0) 77 : cluster [DBG] 2.13 scrub starts 2024-02-19T21:36:07.249 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:06.288942+0000 osd.0 (osd.0) 78 : cluster [DBG] 2.13 scrub ok 2024-02-19T21:36:07.249 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:06.707502+0000 mon.c (mon.2) 27 : audit [INF] from='client.? 172.21.15.80:0/3496828861' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:36:07.249 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:06.707852+0000 mon.a (mon.0) 813 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:36:07.251 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:07.273 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:36:07.277 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:07.277 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:36:07.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:05.759879+0000 osd.3 (osd.3) 85 : cluster [DBG] 4.0 scrub starts 2024-02-19T21:36:07.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:05.769249+0000 osd.3 (osd.3) 86 : cluster [DBG] 4.0 scrub ok 2024-02-19T21:36:07.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:05.929201+0000 osd.1 (osd.1) 81 : cluster [DBG] 4.12 scrub starts 2024-02-19T21:36:07.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:05.935949+0000 osd.1 (osd.1) 82 : cluster [DBG] 4.12 scrub ok 2024-02-19T21:36:07.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:06.287774+0000 osd.0 (osd.0) 77 : cluster [DBG] 2.13 scrub starts 2024-02-19T21:36:07.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:06.288942+0000 osd.0 (osd.0) 78 : cluster [DBG] 2.13 scrub ok 2024-02-19T21:36:07.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:06.707502+0000 mon.c (mon.2) 27 : audit [INF] from='client.? 172.21.15.80:0/3496828861' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:36:07.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:06.707852+0000 mon.a (mon.0) 813 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:36:07.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:05.759879+0000 osd.3 (osd.3) 85 : cluster [DBG] 4.0 scrub starts 2024-02-19T21:36:07.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:05.769249+0000 osd.3 (osd.3) 86 : cluster [DBG] 4.0 scrub ok 2024-02-19T21:36:07.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:05.929201+0000 osd.1 (osd.1) 81 : cluster [DBG] 4.12 scrub starts 2024-02-19T21:36:07.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:05.935949+0000 osd.1 (osd.1) 82 : cluster [DBG] 4.12 scrub ok 2024-02-19T21:36:07.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:06.287774+0000 osd.0 (osd.0) 77 : cluster [DBG] 2.13 scrub starts 2024-02-19T21:36:07.353 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:06.288942+0000 osd.0 (osd.0) 78 : cluster [DBG] 2.13 scrub ok 2024-02-19T21:36:07.353 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:06.707502+0000 mon.c (mon.2) 27 : audit [INF] from='client.? 172.21.15.80:0/3496828861' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:36:07.353 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:06.707852+0000 mon.a (mon.0) 813 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:36:07.378 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:36:07.413 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:07.444 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:36:07.449 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:07.450 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:36:07.551 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:36:07.589 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:07.616 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:36:07.620 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:07.620 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:36:07.721 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:36:07.756 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:07.784 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:36:07.789 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:07.789 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:36:07.890 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:36:07.919 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:06.771643+0000 osd.3 (osd.3) 87 : cluster [DBG] 4.17 scrub starts 2024-02-19T21:36:07.919 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:06.799048+0000 osd.3 (osd.3) 88 : cluster [DBG] 4.17 scrub ok 2024-02-19T21:36:07.919 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:06.813906+0000 mgr.y (mgr.14514) 146 : cluster [DBG] pgmap v143: 148 pgs: 148 active+clean; 3.8 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1023 B/s rd, 78 MiB/s wr, 1.25k op/s 2024-02-19T21:36:07.934 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.0 to 1 (10000) 2024-02-19T21:36:07.984 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:08.145 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:06.771643+0000 osd.3 (osd.3) 87 : cluster [DBG] 4.17 scrub starts 2024-02-19T21:36:08.145 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:06.799048+0000 osd.3 (osd.3) 88 : cluster [DBG] 4.17 scrub ok 2024-02-19T21:36:08.145 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:06.813906+0000 mgr.y (mgr.14514) 146 : cluster [DBG] pgmap v143: 148 pgs: 148 active+clean; 3.8 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1023 B/s rd, 78 MiB/s wr, 1.25k op/s 2024-02-19T21:36:08.145 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:06.881174+0000 mon.a (mon.0) 814 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:36:08.145 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:06.881203+0000 mon.a (mon.0) 815 : cluster [INF] Cluster is now healthy 2024-02-19T21:36:08.145 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:06.898720+0000 mon.a (mon.0) 816 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:36:08.145 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:06.898768+0000 mon.a (mon.0) 817 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2024-02-19T21:36:08.145 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:06.938814+0000 osd.1 (osd.1) 83 : cluster [DBG] 5.12 scrub starts 2024-02-19T21:36:08.146 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:06.939854+0000 osd.1 (osd.1) 84 : cluster [DBG] 5.12 scrub ok 2024-02-19T21:36:08.146 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:07.008409+0000 osd.6 (osd.6) 55 : cluster [DBG] 2.1a scrub starts 2024-02-19T21:36:08.146 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:07.011323+0000 osd.6 (osd.6) 56 : cluster [DBG] 2.1a scrub ok 2024-02-19T21:36:08.146 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:07.043401+0000 osd.2 (osd.2) 66 : cluster [DBG] 5.a scrub starts 2024-02-19T21:36:08.146 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:07.058740+0000 osd.2 (osd.2) 67 : cluster [DBG] 5.a scrub ok 2024-02-19T21:36:08.146 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:07.257158+0000 osd.0 (osd.0) 79 : cluster [DBG] 4.1e scrub starts 2024-02-19T21:36:08.146 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:07.267138+0000 osd.0 (osd.0) 80 : cluster [DBG] 4.1e scrub ok 2024-02-19T21:36:08.146 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:07.416771+0000 mon.b (mon.1) 35 : audit [INF] from='client.? 172.21.15.80:0/209619852' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-19T21:36:08.146 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:07.417314+0000 mon.a (mon.0) 818 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-19T21:36:08.146 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:07.634744+0000 osd.5 (osd.5) 80 : cluster [DBG] 6.1a scrub starts 2024-02-19T21:36:08.146 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:07.637062+0000 osd.5 (osd.5) 81 : cluster [DBG] 6.1a scrub ok 2024-02-19T21:36:08.147 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:06.771643+0000 osd.3 (osd.3) 87 : cluster [DBG] 4.17 scrub starts 2024-02-19T21:36:08.147 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:06.799048+0000 osd.3 (osd.3) 88 : cluster [DBG] 4.17 scrub ok 2024-02-19T21:36:08.147 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:06.813906+0000 mgr.y (mgr.14514) 146 : cluster [DBG] pgmap v143: 148 pgs: 148 active+clean; 3.8 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 1023 B/s rd, 78 MiB/s wr, 1.25k op/s 2024-02-19T21:36:08.147 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:06.881174+0000 mon.a (mon.0) 814 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:36:08.147 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:06.881203+0000 mon.a (mon.0) 815 : cluster [INF] Cluster is now healthy 2024-02-19T21:36:08.147 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:06.898720+0000 mon.a (mon.0) 816 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:36:08.147 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:06.898768+0000 mon.a (mon.0) 817 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2024-02-19T21:36:08.147 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:06.938814+0000 osd.1 (osd.1) 83 : cluster [DBG] 5.12 scrub starts 2024-02-19T21:36:08.147 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:06.939854+0000 osd.1 (osd.1) 84 : cluster [DBG] 5.12 scrub ok 2024-02-19T21:36:08.147 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:07.008409+0000 osd.6 (osd.6) 55 : cluster [DBG] 2.1a scrub starts 2024-02-19T21:36:08.147 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:07.011323+0000 osd.6 (osd.6) 56 : cluster [DBG] 2.1a scrub ok 2024-02-19T21:36:08.147 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:07.043401+0000 osd.2 (osd.2) 66 : cluster [DBG] 5.a scrub starts 2024-02-19T21:36:08.148 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:07.058740+0000 osd.2 (osd.2) 67 : cluster [DBG] 5.a scrub ok 2024-02-19T21:36:08.148 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:07.257158+0000 osd.0 (osd.0) 79 : cluster [DBG] 4.1e scrub starts 2024-02-19T21:36:08.148 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:07.267138+0000 osd.0 (osd.0) 80 : cluster [DBG] 4.1e scrub ok 2024-02-19T21:36:08.148 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:07.416771+0000 mon.b (mon.1) 35 : audit [INF] from='client.? 172.21.15.80:0/209619852' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-19T21:36:08.148 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:07.417314+0000 mon.a (mon.0) 818 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-19T21:36:08.148 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:07.634744+0000 osd.5 (osd.5) 80 : cluster [DBG] 6.1a scrub starts 2024-02-19T21:36:08.148 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:07.637062+0000 osd.5 (osd.5) 81 : cluster [DBG] 6.1a scrub ok 2024-02-19T21:36:08.172 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 39 16 65545 65529 104.977 70.75 0.0185142 0.00952104 2024-02-19T21:36:08.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:06.881174+0000 mon.a (mon.0) 814 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:36:08.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:06.881203+0000 mon.a (mon.0) 815 : cluster [INF] Cluster is now healthy 2024-02-19T21:36:08.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:06.898720+0000 mon.a (mon.0) 816 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:36:08.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:06.898768+0000 mon.a (mon.0) 817 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2024-02-19T21:36:08.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:06.938814+0000 osd.1 (osd.1) 83 : cluster [DBG] 5.12 scrub starts 2024-02-19T21:36:08.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:06.939854+0000 osd.1 (osd.1) 84 : cluster [DBG] 5.12 scrub ok 2024-02-19T21:36:08.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:07.008409+0000 osd.6 (osd.6) 55 : cluster [DBG] 2.1a scrub starts 2024-02-19T21:36:08.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:07.011323+0000 osd.6 (osd.6) 56 : cluster [DBG] 2.1a scrub ok 2024-02-19T21:36:08.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:07.043401+0000 osd.2 (osd.2) 66 : cluster [DBG] 5.a scrub starts 2024-02-19T21:36:08.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:07.058740+0000 osd.2 (osd.2) 67 : cluster [DBG] 5.a scrub ok 2024-02-19T21:36:08.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:07.257158+0000 osd.0 (osd.0) 79 : cluster [DBG] 4.1e scrub starts 2024-02-19T21:36:08.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:07.267138+0000 osd.0 (osd.0) 80 : cluster [DBG] 4.1e scrub ok 2024-02-19T21:36:08.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:07.416771+0000 mon.b (mon.1) 35 : audit [INF] from='client.? 172.21.15.80:0/209619852' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-19T21:36:08.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:07.417314+0000 mon.a (mon.0) 818 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-19T21:36:08.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:07.634744+0000 osd.5 (osd.5) 80 : cluster [DBG] 6.1a scrub starts 2024-02-19T21:36:08.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:07.637062+0000 osd.5 (osd.5) 81 : cluster [DBG] 6.1a scrub ok 2024-02-19T21:36:09.102 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:07.904810+0000 mon.a (mon.0) 819 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-02-19T21:36:09.102 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:07.904860+0000 mon.a (mon.0) 820 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2024-02-19T21:36:09.103 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:08.143962+0000 osd.7 (osd.7) 73 : cluster [DBG] 6.5 scrub starts 2024-02-19T21:36:09.103 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:08.146978+0000 osd.7 (osd.7) 74 : cluster [DBG] 6.5 scrub ok 2024-02-19T21:36:09.103 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:08.293627+0000 osd.0 (osd.0) 81 : cluster [DBG] 6.16 scrub starts 2024-02-19T21:36:09.103 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:08.305883+0000 osd.0 (osd.0) 82 : cluster [DBG] 6.16 scrub ok 2024-02-19T21:36:09.103 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:08.663994+0000 osd.5 (osd.5) 82 : cluster [DBG] 2.18 deep-scrub starts 2024-02-19T21:36:09.103 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:08.666901+0000 osd.5 (osd.5) 83 : cluster [DBG] 2.18 deep-scrub ok 2024-02-19T21:36:09.103 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:07.904810+0000 mon.a (mon.0) 819 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-02-19T21:36:09.103 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:07.904860+0000 mon.a (mon.0) 820 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2024-02-19T21:36:09.103 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:08.143962+0000 osd.7 (osd.7) 73 : cluster [DBG] 6.5 scrub starts 2024-02-19T21:36:09.103 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:08.146978+0000 osd.7 (osd.7) 74 : cluster [DBG] 6.5 scrub ok 2024-02-19T21:36:09.103 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:08.293627+0000 osd.0 (osd.0) 81 : cluster [DBG] 6.16 scrub starts 2024-02-19T21:36:09.104 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:08.305883+0000 osd.0 (osd.0) 82 : cluster [DBG] 6.16 scrub ok 2024-02-19T21:36:09.104 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:08.663994+0000 osd.5 (osd.5) 82 : cluster [DBG] 2.18 deep-scrub starts 2024-02-19T21:36:09.104 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:08.666901+0000 osd.5 (osd.5) 83 : cluster [DBG] 2.18 deep-scrub ok 2024-02-19T21:36:09.171 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:2024-02-19T21:36:09.170772+0000 min lat: 0.00133551 max lat: 0.105691 avg lat: 0.00959623 2024-02-19T21:36:09.171 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-19T21:36:09.171 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 40 16 66702 66686 104.16 72.3125 0.0117985 0.00959623 2024-02-19T21:36:09.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:07.904810+0000 mon.a (mon.0) 819 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-02-19T21:36:09.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:07.904860+0000 mon.a (mon.0) 820 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2024-02-19T21:36:09.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:08.143962+0000 osd.7 (osd.7) 73 : cluster [DBG] 6.5 scrub starts 2024-02-19T21:36:09.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:08.146978+0000 osd.7 (osd.7) 74 : cluster [DBG] 6.5 scrub ok 2024-02-19T21:36:09.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:08.293627+0000 osd.0 (osd.0) 81 : cluster [DBG] 6.16 scrub starts 2024-02-19T21:36:09.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:08.305883+0000 osd.0 (osd.0) 82 : cluster [DBG] 6.16 scrub ok 2024-02-19T21:36:09.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:08.663994+0000 osd.5 (osd.5) 82 : cluster [DBG] 2.18 deep-scrub starts 2024-02-19T21:36:09.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:08.666901+0000 osd.5 (osd.5) 83 : cluster [DBG] 2.18 deep-scrub ok 2024-02-19T21:36:09.472 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:36:09.479 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:09.479 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:36:09.580 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:36:09.620 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:09.647 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:36:09.650 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:09.650 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:36:09.751 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:36:09.783 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:09.807 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:36:09.810 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:09.811 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:36:09.892 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set noscrub 2024-02-19T21:36:09.912 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:36:09.949 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:08.761327+0000 osd.3 (osd.3) 89 : cluster [DBG] 6.1b scrub starts 2024-02-19T21:36:09.950 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:08.767490+0000 osd.3 (osd.3) 90 : cluster [DBG] 6.1b scrub ok 2024-02-19T21:36:09.950 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:08.814311+0000 mgr.y (mgr.14514) 147 : cluster [DBG] pgmap v146: 148 pgs: 148 active+clean; 3.8 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 639 B/s rd, 46 MiB/s wr, 735 op/s 2024-02-19T21:36:09.950 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:09.018515+0000 osd.6 (osd.6) 57 : cluster [DBG] 4.a deep-scrub starts 2024-02-19T21:36:09.950 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:09.031665+0000 osd.6 (osd.6) 58 : cluster [DBG] 4.a deep-scrub ok 2024-02-19T21:36:09.950 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:09.060205+0000 osd.2 (osd.2) 68 : cluster [DBG] 4.d scrub starts 2024-02-19T21:36:09.950 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:09.065786+0000 osd.2 (osd.2) 69 : cluster [DBG] 4.d scrub ok 2024-02-19T21:36:09.950 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:09.426111+0000 osd.4 (osd.4) 77 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:36:09.950 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:09.432333+0000 osd.4 (osd.4) 78 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:36:09.950 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:09.673692+0000 osd.5 (osd.5) 84 : cluster [DBG] 5.1b scrub starts 2024-02-19T21:36:09.950 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:09.678907+0000 osd.5 (osd.5) 85 : cluster [DBG] 5.1b scrub ok 2024-02-19T21:36:10.002 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:10.138 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:36:10.144 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:10.145 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:36:10.145 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:08.761327+0000 osd.3 (osd.3) 89 : cluster [DBG] 6.1b scrub starts 2024-02-19T21:36:10.146 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:08.767490+0000 osd.3 (osd.3) 90 : cluster [DBG] 6.1b scrub ok 2024-02-19T21:36:10.146 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:08.814311+0000 mgr.y (mgr.14514) 147 : cluster [DBG] pgmap v146: 148 pgs: 148 active+clean; 3.8 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 639 B/s rd, 46 MiB/s wr, 735 op/s 2024-02-19T21:36:10.146 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:09.018515+0000 osd.6 (osd.6) 57 : cluster [DBG] 4.a deep-scrub starts 2024-02-19T21:36:10.146 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:09.031665+0000 osd.6 (osd.6) 58 : cluster [DBG] 4.a deep-scrub ok 2024-02-19T21:36:10.146 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:09.060205+0000 osd.2 (osd.2) 68 : cluster [DBG] 4.d scrub starts 2024-02-19T21:36:10.146 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:09.065786+0000 osd.2 (osd.2) 69 : cluster [DBG] 4.d scrub ok 2024-02-19T21:36:10.146 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:09.426111+0000 osd.4 (osd.4) 77 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:36:10.146 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:09.432333+0000 osd.4 (osd.4) 78 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:36:10.146 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:09.673692+0000 osd.5 (osd.5) 84 : cluster [DBG] 5.1b scrub starts 2024-02-19T21:36:10.146 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:09.678907+0000 osd.5 (osd.5) 85 : cluster [DBG] 5.1b scrub ok 2024-02-19T21:36:10.149 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:08.761327+0000 osd.3 (osd.3) 89 : cluster [DBG] 6.1b scrub starts 2024-02-19T21:36:10.149 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:08.767490+0000 osd.3 (osd.3) 90 : cluster [DBG] 6.1b scrub ok 2024-02-19T21:36:10.150 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:08.814311+0000 mgr.y (mgr.14514) 147 : cluster [DBG] pgmap v146: 148 pgs: 148 active+clean; 3.8 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 639 B/s rd, 46 MiB/s wr, 735 op/s 2024-02-19T21:36:10.150 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:09.018515+0000 osd.6 (osd.6) 57 : cluster [DBG] 4.a deep-scrub starts 2024-02-19T21:36:10.150 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:09.031665+0000 osd.6 (osd.6) 58 : cluster [DBG] 4.a deep-scrub ok 2024-02-19T21:36:10.150 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:09.060205+0000 osd.2 (osd.2) 68 : cluster [DBG] 4.d scrub starts 2024-02-19T21:36:10.150 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:09.065786+0000 osd.2 (osd.2) 69 : cluster [DBG] 4.d scrub ok 2024-02-19T21:36:10.150 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:09.426111+0000 osd.4 (osd.4) 77 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:36:10.150 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:09.432333+0000 osd.4 (osd.4) 78 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:36:10.150 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:09.673692+0000 osd.5 (osd.5) 84 : cluster [DBG] 5.1b scrub starts 2024-02-19T21:36:10.150 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:09.678907+0000 osd.5 (osd.5) 85 : cluster [DBG] 5.1b scrub ok 2024-02-19T21:36:10.177 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 41 16 67826 67810 103.33 70.25 0.0216281 0.00967255 2024-02-19T21:36:10.245 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:36:10.274 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:36:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:36:10.276 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:10.301 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:36:10.305 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:10.306 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:36:10.406 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:36:10.469 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:10.778 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:36:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:36:10] "GET /metrics HTTP/1.1" 200 175301 "" "Prometheus/2.33.4" 2024-02-19T21:36:11.046 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:09.958354+0000 mgr.y (mgr.14514) 148 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:36:11.046 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:10.061111+0000 osd.7 (osd.7) 75 : cluster [DBG] 5.1a scrub starts 2024-02-19T21:36:11.046 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:10.065517+0000 osd.7 (osd.7) 76 : cluster [DBG] 5.1a scrub ok 2024-02-19T21:36:11.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:09.958354+0000 mgr.y (mgr.14514) 148 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:36:11.047 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:10.061111+0000 osd.7 (osd.7) 75 : cluster [DBG] 5.1a scrub starts 2024-02-19T21:36:11.047 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:10.065517+0000 osd.7 (osd.7) 76 : cluster [DBG] 5.1a scrub ok 2024-02-19T21:36:11.172 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 42 16 68940 68924 102.528 69.625 0.0182657 0.00974833 2024-02-19T21:36:11.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:09.958354+0000 mgr.y (mgr.14514) 148 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:36:11.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:10.061111+0000 osd.7 (osd.7) 75 : cluster [DBG] 5.1a scrub starts 2024-02-19T21:36:11.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:10.065517+0000 osd.7 (osd.7) 76 : cluster [DBG] 5.1a scrub ok 2024-02-19T21:36:12.173 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 43 16 70113 70097 101.848 73.3125 0.0148094 0.00981448 2024-02-19T21:36:12.246 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:10.718201+0000 osd.3 (osd.3) 91 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:36:12.246 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:10.728206+0000 osd.3 (osd.3) 92 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:36:12.246 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:10.816228+0000 mgr.y (mgr.14514) 149 : cluster [DBG] pgmap v147: 148 pgs: 148 active+clean; 4.1 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 90 MiB/s wr, 1.44k op/s 2024-02-19T21:36:12.246 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:11.066242+0000 osd.2 (osd.2) 70 : cluster [DBG] 2.10 scrub starts 2024-02-19T21:36:12.246 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:11.078746+0000 osd.2 (osd.2) 71 : cluster [DBG] 2.10 scrub ok 2024-02-19T21:36:12.246 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:10.718201+0000 osd.3 (osd.3) 91 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:36:12.247 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:10.728206+0000 osd.3 (osd.3) 92 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:36:12.247 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:10.816228+0000 mgr.y (mgr.14514) 149 : cluster [DBG] pgmap v147: 148 pgs: 148 active+clean; 4.1 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 90 MiB/s wr, 1.44k op/s 2024-02-19T21:36:12.247 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:11.066242+0000 osd.2 (osd.2) 70 : cluster [DBG] 2.10 scrub starts 2024-02-19T21:36:12.247 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:11.078746+0000 osd.2 (osd.2) 71 : cluster [DBG] 2.10 scrub ok 2024-02-19T21:36:12.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:10.718201+0000 osd.3 (osd.3) 91 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:36:12.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:10.728206+0000 osd.3 (osd.3) 92 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:36:12.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:10.816228+0000 mgr.y (mgr.14514) 149 : cluster [DBG] pgmap v147: 148 pgs: 148 active+clean; 4.1 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 90 MiB/s wr, 1.44k op/s 2024-02-19T21:36:12.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:11.066242+0000 osd.2 (osd.2) 70 : cluster [DBG] 2.10 scrub starts 2024-02-19T21:36:12.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:11.078746+0000 osd.2 (osd.2) 71 : cluster [DBG] 2.10 scrub ok 2024-02-19T21:36:12.666 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:36:12.701 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:36:12.741 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:36:12.749 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:12.750 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:36:12.750 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:36:12.785 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:36:12.825 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:36:12.851 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:36:12.863 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:36:12.902 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:36:12.918 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:36:12.918 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:36:12.921 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:12.954 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:36:12.974 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:36:12.974 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:36:12.974 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:36:12.974 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:36:12.975 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:36:12.975 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:36:12.975 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:36:12.975 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:36:13.005 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:11.979576+0000 osd.1 (osd.1) 85 : cluster [DBG] 6.4 scrub starts 2024-02-19T21:36:13.005 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:12.015967+0000 osd.1 (osd.1) 86 : cluster [DBG] 6.4 scrub ok 2024-02-19T21:36:13.005 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:12.623309+0000 mon.c (mon.2) 28 : audit [DBG] from='client.? 172.21.15.80:0/3339719037' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:36:13.005 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:11.979576+0000 osd.1 (osd.1) 85 : cluster [DBG] 6.4 scrub starts 2024-02-19T21:36:13.005 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:12.015967+0000 osd.1 (osd.1) 86 : cluster [DBG] 6.4 scrub ok 2024-02-19T21:36:13.005 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:12.623309+0000 mon.c (mon.2) 28 : audit [DBG] from='client.? 172.21.15.80:0/3339719037' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:36:13.173 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 44 16 71137 71121 100.988 64 0.0211443 0.00989722 2024-02-19T21:36:13.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:11.979576+0000 osd.1 (osd.1) 85 : cluster [DBG] 6.4 scrub starts 2024-02-19T21:36:13.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:12.015967+0000 osd.1 (osd.1) 86 : cluster [DBG] 6.4 scrub ok 2024-02-19T21:36:13.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:12.623309+0000 mon.c (mon.2) 28 : audit [DBG] from='client.? 172.21.15.80:0/3339719037' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:36:13.604 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:36:13.617 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:13.618 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:36:13.718 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:36:13.781 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:13.981 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:12.816580+0000 mgr.y (mgr.14514) 150 : cluster [DBG] pgmap v148: 148 pgs: 148 active+clean; 4.1 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 639 B/s rd, 44 MiB/s wr, 700 op/s 2024-02-19T21:36:13.981 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:12.943170+0000 osd.1 (osd.1) 87 : cluster [DBG] 6.1d deep-scrub starts 2024-02-19T21:36:13.982 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:12.945575+0000 osd.1 (osd.1) 88 : cluster [DBG] 6.1d deep-scrub ok 2024-02-19T21:36:13.982 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:12.816580+0000 mgr.y (mgr.14514) 150 : cluster [DBG] pgmap v148: 148 pgs: 148 active+clean; 4.1 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 639 B/s rd, 44 MiB/s wr, 700 op/s 2024-02-19T21:36:13.982 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:12.943170+0000 osd.1 (osd.1) 87 : cluster [DBG] 6.1d deep-scrub starts 2024-02-19T21:36:13.982 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:12.945575+0000 osd.1 (osd.1) 88 : cluster [DBG] 6.1d deep-scrub ok 2024-02-19T21:36:14.070 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:36:14.079 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:14.080 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:36:14.082 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.2 dump_ops_in_flight 2024-02-19T21:36:14.175 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 45 16 72251 72235 100.291 69.625 0.00755168 0.00996586 2024-02-19T21:36:14.181 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:36:14.214 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:14.235 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:36:14.237 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:12.816580+0000 mgr.y (mgr.14514) 150 : cluster [DBG] pgmap v148: 148 pgs: 148 active+clean; 4.1 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 639 B/s rd, 44 MiB/s wr, 700 op/s 2024-02-19T21:36:14.238 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:12.943170+0000 osd.1 (osd.1) 87 : cluster [DBG] 6.1d deep-scrub starts 2024-02-19T21:36:14.238 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:12.945575+0000 osd.1 (osd.1) 88 : cluster [DBG] 6.1d deep-scrub ok 2024-02-19T21:36:14.238 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:14.239 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:36:14.339 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:36:14.408 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:15.048 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd reweight 1 1 2024-02-19T21:36:15.072 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:36:15.077 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:15.077 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:36:15.134 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:36:15.178 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:36:15.179 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 46 16 73275 73259 99.4893 64 0.0226189 0.0100456 2024-02-19T21:36:15.192 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:36:15.208 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:15.229 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:36:15.233 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:15.234 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:36:15.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:13.729087+0000 osd.3 (osd.3) 93 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:36:15.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:13.740967+0000 osd.3 (osd.3) 94 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:36:15.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:14.778486+0000 osd.5 (osd.5) 86 : cluster [DBG] 6.a deep-scrub starts 2024-02-19T21:36:15.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:14.779439+0000 osd.5 (osd.5) 87 : cluster [DBG] 6.a deep-scrub ok 2024-02-19T21:36:15.334 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:36:15.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:13.729087+0000 osd.3 (osd.3) 93 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:36:15.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:13.740967+0000 osd.3 (osd.3) 94 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:36:15.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:14.778486+0000 osd.5 (osd.5) 86 : cluster [DBG] 6.a deep-scrub starts 2024-02-19T21:36:15.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:14.779439+0000 osd.5 (osd.5) 87 : cluster [DBG] 6.a deep-scrub ok 2024-02-19T21:36:15.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:13.729087+0000 osd.3 (osd.3) 93 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:36:15.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:13.740967+0000 osd.3 (osd.3) 94 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:36:15.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:14.778486+0000 osd.5 (osd.5) 86 : cluster [DBG] 6.a deep-scrub starts 2024-02-19T21:36:15.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:14.779439+0000 osd.5 (osd.5) 87 : cluster [DBG] 6.a deep-scrub ok 2024-02-19T21:36:15.409 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:15.555 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:15.556 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:36:15.556 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:36:15.657 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:36:15.691 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:15.714 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:36:15.718 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:15.718 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:36:15.819 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:36:15.878 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:16.004 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:36:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:36:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:36:16.004 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:14.699452+0000 osd.3 (osd.3) 95 : cluster [DBG] 4.19 scrub starts 2024-02-19T21:36:16.005 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:14.711330+0000 osd.3 (osd.3) 96 : cluster [DBG] 4.19 scrub ok 2024-02-19T21:36:16.005 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:14.818022+0000 mgr.y (mgr.14514) 151 : cluster [DBG] pgmap v149: 148 pgs: 148 active+clean; 4.4 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 86 MiB/s wr, 1.38k op/s 2024-02-19T21:36:16.005 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:14.910222+0000 osd.6 (osd.6) 59 : cluster [DBG] 2.14 deep-scrub starts 2024-02-19T21:36:16.005 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:14.917577+0000 osd.6 (osd.6) 60 : cluster [DBG] 2.14 deep-scrub ok 2024-02-19T21:36:16.005 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:15.286563+0000 osd.0 (osd.0) 83 : cluster [DBG] 6.10 scrub starts 2024-02-19T21:36:16.005 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:15.297009+0000 osd.0 (osd.0) 84 : cluster [DBG] 6.10 scrub ok 2024-02-19T21:36:16.005 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:15.776453+0000 osd.5 (osd.5) 88 : cluster [DBG] 6.d scrub starts 2024-02-19T21:36:16.005 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:15.780071+0000 osd.5 (osd.5) 89 : cluster [DBG] 6.d scrub ok 2024-02-19T21:36:16.181 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 47 16 74281 74265 98.7068 62.875 0.0140459 0.0101271 2024-02-19T21:36:16.241 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:36:16.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:14.699452+0000 osd.3 (osd.3) 95 : cluster [DBG] 4.19 scrub starts 2024-02-19T21:36:16.245 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:14.711330+0000 osd.3 (osd.3) 96 : cluster [DBG] 4.19 scrub ok 2024-02-19T21:36:16.245 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:14.818022+0000 mgr.y (mgr.14514) 151 : cluster [DBG] pgmap v149: 148 pgs: 148 active+clean; 4.4 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 86 MiB/s wr, 1.38k op/s 2024-02-19T21:36:16.245 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:14.910222+0000 osd.6 (osd.6) 59 : cluster [DBG] 2.14 deep-scrub starts 2024-02-19T21:36:16.245 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:14.917577+0000 osd.6 (osd.6) 60 : cluster [DBG] 2.14 deep-scrub ok 2024-02-19T21:36:16.245 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:15.286563+0000 osd.0 (osd.0) 83 : cluster [DBG] 6.10 scrub starts 2024-02-19T21:36:16.245 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:15.297009+0000 osd.0 (osd.0) 84 : cluster [DBG] 6.10 scrub ok 2024-02-19T21:36:16.245 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:15.776453+0000 osd.5 (osd.5) 88 : cluster [DBG] 6.d scrub starts 2024-02-19T21:36:16.245 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:15.780071+0000 osd.5 (osd.5) 89 : cluster [DBG] 6.d scrub ok 2024-02-19T21:36:16.246 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:16.246 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:36:16.246 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:14.699452+0000 osd.3 (osd.3) 95 : cluster [DBG] 4.19 scrub starts 2024-02-19T21:36:16.246 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:14.711330+0000 osd.3 (osd.3) 96 : cluster [DBG] 4.19 scrub ok 2024-02-19T21:36:16.247 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:14.818022+0000 mgr.y (mgr.14514) 151 : cluster [DBG] pgmap v149: 148 pgs: 148 active+clean; 4.4 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 86 MiB/s wr, 1.38k op/s 2024-02-19T21:36:16.247 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:14.910222+0000 osd.6 (osd.6) 59 : cluster [DBG] 2.14 deep-scrub starts 2024-02-19T21:36:16.247 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:14.917577+0000 osd.6 (osd.6) 60 : cluster [DBG] 2.14 deep-scrub ok 2024-02-19T21:36:16.247 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:15.286563+0000 osd.0 (osd.0) 83 : cluster [DBG] 6.10 scrub starts 2024-02-19T21:36:16.247 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:15.297009+0000 osd.0 (osd.0) 84 : cluster [DBG] 6.10 scrub ok 2024-02-19T21:36:16.247 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:15.776453+0000 osd.5 (osd.5) 88 : cluster [DBG] 6.d scrub starts 2024-02-19T21:36:16.247 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:15.780071+0000 osd.5 (osd.5) 89 : cluster [DBG] 6.d scrub ok 2024-02-19T21:36:16.347 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:36:16.380 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:16.403 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:36:16.407 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:16.407 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:36:16.508 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:36:16.563 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:16.663 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:36:16.927 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:36:16.933 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:16.933 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:36:17.034 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:36:17.069 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:17.093 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:36:17.096 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:17.097 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:36:17.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:15.918460+0000 osd.1 (osd.1) 89 : cluster [DBG] 2.9 scrub starts 2024-02-19T21:36:17.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:15.923984+0000 osd.1 (osd.1) 90 : cluster [DBG] 2.9 scrub ok 2024-02-19T21:36:17.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:16.019997+0000 osd.2 (osd.2) 72 : cluster [DBG] 6.17 deep-scrub starts 2024-02-19T21:36:17.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:16.028939+0000 osd.2 (osd.2) 73 : cluster [DBG] 6.17 deep-scrub ok 2024-02-19T21:36:17.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:16.362579+0000 osd.5 (osd.5) 90 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:36:17.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:16.362634+0000 osd.5 (osd.5) 91 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:36:17.102 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:15.918460+0000 osd.1 (osd.1) 89 : cluster [DBG] 2.9 scrub starts 2024-02-19T21:36:17.102 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:15.923984+0000 osd.1 (osd.1) 90 : cluster [DBG] 2.9 scrub ok 2024-02-19T21:36:17.102 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:16.019997+0000 osd.2 (osd.2) 72 : cluster [DBG] 6.17 deep-scrub starts 2024-02-19T21:36:17.102 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:16.028939+0000 osd.2 (osd.2) 73 : cluster [DBG] 6.17 deep-scrub ok 2024-02-19T21:36:17.102 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:16.362579+0000 osd.5 (osd.5) 90 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:36:17.102 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:16.362634+0000 osd.5 (osd.5) 91 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:36:17.181 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 48 16 75264 75248 97.9306 61.4375 0.0206159 0.0102065 2024-02-19T21:36:17.197 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:36:17.232 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:17.257 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:36:17.261 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:17.261 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:36:17.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:15.918460+0000 osd.1 (osd.1) 89 : cluster [DBG] 2.9 scrub starts 2024-02-19T21:36:17.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:15.923984+0000 osd.1 (osd.1) 90 : cluster [DBG] 2.9 scrub ok 2024-02-19T21:36:17.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:16.019997+0000 osd.2 (osd.2) 72 : cluster [DBG] 6.17 deep-scrub starts 2024-02-19T21:36:17.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:16.028939+0000 osd.2 (osd.2) 73 : cluster [DBG] 6.17 deep-scrub ok 2024-02-19T21:36:17.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:16.362579+0000 osd.5 (osd.5) 90 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:36:17.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:16.362634+0000 osd.5 (osd.5) 91 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:36:17.362 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:36:17.427 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:18.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:16.819108+0000 mgr.y (mgr.14514) 152 : cluster [DBG] pgmap v150: 148 pgs: 148 active+clean; 4.4 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 1.0 KiB/s rd, 70 MiB/s wr, 1.11k op/s 2024-02-19T21:36:18.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:16.945536+0000 osd.6 (osd.6) 61 : cluster [DBG] 5.11 scrub starts 2024-02-19T21:36:18.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:16.949901+0000 osd.6 (osd.6) 62 : cluster [DBG] 5.11 scrub ok 2024-02-19T21:36:18.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:17.020955+0000 mon.a (mon.0) 821 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2024-02-19T21:36:18.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:17.842331+0000 osd.1 (osd.1) 91 : cluster [DBG] 4.f scrub starts 2024-02-19T21:36:18.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:17.850302+0000 osd.1 (osd.1) 92 : cluster [DBG] 4.f scrub ok 2024-02-19T21:36:18.181 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 49 16 76268 76252 97.2128 62.75 0.0117775 0.0102821 2024-02-19T21:36:18.299 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:36:18.303 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:18.303 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:36:18.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:16.819108+0000 mgr.y (mgr.14514) 152 : cluster [DBG] pgmap v150: 148 pgs: 148 active+clean; 4.4 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 1.0 KiB/s rd, 70 MiB/s wr, 1.11k op/s 2024-02-19T21:36:18.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:16.945536+0000 osd.6 (osd.6) 61 : cluster [DBG] 5.11 scrub starts 2024-02-19T21:36:18.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:16.949901+0000 osd.6 (osd.6) 62 : cluster [DBG] 5.11 scrub ok 2024-02-19T21:36:18.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:17.020955+0000 mon.a (mon.0) 821 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2024-02-19T21:36:18.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:17.842331+0000 osd.1 (osd.1) 91 : cluster [DBG] 4.f scrub starts 2024-02-19T21:36:18.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:17.850302+0000 osd.1 (osd.1) 92 : cluster [DBG] 4.f scrub ok 2024-02-19T21:36:18.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:16.819108+0000 mgr.y (mgr.14514) 152 : cluster [DBG] pgmap v150: 148 pgs: 148 active+clean; 4.4 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 1.0 KiB/s rd, 70 MiB/s wr, 1.11k op/s 2024-02-19T21:36:18.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:16.945536+0000 osd.6 (osd.6) 61 : cluster [DBG] 5.11 scrub starts 2024-02-19T21:36:18.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:16.949901+0000 osd.6 (osd.6) 62 : cluster [DBG] 5.11 scrub ok 2024-02-19T21:36:18.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:17.020955+0000 mon.a (mon.0) 821 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2024-02-19T21:36:18.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:17.842331+0000 osd.1 (osd.1) 91 : cluster [DBG] 4.f scrub starts 2024-02-19T21:36:18.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:17.850302+0000 osd.1 (osd.1) 92 : cluster [DBG] 4.f scrub ok 2024-02-19T21:36:18.404 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:36:18.437 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:18.462 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:36:18.464 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:18.465 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:36:18.565 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:36:18.618 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:18.771 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:36:18.774 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:18.774 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:36:18.813 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:36:18.875 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:36:18.907 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:18.933 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:36:18.937 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:18.938 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:36:19.039 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:36:19.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:18.227485+0000 mon.b (mon.1) 36 : audit [INF] from='client.? 172.21.15.80:0/1561000191' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:36:19.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:18.240354+0000 mon.a (mon.0) 822 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:36:19.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:18.929185+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:36:19.061 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-02-19T21:36:19.103 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:19.182 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 50 16 77238 77222 96.4791 60.625 0.0102194 0.01036 2024-02-19T21:36:19.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:18.227485+0000 mon.b (mon.1) 36 : audit [INF] from='client.? 172.21.15.80:0/1561000191' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:36:19.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:18.240354+0000 mon.a (mon.0) 822 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:36:19.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:18.929185+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:36:19.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:18.227485+0000 mon.b (mon.1) 36 : audit [INF] from='client.? 172.21.15.80:0/1561000191' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:36:19.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:18.240354+0000 mon.a (mon.0) 822 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:36:19.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:18.929185+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:36:19.533 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:36:19.557 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:36:19.563 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:19.564 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:36:19.606 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:36:19.606 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:36:19.665 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:36:19.700 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:19.724 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:36:19.727 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:19.728 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:36:19.829 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:36:19.897 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:19.930 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:36:19.938 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:19.938 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:36:20.039 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:36:20.073 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:20.101 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:36:20.105 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:20.106 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:36:20.183 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 51 16 78264 78248 95.8449 64.125 0.0156761 0.0104284 2024-02-19T21:36:20.206 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:36:20.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:18.825492+0000 mgr.y (mgr.14514) 153 : cluster [DBG] pgmap v152: 148 pgs: 148 active+clean; 4.4 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 1022 B/s rd, 69 MiB/s wr, 1.10k op/s 2024-02-19T21:36:20.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:19.027464+0000 mon.a (mon.0) 824 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:36:20.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:19.040212+0000 mon.a (mon.0) 825 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:36:20.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:19.040279+0000 mon.a (mon.0) 826 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2024-02-19T21:36:20.245 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:18.825492+0000 mgr.y (mgr.14514) 153 : cluster [DBG] pgmap v152: 148 pgs: 148 active+clean; 4.4 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 1022 B/s rd, 69 MiB/s wr, 1.10k op/s 2024-02-19T21:36:20.245 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:19.027464+0000 mon.a (mon.0) 824 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:36:20.245 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:19.040212+0000 mon.a (mon.0) 825 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:36:20.245 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:19.040279+0000 mon.a (mon.0) 826 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2024-02-19T21:36:20.257 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:20.308 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:36:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:36:20.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:18.825492+0000 mgr.y (mgr.14514) 153 : cluster [DBG] pgmap v152: 148 pgs: 148 active+clean; 4.4 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 1022 B/s rd, 69 MiB/s wr, 1.10k op/s 2024-02-19T21:36:20.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:19.027464+0000 mon.a (mon.0) 824 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:36:20.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:19.040212+0000 mon.a (mon.0) 825 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:36:20.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:19.040279+0000 mon.a (mon.0) 826 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2024-02-19T21:36:20.387 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:36:20.394 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:20.394 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:36:20.417 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.2 dump_blocked_ops 2024-02-19T21:36:20.496 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:36:20.566 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:20.693 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:36:20.698 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:20.699 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:36:20.800 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:36:20.855 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:20.882 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:36:20.885 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:20.885 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:36:20.986 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:36:21.040 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:36:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:36:20] "GET /metrics HTTP/1.1" 200 175334 "" "Prometheus/2.33.4" 2024-02-19T21:36:21.080 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:21.182 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 52 16 79197 79181 95.1232 58.3125 0.0157577 0.0105073 2024-02-19T21:36:21.184 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:36:21.190 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:21.190 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:36:21.291 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:36:21.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:19.968510+0000 mgr.y (mgr.14514) 154 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:36:21.322 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:21.336 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:19.968510+0000 mgr.y (mgr.14514) 154 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:36:21.338 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:19.968510+0000 mgr.y (mgr.14514) 154 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:36:21.346 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:36:21.350 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:21.350 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:36:21.451 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:36:21.485 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:21.512 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:36:21.515 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:21.516 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:36:21.616 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:36:21.678 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:21.723 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:36:21.737 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:21.737 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:36:21.838 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:36:21.897 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:22.079 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:20.828055+0000 mgr.y (mgr.14514) 155 : cluster [DBG] pgmap v154: 148 pgs: 148 active+clean; 4.8 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 81 MiB/s wr, 1.30k op/s 2024-02-19T21:36:22.185 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 53 16 80231 80215 94.5452 64.625 0.0139179 0.0105723 2024-02-19T21:36:22.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:20.828055+0000 mgr.y (mgr.14514) 155 : cluster [DBG] pgmap v154: 148 pgs: 148 active+clean; 4.8 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 81 MiB/s wr, 1.30k op/s 2024-02-19T21:36:22.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:20.828055+0000 mgr.y (mgr.14514) 155 : cluster [DBG] pgmap v154: 148 pgs: 148 active+clean; 4.8 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 81 MiB/s wr, 1.30k op/s 2024-02-19T21:36:23.000 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:36:23.054 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:23.055 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:36:23.155 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:36:23.186 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 54 16 81268 81252 93.9922 64.8125 0.011734 0.0106336 2024-02-19T21:36:23.187 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:23.210 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:36:23.217 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:23.217 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:36:23.318 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:36:23.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:22.357488+0000 osd.4 (osd.4) 79 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:36:23.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:22.357548+0000 osd.4 (osd.4) 80 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:36:23.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:22.357488+0000 osd.4 (osd.4) 79 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:36:23.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:22.357548+0000 osd.4 (osd.4) 80 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:36:23.380 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:23.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:22.357488+0000 osd.4 (osd.4) 79 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:36:23.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:22.357548+0000 osd.4 (osd.4) 80 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:36:24.187 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 55 15 82268 82253 93.4182 62.5625 0.0223758 0.0107 2024-02-19T21:36:24.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:22.739476+0000 osd.7 (osd.7) 77 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:36:24.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:22.739522+0000 osd.7 (osd.7) 78 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:36:24.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:22.828451+0000 mgr.y (mgr.14514) 156 : cluster [DBG] pgmap v155: 148 pgs: 148 active+clean; 4.8 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 639 B/s rd, 39 MiB/s wr, 620 op/s 2024-02-19T21:36:24.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:23.109996+0000 mon.a (mon.0) 827 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2024-02-19T21:36:24.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:22.739476+0000 osd.7 (osd.7) 77 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:36:24.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:22.739522+0000 osd.7 (osd.7) 78 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:36:24.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:22.828451+0000 mgr.y (mgr.14514) 156 : cluster [DBG] pgmap v155: 148 pgs: 148 active+clean; 4.8 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 639 B/s rd, 39 MiB/s wr, 620 op/s 2024-02-19T21:36:24.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:23.109996+0000 mon.a (mon.0) 827 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2024-02-19T21:36:24.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:22.739476+0000 osd.7 (osd.7) 77 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:36:24.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:22.739522+0000 osd.7 (osd.7) 78 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:36:24.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:22.828451+0000 mgr.y (mgr.14514) 156 : cluster [DBG] pgmap v155: 148 pgs: 148 active+clean; 4.8 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 639 B/s rd, 39 MiB/s wr, 620 op/s 2024-02-19T21:36:24.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:23.109996+0000 mon.a (mon.0) 827 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2024-02-19T21:36:25.187 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 56 16 83221 83205 92.8127 59.5 0.00774662 0.0107692 2024-02-19T21:36:25.879 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:36:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:36:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:36:26.188 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 57 16 84230 84214 92.2888 63.0625 0.0152423 0.0108302 2024-02-19T21:36:26.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:24.829223+0000 mgr.y (mgr.14514) 157 : cluster [DBG] pgmap v157: 148 pgs: 148 active+clean; 5.1 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.3 KiB/s rd, 80 MiB/s wr, 1.28k op/s 2024-02-19T21:36:26.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:24.880028+0000 mon.a (mon.0) 828 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2024-02-19T21:36:26.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:24.829223+0000 mgr.y (mgr.14514) 157 : cluster [DBG] pgmap v157: 148 pgs: 148 active+clean; 5.1 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.3 KiB/s rd, 80 MiB/s wr, 1.28k op/s 2024-02-19T21:36:26.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:24.880028+0000 mon.a (mon.0) 828 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2024-02-19T21:36:26.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:24.829223+0000 mgr.y (mgr.14514) 157 : cluster [DBG] pgmap v157: 148 pgs: 148 active+clean; 5.1 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.3 KiB/s rd, 80 MiB/s wr, 1.28k op/s 2024-02-19T21:36:26.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:24.880028+0000 mon.a (mon.0) 828 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2024-02-19T21:36:26.624 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-19T21:36:27.194 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 58 16 85145 85129 91.6799 57.1875 0.0108948 0.010902 2024-02-19T21:36:28.191 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 59 16 86124 86108 91.1633 61.1875 0.0074842 0.0109638 2024-02-19T21:36:28.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:26.829949+0000 mgr.y (mgr.14514) 158 : cluster [DBG] pgmap v159: 148 pgs: 148 active+clean; 5.1 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.3 KiB/s rd, 80 MiB/s wr, 1.28k op/s 2024-02-19T21:36:28.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:27.160997+0000 osd.6 (osd.6) 63 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:36:28.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:27.161048+0000 osd.6 (osd.6) 64 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:36:28.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:26.829949+0000 mgr.y (mgr.14514) 158 : cluster [DBG] pgmap v159: 148 pgs: 148 active+clean; 5.1 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.3 KiB/s rd, 80 MiB/s wr, 1.28k op/s 2024-02-19T21:36:28.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:27.160997+0000 osd.6 (osd.6) 63 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:36:28.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:27.161048+0000 osd.6 (osd.6) 64 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:36:28.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:26.829949+0000 mgr.y (mgr.14514) 158 : cluster [DBG] pgmap v159: 148 pgs: 148 active+clean; 5.1 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1.3 KiB/s rd, 80 MiB/s wr, 1.28k op/s 2024-02-19T21:36:28.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:27.160997+0000 osd.6 (osd.6) 63 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:36:28.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:27.161048+0000 osd.6 (osd.6) 64 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:36:29.191 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:2024-02-19T21:36:29.191112+0000 min lat: 0.00133551 max lat: 0.105691 avg lat: 0.0110163 2024-02-19T21:36:29.192 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-19T21:36:29.192 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 60 16 87177 87161 90.7408 65.8125 0.017283 0.0110163 2024-02-19T21:36:29.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:27.893391+0000 mon.a (mon.0) 829 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2024-02-19T21:36:29.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:27.893391+0000 mon.a (mon.0) 829 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2024-02-19T21:36:29.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:27.893391+0000 mon.a (mon.0) 829 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2024-02-19T21:36:29.672 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:36:29.675 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:29.676 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:36:29.777 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:36:29.813 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:29.838 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:36:29.840 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:29.841 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:36:29.941 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:36:29.976 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:29.998 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:36:30.000 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:30.001 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:36:30.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:28.830585+0000 mgr.y (mgr.14514) 159 : cluster [DBG] pgmap v161: 148 pgs: 148 active+clean; 5.1 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 853 B/s rd, 52 MiB/s wr, 839 op/s 2024-02-19T21:36:30.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:29.884259+0000 mon.a (mon.0) 830 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2024-02-19T21:36:30.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:28.830585+0000 mgr.y (mgr.14514) 159 : cluster [DBG] pgmap v161: 148 pgs: 148 active+clean; 5.1 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 853 B/s rd, 52 MiB/s wr, 839 op/s 2024-02-19T21:36:30.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:29.884259+0000 mon.a (mon.0) 830 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2024-02-19T21:36:30.101 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:36:30.160 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:30.191 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 61 16 88125 88109 90.2247 59.25 0.0119421 0.0110784 2024-02-19T21:36:30.308 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:36:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:36:30.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:28.830585+0000 mgr.y (mgr.14514) 159 : cluster [DBG] pgmap v161: 148 pgs: 148 active+clean; 5.1 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 853 B/s rd, 52 MiB/s wr, 839 op/s 2024-02-19T21:36:30.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:29.884259+0000 mon.a (mon.0) 830 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2024-02-19T21:36:31.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:29.978546+0000 mgr.y (mgr.14514) 160 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:36:31.099 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:36:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:36:30] "GET /metrics HTTP/1.1" 200 175334 "" "Prometheus/2.33.4" 2024-02-19T21:36:31.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:29.978546+0000 mgr.y (mgr.14514) 160 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:36:31.192 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 62 16 89063 89047 89.7148 58.625 0.0167322 0.0111409 2024-02-19T21:36:31.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:29.978546+0000 mgr.y (mgr.14514) 160 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:36:31.430 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:36:31.432 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:36:31.443 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:31.443 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:36:31.509 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:36:31.545 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:36:31.551 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:36:31.574 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:31.595 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:36:31.598 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:36:31.602 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:31.602 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:36:31.626 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:36:31.665 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:36:31.694 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:36:31.704 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:36:31.734 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:36:31.735 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:31.756 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:36:31.758 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:31.759 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:36:31.770 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:36:31.792 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:36:31.793 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:36:31.793 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:36:31.793 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:36:31.793 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:36:31.793 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:36:31.793 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:36:31.793 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:36:31.859 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:36:31.925 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:31.929 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:30.832642+0000 mgr.y (mgr.14514) 161 : cluster [DBG] pgmap v163: 148 pgs: 148 active+clean; 5.4 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 852 B/s rd, 51 MiB/s wr, 816 op/s 2024-02-19T21:36:31.929 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:31.439905+0000 mon.a (mon.0) 831 : audit [DBG] from='client.? 172.21.15.80:0/394001352' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:36:32.031 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:36:32.037 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:32.038 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:30.832642+0000 mgr.y (mgr.14514) 161 : cluster [DBG] pgmap v163: 148 pgs: 148 active+clean; 5.4 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 852 B/s rd, 51 MiB/s wr, 816 op/s 2024-02-19T21:36:32.038 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:31.439905+0000 mon.a (mon.0) 831 : audit [DBG] from='client.? 172.21.15.80:0/394001352' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:36:32.038 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:30.832642+0000 mgr.y (mgr.14514) 161 : cluster [DBG] pgmap v163: 148 pgs: 148 active+clean; 5.4 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 852 B/s rd, 51 MiB/s wr, 816 op/s 2024-02-19T21:36:32.038 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:31.439905+0000 mon.a (mon.0) 831 : audit [DBG] from='client.? 172.21.15.80:0/394001352' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:36:32.039 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:36:32.140 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:36:32.169 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:32.192 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 63 16 89933 89917 89.1541 54.375 0.0194452 0.0112117 2024-02-19T21:36:32.192 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:36:32.198 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:32.198 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:36:32.299 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:36:32.327 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:32.353 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:36:32.356 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:32.357 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:36:32.457 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:36:32.536 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:32.656 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:36:32.661 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:32.662 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:36:32.762 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:36:32.832 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:33.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:32.809228+0000 mon.a (mon.0) 832 : audit [INF] from='client.? 172.21.15.80:0/3227712804' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-02-19T21:36:33.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:32.809228+0000 mon.a (mon.0) 832 : audit [INF] from='client.? 172.21.15.80:0/3227712804' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-02-19T21:36:33.192 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 64 15 90816 90801 88.6245 55.25 0.00602433 0.0112798 2024-02-19T21:36:33.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:32.809228+0000 mon.a (mon.0) 832 : audit [INF] from='client.? 172.21.15.80:0/3227712804' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-02-19T21:36:33.466 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.1 to 1 (10000) 2024-02-19T21:36:33.708 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:36:34.193 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 65 16 91792 91776 88.1973 60.9375 0.0148804 0.0113331 2024-02-19T21:36:34.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:32.832965+0000 mgr.y (mgr.14514) 162 : cluster [DBG] pgmap v164: 148 pgs: 148 active+clean; 5.4 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 643 B/s rd, 38 MiB/s wr, 616 op/s 2024-02-19T21:36:34.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:32.940307+0000 mon.a (mon.0) 833 : audit [INF] from='client.? 172.21.15.80:0/3227712804' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-02-19T21:36:34.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:32.940364+0000 mon.a (mon.0) 834 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2024-02-19T21:36:34.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:33.925514+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:36:34.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:32.832965+0000 mgr.y (mgr.14514) 162 : cluster [DBG] pgmap v164: 148 pgs: 148 active+clean; 5.4 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 643 B/s rd, 38 MiB/s wr, 616 op/s 2024-02-19T21:36:34.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:32.940307+0000 mon.a (mon.0) 833 : audit [INF] from='client.? 172.21.15.80:0/3227712804' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-02-19T21:36:34.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:32.940364+0000 mon.a (mon.0) 834 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2024-02-19T21:36:34.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:33.925514+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:36:34.354 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:32.832965+0000 mgr.y (mgr.14514) 162 : cluster [DBG] pgmap v164: 148 pgs: 148 active+clean; 5.4 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 643 B/s rd, 38 MiB/s wr, 616 op/s 2024-02-19T21:36:34.354 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:32.940307+0000 mon.a (mon.0) 833 : audit [INF] from='client.? 172.21.15.80:0/3227712804' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-02-19T21:36:34.354 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:32.940364+0000 mon.a (mon.0) 834 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2024-02-19T21:36:34.354 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:33.925514+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:36:35.195 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 66 16 92822 92806 87.8335 64.375 0.0120828 0.01138 2024-02-19T21:36:35.343 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:36:35.697 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd reweight 2 1 2024-02-19T21:36:35.893 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:36:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:36:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:36:36.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:34.833743+0000 mgr.y (mgr.14514) 163 : cluster [DBG] pgmap v166: 148 pgs: 148 active+clean; 5.6 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.4 KiB/s rd, 86 MiB/s wr, 1.38k op/s 2024-02-19T21:36:36.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:34.884073+0000 mon.a (mon.0) 836 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2024-02-19T21:36:36.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:34.833743+0000 mgr.y (mgr.14514) 163 : cluster [DBG] pgmap v166: 148 pgs: 148 active+clean; 5.6 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.4 KiB/s rd, 86 MiB/s wr, 1.38k op/s 2024-02-19T21:36:36.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:34.884073+0000 mon.a (mon.0) 836 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2024-02-19T21:36:36.195 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 67 16 93712 93696 87.353 55.625 0.0175684 0.0114428 2024-02-19T21:36:36.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:34.833743+0000 mgr.y (mgr.14514) 163 : cluster [DBG] pgmap v166: 148 pgs: 148 active+clean; 5.6 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.4 KiB/s rd, 86 MiB/s wr, 1.38k op/s 2024-02-19T21:36:36.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:34.884073+0000 mon.a (mon.0) 836 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2024-02-19T21:36:37.196 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 68 16 94664 94648 86.9435 59.5 0.01134 0.0114969 2024-02-19T21:36:37.341 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:36:37.341 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-02-19T21:36:37.341 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-02-19T21:36:37.342 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-02-19T21:36:37.342 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:36:38.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:36.834080+0000 mgr.y (mgr.14514) 164 : cluster [DBG] pgmap v168: 148 pgs: 148 active+clean; 5.6 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 736 B/s rd, 42 MiB/s wr, 672 op/s 2024-02-19T21:36:38.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:36.834080+0000 mgr.y (mgr.14514) 164 : cluster [DBG] pgmap v168: 148 pgs: 148 active+clean; 5.6 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 736 B/s rd, 42 MiB/s wr, 672 op/s 2024-02-19T21:36:38.197 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 69 16 95586 95570 86.517 57.625 0.0169515 0.0115535 2024-02-19T21:36:38.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:36.834080+0000 mgr.y (mgr.14514) 164 : cluster [DBG] pgmap v168: 148 pgs: 148 active+clean; 5.6 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 736 B/s rd, 42 MiB/s wr, 672 op/s 2024-02-19T21:36:38.348 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.2 dump_historic_ops 2024-02-19T21:36:38.463 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:36:38.473 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:38.473 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:36:38.572 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:36:38.574 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:36:38.585 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:36:38.605 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:38.626 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:36:38.630 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:38.630 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:36:38.731 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:36:38.798 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-02-19T21:36:39.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:38.304511+0000 osd.3 (osd.3) 97 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:36:39.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:38.304564+0000 osd.3 (osd.3) 98 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:36:39.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:38.362555+0000 mon.c (mon.2) 29 : audit [INF] from='client.? 172.21.15.80:0/876559817' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:36:39.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:38.363154+0000 mon.a (mon.0) 837 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:36:39.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:38.304511+0000 osd.3 (osd.3) 97 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:36:39.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:38.304564+0000 osd.3 (osd.3) 98 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:36:39.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:38.362555+0000 mon.c (mon.2) 29 : audit [INF] from='client.? 172.21.15.80:0/876559817' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:36:39.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:38.363154+0000 mon.a (mon.0) 837 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:36:39.197 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 70 16 96445 96429 86.0481 53.6875 0.0201686 0.0116162 2024-02-19T21:36:39.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:38.304511+0000 osd.3 (osd.3) 97 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:36:39.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:38.304564+0000 osd.3 (osd.3) 98 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:36:39.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:38.362555+0000 mon.c (mon.2) 29 : audit [INF] from='client.? 172.21.15.80:0/876559817' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:36:39.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:38.363154+0000 mon.a (mon.0) 837 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:36:39.466 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:36:39.469 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:39.469 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:36:39.570 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:36:39.636 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:40.055 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:36:40.059 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:40.060 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:36:40.161 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:36:40.197 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 71 16 97401 97385 85.6778 59.75 0.0148111 0.0116663 2024-02-19T21:36:40.217 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:38.834688+0000 mgr.y (mgr.14514) 165 : cluster [DBG] pgmap v169: 148 pgs: 148 active+clean; 5.6 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 639 B/s rd, 36 MiB/s wr, 583 op/s 2024-02-19T21:36:40.217 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:38.908740+0000 mon.a (mon.0) 838 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:36:40.217 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:38.934204+0000 mon.a (mon.0) 839 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:36:40.217 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:38.934283+0000 mon.a (mon.0) 840 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2024-02-19T21:36:40.217 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:39.892412+0000 mon.a (mon.0) 841 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2024-02-19T21:36:40.218 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:38.834688+0000 mgr.y (mgr.14514) 165 : cluster [DBG] pgmap v169: 148 pgs: 148 active+clean; 5.6 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 639 B/s rd, 36 MiB/s wr, 583 op/s 2024-02-19T21:36:40.218 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:38.908740+0000 mon.a (mon.0) 838 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:36:40.218 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:38.934204+0000 mon.a (mon.0) 839 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:36:40.218 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:38.934283+0000 mon.a (mon.0) 840 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2024-02-19T21:36:40.218 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:39.892412+0000 mon.a (mon.0) 841 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2024-02-19T21:36:40.221 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:40.307 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:36:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:36:40.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:38.834688+0000 mgr.y (mgr.14514) 165 : cluster [DBG] pgmap v169: 148 pgs: 148 active+clean; 5.6 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 639 B/s rd, 36 MiB/s wr, 583 op/s 2024-02-19T21:36:40.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:38.908740+0000 mon.a (mon.0) 838 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:36:40.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:38.934204+0000 mon.a (mon.0) 839 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:36:40.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:38.934283+0000 mon.a (mon.0) 840 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2024-02-19T21:36:40.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:39.892412+0000 mon.a (mon.0) 841 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2024-02-19T21:36:40.848 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:36:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:36:40] "GET /metrics HTTP/1.1" 200 175348 "" "Prometheus/2.33.4" 2024-02-19T21:36:41.197 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 72 16 98365 98349 85.3247 60.25 0.0214386 0.0117153 2024-02-19T21:36:41.298 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:39.988577+0000 mgr.y (mgr.14514) 166 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:36:41.303 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:39.988577+0000 mgr.y (mgr.14514) 166 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:36:41.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:39.988577+0000 mgr.y (mgr.14514) 166 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:36:41.675 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:36:41.679 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:41.679 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:36:41.780 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:36:41.810 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:41.840 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:36:41.843 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:41.844 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:36:41.944 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:36:41.951 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:40.836655+0000 mgr.y (mgr.14514) 167 : cluster [DBG] pgmap v172: 148 pgs: 148 active+clean; 5.9 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 852 B/s rd, 48 MiB/s wr, 768 op/s 2024-02-19T21:36:41.951 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:41.574409+0000 osd.0 (osd.0) 85 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:36:41.951 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:41.574461+0000 osd.0 (osd.0) 86 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:36:42.019 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:42.197 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 73 16 99311 99295 84.9659 59.125 0.0203944 0.0117644 2024-02-19T21:36:42.218 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:40.836655+0000 mgr.y (mgr.14514) 167 : cluster [DBG] pgmap v172: 148 pgs: 148 active+clean; 5.9 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 852 B/s rd, 48 MiB/s wr, 768 op/s 2024-02-19T21:36:42.218 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:41.574409+0000 osd.0 (osd.0) 85 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:36:42.218 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:41.574461+0000 osd.0 (osd.0) 86 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:36:42.225 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:36:42.232 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:42.233 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:36:42.261 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:36:42.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:40.836655+0000 mgr.y (mgr.14514) 167 : cluster [DBG] pgmap v172: 148 pgs: 148 active+clean; 5.9 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 852 B/s rd, 48 MiB/s wr, 768 op/s 2024-02-19T21:36:42.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:41.574409+0000 osd.0 (osd.0) 85 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:36:42.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:41.574461+0000 osd.0 (osd.0) 86 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:36:42.333 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:36:42.367 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:42.390 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:36:42.396 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:42.396 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:36:42.497 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:36:42.528 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:42.550 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:36:42.555 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:42.555 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:36:42.623 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset noscrub 2024-02-19T21:36:42.656 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:36:42.685 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:42.708 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:36:42.710 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:42.711 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:36:42.812 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:36:42.893 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:43.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:41.962942+0000 mon.a (mon.0) 842 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2024-02-19T21:36:43.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:41.962942+0000 mon.a (mon.0) 842 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2024-02-19T21:36:43.199 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 74 16 100173 100157 84.5438 53.875 0.0107288 0.0118233 2024-02-19T21:36:43.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:41.962942+0000 mon.a (mon.0) 842 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2024-02-19T21:36:43.696 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:36:43.701 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:43.702 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:36:43.802 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:36:43.833 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:43.860 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:36:43.864 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:43.865 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:36:43.966 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:36:43.996 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:42.839368+0000 mgr.y (mgr.14514) 168 : cluster [DBG] pgmap v174: 148 pgs: 148 active+clean; 5.9 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 852 B/s rd, 48 MiB/s wr, 768 op/s 2024-02-19T21:36:43.997 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:43.464457+0000 mon.c (mon.2) 30 : audit [INF] from='client.? 172.21.15.80:0/2593467679' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-02-19T21:36:43.997 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:43.465945+0000 mon.a (mon.0) 843 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-02-19T21:36:43.997 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:44.011 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.2 to 1 (10000) 2024-02-19T21:36:44.022 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:36:44.025 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:44.025 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:36:44.126 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:36:44.200 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 75 16 101080 101064 84.1715 56.6875 0.0154687 0.0118765 2024-02-19T21:36:44.215 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:44.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:42.839368+0000 mgr.y (mgr.14514) 168 : cluster [DBG] pgmap v174: 148 pgs: 148 active+clean; 5.9 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 852 B/s rd, 48 MiB/s wr, 768 op/s 2024-02-19T21:36:44.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:43.464457+0000 mon.c (mon.2) 30 : audit [INF] from='client.? 172.21.15.80:0/2593467679' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-02-19T21:36:44.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:43.465945+0000 mon.a (mon.0) 843 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-02-19T21:36:44.336 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:36:44.340 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:44.341 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:36:44.341 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:42.839368+0000 mgr.y (mgr.14514) 168 : cluster [DBG] pgmap v174: 148 pgs: 148 active+clean; 5.9 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 852 B/s rd, 48 MiB/s wr, 768 op/s 2024-02-19T21:36:44.341 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:43.464457+0000 mon.c (mon.2) 30 : audit [INF] from='client.? 172.21.15.80:0/2593467679' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-02-19T21:36:44.342 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:43.465945+0000 mon.a (mon.0) 843 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-02-19T21:36:44.442 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:36:44.498 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:44.720 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:36:44.733 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:36:44.783 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:36:44.825 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:36:44.851 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:36:44.895 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:36:44.931 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:36:44.954 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:36:44.956 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:36:44.956 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:36:44.956 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:36:44.956 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:36:44.956 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:36:44.956 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:36:44.956 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:36:44.956 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:36:45.182 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd reweight 3 1 2024-02-19T21:36:45.200 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 76 16 101930 101914 83.7627 53.125 0.030477 0.0119337 2024-02-19T21:36:45.242 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:43.983838+0000 mon.a (mon.0) 844 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-02-19T21:36:45.242 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:43.983908+0000 mon.a (mon.0) 845 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2024-02-19T21:36:45.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:44.640990+0000 mon.a (mon.0) 846 : audit [DBG] from='client.? 172.21.15.80:0/3454827581' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:36:45.243 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:43.983838+0000 mon.a (mon.0) 844 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-02-19T21:36:45.243 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:43.983908+0000 mon.a (mon.0) 845 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2024-02-19T21:36:45.243 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:44.640990+0000 mon.a (mon.0) 846 : audit [DBG] from='client.? 172.21.15.80:0/3454827581' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:36:45.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:43.983838+0000 mon.a (mon.0) 844 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-02-19T21:36:45.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:43.983908+0000 mon.a (mon.0) 845 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2024-02-19T21:36:45.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:44.640990+0000 mon.a (mon.0) 846 : audit [DBG] from='client.? 172.21.15.80:0/3454827581' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:36:45.371 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:36:45.383 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:45.383 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:36:45.484 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:36:45.517 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:45.542 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:36:45.547 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:45.547 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:36:45.648 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:36:45.684 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:45.807 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:36:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:36:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:36:45.914 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:36:45.918 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:45.918 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:36:46.019 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:36:46.057 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:46.088 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:36:46.091 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:46.091 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:36:46.192 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:36:46.201 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 77 16 102857 102841 83.427 57.9375 0.0166298 0.0119823 2024-02-19T21:36:46.240 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:44.842775+0000 mgr.y (mgr.14514) 169 : cluster [DBG] pgmap v176: 148 pgs: 148 active+clean; 6.1 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 1.7 KiB/s rd, 85 MiB/s wr, 1.36k op/s 2024-02-19T21:36:46.240 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:45.612877+0000 osd.1 (osd.1) 93 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:36:46.240 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:45.612915+0000 osd.1 (osd.1) 94 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:36:46.240 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:44.842775+0000 mgr.y (mgr.14514) 169 : cluster [DBG] pgmap v176: 148 pgs: 148 active+clean; 6.1 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 1.7 KiB/s rd, 85 MiB/s wr, 1.36k op/s 2024-02-19T21:36:46.240 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:45.612877+0000 osd.1 (osd.1) 93 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:36:46.240 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:45.612915+0000 osd.1 (osd.1) 94 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:36:46.244 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:46.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:44.842775+0000 mgr.y (mgr.14514) 169 : cluster [DBG] pgmap v176: 148 pgs: 148 active+clean; 6.1 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 1.7 KiB/s rd, 85 MiB/s wr, 1.36k op/s 2024-02-19T21:36:46.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:45.612877+0000 osd.1 (osd.1) 93 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:36:46.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:45.612915+0000 osd.1 (osd.1) 94 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:36:46.533 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:36:46.537 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:46.537 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:36:46.541 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:36:46.638 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:36:46.667 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:46.689 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:36:46.693 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:46.694 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:36:46.794 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:36:46.847 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:47.201 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 78 16 103783 103767 83.0994 57.875 0.00878855 0.0120285 2024-02-19T21:36:47.336 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:36:47.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:46.094535+0000 mon.a (mon.0) 847 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2024-02-19T21:36:47.602 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:46.094535+0000 mon.a (mon.0) 847 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2024-02-19T21:36:47.602 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:46.094535+0000 mon.a (mon.0) 847 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2024-02-19T21:36:47.612 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:36:47.618 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:47.618 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:36:47.719 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:36:47.750 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:47.773 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:36:47.778 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:47.778 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:36:47.879 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:36:47.942 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:47.945 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:36:48.200 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:36:48.203 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 79 16 104678 104662 82.7557 55.9375 0.0280394 0.0120782 2024-02-19T21:36:48.207 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:48.208 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:46.843572+0000 mgr.y (mgr.14514) 170 : cluster [DBG] pgmap v178: 148 pgs: 148 active+clean; 6.2 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 852 B/s rd, 48 MiB/s wr, 765 op/s 2024-02-19T21:36:48.208 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:46.843572+0000 mgr.y (mgr.14514) 170 : cluster [DBG] pgmap v178: 148 pgs: 148 active+clean; 6.2 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 852 B/s rd, 48 MiB/s wr, 765 op/s 2024-02-19T21:36:48.208 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:36:48.309 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:36:48.360 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:48.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:46.843572+0000 mgr.y (mgr.14514) 170 : cluster [DBG] pgmap v178: 148 pgs: 148 active+clean; 6.2 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 852 B/s rd, 48 MiB/s wr, 765 op/s 2024-02-19T21:36:48.635 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:36:48.640 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:48.641 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:36:48.741 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:36:48.804 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:49.201 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:2024-02-19T21:36:49.201296+0000 min lat: 0.00133551 max lat: 0.105691 avg lat: 0.0121229 2024-02-19T21:36:49.202 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-19T21:36:49.202 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 80 16 105612 105596 82.451 58.375 0.018333 0.0121229 2024-02-19T21:36:50.152 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:48.844342+0000 mgr.y (mgr.14514) 171 : cluster [DBG] pgmap v179: 148 pgs: 148 active+clean; 6.2 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 744 B/s rd, 42 MiB/s wr, 668 op/s 2024-02-19T21:36:50.202 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 81 16 106566 106550 82.1684 59.625 0.00706128 0.0121651 2024-02-19T21:36:50.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:48.844342+0000 mgr.y (mgr.14514) 171 : cluster [DBG] pgmap v179: 148 pgs: 148 active+clean; 6.2 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 744 B/s rd, 42 MiB/s wr, 668 op/s 2024-02-19T21:36:50.308 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:36:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:36:50.576 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:36:50.576 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:36:50.598 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:36:50.603 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:50.603 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:48.844342+0000 mgr.y (mgr.14514) 171 : cluster [DBG] pgmap v179: 148 pgs: 148 active+clean; 6.2 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 744 B/s rd, 42 MiB/s wr, 668 op/s 2024-02-19T21:36:50.603 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:36:50.704 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:36:50.745 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:50.768 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:36:50.777 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:50.778 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:36:50.879 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:36:50.910 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:50.933 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:36:50.936 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:50.937 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:36:50.942 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:36:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:36:50] "GET /metrics HTTP/1.1" 200 175367 "" "Prometheus/2.33.4" 2024-02-19T21:36:51.037 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:36:51.071 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:51.104 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:36:51.109 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:51.109 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:36:51.202 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 82 16 107482 107466 81.8646 57.25 0.0172807 0.0122108 2024-02-19T21:36:51.210 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:36:51.281 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:49.998498+0000 mgr.y (mgr.14514) 172 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:36:51.282 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:49.998498+0000 mgr.y (mgr.14514) 172 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:36:51.282 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:51.328 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:36:51.333 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:51.333 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:36:51.434 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:36:51.463 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:49.998498+0000 mgr.y (mgr.14514) 172 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:36:51.466 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:51.493 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:36:51.498 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:51.498 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:36:51.599 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:36:51.636 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:51.669 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:36:51.674 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:51.674 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:36:51.775 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:36:51.842 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:52.105 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:36:52.116 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:36:52.123 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:52.124 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:36:52.131 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.3 dump_ops_in_flight 2024-02-19T21:36:52.202 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 83 16 108354 108338 81.535 54.5 0.0210914 0.0122587 2024-02-19T21:36:52.206 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-02-19T21:36:52.225 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:36:52.293 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:52.413 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:36:52.417 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:52.417 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:50.845110+0000 mgr.y (mgr.14514) 173 : cluster [DBG] pgmap v180: 148 pgs: 148 active+clean; 6.5 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 71 MiB/s wr, 1.14k op/s 2024-02-19T21:36:52.417 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:51.345748+0000 osd.2 (osd.2) 74 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:36:52.417 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:51.345804+0000 osd.2 (osd.2) 75 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:36:52.417 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:51.792655+0000 mon.a (mon.0) 848 : audit [INF] from='client.? 172.21.15.80:0/3991232257' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:36:52.418 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:52.064178+0000 mon.a (mon.0) 849 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:36:52.418 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:50.845110+0000 mgr.y (mgr.14514) 173 : cluster [DBG] pgmap v180: 148 pgs: 148 active+clean; 6.5 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 71 MiB/s wr, 1.14k op/s 2024-02-19T21:36:52.418 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:51.345748+0000 osd.2 (osd.2) 74 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:36:52.418 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:51.345804+0000 osd.2 (osd.2) 75 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:36:52.418 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:51.792655+0000 mon.a (mon.0) 848 : audit [INF] from='client.? 172.21.15.80:0/3991232257' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:36:52.418 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:52.064178+0000 mon.a (mon.0) 849 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:36:52.419 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:36:52.519 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:36:52.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:50.845110+0000 mgr.y (mgr.14514) 173 : cluster [DBG] pgmap v180: 148 pgs: 148 active+clean; 6.5 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 1.2 KiB/s rd, 71 MiB/s wr, 1.14k op/s 2024-02-19T21:36:52.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:51.345748+0000 osd.2 (osd.2) 74 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:36:52.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:51.345804+0000 osd.2 (osd.2) 75 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:36:52.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:51.792655+0000 mon.a (mon.0) 848 : audit [INF] from='client.? 172.21.15.80:0/3991232257' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:36:52.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:52.064178+0000 mon.a (mon.0) 849 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:36:52.598 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:53.203 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 84 16 109222 109206 81.2102 54.25 0.0191949 0.0123094 2024-02-19T21:36:53.465 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:36:53.473 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:53.474 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:52.166890+0000 mon.a (mon.0) 850 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:36:53.474 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:52.186979+0000 mon.a (mon.0) 851 : audit [INF] from='client.? 172.21.15.80:0/3991232257' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:36:53.474 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:52.187017+0000 mon.a (mon.0) 852 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2024-02-19T21:36:53.474 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:52.553697+0000 osd.3 (osd.3) 99 : cluster [DBG] 5.1c scrub starts 2024-02-19T21:36:53.474 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:52.565936+0000 osd.3 (osd.3) 100 : cluster [DBG] 5.1c scrub ok 2024-02-19T21:36:53.474 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:52.576643+0000 mon.a (mon.0) 853 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:36:53.474 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:52.579202+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:36:53.474 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:52.587897+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:36:53.475 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:52.166890+0000 mon.a (mon.0) 850 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:36:53.475 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:52.186979+0000 mon.a (mon.0) 851 : audit [INF] from='client.? 172.21.15.80:0/3991232257' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:36:53.475 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:52.187017+0000 mon.a (mon.0) 852 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2024-02-19T21:36:53.475 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:52.553697+0000 osd.3 (osd.3) 99 : cluster [DBG] 5.1c scrub starts 2024-02-19T21:36:53.475 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:52.565936+0000 osd.3 (osd.3) 100 : cluster [DBG] 5.1c scrub ok 2024-02-19T21:36:53.475 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:52.576643+0000 mon.a (mon.0) 853 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:36:53.475 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:52.579202+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:36:53.475 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:52.587897+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:36:53.476 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:36:53.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:52.166890+0000 mon.a (mon.0) 850 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:36:53.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:52.186979+0000 mon.a (mon.0) 851 : audit [INF] from='client.? 172.21.15.80:0/3991232257' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:36:53.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:52.187017+0000 mon.a (mon.0) 852 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2024-02-19T21:36:53.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:52.553697+0000 osd.3 (osd.3) 99 : cluster [DBG] 5.1c scrub starts 2024-02-19T21:36:53.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:52.565936+0000 osd.3 (osd.3) 100 : cluster [DBG] 5.1c scrub ok 2024-02-19T21:36:53.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:52.576643+0000 mon.a (mon.0) 853 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:36:53.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:52.579202+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:36:53.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:52.587897+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:36:53.577 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:36:53.604 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:53.631 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:36:53.635 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:53.635 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:36:53.736 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:36:53.802 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:54.203 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 85 16 110193 110177 80.9688 60.6875 0.00939355 0.0123459 2024-02-19T21:36:54.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:52.845492+0000 mgr.y (mgr.14514) 174 : cluster [DBG] pgmap v182: 148 pgs: 148 active+clean; 6.5 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 639 B/s rd, 45 MiB/s wr, 712 op/s 2024-02-19T21:36:54.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:53.476493+0000 osd.0 (osd.0) 87 : cluster [DBG] 4.16 scrub starts 2024-02-19T21:36:54.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:53.491272+0000 osd.0 (osd.0) 88 : cluster [DBG] 4.16 scrub ok 2024-02-19T21:36:54.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:53.594387+0000 osd.4 (osd.4) 81 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:36:54.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:53.600048+0000 osd.4 (osd.4) 82 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:36:54.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:52.845492+0000 mgr.y (mgr.14514) 174 : cluster [DBG] pgmap v182: 148 pgs: 148 active+clean; 6.5 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 639 B/s rd, 45 MiB/s wr, 712 op/s 2024-02-19T21:36:54.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:53.476493+0000 osd.0 (osd.0) 87 : cluster [DBG] 4.16 scrub starts 2024-02-19T21:36:54.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:53.491272+0000 osd.0 (osd.0) 88 : cluster [DBG] 4.16 scrub ok 2024-02-19T21:36:54.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:53.594387+0000 osd.4 (osd.4) 81 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:36:54.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:53.600048+0000 osd.4 (osd.4) 82 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:36:55.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:52.845492+0000 mgr.y (mgr.14514) 174 : cluster [DBG] pgmap v182: 148 pgs: 148 active+clean; 6.5 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 639 B/s rd, 45 MiB/s wr, 712 op/s 2024-02-19T21:36:55.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:53.476493+0000 osd.0 (osd.0) 87 : cluster [DBG] 4.16 scrub starts 2024-02-19T21:36:55.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:53.491272+0000 osd.0 (osd.0) 88 : cluster [DBG] 4.16 scrub ok 2024-02-19T21:36:55.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:53.594387+0000 osd.4 (osd.4) 81 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:36:55.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:53.600048+0000 osd.4 (osd.4) 82 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:36:55.072 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:36:55.078 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:36:55.079 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:36:55.180 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:36:55.203 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 86 16 111156 111140 80.7271 60.1875 0.00569542 0.0123823 2024-02-19T21:36:55.234 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:36:56.057 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:36:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:36:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:36:56.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:54.554656+0000 osd.4 (osd.4) 83 : cluster [DBG] 2.f scrub starts 2024-02-19T21:36:56.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:54.560979+0000 osd.4 (osd.4) 84 : cluster [DBG] 2.f scrub ok 2024-02-19T21:36:56.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:54.640216+0000 osd.3 (osd.3) 101 : cluster [DBG] 5.17 scrub starts 2024-02-19T21:36:56.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:54.644114+0000 osd.3 (osd.3) 102 : cluster [DBG] 5.17 scrub ok 2024-02-19T21:36:56.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:55.527967+0000 mon.a (mon.0) 856 : audit [INF] from='client.? 172.21.15.80:0/2093089525' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-02-19T21:36:56.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:54.554656+0000 osd.4 (osd.4) 83 : cluster [DBG] 2.f scrub starts 2024-02-19T21:36:56.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:54.560979+0000 osd.4 (osd.4) 84 : cluster [DBG] 2.f scrub ok 2024-02-19T21:36:56.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:54.640216+0000 osd.3 (osd.3) 101 : cluster [DBG] 5.17 scrub starts 2024-02-19T21:36:56.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:54.644114+0000 osd.3 (osd.3) 102 : cluster [DBG] 5.17 scrub ok 2024-02-19T21:36:56.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:55.527967+0000 mon.a (mon.0) 856 : audit [INF] from='client.? 172.21.15.80:0/2093089525' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-02-19T21:36:56.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:54.554656+0000 osd.4 (osd.4) 83 : cluster [DBG] 2.f scrub starts 2024-02-19T21:36:56.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:54.560979+0000 osd.4 (osd.4) 84 : cluster [DBG] 2.f scrub ok 2024-02-19T21:36:56.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:54.640216+0000 osd.3 (osd.3) 101 : cluster [DBG] 5.17 scrub starts 2024-02-19T21:36:56.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:54.644114+0000 osd.3 (osd.3) 102 : cluster [DBG] 5.17 scrub ok 2024-02-19T21:36:56.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:55.527967+0000 mon.a (mon.0) 856 : audit [INF] from='client.? 172.21.15.80:0/2093089525' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-02-19T21:36:56.205 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 87 16 112003 111987 80.4077 52.9375 0.0229606 0.012432 2024-02-19T21:36:56.707 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.3 to 1 (10000) 2024-02-19T21:36:57.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:54.846252+0000 mgr.y (mgr.14514) 175 : cluster [DBG] pgmap v183: 148 pgs: 148 active+clean; 6.7 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.1 KiB/s rd, 58 MiB/s wr, 924 op/s 2024-02-19T21:36:57.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:55.498540+0000 osd.0 (osd.0) 89 : cluster [DBG] 6.9 scrub starts 2024-02-19T21:36:57.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:55.508701+0000 osd.0 (osd.0) 90 : cluster [DBG] 6.9 scrub ok 2024-02-19T21:36:57.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:55.587375+0000 osd.4 (osd.4) 85 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:36:57.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:55.590416+0000 osd.4 (osd.4) 86 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:36:57.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:36:55.605303+0000 mon.a (mon.0) 857 : audit [INF] from='client.? 172.21.15.80:0/2093089525' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-02-19T21:36:57.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:55.605360+0000 mon.a (mon.0) 858 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2024-02-19T21:36:57.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:54.846252+0000 mgr.y (mgr.14514) 175 : cluster [DBG] pgmap v183: 148 pgs: 148 active+clean; 6.7 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.1 KiB/s rd, 58 MiB/s wr, 924 op/s 2024-02-19T21:36:57.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:55.498540+0000 osd.0 (osd.0) 89 : cluster [DBG] 6.9 scrub starts 2024-02-19T21:36:57.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:55.508701+0000 osd.0 (osd.0) 90 : cluster [DBG] 6.9 scrub ok 2024-02-19T21:36:57.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:55.587375+0000 osd.4 (osd.4) 85 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:36:57.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:55.590416+0000 osd.4 (osd.4) 86 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:36:57.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:36:55.605303+0000 mon.a (mon.0) 857 : audit [INF] from='client.? 172.21.15.80:0/2093089525' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-02-19T21:36:57.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:55.605360+0000 mon.a (mon.0) 858 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2024-02-19T21:36:57.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:54.846252+0000 mgr.y (mgr.14514) 175 : cluster [DBG] pgmap v183: 148 pgs: 148 active+clean; 6.7 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.1 KiB/s rd, 58 MiB/s wr, 924 op/s 2024-02-19T21:36:57.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:55.498540+0000 osd.0 (osd.0) 89 : cluster [DBG] 6.9 scrub starts 2024-02-19T21:36:57.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:55.508701+0000 osd.0 (osd.0) 90 : cluster [DBG] 6.9 scrub ok 2024-02-19T21:36:57.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:55.587375+0000 osd.4 (osd.4) 85 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:36:57.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:55.590416+0000 osd.4 (osd.4) 86 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:36:57.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:36:55.605303+0000 mon.a (mon.0) 857 : audit [INF] from='client.? 172.21.15.80:0/2093089525' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-02-19T21:36:57.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:55.605360+0000 mon.a (mon.0) 858 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2024-02-19T21:36:57.204 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 88 15 112896 112881 80.129 55.875 0.0151055 0.0124757 2024-02-19T21:36:58.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:55.986110+0000 osd.2 (osd.2) 76 : cluster [DBG] 4.1c scrub starts 2024-02-19T21:36:58.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:55.991764+0000 osd.2 (osd.2) 77 : cluster [DBG] 4.1c scrub ok 2024-02-19T21:36:58.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:56.027521+0000 osd.6 (osd.6) 65 : cluster [DBG] 4.1f scrub starts 2024-02-19T21:36:58.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:56.036178+0000 osd.6 (osd.6) 66 : cluster [DBG] 4.1f scrub ok 2024-02-19T21:36:58.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:56.498240+0000 osd.0 (osd.0) 91 : cluster [DBG] 4.b scrub starts 2024-02-19T21:36:58.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:56.503772+0000 osd.0 (osd.0) 92 : cluster [DBG] 4.b scrub ok 2024-02-19T21:36:58.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:56.716740+0000 osd.1 (osd.1) 95 : cluster [DBG] 4.9 scrub starts 2024-02-19T21:36:58.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:56.732440+0000 osd.1 (osd.1) 96 : cluster [DBG] 4.9 scrub ok 2024-02-19T21:36:58.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:55.986110+0000 osd.2 (osd.2) 76 : cluster [DBG] 4.1c scrub starts 2024-02-19T21:36:58.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:55.991764+0000 osd.2 (osd.2) 77 : cluster [DBG] 4.1c scrub ok 2024-02-19T21:36:58.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:56.027521+0000 osd.6 (osd.6) 65 : cluster [DBG] 4.1f scrub starts 2024-02-19T21:36:58.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:56.036178+0000 osd.6 (osd.6) 66 : cluster [DBG] 4.1f scrub ok 2024-02-19T21:36:58.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:56.498240+0000 osd.0 (osd.0) 91 : cluster [DBG] 4.b scrub starts 2024-02-19T21:36:58.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:56.503772+0000 osd.0 (osd.0) 92 : cluster [DBG] 4.b scrub ok 2024-02-19T21:36:58.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:56.716740+0000 osd.1 (osd.1) 95 : cluster [DBG] 4.9 scrub starts 2024-02-19T21:36:58.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:56.732440+0000 osd.1 (osd.1) 96 : cluster [DBG] 4.9 scrub ok 2024-02-19T21:36:58.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:55.986110+0000 osd.2 (osd.2) 76 : cluster [DBG] 4.1c scrub starts 2024-02-19T21:36:58.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:55.991764+0000 osd.2 (osd.2) 77 : cluster [DBG] 4.1c scrub ok 2024-02-19T21:36:58.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:56.027521+0000 osd.6 (osd.6) 65 : cluster [DBG] 4.1f scrub starts 2024-02-19T21:36:58.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:56.036178+0000 osd.6 (osd.6) 66 : cluster [DBG] 4.1f scrub ok 2024-02-19T21:36:58.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:56.498240+0000 osd.0 (osd.0) 91 : cluster [DBG] 4.b scrub starts 2024-02-19T21:36:58.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:56.503772+0000 osd.0 (osd.0) 92 : cluster [DBG] 4.b scrub ok 2024-02-19T21:36:58.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:56.716740+0000 osd.1 (osd.1) 95 : cluster [DBG] 4.9 scrub starts 2024-02-19T21:36:58.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:56.732440+0000 osd.1 (osd.1) 96 : cluster [DBG] 4.9 scrub ok 2024-02-19T21:36:58.203 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 89 16 113865 113849 79.9085 60.5 0.0145037 0.0125103 2024-02-19T21:36:59.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:56.846639+0000 mgr.y (mgr.14514) 176 : cluster [DBG] pgmap v185: 148 pgs: 148 active+clean; 6.8 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 1.2 KiB/s rd, 72 MiB/s wr, 1.15k op/s 2024-02-19T21:36:59.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:56.994168+0000 osd.2 (osd.2) 78 : cluster [DBG] 5.b scrub starts 2024-02-19T21:36:59.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:57.003980+0000 osd.2 (osd.2) 79 : cluster [DBG] 5.b scrub ok 2024-02-19T21:36:59.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:57.706632+0000 osd.3 (osd.3) 103 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:36:59.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:57.707834+0000 osd.3 (osd.3) 104 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:36:59.106 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:56.846639+0000 mgr.y (mgr.14514) 176 : cluster [DBG] pgmap v185: 148 pgs: 148 active+clean; 6.8 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 1.2 KiB/s rd, 72 MiB/s wr, 1.15k op/s 2024-02-19T21:36:59.106 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:56.994168+0000 osd.2 (osd.2) 78 : cluster [DBG] 5.b scrub starts 2024-02-19T21:36:59.106 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:57.003980+0000 osd.2 (osd.2) 79 : cluster [DBG] 5.b scrub ok 2024-02-19T21:36:59.106 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:57.706632+0000 osd.3 (osd.3) 103 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:36:59.106 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:57.707834+0000 osd.3 (osd.3) 104 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:36:59.107 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:56.846639+0000 mgr.y (mgr.14514) 176 : cluster [DBG] pgmap v185: 148 pgs: 148 active+clean; 6.8 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 1.2 KiB/s rd, 72 MiB/s wr, 1.15k op/s 2024-02-19T21:36:59.107 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:56.994168+0000 osd.2 (osd.2) 78 : cluster [DBG] 5.b scrub starts 2024-02-19T21:36:59.107 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:57.003980+0000 osd.2 (osd.2) 79 : cluster [DBG] 5.b scrub ok 2024-02-19T21:36:59.107 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:57.706632+0000 osd.3 (osd.3) 103 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:36:59.107 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:57.707834+0000 osd.3 (osd.3) 104 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:36:59.203 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Total time run: 90.0099 2024-02-19T21:36:59.204 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Total writes made: 114731 2024-02-19T21:36:59.204 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Write size: 65536 2024-02-19T21:36:59.204 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Object size: 65536 2024-02-19T21:36:59.204 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Bandwidth (MB/sec): 79.6655 2024-02-19T21:36:59.204 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Stddev Bandwidth: 32.1004 2024-02-19T21:36:59.204 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Max bandwidth (MB/sec): 197.75 2024-02-19T21:36:59.204 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Min bandwidth (MB/sec): 52.9375 2024-02-19T21:36:59.204 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Average IOPS: 1274 2024-02-19T21:36:59.204 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Stddev IOPS: 513.607 2024-02-19T21:36:59.204 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Max IOPS: 3164 2024-02-19T21:36:59.204 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Min IOPS: 847 2024-02-19T21:36:59.204 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Average Latency(s): 0.012549 2024-02-19T21:36:59.205 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Stddev Latency(s): 0.0072533 2024-02-19T21:36:59.205 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Max latency(s): 0.105691 2024-02-19T21:36:59.205 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Min latency(s): 0.00133551 2024-02-19T21:36:59.207 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Cleaning up (deleting benchmark objects) 2024-02-19T21:37:00.009 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:57.983152+0000 osd.2 (osd.2) 80 : cluster [DBG] 6.f scrub starts 2024-02-19T21:37:00.009 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:57.989412+0000 osd.2 (osd.2) 81 : cluster [DBG] 6.f scrub ok 2024-02-19T21:37:00.009 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:36:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:58.541586+0000 osd.0 (osd.0) 93 : cluster [DBG] 7.6 scrub starts 2024-02-19T21:37:00.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:57.983152+0000 osd.2 (osd.2) 80 : cluster [DBG] 6.f scrub starts 2024-02-19T21:37:00.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:57.989412+0000 osd.2 (osd.2) 81 : cluster [DBG] 6.f scrub ok 2024-02-19T21:37:00.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:36:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:58.541586+0000 osd.0 (osd.0) 93 : cluster [DBG] 7.6 scrub starts 2024-02-19T21:37:00.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:57.983152+0000 osd.2 (osd.2) 80 : cluster [DBG] 6.f scrub starts 2024-02-19T21:37:00.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:57.989412+0000 osd.2 (osd.2) 81 : cluster [DBG] 6.f scrub ok 2024-02-19T21:37:00.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:36:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:58.541586+0000 osd.0 (osd.0) 93 : cluster [DBG] 7.6 scrub starts 2024-02-19T21:37:00.307 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:37:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:37:01.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:36:58.847310+0000 mgr.y (mgr.14514) 177 : cluster [DBG] pgmap v186: 148 pgs: 148 active+clean; 6.8 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 639 B/s rd, 36 MiB/s wr, 577 op/s 2024-02-19T21:37:01.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:00.008500+0000 mgr.y (mgr.14514) 178 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:37:01.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:36:58.847310+0000 mgr.y (mgr.14514) 177 : cluster [DBG] pgmap v186: 148 pgs: 148 active+clean; 6.8 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 639 B/s rd, 36 MiB/s wr, 577 op/s 2024-02-19T21:37:01.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:00.008500+0000 mgr.y (mgr.14514) 178 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:37:01.098 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:37:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:37:00] "GET /metrics HTTP/1.1" 200 175367 "" "Prometheus/2.33.4" 2024-02-19T21:37:01.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:36:58.847310+0000 mgr.y (mgr.14514) 177 : cluster [DBG] pgmap v186: 148 pgs: 148 active+clean; 6.8 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 639 B/s rd, 36 MiB/s wr, 577 op/s 2024-02-19T21:37:01.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:00.008500+0000 mgr.y (mgr.14514) 178 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:37:02.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:00.848045+0000 mgr.y (mgr.14514) 179 : cluster [DBG] pgmap v187: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 7.0 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.3 KiB/s rd, 62 MiB/s wr, 1.06k op/s 2024-02-19T21:37:02.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:00.848045+0000 mgr.y (mgr.14514) 179 : cluster [DBG] pgmap v187: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 7.0 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.3 KiB/s rd, 62 MiB/s wr, 1.06k op/s 2024-02-19T21:37:02.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:00.848045+0000 mgr.y (mgr.14514) 179 : cluster [DBG] pgmap v187: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 7.0 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.3 KiB/s rd, 62 MiB/s wr, 1.06k op/s 2024-02-19T21:37:03.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:01.782502+0000 osd.0 (osd.0) 94 : cluster [DBG] 7.6 scrub ok 2024-02-19T21:37:03.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:01.885973+0000 osd.2 (osd.2) 82 : cluster [DBG] 7.e scrub starts 2024-02-19T21:37:03.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:01.782502+0000 osd.0 (osd.0) 94 : cluster [DBG] 7.6 scrub ok 2024-02-19T21:37:03.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:01.885973+0000 osd.2 (osd.2) 82 : cluster [DBG] 7.e scrub starts 2024-02-19T21:37:03.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:01.782502+0000 osd.0 (osd.0) 94 : cluster [DBG] 7.6 scrub ok 2024-02-19T21:37:03.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:01.885973+0000 osd.2 (osd.2) 82 : cluster [DBG] 7.e scrub starts 2024-02-19T21:37:04.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:02.849433+0000 mgr.y (mgr.14514) 180 : cluster [DBG] pgmap v188: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 7.0 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.1 KiB/s rd, 53 MiB/s wr, 916 op/s 2024-02-19T21:37:04.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:02.849433+0000 mgr.y (mgr.14514) 180 : cluster [DBG] pgmap v188: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 7.0 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.1 KiB/s rd, 53 MiB/s wr, 916 op/s 2024-02-19T21:37:04.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:02.849433+0000 mgr.y (mgr.14514) 180 : cluster [DBG] pgmap v188: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 7.0 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.1 KiB/s rd, 53 MiB/s wr, 916 op/s 2024-02-19T21:37:05.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:04.478169+0000 osd.4 (osd.4) 87 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:37:05.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:04.481750+0000 osd.4 (osd.4) 88 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:37:05.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:04.478169+0000 osd.4 (osd.4) 87 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:37:05.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:04.481750+0000 osd.4 (osd.4) 88 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:37:05.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:04.478169+0000 osd.4 (osd.4) 87 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:37:05.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:04.481750+0000 osd.4 (osd.4) 88 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:37:05.449 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:37:05.452 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:05.453 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:37:05.553 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:37:05.617 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:05.742 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:37:05.747 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:05.747 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:37:05.848 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:37:05.874 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:37:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:37:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:37:05.876 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:05.905 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:37:05.907 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:05.908 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:37:06.008 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:37:06.074 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:06.074 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:04.850148+0000 mgr.y (mgr.14514) 181 : cluster [DBG] pgmap v189: 148 pgs: 2 active+clean+scrubbing, 146 active+clean; 6.7 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 1.1 KiB/s rd, 31 MiB/s wr, 918 op/s 2024-02-19T21:37:06.075 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:05.681994+0000 osd.3 (osd.3) 105 : cluster [DBG] 6.2 scrub starts 2024-02-19T21:37:06.075 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:05.692948+0000 osd.3 (osd.3) 106 : cluster [DBG] 6.2 scrub ok 2024-02-19T21:37:06.075 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:04.850148+0000 mgr.y (mgr.14514) 181 : cluster [DBG] pgmap v189: 148 pgs: 2 active+clean+scrubbing, 146 active+clean; 6.7 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 1.1 KiB/s rd, 31 MiB/s wr, 918 op/s 2024-02-19T21:37:06.075 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:05.681994+0000 osd.3 (osd.3) 105 : cluster [DBG] 6.2 scrub starts 2024-02-19T21:37:06.075 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:05.692948+0000 osd.3 (osd.3) 106 : cluster [DBG] 6.2 scrub ok 2024-02-19T21:37:06.202 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:37:06.209 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:06.209 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:37:06.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:04.850148+0000 mgr.y (mgr.14514) 181 : cluster [DBG] pgmap v189: 148 pgs: 2 active+clean+scrubbing, 146 active+clean; 6.7 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 1.1 KiB/s rd, 31 MiB/s wr, 918 op/s 2024-02-19T21:37:06.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:05.681994+0000 osd.3 (osd.3) 105 : cluster [DBG] 6.2 scrub starts 2024-02-19T21:37:06.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:05.692948+0000 osd.3 (osd.3) 106 : cluster [DBG] 6.2 scrub ok 2024-02-19T21:37:06.309 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:37:06.342 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:06.370 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:37:06.373 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:06.373 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:37:06.474 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:37:06.554 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:06.603 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:37:06.612 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:06.613 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:37:06.714 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:37:06.746 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:06.769 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:37:06.773 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:06.774 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:37:06.875 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:37:06.911 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:06.933 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:37:06.936 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:06.936 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:37:07.037 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:37:07.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:05.415965+0000 osd.2 (osd.2) 83 : cluster [DBG] 7.e scrub ok 2024-02-19T21:37:07.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:05.917528+0000 osd.6 (osd.6) 67 : cluster [DBG] 5.2 scrub starts 2024-02-19T21:37:07.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:05.923204+0000 osd.6 (osd.6) 68 : cluster [DBG] 5.2 scrub ok 2024-02-19T21:37:07.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:05.930426+0000 osd.5 (osd.5) 92 : cluster [DBG] 4.8 scrub starts 2024-02-19T21:37:07.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:05.934026+0000 osd.5 (osd.5) 93 : cluster [DBG] 4.8 scrub ok 2024-02-19T21:37:07.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:06.531042+0000 osd.0 (osd.0) 95 : cluster [DBG] 5.1e scrub starts 2024-02-19T21:37:07.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:06.536115+0000 osd.0 (osd.0) 96 : cluster [DBG] 5.1e scrub ok 2024-02-19T21:37:07.072 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:07.101 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:37:07.105 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:07.106 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:37:07.164 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:37:07.184 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd reweight 4 1 2024-02-19T21:37:07.185 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:05.415965+0000 osd.2 (osd.2) 83 : cluster [DBG] 7.e scrub ok 2024-02-19T21:37:07.185 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:05.917528+0000 osd.6 (osd.6) 67 : cluster [DBG] 5.2 scrub starts 2024-02-19T21:37:07.185 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:05.923204+0000 osd.6 (osd.6) 68 : cluster [DBG] 5.2 scrub ok 2024-02-19T21:37:07.185 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:05.930426+0000 osd.5 (osd.5) 92 : cluster [DBG] 4.8 scrub starts 2024-02-19T21:37:07.185 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:05.934026+0000 osd.5 (osd.5) 93 : cluster [DBG] 4.8 scrub ok 2024-02-19T21:37:07.186 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:06.531042+0000 osd.0 (osd.0) 95 : cluster [DBG] 5.1e scrub starts 2024-02-19T21:37:07.186 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:06.536115+0000 osd.0 (osd.0) 96 : cluster [DBG] 5.1e scrub ok 2024-02-19T21:37:07.186 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:05.415965+0000 osd.2 (osd.2) 83 : cluster [DBG] 7.e scrub ok 2024-02-19T21:37:07.186 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:05.917528+0000 osd.6 (osd.6) 67 : cluster [DBG] 5.2 scrub starts 2024-02-19T21:37:07.186 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:05.923204+0000 osd.6 (osd.6) 68 : cluster [DBG] 5.2 scrub ok 2024-02-19T21:37:07.186 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:05.930426+0000 osd.5 (osd.5) 92 : cluster [DBG] 4.8 scrub starts 2024-02-19T21:37:07.186 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:05.934026+0000 osd.5 (osd.5) 93 : cluster [DBG] 4.8 scrub ok 2024-02-19T21:37:07.186 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:06.531042+0000 osd.0 (osd.0) 95 : cluster [DBG] 5.1e scrub starts 2024-02-19T21:37:07.186 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:06.536115+0000 osd.0 (osd.0) 96 : cluster [DBG] 5.1e scrub ok 2024-02-19T21:37:07.206 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:37:07.315 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:07.765 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-19T21:37:07.805 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:37:07.809 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:07.810 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:37:07.910 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:37:07.942 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:07.967 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:37:07.972 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:07.973 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:37:07.997 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:37:08.029 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:37:08.059 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:37:08.074 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:37:08.101 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:08.107 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:37:08.127 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:37:08.132 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:08.133 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:37:08.137 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:37:08.193 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:37:08.229 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:37:08.233 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:37:08.262 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:06.850560+0000 mgr.y (mgr.14514) 182 : cluster [DBG] pgmap v190: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 6.7 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1001 B/s rd, 22 MiB/s wr, 828 op/s 2024-02-19T21:37:08.262 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:06.955140+0000 osd.7 (osd.7) 79 : cluster [DBG] 2.1c scrub starts 2024-02-19T21:37:08.262 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:06.962240+0000 osd.7 (osd.7) 80 : cluster [DBG] 2.1c scrub ok 2024-02-19T21:37:08.262 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:06.979362+0000 osd.5 (osd.5) 94 : cluster [DBG] 5.f scrub starts 2024-02-19T21:37:08.262 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:06.982276+0000 osd.5 (osd.5) 95 : cluster [DBG] 5.f scrub ok 2024-02-19T21:37:08.262 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:07.607021+0000 osd.3 (osd.3) 107 : cluster [DBG] 5.0 scrub starts 2024-02-19T21:37:08.262 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:07.618607+0000 osd.3 (osd.3) 108 : cluster [DBG] 5.0 scrub ok 2024-02-19T21:37:08.264 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:08.274 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:37:08.292 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:37:08.294 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:08.294 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:37:08.296 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:37:08.296 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:37:08.296 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:37:08.296 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:37:08.296 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:37:08.296 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:37:08.296 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:37:08.297 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:37:08.323 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:06.850560+0000 mgr.y (mgr.14514) 182 : cluster [DBG] pgmap v190: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 6.7 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1001 B/s rd, 22 MiB/s wr, 828 op/s 2024-02-19T21:37:08.323 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:06.955140+0000 osd.7 (osd.7) 79 : cluster [DBG] 2.1c scrub starts 2024-02-19T21:37:08.324 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:06.962240+0000 osd.7 (osd.7) 80 : cluster [DBG] 2.1c scrub ok 2024-02-19T21:37:08.324 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:06.979362+0000 osd.5 (osd.5) 94 : cluster [DBG] 5.f scrub starts 2024-02-19T21:37:08.324 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:06.982276+0000 osd.5 (osd.5) 95 : cluster [DBG] 5.f scrub ok 2024-02-19T21:37:08.324 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:07.607021+0000 osd.3 (osd.3) 107 : cluster [DBG] 5.0 scrub starts 2024-02-19T21:37:08.324 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:07.618607+0000 osd.3 (osd.3) 108 : cluster [DBG] 5.0 scrub ok 2024-02-19T21:37:08.326 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:06.850560+0000 mgr.y (mgr.14514) 182 : cluster [DBG] pgmap v190: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 6.7 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1001 B/s rd, 22 MiB/s wr, 828 op/s 2024-02-19T21:37:08.326 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:06.955140+0000 osd.7 (osd.7) 79 : cluster [DBG] 2.1c scrub starts 2024-02-19T21:37:08.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:06.962240+0000 osd.7 (osd.7) 80 : cluster [DBG] 2.1c scrub ok 2024-02-19T21:37:08.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:06.979362+0000 osd.5 (osd.5) 94 : cluster [DBG] 5.f scrub starts 2024-02-19T21:37:08.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:06.982276+0000 osd.5 (osd.5) 95 : cluster [DBG] 5.f scrub ok 2024-02-19T21:37:08.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:07.607021+0000 osd.3 (osd.3) 107 : cluster [DBG] 5.0 scrub starts 2024-02-19T21:37:08.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:07.618607+0000 osd.3 (osd.3) 108 : cluster [DBG] 5.0 scrub ok 2024-02-19T21:37:08.395 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:37:08.433 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:08.460 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:37:08.464 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:08.464 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:37:08.565 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:37:08.596 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:08.622 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:37:08.628 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:08.629 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:37:08.729 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:37:08.762 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:08.789 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:37:08.792 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:08.792 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:37:08.893 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:37:08.951 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:08.963 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:07.918946+0000 osd.6 (osd.6) 69 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:37:08.964 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:07.922753+0000 osd.6 (osd.6) 70 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:37:08.964 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:07.931418+0000 osd.7 (osd.7) 81 : cluster [DBG] 5.4 scrub starts 2024-02-19T21:37:08.964 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:07.934736+0000 osd.7 (osd.7) 82 : cluster [DBG] 5.4 scrub ok 2024-02-19T21:37:08.964 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:07.966125+0000 mon.a (mon.0) 859 : audit [DBG] from='client.? 172.21.15.80:0/687584926' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:37:08.964 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:08.605395+0000 osd.0 (osd.0) 97 : cluster [DBG] 7.f scrub starts 2024-02-19T21:37:09.319 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:07.918946+0000 osd.6 (osd.6) 69 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:37:09.319 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:07.922753+0000 osd.6 (osd.6) 70 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:37:09.319 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:07.931418+0000 osd.7 (osd.7) 81 : cluster [DBG] 5.4 scrub starts 2024-02-19T21:37:09.319 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:07.934736+0000 osd.7 (osd.7) 82 : cluster [DBG] 5.4 scrub ok 2024-02-19T21:37:09.320 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:07.966125+0000 mon.a (mon.0) 859 : audit [DBG] from='client.? 172.21.15.80:0/687584926' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:37:09.320 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:08.605395+0000 osd.0 (osd.0) 97 : cluster [DBG] 7.f scrub starts 2024-02-19T21:37:09.330 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:07.918946+0000 osd.6 (osd.6) 69 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:37:09.330 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:07.922753+0000 osd.6 (osd.6) 70 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:37:09.330 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:07.931418+0000 osd.7 (osd.7) 81 : cluster [DBG] 5.4 scrub starts 2024-02-19T21:37:09.330 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:07.934736+0000 osd.7 (osd.7) 82 : cluster [DBG] 5.4 scrub ok 2024-02-19T21:37:09.330 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:07.966125+0000 mon.a (mon.0) 859 : audit [DBG] from='client.? 172.21.15.80:0/687584926' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:37:09.330 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:08.605395+0000 osd.0 (osd.0) 97 : cluster [DBG] 7.f scrub starts 2024-02-19T21:37:09.340 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:09.341 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:37:09.341 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:37:09.442 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:37:09.479 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:09.502 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:37:09.506 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:09.507 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:37:09.607 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:37:09.668 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:09.881 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:37:09.888 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:09.889 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:37:09.958 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:37:09.975 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:08.850966+0000 mgr.y (mgr.14514) 183 : cluster [DBG] pgmap v191: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 6.7 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 938 B/s rd, 20 MiB/s wr, 776 op/s 2024-02-19T21:37:09.989 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:37:10.051 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:10.091 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:37:10.099 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:10.099 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:37:10.200 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:37:10.232 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:08.850966+0000 mgr.y (mgr.14514) 183 : cluster [DBG] pgmap v191: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 6.7 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 938 B/s rd, 20 MiB/s wr, 776 op/s 2024-02-19T21:37:10.233 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:37:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:37:10.234 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:10.255 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:37:10.258 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:10.258 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:37:10.267 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:08.850966+0000 mgr.y (mgr.14514) 183 : cluster [DBG] pgmap v191: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 6.7 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 938 B/s rd, 20 MiB/s wr, 776 op/s 2024-02-19T21:37:10.359 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:37:10.440 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:10.610 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:37:10.618 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:10.618 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:37:10.719 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:37:10.751 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:10.775 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:37:10.779 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:10.780 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:37:10.790 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:37:10.790 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-02-19T21:37:10.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.791 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.14793.0:125521 7.f e130/100 7:f73bb33e:::benchmark_data_smithi080_79222_object10787:head v 130'7939, mlcod=130'7937)", 2024-02-19T21:37:10.791 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:37:10.783132+0000", 2024-02-19T21:37:10.791 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0057423889999999997, 2024-02-19T21:37:10.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00577248, 2024-02-19T21:37:10.791 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:37:10.791 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:37:10.791 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:37:10.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:37:10.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.783132+0000", 2024-02-19T21:37:10.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:37:10.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.792 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.792 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:37:10.792 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.783132+0000", 2024-02-19T21:37:10.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:37:10.792 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.792 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.792 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:37:10.792 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.783131+0000", 2024-02-19T21:37:10.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0492000000000001e-05 2024-02-19T21:37:10.792 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.792 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.792 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:37:10.792 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.783142+0000", 2024-02-19T21:37:10.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9469999999999998e-06 2024-02-19T21:37:10.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:37:10.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.783152+0000", 2024-02-19T21:37:10.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4019999999999996e-06 2024-02-19T21:37:10.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:37:10.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.783159+0000", 2024-02-19T21:37:10.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010763400000000001 2024-02-19T21:37:10.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:37:10.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.783267+0000", 2024-02-19T21:37:10.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8609000000000001e-05 2024-02-19T21:37:10.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:37:10.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.783285+0000", 2024-02-19T21:37:10.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015360100000000001 2024-02-19T21:37:10.794 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:10.794 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:37:10.794 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:10.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.794 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.14793.0:125528 7.7 e130/100 7:e6a86a98:::benchmark_data_smithi080_79222_object10794:head v 130'7719, mlcod=130'7717)", 2024-02-19T21:37:10.795 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:37:10.783311+0000", 2024-02-19T21:37:10.795 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0055635470000000003, 2024-02-19T21:37:10.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0056757860000000004, 2024-02-19T21:37:10.795 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:37:10.795 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:37:10.795 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:37:10.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:37:10.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.783311+0000", 2024-02-19T21:37:10.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:37:10.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:37:10.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.783311+0000", 2024-02-19T21:37:10.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:37:10.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:37:10.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.783310+0000", 2024-02-19T21:37:10.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4689999999999999e-06 2024-02-19T21:37:10.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:37:10.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.783315+0000", 2024-02-19T21:37:10.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4269999999999996e-06 2024-02-19T21:37:10.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:37:10.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.783321+0000", 2024-02-19T21:37:10.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3460000000000004e-06 2024-02-19T21:37:10.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:37:10.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.783325+0000", 2024-02-19T21:37:10.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028602390000000001 2024-02-19T21:37:10.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:37:10.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.786186+0000", 2024-02-19T21:37:10.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1806000000000001e-05 2024-02-19T21:37:10.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:37:10.798 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.786207+0000", 2024-02-19T21:37:10.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028968090000000002 2024-02-19T21:37:10.798 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:10.798 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:37:10.798 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:10.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.798 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:125532 7.3 7:c8c12b6b:::benchmark_data_smithi080_79222_object10798:head [delete] snapc 0=[] ondisk+write+known_if_redirected e130)", 2024-02-19T21:37:10.798 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:37:10.783337+0000", 2024-02-19T21:37:10.798 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0055369420000000004, 2024-02-19T21:37:10.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057209959999999999, 2024-02-19T21:37:10.798 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:37:10.799 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:37:10.799 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:37:10.799 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:37:10.799 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:37:10.799 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 125532 2024-02-19T21:37:10.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.799 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:37:10.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:37:10.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.783337+0000", 2024-02-19T21:37:10.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:37:10.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:37:10.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.783337+0000", 2024-02-19T21:37:10.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:37:10.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:37:10.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.783335+0000", 2024-02-19T21:37:10.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2390000000000002e-06 2024-02-19T21:37:10.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:37:10.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.783340+0000", 2024-02-19T21:37:10.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7199999999999995e-06 2024-02-19T21:37:10.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:37:10.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.783349+0000", 2024-02-19T21:37:10.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5839999999999996e-06 2024-02-19T21:37:10.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:37:10.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.783354+0000", 2024-02-19T21:37:10.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031421520000000001 2024-02-19T21:37:10.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:37:10.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.786496+0000", 2024-02-19T21:37:10.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5309000000000005e-05 2024-02-19T21:37:10.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:37:10.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.786591+0000", 2024-02-19T21:37:10.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012772099999999999 2024-02-19T21:37:10.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,4", 2024-02-19T21:37:10.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.786719+0000", 2024-02-19T21:37:10.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033816990000000002 2024-02-19T21:37:10.802 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:10.802 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:37:10.802 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:10.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.802 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.14793.0:125522 7.f e130/100 7:ff8bb205:::benchmark_data_smithi080_79222_object10788:head v 130'7940, mlcod=130'7937)", 2024-02-19T21:37:10.802 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:37:10.783983+0000", 2024-02-19T21:37:10.802 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0048913009999999998, 2024-02-19T21:37:10.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0051798529999999999, 2024-02-19T21:37:10.803 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:37:10.803 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:37:10.803 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:37:10.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:37:10.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.783983+0000", 2024-02-19T21:37:10.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:37:10.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:37:10.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.783983+0000", 2024-02-19T21:37:10.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:37:10.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:37:10.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.783982+0000", 2024-02-19T21:37:10.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.267e-06 2024-02-19T21:37:10.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:37:10.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.783989+0000", 2024-02-19T21:37:10.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0115000000000001e-05 2024-02-19T21:37:10.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:37:10.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.784000+0000", 2024-02-19T21:37:10.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5639999999999996e-06 2024-02-19T21:37:10.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:37:10.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.784005+0000", 2024-02-19T21:37:10.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028274730000000001 2024-02-19T21:37:10.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:37:10.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.786833+0000", 2024-02-19T21:37:10.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3283e-05 2024-02-19T21:37:10.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:37:10.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.786846+0000", 2024-02-19T21:37:10.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002862945 2024-02-19T21:37:10.805 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:10.805 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:37:10.805 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:10.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.806 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.14793.0:125526 7.f e130/100 7:fd877ea9:::benchmark_data_smithi080_79222_object10792:head v 130'7941, mlcod=130'7937)", 2024-02-19T21:37:10.806 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:37:10.784011+0000", 2024-02-19T21:37:10.806 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0048636010000000004, 2024-02-19T21:37:10.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0052249540000000004, 2024-02-19T21:37:10.806 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:37:10.806 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:37:10.806 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:37:10.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:37:10.806 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.784011+0000", 2024-02-19T21:37:10.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:37:10.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:37:10.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.784011+0000", 2024-02-19T21:37:10.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:37:10.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:37:10.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.784010+0000", 2024-02-19T21:37:10.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6459999999999999e-06 2024-02-19T21:37:10.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:37:10.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.784014+0000", 2024-02-19T21:37:10.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2349999999999999e-06 2024-02-19T21:37:10.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:37:10.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.784019+0000", 2024-02-19T21:37:10.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6370000000000001e-06 2024-02-19T21:37:10.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:37:10.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.784023+0000", 2024-02-19T21:37:10.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049157599999999999 2024-02-19T21:37:10.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:37:10.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.788939+0000", 2024-02-19T21:37:10.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2150000000000001e-05 2024-02-19T21:37:10.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:10.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:10.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:37:10.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:10.788951+0000", 2024-02-19T21:37:10.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049401499999999999 2024-02-19T21:37:10.809 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:10.809 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:37:10.809 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:10.809 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:10.809 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:37:10.809 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 5 2024-02-19T21:37:10.809 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:37:10.818 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:37:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:37:10] "GET /metrics HTTP/1.1" 200 175382 "" "Prometheus/2.33.4" 2024-02-19T21:37:10.881 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:37:10.946 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:11.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:10.018601+0000 mgr.y (mgr.14514) 184 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:37:11.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:10.018601+0000 mgr.y (mgr.14514) 184 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:37:11.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:10.018601+0000 mgr.y (mgr.14514) 184 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:37:11.346 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:37:11.530 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:37:11.534 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:11.535 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:37:11.636 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:37:11.711 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:12.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:10.851744+0000 mgr.y (mgr.14514) 185 : cluster [DBG] pgmap v192: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 6.4 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 1.3 KiB/s rd, 20 MiB/s wr, 1.16k op/s 2024-02-19T21:37:12.180 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:37:12.186 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:12.186 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:37:12.193 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.3 dump_blocked_ops 2024-02-19T21:37:12.287 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:37:12.302 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:10.851744+0000 mgr.y (mgr.14514) 185 : cluster [DBG] pgmap v192: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 6.4 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 1.3 KiB/s rd, 20 MiB/s wr, 1.16k op/s 2024-02-19T21:37:12.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:10.851744+0000 mgr.y (mgr.14514) 185 : cluster [DBG] pgmap v192: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 6.4 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 1.3 KiB/s rd, 20 MiB/s wr, 1.16k op/s 2024-02-19T21:37:12.364 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:12.620 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:37:12.630 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:37:12.631 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:12.632 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:37:12.666 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:37:12.733 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:37:12.783 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:12.879 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:37:12.882 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:12.883 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:37:12.984 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:37:13.037 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:13.173 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:12.025393+0000 osd.0 (osd.0) 98 : cluster [DBG] 7.f scrub ok 2024-02-19T21:37:13.173 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:12.546448+0000 osd.3 (osd.3) 109 : cluster [DBG] 4.1b scrub starts 2024-02-19T21:37:13.173 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:12.566103+0000 osd.3 (osd.3) 110 : cluster [DBG] 4.1b scrub ok 2024-02-19T21:37:13.173 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:12.025393+0000 osd.0 (osd.0) 98 : cluster [DBG] 7.f scrub ok 2024-02-19T21:37:13.173 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:12.546448+0000 osd.3 (osd.3) 109 : cluster [DBG] 4.1b scrub starts 2024-02-19T21:37:13.173 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:12.566103+0000 osd.3 (osd.3) 110 : cluster [DBG] 4.1b scrub ok 2024-02-19T21:37:13.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:12.025393+0000 osd.0 (osd.0) 98 : cluster [DBG] 7.f scrub ok 2024-02-19T21:37:13.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:12.546448+0000 osd.3 (osd.3) 109 : cluster [DBG] 4.1b scrub starts 2024-02-19T21:37:13.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:12.566103+0000 osd.3 (osd.3) 110 : cluster [DBG] 4.1b scrub ok 2024-02-19T21:37:13.595 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:37:13.606 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:13.607 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:37:13.707 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:37:13.736 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:13.757 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:37:13.760 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:13.761 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:37:13.861 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:37:13.937 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:14.265 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.4 to 1 (10000) 2024-02-19T21:37:14.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:12.852144+0000 mgr.y (mgr.14514) 186 : cluster [DBG] pgmap v193: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 6.4 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 781 op/s 2024-02-19T21:37:14.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:12.931645+0000 osd.6 (osd.6) 71 : cluster [DBG] 5.1f scrub starts 2024-02-19T21:37:14.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:12.934528+0000 osd.6 (osd.6) 72 : cluster [DBG] 5.1f scrub ok 2024-02-19T21:37:14.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:13.574360+0000 osd.3 (osd.3) 111 : cluster [DBG] 3.2 scrub starts 2024-02-19T21:37:14.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:13.579368+0000 osd.3 (osd.3) 112 : cluster [DBG] 3.2 scrub ok 2024-02-19T21:37:14.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:13.655466+0000 osd.0 (osd.0) 99 : cluster [DBG] 4.3 scrub starts 2024-02-19T21:37:14.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:13.658733+0000 osd.0 (osd.0) 100 : cluster [DBG] 4.3 scrub ok 2024-02-19T21:37:14.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:13.931913+0000 mon.b (mon.1) 37 : audit [INF] from='client.? 172.21.15.80:0/4287728536' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-02-19T21:37:14.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:13.932433+0000 mon.a (mon.0) 860 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-02-19T21:37:14.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:12.852144+0000 mgr.y (mgr.14514) 186 : cluster [DBG] pgmap v193: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 6.4 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 781 op/s 2024-02-19T21:37:14.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:12.931645+0000 osd.6 (osd.6) 71 : cluster [DBG] 5.1f scrub starts 2024-02-19T21:37:14.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:12.934528+0000 osd.6 (osd.6) 72 : cluster [DBG] 5.1f scrub ok 2024-02-19T21:37:14.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:13.574360+0000 osd.3 (osd.3) 111 : cluster [DBG] 3.2 scrub starts 2024-02-19T21:37:14.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:13.579368+0000 osd.3 (osd.3) 112 : cluster [DBG] 3.2 scrub ok 2024-02-19T21:37:14.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:13.655466+0000 osd.0 (osd.0) 99 : cluster [DBG] 4.3 scrub starts 2024-02-19T21:37:14.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:13.658733+0000 osd.0 (osd.0) 100 : cluster [DBG] 4.3 scrub ok 2024-02-19T21:37:14.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:13.931913+0000 mon.b (mon.1) 37 : audit [INF] from='client.? 172.21.15.80:0/4287728536' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-02-19T21:37:14.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:13.932433+0000 mon.a (mon.0) 860 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-02-19T21:37:14.352 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:12.852144+0000 mgr.y (mgr.14514) 186 : cluster [DBG] pgmap v193: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 6.4 GiB data, 22 GiB used, 694 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 781 op/s 2024-02-19T21:37:14.352 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:12.931645+0000 osd.6 (osd.6) 71 : cluster [DBG] 5.1f scrub starts 2024-02-19T21:37:14.352 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:12.934528+0000 osd.6 (osd.6) 72 : cluster [DBG] 5.1f scrub ok 2024-02-19T21:37:14.352 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:13.574360+0000 osd.3 (osd.3) 111 : cluster [DBG] 3.2 scrub starts 2024-02-19T21:37:14.352 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:13.579368+0000 osd.3 (osd.3) 112 : cluster [DBG] 3.2 scrub ok 2024-02-19T21:37:14.352 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:13.655466+0000 osd.0 (osd.0) 99 : cluster [DBG] 4.3 scrub starts 2024-02-19T21:37:14.352 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:13.658733+0000 osd.0 (osd.0) 100 : cluster [DBG] 4.3 scrub ok 2024-02-19T21:37:14.352 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:13.931913+0000 mon.b (mon.1) 37 : audit [INF] from='client.? 172.21.15.80:0/4287728536' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-02-19T21:37:14.352 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:13.932433+0000 mon.a (mon.0) 860 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-02-19T21:37:15.048 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:14.025979+0000 mon.a (mon.0) 861 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-02-19T21:37:15.049 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:14.026028+0000 mon.a (mon.0) 862 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2024-02-19T21:37:15.105 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:37:15.112 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:15.112 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:37:15.213 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:37:15.281 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:15.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:14.025979+0000 mon.a (mon.0) 861 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-02-19T21:37:15.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:14.026028+0000 mon.a (mon.0) 862 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2024-02-19T21:37:15.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:14.038361+0000 osd.2 (osd.2) 84 : cluster [DBG] 4.2 scrub starts 2024-02-19T21:37:15.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:14.054897+0000 osd.2 (osd.2) 85 : cluster [DBG] 4.2 scrub ok 2024-02-19T21:37:15.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:14.696939+0000 osd.0 (osd.0) 101 : cluster [DBG] 7.9 scrub starts 2024-02-19T21:37:15.331 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:14.038361+0000 osd.2 (osd.2) 84 : cluster [DBG] 4.2 scrub starts 2024-02-19T21:37:15.331 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:14.054897+0000 osd.2 (osd.2) 85 : cluster [DBG] 4.2 scrub ok 2024-02-19T21:37:15.331 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:14.696939+0000 osd.0 (osd.0) 101 : cluster [DBG] 7.9 scrub starts 2024-02-19T21:37:15.332 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:14.025979+0000 mon.a (mon.0) 861 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-02-19T21:37:15.332 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:14.026028+0000 mon.a (mon.0) 862 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2024-02-19T21:37:15.332 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:14.038361+0000 osd.2 (osd.2) 84 : cluster [DBG] 4.2 scrub starts 2024-02-19T21:37:15.332 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:14.054897+0000 osd.2 (osd.2) 85 : cluster [DBG] 4.2 scrub ok 2024-02-19T21:37:15.332 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:14.696939+0000 osd.0 (osd.0) 101 : cluster [DBG] 7.9 scrub starts 2024-02-19T21:37:15.332 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:37:15.340 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:15.341 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:37:15.441 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:37:15.508 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:15.870 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:37:15.876 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:15.877 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:37:15.978 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:37:16.045 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:16.059 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:37:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:37:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:37:16.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:14.853920+0000 mgr.y (mgr.14514) 187 : cluster [DBG] pgmap v195: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 6.3 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 804 op/s 2024-02-19T21:37:16.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:14.853920+0000 mgr.y (mgr.14514) 187 : cluster [DBG] pgmap v195: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 6.3 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 804 op/s 2024-02-19T21:37:16.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:14.853920+0000 mgr.y (mgr.14514) 187 : cluster [DBG] pgmap v195: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 6.3 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 804 op/s 2024-02-19T21:37:17.634 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:37:17.650 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:17.650 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:37:17.751 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:37:17.804 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:18.079 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:37:18.092 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:18.093 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:37:18.097 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd reweight 5 1 2024-02-19T21:37:18.100 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-02-19T21:37:18.194 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:37:18.212 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:37:18.212 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:37:18.212 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:37:18.213 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:37:18.213 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:37:18.213 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:37:18.213 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:37:18.213 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:37:18.213 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:37:18.213 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:37:18.213 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:37:18.213 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:37:18.213 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:37:18.213 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:37:18.214 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:37:18.214 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:37:18.254 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:18.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:16.855522+0000 mgr.y (mgr.14514) 188 : cluster [DBG] pgmap v196: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 6.1 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 914 op/s 2024-02-19T21:37:18.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:16.986345+0000 osd.2 (osd.2) 86 : cluster [DBG] 5.d scrub starts 2024-02-19T21:37:18.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:16.989828+0000 osd.2 (osd.2) 87 : cluster [DBG] 5.d scrub ok 2024-02-19T21:37:18.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:17.375359+0000 osd.0 (osd.0) 102 : cluster [DBG] 7.9 scrub ok 2024-02-19T21:37:18.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:17.432350+0000 mon.c (mon.2) 31 : audit [DBG] from='client.? 172.21.15.80:0/3847488353' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:37:18.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:17.764685+0000 osd.0 (osd.0) 103 : cluster [DBG] 5.3 scrub starts 2024-02-19T21:37:18.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:17.775077+0000 osd.0 (osd.0) 104 : cluster [DBG] 5.3 scrub ok 2024-02-19T21:37:18.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:17.813301+0000 mon.a (mon.0) 863 : audit [INF] from='client.? 172.21.15.80:0/3320005144' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:37:18.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:16.855522+0000 mgr.y (mgr.14514) 188 : cluster [DBG] pgmap v196: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 6.1 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 914 op/s 2024-02-19T21:37:18.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:16.986345+0000 osd.2 (osd.2) 86 : cluster [DBG] 5.d scrub starts 2024-02-19T21:37:18.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:16.989828+0000 osd.2 (osd.2) 87 : cluster [DBG] 5.d scrub ok 2024-02-19T21:37:18.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:17.375359+0000 osd.0 (osd.0) 102 : cluster [DBG] 7.9 scrub ok 2024-02-19T21:37:18.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:17.432350+0000 mon.c (mon.2) 31 : audit [DBG] from='client.? 172.21.15.80:0/3847488353' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:37:18.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:17.764685+0000 osd.0 (osd.0) 103 : cluster [DBG] 5.3 scrub starts 2024-02-19T21:37:18.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:17.775077+0000 osd.0 (osd.0) 104 : cluster [DBG] 5.3 scrub ok 2024-02-19T21:37:18.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:17.813301+0000 mon.a (mon.0) 863 : audit [INF] from='client.? 172.21.15.80:0/3320005144' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:37:18.485 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:37:18.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:16.855522+0000 mgr.y (mgr.14514) 188 : cluster [DBG] pgmap v196: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 6.1 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 914 op/s 2024-02-19T21:37:18.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:16.986345+0000 osd.2 (osd.2) 86 : cluster [DBG] 5.d scrub starts 2024-02-19T21:37:18.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:16.989828+0000 osd.2 (osd.2) 87 : cluster [DBG] 5.d scrub ok 2024-02-19T21:37:18.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:17.375359+0000 osd.0 (osd.0) 102 : cluster [DBG] 7.9 scrub ok 2024-02-19T21:37:18.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:17.432350+0000 mon.c (mon.2) 31 : audit [DBG] from='client.? 172.21.15.80:0/3847488353' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:37:18.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:17.764685+0000 osd.0 (osd.0) 103 : cluster [DBG] 5.3 scrub starts 2024-02-19T21:37:18.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:17.775077+0000 osd.0 (osd.0) 104 : cluster [DBG] 5.3 scrub ok 2024-02-19T21:37:18.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:17.813301+0000 mon.a (mon.0) 863 : audit [INF] from='client.? 172.21.15.80:0/3320005144' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:37:19.046 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:37:19.052 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:19.053 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:37:19.154 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:37:19.238 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:19.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:18.035514+0000 osd.7 (osd.7) 83 : cluster [DBG] 2.b scrub starts 2024-02-19T21:37:19.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:18.041932+0000 osd.7 (osd.7) 84 : cluster [DBG] 2.b scrub ok 2024-02-19T21:37:19.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:18.065388+0000 mon.a (mon.0) 864 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:37:19.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:18.065424+0000 mon.a (mon.0) 865 : cluster [INF] Cluster is now healthy 2024-02-19T21:37:19.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:18.078118+0000 mon.a (mon.0) 866 : audit [INF] from='client.? 172.21.15.80:0/3320005144' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:37:19.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:18.078171+0000 mon.a (mon.0) 867 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2024-02-19T21:37:19.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:18.546324+0000 osd.3 (osd.3) 113 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:37:19.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:18.550815+0000 osd.3 (osd.3) 114 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:37:19.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:18.932113+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:37:19.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:18.035514+0000 osd.7 (osd.7) 83 : cluster [DBG] 2.b scrub starts 2024-02-19T21:37:19.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:18.041932+0000 osd.7 (osd.7) 84 : cluster [DBG] 2.b scrub ok 2024-02-19T21:37:19.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:18.065388+0000 mon.a (mon.0) 864 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:37:19.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:18.065424+0000 mon.a (mon.0) 865 : cluster [INF] Cluster is now healthy 2024-02-19T21:37:19.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:18.078118+0000 mon.a (mon.0) 866 : audit [INF] from='client.? 172.21.15.80:0/3320005144' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:37:19.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:18.078171+0000 mon.a (mon.0) 867 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2024-02-19T21:37:19.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:18.546324+0000 osd.3 (osd.3) 113 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:37:19.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:18.550815+0000 osd.3 (osd.3) 114 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:37:19.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:18.932113+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:37:19.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:18.035514+0000 osd.7 (osd.7) 83 : cluster [DBG] 2.b scrub starts 2024-02-19T21:37:19.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:18.041932+0000 osd.7 (osd.7) 84 : cluster [DBG] 2.b scrub ok 2024-02-19T21:37:19.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:18.065388+0000 mon.a (mon.0) 864 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:37:19.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:18.065424+0000 mon.a (mon.0) 865 : cluster [INF] Cluster is now healthy 2024-02-19T21:37:19.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:18.078118+0000 mon.a (mon.0) 866 : audit [INF] from='client.? 172.21.15.80:0/3320005144' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:37:19.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:18.078171+0000 mon.a (mon.0) 867 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2024-02-19T21:37:19.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:18.546324+0000 osd.3 (osd.3) 113 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:37:19.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:18.550815+0000 osd.3 (osd.3) 114 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:37:19.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:18.932113+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:37:20.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:18.856499+0000 mgr.y (mgr.14514) 189 : cluster [DBG] pgmap v198: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 6.1 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 566 op/s 2024-02-19T21:37:20.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:18.923033+0000 osd.2 (osd.2) 88 : cluster [DBG] 2.c scrub starts 2024-02-19T21:37:20.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:18.928605+0000 osd.2 (osd.2) 89 : cluster [DBG] 2.c scrub ok 2024-02-19T21:37:20.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:19.761752+0000 osd.5 (osd.5) 96 : cluster [DBG] 2.12 deep-scrub starts 2024-02-19T21:37:20.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:19.763633+0000 osd.5 (osd.5) 97 : cluster [DBG] 2.12 deep-scrub ok 2024-02-19T21:37:20.308 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:37:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:37:20.403 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:18.856499+0000 mgr.y (mgr.14514) 189 : cluster [DBG] pgmap v198: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 6.1 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 566 op/s 2024-02-19T21:37:20.404 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:18.923033+0000 osd.2 (osd.2) 88 : cluster [DBG] 2.c scrub starts 2024-02-19T21:37:20.404 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:18.928605+0000 osd.2 (osd.2) 89 : cluster [DBG] 2.c scrub ok 2024-02-19T21:37:20.404 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:19.761752+0000 osd.5 (osd.5) 96 : cluster [DBG] 2.12 deep-scrub starts 2024-02-19T21:37:20.404 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:19.763633+0000 osd.5 (osd.5) 97 : cluster [DBG] 2.12 deep-scrub ok 2024-02-19T21:37:20.404 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:18.856499+0000 mgr.y (mgr.14514) 189 : cluster [DBG] pgmap v198: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 6.1 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 566 op/s 2024-02-19T21:37:20.405 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:18.923033+0000 osd.2 (osd.2) 88 : cluster [DBG] 2.c scrub starts 2024-02-19T21:37:20.405 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:18.928605+0000 osd.2 (osd.2) 89 : cluster [DBG] 2.c scrub ok 2024-02-19T21:37:20.405 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:19.761752+0000 osd.5 (osd.5) 96 : cluster [DBG] 2.12 deep-scrub starts 2024-02-19T21:37:20.405 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:19.763633+0000 osd.5 (osd.5) 97 : cluster [DBG] 2.12 deep-scrub ok 2024-02-19T21:37:20.406 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:37:20.412 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:20.412 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:37:20.514 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:37:20.555 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:20.583 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:37:20.587 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:20.588 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:37:20.688 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:37:20.720 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:20.744 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:37:20.746 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:20.746 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:37:20.847 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:37:20.877 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:20.903 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:37:20.908 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:20.909 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:37:21.009 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:37:21.050 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:21.076 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:37:21.081 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:21.082 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:37:21.085 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:37:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:37:20] "GET /metrics HTTP/1.1" 200 175379 "" "Prometheus/2.33.4" 2024-02-19T21:37:21.183 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:37:21.245 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:21.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:20.028525+0000 mgr.y (mgr.14514) 190 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:37:21.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:20.489951+0000 osd.3 (osd.3) 115 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:37:21.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:20.505083+0000 osd.3 (osd.3) 116 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:37:21.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:20.801460+0000 osd.5 (osd.5) 98 : cluster [DBG] 6.7 scrub starts 2024-02-19T21:37:21.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:20.804448+0000 osd.5 (osd.5) 99 : cluster [DBG] 6.7 scrub ok 2024-02-19T21:37:21.352 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:20.028525+0000 mgr.y (mgr.14514) 190 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:37:21.352 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:20.489951+0000 osd.3 (osd.3) 115 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:37:21.352 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:20.505083+0000 osd.3 (osd.3) 116 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:37:21.352 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:20.801460+0000 osd.5 (osd.5) 98 : cluster [DBG] 6.7 scrub starts 2024-02-19T21:37:21.352 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:20.804448+0000 osd.5 (osd.5) 99 : cluster [DBG] 6.7 scrub ok 2024-02-19T21:37:21.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:20.028525+0000 mgr.y (mgr.14514) 190 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:37:21.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:20.489951+0000 osd.3 (osd.3) 115 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:37:21.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:20.505083+0000 osd.3 (osd.3) 116 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:37:21.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:20.801460+0000 osd.5 (osd.5) 98 : cluster [DBG] 6.7 scrub starts 2024-02-19T21:37:21.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:20.804448+0000 osd.5 (osd.5) 99 : cluster [DBG] 6.7 scrub ok 2024-02-19T21:37:21.667 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:37:21.695 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:37:21.699 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:21.700 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:37:21.801 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:37:21.855 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:21.892 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:37:21.900 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:21.900 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:37:22.001 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:37:22.076 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:22.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:20.863187+0000 mgr.y (mgr.14514) 191 : cluster [DBG] pgmap v199: 148 pgs: 148 active+clean; 5.8 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.14k op/s 2024-02-19T21:37:22.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:20.863187+0000 mgr.y (mgr.14514) 191 : cluster [DBG] pgmap v199: 148 pgs: 148 active+clean; 5.8 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.14k op/s 2024-02-19T21:37:22.430 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:37:22.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:20.863187+0000 mgr.y (mgr.14514) 191 : cluster [DBG] pgmap v199: 148 pgs: 148 active+clean; 5.8 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.14k op/s 2024-02-19T21:37:22.886 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set noscrub 2024-02-19T21:37:23.210 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:37:23.210 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:37:23.218 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:22.536718+0000 osd.3 (osd.3) 117 : cluster [DBG] 4.c scrub starts 2024-02-19T21:37:23.218 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:22.544814+0000 osd.3 (osd.3) 118 : cluster [DBG] 4.c scrub ok 2024-02-19T21:37:23.218 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:22.536718+0000 osd.3 (osd.3) 117 : cluster [DBG] 4.c scrub starts 2024-02-19T21:37:23.218 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:22.544814+0000 osd.3 (osd.3) 118 : cluster [DBG] 4.c scrub ok 2024-02-19T21:37:23.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:22.536718+0000 osd.3 (osd.3) 117 : cluster [DBG] 4.c scrub starts 2024-02-19T21:37:23.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:22.544814+0000 osd.3 (osd.3) 118 : cluster [DBG] 4.c scrub ok 2024-02-19T21:37:23.655 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:37:23.659 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:23.659 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:37:23.760 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:37:23.816 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:23.870 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:37:23.874 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:23.875 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:37:23.976 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:37:24.024 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:24.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:22.868373+0000 mgr.y (mgr.14514) 192 : cluster [DBG] pgmap v200: 148 pgs: 148 active+clean; 5.8 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.03k op/s 2024-02-19T21:37:24.352 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:23.534480+0000 osd.3 (osd.3) 119 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:37:24.352 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:23.540510+0000 osd.3 (osd.3) 120 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:37:24.352 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:23.767042+0000 osd.0 (osd.0) 105 : cluster [DBG] 7.4 scrub starts 2024-02-19T21:37:24.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:22.868373+0000 mgr.y (mgr.14514) 192 : cluster [DBG] pgmap v200: 148 pgs: 148 active+clean; 5.8 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.03k op/s 2024-02-19T21:37:24.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:23.534480+0000 osd.3 (osd.3) 119 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:37:24.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:23.540510+0000 osd.3 (osd.3) 120 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:37:24.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:23.767042+0000 osd.0 (osd.0) 105 : cluster [DBG] 7.4 scrub starts 2024-02-19T21:37:24.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:22.868373+0000 mgr.y (mgr.14514) 192 : cluster [DBG] pgmap v200: 148 pgs: 148 active+clean; 5.8 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.03k op/s 2024-02-19T21:37:24.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:23.534480+0000 osd.3 (osd.3) 119 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:37:24.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:23.540510+0000 osd.3 (osd.3) 120 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:37:24.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:23.767042+0000 osd.0 (osd.0) 105 : cluster [DBG] 7.4 scrub starts 2024-02-19T21:37:24.839 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.3 dump_historic_ops 2024-02-19T21:37:25.199 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:37:25.205 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:25.205 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:37:25.219 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:37:25.272 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:37:25.307 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:37:25.371 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:25.426 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:25.427 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:37:25.427 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:37:25.528 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:37:25.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:23.989092+0000 osd.7 (osd.7) 85 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:37:25.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:23.993238+0000 osd.7 (osd.7) 86 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:37:25.559 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:25.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:23.989092+0000 osd.7 (osd.7) 85 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:37:25.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:23.993238+0000 osd.7 (osd.7) 86 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:37:25.568 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:23.989092+0000 osd.7 (osd.7) 85 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:37:25.568 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:23.993238+0000 osd.7 (osd.7) 86 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:37:25.583 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:37:25.587 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:25.588 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:37:25.689 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:37:25.719 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:25.741 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:37:25.746 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:25.746 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:37:25.807 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:37:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:37:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:37:25.847 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:37:25.916 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:26.038 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:37:26.043 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:26.043 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:37:26.144 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:37:26.208 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:26.232 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.5 to 1 (10000) 2024-02-19T21:37:26.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:24.870175+0000 mgr.y (mgr.14514) 193 : cluster [DBG] pgmap v201: 148 pgs: 148 active+clean; 5.7 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 932 op/s 2024-02-19T21:37:26.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:25.450974+0000 mon.b (mon.1) 38 : audit [INF] from='client.? 172.21.15.80:0/3569340606' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-19T21:37:26.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:25.451506+0000 mon.a (mon.0) 869 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-19T21:37:26.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:25.600261+0000 osd.3 (osd.3) 121 : cluster [DBG] 7.a scrub starts 2024-02-19T21:37:26.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:24.870175+0000 mgr.y (mgr.14514) 193 : cluster [DBG] pgmap v201: 148 pgs: 148 active+clean; 5.7 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 932 op/s 2024-02-19T21:37:26.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:25.450974+0000 mon.b (mon.1) 38 : audit [INF] from='client.? 172.21.15.80:0/3569340606' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-19T21:37:26.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:25.451506+0000 mon.a (mon.0) 869 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-19T21:37:26.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:25.600261+0000 osd.3 (osd.3) 121 : cluster [DBG] 7.a scrub starts 2024-02-19T21:37:26.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:24.870175+0000 mgr.y (mgr.14514) 193 : cluster [DBG] pgmap v201: 148 pgs: 148 active+clean; 5.7 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 932 op/s 2024-02-19T21:37:26.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:25.450974+0000 mon.b (mon.1) 38 : audit [INF] from='client.? 172.21.15.80:0/3569340606' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-19T21:37:26.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:25.451506+0000 mon.a (mon.0) 869 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-19T21:37:26.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:25.600261+0000 osd.3 (osd.3) 121 : cluster [DBG] 7.a scrub starts 2024-02-19T21:37:27.387 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:37:27.395 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:37:27.400 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:27.401 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:37:27.502 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:37:27.554 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:26.190023+0000 osd.0 (osd.0) 106 : cluster [DBG] 7.4 scrub ok 2024-02-19T21:37:27.555 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:26.205292+0000 mon.a (mon.0) 870 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-02-19T21:37:27.555 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:26.205341+0000 mon.a (mon.0) 871 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2024-02-19T21:37:27.555 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:26.832894+0000 osd.0 (osd.0) 107 : cluster [DBG] 2.1f scrub starts 2024-02-19T21:37:27.555 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:26.834167+0000 osd.0 (osd.0) 108 : cluster [DBG] 2.1f scrub ok 2024-02-19T21:37:27.556 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:26.190023+0000 osd.0 (osd.0) 106 : cluster [DBG] 7.4 scrub ok 2024-02-19T21:37:27.556 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:26.205292+0000 mon.a (mon.0) 870 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-02-19T21:37:27.556 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:26.205341+0000 mon.a (mon.0) 871 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2024-02-19T21:37:27.556 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:26.832894+0000 osd.0 (osd.0) 107 : cluster [DBG] 2.1f scrub starts 2024-02-19T21:37:27.556 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:26.834167+0000 osd.0 (osd.0) 108 : cluster [DBG] 2.1f scrub ok 2024-02-19T21:37:27.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:26.190023+0000 osd.0 (osd.0) 106 : cluster [DBG] 7.4 scrub ok 2024-02-19T21:37:27.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:26.205292+0000 mon.a (mon.0) 870 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-02-19T21:37:27.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:26.205341+0000 mon.a (mon.0) 871 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2024-02-19T21:37:27.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:26.832894+0000 osd.0 (osd.0) 107 : cluster [DBG] 2.1f scrub starts 2024-02-19T21:37:27.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:26.834167+0000 osd.0 (osd.0) 108 : cluster [DBG] 2.1f scrub ok 2024-02-19T21:37:27.563 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:27.599 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:37:27.607 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:27.608 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:37:27.708 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:37:27.781 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:27.968 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:37:27.976 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:27.976 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:37:27.990 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd reweight 6 1 2024-02-19T21:37:28.077 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:37:28.110 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:28.132 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:37:28.135 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:28.136 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:37:28.236 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:37:28.256 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:26.872222+0000 mgr.y (mgr.14514) 194 : cluster [DBG] pgmap v203: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 5.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.07k op/s 2024-02-19T21:37:28.256 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:27.031073+0000 osd.7 (osd.7) 87 : cluster [DBG] 6.15 deep-scrub starts 2024-02-19T21:37:28.256 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:27.036733+0000 osd.7 (osd.7) 88 : cluster [DBG] 6.15 deep-scrub ok 2024-02-19T21:37:28.266 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:28.295 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:37:28.298 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:28.298 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:37:28.399 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:37:28.461 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:28.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:26.872222+0000 mgr.y (mgr.14514) 194 : cluster [DBG] pgmap v203: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 5.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.07k op/s 2024-02-19T21:37:28.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:27.031073+0000 osd.7 (osd.7) 87 : cluster [DBG] 6.15 deep-scrub starts 2024-02-19T21:37:28.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:27.036733+0000 osd.7 (osd.7) 88 : cluster [DBG] 6.15 deep-scrub ok 2024-02-19T21:37:28.605 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:26.872222+0000 mgr.y (mgr.14514) 194 : cluster [DBG] pgmap v203: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 5.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.07k op/s 2024-02-19T21:37:28.605 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:27.031073+0000 osd.7 (osd.7) 87 : cluster [DBG] 6.15 deep-scrub starts 2024-02-19T21:37:28.606 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:27.036733+0000 osd.7 (osd.7) 88 : cluster [DBG] 6.15 deep-scrub ok 2024-02-19T21:37:28.664 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:37:28.668 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:28.669 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:37:28.770 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:37:28.800 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:28.832 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:37:28.837 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:28.838 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:37:28.939 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:37:29.014 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:29.064 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:37:29.073 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:29.074 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:37:29.175 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:37:29.239 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:29.264 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:27.994210+0000 osd.7 (osd.7) 89 : cluster [DBG] 5.9 scrub starts 2024-02-19T21:37:29.264 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:27.997717+0000 osd.7 (osd.7) 90 : cluster [DBG] 5.9 scrub ok 2024-02-19T21:37:29.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:27.994210+0000 osd.7 (osd.7) 89 : cluster [DBG] 5.9 scrub starts 2024-02-19T21:37:29.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:27.997717+0000 osd.7 (osd.7) 90 : cluster [DBG] 5.9 scrub ok 2024-02-19T21:37:29.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:27.994210+0000 osd.7 (osd.7) 89 : cluster [DBG] 5.9 scrub starts 2024-02-19T21:37:29.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:27.997717+0000 osd.7 (osd.7) 90 : cluster [DBG] 5.9 scrub ok 2024-02-19T21:37:30.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:28.803206+0000 osd.3 (osd.3) 122 : cluster [DBG] 7.a scrub ok 2024-02-19T21:37:30.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:28.874380+0000 mgr.y (mgr.14514) 195 : cluster [DBG] pgmap v204: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 5.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 941 op/s 2024-02-19T21:37:30.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:29.497427+0000 osd.4 (osd.4) 89 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:37:30.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:29.501096+0000 osd.4 (osd.4) 90 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:37:30.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:29.662256+0000 osd.3 (osd.3) 123 : cluster [DBG] 2.1e deep-scrub starts 2024-02-19T21:37:30.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:29.668431+0000 osd.3 (osd.3) 124 : cluster [DBG] 2.1e deep-scrub ok 2024-02-19T21:37:30.308 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:37:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:37:30.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:28.803206+0000 osd.3 (osd.3) 122 : cluster [DBG] 7.a scrub ok 2024-02-19T21:37:30.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:28.874380+0000 mgr.y (mgr.14514) 195 : cluster [DBG] pgmap v204: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 5.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 941 op/s 2024-02-19T21:37:30.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:29.497427+0000 osd.4 (osd.4) 89 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:37:30.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:29.501096+0000 osd.4 (osd.4) 90 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:37:30.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:29.662256+0000 osd.3 (osd.3) 123 : cluster [DBG] 2.1e deep-scrub starts 2024-02-19T21:37:30.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:29.668431+0000 osd.3 (osd.3) 124 : cluster [DBG] 2.1e deep-scrub ok 2024-02-19T21:37:30.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:28.803206+0000 osd.3 (osd.3) 122 : cluster [DBG] 7.a scrub ok 2024-02-19T21:37:30.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:28.874380+0000 mgr.y (mgr.14514) 195 : cluster [DBG] pgmap v204: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 5.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 941 op/s 2024-02-19T21:37:30.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:29.497427+0000 osd.4 (osd.4) 89 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:37:30.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:29.501096+0000 osd.4 (osd.4) 90 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:37:30.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:29.662256+0000 osd.3 (osd.3) 123 : cluster [DBG] 2.1e deep-scrub starts 2024-02-19T21:37:30.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:29.668431+0000 osd.3 (osd.3) 124 : cluster [DBG] 2.1e deep-scrub ok 2024-02-19T21:37:30.665 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:37:30.670 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:30.671 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:37:30.772 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:37:30.836 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:30.870 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:37:30.882 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:30.882 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:37:30.983 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:37:31.029 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:37:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:37:30] "GET /metrics HTTP/1.1" 200 175379 "" "Prometheus/2.33.4" 2024-02-19T21:37:31.037 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:31.281 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:29.928497+0000 osd.7 (osd.7) 91 : cluster [DBG] 6.8 deep-scrub starts 2024-02-19T21:37:31.281 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:29.936131+0000 osd.7 (osd.7) 92 : cluster [DBG] 6.8 deep-scrub ok 2024-02-19T21:37:31.281 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:29.940254+0000 osd.6 (osd.6) 73 : cluster [DBG] 7.7 scrub starts 2024-02-19T21:37:31.281 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:30.038503+0000 mgr.y (mgr.14514) 196 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:37:31.282 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:29.928497+0000 osd.7 (osd.7) 91 : cluster [DBG] 6.8 deep-scrub starts 2024-02-19T21:37:31.282 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:29.936131+0000 osd.7 (osd.7) 92 : cluster [DBG] 6.8 deep-scrub ok 2024-02-19T21:37:31.282 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:29.940254+0000 osd.6 (osd.6) 73 : cluster [DBG] 7.7 scrub starts 2024-02-19T21:37:31.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:29.928497+0000 osd.7 (osd.7) 91 : cluster [DBG] 6.8 deep-scrub starts 2024-02-19T21:37:31.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:29.936131+0000 osd.7 (osd.7) 92 : cluster [DBG] 6.8 deep-scrub ok 2024-02-19T21:37:31.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:29.940254+0000 osd.6 (osd.6) 73 : cluster [DBG] 7.7 scrub starts 2024-02-19T21:37:31.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:30.038503+0000 mgr.y (mgr.14514) 196 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:37:31.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:30.038503+0000 mgr.y (mgr.14514) 196 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:37:32.040 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:37:32.040 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:37:32.067 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:37:32.115 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:37:32.156 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:37:32.188 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:37:32.219 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:37:32.256 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:37:32.285 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:37:32.285 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:37:32.285 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:37:32.285 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:37:32.285 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:37:32.285 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:37:32.285 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:37:32.286 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:37:32.294 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:30.875815+0000 mgr.y (mgr.14514) 197 : cluster [DBG] pgmap v205: 148 pgs: 148 active+clean; 5.3 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 923 op/s 2024-02-19T21:37:32.294 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:31.939759+0000 mon.a (mon.0) 872 : audit [DBG] from='client.? 172.21.15.80:0/36760545' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:37:32.376 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:37:32.376 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-02-19T21:37:32.376 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-02-19T21:37:32.376 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-02-19T21:37:32.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.376 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:28359 7.3 7:cc0ad1e5:::benchmark_data_smithi080_79222_object28358:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-19T21:37:32.376 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:41.013276+0000", 2024-02-19T21:37:32.376 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 111.359146817, 2024-02-19T21:37:32.376 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.063904692999999999, 2024-02-19T21:37:32.377 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:37:32.377 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:37:32.377 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:37:32.377 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:37:32.377 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:37:32.377 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 28359 2024-02-19T21:37:32.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.377 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:37:32.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.377 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:37:32.377 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.013276+0000", 2024-02-19T21:37:32.377 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:37:32.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.377 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:37:32.378 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.013276+0000", 2024-02-19T21:37:32.378 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:37:32.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.378 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:37:32.378 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.013275+0000", 2024-02-19T21:37:32.378 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0366000000000001e-05 2024-02-19T21:37:32.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.378 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:37:32.378 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.013295+0000", 2024-02-19T21:37:32.378 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6299999999999993e-06 2024-02-19T21:37:32.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.378 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:37:32.378 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.013305+0000", 2024-02-19T21:37:32.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2310000000000001e-06 2024-02-19T21:37:32.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:37:32.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.013311+0000", 2024-02-19T21:37:32.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5918999999999999e-05 2024-02-19T21:37:32.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:37:32.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.013347+0000", 2024-02-19T21:37:32.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014232900000000001 2024-02-19T21:37:32.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:37:32.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.013489+0000", 2024-02-19T21:37:32.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018009800000000001 2024-02-19T21:37:32.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,4", 2024-02-19T21:37:32.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.013669+0000", 2024-02-19T21:37:32.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.062780471000000004 2024-02-19T21:37:32.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:37:32.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.076450+0000", 2024-02-19T21:37:32.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017763800000000001 2024-02-19T21:37:32.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:37:32.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.076627+0000", 2024-02-19T21:37:32.381 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045171300000000002 2024-02-19T21:37:32.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.381 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:37:32.381 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.077079+0000", 2024-02-19T21:37:32.381 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1252000000000002e-05 2024-02-19T21:37:32.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.381 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:37:32.381 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.077140+0000", 2024-02-19T21:37:32.381 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0519999999999998e-05 2024-02-19T21:37:32.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.381 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:37:32.381 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.077181+0000", 2024-02-19T21:37:32.382 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.063904692999999999 2024-02-19T21:37:32.382 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.382 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:37:32.382 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.382 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:28360 7.3 7:c491ae27:::benchmark_data_smithi080_79222_object28359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-19T21:37:32.382 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:41.014157+0000", 2024-02-19T21:37:32.382 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 111.358265582, 2024-02-19T21:37:32.382 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.063118880000000002, 2024-02-19T21:37:32.382 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:37:32.382 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:37:32.382 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:37:32.382 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:37:32.382 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:37:32.382 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 28360 2024-02-19T21:37:32.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.383 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:37:32.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.383 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:37:32.383 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.014157+0000", 2024-02-19T21:37:32.383 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:37:32.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.383 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:37:32.383 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.014157+0000", 2024-02-19T21:37:32.383 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:37:32.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.384 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:37:32.384 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.014157+0000", 2024-02-19T21:37:32.384 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9004e-05 2024-02-19T21:37:32.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.384 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:37:32.384 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.014176+0000", 2024-02-19T21:37:32.384 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3930000000000008e-06 2024-02-19T21:37:32.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.384 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:37:32.384 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.014184+0000", 2024-02-19T21:37:32.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8339999999999998e-06 2024-02-19T21:37:32.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:37:32.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.014189+0000", 2024-02-19T21:37:32.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042888300000000002 2024-02-19T21:37:32.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:37:32.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.014618+0000", 2024-02-19T21:37:32.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012448200000000001 2024-02-19T21:37:32.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:37:32.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.014742+0000", 2024-02-19T21:37:32.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014312099999999999 2024-02-19T21:37:32.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,4", 2024-02-19T21:37:32.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.014885+0000", 2024-02-19T21:37:32.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.061748606999999997 2024-02-19T21:37:32.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:37:32.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.076634+0000", 2024-02-19T21:37:32.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042023100000000002 2024-02-19T21:37:32.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:37:32.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.077054+0000", 2024-02-19T21:37:32.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015765700000000001 2024-02-19T21:37:32.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:37:32.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.077212+0000", 2024-02-19T21:37:32.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5200000000000002e-05 2024-02-19T21:37:32.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.388 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:37:32.388 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.077247+0000", 2024-02-19T21:37:32.388 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9178000000000001e-05 2024-02-19T21:37:32.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.388 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:37:32.388 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.077276+0000", 2024-02-19T21:37:32.388 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.063118880000000002 2024-02-19T21:37:32.388 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.388 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:37:32.388 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.389 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.14793.0:28358 7.6 e107/100 7:62c4b301:::benchmark_data_smithi080_79222_object28357:head v 107'1782, mlcod=107'1779)", 2024-02-19T21:37:32.389 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:41.014662+0000", 2024-02-19T21:37:32.389 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 111.357760719, 2024-02-19T21:37:32.389 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.062765529, 2024-02-19T21:37:32.389 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:37:32.389 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:37:32.389 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:37:32.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.389 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:37:32.389 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.014662+0000", 2024-02-19T21:37:32.389 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:37:32.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.390 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:37:32.390 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.014662+0000", 2024-02-19T21:37:32.390 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:37:32.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.390 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:37:32.390 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.014661+0000", 2024-02-19T21:37:32.390 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3476999999999999e-05 2024-02-19T21:37:32.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.390 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:37:32.390 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.014685+0000", 2024-02-19T21:37:32.390 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0488e-05 2024-02-19T21:37:32.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:37:32.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.014695+0000", 2024-02-19T21:37:32.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7610000000000004e-06 2024-02-19T21:37:32.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:37:32.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.014701+0000", 2024-02-19T21:37:32.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3220000000000002e-05 2024-02-19T21:37:32.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:37:32.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.014754+0000", 2024-02-19T21:37:32.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2490999999999999e-05 2024-02-19T21:37:32.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.392 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:37:32.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.014767+0000", 2024-02-19T21:37:32.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.062616640000000001 2024-02-19T21:37:32.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.392 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:37:32.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.077384+0000", 2024-02-19T21:37:32.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4292999999999998e-05 2024-02-19T21:37:32.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:37:32.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.077428+0000", 2024-02-19T21:37:32.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.062765529 2024-02-19T21:37:32.393 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.393 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:37:32.393 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.393 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:28369 7.a 7:5be50bd8:::benchmark_data_smithi080_79222_object28368:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-19T21:37:32.393 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:41.015297+0000", 2024-02-19T21:37:32.393 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 111.357125869, 2024-02-19T21:37:32.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.065202344999999995, 2024-02-19T21:37:32.394 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:37:32.394 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:37:32.394 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:37:32.394 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:37:32.394 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:37:32.394 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 28369 2024-02-19T21:37:32.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.394 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:37:32.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:37:32.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015297+0000", 2024-02-19T21:37:32.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:37:32.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:37:32.395 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015297+0000", 2024-02-19T21:37:32.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:37:32.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:37:32.395 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015296+0000", 2024-02-19T21:37:32.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2259000000000002e-05 2024-02-19T21:37:32.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:37:32.395 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015318+0000", 2024-02-19T21:37:32.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1219e-05 2024-02-19T21:37:32.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:37:32.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015329+0000", 2024-02-19T21:37:32.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8000000000000004e-06 2024-02-19T21:37:32.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:37:32.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015335+0000", 2024-02-19T21:37:32.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3869000000000003e-05 2024-02-19T21:37:32.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:37:32.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015379+0000", 2024-02-19T21:37:32.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109423 2024-02-19T21:37:32.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:37:32.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015489+0000", 2024-02-19T21:37:32.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000140796 2024-02-19T21:37:32.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,5", 2024-02-19T21:37:32.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.015629+0000", 2024-02-19T21:37:32.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.061763466000000003 2024-02-19T21:37:32.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:37:32.398 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.077393+0000", 2024-02-19T21:37:32.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012307600000000001 2024-02-19T21:37:32.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.398 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:37:32.398 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.077516+0000", 2024-02-19T21:37:32.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028927419999999998 2024-02-19T21:37:32.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.398 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:37:32.398 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.080409+0000", 2024-02-19T21:37:32.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9524000000000002e-05 2024-02-19T21:37:32.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.398 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:37:32.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.080458+0000", 2024-02-19T21:37:32.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1389e-05 2024-02-19T21:37:32.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:37:32.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.080500+0000", 2024-02-19T21:37:32.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.065202344999999995 2024-02-19T21:37:32.399 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.399 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:37:32.399 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.399 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.14793.0:28365 7.6 e107/100 7:6630916d:::benchmark_data_smithi080_79222_object28364:head v 107'1783, mlcod=107'1780)", 2024-02-19T21:37:32.399 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:41.016302+0000", 2024-02-19T21:37:32.399 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 111.356120526, 2024-02-19T21:37:32.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.063462438999999995, 2024-02-19T21:37:32.400 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:37:32.400 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:37:32.400 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:37:32.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.400 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:37:32.400 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016302+0000", 2024-02-19T21:37:32.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:37:32.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.400 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:37:32.400 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016302+0000", 2024-02-19T21:37:32.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:37:32.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:37:32.401 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016301+0000", 2024-02-19T21:37:32.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.215e-05 2024-02-19T21:37:32.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:37:32.401 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016323+0000", 2024-02-19T21:37:32.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3979999999999999e-06 2024-02-19T21:37:32.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:37:32.401 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016332+0000", 2024-02-19T21:37:32.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4750000000000004e-06 2024-02-19T21:37:32.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:37:32.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016336+0000", 2024-02-19T21:37:32.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00086658700000000004 2024-02-19T21:37:32.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:37:32.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.017203+0000", 2024-02-19T21:37:32.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.059075491000000001 2024-02-19T21:37:32.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:37:32.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.076278+0000", 2024-02-19T21:37:32.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034458589999999999 2024-02-19T21:37:32.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:37:32.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.079724+0000", 2024-02-19T21:37:32.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0697e-05 2024-02-19T21:37:32.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:37:32.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.079765+0000", 2024-02-19T21:37:32.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.063462438999999995 2024-02-19T21:37:32.404 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.404 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:37:32.404 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.404 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.14793.0:28368 7.0 e107/100 7:0c25a544:::benchmark_data_smithi080_79222_object28367:head v 107'1763, mlcod=107'1761)", 2024-02-19T21:37:32.404 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:41.016650+0000", 2024-02-19T21:37:32.404 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 111.355772933, 2024-02-19T21:37:32.404 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.059747791000000001, 2024-02-19T21:37:32.404 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:37:32.404 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:37:32.404 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:37:32.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.404 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:37:32.405 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016650+0000", 2024-02-19T21:37:32.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:37:32.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.405 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:37:32.405 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016650+0000", 2024-02-19T21:37:32.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:37:32.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.405 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:37:32.405 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016649+0000", 2024-02-19T21:37:32.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9706999999999999e-05 2024-02-19T21:37:32.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.406 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:37:32.406 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016679+0000", 2024-02-19T21:37:32.406 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3230000000000004e-06 2024-02-19T21:37:32.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.406 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:37:32.406 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016688+0000", 2024-02-19T21:37:32.406 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2100000000000001e-06 2024-02-19T21:37:32.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.406 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:37:32.406 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016694+0000", 2024-02-19T21:37:32.406 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8446000000000003e-05 2024-02-19T21:37:32.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.407 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:37:32.407 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016742+0000", 2024-02-19T21:37:32.407 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.861e-05 2024-02-19T21:37:32.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.407 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:37:32.407 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016761+0000", 2024-02-19T21:37:32.407 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.059597632999999997 2024-02-19T21:37:32.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.407 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:37:32.407 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.076358+0000", 2024-02-19T21:37:32.407 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9610999999999997e-05 2024-02-19T21:37:32.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.407 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:37:32.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.076398+0000", 2024-02-19T21:37:32.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.059747791000000001 2024-02-19T21:37:32.408 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.408 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:37:32.408 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.408 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:28371 7.2 7:4b9acdca:::benchmark_data_smithi080_79222_object28370:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-19T21:37:32.408 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:41.016760+0000", 2024-02-19T21:37:32.408 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 111.355662893, 2024-02-19T21:37:32.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.064063558000000007, 2024-02-19T21:37:32.408 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:37:32.409 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:37:32.409 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:37:32.409 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:37:32.409 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:37:32.409 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 28371 2024-02-19T21:37:32.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.409 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:37:32.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.409 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:37:32.409 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016760+0000", 2024-02-19T21:37:32.409 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:37:32.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.409 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:37:32.410 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016760+0000", 2024-02-19T21:37:32.410 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:37:32.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.410 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:37:32.410 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016759+0000", 2024-02-19T21:37:32.410 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1466000000000001e-05 2024-02-19T21:37:32.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.410 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:37:32.410 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016780+0000", 2024-02-19T21:37:32.410 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8089999999999999e-06 2024-02-19T21:37:32.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.410 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:37:32.411 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016789+0000", 2024-02-19T21:37:32.411 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1019999999999996e-06 2024-02-19T21:37:32.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.411 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:37:32.411 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016794+0000", 2024-02-19T21:37:32.411 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1641999999999999e-05 2024-02-19T21:37:32.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.411 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:37:32.411 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016836+0000", 2024-02-19T21:37:32.411 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116966 2024-02-19T21:37:32.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.411 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:37:32.412 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016953+0000", 2024-02-19T21:37:32.412 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000103906 2024-02-19T21:37:32.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.412 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,2", 2024-02-19T21:37:32.412 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.017057+0000", 2024-02-19T21:37:32.412 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.062902298999999995 2024-02-19T21:37:32.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.412 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:37:32.412 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.079959+0000", 2024-02-19T21:37:32.412 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00057589999999999996 2024-02-19T21:37:32.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.413 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:37:32.413 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.080535+0000", 2024-02-19T21:37:32.413 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017077600000000001 2024-02-19T21:37:32.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.413 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:37:32.413 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.080706+0000", 2024-02-19T21:37:32.413 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0539999999999999e-05 2024-02-19T21:37:32.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.413 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:37:32.413 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.080776+0000", 2024-02-19T21:37:32.413 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7372e-05 2024-02-19T21:37:32.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.414 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:37:32.414 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.080824+0000", 2024-02-19T21:37:32.414 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.064063558000000007 2024-02-19T21:37:32.414 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.414 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:37:32.414 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.414 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.14793.0:28364 7.c e107/100 7:327efdff:::benchmark_data_smithi080_79222_object28363:head v 107'1805, mlcod=107'1802)", 2024-02-19T21:37:32.414 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:41.016815+0000", 2024-02-19T21:37:32.414 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 111.35560814900001, 2024-02-19T21:37:32.414 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.059966968000000002, 2024-02-19T21:37:32.414 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:37:32.414 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:37:32.415 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:37:32.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.415 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:37:32.415 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016815+0000", 2024-02-19T21:37:32.415 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:37:32.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.415 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:37:32.415 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016815+0000", 2024-02-19T21:37:32.415 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:37:32.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.415 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:37:32.415 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016815+0000", 2024-02-19T21:37:32.415 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2394000000000002e-05 2024-02-19T21:37:32.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:37:32.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016847+0000", 2024-02-19T21:37:32.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4829999999999996e-06 2024-02-19T21:37:32.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:37:32.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016853+0000", 2024-02-19T21:37:32.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8029999999999998e-06 2024-02-19T21:37:32.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:37:32.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016857+0000", 2024-02-19T21:37:32.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6353000000000002e-05 2024-02-19T21:37:32.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:37:32.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016894+0000", 2024-02-19T21:37:32.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8403e-05 2024-02-19T21:37:32.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:37:32.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016912+0000", 2024-02-19T21:37:32.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.059844508999999997 2024-02-19T21:37:32.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:37:32.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.076756+0000", 2024-02-19T21:37:32.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5392e-05 2024-02-19T21:37:32.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.418 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:37:32.418 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.076782+0000", 2024-02-19T21:37:32.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.059966968000000002 2024-02-19T21:37:32.418 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.418 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:37:32.418 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.418 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.14793.0:28366 7.7 e107/100 7:ee863d9d:::benchmark_data_smithi080_79222_object28365:head v 107'1779, mlcod=107'1776)", 2024-02-19T21:37:32.418 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:41.016866+0000", 2024-02-19T21:37:32.418 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 111.355557147, 2024-02-19T21:37:32.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.060500680000000001, 2024-02-19T21:37:32.418 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:37:32.419 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:37:32.419 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:37:32.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:37:32.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016866+0000", 2024-02-19T21:37:32.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:37:32.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:37:32.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016866+0000", 2024-02-19T21:37:32.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:37:32.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:37:32.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016866+0000", 2024-02-19T21:37:32.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7498e-05 2024-02-19T21:37:32.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:37:32.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016893+0000", 2024-02-19T21:37:32.420 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.908e-06 2024-02-19T21:37:32.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:37:32.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016899+0000", 2024-02-19T21:37:32.420 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8430000000000003e-06 2024-02-19T21:37:32.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:37:32.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016903+0000", 2024-02-19T21:37:32.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6693999999999994e-05 2024-02-19T21:37:32.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.421 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:37:32.421 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016979+0000", 2024-02-19T21:37:32.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8091e-05 2024-02-19T21:37:32.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.421 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:37:32.421 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016998+0000", 2024-02-19T21:37:32.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.060341594999999998 2024-02-19T21:37:32.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.421 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:37:32.421 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.077339+0000", 2024-02-19T21:37:32.422 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7409000000000001e-05 2024-02-19T21:37:32.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.422 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.422 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:37:32.422 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.077367+0000", 2024-02-19T21:37:32.422 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.060500680000000001 2024-02-19T21:37:32.422 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.422 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:37:32.422 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.422 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.422 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop_reply(client.14793.0:28359 7.3 e107/100 ondisk, result = 0)", 2024-02-19T21:37:32.422 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:41.016925+0000", 2024-02-19T21:37:32.422 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 111.355497779, 2024-02-19T21:37:32.422 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.059526461000000003, 2024-02-19T21:37:32.422 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:37:32.422 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:37:32.423 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:37:32.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.423 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:37:32.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016925+0000", 2024-02-19T21:37:32.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:37:32.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.423 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:37:32.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016925+0000", 2024-02-19T21:37:32.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:37:32.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.423 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:37:32.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016925+0000", 2024-02-19T21:37:32.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0819999999999999e-06 2024-02-19T21:37:32.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.424 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:37:32.424 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016928+0000", 2024-02-19T21:37:32.424 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9440000000000002e-06 2024-02-19T21:37:32.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.424 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:37:32.424 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016934+0000", 2024-02-19T21:37:32.424 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.002e-06 2024-02-19T21:37:32.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.424 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:37:32.424 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.016938+0000", 2024-02-19T21:37:32.424 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.059496525000000001 2024-02-19T21:37:32.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.425 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:37:32.425 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.076434+0000", 2024-02-19T21:37:32.425 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7530000000000001e-06 2024-02-19T21:37:32.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.425 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:37:32.425 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.076442+0000", 2024-02-19T21:37:32.425 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5750000000000007e-06 2024-02-19T21:37:32.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.425 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:37:32.425 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.076452+0000", 2024-02-19T21:37:32.425 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.059526461000000003 2024-02-19T21:37:32.425 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.425 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:37:32.425 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.426 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop_reply(client.14793.0:28360 7.3 e107/100 ondisk, result = 0)", 2024-02-19T21:37:32.426 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:41.017805+0000", 2024-02-19T21:37:32.426 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 111.354618047, 2024-02-19T21:37:32.426 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.059250946999999998, 2024-02-19T21:37:32.426 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:37:32.426 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:37:32.426 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:37:32.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.426 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:37:32.426 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.017805+0000", 2024-02-19T21:37:32.426 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:37:32.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:37:32.427 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.017805+0000", 2024-02-19T21:37:32.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:37:32.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:37:32.427 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.017804+0000", 2024-02-19T21:37:32.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6240000000000001e-06 2024-02-19T21:37:32.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:37:32.427 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.017809+0000", 2024-02-19T21:37:32.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.059004294999999998 2024-02-19T21:37:32.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.428 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:37:32.428 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.076813+0000", 2024-02-19T21:37:32.428 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0800000000000002e-06 2024-02-19T21:37:32.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.428 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:37:32.428 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.076819+0000", 2024-02-19T21:37:32.428 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022236399999999999 2024-02-19T21:37:32.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.428 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:37:32.428 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.077042+0000", 2024-02-19T21:37:32.428 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0179999999999998e-06 2024-02-19T21:37:32.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.429 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:37:32.429 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.077048+0000", 2024-02-19T21:37:32.429 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1000000000000004e-06 2024-02-19T21:37:32.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.429 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:37:32.429 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.077056+0000", 2024-02-19T21:37:32.429 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.059250946999999998 2024-02-19T21:37:32.429 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.429 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:37:32.429 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.429 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop_reply(client.14793.0:28369 7.a e107/100 ondisk, result = 0)", 2024-02-19T21:37:32.429 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:41.018392+0000", 2024-02-19T21:37:32.429 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 111.354031269, 2024-02-19T21:37:32.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.059126241000000003, 2024-02-19T21:37:32.430 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:37:32.430 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:37:32.430 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:37:32.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.430 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:37:32.430 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.018392+0000", 2024-02-19T21:37:32.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:37:32.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.430 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:37:32.430 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.018392+0000", 2024-02-19T21:37:32.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:37:32.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.431 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:37:32.431 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.018391+0000", 2024-02-19T21:37:32.431 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0039999999999999e-06 2024-02-19T21:37:32.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.431 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:37:32.431 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.018396+0000", 2024-02-19T21:37:32.431 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.059025175999999999 2024-02-19T21:37:32.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.431 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:37:32.431 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.077421+0000", 2024-02-19T21:37:32.431 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.952e-06 2024-02-19T21:37:32.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.432 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:37:32.432 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.077430+0000", 2024-02-19T21:37:32.432 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1673000000000003e-05 2024-02-19T21:37:32.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.432 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:37:32.432 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.077502+0000", 2024-02-19T21:37:32.432 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1559999999999998e-06 2024-02-19T21:37:32.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.432 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:37:32.432 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.077509+0000", 2024-02-19T21:37:32.432 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.918e-06 2024-02-19T21:37:32.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:37:32.433 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:41.077518+0000", 2024-02-19T21:37:32.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.059126241000000003 2024-02-19T21:37:32.433 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.433 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:37:32.433 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.433 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.14793.0:34744 7.6 e109/100 7:6c664d92:::benchmark_data_smithi080_79222_object34743:head v 109'2158, mlcod=108'2155)", 2024-02-19T21:37:32.433 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:35:44.912824+0000", 2024-02-19T21:37:32.433 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 107.459599224, 2024-02-19T21:37:32.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.051093472000000001, 2024-02-19T21:37:32.433 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:37:32.433 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:37:32.433 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:37:32.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.434 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:37:32.434 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:44.912824+0000", 2024-02-19T21:37:32.434 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:37:32.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.434 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:37:32.434 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:44.912824+0000", 2024-02-19T21:37:32.434 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:37:32.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.434 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:37:32.434 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:44.912823+0000", 2024-02-19T21:37:32.434 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6567000000000002e-05 2024-02-19T21:37:32.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:37:32.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:44.912850+0000", 2024-02-19T21:37:32.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9253e-05 2024-02-19T21:37:32.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:37:32.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:44.912869+0000", 2024-02-19T21:37:32.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2069999999999995e-06 2024-02-19T21:37:32.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:37:32.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:44.912877+0000", 2024-02-19T21:37:32.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2197999999999997e-05 2024-02-19T21:37:32.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.436 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:37:32.436 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:44.912929+0000", 2024-02-19T21:37:32.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3881999999999999e-05 2024-02-19T21:37:32.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.436 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:37:32.436 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:44.912953+0000", 2024-02-19T21:37:32.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.050931781000000002 2024-02-19T21:37:32.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.436 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:37:32.436 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:44.963885+0000", 2024-02-19T21:37:32.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2221999999999997e-05 2024-02-19T21:37:32.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.437 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:37:32.437 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:35:44.963917+0000", 2024-02-19T21:37:32.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.051093472000000001 2024-02-19T21:37:32.437 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.437 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:37:32.437 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.437 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:61975 7.2 7:4b556505:::benchmark_data_smithi080_79222_object61974:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e113)", 2024-02-19T21:37:32.437 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:36:04.897916+0000", 2024-02-19T21:37:32.438 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 87.474507239000005, 2024-02-19T21:37:32.438 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.051275330000000001, 2024-02-19T21:37:32.438 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:37:32.438 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:37:32.438 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:37:32.438 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:37:32.438 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:37:32.438 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 61975 2024-02-19T21:37:32.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.438 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:37:32.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.438 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:37:32.439 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:04.897916+0000", 2024-02-19T21:37:32.439 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:37:32.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.439 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:37:32.439 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:04.897916+0000", 2024-02-19T21:37:32.439 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:37:32.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.439 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:37:32.439 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:04.897914+0000", 2024-02-19T21:37:32.439 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0375999999999999e-05 2024-02-19T21:37:32.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:37:32.440 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:04.897935+0000", 2024-02-19T21:37:32.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6804999999999999e-05 2024-02-19T21:37:32.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:37:32.440 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:04.897951+0000", 2024-02-19T21:37:32.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8619999999999997e-06 2024-02-19T21:37:32.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:37:32.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:04.897958+0000", 2024-02-19T21:37:32.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0959999999999997e-05 2024-02-19T21:37:32.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.441 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:37:32.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:04.898039+0000", 2024-02-19T21:37:32.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000177875 2024-02-19T21:37:32.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.441 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:37:32.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:04.898217+0000", 2024-02-19T21:37:32.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000187994 2024-02-19T21:37:32.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.442 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,2", 2024-02-19T21:37:32.442 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:04.898405+0000", 2024-02-19T21:37:32.442 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.039458594999999999 2024-02-19T21:37:32.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.442 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:37:32.442 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:04.937864+0000", 2024-02-19T21:37:32.442 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043631019999999998 2024-02-19T21:37:32.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.442 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:37:32.443 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:04.942227+0000", 2024-02-19T21:37:32.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0068959399999999997 2024-02-19T21:37:32.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.443 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:37:32.443 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:04.949123+0000", 2024-02-19T21:37:32.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8022000000000003e-05 2024-02-19T21:37:32.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.443 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:37:32.443 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:04.949161+0000", 2024-02-19T21:37:32.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0420999999999999e-05 2024-02-19T21:37:32.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.444 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:37:32.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:04.949191+0000", 2024-02-19T21:37:32.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.051275330000000001 2024-02-19T21:37:32.444 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.444 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:37:32.444 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.444 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:62928 7.2 7:484b014d:::benchmark_data_smithi080_79222_object62927:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e113)", 2024-02-19T21:37:32.444 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:36:05.696270+0000", 2024-02-19T21:37:32.445 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.676152880000004, 2024-02-19T21:37:32.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.062334978999999999, 2024-02-19T21:37:32.445 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:37:32.445 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:37:32.445 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:37:32.445 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:37:32.445 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:37:32.445 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 62928 2024-02-19T21:37:32.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.445 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:37:32.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.445 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:37:32.445 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.696270+0000", 2024-02-19T21:37:32.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:37:32.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:37:32.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.696270+0000", 2024-02-19T21:37:32.446 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:37:32.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:37:32.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.696269+0000", 2024-02-19T21:37:32.446 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4331000000000001e-05 2024-02-19T21:37:32.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:37:32.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.696293+0000", 2024-02-19T21:37:32.446 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1846e-05 2024-02-19T21:37:32.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:37:32.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.696305+0000", 2024-02-19T21:37:32.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2380000000000002e-06 2024-02-19T21:37:32.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:37:32.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.696311+0000", 2024-02-19T21:37:32.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3441000000000003e-05 2024-02-19T21:37:32.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:37:32.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.696395+0000", 2024-02-19T21:37:32.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015840599999999999 2024-02-19T21:37:32.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.448 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:37:32.448 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.696553+0000", 2024-02-19T21:37:32.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014237899999999999 2024-02-19T21:37:32.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.448 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,2", 2024-02-19T21:37:32.448 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.696695+0000", 2024-02-19T21:37:32.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.061548529999999997 2024-02-19T21:37:32.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.448 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:37:32.448 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.758244+0000", 2024-02-19T21:37:32.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8316999999999997e-05 2024-02-19T21:37:32.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:37:32.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.758302+0000", 2024-02-19T21:37:32.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020193699999999999 2024-02-19T21:37:32.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:37:32.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.758504+0000", 2024-02-19T21:37:32.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.787e-05 2024-02-19T21:37:32.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:37:32.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.758562+0000", 2024-02-19T21:37:32.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.316e-05 2024-02-19T21:37:32.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.450 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.450 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:37:32.450 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.758605+0000", 2024-02-19T21:37:32.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.062334978999999999 2024-02-19T21:37:32.450 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.450 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:37:32.450 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.450 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.450 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:62934 7.2 7:431f8804:::benchmark_data_smithi080_79222_object62933:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e113)", 2024-02-19T21:37:32.450 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:36:05.696376+0000", 2024-02-19T21:37:32.450 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.676047267000001, 2024-02-19T21:37:32.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.062319241999999997, 2024-02-19T21:37:32.451 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:37:32.451 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:37:32.451 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:37:32.451 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:37:32.451 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:37:32.451 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 62934 2024-02-19T21:37:32.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.451 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:37:32.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.451 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:37:32.451 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.696376+0000", 2024-02-19T21:37:32.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:37:32.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.452 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:37:32.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.696376+0000", 2024-02-19T21:37:32.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:37:32.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.452 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:37:32.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.696375+0000", 2024-02-19T21:37:32.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8063e-05 2024-02-19T21:37:32.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.452 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:37:32.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.696393+0000", 2024-02-19T21:37:32.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.993e-06 2024-02-19T21:37:32.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:37:32.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.696399+0000", 2024-02-19T21:37:32.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0879999999999997e-06 2024-02-19T21:37:32.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:37:32.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.696403+0000", 2024-02-19T21:37:32.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002412352 2024-02-19T21:37:32.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:37:32.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.698816+0000", 2024-02-19T21:37:32.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000123693 2024-02-19T21:37:32.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.454 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:37:32.454 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.698939+0000", 2024-02-19T21:37:32.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134812 2024-02-19T21:37:32.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.454 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,2", 2024-02-19T21:37:32.454 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.699074+0000", 2024-02-19T21:37:32.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.059200126999999998 2024-02-19T21:37:32.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.454 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:37:32.454 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.758274+0000", 2024-02-19T21:37:32.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021817599999999999 2024-02-19T21:37:32.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:37:32.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.758493+0000", 2024-02-19T21:37:32.455 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120975 2024-02-19T21:37:32.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:37:32.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.758614+0000", 2024-02-19T21:37:32.455 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4722999999999999e-05 2024-02-19T21:37:32.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:37:32.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.758658+0000", 2024-02-19T21:37:32.455 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6708999999999997e-05 2024-02-19T21:37:32.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:37:32.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.758695+0000", 2024-02-19T21:37:32.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.062319241999999997 2024-02-19T21:37:32.456 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.456 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:37:32.456 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.456 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:62935 7.2 7:4d49b73c:::benchmark_data_smithi080_79222_object62934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e113)", 2024-02-19T21:37:32.456 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:36:05.696409+0000", 2024-02-19T21:37:32.456 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.676013940000004, 2024-02-19T21:37:32.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.067568351999999998, 2024-02-19T21:37:32.456 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:37:32.456 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:37:32.457 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:37:32.457 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:37:32.457 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:37:32.457 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 62935 2024-02-19T21:37:32.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.457 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:37:32.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:37:32.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.696409+0000", 2024-02-19T21:37:32.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:37:32.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:37:32.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.696409+0000", 2024-02-19T21:37:32.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:37:32.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.458 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:37:32.458 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.696409+0000", 2024-02-19T21:37:32.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7110000000000001e-05 2024-02-19T21:37:32.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.458 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:37:32.458 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.696426+0000", 2024-02-19T21:37:32.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9529999999999996e-06 2024-02-19T21:37:32.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.458 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:37:32.458 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.696432+0000", 2024-02-19T21:37:32.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7100000000000001e-06 2024-02-19T21:37:32.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:37:32.459 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.696435+0000", 2024-02-19T21:37:32.459 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044947210000000001 2024-02-19T21:37:32.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:37:32.459 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.700930+0000", 2024-02-19T21:37:32.459 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.054917689999999998 2024-02-19T21:37:32.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:37:32.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.755848+0000", 2024-02-19T21:37:32.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016601100000000001 2024-02-19T21:37:32.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,2", 2024-02-19T21:37:32.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.756014+0000", 2024-02-19T21:37:32.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034225269999999999 2024-02-19T21:37:32.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:37:32.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.759436+0000", 2024-02-19T21:37:32.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001884719 2024-02-19T21:37:32.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:37:32.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.761321+0000", 2024-02-19T21:37:32.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025666970000000002 2024-02-19T21:37:32.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:37:32.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.763888+0000", 2024-02-19T21:37:32.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0621999999999997e-05 2024-02-19T21:37:32.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:37:32.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.763938+0000", 2024-02-19T21:37:32.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9153000000000003e-05 2024-02-19T21:37:32.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.462 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:37:32.462 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.763977+0000", 2024-02-19T21:37:32.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.067568351999999998 2024-02-19T21:37:32.462 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.462 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:37:32.462 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.462 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.14793.0:62937 7.c e113/100 7:34b83ff0:::benchmark_data_smithi080_79222_object62936:head v 113'3996, mlcod=113'3994)", 2024-02-19T21:37:32.462 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:36:05.697054+0000", 2024-02-19T21:37:32.462 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.675369121000003, 2024-02-19T21:37:32.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.059233114000000003, 2024-02-19T21:37:32.462 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:37:32.462 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:37:32.462 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:37:32.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.463 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:37:32.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.697054+0000", 2024-02-19T21:37:32.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:37:32.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.463 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:37:32.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.697054+0000", 2024-02-19T21:37:32.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:37:32.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.463 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:37:32.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.697053+0000", 2024-02-19T21:37:32.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1253000000000004e-05 2024-02-19T21:37:32.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.464 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:37:32.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.697124+0000", 2024-02-19T21:37:32.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.171e-05 2024-02-19T21:37:32.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.464 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:37:32.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.697136+0000", 2024-02-19T21:37:32.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8159999999999996e-06 2024-02-19T21:37:32.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.464 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:37:32.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.697143+0000", 2024-02-19T21:37:32.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016724450000000001 2024-02-19T21:37:32.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:37:32.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.698815+0000", 2024-02-19T21:37:32.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0363000000000001e-05 2024-02-19T21:37:32.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:37:32.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.698836+0000", 2024-02-19T21:37:32.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.057419088 2024-02-19T21:37:32.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:37:32.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.756255+0000", 2024-02-19T21:37:32.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2366000000000001e-05 2024-02-19T21:37:32.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:37:32.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.756287+0000", 2024-02-19T21:37:32.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.059233114000000003 2024-02-19T21:37:32.466 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.466 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:37:32.466 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.466 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop_reply(client.14793.0:62928 7.2 e113/100 ondisk, result = 0)", 2024-02-19T21:37:32.466 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:36:05.699086+0000", 2024-02-19T21:37:32.466 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.673336978999998, 2024-02-19T21:37:32.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.059159590999999997, 2024-02-19T21:37:32.466 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:37:32.466 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:37:32.466 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:37:32.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:37:32.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.699086+0000", 2024-02-19T21:37:32.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:37:32.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:37:32.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.699086+0000", 2024-02-19T21:37:32.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:37:32.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:37:32.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.699085+0000", 2024-02-19T21:37:32.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8849999999999998e-06 2024-02-19T21:37:32.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:37:32.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.699090+0000", 2024-02-19T21:37:32.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0057000000000001e-05 2024-02-19T21:37:32.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:37:32.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.699110+0000", 2024-02-19T21:37:32.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9840000000000001e-06 2024-02-19T21:37:32.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:37:32.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.699115+0000", 2024-02-19T21:37:32.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.059114895000000001 2024-02-19T21:37:32.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:37:32.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.758230+0000", 2024-02-19T21:37:32.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5649999999999998e-06 2024-02-19T21:37:32.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:37:32.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.758237+0000", 2024-02-19T21:37:32.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.816e-06 2024-02-19T21:37:32.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:37:32.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.758246+0000", 2024-02-19T21:37:32.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.059159590999999997 2024-02-19T21:37:32.469 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.469 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:37:32.469 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.470 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop_reply(client.14793.0:62934 7.2 e113/100 ondisk, result = 0)", 2024-02-19T21:37:32.470 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:36:05.701329+0000", 2024-02-19T21:37:32.470 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.671094331000006, 2024-02-19T21:37:32.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.056946732999999999, 2024-02-19T21:37:32.470 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:37:32.470 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:37:32.470 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:37:32.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:37:32.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.701329+0000", 2024-02-19T21:37:32.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:37:32.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:37:32.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.701329+0000", 2024-02-19T21:37:32.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:37:32.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:37:32.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.701328+0000", 2024-02-19T21:37:32.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7899999999999996e-06 2024-02-19T21:37:32.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:37:32.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.701334+0000", 2024-02-19T21:37:32.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.054594538999999997 2024-02-19T21:37:32.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:37:32.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.755928+0000", 2024-02-19T21:37:32.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5119999999999997e-06 2024-02-19T21:37:32.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:37:32.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.755938+0000", 2024-02-19T21:37:32.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023259190000000001 2024-02-19T21:37:32.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:37:32.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.758264+0000", 2024-02-19T21:37:32.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4820000000000002e-06 2024-02-19T21:37:32.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.473 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:37:32.473 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.758269+0000", 2024-02-19T21:37:32.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2469999999999997e-06 2024-02-19T21:37:32.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:37:32.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:37:32.473 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:37:32.473 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.758275+0000", 2024-02-19T21:37:32.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.056946732999999999 2024-02-19T21:37:32.473 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.473 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:37:32.473 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.473 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:37:32.473 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:37:32.473 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:37:32.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:30.875815+0000 mgr.y (mgr.14514) 197 : cluster [DBG] pgmap v205: 148 pgs: 148 active+clean; 5.3 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 923 op/s 2024-02-19T21:37:32.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:31.939759+0000 mon.a (mon.0) 872 : audit [DBG] from='client.? 172.21.15.80:0/36760545' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:37:32.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:30.875815+0000 mgr.y (mgr.14514) 197 : cluster [DBG] pgmap v205: 148 pgs: 148 active+clean; 5.3 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 923 op/s 2024-02-19T21:37:32.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:31.939759+0000 mon.a (mon.0) 872 : audit [DBG] from='client.? 172.21.15.80:0/36760545' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:37:33.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:32.539824+0000 osd.6 (osd.6) 74 : cluster [DBG] 7.7 scrub ok 2024-02-19T21:37:33.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:32.800327+0000 osd.1 (osd.1) 97 : cluster [DBG] 4.7 scrub starts 2024-02-19T21:37:33.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:32.805986+0000 osd.1 (osd.1) 98 : cluster [DBG] 4.7 scrub ok 2024-02-19T21:37:33.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:32.539824+0000 osd.6 (osd.6) 74 : cluster [DBG] 7.7 scrub ok 2024-02-19T21:37:33.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:32.800327+0000 osd.1 (osd.1) 97 : cluster [DBG] 4.7 scrub starts 2024-02-19T21:37:33.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:32.805986+0000 osd.1 (osd.1) 98 : cluster [DBG] 4.7 scrub ok 2024-02-19T21:37:33.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:32.539824+0000 osd.6 (osd.6) 74 : cluster [DBG] 7.7 scrub ok 2024-02-19T21:37:33.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:32.800327+0000 osd.1 (osd.1) 97 : cluster [DBG] 4.7 scrub starts 2024-02-19T21:37:33.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:32.805986+0000 osd.1 (osd.1) 98 : cluster [DBG] 4.7 scrub ok 2024-02-19T21:37:34.321 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:37:34.325 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:34.326 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:37:34.426 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:37:34.462 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:34.489 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:37:34.494 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:34.494 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:37:34.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:32.876219+0000 mgr.y (mgr.14514) 198 : cluster [DBG] pgmap v206: 148 pgs: 148 active+clean; 5.3 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 924 op/s 2024-02-19T21:37:34.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:32.885641+0000 osd.0 (osd.0) 109 : cluster [DBG] 6.16 scrub starts 2024-02-19T21:37:34.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:32.890710+0000 osd.0 (osd.0) 110 : cluster [DBG] 6.16 scrub ok 2024-02-19T21:37:34.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:33.005228+0000 osd.2 (osd.2) 90 : cluster [DBG] 2.e deep-scrub starts 2024-02-19T21:37:34.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:33.010542+0000 osd.2 (osd.2) 91 : cluster [DBG] 2.e deep-scrub ok 2024-02-19T21:37:34.595 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:37:34.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:32.876219+0000 mgr.y (mgr.14514) 198 : cluster [DBG] pgmap v206: 148 pgs: 148 active+clean; 5.3 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 924 op/s 2024-02-19T21:37:34.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:32.885641+0000 osd.0 (osd.0) 109 : cluster [DBG] 6.16 scrub starts 2024-02-19T21:37:34.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:32.890710+0000 osd.0 (osd.0) 110 : cluster [DBG] 6.16 scrub ok 2024-02-19T21:37:34.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:33.005228+0000 osd.2 (osd.2) 90 : cluster [DBG] 2.e deep-scrub starts 2024-02-19T21:37:34.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:33.010542+0000 osd.2 (osd.2) 91 : cluster [DBG] 2.e deep-scrub ok 2024-02-19T21:37:34.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:32.876219+0000 mgr.y (mgr.14514) 198 : cluster [DBG] pgmap v206: 148 pgs: 148 active+clean; 5.3 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 924 op/s 2024-02-19T21:37:34.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:32.885641+0000 osd.0 (osd.0) 109 : cluster [DBG] 6.16 scrub starts 2024-02-19T21:37:34.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:32.890710+0000 osd.0 (osd.0) 110 : cluster [DBG] 6.16 scrub ok 2024-02-19T21:37:34.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:33.005228+0000 osd.2 (osd.2) 90 : cluster [DBG] 2.e deep-scrub starts 2024-02-19T21:37:34.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:33.010542+0000 osd.2 (osd.2) 91 : cluster [DBG] 2.e deep-scrub ok 2024-02-19T21:37:34.631 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:35.594 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:37:35.603 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:35.604 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:37:35.705 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:37:35.734 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:35.763 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:37:35.766 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:35.766 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:37:35.867 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:37:35.947 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:36.057 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:37:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:37:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:37:36.320 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:34.876869+0000 mgr.y (mgr.14514) 199 : cluster [DBG] pgmap v207: 148 pgs: 148 active+clean; 5.1 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 919 op/s 2024-02-19T21:37:36.320 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:34.882297+0000 osd.5 (osd.5) 100 : cluster [DBG] 4.15 deep-scrub starts 2024-02-19T21:37:36.320 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:34.892814+0000 osd.5 (osd.5) 101 : cluster [DBG] 4.15 deep-scrub ok 2024-02-19T21:37:36.320 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:35.171139+0000 osd.4 (osd.4) 91 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:37:36.320 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:35.171198+0000 osd.4 (osd.4) 92 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:37:36.320 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:35.928079+0000 mon.a (mon.0) 873 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2024-02-19T21:37:36.416 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:37:36.437 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:36.438 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:37:36.539 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:37:36.572 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:34.876869+0000 mgr.y (mgr.14514) 199 : cluster [DBG] pgmap v207: 148 pgs: 148 active+clean; 5.1 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 919 op/s 2024-02-19T21:37:36.573 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:34.882297+0000 osd.5 (osd.5) 100 : cluster [DBG] 4.15 deep-scrub starts 2024-02-19T21:37:36.573 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:34.892814+0000 osd.5 (osd.5) 101 : cluster [DBG] 4.15 deep-scrub ok 2024-02-19T21:37:36.573 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:35.171139+0000 osd.4 (osd.4) 91 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:37:36.573 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:35.171198+0000 osd.4 (osd.4) 92 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:37:36.573 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:35.928079+0000 mon.a (mon.0) 873 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2024-02-19T21:37:36.573 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:36.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:34.876869+0000 mgr.y (mgr.14514) 199 : cluster [DBG] pgmap v207: 148 pgs: 148 active+clean; 5.1 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 919 op/s 2024-02-19T21:37:36.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:34.882297+0000 osd.5 (osd.5) 100 : cluster [DBG] 4.15 deep-scrub starts 2024-02-19T21:37:36.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:34.892814+0000 osd.5 (osd.5) 101 : cluster [DBG] 4.15 deep-scrub ok 2024-02-19T21:37:36.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:35.171139+0000 osd.4 (osd.4) 91 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:37:36.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:35.171198+0000 osd.4 (osd.4) 92 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:37:36.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:35.928079+0000 mon.a (mon.0) 873 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2024-02-19T21:37:36.601 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:37:36.604 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:36.605 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:37:36.706 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:37:36.761 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:36.966 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:37:36.974 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:36.974 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:37:36.983 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.4 dump_ops_in_flight 2024-02-19T21:37:37.076 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:37:37.139 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:37.332 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:37:37.353 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:37:37.376 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:37:37.381 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:37.381 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:37:37.482 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:37:37.513 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:37.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:35.780321+0000 osd.3 (osd.3) 125 : cluster [DBG] 6.c scrub starts 2024-02-19T21:37:37.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:35.789456+0000 osd.3 (osd.3) 126 : cluster [DBG] 6.c scrub ok 2024-02-19T21:37:37.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:35.894614+0000 osd.5 (osd.5) 102 : cluster [DBG] 5.15 scrub starts 2024-02-19T21:37:37.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:35.900913+0000 osd.5 (osd.5) 103 : cluster [DBG] 5.15 scrub ok 2024-02-19T21:37:37.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:35.968252+0000 osd.7 (osd.7) 93 : cluster [DBG] 2.1d scrub starts 2024-02-19T21:37:37.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:35.972139+0000 osd.7 (osd.7) 94 : cluster [DBG] 2.1d scrub ok 2024-02-19T21:37:37.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:36.882196+0000 osd.1 (osd.1) 99 : cluster [DBG] 2.d scrub starts 2024-02-19T21:37:37.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:36.883144+0000 osd.1 (osd.1) 100 : cluster [DBG] 2.d scrub ok 2024-02-19T21:37:37.592 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:37:37.596 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:37.648 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:37:37.649 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:35.780321+0000 osd.3 (osd.3) 125 : cluster [DBG] 6.c scrub starts 2024-02-19T21:37:37.649 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:35.789456+0000 osd.3 (osd.3) 126 : cluster [DBG] 6.c scrub ok 2024-02-19T21:37:37.649 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:35.894614+0000 osd.5 (osd.5) 102 : cluster [DBG] 5.15 scrub starts 2024-02-19T21:37:37.649 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:35.900913+0000 osd.5 (osd.5) 103 : cluster [DBG] 5.15 scrub ok 2024-02-19T21:37:37.649 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:35.968252+0000 osd.7 (osd.7) 93 : cluster [DBG] 2.1d scrub starts 2024-02-19T21:37:37.649 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:35.972139+0000 osd.7 (osd.7) 94 : cluster [DBG] 2.1d scrub ok 2024-02-19T21:37:37.649 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:36.882196+0000 osd.1 (osd.1) 99 : cluster [DBG] 2.d scrub starts 2024-02-19T21:37:37.649 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:36.883144+0000 osd.1 (osd.1) 100 : cluster [DBG] 2.d scrub ok 2024-02-19T21:37:37.650 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:35.780321+0000 osd.3 (osd.3) 125 : cluster [DBG] 6.c scrub starts 2024-02-19T21:37:37.650 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:35.789456+0000 osd.3 (osd.3) 126 : cluster [DBG] 6.c scrub ok 2024-02-19T21:37:37.650 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:35.894614+0000 osd.5 (osd.5) 102 : cluster [DBG] 5.15 scrub starts 2024-02-19T21:37:37.650 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:35.900913+0000 osd.5 (osd.5) 103 : cluster [DBG] 5.15 scrub ok 2024-02-19T21:37:37.650 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:35.968252+0000 osd.7 (osd.7) 93 : cluster [DBG] 2.1d scrub starts 2024-02-19T21:37:37.650 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:35.972139+0000 osd.7 (osd.7) 94 : cluster [DBG] 2.1d scrub ok 2024-02-19T21:37:37.651 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:36.882196+0000 osd.1 (osd.1) 99 : cluster [DBG] 2.d scrub starts 2024-02-19T21:37:37.651 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:36.883144+0000 osd.1 (osd.1) 100 : cluster [DBG] 2.d scrub ok 2024-02-19T21:37:37.749 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:37:37.787 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:37.830 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:37:37.835 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:37.836 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:37:37.936 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:37:37.969 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:38.225 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:37:38.228 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:38.229 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:37:38.329 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:37:38.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:36.877265+0000 mgr.y (mgr.14514) 200 : cluster [DBG] pgmap v209: 148 pgs: 148 active+clean; 5.0 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 920 op/s 2024-02-19T21:37:38.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:36.978759+0000 osd.2 (osd.2) 92 : cluster [DBG] 7.8 scrub starts 2024-02-19T21:37:38.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:37.640729+0000 mon.a (mon.0) 874 : audit [INF] from='client.? 172.21.15.80:0/2213366727' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:37:38.368 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:38.380 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-02-19T21:37:38.451 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:37:38.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:36.877265+0000 mgr.y (mgr.14514) 200 : cluster [DBG] pgmap v209: 148 pgs: 148 active+clean; 5.0 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 920 op/s 2024-02-19T21:37:38.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:36.978759+0000 osd.2 (osd.2) 92 : cluster [DBG] 7.8 scrub starts 2024-02-19T21:37:38.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:37.640729+0000 mon.a (mon.0) 874 : audit [INF] from='client.? 172.21.15.80:0/2213366727' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:37:38.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:36.877265+0000 mgr.y (mgr.14514) 200 : cluster [DBG] pgmap v209: 148 pgs: 148 active+clean; 5.0 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 920 op/s 2024-02-19T21:37:38.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:36.978759+0000 osd.2 (osd.2) 92 : cluster [DBG] 7.8 scrub starts 2024-02-19T21:37:38.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:37.640729+0000 mon.a (mon.0) 874 : audit [INF] from='client.? 172.21.15.80:0/2213366727' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:37:38.929 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:37:38.931 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:38.931 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:37:39.032 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:37:39.068 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:39.223 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:37:39.228 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:39.229 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:37:39.330 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:37:39.369 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:39.398 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:37:39.406 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:39.406 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:37:39.507 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:37:39.546 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:38.335498+0000 mon.a (mon.0) 875 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:37:39.546 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:38.359124+0000 mon.a (mon.0) 876 : audit [INF] from='client.? 172.21.15.80:0/2213366727' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:37:39.546 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:38.359175+0000 mon.a (mon.0) 877 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2024-02-19T21:37:39.548 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:39.569 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:37:39.569 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [ 2024-02-19T21:37:39.569 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.569 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_repop(client.14793.0:152256 7.9 e135/100 7:96ba088b:::benchmark_data_smithi080_79222_object37522:head v 135'9244, mlcod=135'9242)", 2024-02-19T21:37:39.569 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:37:39.555358+0000", 2024-02-19T21:37:39.569 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.012363956000000001, 2024-02-19T21:37:39.569 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.012394674, 2024-02-19T21:37:39.569 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:37:39.569 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "started", 2024-02-19T21:37:39.570 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:37:39.570 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.570 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:37:39.570 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.555358+0000", 2024-02-19T21:37:39.570 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:37:39.570 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.570 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.570 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:37:39.570 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.555358+0000", 2024-02-19T21:37:39.570 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:37:39.570 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.570 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.571 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:37:39.571 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.555357+0000", 2024-02-19T21:37:39.571 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.6579999999999999e-06 2024-02-19T21:37:39.571 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.571 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.571 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:37:39.571 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.555363+0000", 2024-02-19T21:37:39.571 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0036e-05 2024-02-19T21:37:39.571 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.571 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.571 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:37:39.571 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.555373+0000", 2024-02-19T21:37:39.572 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.7949999999999998e-06 2024-02-19T21:37:39.572 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.572 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.572 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:37:39.572 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.555378+0000", 2024-02-19T21:37:39.572 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.1445e-05 2024-02-19T21:37:39.572 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.572 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.572 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:37:39.572 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.555419+0000", 2024-02-19T21:37:39.573 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.2149000000000001e-05 2024-02-19T21:37:39.573 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.573 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.573 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:37:39.573 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.555441+0000", 2024-02-19T21:37:39.573 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.3635999999999997e-05 2024-02-19T21:37:39.573 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:37:39.573 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:37:39.573 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:37:39.573 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.573 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.573 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_repop(client.14793.0:152257 7.9 e135/100 7:92731222:::benchmark_data_smithi080_79222_object37523:head v 135'9245, mlcod=135'9242)", 2024-02-19T21:37:39.573 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:37:39.555490+0000", 2024-02-19T21:37:39.573 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.012231315, 2024-02-19T21:37:39.573 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.012332950000000001, 2024-02-19T21:37:39.574 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:37:39.574 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "started", 2024-02-19T21:37:39.574 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:37:39.574 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.574 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:37:39.574 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.555490+0000", 2024-02-19T21:37:39.574 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:37:39.574 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.574 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.574 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:37:39.574 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.555490+0000", 2024-02-19T21:37:39.574 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:37:39.574 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.574 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.574 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:37:39.574 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.555490+0000", 2024-02-19T21:37:39.575 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.5770000000000001e-06 2024-02-19T21:37:39.575 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.575 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.575 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:37:39.575 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.555495+0000", 2024-02-19T21:37:39.575 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.1329999999999998e-06 2024-02-19T21:37:39.575 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.575 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.575 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:37:39.575 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.555500+0000", 2024-02-19T21:37:39.575 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.1599999999999998e-06 2024-02-19T21:37:39.575 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.576 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.576 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:37:39.576 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.555504+0000", 2024-02-19T21:37:39.576 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.002212243 2024-02-19T21:37:39.576 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.576 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.576 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:37:39.576 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.557716+0000", 2024-02-19T21:37:39.576 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.5831000000000001e-05 2024-02-19T21:37:39.576 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.577 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.577 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:37:39.577 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.557742+0000", 2024-02-19T21:37:39.577 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.002251322 2024-02-19T21:37:39.577 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:37:39.577 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:37:39.577 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:37:39.577 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.577 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.577 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_repop(client.14793.0:152261 7.9 e135/100 7:92819fa3:::benchmark_data_smithi080_79222_object37527:head v 135'9246, mlcod=135'9242)", 2024-02-19T21:37:39.577 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:37:39.560641+0000", 2024-02-19T21:37:39.577 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.0070802570000000004, 2024-02-19T21:37:39.577 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0072504300000000004, 2024-02-19T21:37:39.577 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:37:39.577 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "started", 2024-02-19T21:37:39.578 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:37:39.578 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.578 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:37:39.578 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.560641+0000", 2024-02-19T21:37:39.578 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:37:39.578 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.578 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.578 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:37:39.578 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.560641+0000", 2024-02-19T21:37:39.578 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:37:39.578 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.578 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.578 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:37:39.579 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.560640+0000", 2024-02-19T21:37:39.579 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.3033e-05 2024-02-19T21:37:39.579 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.579 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.579 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:37:39.579 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.560653+0000", 2024-02-19T21:37:39.579 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.8199e-05 2024-02-19T21:37:39.579 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.579 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.579 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:37:39.579 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.560671+0000", 2024-02-19T21:37:39.579 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.2599999999999999e-06 2024-02-19T21:37:39.579 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.579 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.579 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:37:39.579 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.560679+0000", 2024-02-19T21:37:39.580 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0066691049999999998 2024-02-19T21:37:39.580 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.580 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.580 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:37:39.580 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.567348+0000", 2024-02-19T21:37:39.580 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.3862999999999998e-05 2024-02-19T21:37:39.580 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.580 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.580 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:37:39.580 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.567372+0000", 2024-02-19T21:37:39.580 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0067301820000000004 2024-02-19T21:37:39.580 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:37:39.580 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:37:39.580 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:37:39.580 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.581 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.581 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_repop(client.14793.0:152270 7.4 e135/100 7:2e55158b:::benchmark_data_smithi080_79222_object37536:head v 135'9659, mlcod=135'9656)", 2024-02-19T21:37:39.581 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:37:39.565341+0000", 2024-02-19T21:37:39.581 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.0023804849999999999, 2024-02-19T21:37:39.581 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.002611337, 2024-02-19T21:37:39.581 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:37:39.581 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "started", 2024-02-19T21:37:39.581 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:37:39.581 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.581 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:37:39.581 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.565341+0000", 2024-02-19T21:37:39.581 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:37:39.581 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.581 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.582 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:37:39.582 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.565341+0000", 2024-02-19T21:37:39.582 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:37:39.582 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.582 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.582 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:37:39.582 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.565340+0000", 2024-02-19T21:37:39.582 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2268e-05 2024-02-19T21:37:39.582 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.582 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.582 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:37:39.582 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.565353+0000", 2024-02-19T21:37:39.582 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.014e-05 2024-02-19T21:37:39.582 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.583 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.583 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:37:39.583 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.565373+0000", 2024-02-19T21:37:39.583 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.4179999999999997e-06 2024-02-19T21:37:39.583 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.583 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.583 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:37:39.583 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.565381+0000", 2024-02-19T21:37:39.583 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.4259999999999997e-05 2024-02-19T21:37:39.583 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.583 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.583 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:37:39.583 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.565455+0000", 2024-02-19T21:37:39.584 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.084e-05 2024-02-19T21:37:39.584 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:37:39.584 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:37:39.584 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:37:39.584 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:39.565476+0000", 2024-02-19T21:37:39.584 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000135091 2024-02-19T21:37:39.584 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:37:39.584 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:37:39.584 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:37:39.584 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:37:39.584 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-02-19T21:37:39.584 INFO:teuthology.orchestra.run.smithi157.stdout: "num_ops": 4 2024-02-19T21:37:39.584 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:37:39.585 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:39.586 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:37:39.586 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:37:39.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:38.335498+0000 mon.a (mon.0) 875 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:37:39.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:38.359124+0000 mon.a (mon.0) 876 : audit [INF] from='client.? 172.21.15.80:0/2213366727' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:37:39.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:38.359175+0000 mon.a (mon.0) 877 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2024-02-19T21:37:39.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:38.335498+0000 mon.a (mon.0) 875 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:37:39.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:38.359124+0000 mon.a (mon.0) 876 : audit [INF] from='client.? 172.21.15.80:0/2213366727' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:37:39.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:38.359175+0000 mon.a (mon.0) 877 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2024-02-19T21:37:39.686 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:37:39.729 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:39.810 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:37:39.815 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:39.816 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:37:39.916 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:37:39.920 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:37:39.950 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:39.995 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:37:39.999 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:39.999 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:37:40.100 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:37:40.178 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:40.218 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:37:40.224 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:40.224 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:37:40.311 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:37:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:37:40.325 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:37:40.358 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:40.462 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:37:40.469 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:40.470 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:37:40.477 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.4 dump_blocked_ops 2024-02-19T21:37:40.571 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:37:40.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:38.877585+0000 mgr.y (mgr.14514) 201 : cluster [DBG] pgmap v211: 148 pgs: 148 active+clean; 5.0 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 595 op/s 2024-02-19T21:37:40.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:38.877585+0000 mgr.y (mgr.14514) 201 : cluster [DBG] pgmap v211: 148 pgs: 148 active+clean; 5.0 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 595 op/s 2024-02-19T21:37:40.610 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:38.877585+0000 mgr.y (mgr.14514) 201 : cluster [DBG] pgmap v211: 148 pgs: 148 active+clean; 5.0 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 595 op/s 2024-02-19T21:37:40.612 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:40.637 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:37:40.642 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:40.642 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:37:40.743 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:37:40.805 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:40.859 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:37:41.066 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:37:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:37:40] "GET /metrics HTTP/1.1" 200 175405 "" "Prometheus/2.33.4" 2024-02-19T21:37:41.403 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.6 to 1 (10000) 2024-02-19T21:37:41.475 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:37:41.479 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:41.480 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:37:41.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:40.052024+0000 mgr.y (mgr.14514) 202 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:37:41.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:41.294848+0000 mon.a (mon.0) 878 : audit [INF] from='client.? 172.21.15.80:0/817274094' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-02-19T21:37:41.580 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:37:41.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:40.052024+0000 mgr.y (mgr.14514) 202 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:37:41.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:41.294848+0000 mon.a (mon.0) 878 : audit [INF] from='client.? 172.21.15.80:0/817274094' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-02-19T21:37:41.636 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:40.052024+0000 mgr.y (mgr.14514) 202 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:37:41.636 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:41.294848+0000 mon.a (mon.0) 878 : audit [INF] from='client.? 172.21.15.80:0/817274094' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-02-19T21:37:41.637 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:41.730 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:37:41.734 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:41.734 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:37:41.835 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:37:41.864 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-19T21:37:41.874 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:42.129 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:37:42.136 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:42.137 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:37:42.237 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:37:42.284 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd reweight 7 1 2024-02-19T21:37:42.316 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:42.361 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:37:42.369 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:42.369 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:37:42.470 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:37:42.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:40.878381+0000 mgr.y (mgr.14514) 203 : cluster [DBG] pgmap v212: 148 pgs: 148 active+clean; 4.7 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.18k op/s 2024-02-19T21:37:42.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:41.375189+0000 mon.a (mon.0) 879 : audit [INF] from='client.? 172.21.15.80:0/817274094' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-02-19T21:37:42.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:41.375250+0000 mon.a (mon.0) 880 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2024-02-19T21:37:42.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:40.878381+0000 mgr.y (mgr.14514) 203 : cluster [DBG] pgmap v212: 148 pgs: 148 active+clean; 4.7 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.18k op/s 2024-02-19T21:37:42.513 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:41.375189+0000 mon.a (mon.0) 879 : audit [INF] from='client.? 172.21.15.80:0/817274094' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-02-19T21:37:42.513 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:41.375250+0000 mon.a (mon.0) 880 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2024-02-19T21:37:42.515 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:42.766 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:40.878381+0000 mgr.y (mgr.14514) 203 : cluster [DBG] pgmap v212: 148 pgs: 148 active+clean; 4.7 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.18k op/s 2024-02-19T21:37:42.766 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:41.375189+0000 mon.a (mon.0) 879 : audit [INF] from='client.? 172.21.15.80:0/817274094' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-02-19T21:37:42.766 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:41.375250+0000 mon.a (mon.0) 880 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2024-02-19T21:37:42.968 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:37:42.990 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:37:42.995 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:42.996 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:37:43.097 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:37:43.143 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:43.254 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:37:43.258 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:43.259 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:37:43.360 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:37:43.403 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:37:43.404 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [], 2024-02-19T21:37:43.404 INFO:teuthology.orchestra.run.smithi157.stdout: "complaint_time": 30, 2024-02-19T21:37:43.404 INFO:teuthology.orchestra.run.smithi157.stdout: "num_blocked_ops": 0 2024-02-19T21:37:43.404 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:37:43.434 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:43.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:42.384782+0000 osd.5 (osd.5) 104 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:37:43.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:42.384832+0000 osd.5 (osd.5) 105 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:37:43.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:42.447760+0000 mon.a (mon.0) 881 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2024-02-19T21:37:43.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:42.384782+0000 osd.5 (osd.5) 104 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:37:43.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:42.384832+0000 osd.5 (osd.5) 105 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:37:43.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:42.447760+0000 mon.a (mon.0) 881 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2024-02-19T21:37:43.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:42.384782+0000 osd.5 (osd.5) 104 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:37:43.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:42.384832+0000 osd.5 (osd.5) 105 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:37:43.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:42.447760+0000 mon.a (mon.0) 881 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2024-02-19T21:37:43.864 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:37:43.864 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:37:43.864 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:37:43.864 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:37:43.864 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:37:43.878 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:37:43.890 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:37:43.905 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:37:43.926 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:43.927 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:37:43.930 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:37:43.966 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:37:43.984 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:37:43.984 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:37:43.984 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:37:43.984 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:37:43.984 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:37:43.984 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:37:43.984 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:37:43.984 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:37:44.028 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:37:44.079 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:44.317 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.4 dump_historic_ops 2024-02-19T21:37:44.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:42.878746+0000 mgr.y (mgr.14514) 204 : cluster [DBG] pgmap v215: 148 pgs: 148 active+clean; 4.7 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 782 op/s 2024-02-19T21:37:44.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:43.688311+0000 mon.b (mon.1) 39 : audit [DBG] from='client.? 172.21.15.80:0/1521987528' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:37:44.689 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:37:44.730 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:42.878746+0000 mgr.y (mgr.14514) 204 : cluster [DBG] pgmap v215: 148 pgs: 148 active+clean; 4.7 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 782 op/s 2024-02-19T21:37:44.730 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:43.688311+0000 mon.b (mon.1) 39 : audit [DBG] from='client.? 172.21.15.80:0/1521987528' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:37:44.730 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:42.878746+0000 mgr.y (mgr.14514) 204 : cluster [DBG] pgmap v215: 148 pgs: 148 active+clean; 4.7 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 782 op/s 2024-02-19T21:37:44.731 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:43.688311+0000 mon.b (mon.1) 39 : audit [DBG] from='client.? 172.21.15.80:0/1521987528' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:37:46.057 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:37:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:37:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:37:46.787 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:37:46.787 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:37:46.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:44.881941+0000 mgr.y (mgr.14514) 205 : cluster [DBG] pgmap v216: 148 pgs: 148 active+clean; 4.6 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1.07k op/s 2024-02-19T21:37:46.829 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:44.881941+0000 mgr.y (mgr.14514) 205 : cluster [DBG] pgmap v216: 148 pgs: 148 active+clean; 4.6 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1.07k op/s 2024-02-19T21:37:46.829 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:44.881941+0000 mgr.y (mgr.14514) 205 : cluster [DBG] pgmap v216: 148 pgs: 148 active+clean; 4.6 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1.07k op/s 2024-02-19T21:37:47.376 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:37:47.389 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:47.389 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:37:47.490 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:37:47.535 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:48.199 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:37:48.202 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:48.203 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:37:48.304 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:37:48.356 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:48.497 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:46.882493+0000 mgr.y (mgr.14514) 206 : cluster [DBG] pgmap v217: 148 pgs: 148 active+clean; 4.4 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.16k op/s 2024-02-19T21:37:48.719 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:37:48.723 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:48.724 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:37:48.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:46.882493+0000 mgr.y (mgr.14514) 206 : cluster [DBG] pgmap v217: 148 pgs: 148 active+clean; 4.4 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.16k op/s 2024-02-19T21:37:48.807 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:46.882493+0000 mgr.y (mgr.14514) 206 : cluster [DBG] pgmap v217: 148 pgs: 148 active+clean; 4.4 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.16k op/s 2024-02-19T21:37:48.825 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:37:48.892 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:48.988 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:37:48.993 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:48.993 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:37:49.094 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:37:49.155 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:49.190 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:37:49.193 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:49.194 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:37:49.294 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:37:49.351 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:49.377 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:37:49.394 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:37:49.396 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:49.397 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:37:49.498 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:37:49.534 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:49.806 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:37:49.979 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-02-19T21:37:49.982 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.7 to 1 (10000) 2024-02-19T21:37:50.213 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:48.883254+0000 mgr.y (mgr.14514) 207 : cluster [DBG] pgmap v218: 148 pgs: 148 active+clean; 4.4 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 572 op/s 2024-02-19T21:37:50.213 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:48.937975+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:37:50.213 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:49.046029+0000 mon.a (mon.0) 883 : audit [INF] from='client.? 172.21.15.80:0/3330287886' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:37:50.213 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:49.481525+0000 mon.b (mon.1) 40 : audit [INF] from='client.? 172.21.15.80:0/1763696890' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-02-19T21:37:50.213 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:49.481887+0000 mon.a (mon.0) 884 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-02-19T21:37:50.213 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:48.883254+0000 mgr.y (mgr.14514) 207 : cluster [DBG] pgmap v218: 148 pgs: 148 active+clean; 4.4 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 572 op/s 2024-02-19T21:37:50.213 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:48.937975+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:37:50.213 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:49.046029+0000 mon.a (mon.0) 883 : audit [INF] from='client.? 172.21.15.80:0/3330287886' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:37:50.214 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:49.481525+0000 mon.b (mon.1) 40 : audit [INF] from='client.? 172.21.15.80:0/1763696890' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-02-19T21:37:50.214 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:49.481887+0000 mon.a (mon.0) 884 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-02-19T21:37:50.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:48.883254+0000 mgr.y (mgr.14514) 207 : cluster [DBG] pgmap v218: 148 pgs: 148 active+clean; 4.4 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 572 op/s 2024-02-19T21:37:50.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:48.937975+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:37:50.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:49.046029+0000 mon.a (mon.0) 883 : audit [INF] from='client.? 172.21.15.80:0/3330287886' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:37:50.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:49.481525+0000 mon.b (mon.1) 40 : audit [INF] from='client.? 172.21.15.80:0/1763696890' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-02-19T21:37:50.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:49.481887+0000 mon.a (mon.0) 884 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-02-19T21:37:50.309 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:37:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:37:50.848 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:37:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:37:50] "GET /metrics HTTP/1.1" 200 175416 "" "Prometheus/2.33.4" 2024-02-19T21:37:51.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:49.549665+0000 osd.1 (osd.1) 101 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:37:51.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:49.549713+0000 osd.1 (osd.1) 102 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:37:51.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:49.698583+0000 osd.7 (osd.7) 95 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:37:51.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:49.698638+0000 osd.7 (osd.7) 96 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:37:51.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:49.935742+0000 mon.a (mon.0) 885 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:37:51.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:49.951219+0000 mon.a (mon.0) 886 : audit [INF] from='client.? 172.21.15.80:0/3330287886' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:37:51.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:49.951273+0000 mon.a (mon.0) 887 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-02-19T21:37:51.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:49.951774+0000 mon.a (mon.0) 888 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2024-02-19T21:37:51.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:50.063288+0000 mgr.y (mgr.14514) 208 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:37:51.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:49.549665+0000 osd.1 (osd.1) 101 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:37:51.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:49.549713+0000 osd.1 (osd.1) 102 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:37:51.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:49.698583+0000 osd.7 (osd.7) 95 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:37:51.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:49.698638+0000 osd.7 (osd.7) 96 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:37:51.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:49.935742+0000 mon.a (mon.0) 885 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:37:51.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:49.951219+0000 mon.a (mon.0) 886 : audit [INF] from='client.? 172.21.15.80:0/3330287886' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:37:51.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:49.951273+0000 mon.a (mon.0) 887 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-02-19T21:37:51.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:49.951774+0000 mon.a (mon.0) 888 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2024-02-19T21:37:51.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:50.063288+0000 mgr.y (mgr.14514) 208 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:37:51.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:49.549665+0000 osd.1 (osd.1) 101 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:37:51.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:49.549713+0000 osd.1 (osd.1) 102 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:37:51.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:49.698583+0000 osd.7 (osd.7) 95 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:37:51.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:49.698638+0000 osd.7 (osd.7) 96 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:37:51.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:49.935742+0000 mon.a (mon.0) 885 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:37:51.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:49.951219+0000 mon.a (mon.0) 886 : audit [INF] from='client.? 172.21.15.80:0/3330287886' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:37:51.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:49.951273+0000 mon.a (mon.0) 887 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-02-19T21:37:51.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:49.951774+0000 mon.a (mon.0) 888 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2024-02-19T21:37:51.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:50.063288+0000 mgr.y (mgr.14514) 208 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:37:51.740 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.5 dump_ops_in_flight 2024-02-19T21:37:51.788 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:37:51.792 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:51.793 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:37:51.893 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:37:51.930 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:51.957 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:37:51.963 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:37:51.963 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:37:51.984 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:50.888141+0000 mgr.y (mgr.14514) 209 : cluster [DBG] pgmap v220: 148 pgs: 148 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.11k op/s 2024-02-19T21:37:52.064 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:37:52.127 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:37:52.152 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:37:52.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:50.888141+0000 mgr.y (mgr.14514) 209 : cluster [DBG] pgmap v220: 148 pgs: 148 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.11k op/s 2024-02-19T21:37:52.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:50.888141+0000 mgr.y (mgr.14514) 209 : cluster [DBG] pgmap v220: 148 pgs: 148 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.11k op/s 2024-02-19T21:37:53.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:52.599375+0000 mon.a (mon.0) 889 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:37:53.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:52.599375+0000 mon.a (mon.0) 889 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:37:53.258 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:52.599375+0000 mon.a (mon.0) 889 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:37:53.724 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset noscrub 2024-02-19T21:37:54.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:52.893386+0000 mgr.y (mgr.14514) 210 : cluster [DBG] pgmap v221: 148 pgs: 148 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 932 op/s 2024-02-19T21:37:54.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:53.470446+0000 osd.6 (osd.6) 75 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:37:54.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:53.470499+0000 osd.6 (osd.6) 76 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:37:54.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:52.893386+0000 mgr.y (mgr.14514) 210 : cluster [DBG] pgmap v221: 148 pgs: 148 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 932 op/s 2024-02-19T21:37:54.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:53.470446+0000 osd.6 (osd.6) 75 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:37:54.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:53.470499+0000 osd.6 (osd.6) 76 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:37:54.301 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:37:54.301 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:37:54.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:52.893386+0000 mgr.y (mgr.14514) 210 : cluster [DBG] pgmap v221: 148 pgs: 148 active+clean; 4.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 932 op/s 2024-02-19T21:37:54.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:53.470446+0000 osd.6 (osd.6) 75 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:37:54.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:53.470499+0000 osd.6 (osd.6) 76 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:37:55.042 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:54.031725+0000 mon.a (mon.0) 890 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2024-02-19T21:37:55.206 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.5 dump_blocked_ops 2024-02-19T21:37:55.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:54.031725+0000 mon.a (mon.0) 890 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2024-02-19T21:37:55.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:54.031725+0000 mon.a (mon.0) 890 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2024-02-19T21:37:55.573 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:37:55.883 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:37:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:37:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:37:56.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:54.893931+0000 mgr.y (mgr.14514) 211 : cluster [DBG] pgmap v223: 148 pgs: 148 active+clean; 4.0 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 884 op/s 2024-02-19T21:37:56.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:54.893931+0000 mgr.y (mgr.14514) 211 : cluster [DBG] pgmap v223: 148 pgs: 148 active+clean; 4.0 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 884 op/s 2024-02-19T21:37:56.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:54.893931+0000 mgr.y (mgr.14514) 211 : cluster [DBG] pgmap v223: 148 pgs: 148 active+clean; 4.0 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 884 op/s 2024-02-19T21:37:57.727 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:37:57.728 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:37:58.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:56.894463+0000 mgr.y (mgr.14514) 212 : cluster [DBG] pgmap v224: 148 pgs: 148 active+clean; 3.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.18k op/s 2024-02-19T21:37:58.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:56.894463+0000 mgr.y (mgr.14514) 212 : cluster [DBG] pgmap v224: 148 pgs: 148 active+clean; 3.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.18k op/s 2024-02-19T21:37:58.463 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:56.894463+0000 mgr.y (mgr.14514) 212 : cluster [DBG] pgmap v224: 148 pgs: 148 active+clean; 3.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.18k op/s 2024-02-19T21:37:58.488 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.5 dump_historic_ops 2024-02-19T21:37:58.853 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:37:59.421 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:37:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:37:58.152197+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:37:59.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:37:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:37:58.152197+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:37:59.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:37:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:37:58.152197+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:38:00.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:37:58.894847+0000 mgr.y (mgr.14514) 213 : cluster [DBG] pgmap v225: 148 pgs: 148 active+clean; 3.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 572 B/s rd, 0 B/s wr, 529 op/s 2024-02-19T21:38:00.307 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:38:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:38:00.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:37:58.894847+0000 mgr.y (mgr.14514) 213 : cluster [DBG] pgmap v225: 148 pgs: 148 active+clean; 3.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 572 B/s rd, 0 B/s wr, 529 op/s 2024-02-19T21:38:00.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:37:58.894847+0000 mgr.y (mgr.14514) 213 : cluster [DBG] pgmap v225: 148 pgs: 148 active+clean; 3.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 572 B/s rd, 0 B/s wr, 529 op/s 2024-02-19T21:38:00.931 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:38:00.931 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:38:01.097 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:38:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:38:00] "GET /metrics HTTP/1.1" 200 175416 "" "Prometheus/2.33.4" 2024-02-19T21:38:01.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:00.075282+0000 mgr.y (mgr.14514) 214 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:38:01.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:00.075282+0000 mgr.y (mgr.14514) 214 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:38:01.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:00.075282+0000 mgr.y (mgr.14514) 214 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:38:01.698 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.6 dump_ops_in_flight 2024-02-19T21:38:02.057 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:38:02.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:00.895634+0000 mgr.y (mgr.14514) 215 : cluster [DBG] pgmap v226: 148 pgs: 148 active+clean; 3.5 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 949 op/s 2024-02-19T21:38:02.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:00.895634+0000 mgr.y (mgr.14514) 215 : cluster [DBG] pgmap v226: 148 pgs: 148 active+clean; 3.5 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 949 op/s 2024-02-19T21:38:02.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:00.895634+0000 mgr.y (mgr.14514) 215 : cluster [DBG] pgmap v226: 148 pgs: 148 active+clean; 3.5 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 949 op/s 2024-02-19T21:38:03.345 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:38:03.348 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:03.349 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:38:03.366 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2024-02-19T21:38:03.366 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:38:03.451 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:38:03.510 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:04.057 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:38:04.057 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:38:04.477 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:02.895974+0000 mgr.y (mgr.14514) 216 : cluster [DBG] pgmap v227: 148 pgs: 148 active+clean; 3.5 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 950 op/s 2024-02-19T21:38:04.477 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:03.162020+0000 osd.3 (osd.3) 127 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:38:04.477 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:03.162065+0000 osd.3 (osd.3) 128 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:38:04.477 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:03.219671+0000 mon.a (mon.0) 892 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2024-02-19T21:38:04.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:02.895974+0000 mgr.y (mgr.14514) 216 : cluster [DBG] pgmap v227: 148 pgs: 148 active+clean; 3.5 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 950 op/s 2024-02-19T21:38:04.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:03.162020+0000 osd.3 (osd.3) 127 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:38:04.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:03.162065+0000 osd.3 (osd.3) 128 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:38:04.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:03.219671+0000 mon.a (mon.0) 892 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2024-02-19T21:38:04.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:02.895974+0000 mgr.y (mgr.14514) 216 : cluster [DBG] pgmap v227: 148 pgs: 148 active+clean; 3.5 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 950 op/s 2024-02-19T21:38:04.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:03.162020+0000 osd.3 (osd.3) 127 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:38:04.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:03.162065+0000 osd.3 (osd.3) 128 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:38:04.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:03.219671+0000 mon.a (mon.0) 892 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2024-02-19T21:38:04.823 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:38:04.834 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.6 dump_blocked_ops 2024-02-19T21:38:05.049 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:38:05.109 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:05.110 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:38:05.167 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:38:05.210 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:38:05.269 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:05.701 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:38:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:38:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:38:06.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:04.896637+0000 mgr.y (mgr.14514) 217 : cluster [DBG] pgmap v229: 148 pgs: 148 active+clean; 3.4 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 947 op/s 2024-02-19T21:38:06.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:04.950153+0000 mon.a (mon.0) 893 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:38:06.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:04.955401+0000 mon.a (mon.0) 894 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:38:06.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:05.038326+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:38:06.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:05.884288+0000 osd.0 (osd.0) 111 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:38:06.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:05.884339+0000 osd.0 (osd.0) 112 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:38:06.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:04.896637+0000 mgr.y (mgr.14514) 217 : cluster [DBG] pgmap v229: 148 pgs: 148 active+clean; 3.4 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 947 op/s 2024-02-19T21:38:06.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:04.950153+0000 mon.a (mon.0) 893 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:38:06.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:04.955401+0000 mon.a (mon.0) 894 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:38:06.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:05.038326+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:38:06.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:05.884288+0000 osd.0 (osd.0) 111 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:38:06.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:05.884339+0000 osd.0 (osd.0) 112 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:38:06.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:04.896637+0000 mgr.y (mgr.14514) 217 : cluster [DBG] pgmap v229: 148 pgs: 148 active+clean; 3.4 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 947 op/s 2024-02-19T21:38:06.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:04.950153+0000 mon.a (mon.0) 893 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:38:06.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:04.955401+0000 mon.a (mon.0) 894 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:38:06.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:05.038326+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:38:06.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:05.884288+0000 osd.0 (osd.0) 111 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:38:06.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:05.884339+0000 osd.0 (osd.0) 112 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:38:06.957 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:05.838233+0000 osd.2 (osd.2) 93 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:38:06.957 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:05.838290+0000 osd.2 (osd.2) 94 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:38:06.957 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:06.246314+0000 mon.a (mon.0) 896 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2024-02-19T21:38:07.118 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:38:07.129 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:07.129 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:38:07.230 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:38:07.247 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:38:07.247 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:38:07.252 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:38:07.253 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:38:07.266 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:38:07.270 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:05.838233+0000 osd.2 (osd.2) 93 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:38:07.270 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:05.838290+0000 osd.2 (osd.2) 94 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:38:07.270 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:06.246314+0000 mon.a (mon.0) 896 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2024-02-19T21:38:07.277 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:05.838233+0000 osd.2 (osd.2) 93 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:38:07.278 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:05.838290+0000 osd.2 (osd.2) 94 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:38:07.278 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:06.246314+0000 mon.a (mon.0) 896 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2024-02-19T21:38:07.278 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:07.308 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:38:07.344 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:38:07.371 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:38:07.412 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:38:07.440 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:38:07.456 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:38:07.456 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:38:07.456 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:38:07.456 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:38:07.456 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:38:07.456 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:38:07.456 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:38:07.456 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:38:08.027 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.6 dump_historic_ops 2024-02-19T21:38:08.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:06.898797+0000 mgr.y (mgr.14514) 218 : cluster [DBG] pgmap v231: 148 pgs: 148 active+clean; 3.3 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.17k op/s 2024-02-19T21:38:08.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:07.105474+0000 mon.c (mon.2) 32 : audit [DBG] from='client.? 172.21.15.80:0/1538314604' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:38:08.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:06.898797+0000 mgr.y (mgr.14514) 218 : cluster [DBG] pgmap v231: 148 pgs: 148 active+clean; 3.3 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.17k op/s 2024-02-19T21:38:08.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:07.105474+0000 mon.c (mon.2) 32 : audit [DBG] from='client.? 172.21.15.80:0/1538314604' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:38:08.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:06.898797+0000 mgr.y (mgr.14514) 218 : cluster [DBG] pgmap v231: 148 pgs: 148 active+clean; 3.3 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.17k op/s 2024-02-19T21:38:08.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:07.105474+0000 mon.c (mon.2) 32 : audit [DBG] from='client.? 172.21.15.80:0/1538314604' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:38:08.402 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:38:09.161 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:38:09.174 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:09.175 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:38:09.276 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:38:09.361 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:09.964 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:38:10.028 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-02-19T21:38:10.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:08.899182+0000 mgr.y (mgr.14514) 219 : cluster [DBG] pgmap v232: 148 pgs: 148 active+clean; 3.3 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 577 op/s 2024-02-19T21:38:10.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:09.719681+0000 mon.b (mon.1) 41 : audit [INF] from='client.? 172.21.15.80:0/1595691610' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:38:10.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:09.720027+0000 mon.a (mon.0) 897 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:38:10.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:08.899182+0000 mgr.y (mgr.14514) 219 : cluster [DBG] pgmap v232: 148 pgs: 148 active+clean; 3.3 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 577 op/s 2024-02-19T21:38:10.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:09.719681+0000 mon.b (mon.1) 41 : audit [INF] from='client.? 172.21.15.80:0/1595691610' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:38:10.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:09.720027+0000 mon.a (mon.0) 897 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:38:10.190 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:08.899182+0000 mgr.y (mgr.14514) 219 : cluster [DBG] pgmap v232: 148 pgs: 148 active+clean; 3.3 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 577 op/s 2024-02-19T21:38:10.190 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:09.719681+0000 mon.b (mon.1) 41 : audit [INF] from='client.? 172.21.15.80:0/1595691610' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:38:10.190 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:09.720027+0000 mon.a (mon.0) 897 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:38:10.191 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:38:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:38:10.544 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:38:10.545 INFO:teuthology.orchestra.run.smithi157.stdout: "size": 20, 2024-02-19T21:38:10.545 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 600, 2024-02-19T21:38:10.545 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [ 2024-02-19T21:38:10.545 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.545 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:28357 7.7 7:e6d67b87:::benchmark_data_smithi080_79222_object28356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-19T21:38:10.545 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:35:41.010840+0000", 2024-02-19T21:38:10.545 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 149.53026836000001, 2024-02-19T21:38:10.545 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.068041013999999997, 2024-02-19T21:38:10.545 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:38:10.545 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:38:10.545 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:38:10.546 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:38:10.546 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:38:10.546 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 28357 2024-02-19T21:38:10.546 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.546 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:38:10.546 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.546 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:38:10.546 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.010840+0000", 2024-02-19T21:38:10.546 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:38:10.546 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.546 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.546 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:38:10.546 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.010840+0000", 2024-02-19T21:38:10.546 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:38:10.546 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.547 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.547 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:38:10.547 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.010838+0000", 2024-02-19T21:38:10.547 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.5791999999999997e-05 2024-02-19T21:38:10.547 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.547 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.547 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:38:10.547 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.010894+0000", 2024-02-19T21:38:10.547 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.4384e-05 2024-02-19T21:38:10.547 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.547 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.547 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:38:10.547 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.010908+0000", 2024-02-19T21:38:10.547 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.6919999999999996e-06 2024-02-19T21:38:10.548 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.548 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.548 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:38:10.548 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.010915+0000", 2024-02-19T21:38:10.548 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.7446e-05 2024-02-19T21:38:10.548 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.548 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.548 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:38:10.548 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.010952+0000", 2024-02-19T21:38:10.548 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.0644999999999997e-05 2024-02-19T21:38:10.548 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.548 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.549 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:38:10.549 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.011043+0000", 2024-02-19T21:38:10.549 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000111668 2024-02-19T21:38:10.549 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.549 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.549 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,3", 2024-02-19T21:38:10.549 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.011154+0000", 2024-02-19T21:38:10.549 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00092018500000000001 2024-02-19T21:38:10.549 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.549 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.549 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:38:10.549 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.012075+0000", 2024-02-19T21:38:10.550 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0012892380000000001 2024-02-19T21:38:10.550 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.550 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.550 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.550 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.013364+0000", 2024-02-19T21:38:10.550 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.065416222999999996 2024-02-19T21:38:10.550 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.550 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.550 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.550 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.078780+0000", 2024-02-19T21:38:10.550 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.2887999999999999e-05 2024-02-19T21:38:10.550 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.550 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.550 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:38:10.550 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.078833+0000", 2024-02-19T21:38:10.551 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.7905999999999998e-05 2024-02-19T21:38:10.551 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.551 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.551 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:38:10.551 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.078881+0000", 2024-02-19T21:38:10.551 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.068041013999999997 2024-02-19T21:38:10.551 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.551 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:38:10.551 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.551 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.551 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.551 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:28362 7.c 7:3e6f3adb:::benchmark_data_smithi080_79222_object28361:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-19T21:38:10.551 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:35:41.013911+0000", 2024-02-19T21:38:10.551 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 149.527197409, 2024-02-19T21:38:10.552 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.063390648999999993, 2024-02-19T21:38:10.552 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:38:10.552 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:38:10.552 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:38:10.552 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:38:10.552 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:38:10.552 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 28362 2024-02-19T21:38:10.552 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.552 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:38:10.552 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.552 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:38:10.552 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.013911+0000", 2024-02-19T21:38:10.552 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:38:10.552 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.553 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.553 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:38:10.553 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.013911+0000", 2024-02-19T21:38:10.553 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:38:10.553 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.553 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.553 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:38:10.553 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.013910+0000", 2024-02-19T21:38:10.553 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.6108999999999999e-05 2024-02-19T21:38:10.553 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.554 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.554 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:38:10.554 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.013986+0000", 2024-02-19T21:38:10.554 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.3370000000000001e-05 2024-02-19T21:38:10.554 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.554 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.554 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:38:10.554 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.013999+0000", 2024-02-19T21:38:10.554 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.9590000000000003e-06 2024-02-19T21:38:10.554 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.554 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.554 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:38:10.554 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.014004+0000", 2024-02-19T21:38:10.554 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.7834000000000002e-05 2024-02-19T21:38:10.554 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.555 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.555 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:38:10.555 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.014032+0000", 2024-02-19T21:38:10.555 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.3635999999999997e-05 2024-02-19T21:38:10.555 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.555 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.555 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:38:10.555 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.014116+0000", 2024-02-19T21:38:10.555 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000101691 2024-02-19T21:38:10.555 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.555 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.555 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:38:10.555 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.014218+0000", 2024-02-19T21:38:10.555 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.001016819 2024-02-19T21:38:10.556 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.556 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.556 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:38:10.556 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.015234+0000", 2024-02-19T21:38:10.556 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0014839079999999999 2024-02-19T21:38:10.556 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.556 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.556 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.556 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.016718+0000", 2024-02-19T21:38:10.556 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.060505524999999998 2024-02-19T21:38:10.556 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.556 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.556 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.556 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.077224+0000", 2024-02-19T21:38:10.557 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.9257e-05 2024-02-19T21:38:10.557 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.557 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.557 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:38:10.557 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.077263+0000", 2024-02-19T21:38:10.557 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.8290000000000001e-05 2024-02-19T21:38:10.557 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.557 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.557 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:38:10.557 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.077301+0000", 2024-02-19T21:38:10.557 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.063390648999999993 2024-02-19T21:38:10.557 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.557 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:38:10.557 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.557 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.558 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.558 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:28364 7.c 7:327efdff:::benchmark_data_smithi080_79222_object28363:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-19T21:38:10.558 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:35:41.015405+0000", 2024-02-19T21:38:10.558 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 149.525703574, 2024-02-19T21:38:10.558 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.061996903999999999, 2024-02-19T21:38:10.558 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:38:10.558 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:38:10.558 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:38:10.558 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:38:10.558 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:38:10.558 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 28364 2024-02-19T21:38:10.558 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.558 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:38:10.559 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.559 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:38:10.559 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.015405+0000", 2024-02-19T21:38:10.559 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:38:10.559 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.559 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.559 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:38:10.559 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.015405+0000", 2024-02-19T21:38:10.559 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:38:10.559 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.559 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.559 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:38:10.559 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.015403+0000", 2024-02-19T21:38:10.559 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.8163000000000005e-05 2024-02-19T21:38:10.559 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.560 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.560 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:38:10.560 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.015472+0000", 2024-02-19T21:38:10.560 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0581000000000001e-05 2024-02-19T21:38:10.560 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.560 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.560 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:38:10.560 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.015482+0000", 2024-02-19T21:38:10.560 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.8099999999999997e-06 2024-02-19T21:38:10.560 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.560 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.560 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:38:10.560 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.015487+0000", 2024-02-19T21:38:10.560 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.7197000000000003e-05 2024-02-19T21:38:10.561 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.561 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.561 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:38:10.561 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.015524+0000", 2024-02-19T21:38:10.561 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000127188 2024-02-19T21:38:10.561 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.561 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.561 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:38:10.561 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.015651+0000", 2024-02-19T21:38:10.562 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000109534 2024-02-19T21:38:10.562 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.562 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.562 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:38:10.562 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.015761+0000", 2024-02-19T21:38:10.562 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.001143998 2024-02-19T21:38:10.562 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.562 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.562 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:38:10.562 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.016905+0000", 2024-02-19T21:38:10.562 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00032542299999999998 2024-02-19T21:38:10.562 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.563 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.563 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.563 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.017230+0000", 2024-02-19T21:38:10.563 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.060102845000000002 2024-02-19T21:38:10.563 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.563 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.563 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.563 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.077333+0000", 2024-02-19T21:38:10.563 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.3385e-05 2024-02-19T21:38:10.563 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.563 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.563 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:38:10.563 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.077367+0000", 2024-02-19T21:38:10.563 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.4972999999999999e-05 2024-02-19T21:38:10.564 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.564 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.564 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:38:10.564 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.077401+0000", 2024-02-19T21:38:10.564 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.061996903999999999 2024-02-19T21:38:10.564 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.564 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:38:10.564 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.564 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.564 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.564 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:28366 7.7 7:ee863d9d:::benchmark_data_smithi080_79222_object28365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e107)", 2024-02-19T21:38:10.564 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:35:41.015495+0000", 2024-02-19T21:38:10.564 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 149.52561280500001, 2024-02-19T21:38:10.564 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.066429589999999997, 2024-02-19T21:38:10.565 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:38:10.565 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:38:10.565 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:38:10.565 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:38:10.565 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:38:10.565 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 28366 2024-02-19T21:38:10.565 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.565 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:38:10.565 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.565 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:38:10.566 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.015495+0000", 2024-02-19T21:38:10.566 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:38:10.566 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.566 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.566 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:38:10.566 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.015495+0000", 2024-02-19T21:38:10.566 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:38:10.566 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.566 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.566 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:38:10.566 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.015495+0000", 2024-02-19T21:38:10.566 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.7567999999999998e-05 2024-02-19T21:38:10.566 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.566 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.567 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:38:10.567 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.015592+0000", 2024-02-19T21:38:10.567 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.3490000000000003e-06 2024-02-19T21:38:10.567 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.567 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.567 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:38:10.567 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.015600+0000", 2024-02-19T21:38:10.567 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.6129999999999997e-06 2024-02-19T21:38:10.567 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.567 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.567 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:38:10.568 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.015604+0000", 2024-02-19T21:38:10.568 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.6205999999999999e-05 2024-02-19T21:38:10.568 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.568 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.568 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:38:10.568 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.015640+0000", 2024-02-19T21:38:10.568 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00010624399999999999 2024-02-19T21:38:10.568 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.568 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.568 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:38:10.568 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.015747+0000", 2024-02-19T21:38:10.568 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000107738 2024-02-19T21:38:10.568 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.568 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.569 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,3", 2024-02-19T21:38:10.569 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.015854+0000", 2024-02-19T21:38:10.569 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.001051031 2024-02-19T21:38:10.569 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.569 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.569 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:38:10.569 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.016905+0000", 2024-02-19T21:38:10.570 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.060634081999999999 2024-02-19T21:38:10.570 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.570 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.570 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.570 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.077539+0000", 2024-02-19T21:38:10.570 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0042906799999999998 2024-02-19T21:38:10.570 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.570 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.570 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.570 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.081830+0000", 2024-02-19T21:38:10.570 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.4256999999999999e-05 2024-02-19T21:38:10.571 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.571 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.571 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:38:10.571 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.081884+0000", 2024-02-19T21:38:10.571 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0571000000000002e-05 2024-02-19T21:38:10.571 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.571 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.571 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:38:10.571 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:41.081925+0000", 2024-02-19T21:38:10.571 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.066429589999999997 2024-02-19T21:38:10.571 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.571 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:38:10.571 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.571 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.571 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.572 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:61022 7.d 7:b70c9d23:::benchmark_data_smithi080_79222_object61021:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e113)", 2024-02-19T21:38:10.572 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:36:04.088118+0000", 2024-02-19T21:38:10.572 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 126.452989937, 2024-02-19T21:38:10.572 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.053425821999999998, 2024-02-19T21:38:10.572 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:38:10.572 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:38:10.572 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:38:10.572 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:38:10.572 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:38:10.572 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 61022 2024-02-19T21:38:10.572 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.572 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:38:10.572 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.572 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:38:10.572 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:04.088118+0000", 2024-02-19T21:38:10.573 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:38:10.573 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.573 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.573 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:38:10.573 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:04.088118+0000", 2024-02-19T21:38:10.573 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:38:10.573 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.573 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.573 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:38:10.573 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:04.088118+0000", 2024-02-19T21:38:10.573 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.4735999999999998e-05 2024-02-19T21:38:10.574 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.574 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.574 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:38:10.574 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:04.088183+0000", 2024-02-19T21:38:10.574 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0652000000000001e-05 2024-02-19T21:38:10.574 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.574 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.574 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:38:10.574 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:04.088193+0000", 2024-02-19T21:38:10.574 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.891e-06 2024-02-19T21:38:10.574 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.574 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.574 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:38:10.574 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:04.088199+0000", 2024-02-19T21:38:10.575 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0020894429999999999 2024-02-19T21:38:10.575 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.575 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.575 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:38:10.575 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:04.090289+0000", 2024-02-19T21:38:10.575 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013206099999999999 2024-02-19T21:38:10.575 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.575 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.575 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:38:10.575 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:04.090421+0000", 2024-02-19T21:38:10.575 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000120214 2024-02-19T21:38:10.575 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.575 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.575 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:38:10.575 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:04.090541+0000", 2024-02-19T21:38:10.576 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0014204899999999999 2024-02-19T21:38:10.576 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.576 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.576 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:38:10.576 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:04.091961+0000", 2024-02-19T21:38:10.576 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.047216958000000003 2024-02-19T21:38:10.576 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.576 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.576 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.577 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:04.139178+0000", 2024-02-19T21:38:10.577 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0022583339999999999 2024-02-19T21:38:10.577 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.577 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.577 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.577 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:04.141437+0000", 2024-02-19T21:38:10.577 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.7637999999999999e-05 2024-02-19T21:38:10.577 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.577 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.577 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:38:10.577 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:04.141494+0000", 2024-02-19T21:38:10.577 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.9836999999999997e-05 2024-02-19T21:38:10.577 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.577 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.577 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:38:10.578 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:04.141544+0000", 2024-02-19T21:38:10.578 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.053425821999999998 2024-02-19T21:38:10.578 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.578 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:38:10.578 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.578 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.578 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.578 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:61971 7.d 7:b6adc246:::benchmark_data_smithi080_79222_object61970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e113)", 2024-02-19T21:38:10.578 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:36:04.889854+0000", 2024-02-19T21:38:10.578 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 125.651254235, 2024-02-19T21:38:10.578 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.055068048000000001, 2024-02-19T21:38:10.578 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:38:10.579 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:38:10.579 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:38:10.579 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:38:10.579 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:38:10.579 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 61971 2024-02-19T21:38:10.579 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.579 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:38:10.579 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.579 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:38:10.579 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:04.889854+0000", 2024-02-19T21:38:10.579 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:38:10.579 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.579 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.579 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:38:10.580 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:04.889854+0000", 2024-02-19T21:38:10.580 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999976 2024-02-19T21:38:10.580 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.580 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.580 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:38:10.580 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:04.889852+0000", 2024-02-19T21:38:10.580 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.9107000000000001e-05 2024-02-19T21:38:10.580 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.580 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.580 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:38:10.580 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:04.889881+0000", 2024-02-19T21:38:10.580 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.8272000000000001e-05 2024-02-19T21:38:10.580 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.580 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.581 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:38:10.581 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:04.889899+0000", 2024-02-19T21:38:10.581 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.1359999999999999e-06 2024-02-19T21:38:10.581 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.581 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.581 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:38:10.581 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:04.889906+0000", 2024-02-19T21:38:10.581 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.1631000000000001e-05 2024-02-19T21:38:10.581 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.581 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.581 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:38:10.581 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:04.889958+0000", 2024-02-19T21:38:10.582 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00015144799999999999 2024-02-19T21:38:10.582 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.582 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.582 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:38:10.582 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:04.890109+0000", 2024-02-19T21:38:10.582 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00017411600000000001 2024-02-19T21:38:10.582 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.582 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.582 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:38:10.582 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:04.890283+0000", 2024-02-19T21:38:10.582 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0019159369999999999 2024-02-19T21:38:10.582 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.582 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.582 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:38:10.583 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:04.892199+0000", 2024-02-19T21:38:10.583 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0037994040000000001 2024-02-19T21:38:10.583 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.583 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.583 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.583 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:04.895999+0000", 2024-02-19T21:38:10.583 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.048854521999999997 2024-02-19T21:38:10.583 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.583 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.583 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.583 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:04.944853+0000", 2024-02-19T21:38:10.583 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.3705999999999998e-05 2024-02-19T21:38:10.583 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.583 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.583 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:38:10.583 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:04.944897+0000", 2024-02-19T21:38:10.584 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.5006000000000001e-05 2024-02-19T21:38:10.584 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.584 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.584 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:38:10.585 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:04.944922+0000", 2024-02-19T21:38:10.585 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.055068048000000001 2024-02-19T21:38:10.585 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.585 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:38:10.585 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.585 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.585 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.585 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:62930 7.d 7:b50c8f18:::benchmark_data_smithi080_79222_object62929:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e113)", 2024-02-19T21:38:10.585 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:36:05.696004+0000", 2024-02-19T21:38:10.585 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 124.84510435599999, 2024-02-19T21:38:10.585 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.062978080000000006, 2024-02-19T21:38:10.585 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:38:10.585 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:38:10.586 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:38:10.586 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:38:10.586 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:38:10.586 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 62930 2024-02-19T21:38:10.586 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.586 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:38:10.586 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.586 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:38:10.586 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:05.696004+0000", 2024-02-19T21:38:10.586 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:38:10.586 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.586 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.586 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:38:10.586 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:05.696004+0000", 2024-02-19T21:38:10.587 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:38:10.587 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.587 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.587 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:38:10.587 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:05.696002+0000", 2024-02-19T21:38:10.587 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.8356999999999997e-05 2024-02-19T21:38:10.587 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.587 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.587 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:38:10.587 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:05.696061+0000", 2024-02-19T21:38:10.587 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2249000000000001e-05 2024-02-19T21:38:10.587 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.587 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.587 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:38:10.587 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:05.696073+0000", 2024-02-19T21:38:10.588 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.9780000000000002e-06 2024-02-19T21:38:10.588 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.588 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.588 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:38:10.588 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:05.696079+0000", 2024-02-19T21:38:10.588 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.1862e-05 2024-02-19T21:38:10.588 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.588 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.588 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:38:10.588 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:05.696121+0000", 2024-02-19T21:38:10.588 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013197600000000001 2024-02-19T21:38:10.588 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.588 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.589 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:38:10.589 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:05.696253+0000", 2024-02-19T21:38:10.589 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00016111000000000001 2024-02-19T21:38:10.589 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.589 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.589 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:38:10.589 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:05.696414+0000", 2024-02-19T21:38:10.589 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.001775467 2024-02-19T21:38:10.590 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.590 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.590 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:38:10.590 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:05.698189+0000", 2024-02-19T21:38:10.590 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0031097310000000001 2024-02-19T21:38:10.590 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.590 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.590 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.590 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:05.701299+0000", 2024-02-19T21:38:10.591 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.057624693999999997 2024-02-19T21:38:10.591 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.591 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.591 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.591 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:05.758924+0000", 2024-02-19T21:38:10.591 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.3127000000000003e-05 2024-02-19T21:38:10.591 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.591 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.591 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:38:10.591 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:05.758957+0000", 2024-02-19T21:38:10.591 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.4882e-05 2024-02-19T21:38:10.592 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.592 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.592 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:38:10.592 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:05.758982+0000", 2024-02-19T21:38:10.592 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.062978080000000006 2024-02-19T21:38:10.592 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.592 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:38:10.592 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.592 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.592 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.592 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:62937 7.c 7:34b83ff0:::benchmark_data_smithi080_79222_object62936:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e113)", 2024-02-19T21:38:10.592 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:36:05.696724+0000", 2024-02-19T21:38:10.592 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 124.84438439500001, 2024-02-19T21:38:10.593 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.062047278999999997, 2024-02-19T21:38:10.593 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:38:10.593 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:38:10.593 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:38:10.593 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:38:10.593 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:38:10.593 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 62937 2024-02-19T21:38:10.593 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.593 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:38:10.593 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.593 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:38:10.593 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:05.696724+0000", 2024-02-19T21:38:10.593 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:38:10.593 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.594 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.594 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:38:10.594 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:05.696724+0000", 2024-02-19T21:38:10.594 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:38:10.594 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.594 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.594 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:38:10.594 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:05.696723+0000", 2024-02-19T21:38:10.594 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.1542999999999998e-05 2024-02-19T21:38:10.594 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.594 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.595 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:38:10.595 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:05.696774+0000", 2024-02-19T21:38:10.595 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1088e-05 2024-02-19T21:38:10.595 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.595 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.595 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:38:10.595 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:05.696785+0000", 2024-02-19T21:38:10.595 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.1420000000000001e-06 2024-02-19T21:38:10.595 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.595 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.595 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:38:10.595 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:05.696791+0000", 2024-02-19T21:38:10.596 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.8905000000000001e-05 2024-02-19T21:38:10.596 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.596 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.596 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:38:10.596 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:05.696829+0000", 2024-02-19T21:38:10.596 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.3721999999999996e-05 2024-02-19T21:38:10.596 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.596 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.596 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:38:10.596 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:05.696913+0000", 2024-02-19T21:38:10.596 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000117395 2024-02-19T21:38:10.596 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.596 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.597 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:38:10.597 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:05.697031+0000", 2024-02-19T21:38:10.597 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0021060480000000001 2024-02-19T21:38:10.597 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.597 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.597 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:38:10.597 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:05.699137+0000", 2024-02-19T21:38:10.597 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.001476443 2024-02-19T21:38:10.597 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.597 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.597 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.597 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:05.700613+0000", 2024-02-19T21:38:10.597 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.058087976999999999 2024-02-19T21:38:10.598 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.598 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.598 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.598 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:05.758701+0000", 2024-02-19T21:38:10.598 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.1780000000000003e-05 2024-02-19T21:38:10.598 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.598 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.598 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:38:10.598 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:05.758743+0000", 2024-02-19T21:38:10.598 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.8257000000000001e-05 2024-02-19T21:38:10.598 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.598 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.598 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:38:10.598 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:36:05.758771+0000", 2024-02-19T21:38:10.598 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.062047278999999997 2024-02-19T21:38:10.599 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.599 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:38:10.599 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.599 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.599 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.599 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:146355 7.c 7:383cb75f:::benchmark_data_smithi080_79222_object31621:head [delete] snapc 0=[] ondisk+write+known_if_redirected e133)", 2024-02-19T21:38:10.599 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:37:33.285804+0000", 2024-02-19T21:38:10.599 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 37.255304127000002, 2024-02-19T21:38:10.599 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.049483122999999997, 2024-02-19T21:38:10.599 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:38:10.599 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:38:10.599 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:38:10.599 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:38:10.599 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:38:10.600 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 146355 2024-02-19T21:38:10.600 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.600 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:38:10.600 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.600 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:38:10.600 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.285804+0000", 2024-02-19T21:38:10.600 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:38:10.600 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.600 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.600 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:38:10.600 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.285804+0000", 2024-02-19T21:38:10.600 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:38:10.601 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.601 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.601 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:38:10.601 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.285803+0000", 2024-02-19T21:38:10.601 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.9050000000000002e-06 2024-02-19T21:38:10.601 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.601 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.601 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:38:10.601 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.285809+0000", 2024-02-19T21:38:10.601 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1094000000000001e-05 2024-02-19T21:38:10.601 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.601 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.601 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:38:10.601 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.285820+0000", 2024-02-19T21:38:10.602 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.8599999999999993e-06 2024-02-19T21:38:10.602 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.602 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.602 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:38:10.602 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.285828+0000", 2024-02-19T21:38:10.602 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.9131000000000002e-05 2024-02-19T21:38:10.602 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.602 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.602 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:38:10.602 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.285867+0000", 2024-02-19T21:38:10.602 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.1135000000000002e-05 2024-02-19T21:38:10.602 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.602 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.602 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:38:10.602 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.285948+0000", 2024-02-19T21:38:10.603 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000105251 2024-02-19T21:38:10.603 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.603 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.603 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:38:10.603 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.286053+0000", 2024-02-19T21:38:10.603 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0033847090000000001 2024-02-19T21:38:10.603 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.603 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.603 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.603 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.289438+0000", 2024-02-19T21:38:10.603 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0018895699999999999 2024-02-19T21:38:10.603 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.603 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.603 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:38:10.604 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.291327+0000", 2024-02-19T21:38:10.604 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.043853481 2024-02-19T21:38:10.604 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.604 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.604 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.604 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.335181+0000", 2024-02-19T21:38:10.604 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0847999999999998e-05 2024-02-19T21:38:10.604 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.604 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.604 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:38:10.604 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.335232+0000", 2024-02-19T21:38:10.604 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.5355000000000001e-05 2024-02-19T21:38:10.604 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.605 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.605 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:38:10.605 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.335287+0000", 2024-02-19T21:38:10.605 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.049483122999999997 2024-02-19T21:38:10.605 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.605 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:38:10.605 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.605 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.605 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.605 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:146372 7.c 7:32bad8fa:::benchmark_data_smithi080_79222_object31638:head [delete] snapc 0=[] ondisk+write+known_if_redirected e133)", 2024-02-19T21:38:10.605 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:37:33.297529+0000", 2024-02-19T21:38:10.605 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 37.243579058999998, 2024-02-19T21:38:10.605 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.047515792000000001, 2024-02-19T21:38:10.605 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:38:10.606 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:38:10.606 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:38:10.606 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:38:10.606 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:38:10.606 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 146372 2024-02-19T21:38:10.606 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.606 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:38:10.606 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.606 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:38:10.606 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.297529+0000", 2024-02-19T21:38:10.606 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:38:10.606 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.606 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.607 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:38:10.607 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.297529+0000", 2024-02-19T21:38:10.607 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:38:10.607 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.607 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.607 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:38:10.607 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.297528+0000", 2024-02-19T21:38:10.607 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.1410000000000005e-06 2024-02-19T21:38:10.607 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.607 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.607 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:38:10.607 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.297536+0000", 2024-02-19T21:38:10.607 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2680999999999999e-05 2024-02-19T21:38:10.607 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.607 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.607 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:38:10.608 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.297549+0000", 2024-02-19T21:38:10.608 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0200000000000002e-06 2024-02-19T21:38:10.608 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.608 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.608 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:38:10.608 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.297554+0000", 2024-02-19T21:38:10.608 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.9100000000000002e-05 2024-02-19T21:38:10.608 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.608 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.608 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:38:10.608 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.297593+0000", 2024-02-19T21:38:10.608 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.6755000000000005e-05 2024-02-19T21:38:10.608 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.608 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.609 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:38:10.610 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.297689+0000", 2024-02-19T21:38:10.610 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000100876 2024-02-19T21:38:10.610 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.610 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.610 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:38:10.610 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.297790+0000", 2024-02-19T21:38:10.610 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0024536829999999999 2024-02-19T21:38:10.610 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.610 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.610 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:38:10.610 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.300244+0000", 2024-02-19T21:38:10.610 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00010224499999999999 2024-02-19T21:38:10.610 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.611 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.611 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.611 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.300346+0000", 2024-02-19T21:38:10.611 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.044618625000000002 2024-02-19T21:38:10.611 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.611 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.611 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.611 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.344965+0000", 2024-02-19T21:38:10.611 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.5417999999999998e-05 2024-02-19T21:38:10.612 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.612 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.612 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:38:10.612 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.345010+0000", 2024-02-19T21:38:10.612 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.4672000000000003e-05 2024-02-19T21:38:10.612 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.613 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.613 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:38:10.613 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.345045+0000", 2024-02-19T21:38:10.613 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.047515792000000001 2024-02-19T21:38:10.613 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.613 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:38:10.613 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.613 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.613 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.613 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:146646 7.c 7:3b25307f:::benchmark_data_smithi080_79222_object31912:head [delete] snapc 0=[] ondisk+write+known_if_redirected e133)", 2024-02-19T21:38:10.613 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:37:33.596284+0000", 2024-02-19T21:38:10.613 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 36.944824193999999, 2024-02-19T21:38:10.613 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.084397300999999994, 2024-02-19T21:38:10.613 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:38:10.614 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:38:10.614 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:38:10.614 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:38:10.614 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:38:10.615 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 146646 2024-02-19T21:38:10.615 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.615 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:38:10.615 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.615 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:38:10.615 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596284+0000", 2024-02-19T21:38:10.615 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:38:10.615 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.615 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.615 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:38:10.615 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596284+0000", 2024-02-19T21:38:10.615 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:38:10.616 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.616 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.616 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:38:10.616 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596283+0000", 2024-02-19T21:38:10.616 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.2260000000000001e-06 2024-02-19T21:38:10.616 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.616 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.616 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:38:10.616 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596287+0000", 2024-02-19T21:38:10.616 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.1700000000000002e-06 2024-02-19T21:38:10.616 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.616 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.616 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:38:10.617 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596293+0000", 2024-02-19T21:38:10.617 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.7910000000000002e-06 2024-02-19T21:38:10.617 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.617 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.617 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:38:10.617 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596297+0000", 2024-02-19T21:38:10.617 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.9220000000000005e-05 2024-02-19T21:38:10.617 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.617 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.617 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:38:10.617 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596366+0000", 2024-02-19T21:38:10.617 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000104897 2024-02-19T21:38:10.618 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.618 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.618 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:38:10.618 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596471+0000", 2024-02-19T21:38:10.618 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000122182 2024-02-19T21:38:10.618 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.618 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.618 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:38:10.618 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596593+0000", 2024-02-19T21:38:10.618 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.002585324 2024-02-19T21:38:10.618 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.618 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.618 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:38:10.618 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599178+0000", 2024-02-19T21:38:10.619 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0085386769999999997 2024-02-19T21:38:10.619 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.619 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.619 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.619 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.607717+0000", 2024-02-19T21:38:10.619 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.072893174000000005 2024-02-19T21:38:10.619 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.619 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.619 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.619 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.680610+0000", 2024-02-19T21:38:10.619 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.6788000000000001e-05 2024-02-19T21:38:10.619 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.619 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.619 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:38:10.620 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.680647+0000", 2024-02-19T21:38:10.620 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.4368e-05 2024-02-19T21:38:10.620 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.620 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.620 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:38:10.620 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.680681+0000", 2024-02-19T21:38:10.620 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.084397300999999994 2024-02-19T21:38:10.620 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.620 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:38:10.620 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.620 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.620 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.620 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:146652 7.c 7:3c2dcaab:::benchmark_data_smithi080_79222_object31918:head [delete] snapc 0=[] ondisk+write+known_if_redirected e133)", 2024-02-19T21:38:10.620 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:37:33.599542+0000", 2024-02-19T21:38:10.621 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 36.941566037999998, 2024-02-19T21:38:10.621 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.081263583, 2024-02-19T21:38:10.621 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:38:10.621 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:38:10.621 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:38:10.621 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:38:10.621 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:38:10.621 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 146652 2024-02-19T21:38:10.621 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.621 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:38:10.621 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.621 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:38:10.621 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599542+0000", 2024-02-19T21:38:10.622 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:38:10.622 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.622 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.622 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:38:10.622 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599542+0000", 2024-02-19T21:38:10.622 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:38:10.622 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.622 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.622 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:38:10.622 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599541+0000", 2024-02-19T21:38:10.622 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.0570000000000004e-06 2024-02-19T21:38:10.622 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.622 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.622 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:38:10.623 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599548+0000", 2024-02-19T21:38:10.623 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1291000000000001e-05 2024-02-19T21:38:10.623 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.623 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.623 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:38:10.623 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599559+0000", 2024-02-19T21:38:10.623 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.7070000000000003e-06 2024-02-19T21:38:10.623 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.623 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.623 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:38:10.623 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599566+0000", 2024-02-19T21:38:10.623 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.6984999999999998e-05 2024-02-19T21:38:10.623 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.623 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.624 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:38:10.624 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599613+0000", 2024-02-19T21:38:10.624 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.5153000000000004e-05 2024-02-19T21:38:10.624 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.624 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.624 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:38:10.624 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599688+0000", 2024-02-19T21:38:10.624 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.4678000000000006e-05 2024-02-19T21:38:10.624 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.625 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.625 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:38:10.625 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599763+0000", 2024-02-19T21:38:10.625 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0026663949999999998 2024-02-19T21:38:10.625 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.625 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.625 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:38:10.625 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.602429+0000", 2024-02-19T21:38:10.625 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0078935600000000009 2024-02-19T21:38:10.625 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.625 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.625 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.625 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.610323+0000", 2024-02-19T21:38:10.625 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.070400874000000002 2024-02-19T21:38:10.626 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.626 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.626 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.626 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.680724+0000", 2024-02-19T21:38:10.626 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.1516000000000001e-05 2024-02-19T21:38:10.626 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.626 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.626 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:38:10.626 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.680755+0000", 2024-02-19T21:38:10.626 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0662999999999999e-05 2024-02-19T21:38:10.626 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.626 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.626 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:38:10.626 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.680806+0000", 2024-02-19T21:38:10.627 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.081263583 2024-02-19T21:38:10.627 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.627 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:38:10.627 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.627 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.627 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.627 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:146654 7.c 7:30f1511f:::benchmark_data_smithi080_79222_object31920:head [delete] snapc 0=[] ondisk+write+known_if_redirected e133)", 2024-02-19T21:38:10.627 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:37:33.605005+0000", 2024-02-19T21:38:10.627 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 36.936103117000002, 2024-02-19T21:38:10.627 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.075943084999999994, 2024-02-19T21:38:10.627 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:38:10.627 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:38:10.627 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:38:10.627 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:38:10.628 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:38:10.628 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 146654 2024-02-19T21:38:10.628 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.628 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:38:10.628 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.628 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:38:10.628 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.605005+0000", 2024-02-19T21:38:10.628 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:38:10.628 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.628 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.628 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:38:10.628 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.605005+0000", 2024-02-19T21:38:10.628 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:38:10.628 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.629 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.629 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:38:10.629 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.605004+0000", 2024-02-19T21:38:10.629 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.032e-06 2024-02-19T21:38:10.629 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.629 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.629 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:38:10.629 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.605010+0000", 2024-02-19T21:38:10.629 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1164e-05 2024-02-19T21:38:10.629 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.629 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.629 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:38:10.629 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.605021+0000", 2024-02-19T21:38:10.629 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.4759999999999997e-06 2024-02-19T21:38:10.629 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.630 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.630 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:38:10.630 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.605026+0000", 2024-02-19T21:38:10.630 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.7509000000000003e-05 2024-02-19T21:38:10.630 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.630 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.630 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:38:10.630 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.605064+0000", 2024-02-19T21:38:10.630 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.5448e-05 2024-02-19T21:38:10.630 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.630 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.630 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:38:10.630 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.605139+0000", 2024-02-19T21:38:10.630 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.4794000000000001e-05 2024-02-19T21:38:10.630 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.631 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.631 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:38:10.631 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.605234+0000", 2024-02-19T21:38:10.631 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0051147839999999998 2024-02-19T21:38:10.631 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.631 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.631 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.631 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.610349+0000", 2024-02-19T21:38:10.631 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.1762999999999996e-05 2024-02-19T21:38:10.631 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.631 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.631 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:38:10.631 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.610431+0000", 2024-02-19T21:38:10.631 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.070418361999999998 2024-02-19T21:38:10.632 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.632 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.632 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.632 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.680849+0000", 2024-02-19T21:38:10.632 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.3054999999999999e-05 2024-02-19T21:38:10.632 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.632 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.632 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:38:10.632 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.680902+0000", 2024-02-19T21:38:10.632 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.5923000000000001e-05 2024-02-19T21:38:10.633 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.633 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.633 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:38:10.633 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.680948+0000", 2024-02-19T21:38:10.633 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.075943084999999994 2024-02-19T21:38:10.633 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.633 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:38:10.633 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.633 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.633 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.633 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:146660 7.c 7:3daabc3f:::benchmark_data_smithi080_79222_object31926:head [delete] snapc 0=[] ondisk+write+known_if_redirected e133)", 2024-02-19T21:38:10.634 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:37:33.611219+0000", 2024-02-19T21:38:10.634 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 36.929889529, 2024-02-19T21:38:10.634 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.076377339000000002, 2024-02-19T21:38:10.634 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:38:10.634 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:38:10.634 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:38:10.634 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:38:10.634 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:38:10.634 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 146660 2024-02-19T21:38:10.634 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.634 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:38:10.634 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.634 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:38:10.635 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.611219+0000", 2024-02-19T21:38:10.635 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:38:10.635 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.635 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.635 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:38:10.635 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.611219+0000", 2024-02-19T21:38:10.635 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:38:10.635 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.635 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.635 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:38:10.635 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.611217+0000", 2024-02-19T21:38:10.635 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.2129999999999996e-06 2024-02-19T21:38:10.635 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.635 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.636 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:38:10.636 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.611223+0000", 2024-02-19T21:38:10.636 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0764999999999999e-05 2024-02-19T21:38:10.636 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.636 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.636 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:38:10.636 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.611234+0000", 2024-02-19T21:38:10.636 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.725e-06 2024-02-19T21:38:10.636 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.636 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.636 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:38:10.636 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.611241+0000", 2024-02-19T21:38:10.636 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.8225e-05 2024-02-19T21:38:10.636 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.637 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.637 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:38:10.637 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.611289+0000", 2024-02-19T21:38:10.637 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.1366000000000006e-05 2024-02-19T21:38:10.637 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.637 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.637 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:38:10.637 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.611380+0000", 2024-02-19T21:38:10.637 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00012513499999999999 2024-02-19T21:38:10.637 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.637 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.638 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:38:10.638 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.611506+0000", 2024-02-19T21:38:10.638 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0031754719999999999 2024-02-19T21:38:10.638 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.639 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.639 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.639 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.614681+0000", 2024-02-19T21:38:10.639 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2874000000000001e-05 2024-02-19T21:38:10.639 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.639 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.639 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:38:10.639 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.614694+0000", 2024-02-19T21:38:10.639 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.072793325000000006 2024-02-19T21:38:10.639 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.639 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.640 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.640 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.687487+0000", 2024-02-19T21:38:10.640 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.8658e-05 2024-02-19T21:38:10.640 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.640 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.640 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:38:10.640 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.687546+0000", 2024-02-19T21:38:10.640 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0105000000000002e-05 2024-02-19T21:38:10.640 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.640 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.640 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:38:10.640 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.687596+0000", 2024-02-19T21:38:10.640 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.076377339000000002 2024-02-19T21:38:10.640 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.641 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:38:10.641 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.641 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.641 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.641 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:147646 7.c 7:35a31d22:::benchmark_data_smithi080_79222_object32912:head [delete] snapc 0=[] ondisk+write+known_if_redirected e133)", 2024-02-19T21:38:10.641 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:37:34.602753+0000", 2024-02-19T21:38:10.641 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 35.938355657999999, 2024-02-19T21:38:10.641 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.060353472999999998, 2024-02-19T21:38:10.641 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:38:10.641 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:38:10.641 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:38:10.641 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:38:10.641 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:38:10.641 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 147646 2024-02-19T21:38:10.642 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.642 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:38:10.642 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.642 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:38:10.642 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:34.602753+0000", 2024-02-19T21:38:10.642 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:38:10.642 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.642 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.642 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:38:10.642 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:34.602753+0000", 2024-02-19T21:38:10.642 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:38:10.642 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.642 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.642 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:38:10.642 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:34.602751+0000", 2024-02-19T21:38:10.643 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.3110000000000002e-06 2024-02-19T21:38:10.643 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.643 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.643 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:38:10.643 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:34.602758+0000", 2024-02-19T21:38:10.643 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0549e-05 2024-02-19T21:38:10.643 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.643 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.643 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:38:10.643 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:34.602768+0000", 2024-02-19T21:38:10.643 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0320000000000003e-06 2024-02-19T21:38:10.643 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.643 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.643 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:38:10.644 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:34.602773+0000", 2024-02-19T21:38:10.644 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.7756000000000002e-05 2024-02-19T21:38:10.644 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.644 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.644 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:38:10.644 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:34.602821+0000", 2024-02-19T21:38:10.644 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000121852 2024-02-19T21:38:10.644 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.644 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.644 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:38:10.644 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:34.602943+0000", 2024-02-19T21:38:10.644 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014841600000000001 2024-02-19T21:38:10.644 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.644 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.645 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:38:10.645 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:34.603091+0000", 2024-02-19T21:38:10.645 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0024501269999999999 2024-02-19T21:38:10.645 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.645 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.645 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:38:10.645 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:34.605541+0000", 2024-02-19T21:38:10.645 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00087258300000000002 2024-02-19T21:38:10.645 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.645 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.645 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.645 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:34.606414+0000", 2024-02-19T21:38:10.645 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.056605042000000001 2024-02-19T21:38:10.645 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.646 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.646 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.646 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:34.663019+0000", 2024-02-19T21:38:10.646 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.5355999999999997e-05 2024-02-19T21:38:10.646 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.646 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.646 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:38:10.646 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:34.663064+0000", 2024-02-19T21:38:10.646 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.1692e-05 2024-02-19T21:38:10.646 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.646 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.646 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:38:10.646 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:34.663106+0000", 2024-02-19T21:38:10.646 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.060353472999999998 2024-02-19T21:38:10.646 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.647 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:38:10.647 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.647 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.647 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.647 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:147652 7.c 7:3a6ede4a:::benchmark_data_smithi080_79222_object32918:head [delete] snapc 0=[] ondisk+write+known_if_redirected e133)", 2024-02-19T21:38:10.647 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:37:34.608745+0000", 2024-02-19T21:38:10.647 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 35.932363180999999, 2024-02-19T21:38:10.647 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.063590115000000003, 2024-02-19T21:38:10.647 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:38:10.647 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:38:10.647 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:38:10.647 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:38:10.647 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:38:10.647 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 147652 2024-02-19T21:38:10.647 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.648 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:38:10.648 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.648 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:38:10.648 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:34.608745+0000", 2024-02-19T21:38:10.648 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:38:10.648 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.648 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.648 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:38:10.648 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:34.608745+0000", 2024-02-19T21:38:10.648 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:38:10.648 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.648 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.648 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:38:10.649 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:34.608744+0000", 2024-02-19T21:38:10.649 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.6710000000000002e-06 2024-02-19T21:38:10.649 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.649 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.649 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:38:10.649 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:34.608750+0000", 2024-02-19T21:38:10.649 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1352000000000001e-05 2024-02-19T21:38:10.649 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.649 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.649 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:38:10.649 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:34.608762+0000", 2024-02-19T21:38:10.649 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.6179999999999997e-06 2024-02-19T21:38:10.649 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.649 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.650 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:38:10.650 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:34.608766+0000", 2024-02-19T21:38:10.650 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.2972999999999997e-05 2024-02-19T21:38:10.650 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.650 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.650 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:38:10.650 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:34.608809+0000", 2024-02-19T21:38:10.650 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000120128 2024-02-19T21:38:10.650 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.650 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.650 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:38:10.650 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:34.608929+0000", 2024-02-19T21:38:10.650 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013519699999999999 2024-02-19T21:38:10.650 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.651 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.651 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:38:10.651 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:34.609065+0000", 2024-02-19T21:38:10.651 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0029601710000000002 2024-02-19T21:38:10.651 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.651 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.651 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:38:10.651 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:34.612025+0000", 2024-02-19T21:38:10.651 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0023214609999999999 2024-02-19T21:38:10.651 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.651 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.651 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.651 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:34.614346+0000", 2024-02-19T21:38:10.651 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.057885146999999998 2024-02-19T21:38:10.651 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.652 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.652 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.652 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:34.672231+0000", 2024-02-19T21:38:10.652 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.8585000000000002e-05 2024-02-19T21:38:10.652 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.652 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.652 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:38:10.652 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:34.672290+0000", 2024-02-19T21:38:10.652 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.5083999999999997e-05 2024-02-19T21:38:10.652 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.652 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.652 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:38:10.652 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:34.672335+0000", 2024-02-19T21:38:10.652 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.063590115000000003 2024-02-19T21:38:10.652 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.653 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:38:10.653 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.653 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.653 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.653 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:148599 7.7 7:e16f1a5a:::benchmark_data_smithi080_79222_object33865:head [delete] snapc 0=[] ondisk+write+known_if_redirected e133)", 2024-02-19T21:38:10.653 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:37:35.638299+0000", 2024-02-19T21:38:10.653 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 34.902809556999998, 2024-02-19T21:38:10.653 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.048783799000000003, 2024-02-19T21:38:10.653 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:38:10.653 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:38:10.653 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:38:10.653 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:38:10.653 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:38:10.653 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 148599 2024-02-19T21:38:10.654 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.654 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:38:10.654 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.654 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:38:10.654 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.638299+0000", 2024-02-19T21:38:10.654 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:38:10.654 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.654 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.654 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:38:10.654 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.638299+0000", 2024-02-19T21:38:10.654 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:38:10.654 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.654 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.654 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:38:10.654 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.638297+0000", 2024-02-19T21:38:10.655 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.4300000000000006e-06 2024-02-19T21:38:10.655 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.655 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.655 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:38:10.655 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.638305+0000", 2024-02-19T21:38:10.655 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.5804999999999999e-05 2024-02-19T21:38:10.655 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.655 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.655 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:38:10.655 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.638321+0000", 2024-02-19T21:38:10.655 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.1959999999999996e-06 2024-02-19T21:38:10.655 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.655 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.655 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:38:10.655 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.638327+0000", 2024-02-19T21:38:10.656 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.1098000000000002e-05 2024-02-19T21:38:10.656 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.656 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.656 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:38:10.656 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.638408+0000", 2024-02-19T21:38:10.656 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000123103 2024-02-19T21:38:10.656 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.656 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.656 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:38:10.656 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.638531+0000", 2024-02-19T21:38:10.656 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014235100000000001 2024-02-19T21:38:10.656 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.656 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.656 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,3", 2024-02-19T21:38:10.657 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.638674+0000", 2024-02-19T21:38:10.657 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0082411499999999992 2024-02-19T21:38:10.657 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.657 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.657 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:38:10.657 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.646915+0000", 2024-02-19T21:38:10.657 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0064232610000000004 2024-02-19T21:38:10.657 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.657 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.657 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.657 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.653338+0000", 2024-02-19T21:38:10.657 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.033663734000000001 2024-02-19T21:38:10.657 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.657 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.657 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.658 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.687002+0000", 2024-02-19T21:38:10.658 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0064000000000001e-05 2024-02-19T21:38:10.658 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.658 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.658 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:38:10.658 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.687042+0000", 2024-02-19T21:38:10.658 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0516000000000003e-05 2024-02-19T21:38:10.658 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.658 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.658 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:38:10.658 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.687082+0000", 2024-02-19T21:38:10.658 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.048783799000000003 2024-02-19T21:38:10.658 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.659 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:38:10.659 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.659 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.659 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.659 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:148600 7.7 7:ea40b8d2:::benchmark_data_smithi080_79222_object33866:head [delete] snapc 0=[] ondisk+write+known_if_redirected e133)", 2024-02-19T21:38:10.659 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:37:35.638345+0000", 2024-02-19T21:38:10.659 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 34.902763288999999, 2024-02-19T21:38:10.659 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.048873273000000002, 2024-02-19T21:38:10.659 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:38:10.659 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:38:10.659 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:38:10.659 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:38:10.659 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:38:10.659 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 148600 2024-02-19T21:38:10.659 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.660 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:38:10.660 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.660 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:38:10.660 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.638345+0000", 2024-02-19T21:38:10.660 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:38:10.660 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.660 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.660 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:38:10.660 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.638345+0000", 2024-02-19T21:38:10.660 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:38:10.660 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.660 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.660 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:38:10.660 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.638344+0000", 2024-02-19T21:38:10.660 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.3179999999999998e-06 2024-02-19T21:38:10.661 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.661 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.661 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:38:10.661 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.638348+0000", 2024-02-19T21:38:10.661 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.9800000000000003e-06 2024-02-19T21:38:10.661 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.661 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.661 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:38:10.661 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.638354+0000", 2024-02-19T21:38:10.661 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.766e-06 2024-02-19T21:38:10.661 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.661 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.661 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:38:10.661 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.638357+0000", 2024-02-19T21:38:10.661 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.003182949 2024-02-19T21:38:10.662 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.662 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.662 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:38:10.662 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.641540+0000", 2024-02-19T21:38:10.662 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000113684 2024-02-19T21:38:10.662 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.662 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.662 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:38:10.662 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.641654+0000", 2024-02-19T21:38:10.662 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013184399999999999 2024-02-19T21:38:10.662 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.662 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.662 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,3", 2024-02-19T21:38:10.662 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.641786+0000", 2024-02-19T21:38:10.663 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.005137534 2024-02-19T21:38:10.663 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.663 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.663 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:38:10.663 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.646923+0000", 2024-02-19T21:38:10.663 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0064464470000000001 2024-02-19T21:38:10.663 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.663 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.663 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.663 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.653370+0000", 2024-02-19T21:38:10.663 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.033796224999999999 2024-02-19T21:38:10.663 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.663 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.663 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.663 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.687166+0000", 2024-02-19T21:38:10.664 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.8839e-05 2024-02-19T21:38:10.664 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.664 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.664 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:38:10.664 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.687195+0000", 2024-02-19T21:38:10.664 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.3203000000000001e-05 2024-02-19T21:38:10.664 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.664 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.664 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:38:10.664 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.687218+0000", 2024-02-19T21:38:10.664 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.048873273000000002 2024-02-19T21:38:10.664 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.664 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:38:10.664 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.665 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.665 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.665 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:148604 7.7 7:eba6ba17:::benchmark_data_smithi080_79222_object33870:head [delete] snapc 0=[] ondisk+write+known_if_redirected e133)", 2024-02-19T21:38:10.665 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:37:35.640329+0000", 2024-02-19T21:38:10.665 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 34.900778844999998, 2024-02-19T21:38:10.665 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.048658095999999998, 2024-02-19T21:38:10.665 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:38:10.665 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:38:10.665 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:38:10.665 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:38:10.665 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:38:10.665 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 148604 2024-02-19T21:38:10.665 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.665 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:38:10.666 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.666 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:38:10.666 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.640329+0000", 2024-02-19T21:38:10.666 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:38:10.666 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.666 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.666 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:38:10.666 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.640329+0000", 2024-02-19T21:38:10.666 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:38:10.666 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.666 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.666 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:38:10.666 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.640328+0000", 2024-02-19T21:38:10.666 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.7240000000000003e-06 2024-02-19T21:38:10.666 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.667 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.667 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:38:10.667 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.640335+0000", 2024-02-19T21:38:10.667 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.9559e-05 2024-02-19T21:38:10.667 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.667 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.667 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:38:10.667 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.640354+0000", 2024-02-19T21:38:10.667 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.4810000000000003e-06 2024-02-19T21:38:10.667 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.667 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.667 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:38:10.667 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.640361+0000", 2024-02-19T21:38:10.667 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0041913949999999997 2024-02-19T21:38:10.668 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.668 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.668 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:38:10.668 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.644552+0000", 2024-02-19T21:38:10.668 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.2992999999999995e-05 2024-02-19T21:38:10.668 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.668 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.668 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:38:10.668 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.644645+0000", 2024-02-19T21:38:10.668 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00011145399999999999 2024-02-19T21:38:10.669 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.669 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.669 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,3", 2024-02-19T21:38:10.669 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.644757+0000", 2024-02-19T21:38:10.669 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0021724370000000002 2024-02-19T21:38:10.669 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.669 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.669 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:38:10.669 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.646929+0000", 2024-02-19T21:38:10.669 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.034636884 2024-02-19T21:38:10.669 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.669 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.669 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.669 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.681566+0000", 2024-02-19T21:38:10.669 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0073392070000000004 2024-02-19T21:38:10.670 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.670 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.670 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.670 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.688905+0000", 2024-02-19T21:38:10.670 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.6047999999999997e-05 2024-02-19T21:38:10.670 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.670 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.670 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:38:10.670 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.688951+0000", 2024-02-19T21:38:10.670 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.6038000000000003e-05 2024-02-19T21:38:10.670 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.670 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.671 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:38:10.671 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.688987+0000", 2024-02-19T21:38:10.671 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.048658095999999998 2024-02-19T21:38:10.671 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.671 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:38:10.671 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.671 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.671 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.671 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:148872 7.7 7:ebd66f33:::benchmark_data_smithi080_79222_object34138:head [delete] snapc 0=[] ondisk+write+known_if_redirected e133)", 2024-02-19T21:38:10.671 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:37:35.931773+0000", 2024-02-19T21:38:10.671 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 34.609335117000001, 2024-02-19T21:38:10.671 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.047110753999999998, 2024-02-19T21:38:10.671 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:38:10.671 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:38:10.672 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:38:10.672 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:38:10.672 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:38:10.672 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 148872 2024-02-19T21:38:10.672 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.672 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:38:10.672 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.672 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:38:10.672 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.931773+0000", 2024-02-19T21:38:10.672 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:38:10.672 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.672 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.672 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:38:10.672 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.931773+0000", 2024-02-19T21:38:10.673 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:38:10.673 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.673 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.673 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:38:10.673 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.931772+0000", 2024-02-19T21:38:10.673 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.2650000000000001e-06 2024-02-19T21:38:10.673 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.673 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.673 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:38:10.673 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.931776+0000", 2024-02-19T21:38:10.673 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.4056000000000001e-05 2024-02-19T21:38:10.673 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.673 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.673 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:38:10.673 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.931790+0000", 2024-02-19T21:38:10.674 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.4029999999999998e-06 2024-02-19T21:38:10.674 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.674 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.674 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:38:10.674 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.931795+0000", 2024-02-19T21:38:10.674 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.1408999999999997e-05 2024-02-19T21:38:10.674 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.674 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.674 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:38:10.674 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.931827+0000", 2024-02-19T21:38:10.674 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.0178000000000004e-05 2024-02-19T21:38:10.674 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.674 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.674 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:38:10.674 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.931907+0000", 2024-02-19T21:38:10.675 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.5128000000000002e-05 2024-02-19T21:38:10.675 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.675 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.675 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,3", 2024-02-19T21:38:10.675 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.931992+0000", 2024-02-19T21:38:10.675 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0034189950000000002 2024-02-19T21:38:10.675 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.675 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.675 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:38:10.675 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.935411+0000", 2024-02-19T21:38:10.675 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0062684519999999999 2024-02-19T21:38:10.675 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.675 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.675 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.676 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.941679+0000", 2024-02-19T21:38:10.676 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.037120078000000001 2024-02-19T21:38:10.676 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.676 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.676 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:10.676 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.978799+0000", 2024-02-19T21:38:10.676 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.3695000000000001e-05 2024-02-19T21:38:10.676 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.676 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.676 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:38:10.676 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.978843+0000", 2024-02-19T21:38:10.676 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0658999999999998e-05 2024-02-19T21:38:10.676 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:38:10.676 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:38:10.677 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:38:10.677 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:35.978884+0000", 2024-02-19T21:38:10.677 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.047110753999999998 2024-02-19T21:38:10.677 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.677 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:38:10.677 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.677 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:38:10.677 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:38:10.677 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:38:11.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:09.972330+0000 mon.a (mon.0) 898 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:38:11.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:09.993226+0000 mon.a (mon.0) 899 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:38:11.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:09.993294+0000 mon.a (mon.0) 900 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2024-02-19T21:38:11.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:10.086900+0000 mgr.y (mgr.14514) 220 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:38:11.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:10.094041+0000 osd.2 (osd.2) 95 : cluster [DBG] 7.8 scrub starts 2024-02-19T21:38:11.099 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:38:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:38:10] "GET /metrics HTTP/1.1" 200 175462 "" "Prometheus/2.33.4" 2024-02-19T21:38:11.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:09.972330+0000 mon.a (mon.0) 898 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:38:11.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:09.993226+0000 mon.a (mon.0) 899 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:38:11.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:09.993294+0000 mon.a (mon.0) 900 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2024-02-19T21:38:11.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:10.086900+0000 mgr.y (mgr.14514) 220 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:38:11.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:10.094041+0000 osd.2 (osd.2) 95 : cluster [DBG] 7.8 scrub starts 2024-02-19T21:38:11.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:09.972330+0000 mon.a (mon.0) 898 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:38:11.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:09.993226+0000 mon.a (mon.0) 899 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:38:11.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:09.993294+0000 mon.a (mon.0) 900 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2024-02-19T21:38:11.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:10.086900+0000 mgr.y (mgr.14514) 220 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:38:11.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:10.094041+0000 osd.2 (osd.2) 95 : cluster [DBG] 7.8 scrub starts 2024-02-19T21:38:11.333 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.7 dump_ops_in_flight 2024-02-19T21:38:11.697 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:38:11.842 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:38:12.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:10.903526+0000 mgr.y (mgr.14514) 221 : cluster [DBG] pgmap v234: 148 pgs: 148 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.20k op/s 2024-02-19T21:38:12.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:11.071294+0000 osd.2 (osd.2) 96 : cluster [DBG] 7.8 scrub ok 2024-02-19T21:38:12.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:10.903526+0000 mgr.y (mgr.14514) 221 : cluster [DBG] pgmap v234: 148 pgs: 148 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.20k op/s 2024-02-19T21:38:12.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:11.071294+0000 osd.2 (osd.2) 96 : cluster [DBG] 7.8 scrub ok 2024-02-19T21:38:12.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:10.903526+0000 mgr.y (mgr.14514) 221 : cluster [DBG] pgmap v234: 148 pgs: 148 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.20k op/s 2024-02-19T21:38:12.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:11.071294+0000 osd.2 (osd.2) 96 : cluster [DBG] 7.8 scrub ok 2024-02-19T21:38:12.558 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:38:12.561 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:12.561 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:38:12.662 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:38:12.732 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:12.851 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:38:12.857 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:12.858 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:38:12.959 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:38:13.003 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:13.050 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:38:13.060 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:13.060 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:38:13.161 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:38:13.232 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:13.276 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:38:13.278 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:13.278 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:11.700963+0000 osd.7 (osd.7) 97 : cluster [DBG] 2.8 scrub starts 2024-02-19T21:38:13.278 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:11.707421+0000 osd.7 (osd.7) 98 : cluster [DBG] 2.8 scrub ok 2024-02-19T21:38:13.278 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:11.860112+0000 osd.5 (osd.5) 106 : cluster [DBG] 7.0 scrub starts 2024-02-19T21:38:13.278 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:11.700963+0000 osd.7 (osd.7) 97 : cluster [DBG] 2.8 scrub starts 2024-02-19T21:38:13.279 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:11.707421+0000 osd.7 (osd.7) 98 : cluster [DBG] 2.8 scrub ok 2024-02-19T21:38:13.279 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:11.860112+0000 osd.5 (osd.5) 106 : cluster [DBG] 7.0 scrub starts 2024-02-19T21:38:13.279 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:38:13.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:11.700963+0000 osd.7 (osd.7) 97 : cluster [DBG] 2.8 scrub starts 2024-02-19T21:38:13.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:11.707421+0000 osd.7 (osd.7) 98 : cluster [DBG] 2.8 scrub ok 2024-02-19T21:38:13.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:11.860112+0000 osd.5 (osd.5) 106 : cluster [DBG] 7.0 scrub starts 2024-02-19T21:38:13.331 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:38:13.380 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:38:13.414 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:13.441 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:38:13.444 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:13.445 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:38:13.545 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:38:13.571 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:38:13.581 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:13.587 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:38:13.711 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:38:13.714 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:13.714 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:38:13.815 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:38:13.856 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:13.867 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-19T21:38:14.021 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:12.903960+0000 mgr.y (mgr.14514) 222 : cluster [DBG] pgmap v235: 148 pgs: 148 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 867 op/s 2024-02-19T21:38:14.021 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:12.974507+0000 osd.5 (osd.5) 107 : cluster [DBG] 7.0 scrub ok 2024-02-19T21:38:14.021 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:13.384451+0000 osd.6 (osd.6) 77 : cluster [DBG] 5.18 scrub starts 2024-02-19T21:38:14.021 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:13.387368+0000 osd.6 (osd.6) 78 : cluster [DBG] 5.18 scrub ok 2024-02-19T21:38:14.021 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:13.549319+0000 mgr.y (mgr.14514) 223 : audit [DBG] from='client.24730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:38:14.041 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:38:14.041 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [], 2024-02-19T21:38:14.041 INFO:teuthology.orchestra.run.smithi157.stdout: "num_ops": 0 2024-02-19T21:38:14.041 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:38:14.114 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:38:14.117 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:14.117 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:38:14.218 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:38:14.258 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:14.286 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:12.903960+0000 mgr.y (mgr.14514) 222 : cluster [DBG] pgmap v235: 148 pgs: 148 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 867 op/s 2024-02-19T21:38:14.286 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:12.974507+0000 osd.5 (osd.5) 107 : cluster [DBG] 7.0 scrub ok 2024-02-19T21:38:14.286 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:13.384451+0000 osd.6 (osd.6) 77 : cluster [DBG] 5.18 scrub starts 2024-02-19T21:38:14.286 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:13.387368+0000 osd.6 (osd.6) 78 : cluster [DBG] 5.18 scrub ok 2024-02-19T21:38:14.287 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:13.549319+0000 mgr.y (mgr.14514) 223 : audit [DBG] from='client.24730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:38:14.287 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:12.903960+0000 mgr.y (mgr.14514) 222 : cluster [DBG] pgmap v235: 148 pgs: 148 active+clean; 3.0 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 867 op/s 2024-02-19T21:38:14.287 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:12.974507+0000 osd.5 (osd.5) 107 : cluster [DBG] 7.0 scrub ok 2024-02-19T21:38:14.287 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:13.384451+0000 osd.6 (osd.6) 77 : cluster [DBG] 5.18 scrub starts 2024-02-19T21:38:14.287 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:13.387368+0000 osd.6 (osd.6) 78 : cluster [DBG] 5.18 scrub ok 2024-02-19T21:38:14.287 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:13.549319+0000 mgr.y (mgr.14514) 223 : audit [DBG] from='client.24730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:38:14.324 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:38:14.327 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:14.327 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:38:14.428 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:38:14.486 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:14.758 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:38:14.764 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:14.765 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:38:14.787 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":235,"stamp":"2024-02-19T21:38:12.903714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3201308348,"num_objects":49041,"num_object_clones":0,"num_object_copies":147123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49041,"num_whiteouts":0,"num_read":1054,"num_read_kb":806,"num_write":181043,"num_write_kb":7342826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":89024,"ondisk_log_size":89024,"up":444,"acting":444,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":444,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":11921304,"kb_used_data":9490200,"kb_used_omap":0,"kb_used_meta":2430976,"kb_avail":738039912,"statfs":{"total":767960285184,"available":755752869888,"internally_reserved":0,"allocated":9717964800,"data_stored":9715504780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489319424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,1,4,12,1,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-455081984,"num_objects":-6944,"num_object_clones":0,"num_object_copies":-20832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-6944,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6944,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.007578"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":94,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.228993+0000","last_change":"2024-02-19T21:36:08.767606+0000","last_active":"2024-02-19T21:38:03.228993+0000","last_peered":"2024-02-19T21:38:03.228993+0000","last_clean":"2024-02-19T21:38:03.228993+0000","last_became_active":"2024-02-19T21:32:29.599674+0000","last_became_peered":"2024-02-19T21:32:29.599674+0000","last_unstale":"2024-02-19T21:38:03.228993+0000","last_undegraded":"2024-02-19T21:38:03.228993+0000","last_fullsized":"2024-02-19T21:38:03.228993+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:08.767498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:36:08.767498+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":55,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.228517+0000","last_change":"2024-02-19T21:35:14.512242+0000","last_active":"2024-02-19T21:38:03.228517+0000","last_peered":"2024-02-19T21:38:03.228517+0000","last_clean":"2024-02-19T21:38:03.228517+0000","last_became_active":"2024-02-19T21:35:14.511920+0000","last_became_peered":"2024-02-19T21:35:14.511920+0000","last_unstale":"2024-02-19T21:38:03.228517+0000","last_undegraded":"2024-02-19T21:38:03.228517+0000","last_fullsized":"2024-02-19T21:38:03.228517+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:11.384929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:35:11.384929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":106,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.228379+0000","last_change":"2024-02-19T21:37:26.834440+0000","last_active":"2024-02-19T21:38:03.228379+0000","last_peered":"2024-02-19T21:38:03.228379+0000","last_clean":"2024-02-19T21:38:03.228379+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:38:03.228379+0000","last_undegraded":"2024-02-19T21:38:03.228379+0000","last_fullsized":"2024-02-19T21:38:03.228379+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:26.834173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:37:26.834173+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"66'15","reported_seq":123,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.228464+0000","last_change":"2024-02-19T21:36:14.711437+0000","last_active":"2024-02-19T21:38:03.228464+0000","last_peered":"2024-02-19T21:38:03.228464+0000","last_clean":"2024-02-19T21:38:03.228464+0000","last_became_active":"2024-02-19T21:32:25.365996+0000","last_became_peered":"2024-02-19T21:32:25.365996+0000","last_unstale":"2024-02-19T21:38:03.228464+0000","last_undegraded":"2024-02-19T21:38:03.228464+0000","last_fullsized":"2024-02-19T21:38:03.228464+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:36:14.711338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:14.711338+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":60,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.240248+0000","last_change":"2024-02-19T21:36:07.637136+0000","last_active":"2024-02-19T21:38:03.240248+0000","last_peered":"2024-02-19T21:38:03.240248+0000","last_clean":"2024-02-19T21:38:03.240248+0000","last_became_active":"2024-02-19T21:35:14.517794+0000","last_became_peered":"2024-02-19T21:35:14.517794+0000","last_unstale":"2024-02-19T21:38:03.240248+0000","last_undegraded":"2024-02-19T21:38:03.240248+0000","last_fullsized":"2024-02-19T21:38:03.240248+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:07.637066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:36:07.637066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":97,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.236971+0000","last_change":"2024-02-19T21:36:02.866497+0000","last_active":"2024-02-19T21:38:03.236971+0000","last_peered":"2024-02-19T21:38:03.236971+0000","last_clean":"2024-02-19T21:38:03.236971+0000","last_became_active":"2024-02-19T21:32:27.372466+0000","last_became_peered":"2024-02-19T21:32:27.372466+0000","last_unstale":"2024-02-19T21:38:03.236971+0000","last_undegraded":"2024-02-19T21:38:03.236971+0000","last_fullsized":"2024-02-19T21:38:03.236971+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:02.866408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:02.866408+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":105,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.237147+0000","last_change":"2024-02-19T21:37:29.668528+0000","last_active":"2024-02-19T21:38:03.237147+0000","last_peered":"2024-02-19T21:38:03.237147+0000","last_clean":"2024-02-19T21:38:03.237147+0000","last_became_active":"2024-02-19T21:32:23.356975+0000","last_became_peered":"2024-02-19T21:32:23.356975+0000","last_unstale":"2024-02-19T21:38:03.237147+0000","last_undegraded":"2024-02-19T21:38:03.237147+0000","last_fullsized":"2024-02-19T21:38:03.237147+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:37:29.668438+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"92'13","reported_seq":129,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.222915+0000","last_change":"2024-02-19T21:37:04.481872+0000","last_active":"2024-02-19T21:38:03.222915+0000","last_peered":"2024-02-19T21:38:03.222915+0000","last_clean":"2024-02-19T21:38:03.222915+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:38:03.222915+0000","last_undegraded":"2024-02-19T21:38:03.222915+0000","last_fullsized":"2024-02-19T21:38:03.222915+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"92'13","last_scrub_stamp":"2024-02-19T21:37:04.481758+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:37:04.481758+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":94,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.240088+0000","last_change":"2024-02-19T21:35:58.578063+0000","last_active":"2024-02-19T21:38:03.240088+0000","last_peered":"2024-02-19T21:38:03.240088+0000","last_clean":"2024-02-19T21:38:03.240088+0000","last_became_active":"2024-02-19T21:32:29.373648+0000","last_became_peered":"2024-02-19T21:32:29.373648+0000","last_unstale":"2024-02-19T21:38:03.240088+0000","last_undegraded":"2024-02-19T21:38:03.240088+0000","last_fullsized":"2024-02-19T21:38:03.240088+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:58.577980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:35:58.577980+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":96,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.234377+0000","last_change":"2024-02-19T21:36:10.065611+0000","last_active":"2024-02-19T21:38:03.234377+0000","last_peered":"2024-02-19T21:38:03.234377+0000","last_clean":"2024-02-19T21:38:03.234377+0000","last_became_active":"2024-02-19T21:32:27.370308+0000","last_became_peered":"2024-02-19T21:32:27.370308+0000","last_unstale":"2024-02-19T21:38:03.234377+0000","last_undegraded":"2024-02-19T21:38:03.234377+0000","last_fullsized":"2024-02-19T21:38:03.234377+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:10.065522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:10.065522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":107,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.233890+0000","last_change":"2024-02-19T21:37:35.972210+0000","last_active":"2024-02-19T21:38:03.233890+0000","last_peered":"2024-02-19T21:38:03.233890+0000","last_clean":"2024-02-19T21:38:03.233890+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:38:03.233890+0000","last_undegraded":"2024-02-19T21:38:03.233890+0000","last_fullsized":"2024-02-19T21:38:03.233890+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:35.972143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:08.490788+0000","last_clean_scrub_stamp":"2024-02-19T21:37:35.972143+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"66'5","reported_seq":82,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.229065+0000","last_change":"2024-02-19T21:37:12.566212+0000","last_active":"2024-02-19T21:38:03.229065+0000","last_peered":"2024-02-19T21:38:03.229065+0000","last_clean":"2024-02-19T21:38:03.229065+0000","last_became_active":"2024-02-19T21:35:14.514561+0000","last_became_peered":"2024-02-19T21:35:14.514561+0000","last_unstale":"2024-02-19T21:38:03.229065+0000","last_undegraded":"2024-02-19T21:38:03.229065+0000","last_fullsized":"2024-02-19T21:38:03.229065+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'5","last_scrub_stamp":"2024-02-19T21:37:12.566111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:12.566111+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":96,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.227214+0000","last_change":"2024-02-19T21:35:57.291952+0000","last_active":"2024-02-19T21:38:03.227214+0000","last_peered":"2024-02-19T21:38:03.227214+0000","last_clean":"2024-02-19T21:38:03.227214+0000","last_became_active":"2024-02-19T21:32:29.373010+0000","last_became_peered":"2024-02-19T21:32:29.373010+0000","last_unstale":"2024-02-19T21:38:03.227214+0000","last_undegraded":"2024-02-19T21:38:03.227214+0000","last_fullsized":"2024-02-19T21:38:03.227214+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:35:57.291864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:35:57.291864+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":101,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.241573+0000","last_change":"2024-02-19T21:36:09.679009+0000","last_active":"2024-02-19T21:38:03.241573+0000","last_peered":"2024-02-19T21:38:03.241573+0000","last_clean":"2024-02-19T21:38:03.241573+0000","last_became_active":"2024-02-19T21:32:27.368241+0000","last_became_peered":"2024-02-19T21:32:27.368241+0000","last_unstale":"2024-02-19T21:38:03.241573+0000","last_undegraded":"2024-02-19T21:38:03.241573+0000","last_fullsized":"2024-02-19T21:38:03.241573+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:09.678914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:46.543259+0000","last_clean_scrub_stamp":"2024-02-19T21:36:09.678914+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":105,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.237578+0000","last_change":"2024-02-19T21:37:06.962332+0000","last_active":"2024-02-19T21:38:03.237578+0000","last_peered":"2024-02-19T21:38:03.237578+0000","last_clean":"2024-02-19T21:38:03.237578+0000","last_became_active":"2024-02-19T21:32:23.357179+0000","last_became_peered":"2024-02-19T21:32:23.357179+0000","last_unstale":"2024-02-19T21:38:03.237578+0000","last_undegraded":"2024-02-19T21:38:03.237578+0000","last_fullsized":"2024-02-19T21:38:03.237578+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:06.962245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:37:06.962245+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"89'13","reported_seq":114,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.239353+0000","last_change":"2024-02-19T21:35:20.555646+0000","last_active":"2024-02-19T21:38:03.239353+0000","last_peered":"2024-02-19T21:38:03.239353+0000","last_clean":"2024-02-19T21:38:03.239353+0000","last_became_active":"2024-02-19T21:35:14.514971+0000","last_became_peered":"2024-02-19T21:35:14.514971+0000","last_unstale":"2024-02-19T21:38:03.239353+0000","last_undegraded":"2024-02-19T21:38:03.239353+0000","last_fullsized":"2024-02-19T21:38:03.239353+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'13","last_scrub_stamp":"2024-02-19T21:35:20.555574+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:35:20.555574+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":94,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.240441+0000","last_change":"2024-02-19T21:36:57.707929+0000","last_active":"2024-02-19T21:38:03.240441+0000","last_peered":"2024-02-19T21:38:03.240441+0000","last_clean":"2024-02-19T21:38:03.240441+0000","last_became_active":"2024-02-19T21:32:29.597266+0000","last_became_peered":"2024-02-19T21:32:29.597266+0000","last_unstale":"2024-02-19T21:38:03.240441+0000","last_undegraded":"2024-02-19T21:38:03.240441+0000","last_fullsized":"2024-02-19T21:38:03.240441+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:57.707840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:36:57.707840+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":60,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.231516+0000","last_change":"2024-02-19T21:36:52.566026+0000","last_active":"2024-02-19T21:38:03.231516+0000","last_peered":"2024-02-19T21:38:03.231516+0000","last_clean":"2024-02-19T21:38:03.231516+0000","last_became_active":"2024-02-19T21:35:14.514618+0000","last_became_peered":"2024-02-19T21:35:14.514618+0000","last_unstale":"2024-02-19T21:38:03.231516+0000","last_undegraded":"2024-02-19T21:38:03.231516+0000","last_fullsized":"2024-02-19T21:38:03.231516+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:52.565942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:52.565942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":114,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.229115+0000","last_change":"2024-02-19T21:37:23.540608+0000","last_active":"2024-02-19T21:38:03.229115+0000","last_peered":"2024-02-19T21:38:03.229115+0000","last_clean":"2024-02-19T21:38:03.229115+0000","last_became_active":"2024-02-19T21:33:50.753994+0000","last_became_peered":"2024-02-19T21:33:50.753994+0000","last_unstale":"2024-02-19T21:38:03.229115+0000","last_undegraded":"2024-02-19T21:38:03.229115+0000","last_fullsized":"2024-02-19T21:38:03.229115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:23.540517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:37:23.540517+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"66'12","reported_seq":121,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.228783+0000","last_change":"2024-02-19T21:35:10.587068+0000","last_active":"2024-02-19T21:38:03.228783+0000","last_peered":"2024-02-19T21:38:03.228783+0000","last_clean":"2024-02-19T21:38:03.228783+0000","last_became_active":"2024-02-19T21:32:25.369040+0000","last_became_peered":"2024-02-19T21:32:25.369040+0000","last_unstale":"2024-02-19T21:38:03.228783+0000","last_undegraded":"2024-02-19T21:38:03.228783+0000","last_fullsized":"2024-02-19T21:38:03.228783+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'12","last_scrub_stamp":"2024-02-19T21:35:10.586999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:35:10.586999+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":100,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.223390+0000","last_change":"2024-02-19T21:36:55.590525+0000","last_active":"2024-02-19T21:38:03.223390+0000","last_peered":"2024-02-19T21:38:03.223390+0000","last_clean":"2024-02-19T21:38:03.223390+0000","last_became_active":"2024-02-19T21:32:29.597365+0000","last_became_peered":"2024-02-19T21:32:29.597365+0000","last_unstale":"2024-02-19T21:38:03.223390+0000","last_undegraded":"2024-02-19T21:38:03.223390+0000","last_fullsized":"2024-02-19T21:38:03.223390+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:55.590424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:36:55.590424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":97,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.239267+0000","last_change":"2024-02-19T21:36:03.917955+0000","last_active":"2024-02-19T21:38:03.239267+0000","last_peered":"2024-02-19T21:38:03.239267+0000","last_clean":"2024-02-19T21:38:03.239267+0000","last_became_active":"2024-02-19T21:32:27.369757+0000","last_became_peered":"2024-02-19T21:32:27.369757+0000","last_unstale":"2024-02-19T21:38:03.239267+0000","last_undegraded":"2024-02-19T21:38:03.239267+0000","last_fullsized":"2024-02-19T21:38:03.239267+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:03.917869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:03.917869+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":105,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.231462+0000","last_change":"2024-02-19T21:36:07.011419+0000","last_active":"2024-02-19T21:38:03.231462+0000","last_peered":"2024-02-19T21:38:03.231462+0000","last_clean":"2024-02-19T21:38:03.231462+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:38:03.231462+0000","last_undegraded":"2024-02-19T21:38:03.231462+0000","last_fullsized":"2024-02-19T21:38:03.231462+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:07.011329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:36:07.011329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"93'22","reported_seq":135,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.238480+0000","last_change":"2024-02-19T21:36:55.991871+0000","last_active":"2024-02-19T21:38:03.238480+0000","last_peered":"2024-02-19T21:38:03.238480+0000","last_clean":"2024-02-19T21:38:03.238480+0000","last_became_active":"2024-02-19T21:32:25.365267+0000","last_became_peered":"2024-02-19T21:32:25.365267+0000","last_unstale":"2024-02-19T21:38:03.238480+0000","last_undegraded":"2024-02-19T21:38:03.238480+0000","last_fullsized":"2024-02-19T21:38:03.238480+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'22","last_scrub_stamp":"2024-02-19T21:36:55.991770+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:35:02.204553+0000","last_clean_scrub_stamp":"2024-02-19T21:36:55.991770+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":95,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.238787+0000","last_change":"2024-02-19T21:36:12.945673+0000","last_active":"2024-02-19T21:38:03.238787+0000","last_peered":"2024-02-19T21:38:03.238787+0000","last_clean":"2024-02-19T21:38:03.238787+0000","last_became_active":"2024-02-19T21:32:29.373361+0000","last_became_peered":"2024-02-19T21:32:29.373361+0000","last_unstale":"2024-02-19T21:38:03.238787+0000","last_undegraded":"2024-02-19T21:38:03.238787+0000","last_fullsized":"2024-02-19T21:38:03.238787+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:12.945581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:12.945581+0000","last_clean_scrub_stamp":"2024-02-19T21:36:12.945581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":102,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.228114+0000","last_change":"2024-02-19T21:37:06.536218+0000","last_active":"2024-02-19T21:38:03.228114+0000","last_peered":"2024-02-19T21:38:03.228114+0000","last_clean":"2024-02-19T21:38:03.228114+0000","last_became_active":"2024-02-19T21:32:27.367741+0000","last_became_peered":"2024-02-19T21:32:27.367741+0000","last_unstale":"2024-02-19T21:38:03.228114+0000","last_undegraded":"2024-02-19T21:38:03.228114+0000","last_fullsized":"2024-02-19T21:38:03.228114+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:06.536121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:06.536121+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":100,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.228541+0000","last_change":"2024-02-19T21:36:13.741071+0000","last_active":"2024-02-19T21:38:03.228541+0000","last_peered":"2024-02-19T21:38:03.228541+0000","last_clean":"2024-02-19T21:38:03.228541+0000","last_became_active":"2024-02-19T21:32:23.355085+0000","last_became_peered":"2024-02-19T21:32:23.355085+0000","last_unstale":"2024-02-19T21:38:03.228541+0000","last_undegraded":"2024-02-19T21:38:03.228541+0000","last_fullsized":"2024-02-19T21:38:03.228541+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:13.740974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:36:13.740974+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"66'11","reported_seq":122,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.232367+0000","last_change":"2024-02-19T21:36:56.036308+0000","last_active":"2024-02-19T21:38:03.232367+0000","last_peered":"2024-02-19T21:38:03.232367+0000","last_clean":"2024-02-19T21:38:03.232367+0000","last_became_active":"2024-02-19T21:32:25.355939+0000","last_became_peered":"2024-02-19T21:32:25.355939+0000","last_unstale":"2024-02-19T21:38:03.232367+0000","last_undegraded":"2024-02-19T21:38:03.232367+0000","last_fullsized":"2024-02-19T21:38:03.232367+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:36:56.036187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:56.036187+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":95,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.237722+0000","last_change":"2024-02-19T21:35:14.520479+0000","last_active":"2024-02-19T21:38:03.237722+0000","last_peered":"2024-02-19T21:38:03.237722+0000","last_clean":"2024-02-19T21:38:03.237722+0000","last_became_active":"2024-02-19T21:32:29.372503+0000","last_became_peered":"2024-02-19T21:32:29.372503+0000","last_unstale":"2024-02-19T21:38:03.237722+0000","last_undegraded":"2024-02-19T21:38:03.237722+0000","last_fullsized":"2024-02-19T21:38:03.237722+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:35:14.520357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:35:14.520357+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"66'8","reported_seq":183,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.258578+0000","last_change":"2024-02-19T21:37:12.934637+0000","last_active":"2024-02-19T21:38:06.258578+0000","last_peered":"2024-02-19T21:38:06.258578+0000","last_clean":"2024-02-19T21:38:06.258578+0000","last_became_active":"2024-02-19T21:32:27.366465+0000","last_became_peered":"2024-02-19T21:32:27.366465+0000","last_unstale":"2024-02-19T21:38:06.258578+0000","last_undegraded":"2024-02-19T21:38:06.258578+0000","last_fullsized":"2024-02-19T21:38:06.258578+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:37:12.934537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:12.934537+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":105,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.239945+0000","last_change":"2024-02-19T21:36:08.667004+0000","last_active":"2024-02-19T21:38:03.239945+0000","last_peered":"2024-02-19T21:38:03.239945+0000","last_clean":"2024-02-19T21:38:03.239945+0000","last_became_active":"2024-02-19T21:32:23.356323+0000","last_became_peered":"2024-02-19T21:32:23.356323+0000","last_unstale":"2024-02-19T21:38:03.239945+0000","last_undegraded":"2024-02-19T21:38:03.239945+0000","last_fullsized":"2024-02-19T21:38:03.239945+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:36:08.666908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"66'10","reported_seq":119,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.228022+0000","last_change":"2024-02-19T21:36:07.267247+0000","last_active":"2024-02-19T21:38:03.228022+0000","last_peered":"2024-02-19T21:38:03.228022+0000","last_clean":"2024-02-19T21:38:03.228022+0000","last_became_active":"2024-02-19T21:32:25.372236+0000","last_became_peered":"2024-02-19T21:32:25.372236+0000","last_unstale":"2024-02-19T21:38:03.228022+0000","last_undegraded":"2024-02-19T21:38:03.228022+0000","last_fullsized":"2024-02-19T21:38:03.228022+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:36:07.267146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:07.267146+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":94,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.231130+0000","last_change":"2024-02-19T21:35:16.590543+0000","last_active":"2024-02-19T21:38:03.231130+0000","last_peered":"2024-02-19T21:38:03.231130+0000","last_clean":"2024-02-19T21:38:03.231130+0000","last_became_active":"2024-02-19T21:32:29.599396+0000","last_became_peered":"2024-02-19T21:32:29.599396+0000","last_unstale":"2024-02-19T21:38:03.231130+0000","last_undegraded":"2024-02-19T21:38:03.231130+0000","last_fullsized":"2024-02-19T21:38:03.231130+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:35:16.590436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":96,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.234150+0000","last_change":"2024-02-19T21:36:02.169629+0000","last_active":"2024-02-19T21:38:03.234150+0000","last_peered":"2024-02-19T21:38:03.234150+0000","last_clean":"2024-02-19T21:38:03.234150+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:38:03.234150+0000","last_undegraded":"2024-02-19T21:38:03.234150+0000","last_fullsized":"2024-02-19T21:38:03.234150+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:02.169522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:36:02.169522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":105,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.232136+0000","last_change":"2024-02-19T21:37:07.922839+0000","last_active":"2024-02-19T21:38:03.232136+0000","last_peered":"2024-02-19T21:38:03.232136+0000","last_clean":"2024-02-19T21:38:03.232136+0000","last_became_active":"2024-02-19T21:32:23.355525+0000","last_became_peered":"2024-02-19T21:32:23.355525+0000","last_unstale":"2024-02-19T21:38:03.232136+0000","last_undegraded":"2024-02-19T21:38:03.232136+0000","last_fullsized":"2024-02-19T21:38:03.232136+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:07.922759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:37:07.922759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"66'11","reported_seq":122,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.228929+0000","last_change":"2024-02-19T21:37:20.505192+0000","last_active":"2024-02-19T21:38:03.228929+0000","last_peered":"2024-02-19T21:38:03.228929+0000","last_clean":"2024-02-19T21:38:03.228929+0000","last_became_active":"2024-02-19T21:32:25.372039+0000","last_became_peered":"2024-02-19T21:32:25.372039+0000","last_unstale":"2024-02-19T21:38:03.228929+0000","last_undegraded":"2024-02-19T21:38:03.228929+0000","last_fullsized":"2024-02-19T21:38:03.228929+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:37:20.505097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:20.505097+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":94,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.234185+0000","last_change":"2024-02-19T21:35:56.242025+0000","last_active":"2024-02-19T21:38:03.234185+0000","last_peered":"2024-02-19T21:38:03.234185+0000","last_clean":"2024-02-19T21:38:03.234185+0000","last_became_active":"2024-02-19T21:32:29.372163+0000","last_became_peered":"2024-02-19T21:32:29.372163+0000","last_unstale":"2024-02-19T21:38:03.234185+0000","last_undegraded":"2024-02-19T21:38:03.234185+0000","last_fullsized":"2024-02-19T21:38:03.234185+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:56.241929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:35:56.241929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":101,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.229943+0000","last_change":"2024-02-19T21:36:16.949985+0000","last_active":"2024-02-19T21:38:03.229943+0000","last_peered":"2024-02-19T21:38:03.229943+0000","last_clean":"2024-02-19T21:38:03.229943+0000","last_became_active":"2024-02-19T21:32:27.366281+0000","last_became_peered":"2024-02-19T21:32:27.366281+0000","last_unstale":"2024-02-19T21:38:03.229943+0000","last_undegraded":"2024-02-19T21:38:03.229943+0000","last_fullsized":"2024-02-19T21:38:03.229943+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:16.949911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:16.949911+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":100,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.240900+0000","last_change":"2024-02-19T21:36:01.607836+0000","last_active":"2024-02-19T21:38:03.240900+0000","last_peered":"2024-02-19T21:38:03.240900+0000","last_clean":"2024-02-19T21:38:03.240900+0000","last_became_active":"2024-02-19T21:32:23.355103+0000","last_became_peered":"2024-02-19T21:32:23.355103+0000","last_unstale":"2024-02-19T21:38:03.240900+0000","last_undegraded":"2024-02-19T21:38:03.240900+0000","last_fullsized":"2024-02-19T21:38:03.240900+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:01.607757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:36:01.607757+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"66'4","reported_seq":104,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.228300+0000","last_change":"2024-02-19T21:35:54.642189+0000","last_active":"2024-02-19T21:38:03.228300+0000","last_peered":"2024-02-19T21:38:03.228300+0000","last_clean":"2024-02-19T21:38:03.228300+0000","last_became_active":"2024-02-19T21:32:25.369139+0000","last_became_peered":"2024-02-19T21:32:25.369139+0000","last_unstale":"2024-02-19T21:38:03.228300+0000","last_undegraded":"2024-02-19T21:38:03.228300+0000","last_fullsized":"2024-02-19T21:38:03.228300+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'4","last_scrub_stamp":"2024-02-19T21:35:54.642101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:35:54.642101+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":94,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.228233+0000","last_change":"2024-02-19T21:35:22.516792+0000","last_active":"2024-02-19T21:38:03.228233+0000","last_peered":"2024-02-19T21:38:03.228233+0000","last_clean":"2024-02-19T21:38:03.228233+0000","last_became_active":"2024-02-19T21:32:29.377302+0000","last_became_peered":"2024-02-19T21:32:29.377302+0000","last_unstale":"2024-02-19T21:38:03.228233+0000","last_undegraded":"2024-02-19T21:38:03.228233+0000","last_fullsized":"2024-02-19T21:38:03.228233+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:35:22.516711+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":97,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.237609+0000","last_change":"2024-02-19T21:36:06.939920+0000","last_active":"2024-02-19T21:38:03.237609+0000","last_peered":"2024-02-19T21:38:03.237609+0000","last_clean":"2024-02-19T21:38:03.237609+0000","last_became_active":"2024-02-19T21:32:27.374451+0000","last_became_peered":"2024-02-19T21:32:27.374451+0000","last_unstale":"2024-02-19T21:38:03.237609+0000","last_undegraded":"2024-02-19T21:38:03.237609+0000","last_fullsized":"2024-02-19T21:38:03.237609+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:06.939858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:06.939858+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":103,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.238927+0000","last_change":"2024-02-19T21:35:21.713423+0000","last_active":"2024-02-19T21:38:03.238927+0000","last_peered":"2024-02-19T21:38:03.238927+0000","last_clean":"2024-02-19T21:38:03.238927+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:38:03.238927+0000","last_undegraded":"2024-02-19T21:38:03.238927+0000","last_fullsized":"2024-02-19T21:38:03.238927+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:21.713362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:35:21.713362+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"66'11","reported_seq":128,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.222835+0000","last_change":"2024-02-19T21:37:29.501216+0000","last_active":"2024-02-19T21:38:03.222835+0000","last_peered":"2024-02-19T21:38:03.222835+0000","last_clean":"2024-02-19T21:38:03.222835+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:38:03.222835+0000","last_undegraded":"2024-02-19T21:38:03.222835+0000","last_fullsized":"2024-02-19T21:38:03.222835+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:37:29.501108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:29.501108+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":100,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.226743+0000","last_change":"2024-02-19T21:36:15.297105+0000","last_active":"2024-02-19T21:38:03.226743+0000","last_peered":"2024-02-19T21:38:03.226743+0000","last_clean":"2024-02-19T21:38:03.226743+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:38:03.226743+0000","last_undegraded":"2024-02-19T21:38:03.226743+0000","last_fullsized":"2024-02-19T21:38:03.226743+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:15.297016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:42.527849+0000","last_clean_scrub_stamp":"2024-02-19T21:36:15.297016+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":96,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.229155+0000","last_change":"2024-02-19T21:36:10.728285+0000","last_active":"2024-02-19T21:38:03.229155+0000","last_peered":"2024-02-19T21:38:03.229155+0000","last_clean":"2024-02-19T21:38:03.229155+0000","last_became_active":"2024-02-19T21:32:27.369279+0000","last_became_peered":"2024-02-19T21:32:27.369279+0000","last_unstale":"2024-02-19T21:38:03.229155+0000","last_undegraded":"2024-02-19T21:38:03.229155+0000","last_fullsized":"2024-02-19T21:38:03.229155+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:10.728211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:10.728211+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":105,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.234523+0000","last_change":"2024-02-19T21:36:14.917685+0000","last_active":"2024-02-19T21:38:03.234523+0000","last_peered":"2024-02-19T21:38:03.234523+0000","last_clean":"2024-02-19T21:38:03.234523+0000","last_became_active":"2024-02-19T21:32:23.357338+0000","last_became_peered":"2024-02-19T21:32:23.357338+0000","last_unstale":"2024-02-19T21:38:03.234523+0000","last_undegraded":"2024-02-19T21:38:03.234523+0000","last_fullsized":"2024-02-19T21:38:03.234523+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:36:14.917584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"66'9","reported_seq":115,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.237609+0000","last_change":"2024-02-19T21:36:05.936042+0000","last_active":"2024-02-19T21:38:03.237609+0000","last_peered":"2024-02-19T21:38:03.237609+0000","last_clean":"2024-02-19T21:38:03.237609+0000","last_became_active":"2024-02-19T21:32:25.359777+0000","last_became_peered":"2024-02-19T21:32:25.359777+0000","last_unstale":"2024-02-19T21:38:03.237609+0000","last_undegraded":"2024-02-19T21:38:03.237609+0000","last_fullsized":"2024-02-19T21:38:03.237609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:36:05.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:05.935956+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":60,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.239537+0000","last_change":"2024-02-19T21:36:16.029010+0000","last_active":"2024-02-19T21:38:03.239537+0000","last_peered":"2024-02-19T21:38:03.239537+0000","last_clean":"2024-02-19T21:38:03.239537+0000","last_became_active":"2024-02-19T21:35:14.515471+0000","last_became_peered":"2024-02-19T21:35:14.515471+0000","last_unstale":"2024-02-19T21:38:03.239537+0000","last_undegraded":"2024-02-19T21:38:03.239537+0000","last_fullsized":"2024-02-19T21:38:03.239537+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:16.028943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:16.028943+0000","last_clean_scrub_stamp":"2024-02-19T21:36:16.028943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,5],"acting":[2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"66'8","reported_seq":173,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.252759+0000","last_change":"2024-02-19T21:36:02.726012+0000","last_active":"2024-02-19T21:38:06.252759+0000","last_peered":"2024-02-19T21:38:06.252759+0000","last_clean":"2024-02-19T21:38:06.252759+0000","last_became_active":"2024-02-19T21:32:27.365865+0000","last_became_peered":"2024-02-19T21:32:27.365865+0000","last_unstale":"2024-02-19T21:38:06.252759+0000","last_undegraded":"2024-02-19T21:38:06.252759+0000","last_fullsized":"2024-02-19T21:38:06.252759+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:36:02.725913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:02.725913+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":108,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.227154+0000","last_change":"2024-02-19T21:37:37.925047+0000","last_active":"2024-02-19T21:38:03.227154+0000","last_peered":"2024-02-19T21:38:03.227154+0000","last_clean":"2024-02-19T21:38:03.227154+0000","last_became_active":"2024-02-19T21:32:23.361680+0000","last_became_peered":"2024-02-19T21:32:23.361680+0000","last_unstale":"2024-02-19T21:38:03.227154+0000","last_undegraded":"2024-02-19T21:38:03.227154+0000","last_fullsized":"2024-02-19T21:38:03.227154+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:06.288948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:33.550655+0000","last_clean_scrub_stamp":"2024-02-19T21:36:06.288948+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"133'13","reported_seq":123,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.240845+0000","last_change":"2024-02-19T21:37:34.892934+0000","last_active":"2024-02-19T21:38:03.240845+0000","last_peered":"2024-02-19T21:38:03.240845+0000","last_clean":"2024-02-19T21:38:03.240845+0000","last_became_active":"2024-02-19T21:32:25.372206+0000","last_became_peered":"2024-02-19T21:32:25.372206+0000","last_unstale":"2024-02-19T21:38:03.240845+0000","last_undegraded":"2024-02-19T21:38:03.240845+0000","last_fullsized":"2024-02-19T21:38:03.240845+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'13","last_scrub_stamp":"2024-02-19T21:37:34.892825+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:37:34.892825+0000","last_clean_scrub_stamp":"2024-02-19T21:37:34.892825+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":105,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.227574+0000","last_change":"2024-02-19T21:37:32.890817+0000","last_active":"2024-02-19T21:38:03.227574+0000","last_peered":"2024-02-19T21:38:03.227574+0000","last_clean":"2024-02-19T21:38:03.227574+0000","last_became_active":"2024-02-19T21:32:29.376980+0000","last_became_peered":"2024-02-19T21:32:29.376980+0000","last_unstale":"2024-02-19T21:38:03.227574+0000","last_undegraded":"2024-02-19T21:38:03.227574+0000","last_fullsized":"2024-02-19T21:38:03.227574+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:32.890719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:37:32.890719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"66'8","reported_seq":178,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.247306+0000","last_change":"2024-02-19T21:37:35.901012+0000","last_active":"2024-02-19T21:38:06.247306+0000","last_peered":"2024-02-19T21:38:06.247306+0000","last_clean":"2024-02-19T21:38:06.247306+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:38:06.247306+0000","last_undegraded":"2024-02-19T21:38:06.247306+0000","last_fullsized":"2024-02-19T21:38:06.247306+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:37:35.900920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:35.900920+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":107,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.240336+0000","last_change":"2024-02-19T21:37:19.763737+0000","last_active":"2024-02-19T21:38:03.240336+0000","last_peered":"2024-02-19T21:38:03.240336+0000","last_clean":"2024-02-19T21:38:03.240336+0000","last_became_active":"2024-02-19T21:32:23.360838+0000","last_became_peered":"2024-02-19T21:32:23.360838+0000","last_unstale":"2024-02-19T21:38:03.240336+0000","last_undegraded":"2024-02-19T21:38:03.240336+0000","last_fullsized":"2024-02-19T21:38:03.240336+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:37:19.763642+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"66'10","reported_seq":113,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.231275+0000","last_change":"2024-02-19T21:35:14.590169+0000","last_active":"2024-02-19T21:38:03.231275+0000","last_peered":"2024-02-19T21:38:03.231275+0000","last_clean":"2024-02-19T21:38:03.231275+0000","last_became_active":"2024-02-19T21:32:25.372060+0000","last_became_peered":"2024-02-19T21:32:25.372060+0000","last_unstale":"2024-02-19T21:38:03.231275+0000","last_undegraded":"2024-02-19T21:38:03.231275+0000","last_fullsized":"2024-02-19T21:38:03.231275+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:35:14.590053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:35:14.590053+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":103,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.233819+0000","last_change":"2024-02-19T21:37:27.036804+0000","last_active":"2024-02-19T21:38:03.233819+0000","last_peered":"2024-02-19T21:38:03.233819+0000","last_clean":"2024-02-19T21:38:03.233819+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:38:03.233819+0000","last_undegraded":"2024-02-19T21:38:03.233819+0000","last_fullsized":"2024-02-19T21:38:03.233819+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_clean_scrub_stamp":"2024-02-19T21:37:27.036737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":96,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.240701+0000","last_change":"2024-02-19T21:35:59.616946+0000","last_active":"2024-02-19T21:38:03.240701+0000","last_peered":"2024-02-19T21:38:03.240701+0000","last_clean":"2024-02-19T21:38:03.240701+0000","last_became_active":"2024-02-19T21:32:27.369002+0000","last_became_peered":"2024-02-19T21:32:27.369002+0000","last_unstale":"2024-02-19T21:38:03.240701+0000","last_undegraded":"2024-02-19T21:38:03.240701+0000","last_fullsized":"2024-02-19T21:38:03.240701+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:59.616851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:35:59.616851+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":100,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.230013+0000","last_change":"2024-02-19T21:35:55.058463+0000","last_active":"2024-02-19T21:38:03.230013+0000","last_peered":"2024-02-19T21:38:03.230013+0000","last_clean":"2024-02-19T21:38:03.230013+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:38:03.230013+0000","last_undegraded":"2024-02-19T21:38:03.230013+0000","last_fullsized":"2024-02-19T21:38:03.230013+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:55.058402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:35:55.058402+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"66'6","reported_seq":107,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.240488+0000","last_change":"2024-02-19T21:36:06.799152+0000","last_active":"2024-02-19T21:38:03.240488+0000","last_peered":"2024-02-19T21:38:03.240488+0000","last_clean":"2024-02-19T21:38:03.240488+0000","last_became_active":"2024-02-19T21:32:25.372212+0000","last_became_peered":"2024-02-19T21:32:25.372212+0000","last_unstale":"2024-02-19T21:38:03.240488+0000","last_undegraded":"2024-02-19T21:38:03.240488+0000","last_fullsized":"2024-02-19T21:38:03.240488+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'6","last_scrub_stamp":"2024-02-19T21:36:06.799055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:06.799055+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":94,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.235334+0000","last_change":"2024-02-19T21:36:00.068028+0000","last_active":"2024-02-19T21:38:03.235334+0000","last_peered":"2024-02-19T21:38:03.235334+0000","last_clean":"2024-02-19T21:38:03.235334+0000","last_became_active":"2024-02-19T21:32:29.371977+0000","last_became_peered":"2024-02-19T21:32:29.371977+0000","last_unstale":"2024-02-19T21:38:03.235334+0000","last_undegraded":"2024-02-19T21:38:03.235334+0000","last_fullsized":"2024-02-19T21:38:03.235334+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:00.067936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:36:00.067936+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":96,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.240564+0000","last_change":"2024-02-19T21:36:54.644204+0000","last_active":"2024-02-19T21:38:03.240564+0000","last_peered":"2024-02-19T21:38:03.240564+0000","last_clean":"2024-02-19T21:38:03.240564+0000","last_became_active":"2024-02-19T21:32:27.366748+0000","last_became_peered":"2024-02-19T21:32:27.366748+0000","last_unstale":"2024-02-19T21:38:03.240564+0000","last_undegraded":"2024-02-19T21:38:03.240564+0000","last_fullsized":"2024-02-19T21:38:03.240564+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:54.644120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:54.644120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":105,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.234875+0000","last_change":"2024-02-19T21:36:11.078819+0000","last_active":"2024-02-19T21:38:03.234875+0000","last_peered":"2024-02-19T21:38:03.234875+0000","last_clean":"2024-02-19T21:38:03.234875+0000","last_became_active":"2024-02-19T21:32:23.358939+0000","last_became_peered":"2024-02-19T21:32:23.358939+0000","last_unstale":"2024-02-19T21:38:03.234875+0000","last_undegraded":"2024-02-19T21:38:03.234875+0000","last_fullsized":"2024-02-19T21:38:03.234875+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:11.078750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:36:11.078750+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"66'9","reported_seq":120,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.227759+0000","last_change":"2024-02-19T21:36:53.491383+0000","last_active":"2024-02-19T21:38:03.227759+0000","last_peered":"2024-02-19T21:38:03.227759+0000","last_clean":"2024-02-19T21:38:03.227759+0000","last_became_active":"2024-02-19T21:32:25.372106+0000","last_became_peered":"2024-02-19T21:32:25.372106+0000","last_unstale":"2024-02-19T21:38:03.227759+0000","last_undegraded":"2024-02-19T21:38:03.227759+0000","last_fullsized":"2024-02-19T21:38:03.227759+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:36:53.491279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:53.491279+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"141'11270","reported_seq":11324,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:09.889881+0000","last_change":"2024-02-19T21:37:28.803373+0000","last_active":"2024-02-19T21:38:09.889881+0000","last_peered":"2024-02-19T21:38:09.889881+0000","last_clean":"2024-02-19T21:38:09.889881+0000","last_became_active":"2024-02-19T21:35:19.640049+0000","last_became_peered":"2024-02-19T21:35:19.640049+0000","last_unstale":"2024-02-19T21:38:09.889881+0000","last_undegraded":"2024-02-19T21:38:09.889881+0000","last_fullsized":"2024-02-19T21:38:09.889881+0000","mapping_epoch":100,"log_start":"128'6500","ondisk_log_start":"128'6500","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'8846","last_scrub_stamp":"2024-02-19T21:37:28.803214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:28.803214+0000","log_size":4770,"ondisk_log_size":4770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":204341248,"num_objects":3118,"num_object_clones":0,"num_object_copies":9354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3118,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11270,"num_write_kb":460416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":94,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.229194+0000","last_change":"2024-02-19T21:35:07.519633+0000","last_active":"2024-02-19T21:38:03.229194+0000","last_peered":"2024-02-19T21:38:03.229194+0000","last_clean":"2024-02-19T21:38:03.229194+0000","last_became_active":"2024-02-19T21:32:29.376027+0000","last_became_peered":"2024-02-19T21:32:29.376027+0000","last_unstale":"2024-02-19T21:38:03.229194+0000","last_undegraded":"2024-02-19T21:38:03.229194+0000","last_fullsized":"2024-02-19T21:38:03.229194+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:35:07.519531+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"59'2","reported_seq":119,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.223829+0000","last_change":"2024-02-19T21:36:54.561095+0000","last_active":"2024-02-19T21:38:03.223829+0000","last_peered":"2024-02-19T21:38:03.223829+0000","last_clean":"2024-02-19T21:38:03.223829+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:38:03.223829+0000","last_undegraded":"2024-02-19T21:38:03.223829+0000","last_fullsized":"2024-02-19T21:38:03.223829+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-02-19T21:36:54.560988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:36:54.560988+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"83'17","reported_seq":115,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.236818+0000","last_change":"2024-02-19T21:36:56.732539+0000","last_active":"2024-02-19T21:38:03.236818+0000","last_peered":"2024-02-19T21:38:03.236818+0000","last_clean":"2024-02-19T21:38:03.236818+0000","last_became_active":"2024-02-19T21:35:14.515967+0000","last_became_peered":"2024-02-19T21:35:14.515967+0000","last_unstale":"2024-02-19T21:38:03.236818+0000","last_undegraded":"2024-02-19T21:38:03.236818+0000","last_fullsized":"2024-02-19T21:38:03.236818+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'17","last_scrub_stamp":"2024-02-19T21:36:56.732448+0000","last_deep_scrub":"83'17","last_deep_scrub_stamp":"2024-02-19T21:33:43.418450+0000","last_clean_scrub_stamp":"2024-02-19T21:36:56.732448+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":96,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.234791+0000","last_change":"2024-02-19T21:36:02.020363+0000","last_active":"2024-02-19T21:38:03.234791+0000","last_peered":"2024-02-19T21:38:03.234791+0000","last_clean":"2024-02-19T21:38:03.234791+0000","last_became_active":"2024-02-19T21:32:27.367022+0000","last_became_peered":"2024-02-19T21:32:27.367022+0000","last_unstale":"2024-02-19T21:38:03.234791+0000","last_undegraded":"2024-02-19T21:38:03.234791+0000","last_fullsized":"2024-02-19T21:38:03.234791+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:02.020270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:02.020270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1","version":"141'11381","reported_seq":11430,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:09.878122+0000","last_change":"2024-02-19T21:35:20.121166+0000","last_active":"2024-02-19T21:38:09.878122+0000","last_peered":"2024-02-19T21:38:09.878122+0000","last_clean":"2024-02-19T21:38:09.878122+0000","last_became_active":"2024-02-19T21:35:20.120890+0000","last_became_peered":"2024-02-19T21:35:20.120890+0000","last_unstale":"2024-02-19T21:38:09.878122+0000","last_undegraded":"2024-02-19T21:38:09.878122+0000","last_fullsized":"2024-02-19T21:38:09.878122+0000","mapping_epoch":100,"log_start":"128'6600","ondisk_log_start":"128'6600","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:35:18.622399+0000","log_size":4781,"ondisk_log_size":4781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":207814656,"num_objects":3171,"num_object_clones":0,"num_object_copies":9513,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3171,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11381,"num_write_kb":465664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6],"acting":[3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":95,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.226985+0000","last_change":"2024-02-19T21:35:56.316132+0000","last_active":"2024-02-19T21:38:03.226985+0000","last_peered":"2024-02-19T21:38:03.226985+0000","last_clean":"2024-02-19T21:38:03.226985+0000","last_became_active":"2024-02-19T21:32:29.374999+0000","last_became_peered":"2024-02-19T21:32:29.374999+0000","last_unstale":"2024-02-19T21:38:03.226985+0000","last_undegraded":"2024-02-19T21:38:03.226985+0000","last_fullsized":"2024-02-19T21:38:03.226985+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:56.316061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:35:56.316061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":101,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.239313+0000","last_change":"2024-02-19T21:35:14.754539+0000","last_active":"2024-02-19T21:38:03.239313+0000","last_peered":"2024-02-19T21:38:03.239313+0000","last_clean":"2024-02-19T21:38:03.239313+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:38:03.239313+0000","last_undegraded":"2024-02-19T21:38:03.239313+0000","last_fullsized":"2024-02-19T21:38:03.239313+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:14.754474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:35:14.754474+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"66'10","reported_seq":93,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.237056+0000","last_change":"2024-02-19T21:37:14.054990+0000","last_active":"2024-02-19T21:38:03.237056+0000","last_peered":"2024-02-19T21:38:03.237056+0000","last_clean":"2024-02-19T21:38:03.237056+0000","last_became_active":"2024-02-19T21:33:50.752293+0000","last_became_peered":"2024-02-19T21:33:50.752293+0000","last_unstale":"2024-02-19T21:38:03.237056+0000","last_undegraded":"2024-02-19T21:38:03.237056+0000","last_fullsized":"2024-02-19T21:38:03.237056+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:37:14.054904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:14.054904+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":179,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.264337+0000","last_change":"2024-02-19T21:37:17.775208+0000","last_active":"2024-02-19T21:38:06.264337+0000","last_peered":"2024-02-19T21:38:06.264337+0000","last_clean":"2024-02-19T21:38:06.264337+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:38:06.264337+0000","last_undegraded":"2024-02-19T21:38:06.264337+0000","last_fullsized":"2024-02-19T21:38:06.264337+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:37:17.775085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:17.775085+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.7","version":"141'11077","reported_seq":11138,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:09.818440+0000","last_change":"2024-02-19T21:37:32.539892+0000","last_active":"2024-02-19T21:38:09.818440+0000","last_peered":"2024-02-19T21:38:09.818440+0000","last_clean":"2024-02-19T21:38:09.818440+0000","last_became_active":"2024-02-19T21:35:19.639154+0000","last_became_peered":"2024-02-19T21:35:19.639154+0000","last_unstale":"2024-02-19T21:38:09.818440+0000","last_undegraded":"2024-02-19T21:38:09.818440+0000","last_fullsized":"2024-02-19T21:38:09.818440+0000","mapping_epoch":100,"log_start":"117'4900","ondisk_log_start":"117'4900","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'8930","last_scrub_stamp":"2024-02-19T21:37:32.539829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:32.539829+0000","log_size":6177,"ondisk_log_size":6177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":195100672,"num_objects":2977,"num_object_clones":0,"num_object_copies":8931,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2977,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11077,"num_write_kb":449728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":101,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.237228+0000","last_change":"2024-02-19T21:37:18.550903+0000","last_active":"2024-02-19T21:38:03.237228+0000","last_peered":"2024-02-19T21:38:03.237228+0000","last_clean":"2024-02-19T21:38:03.237228+0000","last_became_active":"2024-02-19T21:32:29.372330+0000","last_became_peered":"2024-02-19T21:32:29.372330+0000","last_unstale":"2024-02-19T21:38:03.237228+0000","last_undegraded":"2024-02-19T21:38:03.237228+0000","last_fullsized":"2024-02-19T21:38:03.237228+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:18.550821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:37:18.550821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":105,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.240373+0000","last_change":"2024-02-19T21:36:05.647803+0000","last_active":"2024-02-19T21:38:03.240373+0000","last_peered":"2024-02-19T21:38:03.240373+0000","last_clean":"2024-02-19T21:38:03.240373+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:38:03.240373+0000","last_undegraded":"2024-02-19T21:38:03.240373+0000","last_fullsized":"2024-02-19T21:38:03.240373+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:05.647719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:36:05.647719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"66'28","reported_seq":216,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.261996+0000","last_change":"2024-02-19T21:35:54.882929+0000","last_active":"2024-02-19T21:38:06.261996+0000","last_peered":"2024-02-19T21:38:06.261996+0000","last_clean":"2024-02-19T21:38:06.261996+0000","last_became_active":"2024-02-19T21:32:25.367594+0000","last_became_peered":"2024-02-19T21:32:25.367594+0000","last_unstale":"2024-02-19T21:38:06.261996+0000","last_undegraded":"2024-02-19T21:38:06.261996+0000","last_fullsized":"2024-02-19T21:38:06.261996+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'28","last_scrub_stamp":"2024-02-19T21:35:54.882818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:35:54.882818+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":97,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.227930+0000","last_change":"2024-02-19T21:36:02.282138+0000","last_active":"2024-02-19T21:38:03.227930+0000","last_peered":"2024-02-19T21:38:03.227930+0000","last_clean":"2024-02-19T21:38:03.227930+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:38:03.227930+0000","last_undegraded":"2024-02-19T21:38:03.227930+0000","last_fullsized":"2024-02-19T21:38:03.227930+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:02.282035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:02.282035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"141'11516","reported_seq":11570,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:09.944416+0000","last_change":"2024-02-19T21:37:26.190135+0000","last_active":"2024-02-19T21:38:09.944416+0000","last_peered":"2024-02-19T21:38:09.944416+0000","last_clean":"2024-02-19T21:38:09.944416+0000","last_became_active":"2024-02-19T21:35:20.120258+0000","last_became_peered":"2024-02-19T21:35:20.120258+0000","last_unstale":"2024-02-19T21:38:09.944416+0000","last_undegraded":"2024-02-19T21:38:09.944416+0000","last_fullsized":"2024-02-19T21:38:09.944416+0000","mapping_epoch":100,"log_start":"123'6000","ondisk_log_start":"123'6000","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"132'8838","last_scrub_stamp":"2024-02-19T21:37:26.190030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:26.190030+0000","log_size":5516,"ondisk_log_size":5516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":199098368,"num_objects":3038,"num_object_clones":0,"num_object_copies":9114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3038,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11516,"num_write_kb":465728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":94,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.234017+0000","last_change":"2024-02-19T21:36:08.147110+0000","last_active":"2024-02-19T21:38:03.234017+0000","last_peered":"2024-02-19T21:38:03.234017+0000","last_clean":"2024-02-19T21:38:03.234017+0000","last_became_active":"2024-02-19T21:32:29.597365+0000","last_became_peered":"2024-02-19T21:32:29.597365+0000","last_unstale":"2024-02-19T21:38:03.234017+0000","last_undegraded":"2024-02-19T21:38:03.234017+0000","last_fullsized":"2024-02-19T21:38:03.234017+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:08.146986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:36:08.146986+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"67'5","reported_seq":442,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:08.448247+0000","last_change":"2024-02-19T21:34:54.718563+0000","last_active":"2024-02-19T21:38:08.448247+0000","last_peered":"2024-02-19T21:38:08.448247+0000","last_clean":"2024-02-19T21:38:08.448247+0000","last_became_active":"2024-02-19T21:32:23.354539+0000","last_became_peered":"2024-02-19T21:32:23.354539+0000","last_unstale":"2024-02-19T21:38:08.448247+0000","last_undegraded":"2024-02-19T21:38:08.448247+0000","last_fullsized":"2024-02-19T21:38:08.448247+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5","last_scrub_stamp":"2024-02-19T21:34:54.718482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:34:54.718482+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":338,"num_read_kb":333,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":105,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.234717+0000","last_change":"2024-02-19T21:36:05.032762+0000","last_active":"2024-02-19T21:38:03.234717+0000","last_peered":"2024-02-19T21:38:03.234717+0000","last_clean":"2024-02-19T21:38:03.234717+0000","last_became_active":"2024-02-19T21:32:23.358321+0000","last_became_peered":"2024-02-19T21:32:23.358321+0000","last_unstale":"2024-02-19T21:38:03.234717+0000","last_undegraded":"2024-02-19T21:38:03.234717+0000","last_fullsized":"2024-02-19T21:38:03.234717+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:05.032661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:36:05.032661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"66'13","reported_seq":141,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.240465+0000","last_change":"2024-02-19T21:37:32.806098+0000","last_active":"2024-02-19T21:38:03.240465+0000","last_peered":"2024-02-19T21:38:03.240465+0000","last_clean":"2024-02-19T21:38:03.240465+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:38:03.240465+0000","last_undegraded":"2024-02-19T21:38:03.240465+0000","last_fullsized":"2024-02-19T21:38:03.240465+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'13","last_scrub_stamp":"2024-02-19T21:37:32.805993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:32.805993+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":99,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.238424+0000","last_change":"2024-02-19T21:35:54.189583+0000","last_active":"2024-02-19T21:38:03.238424+0000","last_peered":"2024-02-19T21:38:03.238424+0000","last_clean":"2024-02-19T21:38:03.238424+0000","last_became_active":"2024-02-19T21:32:27.363740+0000","last_became_peered":"2024-02-19T21:32:27.363740+0000","last_unstale":"2024-02-19T21:38:03.238424+0000","last_undegraded":"2024-02-19T21:38:03.238424+0000","last_fullsized":"2024-02-19T21:38:03.238424+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:54.189498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:35:54.189498+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"141'11303","reported_seq":11357,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:09.973720+0000","last_change":"2024-02-19T21:37:01.782606+0000","last_active":"2024-02-19T21:38:09.973720+0000","last_peered":"2024-02-19T21:38:09.973720+0000","last_clean":"2024-02-19T21:38:09.973720+0000","last_became_active":"2024-02-19T21:35:19.637041+0000","last_became_peered":"2024-02-19T21:35:19.637041+0000","last_unstale":"2024-02-19T21:38:09.973720+0000","last_undegraded":"2024-02-19T21:38:09.973720+0000","last_fullsized":"2024-02-19T21:38:09.973720+0000","mapping_epoch":100,"log_start":"122'5800","ondisk_log_start":"122'5800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'7343","last_scrub_stamp":"2024-02-19T21:37:01.782509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:01.782509+0000","log_size":5503,"ondisk_log_size":5503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":200867840,"num_objects":3065,"num_object_clones":0,"num_object_copies":9195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3065,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11303,"num_write_kb":459776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":99,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.241099+0000","last_change":"2024-02-19T21:37:20.804540+0000","last_active":"2024-02-19T21:38:03.241099+0000","last_peered":"2024-02-19T21:38:03.241099+0000","last_clean":"2024-02-19T21:38:03.241099+0000","last_became_active":"2024-02-19T21:32:29.372547+0000","last_became_peered":"2024-02-19T21:32:29.372547+0000","last_unstale":"2024-02-19T21:38:03.241099+0000","last_undegraded":"2024-02-19T21:38:03.241099+0000","last_fullsized":"2024-02-19T21:38:03.241099+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:20.804454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:37:20.804454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":105,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.239067+0000","last_change":"2024-02-19T21:37:13.579453+0000","last_active":"2024-02-19T21:38:03.239067+0000","last_peered":"2024-02-19T21:38:03.239067+0000","last_clean":"2024-02-19T21:38:03.239067+0000","last_became_active":"2024-02-19T21:32:23.356886+0000","last_became_peered":"2024-02-19T21:32:23.356886+0000","last_unstale":"2024-02-19T21:38:03.239067+0000","last_undegraded":"2024-02-19T21:38:03.239067+0000","last_fullsized":"2024-02-19T21:38:03.239067+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:13.579375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:37:13.579375+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":100,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.241649+0000","last_change":"2024-02-19T21:35:57.573076+0000","last_active":"2024-02-19T21:38:03.241649+0000","last_peered":"2024-02-19T21:38:03.241649+0000","last_clean":"2024-02-19T21:38:03.241649+0000","last_became_active":"2024-02-19T21:32:23.361163+0000","last_became_peered":"2024-02-19T21:32:23.361163+0000","last_unstale":"2024-02-19T21:38:03.241649+0000","last_undegraded":"2024-02-19T21:38:03.241649+0000","last_fullsized":"2024-02-19T21:38:03.241649+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:57.573013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:35:57.573013+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":108,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.233816+0000","last_change":"2024-02-19T21:35:18.481101+0000","last_active":"2024-02-19T21:38:03.233816+0000","last_peered":"2024-02-19T21:38:03.233816+0000","last_clean":"2024-02-19T21:38:03.233816+0000","last_became_active":"2024-02-19T21:32:16.878022+0000","last_became_peered":"2024-02-19T21:32:16.878022+0000","last_unstale":"2024-02-19T21:38:03.233816+0000","last_undegraded":"2024-02-19T21:38:03.233816+0000","last_fullsized":"2024-02-19T21:38:03.233816+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:18.480985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:35:18.480985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"66'14","reported_seq":120,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.234680+0000","last_change":"2024-02-19T21:36:01.053309+0000","last_active":"2024-02-19T21:38:03.234680+0000","last_peered":"2024-02-19T21:38:03.234680+0000","last_clean":"2024-02-19T21:38:03.234680+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:38:03.234680+0000","last_undegraded":"2024-02-19T21:38:03.234680+0000","last_fullsized":"2024-02-19T21:38:03.234680+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'14","last_scrub_stamp":"2024-02-19T21:36:01.053232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:01.053232+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":101,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.237665+0000","last_change":"2024-02-19T21:37:07.934832+0000","last_active":"2024-02-19T21:38:03.237665+0000","last_peered":"2024-02-19T21:38:03.237665+0000","last_clean":"2024-02-19T21:38:03.237665+0000","last_became_active":"2024-02-19T21:32:27.373579+0000","last_became_peered":"2024-02-19T21:32:27.373579+0000","last_unstale":"2024-02-19T21:38:03.237665+0000","last_undegraded":"2024-02-19T21:38:03.237665+0000","last_fullsized":"2024-02-19T21:38:03.237665+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:07.934744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:07.934744+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"141'11127","reported_seq":11176,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:09.798232+0000","last_change":"2024-02-19T21:35:19.639373+0000","last_active":"2024-02-19T21:38:09.798232+0000","last_peered":"2024-02-19T21:38:09.798232+0000","last_clean":"2024-02-19T21:38:09.798232+0000","last_became_active":"2024-02-19T21:35:19.639005+0000","last_became_peered":"2024-02-19T21:35:19.639005+0000","last_unstale":"2024-02-19T21:38:09.798232+0000","last_undegraded":"2024-02-19T21:38:09.798232+0000","last_fullsized":"2024-02-19T21:38:09.798232+0000","mapping_epoch":100,"log_start":"126'6200","ondisk_log_start":"126'6200","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:35:18.622399+0000","log_size":4927,"ondisk_log_size":4927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":196673536,"num_objects":3001,"num_object_clones":0,"num_object_copies":9003,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3001,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11127,"num_write_kb":452096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":95,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.239563+0000","last_change":"2024-02-19T21:36:12.016081+0000","last_active":"2024-02-19T21:38:03.239563+0000","last_peered":"2024-02-19T21:38:03.239563+0000","last_clean":"2024-02-19T21:38:03.239563+0000","last_became_active":"2024-02-19T21:32:29.373625+0000","last_became_peered":"2024-02-19T21:32:29.373625+0000","last_unstale":"2024-02-19T21:38:03.239563+0000","last_undegraded":"2024-02-19T21:38:03.239563+0000","last_fullsized":"2024-02-19T21:38:03.239563+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:12.015973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:36:12.015973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":101,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.226969+0000","last_change":"2024-02-19T21:36:00.256569+0000","last_active":"2024-02-19T21:38:03.226969+0000","last_peered":"2024-02-19T21:38:03.226969+0000","last_clean":"2024-02-19T21:38:03.226969+0000","last_became_active":"2024-02-19T21:32:23.359538+0000","last_became_peered":"2024-02-19T21:32:23.359538+0000","last_unstale":"2024-02-19T21:38:03.226969+0000","last_undegraded":"2024-02-19T21:38:03.226969+0000","last_fullsized":"2024-02-19T21:38:03.226969+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:00.256475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:36:00.256475+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":100,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.233736+0000","last_change":"2024-02-19T21:36:05.241479+0000","last_active":"2024-02-19T21:38:03.233736+0000","last_peered":"2024-02-19T21:38:03.233736+0000","last_clean":"2024-02-19T21:38:03.233736+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:38:03.233736+0000","last_undegraded":"2024-02-19T21:38:03.233736+0000","last_fullsized":"2024-02-19T21:38:03.233736+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:05.241389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:36:05.241389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"66'12","reported_seq":142,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.227579+0000","last_change":"2024-02-19T21:35:54.395232+0000","last_active":"2024-02-19T21:38:03.227579+0000","last_peered":"2024-02-19T21:38:03.227579+0000","last_clean":"2024-02-19T21:38:03.227579+0000","last_became_active":"2024-02-19T21:33:50.750727+0000","last_became_peered":"2024-02-19T21:33:50.750727+0000","last_unstale":"2024-02-19T21:38:03.227579+0000","last_undegraded":"2024-02-19T21:38:03.227579+0000","last_fullsized":"2024-02-19T21:38:03.227579+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'12","last_scrub_stamp":"2024-02-19T21:35:54.395138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:35:54.395138+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":96,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.241025+0000","last_change":"2024-02-19T21:36:00.595014+0000","last_active":"2024-02-19T21:38:03.241025+0000","last_peered":"2024-02-19T21:38:03.241025+0000","last_clean":"2024-02-19T21:38:03.241025+0000","last_became_active":"2024-02-19T21:32:27.372460+0000","last_became_peered":"2024-02-19T21:32:27.372460+0000","last_unstale":"2024-02-19T21:38:03.241025+0000","last_undegraded":"2024-02-19T21:38:03.241025+0000","last_fullsized":"2024-02-19T21:38:03.241025+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:00.594849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:00.594849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"141'11308","reported_seq":11357,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:09.759994+0000","last_change":"2024-02-19T21:35:19.638978+0000","last_active":"2024-02-19T21:38:09.759994+0000","last_peered":"2024-02-19T21:38:09.759994+0000","last_clean":"2024-02-19T21:38:09.759994+0000","last_became_active":"2024-02-19T21:35:19.638649+0000","last_became_peered":"2024-02-19T21:35:19.638649+0000","last_unstale":"2024-02-19T21:38:09.759994+0000","last_undegraded":"2024-02-19T21:38:09.759994+0000","last_fullsized":"2024-02-19T21:38:09.759994+0000","mapping_epoch":100,"log_start":"121'5600","ondisk_log_start":"121'5600","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:35:18.622399+0000","log_size":5708,"ondisk_log_size":5708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":200540160,"num_objects":3060,"num_object_clones":0,"num_object_copies":9180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3060,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11308,"num_write_kb":459776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":95,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.237055+0000","last_change":"2024-02-19T21:35:55.839055+0000","last_active":"2024-02-19T21:38:03.237055+0000","last_peered":"2024-02-19T21:38:03.237055+0000","last_clean":"2024-02-19T21:38:03.237055+0000","last_became_active":"2024-02-19T21:32:29.597270+0000","last_became_peered":"2024-02-19T21:32:29.597270+0000","last_unstale":"2024-02-19T21:38:03.237055+0000","last_undegraded":"2024-02-19T21:38:03.237055+0000","last_fullsized":"2024-02-19T21:38:03.237055+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:55.838954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:35:55.838954+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":100,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.234090+0000","last_change":"2024-02-19T21:35:59.218786+0000","last_active":"2024-02-19T21:38:03.234090+0000","last_peered":"2024-02-19T21:38:03.234090+0000","last_clean":"2024-02-19T21:38:03.234090+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:38:03.234090+0000","last_undegraded":"2024-02-19T21:38:03.234090+0000","last_fullsized":"2024-02-19T21:38:03.234090+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:59.218696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:35:59.218696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"83'27","reported_seq":148,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.227096+0000","last_change":"2024-02-19T21:37:13.658855+0000","last_active":"2024-02-19T21:38:03.227096+0000","last_peered":"2024-02-19T21:38:03.227096+0000","last_clean":"2024-02-19T21:38:03.227096+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:38:03.227096+0000","last_undegraded":"2024-02-19T21:38:03.227096+0000","last_fullsized":"2024-02-19T21:38:03.227096+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'27","last_scrub_stamp":"2024-02-19T21:37:13.658740+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:37:13.658740+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":103,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.231432+0000","last_change":"2024-02-19T21:37:05.923317+0000","last_active":"2024-02-19T21:38:03.231432+0000","last_peered":"2024-02-19T21:38:03.231432+0000","last_clean":"2024-02-19T21:38:03.231432+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:38:03.231432+0000","last_undegraded":"2024-02-19T21:38:03.231432+0000","last_fullsized":"2024-02-19T21:38:03.231432+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:05.923212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:37:05.923212+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"141'11545","reported_seq":11594,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:09.895768+0000","last_change":"2024-02-19T21:35:20.120603+0000","last_active":"2024-02-19T21:38:09.895768+0000","last_peered":"2024-02-19T21:38:09.895768+0000","last_clean":"2024-02-19T21:38:09.895768+0000","last_became_active":"2024-02-19T21:35:20.120275+0000","last_became_peered":"2024-02-19T21:35:20.120275+0000","last_unstale":"2024-02-19T21:38:09.895768+0000","last_undegraded":"2024-02-19T21:38:09.895768+0000","last_fullsized":"2024-02-19T21:38:09.895768+0000","mapping_epoch":100,"log_start":"128'6800","ondisk_log_start":"128'6800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:35:18.622399+0000","log_size":4745,"ondisk_log_size":4745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":200605696,"num_objects":3061,"num_object_clones":0,"num_object_copies":9183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3061,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11545,"num_write_kb":467392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4],"acting":[3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":64,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.238977+0000","last_change":"2024-02-19T21:37:05.693047+0000","last_active":"2024-02-19T21:38:03.238977+0000","last_peered":"2024-02-19T21:38:03.238977+0000","last_clean":"2024-02-19T21:38:03.238977+0000","last_became_active":"2024-02-19T21:35:14.514568+0000","last_became_peered":"2024-02-19T21:35:14.514568+0000","last_unstale":"2024-02-19T21:38:03.238977+0000","last_undegraded":"2024-02-19T21:38:03.238977+0000","last_fullsized":"2024-02-19T21:38:03.238977+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:05.692955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:37:05.692955+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":101,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.238159+0000","last_change":"2024-02-19T21:35:20.731723+0000","last_active":"2024-02-19T21:38:03.238159+0000","last_peered":"2024-02-19T21:38:03.238159+0000","last_clean":"2024-02-19T21:38:03.238159+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:38:03.238159+0000","last_undegraded":"2024-02-19T21:38:03.238159+0000","last_fullsized":"2024-02-19T21:38:03.238159+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:20.731658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:20.731658+0000","last_clean_scrub_stamp":"2024-02-19T21:35:20.731658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"66'18","reported_seq":130,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.228203+0000","last_change":"2024-02-19T21:36:05.769352+0000","last_active":"2024-02-19T21:38:03.228203+0000","last_peered":"2024-02-19T21:38:03.228203+0000","last_clean":"2024-02-19T21:38:03.228203+0000","last_became_active":"2024-02-19T21:32:25.372700+0000","last_became_peered":"2024-02-19T21:32:25.372700+0000","last_unstale":"2024-02-19T21:38:03.228203+0000","last_undegraded":"2024-02-19T21:38:03.228203+0000","last_fullsized":"2024-02-19T21:38:03.228203+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'18","last_scrub_stamp":"2024-02-19T21:36:05.769256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:05.769256+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":102,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.223146+0000","last_change":"2024-02-19T21:36:53.600165+0000","last_active":"2024-02-19T21:38:03.223146+0000","last_peered":"2024-02-19T21:38:03.223146+0000","last_clean":"2024-02-19T21:38:03.223146+0000","last_became_active":"2024-02-19T21:32:27.363698+0000","last_became_peered":"2024-02-19T21:32:27.363698+0000","last_unstale":"2024-02-19T21:38:03.223146+0000","last_undegraded":"2024-02-19T21:38:03.223146+0000","last_fullsized":"2024-02-19T21:38:03.223146+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:53.600058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:53.600058+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"141'11330","reported_seq":11379,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:09.903426+0000","last_change":"2024-02-19T21:35:19.640727+0000","last_active":"2024-02-19T21:38:09.903426+0000","last_peered":"2024-02-19T21:38:09.903426+0000","last_clean":"2024-02-19T21:38:09.903426+0000","last_became_active":"2024-02-19T21:35:19.640449+0000","last_became_peered":"2024-02-19T21:35:19.640449+0000","last_unstale":"2024-02-19T21:38:09.903426+0000","last_undegraded":"2024-02-19T21:38:09.903426+0000","last_fullsized":"2024-02-19T21:38:09.903426+0000","mapping_epoch":100,"log_start":"128'6600","ondisk_log_start":"128'6600","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:35:18.622399+0000","log_size":4730,"ondisk_log_size":4730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":204996608,"num_objects":3128,"num_object_clones":0,"num_object_copies":9384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3128,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11330,"num_write_kb":462656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":99,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.235182+0000","last_change":"2024-02-19T21:37:23.993328+0000","last_active":"2024-02-19T21:38:03.235182+0000","last_peered":"2024-02-19T21:38:03.235182+0000","last_clean":"2024-02-19T21:38:03.235182+0000","last_became_active":"2024-02-19T21:32:29.597309+0000","last_became_peered":"2024-02-19T21:32:29.597309+0000","last_unstale":"2024-02-19T21:38:03.235182+0000","last_undegraded":"2024-02-19T21:38:03.235182+0000","last_fullsized":"2024-02-19T21:38:03.235182+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:23.993242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:37:23.993242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":100,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.232203+0000","last_change":"2024-02-19T21:36:04.968027+0000","last_active":"2024-02-19T21:38:03.232203+0000","last_peered":"2024-02-19T21:38:03.232203+0000","last_clean":"2024-02-19T21:38:03.232203+0000","last_became_active":"2024-02-19T21:32:23.354215+0000","last_became_peered":"2024-02-19T21:32:23.354215+0000","last_unstale":"2024-02-19T21:38:03.232203+0000","last_undegraded":"2024-02-19T21:38:03.232203+0000","last_fullsized":"2024-02-19T21:38:03.232203+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:04.967919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:36:04.967919+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"66'14","reported_seq":93,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.240100+0000","last_change":"2024-02-19T21:35:56.625004+0000","last_active":"2024-02-19T21:38:03.240100+0000","last_peered":"2024-02-19T21:38:03.240100+0000","last_clean":"2024-02-19T21:38:03.240100+0000","last_became_active":"2024-02-19T21:35:14.513806+0000","last_became_peered":"2024-02-19T21:35:14.513806+0000","last_unstale":"2024-02-19T21:38:03.240100+0000","last_undegraded":"2024-02-19T21:38:03.240100+0000","last_fullsized":"2024-02-19T21:38:03.240100+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'14","last_scrub_stamp":"2024-02-19T21:35:56.624886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:35:56.624886+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.0","version":"66'8","reported_seq":181,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.252537+0000","last_change":"2024-02-19T21:37:07.618714+0000","last_active":"2024-02-19T21:38:06.252537+0000","last_peered":"2024-02-19T21:38:06.252537+0000","last_clean":"2024-02-19T21:38:06.252537+0000","last_became_active":"2024-02-19T21:32:27.368914+0000","last_became_peered":"2024-02-19T21:32:27.368914+0000","last_unstale":"2024-02-19T21:38:06.252537+0000","last_undegraded":"2024-02-19T21:38:06.252537+0000","last_fullsized":"2024-02-19T21:38:06.252537+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:37:07.618614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:07.618614+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"141'11259","reported_seq":11309,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:09.772141+0000","last_change":"2024-02-19T21:35:19.636335+0000","last_active":"2024-02-19T21:38:09.772141+0000","last_peered":"2024-02-19T21:38:09.772141+0000","last_clean":"2024-02-19T21:38:09.772141+0000","last_became_active":"2024-02-19T21:35:19.635979+0000","last_became_peered":"2024-02-19T21:35:19.635979+0000","last_unstale":"2024-02-19T21:38:09.772141+0000","last_undegraded":"2024-02-19T21:38:09.772141+0000","last_fullsized":"2024-02-19T21:38:09.772141+0000","mapping_epoch":100,"log_start":"118'5100","ondisk_log_start":"118'5100","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:35:18.622399+0000","log_size":6159,"ondisk_log_size":6159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":201850904,"num_objects":3081,"num_object_clones":0,"num_object_copies":9243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3081,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11259,"num_write_kb":458817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":99,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.231158+0000","last_change":"2024-02-19T21:37:35.789557+0000","last_active":"2024-02-19T21:38:03.231158+0000","last_peered":"2024-02-19T21:38:03.231158+0000","last_clean":"2024-02-19T21:38:03.231158+0000","last_became_active":"2024-02-19T21:32:29.597229+0000","last_became_peered":"2024-02-19T21:32:29.597229+0000","last_unstale":"2024-02-19T21:38:03.231158+0000","last_undegraded":"2024-02-19T21:38:03.231158+0000","last_fullsized":"2024-02-19T21:38:03.231158+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:37:35.789463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":101,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.240953+0000","last_change":"2024-02-19T21:37:06.982383+0000","last_active":"2024-02-19T21:38:03.240953+0000","last_peered":"2024-02-19T21:38:03.240953+0000","last_clean":"2024-02-19T21:38:03.240953+0000","last_became_active":"2024-02-19T21:32:27.362497+0000","last_became_peered":"2024-02-19T21:32:27.362497+0000","last_unstale":"2024-02-19T21:38:03.240953+0000","last_undegraded":"2024-02-19T21:38:03.240953+0000","last_fullsized":"2024-02-19T21:38:03.240953+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:06.982285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:06.982285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":107,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.233948+0000","last_change":"2024-02-19T21:35:05.457656+0000","last_active":"2024-02-19T21:38:03.233948+0000","last_peered":"2024-02-19T21:38:03.233948+0000","last_clean":"2024-02-19T21:38:03.233948+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:38:03.233948+0000","last_undegraded":"2024-02-19T21:38:03.233948+0000","last_fullsized":"2024-02-19T21:38:03.233948+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:35:05.457510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:35:05.457510+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"66'11","reported_seq":91,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.231719+0000","last_change":"2024-02-19T21:35:15.027984+0000","last_active":"2024-02-19T21:38:03.231719+0000","last_peered":"2024-02-19T21:38:03.231719+0000","last_clean":"2024-02-19T21:38:03.231719+0000","last_became_active":"2024-02-19T21:35:14.513889+0000","last_became_peered":"2024-02-19T21:35:14.513889+0000","last_unstale":"2024-02-19T21:38:03.231719+0000","last_undegraded":"2024-02-19T21:38:03.231719+0000","last_fullsized":"2024-02-19T21:38:03.231719+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:35:15.027904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:35:15.027904+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.c","version":"141'11419","reported_seq":11468,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:09.807540+0000","last_change":"2024-02-19T21:35:19.639538+0000","last_active":"2024-02-19T21:38:09.807540+0000","last_peered":"2024-02-19T21:38:09.807540+0000","last_clean":"2024-02-19T21:38:09.807540+0000","last_became_active":"2024-02-19T21:35:19.639085+0000","last_became_peered":"2024-02-19T21:35:19.639085+0000","last_unstale":"2024-02-19T21:38:09.807540+0000","last_undegraded":"2024-02-19T21:38:09.807540+0000","last_fullsized":"2024-02-19T21:38:09.807540+0000","mapping_epoch":100,"log_start":"118'5200","ondisk_log_start":"118'5200","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:35:18.622399+0000","log_size":6219,"ondisk_log_size":6219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":198639616,"num_objects":3031,"num_object_clones":0,"num_object_copies":9093,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3031,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11419,"num_write_kb":462400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":99,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.240609+0000","last_change":"2024-02-19T21:36:15.780162+0000","last_active":"2024-02-19T21:38:03.240609+0000","last_peered":"2024-02-19T21:38:03.240609+0000","last_clean":"2024-02-19T21:38:03.240609+0000","last_became_active":"2024-02-19T21:32:29.378462+0000","last_became_peered":"2024-02-19T21:32:29.378462+0000","last_unstale":"2024-02-19T21:38:03.240609+0000","last_undegraded":"2024-02-19T21:38:03.240609+0000","last_fullsized":"2024-02-19T21:38:03.240609+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:15.780083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:36:15.780083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"98'9","reported_seq":117,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.249309+0000","last_change":"2024-02-19T21:35:53.660231+0000","last_active":"2024-02-19T21:38:06.249309+0000","last_peered":"2024-02-19T21:38:06.249309+0000","last_clean":"2024-02-19T21:38:06.249309+0000","last_became_active":"2024-02-19T21:35:14.513802+0000","last_became_peered":"2024-02-19T21:35:14.513802+0000","last_unstale":"2024-02-19T21:38:06.249309+0000","last_undegraded":"2024-02-19T21:38:06.249309+0000","last_fullsized":"2024-02-19T21:38:06.249309+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'9","last_scrub_stamp":"2024-02-19T21:35:53.660117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:35:53.660117+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":106,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.236897+0000","last_change":"2024-02-19T21:36:15.924099+0000","last_active":"2024-02-19T21:38:03.236897+0000","last_peered":"2024-02-19T21:38:03.236897+0000","last_clean":"2024-02-19T21:38:03.236897+0000","last_became_active":"2024-02-19T21:32:23.362738+0000","last_became_peered":"2024-02-19T21:32:23.362738+0000","last_unstale":"2024-02-19T21:38:03.236897+0000","last_undegraded":"2024-02-19T21:38:03.236897+0000","last_fullsized":"2024-02-19T21:38:03.236897+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:15.923991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:36:15.923991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"66'15","reported_seq":129,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.240392+0000","last_change":"2024-02-19T21:36:17.850403+0000","last_active":"2024-02-19T21:38:03.240392+0000","last_peered":"2024-02-19T21:38:03.240392+0000","last_clean":"2024-02-19T21:38:03.240392+0000","last_became_active":"2024-02-19T21:32:25.367511+0000","last_became_peered":"2024-02-19T21:32:25.367511+0000","last_unstale":"2024-02-19T21:38:03.240392+0000","last_undegraded":"2024-02-19T21:38:03.240392+0000","last_fullsized":"2024-02-19T21:38:03.240392+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:36:17.850310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:17.850310+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"141'11425","reported_seq":11479,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:09.898101+0000","last_change":"2024-02-19T21:37:12.025532+0000","last_active":"2024-02-19T21:38:09.898101+0000","last_peered":"2024-02-19T21:38:09.898101+0000","last_clean":"2024-02-19T21:38:09.898101+0000","last_became_active":"2024-02-19T21:35:19.639909+0000","last_became_peered":"2024-02-19T21:35:19.639909+0000","last_unstale":"2024-02-19T21:38:09.898101+0000","last_undegraded":"2024-02-19T21:38:09.898101+0000","last_fullsized":"2024-02-19T21:38:09.898101+0000","mapping_epoch":100,"log_start":"123'5900","ondisk_log_start":"123'5900","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'8025","last_scrub_stamp":"2024-02-19T21:37:12.025401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:12.025401+0000","log_size":5525,"ondisk_log_size":5525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":199163904,"num_objects":3039,"num_object_clones":0,"num_object_copies":9117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3039,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11425,"num_write_kb":462848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":60,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.237950+0000","last_change":"2024-02-19T21:35:18.708652+0000","last_active":"2024-02-19T21:38:03.237950+0000","last_peered":"2024-02-19T21:38:03.237950+0000","last_clean":"2024-02-19T21:38:03.237950+0000","last_became_active":"2024-02-19T21:35:14.515342+0000","last_became_peered":"2024-02-19T21:35:14.515342+0000","last_unstale":"2024-02-19T21:38:03.237950+0000","last_undegraded":"2024-02-19T21:38:03.237950+0000","last_fullsized":"2024-02-19T21:38:03.237950+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:18.708535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:35:18.708535+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"83'9","reported_seq":179,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.263525+0000","last_change":"2024-02-19T21:37:16.989938+0000","last_active":"2024-02-19T21:38:06.263525+0000","last_peered":"2024-02-19T21:38:06.263525+0000","last_clean":"2024-02-19T21:38:06.263525+0000","last_became_active":"2024-02-19T21:32:27.363859+0000","last_became_peered":"2024-02-19T21:32:27.363859+0000","last_unstale":"2024-02-19T21:38:06.263525+0000","last_undegraded":"2024-02-19T21:38:06.263525+0000","last_fullsized":"2024-02-19T21:38:06.263525+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'9","last_scrub_stamp":"2024-02-19T21:37:16.989836+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:37:16.989836+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":101,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.237525+0000","last_change":"2024-02-19T21:35:04.768053+0000","last_active":"2024-02-19T21:38:03.237525+0000","last_peered":"2024-02-19T21:38:03.237525+0000","last_clean":"2024-02-19T21:38:03.237525+0000","last_became_active":"2024-02-19T21:32:23.363155+0000","last_became_peered":"2024-02-19T21:32:23.363155+0000","last_unstale":"2024-02-19T21:38:03.237525+0000","last_undegraded":"2024-02-19T21:38:03.237525+0000","last_fullsized":"2024-02-19T21:38:03.237525+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:35:04.767979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"66'10","reported_seq":87,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.240184+0000","last_change":"2024-02-19T21:37:22.544888+0000","last_active":"2024-02-19T21:38:03.240184+0000","last_peered":"2024-02-19T21:38:03.240184+0000","last_clean":"2024-02-19T21:38:03.240184+0000","last_became_active":"2024-02-19T21:35:14.514968+0000","last_became_peered":"2024-02-19T21:35:14.514968+0000","last_unstale":"2024-02-19T21:38:03.240184+0000","last_undegraded":"2024-02-19T21:38:03.240184+0000","last_fullsized":"2024-02-19T21:38:03.240184+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:37:22.544818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:22.544818+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6],"acting":[3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"141'11171","reported_seq":11227,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:09.834953+0000","last_change":"2024-02-19T21:37:05.416082+0000","last_active":"2024-02-19T21:38:09.834953+0000","last_peered":"2024-02-19T21:38:09.834953+0000","last_clean":"2024-02-19T21:38:09.834953+0000","last_became_active":"2024-02-19T21:35:19.638981+0000","last_became_peered":"2024-02-19T21:35:19.638981+0000","last_unstale":"2024-02-19T21:38:09.834953+0000","last_undegraded":"2024-02-19T21:38:09.834953+0000","last_fullsized":"2024-02-19T21:38:09.834953+0000","mapping_epoch":100,"log_start":"115'4600","ondisk_log_start":"115'4600","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'7433","last_scrub_stamp":"2024-02-19T21:37:05.415974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:05.415974+0000","log_size":6571,"ondisk_log_size":6571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":194969600,"num_objects":2975,"num_object_clones":0,"num_object_copies":8925,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2975,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11171,"num_write_kb":452672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":99,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.239448+0000","last_change":"2024-02-19T21:36:57.989524+0000","last_active":"2024-02-19T21:38:03.239448+0000","last_peered":"2024-02-19T21:38:03.239448+0000","last_clean":"2024-02-19T21:38:03.239448+0000","last_became_active":"2024-02-19T21:32:29.371946+0000","last_became_peered":"2024-02-19T21:32:29.371946+0000","last_unstale":"2024-02-19T21:38:03.239448+0000","last_undegraded":"2024-02-19T21:38:03.239448+0000","last_fullsized":"2024-02-19T21:38:03.239448+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:57.989420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:36:57.989420+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":97,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.239511+0000","last_change":"2024-02-19T21:35:58.886991+0000","last_active":"2024-02-19T21:38:03.239511+0000","last_peered":"2024-02-19T21:38:03.239511+0000","last_clean":"2024-02-19T21:38:03.239511+0000","last_became_active":"2024-02-19T21:32:27.369452+0000","last_became_peered":"2024-02-19T21:32:27.369452+0000","last_unstale":"2024-02-19T21:38:03.239511+0000","last_undegraded":"2024-02-19T21:38:03.239511+0000","last_fullsized":"2024-02-19T21:38:03.239511+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:58.886937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:35:58.886937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":107,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.234905+0000","last_change":"2024-02-19T21:37:18.042043+0000","last_active":"2024-02-19T21:38:03.234905+0000","last_peered":"2024-02-19T21:38:03.234905+0000","last_clean":"2024-02-19T21:38:03.234905+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:38:03.234905+0000","last_undegraded":"2024-02-19T21:38:03.234905+0000","last_fullsized":"2024-02-19T21:38:03.234905+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:18.041939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:37:18.041939+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"66'17","reported_seq":100,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.238730+0000","last_change":"2024-02-19T21:36:09.065900+0000","last_active":"2024-02-19T21:38:03.238730+0000","last_peered":"2024-02-19T21:38:03.238730+0000","last_clean":"2024-02-19T21:38:03.238730+0000","last_became_active":"2024-02-19T21:35:14.516588+0000","last_became_peered":"2024-02-19T21:35:14.516588+0000","last_unstale":"2024-02-19T21:38:03.238730+0000","last_undegraded":"2024-02-19T21:38:03.238730+0000","last_fullsized":"2024-02-19T21:38:03.238730+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'17","last_scrub_stamp":"2024-02-19T21:36:09.065795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:09.065795+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"141'11021","reported_seq":11073,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:09.962924+0000","last_change":"2024-02-19T21:37:17.375432+0000","last_active":"2024-02-19T21:38:09.962924+0000","last_peered":"2024-02-19T21:38:09.962924+0000","last_clean":"2024-02-19T21:38:09.962924+0000","last_became_active":"2024-02-19T21:35:20.121957+0000","last_became_peered":"2024-02-19T21:35:20.121957+0000","last_unstale":"2024-02-19T21:38:09.962924+0000","last_undegraded":"2024-02-19T21:38:09.962924+0000","last_fullsized":"2024-02-19T21:38:09.962924+0000","mapping_epoch":100,"log_start":"122'5500","ondisk_log_start":"122'5500","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"131'7984","last_scrub_stamp":"2024-02-19T21:37:17.375364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:17.375364+0000","log_size":5521,"ondisk_log_size":5521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":192872448,"num_objects":2943,"num_object_clones":0,"num_object_copies":8829,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2943,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11021,"num_write_kb":446848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":99,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.233653+0000","last_change":"2024-02-19T21:37:29.936229+0000","last_active":"2024-02-19T21:38:03.233653+0000","last_peered":"2024-02-19T21:38:03.233653+0000","last_clean":"2024-02-19T21:38:03.233653+0000","last_became_active":"2024-02-19T21:32:29.373442+0000","last_became_peered":"2024-02-19T21:32:29.373442+0000","last_unstale":"2024-02-19T21:38:03.233653+0000","last_undegraded":"2024-02-19T21:38:03.233653+0000","last_fullsized":"2024-02-19T21:38:03.233653+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:37:29.936139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":101,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.235493+0000","last_change":"2024-02-19T21:36:57.004075+0000","last_active":"2024-02-19T21:38:03.235493+0000","last_peered":"2024-02-19T21:38:03.235493+0000","last_clean":"2024-02-19T21:38:03.235493+0000","last_became_active":"2024-02-19T21:32:27.369020+0000","last_became_peered":"2024-02-19T21:32:27.369020+0000","last_unstale":"2024-02-19T21:38:03.235493+0000","last_undegraded":"2024-02-19T21:38:03.235493+0000","last_fullsized":"2024-02-19T21:38:03.235493+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:57.003986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:46.372184+0000","last_clean_scrub_stamp":"2024-02-19T21:36:57.003986+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"59'1","reported_seq":111,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.238404+0000","last_change":"2024-02-19T21:37:18.928676+0000","last_active":"2024-02-19T21:38:03.238404+0000","last_peered":"2024-02-19T21:38:03.238404+0000","last_clean":"2024-02-19T21:38:03.238404+0000","last_became_active":"2024-02-19T21:32:23.359474+0000","last_became_peered":"2024-02-19T21:32:23.359474+0000","last_unstale":"2024-02-19T21:38:03.238404+0000","last_undegraded":"2024-02-19T21:38:03.238404+0000","last_fullsized":"2024-02-19T21:38:03.238404+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:37:18.928610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:37:18.928610+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"115'28","reported_seq":143,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.231300+0000","last_change":"2024-02-19T21:36:09.031773+0000","last_active":"2024-02-19T21:38:03.231300+0000","last_peered":"2024-02-19T21:38:03.231300+0000","last_clean":"2024-02-19T21:38:03.231300+0000","last_became_active":"2024-02-19T21:32:25.372284+0000","last_became_peered":"2024-02-19T21:32:25.372284+0000","last_unstale":"2024-02-19T21:38:03.231300+0000","last_undegraded":"2024-02-19T21:38:03.231300+0000","last_fullsized":"2024-02-19T21:38:03.231300+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'28","last_scrub_stamp":"2024-02-19T21:36:09.031674+0000","last_deep_scrub":"115'28","last_deep_scrub_stamp":"2024-02-19T21:36:09.031674+0000","last_clean_scrub_stamp":"2024-02-19T21:36:09.031674+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.8","version":"141'11222","reported_seq":11274,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:09.827843+0000","last_change":"2024-02-19T21:37:38.382887+0000","last_active":"2024-02-19T21:38:09.827843+0000","last_peered":"2024-02-19T21:38:09.827843+0000","last_clean":"2024-02-19T21:38:09.827843+0000","last_became_active":"2024-02-19T21:35:20.120284+0000","last_became_peered":"2024-02-19T21:35:20.120284+0000","last_unstale":"2024-02-19T21:38:09.827843+0000","last_undegraded":"2024-02-19T21:38:09.827843+0000","last_fullsized":"2024-02-19T21:38:09.827843+0000","mapping_epoch":100,"log_start":"116'4700","ondisk_log_start":"116'4700","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:35:18.622399+0000","log_size":6522,"ondisk_log_size":6522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":199098368,"num_objects":3038,"num_object_clones":0,"num_object_copies":9114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3038,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11222,"num_write_kb":456320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4],"acting":[2,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":100,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.227177+0000","last_change":"2024-02-19T21:36:55.508810+0000","last_active":"2024-02-19T21:38:03.227177+0000","last_peered":"2024-02-19T21:38:03.227177+0000","last_clean":"2024-02-19T21:38:03.227177+0000","last_became_active":"2024-02-19T21:32:29.375689+0000","last_became_peered":"2024-02-19T21:32:29.375689+0000","last_unstale":"2024-02-19T21:38:03.227177+0000","last_undegraded":"2024-02-19T21:38:03.227177+0000","last_fullsized":"2024-02-19T21:38:03.227177+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:55.508708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:36:55.508708+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":101,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.236689+0000","last_change":"2024-02-19T21:36:07.058840+0000","last_active":"2024-02-19T21:38:03.236689+0000","last_peered":"2024-02-19T21:38:03.236689+0000","last_clean":"2024-02-19T21:38:03.236689+0000","last_became_active":"2024-02-19T21:32:27.361539+0000","last_became_peered":"2024-02-19T21:32:27.361539+0000","last_unstale":"2024-02-19T21:38:03.236689+0000","last_undegraded":"2024-02-19T21:38:03.236689+0000","last_fullsized":"2024-02-19T21:38:03.236689+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:07.058748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:07.058748+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":106,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.239129+0000","last_change":"2024-02-19T21:37:36.883246+0000","last_active":"2024-02-19T21:38:03.239129+0000","last_peered":"2024-02-19T21:38:03.239129+0000","last_clean":"2024-02-19T21:38:03.239129+0000","last_became_active":"2024-02-19T21:32:23.357438+0000","last_became_peered":"2024-02-19T21:32:23.357438+0000","last_unstale":"2024-02-19T21:38:03.239129+0000","last_undegraded":"2024-02-19T21:38:03.239129+0000","last_fullsized":"2024-02-19T21:38:03.239129+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:36.883151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:37:36.883151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"66'9","reported_seq":120,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.227203+0000","last_change":"2024-02-19T21:36:56.503874+0000","last_active":"2024-02-19T21:38:03.227203+0000","last_peered":"2024-02-19T21:38:03.227203+0000","last_clean":"2024-02-19T21:38:03.227203+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:38:03.227203+0000","last_undegraded":"2024-02-19T21:38:03.227203+0000","last_fullsized":"2024-02-19T21:38:03.227203+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:36:56.503779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:56.503779+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"141'11241","reported_seq":11290,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:09.796125+0000","last_change":"2024-02-19T21:35:19.637187+0000","last_active":"2024-02-19T21:38:09.796125+0000","last_peered":"2024-02-19T21:38:09.796125+0000","last_clean":"2024-02-19T21:38:09.796125+0000","last_became_active":"2024-02-19T21:35:19.636837+0000","last_became_peered":"2024-02-19T21:35:19.636837+0000","last_unstale":"2024-02-19T21:38:09.796125+0000","last_undegraded":"2024-02-19T21:38:09.796125+0000","last_fullsized":"2024-02-19T21:38:09.796125+0000","mapping_epoch":100,"log_start":"125'6100","ondisk_log_start":"125'6100","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:35:18.622399+0000","log_size":5141,"ondisk_log_size":5141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":204668928,"num_objects":3123,"num_object_clones":0,"num_object_copies":9369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11241,"num_write_kb":459648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":99,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.240299+0000","last_change":"2024-02-19T21:36:14.779507+0000","last_active":"2024-02-19T21:38:03.240299+0000","last_peered":"2024-02-19T21:38:03.240299+0000","last_clean":"2024-02-19T21:38:03.240299+0000","last_became_active":"2024-02-19T21:32:29.597248+0000","last_became_peered":"2024-02-19T21:32:29.597248+0000","last_unstale":"2024-02-19T21:38:03.240299+0000","last_undegraded":"2024-02-19T21:38:03.240299+0000","last_fullsized":"2024-02-19T21:38:03.240299+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:36:14.779443+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":105,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.238344+0000","last_change":"2024-02-19T21:37:33.010649+0000","last_active":"2024-02-19T21:38:03.238344+0000","last_peered":"2024-02-19T21:38:03.238344+0000","last_clean":"2024-02-19T21:38:03.238344+0000","last_became_active":"2024-02-19T21:32:23.357486+0000","last_became_peered":"2024-02-19T21:32:23.357486+0000","last_unstale":"2024-02-19T21:38:03.238344+0000","last_undegraded":"2024-02-19T21:38:03.238344+0000","last_fullsized":"2024-02-19T21:38:03.238344+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:33.010549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:33.010549+0000","last_clean_scrub_stamp":"2024-02-19T21:37:33.010549+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"66'15","reported_seq":130,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-02-19T21:38:03.240032+0000","last_change":"2024-02-19T21:37:05.934106+0000","last_active":"2024-02-19T21:38:03.240032+0000","last_peered":"2024-02-19T21:38:03.240032+0000","last_clean":"2024-02-19T21:38:03.240032+0000","last_became_active":"2024-02-19T21:32:25.372170+0000","last_became_peered":"2024-02-19T21:32:25.372170+0000","last_unstale":"2024-02-19T21:38:03.240032+0000","last_undegraded":"2024-02-19T21:38:03.240032+0000","last_fullsized":"2024-02-19T21:38:03.240032+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:37:05.934032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:05.934032+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"66'8","reported_seq":178,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.253910+0000","last_change":"2024-02-19T21:37:27.997824+0000","last_active":"2024-02-19T21:38:06.253910+0000","last_peered":"2024-02-19T21:38:06.253910+0000","last_clean":"2024-02-19T21:38:06.253910+0000","last_became_active":"2024-02-19T21:32:27.369840+0000","last_became_peered":"2024-02-19T21:32:27.369840+0000","last_unstale":"2024-02-19T21:38:06.253910+0000","last_undegraded":"2024-02-19T21:38:06.253910+0000","last_fullsized":"2024-02-19T21:38:06.253910+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:37:27.997724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:27.997724+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":3201302552,"num_objects":48849,"num_object_clones":0,"num_object_copies":146547,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48849,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":180615,"num_write_kb":7342785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9607065600,"data_stored":9607053384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88515,"ondisk_log_size":88515,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":3},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":338,"num_read_kb":333,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":693,"num_read_kb":450,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":432,"ondisk_log_size":432,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":66,"ondisk_log_size":66,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201352,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1279332,"kb_used_data":973916,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":92465820,"statfs":{"total":95995035648,"available":94684999680,"internally_reserved":0,"allocated":997289984,"data_stored":996981876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:37:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":0.75600000000000001,"15min":0.61699999999999999},"min":{"1min":0.249,"5min":0.219,"15min":0.219},"max":{"1min":4.9429999999999996,"5min":4.9429999999999996,"15min":4.9429999999999996},"last":1.9430000000000001},{"interface":"front","average":{"1min":2.0009999999999999,"5min":1.026,"15min":0.70599999999999996},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":5.694,"5min":5.694,"15min":5.694},"last":0.872}]},{"osd":1,"last update":"Mon Feb 19 21:37:21 2024","interfaces":[{"interface":"back","average":{"1min":2.5830000000000002,"5min":1.052,"15min":0.69599999999999995},"min":{"1min":0.27200000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":9.1639999999999997,"5min":9.1639999999999997,"15min":9.1639999999999997},"last":0.26700000000000002},{"interface":"front","average":{"1min":1.9970000000000001,"5min":0.93600000000000005,"15min":0.67400000000000004},"min":{"1min":0.28899999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":5.3639999999999999,"5min":7.2930000000000001,"15min":7.2930000000000001},"last":0.92200000000000004}]},{"osd":2,"last update":"Mon Feb 19 21:37:21 2024","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":0.88500000000000001,"15min":0.65200000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.8250000000000002,"5min":3.0779999999999998,"15min":3.0779999999999998},"last":0.38800000000000001},{"interface":"front","average":{"1min":2.1099999999999999,"5min":0.94099999999999995,"15min":0.66900000000000004},"min":{"1min":0.312,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":8.3409999999999993,"5min":8.3409999999999993,"15min":8.3409999999999993},"last":0.39400000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:37:21 2024","interfaces":[{"interface":"back","average":{"1min":3.25,"5min":1.2889999999999999,"15min":0.79300000000000004},"min":{"1min":0.29799999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":31.559000000000001,"5min":31.559000000000001,"15min":31.559000000000001},"last":5.1920000000000002},{"interface":"front","average":{"1min":3.9449999999999998,"5min":1.3220000000000001,"15min":0.79500000000000004},"min":{"1min":0.34000000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":30.812999999999999,"5min":30.812999999999999,"15min":30.812999999999999},"last":3.2799999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.53200000000000003,"15min":0.48599999999999999},"min":{"1min":0.26100000000000001,"5min":0.249,"15min":0.249},"max":{"1min":3.52,"5min":3.52,"15min":3.52},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.53800000000000003,"15min":0.496},"min":{"1min":0.308,"5min":0.245,"15min":0.245},"max":{"1min":3.6480000000000001,"5min":3.6480000000000001,"15min":3.6480000000000001},"last":0.32700000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.57399999999999995,"15min":0.63800000000000001},"min":{"1min":0.307,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.2130000000000001,"5min":4.6390000000000002,"15min":4.6390000000000002},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.65100000000000002,"15min":0.53500000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":3.4809999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":0.88700000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.65500000000000003,"15min":0.56499999999999995},"min":{"1min":0.32100000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":3.6099999999999999,"5min":3.6099999999999999,"15min":3.6099999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.70499999999999996,"15min":0.86799999999999999},"min":{"1min":0.35599999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":3.6800000000000002,"5min":8.8030000000000008,"15min":8.8030000000000008},"last":0.495}]}]},{"osd":6,"up_from":47,"seq":201863462991,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1295440,"kb_used_data":994120,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":92449712,"statfs":{"total":95995035648,"available":94668505088,"internally_reserved":0,"allocated":1017978880,"data_stored":1017690098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:37:58 2024","interfaces":[{"interface":"back","average":{"1min":1.9830000000000001,"5min":1.1499999999999999,"15min":0.70599999999999996},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":5.7919999999999998,"5min":9.0109999999999992,"15min":9.0109999999999992},"last":1.4119999999999999},{"interface":"front","average":{"1min":2.6120000000000001,"5min":1.302,"15min":0.752},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":13.973000000000001,"5min":13.973000000000001,"15min":13.973000000000001},"last":1.7390000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:37:58 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.1319999999999999,"15min":0.71099999999999997},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":3.3330000000000002,"5min":12.574999999999999,"15min":12.574999999999999},"last":0.379},{"interface":"front","average":{"1min":2.2229999999999999,"5min":1.085,"15min":0.67500000000000004},"min":{"1min":0.35299999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":6.4020000000000001,"5min":6.4020000000000001,"15min":6.4020000000000001},"last":2.7410000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:37:58 2024","interfaces":[{"interface":"back","average":{"1min":2.1869999999999998,"5min":1.1060000000000001,"15min":0.70399999999999996},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":8.1379999999999999,"5min":8.1379999999999999,"15min":8.1379999999999999},"last":0.499},{"interface":"front","average":{"1min":2.0059999999999998,"5min":1.198,"15min":0.70999999999999996},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":5.782,"5min":18.068000000000001,"15min":18.068000000000001},"last":2.6749999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:37:58 2024","interfaces":[{"interface":"back","average":{"1min":2.3370000000000002,"5min":1.321,"15min":0.77700000000000002},"min":{"1min":0.28999999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":8.2949999999999999,"5min":8.9890000000000008,"15min":8.9890000000000008},"last":0.35299999999999998},{"interface":"front","average":{"1min":2.7290000000000001,"5min":1.4139999999999999,"15min":0.79500000000000004},"min":{"1min":0.33700000000000002,"5min":0.246,"15min":0.246},"max":{"1min":19.632999999999999,"5min":19.632999999999999,"15min":19.632999999999999},"last":0.53000000000000003}]},{"osd":4,"last update":"Mon Feb 19 21:37:58 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.61399999999999999,"15min":0.45700000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":4.0359999999999996,"5min":4.0359999999999996,"15min":4.0359999999999996},"last":1.6890000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.57399999999999995,"15min":0.46000000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":2.9180000000000001,"5min":2.9180000000000001,"15min":2.9180000000000001},"last":0.40000000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:37:58 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":0.63700000000000001,"15min":0.48799999999999999},"min":{"1min":0.27700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":5.6379999999999999,"5min":5.6379999999999999,"15min":5.6379999999999999},"last":1.716},{"interface":"front","average":{"1min":1.1870000000000001,"5min":0.68700000000000006,"15min":0.496},"min":{"1min":0.318,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":5.8479999999999999,"5min":5.8479999999999999,"15min":5.8479999999999999},"last":0.44}]},{"osd":7,"last update":"Mon Feb 19 21:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59299999999999997,"15min":0.51700000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":4.3639999999999999,"5min":4.3639999999999999,"15min":4.3639999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.67100000000000004,"15min":0.58699999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":4.3840000000000003,"5min":4.3840000000000003,"15min":4.3840000000000003},"last":0.46400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574953,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1492488,"kb_used_data":1195264,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":92252664,"statfs":{"total":95995035648,"available":94466727936,"internally_reserved":0,"allocated":1223950336,"data_stored":1223606290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:37:48 2024","interfaces":[{"interface":"back","average":{"1min":2.5139999999999998,"5min":1.343,"15min":0.67900000000000005},"min":{"1min":0.222,"5min":0.221,"15min":0.193},"max":{"1min":8.25,"5min":11.372,"15min":11.372},"last":3.1699999999999999},{"interface":"front","average":{"1min":3.266,"5min":1.2549999999999999,"15min":0.64900000000000002},"min":{"1min":0.29399999999999998,"5min":0.185,"15min":0.185},"max":{"1min":10.121,"5min":10.121,"15min":10.121},"last":0.39500000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:37:21 2024","interfaces":[{"interface":"back","average":{"1min":4.0359999999999996,"5min":1.544,"15min":0.76000000000000001},"min":{"1min":0.23400000000000001,"5min":0.22,"15min":0.22},"max":{"1min":8.9290000000000003,"5min":11.826000000000001,"15min":11.826000000000001},"last":1.804},{"interface":"front","average":{"1min":4.2290000000000001,"5min":1.627,"15min":0.80400000000000005},"min":{"1min":0.41499999999999998,"5min":0.248,"15min":0.248},"max":{"1min":12.26,"5min":12.26,"15min":12.26},"last":0.46999999999999997}]},{"osd":3,"last update":"Mon Feb 19 21:37:48 2024","interfaces":[{"interface":"back","average":{"1min":3.4769999999999999,"5min":1.6359999999999999,"15min":0.83699999999999997},"min":{"1min":0.308,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":10.923,"5min":10.923,"15min":10.923},"last":0.35999999999999999},{"interface":"front","average":{"1min":2.1480000000000001,"5min":1.2090000000000001,"15min":0.68999999999999995},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":8.7929999999999993,"5min":11.413,"15min":11.413},"last":0.55300000000000005}]},{"osd":4,"last update":"Mon Feb 19 21:38:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.86699999999999999,"15min":0.70199999999999996},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":6.0380000000000003,"5min":7.3330000000000002,"15min":7.3330000000000002},"last":0.45800000000000002},{"interface":"front","average":{"1min":2.0259999999999998,"5min":1.272,"15min":0.83699999999999997},"min":{"1min":0.33600000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":7.0919999999999996,"5min":10.51,"15min":10.51},"last":0.90200000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:37:31 2024","interfaces":[{"interface":"back","average":{"1min":1.8859999999999999,"5min":1.0469999999999999,"15min":0.73899999999999999},"min":{"1min":0.31,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":7.109,"5min":10.458,"15min":10.458},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.8280000000000001,"5min":1.0029999999999999,"15min":0.74299999999999999},"min":{"1min":0.374,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":7.6950000000000003,"5min":7.6950000000000003,"15min":7.6950000000000003},"last":1.1120000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:38:02 2024","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":0.93500000000000005,"15min":0.71799999999999997},"min":{"1min":0.36399999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":5.9939999999999998,"5min":7.375,"15min":7.375},"last":0.42699999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.0980000000000001,"15min":0.78300000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":7.7389999999999999,"5min":7.7389999999999999,"15min":7.7389999999999999},"last":1.143}]},{"osd":7,"last update":"Mon Feb 19 21:37:26 2024","interfaces":[{"interface":"back","average":{"1min":2.3050000000000002,"5min":1.28,"15min":0.81299999999999994},"min":{"1min":0.42899999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":7.718,"5min":10.638999999999999,"15min":10.638999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":1.8,"5min":0.96599999999999997,"15min":0.73099999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":7.4109999999999996,"5min":7.4109999999999996,"15min":7.4109999999999996},"last":0.48399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738479,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1872492,"kb_used_data":1571172,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":91872660,"statfs":{"total":95995035648,"available":94077603840,"internally_reserved":0,"allocated":1608880128,"data_stored":1608563907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,1,4,0,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:37:55 2024","interfaces":[{"interface":"back","average":{"1min":2.5819999999999999,"5min":1.079,"15min":0.56399999999999995},"min":{"1min":0.20300000000000001,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":10.959,"5min":10.959,"15min":10.959},"last":0.33400000000000002},{"interface":"front","average":{"1min":3.702,"5min":1.6639999999999999,"15min":0.76900000000000002},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":12.398,"5min":12.398,"15min":12.398},"last":13.422000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:37:23 2024","interfaces":[{"interface":"back","average":{"1min":2.3300000000000001,"5min":1.1319999999999999,"15min":0.62},"min":{"1min":0.31,"5min":0.255,"15min":0.23999999999999999},"max":{"1min":10.996,"5min":10.996,"15min":10.996},"last":3.359},{"interface":"front","average":{"1min":3.4380000000000002,"5min":1.502,"15min":0.75},"min":{"1min":0.318,"5min":0.25,"15min":0.24299999999999999},"max":{"1min":12.154999999999999,"5min":12.154999999999999,"15min":12.154999999999999},"last":7.0359999999999996}]},{"osd":3,"last update":"Mon Feb 19 21:37:38 2024","interfaces":[{"interface":"back","average":{"1min":4.8230000000000004,"5min":1.798,"15min":0.86799999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":14.507999999999999,"5min":14.507999999999999,"15min":14.507999999999999},"last":2.8029999999999999},{"interface":"front","average":{"1min":2.956,"5min":1.532,"15min":0.80800000000000005},"min":{"1min":0.27400000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":8.6699999999999999,"5min":11.103999999999999,"15min":11.103999999999999},"last":0.439}]},{"osd":4,"last update":"Mon Feb 19 21:37:11 2024","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":0.876,"15min":0.68500000000000005},"min":{"1min":0.30099999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":4.7009999999999996,"5min":5.9139999999999997,"15min":5.9139999999999997},"last":2.7130000000000001},{"interface":"front","average":{"1min":1.3440000000000001,"5min":0.84299999999999997,"15min":0.68999999999999995},"min":{"1min":0.30099999999999999,"5min":0.255,"15min":0.255},"max":{"1min":4.9560000000000004,"5min":5.6100000000000003,"15min":5.6100000000000003},"last":0.40000000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:37:38 2024","interfaces":[{"interface":"back","average":{"1min":2.5270000000000001,"5min":1.294,"15min":0.85299999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":9.7479999999999993,"5min":9.7479999999999993,"15min":9.7479999999999993},"last":7.0949999999999998},{"interface":"front","average":{"1min":1.8819999999999999,"5min":1.044,"15min":0.76800000000000002},"min":{"1min":0.33300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":9.8550000000000004,"5min":9.8550000000000004,"15min":9.8550000000000004},"last":2.7799999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:37:59 2024","interfaces":[{"interface":"back","average":{"1min":4.1139999999999999,"5min":1.448,"15min":0.91000000000000003},"min":{"1min":0.437,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":42.777000000000001,"5min":42.777000000000001,"15min":42.777000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":2.6030000000000002,"5min":1.3660000000000001,"15min":0.85899999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":9.7629999999999999,"5min":9.7629999999999999,"15min":9.7629999999999999},"last":7.0720000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:37:23 2024","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":0.92000000000000004,"15min":0.70999999999999996},"min":{"1min":0.35699999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":6.2859999999999996,"5min":6.2859999999999996,"15min":6.2859999999999996},"last":2.7570000000000001},{"interface":"front","average":{"1min":1.339,"5min":1.0009999999999999,"15min":0.76800000000000002},"min":{"1min":0.45000000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.923,"5min":8.8469999999999995,"15min":8.8469999999999995},"last":0.38}]}]},{"osd":2,"up_from":18,"seq":77309411428,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1499348,"kb_used_data":1189836,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":92245804,"statfs":{"total":95995035648,"available":94459703296,"internally_reserved":0,"allocated":1218392064,"data_stored":1218099763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:37:24 2024","interfaces":[{"interface":"back","average":{"1min":5.0060000000000002,"5min":1.7909999999999999,"15min":0.82899999999999996},"min":{"1min":0.219,"5min":0.183,"15min":0.183},"max":{"1min":16.367999999999999,"5min":17.853000000000002,"15min":17.853000000000002},"last":3.7909999999999999},{"interface":"front","average":{"1min":5.585,"5min":1.845,"15min":0.89000000000000001},"min":{"1min":0.251,"5min":0.193,"15min":0.193},"max":{"1min":17.847999999999999,"5min":17.847999999999999,"15min":17.847999999999999},"last":1.6359999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:37:24 2024","interfaces":[{"interface":"back","average":{"1min":2.4860000000000002,"5min":1.0940000000000001,"15min":0.61199999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.20300000000000001},"max":{"1min":10.988,"5min":13.528,"15min":13.528},"last":3.8420000000000001},{"interface":"front","average":{"1min":3.073,"5min":1.0800000000000001,"15min":0.61899999999999999},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":18.113,"5min":18.113,"15min":18.113},"last":4.0410000000000004}]},{"osd":3,"last update":"Mon Feb 19 21:37:49 2024","interfaces":[{"interface":"back","average":{"1min":4.9610000000000003,"5min":2.1930000000000001,"15min":1.002},"min":{"1min":0.254,"5min":0.185,"15min":0.185},"max":{"1min":19.751000000000001,"5min":19.751000000000001,"15min":19.751000000000001},"last":4.1429999999999998},{"interface":"front","average":{"1min":2.7909999999999999,"5min":1.3899999999999999,"15min":0.74099999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":18.137,"5min":18.137,"15min":18.137},"last":1.7450000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:37:11 2024","interfaces":[{"interface":"back","average":{"1min":2.0270000000000001,"5min":0.878,"15min":0.67900000000000005},"min":{"1min":0.28799999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":18.088000000000001,"5min":18.088000000000001,"15min":18.088000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":2.2789999999999999,"5min":1.05,"15min":0.73599999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":13.369999999999999,"5min":13.369999999999999,"15min":13.369999999999999},"last":3.9279999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:37:30 2024","interfaces":[{"interface":"back","average":{"1min":2.2090000000000001,"5min":1.1879999999999999,"15min":0.80900000000000005},"min":{"1min":0.30299999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":10.944000000000001,"5min":13.470000000000001,"15min":13.470000000000001},"last":6.2270000000000003},{"interface":"front","average":{"1min":2.0899999999999999,"5min":0.94899999999999995,"15min":0.71099999999999997},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":18.018999999999998,"5min":18.018999999999998,"15min":18.018999999999998},"last":0.46300000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:38:00 2024","interfaces":[{"interface":"back","average":{"1min":2.194,"5min":1.2749999999999999,"15min":0.80400000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.313},"max":{"1min":6.6900000000000004,"5min":17.888999999999999,"15min":17.888999999999999},"last":1.7190000000000001},{"interface":"front","average":{"1min":2.2029999999999998,"5min":1.3979999999999999,"15min":0.86799999999999999},"min":{"1min":0.40400000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":8.5640000000000001,"5min":13.443,"15min":13.443},"last":3.8980000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:37:24 2024","interfaces":[{"interface":"back","average":{"1min":1.9590000000000001,"5min":0.93000000000000005,"15min":0.71899999999999997},"min":{"1min":0.34300000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":18.062999999999999,"5min":18.062999999999999,"15min":18.062999999999999},"last":0.435},{"interface":"front","average":{"1min":2.5489999999999999,"5min":1.1000000000000001,"15min":0.77200000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":17.917000000000002,"5min":17.917000000000002,"15min":17.917000000000002},"last":1.6910000000000001}]}]},{"osd":3,"up_from":26,"seq":111669149791,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2074668,"kb_used_data":1777444,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":91670484,"statfs":{"total":95995035648,"available":93870575616,"internally_reserved":0,"allocated":1820102656,"data_stored":1819785653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,3,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:37:51 2024","interfaces":[{"interface":"back","average":{"1min":3.2250000000000001,"5min":1.5860000000000001,"15min":0.80800000000000005},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":8.9730000000000008,"5min":17.992000000000001,"15min":17.992000000000001},"last":2.2850000000000001},{"interface":"front","average":{"1min":4.1459999999999999,"5min":1.9430000000000001,"15min":0.94599999999999995},"min":{"1min":0.23300000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":14.279999999999999,"5min":18.303000000000001,"15min":18.303000000000001},"last":3.415}]},{"osd":1,"last update":"Mon Feb 19 21:37:51 2024","interfaces":[{"interface":"back","average":{"1min":2.581,"5min":1.179,"15min":0.66000000000000003},"min":{"1min":0.22900000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":9.9700000000000006,"5min":9.9700000000000006,"15min":9.9700000000000006},"last":0.27500000000000002},{"interface":"front","average":{"1min":3.9220000000000002,"5min":1.7410000000000001,"15min":0.871},"min":{"1min":0.29999999999999999,"5min":0.185,"15min":0.185},"max":{"1min":11.196999999999999,"5min":13.135999999999999,"15min":13.135999999999999},"last":2.3969999999999998}]},{"osd":2,"last update":"Mon Feb 19 21:37:51 2024","interfaces":[{"interface":"back","average":{"1min":4.1500000000000004,"5min":1.5629999999999999,"15min":0.82699999999999996},"min":{"1min":0.26400000000000001,"5min":0.224,"15min":0.224},"max":{"1min":11.175000000000001,"5min":11.175000000000001,"15min":11.175000000000001},"last":1.865},{"interface":"front","average":{"1min":2.7290000000000001,"5min":1.639,"15min":0.84199999999999997},"min":{"1min":0.25800000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":11.632,"5min":13.109,"15min":13.109},"last":0.54200000000000004}]},{"osd":4,"last update":"Mon Feb 19 21:37:11 2024","interfaces":[{"interface":"back","average":{"1min":1.847,"5min":0.91000000000000003,"15min":0.69399999999999995},"min":{"1min":0.28899999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":5.681,"5min":5.681,"15min":5.681},"last":0.32600000000000001},{"interface":"front","average":{"1min":2.7589999999999999,"5min":1.1120000000000001,"15min":0.75700000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":11.093,"5min":11.093,"15min":11.093},"last":1.901}]},{"osd":5,"last update":"Mon Feb 19 21:37:31 2024","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":0.96999999999999997,"15min":0.70699999999999996},"min":{"1min":0.28399999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":3.9449999999999998,"5min":5.577,"15min":5.577},"last":0.35099999999999998},{"interface":"front","average":{"1min":2.3029999999999999,"5min":1.179,"15min":0.78100000000000003},"min":{"1min":0.41599999999999998,"5min":0.315,"15min":0.315},"max":{"1min":11.128,"5min":11.128,"15min":11.128},"last":1.923}]},{"osd":6,"last update":"Mon Feb 19 21:38:01 2024","interfaces":[{"interface":"back","average":{"1min":2.4140000000000001,"5min":1.2270000000000001,"15min":0.78600000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":17.443999999999999,"5min":17.443999999999999,"15min":17.443999999999999},"last":2.9300000000000002},{"interface":"front","average":{"1min":3.4449999999999998,"5min":1.5169999999999999,"15min":0.89900000000000002},"min":{"1min":0.34200000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":18.219000000000001,"5min":18.219000000000001,"15min":18.219000000000001},"last":1.9430000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:37:21 2024","interfaces":[{"interface":"back","average":{"1min":2.5489999999999999,"5min":1.357,"15min":0.81299999999999994},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":6.617,"5min":8.1069999999999993,"15min":8.1069999999999993},"last":3.3889999999999998},{"interface":"front","average":{"1min":1.3959999999999999,"5min":0.96799999999999997,"15min":0.70499999999999996},"min":{"1min":0.35499999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":4.3929999999999998,"5min":5.6040000000000001,"15min":5.6040000000000001},"last":2.9580000000000002}]}]},{"osd":4,"up_from":32,"seq":137438953560,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1292576,"kb_used_data":987096,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":92452576,"statfs":{"total":95995035648,"available":94671437824,"internally_reserved":0,"allocated":1010786304,"data_stored":1010481257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:38:09 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":0.95499999999999996,"15min":0.66200000000000003},"min":{"1min":0.23699999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":7.1509999999999998,"5min":7.2489999999999997,"15min":7.2489999999999997},"last":2.032},{"interface":"front","average":{"1min":1.49,"5min":1.286,"15min":0.78800000000000003},"min":{"1min":0.26300000000000001,"5min":0.252,"15min":0.252},"max":{"1min":5.4779999999999998,"5min":11.960000000000001,"15min":11.960000000000001},"last":0.434}]},{"osd":1,"last update":"Mon Feb 19 21:38:09 2024","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":0.78700000000000003,"15min":0.622},"min":{"1min":0.27300000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":8.8379999999999992,"5min":8.8379999999999992,"15min":8.8379999999999992},"last":0.33200000000000002},{"interface":"front","average":{"1min":2.008,"5min":0.97899999999999998,"15min":0.69999999999999996},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":15.411,"5min":15.411,"15min":15.411},"last":0.46600000000000003}]},{"osd":2,"last update":"Mon Feb 19 21:38:09 2024","interfaces":[{"interface":"back","average":{"1min":1.7809999999999999,"5min":1.0009999999999999,"15min":0.70099999999999996},"min":{"1min":0.38200000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":5.8079999999999998,"5min":6.7300000000000004,"15min":6.7300000000000004},"last":2.2080000000000002},{"interface":"front","average":{"1min":2.9870000000000001,"5min":1.5669999999999999,"15min":0.88},"min":{"1min":0.28499999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":14.843999999999999,"5min":20.995999999999999,"15min":20.995999999999999},"last":0.42299999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:38:09 2024","interfaces":[{"interface":"back","average":{"1min":2.9550000000000001,"5min":1.2869999999999999,"15min":0.79200000000000004},"min":{"1min":0.33900000000000002,"5min":0.316,"15min":0.316},"max":{"1min":15.914999999999999,"5min":15.914999999999999,"15min":15.914999999999999},"last":4.9139999999999997},{"interface":"front","average":{"1min":1.238,"5min":0.97899999999999998,"15min":0.69099999999999995},"min":{"1min":0.32600000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":2.6680000000000001,"5min":5.9420000000000002,"15min":5.9420000000000002},"last":2.468}]},{"osd":5,"last update":"Mon Feb 19 21:37:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.52600000000000002,"15min":0.436},"min":{"1min":0.27200000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":2.931,"5min":2.931,"15min":2.931},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.54300000000000004,"15min":0.44700000000000001},"min":{"1min":0.28100000000000003,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":0.375}]},{"osd":6,"last update":"Mon Feb 19 21:38:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.58799999999999997,"15min":0.48599999999999999},"min":{"1min":0.30399999999999999,"5min":0.30199999999999999,"15min":0.29999999999999999},"max":{"1min":2.6890000000000001,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.58299999999999996,"15min":0.495},"min":{"1min":0.317,"5min":0.29799999999999999,"15min":0.27700000000000002},"max":{"1min":2.9620000000000002,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":0.497}]},{"osd":7,"last update":"Mon Feb 19 21:37:22 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.54200000000000004,"15min":0.52600000000000002},"min":{"1min":0.32700000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.56799999999999995,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58899999999999997,"15min":0.54500000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.5489999999999999,"5min":1.845,"15min":1.845},"last":0.61199999999999999}]}]},{"osd":5,"up_from":38,"seq":163208757332,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1114960,"kb_used_data":801352,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":92630192,"statfs":{"total":95995035648,"available":94853316608,"internally_reserved":0,"allocated":820584448,"data_stored":820295936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:37:37 2024","interfaces":[{"interface":"back","average":{"1min":3.6179999999999999,"5min":1.2689999999999999,"15min":0.79600000000000004},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":20.550999999999998,"5min":20.550999999999998,"15min":20.550999999999998},"last":0.371},{"interface":"front","average":{"1min":2.6509999999999998,"5min":1.0660000000000001,"15min":0.73599999999999999},"min":{"1min":0.23999999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":20.879000000000001,"5min":20.879000000000001,"15min":20.879000000000001},"last":0.27400000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:37:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":0.83599999999999997,"15min":0.65500000000000003},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":7.8230000000000004,"5min":7.8230000000000004,"15min":7.8230000000000004},"last":2.9569999999999999},{"interface":"front","average":{"1min":2.4710000000000001,"5min":1.1040000000000001,"15min":0.72699999999999998},"min":{"1min":0.28699999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":10.316000000000001,"5min":10.316000000000001,"15min":10.316000000000001},"last":3.0790000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:37:37 2024","interfaces":[{"interface":"back","average":{"1min":3.0150000000000001,"5min":1.25,"15min":0.78000000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":20.186,"5min":20.186,"15min":20.186},"last":0.46100000000000002},{"interface":"front","average":{"1min":3.3570000000000002,"5min":1.218,"15min":0.77800000000000002},"min":{"1min":0.28100000000000003,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":20.175000000000001,"5min":20.175000000000001,"15min":20.175000000000001},"last":0.75800000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:37:37 2024","interfaces":[{"interface":"back","average":{"1min":3.8740000000000001,"5min":1.466,"15min":0.87},"min":{"1min":0.33400000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":20.146999999999998,"5min":20.146999999999998,"15min":20.146999999999998},"last":0.95999999999999996},{"interface":"front","average":{"1min":4.133,"5min":1.542,"15min":0.93000000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":20.120000000000001,"5min":20.120000000000001,"15min":20.120000000000001},"last":0.97899999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:37:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.50700000000000001,"15min":0.437},"min":{"1min":0.247,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":6.4610000000000003,"5min":6.4610000000000003,"15min":6.4610000000000003},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.57599999999999996,"15min":0.46400000000000002},"min":{"1min":0.26000000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":6.4740000000000002,"5min":6.4740000000000002,"15min":6.4740000000000002},"last":0.436}]},{"osd":6,"last update":"Mon Feb 19 21:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.60499999999999998,"15min":0.49099999999999999},"min":{"1min":0.30199999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":5.1689999999999996,"5min":5.1689999999999996,"15min":5.1689999999999996},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.68200000000000005,"15min":0.51200000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":6.6050000000000004,"5min":6.6050000000000004,"15min":6.6050000000000004},"last":0.55000000000000004}]},{"osd":7,"last update":"Mon Feb 19 21:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.58199999999999996,"15min":0.56599999999999995},"min":{"1min":0.311,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.2000000000000002,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.54400000000000004,"15min":0.53000000000000003},"min":{"1min":0.312,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.2250000000000001,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.44700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1578242048,"data_stored":1578237976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1204752384,"data_stored":1204748312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1201733632,"data_stored":1201733632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1810628608,"data_stored":1810628608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1001848832,"data_stored":1001848832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":805371904,"data_stored":805371904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1008799744,"data_stored":1008795672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":995688448,"data_stored":995688448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:38:14.794 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:38:14.844 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.7 dump_blocked_ops 2024-02-19T21:38:14.865 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:38:14.937 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:15.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:13.997140+0000 osd.0 (osd.0) 113 : cluster [DBG] 2.13 scrub starts 2024-02-19T21:38:15.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:14.002705+0000 osd.0 (osd.0) 114 : cluster [DBG] 2.13 scrub ok 2024-02-19T21:38:15.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:14.184540+0000 osd.2 (osd.2) 97 : cluster [DBG] 5.6 scrub starts 2024-02-19T21:38:15.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:14.199979+0000 osd.2 (osd.2) 98 : cluster [DBG] 5.6 scrub ok 2024-02-19T21:38:15.149 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:38:15.160 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:15.160 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:38:15.188 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:38:15.261 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:38:15.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:13.997140+0000 osd.0 (osd.0) 113 : cluster [DBG] 2.13 scrub starts 2024-02-19T21:38:15.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:14.002705+0000 osd.0 (osd.0) 114 : cluster [DBG] 2.13 scrub ok 2024-02-19T21:38:15.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:14.184540+0000 osd.2 (osd.2) 97 : cluster [DBG] 5.6 scrub starts 2024-02-19T21:38:15.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:14.199979+0000 osd.2 (osd.2) 98 : cluster [DBG] 5.6 scrub ok 2024-02-19T21:38:15.294 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:15.318 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:13.997140+0000 osd.0 (osd.0) 113 : cluster [DBG] 2.13 scrub starts 2024-02-19T21:38:15.318 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:14.002705+0000 osd.0 (osd.0) 114 : cluster [DBG] 2.13 scrub ok 2024-02-19T21:38:15.318 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:14.184540+0000 osd.2 (osd.2) 97 : cluster [DBG] 5.6 scrub starts 2024-02-19T21:38:15.319 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:14.199979+0000 osd.2 (osd.2) 98 : cluster [DBG] 5.6 scrub ok 2024-02-19T21:38:15.505 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:38:15.511 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:15.511 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:38:15.612 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:38:15.667 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:15.884 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:38:15.891 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:15.891 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:38:15.913 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:38:15.941 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:38:15.992 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:38:16.021 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:38:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:38:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:38:16.024 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:16.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:14.904525+0000 mgr.y (mgr.14514) 224 : cluster [DBG] pgmap v236: 148 pgs: 148 active+clean; 2.8 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 799 op/s 2024-02-19T21:38:16.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:15.183241+0000 osd.2 (osd.2) 99 : cluster [DBG] 2.1 scrub starts 2024-02-19T21:38:16.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:15.194845+0000 osd.2 (osd.2) 100 : cluster [DBG] 2.1 scrub ok 2024-02-19T21:38:16.130 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:38:16.135 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:16.135 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:38:16.236 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:38:16.271 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:14.904525+0000 mgr.y (mgr.14514) 224 : cluster [DBG] pgmap v236: 148 pgs: 148 active+clean; 2.8 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 799 op/s 2024-02-19T21:38:16.271 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:15.183241+0000 osd.2 (osd.2) 99 : cluster [DBG] 2.1 scrub starts 2024-02-19T21:38:16.271 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:15.194845+0000 osd.2 (osd.2) 100 : cluster [DBG] 2.1 scrub ok 2024-02-19T21:38:16.274 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:16.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:14.904525+0000 mgr.y (mgr.14514) 224 : cluster [DBG] pgmap v236: 148 pgs: 148 active+clean; 2.8 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 799 op/s 2024-02-19T21:38:16.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:15.183241+0000 osd.2 (osd.2) 99 : cluster [DBG] 2.1 scrub starts 2024-02-19T21:38:16.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:15.194845+0000 osd.2 (osd.2) 100 : cluster [DBG] 2.1 scrub ok 2024-02-19T21:38:16.662 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:38:16.668 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:16.669 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:38:16.680 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:38:16.727 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:38:16.764 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:38:16.769 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:38:16.808 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:38:16.815 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:16.847 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:38:16.891 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:38:16.919 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:38:16.948 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:38:16.961 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:38:16.962 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:38:16.962 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:38:16.962 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:38:16.962 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:38:16.962 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:38:16.962 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:38:16.963 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:38:17.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:15.863010+0000 osd.5 (osd.5) 108 : cluster [DBG] 2.3 scrub starts 2024-02-19T21:38:17.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:15.868728+0000 osd.5 (osd.5) 109 : cluster [DBG] 2.3 scrub ok 2024-02-19T21:38:17.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:15.938425+0000 osd.0 (osd.0) 115 : cluster [DBG] 6.0 scrub starts 2024-02-19T21:38:17.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:15.954676+0000 osd.0 (osd.0) 116 : cluster [DBG] 6.0 scrub ok 2024-02-19T21:38:17.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:16.177769+0000 osd.2 (osd.2) 101 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:38:17.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:16.184675+0000 osd.2 (osd.2) 102 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:38:17.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:16.650381+0000 mon.a (mon.0) 901 : audit [DBG] from='client.? 172.21.15.80:0/2954465104' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:38:17.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:16.889272+0000 osd.0 (osd.0) 117 : cluster [DBG] 5.5 scrub starts 2024-02-19T21:38:17.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:16.890263+0000 osd.0 (osd.0) 118 : cluster [DBG] 5.5 scrub ok 2024-02-19T21:38:17.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:15.863010+0000 osd.5 (osd.5) 108 : cluster [DBG] 2.3 scrub starts 2024-02-19T21:38:17.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:15.868728+0000 osd.5 (osd.5) 109 : cluster [DBG] 2.3 scrub ok 2024-02-19T21:38:17.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:15.938425+0000 osd.0 (osd.0) 115 : cluster [DBG] 6.0 scrub starts 2024-02-19T21:38:17.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:15.954676+0000 osd.0 (osd.0) 116 : cluster [DBG] 6.0 scrub ok 2024-02-19T21:38:17.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:16.177769+0000 osd.2 (osd.2) 101 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:38:17.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:16.184675+0000 osd.2 (osd.2) 102 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:38:17.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:16.650381+0000 mon.a (mon.0) 901 : audit [DBG] from='client.? 172.21.15.80:0/2954465104' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:38:17.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:16.889272+0000 osd.0 (osd.0) 117 : cluster [DBG] 5.5 scrub starts 2024-02-19T21:38:17.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:16.890263+0000 osd.0 (osd.0) 118 : cluster [DBG] 5.5 scrub ok 2024-02-19T21:38:17.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:15.863010+0000 osd.5 (osd.5) 108 : cluster [DBG] 2.3 scrub starts 2024-02-19T21:38:17.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:15.868728+0000 osd.5 (osd.5) 109 : cluster [DBG] 2.3 scrub ok 2024-02-19T21:38:17.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:15.938425+0000 osd.0 (osd.0) 115 : cluster [DBG] 6.0 scrub starts 2024-02-19T21:38:17.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:15.954676+0000 osd.0 (osd.0) 116 : cluster [DBG] 6.0 scrub ok 2024-02-19T21:38:17.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:16.177769+0000 osd.2 (osd.2) 101 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:38:17.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:16.184675+0000 osd.2 (osd.2) 102 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:38:17.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:16.650381+0000 mon.a (mon.0) 901 : audit [DBG] from='client.? 172.21.15.80:0/2954465104' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:38:17.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:16.889272+0000 osd.0 (osd.0) 117 : cluster [DBG] 5.5 scrub starts 2024-02-19T21:38:17.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:16.890263+0000 osd.0 (osd.0) 118 : cluster [DBG] 5.5 scrub ok 2024-02-19T21:38:17.318 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:38:17.318 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:38:17.793 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:38:17.799 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:17.800 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:38:17.901 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:38:17.942 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:18.063 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:16.907314+0000 mgr.y (mgr.14514) 225 : cluster [DBG] pgmap v237: 148 pgs: 148 active+clean; 2.7 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 918 op/s 2024-02-19T21:38:18.063 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:17.885087+0000 osd.0 (osd.0) 119 : cluster [DBG] 6.18 scrub starts 2024-02-19T21:38:18.063 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:17.889445+0000 osd.0 (osd.0) 120 : cluster [DBG] 6.18 scrub ok 2024-02-19T21:38:18.063 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:17.993682+0000 osd.1 (osd.1) 103 : cluster [DBG] 3.0 scrub starts 2024-02-19T21:38:18.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:17.997738+0000 osd.1 (osd.1) 104 : cluster [DBG] 3.0 scrub ok 2024-02-19T21:38:18.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:16.907314+0000 mgr.y (mgr.14514) 225 : cluster [DBG] pgmap v237: 148 pgs: 148 active+clean; 2.7 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 918 op/s 2024-02-19T21:38:18.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:17.885087+0000 osd.0 (osd.0) 119 : cluster [DBG] 6.18 scrub starts 2024-02-19T21:38:18.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:17.889445+0000 osd.0 (osd.0) 120 : cluster [DBG] 6.18 scrub ok 2024-02-19T21:38:18.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:17.993682+0000 osd.1 (osd.1) 103 : cluster [DBG] 3.0 scrub starts 2024-02-19T21:38:18.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:17.997738+0000 osd.1 (osd.1) 104 : cluster [DBG] 3.0 scrub ok 2024-02-19T21:38:18.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:16.907314+0000 mgr.y (mgr.14514) 225 : cluster [DBG] pgmap v237: 148 pgs: 148 active+clean; 2.7 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 918 op/s 2024-02-19T21:38:18.353 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:17.885087+0000 osd.0 (osd.0) 119 : cluster [DBG] 6.18 scrub starts 2024-02-19T21:38:18.353 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:17.889445+0000 osd.0 (osd.0) 120 : cluster [DBG] 6.18 scrub ok 2024-02-19T21:38:18.353 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:17.993682+0000 osd.1 (osd.1) 103 : cluster [DBG] 3.0 scrub starts 2024-02-19T21:38:18.353 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:17.997738+0000 osd.1 (osd.1) 104 : cluster [DBG] 3.0 scrub ok 2024-02-19T21:38:19.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:18.293571+0000 osd.6 (osd.6) 79 : cluster [DBG] 7.c scrub starts 2024-02-19T21:38:19.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:18.901351+0000 osd.0 (osd.0) 121 : cluster [DBG] 4.6 scrub starts 2024-02-19T21:38:19.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:18.908717+0000 osd.0 (osd.0) 122 : cluster [DBG] 4.6 scrub ok 2024-02-19T21:38:19.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:18.293571+0000 osd.6 (osd.6) 79 : cluster [DBG] 7.c scrub starts 2024-02-19T21:38:19.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:18.901351+0000 osd.0 (osd.0) 121 : cluster [DBG] 4.6 scrub starts 2024-02-19T21:38:19.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:18.908717+0000 osd.0 (osd.0) 122 : cluster [DBG] 4.6 scrub ok 2024-02-19T21:38:19.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:18.293571+0000 osd.6 (osd.6) 79 : cluster [DBG] 7.c scrub starts 2024-02-19T21:38:19.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:18.901351+0000 osd.0 (osd.0) 121 : cluster [DBG] 4.6 scrub starts 2024-02-19T21:38:19.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:18.908717+0000 osd.0 (osd.0) 122 : cluster [DBG] 4.6 scrub ok 2024-02-19T21:38:20.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:18.908096+0000 mgr.y (mgr.14514) 226 : cluster [DBG] pgmap v238: 148 pgs: 148 active+clean; 2.7 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 918 op/s 2024-02-19T21:38:20.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:19.148933+0000 osd.2 (osd.2) 103 : cluster [DBG] 4.d scrub starts 2024-02-19T21:38:20.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:19.154744+0000 osd.2 (osd.2) 104 : cluster [DBG] 4.d scrub ok 2024-02-19T21:38:20.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:19.330015+0000 osd.6 (osd.6) 80 : cluster [DBG] 7.c scrub ok 2024-02-19T21:38:20.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:18.908096+0000 mgr.y (mgr.14514) 226 : cluster [DBG] pgmap v238: 148 pgs: 148 active+clean; 2.7 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 918 op/s 2024-02-19T21:38:20.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:19.148933+0000 osd.2 (osd.2) 103 : cluster [DBG] 4.d scrub starts 2024-02-19T21:38:20.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:19.154744+0000 osd.2 (osd.2) 104 : cluster [DBG] 4.d scrub ok 2024-02-19T21:38:20.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:19.330015+0000 osd.6 (osd.6) 80 : cluster [DBG] 7.c scrub ok 2024-02-19T21:38:20.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:18.908096+0000 mgr.y (mgr.14514) 226 : cluster [DBG] pgmap v238: 148 pgs: 148 active+clean; 2.7 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 918 op/s 2024-02-19T21:38:20.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:19.148933+0000 osd.2 (osd.2) 103 : cluster [DBG] 4.d scrub starts 2024-02-19T21:38:20.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:19.154744+0000 osd.2 (osd.2) 104 : cluster [DBG] 4.d scrub ok 2024-02-19T21:38:20.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:19.330015+0000 osd.6 (osd.6) 80 : cluster [DBG] 7.c scrub ok 2024-02-19T21:38:20.558 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:38:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:38:20.847 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:38:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:38:20] "GET /metrics HTTP/1.1" 200 175474 "" "Prometheus/2.33.4" 2024-02-19T21:38:21.253 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:19.796400+0000 osd.7 (osd.7) 99 : cluster [DBG] 7.5 scrub starts 2024-02-19T21:38:21.253 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:20.099398+0000 mgr.y (mgr.14514) 227 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:38:21.253 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:20.300037+0000 osd.6 (osd.6) 81 : cluster [DBG] 4.e scrub starts 2024-02-19T21:38:21.253 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:20.307333+0000 osd.6 (osd.6) 82 : cluster [DBG] 4.e scrub ok 2024-02-19T21:38:21.254 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:19.796400+0000 osd.7 (osd.7) 99 : cluster [DBG] 7.5 scrub starts 2024-02-19T21:38:21.254 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:20.099398+0000 mgr.y (mgr.14514) 227 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:38:21.254 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:20.300037+0000 osd.6 (osd.6) 81 : cluster [DBG] 4.e scrub starts 2024-02-19T21:38:21.254 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:20.307333+0000 osd.6 (osd.6) 82 : cluster [DBG] 4.e scrub ok 2024-02-19T21:38:21.378 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:38:21.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:19.796400+0000 osd.7 (osd.7) 99 : cluster [DBG] 7.5 scrub starts 2024-02-19T21:38:21.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:20.099398+0000 mgr.y (mgr.14514) 227 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:38:21.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:20.300037+0000 osd.6 (osd.6) 81 : cluster [DBG] 4.e scrub starts 2024-02-19T21:38:21.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:20.307333+0000 osd.6 (osd.6) 82 : cluster [DBG] 4.e scrub ok 2024-02-19T21:38:21.815 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:38:21.819 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:38:22.267 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:38:22.271 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:22.272 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:38:22.283 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.7 dump_historic_ops 2024-02-19T21:38:22.361 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:20.870368+0000 osd.7 (osd.7) 100 : cluster [DBG] 7.5 scrub ok 2024-02-19T21:38:22.361 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:20.908843+0000 mgr.y (mgr.14514) 228 : cluster [DBG] pgmap v239: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 2.4 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 938 B/s rd, 0 B/s wr, 850 op/s 2024-02-19T21:38:22.361 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:21.353513+0000 osd.6 (osd.6) 83 : cluster [DBG] 7.d scrub starts 2024-02-19T21:38:22.373 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:38:22.454 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:20.870368+0000 osd.7 (osd.7) 100 : cluster [DBG] 7.5 scrub ok 2024-02-19T21:38:22.454 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:20.908843+0000 mgr.y (mgr.14514) 228 : cluster [DBG] pgmap v239: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 2.4 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 938 B/s rd, 0 B/s wr, 850 op/s 2024-02-19T21:38:22.454 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:21.353513+0000 osd.6 (osd.6) 83 : cluster [DBG] 7.d scrub starts 2024-02-19T21:38:22.454 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:20.870368+0000 osd.7 (osd.7) 100 : cluster [DBG] 7.5 scrub ok 2024-02-19T21:38:22.455 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:20.908843+0000 mgr.y (mgr.14514) 228 : cluster [DBG] pgmap v239: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 2.4 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 938 B/s rd, 0 B/s wr, 850 op/s 2024-02-19T21:38:22.455 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:21.353513+0000 osd.6 (osd.6) 83 : cluster [DBG] 7.d scrub starts 2024-02-19T21:38:22.455 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:22.699 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:38:22.826 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:38:22.830 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:22.831 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:38:22.932 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:38:22.990 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2024-02-19T21:38:20.908251+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2593265340,"num_objects":39763,"num_object_clones":0,"num_object_copies":119289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39763,"num_whiteouts":0,"num_read":1064,"num_read_kb":816,"num_write":190321,"num_write_kb":7342826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88802,"ondisk_log_size":88802,"up":444,"acting":444,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":444,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":10114424,"kb_used_data":7678712,"kb_used_omap":0,"kb_used_meta":2435072,"kb_avail":739846792,"statfs":{"total":767960285184,"available":757603115008,"internally_reserved":0,"allocated":7863001088,"data_stored":7860506844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2493513728},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-608043008,"num_objects":-9278,"num_object_clones":0,"num_object_copies":-27834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-9278,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":9278,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.914434"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":95,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.252260+0000","last_change":"2024-02-19T21:36:08.767606+0000","last_active":"2024-02-19T21:38:06.252260+0000","last_peered":"2024-02-19T21:38:06.252260+0000","last_clean":"2024-02-19T21:38:06.252260+0000","last_became_active":"2024-02-19T21:32:29.599674+0000","last_became_peered":"2024-02-19T21:32:29.599674+0000","last_unstale":"2024-02-19T21:38:06.252260+0000","last_undegraded":"2024-02-19T21:38:06.252260+0000","last_fullsized":"2024-02-19T21:38:06.252260+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:08.767498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:36:08.767498+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":63,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:13.387483+0000","last_change":"2024-02-19T21:38:13.387483+0000","last_active":"2024-02-19T21:38:13.387483+0000","last_peered":"2024-02-19T21:38:13.387483+0000","last_clean":"2024-02-19T21:38:13.387483+0000","last_became_active":"2024-02-19T21:35:14.511920+0000","last_became_peered":"2024-02-19T21:35:14.511920+0000","last_unstale":"2024-02-19T21:38:13.387483+0000","last_undegraded":"2024-02-19T21:38:13.387483+0000","last_fullsized":"2024-02-19T21:38:13.387483+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:13.387376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:13.387376+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":107,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.264987+0000","last_change":"2024-02-19T21:37:26.834440+0000","last_active":"2024-02-19T21:38:06.264987+0000","last_peered":"2024-02-19T21:38:06.264987+0000","last_clean":"2024-02-19T21:38:06.264987+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:38:06.264987+0000","last_undegraded":"2024-02-19T21:38:06.264987+0000","last_fullsized":"2024-02-19T21:38:06.264987+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:26.834173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:37:26.834173+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"66'15","reported_seq":124,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.252985+0000","last_change":"2024-02-19T21:36:14.711437+0000","last_active":"2024-02-19T21:38:06.252985+0000","last_peered":"2024-02-19T21:38:06.252985+0000","last_clean":"2024-02-19T21:38:06.252985+0000","last_became_active":"2024-02-19T21:32:25.365996+0000","last_became_peered":"2024-02-19T21:32:25.365996+0000","last_unstale":"2024-02-19T21:38:06.252985+0000","last_undegraded":"2024-02-19T21:38:06.252985+0000","last_fullsized":"2024-02-19T21:38:06.252985+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:36:14.711338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:14.711338+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":61,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.247209+0000","last_change":"2024-02-19T21:36:07.637136+0000","last_active":"2024-02-19T21:38:06.247209+0000","last_peered":"2024-02-19T21:38:06.247209+0000","last_clean":"2024-02-19T21:38:06.247209+0000","last_became_active":"2024-02-19T21:35:14.517794+0000","last_became_peered":"2024-02-19T21:35:14.517794+0000","last_unstale":"2024-02-19T21:38:06.247209+0000","last_undegraded":"2024-02-19T21:38:06.247209+0000","last_fullsized":"2024-02-19T21:38:06.247209+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:07.637066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:36:07.637066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":98,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.260754+0000","last_change":"2024-02-19T21:36:02.866497+0000","last_active":"2024-02-19T21:38:06.260754+0000","last_peered":"2024-02-19T21:38:06.260754+0000","last_clean":"2024-02-19T21:38:06.260754+0000","last_became_active":"2024-02-19T21:32:27.372466+0000","last_became_peered":"2024-02-19T21:32:27.372466+0000","last_unstale":"2024-02-19T21:38:06.260754+0000","last_undegraded":"2024-02-19T21:38:06.260754+0000","last_fullsized":"2024-02-19T21:38:06.260754+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:02.866408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:02.866408+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":106,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.253300+0000","last_change":"2024-02-19T21:37:29.668528+0000","last_active":"2024-02-19T21:38:06.253300+0000","last_peered":"2024-02-19T21:38:06.253300+0000","last_clean":"2024-02-19T21:38:06.253300+0000","last_became_active":"2024-02-19T21:32:23.356975+0000","last_became_peered":"2024-02-19T21:32:23.356975+0000","last_unstale":"2024-02-19T21:38:06.253300+0000","last_undegraded":"2024-02-19T21:38:06.253300+0000","last_fullsized":"2024-02-19T21:38:06.253300+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:37:29.668438+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"92'13","reported_seq":130,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.266187+0000","last_change":"2024-02-19T21:37:04.481872+0000","last_active":"2024-02-19T21:38:06.266187+0000","last_peered":"2024-02-19T21:38:06.266187+0000","last_clean":"2024-02-19T21:38:06.266187+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:38:06.266187+0000","last_undegraded":"2024-02-19T21:38:06.266187+0000","last_fullsized":"2024-02-19T21:38:06.266187+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"92'13","last_scrub_stamp":"2024-02-19T21:37:04.481758+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:37:04.481758+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":95,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.246491+0000","last_change":"2024-02-19T21:35:58.578063+0000","last_active":"2024-02-19T21:38:06.246491+0000","last_peered":"2024-02-19T21:38:06.246491+0000","last_clean":"2024-02-19T21:38:06.246491+0000","last_became_active":"2024-02-19T21:32:29.373648+0000","last_became_peered":"2024-02-19T21:32:29.373648+0000","last_unstale":"2024-02-19T21:38:06.246491+0000","last_undegraded":"2024-02-19T21:38:06.246491+0000","last_fullsized":"2024-02-19T21:38:06.246491+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:58.577980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:35:58.577980+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":97,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.253931+0000","last_change":"2024-02-19T21:36:10.065611+0000","last_active":"2024-02-19T21:38:06.253931+0000","last_peered":"2024-02-19T21:38:06.253931+0000","last_clean":"2024-02-19T21:38:06.253931+0000","last_became_active":"2024-02-19T21:32:27.370308+0000","last_became_peered":"2024-02-19T21:32:27.370308+0000","last_unstale":"2024-02-19T21:38:06.253931+0000","last_undegraded":"2024-02-19T21:38:06.253931+0000","last_fullsized":"2024-02-19T21:38:06.253931+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:10.065522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:10.065522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":108,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.254412+0000","last_change":"2024-02-19T21:37:35.972210+0000","last_active":"2024-02-19T21:38:06.254412+0000","last_peered":"2024-02-19T21:38:06.254412+0000","last_clean":"2024-02-19T21:38:06.254412+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:38:06.254412+0000","last_undegraded":"2024-02-19T21:38:06.254412+0000","last_fullsized":"2024-02-19T21:38:06.254412+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:35.972143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:08.490788+0000","last_clean_scrub_stamp":"2024-02-19T21:37:35.972143+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"66'5","reported_seq":83,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.252417+0000","last_change":"2024-02-19T21:37:12.566212+0000","last_active":"2024-02-19T21:38:06.252417+0000","last_peered":"2024-02-19T21:38:06.252417+0000","last_clean":"2024-02-19T21:38:06.252417+0000","last_became_active":"2024-02-19T21:35:14.514561+0000","last_became_peered":"2024-02-19T21:35:14.514561+0000","last_unstale":"2024-02-19T21:38:06.252417+0000","last_undegraded":"2024-02-19T21:38:06.252417+0000","last_fullsized":"2024-02-19T21:38:06.252417+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'5","last_scrub_stamp":"2024-02-19T21:37:12.566111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:12.566111+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":102,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:17.889547+0000","last_change":"2024-02-19T21:38:17.889547+0000","last_active":"2024-02-19T21:38:17.889547+0000","last_peered":"2024-02-19T21:38:17.889547+0000","last_clean":"2024-02-19T21:38:17.889547+0000","last_became_active":"2024-02-19T21:32:29.373010+0000","last_became_peered":"2024-02-19T21:32:29.373010+0000","last_unstale":"2024-02-19T21:38:17.889547+0000","last_undegraded":"2024-02-19T21:38:17.889547+0000","last_fullsized":"2024-02-19T21:38:17.889547+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:38:17.889452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:38:17.889452+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":102,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.246801+0000","last_change":"2024-02-19T21:36:09.679009+0000","last_active":"2024-02-19T21:38:06.246801+0000","last_peered":"2024-02-19T21:38:06.246801+0000","last_clean":"2024-02-19T21:38:06.246801+0000","last_became_active":"2024-02-19T21:32:27.368241+0000","last_became_peered":"2024-02-19T21:32:27.368241+0000","last_unstale":"2024-02-19T21:38:06.246801+0000","last_undegraded":"2024-02-19T21:38:06.246801+0000","last_fullsized":"2024-02-19T21:38:06.246801+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:09.678914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:46.543259+0000","last_clean_scrub_stamp":"2024-02-19T21:36:09.678914+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":106,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.254280+0000","last_change":"2024-02-19T21:37:06.962332+0000","last_active":"2024-02-19T21:38:06.254280+0000","last_peered":"2024-02-19T21:38:06.254280+0000","last_clean":"2024-02-19T21:38:06.254280+0000","last_became_active":"2024-02-19T21:32:23.357179+0000","last_became_peered":"2024-02-19T21:32:23.357179+0000","last_unstale":"2024-02-19T21:38:06.254280+0000","last_undegraded":"2024-02-19T21:38:06.254280+0000","last_fullsized":"2024-02-19T21:38:06.254280+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:06.962245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:37:06.962245+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"89'13","reported_seq":115,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.253570+0000","last_change":"2024-02-19T21:35:20.555646+0000","last_active":"2024-02-19T21:38:06.253570+0000","last_peered":"2024-02-19T21:38:06.253570+0000","last_clean":"2024-02-19T21:38:06.253570+0000","last_became_active":"2024-02-19T21:35:14.514971+0000","last_became_peered":"2024-02-19T21:35:14.514971+0000","last_unstale":"2024-02-19T21:38:06.253570+0000","last_undegraded":"2024-02-19T21:38:06.253570+0000","last_fullsized":"2024-02-19T21:38:06.253570+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'13","last_scrub_stamp":"2024-02-19T21:35:20.555574+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:35:20.555574+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":95,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.252636+0000","last_change":"2024-02-19T21:36:57.707929+0000","last_active":"2024-02-19T21:38:06.252636+0000","last_peered":"2024-02-19T21:38:06.252636+0000","last_clean":"2024-02-19T21:38:06.252636+0000","last_became_active":"2024-02-19T21:32:29.597266+0000","last_became_peered":"2024-02-19T21:32:29.597266+0000","last_unstale":"2024-02-19T21:38:06.252636+0000","last_undegraded":"2024-02-19T21:38:06.252636+0000","last_fullsized":"2024-02-19T21:38:06.252636+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:57.707840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:36:57.707840+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":61,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.252939+0000","last_change":"2024-02-19T21:36:52.566026+0000","last_active":"2024-02-19T21:38:06.252939+0000","last_peered":"2024-02-19T21:38:06.252939+0000","last_clean":"2024-02-19T21:38:06.252939+0000","last_became_active":"2024-02-19T21:35:14.514618+0000","last_became_peered":"2024-02-19T21:35:14.514618+0000","last_unstale":"2024-02-19T21:38:06.252939+0000","last_undegraded":"2024-02-19T21:38:06.252939+0000","last_fullsized":"2024-02-19T21:38:06.252939+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:52.565942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:52.565942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":115,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.252498+0000","last_change":"2024-02-19T21:37:23.540608+0000","last_active":"2024-02-19T21:38:06.252498+0000","last_peered":"2024-02-19T21:38:06.252498+0000","last_clean":"2024-02-19T21:38:06.252498+0000","last_became_active":"2024-02-19T21:33:50.753994+0000","last_became_peered":"2024-02-19T21:33:50.753994+0000","last_unstale":"2024-02-19T21:38:06.252498+0000","last_undegraded":"2024-02-19T21:38:06.252498+0000","last_fullsized":"2024-02-19T21:38:06.252498+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:23.540517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:37:23.540517+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"66'12","reported_seq":122,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.256475+0000","last_change":"2024-02-19T21:35:10.587068+0000","last_active":"2024-02-19T21:38:06.256475+0000","last_peered":"2024-02-19T21:38:06.256475+0000","last_clean":"2024-02-19T21:38:06.256475+0000","last_became_active":"2024-02-19T21:32:25.369040+0000","last_became_peered":"2024-02-19T21:32:25.369040+0000","last_unstale":"2024-02-19T21:38:06.256475+0000","last_undegraded":"2024-02-19T21:38:06.256475+0000","last_fullsized":"2024-02-19T21:38:06.256475+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'12","last_scrub_stamp":"2024-02-19T21:35:10.586999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:35:10.586999+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":101,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.265132+0000","last_change":"2024-02-19T21:36:55.590525+0000","last_active":"2024-02-19T21:38:06.265132+0000","last_peered":"2024-02-19T21:38:06.265132+0000","last_clean":"2024-02-19T21:38:06.265132+0000","last_became_active":"2024-02-19T21:32:29.597365+0000","last_became_peered":"2024-02-19T21:32:29.597365+0000","last_unstale":"2024-02-19T21:38:06.265132+0000","last_undegraded":"2024-02-19T21:38:06.265132+0000","last_fullsized":"2024-02-19T21:38:06.265132+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:55.590424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:36:55.590424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":98,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.261910+0000","last_change":"2024-02-19T21:36:03.917955+0000","last_active":"2024-02-19T21:38:06.261910+0000","last_peered":"2024-02-19T21:38:06.261910+0000","last_clean":"2024-02-19T21:38:06.261910+0000","last_became_active":"2024-02-19T21:32:27.369757+0000","last_became_peered":"2024-02-19T21:32:27.369757+0000","last_unstale":"2024-02-19T21:38:06.261910+0000","last_undegraded":"2024-02-19T21:38:06.261910+0000","last_fullsized":"2024-02-19T21:38:06.261910+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:03.917869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:03.917869+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":106,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.258039+0000","last_change":"2024-02-19T21:36:07.011419+0000","last_active":"2024-02-19T21:38:06.258039+0000","last_peered":"2024-02-19T21:38:06.258039+0000","last_clean":"2024-02-19T21:38:06.258039+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:38:06.258039+0000","last_undegraded":"2024-02-19T21:38:06.258039+0000","last_fullsized":"2024-02-19T21:38:06.258039+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:07.011329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:36:07.011329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"93'22","reported_seq":136,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.263526+0000","last_change":"2024-02-19T21:36:55.991871+0000","last_active":"2024-02-19T21:38:06.263526+0000","last_peered":"2024-02-19T21:38:06.263526+0000","last_clean":"2024-02-19T21:38:06.263526+0000","last_became_active":"2024-02-19T21:32:25.365267+0000","last_became_peered":"2024-02-19T21:32:25.365267+0000","last_unstale":"2024-02-19T21:38:06.263526+0000","last_undegraded":"2024-02-19T21:38:06.263526+0000","last_fullsized":"2024-02-19T21:38:06.263526+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'22","last_scrub_stamp":"2024-02-19T21:36:55.991770+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:35:02.204553+0000","last_clean_scrub_stamp":"2024-02-19T21:36:55.991770+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":96,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.261523+0000","last_change":"2024-02-19T21:36:12.945673+0000","last_active":"2024-02-19T21:38:06.261523+0000","last_peered":"2024-02-19T21:38:06.261523+0000","last_clean":"2024-02-19T21:38:06.261523+0000","last_became_active":"2024-02-19T21:32:29.373361+0000","last_became_peered":"2024-02-19T21:32:29.373361+0000","last_unstale":"2024-02-19T21:38:06.261523+0000","last_undegraded":"2024-02-19T21:38:06.261523+0000","last_fullsized":"2024-02-19T21:38:06.261523+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:12.945581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:12.945581+0000","last_clean_scrub_stamp":"2024-02-19T21:36:12.945581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":103,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.264680+0000","last_change":"2024-02-19T21:37:06.536218+0000","last_active":"2024-02-19T21:38:06.264680+0000","last_peered":"2024-02-19T21:38:06.264680+0000","last_clean":"2024-02-19T21:38:06.264680+0000","last_became_active":"2024-02-19T21:32:27.367741+0000","last_became_peered":"2024-02-19T21:32:27.367741+0000","last_unstale":"2024-02-19T21:38:06.264680+0000","last_undegraded":"2024-02-19T21:38:06.264680+0000","last_fullsized":"2024-02-19T21:38:06.264680+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:06.536121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:06.536121+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":101,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.253001+0000","last_change":"2024-02-19T21:36:13.741071+0000","last_active":"2024-02-19T21:38:06.253001+0000","last_peered":"2024-02-19T21:38:06.253001+0000","last_clean":"2024-02-19T21:38:06.253001+0000","last_became_active":"2024-02-19T21:32:23.355085+0000","last_became_peered":"2024-02-19T21:32:23.355085+0000","last_unstale":"2024-02-19T21:38:06.253001+0000","last_undegraded":"2024-02-19T21:38:06.253001+0000","last_fullsized":"2024-02-19T21:38:06.253001+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:13.740974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:36:13.740974+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"66'11","reported_seq":123,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.258608+0000","last_change":"2024-02-19T21:36:56.036308+0000","last_active":"2024-02-19T21:38:06.258608+0000","last_peered":"2024-02-19T21:38:06.258608+0000","last_clean":"2024-02-19T21:38:06.258608+0000","last_became_active":"2024-02-19T21:32:25.355939+0000","last_became_peered":"2024-02-19T21:32:25.355939+0000","last_unstale":"2024-02-19T21:38:06.258608+0000","last_undegraded":"2024-02-19T21:38:06.258608+0000","last_fullsized":"2024-02-19T21:38:06.258608+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:36:56.036187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:56.036187+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":96,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.254470+0000","last_change":"2024-02-19T21:35:14.520479+0000","last_active":"2024-02-19T21:38:06.254470+0000","last_peered":"2024-02-19T21:38:06.254470+0000","last_clean":"2024-02-19T21:38:06.254470+0000","last_became_active":"2024-02-19T21:32:29.372503+0000","last_became_peered":"2024-02-19T21:32:29.372503+0000","last_unstale":"2024-02-19T21:38:06.254470+0000","last_undegraded":"2024-02-19T21:38:06.254470+0000","last_fullsized":"2024-02-19T21:38:06.254470+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:35:14.520357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:35:14.520357+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"66'8","reported_seq":186,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:11.927598+0000","last_change":"2024-02-19T21:37:12.934637+0000","last_active":"2024-02-19T21:38:11.927598+0000","last_peered":"2024-02-19T21:38:11.927598+0000","last_clean":"2024-02-19T21:38:11.927598+0000","last_became_active":"2024-02-19T21:32:27.366465+0000","last_became_peered":"2024-02-19T21:32:27.366465+0000","last_unstale":"2024-02-19T21:38:11.927598+0000","last_undegraded":"2024-02-19T21:38:11.927598+0000","last_fullsized":"2024-02-19T21:38:11.927598+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:37:12.934537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:12.934537+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":106,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.246489+0000","last_change":"2024-02-19T21:36:08.667004+0000","last_active":"2024-02-19T21:38:06.246489+0000","last_peered":"2024-02-19T21:38:06.246489+0000","last_clean":"2024-02-19T21:38:06.246489+0000","last_became_active":"2024-02-19T21:32:23.356323+0000","last_became_peered":"2024-02-19T21:32:23.356323+0000","last_unstale":"2024-02-19T21:38:06.246489+0000","last_undegraded":"2024-02-19T21:38:06.246489+0000","last_fullsized":"2024-02-19T21:38:06.246489+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:36:08.666908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"66'10","reported_seq":120,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.264683+0000","last_change":"2024-02-19T21:36:07.267247+0000","last_active":"2024-02-19T21:38:06.264683+0000","last_peered":"2024-02-19T21:38:06.264683+0000","last_clean":"2024-02-19T21:38:06.264683+0000","last_became_active":"2024-02-19T21:32:25.372236+0000","last_became_peered":"2024-02-19T21:32:25.372236+0000","last_unstale":"2024-02-19T21:38:06.264683+0000","last_undegraded":"2024-02-19T21:38:06.264683+0000","last_fullsized":"2024-02-19T21:38:06.264683+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:36:07.267146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:07.267146+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":95,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.252932+0000","last_change":"2024-02-19T21:35:16.590543+0000","last_active":"2024-02-19T21:38:06.252932+0000","last_peered":"2024-02-19T21:38:06.252932+0000","last_clean":"2024-02-19T21:38:06.252932+0000","last_became_active":"2024-02-19T21:32:29.599396+0000","last_became_peered":"2024-02-19T21:32:29.599396+0000","last_unstale":"2024-02-19T21:38:06.252932+0000","last_undegraded":"2024-02-19T21:38:06.252932+0000","last_fullsized":"2024-02-19T21:38:06.252932+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:35:16.590436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":97,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.253843+0000","last_change":"2024-02-19T21:36:02.169629+0000","last_active":"2024-02-19T21:38:06.253843+0000","last_peered":"2024-02-19T21:38:06.253843+0000","last_clean":"2024-02-19T21:38:06.253843+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:38:06.253843+0000","last_undegraded":"2024-02-19T21:38:06.253843+0000","last_fullsized":"2024-02-19T21:38:06.253843+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:02.169522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:36:02.169522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":106,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.258494+0000","last_change":"2024-02-19T21:37:07.922839+0000","last_active":"2024-02-19T21:38:06.258494+0000","last_peered":"2024-02-19T21:38:06.258494+0000","last_clean":"2024-02-19T21:38:06.258494+0000","last_became_active":"2024-02-19T21:32:23.355525+0000","last_became_peered":"2024-02-19T21:32:23.355525+0000","last_unstale":"2024-02-19T21:38:06.258494+0000","last_undegraded":"2024-02-19T21:38:06.258494+0000","last_fullsized":"2024-02-19T21:38:06.258494+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:07.922759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:37:07.922759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"66'11","reported_seq":123,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.253179+0000","last_change":"2024-02-19T21:37:20.505192+0000","last_active":"2024-02-19T21:38:06.253179+0000","last_peered":"2024-02-19T21:38:06.253179+0000","last_clean":"2024-02-19T21:38:06.253179+0000","last_became_active":"2024-02-19T21:32:25.372039+0000","last_became_peered":"2024-02-19T21:32:25.372039+0000","last_unstale":"2024-02-19T21:38:06.253179+0000","last_undegraded":"2024-02-19T21:38:06.253179+0000","last_fullsized":"2024-02-19T21:38:06.253179+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:37:20.505097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:20.505097+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":95,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.253669+0000","last_change":"2024-02-19T21:35:56.242025+0000","last_active":"2024-02-19T21:38:06.253669+0000","last_peered":"2024-02-19T21:38:06.253669+0000","last_clean":"2024-02-19T21:38:06.253669+0000","last_became_active":"2024-02-19T21:32:29.372163+0000","last_became_peered":"2024-02-19T21:32:29.372163+0000","last_unstale":"2024-02-19T21:38:06.253669+0000","last_undegraded":"2024-02-19T21:38:06.253669+0000","last_fullsized":"2024-02-19T21:38:06.253669+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:56.241929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:35:56.241929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":102,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.257874+0000","last_change":"2024-02-19T21:36:16.949985+0000","last_active":"2024-02-19T21:38:06.257874+0000","last_peered":"2024-02-19T21:38:06.257874+0000","last_clean":"2024-02-19T21:38:06.257874+0000","last_became_active":"2024-02-19T21:32:27.366281+0000","last_became_peered":"2024-02-19T21:32:27.366281+0000","last_unstale":"2024-02-19T21:38:06.257874+0000","last_undegraded":"2024-02-19T21:38:06.257874+0000","last_fullsized":"2024-02-19T21:38:06.257874+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:16.949911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:16.949911+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":101,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.249358+0000","last_change":"2024-02-19T21:36:01.607836+0000","last_active":"2024-02-19T21:38:06.249358+0000","last_peered":"2024-02-19T21:38:06.249358+0000","last_clean":"2024-02-19T21:38:06.249358+0000","last_became_active":"2024-02-19T21:32:23.355103+0000","last_became_peered":"2024-02-19T21:32:23.355103+0000","last_unstale":"2024-02-19T21:38:06.249358+0000","last_undegraded":"2024-02-19T21:38:06.249358+0000","last_fullsized":"2024-02-19T21:38:06.249358+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:01.607757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:36:01.607757+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"66'4","reported_seq":105,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.252670+0000","last_change":"2024-02-19T21:35:54.642189+0000","last_active":"2024-02-19T21:38:06.252670+0000","last_peered":"2024-02-19T21:38:06.252670+0000","last_clean":"2024-02-19T21:38:06.252670+0000","last_became_active":"2024-02-19T21:32:25.369139+0000","last_became_peered":"2024-02-19T21:32:25.369139+0000","last_unstale":"2024-02-19T21:38:06.252670+0000","last_undegraded":"2024-02-19T21:38:06.252670+0000","last_fullsized":"2024-02-19T21:38:06.252670+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'4","last_scrub_stamp":"2024-02-19T21:35:54.642101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:35:54.642101+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":95,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.252905+0000","last_change":"2024-02-19T21:35:22.516792+0000","last_active":"2024-02-19T21:38:06.252905+0000","last_peered":"2024-02-19T21:38:06.252905+0000","last_clean":"2024-02-19T21:38:06.252905+0000","last_became_active":"2024-02-19T21:32:29.377302+0000","last_became_peered":"2024-02-19T21:32:29.377302+0000","last_unstale":"2024-02-19T21:38:06.252905+0000","last_undegraded":"2024-02-19T21:38:06.252905+0000","last_fullsized":"2024-02-19T21:38:06.252905+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:35:22.516711+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":98,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.261394+0000","last_change":"2024-02-19T21:36:06.939920+0000","last_active":"2024-02-19T21:38:06.261394+0000","last_peered":"2024-02-19T21:38:06.261394+0000","last_clean":"2024-02-19T21:38:06.261394+0000","last_became_active":"2024-02-19T21:32:27.374451+0000","last_became_peered":"2024-02-19T21:32:27.374451+0000","last_unstale":"2024-02-19T21:38:06.261394+0000","last_undegraded":"2024-02-19T21:38:06.261394+0000","last_fullsized":"2024-02-19T21:38:06.261394+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:06.939858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:06.939858+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":104,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.261634+0000","last_change":"2024-02-19T21:35:21.713423+0000","last_active":"2024-02-19T21:38:06.261634+0000","last_peered":"2024-02-19T21:38:06.261634+0000","last_clean":"2024-02-19T21:38:06.261634+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:38:06.261634+0000","last_undegraded":"2024-02-19T21:38:06.261634+0000","last_fullsized":"2024-02-19T21:38:06.261634+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:21.713362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:35:21.713362+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"66'11","reported_seq":129,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.264504+0000","last_change":"2024-02-19T21:37:29.501216+0000","last_active":"2024-02-19T21:38:06.264504+0000","last_peered":"2024-02-19T21:38:06.264504+0000","last_clean":"2024-02-19T21:38:06.264504+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:38:06.264504+0000","last_undegraded":"2024-02-19T21:38:06.264504+0000","last_fullsized":"2024-02-19T21:38:06.264504+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:37:29.501108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:29.501108+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":101,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.263895+0000","last_change":"2024-02-19T21:36:15.297105+0000","last_active":"2024-02-19T21:38:06.263895+0000","last_peered":"2024-02-19T21:38:06.263895+0000","last_clean":"2024-02-19T21:38:06.263895+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:38:06.263895+0000","last_undegraded":"2024-02-19T21:38:06.263895+0000","last_fullsized":"2024-02-19T21:38:06.263895+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:15.297016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:42.527849+0000","last_clean_scrub_stamp":"2024-02-19T21:36:15.297016+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":97,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.252643+0000","last_change":"2024-02-19T21:36:10.728285+0000","last_active":"2024-02-19T21:38:06.252643+0000","last_peered":"2024-02-19T21:38:06.252643+0000","last_clean":"2024-02-19T21:38:06.252643+0000","last_became_active":"2024-02-19T21:32:27.369279+0000","last_became_peered":"2024-02-19T21:32:27.369279+0000","last_unstale":"2024-02-19T21:38:06.252643+0000","last_undegraded":"2024-02-19T21:38:06.252643+0000","last_fullsized":"2024-02-19T21:38:06.252643+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:10.728211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:10.728211+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":106,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.258150+0000","last_change":"2024-02-19T21:36:14.917685+0000","last_active":"2024-02-19T21:38:06.258150+0000","last_peered":"2024-02-19T21:38:06.258150+0000","last_clean":"2024-02-19T21:38:06.258150+0000","last_became_active":"2024-02-19T21:32:23.357338+0000","last_became_peered":"2024-02-19T21:32:23.357338+0000","last_unstale":"2024-02-19T21:38:06.258150+0000","last_undegraded":"2024-02-19T21:38:06.258150+0000","last_fullsized":"2024-02-19T21:38:06.258150+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:36:14.917584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"66'9","reported_seq":116,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.261317+0000","last_change":"2024-02-19T21:36:05.936042+0000","last_active":"2024-02-19T21:38:06.261317+0000","last_peered":"2024-02-19T21:38:06.261317+0000","last_clean":"2024-02-19T21:38:06.261317+0000","last_became_active":"2024-02-19T21:32:25.359777+0000","last_became_peered":"2024-02-19T21:32:25.359777+0000","last_unstale":"2024-02-19T21:38:06.261317+0000","last_undegraded":"2024-02-19T21:38:06.261317+0000","last_fullsized":"2024-02-19T21:38:06.261317+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:36:05.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:05.935956+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":61,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.263605+0000","last_change":"2024-02-19T21:36:16.029010+0000","last_active":"2024-02-19T21:38:06.263605+0000","last_peered":"2024-02-19T21:38:06.263605+0000","last_clean":"2024-02-19T21:38:06.263605+0000","last_became_active":"2024-02-19T21:35:14.515471+0000","last_became_peered":"2024-02-19T21:35:14.515471+0000","last_unstale":"2024-02-19T21:38:06.263605+0000","last_undegraded":"2024-02-19T21:38:06.263605+0000","last_fullsized":"2024-02-19T21:38:06.263605+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:16.028943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:16.028943+0000","last_clean_scrub_stamp":"2024-02-19T21:36:16.028943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,5],"acting":[2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"66'8","reported_seq":176,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:11.928376+0000","last_change":"2024-02-19T21:36:02.726012+0000","last_active":"2024-02-19T21:38:11.928376+0000","last_peered":"2024-02-19T21:38:11.928376+0000","last_clean":"2024-02-19T21:38:11.928376+0000","last_became_active":"2024-02-19T21:32:27.365865+0000","last_became_peered":"2024-02-19T21:32:27.365865+0000","last_unstale":"2024-02-19T21:38:11.928376+0000","last_undegraded":"2024-02-19T21:38:11.928376+0000","last_fullsized":"2024-02-19T21:38:11.928376+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:36:02.725913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:02.725913+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":116,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:14.002797+0000","last_change":"2024-02-19T21:38:14.002797+0000","last_active":"2024-02-19T21:38:14.002797+0000","last_peered":"2024-02-19T21:38:14.002797+0000","last_clean":"2024-02-19T21:38:14.002797+0000","last_became_active":"2024-02-19T21:32:23.361680+0000","last_became_peered":"2024-02-19T21:32:23.361680+0000","last_unstale":"2024-02-19T21:38:14.002797+0000","last_undegraded":"2024-02-19T21:38:14.002797+0000","last_fullsized":"2024-02-19T21:38:14.002797+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:14.002713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:33.550655+0000","last_clean_scrub_stamp":"2024-02-19T21:38:14.002713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"133'13","reported_seq":124,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.247400+0000","last_change":"2024-02-19T21:37:34.892934+0000","last_active":"2024-02-19T21:38:06.247400+0000","last_peered":"2024-02-19T21:38:06.247400+0000","last_clean":"2024-02-19T21:38:06.247400+0000","last_became_active":"2024-02-19T21:32:25.372206+0000","last_became_peered":"2024-02-19T21:32:25.372206+0000","last_unstale":"2024-02-19T21:38:06.247400+0000","last_undegraded":"2024-02-19T21:38:06.247400+0000","last_fullsized":"2024-02-19T21:38:06.247400+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'13","last_scrub_stamp":"2024-02-19T21:37:34.892825+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:37:34.892825+0000","last_clean_scrub_stamp":"2024-02-19T21:37:34.892825+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":106,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.264224+0000","last_change":"2024-02-19T21:37:32.890817+0000","last_active":"2024-02-19T21:38:06.264224+0000","last_peered":"2024-02-19T21:38:06.264224+0000","last_clean":"2024-02-19T21:38:06.264224+0000","last_became_active":"2024-02-19T21:32:29.376980+0000","last_became_peered":"2024-02-19T21:32:29.376980+0000","last_unstale":"2024-02-19T21:38:06.264224+0000","last_undegraded":"2024-02-19T21:38:06.264224+0000","last_fullsized":"2024-02-19T21:38:06.264224+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:32.890719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:37:32.890719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"66'8","reported_seq":181,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:11.922208+0000","last_change":"2024-02-19T21:37:35.901012+0000","last_active":"2024-02-19T21:38:11.922208+0000","last_peered":"2024-02-19T21:38:11.922208+0000","last_clean":"2024-02-19T21:38:11.922208+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:38:11.922208+0000","last_undegraded":"2024-02-19T21:38:11.922208+0000","last_fullsized":"2024-02-19T21:38:11.922208+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:37:35.900920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:35.900920+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":108,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.247553+0000","last_change":"2024-02-19T21:37:19.763737+0000","last_active":"2024-02-19T21:38:06.247553+0000","last_peered":"2024-02-19T21:38:06.247553+0000","last_clean":"2024-02-19T21:38:06.247553+0000","last_became_active":"2024-02-19T21:32:23.360838+0000","last_became_peered":"2024-02-19T21:32:23.360838+0000","last_unstale":"2024-02-19T21:38:06.247553+0000","last_undegraded":"2024-02-19T21:38:06.247553+0000","last_fullsized":"2024-02-19T21:38:06.247553+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:37:19.763642+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"66'10","reported_seq":114,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.252681+0000","last_change":"2024-02-19T21:35:14.590169+0000","last_active":"2024-02-19T21:38:06.252681+0000","last_peered":"2024-02-19T21:38:06.252681+0000","last_clean":"2024-02-19T21:38:06.252681+0000","last_became_active":"2024-02-19T21:32:25.372060+0000","last_became_peered":"2024-02-19T21:32:25.372060+0000","last_unstale":"2024-02-19T21:38:06.252681+0000","last_undegraded":"2024-02-19T21:38:06.252681+0000","last_fullsized":"2024-02-19T21:38:06.252681+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:35:14.590053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:35:14.590053+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":104,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.254329+0000","last_change":"2024-02-19T21:37:27.036804+0000","last_active":"2024-02-19T21:38:06.254329+0000","last_peered":"2024-02-19T21:38:06.254329+0000","last_clean":"2024-02-19T21:38:06.254329+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:38:06.254329+0000","last_undegraded":"2024-02-19T21:38:06.254329+0000","last_fullsized":"2024-02-19T21:38:06.254329+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_clean_scrub_stamp":"2024-02-19T21:37:27.036737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":97,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.249169+0000","last_change":"2024-02-19T21:35:59.616946+0000","last_active":"2024-02-19T21:38:06.249169+0000","last_peered":"2024-02-19T21:38:06.249169+0000","last_clean":"2024-02-19T21:38:06.249169+0000","last_became_active":"2024-02-19T21:32:27.369002+0000","last_became_peered":"2024-02-19T21:32:27.369002+0000","last_unstale":"2024-02-19T21:38:06.249169+0000","last_undegraded":"2024-02-19T21:38:06.249169+0000","last_fullsized":"2024-02-19T21:38:06.249169+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:59.616851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:35:59.616851+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":101,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.257921+0000","last_change":"2024-02-19T21:35:55.058463+0000","last_active":"2024-02-19T21:38:06.257921+0000","last_peered":"2024-02-19T21:38:06.257921+0000","last_clean":"2024-02-19T21:38:06.257921+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:38:06.257921+0000","last_undegraded":"2024-02-19T21:38:06.257921+0000","last_fullsized":"2024-02-19T21:38:06.257921+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:55.058402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:35:55.058402+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"66'6","reported_seq":108,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.252714+0000","last_change":"2024-02-19T21:36:06.799152+0000","last_active":"2024-02-19T21:38:06.252714+0000","last_peered":"2024-02-19T21:38:06.252714+0000","last_clean":"2024-02-19T21:38:06.252714+0000","last_became_active":"2024-02-19T21:32:25.372212+0000","last_became_peered":"2024-02-19T21:32:25.372212+0000","last_unstale":"2024-02-19T21:38:06.252714+0000","last_undegraded":"2024-02-19T21:38:06.252714+0000","last_fullsized":"2024-02-19T21:38:06.252714+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'6","last_scrub_stamp":"2024-02-19T21:36:06.799055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:06.799055+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":100,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:16.184777+0000","last_change":"2024-02-19T21:38:16.184777+0000","last_active":"2024-02-19T21:38:16.184777+0000","last_peered":"2024-02-19T21:38:16.184777+0000","last_clean":"2024-02-19T21:38:16.184777+0000","last_became_active":"2024-02-19T21:32:29.371977+0000","last_became_peered":"2024-02-19T21:32:29.371977+0000","last_unstale":"2024-02-19T21:38:16.184777+0000","last_undegraded":"2024-02-19T21:38:16.184777+0000","last_fullsized":"2024-02-19T21:38:16.184777+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:16.184681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:38:16.184681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":97,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.252839+0000","last_change":"2024-02-19T21:36:54.644204+0000","last_active":"2024-02-19T21:38:06.252839+0000","last_peered":"2024-02-19T21:38:06.252839+0000","last_clean":"2024-02-19T21:38:06.252839+0000","last_became_active":"2024-02-19T21:32:27.366748+0000","last_became_peered":"2024-02-19T21:32:27.366748+0000","last_unstale":"2024-02-19T21:38:06.252839+0000","last_undegraded":"2024-02-19T21:38:06.252839+0000","last_fullsized":"2024-02-19T21:38:06.252839+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:54.644120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:54.644120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":106,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.259660+0000","last_change":"2024-02-19T21:36:11.078819+0000","last_active":"2024-02-19T21:38:06.259660+0000","last_peered":"2024-02-19T21:38:06.259660+0000","last_clean":"2024-02-19T21:38:06.259660+0000","last_became_active":"2024-02-19T21:32:23.358939+0000","last_became_peered":"2024-02-19T21:32:23.358939+0000","last_unstale":"2024-02-19T21:38:06.259660+0000","last_undegraded":"2024-02-19T21:38:06.259660+0000","last_fullsized":"2024-02-19T21:38:06.259660+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:11.078750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:36:11.078750+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"66'9","reported_seq":121,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.264467+0000","last_change":"2024-02-19T21:36:53.491383+0000","last_active":"2024-02-19T21:38:06.264467+0000","last_peered":"2024-02-19T21:38:06.264467+0000","last_clean":"2024-02-19T21:38:06.264467+0000","last_became_active":"2024-02-19T21:32:25.372106+0000","last_became_peered":"2024-02-19T21:32:25.372106+0000","last_unstale":"2024-02-19T21:38:06.264467+0000","last_undegraded":"2024-02-19T21:38:06.264467+0000","last_fullsized":"2024-02-19T21:38:06.264467+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:36:53.491279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:53.491279+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"142'11819","reported_seq":11874,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:19.916941+0000","last_change":"2024-02-19T21:37:28.803373+0000","last_active":"2024-02-19T21:38:19.916941+0000","last_peered":"2024-02-19T21:38:19.916941+0000","last_clean":"2024-02-19T21:38:19.916941+0000","last_became_active":"2024-02-19T21:35:19.640049+0000","last_became_peered":"2024-02-19T21:35:19.640049+0000","last_unstale":"2024-02-19T21:38:19.916941+0000","last_undegraded":"2024-02-19T21:38:19.916941+0000","last_fullsized":"2024-02-19T21:38:19.916941+0000","mapping_epoch":100,"log_start":"130'7100","ondisk_log_start":"130'7100","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'8846","last_scrub_stamp":"2024-02-19T21:37:28.803214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:28.803214+0000","log_size":4719,"ondisk_log_size":4719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168361984,"num_objects":2569,"num_object_clones":0,"num_object_copies":7707,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2569,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11819,"num_write_kb":460416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":95,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.252729+0000","last_change":"2024-02-19T21:35:07.519633+0000","last_active":"2024-02-19T21:38:06.252729+0000","last_peered":"2024-02-19T21:38:06.252729+0000","last_clean":"2024-02-19T21:38:06.252729+0000","last_became_active":"2024-02-19T21:32:29.376027+0000","last_became_peered":"2024-02-19T21:32:29.376027+0000","last_unstale":"2024-02-19T21:38:06.252729+0000","last_undegraded":"2024-02-19T21:38:06.252729+0000","last_fullsized":"2024-02-19T21:38:06.252729+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:35:07.519531+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"59'2","reported_seq":122,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:18.385392+0000","last_change":"2024-02-19T21:38:18.385869+0000","last_active":"2024-02-19T21:38:18.385392+0000","last_peered":"2024-02-19T21:38:18.385392+0000","last_clean":"2024-02-19T21:38:18.385392+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:38:18.385392+0000","last_undegraded":"2024-02-19T21:38:18.385392+0000","last_fullsized":"2024-02-19T21:38:18.385392+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-02-19T21:36:54.560988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:36:54.560988+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"83'17","reported_seq":116,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.254526+0000","last_change":"2024-02-19T21:36:56.732539+0000","last_active":"2024-02-19T21:38:06.254526+0000","last_peered":"2024-02-19T21:38:06.254526+0000","last_clean":"2024-02-19T21:38:06.254526+0000","last_became_active":"2024-02-19T21:35:14.515967+0000","last_became_peered":"2024-02-19T21:35:14.515967+0000","last_unstale":"2024-02-19T21:38:06.254526+0000","last_undegraded":"2024-02-19T21:38:06.254526+0000","last_fullsized":"2024-02-19T21:38:06.254526+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'17","last_scrub_stamp":"2024-02-19T21:36:56.732448+0000","last_deep_scrub":"83'17","last_deep_scrub_stamp":"2024-02-19T21:33:43.418450+0000","last_clean_scrub_stamp":"2024-02-19T21:36:56.732448+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":97,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.259570+0000","last_change":"2024-02-19T21:36:02.020363+0000","last_active":"2024-02-19T21:38:06.259570+0000","last_peered":"2024-02-19T21:38:06.259570+0000","last_clean":"2024-02-19T21:38:06.259570+0000","last_became_active":"2024-02-19T21:32:27.367022+0000","last_became_peered":"2024-02-19T21:32:27.367022+0000","last_unstale":"2024-02-19T21:38:06.259570+0000","last_undegraded":"2024-02-19T21:38:06.259570+0000","last_fullsized":"2024-02-19T21:38:06.259570+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:02.020270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:02.020270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1","version":"142'11997","reported_seq":12047,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:19.887198+0000","last_change":"2024-02-19T21:35:20.121166+0000","last_active":"2024-02-19T21:38:19.887198+0000","last_peered":"2024-02-19T21:38:19.887198+0000","last_clean":"2024-02-19T21:38:19.887198+0000","last_became_active":"2024-02-19T21:35:20.120890+0000","last_became_peered":"2024-02-19T21:35:20.120890+0000","last_unstale":"2024-02-19T21:38:19.887198+0000","last_undegraded":"2024-02-19T21:38:19.887198+0000","last_fullsized":"2024-02-19T21:38:19.887198+0000","mapping_epoch":100,"log_start":"130'7300","ondisk_log_start":"130'7300","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:35:18.622399+0000","log_size":4697,"ondisk_log_size":4697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":167444480,"num_objects":2555,"num_object_clones":0,"num_object_copies":7665,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2555,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11997,"num_write_kb":465664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6],"acting":[3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":101,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:15.954785+0000","last_change":"2024-02-19T21:38:15.954785+0000","last_active":"2024-02-19T21:38:15.954785+0000","last_peered":"2024-02-19T21:38:15.954785+0000","last_clean":"2024-02-19T21:38:15.954785+0000","last_became_active":"2024-02-19T21:32:29.374999+0000","last_became_peered":"2024-02-19T21:32:29.374999+0000","last_unstale":"2024-02-19T21:38:15.954785+0000","last_undegraded":"2024-02-19T21:38:15.954785+0000","last_fullsized":"2024-02-19T21:38:15.954785+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:15.954684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:38:15.954684+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":102,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.262030+0000","last_change":"2024-02-19T21:35:14.754539+0000","last_active":"2024-02-19T21:38:06.262030+0000","last_peered":"2024-02-19T21:38:06.262030+0000","last_clean":"2024-02-19T21:38:06.262030+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:38:06.262030+0000","last_undegraded":"2024-02-19T21:38:06.262030+0000","last_fullsized":"2024-02-19T21:38:06.262030+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:14.754474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:35:14.754474+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"66'10","reported_seq":94,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.260184+0000","last_change":"2024-02-19T21:37:14.054990+0000","last_active":"2024-02-19T21:38:06.260184+0000","last_peered":"2024-02-19T21:38:06.260184+0000","last_clean":"2024-02-19T21:38:06.260184+0000","last_became_active":"2024-02-19T21:33:50.752293+0000","last_became_peered":"2024-02-19T21:33:50.752293+0000","last_unstale":"2024-02-19T21:38:06.260184+0000","last_undegraded":"2024-02-19T21:38:06.260184+0000","last_fullsized":"2024-02-19T21:38:06.260184+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:37:14.054904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:14.054904+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":182,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:11.924331+0000","last_change":"2024-02-19T21:37:17.775208+0000","last_active":"2024-02-19T21:38:11.924331+0000","last_peered":"2024-02-19T21:38:11.924331+0000","last_clean":"2024-02-19T21:38:11.924331+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:38:11.924331+0000","last_undegraded":"2024-02-19T21:38:11.924331+0000","last_fullsized":"2024-02-19T21:38:11.924331+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:37:17.775085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:17.775085+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.7","version":"142'11669","reported_seq":11731,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:19.769377+0000","last_change":"2024-02-19T21:37:32.539892+0000","last_active":"2024-02-19T21:38:19.769377+0000","last_peered":"2024-02-19T21:38:19.769377+0000","last_clean":"2024-02-19T21:38:19.769377+0000","last_became_active":"2024-02-19T21:35:19.639154+0000","last_became_peered":"2024-02-19T21:35:19.639154+0000","last_unstale":"2024-02-19T21:38:19.769377+0000","last_undegraded":"2024-02-19T21:38:19.769377+0000","last_fullsized":"2024-02-19T21:38:19.769377+0000","mapping_epoch":100,"log_start":"121'5500","ondisk_log_start":"121'5500","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'8930","last_scrub_stamp":"2024-02-19T21:37:32.539829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:32.539829+0000","log_size":6169,"ondisk_log_size":6169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":156303360,"num_objects":2385,"num_object_clones":0,"num_object_copies":7155,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2385,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11669,"num_write_kb":449728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":102,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.253378+0000","last_change":"2024-02-19T21:37:18.550903+0000","last_active":"2024-02-19T21:38:06.253378+0000","last_peered":"2024-02-19T21:38:06.253378+0000","last_clean":"2024-02-19T21:38:06.253378+0000","last_became_active":"2024-02-19T21:32:29.372330+0000","last_became_peered":"2024-02-19T21:32:29.372330+0000","last_unstale":"2024-02-19T21:38:06.253378+0000","last_undegraded":"2024-02-19T21:38:06.253378+0000","last_fullsized":"2024-02-19T21:38:06.253378+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:18.550821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:37:18.550821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":106,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.247386+0000","last_change":"2024-02-19T21:36:05.647803+0000","last_active":"2024-02-19T21:38:06.247386+0000","last_peered":"2024-02-19T21:38:06.247386+0000","last_clean":"2024-02-19T21:38:06.247386+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:38:06.247386+0000","last_undegraded":"2024-02-19T21:38:06.247386+0000","last_fullsized":"2024-02-19T21:38:06.247386+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:05.647719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:36:05.647719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"66'28","reported_seq":219,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:11.932835+0000","last_change":"2024-02-19T21:35:54.882929+0000","last_active":"2024-02-19T21:38:11.932835+0000","last_peered":"2024-02-19T21:38:11.932835+0000","last_clean":"2024-02-19T21:38:11.932835+0000","last_became_active":"2024-02-19T21:32:25.367594+0000","last_became_peered":"2024-02-19T21:32:25.367594+0000","last_unstale":"2024-02-19T21:38:11.932835+0000","last_undegraded":"2024-02-19T21:38:11.932835+0000","last_fullsized":"2024-02-19T21:38:11.932835+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'28","last_scrub_stamp":"2024-02-19T21:35:54.882818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:35:54.882818+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":103,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:16.890343+0000","last_change":"2024-02-19T21:38:16.890343+0000","last_active":"2024-02-19T21:38:16.890343+0000","last_peered":"2024-02-19T21:38:16.890343+0000","last_clean":"2024-02-19T21:38:16.890343+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:38:16.890343+0000","last_undegraded":"2024-02-19T21:38:16.890343+0000","last_fullsized":"2024-02-19T21:38:16.890343+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:16.890269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:16.890269+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"142'12118","reported_seq":12173,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:19.918480+0000","last_change":"2024-02-19T21:37:26.190135+0000","last_active":"2024-02-19T21:38:19.918480+0000","last_peered":"2024-02-19T21:38:19.918480+0000","last_clean":"2024-02-19T21:38:19.918480+0000","last_became_active":"2024-02-19T21:35:20.120258+0000","last_became_peered":"2024-02-19T21:35:20.120258+0000","last_unstale":"2024-02-19T21:38:19.918480+0000","last_undegraded":"2024-02-19T21:38:19.918480+0000","last_fullsized":"2024-02-19T21:38:19.918480+0000","mapping_epoch":100,"log_start":"128'6600","ondisk_log_start":"128'6600","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"132'8838","last_scrub_stamp":"2024-02-19T21:37:26.190030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:26.190030+0000","log_size":5518,"ondisk_log_size":5518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":159645696,"num_objects":2436,"num_object_clones":0,"num_object_copies":7308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2436,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12118,"num_write_kb":465728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":95,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.254553+0000","last_change":"2024-02-19T21:36:08.147110+0000","last_active":"2024-02-19T21:38:06.254553+0000","last_peered":"2024-02-19T21:38:06.254553+0000","last_clean":"2024-02-19T21:38:06.254553+0000","last_became_active":"2024-02-19T21:32:29.597365+0000","last_became_peered":"2024-02-19T21:32:29.597365+0000","last_unstale":"2024-02-19T21:38:06.254553+0000","last_undegraded":"2024-02-19T21:38:06.254553+0000","last_fullsized":"2024-02-19T21:38:06.254553+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:08.146986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:36:08.146986+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"67'5","reported_seq":458,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:18.501505+0000","last_change":"2024-02-19T21:38:17.997812+0000","last_active":"2024-02-19T21:38:18.501505+0000","last_peered":"2024-02-19T21:38:18.501505+0000","last_clean":"2024-02-19T21:38:18.501505+0000","last_became_active":"2024-02-19T21:32:23.354539+0000","last_became_peered":"2024-02-19T21:32:23.354539+0000","last_unstale":"2024-02-19T21:38:18.501505+0000","last_undegraded":"2024-02-19T21:38:18.501505+0000","last_fullsized":"2024-02-19T21:38:18.501505+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5","last_scrub_stamp":"2024-02-19T21:38:17.997743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:38:17.997743+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":348,"num_read_kb":343,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":111,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:15.194913+0000","last_change":"2024-02-19T21:38:15.194913+0000","last_active":"2024-02-19T21:38:15.194913+0000","last_peered":"2024-02-19T21:38:15.194913+0000","last_clean":"2024-02-19T21:38:15.194913+0000","last_became_active":"2024-02-19T21:32:23.358321+0000","last_became_peered":"2024-02-19T21:32:23.358321+0000","last_unstale":"2024-02-19T21:38:15.194913+0000","last_undegraded":"2024-02-19T21:38:15.194913+0000","last_fullsized":"2024-02-19T21:38:15.194913+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:15.194849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:38:15.194849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"66'13","reported_seq":142,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.261794+0000","last_change":"2024-02-19T21:37:32.806098+0000","last_active":"2024-02-19T21:38:06.261794+0000","last_peered":"2024-02-19T21:38:06.261794+0000","last_clean":"2024-02-19T21:38:06.261794+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:38:06.261794+0000","last_undegraded":"2024-02-19T21:38:06.261794+0000","last_fullsized":"2024-02-19T21:38:06.261794+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'13","last_scrub_stamp":"2024-02-19T21:37:32.805993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:32.805993+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":105,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:14.200101+0000","last_change":"2024-02-19T21:38:14.200101+0000","last_active":"2024-02-19T21:38:14.200101+0000","last_peered":"2024-02-19T21:38:14.200101+0000","last_clean":"2024-02-19T21:38:14.200101+0000","last_became_active":"2024-02-19T21:32:27.363740+0000","last_became_peered":"2024-02-19T21:32:27.363740+0000","last_unstale":"2024-02-19T21:38:14.200101+0000","last_undegraded":"2024-02-19T21:38:14.200101+0000","last_fullsized":"2024-02-19T21:38:14.200101+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:14.199989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:14.199989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"142'11881","reported_seq":11934,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:19.946819+0000","last_change":"2024-02-19T21:37:01.782606+0000","last_active":"2024-02-19T21:38:19.946819+0000","last_peered":"2024-02-19T21:38:19.946819+0000","last_clean":"2024-02-19T21:38:19.946819+0000","last_became_active":"2024-02-19T21:35:19.637041+0000","last_became_peered":"2024-02-19T21:35:19.637041+0000","last_unstale":"2024-02-19T21:38:19.946819+0000","last_undegraded":"2024-02-19T21:38:19.946819+0000","last_fullsized":"2024-02-19T21:38:19.946819+0000","mapping_epoch":100,"log_start":"127'6400","ondisk_log_start":"127'6400","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'7343","last_scrub_stamp":"2024-02-19T21:37:01.782509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:01.782509+0000","log_size":5481,"ondisk_log_size":5481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":162988032,"num_objects":2487,"num_object_clones":0,"num_object_copies":7461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2487,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11881,"num_write_kb":459776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":100,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.247744+0000","last_change":"2024-02-19T21:37:20.804540+0000","last_active":"2024-02-19T21:38:06.247744+0000","last_peered":"2024-02-19T21:38:06.247744+0000","last_clean":"2024-02-19T21:38:06.247744+0000","last_became_active":"2024-02-19T21:32:29.372547+0000","last_became_peered":"2024-02-19T21:32:29.372547+0000","last_unstale":"2024-02-19T21:38:06.247744+0000","last_undegraded":"2024-02-19T21:38:06.247744+0000","last_fullsized":"2024-02-19T21:38:06.247744+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:20.804454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:37:20.804454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":106,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.253236+0000","last_change":"2024-02-19T21:37:13.579453+0000","last_active":"2024-02-19T21:38:06.253236+0000","last_peered":"2024-02-19T21:38:06.253236+0000","last_clean":"2024-02-19T21:38:06.253236+0000","last_became_active":"2024-02-19T21:32:23.356886+0000","last_became_peered":"2024-02-19T21:32:23.356886+0000","last_unstale":"2024-02-19T21:38:06.253236+0000","last_undegraded":"2024-02-19T21:38:06.253236+0000","last_fullsized":"2024-02-19T21:38:06.253236+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:13.579375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:37:13.579375+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":106,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:15.868833+0000","last_change":"2024-02-19T21:38:15.868833+0000","last_active":"2024-02-19T21:38:15.868833+0000","last_peered":"2024-02-19T21:38:15.868833+0000","last_clean":"2024-02-19T21:38:15.868833+0000","last_became_active":"2024-02-19T21:32:23.361163+0000","last_became_peered":"2024-02-19T21:32:23.361163+0000","last_unstale":"2024-02-19T21:38:15.868833+0000","last_undegraded":"2024-02-19T21:38:15.868833+0000","last_fullsized":"2024-02-19T21:38:15.868833+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:15.868735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:38:15.868735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":109,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.253650+0000","last_change":"2024-02-19T21:35:18.481101+0000","last_active":"2024-02-19T21:38:06.253650+0000","last_peered":"2024-02-19T21:38:06.253650+0000","last_clean":"2024-02-19T21:38:06.253650+0000","last_became_active":"2024-02-19T21:32:16.878022+0000","last_became_peered":"2024-02-19T21:32:16.878022+0000","last_unstale":"2024-02-19T21:38:06.253650+0000","last_undegraded":"2024-02-19T21:38:06.253650+0000","last_fullsized":"2024-02-19T21:38:06.253650+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:18.480985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:35:18.480985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"66'14","reported_seq":121,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.258437+0000","last_change":"2024-02-19T21:36:01.053309+0000","last_active":"2024-02-19T21:38:06.258437+0000","last_peered":"2024-02-19T21:38:06.258437+0000","last_clean":"2024-02-19T21:38:06.258437+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:38:06.258437+0000","last_undegraded":"2024-02-19T21:38:06.258437+0000","last_fullsized":"2024-02-19T21:38:06.258437+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'14","last_scrub_stamp":"2024-02-19T21:36:01.053232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:01.053232+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":102,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.254388+0000","last_change":"2024-02-19T21:37:07.934832+0000","last_active":"2024-02-19T21:38:06.254388+0000","last_peered":"2024-02-19T21:38:06.254388+0000","last_clean":"2024-02-19T21:38:06.254388+0000","last_became_active":"2024-02-19T21:32:27.373579+0000","last_became_peered":"2024-02-19T21:32:27.373579+0000","last_unstale":"2024-02-19T21:38:06.254388+0000","last_undegraded":"2024-02-19T21:38:06.254388+0000","last_fullsized":"2024-02-19T21:38:06.254388+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:07.934744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:07.934744+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"142'11723","reported_seq":11775,"reported_epoch":142,"state":"active+clean+scrubbing","last_fresh":"2024-02-19T21:38:19.796405+0000","last_change":"2024-02-19T21:38:19.795599+0000","last_active":"2024-02-19T21:38:19.796405+0000","last_peered":"2024-02-19T21:38:19.796405+0000","last_clean":"2024-02-19T21:38:19.796405+0000","last_became_active":"2024-02-19T21:35:19.639005+0000","last_became_peered":"2024-02-19T21:35:19.639005+0000","last_unstale":"2024-02-19T21:38:19.796405+0000","last_undegraded":"2024-02-19T21:38:19.796405+0000","last_fullsized":"2024-02-19T21:38:19.796405+0000","mapping_epoch":100,"log_start":"129'6800","ondisk_log_start":"129'6800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:35:18.622399+0000","log_size":4923,"ondisk_log_size":4923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":157614080,"num_objects":2405,"num_object_clones":0,"num_object_copies":7215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2405,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11723,"num_write_kb":452096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":96,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.262169+0000","last_change":"2024-02-19T21:36:12.016081+0000","last_active":"2024-02-19T21:38:06.262169+0000","last_peered":"2024-02-19T21:38:06.262169+0000","last_clean":"2024-02-19T21:38:06.262169+0000","last_became_active":"2024-02-19T21:32:29.373625+0000","last_became_peered":"2024-02-19T21:32:29.373625+0000","last_unstale":"2024-02-19T21:38:06.262169+0000","last_undegraded":"2024-02-19T21:38:06.262169+0000","last_fullsized":"2024-02-19T21:38:06.262169+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:12.015973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:36:12.015973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":102,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.264680+0000","last_change":"2024-02-19T21:36:00.256569+0000","last_active":"2024-02-19T21:38:06.264680+0000","last_peered":"2024-02-19T21:38:06.264680+0000","last_clean":"2024-02-19T21:38:06.264680+0000","last_became_active":"2024-02-19T21:32:23.359538+0000","last_became_peered":"2024-02-19T21:32:23.359538+0000","last_unstale":"2024-02-19T21:38:06.264680+0000","last_undegraded":"2024-02-19T21:38:06.264680+0000","last_fullsized":"2024-02-19T21:38:06.264680+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:00.256475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:36:00.256475+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":101,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.253627+0000","last_change":"2024-02-19T21:36:05.241479+0000","last_active":"2024-02-19T21:38:06.253627+0000","last_peered":"2024-02-19T21:38:06.253627+0000","last_clean":"2024-02-19T21:38:06.253627+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:38:06.253627+0000","last_undegraded":"2024-02-19T21:38:06.253627+0000","last_fullsized":"2024-02-19T21:38:06.253627+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:05.241389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:36:05.241389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"66'12","reported_seq":148,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:18.908836+0000","last_change":"2024-02-19T21:38:18.908836+0000","last_active":"2024-02-19T21:38:18.908836+0000","last_peered":"2024-02-19T21:38:18.908836+0000","last_clean":"2024-02-19T21:38:18.908836+0000","last_became_active":"2024-02-19T21:33:50.750727+0000","last_became_peered":"2024-02-19T21:33:50.750727+0000","last_unstale":"2024-02-19T21:38:18.908836+0000","last_undegraded":"2024-02-19T21:38:18.908836+0000","last_fullsized":"2024-02-19T21:38:18.908836+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'12","last_scrub_stamp":"2024-02-19T21:38:18.908732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:38:18.908732+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":97,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.247677+0000","last_change":"2024-02-19T21:36:00.595014+0000","last_active":"2024-02-19T21:38:06.247677+0000","last_peered":"2024-02-19T21:38:06.247677+0000","last_clean":"2024-02-19T21:38:06.247677+0000","last_became_active":"2024-02-19T21:32:27.372460+0000","last_became_peered":"2024-02-19T21:32:27.372460+0000","last_unstale":"2024-02-19T21:38:06.247677+0000","last_undegraded":"2024-02-19T21:38:06.247677+0000","last_fullsized":"2024-02-19T21:38:06.247677+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:00.594849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:00.594849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"142'11877","reported_seq":11932,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:19.784233+0000","last_change":"2024-02-19T21:38:12.974623+0000","last_active":"2024-02-19T21:38:19.784233+0000","last_peered":"2024-02-19T21:38:19.784233+0000","last_clean":"2024-02-19T21:38:19.784233+0000","last_became_active":"2024-02-19T21:35:19.638649+0000","last_became_peered":"2024-02-19T21:35:19.638649+0000","last_unstale":"2024-02-19T21:38:19.784233+0000","last_undegraded":"2024-02-19T21:38:19.784233+0000","last_fullsized":"2024-02-19T21:38:19.784233+0000","mapping_epoch":100,"log_start":"125'6200","ondisk_log_start":"125'6200","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'11484","last_scrub_stamp":"2024-02-19T21:38:12.974516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:12.974516+0000","log_size":5677,"ondisk_log_size":5677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":163250176,"num_objects":2491,"num_object_clones":0,"num_object_copies":7473,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2491,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11877,"num_write_kb":459776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":96,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.260880+0000","last_change":"2024-02-19T21:35:55.839055+0000","last_active":"2024-02-19T21:38:06.260880+0000","last_peered":"2024-02-19T21:38:06.260880+0000","last_clean":"2024-02-19T21:38:06.260880+0000","last_became_active":"2024-02-19T21:32:29.597270+0000","last_became_peered":"2024-02-19T21:32:29.597270+0000","last_unstale":"2024-02-19T21:38:06.260880+0000","last_undegraded":"2024-02-19T21:38:06.260880+0000","last_fullsized":"2024-02-19T21:38:06.260880+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:55.838954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:35:55.838954+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":101,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.254624+0000","last_change":"2024-02-19T21:35:59.218786+0000","last_active":"2024-02-19T21:38:06.254624+0000","last_peered":"2024-02-19T21:38:06.254624+0000","last_clean":"2024-02-19T21:38:06.254624+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:38:06.254624+0000","last_undegraded":"2024-02-19T21:38:06.254624+0000","last_fullsized":"2024-02-19T21:38:06.254624+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:59.218696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:35:59.218696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"83'27","reported_seq":149,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.264127+0000","last_change":"2024-02-19T21:37:13.658855+0000","last_active":"2024-02-19T21:38:06.264127+0000","last_peered":"2024-02-19T21:38:06.264127+0000","last_clean":"2024-02-19T21:38:06.264127+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:38:06.264127+0000","last_undegraded":"2024-02-19T21:38:06.264127+0000","last_fullsized":"2024-02-19T21:38:06.264127+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'27","last_scrub_stamp":"2024-02-19T21:37:13.658740+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:37:13.658740+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":104,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.258118+0000","last_change":"2024-02-19T21:37:05.923317+0000","last_active":"2024-02-19T21:38:06.258118+0000","last_peered":"2024-02-19T21:38:06.258118+0000","last_clean":"2024-02-19T21:38:06.258118+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:38:06.258118+0000","last_undegraded":"2024-02-19T21:38:06.258118+0000","last_fullsized":"2024-02-19T21:38:06.258118+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:05.923212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:37:05.923212+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"142'12124","reported_seq":12174,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:19.862704+0000","last_change":"2024-02-19T21:35:20.120603+0000","last_active":"2024-02-19T21:38:19.862704+0000","last_peered":"2024-02-19T21:38:19.862704+0000","last_clean":"2024-02-19T21:38:19.862704+0000","last_became_active":"2024-02-19T21:35:20.120275+0000","last_became_peered":"2024-02-19T21:35:20.120275+0000","last_unstale":"2024-02-19T21:38:19.862704+0000","last_undegraded":"2024-02-19T21:38:19.862704+0000","last_fullsized":"2024-02-19T21:38:19.862704+0000","mapping_epoch":100,"log_start":"130'7400","ondisk_log_start":"130'7400","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:35:18.622399+0000","log_size":4724,"ondisk_log_size":4724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":162660352,"num_objects":2482,"num_object_clones":0,"num_object_copies":7446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2482,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12124,"num_write_kb":467392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4],"acting":[3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":65,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.253156+0000","last_change":"2024-02-19T21:37:05.693047+0000","last_active":"2024-02-19T21:38:06.253156+0000","last_peered":"2024-02-19T21:38:06.253156+0000","last_clean":"2024-02-19T21:38:06.253156+0000","last_became_active":"2024-02-19T21:35:14.514568+0000","last_became_peered":"2024-02-19T21:35:14.514568+0000","last_unstale":"2024-02-19T21:38:06.253156+0000","last_undegraded":"2024-02-19T21:38:06.253156+0000","last_fullsized":"2024-02-19T21:38:06.253156+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:05.692955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:37:05.692955+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":104,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:19.023973+0000","last_change":"2024-02-19T21:38:19.024559+0000","last_active":"2024-02-19T21:38:19.023973+0000","last_peered":"2024-02-19T21:38:19.023973+0000","last_clean":"2024-02-19T21:38:19.023973+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:38:19.023973+0000","last_undegraded":"2024-02-19T21:38:19.023973+0000","last_fullsized":"2024-02-19T21:38:19.023973+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:20.731658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:20.731658+0000","last_clean_scrub_stamp":"2024-02-19T21:35:20.731658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"66'18","reported_seq":131,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.252587+0000","last_change":"2024-02-19T21:36:05.769352+0000","last_active":"2024-02-19T21:38:06.252587+0000","last_peered":"2024-02-19T21:38:06.252587+0000","last_clean":"2024-02-19T21:38:06.252587+0000","last_became_active":"2024-02-19T21:32:25.372700+0000","last_became_peered":"2024-02-19T21:32:25.372700+0000","last_unstale":"2024-02-19T21:38:06.252587+0000","last_undegraded":"2024-02-19T21:38:06.252587+0000","last_fullsized":"2024-02-19T21:38:06.252587+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'18","last_scrub_stamp":"2024-02-19T21:36:05.769256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:05.769256+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":103,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.264453+0000","last_change":"2024-02-19T21:36:53.600165+0000","last_active":"2024-02-19T21:38:06.264453+0000","last_peered":"2024-02-19T21:38:06.264453+0000","last_clean":"2024-02-19T21:38:06.264453+0000","last_became_active":"2024-02-19T21:32:27.363698+0000","last_became_peered":"2024-02-19T21:32:27.363698+0000","last_unstale":"2024-02-19T21:38:06.264453+0000","last_undegraded":"2024-02-19T21:38:06.264453+0000","last_fullsized":"2024-02-19T21:38:06.264453+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:53.600058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:53.600058+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"142'11919","reported_seq":11971,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:19.869595+0000","last_change":"2024-02-19T21:38:19.869595+0000","last_active":"2024-02-19T21:38:19.869595+0000","last_peered":"2024-02-19T21:38:19.869595+0000","last_clean":"2024-02-19T21:38:19.869595+0000","last_became_active":"2024-02-19T21:35:19.640449+0000","last_became_peered":"2024-02-19T21:35:19.640449+0000","last_unstale":"2024-02-19T21:38:19.869595+0000","last_undegraded":"2024-02-19T21:38:19.869595+0000","last_fullsized":"2024-02-19T21:38:19.869595+0000","mapping_epoch":100,"log_start":"130'7200","ondisk_log_start":"130'7200","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:35:18.622399+0000","log_size":4719,"ondisk_log_size":4719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":166395904,"num_objects":2539,"num_object_clones":0,"num_object_copies":7617,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2539,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11919,"num_write_kb":462656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":100,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.254163+0000","last_change":"2024-02-19T21:37:23.993328+0000","last_active":"2024-02-19T21:38:06.254163+0000","last_peered":"2024-02-19T21:38:06.254163+0000","last_clean":"2024-02-19T21:38:06.254163+0000","last_became_active":"2024-02-19T21:32:29.597309+0000","last_became_peered":"2024-02-19T21:32:29.597309+0000","last_unstale":"2024-02-19T21:38:06.254163+0000","last_undegraded":"2024-02-19T21:38:06.254163+0000","last_fullsized":"2024-02-19T21:38:06.254163+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:23.993242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:37:23.993242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":101,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.258562+0000","last_change":"2024-02-19T21:36:04.968027+0000","last_active":"2024-02-19T21:38:06.258562+0000","last_peered":"2024-02-19T21:38:06.258562+0000","last_clean":"2024-02-19T21:38:06.258562+0000","last_became_active":"2024-02-19T21:32:23.354215+0000","last_became_peered":"2024-02-19T21:32:23.354215+0000","last_unstale":"2024-02-19T21:38:06.258562+0000","last_undegraded":"2024-02-19T21:38:06.258562+0000","last_fullsized":"2024-02-19T21:38:06.258562+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:04.967919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:36:04.967919+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"66'14","reported_seq":94,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.246575+0000","last_change":"2024-02-19T21:35:56.625004+0000","last_active":"2024-02-19T21:38:06.246575+0000","last_peered":"2024-02-19T21:38:06.246575+0000","last_clean":"2024-02-19T21:38:06.246575+0000","last_became_active":"2024-02-19T21:35:14.513806+0000","last_became_peered":"2024-02-19T21:35:14.513806+0000","last_unstale":"2024-02-19T21:38:06.246575+0000","last_undegraded":"2024-02-19T21:38:06.246575+0000","last_fullsized":"2024-02-19T21:38:06.246575+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'14","last_scrub_stamp":"2024-02-19T21:35:56.624886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:35:56.624886+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.0","version":"66'8","reported_seq":184,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:11.929381+0000","last_change":"2024-02-19T21:37:07.618714+0000","last_active":"2024-02-19T21:38:11.929381+0000","last_peered":"2024-02-19T21:38:11.929381+0000","last_clean":"2024-02-19T21:38:11.929381+0000","last_became_active":"2024-02-19T21:32:27.368914+0000","last_became_peered":"2024-02-19T21:32:27.368914+0000","last_unstale":"2024-02-19T21:38:11.929381+0000","last_undegraded":"2024-02-19T21:38:11.929381+0000","last_fullsized":"2024-02-19T21:38:11.929381+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:37:07.618614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:07.618614+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"142'11853","reported_seq":11904,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:19.807535+0000","last_change":"2024-02-19T21:35:19.636335+0000","last_active":"2024-02-19T21:38:19.807535+0000","last_peered":"2024-02-19T21:38:19.807535+0000","last_clean":"2024-02-19T21:38:19.807535+0000","last_became_active":"2024-02-19T21:35:19.635979+0000","last_became_peered":"2024-02-19T21:35:19.635979+0000","last_unstale":"2024-02-19T21:38:19.807535+0000","last_undegraded":"2024-02-19T21:38:19.807535+0000","last_fullsized":"2024-02-19T21:38:19.807535+0000","mapping_epoch":100,"log_start":"122'5700","ondisk_log_start":"122'5700","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:35:18.622399+0000","log_size":6153,"ondisk_log_size":6153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":162922520,"num_objects":2487,"num_object_clones":0,"num_object_copies":7461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2487,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11853,"num_write_kb":458817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":100,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.252551+0000","last_change":"2024-02-19T21:37:35.789557+0000","last_active":"2024-02-19T21:38:06.252551+0000","last_peered":"2024-02-19T21:38:06.252551+0000","last_clean":"2024-02-19T21:38:06.252551+0000","last_became_active":"2024-02-19T21:32:29.597229+0000","last_became_peered":"2024-02-19T21:32:29.597229+0000","last_unstale":"2024-02-19T21:38:06.252551+0000","last_undegraded":"2024-02-19T21:38:06.252551+0000","last_fullsized":"2024-02-19T21:38:06.252551+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:37:35.789463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":102,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.247612+0000","last_change":"2024-02-19T21:37:06.982383+0000","last_active":"2024-02-19T21:38:06.247612+0000","last_peered":"2024-02-19T21:38:06.247612+0000","last_clean":"2024-02-19T21:38:06.247612+0000","last_became_active":"2024-02-19T21:32:27.362497+0000","last_became_peered":"2024-02-19T21:32:27.362497+0000","last_unstale":"2024-02-19T21:38:06.247612+0000","last_undegraded":"2024-02-19T21:38:06.247612+0000","last_fullsized":"2024-02-19T21:38:06.247612+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:06.982285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:06.982285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":113,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:11.707510+0000","last_change":"2024-02-19T21:38:11.707510+0000","last_active":"2024-02-19T21:38:11.707510+0000","last_peered":"2024-02-19T21:38:11.707510+0000","last_clean":"2024-02-19T21:38:11.707510+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:38:11.707510+0000","last_undegraded":"2024-02-19T21:38:11.707510+0000","last_fullsized":"2024-02-19T21:38:11.707510+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:38:11.707428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:38:11.707428+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"66'11","reported_seq":92,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.258444+0000","last_change":"2024-02-19T21:35:15.027984+0000","last_active":"2024-02-19T21:38:06.258444+0000","last_peered":"2024-02-19T21:38:06.258444+0000","last_clean":"2024-02-19T21:38:06.258444+0000","last_became_active":"2024-02-19T21:35:14.513889+0000","last_became_peered":"2024-02-19T21:35:14.513889+0000","last_unstale":"2024-02-19T21:38:06.258444+0000","last_undegraded":"2024-02-19T21:38:06.258444+0000","last_fullsized":"2024-02-19T21:38:06.258444+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:35:15.027904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:35:15.027904+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.c","version":"142'12000","reported_seq":12055,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:19.808521+0000","last_change":"2024-02-19T21:38:19.330127+0000","last_active":"2024-02-19T21:38:19.808521+0000","last_peered":"2024-02-19T21:38:19.808521+0000","last_clean":"2024-02-19T21:38:19.808521+0000","last_became_active":"2024-02-19T21:35:19.639085+0000","last_became_peered":"2024-02-19T21:35:19.639085+0000","last_unstale":"2024-02-19T21:38:19.808521+0000","last_undegraded":"2024-02-19T21:38:19.808521+0000","last_fullsized":"2024-02-19T21:38:19.808521+0000","mapping_epoch":100,"log_start":"122'5800","ondisk_log_start":"122'5800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'11969","last_scrub_stamp":"2024-02-19T21:38:19.330024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:19.330024+0000","log_size":6200,"ondisk_log_size":6200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160563200,"num_objects":2450,"num_object_clones":0,"num_object_copies":7350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2450,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12000,"num_write_kb":462400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":100,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.247204+0000","last_change":"2024-02-19T21:36:15.780162+0000","last_active":"2024-02-19T21:38:06.247204+0000","last_peered":"2024-02-19T21:38:06.247204+0000","last_clean":"2024-02-19T21:38:06.247204+0000","last_became_active":"2024-02-19T21:32:29.378462+0000","last_became_peered":"2024-02-19T21:32:29.378462+0000","last_unstale":"2024-02-19T21:38:06.247204+0000","last_undegraded":"2024-02-19T21:38:06.247204+0000","last_fullsized":"2024-02-19T21:38:06.247204+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:15.780083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:36:15.780083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"98'9","reported_seq":120,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:11.922223+0000","last_change":"2024-02-19T21:35:53.660231+0000","last_active":"2024-02-19T21:38:11.922223+0000","last_peered":"2024-02-19T21:38:11.922223+0000","last_clean":"2024-02-19T21:38:11.922223+0000","last_became_active":"2024-02-19T21:35:14.513802+0000","last_became_peered":"2024-02-19T21:35:14.513802+0000","last_unstale":"2024-02-19T21:38:11.922223+0000","last_undegraded":"2024-02-19T21:38:11.922223+0000","last_fullsized":"2024-02-19T21:38:11.922223+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'9","last_scrub_stamp":"2024-02-19T21:35:53.660117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:35:53.660117+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":107,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.256791+0000","last_change":"2024-02-19T21:36:15.924099+0000","last_active":"2024-02-19T21:38:06.256791+0000","last_peered":"2024-02-19T21:38:06.256791+0000","last_clean":"2024-02-19T21:38:06.256791+0000","last_became_active":"2024-02-19T21:32:23.362738+0000","last_became_peered":"2024-02-19T21:32:23.362738+0000","last_unstale":"2024-02-19T21:38:06.256791+0000","last_undegraded":"2024-02-19T21:38:06.256791+0000","last_fullsized":"2024-02-19T21:38:06.256791+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:15.923991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:36:15.923991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"66'15","reported_seq":130,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.261710+0000","last_change":"2024-02-19T21:36:17.850403+0000","last_active":"2024-02-19T21:38:06.261710+0000","last_peered":"2024-02-19T21:38:06.261710+0000","last_clean":"2024-02-19T21:38:06.261710+0000","last_became_active":"2024-02-19T21:32:25.367511+0000","last_became_peered":"2024-02-19T21:32:25.367511+0000","last_unstale":"2024-02-19T21:38:06.261710+0000","last_undegraded":"2024-02-19T21:38:06.261710+0000","last_fullsized":"2024-02-19T21:38:06.261710+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:36:17.850310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:17.850310+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"142'11992","reported_seq":12046,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:19.942830+0000","last_change":"2024-02-19T21:37:12.025532+0000","last_active":"2024-02-19T21:38:19.942830+0000","last_peered":"2024-02-19T21:38:19.942830+0000","last_clean":"2024-02-19T21:38:19.942830+0000","last_became_active":"2024-02-19T21:35:19.639909+0000","last_became_peered":"2024-02-19T21:35:19.639909+0000","last_unstale":"2024-02-19T21:38:19.942830+0000","last_undegraded":"2024-02-19T21:38:19.942830+0000","last_fullsized":"2024-02-19T21:38:19.942830+0000","mapping_epoch":100,"log_start":"127'6500","ondisk_log_start":"127'6500","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'8025","last_scrub_stamp":"2024-02-19T21:37:12.025401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:12.025401+0000","log_size":5492,"ondisk_log_size":5492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":162004992,"num_objects":2472,"num_object_clones":0,"num_object_copies":7416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2472,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11992,"num_write_kb":462848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":61,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.261108+0000","last_change":"2024-02-19T21:35:18.708652+0000","last_active":"2024-02-19T21:38:06.261108+0000","last_peered":"2024-02-19T21:38:06.261108+0000","last_clean":"2024-02-19T21:38:06.261108+0000","last_became_active":"2024-02-19T21:35:14.515342+0000","last_became_peered":"2024-02-19T21:35:14.515342+0000","last_unstale":"2024-02-19T21:38:06.261108+0000","last_undegraded":"2024-02-19T21:38:06.261108+0000","last_fullsized":"2024-02-19T21:38:06.261108+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:18.708535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:35:18.708535+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"83'9","reported_seq":182,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:11.922171+0000","last_change":"2024-02-19T21:37:16.989938+0000","last_active":"2024-02-19T21:38:11.922171+0000","last_peered":"2024-02-19T21:38:11.922171+0000","last_clean":"2024-02-19T21:38:11.922171+0000","last_became_active":"2024-02-19T21:32:27.363859+0000","last_became_peered":"2024-02-19T21:32:27.363859+0000","last_unstale":"2024-02-19T21:38:11.922171+0000","last_undegraded":"2024-02-19T21:38:11.922171+0000","last_fullsized":"2024-02-19T21:38:11.922171+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'9","last_scrub_stamp":"2024-02-19T21:37:16.989836+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:37:16.989836+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":102,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.261175+0000","last_change":"2024-02-19T21:35:04.768053+0000","last_active":"2024-02-19T21:38:06.261175+0000","last_peered":"2024-02-19T21:38:06.261175+0000","last_clean":"2024-02-19T21:38:06.261175+0000","last_became_active":"2024-02-19T21:32:23.363155+0000","last_became_peered":"2024-02-19T21:32:23.363155+0000","last_unstale":"2024-02-19T21:38:06.261175+0000","last_undegraded":"2024-02-19T21:38:06.261175+0000","last_fullsized":"2024-02-19T21:38:06.261175+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:35:04.767979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"66'10","reported_seq":88,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.253012+0000","last_change":"2024-02-19T21:37:22.544888+0000","last_active":"2024-02-19T21:38:06.253012+0000","last_peered":"2024-02-19T21:38:06.253012+0000","last_clean":"2024-02-19T21:38:06.253012+0000","last_became_active":"2024-02-19T21:35:14.514968+0000","last_became_peered":"2024-02-19T21:35:14.514968+0000","last_unstale":"2024-02-19T21:38:06.253012+0000","last_undegraded":"2024-02-19T21:38:06.253012+0000","last_fullsized":"2024-02-19T21:38:06.253012+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:37:22.544818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:22.544818+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6],"acting":[3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"142'11755","reported_seq":11812,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:19.822572+0000","last_change":"2024-02-19T21:37:05.416082+0000","last_active":"2024-02-19T21:38:19.822572+0000","last_peered":"2024-02-19T21:38:19.822572+0000","last_clean":"2024-02-19T21:38:19.822572+0000","last_became_active":"2024-02-19T21:35:19.638981+0000","last_became_peered":"2024-02-19T21:35:19.638981+0000","last_unstale":"2024-02-19T21:38:19.822572+0000","last_undegraded":"2024-02-19T21:38:19.822572+0000","last_fullsized":"2024-02-19T21:38:19.822572+0000","mapping_epoch":100,"log_start":"119'5200","ondisk_log_start":"119'5200","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'7433","last_scrub_stamp":"2024-02-19T21:37:05.415974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:05.415974+0000","log_size":6555,"ondisk_log_size":6555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":156696576,"num_objects":2391,"num_object_clones":0,"num_object_copies":7173,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2391,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11755,"num_write_kb":452672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":100,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.263461+0000","last_change":"2024-02-19T21:36:57.989524+0000","last_active":"2024-02-19T21:38:06.263461+0000","last_peered":"2024-02-19T21:38:06.263461+0000","last_clean":"2024-02-19T21:38:06.263461+0000","last_became_active":"2024-02-19T21:32:29.371946+0000","last_became_peered":"2024-02-19T21:32:29.371946+0000","last_unstale":"2024-02-19T21:38:06.263461+0000","last_undegraded":"2024-02-19T21:38:06.263461+0000","last_fullsized":"2024-02-19T21:38:06.263461+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:57.989420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:36:57.989420+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":98,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.262128+0000","last_change":"2024-02-19T21:35:58.886991+0000","last_active":"2024-02-19T21:38:06.262128+0000","last_peered":"2024-02-19T21:38:06.262128+0000","last_clean":"2024-02-19T21:38:06.262128+0000","last_became_active":"2024-02-19T21:32:27.369452+0000","last_became_peered":"2024-02-19T21:32:27.369452+0000","last_unstale":"2024-02-19T21:38:06.262128+0000","last_undegraded":"2024-02-19T21:38:06.262128+0000","last_fullsized":"2024-02-19T21:38:06.262128+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:58.886937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:35:58.886937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":108,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.254008+0000","last_change":"2024-02-19T21:37:18.042043+0000","last_active":"2024-02-19T21:38:06.254008+0000","last_peered":"2024-02-19T21:38:06.254008+0000","last_clean":"2024-02-19T21:38:06.254008+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:38:06.254008+0000","last_undegraded":"2024-02-19T21:38:06.254008+0000","last_fullsized":"2024-02-19T21:38:06.254008+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:18.041939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:37:18.041939+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"66'17","reported_seq":106,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:19.154861+0000","last_change":"2024-02-19T21:38:19.154861+0000","last_active":"2024-02-19T21:38:19.154861+0000","last_peered":"2024-02-19T21:38:19.154861+0000","last_clean":"2024-02-19T21:38:19.154861+0000","last_became_active":"2024-02-19T21:35:14.516588+0000","last_became_peered":"2024-02-19T21:35:14.516588+0000","last_unstale":"2024-02-19T21:38:19.154861+0000","last_undegraded":"2024-02-19T21:38:19.154861+0000","last_fullsized":"2024-02-19T21:38:19.154861+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'17","last_scrub_stamp":"2024-02-19T21:38:19.154753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:38:19.154753+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"142'11544","reported_seq":11599,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:19.953686+0000","last_change":"2024-02-19T21:37:17.375432+0000","last_active":"2024-02-19T21:38:19.953686+0000","last_peered":"2024-02-19T21:38:19.953686+0000","last_clean":"2024-02-19T21:38:19.953686+0000","last_became_active":"2024-02-19T21:35:20.121957+0000","last_became_peered":"2024-02-19T21:35:20.121957+0000","last_unstale":"2024-02-19T21:38:19.953686+0000","last_undegraded":"2024-02-19T21:38:19.953686+0000","last_fullsized":"2024-02-19T21:38:19.953686+0000","mapping_epoch":100,"log_start":"125'6000","ondisk_log_start":"125'6000","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"131'7984","last_scrub_stamp":"2024-02-19T21:37:17.375364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:17.375364+0000","log_size":5544,"ondisk_log_size":5544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":158597120,"num_objects":2420,"num_object_clones":0,"num_object_copies":7260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2420,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11544,"num_write_kb":446848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":100,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.253588+0000","last_change":"2024-02-19T21:37:29.936229+0000","last_active":"2024-02-19T21:38:06.253588+0000","last_peered":"2024-02-19T21:38:06.253588+0000","last_clean":"2024-02-19T21:38:06.253588+0000","last_became_active":"2024-02-19T21:32:29.373442+0000","last_became_peered":"2024-02-19T21:32:29.373442+0000","last_unstale":"2024-02-19T21:38:06.253588+0000","last_undegraded":"2024-02-19T21:38:06.253588+0000","last_fullsized":"2024-02-19T21:38:06.253588+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:37:29.936139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":102,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.263478+0000","last_change":"2024-02-19T21:36:57.004075+0000","last_active":"2024-02-19T21:38:06.263478+0000","last_peered":"2024-02-19T21:38:06.263478+0000","last_clean":"2024-02-19T21:38:06.263478+0000","last_became_active":"2024-02-19T21:32:27.369020+0000","last_became_peered":"2024-02-19T21:32:27.369020+0000","last_unstale":"2024-02-19T21:38:06.263478+0000","last_undegraded":"2024-02-19T21:38:06.263478+0000","last_fullsized":"2024-02-19T21:38:06.263478+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:57.003986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:46.372184+0000","last_clean_scrub_stamp":"2024-02-19T21:36:57.003986+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"59'1","reported_seq":112,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.263461+0000","last_change":"2024-02-19T21:37:18.928676+0000","last_active":"2024-02-19T21:38:06.263461+0000","last_peered":"2024-02-19T21:38:06.263461+0000","last_clean":"2024-02-19T21:38:06.263461+0000","last_became_active":"2024-02-19T21:32:23.359474+0000","last_became_peered":"2024-02-19T21:32:23.359474+0000","last_unstale":"2024-02-19T21:38:06.263461+0000","last_undegraded":"2024-02-19T21:38:06.263461+0000","last_fullsized":"2024-02-19T21:38:06.263461+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:37:18.928610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:37:18.928610+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"115'28","reported_seq":144,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.258151+0000","last_change":"2024-02-19T21:36:09.031773+0000","last_active":"2024-02-19T21:38:06.258151+0000","last_peered":"2024-02-19T21:38:06.258151+0000","last_clean":"2024-02-19T21:38:06.258151+0000","last_became_active":"2024-02-19T21:32:25.372284+0000","last_became_peered":"2024-02-19T21:32:25.372284+0000","last_unstale":"2024-02-19T21:38:06.258151+0000","last_undegraded":"2024-02-19T21:38:06.258151+0000","last_fullsized":"2024-02-19T21:38:06.258151+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'28","last_scrub_stamp":"2024-02-19T21:36:09.031674+0000","last_deep_scrub":"115'28","last_deep_scrub_stamp":"2024-02-19T21:36:09.031674+0000","last_clean_scrub_stamp":"2024-02-19T21:36:09.031674+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.8","version":"142'11803","reported_seq":11861,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:19.734260+0000","last_change":"2024-02-19T21:38:11.071417+0000","last_active":"2024-02-19T21:38:19.734260+0000","last_peered":"2024-02-19T21:38:19.734260+0000","last_clean":"2024-02-19T21:38:19.734260+0000","last_became_active":"2024-02-19T21:35:20.120284+0000","last_became_peered":"2024-02-19T21:35:20.120284+0000","last_unstale":"2024-02-19T21:38:19.734260+0000","last_undegraded":"2024-02-19T21:38:19.734260+0000","last_fullsized":"2024-02-19T21:38:19.734260+0000","mapping_epoch":100,"log_start":"119'5200","ondisk_log_start":"119'5200","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'11304","last_scrub_stamp":"2024-02-19T21:38:11.071303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:11.071303+0000","log_size":6603,"ondisk_log_size":6603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":161021952,"num_objects":2457,"num_object_clones":0,"num_object_copies":7371,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2457,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11803,"num_write_kb":456320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4],"acting":[2,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":101,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.264882+0000","last_change":"2024-02-19T21:36:55.508810+0000","last_active":"2024-02-19T21:38:06.264882+0000","last_peered":"2024-02-19T21:38:06.264882+0000","last_clean":"2024-02-19T21:38:06.264882+0000","last_became_active":"2024-02-19T21:32:29.375689+0000","last_became_peered":"2024-02-19T21:32:29.375689+0000","last_unstale":"2024-02-19T21:38:06.264882+0000","last_undegraded":"2024-02-19T21:38:06.264882+0000","last_fullsized":"2024-02-19T21:38:06.264882+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:55.508708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:36:55.508708+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":102,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.259822+0000","last_change":"2024-02-19T21:36:07.058840+0000","last_active":"2024-02-19T21:38:06.259822+0000","last_peered":"2024-02-19T21:38:06.259822+0000","last_clean":"2024-02-19T21:38:06.259822+0000","last_became_active":"2024-02-19T21:32:27.361539+0000","last_became_peered":"2024-02-19T21:32:27.361539+0000","last_unstale":"2024-02-19T21:38:06.259822+0000","last_undegraded":"2024-02-19T21:38:06.259822+0000","last_fullsized":"2024-02-19T21:38:06.259822+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:07.058748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:07.058748+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":107,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.261799+0000","last_change":"2024-02-19T21:37:36.883246+0000","last_active":"2024-02-19T21:38:06.261799+0000","last_peered":"2024-02-19T21:38:06.261799+0000","last_clean":"2024-02-19T21:38:06.261799+0000","last_became_active":"2024-02-19T21:32:23.357438+0000","last_became_peered":"2024-02-19T21:32:23.357438+0000","last_unstale":"2024-02-19T21:38:06.261799+0000","last_undegraded":"2024-02-19T21:38:06.261799+0000","last_fullsized":"2024-02-19T21:38:06.261799+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:36.883151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:37:36.883151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"66'9","reported_seq":121,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.264224+0000","last_change":"2024-02-19T21:36:56.503874+0000","last_active":"2024-02-19T21:38:06.264224+0000","last_peered":"2024-02-19T21:38:06.264224+0000","last_clean":"2024-02-19T21:38:06.264224+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:38:06.264224+0000","last_undegraded":"2024-02-19T21:38:06.264224+0000","last_fullsized":"2024-02-19T21:38:06.264224+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:36:56.503779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:56.503779+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"142'11819","reported_seq":11869,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:19.834697+0000","last_change":"2024-02-19T21:35:19.637187+0000","last_active":"2024-02-19T21:38:19.834697+0000","last_peered":"2024-02-19T21:38:19.834697+0000","last_clean":"2024-02-19T21:38:19.834697+0000","last_became_active":"2024-02-19T21:35:19.636837+0000","last_became_peered":"2024-02-19T21:35:19.636837+0000","last_unstale":"2024-02-19T21:38:19.834697+0000","last_undegraded":"2024-02-19T21:38:19.834697+0000","last_fullsized":"2024-02-19T21:38:19.834697+0000","mapping_epoch":100,"log_start":"128'6700","ondisk_log_start":"128'6700","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:35:18.622399+0000","log_size":5119,"ondisk_log_size":5119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":166789120,"num_objects":2545,"num_object_clones":0,"num_object_copies":7635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2545,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11819,"num_write_kb":459648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":100,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.247297+0000","last_change":"2024-02-19T21:36:14.779507+0000","last_active":"2024-02-19T21:38:06.247297+0000","last_peered":"2024-02-19T21:38:06.247297+0000","last_clean":"2024-02-19T21:38:06.247297+0000","last_became_active":"2024-02-19T21:32:29.597248+0000","last_became_peered":"2024-02-19T21:32:29.597248+0000","last_unstale":"2024-02-19T21:38:06.247297+0000","last_undegraded":"2024-02-19T21:38:06.247297+0000","last_fullsized":"2024-02-19T21:38:06.247297+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:36:14.779443+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":106,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.263870+0000","last_change":"2024-02-19T21:37:33.010649+0000","last_active":"2024-02-19T21:38:06.263870+0000","last_peered":"2024-02-19T21:38:06.263870+0000","last_clean":"2024-02-19T21:38:06.263870+0000","last_became_active":"2024-02-19T21:32:23.357486+0000","last_became_peered":"2024-02-19T21:32:23.357486+0000","last_unstale":"2024-02-19T21:38:06.263870+0000","last_undegraded":"2024-02-19T21:38:06.263870+0000","last_fullsized":"2024-02-19T21:38:06.263870+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:33.010549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:33.010549+0000","last_clean_scrub_stamp":"2024-02-19T21:37:33.010549+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"66'15","reported_seq":131,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-02-19T21:38:06.246575+0000","last_change":"2024-02-19T21:37:05.934106+0000","last_active":"2024-02-19T21:38:06.246575+0000","last_peered":"2024-02-19T21:38:06.246575+0000","last_clean":"2024-02-19T21:38:06.246575+0000","last_became_active":"2024-02-19T21:32:25.372170+0000","last_became_peered":"2024-02-19T21:32:25.372170+0000","last_unstale":"2024-02-19T21:38:06.246575+0000","last_undegraded":"2024-02-19T21:38:06.246575+0000","last_fullsized":"2024-02-19T21:38:06.246575+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:37:05.934032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:05.934032+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"66'8","reported_seq":181,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-02-19T21:38:11.927581+0000","last_change":"2024-02-19T21:37:27.997824+0000","last_active":"2024-02-19T21:38:11.927581+0000","last_peered":"2024-02-19T21:38:11.927581+0000","last_clean":"2024-02-19T21:38:11.927581+0000","last_became_active":"2024-02-19T21:32:27.369840+0000","last_became_peered":"2024-02-19T21:32:27.369840+0000","last_unstale":"2024-02-19T21:38:11.927581+0000","last_undegraded":"2024-02-19T21:38:11.927581+0000","last_fullsized":"2024-02-19T21:38:11.927581+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:37:27.997724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:27.997724+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":2593259544,"num_objects":39571,"num_object_clones":0,"num_object_copies":118713,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39571,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":189893,"num_write_kb":7342785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7779004416,"data_stored":7778992200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88293,"ondisk_log_size":88293,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":3},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":348,"num_read_kb":343,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":693,"num_read_kb":450,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":432,"ondisk_log_size":432,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":66,"ondisk_log_size":66,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201354,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1088752,"kb_used_data":787432,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":92656400,"statfs":{"total":95995035648,"available":94880153600,"internally_reserved":0,"allocated":806330368,"data_stored":806017982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:37:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":0.75600000000000001,"15min":0.61699999999999999},"min":{"1min":0.249,"5min":0.219,"15min":0.219},"max":{"1min":4.9429999999999996,"5min":4.9429999999999996,"15min":4.9429999999999996},"last":0.45300000000000001},{"interface":"front","average":{"1min":2.0009999999999999,"5min":1.026,"15min":0.70599999999999996},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":5.694,"5min":5.694,"15min":5.694},"last":2.508}]},{"osd":1,"last update":"Mon Feb 19 21:37:21 2024","interfaces":[{"interface":"back","average":{"1min":2.5830000000000002,"5min":1.052,"15min":0.69599999999999995},"min":{"1min":0.27200000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":9.1639999999999997,"5min":9.1639999999999997,"15min":9.1639999999999997},"last":2.1040000000000001},{"interface":"front","average":{"1min":1.9970000000000001,"5min":0.93600000000000005,"15min":0.67400000000000004},"min":{"1min":0.28899999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":5.3639999999999999,"5min":7.2930000000000001,"15min":7.2930000000000001},"last":2.3210000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:37:21 2024","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":0.88500000000000001,"15min":0.65200000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.8250000000000002,"5min":3.0779999999999998,"15min":3.0779999999999998},"last":0.85699999999999998},{"interface":"front","average":{"1min":2.1099999999999999,"5min":0.94099999999999995,"15min":0.66900000000000004},"min":{"1min":0.312,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":8.3409999999999993,"5min":8.3409999999999993,"15min":8.3409999999999993},"last":5.5609999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:37:21 2024","interfaces":[{"interface":"back","average":{"1min":3.25,"5min":1.2889999999999999,"15min":0.79300000000000004},"min":{"1min":0.29799999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":31.559000000000001,"5min":31.559000000000001,"15min":31.559000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":3.9449999999999998,"5min":1.3220000000000001,"15min":0.79500000000000004},"min":{"1min":0.34000000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":30.812999999999999,"5min":30.812999999999999,"15min":30.812999999999999},"last":1.014}]},{"osd":4,"last update":"Mon Feb 19 21:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.53200000000000003,"15min":0.48599999999999999},"min":{"1min":0.26100000000000001,"5min":0.249,"15min":0.249},"max":{"1min":3.52,"5min":3.52,"15min":3.52},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.53800000000000003,"15min":0.496},"min":{"1min":0.308,"5min":0.245,"15min":0.245},"max":{"1min":3.6480000000000001,"5min":3.6480000000000001,"15min":3.6480000000000001},"last":0.40200000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.57399999999999995,"15min":0.63800000000000001},"min":{"1min":0.307,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.2130000000000001,"5min":4.6390000000000002,"15min":4.6390000000000002},"last":1.8460000000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.65100000000000002,"15min":0.53500000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":3.4809999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":0.55300000000000005}]},{"osd":6,"last update":"Mon Feb 19 21:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.65500000000000003,"15min":0.56499999999999995},"min":{"1min":0.32100000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":3.6099999999999999,"5min":3.6099999999999999,"15min":3.6099999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.70499999999999996,"15min":0.86799999999999999},"min":{"1min":0.35599999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":3.6800000000000002,"5min":8.8030000000000008,"15min":8.8030000000000008},"last":0.64600000000000002}]}]},{"osd":6,"up_from":47,"seq":201863462993,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1103004,"kb_used_data":805780,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":92642148,"statfs":{"total":95995035648,"available":94865559552,"internally_reserved":0,"allocated":825118720,"data_stored":824825660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:37:58 2024","interfaces":[{"interface":"back","average":{"1min":1.9830000000000001,"5min":1.1499999999999999,"15min":0.70599999999999996},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":5.7919999999999998,"5min":9.0109999999999992,"15min":9.0109999999999992},"last":0.20599999999999999},{"interface":"front","average":{"1min":2.6120000000000001,"5min":1.302,"15min":0.752},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":13.973000000000001,"5min":13.973000000000001,"15min":13.973000000000001},"last":3.6960000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:37:58 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.1319999999999999,"15min":0.71099999999999997},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":3.3330000000000002,"5min":12.574999999999999,"15min":12.574999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":2.2229999999999999,"5min":1.085,"15min":0.67500000000000004},"min":{"1min":0.35299999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":6.4020000000000001,"5min":6.4020000000000001,"15min":6.4020000000000001},"last":1.571}]},{"osd":2,"last update":"Mon Feb 19 21:37:58 2024","interfaces":[{"interface":"back","average":{"1min":2.1869999999999998,"5min":1.1060000000000001,"15min":0.70399999999999996},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":8.1379999999999999,"5min":8.1379999999999999,"15min":8.1379999999999999},"last":1.601},{"interface":"front","average":{"1min":2.0059999999999998,"5min":1.198,"15min":0.70999999999999996},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":5.782,"5min":18.068000000000001,"15min":18.068000000000001},"last":3.5139999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:37:58 2024","interfaces":[{"interface":"back","average":{"1min":2.3370000000000002,"5min":1.321,"15min":0.77700000000000002},"min":{"1min":0.28999999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":8.2949999999999999,"5min":8.9890000000000008,"15min":8.9890000000000008},"last":0.31},{"interface":"front","average":{"1min":2.7290000000000001,"5min":1.4139999999999999,"15min":0.79500000000000004},"min":{"1min":0.33700000000000002,"5min":0.246,"15min":0.246},"max":{"1min":19.632999999999999,"5min":19.632999999999999,"15min":19.632999999999999},"last":2.2850000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:37:58 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.61399999999999999,"15min":0.45700000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":4.0359999999999996,"5min":4.0359999999999996,"15min":4.0359999999999996},"last":0.436},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.57399999999999995,"15min":0.46000000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":2.9180000000000001,"5min":2.9180000000000001,"15min":2.9180000000000001},"last":0.33200000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:37:58 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":0.63700000000000001,"15min":0.48799999999999999},"min":{"1min":0.27700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":5.6379999999999999,"5min":5.6379999999999999,"15min":5.6379999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":1.1870000000000001,"5min":0.68700000000000006,"15min":0.496},"min":{"1min":0.318,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":5.8479999999999999,"5min":5.8479999999999999,"15min":5.8479999999999999},"last":0.372}]},{"osd":7,"last update":"Mon Feb 19 21:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59299999999999997,"15min":0.51700000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":4.3639999999999999,"5min":4.3639999999999999,"15min":4.3639999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.67100000000000004,"15min":0.58699999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":4.3840000000000003,"5min":4.3840000000000003,"15min":4.3840000000000003},"last":0.39000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574955,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1285268,"kb_used_data":975692,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":92459884,"statfs":{"total":95995035648,"available":94678921216,"internally_reserved":0,"allocated":999108608,"data_stored":998760284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:37:48 2024","interfaces":[{"interface":"back","average":{"1min":2.5139999999999998,"5min":1.343,"15min":0.67900000000000005},"min":{"1min":0.222,"5min":0.221,"15min":0.193},"max":{"1min":8.25,"5min":11.372,"15min":11.372},"last":5.3280000000000003},{"interface":"front","average":{"1min":3.266,"5min":1.2549999999999999,"15min":0.64900000000000002},"min":{"1min":0.29399999999999998,"5min":0.185,"15min":0.185},"max":{"1min":10.121,"5min":10.121,"15min":10.121},"last":0.189}]},{"osd":2,"last update":"Mon Feb 19 21:37:21 2024","interfaces":[{"interface":"back","average":{"1min":4.0359999999999996,"5min":1.544,"15min":0.76000000000000001},"min":{"1min":0.23400000000000001,"5min":0.22,"15min":0.22},"max":{"1min":8.9290000000000003,"5min":11.826000000000001,"15min":11.826000000000001},"last":5.3049999999999997},{"interface":"front","average":{"1min":4.2290000000000001,"5min":1.627,"15min":0.80400000000000005},"min":{"1min":0.41499999999999998,"5min":0.248,"15min":0.248},"max":{"1min":12.26,"5min":12.26,"15min":12.26},"last":4.8280000000000003}]},{"osd":3,"last update":"Mon Feb 19 21:37:48 2024","interfaces":[{"interface":"back","average":{"1min":3.4769999999999999,"5min":1.6359999999999999,"15min":0.83699999999999997},"min":{"1min":0.308,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":10.923,"5min":10.923,"15min":10.923},"last":0.254},{"interface":"front","average":{"1min":2.1480000000000001,"5min":1.2090000000000001,"15min":0.68999999999999995},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":8.7929999999999993,"5min":11.413,"15min":11.413},"last":5.3440000000000003}]},{"osd":4,"last update":"Mon Feb 19 21:38:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.86699999999999999,"15min":0.70199999999999996},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":6.0380000000000003,"5min":7.3330000000000002,"15min":7.3330000000000002},"last":2.9100000000000001},{"interface":"front","average":{"1min":2.0259999999999998,"5min":1.272,"15min":0.83699999999999997},"min":{"1min":0.33600000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":7.0919999999999996,"5min":10.51,"15min":10.51},"last":0.26600000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:37:31 2024","interfaces":[{"interface":"back","average":{"1min":1.8859999999999999,"5min":1.0469999999999999,"15min":0.73899999999999999},"min":{"1min":0.31,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":7.109,"5min":10.458,"15min":10.458},"last":0.28799999999999998},{"interface":"front","average":{"1min":1.8280000000000001,"5min":1.0029999999999999,"15min":0.74299999999999999},"min":{"1min":0.374,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":7.6950000000000003,"5min":7.6950000000000003,"15min":7.6950000000000003},"last":0.34300000000000003}]},{"osd":6,"last update":"Mon Feb 19 21:38:02 2024","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":0.93500000000000005,"15min":0.71799999999999997},"min":{"1min":0.36399999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":5.9939999999999998,"5min":7.375,"15min":7.375},"last":2.9420000000000002},{"interface":"front","average":{"1min":1.337,"5min":1.0980000000000001,"15min":0.78300000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":7.7389999999999999,"5min":7.7389999999999999,"15min":7.7389999999999999},"last":0.36799999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:37:26 2024","interfaces":[{"interface":"back","average":{"1min":2.3050000000000002,"5min":1.28,"15min":0.81299999999999994},"min":{"1min":0.42899999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":7.718,"5min":10.638999999999999,"15min":10.638999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":1.8,"5min":0.96599999999999997,"15min":0.73099999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":7.4109999999999996,"5min":7.4109999999999996,"15min":7.4109999999999996},"last":2.8719999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738481,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1548984,"kb_used_data":1247152,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":92196168,"statfs":{"total":95995035648,"available":94408876032,"internally_reserved":0,"allocated":1277083648,"data_stored":1276763149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:37:55 2024","interfaces":[{"interface":"back","average":{"1min":2.5819999999999999,"5min":1.079,"15min":0.56399999999999995},"min":{"1min":0.20300000000000001,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":10.959,"5min":10.959,"15min":10.959},"last":2.4289999999999998},{"interface":"front","average":{"1min":3.702,"5min":1.6639999999999999,"15min":0.76900000000000002},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":12.398,"5min":12.398,"15min":12.398},"last":8.9939999999999998}]},{"osd":2,"last update":"Mon Feb 19 21:37:23 2024","interfaces":[{"interface":"back","average":{"1min":2.3300000000000001,"5min":1.1319999999999999,"15min":0.62},"min":{"1min":0.31,"5min":0.255,"15min":0.23999999999999999},"max":{"1min":10.996,"5min":10.996,"15min":10.996},"last":1.774},{"interface":"front","average":{"1min":3.4380000000000002,"5min":1.502,"15min":0.75},"min":{"1min":0.318,"5min":0.25,"15min":0.24299999999999999},"max":{"1min":12.154999999999999,"5min":12.154999999999999,"15min":12.154999999999999},"last":3.7759999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:37:38 2024","interfaces":[{"interface":"back","average":{"1min":4.8230000000000004,"5min":1.798,"15min":0.86799999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":14.507999999999999,"5min":14.507999999999999,"15min":14.507999999999999},"last":10.358000000000001},{"interface":"front","average":{"1min":2.956,"5min":1.532,"15min":0.80800000000000005},"min":{"1min":0.27400000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":8.6699999999999999,"5min":11.103999999999999,"15min":11.103999999999999},"last":1.502}]},{"osd":4,"last update":"Mon Feb 19 21:38:14 2024","interfaces":[{"interface":"back","average":{"1min":2.363,"5min":1.232,"15min":0.80300000000000005},"min":{"1min":0.29799999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":9.8140000000000001,"5min":9.8140000000000001,"15min":9.8140000000000001},"last":9.6430000000000007},{"interface":"front","average":{"1min":1.8360000000000001,"5min":1.089,"15min":0.77200000000000002},"min":{"1min":0.317,"5min":0.255,"15min":0.255},"max":{"1min":8.9450000000000003,"5min":8.9450000000000003,"15min":8.9450000000000003},"last":0.34599999999999997}]},{"osd":5,"last update":"Mon Feb 19 21:37:38 2024","interfaces":[{"interface":"back","average":{"1min":2.5270000000000001,"5min":1.294,"15min":0.85299999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":9.7479999999999993,"5min":9.7479999999999993,"15min":9.7479999999999993},"last":2.6840000000000002},{"interface":"front","average":{"1min":1.8819999999999999,"5min":1.044,"15min":0.76800000000000002},"min":{"1min":0.33300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":9.8550000000000004,"5min":9.8550000000000004,"15min":9.8550000000000004},"last":9.7089999999999996}]},{"osd":6,"last update":"Mon Feb 19 21:37:59 2024","interfaces":[{"interface":"back","average":{"1min":4.1139999999999999,"5min":1.448,"15min":0.91000000000000003},"min":{"1min":0.437,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":42.777000000000001,"5min":42.777000000000001,"15min":42.777000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":2.6030000000000002,"5min":1.3660000000000001,"15min":0.85899999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":9.7629999999999999,"5min":9.7629999999999999,"15min":9.7629999999999999},"last":2.7050000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:37:23 2024","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":0.92000000000000004,"15min":0.70999999999999996},"min":{"1min":0.35699999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":6.2859999999999996,"5min":6.2859999999999996,"15min":6.2859999999999996},"last":9.6780000000000008},{"interface":"front","average":{"1min":1.339,"5min":1.0009999999999999,"15min":0.76800000000000002},"min":{"1min":0.45000000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.923,"5min":8.8469999999999995,"15min":8.8469999999999995},"last":0.40600000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411430,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1274016,"kb_used_data":968600,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":92471136,"statfs":{"total":95995035648,"available":94690443264,"internally_reserved":0,"allocated":991846400,"data_stored":991549821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:37:24 2024","interfaces":[{"interface":"back","average":{"1min":5.0060000000000002,"5min":1.7909999999999999,"15min":0.82899999999999996},"min":{"1min":0.219,"5min":0.183,"15min":0.183},"max":{"1min":16.367999999999999,"5min":17.853000000000002,"15min":17.853000000000002},"last":0.84699999999999998},{"interface":"front","average":{"1min":5.585,"5min":1.845,"15min":0.89000000000000001},"min":{"1min":0.251,"5min":0.193,"15min":0.193},"max":{"1min":17.847999999999999,"5min":17.847999999999999,"15min":17.847999999999999},"last":1.911}]},{"osd":1,"last update":"Mon Feb 19 21:37:24 2024","interfaces":[{"interface":"back","average":{"1min":2.4860000000000002,"5min":1.0940000000000001,"15min":0.61199999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.20300000000000001},"max":{"1min":10.988,"5min":13.528,"15min":13.528},"last":0.88},{"interface":"front","average":{"1min":3.073,"5min":1.0800000000000001,"15min":0.61899999999999999},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":18.113,"5min":18.113,"15min":18.113},"last":0.41999999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:37:49 2024","interfaces":[{"interface":"back","average":{"1min":4.9610000000000003,"5min":2.1930000000000001,"15min":1.002},"min":{"1min":0.254,"5min":0.185,"15min":0.185},"max":{"1min":19.751000000000001,"5min":19.751000000000001,"15min":19.751000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":2.7909999999999999,"5min":1.3899999999999999,"15min":0.74099999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":18.137,"5min":18.137,"15min":18.137},"last":0.44800000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:38:12 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.93899999999999995,"15min":0.69699999999999995},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":3.6869999999999998,"5min":18.088000000000001,"15min":18.088000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":2.2170000000000001,"5min":1.3759999999999999,"15min":0.84499999999999997},"min":{"1min":0.38600000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":7.9489999999999998,"5min":13.369999999999999,"15min":13.369999999999999},"last":0.95399999999999996}]},{"osd":5,"last update":"Mon Feb 19 21:37:30 2024","interfaces":[{"interface":"back","average":{"1min":2.2090000000000001,"5min":1.1879999999999999,"15min":0.80900000000000005},"min":{"1min":0.30299999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":10.944000000000001,"5min":13.470000000000001,"15min":13.470000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":2.0899999999999999,"5min":0.94899999999999995,"15min":0.71099999999999997},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":18.018999999999998,"5min":18.018999999999998,"15min":18.018999999999998},"last":0.49299999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:38:00 2024","interfaces":[{"interface":"back","average":{"1min":2.194,"5min":1.2749999999999999,"15min":0.80400000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.313},"max":{"1min":6.6900000000000004,"5min":17.888999999999999,"15min":17.888999999999999},"last":2.4369999999999998},{"interface":"front","average":{"1min":2.2029999999999998,"5min":1.3979999999999999,"15min":0.86799999999999999},"min":{"1min":0.40400000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":8.5640000000000001,"5min":13.443,"15min":13.443},"last":2.363}]},{"osd":7,"last update":"Mon Feb 19 21:37:24 2024","interfaces":[{"interface":"back","average":{"1min":1.9590000000000001,"5min":0.93000000000000005,"15min":0.71899999999999997},"min":{"1min":0.34300000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":18.062999999999999,"5min":18.062999999999999,"15min":18.062999999999999},"last":2.379},{"interface":"front","average":{"1min":2.5489999999999999,"5min":1.1000000000000001,"15min":0.77200000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":17.917000000000002,"5min":17.917000000000002,"15min":17.917000000000002},"last":2.411}]}]},{"osd":3,"up_from":26,"seq":111669149793,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1750520,"kb_used_data":1436912,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":91994632,"statfs":{"total":95995035648,"available":94202503168,"internally_reserved":0,"allocated":1471397888,"data_stored":1471076607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:37:51 2024","interfaces":[{"interface":"back","average":{"1min":3.2250000000000001,"5min":1.5860000000000001,"15min":0.80800000000000005},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":8.9730000000000008,"5min":17.992000000000001,"15min":17.992000000000001},"last":1.7629999999999999},{"interface":"front","average":{"1min":4.1459999999999999,"5min":1.9430000000000001,"15min":0.94599999999999995},"min":{"1min":0.23300000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":14.279999999999999,"5min":18.303000000000001,"15min":18.303000000000001},"last":1.7350000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:37:51 2024","interfaces":[{"interface":"back","average":{"1min":2.581,"5min":1.179,"15min":0.66000000000000003},"min":{"1min":0.22900000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":9.9700000000000006,"5min":9.9700000000000006,"15min":9.9700000000000006},"last":6.8529999999999998},{"interface":"front","average":{"1min":3.9220000000000002,"5min":1.7410000000000001,"15min":0.871},"min":{"1min":0.29999999999999999,"5min":0.185,"15min":0.185},"max":{"1min":11.196999999999999,"5min":13.135999999999999,"15min":13.135999999999999},"last":8.6890000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:37:51 2024","interfaces":[{"interface":"back","average":{"1min":4.1500000000000004,"5min":1.5629999999999999,"15min":0.82699999999999996},"min":{"1min":0.26400000000000001,"5min":0.224,"15min":0.224},"max":{"1min":11.175000000000001,"5min":11.175000000000001,"15min":11.175000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":2.7290000000000001,"5min":1.639,"15min":0.84199999999999997},"min":{"1min":0.25800000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":11.632,"5min":13.109,"15min":13.109},"last":1.4470000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:38:13 2024","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.0649999999999999,"15min":0.74299999999999999},"min":{"1min":0.28199999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":3.6840000000000002,"5min":5.681,"15min":5.681},"last":0.64000000000000001},{"interface":"front","average":{"1min":2.0070000000000001,"5min":1.401,"15min":0.85199999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":5.5960000000000001,"5min":11.093,"15min":11.093},"last":0.47299999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:37:31 2024","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":0.96999999999999997,"15min":0.70699999999999996},"min":{"1min":0.28399999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":3.9449999999999998,"5min":5.577,"15min":5.577},"last":0.57099999999999995},{"interface":"front","average":{"1min":2.3029999999999999,"5min":1.179,"15min":0.78100000000000003},"min":{"1min":0.41599999999999998,"5min":0.315,"15min":0.315},"max":{"1min":11.128,"5min":11.128,"15min":11.128},"last":0.441}]},{"osd":6,"last update":"Mon Feb 19 21:38:01 2024","interfaces":[{"interface":"back","average":{"1min":2.4140000000000001,"5min":1.2270000000000001,"15min":0.78600000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":17.443999999999999,"5min":17.443999999999999,"15min":17.443999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":3.4449999999999998,"5min":1.5169999999999999,"15min":0.89900000000000002},"min":{"1min":0.34200000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":18.219000000000001,"5min":18.219000000000001,"15min":18.219000000000001},"last":0.497}]},{"osd":7,"last update":"Mon Feb 19 21:37:21 2024","interfaces":[{"interface":"back","average":{"1min":2.5489999999999999,"5min":1.357,"15min":0.81299999999999994},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":6.617,"5min":8.1069999999999993,"15min":8.1069999999999993},"last":1.478},{"interface":"front","average":{"1min":1.3959999999999999,"5min":0.96799999999999997,"15min":0.70499999999999996},"min":{"1min":0.35499999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":4.3929999999999998,"5min":5.6040000000000001,"15min":5.6040000000000001},"last":0.61599999999999999}]}]},{"osd":4,"up_from":32,"seq":137438953562,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1101484,"kb_used_data":800164,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":92643668,"statfs":{"total":95995035648,"available":94867116032,"internally_reserved":0,"allocated":819367936,"data_stored":819058611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:38:09 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":0.95499999999999996,"15min":0.66200000000000003},"min":{"1min":0.23699999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":7.1509999999999998,"5min":7.2489999999999997,"15min":7.2489999999999997},"last":0.245},{"interface":"front","average":{"1min":1.49,"5min":1.286,"15min":0.78800000000000003},"min":{"1min":0.26300000000000001,"5min":0.252,"15min":0.252},"max":{"1min":5.4779999999999998,"5min":11.960000000000001,"15min":11.960000000000001},"last":2.5920000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:38:09 2024","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":0.78700000000000003,"15min":0.622},"min":{"1min":0.27300000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":8.8379999999999992,"5min":8.8379999999999992,"15min":8.8379999999999992},"last":0.33100000000000002},{"interface":"front","average":{"1min":2.008,"5min":0.97899999999999998,"15min":0.69999999999999996},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":15.411,"5min":15.411,"15min":15.411},"last":2.6120000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:38:09 2024","interfaces":[{"interface":"back","average":{"1min":1.7809999999999999,"5min":1.0009999999999999,"15min":0.70099999999999996},"min":{"1min":0.38200000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":5.8079999999999998,"5min":6.7300000000000004,"15min":6.7300000000000004},"last":2.6280000000000001},{"interface":"front","average":{"1min":2.9870000000000001,"5min":1.5669999999999999,"15min":0.88},"min":{"1min":0.28499999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":14.843999999999999,"5min":20.995999999999999,"15min":20.995999999999999},"last":3.2759999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:38:09 2024","interfaces":[{"interface":"back","average":{"1min":2.9550000000000001,"5min":1.2869999999999999,"15min":0.79200000000000004},"min":{"1min":0.33900000000000002,"5min":0.316,"15min":0.316},"max":{"1min":15.914999999999999,"5min":15.914999999999999,"15min":15.914999999999999},"last":3.5030000000000001},{"interface":"front","average":{"1min":1.238,"5min":0.97899999999999998,"15min":0.69099999999999995},"min":{"1min":0.32600000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":2.6680000000000001,"5min":5.9420000000000002,"15min":5.9420000000000002},"last":0.30599999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:37:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.52600000000000002,"15min":0.436},"min":{"1min":0.27200000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":2.931,"5min":2.931,"15min":2.931},"last":2.5750000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.54300000000000004,"15min":0.44700000000000001},"min":{"1min":0.28100000000000003,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":3.2490000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:38:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.58799999999999997,"15min":0.48599999999999999},"min":{"1min":0.30399999999999999,"5min":0.30199999999999999,"15min":0.29999999999999999},"max":{"1min":2.6890000000000001,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":3.2149999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.58299999999999996,"15min":0.495},"min":{"1min":0.317,"5min":0.29799999999999999,"15min":0.27700000000000002},"max":{"1min":2.9620000000000002,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":2.5600000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:37:22 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.54200000000000004,"15min":0.52600000000000002},"min":{"1min":0.32700000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.56799999999999995,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":2.5289999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58899999999999997,"15min":0.54500000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.5489999999999999,"5min":1.845,"15min":1.845},"last":3.5299999999999998}]}]},{"osd":5,"up_from":38,"seq":163208757334,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":962396,"kb_used_data":656980,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":92782756,"statfs":{"total":95995035648,"available":95009542144,"internally_reserved":0,"allocated":672747520,"data_stored":672454730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:37:37 2024","interfaces":[{"interface":"back","average":{"1min":3.6179999999999999,"5min":1.2689999999999999,"15min":0.79600000000000004},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":20.550999999999998,"5min":20.550999999999998,"15min":20.550999999999998},"last":1.948},{"interface":"front","average":{"1min":2.6509999999999998,"5min":1.0660000000000001,"15min":0.73599999999999999},"min":{"1min":0.23999999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":20.879000000000001,"5min":20.879000000000001,"15min":20.879000000000001},"last":6.3319999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:37:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":0.83599999999999997,"15min":0.65500000000000003},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":7.8230000000000004,"5min":7.8230000000000004,"15min":7.8230000000000004},"last":0.373},{"interface":"front","average":{"1min":2.4710000000000001,"5min":1.1040000000000001,"15min":0.72699999999999998},"min":{"1min":0.28699999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":10.316000000000001,"5min":10.316000000000001,"15min":10.316000000000001},"last":0.39600000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:37:37 2024","interfaces":[{"interface":"back","average":{"1min":3.0150000000000001,"5min":1.25,"15min":0.78000000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":20.186,"5min":20.186,"15min":20.186},"last":0.92900000000000005},{"interface":"front","average":{"1min":3.3570000000000002,"5min":1.218,"15min":0.77800000000000002},"min":{"1min":0.28100000000000003,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":20.175000000000001,"5min":20.175000000000001,"15min":20.175000000000001},"last":0.46200000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:37:37 2024","interfaces":[{"interface":"back","average":{"1min":3.8740000000000001,"5min":1.466,"15min":0.87},"min":{"1min":0.33400000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":20.146999999999998,"5min":20.146999999999998,"15min":20.146999999999998},"last":5.1239999999999997},{"interface":"front","average":{"1min":4.133,"5min":1.542,"15min":0.93000000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":20.120000000000001,"5min":20.120000000000001,"15min":20.120000000000001},"last":5.133}]},{"osd":4,"last update":"Mon Feb 19 21:37:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.50700000000000001,"15min":0.437},"min":{"1min":0.247,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":6.4610000000000003,"5min":6.4610000000000003,"15min":6.4610000000000003},"last":0.439},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.57599999999999996,"15min":0.46400000000000002},"min":{"1min":0.26000000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":6.4740000000000002,"5min":6.4740000000000002,"15min":6.4740000000000002},"last":0.34499999999999997}]},{"osd":6,"last update":"Mon Feb 19 21:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.60499999999999998,"15min":0.49099999999999999},"min":{"1min":0.30199999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":5.1689999999999996,"5min":5.1689999999999996,"15min":5.1689999999999996},"last":0.312},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.68200000000000005,"15min":0.51200000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":6.6050000000000004,"5min":6.6050000000000004,"15min":6.6050000000000004},"last":0.56000000000000005}]},{"osd":7,"last update":"Mon Feb 19 21:37:29 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.58199999999999996,"15min":0.56599999999999995},"min":{"1min":0.311,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.2000000000000002,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.54400000000000004,"15min":0.53000000000000003},"min":{"1min":0.312,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.2250000000000001,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.47499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1273827328,"data_stored":1273823256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":977276928,"data_stored":977272856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":973209600,"data_stored":973209600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1468530688,"data_stored":1468530688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":810876928,"data_stored":810876928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":656015360,"data_stored":656015360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":814092288,"data_stored":814088216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":805175296,"data_stored":805175296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:38:22.997 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2024-02-19T21:38:22.997 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:38:22.997 INFO:tasks.thrashosds.thrasher:Reweighting osd 3 to 0.39626051782260496 2024-02-19T21:38:22.997 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd reweight 3 0.39626051782260496 2024-02-19T21:38:23.003 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:23.034 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:38:23.035 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:38:23.043 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:23.044 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:38:23.144 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-02-19T21:38:23.147 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:38:23.176 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:23.221 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:38:23.225 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:23.225 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:38:23.253 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:21.792449+0000 mgr.y (mgr.14514) 229 : audit [DBG] from='client.24742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:38:23.253 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:22.113619+0000 mon.c (mon.2) 33 : audit [INF] from='client.? 172.21.15.80:0/1891384104' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:38:23.253 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:22.116756+0000 mon.a (mon.0) 902 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:38:23.253 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:22.620375+0000 osd.6 (osd.6) 84 : cluster [DBG] 7.d scrub ok 2024-02-19T21:38:23.325 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:38:23.360 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:23.569 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:38:23.572 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:23.572 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:38:23.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:21.792449+0000 mgr.y (mgr.14514) 229 : audit [DBG] from='client.24742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:38:23.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:22.113619+0000 mon.c (mon.2) 33 : audit [INF] from='client.? 172.21.15.80:0/1891384104' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:38:23.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:22.116756+0000 mon.a (mon.0) 902 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:38:23.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:22.620375+0000 osd.6 (osd.6) 84 : cluster [DBG] 7.d scrub ok 2024-02-19T21:38:23.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:21.792449+0000 mgr.y (mgr.14514) 229 : audit [DBG] from='client.24742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:38:23.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:22.113619+0000 mon.c (mon.2) 33 : audit [INF] from='client.? 172.21.15.80:0/1891384104' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:38:23.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:22.116756+0000 mon.a (mon.0) 902 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:38:23.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:22.620375+0000 osd.6 (osd.6) 84 : cluster [DBG] 7.d scrub ok 2024-02-19T21:38:23.673 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:38:23.712 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:24.267 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:38:24.270 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:24.271 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:38:24.371 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:38:24.450 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:22.811589+0000 osd.7 (osd.7) 101 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:38:24.450 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:22.818935+0000 osd.7 (osd.7) 102 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:38:24.450 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:22.909231+0000 mgr.y (mgr.14514) 230 : cluster [DBG] pgmap v240: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 2.4 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 773 op/s 2024-02-19T21:38:24.450 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:22.926320+0000 osd.0 (osd.0) 123 : cluster [DBG] 3.1 scrub starts 2024-02-19T21:38:24.450 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:22.928797+0000 osd.0 (osd.0) 124 : cluster [DBG] 3.1 scrub ok 2024-02-19T21:38:24.450 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:23.103397+0000 mon.a (mon.0) 903 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:38:24.450 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:23.103430+0000 mon.a (mon.0) 904 : cluster [INF] Cluster is now healthy 2024-02-19T21:38:24.450 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:23.116394+0000 mon.a (mon.0) 905 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:38:24.450 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:23.116466+0000 mon.a (mon.0) 906 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2024-02-19T21:38:24.451 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:22.811589+0000 osd.7 (osd.7) 101 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:38:24.451 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:22.818935+0000 osd.7 (osd.7) 102 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:38:24.451 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:22.909231+0000 mgr.y (mgr.14514) 230 : cluster [DBG] pgmap v240: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 2.4 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 773 op/s 2024-02-19T21:38:24.451 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:22.926320+0000 osd.0 (osd.0) 123 : cluster [DBG] 3.1 scrub starts 2024-02-19T21:38:24.451 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:22.928797+0000 osd.0 (osd.0) 124 : cluster [DBG] 3.1 scrub ok 2024-02-19T21:38:24.451 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:23.103397+0000 mon.a (mon.0) 903 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:38:24.451 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:23.103430+0000 mon.a (mon.0) 904 : cluster [INF] Cluster is now healthy 2024-02-19T21:38:24.451 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:23.116394+0000 mon.a (mon.0) 905 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:38:24.451 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:23.116466+0000 mon.a (mon.0) 906 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2024-02-19T21:38:24.457 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:24.530 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:22.811589+0000 osd.7 (osd.7) 101 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:38:24.531 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:22.818935+0000 osd.7 (osd.7) 102 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:38:24.531 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:22.909231+0000 mgr.y (mgr.14514) 230 : cluster [DBG] pgmap v240: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 2.4 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 773 op/s 2024-02-19T21:38:24.531 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:22.926320+0000 osd.0 (osd.0) 123 : cluster [DBG] 3.1 scrub starts 2024-02-19T21:38:24.531 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:22.928797+0000 osd.0 (osd.0) 124 : cluster [DBG] 3.1 scrub ok 2024-02-19T21:38:24.531 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:23.103397+0000 mon.a (mon.0) 903 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:38:24.531 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:23.103430+0000 mon.a (mon.0) 904 : cluster [INF] Cluster is now healthy 2024-02-19T21:38:24.531 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:23.116394+0000 mon.a (mon.0) 905 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:38:24.531 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:23.116466+0000 mon.a (mon.0) 906 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2024-02-19T21:38:24.569 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:38:24.572 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:24.573 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:38:24.674 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:38:24.716 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:24.789 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:38:24.793 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:24.794 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:38:24.833 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:38:24.834 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:38:24.894 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:38:24.932 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:25.138 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:38:25.143 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:25.144 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:38:25.245 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:38:25.277 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:25.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:23.882442+0000 osd.5 (osd.5) 110 : cluster [DBG] 5.e scrub starts 2024-02-19T21:38:25.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:23.887704+0000 osd.5 (osd.5) 111 : cluster [DBG] 5.e scrub ok 2024-02-19T21:38:25.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:24.308279+0000 osd.4 (osd.4) 93 : cluster [DBG] 2.f scrub starts 2024-02-19T21:38:25.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:24.311027+0000 osd.4 (osd.4) 94 : cluster [DBG] 2.f scrub ok 2024-02-19T21:38:25.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:23.882442+0000 osd.5 (osd.5) 110 : cluster [DBG] 5.e scrub starts 2024-02-19T21:38:25.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:23.887704+0000 osd.5 (osd.5) 111 : cluster [DBG] 5.e scrub ok 2024-02-19T21:38:25.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:24.308279+0000 osd.4 (osd.4) 93 : cluster [DBG] 2.f scrub starts 2024-02-19T21:38:25.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:24.311027+0000 osd.4 (osd.4) 94 : cluster [DBG] 2.f scrub ok 2024-02-19T21:38:25.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:23.882442+0000 osd.5 (osd.5) 110 : cluster [DBG] 5.e scrub starts 2024-02-19T21:38:25.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:23.887704+0000 osd.5 (osd.5) 111 : cluster [DBG] 5.e scrub ok 2024-02-19T21:38:25.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:24.308279+0000 osd.4 (osd.4) 93 : cluster [DBG] 2.f scrub starts 2024-02-19T21:38:25.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:24.311027+0000 osd.4 (osd.4) 94 : cluster [DBG] 2.f scrub ok 2024-02-19T21:38:25.630 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:38:25.633 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:25.633 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:38:25.634 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:38:25.637 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_ops_in_flight 2024-02-19T21:38:25.734 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:38:25.788 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:25.936 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:38:25.956 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:25.956 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:38:26.057 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:38:26.057 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:38:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:38:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:38:26.093 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:26.118 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:38:26.123 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:26.124 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:38:26.225 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:38:26.282 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:24.909757+0000 mgr.y (mgr.14514) 231 : cluster [DBG] pgmap v242: 148 pgs: 148 active+clean; 2.3 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 920 op/s 2024-02-19T21:38:26.282 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:24.909757+0000 mgr.y (mgr.14514) 231 : cluster [DBG] pgmap v242: 148 pgs: 148 active+clean; 2.3 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 920 op/s 2024-02-19T21:38:26.309 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:26.352 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set noscrub 2024-02-19T21:38:26.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:24.909757+0000 mgr.y (mgr.14514) 231 : cluster [DBG] pgmap v242: 148 pgs: 148 active+clean; 2.3 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 920 op/s 2024-02-19T21:38:27.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:25.878116+0000 osd.7 (osd.7) 103 : cluster [DBG] 6.1c scrub starts 2024-02-19T21:38:27.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:25.883922+0000 osd.7 (osd.7) 104 : cluster [DBG] 6.1c scrub ok 2024-02-19T21:38:27.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:25.911349+0000 osd.5 (osd.5) 112 : cluster [DBG] 5.7 scrub starts 2024-02-19T21:38:27.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:25.920959+0000 osd.5 (osd.5) 113 : cluster [DBG] 5.7 scrub ok 2024-02-19T21:38:27.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:26.241256+0000 osd.2 (osd.2) 105 : cluster [DBG] 2.10 scrub starts 2024-02-19T21:38:27.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:26.250616+0000 osd.2 (osd.2) 106 : cluster [DBG] 2.10 scrub ok 2024-02-19T21:38:27.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:26.349414+0000 osd.6 (osd.6) 85 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:38:27.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:26.356884+0000 osd.6 (osd.6) 86 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:38:27.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:25.878116+0000 osd.7 (osd.7) 103 : cluster [DBG] 6.1c scrub starts 2024-02-19T21:38:27.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:25.883922+0000 osd.7 (osd.7) 104 : cluster [DBG] 6.1c scrub ok 2024-02-19T21:38:27.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:25.911349+0000 osd.5 (osd.5) 112 : cluster [DBG] 5.7 scrub starts 2024-02-19T21:38:27.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:25.920959+0000 osd.5 (osd.5) 113 : cluster [DBG] 5.7 scrub ok 2024-02-19T21:38:27.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:26.241256+0000 osd.2 (osd.2) 105 : cluster [DBG] 2.10 scrub starts 2024-02-19T21:38:27.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:26.250616+0000 osd.2 (osd.2) 106 : cluster [DBG] 2.10 scrub ok 2024-02-19T21:38:27.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:26.349414+0000 osd.6 (osd.6) 85 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:38:27.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:26.356884+0000 osd.6 (osd.6) 86 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:38:27.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:25.878116+0000 osd.7 (osd.7) 103 : cluster [DBG] 6.1c scrub starts 2024-02-19T21:38:27.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:25.883922+0000 osd.7 (osd.7) 104 : cluster [DBG] 6.1c scrub ok 2024-02-19T21:38:27.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:25.911349+0000 osd.5 (osd.5) 112 : cluster [DBG] 5.7 scrub starts 2024-02-19T21:38:27.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:25.920959+0000 osd.5 (osd.5) 113 : cluster [DBG] 5.7 scrub ok 2024-02-19T21:38:27.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:26.241256+0000 osd.2 (osd.2) 105 : cluster [DBG] 2.10 scrub starts 2024-02-19T21:38:27.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:26.250616+0000 osd.2 (osd.2) 106 : cluster [DBG] 2.10 scrub ok 2024-02-19T21:38:27.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:26.349414+0000 osd.6 (osd.6) 85 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:38:27.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:26.356884+0000 osd.6 (osd.6) 86 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:38:28.084 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:38:28.088 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:28.089 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:38:28.189 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:38:28.252 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:28.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:26.851220+0000 osd.7 (osd.7) 105 : cluster [DBG] 5.10 scrub starts 2024-02-19T21:38:28.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:26.854127+0000 osd.7 (osd.7) 106 : cluster [DBG] 5.10 scrub ok 2024-02-19T21:38:28.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:26.910314+0000 mgr.y (mgr.14514) 232 : cluster [DBG] pgmap v243: 148 pgs: 148 active+clean; 2.1 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 923 op/s 2024-02-19T21:38:28.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:27.297233+0000 osd.4 (osd.4) 95 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:38:28.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:27.306140+0000 osd.4 (osd.4) 96 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:38:28.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:26.851220+0000 osd.7 (osd.7) 105 : cluster [DBG] 5.10 scrub starts 2024-02-19T21:38:28.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:26.854127+0000 osd.7 (osd.7) 106 : cluster [DBG] 5.10 scrub ok 2024-02-19T21:38:28.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:26.910314+0000 mgr.y (mgr.14514) 232 : cluster [DBG] pgmap v243: 148 pgs: 148 active+clean; 2.1 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 923 op/s 2024-02-19T21:38:28.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:27.297233+0000 osd.4 (osd.4) 95 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:38:28.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:27.306140+0000 osd.4 (osd.4) 96 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:38:28.528 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:38:28.532 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:28.533 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:38:28.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:26.851220+0000 osd.7 (osd.7) 105 : cluster [DBG] 5.10 scrub starts 2024-02-19T21:38:28.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:26.854127+0000 osd.7 (osd.7) 106 : cluster [DBG] 5.10 scrub ok 2024-02-19T21:38:28.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:26.910314+0000 mgr.y (mgr.14514) 232 : cluster [DBG] pgmap v243: 148 pgs: 148 active+clean; 2.1 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 923 op/s 2024-02-19T21:38:28.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:27.297233+0000 osd.4 (osd.4) 95 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:38:28.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:27.306140+0000 osd.4 (osd.4) 96 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:38:28.634 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:38:28.637 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:38:28.638 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:38:28.638 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:38:28.638 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:38:28.638 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:38:28.638 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:38:28.638 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:38:28.638 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:38:28.646 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:38:28.646 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:38:28.646 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:38:28.646 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:38:28.646 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:38:28.647 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:38:28.647 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:38:28.647 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:38:28.665 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:28.689 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:38:28.691 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:28.692 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:38:28.793 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:38:28.827 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:28.850 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:38:28.854 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:28.855 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:38:28.956 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:38:28.985 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:29.007 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:38:29.012 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:29.013 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:38:29.113 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:38:29.147 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:29.175 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:38:29.178 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:29.178 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:38:29.279 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:38:29.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:28.030172+0000 osd.1 (osd.1) 105 : cluster [DBG] 2.6 deep-scrub starts 2024-02-19T21:38:29.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:28.036347+0000 osd.1 (osd.1) 106 : cluster [DBG] 2.6 deep-scrub ok 2024-02-19T21:38:29.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:28.348592+0000 mon.b (mon.1) 42 : audit [DBG] from='client.? 172.21.15.80:0/324066954' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:38:29.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:28.353159+0000 osd.6 (osd.6) 87 : cluster [DBG] 4.5 deep-scrub starts 2024-02-19T21:38:29.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:28.363067+0000 osd.6 (osd.6) 88 : cluster [DBG] 4.5 deep-scrub ok 2024-02-19T21:38:29.341 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:29.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:28.030172+0000 osd.1 (osd.1) 105 : cluster [DBG] 2.6 deep-scrub starts 2024-02-19T21:38:29.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:28.036347+0000 osd.1 (osd.1) 106 : cluster [DBG] 2.6 deep-scrub ok 2024-02-19T21:38:29.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:28.348592+0000 mon.b (mon.1) 42 : audit [DBG] from='client.? 172.21.15.80:0/324066954' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:38:29.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:28.353159+0000 osd.6 (osd.6) 87 : cluster [DBG] 4.5 deep-scrub starts 2024-02-19T21:38:29.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:28.363067+0000 osd.6 (osd.6) 88 : cluster [DBG] 4.5 deep-scrub ok 2024-02-19T21:38:29.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:28.030172+0000 osd.1 (osd.1) 105 : cluster [DBG] 2.6 deep-scrub starts 2024-02-19T21:38:29.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:28.036347+0000 osd.1 (osd.1) 106 : cluster [DBG] 2.6 deep-scrub ok 2024-02-19T21:38:29.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:28.348592+0000 mon.b (mon.1) 42 : audit [DBG] from='client.? 172.21.15.80:0/324066954' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:38:29.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:28.353159+0000 osd.6 (osd.6) 87 : cluster [DBG] 4.5 deep-scrub starts 2024-02-19T21:38:29.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:28.363067+0000 osd.6 (osd.6) 88 : cluster [DBG] 4.5 deep-scrub ok 2024-02-19T21:38:29.754 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:38:29.760 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:29.761 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:38:29.861 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:38:29.899 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:29.914 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:38:29.918 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:38:29.922 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:38:29.924 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:29.925 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:38:30.025 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:38:30.060 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:30.236 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:38:30.241 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:30.242 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:38:30.247 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:28.911382+0000 mgr.y (mgr.14514) 233 : cluster [DBG] pgmap v244: 148 pgs: 148 active+clean; 2.1 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 923 op/s 2024-02-19T21:38:30.247 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:29.274870+0000 mon.c (mon.2) 34 : audit [INF] from='client.? 172.21.15.80:0/2329923889' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 0.39626051782260496}]: dispatch 2024-02-19T21:38:30.247 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:29.275919+0000 mon.a (mon.0) 907 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 0.39626051782260496}]: dispatch 2024-02-19T21:38:30.247 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:29.302498+0000 osd.4 (osd.4) 97 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:38:30.247 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:29.307042+0000 osd.4 (osd.4) 98 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:38:30.247 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:38:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:38:30.275 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.3 to 0.396261 (6571) 2024-02-19T21:38:30.326 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:28.911382+0000 mgr.y (mgr.14514) 233 : cluster [DBG] pgmap v244: 148 pgs: 148 active+clean; 2.1 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 923 op/s 2024-02-19T21:38:30.326 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:29.274870+0000 mon.c (mon.2) 34 : audit [INF] from='client.? 172.21.15.80:0/2329923889' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 0.39626051782260496}]: dispatch 2024-02-19T21:38:30.326 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:29.275919+0000 mon.a (mon.0) 907 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 0.39626051782260496}]: dispatch 2024-02-19T21:38:30.326 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:29.302498+0000 osd.4 (osd.4) 97 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:38:30.326 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:29.307042+0000 osd.4 (osd.4) 98 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:38:30.326 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:28.911382+0000 mgr.y (mgr.14514) 233 : cluster [DBG] pgmap v244: 148 pgs: 148 active+clean; 2.1 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 923 op/s 2024-02-19T21:38:30.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:29.274870+0000 mon.c (mon.2) 34 : audit [INF] from='client.? 172.21.15.80:0/2329923889' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 0.39626051782260496}]: dispatch 2024-02-19T21:38:30.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:29.275919+0000 mon.a (mon.0) 907 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 0.39626051782260496}]: dispatch 2024-02-19T21:38:30.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:29.302498+0000 osd.4 (osd.4) 97 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:38:30.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:29.307042+0000 osd.4 (osd.4) 98 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:38:30.343 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:38:30.372 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:31.076 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:38:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:38:30] "GET /metrics HTTP/1.1" 200 175474 "" "Prometheus/2.33.4" 2024-02-19T21:38:31.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:29.961085+0000 osd.0 (osd.0) 125 : cluster [DBG] 6.10 scrub starts 2024-02-19T21:38:31.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:29.972332+0000 osd.0 (osd.0) 126 : cluster [DBG] 6.10 scrub ok 2024-02-19T21:38:31.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:30.057395+0000 osd.3 (osd.3) 129 : cluster [DBG] 7.2 scrub starts 2024-02-19T21:38:31.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:30.109537+0000 mgr.y (mgr.14514) 234 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:38:31.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:30.231643+0000 mon.a (mon.0) 908 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 0.39626051782260496}]': finished 2024-02-19T21:38:31.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:30.231711+0000 mon.a (mon.0) 909 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2024-02-19T21:38:31.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:30.580772+0000 osd.3 (osd.3) 130 : cluster [DBG] 7.2 scrub ok 2024-02-19T21:38:31.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:31.234602+0000 mon.a (mon.0) 910 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2024-02-19T21:38:31.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:29.961085+0000 osd.0 (osd.0) 125 : cluster [DBG] 6.10 scrub starts 2024-02-19T21:38:31.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:29.972332+0000 osd.0 (osd.0) 126 : cluster [DBG] 6.10 scrub ok 2024-02-19T21:38:31.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:30.057395+0000 osd.3 (osd.3) 129 : cluster [DBG] 7.2 scrub starts 2024-02-19T21:38:31.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:30.109537+0000 mgr.y (mgr.14514) 234 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:38:31.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:30.231643+0000 mon.a (mon.0) 908 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 0.39626051782260496}]': finished 2024-02-19T21:38:31.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:30.231711+0000 mon.a (mon.0) 909 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2024-02-19T21:38:31.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:30.580772+0000 osd.3 (osd.3) 130 : cluster [DBG] 7.2 scrub ok 2024-02-19T21:38:31.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:31.234602+0000 mon.a (mon.0) 910 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2024-02-19T21:38:31.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:29.961085+0000 osd.0 (osd.0) 125 : cluster [DBG] 6.10 scrub starts 2024-02-19T21:38:31.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:29.972332+0000 osd.0 (osd.0) 126 : cluster [DBG] 6.10 scrub ok 2024-02-19T21:38:31.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:30.057395+0000 osd.3 (osd.3) 129 : cluster [DBG] 7.2 scrub starts 2024-02-19T21:38:31.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:30.109537+0000 mgr.y (mgr.14514) 234 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:38:31.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:30.231643+0000 mon.a (mon.0) 908 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 0.39626051782260496}]': finished 2024-02-19T21:38:31.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:30.231711+0000 mon.a (mon.0) 909 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2024-02-19T21:38:31.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:30.580772+0000 osd.3 (osd.3) 130 : cluster [DBG] 7.2 scrub ok 2024-02-19T21:38:31.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:31.234602+0000 mon.a (mon.0) 910 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2024-02-19T21:38:31.793 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:38:32.053 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:38:32.058 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:32.059 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:38:32.159 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:38:32.189 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:32.439 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:38:32.443 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:30.882925+0000 osd.5 (osd.5) 114 : cluster [DBG] 4.1 scrub starts 2024-02-19T21:38:32.443 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:30.886416+0000 osd.5 (osd.5) 115 : cluster [DBG] 4.1 scrub ok 2024-02-19T21:38:32.443 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:30.911760+0000 mgr.y (mgr.14514) 235 : cluster [DBG] pgmap v246: 148 pgs: 148 active+clean; 1.9 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.13k op/s 2024-02-19T21:38:32.443 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:31.093274+0000 osd.3 (osd.3) 131 : cluster [DBG] 4.1a scrub starts 2024-02-19T21:38:32.443 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:31.096866+0000 osd.3 (osd.3) 132 : cluster [DBG] 4.1a scrub ok 2024-02-19T21:38:32.443 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:32.235878+0000 mon.a (mon.0) 911 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2024-02-19T21:38:32.444 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:32.444 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:38:32.445 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:30.882925+0000 osd.5 (osd.5) 114 : cluster [DBG] 4.1 scrub starts 2024-02-19T21:38:32.445 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:30.886416+0000 osd.5 (osd.5) 115 : cluster [DBG] 4.1 scrub ok 2024-02-19T21:38:32.445 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:30.911760+0000 mgr.y (mgr.14514) 235 : cluster [DBG] pgmap v246: 148 pgs: 148 active+clean; 1.9 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.13k op/s 2024-02-19T21:38:32.445 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:31.093274+0000 osd.3 (osd.3) 131 : cluster [DBG] 4.1a scrub starts 2024-02-19T21:38:32.445 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:31.096866+0000 osd.3 (osd.3) 132 : cluster [DBG] 4.1a scrub ok 2024-02-19T21:38:32.445 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:32.235878+0000 mon.a (mon.0) 911 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2024-02-19T21:38:32.545 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:38:32.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:30.882925+0000 osd.5 (osd.5) 114 : cluster [DBG] 4.1 scrub starts 2024-02-19T21:38:32.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:30.886416+0000 osd.5 (osd.5) 115 : cluster [DBG] 4.1 scrub ok 2024-02-19T21:38:32.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:30.911760+0000 mgr.y (mgr.14514) 235 : cluster [DBG] pgmap v246: 148 pgs: 148 active+clean; 1.9 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.13k op/s 2024-02-19T21:38:32.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:31.093274+0000 osd.3 (osd.3) 131 : cluster [DBG] 4.1a scrub starts 2024-02-19T21:38:32.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:31.096866+0000 osd.3 (osd.3) 132 : cluster [DBG] 4.1a scrub ok 2024-02-19T21:38:32.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:32.235878+0000 mon.a (mon.0) 911 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2024-02-19T21:38:32.627 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:33.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:32.234063+0000 osd.6 (osd.6) 89 : cluster [DBG] 7.1 starting backfill to osd.1 from (0'0,0'0] MAX to 143'12578 2024-02-19T21:38:33.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:32.234536+0000 osd.6 (osd.6) 90 : cluster [DBG] 7.c starting backfill to osd.2 from (0'0,0'0] MAX to 143'12578 2024-02-19T21:38:33.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:32.234770+0000 osd.6 (osd.6) 91 : cluster [DBG] 7.7 starting backfill to osd.1 from (0'0,0'0] MAX to 143'12247 2024-02-19T21:38:33.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:32.235343+0000 osd.0 (osd.0) 127 : cluster [DBG] 7.f starting backfill to osd.4 from (0'0,0'0] MAX to 143'12601 2024-02-19T21:38:33.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:32.235386+0000 osd.0 (osd.0) 128 : cluster [DBG] 7.6 starting backfill to osd.5 from (0'0,0'0] MAX to 143'12472 2024-02-19T21:38:33.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:32.240426+0000 osd.5 (osd.5) 116 : cluster [DBG] 7.0 starting backfill to osd.2 from (0'0,0'0] MAX to 143'12436 2024-02-19T21:38:33.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:32.234063+0000 osd.6 (osd.6) 89 : cluster [DBG] 7.1 starting backfill to osd.1 from (0'0,0'0] MAX to 143'12578 2024-02-19T21:38:33.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:32.234536+0000 osd.6 (osd.6) 90 : cluster [DBG] 7.c starting backfill to osd.2 from (0'0,0'0] MAX to 143'12578 2024-02-19T21:38:33.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:32.234770+0000 osd.6 (osd.6) 91 : cluster [DBG] 7.7 starting backfill to osd.1 from (0'0,0'0] MAX to 143'12247 2024-02-19T21:38:33.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:32.235343+0000 osd.0 (osd.0) 127 : cluster [DBG] 7.f starting backfill to osd.4 from (0'0,0'0] MAX to 143'12601 2024-02-19T21:38:33.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:32.235386+0000 osd.0 (osd.0) 128 : cluster [DBG] 7.6 starting backfill to osd.5 from (0'0,0'0] MAX to 143'12472 2024-02-19T21:38:33.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:32.240426+0000 osd.5 (osd.5) 116 : cluster [DBG] 7.0 starting backfill to osd.2 from (0'0,0'0] MAX to 143'12436 2024-02-19T21:38:33.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:32.234063+0000 osd.6 (osd.6) 89 : cluster [DBG] 7.1 starting backfill to osd.1 from (0'0,0'0] MAX to 143'12578 2024-02-19T21:38:33.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:32.234536+0000 osd.6 (osd.6) 90 : cluster [DBG] 7.c starting backfill to osd.2 from (0'0,0'0] MAX to 143'12578 2024-02-19T21:38:33.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:32.234770+0000 osd.6 (osd.6) 91 : cluster [DBG] 7.7 starting backfill to osd.1 from (0'0,0'0] MAX to 143'12247 2024-02-19T21:38:33.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:32.235343+0000 osd.0 (osd.0) 127 : cluster [DBG] 7.f starting backfill to osd.4 from (0'0,0'0] MAX to 143'12601 2024-02-19T21:38:33.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:32.235386+0000 osd.0 (osd.0) 128 : cluster [DBG] 7.6 starting backfill to osd.5 from (0'0,0'0] MAX to 143'12472 2024-02-19T21:38:33.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:32.240426+0000 osd.5 (osd.5) 116 : cluster [DBG] 7.0 starting backfill to osd.2 from (0'0,0'0] MAX to 143'12436 2024-02-19T21:38:34.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:32.912690+0000 mgr.y (mgr.14514) 236 : cluster [DBG] pgmap v249: 148 pgs: 148 active+clean; 1.9 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 759 op/s 2024-02-19T21:38:34.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:33.955475+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:38:34.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:32.912690+0000 mgr.y (mgr.14514) 236 : cluster [DBG] pgmap v249: 148 pgs: 148 active+clean; 1.9 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 759 op/s 2024-02-19T21:38:34.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:33.955475+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:38:34.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:32.912690+0000 mgr.y (mgr.14514) 236 : cluster [DBG] pgmap v249: 148 pgs: 148 active+clean; 1.9 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 759 op/s 2024-02-19T21:38:34.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:33.955475+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:38:34.766 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:38:34.767 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-02-19T21:38:34.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.767 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:199462 7.4 7:2d793118:::benchmark_data_smithi080_79222_object84728:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:38:34.767 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:32.735416+0000", 2024-02-19T21:38:34.767 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.013109212, 2024-02-19T21:38:34.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013140499999999999, 2024-02-19T21:38:34.767 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:38:34.767 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:38:34.767 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:38:34.767 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:38:34.767 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:38:34.767 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 199462 2024-02-19T21:38:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:38:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:38:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.735416+0000", 2024-02-19T21:38:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:38:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:38:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.735416+0000", 2024-02-19T21:38:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:38:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:38:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.735415+0000", 2024-02-19T21:38:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3680000000000001e-06 2024-02-19T21:38:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:38:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.735420+0000", 2024-02-19T21:38:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0120000000000005e-06 2024-02-19T21:38:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:38:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.735428+0000", 2024-02-19T21:38:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.07e-06 2024-02-19T21:38:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:38:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.735432+0000", 2024-02-19T21:38:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3578000000000003e-05 2024-02-19T21:38:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:38:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.735466+0000", 2024-02-19T21:38:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106152 2024-02-19T21:38:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:38:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.735572+0000", 2024-02-19T21:38:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000132044 2024-02-19T21:38:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,4", 2024-02-19T21:38:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.735704+0000", 2024-02-19T21:38:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.009007368 2024-02-19T21:38:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.744712+0000", 2024-02-19T21:38:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001201567 2024-02-19T21:38:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:38:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.745913+0000", 2024-02-19T21:38:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010496996 2024-02-19T21:38:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:199464 7.f 7:fb734f59:::benchmark_data_smithi080_79222_object84730:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:38:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:32.735442+0000", 2024-02-19T21:38:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.013083011, 2024-02-19T21:38:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013215304000000001, 2024-02-19T21:38:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:38:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:38:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:38:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:38:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:38:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 199464 2024-02-19T21:38:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:38:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:38:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.735442+0000", 2024-02-19T21:38:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:38:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:38:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.735442+0000", 2024-02-19T21:38:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:38:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:38:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.735442+0000", 2024-02-19T21:38:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0790000000000001e-06 2024-02-19T21:38:34.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:38:34.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.735445+0000", 2024-02-19T21:38:34.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7629999999999997e-06 2024-02-19T21:38:34.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:38:34.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.735451+0000", 2024-02-19T21:38:34.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0999999999999997e-06 2024-02-19T21:38:34.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:38:34.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.735455+0000", 2024-02-19T21:38:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4946e-05 2024-02-19T21:38:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:38:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.735500+0000", 2024-02-19T21:38:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011498299999999999 2024-02-19T21:38:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:38:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.735615+0000", 2024-02-19T21:38:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015291400000000001 2024-02-19T21:38:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,4,7", 2024-02-19T21:38:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.735768+0000", 2024-02-19T21:38:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0051407600000000003 2024-02-19T21:38:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:38:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.740908+0000", 2024-02-19T21:38:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038894580000000002 2024-02-19T21:38:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.744798+0000", 2024-02-19T21:38:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2030000000000003e-05 2024-02-19T21:38:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.744830+0000", 2024-02-19T21:38:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0093875610000000009 2024-02-19T21:38:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:199466 7.6 7:62838012:::benchmark_data_smithi080_79222_object84732:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:38:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:32.737895+0000", 2024-02-19T21:38:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.010630788, 2024-02-19T21:38:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010891021000000001, 2024-02-19T21:38:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:38:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:38:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:38:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:38:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:38:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 199466 2024-02-19T21:38:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:38:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:38:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.737895+0000", 2024-02-19T21:38:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:38:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:38:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.737895+0000", 2024-02-19T21:38:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:38:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:38:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.737893+0000", 2024-02-19T21:38:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6389999999999992e-06 2024-02-19T21:38:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:38:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.737901+0000", 2024-02-19T21:38:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0241000000000001e-05 2024-02-19T21:38:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:38:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.737911+0000", 2024-02-19T21:38:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.224e-06 2024-02-19T21:38:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:38:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.737917+0000", 2024-02-19T21:38:34.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9548999999999997e-05 2024-02-19T21:38:34.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:38:34.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.737957+0000", 2024-02-19T21:38:34.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118461 2024-02-19T21:38:34.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:38:34.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.738075+0000", 2024-02-19T21:38:34.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113501 2024-02-19T21:38:34.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,5,7", 2024-02-19T21:38:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.738189+0000", 2024-02-19T21:38:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0080699540000000007 2024-02-19T21:38:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:38:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.746259+0000", 2024-02-19T21:38:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6722000000000001e-05 2024-02-19T21:38:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.746345+0000", 2024-02-19T21:38:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0084507450000000008 2024-02-19T21:38:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:199468 7.9 7:9c02fa95:::benchmark_data_smithi080_79222_object84734:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:38:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:32.737929+0000", 2024-02-19T21:38:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.010596108999999999, 2024-02-19T21:38:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010945497, 2024-02-19T21:38:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:38:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:38:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:38:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:38:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:38:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 199468 2024-02-19T21:38:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:38:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:38:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.737929+0000", 2024-02-19T21:38:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:38:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:38:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.737929+0000", 2024-02-19T21:38:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:38:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:38:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.737929+0000", 2024-02-19T21:38:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.25e-06 2024-02-19T21:38:34.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:38:34.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.737933+0000", 2024-02-19T21:38:34.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7340000000000008e-06 2024-02-19T21:38:34.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:38:34.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.737941+0000", 2024-02-19T21:38:34.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3170000000000003e-06 2024-02-19T21:38:34.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:38:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.737945+0000", 2024-02-19T21:38:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9022000000000004e-05 2024-02-19T21:38:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:38:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.738014+0000", 2024-02-19T21:38:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000105865 2024-02-19T21:38:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:38:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.738120+0000", 2024-02-19T21:38:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000111452 2024-02-19T21:38:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,4", 2024-02-19T21:38:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.738231+0000", 2024-02-19T21:38:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066264369999999998 2024-02-19T21:38:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:38:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.744858+0000", 2024-02-19T21:38:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033808110000000001 2024-02-19T21:38:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:38:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.748239+0000", 2024-02-19T21:38:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010309287 2024-02-19T21:38:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop_reply(client.14793.0:199464 7.f e146/145)", 2024-02-19T21:38:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:32.745252+0000", 2024-02-19T21:38:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0032736110000000001, 2024-02-19T21:38:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036901099999999999, 2024-02-19T21:38:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:38:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "queued for pg", 2024-02-19T21:38:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:38:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:38:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.745252+0000", 2024-02-19T21:38:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:38:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:38:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.745252+0000", 2024-02-19T21:38:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:38:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:38:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.745251+0000", 2024-02-19T21:38:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3209999999999998e-06 2024-02-19T21:38:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:38:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.745256+0000", 2024-02-19T21:38:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0455000000000001e-05 2024-02-19T21:38:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:38:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.745266+0000", 2024-02-19T21:38:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4360000000000001e-06 2024-02-19T21:38:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:38:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.745271+0000", 2024-02-19T21:38:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9621999999999999e-05 2024-02-19T21:38:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop_reply(client.14793.0:199462 7.4 e146/100)", 2024-02-19T21:38:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:32.748127+0000", 2024-02-19T21:38:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.00039806200000000003, 2024-02-19T21:38:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00085036300000000003, 2024-02-19T21:38:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:38:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "queued for pg", 2024-02-19T21:38:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:38:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:38:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.748127+0000", 2024-02-19T21:38:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:38:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:38:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.748127+0000", 2024-02-19T21:38:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:38:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:38:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.748126+0000", 2024-02-19T21:38:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3610000000000001e-06 2024-02-19T21:38:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:38:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.748134+0000", 2024-02-19T21:38:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3767e-05 2024-02-19T21:38:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:38:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.748148+0000", 2024-02-19T21:38:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3929999999999996e-06 2024-02-19T21:38:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:38:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.748154+0000", 2024-02-19T21:38:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6900999999999999e-05 2024-02-19T21:38:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop_reply(client.14793.0:199466 7.6 e146/145)", 2024-02-19T21:38:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:32.748688+0000", 2024-02-19T21:38:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4294967295.9998379, 2024-02-19T21:38:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031730099999999998, 2024-02-19T21:38:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:38:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "queued for pg", 2024-02-19T21:38:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:38:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:38:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.748688+0000", 2024-02-19T21:38:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:38:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:38:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.748688+0000", 2024-02-19T21:38:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:38:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:38:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.748687+0000", 2024-02-19T21:38:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4800000000000003e-06 2024-02-19T21:38:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:38:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.748691+0000", 2024-02-19T21:38:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4530000000000008e-06 2024-02-19T21:38:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:38:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.748701+0000", 2024-02-19T21:38:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4720000000000003e-06 2024-02-19T21:38:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:38:34.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.748706+0000", 2024-02-19T21:38:34.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8614000000000002e-05 2024-02-19T21:38:34.795 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:34.795 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:34.795 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:34.795 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:34.795 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:38:34.795 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 7 2024-02-19T21:38:34.795 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:38:35.620 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:38:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:38:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:38:35.625 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:35.295214+0000 mon.a (mon.0) 913 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:38:35.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:35.295214+0000 mon.a (mon.0) 913 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:38:35.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:35.295214+0000 mon.a (mon.0) 913 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:38:36.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:34.916148+0000 mgr.y (mgr.14514) 237 : cluster [DBG] pgmap v250: 148 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 144 active+clean; 1.8 GiB data, 7.7 GiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 985 op/s; 6976/88026 objects misplaced (7.925%); 821 KiB/s, 21 objects/s recovering 2024-02-19T21:38:36.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:34.916148+0000 mgr.y (mgr.14514) 237 : cluster [DBG] pgmap v250: 148 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 144 active+clean; 1.8 GiB data, 7.7 GiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 985 op/s; 6976/88026 objects misplaced (7.925%); 821 KiB/s, 21 objects/s recovering 2024-02-19T21:38:36.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:34.916148+0000 mgr.y (mgr.14514) 237 : cluster [DBG] pgmap v250: 148 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 144 active+clean; 1.8 GiB data, 7.7 GiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 985 op/s; 6976/88026 objects misplaced (7.925%); 821 KiB/s, 21 objects/s recovering 2024-02-19T21:38:38.593 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:38:38.603 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:38.604 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:38:38.705 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:38:38.780 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:36.917549+0000 mgr.y (mgr.14514) 238 : cluster [DBG] pgmap v251: 148 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 142 active+clean; 1.7 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 0 B/s wr, 360 op/s; 9867/84879 objects misplaced (11.625%); 6.3 MiB/s, 109 objects/s recovering 2024-02-19T21:38:38.780 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:36.917549+0000 mgr.y (mgr.14514) 238 : cluster [DBG] pgmap v251: 148 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 142 active+clean; 1.7 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 0 B/s wr, 360 op/s; 9867/84879 objects misplaced (11.625%); 6.3 MiB/s, 109 objects/s recovering 2024-02-19T21:38:38.787 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:38.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:36.917549+0000 mgr.y (mgr.14514) 238 : cluster [DBG] pgmap v251: 148 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 142 active+clean; 1.7 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 0 B/s wr, 360 op/s; 9867/84879 objects misplaced (11.625%); 6.3 MiB/s, 109 objects/s recovering 2024-02-19T21:38:40.397 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:38:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:38:40.774 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:38:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:38:40] "GET /metrics HTTP/1.1" 200 175494 "" "Prometheus/2.33.4" 2024-02-19T21:38:40.774 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:38.917993+0000 mgr.y (mgr.14514) 239 : cluster [DBG] pgmap v252: 148 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 142 active+clean; 1.7 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 0 B/s wr, 300 op/s; 9867/84879 objects misplaced (11.625%); 5.2 MiB/s, 91 objects/s recovering 2024-02-19T21:38:40.775 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:38.917993+0000 mgr.y (mgr.14514) 239 : cluster [DBG] pgmap v252: 148 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 142 active+clean; 1.7 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 0 B/s wr, 300 op/s; 9867/84879 objects misplaced (11.625%); 5.2 MiB/s, 91 objects/s recovering 2024-02-19T21:38:40.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:38.917993+0000 mgr.y (mgr.14514) 239 : cluster [DBG] pgmap v252: 148 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 142 active+clean; 1.7 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 0 B/s wr, 300 op/s; 9867/84879 objects misplaced (11.625%); 5.2 MiB/s, 91 objects/s recovering 2024-02-19T21:38:41.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:40.119566+0000 mgr.y (mgr.14514) 240 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:38:41.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:40.119566+0000 mgr.y (mgr.14514) 240 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:38:41.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:40.119566+0000 mgr.y (mgr.14514) 240 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:38:42.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:40.918839+0000 mgr.y (mgr.14514) 241 : cluster [DBG] pgmap v253: 148 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 142 active+clean; 1.4 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 528 B/s rd, 0 B/s wr, 697 op/s; 7163/71844 objects misplaced (9.970%); 13 MiB/s, 209 objects/s recovering 2024-02-19T21:38:42.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:40.918839+0000 mgr.y (mgr.14514) 241 : cluster [DBG] pgmap v253: 148 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 142 active+clean; 1.4 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 528 B/s rd, 0 B/s wr, 697 op/s; 7163/71844 objects misplaced (9.970%); 13 MiB/s, 209 objects/s recovering 2024-02-19T21:38:42.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:40.918839+0000 mgr.y (mgr.14514) 241 : cluster [DBG] pgmap v253: 148 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 142 active+clean; 1.4 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 528 B/s rd, 0 B/s wr, 697 op/s; 7163/71844 objects misplaced (9.970%); 13 MiB/s, 209 objects/s recovering 2024-02-19T21:38:44.441 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:38:44.457 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_blocked_ops 2024-02-19T21:38:44.525 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:42.919273+0000 mgr.y (mgr.14514) 242 : cluster [DBG] pgmap v254: 148 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 142 active+clean; 1.4 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 479 B/s rd, 0 B/s wr, 632 op/s; 7163/71844 objects misplaced (9.970%); 11 MiB/s, 189 objects/s recovering 2024-02-19T21:38:44.525 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:42.919273+0000 mgr.y (mgr.14514) 242 : cluster [DBG] pgmap v254: 148 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 142 active+clean; 1.4 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 479 B/s rd, 0 B/s wr, 632 op/s; 7163/71844 objects misplaced (9.970%); 11 MiB/s, 189 objects/s recovering 2024-02-19T21:38:44.662 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:38:44.670 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:44.671 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:38:44.772 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:38:44.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:42.919273+0000 mgr.y (mgr.14514) 242 : cluster [DBG] pgmap v254: 148 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 142 active+clean; 1.4 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 479 B/s rd, 0 B/s wr, 632 op/s; 7163/71844 objects misplaced (9.970%); 11 MiB/s, 189 objects/s recovering 2024-02-19T21:38:44.814 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:44.846 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:38:44.849 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:44.849 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:38:44.950 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:38:45.021 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:45.050 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:38:45.053 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:45.053 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:38:45.154 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:38:45.196 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:45.222 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:38:45.224 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:45.224 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:38:45.325 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:38:45.369 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:45.398 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:38:45.407 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:45.408 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:38:45.508 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:38:45.548 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:45.583 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:38:45.586 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:45.586 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:38:45.687 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:38:45.742 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:45.807 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:38:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:38:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:38:45.963 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:38:45.971 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:45.972 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:38:46.011 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-02-19T21:38:46.072 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:38:46.149 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:46.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:44.920013+0000 mgr.y (mgr.14514) 243 : cluster [DBG] pgmap v255: 148 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 142 active+clean; 1.3 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 759 op/s; 5995/64788 objects misplaced (9.253%); 11 MiB/s, 183 objects/s recovering 2024-02-19T21:38:46.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:45.549493+0000 mon.b (mon.1) 43 : audit [INF] from='client.? 172.21.15.80:0/944033' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:38:46.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:45.550013+0000 mon.a (mon.0) 914 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:38:46.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:45.989357+0000 mon.a (mon.0) 915 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:38:46.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:45.993727+0000 mon.a (mon.0) 916 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:38:46.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:45.993782+0000 mon.a (mon.0) 917 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2024-02-19T21:38:46.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:44.920013+0000 mgr.y (mgr.14514) 243 : cluster [DBG] pgmap v255: 148 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 142 active+clean; 1.3 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 759 op/s; 5995/64788 objects misplaced (9.253%); 11 MiB/s, 183 objects/s recovering 2024-02-19T21:38:46.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:45.549493+0000 mon.b (mon.1) 43 : audit [INF] from='client.? 172.21.15.80:0/944033' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:38:46.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:45.550013+0000 mon.a (mon.0) 914 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:38:46.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:45.989357+0000 mon.a (mon.0) 915 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:38:46.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:45.993727+0000 mon.a (mon.0) 916 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:38:46.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:45.993782+0000 mon.a (mon.0) 917 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2024-02-19T21:38:46.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:44.920013+0000 mgr.y (mgr.14514) 243 : cluster [DBG] pgmap v255: 148 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 142 active+clean; 1.3 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 759 op/s; 5995/64788 objects misplaced (9.253%); 11 MiB/s, 183 objects/s recovering 2024-02-19T21:38:46.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:45.549493+0000 mon.b (mon.1) 43 : audit [INF] from='client.? 172.21.15.80:0/944033' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:38:46.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:45.550013+0000 mon.a (mon.0) 914 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:38:46.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:45.989357+0000 mon.a (mon.0) 915 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:38:46.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:45.993727+0000 mon.a (mon.0) 916 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:38:46.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:45.993782+0000 mon.a (mon.0) 917 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2024-02-19T21:38:47.557 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:38:47.583 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:38:47.600 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:38:47.617 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:38:47.635 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:38:47.652 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:38:47.669 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:38:47.688 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:38:47.689 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:38:47.689 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:38:47.689 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:38:47.689 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:38:47.689 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:38:47.690 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:38:47.690 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:38:47.690 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:38:48.006 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:46.920356+0000 mgr.y (mgr.14514) 244 : cluster [DBG] pgmap v257: 148 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 142 active+clean; 1.2 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 851 op/s; 4748/59358 objects misplaced (7.999%); 16 MiB/s, 256 objects/s recovering 2024-02-19T21:38:48.006 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:46.997960+0000 mon.a (mon.0) 918 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2024-02-19T21:38:48.006 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:47.539192+0000 mon.a (mon.0) 919 : audit [DBG] from='client.? 172.21.15.80:0/852223342' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:38:48.006 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:46.920356+0000 mgr.y (mgr.14514) 244 : cluster [DBG] pgmap v257: 148 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 142 active+clean; 1.2 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 851 op/s; 4748/59358 objects misplaced (7.999%); 16 MiB/s, 256 objects/s recovering 2024-02-19T21:38:48.006 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:46.997960+0000 mon.a (mon.0) 918 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2024-02-19T21:38:48.006 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:47.539192+0000 mon.a (mon.0) 919 : audit [DBG] from='client.? 172.21.15.80:0/852223342' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:38:48.213 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:38:48.217 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:48.218 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:38:48.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:46.920356+0000 mgr.y (mgr.14514) 244 : cluster [DBG] pgmap v257: 148 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 142 active+clean; 1.2 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 851 op/s; 4748/59358 objects misplaced (7.999%); 16 MiB/s, 256 objects/s recovering 2024-02-19T21:38:48.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:46.997960+0000 mon.a (mon.0) 918 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2024-02-19T21:38:48.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:47.539192+0000 mon.a (mon.0) 919 : audit [DBG] from='client.? 172.21.15.80:0/852223342' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:38:48.319 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:38:48.374 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:48.622 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:38:48.622 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:38:48.622 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-02-19T21:38:48.622 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd dump -f json-pretty 2024-02-19T21:38:49.018 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:47.997764+0000 mon.a (mon.0) 920 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2024-02-19T21:38:49.018 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:48.953091+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:38:49.019 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:47.997764+0000 mon.a (mon.0) 920 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2024-02-19T21:38:49.019 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:48.953091+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:38:49.121 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:38:49.149 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:38:49.156 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:49.157 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:38:49.258 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:38:49.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:47.997764+0000 mon.a (mon.0) 920 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2024-02-19T21:38:49.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:48.953091+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:38:49.321 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:49.355 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:38:49.359 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:49.360 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:38:49.460 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:38:49.527 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:49.574 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:38:49.577 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:49.577 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:38:49.678 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:38:49.738 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:49.768 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:38:49.772 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:49.775 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:38:49.876 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:38:49.941 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:50.076 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:48.921132+0000 mgr.y (mgr.14514) 245 : cluster [DBG] pgmap v260: 148 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 142 active+clean; 1.2 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 694 op/s; 4748/59358 objects misplaced (7.999%); 13 MiB/s, 210 objects/s recovering 2024-02-19T21:38:50.076 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:48.921132+0000 mgr.y (mgr.14514) 245 : cluster [DBG] pgmap v260: 148 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 142 active+clean; 1.2 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 694 op/s; 4748/59358 objects misplaced (7.999%); 13 MiB/s, 210 objects/s recovering 2024-02-19T21:38:50.216 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:38:50.221 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:50.221 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:38:50.236 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-19T21:38:50.322 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:38:50.365 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:48.921132+0000 mgr.y (mgr.14514) 245 : cluster [DBG] pgmap v260: 148 pgs: 1 active+remapped+backfill_toofull, 5 active+remapped+backfilling, 142 active+clean; 1.2 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 694 op/s; 4748/59358 objects misplaced (7.999%); 13 MiB/s, 210 objects/s recovering 2024-02-19T21:38:50.366 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:38:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:38:50.368 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:50.416 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:38:50.423 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:50.424 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:38:50.524 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:38:50.574 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:50.617 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:38:50.621 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:50.621 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:38:50.722 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:38:50.786 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:50.812 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:38:50.813 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:50.814 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:38:50.870 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:38:50.915 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:38:50.974 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:51.087 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:38:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:38:50] "GET /metrics HTTP/1.1" 200 175623 "" "Prometheus/2.33.4" 2024-02-19T21:38:51.111 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:38:51.116 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:51.116 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:38:51.151 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:38:51.217 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:38:51.282 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:51.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:50.129919+0000 mgr.y (mgr.14514) 246 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:38:51.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:50.129919+0000 mgr.y (mgr.14514) 246 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:38:51.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:50.129919+0000 mgr.y (mgr.14514) 246 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:38:52.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:50.922885+0000 mgr.y (mgr.14514) 247 : cluster [DBG] pgmap v261: 148 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 144 active+clean; 1.0 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 814 op/s; 3688/50136 objects misplaced (7.356%); 15 MiB/s, 239 objects/s recovering 2024-02-19T21:38:52.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:50.922885+0000 mgr.y (mgr.14514) 247 : cluster [DBG] pgmap v261: 148 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 144 active+clean; 1.0 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 814 op/s; 3688/50136 objects misplaced (7.356%); 15 MiB/s, 239 objects/s recovering 2024-02-19T21:38:52.489 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:38:52.489 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:38:52.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:50.922885+0000 mgr.y (mgr.14514) 247 : cluster [DBG] pgmap v261: 148 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 144 active+clean; 1.0 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 814 op/s; 3688/50136 objects misplaced (7.356%); 15 MiB/s, 239 objects/s recovering 2024-02-19T21:38:52.862 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:38:52.867 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:52.867 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:38:52.968 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:38:53.022 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:53.060 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:38:53.068 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:53.069 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:38:53.169 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:38:53.220 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:53.429 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:38:53.435 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:53.435 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:38:53.444 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_historic_ops 2024-02-19T21:38:53.536 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:38:53.592 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:54.051 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:38:54.059 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:54.060 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:38:54.071 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:38:54.137 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:38:54.161 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:38:54.204 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:54.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:52.923306+0000 mgr.y (mgr.14514) 248 : cluster [DBG] pgmap v262: 148 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 144 active+clean; 1.0 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 738 B/s rd, 0 B/s wr, 444 op/s; 3688/50136 objects misplaced (7.356%); 3.1 MiB/s, 50 objects/s recovering 2024-02-19T21:38:54.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:53.799691+0000 osd.1 (osd.1) 107 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:38:54.351 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:53.799757+0000 osd.1 (osd.1) 108 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:38:54.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:52.923306+0000 mgr.y (mgr.14514) 248 : cluster [DBG] pgmap v262: 148 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 144 active+clean; 1.0 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 738 B/s rd, 0 B/s wr, 444 op/s; 3688/50136 objects misplaced (7.356%); 3.1 MiB/s, 50 objects/s recovering 2024-02-19T21:38:54.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:53.799691+0000 osd.1 (osd.1) 107 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:38:54.352 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:53.799757+0000 osd.1 (osd.1) 108 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:38:54.438 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:38:54.447 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:54.448 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:38:54.548 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:38:54.566 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:52.923306+0000 mgr.y (mgr.14514) 248 : cluster [DBG] pgmap v262: 148 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 144 active+clean; 1.0 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 738 B/s rd, 0 B/s wr, 444 op/s; 3688/50136 objects misplaced (7.356%); 3.1 MiB/s, 50 objects/s recovering 2024-02-19T21:38:54.566 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:53.799691+0000 osd.1 (osd.1) 107 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:38:54.566 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:53.799757+0000 osd.1 (osd.1) 108 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:38:54.613 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:55.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:54.144288+0000 mon.a (mon.0) 922 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2024-02-19T21:38:55.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:54.144288+0000 mon.a (mon.0) 922 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2024-02-19T21:38:55.389 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:38:55.389 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:38:55.389 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 150, 2024-02-19T21:38:55.389 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "6f763558-cf6d-11ee-95bb-87774f69a715", 2024-02-19T21:38:55.389 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2024-02-19T21:26:16.880265+0000", 2024-02-19T21:38:55.390 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2024-02-19T21:38:54.096283+0000", 2024-02-19T21:38:55.390 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2024-02-19T21:32:14.805693+0000", 2024-02-19T21:38:55.390 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2024-02-19T21:31:56.867171+0000", 2024-02-19T21:38:55.390 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-02-19T21:38:55.390 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5801984, 2024-02-19T21:38:55.390 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2024-02-19T21:38:55.390 INFO:teuthology.orchestra.run.smithi080.stdout: "noscrub", 2024-02-19T21:38:55.390 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2024-02-19T21:38:55.390 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2024-02-19T21:38:55.390 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2024-02-19T21:38:55.390 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2024-02-19T21:38:55.390 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:38:55.390 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 18, 2024-02-19T21:38:55.391 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2024-02-19T21:38:55.391 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-02-19T21:38:55.391 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2024-02-19T21:38:55.391 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2024-02-19T21:38:55.391 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 7, 2024-02-19T21:38:55.391 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2024-02-19T21:38:55.391 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "luminous", 2024-02-19T21:38:55.391 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "luminous", 2024-02-19T21:38:55.391 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "pacific", 2024-02-19T21:38:55.391 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2024-02-19T21:38:55.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.391 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2024-02-19T21:38:55.391 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "device_health_metrics", 2024-02-19T21:38:55.391 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:30:05.947623+0000", 2024-02-19T21:38:55.392 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:38:55.392 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:38:55.392 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:38:55.392 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:38:55.392 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:38:55.392 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:38:55.392 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:38:55.392 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:38:55.392 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:38:55.392 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:38:55.392 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:38:55.392 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:38:55.392 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 1, 2024-02-19T21:38:55.393 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 1, 2024-02-19T21:38:55.393 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 1, 2024-02-19T21:38:55.393 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 1, 2024-02-19T21:38:55.393 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 1, 2024-02-19T21:38:55.393 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:38:55.393 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:38:55.393 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:38:55.393 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:38:55.393 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:38:55.393 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:38:55.393 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:38:55.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.393 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "74", 2024-02-19T21:38:55.394 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:38:55.394 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:38:55.394 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:38:55.394 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:38:55.394 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:38:55.394 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:38:55.394 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:38:55.394 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:38:55.394 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:38:55.394 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:38:55.394 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:38:55.394 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:38:55.395 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:38:55.395 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:38:55.395 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:38:55.395 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:38:55.395 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:38:55.395 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:38:55.395 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:38:55.395 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:38:55.395 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:38:55.395 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:38:55.395 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:38:55.395 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:38:55.395 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:38:55.396 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:38:55.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.396 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:38:55.396 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:38:55.396 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:38:55.396 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:38:55.396 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:38:55.396 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:38:55.396 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:38:55.396 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:38:55.396 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:38:55.396 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:38:55.396 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:38:55.396 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2024-02-19T21:38:55.397 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_max": 32, 2024-02-19T21:38:55.397 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 1 2024-02-19T21:38:55.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.397 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:38:55.397 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_devicehealth": {} 2024-02-19T21:38:55.397 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.397 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 2, 2024-02-19T21:38:55.397 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": ".rgw.root", 2024-02-19T21:38:55.397 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:22.082250+0000", 2024-02-19T21:38:55.397 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:38:55.397 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:38:55.397 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:38:55.398 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:38:55.398 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:38:55.398 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:38:55.398 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:38:55.398 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:38:55.398 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:38:55.398 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:38:55.398 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:38:55.398 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:38:55.398 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:38:55.398 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:38:55.398 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:38:55.398 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:38:55.399 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:38:55.399 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:38:55.399 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:38:55.399 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:38:55.399 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:38:55.399 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:38:55.399 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:38:55.399 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:38:55.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.399 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "60", 2024-02-19T21:38:55.399 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:38:55.399 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:38:55.399 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:38:55.399 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:38:55.400 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:38:55.400 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:38:55.400 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:38:55.400 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:38:55.400 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:38:55.400 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:38:55.400 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:38:55.400 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:38:55.400 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:38:55.400 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:38:55.400 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:38:55.400 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:38:55.400 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:38:55.400 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:38:55.400 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:38:55.401 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:38:55.401 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:38:55.401 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:38:55.401 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:38:55.401 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:38:55.401 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:38:55.401 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:38:55.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.401 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:38:55.401 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:38:55.401 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:38:55.401 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:38:55.401 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:38:55.401 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:38:55.402 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:38:55.402 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:38:55.402 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:38:55.402 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:38:55.402 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:38:55.402 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:38:55.402 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:38:55.402 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:38:55.402 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.402 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 3, 2024-02-19T21:38:55.402 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "iscsi", 2024-02-19T21:38:55.402 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:22.333164+0000", 2024-02-19T21:38:55.403 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:38:55.403 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:38:55.403 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:38:55.403 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:38:55.403 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:38:55.403 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:38:55.403 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:38:55.403 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:38:55.403 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:38:55.403 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:38:55.403 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:38:55.403 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:38:55.403 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 3, 2024-02-19T21:38:55.403 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 3, 2024-02-19T21:38:55.403 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 3, 2024-02-19T21:38:55.404 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 3, 2024-02-19T21:38:55.404 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 3, 2024-02-19T21:38:55.404 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:38:55.404 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:38:55.404 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:38:55.404 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:38:55.404 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:38:55.404 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:38:55.404 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:38:55.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.404 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "62", 2024-02-19T21:38:55.404 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:38:55.404 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:38:55.404 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:38:55.405 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:38:55.405 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:38:55.405 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:38:55.405 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:38:55.405 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:38:55.405 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:38:55.405 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:38:55.405 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:38:55.405 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:38:55.405 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:38:55.405 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:38:55.405 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:38:55.405 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:38:55.405 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:38:55.405 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:38:55.406 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:38:55.406 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:38:55.406 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:38:55.406 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:38:55.406 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:38:55.406 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:38:55.406 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:38:55.406 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:38:55.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.406 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:38:55.406 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:38:55.406 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:38:55.406 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:38:55.407 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:38:55.407 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:38:55.407 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:38:55.407 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:38:55.407 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:38:55.407 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:38:55.407 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:38:55.407 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:38:55.407 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:38:55.407 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2024-02-19T21:38:55.407 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.407 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 4, 2024-02-19T21:38:55.407 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.log", 2024-02-19T21:38:55.408 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:23.632615+0000", 2024-02-19T21:38:55.408 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:38:55.408 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:38:55.408 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:38:55.408 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:38:55.408 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:38:55.408 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:38:55.408 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:38:55.408 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:38:55.408 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:38:55.408 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:38:55.408 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:38:55.408 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:38:55.408 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:38:55.408 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:38:55.409 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:38:55.409 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:38:55.409 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:38:55.409 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:38:55.409 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:38:55.409 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:38:55.409 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:38:55.409 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:38:55.409 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:38:55.409 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:38:55.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.409 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "62", 2024-02-19T21:38:55.409 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:38:55.410 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:38:55.410 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:38:55.410 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:38:55.410 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:38:55.410 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:38:55.410 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:38:55.410 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:38:55.410 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:38:55.410 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:38:55.410 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:38:55.410 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:38:55.410 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:38:55.410 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:38:55.410 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:38:55.411 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:38:55.411 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:38:55.411 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:38:55.411 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:38:55.411 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:38:55.411 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:38:55.411 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:38:55.411 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:38:55.411 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:38:55.411 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:38:55.411 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:38:55.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.411 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:38:55.411 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:38:55.411 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:38:55.412 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:38:55.412 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:38:55.412 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:38:55.412 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:38:55.412 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:38:55.412 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:38:55.412 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:38:55.412 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:38:55.412 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:38:55.412 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:38:55.412 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:38:55.412 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.413 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 5, 2024-02-19T21:38:55.413 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.control", 2024-02-19T21:38:55.413 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:25.600876+0000", 2024-02-19T21:38:55.413 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:38:55.413 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:38:55.413 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:38:55.413 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:38:55.413 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:38:55.413 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:38:55.413 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:38:55.413 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:38:55.413 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:38:55.413 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:38:55.413 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:38:55.413 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:38:55.414 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:38:55.414 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:38:55.414 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:38:55.414 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:38:55.414 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:38:55.414 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:38:55.414 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:38:55.414 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:38:55.414 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:38:55.414 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:38:55.415 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:38:55.415 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:38:55.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.415 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "64", 2024-02-19T21:38:55.415 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:38:55.415 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:38:55.415 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:38:55.415 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:38:55.415 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:38:55.415 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:38:55.415 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:38:55.416 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:38:55.416 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:38:55.416 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:38:55.416 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:38:55.416 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:38:55.416 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:38:55.416 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:38:55.416 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:38:55.416 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:38:55.416 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:38:55.416 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:38:55.416 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:38:55.416 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:38:55.416 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:38:55.417 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:38:55.417 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:38:55.417 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:38:55.417 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:38:55.417 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:38:55.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.417 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:38:55.417 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:38:55.417 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:38:55.417 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:38:55.417 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:38:55.417 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:38:55.417 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:38:55.417 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:38:55.417 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:38:55.417 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:38:55.418 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:38:55.418 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:38:55.418 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:38:55.418 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:38:55.418 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.418 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 6, 2024-02-19T21:38:55.418 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.meta", 2024-02-19T21:38:55.418 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:27.661242+0000", 2024-02-19T21:38:55.418 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:38:55.418 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:38:55.418 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:38:55.418 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:38:55.418 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:38:55.419 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:38:55.419 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:38:55.419 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:38:55.419 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:38:55.419 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:38:55.419 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:38:55.419 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:38:55.419 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:38:55.419 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:38:55.419 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:38:55.419 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:38:55.419 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:38:55.419 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:38:55.419 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:38:55.420 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:38:55.420 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:38:55.420 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:38:55.420 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:38:55.420 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:38:55.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.420 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "66", 2024-02-19T21:38:55.420 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:38:55.420 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:38:55.420 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:38:55.420 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:38:55.420 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:38:55.420 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:38:55.420 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:38:55.421 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:38:55.421 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:38:55.421 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:38:55.421 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:38:55.421 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:38:55.421 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:38:55.421 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:38:55.421 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:38:55.421 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:38:55.421 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:38:55.421 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:38:55.421 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:38:55.421 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:38:55.421 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:38:55.422 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:38:55.422 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:38:55.422 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:38:55.422 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:38:55.422 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:38:55.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.422 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:38:55.422 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:38:55.422 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:38:55.422 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:38:55.422 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:38:55.422 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:38:55.422 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:38:55.422 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:38:55.422 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:38:55.423 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:38:55.423 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:38:55.423 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2024-02-19T21:38:55.423 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4 2024-02-19T21:38:55.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.423 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:38:55.423 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:38:55.423 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.423 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 7, 2024-02-19T21:38:55.423 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "unique_pool_0", 2024-02-19T21:38:55.424 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:35:18.572249+0000", 2024-02-19T21:38:55.424 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:38:55.424 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:38:55.424 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:38:55.424 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:38:55.424 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:38:55.424 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:38:55.424 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:38:55.424 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:38:55.424 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:38:55.424 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:38:55.424 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:38:55.424 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:38:55.424 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 16, 2024-02-19T21:38:55.425 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 16, 2024-02-19T21:38:55.425 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 16, 2024-02-19T21:38:55.425 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 16, 2024-02-19T21:38:55.425 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 16, 2024-02-19T21:38:55.425 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:38:55.425 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:38:55.425 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:38:55.425 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:38:55.425 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:38:55.425 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:38:55.425 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:38:55.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.425 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "105", 2024-02-19T21:38:55.425 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:38:55.425 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:38:55.426 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:38:55.426 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:38:55.426 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:38:55.426 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:38:55.426 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:38:55.426 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:38:55.426 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:38:55.426 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:38:55.426 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:38:55.426 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:38:55.426 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:38:55.426 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:38:55.426 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:38:55.426 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:38:55.426 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:38:55.427 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:38:55.427 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:38:55.427 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:38:55.427 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:38:55.427 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:38:55.427 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:38:55.427 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:38:55.427 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:38:55.427 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:38:55.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.427 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:38:55.427 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:38:55.427 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:38:55.427 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:38:55.427 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:38:55.428 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:38:55.428 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:38:55.428 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:38:55.428 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:38:55.428 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:38:55.428 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:38:55.428 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:38:55.428 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:38:55.428 INFO:teuthology.orchestra.run.smithi080.stdout: "rados": {} 2024-02-19T21:38:55.428 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.428 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.428 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:38:55.428 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:38:55.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.429 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2024-02-19T21:38:55.429 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "a72c63f6-46b3-4202-99da-7b0c92b799a5", 2024-02-19T21:38:55.429 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:38:55.429 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:38:55.429 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:38:55.429 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:38:55.429 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:38:55.429 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:38:55.429 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 8, 2024-02-19T21:38:55.429 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 148, 2024-02-19T21:38:55.429 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:38:55.429 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:38:55.429 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:38:55.429 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.429 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.430 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2024-02-19T21:38:55.430 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:38:55.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.430 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.430 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2024-02-19T21:38:55.430 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:38:55.430 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.430 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.430 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:38:55.430 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.430 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.431 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2024-02-19T21:38:55.431 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:38:55.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.431 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.431 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2024-02-19T21:38:55.431 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:38:55.431 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.431 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.431 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:38:55.431 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.431 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.431 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2024-02-19T21:38:55.432 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:38:55.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.432 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.432 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2024-02-19T21:38:55.432 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:38:55.432 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.432 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.432 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:38:55.432 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.432 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.432 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2024-02-19T21:38:55.433 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:38:55.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.433 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.433 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2024-02-19T21:38:55.433 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:38:55.433 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.433 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.433 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6803/3531298825", 2024-02-19T21:38:55.433 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6805/3531298825", 2024-02-19T21:38:55.433 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6809/3531298825", 2024-02-19T21:38:55.433 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6807/3531298825", 2024-02-19T21:38:55.434 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:38:55.434 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:38:55.434 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:38:55.434 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.434 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2024-02-19T21:38:55.434 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "7d4e170e-b0ca-4e19-be35-4038ca126ee6", 2024-02-19T21:38:55.434 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:38:55.434 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:38:55.434 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:38:55.434 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:38:55.434 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:38:55.434 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:38:55.435 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-02-19T21:38:55.435 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 144, 2024-02-19T21:38:55.435 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:38:55.435 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:38:55.435 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:38:55.435 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.435 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.435 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2024-02-19T21:38:55.435 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:38:55.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.435 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.435 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2024-02-19T21:38:55.436 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:38:55.436 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.436 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.436 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:38:55.436 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.436 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.436 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2024-02-19T21:38:55.436 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:38:55.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.436 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.436 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2024-02-19T21:38:55.437 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:38:55.437 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.437 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.437 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:38:55.437 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.437 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.437 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2024-02-19T21:38:55.437 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:38:55.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.437 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.437 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2024-02-19T21:38:55.438 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:38:55.438 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.438 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.438 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:38:55.438 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.438 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.438 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2024-02-19T21:38:55.438 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:38:55.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.438 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.438 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2024-02-19T21:38:55.439 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:38:55.439 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.439 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.439 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6811/1497235950", 2024-02-19T21:38:55.439 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6813/1497235950", 2024-02-19T21:38:55.439 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6817/1497235950", 2024-02-19T21:38:55.439 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6815/1497235950", 2024-02-19T21:38:55.439 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:38:55.439 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:38:55.439 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:38:55.439 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.439 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2024-02-19T21:38:55.439 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "cf461b67-f3e8-45e9-b2f6-777752ba5574", 2024-02-19T21:38:55.440 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:38:55.440 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:38:55.440 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:38:55.440 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:38:55.440 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:38:55.440 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:38:55.440 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 18, 2024-02-19T21:38:55.440 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 144, 2024-02-19T21:38:55.440 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:38:55.440 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:38:55.440 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:38:55.440 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.440 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.441 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2024-02-19T21:38:55.441 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:38:55.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.441 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.441 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2024-02-19T21:38:55.441 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:38:55.441 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.441 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.441 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:38:55.441 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.441 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.441 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2024-02-19T21:38:55.442 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:38:55.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.442 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.442 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2024-02-19T21:38:55.442 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:38:55.442 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.442 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.442 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:38:55.442 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.442 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.442 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2024-02-19T21:38:55.443 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:38:55.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.443 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.443 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2024-02-19T21:38:55.443 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:38:55.443 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.443 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.443 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:38:55.443 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.443 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.443 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2024-02-19T21:38:55.443 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:38:55.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.444 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.444 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2024-02-19T21:38:55.444 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:38:55.444 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.444 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.444 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6819/3131848307", 2024-02-19T21:38:55.444 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6821/3131848307", 2024-02-19T21:38:55.444 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6825/3131848307", 2024-02-19T21:38:55.444 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6823/3131848307", 2024-02-19T21:38:55.444 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:38:55.444 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:38:55.445 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:38:55.445 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.445 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2024-02-19T21:38:55.445 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "76318cdd-5fce-4a40-95c9-300d55c34820", 2024-02-19T21:38:55.445 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:38:55.445 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:38:55.445 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 0.3962554931640625, 2024-02-19T21:38:55.445 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:38:55.445 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:38:55.445 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:38:55.445 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 26, 2024-02-19T21:38:55.445 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 100, 2024-02-19T21:38:55.445 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:38:55.446 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:38:55.446 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:38:55.446 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.446 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.446 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2024-02-19T21:38:55.446 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:38:55.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.446 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.446 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2024-02-19T21:38:55.446 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:38:55.446 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.446 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.447 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:38:55.447 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.447 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.447 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2024-02-19T21:38:55.447 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:38:55.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.447 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.447 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2024-02-19T21:38:55.447 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:38:55.447 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.447 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.448 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:38:55.448 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.448 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.448 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6832", 2024-02-19T21:38:55.448 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:38:55.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.448 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.448 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6833", 2024-02-19T21:38:55.448 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:38:55.448 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.448 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.449 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:38:55.449 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.449 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.449 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2024-02-19T21:38:55.449 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:38:55.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.449 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.449 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2024-02-19T21:38:55.449 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:38:55.449 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.449 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.449 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6827/2007978078", 2024-02-19T21:38:55.450 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6829/2007978078", 2024-02-19T21:38:55.450 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6833/2007978078", 2024-02-19T21:38:55.450 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6831/2007978078", 2024-02-19T21:38:55.450 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:38:55.450 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:38:55.450 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:38:55.450 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.450 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.450 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2024-02-19T21:38:55.450 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "6484964f-3391-4e1d-a56c-813f46124062", 2024-02-19T21:38:55.450 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:38:55.450 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:38:55.450 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:38:55.451 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 0.427398681640625, 2024-02-19T21:38:55.451 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:38:55.451 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:38:55.451 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 32, 2024-02-19T21:38:55.451 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 144, 2024-02-19T21:38:55.451 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:38:55.451 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:38:55.451 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:38:55.451 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.451 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.451 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6800", 2024-02-19T21:38:55.451 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:38:55.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.452 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.452 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6801", 2024-02-19T21:38:55.452 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:38:55.452 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.452 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.452 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:38:55.452 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.452 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.452 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6802", 2024-02-19T21:38:55.452 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:38:55.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.453 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.453 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6803", 2024-02-19T21:38:55.453 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:38:55.453 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.453 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.453 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:38:55.453 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.453 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.453 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6806", 2024-02-19T21:38:55.453 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:38:55.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.454 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.454 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6807", 2024-02-19T21:38:55.454 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:38:55.454 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.454 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.454 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:38:55.454 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.454 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.454 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6804", 2024-02-19T21:38:55.454 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:38:55.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.455 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.455 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6805", 2024-02-19T21:38:55.455 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:38:55.455 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.455 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.455 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6801/1922002860", 2024-02-19T21:38:55.455 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6803/1922002860", 2024-02-19T21:38:55.455 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6807/1922002860", 2024-02-19T21:38:55.455 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6805/1922002860", 2024-02-19T21:38:55.455 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:38:55.455 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:38:55.455 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:38:55.455 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.456 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2024-02-19T21:38:55.456 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "8c7e0309-8c3b-40b9-99d9-96620e52742f", 2024-02-19T21:38:55.456 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:38:55.456 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:38:55.456 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:38:55.456 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:38:55.456 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:38:55.456 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:38:55.456 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 38, 2024-02-19T21:38:55.456 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 145, 2024-02-19T21:38:55.456 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:38:55.456 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:38:55.456 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:38:55.457 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.457 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.457 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6808", 2024-02-19T21:38:55.457 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:38:55.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.457 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.457 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6809", 2024-02-19T21:38:55.457 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:38:55.457 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.457 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.457 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:38:55.457 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.458 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.458 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6810", 2024-02-19T21:38:55.458 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:38:55.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.458 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.458 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6811", 2024-02-19T21:38:55.458 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:38:55.458 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.458 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.458 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:38:55.458 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.459 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.459 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6814", 2024-02-19T21:38:55.459 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:38:55.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.459 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.459 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6815", 2024-02-19T21:38:55.459 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:38:55.459 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.459 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.459 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:38:55.459 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.460 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.460 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6812", 2024-02-19T21:38:55.460 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:38:55.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.460 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.460 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6813", 2024-02-19T21:38:55.460 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:38:55.460 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.460 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.460 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6809/960889603", 2024-02-19T21:38:55.460 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6811/960889603", 2024-02-19T21:38:55.461 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6815/960889603", 2024-02-19T21:38:55.461 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6813/960889603", 2024-02-19T21:38:55.461 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:38:55.461 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:38:55.461 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:38:55.461 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.461 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2024-02-19T21:38:55.461 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "5b7d44a3-197d-482c-bf9e-de5e9013a851", 2024-02-19T21:38:55.461 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:38:55.461 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:38:55.461 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:38:55.462 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:38:55.462 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:38:55.462 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:38:55.462 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 47, 2024-02-19T21:38:55.462 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 145, 2024-02-19T21:38:55.462 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:38:55.462 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:38:55.462 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:38:55.462 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.462 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.462 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6816", 2024-02-19T21:38:55.462 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:38:55.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.463 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.463 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6817", 2024-02-19T21:38:55.463 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:38:55.463 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.463 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.463 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:38:55.463 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.463 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.463 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6818", 2024-02-19T21:38:55.463 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:38:55.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.464 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.464 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6819", 2024-02-19T21:38:55.464 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:38:55.464 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.464 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.464 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:38:55.464 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.464 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.464 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6822", 2024-02-19T21:38:55.464 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:38:55.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.464 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.465 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6823", 2024-02-19T21:38:55.465 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:38:55.465 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.465 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.465 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:38:55.465 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.465 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.465 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6820", 2024-02-19T21:38:55.465 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:38:55.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.465 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.465 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6821", 2024-02-19T21:38:55.466 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:38:55.466 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.466 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.466 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6817/2598265223", 2024-02-19T21:38:55.466 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6819/2598265223", 2024-02-19T21:38:55.466 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6823/2598265223", 2024-02-19T21:38:55.466 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6821/2598265223", 2024-02-19T21:38:55.466 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:38:55.466 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:38:55.466 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:38:55.466 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.467 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2024-02-19T21:38:55.467 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "7e2d0287-928d-40f8-841b-6c2077fc08ac", 2024-02-19T21:38:55.467 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:38:55.467 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:38:55.467 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:38:55.467 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:38:55.467 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:38:55.467 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:38:55.467 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 55, 2024-02-19T21:38:55.467 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 144, 2024-02-19T21:38:55.467 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:38:55.467 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:38:55.467 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:38:55.467 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.468 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.468 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6824", 2024-02-19T21:38:55.468 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:38:55.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.468 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.468 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6825", 2024-02-19T21:38:55.468 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:38:55.468 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.468 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.468 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:38:55.468 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.469 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.469 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6826", 2024-02-19T21:38:55.469 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:38:55.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.469 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.469 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6827", 2024-02-19T21:38:55.469 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:38:55.469 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.469 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.469 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:38:55.469 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.470 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.470 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6830", 2024-02-19T21:38:55.470 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:38:55.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.470 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.470 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6831", 2024-02-19T21:38:55.470 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:38:55.470 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.470 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.470 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:38:55.470 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:38:55.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.471 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:38:55.471 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6828", 2024-02-19T21:38:55.471 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:38:55.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.471 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:38:55.471 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6829", 2024-02-19T21:38:55.471 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:38:55.471 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.471 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.471 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6825/3619345894", 2024-02-19T21:38:55.471 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6827/3619345894", 2024-02-19T21:38:55.471 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6831/3619345894", 2024-02-19T21:38:55.471 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6829/3619345894", 2024-02-19T21:38:55.472 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:38:55.472 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:38:55.472 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:38:55.472 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.472 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.472 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:38:55.472 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2024-02-19T21:38:55.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.472 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2024-02-19T21:38:55.472 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:38:55.472 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:38:55.472 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:38:55.472 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:38:55.472 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:38:55.473 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:38:05.884341+0000", 2024-02-19T21:38:55.473 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:38:55.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.473 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2024-02-19T21:38:55.473 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:38:55.473 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:38:55.473 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:38:55.473 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:38:55.473 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:38:55.473 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:38:53.799761+0000", 2024-02-19T21:38:55.473 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:38:55.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.473 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2024-02-19T21:38:55.474 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:38:55.474 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:38:55.474 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:38:55.474 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:38:55.474 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:38:55.474 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:38:05.838293+0000", 2024-02-19T21:38:55.474 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:38:55.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.474 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2024-02-19T21:38:55.474 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:38:55.474 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:38:55.474 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:38:55.474 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:38:55.475 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:38:55.475 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:38:03.162067+0000", 2024-02-19T21:38:55.475 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:38:55.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.475 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2024-02-19T21:38:55.475 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:38:55.475 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:38:55.475 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:38:55.475 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:38:55.475 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:38:55.475 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:37:35.171200+0000", 2024-02-19T21:38:55.475 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:38:55.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.476 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2024-02-19T21:38:55.476 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:38:55.476 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:38:55.476 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:38:55.476 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:38:55.476 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:38:55.476 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:37:42.384834+0000", 2024-02-19T21:38:55.476 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:38:55.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.476 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2024-02-19T21:38:55.476 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:38:55.476 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:38:55.477 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:38:55.477 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:38:55.477 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:38:55.477 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:37:53.470502+0000", 2024-02-19T21:38:55.477 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:38:55.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.477 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2024-02-19T21:38:55.477 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:38:55.477 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:38:55.477 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:38:55.477 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:38:55.477 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:38:55.477 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:37:49.698640+0000", 2024-02-19T21:38:55.477 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:38:55.478 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.478 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:38:55.478 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [], 2024-02-19T21:38:55.478 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [ 2024-02-19T21:38:55.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.478 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "2.1b", 2024-02-19T21:38:55.478 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:38:55.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.478 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 7, 2024-02-19T21:38:55.478 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 2 2024-02-19T21:38:55.478 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.478 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.478 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.2", 2024-02-19T21:38:55.479 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:38:55.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.479 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:38:55.479 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 2 2024-02-19T21:38:55.479 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.479 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.479 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.6", 2024-02-19T21:38:55.479 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:38:55.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.479 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:38:55.479 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 5 2024-02-19T21:38:55.479 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.479 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.480 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.1b", 2024-02-19T21:38:55.480 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:38:55.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.480 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:38:55.480 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 2 2024-02-19T21:38:55.480 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.480 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.480 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.480 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:38:55.480 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [ 2024-02-19T21:38:55.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.480 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "7.0", 2024-02-19T21:38:55.481 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:38:55.481 INFO:teuthology.orchestra.run.smithi080.stdout: 5, 2024-02-19T21:38:55.481 INFO:teuthology.orchestra.run.smithi080.stdout: 1, 2024-02-19T21:38:55.481 INFO:teuthology.orchestra.run.smithi080.stdout: 3 2024-02-19T21:38:55.481 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.481 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "7.1", 2024-02-19T21:38:55.481 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:38:55.481 INFO:teuthology.orchestra.run.smithi080.stdout: 6, 2024-02-19T21:38:55.481 INFO:teuthology.orchestra.run.smithi080.stdout: 4, 2024-02-19T21:38:55.481 INFO:teuthology.orchestra.run.smithi080.stdout: 3 2024-02-19T21:38:55.481 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.482 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "7.7", 2024-02-19T21:38:55.482 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:38:55.482 INFO:teuthology.orchestra.run.smithi080.stdout: 6, 2024-02-19T21:38:55.482 INFO:teuthology.orchestra.run.smithi080.stdout: 0, 2024-02-19T21:38:55.482 INFO:teuthology.orchestra.run.smithi080.stdout: 3 2024-02-19T21:38:55.482 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:38:55.482 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "7.c", 2024-02-19T21:38:55.482 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:38:55.482 INFO:teuthology.orchestra.run.smithi080.stdout: 6, 2024-02-19T21:38:55.482 INFO:teuthology.orchestra.run.smithi080.stdout: 7, 2024-02-19T21:38:55.482 INFO:teuthology.orchestra.run.smithi080.stdout: 3 2024-02-19T21:38:55.482 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:38:55.482 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.483 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:38:55.483 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2024-02-19T21:38:55.483 INFO:teuthology.orchestra.run.smithi080.stdout: "blocklist": { 2024-02-19T21:38:55.483 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6800/2867197629": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:38:55.483 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/1659656010": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:38:55.483 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6801/2272739550": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:38:55.483 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/867908385": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:38:55.483 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/398750494": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:38:55.483 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/2833137430": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:38:55.483 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/2520755315": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:38:55.483 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6800/2094869828": "2024-02-20T21:26:51.262073+0000", 2024-02-19T21:38:55.483 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6800/2272739550": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:38:55.483 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6801/2094869828": "2024-02-20T21:26:51.262073+0000", 2024-02-19T21:38:55.483 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/2130852198": "2024-02-20T21:26:51.262073+0000", 2024-02-19T21:38:55.483 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6801/2867197629": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:38:55.484 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/1952386920": "2024-02-20T21:26:51.262073+0000" 2024-02-19T21:38:55.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.484 INFO:teuthology.orchestra.run.smithi080.stdout: "range_blocklist": {}, 2024-02-19T21:38:55.484 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2024-02-19T21:38:55.484 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2024-02-19T21:38:55.484 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2024-02-19T21:38:55.484 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2024-02-19T21:38:55.484 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2024-02-19T21:38:55.484 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2024-02-19T21:38:55.484 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2024-02-19T21:38:55.484 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2024-02-19T21:38:55.484 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:38:55.484 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2024-02-19T21:38:55.485 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2024-02-19T21:38:55.485 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2024-02-19T21:38:55.485 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2024-02-19T21:38:55.485 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {}, 2024-02-19T21:38:55.485 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode": { 2024-02-19T21:38:55.485 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode_enabled": false, 2024-02-19T21:38:55.485 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_bucket_count": 0, 2024-02-19T21:38:55.485 INFO:teuthology.orchestra.run.smithi080.stdout: "degraded_stretch_mode": 0, 2024-02-19T21:38:55.485 INFO:teuthology.orchestra.run.smithi080.stdout: "recovering_stretch_mode": 0, 2024-02-19T21:38:55.485 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode_bucket": 0 2024-02-19T21:38:55.485 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:38:55.485 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:38:55.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:54.144288+0000 mon.a (mon.0) 922 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2024-02-19T21:38:55.991 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:38:56.002 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:56.002 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:38:56.057 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:38:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:38:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:38:56.103 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:38:56.158 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:56.199 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:38:56.203 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:56.204 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:38:56.304 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:38:56.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:54.930184+0000 mgr.y (mgr.14514) 249 : cluster [DBG] pgmap v264: 148 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 144 active+clean; 878 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 700 op/s; 2557/42705 objects misplaced (5.988%); 4.1 MiB/s, 65 objects/s recovering 2024-02-19T21:38:56.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:55.383564+0000 mon.b (mon.1) 44 : audit [DBG] from='client.? 172.21.15.80:0/2730188210' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-19T21:38:56.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:54.930184+0000 mgr.y (mgr.14514) 249 : cluster [DBG] pgmap v264: 148 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 144 active+clean; 878 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 700 op/s; 2557/42705 objects misplaced (5.988%); 4.1 MiB/s, 65 objects/s recovering 2024-02-19T21:38:56.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:55.383564+0000 mon.b (mon.1) 44 : audit [DBG] from='client.? 172.21.15.80:0/2730188210' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-19T21:38:56.369 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:56.428 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:38:56.433 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:54.930184+0000 mgr.y (mgr.14514) 249 : cluster [DBG] pgmap v264: 148 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 144 active+clean; 878 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 700 op/s; 2557/42705 objects misplaced (5.988%); 4.1 MiB/s, 65 objects/s recovering 2024-02-19T21:38:56.433 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:55.383564+0000 mon.b (mon.1) 44 : audit [DBG] from='client.? 172.21.15.80:0/2730188210' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-19T21:38:56.433 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:56.434 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:38:56.455 INFO:tasks.thrashosds.thrasher:j is {'epoch': 150, 'fsid': '6f763558-cf6d-11ee-95bb-87774f69a715', 'created': '2024-02-19T21:26:16.880265+0000', 'modified': '2024-02-19T21:38:54.096283+0000', 'last_up_change': '2024-02-19T21:32:14.805693+0000', 'last_in_change': '2024-02-19T21:31:56.867171+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 18, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 7, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-19T21:30:05.947623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2024-02-19T21:32:22.082250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2024-02-19T21:32:22.333164+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 3, 'pg_placement_num': 3, 'pg_placement_num_target': 3, 'pg_num_target': 3, 'pg_num_pending': 3, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2024-02-19T21:32:23.632615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2024-02-19T21:32:25.600876+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2024-02-19T21:32:27.661242+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}}, {'pool': 7, 'pool_name': 'unique_pool_0', 'create_time': '2024-02-19T21:35:18.572249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': 'a72c63f6-46b3-4202-99da-7b0c92b799a5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 148, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6802', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6803', 'nonce': 3531298825}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6804', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6805', 'nonce': 3531298825}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6808', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6809', 'nonce': 3531298825}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6806', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6807', 'nonce': 3531298825}]}, 'public_addr': '172.21.15.80:6803/3531298825', 'cluster_addr': '172.21.15.80:6805/3531298825', 'heartbeat_back_addr': '172.21.15.80:6809/3531298825', 'heartbeat_front_addr': '172.21.15.80:6807/3531298825', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7d4e170e-b0ca-4e19-be35-4038ca126ee6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 144, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6810', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6811', 'nonce': 1497235950}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6812', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6813', 'nonce': 1497235950}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6816', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6817', 'nonce': 1497235950}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6814', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6815', 'nonce': 1497235950}]}, 'public_addr': '172.21.15.80:6811/1497235950', 'cluster_addr': '172.21.15.80:6813/1497235950', 'heartbeat_back_addr': '172.21.15.80:6817/1497235950', 'heartbeat_front_addr': '172.21.15.80:6815/1497235950', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'cf461b67-f3e8-45e9-b2f6-777752ba5574', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 18, 'up_thru': 144, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6818', 'nonce': 3131848307}, {'type': 'v1', 'addr': '172.21.15.80:6819', 'nonce': 3131848307}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6820', 'nonce': 3131848307}, {'type': 'v1', 'addr': '172.21.15.80:6821', 'nonce': 3131848307}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6824', 'nonce': 3131848307}, {'type': 'v1', 'addr': '172.21.15.80:6825', 'nonce': 3131848307}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6822', 'nonce': 3131848307}, {'type': 'v1', 'addr': '172.21.15.80:6823', 'nonce': 3131848307}]}, 'public_addr': '172.21.15.80:6819/3131848307', 'cluster_addr': '172.21.15.80:6821/3131848307', 'heartbeat_back_addr': '172.21.15.80:6825/3131848307', 'heartbeat_front_addr': '172.21.15.80:6823/3131848307', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '76318cdd-5fce-4a40-95c9-300d55c34820', 'up': 1, 'in': 1, 'weight': 0.3962554931640625, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 26, 'up_thru': 100, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6826', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6827', 'nonce': 2007978078}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6828', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6829', 'nonce': 2007978078}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6832', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6833', 'nonce': 2007978078}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6830', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6831', 'nonce': 2007978078}]}, 'public_addr': '172.21.15.80:6827/2007978078', 'cluster_addr': '172.21.15.80:6829/2007978078', 'heartbeat_back_addr': '172.21.15.80:6833/2007978078', 'heartbeat_front_addr': '172.21.15.80:6831/2007978078', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '6484964f-3391-4e1d-a56c-813f46124062', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.427398681640625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 32, 'up_thru': 144, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6800', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6801', 'nonce': 1922002860}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6802', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6803', 'nonce': 1922002860}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6806', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6807', 'nonce': 1922002860}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6804', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6805', 'nonce': 1922002860}]}, 'public_addr': '172.21.15.157:6801/1922002860', 'cluster_addr': '172.21.15.157:6803/1922002860', 'heartbeat_back_addr': '172.21.15.157:6807/1922002860', 'heartbeat_front_addr': '172.21.15.157:6805/1922002860', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '8c7e0309-8c3b-40b9-99d9-96620e52742f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 38, 'up_thru': 145, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6808', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6809', 'nonce': 960889603}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6810', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6811', 'nonce': 960889603}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6814', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6815', 'nonce': 960889603}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6812', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6813', 'nonce': 960889603}]}, 'public_addr': '172.21.15.157:6809/960889603', 'cluster_addr': '172.21.15.157:6811/960889603', 'heartbeat_back_addr': '172.21.15.157:6815/960889603', 'heartbeat_front_addr': '172.21.15.157:6813/960889603', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '5b7d44a3-197d-482c-bf9e-de5e9013a851', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 47, 'up_thru': 145, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6816', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6817', 'nonce': 2598265223}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6818', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6819', 'nonce': 2598265223}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6822', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6823', 'nonce': 2598265223}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6820', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6821', 'nonce': 2598265223}]}, 'public_addr': '172.21.15.157:6817/2598265223', 'cluster_addr': '172.21.15.157:6819/2598265223', 'heartbeat_back_addr': '172.21.15.157:6823/2598265223', 'heartbeat_front_addr': '172.21.15.157:6821/2598265223', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '7e2d0287-928d-40f8-841b-6c2077fc08ac', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 55, 'up_thru': 144, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6824', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6825', 'nonce': 3619345894}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6826', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6827', 'nonce': 3619345894}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6830', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6831', 'nonce': 3619345894}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6828', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6829', 'nonce': 3619345894}]}, 'public_addr': '172.21.15.157:6825/3619345894', 'cluster_addr': '172.21.15.157:6827/3619345894', 'heartbeat_back_addr': '172.21.15.157:6831/3619345894', 'heartbeat_front_addr': '172.21.15.157:6829/3619345894', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:38:05.884341+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:38:53.799761+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:38:05.838293+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:38:03.162067+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:37:35.171200+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:37:42.384834+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:37:53.470502+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:37:49.698640+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '2.1b', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '4.2', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '4.6', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.1b', 'mappings': [{'from': 1, 'to': 2}]}], 'pg_temp': [{'pgid': '7.0', 'osds': [5, 1, 3]}, {'pgid': '7.1', 'osds': [6, 4, 3]}, {'pgid': '7.7', 'osds': [6, 0, 3]}, {'pgid': '7.c', 'osds': [6, 7, 3]}], 'primary_temp': [], 'blocklist': {'172.21.15.80:6800/2867197629': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:0/1659656010': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:6801/2272739550': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:0/867908385': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:0/398750494': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:0/2833137430': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:0/2520755315': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:6800/2094869828': '2024-02-20T21:26:51.262073+0000', '172.21.15.80:6800/2272739550': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:6801/2094869828': '2024-02-20T21:26:51.262073+0000', '172.21.15.80:0/2130852198': '2024-02-20T21:26:51.262073+0000', '172.21.15.80:6801/2867197629': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:0/1952386920': '2024-02-20T21:26:51.262073+0000'}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-02-19T21:38:56.455 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:38:56.534 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:38:56.577 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:56.618 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:38:56.631 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:56.631 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:38:56.732 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:38:56.801 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:57.065 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:38:57.076 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:57.076 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:38:57.101 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:38:57.177 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:38:57.243 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:57.381 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:38:57.385 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:57.386 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:38:57.486 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:38:57.537 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:57.711 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:38:57.717 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:57.717 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:38:57.818 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:38:57.871 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:57.898 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:38:57.906 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:57.907 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:38:58.007 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:38:58.064 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:58.108 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:38:58.109 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:58.110 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:38:58.210 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:38:58.250 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:58.294 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:38:58.304 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:58.304 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:38:58.405 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:38:58.470 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:56.933517+0000 mgr.y (mgr.14514) 250 : cluster [DBG] pgmap v265: 148 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 144 active+clean; 758 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 836 op/s; 2557/36960 objects misplaced (6.918%); 3.7 MiB/s, 58 objects/s recovering 2024-02-19T21:38:58.470 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:56.933517+0000 mgr.y (mgr.14514) 250 : cluster [DBG] pgmap v265: 148 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 144 active+clean; 758 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 836 op/s; 2557/36960 objects misplaced (6.918%); 3.7 MiB/s, 58 objects/s recovering 2024-02-19T21:38:58.475 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:58.554 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:38:58.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:56.933517+0000 mgr.y (mgr.14514) 250 : cluster [DBG] pgmap v265: 148 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 144 active+clean; 758 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 836 op/s; 2557/36960 objects misplaced (6.918%); 3.7 MiB/s, 58 objects/s recovering 2024-02-19T21:38:58.557 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:38:58.558 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:38:58.659 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:38:58.720 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:38:59.202 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-02-19T21:38:59.213 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:38:59.562 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:58.488423+0000 mon.c (mon.2) 35 : audit [INF] from='client.? 172.21.15.80:0/1510388920' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:38:59.562 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:38:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:58.488917+0000 mon.a (mon.0) 923 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:38:59.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:58.488423+0000 mon.c (mon.2) 35 : audit [INF] from='client.? 172.21.15.80:0/1510388920' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:38:59.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:38:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:58.488917+0000 mon.a (mon.0) 923 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:38:59.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:58.488423+0000 mon.c (mon.2) 35 : audit [INF] from='client.? 172.21.15.80:0/1510388920' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:38:59.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:38:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:58.488917+0000 mon.a (mon.0) 923 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:39:00.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:58.936024+0000 mgr.y (mgr.14514) 251 : cluster [DBG] pgmap v266: 148 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 144 active+clean; 758 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 746 op/s; 2557/36960 objects misplaced (6.918%); 3.3 MiB/s, 52 objects/s recovering 2024-02-19T21:39:00.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:59.172859+0000 mon.a (mon.0) 924 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:39:00.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:38:59.183614+0000 mon.a (mon.0) 925 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:39:00.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:38:59.183680+0000 mon.a (mon.0) 926 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2024-02-19T21:39:00.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:58.936024+0000 mgr.y (mgr.14514) 251 : cluster [DBG] pgmap v266: 148 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 144 active+clean; 758 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 746 op/s; 2557/36960 objects misplaced (6.918%); 3.3 MiB/s, 52 objects/s recovering 2024-02-19T21:39:00.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:59.172859+0000 mon.a (mon.0) 924 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:39:00.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:38:59.183614+0000 mon.a (mon.0) 925 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:39:00.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:38:59.183680+0000 mon.a (mon.0) 926 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2024-02-19T21:39:00.557 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:39:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:39:00.561 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:58.936024+0000 mgr.y (mgr.14514) 251 : cluster [DBG] pgmap v266: 148 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 144 active+clean; 758 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1022 B/s rd, 0 B/s wr, 746 op/s; 2557/36960 objects misplaced (6.918%); 3.3 MiB/s, 52 objects/s recovering 2024-02-19T21:39:00.561 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:59.172859+0000 mon.a (mon.0) 924 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:39:00.561 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:38:59.183614+0000 mon.a (mon.0) 925 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:39:00.561 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:38:59.183680+0000 mon.a (mon.0) 926 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2024-02-19T21:39:00.850 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:39:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:39:00] "GET /metrics HTTP/1.1" 200 175623 "" "Prometheus/2.33.4" 2024-02-19T21:39:00.912 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:39:00.916 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:00.917 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:39:01.018 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:39:01.078 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:01.110 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:39:01.114 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:01.115 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:39:01.216 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:39:01.281 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:01.311 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:39:01.314 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:01.315 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:39:01.415 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:39:01.488 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:01.489 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:00.147566+0000 mgr.y (mgr.14514) 252 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:39:01.534 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:39:01.545 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:01.546 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:39:01.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:00.147566+0000 mgr.y (mgr.14514) 252 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:39:01.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:00.147566+0000 mgr.y (mgr.14514) 252 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:39:01.647 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:39:01.722 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:01.800 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:39:01.819 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:01.819 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:39:01.920 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:39:01.971 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:02.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:00.938254+0000 mgr.y (mgr.14514) 253 : cluster [DBG] pgmap v268: 148 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 144 active+clean; 482 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.10k op/s; 1493/23730 objects misplaced (6.292%); 2.7 MiB/s, 43 objects/s recovering 2024-02-19T21:39:02.583 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:00.938254+0000 mgr.y (mgr.14514) 253 : cluster [DBG] pgmap v268: 148 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 144 active+clean; 482 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.10k op/s; 1493/23730 objects misplaced (6.292%); 2.7 MiB/s, 43 objects/s recovering 2024-02-19T21:39:02.583 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:00.938254+0000 mgr.y (mgr.14514) 253 : cluster [DBG] pgmap v268: 148 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 144 active+clean; 482 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.10k op/s; 1493/23730 objects misplaced (6.292%); 2.7 MiB/s, 43 objects/s recovering 2024-02-19T21:39:02.838 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:39:02.845 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:02.846 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:39:02.947 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:39:02.999 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:03.036 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:39:03.038 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:03.039 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:39:03.081 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset noscrub 2024-02-19T21:39:03.140 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:39:03.195 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:03.256 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:39:03.265 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:39:03.274 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:03.275 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:39:03.301 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:39:03.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:03.149475+0000 mon.c (mon.2) 36 : audit [DBG] from='client.? 172.21.15.80:0/894980372' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:39:03.355 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:39:03.376 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:39:03.394 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:39:03.431 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:03.149475+0000 mon.c (mon.2) 36 : audit [DBG] from='client.? 172.21.15.80:0/894980372' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:39:03.431 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:03.149475+0000 mon.c (mon.2) 36 : audit [DBG] from='client.? 172.21.15.80:0/894980372' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:39:03.439 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:03.451 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:39:03.485 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:39:03.492 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:03.492 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:39:03.497 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:39:03.523 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:39:03.574 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:39:03.592 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:39:03.593 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:39:03.593 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:39:03.593 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:39:03.593 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:39:03.594 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:39:03.594 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:39:03.594 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:39:03.594 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:39:03.676 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:39:03.683 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:39:03.693 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:04.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:02.595311+0000 osd.4 (osd.4) 99 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:39:04.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:02.595364+0000 osd.4 (osd.4) 100 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:39:04.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:02.939819+0000 mgr.y (mgr.14514) 254 : cluster [DBG] pgmap v269: 148 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 144 active+clean; 482 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.00k op/s; 1493/23730 objects misplaced (6.292%); 2.5 MiB/s, 39 objects/s recovering 2024-02-19T21:39:04.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:03.249310+0000 mon.a (mon.0) 927 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2024-02-19T21:39:04.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:03.653213+0000 mgr.y (mgr.14514) 255 : audit [DBG] from='client.24860 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:39:04.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:02.595311+0000 osd.4 (osd.4) 99 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:39:04.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:02.595364+0000 osd.4 (osd.4) 100 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:39:04.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:02.939819+0000 mgr.y (mgr.14514) 254 : cluster [DBG] pgmap v269: 148 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 144 active+clean; 482 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.00k op/s; 1493/23730 objects misplaced (6.292%); 2.5 MiB/s, 39 objects/s recovering 2024-02-19T21:39:04.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:03.249310+0000 mon.a (mon.0) 927 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2024-02-19T21:39:04.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:03.653213+0000 mgr.y (mgr.14514) 255 : audit [DBG] from='client.24860 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:39:04.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:02.595311+0000 osd.4 (osd.4) 99 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:39:04.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:02.595364+0000 osd.4 (osd.4) 100 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:39:04.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:02.939819+0000 mgr.y (mgr.14514) 254 : cluster [DBG] pgmap v269: 148 pgs: 1 active+remapped+backfill_toofull, 3 active+remapped+backfilling, 144 active+clean; 482 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.00k op/s; 1493/23730 objects misplaced (6.292%); 2.5 MiB/s, 39 objects/s recovering 2024-02-19T21:39:04.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:03.249310+0000 mon.a (mon.0) 927 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2024-02-19T21:39:04.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:03.653213+0000 mgr.y (mgr.14514) 255 : audit [DBG] from='client.24860 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:39:05.062 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:39:05.065 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:05.065 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:39:05.167 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:39:05.239 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:05.283 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:39:05.288 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:05.289 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:39:05.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:04.500240+0000 osd.5 (osd.5) 117 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:39:05.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:04.500305+0000 osd.5 (osd.5) 118 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:39:05.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:05.045474+0000 mon.a (mon.0) 928 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:39:05.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:04.500240+0000 osd.5 (osd.5) 117 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:39:05.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:04.500305+0000 osd.5 (osd.5) 118 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:39:05.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:05.045474+0000 mon.a (mon.0) 928 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:39:05.389 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:39:05.468 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:05.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:04.500240+0000 osd.5 (osd.5) 117 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:39:05.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:04.500305+0000 osd.5 (osd.5) 118 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:39:05.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:05.045474+0000 mon.a (mon.0) 928 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:39:05.572 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:39:05.598 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:05.598 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:39:05.699 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:39:05.819 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:05.851 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:39:05.851 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-02-19T21:39:05.851 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-02-19T21:39:05.851 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-02-19T21:39:05.851 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.851 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:199205 7.f 7:f54f23d5:::benchmark_data_smithi080_79222_object84471:head [delete] snapc 0=[] ondisk+write+known_if_redirected e143)", 2024-02-19T21:39:05.851 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:30.217625+0000", 2024-02-19T21:39:05.851 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 35.628325619999998, 2024-02-19T21:39:05.851 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1406671500000001, 2024-02-19T21:39:05.851 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:39:05.851 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:39:05.852 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:39:05.852 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:39:05.852 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:39:05.852 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 199205 2024-02-19T21:39:05.852 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.852 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:39:05.852 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.852 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:39:05.852 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.217625+0000", 2024-02-19T21:39:05.852 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:39:05.852 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.852 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.852 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:39:05.852 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.217625+0000", 2024-02-19T21:39:05.853 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:39:05.853 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.853 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.853 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:39:05.853 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.217623+0000", 2024-02-19T21:39:05.853 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.859e-06 2024-02-19T21:39:05.853 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.853 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.853 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:39:05.853 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.217633+0000", 2024-02-19T21:39:05.853 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2663000000000001e-05 2024-02-19T21:39:05.853 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.853 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.853 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:39:05.854 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.217646+0000", 2024-02-19T21:39:05.854 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6120000000000004e-06 2024-02-19T21:39:05.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.854 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:39:05.854 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.217652+0000", 2024-02-19T21:39:05.854 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034955870000000001 2024-02-19T21:39:05.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.854 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.854 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.221148+0000", 2024-02-19T21:39:05.855 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113101 2024-02-19T21:39:05.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.855 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:39:05.855 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.221261+0000", 2024-02-19T21:39:05.855 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012301900000000001 2024-02-19T21:39:05.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.855 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:39:05.855 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.221384+0000", 2024-02-19T21:39:05.855 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085185150000000008 2024-02-19T21:39:05.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.855 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.856 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229902+0000", 2024-02-19T21:39:05.856 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035264179999999999 2024-02-19T21:39:05.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.856 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.856 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:39:05.856 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.233429+0000", 2024-02-19T21:39:05.856 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.030760246000000002 2024-02-19T21:39:05.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.856 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.856 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.856 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.264189+0000", 2024-02-19T21:39:05.856 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8979999999999999e-06 2024-02-19T21:39:05.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.856 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:39:05.857 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.264196+0000", 2024-02-19T21:39:05.857 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.981450779 2024-02-19T21:39:05.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.857 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.245647+0000", 2024-02-19T21:39:05.857 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1880000000000001e-05 2024-02-19T21:39:05.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:39:05.857 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.245669+0000", 2024-02-19T21:39:05.857 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.112543785 2024-02-19T21:39:05.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.857 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.358212+0000", 2024-02-19T21:39:05.858 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9555999999999995e-05 2024-02-19T21:39:05.858 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.858 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.858 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:39:05.858 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.358292+0000", 2024-02-19T21:39:05.858 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1406671500000001 2024-02-19T21:39:05.858 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.858 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:39:05.858 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.858 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.858 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.858 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:199215 7.f 7:fa880ab0:::benchmark_data_smithi080_79222_object84481:head [delete] snapc 0=[] ondisk+write+known_if_redirected e143)", 2024-02-19T21:39:05.858 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:30.224149+0000", 2024-02-19T21:39:05.858 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 35.621801101000003, 2024-02-19T21:39:05.858 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.143588313, 2024-02-19T21:39:05.858 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:39:05.859 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:39:05.859 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:39:05.859 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:39:05.859 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:39:05.859 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 199215 2024-02-19T21:39:05.859 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.859 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:39:05.859 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.859 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:39:05.859 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.224149+0000", 2024-02-19T21:39:05.859 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:39:05.859 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.859 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.859 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:39:05.859 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.224149+0000", 2024-02-19T21:39:05.859 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:39:05.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.860 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:39:05.860 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.224149+0000", 2024-02-19T21:39:05.860 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3409999999999999e-06 2024-02-19T21:39:05.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.860 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:39:05.860 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.224152+0000", 2024-02-19T21:39:05.860 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5140000000000001e-06 2024-02-19T21:39:05.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.860 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:39:05.860 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.224158+0000", 2024-02-19T21:39:05.861 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1470000000000003e-06 2024-02-19T21:39:05.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.861 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:39:05.861 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.224162+0000", 2024-02-19T21:39:05.861 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057741870000000001 2024-02-19T21:39:05.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.861 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.861 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229936+0000", 2024-02-19T21:39:05.861 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9172999999999995e-05 2024-02-19T21:39:05.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.861 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:39:05.861 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.230025+0000", 2024-02-19T21:39:05.862 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9171000000000003e-05 2024-02-19T21:39:05.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.862 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:39:05.862 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.230124+0000", 2024-02-19T21:39:05.862 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015308881999999999 2024-02-19T21:39:05.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.862 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:39:05.862 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.245433+0000", 2024-02-19T21:39:05.862 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020072105999999999 2024-02-19T21:39:05.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.862 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.862 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.265505+0000", 2024-02-19T21:39:05.863 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0350000000000007e-06 2024-02-19T21:39:05.863 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.863 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.863 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:39:05.863 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.265514+0000", 2024-02-19T21:39:05.863 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98018463700000003 2024-02-19T21:39:05.863 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.863 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.863 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.863 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.245699+0000", 2024-02-19T21:39:05.863 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1910000000000006e-06 2024-02-19T21:39:05.863 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.863 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.863 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:39:05.863 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.245708+0000", 2024-02-19T21:39:05.864 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1129750279999999 2024-02-19T21:39:05.864 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.864 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.864 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.864 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.358683+0000", 2024-02-19T21:39:05.864 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121438 2024-02-19T21:39:05.864 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.864 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.864 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for missing object", 2024-02-19T21:39:05.864 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.358805+0000", 2024-02-19T21:39:05.864 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0088367979999999999 2024-02-19T21:39:05.864 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.864 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.864 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.864 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.367642+0000", 2024-02-19T21:39:05.865 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6200999999999996e-05 2024-02-19T21:39:05.865 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.865 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.865 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:39:05.865 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.367738+0000", 2024-02-19T21:39:05.865 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.143588313 2024-02-19T21:39:05.865 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.865 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:39:05.865 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.865 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.865 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.865 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:199227 7.6 7:6852e908:::benchmark_data_smithi080_79222_object84493:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-02-19T21:39:05.865 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:30.272214+0000", 2024-02-19T21:39:05.865 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 35.573736607000001, 2024-02-19T21:39:05.865 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0968052400000001, 2024-02-19T21:39:05.866 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:39:05.866 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:39:05.866 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:39:05.866 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:39:05.866 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:39:05.866 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 199227 2024-02-19T21:39:05.866 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.866 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:39:05.866 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.866 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:39:05.866 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.272214+0000", 2024-02-19T21:39:05.866 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:39:05.866 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.866 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.866 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:39:05.867 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.272214+0000", 2024-02-19T21:39:05.867 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999976 2024-02-19T21:39:05.867 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.867 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.867 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:39:05.867 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.272212+0000", 2024-02-19T21:39:05.867 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2119999999999999e-05 2024-02-19T21:39:05.867 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.867 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.867 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:39:05.867 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.272224+0000", 2024-02-19T21:39:05.867 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4482e-05 2024-02-19T21:39:05.867 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.867 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.867 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:39:05.868 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.272238+0000", 2024-02-19T21:39:05.868 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4329999999999998e-06 2024-02-19T21:39:05.868 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.868 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.868 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:39:05.868 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.272246+0000", 2024-02-19T21:39:05.868 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7330000000000007e-05 2024-02-19T21:39:05.868 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.868 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.868 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.868 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.272323+0000", 2024-02-19T21:39:05.868 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1031e-05 2024-02-19T21:39:05.868 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.868 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.869 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:39:05.869 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.272334+0000", 2024-02-19T21:39:05.869 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.96913022000000004 2024-02-19T21:39:05.869 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.869 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.869 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.869 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.241464+0000", 2024-02-19T21:39:05.869 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2952000000000001e-05 2024-02-19T21:39:05.869 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.869 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.869 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:39:05.869 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.241477+0000", 2024-02-19T21:39:05.869 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1132234729999999 2024-02-19T21:39:05.869 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.869 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.870 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.870 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.354701+0000", 2024-02-19T21:39:05.870 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5845000000000001e-05 2024-02-19T21:39:05.870 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.870 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.870 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:39:05.870 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.354797+0000", 2024-02-19T21:39:05.870 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000422963 2024-02-19T21:39:05.870 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.870 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.870 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,5,7", 2024-02-19T21:39:05.870 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.355220+0000", 2024-02-19T21:39:05.870 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010195503 2024-02-19T21:39:05.870 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.871 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.871 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:39:05.871 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.365415+0000", 2024-02-19T21:39:05.871 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7411999999999999e-05 2024-02-19T21:39:05.871 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.871 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.871 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.871 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.365472+0000", 2024-02-19T21:39:05.871 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030797419999999999 2024-02-19T21:39:05.871 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.871 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.871 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.871 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.368552+0000", 2024-02-19T21:39:05.872 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026477599999999999 2024-02-19T21:39:05.872 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.872 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.872 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.872 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.368817+0000", 2024-02-19T21:39:05.872 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9876000000000007e-05 2024-02-19T21:39:05.872 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.872 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.872 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:39:05.872 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.368887+0000", 2024-02-19T21:39:05.873 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013229800000000001 2024-02-19T21:39:05.873 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.873 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.873 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:39:05.873 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.369019+0000", 2024-02-19T21:39:05.873 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0968052400000001 2024-02-19T21:39:05.873 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.873 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:39:05.873 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.873 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.873 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.873 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:199229 7.f 7:fdced05f:::benchmark_data_smithi080_79222_object84495:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-02-19T21:39:05.873 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:30.276663+0000", 2024-02-19T21:39:05.873 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 35.569287107999997, 2024-02-19T21:39:05.874 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0917742279999998, 2024-02-19T21:39:05.874 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:39:05.874 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:39:05.874 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:39:05.874 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:39:05.874 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:39:05.874 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 199229 2024-02-19T21:39:05.874 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.874 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:39:05.874 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.874 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:39:05.874 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.276663+0000", 2024-02-19T21:39:05.874 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:39:05.874 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.875 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.875 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:39:05.875 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.276663+0000", 2024-02-19T21:39:05.875 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:39:05.875 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.875 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.875 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:39:05.875 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.276662+0000", 2024-02-19T21:39:05.875 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7950000000000008e-06 2024-02-19T21:39:05.875 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.875 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.875 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:39:05.875 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.276670+0000", 2024-02-19T21:39:05.876 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3722e-05 2024-02-19T21:39:05.876 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.876 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.876 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:39:05.876 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.276683+0000", 2024-02-19T21:39:05.876 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0430000000000004e-06 2024-02-19T21:39:05.876 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.876 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.876 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:39:05.876 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.276689+0000", 2024-02-19T21:39:05.876 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1431000000000003e-05 2024-02-19T21:39:05.876 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.876 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.876 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.877 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.276741+0000", 2024-02-19T21:39:05.877 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0618999999999999e-05 2024-02-19T21:39:05.877 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.877 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.877 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:39:05.877 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.276751+0000", 2024-02-19T21:39:05.877 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.96898190399999995 2024-02-19T21:39:05.877 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.877 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.877 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.877 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.245733+0000", 2024-02-19T21:39:05.877 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7859999999999997e-06 2024-02-19T21:39:05.877 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.877 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.878 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:39:05.878 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.245741+0000", 2024-02-19T21:39:05.878 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.113100762 2024-02-19T21:39:05.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.878 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.878 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.878 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.358842+0000", 2024-02-19T21:39:05.878 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012274900000000001 2024-02-19T21:39:05.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.878 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.878 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:39:05.878 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.358965+0000", 2024-02-19T21:39:05.878 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000501824 2024-02-19T21:39:05.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.878 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.879 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,4,7", 2024-02-19T21:39:05.879 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.359466+0000", 2024-02-19T21:39:05.879 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061552739999999996 2024-02-19T21:39:05.879 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.879 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.879 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.879 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.365622+0000", 2024-02-19T21:39:05.879 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9379000000000001e-05 2024-02-19T21:39:05.879 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.879 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.879 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.879 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.365691+0000", 2024-02-19T21:39:05.879 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00044686599999999997 2024-02-19T21:39:05.879 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.879 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.880 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:39:05.880 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.366138+0000", 2024-02-19T21:39:05.880 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0021616090000000001 2024-02-19T21:39:05.880 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.880 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.880 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.880 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.368299+0000", 2024-02-19T21:39:05.880 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3013000000000003e-05 2024-02-19T21:39:05.880 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.880 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.880 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:39:05.880 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.368342+0000", 2024-02-19T21:39:05.880 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5144999999999998e-05 2024-02-19T21:39:05.880 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.881 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.881 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:39:05.881 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.368438+0000", 2024-02-19T21:39:05.881 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0917742279999998 2024-02-19T21:39:05.881 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.881 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:39:05.881 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.881 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.881 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.881 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:199231 7.6 7:684f5a25:::benchmark_data_smithi080_79222_object84497:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-02-19T21:39:05.881 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:30.278362+0000", 2024-02-19T21:39:05.881 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 35.567588719, 2024-02-19T21:39:05.881 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.091004968, 2024-02-19T21:39:05.881 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:39:05.882 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:39:05.882 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:39:05.882 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:39:05.882 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:39:05.882 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 199231 2024-02-19T21:39:05.882 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.882 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:39:05.882 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.882 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:39:05.882 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.278362+0000", 2024-02-19T21:39:05.882 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:39:05.882 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.882 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.882 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:39:05.883 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.278362+0000", 2024-02-19T21:39:05.883 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:39:05.883 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.883 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.883 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:39:05.883 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.278361+0000", 2024-02-19T21:39:05.883 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1339999999999998e-06 2024-02-19T21:39:05.883 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.883 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.883 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:39:05.883 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.278368+0000", 2024-02-19T21:39:05.883 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2194e-05 2024-02-19T21:39:05.883 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.883 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.884 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:39:05.884 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.278380+0000", 2024-02-19T21:39:05.884 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0460000000000002e-06 2024-02-19T21:39:05.884 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.884 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.884 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:39:05.884 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.278386+0000", 2024-02-19T21:39:05.884 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0667000000000001e-05 2024-02-19T21:39:05.884 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.884 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.884 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.884 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.278437+0000", 2024-02-19T21:39:05.884 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0003999999999999e-05 2024-02-19T21:39:05.884 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.885 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.885 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:39:05.885 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.278447+0000", 2024-02-19T21:39:05.885 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.96306393599999995 2024-02-19T21:39:05.885 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.885 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.885 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.885 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.241511+0000", 2024-02-19T21:39:05.885 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7559999999999999e-06 2024-02-19T21:39:05.885 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.885 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.885 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:39:05.885 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.241518+0000", 2024-02-19T21:39:05.885 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.117859503 2024-02-19T21:39:05.885 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.886 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.886 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.886 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.359378+0000", 2024-02-19T21:39:05.886 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3511999999999997e-05 2024-02-19T21:39:05.886 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.886 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.886 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:39:05.886 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.359451+0000", 2024-02-19T21:39:05.886 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6982000000000002e-05 2024-02-19T21:39:05.886 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.886 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.886 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,5,7", 2024-02-19T21:39:05.886 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.359538+0000", 2024-02-19T21:39:05.886 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0058835880000000004 2024-02-19T21:39:05.887 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.887 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.887 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:39:05.887 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.365422+0000", 2024-02-19T21:39:05.887 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6373999999999996e-05 2024-02-19T21:39:05.887 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.887 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.887 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.887 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.365518+0000", 2024-02-19T21:39:05.887 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032462139999999999 2024-02-19T21:39:05.887 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.887 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.887 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.887 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.368764+0000", 2024-02-19T21:39:05.887 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042471700000000002 2024-02-19T21:39:05.887 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.888 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.888 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.888 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.369189+0000", 2024-02-19T21:39:05.888 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1245000000000001e-05 2024-02-19T21:39:05.888 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.888 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.888 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:39:05.888 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.369240+0000", 2024-02-19T21:39:05.888 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012630599999999999 2024-02-19T21:39:05.888 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.888 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.888 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:39:05.888 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.369367+0000", 2024-02-19T21:39:05.888 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.091004968 2024-02-19T21:39:05.889 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.889 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:39:05.889 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.889 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.889 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.889 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:199239 7.6 7:61cef367:::benchmark_data_smithi080_79222_object84505:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-02-19T21:39:05.889 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:30.313389+0000", 2024-02-19T21:39:05.889 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 35.532561418, 2024-02-19T21:39:05.889 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0562398119999998, 2024-02-19T21:39:05.889 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:39:05.889 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:39:05.889 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:39:05.889 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:39:05.890 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:39:05.890 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 199239 2024-02-19T21:39:05.890 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.890 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:39:05.890 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.890 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:39:05.890 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.313389+0000", 2024-02-19T21:39:05.890 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:39:05.890 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.890 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.890 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:39:05.890 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.313389+0000", 2024-02-19T21:39:05.890 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:39:05.890 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.890 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.891 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:39:05.891 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.313387+0000", 2024-02-19T21:39:05.891 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3810000000000005e-06 2024-02-19T21:39:05.891 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.891 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.891 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:39:05.891 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.313397+0000", 2024-02-19T21:39:05.891 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6901e-05 2024-02-19T21:39:05.891 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.891 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.891 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:39:05.891 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.313413+0000", 2024-02-19T21:39:05.891 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6100000000000002e-06 2024-02-19T21:39:05.891 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.891 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.891 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:39:05.892 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.313420+0000", 2024-02-19T21:39:05.892 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5312000000000002e-05 2024-02-19T21:39:05.892 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.892 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.892 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.892 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.313475+0000", 2024-02-19T21:39:05.892 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0936e-05 2024-02-19T21:39:05.892 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.892 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.892 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:39:05.892 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.313486+0000", 2024-02-19T21:39:05.892 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.92994775100000004 2024-02-19T21:39:05.892 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.893 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.893 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.893 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.243434+0000", 2024-02-19T21:39:05.893 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1535000000000001e-05 2024-02-19T21:39:05.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.893 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.893 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:39:05.893 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.243446+0000", 2024-02-19T21:39:05.893 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.118529742 2024-02-19T21:39:05.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.893 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.893 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.893 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.361975+0000", 2024-02-19T21:39:05.893 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010784 2024-02-19T21:39:05.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.894 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.894 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:39:05.894 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.362083+0000", 2024-02-19T21:39:05.894 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000135792 2024-02-19T21:39:05.894 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.894 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.894 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,5,7", 2024-02-19T21:39:05.894 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.362219+0000", 2024-02-19T21:39:05.894 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003306893 2024-02-19T21:39:05.894 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.894 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.894 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:39:05.894 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.365526+0000", 2024-02-19T21:39:05.894 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035462369999999998 2024-02-19T21:39:05.894 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.895 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.895 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.895 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.369072+0000", 2024-02-19T21:39:05.895 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2008999999999994e-05 2024-02-19T21:39:05.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.895 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.895 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.895 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.369144+0000", 2024-02-19T21:39:05.895 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030739100000000001 2024-02-19T21:39:05.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.895 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.895 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.895 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.369452+0000", 2024-02-19T21:39:05.895 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0130999999999998e-05 2024-02-19T21:39:05.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.896 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.896 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:39:05.896 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.369502+0000", 2024-02-19T21:39:05.896 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000127238 2024-02-19T21:39:05.896 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.896 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.896 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:39:05.896 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.369629+0000", 2024-02-19T21:39:05.896 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0562398119999998 2024-02-19T21:39:05.896 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.896 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:39:05.896 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.896 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.896 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.897 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:210701 7.6 7:6ac72bc1:::benchmark_data_smithi080_79222_object95967:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:39:05.897 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:46.006216+0000", 2024-02-19T21:39:05.897 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.839734264000001, 2024-02-19T21:39:05.897 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0367069870000001, 2024-02-19T21:39:05.897 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:39:05.897 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:39:05.897 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:39:05.897 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:39:05.897 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:39:05.897 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210701 2024-02-19T21:39:05.897 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.897 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:39:05.897 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.897 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:39:05.897 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.006216+0000", 2024-02-19T21:39:05.898 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:39:05.898 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.898 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.898 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:39:05.898 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.006216+0000", 2024-02-19T21:39:05.898 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:39:05.898 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.898 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.898 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:39:05.898 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.006215+0000", 2024-02-19T21:39:05.898 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7510000000000008e-06 2024-02-19T21:39:05.898 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.898 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.898 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:39:05.898 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.006222+0000", 2024-02-19T21:39:05.899 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8026999999999999e-05 2024-02-19T21:39:05.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.899 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.899 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:39:05.899 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.006240+0000", 2024-02-19T21:39:05.899 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6569999999999997e-06 2024-02-19T21:39:05.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.899 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.899 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:39:05.899 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.006248+0000", 2024-02-19T21:39:05.899 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018719769999999999 2024-02-19T21:39:05.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.899 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.899 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.899 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.008120+0000", 2024-02-19T21:39:05.900 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8023999999999995e-05 2024-02-19T21:39:05.900 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.900 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.900 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:39:05.900 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.008218+0000", 2024-02-19T21:39:05.900 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011971799999999999 2024-02-19T21:39:05.900 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.900 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.900 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,5,7", 2024-02-19T21:39:05.900 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.008338+0000", 2024-02-19T21:39:05.900 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0075400900000000002 2024-02-19T21:39:05.900 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.900 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.900 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.901 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.015878+0000", 2024-02-19T21:39:05.901 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9990000000000008e-06 2024-02-19T21:39:05.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.901 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:39:05.901 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.015886+0000", 2024-02-19T21:39:05.901 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.026982287 2024-02-19T21:39:05.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.901 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.901 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.042868+0000", 2024-02-19T21:39:05.901 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5086000000000001e-05 2024-02-19T21:39:05.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.901 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.902 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:39:05.902 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.042923+0000", 2024-02-19T21:39:05.902 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0367069870000001 2024-02-19T21:39:05.902 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.902 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:39:05.902 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.902 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.902 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.902 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:210709 7.6 7:6e6a8f35:::benchmark_data_smithi080_79222_object95975:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:39:05.902 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:46.012578+0000", 2024-02-19T21:39:05.902 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.833372559000001, 2024-02-19T21:39:05.902 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.03834815, 2024-02-19T21:39:05.902 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:39:05.902 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:39:05.902 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:39:05.903 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:39:05.903 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:39:05.903 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210709 2024-02-19T21:39:05.903 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.903 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:39:05.903 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.903 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:39:05.903 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.012578+0000", 2024-02-19T21:39:05.903 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:39:05.903 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.903 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.903 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:39:05.903 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.012578+0000", 2024-02-19T21:39:05.903 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:39:05.903 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.904 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.904 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:39:05.904 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.012576+0000", 2024-02-19T21:39:05.904 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0880000000000001e-06 2024-02-19T21:39:05.904 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.904 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.904 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:39:05.904 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.012585+0000", 2024-02-19T21:39:05.904 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2099000000000001e-05 2024-02-19T21:39:05.904 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.904 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.904 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:39:05.904 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.012597+0000", 2024-02-19T21:39:05.904 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4749999999999998e-06 2024-02-19T21:39:05.905 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.905 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.905 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:39:05.905 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.012604+0000", 2024-02-19T21:39:05.905 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033026069999999999 2024-02-19T21:39:05.905 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.905 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.905 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.905 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.015906+0000", 2024-02-19T21:39:05.905 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0079999999999999e-06 2024-02-19T21:39:05.905 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.905 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.905 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:39:05.905 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.015912+0000", 2024-02-19T21:39:05.905 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0273553 2024-02-19T21:39:05.906 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.906 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.906 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.906 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.043267+0000", 2024-02-19T21:39:05.906 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121174 2024-02-19T21:39:05.906 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.906 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.906 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:39:05.906 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.043389+0000", 2024-02-19T21:39:05.906 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013930099999999999 2024-02-19T21:39:05.906 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.906 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.906 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,7", 2024-02-19T21:39:05.906 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.043528+0000", 2024-02-19T21:39:05.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073013959999999999 2024-02-19T21:39:05.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.907 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.907 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.907 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.050829+0000", 2024-02-19T21:39:05.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0027999999999997e-05 2024-02-19T21:39:05.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.907 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.907 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.907 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.050869+0000", 2024-02-19T21:39:05.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1010000000000003e-06 2024-02-19T21:39:05.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.907 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.907 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:39:05.907 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.050876+0000", 2024-02-19T21:39:05.908 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7688999999999999e-05 2024-02-19T21:39:05.908 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.908 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.908 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:39:05.908 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.050904+0000", 2024-02-19T21:39:05.908 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1943e-05 2024-02-19T21:39:05.908 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.908 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.908 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:39:05.908 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.050926+0000", 2024-02-19T21:39:05.908 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.03834815 2024-02-19T21:39:05.908 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.908 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:39:05.908 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.908 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.909 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.909 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:210719 7.6 7:64d9e72c:::benchmark_data_smithi080_79222_object95985:head [delete] snapc 0=[] ondisk+write+known_if_redirected e147)", 2024-02-19T21:39:05.909 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:46.026989+0000", 2024-02-19T21:39:05.909 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.818961601000002, 2024-02-19T21:39:05.909 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0240782049999999, 2024-02-19T21:39:05.909 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:39:05.909 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:39:05.909 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:39:05.909 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:39:05.909 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:39:05.909 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210719 2024-02-19T21:39:05.909 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.909 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:39:05.909 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.909 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:39:05.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.026989+0000", 2024-02-19T21:39:05.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:39:05.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:39:05.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.026989+0000", 2024-02-19T21:39:05.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:39:05.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:39:05.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.026987+0000", 2024-02-19T21:39:05.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6559999999999998e-06 2024-02-19T21:39:05.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:39:05.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.026996+0000", 2024-02-19T21:39:05.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8037999999999999e-05 2024-02-19T21:39:05.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.911 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:39:05.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.027014+0000", 2024-02-19T21:39:05.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.391e-06 2024-02-19T21:39:05.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.911 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:39:05.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.027021+0000", 2024-02-19T21:39:05.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3176000000000006e-05 2024-02-19T21:39:05.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.911 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.912 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.027084+0000", 2024-02-19T21:39:05.912 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4861000000000001e-05 2024-02-19T21:39:05.912 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.912 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.912 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:39:05.912 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.027099+0000", 2024-02-19T21:39:05.912 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.019046833 2024-02-19T21:39:05.912 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.912 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.912 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.912 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.046146+0000", 2024-02-19T21:39:05.912 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011827100000000001 2024-02-19T21:39:05.912 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.912 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.913 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:39:05.913 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.046264+0000", 2024-02-19T21:39:05.913 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000146286 2024-02-19T21:39:05.913 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.913 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.913 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,7", 2024-02-19T21:39:05.913 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.046410+0000", 2024-02-19T21:39:05.913 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004523661 2024-02-19T21:39:05.913 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.913 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.913 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:39:05.913 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.050934+0000", 2024-02-19T21:39:05.913 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1031000000000002e-05 2024-02-19T21:39:05.913 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.913 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.914 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.914 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.050965+0000", 2024-02-19T21:39:05.914 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7708999999999998e-05 2024-02-19T21:39:05.914 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.914 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.914 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.914 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.050993+0000", 2024-02-19T21:39:05.914 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7109e-05 2024-02-19T21:39:05.914 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.914 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.914 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:39:05.914 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.051030+0000", 2024-02-19T21:39:05.914 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7237999999999998e-05 2024-02-19T21:39:05.914 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.914 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.914 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:39:05.915 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.051067+0000", 2024-02-19T21:39:05.915 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0240782049999999 2024-02-19T21:39:05.915 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.915 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:39:05.915 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.915 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.915 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.915 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:210745 7.6 7:6da67535:::benchmark_data_smithi080_79222_object96011:head [delete] snapc 0=[] ondisk+write+known_if_redirected e147)", 2024-02-19T21:39:05.915 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:46.051028+0000", 2024-02-19T21:39:05.915 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.794922712999998, 2024-02-19T21:39:05.915 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0002155180000001, 2024-02-19T21:39:05.915 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:39:05.915 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:39:05.915 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:39:05.915 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:39:05.916 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:39:05.916 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210745 2024-02-19T21:39:05.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.916 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:39:05.916 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.916 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:39:05.916 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.051028+0000", 2024-02-19T21:39:05.916 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:39:05.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.916 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.916 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:39:05.916 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.051028+0000", 2024-02-19T21:39:05.916 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:39:05.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.917 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.917 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:39:05.917 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.051026+0000", 2024-02-19T21:39:05.917 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8499999999999994e-06 2024-02-19T21:39:05.917 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.917 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.917 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:39:05.917 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.051034+0000", 2024-02-19T21:39:05.917 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1426999999999999e-05 2024-02-19T21:39:05.917 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.917 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.917 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:39:05.917 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.051046+0000", 2024-02-19T21:39:05.917 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5239999999999997e-06 2024-02-19T21:39:05.917 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.917 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.918 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:39:05.918 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.051052+0000", 2024-02-19T21:39:05.918 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6909e-05 2024-02-19T21:39:05.918 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.918 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.918 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.918 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.051109+0000", 2024-02-19T21:39:05.918 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.977e-06 2024-02-19T21:39:05.918 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.918 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.918 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:39:05.918 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.051117+0000", 2024-02-19T21:39:05.918 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.99756426399999998 2024-02-19T21:39:05.918 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.918 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.918 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.919 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.048681+0000", 2024-02-19T21:39:05.919 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000107496 2024-02-19T21:39:05.919 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.919 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.919 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:39:05.919 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.048789+0000", 2024-02-19T21:39:05.919 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000138236 2024-02-19T21:39:05.919 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.919 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.919 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,7", 2024-02-19T21:39:05.919 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.048927+0000", 2024-02-19T21:39:05.919 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002151264 2024-02-19T21:39:05.919 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.919 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.919 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:39:05.919 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.051078+0000", 2024-02-19T21:39:05.919 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6669999999999999e-05 2024-02-19T21:39:05.920 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.920 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.920 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.920 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.051125+0000", 2024-02-19T21:39:05.920 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0346999999999998e-05 2024-02-19T21:39:05.920 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.920 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.920 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.920 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.051175+0000", 2024-02-19T21:39:05.920 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9811999999999998e-05 2024-02-19T21:39:05.920 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.920 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.920 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:39:05.920 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.051205+0000", 2024-02-19T21:39:05.920 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8158999999999998e-05 2024-02-19T21:39:05.921 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.921 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.921 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:39:05.921 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.051243+0000", 2024-02-19T21:39:05.921 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0002155180000001 2024-02-19T21:39:05.921 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.921 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:39:05.921 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.921 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.921 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.921 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:210770 7.6 7:696320ab:::benchmark_data_smithi080_79222_object96036:head [delete] snapc 0=[] ondisk+write+known_if_redirected e147)", 2024-02-19T21:39:05.921 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:46.085540+0000", 2024-02-19T21:39:05.921 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.760410188000002, 2024-02-19T21:39:05.921 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98762682199999996, 2024-02-19T21:39:05.921 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:39:05.922 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:39:05.922 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:39:05.922 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:39:05.922 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:39:05.922 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210770 2024-02-19T21:39:05.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.922 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:39:05.922 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.922 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:39:05.922 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085540+0000", 2024-02-19T21:39:05.922 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:39:05.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.922 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.922 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:39:05.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085540+0000", 2024-02-19T21:39:05.923 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:39:05.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.923 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.923 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:39:05.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085539+0000", 2024-02-19T21:39:05.923 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0530000000000001e-06 2024-02-19T21:39:05.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.923 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.923 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:39:05.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085546+0000", 2024-02-19T21:39:05.923 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1626e-05 2024-02-19T21:39:05.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.923 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.924 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:39:05.924 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085558+0000", 2024-02-19T21:39:05.924 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0000000000000002e-06 2024-02-19T21:39:05.924 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.924 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.924 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:39:05.924 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085564+0000", 2024-02-19T21:39:05.924 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0708000000000002e-05 2024-02-19T21:39:05.924 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.924 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.924 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.924 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085625+0000", 2024-02-19T21:39:05.924 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0899999999999999e-06 2024-02-19T21:39:05.924 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.925 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.925 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:39:05.925 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085632+0000", 2024-02-19T21:39:05.925 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.965647649 2024-02-19T21:39:05.925 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.925 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.925 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.925 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.051279+0000", 2024-02-19T21:39:05.925 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0611000000000004e-05 2024-02-19T21:39:05.925 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.925 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.925 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:39:05.925 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.051370+0000", 2024-02-19T21:39:05.925 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000124559 2024-02-19T21:39:05.925 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.926 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.926 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,7", 2024-02-19T21:39:05.926 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.051494+0000", 2024-02-19T21:39:05.926 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057145379999999999 2024-02-19T21:39:05.926 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.926 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.926 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:39:05.926 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.057209+0000", 2024-02-19T21:39:05.926 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0075562199999999998 2024-02-19T21:39:05.926 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.926 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.926 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.926 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.064765+0000", 2024-02-19T21:39:05.926 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0083054649999999997 2024-02-19T21:39:05.926 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.927 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.927 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.927 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073071+0000", 2024-02-19T21:39:05.927 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8593e-05 2024-02-19T21:39:05.927 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.927 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.927 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:39:05.927 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073129+0000", 2024-02-19T21:39:05.927 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7911999999999999e-05 2024-02-19T21:39:05.927 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.927 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.927 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:39:05.927 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073167+0000", 2024-02-19T21:39:05.927 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98762682199999996 2024-02-19T21:39:05.927 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.927 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:39:05.927 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.928 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:210771 7.6 7:682866f3:::benchmark_data_smithi080_79222_object96037:head [delete] snapc 0=[] ondisk+write+known_if_redirected e147)", 2024-02-19T21:39:05.928 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:46.085578+0000", 2024-02-19T21:39:05.928 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.760372926999999, 2024-02-19T21:39:05.928 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98768554799999997, 2024-02-19T21:39:05.928 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:39:05.928 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:39:05.928 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:39:05.928 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:39:05.928 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:39:05.928 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210771 2024-02-19T21:39:05.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.928 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:39:05.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:39:05.929 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085578+0000", 2024-02-19T21:39:05.929 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:39:05.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:39:05.929 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085578+0000", 2024-02-19T21:39:05.929 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:39:05.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:39:05.929 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085577+0000", 2024-02-19T21:39:05.929 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.027e-06 2024-02-19T21:39:05.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:39:05.930 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085580+0000", 2024-02-19T21:39:05.930 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6269999999999997e-06 2024-02-19T21:39:05.930 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.930 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.930 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:39:05.930 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085586+0000", 2024-02-19T21:39:05.930 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.703e-06 2024-02-19T21:39:05.930 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.930 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.930 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:39:05.930 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085589+0000", 2024-02-19T21:39:05.930 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8749000000000003e-05 2024-02-19T21:39:05.930 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.930 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.931 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.931 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085648+0000", 2024-02-19T21:39:05.931 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8500000000000002e-06 2024-02-19T21:39:05.931 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.931 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.931 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:39:05.931 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085653+0000", 2024-02-19T21:39:05.931 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.96758180299999996 2024-02-19T21:39:05.931 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.931 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.931 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.931 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.053235+0000", 2024-02-19T21:39:05.931 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000103496 2024-02-19T21:39:05.931 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.932 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.932 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:39:05.932 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.053338+0000", 2024-02-19T21:39:05.932 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013926800000000001 2024-02-19T21:39:05.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.932 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.932 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,7", 2024-02-19T21:39:05.932 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.053478+0000", 2024-02-19T21:39:05.932 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0052283870000000001 2024-02-19T21:39:05.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.932 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.932 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:39:05.932 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.058706+0000", 2024-02-19T21:39:05.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013529398999999999 2024-02-19T21:39:05.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.072235+0000", 2024-02-19T21:39:05.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00096582600000000003 2024-02-19T21:39:05.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073201+0000", 2024-02-19T21:39:05.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8152000000000001e-05 2024-02-19T21:39:05.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:39:05.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073229+0000", 2024-02-19T21:39:05.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3732000000000002e-05 2024-02-19T21:39:05.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:39:05.934 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073263+0000", 2024-02-19T21:39:05.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98768554799999997 2024-02-19T21:39:05.934 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.934 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:39:05.934 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.934 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:210799 7.6 7:646ebd13:::benchmark_data_smithi080_79222_object96065:head [delete] snapc 0=[] ondisk+write+known_if_redirected e147)", 2024-02-19T21:39:05.934 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:46.119803+0000", 2024-02-19T21:39:05.934 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.726147737000002, 2024-02-19T21:39:05.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.95356817999999999, 2024-02-19T21:39:05.935 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:39:05.935 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:39:05.935 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:39:05.935 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:39:05.935 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:39:05.935 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210799 2024-02-19T21:39:05.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.935 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:39:05.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.935 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:39:05.935 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.119803+0000", 2024-02-19T21:39:05.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:39:05.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.936 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.936 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:39:05.936 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.119803+0000", 2024-02-19T21:39:05.936 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:39:05.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.936 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.936 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:39:05.936 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.119802+0000", 2024-02-19T21:39:05.936 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2410000000000003e-06 2024-02-19T21:39:05.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.936 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.936 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:39:05.936 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.119807+0000", 2024-02-19T21:39:05.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2129999999999997e-06 2024-02-19T21:39:05.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:39:05.937 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.119816+0000", 2024-02-19T21:39:05.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5099999999999998e-06 2024-02-19T21:39:05.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:39:05.937 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.119822+0000", 2024-02-19T21:39:05.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4808000000000003e-05 2024-02-19T21:39:05.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.938 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.119857+0000", 2024-02-19T21:39:05.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5889999999999997e-06 2024-02-19T21:39:05.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.938 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:39:05.938 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.119864+0000", 2024-02-19T21:39:05.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.93562374299999995 2024-02-19T21:39:05.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.938 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.938 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.055488+0000", 2024-02-19T21:39:05.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2298000000000005e-05 2024-02-19T21:39:05.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:39:05.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.055560+0000", 2024-02-19T21:39:05.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1667000000000003e-05 2024-02-19T21:39:05.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,7", 2024-02-19T21:39:05.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.055642+0000", 2024-02-19T21:39:05.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.006240598 2024-02-19T21:39:05.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:39:05.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.061882+0000", 2024-02-19T21:39:05.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01041094 2024-02-19T21:39:05.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.072293+0000", 2024-02-19T21:39:05.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010072519999999999 2024-02-19T21:39:05.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073301+0000", 2024-02-19T21:39:05.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7805999999999997e-05 2024-02-19T21:39:05.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:39:05.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073338+0000", 2024-02-19T21:39:05.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2486e-05 2024-02-19T21:39:05.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.941 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:39:05.941 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073371+0000", 2024-02-19T21:39:05.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.95356817999999999 2024-02-19T21:39:05.941 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.941 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:39:05.941 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.941 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:210821 7.6 7:63bb4219:::benchmark_data_smithi080_79222_object96087:head [delete] snapc 0=[] ondisk+write+known_if_redirected e147)", 2024-02-19T21:39:05.941 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:46.151330+0000", 2024-02-19T21:39:05.941 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.694620477000001, 2024-02-19T21:39:05.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.92217702099999999, 2024-02-19T21:39:05.941 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:39:05.941 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:39:05.941 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:39:05.942 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:39:05.942 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:39:05.942 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210821 2024-02-19T21:39:05.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.942 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:39:05.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.942 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:39:05.942 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.151330+0000", 2024-02-19T21:39:05.942 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:39:05.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.942 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:39:05.942 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.151330+0000", 2024-02-19T21:39:05.942 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:39:05.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.942 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:39:05.943 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.151328+0000", 2024-02-19T21:39:05.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5220000000000001e-06 2024-02-19T21:39:05.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:39:05.943 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.151336+0000", 2024-02-19T21:39:05.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1793999999999999e-05 2024-02-19T21:39:05.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:39:05.943 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.151347+0000", 2024-02-19T21:39:05.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2960000000000004e-06 2024-02-19T21:39:05.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:39:05.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.151354+0000", 2024-02-19T21:39:05.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7815999999999998e-05 2024-02-19T21:39:05.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.151401+0000", 2024-02-19T21:39:05.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2060000000000007e-06 2024-02-19T21:39:05.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:39:05.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.151410+0000", 2024-02-19T21:39:05.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.90581814299999996 2024-02-19T21:39:05.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.057228+0000", 2024-02-19T21:39:05.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6113999999999995e-05 2024-02-19T21:39:05.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:39:05.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.057324+0000", 2024-02-19T21:39:05.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010802399999999999 2024-02-19T21:39:05.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,7", 2024-02-19T21:39:05.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.057432+0000", 2024-02-19T21:39:05.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073385899999999999 2024-02-19T21:39:05.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:39:05.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.064771+0000", 2024-02-19T21:39:05.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0075701199999999996 2024-02-19T21:39:05.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.072341+0000", 2024-02-19T21:39:05.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001079708 2024-02-19T21:39:05.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073420+0000", 2024-02-19T21:39:05.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6832999999999997e-05 2024-02-19T21:39:05.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:39:05.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073467+0000", 2024-02-19T21:39:05.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9817000000000002e-05 2024-02-19T21:39:05.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:39:05.947 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073507+0000", 2024-02-19T21:39:05.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.92217702099999999 2024-02-19T21:39:05.947 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.947 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:39:05.947 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.947 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:210840 7.6 7:669c4fd1:::benchmark_data_smithi080_79222_object96106:head [delete] snapc 0=[] ondisk+write+known_if_redirected e147)", 2024-02-19T21:39:05.947 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:46.179347+0000", 2024-02-19T21:39:05.947 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.666603354999999, 2024-02-19T21:39:05.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.89428998400000004, 2024-02-19T21:39:05.947 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:39:05.947 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:39:05.947 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:39:05.948 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:39:05.948 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:39:05.948 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210840 2024-02-19T21:39:05.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.948 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:39:05.948 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.948 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:39:05.948 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.179347+0000", 2024-02-19T21:39:05.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:39:05.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.948 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.948 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:39:05.948 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.179347+0000", 2024-02-19T21:39:05.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:39:05.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:39:05.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.179347+0000", 2024-02-19T21:39:05.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1469999999999999e-06 2024-02-19T21:39:05.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:39:05.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.179349+0000", 2024-02-19T21:39:05.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5379999999999996e-06 2024-02-19T21:39:05.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:39:05.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.179353+0000", 2024-02-19T21:39:05.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5890000000000001e-06 2024-02-19T21:39:05.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:39:05.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.179356+0000", 2024-02-19T21:39:05.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5544999999999998e-05 2024-02-19T21:39:05.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.179402+0000", 2024-02-19T21:39:05.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0530000000000003e-06 2024-02-19T21:39:05.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.952 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:39:05.952 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.179408+0000", 2024-02-19T21:39:05.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.87932612300000002 2024-02-19T21:39:05.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.952 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.952 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.058734+0000", 2024-02-19T21:39:05.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0507999999999996e-05 2024-02-19T21:39:05.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.952 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:39:05.952 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.058804+0000", 2024-02-19T21:39:05.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5167000000000006e-05 2024-02-19T21:39:05.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.953 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,7", 2024-02-19T21:39:05.953 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.058889+0000", 2024-02-19T21:39:05.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0058850129999999997 2024-02-19T21:39:05.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.953 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:39:05.953 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.064774+0000", 2024-02-19T21:39:05.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0076125489999999997 2024-02-19T21:39:05.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.953 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.953 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.072387+0000", 2024-02-19T21:39:05.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011695290000000001 2024-02-19T21:39:05.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.954 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.954 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073557+0000", 2024-02-19T21:39:05.954 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1776000000000001e-05 2024-02-19T21:39:05.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.954 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:39:05.954 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073598+0000", 2024-02-19T21:39:05.954 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8831000000000001e-05 2024-02-19T21:39:05.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.954 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:39:05.954 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073637+0000", 2024-02-19T21:39:05.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.89428998400000004 2024-02-19T21:39:05.955 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.955 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:39:05.955 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.955 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.955 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:210867 7.6 7:65e104c1:::benchmark_data_smithi080_79222_object96133:head [delete] snapc 0=[] ondisk+write+known_if_redirected e147)", 2024-02-19T21:39:05.955 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:46.216445+0000", 2024-02-19T21:39:05.955 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.629505173999998, 2024-02-19T21:39:05.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.85732473899999995, 2024-02-19T21:39:05.955 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:39:05.955 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:39:05.955 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:39:05.955 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:39:05.955 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:39:05.956 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210867 2024-02-19T21:39:05.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.956 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:39:05.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.956 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:39:05.956 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.216445+0000", 2024-02-19T21:39:05.956 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:39:05.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.956 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:39:05.956 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.216445+0000", 2024-02-19T21:39:05.956 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:39:05.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:39:05.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.216444+0000", 2024-02-19T21:39:05.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2060000000000001e-06 2024-02-19T21:39:05.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:39:05.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.216451+0000", 2024-02-19T21:39:05.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8649999999999996e-06 2024-02-19T21:39:05.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:39:05.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.216461+0000", 2024-02-19T21:39:05.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7880000000000003e-06 2024-02-19T21:39:05.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:39:05.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.216467+0000", 2024-02-19T21:39:05.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6378999999999998e-05 2024-02-19T21:39:05.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.216503+0000", 2024-02-19T21:39:05.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6389999999999997e-06 2024-02-19T21:39:05.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:39:05.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.216509+0000", 2024-02-19T21:39:05.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.843655092 2024-02-19T21:39:05.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.959 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.959 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.959 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.060164+0000", 2024-02-19T21:39:05.959 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6625999999999995e-05 2024-02-19T21:39:05.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.959 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.959 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:39:05.959 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.060230+0000", 2024-02-19T21:39:05.959 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013156999999999999 2024-02-19T21:39:05.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.959 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.959 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,7", 2024-02-19T21:39:05.959 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.060362+0000", 2024-02-19T21:39:05.959 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0070599089999999996 2024-02-19T21:39:05.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:39:05.960 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.067422+0000", 2024-02-19T21:39:05.960 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049995639999999997 2024-02-19T21:39:05.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.960 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.072421+0000", 2024-02-19T21:39:05.960 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001263126 2024-02-19T21:39:05.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.960 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073685+0000", 2024-02-19T21:39:05.960 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6437999999999998e-05 2024-02-19T21:39:05.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.961 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:39:05.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073731+0000", 2024-02-19T21:39:05.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9057999999999998e-05 2024-02-19T21:39:05.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.961 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:39:05.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073770+0000", 2024-02-19T21:39:05.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.85732473899999995 2024-02-19T21:39:05.961 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.961 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:39:05.961 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.961 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:210873 7.6 7:65e1aeb7:::benchmark_data_smithi080_79222_object96139:head [delete] snapc 0=[] ondisk+write+known_if_redirected e147)", 2024-02-19T21:39:05.962 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:46.220646+0000", 2024-02-19T21:39:05.962 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.625304423999999, 2024-02-19T21:39:05.962 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.85997098699999996, 2024-02-19T21:39:05.962 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:39:05.962 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:39:05.962 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:39:05.962 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:39:05.962 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:39:05.962 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210873 2024-02-19T21:39:05.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.962 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:39:05.962 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.962 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:39:05.962 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.220646+0000", 2024-02-19T21:39:05.962 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:39:05.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:39:05.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.220646+0000", 2024-02-19T21:39:05.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:39:05.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:39:05.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.220645+0000", 2024-02-19T21:39:05.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8300000000000001e-06 2024-02-19T21:39:05.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:39:05.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.220650+0000", 2024-02-19T21:39:05.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7310000000000005e-06 2024-02-19T21:39:05.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:39:05.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.220660+0000", 2024-02-19T21:39:05.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6880000000000002e-06 2024-02-19T21:39:05.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:39:05.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.220667+0000", 2024-02-19T21:39:05.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7011000000000001e-05 2024-02-19T21:39:05.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.220714+0000", 2024-02-19T21:39:05.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8490000000000001e-06 2024-02-19T21:39:05.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.965 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:39:05.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.220724+0000", 2024-02-19T21:39:05.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.84119965900000004 2024-02-19T21:39:05.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.965 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.061923+0000", 2024-02-19T21:39:05.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8426999999999998e-05 2024-02-19T21:39:05.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.965 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:39:05.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.062022+0000", 2024-02-19T21:39:05.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013361800000000001 2024-02-19T21:39:05.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,7", 2024-02-19T21:39:05.966 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.062155+0000", 2024-02-19T21:39:05.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0052730659999999999 2024-02-19T21:39:05.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:39:05.966 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.067428+0000", 2024-02-19T21:39:05.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0063878069999999997 2024-02-19T21:39:05.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.966 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073816+0000", 2024-02-19T21:39:05.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0067316260000000001 2024-02-19T21:39:05.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.080548+0000", 2024-02-19T21:39:05.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1437999999999999e-05 2024-02-19T21:39:05.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:39:05.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.080589+0000", 2024-02-19T21:39:05.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7710999999999999e-05 2024-02-19T21:39:05.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:39:05.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.080617+0000", 2024-02-19T21:39:05.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.85997098699999996 2024-02-19T21:39:05.967 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.968 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:39:05.968 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.968 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:210915 7.6 7:65513809:::benchmark_data_smithi080_79222_object96181:head [delete] snapc 0=[] ondisk+write+known_if_redirected e147)", 2024-02-19T21:39:05.968 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:46.272400+0000", 2024-02-19T21:39:05.968 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.573550228999999, 2024-02-19T21:39:05.968 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.80834293700000004, 2024-02-19T21:39:05.968 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:39:05.968 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:39:05.968 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:39:05.968 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:39:05.968 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:39:05.968 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210915 2024-02-19T21:39:05.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.969 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:39:05.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:39:05.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.272400+0000", 2024-02-19T21:39:05.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:39:05.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:39:05.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.272400+0000", 2024-02-19T21:39:05.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:39:05.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:39:05.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.272399+0000", 2024-02-19T21:39:05.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3350000000000001e-06 2024-02-19T21:39:05.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:39:05.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.272406+0000", 2024-02-19T21:39:05.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2659e-05 2024-02-19T21:39:05.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:39:05.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.272419+0000", 2024-02-19T21:39:05.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0839999999999997e-06 2024-02-19T21:39:05.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:39:05.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.272425+0000", 2024-02-19T21:39:05.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6866999999999997e-05 2024-02-19T21:39:05.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.272472+0000", 2024-02-19T21:39:05.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0942e-05 2024-02-19T21:39:05.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:39:05.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.272483+0000", 2024-02-19T21:39:05.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.79092001199999995 2024-02-19T21:39:05.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.063403+0000", 2024-02-19T21:39:05.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010090999999999999 2024-02-19T21:39:05.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:39:05.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.063504+0000", 2024-02-19T21:39:05.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011632400000000001 2024-02-19T21:39:05.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,7", 2024-02-19T21:39:05.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.063620+0000", 2024-02-19T21:39:05.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066519719999999999 2024-02-19T21:39:05.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:39:05.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.070272+0000", 2024-02-19T21:39:05.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035754519999999998 2024-02-19T21:39:05.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073848+0000", 2024-02-19T21:39:05.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0068138699999999996 2024-02-19T21:39:05.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.080662+0000", 2024-02-19T21:39:05.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5765e-05 2024-02-19T21:39:05.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:39:05.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.080707+0000", 2024-02-19T21:39:05.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5941e-05 2024-02-19T21:39:05.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:39:05.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.080743+0000", 2024-02-19T21:39:05.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.80834293700000004 2024-02-19T21:39:05.974 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.974 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:39:05.974 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.974 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:210916 7.6 7:6ff02567:::benchmark_data_smithi080_79222_object96182:head [delete] snapc 0=[] ondisk+write+known_if_redirected e147)", 2024-02-19T21:39:05.974 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:46.275928+0000", 2024-02-19T21:39:05.974 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.570022219999998, 2024-02-19T21:39:05.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.80800256500000001, 2024-02-19T21:39:05.974 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:39:05.974 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:39:05.974 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:39:05.974 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:39:05.974 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:39:05.974 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210916 2024-02-19T21:39:05.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.975 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:39:05.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:39:05.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.275928+0000", 2024-02-19T21:39:05.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:39:05.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:39:05.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.275928+0000", 2024-02-19T21:39:05.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:39:05.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:39:05.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.275927+0000", 2024-02-19T21:39:05.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3810000000000001e-06 2024-02-19T21:39:05.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:39:05.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.275934+0000", 2024-02-19T21:39:05.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2346e-05 2024-02-19T21:39:05.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:39:05.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.275947+0000", 2024-02-19T21:39:05.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3230000000000003e-06 2024-02-19T21:39:05.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:39:05.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.275953+0000", 2024-02-19T21:39:05.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0070000000000001e-05 2024-02-19T21:39:05.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.275993+0000", 2024-02-19T21:39:05.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2469999999999997e-06 2024-02-19T21:39:05.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:39:05.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.275999+0000", 2024-02-19T21:39:05.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.78879722399999996 2024-02-19T21:39:05.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.064797+0000", 2024-02-19T21:39:05.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7978000000000005e-05 2024-02-19T21:39:05.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:39:05.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.064875+0000", 2024-02-19T21:39:05.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4245000000000005e-05 2024-02-19T21:39:05.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,7", 2024-02-19T21:39:05.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.064949+0000", 2024-02-19T21:39:05.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053302879999999999 2024-02-19T21:39:05.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:39:05.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.070279+0000", 2024-02-19T21:39:05.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011539819 2024-02-19T21:39:05.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.081819+0000", 2024-02-19T21:39:05.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002023249 2024-02-19T21:39:05.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.083842+0000", 2024-02-19T21:39:05.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7425000000000001e-05 2024-02-19T21:39:05.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:39:05.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.083890+0000", 2024-02-19T21:39:05.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1264000000000003e-05 2024-02-19T21:39:05.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:39:05.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.083931+0000", 2024-02-19T21:39:05.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.80800256500000001 2024-02-19T21:39:05.980 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.980 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:39:05.980 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.980 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:210938 7.6 7:6ffb3d7f:::benchmark_data_smithi080_79222_object96204:head [delete] snapc 0=[] ondisk+write+known_if_redirected e147)", 2024-02-19T21:39:05.980 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:46.306311+0000", 2024-02-19T21:39:05.980 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.539639611999998, 2024-02-19T21:39:05.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.77772747499999995, 2024-02-19T21:39:05.980 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:39:05.980 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:39:05.981 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:39:05.981 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:39:05.981 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:39:05.981 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210938 2024-02-19T21:39:05.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.981 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:39:05.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:39:05.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.306311+0000", 2024-02-19T21:39:05.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:39:05.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:39:05.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.306311+0000", 2024-02-19T21:39:05.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:39:05.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:39:05.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.306309+0000", 2024-02-19T21:39:05.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6769999999999998e-06 2024-02-19T21:39:05.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:39:05.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.306316+0000", 2024-02-19T21:39:05.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1129e-05 2024-02-19T21:39:05.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:39:05.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.306327+0000", 2024-02-19T21:39:05.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4849999999999997e-06 2024-02-19T21:39:05.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:39:05.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.306334+0000", 2024-02-19T21:39:05.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3414000000000002e-05 2024-02-19T21:39:05.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.306367+0000", 2024-02-19T21:39:05.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5029999999999997e-06 2024-02-19T21:39:05.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:39:05.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.306373+0000", 2024-02-19T21:39:05.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.75973460599999998 2024-02-19T21:39:05.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:39:05.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.066107+0000", 2024-02-19T21:39:05.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4220000000000003e-05 2024-02-19T21:39:05.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:39:05.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.066191+0000", 2024-02-19T21:39:05.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0946999999999996e-05 2024-02-19T21:39:05.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,7", 2024-02-19T21:39:05.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.066272+0000", 2024-02-19T21:39:05.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059189769999999997 2024-02-19T21:39:05.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:39:05.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.072191+0000", 2024-02-19T21:39:05.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00965389 2024-02-19T21:39:05.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.081845+0000", 2024-02-19T21:39:05.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0021186209999999998 2024-02-19T21:39:05.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:39:05.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.083964+0000", 2024-02-19T21:39:05.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.057e-05 2024-02-19T21:39:05.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:39:05.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.084004+0000", 2024-02-19T21:39:05.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3929e-05 2024-02-19T21:39:05.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:39:05.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:39:05.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:39:05.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.084038+0000", 2024-02-19T21:39:05.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.77772747499999995 2024-02-19T21:39:05.986 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.986 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:39:05.986 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.986 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:39:05.986 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:39:05.987 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:39:05.987 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:05.988 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:39:05.988 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:39:06.058 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:39:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:39:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:39:06.089 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:39:06.158 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:06.194 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:39:06.195 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:06.197 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:39:06.276 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:04.940577+0000 mgr.y (mgr.14514) 256 : cluster [DBG] pgmap v271: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 330 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 856 op/s; 520/16422 objects misplaced (3.166%); 3.0 MiB/s, 47 objects/s recovering 2024-02-19T21:39:06.276 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:05.248328+0000 mon.a (mon.0) 929 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-19T21:39:06.277 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:05.269067+0000 mon.a (mon.0) 930 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2024-02-19T21:39:06.277 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:05.435584+0000 mon.a (mon.0) 931 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:39:06.277 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:05.928561+0000 mon.a (mon.0) 932 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:39:06.277 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:05.932339+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:39:06.277 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:05.938761+0000 mon.a (mon.0) 934 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:39:06.298 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:39:06.354 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:06.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:04.940577+0000 mgr.y (mgr.14514) 256 : cluster [DBG] pgmap v271: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 330 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 856 op/s; 520/16422 objects misplaced (3.166%); 3.0 MiB/s, 47 objects/s recovering 2024-02-19T21:39:06.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:05.248328+0000 mon.a (mon.0) 929 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-19T21:39:06.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:05.269067+0000 mon.a (mon.0) 930 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2024-02-19T21:39:06.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:05.435584+0000 mon.a (mon.0) 931 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:39:06.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:05.928561+0000 mon.a (mon.0) 932 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:39:06.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:05.932339+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:39:06.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:05.938761+0000 mon.a (mon.0) 934 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:39:06.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:04.940577+0000 mgr.y (mgr.14514) 256 : cluster [DBG] pgmap v271: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 330 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 856 op/s; 520/16422 objects misplaced (3.166%); 3.0 MiB/s, 47 objects/s recovering 2024-02-19T21:39:06.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:05.248328+0000 mon.a (mon.0) 929 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-19T21:39:06.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:05.269067+0000 mon.a (mon.0) 930 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2024-02-19T21:39:06.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:05.435584+0000 mon.a (mon.0) 931 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:39:06.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:05.928561+0000 mon.a (mon.0) 932 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:39:06.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:05.932339+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:39:06.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:05.938761+0000 mon.a (mon.0) 934 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:39:06.722 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:39:06.727 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:06.728 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:39:06.828 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:39:06.885 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:07.274 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.1 dump_ops_in_flight 2024-02-19T21:39:08.050 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":270,"stamp":"2024-02-19T21:39:03.249410+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":505747132,"num_objects":7910,"num_object_clones":0,"num_object_copies":23730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1493,"num_objects_unfound":0,"num_objects_dirty":7910,"num_whiteouts":0,"num_read":1099,"num_read_kb":851,"num_write":222174,"num_write_kb":7342826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3999,"num_bytes_recovered":257426756,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86279,"ondisk_log_size":86279,"up":444,"acting":444,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":450,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":4163984,"kb_used_data":1744784,"kb_used_omap":0,"kb_used_meta":2418688,"kb_avail":745797232,"statfs":{"total":767960285184,"available":763696365568,"internally_reserved":0,"allocated":1786658816,"data_stored":1784343816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2476736512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-414515200,"num_objects":-6325,"num_object_clones":0,"num_object_copies":-18975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-1064,"num_objects_unfound":0,"num_objects_dirty":-6325,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6325,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":11468800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.319836"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":18,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.166942+0000","last_change":"2024-02-19T21:38:31.247438+0000","last_active":"2024-02-19T21:38:54.166942+0000","last_peered":"2024-02-19T21:38:54.166942+0000","last_clean":"2024-02-19T21:38:54.166942+0000","last_became_active":"2024-02-19T21:38:31.247054+0000","last_became_peered":"2024-02-19T21:38:31.247054+0000","last_unstale":"2024-02-19T21:38:54.166942+0000","last_undegraded":"2024-02-19T21:38:54.166942+0000","last_fullsized":"2024-02-19T21:38:54.166942+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:08.767498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:36:08.767498+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":72,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.148478+0000","last_change":"2024-02-19T21:38:13.387483+0000","last_active":"2024-02-19T21:38:54.148478+0000","last_peered":"2024-02-19T21:38:54.148478+0000","last_clean":"2024-02-19T21:38:54.148478+0000","last_became_active":"2024-02-19T21:35:14.511920+0000","last_became_peered":"2024-02-19T21:35:14.511920+0000","last_unstale":"2024-02-19T21:38:54.148478+0000","last_undegraded":"2024-02-19T21:38:54.148478+0000","last_fullsized":"2024-02-19T21:38:54.148478+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:13.387376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:13.387376+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":116,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.153928+0000","last_change":"2024-02-19T21:37:26.834440+0000","last_active":"2024-02-19T21:38:54.153928+0000","last_peered":"2024-02-19T21:38:54.153928+0000","last_clean":"2024-02-19T21:38:54.153928+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:38:54.153928+0000","last_undegraded":"2024-02-19T21:38:54.153928+0000","last_fullsized":"2024-02-19T21:38:54.153928+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:26.834173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:37:26.834173+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"66'15","reported_seq":71,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.159808+0000","last_change":"2024-02-19T21:38:31.303417+0000","last_active":"2024-02-19T21:38:54.159808+0000","last_peered":"2024-02-19T21:38:54.159808+0000","last_clean":"2024-02-19T21:38:54.159808+0000","last_became_active":"2024-02-19T21:38:31.251540+0000","last_became_peered":"2024-02-19T21:38:31.251540+0000","last_unstale":"2024-02-19T21:38:54.159808+0000","last_undegraded":"2024-02-19T21:38:54.159808+0000","last_fullsized":"2024-02-19T21:38:54.159808+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:36:14.711338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:14.711338+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":70,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.155445+0000","last_change":"2024-02-19T21:36:07.637136+0000","last_active":"2024-02-19T21:38:54.155445+0000","last_peered":"2024-02-19T21:38:54.155445+0000","last_clean":"2024-02-19T21:38:54.155445+0000","last_became_active":"2024-02-19T21:35:14.517794+0000","last_became_peered":"2024-02-19T21:35:14.517794+0000","last_unstale":"2024-02-19T21:38:54.155445+0000","last_undegraded":"2024-02-19T21:38:54.155445+0000","last_fullsized":"2024-02-19T21:38:54.155445+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:07.637066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:36:07.637066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":107,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.147730+0000","last_change":"2024-02-19T21:36:02.866497+0000","last_active":"2024-02-19T21:38:54.147730+0000","last_peered":"2024-02-19T21:38:54.147730+0000","last_clean":"2024-02-19T21:38:54.147730+0000","last_became_active":"2024-02-19T21:32:27.372466+0000","last_became_peered":"2024-02-19T21:32:27.372466+0000","last_unstale":"2024-02-19T21:38:54.147730+0000","last_undegraded":"2024-02-19T21:38:54.147730+0000","last_fullsized":"2024-02-19T21:38:54.147730+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:02.866408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:02.866408+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":115,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.154803+0000","last_change":"2024-02-19T21:37:29.668528+0000","last_active":"2024-02-19T21:38:54.154803+0000","last_peered":"2024-02-19T21:38:54.154803+0000","last_clean":"2024-02-19T21:38:54.154803+0000","last_became_active":"2024-02-19T21:32:23.356975+0000","last_became_peered":"2024-02-19T21:32:23.356975+0000","last_unstale":"2024-02-19T21:38:54.154803+0000","last_undegraded":"2024-02-19T21:38:54.154803+0000","last_fullsized":"2024-02-19T21:38:54.154803+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:37:29.668438+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"92'13","reported_seq":144,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.139468+0000","last_change":"2024-02-19T21:38:29.307119+0000","last_active":"2024-02-19T21:38:54.139468+0000","last_peered":"2024-02-19T21:38:54.139468+0000","last_clean":"2024-02-19T21:38:54.139468+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:38:54.139468+0000","last_undegraded":"2024-02-19T21:38:54.139468+0000","last_fullsized":"2024-02-19T21:38:54.139468+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"92'13","last_scrub_stamp":"2024-02-19T21:38:29.307047+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:38:29.307047+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":113,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.155418+0000","last_change":"2024-02-19T21:38:31.248312+0000","last_active":"2024-02-19T21:38:54.155418+0000","last_peered":"2024-02-19T21:38:54.155418+0000","last_clean":"2024-02-19T21:38:54.155418+0000","last_became_active":"2024-02-19T21:38:31.247922+0000","last_became_peered":"2024-02-19T21:38:31.247922+0000","last_unstale":"2024-02-19T21:38:54.155418+0000","last_undegraded":"2024-02-19T21:38:54.155418+0000","last_fullsized":"2024-02-19T21:38:54.155418+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:58.577980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:35:58.577980+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":106,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.166780+0000","last_change":"2024-02-19T21:36:10.065611+0000","last_active":"2024-02-19T21:38:54.166780+0000","last_peered":"2024-02-19T21:38:54.166780+0000","last_clean":"2024-02-19T21:38:54.166780+0000","last_became_active":"2024-02-19T21:32:27.370308+0000","last_became_peered":"2024-02-19T21:32:27.370308+0000","last_unstale":"2024-02-19T21:38:54.166780+0000","last_undegraded":"2024-02-19T21:38:54.166780+0000","last_fullsized":"2024-02-19T21:38:54.166780+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:10.065522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:10.065522+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.167577+0000","last_change":"2024-02-19T21:37:35.972210+0000","last_active":"2024-02-19T21:38:54.167577+0000","last_peered":"2024-02-19T21:38:54.167577+0000","last_clean":"2024-02-19T21:38:54.167577+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:38:54.167577+0000","last_undegraded":"2024-02-19T21:38:54.167577+0000","last_fullsized":"2024-02-19T21:38:54.167577+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:35.972143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:08.490788+0000","last_clean_scrub_stamp":"2024-02-19T21:37:35.972143+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"66'5","reported_seq":92,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.156831+0000","last_change":"2024-02-19T21:37:12.566212+0000","last_active":"2024-02-19T21:38:54.156831+0000","last_peered":"2024-02-19T21:38:54.156831+0000","last_clean":"2024-02-19T21:38:54.156831+0000","last_became_active":"2024-02-19T21:35:14.514561+0000","last_became_peered":"2024-02-19T21:35:14.514561+0000","last_unstale":"2024-02-19T21:38:54.156831+0000","last_undegraded":"2024-02-19T21:38:54.156831+0000","last_fullsized":"2024-02-19T21:38:54.156831+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'5","last_scrub_stamp":"2024-02-19T21:37:12.566111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:12.566111+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":111,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.154345+0000","last_change":"2024-02-19T21:38:17.889547+0000","last_active":"2024-02-19T21:38:54.154345+0000","last_peered":"2024-02-19T21:38:54.154345+0000","last_clean":"2024-02-19T21:38:54.154345+0000","last_became_active":"2024-02-19T21:32:29.373010+0000","last_became_peered":"2024-02-19T21:32:29.373010+0000","last_unstale":"2024-02-19T21:38:54.154345+0000","last_undegraded":"2024-02-19T21:38:54.154345+0000","last_fullsized":"2024-02-19T21:38:54.154345+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:38:17.889452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:38:17.889452+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":111,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.156692+0000","last_change":"2024-02-19T21:36:09.679009+0000","last_active":"2024-02-19T21:38:54.156692+0000","last_peered":"2024-02-19T21:38:54.156692+0000","last_clean":"2024-02-19T21:38:54.156692+0000","last_became_active":"2024-02-19T21:32:27.368241+0000","last_became_peered":"2024-02-19T21:32:27.368241+0000","last_unstale":"2024-02-19T21:38:54.156692+0000","last_undegraded":"2024-02-19T21:38:54.156692+0000","last_fullsized":"2024-02-19T21:38:54.156692+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:09.678914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:46.543259+0000","last_clean_scrub_stamp":"2024-02-19T21:36:09.678914+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":115,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.167785+0000","last_change":"2024-02-19T21:37:06.962332+0000","last_active":"2024-02-19T21:38:54.167785+0000","last_peered":"2024-02-19T21:38:54.167785+0000","last_clean":"2024-02-19T21:38:54.167785+0000","last_became_active":"2024-02-19T21:32:23.357179+0000","last_became_peered":"2024-02-19T21:32:23.357179+0000","last_unstale":"2024-02-19T21:38:54.167785+0000","last_undegraded":"2024-02-19T21:38:54.167785+0000","last_fullsized":"2024-02-19T21:38:54.167785+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:06.962245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:37:06.962245+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"89'13","reported_seq":129,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.156484+0000","last_change":"2024-02-19T21:38:31.096939+0000","last_active":"2024-02-19T21:38:54.156484+0000","last_peered":"2024-02-19T21:38:54.156484+0000","last_clean":"2024-02-19T21:38:54.156484+0000","last_became_active":"2024-02-19T21:35:14.514971+0000","last_became_peered":"2024-02-19T21:35:14.514971+0000","last_unstale":"2024-02-19T21:38:54.156484+0000","last_undegraded":"2024-02-19T21:38:54.156484+0000","last_fullsized":"2024-02-19T21:38:54.156484+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'13","last_scrub_stamp":"2024-02-19T21:38:31.096870+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:38:31.096870+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":104,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.155194+0000","last_change":"2024-02-19T21:36:57.707929+0000","last_active":"2024-02-19T21:38:54.155194+0000","last_peered":"2024-02-19T21:38:54.155194+0000","last_clean":"2024-02-19T21:38:54.155194+0000","last_became_active":"2024-02-19T21:32:29.597266+0000","last_became_peered":"2024-02-19T21:32:29.597266+0000","last_unstale":"2024-02-19T21:38:54.155194+0000","last_undegraded":"2024-02-19T21:38:54.155194+0000","last_fullsized":"2024-02-19T21:38:54.155194+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:57.707840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:36:57.707840+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":70,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.154716+0000","last_change":"2024-02-19T21:36:52.566026+0000","last_active":"2024-02-19T21:38:54.154716+0000","last_peered":"2024-02-19T21:38:54.154716+0000","last_clean":"2024-02-19T21:38:54.154716+0000","last_became_active":"2024-02-19T21:35:14.514618+0000","last_became_peered":"2024-02-19T21:35:14.514618+0000","last_unstale":"2024-02-19T21:38:54.154716+0000","last_undegraded":"2024-02-19T21:38:54.154716+0000","last_fullsized":"2024-02-19T21:38:54.154716+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:52.565942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:52.565942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":52,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.160365+0000","last_change":"2024-02-19T21:38:31.252355+0000","last_active":"2024-02-19T21:38:54.160365+0000","last_peered":"2024-02-19T21:38:54.160365+0000","last_clean":"2024-02-19T21:38:54.160365+0000","last_became_active":"2024-02-19T21:38:31.250717+0000","last_became_peered":"2024-02-19T21:38:31.250717+0000","last_unstale":"2024-02-19T21:38:54.160365+0000","last_undegraded":"2024-02-19T21:38:54.160365+0000","last_fullsized":"2024-02-19T21:38:54.160365+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:23.540517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:37:23.540517+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"66'12","reported_seq":65,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.148284+0000","last_change":"2024-02-19T21:38:31.269935+0000","last_active":"2024-02-19T21:38:54.148284+0000","last_peered":"2024-02-19T21:38:54.148284+0000","last_clean":"2024-02-19T21:38:54.148284+0000","last_became_active":"2024-02-19T21:38:31.247067+0000","last_became_peered":"2024-02-19T21:38:31.247067+0000","last_unstale":"2024-02-19T21:38:54.148284+0000","last_undegraded":"2024-02-19T21:38:54.148284+0000","last_fullsized":"2024-02-19T21:38:54.148284+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'12","last_scrub_stamp":"2024-02-19T21:35:10.586999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:35:10.586999+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":24,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":110,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.141041+0000","last_change":"2024-02-19T21:36:55.590525+0000","last_active":"2024-02-19T21:38:54.141041+0000","last_peered":"2024-02-19T21:38:54.141041+0000","last_clean":"2024-02-19T21:38:54.141041+0000","last_became_active":"2024-02-19T21:32:29.597365+0000","last_became_peered":"2024-02-19T21:32:29.597365+0000","last_unstale":"2024-02-19T21:38:54.141041+0000","last_undegraded":"2024-02-19T21:38:54.141041+0000","last_fullsized":"2024-02-19T21:38:54.141041+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:55.590424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:36:55.590424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":107,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.148357+0000","last_change":"2024-02-19T21:36:03.917955+0000","last_active":"2024-02-19T21:38:54.148357+0000","last_peered":"2024-02-19T21:38:54.148357+0000","last_clean":"2024-02-19T21:38:54.148357+0000","last_became_active":"2024-02-19T21:32:27.369757+0000","last_became_peered":"2024-02-19T21:32:27.369757+0000","last_unstale":"2024-02-19T21:38:54.148357+0000","last_undegraded":"2024-02-19T21:38:54.148357+0000","last_fullsized":"2024-02-19T21:38:54.148357+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:03.917869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:03.917869+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":115,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.149281+0000","last_change":"2024-02-19T21:36:07.011419+0000","last_active":"2024-02-19T21:38:54.149281+0000","last_peered":"2024-02-19T21:38:54.149281+0000","last_clean":"2024-02-19T21:38:54.149281+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:38:54.149281+0000","last_undegraded":"2024-02-19T21:38:54.149281+0000","last_fullsized":"2024-02-19T21:38:54.149281+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:07.011329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:36:07.011329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"93'22","reported_seq":170,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.161730+0000","last_change":"2024-02-19T21:38:31.973426+0000","last_active":"2024-02-19T21:38:54.161730+0000","last_peered":"2024-02-19T21:38:54.161730+0000","last_clean":"2024-02-19T21:38:54.161730+0000","last_became_active":"2024-02-19T21:38:31.251389+0000","last_became_peered":"2024-02-19T21:38:31.251389+0000","last_unstale":"2024-02-19T21:38:54.161730+0000","last_undegraded":"2024-02-19T21:38:54.161730+0000","last_fullsized":"2024-02-19T21:38:54.161730+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'22","last_scrub_stamp":"2024-02-19T21:36:55.991770+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:35:02.204553+0000","last_clean_scrub_stamp":"2024-02-19T21:36:55.991770+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":105,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.148401+0000","last_change":"2024-02-19T21:36:12.945673+0000","last_active":"2024-02-19T21:38:54.148401+0000","last_peered":"2024-02-19T21:38:54.148401+0000","last_clean":"2024-02-19T21:38:54.148401+0000","last_became_active":"2024-02-19T21:32:29.373361+0000","last_became_peered":"2024-02-19T21:32:29.373361+0000","last_unstale":"2024-02-19T21:38:54.148401+0000","last_undegraded":"2024-02-19T21:38:54.148401+0000","last_fullsized":"2024-02-19T21:38:54.148401+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:12.945581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:12.945581+0000","last_clean_scrub_stamp":"2024-02-19T21:36:12.945581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":112,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.154689+0000","last_change":"2024-02-19T21:37:06.536218+0000","last_active":"2024-02-19T21:38:54.154689+0000","last_peered":"2024-02-19T21:38:54.154689+0000","last_clean":"2024-02-19T21:38:54.154689+0000","last_became_active":"2024-02-19T21:32:27.367741+0000","last_became_peered":"2024-02-19T21:32:27.367741+0000","last_unstale":"2024-02-19T21:38:54.154689+0000","last_undegraded":"2024-02-19T21:38:54.154689+0000","last_fullsized":"2024-02-19T21:38:54.154689+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:06.536121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:06.536121+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.148608+0000","last_change":"2024-02-19T21:38:31.248352+0000","last_active":"2024-02-19T21:38:54.148608+0000","last_peered":"2024-02-19T21:38:54.148608+0000","last_clean":"2024-02-19T21:38:54.148608+0000","last_became_active":"2024-02-19T21:38:31.248001+0000","last_became_peered":"2024-02-19T21:38:31.248001+0000","last_unstale":"2024-02-19T21:38:54.148608+0000","last_undegraded":"2024-02-19T21:38:54.148608+0000","last_fullsized":"2024-02-19T21:38:54.148608+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:13.740974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:36:13.740974+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"66'11","reported_seq":132,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.149312+0000","last_change":"2024-02-19T21:36:56.036308+0000","last_active":"2024-02-19T21:38:54.149312+0000","last_peered":"2024-02-19T21:38:54.149312+0000","last_clean":"2024-02-19T21:38:54.149312+0000","last_became_active":"2024-02-19T21:32:25.355939+0000","last_became_peered":"2024-02-19T21:32:25.355939+0000","last_unstale":"2024-02-19T21:38:54.149312+0000","last_undegraded":"2024-02-19T21:38:54.149312+0000","last_fullsized":"2024-02-19T21:38:54.149312+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:36:56.036187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:56.036187+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":110,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.168130+0000","last_change":"2024-02-19T21:38:25.883992+0000","last_active":"2024-02-19T21:38:54.168130+0000","last_peered":"2024-02-19T21:38:54.168130+0000","last_clean":"2024-02-19T21:38:54.168130+0000","last_became_active":"2024-02-19T21:32:29.372503+0000","last_became_peered":"2024-02-19T21:32:29.372503+0000","last_unstale":"2024-02-19T21:38:54.168130+0000","last_undegraded":"2024-02-19T21:38:54.168130+0000","last_fullsized":"2024-02-19T21:38:54.168130+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:38:25.883927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:38:25.883927+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"66'8","reported_seq":203,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:56.936613+0000","last_change":"2024-02-19T21:37:12.934637+0000","last_active":"2024-02-19T21:38:56.936613+0000","last_peered":"2024-02-19T21:38:56.936613+0000","last_clean":"2024-02-19T21:38:56.936613+0000","last_became_active":"2024-02-19T21:32:27.366465+0000","last_became_peered":"2024-02-19T21:32:27.366465+0000","last_unstale":"2024-02-19T21:38:56.936613+0000","last_undegraded":"2024-02-19T21:38:56.936613+0000","last_fullsized":"2024-02-19T21:38:56.936613+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:37:12.934537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:12.934537+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":115,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.155312+0000","last_change":"2024-02-19T21:36:08.667004+0000","last_active":"2024-02-19T21:38:54.155312+0000","last_peered":"2024-02-19T21:38:54.155312+0000","last_clean":"2024-02-19T21:38:54.155312+0000","last_became_active":"2024-02-19T21:32:23.356323+0000","last_became_peered":"2024-02-19T21:32:23.356323+0000","last_unstale":"2024-02-19T21:38:54.155312+0000","last_undegraded":"2024-02-19T21:38:54.155312+0000","last_fullsized":"2024-02-19T21:38:54.155312+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:36:08.666908+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"66'10","reported_seq":150,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.154617+0000","last_change":"2024-02-19T21:38:31.340043+0000","last_active":"2024-02-19T21:38:54.154617+0000","last_peered":"2024-02-19T21:38:54.154617+0000","last_clean":"2024-02-19T21:38:54.154617+0000","last_became_active":"2024-02-19T21:38:31.249961+0000","last_became_peered":"2024-02-19T21:38:31.249961+0000","last_unstale":"2024-02-19T21:38:54.154617+0000","last_undegraded":"2024-02-19T21:38:54.154617+0000","last_fullsized":"2024-02-19T21:38:54.154617+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:36:07.267146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:07.267146+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":18,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.154434+0000","last_change":"2024-02-19T21:38:31.255980+0000","last_active":"2024-02-19T21:38:54.154434+0000","last_peered":"2024-02-19T21:38:54.154434+0000","last_clean":"2024-02-19T21:38:54.154434+0000","last_became_active":"2024-02-19T21:38:31.250869+0000","last_became_peered":"2024-02-19T21:38:31.250869+0000","last_unstale":"2024-02-19T21:38:54.154434+0000","last_undegraded":"2024-02-19T21:38:54.154434+0000","last_fullsized":"2024-02-19T21:38:54.154434+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:35:16.590436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":111,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.168239+0000","last_change":"2024-02-19T21:38:26.854195+0000","last_active":"2024-02-19T21:38:54.168239+0000","last_peered":"2024-02-19T21:38:54.168239+0000","last_clean":"2024-02-19T21:38:54.168239+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:38:54.168239+0000","last_undegraded":"2024-02-19T21:38:54.168239+0000","last_fullsized":"2024-02-19T21:38:54.168239+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:26.854133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:38:26.854133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":115,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.149105+0000","last_change":"2024-02-19T21:37:07.922839+0000","last_active":"2024-02-19T21:38:54.149105+0000","last_peered":"2024-02-19T21:38:54.149105+0000","last_clean":"2024-02-19T21:38:54.149105+0000","last_became_active":"2024-02-19T21:32:23.355525+0000","last_became_peered":"2024-02-19T21:32:23.355525+0000","last_unstale":"2024-02-19T21:38:54.149105+0000","last_undegraded":"2024-02-19T21:38:54.149105+0000","last_fullsized":"2024-02-19T21:38:54.149105+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:07.922759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:37:07.922759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"66'11","reported_seq":132,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.155596+0000","last_change":"2024-02-19T21:37:20.505192+0000","last_active":"2024-02-19T21:38:54.155596+0000","last_peered":"2024-02-19T21:38:54.155596+0000","last_clean":"2024-02-19T21:38:54.155596+0000","last_became_active":"2024-02-19T21:32:25.372039+0000","last_became_peered":"2024-02-19T21:32:25.372039+0000","last_unstale":"2024-02-19T21:38:54.155596+0000","last_undegraded":"2024-02-19T21:38:54.155596+0000","last_fullsized":"2024-02-19T21:38:54.155596+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:37:20.505097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:20.505097+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":104,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.166884+0000","last_change":"2024-02-19T21:35:56.242025+0000","last_active":"2024-02-19T21:38:54.166884+0000","last_peered":"2024-02-19T21:38:54.166884+0000","last_clean":"2024-02-19T21:38:54.166884+0000","last_became_active":"2024-02-19T21:32:29.372163+0000","last_became_peered":"2024-02-19T21:32:29.372163+0000","last_unstale":"2024-02-19T21:38:54.166884+0000","last_undegraded":"2024-02-19T21:38:54.166884+0000","last_fullsized":"2024-02-19T21:38:54.166884+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:56.241929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:35:56.241929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":111,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.148700+0000","last_change":"2024-02-19T21:36:16.949985+0000","last_active":"2024-02-19T21:38:54.148700+0000","last_peered":"2024-02-19T21:38:54.148700+0000","last_clean":"2024-02-19T21:38:54.148700+0000","last_became_active":"2024-02-19T21:32:27.366281+0000","last_became_peered":"2024-02-19T21:32:27.366281+0000","last_unstale":"2024-02-19T21:38:54.148700+0000","last_undegraded":"2024-02-19T21:38:54.148700+0000","last_fullsized":"2024-02-19T21:38:54.148700+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:16.949911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:16.949911+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":110,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.156728+0000","last_change":"2024-02-19T21:36:01.607836+0000","last_active":"2024-02-19T21:38:54.156728+0000","last_peered":"2024-02-19T21:38:54.156728+0000","last_clean":"2024-02-19T21:38:54.156728+0000","last_became_active":"2024-02-19T21:32:23.355103+0000","last_became_peered":"2024-02-19T21:32:23.355103+0000","last_unstale":"2024-02-19T21:38:54.156728+0000","last_undegraded":"2024-02-19T21:38:54.156728+0000","last_fullsized":"2024-02-19T21:38:54.156728+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:01.607757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:36:01.607757+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"66'4","reported_seq":42,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.151051+0000","last_change":"2024-02-19T21:38:31.598219+0000","last_active":"2024-02-19T21:38:54.151051+0000","last_peered":"2024-02-19T21:38:54.151051+0000","last_clean":"2024-02-19T21:38:54.151051+0000","last_became_active":"2024-02-19T21:38:31.248249+0000","last_became_peered":"2024-02-19T21:38:31.248249+0000","last_unstale":"2024-02-19T21:38:54.151051+0000","last_undegraded":"2024-02-19T21:38:54.151051+0000","last_fullsized":"2024-02-19T21:38:54.151051+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'4","last_scrub_stamp":"2024-02-19T21:35:54.642101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:35:54.642101+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":18,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.155309+0000","last_change":"2024-02-19T21:38:31.260316+0000","last_active":"2024-02-19T21:38:54.155309+0000","last_peered":"2024-02-19T21:38:54.155309+0000","last_clean":"2024-02-19T21:38:54.155309+0000","last_became_active":"2024-02-19T21:38:31.259919+0000","last_became_peered":"2024-02-19T21:38:31.259919+0000","last_unstale":"2024-02-19T21:38:54.155309+0000","last_undegraded":"2024-02-19T21:38:54.155309+0000","last_fullsized":"2024-02-19T21:38:54.155309+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:35:22.516711+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":116,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.152771+0000","last_change":"2024-02-19T21:38:31.249143+0000","last_active":"2024-02-19T21:38:54.152771+0000","last_peered":"2024-02-19T21:38:54.152771+0000","last_clean":"2024-02-19T21:38:54.152771+0000","last_became_active":"2024-02-19T21:38:31.248795+0000","last_became_peered":"2024-02-19T21:38:31.248795+0000","last_unstale":"2024-02-19T21:38:54.152771+0000","last_undegraded":"2024-02-19T21:38:54.152771+0000","last_fullsized":"2024-02-19T21:38:54.152771+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:06.939858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:06.939858+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":113,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.148006+0000","last_change":"2024-02-19T21:35:21.713423+0000","last_active":"2024-02-19T21:38:54.148006+0000","last_peered":"2024-02-19T21:38:54.148006+0000","last_clean":"2024-02-19T21:38:54.148006+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:38:54.148006+0000","last_undegraded":"2024-02-19T21:38:54.148006+0000","last_fullsized":"2024-02-19T21:38:54.148006+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:21.713362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:35:21.713362+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"66'11","reported_seq":138,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.140692+0000","last_change":"2024-02-19T21:37:29.501216+0000","last_active":"2024-02-19T21:38:54.140692+0000","last_peered":"2024-02-19T21:38:54.140692+0000","last_clean":"2024-02-19T21:38:54.140692+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:38:54.140692+0000","last_undegraded":"2024-02-19T21:38:54.140692+0000","last_fullsized":"2024-02-19T21:38:54.140692+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:37:29.501108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:29.501108+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.153868+0000","last_change":"2024-02-19T21:38:29.972418+0000","last_active":"2024-02-19T21:38:54.153868+0000","last_peered":"2024-02-19T21:38:54.153868+0000","last_clean":"2024-02-19T21:38:54.153868+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:38:54.153868+0000","last_undegraded":"2024-02-19T21:38:54.153868+0000","last_fullsized":"2024-02-19T21:38:54.153868+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:29.972337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:42.527849+0000","last_clean_scrub_stamp":"2024-02-19T21:38:29.972337+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":106,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.156920+0000","last_change":"2024-02-19T21:36:10.728285+0000","last_active":"2024-02-19T21:38:54.156920+0000","last_peered":"2024-02-19T21:38:54.156920+0000","last_clean":"2024-02-19T21:38:54.156920+0000","last_became_active":"2024-02-19T21:32:27.369279+0000","last_became_peered":"2024-02-19T21:32:27.369279+0000","last_unstale":"2024-02-19T21:38:54.156920+0000","last_undegraded":"2024-02-19T21:38:54.156920+0000","last_fullsized":"2024-02-19T21:38:54.156920+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:10.728211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:10.728211+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":115,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.150350+0000","last_change":"2024-02-19T21:36:14.917685+0000","last_active":"2024-02-19T21:38:54.150350+0000","last_peered":"2024-02-19T21:38:54.150350+0000","last_clean":"2024-02-19T21:38:54.150350+0000","last_became_active":"2024-02-19T21:32:23.357338+0000","last_became_peered":"2024-02-19T21:32:23.357338+0000","last_unstale":"2024-02-19T21:38:54.150350+0000","last_undegraded":"2024-02-19T21:38:54.150350+0000","last_fullsized":"2024-02-19T21:38:54.150350+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:36:14.917584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"66'9","reported_seq":125,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.152685+0000","last_change":"2024-02-19T21:36:05.936042+0000","last_active":"2024-02-19T21:38:54.152685+0000","last_peered":"2024-02-19T21:38:54.152685+0000","last_clean":"2024-02-19T21:38:54.152685+0000","last_became_active":"2024-02-19T21:32:25.359777+0000","last_became_peered":"2024-02-19T21:32:25.359777+0000","last_unstale":"2024-02-19T21:38:54.152685+0000","last_undegraded":"2024-02-19T21:38:54.152685+0000","last_fullsized":"2024-02-19T21:38:54.152685+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:36:05.935956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:05.935956+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":70,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.160173+0000","last_change":"2024-02-19T21:36:16.029010+0000","last_active":"2024-02-19T21:38:54.160173+0000","last_peered":"2024-02-19T21:38:54.160173+0000","last_clean":"2024-02-19T21:38:54.160173+0000","last_became_active":"2024-02-19T21:35:14.515471+0000","last_became_peered":"2024-02-19T21:35:14.515471+0000","last_unstale":"2024-02-19T21:38:54.160173+0000","last_undegraded":"2024-02-19T21:38:54.160173+0000","last_fullsized":"2024-02-19T21:38:54.160173+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:16.028943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:16.028943+0000","last_clean_scrub_stamp":"2024-02-19T21:36:16.028943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,5],"acting":[2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"145'9","reported_seq":48,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:56.934504+0000","last_change":"2024-02-19T21:38:31.361094+0000","last_active":"2024-02-19T21:38:56.934504+0000","last_peered":"2024-02-19T21:38:56.934504+0000","last_clean":"2024-02-19T21:38:56.934504+0000","last_became_active":"2024-02-19T21:38:31.255988+0000","last_became_peered":"2024-02-19T21:38:31.255988+0000","last_unstale":"2024-02-19T21:38:56.934504+0000","last_undegraded":"2024-02-19T21:38:56.934504+0000","last_fullsized":"2024-02-19T21:38:56.934504+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:36:02.725913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:02.725913+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":125,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.154622+0000","last_change":"2024-02-19T21:38:14.002797+0000","last_active":"2024-02-19T21:38:54.154622+0000","last_peered":"2024-02-19T21:38:54.154622+0000","last_clean":"2024-02-19T21:38:54.154622+0000","last_became_active":"2024-02-19T21:32:23.361680+0000","last_became_peered":"2024-02-19T21:32:23.361680+0000","last_unstale":"2024-02-19T21:38:54.154622+0000","last_undegraded":"2024-02-19T21:38:54.154622+0000","last_fullsized":"2024-02-19T21:38:54.154622+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:14.002713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:33.550655+0000","last_clean_scrub_stamp":"2024-02-19T21:38:14.002713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"133'13","reported_seq":133,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.156643+0000","last_change":"2024-02-19T21:37:34.892934+0000","last_active":"2024-02-19T21:38:54.156643+0000","last_peered":"2024-02-19T21:38:54.156643+0000","last_clean":"2024-02-19T21:38:54.156643+0000","last_became_active":"2024-02-19T21:32:25.372206+0000","last_became_peered":"2024-02-19T21:32:25.372206+0000","last_unstale":"2024-02-19T21:38:54.156643+0000","last_undegraded":"2024-02-19T21:38:54.156643+0000","last_fullsized":"2024-02-19T21:38:54.156643+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'13","last_scrub_stamp":"2024-02-19T21:37:34.892825+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:37:34.892825+0000","last_clean_scrub_stamp":"2024-02-19T21:37:34.892825+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.154110+0000","last_change":"2024-02-19T21:38:31.248430+0000","last_active":"2024-02-19T21:38:54.154110+0000","last_peered":"2024-02-19T21:38:54.154110+0000","last_clean":"2024-02-19T21:38:54.154110+0000","last_became_active":"2024-02-19T21:38:31.248016+0000","last_became_peered":"2024-02-19T21:38:31.248016+0000","last_unstale":"2024-02-19T21:38:54.154110+0000","last_undegraded":"2024-02-19T21:38:54.154110+0000","last_fullsized":"2024-02-19T21:38:54.154110+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:32.890719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:37:32.890719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"66'8","reported_seq":198,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:56.934423+0000","last_change":"2024-02-19T21:37:35.901012+0000","last_active":"2024-02-19T21:38:56.934423+0000","last_peered":"2024-02-19T21:38:56.934423+0000","last_clean":"2024-02-19T21:38:56.934423+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:38:56.934423+0000","last_undegraded":"2024-02-19T21:38:56.934423+0000","last_fullsized":"2024-02-19T21:38:56.934423+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:37:35.900920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:35.900920+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.155599+0000","last_change":"2024-02-19T21:37:19.763737+0000","last_active":"2024-02-19T21:38:54.155599+0000","last_peered":"2024-02-19T21:38:54.155599+0000","last_clean":"2024-02-19T21:38:54.155599+0000","last_became_active":"2024-02-19T21:32:23.360838+0000","last_became_peered":"2024-02-19T21:32:23.360838+0000","last_unstale":"2024-02-19T21:38:54.155599+0000","last_undegraded":"2024-02-19T21:38:54.155599+0000","last_fullsized":"2024-02-19T21:38:54.155599+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:37:19.763642+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"66'10","reported_seq":123,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.154634+0000","last_change":"2024-02-19T21:35:14.590169+0000","last_active":"2024-02-19T21:38:54.154634+0000","last_peered":"2024-02-19T21:38:54.154634+0000","last_clean":"2024-02-19T21:38:54.154634+0000","last_became_active":"2024-02-19T21:32:25.372060+0000","last_became_peered":"2024-02-19T21:32:25.372060+0000","last_unstale":"2024-02-19T21:38:54.154634+0000","last_undegraded":"2024-02-19T21:38:54.154634+0000","last_fullsized":"2024-02-19T21:38:54.154634+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:35:14.590053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:35:14.590053+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":113,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.167521+0000","last_change":"2024-02-19T21:37:27.036804+0000","last_active":"2024-02-19T21:38:54.167521+0000","last_peered":"2024-02-19T21:38:54.167521+0000","last_clean":"2024-02-19T21:38:54.167521+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:38:54.167521+0000","last_undegraded":"2024-02-19T21:38:54.167521+0000","last_fullsized":"2024-02-19T21:38:54.167521+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_clean_scrub_stamp":"2024-02-19T21:37:27.036737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":106,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.156510+0000","last_change":"2024-02-19T21:35:59.616946+0000","last_active":"2024-02-19T21:38:54.156510+0000","last_peered":"2024-02-19T21:38:54.156510+0000","last_clean":"2024-02-19T21:38:54.156510+0000","last_became_active":"2024-02-19T21:32:27.369002+0000","last_became_peered":"2024-02-19T21:32:27.369002+0000","last_unstale":"2024-02-19T21:38:54.156510+0000","last_undegraded":"2024-02-19T21:38:54.156510+0000","last_fullsized":"2024-02-19T21:38:54.156510+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:59.616851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:35:59.616851+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":115,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.148761+0000","last_change":"2024-02-19T21:38:26.356987+0000","last_active":"2024-02-19T21:38:54.148761+0000","last_peered":"2024-02-19T21:38:54.148761+0000","last_clean":"2024-02-19T21:38:54.148761+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:38:54.148761+0000","last_undegraded":"2024-02-19T21:38:54.148761+0000","last_fullsized":"2024-02-19T21:38:54.148761+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:26.356890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:38:26.356890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"66'6","reported_seq":55,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.167335+0000","last_change":"2024-02-19T21:38:45.929745+0000","last_active":"2024-02-19T21:38:54.167335+0000","last_peered":"2024-02-19T21:38:54.167335+0000","last_clean":"2024-02-19T21:38:54.167335+0000","last_became_active":"2024-02-19T21:38:31.249552+0000","last_became_peered":"2024-02-19T21:38:31.249552+0000","last_unstale":"2024-02-19T21:38:54.167335+0000","last_undegraded":"2024-02-19T21:38:54.167335+0000","last_fullsized":"2024-02-19T21:38:54.167335+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'6","last_scrub_stamp":"2024-02-19T21:36:06.799055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:06.799055+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":109,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.165734+0000","last_change":"2024-02-19T21:38:16.184777+0000","last_active":"2024-02-19T21:38:54.165734+0000","last_peered":"2024-02-19T21:38:54.165734+0000","last_clean":"2024-02-19T21:38:54.165734+0000","last_became_active":"2024-02-19T21:32:29.371977+0000","last_became_peered":"2024-02-19T21:32:29.371977+0000","last_unstale":"2024-02-19T21:38:54.165734+0000","last_undegraded":"2024-02-19T21:38:54.165734+0000","last_fullsized":"2024-02-19T21:38:54.165734+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:16.184681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:38:16.184681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":18,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.148212+0000","last_change":"2024-02-19T21:38:31.250323+0000","last_active":"2024-02-19T21:38:54.148212+0000","last_peered":"2024-02-19T21:38:54.148212+0000","last_clean":"2024-02-19T21:38:54.148212+0000","last_became_active":"2024-02-19T21:38:31.249969+0000","last_became_peered":"2024-02-19T21:38:31.249969+0000","last_unstale":"2024-02-19T21:38:54.148212+0000","last_undegraded":"2024-02-19T21:38:54.148212+0000","last_fullsized":"2024-02-19T21:38:54.148212+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:54.644120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:54.644120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":122,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.159747+0000","last_change":"2024-02-19T21:38:26.250702+0000","last_active":"2024-02-19T21:38:54.159747+0000","last_peered":"2024-02-19T21:38:54.159747+0000","last_clean":"2024-02-19T21:38:54.159747+0000","last_became_active":"2024-02-19T21:32:23.358939+0000","last_became_peered":"2024-02-19T21:32:23.358939+0000","last_unstale":"2024-02-19T21:38:54.159747+0000","last_undegraded":"2024-02-19T21:38:54.159747+0000","last_fullsized":"2024-02-19T21:38:54.159747+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:26.250620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:38:26.250620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"66'9","reported_seq":149,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.154370+0000","last_change":"2024-02-19T21:38:31.316879+0000","last_active":"2024-02-19T21:38:54.154370+0000","last_peered":"2024-02-19T21:38:54.154370+0000","last_clean":"2024-02-19T21:38:54.154370+0000","last_became_active":"2024-02-19T21:38:31.259887+0000","last_became_peered":"2024-02-19T21:38:31.259887+0000","last_unstale":"2024-02-19T21:38:54.154370+0000","last_undegraded":"2024-02-19T21:38:54.154370+0000","last_fullsized":"2024-02-19T21:38:54.154370+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:36:53.491279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:53.491279+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"151'13873","reported_seq":13937,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-02-19T21:38:59.940761+0000","last_change":"2024-02-19T21:37:28.803373+0000","last_active":"2024-02-19T21:38:59.940761+0000","last_peered":"2024-02-19T21:38:59.940761+0000","last_clean":"2024-02-19T21:38:59.940761+0000","last_became_active":"2024-02-19T21:35:19.640049+0000","last_became_peered":"2024-02-19T21:35:19.640049+0000","last_unstale":"2024-02-19T21:38:59.940761+0000","last_undegraded":"2024-02-19T21:38:59.940761+0000","last_fullsized":"2024-02-19T21:38:59.940761+0000","mapping_epoch":100,"log_start":"130'7700","ondisk_log_start":"130'7700","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'8846","last_scrub_stamp":"2024-02-19T21:37:28.803214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:28.803214+0000","log_size":6173,"ondisk_log_size":6173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33751040,"num_objects":515,"num_object_clones":0,"num_object_copies":1545,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":515,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13873,"num_write_kb":460416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":104,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.157009+0000","last_change":"2024-02-19T21:35:07.519633+0000","last_active":"2024-02-19T21:38:54.157009+0000","last_peered":"2024-02-19T21:38:54.157009+0000","last_clean":"2024-02-19T21:38:54.157009+0000","last_became_active":"2024-02-19T21:32:29.376027+0000","last_became_peered":"2024-02-19T21:32:29.376027+0000","last_unstale":"2024-02-19T21:38:54.157009+0000","last_undegraded":"2024-02-19T21:38:54.157009+0000","last_fullsized":"2024-02-19T21:38:54.157009+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:35:07.519531+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"59'2","reported_seq":138,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.141350+0000","last_change":"2024-02-19T21:38:24.311097+0000","last_active":"2024-02-19T21:38:54.141350+0000","last_peered":"2024-02-19T21:38:54.141350+0000","last_clean":"2024-02-19T21:38:54.141350+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:38:54.141350+0000","last_undegraded":"2024-02-19T21:38:54.141350+0000","last_fullsized":"2024-02-19T21:38:54.141350+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-02-19T21:38:24.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:38:24.311033+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"83'17","reported_seq":146,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.147650+0000","last_change":"2024-02-19T21:38:31.684369+0000","last_active":"2024-02-19T21:38:54.147650+0000","last_peered":"2024-02-19T21:38:54.147650+0000","last_clean":"2024-02-19T21:38:54.147650+0000","last_became_active":"2024-02-19T21:38:31.247821+0000","last_became_peered":"2024-02-19T21:38:31.247821+0000","last_unstale":"2024-02-19T21:38:54.147650+0000","last_undegraded":"2024-02-19T21:38:54.147650+0000","last_fullsized":"2024-02-19T21:38:54.147650+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'17","last_scrub_stamp":"2024-02-19T21:36:56.732448+0000","last_deep_scrub":"83'17","last_deep_scrub_stamp":"2024-02-19T21:33:43.418450+0000","last_clean_scrub_stamp":"2024-02-19T21:36:56.732448+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":106,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.159815+0000","last_change":"2024-02-19T21:36:02.020363+0000","last_active":"2024-02-19T21:38:54.159815+0000","last_peered":"2024-02-19T21:38:54.159815+0000","last_clean":"2024-02-19T21:38:54.159815+0000","last_became_active":"2024-02-19T21:32:27.367022+0000","last_became_peered":"2024-02-19T21:32:27.367022+0000","last_unstale":"2024-02-19T21:38:54.159815+0000","last_undegraded":"2024-02-19T21:38:54.159815+0000","last_fullsized":"2024-02-19T21:38:54.159815+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:02.020270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:02.020270+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1","version":"151'14051","reported_seq":14120,"reported_epoch":151,"state":"active+remapped+backfill_toofull","last_fresh":"2024-02-19T21:38:59.795491+0000","last_change":"2024-02-19T21:38:32.344146+0000","last_active":"2024-02-19T21:38:59.795491+0000","last_peered":"2024-02-19T21:38:59.795491+0000","last_clean":"2024-02-19T21:38:30.171099+0000","last_became_active":"2024-02-19T21:38:32.313392+0000","last_became_peered":"2024-02-19T21:38:32.313392+0000","last_unstale":"2024-02-19T21:38:59.795491+0000","last_undegraded":"2024-02-19T21:38:59.795491+0000","last_fullsized":"2024-02-19T21:38:59.795491+0000","mapping_epoch":145,"log_start":"132'8700","ondisk_log_start":"132'8700","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:35:18.622399+0000","log_size":5351,"ondisk_log_size":5351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32833536,"num_objects":501,"num_object_clones":0,"num_object_copies":1503,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":501,"num_objects_unfound":0,"num_objects_dirty":501,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14051,"num_write_kb":465664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,3],"avail_no_missing":["6","3","4"],"object_location_counts":[{"shards":"3,4,6","objects":501}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":119,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.153941+0000","last_change":"2024-02-19T21:38:31.256848+0000","last_active":"2024-02-19T21:38:54.153941+0000","last_peered":"2024-02-19T21:38:54.153941+0000","last_clean":"2024-02-19T21:38:54.153941+0000","last_became_active":"2024-02-19T21:38:31.256533+0000","last_became_peered":"2024-02-19T21:38:31.256533+0000","last_unstale":"2024-02-19T21:38:54.153941+0000","last_undegraded":"2024-02-19T21:38:54.153941+0000","last_fullsized":"2024-02-19T21:38:54.153941+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:15.954684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:38:15.954684+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5],"acting":[0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":111,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.148520+0000","last_change":"2024-02-19T21:35:14.754539+0000","last_active":"2024-02-19T21:38:54.148520+0000","last_peered":"2024-02-19T21:38:54.148520+0000","last_clean":"2024-02-19T21:38:54.148520+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:38:54.148520+0000","last_undegraded":"2024-02-19T21:38:54.148520+0000","last_fullsized":"2024-02-19T21:38:54.148520+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:14.754474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:35:14.754474+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"66'10","reported_seq":103,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.161150+0000","last_change":"2024-02-19T21:37:14.054990+0000","last_active":"2024-02-19T21:38:54.161150+0000","last_peered":"2024-02-19T21:38:54.161150+0000","last_clean":"2024-02-19T21:38:54.161150+0000","last_became_active":"2024-02-19T21:33:50.752293+0000","last_became_peered":"2024-02-19T21:33:50.752293+0000","last_unstale":"2024-02-19T21:38:54.161150+0000","last_undegraded":"2024-02-19T21:38:54.161150+0000","last_fullsized":"2024-02-19T21:38:54.161150+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:37:14.054904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:14.054904+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":199,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:56.934279+0000","last_change":"2024-02-19T21:37:17.775208+0000","last_active":"2024-02-19T21:38:56.934279+0000","last_peered":"2024-02-19T21:38:56.934279+0000","last_clean":"2024-02-19T21:38:56.934279+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:38:56.934279+0000","last_undegraded":"2024-02-19T21:38:56.934279+0000","last_fullsized":"2024-02-19T21:38:56.934279+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:37:17.775085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:17.775085+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.7","version":"151'13595","reported_seq":14313,"reported_epoch":151,"state":"active+remapped+backfilling","last_fresh":"2024-02-19T21:38:59.812496+0000","last_change":"2024-02-19T21:38:32.389677+0000","last_active":"2024-02-19T21:38:59.812496+0000","last_peered":"2024-02-19T21:38:59.812496+0000","last_clean":"2024-02-19T21:38:30.230143+0000","last_became_active":"2024-02-19T21:38:32.333166+0000","last_became_peered":"2024-02-19T21:38:32.333166+0000","last_unstale":"2024-02-19T21:38:59.812496+0000","last_undegraded":"2024-02-19T21:38:59.812496+0000","last_fullsized":"2024-02-19T21:38:59.812496+0000","mapping_epoch":145,"log_start":"132'8284","ondisk_log_start":"132'8284","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'8930","last_scrub_stamp":"2024-02-19T21:37:32.539829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:32.539829+0000","log_size":5311,"ondisk_log_size":5311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":30081024,"num_objects":459,"num_object_clones":0,"num_object_copies":1377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":311,"num_objects_unfound":0,"num_objects_dirty":459,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13595,"num_write_kb":449728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":319,"num_bytes_recovered":20905984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1],"acting":[6,0,3],"avail_no_missing":["6","0","3"],"object_location_counts":[{"shards":"0,3,6","objects":459}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":18,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.141173+0000","last_change":"2024-02-19T21:38:31.245116+0000","last_active":"2024-02-19T21:38:54.141173+0000","last_peered":"2024-02-19T21:38:54.141173+0000","last_clean":"2024-02-19T21:38:54.141173+0000","last_became_active":"2024-02-19T21:38:31.244787+0000","last_became_peered":"2024-02-19T21:38:31.244787+0000","last_unstale":"2024-02-19T21:38:54.141173+0000","last_undegraded":"2024-02-19T21:38:54.141173+0000","last_fullsized":"2024-02-19T21:38:54.141173+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:18.550821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:37:18.550821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":115,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.155670+0000","last_change":"2024-02-19T21:36:05.647803+0000","last_active":"2024-02-19T21:38:54.155670+0000","last_peered":"2024-02-19T21:38:54.155670+0000","last_clean":"2024-02-19T21:38:54.155670+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:38:54.155670+0000","last_undegraded":"2024-02-19T21:38:54.155670+0000","last_fullsized":"2024-02-19T21:38:54.155670+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:05.647719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:36:05.647719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"145'29","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:56.937813+0000","last_change":"2024-02-19T21:38:31.350653+0000","last_active":"2024-02-19T21:38:56.937813+0000","last_peered":"2024-02-19T21:38:56.937813+0000","last_clean":"2024-02-19T21:38:56.937813+0000","last_became_active":"2024-02-19T21:38:31.256127+0000","last_became_peered":"2024-02-19T21:38:31.256127+0000","last_unstale":"2024-02-19T21:38:56.937813+0000","last_undegraded":"2024-02-19T21:38:56.937813+0000","last_fullsized":"2024-02-19T21:38:56.937813+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'28","last_scrub_stamp":"2024-02-19T21:35:54.882818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:35:54.882818+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":112,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.155300+0000","last_change":"2024-02-19T21:38:16.890343+0000","last_active":"2024-02-19T21:38:54.155300+0000","last_peered":"2024-02-19T21:38:54.155300+0000","last_clean":"2024-02-19T21:38:54.155300+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:38:54.155300+0000","last_undegraded":"2024-02-19T21:38:54.155300+0000","last_fullsized":"2024-02-19T21:38:54.155300+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:16.890269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:16.890269+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"151'14093","reported_seq":14157,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-02-19T21:38:59.994074+0000","last_change":"2024-02-19T21:37:26.190135+0000","last_active":"2024-02-19T21:38:59.994074+0000","last_peered":"2024-02-19T21:38:59.994074+0000","last_clean":"2024-02-19T21:38:59.994074+0000","last_became_active":"2024-02-19T21:35:20.120258+0000","last_became_peered":"2024-02-19T21:35:20.120258+0000","last_unstale":"2024-02-19T21:38:59.994074+0000","last_undegraded":"2024-02-19T21:38:59.994074+0000","last_fullsized":"2024-02-19T21:38:59.994074+0000","mapping_epoch":100,"log_start":"133'9057","ondisk_log_start":"133'9057","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"132'8838","last_scrub_stamp":"2024-02-19T21:37:26.190030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:26.190030+0000","log_size":5036,"ondisk_log_size":5036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":30212096,"num_objects":461,"num_object_clones":0,"num_object_copies":1383,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":461,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14093,"num_write_kb":465728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":104,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.167704+0000","last_change":"2024-02-19T21:36:08.147110+0000","last_active":"2024-02-19T21:38:54.167704+0000","last_peered":"2024-02-19T21:38:54.167704+0000","last_clean":"2024-02-19T21:38:54.167704+0000","last_became_active":"2024-02-19T21:32:29.597365+0000","last_became_peered":"2024-02-19T21:32:29.597365+0000","last_unstale":"2024-02-19T21:38:54.167704+0000","last_undegraded":"2024-02-19T21:38:54.167704+0000","last_fullsized":"2024-02-19T21:38:54.167704+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:08.146986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:36:08.146986+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"67'5","reported_seq":507,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-02-19T21:38:59.185399+0000","last_change":"2024-02-19T21:38:17.997812+0000","last_active":"2024-02-19T21:38:59.185399+0000","last_peered":"2024-02-19T21:38:59.185399+0000","last_clean":"2024-02-19T21:38:59.185399+0000","last_became_active":"2024-02-19T21:32:23.354539+0000","last_became_peered":"2024-02-19T21:32:23.354539+0000","last_unstale":"2024-02-19T21:38:59.185399+0000","last_undegraded":"2024-02-19T21:38:59.185399+0000","last_fullsized":"2024-02-19T21:38:59.185399+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5","last_scrub_stamp":"2024-02-19T21:38:17.997743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:38:17.997743+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":388,"num_read_kb":383,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":129,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.159934+0000","last_change":"2024-02-19T21:38:31.249156+0000","last_active":"2024-02-19T21:38:54.159934+0000","last_peered":"2024-02-19T21:38:54.159934+0000","last_clean":"2024-02-19T21:38:54.159934+0000","last_became_active":"2024-02-19T21:38:31.248699+0000","last_became_peered":"2024-02-19T21:38:31.248699+0000","last_unstale":"2024-02-19T21:38:54.159934+0000","last_undegraded":"2024-02-19T21:38:54.159934+0000","last_fullsized":"2024-02-19T21:38:54.159934+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:15.194849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:38:15.194849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"66'13","reported_seq":151,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.148042+0000","last_change":"2024-02-19T21:37:32.806098+0000","last_active":"2024-02-19T21:38:54.148042+0000","last_peered":"2024-02-19T21:38:54.148042+0000","last_clean":"2024-02-19T21:38:54.148042+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:38:54.148042+0000","last_undegraded":"2024-02-19T21:38:54.148042+0000","last_fullsized":"2024-02-19T21:38:54.148042+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'13","last_scrub_stamp":"2024-02-19T21:37:32.805993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:32.805993+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":114,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.164632+0000","last_change":"2024-02-19T21:38:14.200101+0000","last_active":"2024-02-19T21:38:54.164632+0000","last_peered":"2024-02-19T21:38:54.164632+0000","last_clean":"2024-02-19T21:38:54.164632+0000","last_became_active":"2024-02-19T21:32:27.363740+0000","last_became_peered":"2024-02-19T21:32:27.363740+0000","last_unstale":"2024-02-19T21:38:54.164632+0000","last_undegraded":"2024-02-19T21:38:54.164632+0000","last_fullsized":"2024-02-19T21:38:54.164632+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:14.199989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:14.199989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"151'13888","reported_seq":16982,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-02-19T21:39:00.009319+0000","last_change":"2024-02-19T21:38:47.043161+0000","last_active":"2024-02-19T21:39:00.009319+0000","last_peered":"2024-02-19T21:39:00.009319+0000","last_clean":"2024-02-19T21:39:00.009319+0000","last_became_active":"2024-02-19T21:38:47.001836+0000","last_became_peered":"2024-02-19T21:38:47.001836+0000","last_unstale":"2024-02-19T21:39:00.009319+0000","last_undegraded":"2024-02-19T21:39:00.009319+0000","last_fullsized":"2024-02-19T21:39:00.009319+0000","mapping_epoch":147,"log_start":"133'8872","ondisk_log_start":"133'8872","created":100,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'7343","last_scrub_stamp":"2024-02-19T21:37:01.782509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:01.782509+0000","log_size":5016,"ondisk_log_size":5016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31457280,"num_objects":480,"num_object_clones":0,"num_object_copies":1440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":480,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13888,"num_write_kb":459776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1504,"num_bytes_recovered":98566144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":109,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.156775+0000","last_change":"2024-02-19T21:37:20.804540+0000","last_active":"2024-02-19T21:38:54.156775+0000","last_peered":"2024-02-19T21:38:54.156775+0000","last_clean":"2024-02-19T21:38:54.156775+0000","last_became_active":"2024-02-19T21:32:29.372547+0000","last_became_peered":"2024-02-19T21:32:29.372547+0000","last_unstale":"2024-02-19T21:38:54.156775+0000","last_undegraded":"2024-02-19T21:38:54.156775+0000","last_fullsized":"2024-02-19T21:38:54.156775+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:20.804454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:37:20.804454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.155791+0000","last_change":"2024-02-19T21:38:31.247087+0000","last_active":"2024-02-19T21:38:54.155791+0000","last_peered":"2024-02-19T21:38:54.155791+0000","last_clean":"2024-02-19T21:38:54.155791+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:38:54.155791+0000","last_undegraded":"2024-02-19T21:38:54.155791+0000","last_fullsized":"2024-02-19T21:38:54.155791+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:13.579375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:37:13.579375+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":115,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.156773+0000","last_change":"2024-02-19T21:38:15.868833+0000","last_active":"2024-02-19T21:38:54.156773+0000","last_peered":"2024-02-19T21:38:54.156773+0000","last_clean":"2024-02-19T21:38:54.156773+0000","last_became_active":"2024-02-19T21:32:23.361163+0000","last_became_peered":"2024-02-19T21:32:23.361163+0000","last_unstale":"2024-02-19T21:38:54.156773+0000","last_undegraded":"2024-02-19T21:38:54.156773+0000","last_fullsized":"2024-02-19T21:38:54.156773+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:15.868735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:38:15.868735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":123,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.168020+0000","last_change":"2024-02-19T21:38:22.819040+0000","last_active":"2024-02-19T21:38:54.168020+0000","last_peered":"2024-02-19T21:38:54.168020+0000","last_clean":"2024-02-19T21:38:54.168020+0000","last_became_active":"2024-02-19T21:32:16.878022+0000","last_became_peered":"2024-02-19T21:32:16.878022+0000","last_unstale":"2024-02-19T21:38:54.168020+0000","last_undegraded":"2024-02-19T21:38:54.168020+0000","last_fullsized":"2024-02-19T21:38:54.168020+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:22.818948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:38:22.818948+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"143'21","reported_seq":142,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.149245+0000","last_change":"2024-02-19T21:38:28.363141+0000","last_active":"2024-02-19T21:38:54.149245+0000","last_peered":"2024-02-19T21:38:54.149245+0000","last_clean":"2024-02-19T21:38:54.149245+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:38:54.149245+0000","last_undegraded":"2024-02-19T21:38:54.149245+0000","last_fullsized":"2024-02-19T21:38:54.149245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"143'21","last_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:38:28.363073+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":111,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.167964+0000","last_change":"2024-02-19T21:37:07.934832+0000","last_active":"2024-02-19T21:38:54.167964+0000","last_peered":"2024-02-19T21:38:54.167964+0000","last_clean":"2024-02-19T21:38:54.167964+0000","last_became_active":"2024-02-19T21:32:27.373579+0000","last_became_peered":"2024-02-19T21:32:27.373579+0000","last_unstale":"2024-02-19T21:38:54.167964+0000","last_undegraded":"2024-02-19T21:38:54.167964+0000","last_fullsized":"2024-02-19T21:38:54.167964+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:07.934744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:07.934744+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"151'13683","reported_seq":13745,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-02-19T21:38:59.836465+0000","last_change":"2024-02-19T21:38:20.870478+0000","last_active":"2024-02-19T21:38:59.836465+0000","last_peered":"2024-02-19T21:38:59.836465+0000","last_clean":"2024-02-19T21:38:59.836465+0000","last_became_active":"2024-02-19T21:35:19.639005+0000","last_became_peered":"2024-02-19T21:35:19.639005+0000","last_unstale":"2024-02-19T21:38:59.836465+0000","last_undegraded":"2024-02-19T21:38:59.836465+0000","last_fullsized":"2024-02-19T21:38:59.836465+0000","mapping_epoch":100,"log_start":"133'8917","ondisk_log_start":"133'8917","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'11787","last_scrub_stamp":"2024-02-19T21:38:20.870376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:20.870376+0000","log_size":4766,"ondisk_log_size":4766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":445,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13683,"num_write_kb":452096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":114,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.148703+0000","last_change":"2024-02-19T21:38:31.249166+0000","last_active":"2024-02-19T21:38:54.148703+0000","last_peered":"2024-02-19T21:38:54.148703+0000","last_clean":"2024-02-19T21:38:54.148703+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:38:54.148703+0000","last_undegraded":"2024-02-19T21:38:54.148703+0000","last_fullsized":"2024-02-19T21:38:54.148703+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:12.015973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:36:12.015973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":125,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.155245+0000","last_change":"2024-02-19T21:38:31.247108+0000","last_active":"2024-02-19T21:38:54.155245+0000","last_peered":"2024-02-19T21:38:54.155245+0000","last_clean":"2024-02-19T21:38:54.155245+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:38:54.155245+0000","last_undegraded":"2024-02-19T21:38:54.155245+0000","last_fullsized":"2024-02-19T21:38:54.155245+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:22.928801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:38:22.928801+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":110,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.167977+0000","last_change":"2024-02-19T21:36:05.241479+0000","last_active":"2024-02-19T21:38:54.167977+0000","last_peered":"2024-02-19T21:38:54.167977+0000","last_clean":"2024-02-19T21:38:54.167977+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:38:54.167977+0000","last_undegraded":"2024-02-19T21:38:54.167977+0000","last_fullsized":"2024-02-19T21:38:54.167977+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:05.241389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:36:05.241389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"66'12","reported_seq":157,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.154197+0000","last_change":"2024-02-19T21:38:18.908836+0000","last_active":"2024-02-19T21:38:54.154197+0000","last_peered":"2024-02-19T21:38:54.154197+0000","last_clean":"2024-02-19T21:38:54.154197+0000","last_became_active":"2024-02-19T21:33:50.750727+0000","last_became_peered":"2024-02-19T21:33:50.750727+0000","last_unstale":"2024-02-19T21:38:54.154197+0000","last_undegraded":"2024-02-19T21:38:54.154197+0000","last_fullsized":"2024-02-19T21:38:54.154197+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'12","last_scrub_stamp":"2024-02-19T21:38:18.908732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:38:18.908732+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":111,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.157015+0000","last_change":"2024-02-19T21:38:25.921065+0000","last_active":"2024-02-19T21:38:54.157015+0000","last_peered":"2024-02-19T21:38:54.157015+0000","last_clean":"2024-02-19T21:38:54.157015+0000","last_became_active":"2024-02-19T21:32:27.372460+0000","last_became_peered":"2024-02-19T21:32:27.372460+0000","last_unstale":"2024-02-19T21:38:54.157015+0000","last_undegraded":"2024-02-19T21:38:54.157015+0000","last_fullsized":"2024-02-19T21:38:54.157015+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:25.920968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:25.920968+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"151'13878","reported_seq":14589,"reported_epoch":151,"state":"active+remapped+backfilling","last_fresh":"2024-02-19T21:38:59.810007+0000","last_change":"2024-02-19T21:38:32.664787+0000","last_active":"2024-02-19T21:38:59.810007+0000","last_peered":"2024-02-19T21:38:59.810007+0000","last_clean":"2024-02-19T21:38:30.218734+0000","last_became_active":"2024-02-19T21:38:32.488424+0000","last_became_peered":"2024-02-19T21:38:32.488424+0000","last_unstale":"2024-02-19T21:38:59.810007+0000","last_undegraded":"2024-02-19T21:38:59.810007+0000","last_fullsized":"2024-02-19T21:38:59.810007+0000","mapping_epoch":145,"log_start":"132'8573","ondisk_log_start":"132'8573","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'11484","last_scrub_stamp":"2024-02-19T21:38:12.974516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:12.974516+0000","log_size":5305,"ondisk_log_size":5305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":348,"num_objects_unfound":0,"num_objects_dirty":490,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13878,"num_write_kb":459776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":316,"num_bytes_recovered":20643840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,3],"avail_no_missing":["5","1","3"],"object_location_counts":[{"shards":"1,3,5","objects":490}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":105,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.147759+0000","last_change":"2024-02-19T21:35:55.839055+0000","last_active":"2024-02-19T21:38:54.147759+0000","last_peered":"2024-02-19T21:38:54.147759+0000","last_clean":"2024-02-19T21:38:54.147759+0000","last_became_active":"2024-02-19T21:32:29.597270+0000","last_became_peered":"2024-02-19T21:32:29.597270+0000","last_unstale":"2024-02-19T21:38:54.147759+0000","last_undegraded":"2024-02-19T21:38:54.147759+0000","last_fullsized":"2024-02-19T21:38:54.147759+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:55.838954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:35:55.838954+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":110,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.167749+0000","last_change":"2024-02-19T21:35:59.218786+0000","last_active":"2024-02-19T21:38:54.167749+0000","last_peered":"2024-02-19T21:38:54.167749+0000","last_clean":"2024-02-19T21:38:54.167749+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:38:54.167749+0000","last_undegraded":"2024-02-19T21:38:54.167749+0000","last_fullsized":"2024-02-19T21:38:54.167749+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:59.218696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:35:59.218696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"83'27","reported_seq":158,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.154554+0000","last_change":"2024-02-19T21:37:13.658855+0000","last_active":"2024-02-19T21:38:54.154554+0000","last_peered":"2024-02-19T21:38:54.154554+0000","last_clean":"2024-02-19T21:38:54.154554+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:38:54.154554+0000","last_undegraded":"2024-02-19T21:38:54.154554+0000","last_fullsized":"2024-02-19T21:38:54.154554+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'27","last_scrub_stamp":"2024-02-19T21:37:13.658740+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:37:13.658740+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":113,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.148936+0000","last_change":"2024-02-19T21:37:05.923317+0000","last_active":"2024-02-19T21:38:54.148936+0000","last_peered":"2024-02-19T21:38:54.148936+0000","last_clean":"2024-02-19T21:38:54.148936+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:38:54.148936+0000","last_undegraded":"2024-02-19T21:38:54.148936+0000","last_fullsized":"2024-02-19T21:38:54.148936+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:05.923212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:37:05.923212+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"151'14130","reported_seq":14199,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-02-19T21:38:59.923129+0000","last_change":"2024-02-19T21:38:45.173367+0000","last_active":"2024-02-19T21:38:59.923129+0000","last_peered":"2024-02-19T21:38:59.923129+0000","last_clean":"2024-02-19T21:38:59.923129+0000","last_became_active":"2024-02-19T21:35:20.120275+0000","last_became_peered":"2024-02-19T21:35:20.120275+0000","last_unstale":"2024-02-19T21:38:59.923129+0000","last_undegraded":"2024-02-19T21:38:59.923129+0000","last_fullsized":"2024-02-19T21:38:59.923129+0000","mapping_epoch":100,"log_start":"130'8000","ondisk_log_start":"130'8000","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:35:18.622399+0000","log_size":6130,"ondisk_log_size":6130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31195136,"num_objects":476,"num_object_clones":0,"num_object_copies":1428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":476,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14130,"num_write_kb":467392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4],"acting":[3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":21,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.160992+0000","last_change":"2024-02-19T21:38:31.254241+0000","last_active":"2024-02-19T21:38:54.160992+0000","last_peered":"2024-02-19T21:38:54.160992+0000","last_clean":"2024-02-19T21:38:54.160992+0000","last_became_active":"2024-02-19T21:38:31.253920+0000","last_became_peered":"2024-02-19T21:38:31.253920+0000","last_unstale":"2024-02-19T21:38:54.160992+0000","last_undegraded":"2024-02-19T21:38:54.160992+0000","last_fullsized":"2024-02-19T21:38:54.160992+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:05.692955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:37:05.692955+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6],"acting":[2,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":118,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.148591+0000","last_change":"2024-02-19T21:38:28.036423+0000","last_active":"2024-02-19T21:38:54.148591+0000","last_peered":"2024-02-19T21:38:54.148591+0000","last_clean":"2024-02-19T21:38:54.148591+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:38:54.148591+0000","last_undegraded":"2024-02-19T21:38:54.148591+0000","last_fullsized":"2024-02-19T21:38:54.148591+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:38:28.036351+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"66'18","reported_seq":80,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.168889+0000","last_change":"2024-02-19T21:38:31.974143+0000","last_active":"2024-02-19T21:38:54.168889+0000","last_peered":"2024-02-19T21:38:54.168889+0000","last_clean":"2024-02-19T21:38:54.168889+0000","last_became_active":"2024-02-19T21:38:31.249726+0000","last_became_peered":"2024-02-19T21:38:31.249726+0000","last_unstale":"2024-02-19T21:38:54.168889+0000","last_undegraded":"2024-02-19T21:38:54.168889+0000","last_fullsized":"2024-02-19T21:38:54.168889+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'18","last_scrub_stamp":"2024-02-19T21:36:05.769256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:05.769256+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":33,"num_read_kb":21,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":126,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.140109+0000","last_change":"2024-02-19T21:38:31.247302+0000","last_active":"2024-02-19T21:38:54.140109+0000","last_peered":"2024-02-19T21:38:54.140109+0000","last_clean":"2024-02-19T21:38:54.140109+0000","last_became_active":"2024-02-19T21:38:31.246742+0000","last_became_peered":"2024-02-19T21:38:31.246742+0000","last_unstale":"2024-02-19T21:38:54.140109+0000","last_undegraded":"2024-02-19T21:38:54.140109+0000","last_fullsized":"2024-02-19T21:38:54.140109+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:27.306147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:27.306147+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"151'13958","reported_seq":14024,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-02-19T21:38:59.940888+0000","last_change":"2024-02-19T21:38:30.580862+0000","last_active":"2024-02-19T21:38:59.940888+0000","last_peered":"2024-02-19T21:38:59.940888+0000","last_clean":"2024-02-19T21:38:59.940888+0000","last_became_active":"2024-02-19T21:35:19.640449+0000","last_became_peered":"2024-02-19T21:35:19.640449+0000","last_unstale":"2024-02-19T21:38:59.940888+0000","last_undegraded":"2024-02-19T21:38:59.940888+0000","last_fullsized":"2024-02-19T21:38:59.940888+0000","mapping_epoch":100,"log_start":"130'7800","ondisk_log_start":"130'7800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"144'12525","last_scrub_stamp":"2024-02-19T21:38:30.580777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:30.580777+0000","log_size":6158,"ondisk_log_size":6158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32768000,"num_objects":500,"num_object_clones":0,"num_object_copies":1500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":500,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13958,"num_write_kb":462656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":109,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.167136+0000","last_change":"2024-02-19T21:37:23.993328+0000","last_active":"2024-02-19T21:38:54.167136+0000","last_peered":"2024-02-19T21:38:54.167136+0000","last_clean":"2024-02-19T21:38:54.167136+0000","last_became_active":"2024-02-19T21:32:29.597309+0000","last_became_peered":"2024-02-19T21:32:29.597309+0000","last_unstale":"2024-02-19T21:38:54.167136+0000","last_undegraded":"2024-02-19T21:38:54.167136+0000","last_fullsized":"2024-02-19T21:38:54.167136+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:23.993242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:37:23.993242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":110,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.149189+0000","last_change":"2024-02-19T21:36:04.968027+0000","last_active":"2024-02-19T21:38:54.149189+0000","last_peered":"2024-02-19T21:38:54.149189+0000","last_clean":"2024-02-19T21:38:54.149189+0000","last_became_active":"2024-02-19T21:32:23.354215+0000","last_became_peered":"2024-02-19T21:32:23.354215+0000","last_unstale":"2024-02-19T21:38:54.149189+0000","last_undegraded":"2024-02-19T21:38:54.149189+0000","last_fullsized":"2024-02-19T21:38:54.149189+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:04.967919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:36:04.967919+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"66'14","reported_seq":108,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.155498+0000","last_change":"2024-02-19T21:38:30.886495+0000","last_active":"2024-02-19T21:38:54.155498+0000","last_peered":"2024-02-19T21:38:54.155498+0000","last_clean":"2024-02-19T21:38:54.155498+0000","last_became_active":"2024-02-19T21:35:14.513806+0000","last_became_peered":"2024-02-19T21:35:14.513806+0000","last_unstale":"2024-02-19T21:38:54.155498+0000","last_undegraded":"2024-02-19T21:38:54.155498+0000","last_fullsized":"2024-02-19T21:38:54.155498+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'14","last_scrub_stamp":"2024-02-19T21:38:30.886421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:38:30.886421+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":51,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:56.934276+0000","last_change":"2024-02-19T21:38:31.340504+0000","last_active":"2024-02-19T21:38:56.934276+0000","last_peered":"2024-02-19T21:38:56.934276+0000","last_clean":"2024-02-19T21:38:56.934276+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:38:56.934276+0000","last_undegraded":"2024-02-19T21:38:56.934276+0000","last_fullsized":"2024-02-19T21:38:56.934276+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:37:07.618614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:07.618614+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"151'13840","reported_seq":13905,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-02-19T21:38:59.795522+0000","last_change":"2024-02-19T21:38:22.620478+0000","last_active":"2024-02-19T21:38:59.795522+0000","last_peered":"2024-02-19T21:38:59.795522+0000","last_clean":"2024-02-19T21:38:59.795522+0000","last_became_active":"2024-02-19T21:35:19.635979+0000","last_became_peered":"2024-02-19T21:35:19.635979+0000","last_unstale":"2024-02-19T21:38:59.795522+0000","last_undegraded":"2024-02-19T21:38:59.795522+0000","last_fullsized":"2024-02-19T21:38:59.795522+0000","mapping_epoch":100,"log_start":"132'8568","ondisk_log_start":"132'8568","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'12028","last_scrub_stamp":"2024-02-19T21:38:22.620386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:22.620386+0000","log_size":5272,"ondisk_log_size":5272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32702488,"num_objects":500,"num_object_clones":0,"num_object_copies":1500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":500,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13840,"num_write_kb":458817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":18,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.149153+0000","last_change":"2024-02-19T21:38:31.248452+0000","last_active":"2024-02-19T21:38:54.149153+0000","last_peered":"2024-02-19T21:38:54.149153+0000","last_clean":"2024-02-19T21:38:54.149153+0000","last_became_active":"2024-02-19T21:38:31.247955+0000","last_became_peered":"2024-02-19T21:38:31.247955+0000","last_unstale":"2024-02-19T21:38:54.149153+0000","last_undegraded":"2024-02-19T21:38:54.149153+0000","last_fullsized":"2024-02-19T21:38:54.149153+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:37:35.789463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":111,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.156636+0000","last_change":"2024-02-19T21:37:06.982383+0000","last_active":"2024-02-19T21:38:54.156636+0000","last_peered":"2024-02-19T21:38:54.156636+0000","last_clean":"2024-02-19T21:38:54.156636+0000","last_became_active":"2024-02-19T21:32:27.362497+0000","last_became_peered":"2024-02-19T21:32:27.362497+0000","last_unstale":"2024-02-19T21:38:54.156636+0000","last_undegraded":"2024-02-19T21:38:54.156636+0000","last_fullsized":"2024-02-19T21:38:54.156636+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:06.982285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:06.982285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":122,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.168066+0000","last_change":"2024-02-19T21:38:11.707510+0000","last_active":"2024-02-19T21:38:54.168066+0000","last_peered":"2024-02-19T21:38:54.168066+0000","last_clean":"2024-02-19T21:38:54.168066+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:38:54.168066+0000","last_undegraded":"2024-02-19T21:38:54.168066+0000","last_fullsized":"2024-02-19T21:38:54.168066+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:38:11.707428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:38:11.707428+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"66'11","reported_seq":106,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.149140+0000","last_change":"2024-02-19T21:38:20.307440+0000","last_active":"2024-02-19T21:38:54.149140+0000","last_peered":"2024-02-19T21:38:54.149140+0000","last_clean":"2024-02-19T21:38:54.149140+0000","last_became_active":"2024-02-19T21:35:14.513889+0000","last_became_peered":"2024-02-19T21:35:14.513889+0000","last_unstale":"2024-02-19T21:38:54.149140+0000","last_undegraded":"2024-02-19T21:38:54.149140+0000","last_fullsized":"2024-02-19T21:38:54.149140+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:38:20.307340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:38:20.307340+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.c","version":"151'13972","reported_seq":14678,"reported_epoch":151,"state":"active+remapped+backfilling","last_fresh":"2024-02-19T21:38:59.835231+0000","last_change":"2024-02-19T21:38:32.531120+0000","last_active":"2024-02-19T21:38:59.835231+0000","last_peered":"2024-02-19T21:38:59.835231+0000","last_clean":"2024-02-19T21:38:30.223358+0000","last_became_active":"2024-02-19T21:38:32.461156+0000","last_became_peered":"2024-02-19T21:38:32.461156+0000","last_unstale":"2024-02-19T21:38:59.835231+0000","last_undegraded":"2024-02-19T21:38:59.835231+0000","last_fullsized":"2024-02-19T21:38:59.835231+0000","mapping_epoch":145,"log_start":"132'8615","ondisk_log_start":"132'8615","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'11969","last_scrub_stamp":"2024-02-19T21:38:19.330024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:19.330024+0000","log_size":5357,"ondisk_log_size":5357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31326208,"num_objects":478,"num_object_clones":0,"num_object_copies":1434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":333,"num_objects_unfound":0,"num_objects_dirty":478,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13972,"num_write_kb":462400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":317,"num_bytes_recovered":20774912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,3],"avail_no_missing":["6","3","7"],"object_location_counts":[{"shards":"3,6,7","objects":478}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":109,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.156351+0000","last_change":"2024-02-19T21:36:15.780162+0000","last_active":"2024-02-19T21:38:54.156351+0000","last_peered":"2024-02-19T21:38:54.156351+0000","last_clean":"2024-02-19T21:38:54.156351+0000","last_became_active":"2024-02-19T21:32:29.378462+0000","last_became_peered":"2024-02-19T21:32:29.378462+0000","last_unstale":"2024-02-19T21:38:54.156351+0000","last_undegraded":"2024-02-19T21:38:54.156351+0000","last_fullsized":"2024-02-19T21:38:54.156351+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:15.780083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:36:15.780083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"98'9","reported_seq":146,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:56.934434+0000","last_change":"2024-02-19T21:38:23.887797+0000","last_active":"2024-02-19T21:38:56.934434+0000","last_peered":"2024-02-19T21:38:56.934434+0000","last_clean":"2024-02-19T21:38:56.934434+0000","last_became_active":"2024-02-19T21:35:14.513802+0000","last_became_peered":"2024-02-19T21:35:14.513802+0000","last_unstale":"2024-02-19T21:38:56.934434+0000","last_undegraded":"2024-02-19T21:38:56.934434+0000","last_fullsized":"2024-02-19T21:38:56.934434+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'9","last_scrub_stamp":"2024-02-19T21:38:23.887716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:23.887716+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":116,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.147677+0000","last_change":"2024-02-19T21:36:15.924099+0000","last_active":"2024-02-19T21:38:54.147677+0000","last_peered":"2024-02-19T21:38:54.147677+0000","last_clean":"2024-02-19T21:38:54.147677+0000","last_became_active":"2024-02-19T21:32:23.362738+0000","last_became_peered":"2024-02-19T21:32:23.362738+0000","last_unstale":"2024-02-19T21:38:54.147677+0000","last_undegraded":"2024-02-19T21:38:54.147677+0000","last_fullsized":"2024-02-19T21:38:54.147677+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:15.923991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:36:15.923991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"66'15","reported_seq":139,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.148131+0000","last_change":"2024-02-19T21:36:17.850403+0000","last_active":"2024-02-19T21:38:54.148131+0000","last_peered":"2024-02-19T21:38:54.148131+0000","last_clean":"2024-02-19T21:38:54.148131+0000","last_became_active":"2024-02-19T21:32:25.367511+0000","last_became_peered":"2024-02-19T21:32:25.367511+0000","last_unstale":"2024-02-19T21:38:54.148131+0000","last_undegraded":"2024-02-19T21:38:54.148131+0000","last_fullsized":"2024-02-19T21:38:54.148131+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:36:17.850310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:17.850310+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"151'14017","reported_seq":17054,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-02-19T21:39:00.009591+0000","last_change":"2024-02-19T21:38:48.028195+0000","last_active":"2024-02-19T21:39:00.009591+0000","last_peered":"2024-02-19T21:39:00.009591+0000","last_clean":"2024-02-19T21:39:00.009591+0000","last_became_active":"2024-02-19T21:38:48.001623+0000","last_became_peered":"2024-02-19T21:38:48.001623+0000","last_unstale":"2024-02-19T21:39:00.009591+0000","last_undegraded":"2024-02-19T21:39:00.009591+0000","last_fullsized":"2024-02-19T21:39:00.009591+0000","mapping_epoch":148,"log_start":"133'9001","ondisk_log_start":"133'9001","created":100,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'8025","last_scrub_stamp":"2024-02-19T21:37:12.025401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:12.025401+0000","log_size":5016,"ondisk_log_size":5016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":29294592,"num_objects":447,"num_object_clones":0,"num_object_copies":1341,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":447,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14017,"num_write_kb":462848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1474,"num_bytes_recovered":96534528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":70,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.147873+0000","last_change":"2024-02-19T21:35:18.708652+0000","last_active":"2024-02-19T21:38:54.147873+0000","last_peered":"2024-02-19T21:38:54.147873+0000","last_clean":"2024-02-19T21:38:54.147873+0000","last_became_active":"2024-02-19T21:35:14.515342+0000","last_became_peered":"2024-02-19T21:35:14.515342+0000","last_unstale":"2024-02-19T21:38:54.147873+0000","last_undegraded":"2024-02-19T21:38:54.147873+0000","last_fullsized":"2024-02-19T21:38:54.147873+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:18.708535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:35:18.708535+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"83'9","reported_seq":199,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:56.935106+0000","last_change":"2024-02-19T21:37:16.989938+0000","last_active":"2024-02-19T21:38:56.935106+0000","last_peered":"2024-02-19T21:38:56.935106+0000","last_clean":"2024-02-19T21:38:56.935106+0000","last_became_active":"2024-02-19T21:32:27.363859+0000","last_became_peered":"2024-02-19T21:32:27.363859+0000","last_unstale":"2024-02-19T21:38:56.935106+0000","last_undegraded":"2024-02-19T21:38:56.935106+0000","last_fullsized":"2024-02-19T21:38:56.935106+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'9","last_scrub_stamp":"2024-02-19T21:37:16.989836+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:37:16.989836+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":111,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.149011+0000","last_change":"2024-02-19T21:35:04.768053+0000","last_active":"2024-02-19T21:38:54.149011+0000","last_peered":"2024-02-19T21:38:54.149011+0000","last_clean":"2024-02-19T21:38:54.149011+0000","last_became_active":"2024-02-19T21:32:23.363155+0000","last_became_peered":"2024-02-19T21:32:23.363155+0000","last_unstale":"2024-02-19T21:38:54.149011+0000","last_undegraded":"2024-02-19T21:38:54.149011+0000","last_fullsized":"2024-02-19T21:38:54.149011+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:35:04.767979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"66'10","reported_seq":97,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.154804+0000","last_change":"2024-02-19T21:37:22.544888+0000","last_active":"2024-02-19T21:38:54.154804+0000","last_peered":"2024-02-19T21:38:54.154804+0000","last_clean":"2024-02-19T21:38:54.154804+0000","last_became_active":"2024-02-19T21:35:14.514968+0000","last_became_peered":"2024-02-19T21:35:14.514968+0000","last_unstale":"2024-02-19T21:38:54.154804+0000","last_undegraded":"2024-02-19T21:38:54.154804+0000","last_fullsized":"2024-02-19T21:38:54.154804+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:37:22.544818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:22.544818+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6],"acting":[3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"151'13676","reported_seq":13742,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-02-19T21:38:59.865672+0000","last_change":"2024-02-19T21:37:05.416082+0000","last_active":"2024-02-19T21:38:59.865672+0000","last_peered":"2024-02-19T21:38:59.865672+0000","last_clean":"2024-02-19T21:38:59.865672+0000","last_became_active":"2024-02-19T21:35:19.638981+0000","last_became_peered":"2024-02-19T21:35:19.638981+0000","last_unstale":"2024-02-19T21:38:59.865672+0000","last_undegraded":"2024-02-19T21:38:59.865672+0000","last_fullsized":"2024-02-19T21:38:59.865672+0000","mapping_epoch":100,"log_start":"131'8107","ondisk_log_start":"131'8107","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'7433","last_scrub_stamp":"2024-02-19T21:37:05.415974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:05.415974+0000","log_size":5569,"ondisk_log_size":5569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":30801920,"num_objects":470,"num_object_clones":0,"num_object_copies":1410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":470,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13676,"num_write_kb":452672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":118,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.160082+0000","last_change":"2024-02-19T21:38:31.256285+0000","last_active":"2024-02-19T21:38:54.160082+0000","last_peered":"2024-02-19T21:38:54.160082+0000","last_clean":"2024-02-19T21:38:54.160082+0000","last_became_active":"2024-02-19T21:38:31.255853+0000","last_became_peered":"2024-02-19T21:38:31.255853+0000","last_unstale":"2024-02-19T21:38:54.160082+0000","last_undegraded":"2024-02-19T21:38:54.160082+0000","last_fullsized":"2024-02-19T21:38:54.160082+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:57.989420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:36:57.989420+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6],"acting":[2,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":107,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.148668+0000","last_change":"2024-02-19T21:35:58.886991+0000","last_active":"2024-02-19T21:38:54.148668+0000","last_peered":"2024-02-19T21:38:54.148668+0000","last_clean":"2024-02-19T21:38:54.148668+0000","last_became_active":"2024-02-19T21:32:27.369452+0000","last_became_peered":"2024-02-19T21:32:27.369452+0000","last_unstale":"2024-02-19T21:38:54.148668+0000","last_undegraded":"2024-02-19T21:38:54.148668+0000","last_fullsized":"2024-02-19T21:38:54.148668+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:58.886937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:35:58.886937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.166982+0000","last_change":"2024-02-19T21:37:18.042043+0000","last_active":"2024-02-19T21:38:54.166982+0000","last_peered":"2024-02-19T21:38:54.166982+0000","last_clean":"2024-02-19T21:38:54.166982+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:38:54.166982+0000","last_undegraded":"2024-02-19T21:38:54.166982+0000","last_fullsized":"2024-02-19T21:38:54.166982+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:18.041939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:37:18.041939+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"66'17","reported_seq":115,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.160626+0000","last_change":"2024-02-19T21:38:19.154861+0000","last_active":"2024-02-19T21:38:54.160626+0000","last_peered":"2024-02-19T21:38:54.160626+0000","last_clean":"2024-02-19T21:38:54.160626+0000","last_became_active":"2024-02-19T21:35:14.516588+0000","last_became_peered":"2024-02-19T21:35:14.516588+0000","last_unstale":"2024-02-19T21:38:54.160626+0000","last_undegraded":"2024-02-19T21:38:54.160626+0000","last_fullsized":"2024-02-19T21:38:54.160626+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'17","last_scrub_stamp":"2024-02-19T21:38:19.154753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:38:19.154753+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"151'13493","reported_seq":13557,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-02-19T21:38:59.940391+0000","last_change":"2024-02-19T21:37:17.375432+0000","last_active":"2024-02-19T21:38:59.940391+0000","last_peered":"2024-02-19T21:38:59.940391+0000","last_clean":"2024-02-19T21:38:59.940391+0000","last_became_active":"2024-02-19T21:35:20.121957+0000","last_became_peered":"2024-02-19T21:35:20.121957+0000","last_unstale":"2024-02-19T21:38:59.940391+0000","last_undegraded":"2024-02-19T21:38:59.940391+0000","last_fullsized":"2024-02-19T21:38:59.940391+0000","mapping_epoch":100,"log_start":"132'8396","ondisk_log_start":"132'8396","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"131'7984","last_scrub_stamp":"2024-02-19T21:37:17.375364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:17.375364+0000","log_size":5097,"ondisk_log_size":5097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":30867456,"num_objects":471,"num_object_clones":0,"num_object_copies":1413,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13493,"num_write_kb":446848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":109,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.167934+0000","last_change":"2024-02-19T21:37:29.936229+0000","last_active":"2024-02-19T21:38:54.167934+0000","last_peered":"2024-02-19T21:38:54.167934+0000","last_clean":"2024-02-19T21:38:54.167934+0000","last_became_active":"2024-02-19T21:32:29.373442+0000","last_became_peered":"2024-02-19T21:32:29.373442+0000","last_unstale":"2024-02-19T21:38:54.167934+0000","last_undegraded":"2024-02-19T21:38:54.167934+0000","last_fullsized":"2024-02-19T21:38:54.167934+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:37:29.936139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":111,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.160244+0000","last_change":"2024-02-19T21:36:57.004075+0000","last_active":"2024-02-19T21:38:54.160244+0000","last_peered":"2024-02-19T21:38:54.160244+0000","last_clean":"2024-02-19T21:38:54.160244+0000","last_became_active":"2024-02-19T21:32:27.369020+0000","last_became_peered":"2024-02-19T21:32:27.369020+0000","last_unstale":"2024-02-19T21:38:54.160244+0000","last_undegraded":"2024-02-19T21:38:54.160244+0000","last_fullsized":"2024-02-19T21:38:54.160244+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:57.003986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:46.372184+0000","last_clean_scrub_stamp":"2024-02-19T21:36:57.003986+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"59'1","reported_seq":121,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.161652+0000","last_change":"2024-02-19T21:37:18.928676+0000","last_active":"2024-02-19T21:38:54.161652+0000","last_peered":"2024-02-19T21:38:54.161652+0000","last_clean":"2024-02-19T21:38:54.161652+0000","last_became_active":"2024-02-19T21:32:23.359474+0000","last_became_peered":"2024-02-19T21:32:23.359474+0000","last_unstale":"2024-02-19T21:38:54.161652+0000","last_undegraded":"2024-02-19T21:38:54.161652+0000","last_fullsized":"2024-02-19T21:38:54.161652+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:37:18.928610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:37:18.928610+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"115'28","reported_seq":153,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.148846+0000","last_change":"2024-02-19T21:36:09.031773+0000","last_active":"2024-02-19T21:38:54.148846+0000","last_peered":"2024-02-19T21:38:54.148846+0000","last_clean":"2024-02-19T21:38:54.148846+0000","last_became_active":"2024-02-19T21:32:25.372284+0000","last_became_peered":"2024-02-19T21:32:25.372284+0000","last_unstale":"2024-02-19T21:38:54.148846+0000","last_undegraded":"2024-02-19T21:38:54.148846+0000","last_fullsized":"2024-02-19T21:38:54.148846+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'28","last_scrub_stamp":"2024-02-19T21:36:09.031674+0000","last_deep_scrub":"115'28","last_deep_scrub_stamp":"2024-02-19T21:36:09.031674+0000","last_clean_scrub_stamp":"2024-02-19T21:36:09.031674+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.8","version":"151'13739","reported_seq":13806,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-02-19T21:38:59.852830+0000","last_change":"2024-02-19T21:38:11.071417+0000","last_active":"2024-02-19T21:38:59.852830+0000","last_peered":"2024-02-19T21:38:59.852830+0000","last_clean":"2024-02-19T21:38:59.852830+0000","last_became_active":"2024-02-19T21:35:20.120284+0000","last_became_peered":"2024-02-19T21:35:20.120284+0000","last_unstale":"2024-02-19T21:38:59.852830+0000","last_undegraded":"2024-02-19T21:38:59.852830+0000","last_fullsized":"2024-02-19T21:38:59.852830+0000","mapping_epoch":100,"log_start":"131'8093","ondisk_log_start":"131'8093","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'11304","last_scrub_stamp":"2024-02-19T21:38:11.071303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:11.071303+0000","log_size":5646,"ondisk_log_size":5646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34144256,"num_objects":521,"num_object_clones":0,"num_object_copies":1563,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":521,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13739,"num_write_kb":456320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4],"acting":[2,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":110,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.155390+0000","last_change":"2024-02-19T21:36:55.508810+0000","last_active":"2024-02-19T21:38:54.155390+0000","last_peered":"2024-02-19T21:38:54.155390+0000","last_clean":"2024-02-19T21:38:54.155390+0000","last_became_active":"2024-02-19T21:32:29.375689+0000","last_became_peered":"2024-02-19T21:32:29.375689+0000","last_unstale":"2024-02-19T21:38:54.155390+0000","last_undegraded":"2024-02-19T21:38:54.155390+0000","last_fullsized":"2024-02-19T21:38:54.155390+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:55.508708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:36:55.508708+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":120,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.160768+0000","last_change":"2024-02-19T21:38:31.249224+0000","last_active":"2024-02-19T21:38:54.160768+0000","last_peered":"2024-02-19T21:38:54.160768+0000","last_clean":"2024-02-19T21:38:54.160768+0000","last_became_active":"2024-02-19T21:38:31.248877+0000","last_became_peered":"2024-02-19T21:38:31.248877+0000","last_unstale":"2024-02-19T21:38:54.160768+0000","last_undegraded":"2024-02-19T21:38:54.160768+0000","last_fullsized":"2024-02-19T21:38:54.160768+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:07.058748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:07.058748+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":116,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.148203+0000","last_change":"2024-02-19T21:37:36.883246+0000","last_active":"2024-02-19T21:38:54.148203+0000","last_peered":"2024-02-19T21:38:54.148203+0000","last_clean":"2024-02-19T21:38:54.148203+0000","last_became_active":"2024-02-19T21:32:23.357438+0000","last_became_peered":"2024-02-19T21:32:23.357438+0000","last_unstale":"2024-02-19T21:38:54.148203+0000","last_undegraded":"2024-02-19T21:38:54.148203+0000","last_fullsized":"2024-02-19T21:38:54.148203+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:36.883151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:37:36.883151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"66'9","reported_seq":130,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.154694+0000","last_change":"2024-02-19T21:36:56.503874+0000","last_active":"2024-02-19T21:38:54.154694+0000","last_peered":"2024-02-19T21:38:54.154694+0000","last_clean":"2024-02-19T21:38:54.154694+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:38:54.154694+0000","last_undegraded":"2024-02-19T21:38:54.154694+0000","last_fullsized":"2024-02-19T21:38:54.154694+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:36:56.503779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:36:56.503779+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"151'13860","reported_seq":13919,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-02-19T21:38:59.892754+0000","last_change":"2024-02-19T21:35:19.637187+0000","last_active":"2024-02-19T21:38:59.892754+0000","last_peered":"2024-02-19T21:38:59.892754+0000","last_clean":"2024-02-19T21:38:59.892754+0000","last_became_active":"2024-02-19T21:35:19.636837+0000","last_became_peered":"2024-02-19T21:35:19.636837+0000","last_unstale":"2024-02-19T21:38:59.892754+0000","last_undegraded":"2024-02-19T21:38:59.892754+0000","last_fullsized":"2024-02-19T21:38:59.892754+0000","mapping_epoch":100,"log_start":"133'9303","ondisk_log_start":"133'9303","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:18.622399+0000","last_clean_scrub_stamp":"2024-02-19T21:35:18.622399+0000","log_size":4557,"ondisk_log_size":4557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33030144,"num_objects":504,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":504,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13860,"num_write_kb":459648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":109,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.155525+0000","last_change":"2024-02-19T21:36:14.779507+0000","last_active":"2024-02-19T21:38:54.155525+0000","last_peered":"2024-02-19T21:38:54.155525+0000","last_clean":"2024-02-19T21:38:54.155525+0000","last_became_active":"2024-02-19T21:32:29.597248+0000","last_became_peered":"2024-02-19T21:32:29.597248+0000","last_unstale":"2024-02-19T21:38:54.155525+0000","last_undegraded":"2024-02-19T21:38:54.155525+0000","last_fullsized":"2024-02-19T21:38:54.155525+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:36:14.779443+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.164447+0000","last_change":"2024-02-19T21:38:31.253570+0000","last_active":"2024-02-19T21:38:54.164447+0000","last_peered":"2024-02-19T21:38:54.164447+0000","last_clean":"2024-02-19T21:38:54.164447+0000","last_became_active":"2024-02-19T21:38:31.253197+0000","last_became_peered":"2024-02-19T21:38:31.253197+0000","last_unstale":"2024-02-19T21:38:54.164447+0000","last_undegraded":"2024-02-19T21:38:54.164447+0000","last_fullsized":"2024-02-19T21:38:54.164447+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:33.010549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:33.010549+0000","last_clean_scrub_stamp":"2024-02-19T21:37:33.010549+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"66'15","reported_seq":140,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:54.155394+0000","last_change":"2024-02-19T21:37:05.934106+0000","last_active":"2024-02-19T21:38:54.155394+0000","last_peered":"2024-02-19T21:38:54.155394+0000","last_clean":"2024-02-19T21:38:54.155394+0000","last_became_active":"2024-02-19T21:32:25.372170+0000","last_became_peered":"2024-02-19T21:32:25.372170+0000","last_unstale":"2024-02-19T21:38:54.155394+0000","last_undegraded":"2024-02-19T21:38:54.155394+0000","last_fullsized":"2024-02-19T21:38:54.155394+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:37:05.934032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:05.934032+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"66'8","reported_seq":198,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-02-19T21:38:56.934678+0000","last_change":"2024-02-19T21:37:27.997824+0000","last_active":"2024-02-19T21:38:56.934678+0000","last_peered":"2024-02-19T21:38:56.934678+0000","last_clean":"2024-02-19T21:38:56.934678+0000","last_became_active":"2024-02-19T21:32:27.369840+0000","last_became_peered":"2024-02-19T21:32:27.369840+0000","last_unstale":"2024-02-19T21:38:56.934678+0000","last_undegraded":"2024-02-19T21:38:56.934678+0000","last_fullsized":"2024-02-19T21:38:56.934678+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:37:27.997724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:27.997724+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":505741336,"num_objects":7718,"num_object_clones":0,"num_object_copies":23154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1493,"num_objects_unfound":0,"num_objects_dirty":7718,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":221746,"num_write_kb":7342785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3930,"num_bytes_recovered":257425408,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1651191808,"data_stored":1651179592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85760,"ondisk_log_size":85760,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":3},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":388,"num_read_kb":383,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":688,"num_read_kb":445,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":1348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":440,"ondisk_log_size":440,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201362,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":476736,"kb_used_data":171320,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93268416,"statfs":{"total":95995035648,"available":95506857984,"internally_reserved":0,"allocated":175431680,"data_stored":175142736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:38:22 2024","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":0.90200000000000002,"15min":0.66600000000000004},"min":{"1min":0.23000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":6.625,"5min":6.625,"15min":6.625},"last":0.39700000000000002},{"interface":"front","average":{"1min":1.607,"5min":1.238,"15min":0.77700000000000002},"min":{"1min":0.23699999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":7.2290000000000001,"5min":7.2290000000000001,"15min":7.2290000000000001},"last":0.30499999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:38:22 2024","interfaces":[{"interface":"back","average":{"1min":2.0710000000000002,"5min":1.363,"15min":0.79900000000000004},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":11.276999999999999,"5min":11.276999999999999,"15min":11.276999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.1020000000000001,"15min":0.72999999999999998},"min":{"1min":0.28100000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":4.5279999999999996,"5min":7.2930000000000001,"15min":7.2930000000000001},"last":0.379}]},{"osd":2,"last update":"Mon Feb 19 21:38:22 2024","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.054,"15min":0.70799999999999996},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":3.5209999999999999,"5min":3.5209999999999999,"15min":3.5209999999999999},"last":7.1059999999999999},{"interface":"front","average":{"1min":2.661,"5min":1.367,"15min":0.81100000000000005},"min":{"1min":0.28000000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":8.7599999999999998,"5min":8.7599999999999998,"15min":8.7599999999999998},"last":9.7010000000000005}]},{"osd":3,"last update":"Mon Feb 19 21:38:22 2024","interfaces":[{"interface":"back","average":{"1min":2.871,"5min":1.754,"15min":0.94799999999999995},"min":{"1min":0.29299999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":17.481999999999999,"5min":31.559000000000001,"15min":31.559000000000001},"last":0.443},{"interface":"front","average":{"1min":2.6909999999999998,"5min":1.754,"15min":0.93899999999999995},"min":{"1min":0.35499999999999998,"5min":0.34000000000000002,"15min":0.33800000000000002},"max":{"1min":17.576000000000001,"5min":30.812999999999999,"15min":30.812999999999999},"last":1.0649999999999999}]},{"osd":4,"last update":"Mon Feb 19 21:38:22 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.56499999999999995,"15min":0.497},"min":{"1min":0.26700000000000002,"5min":0.249,"15min":0.249},"max":{"1min":2.5990000000000002,"5min":3.52,"15min":3.52},"last":0.436},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.628,"15min":0.52600000000000002},"min":{"1min":0.30399999999999999,"5min":0.245,"15min":0.245},"max":{"1min":4.0110000000000001,"5min":4.0110000000000001,"15min":4.0110000000000001},"last":0.501}]},{"osd":5,"last update":"Mon Feb 19 21:38:22 2024","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":0.67500000000000004,"15min":0.67100000000000004},"min":{"1min":0.29499999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":4.9859999999999998,"5min":4.9859999999999998,"15min":4.9859999999999998},"last":1.026},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.68400000000000005,"15min":0.54600000000000004},"min":{"1min":0.34599999999999997,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":2.641,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":0.46800000000000003}]},{"osd":6,"last update":"Mon Feb 19 21:38:22 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.67900000000000005,"15min":0.57299999999999995},"min":{"1min":0.36699999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":2.6739999999999999,"5min":3.6099999999999999,"15min":3.6099999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.68500000000000005,"15min":0.86099999999999999},"min":{"1min":0.33600000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":3.5750000000000002,"5min":3.6800000000000002,"15min":8.8030000000000008},"last":0.52800000000000002}]}]},{"osd":6,"up_from":47,"seq":201863463001,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":471308,"kb_used_data":169604,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93273844,"statfs":{"total":95995035648,"available":95512416256,"internally_reserved":0,"allocated":173674496,"data_stored":173372908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:37:58 2024","interfaces":[{"interface":"back","average":{"1min":1.9830000000000001,"5min":1.1499999999999999,"15min":0.70599999999999996},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":5.7919999999999998,"5min":9.0109999999999992,"15min":9.0109999999999992},"last":1.623},{"interface":"front","average":{"1min":2.6120000000000001,"5min":1.302,"15min":0.752},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":13.973000000000001,"5min":13.973000000000001,"15min":13.973000000000001},"last":4.8140000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:37:58 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.1319999999999999,"15min":0.71099999999999997},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":3.3330000000000002,"5min":12.574999999999999,"15min":12.574999999999999},"last":5.4139999999999997},{"interface":"front","average":{"1min":2.2229999999999999,"5min":1.085,"15min":0.67500000000000004},"min":{"1min":0.35299999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":6.4020000000000001,"5min":6.4020000000000001,"15min":6.4020000000000001},"last":11.19}]},{"osd":2,"last update":"Mon Feb 19 21:37:58 2024","interfaces":[{"interface":"back","average":{"1min":2.1869999999999998,"5min":1.1060000000000001,"15min":0.70399999999999996},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":8.1379999999999999,"5min":8.1379999999999999,"15min":8.1379999999999999},"last":2.7200000000000002},{"interface":"front","average":{"1min":2.0059999999999998,"5min":1.198,"15min":0.70999999999999996},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":5.782,"5min":18.068000000000001,"15min":18.068000000000001},"last":0.83199999999999996}]},{"osd":3,"last update":"Mon Feb 19 21:37:58 2024","interfaces":[{"interface":"back","average":{"1min":2.3370000000000002,"5min":1.321,"15min":0.77700000000000002},"min":{"1min":0.28999999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":8.2949999999999999,"5min":8.9890000000000008,"15min":8.9890000000000008},"last":1.6439999999999999},{"interface":"front","average":{"1min":2.7290000000000001,"5min":1.4139999999999999,"15min":0.79500000000000004},"min":{"1min":0.33700000000000002,"5min":0.246,"15min":0.246},"max":{"1min":19.632999999999999,"5min":19.632999999999999,"15min":19.632999999999999},"last":4.3680000000000003}]},{"osd":4,"last update":"Mon Feb 19 21:37:58 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.61399999999999999,"15min":0.45700000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":4.0359999999999996,"5min":4.0359999999999996,"15min":4.0359999999999996},"last":4.8520000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.57399999999999995,"15min":0.46000000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":2.9180000000000001,"5min":2.9180000000000001,"15min":2.9180000000000001},"last":1.4199999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:37:58 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":0.63700000000000001,"15min":0.48799999999999999},"min":{"1min":0.27700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":5.6379999999999999,"5min":5.6379999999999999,"15min":5.6379999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":1.1870000000000001,"5min":0.68700000000000006,"15min":0.496},"min":{"1min":0.318,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":5.8479999999999999,"5min":5.8479999999999999,"15min":5.8479999999999999},"last":1.5369999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:38:27 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.68700000000000006,"15min":0.54800000000000004},"min":{"1min":0.28799999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.8150000000000004,"5min":5.8150000000000004,"15min":5.8150000000000004},"last":1.5800000000000001},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.76000000000000001,"15min":0.61599999999999999},"min":{"1min":0.35799999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":5.8300000000000001,"5min":5.8300000000000001,"15min":5.8300000000000001},"last":1.601}]}]},{"osd":1,"up_from":13,"seq":55834574963,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":524396,"kb_used_data":214884,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93220756,"statfs":{"total":95995035648,"available":95458054144,"internally_reserved":0,"allocated":220041216,"data_stored":219708362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:38:50 2024","interfaces":[{"interface":"back","average":{"1min":5.5999999999999996,"5min":2.395,"15min":1.03},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":42.776000000000003,"5min":42.776000000000003,"15min":42.776000000000003},"last":3.2370000000000001},{"interface":"front","average":{"1min":4.8209999999999997,"5min":2.1520000000000001,"15min":0.94799999999999995},"min":{"1min":0.189,"5min":0.185,"15min":0.185},"max":{"1min":44.845999999999997,"5min":44.845999999999997,"15min":44.845999999999997},"last":4.2830000000000004}]},{"osd":2,"last update":"Mon Feb 19 21:38:21 2024","interfaces":[{"interface":"back","average":{"1min":1.6870000000000001,"5min":1.8080000000000001,"15min":0.84799999999999998},"min":{"1min":0.27300000000000002,"5min":0.22,"15min":0.22},"max":{"1min":5.3049999999999997,"5min":11.826000000000001,"15min":11.826000000000001},"last":3.367},{"interface":"front","average":{"1min":2.7210000000000001,"5min":2.0899999999999999,"15min":0.95999999999999996},"min":{"1min":0.35599999999999998,"5min":0.248,"15min":0.248},"max":{"1min":11.507,"5min":12.26,"15min":12.26},"last":0.375}]},{"osd":3,"last update":"Mon Feb 19 21:38:50 2024","interfaces":[{"interface":"back","average":{"1min":4.5549999999999997,"5min":2.468,"15min":1.1120000000000001},"min":{"1min":0.254,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":41.607999999999997,"5min":41.607999999999997,"15min":41.607999999999997},"last":4.3159999999999998},{"interface":"front","average":{"1min":4.4379999999999997,"5min":2.0179999999999998,"15min":0.95699999999999996},"min":{"1min":0.27300000000000002,"5min":0.217,"15min":0.217},"max":{"1min":42.811999999999998,"5min":42.811999999999998,"15min":42.811999999999998},"last":0.53700000000000003}]},{"osd":4,"last update":"Mon Feb 19 21:38:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.86699999999999999,"15min":0.70199999999999996},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":6.0380000000000003,"5min":7.3330000000000002,"15min":7.3330000000000002},"last":0.627},{"interface":"front","average":{"1min":2.0259999999999998,"5min":1.272,"15min":0.83699999999999997},"min":{"1min":0.33600000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":7.0919999999999996,"5min":10.51,"15min":10.51},"last":0.49099999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:38:36 2024","interfaces":[{"interface":"back","average":{"1min":2.173,"5min":1.3759999999999999,"15min":0.84399999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":7.1289999999999996,"5min":10.458,"15min":10.458},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.7589999999999999,"5min":1.25,"15min":0.81899999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":7.2389999999999999,"5min":7.6950000000000003,"15min":7.6950000000000003},"last":0.41399999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:38:02 2024","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":0.93500000000000005,"15min":0.71799999999999997},"min":{"1min":0.36399999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":5.9939999999999998,"5min":7.375,"15min":7.375},"last":0.59399999999999997},{"interface":"front","average":{"1min":1.337,"5min":1.0980000000000001,"15min":0.78300000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":7.7389999999999999,"5min":7.7389999999999999,"15min":7.7389999999999999},"last":0.56899999999999995}]},{"osd":7,"last update":"Mon Feb 19 21:38:29 2024","interfaces":[{"interface":"back","average":{"1min":1.696,"5min":1.5029999999999999,"15min":0.88700000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":7.2599999999999998,"5min":10.638999999999999,"15min":10.638999999999999},"last":0.439},{"interface":"front","average":{"1min":1.458,"5min":1.1339999999999999,"15min":0.78700000000000003},"min":{"1min":0.41299999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":5.7329999999999997,"5min":7.4109999999999996,"15min":7.4109999999999996},"last":0.64700000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738489,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":559948,"kb_used_data":262724,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93185204,"statfs":{"total":95995035648,"available":95421648896,"internally_reserved":0,"allocated":269029376,"data_stored":268728333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:38:56 2024","interfaces":[{"interface":"back","average":{"1min":2.9769999999999999,"5min":1.607,"15min":0.74299999999999999},"min":{"1min":0.20300000000000001,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":15.381,"5min":15.381,"15min":15.381},"last":0.20300000000000001},{"interface":"front","average":{"1min":2.847,"5min":2.1520000000000001,"15min":0.93899999999999995},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":13.422000000000001,"5min":13.422000000000001,"15min":13.422000000000001},"last":2.2170000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:38:27 2024","interfaces":[{"interface":"back","average":{"1min":3.0289999999999999,"5min":1.653,"15min":0.79800000000000004},"min":{"1min":0.245,"5min":0.245,"15min":0.23999999999999999},"max":{"1min":10.204000000000001,"5min":10.996,"15min":10.996},"last":0.374},{"interface":"front","average":{"1min":2.637,"5min":1.9419999999999999,"15min":0.90100000000000002},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":9.7129999999999992,"5min":12.154999999999999,"15min":12.154999999999999},"last":2.25}]},{"osd":3,"last update":"Mon Feb 19 21:38:39 2024","interfaces":[{"interface":"back","average":{"1min":3.6899999999999999,"5min":2.4449999999999998,"15min":1.0880000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":13.776,"5min":14.507999999999999,"15min":14.507999999999999},"last":1.8220000000000001},{"interface":"front","average":{"1min":4.7549999999999999,"5min":2.3969999999999998,"15min":1.0960000000000001},"min":{"1min":0.316,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":18.759,"5min":18.759,"15min":18.759},"last":3.0950000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:38:14 2024","interfaces":[{"interface":"back","average":{"1min":2.363,"5min":1.232,"15min":0.80300000000000005},"min":{"1min":0.29799999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":9.8140000000000001,"5min":9.8140000000000001,"15min":9.8140000000000001},"last":3.6579999999999999},{"interface":"front","average":{"1min":1.8360000000000001,"5min":1.089,"15min":0.77200000000000002},"min":{"1min":0.317,"5min":0.255,"15min":0.255},"max":{"1min":8.9450000000000003,"5min":8.9450000000000003,"15min":8.9450000000000003},"last":0.40899999999999997}]},{"osd":5,"last update":"Mon Feb 19 21:38:39 2024","interfaces":[{"interface":"back","average":{"1min":4.0919999999999996,"5min":1.994,"15min":1.0840000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":42.799999999999997,"5min":42.799999999999997,"15min":42.799999999999997},"last":5.548},{"interface":"front","average":{"1min":4.5190000000000001,"5min":1.819,"15min":1.0269999999999999},"min":{"1min":0.33400000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":42.695,"5min":42.695,"15min":42.695},"last":5.9850000000000003}]},{"osd":6,"last update":"Mon Feb 19 21:37:59 2024","interfaces":[{"interface":"back","average":{"1min":4.1139999999999999,"5min":1.448,"15min":0.91000000000000003},"min":{"1min":0.437,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":42.777000000000001,"5min":42.777000000000001,"15min":42.777000000000001},"last":0.435},{"interface":"front","average":{"1min":2.6030000000000002,"5min":1.3660000000000001,"15min":0.85899999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":9.7629999999999999,"5min":9.7629999999999999,"15min":9.7629999999999999},"last":5.5140000000000002}]},{"osd":7,"last update":"Mon Feb 19 21:38:27 2024","interfaces":[{"interface":"back","average":{"1min":4.5529999999999999,"5min":1.7090000000000001,"15min":0.97299999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":42.758000000000003,"5min":42.758000000000003,"15min":42.758000000000003},"last":2.6150000000000002},{"interface":"front","average":{"1min":3.9119999999999999,"5min":1.653,"15min":0.98499999999999999},"min":{"1min":0.38,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":42.718000000000004,"5min":42.718000000000004,"15min":42.718000000000004},"last":3.125}]}]},{"osd":2,"up_from":18,"seq":77309411438,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":522560,"kb_used_data":217144,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93222592,"statfs":{"total":95995035648,"available":95459934208,"internally_reserved":0,"allocated":222355456,"data_stored":222074187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:38:28 2024","interfaces":[{"interface":"back","average":{"1min":3.4169999999999998,"5min":2.4020000000000001,"15min":1.0349999999999999},"min":{"1min":0.246,"5min":0.183,"15min":0.183},"max":{"1min":8.9179999999999993,"5min":17.853000000000002,"15min":17.853000000000002},"last":2.2879999999999998},{"interface":"front","average":{"1min":2.8439999999999999,"5min":2.3359999999999999,"15min":1.052},"min":{"1min":0.251,"5min":0.215,"15min":0.193},"max":{"1min":8.1859999999999999,"5min":17.847999999999999,"15min":17.847999999999999},"last":7.8819999999999997}]},{"osd":1,"last update":"Mon Feb 19 21:38:28 2024","interfaces":[{"interface":"back","average":{"1min":3.5339999999999998,"5min":1.724,"15min":0.82299999999999995},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20300000000000001},"max":{"1min":11.083,"5min":13.528,"15min":13.528},"last":0.55100000000000005},{"interface":"front","average":{"1min":1.8740000000000001,"5min":1.381,"15min":0.71799999999999997},"min":{"1min":0.20499999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":8.8130000000000006,"5min":18.113,"15min":18.113},"last":0.68799999999999994}]},{"osd":3,"last update":"Mon Feb 19 21:38:51 2024","interfaces":[{"interface":"back","average":{"1min":3.3300000000000001,"5min":2.7839999999999998,"15min":1.1970000000000001},"min":{"1min":0.30499999999999999,"5min":0.185,"15min":0.185},"max":{"1min":14.122999999999999,"5min":19.751000000000001,"15min":19.751000000000001},"last":2.3079999999999998},{"interface":"front","average":{"1min":1.6950000000000001,"5min":1.6539999999999999,"15min":0.82699999999999996},"min":{"1min":0.26900000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":8.7799999999999994,"5min":18.137,"15min":18.137},"last":0.41699999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:38:12 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.93899999999999995,"15min":0.69699999999999995},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":3.6869999999999998,"5min":18.088000000000001,"15min":18.088000000000001},"last":1.1459999999999999},{"interface":"front","average":{"1min":2.2170000000000001,"5min":1.3759999999999999,"15min":0.84499999999999997},"min":{"1min":0.38600000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":7.9489999999999998,"5min":13.369999999999999,"15min":13.369999999999999},"last":2.2120000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:38:32 2024","interfaces":[{"interface":"back","average":{"1min":2.7000000000000002,"5min":1.6160000000000001,"15min":0.94799999999999995},"min":{"1min":0.373,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":7.8760000000000003,"5min":13.470000000000001,"15min":13.470000000000001},"last":2.2650000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.98899999999999999,"15min":0.72199999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.8929999999999998,"5min":18.018999999999998,"15min":18.018999999999998},"last":0.34799999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:38:00 2024","interfaces":[{"interface":"back","average":{"1min":2.194,"5min":1.2749999999999999,"15min":0.80400000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.313},"max":{"1min":6.6900000000000004,"5min":17.888999999999999,"15min":17.888999999999999},"last":7.9189999999999996},{"interface":"front","average":{"1min":2.2029999999999998,"5min":1.3979999999999999,"15min":0.86799999999999999},"min":{"1min":0.40400000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":8.5640000000000001,"5min":13.443,"15min":13.443},"last":2.2440000000000002}]},{"osd":7,"last update":"Mon Feb 19 21:38:28 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.0409999999999999,"15min":0.75600000000000001},"min":{"1min":0.41199999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.7360000000000002,"5min":18.062999999999999,"15min":18.062999999999999},"last":1.7130000000000001},{"interface":"front","average":{"1min":2.8500000000000001,"5min":1.5489999999999999,"15min":0.92200000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":7.4420000000000002,"5min":17.917000000000002,"15min":17.917000000000002},"last":7.8390000000000004}]}]},{"osd":3,"up_from":26,"seq":111669149801,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":639700,"kb_used_data":342412,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93105452,"statfs":{"total":95995035648,"available":95339982848,"internally_reserved":0,"allocated":350629888,"data_stored":350383949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:38:52 2024","interfaces":[{"interface":"back","average":{"1min":2.2080000000000002,"5min":1.9550000000000001,"15min":0.92700000000000005},"min":{"1min":0.20399999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":11.292,"5min":17.992000000000001,"15min":17.992000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":5.3710000000000004,"5min":2.9420000000000002,"15min":1.274},"min":{"1min":0.27900000000000003,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":46.654000000000003,"5min":46.654000000000003,"15min":46.654000000000003},"last":0.41999999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:38:52 2024","interfaces":[{"interface":"back","average":{"1min":1.8600000000000001,"5min":1.4830000000000001,"15min":0.75700000000000001},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":7.8230000000000004,"5min":9.9700000000000006,"15min":9.9700000000000006},"last":0.71299999999999997},{"interface":"front","average":{"1min":2.3260000000000001,"5min":2.1339999999999999,"15min":0.997},"min":{"1min":0.20999999999999999,"5min":0.185,"15min":0.185},"max":{"1min":8.6890000000000001,"5min":13.135999999999999,"15min":13.135999999999999},"last":0.48599999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:38:52 2024","interfaces":[{"interface":"back","average":{"1min":2.286,"5min":1.944,"15min":0.94899999999999995},"min":{"1min":0.26300000000000001,"5min":0.224,"15min":0.224},"max":{"1min":6.1180000000000003,"5min":11.175000000000001,"15min":11.175000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":6.0220000000000002,"5min":2.774,"15min":1.2130000000000001},"min":{"1min":0.42499999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":45.831000000000003,"5min":45.831000000000003,"15min":45.831000000000003},"last":0.27100000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:38:13 2024","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.0649999999999999,"15min":0.74299999999999999},"min":{"1min":0.28199999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":3.6840000000000002,"5min":5.681,"15min":5.681},"last":0.59699999999999998},{"interface":"front","average":{"1min":2.0070000000000001,"5min":1.401,"15min":0.85199999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":5.5960000000000001,"5min":11.093,"15min":11.093},"last":0.432}]},{"osd":5,"last update":"Mon Feb 19 21:38:32 2024","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.1499999999999999,"15min":0.76400000000000001},"min":{"1min":0.28699999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":3.468,"5min":5.577,"15min":5.577},"last":0.56000000000000005},{"interface":"front","average":{"1min":2.3210000000000002,"5min":1.536,"15min":0.89700000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":9.2579999999999991,"5min":11.128,"15min":11.128},"last":0.46200000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:38:01 2024","interfaces":[{"interface":"back","average":{"1min":2.4140000000000001,"5min":1.2270000000000001,"15min":0.78600000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":17.443999999999999,"5min":17.443999999999999,"15min":17.443999999999999},"last":0.622},{"interface":"front","average":{"1min":3.4449999999999998,"5min":1.5169999999999999,"15min":0.89900000000000002},"min":{"1min":0.34200000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":18.219000000000001,"5min":18.219000000000001,"15min":18.219000000000001},"last":0.50900000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:38:24 2024","interfaces":[{"interface":"back","average":{"1min":4.2350000000000003,"5min":2.0960000000000001,"15min":1.0589999999999999},"min":{"1min":0.36399999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":45.777999999999999,"5min":45.777999999999999,"15min":45.777999999999999},"last":6.1470000000000002},{"interface":"front","average":{"1min":1.556,"5min":1.1639999999999999,"15min":0.77000000000000002},"min":{"1min":0.39600000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":3.7410000000000001,"5min":5.6040000000000001,"15min":5.6040000000000001},"last":0.745}]}]},{"osd":4,"up_from":32,"seq":137438953570,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":493320,"kb_used_data":192000,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93251832,"statfs":{"total":95995035648,"available":95489875968,"internally_reserved":0,"allocated":196608000,"data_stored":196317971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:38:09 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":0.95499999999999996,"15min":0.66200000000000003},"min":{"1min":0.23699999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":7.1509999999999998,"5min":7.2489999999999997,"15min":7.2489999999999997},"last":6.9180000000000001},{"interface":"front","average":{"1min":1.49,"5min":1.286,"15min":0.78800000000000003},"min":{"1min":0.26300000000000001,"5min":0.252,"15min":0.252},"max":{"1min":5.4779999999999998,"5min":11.960000000000001,"15min":11.960000000000001},"last":4.3129999999999997}]},{"osd":1,"last update":"Mon Feb 19 21:38:09 2024","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":0.78700000000000003,"15min":0.622},"min":{"1min":0.27300000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":8.8379999999999992,"5min":8.8379999999999992,"15min":8.8379999999999992},"last":2.5459999999999998},{"interface":"front","average":{"1min":2.008,"5min":0.97899999999999998,"15min":0.69999999999999996},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":15.411,"5min":15.411,"15min":15.411},"last":4.4669999999999996}]},{"osd":2,"last update":"Mon Feb 19 21:38:09 2024","interfaces":[{"interface":"back","average":{"1min":1.7809999999999999,"5min":1.0009999999999999,"15min":0.70099999999999996},"min":{"1min":0.38200000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":5.8079999999999998,"5min":6.7300000000000004,"15min":6.7300000000000004},"last":4.0099999999999998},{"interface":"front","average":{"1min":2.9870000000000001,"5min":1.5669999999999999,"15min":0.88},"min":{"1min":0.28499999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":14.843999999999999,"5min":20.995999999999999,"15min":20.995999999999999},"last":0.34200000000000003}]},{"osd":3,"last update":"Mon Feb 19 21:38:09 2024","interfaces":[{"interface":"back","average":{"1min":2.9550000000000001,"5min":1.2869999999999999,"15min":0.79200000000000004},"min":{"1min":0.33900000000000002,"5min":0.316,"15min":0.316},"max":{"1min":15.914999999999999,"5min":15.914999999999999,"15min":15.914999999999999},"last":6.0449999999999999},{"interface":"front","average":{"1min":1.238,"5min":0.97899999999999998,"15min":0.69099999999999995},"min":{"1min":0.32600000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":2.6680000000000001,"5min":5.9420000000000002,"15min":5.9420000000000002},"last":3.0030000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:38:45 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":0.67300000000000004,"15min":0.48899999999999999},"min":{"1min":0.28799999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":9.2289999999999992,"5min":9.2289999999999992,"15min":9.2289999999999992},"last":3.1179999999999999},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.628,"15min":0.47999999999999998},"min":{"1min":0.316,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":3.5049999999999999,"5min":3.5049999999999999,"15min":3.5049999999999999},"last":0.36799999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:38:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.58799999999999997,"15min":0.48599999999999999},"min":{"1min":0.30399999999999999,"5min":0.30199999999999999,"15min":0.29999999999999999},"max":{"1min":2.6890000000000001,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":6.1180000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.58299999999999996,"15min":0.495},"min":{"1min":0.317,"5min":0.29799999999999999,"15min":0.27700000000000002},"max":{"1min":2.9620000000000002,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":2.1419999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:38:23 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.623,"15min":0.55300000000000005},"min":{"1min":0.32800000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":2.984,"5min":2.984,"15min":2.984},"last":2.1709999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.64700000000000002,"15min":0.56399999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":3.5299999999999998,"5min":3.5299999999999998,"15min":3.5299999999999998},"last":6.0110000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757342,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":476016,"kb_used_data":174696,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93269136,"statfs":{"total":95995035648,"available":95507595264,"internally_reserved":0,"allocated":178888704,"data_stored":178615370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:38:39 2024","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4590000000000001,"15min":0.85299999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":3.6190000000000002,"5min":20.550999999999998,"15min":20.550999999999998},"last":2.4540000000000002},{"interface":"front","average":{"1min":1.6719999999999999,"5min":1.302,"15min":0.81000000000000005},"min":{"1min":0.27400000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":8.452,"5min":20.879000000000001,"15min":20.879000000000001},"last":7.1360000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:38:39 2024","interfaces":[{"interface":"back","average":{"1min":1.651,"5min":1.0720000000000001,"15min":0.72799999999999998},"min":{"1min":0.27200000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":8.5640000000000001,"5min":8.5640000000000001,"15min":8.5640000000000001},"last":7.1580000000000004},{"interface":"front","average":{"1min":2.4940000000000002,"5min":1.5089999999999999,"15min":0.85699999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":9.5679999999999996,"5min":10.316000000000001,"15min":10.316000000000001},"last":0.28899999999999998}]},{"osd":2,"last update":"Mon Feb 19 21:38:39 2024","interfaces":[{"interface":"back","average":{"1min":2.3029999999999999,"5min":1.6120000000000001,"15min":0.89700000000000002},"min":{"1min":0.34200000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":6.2670000000000003,"5min":20.186,"15min":20.186},"last":0.35699999999999998},{"interface":"front","average":{"1min":1.915,"5min":1.498,"15min":0.86799999999999999},"min":{"1min":0.33200000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":8.5139999999999993,"5min":20.175000000000001,"15min":20.175000000000001},"last":7.3109999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:38:39 2024","interfaces":[{"interface":"back","average":{"1min":2.0510000000000002,"5min":1.7709999999999999,"15min":0.96899999999999997},"min":{"1min":0.36399999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":6.3010000000000002,"5min":20.146999999999998,"15min":20.146999999999998},"last":4.1319999999999997},{"interface":"front","average":{"1min":2.3980000000000001,"5min":1.913,"15min":1.0489999999999999},"min":{"1min":0.377,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":8.4879999999999995,"5min":20.120000000000001,"15min":20.120000000000001},"last":8.7710000000000008}]},{"osd":4,"last update":"Mon Feb 19 21:38:39 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.55600000000000005,"15min":0.45400000000000001},"min":{"1min":0.24399999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":2.6499999999999999,"5min":6.4610000000000003,"15min":6.4610000000000003},"last":1.8799999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.67000000000000004,"15min":0.497},"min":{"1min":0.26300000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":6.4119999999999999,"5min":6.4740000000000002,"15min":6.4740000000000002},"last":0.376}]},{"osd":6,"last update":"Mon Feb 19 21:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.60499999999999998,"15min":0.49099999999999999},"min":{"1min":0.30199999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":5.1689999999999996,"5min":5.1689999999999996,"15min":5.1689999999999996},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.68200000000000005,"15min":0.51200000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":6.6050000000000004,"5min":6.6050000000000004,"15min":6.6050000000000004},"last":7.1059999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:38:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":0.68100000000000005,"15min":0.59899999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":6.5650000000000004,"5min":6.5650000000000004,"15min":6.5650000000000004},"last":7.0709999999999997},{"interface":"front","average":{"1min":1.2490000000000001,"5min":0.68899999999999995,"15min":0.57799999999999996},"min":{"1min":0.33300000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":6.4930000000000003,"5min":6.4930000000000003,"15min":6.4930000000000003},"last":0.34899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":2448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":242421760,"data_stored":242417688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":201789440,"data_stored":201785368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":211419136,"data_stored":211419136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":324403200,"data_stored":324403200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":191299584,"data_stored":191299584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":162791424,"data_stored":162791424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":159977472,"data_stored":159973400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":157089792,"data_stored":157089792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:39:08.058 INFO:tasks.thrashosds.thrasher:Setting 6.c to [5, 0, 2] 2024-02-19T21:39:08.058 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '6.c', '5', '0', '2'] 2024-02-19T21:39:08.058 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pg-upmap 6.c 5 0 2 2024-02-19T21:39:08.068 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:39:08.072 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:08.072 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:39:08.092 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:39:08.173 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:39:08.187 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:39:08.244 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:08.318 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:06.940971+0000 mgr.y (mgr.14514) 257 : cluster [DBG] pgmap v273: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 215 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.12k op/s; 520/10887 objects misplaced (4.776%); 3.1 MiB/s, 48 objects/s recovering 2024-02-19T21:39:08.318 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:07.665450+0000 osd.6 (osd.6) 92 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:39:08.318 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:07.665504+0000 osd.6 (osd.6) 93 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:39:08.388 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:39:08.459 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:39:08.464 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:08.465 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:39:08.566 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:39:08.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:06.940971+0000 mgr.y (mgr.14514) 257 : cluster [DBG] pgmap v273: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 215 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.12k op/s; 520/10887 objects misplaced (4.776%); 3.1 MiB/s, 48 objects/s recovering 2024-02-19T21:39:08.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:07.665450+0000 osd.6 (osd.6) 92 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:39:08.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:07.665504+0000 osd.6 (osd.6) 93 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:39:08.607 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:06.940971+0000 mgr.y (mgr.14514) 257 : cluster [DBG] pgmap v273: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 215 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.12k op/s; 520/10887 objects misplaced (4.776%); 3.1 MiB/s, 48 objects/s recovering 2024-02-19T21:39:08.607 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:07.665450+0000 osd.6 (osd.6) 92 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:39:08.607 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:07.665504+0000 osd.6 (osd.6) 93 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:39:08.610 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:08.637 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:39:08.639 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:08.640 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:39:08.741 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:39:08.773 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:08.805 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:39:08.816 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:08.816 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:39:08.917 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:39:08.985 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:09.240 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Removed 114731 objects 2024-02-19T21:39:09.240 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Clean up completed and total clean up time :130.033 2024-02-19T21:39:09.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:08.301226+0000 mon.a (mon.0) 935 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2024-02-19T21:39:09.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:08.301226+0000 mon.a (mon.0) 935 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2024-02-19T21:39:09.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:08.301226+0000 mon.a (mon.0) 935 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2024-02-19T21:39:10.557 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:39:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:39:10.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:08.942463+0000 mgr.y (mgr.14514) 258 : cluster [DBG] pgmap v275: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 215 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 714 op/s; 520/10887 objects misplaced (4.776%); 2.1 MiB/s, 33 objects/s recovering 2024-02-19T21:39:10.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:09.318368+0000 mon.a (mon.0) 936 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2024-02-19T21:39:10.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:08.942463+0000 mgr.y (mgr.14514) 258 : cluster [DBG] pgmap v275: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 215 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 714 op/s; 520/10887 objects misplaced (4.776%); 2.1 MiB/s, 33 objects/s recovering 2024-02-19T21:39:10.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:09.318368+0000 mon.a (mon.0) 936 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2024-02-19T21:39:10.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:08.942463+0000 mgr.y (mgr.14514) 258 : cluster [DBG] pgmap v275: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 215 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 714 op/s; 520/10887 objects misplaced (4.776%); 2.1 MiB/s, 33 objects/s recovering 2024-02-19T21:39:10.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:09.318368+0000 mon.a (mon.0) 936 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2024-02-19T21:39:11.097 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:39:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:39:10] "GET /metrics HTTP/1.1" 200 175629 "" "Prometheus/2.33.4" 2024-02-19T21:39:11.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:10.154270+0000 mgr.y (mgr.14514) 259 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:39:11.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:10.322498+0000 mon.a (mon.0) 937 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2024-02-19T21:39:11.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:10.154270+0000 mgr.y (mgr.14514) 259 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:39:11.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:10.322498+0000 mon.a (mon.0) 937 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2024-02-19T21:39:11.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:10.154270+0000 mgr.y (mgr.14514) 259 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:39:11.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:10.322498+0000 mon.a (mon.0) 937 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2024-02-19T21:39:12.545 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:39:12.549 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:12.549 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:39:12.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:10.942943+0000 mgr.y (mgr.14514) 260 : cluster [DBG] pgmap v278: 148 pgs: 4 peering, 144 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 902 B/s rd, 0 B/s wr, 606 op/s; 2.0 MiB/s, 31 objects/s recovering 2024-02-19T21:39:12.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:10.942943+0000 mgr.y (mgr.14514) 260 : cluster [DBG] pgmap v278: 148 pgs: 4 peering, 144 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 902 B/s rd, 0 B/s wr, 606 op/s; 2.0 MiB/s, 31 objects/s recovering 2024-02-19T21:39:12.650 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:39:12.680 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:10.942943+0000 mgr.y (mgr.14514) 260 : cluster [DBG] pgmap v278: 148 pgs: 4 peering, 144 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 902 B/s rd, 0 B/s wr, 606 op/s; 2.0 MiB/s, 31 objects/s recovering 2024-02-19T21:39:12.682 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:12.704 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:39:12.706 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:12.707 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:39:12.807 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:39:12.842 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:14.532 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_0 2024-02-19T21:39:14.532 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-02-19T21:39:14.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:12.943513+0000 mgr.y (mgr.14514) 261 : cluster [DBG] pgmap v279: 148 pgs: 4 peering, 144 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 573 op/s; 1.9 MiB/s, 30 objects/s recovering 2024-02-19T21:39:14.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:12.943513+0000 mgr.y (mgr.14514) 261 : cluster [DBG] pgmap v279: 148 pgs: 4 peering, 144 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 573 op/s; 1.9 MiB/s, 30 objects/s recovering 2024-02-19T21:39:14.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:12.943513+0000 mgr.y (mgr.14514) 261 : cluster [DBG] pgmap v279: 148 pgs: 4 peering, 144 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 573 op/s; 1.9 MiB/s, 30 objects/s recovering 2024-02-19T21:39:16.057 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:39:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:39:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:39:16.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:14.944292+0000 mgr.y (mgr.14514) 262 : cluster [DBG] pgmap v280: 148 pgs: 148 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 518 op/s; 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:39:16.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:14.944292+0000 mgr.y (mgr.14514) 262 : cluster [DBG] pgmap v280: 148 pgs: 148 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 518 op/s; 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:39:16.798 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:39:16.801 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:16.802 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:39:16.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:14.944292+0000 mgr.y (mgr.14514) 262 : cluster [DBG] pgmap v280: 148 pgs: 148 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 518 op/s; 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:39:16.902 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:39:16.934 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:16.956 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:39:16.959 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:16.960 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:39:17.060 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:39:17.091 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:17.111 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:39:17.114 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:17.114 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:39:17.215 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:39:17.248 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:17.280 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:39:17.284 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:17.285 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:39:17.330 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:39:17.333 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:39:17.333 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:39:17.386 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:39:17.412 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:18.450 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:16.944805+0000 mgr.y (mgr.14514) 263 : cluster [DBG] pgmap v281: 148 pgs: 148 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 430 op/s; 1.4 MiB/s, 22 objects/s recovering 2024-02-19T21:39:18.450 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:17.068843+0000 osd.7 (osd.7) 107 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:39:18.450 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:17.068938+0000 osd.7 (osd.7) 108 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:39:18.450 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:17.354733+0000 mon.a (mon.0) 938 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2024-02-19T21:39:18.450 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:17.441599+0000 osd.0 (osd.0) 129 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:39:18.450 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:17.441674+0000 osd.0 (osd.0) 130 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:39:18.450 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:16.944805+0000 mgr.y (mgr.14514) 263 : cluster [DBG] pgmap v281: 148 pgs: 148 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 430 op/s; 1.4 MiB/s, 22 objects/s recovering 2024-02-19T21:39:18.450 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:17.068843+0000 osd.7 (osd.7) 107 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:39:18.450 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:17.068938+0000 osd.7 (osd.7) 108 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:39:18.451 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:17.354733+0000 mon.a (mon.0) 938 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2024-02-19T21:39:18.451 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:17.441599+0000 osd.0 (osd.0) 129 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:39:18.451 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:17.441674+0000 osd.0 (osd.0) 130 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:39:18.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:16.944805+0000 mgr.y (mgr.14514) 263 : cluster [DBG] pgmap v281: 148 pgs: 148 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 430 op/s; 1.4 MiB/s, 22 objects/s recovering 2024-02-19T21:39:18.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:17.068843+0000 osd.7 (osd.7) 107 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:39:18.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:17.068938+0000 osd.7 (osd.7) 108 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:39:18.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:17.354733+0000 mon.a (mon.0) 938 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2024-02-19T21:39:18.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:17.441599+0000 osd.0 (osd.0) 129 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:39:18.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:17.441674+0000 osd.0 (osd.0) 130 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:39:19.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:18.359202+0000 mon.a (mon.0) 939 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2024-02-19T21:39:19.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:18.943633+0000 mon.a (mon.0) 940 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:39:19.807 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:18.359202+0000 mon.a (mon.0) 939 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2024-02-19T21:39:19.807 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:18.943633+0000 mon.a (mon.0) 940 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:39:19.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:18.359202+0000 mon.a (mon.0) 939 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2024-02-19T21:39:19.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:18.943633+0000 mon.a (mon.0) 940 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:39:20.557 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:39:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:39:20.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:18.946640+0000 mgr.y (mgr.14514) 264 : cluster [DBG] pgmap v284: 148 pgs: 148 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:39:20.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:19.465882+0000 mon.a (mon.0) 941 : audit [INF] from='client.? 172.21.15.80:0/1879943614' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:39:20.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:18.946640+0000 mgr.y (mgr.14514) 264 : cluster [DBG] pgmap v284: 148 pgs: 148 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:39:20.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:19.465882+0000 mon.a (mon.0) 941 : audit [INF] from='client.? 172.21.15.80:0/1879943614' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:39:20.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:18.946640+0000 mgr.y (mgr.14514) 264 : cluster [DBG] pgmap v284: 148 pgs: 148 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:39:20.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:19.465882+0000 mon.a (mon.0) 941 : audit [INF] from='client.? 172.21.15.80:0/1879943614' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:39:20.646 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:39:20.646 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-02-19T21:39:20.646 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-02-19T21:39:20.647 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:39:21.097 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:39:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:39:20] "GET /metrics HTTP/1.1" 200 175608 "" "Prometheus/2.33.4" 2024-02-19T21:39:21.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:20.156254+0000 mgr.y (mgr.14514) 265 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:39:21.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:20.358829+0000 mon.a (mon.0) 942 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:39:21.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:20.370451+0000 mon.a (mon.0) 943 : audit [INF] from='client.? 172.21.15.80:0/1879943614' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:39:21.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:20.370496+0000 mon.a (mon.0) 944 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2024-02-19T21:39:21.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:20.156254+0000 mgr.y (mgr.14514) 265 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:39:21.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:20.358829+0000 mon.a (mon.0) 942 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:39:21.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:20.370451+0000 mon.a (mon.0) 943 : audit [INF] from='client.? 172.21.15.80:0/1879943614' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:39:21.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:20.370496+0000 mon.a (mon.0) 944 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2024-02-19T21:39:21.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:20.156254+0000 mgr.y (mgr.14514) 265 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:39:21.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:20.358829+0000 mon.a (mon.0) 942 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:39:21.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:20.370451+0000 mon.a (mon.0) 943 : audit [INF] from='client.? 172.21.15.80:0/1879943614' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:39:21.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:20.370496+0000 mon.a (mon.0) 944 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2024-02-19T21:39:22.195 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:39:22.202 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:22.202 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:39:22.303 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:39:22.335 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:22.454 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-02-19T21:39:22.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:20.947005+0000 mgr.y (mgr.14514) 266 : cluster [DBG] pgmap v286: 148 pgs: 148 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-19T21:39:22.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:21.124676+0000 osd.1 (osd.1) 109 : cluster [DBG] 4.1d scrub starts 2024-02-19T21:39:22.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:21.126558+0000 osd.1 (osd.1) 110 : cluster [DBG] 4.1d scrub ok 2024-02-19T21:39:22.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:20.947005+0000 mgr.y (mgr.14514) 266 : cluster [DBG] pgmap v286: 148 pgs: 148 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-19T21:39:22.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:21.124676+0000 osd.1 (osd.1) 109 : cluster [DBG] 4.1d scrub starts 2024-02-19T21:39:22.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:21.126558+0000 osd.1 (osd.1) 110 : cluster [DBG] 4.1d scrub ok 2024-02-19T21:39:22.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:20.947005+0000 mgr.y (mgr.14514) 266 : cluster [DBG] pgmap v286: 148 pgs: 148 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-19T21:39:22.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:21.124676+0000 osd.1 (osd.1) 109 : cluster [DBG] 4.1d scrub starts 2024-02-19T21:39:22.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:21.126558+0000 osd.1 (osd.1) 110 : cluster [DBG] 4.1d scrub ok 2024-02-19T21:39:23.373 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:22.216188+0000 osd.2 (osd.2) 107 : cluster [DBG] 5.a scrub starts 2024-02-19T21:39:23.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:22.219306+0000 osd.2 (osd.2) 108 : cluster [DBG] 5.a scrub ok 2024-02-19T21:39:23.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:22.618129+0000 mon.a (mon.0) 945 : audit [INF] from='client.? 172.21.15.80:0/1172743038' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "6.c", "id": [5, 0, 2]}]: dispatch 2024-02-19T21:39:23.391 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:39:23.393 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:23.394 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:39:23.495 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:39:23.527 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:23.550 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:39:23.553 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:23.553 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:39:23.654 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:39:23.681 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:22.216188+0000 osd.2 (osd.2) 107 : cluster [DBG] 5.a scrub starts 2024-02-19T21:39:23.681 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:22.219306+0000 osd.2 (osd.2) 108 : cluster [DBG] 5.a scrub ok 2024-02-19T21:39:23.681 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:22.618129+0000 mon.a (mon.0) 945 : audit [INF] from='client.? 172.21.15.80:0/1172743038' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "6.c", "id": [5, 0, 2]}]: dispatch 2024-02-19T21:39:23.683 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:23.704 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:39:23.706 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:23.707 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:39:23.808 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:39:23.835 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:23.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:22.216188+0000 osd.2 (osd.2) 107 : cluster [DBG] 5.a scrub starts 2024-02-19T21:39:23.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:22.219306+0000 osd.2 (osd.2) 108 : cluster [DBG] 5.a scrub ok 2024-02-19T21:39:23.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:22.618129+0000 mon.a (mon.0) 945 : audit [INF] from='client.? 172.21.15.80:0/1172743038' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "6.c", "id": [5, 0, 2]}]: dispatch 2024-02-19T21:39:23.854 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:39:23.856 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:23.857 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:39:23.924 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.1 dump_blocked_ops 2024-02-19T21:39:23.958 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:39:23.986 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:24.005 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:39:24.007 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:24.008 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:39:24.075 INFO:teuthology.orchestra.run.smithi080.stderr:set 6.c pg_upmap mapping to [5,0,2] 2024-02-19T21:39:24.108 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:39:24.136 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:24.333 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:39:24.336 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:24.336 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:39:24.437 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:39:24.464 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:24.490 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:39:24.493 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:24.493 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:39:24.594 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:39:24.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:22.947564+0000 mgr.y (mgr.14514) 267 : cluster [DBG] pgmap v287: 148 pgs: 148 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-19T21:39:24.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:23.257969+0000 osd.0 (osd.0) 131 : cluster [DBG] 6.13 scrub starts 2024-02-19T21:39:24.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:23.270245+0000 osd.0 (osd.0) 132 : cluster [DBG] 6.13 scrub ok 2024-02-19T21:39:24.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:23.384470+0000 mon.a (mon.0) 946 : audit [INF] from='client.? 172.21.15.80:0/1172743038' entity='client.admin' cmd='[{"prefix": "osd pg-upmap", "pgid": "6.c", "id": [5, 0, 2]}]': finished 2024-02-19T21:39:24.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:23.384537+0000 mon.a (mon.0) 947 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2024-02-19T21:39:24.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:23.544903+0000 osd.4 (osd.4) 101 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:39:24.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:23.552245+0000 osd.4 (osd.4) 102 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:39:24.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:22.947564+0000 mgr.y (mgr.14514) 267 : cluster [DBG] pgmap v287: 148 pgs: 148 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-19T21:39:24.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:23.257969+0000 osd.0 (osd.0) 131 : cluster [DBG] 6.13 scrub starts 2024-02-19T21:39:24.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:23.270245+0000 osd.0 (osd.0) 132 : cluster [DBG] 6.13 scrub ok 2024-02-19T21:39:24.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:23.384470+0000 mon.a (mon.0) 946 : audit [INF] from='client.? 172.21.15.80:0/1172743038' entity='client.admin' cmd='[{"prefix": "osd pg-upmap", "pgid": "6.c", "id": [5, 0, 2]}]': finished 2024-02-19T21:39:24.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:23.384537+0000 mon.a (mon.0) 947 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2024-02-19T21:39:24.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:23.544903+0000 osd.4 (osd.4) 101 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:39:24.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:23.552245+0000 osd.4 (osd.4) 102 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:39:24.621 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:24.677 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:39:24.679 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:24.680 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:39:24.781 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:39:24.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:22.947564+0000 mgr.y (mgr.14514) 267 : cluster [DBG] pgmap v287: 148 pgs: 148 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-19T21:39:24.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:23.257969+0000 osd.0 (osd.0) 131 : cluster [DBG] 6.13 scrub starts 2024-02-19T21:39:24.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:23.270245+0000 osd.0 (osd.0) 132 : cluster [DBG] 6.13 scrub ok 2024-02-19T21:39:24.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:23.384470+0000 mon.a (mon.0) 946 : audit [INF] from='client.? 172.21.15.80:0/1172743038' entity='client.admin' cmd='[{"prefix": "osd pg-upmap", "pgid": "6.c", "id": [5, 0, 2]}]': finished 2024-02-19T21:39:24.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:23.384537+0000 mon.a (mon.0) 947 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2024-02-19T21:39:24.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:23.544903+0000 osd.4 (osd.4) 101 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:39:24.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:23.552245+0000 osd.4 (osd.4) 102 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:39:24.813 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:24.834 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:39:24.836 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:24.836 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:39:24.937 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:39:24.967 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:24.987 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:39:24.989 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:24.990 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:39:25.092 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:39:25.119 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:25.139 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:39:25.140 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:25.141 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:39:25.141 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-19T21:39:25.243 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:39:25.269 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:25.289 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:39:25.292 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:25.293 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:39:25.394 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:39:25.428 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:25.440 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'unique_pool_0' removed 2024-02-19T21:39:25.443 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:24.009843+0000 osd.7 (osd.7) 109 : cluster [DBG] 4.17 scrub starts 2024-02-19T21:39:25.443 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:24.011484+0000 osd.7 (osd.7) 110 : cluster [DBG] 4.17 scrub ok 2024-02-19T21:39:25.443 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:24.383154+0000 mon.a (mon.0) 948 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2024-02-19T21:39:25.443 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:24.520550+0000 osd.4 (osd.4) 103 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:39:25.443 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:24.526387+0000 osd.4 (osd.4) 104 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:39:25.443 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:24.786292+0000 mon.c (mon.2) 37 : audit [INF] from='client.? 172.21.15.80:0/1994248170' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T21:39:25.443 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:24.786604+0000 mon.a (mon.0) 949 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T21:39:25.444 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:24.009843+0000 osd.7 (osd.7) 109 : cluster [DBG] 4.17 scrub starts 2024-02-19T21:39:25.444 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:24.011484+0000 osd.7 (osd.7) 110 : cluster [DBG] 4.17 scrub ok 2024-02-19T21:39:25.444 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:24.383154+0000 mon.a (mon.0) 948 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2024-02-19T21:39:25.444 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:24.520550+0000 osd.4 (osd.4) 103 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:39:25.444 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:24.526387+0000 osd.4 (osd.4) 104 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:39:25.444 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:24.786292+0000 mon.c (mon.2) 37 : audit [INF] from='client.? 172.21.15.80:0/1994248170' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T21:39:25.444 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:24.786604+0000 mon.a (mon.0) 949 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T21:39:25.452 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:39:25.455 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:25.456 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:39:25.557 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:39:25.583 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:25.807 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:39:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:39:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:39:25.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:24.009843+0000 osd.7 (osd.7) 109 : cluster [DBG] 4.17 scrub starts 2024-02-19T21:39:25.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:24.011484+0000 osd.7 (osd.7) 110 : cluster [DBG] 4.17 scrub ok 2024-02-19T21:39:25.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:24.383154+0000 mon.a (mon.0) 948 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2024-02-19T21:39:25.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:24.520550+0000 osd.4 (osd.4) 103 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:39:25.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:24.526387+0000 osd.4 (osd.4) 104 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:39:25.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:24.786292+0000 mon.c (mon.2) 37 : audit [INF] from='client.? 172.21.15.80:0/1994248170' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T21:39:25.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:24.786604+0000 mon.a (mon.0) 949 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T21:39:25.831 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:39:25.834 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:25.834 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:39:25.935 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:39:25.962 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:26.085 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:39:26.089 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:26.089 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:39:26.190 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:39:26.216 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:26.235 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:39:26.237 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:26.237 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:39:26.338 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:39:26.364 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:26.382 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:39:26.384 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:26.385 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:39:26.485 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:39:26.512 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:26.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:24.948316+0000 mgr.y (mgr.14514) 268 : cluster [DBG] pgmap v290: 148 pgs: 1 activating, 147 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-19T21:39:26.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:25.283968+0000 osd.3 (osd.3) 133 : cluster [DBG] 7.3 scrub starts 2024-02-19T21:39:26.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:25.299210+0000 osd.3 (osd.3) 134 : cluster [DBG] 7.3 scrub ok 2024-02-19T21:39:26.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:25.386357+0000 mon.a (mon.0) 950 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-02-19T21:39:26.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:25.395522+0000 mon.a (mon.0) 951 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]': finished 2024-02-19T21:39:26.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:25.395589+0000 mon.a (mon.0) 952 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2024-02-19T21:39:26.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:25.550795+0000 osd.4 (osd.4) 105 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:39:26.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:25.554879+0000 osd.4 (osd.4) 106 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:39:26.670 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:24.948316+0000 mgr.y (mgr.14514) 268 : cluster [DBG] pgmap v290: 148 pgs: 1 activating, 147 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-19T21:39:26.670 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:25.283968+0000 osd.3 (osd.3) 133 : cluster [DBG] 7.3 scrub starts 2024-02-19T21:39:26.671 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:25.299210+0000 osd.3 (osd.3) 134 : cluster [DBG] 7.3 scrub ok 2024-02-19T21:39:26.671 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:25.386357+0000 mon.a (mon.0) 950 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-02-19T21:39:26.671 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:25.395522+0000 mon.a (mon.0) 951 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]': finished 2024-02-19T21:39:26.671 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:25.395589+0000 mon.a (mon.0) 952 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2024-02-19T21:39:26.671 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:25.550795+0000 osd.4 (osd.4) 105 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:39:26.671 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:25.554879+0000 osd.4 (osd.4) 106 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:39:26.671 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:24.948316+0000 mgr.y (mgr.14514) 268 : cluster [DBG] pgmap v290: 148 pgs: 1 activating, 147 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-19T21:39:26.671 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:25.283968+0000 osd.3 (osd.3) 133 : cluster [DBG] 7.3 scrub starts 2024-02-19T21:39:26.671 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:25.299210+0000 osd.3 (osd.3) 134 : cluster [DBG] 7.3 scrub ok 2024-02-19T21:39:26.671 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:25.386357+0000 mon.a (mon.0) 950 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-02-19T21:39:26.671 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:25.395522+0000 mon.a (mon.0) 951 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]': finished 2024-02-19T21:39:26.672 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:25.395589+0000 mon.a (mon.0) 952 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2024-02-19T21:39:26.672 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:25.550795+0000 osd.4 (osd.4) 105 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:39:26.672 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:25.554879+0000 osd.4 (osd.4) 106 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:39:26.672 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:39:26.693 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-02-19T21:39:26.694 INFO:tasks.radosbench:Beginning radosbench... 2024-02-19T21:39:26.694 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_1 2024-02-19T21:39:26.694 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool create unique_pool_1 16 2024-02-19T21:39:27.460 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:39:27.463 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:27.463 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:39:27.564 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:39:27.589 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:26.294900+0000 osd.0 (osd.0) 133 : cluster [DBG] 6.11 scrub starts 2024-02-19T21:39:27.589 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:26.311522+0000 osd.0 (osd.0) 134 : cluster [DBG] 6.11 scrub ok 2024-02-19T21:39:27.590 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:26.294900+0000 osd.0 (osd.0) 133 : cluster [DBG] 6.11 scrub starts 2024-02-19T21:39:27.590 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:26.311522+0000 osd.0 (osd.0) 134 : cluster [DBG] 6.11 scrub ok 2024-02-19T21:39:27.592 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:27.688 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:39:27.690 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:39:27.692 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:27.693 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:39:27.693 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:39:27.710 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:39:27.726 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:39:27.745 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:39:27.763 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:39:27.780 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:39:27.794 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:39:27.798 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:39:27.800 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:39:27.800 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:39:27.800 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:39:27.800 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:39:27.800 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:39:27.800 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:39:27.800 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:39:27.800 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:39:27.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:26.294900+0000 osd.0 (osd.0) 133 : cluster [DBG] 6.11 scrub starts 2024-02-19T21:39:27.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:26.311522+0000 osd.0 (osd.0) 134 : cluster [DBG] 6.11 scrub ok 2024-02-19T21:39:27.821 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:28.071 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:39:28.073 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:28.073 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:39:28.174 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:39:28.206 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:28.227 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:39:28.230 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:28.230 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:39:28.331 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:39:28.361 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:28.383 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:39:28.385 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:28.386 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:39:28.487 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:39:28.513 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:26.948663+0000 mgr.y (mgr.14514) 269 : cluster [DBG] pgmap v292: 132 pgs: 1 activating, 131 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-19T21:39:28.513 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:27.078760+0000 osd.5 (osd.5) 119 : cluster [DBG] 2.2 scrub starts 2024-02-19T21:39:28.513 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:27.079776+0000 osd.5 (osd.5) 120 : cluster [DBG] 2.2 scrub ok 2024-02-19T21:39:28.513 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:27.257141+0000 osd.3 (osd.3) 135 : cluster [DBG] 6.b scrub starts 2024-02-19T21:39:28.513 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:27.289971+0000 osd.3 (osd.3) 136 : cluster [DBG] 6.b scrub ok 2024-02-19T21:39:28.513 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:27.657001+0000 mon.a (mon.0) 953 : audit [DBG] from='client.? 172.21.15.80:0/3483768006' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:39:28.515 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:28.534 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:39:28.537 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:28.537 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:39:28.638 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:39:28.665 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:26.948663+0000 mgr.y (mgr.14514) 269 : cluster [DBG] pgmap v292: 132 pgs: 1 activating, 131 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-19T21:39:28.665 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:27.078760+0000 osd.5 (osd.5) 119 : cluster [DBG] 2.2 scrub starts 2024-02-19T21:39:28.666 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:27.079776+0000 osd.5 (osd.5) 120 : cluster [DBG] 2.2 scrub ok 2024-02-19T21:39:28.666 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:27.257141+0000 osd.3 (osd.3) 135 : cluster [DBG] 6.b scrub starts 2024-02-19T21:39:28.666 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:27.289971+0000 osd.3 (osd.3) 136 : cluster [DBG] 6.b scrub ok 2024-02-19T21:39:28.666 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:27.657001+0000 mon.a (mon.0) 953 : audit [DBG] from='client.? 172.21.15.80:0/3483768006' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:39:28.666 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:26.948663+0000 mgr.y (mgr.14514) 269 : cluster [DBG] pgmap v292: 132 pgs: 1 activating, 131 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-19T21:39:28.666 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:27.078760+0000 osd.5 (osd.5) 119 : cluster [DBG] 2.2 scrub starts 2024-02-19T21:39:28.666 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:27.079776+0000 osd.5 (osd.5) 120 : cluster [DBG] 2.2 scrub ok 2024-02-19T21:39:28.666 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:27.257141+0000 osd.3 (osd.3) 135 : cluster [DBG] 6.b scrub starts 2024-02-19T21:39:28.666 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:27.289971+0000 osd.3 (osd.3) 136 : cluster [DBG] 6.b scrub ok 2024-02-19T21:39:28.666 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:27.657001+0000 mon.a (mon.0) 953 : audit [DBG] from='client.? 172.21.15.80:0/3483768006' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:39:28.667 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:29.119 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:39:29.122 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:29.122 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:39:29.223 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:39:29.233 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:39:29.233 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:39:29.255 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:29.277 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:39:29.280 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:29.280 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:39:29.381 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:39:29.411 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:29.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:28.155104+0000 osd.6 (osd.6) 94 : cluster [DBG] 2.7 scrub starts 2024-02-19T21:39:29.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:28.158717+0000 osd.6 (osd.6) 95 : cluster [DBG] 2.7 scrub ok 2024-02-19T21:39:29.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:28.642172+0000 osd.2 (osd.2) 109 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:39:29.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:28.642233+0000 osd.2 (osd.2) 110 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:39:29.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:29.066474+0000 osd.7 (osd.7) 111 : cluster [DBG] 6.5 scrub starts 2024-02-19T21:39:29.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:29.085638+0000 osd.7 (osd.7) 112 : cluster [DBG] 6.5 scrub ok 2024-02-19T21:39:29.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:28.155104+0000 osd.6 (osd.6) 94 : cluster [DBG] 2.7 scrub starts 2024-02-19T21:39:29.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:28.158717+0000 osd.6 (osd.6) 95 : cluster [DBG] 2.7 scrub ok 2024-02-19T21:39:29.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:28.642172+0000 osd.2 (osd.2) 109 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:39:29.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:28.642233+0000 osd.2 (osd.2) 110 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:39:29.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:29.066474+0000 osd.7 (osd.7) 111 : cluster [DBG] 6.5 scrub starts 2024-02-19T21:39:29.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:29.085638+0000 osd.7 (osd.7) 112 : cluster [DBG] 6.5 scrub ok 2024-02-19T21:39:29.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:28.155104+0000 osd.6 (osd.6) 94 : cluster [DBG] 2.7 scrub starts 2024-02-19T21:39:29.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:28.158717+0000 osd.6 (osd.6) 95 : cluster [DBG] 2.7 scrub ok 2024-02-19T21:39:29.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:28.642172+0000 osd.2 (osd.2) 109 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:39:29.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:28.642233+0000 osd.2 (osd.2) 110 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:39:29.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:29.066474+0000 osd.7 (osd.7) 111 : cluster [DBG] 6.5 scrub starts 2024-02-19T21:39:29.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:29.085638+0000 osd.7 (osd.7) 112 : cluster [DBG] 6.5 scrub ok 2024-02-19T21:39:29.610 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:39:29.613 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:29.614 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:39:29.714 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:39:29.741 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:30.189 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:39:30.192 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:30.192 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:39:30.258 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:39:30.266 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:39:30.266 INFO:tasks.thrashosds.thrasher:Removing osd 2, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:39:30.267 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd out 2 2024-02-19T21:39:30.293 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:39:30.338 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:30.414 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:39:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:39:30.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:28.949047+0000 mgr.y (mgr.14514) 270 : cluster [DBG] pgmap v293: 132 pgs: 1 activating, 131 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-19T21:39:30.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:29.062978+0000 osd.5 (osd.5) 121 : cluster [DBG] 6.1a scrub starts 2024-02-19T21:39:30.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:29.064176+0000 osd.5 (osd.5) 122 : cluster [DBG] 6.1a scrub ok 2024-02-19T21:39:30.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:29.267827+0000 osd.2 (osd.2) 111 : cluster [DBG] 4.19 scrub starts 2024-02-19T21:39:30.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:29.269815+0000 osd.2 (osd.2) 112 : cluster [DBG] 4.19 scrub ok 2024-02-19T21:39:30.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:29.332600+0000 osd.3 (osd.3) 137 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:39:30.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:29.332663+0000 osd.3 (osd.3) 138 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:39:30.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:29.416641+0000 mon.a (mon.0) 954 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2024-02-19T21:39:30.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:30.113505+0000 osd.7 (osd.7) 113 : cluster [DBG] 2.0 scrub starts 2024-02-19T21:39:30.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:30.117028+0000 osd.7 (osd.7) 114 : cluster [DBG] 2.0 scrub ok 2024-02-19T21:39:30.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:28.949047+0000 mgr.y (mgr.14514) 270 : cluster [DBG] pgmap v293: 132 pgs: 1 activating, 131 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-19T21:39:30.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:29.062978+0000 osd.5 (osd.5) 121 : cluster [DBG] 6.1a scrub starts 2024-02-19T21:39:30.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:29.064176+0000 osd.5 (osd.5) 122 : cluster [DBG] 6.1a scrub ok 2024-02-19T21:39:30.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:29.267827+0000 osd.2 (osd.2) 111 : cluster [DBG] 4.19 scrub starts 2024-02-19T21:39:30.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:29.269815+0000 osd.2 (osd.2) 112 : cluster [DBG] 4.19 scrub ok 2024-02-19T21:39:30.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:29.332600+0000 osd.3 (osd.3) 137 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:39:30.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:29.332663+0000 osd.3 (osd.3) 138 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:39:30.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:29.416641+0000 mon.a (mon.0) 954 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2024-02-19T21:39:30.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:30.113505+0000 osd.7 (osd.7) 113 : cluster [DBG] 2.0 scrub starts 2024-02-19T21:39:30.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:30.117028+0000 osd.7 (osd.7) 114 : cluster [DBG] 2.0 scrub ok 2024-02-19T21:39:30.616 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:39:30.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:28.949047+0000 mgr.y (mgr.14514) 270 : cluster [DBG] pgmap v293: 132 pgs: 1 activating, 131 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-19T21:39:30.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:29.062978+0000 osd.5 (osd.5) 121 : cluster [DBG] 6.1a scrub starts 2024-02-19T21:39:30.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:29.064176+0000 osd.5 (osd.5) 122 : cluster [DBG] 6.1a scrub ok 2024-02-19T21:39:30.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:29.267827+0000 osd.2 (osd.2) 111 : cluster [DBG] 4.19 scrub starts 2024-02-19T21:39:30.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:29.269815+0000 osd.2 (osd.2) 112 : cluster [DBG] 4.19 scrub ok 2024-02-19T21:39:30.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:29.332600+0000 osd.3 (osd.3) 137 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:39:30.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:29.332663+0000 osd.3 (osd.3) 138 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:39:30.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:29.416641+0000 mon.a (mon.0) 954 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2024-02-19T21:39:30.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:30.113505+0000 osd.7 (osd.7) 113 : cluster [DBG] 2.0 scrub starts 2024-02-19T21:39:30.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:30.117028+0000 osd.7 (osd.7) 114 : cluster [DBG] 2.0 scrub ok 2024-02-19T21:39:31.097 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:39:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:39:30] "GET /metrics HTTP/1.1" 200 175608 "" "Prometheus/2.33.4" 2024-02-19T21:39:31.133 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.1 dump_historic_ops 2024-02-19T21:39:31.421 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:30.093108+0000 osd.5 (osd.5) 123 : cluster [DBG] 6.19 scrub starts 2024-02-19T21:39:31.421 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:30.102781+0000 osd.5 (osd.5) 124 : cluster [DBG] 6.19 scrub ok 2024-02-19T21:39:31.422 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:30.158693+0000 mgr.y (mgr.14514) 271 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:39:31.422 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:30.262399+0000 osd.3 (osd.3) 139 : cluster [DBG] 4.14 scrub starts 2024-02-19T21:39:31.422 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:30.264296+0000 osd.3 (osd.3) 140 : cluster [DBG] 4.14 scrub ok 2024-02-19T21:39:31.422 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:31.017075+0000 osd.1 (osd.1) 111 : cluster [DBG] 2.a scrub starts 2024-02-19T21:39:31.422 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:31.017996+0000 osd.1 (osd.1) 112 : cluster [DBG] 2.a scrub ok 2024-02-19T21:39:31.515 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:39:31.518 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:31.519 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:39:31.521 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:39:31.620 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:39:31.652 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:31.673 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:39:31.676 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:30.093108+0000 osd.5 (osd.5) 123 : cluster [DBG] 6.19 scrub starts 2024-02-19T21:39:31.676 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:30.102781+0000 osd.5 (osd.5) 124 : cluster [DBG] 6.19 scrub ok 2024-02-19T21:39:31.676 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:30.158693+0000 mgr.y (mgr.14514) 271 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:39:31.676 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:30.262399+0000 osd.3 (osd.3) 139 : cluster [DBG] 4.14 scrub starts 2024-02-19T21:39:31.676 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:30.264296+0000 osd.3 (osd.3) 140 : cluster [DBG] 4.14 scrub ok 2024-02-19T21:39:31.676 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:31.017075+0000 osd.1 (osd.1) 111 : cluster [DBG] 2.a scrub starts 2024-02-19T21:39:31.676 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:31.017996+0000 osd.1 (osd.1) 112 : cluster [DBG] 2.a scrub ok 2024-02-19T21:39:31.677 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:31.677 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:39:31.752 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:30.093108+0000 osd.5 (osd.5) 123 : cluster [DBG] 6.19 scrub starts 2024-02-19T21:39:31.753 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:30.102781+0000 osd.5 (osd.5) 124 : cluster [DBG] 6.19 scrub ok 2024-02-19T21:39:31.753 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:30.158693+0000 mgr.y (mgr.14514) 271 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:39:31.753 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:30.262399+0000 osd.3 (osd.3) 139 : cluster [DBG] 4.14 scrub starts 2024-02-19T21:39:31.753 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:30.264296+0000 osd.3 (osd.3) 140 : cluster [DBG] 4.14 scrub ok 2024-02-19T21:39:31.753 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:31.017075+0000 osd.1 (osd.1) 111 : cluster [DBG] 2.a scrub starts 2024-02-19T21:39:31.753 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:31.017996+0000 osd.1 (osd.1) 112 : cluster [DBG] 2.a scrub ok 2024-02-19T21:39:31.778 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:39:31.808 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:31.828 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:39:31.831 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:31.831 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:39:31.932 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:39:31.959 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:32.209 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:39:32.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:30.950050+0000 mgr.y (mgr.14514) 272 : cluster [DBG] pgmap v295: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-19T21:39:32.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:31.245326+0000 osd.6 (osd.6) 96 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:39:32.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:31.248203+0000 osd.6 (osd.6) 97 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:39:32.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:31.414254+0000 mon.a (mon.0) 955 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-02-19T21:39:32.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:32.206292+0000 osd.7 (osd.7) 115 : cluster [DBG] 5.1a scrub starts 2024-02-19T21:39:32.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:32.209229+0000 osd.7 (osd.7) 116 : cluster [DBG] 5.1a scrub ok 2024-02-19T21:39:32.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:30.950050+0000 mgr.y (mgr.14514) 272 : cluster [DBG] pgmap v295: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-19T21:39:32.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:31.245326+0000 osd.6 (osd.6) 96 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:39:32.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:31.248203+0000 osd.6 (osd.6) 97 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:39:32.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:31.414254+0000 mon.a (mon.0) 955 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-02-19T21:39:32.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:32.206292+0000 osd.7 (osd.7) 115 : cluster [DBG] 5.1a scrub starts 2024-02-19T21:39:32.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:32.209229+0000 osd.7 (osd.7) 116 : cluster [DBG] 5.1a scrub ok 2024-02-19T21:39:32.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:30.950050+0000 mgr.y (mgr.14514) 272 : cluster [DBG] pgmap v295: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-19T21:39:32.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:31.245326+0000 osd.6 (osd.6) 96 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:39:32.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:31.248203+0000 osd.6 (osd.6) 97 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:39:32.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:31.414254+0000 mon.a (mon.0) 955 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-02-19T21:39:32.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:32.206292+0000 osd.7 (osd.7) 115 : cluster [DBG] 5.1a scrub starts 2024-02-19T21:39:32.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:32.209229+0000 osd.7 (osd.7) 116 : cluster [DBG] 5.1a scrub ok 2024-02-19T21:39:33.781 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:32.261526+0000 osd.6 (osd.6) 98 : cluster [DBG] 2.1a scrub starts 2024-02-19T21:39:33.781 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:32.264419+0000 osd.6 (osd.6) 99 : cluster [DBG] 2.1a scrub ok 2024-02-19T21:39:33.781 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:32.261526+0000 osd.6 (osd.6) 98 : cluster [DBG] 2.1a scrub starts 2024-02-19T21:39:33.782 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:32.264419+0000 osd.6 (osd.6) 99 : cluster [DBG] 2.1a scrub ok 2024-02-19T21:39:33.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:32.261526+0000 osd.6 (osd.6) 98 : cluster [DBG] 2.1a scrub starts 2024-02-19T21:39:33.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:32.264419+0000 osd.6 (osd.6) 99 : cluster [DBG] 2.1a scrub ok 2024-02-19T21:39:33.810 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:39:33.813 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:33.814 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:39:33.831 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:39:33.915 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:39:33.947 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:33.969 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:39:33.972 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:33.972 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:39:34.073 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:39:34.104 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:34.125 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:39:34.128 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:34.129 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:39:34.230 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:39:34.260 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:34.434 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:32.950368+0000 mgr.y (mgr.14514) 273 : cluster [DBG] pgmap v296: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-02-19T21:39:34.434 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:33.123822+0000 osd.0 (osd.0) 135 : cluster [DBG] 4.1e scrub starts 2024-02-19T21:39:34.435 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:33.125895+0000 osd.0 (osd.0) 136 : cluster [DBG] 4.1e scrub ok 2024-02-19T21:39:34.435 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:33.270416+0000 osd.6 (osd.6) 100 : cluster [DBG] 2.14 scrub starts 2024-02-19T21:39:34.435 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:33.273359+0000 osd.6 (osd.6) 101 : cluster [DBG] 2.14 scrub ok 2024-02-19T21:39:34.437 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-02-19T21:39:34.718 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:32.950368+0000 mgr.y (mgr.14514) 273 : cluster [DBG] pgmap v296: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-02-19T21:39:34.718 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:33.123822+0000 osd.0 (osd.0) 135 : cluster [DBG] 4.1e scrub starts 2024-02-19T21:39:34.718 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:33.125895+0000 osd.0 (osd.0) 136 : cluster [DBG] 4.1e scrub ok 2024-02-19T21:39:34.718 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:33.270416+0000 osd.6 (osd.6) 100 : cluster [DBG] 2.14 scrub starts 2024-02-19T21:39:34.718 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:33.273359+0000 osd.6 (osd.6) 101 : cluster [DBG] 2.14 scrub ok 2024-02-19T21:39:34.719 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:33.346351+0000 osd.3 (osd.3) 141 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:39:34.719 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:33.360060+0000 osd.3 (osd.3) 142 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:39:34.719 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:33.531661+0000 osd.4 (osd.4) 107 : cluster [DBG] 2.f scrub starts 2024-02-19T21:39:34.719 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:33.533121+0000 osd.4 (osd.4) 108 : cluster [DBG] 2.f scrub ok 2024-02-19T21:39:34.719 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:33.956838+0000 osd.1 (osd.1) 113 : cluster [DBG] 2.15 scrub starts 2024-02-19T21:39:34.719 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:33.957806+0000 osd.1 (osd.1) 114 : cluster [DBG] 2.15 scrub ok 2024-02-19T21:39:34.719 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:34.213291+0000 mon.c (mon.2) 38 : audit [INF] from='client.? 172.21.15.80:0/3795400656' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:39:34.719 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:34.213600+0000 mon.a (mon.0) 956 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:39:34.719 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:33.346351+0000 osd.3 (osd.3) 141 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:39:34.719 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:33.360060+0000 osd.3 (osd.3) 142 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:39:34.719 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:33.531661+0000 osd.4 (osd.4) 107 : cluster [DBG] 2.f scrub starts 2024-02-19T21:39:34.719 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:33.533121+0000 osd.4 (osd.4) 108 : cluster [DBG] 2.f scrub ok 2024-02-19T21:39:34.719 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:33.956838+0000 osd.1 (osd.1) 113 : cluster [DBG] 2.15 scrub starts 2024-02-19T21:39:34.720 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:33.957806+0000 osd.1 (osd.1) 114 : cluster [DBG] 2.15 scrub ok 2024-02-19T21:39:34.720 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:34.213291+0000 mon.c (mon.2) 38 : audit [INF] from='client.? 172.21.15.80:0/3795400656' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:39:34.720 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:34.213600+0000 mon.a (mon.0) 956 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:39:34.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:32.950368+0000 mgr.y (mgr.14514) 273 : cluster [DBG] pgmap v296: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-02-19T21:39:34.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:33.123822+0000 osd.0 (osd.0) 135 : cluster [DBG] 4.1e scrub starts 2024-02-19T21:39:34.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:33.125895+0000 osd.0 (osd.0) 136 : cluster [DBG] 4.1e scrub ok 2024-02-19T21:39:34.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:33.270416+0000 osd.6 (osd.6) 100 : cluster [DBG] 2.14 scrub starts 2024-02-19T21:39:34.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:33.273359+0000 osd.6 (osd.6) 101 : cluster [DBG] 2.14 scrub ok 2024-02-19T21:39:34.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:33.346351+0000 osd.3 (osd.3) 141 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:39:34.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:33.360060+0000 osd.3 (osd.3) 142 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:39:34.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:33.531661+0000 osd.4 (osd.4) 107 : cluster [DBG] 2.f scrub starts 2024-02-19T21:39:34.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:33.533121+0000 osd.4 (osd.4) 108 : cluster [DBG] 2.f scrub ok 2024-02-19T21:39:34.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:33.956838+0000 osd.1 (osd.1) 113 : cluster [DBG] 2.15 scrub starts 2024-02-19T21:39:34.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:33.957806+0000 osd.1 (osd.1) 114 : cluster [DBG] 2.15 scrub ok 2024-02-19T21:39:34.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:34.213291+0000 mon.c (mon.2) 38 : audit [INF] from='client.? 172.21.15.80:0/3795400656' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:39:34.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:34.213600+0000 mon.a (mon.0) 956 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:39:35.020 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:39:35.209 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:39:35.212 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:35.213 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:39:35.314 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:39:35.344 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:35.365 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:39:35.367 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:35.368 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:39:35.468 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:39:35.499 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:35.519 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:39:35.522 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:35.522 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:39:35.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:34.363266+0000 osd.3 (osd.3) 143 : cluster [DBG] 5.1c scrub starts 2024-02-19T21:39:35.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:34.364408+0000 osd.3 (osd.3) 144 : cluster [DBG] 5.1c scrub ok 2024-02-19T21:39:35.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:34.426869+0000 mon.a (mon.0) 957 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:39:35.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:34.426892+0000 mon.a (mon.0) 958 : cluster [INF] Cluster is now healthy 2024-02-19T21:39:35.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:34.431129+0000 mon.a (mon.0) 959 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:39:35.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:34.431194+0000 mon.a (mon.0) 960 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2024-02-19T21:39:35.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:34.515852+0000 osd.4 (osd.4) 109 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:39:35.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:34.519421+0000 osd.4 (osd.4) 110 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:39:35.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:34.970896+0000 osd.1 (osd.1) 115 : cluster [DBG] 2.4 scrub starts 2024-02-19T21:39:35.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:34.971912+0000 osd.1 (osd.1) 116 : cluster [DBG] 2.4 scrub ok 2024-02-19T21:39:35.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:34.363266+0000 osd.3 (osd.3) 143 : cluster [DBG] 5.1c scrub starts 2024-02-19T21:39:35.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:34.364408+0000 osd.3 (osd.3) 144 : cluster [DBG] 5.1c scrub ok 2024-02-19T21:39:35.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:34.426869+0000 mon.a (mon.0) 957 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:39:35.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:34.426892+0000 mon.a (mon.0) 958 : cluster [INF] Cluster is now healthy 2024-02-19T21:39:35.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:34.431129+0000 mon.a (mon.0) 959 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:39:35.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:34.431194+0000 mon.a (mon.0) 960 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2024-02-19T21:39:35.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:34.515852+0000 osd.4 (osd.4) 109 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:39:35.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:34.519421+0000 osd.4 (osd.4) 110 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:39:35.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:34.970896+0000 osd.1 (osd.1) 115 : cluster [DBG] 2.4 scrub starts 2024-02-19T21:39:35.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:34.971912+0000 osd.1 (osd.1) 116 : cluster [DBG] 2.4 scrub ok 2024-02-19T21:39:35.623 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:39:35.652 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:35.671 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:39:35.673 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:35.674 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:39:35.774 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:39:35.799 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:39:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:39:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:39:35.799 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:34.363266+0000 osd.3 (osd.3) 143 : cluster [DBG] 5.1c scrub starts 2024-02-19T21:39:35.799 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:34.364408+0000 osd.3 (osd.3) 144 : cluster [DBG] 5.1c scrub ok 2024-02-19T21:39:35.800 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:34.426869+0000 mon.a (mon.0) 957 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:39:35.800 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:34.426892+0000 mon.a (mon.0) 958 : cluster [INF] Cluster is now healthy 2024-02-19T21:39:35.800 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:34.431129+0000 mon.a (mon.0) 959 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:39:35.800 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:34.431194+0000 mon.a (mon.0) 960 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2024-02-19T21:39:35.800 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:34.515852+0000 osd.4 (osd.4) 109 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:39:35.800 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:34.519421+0000 osd.4 (osd.4) 110 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:39:35.800 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:34.970896+0000 osd.1 (osd.1) 115 : cluster [DBG] 2.4 scrub starts 2024-02-19T21:39:35.800 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:34.971912+0000 osd.1 (osd.1) 116 : cluster [DBG] 2.4 scrub ok 2024-02-19T21:39:35.801 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:35.820 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:39:35.822 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:35.823 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:39:35.924 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:39:35.950 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:35.968 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:39:35.971 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:35.971 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:39:36.072 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:39:36.102 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:36.592 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:34.950874+0000 mgr.y (mgr.14514) 274 : cluster [DBG] pgmap v298: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:39:36.592 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:35.102749+0000 osd.5 (osd.5) 125 : cluster [DBG] 5.1b scrub starts 2024-02-19T21:39:36.592 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:35.103940+0000 osd.5 (osd.5) 126 : cluster [DBG] 5.1b scrub ok 2024-02-19T21:39:36.592 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:34.950874+0000 mgr.y (mgr.14514) 274 : cluster [DBG] pgmap v298: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:39:36.592 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:35.102749+0000 osd.5 (osd.5) 125 : cluster [DBG] 5.1b scrub starts 2024-02-19T21:39:36.592 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:35.103940+0000 osd.5 (osd.5) 126 : cluster [DBG] 5.1b scrub ok 2024-02-19T21:39:36.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:34.950874+0000 mgr.y (mgr.14514) 274 : cluster [DBG] pgmap v298: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:39:36.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:35.102749+0000 osd.5 (osd.5) 125 : cluster [DBG] 5.1b scrub starts 2024-02-19T21:39:36.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:35.103940+0000 osd.5 (osd.5) 126 : cluster [DBG] 5.1b scrub ok 2024-02-19T21:39:37.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:36.064370+0000 osd.5 (osd.5) 127 : cluster [DBG] 5.16 deep-scrub starts 2024-02-19T21:39:37.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:36.067346+0000 osd.5 (osd.5) 128 : cluster [DBG] 5.16 deep-scrub ok 2024-02-19T21:39:37.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:36.191441+0000 osd.0 (osd.0) 137 : cluster [DBG] 4.b scrub starts 2024-02-19T21:39:37.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:36.193179+0000 osd.0 (osd.0) 138 : cluster [DBG] 4.b scrub ok 2024-02-19T21:39:37.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:37.101910+0000 osd.7 (osd.7) 117 : cluster [DBG] 6.12 scrub starts 2024-02-19T21:39:37.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:37.104827+0000 osd.7 (osd.7) 118 : cluster [DBG] 6.12 scrub ok 2024-02-19T21:39:37.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:36.064370+0000 osd.5 (osd.5) 127 : cluster [DBG] 5.16 deep-scrub starts 2024-02-19T21:39:37.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:36.067346+0000 osd.5 (osd.5) 128 : cluster [DBG] 5.16 deep-scrub ok 2024-02-19T21:39:37.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:36.191441+0000 osd.0 (osd.0) 137 : cluster [DBG] 4.b scrub starts 2024-02-19T21:39:37.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:36.193179+0000 osd.0 (osd.0) 138 : cluster [DBG] 4.b scrub ok 2024-02-19T21:39:37.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:37.101910+0000 osd.7 (osd.7) 117 : cluster [DBG] 6.12 scrub starts 2024-02-19T21:39:37.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:37.104827+0000 osd.7 (osd.7) 118 : cluster [DBG] 6.12 scrub ok 2024-02-19T21:39:37.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:36.064370+0000 osd.5 (osd.5) 127 : cluster [DBG] 5.16 deep-scrub starts 2024-02-19T21:39:37.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:36.067346+0000 osd.5 (osd.5) 128 : cluster [DBG] 5.16 deep-scrub ok 2024-02-19T21:39:37.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:36.191441+0000 osd.0 (osd.0) 137 : cluster [DBG] 4.b scrub starts 2024-02-19T21:39:37.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:36.193179+0000 osd.0 (osd.0) 138 : cluster [DBG] 4.b scrub ok 2024-02-19T21:39:37.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:37.101910+0000 osd.7 (osd.7) 117 : cluster [DBG] 6.12 scrub starts 2024-02-19T21:39:37.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:37.104827+0000 osd.7 (osd.7) 118 : cluster [DBG] 6.12 scrub ok 2024-02-19T21:39:38.154 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:39:38.157 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:38.158 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:39:38.158 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:39:38.259 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:39:38.288 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:38.294 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:39:38.038+0000 7f2483437700 -1 mon.a@0(leader).osd e164 definitely_dead 0 2024-02-19T21:39:38.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:36.951437+0000 mgr.y (mgr.14514) 275 : cluster [DBG] pgmap v299: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:39:38.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:37.082389+0000 osd.5 (osd.5) 129 : cluster [DBG] 2.16 deep-scrub starts 2024-02-19T21:39:38.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:37.085370+0000 osd.5 (osd.5) 130 : cluster [DBG] 2.16 deep-scrub ok 2024-02-19T21:39:38.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:37.168620+0000 osd.0 (osd.0) 139 : cluster [DBG] 5.1e scrub starts 2024-02-19T21:39:38.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:37.169499+0000 osd.0 (osd.0) 140 : cluster [DBG] 5.1e scrub ok 2024-02-19T21:39:38.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:37.383791+0000 osd.2 (osd.2) 113 : cluster [DBG] 5.8 scrub starts 2024-02-19T21:39:38.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:37.384714+0000 osd.2 (osd.2) 114 : cluster [DBG] 5.8 scrub ok 2024-02-19T21:39:38.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:38.039046+0000 mon.c (mon.2) 39 : audit [INF] from='client.? 172.21.15.80:0/2318042324' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["2"]}]: dispatch 2024-02-19T21:39:38.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:38.039347+0000 mon.a (mon.0) 961 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["2"]}]: dispatch 2024-02-19T21:39:38.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:38.039414+0000 mon.a (mon.0) 962 : cluster [INF] Client client.admin marked osd.2 out, while it was still marked up 2024-02-19T21:39:38.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:38.130743+0000 mon.a (mon.0) 963 : audit [INF] from='client.? 172.21.15.80:0/3747553771' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]: dispatch 2024-02-19T21:39:38.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:36.951437+0000 mgr.y (mgr.14514) 275 : cluster [DBG] pgmap v299: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:39:38.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:37.082389+0000 osd.5 (osd.5) 129 : cluster [DBG] 2.16 deep-scrub starts 2024-02-19T21:39:38.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:37.085370+0000 osd.5 (osd.5) 130 : cluster [DBG] 2.16 deep-scrub ok 2024-02-19T21:39:38.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:37.168620+0000 osd.0 (osd.0) 139 : cluster [DBG] 5.1e scrub starts 2024-02-19T21:39:38.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:37.169499+0000 osd.0 (osd.0) 140 : cluster [DBG] 5.1e scrub ok 2024-02-19T21:39:38.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:37.383791+0000 osd.2 (osd.2) 113 : cluster [DBG] 5.8 scrub starts 2024-02-19T21:39:38.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:37.384714+0000 osd.2 (osd.2) 114 : cluster [DBG] 5.8 scrub ok 2024-02-19T21:39:38.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:38.039046+0000 mon.c (mon.2) 39 : audit [INF] from='client.? 172.21.15.80:0/2318042324' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["2"]}]: dispatch 2024-02-19T21:39:38.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:38.039347+0000 mon.a (mon.0) 961 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["2"]}]: dispatch 2024-02-19T21:39:38.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:38.039414+0000 mon.a (mon.0) 962 : cluster [INF] Client client.admin marked osd.2 out, while it was still marked up 2024-02-19T21:39:38.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:38.130743+0000 mon.a (mon.0) 963 : audit [INF] from='client.? 172.21.15.80:0/3747553771' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]: dispatch 2024-02-19T21:39:38.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:36.951437+0000 mgr.y (mgr.14514) 275 : cluster [DBG] pgmap v299: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:39:38.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:37.082389+0000 osd.5 (osd.5) 129 : cluster [DBG] 2.16 deep-scrub starts 2024-02-19T21:39:38.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:37.085370+0000 osd.5 (osd.5) 130 : cluster [DBG] 2.16 deep-scrub ok 2024-02-19T21:39:38.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:37.168620+0000 osd.0 (osd.0) 139 : cluster [DBG] 5.1e scrub starts 2024-02-19T21:39:38.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:37.169499+0000 osd.0 (osd.0) 140 : cluster [DBG] 5.1e scrub ok 2024-02-19T21:39:38.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:37.383791+0000 osd.2 (osd.2) 113 : cluster [DBG] 5.8 scrub starts 2024-02-19T21:39:38.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:37.384714+0000 osd.2 (osd.2) 114 : cluster [DBG] 5.8 scrub ok 2024-02-19T21:39:38.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:38.039046+0000 mon.c (mon.2) 39 : audit [INF] from='client.? 172.21.15.80:0/2318042324' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["2"]}]: dispatch 2024-02-19T21:39:38.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:38.039347+0000 mon.a (mon.0) 961 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["2"]}]: dispatch 2024-02-19T21:39:38.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:38.039414+0000 mon.a (mon.0) 962 : cluster [INF] Client client.admin marked osd.2 out, while it was still marked up 2024-02-19T21:39:38.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:38.130743+0000 mon.a (mon.0) 963 : audit [INF] from='client.? 172.21.15.80:0/3747553771' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]: dispatch 2024-02-19T21:39:38.979 INFO:teuthology.orchestra.run.smithi080.stderr:marked out osd.2. 2024-02-19T21:39:39.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:38.077554+0000 osd.5 (osd.5) 131 : cluster [DBG] 2.18 scrub starts 2024-02-19T21:39:39.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:38.080596+0000 osd.5 (osd.5) 132 : cluster [DBG] 2.18 scrub ok 2024-02-19T21:39:39.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:38.413142+0000 osd.3 (osd.3) 145 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:39:39.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:38.448488+0000 mon.a (mon.0) 964 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["2"]}]': finished 2024-02-19T21:39:39.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:38.448574+0000 mon.a (mon.0) 965 : audit [INF] from='client.? 172.21.15.80:0/3747553771' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]': finished 2024-02-19T21:39:39.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:38.448630+0000 mon.a (mon.0) 966 : cluster [DBG] osdmap e165: 8 total, 8 up, 7 in 2024-02-19T21:39:39.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:38.452515+0000 osd.3 (osd.3) 146 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:39:39.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:38.471884+0000 osd.4 (osd.4) 111 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:39:39.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:38.475436+0000 osd.4 (osd.4) 112 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:39:39.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:39.001033+0000 osd.1 (osd.1) 117 : cluster [DBG] 5.c scrub starts 2024-02-19T21:39:39.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:39.002255+0000 osd.1 (osd.1) 118 : cluster [DBG] 5.c scrub ok 2024-02-19T21:39:39.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:39.450548+0000 mon.a (mon.0) 967 : cluster [DBG] osdmap e166: 8 total, 8 up, 7 in 2024-02-19T21:39:39.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:38.077554+0000 osd.5 (osd.5) 131 : cluster [DBG] 2.18 scrub starts 2024-02-19T21:39:39.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:38.080596+0000 osd.5 (osd.5) 132 : cluster [DBG] 2.18 scrub ok 2024-02-19T21:39:39.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:38.413142+0000 osd.3 (osd.3) 145 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:39:39.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:38.448488+0000 mon.a (mon.0) 964 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["2"]}]': finished 2024-02-19T21:39:39.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:38.448574+0000 mon.a (mon.0) 965 : audit [INF] from='client.? 172.21.15.80:0/3747553771' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]': finished 2024-02-19T21:39:39.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:38.448630+0000 mon.a (mon.0) 966 : cluster [DBG] osdmap e165: 8 total, 8 up, 7 in 2024-02-19T21:39:39.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:38.452515+0000 osd.3 (osd.3) 146 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:39:39.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:38.471884+0000 osd.4 (osd.4) 111 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:39:39.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:38.475436+0000 osd.4 (osd.4) 112 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:39:39.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:39.001033+0000 osd.1 (osd.1) 117 : cluster [DBG] 5.c scrub starts 2024-02-19T21:39:39.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:39.002255+0000 osd.1 (osd.1) 118 : cluster [DBG] 5.c scrub ok 2024-02-19T21:39:39.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:39.450548+0000 mon.a (mon.0) 967 : cluster [DBG] osdmap e166: 8 total, 8 up, 7 in 2024-02-19T21:39:39.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:38.077554+0000 osd.5 (osd.5) 131 : cluster [DBG] 2.18 scrub starts 2024-02-19T21:39:39.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:38.080596+0000 osd.5 (osd.5) 132 : cluster [DBG] 2.18 scrub ok 2024-02-19T21:39:39.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:38.413142+0000 osd.3 (osd.3) 145 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:39:39.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:38.448488+0000 mon.a (mon.0) 964 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["2"]}]': finished 2024-02-19T21:39:39.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:38.448574+0000 mon.a (mon.0) 965 : audit [INF] from='client.? 172.21.15.80:0/3747553771' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]': finished 2024-02-19T21:39:39.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:38.448630+0000 mon.a (mon.0) 966 : cluster [DBG] osdmap e165: 8 total, 8 up, 7 in 2024-02-19T21:39:39.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:38.452515+0000 osd.3 (osd.3) 146 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:39:39.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:38.471884+0000 osd.4 (osd.4) 111 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:39:39.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:38.475436+0000 osd.4 (osd.4) 112 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:39:39.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:39.001033+0000 osd.1 (osd.1) 117 : cluster [DBG] 5.c scrub starts 2024-02-19T21:39:39.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:39.002255+0000 osd.1 (osd.1) 118 : cluster [DBG] 5.c scrub ok 2024-02-19T21:39:39.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:39.450548+0000 mon.a (mon.0) 967 : cluster [DBG] osdmap e166: 8 total, 8 up, 7 in 2024-02-19T21:39:40.288 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'unique_pool_1' created 2024-02-19T21:39:40.485 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:39:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:39:40.564 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:39:40.567 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:40.568 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:39:40.669 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:39:40.699 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:40.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:38.951820+0000 mgr.y (mgr.14514) 276 : cluster [DBG] pgmap v301: 148 pgs: 16 unknown, 132 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:39:40.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:40.011761+0000 osd.1 (osd.1) 119 : cluster [DBG] 6.e scrub starts 2024-02-19T21:39:40.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:40.015899+0000 osd.1 (osd.1) 120 : cluster [DBG] 6.e scrub ok 2024-02-19T21:39:40.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:40.451565+0000 mon.a (mon.0) 968 : cluster [DBG] osdmap e167: 8 total, 8 up, 7 in 2024-02-19T21:39:40.773 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:38.951820+0000 mgr.y (mgr.14514) 276 : cluster [DBG] pgmap v301: 148 pgs: 16 unknown, 132 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:39:40.773 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:40.011761+0000 osd.1 (osd.1) 119 : cluster [DBG] 6.e scrub starts 2024-02-19T21:39:40.773 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:40.015899+0000 osd.1 (osd.1) 120 : cluster [DBG] 6.e scrub ok 2024-02-19T21:39:40.773 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:40.451565+0000 mon.a (mon.0) 968 : cluster [DBG] osdmap e167: 8 total, 8 up, 7 in 2024-02-19T21:39:40.789 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:39:40.790 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:39:40.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:38.951820+0000 mgr.y (mgr.14514) 276 : cluster [DBG] pgmap v301: 148 pgs: 16 unknown, 132 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:39:40.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:40.011761+0000 osd.1 (osd.1) 119 : cluster [DBG] 6.e scrub starts 2024-02-19T21:39:40.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:40.015899+0000 osd.1 (osd.1) 120 : cluster [DBG] 6.e scrub ok 2024-02-19T21:39:40.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:40.451565+0000 mon.a (mon.0) 968 : cluster [DBG] osdmap e167: 8 total, 8 up, 7 in 2024-02-19T21:39:41.093 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:39:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:39:40] "GET /metrics HTTP/1.1" 200 173265 "" "Prometheus/2.33.4" 2024-02-19T21:39:41.780 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:40.169689+0000 mgr.y (mgr.14514) 277 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:39:41.780 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:40.279137+0000 osd.6 (osd.6) 102 : cluster [DBG] 4.a scrub starts 2024-02-19T21:39:41.780 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:40.282673+0000 osd.6 (osd.6) 103 : cluster [DBG] 4.a scrub ok 2024-02-19T21:39:41.780 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:40.169689+0000 mgr.y (mgr.14514) 277 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:39:41.780 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:40.279137+0000 osd.6 (osd.6) 102 : cluster [DBG] 4.a scrub starts 2024-02-19T21:39:41.780 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:40.282673+0000 osd.6 (osd.6) 103 : cluster [DBG] 4.a scrub ok 2024-02-19T21:39:41.800 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.2 dump_ops_in_flight 2024-02-19T21:39:41.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:40.169689+0000 mgr.y (mgr.14514) 277 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:39:41.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:40.279137+0000 osd.6 (osd.6) 102 : cluster [DBG] 4.a scrub starts 2024-02-19T21:39:41.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:40.282673+0000 osd.6 (osd.6) 103 : cluster [DBG] 4.a scrub ok 2024-02-19T21:39:42.210 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set noscrub 2024-02-19T21:39:42.449 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:39:42.451 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:42.452 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:39:42.553 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:39:42.579 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:42.799 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:40.952175+0000 mgr.y (mgr.14514) 278 : cluster [DBG] pgmap v304: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 318 B/s, 7 objects/s recovering 2024-02-19T21:39:42.799 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:41.002403+0000 osd.5 (osd.5) 133 : cluster [DBG] 6.17 deep-scrub starts 2024-02-19T21:39:42.800 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:41.032058+0000 osd.5 (osd.5) 134 : cluster [DBG] 6.17 deep-scrub ok 2024-02-19T21:39:42.800 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:41.231332+0000 osd.6 (osd.6) 104 : cluster [DBG] 5.11 scrub starts 2024-02-19T21:39:42.800 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:41.234246+0000 osd.6 (osd.6) 105 : cluster [DBG] 5.11 scrub ok 2024-02-19T21:39:42.800 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:41.364758+0000 osd.4 (osd.4) 113 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:39:42.800 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:41.367688+0000 osd.4 (osd.4) 114 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:39:42.800 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:42.017789+0000 osd.1 (osd.1) 121 : cluster [DBG] 6.1 deep-scrub starts 2024-02-19T21:39:42.800 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:42.020829+0000 osd.1 (osd.1) 122 : cluster [DBG] 6.1 deep-scrub ok 2024-02-19T21:39:42.800 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:40.952175+0000 mgr.y (mgr.14514) 278 : cluster [DBG] pgmap v304: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 318 B/s, 7 objects/s recovering 2024-02-19T21:39:42.800 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:41.002403+0000 osd.5 (osd.5) 133 : cluster [DBG] 6.17 deep-scrub starts 2024-02-19T21:39:42.800 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:41.032058+0000 osd.5 (osd.5) 134 : cluster [DBG] 6.17 deep-scrub ok 2024-02-19T21:39:42.801 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:41.231332+0000 osd.6 (osd.6) 104 : cluster [DBG] 5.11 scrub starts 2024-02-19T21:39:42.801 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:41.234246+0000 osd.6 (osd.6) 105 : cluster [DBG] 5.11 scrub ok 2024-02-19T21:39:42.801 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:41.364758+0000 osd.4 (osd.4) 113 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:39:42.801 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:41.367688+0000 osd.4 (osd.4) 114 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:39:42.801 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:42.017789+0000 osd.1 (osd.1) 121 : cluster [DBG] 6.1 deep-scrub starts 2024-02-19T21:39:42.801 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:42.020829+0000 osd.1 (osd.1) 122 : cluster [DBG] 6.1 deep-scrub ok 2024-02-19T21:39:42.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:40.952175+0000 mgr.y (mgr.14514) 278 : cluster [DBG] pgmap v304: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 318 B/s, 7 objects/s recovering 2024-02-19T21:39:42.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:41.002403+0000 osd.5 (osd.5) 133 : cluster [DBG] 6.17 deep-scrub starts 2024-02-19T21:39:42.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:41.032058+0000 osd.5 (osd.5) 134 : cluster [DBG] 6.17 deep-scrub ok 2024-02-19T21:39:42.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:41.231332+0000 osd.6 (osd.6) 104 : cluster [DBG] 5.11 scrub starts 2024-02-19T21:39:42.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:41.234246+0000 osd.6 (osd.6) 105 : cluster [DBG] 5.11 scrub ok 2024-02-19T21:39:42.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:41.364758+0000 osd.4 (osd.4) 113 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:39:42.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:41.367688+0000 osd.4 (osd.4) 114 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:39:42.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:42.017789+0000 osd.1 (osd.1) 121 : cluster [DBG] 6.1 deep-scrub starts 2024-02-19T21:39:42.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:42.020829+0000 osd.1 (osd.1) 122 : cluster [DBG] 6.1 deep-scrub ok 2024-02-19T21:39:42.821 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool application enable unique_pool_1 rados --yes-i-really-mean-it || true 2024-02-19T21:39:42.828 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:39:42.831 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:42.831 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:39:42.836 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:39:42.932 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:39:42.967 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:42.988 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:39:42.991 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:42.991 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:39:43.092 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:39:43.121 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:43.149 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:39:43.151 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:43.151 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:39:43.252 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:39:43.284 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:43.305 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:39:43.308 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:43.308 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:39:43.409 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:39:43.436 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:43.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:42.211478+0000 osd.0 (osd.0) 141 : cluster [DBG] 6.9 scrub starts 2024-02-19T21:39:43.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:42.230655+0000 osd.0 (osd.0) 142 : cluster [DBG] 6.9 scrub ok 2024-02-19T21:39:43.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:42.249411+0000 osd.6 (osd.6) 106 : cluster [DBG] 6.f scrub starts 2024-02-19T21:39:43.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:42.276859+0000 osd.6 (osd.6) 107 : cluster [DBG] 6.f scrub ok 2024-02-19T21:39:43.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:42.509468+0000 osd.3 (osd.3) 147 : cluster [DBG] 4.c scrub starts 2024-02-19T21:39:43.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:42.511433+0000 osd.3 (osd.3) 148 : cluster [DBG] 4.c scrub ok 2024-02-19T21:39:43.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:42.211478+0000 osd.0 (osd.0) 141 : cluster [DBG] 6.9 scrub starts 2024-02-19T21:39:43.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:42.230655+0000 osd.0 (osd.0) 142 : cluster [DBG] 6.9 scrub ok 2024-02-19T21:39:43.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:42.249411+0000 osd.6 (osd.6) 106 : cluster [DBG] 6.f scrub starts 2024-02-19T21:39:43.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:42.276859+0000 osd.6 (osd.6) 107 : cluster [DBG] 6.f scrub ok 2024-02-19T21:39:43.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:42.509468+0000 osd.3 (osd.3) 147 : cluster [DBG] 4.c scrub starts 2024-02-19T21:39:43.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:42.511433+0000 osd.3 (osd.3) 148 : cluster [DBG] 4.c scrub ok 2024-02-19T21:39:43.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:42.211478+0000 osd.0 (osd.0) 141 : cluster [DBG] 6.9 scrub starts 2024-02-19T21:39:43.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:42.230655+0000 osd.0 (osd.0) 142 : cluster [DBG] 6.9 scrub ok 2024-02-19T21:39:43.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:42.249411+0000 osd.6 (osd.6) 106 : cluster [DBG] 6.f scrub starts 2024-02-19T21:39:43.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:42.276859+0000 osd.6 (osd.6) 107 : cluster [DBG] 6.f scrub ok 2024-02-19T21:39:43.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:42.509468+0000 osd.3 (osd.3) 147 : cluster [DBG] 4.c scrub starts 2024-02-19T21:39:43.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:42.511433+0000 osd.3 (osd.3) 148 : cluster [DBG] 4.c scrub ok 2024-02-19T21:39:43.990 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:39:43.992 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:43.993 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:39:44.093 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:39:44.121 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:44.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:42.952556+0000 mgr.y (mgr.14514) 279 : cluster [DBG] pgmap v305: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 318 B/s, 7 objects/s recovering 2024-02-19T21:39:44.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:43.206313+0000 osd.6 (osd.6) 108 : cluster [DBG] 4.1f scrub starts 2024-02-19T21:39:44.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:43.209799+0000 osd.6 (osd.6) 109 : cluster [DBG] 4.1f scrub ok 2024-02-19T21:39:44.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:43.994115+0000 osd.1 (osd.1) 123 : cluster [DBG] 4.4 scrub starts 2024-02-19T21:39:44.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:43.996502+0000 osd.1 (osd.1) 124 : cluster [DBG] 4.4 scrub ok 2024-02-19T21:39:44.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:42.952556+0000 mgr.y (mgr.14514) 279 : cluster [DBG] pgmap v305: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 318 B/s, 7 objects/s recovering 2024-02-19T21:39:44.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:43.206313+0000 osd.6 (osd.6) 108 : cluster [DBG] 4.1f scrub starts 2024-02-19T21:39:44.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:43.209799+0000 osd.6 (osd.6) 109 : cluster [DBG] 4.1f scrub ok 2024-02-19T21:39:44.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:43.994115+0000 osd.1 (osd.1) 123 : cluster [DBG] 4.4 scrub starts 2024-02-19T21:39:44.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:43.996502+0000 osd.1 (osd.1) 124 : cluster [DBG] 4.4 scrub ok 2024-02-19T21:39:44.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:42.952556+0000 mgr.y (mgr.14514) 279 : cluster [DBG] pgmap v305: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 318 B/s, 7 objects/s recovering 2024-02-19T21:39:44.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:43.206313+0000 osd.6 (osd.6) 108 : cluster [DBG] 4.1f scrub starts 2024-02-19T21:39:44.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:43.209799+0000 osd.6 (osd.6) 109 : cluster [DBG] 4.1f scrub ok 2024-02-19T21:39:44.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:43.994115+0000 osd.1 (osd.1) 123 : cluster [DBG] 4.4 scrub starts 2024-02-19T21:39:44.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:43.996502+0000 osd.1 (osd.1) 124 : cluster [DBG] 4.4 scrub ok 2024-02-19T21:39:45.470 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:39:45.489 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:45.490 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:39:45.560 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:39:45.560 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:39:45.560 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:39:45.561 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:39:45.561 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:39:45.561 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:39:45.572 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:39:45.590 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:39:45.591 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:39:45.592 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:39:45.592 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:39:45.592 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:39:45.592 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:39:45.592 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:39:45.592 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:39:45.592 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:39:45.592 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:39:45.624 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:45.645 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:39:45.648 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:45.648 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:39:45.749 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:39:45.777 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:39:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:39:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:39:45.777 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:44.228460+0000 osd.6 (osd.6) 110 : cluster [DBG] 6.2 scrub starts 2024-02-19T21:39:45.778 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:44.231415+0000 osd.6 (osd.6) 111 : cluster [DBG] 6.2 scrub ok 2024-02-19T21:39:45.778 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:44.442267+0000 osd.3 (osd.3) 149 : cluster [DBG] 4.1b scrub starts 2024-02-19T21:39:45.778 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:44.443958+0000 osd.3 (osd.3) 150 : cluster [DBG] 4.1b scrub ok 2024-02-19T21:39:45.778 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:45.024953+0000 osd.1 (osd.1) 125 : cluster [DBG] 4.12 scrub starts 2024-02-19T21:39:45.778 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:45.026685+0000 osd.1 (osd.1) 126 : cluster [DBG] 4.12 scrub ok 2024-02-19T21:39:45.778 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:45.447663+0000 mon.c (mon.2) 40 : audit [DBG] from='client.? 172.21.15.80:0/1250712415' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:39:45.779 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:45.800 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:39:45.803 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:45.803 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:39:45.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:44.228460+0000 osd.6 (osd.6) 110 : cluster [DBG] 6.2 scrub starts 2024-02-19T21:39:45.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:44.231415+0000 osd.6 (osd.6) 111 : cluster [DBG] 6.2 scrub ok 2024-02-19T21:39:45.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:44.442267+0000 osd.3 (osd.3) 149 : cluster [DBG] 4.1b scrub starts 2024-02-19T21:39:45.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:44.443958+0000 osd.3 (osd.3) 150 : cluster [DBG] 4.1b scrub ok 2024-02-19T21:39:45.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:45.024953+0000 osd.1 (osd.1) 125 : cluster [DBG] 4.12 scrub starts 2024-02-19T21:39:45.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:45.026685+0000 osd.1 (osd.1) 126 : cluster [DBG] 4.12 scrub ok 2024-02-19T21:39:45.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:45.447663+0000 mon.c (mon.2) 40 : audit [DBG] from='client.? 172.21.15.80:0/1250712415' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:39:45.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:44.228460+0000 osd.6 (osd.6) 110 : cluster [DBG] 6.2 scrub starts 2024-02-19T21:39:45.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:44.231415+0000 osd.6 (osd.6) 111 : cluster [DBG] 6.2 scrub ok 2024-02-19T21:39:45.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:44.442267+0000 osd.3 (osd.3) 149 : cluster [DBG] 4.1b scrub starts 2024-02-19T21:39:45.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:44.443958+0000 osd.3 (osd.3) 150 : cluster [DBG] 4.1b scrub ok 2024-02-19T21:39:45.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:45.024953+0000 osd.1 (osd.1) 125 : cluster [DBG] 4.12 scrub starts 2024-02-19T21:39:45.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:45.026685+0000 osd.1 (osd.1) 126 : cluster [DBG] 4.12 scrub ok 2024-02-19T21:39:45.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:45.447663+0000 mon.c (mon.2) 40 : audit [DBG] from='client.? 172.21.15.80:0/1250712415' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:39:45.904 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:39:45.934 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:46.283 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:39:46.285 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:46.286 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:39:46.305 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:39:46.309 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:39:46.387 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:39:46.419 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:46.441 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:39:46.444 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:46.445 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:39:46.545 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:39:46.575 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:46.594 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:44.953306+0000 mgr.y (mgr.14514) 280 : cluster [DBG] pgmap v306: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 157 B/s rd, 0 op/s; 294 B/s, 7 objects/s recovering 2024-02-19T21:39:46.594 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:45.208490+0000 osd.6 (osd.6) 112 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:39:46.594 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:45.211384+0000 osd.6 (osd.6) 113 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:39:46.594 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:45.431235+0000 osd.3 (osd.3) 151 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:39:46.594 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:45.432176+0000 osd.3 (osd.3) 152 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:39:46.594 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:46.050835+0000 osd.7 (osd.7) 119 : cluster [DBG] 5.14 deep-scrub starts 2024-02-19T21:39:46.594 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:46.054883+0000 osd.7 (osd.7) 120 : cluster [DBG] 5.14 deep-scrub ok 2024-02-19T21:39:46.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:44.953306+0000 mgr.y (mgr.14514) 280 : cluster [DBG] pgmap v306: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 157 B/s rd, 0 op/s; 294 B/s, 7 objects/s recovering 2024-02-19T21:39:46.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:45.208490+0000 osd.6 (osd.6) 112 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:39:46.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:45.211384+0000 osd.6 (osd.6) 113 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:39:46.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:45.431235+0000 osd.3 (osd.3) 151 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:39:46.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:45.432176+0000 osd.3 (osd.3) 152 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:39:46.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:46.050835+0000 osd.7 (osd.7) 119 : cluster [DBG] 5.14 deep-scrub starts 2024-02-19T21:39:46.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:46.054883+0000 osd.7 (osd.7) 120 : cluster [DBG] 5.14 deep-scrub ok 2024-02-19T21:39:46.595 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:39:46.597 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:46.597 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:39:46.698 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:39:46.724 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:44.953306+0000 mgr.y (mgr.14514) 280 : cluster [DBG] pgmap v306: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 157 B/s rd, 0 op/s; 294 B/s, 7 objects/s recovering 2024-02-19T21:39:46.724 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:45.208490+0000 osd.6 (osd.6) 112 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:39:46.724 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:45.211384+0000 osd.6 (osd.6) 113 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:39:46.724 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:45.431235+0000 osd.3 (osd.3) 151 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:39:46.725 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:45.432176+0000 osd.3 (osd.3) 152 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:39:46.725 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:46.050835+0000 osd.7 (osd.7) 119 : cluster [DBG] 5.14 deep-scrub starts 2024-02-19T21:39:46.725 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:46.054883+0000 osd.7 (osd.7) 120 : cluster [DBG] 5.14 deep-scrub ok 2024-02-19T21:39:46.726 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:46.746 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:39:46.748 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:46.749 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:39:46.849 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:39:46.877 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:46.896 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:39:46.898 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:46.898 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:39:46.999 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:39:47.031 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:47.182 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:39:47.184 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:47.185 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:39:47.286 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:39:47.314 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:47.410 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 6, 7] out_osds: [2] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:39:47.410 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:39:47.410 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-02-19T21:39:47.410 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-02-19T21:39:47.411 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-02-19T21:39:47.411 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.2 config set filestore_inject_stall 3 2024-02-19T21:39:47.523 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-02-19T21:39:47.562 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:39:47.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:46.191460+0000 osd.0 (osd.0) 143 : cluster [DBG] 4.16 scrub starts 2024-02-19T21:39:47.566 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:46.193422+0000 osd.0 (osd.0) 144 : cluster [DBG] 4.16 scrub ok 2024-02-19T21:39:47.566 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:46.417438+0000 osd.3 (osd.3) 153 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:39:47.566 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:46.421088+0000 osd.3 (osd.3) 154 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:39:47.566 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:47.487288+0000 mon.a (mon.0) 969 : audit [INF] from='client.? 172.21.15.80:0/3764265549' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:39:47.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:46.191460+0000 osd.0 (osd.0) 143 : cluster [DBG] 4.16 scrub starts 2024-02-19T21:39:47.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:46.193422+0000 osd.0 (osd.0) 144 : cluster [DBG] 4.16 scrub ok 2024-02-19T21:39:47.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:46.417438+0000 osd.3 (osd.3) 153 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:39:47.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:46.421088+0000 osd.3 (osd.3) 154 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:39:47.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:47.487288+0000 mon.a (mon.0) 969 : audit [INF] from='client.? 172.21.15.80:0/3764265549' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:39:47.567 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:47.567 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:39:47.668 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:39:47.697 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:47.718 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:39:47.720 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:47.721 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:39:47.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:46.191460+0000 osd.0 (osd.0) 143 : cluster [DBG] 4.16 scrub starts 2024-02-19T21:39:47.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:46.193422+0000 osd.0 (osd.0) 144 : cluster [DBG] 4.16 scrub ok 2024-02-19T21:39:47.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:46.417438+0000 osd.3 (osd.3) 153 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:39:47.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:46.421088+0000 osd.3 (osd.3) 154 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:39:47.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:47.487288+0000 mon.a (mon.0) 969 : audit [INF] from='client.? 172.21.15.80:0/3764265549' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:39:47.821 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:39:47.850 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:47.869 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:39:47.871 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:47.872 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:39:47.973 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:39:48.002 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:48.022 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:39:48.025 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:48.025 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:39:48.126 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:39:48.153 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:48.172 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:39:48.174 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:48.175 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:39:48.275 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:39:48.302 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:48.321 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:39:48.323 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:48.324 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:39:48.424 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:39:48.451 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:48.469 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:39:48.472 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:48.472 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:39:48.573 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:39:48.599 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:48.618 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:39:48.621 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:48.621 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:39:48.722 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:39:48.746 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:46.953962+0000 mgr.y (mgr.14514) 281 : cluster [DBG] pgmap v307: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 127 B/s rd, 0 op/s; 239 B/s, 5 objects/s recovering 2024-02-19T21:39:48.746 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:47.391972+0000 osd.3 (osd.3) 155 : cluster [DBG] 4.1a scrub starts 2024-02-19T21:39:48.746 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:47.395563+0000 osd.3 (osd.3) 156 : cluster [DBG] 4.1a scrub ok 2024-02-19T21:39:48.746 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:47.509160+0000 mon.a (mon.0) 970 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:39:48.747 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:47.519806+0000 mon.a (mon.0) 971 : audit [INF] from='client.? 172.21.15.80:0/3764265549' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:39:48.747 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:47.519871+0000 mon.a (mon.0) 972 : cluster [DBG] osdmap e168: 8 total, 8 up, 7 in 2024-02-19T21:39:48.747 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:47.995997+0000 osd.7 (osd.7) 121 : cluster [DBG] 4.0 deep-scrub starts 2024-02-19T21:39:48.747 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:48.004691+0000 osd.7 (osd.7) 122 : cluster [DBG] 4.0 deep-scrub ok 2024-02-19T21:39:48.748 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:48.767 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:39:48.769 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:48.770 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:39:48.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:46.953962+0000 mgr.y (mgr.14514) 281 : cluster [DBG] pgmap v307: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 127 B/s rd, 0 op/s; 239 B/s, 5 objects/s recovering 2024-02-19T21:39:48.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:47.391972+0000 osd.3 (osd.3) 155 : cluster [DBG] 4.1a scrub starts 2024-02-19T21:39:48.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:47.395563+0000 osd.3 (osd.3) 156 : cluster [DBG] 4.1a scrub ok 2024-02-19T21:39:48.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:47.509160+0000 mon.a (mon.0) 970 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:39:48.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:47.519806+0000 mon.a (mon.0) 971 : audit [INF] from='client.? 172.21.15.80:0/3764265549' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:39:48.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:47.519871+0000 mon.a (mon.0) 972 : cluster [DBG] osdmap e168: 8 total, 8 up, 7 in 2024-02-19T21:39:48.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:47.995997+0000 osd.7 (osd.7) 121 : cluster [DBG] 4.0 deep-scrub starts 2024-02-19T21:39:48.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:48.004691+0000 osd.7 (osd.7) 122 : cluster [DBG] 4.0 deep-scrub ok 2024-02-19T21:39:48.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:46.953962+0000 mgr.y (mgr.14514) 281 : cluster [DBG] pgmap v307: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 127 B/s rd, 0 op/s; 239 B/s, 5 objects/s recovering 2024-02-19T21:39:48.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:47.391972+0000 osd.3 (osd.3) 155 : cluster [DBG] 4.1a scrub starts 2024-02-19T21:39:48.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:47.395563+0000 osd.3 (osd.3) 156 : cluster [DBG] 4.1a scrub ok 2024-02-19T21:39:48.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:47.509160+0000 mon.a (mon.0) 970 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:39:48.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:47.519806+0000 mon.a (mon.0) 971 : audit [INF] from='client.? 172.21.15.80:0/3764265549' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:39:48.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:47.519871+0000 mon.a (mon.0) 972 : cluster [DBG] osdmap e168: 8 total, 8 up, 7 in 2024-02-19T21:39:48.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:47.995997+0000 osd.7 (osd.7) 121 : cluster [DBG] 4.0 deep-scrub starts 2024-02-19T21:39:48.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:48.004691+0000 osd.7 (osd.7) 122 : cluster [DBG] 4.0 deep-scrub ok 2024-02-19T21:39:48.871 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:39:48.897 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:48.916 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:39:48.919 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:48.919 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:39:49.020 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:39:49.046 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:49.065 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:39:49.067 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:49.068 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:39:49.169 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:39:49.197 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:49.270 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:39:49.277 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:49.277 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:39:49.378 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:39:49.404 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:49.753 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:39:49.756 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:49.756 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:39:49.857 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:39:49.886 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:49.906 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:39:49.909 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:49.909 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:39:50.010 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:39:50.038 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:50.059 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:39:50.061 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:50.062 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:39:50.163 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:39:50.179 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:48.954292+0000 mgr.y (mgr.14514) 282 : cluster [DBG] pgmap v309: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 601 B/s rd, 0 op/s 2024-02-19T21:39:50.179 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:49.123734+0000 mon.a (mon.0) 973 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:39:50.180 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:49.764225+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 7]}]: dispatch 2024-02-19T21:39:50.180 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:49.764494+0000 mon.a (mon.0) 975 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2024-02-19T21:39:50.180 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:49.764726+0000 mon.a (mon.0) 976 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [1, 7]}]: dispatch 2024-02-19T21:39:50.180 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:49.764945+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1e", "id": [7, 5]}]: dispatch 2024-02-19T21:39:50.180 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:49.765186+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 7, 6, 0]}]: dispatch 2024-02-19T21:39:50.180 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:49.765403+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1", "id": [4, 6]}]: dispatch 2024-02-19T21:39:50.180 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:49.765622+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.d", "id": [0, 3]}]: dispatch 2024-02-19T21:39:50.180 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:49.765836+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.13", "id": [0, 6]}]: dispatch 2024-02-19T21:39:50.180 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:49.766051+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.14", "id": [7, 6]}]: dispatch 2024-02-19T21:39:50.190 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:50.211 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:39:50.213 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:50.213 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:39:50.314 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:39:50.340 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:50.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:48.954292+0000 mgr.y (mgr.14514) 282 : cluster [DBG] pgmap v309: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 601 B/s rd, 0 op/s 2024-02-19T21:39:50.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:49.123734+0000 mon.a (mon.0) 973 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:39:50.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:49.764225+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 7]}]: dispatch 2024-02-19T21:39:50.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:49.764494+0000 mon.a (mon.0) 975 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2024-02-19T21:39:50.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:49.764726+0000 mon.a (mon.0) 976 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [1, 7]}]: dispatch 2024-02-19T21:39:50.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:49.764945+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1e", "id": [7, 5]}]: dispatch 2024-02-19T21:39:50.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:49.765186+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 7, 6, 0]}]: dispatch 2024-02-19T21:39:50.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:49.765403+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1", "id": [4, 6]}]: dispatch 2024-02-19T21:39:50.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:49.765622+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.d", "id": [0, 3]}]: dispatch 2024-02-19T21:39:50.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:49.765836+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.13", "id": [0, 6]}]: dispatch 2024-02-19T21:39:50.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:49.766051+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.14", "id": [7, 6]}]: dispatch 2024-02-19T21:39:50.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:48.954292+0000 mgr.y (mgr.14514) 282 : cluster [DBG] pgmap v309: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 601 B/s rd, 0 op/s 2024-02-19T21:39:50.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:49.123734+0000 mon.a (mon.0) 973 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:39:50.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:49.764225+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 7]}]: dispatch 2024-02-19T21:39:50.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:49.764494+0000 mon.a (mon.0) 975 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2024-02-19T21:39:50.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:49.764726+0000 mon.a (mon.0) 976 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [1, 7]}]: dispatch 2024-02-19T21:39:50.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:49.764945+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1e", "id": [7, 5]}]: dispatch 2024-02-19T21:39:50.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:49.765186+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 7, 6, 0]}]: dispatch 2024-02-19T21:39:50.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:49.765403+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1", "id": [4, 6]}]: dispatch 2024-02-19T21:39:50.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:49.765622+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.d", "id": [0, 3]}]: dispatch 2024-02-19T21:39:50.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:49.765836+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.13", "id": [0, 6]}]: dispatch 2024-02-19T21:39:50.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:49.766051+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.14", "id": [7, 6]}]: dispatch 2024-02-19T21:39:50.359 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:39:50.361 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:50.362 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:39:50.463 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:39:50.490 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:50.557 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:39:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:39:51.097 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:39:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:39:50] "GET /metrics HTTP/1.1" 200 175688 "" "Prometheus/2.33.4" 2024-02-19T21:39:51.154 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:39:51.769 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-19T21:39:51.796 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:50.179598+0000 mgr.y (mgr.14514) 283 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:39:51.796 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:50.522155+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 7]}]': finished 2024-02-19T21:39:51.797 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:50.522217+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]': finished 2024-02-19T21:39:51.797 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:50.522267+0000 mon.a (mon.0) 985 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [1, 7]}]': finished 2024-02-19T21:39:51.797 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:50.522315+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1e", "id": [7, 5]}]': finished 2024-02-19T21:39:51.797 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:50.522342+0000 mon.a (mon.0) 987 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 7, 6, 0]}]': finished 2024-02-19T21:39:51.797 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:50.522368+0000 mon.a (mon.0) 988 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1", "id": [4, 6]}]': finished 2024-02-19T21:39:51.797 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:50.522392+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.d", "id": [0, 3]}]': finished 2024-02-19T21:39:51.798 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:50.522416+0000 mon.a (mon.0) 990 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.13", "id": [0, 6]}]': finished 2024-02-19T21:39:51.798 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:50.522439+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.14", "id": [7, 6]}]': finished 2024-02-19T21:39:51.798 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:50.522461+0000 mon.a (mon.0) 992 : cluster [DBG] osdmap e169: 8 total, 8 up, 7 in 2024-02-19T21:39:51.798 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:50.179598+0000 mgr.y (mgr.14514) 283 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:39:51.798 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:50.522155+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 7]}]': finished 2024-02-19T21:39:51.799 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:50.522217+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]': finished 2024-02-19T21:39:51.799 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:50.522267+0000 mon.a (mon.0) 985 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [1, 7]}]': finished 2024-02-19T21:39:51.799 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:50.522315+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1e", "id": [7, 5]}]': finished 2024-02-19T21:39:51.799 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:50.522342+0000 mon.a (mon.0) 987 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 7, 6, 0]}]': finished 2024-02-19T21:39:51.799 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:50.522368+0000 mon.a (mon.0) 988 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1", "id": [4, 6]}]': finished 2024-02-19T21:39:51.799 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:50.522392+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.d", "id": [0, 3]}]': finished 2024-02-19T21:39:51.799 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:50.522416+0000 mon.a (mon.0) 990 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.13", "id": [0, 6]}]': finished 2024-02-19T21:39:51.799 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:50.522439+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.14", "id": [7, 6]}]': finished 2024-02-19T21:39:51.799 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:50.522461+0000 mon.a (mon.0) 992 : cluster [DBG] osdmap e169: 8 total, 8 up, 7 in 2024-02-19T21:39:51.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:50.179598+0000 mgr.y (mgr.14514) 283 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:39:51.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:50.522155+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 7]}]': finished 2024-02-19T21:39:51.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:50.522217+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]': finished 2024-02-19T21:39:51.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:50.522267+0000 mon.a (mon.0) 985 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [1, 7]}]': finished 2024-02-19T21:39:51.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:50.522315+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1e", "id": [7, 5]}]': finished 2024-02-19T21:39:51.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:50.522342+0000 mon.a (mon.0) 987 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 7, 6, 0]}]': finished 2024-02-19T21:39:51.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:50.522368+0000 mon.a (mon.0) 988 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1", "id": [4, 6]}]': finished 2024-02-19T21:39:51.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:50.522392+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.d", "id": [0, 3]}]': finished 2024-02-19T21:39:51.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:50.522416+0000 mon.a (mon.0) 990 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.13", "id": [0, 6]}]': finished 2024-02-19T21:39:51.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:50.522439+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.14", "id": [7, 6]}]': finished 2024-02-19T21:39:51.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:50.522461+0000 mon.a (mon.0) 992 : cluster [DBG] osdmap e169: 8 total, 8 up, 7 in 2024-02-19T21:39:52.020 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:39:52.020 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-02-19T21:39:52.020 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-02-19T21:39:52.020 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:39:52.068 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:39:52.071 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:52.072 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:39:52.172 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:39:52.201 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:52.323 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:39:52.323 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:39:52.324 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:39:52.328 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:52.329 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:39:52.429 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:39:52.456 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:52.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:50.954608+0000 mgr.y (mgr.14514) 284 : cluster [DBG] pgmap v311: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:39:52.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:51.527041+0000 mon.a (mon.0) 993 : cluster [DBG] osdmap e170: 8 total, 8 up, 7 in 2024-02-19T21:39:52.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:50.954608+0000 mgr.y (mgr.14514) 284 : cluster [DBG] pgmap v311: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:39:52.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:51.527041+0000 mon.a (mon.0) 993 : cluster [DBG] osdmap e170: 8 total, 8 up, 7 in 2024-02-19T21:39:52.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:50.954608+0000 mgr.y (mgr.14514) 284 : cluster [DBG] pgmap v311: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:39:52.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:51.527041+0000 mon.a (mon.0) 993 : cluster [DBG] osdmap e170: 8 total, 8 up, 7 in 2024-02-19T21:39:52.904 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:39:52.907 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:52.907 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:39:52.913 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.2 dump_blocked_ops 2024-02-19T21:39:52.922 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:39:53.008 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:39:53.035 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:53.053 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:39:53.056 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:53.056 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:39:53.157 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:39:53.183 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:53.202 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:39:53.205 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:53.205 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:39:53.306 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:39:53.332 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:53.351 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:39:53.353 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:53.355 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:39:53.456 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:39:53.482 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:53.500 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:39:53.503 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:53.503 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:39:53.604 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:39:53.632 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:54.539 INFO:teuthology.orchestra.run.smithi080.stderr:enabled application 'rados' on pool 'unique_pool_1' 2024-02-19T21:39:54.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:52.954971+0000 mgr.y (mgr.14514) 285 : cluster [DBG] pgmap v313: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:39:54.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:53.877580+0000 mon.c (mon.2) 41 : audit [INF] from='client.? 172.21.15.80:0/3810072632' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T21:39:54.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:53.877894+0000 mon.a (mon.0) 994 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T21:39:54.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:52.954971+0000 mgr.y (mgr.14514) 285 : cluster [DBG] pgmap v313: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:39:54.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:53.877580+0000 mon.c (mon.2) 41 : audit [INF] from='client.? 172.21.15.80:0/3810072632' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T21:39:54.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:53.877894+0000 mon.a (mon.0) 994 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T21:39:54.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:52.954971+0000 mgr.y (mgr.14514) 285 : cluster [DBG] pgmap v313: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:39:54.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:53.877580+0000 mon.c (mon.2) 41 : audit [INF] from='client.? 172.21.15.80:0/3810072632' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T21:39:54.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:53.877894+0000 mon.a (mon.0) 994 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T21:39:55.807 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:39:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:39:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:39:55.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:54.535705+0000 mon.a (mon.0) 995 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-19T21:39:55.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:54.535769+0000 mon.a (mon.0) 996 : cluster [DBG] osdmap e171: 8 total, 8 up, 7 in 2024-02-19T21:39:55.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:54.535705+0000 mon.a (mon.0) 995 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-19T21:39:55.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:54.535769+0000 mon.a (mon.0) 996 : cluster [DBG] osdmap e171: 8 total, 8 up, 7 in 2024-02-19T21:39:55.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:54.535705+0000 mon.a (mon.0) 995 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-19T21:39:55.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:54.535769+0000 mon.a (mon.0) 996 : cluster [DBG] osdmap e171: 8 total, 8 up, 7 in 2024-02-19T21:39:56.683 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:39:56.685 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:56.686 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:39:56.787 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:39:56.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:54.955685+0000 mgr.y (mgr.14514) 286 : cluster [DBG] pgmap v315: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 1.7 KiB/s rd, 1 op/s; 36 B/s, 2 objects/s recovering 2024-02-19T21:39:56.819 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:56.840 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:39:56.843 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:56.844 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:39:56.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:54.955685+0000 mgr.y (mgr.14514) 286 : cluster [DBG] pgmap v315: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 1.7 KiB/s rd, 1 op/s; 36 B/s, 2 objects/s recovering 2024-02-19T21:39:56.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:54.955685+0000 mgr.y (mgr.14514) 286 : cluster [DBG] pgmap v315: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 1.7 KiB/s rd, 1 op/s; 36 B/s, 2 objects/s recovering 2024-02-19T21:39:56.897 DEBUG:teuthology.orchestra.run.smithi080:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_1 bench 90 write' 2024-02-19T21:39:56.900 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-02-19T21:39:56.900 INFO:teuthology.orchestra.run:waiting for 3000 2024-02-19T21:39:56.945 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:39:56.950 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:hints = 1 2024-02-19T21:39:56.950 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-02-19T21:39:56.950 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Object prefix: benchmark_data_smithi080_100924 2024-02-19T21:39:56.950 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-19T21:39:56.950 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 0 0 0 0 0 0 - 0 2024-02-19T21:39:56.992 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:57.027 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:39:57.031 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:57.032 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:39:57.133 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:39:57.175 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:57.202 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:39:57.204 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:57.205 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:39:57.306 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:39:57.308 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:39:57.345 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:57.372 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:39:57.376 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:57.376 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:39:57.477 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:39:57.524 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:57.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:57.251485+0000 mon.c (mon.2) 42 : audit [INF] from='client.? 172.21.15.80:0/3079881221' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:39:57.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:57.252021+0000 mon.a (mon.0) 997 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:39:57.569 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-02-19T21:39:57.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:57.251485+0000 mon.c (mon.2) 42 : audit [INF] from='client.? 172.21.15.80:0/3079881221' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:39:57.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:57.252021+0000 mon.a (mon.0) 997 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:39:57.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:57.251485+0000 mon.c (mon.2) 42 : audit [INF] from='client.? 172.21.15.80:0/3079881221' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:39:57.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:57.252021+0000 mon.a (mon.0) 997 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:39:57.951 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 1 16 3594 3578 223.396 223.625 0.00369478 0.00446351 2024-02-19T21:39:58.081 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:39:58.084 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:58.085 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:39:58.185 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:39:58.229 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:39:58.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:56.956231+0000 mgr.y (mgr.14514) 287 : cluster [DBG] pgmap v316: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 636 B/s rd, 0 op/s; 68 B/s, 4 objects/s recovering 2024-02-19T21:39:58.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:57.542761+0000 mon.a (mon.0) 998 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:39:58.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:39:57.560546+0000 mon.a (mon.0) 999 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:39:58.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:39:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:57.560579+0000 mon.a (mon.0) 1000 : cluster [DBG] osdmap e172: 8 total, 8 up, 7 in 2024-02-19T21:39:58.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:56.956231+0000 mgr.y (mgr.14514) 287 : cluster [DBG] pgmap v316: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 636 B/s rd, 0 op/s; 68 B/s, 4 objects/s recovering 2024-02-19T21:39:58.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:57.542761+0000 mon.a (mon.0) 998 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:39:58.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:39:57.560546+0000 mon.a (mon.0) 999 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:39:58.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:39:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:57.560579+0000 mon.a (mon.0) 1000 : cluster [DBG] osdmap e172: 8 total, 8 up, 7 in 2024-02-19T21:39:58.951 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 2 16 7234 7218 225.435 227.5 0.00341029 0.00442687 2024-02-19T21:39:59.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:56.956231+0000 mgr.y (mgr.14514) 287 : cluster [DBG] pgmap v316: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 636 B/s rd, 0 op/s; 68 B/s, 4 objects/s recovering 2024-02-19T21:39:59.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:57.542761+0000 mon.a (mon.0) 998 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:39:59.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:39:57.560546+0000 mon.a (mon.0) 999 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:39:59.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:39:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:57.560579+0000 mon.a (mon.0) 1000 : cluster [DBG] osdmap e172: 8 total, 8 up, 7 in 2024-02-19T21:39:59.924 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:39:59.927 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:39:59.928 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:39:59.951 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 3 16 10497 10481 218.266 203.938 0.00369155 0.00457429 2024-02-19T21:40:00.029 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:40:00.084 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:00.540 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:40:00.546 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:00.546 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:40:00.557 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:40:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:40:00.647 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:40:00.697 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:00.725 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:40:00.728 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:00.728 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:40:00.829 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:40:00.848 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:40:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:40:00] "GET /metrics HTTP/1.1" 200 175688 "" "Prometheus/2.33.4" 2024-02-19T21:40:00.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:39:58.956659+0000 mgr.y (mgr.14514) 288 : cluster [DBG] pgmap v318: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 551 B/s rd, 0 op/s; 59 B/s, 4 objects/s recovering 2024-02-19T21:40:00.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:00.000115+0000 mon.a (mon.0) 1001 : cluster [WRN] Health detail: HEALTH_WARN noscrub,nodeep-scrub flag(s) set 2024-02-19T21:40:00.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:00.000155+0000 mon.a (mon.0) 1002 : cluster [WRN] [WRN] OSDMAP_FLAGS: noscrub,nodeep-scrub flag(s) set 2024-02-19T21:40:00.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:39:58.956659+0000 mgr.y (mgr.14514) 288 : cluster [DBG] pgmap v318: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 551 B/s rd, 0 op/s; 59 B/s, 4 objects/s recovering 2024-02-19T21:40:00.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:00.000115+0000 mon.a (mon.0) 1001 : cluster [WRN] Health detail: HEALTH_WARN noscrub,nodeep-scrub flag(s) set 2024-02-19T21:40:00.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:00.000155+0000 mon.a (mon.0) 1002 : cluster [WRN] [WRN] OSDMAP_FLAGS: noscrub,nodeep-scrub flag(s) set 2024-02-19T21:40:00.876 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:00.951 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 4 16 13420 13404 209.37 182.688 0.00299957 0.00476876 2024-02-19T21:40:01.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:39:58.956659+0000 mgr.y (mgr.14514) 288 : cluster [DBG] pgmap v318: 148 pgs: 148 active+clean; 5.7 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 551 B/s rd, 0 op/s; 59 B/s, 4 objects/s recovering 2024-02-19T21:40:01.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:00.000115+0000 mon.a (mon.0) 1001 : cluster [WRN] Health detail: HEALTH_WARN noscrub,nodeep-scrub flag(s) set 2024-02-19T21:40:01.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:00.000155+0000 mon.a (mon.0) 1002 : cluster [WRN] [WRN] OSDMAP_FLAGS: noscrub,nodeep-scrub flag(s) set 2024-02-19T21:40:01.715 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:00.191262+0000 mgr.y (mgr.14514) 289 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:40:01.715 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:01.441289+0000 mon.b (mon.1) 45 : audit [DBG] from='client.? 172.21.15.80:0/1107608074' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:40:01.715 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:00.191262+0000 mgr.y (mgr.14514) 289 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:40:01.715 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:01.441289+0000 mon.b (mon.1) 45 : audit [DBG] from='client.? 172.21.15.80:0/1107608074' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:40:01.952 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 5 15 16120 16105 201.258 168.812 0.00629008 0.00496202 2024-02-19T21:40:02.002 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:40:02.002 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2024-02-19T21:40:02.002 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:40:02.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:00.191262+0000 mgr.y (mgr.14514) 289 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:40:02.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:01.441289+0000 mon.b (mon.1) 45 : audit [DBG] from='client.? 172.21.15.80:0/1107608074' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:40:02.569 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset noscrub 2024-02-19T21:40:02.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:00.957381+0000 mgr.y (mgr.14514) 290 : cluster [DBG] pgmap v319: 148 pgs: 148 active+clean; 647 MiB data, 3.6 GiB used, 622 GiB / 626 GiB avail; 1.1 KiB/s rd, 81 MiB/s wr, 1.29k op/s; 54 B/s, 3 objects/s recovering 2024-02-19T21:40:02.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:00.957381+0000 mgr.y (mgr.14514) 290 : cluster [DBG] pgmap v319: 148 pgs: 148 active+clean; 647 MiB data, 3.6 GiB used, 622 GiB / 626 GiB avail; 1.1 KiB/s rd, 81 MiB/s wr, 1.29k op/s; 54 B/s, 3 objects/s recovering 2024-02-19T21:40:02.952 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 6 16 18835 18819 195.983 169.625 0.00343398 0.00509598 2024-02-19T21:40:03.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:00.957381+0000 mgr.y (mgr.14514) 290 : cluster [DBG] pgmap v319: 148 pgs: 148 active+clean; 647 MiB data, 3.6 GiB used, 622 GiB / 626 GiB avail; 1.1 KiB/s rd, 81 MiB/s wr, 1.29k op/s; 54 B/s, 3 objects/s recovering 2024-02-19T21:40:03.343 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:40:03.343 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:40:03.343 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:40:03.343 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:40:03.343 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:40:03.343 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:40:03.343 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:40:03.343 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:40:03.344 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:40:03.344 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:40:03.344 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:40:03.344 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:40:03.344 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:40:03.344 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:40:03.344 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:40:03.344 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:40:03.641 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:40:03.649 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:03.649 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:40:03.750 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:40:03.796 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:03.822 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:40:03.826 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:03.826 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:40:03.927 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:40:03.952 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 7 15 21416 21401 191.038 161.375 0.00597581 0.00522936 2024-02-19T21:40:03.973 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:03.999 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:40:04.001 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:04.002 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:40:04.102 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:40:04.147 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:04.250 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:40:04.257 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:04.257 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:40:04.358 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:40:04.400 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:04.830 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:02.957778+0000 mgr.y (mgr.14514) 291 : cluster [DBG] pgmap v320: 148 pgs: 148 active+clean; 647 MiB data, 3.6 GiB used, 622 GiB / 626 GiB avail; 1.1 KiB/s rd, 77 MiB/s wr, 1.23k op/s; 52 B/s, 3 objects/s recovering 2024-02-19T21:40:04.830 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:02.957778+0000 mgr.y (mgr.14514) 291 : cluster [DBG] pgmap v320: 148 pgs: 148 active+clean; 647 MiB data, 3.6 GiB used, 622 GiB / 626 GiB avail; 1.1 KiB/s rd, 77 MiB/s wr, 1.23k op/s; 52 B/s, 3 objects/s recovering 2024-02-19T21:40:04.864 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:40:04.869 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:04.869 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:40:04.952 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 8 16 23806 23790 185.822 149.312 0.00294926 0.00537529 2024-02-19T21:40:04.971 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:40:05.021 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:05.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:02.957778+0000 mgr.y (mgr.14514) 291 : cluster [DBG] pgmap v320: 148 pgs: 148 active+clean; 647 MiB data, 3.6 GiB used, 622 GiB / 626 GiB avail; 1.1 KiB/s rd, 77 MiB/s wr, 1.23k op/s; 52 B/s, 3 objects/s recovering 2024-02-19T21:40:05.151 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:40:05.159 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:05.160 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:40:05.261 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:40:05.308 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:05.491 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:40:05.496 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:05.497 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:40:05.509 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:40:05.555 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:40:05.555 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:40:05.598 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:40:05.642 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:05.850 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:40:05.858 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:05.859 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:40:05.952 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 9 16 25902 25886 179.73 131 0.0044667 0.00555887 2024-02-19T21:40:05.959 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:40:06.015 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:06.057 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:40:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:40:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:40:06.276 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:40:06.372 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:40:06.383 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:06.383 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:40:06.484 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:40:06.529 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:06.785 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:40:06.789 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:06.790 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:40:06.891 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:40:06.926 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:04.958427+0000 mgr.y (mgr.14514) 292 : cluster [DBG] pgmap v321: 148 pgs: 148 active+clean; 1.2 GiB data, 5.6 GiB used, 620 GiB / 626 GiB avail; 921 B/s rd, 121 MiB/s wr, 1.94k op/s; 21 B/s, 1 objects/s recovering 2024-02-19T21:40:06.927 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:05.947878+0000 mon.a (mon.0) 1003 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:40:06.927 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:06.437041+0000 mon.a (mon.0) 1004 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:40:06.927 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:06.438365+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:40:06.927 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:06.448748+0000 mon.a (mon.0) 1006 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:40:06.927 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:04.958427+0000 mgr.y (mgr.14514) 292 : cluster [DBG] pgmap v321: 148 pgs: 148 active+clean; 1.2 GiB data, 5.6 GiB used, 620 GiB / 626 GiB avail; 921 B/s rd, 121 MiB/s wr, 1.94k op/s; 21 B/s, 1 objects/s recovering 2024-02-19T21:40:06.927 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:05.947878+0000 mon.a (mon.0) 1003 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:40:06.927 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:06.437041+0000 mon.a (mon.0) 1004 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:40:06.927 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:06.438365+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:40:06.928 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:06.448748+0000 mon.a (mon.0) 1006 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:40:06.931 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:06.952 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 10 15 27911 27896 174.31 125.625 0.0121826 0.00573081 2024-02-19T21:40:07.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:04.958427+0000 mgr.y (mgr.14514) 292 : cluster [DBG] pgmap v321: 148 pgs: 148 active+clean; 1.2 GiB data, 5.6 GiB used, 620 GiB / 626 GiB avail; 921 B/s rd, 121 MiB/s wr, 1.94k op/s; 21 B/s, 1 objects/s recovering 2024-02-19T21:40:07.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:05.947878+0000 mon.a (mon.0) 1003 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:40:07.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:06.437041+0000 mon.a (mon.0) 1004 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:40:07.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:06.438365+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:40:07.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:06.448748+0000 mon.a (mon.0) 1006 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:40:07.404 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.2 dump_historic_ops 2024-02-19T21:40:07.417 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:40:07.423 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:07.423 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:40:07.524 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:40:07.571 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:07.602 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:40:07.605 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:07.606 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:40:07.707 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:40:07.746 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:07.953 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 11 16 30045 30029 170.582 133.312 0.00524515 0.00585709 2024-02-19T21:40:08.077 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:40:08.236 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 6, 7] out_osds: [2] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:40:08.236 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:40:08.236 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-02-19T21:40:08.236 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd dump -f json-pretty 2024-02-19T21:40:08.953 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 12 16 32063 32047 166.877 126.125 0.00579212 0.00598704 2024-02-19T21:40:09.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:06.959465+0000 mgr.y (mgr.14514) 293 : cluster [DBG] pgmap v322: 148 pgs: 148 active+clean; 1.4 GiB data, 6.2 GiB used, 620 GiB / 626 GiB avail; 1023 B/s rd, 148 MiB/s wr, 2.37k op/s 2024-02-19T21:40:09.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:06.959465+0000 mgr.y (mgr.14514) 293 : cluster [DBG] pgmap v322: 148 pgs: 148 active+clean; 1.4 GiB data, 6.2 GiB used, 620 GiB / 626 GiB avail; 1023 B/s rd, 148 MiB/s wr, 2.37k op/s 2024-02-19T21:40:09.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:06.959465+0000 mgr.y (mgr.14514) 293 : cluster [DBG] pgmap v322: 148 pgs: 148 active+clean; 1.4 GiB data, 6.2 GiB used, 620 GiB / 626 GiB avail; 1023 B/s rd, 148 MiB/s wr, 2.37k op/s 2024-02-19T21:40:09.811 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:40:09.815 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:09.815 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:40:09.916 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:40:09.953 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 13 16 34042 34026 163.555 123.688 0.00765051 0.00610842 2024-02-19T21:40:09.958 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:09.991 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:40:09.997 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:09.997 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:40:10.098 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:40:10.156 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:10.192 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:40:10.195 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:10.196 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:40:10.296 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:40:10.307 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:40:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:40:10.351 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:10.380 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:40:10.384 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:10.384 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:40:10.485 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:40:10.533 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:10.559 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:40:10.563 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:10.563 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:40:10.625 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:08.960636+0000 mgr.y (mgr.14514) 294 : cluster [DBG] pgmap v323: 148 pgs: 148 active+clean; 1.4 GiB data, 6.2 GiB used, 620 GiB / 626 GiB avail; 898 B/s rd, 130 MiB/s wr, 2.08k op/s 2024-02-19T21:40:10.664 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:40:10.703 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:10.736 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:40:10.739 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:10.739 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:40:10.773 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:08.960636+0000 mgr.y (mgr.14514) 294 : cluster [DBG] pgmap v323: 148 pgs: 148 active+clean; 1.4 GiB data, 6.2 GiB used, 620 GiB / 626 GiB avail; 898 B/s rd, 130 MiB/s wr, 2.08k op/s 2024-02-19T21:40:10.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:08.960636+0000 mgr.y (mgr.14514) 294 : cluster [DBG] pgmap v323: 148 pgs: 148 active+clean; 1.4 GiB data, 6.2 GiB used, 620 GiB / 626 GiB avail; 898 B/s rd, 130 MiB/s wr, 2.08k op/s 2024-02-19T21:40:10.774 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:40:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:40:10] "GET /metrics HTTP/1.1" 200 175758 "" "Prometheus/2.33.4" 2024-02-19T21:40:10.840 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:40:10.890 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:10.923 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:40:10.928 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:10.929 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:40:10.953 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 14 16 35714 35698 159.336 104.5 0.00689756 0.00627182 2024-02-19T21:40:11.029 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:40:11.082 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:11.115 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:40:11.121 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:11.122 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:40:11.222 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:40:11.266 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:11.618 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:40:11.631 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:40:11.637 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:11.637 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:40:11.637 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:40:11.670 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-02-19T21:40:11.739 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:40:11.779 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:11.953 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 15 16 37513 37497 156.209 112.438 0.00655556 0.00639567 2024-02-19T21:40:11.972 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:10.202227+0000 mgr.y (mgr.14514) 295 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:40:11.973 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:10.860257+0000 mon.a (mon.0) 1007 : audit [INF] from='client.? 172.21.15.80:0/4091331957' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:40:11.973 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:10.202227+0000 mgr.y (mgr.14514) 295 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:40:11.973 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:10.860257+0000 mon.a (mon.0) 1007 : audit [INF] from='client.? 172.21.15.80:0/4091331957' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:40:12.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:10.202227+0000 mgr.y (mgr.14514) 295 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:40:12.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:10.860257+0000 mon.a (mon.0) 1007 : audit [INF] from='client.? 172.21.15.80:0/4091331957' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:40:12.240 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:40:12.243 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:12.243 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:40:12.344 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:40:12.391 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:12.427 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:40:12.430 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:12.430 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:40:12.531 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:40:12.579 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:12.644 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:10.961441+0000 mgr.y (mgr.14514) 296 : cluster [DBG] pgmap v324: 148 pgs: 148 active+clean; 2.1 GiB data, 8.1 GiB used, 618 GiB / 626 GiB avail; 1.2 KiB/s rd, 177 MiB/s wr, 2.83k op/s 2024-02-19T21:40:12.644 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:11.622028+0000 mon.a (mon.0) 1008 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:40:12.644 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:11.641989+0000 mon.a (mon.0) 1009 : audit [INF] from='client.? 172.21.15.80:0/4091331957' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:40:12.789 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:40:12.793 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:12.793 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:40:12.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:10.961441+0000 mgr.y (mgr.14514) 296 : cluster [DBG] pgmap v324: 148 pgs: 148 active+clean; 2.1 GiB data, 8.1 GiB used, 618 GiB / 626 GiB avail; 1.2 KiB/s rd, 177 MiB/s wr, 2.83k op/s 2024-02-19T21:40:12.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:11.622028+0000 mon.a (mon.0) 1008 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:40:12.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:11.641989+0000 mon.a (mon.0) 1009 : audit [INF] from='client.? 172.21.15.80:0/4091331957' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:40:12.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:11.642042+0000 mon.a (mon.0) 1010 : cluster [DBG] osdmap e173: 8 total, 8 up, 7 in 2024-02-19T21:40:12.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:11.871816+0000 osd.7 (osd.7) 123 : cluster [DBG] 2.5 scrub starts 2024-02-19T21:40:12.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:11.877747+0000 osd.7 (osd.7) 124 : cluster [DBG] 2.5 scrub ok 2024-02-19T21:40:12.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:10.961441+0000 mgr.y (mgr.14514) 296 : cluster [DBG] pgmap v324: 148 pgs: 148 active+clean; 2.1 GiB data, 8.1 GiB used, 618 GiB / 626 GiB avail; 1.2 KiB/s rd, 177 MiB/s wr, 2.83k op/s 2024-02-19T21:40:12.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:11.622028+0000 mon.a (mon.0) 1008 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:40:12.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:11.641989+0000 mon.a (mon.0) 1009 : audit [INF] from='client.? 172.21.15.80:0/4091331957' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:40:12.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:11.642042+0000 mon.a (mon.0) 1010 : cluster [DBG] osdmap e173: 8 total, 8 up, 7 in 2024-02-19T21:40:12.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:11.871816+0000 osd.7 (osd.7) 123 : cluster [DBG] 2.5 scrub starts 2024-02-19T21:40:12.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:11.877747+0000 osd.7 (osd.7) 124 : cluster [DBG] 2.5 scrub ok 2024-02-19T21:40:12.894 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:40:12.937 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:12.953 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 16 16 39333 39317 153.555 113.75 0.00783171 0.00650739 2024-02-19T21:40:12.972 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:40:12.975 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:12.976 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:40:13.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:11.642042+0000 mon.a (mon.0) 1010 : cluster [DBG] osdmap e173: 8 total, 8 up, 7 in 2024-02-19T21:40:13.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:11.871816+0000 osd.7 (osd.7) 123 : cluster [DBG] 2.5 scrub starts 2024-02-19T21:40:13.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:11.877747+0000 osd.7 (osd.7) 124 : cluster [DBG] 2.5 scrub ok 2024-02-19T21:40:13.077 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:40:13.120 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:13.680 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:40:13.684 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:13.684 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:40:13.785 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:40:13.839 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:13.921 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:12.832358+0000 osd.5 (osd.5) 135 : cluster [DBG] 4.f scrub starts 2024-02-19T21:40:13.922 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:12.838076+0000 osd.5 (osd.5) 136 : cluster [DBG] 4.f scrub ok 2024-02-19T21:40:13.922 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:12.888504+0000 osd.7 (osd.7) 125 : cluster [DBG] 6.1b scrub starts 2024-02-19T21:40:13.922 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:12.925417+0000 osd.7 (osd.7) 126 : cluster [DBG] 6.1b scrub ok 2024-02-19T21:40:13.922 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:12.832358+0000 osd.5 (osd.5) 135 : cluster [DBG] 4.f scrub starts 2024-02-19T21:40:13.922 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:12.838076+0000 osd.5 (osd.5) 136 : cluster [DBG] 4.f scrub ok 2024-02-19T21:40:13.922 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:12.888504+0000 osd.7 (osd.7) 125 : cluster [DBG] 6.1b scrub starts 2024-02-19T21:40:13.922 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:12.925417+0000 osd.7 (osd.7) 126 : cluster [DBG] 6.1b scrub ok 2024-02-19T21:40:13.953 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 17 16 41098 41082 151.011 110.312 0.0161087 0.00661705 2024-02-19T21:40:14.052 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:40:14.057 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:14.057 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:40:14.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:12.832358+0000 osd.5 (osd.5) 135 : cluster [DBG] 4.f scrub starts 2024-02-19T21:40:14.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:12.838076+0000 osd.5 (osd.5) 136 : cluster [DBG] 4.f scrub ok 2024-02-19T21:40:14.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:12.888504+0000 osd.7 (osd.7) 125 : cluster [DBG] 6.1b scrub starts 2024-02-19T21:40:14.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:12.925417+0000 osd.7 (osd.7) 126 : cluster [DBG] 6.1b scrub ok 2024-02-19T21:40:14.158 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:40:14.200 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:14.791 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-19T21:40:14.826 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:12.961766+0000 mgr.y (mgr.14514) 297 : cluster [DBG] pgmap v326: 148 pgs: 148 active+clean; 2.1 GiB data, 8.1 GiB used, 618 GiB / 626 GiB avail; 1023 B/s rd, 147 MiB/s wr, 2.36k op/s 2024-02-19T21:40:14.826 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:12.961766+0000 mgr.y (mgr.14514) 297 : cluster [DBG] pgmap v326: 148 pgs: 148 active+clean; 2.1 GiB data, 8.1 GiB used, 618 GiB / 626 GiB avail; 1023 B/s rd, 147 MiB/s wr, 2.36k op/s 2024-02-19T21:40:14.954 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 18 16 42829 42813 148.626 108.188 0.0125777 0.00672368 2024-02-19T21:40:15.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:12.961766+0000 mgr.y (mgr.14514) 297 : cluster [DBG] pgmap v326: 148 pgs: 148 active+clean; 2.1 GiB data, 8.1 GiB used, 618 GiB / 626 GiB avail; 1023 B/s rd, 147 MiB/s wr, 2.36k op/s 2024-02-19T21:40:15.862 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:40:15.865 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:15.865 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:40:15.954 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 19 16 44527 44511 146.389 106.125 0.0141737 0.00682677 2024-02-19T21:40:15.966 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:40:16.012 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:14.290839+0000 osd.1 (osd.1) 127 : cluster [DBG] 2.9 scrub starts 2024-02-19T21:40:16.012 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:14.294060+0000 osd.1 (osd.1) 128 : cluster [DBG] 2.9 scrub ok 2024-02-19T21:40:16.013 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:40:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:40:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:40:16.020 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:16.048 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:40:16.050 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:16.051 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:40:16.059 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:40:16.088 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:40:16.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:14.290839+0000 osd.1 (osd.1) 127 : cluster [DBG] 2.9 scrub starts 2024-02-19T21:40:16.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:14.294060+0000 osd.1 (osd.1) 128 : cluster [DBG] 2.9 scrub ok 2024-02-19T21:40:16.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:14.290839+0000 osd.1 (osd.1) 127 : cluster [DBG] 2.9 scrub starts 2024-02-19T21:40:16.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:14.294060+0000 osd.1 (osd.1) 128 : cluster [DBG] 2.9 scrub ok 2024-02-19T21:40:16.116 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:40:16.151 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:40:16.151 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:40:16.182 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:40:16.203 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:16.221 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:40:16.251 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:40:16.284 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:40:16.286 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:40:16.291 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:16.292 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:40:16.302 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:40:16.302 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:40:16.302 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:40:16.302 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:40:16.302 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:40:16.302 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:40:16.302 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:40:16.302 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:40:16.392 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:40:16.447 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:16.481 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:40:16.486 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:16.487 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:40:16.588 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:40:16.638 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:16.676 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:40:16.680 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:16.681 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:40:16.781 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:40:16.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:14.962422+0000 mgr.y (mgr.14514) 298 : cluster [DBG] pgmap v327: 148 pgs: 148 active+clean; 2.4 GiB data, 9.3 GiB used, 617 GiB / 626 GiB avail; 1023 B/s rd, 129 MiB/s wr, 2.06k op/s 2024-02-19T21:40:16.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:15.262811+0000 osd.1 (osd.1) 129 : cluster [DBG] 5.1d scrub starts 2024-02-19T21:40:16.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:15.269712+0000 osd.1 (osd.1) 130 : cluster [DBG] 5.1d scrub ok 2024-02-19T21:40:16.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:16.032478+0000 mon.a (mon.0) 1011 : audit [DBG] from='client.? 172.21.15.80:0/1368676798' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:40:16.831 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:16.868 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:40:16.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:14.962422+0000 mgr.y (mgr.14514) 298 : cluster [DBG] pgmap v327: 148 pgs: 148 active+clean; 2.4 GiB data, 9.3 GiB used, 617 GiB / 626 GiB avail; 1023 B/s rd, 129 MiB/s wr, 2.06k op/s 2024-02-19T21:40:16.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:15.262811+0000 osd.1 (osd.1) 129 : cluster [DBG] 5.1d scrub starts 2024-02-19T21:40:16.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:15.269712+0000 osd.1 (osd.1) 130 : cluster [DBG] 5.1d scrub ok 2024-02-19T21:40:16.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:16.032478+0000 mon.a (mon.0) 1011 : audit [DBG] from='client.? 172.21.15.80:0/1368676798' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:40:16.873 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:14.962422+0000 mgr.y (mgr.14514) 298 : cluster [DBG] pgmap v327: 148 pgs: 148 active+clean; 2.4 GiB data, 9.3 GiB used, 617 GiB / 626 GiB avail; 1023 B/s rd, 129 MiB/s wr, 2.06k op/s 2024-02-19T21:40:16.873 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:15.262811+0000 osd.1 (osd.1) 129 : cluster [DBG] 5.1d scrub starts 2024-02-19T21:40:16.874 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:15.269712+0000 osd.1 (osd.1) 130 : cluster [DBG] 5.1d scrub ok 2024-02-19T21:40:16.874 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:16.032478+0000 mon.a (mon.0) 1011 : audit [DBG] from='client.? 172.21.15.80:0/1368676798' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:40:16.874 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:16.874 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:40:16.954 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:2024-02-19T21:40:16.954638+0000 min lat: 0.00129851 max lat: 0.0675147 avg lat: 0.00694675 2024-02-19T21:40:16.954 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-19T21:40:16.954 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 20 16 46057 46041 143.851 95.625 0.00633303 0.00694675 2024-02-19T21:40:16.976 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:40:17.025 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:17.047 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:40:17.052 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:17.053 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:40:17.153 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:40:17.199 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:17.230 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:40:17.236 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:17.236 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:40:17.337 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:40:17.385 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:17.418 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:40:17.419 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:40:17.419 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 173, 2024-02-19T21:40:17.419 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "6f763558-cf6d-11ee-95bb-87774f69a715", 2024-02-19T21:40:17.419 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2024-02-19T21:26:16.880265+0000", 2024-02-19T21:40:17.419 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2024-02-19T21:40:11.621762+0000", 2024-02-19T21:40:17.419 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2024-02-19T21:32:14.805693+0000", 2024-02-19T21:40:17.419 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2024-02-19T21:39:38.443319+0000", 2024-02-19T21:40:17.419 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-02-19T21:40:17.419 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5804032, 2024-02-19T21:40:17.419 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2024-02-19T21:40:17.420 INFO:teuthology.orchestra.run.smithi080.stdout: "nodeep-scrub", 2024-02-19T21:40:17.420 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2024-02-19T21:40:17.420 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2024-02-19T21:40:17.420 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2024-02-19T21:40:17.420 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2024-02-19T21:40:17.420 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:40:17.420 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 18, 2024-02-19T21:40:17.420 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2024-02-19T21:40:17.420 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-02-19T21:40:17.420 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2024-02-19T21:40:17.420 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2024-02-19T21:40:17.420 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 8, 2024-02-19T21:40:17.421 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2024-02-19T21:40:17.421 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "luminous", 2024-02-19T21:40:17.421 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "luminous", 2024-02-19T21:40:17.421 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "pacific", 2024-02-19T21:40:17.421 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2024-02-19T21:40:17.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.421 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2024-02-19T21:40:17.421 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "device_health_metrics", 2024-02-19T21:40:17.421 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:30:05.947623+0000", 2024-02-19T21:40:17.421 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:40:17.421 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:40:17.422 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:40:17.422 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:40:17.422 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:40:17.422 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:40:17.422 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:40:17.422 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:40:17.422 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:40:17.422 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:40:17.422 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:40:17.422 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:40:17.422 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 1, 2024-02-19T21:40:17.422 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 1, 2024-02-19T21:40:17.423 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 1, 2024-02-19T21:40:17.423 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 1, 2024-02-19T21:40:17.423 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 1, 2024-02-19T21:40:17.423 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:40:17.423 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:40:17.423 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:40:17.423 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:40:17.423 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:40:17.423 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:40:17.423 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:40:17.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.423 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "74", 2024-02-19T21:40:17.424 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:40:17.424 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:40:17.424 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:40:17.424 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:40:17.424 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:40:17.424 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:40:17.424 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:40:17.424 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:40:17.424 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:40:17.424 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:40:17.424 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:40:17.425 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:40:17.425 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:40:17.425 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:40:17.425 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:40:17.425 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:40:17.425 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:40:17.425 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:40:17.425 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:40:17.425 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:40:17.425 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:40:17.425 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:40:17.425 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:40:17.425 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:40:17.426 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:40:17.426 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:40:17.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.426 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:40:17.426 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:40:17.426 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:40:17.426 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:40:17.426 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:40:17.426 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:40:17.426 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:40:17.426 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:40:17.427 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:40:17.427 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:40:17.427 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:40:17.427 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2024-02-19T21:40:17.427 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_max": 32, 2024-02-19T21:40:17.427 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 1 2024-02-19T21:40:17.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.427 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:40:17.427 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_devicehealth": {} 2024-02-19T21:40:17.427 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.428 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 2, 2024-02-19T21:40:17.428 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": ".rgw.root", 2024-02-19T21:40:17.428 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:22.082250+0000", 2024-02-19T21:40:17.428 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:40:17.428 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:40:17.428 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:40:17.428 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:40:17.428 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:40:17.428 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:40:17.428 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:40:17.429 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:40:17.429 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:40:17.429 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:40:17.429 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:40:17.429 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:40:17.429 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:40:17.429 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:40:17.429 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:40:17.429 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:40:17.429 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:40:17.429 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:40:17.429 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:40:17.430 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:40:17.430 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:40:17.430 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:40:17.430 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:40:17.430 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:40:17.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.430 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "60", 2024-02-19T21:40:17.430 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:40:17.430 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:40:17.430 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:40:17.430 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:40:17.430 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:40:17.431 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:40:17.431 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:40:17.431 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:40:17.431 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:40:17.431 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:40:17.431 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:40:17.431 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:40:17.431 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:40:17.431 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:40:17.431 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:40:17.431 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:40:17.432 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:40:17.432 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:40:17.432 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:40:17.432 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:40:17.432 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:40:17.432 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:40:17.432 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:40:17.432 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:40:17.432 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:40:17.432 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:40:17.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.433 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:40:17.433 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:40:17.433 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:40:17.433 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:40:17.433 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:40:17.433 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:40:17.433 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:40:17.433 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:40:17.433 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:40:17.433 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:40:17.433 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:40:17.434 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:40:17.434 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:40:17.434 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:40:17.434 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.434 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 3, 2024-02-19T21:40:17.434 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "iscsi", 2024-02-19T21:40:17.434 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:22.333164+0000", 2024-02-19T21:40:17.434 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:40:17.434 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:40:17.434 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:40:17.434 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:40:17.435 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:40:17.435 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:40:17.435 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:40:17.435 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:40:17.435 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:40:17.435 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:40:17.435 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:40:17.435 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:40:17.435 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 3, 2024-02-19T21:40:17.436 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 3, 2024-02-19T21:40:17.436 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 3, 2024-02-19T21:40:17.436 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 3, 2024-02-19T21:40:17.436 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 3, 2024-02-19T21:40:17.436 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:40:17.436 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:40:17.436 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:40:17.436 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:40:17.436 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:40:17.436 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:40:17.436 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:40:17.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.436 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "62", 2024-02-19T21:40:17.437 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:40:17.437 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:40:17.437 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:40:17.437 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:40:17.437 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:40:17.437 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:40:17.437 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:40:17.437 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:40:17.437 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:40:17.437 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:40:17.437 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:40:17.437 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:40:17.437 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:40:17.437 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:40:17.438 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:40:17.438 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:40:17.438 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:40:17.438 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:40:17.438 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:40:17.438 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:40:17.438 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:40:17.438 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:40:17.438 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:40:17.438 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:40:17.438 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:40:17.438 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:40:17.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.438 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:40:17.438 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:40:17.439 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:40:17.439 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:40:17.439 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:40:17.439 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:40:17.439 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:40:17.439 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:40:17.439 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:40:17.439 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:40:17.439 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:40:17.440 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:40:17.440 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:40:17.440 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2024-02-19T21:40:17.440 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.440 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 4, 2024-02-19T21:40:17.440 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.log", 2024-02-19T21:40:17.440 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:23.632615+0000", 2024-02-19T21:40:17.440 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:40:17.440 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:40:17.440 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:40:17.440 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:40:17.441 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:40:17.441 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:40:17.441 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:40:17.441 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:40:17.441 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:40:17.441 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:40:17.441 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:40:17.443 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:40:17.443 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:40:17.443 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:40:17.443 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:40:17.443 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:40:17.443 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:40:17.443 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:40:17.443 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:40:17.443 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:40:17.443 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:40:17.443 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:40:17.443 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:40:17.443 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:40:17.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.444 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "62", 2024-02-19T21:40:17.444 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:40:17.444 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:40:17.444 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:40:17.444 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:40:17.444 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:40:17.444 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:40:17.444 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:40:17.444 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:40:17.444 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:40:17.444 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:40:17.444 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:40:17.444 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:40:17.444 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:40:17.444 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:40:17.445 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:40:17.445 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:40:17.445 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:40:17.445 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:40:17.445 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:40:17.445 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:40:17.445 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:40:17.445 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:40:17.445 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:40:17.445 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:40:17.445 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:40:17.445 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:40:17.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.445 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:40:17.446 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:40:17.446 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:40:17.446 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:40:17.446 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:40:17.446 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:40:17.446 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:40:17.446 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:40:17.446 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:40:17.446 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:40:17.446 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:40:17.446 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:40:17.446 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:40:17.446 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:40:17.446 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.447 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 5, 2024-02-19T21:40:17.447 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.control", 2024-02-19T21:40:17.447 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:25.600876+0000", 2024-02-19T21:40:17.447 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:40:17.447 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:40:17.447 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:40:17.447 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:40:17.447 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:40:17.447 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:40:17.447 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:40:17.447 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:40:17.447 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:40:17.448 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:40:17.448 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:40:17.448 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:40:17.448 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:40:17.448 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:40:17.448 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:40:17.448 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:40:17.448 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:40:17.448 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:40:17.448 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:40:17.448 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:40:17.448 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:40:17.448 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:40:17.449 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:40:17.449 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:40:17.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.449 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "64", 2024-02-19T21:40:17.449 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:40:17.449 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:40:17.449 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:40:17.449 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:40:17.449 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:40:17.449 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:40:17.449 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:40:17.450 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:40:17.450 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:40:17.450 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:40:17.450 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:40:17.450 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:40:17.450 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:40:17.450 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:40:17.450 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:40:17.450 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:40:17.451 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:40:17.451 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:40:17.451 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:40:17.451 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:40:17.451 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:40:17.451 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:40:17.451 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:40:17.451 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:40:17.451 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:40:17.451 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:40:17.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.451 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:40:17.451 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:40:17.452 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:40:17.452 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:40:17.452 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:40:17.452 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:40:17.452 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:40:17.452 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:40:17.452 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:40:17.452 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:40:17.452 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:40:17.452 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:40:17.452 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:40:17.452 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:40:17.452 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.453 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 6, 2024-02-19T21:40:17.453 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.meta", 2024-02-19T21:40:17.453 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:27.661242+0000", 2024-02-19T21:40:17.453 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:40:17.453 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:40:17.453 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:40:17.453 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:40:17.453 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:40:17.453 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:40:17.453 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:40:17.453 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:40:17.453 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:40:17.453 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:40:17.454 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:40:17.454 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:40:17.454 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:40:17.454 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:40:17.454 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:40:17.454 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:40:17.454 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:40:17.454 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:40:17.454 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:40:17.454 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:40:17.454 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:40:17.454 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:40:17.454 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:40:17.455 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:40:17.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.455 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "66", 2024-02-19T21:40:17.455 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:40:17.455 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:40:17.455 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:40:17.455 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:40:17.455 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:40:17.455 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:40:17.455 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:40:17.455 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:40:17.455 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:40:17.455 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:40:17.455 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:40:17.456 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:40:17.456 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:40:17.456 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:40:17.456 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:40:17.456 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:40:17.456 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:40:17.456 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:40:17.456 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:40:17.456 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:40:17.456 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:40:17.456 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:40:17.456 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:40:17.456 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:40:17.456 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:40:17.457 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:40:17.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.457 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:40:17.457 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:40:17.457 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:40:17.457 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:40:17.457 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:40:17.457 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:40:17.457 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:40:17.457 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:40:17.457 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:40:17.457 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:40:17.457 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:40:17.457 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2024-02-19T21:40:17.458 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4 2024-02-19T21:40:17.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.458 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:40:17.458 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:40:17.458 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.458 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 8, 2024-02-19T21:40:17.458 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "unique_pool_1", 2024-02-19T21:40:17.458 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:39:38.377517+0000", 2024-02-19T21:40:17.458 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:40:17.458 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:40:17.458 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:40:17.459 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:40:17.459 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:40:17.459 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:40:17.459 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:40:17.459 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:40:17.459 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:40:17.459 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:40:17.459 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:40:17.459 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:40:17.459 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 16, 2024-02-19T21:40:17.459 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 16, 2024-02-19T21:40:17.459 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 16, 2024-02-19T21:40:17.459 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 16, 2024-02-19T21:40:17.459 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 16, 2024-02-19T21:40:17.460 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:40:17.460 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:40:17.460 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:40:17.460 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:40:17.460 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:40:17.460 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:40:17.460 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:40:17.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.461 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "171", 2024-02-19T21:40:17.461 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:40:17.461 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:40:17.461 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:40:17.461 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:40:17.461 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:40:17.461 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:40:17.461 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:40:17.461 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:40:17.461 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:40:17.461 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:40:17.461 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:40:17.461 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:40:17.462 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:40:17.462 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:40:17.462 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:40:17.462 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:40:17.462 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:40:17.462 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:40:17.462 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:40:17.462 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:40:17.462 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:40:17.462 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:40:17.462 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:40:17.462 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:40:17.462 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:40:17.463 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:40:17.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.463 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:40:17.463 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:40:17.463 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:40:17.463 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:40:17.463 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:40:17.463 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:40:17.463 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:40:17.463 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:40:17.463 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:40:17.463 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:40:17.463 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:40:17.463 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:40:17.463 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:40:17.464 INFO:teuthology.orchestra.run.smithi080.stdout: "rados": {} 2024-02-19T21:40:17.464 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.464 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.464 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:40:17.464 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:40:17.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.464 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2024-02-19T21:40:17.464 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "a72c63f6-46b3-4202-99da-7b0c92b799a5", 2024-02-19T21:40:17.464 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:40:17.464 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:40:17.464 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:40:17.464 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:40:17.465 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:40:17.465 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:40:17.465 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 8, 2024-02-19T21:40:17.465 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 169, 2024-02-19T21:40:17.465 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:40:17.465 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:40:17.465 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:40:17.465 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.465 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.465 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2024-02-19T21:40:17.465 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:40:17.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.466 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.466 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2024-02-19T21:40:17.466 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:40:17.466 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.466 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.466 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:40:17.466 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.466 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.466 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2024-02-19T21:40:17.466 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:40:17.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.467 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.467 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2024-02-19T21:40:17.467 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:40:17.467 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.467 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.467 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:40:17.467 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.467 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.467 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2024-02-19T21:40:17.467 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:40:17.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.468 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.468 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2024-02-19T21:40:17.468 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:40:17.468 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.468 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.468 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:40:17.468 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.468 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.468 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2024-02-19T21:40:17.468 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:40:17.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.469 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.469 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2024-02-19T21:40:17.469 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:40:17.469 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.469 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.469 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6803/3531298825", 2024-02-19T21:40:17.469 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6805/3531298825", 2024-02-19T21:40:17.469 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6809/3531298825", 2024-02-19T21:40:17.469 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6807/3531298825", 2024-02-19T21:40:17.469 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:40:17.469 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:40:17.469 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:40:17.469 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.470 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2024-02-19T21:40:17.470 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "7d4e170e-b0ca-4e19-be35-4038ca126ee6", 2024-02-19T21:40:17.470 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:40:17.470 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:40:17.470 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:40:17.470 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:40:17.470 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:40:17.470 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:40:17.470 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-02-19T21:40:17.471 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 165, 2024-02-19T21:40:17.471 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:40:17.471 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:40:17.471 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:40:17.471 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.471 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.471 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2024-02-19T21:40:17.471 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:40:17.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.471 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.471 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2024-02-19T21:40:17.471 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:40:17.472 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.472 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.472 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:40:17.472 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.472 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.472 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2024-02-19T21:40:17.472 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:40:17.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.472 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.472 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2024-02-19T21:40:17.472 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:40:17.472 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.473 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.473 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:40:17.473 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.473 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.473 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2024-02-19T21:40:17.473 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:40:17.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.473 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.473 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2024-02-19T21:40:17.473 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:40:17.473 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.473 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.474 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:40:17.474 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.474 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.474 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2024-02-19T21:40:17.474 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:40:17.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.474 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.474 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2024-02-19T21:40:17.474 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:40:17.474 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.474 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.475 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6811/1497235950", 2024-02-19T21:40:17.475 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6813/1497235950", 2024-02-19T21:40:17.475 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6817/1497235950", 2024-02-19T21:40:17.475 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6815/1497235950", 2024-02-19T21:40:17.475 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:40:17.475 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:40:17.475 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:40:17.475 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.475 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2024-02-19T21:40:17.475 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "cf461b67-f3e8-45e9-b2f6-777752ba5574", 2024-02-19T21:40:17.475 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:40:17.475 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 0, 2024-02-19T21:40:17.476 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 0, 2024-02-19T21:40:17.476 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:40:17.476 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:40:17.476 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:40:17.476 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 18, 2024-02-19T21:40:17.476 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 144, 2024-02-19T21:40:17.476 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:40:17.476 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:40:17.476 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:40:17.476 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.476 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.476 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2024-02-19T21:40:17.477 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:40:17.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.477 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.477 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2024-02-19T21:40:17.477 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:40:17.477 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.477 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.477 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:40:17.477 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.477 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.477 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2024-02-19T21:40:17.477 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:40:17.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.478 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.478 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2024-02-19T21:40:17.478 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:40:17.478 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.478 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.478 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:40:17.478 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.478 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.478 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2024-02-19T21:40:17.478 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:40:17.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.479 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.479 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2024-02-19T21:40:17.479 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:40:17.479 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.479 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.479 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:40:17.479 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.479 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.479 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2024-02-19T21:40:17.479 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:40:17.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.480 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.480 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2024-02-19T21:40:17.480 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:40:17.480 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.480 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.480 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6819/3131848307", 2024-02-19T21:40:17.480 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6821/3131848307", 2024-02-19T21:40:17.480 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6825/3131848307", 2024-02-19T21:40:17.480 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6823/3131848307", 2024-02-19T21:40:17.480 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:40:17.480 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:40:17.481 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:40:17.481 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.481 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2024-02-19T21:40:17.481 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "76318cdd-5fce-4a40-95c9-300d55c34820", 2024-02-19T21:40:17.481 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:40:17.481 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:40:17.481 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 0.3962554931640625, 2024-02-19T21:40:17.481 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:40:17.481 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:40:17.481 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:40:17.481 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 26, 2024-02-19T21:40:17.481 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 169, 2024-02-19T21:40:17.481 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:40:17.482 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:40:17.482 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:40:17.482 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.482 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.482 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2024-02-19T21:40:17.482 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:40:17.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.482 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.482 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2024-02-19T21:40:17.482 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:40:17.482 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.482 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.483 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:40:17.483 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.483 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.483 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2024-02-19T21:40:17.483 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:40:17.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.483 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.483 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2024-02-19T21:40:17.483 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:40:17.483 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.483 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.483 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:40:17.483 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.484 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.484 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6832", 2024-02-19T21:40:17.484 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:40:17.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.484 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.484 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6833", 2024-02-19T21:40:17.484 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:40:17.484 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.484 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.484 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:40:17.484 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.485 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.485 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2024-02-19T21:40:17.485 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:40:17.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.485 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.485 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2024-02-19T21:40:17.485 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:40:17.485 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.485 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.485 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6827/2007978078", 2024-02-19T21:40:17.485 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6829/2007978078", 2024-02-19T21:40:17.486 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6833/2007978078", 2024-02-19T21:40:17.486 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6831/2007978078", 2024-02-19T21:40:17.486 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:40:17.486 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:40:17.486 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:40:17.486 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.486 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2024-02-19T21:40:17.486 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "6484964f-3391-4e1d-a56c-813f46124062", 2024-02-19T21:40:17.486 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:40:17.486 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:40:17.486 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:40:17.486 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 0.427398681640625, 2024-02-19T21:40:17.487 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:40:17.487 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:40:17.487 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 32, 2024-02-19T21:40:17.487 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 165, 2024-02-19T21:40:17.487 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:40:17.487 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:40:17.487 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:40:17.487 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.487 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.487 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6800", 2024-02-19T21:40:17.487 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:40:17.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.488 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.488 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6801", 2024-02-19T21:40:17.488 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:40:17.488 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.488 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.488 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:40:17.488 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.488 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.488 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6802", 2024-02-19T21:40:17.488 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:40:17.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.489 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.489 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6803", 2024-02-19T21:40:17.489 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:40:17.489 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.489 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.489 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:40:17.489 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.489 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.489 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6806", 2024-02-19T21:40:17.489 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:40:17.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.490 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.490 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6807", 2024-02-19T21:40:17.490 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:40:17.490 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.490 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.490 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:40:17.490 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.490 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.490 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6804", 2024-02-19T21:40:17.490 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:40:17.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.491 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.491 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6805", 2024-02-19T21:40:17.491 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:40:17.491 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.491 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.491 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6801/1922002860", 2024-02-19T21:40:17.491 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6803/1922002860", 2024-02-19T21:40:17.491 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6807/1922002860", 2024-02-19T21:40:17.491 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6805/1922002860", 2024-02-19T21:40:17.491 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:40:17.491 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:40:17.491 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:40:17.491 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.492 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2024-02-19T21:40:17.492 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "8c7e0309-8c3b-40b9-99d9-96620e52742f", 2024-02-19T21:40:17.492 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:40:17.492 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:40:17.492 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:40:17.492 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:40:17.492 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:40:17.492 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:40:17.492 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 38, 2024-02-19T21:40:17.492 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 169, 2024-02-19T21:40:17.492 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:40:17.493 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:40:17.493 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:40:17.493 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.493 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.493 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6808", 2024-02-19T21:40:17.493 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:40:17.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.493 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.493 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6809", 2024-02-19T21:40:17.493 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:40:17.493 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.493 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.494 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:40:17.494 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.494 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.494 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6810", 2024-02-19T21:40:17.494 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:40:17.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.494 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.494 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6811", 2024-02-19T21:40:17.494 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:40:17.494 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.494 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.495 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:40:17.495 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.495 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.495 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6814", 2024-02-19T21:40:17.495 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:40:17.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.495 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.495 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6815", 2024-02-19T21:40:17.495 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:40:17.495 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.495 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.495 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:40:17.496 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.496 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.496 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6812", 2024-02-19T21:40:17.496 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:40:17.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.496 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.496 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6813", 2024-02-19T21:40:17.496 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:40:17.496 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.496 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.497 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6809/960889603", 2024-02-19T21:40:17.497 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6811/960889603", 2024-02-19T21:40:17.497 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6815/960889603", 2024-02-19T21:40:17.497 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6813/960889603", 2024-02-19T21:40:17.497 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:40:17.497 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:40:17.497 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:40:17.497 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.497 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2024-02-19T21:40:17.497 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "5b7d44a3-197d-482c-bf9e-de5e9013a851", 2024-02-19T21:40:17.497 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:40:17.497 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:40:17.498 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:40:17.498 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:40:17.498 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:40:17.498 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:40:17.498 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 47, 2024-02-19T21:40:17.498 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 169, 2024-02-19T21:40:17.498 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:40:17.498 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:40:17.498 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:40:17.498 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.498 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.498 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6816", 2024-02-19T21:40:17.498 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:40:17.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.499 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.499 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6817", 2024-02-19T21:40:17.499 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:40:17.499 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.499 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.499 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:40:17.499 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.499 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.499 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6818", 2024-02-19T21:40:17.499 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:40:17.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.500 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.500 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6819", 2024-02-19T21:40:17.500 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:40:17.500 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.500 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.500 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:40:17.500 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.500 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.500 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6822", 2024-02-19T21:40:17.501 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:40:17.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.501 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.501 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.501 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6823", 2024-02-19T21:40:17.501 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:40:17.501 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.501 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.501 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:40:17.501 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.501 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.501 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.502 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6820", 2024-02-19T21:40:17.502 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:40:17.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.502 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.502 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6821", 2024-02-19T21:40:17.502 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:40:17.502 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.502 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.502 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6817/2598265223", 2024-02-19T21:40:17.502 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6819/2598265223", 2024-02-19T21:40:17.502 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6823/2598265223", 2024-02-19T21:40:17.502 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6821/2598265223", 2024-02-19T21:40:17.503 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:40:17.503 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:40:17.503 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:40:17.503 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.503 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2024-02-19T21:40:17.503 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "7e2d0287-928d-40f8-841b-6c2077fc08ac", 2024-02-19T21:40:17.503 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:40:17.503 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:40:17.503 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:40:17.503 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:40:17.504 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:40:17.504 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:40:17.504 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 55, 2024-02-19T21:40:17.504 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 169, 2024-02-19T21:40:17.504 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:40:17.504 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:40:17.504 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:40:17.504 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.504 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.504 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6824", 2024-02-19T21:40:17.504 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:40:17.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.505 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.505 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6825", 2024-02-19T21:40:17.505 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:40:17.505 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.505 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.505 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:40:17.505 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.505 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.505 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6826", 2024-02-19T21:40:17.505 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:40:17.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.506 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.506 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6827", 2024-02-19T21:40:17.506 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:40:17.506 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.506 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.506 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:40:17.506 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.506 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.506 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6830", 2024-02-19T21:40:17.506 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:40:17.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.507 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.507 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6831", 2024-02-19T21:40:17.507 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:40:17.507 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.507 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.507 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:40:17.507 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:17.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.507 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:17.507 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6828", 2024-02-19T21:40:17.507 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:40:17.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.508 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:17.508 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6829", 2024-02-19T21:40:17.508 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:40:17.508 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.508 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.508 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6825/3619345894", 2024-02-19T21:40:17.508 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6827/3619345894", 2024-02-19T21:40:17.508 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6831/3619345894", 2024-02-19T21:40:17.508 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6829/3619345894", 2024-02-19T21:40:17.508 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:40:17.509 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:40:17.509 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:40:17.509 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.509 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.509 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:40:17.509 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2024-02-19T21:40:17.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.509 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2024-02-19T21:40:17.509 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:40:17.509 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:40:17.509 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:40:17.509 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:40:17.509 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:40:17.509 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:39:17.441678+0000", 2024-02-19T21:40:17.510 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:40:17.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.510 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2024-02-19T21:40:17.510 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:40:17.510 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:40:17.510 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:40:17.510 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:40:17.510 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:40:17.510 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:38:53.799761+0000", 2024-02-19T21:40:17.510 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:40:17.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.510 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2024-02-19T21:40:17.511 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:40:17.511 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:40:17.511 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:40:17.511 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:40:17.511 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 65536, 2024-02-19T21:40:17.511 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:39:28.642236+0000", 2024-02-19T21:40:17.511 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:40:17.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.511 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2024-02-19T21:40:17.511 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:40:17.511 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:40:17.511 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:40:17.511 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:40:17.512 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:40:17.512 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:39:29.332667+0000", 2024-02-19T21:40:17.512 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:40:17.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.512 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2024-02-19T21:40:17.512 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:40:17.512 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:40:17.512 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:40:17.512 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:40:17.512 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:40:17.512 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:39:02.595367+0000", 2024-02-19T21:40:17.512 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:40:17.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.513 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2024-02-19T21:40:17.513 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:40:17.513 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:40:17.513 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:40:17.513 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:40:17.513 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:40:17.513 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:39:04.500308+0000", 2024-02-19T21:40:17.513 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:40:17.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.513 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2024-02-19T21:40:17.513 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:40:17.513 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:40:17.513 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:40:17.514 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:40:17.514 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:40:17.514 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:39:07.665506+0000", 2024-02-19T21:40:17.514 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:40:17.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.514 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2024-02-19T21:40:17.514 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:40:17.514 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:40:17.514 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:40:17.514 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:40:17.514 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:40:17.514 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:39:17.068940+0000", 2024-02-19T21:40:17.514 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:40:17.515 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.515 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:40:17.515 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [ 2024-02-19T21:40:17.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.515 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "6.c", 2024-02-19T21:40:17.515 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:40:17.515 INFO:teuthology.orchestra.run.smithi080.stdout: 5, 2024-02-19T21:40:17.515 INFO:teuthology.orchestra.run.smithi080.stdout: 0, 2024-02-19T21:40:17.515 INFO:teuthology.orchestra.run.smithi080.stdout: 2 2024-02-19T21:40:17.515 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.515 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.515 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:40:17.515 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [ 2024-02-19T21:40:17.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.515 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.6", 2024-02-19T21:40:17.516 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:40:17.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.516 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:40:17.516 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 5 2024-02-19T21:40:17.516 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.516 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.516 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.e", 2024-02-19T21:40:17.516 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:40:17.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.516 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:40:17.516 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 7 2024-02-19T21:40:17.516 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.517 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.517 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.f", 2024-02-19T21:40:17.517 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:40:17.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.517 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:40:17.517 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 5 2024-02-19T21:40:17.517 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.517 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.517 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.19", 2024-02-19T21:40:17.517 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:40:17.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.518 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:40:17.518 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 7 2024-02-19T21:40:17.518 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.518 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.518 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.1e", 2024-02-19T21:40:17.518 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:40:17.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.518 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 7, 2024-02-19T21:40:17.518 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 5 2024-02-19T21:40:17.518 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.518 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.519 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.1f", 2024-02-19T21:40:17.519 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:40:17.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.519 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:40:17.519 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 7 2024-02-19T21:40:17.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.519 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 6, 2024-02-19T21:40:17.519 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 0 2024-02-19T21:40:17.519 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.519 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.519 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "5.1", 2024-02-19T21:40:17.520 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:40:17.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.520 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 4, 2024-02-19T21:40:17.520 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 6 2024-02-19T21:40:17.520 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.520 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.520 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "5.d", 2024-02-19T21:40:17.520 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:40:17.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.520 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 0, 2024-02-19T21:40:17.520 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 3 2024-02-19T21:40:17.520 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.521 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.521 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "5.13", 2024-02-19T21:40:17.521 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:40:17.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.521 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 0, 2024-02-19T21:40:17.521 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 6 2024-02-19T21:40:17.521 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.521 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.521 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "5.14", 2024-02-19T21:40:17.522 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:40:17.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.522 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 7, 2024-02-19T21:40:17.522 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 6 2024-02-19T21:40:17.522 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.522 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.522 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.522 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:40:17.522 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [], 2024-02-19T21:40:17.522 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2024-02-19T21:40:17.522 INFO:teuthology.orchestra.run.smithi080.stdout: "blocklist": { 2024-02-19T21:40:17.522 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6800/2867197629": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:40:17.522 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/1659656010": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:40:17.523 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6801/2272739550": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:40:17.523 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/867908385": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:40:17.523 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/398750494": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:40:17.523 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/2833137430": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:40:17.523 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/2520755315": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:40:17.523 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6800/2094869828": "2024-02-20T21:26:51.262073+0000", 2024-02-19T21:40:17.523 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6800/2272739550": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:40:17.523 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6801/2094869828": "2024-02-20T21:26:51.262073+0000", 2024-02-19T21:40:17.523 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/2130852198": "2024-02-20T21:26:51.262073+0000", 2024-02-19T21:40:17.523 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6801/2867197629": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:40:17.523 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/1952386920": "2024-02-20T21:26:51.262073+0000" 2024-02-19T21:40:17.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.524 INFO:teuthology.orchestra.run.smithi080.stdout: "range_blocklist": {}, 2024-02-19T21:40:17.524 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2024-02-19T21:40:17.524 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2024-02-19T21:40:17.524 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2024-02-19T21:40:17.524 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2024-02-19T21:40:17.524 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2024-02-19T21:40:17.524 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2024-02-19T21:40:17.524 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2024-02-19T21:40:17.524 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2024-02-19T21:40:17.524 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.524 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2024-02-19T21:40:17.524 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2024-02-19T21:40:17.525 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2024-02-19T21:40:17.525 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2024-02-19T21:40:17.525 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {}, 2024-02-19T21:40:17.525 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode": { 2024-02-19T21:40:17.525 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode_enabled": false, 2024-02-19T21:40:17.525 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_bucket_count": 0, 2024-02-19T21:40:17.525 INFO:teuthology.orchestra.run.smithi080.stdout: "degraded_stretch_mode": 0, 2024-02-19T21:40:17.525 INFO:teuthology.orchestra.run.smithi080.stdout: "recovering_stretch_mode": 0, 2024-02-19T21:40:17.525 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode_bucket": 0 2024-02-19T21:40:17.525 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.525 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:40:17.526 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:17.526 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:40:17.527 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:40:17.528 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:40:17.528 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-02-19T21:40:17.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-02-19T21:40:17.528 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-02-19T21:40:17.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.529 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:62925 7.e 7:71ce0b1b:::benchmark_data_smithi080_79222_object62924:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e113)", 2024-02-19T21:40:17.529 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:36:05.693126+0000", 2024-02-19T21:40:17.529 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 251.82818891299999, 2024-02-19T21:40:17.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.066503576999999994, 2024-02-19T21:40:17.529 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:40:17.529 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:40:17.529 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:40:17.529 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:40:17.529 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:40:17.529 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 62925 2024-02-19T21:40:17.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.529 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:40:17.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:40:17.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.693126+0000", 2024-02-19T21:40:17.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:40:17.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:40:17.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.693126+0000", 2024-02-19T21:40:17.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:40:17.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:40:17.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.693125+0000", 2024-02-19T21:40:17.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9908999999999999e-05 2024-02-19T21:40:17.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:40:17.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.693145+0000", 2024-02-19T21:40:17.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7490000000000001e-06 2024-02-19T21:40:17.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:40:17.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.693152+0000", 2024-02-19T21:40:17.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.42e-06 2024-02-19T21:40:17.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:40:17.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.693156+0000", 2024-02-19T21:40:17.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025212519999999999 2024-02-19T21:40:17.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:40:17.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.695678+0000", 2024-02-19T21:40:17.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000133542 2024-02-19T21:40:17.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:40:17.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.695811+0000", 2024-02-19T21:40:17.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015830900000000001 2024-02-19T21:40:17.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:40:17.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.695970+0000", 2024-02-19T21:40:17.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059911000000000001 2024-02-19T21:40:17.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.701961+0000", 2024-02-19T21:40:17.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9740000000000004e-06 2024-02-19T21:40:17.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:40:17.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.701965+0000", 2024-02-19T21:40:17.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.057567501 2024-02-19T21:40:17.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.759532+0000", 2024-02-19T21:40:17.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5862999999999997e-05 2024-02-19T21:40:17.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:40:17.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.759588+0000", 2024-02-19T21:40:17.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1523000000000002e-05 2024-02-19T21:40:17.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:40:17.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.759630+0000", 2024-02-19T21:40:17.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.066503576999999994 2024-02-19T21:40:17.534 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.534 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.534 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.535 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:62931 7.e 7:7da2a5e2:::benchmark_data_smithi080_79222_object62930:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e113)", 2024-02-19T21:40:17.535 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:36:05.695870+0000", 2024-02-19T21:40:17.535 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 251.82544512999999, 2024-02-19T21:40:17.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.067591908000000006, 2024-02-19T21:40:17.535 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:40:17.535 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:40:17.535 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:40:17.535 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:40:17.535 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:40:17.535 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 62931 2024-02-19T21:40:17.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.535 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:40:17.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:40:17.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.695870+0000", 2024-02-19T21:40:17.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:40:17.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:40:17.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.695870+0000", 2024-02-19T21:40:17.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:40:17.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:40:17.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.695868+0000", 2024-02-19T21:40:17.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2269999999999999e-05 2024-02-19T21:40:17.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:40:17.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.695890+0000", 2024-02-19T21:40:17.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1642e-05 2024-02-19T21:40:17.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:40:17.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.695902+0000", 2024-02-19T21:40:17.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5459999999999997e-06 2024-02-19T21:40:17.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:40:17.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.695908+0000", 2024-02-19T21:40:17.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0021398939999999998 2024-02-19T21:40:17.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:40:17.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.698048+0000", 2024-02-19T21:40:17.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013656900000000001 2024-02-19T21:40:17.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:40:17.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.698185+0000", 2024-02-19T21:40:17.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014641900000000001 2024-02-19T21:40:17.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:40:17.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.698331+0000", 2024-02-19T21:40:17.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036360960000000001 2024-02-19T21:40:17.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:40:17.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.701967+0000", 2024-02-19T21:40:17.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024068200000000001 2024-02-19T21:40:17.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.702208+0000", 2024-02-19T21:40:17.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.061168630000000002 2024-02-19T21:40:17.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.763377+0000", 2024-02-19T21:40:17.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6195000000000001e-05 2024-02-19T21:40:17.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:40:17.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.763423+0000", 2024-02-19T21:40:17.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8824e-05 2024-02-19T21:40:17.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:40:17.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.763462+0000", 2024-02-19T21:40:17.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.067591908000000006 2024-02-19T21:40:17.541 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.541 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.541 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.541 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:62933 7.e 7:7399d59e:::benchmark_data_smithi080_79222_object62932:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e113)", 2024-02-19T21:40:17.541 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:36:05.696316+0000", 2024-02-19T21:40:17.541 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 251.824998435, 2024-02-19T21:40:17.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.067640932000000001, 2024-02-19T21:40:17.541 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:40:17.541 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:40:17.541 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:40:17.541 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:40:17.541 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:40:17.542 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 62933 2024-02-19T21:40:17.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.542 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:40:17.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:40:17.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.696316+0000", 2024-02-19T21:40:17.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:40:17.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:40:17.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.696316+0000", 2024-02-19T21:40:17.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:40:17.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:40:17.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.696315+0000", 2024-02-19T21:40:17.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0103e-05 2024-02-19T21:40:17.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:40:17.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.696336+0000", 2024-02-19T21:40:17.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0747000000000001e-05 2024-02-19T21:40:17.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:40:17.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.696346+0000", 2024-02-19T21:40:17.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6640000000000003e-06 2024-02-19T21:40:17.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:40:17.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.696352+0000", 2024-02-19T21:40:17.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003716699 2024-02-19T21:40:17.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:40:17.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.700069+0000", 2024-02-19T21:40:17.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121891 2024-02-19T21:40:17.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:40:17.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.700191+0000", 2024-02-19T21:40:17.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000141903 2024-02-19T21:40:17.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:40:17.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.700332+0000", 2024-02-19T21:40:17.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016799460000000001 2024-02-19T21:40:17.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:40:17.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.702012+0000", 2024-02-19T21:40:17.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030276199999999999 2024-02-19T21:40:17.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.702315+0000", 2024-02-19T21:40:17.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.061564491999999998 2024-02-19T21:40:17.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.763880+0000", 2024-02-19T21:40:17.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3278000000000001e-05 2024-02-19T21:40:17.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:40:17.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.763923+0000", 2024-02-19T21:40:17.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4440999999999998e-05 2024-02-19T21:40:17.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:40:17.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:36:05.763957+0000", 2024-02-19T21:40:17.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.067640932000000001 2024-02-19T21:40:17.547 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.547 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.547 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.547 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:199254 7.8 7:1182491f:::benchmark_data_smithi080_79222_object84520:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:40:17.547 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:32.385505+0000", 2024-02-19T21:40:17.547 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 105.13581034000001, 2024-02-19T21:40:17.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.102585651, 2024-02-19T21:40:17.547 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:40:17.547 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:40:17.547 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:40:17.547 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:40:17.548 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:40:17.548 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 199254 2024-02-19T21:40:17.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.548 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:40:17.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:40:17.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.385505+0000", 2024-02-19T21:40:17.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:40:17.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:40:17.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.385505+0000", 2024-02-19T21:40:17.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999976 2024-02-19T21:40:17.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:40:17.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.385502+0000", 2024-02-19T21:40:17.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.031e-05 2024-02-19T21:40:17.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:40:17.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.385512+0000", 2024-02-19T21:40:17.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7918e-05 2024-02-19T21:40:17.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:40:17.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.385530+0000", 2024-02-19T21:40:17.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.926e-06 2024-02-19T21:40:17.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:40:17.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.385538+0000", 2024-02-19T21:40:17.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.089643346999999998 2024-02-19T21:40:17.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:40:17.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.475182+0000", 2024-02-19T21:40:17.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012684099999999999 2024-02-19T21:40:17.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:40:17.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.475308+0000", 2024-02-19T21:40:17.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050588100000000002 2024-02-19T21:40:17.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4,7", 2024-02-19T21:40:17.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.475814+0000", 2024-02-19T21:40:17.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012170716 2024-02-19T21:40:17.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.487985+0000", 2024-02-19T21:40:17.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3634999999999999e-05 2024-02-19T21:40:17.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.488019+0000", 2024-02-19T21:40:17.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.259e-05 2024-02-19T21:40:17.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:40:17.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.488031+0000", 2024-02-19T21:40:17.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2577999999999999e-05 2024-02-19T21:40:17.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:40:17.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.488064+0000", 2024-02-19T21:40:17.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6361999999999999e-05 2024-02-19T21:40:17.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:40:17.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.488090+0000", 2024-02-19T21:40:17.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.102585651 2024-02-19T21:40:17.553 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.553 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.553 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.553 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:199255 7.8 7:17aaf57f:::benchmark_data_smithi080_79222_object84521:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:40:17.553 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:32.385550+0000", 2024-02-19T21:40:17.553 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 105.13576466400001, 2024-02-19T21:40:17.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.107109775, 2024-02-19T21:40:17.553 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:40:17.554 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:40:17.554 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:40:17.554 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:40:17.554 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:40:17.554 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 199255 2024-02-19T21:40:17.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.554 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:40:17.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:40:17.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.385550+0000", 2024-02-19T21:40:17.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:40:17.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:40:17.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.385550+0000", 2024-02-19T21:40:17.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:40:17.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:40:17.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.385550+0000", 2024-02-19T21:40:17.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0899999999999998e-06 2024-02-19T21:40:17.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:40:17.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.385554+0000", 2024-02-19T21:40:17.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3889999999999994e-06 2024-02-19T21:40:17.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:40:17.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.385563+0000", 2024-02-19T21:40:17.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8239999999999999e-06 2024-02-19T21:40:17.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:40:17.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.385568+0000", 2024-02-19T21:40:17.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.098054825999999998 2024-02-19T21:40:17.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:40:17.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.483623+0000", 2024-02-19T21:40:17.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012832800000000001 2024-02-19T21:40:17.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:40:17.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.483751+0000", 2024-02-19T21:40:17.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00051406200000000003 2024-02-19T21:40:17.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4,7", 2024-02-19T21:40:17.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.484265+0000", 2024-02-19T21:40:17.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038470380000000001 2024-02-19T21:40:17.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:40:17.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.488112+0000", 2024-02-19T21:40:17.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040480530000000002 2024-02-19T21:40:17.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.492160+0000", 2024-02-19T21:40:17.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000428427 2024-02-19T21:40:17.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.492589+0000", 2024-02-19T21:40:17.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6365000000000001e-05 2024-02-19T21:40:17.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:40:17.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.492635+0000", 2024-02-19T21:40:17.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4882e-05 2024-02-19T21:40:17.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:40:17.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.492660+0000", 2024-02-19T21:40:17.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.107109775 2024-02-19T21:40:17.559 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.559 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.559 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.559 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:200355 7.e 7:70a966ad:::benchmark_data_smithi080_79222_object85621:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:40:17.559 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:33.717496+0000", 2024-02-19T21:40:17.559 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 103.803819109, 2024-02-19T21:40:17.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.070151129000000007, 2024-02-19T21:40:17.560 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:40:17.560 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:40:17.560 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:40:17.560 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:40:17.560 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:40:17.560 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 200355 2024-02-19T21:40:17.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.560 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:40:17.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:40:17.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.717496+0000", 2024-02-19T21:40:17.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:40:17.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:40:17.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.717496+0000", 2024-02-19T21:40:17.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:40:17.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:40:17.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.717494+0000", 2024-02-19T21:40:17.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7259999999999996e-06 2024-02-19T21:40:17.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:40:17.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.717501+0000", 2024-02-19T21:40:17.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1293e-05 2024-02-19T21:40:17.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:40:17.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.717512+0000", 2024-02-19T21:40:17.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.049e-06 2024-02-19T21:40:17.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:40:17.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.717518+0000", 2024-02-19T21:40:17.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3568e-05 2024-02-19T21:40:17.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:40:17.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.717562+0000", 2024-02-19T21:40:17.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1899999999999999e-05 2024-02-19T21:40:17.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:40:17.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.717634+0000", 2024-02-19T21:40:17.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2127999999999998e-05 2024-02-19T21:40:17.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:40:17.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.717706+0000", 2024-02-19T21:40:17.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0074295029999999996 2024-02-19T21:40:17.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:40:17.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.725135+0000", 2024-02-19T21:40:17.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6383000000000001e-05 2024-02-19T21:40:17.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.725162+0000", 2024-02-19T21:40:17.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.062392376999999999 2024-02-19T21:40:17.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.787554+0000", 2024-02-19T21:40:17.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4577999999999998e-05 2024-02-19T21:40:17.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:40:17.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.787609+0000", 2024-02-19T21:40:17.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8180999999999999e-05 2024-02-19T21:40:17.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:40:17.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.787647+0000", 2024-02-19T21:40:17.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.070151129000000007 2024-02-19T21:40:17.565 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.565 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.565 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.565 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:200356 7.e 7:78db2a80:::benchmark_data_smithi080_79222_object85622:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:40:17.565 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:33.717532+0000", 2024-02-19T21:40:17.565 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 103.803783317, 2024-02-19T21:40:17.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.072789079000000007, 2024-02-19T21:40:17.566 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:40:17.566 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:40:17.566 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:40:17.566 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:40:17.566 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:40:17.566 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 200356 2024-02-19T21:40:17.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.566 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:40:17.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:40:17.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.717532+0000", 2024-02-19T21:40:17.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:40:17.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:40:17.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.717532+0000", 2024-02-19T21:40:17.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:40:17.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:40:17.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.717531+0000", 2024-02-19T21:40:17.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1200000000000002e-06 2024-02-19T21:40:17.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:40:17.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.717534+0000", 2024-02-19T21:40:17.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0209999999999996e-06 2024-02-19T21:40:17.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:40:17.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.717540+0000", 2024-02-19T21:40:17.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7869999999999999e-06 2024-02-19T21:40:17.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:40:17.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.717544+0000", 2024-02-19T21:40:17.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026473569999999999 2024-02-19T21:40:17.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:40:17.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.720191+0000", 2024-02-19T21:40:17.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000100499 2024-02-19T21:40:17.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:40:17.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.720292+0000", 2024-02-19T21:40:17.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012288800000000001 2024-02-19T21:40:17.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:40:17.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.720415+0000", 2024-02-19T21:40:17.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047247230000000001 2024-02-19T21:40:17.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:40:17.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.725139+0000", 2024-02-19T21:40:17.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001626171 2024-02-19T21:40:17.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.726766+0000", 2024-02-19T21:40:17.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.063463997999999994 2024-02-19T21:40:17.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.790230+0000", 2024-02-19T21:40:17.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4219999999999999e-05 2024-02-19T21:40:17.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:40:17.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.790284+0000", 2024-02-19T21:40:17.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6774999999999999e-05 2024-02-19T21:40:17.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:40:17.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.790321+0000", 2024-02-19T21:40:17.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.072789079000000007 2024-02-19T21:40:17.571 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.571 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.571 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.571 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:200357 7.e 7:778dd68f:::benchmark_data_smithi080_79222_object85623:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:40:17.571 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:33.720127+0000", 2024-02-19T21:40:17.571 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 103.80118741299999, 2024-02-19T21:40:17.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.071411025000000003, 2024-02-19T21:40:17.571 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:40:17.571 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:40:17.572 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:40:17.572 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:40:17.572 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:40:17.572 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 200357 2024-02-19T21:40:17.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.572 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:40:17.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:40:17.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.720127+0000", 2024-02-19T21:40:17.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:40:17.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:40:17.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.720127+0000", 2024-02-19T21:40:17.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:40:17.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:40:17.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.720126+0000", 2024-02-19T21:40:17.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9699999999999999e-06 2024-02-19T21:40:17.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:40:17.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.720134+0000", 2024-02-19T21:40:17.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1209000000000001e-05 2024-02-19T21:40:17.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:40:17.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.720145+0000", 2024-02-19T21:40:17.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1040000000000003e-06 2024-02-19T21:40:17.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:40:17.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.720151+0000", 2024-02-19T21:40:17.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002858462 2024-02-19T21:40:17.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:40:17.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.723010+0000", 2024-02-19T21:40:17.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012339499999999999 2024-02-19T21:40:17.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:40:17.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.723133+0000", 2024-02-19T21:40:17.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000100226 2024-02-19T21:40:17.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:40:17.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.723233+0000", 2024-02-19T21:40:17.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002022069 2024-02-19T21:40:17.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:40:17.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.725255+0000", 2024-02-19T21:40:17.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015767380000000001 2024-02-19T21:40:17.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.726832+0000", 2024-02-19T21:40:17.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.064621769999999995 2024-02-19T21:40:17.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.791454+0000", 2024-02-19T21:40:17.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8368000000000002e-05 2024-02-19T21:40:17.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:40:17.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.791502+0000", 2024-02-19T21:40:17.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6256e-05 2024-02-19T21:40:17.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:40:17.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:33.791539+0000", 2024-02-19T21:40:17.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.071411025000000003 2024-02-19T21:40:17.577 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.577 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.577 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.577 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:203977 7.e 7:7ed78029:::benchmark_data_smithi080_79222_object89243:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:40:17.577 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:37.819344+0000", 2024-02-19T21:40:17.578 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 99.701971251000003, 2024-02-19T21:40:17.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.074531503999999998, 2024-02-19T21:40:17.578 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:40:17.578 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:40:17.578 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:40:17.578 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:40:17.578 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:40:17.578 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 203977 2024-02-19T21:40:17.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.578 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:40:17.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:40:17.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:37.819344+0000", 2024-02-19T21:40:17.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:40:17.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:40:17.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:37.819344+0000", 2024-02-19T21:40:17.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:40:17.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:40:17.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:37.819342+0000", 2024-02-19T21:40:17.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4880000000000004e-06 2024-02-19T21:40:17.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:40:17.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:37.819349+0000", 2024-02-19T21:40:17.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0495e-05 2024-02-19T21:40:17.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:40:17.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:37.819359+0000", 2024-02-19T21:40:17.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0390000000000004e-06 2024-02-19T21:40:17.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:40:17.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:37.819364+0000", 2024-02-19T21:40:17.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4953000000000001e-05 2024-02-19T21:40:17.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:40:17.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:37.819409+0000", 2024-02-19T21:40:17.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121748 2024-02-19T21:40:17.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:40:17.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:37.819531+0000", 2024-02-19T21:40:17.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013493000000000001 2024-02-19T21:40:17.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:40:17.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:37.819666+0000", 2024-02-19T21:40:17.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.005196829 2024-02-19T21:40:17.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:40:17.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:37.824863+0000", 2024-02-19T21:40:17.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7472000000000001e-05 2024-02-19T21:40:17.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:37.824890+0000", 2024-02-19T21:40:17.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.068887209000000005 2024-02-19T21:40:17.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:37.893778+0000", 2024-02-19T21:40:17.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5180999999999999e-05 2024-02-19T21:40:17.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:40:17.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:37.893833+0000", 2024-02-19T21:40:17.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2451999999999999e-05 2024-02-19T21:40:17.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:40:17.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:37.893875+0000", 2024-02-19T21:40:17.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.074531503999999998 2024-02-19T21:40:17.584 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.584 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.584 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.584 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:203979 7.e 7:7a05ad51:::benchmark_data_smithi080_79222_object89245:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:40:17.584 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:37.820554+0000", 2024-02-19T21:40:17.584 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 99.700760631999998, 2024-02-19T21:40:17.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.073443362999999998, 2024-02-19T21:40:17.585 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:40:17.585 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:40:17.585 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:40:17.585 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:40:17.585 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:40:17.585 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 203979 2024-02-19T21:40:17.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.585 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:40:17.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:40:17.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:37.820554+0000", 2024-02-19T21:40:17.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:40:17.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:40:17.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:37.820554+0000", 2024-02-19T21:40:17.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:40:17.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:40:17.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:37.820553+0000", 2024-02-19T21:40:17.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6259999999999997e-06 2024-02-19T21:40:17.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:40:17.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:37.820560+0000", 2024-02-19T21:40:17.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1620999999999999e-05 2024-02-19T21:40:17.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:40:17.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:37.820571+0000", 2024-02-19T21:40:17.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.28e-06 2024-02-19T21:40:17.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:40:17.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:37.820578+0000", 2024-02-19T21:40:17.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001879571 2024-02-19T21:40:17.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:40:17.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:37.822457+0000", 2024-02-19T21:40:17.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000107537 2024-02-19T21:40:17.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:40:17.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:37.822565+0000", 2024-02-19T21:40:17.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121749 2024-02-19T21:40:17.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:40:17.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:37.822687+0000", 2024-02-19T21:40:17.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023030590000000001 2024-02-19T21:40:17.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:40:17.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:37.824990+0000", 2024-02-19T21:40:17.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010178349999999999 2024-02-19T21:40:17.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:37.826007+0000", 2024-02-19T21:40:17.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.067907884000000002 2024-02-19T21:40:17.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:37.893915+0000", 2024-02-19T21:40:17.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1017999999999999e-05 2024-02-19T21:40:17.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:40:17.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:37.893956+0000", 2024-02-19T21:40:17.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.125e-05 2024-02-19T21:40:17.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:40:17.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:37.893998+0000", 2024-02-19T21:40:17.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.073443362999999998 2024-02-19T21:40:17.590 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.591 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.591 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.591 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:204132 7.e 7:767747f1:::benchmark_data_smithi080_79222_object89398:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:40:17.591 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:38.034252+0000", 2024-02-19T21:40:17.591 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 99.487062987000002, 2024-02-19T21:40:17.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.083463397999999994, 2024-02-19T21:40:17.591 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:40:17.591 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:40:17.591 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:40:17.591 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:40:17.591 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:40:17.591 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 204132 2024-02-19T21:40:17.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.592 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:40:17.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:40:17.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.034252+0000", 2024-02-19T21:40:17.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:40:17.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:40:17.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.034252+0000", 2024-02-19T21:40:17.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:40:17.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:40:17.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.034250+0000", 2024-02-19T21:40:17.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6639999999999998e-06 2024-02-19T21:40:17.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:40:17.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.034258+0000", 2024-02-19T21:40:17.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1131000000000001e-05 2024-02-19T21:40:17.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:40:17.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.034269+0000", 2024-02-19T21:40:17.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9299999999999997e-06 2024-02-19T21:40:17.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:40:17.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.034276+0000", 2024-02-19T21:40:17.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7550000000000003e-05 2024-02-19T21:40:17.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:40:17.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.034333+0000", 2024-02-19T21:40:17.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011947000000000001 2024-02-19T21:40:17.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:40:17.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.034453+0000", 2024-02-19T21:40:17.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4636999999999995e-05 2024-02-19T21:40:17.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:40:17.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.034547+0000", 2024-02-19T21:40:17.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0068778390000000002 2024-02-19T21:40:17.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:40:17.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.041425+0000", 2024-02-19T21:40:17.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001784962 2024-02-19T21:40:17.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.043210+0000", 2024-02-19T21:40:17.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.074420248999999994 2024-02-19T21:40:17.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.117630+0000", 2024-02-19T21:40:17.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0929000000000001e-05 2024-02-19T21:40:17.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:40:17.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.117671+0000", 2024-02-19T21:40:17.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4100999999999997e-05 2024-02-19T21:40:17.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:40:17.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.117715+0000", 2024-02-19T21:40:17.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.083463397999999994 2024-02-19T21:40:17.596 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.596 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.597 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.597 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:204138 7.e 7:7df837da:::benchmark_data_smithi080_79222_object89404:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:40:17.597 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:38.038287+0000", 2024-02-19T21:40:17.597 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 99.483027820000004, 2024-02-19T21:40:17.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.085979325999999995, 2024-02-19T21:40:17.597 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:40:17.597 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:40:17.597 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:40:17.597 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:40:17.597 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:40:17.597 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 204138 2024-02-19T21:40:17.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.598 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:40:17.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:40:17.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.038287+0000", 2024-02-19T21:40:17.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:40:17.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:40:17.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.038287+0000", 2024-02-19T21:40:17.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:40:17.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:40:17.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.038286+0000", 2024-02-19T21:40:17.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0009999999999998e-06 2024-02-19T21:40:17.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:40:17.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.038292+0000", 2024-02-19T21:40:17.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2432000000000001e-05 2024-02-19T21:40:17.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:40:17.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.038304+0000", 2024-02-19T21:40:17.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2339999999999999e-06 2024-02-19T21:40:17.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:40:17.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.038311+0000", 2024-02-19T21:40:17.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1131999999999995e-05 2024-02-19T21:40:17.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:40:17.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.038392+0000", 2024-02-19T21:40:17.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000123745 2024-02-19T21:40:17.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:40:17.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.038515+0000", 2024-02-19T21:40:17.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000143151 2024-02-19T21:40:17.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:40:17.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.038659+0000", 2024-02-19T21:40:17.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028829429999999998 2024-02-19T21:40:17.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:40:17.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.041542+0000", 2024-02-19T21:40:17.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0056303380000000004 2024-02-19T21:40:17.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.047172+0000", 2024-02-19T21:40:17.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.077013092000000005 2024-02-19T21:40:17.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.124185+0000", 2024-02-19T21:40:17.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3927000000000001e-05 2024-02-19T21:40:17.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:40:17.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.124229+0000", 2024-02-19T21:40:17.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7530999999999997e-05 2024-02-19T21:40:17.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:40:17.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.124266+0000", 2024-02-19T21:40:17.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.085979325999999995 2024-02-19T21:40:17.602 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.602 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.603 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.603 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:204143 7.e 7:7f4d9d32:::benchmark_data_smithi080_79222_object89409:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:40:17.603 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:38.043290+0000", 2024-02-19T21:40:17.603 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 99.478025083999995, 2024-02-19T21:40:17.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.081082645999999994, 2024-02-19T21:40:17.603 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:40:17.603 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:40:17.603 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:40:17.603 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:40:17.603 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:40:17.603 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 204143 2024-02-19T21:40:17.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.603 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:40:17.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:40:17.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.043290+0000", 2024-02-19T21:40:17.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:40:17.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:40:17.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.043290+0000", 2024-02-19T21:40:17.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:40:17.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:40:17.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.043288+0000", 2024-02-19T21:40:17.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3069999999999996e-06 2024-02-19T21:40:17.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:40:17.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.043293+0000", 2024-02-19T21:40:17.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1689999999999992e-06 2024-02-19T21:40:17.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:40:17.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.043301+0000", 2024-02-19T21:40:17.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5539999999999999e-06 2024-02-19T21:40:17.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:40:17.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.043305+0000", 2024-02-19T21:40:17.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038935829999999999 2024-02-19T21:40:17.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:40:17.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.047199+0000", 2024-02-19T21:40:17.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118715 2024-02-19T21:40:17.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:40:17.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.047318+0000", 2024-02-19T21:40:17.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9460000000000001e-05 2024-02-19T21:40:17.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:40:17.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.047407+0000", 2024-02-19T21:40:17.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029525139999999998 2024-02-19T21:40:17.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.050360+0000", 2024-02-19T21:40:17.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001808404 2024-02-19T21:40:17.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:40:17.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.052168+0000", 2024-02-19T21:40:17.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.072129223000000006 2024-02-19T21:40:17.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.124297+0000", 2024-02-19T21:40:17.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0799e-05 2024-02-19T21:40:17.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:40:17.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.124338+0000", 2024-02-19T21:40:17.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4403000000000002e-05 2024-02-19T21:40:17.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:40:17.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:38.124372+0000", 2024-02-19T21:40:17.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.081082645999999994 2024-02-19T21:40:17.608 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.608 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.608 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.609 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:206646 7.e 7:7d6bb5df:::benchmark_data_smithi080_79222_object91912:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:40:17.609 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:40.959731+0000", 2024-02-19T21:40:17.609 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 96.561583795000004, 2024-02-19T21:40:17.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.084091476999999998, 2024-02-19T21:40:17.609 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:40:17.609 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:40:17.609 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:40:17.609 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:40:17.609 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:40:17.609 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 206646 2024-02-19T21:40:17.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.609 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:40:17.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:40:17.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.959731+0000", 2024-02-19T21:40:17.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:40:17.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:40:17.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.959731+0000", 2024-02-19T21:40:17.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:40:17.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:40:17.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.959730+0000", 2024-02-19T21:40:17.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2890000000000003e-06 2024-02-19T21:40:17.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:40:17.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.959736+0000", 2024-02-19T21:40:17.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3098000000000001e-05 2024-02-19T21:40:17.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:40:17.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.959749+0000", 2024-02-19T21:40:17.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0519999999999998e-06 2024-02-19T21:40:17.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:40:17.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.959755+0000", 2024-02-19T21:40:17.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013532799999999999 2024-02-19T21:40:17.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:40:17.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.959891+0000", 2024-02-19T21:40:17.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010744299999999999 2024-02-19T21:40:17.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:40:17.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.959998+0000", 2024-02-19T21:40:17.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013575999999999999 2024-02-19T21:40:17.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:40:17.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.960134+0000", 2024-02-19T21:40:17.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029363890000000002 2024-02-19T21:40:17.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:40:17.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.963070+0000", 2024-02-19T21:40:17.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026266039999999998 2024-02-19T21:40:17.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.965697+0000", 2024-02-19T21:40:17.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.078048566999999999 2024-02-19T21:40:17.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:41.043745+0000", 2024-02-19T21:40:17.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9660999999999999e-05 2024-02-19T21:40:17.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:40:17.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:41.043785+0000", 2024-02-19T21:40:17.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7613000000000001e-05 2024-02-19T21:40:17.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:40:17.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:41.043823+0000", 2024-02-19T21:40:17.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.084091476999999998 2024-02-19T21:40:17.614 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.614 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.615 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.615 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:206657 7.e 7:780d386f:::benchmark_data_smithi080_79222_object91923:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:40:17.615 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:40.970650+0000", 2024-02-19T21:40:17.615 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 96.550665140999996, 2024-02-19T21:40:17.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.073286131000000004, 2024-02-19T21:40:17.615 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:40:17.615 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:40:17.615 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:40:17.615 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:40:17.615 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:40:17.615 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 206657 2024-02-19T21:40:17.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.616 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:40:17.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:40:17.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.970650+0000", 2024-02-19T21:40:17.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:40:17.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:40:17.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.970650+0000", 2024-02-19T21:40:17.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:40:17.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:40:17.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.970648+0000", 2024-02-19T21:40:17.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9789999999999996e-06 2024-02-19T21:40:17.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:40:17.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.970655+0000", 2024-02-19T21:40:17.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8490000000000001e-06 2024-02-19T21:40:17.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:40:17.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.970665+0000", 2024-02-19T21:40:17.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.536e-06 2024-02-19T21:40:17.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:40:17.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.970671+0000", 2024-02-19T21:40:17.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9561999999999998e-05 2024-02-19T21:40:17.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:40:17.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.970710+0000", 2024-02-19T21:40:17.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9592999999999996e-05 2024-02-19T21:40:17.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:40:17.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.970780+0000", 2024-02-19T21:40:17.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4241999999999997e-05 2024-02-19T21:40:17.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:40:17.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.970864+0000", 2024-02-19T21:40:17.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.039061275999999999 2024-02-19T21:40:17.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:41.009925+0000", 2024-02-19T21:40:17.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1233000000000002e-05 2024-02-19T21:40:17.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:40:17.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:41.009947+0000", 2024-02-19T21:40:17.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.033908831 2024-02-19T21:40:17.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:41.043855+0000", 2024-02-19T21:40:17.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.299e-05 2024-02-19T21:40:17.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:40:17.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:41.043898+0000", 2024-02-19T21:40:17.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7540999999999999e-05 2024-02-19T21:40:17.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:40:17.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:41.043936+0000", 2024-02-19T21:40:17.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.073286131000000004 2024-02-19T21:40:17.621 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.621 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.621 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.621 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:206659 7.e 7:7ba6ad41:::benchmark_data_smithi080_79222_object91925:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:40:17.621 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:40.970973+0000", 2024-02-19T21:40:17.621 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 96.550341860000003, 2024-02-19T21:40:17.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.075722496, 2024-02-19T21:40:17.622 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:40:17.622 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:40:17.622 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:40:17.622 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:40:17.622 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:40:17.622 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 206659 2024-02-19T21:40:17.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.622 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:40:17.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:40:17.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.970973+0000", 2024-02-19T21:40:17.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:40:17.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:40:17.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.970973+0000", 2024-02-19T21:40:17.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:40:17.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:40:17.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.970972+0000", 2024-02-19T21:40:17.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9520000000000002e-06 2024-02-19T21:40:17.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:40:17.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.970977+0000", 2024-02-19T21:40:17.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6479999999999998e-06 2024-02-19T21:40:17.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:40:17.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.970987+0000", 2024-02-19T21:40:17.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1420000000000001e-06 2024-02-19T21:40:17.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:40:17.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.970992+0000", 2024-02-19T21:40:17.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0021397339999999999 2024-02-19T21:40:17.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:40:17.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.973132+0000", 2024-02-19T21:40:17.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5405e-05 2024-02-19T21:40:17.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:40:17.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.973217+0000", 2024-02-19T21:40:17.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0263e-05 2024-02-19T21:40:17.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:40:17.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:40.973307+0000", 2024-02-19T21:40:17.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.036643786999999997 2024-02-19T21:40:17.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:40:17.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:41.009951+0000", 2024-02-19T21:40:17.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060272500000000003 2024-02-19T21:40:17.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:41.010554+0000", 2024-02-19T21:40:17.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.036055208999999998 2024-02-19T21:40:17.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:41.046609+0000", 2024-02-19T21:40:17.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6964e-05 2024-02-19T21:40:17.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:40:17.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:41.046656+0000", 2024-02-19T21:40:17.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9508999999999997e-05 2024-02-19T21:40:17.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:40:17.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:41.046696+0000", 2024-02-19T21:40:17.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.075722496 2024-02-19T21:40:17.627 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.627 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.627 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.627 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:207591 7.e 7:7103c923:::benchmark_data_smithi080_79222_object92857:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:40:17.627 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:42.097252+0000", 2024-02-19T21:40:17.628 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 95.424062761000002, 2024-02-19T21:40:17.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.086708426000000005, 2024-02-19T21:40:17.628 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:40:17.628 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:40:17.628 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:40:17.628 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:40:17.628 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:40:17.628 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 207591 2024-02-19T21:40:17.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.628 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:40:17.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:40:17.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.097252+0000", 2024-02-19T21:40:17.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:40:17.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:40:17.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.097252+0000", 2024-02-19T21:40:17.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:40:17.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:40:17.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.097251+0000", 2024-02-19T21:40:17.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3329999999999999e-06 2024-02-19T21:40:17.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:40:17.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.097258+0000", 2024-02-19T21:40:17.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1151e-05 2024-02-19T21:40:17.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:40:17.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.097269+0000", 2024-02-19T21:40:17.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7159999999999997e-06 2024-02-19T21:40:17.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:40:17.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.097276+0000", 2024-02-19T21:40:17.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7854e-05 2024-02-19T21:40:17.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:40:17.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.097324+0000", 2024-02-19T21:40:17.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012699400000000001 2024-02-19T21:40:17.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:40:17.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.097451+0000", 2024-02-19T21:40:17.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000131056 2024-02-19T21:40:17.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:40:17.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.097582+0000", 2024-02-19T21:40:17.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061105550000000002 2024-02-19T21:40:17.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:40:17.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.103692+0000", 2024-02-19T21:40:17.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3604e-05 2024-02-19T21:40:17.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.103716+0000", 2024-02-19T21:40:17.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.080162237999999997 2024-02-19T21:40:17.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.183878+0000", 2024-02-19T21:40:17.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6257000000000001e-05 2024-02-19T21:40:17.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:40:17.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.183924+0000", 2024-02-19T21:40:17.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6220000000000002e-05 2024-02-19T21:40:17.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:40:17.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.183961+0000", 2024-02-19T21:40:17.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.086708426000000005 2024-02-19T21:40:17.633 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.633 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.633 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.633 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:207592 7.e 7:7f4d952f:::benchmark_data_smithi080_79222_object92858:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:40:17.634 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:42.097297+0000", 2024-02-19T21:40:17.634 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 95.424017407999997, 2024-02-19T21:40:17.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.086829431999999998, 2024-02-19T21:40:17.634 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:40:17.634 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:40:17.634 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:40:17.634 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:40:17.634 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:40:17.634 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 207592 2024-02-19T21:40:17.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.634 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:40:17.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:40:17.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.097297+0000", 2024-02-19T21:40:17.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:40:17.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:40:17.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.097297+0000", 2024-02-19T21:40:17.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:40:17.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:40:17.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.097297+0000", 2024-02-19T21:40:17.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.281e-06 2024-02-19T21:40:17.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:40:17.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.097300+0000", 2024-02-19T21:40:17.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7739999999999999e-06 2024-02-19T21:40:17.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:40:17.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.097307+0000", 2024-02-19T21:40:17.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0740000000000003e-06 2024-02-19T21:40:17.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:40:17.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.097311+0000", 2024-02-19T21:40:17.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028060110000000002 2024-02-19T21:40:17.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:40:17.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.100117+0000", 2024-02-19T21:40:17.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8356999999999994e-05 2024-02-19T21:40:17.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:40:17.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.100205+0000", 2024-02-19T21:40:17.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9227999999999994e-05 2024-02-19T21:40:17.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.638 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:40:17.638 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.100285+0000", 2024-02-19T21:40:17.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003437365 2024-02-19T21:40:17.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.638 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:40:17.638 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.103722+0000", 2024-02-19T21:40:17.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6245e-05 2024-02-19T21:40:17.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.638 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.638 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.103748+0000", 2024-02-19T21:40:17.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.080267063999999999 2024-02-19T21:40:17.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.184015+0000", 2024-02-19T21:40:17.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8347000000000002e-05 2024-02-19T21:40:17.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:40:17.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.184074+0000", 2024-02-19T21:40:17.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3198000000000001e-05 2024-02-19T21:40:17.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:40:17.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.184127+0000", 2024-02-19T21:40:17.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.086829431999999998 2024-02-19T21:40:17.640 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.640 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.640 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.640 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:207962 7.e 7:71e0268b:::benchmark_data_smithi080_79222_object93228:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:40:17.640 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:42.606514+0000", 2024-02-19T21:40:17.640 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 94.914801393000005, 2024-02-19T21:40:17.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.077917431999999995, 2024-02-19T21:40:17.640 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:40:17.640 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:40:17.640 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:40:17.640 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:40:17.641 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:40:17.641 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 207962 2024-02-19T21:40:17.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.641 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:40:17.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:40:17.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.606514+0000", 2024-02-19T21:40:17.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:40:17.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:40:17.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.606514+0000", 2024-02-19T21:40:17.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:40:17.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:40:17.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.606512+0000", 2024-02-19T21:40:17.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2899999999999997e-06 2024-02-19T21:40:17.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:40:17.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.606519+0000", 2024-02-19T21:40:17.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1983e-05 2024-02-19T21:40:17.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:40:17.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.606531+0000", 2024-02-19T21:40:17.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5150000000000003e-06 2024-02-19T21:40:17.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:40:17.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.606538+0000", 2024-02-19T21:40:17.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9706999999999997e-05 2024-02-19T21:40:17.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:40:17.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.606588+0000", 2024-02-19T21:40:17.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0959999999999996e-05 2024-02-19T21:40:17.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:40:17.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.606678+0000", 2024-02-19T21:40:17.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0127e-05 2024-02-19T21:40:17.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.644 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.644 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:40:17.644 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.606759+0000", 2024-02-19T21:40:17.644 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002347984 2024-02-19T21:40:17.644 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.644 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.644 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:40:17.644 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.609107+0000", 2024-02-19T21:40:17.644 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012571069999999999 2024-02-19T21:40:17.644 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.644 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.644 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.644 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.610364+0000", 2024-02-19T21:40:17.644 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.073985709999999996 2024-02-19T21:40:17.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.684349+0000", 2024-02-19T21:40:17.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5637999999999999e-05 2024-02-19T21:40:17.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:40:17.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.684395+0000", 2024-02-19T21:40:17.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5889999999999997e-05 2024-02-19T21:40:17.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:40:17.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.684431+0000", 2024-02-19T21:40:17.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.077917431999999995 2024-02-19T21:40:17.648 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.648 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.648 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.648 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:207971 7.e 7:723ee463:::benchmark_data_smithi080_79222_object93237:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:40:17.648 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:42.613175+0000", 2024-02-19T21:40:17.648 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 94.908139774999995, 2024-02-19T21:40:17.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.071359170999999999, 2024-02-19T21:40:17.648 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:40:17.649 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:40:17.649 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:40:17.649 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:40:17.649 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:40:17.649 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 207971 2024-02-19T21:40:17.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.649 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:40:17.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:40:17.649 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.613175+0000", 2024-02-19T21:40:17.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:40:17.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:40:17.649 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.613175+0000", 2024-02-19T21:40:17.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:40:17.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.650 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:40:17.650 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.613174+0000", 2024-02-19T21:40:17.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2450000000000001e-06 2024-02-19T21:40:17.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.650 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:40:17.650 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.613181+0000", 2024-02-19T21:40:17.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1387e-05 2024-02-19T21:40:17.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.650 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:40:17.650 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.613192+0000", 2024-02-19T21:40:17.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5940000000000001e-06 2024-02-19T21:40:17.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:40:17.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.613198+0000", 2024-02-19T21:40:17.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0287999999999998e-05 2024-02-19T21:40:17.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:40:17.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.613238+0000", 2024-02-19T21:40:17.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2497999999999994e-05 2024-02-19T21:40:17.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:40:17.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.613331+0000", 2024-02-19T21:40:17.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0014999999999998e-05 2024-02-19T21:40:17.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:40:17.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.613421+0000", 2024-02-19T21:40:17.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022767220000000001 2024-02-19T21:40:17.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:40:17.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.615697+0000", 2024-02-19T21:40:17.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00078460699999999999 2024-02-19T21:40:17.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.616482+0000", 2024-02-19T21:40:17.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.067985779999999996 2024-02-19T21:40:17.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:17.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.684468+0000", 2024-02-19T21:40:17.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5392999999999998e-05 2024-02-19T21:40:17.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:40:17.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.684503+0000", 2024-02-19T21:40:17.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1217999999999998e-05 2024-02-19T21:40:17.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:17.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:17.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:40:17.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.684534+0000", 2024-02-19T21:40:17.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.071359170999999999 2024-02-19T21:40:17.654 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.654 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.654 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.654 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:17.654 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:17.654 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:40:17.654 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:40:17.687 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:16.252616+0000 osd.6 (osd.6) 114 : cluster [DBG] 5.2 scrub starts 2024-02-19T21:40:17.687 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:16.260214+0000 osd.6 (osd.6) 115 : cluster [DBG] 5.2 scrub ok 2024-02-19T21:40:17.687 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:16.825397+0000 osd.5 (osd.5) 137 : cluster [DBG] 6.d scrub starts 2024-02-19T21:40:17.688 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:16.845259+0000 osd.5 (osd.5) 138 : cluster [DBG] 6.d scrub ok 2024-02-19T21:40:17.688 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:16.858380+0000 osd.7 (osd.7) 127 : cluster [DBG] 2.1c scrub starts 2024-02-19T21:40:17.688 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:16.863928+0000 osd.7 (osd.7) 128 : cluster [DBG] 2.1c scrub ok 2024-02-19T21:40:17.688 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:17.415981+0000 mon.a (mon.0) 1012 : audit [DBG] from='client.? 172.21.15.80:0/1880903348' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-19T21:40:17.712 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:17.741 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:40:17.743 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:17.744 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:40:17.845 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:40:17.875 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:17.954 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 21 16 47462 47446 141.182 87.8125 0.0102816 0.00707921 2024-02-19T21:40:17.979 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:40:17.981 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:16.252616+0000 osd.6 (osd.6) 114 : cluster [DBG] 5.2 scrub starts 2024-02-19T21:40:17.981 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:16.260214+0000 osd.6 (osd.6) 115 : cluster [DBG] 5.2 scrub ok 2024-02-19T21:40:17.981 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:16.825397+0000 osd.5 (osd.5) 137 : cluster [DBG] 6.d scrub starts 2024-02-19T21:40:17.981 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:16.845259+0000 osd.5 (osd.5) 138 : cluster [DBG] 6.d scrub ok 2024-02-19T21:40:17.981 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:16.858380+0000 osd.7 (osd.7) 127 : cluster [DBG] 2.1c scrub starts 2024-02-19T21:40:17.981 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:16.863928+0000 osd.7 (osd.7) 128 : cluster [DBG] 2.1c scrub ok 2024-02-19T21:40:17.982 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:17.415981+0000 mon.a (mon.0) 1012 : audit [DBG] from='client.? 172.21.15.80:0/1880903348' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-19T21:40:17.982 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:17.982 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:40:18.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:16.252616+0000 osd.6 (osd.6) 114 : cluster [DBG] 5.2 scrub starts 2024-02-19T21:40:18.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:16.260214+0000 osd.6 (osd.6) 115 : cluster [DBG] 5.2 scrub ok 2024-02-19T21:40:18.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:16.825397+0000 osd.5 (osd.5) 137 : cluster [DBG] 6.d scrub starts 2024-02-19T21:40:18.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:16.845259+0000 osd.5 (osd.5) 138 : cluster [DBG] 6.d scrub ok 2024-02-19T21:40:18.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:16.858380+0000 osd.7 (osd.7) 127 : cluster [DBG] 2.1c scrub starts 2024-02-19T21:40:18.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:16.863928+0000 osd.7 (osd.7) 128 : cluster [DBG] 2.1c scrub ok 2024-02-19T21:40:18.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:17.415981+0000 mon.a (mon.0) 1012 : audit [DBG] from='client.? 172.21.15.80:0/1880903348' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-19T21:40:18.083 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:40:18.135 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:18.166 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:40:18.171 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:18.171 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:40:18.272 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:40:18.308 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:18.768 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:40:18.771 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:18.772 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:40:18.800 INFO:tasks.thrashosds.thrasher:j is {'epoch': 173, 'fsid': '6f763558-cf6d-11ee-95bb-87774f69a715', 'created': '2024-02-19T21:26:16.880265+0000', 'modified': '2024-02-19T21:40:11.621762+0000', 'last_up_change': '2024-02-19T21:32:14.805693+0000', 'last_in_change': '2024-02-19T21:39:38.443319+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 18, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 8, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-19T21:30:05.947623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2024-02-19T21:32:22.082250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2024-02-19T21:32:22.333164+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 3, 'pg_placement_num': 3, 'pg_placement_num_target': 3, 'pg_num_target': 3, 'pg_num_pending': 3, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2024-02-19T21:32:23.632615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2024-02-19T21:32:25.600876+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2024-02-19T21:32:27.661242+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}}, {'pool': 8, 'pool_name': 'unique_pool_1', 'create_time': '2024-02-19T21:39:38.377517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '171', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': 'a72c63f6-46b3-4202-99da-7b0c92b799a5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 169, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6802', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6803', 'nonce': 3531298825}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6804', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6805', 'nonce': 3531298825}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6808', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6809', 'nonce': 3531298825}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6806', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6807', 'nonce': 3531298825}]}, 'public_addr': '172.21.15.80:6803/3531298825', 'cluster_addr': '172.21.15.80:6805/3531298825', 'heartbeat_back_addr': '172.21.15.80:6809/3531298825', 'heartbeat_front_addr': '172.21.15.80:6807/3531298825', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7d4e170e-b0ca-4e19-be35-4038ca126ee6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 165, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6810', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6811', 'nonce': 1497235950}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6812', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6813', 'nonce': 1497235950}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6816', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6817', 'nonce': 1497235950}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6814', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6815', 'nonce': 1497235950}]}, 'public_addr': '172.21.15.80:6811/1497235950', 'cluster_addr': '172.21.15.80:6813/1497235950', 'heartbeat_back_addr': '172.21.15.80:6817/1497235950', 'heartbeat_front_addr': '172.21.15.80:6815/1497235950', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'cf461b67-f3e8-45e9-b2f6-777752ba5574', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 18, 'up_thru': 144, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6818', 'nonce': 3131848307}, {'type': 'v1', 'addr': '172.21.15.80:6819', 'nonce': 3131848307}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6820', 'nonce': 3131848307}, {'type': 'v1', 'addr': '172.21.15.80:6821', 'nonce': 3131848307}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6824', 'nonce': 3131848307}, {'type': 'v1', 'addr': '172.21.15.80:6825', 'nonce': 3131848307}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6822', 'nonce': 3131848307}, {'type': 'v1', 'addr': '172.21.15.80:6823', 'nonce': 3131848307}]}, 'public_addr': '172.21.15.80:6819/3131848307', 'cluster_addr': '172.21.15.80:6821/3131848307', 'heartbeat_back_addr': '172.21.15.80:6825/3131848307', 'heartbeat_front_addr': '172.21.15.80:6823/3131848307', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '76318cdd-5fce-4a40-95c9-300d55c34820', 'up': 1, 'in': 1, 'weight': 0.3962554931640625, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 26, 'up_thru': 169, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6826', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6827', 'nonce': 2007978078}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6828', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6829', 'nonce': 2007978078}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6832', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6833', 'nonce': 2007978078}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6830', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6831', 'nonce': 2007978078}]}, 'public_addr': '172.21.15.80:6827/2007978078', 'cluster_addr': '172.21.15.80:6829/2007978078', 'heartbeat_back_addr': '172.21.15.80:6833/2007978078', 'heartbeat_front_addr': '172.21.15.80:6831/2007978078', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '6484964f-3391-4e1d-a56c-813f46124062', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.427398681640625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 32, 'up_thru': 165, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6800', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6801', 'nonce': 1922002860}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6802', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6803', 'nonce': 1922002860}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6806', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6807', 'nonce': 1922002860}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6804', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6805', 'nonce': 1922002860}]}, 'public_addr': '172.21.15.157:6801/1922002860', 'cluster_addr': '172.21.15.157:6803/1922002860', 'heartbeat_back_addr': '172.21.15.157:6807/1922002860', 'heartbeat_front_addr': '172.21.15.157:6805/1922002860', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '8c7e0309-8c3b-40b9-99d9-96620e52742f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 38, 'up_thru': 169, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6808', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6809', 'nonce': 960889603}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6810', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6811', 'nonce': 960889603}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6814', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6815', 'nonce': 960889603}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6812', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6813', 'nonce': 960889603}]}, 'public_addr': '172.21.15.157:6809/960889603', 'cluster_addr': '172.21.15.157:6811/960889603', 'heartbeat_back_addr': '172.21.15.157:6815/960889603', 'heartbeat_front_addr': '172.21.15.157:6813/960889603', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '5b7d44a3-197d-482c-bf9e-de5e9013a851', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 47, 'up_thru': 169, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6816', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6817', 'nonce': 2598265223}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6818', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6819', 'nonce': 2598265223}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6822', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6823', 'nonce': 2598265223}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6820', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6821', 'nonce': 2598265223}]}, 'public_addr': '172.21.15.157:6817/2598265223', 'cluster_addr': '172.21.15.157:6819/2598265223', 'heartbeat_back_addr': '172.21.15.157:6823/2598265223', 'heartbeat_front_addr': '172.21.15.157:6821/2598265223', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '7e2d0287-928d-40f8-841b-6c2077fc08ac', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 55, 'up_thru': 169, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6824', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6825', 'nonce': 3619345894}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6826', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6827', 'nonce': 3619345894}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6830', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6831', 'nonce': 3619345894}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6828', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6829', 'nonce': 3619345894}]}, 'public_addr': '172.21.15.157:6825/3619345894', 'cluster_addr': '172.21.15.157:6827/3619345894', 'heartbeat_back_addr': '172.21.15.157:6831/3619345894', 'heartbeat_front_addr': '172.21.15.157:6829/3619345894', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:39:17.441678+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:38:53.799761+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-02-19T21:39:28.642236+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:39:29.332667+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:39:02.595367+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:39:04.500308+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:39:07.665506+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:39:17.068940+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '6.c', 'osds': [5, 0, 2]}], 'pg_upmap_items': [{'pgid': '4.6', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.e', 'mappings': [{'from': 1, 'to': 7}]}, {'pgid': '4.f', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.19', 'mappings': [{'from': 1, 'to': 7}]}, {'pgid': '4.1e', 'mappings': [{'from': 7, 'to': 5}]}, {'pgid': '4.1f', 'mappings': [{'from': 1, 'to': 7}, {'from': 6, 'to': 0}]}, {'pgid': '5.1', 'mappings': [{'from': 4, 'to': 6}]}, {'pgid': '5.d', 'mappings': [{'from': 0, 'to': 3}]}, {'pgid': '5.13', 'mappings': [{'from': 0, 'to': 6}]}, {'pgid': '5.14', 'mappings': [{'from': 7, 'to': 6}]}], 'pg_temp': [], 'primary_temp': [], 'blocklist': {'172.21.15.80:6800/2867197629': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:0/1659656010': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:6801/2272739550': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:0/867908385': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:0/398750494': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:0/2833137430': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:0/2520755315': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:6800/2094869828': '2024-02-20T21:26:51.262073+0000', '172.21.15.80:6800/2272739550': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:6801/2094869828': '2024-02-20T21:26:51.262073+0000', '172.21.15.80:0/2130852198': '2024-02-20T21:26:51.262073+0000', '172.21.15.80:6801/2867197629': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:0/1952386920': '2024-02-20T21:26:51.262073+0000'}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-02-19T21:40:18.800 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:40:18.875 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:40:18.936 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:18.954 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 22 16 49020 49004 139.191 97.375 0.0160689 0.00717902 2024-02-19T21:40:18.965 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:40:18.969 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:16.962921+0000 mgr.y (mgr.14514) 299 : cluster [DBG] pgmap v328: 148 pgs: 148 active+clean; 2.6 GiB data, 9.7 GiB used, 616 GiB / 626 GiB avail; 1023 B/s rd, 119 MiB/s wr, 1.91k op/s 2024-02-19T21:40:18.970 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:17.851545+0000 osd.5 (osd.5) 139 : cluster [DBG] 6.a scrub starts 2024-02-19T21:40:18.970 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:17.853009+0000 osd.5 (osd.5) 140 : cluster [DBG] 6.a scrub ok 2024-02-19T21:40:18.970 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:18.971 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:40:19.071 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:40:19.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:16.962921+0000 mgr.y (mgr.14514) 299 : cluster [DBG] pgmap v328: 148 pgs: 148 active+clean; 2.6 GiB data, 9.7 GiB used, 616 GiB / 626 GiB avail; 1023 B/s rd, 119 MiB/s wr, 1.91k op/s 2024-02-19T21:40:19.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:17.851545+0000 osd.5 (osd.5) 139 : cluster [DBG] 6.a scrub starts 2024-02-19T21:40:19.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:17.853009+0000 osd.5 (osd.5) 140 : cluster [DBG] 6.a scrub ok 2024-02-19T21:40:19.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:16.962921+0000 mgr.y (mgr.14514) 299 : cluster [DBG] pgmap v328: 148 pgs: 148 active+clean; 2.6 GiB data, 9.7 GiB used, 616 GiB / 626 GiB avail; 1023 B/s rd, 119 MiB/s wr, 1.91k op/s 2024-02-19T21:40:19.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:17.851545+0000 osd.5 (osd.5) 139 : cluster [DBG] 6.a scrub starts 2024-02-19T21:40:19.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:17.853009+0000 osd.5 (osd.5) 140 : cluster [DBG] 6.a scrub ok 2024-02-19T21:40:19.122 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:19.163 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:40:19.166 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:19.167 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:40:19.268 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:40:19.312 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.3 dump_ops_in_flight 2024-02-19T21:40:19.343 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:19.909 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:40:19.913 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:19.913 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:40:19.946 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:40:19.954 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 23 16 50494 50478 137.144 92.125 0.00730308 0.00728512 2024-02-19T21:40:19.998 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:40:20.015 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:40:20.055 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:17.977172+0000 osd.6 (osd.6) 116 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:40:20.055 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:17.977224+0000 osd.6 (osd.6) 117 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:40:20.055 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:18.205888+0000 osd.1 (osd.1) 131 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:40:20.055 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:18.214838+0000 osd.1 (osd.1) 132 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:40:20.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:18.703768+0000 mon.a (mon.0) 1013 : cluster [DBG] osdmap e174: 8 total, 8 up, 7 in 2024-02-19T21:40:20.060 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:20.077 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:40:20.080 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:20.080 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:40:20.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:17.977172+0000 osd.6 (osd.6) 116 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:40:20.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:17.977224+0000 osd.6 (osd.6) 117 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:40:20.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:18.205888+0000 osd.1 (osd.1) 131 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:40:20.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:18.214838+0000 osd.1 (osd.1) 132 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:40:20.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:18.703768+0000 mon.a (mon.0) 1013 : cluster [DBG] osdmap e174: 8 total, 8 up, 7 in 2024-02-19T21:40:20.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:17.977172+0000 osd.6 (osd.6) 116 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:40:20.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:17.977224+0000 osd.6 (osd.6) 117 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:40:20.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:18.205888+0000 osd.1 (osd.1) 131 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:40:20.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:18.214838+0000 osd.1 (osd.1) 132 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:40:20.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:18.703768+0000 mon.a (mon.0) 1013 : cluster [DBG] osdmap e174: 8 total, 8 up, 7 in 2024-02-19T21:40:20.181 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:40:20.229 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:20.307 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:40:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:40:20.587 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:40:20.591 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:20.592 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:40:20.692 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:40:20.753 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:20.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:18.963405+0000 mgr.y (mgr.14514) 300 : cluster [DBG] pgmap v330: 148 pgs: 148 active+clean; 2.6 GiB data, 9.7 GiB used, 616 GiB / 626 GiB avail; 639 B/s rd, 69 MiB/s wr, 1.10k op/s 2024-02-19T21:40:20.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:19.269225+0000 osd.6 (osd.6) 118 : cluster [DBG] 5.1f scrub starts 2024-02-19T21:40:20.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:19.276735+0000 osd.6 (osd.6) 119 : cluster [DBG] 5.1f scrub ok 2024-02-19T21:40:20.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:19.689289+0000 osd.5 (osd.5) 141 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:40:20.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:19.689338+0000 osd.5 (osd.5) 142 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:40:20.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:19.715167+0000 mon.a (mon.0) 1014 : cluster [DBG] osdmap e175: 8 total, 8 up, 7 in 2024-02-19T21:40:20.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:19.862662+0000 osd.7 (osd.7) 129 : cluster [DBG] 5.9 scrub starts 2024-02-19T21:40:20.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:19.870242+0000 osd.7 (osd.7) 130 : cluster [DBG] 5.9 scrub ok 2024-02-19T21:40:20.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:18.963405+0000 mgr.y (mgr.14514) 300 : cluster [DBG] pgmap v330: 148 pgs: 148 active+clean; 2.6 GiB data, 9.7 GiB used, 616 GiB / 626 GiB avail; 639 B/s rd, 69 MiB/s wr, 1.10k op/s 2024-02-19T21:40:20.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:19.269225+0000 osd.6 (osd.6) 118 : cluster [DBG] 5.1f scrub starts 2024-02-19T21:40:20.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:19.276735+0000 osd.6 (osd.6) 119 : cluster [DBG] 5.1f scrub ok 2024-02-19T21:40:20.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:19.689289+0000 osd.5 (osd.5) 141 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:40:20.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:19.689338+0000 osd.5 (osd.5) 142 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:40:20.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:19.715167+0000 mon.a (mon.0) 1014 : cluster [DBG] osdmap e175: 8 total, 8 up, 7 in 2024-02-19T21:40:20.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:19.862662+0000 osd.7 (osd.7) 129 : cluster [DBG] 5.9 scrub starts 2024-02-19T21:40:20.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:19.870242+0000 osd.7 (osd.7) 130 : cluster [DBG] 5.9 scrub ok 2024-02-19T21:40:20.848 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:40:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:40:20] "GET /metrics HTTP/1.1" 200 175790 "" "Prometheus/2.33.4" 2024-02-19T21:40:20.954 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 24 16 51897 51881 135.083 87.6875 0.0064075 0.00739836 2024-02-19T21:40:21.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:18.963405+0000 mgr.y (mgr.14514) 300 : cluster [DBG] pgmap v330: 148 pgs: 148 active+clean; 2.6 GiB data, 9.7 GiB used, 616 GiB / 626 GiB avail; 639 B/s rd, 69 MiB/s wr, 1.10k op/s 2024-02-19T21:40:21.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:19.269225+0000 osd.6 (osd.6) 118 : cluster [DBG] 5.1f scrub starts 2024-02-19T21:40:21.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:19.276735+0000 osd.6 (osd.6) 119 : cluster [DBG] 5.1f scrub ok 2024-02-19T21:40:21.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:19.689289+0000 osd.5 (osd.5) 141 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:40:21.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:19.689338+0000 osd.5 (osd.5) 142 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:40:21.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:19.715167+0000 mon.a (mon.0) 1014 : cluster [DBG] osdmap e175: 8 total, 8 up, 7 in 2024-02-19T21:40:21.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:19.862662+0000 osd.7 (osd.7) 129 : cluster [DBG] 5.9 scrub starts 2024-02-19T21:40:21.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:19.870242+0000 osd.7 (osd.7) 130 : cluster [DBG] 5.9 scrub ok 2024-02-19T21:40:21.517 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:40:21.530 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:21.530 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:40:21.631 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:40:21.690 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:21.721 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:40:21.726 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:21.726 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:40:21.827 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:40:21.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:20.214573+0000 mgr.y (mgr.14514) 301 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:40:21.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:20.214573+0000 mgr.y (mgr.14514) 301 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:40:21.869 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:21.910 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:40:21.954 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 25 16 53410 53394 133.462 94.5625 0.00590582 0.00748725 2024-02-19T21:40:22.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:20.214573+0000 mgr.y (mgr.14514) 301 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:40:22.640 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:40:22.646 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:22.646 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:40:22.656 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:40:22.747 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:40:22.803 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:22.839 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:40:22.843 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:22.843 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:40:22.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:20.964224+0000 mgr.y (mgr.14514) 302 : cluster [DBG] pgmap v332: 148 pgs: 148 active+clean; 3.1 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1.2 KiB/s rd, 129 MiB/s wr, 2.06k op/s 2024-02-19T21:40:22.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:21.362580+0000 osd.6 (osd.6) 120 : cluster [DBG] 6.c scrub starts 2024-02-19T21:40:22.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:21.371233+0000 osd.6 (osd.6) 121 : cluster [DBG] 6.c scrub ok 2024-02-19T21:40:22.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:21.858317+0000 osd.7 (osd.7) 131 : cluster [DBG] 5.d scrub starts 2024-02-19T21:40:22.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:21.863952+0000 osd.7 (osd.7) 132 : cluster [DBG] 5.d scrub ok 2024-02-19T21:40:22.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:20.964224+0000 mgr.y (mgr.14514) 302 : cluster [DBG] pgmap v332: 148 pgs: 148 active+clean; 3.1 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1.2 KiB/s rd, 129 MiB/s wr, 2.06k op/s 2024-02-19T21:40:22.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:21.362580+0000 osd.6 (osd.6) 120 : cluster [DBG] 6.c scrub starts 2024-02-19T21:40:22.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:21.371233+0000 osd.6 (osd.6) 121 : cluster [DBG] 6.c scrub ok 2024-02-19T21:40:22.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:21.858317+0000 osd.7 (osd.7) 131 : cluster [DBG] 5.d scrub starts 2024-02-19T21:40:22.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:21.863952+0000 osd.7 (osd.7) 132 : cluster [DBG] 5.d scrub ok 2024-02-19T21:40:22.944 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:40:22.954 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 26 16 54842 54826 131.771 89.5 0.0106128 0.00758458 2024-02-19T21:40:22.988 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:23.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:20.964224+0000 mgr.y (mgr.14514) 302 : cluster [DBG] pgmap v332: 148 pgs: 148 active+clean; 3.1 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1.2 KiB/s rd, 129 MiB/s wr, 2.06k op/s 2024-02-19T21:40:23.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:21.362580+0000 osd.6 (osd.6) 120 : cluster [DBG] 6.c scrub starts 2024-02-19T21:40:23.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:21.371233+0000 osd.6 (osd.6) 121 : cluster [DBG] 6.c scrub ok 2024-02-19T21:40:23.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:21.858317+0000 osd.7 (osd.7) 131 : cluster [DBG] 5.d scrub starts 2024-02-19T21:40:23.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:21.863952+0000 osd.7 (osd.7) 132 : cluster [DBG] 5.d scrub ok 2024-02-19T21:40:23.202 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:40:23.206 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:23.207 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:40:23.308 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:40:23.343 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:23.813 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:40:23.817 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:23.818 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:40:23.919 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:40:23.954 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 27 16 56279 56263 130.217 89.8125 0.00601553 0.00767535 2024-02-19T21:40:23.971 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:24.001 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:40:24.005 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:24.005 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:40:24.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:22.621765+0000 osd.1 (osd.1) 133 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:40:24.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:22.621823+0000 osd.1 (osd.1) 134 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:40:24.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:22.747771+0000 mon.a (mon.0) 1015 : cluster [DBG] osdmap e176: 8 total, 8 up, 7 in 2024-02-19T21:40:24.062 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:22.765411+0000 osd.5 (osd.5) 143 : cluster [DBG] 5.f scrub starts 2024-02-19T21:40:24.062 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:22.774073+0000 osd.5 (osd.5) 144 : cluster [DBG] 5.f scrub ok 2024-02-19T21:40:24.062 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:22.821583+0000 osd.7 (osd.7) 133 : cluster [DBG] 5.4 scrub starts 2024-02-19T21:40:24.062 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:22.826672+0000 osd.7 (osd.7) 134 : cluster [DBG] 5.4 scrub ok 2024-02-19T21:40:24.062 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:23.152333+0000 osd.7 (osd.7) 135 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:40:24.062 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:23.152384+0000 osd.7 (osd.7) 136 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:40:24.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:22.621765+0000 osd.1 (osd.1) 133 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:40:24.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:22.621823+0000 osd.1 (osd.1) 134 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:40:24.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:22.747771+0000 mon.a (mon.0) 1015 : cluster [DBG] osdmap e176: 8 total, 8 up, 7 in 2024-02-19T21:40:24.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:22.765411+0000 osd.5 (osd.5) 143 : cluster [DBG] 5.f scrub starts 2024-02-19T21:40:24.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:22.774073+0000 osd.5 (osd.5) 144 : cluster [DBG] 5.f scrub ok 2024-02-19T21:40:24.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:22.821583+0000 osd.7 (osd.7) 133 : cluster [DBG] 5.4 scrub starts 2024-02-19T21:40:24.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:22.826672+0000 osd.7 (osd.7) 134 : cluster [DBG] 5.4 scrub ok 2024-02-19T21:40:24.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:23.152333+0000 osd.7 (osd.7) 135 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:40:24.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:23.152384+0000 osd.7 (osd.7) 136 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:40:24.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:22.621765+0000 osd.1 (osd.1) 133 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:40:24.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:22.621823+0000 osd.1 (osd.1) 134 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:40:24.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:22.747771+0000 mon.a (mon.0) 1015 : cluster [DBG] osdmap e176: 8 total, 8 up, 7 in 2024-02-19T21:40:24.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:22.765411+0000 osd.5 (osd.5) 143 : cluster [DBG] 5.f scrub starts 2024-02-19T21:40:24.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:22.774073+0000 osd.5 (osd.5) 144 : cluster [DBG] 5.f scrub ok 2024-02-19T21:40:24.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:22.821583+0000 osd.7 (osd.7) 133 : cluster [DBG] 5.4 scrub starts 2024-02-19T21:40:24.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:22.826672+0000 osd.7 (osd.7) 134 : cluster [DBG] 5.4 scrub ok 2024-02-19T21:40:24.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:23.152333+0000 osd.7 (osd.7) 135 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:40:24.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:23.152384+0000 osd.7 (osd.7) 136 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:40:24.106 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:40:24.162 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:24.269 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:40:24.272 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:24.273 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:40:24.373 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:40:24.438 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:24.479 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:40:24.484 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:24.485 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:40:24.585 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:40:24.634 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:24.662 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:40:24.667 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:24.667 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:40:24.768 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:40:24.800 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-02-19T21:40:24.827 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:22.964766+0000 mgr.y (mgr.14514) 303 : cluster [DBG] pgmap v334: 148 pgs: 148 active+clean; 3.1 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 853 B/s rd, 80 MiB/s wr, 1.28k op/s 2024-02-19T21:40:24.827 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:23.323147+0000 osd.0 (osd.0) 145 : cluster [DBG] 5.b scrub starts 2024-02-19T21:40:24.828 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:23.324294+0000 osd.0 (osd.0) 146 : cluster [DBG] 5.b scrub ok 2024-02-19T21:40:24.828 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:23.360497+0000 osd.6 (osd.6) 122 : cluster [DBG] 5.18 scrub starts 2024-02-19T21:40:24.828 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:23.364572+0000 osd.6 (osd.6) 123 : cluster [DBG] 5.18 scrub ok 2024-02-19T21:40:24.828 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:23.740594+0000 osd.5 (osd.5) 145 : cluster [DBG] 4.8 scrub starts 2024-02-19T21:40:24.828 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:23.751874+0000 osd.5 (osd.5) 146 : cluster [DBG] 4.8 scrub ok 2024-02-19T21:40:24.828 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:23.763563+0000 mon.a (mon.0) 1016 : cluster [DBG] osdmap e177: 8 total, 8 up, 7 in 2024-02-19T21:40:24.828 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:24.459552+0000 mon.c (mon.2) 43 : audit [INF] from='client.? 172.21.15.80:0/1724437339' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:40:24.828 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:24.459925+0000 mon.a (mon.0) 1017 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:40:24.828 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:22.964766+0000 mgr.y (mgr.14514) 303 : cluster [DBG] pgmap v334: 148 pgs: 148 active+clean; 3.1 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 853 B/s rd, 80 MiB/s wr, 1.28k op/s 2024-02-19T21:40:24.828 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:23.323147+0000 osd.0 (osd.0) 145 : cluster [DBG] 5.b scrub starts 2024-02-19T21:40:24.828 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:23.324294+0000 osd.0 (osd.0) 146 : cluster [DBG] 5.b scrub ok 2024-02-19T21:40:24.829 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:23.360497+0000 osd.6 (osd.6) 122 : cluster [DBG] 5.18 scrub starts 2024-02-19T21:40:24.829 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:23.364572+0000 osd.6 (osd.6) 123 : cluster [DBG] 5.18 scrub ok 2024-02-19T21:40:24.829 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:23.740594+0000 osd.5 (osd.5) 145 : cluster [DBG] 4.8 scrub starts 2024-02-19T21:40:24.829 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:23.751874+0000 osd.5 (osd.5) 146 : cluster [DBG] 4.8 scrub ok 2024-02-19T21:40:24.829 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:23.763563+0000 mon.a (mon.0) 1016 : cluster [DBG] osdmap e177: 8 total, 8 up, 7 in 2024-02-19T21:40:24.829 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:24.459552+0000 mon.c (mon.2) 43 : audit [INF] from='client.? 172.21.15.80:0/1724437339' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:40:24.829 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:24.459925+0000 mon.a (mon.0) 1017 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:40:24.854 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:24.907 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:40:24.908 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-02-19T21:40:24.908 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:24.908 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.24932.0:57523 8.a e178/165 8:50cfca86:::benchmark_data_smithi080_100924_object57522:head v 178'3500, mlcod=178'3498)", 2024-02-19T21:40:24.908 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:40:24.905393+0000", 2024-02-19T21:40:24.908 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.000776262, 2024-02-19T21:40:24.908 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00079644600000000002, 2024-02-19T21:40:24.908 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:40:24.908 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:40:24.908 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:40:24.908 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:24.908 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:40:24.908 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:24.905393+0000", 2024-02-19T21:40:24.909 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:40:24.909 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:24.909 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:24.909 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:40:24.909 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:24.905393+0000", 2024-02-19T21:40:24.909 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:40:24.909 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:24.909 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:24.909 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:40:24.909 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:24.905393+0000", 2024-02-19T21:40:24.909 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5032e-05 2024-02-19T21:40:24.909 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:24.909 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:24.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:40:24.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:24.905418+0000", 2024-02-19T21:40:24.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1127999999999999e-05 2024-02-19T21:40:24.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:24.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:24.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:40:24.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:24.905429+0000", 2024-02-19T21:40:24.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0390000000000001e-06 2024-02-19T21:40:24.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:24.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:24.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:40:24.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:24.905435+0000", 2024-02-19T21:40:24.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0018999999999997e-05 2024-02-19T21:40:24.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:24.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:24.911 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:40:24.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:24.905475+0000", 2024-02-19T21:40:24.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6138e-05 2024-02-19T21:40:24.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:24.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:24.911 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:40:24.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:24.905491+0000", 2024-02-19T21:40:24.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7504999999999996e-05 2024-02-19T21:40:24.911 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:24.911 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:24.911 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:24.911 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:24.912 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:40:24.912 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 1 2024-02-19T21:40:24.912 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:40:24.955 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 28 16 57591 57575 128.495 82 0.0120303 0.0077774 2024-02-19T21:40:25.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:22.964766+0000 mgr.y (mgr.14514) 303 : cluster [DBG] pgmap v334: 148 pgs: 148 active+clean; 3.1 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 853 B/s rd, 80 MiB/s wr, 1.28k op/s 2024-02-19T21:40:25.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:23.323147+0000 osd.0 (osd.0) 145 : cluster [DBG] 5.b scrub starts 2024-02-19T21:40:25.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:23.324294+0000 osd.0 (osd.0) 146 : cluster [DBG] 5.b scrub ok 2024-02-19T21:40:25.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:23.360497+0000 osd.6 (osd.6) 122 : cluster [DBG] 5.18 scrub starts 2024-02-19T21:40:25.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:23.364572+0000 osd.6 (osd.6) 123 : cluster [DBG] 5.18 scrub ok 2024-02-19T21:40:25.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:23.740594+0000 osd.5 (osd.5) 145 : cluster [DBG] 4.8 scrub starts 2024-02-19T21:40:25.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:23.751874+0000 osd.5 (osd.5) 146 : cluster [DBG] 4.8 scrub ok 2024-02-19T21:40:25.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:23.763563+0000 mon.a (mon.0) 1016 : cluster [DBG] osdmap e177: 8 total, 8 up, 7 in 2024-02-19T21:40:25.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:24.459552+0000 mon.c (mon.2) 43 : audit [INF] from='client.? 172.21.15.80:0/1724437339' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:40:25.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:24.459925+0000 mon.a (mon.0) 1017 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:40:25.419 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:40:25.428 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:25.428 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:40:25.529 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:40:25.567 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:25.769 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:24.323233+0000 osd.6 (osd.6) 124 : cluster [DBG] 4.5 scrub starts 2024-02-19T21:40:25.769 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:24.331862+0000 osd.6 (osd.6) 125 : cluster [DBG] 4.5 scrub ok 2024-02-19T21:40:25.769 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:24.759015+0000 mon.a (mon.0) 1018 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:40:25.769 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:24.759050+0000 mon.a (mon.0) 1019 : cluster [INF] Cluster is now healthy 2024-02-19T21:40:25.769 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:24.780139+0000 mon.a (mon.0) 1020 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:40:25.770 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:24.780187+0000 mon.a (mon.0) 1021 : cluster [DBG] osdmap e178: 8 total, 8 up, 7 in 2024-02-19T21:40:25.770 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:24.782603+0000 osd.7 (osd.7) 137 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:40:25.770 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:24.788636+0000 osd.7 (osd.7) 138 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:40:25.770 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:25.010449+0000 mon.a (mon.0) 1022 : cluster [DBG] osdmap e179: 8 total, 8 up, 7 in 2024-02-19T21:40:25.955 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 29 16 58955 58939 127.003 85.25 0.00342444 0.007869 2024-02-19T21:40:26.057 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:40:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:40:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:40:26.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:24.323233+0000 osd.6 (osd.6) 124 : cluster [DBG] 4.5 scrub starts 2024-02-19T21:40:26.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:24.331862+0000 osd.6 (osd.6) 125 : cluster [DBG] 4.5 scrub ok 2024-02-19T21:40:26.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:24.759015+0000 mon.a (mon.0) 1018 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:40:26.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:24.759050+0000 mon.a (mon.0) 1019 : cluster [INF] Cluster is now healthy 2024-02-19T21:40:26.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:24.780139+0000 mon.a (mon.0) 1020 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:40:26.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:24.780187+0000 mon.a (mon.0) 1021 : cluster [DBG] osdmap e178: 8 total, 8 up, 7 in 2024-02-19T21:40:26.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:24.782603+0000 osd.7 (osd.7) 137 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:40:26.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:24.788636+0000 osd.7 (osd.7) 138 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:40:26.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:25.010449+0000 mon.a (mon.0) 1022 : cluster [DBG] osdmap e179: 8 total, 8 up, 7 in 2024-02-19T21:40:26.082 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:24.323233+0000 osd.6 (osd.6) 124 : cluster [DBG] 4.5 scrub starts 2024-02-19T21:40:26.082 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:24.331862+0000 osd.6 (osd.6) 125 : cluster [DBG] 4.5 scrub ok 2024-02-19T21:40:26.082 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:24.759015+0000 mon.a (mon.0) 1018 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:40:26.082 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:24.759050+0000 mon.a (mon.0) 1019 : cluster [INF] Cluster is now healthy 2024-02-19T21:40:26.082 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:24.780139+0000 mon.a (mon.0) 1020 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:40:26.082 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:24.780187+0000 mon.a (mon.0) 1021 : cluster [DBG] osdmap e178: 8 total, 8 up, 7 in 2024-02-19T21:40:26.082 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:24.782603+0000 osd.7 (osd.7) 137 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:40:26.082 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:24.788636+0000 osd.7 (osd.7) 138 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:40:26.082 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:25.010449+0000 mon.a (mon.0) 1022 : cluster [DBG] osdmap e179: 8 total, 8 up, 7 in 2024-02-19T21:40:26.108 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.3 dump_blocked_ops 2024-02-19T21:40:26.955 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 30 16 60366 60350 125.709 88.1875 0.0103094 0.00795074 2024-02-19T21:40:27.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:24.965422+0000 mgr.y (mgr.14514) 304 : cluster [DBG] pgmap v337: 148 pgs: 148 active+clean; 3.4 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 1.9 KiB/s rd, 150 MiB/s wr, 2.40k op/s 2024-02-19T21:40:27.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:25.254408+0000 osd.1 (osd.1) 135 : cluster [DBG] 5.19 deep-scrub starts 2024-02-19T21:40:27.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:25.265473+0000 osd.1 (osd.1) 136 : cluster [DBG] 5.19 deep-scrub ok 2024-02-19T21:40:27.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:25.358991+0000 osd.0 (osd.0) 147 : cluster [DBG] 5.3 scrub starts 2024-02-19T21:40:27.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:25.363228+0000 osd.0 (osd.0) 148 : cluster [DBG] 5.3 scrub ok 2024-02-19T21:40:27.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:25.756539+0000 osd.5 (osd.5) 147 : cluster [DBG] 2.12 scrub starts 2024-02-19T21:40:27.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:25.759691+0000 osd.5 (osd.5) 148 : cluster [DBG] 2.12 scrub ok 2024-02-19T21:40:27.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:24.965422+0000 mgr.y (mgr.14514) 304 : cluster [DBG] pgmap v337: 148 pgs: 148 active+clean; 3.4 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 1.9 KiB/s rd, 150 MiB/s wr, 2.40k op/s 2024-02-19T21:40:27.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:25.254408+0000 osd.1 (osd.1) 135 : cluster [DBG] 5.19 deep-scrub starts 2024-02-19T21:40:27.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:25.265473+0000 osd.1 (osd.1) 136 : cluster [DBG] 5.19 deep-scrub ok 2024-02-19T21:40:27.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:25.358991+0000 osd.0 (osd.0) 147 : cluster [DBG] 5.3 scrub starts 2024-02-19T21:40:27.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:25.363228+0000 osd.0 (osd.0) 148 : cluster [DBG] 5.3 scrub ok 2024-02-19T21:40:27.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:25.756539+0000 osd.5 (osd.5) 147 : cluster [DBG] 2.12 scrub starts 2024-02-19T21:40:27.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:25.759691+0000 osd.5 (osd.5) 148 : cluster [DBG] 2.12 scrub ok 2024-02-19T21:40:27.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:24.965422+0000 mgr.y (mgr.14514) 304 : cluster [DBG] pgmap v337: 148 pgs: 148 active+clean; 3.4 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 1.9 KiB/s rd, 150 MiB/s wr, 2.40k op/s 2024-02-19T21:40:27.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:25.254408+0000 osd.1 (osd.1) 135 : cluster [DBG] 5.19 deep-scrub starts 2024-02-19T21:40:27.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:25.265473+0000 osd.1 (osd.1) 136 : cluster [DBG] 5.19 deep-scrub ok 2024-02-19T21:40:27.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:25.358991+0000 osd.0 (osd.0) 147 : cluster [DBG] 5.3 scrub starts 2024-02-19T21:40:27.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:25.363228+0000 osd.0 (osd.0) 148 : cluster [DBG] 5.3 scrub ok 2024-02-19T21:40:27.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:25.756539+0000 osd.5 (osd.5) 147 : cluster [DBG] 2.12 scrub starts 2024-02-19T21:40:27.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:25.759691+0000 osd.5 (osd.5) 148 : cluster [DBG] 2.12 scrub ok 2024-02-19T21:40:27.955 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 31 16 61756 61740 124.457 86.875 0.0103895 0.00802984 2024-02-19T21:40:27.981 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:40:28.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:26.268493+0000 osd.1 (osd.1) 137 : cluster [DBG] 5.12 scrub starts 2024-02-19T21:40:28.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:26.272649+0000 osd.1 (osd.1) 138 : cluster [DBG] 5.12 scrub ok 2024-02-19T21:40:28.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:26.382457+0000 osd.6 (osd.6) 126 : cluster [DBG] 4.e scrub starts 2024-02-19T21:40:28.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:26.390164+0000 osd.6 (osd.6) 127 : cluster [DBG] 4.e scrub ok 2024-02-19T21:40:28.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:26.401954+0000 osd.0 (osd.0) 149 : cluster [DBG] 4.3 scrub starts 2024-02-19T21:40:28.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:26.405447+0000 osd.0 (osd.0) 150 : cluster [DBG] 4.3 scrub ok 2024-02-19T21:40:28.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:26.268493+0000 osd.1 (osd.1) 137 : cluster [DBG] 5.12 scrub starts 2024-02-19T21:40:28.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:26.272649+0000 osd.1 (osd.1) 138 : cluster [DBG] 5.12 scrub ok 2024-02-19T21:40:28.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:26.382457+0000 osd.6 (osd.6) 126 : cluster [DBG] 4.e scrub starts 2024-02-19T21:40:28.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:26.390164+0000 osd.6 (osd.6) 127 : cluster [DBG] 4.e scrub ok 2024-02-19T21:40:28.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:26.401954+0000 osd.0 (osd.0) 149 : cluster [DBG] 4.3 scrub starts 2024-02-19T21:40:28.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:26.405447+0000 osd.0 (osd.0) 150 : cluster [DBG] 4.3 scrub ok 2024-02-19T21:40:28.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:26.268493+0000 osd.1 (osd.1) 137 : cluster [DBG] 5.12 scrub starts 2024-02-19T21:40:28.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:26.272649+0000 osd.1 (osd.1) 138 : cluster [DBG] 5.12 scrub ok 2024-02-19T21:40:28.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:26.382457+0000 osd.6 (osd.6) 126 : cluster [DBG] 4.e scrub starts 2024-02-19T21:40:28.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:26.390164+0000 osd.6 (osd.6) 127 : cluster [DBG] 4.e scrub ok 2024-02-19T21:40:28.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:26.401954+0000 osd.0 (osd.0) 149 : cluster [DBG] 4.3 scrub starts 2024-02-19T21:40:28.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:26.405447+0000 osd.0 (osd.0) 150 : cluster [DBG] 4.3 scrub ok 2024-02-19T21:40:28.659 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:40:28.665 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:28.666 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:40:28.766 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:40:28.802 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:28.880 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:40:28.890 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:28.891 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:40:28.891 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:26.965842+0000 mgr.y (mgr.14514) 305 : cluster [DBG] pgmap v339: 148 pgs: 148 active+clean; 3.5 GiB data, 12 GiB used, 613 GiB / 626 GiB avail; 1.2 KiB/s rd, 105 MiB/s wr, 1.68k op/s 2024-02-19T21:40:28.891 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:27.751955+0000 osd.4 (osd.4) 115 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:40:28.891 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:27.767435+0000 osd.4 (osd.4) 116 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:40:28.891 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:26.965842+0000 mgr.y (mgr.14514) 305 : cluster [DBG] pgmap v339: 148 pgs: 148 active+clean; 3.5 GiB data, 12 GiB used, 613 GiB / 626 GiB avail; 1.2 KiB/s rd, 105 MiB/s wr, 1.68k op/s 2024-02-19T21:40:28.892 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:27.751955+0000 osd.4 (osd.4) 115 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:40:28.892 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:27.767435+0000 osd.4 (osd.4) 116 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:40:28.955 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 32 16 63084 63068 123.161 83 0.0104384 0.00811484 2024-02-19T21:40:28.992 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:40:29.057 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:29.088 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:40:29.094 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:29.094 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:26.965842+0000 mgr.y (mgr.14514) 305 : cluster [DBG] pgmap v339: 148 pgs: 148 active+clean; 3.5 GiB data, 12 GiB used, 613 GiB / 626 GiB avail; 1.2 KiB/s rd, 105 MiB/s wr, 1.68k op/s 2024-02-19T21:40:29.094 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:27.751955+0000 osd.4 (osd.4) 115 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:40:29.094 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:27.767435+0000 osd.4 (osd.4) 116 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:40:29.095 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:40:29.195 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:40:29.253 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:29.287 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:40:29.290 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:29.291 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:40:29.392 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:40:29.430 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:29.674 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set noscrub 2024-02-19T21:40:29.955 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 33 15 64382 64367 121.889 81.1875 0.0134433 0.00819908 2024-02-19T21:40:30.092 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:40:30.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:28.471940+0000 osd.0 (osd.0) 151 : cluster [DBG] 2.1f scrub starts 2024-02-19T21:40:30.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:28.473773+0000 osd.0 (osd.0) 152 : cluster [DBG] 2.1f scrub ok 2024-02-19T21:40:30.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:28.691284+0000 osd.5 (osd.5) 149 : cluster [DBG] 2.c deep-scrub starts 2024-02-19T21:40:30.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:28.696775+0000 osd.5 (osd.5) 150 : cluster [DBG] 2.c deep-scrub ok 2024-02-19T21:40:30.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:28.852284+0000 osd.7 (osd.7) 139 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:40:30.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:28.874755+0000 osd.7 (osd.7) 140 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:40:30.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:28.471940+0000 osd.0 (osd.0) 151 : cluster [DBG] 2.1f scrub starts 2024-02-19T21:40:30.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:28.473773+0000 osd.0 (osd.0) 152 : cluster [DBG] 2.1f scrub ok 2024-02-19T21:40:30.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:28.691284+0000 osd.5 (osd.5) 149 : cluster [DBG] 2.c deep-scrub starts 2024-02-19T21:40:30.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:28.696775+0000 osd.5 (osd.5) 150 : cluster [DBG] 2.c deep-scrub ok 2024-02-19T21:40:30.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:28.852284+0000 osd.7 (osd.7) 139 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:40:30.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:28.874755+0000 osd.7 (osd.7) 140 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:40:30.098 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:30.099 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:40:30.199 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:40:30.226 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:28.471940+0000 osd.0 (osd.0) 151 : cluster [DBG] 2.1f scrub starts 2024-02-19T21:40:30.226 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:28.473773+0000 osd.0 (osd.0) 152 : cluster [DBG] 2.1f scrub ok 2024-02-19T21:40:30.226 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:28.691284+0000 osd.5 (osd.5) 149 : cluster [DBG] 2.c deep-scrub starts 2024-02-19T21:40:30.226 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:28.696775+0000 osd.5 (osd.5) 150 : cluster [DBG] 2.c deep-scrub ok 2024-02-19T21:40:30.226 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:28.852284+0000 osd.7 (osd.7) 139 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:40:30.226 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:28.874755+0000 osd.7 (osd.7) 140 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:40:30.228 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:40:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:40:30.247 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:30.386 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:40:30.389 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:40:30.955 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 34 16 65609 65593 120.558 76.625 0.00913544 0.00828988 2024-02-19T21:40:31.008 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:40:31.011 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:31.012 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:40:31.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:28.966228+0000 mgr.y (mgr.14514) 306 : cluster [DBG] pgmap v340: 148 pgs: 148 active+clean; 3.5 GiB data, 12 GiB used, 613 GiB / 626 GiB avail; 853 B/s rd, 74 MiB/s wr, 1.18k op/s 2024-02-19T21:40:31.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:29.230696+0000 osd.1 (osd.1) 139 : cluster [DBG] 6.4 deep-scrub starts 2024-02-19T21:40:31.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:29.250595+0000 osd.1 (osd.1) 140 : cluster [DBG] 6.4 deep-scrub ok 2024-02-19T21:40:31.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:29.414384+0000 osd.6 (osd.6) 128 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:40:31.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:29.421784+0000 osd.6 (osd.6) 129 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:40:31.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:29.497834+0000 osd.0 (osd.0) 153 : cluster [DBG] 6.16 scrub starts 2024-02-19T21:40:31.013 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:29.506778+0000 osd.0 (osd.0) 154 : cluster [DBG] 6.16 scrub ok 2024-02-19T21:40:31.013 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:29.854594+0000 osd.7 (osd.7) 141 : cluster [DBG] 2.e deep-scrub starts 2024-02-19T21:40:31.013 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:29.858798+0000 osd.7 (osd.7) 142 : cluster [DBG] 2.e deep-scrub ok 2024-02-19T21:40:31.013 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:30.001150+0000 osd.2 (osd.2) 115 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:40:31.013 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:30.001204+0000 osd.2 (osd.2) 116 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:40:31.013 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:30.012824+0000 mon.a (mon.0) 1023 : cluster [DBG] osdmap e180: 8 total, 8 up, 7 in 2024-02-19T21:40:31.013 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:30.224587+0000 mgr.y (mgr.14514) 307 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:40:31.013 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:30.361307+0000 mgr.y (mgr.14514) 308 : audit [DBG] from='client.15039 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:40:31.013 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:30.593185+0000 osd.4 (osd.4) 117 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:40:31.013 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:30.593242+0000 osd.4 (osd.4) 118 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:40:31.013 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:40:30] "GET /metrics HTTP/1.1" 200 175790 "" "Prometheus/2.33.4" 2024-02-19T21:40:31.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:28.966228+0000 mgr.y (mgr.14514) 306 : cluster [DBG] pgmap v340: 148 pgs: 148 active+clean; 3.5 GiB data, 12 GiB used, 613 GiB / 626 GiB avail; 853 B/s rd, 74 MiB/s wr, 1.18k op/s 2024-02-19T21:40:31.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:29.230696+0000 osd.1 (osd.1) 139 : cluster [DBG] 6.4 deep-scrub starts 2024-02-19T21:40:31.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:29.250595+0000 osd.1 (osd.1) 140 : cluster [DBG] 6.4 deep-scrub ok 2024-02-19T21:40:31.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:29.414384+0000 osd.6 (osd.6) 128 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:40:31.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:29.421784+0000 osd.6 (osd.6) 129 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:40:31.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:29.497834+0000 osd.0 (osd.0) 153 : cluster [DBG] 6.16 scrub starts 2024-02-19T21:40:31.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:29.506778+0000 osd.0 (osd.0) 154 : cluster [DBG] 6.16 scrub ok 2024-02-19T21:40:31.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:29.854594+0000 osd.7 (osd.7) 141 : cluster [DBG] 2.e deep-scrub starts 2024-02-19T21:40:31.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:29.858798+0000 osd.7 (osd.7) 142 : cluster [DBG] 2.e deep-scrub ok 2024-02-19T21:40:31.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:30.001150+0000 osd.2 (osd.2) 115 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:40:31.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:30.001204+0000 osd.2 (osd.2) 116 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:40:31.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:30.012824+0000 mon.a (mon.0) 1023 : cluster [DBG] osdmap e180: 8 total, 8 up, 7 in 2024-02-19T21:40:31.015 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:30.224587+0000 mgr.y (mgr.14514) 307 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:40:31.015 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:30.361307+0000 mgr.y (mgr.14514) 308 : audit [DBG] from='client.15039 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:40:31.015 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:30.593185+0000 osd.4 (osd.4) 117 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:40:31.015 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:30.593242+0000 osd.4 (osd.4) 118 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:40:31.020 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:40:31.113 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:40:31.150 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:31.307 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:40:31.310 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:31.310 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:40:31.313 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:28.966228+0000 mgr.y (mgr.14514) 306 : cluster [DBG] pgmap v340: 148 pgs: 148 active+clean; 3.5 GiB data, 12 GiB used, 613 GiB / 626 GiB avail; 853 B/s rd, 74 MiB/s wr, 1.18k op/s 2024-02-19T21:40:31.314 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:29.230696+0000 osd.1 (osd.1) 139 : cluster [DBG] 6.4 deep-scrub starts 2024-02-19T21:40:31.314 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:29.250595+0000 osd.1 (osd.1) 140 : cluster [DBG] 6.4 deep-scrub ok 2024-02-19T21:40:31.314 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:29.414384+0000 osd.6 (osd.6) 128 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:40:31.314 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:29.421784+0000 osd.6 (osd.6) 129 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:40:31.314 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:29.497834+0000 osd.0 (osd.0) 153 : cluster [DBG] 6.16 scrub starts 2024-02-19T21:40:31.314 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:29.506778+0000 osd.0 (osd.0) 154 : cluster [DBG] 6.16 scrub ok 2024-02-19T21:40:31.314 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:29.854594+0000 osd.7 (osd.7) 141 : cluster [DBG] 2.e deep-scrub starts 2024-02-19T21:40:31.314 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:29.858798+0000 osd.7 (osd.7) 142 : cluster [DBG] 2.e deep-scrub ok 2024-02-19T21:40:31.314 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:30.001150+0000 osd.2 (osd.2) 115 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:40:31.314 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:30.001204+0000 osd.2 (osd.2) 116 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:40:31.314 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:30.012824+0000 mon.a (mon.0) 1023 : cluster [DBG] osdmap e180: 8 total, 8 up, 7 in 2024-02-19T21:40:31.315 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:30.224587+0000 mgr.y (mgr.14514) 307 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:40:31.315 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:30.361307+0000 mgr.y (mgr.14514) 308 : audit [DBG] from='client.15039 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:40:31.315 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:30.593185+0000 osd.4 (osd.4) 117 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:40:31.315 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:30.593242+0000 osd.4 (osd.4) 118 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:40:31.411 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:40:31.452 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:31.535 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:40:31.546 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:31.547 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:40:31.647 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:40:31.687 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:31.955 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 35 16 66854 66838 119.336 77.8125 0.00910052 0.00837525 2024-02-19T21:40:32.084 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:30.690711+0000 osd.5 (osd.5) 151 : cluster [DBG] 3.2 scrub starts 2024-02-19T21:40:32.084 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:30.692376+0000 osd.5 (osd.5) 152 : cluster [DBG] 3.2 scrub ok 2024-02-19T21:40:32.084 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:30.966699+0000 mgr.y (mgr.14514) 309 : cluster [DBG] pgmap v342: 148 pgs: 1 active+clean+scrubbing+deep, 147 active+clean; 3.9 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 1.6 KiB/s rd, 140 MiB/s wr, 2.25k op/s 2024-02-19T21:40:32.084 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:31.033802+0000 mon.a (mon.0) 1024 : cluster [DBG] osdmap e181: 8 total, 8 up, 7 in 2024-02-19T21:40:32.084 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:30.690711+0000 osd.5 (osd.5) 151 : cluster [DBG] 3.2 scrub starts 2024-02-19T21:40:32.084 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:30.692376+0000 osd.5 (osd.5) 152 : cluster [DBG] 3.2 scrub ok 2024-02-19T21:40:32.084 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:30.966699+0000 mgr.y (mgr.14514) 309 : cluster [DBG] pgmap v342: 148 pgs: 1 active+clean+scrubbing+deep, 147 active+clean; 3.9 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 1.6 KiB/s rd, 140 MiB/s wr, 2.25k op/s 2024-02-19T21:40:32.085 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:31.033802+0000 mon.a (mon.0) 1024 : cluster [DBG] osdmap e181: 8 total, 8 up, 7 in 2024-02-19T21:40:32.109 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":341,"stamp":"2024-02-19T21:40:30.010286+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4135130788,"num_objects":63289,"num_object_clones":0,"num_object_copies":189867,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63289,"num_whiteouts":0,"num_read":1178,"num_read_kb":930,"num_write":63525,"num_write_kb":4038249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":3702,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":63631,"ondisk_log_size":63631,"up":444,"acting":444,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":444,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":656216064,"kb_used":14188228,"kb_used_data":12066636,"kb_used_omap":0,"kb_used_meta":2121472,"kb_avail":642027836,"statfs":{"total":671965249536,"available":657436504064,"internally_reserved":0,"allocated":12356235264,"data_stored":12353667981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2172387328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,1,7,5,6],"upper_bound":32},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":829227008,"num_objects":12653,"num_object_clones":0,"num_object_copies":37959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12653,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":12653,"num_write_kb":809792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.249949"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":51,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.793355+0000","last_change":"2024-02-19T21:40:12.925489+0000","last_active":"2024-02-19T21:40:24.793355+0000","last_peered":"2024-02-19T21:40:24.793355+0000","last_clean":"2024-02-19T21:40:24.793355+0000","last_became_active":"2024-02-19T21:38:31.247054+0000","last_became_peered":"2024-02-19T21:38:31.247054+0000","last_unstale":"2024-02-19T21:40:24.793355+0000","last_undegraded":"2024-02-19T21:40:24.793355+0000","last_fullsized":"2024-02-19T21:40:24.793355+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:12.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:12.925421+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":105,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.787037+0000","last_change":"2024-02-19T21:40:23.364671+0000","last_active":"2024-02-19T21:40:24.787037+0000","last_peered":"2024-02-19T21:40:24.787037+0000","last_clean":"2024-02-19T21:40:24.787037+0000","last_became_active":"2024-02-19T21:35:14.511920+0000","last_became_peered":"2024-02-19T21:35:14.511920+0000","last_unstale":"2024-02-19T21:40:24.787037+0000","last_undegraded":"2024-02-19T21:40:24.787037+0000","last_fullsized":"2024-02-19T21:40:24.787037+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:23.364579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:23.364579+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":144,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.794662+0000","last_change":"2024-02-19T21:37:26.834440+0000","last_active":"2024-02-19T21:40:24.794662+0000","last_peered":"2024-02-19T21:40:24.794662+0000","last_clean":"2024-02-19T21:40:24.794662+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:40:24.794662+0000","last_undegraded":"2024-02-19T21:40:24.794662+0000","last_fullsized":"2024-02-19T21:40:24.794662+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:26.834173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:37:26.834173+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"66'15","reported_seq":103,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.796721+0000","last_change":"2024-02-19T21:39:51.546188+0000","last_active":"2024-02-19T21:40:24.796721+0000","last_peered":"2024-02-19T21:40:24.796721+0000","last_clean":"2024-02-19T21:40:24.796721+0000","last_became_active":"2024-02-19T21:39:51.536424+0000","last_became_peered":"2024-02-19T21:39:51.536424+0000","last_unstale":"2024-02-19T21:40:24.796721+0000","last_undegraded":"2024-02-19T21:40:24.796721+0000","last_fullsized":"2024-02-19T21:40:24.796721+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:39:29.269819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:29.269819+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":103,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.789525+0000","last_change":"2024-02-19T21:39:29.064310+0000","last_active":"2024-02-19T21:40:24.789525+0000","last_peered":"2024-02-19T21:40:24.789525+0000","last_clean":"2024-02-19T21:40:24.789525+0000","last_became_active":"2024-02-19T21:35:14.517794+0000","last_became_peered":"2024-02-19T21:35:14.517794+0000","last_unstale":"2024-02-19T21:40:24.789525+0000","last_undegraded":"2024-02-19T21:40:24.789525+0000","last_fullsized":"2024-02-19T21:40:24.789525+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:29.064185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:29.064185+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":140,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:25.265586+0000","last_change":"2024-02-19T21:40:25.265586+0000","last_active":"2024-02-19T21:40:25.265586+0000","last_peered":"2024-02-19T21:40:25.265586+0000","last_clean":"2024-02-19T21:40:25.265586+0000","last_became_active":"2024-02-19T21:32:27.372466+0000","last_became_peered":"2024-02-19T21:32:27.372466+0000","last_unstale":"2024-02-19T21:40:25.265586+0000","last_undegraded":"2024-02-19T21:40:25.265586+0000","last_fullsized":"2024-02-19T21:40:25.265586+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:25.265482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:25.265482+0000","last_clean_scrub_stamp":"2024-02-19T21:40:25.265482+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":148,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.788898+0000","last_change":"2024-02-19T21:39:45.432311+0000","last_active":"2024-02-19T21:40:24.788898+0000","last_peered":"2024-02-19T21:40:24.788898+0000","last_clean":"2024-02-19T21:40:24.788898+0000","last_became_active":"2024-02-19T21:32:23.356975+0000","last_became_peered":"2024-02-19T21:32:23.356975+0000","last_unstale":"2024-02-19T21:40:24.788898+0000","last_undegraded":"2024-02-19T21:40:24.788898+0000","last_fullsized":"2024-02-19T21:40:24.788898+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:45.432184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:39:45.432184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"92'13","reported_seq":177,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.784369+0000","last_change":"2024-02-19T21:39:38.475516+0000","last_active":"2024-02-19T21:40:24.784369+0000","last_peered":"2024-02-19T21:40:24.784369+0000","last_clean":"2024-02-19T21:40:24.784369+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:40:24.784369+0000","last_undegraded":"2024-02-19T21:40:24.784369+0000","last_fullsized":"2024-02-19T21:40:24.784369+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"92'13","last_scrub_stamp":"2024-02-19T21:39:38.475440+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.475440+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":155,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.787793+0000","last_change":"2024-02-19T21:39:39.467763+0000","last_active":"2024-02-19T21:40:24.787793+0000","last_peered":"2024-02-19T21:40:24.787793+0000","last_clean":"2024-02-19T21:40:24.787793+0000","last_became_active":"2024-02-19T21:39:39.467350+0000","last_became_peered":"2024-02-19T21:39:39.467350+0000","last_unstale":"2024-02-19T21:40:24.787793+0000","last_undegraded":"2024-02-19T21:40:24.787793+0000","last_fullsized":"2024-02-19T21:40:24.787793+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:30.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:30.102789+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":139,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.793876+0000","last_change":"2024-02-19T21:39:32.209318+0000","last_active":"2024-02-19T21:40:24.793876+0000","last_peered":"2024-02-19T21:40:24.793876+0000","last_clean":"2024-02-19T21:40:24.793876+0000","last_became_active":"2024-02-19T21:32:27.370308+0000","last_became_peered":"2024-02-19T21:32:27.370308+0000","last_unstale":"2024-02-19T21:40:24.793876+0000","last_undegraded":"2024-02-19T21:40:24.793876+0000","last_fullsized":"2024-02-19T21:40:24.793876+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:32.209233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:32.209233+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":145,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.793792+0000","last_change":"2024-02-19T21:37:35.972210+0000","last_active":"2024-02-19T21:40:24.793792+0000","last_peered":"2024-02-19T21:40:24.793792+0000","last_clean":"2024-02-19T21:40:24.793792+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:40:24.793792+0000","last_undegraded":"2024-02-19T21:40:24.793792+0000","last_fullsized":"2024-02-19T21:40:24.793792+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:35.972143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:08.490788+0000","last_clean_scrub_stamp":"2024-02-19T21:37:35.972143+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"66'5","reported_seq":140,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.788647+0000","last_change":"2024-02-19T21:39:44.444043+0000","last_active":"2024-02-19T21:40:24.788647+0000","last_peered":"2024-02-19T21:40:24.788647+0000","last_clean":"2024-02-19T21:40:24.788647+0000","last_became_active":"2024-02-19T21:39:39.471143+0000","last_became_peered":"2024-02-19T21:39:39.471143+0000","last_unstale":"2024-02-19T21:40:24.788647+0000","last_undegraded":"2024-02-19T21:40:24.788647+0000","last_fullsized":"2024-02-19T21:40:24.788647+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'5","last_scrub_stamp":"2024-02-19T21:39:44.443963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:44.443963+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":139,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.792197+0000","last_change":"2024-02-19T21:38:17.889547+0000","last_active":"2024-02-19T21:40:24.792197+0000","last_peered":"2024-02-19T21:40:24.792197+0000","last_clean":"2024-02-19T21:40:24.792197+0000","last_became_active":"2024-02-19T21:32:29.373010+0000","last_became_peered":"2024-02-19T21:32:29.373010+0000","last_unstale":"2024-02-19T21:40:24.792197+0000","last_undegraded":"2024-02-19T21:40:24.792197+0000","last_fullsized":"2024-02-19T21:40:24.792197+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:38:17.889452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:38:17.889452+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":144,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.788886+0000","last_change":"2024-02-19T21:39:35.104060+0000","last_active":"2024-02-19T21:40:24.788886+0000","last_peered":"2024-02-19T21:40:24.788886+0000","last_clean":"2024-02-19T21:40:24.788886+0000","last_became_active":"2024-02-19T21:32:27.368241+0000","last_became_peered":"2024-02-19T21:32:27.368241+0000","last_unstale":"2024-02-19T21:40:24.788886+0000","last_undegraded":"2024-02-19T21:40:24.788886+0000","last_fullsized":"2024-02-19T21:40:24.788886+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:35.103945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:46.543259+0000","last_clean_scrub_stamp":"2024-02-19T21:39:35.103945+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":157,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.793346+0000","last_change":"2024-02-19T21:40:16.864005+0000","last_active":"2024-02-19T21:40:24.793346+0000","last_peered":"2024-02-19T21:40:24.793346+0000","last_clean":"2024-02-19T21:40:24.793346+0000","last_became_active":"2024-02-19T21:39:39.473759+0000","last_became_peered":"2024-02-19T21:39:39.473759+0000","last_unstale":"2024-02-19T21:40:24.793346+0000","last_undegraded":"2024-02-19T21:40:24.793346+0000","last_fullsized":"2024-02-19T21:40:24.793346+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:16.863939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:16.863939+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"89'13","reported_seq":162,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.789556+0000","last_change":"2024-02-19T21:39:47.395697+0000","last_active":"2024-02-19T21:40:24.789556+0000","last_peered":"2024-02-19T21:40:24.789556+0000","last_clean":"2024-02-19T21:40:24.789556+0000","last_became_active":"2024-02-19T21:35:14.514971+0000","last_became_peered":"2024-02-19T21:35:14.514971+0000","last_unstale":"2024-02-19T21:40:24.789556+0000","last_undegraded":"2024-02-19T21:40:24.789556+0000","last_fullsized":"2024-02-19T21:40:24.789556+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'13","last_scrub_stamp":"2024-02-19T21:39:47.395572+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:39:47.395572+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":137,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.789199+0000","last_change":"2024-02-19T21:39:38.452607+0000","last_active":"2024-02-19T21:40:24.789199+0000","last_peered":"2024-02-19T21:40:24.789199+0000","last_clean":"2024-02-19T21:40:24.789199+0000","last_became_active":"2024-02-19T21:32:29.597266+0000","last_became_peered":"2024-02-19T21:32:29.597266+0000","last_unstale":"2024-02-19T21:40:24.789199+0000","last_undegraded":"2024-02-19T21:40:24.789199+0000","last_fullsized":"2024-02-19T21:40:24.789199+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.452523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.452523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":112,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.789549+0000","last_change":"2024-02-19T21:39:39.474633+0000","last_active":"2024-02-19T21:40:24.789549+0000","last_peered":"2024-02-19T21:40:24.789549+0000","last_clean":"2024-02-19T21:40:24.789549+0000","last_became_active":"2024-02-19T21:39:39.474044+0000","last_became_peered":"2024-02-19T21:39:39.474044+0000","last_unstale":"2024-02-19T21:40:24.789549+0000","last_undegraded":"2024-02-19T21:40:24.789549+0000","last_fullsized":"2024-02-19T21:40:24.789549+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:34.364412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:34.364412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":28,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.793201+0000","last_change":"2024-02-19T21:40:24.788747+0000","last_active":"2024-02-19T21:40:24.793201+0000","last_peered":"2024-02-19T21:40:24.793201+0000","last_clean":"2024-02-19T21:40:24.793201+0000","last_became_active":"2024-02-19T21:39:39.470743+0000","last_became_peered":"2024-02-19T21:39:39.470743+0000","last_unstale":"2024-02-19T21:40:24.793201+0000","last_undegraded":"2024-02-19T21:40:24.793201+0000","last_fullsized":"2024-02-19T21:40:24.793201+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:24.788644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:24.788644+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1d","version":"66'12","reported_seq":98,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.782193+0000","last_change":"2024-02-19T21:39:21.126642+0000","last_active":"2024-02-19T21:40:24.782193+0000","last_peered":"2024-02-19T21:40:24.782193+0000","last_clean":"2024-02-19T21:40:24.782193+0000","last_became_active":"2024-02-19T21:38:31.247067+0000","last_became_peered":"2024-02-19T21:38:31.247067+0000","last_unstale":"2024-02-19T21:40:24.782193+0000","last_undegraded":"2024-02-19T21:40:24.782193+0000","last_fullsized":"2024-02-19T21:40:24.782193+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'12","last_scrub_stamp":"2024-02-19T21:39:21.126563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:21.126563+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":24,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":143,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.785863+0000","last_change":"2024-02-19T21:39:23.552366+0000","last_active":"2024-02-19T21:40:24.785863+0000","last_peered":"2024-02-19T21:40:24.785863+0000","last_clean":"2024-02-19T21:40:24.785863+0000","last_became_active":"2024-02-19T21:32:29.597365+0000","last_became_peered":"2024-02-19T21:32:29.597365+0000","last_unstale":"2024-02-19T21:40:24.785863+0000","last_undegraded":"2024-02-19T21:40:24.785863+0000","last_fullsized":"2024-02-19T21:40:24.785863+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:23.552253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:23.552253+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":140,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.782227+0000","last_change":"2024-02-19T21:40:15.269827+0000","last_active":"2024-02-19T21:40:24.782227+0000","last_peered":"2024-02-19T21:40:24.782227+0000","last_clean":"2024-02-19T21:40:24.782227+0000","last_became_active":"2024-02-19T21:32:27.369757+0000","last_became_peered":"2024-02-19T21:32:27.369757+0000","last_unstale":"2024-02-19T21:40:24.782227+0000","last_undegraded":"2024-02-19T21:40:24.782227+0000","last_fullsized":"2024-02-19T21:40:24.782227+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:15.269720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:15.269720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":148,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.787672+0000","last_change":"2024-02-19T21:39:32.264501+0000","last_active":"2024-02-19T21:40:24.787672+0000","last_peered":"2024-02-19T21:40:24.787672+0000","last_clean":"2024-02-19T21:40:24.787672+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:40:24.787672+0000","last_undegraded":"2024-02-19T21:40:24.787672+0000","last_fullsized":"2024-02-19T21:40:24.787672+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:32.264424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:39:32.264424+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"93'22","reported_seq":112,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.781926+0000","last_change":"2024-02-19T21:39:39.518947+0000","last_active":"2024-02-19T21:40:24.781926+0000","last_peered":"2024-02-19T21:40:24.781926+0000","last_clean":"2024-02-19T21:40:24.781926+0000","last_became_active":"2024-02-19T21:39:39.477429+0000","last_became_peered":"2024-02-19T21:39:39.477429+0000","last_unstale":"2024-02-19T21:40:24.781926+0000","last_undegraded":"2024-02-19T21:40:24.781926+0000","last_fullsized":"2024-02-19T21:40:24.781926+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'22","last_scrub_stamp":"2024-02-19T21:36:55.991770+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:35:02.204553+0000","last_clean_scrub_stamp":"2024-02-19T21:36:55.991770+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":133,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.781766+0000","last_change":"2024-02-19T21:36:12.945673+0000","last_active":"2024-02-19T21:40:24.781766+0000","last_peered":"2024-02-19T21:40:24.781766+0000","last_clean":"2024-02-19T21:40:24.781766+0000","last_became_active":"2024-02-19T21:32:29.373361+0000","last_became_peered":"2024-02-19T21:32:29.373361+0000","last_unstale":"2024-02-19T21:40:24.781766+0000","last_undegraded":"2024-02-19T21:40:24.781766+0000","last_fullsized":"2024-02-19T21:40:24.781766+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:12.945581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:12.945581+0000","last_clean_scrub_stamp":"2024-02-19T21:36:12.945581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":154,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.793776+0000","last_change":"2024-02-19T21:39:39.471709+0000","last_active":"2024-02-19T21:40:24.793776+0000","last_peered":"2024-02-19T21:40:24.793776+0000","last_clean":"2024-02-19T21:40:24.793776+0000","last_became_active":"2024-02-19T21:39:39.471214+0000","last_became_peered":"2024-02-19T21:39:39.471214+0000","last_unstale":"2024-02-19T21:40:24.793776+0000","last_undegraded":"2024-02-19T21:40:24.793776+0000","last_fullsized":"2024-02-19T21:40:24.793776+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:37.169503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:37.169503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":60,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.788575+0000","last_change":"2024-02-19T21:39:39.472557+0000","last_active":"2024-02-19T21:40:24.788575+0000","last_peered":"2024-02-19T21:40:24.788575+0000","last_clean":"2024-02-19T21:40:24.788575+0000","last_became_active":"2024-02-19T21:39:39.470895+0000","last_became_peered":"2024-02-19T21:39:39.470895+0000","last_unstale":"2024-02-19T21:40:24.788575+0000","last_undegraded":"2024-02-19T21:40:24.788575+0000","last_fullsized":"2024-02-19T21:40:24.788575+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:31.248207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:39:31.248207+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"66'11","reported_seq":36,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.794477+0000","last_change":"2024-02-19T21:39:51.559559+0000","last_active":"2024-02-19T21:40:24.794477+0000","last_peered":"2024-02-19T21:40:24.794477+0000","last_clean":"2024-02-19T21:40:24.794477+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:40:24.794477+0000","last_undegraded":"2024-02-19T21:40:24.794477+0000","last_fullsized":"2024-02-19T21:40:24.794477+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:39:43.209803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:43.209803+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":151,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.793905+0000","last_change":"2024-02-19T21:39:39.568862+0000","last_active":"2024-02-19T21:40:24.793905+0000","last_peered":"2024-02-19T21:40:24.793905+0000","last_clean":"2024-02-19T21:40:24.793905+0000","last_became_active":"2024-02-19T21:39:39.473146+0000","last_became_peered":"2024-02-19T21:39:39.473146+0000","last_unstale":"2024-02-19T21:40:24.793905+0000","last_undegraded":"2024-02-19T21:40:24.793905+0000","last_fullsized":"2024-02-19T21:40:24.793905+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:38:25.883927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:38:25.883927+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"66'8","reported_seq":254,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:25.022411+0000","last_change":"2024-02-19T21:40:19.276823+0000","last_active":"2024-02-19T21:40:25.022411+0000","last_peered":"2024-02-19T21:40:25.022411+0000","last_clean":"2024-02-19T21:40:25.022411+0000","last_became_active":"2024-02-19T21:32:27.366465+0000","last_became_peered":"2024-02-19T21:32:27.366465+0000","last_unstale":"2024-02-19T21:40:25.022411+0000","last_undegraded":"2024-02-19T21:40:25.022411+0000","last_fullsized":"2024-02-19T21:40:25.022411+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:40:19.276740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:19.276740+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":148,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.787644+0000","last_change":"2024-02-19T21:39:38.080684+0000","last_active":"2024-02-19T21:40:24.787644+0000","last_peered":"2024-02-19T21:40:24.787644+0000","last_clean":"2024-02-19T21:40:24.787644+0000","last_became_active":"2024-02-19T21:32:23.356323+0000","last_became_peered":"2024-02-19T21:32:23.356323+0000","last_unstale":"2024-02-19T21:40:24.787644+0000","last_undegraded":"2024-02-19T21:40:24.787644+0000","last_fullsized":"2024-02-19T21:40:24.787644+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.080601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.080601+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"66'10","reported_seq":204,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.793708+0000","last_change":"2024-02-19T21:39:51.544334+0000","last_active":"2024-02-19T21:40:24.793708+0000","last_peered":"2024-02-19T21:40:24.793708+0000","last_clean":"2024-02-19T21:40:24.793708+0000","last_became_active":"2024-02-19T21:39:51.536426+0000","last_became_peered":"2024-02-19T21:39:51.536426+0000","last_unstale":"2024-02-19T21:40:24.793708+0000","last_undegraded":"2024-02-19T21:40:24.793708+0000","last_fullsized":"2024-02-19T21:40:24.793708+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:39:33.125904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:33.125904+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":60,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.792330+0000","last_change":"2024-02-19T21:39:39.471651+0000","last_active":"2024-02-19T21:40:24.792330+0000","last_peered":"2024-02-19T21:40:24.792330+0000","last_clean":"2024-02-19T21:40:24.792330+0000","last_became_active":"2024-02-19T21:39:39.471332+0000","last_became_peered":"2024-02-19T21:39:39.471332+0000","last_unstale":"2024-02-19T21:40:24.792330+0000","last_undegraded":"2024-02-19T21:40:24.792330+0000","last_fullsized":"2024-02-19T21:40:24.792330+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:23.270251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:39:23.270251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":139,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.793924+0000","last_change":"2024-02-19T21:38:26.854195+0000","last_active":"2024-02-19T21:40:24.793924+0000","last_peered":"2024-02-19T21:40:24.793924+0000","last_clean":"2024-02-19T21:40:24.793924+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:40:24.793924+0000","last_undegraded":"2024-02-19T21:40:24.793924+0000","last_fullsized":"2024-02-19T21:40:24.793924+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:26.854133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:38:26.854133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":157,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.788464+0000","last_change":"2024-02-19T21:39:45.211467+0000","last_active":"2024-02-19T21:40:24.788464+0000","last_peered":"2024-02-19T21:40:24.788464+0000","last_clean":"2024-02-19T21:40:24.788464+0000","last_became_active":"2024-02-19T21:39:39.478633+0000","last_became_peered":"2024-02-19T21:39:39.478633+0000","last_unstale":"2024-02-19T21:40:24.788464+0000","last_undegraded":"2024-02-19T21:40:24.788464+0000","last_fullsized":"2024-02-19T21:40:24.788464+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:45.211388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:39:45.211388+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"66'11","reported_seq":165,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.788647+0000","last_change":"2024-02-19T21:39:46.421215+0000","last_active":"2024-02-19T21:40:24.788647+0000","last_peered":"2024-02-19T21:40:24.788647+0000","last_clean":"2024-02-19T21:40:24.788647+0000","last_became_active":"2024-02-19T21:32:25.372039+0000","last_became_peered":"2024-02-19T21:32:25.372039+0000","last_unstale":"2024-02-19T21:40:24.788647+0000","last_undegraded":"2024-02-19T21:40:24.788647+0000","last_fullsized":"2024-02-19T21:40:24.788647+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:39:46.421117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:46.421117+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":146,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.794026+0000","last_change":"2024-02-19T21:39:39.471671+0000","last_active":"2024-02-19T21:40:24.794026+0000","last_peered":"2024-02-19T21:40:24.794026+0000","last_clean":"2024-02-19T21:40:24.794026+0000","last_became_active":"2024-02-19T21:39:39.471306+0000","last_became_peered":"2024-02-19T21:39:39.471306+0000","last_unstale":"2024-02-19T21:40:24.794026+0000","last_undegraded":"2024-02-19T21:40:24.794026+0000","last_fullsized":"2024-02-19T21:40:24.794026+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:37.104831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:39:37.104831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":144,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.788695+0000","last_change":"2024-02-19T21:39:41.234334+0000","last_active":"2024-02-19T21:40:24.788695+0000","last_peered":"2024-02-19T21:40:24.788695+0000","last_clean":"2024-02-19T21:40:24.788695+0000","last_became_active":"2024-02-19T21:32:27.366281+0000","last_became_peered":"2024-02-19T21:32:27.366281+0000","last_unstale":"2024-02-19T21:40:24.788695+0000","last_undegraded":"2024-02-19T21:40:24.788695+0000","last_fullsized":"2024-02-19T21:40:24.788695+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:41.234250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:41.234250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":152,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.788101+0000","last_change":"2024-02-19T21:39:39.480521+0000","last_active":"2024-02-19T21:40:24.788101+0000","last_peered":"2024-02-19T21:40:24.788101+0000","last_clean":"2024-02-19T21:40:24.788101+0000","last_became_active":"2024-02-19T21:39:39.479927+0000","last_became_peered":"2024-02-19T21:39:39.479927+0000","last_unstale":"2024-02-19T21:40:24.788101+0000","last_undegraded":"2024-02-19T21:40:24.788101+0000","last_fullsized":"2024-02-19T21:40:24.788101+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:39:37.085374+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"66'4","reported_seq":75,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.782968+0000","last_change":"2024-02-19T21:40:18.214945+0000","last_active":"2024-02-19T21:40:24.782968+0000","last_peered":"2024-02-19T21:40:24.782968+0000","last_clean":"2024-02-19T21:40:24.782968+0000","last_became_active":"2024-02-19T21:38:31.248249+0000","last_became_peered":"2024-02-19T21:38:31.248249+0000","last_unstale":"2024-02-19T21:40:24.782968+0000","last_undegraded":"2024-02-19T21:40:24.782968+0000","last_fullsized":"2024-02-19T21:40:24.782968+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'4","last_scrub_stamp":"2024-02-19T21:40:18.214846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:18.214846+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":60,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.796637+0000","last_change":"2024-02-19T21:39:39.462663+0000","last_active":"2024-02-19T21:40:24.796637+0000","last_peered":"2024-02-19T21:40:24.796637+0000","last_clean":"2024-02-19T21:40:24.796637+0000","last_became_active":"2024-02-19T21:39:39.462363+0000","last_became_peered":"2024-02-19T21:39:39.462363+0000","last_unstale":"2024-02-19T21:40:24.796637+0000","last_undegraded":"2024-02-19T21:40:24.796637+0000","last_fullsized":"2024-02-19T21:40:24.796637+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:26.311526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:39:26.311526+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":149,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:26.272724+0000","last_change":"2024-02-19T21:40:26.272724+0000","last_active":"2024-02-19T21:40:26.272724+0000","last_peered":"2024-02-19T21:40:26.272724+0000","last_clean":"2024-02-19T21:40:26.272724+0000","last_became_active":"2024-02-19T21:38:31.248795+0000","last_became_peered":"2024-02-19T21:38:31.248795+0000","last_unstale":"2024-02-19T21:40:26.272724+0000","last_undegraded":"2024-02-19T21:40:26.272724+0000","last_fullsized":"2024-02-19T21:40:26.272724+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:26.272653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:26.272653+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":146,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.781884+0000","last_change":"2024-02-19T21:39:33.957921+0000","last_active":"2024-02-19T21:40:24.781884+0000","last_peered":"2024-02-19T21:40:24.781884+0000","last_clean":"2024-02-19T21:40:24.781884+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:40:24.781884+0000","last_undegraded":"2024-02-19T21:40:24.781884+0000","last_fullsized":"2024-02-19T21:40:24.781884+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:33.957814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:39:33.957814+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"66'11","reported_seq":171,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.786729+0000","last_change":"2024-02-19T21:39:25.554998+0000","last_active":"2024-02-19T21:40:24.786729+0000","last_peered":"2024-02-19T21:40:24.786729+0000","last_clean":"2024-02-19T21:40:24.786729+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:40:24.786729+0000","last_undegraded":"2024-02-19T21:40:24.786729+0000","last_fullsized":"2024-02-19T21:40:24.786729+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:39:25.554888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:25.554888+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":145,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.791753+0000","last_change":"2024-02-19T21:38:29.972418+0000","last_active":"2024-02-19T21:40:24.791753+0000","last_peered":"2024-02-19T21:40:24.791753+0000","last_clean":"2024-02-19T21:40:24.791753+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:40:24.791753+0000","last_undegraded":"2024-02-19T21:40:24.791753+0000","last_fullsized":"2024-02-19T21:40:24.791753+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:29.972337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:42.527849+0000","last_clean_scrub_stamp":"2024-02-19T21:38:29.972337+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":148,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.788725+0000","last_change":"2024-02-19T21:39:51.535010+0000","last_active":"2024-02-19T21:40:24.788725+0000","last_peered":"2024-02-19T21:40:24.788725+0000","last_clean":"2024-02-19T21:40:24.788725+0000","last_became_active":"2024-02-19T21:39:51.534750+0000","last_became_peered":"2024-02-19T21:39:51.534750+0000","last_unstale":"2024-02-19T21:40:24.788725+0000","last_undegraded":"2024-02-19T21:40:24.788725+0000","last_fullsized":"2024-02-19T21:40:24.788725+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:33.360066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:33.360066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":148,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.787978+0000","last_change":"2024-02-19T21:39:33.273446+0000","last_active":"2024-02-19T21:40:24.787978+0000","last_peered":"2024-02-19T21:40:24.787978+0000","last_clean":"2024-02-19T21:40:24.787978+0000","last_became_active":"2024-02-19T21:32:23.357338+0000","last_became_peered":"2024-02-19T21:32:23.357338+0000","last_unstale":"2024-02-19T21:40:24.787978+0000","last_undegraded":"2024-02-19T21:40:24.787978+0000","last_fullsized":"2024-02-19T21:40:24.787978+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:33.273364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:39:33.273364+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"66'9","reported_seq":177,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.783110+0000","last_change":"2024-02-19T21:39:45.026756+0000","last_active":"2024-02-19T21:40:24.783110+0000","last_peered":"2024-02-19T21:40:24.783110+0000","last_clean":"2024-02-19T21:40:24.783110+0000","last_became_active":"2024-02-19T21:39:39.466843+0000","last_became_peered":"2024-02-19T21:39:39.466843+0000","last_unstale":"2024-02-19T21:40:24.783110+0000","last_undegraded":"2024-02-19T21:40:24.783110+0000","last_fullsized":"2024-02-19T21:40:24.783110+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:39:45.026689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:45.026689+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":33,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.788468+0000","last_change":"2024-02-19T21:39:41.032181+0000","last_active":"2024-02-19T21:40:24.788468+0000","last_peered":"2024-02-19T21:40:24.788468+0000","last_clean":"2024-02-19T21:40:24.788468+0000","last_became_active":"2024-02-19T21:39:39.474430+0000","last_became_peered":"2024-02-19T21:39:39.474430+0000","last_unstale":"2024-02-19T21:40:24.788468+0000","last_undegraded":"2024-02-19T21:40:24.788468+0000","last_fullsized":"2024-02-19T21:40:24.788468+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:41.032064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:41.032064+0000","last_clean_scrub_stamp":"2024-02-19T21:39:41.032064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"170'12","reported_seq":31,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:25.022039+0000","last_change":"2024-02-19T21:39:51.710164+0000","last_active":"2024-02-19T21:40:25.022039+0000","last_peered":"2024-02-19T21:40:25.022039+0000","last_clean":"2024-02-19T21:40:25.022039+0000","last_became_active":"2024-02-19T21:39:51.534932+0000","last_became_peered":"2024-02-19T21:39:51.534932+0000","last_unstale":"2024-02-19T21:40:25.022039+0000","last_undegraded":"2024-02-19T21:40:25.022039+0000","last_fullsized":"2024-02-19T21:40:25.022039+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'11","last_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:39:46.054888+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":153,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.792571+0000","last_change":"2024-02-19T21:38:14.002797+0000","last_active":"2024-02-19T21:40:24.792571+0000","last_peered":"2024-02-19T21:40:24.792571+0000","last_clean":"2024-02-19T21:40:24.792571+0000","last_became_active":"2024-02-19T21:32:23.361680+0000","last_became_peered":"2024-02-19T21:32:23.361680+0000","last_unstale":"2024-02-19T21:40:24.792571+0000","last_undegraded":"2024-02-19T21:40:24.792571+0000","last_fullsized":"2024-02-19T21:40:24.792571+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:14.002713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:33.550655+0000","last_clean_scrub_stamp":"2024-02-19T21:38:14.002713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"133'13","reported_seq":161,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.789150+0000","last_change":"2024-02-19T21:37:34.892934+0000","last_active":"2024-02-19T21:40:24.789150+0000","last_peered":"2024-02-19T21:40:24.789150+0000","last_clean":"2024-02-19T21:40:24.789150+0000","last_became_active":"2024-02-19T21:32:25.372206+0000","last_became_peered":"2024-02-19T21:32:25.372206+0000","last_unstale":"2024-02-19T21:40:24.789150+0000","last_undegraded":"2024-02-19T21:40:24.789150+0000","last_fullsized":"2024-02-19T21:40:24.789150+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'13","last_scrub_stamp":"2024-02-19T21:37:34.892825+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:37:34.892825+0000","last_clean_scrub_stamp":"2024-02-19T21:37:34.892825+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":152,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.793389+0000","last_change":"2024-02-19T21:38:31.248430+0000","last_active":"2024-02-19T21:40:24.793389+0000","last_peered":"2024-02-19T21:40:24.793389+0000","last_clean":"2024-02-19T21:40:24.793389+0000","last_became_active":"2024-02-19T21:38:31.248016+0000","last_became_peered":"2024-02-19T21:38:31.248016+0000","last_unstale":"2024-02-19T21:40:24.793389+0000","last_undegraded":"2024-02-19T21:40:24.793389+0000","last_fullsized":"2024-02-19T21:40:24.793389+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:32.890719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:37:32.890719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"66'8","reported_seq":244,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:25.017967+0000","last_change":"2024-02-19T21:37:35.901012+0000","last_active":"2024-02-19T21:40:25.017967+0000","last_peered":"2024-02-19T21:40:25.017967+0000","last_clean":"2024-02-19T21:40:25.017967+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:40:25.017967+0000","last_undegraded":"2024-02-19T21:40:25.017967+0000","last_fullsized":"2024-02-19T21:40:25.017967+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:37:35.900920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:35.900920+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":150,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:25.759797+0000","last_change":"2024-02-19T21:40:25.759797+0000","last_active":"2024-02-19T21:40:25.759797+0000","last_peered":"2024-02-19T21:40:25.759797+0000","last_clean":"2024-02-19T21:40:25.759797+0000","last_became_active":"2024-02-19T21:32:23.360838+0000","last_became_peered":"2024-02-19T21:32:23.360838+0000","last_unstale":"2024-02-19T21:40:25.759797+0000","last_undegraded":"2024-02-19T21:40:25.759797+0000","last_fullsized":"2024-02-19T21:40:25.759797+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:25.759697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:40:25.759697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"66'10","reported_seq":156,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.789517+0000","last_change":"2024-02-19T21:39:30.264368+0000","last_active":"2024-02-19T21:40:24.789517+0000","last_peered":"2024-02-19T21:40:24.789517+0000","last_clean":"2024-02-19T21:40:24.789517+0000","last_became_active":"2024-02-19T21:32:25.372060+0000","last_became_peered":"2024-02-19T21:32:25.372060+0000","last_unstale":"2024-02-19T21:40:24.789517+0000","last_undegraded":"2024-02-19T21:40:24.789517+0000","last_fullsized":"2024-02-19T21:40:24.789517+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:39:30.264301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:30.264301+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":141,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.793834+0000","last_change":"2024-02-19T21:37:27.036804+0000","last_active":"2024-02-19T21:40:24.793834+0000","last_peered":"2024-02-19T21:40:24.793834+0000","last_clean":"2024-02-19T21:40:24.793834+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:40:24.793834+0000","last_undegraded":"2024-02-19T21:40:24.793834+0000","last_fullsized":"2024-02-19T21:40:24.793834+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_clean_scrub_stamp":"2024-02-19T21:37:27.036737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":139,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.787885+0000","last_change":"2024-02-19T21:39:36.067452+0000","last_active":"2024-02-19T21:40:24.787885+0000","last_peered":"2024-02-19T21:40:24.787885+0000","last_clean":"2024-02-19T21:40:24.787885+0000","last_became_active":"2024-02-19T21:32:27.369002+0000","last_became_peered":"2024-02-19T21:32:27.369002+0000","last_unstale":"2024-02-19T21:40:24.787885+0000","last_undegraded":"2024-02-19T21:40:24.787885+0000","last_fullsized":"2024-02-19T21:40:24.787885+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:36.067354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:36.067354+0000","last_clean_scrub_stamp":"2024-02-19T21:39:36.067354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":148,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:29.421893+0000","last_change":"2024-02-19T21:40:29.421893+0000","last_active":"2024-02-19T21:40:29.421893+0000","last_peered":"2024-02-19T21:40:29.421893+0000","last_clean":"2024-02-19T21:40:29.421893+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:40:29.421893+0000","last_undegraded":"2024-02-19T21:40:29.421893+0000","last_fullsized":"2024-02-19T21:40:29.421893+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:29.421791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:29.421791+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"66'6","reported_seq":105,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.793369+0000","last_change":"2024-02-19T21:39:39.505326+0000","last_active":"2024-02-19T21:40:24.793369+0000","last_peered":"2024-02-19T21:40:24.793369+0000","last_clean":"2024-02-19T21:40:24.793369+0000","last_became_active":"2024-02-19T21:39:39.479449+0000","last_became_peered":"2024-02-19T21:39:39.479449+0000","last_unstale":"2024-02-19T21:40:24.793369+0000","last_undegraded":"2024-02-19T21:40:24.793369+0000","last_fullsized":"2024-02-19T21:40:24.793369+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'6","last_scrub_stamp":"2024-02-19T21:39:24.011489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:24.011489+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":30,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.785792+0000","last_change":"2024-02-19T21:39:41.367764+0000","last_active":"2024-02-19T21:40:24.785792+0000","last_peered":"2024-02-19T21:40:24.785792+0000","last_clean":"2024-02-19T21:40:24.785792+0000","last_became_active":"2024-02-19T21:39:39.469477+0000","last_became_peered":"2024-02-19T21:39:39.469477+0000","last_unstale":"2024-02-19T21:40:24.785792+0000","last_undegraded":"2024-02-19T21:40:24.785792+0000","last_fullsized":"2024-02-19T21:40:24.785792+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:41.367692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:41.367692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":46,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.790610+0000","last_change":"2024-02-19T21:38:31.250323+0000","last_active":"2024-02-19T21:40:24.790610+0000","last_peered":"2024-02-19T21:40:24.790610+0000","last_clean":"2024-02-19T21:40:24.790610+0000","last_became_active":"2024-02-19T21:38:31.249969+0000","last_became_peered":"2024-02-19T21:38:31.249969+0000","last_unstale":"2024-02-19T21:40:24.790610+0000","last_undegraded":"2024-02-19T21:40:24.790610+0000","last_fullsized":"2024-02-19T21:40:24.790610+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:36:54.644120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:36:54.644120+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":25,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.783489+0000","last_change":"2024-02-19T21:39:39.477623+0000","last_active":"2024-02-19T21:40:24.783489+0000","last_peered":"2024-02-19T21:40:24.783489+0000","last_clean":"2024-02-19T21:40:24.783489+0000","last_became_active":"2024-02-19T21:39:39.477308+0000","last_became_peered":"2024-02-19T21:39:39.477308+0000","last_unstale":"2024-02-19T21:40:24.783489+0000","last_undegraded":"2024-02-19T21:40:24.783489+0000","last_fullsized":"2024-02-19T21:40:24.783489+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:26.250620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:38:26.250620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"66'9","reported_seq":201,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.793540+0000","last_change":"2024-02-19T21:39:46.193498+0000","last_active":"2024-02-19T21:40:24.793540+0000","last_peered":"2024-02-19T21:40:24.793540+0000","last_clean":"2024-02-19T21:40:24.793540+0000","last_became_active":"2024-02-19T21:39:39.470993+0000","last_became_peered":"2024-02-19T21:39:39.470993+0000","last_unstale":"2024-02-19T21:40:24.793540+0000","last_undegraded":"2024-02-19T21:40:24.793540+0000","last_fullsized":"2024-02-19T21:40:24.793540+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:39:46.193426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:46.193426+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6],"acting":[0,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"179'4099","reported_seq":4121,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:29.856987+0000","last_change":"2024-02-19T21:39:39.469485+0000","last_active":"2024-02-19T21:40:29.856987+0000","last_peered":"2024-02-19T21:40:29.856987+0000","last_clean":"2024-02-19T21:40:29.856987+0000","last_became_active":"2024-02-19T21:39:39.469130+0000","last_became_peered":"2024-02-19T21:39:39.469130+0000","last_unstale":"2024-02-19T21:40:29.856987+0000","last_undegraded":"2024-02-19T21:40:29.856987+0000","last_fullsized":"2024-02-19T21:40:29.856987+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4099,"ondisk_log_size":4099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":268632064,"num_objects":4099,"num_object_clones":0,"num_object_copies":12297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4099,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4099,"num_write_kb":262336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":137,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.788807+0000","last_change":"2024-02-19T21:39:27.290115+0000","last_active":"2024-02-19T21:40:24.788807+0000","last_peered":"2024-02-19T21:40:24.788807+0000","last_clean":"2024-02-19T21:40:24.788807+0000","last_became_active":"2024-02-19T21:32:29.376027+0000","last_became_peered":"2024-02-19T21:32:29.376027+0000","last_unstale":"2024-02-19T21:40:24.788807+0000","last_undegraded":"2024-02-19T21:40:24.788807+0000","last_fullsized":"2024-02-19T21:40:24.788807+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:27.289980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:39:27.289980+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"59'2","reported_seq":171,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.785941+0000","last_change":"2024-02-19T21:39:33.533206+0000","last_active":"2024-02-19T21:40:24.785941+0000","last_peered":"2024-02-19T21:40:24.785941+0000","last_clean":"2024-02-19T21:40:24.785941+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:40:24.785941+0000","last_undegraded":"2024-02-19T21:40:24.785941+0000","last_fullsized":"2024-02-19T21:40:24.785941+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-02-19T21:39:33.533126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:39:33.533126+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"83'17","reported_seq":174,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.782783+0000","last_change":"2024-02-19T21:38:31.684369+0000","last_active":"2024-02-19T21:40:24.782783+0000","last_peered":"2024-02-19T21:40:24.782783+0000","last_clean":"2024-02-19T21:40:24.782783+0000","last_became_active":"2024-02-19T21:38:31.247821+0000","last_became_peered":"2024-02-19T21:38:31.247821+0000","last_unstale":"2024-02-19T21:40:24.782783+0000","last_undegraded":"2024-02-19T21:40:24.782783+0000","last_fullsized":"2024-02-19T21:40:24.782783+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'17","last_scrub_stamp":"2024-02-19T21:36:56.732448+0000","last_deep_scrub":"83'17","last_deep_scrub_stamp":"2024-02-19T21:33:43.418450+0000","last_clean_scrub_stamp":"2024-02-19T21:36:56.732448+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":25,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.792276+0000","last_change":"2024-02-19T21:39:39.467760+0000","last_active":"2024-02-19T21:40:24.792276+0000","last_peered":"2024-02-19T21:40:24.792276+0000","last_clean":"2024-02-19T21:40:24.792276+0000","last_became_active":"2024-02-19T21:39:39.467210+0000","last_became_peered":"2024-02-19T21:39:39.467210+0000","last_unstale":"2024-02-19T21:40:24.792276+0000","last_undegraded":"2024-02-19T21:40:24.792276+0000","last_fullsized":"2024-02-19T21:40:24.792276+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:37.384723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:37.384723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"179'3689","reported_seq":3711,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:25.037520+0000","last_change":"2024-02-19T21:39:39.471871+0000","last_active":"2024-02-19T21:40:25.037520+0000","last_peered":"2024-02-19T21:40:25.037520+0000","last_clean":"2024-02-19T21:40:25.037520+0000","last_became_active":"2024-02-19T21:39:39.471575+0000","last_became_peered":"2024-02-19T21:39:39.471575+0000","last_unstale":"2024-02-19T21:40:25.037520+0000","last_undegraded":"2024-02-19T21:40:25.037520+0000","last_fullsized":"2024-02-19T21:40:25.037520+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":3689,"ondisk_log_size":3689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":241762304,"num_objects":3689,"num_object_clones":0,"num_object_copies":11067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3689,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3689,"num_write_kb":236096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":156,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.791834+0000","last_change":"2024-02-19T21:39:39.467547+0000","last_active":"2024-02-19T21:40:24.791834+0000","last_peered":"2024-02-19T21:40:24.791834+0000","last_clean":"2024-02-19T21:40:24.791834+0000","last_became_active":"2024-02-19T21:39:39.466788+0000","last_became_peered":"2024-02-19T21:39:39.466788+0000","last_unstale":"2024-02-19T21:40:24.791834+0000","last_undegraded":"2024-02-19T21:40:24.791834+0000","last_fullsized":"2024-02-19T21:40:24.791834+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:15.954684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:38:15.954684+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":144,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.781846+0000","last_change":"2024-02-19T21:39:34.971980+0000","last_active":"2024-02-19T21:40:24.781846+0000","last_peered":"2024-02-19T21:40:24.781846+0000","last_clean":"2024-02-19T21:40:24.781846+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:40:24.781846+0000","last_undegraded":"2024-02-19T21:40:24.781846+0000","last_fullsized":"2024-02-19T21:40:24.781846+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:34.971917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:39:34.971917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"66'10","reported_seq":35,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.783141+0000","last_change":"2024-02-19T21:39:39.526201+0000","last_active":"2024-02-19T21:40:24.783141+0000","last_peered":"2024-02-19T21:40:24.783141+0000","last_clean":"2024-02-19T21:40:24.783141+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:40:24.783141+0000","last_undegraded":"2024-02-19T21:40:24.783141+0000","last_fullsized":"2024-02-19T21:40:24.783141+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:37:14.054904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:14.054904+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":246,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.792733+0000","last_change":"2024-02-19T21:40:24.323394+0000","last_active":"2024-02-19T21:40:24.792733+0000","last_peered":"2024-02-19T21:40:24.792733+0000","last_clean":"2024-02-19T21:40:24.792733+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:40:24.792733+0000","last_undegraded":"2024-02-19T21:40:24.792733+0000","last_fullsized":"2024-02-19T21:40:24.792733+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:37:17.775085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:17.775085+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"179'4002","reported_seq":4024,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:29.824117+0000","last_change":"2024-02-19T21:39:39.471426+0000","last_active":"2024-02-19T21:40:29.824117+0000","last_peered":"2024-02-19T21:40:29.824117+0000","last_clean":"2024-02-19T21:40:29.824117+0000","last_became_active":"2024-02-19T21:39:39.471113+0000","last_became_peered":"2024-02-19T21:39:39.471113+0000","last_unstale":"2024-02-19T21:40:29.824117+0000","last_undegraded":"2024-02-19T21:40:29.824117+0000","last_fullsized":"2024-02-19T21:40:29.824117+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4002,"ondisk_log_size":4002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":262275072,"num_objects":4002,"num_object_clones":0,"num_object_copies":12006,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4002,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4002,"num_write_kb":256128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":56,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:27.767533+0000","last_change":"2024-02-19T21:40:27.767533+0000","last_active":"2024-02-19T21:40:27.767533+0000","last_peered":"2024-02-19T21:40:27.767533+0000","last_clean":"2024-02-19T21:40:27.767533+0000","last_became_active":"2024-02-19T21:38:31.244787+0000","last_became_peered":"2024-02-19T21:38:31.244787+0000","last_unstale":"2024-02-19T21:40:27.767533+0000","last_undegraded":"2024-02-19T21:40:27.767533+0000","last_fullsized":"2024-02-19T21:40:27.767533+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:27.767442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:27.767442+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":148,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.789647+0000","last_change":"2024-02-19T21:39:27.079886+0000","last_active":"2024-02-19T21:40:24.789647+0000","last_peered":"2024-02-19T21:40:24.789647+0000","last_clean":"2024-02-19T21:40:24.789647+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:40:24.789647+0000","last_undegraded":"2024-02-19T21:40:24.789647+0000","last_fullsized":"2024-02-19T21:40:24.789647+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:27.079784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:39:27.079784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"167'30","reported_seq":350,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:25.023672+0000","last_change":"2024-02-19T21:39:43.996618+0000","last_active":"2024-02-19T21:40:25.023672+0000","last_peered":"2024-02-19T21:40:25.023672+0000","last_clean":"2024-02-19T21:40:25.023672+0000","last_became_active":"2024-02-19T21:39:39.476146+0000","last_became_peered":"2024-02-19T21:39:39.476146+0000","last_unstale":"2024-02-19T21:40:25.023672+0000","last_undegraded":"2024-02-19T21:40:25.023672+0000","last_fullsized":"2024-02-19T21:40:25.023672+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'30","last_scrub_stamp":"2024-02-19T21:39:43.996511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:43.996511+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,7],"acting":[1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":140,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.793187+0000","last_change":"2024-02-19T21:38:16.890343+0000","last_active":"2024-02-19T21:40:24.793187+0000","last_peered":"2024-02-19T21:40:24.793187+0000","last_clean":"2024-02-19T21:40:24.793187+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:40:24.793187+0000","last_undegraded":"2024-02-19T21:40:24.793187+0000","last_fullsized":"2024-02-19T21:40:24.793187+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:16.890269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:16.890269+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"179'4096","reported_seq":4118,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:29.846475+0000","last_change":"2024-02-19T21:39:39.469811+0000","last_active":"2024-02-19T21:40:29.846475+0000","last_peered":"2024-02-19T21:40:29.846475+0000","last_clean":"2024-02-19T21:40:29.846475+0000","last_became_active":"2024-02-19T21:39:39.469500+0000","last_became_peered":"2024-02-19T21:39:39.469500+0000","last_unstale":"2024-02-19T21:40:29.846475+0000","last_undegraded":"2024-02-19T21:40:29.846475+0000","last_fullsized":"2024-02-19T21:40:29.846475+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4096,"ondisk_log_size":4096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":268435456,"num_objects":4096,"num_object_clones":0,"num_object_copies":12288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4096,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4096,"num_write_kb":262144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7],"acting":[4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":137,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.793913+0000","last_change":"2024-02-19T21:39:29.085751+0000","last_active":"2024-02-19T21:40:24.793913+0000","last_peered":"2024-02-19T21:40:24.793913+0000","last_clean":"2024-02-19T21:40:24.793913+0000","last_became_active":"2024-02-19T21:32:29.597365+0000","last_became_peered":"2024-02-19T21:32:29.597365+0000","last_unstale":"2024-02-19T21:40:24.793913+0000","last_undegraded":"2024-02-19T21:40:24.793913+0000","last_fullsized":"2024-02-19T21:40:24.793913+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:29.085642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:29.085642+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"67'5","reported_seq":637,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:28.598807+0000","last_change":"2024-02-19T21:39:39.576551+0000","last_active":"2024-02-19T21:40:28.598807+0000","last_peered":"2024-02-19T21:40:28.598807+0000","last_clean":"2024-02-19T21:40:28.598807+0000","last_became_active":"2024-02-19T21:39:39.464361+0000","last_became_peered":"2024-02-19T21:39:39.464361+0000","last_unstale":"2024-02-19T21:40:28.598807+0000","last_undegraded":"2024-02-19T21:40:28.598807+0000","last_fullsized":"2024-02-19T21:40:28.598807+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5","last_scrub_stamp":"2024-02-19T21:38:17.997743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:38:17.997743+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":474,"num_read_kb":469,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":139,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.796435+0000","last_change":"2024-02-19T21:39:39.468973+0000","last_active":"2024-02-19T21:40:24.796435+0000","last_peered":"2024-02-19T21:40:24.796435+0000","last_clean":"2024-02-19T21:40:24.796435+0000","last_became_active":"2024-02-19T21:39:39.468113+0000","last_became_peered":"2024-02-19T21:39:39.468113+0000","last_unstale":"2024-02-19T21:40:24.796435+0000","last_undegraded":"2024-02-19T21:40:24.796435+0000","last_fullsized":"2024-02-19T21:40:24.796435+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:15.194849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:38:15.194849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"66'13","reported_seq":179,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.790498+0000","last_change":"2024-02-19T21:37:32.806098+0000","last_active":"2024-02-19T21:40:24.790498+0000","last_peered":"2024-02-19T21:40:24.790498+0000","last_clean":"2024-02-19T21:40:24.790498+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:40:24.790498+0000","last_undegraded":"2024-02-19T21:40:24.790498+0000","last_fullsized":"2024-02-19T21:40:24.790498+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'13","last_scrub_stamp":"2024-02-19T21:37:32.805993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:32.805993+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":25,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.788178+0000","last_change":"2024-02-19T21:39:39.477625+0000","last_active":"2024-02-19T21:40:24.788178+0000","last_peered":"2024-02-19T21:40:24.788178+0000","last_clean":"2024-02-19T21:40:24.788178+0000","last_became_active":"2024-02-19T21:39:39.475190+0000","last_became_peered":"2024-02-19T21:39:39.475190+0000","last_unstale":"2024-02-19T21:40:24.788178+0000","last_undegraded":"2024-02-19T21:40:24.788178+0000","last_fullsized":"2024-02-19T21:40:24.788178+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:14.199989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:14.199989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"179'3962","reported_seq":3984,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:29.848902+0000","last_change":"2024-02-19T21:39:39.475831+0000","last_active":"2024-02-19T21:40:29.848902+0000","last_peered":"2024-02-19T21:40:29.848902+0000","last_clean":"2024-02-19T21:40:29.848902+0000","last_became_active":"2024-02-19T21:39:39.475531+0000","last_became_peered":"2024-02-19T21:39:39.475531+0000","last_unstale":"2024-02-19T21:40:29.848902+0000","last_undegraded":"2024-02-19T21:40:29.848902+0000","last_fullsized":"2024-02-19T21:40:29.848902+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":3962,"ondisk_log_size":3962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":259653632,"num_objects":3962,"num_object_clones":0,"num_object_copies":11886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3962,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3962,"num_write_kb":253568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":137,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.788727+0000","last_change":"2024-02-19T21:37:20.804540+0000","last_active":"2024-02-19T21:40:24.788727+0000","last_peered":"2024-02-19T21:40:24.788727+0000","last_clean":"2024-02-19T21:40:24.788727+0000","last_became_active":"2024-02-19T21:32:29.372547+0000","last_became_peered":"2024-02-19T21:32:29.372547+0000","last_unstale":"2024-02-19T21:40:24.788727+0000","last_undegraded":"2024-02-19T21:40:24.788727+0000","last_fullsized":"2024-02-19T21:40:24.788727+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:20.804454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:37:20.804454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":46,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.789713+0000","last_change":"2024-02-19T21:38:31.247087+0000","last_active":"2024-02-19T21:40:24.789713+0000","last_peered":"2024-02-19T21:40:24.789713+0000","last_clean":"2024-02-19T21:40:24.789713+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:40:24.789713+0000","last_undegraded":"2024-02-19T21:40:24.789713+0000","last_fullsized":"2024-02-19T21:40:24.789713+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:13.579375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:37:13.579375+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":152,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.788948+0000","last_change":"2024-02-19T21:39:39.473449+0000","last_active":"2024-02-19T21:40:24.788948+0000","last_peered":"2024-02-19T21:40:24.788948+0000","last_clean":"2024-02-19T21:40:24.788948+0000","last_became_active":"2024-02-19T21:39:39.473125+0000","last_became_peered":"2024-02-19T21:39:39.473125+0000","last_unstale":"2024-02-19T21:40:24.788948+0000","last_undegraded":"2024-02-19T21:40:24.788948+0000","last_fullsized":"2024-02-19T21:40:24.788948+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:15.868735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:38:15.868735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":151,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.793618+0000","last_change":"2024-02-19T21:38:22.819040+0000","last_active":"2024-02-19T21:40:24.793618+0000","last_peered":"2024-02-19T21:40:24.793618+0000","last_clean":"2024-02-19T21:40:24.793618+0000","last_became_active":"2024-02-19T21:32:16.878022+0000","last_became_peered":"2024-02-19T21:32:16.878022+0000","last_unstale":"2024-02-19T21:40:24.793618+0000","last_undegraded":"2024-02-19T21:40:24.793618+0000","last_fullsized":"2024-02-19T21:40:24.793618+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:22.818948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:38:22.818948+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"143'21","reported_seq":175,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.789470+0000","last_change":"2024-02-19T21:40:24.331961+0000","last_active":"2024-02-19T21:40:24.789470+0000","last_peered":"2024-02-19T21:40:24.789470+0000","last_clean":"2024-02-19T21:40:24.789470+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:40:24.789470+0000","last_undegraded":"2024-02-19T21:40:24.789470+0000","last_fullsized":"2024-02-19T21:40:24.789470+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"143'21","last_scrub_stamp":"2024-02-19T21:40:24.331869+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:40:24.331869+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":153,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.793677+0000","last_change":"2024-02-19T21:40:22.826773+0000","last_active":"2024-02-19T21:40:24.793677+0000","last_peered":"2024-02-19T21:40:24.793677+0000","last_clean":"2024-02-19T21:40:24.793677+0000","last_became_active":"2024-02-19T21:39:39.472712+0000","last_became_peered":"2024-02-19T21:39:39.472712+0000","last_unstale":"2024-02-19T21:40:24.793677+0000","last_undegraded":"2024-02-19T21:40:24.793677+0000","last_fullsized":"2024-02-19T21:40:24.793677+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:22.826680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:22.826680+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"179'3921","reported_seq":3943,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:29.883129+0000","last_change":"2024-02-19T21:39:39.480146+0000","last_active":"2024-02-19T21:40:29.883129+0000","last_peered":"2024-02-19T21:40:29.883129+0000","last_clean":"2024-02-19T21:40:29.883129+0000","last_became_active":"2024-02-19T21:39:39.479576+0000","last_became_peered":"2024-02-19T21:39:39.479576+0000","last_unstale":"2024-02-19T21:40:29.883129+0000","last_undegraded":"2024-02-19T21:40:29.883129+0000","last_fullsized":"2024-02-19T21:40:29.883129+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":3921,"ondisk_log_size":3921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":256966656,"num_objects":3921,"num_object_clones":0,"num_object_copies":11763,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3921,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3921,"num_write_kb":250944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":147,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:29.250688+0000","last_change":"2024-02-19T21:40:29.250688+0000","last_active":"2024-02-19T21:40:29.250688+0000","last_peered":"2024-02-19T21:40:29.250688+0000","last_clean":"2024-02-19T21:40:29.250688+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:40:29.250688+0000","last_undegraded":"2024-02-19T21:40:29.250688+0000","last_fullsized":"2024-02-19T21:40:29.250688+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:40:29.250599+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":153,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.796548+0000","last_change":"2024-02-19T21:38:31.247108+0000","last_active":"2024-02-19T21:40:24.796548+0000","last_peered":"2024-02-19T21:40:24.796548+0000","last_clean":"2024-02-19T21:40:24.796548+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:40:24.796548+0000","last_undegraded":"2024-02-19T21:40:24.796548+0000","last_fullsized":"2024-02-19T21:40:24.796548+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:22.928801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:38:22.928801+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":143,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.793536+0000","last_change":"2024-02-19T21:39:30.117111+0000","last_active":"2024-02-19T21:40:24.793536+0000","last_peered":"2024-02-19T21:40:24.793536+0000","last_clean":"2024-02-19T21:40:24.793536+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:40:24.793536+0000","last_undegraded":"2024-02-19T21:40:24.793536+0000","last_fullsized":"2024-02-19T21:40:24.793536+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:30.117032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:39:30.117032+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"66'12","reported_seq":208,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.793463+0000","last_change":"2024-02-19T21:39:39.494633+0000","last_active":"2024-02-19T21:40:24.793463+0000","last_peered":"2024-02-19T21:40:24.793463+0000","last_clean":"2024-02-19T21:40:24.793463+0000","last_became_active":"2024-02-19T21:39:39.472079+0000","last_became_peered":"2024-02-19T21:39:39.472079+0000","last_unstale":"2024-02-19T21:40:24.793463+0000","last_undegraded":"2024-02-19T21:40:24.793463+0000","last_fullsized":"2024-02-19T21:40:24.793463+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'12","last_scrub_stamp":"2024-02-19T21:38:18.908732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:38:18.908732+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":139,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.788679+0000","last_change":"2024-02-19T21:38:25.921065+0000","last_active":"2024-02-19T21:40:24.788679+0000","last_peered":"2024-02-19T21:40:24.788679+0000","last_clean":"2024-02-19T21:40:24.788679+0000","last_became_active":"2024-02-19T21:32:27.372460+0000","last_became_peered":"2024-02-19T21:32:27.372460+0000","last_unstale":"2024-02-19T21:40:24.788679+0000","last_undegraded":"2024-02-19T21:40:24.788679+0000","last_fullsized":"2024-02-19T21:40:24.788679+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:25.920968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:25.920968+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"179'3976","reported_seq":3998,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:29.945341+0000","last_change":"2024-02-19T21:39:39.468511+0000","last_active":"2024-02-19T21:40:29.945341+0000","last_peered":"2024-02-19T21:40:29.945341+0000","last_clean":"2024-02-19T21:40:29.945341+0000","last_became_active":"2024-02-19T21:39:39.468217+0000","last_became_peered":"2024-02-19T21:39:39.468217+0000","last_unstale":"2024-02-19T21:40:29.945341+0000","last_undegraded":"2024-02-19T21:40:29.945341+0000","last_fullsized":"2024-02-19T21:40:29.945341+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":3976,"ondisk_log_size":3976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":260571136,"num_objects":3976,"num_object_clones":0,"num_object_copies":11928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3976,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3976,"num_write_kb":254464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":147,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.783153+0000","last_change":"2024-02-19T21:39:42.020899+0000","last_active":"2024-02-19T21:40:24.783153+0000","last_peered":"2024-02-19T21:40:24.783153+0000","last_clean":"2024-02-19T21:40:24.783153+0000","last_became_active":"2024-02-19T21:39:39.474951+0000","last_became_peered":"2024-02-19T21:39:39.474951+0000","last_unstale":"2024-02-19T21:40:24.783153+0000","last_undegraded":"2024-02-19T21:40:24.783153+0000","last_fullsized":"2024-02-19T21:40:24.783153+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:39:42.020832+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,7],"acting":[1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":143,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.793934+0000","last_change":"2024-02-19T21:40:11.877814+0000","last_active":"2024-02-19T21:40:24.793934+0000","last_peered":"2024-02-19T21:40:24.793934+0000","last_clean":"2024-02-19T21:40:24.793934+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:40:24.793934+0000","last_undegraded":"2024-02-19T21:40:24.793934+0000","last_fullsized":"2024-02-19T21:40:24.793934+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:11.877751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:11.877751+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"83'27","reported_seq":186,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.792493+0000","last_change":"2024-02-19T21:37:13.658855+0000","last_active":"2024-02-19T21:40:24.792493+0000","last_peered":"2024-02-19T21:40:24.792493+0000","last_clean":"2024-02-19T21:40:24.792493+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:40:24.792493+0000","last_undegraded":"2024-02-19T21:40:24.792493+0000","last_fullsized":"2024-02-19T21:40:24.792493+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'27","last_scrub_stamp":"2024-02-19T21:37:13.658740+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:37:13.658740+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":146,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.787737+0000","last_change":"2024-02-19T21:40:16.260329+0000","last_active":"2024-02-19T21:40:24.787737+0000","last_peered":"2024-02-19T21:40:24.787737+0000","last_clean":"2024-02-19T21:40:24.787737+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:40:24.787737+0000","last_undegraded":"2024-02-19T21:40:24.787737+0000","last_fullsized":"2024-02-19T21:40:24.787737+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:16.260223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:40:16.260223+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.c","version":"179'3676","reported_seq":3698,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:25.025164+0000","last_change":"2024-02-19T21:39:39.476418+0000","last_active":"2024-02-19T21:40:25.025164+0000","last_peered":"2024-02-19T21:40:25.025164+0000","last_clean":"2024-02-19T21:40:25.025164+0000","last_became_active":"2024-02-19T21:39:39.476073+0000","last_became_peered":"2024-02-19T21:39:39.476073+0000","last_unstale":"2024-02-19T21:40:25.025164+0000","last_undegraded":"2024-02-19T21:40:25.025164+0000","last_fullsized":"2024-02-19T21:40:25.025164+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":3676,"ondisk_log_size":3676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":240910336,"num_objects":3676,"num_object_clones":0,"num_object_copies":11028,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3676,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3676,"num_write_kb":235264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":36,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.787334+0000","last_change":"2024-02-19T21:39:44.231498+0000","last_active":"2024-02-19T21:40:24.787334+0000","last_peered":"2024-02-19T21:40:24.787334+0000","last_clean":"2024-02-19T21:40:24.787334+0000","last_became_active":"2024-02-19T21:39:39.472861+0000","last_became_peered":"2024-02-19T21:39:39.472861+0000","last_unstale":"2024-02-19T21:40:24.787334+0000","last_undegraded":"2024-02-19T21:40:24.787334+0000","last_fullsized":"2024-02-19T21:40:24.787334+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:44.231420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:44.231420+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":146,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.782333+0000","last_change":"2024-02-19T21:38:28.036423+0000","last_active":"2024-02-19T21:40:24.782333+0000","last_peered":"2024-02-19T21:40:24.782333+0000","last_clean":"2024-02-19T21:40:24.782333+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:40:24.782333+0000","last_undegraded":"2024-02-19T21:40:24.782333+0000","last_fullsized":"2024-02-19T21:40:24.782333+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:38:28.036351+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"168'26","reported_seq":121,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.794015+0000","last_change":"2024-02-19T21:39:48.004824+0000","last_active":"2024-02-19T21:40:24.794015+0000","last_peered":"2024-02-19T21:40:24.794015+0000","last_clean":"2024-02-19T21:40:24.794015+0000","last_became_active":"2024-02-19T21:38:31.249726+0000","last_became_peered":"2024-02-19T21:38:31.249726+0000","last_unstale":"2024-02-19T21:40:24.794015+0000","last_undegraded":"2024-02-19T21:40:24.794015+0000","last_fullsized":"2024-02-19T21:40:24.794015+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"168'26","last_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:39:48.004702+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":33,"num_read_kb":21,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":19,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.788920+0000","last_change":"2024-02-19T21:39:51.537021+0000","last_active":"2024-02-19T21:40:24.788920+0000","last_peered":"2024-02-19T21:40:24.788920+0000","last_clean":"2024-02-19T21:40:24.788920+0000","last_became_active":"2024-02-19T21:39:51.536640+0000","last_became_peered":"2024-02-19T21:39:51.536640+0000","last_unstale":"2024-02-19T21:40:24.788920+0000","last_undegraded":"2024-02-19T21:40:24.788920+0000","last_fullsized":"2024-02-19T21:40:24.788920+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:34.519432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:34.519432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.d","version":"179'3920","reported_seq":3939,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:29.812444+0000","last_change":"2024-02-19T21:39:39.471058+0000","last_active":"2024-02-19T21:40:29.812444+0000","last_peered":"2024-02-19T21:40:29.812444+0000","last_clean":"2024-02-19T21:40:29.812444+0000","last_became_active":"2024-02-19T21:39:39.470705+0000","last_became_peered":"2024-02-19T21:39:39.470705+0000","last_unstale":"2024-02-19T21:40:29.812444+0000","last_undegraded":"2024-02-19T21:40:29.812444+0000","last_fullsized":"2024-02-19T21:40:29.812444+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":3920,"ondisk_log_size":3920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":256901120,"num_objects":3920,"num_object_clones":0,"num_object_copies":11760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3920,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3920,"num_write_kb":250880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":151,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:28.874859+0000","last_change":"2024-02-19T21:40:28.874859+0000","last_active":"2024-02-19T21:40:28.874859+0000","last_peered":"2024-02-19T21:40:28.874859+0000","last_clean":"2024-02-19T21:40:28.874859+0000","last_became_active":"2024-02-19T21:39:39.481908+0000","last_became_peered":"2024-02-19T21:39:39.481908+0000","last_unstale":"2024-02-19T21:40:28.874859+0000","last_undegraded":"2024-02-19T21:40:28.874859+0000","last_fullsized":"2024-02-19T21:40:28.874859+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:28.874762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:28.874762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":152,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.788532+0000","last_change":"2024-02-19T21:39:39.462954+0000","last_active":"2024-02-19T21:40:24.788532+0000","last_peered":"2024-02-19T21:40:24.788532+0000","last_clean":"2024-02-19T21:40:24.788532+0000","last_became_active":"2024-02-19T21:39:39.462545+0000","last_became_peered":"2024-02-19T21:39:39.462545+0000","last_unstale":"2024-02-19T21:40:24.788532+0000","last_undegraded":"2024-02-19T21:40:24.788532+0000","last_fullsized":"2024-02-19T21:40:24.788532+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:28.158722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:39:28.158722+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"66'14","reported_seq":136,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.787714+0000","last_change":"2024-02-19T21:38:30.886495+0000","last_active":"2024-02-19T21:40:24.787714+0000","last_peered":"2024-02-19T21:40:24.787714+0000","last_clean":"2024-02-19T21:40:24.787714+0000","last_became_active":"2024-02-19T21:35:14.513806+0000","last_became_peered":"2024-02-19T21:35:14.513806+0000","last_unstale":"2024-02-19T21:40:24.787714+0000","last_undegraded":"2024-02-19T21:40:24.787714+0000","last_fullsized":"2024-02-19T21:40:24.787714+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'14","last_scrub_stamp":"2024-02-19T21:38:30.886421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:38:30.886421+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":97,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:25.021695+0000","last_change":"2024-02-19T21:38:31.340504+0000","last_active":"2024-02-19T21:40:25.021695+0000","last_peered":"2024-02-19T21:40:25.021695+0000","last_clean":"2024-02-19T21:40:25.021695+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:40:25.021695+0000","last_undegraded":"2024-02-19T21:40:25.021695+0000","last_fullsized":"2024-02-19T21:40:25.021695+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:37:07.618614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:07.618614+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"179'4008","reported_seq":4030,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:29.827405+0000","last_change":"2024-02-19T21:39:39.471935+0000","last_active":"2024-02-19T21:40:29.827405+0000","last_peered":"2024-02-19T21:40:29.827405+0000","last_clean":"2024-02-19T21:40:29.827405+0000","last_became_active":"2024-02-19T21:39:39.471580+0000","last_became_peered":"2024-02-19T21:39:39.471580+0000","last_unstale":"2024-02-19T21:40:29.827405+0000","last_undegraded":"2024-02-19T21:40:29.827405+0000","last_fullsized":"2024-02-19T21:40:29.827405+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4008,"ondisk_log_size":4008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":262668288,"num_objects":4008,"num_object_clones":0,"num_object_copies":12024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4008,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4008,"num_write_kb":256512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":28,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.788235+0000","last_change":"2024-02-19T21:40:21.371352+0000","last_active":"2024-02-19T21:40:24.788235+0000","last_peered":"2024-02-19T21:40:24.788235+0000","last_clean":"2024-02-19T21:40:24.788235+0000","last_became_active":"2024-02-19T21:39:39.477051+0000","last_became_peered":"2024-02-19T21:39:39.477051+0000","last_unstale":"2024-02-19T21:40:24.788235+0000","last_undegraded":"2024-02-19T21:40:24.788235+0000","last_fullsized":"2024-02-19T21:40:24.788235+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:21.371240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:40:21.371240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":144,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.788640+0000","last_change":"2024-02-19T21:40:22.774178+0000","last_active":"2024-02-19T21:40:24.788640+0000","last_peered":"2024-02-19T21:40:24.788640+0000","last_clean":"2024-02-19T21:40:24.788640+0000","last_became_active":"2024-02-19T21:32:27.362497+0000","last_became_peered":"2024-02-19T21:32:27.362497+0000","last_unstale":"2024-02-19T21:40:24.788640+0000","last_undegraded":"2024-02-19T21:40:24.788640+0000","last_fullsized":"2024-02-19T21:40:24.788640+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:22.774081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:22.774081+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":150,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.793714+0000","last_change":"2024-02-19T21:38:11.707510+0000","last_active":"2024-02-19T21:40:24.793714+0000","last_peered":"2024-02-19T21:40:24.793714+0000","last_clean":"2024-02-19T21:40:24.793714+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:40:24.793714+0000","last_undegraded":"2024-02-19T21:40:24.793714+0000","last_fullsized":"2024-02-19T21:40:24.793714+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:38:11.707428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:38:11.707428+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"66'11","reported_seq":160,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:26.390284+0000","last_change":"2024-02-19T21:40:26.390284+0000","last_active":"2024-02-19T21:40:26.390284+0000","last_peered":"2024-02-19T21:40:26.390284+0000","last_clean":"2024-02-19T21:40:26.390284+0000","last_became_active":"2024-02-19T21:39:51.536649+0000","last_became_peered":"2024-02-19T21:39:51.536649+0000","last_unstale":"2024-02-19T21:40:26.390284+0000","last_undegraded":"2024-02-19T21:40:26.390284+0000","last_fullsized":"2024-02-19T21:40:26.390284+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:40:26.390173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:26.390173+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"179'4079","reported_seq":4101,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:29.891560+0000","last_change":"2024-02-19T21:39:39.479591+0000","last_active":"2024-02-19T21:40:29.891560+0000","last_peered":"2024-02-19T21:40:29.891560+0000","last_clean":"2024-02-19T21:40:29.891560+0000","last_became_active":"2024-02-19T21:39:39.479224+0000","last_became_peered":"2024-02-19T21:39:39.479224+0000","last_unstale":"2024-02-19T21:40:29.891560+0000","last_undegraded":"2024-02-19T21:40:29.891560+0000","last_fullsized":"2024-02-19T21:40:29.891560+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4079,"ondisk_log_size":4079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":267321344,"num_objects":4079,"num_object_clones":0,"num_object_copies":12237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4079,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4079,"num_write_kb":261056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":142,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.789379+0000","last_change":"2024-02-19T21:40:16.845431+0000","last_active":"2024-02-19T21:40:24.789379+0000","last_peered":"2024-02-19T21:40:24.789379+0000","last_clean":"2024-02-19T21:40:24.789379+0000","last_became_active":"2024-02-19T21:32:29.378462+0000","last_became_peered":"2024-02-19T21:32:29.378462+0000","last_unstale":"2024-02-19T21:40:24.789379+0000","last_undegraded":"2024-02-19T21:40:24.789379+0000","last_fullsized":"2024-02-19T21:40:24.789379+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:16.845272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:16.845272+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"98'9","reported_seq":192,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:25.021041+0000","last_change":"2024-02-19T21:38:23.887797+0000","last_active":"2024-02-19T21:40:25.021041+0000","last_peered":"2024-02-19T21:40:25.021041+0000","last_clean":"2024-02-19T21:40:25.021041+0000","last_became_active":"2024-02-19T21:35:14.513802+0000","last_became_peered":"2024-02-19T21:35:14.513802+0000","last_unstale":"2024-02-19T21:40:25.021041+0000","last_undegraded":"2024-02-19T21:40:25.021041+0000","last_fullsized":"2024-02-19T21:40:25.021041+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'9","last_scrub_stamp":"2024-02-19T21:38:23.887716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:23.887716+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":149,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.782796+0000","last_change":"2024-02-19T21:40:14.294150+0000","last_active":"2024-02-19T21:40:24.782796+0000","last_peered":"2024-02-19T21:40:24.782796+0000","last_clean":"2024-02-19T21:40:24.782796+0000","last_became_active":"2024-02-19T21:32:23.362738+0000","last_became_peered":"2024-02-19T21:32:23.362738+0000","last_unstale":"2024-02-19T21:40:24.782796+0000","last_undegraded":"2024-02-19T21:40:24.782796+0000","last_fullsized":"2024-02-19T21:40:24.782796+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:14.294064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:40:14.294064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"66'15","reported_seq":40,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.788336+0000","last_change":"2024-02-19T21:40:12.838278+0000","last_active":"2024-02-19T21:40:24.788336+0000","last_peered":"2024-02-19T21:40:24.788336+0000","last_clean":"2024-02-19T21:40:24.788336+0000","last_became_active":"2024-02-19T21:39:51.539230+0000","last_became_peered":"2024-02-19T21:39:51.539230+0000","last_unstale":"2024-02-19T21:40:24.788336+0000","last_undegraded":"2024-02-19T21:40:24.788336+0000","last_fullsized":"2024-02-19T21:40:24.788336+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:40:12.838083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:12.838083+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.0","version":"179'4025","reported_seq":4047,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:29.968275+0000","last_change":"2024-02-19T21:39:39.465524+0000","last_active":"2024-02-19T21:40:29.968275+0000","last_peered":"2024-02-19T21:40:29.968275+0000","last_clean":"2024-02-19T21:40:29.968275+0000","last_became_active":"2024-02-19T21:39:39.465196+0000","last_became_peered":"2024-02-19T21:39:39.465196+0000","last_unstale":"2024-02-19T21:40:29.968275+0000","last_undegraded":"2024-02-19T21:40:29.968275+0000","last_fullsized":"2024-02-19T21:40:29.968275+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4025,"ondisk_log_size":4025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":263782400,"num_objects":4025,"num_object_clones":0,"num_object_copies":12075,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4025,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4025,"num_write_kb":257600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":112,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.782479+0000","last_change":"2024-02-19T21:39:40.016015+0000","last_active":"2024-02-19T21:40:24.782479+0000","last_peered":"2024-02-19T21:40:24.782479+0000","last_clean":"2024-02-19T21:40:24.782479+0000","last_became_active":"2024-02-19T21:39:39.479567+0000","last_became_peered":"2024-02-19T21:39:39.479567+0000","last_unstale":"2024-02-19T21:40:24.782479+0000","last_undegraded":"2024-02-19T21:40:24.782479+0000","last_fullsized":"2024-02-19T21:40:24.782479+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:40.015907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:40.015907+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"170'11","reported_seq":111,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:25.019535+0000","last_change":"2024-02-19T21:40:21.864057+0000","last_active":"2024-02-19T21:40:25.019535+0000","last_peered":"2024-02-19T21:40:25.019535+0000","last_clean":"2024-02-19T21:40:25.019535+0000","last_became_active":"2024-02-19T21:39:51.534304+0000","last_became_peered":"2024-02-19T21:39:51.534304+0000","last_unstale":"2024-02-19T21:40:25.019535+0000","last_undegraded":"2024-02-19T21:40:25.019535+0000","last_fullsized":"2024-02-19T21:40:25.019535+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'11","last_scrub_stamp":"2024-02-19T21:40:21.863959+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:40:21.863959+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":146,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.783048+0000","last_change":"2024-02-19T21:39:31.018063+0000","last_active":"2024-02-19T21:40:24.783048+0000","last_peered":"2024-02-19T21:40:24.783048+0000","last_clean":"2024-02-19T21:40:24.783048+0000","last_became_active":"2024-02-19T21:32:23.363155+0000","last_became_peered":"2024-02-19T21:32:23.363155+0000","last_unstale":"2024-02-19T21:40:24.783048+0000","last_undegraded":"2024-02-19T21:40:24.783048+0000","last_fullsized":"2024-02-19T21:40:24.783048+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:31.018000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:39:31.018000+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"66'10","reported_seq":130,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.789591+0000","last_change":"2024-02-19T21:39:42.511504+0000","last_active":"2024-02-19T21:40:24.789591+0000","last_peered":"2024-02-19T21:40:24.789591+0000","last_clean":"2024-02-19T21:40:24.789591+0000","last_became_active":"2024-02-19T21:35:14.514968+0000","last_became_peered":"2024-02-19T21:35:14.514968+0000","last_unstale":"2024-02-19T21:40:24.789591+0000","last_undegraded":"2024-02-19T21:40:24.789591+0000","last_fullsized":"2024-02-19T21:40:24.789591+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:39:42.511438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:42.511438+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6],"acting":[3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"179'3970","reported_seq":3992,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:29.877963+0000","last_change":"2024-02-19T21:39:39.480753+0000","last_active":"2024-02-19T21:40:29.877963+0000","last_peered":"2024-02-19T21:40:29.877963+0000","last_clean":"2024-02-19T21:40:29.877963+0000","last_became_active":"2024-02-19T21:39:39.480509+0000","last_became_peered":"2024-02-19T21:39:39.480509+0000","last_unstale":"2024-02-19T21:40:29.877963+0000","last_undegraded":"2024-02-19T21:40:29.877963+0000","last_fullsized":"2024-02-19T21:40:29.877963+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":3970,"ondisk_log_size":3970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":260177920,"num_objects":3970,"num_object_clones":0,"num_object_copies":11910,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3970,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3970,"num_write_kb":254080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":133,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.788609+0000","last_change":"2024-02-19T21:39:42.276960+0000","last_active":"2024-02-19T21:40:24.788609+0000","last_peered":"2024-02-19T21:40:24.788609+0000","last_clean":"2024-02-19T21:40:24.788609+0000","last_became_active":"2024-02-19T21:39:39.469058+0000","last_became_peered":"2024-02-19T21:39:39.469058+0000","last_unstale":"2024-02-19T21:40:24.788609+0000","last_undegraded":"2024-02-19T21:40:24.788609+0000","last_fullsized":"2024-02-19T21:40:24.788609+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:42.276864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:42.276864+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":140,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.782052+0000","last_change":"2024-02-19T21:39:39.002316+0000","last_active":"2024-02-19T21:40:24.782052+0000","last_peered":"2024-02-19T21:40:24.782052+0000","last_clean":"2024-02-19T21:40:24.782052+0000","last_became_active":"2024-02-19T21:32:27.369452+0000","last_became_peered":"2024-02-19T21:32:27.369452+0000","last_unstale":"2024-02-19T21:40:24.782052+0000","last_undegraded":"2024-02-19T21:40:24.782052+0000","last_fullsized":"2024-02-19T21:40:24.782052+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:39.002258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:39.002258+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":145,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.793426+0000","last_change":"2024-02-19T21:37:18.042043+0000","last_active":"2024-02-19T21:40:24.793426+0000","last_peered":"2024-02-19T21:40:24.793426+0000","last_clean":"2024-02-19T21:40:24.793426+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:40:24.793426+0000","last_undegraded":"2024-02-19T21:40:24.793426+0000","last_fullsized":"2024-02-19T21:40:24.793426+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:18.041939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:37:18.041939+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"66'17","reported_seq":83,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.781963+0000","last_change":"2024-02-19T21:39:39.501787+0000","last_active":"2024-02-19T21:40:24.781963+0000","last_peered":"2024-02-19T21:40:24.781963+0000","last_clean":"2024-02-19T21:40:24.781963+0000","last_became_active":"2024-02-19T21:39:39.474668+0000","last_became_peered":"2024-02-19T21:39:39.474668+0000","last_unstale":"2024-02-19T21:40:24.781963+0000","last_undegraded":"2024-02-19T21:40:24.781963+0000","last_fullsized":"2024-02-19T21:40:24.781963+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'17","last_scrub_stamp":"2024-02-19T21:38:19.154753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:38:19.154753+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"179'3609","reported_seq":3631,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:25.015508+0000","last_change":"2024-02-19T21:39:39.471363+0000","last_active":"2024-02-19T21:40:25.015508+0000","last_peered":"2024-02-19T21:40:25.015508+0000","last_clean":"2024-02-19T21:40:25.015508+0000","last_became_active":"2024-02-19T21:39:39.470667+0000","last_became_peered":"2024-02-19T21:39:39.470667+0000","last_unstale":"2024-02-19T21:40:25.015508+0000","last_undegraded":"2024-02-19T21:40:25.015508+0000","last_fullsized":"2024-02-19T21:40:25.015508+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":3609,"ondisk_log_size":3609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":236519424,"num_objects":3609,"num_object_clones":0,"num_object_copies":10827,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3609,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3609,"num_write_kb":230976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":146,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.793428+0000","last_change":"2024-02-19T21:39:39.465417+0000","last_active":"2024-02-19T21:40:24.793428+0000","last_peered":"2024-02-19T21:40:24.793428+0000","last_clean":"2024-02-19T21:40:24.793428+0000","last_became_active":"2024-02-19T21:39:39.464542+0000","last_became_peered":"2024-02-19T21:39:39.464542+0000","last_unstale":"2024-02-19T21:40:24.793428+0000","last_undegraded":"2024-02-19T21:40:24.793428+0000","last_fullsized":"2024-02-19T21:40:24.793428+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:37:29.936139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.792408+0000","last_change":"2024-02-19T21:40:23.324375+0000","last_active":"2024-02-19T21:40:24.792408+0000","last_peered":"2024-02-19T21:40:24.792408+0000","last_clean":"2024-02-19T21:40:24.792408+0000","last_became_active":"2024-02-19T21:39:39.471933+0000","last_became_peered":"2024-02-19T21:39:39.471933+0000","last_unstale":"2024-02-19T21:40:24.792408+0000","last_undegraded":"2024-02-19T21:40:24.792408+0000","last_fullsized":"2024-02-19T21:40:24.792408+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:23.324303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:46.372184+0000","last_clean_scrub_stamp":"2024-02-19T21:40:23.324303+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":43,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:28.696870+0000","last_change":"2024-02-19T21:40:28.696870+0000","last_active":"2024-02-19T21:40:28.696870+0000","last_peered":"2024-02-19T21:40:28.696870+0000","last_clean":"2024-02-19T21:40:28.696870+0000","last_became_active":"2024-02-19T21:39:39.479752+0000","last_became_peered":"2024-02-19T21:39:39.479752+0000","last_unstale":"2024-02-19T21:40:28.696870+0000","last_undegraded":"2024-02-19T21:40:28.696870+0000","last_fullsized":"2024-02-19T21:40:28.696870+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:40:28.696783+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"115'28","reported_seq":186,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.787605+0000","last_change":"2024-02-19T21:39:40.282748+0000","last_active":"2024-02-19T21:40:24.787605+0000","last_peered":"2024-02-19T21:40:24.787605+0000","last_clean":"2024-02-19T21:40:24.787605+0000","last_became_active":"2024-02-19T21:32:25.372284+0000","last_became_peered":"2024-02-19T21:32:25.372284+0000","last_unstale":"2024-02-19T21:40:24.787605+0000","last_undegraded":"2024-02-19T21:40:24.787605+0000","last_fullsized":"2024-02-19T21:40:24.787605+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'28","last_scrub_stamp":"2024-02-19T21:39:40.282677+0000","last_deep_scrub":"115'28","last_deep_scrub_stamp":"2024-02-19T21:36:09.031674+0000","last_clean_scrub_stamp":"2024-02-19T21:39:40.282677+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.7","version":"179'3989","reported_seq":4011,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:29.896918+0000","last_change":"2024-02-19T21:39:39.463794+0000","last_active":"2024-02-19T21:40:29.896918+0000","last_peered":"2024-02-19T21:40:29.896918+0000","last_clean":"2024-02-19T21:40:29.896918+0000","last_became_active":"2024-02-19T21:39:39.463542+0000","last_became_peered":"2024-02-19T21:39:39.463542+0000","last_unstale":"2024-02-19T21:40:29.896918+0000","last_undegraded":"2024-02-19T21:40:29.896918+0000","last_fullsized":"2024-02-19T21:40:29.896918+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":3989,"ondisk_log_size":3989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":261423104,"num_objects":3989,"num_object_clones":0,"num_object_copies":11967,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3989,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3989,"num_write_kb":255296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,6],"acting":[1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":152,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.796793+0000","last_change":"2024-02-19T21:39:42.230802+0000","last_active":"2024-02-19T21:40:24.796793+0000","last_peered":"2024-02-19T21:40:24.796793+0000","last_clean":"2024-02-19T21:40:24.796793+0000","last_became_active":"2024-02-19T21:39:39.470671+0000","last_became_peered":"2024-02-19T21:39:39.470671+0000","last_unstale":"2024-02-19T21:40:24.796793+0000","last_undegraded":"2024-02-19T21:40:24.796793+0000","last_fullsized":"2024-02-19T21:40:24.796793+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:42.230664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:42.230664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":130,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.786432+0000","last_change":"2024-02-19T21:39:39.468517+0000","last_active":"2024-02-19T21:40:24.786432+0000","last_peered":"2024-02-19T21:40:24.786432+0000","last_clean":"2024-02-19T21:40:24.786432+0000","last_became_active":"2024-02-19T21:39:39.468109+0000","last_became_peered":"2024-02-19T21:39:39.468109+0000","last_unstale":"2024-02-19T21:40:24.786432+0000","last_undegraded":"2024-02-19T21:40:24.786432+0000","last_fullsized":"2024-02-19T21:40:24.786432+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:22.219309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:22.219309+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1],"acting":[4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":144,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.782086+0000","last_change":"2024-02-19T21:37:36.883246+0000","last_active":"2024-02-19T21:40:24.782086+0000","last_peered":"2024-02-19T21:40:24.782086+0000","last_clean":"2024-02-19T21:40:24.782086+0000","last_became_active":"2024-02-19T21:32:23.357438+0000","last_became_peered":"2024-02-19T21:32:23.357438+0000","last_unstale":"2024-02-19T21:40:24.782086+0000","last_undegraded":"2024-02-19T21:40:24.782086+0000","last_fullsized":"2024-02-19T21:40:24.782086+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:36.883151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:37:36.883151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"66'9","reported_seq":163,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.792651+0000","last_change":"2024-02-19T21:39:36.193250+0000","last_active":"2024-02-19T21:40:24.792651+0000","last_peered":"2024-02-19T21:40:24.792651+0000","last_clean":"2024-02-19T21:40:24.792651+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:40:24.792651+0000","last_undegraded":"2024-02-19T21:40:24.792651+0000","last_fullsized":"2024-02-19T21:40:24.792651+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:39:36.193184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:36.193184+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"179'4076","reported_seq":4098,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:29.829585+0000","last_change":"2024-02-19T21:39:39.474614+0000","last_active":"2024-02-19T21:40:29.829585+0000","last_peered":"2024-02-19T21:40:29.829585+0000","last_clean":"2024-02-19T21:40:29.829585+0000","last_became_active":"2024-02-19T21:39:39.474311+0000","last_became_peered":"2024-02-19T21:39:39.474311+0000","last_unstale":"2024-02-19T21:40:29.829585+0000","last_undegraded":"2024-02-19T21:40:29.829585+0000","last_fullsized":"2024-02-19T21:40:29.829585+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4076,"ondisk_log_size":4076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":267124736,"num_objects":4076,"num_object_clones":0,"num_object_copies":12228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4076,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4076,"num_write_kb":260864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":142,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.789568+0000","last_change":"2024-02-19T21:40:17.853102+0000","last_active":"2024-02-19T21:40:24.789568+0000","last_peered":"2024-02-19T21:40:24.789568+0000","last_clean":"2024-02-19T21:40:24.789568+0000","last_became_active":"2024-02-19T21:32:29.597248+0000","last_became_peered":"2024-02-19T21:32:29.597248+0000","last_unstale":"2024-02-19T21:40:24.789568+0000","last_undegraded":"2024-02-19T21:40:24.789568+0000","last_fullsized":"2024-02-19T21:40:24.789568+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:17.853016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:40:17.853016+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":136,"reported_epoch":179,"state":"active+clean+scrubbing+deep","last_fresh":"2024-02-19T21:40:29.850184+0000","last_change":"2024-02-19T21:40:29.850184+0000","last_active":"2024-02-19T21:40:29.850184+0000","last_peered":"2024-02-19T21:40:29.850184+0000","last_clean":"2024-02-19T21:40:29.850184+0000","last_became_active":"2024-02-19T21:39:39.480651+0000","last_became_peered":"2024-02-19T21:39:39.480651+0000","last_unstale":"2024-02-19T21:40:29.850184+0000","last_undegraded":"2024-02-19T21:40:29.850184+0000","last_fullsized":"2024-02-19T21:40:29.850184+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:33.010549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:33.010549+0000","last_clean_scrub_stamp":"2024-02-19T21:37:33.010549+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"66'15","reported_seq":173,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-02-19T21:40:24.787565+0000","last_change":"2024-02-19T21:40:23.751996+0000","last_active":"2024-02-19T21:40:24.787565+0000","last_peered":"2024-02-19T21:40:24.787565+0000","last_clean":"2024-02-19T21:40:24.787565+0000","last_became_active":"2024-02-19T21:32:25.372170+0000","last_became_peered":"2024-02-19T21:32:25.372170+0000","last_unstale":"2024-02-19T21:40:24.787565+0000","last_undegraded":"2024-02-19T21:40:24.787565+0000","last_fullsized":"2024-02-19T21:40:24.787565+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:40:23.751886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:23.751886+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"66'8","reported_seq":249,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-02-19T21:40:25.018081+0000","last_change":"2024-02-19T21:40:19.870350+0000","last_active":"2024-02-19T21:40:25.018081+0000","last_peered":"2024-02-19T21:40:25.018081+0000","last_clean":"2024-02-19T21:40:25.018081+0000","last_became_active":"2024-02-19T21:32:27.369840+0000","last_became_peered":"2024-02-19T21:32:27.369840+0000","last_unstale":"2024-02-19T21:40:25.018081+0000","last_undegraded":"2024-02-19T21:40:25.018081+0000","last_fullsized":"2024-02-19T21:40:25.018081+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:40:19.870250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:19.870250+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":4135124992,"num_objects":63097,"num_object_clones":0,"num_object_copies":189291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63097,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63097,"num_write_kb":4038208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12449415168,"data_stored":12449415168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":63097,"ondisk_log_size":63097,"up":48,"acting":48,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":3},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":474,"num_read_kb":469,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":687,"num_read_kb":444,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":2586,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":449,"ondisk_log_size":449,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201380,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2116204,"kb_used_data":1810788,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":91628948,"statfs":{"total":95995035648,"available":93828042752,"internally_reserved":0,"allocated":1854246912,"data_stored":1853857566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:40:27 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.147,"15min":0.746},"min":{"1min":0.30299999999999999,"5min":0.189,"15min":0.189},"max":{"1min":4.0220000000000002,"5min":6.625,"15min":6.625},"last":4.0220000000000002},{"interface":"front","average":{"1min":1.26,"5min":1.5349999999999999,"15min":0.876},"min":{"1min":0.39200000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":6.6900000000000004,"5min":7.2290000000000001,"15min":7.2290000000000001},"last":6.6900000000000004}]},{"osd":1,"last update":"Mon Feb 19 21:40:27 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.7789999999999999,"15min":0.93999999999999995},"min":{"1min":0.36499999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":5.2709999999999999,"5min":11.276999999999999,"15min":11.276999999999999},"last":5.2709999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.3220000000000001,"15min":0.80200000000000005},"min":{"1min":0.29899999999999999,"5min":0.223,"15min":0.223},"max":{"1min":6.718,"5min":7.2930000000000001,"15min":7.2930000000000001},"last":6.718}]},{"osd":2,"last update":"Mon Feb 19 21:40:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.415,"15min":0.83099999999999996},"min":{"1min":0.314,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":4.1689999999999996,"5min":7.1059999999999999,"15min":7.1059999999999999},"last":4.1689999999999996},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.831,"15min":0.96899999999999997},"min":{"1min":0.32000000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":5.2930000000000001,"5min":9.7010000000000005,"15min":9.7010000000000005},"last":5.2930000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:40:27 2024","interfaces":[{"interface":"back","average":{"1min":1.827,"5min":2.427,"15min":1.1719999999999999},"min":{"1min":0.35899999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":6.7729999999999997,"5min":31.559000000000001,"15min":31.559000000000001},"last":4.1440000000000001},{"interface":"front","average":{"1min":1.339,"5min":2.222,"15min":1.099},"min":{"1min":0.34899999999999998,"5min":0.34000000000000002,"15min":0.33800000000000002},"max":{"1min":5.6559999999999997,"5min":30.812999999999999,"15min":30.812999999999999},"last":5.3259999999999996}]},{"osd":4,"last update":"Mon Feb 19 21:40:27 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":0.75600000000000001,"15min":0.56200000000000006},"min":{"1min":0.373,"5min":0.247,"15min":0.247},"max":{"1min":6.7939999999999996,"5min":6.7939999999999996,"15min":6.7939999999999996},"last":6.7939999999999996},{"interface":"front","average":{"1min":1.329,"5min":0.86599999999999999,"15min":0.60799999999999998},"min":{"1min":0.33300000000000002,"5min":0.245,"15min":0.245},"max":{"1min":5.7560000000000002,"5min":5.7560000000000002,"15min":5.7560000000000002},"last":4.6070000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:40:27 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":0.96899999999999997,"15min":0.749},"min":{"1min":0.33100000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":5.2430000000000003,"5min":7.8209999999999997,"15min":7.8209999999999997},"last":5.2430000000000003},{"interface":"front","average":{"1min":1.8540000000000001,"5min":0.998,"15min":0.65800000000000003},"min":{"1min":0.438,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":10.175000000000001,"5min":10.175000000000001,"15min":10.175000000000001},"last":6.7430000000000003}]},{"osd":6,"last update":"Mon Feb 19 21:40:27 2024","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":0.85799999999999998,"15min":0.63800000000000001},"min":{"1min":0.40500000000000003,"5min":0.317,"15min":0.30299999999999999},"max":{"1min":6.7699999999999996,"5min":6.7699999999999996,"15min":6.7699999999999996},"last":6.7699999999999996},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.006,"15min":0.91900000000000004},"min":{"1min":0.34300000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":5.79,"5min":8.5099999999999998,"15min":8.8030000000000008},"last":4.2969999999999997}]}]},{"osd":6,"up_from":47,"seq":201863463019,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2097692,"kb_used_data":1784020,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":91647460,"statfs":{"total":95995035648,"available":93846999040,"internally_reserved":0,"allocated":1826836480,"data_stored":1826462560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":1.7070000000000001,"15min":0.89700000000000002},"min":{"1min":0.40300000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":2.6400000000000001,"5min":11.391999999999999,"15min":11.391999999999999},"last":2.9609999999999999},{"interface":"front","average":{"1min":1.099,"5min":1.8029999999999999,"15min":0.92200000000000004},"min":{"1min":0.32500000000000001,"5min":0.221,"15min":0.221},"max":{"1min":7.9470000000000001,"5min":13.973000000000001,"15min":13.973000000000001},"last":4.226}]},{"osd":1,"last update":"Mon Feb 19 21:40:02 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.627,"15min":0.878},"min":{"1min":0.34000000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":9.2699999999999996,"5min":12.574999999999999,"15min":12.574999999999999},"last":7.3979999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":1.5860000000000001,"15min":0.84599999999999997},"min":{"1min":0.34399999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":2.1880000000000002,"5min":11.19,"15min":11.19},"last":0.51200000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":1.524,"15min":0.84399999999999997},"min":{"1min":0.29999999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.4730000000000001,"5min":8.3849999999999998,"15min":8.3849999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":1.5620000000000001,"15min":0.84099999999999997},"min":{"1min":0.34599999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.7189999999999999,"5min":18.068000000000001,"15min":18.068000000000001},"last":2.9199999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":1.6519999999999999,"15min":0.89200000000000002},"min":{"1min":0.30099999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":2.3439999999999999,"5min":11.15,"15min":11.15},"last":10.630000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":1.883,"15min":0.95599999999999996},"min":{"1min":0.38200000000000001,"5min":0.246,"15min":0.246},"max":{"1min":1.4330000000000001,"5min":19.632999999999999,"15min":19.632999999999999},"last":0.53900000000000003}]},{"osd":4,"last update":"Mon Feb 19 21:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.82199999999999995,"15min":0.53700000000000003},"min":{"1min":0.26000000000000001,"5min":0.248,"15min":0.248},"max":{"1min":4.0090000000000003,"5min":4.8520000000000003,"15min":4.8520000000000003},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.91000000000000003,"15min":0.57999999999999996},"min":{"1min":0.27300000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.5580000000000001,"5min":16.594999999999999,"15min":16.594999999999999},"last":0.77800000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.81399999999999995,"15min":0.55600000000000005},"min":{"1min":0.29799999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.6880000000000002,"5min":5.6379999999999999,"15min":5.6379999999999999},"last":4.2640000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":1.006,"15min":0.61599999999999999},"min":{"1min":0.37,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.6830000000000001,"5min":11.039,"15min":11.039},"last":2.0790000000000002}]},{"osd":7,"last update":"Mon Feb 19 21:40:29 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.0429999999999999,"15min":0.67900000000000005},"min":{"1min":0.307,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":4.4950000000000001,"5min":11.069000000000001,"15min":11.069000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":1.244,"5min":1.1140000000000001,"15min":0.745},"min":{"1min":0.443,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":4.516,"5min":11.095000000000001,"15min":11.095000000000001},"last":0.62}]}]},{"osd":1,"up_from":13,"seq":55834574981,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2072884,"kb_used_data":1771564,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":91672268,"statfs":{"total":95995035648,"available":93872402432,"internally_reserved":0,"allocated":1814081536,"data_stored":1813684570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:39:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":2.5779999999999998,"15min":1.087},"min":{"1min":0.191,"5min":0.184,"15min":0.184},"max":{"1min":11.305,"5min":42.776000000000003,"15min":42.776000000000003},"last":0.17899999999999999},{"interface":"front","average":{"1min":1.5129999999999999,"5min":2.391,"15min":1.0269999999999999},"min":{"1min":0.22,"5min":0.185,"15min":0.185},"max":{"1min":11.92,"5min":44.845999999999997,"15min":44.845999999999997},"last":0.26000000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:40:25 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":2.2429999999999999,"15min":0.98699999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":3.3860000000000001,"5min":11.826000000000001,"15min":11.826000000000001},"last":0.247},{"interface":"front","average":{"1min":0.76100000000000001,"5min":2.4860000000000002,"15min":1.087},"min":{"1min":0.254,"5min":0.215,"15min":0.215},"max":{"1min":4.1200000000000001,"5min":12.26,"15min":12.26},"last":0.32600000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:39:53 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":2.6440000000000001,"15min":1.165},"min":{"1min":0.26600000000000001,"5min":0.254,"15min":0.24399999999999999},"max":{"1min":7.7789999999999999,"5min":41.607999999999997,"15min":41.607999999999997},"last":0.29699999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":2.1699999999999999,"15min":1.004},"min":{"1min":0.22500000000000001,"5min":0.217,"15min":0.217},"max":{"1min":11.204000000000001,"5min":42.811999999999998,"15min":42.811999999999998},"last":0.27700000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:40:16 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":1.2649999999999999,"15min":0.82499999999999996},"min":{"1min":0.36099999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":2.6320000000000001,"5min":11.23,"15min":11.23},"last":2.7090000000000001},{"interface":"front","average":{"1min":0.88800000000000001,"5min":1.6060000000000001,"15min":0.94099999999999995},"min":{"1min":0.36699999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":3.2650000000000001,"5min":10.51,"15min":10.51},"last":2.7250000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:39:40 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":1.4430000000000001,"15min":0.85999999999999999},"min":{"1min":0.38600000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":2.0259999999999998,"5min":10.458,"15min":10.458},"last":1.976},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.427,"15min":0.872},"min":{"1min":0.32900000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":6.7320000000000002,"5min":7.6950000000000003,"15min":7.6950000000000003},"last":2.1930000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":1.3899999999999999,"15min":0.86299999999999999},"min":{"1min":0.38300000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":3.4820000000000002,"5min":11.254,"15min":11.254},"last":1.7809999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":1.4690000000000001,"15min":0.89800000000000002},"min":{"1min":0.40799999999999997,"5min":0.316,"15min":0.316},"max":{"1min":2.8159999999999998,"5min":7.7389999999999999,"15min":7.7389999999999999},"last":1.8280000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:39:30 2024","interfaces":[{"interface":"back","average":{"1min":1.853,"5min":1.764,"15min":0.97199999999999998},"min":{"1min":0.40899999999999997,"5min":0.376,"15min":0.376},"max":{"1min":6.7610000000000001,"5min":10.638999999999999,"15min":10.638999999999999},"last":1.448},{"interface":"front","average":{"1min":1.7210000000000001,"5min":1.369,"15min":0.86099999999999999},"min":{"1min":0.41899999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":11.276,"5min":11.276,"15min":11.276},"last":1.425}]}]},{"osd":0,"up_from":8,"seq":34359738506,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1884108,"kb_used_data":1586884,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":91861044,"statfs":{"total":95995035648,"available":94065709056,"internally_reserved":0,"allocated":1624969216,"data_stored":1624596274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:39:56 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":1.667,"15min":0.76700000000000002},"min":{"1min":0.222,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":4.5519999999999996,"5min":15.381,"15min":15.381},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":2.234,"15min":0.97099999999999997},"min":{"1min":0.27700000000000002,"5min":0.188,"15min":0.188},"max":{"1min":3.988,"5min":13.422000000000001,"15min":13.422000000000001},"last":1.3360000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:39:28 2024","interfaces":[{"interface":"back","average":{"1min":2.6760000000000002,"5min":2.0979999999999999,"15min":0.95199999999999996},"min":{"1min":0.254,"5min":0.245,"15min":0.23999999999999999},"max":{"1min":13.638999999999999,"5min":13.638999999999999,"15min":13.638999999999999},"last":0.316},{"interface":"front","average":{"1min":2.444,"5min":2.3410000000000002,"15min":1.04},"min":{"1min":0.21199999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":8.4019999999999992,"5min":12.154999999999999,"15min":12.154999999999999},"last":1.306}]},{"osd":3,"last update":"Mon Feb 19 21:39:41 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":2.552,"15min":1.1220000000000001},"min":{"1min":0.26500000000000001,"5min":0.217,"15min":0.217},"max":{"1min":3.3660000000000001,"5min":14.507999999999999,"15min":14.507999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.8700000000000001,"5min":2.6869999999999998,"15min":1.1910000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":7.9109999999999996,"5min":18.759,"15min":18.759},"last":0.48099999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:40:20 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":1.5840000000000001,"15min":0.92300000000000004},"min":{"1min":0.34200000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.4140000000000001,"5min":9.8140000000000001,"15min":9.8140000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":1.4770000000000001,"15min":0.89500000000000002},"min":{"1min":0.33200000000000002,"5min":0.255,"15min":0.255},"max":{"1min":2.2149999999999999,"5min":8.9450000000000003,"15min":8.9450000000000003},"last":0.35799999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:39:41 2024","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":2.1749999999999998,"15min":1.143},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":5.548,"5min":42.799999999999997,"15min":42.799999999999997},"last":2.6779999999999999},{"interface":"front","average":{"1min":1.5940000000000001,"5min":2.0150000000000001,"15min":1.0920000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":5.9850000000000003,"5min":42.695,"15min":42.695},"last":0.53800000000000003}]},{"osd":6,"last update":"Mon Feb 19 21:40:01 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":1.871,"15min":1.044},"min":{"1min":0.39500000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":2.859,"5min":42.777000000000001,"15min":42.777000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.129,"5min":1.8839999999999999,"15min":1.03},"min":{"1min":0.35399999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":6.5439999999999996,"5min":9.7629999999999999,"15min":9.7629999999999999},"last":2.7160000000000002}]},{"osd":7,"last update":"Mon Feb 19 21:39:28 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.8200000000000001,"15min":1.0149999999999999},"min":{"1min":0.33700000000000002,"5min":0.31,"15min":0.31},"max":{"1min":4.4770000000000003,"5min":42.758000000000003,"15min":42.758000000000003},"last":0.59899999999999998},{"interface":"front","average":{"1min":1.8400000000000001,"5min":1.8939999999999999,"15min":1.0640000000000001},"min":{"1min":0.45200000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":7.9580000000000002,"5min":42.718000000000004,"15min":42.718000000000004},"last":0.622}]}]},{"osd":2,"up_from":0,"seq":77309411456,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":26,"seq":111669149819,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1562856,"kb_used_data":1265632,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":92182296,"statfs":{"total":95995035648,"available":94394671104,"internally_reserved":0,"allocated":1296007168,"data_stored":1295685084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:39:55 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":2.0129999999999999,"15min":0.94099999999999995},"min":{"1min":0.19,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":3.2200000000000002,"5min":17.992000000000001,"15min":17.992000000000001},"last":4.1689999999999996},{"interface":"front","average":{"1min":1.0760000000000001,"5min":3.085,"15min":1.3160000000000001},"min":{"1min":0.23100000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":5.327,"5min":46.654000000000003,"15min":46.654000000000003},"last":0.216}]},{"osd":1,"last update":"Mon Feb 19 21:39:55 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.6200000000000001,"15min":0.79800000000000004},"min":{"1min":0.20100000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":9.6289999999999996,"5min":9.9700000000000006,"15min":9.9700000000000006},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.83199999999999996,"5min":2.2330000000000001,"15min":1.0229999999999999},"min":{"1min":0.222,"5min":0.185,"15min":0.185},"max":{"1min":3.7330000000000001,"5min":13.135999999999999,"15min":13.135999999999999},"last":1.8819999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:39:55 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":2.0899999999999999,"15min":0.99099999999999999},"min":{"1min":0.253,"5min":0.224,"15min":0.224},"max":{"1min":6.7030000000000003,"5min":11.175000000000001,"15min":11.175000000000001},"last":6.5259999999999998},{"interface":"front","average":{"1min":0.88700000000000001,"5min":2.8849999999999998,"15min":1.242},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":5.3490000000000002,"5min":45.831000000000003,"15min":45.831000000000003},"last":0.495}]},{"osd":4,"last update":"Mon Feb 19 21:40:16 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":1.339,"15min":0.82799999999999996},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":2.1509999999999998,"5min":5.8920000000000003,"15min":5.8920000000000003},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.88900000000000001,"5min":1.7629999999999999,"15min":0.97199999999999998},"min":{"1min":0.38200000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":2.7749999999999999,"5min":11.093,"15min":11.093},"last":1.9370000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:39:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.2589999999999999,"15min":0.79700000000000004},"min":{"1min":0.29199999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":4.4690000000000003,"5min":5.577,"15min":5.577},"last":0.32800000000000001},{"interface":"front","average":{"1min":1.7629999999999999,"5min":1.776,"15min":0.97499999999999998},"min":{"1min":0.307,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":4.4720000000000004,"5min":11.128,"15min":11.128},"last":2.9340000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:40:03 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":1.4470000000000001,"15min":0.85999999999999999},"min":{"1min":0.32200000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":4.8250000000000002,"5min":17.443999999999999,"15min":17.443999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.9039999999999999,"15min":1.0269999999999999},"min":{"1min":0.36499999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":4.899,"5min":18.219000000000001,"15min":18.219000000000001},"last":1.9550000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:40:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":2.6190000000000002,"15min":1.2430000000000001},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":6.0439999999999996,"5min":45.777999999999999,"15min":45.777999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":1.4419999999999999,"15min":0.86599999999999999},"min":{"1min":0.377,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":3.4990000000000001,"5min":5.6040000000000001,"15min":5.6040000000000001},"last":0.35699999999999998}]}]},{"osd":4,"up_from":32,"seq":137438953588,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1865936,"kb_used_data":1556424,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":91879216,"statfs":{"total":95995035648,"available":94084317184,"internally_reserved":0,"allocated":1593778176,"data_stored":1593415889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:40:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":1.944,"15min":0.98899999999999999},"min":{"1min":0.27900000000000003,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":3.4649999999999999,"5min":40.664000000000001,"15min":40.664000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":1.0569999999999999,"5min":2.2610000000000001,"15min":1.1120000000000001},"min":{"1min":0.23999999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":4.9119999999999999,"5min":41.046999999999997,"15min":41.046999999999997},"last":0.31}]},{"osd":1,"last update":"Mon Feb 19 21:40:15 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":1.2410000000000001,"15min":0.76500000000000001},"min":{"1min":0.25,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":3.609,"5min":13.254,"15min":13.254},"last":0.63},{"interface":"front","average":{"1min":0.80900000000000005,"5min":1.3340000000000001,"15min":0.81699999999999995},"min":{"1min":0.311,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":4.2800000000000002,"5min":15.411,"15min":15.411},"last":0.26900000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:40:15 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.5089999999999999,"15min":0.86799999999999999},"min":{"1min":0.35299999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":7.2249999999999996,"5min":16.788,"15min":16.788},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":2.0739999999999998,"15min":1.0469999999999999},"min":{"1min":0.318,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":3.8679999999999999,"5min":20.995999999999999,"15min":20.995999999999999},"last":1.7969999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:40:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":1.6699999999999999,"15min":0.92300000000000004},"min":{"1min":0.32800000000000001,"5min":0.316,"15min":0.316},"max":{"1min":3.8370000000000002,"5min":15.914999999999999,"15min":15.914999999999999},"last":1.76},{"interface":"front","average":{"1min":0.79000000000000004,"5min":1.486,"15min":0.85599999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.4430000000000001,"5min":13.321,"15min":13.321},"last":0.57699999999999996}]},{"osd":5,"last update":"Mon Feb 19 21:39:49 2024","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":0.86799999999999999,"15min":0.55900000000000005},"min":{"1min":0.249,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.875,"5min":9.2289999999999992,"15min":9.2289999999999992},"last":0.33800000000000002},{"interface":"front","average":{"1min":1.581,"5min":0.84199999999999997,"15min":0.55900000000000005},"min":{"1min":0.27300000000000002,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":13.226000000000001,"5min":13.226000000000001,"15min":13.226000000000001},"last":1.831}]},{"osd":6,"last update":"Mon Feb 19 21:40:15 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.149,"15min":0.68300000000000005},"min":{"1min":0.31,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":6.6669999999999998,"5min":13.27,"15min":13.27},"last":1.907},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.82799999999999996,"15min":0.58999999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":4.367,"5min":6.2210000000000001,"15min":6.2210000000000001},"last":0.41399999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:39:26 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":0.73599999999999999,"15min":0.59199999999999997},"min":{"1min":0.40699999999999997,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":4.6749999999999998,"5min":4.6749999999999998,"15min":4.6749999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":2.4350000000000001,"5min":1.028,"15min":0.69199999999999995},"min":{"1min":0.41599999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":9.8900000000000006,"5min":9.8900000000000006,"15min":9.8900000000000006},"last":4.4589999999999996}]}]},{"osd":5,"up_from":38,"seq":163208757360,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2588548,"kb_used_data":2291324,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":91156604,"statfs":{"total":95995035648,"available":93344362496,"internally_reserved":0,"allocated":2346315776,"data_stored":2345966038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,0,0,0,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:39:39 2024","interfaces":[{"interface":"back","average":{"1min":1.607,"5min":1.6779999999999999,"15min":0.92200000000000004},"min":{"1min":0.34599999999999997,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":4.4279999999999999,"5min":20.550999999999998,"15min":20.550999999999998},"last":0.67600000000000005},{"interface":"front","average":{"1min":1.744,"5min":1.548,"15min":0.88800000000000001},"min":{"1min":0.35299999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":7.1360000000000001,"5min":20.879000000000001,"15min":20.879000000000001},"last":0.33300000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:39:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.226,"15min":0.77600000000000002},"min":{"1min":0.248,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":7.1580000000000004,"5min":8.5640000000000001,"15min":8.5640000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.6399999999999999,"15min":0.89600000000000002},"min":{"1min":0.26500000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.0049999999999999,"5min":10.316000000000001,"15min":10.316000000000001},"last":0.57499999999999996}]},{"osd":2,"last update":"Mon Feb 19 21:39:39 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.7949999999999999,"15min":0.95799999999999996},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":8.1189999999999998,"5min":20.186,"15min":20.186},"last":0.72899999999999998},{"interface":"front","average":{"1min":1.8100000000000001,"5min":1.758,"15min":0.95199999999999996},"min":{"1min":0.33900000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":7.3109999999999999,"5min":20.175000000000001,"15min":20.175000000000001},"last":0.42299999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:39:39 2024","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.9630000000000001,"15min":1.0309999999999999},"min":{"1min":0.34000000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":5.085,"5min":20.146999999999998,"15min":20.146999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":1.6830000000000001,"5min":2.137,"15min":1.119},"min":{"1min":0.496,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":8.7710000000000008,"5min":20.120000000000001,"15min":20.120000000000001},"last":0.38}]},{"osd":4,"last update":"Mon Feb 19 21:39:39 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":0.69399999999999995,"15min":0.501},"min":{"1min":0.34599999999999997,"5min":0.24299999999999999,"15min":0.23999999999999999},"max":{"1min":5.0220000000000002,"5min":6.4610000000000003,"15min":6.4610000000000003},"last":0.59699999999999998},{"interface":"front","average":{"1min":1.3069999999999999,"5min":0.84199999999999997,"15min":0.55700000000000005},"min":{"1min":0.31900000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":5.3319999999999999,"5min":6.4740000000000002,"15min":6.4740000000000002},"last":5.8860000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:40:07 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.83199999999999996,"15min":0.57399999999999995},"min":{"1min":0.30499999999999999,"5min":0.221,"15min":0.221},"max":{"1min":1.528,"5min":8.4629999999999992,"15min":8.4629999999999992},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.61899999999999999,"5min":1.167,"15min":0.68500000000000005},"min":{"1min":0.28999999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":2.1549999999999998,"5min":13.362,"15min":13.362},"last":0.40200000000000002}]},{"osd":7,"last update":"Mon Feb 19 21:39:34 2024","interfaces":[{"interface":"back","average":{"1min":2.403,"5min":1.054,"15min":0.72199999999999998},"min":{"1min":0.44900000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":8.5410000000000004,"5min":8.5410000000000004,"15min":8.5410000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":2.1520000000000001,"5min":1.018,"15min":0.68700000000000006},"min":{"1min":0.313,"5min":0.312,"15min":0.29099999999999998},"max":{"1min":17.759,"5min":17.759,"15min":17.759},"last":0.53600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1653276672,"data_stored":1653276672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1838678016,"data_stored":1838678016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1310326784,"data_stored":1310326784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1595015168,"data_stored":1595015168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2355167232,"data_stored":2355167232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1843593216,"data_stored":1843593216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1853358080,"data_stored":1853358080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:40:32.116 INFO:tasks.thrashosds.thrasher:Setting 4.8 to [3, 6, 7, 5, 2, 1] 2024-02-19T21:40:32.116 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.8', '3', '6', '7', '5', '2', '1'] 2024-02-19T21:40:32.116 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pg-upmap-items 4.8 3 6 7 5 2 1 2024-02-19T21:40:32.312 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:30.690711+0000 osd.5 (osd.5) 151 : cluster [DBG] 3.2 scrub starts 2024-02-19T21:40:32.312 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:30.692376+0000 osd.5 (osd.5) 152 : cluster [DBG] 3.2 scrub ok 2024-02-19T21:40:32.312 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:30.966699+0000 mgr.y (mgr.14514) 309 : cluster [DBG] pgmap v342: 148 pgs: 1 active+clean+scrubbing+deep, 147 active+clean; 3.9 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 1.6 KiB/s rd, 140 MiB/s wr, 2.25k op/s 2024-02-19T21:40:32.312 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:31.033802+0000 mon.a (mon.0) 1024 : cluster [DBG] osdmap e181: 8 total, 8 up, 7 in 2024-02-19T21:40:32.955 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 36 16 68098 68082 118.181 77.75 0.0209726 0.00845752 2024-02-19T21:40:33.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:31.872065+0000 osd.7 (osd.7) 143 : cluster [DBG] 6.15 scrub starts 2024-02-19T21:40:33.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:31.891960+0000 osd.7 (osd.7) 144 : cluster [DBG] 6.15 scrub ok 2024-02-19T21:40:33.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:31.872065+0000 osd.7 (osd.7) 143 : cluster [DBG] 6.15 scrub starts 2024-02-19T21:40:33.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:31.891960+0000 osd.7 (osd.7) 144 : cluster [DBG] 6.15 scrub ok 2024-02-19T21:40:33.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:31.872065+0000 osd.7 (osd.7) 143 : cluster [DBG] 6.15 scrub starts 2024-02-19T21:40:33.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:31.891960+0000 osd.7 (osd.7) 144 : cluster [DBG] 6.15 scrub ok 2024-02-19T21:40:33.768 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:40:33.768 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:40:33.792 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:40:33.818 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:40:33.851 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:40:33.891 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:40:33.924 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:40:33.955 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 37 16 69338 69322 117.081 77.5 0.00790045 0.00853614 2024-02-19T21:40:33.961 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:40:33.990 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:40:33.991 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:40:33.991 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:40:33.991 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:40:33.991 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:40:33.991 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:40:33.991 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:40:33.991 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:40:34.016 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:32.260111+0000 osd.1 (osd.1) 141 : cluster [DBG] 6.1d scrub starts 2024-02-19T21:40:34.016 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:32.280700+0000 osd.1 (osd.1) 142 : cluster [DBG] 6.1d scrub ok 2024-02-19T21:40:34.016 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:32.494061+0000 osd.6 (osd.6) 130 : cluster [DBG] 2.7 scrub starts 2024-02-19T21:40:34.016 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:32.498426+0000 osd.6 (osd.6) 131 : cluster [DBG] 2.7 scrub ok 2024-02-19T21:40:34.016 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:32.671975+0000 osd.5 (osd.5) 153 : cluster [DBG] 5.15 deep-scrub starts 2024-02-19T21:40:34.016 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:32.678924+0000 osd.5 (osd.5) 154 : cluster [DBG] 5.15 deep-scrub ok 2024-02-19T21:40:34.016 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:32.856646+0000 osd.7 (osd.7) 145 : cluster [DBG] 2.b scrub starts 2024-02-19T21:40:34.016 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:32.869457+0000 osd.7 (osd.7) 146 : cluster [DBG] 2.b scrub ok 2024-02-19T21:40:34.016 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:32.967074+0000 mgr.y (mgr.14514) 310 : cluster [DBG] pgmap v344: 148 pgs: 1 active+clean+scrubbing+deep, 147 active+clean; 3.9 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 643 B/s rd, 64 MiB/s wr, 1.02k op/s 2024-02-19T21:40:34.016 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:33.688031+0000 mon.c (mon.2) 44 : audit [DBG] from='client.? 172.21.15.80:0/3297854019' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:40:34.017 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:32.260111+0000 osd.1 (osd.1) 141 : cluster [DBG] 6.1d scrub starts 2024-02-19T21:40:34.017 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:32.280700+0000 osd.1 (osd.1) 142 : cluster [DBG] 6.1d scrub ok 2024-02-19T21:40:34.017 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:32.494061+0000 osd.6 (osd.6) 130 : cluster [DBG] 2.7 scrub starts 2024-02-19T21:40:34.017 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:32.498426+0000 osd.6 (osd.6) 131 : cluster [DBG] 2.7 scrub ok 2024-02-19T21:40:34.017 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:32.671975+0000 osd.5 (osd.5) 153 : cluster [DBG] 5.15 deep-scrub starts 2024-02-19T21:40:34.017 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:32.678924+0000 osd.5 (osd.5) 154 : cluster [DBG] 5.15 deep-scrub ok 2024-02-19T21:40:34.017 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:32.856646+0000 osd.7 (osd.7) 145 : cluster [DBG] 2.b scrub starts 2024-02-19T21:40:34.017 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:32.869457+0000 osd.7 (osd.7) 146 : cluster [DBG] 2.b scrub ok 2024-02-19T21:40:34.017 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:32.967074+0000 mgr.y (mgr.14514) 310 : cluster [DBG] pgmap v344: 148 pgs: 1 active+clean+scrubbing+deep, 147 active+clean; 3.9 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 643 B/s rd, 64 MiB/s wr, 1.02k op/s 2024-02-19T21:40:34.017 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:33.688031+0000 mon.c (mon.2) 44 : audit [DBG] from='client.? 172.21.15.80:0/3297854019' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:40:34.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:32.260111+0000 osd.1 (osd.1) 141 : cluster [DBG] 6.1d scrub starts 2024-02-19T21:40:34.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:32.280700+0000 osd.1 (osd.1) 142 : cluster [DBG] 6.1d scrub ok 2024-02-19T21:40:34.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:32.494061+0000 osd.6 (osd.6) 130 : cluster [DBG] 2.7 scrub starts 2024-02-19T21:40:34.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:32.498426+0000 osd.6 (osd.6) 131 : cluster [DBG] 2.7 scrub ok 2024-02-19T21:40:34.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:32.671975+0000 osd.5 (osd.5) 153 : cluster [DBG] 5.15 deep-scrub starts 2024-02-19T21:40:34.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:32.678924+0000 osd.5 (osd.5) 154 : cluster [DBG] 5.15 deep-scrub ok 2024-02-19T21:40:34.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:32.856646+0000 osd.7 (osd.7) 145 : cluster [DBG] 2.b scrub starts 2024-02-19T21:40:34.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:32.869457+0000 osd.7 (osd.7) 146 : cluster [DBG] 2.b scrub ok 2024-02-19T21:40:34.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:32.967074+0000 mgr.y (mgr.14514) 310 : cluster [DBG] pgmap v344: 148 pgs: 1 active+clean+scrubbing+deep, 147 active+clean; 3.9 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 643 B/s rd, 64 MiB/s wr, 1.02k op/s 2024-02-19T21:40:34.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:33.688031+0000 mon.c (mon.2) 44 : audit [DBG] from='client.? 172.21.15.80:0/3297854019' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:40:34.869 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:40:34.874 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:34.875 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:40:34.957 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 38 16 70589 70573 116.053 78.1875 0.0121533 0.00861237 2024-02-19T21:40:34.975 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:40:35.017 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:35.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:33.512297+0000 osd.6 (osd.6) 132 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:40:35.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:33.515181+0000 osd.6 (osd.6) 133 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:40:35.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:33.531317+0000 osd.0 (osd.0) 155 : cluster [DBG] 2.13 scrub starts 2024-02-19T21:40:35.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:33.532347+0000 osd.0 (osd.0) 156 : cluster [DBG] 2.13 scrub ok 2024-02-19T21:40:35.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:33.714773+0000 osd.5 (osd.5) 155 : cluster [DBG] 6.7 scrub starts 2024-02-19T21:40:35.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:33.758118+0000 osd.5 (osd.5) 156 : cluster [DBG] 6.7 scrub ok 2024-02-19T21:40:35.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:33.957059+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:40:35.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:33.512297+0000 osd.6 (osd.6) 132 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:40:35.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:33.515181+0000 osd.6 (osd.6) 133 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:40:35.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:33.531317+0000 osd.0 (osd.0) 155 : cluster [DBG] 2.13 scrub starts 2024-02-19T21:40:35.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:33.532347+0000 osd.0 (osd.0) 156 : cluster [DBG] 2.13 scrub ok 2024-02-19T21:40:35.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:33.714773+0000 osd.5 (osd.5) 155 : cluster [DBG] 6.7 scrub starts 2024-02-19T21:40:35.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:33.758118+0000 osd.5 (osd.5) 156 : cluster [DBG] 6.7 scrub ok 2024-02-19T21:40:35.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:33.957059+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:40:35.160 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:40:35.164 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:35.164 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:40:35.265 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:40:35.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:33.512297+0000 osd.6 (osd.6) 132 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:40:35.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:33.515181+0000 osd.6 (osd.6) 133 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:40:35.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:33.531317+0000 osd.0 (osd.0) 155 : cluster [DBG] 2.13 scrub starts 2024-02-19T21:40:35.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:33.532347+0000 osd.0 (osd.0) 156 : cluster [DBG] 2.13 scrub ok 2024-02-19T21:40:35.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:33.714773+0000 osd.5 (osd.5) 155 : cluster [DBG] 6.7 scrub starts 2024-02-19T21:40:35.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:33.758118+0000 osd.5 (osd.5) 156 : cluster [DBG] 6.7 scrub ok 2024-02-19T21:40:35.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:33.957059+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:40:35.315 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:35.349 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:40:35.351 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:35.352 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:40:35.453 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:40:35.475 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:40:35.510 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:35.560 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:40:35.567 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:35.567 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:40:35.668 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:40:35.716 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:35.957 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 39 16 71795 71779 115.01 75.375 0.0163512 0.00869048 2024-02-19T21:40:35.983 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:40:35.991 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:35.992 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:40:36.018 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:34.282550+0000 osd.1 (osd.1) 143 : cluster [DBG] 5.17 scrub starts 2024-02-19T21:40:36.018 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:34.284783+0000 osd.1 (osd.1) 144 : cluster [DBG] 5.17 scrub ok 2024-02-19T21:40:36.018 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:34.881135+0000 osd.7 (osd.7) 147 : cluster [DBG] 2.1d scrub starts 2024-02-19T21:40:36.018 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:34.884775+0000 osd.7 (osd.7) 148 : cluster [DBG] 2.1d scrub ok 2024-02-19T21:40:36.018 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:34.967674+0000 mgr.y (mgr.14514) 311 : cluster [DBG] pgmap v345: 148 pgs: 148 active+clean; 4.2 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1.2 KiB/s rd, 86 MiB/s wr, 1.38k op/s 2024-02-19T21:40:36.018 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:35.011372+0000 mon.a (mon.0) 1026 : cluster [DBG] osdmap e182: 8 total, 8 up, 7 in 2024-02-19T21:40:36.018 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:35.496047+0000 osd.3 (osd.3) 157 : cluster [DBG] 6.b scrub starts 2024-02-19T21:40:36.018 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:35.539212+0000 osd.3 (osd.3) 158 : cluster [DBG] 6.b scrub ok 2024-02-19T21:40:36.019 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:40:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:40:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:40:36.093 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:40:36.136 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:36.203 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:40:36.206 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:36.207 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:40:36.308 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:40:36.352 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:34.282550+0000 osd.1 (osd.1) 143 : cluster [DBG] 5.17 scrub starts 2024-02-19T21:40:36.352 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:34.284783+0000 osd.1 (osd.1) 144 : cluster [DBG] 5.17 scrub ok 2024-02-19T21:40:36.353 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:34.881135+0000 osd.7 (osd.7) 147 : cluster [DBG] 2.1d scrub starts 2024-02-19T21:40:36.353 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:34.884775+0000 osd.7 (osd.7) 148 : cluster [DBG] 2.1d scrub ok 2024-02-19T21:40:36.353 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:34.967674+0000 mgr.y (mgr.14514) 311 : cluster [DBG] pgmap v345: 148 pgs: 148 active+clean; 4.2 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1.2 KiB/s rd, 86 MiB/s wr, 1.38k op/s 2024-02-19T21:40:36.353 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:35.011372+0000 mon.a (mon.0) 1026 : cluster [DBG] osdmap e182: 8 total, 8 up, 7 in 2024-02-19T21:40:36.353 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:35.496047+0000 osd.3 (osd.3) 157 : cluster [DBG] 6.b scrub starts 2024-02-19T21:40:36.353 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:35.539212+0000 osd.3 (osd.3) 158 : cluster [DBG] 6.b scrub ok 2024-02-19T21:40:36.353 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:34.282550+0000 osd.1 (osd.1) 143 : cluster [DBG] 5.17 scrub starts 2024-02-19T21:40:36.353 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:34.284783+0000 osd.1 (osd.1) 144 : cluster [DBG] 5.17 scrub ok 2024-02-19T21:40:36.353 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:34.881135+0000 osd.7 (osd.7) 147 : cluster [DBG] 2.1d scrub starts 2024-02-19T21:40:36.353 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:34.884775+0000 osd.7 (osd.7) 148 : cluster [DBG] 2.1d scrub ok 2024-02-19T21:40:36.353 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:34.967674+0000 mgr.y (mgr.14514) 311 : cluster [DBG] pgmap v345: 148 pgs: 148 active+clean; 4.2 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1.2 KiB/s rd, 86 MiB/s wr, 1.38k op/s 2024-02-19T21:40:36.353 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:35.011372+0000 mon.a (mon.0) 1026 : cluster [DBG] osdmap e182: 8 total, 8 up, 7 in 2024-02-19T21:40:36.354 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:35.496047+0000 osd.3 (osd.3) 157 : cluster [DBG] 6.b scrub starts 2024-02-19T21:40:36.354 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:35.539212+0000 osd.3 (osd.3) 158 : cluster [DBG] 6.b scrub ok 2024-02-19T21:40:36.358 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:36.383 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:40:36.383 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:40:36.832 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:40:36.836 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:36.837 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:40:36.937 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:40:36.957 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:2024-02-19T21:40:36.957735+0000 min lat: 0.00129851 max lat: 0.0968115 avg lat: 0.00876469 2024-02-19T21:40:36.957 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-19T21:40:36.957 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 40 16 73013 72997 114.038 76.125 0.014852 0.00876469 2024-02-19T21:40:37.003 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:37.029 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:40:37.036 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:37.037 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:40:37.138 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:40:37.206 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:37.235 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:40:37.237 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:37.238 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:40:37.338 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:40:37.395 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:37.658 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:40:37.670 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:37.671 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:40:37.673 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.3 dump_historic_ops 2024-02-19T21:40:37.772 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:40:37.821 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:37.941 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:40:37.945 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:37.945 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:40:37.957 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 41 16 74201 74185 113.068 74.25 0.0105038 0.00883975 2024-02-19T21:40:38.014 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:40:38.046 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:40:38.088 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:38.122 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:40:38.128 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:38.128 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:40:38.229 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:40:38.281 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:36.275817+0000 osd.1 (osd.1) 145 : cluster [DBG] 4.1c deep-scrub starts 2024-02-19T21:40:38.281 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:36.287042+0000 osd.1 (osd.1) 146 : cluster [DBG] 4.1c deep-scrub ok 2024-02-19T21:40:38.281 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:36.870001+0000 osd.7 (osd.7) 149 : cluster [DBG] 6.8 scrub starts 2024-02-19T21:40:38.281 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:36.890193+0000 osd.7 (osd.7) 150 : cluster [DBG] 6.8 scrub ok 2024-02-19T21:40:38.281 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:36.968150+0000 mgr.y (mgr.14514) 312 : cluster [DBG] pgmap v347: 148 pgs: 148 active+clean; 4.3 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 735 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-19T21:40:38.281 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:37.716841+0000 osd.5 (osd.5) 157 : cluster [DBG] 4.15 deep-scrub starts 2024-02-19T21:40:38.281 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:37.730188+0000 osd.5 (osd.5) 158 : cluster [DBG] 4.15 deep-scrub ok 2024-02-19T21:40:38.282 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:36.275817+0000 osd.1 (osd.1) 145 : cluster [DBG] 4.1c deep-scrub starts 2024-02-19T21:40:38.282 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:36.287042+0000 osd.1 (osd.1) 146 : cluster [DBG] 4.1c deep-scrub ok 2024-02-19T21:40:38.282 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:36.870001+0000 osd.7 (osd.7) 149 : cluster [DBG] 6.8 scrub starts 2024-02-19T21:40:38.282 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:36.890193+0000 osd.7 (osd.7) 150 : cluster [DBG] 6.8 scrub ok 2024-02-19T21:40:38.282 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:36.968150+0000 mgr.y (mgr.14514) 312 : cluster [DBG] pgmap v347: 148 pgs: 148 active+clean; 4.3 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 735 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-19T21:40:38.282 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:37.716841+0000 osd.5 (osd.5) 157 : cluster [DBG] 4.15 deep-scrub starts 2024-02-19T21:40:38.282 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:37.730188+0000 osd.5 (osd.5) 158 : cluster [DBG] 4.15 deep-scrub ok 2024-02-19T21:40:38.284 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:38.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:36.275817+0000 osd.1 (osd.1) 145 : cluster [DBG] 4.1c deep-scrub starts 2024-02-19T21:40:38.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:36.287042+0000 osd.1 (osd.1) 146 : cluster [DBG] 4.1c deep-scrub ok 2024-02-19T21:40:38.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:36.870001+0000 osd.7 (osd.7) 149 : cluster [DBG] 6.8 scrub starts 2024-02-19T21:40:38.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:36.890193+0000 osd.7 (osd.7) 150 : cluster [DBG] 6.8 scrub ok 2024-02-19T21:40:38.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:36.968150+0000 mgr.y (mgr.14514) 312 : cluster [DBG] pgmap v347: 148 pgs: 148 active+clean; 4.3 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 735 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-19T21:40:38.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:37.716841+0000 osd.5 (osd.5) 157 : cluster [DBG] 4.15 deep-scrub starts 2024-02-19T21:40:38.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:37.730188+0000 osd.5 (osd.5) 158 : cluster [DBG] 4.15 deep-scrub ok 2024-02-19T21:40:38.322 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:40:38.325 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:38.326 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:40:38.329 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:40:38.427 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:40:38.468 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:38.957 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 42 16 75369 75353 112.114 73 0.0100539 0.00891495 2024-02-19T21:40:39.036 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:40:39.041 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:39.041 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:40:39.142 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:40:39.201 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:39.231 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:40:39.235 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:39.235 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:40:39.311 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:37.312622+0000 osd.1 (osd.1) 147 : cluster [DBG] 4.9 scrub starts 2024-02-19T21:40:39.311 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:37.318635+0000 osd.1 (osd.1) 148 : cluster [DBG] 4.9 scrub ok 2024-02-19T21:40:39.312 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:38.590597+0000 osd.6 (osd.6) 134 : cluster [DBG] 2.1a deep-scrub starts 2024-02-19T21:40:39.312 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:38.599932+0000 osd.6 (osd.6) 135 : cluster [DBG] 2.1a deep-scrub ok 2024-02-19T21:40:39.336 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:40:39.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:37.312622+0000 osd.1 (osd.1) 147 : cluster [DBG] 4.9 scrub starts 2024-02-19T21:40:39.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:37.318635+0000 osd.1 (osd.1) 148 : cluster [DBG] 4.9 scrub ok 2024-02-19T21:40:39.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:38.590597+0000 osd.6 (osd.6) 134 : cluster [DBG] 2.1a deep-scrub starts 2024-02-19T21:40:39.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:38.599932+0000 osd.6 (osd.6) 135 : cluster [DBG] 2.1a deep-scrub ok 2024-02-19T21:40:39.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:37.312622+0000 osd.1 (osd.1) 147 : cluster [DBG] 4.9 scrub starts 2024-02-19T21:40:39.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:37.318635+0000 osd.1 (osd.1) 148 : cluster [DBG] 4.9 scrub ok 2024-02-19T21:40:39.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:38.590597+0000 osd.6 (osd.6) 134 : cluster [DBG] 2.1a deep-scrub starts 2024-02-19T21:40:39.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:38.599932+0000 osd.6 (osd.6) 135 : cluster [DBG] 2.1a deep-scrub ok 2024-02-19T21:40:39.375 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:39.532 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:40:39.536 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:39.536 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:40:39.637 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:40:39.696 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:39.738 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:40:39.743 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:39.743 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:40:39.844 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:40:39.900 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:39.942 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:40:39.945 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:39.946 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:40:39.957 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 43 16 76538 76522 111.205 73.0625 0.010599 0.00898744 2024-02-19T21:40:40.047 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:40:40.101 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:40.128 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:40:40.133 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:40.134 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:40:40.235 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:40:40.238 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:38.783731+0000 osd.4 (osd.4) 119 : cluster [DBG] 6.1e deep-scrub starts 2024-02-19T21:40:40.239 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:38.796490+0000 osd.4 (osd.4) 120 : cluster [DBG] 6.1e deep-scrub ok 2024-02-19T21:40:40.239 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:38.922136+0000 osd.7 (osd.7) 151 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:40:40.239 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:38.927464+0000 osd.7 (osd.7) 152 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:40:40.239 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:38.968532+0000 mgr.y (mgr.14514) 313 : cluster [DBG] pgmap v348: 148 pgs: 148 active+clean; 4.3 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 639 B/s rd, 49 MiB/s wr, 777 op/s 2024-02-19T21:40:40.239 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:39.576482+0000 osd.3 (osd.3) 159 : cluster [DBG] 4.14 deep-scrub starts 2024-02-19T21:40:40.239 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:39.591989+0000 osd.3 (osd.3) 160 : cluster [DBG] 4.14 deep-scrub ok 2024-02-19T21:40:40.239 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:39.702431+0000 osd.5 (osd.5) 159 : cluster [DBG] 2.3 scrub starts 2024-02-19T21:40:40.239 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:39.714975+0000 osd.5 (osd.5) 160 : cluster [DBG] 2.3 scrub ok 2024-02-19T21:40:40.310 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:40.343 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:40:40.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:38.783731+0000 osd.4 (osd.4) 119 : cluster [DBG] 6.1e deep-scrub starts 2024-02-19T21:40:40.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:38.796490+0000 osd.4 (osd.4) 120 : cluster [DBG] 6.1e deep-scrub ok 2024-02-19T21:40:40.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:38.922136+0000 osd.7 (osd.7) 151 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:40:40.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:38.927464+0000 osd.7 (osd.7) 152 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:40:40.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:38.968532+0000 mgr.y (mgr.14514) 313 : cluster [DBG] pgmap v348: 148 pgs: 148 active+clean; 4.3 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 639 B/s rd, 49 MiB/s wr, 777 op/s 2024-02-19T21:40:40.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:39.576482+0000 osd.3 (osd.3) 159 : cluster [DBG] 4.14 deep-scrub starts 2024-02-19T21:40:40.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:39.591989+0000 osd.3 (osd.3) 160 : cluster [DBG] 4.14 deep-scrub ok 2024-02-19T21:40:40.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:39.702431+0000 osd.5 (osd.5) 159 : cluster [DBG] 2.3 scrub starts 2024-02-19T21:40:40.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:39.714975+0000 osd.5 (osd.5) 160 : cluster [DBG] 2.3 scrub ok 2024-02-19T21:40:40.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:38.783731+0000 osd.4 (osd.4) 119 : cluster [DBG] 6.1e deep-scrub starts 2024-02-19T21:40:40.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:38.796490+0000 osd.4 (osd.4) 120 : cluster [DBG] 6.1e deep-scrub ok 2024-02-19T21:40:40.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:38.922136+0000 osd.7 (osd.7) 151 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:40:40.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:38.927464+0000 osd.7 (osd.7) 152 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:40:40.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:38.968532+0000 mgr.y (mgr.14514) 313 : cluster [DBG] pgmap v348: 148 pgs: 148 active+clean; 4.3 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 639 B/s rd, 49 MiB/s wr, 777 op/s 2024-02-19T21:40:40.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:39.576482+0000 osd.3 (osd.3) 159 : cluster [DBG] 4.14 deep-scrub starts 2024-02-19T21:40:40.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:39.591989+0000 osd.3 (osd.3) 160 : cluster [DBG] 4.14 deep-scrub ok 2024-02-19T21:40:40.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:39.702431+0000 osd.5 (osd.5) 159 : cluster [DBG] 2.3 scrub starts 2024-02-19T21:40:40.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:39.714975+0000 osd.5 (osd.5) 160 : cluster [DBG] 2.3 scrub ok 2024-02-19T21:40:40.350 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:40.351 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:40:40.451 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:40:40.497 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:40.557 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:40:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:40:40.957 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 44 16 77718 77702 110.354 73.75 0.0123377 0.00905684 2024-02-19T21:40:41.054 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:40:41.061 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:41.062 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:40:41.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:40:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:40:40] "GET /metrics HTTP/1.1" 200 175810 "" "Prometheus/2.33.4" 2024-02-19T21:40:41.163 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:40:41.229 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:41.333 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:40:41.339 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:41.339 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:40.234596+0000 mgr.y (mgr.14514) 314 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:40:41.340 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:40.469795+0000 osd.0 (osd.0) 157 : cluster [DBG] 6.0 scrub starts 2024-02-19T21:40:41.340 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:40.474329+0000 osd.0 (osd.0) 158 : cluster [DBG] 6.0 scrub ok 2024-02-19T21:40:41.340 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:40.234596+0000 mgr.y (mgr.14514) 314 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:40:41.340 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:40.469795+0000 osd.0 (osd.0) 157 : cluster [DBG] 6.0 scrub starts 2024-02-19T21:40:41.340 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:40.474329+0000 osd.0 (osd.0) 158 : cluster [DBG] 6.0 scrub ok 2024-02-19T21:40:41.341 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:40:41.442 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:40:41.485 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:40.234596+0000 mgr.y (mgr.14514) 314 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:40:41.486 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:40.469795+0000 osd.0 (osd.0) 157 : cluster [DBG] 6.0 scrub starts 2024-02-19T21:40:41.486 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:40.474329+0000 osd.0 (osd.0) 158 : cluster [DBG] 6.0 scrub ok 2024-02-19T21:40:41.488 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:41.517 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:40:41.519 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:41.520 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:40:41.621 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:40:41.681 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:41.706 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:40:41.709 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:41.709 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:40:41.803 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:40:41.806 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:40:41.810 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:40:41.854 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:41.880 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:40:41.882 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:41.882 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:40:41.958 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 45 15 78839 78824 109.459 70.125 0.00847988 0.00913153 2024-02-19T21:40:41.983 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:40:42.026 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:42.104 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-02-19T21:40:42.134 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:40:42.137 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:42.138 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:40:42.238 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:40:42.317 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:42.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:40.793556+0000 osd.4 (osd.4) 121 : cluster [DBG] 5.a scrub starts 2024-02-19T21:40:42.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:40.799133+0000 osd.4 (osd.4) 122 : cluster [DBG] 5.a scrub ok 2024-02-19T21:40:42.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:40.969303+0000 mgr.y (mgr.14514) 315 : cluster [DBG] pgmap v349: 148 pgs: 148 active+clean; 4.7 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1.0 KiB/s rd, 77 MiB/s wr, 1.23k op/s 2024-02-19T21:40:42.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:41.527447+0000 mon.b (mon.1) 46 : audit [INF] from='client.? 172.21.15.80:0/3633297384' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:40:42.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:41.527979+0000 mon.a (mon.0) 1027 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:40:42.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:41.619368+0000 osd.3 (osd.3) 161 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:40:42.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:41.638816+0000 osd.3 (osd.3) 162 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:40:42.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:41.638866+0000 osd.3 (osd.3) 163 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:40:42.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:41.667279+0000 osd.3 (osd.3) 164 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:40:42.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:40.793556+0000 osd.4 (osd.4) 121 : cluster [DBG] 5.a scrub starts 2024-02-19T21:40:42.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:40.799133+0000 osd.4 (osd.4) 122 : cluster [DBG] 5.a scrub ok 2024-02-19T21:40:42.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:40.969303+0000 mgr.y (mgr.14514) 315 : cluster [DBG] pgmap v349: 148 pgs: 148 active+clean; 4.7 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1.0 KiB/s rd, 77 MiB/s wr, 1.23k op/s 2024-02-19T21:40:42.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:41.527447+0000 mon.b (mon.1) 46 : audit [INF] from='client.? 172.21.15.80:0/3633297384' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:40:42.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:41.527979+0000 mon.a (mon.0) 1027 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:40:42.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:41.619368+0000 osd.3 (osd.3) 161 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:40:42.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:41.638816+0000 osd.3 (osd.3) 162 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:40:42.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:41.638866+0000 osd.3 (osd.3) 163 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:40:42.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:41.667279+0000 osd.3 (osd.3) 164 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:40:42.350 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:40:42.358 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:42.358 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:40:42.359 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:40.793556+0000 osd.4 (osd.4) 121 : cluster [DBG] 5.a scrub starts 2024-02-19T21:40:42.359 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:40.799133+0000 osd.4 (osd.4) 122 : cluster [DBG] 5.a scrub ok 2024-02-19T21:40:42.359 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:40.969303+0000 mgr.y (mgr.14514) 315 : cluster [DBG] pgmap v349: 148 pgs: 148 active+clean; 4.7 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1.0 KiB/s rd, 77 MiB/s wr, 1.23k op/s 2024-02-19T21:40:42.359 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:41.527447+0000 mon.b (mon.1) 46 : audit [INF] from='client.? 172.21.15.80:0/3633297384' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:40:42.359 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:41.527979+0000 mon.a (mon.0) 1027 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:40:42.359 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:41.619368+0000 osd.3 (osd.3) 161 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:40:42.359 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:41.638816+0000 osd.3 (osd.3) 162 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:40:42.359 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:41.638866+0000 osd.3 (osd.3) 163 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:40:42.359 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:41.667279+0000 osd.3 (osd.3) 164 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:40:42.459 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:40:42.502 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:42.546 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:40:42.554 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:42.554 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:40:42.655 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:40:42.694 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:42.958 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 46 16 80019 80003 108.682 73.6875 0.0158366 0.00919671 2024-02-19T21:40:43.053 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:40:43.057 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:43.057 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:40:43.138 INFO:teuthology.orchestra.run.smithi080.stderr:set 4.8 pg_upmap_items mapping to [3->6,7->5,2->1] 2024-02-19T21:40:43.158 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:40:43.198 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:43.324 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:41.888443+0000 osd.7 (osd.7) 153 : cluster [DBG] 2.8 scrub starts 2024-02-19T21:40:43.324 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:41.901663+0000 osd.7 (osd.7) 154 : cluster [DBG] 2.8 scrub ok 2024-02-19T21:40:43.324 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:42.075264+0000 mon.a (mon.0) 1028 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:40:43.324 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:42.089031+0000 mon.a (mon.0) 1029 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:40:43.324 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:42.089106+0000 mon.a (mon.0) 1030 : cluster [DBG] osdmap e183: 8 total, 8 up, 7 in 2024-02-19T21:40:43.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:42.136491+0000 mon.a (mon.0) 1031 : audit [INF] from='client.? 172.21.15.80:0/3165425537' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "4.8", "id": [3, 6, 7, 5, 2, 1]}]: dispatch 2024-02-19T21:40:43.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:42.309942+0000 osd.0 (osd.0) 159 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:40:43.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:42.309990+0000 osd.0 (osd.0) 160 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:40:43.325 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:41.888443+0000 osd.7 (osd.7) 153 : cluster [DBG] 2.8 scrub starts 2024-02-19T21:40:43.325 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:41.901663+0000 osd.7 (osd.7) 154 : cluster [DBG] 2.8 scrub ok 2024-02-19T21:40:43.325 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:42.075264+0000 mon.a (mon.0) 1028 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:40:43.325 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:42.089031+0000 mon.a (mon.0) 1029 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:40:43.325 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:42.089106+0000 mon.a (mon.0) 1030 : cluster [DBG] osdmap e183: 8 total, 8 up, 7 in 2024-02-19T21:40:43.325 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:42.136491+0000 mon.a (mon.0) 1031 : audit [INF] from='client.? 172.21.15.80:0/3165425537' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "4.8", "id": [3, 6, 7, 5, 2, 1]}]: dispatch 2024-02-19T21:40:43.325 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:42.309942+0000 osd.0 (osd.0) 159 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:40:43.325 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:42.309990+0000 osd.0 (osd.0) 160 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:40:43.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:41.888443+0000 osd.7 (osd.7) 153 : cluster [DBG] 2.8 scrub starts 2024-02-19T21:40:43.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:41.901663+0000 osd.7 (osd.7) 154 : cluster [DBG] 2.8 scrub ok 2024-02-19T21:40:43.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:42.075264+0000 mon.a (mon.0) 1028 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:40:43.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:42.089031+0000 mon.a (mon.0) 1029 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:40:43.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:42.089106+0000 mon.a (mon.0) 1030 : cluster [DBG] osdmap e183: 8 total, 8 up, 7 in 2024-02-19T21:40:43.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:42.136491+0000 mon.a (mon.0) 1031 : audit [INF] from='client.? 172.21.15.80:0/3165425537' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "4.8", "id": [3, 6, 7, 5, 2, 1]}]: dispatch 2024-02-19T21:40:43.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:42.309942+0000 osd.0 (osd.0) 159 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:40:43.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:42.309990+0000 osd.0 (osd.0) 160 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:40:43.958 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 47 16 81160 81144 107.886 71.3125 0.00614077 0.00926463 2024-02-19T21:40:44.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:42.969734+0000 mgr.y (mgr.14514) 316 : cluster [DBG] pgmap v351: 148 pgs: 148 active+clean; 4.7 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 639 B/s rd, 62 MiB/s wr, 991 op/s 2024-02-19T21:40:44.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:43.124273+0000 mon.a (mon.0) 1032 : audit [INF] from='client.? 172.21.15.80:0/3165425537' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "4.8", "id": [3, 6, 7, 5, 2, 1]}]': finished 2024-02-19T21:40:44.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:43.124319+0000 mon.a (mon.0) 1033 : cluster [DBG] osdmap e184: 8 total, 8 up, 7 in 2024-02-19T21:40:44.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:42.969734+0000 mgr.y (mgr.14514) 316 : cluster [DBG] pgmap v351: 148 pgs: 148 active+clean; 4.7 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 639 B/s rd, 62 MiB/s wr, 991 op/s 2024-02-19T21:40:44.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:43.124273+0000 mon.a (mon.0) 1032 : audit [INF] from='client.? 172.21.15.80:0/3165425537' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "4.8", "id": [3, 6, 7, 5, 2, 1]}]': finished 2024-02-19T21:40:44.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:43.124319+0000 mon.a (mon.0) 1033 : cluster [DBG] osdmap e184: 8 total, 8 up, 7 in 2024-02-19T21:40:44.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:42.969734+0000 mgr.y (mgr.14514) 316 : cluster [DBG] pgmap v351: 148 pgs: 148 active+clean; 4.7 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 639 B/s rd, 62 MiB/s wr, 991 op/s 2024-02-19T21:40:44.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:43.124273+0000 mon.a (mon.0) 1032 : audit [INF] from='client.? 172.21.15.80:0/3165425537' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "4.8", "id": [3, 6, 7, 5, 2, 1]}]': finished 2024-02-19T21:40:44.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:43.124319+0000 mon.a (mon.0) 1033 : cluster [DBG] osdmap e184: 8 total, 8 up, 7 in 2024-02-19T21:40:44.958 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 48 16 82374 82358 107.219 75.875 0.0170257 0.00932199 2024-02-19T21:40:45.056 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:40:45.059 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:45.060 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:40:45.069 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-19T21:40:45.161 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:40:45.190 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:45.220 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:40:45.224 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:45.225 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:40:45.325 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:40:45.368 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:45.958 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 49 16 83402 83386 106.342 64.25 0.0128864 0.00939958 2024-02-19T21:40:46.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:40:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:40:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:40:46.451 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:44.970407+0000 mgr.y (mgr.14514) 317 : cluster [DBG] pgmap v353: 148 pgs: 148 active+clean; 4.9 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 78 MiB/s wr, 1.24k op/s 2024-02-19T21:40:46.452 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:44.970407+0000 mgr.y (mgr.14514) 317 : cluster [DBG] pgmap v353: 148 pgs: 148 active+clean; 4.9 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 78 MiB/s wr, 1.24k op/s 2024-02-19T21:40:46.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:44.970407+0000 mgr.y (mgr.14514) 317 : cluster [DBG] pgmap v353: 148 pgs: 148 active+clean; 4.9 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 78 MiB/s wr, 1.24k op/s 2024-02-19T21:40:46.958 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 50 16 84615 84599 105.732 75.8125 0.00999943 0.00945355 2024-02-19T21:40:47.842 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:40:47.844 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:47.845 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:40:47.946 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:40:47.958 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 51 16 85811 85795 105.124 74.75 0.00914511 0.00950849 2024-02-19T21:40:47.993 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:48.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:46.970857+0000 mgr.y (mgr.14514) 318 : cluster [DBG] pgmap v354: 148 pgs: 148 active+clean; 5.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 92 MiB/s wr, 1.47k op/s 2024-02-19T21:40:48.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:46.970857+0000 mgr.y (mgr.14514) 318 : cluster [DBG] pgmap v354: 148 pgs: 148 active+clean; 5.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 92 MiB/s wr, 1.47k op/s 2024-02-19T21:40:48.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:46.970857+0000 mgr.y (mgr.14514) 318 : cluster [DBG] pgmap v354: 148 pgs: 148 active+clean; 5.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 92 MiB/s wr, 1.47k op/s 2024-02-19T21:40:48.960 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 52 15 86998 86983 104.526 74.25 0.0115532 0.00956237 2024-02-19T21:40:49.043 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:40:49.044 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:40:49.851 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:40:49.854 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:49.855 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:40:49.956 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:40:49.960 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 53 16 88195 88179 103.964 74.75 0.0176783 0.00961379 2024-02-19T21:40:50.026 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:50.073 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:40:50.077 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:50.077 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:40:50.170 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:48.959467+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:40:50.170 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:48.973139+0000 mgr.y (mgr.14514) 319 : cluster [DBG] pgmap v355: 148 pgs: 148 active+clean; 5.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 639 B/s rd, 45 MiB/s wr, 727 op/s 2024-02-19T21:40:50.170 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:48.959467+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:40:50.170 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:48.973139+0000 mgr.y (mgr.14514) 319 : cluster [DBG] pgmap v355: 148 pgs: 148 active+clean; 5.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 639 B/s rd, 45 MiB/s wr, 727 op/s 2024-02-19T21:40:50.178 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:40:50.249 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:48.959467+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:40:50.249 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:48.973139+0000 mgr.y (mgr.14514) 319 : cluster [DBG] pgmap v355: 148 pgs: 148 active+clean; 5.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 639 B/s rd, 45 MiB/s wr, 727 op/s 2024-02-19T21:40:50.251 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:50.280 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:40:50.286 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:50.286 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:40:50.387 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:40:50.446 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:50.558 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:40:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:40:50.710 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:40:50.714 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:50.714 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:40:50.815 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:40:50.871 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:50.904 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:40:50.909 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:50.909 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:40:50.960 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 54 16 89310 89294 103.33 69.6875 0.00760242 0.00967289 2024-02-19T21:40:51.010 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:40:51.040 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:40:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:40:50] "GET /metrics HTTP/1.1" 200 175835 "" "Prometheus/2.33.4" 2024-02-19T21:40:51.075 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:51.128 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:40:51.132 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:50.248372+0000 mgr.y (mgr.14514) 320 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:40:51.133 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:51.133 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:40:51.149 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.4 dump_ops_in_flight 2024-02-19T21:40:51.234 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:40:51.328 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:51.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:50.248372+0000 mgr.y (mgr.14514) 320 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:40:51.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:50.248372+0000 mgr.y (mgr.14514) 320 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:40:51.402 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:40:51.406 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:51.406 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:40:51.507 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:40:51.548 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:51.577 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:40:51.581 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:51.581 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:40:51.603 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:40:51.614 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:40:51.683 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:40:51.719 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:51.846 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:40:51.850 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:51.851 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:40:51.952 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:40:51.960 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 55 16 90374 90358 102.66 66.5 0.00530993 0.00973705 2024-02-19T21:40:52.017 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:52.047 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:40:52.057 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:52.058 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:40:52.122 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:50.973794+0000 mgr.y (mgr.14514) 321 : cluster [DBG] pgmap v356: 148 pgs: 148 active+clean; 5.4 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1.1 KiB/s rd, 82 MiB/s wr, 1.31k op/s 2024-02-19T21:40:52.122 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:51.992324+0000 mon.a (mon.0) 1035 : audit [DBG] from='client.? 172.21.15.80:0/2356918027' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:40:52.122 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:50.973794+0000 mgr.y (mgr.14514) 321 : cluster [DBG] pgmap v356: 148 pgs: 148 active+clean; 5.4 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1.1 KiB/s rd, 82 MiB/s wr, 1.31k op/s 2024-02-19T21:40:52.122 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:51.992324+0000 mon.a (mon.0) 1035 : audit [DBG] from='client.? 172.21.15.80:0/2356918027' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:40:52.159 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:40:52.231 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:50.973794+0000 mgr.y (mgr.14514) 321 : cluster [DBG] pgmap v356: 148 pgs: 148 active+clean; 5.4 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1.1 KiB/s rd, 82 MiB/s wr, 1.31k op/s 2024-02-19T21:40:52.231 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:51.992324+0000 mon.a (mon.0) 1035 : audit [DBG] from='client.? 172.21.15.80:0/2356918027' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:40:52.280 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:52.329 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:40:52.329 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:40:52.330 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:40:52.330 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:40:52.330 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:40:52.330 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:40:52.330 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:40:52.330 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:40:52.330 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:40:52.330 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:40:52.330 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:40:52.330 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:40:52.330 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:40:52.331 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:40:52.331 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:40:52.331 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:40:52.335 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:40:52.340 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:52.341 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:40:52.442 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:40:52.494 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:52.961 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 56 15 91512 91497 102.098 71.1875 0.0125401 0.00979 2024-02-19T21:40:53.574 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:40:53.578 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:53.579 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:40:53.680 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:40:53.746 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:53.831 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:40:53.835 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:53.836 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:40:53.936 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:40:53.961 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 57 16 92629 92613 101.53 69.75 0.0114334 0.00984512 2024-02-19T21:40:53.973 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:54.001 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:40:54.008 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:54.008 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:40:54.026 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:40:54.027 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [ 2024-02-19T21:40:54.027 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.027 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:92677 8.b 8:d1960cbd:::benchmark_data_smithi080_100924_object92676:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e184)", 2024-02-19T21:40:54.027 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:40:54.009741+0000", 2024-02-19T21:40:54.027 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.0093572529999999994, 2024-02-19T21:40:54.027 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0093900389999999993, 2024-02-19T21:40:54.027 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:40:54.027 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:40:54.027 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:40:54.027 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:40:54.027 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:40:54.027 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 92677 2024-02-19T21:40:54.027 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.028 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:40:54.028 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.028 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:40:54.028 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.009741+0000", 2024-02-19T21:40:54.028 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:40:54.028 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.028 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.028 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:40:54.028 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.009741+0000", 2024-02-19T21:40:54.028 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:40:54.028 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.028 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.028 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:40:54.028 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.009739+0000", 2024-02-19T21:40:54.029 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.9839000000000003e-05 2024-02-19T21:40:54.029 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.029 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.029 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:40:54.029 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.009779+0000", 2024-02-19T21:40:54.029 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.6869999999999999e-05 2024-02-19T21:40:54.029 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.029 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.029 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:40:54.029 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.009796+0000", 2024-02-19T21:40:54.029 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.651e-06 2024-02-19T21:40:54.029 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.029 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.029 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:40:54.029 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.009801+0000", 2024-02-19T21:40:54.030 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0048631220000000001 2024-02-19T21:40:54.030 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.030 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.030 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:40:54.030 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.014664+0000", 2024-02-19T21:40:54.030 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000109498 2024-02-19T21:40:54.030 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.030 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.030 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:40:54.030 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.014773+0000", 2024-02-19T21:40:54.030 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000145234 2024-02-19T21:40:54.030 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.030 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.030 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,7", 2024-02-19T21:40:54.030 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.014919+0000", 2024-02-19T21:40:54.031 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0051776820000000003 2024-02-19T21:40:54.031 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:40:54.031 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:40:54.031 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:40:54.031 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.031 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.031 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:92678 8.2 8:45ccaffa:::benchmark_data_smithi080_100924_object92677:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e184)", 2024-02-19T21:40:54.031 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:40:54.009812+0000", 2024-02-19T21:40:54.031 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.0092856740000000007, 2024-02-19T21:40:54.031 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0094060319999999999, 2024-02-19T21:40:54.031 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:40:54.031 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:40:54.031 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:40:54.032 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:40:54.032 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:40:54.032 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 92678 2024-02-19T21:40:54.032 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.032 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:40:54.032 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.032 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:40:54.032 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.009812+0000", 2024-02-19T21:40:54.032 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:40:54.032 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.032 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.032 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:40:54.032 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.009812+0000", 2024-02-19T21:40:54.032 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:40:54.033 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.033 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.033 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:40:54.033 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.009812+0000", 2024-02-19T21:40:54.033 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.4672999999999999e-05 2024-02-19T21:40:54.033 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.033 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.033 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:40:54.033 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.009837+0000", 2024-02-19T21:40:54.033 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.9280000000000001e-06 2024-02-19T21:40:54.033 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.033 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.033 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:40:54.034 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.009842+0000", 2024-02-19T21:40:54.034 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.7539999999999998e-06 2024-02-19T21:40:54.034 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.034 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.034 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:40:54.034 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.009844+0000", 2024-02-19T21:40:54.034 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.4529000000000001e-05 2024-02-19T21:40:54.034 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.034 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.035 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:40:54.035 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.009879+0000", 2024-02-19T21:40:54.035 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.9868000000000001e-05 2024-02-19T21:40:54.035 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.035 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.035 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:40:54.035 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.009969+0000", 2024-02-19T21:40:54.035 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00011346 2024-02-19T21:40:54.035 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.036 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.036 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:40:54.036 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.010082+0000", 2024-02-19T21:40:54.036 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0047030709999999996 2024-02-19T21:40:54.036 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.036 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.036 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:40:54.036 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.014785+0000", 2024-02-19T21:40:54.036 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00017881200000000001 2024-02-19T21:40:54.036 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.036 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.036 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:40:54.036 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.014964+0000", 2024-02-19T21:40:54.037 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0051516009999999996 2024-02-19T21:40:54.037 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:40:54.037 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:40:54.037 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:40:54.037 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.037 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.037 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:92684 8.b 8:d44f7655:::benchmark_data_smithi080_100924_object92683:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e184)", 2024-02-19T21:40:54.037 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:40:54.018221+0000", 2024-02-19T21:40:54.037 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.00087682400000000001, 2024-02-19T21:40:54.037 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0010945169999999999, 2024-02-19T21:40:54.037 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:40:54.037 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:40:54.037 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:40:54.037 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:40:54.038 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:40:54.038 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 92684 2024-02-19T21:40:54.038 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.038 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:40:54.038 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.038 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:40:54.038 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.018221+0000", 2024-02-19T21:40:54.038 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:40:54.038 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.038 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.038 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:40:54.038 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.018221+0000", 2024-02-19T21:40:54.038 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:40:54.038 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.039 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.039 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:40:54.039 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.018220+0000", 2024-02-19T21:40:54.039 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.4449000000000006e-05 2024-02-19T21:40:54.039 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.039 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.039 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:40:54.039 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.018284+0000", 2024-02-19T21:40:54.039 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.4572e-05 2024-02-19T21:40:54.039 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.039 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.040 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:40:54.040 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.018299+0000", 2024-02-19T21:40:54.040 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.0820000000000001e-06 2024-02-19T21:40:54.040 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.040 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.040 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:40:54.040 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.018306+0000", 2024-02-19T21:40:54.040 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.9116999999999997e-05 2024-02-19T21:40:54.040 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.040 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.040 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:40:54.040 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.018355+0000", 2024-02-19T21:40:54.040 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013117900000000001 2024-02-19T21:40:54.040 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.041 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.041 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:40:54.041 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.018486+0000", 2024-02-19T21:40:54.041 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000163208 2024-02-19T21:40:54.041 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:40:54.041 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:40:54.041 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,7", 2024-02-19T21:40:54.041 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.018649+0000", 2024-02-19T21:40:54.041 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00042813399999999999 2024-02-19T21:40:54.041 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:40:54.041 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:40:54.041 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:40:54.041 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:40:54.041 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-02-19T21:40:54.042 INFO:teuthology.orchestra.run.smithi157.stdout: "num_ops": 3 2024-02-19T21:40:54.042 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:40:54.109 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:40:54.147 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:54.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:52.974235+0000 mgr.y (mgr.14514) 322 : cluster [DBG] pgmap v357: 148 pgs: 148 active+clean; 5.4 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1023 B/s rd, 73 MiB/s wr, 1.16k op/s 2024-02-19T21:40:54.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:52.974235+0000 mgr.y (mgr.14514) 322 : cluster [DBG] pgmap v357: 148 pgs: 148 active+clean; 5.4 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1023 B/s rd, 73 MiB/s wr, 1.16k op/s 2024-02-19T21:40:54.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:52.974235+0000 mgr.y (mgr.14514) 322 : cluster [DBG] pgmap v357: 148 pgs: 148 active+clean; 5.4 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1023 B/s rd, 73 MiB/s wr, 1.16k op/s 2024-02-19T21:40:54.404 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:40:54.413 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:54.414 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:40:54.515 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:40:54.543 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 6, 7] out_osds: [2] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:40:54.544 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:40:54.544 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-02-19T21:40:54.544 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd dump -f json-pretty 2024-02-19T21:40:54.568 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:54.775 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:40:54.780 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:54.780 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:40:54.816 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.4 dump_blocked_ops 2024-02-19T21:40:54.882 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:40:54.961 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 58 16 93703 93687 100.937 67.125 0.0137976 0.00990286 2024-02-19T21:40:54.973 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:55.029 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:40:55.034 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:55.035 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:40:55.118 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:40:55.136 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:40:55.202 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:55.297 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:40:55.333 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:40:55.343 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:55.343 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:40:55.444 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:40:55.489 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:55.519 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:40:55.523 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:55.523 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:40:55.624 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:40:55.682 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:55.720 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:40:55.726 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:55.726 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:40:55.827 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:40:55.874 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:55.963 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 59 16 94724 94708 100.305 63.8125 0.00557068 0.00996498 2024-02-19T21:40:55.967 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:40:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:40:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:40:56.102 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-02-19T21:40:56.139 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:40:56.141 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:56.141 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:40:56.242 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:40:56.292 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:54.974802+0000 mgr.y (mgr.14514) 323 : cluster [DBG] pgmap v358: 148 pgs: 148 active+clean; 5.6 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 1.3 KiB/s rd, 81 MiB/s wr, 1.30k op/s 2024-02-19T21:40:56.292 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:55.370112+0000 mon.b (mon.1) 47 : audit [INF] from='client.? 172.21.15.80:0/1047143267' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:40:56.292 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:55.370563+0000 mon.a (mon.0) 1036 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:40:56.298 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:56.333 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:40:56.336 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:56.336 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:40:56.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:54.974802+0000 mgr.y (mgr.14514) 323 : cluster [DBG] pgmap v358: 148 pgs: 148 active+clean; 5.6 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 1.3 KiB/s rd, 81 MiB/s wr, 1.30k op/s 2024-02-19T21:40:56.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:55.370112+0000 mon.b (mon.1) 47 : audit [INF] from='client.? 172.21.15.80:0/1047143267' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:40:56.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:55.370563+0000 mon.a (mon.0) 1036 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:40:56.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:54.974802+0000 mgr.y (mgr.14514) 323 : cluster [DBG] pgmap v358: 148 pgs: 148 active+clean; 5.6 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 1.3 KiB/s rd, 81 MiB/s wr, 1.30k op/s 2024-02-19T21:40:56.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:55.370112+0000 mon.b (mon.1) 47 : audit [INF] from='client.? 172.21.15.80:0/1047143267' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:40:56.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:55.370563+0000 mon.a (mon.0) 1036 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:40:56.429 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:40:56.438 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:40:56.530 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:56.577 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:40:56.601 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:56.602 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:40:56.703 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:40:56.745 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:56.963 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:2024-02-19T21:40:56.963568+0000 min lat: 0.00129851 max lat: 0.0968115 avg lat: 0.0100144 2024-02-19T21:40:56.963 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-19T21:40:56.963 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 60 16 95856 95840 99.8121 70.75 0.0103948 0.0100144 2024-02-19T21:40:57.085 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:56.073237+0000 mon.a (mon.0) 1037 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:40:57.085 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:56.085898+0000 mon.a (mon.0) 1038 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:40:57.085 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:56.085967+0000 mon.a (mon.0) 1039 : cluster [DBG] osdmap e185: 8 total, 8 up, 7 in 2024-02-19T21:40:57.207 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:56.073237+0000 mon.a (mon.0) 1037 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:40:57.207 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:56.085898+0000 mon.a (mon.0) 1038 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:40:57.207 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:56.085967+0000 mon.a (mon.0) 1039 : cluster [DBG] osdmap e185: 8 total, 8 up, 7 in 2024-02-19T21:40:57.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:56.073237+0000 mon.a (mon.0) 1037 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:40:57.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:56.085898+0000 mon.a (mon.0) 1038 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:40:57.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:56.085967+0000 mon.a (mon.0) 1039 : cluster [DBG] osdmap e185: 8 total, 8 up, 7 in 2024-02-19T21:40:57.578 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:40:57.578 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [], 2024-02-19T21:40:57.578 INFO:teuthology.orchestra.run.smithi157.stdout: "complaint_time": 30, 2024-02-19T21:40:57.578 INFO:teuthology.orchestra.run.smithi157.stdout: "num_blocked_ops": 0 2024-02-19T21:40:57.578 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:40:57.963 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 61 16 96992 96976 99.3398 71 0.00673079 0.010062 2024-02-19T21:40:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:40:58.118 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:58.118 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:40:58.170 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:40:58.220 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:40:58.276 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:40:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:56.975177+0000 mgr.y (mgr.14514) 324 : cluster [DBG] pgmap v360: 148 pgs: 148 active+clean; 5.7 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 1023 B/s rd, 71 MiB/s wr, 1.14k op/s 2024-02-19T21:40:58.281 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:58.338 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:40:58.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:40:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:56.975177+0000 mgr.y (mgr.14514) 324 : cluster [DBG] pgmap v360: 148 pgs: 148 active+clean; 5.7 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 1023 B/s rd, 71 MiB/s wr, 1.14k op/s 2024-02-19T21:40:58.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:40:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:56.975177+0000 mgr.y (mgr.14514) 324 : cluster [DBG] pgmap v360: 148 pgs: 148 active+clean; 5.7 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 1023 B/s rd, 71 MiB/s wr, 1.14k op/s 2024-02-19T21:40:58.348 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:58.349 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:40:58.366 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.4 dump_historic_ops 2024-02-19T21:40:58.450 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:40:58.486 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:58.691 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:40:58.697 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:58.698 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:40:58.799 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:40:58.851 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:40:58.870 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:58.912 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:40:58.919 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:58.920 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:40:58.963 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 62 16 97997 97981 98.7506 62.8125 0.0148845 0.0101224 2024-02-19T21:40:59.020 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:40:59.076 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:59.110 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:40:59.113 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:59.113 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:40:59.214 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:40:59.258 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:59.281 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:40:59.282 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:40:59.282 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 185, 2024-02-19T21:40:59.282 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "6f763558-cf6d-11ee-95bb-87774f69a715", 2024-02-19T21:40:59.282 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2024-02-19T21:26:16.880265+0000", 2024-02-19T21:40:59.282 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2024-02-19T21:40:56.073015+0000", 2024-02-19T21:40:59.282 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2024-02-19T21:32:14.805693+0000", 2024-02-19T21:40:59.282 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2024-02-19T21:39:38.443319+0000", 2024-02-19T21:40:59.282 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-02-19T21:40:59.282 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5806080, 2024-02-19T21:40:59.282 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2024-02-19T21:40:59.282 INFO:teuthology.orchestra.run.smithi080.stdout: "nodeep-scrub", 2024-02-19T21:40:59.282 INFO:teuthology.orchestra.run.smithi080.stdout: "noscrub", 2024-02-19T21:40:59.283 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2024-02-19T21:40:59.283 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2024-02-19T21:40:59.283 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2024-02-19T21:40:59.283 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2024-02-19T21:40:59.283 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:40:59.283 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 18, 2024-02-19T21:40:59.283 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2024-02-19T21:40:59.283 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-02-19T21:40:59.283 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2024-02-19T21:40:59.283 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2024-02-19T21:40:59.283 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 8, 2024-02-19T21:40:59.283 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2024-02-19T21:40:59.283 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "luminous", 2024-02-19T21:40:59.283 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "luminous", 2024-02-19T21:40:59.284 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "pacific", 2024-02-19T21:40:59.284 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2024-02-19T21:40:59.284 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.284 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2024-02-19T21:40:59.284 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "device_health_metrics", 2024-02-19T21:40:59.284 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:30:05.947623+0000", 2024-02-19T21:40:59.284 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:40:59.284 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:40:59.284 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:40:59.284 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:40:59.284 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:40:59.284 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:40:59.285 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:40:59.285 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:40:59.285 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:40:59.285 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:40:59.285 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:40:59.285 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:40:59.285 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 1, 2024-02-19T21:40:59.285 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 1, 2024-02-19T21:40:59.285 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 1, 2024-02-19T21:40:59.285 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 1, 2024-02-19T21:40:59.285 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 1, 2024-02-19T21:40:59.285 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:40:59.285 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:40:59.285 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:40:59.286 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:40:59.286 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:40:59.286 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:40:59.286 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:40:59.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.286 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "74", 2024-02-19T21:40:59.286 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:40:59.286 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:40:59.286 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:40:59.286 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:40:59.286 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:40:59.286 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:40:59.286 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:40:59.286 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:40:59.287 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:40:59.287 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:40:59.287 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:40:59.287 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:40:59.287 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:40:59.287 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:40:59.287 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:40:59.287 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:40:59.287 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:40:59.287 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:40:59.287 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:40:59.287 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:40:59.287 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:40:59.287 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:40:59.288 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:40:59.288 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:40:59.288 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:40:59.288 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:40:59.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.288 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:40:59.288 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:40:59.288 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:40:59.288 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:40:59.288 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:40:59.288 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:40:59.288 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:40:59.288 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:40:59.288 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:40:59.289 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:40:59.289 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:40:59.289 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2024-02-19T21:40:59.289 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_max": 32, 2024-02-19T21:40:59.289 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 1 2024-02-19T21:40:59.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.289 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:40:59.289 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_devicehealth": {} 2024-02-19T21:40:59.289 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.289 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 2, 2024-02-19T21:40:59.289 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": ".rgw.root", 2024-02-19T21:40:59.289 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:22.082250+0000", 2024-02-19T21:40:59.290 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:40:59.290 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:40:59.290 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:40:59.290 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:40:59.290 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:40:59.290 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:40:59.290 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:40:59.290 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:40:59.290 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:40:59.290 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:40:59.290 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:40:59.290 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:40:59.290 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:40:59.290 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:40:59.291 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:40:59.291 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:40:59.291 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:40:59.291 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:40:59.291 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:40:59.291 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:40:59.291 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:40:59.291 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:40:59.291 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:40:59.291 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:40:59.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.291 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "60", 2024-02-19T21:40:59.291 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:40:59.291 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:40:59.292 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:40:59.292 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:40:59.292 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:40:59.292 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:40:59.292 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:40:59.292 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:40:59.292 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:40:59.292 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:40:59.292 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:40:59.292 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:40:59.292 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:40:59.292 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:40:59.292 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:40:59.292 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:40:59.293 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:40:59.293 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:40:59.293 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:40:59.293 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:40:59.293 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:40:59.293 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:40:59.293 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:40:59.293 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:40:59.293 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:40:59.293 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:40:59.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.293 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:40:59.293 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:40:59.293 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:40:59.293 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:40:59.293 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:40:59.294 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:40:59.294 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:40:59.294 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:40:59.294 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:40:59.294 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:40:59.294 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:40:59.294 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:40:59.294 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:40:59.294 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:40:59.294 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.294 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.294 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 3, 2024-02-19T21:40:59.294 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "iscsi", 2024-02-19T21:40:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:22.333164+0000", 2024-02-19T21:40:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:40:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:40:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:40:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:40:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:40:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:40:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:40:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:40:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:40:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:40:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:40:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:40:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 3, 2024-02-19T21:40:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 3, 2024-02-19T21:40:59.296 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 3, 2024-02-19T21:40:59.296 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 3, 2024-02-19T21:40:59.296 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 3, 2024-02-19T21:40:59.296 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:40:59.296 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:40:59.296 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:40:59.296 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:40:59.296 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:40:59.296 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:40:59.296 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:40:59.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.296 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "62", 2024-02-19T21:40:59.296 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:40:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:40:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:40:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:40:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:40:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:40:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:40:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:40:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:40:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:40:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:40:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:40:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:40:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:40:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:40:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:40:59.298 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:40:59.298 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:40:59.298 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:40:59.298 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:40:59.298 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:40:59.298 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:40:59.298 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:40:59.298 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:40:59.298 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:40:59.298 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:40:59.298 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.298 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:40:59.298 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:40:59.298 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:40:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:40:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:40:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:40:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:40:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:40:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:40:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:40:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:40:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:40:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:40:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2024-02-19T21:40:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.300 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 4, 2024-02-19T21:40:59.300 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.log", 2024-02-19T21:40:59.300 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:23.632615+0000", 2024-02-19T21:40:59.300 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:40:59.300 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:40:59.300 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:40:59.300 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:40:59.300 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:40:59.300 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:40:59.300 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:40:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:40:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:40:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:40:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:40:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:40:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:40:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:40:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:40:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:40:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:40:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:40:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:40:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:40:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:40:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:40:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:40:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:40:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "62", 2024-02-19T21:40:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:40:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:40:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:40:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:40:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:40:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:40:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:40:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:40:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:40:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:40:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:40:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:40:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:40:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:40:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:40:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:40:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:40:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:40:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:40:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:40:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:40:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:40:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:40:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:40:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:40:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:40:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:40:59.304 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:40:59.304 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:40:59.304 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:40:59.304 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:40:59.304 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:40:59.304 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:40:59.304 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:40:59.304 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:40:59.304 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:40:59.304 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:40:59.304 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:40:59.304 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:40:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:40:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 5, 2024-02-19T21:40:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.control", 2024-02-19T21:40:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:25.600876+0000", 2024-02-19T21:40:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:40:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:40:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:40:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:40:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:40:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:40:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:40:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:40:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:40:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:40:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:40:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:40:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:40:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:40:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:40:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:40:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:40:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:40:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:40:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:40:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:40:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:40:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:40:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:40:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "64", 2024-02-19T21:40:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:40:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:40:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:40:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:40:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:40:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:40:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:40:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:40:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:40:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:40:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:40:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:40:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:40:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:40:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:40:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:40:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:40:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:40:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:40:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:40:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:40:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:40:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:40:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:40:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:40:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:40:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:40:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:40:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:40:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:40:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:40:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:40:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:40:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:40:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:40:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:40:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:40:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:40:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:40:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:40:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 6, 2024-02-19T21:40:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.meta", 2024-02-19T21:40:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:27.661242+0000", 2024-02-19T21:40:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:40:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:40:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:40:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:40:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:40:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:40:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:40:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:40:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:40:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:40:59.311 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:40:59.311 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:40:59.311 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:40:59.311 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:40:59.311 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:40:59.311 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:40:59.311 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:40:59.311 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:40:59.311 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:40:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:40:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:40:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:40:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:40:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:40:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "66", 2024-02-19T21:40:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:40:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:40:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:40:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:40:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:40:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:40:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:40:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:40:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:40:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:40:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:40:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:40:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:40:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:40:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:40:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:40:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:40:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:40:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:40:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:40:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:40:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:40:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:40:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:40:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:40:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:40:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:40:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:40:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:40:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:40:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:40:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:40:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:40:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:40:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:40:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:40:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:40:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2024-02-19T21:40:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4 2024-02-19T21:40:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:40:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:40:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 8, 2024-02-19T21:40:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "unique_pool_1", 2024-02-19T21:40:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:39:38.377517+0000", 2024-02-19T21:40:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:40:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:40:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:40:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:40:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:40:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:40:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:40:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:40:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:40:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:40:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:40:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:40:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 16, 2024-02-19T21:40:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 16, 2024-02-19T21:40:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 16, 2024-02-19T21:40:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 16, 2024-02-19T21:40:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 16, 2024-02-19T21:40:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:40:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:40:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:40:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:40:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:40:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:40:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:40:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "171", 2024-02-19T21:40:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:40:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:40:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:40:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:40:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:40:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:40:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:40:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:40:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:40:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:40:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:40:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:40:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:40:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:40:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:40:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:40:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:40:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:40:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:40:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:40:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:40:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:40:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:40:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:40:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:40:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:40:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:40:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:40:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:40:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:40:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:40:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:40:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:40:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:40:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:40:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:40:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:40:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:40:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:40:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: "rados": {} 2024-02-19T21:40:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:40:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:40:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2024-02-19T21:40:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "a72c63f6-46b3-4202-99da-7b0c92b799a5", 2024-02-19T21:40:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:40:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:40:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:40:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:40:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:40:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:40:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 8, 2024-02-19T21:40:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 169, 2024-02-19T21:40:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:40:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:40:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:40:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2024-02-19T21:40:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:40:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2024-02-19T21:40:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:40:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:40:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2024-02-19T21:40:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:40:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2024-02-19T21:40:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:40:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:40:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2024-02-19T21:40:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:40:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2024-02-19T21:40:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:40:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:40:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2024-02-19T21:40:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:40:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2024-02-19T21:40:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:40:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6803/3531298825", 2024-02-19T21:40:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6805/3531298825", 2024-02-19T21:40:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6809/3531298825", 2024-02-19T21:40:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6807/3531298825", 2024-02-19T21:40:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:40:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:40:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:40:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.326 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2024-02-19T21:40:59.326 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "7d4e170e-b0ca-4e19-be35-4038ca126ee6", 2024-02-19T21:40:59.326 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:40:59.326 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:40:59.326 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:40:59.326 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:40:59.326 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:40:59.326 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:40:59.326 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-02-19T21:40:59.326 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 165, 2024-02-19T21:40:59.326 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:40:59.326 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:40:59.326 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:40:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2024-02-19T21:40:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:40:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2024-02-19T21:40:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:40:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.328 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:40:59.328 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.328 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.328 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.328 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2024-02-19T21:40:59.328 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:40:59.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.328 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.328 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.328 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2024-02-19T21:40:59.328 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:40:59.328 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:40:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2024-02-19T21:40:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:40:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2024-02-19T21:40:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:40:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:40:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2024-02-19T21:40:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:40:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2024-02-19T21:40:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:40:59.331 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.331 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.331 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6811/1497235950", 2024-02-19T21:40:59.331 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6813/1497235950", 2024-02-19T21:40:59.331 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6817/1497235950", 2024-02-19T21:40:59.331 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6815/1497235950", 2024-02-19T21:40:59.331 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:40:59.331 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:40:59.331 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:40:59.331 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.331 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.331 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2024-02-19T21:40:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "cf461b67-f3e8-45e9-b2f6-777752ba5574", 2024-02-19T21:40:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:40:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 0, 2024-02-19T21:40:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 0, 2024-02-19T21:40:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:40:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:40:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:40:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 18, 2024-02-19T21:40:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 144, 2024-02-19T21:40:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:40:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:40:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:40:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2024-02-19T21:40:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:40:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2024-02-19T21:40:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:40:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:40:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2024-02-19T21:40:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:40:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2024-02-19T21:40:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:40:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:40:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2024-02-19T21:40:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:40:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.335 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.335 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2024-02-19T21:40:59.335 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:40:59.335 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.335 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.335 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.335 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:40:59.335 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.335 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.335 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.335 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2024-02-19T21:40:59.335 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:40:59.335 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.335 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.336 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.336 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2024-02-19T21:40:59.336 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:40:59.336 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.336 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.336 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.336 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6819/3131848307", 2024-02-19T21:40:59.336 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6821/3131848307", 2024-02-19T21:40:59.336 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6825/3131848307", 2024-02-19T21:40:59.336 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6823/3131848307", 2024-02-19T21:40:59.336 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:40:59.336 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:40:59.336 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:40:59.336 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2024-02-19T21:40:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "76318cdd-5fce-4a40-95c9-300d55c34820", 2024-02-19T21:40:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:40:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:40:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 0.3962554931640625, 2024-02-19T21:40:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:40:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:40:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:40:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 26, 2024-02-19T21:40:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 169, 2024-02-19T21:40:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:40:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:40:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:40:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2024-02-19T21:40:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:40:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2024-02-19T21:40:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:40:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:40:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2024-02-19T21:40:59.339 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:40:59.339 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.339 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.339 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.339 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2024-02-19T21:40:59.339 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:40:59.339 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.339 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.339 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.339 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:40:59.339 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.339 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.339 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.339 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6832", 2024-02-19T21:40:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:40:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6833", 2024-02-19T21:40:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:40:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:40:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2024-02-19T21:40:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:40:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2024-02-19T21:40:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:40:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6827/2007978078", 2024-02-19T21:40:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6829/2007978078", 2024-02-19T21:40:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6833/2007978078", 2024-02-19T21:40:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6831/2007978078", 2024-02-19T21:40:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:40:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:40:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:40:59.342 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.342 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.342 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2024-02-19T21:40:59.342 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "6484964f-3391-4e1d-a56c-813f46124062", 2024-02-19T21:40:59.342 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:40:59.342 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:40:59.342 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:40:59.342 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 0.427398681640625, 2024-02-19T21:40:59.342 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:40:59.342 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:40:59.342 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 32, 2024-02-19T21:40:59.342 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 165, 2024-02-19T21:40:59.342 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:40:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:40:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:40:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6800", 2024-02-19T21:40:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:40:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6801", 2024-02-19T21:40:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:40:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:40:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.344 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.344 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.344 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6802", 2024-02-19T21:40:59.344 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:40:59.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.344 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.344 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.344 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6803", 2024-02-19T21:40:59.344 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:40:59.344 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.344 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.344 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:40:59.344 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6806", 2024-02-19T21:40:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:40:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6807", 2024-02-19T21:40:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:40:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:40:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.346 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.346 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6804", 2024-02-19T21:40:59.346 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:40:59.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.346 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.346 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6805", 2024-02-19T21:40:59.346 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:40:59.346 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.346 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.346 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6801/1922002860", 2024-02-19T21:40:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6803/1922002860", 2024-02-19T21:40:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6807/1922002860", 2024-02-19T21:40:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6805/1922002860", 2024-02-19T21:40:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:40:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:40:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:40:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2024-02-19T21:40:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "8c7e0309-8c3b-40b9-99d9-96620e52742f", 2024-02-19T21:40:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:40:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:40:59.348 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:40:59.348 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:40:59.348 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:40:59.348 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:40:59.348 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 38, 2024-02-19T21:40:59.348 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 169, 2024-02-19T21:40:59.348 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:40:59.348 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:40:59.348 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:40:59.348 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.348 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.348 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.348 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6808", 2024-02-19T21:40:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:40:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6809", 2024-02-19T21:40:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:40:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:40:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6810", 2024-02-19T21:40:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:40:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6811", 2024-02-19T21:40:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:40:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:40:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6814", 2024-02-19T21:40:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:40:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6815", 2024-02-19T21:40:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:40:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:40:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6812", 2024-02-19T21:40:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:40:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6813", 2024-02-19T21:40:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:40:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6809/960889603", 2024-02-19T21:40:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6811/960889603", 2024-02-19T21:40:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6815/960889603", 2024-02-19T21:40:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6813/960889603", 2024-02-19T21:40:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:40:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:40:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:40:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2024-02-19T21:40:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "5b7d44a3-197d-482c-bf9e-de5e9013a851", 2024-02-19T21:40:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:40:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:40:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:40:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:40:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:40:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:40:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 47, 2024-02-19T21:40:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 169, 2024-02-19T21:40:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:40:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:40:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:40:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6816", 2024-02-19T21:40:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:40:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6817", 2024-02-19T21:40:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:40:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:40:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6818", 2024-02-19T21:40:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:40:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6819", 2024-02-19T21:40:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:40:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:40:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6822", 2024-02-19T21:40:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:40:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6823", 2024-02-19T21:40:59.357 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:40:59.357 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.357 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.357 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:40:59.357 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.357 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.357 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6820", 2024-02-19T21:40:59.357 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:40:59.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.358 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.358 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6821", 2024-02-19T21:40:59.358 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:40:59.358 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.358 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.358 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.358 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6817/2598265223", 2024-02-19T21:40:59.358 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6819/2598265223", 2024-02-19T21:40:59.358 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6823/2598265223", 2024-02-19T21:40:59.358 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6821/2598265223", 2024-02-19T21:40:59.358 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:40:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:40:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:40:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2024-02-19T21:40:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "7e2d0287-928d-40f8-841b-6c2077fc08ac", 2024-02-19T21:40:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:40:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:40:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:40:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:40:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:40:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:40:59.360 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 55, 2024-02-19T21:40:59.360 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 169, 2024-02-19T21:40:59.360 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:40:59.360 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:40:59.360 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:40:59.360 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.360 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.360 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.360 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6824", 2024-02-19T21:40:59.361 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:40:59.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.361 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.361 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.361 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6825", 2024-02-19T21:40:59.361 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:40:59.361 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.361 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.361 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:40:59.361 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.361 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.362 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.362 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6826", 2024-02-19T21:40:59.362 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:40:59.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.362 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.362 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.362 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6827", 2024-02-19T21:40:59.362 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:40:59.362 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.362 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.362 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:40:59.363 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.363 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.363 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.363 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6830", 2024-02-19T21:40:59.363 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:40:59.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.363 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.363 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.363 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6831", 2024-02-19T21:40:59.363 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:40:59.363 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.363 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.364 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:40:59.364 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:40:59.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.364 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:40:59.364 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6828", 2024-02-19T21:40:59.364 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:40:59.364 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.364 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:40:59.364 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6829", 2024-02-19T21:40:59.364 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:40:59.365 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.365 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.365 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6825/3619345894", 2024-02-19T21:40:59.365 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6827/3619345894", 2024-02-19T21:40:59.365 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6831/3619345894", 2024-02-19T21:40:59.365 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6829/3619345894", 2024-02-19T21:40:59.365 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:40:59.365 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:40:59.365 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:40:59.365 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.365 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.365 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:40:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2024-02-19T21:40:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2024-02-19T21:40:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:40:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:40:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:40:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:40:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:40:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:40:42.309992+0000", 2024-02-19T21:40:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:40:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2024-02-19T21:40:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:40:59.367 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:40:59.367 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:40:59.367 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:40:59.367 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:40:59.367 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:40:22.621826+0000", 2024-02-19T21:40:59.367 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:40:59.367 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.367 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.367 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2024-02-19T21:40:59.367 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:40:59.367 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:40:59.367 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:40:59.367 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:40:59.367 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 65536, 2024-02-19T21:40:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:40:30.001206+0000", 2024-02-19T21:40:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:40:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2024-02-19T21:40:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:40:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:40:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:40:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:40:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:40:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:40:41.638869+0000", 2024-02-19T21:40:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:40:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2024-02-19T21:40:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:40:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:40:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:40:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:40:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:40:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:40:30.593245+0000", 2024-02-19T21:40:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:40:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2024-02-19T21:40:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:40:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:40:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:40:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:40:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:40:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:40:19.689341+0000", 2024-02-19T21:40:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:40:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2024-02-19T21:40:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:40:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:40:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:40:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:40:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:40:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:40:17.977226+0000", 2024-02-19T21:40:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:40:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2024-02-19T21:40:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:40:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:40:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:40:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:40:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:40:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:40:23.152399+0000", 2024-02-19T21:40:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:40:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:40:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [ 2024-02-19T21:40:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "6.c", 2024-02-19T21:40:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:40:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: 5, 2024-02-19T21:40:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: 0, 2024-02-19T21:40:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: 2 2024-02-19T21:40:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:40:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [ 2024-02-19T21:40:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.6", 2024-02-19T21:40:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:40:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:40:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 5 2024-02-19T21:40:59.373 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.373 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.373 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.8", 2024-02-19T21:40:59.373 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:40:59.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.373 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 7, 2024-02-19T21:40:59.373 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 5 2024-02-19T21:40:59.373 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.373 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.374 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.e", 2024-02-19T21:40:59.374 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:40:59.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.374 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:40:59.374 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 7 2024-02-19T21:40:59.374 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.374 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.374 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.f", 2024-02-19T21:40:59.374 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:40:59.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.374 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:40:59.374 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 5 2024-02-19T21:40:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.19", 2024-02-19T21:40:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:40:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:40:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 7 2024-02-19T21:40:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.1e", 2024-02-19T21:40:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:40:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.376 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 7, 2024-02-19T21:40:59.376 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 5 2024-02-19T21:40:59.376 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.376 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.376 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.1f", 2024-02-19T21:40:59.376 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:40:59.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.376 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:40:59.376 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 7 2024-02-19T21:40:59.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 6, 2024-02-19T21:40:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 0 2024-02-19T21:40:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "5.1", 2024-02-19T21:40:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:40:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 4, 2024-02-19T21:40:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 6 2024-02-19T21:40:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "5.d", 2024-02-19T21:40:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:40:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 0, 2024-02-19T21:40:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 3 2024-02-19T21:40:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "5.13", 2024-02-19T21:40:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:40:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 0, 2024-02-19T21:40:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 6 2024-02-19T21:40:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "5.14", 2024-02-19T21:40:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:40:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:40:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 7, 2024-02-19T21:40:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 6 2024-02-19T21:40:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:40:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:40:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [], 2024-02-19T21:40:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2024-02-19T21:40:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: "blocklist": { 2024-02-19T21:40:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6800/2867197629": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:40:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/1659656010": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:40:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6801/2272739550": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:40:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/867908385": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:40:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/398750494": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:40:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/2833137430": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:40:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/2520755315": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:40:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6800/2094869828": "2024-02-20T21:26:51.262073+0000", 2024-02-19T21:40:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6800/2272739550": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:40:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6801/2094869828": "2024-02-20T21:26:51.262073+0000", 2024-02-19T21:40:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/2130852198": "2024-02-20T21:26:51.262073+0000", 2024-02-19T21:40:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6801/2867197629": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:40:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/1952386920": "2024-02-20T21:26:51.262073+0000" 2024-02-19T21:40:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: "range_blocklist": {}, 2024-02-19T21:40:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2024-02-19T21:40:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2024-02-19T21:40:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2024-02-19T21:40:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2024-02-19T21:40:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2024-02-19T21:40:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2024-02-19T21:40:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2024-02-19T21:40:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2024-02-19T21:40:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:40:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2024-02-19T21:40:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2024-02-19T21:40:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2024-02-19T21:40:59.382 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2024-02-19T21:40:59.382 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {}, 2024-02-19T21:40:59.382 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode": { 2024-02-19T21:40:59.382 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode_enabled": false, 2024-02-19T21:40:59.382 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_bucket_count": 0, 2024-02-19T21:40:59.382 INFO:teuthology.orchestra.run.smithi080.stdout: "degraded_stretch_mode": 0, 2024-02-19T21:40:59.382 INFO:teuthology.orchestra.run.smithi080.stdout: "recovering_stretch_mode": 0, 2024-02-19T21:40:59.382 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode_bucket": 0 2024-02-19T21:40:59.382 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:40:59.382 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:40:59.518 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:40:59.520 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:59.521 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:40:59.571 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset noscrub 2024-02-19T21:40:59.621 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:40:59.683 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:40:59.813 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:40:59.822 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:40:59.822 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:40:59.923 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:40:59.963 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 63 16 99091 99075 98.2684 68.375 0.0193784 0.0101722 2024-02-19T21:40:59.976 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:00.125 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:40:58.975561+0000 mgr.y (mgr.14514) 325 : cluster [DBG] pgmap v361: 148 pgs: 148 active+clean; 5.7 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 1023 B/s rd, 71 MiB/s wr, 1.14k op/s 2024-02-19T21:41:00.125 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:40:59.276621+0000 mon.a (mon.0) 1040 : audit [DBG] from='client.? 172.21.15.80:0/3472526992' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-19T21:41:00.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:40:58.975561+0000 mgr.y (mgr.14514) 325 : cluster [DBG] pgmap v361: 148 pgs: 148 active+clean; 5.7 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 1023 B/s rd, 71 MiB/s wr, 1.14k op/s 2024-02-19T21:41:00.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:40:59.276621+0000 mon.a (mon.0) 1040 : audit [DBG] from='client.? 172.21.15.80:0/3472526992' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-19T21:41:00.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:40:58.975561+0000 mgr.y (mgr.14514) 325 : cluster [DBG] pgmap v361: 148 pgs: 148 active+clean; 5.7 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 1023 B/s rd, 71 MiB/s wr, 1.14k op/s 2024-02-19T21:41:00.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:40:59.276621+0000 mon.a (mon.0) 1040 : audit [DBG] from='client.? 172.21.15.80:0/3472526992' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-19T21:41:00.452 INFO:tasks.thrashosds.thrasher:j is {'epoch': 185, 'fsid': '6f763558-cf6d-11ee-95bb-87774f69a715', 'created': '2024-02-19T21:26:16.880265+0000', 'modified': '2024-02-19T21:40:56.073015+0000', 'last_up_change': '2024-02-19T21:32:14.805693+0000', 'last_in_change': '2024-02-19T21:39:38.443319+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 18, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 8, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-19T21:30:05.947623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2024-02-19T21:32:22.082250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2024-02-19T21:32:22.333164+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 3, 'pg_placement_num': 3, 'pg_placement_num_target': 3, 'pg_num_target': 3, 'pg_num_pending': 3, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2024-02-19T21:32:23.632615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2024-02-19T21:32:25.600876+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2024-02-19T21:32:27.661242+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}}, {'pool': 8, 'pool_name': 'unique_pool_1', 'create_time': '2024-02-19T21:39:38.377517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '171', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': 'a72c63f6-46b3-4202-99da-7b0c92b799a5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 169, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6802', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6803', 'nonce': 3531298825}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6804', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6805', 'nonce': 3531298825}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6808', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6809', 'nonce': 3531298825}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6806', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6807', 'nonce': 3531298825}]}, 'public_addr': '172.21.15.80:6803/3531298825', 'cluster_addr': '172.21.15.80:6805/3531298825', 'heartbeat_back_addr': '172.21.15.80:6809/3531298825', 'heartbeat_front_addr': '172.21.15.80:6807/3531298825', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7d4e170e-b0ca-4e19-be35-4038ca126ee6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 165, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6810', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6811', 'nonce': 1497235950}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6812', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6813', 'nonce': 1497235950}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6816', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6817', 'nonce': 1497235950}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6814', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6815', 'nonce': 1497235950}]}, 'public_addr': '172.21.15.80:6811/1497235950', 'cluster_addr': '172.21.15.80:6813/1497235950', 'heartbeat_back_addr': '172.21.15.80:6817/1497235950', 'heartbeat_front_addr': '172.21.15.80:6815/1497235950', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'cf461b67-f3e8-45e9-b2f6-777752ba5574', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 18, 'up_thru': 144, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6818', 'nonce': 3131848307}, {'type': 'v1', 'addr': '172.21.15.80:6819', 'nonce': 3131848307}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6820', 'nonce': 3131848307}, {'type': 'v1', 'addr': '172.21.15.80:6821', 'nonce': 3131848307}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6824', 'nonce': 3131848307}, {'type': 'v1', 'addr': '172.21.15.80:6825', 'nonce': 3131848307}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6822', 'nonce': 3131848307}, {'type': 'v1', 'addr': '172.21.15.80:6823', 'nonce': 3131848307}]}, 'public_addr': '172.21.15.80:6819/3131848307', 'cluster_addr': '172.21.15.80:6821/3131848307', 'heartbeat_back_addr': '172.21.15.80:6825/3131848307', 'heartbeat_front_addr': '172.21.15.80:6823/3131848307', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '76318cdd-5fce-4a40-95c9-300d55c34820', 'up': 1, 'in': 1, 'weight': 0.3962554931640625, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 26, 'up_thru': 169, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6826', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6827', 'nonce': 2007978078}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6828', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6829', 'nonce': 2007978078}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6832', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6833', 'nonce': 2007978078}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6830', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6831', 'nonce': 2007978078}]}, 'public_addr': '172.21.15.80:6827/2007978078', 'cluster_addr': '172.21.15.80:6829/2007978078', 'heartbeat_back_addr': '172.21.15.80:6833/2007978078', 'heartbeat_front_addr': '172.21.15.80:6831/2007978078', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '6484964f-3391-4e1d-a56c-813f46124062', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.427398681640625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 32, 'up_thru': 165, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6800', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6801', 'nonce': 1922002860}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6802', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6803', 'nonce': 1922002860}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6806', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6807', 'nonce': 1922002860}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6804', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6805', 'nonce': 1922002860}]}, 'public_addr': '172.21.15.157:6801/1922002860', 'cluster_addr': '172.21.15.157:6803/1922002860', 'heartbeat_back_addr': '172.21.15.157:6807/1922002860', 'heartbeat_front_addr': '172.21.15.157:6805/1922002860', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '8c7e0309-8c3b-40b9-99d9-96620e52742f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 38, 'up_thru': 169, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6808', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6809', 'nonce': 960889603}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6810', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6811', 'nonce': 960889603}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6814', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6815', 'nonce': 960889603}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6812', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6813', 'nonce': 960889603}]}, 'public_addr': '172.21.15.157:6809/960889603', 'cluster_addr': '172.21.15.157:6811/960889603', 'heartbeat_back_addr': '172.21.15.157:6815/960889603', 'heartbeat_front_addr': '172.21.15.157:6813/960889603', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '5b7d44a3-197d-482c-bf9e-de5e9013a851', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 47, 'up_thru': 169, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6816', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6817', 'nonce': 2598265223}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6818', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6819', 'nonce': 2598265223}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6822', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6823', 'nonce': 2598265223}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6820', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6821', 'nonce': 2598265223}]}, 'public_addr': '172.21.15.157:6817/2598265223', 'cluster_addr': '172.21.15.157:6819/2598265223', 'heartbeat_back_addr': '172.21.15.157:6823/2598265223', 'heartbeat_front_addr': '172.21.15.157:6821/2598265223', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '7e2d0287-928d-40f8-841b-6c2077fc08ac', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 55, 'up_thru': 169, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6824', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6825', 'nonce': 3619345894}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6826', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6827', 'nonce': 3619345894}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6830', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6831', 'nonce': 3619345894}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6828', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6829', 'nonce': 3619345894}]}, 'public_addr': '172.21.15.157:6825/3619345894', 'cluster_addr': '172.21.15.157:6827/3619345894', 'heartbeat_back_addr': '172.21.15.157:6831/3619345894', 'heartbeat_front_addr': '172.21.15.157:6829/3619345894', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:40:42.309992+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:40:22.621826+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-02-19T21:40:30.001206+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:40:41.638869+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:40:30.593245+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:40:19.689341+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:40:17.977226+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:40:23.152399+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '6.c', 'osds': [5, 0, 2]}], 'pg_upmap_items': [{'pgid': '4.6', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.8', 'mappings': [{'from': 7, 'to': 5}]}, {'pgid': '4.e', 'mappings': [{'from': 1, 'to': 7}]}, {'pgid': '4.f', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.19', 'mappings': [{'from': 1, 'to': 7}]}, {'pgid': '4.1e', 'mappings': [{'from': 7, 'to': 5}]}, {'pgid': '4.1f', 'mappings': [{'from': 1, 'to': 7}, {'from': 6, 'to': 0}]}, {'pgid': '5.1', 'mappings': [{'from': 4, 'to': 6}]}, {'pgid': '5.d', 'mappings': [{'from': 0, 'to': 3}]}, {'pgid': '5.13', 'mappings': [{'from': 0, 'to': 6}]}, {'pgid': '5.14', 'mappings': [{'from': 7, 'to': 6}]}], 'pg_temp': [], 'primary_temp': [], 'blocklist': {'172.21.15.80:6800/2867197629': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:0/1659656010': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:6801/2272739550': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:0/867908385': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:0/398750494': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:0/2833137430': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:0/2520755315': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:6800/2094869828': '2024-02-20T21:26:51.262073+0000', '172.21.15.80:6800/2272739550': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:6801/2094869828': '2024-02-20T21:26:51.262073+0000', '172.21.15.80:0/2130852198': '2024-02-20T21:26:51.262073+0000', '172.21.15.80:6801/2867197629': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:0/1952386920': '2024-02-20T21:26:51.262073+0000'}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-02-19T21:41:00.452 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:41:00.557 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:41:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:41:00.745 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:41:00.750 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:00.750 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:41:00.777 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:41:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:41:00] "GET /metrics HTTP/1.1" 200 175835 "" "Prometheus/2.33.4" 2024-02-19T21:41:00.851 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:41:00.902 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:00.963 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 64 16 100186 100170 97.8023 68.4375 0.017846 0.0102205 2024-02-19T21:41:01.015 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:41:01.020 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:01.020 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:41:01.062 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:41:01.062 INFO:teuthology.orchestra.run.smithi157.stdout: "size": 20, 2024-02-19T21:41:01.062 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 600, 2024-02-19T21:41:01.063 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [ 2024-02-19T21:41:01.063 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.063 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_repop(client.14793.0:34732 7.4 e109/100 7:23403103:::benchmark_data_smithi080_79222_object34731:head v 109'2197, mlcod=108'2194)", 2024-02-19T21:41:01.063 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:35:44.874248+0000", 2024-02-19T21:41:01.063 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 316.18336596199998, 2024-02-19T21:41:01.063 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.040447892999999999, 2024-02-19T21:41:01.063 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:01.063 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:01.063 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:01.063 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.063 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:01.063 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.874248+0000", 2024-02-19T21:41:01.063 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:01.063 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.064 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.064 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:01.064 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.874248+0000", 2024-02-19T21:41:01.064 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:41:01.064 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.064 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.064 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:01.064 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.874248+0000", 2024-02-19T21:41:01.064 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0096999999999998e-05 2024-02-19T21:41:01.064 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.064 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.064 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:01.064 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.874298+0000", 2024-02-19T21:41:01.065 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.2130000000000008e-06 2024-02-19T21:41:01.065 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.065 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.065 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:01.065 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.874306+0000", 2024-02-19T21:41:01.065 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.267e-06 2024-02-19T21:41:01.065 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.065 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.065 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:01.065 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.874311+0000", 2024-02-19T21:41:01.065 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.6579999999999999e-05 2024-02-19T21:41:01.065 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.065 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.065 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:01.065 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.874347+0000", 2024-02-19T21:41:01.066 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.3634e-05 2024-02-19T21:41:01.066 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.066 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.066 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:01.066 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.874361+0000", 2024-02-19T21:41:01.066 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.040289366 2024-02-19T21:41:01.066 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.066 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.066 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:01.066 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.914650+0000", 2024-02-19T21:41:01.066 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.5986000000000003e-05 2024-02-19T21:41:01.066 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.066 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.066 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:01.067 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.914696+0000", 2024-02-19T21:41:01.067 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.040447892999999999 2024-02-19T21:41:01.067 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.067 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:01.067 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.067 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.067 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.067 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_repop(client.14793.0:34736 7.4 e109/100 7:25d020ae:::benchmark_data_smithi080_79222_object34735:head v 109'2198, mlcod=108'2195)", 2024-02-19T21:41:01.067 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:35:44.877870+0000", 2024-02-19T21:41:01.067 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 316.17974425699998, 2024-02-19T21:41:01.067 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.037663589999999997, 2024-02-19T21:41:01.067 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:01.067 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:01.067 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:01.067 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.068 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:01.068 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.877870+0000", 2024-02-19T21:41:01.068 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:01.068 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.068 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.068 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:01.068 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.877870+0000", 2024-02-19T21:41:01.068 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:41:01.068 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.068 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.068 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:01.068 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.877869+0000", 2024-02-19T21:41:01.069 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000101241 2024-02-19T21:41:01.069 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.069 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.069 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:01.069 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.877970+0000", 2024-02-19T21:41:01.069 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.033746681000000001 2024-02-19T21:41:01.069 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.069 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.069 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:01.069 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.911717+0000", 2024-02-19T21:41:01.069 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.8480000000000001e-06 2024-02-19T21:41:01.069 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.069 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.070 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:01.070 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.911725+0000", 2024-02-19T21:41:01.070 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.001192348 2024-02-19T21:41:01.070 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.070 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.070 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:01.070 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.912917+0000", 2024-02-19T21:41:01.070 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.3701000000000001e-05 2024-02-19T21:41:01.070 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.070 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.070 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:01.070 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.912961+0000", 2024-02-19T21:41:01.070 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.002526398 2024-02-19T21:41:01.070 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.070 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.071 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:01.071 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.915487+0000", 2024-02-19T21:41:01.071 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.6062e-05 2024-02-19T21:41:01.071 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.071 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.071 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:01.071 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.915534+0000", 2024-02-19T21:41:01.071 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.037663589999999997 2024-02-19T21:41:01.071 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.071 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:01.072 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.072 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.072 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.072 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_repop(client.14793.0:34739 7.8 e109/100 7:1ab50e28:::benchmark_data_smithi080_79222_object34738:head v 109'2171, mlcod=108'2167)", 2024-02-19T21:41:01.072 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:35:44.883720+0000", 2024-02-19T21:41:01.073 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 316.17389465299999, 2024-02-19T21:41:01.073 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.031758270999999998, 2024-02-19T21:41:01.073 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:01.073 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:01.073 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:01.073 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.073 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:01.073 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.883720+0000", 2024-02-19T21:41:01.073 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:01.073 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.073 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.073 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:01.074 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.883720+0000", 2024-02-19T21:41:01.074 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967296 2024-02-19T21:41:01.074 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.074 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.074 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:01.074 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.883719+0000", 2024-02-19T21:41:01.074 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.6373e-05 2024-02-19T21:41:01.074 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.074 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.075 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:01.075 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.883746+0000", 2024-02-19T21:41:01.075 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.029178550000000001 2024-02-19T21:41:01.075 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.075 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.075 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:01.075 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.912924+0000", 2024-02-19T21:41:01.075 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.6990000000000003e-06 2024-02-19T21:41:01.075 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.075 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.075 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:01.076 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.912932+0000", 2024-02-19T21:41:01.076 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.8303e-05 2024-02-19T21:41:01.076 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.076 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.077 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:01.077 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.913000+0000", 2024-02-19T21:41:01.077 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.9565999999999999e-05 2024-02-19T21:41:01.077 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.077 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.077 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:01.077 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.913020+0000", 2024-02-19T21:41:01.077 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0024208060000000002 2024-02-19T21:41:01.077 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.077 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.077 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:01.077 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.915441+0000", 2024-02-19T21:41:01.077 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.7187000000000002e-05 2024-02-19T21:41:01.078 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.078 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.078 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:01.078 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:35:44.915478+0000", 2024-02-19T21:41:01.078 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.031758270999999998 2024-02-19T21:41:01.078 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.078 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:01.078 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.078 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.078 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.078 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_repop(client.14793.0:226855 7.3 e153/100 7:c1026650:::benchmark_data_smithi080_79222_object112121:head v 153'14445, mlcod=153'14442)", 2024-02-19T21:41:01.078 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:39:06.082182+0000", 2024-02-19T21:41:01.078 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 114.975432242, 2024-02-19T21:41:01.078 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.034282293999999998, 2024-02-19T21:41:01.078 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:01.079 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:01.079 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:01.079 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.079 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:01.079 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.082182+0000", 2024-02-19T21:41:01.079 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:01.079 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.079 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.079 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:01.079 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.082182+0000", 2024-02-19T21:41:01.079 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:41:01.079 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.079 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.080 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:01.080 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.082181+0000", 2024-02-19T21:41:01.080 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.3849000000000001e-05 2024-02-19T21:41:01.080 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.080 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.080 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:01.080 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.082194+0000", 2024-02-19T21:41:01.080 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0247e-05 2024-02-19T21:41:01.080 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.080 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.080 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:01.080 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.082205+0000", 2024-02-19T21:41:01.080 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.9680000000000003e-06 2024-02-19T21:41:01.080 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.080 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.081 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:01.081 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.082211+0000", 2024-02-19T21:41:01.081 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.394e-05 2024-02-19T21:41:01.081 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.081 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.081 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:01.081 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.082285+0000", 2024-02-19T21:41:01.081 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.069e-05 2024-02-19T21:41:01.081 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.081 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.081 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:01.081 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.082305+0000", 2024-02-19T21:41:01.081 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.034049511999999997 2024-02-19T21:41:01.082 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.082 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.082 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:01.082 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.116355+0000", 2024-02-19T21:41:01.082 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000109446 2024-02-19T21:41:01.082 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.082 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.082 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:01.082 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.116464+0000", 2024-02-19T21:41:01.082 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.034282293999999998 2024-02-19T21:41:01.082 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.082 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:01.082 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.082 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.082 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.082 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_repop(client.14793.0:226851 7.1 e153/145 7:86f7423e:::benchmark_data_smithi080_79222_object112117:head v 153'14376, mlcod=153'14373)", 2024-02-19T21:41:01.083 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:39:06.082231+0000", 2024-02-19T21:41:01.083 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 114.97538310900001, 2024-02-19T21:41:01.083 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.034168786999999999, 2024-02-19T21:41:01.083 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:01.083 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:01.083 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:01.083 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.083 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:01.083 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.082231+0000", 2024-02-19T21:41:01.083 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:01.083 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.083 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.083 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:01.084 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.082231+0000", 2024-02-19T21:41:01.084 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:41:01.084 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.084 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.084 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:01.084 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.082231+0000", 2024-02-19T21:41:01.084 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.2379999999999997e-06 2024-02-19T21:41:01.084 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.084 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.084 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:01.084 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.082236+0000", 2024-02-19T21:41:01.084 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.0219999999999999e-06 2024-02-19T21:41:01.084 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.084 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.084 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:01.085 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.082243+0000", 2024-02-19T21:41:01.085 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0390000000000004e-06 2024-02-19T21:41:01.085 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.085 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.085 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:01.085 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.082248+0000", 2024-02-19T21:41:01.085 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.002632714 2024-02-19T21:41:01.085 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.085 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.085 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:01.085 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.084881+0000", 2024-02-19T21:41:01.085 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.3470000000000001e-05 2024-02-19T21:41:01.085 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.085 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.085 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:01.086 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.084904+0000", 2024-02-19T21:41:01.086 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.031450707000000001 2024-02-19T21:41:01.086 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.086 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.086 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:01.086 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.116355+0000", 2024-02-19T21:41:01.086 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.5117999999999997e-05 2024-02-19T21:41:01.086 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.086 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.086 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:01.086 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.116400+0000", 2024-02-19T21:41:01.086 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.034168786999999999 2024-02-19T21:41:01.086 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.086 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:01.087 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.087 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.087 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.087 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_repop(client.14793.0:226852 7.4 e153/100 7:27015156:::benchmark_data_smithi080_79222_object112118:head v 153'14385, mlcod=153'14383)", 2024-02-19T21:41:01.087 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:39:06.082276+0000", 2024-02-19T21:41:01.087 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 114.975338604, 2024-02-19T21:41:01.087 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.036166118999999997, 2024-02-19T21:41:01.087 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:01.087 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:01.087 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:01.087 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.087 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:01.087 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.082276+0000", 2024-02-19T21:41:01.087 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:01.088 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.088 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.088 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:01.088 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.082276+0000", 2024-02-19T21:41:01.088 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:41:01.088 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.088 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.088 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:01.088 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.082275+0000", 2024-02-19T21:41:01.088 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.2339999999999997e-06 2024-02-19T21:41:01.088 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.088 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.088 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:01.088 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.082282+0000", 2024-02-19T21:41:01.089 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.2599999999999999e-06 2024-02-19T21:41:01.089 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.089 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.089 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:01.089 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.082290+0000", 2024-02-19T21:41:01.089 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0289999999999996e-06 2024-02-19T21:41:01.089 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.089 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.089 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:01.089 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.082295+0000", 2024-02-19T21:41:01.089 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.5032999999999997e-05 2024-02-19T21:41:01.089 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.089 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.089 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:01.089 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.082380+0000", 2024-02-19T21:41:01.090 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.7370000000000001e-05 2024-02-19T21:41:01.090 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.090 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.090 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:01.090 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.082397+0000", 2024-02-19T21:41:01.090 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.036014500999999997 2024-02-19T21:41:01.090 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.090 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.090 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:01.090 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.118411+0000", 2024-02-19T21:41:01.090 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.0207999999999999e-05 2024-02-19T21:41:01.090 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.090 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.090 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:01.090 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.118442+0000", 2024-02-19T21:41:01.091 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.036166118999999997 2024-02-19T21:41:01.091 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.091 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:01.091 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.091 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.091 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.091 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_repop(client.14793.0:226860 7.4 e153/100 7:28a03ae7:::benchmark_data_smithi080_79222_object112126:head v 153'14386, mlcod=153'14383)", 2024-02-19T21:41:01.091 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:39:06.087811+0000", 2024-02-19T21:41:01.091 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 114.969803646, 2024-02-19T21:41:01.091 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.030651101, 2024-02-19T21:41:01.091 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:01.091 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:01.091 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:01.091 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.091 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:01.092 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.087811+0000", 2024-02-19T21:41:01.092 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:01.092 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.092 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.092 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:01.092 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.087811+0000", 2024-02-19T21:41:01.092 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:41:01.092 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.092 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.092 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:01.092 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.087809+0000", 2024-02-19T21:41:01.092 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1766000000000001e-05 2024-02-19T21:41:01.092 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.092 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.093 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:01.093 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.087821+0000", 2024-02-19T21:41:01.093 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1652e-05 2024-02-19T21:41:01.093 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.093 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.093 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:01.093 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.087833+0000", 2024-02-19T21:41:01.093 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.0290000000000002e-06 2024-02-19T21:41:01.093 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.093 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.093 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:01.093 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.087839+0000", 2024-02-19T21:41:01.093 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.5207000000000002e-05 2024-02-19T21:41:01.093 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.094 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.094 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:01.094 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.087894+0000", 2024-02-19T21:41:01.094 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.8870000000000001e-05 2024-02-19T21:41:01.094 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.094 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.094 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:01.094 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.087913+0000", 2024-02-19T21:41:01.094 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.030531968999999999 2024-02-19T21:41:01.094 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.094 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.094 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:01.094 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.118445+0000", 2024-02-19T21:41:01.094 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.6738000000000001e-05 2024-02-19T21:41:01.095 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.095 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.095 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:01.095 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:39:06.118462+0000", 2024-02-19T21:41:01.095 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.030651101 2024-02-19T21:41:01.095 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.095 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:01.095 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.095 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.095 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.095 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:46820 8.2 8:4aa0b4ec:::benchmark_data_smithi080_100924_object46819:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e173)", 2024-02-19T21:41:01.095 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:40:17.465391+0000", 2024-02-19T21:41:01.095 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 43.592223197999999, 2024-02-19T21:41:01.096 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.037711491999999999, 2024-02-19T21:41:01.096 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:01.096 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:01.096 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:01.096 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:41:01.096 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:41:01.096 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 46820 2024-02-19T21:41:01.096 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.096 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:01.096 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.096 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:01.096 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.465391+0000", 2024-02-19T21:41:01.096 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:01.096 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.096 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.097 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:01.097 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.465391+0000", 2024-02-19T21:41:01.097 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:41:01.097 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.097 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.097 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:01.097 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.465389+0000", 2024-02-19T21:41:01.097 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000108039 2024-02-19T21:41:01.097 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.097 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.097 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:01.097 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.465497+0000", 2024-02-19T21:41:01.097 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.7858000000000001e-05 2024-02-19T21:41:01.097 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.098 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.098 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:01.098 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.465515+0000", 2024-02-19T21:41:01.098 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.7810000000000005e-06 2024-02-19T21:41:01.098 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.098 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.098 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:01.098 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.465523+0000", 2024-02-19T21:41:01.098 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.2500000000000002e-05 2024-02-19T21:41:01.098 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.098 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.098 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:01.098 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.465575+0000", 2024-02-19T21:41:01.098 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000118935 2024-02-19T21:41:01.098 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.099 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.099 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:01.099 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.465694+0000", 2024-02-19T21:41:01.099 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014990199999999999 2024-02-19T21:41:01.099 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.099 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.099 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:41:01.099 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.465844+0000", 2024-02-19T21:41:01.099 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0019113139999999999 2024-02-19T21:41:01.099 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.099 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.099 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:01.099 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.467756+0000", 2024-02-19T21:41:01.099 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0048101970000000004 2024-02-19T21:41:01.099 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.099 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.100 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:01.100 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.472566+0000", 2024-02-19T21:41:01.100 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.030451599999999999 2024-02-19T21:41:01.100 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.100 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.100 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:01.100 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.503017+0000", 2024-02-19T21:41:01.100 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.8217000000000003e-05 2024-02-19T21:41:01.100 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.100 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.100 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:01.100 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.503066+0000", 2024-02-19T21:41:01.100 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.6863000000000003e-05 2024-02-19T21:41:01.100 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.100 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.101 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:01.101 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.503102+0000", 2024-02-19T21:41:01.101 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.037711491999999999 2024-02-19T21:41:01.101 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.101 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:01.101 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.101 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.101 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.101 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:47310 8.2 8:41040c92:::benchmark_data_smithi080_100924_object47309:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e173)", 2024-02-19T21:41:01.101 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:40:17.784374+0000", 2024-02-19T21:41:01.101 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 43.273239740000001, 2024-02-19T21:41:01.101 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.068229363000000001, 2024-02-19T21:41:01.101 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:01.101 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:01.101 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:01.102 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:41:01.102 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:41:01.102 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 47310 2024-02-19T21:41:01.102 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.102 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:01.102 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.102 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:01.102 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.784374+0000", 2024-02-19T21:41:01.102 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:01.102 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.102 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.102 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:01.102 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.784374+0000", 2024-02-19T21:41:01.102 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:41:01.103 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.103 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.103 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:01.103 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.784373+0000", 2024-02-19T21:41:01.103 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.2885999999999994e-05 2024-02-19T21:41:01.103 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.103 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.103 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:01.103 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.784436+0000", 2024-02-19T21:41:01.103 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1836e-05 2024-02-19T21:41:01.103 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.104 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.104 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:01.104 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.784447+0000", 2024-02-19T21:41:01.104 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.3160000000000002e-06 2024-02-19T21:41:01.104 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.104 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.104 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:01.104 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.784454+0000", 2024-02-19T21:41:01.104 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.5770999999999999e-05 2024-02-19T21:41:01.104 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.104 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.104 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:01.104 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.784500+0000", 2024-02-19T21:41:01.104 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000113029 2024-02-19T21:41:01.105 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.105 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.105 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:01.105 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.784613+0000", 2024-02-19T21:41:01.105 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014545899999999999 2024-02-19T21:41:01.105 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.105 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.105 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:41:01.105 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.784758+0000", 2024-02-19T21:41:01.105 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0014968780000000001 2024-02-19T21:41:01.105 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.105 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.105 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:01.105 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.786255+0000", 2024-02-19T21:41:01.106 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000302749 2024-02-19T21:41:01.106 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.106 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.106 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:01.106 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.786558+0000", 2024-02-19T21:41:01.106 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.065924609999999995 2024-02-19T21:41:01.106 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.106 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.106 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:01.106 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.852482+0000", 2024-02-19T21:41:01.106 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.2185999999999998e-05 2024-02-19T21:41:01.106 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.106 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.106 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:01.107 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.852534+0000", 2024-02-19T21:41:01.107 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.9381999999999994e-05 2024-02-19T21:41:01.107 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.107 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.107 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:01.107 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.852604+0000", 2024-02-19T21:41:01.107 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.068229363000000001 2024-02-19T21:41:01.107 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.107 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:01.107 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.107 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.107 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.107 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:47315 8.2 8:408336ae:::benchmark_data_smithi080_100924_object47314:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e173)", 2024-02-19T21:41:01.107 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:40:17.788274+0000", 2024-02-19T21:41:01.107 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 43.269340421999999, 2024-02-19T21:41:01.108 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.064493159999999994, 2024-02-19T21:41:01.108 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:01.108 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:01.108 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:01.108 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:41:01.108 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:41:01.108 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 47315 2024-02-19T21:41:01.108 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.108 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:01.108 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.108 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:01.108 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.788274+0000", 2024-02-19T21:41:01.109 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:01.109 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.109 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.109 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:01.109 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.788274+0000", 2024-02-19T21:41:01.109 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:41:01.109 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.109 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.109 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:01.109 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.788272+0000", 2024-02-19T21:41:01.109 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.3307000000000003e-05 2024-02-19T21:41:01.110 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.110 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.110 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:01.110 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.788325+0000", 2024-02-19T21:41:01.110 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1620999999999999e-05 2024-02-19T21:41:01.110 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.110 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.110 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:01.110 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.788337+0000", 2024-02-19T21:41:01.110 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.8810000000000004e-06 2024-02-19T21:41:01.110 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.110 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.110 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:01.110 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.788342+0000", 2024-02-19T21:41:01.110 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.1180999999999998e-05 2024-02-19T21:41:01.111 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.111 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.111 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:01.111 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.788373+0000", 2024-02-19T21:41:01.111 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.5106999999999997e-05 2024-02-19T21:41:01.111 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.111 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.111 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:01.111 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.788458+0000", 2024-02-19T21:41:01.111 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00010922800000000001 2024-02-19T21:41:01.111 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.111 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.111 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:41:01.111 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.788567+0000", 2024-02-19T21:41:01.111 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0013808539999999999 2024-02-19T21:41:01.112 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.112 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.112 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:01.112 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.789948+0000", 2024-02-19T21:41:01.112 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00042332099999999999 2024-02-19T21:41:01.112 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.112 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.112 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:01.112 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.790371+0000", 2024-02-19T21:41:01.112 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.062291976999999998 2024-02-19T21:41:01.112 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.112 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.112 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:01.112 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.852663+0000", 2024-02-19T21:41:01.113 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.5509000000000001e-05 2024-02-19T21:41:01.113 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.113 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.113 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:01.113 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.852709+0000", 2024-02-19T21:41:01.113 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.8094999999999999e-05 2024-02-19T21:41:01.113 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.113 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.113 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:01.113 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.852767+0000", 2024-02-19T21:41:01.113 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.064493159999999994 2024-02-19T21:41:01.113 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.113 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:01.113 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.113 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.113 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.114 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:47324 8.2 8:48cdf98f:::benchmark_data_smithi080_100924_object47323:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e173)", 2024-02-19T21:41:01.114 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:40:17.849943+0000", 2024-02-19T21:41:01.114 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 43.207671535000003, 2024-02-19T21:41:01.114 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.040769649999999998, 2024-02-19T21:41:01.114 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:01.114 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:01.114 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:01.114 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:41:01.114 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:41:01.114 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 47324 2024-02-19T21:41:01.114 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.114 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:01.114 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.114 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:01.114 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.849943+0000", 2024-02-19T21:41:01.115 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:01.115 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.115 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.115 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:01.115 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.849943+0000", 2024-02-19T21:41:01.115 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999938 2024-02-19T21:41:01.115 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.115 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.115 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:01.115 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.849936+0000", 2024-02-19T21:41:01.115 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.4240999999999999e-05 2024-02-19T21:41:01.115 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.115 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.115 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:01.115 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.849981+0000", 2024-02-19T21:41:01.116 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.2045e-05 2024-02-19T21:41:01.116 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.116 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.116 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:01.116 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.850003+0000", 2024-02-19T21:41:01.116 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.6440000000000006e-06 2024-02-19T21:41:01.116 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.116 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.116 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:01.116 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.850011+0000", 2024-02-19T21:41:01.116 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00051476699999999996 2024-02-19T21:41:01.116 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.116 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.116 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:01.116 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.850526+0000", 2024-02-19T21:41:01.117 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013574099999999999 2024-02-19T21:41:01.117 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.117 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.117 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:01.117 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.850662+0000", 2024-02-19T21:41:01.117 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000153886 2024-02-19T21:41:01.117 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.117 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.117 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:41:01.117 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.850816+0000", 2024-02-19T21:41:01.117 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0039254160000000001 2024-02-19T21:41:01.117 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.117 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.117 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:01.117 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.854741+0000", 2024-02-19T21:41:01.117 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.2199999999999997e-06 2024-02-19T21:41:01.118 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.118 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.118 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:01.118 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.854747+0000", 2024-02-19T21:41:01.118 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.035862219000000001 2024-02-19T21:41:01.118 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.118 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.118 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:01.118 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.890610+0000", 2024-02-19T21:41:01.118 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.6935000000000003e-05 2024-02-19T21:41:01.118 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.118 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.118 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:01.118 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.890667+0000", 2024-02-19T21:41:01.119 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.5711999999999999e-05 2024-02-19T21:41:01.119 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.119 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.119 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:01.119 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.890712+0000", 2024-02-19T21:41:01.119 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.040769649999999998 2024-02-19T21:41:01.119 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.119 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:01.119 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.119 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.119 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.119 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:47325 8.2 8:473d50a3:::benchmark_data_smithi080_100924_object47324:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e173)", 2024-02-19T21:41:01.119 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:40:17.850030+0000", 2024-02-19T21:41:01.119 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 43.207583943000003, 2024-02-19T21:41:01.119 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.044494519000000003, 2024-02-19T21:41:01.120 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:01.120 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:01.120 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:01.120 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:41:01.120 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:41:01.120 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 47325 2024-02-19T21:41:01.120 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.120 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:01.120 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.120 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:01.120 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.850030+0000", 2024-02-19T21:41:01.120 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:01.120 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.120 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.120 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:01.121 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.850030+0000", 2024-02-19T21:41:01.121 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:41:01.121 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.121 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.121 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:01.121 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.850030+0000", 2024-02-19T21:41:01.121 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.2758e-05 2024-02-19T21:41:01.121 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.121 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.121 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:01.121 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.850062+0000", 2024-02-19T21:41:01.121 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.9929999999999998e-06 2024-02-19T21:41:01.121 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.121 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.122 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:01.122 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.850069+0000", 2024-02-19T21:41:01.122 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.4599999999999996e-06 2024-02-19T21:41:01.122 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.122 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.122 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:01.122 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.850074+0000", 2024-02-19T21:41:01.122 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0027407529999999999 2024-02-19T21:41:01.122 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.122 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.122 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:01.122 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.852815+0000", 2024-02-19T21:41:01.122 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00012288199999999999 2024-02-19T21:41:01.122 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.122 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.123 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:01.123 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.852937+0000", 2024-02-19T21:41:01.123 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014307100000000001 2024-02-19T21:41:01.123 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.123 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.123 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:41:01.123 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.853081+0000", 2024-02-19T21:41:01.123 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.002035635 2024-02-19T21:41:01.123 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.123 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.123 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:01.123 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.855116+0000", 2024-02-19T21:41:01.123 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00072517000000000002 2024-02-19T21:41:01.123 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.123 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.124 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:01.124 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.855841+0000", 2024-02-19T21:41:01.124 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.038596452000000003 2024-02-19T21:41:01.124 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.124 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.124 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:01.124 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.894438+0000", 2024-02-19T21:41:01.124 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.6449000000000002e-05 2024-02-19T21:41:01.124 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.124 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.124 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:01.124 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.894484+0000", 2024-02-19T21:41:01.124 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0544999999999999e-05 2024-02-19T21:41:01.124 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.124 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.125 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:01.125 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:17.894525+0000", 2024-02-19T21:41:01.125 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.044494519000000003 2024-02-19T21:41:01.125 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.125 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:01.125 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.125 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.125 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.125 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:57711 8.b 8:dd0aa57b:::benchmark_data_smithi080_100924_object57710:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e179)", 2024-02-19T21:41:01.125 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:40:25.052300+0000", 2024-02-19T21:41:01.125 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 36.005314392000002, 2024-02-19T21:41:01.125 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.054877700000000001, 2024-02-19T21:41:01.125 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:01.125 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:01.125 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:01.126 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:41:01.126 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:41:01.126 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 57711 2024-02-19T21:41:01.126 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.126 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:01.126 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.126 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:01.126 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:25.052300+0000", 2024-02-19T21:41:01.126 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:01.126 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.126 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.126 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:01.126 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:25.052300+0000", 2024-02-19T21:41:01.126 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999976 2024-02-19T21:41:01.126 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.127 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.127 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:01.127 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:25.052298+0000", 2024-02-19T21:41:01.127 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0426000000000002e-05 2024-02-19T21:41:01.127 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.127 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.127 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:01.127 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:25.052338+0000", 2024-02-19T21:41:01.127 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2282e-05 2024-02-19T21:41:01.127 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.127 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.127 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:01.127 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:25.052350+0000", 2024-02-19T21:41:01.127 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.852e-06 2024-02-19T21:41:01.127 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.128 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.128 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:01.128 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:25.052356+0000", 2024-02-19T21:41:01.128 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0396000000000003e-05 2024-02-19T21:41:01.128 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.128 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.128 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:01.128 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:25.052407+0000", 2024-02-19T21:41:01.128 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000157257 2024-02-19T21:41:01.128 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.128 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.128 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:01.128 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:25.052564+0000", 2024-02-19T21:41:01.128 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000170197 2024-02-19T21:41:01.129 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.129 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.129 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,7", 2024-02-19T21:41:01.129 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:25.052734+0000", 2024-02-19T21:41:01.129 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.012052389 2024-02-19T21:41:01.129 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.129 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.129 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:01.129 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:25.064786+0000", 2024-02-19T21:41:01.129 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000400505 2024-02-19T21:41:01.129 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.129 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.129 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:01.129 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:25.065187+0000", 2024-02-19T21:41:01.129 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.041883255000000001 2024-02-19T21:41:01.130 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.130 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.130 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:01.130 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:25.107070+0000", 2024-02-19T21:41:01.130 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.0151000000000001e-05 2024-02-19T21:41:01.130 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.130 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.130 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:01.130 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:25.107130+0000", 2024-02-19T21:41:01.130 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.7162e-05 2024-02-19T21:41:01.130 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.130 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.130 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:01.130 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:25.107177+0000", 2024-02-19T21:41:01.130 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.054877700000000001 2024-02-19T21:41:01.130 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.131 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:01.131 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.131 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.131 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.131 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:64494 8.2 8:4b11eb3d:::benchmark_data_smithi080_100924_object64493:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e180)", 2024-02-19T21:41:01.131 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:40:30.054045+0000", 2024-02-19T21:41:01.131 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 31.003568959999999, 2024-02-19T21:41:01.131 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.056185938999999997, 2024-02-19T21:41:01.131 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:01.131 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:01.131 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:01.131 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:41:01.131 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:41:01.132 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 64494 2024-02-19T21:41:01.132 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.132 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:01.132 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.132 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:01.132 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:30.054045+0000", 2024-02-19T21:41:01.132 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:01.132 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.133 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.133 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:01.133 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:30.054045+0000", 2024-02-19T21:41:01.133 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999976 2024-02-19T21:41:01.133 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.133 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.133 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:01.133 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:30.054043+0000", 2024-02-19T21:41:01.133 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.8565000000000001e-05 2024-02-19T21:41:01.133 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.133 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.133 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:01.133 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:30.054081+0000", 2024-02-19T21:41:01.134 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.3334000000000001e-05 2024-02-19T21:41:01.134 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.134 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.134 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:01.134 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:30.054105+0000", 2024-02-19T21:41:01.134 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0531e-05 2024-02-19T21:41:01.134 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.134 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.134 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:01.134 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:30.054115+0000", 2024-02-19T21:41:01.134 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.1618999999999994e-05 2024-02-19T21:41:01.134 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.134 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.135 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:01.135 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:30.054177+0000", 2024-02-19T21:41:01.135 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013793200000000001 2024-02-19T21:41:01.135 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.135 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.135 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:01.135 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:30.054315+0000", 2024-02-19T21:41:01.135 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00015368000000000001 2024-02-19T21:41:01.135 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.135 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.135 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:41:01.135 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:30.054468+0000", 2024-02-19T21:41:01.136 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.003086849 2024-02-19T21:41:01.136 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.136 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.136 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:01.136 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:30.057555+0000", 2024-02-19T21:41:01.136 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0067315980000000001 2024-02-19T21:41:01.136 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.136 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.136 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:01.136 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:30.064287+0000", 2024-02-19T21:41:01.136 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.045882313000000001 2024-02-19T21:41:01.136 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.137 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.137 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:01.137 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:30.110169+0000", 2024-02-19T21:41:01.137 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.6075999999999998e-05 2024-02-19T21:41:01.137 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.137 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.137 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:01.137 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:30.110205+0000", 2024-02-19T21:41:01.137 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.6013e-05 2024-02-19T21:41:01.137 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.137 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.137 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:01.137 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:30.110231+0000", 2024-02-19T21:41:01.138 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.056185938999999997 2024-02-19T21:41:01.138 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.138 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:01.138 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.138 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.138 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.138 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:64507 8.2 8:4585ec54:::benchmark_data_smithi080_100924_object64506:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e180)", 2024-02-19T21:41:01.138 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:40:30.072080+0000", 2024-02-19T21:41:01.138 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 30.985534073, 2024-02-19T21:41:01.138 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.045567251000000003, 2024-02-19T21:41:01.139 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:01.139 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:01.139 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:01.139 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:41:01.139 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:41:01.139 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 64507 2024-02-19T21:41:01.139 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.139 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:01.139 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.139 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:01.139 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:30.072080+0000", 2024-02-19T21:41:01.140 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:01.140 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.140 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.140 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:01.140 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:30.072080+0000", 2024-02-19T21:41:01.140 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:41:01.140 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.140 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.140 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:01.140 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:30.072078+0000", 2024-02-19T21:41:01.140 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.7859999999999999e-05 2024-02-19T21:41:01.140 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.141 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.141 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:01.141 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:30.072126+0000", 2024-02-19T21:41:01.141 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.3237000000000001e-05 2024-02-19T21:41:01.141 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.141 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.141 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:01.141 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:30.072149+0000", 2024-02-19T21:41:01.141 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.038e-06 2024-02-19T21:41:01.141 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.141 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.141 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:01.141 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:30.072157+0000", 2024-02-19T21:41:01.142 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.7463000000000003e-05 2024-02-19T21:41:01.142 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.142 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.142 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:01.142 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:30.072205+0000", 2024-02-19T21:41:01.142 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000152208 2024-02-19T21:41:01.142 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.142 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.142 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:01.142 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:30.072357+0000", 2024-02-19T21:41:01.142 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00017037500000000001 2024-02-19T21:41:01.142 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.143 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.143 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:41:01.143 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:30.072527+0000", 2024-02-19T21:41:01.143 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0037671639999999999 2024-02-19T21:41:01.143 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.143 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.143 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:01.143 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:30.076294+0000", 2024-02-19T21:41:01.143 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.002694798 2024-02-19T21:41:01.143 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.143 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.143 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:01.143 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:30.078989+0000", 2024-02-19T21:41:01.143 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.038578743999999998 2024-02-19T21:41:01.144 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.144 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.144 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:01.144 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:30.117568+0000", 2024-02-19T21:41:01.144 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.1158000000000001e-05 2024-02-19T21:41:01.144 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.144 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.144 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:01.144 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:30.117609+0000", 2024-02-19T21:41:01.144 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.8318000000000001e-05 2024-02-19T21:41:01.144 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.144 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.144 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:01.145 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:30.117647+0000", 2024-02-19T21:41:01.145 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.045567251000000003 2024-02-19T21:41:01.145 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.145 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:01.145 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.145 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.145 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.145 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:67381 8.2 8:41a5cd01:::benchmark_data_smithi080_100924_object67380:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e181)", 2024-02-19T21:41:01.145 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:40:32.376310+0000", 2024-02-19T21:41:01.145 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 28.681304354000002, 2024-02-19T21:41:01.145 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.039641988000000003, 2024-02-19T21:41:01.145 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:01.146 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:01.146 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:01.146 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:41:01.146 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:41:01.146 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 67381 2024-02-19T21:41:01.146 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.146 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:01.146 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.146 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:01.146 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:32.376310+0000", 2024-02-19T21:41:01.146 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:01.147 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.147 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.147 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:01.147 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:32.376310+0000", 2024-02-19T21:41:01.147 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:41:01.147 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.147 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.147 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:01.147 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:32.376308+0000", 2024-02-19T21:41:01.147 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.3466e-05 2024-02-19T21:41:01.147 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.148 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.148 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:01.148 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:32.376352+0000", 2024-02-19T21:41:01.148 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2629000000000001e-05 2024-02-19T21:41:01.148 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.148 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.148 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:01.148 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:32.376364+0000", 2024-02-19T21:41:01.148 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.5910000000000003e-06 2024-02-19T21:41:01.148 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.148 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.148 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:01.149 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:32.376370+0000", 2024-02-19T21:41:01.149 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.8631000000000002e-05 2024-02-19T21:41:01.149 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.149 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.149 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:01.149 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:32.376418+0000", 2024-02-19T21:41:01.149 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00015753100000000001 2024-02-19T21:41:01.149 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.149 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.149 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:01.149 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:32.376576+0000", 2024-02-19T21:41:01.149 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00018581500000000001 2024-02-19T21:41:01.150 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.150 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.150 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:41:01.150 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:32.376762+0000", 2024-02-19T21:41:01.150 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0023996379999999999 2024-02-19T21:41:01.150 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.150 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.150 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:01.150 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:32.379161+0000", 2024-02-19T21:41:01.150 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000179867 2024-02-19T21:41:01.150 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.150 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.150 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:01.151 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:32.379341+0000", 2024-02-19T21:41:01.151 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.036509924999999999 2024-02-19T21:41:01.151 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.151 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.151 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:01.151 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:32.415851+0000", 2024-02-19T21:41:01.151 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.5359999999999999e-05 2024-02-19T21:41:01.151 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.151 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.151 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:01.152 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:32.415907+0000", 2024-02-19T21:41:01.152 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.5266000000000003e-05 2024-02-19T21:41:01.152 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.152 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.152 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:01.152 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:32.415952+0000", 2024-02-19T21:41:01.152 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.039641988000000003 2024-02-19T21:41:01.152 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.152 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:01.152 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.152 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.153 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.153 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:93278 8.2 8:407c63e1:::benchmark_data_smithi080_100924_object93277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e184)", 2024-02-19T21:41:01.153 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:40:54.551499+0000", 2024-02-19T21:41:01.153 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 6.5061151700000002, 2024-02-19T21:41:01.153 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.031134078999999999, 2024-02-19T21:41:01.153 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:01.153 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:01.153 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:01.153 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:41:01.153 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:41:01.153 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 93278 2024-02-19T21:41:01.153 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.154 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:01.154 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.154 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:01.154 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.551499+0000", 2024-02-19T21:41:01.154 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:01.154 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.154 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.154 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:01.154 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.551499+0000", 2024-02-19T21:41:01.154 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:41:01.154 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.154 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.155 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:01.155 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.551498+0000", 2024-02-19T21:41:01.155 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.731e-05 2024-02-19T21:41:01.155 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.155 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.155 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:01.155 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.551535+0000", 2024-02-19T21:41:01.155 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.3570000000000004e-06 2024-02-19T21:41:01.155 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.155 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.155 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:01.155 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.551544+0000", 2024-02-19T21:41:01.156 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0919999999999997e-06 2024-02-19T21:41:01.156 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.156 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.156 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:01.156 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.551549+0000", 2024-02-19T21:41:01.156 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.006266672 2024-02-19T21:41:01.156 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.156 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.156 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:01.156 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.557816+0000", 2024-02-19T21:41:01.156 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013050799999999999 2024-02-19T21:41:01.156 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.157 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.157 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:01.157 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.557947+0000", 2024-02-19T21:41:01.157 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00016599900000000001 2024-02-19T21:41:01.157 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.157 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.157 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:41:01.157 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.558113+0000", 2024-02-19T21:41:01.157 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.002979434 2024-02-19T21:41:01.157 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.157 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.157 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:01.157 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.561092+0000", 2024-02-19T21:41:01.158 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0041209940000000002 2024-02-19T21:41:01.158 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.158 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.158 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:01.158 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.565213+0000", 2024-02-19T21:41:01.158 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.017308734999999999 2024-02-19T21:41:01.158 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.158 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.158 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:01.158 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.582522+0000", 2024-02-19T21:41:01.158 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.0846e-05 2024-02-19T21:41:01.158 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.159 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.159 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:01.159 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.582583+0000", 2024-02-19T21:41:01.159 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0569000000000003e-05 2024-02-19T21:41:01.159 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.159 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.159 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:01.159 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.582633+0000", 2024-02-19T21:41:01.159 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.031134078999999999 2024-02-19T21:41:01.159 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.159 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:01.159 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.160 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.160 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.160 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:93286 8.b 8:da6aa296:::benchmark_data_smithi080_100924_object93285:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e184)", 2024-02-19T21:41:01.160 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:40:54.553013+0000", 2024-02-19T21:41:01.160 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 6.5046007909999997, 2024-02-19T21:41:01.160 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.031375159999999999, 2024-02-19T21:41:01.160 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:01.160 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:01.160 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:01.160 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:41:01.160 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:41:01.161 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 93286 2024-02-19T21:41:01.161 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.161 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:01.161 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.161 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:01.161 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.553013+0000", 2024-02-19T21:41:01.161 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:01.161 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.161 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.161 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:01.161 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.553013+0000", 2024-02-19T21:41:01.161 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:41:01.161 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.162 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.162 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:01.162 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.553012+0000", 2024-02-19T21:41:01.162 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0018948369999999999 2024-02-19T21:41:01.162 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.162 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.162 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:01.162 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.554907+0000", 2024-02-19T21:41:01.162 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.5192e-05 2024-02-19T21:41:01.162 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.162 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.163 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:01.163 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.554922+0000", 2024-02-19T21:41:01.163 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.1659999999999999e-06 2024-02-19T21:41:01.163 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.163 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.163 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:01.163 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.554928+0000", 2024-02-19T21:41:01.163 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.9011000000000002e-05 2024-02-19T21:41:01.163 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.163 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.164 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:01.164 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.554977+0000", 2024-02-19T21:41:01.164 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000128236 2024-02-19T21:41:01.164 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.164 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.164 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:01.164 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.555105+0000", 2024-02-19T21:41:01.164 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00017467000000000001 2024-02-19T21:41:01.164 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.164 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.164 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,7", 2024-02-19T21:41:01.164 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.555280+0000", 2024-02-19T21:41:01.165 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0052760610000000003 2024-02-19T21:41:01.165 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.165 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.165 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:01.165 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.560556+0000", 2024-02-19T21:41:01.165 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00038487100000000001 2024-02-19T21:41:01.165 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.165 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.165 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:01.165 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.560941+0000", 2024-02-19T21:41:01.165 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.023385030000000001 2024-02-19T21:41:01.165 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.166 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.166 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:01.166 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.584326+0000", 2024-02-19T21:41:01.166 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.4774999999999998e-05 2024-02-19T21:41:01.166 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.166 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.166 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:01.166 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.584361+0000", 2024-02-19T21:41:01.166 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.7730999999999999e-05 2024-02-19T21:41:01.166 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.166 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.167 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:01.167 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:54.584389+0000", 2024-02-19T21:41:01.167 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.031375159999999999 2024-02-19T21:41:01.167 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.167 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:01.167 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.167 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.167 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.167 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:94445 8.b 8:d33a77f2:::benchmark_data_smithi080_100924_object94444:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e184)", 2024-02-19T21:41:01.167 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:40:55.723335+0000", 2024-02-19T21:41:01.167 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 5.3342793799999999, 2024-02-19T21:41:01.167 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.031493326000000002, 2024-02-19T21:41:01.167 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:01.168 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:01.168 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:01.168 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:41:01.168 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:41:01.168 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 94445 2024-02-19T21:41:01.168 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.168 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:01.168 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.168 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:01.168 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:55.723335+0000", 2024-02-19T21:41:01.168 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:01.168 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.169 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.169 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:01.169 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:55.723335+0000", 2024-02-19T21:41:01.169 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999971 2024-02-19T21:41:01.169 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.169 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.169 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:01.169 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:55.723332+0000", 2024-02-19T21:41:01.169 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.9614000000000003e-05 2024-02-19T21:41:01.169 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.169 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.170 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:01.170 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:55.723382+0000", 2024-02-19T21:41:01.170 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1437000000000002e-05 2024-02-19T21:41:01.170 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.170 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.170 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:01.170 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:55.723403+0000", 2024-02-19T21:41:01.170 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.7800000000000001e-06 2024-02-19T21:41:01.170 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.170 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.170 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:01.170 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:55.723411+0000", 2024-02-19T21:41:01.171 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0029985770000000001 2024-02-19T21:41:01.171 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.171 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.171 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:01.171 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:55.726409+0000", 2024-02-19T21:41:01.171 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013626799999999999 2024-02-19T21:41:01.171 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.171 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.171 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:01.171 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:55.726546+0000", 2024-02-19T21:41:01.171 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00016617699999999999 2024-02-19T21:41:01.171 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.171 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.172 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,7", 2024-02-19T21:41:01.172 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:55.726712+0000", 2024-02-19T21:41:01.172 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.012727501 2024-02-19T21:41:01.172 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.172 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.172 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:01.172 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:55.739439+0000", 2024-02-19T21:41:01.172 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0020682909999999999 2024-02-19T21:41:01.172 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.172 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.172 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:01.172 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:55.741508+0000", 2024-02-19T21:41:01.173 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.013226536000000001 2024-02-19T21:41:01.173 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.173 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.173 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:01.173 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:55.754734+0000", 2024-02-19T21:41:01.173 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.2991000000000001e-05 2024-02-19T21:41:01.173 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.173 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.173 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:01.173 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:55.754787+0000", 2024-02-19T21:41:01.173 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0946999999999999e-05 2024-02-19T21:41:01.173 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.173 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.174 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:01.174 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:55.754828+0000", 2024-02-19T21:41:01.174 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.031493326000000002 2024-02-19T21:41:01.174 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.174 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:01.174 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.174 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.174 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.174 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:98547 8.b 8:d8fcf22e:::benchmark_data_smithi080_100924_object98546:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e185)", 2024-02-19T21:41:01.174 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:40:59.470032+0000", 2024-02-19T21:41:01.174 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 1.587582024, 2024-02-19T21:41:01.175 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.030898355999999998, 2024-02-19T21:41:01.175 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:01.175 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:01.175 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:01.175 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:41:01.175 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:41:01.175 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 98547 2024-02-19T21:41:01.175 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.175 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:01.175 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.175 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:01.175 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:59.470032+0000", 2024-02-19T21:41:01.176 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:01.176 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.176 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.176 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:01.176 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:59.470032+0000", 2024-02-19T21:41:01.176 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:41:01.176 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.176 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.176 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:01.176 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:59.470031+0000", 2024-02-19T21:41:01.176 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.2636999999999999e-05 2024-02-19T21:41:01.176 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.177 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.177 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:01.177 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:59.470073+0000", 2024-02-19T21:41:01.177 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.3403e-05 2024-02-19T21:41:01.177 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.177 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.177 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:01.177 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:59.470087+0000", 2024-02-19T21:41:01.177 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.7989999999999999e-06 2024-02-19T21:41:01.177 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.177 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.177 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:01.177 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:59.470093+0000", 2024-02-19T21:41:01.178 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0044858989999999998 2024-02-19T21:41:01.178 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.178 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.178 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:01.178 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:59.474578+0000", 2024-02-19T21:41:01.178 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00010773900000000001 2024-02-19T21:41:01.178 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.178 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.178 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:01.178 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:59.474686+0000", 2024-02-19T21:41:01.178 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00010705999999999999 2024-02-19T21:41:01.178 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.179 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.179 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,7", 2024-02-19T21:41:01.179 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:59.474793+0000", 2024-02-19T21:41:01.179 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0066658280000000004 2024-02-19T21:41:01.179 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.179 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.179 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:01.179 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:59.481459+0000", 2024-02-19T21:41:01.179 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.3034999999999995e-05 2024-02-19T21:41:01.179 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.179 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.179 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:01.179 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:59.481522+0000", 2024-02-19T21:41:01.180 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.019313882000000001 2024-02-19T21:41:01.180 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.180 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.180 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:01.180 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:59.500836+0000", 2024-02-19T21:41:01.180 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.2818999999999997e-05 2024-02-19T21:41:01.180 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.180 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.180 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:01.180 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:59.500889+0000", 2024-02-19T21:41:01.180 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.1733999999999997e-05 2024-02-19T21:41:01.180 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:01.181 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:01.181 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:01.181 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:40:59.500931+0000", 2024-02-19T21:41:01.181 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.030898355999999998 2024-02-19T21:41:01.181 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.181 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:01.181 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.181 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:01.181 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:01.181 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:41:01.182 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:41:01.245 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:01.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:00.260605+0000 mgr.y (mgr.14514) 326 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:41:01.338 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:41:01.346 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:01.347 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:41:01.383 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:00.260605+0000 mgr.y (mgr.14514) 326 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:41:01.383 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:00.260605+0000 mgr.y (mgr.14514) 326 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:41:01.447 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:41:01.496 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:01.669 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:41:01.674 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:41:01.679 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:01.680 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:41:01.738 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:41:01.760 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:41:01.781 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:41:01.791 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:41:01.812 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:41:01.839 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:41:01.841 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:01.883 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:41:01.889 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:41:01.891 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.5 dump_ops_in_flight 2024-02-19T21:41:01.894 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:01.894 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:41:01.922 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:41:01.959 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:41:01.965 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 65 16 101233 101217 97.3008 65.4375 0.0203491 0.010273 2024-02-19T21:41:01.994 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:41:01.995 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:41:02.007 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:41:02.007 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:41:02.008 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:41:02.008 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:41:02.008 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:41:02.008 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:41:02.008 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:41:02.008 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:41:02.044 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:02.270 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:00.976394+0000 mgr.y (mgr.14514) 327 : cluster [DBG] pgmap v362: 148 pgs: 148 active+clean; 6.0 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 1023 B/s rd, 68 MiB/s wr, 1.09k op/s 2024-02-19T21:41:02.270 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:01.720539+0000 mon.a (mon.0) 1041 : audit [DBG] from='client.? 172.21.15.80:0/1012972346' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:41:02.270 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:00.976394+0000 mgr.y (mgr.14514) 327 : cluster [DBG] pgmap v362: 148 pgs: 148 active+clean; 6.0 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 1023 B/s rd, 68 MiB/s wr, 1.09k op/s 2024-02-19T21:41:02.270 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:01.720539+0000 mon.a (mon.0) 1041 : audit [DBG] from='client.? 172.21.15.80:0/1012972346' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:41:02.336 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:41:02.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:00.976394+0000 mgr.y (mgr.14514) 327 : cluster [DBG] pgmap v362: 148 pgs: 148 active+clean; 6.0 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 1023 B/s rd, 68 MiB/s wr, 1.09k op/s 2024-02-19T21:41:02.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:01.720539+0000 mon.a (mon.0) 1041 : audit [DBG] from='client.? 172.21.15.80:0/1012972346' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:41:02.800 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:41:02.803 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:02.804 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:41:02.904 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:41:02.959 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:02.965 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 66 16 102298 102282 96.8351 66.5625 0.0114063 0.0103224 2024-02-19T21:41:02.995 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:41:03.003 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:03.004 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:41:03.105 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:41:03.159 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:03.370 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:41:03.377 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:03.377 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:41:03.479 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:41:03.530 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:03.597 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:41:03.608 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:03.609 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:41:03.710 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:41:03.768 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:03.966 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 67 16 103315 103299 96.3384 63.5625 0.0380975 0.0103759 2024-02-19T21:41:03.989 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:41:03.995 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:03.995 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:41:04.096 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:41:04.147 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:04.187 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:41:04.189 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:04.189 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:41:04.290 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:41:04.327 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:04.399 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:02.976780+0000 mgr.y (mgr.14514) 328 : cluster [DBG] pgmap v363: 148 pgs: 148 active+clean; 6.0 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 1023 B/s rd, 68 MiB/s wr, 1.09k op/s 2024-02-19T21:41:04.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:02.976780+0000 mgr.y (mgr.14514) 328 : cluster [DBG] pgmap v363: 148 pgs: 148 active+clean; 6.0 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 1023 B/s rd, 68 MiB/s wr, 1.09k op/s 2024-02-19T21:41:04.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:02.976780+0000 mgr.y (mgr.14514) 328 : cluster [DBG] pgmap v363: 148 pgs: 148 active+clean; 6.0 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 1023 B/s rd, 68 MiB/s wr, 1.09k op/s 2024-02-19T21:41:04.712 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:41:04.712 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:41:04.966 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 68 16 104372 104356 95.8931 66.0625 0.014413 0.0104242 2024-02-19T21:41:05.484 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.5 dump_blocked_ops 2024-02-19T21:41:05.807 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:41:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:41:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:41:05.921 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:41:05.966 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 69 16 105349 105333 95.3883 61.0625 0.0382494 0.0104788 2024-02-19T21:41:06.518 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:04.977365+0000 mgr.y (mgr.14514) 329 : cluster [DBG] pgmap v364: 148 pgs: 148 active+clean; 6.3 GiB data, 21 GiB used, 605 GiB / 626 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-19T21:41:06.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:04.977365+0000 mgr.y (mgr.14514) 329 : cluster [DBG] pgmap v364: 148 pgs: 148 active+clean; 6.3 GiB data, 21 GiB used, 605 GiB / 626 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-19T21:41:06.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:04.977365+0000 mgr.y (mgr.14514) 329 : cluster [DBG] pgmap v364: 148 pgs: 148 active+clean; 6.3 GiB data, 21 GiB used, 605 GiB / 626 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-19T21:41:06.966 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 70 16 106383 106367 94.9488 64.625 0.00650734 0.010526 2024-02-19T21:41:07.526 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:06.454856+0000 mon.a (mon.0) 1042 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:41:07.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:06.454856+0000 mon.a (mon.0) 1042 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:41:07.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:06.454856+0000 mon.a (mon.0) 1042 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:41:07.966 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 71 16 107481 107465 94.578 68.625 0.0044061 0.0105685 2024-02-19T21:41:08.215 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:06.977755+0000 mgr.y (mgr.14514) 330 : cluster [DBG] pgmap v365: 148 pgs: 148 active+clean; 6.4 GiB data, 21 GiB used, 605 GiB / 626 GiB avail; 939 B/s rd, 61 MiB/s wr, 979 op/s 2024-02-19T21:41:08.242 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:41:08.243 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:41:08.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:06.977755+0000 mgr.y (mgr.14514) 330 : cluster [DBG] pgmap v365: 148 pgs: 148 active+clean; 6.4 GiB data, 21 GiB used, 605 GiB / 626 GiB avail; 939 B/s rd, 61 MiB/s wr, 979 op/s 2024-02-19T21:41:08.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:06.977755+0000 mgr.y (mgr.14514) 330 : cluster [DBG] pgmap v365: 148 pgs: 148 active+clean; 6.4 GiB data, 21 GiB used, 605 GiB / 626 GiB avail; 939 B/s rd, 61 MiB/s wr, 979 op/s 2024-02-19T21:41:08.966 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 72 16 108591 108575 94.228 69.375 0.0180638 0.0106084 2024-02-19T21:41:09.075 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.5 dump_historic_ops 2024-02-19T21:41:09.526 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:41:09.966 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 73 16 109594 109578 93.7959 62.6875 0.0115854 0.0106573 2024-02-19T21:41:10.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:08.978056+0000 mgr.y (mgr.14514) 331 : cluster [DBG] pgmap v366: 148 pgs: 148 active+clean; 6.4 GiB data, 21 GiB used, 605 GiB / 626 GiB avail; 853 B/s rd, 56 MiB/s wr, 888 op/s 2024-02-19T21:41:10.559 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:41:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:41:10.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:08.978056+0000 mgr.y (mgr.14514) 331 : cluster [DBG] pgmap v366: 148 pgs: 148 active+clean; 6.4 GiB data, 21 GiB used, 605 GiB / 626 GiB avail; 853 B/s rd, 56 MiB/s wr, 888 op/s 2024-02-19T21:41:10.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:08.978056+0000 mgr.y (mgr.14514) 331 : cluster [DBG] pgmap v366: 148 pgs: 148 active+clean; 6.4 GiB data, 21 GiB used, 605 GiB / 626 GiB avail; 853 B/s rd, 56 MiB/s wr, 888 op/s 2024-02-19T21:41:10.966 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 74 16 110749 110733 93.5038 72.1875 0.00993395 0.0106902 2024-02-19T21:41:11.097 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:41:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:41:10] "GET /metrics HTTP/1.1" 200 175847 "" "Prometheus/2.33.4" 2024-02-19T21:41:11.454 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:10.272603+0000 mgr.y (mgr.14514) 332 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:41:11.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:10.272603+0000 mgr.y (mgr.14514) 332 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:41:11.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:10.272603+0000 mgr.y (mgr.14514) 332 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:41:11.838 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:41:11.838 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:41:11.967 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 75 16 111837 111821 93.1627 68 0.014101 0.0107301 2024-02-19T21:41:12.238 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:10.978861+0000 mgr.y (mgr.14514) 333 : cluster [DBG] pgmap v367: 148 pgs: 148 active+clean; 6.7 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 1.2 KiB/s rd, 83 MiB/s wr, 1.32k op/s 2024-02-19T21:41:12.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:10.978861+0000 mgr.y (mgr.14514) 333 : cluster [DBG] pgmap v367: 148 pgs: 148 active+clean; 6.7 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 1.2 KiB/s rd, 83 MiB/s wr, 1.32k op/s 2024-02-19T21:41:12.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:10.978861+0000 mgr.y (mgr.14514) 333 : cluster [DBG] pgmap v367: 148 pgs: 148 active+clean; 6.7 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 1.2 KiB/s rd, 83 MiB/s wr, 1.32k op/s 2024-02-19T21:41:12.672 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:41:12.677 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:12.678 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:41:12.779 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:41:12.823 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:12.962 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.6 dump_ops_in_flight 2024-02-19T21:41:12.967 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 76 16 112985 112969 92.8808 71.75 0.0174717 0.0107622 2024-02-19T21:41:13.446 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:41:13.968 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 77 16 114046 114030 92.5358 66.3125 0.017184 0.0108025 2024-02-19T21:41:14.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:12.979194+0000 mgr.y (mgr.14514) 334 : cluster [DBG] pgmap v368: 148 pgs: 148 active+clean; 6.7 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 853 B/s rd, 55 MiB/s wr, 877 op/s 2024-02-19T21:41:14.244 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:12.979194+0000 mgr.y (mgr.14514) 334 : cluster [DBG] pgmap v368: 148 pgs: 148 active+clean; 6.7 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 853 B/s rd, 55 MiB/s wr, 877 op/s 2024-02-19T21:41:14.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:12.979194+0000 mgr.y (mgr.14514) 334 : cluster [DBG] pgmap v368: 148 pgs: 148 active+clean; 6.7 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 853 B/s rd, 55 MiB/s wr, 877 op/s 2024-02-19T21:41:14.967 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 78 16 115188 115172 92.2645 71.375 0.0106292 0.0108347 2024-02-19T21:41:15.622 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:41:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:41:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:41:15.669 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:41:15.669 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:41:15.968 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 79 16 116194 116178 91.8925 62.875 0.00960755 0.0108779 2024-02-19T21:41:16.483 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:14.979755+0000 mgr.y (mgr.14514) 335 : cluster [DBG] pgmap v369: 148 pgs: 148 active+clean; 6.9 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 1.2 KiB/s rd, 75 MiB/s wr, 1.20k op/s 2024-02-19T21:41:16.511 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.6 dump_blocked_ops 2024-02-19T21:41:16.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:14.979755+0000 mgr.y (mgr.14514) 335 : cluster [DBG] pgmap v369: 148 pgs: 148 active+clean; 6.9 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 1.2 KiB/s rd, 75 MiB/s wr, 1.20k op/s 2024-02-19T21:41:16.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:14.979755+0000 mgr.y (mgr.14514) 335 : cluster [DBG] pgmap v369: 148 pgs: 148 active+clean; 6.9 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 1.2 KiB/s rd, 75 MiB/s wr, 1.20k op/s 2024-02-19T21:41:16.968 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:2024-02-19T21:41:16.968528+0000 min lat: 0.00129851 max lat: 0.109215 avg lat: 0.0109169 2024-02-19T21:41:16.968 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-19T21:41:16.968 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 80 16 117245 117229 91.5649 65.6875 0.0089752 0.0109169 2024-02-19T21:41:16.990 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:41:17.968 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 81 16 118336 118320 91.2762 68.1875 0.0519247 0.0109492 2024-02-19T21:41:18.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:16.980235+0000 mgr.y (mgr.14514) 336 : cluster [DBG] pgmap v370: 148 pgs: 148 active+clean; 7.0 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 853 B/s rd, 65 MiB/s wr, 1.04k op/s 2024-02-19T21:41:18.579 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:16.980235+0000 mgr.y (mgr.14514) 336 : cluster [DBG] pgmap v370: 148 pgs: 148 active+clean; 7.0 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 853 B/s rd, 65 MiB/s wr, 1.04k op/s 2024-02-19T21:41:18.579 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:16.980235+0000 mgr.y (mgr.14514) 336 : cluster [DBG] pgmap v370: 148 pgs: 148 active+clean; 7.0 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 853 B/s rd, 65 MiB/s wr, 1.04k op/s 2024-02-19T21:41:18.585 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:41:18.589 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:18.589 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:41:18.690 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:41:18.754 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:18.968 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 82 16 119412 119396 90.9832 67.25 0.0106533 0.0109868 2024-02-19T21:41:19.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:18.740008+0000 mon.a (mon.0) 1043 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:41:19.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:18.740919+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:41:19.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:18.751207+0000 mon.a (mon.0) 1045 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:41:19.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:18.740008+0000 mon.a (mon.0) 1043 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:41:19.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:18.740919+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:41:19.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:18.751207+0000 mon.a (mon.0) 1045 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:41:19.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:18.740008+0000 mon.a (mon.0) 1043 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:41:19.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:18.740919+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:41:19.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:18.751207+0000 mon.a (mon.0) 1045 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:41:19.968 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 83 16 120454 120438 90.6716 65.125 0.0144322 0.011025 2024-02-19T21:41:20.560 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:41:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:41:20.611 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:41:20.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:18.980595+0000 mgr.y (mgr.14514) 337 : cluster [DBG] pgmap v371: 148 pgs: 148 active+clean; 7.0 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 853 B/s rd, 56 MiB/s wr, 901 op/s 2024-02-19T21:41:20.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:18.980595+0000 mgr.y (mgr.14514) 337 : cluster [DBG] pgmap v371: 148 pgs: 148 active+clean; 7.0 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 853 B/s rd, 56 MiB/s wr, 901 op/s 2024-02-19T21:41:20.851 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:41:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:41:20] "GET /metrics HTTP/1.1" 200 175857 "" "Prometheus/2.33.4" 2024-02-19T21:41:20.972 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 84 16 121491 121475 90.3607 64.8125 0.0138649 0.0110624 2024-02-19T21:41:21.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:18.980595+0000 mgr.y (mgr.14514) 337 : cluster [DBG] pgmap v371: 148 pgs: 148 active+clean; 7.0 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 853 B/s rd, 56 MiB/s wr, 901 op/s 2024-02-19T21:41:21.196 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:41:21.468 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:41:21.471 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:41:21.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:20.284490+0000 mgr.y (mgr.14514) 338 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:41:21.775 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:21.179833+0000 mon.a (mon.0) 1046 : audit [INF] from='client.? 172.21.15.80:0/315641529' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:41:21.789 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-02-19T21:41:21.971 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 85 16 122492 122476 90.0337 62.5625 0.0101781 0.0111031 2024-02-19T21:41:22.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:20.284490+0000 mgr.y (mgr.14514) 338 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:41:22.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:21.179833+0000 mon.a (mon.0) 1046 : audit [INF] from='client.? 172.21.15.80:0/315641529' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:41:22.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:20.284490+0000 mgr.y (mgr.14514) 338 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:41:22.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:21.179833+0000 mon.a (mon.0) 1046 : audit [INF] from='client.? 172.21.15.80:0/315641529' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:41:22.861 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:41:22.869 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:22.870 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:41:22.971 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:41:22.972 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 86 16 123592 123576 89.7862 68.75 0.0102501 0.0111335 2024-02-19T21:41:23.006 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:23.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:20.981380+0000 mgr.y (mgr.14514) 339 : cluster [DBG] pgmap v372: 148 pgs: 148 active+clean; 7.3 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 1.2 KiB/s rd, 84 MiB/s wr, 1.34k op/s 2024-02-19T21:41:23.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:21.445199+0000 mgr.y (mgr.14514) 340 : audit [DBG] from='client.24986 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:41:23.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:21.756536+0000 mon.a (mon.0) 1047 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:41:23.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:21.773114+0000 mon.a (mon.0) 1048 : audit [INF] from='client.? 172.21.15.80:0/315641529' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:41:23.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:21.773181+0000 mon.a (mon.0) 1049 : cluster [DBG] osdmap e186: 8 total, 8 up, 7 in 2024-02-19T21:41:23.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:21.845254+0000 osd.3 (osd.3) 165 : cluster [DBG] 4.c scrub starts 2024-02-19T21:41:23.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:21.872049+0000 osd.3 (osd.3) 166 : cluster [DBG] 4.c scrub ok 2024-02-19T21:41:23.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:20.981380+0000 mgr.y (mgr.14514) 339 : cluster [DBG] pgmap v372: 148 pgs: 148 active+clean; 7.3 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 1.2 KiB/s rd, 84 MiB/s wr, 1.34k op/s 2024-02-19T21:41:23.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:21.445199+0000 mgr.y (mgr.14514) 340 : audit [DBG] from='client.24986 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:41:23.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:21.756536+0000 mon.a (mon.0) 1047 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:41:23.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:21.773114+0000 mon.a (mon.0) 1048 : audit [INF] from='client.? 172.21.15.80:0/315641529' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:41:23.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:21.773181+0000 mon.a (mon.0) 1049 : cluster [DBG] osdmap e186: 8 total, 8 up, 7 in 2024-02-19T21:41:23.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:21.845254+0000 osd.3 (osd.3) 165 : cluster [DBG] 4.c scrub starts 2024-02-19T21:41:23.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:21.872049+0000 osd.3 (osd.3) 166 : cluster [DBG] 4.c scrub ok 2024-02-19T21:41:23.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:20.981380+0000 mgr.y (mgr.14514) 339 : cluster [DBG] pgmap v372: 148 pgs: 148 active+clean; 7.3 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 1.2 KiB/s rd, 84 MiB/s wr, 1.34k op/s 2024-02-19T21:41:23.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:21.445199+0000 mgr.y (mgr.14514) 340 : audit [DBG] from='client.24986 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:41:23.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:21.756536+0000 mon.a (mon.0) 1047 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:41:23.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:21.773114+0000 mon.a (mon.0) 1048 : audit [INF] from='client.? 172.21.15.80:0/315641529' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:41:23.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:21.773181+0000 mon.a (mon.0) 1049 : cluster [DBG] osdmap e186: 8 total, 8 up, 7 in 2024-02-19T21:41:23.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:21.845254+0000 osd.3 (osd.3) 165 : cluster [DBG] 4.c scrub starts 2024-02-19T21:41:23.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:21.872049+0000 osd.3 (osd.3) 166 : cluster [DBG] 4.c scrub ok 2024-02-19T21:41:23.267 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:41:23.276 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:23.277 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:41:23.294 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":372,"stamp":"2024-02-19T21:41:20.980751+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7890933412,"num_objects":120598,"num_object_clones":0,"num_object_copies":361794,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120598,"num_whiteouts":0,"num_read":1228,"num_read_kb":980,"num_write":120834,"num_write_kb":7706025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":3702,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77846,"ondisk_log_size":77846,"up":444,"acting":444,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":444,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":656216064,"kb_used":25170248,"kb_used_data":23036368,"kb_used_omap":0,"kb_used_meta":2133760,"kb_avail":631045816,"statfs":{"total":671965249536,"available":646190915584,"internally_reserved":0,"allocated":23589240832,"data_stored":23587182408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2184970240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1053622272,"num_objects":16077,"num_object_clones":0,"num_object_copies":48231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16077,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":16077,"num_write_kb":1028928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002859"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":57,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.142426+0000","last_change":"2024-02-19T21:40:12.925489+0000","last_active":"2024-02-19T21:40:43.142426+0000","last_peered":"2024-02-19T21:40:43.142426+0000","last_clean":"2024-02-19T21:40:43.142426+0000","last_became_active":"2024-02-19T21:38:31.247054+0000","last_became_peered":"2024-02-19T21:38:31.247054+0000","last_unstale":"2024-02-19T21:40:43.142426+0000","last_undegraded":"2024-02-19T21:40:43.142426+0000","last_fullsized":"2024-02-19T21:40:43.142426+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:12.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:12.925421+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":111,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.134114+0000","last_change":"2024-02-19T21:40:23.364671+0000","last_active":"2024-02-19T21:40:43.134114+0000","last_peered":"2024-02-19T21:40:43.134114+0000","last_clean":"2024-02-19T21:40:43.134114+0000","last_became_active":"2024-02-19T21:35:14.511920+0000","last_became_peered":"2024-02-19T21:35:14.511920+0000","last_unstale":"2024-02-19T21:40:43.134114+0000","last_undegraded":"2024-02-19T21:40:43.134114+0000","last_fullsized":"2024-02-19T21:40:43.134114+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:23.364579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:23.364579+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":155,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.125928+0000","last_change":"2024-02-19T21:40:28.473842+0000","last_active":"2024-02-19T21:40:43.125928+0000","last_peered":"2024-02-19T21:40:43.125928+0000","last_clean":"2024-02-19T21:40:43.125928+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:40:43.125928+0000","last_undegraded":"2024-02-19T21:40:43.125928+0000","last_fullsized":"2024-02-19T21:40:43.125928+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:28.473778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:28.473778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"66'15","reported_seq":109,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.125016+0000","last_change":"2024-02-19T21:39:51.546188+0000","last_active":"2024-02-19T21:40:43.125016+0000","last_peered":"2024-02-19T21:40:43.125016+0000","last_clean":"2024-02-19T21:40:43.125016+0000","last_became_active":"2024-02-19T21:39:51.536424+0000","last_became_peered":"2024-02-19T21:39:51.536424+0000","last_unstale":"2024-02-19T21:40:43.125016+0000","last_undegraded":"2024-02-19T21:40:43.125016+0000","last_fullsized":"2024-02-19T21:40:43.125016+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:39:29.269819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:29.269819+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":109,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.126117+0000","last_change":"2024-02-19T21:39:29.064310+0000","last_active":"2024-02-19T21:40:43.126117+0000","last_peered":"2024-02-19T21:40:43.126117+0000","last_clean":"2024-02-19T21:40:43.126117+0000","last_became_active":"2024-02-19T21:35:14.517794+0000","last_became_peered":"2024-02-19T21:35:14.517794+0000","last_unstale":"2024-02-19T21:40:43.126117+0000","last_undegraded":"2024-02-19T21:40:43.126117+0000","last_fullsized":"2024-02-19T21:40:43.126117+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:29.064185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:29.064185+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":146,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.130565+0000","last_change":"2024-02-19T21:40:25.265586+0000","last_active":"2024-02-19T21:40:43.130565+0000","last_peered":"2024-02-19T21:40:43.130565+0000","last_clean":"2024-02-19T21:40:43.130565+0000","last_became_active":"2024-02-19T21:32:27.372466+0000","last_became_peered":"2024-02-19T21:32:27.372466+0000","last_unstale":"2024-02-19T21:40:43.130565+0000","last_undegraded":"2024-02-19T21:40:43.130565+0000","last_fullsized":"2024-02-19T21:40:43.130565+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:25.265482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:25.265482+0000","last_clean_scrub_stamp":"2024-02-19T21:40:25.265482+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":154,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.135621+0000","last_change":"2024-02-19T21:39:45.432311+0000","last_active":"2024-02-19T21:40:43.135621+0000","last_peered":"2024-02-19T21:40:43.135621+0000","last_clean":"2024-02-19T21:40:43.135621+0000","last_became_active":"2024-02-19T21:32:23.356975+0000","last_became_peered":"2024-02-19T21:32:23.356975+0000","last_unstale":"2024-02-19T21:40:43.135621+0000","last_undegraded":"2024-02-19T21:40:43.135621+0000","last_fullsized":"2024-02-19T21:40:43.135621+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:45.432184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:39:45.432184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"92'13","reported_seq":183,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.136840+0000","last_change":"2024-02-19T21:39:38.475516+0000","last_active":"2024-02-19T21:40:43.136840+0000","last_peered":"2024-02-19T21:40:43.136840+0000","last_clean":"2024-02-19T21:40:43.136840+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:40:43.136840+0000","last_undegraded":"2024-02-19T21:40:43.136840+0000","last_fullsized":"2024-02-19T21:40:43.136840+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"92'13","last_scrub_stamp":"2024-02-19T21:39:38.475440+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.475440+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":161,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.125695+0000","last_change":"2024-02-19T21:39:39.467763+0000","last_active":"2024-02-19T21:40:43.125695+0000","last_peered":"2024-02-19T21:40:43.125695+0000","last_clean":"2024-02-19T21:40:43.125695+0000","last_became_active":"2024-02-19T21:39:39.467350+0000","last_became_peered":"2024-02-19T21:39:39.467350+0000","last_unstale":"2024-02-19T21:40:43.125695+0000","last_undegraded":"2024-02-19T21:40:43.125695+0000","last_fullsized":"2024-02-19T21:40:43.125695+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:30.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:30.102789+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":145,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.141439+0000","last_change":"2024-02-19T21:39:32.209318+0000","last_active":"2024-02-19T21:40:43.141439+0000","last_peered":"2024-02-19T21:40:43.141439+0000","last_clean":"2024-02-19T21:40:43.141439+0000","last_became_active":"2024-02-19T21:32:27.370308+0000","last_became_peered":"2024-02-19T21:32:27.370308+0000","last_unstale":"2024-02-19T21:40:43.141439+0000","last_undegraded":"2024-02-19T21:40:43.141439+0000","last_fullsized":"2024-02-19T21:40:43.141439+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:32.209233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:32.209233+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":156,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.144844+0000","last_change":"2024-02-19T21:40:34.884850+0000","last_active":"2024-02-19T21:40:43.144844+0000","last_peered":"2024-02-19T21:40:43.144844+0000","last_clean":"2024-02-19T21:40:43.144844+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:40:43.144844+0000","last_undegraded":"2024-02-19T21:40:43.144844+0000","last_fullsized":"2024-02-19T21:40:43.144844+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:34.884780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:08.490788+0000","last_clean_scrub_stamp":"2024-02-19T21:40:34.884780+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"66'5","reported_seq":146,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.134617+0000","last_change":"2024-02-19T21:39:44.444043+0000","last_active":"2024-02-19T21:40:43.134617+0000","last_peered":"2024-02-19T21:40:43.134617+0000","last_clean":"2024-02-19T21:40:43.134617+0000","last_became_active":"2024-02-19T21:39:39.471143+0000","last_became_peered":"2024-02-19T21:39:39.471143+0000","last_unstale":"2024-02-19T21:40:43.134617+0000","last_undegraded":"2024-02-19T21:40:43.134617+0000","last_fullsized":"2024-02-19T21:40:43.134617+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'5","last_scrub_stamp":"2024-02-19T21:39:44.443963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:44.443963+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":145,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.124821+0000","last_change":"2024-02-19T21:38:17.889547+0000","last_active":"2024-02-19T21:40:43.124821+0000","last_peered":"2024-02-19T21:40:43.124821+0000","last_clean":"2024-02-19T21:40:43.124821+0000","last_became_active":"2024-02-19T21:32:29.373010+0000","last_became_peered":"2024-02-19T21:32:29.373010+0000","last_unstale":"2024-02-19T21:40:43.124821+0000","last_undegraded":"2024-02-19T21:40:43.124821+0000","last_fullsized":"2024-02-19T21:40:43.124821+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:38:17.889452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:38:17.889452+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":150,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.125702+0000","last_change":"2024-02-19T21:39:35.104060+0000","last_active":"2024-02-19T21:40:43.125702+0000","last_peered":"2024-02-19T21:40:43.125702+0000","last_clean":"2024-02-19T21:40:43.125702+0000","last_became_active":"2024-02-19T21:32:27.368241+0000","last_became_peered":"2024-02-19T21:32:27.368241+0000","last_unstale":"2024-02-19T21:40:43.125702+0000","last_undegraded":"2024-02-19T21:40:43.125702+0000","last_fullsized":"2024-02-19T21:40:43.125702+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:35.103945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:46.543259+0000","last_clean_scrub_stamp":"2024-02-19T21:39:35.103945+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":163,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.142586+0000","last_change":"2024-02-19T21:40:16.864005+0000","last_active":"2024-02-19T21:40:43.142586+0000","last_peered":"2024-02-19T21:40:43.142586+0000","last_clean":"2024-02-19T21:40:43.142586+0000","last_became_active":"2024-02-19T21:39:39.473759+0000","last_became_peered":"2024-02-19T21:39:39.473759+0000","last_unstale":"2024-02-19T21:40:43.142586+0000","last_undegraded":"2024-02-19T21:40:43.142586+0000","last_fullsized":"2024-02-19T21:40:43.142586+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:16.863939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:16.863939+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"89'13","reported_seq":168,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.134695+0000","last_change":"2024-02-19T21:39:47.395697+0000","last_active":"2024-02-19T21:40:43.134695+0000","last_peered":"2024-02-19T21:40:43.134695+0000","last_clean":"2024-02-19T21:40:43.134695+0000","last_became_active":"2024-02-19T21:35:14.514971+0000","last_became_peered":"2024-02-19T21:35:14.514971+0000","last_unstale":"2024-02-19T21:40:43.134695+0000","last_undegraded":"2024-02-19T21:40:43.134695+0000","last_fullsized":"2024-02-19T21:40:43.134695+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'13","last_scrub_stamp":"2024-02-19T21:39:47.395572+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:39:47.395572+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":148,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.135569+0000","last_change":"2024-02-19T21:40:41.667390+0000","last_active":"2024-02-19T21:40:43.135569+0000","last_peered":"2024-02-19T21:40:43.135569+0000","last_clean":"2024-02-19T21:40:43.135569+0000","last_became_active":"2024-02-19T21:32:29.597266+0000","last_became_peered":"2024-02-19T21:32:29.597266+0000","last_unstale":"2024-02-19T21:40:43.135569+0000","last_undegraded":"2024-02-19T21:40:43.135569+0000","last_fullsized":"2024-02-19T21:40:43.135569+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:41.667287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:41.667287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":118,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.135964+0000","last_change":"2024-02-19T21:39:39.474633+0000","last_active":"2024-02-19T21:40:43.135964+0000","last_peered":"2024-02-19T21:40:43.135964+0000","last_clean":"2024-02-19T21:40:43.135964+0000","last_became_active":"2024-02-19T21:39:39.474044+0000","last_became_peered":"2024-02-19T21:39:39.474044+0000","last_unstale":"2024-02-19T21:40:43.135964+0000","last_undegraded":"2024-02-19T21:40:43.135964+0000","last_fullsized":"2024-02-19T21:40:43.135964+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:34.364412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:34.364412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":34,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.141492+0000","last_change":"2024-02-19T21:40:24.788747+0000","last_active":"2024-02-19T21:40:43.141492+0000","last_peered":"2024-02-19T21:40:43.141492+0000","last_clean":"2024-02-19T21:40:43.141492+0000","last_became_active":"2024-02-19T21:39:39.470743+0000","last_became_peered":"2024-02-19T21:39:39.470743+0000","last_unstale":"2024-02-19T21:40:43.141492+0000","last_undegraded":"2024-02-19T21:40:43.141492+0000","last_fullsized":"2024-02-19T21:40:43.141492+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:24.788644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:24.788644+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1d","version":"66'12","reported_seq":104,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.129619+0000","last_change":"2024-02-19T21:39:21.126642+0000","last_active":"2024-02-19T21:40:43.129619+0000","last_peered":"2024-02-19T21:40:43.129619+0000","last_clean":"2024-02-19T21:40:43.129619+0000","last_became_active":"2024-02-19T21:38:31.247067+0000","last_became_peered":"2024-02-19T21:38:31.247067+0000","last_unstale":"2024-02-19T21:40:43.129619+0000","last_undegraded":"2024-02-19T21:40:43.129619+0000","last_fullsized":"2024-02-19T21:40:43.129619+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'12","last_scrub_stamp":"2024-02-19T21:39:21.126563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:21.126563+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":24,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":154,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.137630+0000","last_change":"2024-02-19T21:40:38.796583+0000","last_active":"2024-02-19T21:40:43.137630+0000","last_peered":"2024-02-19T21:40:43.137630+0000","last_clean":"2024-02-19T21:40:43.137630+0000","last_became_active":"2024-02-19T21:32:29.597365+0000","last_became_peered":"2024-02-19T21:32:29.597365+0000","last_unstale":"2024-02-19T21:40:43.137630+0000","last_undegraded":"2024-02-19T21:40:43.137630+0000","last_fullsized":"2024-02-19T21:40:43.137630+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:38.796496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:38.796496+0000","last_clean_scrub_stamp":"2024-02-19T21:40:38.796496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":146,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.129693+0000","last_change":"2024-02-19T21:40:15.269827+0000","last_active":"2024-02-19T21:40:43.129693+0000","last_peered":"2024-02-19T21:40:43.129693+0000","last_clean":"2024-02-19T21:40:43.129693+0000","last_became_active":"2024-02-19T21:32:27.369757+0000","last_became_peered":"2024-02-19T21:32:27.369757+0000","last_unstale":"2024-02-19T21:40:43.129693+0000","last_undegraded":"2024-02-19T21:40:43.129693+0000","last_fullsized":"2024-02-19T21:40:43.129693+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:15.269720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:15.269720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":159,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.135161+0000","last_change":"2024-02-19T21:40:38.600031+0000","last_active":"2024-02-19T21:40:43.135161+0000","last_peered":"2024-02-19T21:40:43.135161+0000","last_clean":"2024-02-19T21:40:43.135161+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:40:43.135161+0000","last_undegraded":"2024-02-19T21:40:43.135161+0000","last_fullsized":"2024-02-19T21:40:43.135161+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:38.599939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:38.599939+0000","last_clean_scrub_stamp":"2024-02-19T21:40:38.599939+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"93'22","reported_seq":123,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.129079+0000","last_change":"2024-02-19T21:40:36.287163+0000","last_active":"2024-02-19T21:40:43.129079+0000","last_peered":"2024-02-19T21:40:43.129079+0000","last_clean":"2024-02-19T21:40:43.129079+0000","last_became_active":"2024-02-19T21:39:39.477429+0000","last_became_peered":"2024-02-19T21:39:39.477429+0000","last_unstale":"2024-02-19T21:40:43.129079+0000","last_undegraded":"2024-02-19T21:40:43.129079+0000","last_fullsized":"2024-02-19T21:40:43.129079+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'22","last_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.287051+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":144,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.129273+0000","last_change":"2024-02-19T21:40:32.280767+0000","last_active":"2024-02-19T21:40:43.129273+0000","last_peered":"2024-02-19T21:40:43.129273+0000","last_clean":"2024-02-19T21:40:43.129273+0000","last_became_active":"2024-02-19T21:32:29.373361+0000","last_became_peered":"2024-02-19T21:32:29.373361+0000","last_unstale":"2024-02-19T21:40:43.129273+0000","last_undegraded":"2024-02-19T21:40:43.129273+0000","last_fullsized":"2024-02-19T21:40:43.129273+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:32.280705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:12.945581+0000","last_clean_scrub_stamp":"2024-02-19T21:40:32.280705+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":160,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.126101+0000","last_change":"2024-02-19T21:39:39.471709+0000","last_active":"2024-02-19T21:40:43.126101+0000","last_peered":"2024-02-19T21:40:43.126101+0000","last_clean":"2024-02-19T21:40:43.126101+0000","last_became_active":"2024-02-19T21:39:39.471214+0000","last_became_peered":"2024-02-19T21:39:39.471214+0000","last_unstale":"2024-02-19T21:40:43.126101+0000","last_undegraded":"2024-02-19T21:40:43.126101+0000","last_fullsized":"2024-02-19T21:40:43.126101+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:37.169503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:37.169503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":71,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.133216+0000","last_change":"2024-02-19T21:40:33.515294+0000","last_active":"2024-02-19T21:40:43.133216+0000","last_peered":"2024-02-19T21:40:43.133216+0000","last_clean":"2024-02-19T21:40:43.133216+0000","last_became_active":"2024-02-19T21:39:39.470895+0000","last_became_peered":"2024-02-19T21:39:39.470895+0000","last_unstale":"2024-02-19T21:40:43.133216+0000","last_undegraded":"2024-02-19T21:40:43.133216+0000","last_fullsized":"2024-02-19T21:40:43.133216+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:33.515188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:33.515188+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"66'11","reported_seq":42,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.125739+0000","last_change":"2024-02-19T21:39:51.559559+0000","last_active":"2024-02-19T21:40:43.125739+0000","last_peered":"2024-02-19T21:40:43.125739+0000","last_clean":"2024-02-19T21:40:43.125739+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:40:43.125739+0000","last_undegraded":"2024-02-19T21:40:43.125739+0000","last_fullsized":"2024-02-19T21:40:43.125739+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:39:43.209803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:43.209803+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":157,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.142900+0000","last_change":"2024-02-19T21:39:39.568862+0000","last_active":"2024-02-19T21:40:43.142900+0000","last_peered":"2024-02-19T21:40:43.142900+0000","last_clean":"2024-02-19T21:40:43.142900+0000","last_became_active":"2024-02-19T21:39:39.473146+0000","last_became_peered":"2024-02-19T21:39:39.473146+0000","last_unstale":"2024-02-19T21:40:43.142900+0000","last_undegraded":"2024-02-19T21:40:43.142900+0000","last_fullsized":"2024-02-19T21:40:43.142900+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:38:25.883927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:38:25.883927+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"66'8","reported_seq":270,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-02-19T21:41:11.962585+0000","last_change":"2024-02-19T21:40:19.276823+0000","last_active":"2024-02-19T21:41:11.962585+0000","last_peered":"2024-02-19T21:41:11.962585+0000","last_clean":"2024-02-19T21:41:11.962585+0000","last_became_active":"2024-02-19T21:32:27.366465+0000","last_became_peered":"2024-02-19T21:32:27.366465+0000","last_unstale":"2024-02-19T21:41:11.962585+0000","last_undegraded":"2024-02-19T21:41:11.962585+0000","last_fullsized":"2024-02-19T21:41:11.962585+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:40:19.276740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:19.276740+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":154,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.126532+0000","last_change":"2024-02-19T21:39:38.080684+0000","last_active":"2024-02-19T21:40:43.126532+0000","last_peered":"2024-02-19T21:40:43.126532+0000","last_clean":"2024-02-19T21:40:43.126532+0000","last_became_active":"2024-02-19T21:32:23.356323+0000","last_became_peered":"2024-02-19T21:32:23.356323+0000","last_unstale":"2024-02-19T21:40:43.126532+0000","last_undegraded":"2024-02-19T21:40:43.126532+0000","last_fullsized":"2024-02-19T21:40:43.126532+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.080601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.080601+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"66'10","reported_seq":210,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.126010+0000","last_change":"2024-02-19T21:39:51.544334+0000","last_active":"2024-02-19T21:40:43.126010+0000","last_peered":"2024-02-19T21:40:43.126010+0000","last_clean":"2024-02-19T21:40:43.126010+0000","last_became_active":"2024-02-19T21:39:51.536426+0000","last_became_peered":"2024-02-19T21:39:51.536426+0000","last_unstale":"2024-02-19T21:40:43.126010+0000","last_undegraded":"2024-02-19T21:40:43.126010+0000","last_fullsized":"2024-02-19T21:40:43.126010+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:39:33.125904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:33.125904+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":66,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.124324+0000","last_change":"2024-02-19T21:39:39.471651+0000","last_active":"2024-02-19T21:40:43.124324+0000","last_peered":"2024-02-19T21:40:43.124324+0000","last_clean":"2024-02-19T21:40:43.124324+0000","last_became_active":"2024-02-19T21:39:39.471332+0000","last_became_peered":"2024-02-19T21:39:39.471332+0000","last_unstale":"2024-02-19T21:40:43.124324+0000","last_undegraded":"2024-02-19T21:40:43.124324+0000","last_fullsized":"2024-02-19T21:40:43.124324+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:23.270251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:39:23.270251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":145,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.140970+0000","last_change":"2024-02-19T21:38:26.854195+0000","last_active":"2024-02-19T21:40:43.140970+0000","last_peered":"2024-02-19T21:40:43.140970+0000","last_clean":"2024-02-19T21:40:43.140970+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:40:43.140970+0000","last_undegraded":"2024-02-19T21:40:43.140970+0000","last_fullsized":"2024-02-19T21:40:43.140970+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:26.854133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:38:26.854133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":163,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.134065+0000","last_change":"2024-02-19T21:39:45.211467+0000","last_active":"2024-02-19T21:40:43.134065+0000","last_peered":"2024-02-19T21:40:43.134065+0000","last_clean":"2024-02-19T21:40:43.134065+0000","last_became_active":"2024-02-19T21:39:39.478633+0000","last_became_peered":"2024-02-19T21:39:39.478633+0000","last_unstale":"2024-02-19T21:40:43.134065+0000","last_undegraded":"2024-02-19T21:40:43.134065+0000","last_fullsized":"2024-02-19T21:40:43.134065+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:45.211388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:39:45.211388+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"66'11","reported_seq":171,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.134525+0000","last_change":"2024-02-19T21:39:46.421215+0000","last_active":"2024-02-19T21:40:43.134525+0000","last_peered":"2024-02-19T21:40:43.134525+0000","last_clean":"2024-02-19T21:40:43.134525+0000","last_became_active":"2024-02-19T21:32:25.372039+0000","last_became_peered":"2024-02-19T21:32:25.372039+0000","last_unstale":"2024-02-19T21:40:43.134525+0000","last_undegraded":"2024-02-19T21:40:43.134525+0000","last_fullsized":"2024-02-19T21:40:43.134525+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:39:46.421117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:46.421117+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":152,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.141533+0000","last_change":"2024-02-19T21:39:39.471671+0000","last_active":"2024-02-19T21:40:43.141533+0000","last_peered":"2024-02-19T21:40:43.141533+0000","last_clean":"2024-02-19T21:40:43.141533+0000","last_became_active":"2024-02-19T21:39:39.471306+0000","last_became_peered":"2024-02-19T21:39:39.471306+0000","last_unstale":"2024-02-19T21:40:43.141533+0000","last_undegraded":"2024-02-19T21:40:43.141533+0000","last_fullsized":"2024-02-19T21:40:43.141533+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:37.104831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:39:37.104831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":150,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.133294+0000","last_change":"2024-02-19T21:39:41.234334+0000","last_active":"2024-02-19T21:40:43.133294+0000","last_peered":"2024-02-19T21:40:43.133294+0000","last_clean":"2024-02-19T21:40:43.133294+0000","last_became_active":"2024-02-19T21:32:27.366281+0000","last_became_peered":"2024-02-19T21:32:27.366281+0000","last_unstale":"2024-02-19T21:40:43.133294+0000","last_undegraded":"2024-02-19T21:40:43.133294+0000","last_fullsized":"2024-02-19T21:40:43.133294+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:41.234250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:41.234250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":158,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.127133+0000","last_change":"2024-02-19T21:39:39.480521+0000","last_active":"2024-02-19T21:40:43.127133+0000","last_peered":"2024-02-19T21:40:43.127133+0000","last_clean":"2024-02-19T21:40:43.127133+0000","last_became_active":"2024-02-19T21:39:39.479927+0000","last_became_peered":"2024-02-19T21:39:39.479927+0000","last_unstale":"2024-02-19T21:40:43.127133+0000","last_undegraded":"2024-02-19T21:40:43.127133+0000","last_fullsized":"2024-02-19T21:40:43.127133+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:39:37.085374+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"66'4","reported_seq":81,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.127836+0000","last_change":"2024-02-19T21:40:18.214945+0000","last_active":"2024-02-19T21:40:43.127836+0000","last_peered":"2024-02-19T21:40:43.127836+0000","last_clean":"2024-02-19T21:40:43.127836+0000","last_became_active":"2024-02-19T21:38:31.248249+0000","last_became_peered":"2024-02-19T21:38:31.248249+0000","last_unstale":"2024-02-19T21:40:43.127836+0000","last_undegraded":"2024-02-19T21:40:43.127836+0000","last_fullsized":"2024-02-19T21:40:43.127836+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'4","last_scrub_stamp":"2024-02-19T21:40:18.214846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:18.214846+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":66,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.124966+0000","last_change":"2024-02-19T21:39:39.462663+0000","last_active":"2024-02-19T21:40:43.124966+0000","last_peered":"2024-02-19T21:40:43.124966+0000","last_clean":"2024-02-19T21:40:43.124966+0000","last_became_active":"2024-02-19T21:39:39.462363+0000","last_became_peered":"2024-02-19T21:39:39.462363+0000","last_unstale":"2024-02-19T21:40:43.124966+0000","last_undegraded":"2024-02-19T21:40:43.124966+0000","last_fullsized":"2024-02-19T21:40:43.124966+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:26.311526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:39:26.311526+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":155,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.129806+0000","last_change":"2024-02-19T21:40:26.272724+0000","last_active":"2024-02-19T21:40:43.129806+0000","last_peered":"2024-02-19T21:40:43.129806+0000","last_clean":"2024-02-19T21:40:43.129806+0000","last_became_active":"2024-02-19T21:38:31.248795+0000","last_became_peered":"2024-02-19T21:38:31.248795+0000","last_unstale":"2024-02-19T21:40:43.129806+0000","last_undegraded":"2024-02-19T21:40:43.129806+0000","last_fullsized":"2024-02-19T21:40:43.129806+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:26.272653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:26.272653+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":152,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.129981+0000","last_change":"2024-02-19T21:39:33.957921+0000","last_active":"2024-02-19T21:40:43.129981+0000","last_peered":"2024-02-19T21:40:43.129981+0000","last_clean":"2024-02-19T21:40:43.129981+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:40:43.129981+0000","last_undegraded":"2024-02-19T21:40:43.129981+0000","last_fullsized":"2024-02-19T21:40:43.129981+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:33.957814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:39:33.957814+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"66'11","reported_seq":177,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.138054+0000","last_change":"2024-02-19T21:39:25.554998+0000","last_active":"2024-02-19T21:40:43.138054+0000","last_peered":"2024-02-19T21:40:43.138054+0000","last_clean":"2024-02-19T21:40:43.138054+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:40:43.138054+0000","last_undegraded":"2024-02-19T21:40:43.138054+0000","last_fullsized":"2024-02-19T21:40:43.138054+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:39:25.554888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:25.554888+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":151,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.124187+0000","last_change":"2024-02-19T21:38:29.972418+0000","last_active":"2024-02-19T21:40:43.124187+0000","last_peered":"2024-02-19T21:40:43.124187+0000","last_clean":"2024-02-19T21:40:43.124187+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:40:43.124187+0000","last_undegraded":"2024-02-19T21:40:43.124187+0000","last_fullsized":"2024-02-19T21:40:43.124187+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:29.972337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:42.527849+0000","last_clean_scrub_stamp":"2024-02-19T21:38:29.972337+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":154,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.134650+0000","last_change":"2024-02-19T21:39:51.535010+0000","last_active":"2024-02-19T21:40:43.134650+0000","last_peered":"2024-02-19T21:40:43.134650+0000","last_clean":"2024-02-19T21:40:43.134650+0000","last_became_active":"2024-02-19T21:39:51.534750+0000","last_became_peered":"2024-02-19T21:39:51.534750+0000","last_unstale":"2024-02-19T21:40:43.134650+0000","last_undegraded":"2024-02-19T21:40:43.134650+0000","last_fullsized":"2024-02-19T21:40:43.134650+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:33.360066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:33.360066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":154,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.134748+0000","last_change":"2024-02-19T21:39:33.273446+0000","last_active":"2024-02-19T21:40:43.134748+0000","last_peered":"2024-02-19T21:40:43.134748+0000","last_clean":"2024-02-19T21:40:43.134748+0000","last_became_active":"2024-02-19T21:32:23.357338+0000","last_became_peered":"2024-02-19T21:32:23.357338+0000","last_unstale":"2024-02-19T21:40:43.134748+0000","last_undegraded":"2024-02-19T21:40:43.134748+0000","last_fullsized":"2024-02-19T21:40:43.134748+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:33.273364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:39:33.273364+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"66'9","reported_seq":183,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.129716+0000","last_change":"2024-02-19T21:39:45.026756+0000","last_active":"2024-02-19T21:40:43.129716+0000","last_peered":"2024-02-19T21:40:43.129716+0000","last_clean":"2024-02-19T21:40:43.129716+0000","last_became_active":"2024-02-19T21:39:39.466843+0000","last_became_peered":"2024-02-19T21:39:39.466843+0000","last_unstale":"2024-02-19T21:40:43.129716+0000","last_undegraded":"2024-02-19T21:40:43.129716+0000","last_fullsized":"2024-02-19T21:40:43.129716+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:39:45.026689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:45.026689+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":39,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.127530+0000","last_change":"2024-02-19T21:39:41.032181+0000","last_active":"2024-02-19T21:40:43.127530+0000","last_peered":"2024-02-19T21:40:43.127530+0000","last_clean":"2024-02-19T21:40:43.127530+0000","last_became_active":"2024-02-19T21:39:39.474430+0000","last_became_peered":"2024-02-19T21:39:39.474430+0000","last_unstale":"2024-02-19T21:40:43.127530+0000","last_undegraded":"2024-02-19T21:40:43.127530+0000","last_fullsized":"2024-02-19T21:40:43.127530+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:41.032064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:41.032064+0000","last_clean_scrub_stamp":"2024-02-19T21:39:41.032064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"170'12","reported_seq":47,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-02-19T21:41:11.967864+0000","last_change":"2024-02-19T21:39:51.710164+0000","last_active":"2024-02-19T21:41:11.967864+0000","last_peered":"2024-02-19T21:41:11.967864+0000","last_clean":"2024-02-19T21:41:11.967864+0000","last_became_active":"2024-02-19T21:39:51.534932+0000","last_became_peered":"2024-02-19T21:39:51.534932+0000","last_unstale":"2024-02-19T21:41:11.967864+0000","last_undegraded":"2024-02-19T21:41:11.967864+0000","last_fullsized":"2024-02-19T21:41:11.967864+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'11","last_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:39:46.054888+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":164,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.124790+0000","last_change":"2024-02-19T21:40:33.532430+0000","last_active":"2024-02-19T21:40:43.124790+0000","last_peered":"2024-02-19T21:40:43.124790+0000","last_clean":"2024-02-19T21:40:43.124790+0000","last_became_active":"2024-02-19T21:32:23.361680+0000","last_became_peered":"2024-02-19T21:32:23.361680+0000","last_unstale":"2024-02-19T21:40:43.124790+0000","last_undegraded":"2024-02-19T21:40:43.124790+0000","last_fullsized":"2024-02-19T21:40:43.124790+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:33.532354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:33.550655+0000","last_clean_scrub_stamp":"2024-02-19T21:40:33.532354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"133'13","reported_seq":172,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.127017+0000","last_change":"2024-02-19T21:40:37.730352+0000","last_active":"2024-02-19T21:40:43.127017+0000","last_peered":"2024-02-19T21:40:43.127017+0000","last_clean":"2024-02-19T21:40:43.127017+0000","last_became_active":"2024-02-19T21:32:25.372206+0000","last_became_peered":"2024-02-19T21:32:25.372206+0000","last_unstale":"2024-02-19T21:40:43.127017+0000","last_undegraded":"2024-02-19T21:40:43.127017+0000","last_fullsized":"2024-02-19T21:40:43.127017+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'13","last_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:40:37.730197+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":163,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.124364+0000","last_change":"2024-02-19T21:40:29.506871+0000","last_active":"2024-02-19T21:40:43.124364+0000","last_peered":"2024-02-19T21:40:43.124364+0000","last_clean":"2024-02-19T21:40:43.124364+0000","last_became_active":"2024-02-19T21:38:31.248016+0000","last_became_peered":"2024-02-19T21:38:31.248016+0000","last_unstale":"2024-02-19T21:40:43.124364+0000","last_undegraded":"2024-02-19T21:40:43.124364+0000","last_fullsized":"2024-02-19T21:40:43.124364+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:29.506785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:29.506785+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":266,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-02-19T21:41:11.964726+0000","last_change":"2024-02-19T21:40:32.679041+0000","last_active":"2024-02-19T21:41:11.964726+0000","last_peered":"2024-02-19T21:41:11.964726+0000","last_clean":"2024-02-19T21:41:11.964726+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:41:11.964726+0000","last_undegraded":"2024-02-19T21:41:11.964726+0000","last_fullsized":"2024-02-19T21:41:11.964726+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:40:32.678933+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":156,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.126188+0000","last_change":"2024-02-19T21:40:25.759797+0000","last_active":"2024-02-19T21:40:43.126188+0000","last_peered":"2024-02-19T21:40:43.126188+0000","last_clean":"2024-02-19T21:40:43.126188+0000","last_became_active":"2024-02-19T21:32:23.360838+0000","last_became_peered":"2024-02-19T21:32:23.360838+0000","last_unstale":"2024-02-19T21:40:43.126188+0000","last_undegraded":"2024-02-19T21:40:43.126188+0000","last_fullsized":"2024-02-19T21:40:43.126188+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:25.759697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:40:25.759697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"182'15","reported_seq":172,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.135892+0000","last_change":"2024-02-19T21:40:39.592088+0000","last_active":"2024-02-19T21:40:43.135892+0000","last_peered":"2024-02-19T21:40:43.135892+0000","last_clean":"2024-02-19T21:40:43.135892+0000","last_became_active":"2024-02-19T21:32:25.372060+0000","last_became_peered":"2024-02-19T21:32:25.372060+0000","last_unstale":"2024-02-19T21:40:43.135892+0000","last_undegraded":"2024-02-19T21:40:43.135892+0000","last_fullsized":"2024-02-19T21:40:43.135892+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'15","last_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:40:39.591994+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":152,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.142996+0000","last_change":"2024-02-19T21:40:31.892048+0000","last_active":"2024-02-19T21:40:43.142996+0000","last_peered":"2024-02-19T21:40:43.142996+0000","last_clean":"2024-02-19T21:40:43.142996+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:40:43.142996+0000","last_undegraded":"2024-02-19T21:40:43.142996+0000","last_fullsized":"2024-02-19T21:40:43.142996+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:31.891967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_clean_scrub_stamp":"2024-02-19T21:40:31.891967+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":145,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.126879+0000","last_change":"2024-02-19T21:39:36.067452+0000","last_active":"2024-02-19T21:40:43.126879+0000","last_peered":"2024-02-19T21:40:43.126879+0000","last_clean":"2024-02-19T21:40:43.126879+0000","last_became_active":"2024-02-19T21:32:27.369002+0000","last_became_peered":"2024-02-19T21:32:27.369002+0000","last_unstale":"2024-02-19T21:40:43.126879+0000","last_undegraded":"2024-02-19T21:40:43.126879+0000","last_fullsized":"2024-02-19T21:40:43.126879+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:36.067354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:36.067354+0000","last_clean_scrub_stamp":"2024-02-19T21:39:36.067354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":154,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.133334+0000","last_change":"2024-02-19T21:40:29.421893+0000","last_active":"2024-02-19T21:40:43.133334+0000","last_peered":"2024-02-19T21:40:43.133334+0000","last_clean":"2024-02-19T21:40:43.133334+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:40:43.133334+0000","last_undegraded":"2024-02-19T21:40:43.133334+0000","last_fullsized":"2024-02-19T21:40:43.133334+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:29.421791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:29.421791+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"66'6","reported_seq":111,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.145248+0000","last_change":"2024-02-19T21:39:39.505326+0000","last_active":"2024-02-19T21:40:43.145248+0000","last_peered":"2024-02-19T21:40:43.145248+0000","last_clean":"2024-02-19T21:40:43.145248+0000","last_became_active":"2024-02-19T21:39:39.479449+0000","last_became_peered":"2024-02-19T21:39:39.479449+0000","last_unstale":"2024-02-19T21:40:43.145248+0000","last_undegraded":"2024-02-19T21:40:43.145248+0000","last_fullsized":"2024-02-19T21:40:43.145248+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'6","last_scrub_stamp":"2024-02-19T21:39:24.011489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:24.011489+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":36,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.137729+0000","last_change":"2024-02-19T21:39:41.367764+0000","last_active":"2024-02-19T21:40:43.137729+0000","last_peered":"2024-02-19T21:40:43.137729+0000","last_clean":"2024-02-19T21:40:43.137729+0000","last_became_active":"2024-02-19T21:39:39.469477+0000","last_became_peered":"2024-02-19T21:39:39.469477+0000","last_unstale":"2024-02-19T21:40:43.137729+0000","last_undegraded":"2024-02-19T21:40:43.137729+0000","last_fullsized":"2024-02-19T21:40:43.137729+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:41.367692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:41.367692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":57,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.130400+0000","last_change":"2024-02-19T21:40:34.284861+0000","last_active":"2024-02-19T21:40:43.130400+0000","last_peered":"2024-02-19T21:40:43.130400+0000","last_clean":"2024-02-19T21:40:43.130400+0000","last_became_active":"2024-02-19T21:38:31.249969+0000","last_became_peered":"2024-02-19T21:38:31.249969+0000","last_unstale":"2024-02-19T21:40:43.130400+0000","last_undegraded":"2024-02-19T21:40:43.130400+0000","last_fullsized":"2024-02-19T21:40:43.130400+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:34.284787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:34.284787+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":31,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.127599+0000","last_change":"2024-02-19T21:39:39.477623+0000","last_active":"2024-02-19T21:40:43.127599+0000","last_peered":"2024-02-19T21:40:43.127599+0000","last_clean":"2024-02-19T21:40:43.127599+0000","last_became_active":"2024-02-19T21:39:39.477308+0000","last_became_peered":"2024-02-19T21:39:39.477308+0000","last_unstale":"2024-02-19T21:40:43.127599+0000","last_undegraded":"2024-02-19T21:40:43.127599+0000","last_fullsized":"2024-02-19T21:40:43.127599+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:26.250620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:38:26.250620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"66'9","reported_seq":207,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.125812+0000","last_change":"2024-02-19T21:39:46.193498+0000","last_active":"2024-02-19T21:40:43.125812+0000","last_peered":"2024-02-19T21:40:43.125812+0000","last_clean":"2024-02-19T21:40:43.125812+0000","last_became_active":"2024-02-19T21:39:39.470993+0000","last_became_peered":"2024-02-19T21:39:39.470993+0000","last_unstale":"2024-02-19T21:40:43.125812+0000","last_undegraded":"2024-02-19T21:40:43.125812+0000","last_fullsized":"2024-02-19T21:40:43.125812+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:39:46.193426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:46.193426+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6],"acting":[0,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"185'7516","reported_seq":7544,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-02-19T21:41:19.856568+0000","last_change":"2024-02-19T21:39:39.469485+0000","last_active":"2024-02-19T21:41:19.856568+0000","last_peered":"2024-02-19T21:41:19.856568+0000","last_clean":"2024-02-19T21:41:19.856568+0000","last_became_active":"2024-02-19T21:39:39.469130+0000","last_became_peered":"2024-02-19T21:39:39.469130+0000","last_unstale":"2024-02-19T21:41:19.856568+0000","last_undegraded":"2024-02-19T21:41:19.856568+0000","last_fullsized":"2024-02-19T21:41:19.856568+0000","mapping_epoch":165,"log_start":"174'3100","ondisk_log_start":"174'3100","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4416,"ondisk_log_size":4416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":492568576,"num_objects":7516,"num_object_clones":0,"num_object_copies":22548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7516,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7516,"num_write_kb":481024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":148,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.134697+0000","last_change":"2024-02-19T21:40:35.539321+0000","last_active":"2024-02-19T21:40:43.134697+0000","last_peered":"2024-02-19T21:40:43.134697+0000","last_clean":"2024-02-19T21:40:43.134697+0000","last_became_active":"2024-02-19T21:32:29.376027+0000","last_became_peered":"2024-02-19T21:32:29.376027+0000","last_unstale":"2024-02-19T21:40:43.134697+0000","last_undegraded":"2024-02-19T21:40:43.134697+0000","last_fullsized":"2024-02-19T21:40:43.134697+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:35.539219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:40:35.539219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"59'2","reported_seq":177,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.137780+0000","last_change":"2024-02-19T21:39:33.533206+0000","last_active":"2024-02-19T21:40:43.137780+0000","last_peered":"2024-02-19T21:40:43.137780+0000","last_clean":"2024-02-19T21:40:43.137780+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:40:43.137780+0000","last_undegraded":"2024-02-19T21:40:43.137780+0000","last_fullsized":"2024-02-19T21:40:43.137780+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-02-19T21:39:33.533126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:39:33.533126+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"83'17","reported_seq":185,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.130418+0000","last_change":"2024-02-19T21:40:37.318743+0000","last_active":"2024-02-19T21:40:43.130418+0000","last_peered":"2024-02-19T21:40:43.130418+0000","last_clean":"2024-02-19T21:40:43.130418+0000","last_became_active":"2024-02-19T21:38:31.247821+0000","last_became_peered":"2024-02-19T21:38:31.247821+0000","last_unstale":"2024-02-19T21:40:43.130418+0000","last_undegraded":"2024-02-19T21:40:43.130418+0000","last_fullsized":"2024-02-19T21:40:43.130418+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'17","last_scrub_stamp":"2024-02-19T21:40:37.318642+0000","last_deep_scrub":"83'17","last_deep_scrub_stamp":"2024-02-19T21:33:43.418450+0000","last_clean_scrub_stamp":"2024-02-19T21:40:37.318642+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":31,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.124869+0000","last_change":"2024-02-19T21:39:39.467760+0000","last_active":"2024-02-19T21:40:43.124869+0000","last_peered":"2024-02-19T21:40:43.124869+0000","last_clean":"2024-02-19T21:40:43.124869+0000","last_became_active":"2024-02-19T21:39:39.467210+0000","last_became_peered":"2024-02-19T21:39:39.467210+0000","last_unstale":"2024-02-19T21:40:43.124869+0000","last_undegraded":"2024-02-19T21:40:43.124869+0000","last_fullsized":"2024-02-19T21:40:43.124869+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:37.384723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:37.384723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"185'7664","reported_seq":7692,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-02-19T21:41:20.056480+0000","last_change":"2024-02-19T21:39:39.471871+0000","last_active":"2024-02-19T21:41:20.056480+0000","last_peered":"2024-02-19T21:41:20.056480+0000","last_clean":"2024-02-19T21:41:20.056480+0000","last_became_active":"2024-02-19T21:39:39.471575+0000","last_became_peered":"2024-02-19T21:39:39.471575+0000","last_unstale":"2024-02-19T21:41:20.056480+0000","last_undegraded":"2024-02-19T21:41:20.056480+0000","last_fullsized":"2024-02-19T21:41:20.056480+0000","mapping_epoch":165,"log_start":"173'3000","ondisk_log_start":"173'3000","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4664,"ondisk_log_size":4664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":502267904,"num_objects":7664,"num_object_clones":0,"num_object_copies":22992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7664,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7664,"num_write_kb":490496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":167,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.124446+0000","last_change":"2024-02-19T21:40:40.474397+0000","last_active":"2024-02-19T21:40:43.124446+0000","last_peered":"2024-02-19T21:40:43.124446+0000","last_clean":"2024-02-19T21:40:43.124446+0000","last_became_active":"2024-02-19T21:39:39.466788+0000","last_became_peered":"2024-02-19T21:39:39.466788+0000","last_unstale":"2024-02-19T21:40:43.124446+0000","last_undegraded":"2024-02-19T21:40:43.124446+0000","last_fullsized":"2024-02-19T21:40:43.124446+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:40.474333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:40.474333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":150,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.129030+0000","last_change":"2024-02-19T21:39:34.971980+0000","last_active":"2024-02-19T21:40:43.129030+0000","last_peered":"2024-02-19T21:40:43.129030+0000","last_clean":"2024-02-19T21:40:43.129030+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:40:43.129030+0000","last_undegraded":"2024-02-19T21:40:43.129030+0000","last_fullsized":"2024-02-19T21:40:43.129030+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:34.971917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:39:34.971917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"66'10","reported_seq":41,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.129792+0000","last_change":"2024-02-19T21:39:39.526201+0000","last_active":"2024-02-19T21:40:43.129792+0000","last_peered":"2024-02-19T21:40:43.129792+0000","last_clean":"2024-02-19T21:40:43.129792+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:40:43.129792+0000","last_undegraded":"2024-02-19T21:40:43.129792+0000","last_fullsized":"2024-02-19T21:40:43.129792+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:37:14.054904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:14.054904+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":268,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-02-19T21:41:11.964705+0000","last_change":"2024-02-19T21:40:25.363354+0000","last_active":"2024-02-19T21:41:11.964705+0000","last_peered":"2024-02-19T21:41:11.964705+0000","last_clean":"2024-02-19T21:41:11.964705+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:41:11.964705+0000","last_undegraded":"2024-02-19T21:41:11.964705+0000","last_fullsized":"2024-02-19T21:41:11.964705+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:40:25.363236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:25.363236+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"185'7548","reported_seq":7576,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-02-19T21:41:19.867583+0000","last_change":"2024-02-19T21:39:39.471426+0000","last_active":"2024-02-19T21:41:19.867583+0000","last_peered":"2024-02-19T21:41:19.867583+0000","last_clean":"2024-02-19T21:41:19.867583+0000","last_became_active":"2024-02-19T21:39:39.471113+0000","last_became_peered":"2024-02-19T21:39:39.471113+0000","last_unstale":"2024-02-19T21:41:19.867583+0000","last_undegraded":"2024-02-19T21:41:19.867583+0000","last_fullsized":"2024-02-19T21:41:19.867583+0000","mapping_epoch":165,"log_start":"173'2900","ondisk_log_start":"173'2900","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4648,"ondisk_log_size":4648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":494665728,"num_objects":7548,"num_object_clones":0,"num_object_copies":22644,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7548,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7548,"num_write_kb":483072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":62,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.137938+0000","last_change":"2024-02-19T21:40:27.767533+0000","last_active":"2024-02-19T21:40:43.137938+0000","last_peered":"2024-02-19T21:40:43.137938+0000","last_clean":"2024-02-19T21:40:43.137938+0000","last_became_active":"2024-02-19T21:38:31.244787+0000","last_became_peered":"2024-02-19T21:38:31.244787+0000","last_unstale":"2024-02-19T21:40:43.137938+0000","last_undegraded":"2024-02-19T21:40:43.137938+0000","last_fullsized":"2024-02-19T21:40:43.137938+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:27.767442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:27.767442+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":154,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.128172+0000","last_change":"2024-02-19T21:39:27.079886+0000","last_active":"2024-02-19T21:40:43.128172+0000","last_peered":"2024-02-19T21:40:43.128172+0000","last_clean":"2024-02-19T21:40:43.128172+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:40:43.128172+0000","last_undegraded":"2024-02-19T21:40:43.128172+0000","last_fullsized":"2024-02-19T21:40:43.128172+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:27.079784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:39:27.079784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"167'30","reported_seq":366,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-02-19T21:41:11.964467+0000","last_change":"2024-02-19T21:39:43.996618+0000","last_active":"2024-02-19T21:41:11.964467+0000","last_peered":"2024-02-19T21:41:11.964467+0000","last_clean":"2024-02-19T21:41:11.964467+0000","last_became_active":"2024-02-19T21:39:39.476146+0000","last_became_peered":"2024-02-19T21:39:39.476146+0000","last_unstale":"2024-02-19T21:41:11.964467+0000","last_undegraded":"2024-02-19T21:41:11.964467+0000","last_fullsized":"2024-02-19T21:41:11.964467+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'30","last_scrub_stamp":"2024-02-19T21:39:43.996511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:43.996511+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,7],"acting":[1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":146,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.124484+0000","last_change":"2024-02-19T21:38:16.890343+0000","last_active":"2024-02-19T21:40:43.124484+0000","last_peered":"2024-02-19T21:40:43.124484+0000","last_clean":"2024-02-19T21:40:43.124484+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:40:43.124484+0000","last_undegraded":"2024-02-19T21:40:43.124484+0000","last_fullsized":"2024-02-19T21:40:43.124484+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:16.890269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:16.890269+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"185'7558","reported_seq":7583,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-02-19T21:41:19.867715+0000","last_change":"2024-02-19T21:39:39.469811+0000","last_active":"2024-02-19T21:41:19.867715+0000","last_peered":"2024-02-19T21:41:19.867715+0000","last_clean":"2024-02-19T21:41:19.867715+0000","last_became_active":"2024-02-19T21:39:39.469500+0000","last_became_peered":"2024-02-19T21:39:39.469500+0000","last_unstale":"2024-02-19T21:41:19.867715+0000","last_undegraded":"2024-02-19T21:41:19.867715+0000","last_fullsized":"2024-02-19T21:41:19.867715+0000","mapping_epoch":165,"log_start":"173'3000","ondisk_log_start":"173'3000","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4558,"ondisk_log_size":4558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":495321088,"num_objects":7558,"num_object_clones":0,"num_object_copies":22674,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7558,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7558,"num_write_kb":483712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7],"acting":[4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":143,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.145479+0000","last_change":"2024-02-19T21:39:29.085751+0000","last_active":"2024-02-19T21:40:43.145479+0000","last_peered":"2024-02-19T21:40:43.145479+0000","last_clean":"2024-02-19T21:40:43.145479+0000","last_became_active":"2024-02-19T21:32:29.597365+0000","last_became_peered":"2024-02-19T21:32:29.597365+0000","last_unstale":"2024-02-19T21:40:43.145479+0000","last_undegraded":"2024-02-19T21:40:43.145479+0000","last_fullsized":"2024-02-19T21:40:43.145479+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:29.085642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:29.085642+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"67'5","reported_seq":693,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-02-19T21:41:18.771701+0000","last_change":"2024-02-19T21:39:39.576551+0000","last_active":"2024-02-19T21:41:18.771701+0000","last_peered":"2024-02-19T21:41:18.771701+0000","last_clean":"2024-02-19T21:41:18.771701+0000","last_became_active":"2024-02-19T21:39:39.464361+0000","last_became_peered":"2024-02-19T21:39:39.464361+0000","last_unstale":"2024-02-19T21:41:18.771701+0000","last_undegraded":"2024-02-19T21:41:18.771701+0000","last_fullsized":"2024-02-19T21:41:18.771701+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5","last_scrub_stamp":"2024-02-19T21:38:17.997743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:38:17.997743+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":524,"num_read_kb":519,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":145,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.124650+0000","last_change":"2024-02-19T21:39:39.468973+0000","last_active":"2024-02-19T21:40:43.124650+0000","last_peered":"2024-02-19T21:40:43.124650+0000","last_clean":"2024-02-19T21:40:43.124650+0000","last_became_active":"2024-02-19T21:39:39.468113+0000","last_became_peered":"2024-02-19T21:39:39.468113+0000","last_unstale":"2024-02-19T21:40:43.124650+0000","last_undegraded":"2024-02-19T21:40:43.124650+0000","last_fullsized":"2024-02-19T21:40:43.124650+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:15.194849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:38:15.194849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"66'13","reported_seq":185,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.130319+0000","last_change":"2024-02-19T21:37:32.806098+0000","last_active":"2024-02-19T21:40:43.130319+0000","last_peered":"2024-02-19T21:40:43.130319+0000","last_clean":"2024-02-19T21:40:43.130319+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:40:43.130319+0000","last_undegraded":"2024-02-19T21:40:43.130319+0000","last_fullsized":"2024-02-19T21:40:43.130319+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'13","last_scrub_stamp":"2024-02-19T21:37:32.805993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:32.805993+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":31,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.127216+0000","last_change":"2024-02-19T21:39:39.477625+0000","last_active":"2024-02-19T21:40:43.127216+0000","last_peered":"2024-02-19T21:40:43.127216+0000","last_clean":"2024-02-19T21:40:43.127216+0000","last_became_active":"2024-02-19T21:39:39.475190+0000","last_became_peered":"2024-02-19T21:39:39.475190+0000","last_unstale":"2024-02-19T21:40:43.127216+0000","last_undegraded":"2024-02-19T21:40:43.127216+0000","last_fullsized":"2024-02-19T21:40:43.127216+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:14.199989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:14.199989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"185'7434","reported_seq":7462,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-02-19T21:41:19.857515+0000","last_change":"2024-02-19T21:39:39.475831+0000","last_active":"2024-02-19T21:41:19.857515+0000","last_peered":"2024-02-19T21:41:19.857515+0000","last_clean":"2024-02-19T21:41:19.857515+0000","last_became_active":"2024-02-19T21:39:39.475531+0000","last_became_peered":"2024-02-19T21:39:39.475531+0000","last_unstale":"2024-02-19T21:41:19.857515+0000","last_undegraded":"2024-02-19T21:41:19.857515+0000","last_fullsized":"2024-02-19T21:41:19.857515+0000","mapping_epoch":165,"log_start":"174'3000","ondisk_log_start":"174'3000","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4434,"ondisk_log_size":4434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":487194624,"num_objects":7434,"num_object_clones":0,"num_object_copies":22302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7434,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7434,"num_write_kb":475776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":148,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.127961+0000","last_change":"2024-02-19T21:40:33.758226+0000","last_active":"2024-02-19T21:40:43.127961+0000","last_peered":"2024-02-19T21:40:43.127961+0000","last_clean":"2024-02-19T21:40:43.127961+0000","last_became_active":"2024-02-19T21:32:29.372547+0000","last_became_peered":"2024-02-19T21:32:29.372547+0000","last_unstale":"2024-02-19T21:40:43.127961+0000","last_undegraded":"2024-02-19T21:40:43.127961+0000","last_fullsized":"2024-02-19T21:40:43.127961+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:33.758127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:40:33.758127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":57,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.126337+0000","last_change":"2024-02-19T21:40:30.692471+0000","last_active":"2024-02-19T21:40:43.126337+0000","last_peered":"2024-02-19T21:40:43.126337+0000","last_clean":"2024-02-19T21:40:43.126337+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:40:43.126337+0000","last_undegraded":"2024-02-19T21:40:43.126337+0000","last_fullsized":"2024-02-19T21:40:43.126337+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:30.692385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:40:30.692385+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":163,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.125791+0000","last_change":"2024-02-19T21:40:39.715093+0000","last_active":"2024-02-19T21:40:43.125791+0000","last_peered":"2024-02-19T21:40:43.125791+0000","last_clean":"2024-02-19T21:40:43.125791+0000","last_became_active":"2024-02-19T21:39:39.473125+0000","last_became_peered":"2024-02-19T21:39:39.473125+0000","last_unstale":"2024-02-19T21:40:43.125791+0000","last_undegraded":"2024-02-19T21:40:43.125791+0000","last_fullsized":"2024-02-19T21:40:43.125791+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:39.714982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:39.714982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.140851+0000","last_change":"2024-02-19T21:40:38.927576+0000","last_active":"2024-02-19T21:40:43.140851+0000","last_peered":"2024-02-19T21:40:43.140851+0000","last_clean":"2024-02-19T21:40:43.140851+0000","last_became_active":"2024-02-19T21:32:16.878022+0000","last_became_peered":"2024-02-19T21:32:16.878022+0000","last_unstale":"2024-02-19T21:40:43.140851+0000","last_undegraded":"2024-02-19T21:40:43.140851+0000","last_fullsized":"2024-02-19T21:40:43.140851+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:38.927472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:40:38.927472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"143'21","reported_seq":181,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.133553+0000","last_change":"2024-02-19T21:40:24.331961+0000","last_active":"2024-02-19T21:40:43.133553+0000","last_peered":"2024-02-19T21:40:43.133553+0000","last_clean":"2024-02-19T21:40:43.133553+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:40:43.133553+0000","last_undegraded":"2024-02-19T21:40:43.133553+0000","last_fullsized":"2024-02-19T21:40:43.133553+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"143'21","last_scrub_stamp":"2024-02-19T21:40:24.331869+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:40:24.331869+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":159,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.142770+0000","last_change":"2024-02-19T21:40:22.826773+0000","last_active":"2024-02-19T21:40:43.142770+0000","last_peered":"2024-02-19T21:40:43.142770+0000","last_clean":"2024-02-19T21:40:43.142770+0000","last_became_active":"2024-02-19T21:39:39.472712+0000","last_became_peered":"2024-02-19T21:39:39.472712+0000","last_unstale":"2024-02-19T21:40:43.142770+0000","last_undegraded":"2024-02-19T21:40:43.142770+0000","last_fullsized":"2024-02-19T21:40:43.142770+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:22.826680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:22.826680+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"185'7456","reported_seq":7484,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-02-19T21:41:19.931428+0000","last_change":"2024-02-19T21:39:39.480146+0000","last_active":"2024-02-19T21:41:19.931428+0000","last_peered":"2024-02-19T21:41:19.931428+0000","last_clean":"2024-02-19T21:41:19.931428+0000","last_became_active":"2024-02-19T21:39:39.479576+0000","last_became_peered":"2024-02-19T21:39:39.479576+0000","last_unstale":"2024-02-19T21:41:19.931428+0000","last_undegraded":"2024-02-19T21:41:19.931428+0000","last_fullsized":"2024-02-19T21:41:19.931428+0000","mapping_epoch":165,"log_start":"177'3400","ondisk_log_start":"177'3400","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4056,"ondisk_log_size":4056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":488636416,"num_objects":7456,"num_object_clones":0,"num_object_copies":22368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7456,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7456,"num_write_kb":477184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":153,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.129286+0000","last_change":"2024-02-19T21:40:29.250688+0000","last_active":"2024-02-19T21:40:43.129286+0000","last_peered":"2024-02-19T21:40:43.129286+0000","last_clean":"2024-02-19T21:40:43.129286+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:40:43.129286+0000","last_undegraded":"2024-02-19T21:40:43.129286+0000","last_fullsized":"2024-02-19T21:40:43.129286+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:40:29.250599+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":159,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.124925+0000","last_change":"2024-02-19T21:38:31.247108+0000","last_active":"2024-02-19T21:40:43.124925+0000","last_peered":"2024-02-19T21:40:43.124925+0000","last_clean":"2024-02-19T21:40:43.124925+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:40:43.124925+0000","last_undegraded":"2024-02-19T21:40:43.124925+0000","last_fullsized":"2024-02-19T21:40:43.124925+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:22.928801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:38:22.928801+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":149,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.140809+0000","last_change":"2024-02-19T21:39:30.117111+0000","last_active":"2024-02-19T21:40:43.140809+0000","last_peered":"2024-02-19T21:40:43.140809+0000","last_clean":"2024-02-19T21:40:43.140809+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:40:43.140809+0000","last_undegraded":"2024-02-19T21:40:43.140809+0000","last_fullsized":"2024-02-19T21:40:43.140809+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:30.117032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:39:30.117032+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"66'12","reported_seq":214,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.125722+0000","last_change":"2024-02-19T21:39:39.494633+0000","last_active":"2024-02-19T21:40:43.125722+0000","last_peered":"2024-02-19T21:40:43.125722+0000","last_clean":"2024-02-19T21:40:43.125722+0000","last_became_active":"2024-02-19T21:39:39.472079+0000","last_became_peered":"2024-02-19T21:39:39.472079+0000","last_unstale":"2024-02-19T21:40:43.125722+0000","last_undegraded":"2024-02-19T21:40:43.125722+0000","last_fullsized":"2024-02-19T21:40:43.125722+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'12","last_scrub_stamp":"2024-02-19T21:38:18.908732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:38:18.908732+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":145,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.127851+0000","last_change":"2024-02-19T21:38:25.921065+0000","last_active":"2024-02-19T21:40:43.127851+0000","last_peered":"2024-02-19T21:40:43.127851+0000","last_clean":"2024-02-19T21:40:43.127851+0000","last_became_active":"2024-02-19T21:32:27.372460+0000","last_became_peered":"2024-02-19T21:32:27.372460+0000","last_unstale":"2024-02-19T21:40:43.127851+0000","last_undegraded":"2024-02-19T21:40:43.127851+0000","last_fullsized":"2024-02-19T21:40:43.127851+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:25.920968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:25.920968+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"185'7467","reported_seq":7495,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-02-19T21:41:19.973321+0000","last_change":"2024-02-19T21:39:39.468511+0000","last_active":"2024-02-19T21:41:19.973321+0000","last_peered":"2024-02-19T21:41:19.973321+0000","last_clean":"2024-02-19T21:41:19.973321+0000","last_became_active":"2024-02-19T21:39:39.468217+0000","last_became_peered":"2024-02-19T21:39:39.468217+0000","last_unstale":"2024-02-19T21:41:19.973321+0000","last_undegraded":"2024-02-19T21:41:19.973321+0000","last_fullsized":"2024-02-19T21:41:19.973321+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":7467,"ondisk_log_size":7467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":489357312,"num_objects":7467,"num_object_clones":0,"num_object_copies":22401,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7467,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7467,"num_write_kb":477888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":153,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.130639+0000","last_change":"2024-02-19T21:39:42.020899+0000","last_active":"2024-02-19T21:40:43.130639+0000","last_peered":"2024-02-19T21:40:43.130639+0000","last_clean":"2024-02-19T21:40:43.130639+0000","last_became_active":"2024-02-19T21:39:39.474951+0000","last_became_peered":"2024-02-19T21:39:39.474951+0000","last_unstale":"2024-02-19T21:40:43.130639+0000","last_undegraded":"2024-02-19T21:40:43.130639+0000","last_fullsized":"2024-02-19T21:40:43.130639+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:39:42.020832+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,7],"acting":[1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":149,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.145564+0000","last_change":"2024-02-19T21:40:11.877814+0000","last_active":"2024-02-19T21:40:43.145564+0000","last_peered":"2024-02-19T21:40:43.145564+0000","last_clean":"2024-02-19T21:40:43.145564+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:40:43.145564+0000","last_undegraded":"2024-02-19T21:40:43.145564+0000","last_fullsized":"2024-02-19T21:40:43.145564+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:11.877751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:11.877751+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"83'27","reported_seq":197,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.124075+0000","last_change":"2024-02-19T21:40:26.405558+0000","last_active":"2024-02-19T21:40:43.124075+0000","last_peered":"2024-02-19T21:40:43.124075+0000","last_clean":"2024-02-19T21:40:43.124075+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:40:43.124075+0000","last_undegraded":"2024-02-19T21:40:43.124075+0000","last_fullsized":"2024-02-19T21:40:43.124075+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'27","last_scrub_stamp":"2024-02-19T21:40:26.405455+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:40:26.405455+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":152,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.135229+0000","last_change":"2024-02-19T21:40:16.260329+0000","last_active":"2024-02-19T21:40:43.135229+0000","last_peered":"2024-02-19T21:40:43.135229+0000","last_clean":"2024-02-19T21:40:43.135229+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:40:43.135229+0000","last_undegraded":"2024-02-19T21:40:43.135229+0000","last_fullsized":"2024-02-19T21:40:43.135229+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:16.260223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:40:16.260223+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.c","version":"185'7608","reported_seq":7636,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-02-19T21:41:19.993752+0000","last_change":"2024-02-19T21:39:39.476418+0000","last_active":"2024-02-19T21:41:19.993752+0000","last_peered":"2024-02-19T21:41:19.993752+0000","last_clean":"2024-02-19T21:41:19.993752+0000","last_became_active":"2024-02-19T21:39:39.476073+0000","last_became_peered":"2024-02-19T21:39:39.476073+0000","last_unstale":"2024-02-19T21:41:19.993752+0000","last_undegraded":"2024-02-19T21:41:19.993752+0000","last_fullsized":"2024-02-19T21:41:19.993752+0000","mapping_epoch":165,"log_start":"173'2900","ondisk_log_start":"173'2900","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4708,"ondisk_log_size":4708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":498597888,"num_objects":7608,"num_object_clones":0,"num_object_copies":22824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7608,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7608,"num_write_kb":486912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":42,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.134801+0000","last_change":"2024-02-19T21:39:44.231498+0000","last_active":"2024-02-19T21:40:43.134801+0000","last_peered":"2024-02-19T21:40:43.134801+0000","last_clean":"2024-02-19T21:40:43.134801+0000","last_became_active":"2024-02-19T21:39:39.472861+0000","last_became_peered":"2024-02-19T21:39:39.472861+0000","last_unstale":"2024-02-19T21:40:43.134801+0000","last_undegraded":"2024-02-19T21:40:43.134801+0000","last_fullsized":"2024-02-19T21:40:43.134801+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:44.231420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:44.231420+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":152,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.129501+0000","last_change":"2024-02-19T21:38:28.036423+0000","last_active":"2024-02-19T21:40:43.129501+0000","last_peered":"2024-02-19T21:40:43.129501+0000","last_clean":"2024-02-19T21:40:43.129501+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:40:43.129501+0000","last_undegraded":"2024-02-19T21:40:43.129501+0000","last_fullsized":"2024-02-19T21:40:43.129501+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:38:28.036351+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"168'26","reported_seq":127,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.141030+0000","last_change":"2024-02-19T21:39:48.004824+0000","last_active":"2024-02-19T21:40:43.141030+0000","last_peered":"2024-02-19T21:40:43.141030+0000","last_clean":"2024-02-19T21:40:43.141030+0000","last_became_active":"2024-02-19T21:38:31.249726+0000","last_became_peered":"2024-02-19T21:38:31.249726+0000","last_unstale":"2024-02-19T21:40:43.141030+0000","last_undegraded":"2024-02-19T21:40:43.141030+0000","last_fullsized":"2024-02-19T21:40:43.141030+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"168'26","last_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:39:48.004702+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":33,"num_read_kb":21,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":25,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.133435+0000","last_change":"2024-02-19T21:39:51.537021+0000","last_active":"2024-02-19T21:40:43.133435+0000","last_peered":"2024-02-19T21:40:43.133435+0000","last_clean":"2024-02-19T21:40:43.133435+0000","last_became_active":"2024-02-19T21:39:51.536640+0000","last_became_peered":"2024-02-19T21:39:51.536640+0000","last_unstale":"2024-02-19T21:40:43.133435+0000","last_undegraded":"2024-02-19T21:40:43.133435+0000","last_fullsized":"2024-02-19T21:40:43.133435+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:34.519432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:34.519432+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.d","version":"185'7408","reported_seq":7435,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-02-19T21:41:19.885619+0000","last_change":"2024-02-19T21:39:39.471058+0000","last_active":"2024-02-19T21:41:19.885619+0000","last_peered":"2024-02-19T21:41:19.885619+0000","last_clean":"2024-02-19T21:41:19.885619+0000","last_became_active":"2024-02-19T21:39:39.470705+0000","last_became_peered":"2024-02-19T21:39:39.470705+0000","last_unstale":"2024-02-19T21:41:19.885619+0000","last_undegraded":"2024-02-19T21:41:19.885619+0000","last_fullsized":"2024-02-19T21:41:19.885619+0000","mapping_epoch":165,"log_start":"173'2700","ondisk_log_start":"173'2700","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4708,"ondisk_log_size":4708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":485490688,"num_objects":7408,"num_object_clones":0,"num_object_copies":22224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7408,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7408,"num_write_kb":474112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":157,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.142636+0000","last_change":"2024-02-19T21:40:28.874859+0000","last_active":"2024-02-19T21:40:43.142636+0000","last_peered":"2024-02-19T21:40:43.142636+0000","last_clean":"2024-02-19T21:40:43.142636+0000","last_became_active":"2024-02-19T21:39:39.481908+0000","last_became_peered":"2024-02-19T21:39:39.481908+0000","last_unstale":"2024-02-19T21:40:43.142636+0000","last_undegraded":"2024-02-19T21:40:43.142636+0000","last_fullsized":"2024-02-19T21:40:43.142636+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:28.874762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:28.874762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":163,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.134110+0000","last_change":"2024-02-19T21:40:32.498539+0000","last_active":"2024-02-19T21:40:43.134110+0000","last_peered":"2024-02-19T21:40:43.134110+0000","last_clean":"2024-02-19T21:40:43.134110+0000","last_became_active":"2024-02-19T21:39:39.462545+0000","last_became_peered":"2024-02-19T21:39:39.462545+0000","last_unstale":"2024-02-19T21:40:43.134110+0000","last_undegraded":"2024-02-19T21:40:43.134110+0000","last_fullsized":"2024-02-19T21:40:43.134110+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:32.498434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:32.498434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"66'14","reported_seq":142,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.125613+0000","last_change":"2024-02-19T21:38:30.886495+0000","last_active":"2024-02-19T21:40:43.125613+0000","last_peered":"2024-02-19T21:40:43.125613+0000","last_clean":"2024-02-19T21:40:43.125613+0000","last_became_active":"2024-02-19T21:35:14.513806+0000","last_became_peered":"2024-02-19T21:35:14.513806+0000","last_unstale":"2024-02-19T21:40:43.125613+0000","last_undegraded":"2024-02-19T21:40:43.125613+0000","last_fullsized":"2024-02-19T21:40:43.125613+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'14","last_scrub_stamp":"2024-02-19T21:38:30.886421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:38:30.886421+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":113,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-02-19T21:41:11.963287+0000","last_change":"2024-02-19T21:38:31.340504+0000","last_active":"2024-02-19T21:41:11.963287+0000","last_peered":"2024-02-19T21:41:11.963287+0000","last_clean":"2024-02-19T21:41:11.963287+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:41:11.963287+0000","last_undegraded":"2024-02-19T21:41:11.963287+0000","last_fullsized":"2024-02-19T21:41:11.963287+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:37:07.618614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:37:07.618614+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"185'7453","reported_seq":7481,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-02-19T21:41:19.864230+0000","last_change":"2024-02-19T21:39:39.471935+0000","last_active":"2024-02-19T21:41:19.864230+0000","last_peered":"2024-02-19T21:41:19.864230+0000","last_clean":"2024-02-19T21:41:19.864230+0000","last_became_active":"2024-02-19T21:39:39.471580+0000","last_became_peered":"2024-02-19T21:39:39.471580+0000","last_unstale":"2024-02-19T21:41:19.864230+0000","last_undegraded":"2024-02-19T21:41:19.864230+0000","last_fullsized":"2024-02-19T21:41:19.864230+0000","mapping_epoch":165,"log_start":"173'2900","ondisk_log_start":"173'2900","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4553,"ondisk_log_size":4553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":488439808,"num_objects":7453,"num_object_clones":0,"num_object_copies":22359,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7453,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7453,"num_write_kb":476992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":34,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.135047+0000","last_change":"2024-02-19T21:40:21.371352+0000","last_active":"2024-02-19T21:40:43.135047+0000","last_peered":"2024-02-19T21:40:43.135047+0000","last_clean":"2024-02-19T21:40:43.135047+0000","last_became_active":"2024-02-19T21:39:39.477051+0000","last_became_peered":"2024-02-19T21:39:39.477051+0000","last_unstale":"2024-02-19T21:40:43.135047+0000","last_undegraded":"2024-02-19T21:40:43.135047+0000","last_fullsized":"2024-02-19T21:40:43.135047+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:21.371240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:40:21.371240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":150,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.127775+0000","last_change":"2024-02-19T21:40:22.774178+0000","last_active":"2024-02-19T21:40:43.127775+0000","last_peered":"2024-02-19T21:40:43.127775+0000","last_clean":"2024-02-19T21:40:43.127775+0000","last_became_active":"2024-02-19T21:32:27.362497+0000","last_became_peered":"2024-02-19T21:32:27.362497+0000","last_unstale":"2024-02-19T21:40:43.127775+0000","last_undegraded":"2024-02-19T21:40:43.127775+0000","last_fullsized":"2024-02-19T21:40:43.127775+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:22.774081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:22.774081+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":161,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.140888+0000","last_change":"2024-02-19T21:40:41.901768+0000","last_active":"2024-02-19T21:40:43.140888+0000","last_peered":"2024-02-19T21:40:43.140888+0000","last_clean":"2024-02-19T21:40:43.140888+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:40:43.140888+0000","last_undegraded":"2024-02-19T21:40:43.140888+0000","last_fullsized":"2024-02-19T21:40:43.140888+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:40:41.901670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:41.901670+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"66'11","reported_seq":166,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.134241+0000","last_change":"2024-02-19T21:40:26.390284+0000","last_active":"2024-02-19T21:40:43.134241+0000","last_peered":"2024-02-19T21:40:43.134241+0000","last_clean":"2024-02-19T21:40:43.134241+0000","last_became_active":"2024-02-19T21:39:51.536649+0000","last_became_peered":"2024-02-19T21:39:51.536649+0000","last_unstale":"2024-02-19T21:40:43.134241+0000","last_undegraded":"2024-02-19T21:40:43.134241+0000","last_fullsized":"2024-02-19T21:40:43.134241+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:40:26.390173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:26.390173+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"185'7556","reported_seq":7584,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-02-19T21:41:19.924294+0000","last_change":"2024-02-19T21:39:39.479591+0000","last_active":"2024-02-19T21:41:19.924294+0000","last_peered":"2024-02-19T21:41:19.924294+0000","last_clean":"2024-02-19T21:41:19.924294+0000","last_became_active":"2024-02-19T21:39:39.479224+0000","last_became_peered":"2024-02-19T21:39:39.479224+0000","last_unstale":"2024-02-19T21:41:19.924294+0000","last_undegraded":"2024-02-19T21:41:19.924294+0000","last_fullsized":"2024-02-19T21:41:19.924294+0000","mapping_epoch":165,"log_start":"176'3500","ondisk_log_start":"176'3500","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4056,"ondisk_log_size":4056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":495190016,"num_objects":7556,"num_object_clones":0,"num_object_copies":22668,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7556,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7556,"num_write_kb":483584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":148,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.127208+0000","last_change":"2024-02-19T21:40:16.845431+0000","last_active":"2024-02-19T21:40:43.127208+0000","last_peered":"2024-02-19T21:40:43.127208+0000","last_clean":"2024-02-19T21:40:43.127208+0000","last_became_active":"2024-02-19T21:32:29.378462+0000","last_became_peered":"2024-02-19T21:32:29.378462+0000","last_unstale":"2024-02-19T21:40:43.127208+0000","last_undegraded":"2024-02-19T21:40:43.127208+0000","last_fullsized":"2024-02-19T21:40:43.127208+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:16.845272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:16.845272+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"98'9","reported_seq":208,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-02-19T21:41:11.962679+0000","last_change":"2024-02-19T21:38:23.887797+0000","last_active":"2024-02-19T21:41:11.962679+0000","last_peered":"2024-02-19T21:41:11.962679+0000","last_clean":"2024-02-19T21:41:11.962679+0000","last_became_active":"2024-02-19T21:35:14.513802+0000","last_became_peered":"2024-02-19T21:35:14.513802+0000","last_unstale":"2024-02-19T21:41:11.962679+0000","last_undegraded":"2024-02-19T21:41:11.962679+0000","last_fullsized":"2024-02-19T21:41:11.962679+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'9","last_scrub_stamp":"2024-02-19T21:38:23.887716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:23.887716+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":155,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.130497+0000","last_change":"2024-02-19T21:40:14.294150+0000","last_active":"2024-02-19T21:40:43.130497+0000","last_peered":"2024-02-19T21:40:43.130497+0000","last_clean":"2024-02-19T21:40:43.130497+0000","last_became_active":"2024-02-19T21:32:23.362738+0000","last_became_peered":"2024-02-19T21:32:23.362738+0000","last_unstale":"2024-02-19T21:40:43.130497+0000","last_undegraded":"2024-02-19T21:40:43.130497+0000","last_fullsized":"2024-02-19T21:40:43.130497+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:14.294064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:40:14.294064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"66'15","reported_seq":46,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.127386+0000","last_change":"2024-02-19T21:40:12.838278+0000","last_active":"2024-02-19T21:40:43.127386+0000","last_peered":"2024-02-19T21:40:43.127386+0000","last_clean":"2024-02-19T21:40:43.127386+0000","last_became_active":"2024-02-19T21:39:51.539230+0000","last_became_peered":"2024-02-19T21:39:51.539230+0000","last_unstale":"2024-02-19T21:40:43.127386+0000","last_undegraded":"2024-02-19T21:40:43.127386+0000","last_fullsized":"2024-02-19T21:40:43.127386+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:40:12.838083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:12.838083+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.0","version":"185'7567","reported_seq":7595,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-02-19T21:41:19.962346+0000","last_change":"2024-02-19T21:39:39.465524+0000","last_active":"2024-02-19T21:41:19.962346+0000","last_peered":"2024-02-19T21:41:19.962346+0000","last_clean":"2024-02-19T21:41:19.962346+0000","last_became_active":"2024-02-19T21:39:39.465196+0000","last_became_peered":"2024-02-19T21:39:39.465196+0000","last_unstale":"2024-02-19T21:41:19.962346+0000","last_undegraded":"2024-02-19T21:41:19.962346+0000","last_fullsized":"2024-02-19T21:41:19.962346+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":7567,"ondisk_log_size":7567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":495910912,"num_objects":7567,"num_object_clones":0,"num_object_copies":22701,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7567,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7567,"num_write_kb":484288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":118,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.129772+0000","last_change":"2024-02-19T21:39:40.016015+0000","last_active":"2024-02-19T21:40:43.129772+0000","last_peered":"2024-02-19T21:40:43.129772+0000","last_clean":"2024-02-19T21:40:43.129772+0000","last_became_active":"2024-02-19T21:39:39.479567+0000","last_became_peered":"2024-02-19T21:39:39.479567+0000","last_unstale":"2024-02-19T21:40:43.129772+0000","last_undegraded":"2024-02-19T21:40:43.129772+0000","last_fullsized":"2024-02-19T21:40:43.129772+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:40.015907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:40.015907+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"170'11","reported_seq":127,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-02-19T21:41:11.962636+0000","last_change":"2024-02-19T21:40:21.864057+0000","last_active":"2024-02-19T21:41:11.962636+0000","last_peered":"2024-02-19T21:41:11.962636+0000","last_clean":"2024-02-19T21:41:11.962636+0000","last_became_active":"2024-02-19T21:39:51.534304+0000","last_became_peered":"2024-02-19T21:39:51.534304+0000","last_unstale":"2024-02-19T21:41:11.962636+0000","last_undegraded":"2024-02-19T21:41:11.962636+0000","last_fullsized":"2024-02-19T21:41:11.962636+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'11","last_scrub_stamp":"2024-02-19T21:40:21.863959+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:40:21.863959+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":152,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.129631+0000","last_change":"2024-02-19T21:39:31.018063+0000","last_active":"2024-02-19T21:40:43.129631+0000","last_peered":"2024-02-19T21:40:43.129631+0000","last_clean":"2024-02-19T21:40:43.129631+0000","last_became_active":"2024-02-19T21:32:23.363155+0000","last_became_peered":"2024-02-19T21:32:23.363155+0000","last_unstale":"2024-02-19T21:40:43.129631+0000","last_undegraded":"2024-02-19T21:40:43.129631+0000","last_fullsized":"2024-02-19T21:40:43.129631+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:31.018000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:39:31.018000+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"66'10","reported_seq":136,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.136011+0000","last_change":"2024-02-19T21:39:42.511504+0000","last_active":"2024-02-19T21:40:43.136011+0000","last_peered":"2024-02-19T21:40:43.136011+0000","last_clean":"2024-02-19T21:40:43.136011+0000","last_became_active":"2024-02-19T21:35:14.514968+0000","last_became_peered":"2024-02-19T21:35:14.514968+0000","last_unstale":"2024-02-19T21:40:43.136011+0000","last_undegraded":"2024-02-19T21:40:43.136011+0000","last_fullsized":"2024-02-19T21:40:43.136011+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:39:42.511438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:42.511438+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6],"acting":[3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"185'7519","reported_seq":7547,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-02-19T21:41:19.908846+0000","last_change":"2024-02-19T21:39:39.480753+0000","last_active":"2024-02-19T21:41:19.908846+0000","last_peered":"2024-02-19T21:41:19.908846+0000","last_clean":"2024-02-19T21:41:19.908846+0000","last_became_active":"2024-02-19T21:39:39.480509+0000","last_became_peered":"2024-02-19T21:39:39.480509+0000","last_unstale":"2024-02-19T21:41:19.908846+0000","last_undegraded":"2024-02-19T21:41:19.908846+0000","last_fullsized":"2024-02-19T21:41:19.908846+0000","mapping_epoch":165,"log_start":"176'3400","ondisk_log_start":"176'3400","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4119,"ondisk_log_size":4119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":492765184,"num_objects":7519,"num_object_clones":0,"num_object_copies":22557,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7519,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7519,"num_write_kb":481216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":139,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.134166+0000","last_change":"2024-02-19T21:39:42.276960+0000","last_active":"2024-02-19T21:40:43.134166+0000","last_peered":"2024-02-19T21:40:43.134166+0000","last_clean":"2024-02-19T21:40:43.134166+0000","last_became_active":"2024-02-19T21:39:39.469058+0000","last_became_peered":"2024-02-19T21:39:39.469058+0000","last_unstale":"2024-02-19T21:40:43.134166+0000","last_undegraded":"2024-02-19T21:40:43.134166+0000","last_fullsized":"2024-02-19T21:40:43.134166+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:42.276864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:42.276864+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":146,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.129208+0000","last_change":"2024-02-19T21:39:39.002316+0000","last_active":"2024-02-19T21:40:43.129208+0000","last_peered":"2024-02-19T21:40:43.129208+0000","last_clean":"2024-02-19T21:40:43.129208+0000","last_became_active":"2024-02-19T21:32:27.369452+0000","last_became_peered":"2024-02-19T21:32:27.369452+0000","last_unstale":"2024-02-19T21:40:43.129208+0000","last_undegraded":"2024-02-19T21:40:43.129208+0000","last_fullsized":"2024-02-19T21:40:43.129208+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:39.002258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:39.002258+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":156,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.142482+0000","last_change":"2024-02-19T21:40:32.869530+0000","last_active":"2024-02-19T21:40:43.142482+0000","last_peered":"2024-02-19T21:40:43.142482+0000","last_clean":"2024-02-19T21:40:43.142482+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:40:43.142482+0000","last_undegraded":"2024-02-19T21:40:43.142482+0000","last_fullsized":"2024-02-19T21:40:43.142482+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:32.869462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:40:32.869462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"66'17","reported_seq":89,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.129405+0000","last_change":"2024-02-19T21:39:39.501787+0000","last_active":"2024-02-19T21:40:43.129405+0000","last_peered":"2024-02-19T21:40:43.129405+0000","last_clean":"2024-02-19T21:40:43.129405+0000","last_became_active":"2024-02-19T21:39:39.474668+0000","last_became_peered":"2024-02-19T21:39:39.474668+0000","last_unstale":"2024-02-19T21:40:43.129405+0000","last_undegraded":"2024-02-19T21:40:43.129405+0000","last_fullsized":"2024-02-19T21:40:43.129405+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'17","last_scrub_stamp":"2024-02-19T21:38:19.154753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:38:19.154753+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"185'7548","reported_seq":7576,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-02-19T21:41:20.049791+0000","last_change":"2024-02-19T21:39:39.471363+0000","last_active":"2024-02-19T21:41:20.049791+0000","last_peered":"2024-02-19T21:41:20.049791+0000","last_clean":"2024-02-19T21:41:20.049791+0000","last_became_active":"2024-02-19T21:39:39.470667+0000","last_became_peered":"2024-02-19T21:39:39.470667+0000","last_unstale":"2024-02-19T21:41:20.049791+0000","last_undegraded":"2024-02-19T21:41:20.049791+0000","last_fullsized":"2024-02-19T21:41:20.049791+0000","mapping_epoch":165,"log_start":"173'2900","ondisk_log_start":"173'2900","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4648,"ondisk_log_size":4648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":494665728,"num_objects":7548,"num_object_clones":0,"num_object_copies":22644,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7548,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7548,"num_write_kb":483072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":157,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.140772+0000","last_change":"2024-02-19T21:40:36.890305+0000","last_active":"2024-02-19T21:40:43.140772+0000","last_peered":"2024-02-19T21:40:43.140772+0000","last_clean":"2024-02-19T21:40:43.140772+0000","last_became_active":"2024-02-19T21:39:39.464542+0000","last_became_peered":"2024-02-19T21:39:39.464542+0000","last_unstale":"2024-02-19T21:40:43.140772+0000","last_undegraded":"2024-02-19T21:40:43.140772+0000","last_fullsized":"2024-02-19T21:40:43.140772+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:36.890201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.890201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":36,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.123991+0000","last_change":"2024-02-19T21:40:23.324375+0000","last_active":"2024-02-19T21:40:43.123991+0000","last_peered":"2024-02-19T21:40:43.123991+0000","last_clean":"2024-02-19T21:40:43.123991+0000","last_became_active":"2024-02-19T21:39:39.471933+0000","last_became_peered":"2024-02-19T21:39:39.471933+0000","last_unstale":"2024-02-19T21:40:43.123991+0000","last_undegraded":"2024-02-19T21:40:43.123991+0000","last_fullsized":"2024-02-19T21:40:43.123991+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:23.324303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:46.372184+0000","last_clean_scrub_stamp":"2024-02-19T21:40:23.324303+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":49,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.128310+0000","last_change":"2024-02-19T21:40:28.696870+0000","last_active":"2024-02-19T21:40:43.128310+0000","last_peered":"2024-02-19T21:40:43.128310+0000","last_clean":"2024-02-19T21:40:43.128310+0000","last_became_active":"2024-02-19T21:39:39.479752+0000","last_became_peered":"2024-02-19T21:39:39.479752+0000","last_unstale":"2024-02-19T21:40:43.128310+0000","last_undegraded":"2024-02-19T21:40:43.128310+0000","last_fullsized":"2024-02-19T21:40:43.128310+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:40:28.696783+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"115'28","reported_seq":192,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.135091+0000","last_change":"2024-02-19T21:39:40.282748+0000","last_active":"2024-02-19T21:40:43.135091+0000","last_peered":"2024-02-19T21:40:43.135091+0000","last_clean":"2024-02-19T21:40:43.135091+0000","last_became_active":"2024-02-19T21:32:25.372284+0000","last_became_peered":"2024-02-19T21:32:25.372284+0000","last_unstale":"2024-02-19T21:40:43.135091+0000","last_undegraded":"2024-02-19T21:40:43.135091+0000","last_fullsized":"2024-02-19T21:40:43.135091+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'28","last_scrub_stamp":"2024-02-19T21:39:40.282677+0000","last_deep_scrub":"115'28","last_deep_scrub_stamp":"2024-02-19T21:36:09.031674+0000","last_clean_scrub_stamp":"2024-02-19T21:39:40.282677+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.7","version":"185'7463","reported_seq":7491,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-02-19T21:41:19.900282+0000","last_change":"2024-02-19T21:39:39.463794+0000","last_active":"2024-02-19T21:41:19.900282+0000","last_peered":"2024-02-19T21:41:19.900282+0000","last_clean":"2024-02-19T21:41:19.900282+0000","last_became_active":"2024-02-19T21:39:39.463542+0000","last_became_peered":"2024-02-19T21:39:39.463542+0000","last_unstale":"2024-02-19T21:41:19.900282+0000","last_undegraded":"2024-02-19T21:41:19.900282+0000","last_fullsized":"2024-02-19T21:41:19.900282+0000","mapping_epoch":165,"log_start":"176'3400","ondisk_log_start":"176'3400","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4063,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":489095168,"num_objects":7463,"num_object_clones":0,"num_object_copies":22389,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7463,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7463,"num_write_kb":477632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,6],"acting":[1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":158,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.125058+0000","last_change":"2024-02-19T21:39:42.230802+0000","last_active":"2024-02-19T21:40:43.125058+0000","last_peered":"2024-02-19T21:40:43.125058+0000","last_clean":"2024-02-19T21:40:43.125058+0000","last_became_active":"2024-02-19T21:39:39.470671+0000","last_became_peered":"2024-02-19T21:39:39.470671+0000","last_unstale":"2024-02-19T21:40:43.125058+0000","last_undegraded":"2024-02-19T21:40:43.125058+0000","last_fullsized":"2024-02-19T21:40:43.125058+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:42.230664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:42.230664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":141,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.138991+0000","last_change":"2024-02-19T21:40:40.799240+0000","last_active":"2024-02-19T21:40:43.138991+0000","last_peered":"2024-02-19T21:40:43.138991+0000","last_clean":"2024-02-19T21:40:43.138991+0000","last_became_active":"2024-02-19T21:39:39.468109+0000","last_became_peered":"2024-02-19T21:39:39.468109+0000","last_unstale":"2024-02-19T21:40:43.138991+0000","last_undegraded":"2024-02-19T21:40:43.138991+0000","last_fullsized":"2024-02-19T21:40:43.138991+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:40.799141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:40.799141+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1],"acting":[4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":150,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.129535+0000","last_change":"2024-02-19T21:37:36.883246+0000","last_active":"2024-02-19T21:40:43.129535+0000","last_peered":"2024-02-19T21:40:43.129535+0000","last_clean":"2024-02-19T21:40:43.129535+0000","last_became_active":"2024-02-19T21:32:23.357438+0000","last_became_peered":"2024-02-19T21:32:23.357438+0000","last_unstale":"2024-02-19T21:40:43.129535+0000","last_undegraded":"2024-02-19T21:40:43.129535+0000","last_fullsized":"2024-02-19T21:40:43.129535+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:36.883151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:37:36.883151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"66'9","reported_seq":169,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.124594+0000","last_change":"2024-02-19T21:39:36.193250+0000","last_active":"2024-02-19T21:40:43.124594+0000","last_peered":"2024-02-19T21:40:43.124594+0000","last_clean":"2024-02-19T21:40:43.124594+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:40:43.124594+0000","last_undegraded":"2024-02-19T21:40:43.124594+0000","last_fullsized":"2024-02-19T21:40:43.124594+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:39:36.193184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:36.193184+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"185'7641","reported_seq":7669,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-02-19T21:41:19.867173+0000","last_change":"2024-02-19T21:39:39.474614+0000","last_active":"2024-02-19T21:41:19.867173+0000","last_peered":"2024-02-19T21:41:19.867173+0000","last_clean":"2024-02-19T21:41:19.867173+0000","last_became_active":"2024-02-19T21:39:39.474311+0000","last_became_peered":"2024-02-19T21:39:39.474311+0000","last_unstale":"2024-02-19T21:41:19.867173+0000","last_undegraded":"2024-02-19T21:41:19.867173+0000","last_fullsized":"2024-02-19T21:41:19.867173+0000","mapping_epoch":165,"log_start":"173'3000","ondisk_log_start":"173'3000","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4641,"ondisk_log_size":4641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":500760576,"num_objects":7641,"num_object_clones":0,"num_object_copies":22923,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7641,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7641,"num_write_kb":489024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":148,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.126193+0000","last_change":"2024-02-19T21:40:17.853102+0000","last_active":"2024-02-19T21:40:43.126193+0000","last_peered":"2024-02-19T21:40:43.126193+0000","last_clean":"2024-02-19T21:40:43.126193+0000","last_became_active":"2024-02-19T21:32:29.597248+0000","last_became_peered":"2024-02-19T21:32:29.597248+0000","last_unstale":"2024-02-19T21:40:43.126193+0000","last_undegraded":"2024-02-19T21:40:43.126193+0000","last_fullsized":"2024-02-19T21:40:43.126193+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:17.853016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:40:17.853016+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":145,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.145001+0000","last_change":"2024-02-19T21:40:29.858902+0000","last_active":"2024-02-19T21:40:43.145001+0000","last_peered":"2024-02-19T21:40:43.145001+0000","last_clean":"2024-02-19T21:40:43.145001+0000","last_became_active":"2024-02-19T21:39:39.480651+0000","last_became_peered":"2024-02-19T21:39:39.480651+0000","last_unstale":"2024-02-19T21:40:43.145001+0000","last_undegraded":"2024-02-19T21:40:43.145001+0000","last_fullsized":"2024-02-19T21:40:43.145001+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:40:29.858805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"66'15","reported_seq":179,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-02-19T21:40:43.126453+0000","last_change":"2024-02-19T21:40:23.751996+0000","last_active":"2024-02-19T21:40:43.126453+0000","last_peered":"2024-02-19T21:40:43.126453+0000","last_clean":"2024-02-19T21:40:43.126453+0000","last_became_active":"2024-02-19T21:32:25.372170+0000","last_became_peered":"2024-02-19T21:32:25.372170+0000","last_unstale":"2024-02-19T21:40:43.126453+0000","last_undegraded":"2024-02-19T21:40:43.126453+0000","last_fullsized":"2024-02-19T21:40:43.126453+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:40:23.751886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:23.751886+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"66'8","reported_seq":265,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-02-19T21:41:11.962652+0000","last_change":"2024-02-19T21:40:19.870350+0000","last_active":"2024-02-19T21:41:11.962652+0000","last_peered":"2024-02-19T21:41:11.962652+0000","last_clean":"2024-02-19T21:41:11.962652+0000","last_became_active":"2024-02-19T21:32:27.369840+0000","last_became_peered":"2024-02-19T21:32:27.369840+0000","last_unstale":"2024-02-19T21:41:11.962652+0000","last_undegraded":"2024-02-19T21:41:11.962652+0000","last_fullsized":"2024-02-19T21:41:11.962652+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:40:19.870250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:19.870250+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":7890927616,"num_objects":120406,"num_object_clones":0,"num_object_copies":361218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120406,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120406,"num_write_kb":7705984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":23672061952,"data_stored":23672061952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77306,"ondisk_log_size":77306,"up":48,"acting":48,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":3},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":524,"num_read_kb":519,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":687,"num_read_kb":444,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":2586,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":454,"ondisk_log_size":454,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201390,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3662432,"kb_used_data":3352856,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":90082720,"statfs":{"total":95995035648,"available":92244705280,"internally_reserved":0,"allocated":3433324544,"data_stored":3433009053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:40:27 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.147,"15min":0.746},"min":{"1min":0.30299999999999999,"5min":0.189,"15min":0.189},"max":{"1min":4.0220000000000002,"5min":6.625,"15min":6.625},"last":3.1909999999999998},{"interface":"front","average":{"1min":1.26,"5min":1.5349999999999999,"15min":0.876},"min":{"1min":0.39200000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":6.6900000000000004,"5min":7.2290000000000001,"15min":7.2290000000000001},"last":4.0049999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:40:27 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.7789999999999999,"15min":0.93999999999999995},"min":{"1min":0.36499999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":5.2709999999999999,"5min":11.276999999999999,"15min":11.276999999999999},"last":3.044},{"interface":"front","average":{"1min":1.258,"5min":1.3220000000000001,"15min":0.80200000000000005},"min":{"1min":0.29899999999999999,"5min":0.223,"15min":0.223},"max":{"1min":6.718,"5min":7.2930000000000001,"15min":7.2930000000000001},"last":4.0679999999999996}]},{"osd":2,"last update":"Mon Feb 19 21:40:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.415,"15min":0.83099999999999996},"min":{"1min":0.314,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":4.1689999999999996,"5min":7.1059999999999999,"15min":7.1059999999999999},"last":3.2189999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.831,"15min":0.96899999999999997},"min":{"1min":0.32000000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":5.2930000000000001,"5min":9.7010000000000005,"15min":9.7010000000000005},"last":3.093}]},{"osd":3,"last update":"Mon Feb 19 21:40:27 2024","interfaces":[{"interface":"back","average":{"1min":1.827,"5min":2.427,"15min":1.1719999999999999},"min":{"1min":0.35899999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":6.7729999999999997,"5min":31.559000000000001,"15min":31.559000000000001},"last":3.2679999999999998},{"interface":"front","average":{"1min":1.339,"5min":2.222,"15min":1.099},"min":{"1min":0.34899999999999998,"5min":0.34000000000000002,"15min":0.33800000000000002},"max":{"1min":5.6559999999999997,"5min":30.812999999999999,"15min":30.812999999999999},"last":3.0720000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:40:27 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":0.75600000000000001,"15min":0.56200000000000006},"min":{"1min":0.373,"5min":0.247,"15min":0.247},"max":{"1min":6.7939999999999996,"5min":6.7939999999999996,"15min":6.7939999999999996},"last":4.0960000000000001},{"interface":"front","average":{"1min":1.329,"5min":0.86599999999999999,"15min":0.60799999999999998},"min":{"1min":0.33300000000000002,"5min":0.245,"15min":0.245},"max":{"1min":5.7560000000000002,"5min":5.7560000000000002,"15min":5.7560000000000002},"last":10.23}]},{"osd":5,"last update":"Mon Feb 19 21:40:27 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":0.96899999999999997,"15min":0.749},"min":{"1min":0.33100000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":5.2430000000000003,"5min":7.8209999999999997,"15min":7.8209999999999997},"last":0.27800000000000002},{"interface":"front","average":{"1min":1.8540000000000001,"5min":0.998,"15min":0.65800000000000003},"min":{"1min":0.438,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":10.175000000000001,"5min":10.175000000000001,"15min":10.175000000000001},"last":6.1959999999999997}]},{"osd":6,"last update":"Mon Feb 19 21:40:27 2024","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":0.85799999999999998,"15min":0.63800000000000001},"min":{"1min":0.40500000000000003,"5min":0.317,"15min":0.30299999999999999},"max":{"1min":6.7699999999999996,"5min":6.7699999999999996,"15min":6.7699999999999996},"last":4.0389999999999997},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.006,"15min":0.91900000000000004},"min":{"1min":0.34300000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":5.79,"5min":8.5099999999999998,"15min":8.8030000000000008},"last":3.5950000000000002}]}]},{"osd":6,"up_from":47,"seq":201863463029,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3653776,"kb_used_data":3352456,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":90091376,"statfs":{"total":95995035648,"available":92253569024,"internally_reserved":0,"allocated":3432914944,"data_stored":3432614879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:41:06 2024","interfaces":[{"interface":"back","average":{"1min":1.9950000000000001,"5min":1.9399999999999999,"15min":0.997},"min":{"1min":0.26700000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":7.6059999999999999,"5min":11.391999999999999,"15min":11.391999999999999},"last":0.23400000000000001},{"interface":"front","average":{"1min":2.6949999999999998,"5min":2.177,"15min":1.0700000000000001},"min":{"1min":0.26600000000000001,"5min":0.221,"15min":0.221},"max":{"1min":6.8710000000000004,"5min":13.973000000000001,"15min":13.973000000000001},"last":4.9420000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:41:06 2024","interfaces":[{"interface":"back","average":{"1min":2.0179999999999998,"5min":1.835,"15min":0.97899999999999998},"min":{"1min":0.26000000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":7.6689999999999996,"5min":12.574999999999999,"15min":12.574999999999999},"last":0.26400000000000001},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.6859999999999999,"15min":0.89500000000000002},"min":{"1min":0.28999999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":5.0800000000000001,"5min":11.19,"15min":11.19},"last":2.0950000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:41:06 2024","interfaces":[{"interface":"back","average":{"1min":1.546,"5min":1.6659999999999999,"15min":0.91400000000000003},"min":{"1min":0.29999999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":7.4969999999999999,"5min":8.3849999999999998,"15min":8.3849999999999998},"last":1.0589999999999999},{"interface":"front","average":{"1min":2.5499999999999998,"5min":1.879,"15min":0.97999999999999998},"min":{"1min":0.315,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.6360000000000001,"5min":18.068000000000001,"15min":18.068000000000001},"last":4.9720000000000004}]},{"osd":3,"last update":"Mon Feb 19 21:41:06 2024","interfaces":[{"interface":"back","average":{"1min":2.121,"5min":1.9219999999999999,"15min":1},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":10.630000000000001,"5min":11.15,"15min":11.15},"last":3.3380000000000001},{"interface":"front","average":{"1min":1.139,"5min":1.917,"15min":0.999},"min":{"1min":0.32300000000000001,"5min":0.246,"15min":0.246},"max":{"1min":5.1379999999999999,"5min":19.632999999999999,"15min":19.632999999999999},"last":2.016}]},{"osd":4,"last update":"Mon Feb 19 21:41:06 2024","interfaces":[{"interface":"back","average":{"1min":3.278,"5min":1.3600000000000001,"15min":0.72999999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":9.3759999999999994,"5min":9.3759999999999994,"15min":9.3759999999999994},"last":4.8810000000000002},{"interface":"front","average":{"1min":2.6219999999999999,"5min":1.3169999999999999,"15min":0.72799999999999998},"min":{"1min":0.34499999999999997,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":10.19,"5min":16.594999999999999,"15min":16.594999999999999},"last":1.0940000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:41:06 2024","interfaces":[{"interface":"back","average":{"1min":3.1299999999999999,"5min":1.3220000000000001,"15min":0.73699999999999999},"min":{"1min":0.38100000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.7140000000000004,"5min":6.7140000000000004,"15min":6.7140000000000004},"last":4.9169999999999998},{"interface":"front","average":{"1min":3.2530000000000001,"5min":1.5509999999999999,"15min":0.80600000000000005},"min":{"1min":0.37,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":14.673999999999999,"5min":14.673999999999999,"15min":14.673999999999999},"last":0.56200000000000006}]},{"osd":7,"last update":"Mon Feb 19 21:40:29 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.0429999999999999,"15min":0.67900000000000005},"min":{"1min":0.307,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":4.4950000000000001,"5min":11.069000000000001,"15min":11.069000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":1.244,"5min":1.1140000000000001,"15min":0.745},"min":{"1min":0.443,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":4.516,"5min":11.095000000000001,"15min":11.095000000000001},"last":0.58899999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574991,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3643560,"kb_used_data":3342240,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":90101592,"statfs":{"total":95995035648,"available":92264030208,"internally_reserved":0,"allocated":3422453760,"data_stored":3422130649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:40:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":2.5379999999999998,"15min":1.101},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":2.5379999999999998,"5min":42.776000000000003,"15min":42.776000000000003},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.93500000000000005,"5min":2.4079999999999999,"15min":1.0680000000000001},"min":{"1min":0.187,"5min":0.185,"15min":0.185},"max":{"1min":3.2789999999999999,"5min":44.845999999999997,"15min":44.845999999999997},"last":1.347}]},{"osd":2,"last update":"Mon Feb 19 21:40:25 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":2.2429999999999999,"15min":0.98699999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":3.3860000000000001,"5min":11.826000000000001,"15min":11.826000000000001},"last":0.437},{"interface":"front","average":{"1min":0.76100000000000001,"5min":2.4860000000000002,"15min":1.087},"min":{"1min":0.254,"5min":0.215,"15min":0.215},"max":{"1min":4.1200000000000001,"5min":12.26,"15min":12.26},"last":1.0720000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:40:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":2.645,"15min":1.208},"min":{"1min":0.25900000000000001,"5min":0.254,"15min":0.24399999999999999},"max":{"1min":3.8079999999999998,"5min":41.607999999999997,"15min":41.607999999999997},"last":1.2190000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":2.2160000000000002,"15min":1.0229999999999999},"min":{"1min":0.25,"5min":0.217,"15min":0.217},"max":{"1min":2.593,"5min":42.811999999999998,"15min":42.811999999999998},"last":0.97299999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:40:16 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":1.2649999999999999,"15min":0.82499999999999996},"min":{"1min":0.36099999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":2.6320000000000001,"5min":11.23,"15min":11.23},"last":2.3180000000000001},{"interface":"front","average":{"1min":0.88800000000000001,"5min":1.6060000000000001,"15min":0.94099999999999995},"min":{"1min":0.36699999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":3.2650000000000001,"5min":10.51,"15min":10.51},"last":2.3279999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:40:42 2024","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.6180000000000001,"15min":0.91900000000000004},"min":{"1min":0.33900000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":4.8339999999999996,"5min":10.458,"15min":10.458},"last":2.4950000000000001},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.5840000000000001,"15min":0.92800000000000005},"min":{"1min":0.39500000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":4.6440000000000001,"5min":7.6950000000000003,"15min":7.6950000000000003},"last":4.5309999999999997}]},{"osd":6,"last update":"Mon Feb 19 21:41:13 2024","interfaces":[{"interface":"back","average":{"1min":2.3599999999999999,"5min":1.7130000000000001,"15min":0.97899999999999998},"min":{"1min":0.45000000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":11.638999999999999,"5min":11.638999999999999,"15min":11.638999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":2.1629999999999998,"5min":1.732,"15min":1.0009999999999999},"min":{"1min":0.34599999999999997,"5min":0.316,"15min":0.316},"max":{"1min":8.3409999999999993,"5min":8.3409999999999993,"15min":8.3409999999999993},"last":1.736}]},{"osd":7,"last update":"Mon Feb 19 21:40:30 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.839,"15min":1},"min":{"1min":0.443,"5min":0.376,"15min":0.376},"max":{"1min":1.944,"5min":10.638999999999999,"15min":10.638999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.49,"15min":0.90200000000000002},"min":{"1min":0.41099999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":3.504,"5min":11.276,"15min":11.276},"last":1.429}]}]},{"osd":0,"up_from":8,"seq":34359738517,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3668504,"kb_used_data":3371280,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":90076648,"statfs":{"total":95995035648,"available":92238487552,"internally_reserved":0,"allocated":3452190720,"data_stored":3451883507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:40:57 2024","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.827,"15min":0.83799999999999997},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.17499999999999999},"max":{"1min":16.478000000000002,"5min":16.478000000000002,"15min":16.478000000000002},"last":0.317},{"interface":"front","average":{"1min":1.4019999999999999,"5min":2.3300000000000001,"15min":1.0449999999999999},"min":{"1min":0.24199999999999999,"5min":0.188,"15min":0.188},"max":{"1min":8.0229999999999997,"5min":13.422000000000001,"15min":13.422000000000001},"last":2.4489999999999998}]},{"osd":2,"last update":"Mon Feb 19 21:40:30 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":2.1499999999999999,"15min":0.96999999999999997},"min":{"1min":0.27800000000000002,"5min":0.245,"15min":0.23999999999999999},"max":{"1min":2.9420000000000002,"5min":13.638999999999999,"15min":13.638999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":1.0980000000000001,"5min":2.4910000000000001,"15min":1.0880000000000001},"min":{"1min":0.27900000000000003,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":6.1689999999999996,"5min":12.154999999999999,"15min":12.154999999999999},"last":0.437}]},{"osd":3,"last update":"Mon Feb 19 21:40:42 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":2.77,"15min":1.1910000000000001},"min":{"1min":0.22700000000000001,"5min":0.217,"15min":0.217},"max":{"1min":13.292999999999999,"5min":14.507999999999999,"15min":14.507999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":1.365,"5min":2.8879999999999999,"15min":1.252},"min":{"1min":0.25900000000000001,"5min":0.252,"15min":0.252},"max":{"1min":8.4169999999999998,"5min":18.759,"15min":18.759},"last":0.48099999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:40:20 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":1.5840000000000001,"15min":0.92300000000000004},"min":{"1min":0.34200000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.4140000000000001,"5min":9.8140000000000001,"15min":9.8140000000000001},"last":3.294},{"interface":"front","average":{"1min":0.84899999999999998,"5min":1.4770000000000001,"15min":0.89500000000000002},"min":{"1min":0.33200000000000002,"5min":0.255,"15min":0.255},"max":{"1min":2.2149999999999999,"5min":8.9450000000000003,"15min":8.9450000000000003},"last":3.2799999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:40:42 2024","interfaces":[{"interface":"back","average":{"1min":2.2029999999999998,"5min":2.5,"15min":1.2470000000000001},"min":{"1min":0.41599999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":8.0579999999999998,"5min":42.799999999999997,"15min":42.799999999999997},"last":4.556},{"interface":"front","average":{"1min":1.774,"5min":2.2570000000000001,"15min":1.1679999999999999},"min":{"1min":0.38400000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":13.237,"5min":42.695,"15min":42.695},"last":4.5659999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:41:02 2024","interfaces":[{"interface":"back","average":{"1min":1.7470000000000001,"5min":2.069,"15min":1.117},"min":{"1min":0.36499999999999999,"5min":0.33200000000000002,"15min":0.27900000000000003},"max":{"1min":8.5009999999999994,"5min":42.777000000000001,"15min":42.777000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":2.8359999999999999,"5min":2.2669999999999999,"15min":1.179},"min":{"1min":0.41099999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":7.8739999999999997,"5min":9.7629999999999999,"15min":9.7629999999999999},"last":2.9119999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:40:30 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":1.891,"15min":1.038},"min":{"1min":0.372,"5min":0.31,"15min":0.31},"max":{"1min":3.5099999999999998,"5min":42.758000000000003,"15min":42.758000000000003},"last":2.5059999999999998},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.9770000000000001,"15min":1.091},"min":{"1min":0.40400000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":3.468,"5min":42.718000000000004,"15min":42.718000000000004},"last":2.4849999999999999}]}]},{"osd":2,"up_from":0,"seq":77309411466,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":26,"seq":111669149829,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2715164,"kb_used_data":2401556,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":91029988,"statfs":{"total":95995035648,"available":93214707712,"internally_reserved":0,"allocated":2459193344,"data_stored":2458945115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:40:58 2024","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":2.1970000000000001,"15min":1},"min":{"1min":0.183,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":6.0259999999999998,"5min":17.992000000000001,"15min":17.992000000000001},"last":2.774},{"interface":"front","average":{"1min":1.1970000000000001,"5min":3.234,"15min":1.365},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":4.875,"5min":46.654000000000003,"15min":46.654000000000003},"last":0.42999999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:40:58 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":1.6499999999999999,"15min":0.81599999999999995},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":3.9089999999999998,"5min":9.9700000000000006,"15min":9.9700000000000006},"last":0.30299999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":2.331,"15min":1.0600000000000001},"min":{"1min":0.223,"5min":0.185,"15min":0.185},"max":{"1min":3.3730000000000002,"5min":13.135999999999999,"15min":13.135999999999999},"last":2.8500000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:40:58 2024","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":2.2410000000000001,"15min":1.048},"min":{"1min":0.26200000000000001,"5min":0.224,"15min":0.224},"max":{"1min":6.5259999999999998,"5min":11.175000000000001,"15min":11.175000000000001},"last":6.8879999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":2.9660000000000002,"15min":1.2729999999999999},"min":{"1min":0.26100000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":3.875,"5min":45.831000000000003,"15min":45.831000000000003},"last":0.377}]},{"osd":4,"last update":"Mon Feb 19 21:40:16 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":1.339,"15min":0.82799999999999996},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":2.1509999999999998,"5min":5.8920000000000003,"15min":5.8920000000000003},"last":1.7709999999999999},{"interface":"front","average":{"1min":0.88900000000000001,"5min":1.7629999999999999,"15min":0.97199999999999998},"min":{"1min":0.38200000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":2.7749999999999999,"5min":11.093,"15min":11.093},"last":6.8289999999999997}]},{"osd":5,"last update":"Mon Feb 19 21:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.339,"15min":0.82399999999999995},"min":{"1min":0.32300000000000001,"5min":0.28399999999999997,"15min":0.27100000000000002},"max":{"1min":3.5550000000000002,"5min":5.577,"15min":5.577},"last":2.3610000000000002},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.899,"15min":1.016},"min":{"1min":0.33000000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":3.3940000000000001,"5min":11.128,"15min":11.128},"last":6.8600000000000003}]},{"osd":6,"last update":"Mon Feb 19 21:41:07 2024","interfaces":[{"interface":"back","average":{"1min":1.774,"5min":1.6339999999999999,"15min":0.93999999999999995},"min":{"1min":0.309,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":6.6029999999999998,"5min":17.443999999999999,"15min":17.443999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":1.6419999999999999,"5min":2.0760000000000001,"15min":1.097},"min":{"1min":0.33300000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":6.6580000000000004,"5min":18.219000000000001,"15min":18.219000000000001},"last":6.7800000000000002}]},{"osd":7,"last update":"Mon Feb 19 21:40:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":2.6190000000000002,"15min":1.2430000000000001},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":6.0439999999999996,"5min":45.777999999999999,"15min":45.777999999999999},"last":1.587},{"interface":"front","average":{"1min":0.84299999999999997,"5min":1.4419999999999999,"15min":0.86599999999999999},"min":{"1min":0.377,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":3.4990000000000001,"5min":5.6040000000000001,"15min":5.6040000000000001},"last":2.9849999999999999}]}]},{"osd":4,"up_from":32,"seq":137438953598,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3207364,"kb_used_data":2897852,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":90537788,"statfs":{"total":95995035648,"available":92710694912,"internally_reserved":0,"allocated":2967400448,"data_stored":2967112016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:41:17 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":2.089,"15min":1.044},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":5.7229999999999999,"5min":40.664000000000001,"15min":40.664000000000001},"last":1.095},{"interface":"front","average":{"1min":1.2410000000000001,"5min":2.3479999999999999,"15min":1.159},"min":{"1min":0.26300000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":3.081,"5min":41.046999999999997,"15min":41.046999999999997},"last":1.6759999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:41:17 2024","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.375,"15min":0.82099999999999995},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":6.2469999999999999,"5min":13.254,"15min":13.254},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.272,"5min":1.4590000000000001,"15min":0.86399999999999999},"min":{"1min":0.26900000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":3.177,"5min":15.411,"15min":15.411},"last":1.639}]},{"osd":2,"last update":"Mon Feb 19 21:41:17 2024","interfaces":[{"interface":"back","average":{"1min":1.589,"5min":1.679,"15min":0.93700000000000006},"min":{"1min":0.307,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":6.0629999999999997,"5min":16.788,"15min":16.788},"last":1.712},{"interface":"front","average":{"1min":2.1459999999999999,"5min":2.319,"15min":1.155},"min":{"1min":0.34399999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":10.603999999999999,"5min":20.995999999999999,"15min":20.995999999999999},"last":1.7310000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:41:17 2024","interfaces":[{"interface":"back","average":{"1min":1.825,"5min":1.8759999999999999,"15min":1.008},"min":{"1min":0.34200000000000003,"5min":0.32300000000000001,"15min":0.316},"max":{"1min":10.561999999999999,"5min":15.914999999999999,"15min":15.914999999999999},"last":1.7629999999999999},{"interface":"front","average":{"1min":1.754,"5min":1.704,"15min":0.93600000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":6.2889999999999997,"5min":13.321,"15min":13.321},"last":1.165}]},{"osd":5,"last update":"Mon Feb 19 21:40:53 2024","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.079,"15min":0.63700000000000001},"min":{"1min":0.32100000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":5.7809999999999997,"5min":9.2289999999999992,"15min":9.2289999999999992},"last":1.7769999999999999},{"interface":"front","average":{"1min":1.871,"5min":1.111,"15min":0.65700000000000003},"min":{"1min":0.28100000000000003,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":10.679,"5min":13.226000000000001,"15min":13.226000000000001},"last":5.2789999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:41:17 2024","interfaces":[{"interface":"back","average":{"1min":2.6219999999999999,"5min":1.5640000000000001,"15min":0.82899999999999996},"min":{"1min":0.372,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":10.622999999999999,"5min":13.27,"15min":13.27},"last":5.25},{"interface":"front","average":{"1min":2.2029999999999998,"5min":1.1579999999999999,"15min":0.70699999999999996},"min":{"1min":0.30099999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":7.9939999999999998,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":7.7549999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:40:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":0.86199999999999999,"15min":0.64000000000000001},"min":{"1min":0.42699999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":4.3520000000000003,"5min":4.6749999999999998,"15min":4.6749999999999998},"last":1.75},{"interface":"front","average":{"1min":1.869,"5min":1.2689999999999999,"15min":0.78100000000000003},"min":{"1min":0.371,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":10.707000000000001,"5min":10.707000000000001,"15min":10.707000000000001},"last":5.1429999999999998}]}]},{"osd":5,"up_from":38,"seq":163208757370,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":4619448,"kb_used_data":4318128,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":89125704,"statfs":{"total":95995035648,"available":91264720896,"internally_reserved":0,"allocated":4421763072,"data_stored":4421487189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:40:43 2024","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.8080000000000001,"15min":0.96799999999999997},"min":{"1min":0.28399999999999997,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":4.5279999999999996,"5min":20.550999999999998,"15min":20.550999999999998},"last":10.044},{"interface":"front","average":{"1min":1.252,"5min":1.6950000000000001,"15min":0.93300000000000005},"min":{"1min":0.26600000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":5.9550000000000001,"5min":20.879000000000001,"15min":20.879000000000001},"last":9.9390000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:40:43 2024","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.391,"15min":0.82999999999999996},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":5.9900000000000002,"5min":8.5640000000000001,"15min":8.5640000000000001},"last":10.42},{"interface":"front","average":{"1min":0.76800000000000002,"5min":1.6799999999999999,"15min":0.91200000000000003},"min":{"1min":0.28100000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":3.3980000000000001,"5min":10.316000000000001,"15min":10.316000000000001},"last":10.021000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:40:43 2024","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.9470000000000001,"15min":1.0089999999999999},"min":{"1min":0.38900000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.5780000000000003,"5min":20.186,"15min":20.186},"last":0.35499999999999998},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.9099999999999999,"15min":1.002},"min":{"1min":0.32600000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":6.069,"5min":20.175000000000001,"15min":20.175000000000001},"last":0.29899999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:40:43 2024","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":2.117,"15min":1.083},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":4.5570000000000004,"5min":20.146999999999998,"15min":20.146999999999998},"last":0.38500000000000001},{"interface":"front","average":{"1min":1.524,"5min":2.319,"15min":1.179},"min":{"1min":0.38,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":6.0179999999999998,"5min":20.120000000000001,"15min":20.120000000000001},"last":0.36499999999999999}]},{"osd":4,"last update":"Mon Feb 19 21:40:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.80000000000000004,"15min":0.54100000000000004},"min":{"1min":0.26600000000000001,"5min":0.24299999999999999,"15min":0.23999999999999999},"max":{"1min":4.9969999999999999,"5min":6.4610000000000003,"15min":6.4610000000000003},"last":0.309},{"interface":"front","average":{"1min":1.7490000000000001,"5min":1.0860000000000001,"15min":0.64600000000000002},"min":{"1min":0.38200000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":5.8860000000000001,"5min":6.4740000000000002,"15min":6.4740000000000002},"last":0.28799999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:41:11 2024","interfaces":[{"interface":"back","average":{"1min":2.8239999999999998,"5min":1.2869999999999999,"15min":0.73299999999999998},"min":{"1min":0.27000000000000002,"5min":0.221,"15min":0.221},"max":{"1min":7.7329999999999997,"5min":8.4629999999999992,"15min":8.4629999999999992},"last":0.32600000000000001},{"interface":"front","average":{"1min":2.556,"5min":1.5429999999999999,"15min":0.82699999999999996},"min":{"1min":0.34899999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":10.127000000000001,"5min":13.362,"15min":13.362},"last":0.379}]},{"osd":7,"last update":"Mon Feb 19 21:40:38 2024","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.2390000000000001,"15min":0.78500000000000003},"min":{"1min":0.35799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":8.9860000000000007,"5min":8.9860000000000007,"15min":8.9860000000000007},"last":0.33800000000000002},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":0.72799999999999998},"min":{"1min":0.35799999999999998,"5min":0.312,"15min":0.29099999999999998},"max":{"1min":4.5919999999999996,"5min":17.759,"15min":17.759},"last":0.34599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3461873664,"data_stored":3461873664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3446145024,"data_stored":3446145024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2462449664,"data_stored":2462449664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2967863296,"data_stored":2967863296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4428333056,"data_stored":4428333056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3443916800,"data_stored":3443916800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3461480448,"data_stored":3461480448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:41:23.301 INFO:tasks.thrashosds.thrasher:Setting 4.1 to [4, 2, 6] 2024-02-19T21:41:23.302 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.1', '4', '2', '6'] 2024-02-19T21:41:23.302 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pg-upmap 4.1 4 2 6 2024-02-19T21:41:23.377 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:41:23.439 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:23.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:22.191846+0000 osd.1 (osd.1) 149 : cluster [DBG] 4.2 scrub starts 2024-02-19T21:41:23.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:22.195156+0000 osd.1 (osd.1) 150 : cluster [DBG] 4.2 scrub ok 2024-02-19T21:41:23.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:22.611021+0000 osd.0 (osd.0) 161 : cluster [DBG] 3.1 scrub starts 2024-02-19T21:41:23.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:22.644399+0000 osd.0 (osd.0) 162 : cluster [DBG] 3.1 scrub ok 2024-02-19T21:41:23.971 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 87 16 124623 124607 89.4948 64.4375 0.0100392 0.0111697 2024-02-19T21:41:24.039 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:22.191846+0000 osd.1 (osd.1) 149 : cluster [DBG] 4.2 scrub starts 2024-02-19T21:41:24.039 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:22.195156+0000 osd.1 (osd.1) 150 : cluster [DBG] 4.2 scrub ok 2024-02-19T21:41:24.039 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:22.611021+0000 osd.0 (osd.0) 161 : cluster [DBG] 3.1 scrub starts 2024-02-19T21:41:24.039 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:22.644399+0000 osd.0 (osd.0) 162 : cluster [DBG] 3.1 scrub ok 2024-02-19T21:41:24.040 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:22.191846+0000 osd.1 (osd.1) 149 : cluster [DBG] 4.2 scrub starts 2024-02-19T21:41:24.040 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:22.195156+0000 osd.1 (osd.1) 150 : cluster [DBG] 4.2 scrub ok 2024-02-19T21:41:24.040 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:22.611021+0000 osd.0 (osd.0) 161 : cluster [DBG] 3.1 scrub starts 2024-02-19T21:41:24.040 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:22.644399+0000 osd.0 (osd.0) 162 : cluster [DBG] 3.1 scrub ok 2024-02-19T21:41:24.476 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:41:24.719 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:41:24.723 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:24.724 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:41:24.825 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:41:24.885 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:24.971 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 88 16 125708 125692 89.2484 67.8125 0.014596 0.0112006 2024-02-19T21:41:24.976 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:41:24.982 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:24.983 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:41:24.989 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:22.981767+0000 mgr.y (mgr.14514) 341 : cluster [DBG] pgmap v374: 148 pgs: 148 active+clean; 7.3 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 1023 B/s rd, 68 MiB/s wr, 1.08k op/s 2024-02-19T21:41:24.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:23.671604+0000 osd.5 (osd.5) 161 : cluster [DBG] 5.7 scrub starts 2024-02-19T21:41:24.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:23.683330+0000 osd.5 (osd.5) 162 : cluster [DBG] 5.7 scrub ok 2024-02-19T21:41:24.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:23.876050+0000 osd.4 (osd.4) 123 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:41:24.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:23.880493+0000 osd.4 (osd.4) 124 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:41:25.082 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:22.981767+0000 mgr.y (mgr.14514) 341 : cluster [DBG] pgmap v374: 148 pgs: 148 active+clean; 7.3 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 1023 B/s rd, 68 MiB/s wr, 1.08k op/s 2024-02-19T21:41:25.082 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:23.671604+0000 osd.5 (osd.5) 161 : cluster [DBG] 5.7 scrub starts 2024-02-19T21:41:25.082 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:23.683330+0000 osd.5 (osd.5) 162 : cluster [DBG] 5.7 scrub ok 2024-02-19T21:41:25.082 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:23.876050+0000 osd.4 (osd.4) 123 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:41:25.082 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:23.880493+0000 osd.4 (osd.4) 124 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:41:25.083 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:22.981767+0000 mgr.y (mgr.14514) 341 : cluster [DBG] pgmap v374: 148 pgs: 148 active+clean; 7.3 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 1023 B/s rd, 68 MiB/s wr, 1.08k op/s 2024-02-19T21:41:25.083 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:23.671604+0000 osd.5 (osd.5) 161 : cluster [DBG] 5.7 scrub starts 2024-02-19T21:41:25.083 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:23.683330+0000 osd.5 (osd.5) 162 : cluster [DBG] 5.7 scrub ok 2024-02-19T21:41:25.083 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:23.876050+0000 osd.4 (osd.4) 123 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:41:25.083 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:23.880493+0000 osd.4 (osd.4) 124 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:41:25.084 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:41:25.116 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:25.375 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:41:25.375 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:41:25.806 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:41:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:41:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:41:25.902 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:41:25.902 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:41:25.902 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:41:25.902 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:41:25.902 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:41:25.902 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:41:25.902 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:41:25.903 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:41:25.903 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:41:25.903 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:41:25.903 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:41:25.903 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:41:25.903 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:41:25.903 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:41:25.903 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:41:25.903 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:41:25.971 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 89 16 126735 126719 88.9668 64.1875 0.014791 0.0112362 2024-02-19T21:41:26.050 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:24.904286+0000 osd.4 (osd.4) 125 : cluster [DBG] 2.f scrub starts 2024-02-19T21:41:26.050 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:24.913921+0000 osd.4 (osd.4) 126 : cluster [DBG] 2.f scrub ok 2024-02-19T21:41:26.050 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:24.982531+0000 mgr.y (mgr.14514) 342 : cluster [DBG] pgmap v375: 148 pgs: 148 active+clean; 7.6 GiB data, 25 GiB used, 601 GiB / 626 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-19T21:41:26.050 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:25.382276+0000 mon.c (mon.2) 45 : audit [DBG] from='client.? 172.21.15.80:0/385427961' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:41:26.051 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:24.904286+0000 osd.4 (osd.4) 125 : cluster [DBG] 2.f scrub starts 2024-02-19T21:41:26.051 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:24.913921+0000 osd.4 (osd.4) 126 : cluster [DBG] 2.f scrub ok 2024-02-19T21:41:26.051 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:24.982531+0000 mgr.y (mgr.14514) 342 : cluster [DBG] pgmap v375: 148 pgs: 148 active+clean; 7.6 GiB data, 25 GiB used, 601 GiB / 626 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-19T21:41:26.051 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:25.382276+0000 mon.c (mon.2) 45 : audit [DBG] from='client.? 172.21.15.80:0/385427961' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:41:26.258 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:24.904286+0000 osd.4 (osd.4) 125 : cluster [DBG] 2.f scrub starts 2024-02-19T21:41:26.259 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:24.913921+0000 osd.4 (osd.4) 126 : cluster [DBG] 2.f scrub ok 2024-02-19T21:41:26.259 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:24.982531+0000 mgr.y (mgr.14514) 342 : cluster [DBG] pgmap v375: 148 pgs: 148 active+clean; 7.6 GiB data, 25 GiB used, 601 GiB / 626 GiB avail; 1023 B/s rd, 67 MiB/s wr, 1.07k op/s 2024-02-19T21:41:26.259 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:25.382276+0000 mon.c (mon.2) 45 : audit [DBG] from='client.? 172.21.15.80:0/385427961' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:41:26.288 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.6 dump_historic_ops 2024-02-19T21:41:26.448 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-19T21:41:26.690 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:41:26.694 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:26.695 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:41:26.796 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:41:26.815 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:41:26.845 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:26.971 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Total time run: 90.0047 2024-02-19T21:41:26.972 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Total writes made: 127715 2024-02-19T21:41:26.972 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Write size: 65536 2024-02-19T21:41:26.972 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Object size: 65536 2024-02-19T21:41:26.972 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Bandwidth (MB/sec): 88.6863 2024-02-19T21:41:26.972 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Stddev Bandwidth: 35.9711 2024-02-19T21:41:26.972 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Max bandwidth (MB/sec): 227.5 2024-02-19T21:41:26.972 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Min bandwidth (MB/sec): 61.0625 2024-02-19T21:41:26.972 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Average IOPS: 1418 2024-02-19T21:41:26.972 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Stddev IOPS: 575.538 2024-02-19T21:41:26.972 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Max IOPS: 3640 2024-02-19T21:41:26.973 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Min IOPS: 977 2024-02-19T21:41:26.973 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Average Latency(s): 0.0112723 2024-02-19T21:41:26.973 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Stddev Latency(s): 0.00649956 2024-02-19T21:41:26.973 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Max latency(s): 0.109215 2024-02-19T21:41:26.973 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Min latency(s): 0.00129851 2024-02-19T21:41:26.975 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Cleaning up (deleting benchmark objects) 2024-02-19T21:41:27.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:25.890827+0000 osd.4 (osd.4) 127 : cluster [DBG] 8.2 scrub starts 2024-02-19T21:41:27.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:25.890827+0000 osd.4 (osd.4) 127 : cluster [DBG] 8.2 scrub starts 2024-02-19T21:41:27.205 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:41:27.212 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:27.213 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:41:27.314 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:41:27.375 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:25.890827+0000 osd.4 (osd.4) 127 : cluster [DBG] 8.2 scrub starts 2024-02-19T21:41:27.382 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:27.445 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:41:27.451 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:27.451 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:41:27.552 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:41:27.598 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:27.788 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:41:27.794 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:27.795 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:41:27.830 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:41:27.895 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:41:27.940 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:28.018 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:41:28.023 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:28.023 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:41:28.124 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:41:28.162 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:28.191 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:41:28.194 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:28.194 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:41:28.295 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:41:28.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:26.982947+0000 mgr.y (mgr.14514) 343 : cluster [DBG] pgmap v376: 148 pgs: 148 active+clean; 7.7 GiB data, 25 GiB used, 601 GiB / 626 GiB avail; 1023 B/s rd, 66 MiB/s wr, 1.05k op/s 2024-02-19T21:41:28.330 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:26.982947+0000 mgr.y (mgr.14514) 343 : cluster [DBG] pgmap v376: 148 pgs: 148 active+clean; 7.7 GiB data, 25 GiB used, 601 GiB / 626 GiB avail; 1023 B/s rd, 66 MiB/s wr, 1.05k op/s 2024-02-19T21:41:28.331 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:26.982947+0000 mgr.y (mgr.14514) 343 : cluster [DBG] pgmap v376: 148 pgs: 148 active+clean; 7.7 GiB data, 25 GiB used, 601 GiB / 626 GiB avail; 1023 B/s rd, 66 MiB/s wr, 1.05k op/s 2024-02-19T21:41:28.332 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:28.501 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:41:28.504 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:28.505 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:41:28.605 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:41:28.673 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:28.744 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:41:28.751 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:28.752 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:41:28.852 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:41:28.894 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:28.924 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:41:28.933 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:28.934 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:41:29.034 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:41:29.095 INFO:teuthology.orchestra.run.smithi080.stderr:set 4.1 pg_upmap mapping to [4,2,6] 2024-02-19T21:41:29.115 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:29.165 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:41:29.165 INFO:teuthology.orchestra.run.smithi157.stdout: "size": 20, 2024-02-19T21:41:29.165 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 600, 2024-02-19T21:41:29.165 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [ 2024-02-19T21:41:29.165 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.165 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:146646 7.c 7:3b25307f:::benchmark_data_smithi080_79222_object31912:head [delete] snapc 0=[] ondisk+write+known_if_redirected e133)", 2024-02-19T21:41:29.166 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:37:33.596284+0000", 2024-02-19T21:41:29.166 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 235.56453864100001, 2024-02-19T21:41:29.166 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.084397300999999994, 2024-02-19T21:41:29.166 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:29.166 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:29.166 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:29.166 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:41:29.166 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:41:29.166 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 146646 2024-02-19T21:41:29.166 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.166 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:29.166 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.166 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:29.166 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596284+0000", 2024-02-19T21:41:29.167 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:29.167 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.167 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.167 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:29.167 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596284+0000", 2024-02-19T21:41:29.167 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:41:29.167 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.167 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.167 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:29.167 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596283+0000", 2024-02-19T21:41:29.167 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.2260000000000001e-06 2024-02-19T21:41:29.167 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.167 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.167 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:29.167 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596287+0000", 2024-02-19T21:41:29.168 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.1700000000000002e-06 2024-02-19T21:41:29.168 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.168 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.168 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:29.168 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596293+0000", 2024-02-19T21:41:29.168 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.7910000000000002e-06 2024-02-19T21:41:29.168 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.168 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.168 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:29.168 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596297+0000", 2024-02-19T21:41:29.168 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.9220000000000005e-05 2024-02-19T21:41:29.168 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.168 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.168 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.169 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596366+0000", 2024-02-19T21:41:29.169 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000104897 2024-02-19T21:41:29.169 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.169 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.169 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:29.169 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596471+0000", 2024-02-19T21:41:29.169 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000122182 2024-02-19T21:41:29.169 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.169 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.169 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:41:29.169 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596593+0000", 2024-02-19T21:41:29.169 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.002585324 2024-02-19T21:41:29.169 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.169 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.170 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:29.170 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599178+0000", 2024-02-19T21:41:29.170 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0085386769999999997 2024-02-19T21:41:29.170 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.170 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.170 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.170 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.607717+0000", 2024-02-19T21:41:29.170 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.072893174000000005 2024-02-19T21:41:29.170 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.170 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.170 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.170 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.680610+0000", 2024-02-19T21:41:29.170 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.6788000000000001e-05 2024-02-19T21:41:29.170 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.170 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.171 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:29.171 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.680647+0000", 2024-02-19T21:41:29.171 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.4368e-05 2024-02-19T21:41:29.171 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.171 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.171 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:29.171 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.680681+0000", 2024-02-19T21:41:29.171 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.084397300999999994 2024-02-19T21:41:29.171 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.171 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:29.171 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.171 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.171 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.171 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:146652 7.c 7:3c2dcaab:::benchmark_data_smithi080_79222_object31918:head [delete] snapc 0=[] ondisk+write+known_if_redirected e133)", 2024-02-19T21:41:29.171 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:37:33.599542+0000", 2024-02-19T21:41:29.172 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 235.561280485, 2024-02-19T21:41:29.172 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.081263583, 2024-02-19T21:41:29.172 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:29.172 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:29.172 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:29.172 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:41:29.172 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:41:29.172 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 146652 2024-02-19T21:41:29.172 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.172 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:29.172 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.172 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:29.172 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599542+0000", 2024-02-19T21:41:29.172 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:29.173 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.173 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.173 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:29.173 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599542+0000", 2024-02-19T21:41:29.173 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:41:29.173 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.173 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.173 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:29.173 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599541+0000", 2024-02-19T21:41:29.173 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.0570000000000004e-06 2024-02-19T21:41:29.173 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.173 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.173 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:29.173 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599548+0000", 2024-02-19T21:41:29.174 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1291000000000001e-05 2024-02-19T21:41:29.174 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.174 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.174 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:29.174 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599559+0000", 2024-02-19T21:41:29.174 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.7070000000000003e-06 2024-02-19T21:41:29.174 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.174 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.174 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:29.174 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599566+0000", 2024-02-19T21:41:29.174 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.6984999999999998e-05 2024-02-19T21:41:29.174 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.174 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.174 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.174 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599613+0000", 2024-02-19T21:41:29.175 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.5153000000000004e-05 2024-02-19T21:41:29.175 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.175 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.175 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:29.175 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599688+0000", 2024-02-19T21:41:29.175 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.4678000000000006e-05 2024-02-19T21:41:29.175 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.175 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.175 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:41:29.175 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599763+0000", 2024-02-19T21:41:29.175 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0026663949999999998 2024-02-19T21:41:29.175 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.175 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.175 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:29.176 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.602429+0000", 2024-02-19T21:41:29.176 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0078935600000000009 2024-02-19T21:41:29.176 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.176 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.176 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.176 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.610323+0000", 2024-02-19T21:41:29.176 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.070400874000000002 2024-02-19T21:41:29.176 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.176 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.176 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.176 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.680724+0000", 2024-02-19T21:41:29.176 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.1516000000000001e-05 2024-02-19T21:41:29.176 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.177 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.177 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:29.177 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.680755+0000", 2024-02-19T21:41:29.177 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0662999999999999e-05 2024-02-19T21:41:29.177 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.177 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.177 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:29.177 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.680806+0000", 2024-02-19T21:41:29.177 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.081263583 2024-02-19T21:41:29.177 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.177 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:29.177 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.177 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.177 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.177 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199203 7.7 7:e4e0691c:::benchmark_data_smithi080_79222_object84469:head [delete] snapc 0=[] ondisk+write+known_if_redirected e143)", 2024-02-19T21:41:29.178 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:30.214329+0000", 2024-02-19T21:41:29.178 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 178.9464935, 2024-02-19T21:41:29.178 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1537202830000002, 2024-02-19T21:41:29.178 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:29.178 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "reached pg", 2024-02-19T21:41:29.178 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:29.178 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:41:29.178 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:41:29.178 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199203 2024-02-19T21:41:29.178 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.178 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:29.178 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.178 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:29.178 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.214329+0000", 2024-02-19T21:41:29.179 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:29.179 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.179 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.179 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:29.179 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.214329+0000", 2024-02-19T21:41:29.179 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:41:29.179 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.179 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.179 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:29.179 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.214329+0000", 2024-02-19T21:41:29.179 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.6859999999999999e-06 2024-02-19T21:41:29.179 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.179 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.179 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:29.180 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.214332+0000", 2024-02-19T21:41:29.180 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.5900000000000002e-06 2024-02-19T21:41:29.180 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.180 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.180 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:29.180 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.214340+0000", 2024-02-19T21:41:29.180 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.4649999999999996e-06 2024-02-19T21:41:29.180 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.180 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.180 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:29.180 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.214344+0000", 2024-02-19T21:41:29.180 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0033895370000000002 2024-02-19T21:41:29.180 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.181 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.181 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.181 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.217734+0000", 2024-02-19T21:41:29.181 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.0727000000000002e-05 2024-02-19T21:41:29.181 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.181 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.181 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:29.181 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.217805+0000", 2024-02-19T21:41:29.181 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.0567000000000002e-05 2024-02-19T21:41:29.181 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.181 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.181 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,3", 2024-02-19T21:41:29.181 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.217895+0000", 2024-02-19T21:41:29.181 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0021666659999999998 2024-02-19T21:41:29.181 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.181 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.182 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:29.182 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220062+0000", 2024-02-19T21:41:29.182 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.022580901 2024-02-19T21:41:29.182 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.182 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.182 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.182 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.242643+0000", 2024-02-19T21:41:29.182 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.5939999999999999e-06 2024-02-19T21:41:29.182 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.182 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.182 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:41:29.182 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.242649+0000", 2024-02-19T21:41:29.182 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99385833999999995 2024-02-19T21:41:29.182 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.182 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.183 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.183 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236508+0000", 2024-02-19T21:41:29.183 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0581000000000001e-05 2024-02-19T21:41:29.183 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.183 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.183 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:41:29.183 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236518+0000", 2024-02-19T21:41:29.183 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.131440564 2024-02-19T21:41:29.183 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.183 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.183 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.183 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.367959+0000", 2024-02-19T21:41:29.183 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.0580000000000004e-05 2024-02-19T21:41:29.183 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.183 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.183 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:29.184 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368049+0000", 2024-02-19T21:41:29.184 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1537202830000002 2024-02-19T21:41:29.184 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.184 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:29.184 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.184 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.184 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.184 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199209 7.c 7:366958b9:::benchmark_data_smithi080_79222_object84475:head [delete] snapc 0=[] ondisk+write+known_if_redirected e143)", 2024-02-19T21:41:29.184 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:30.220544+0000", 2024-02-19T21:41:29.184 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 178.94027862600001, 2024-02-19T21:41:29.184 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.2867079380000002, 2024-02-19T21:41:29.184 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:29.184 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "reached pg", 2024-02-19T21:41:29.185 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:29.185 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:41:29.185 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:41:29.185 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199209 2024-02-19T21:41:29.185 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.185 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:29.185 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.185 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:29.185 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220544+0000", 2024-02-19T21:41:29.185 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:29.185 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.185 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.185 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:29.185 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220544+0000", 2024-02-19T21:41:29.186 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:41:29.186 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.186 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.186 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:29.186 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220543+0000", 2024-02-19T21:41:29.186 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0220000000000004e-06 2024-02-19T21:41:29.186 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.186 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.186 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:29.186 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220548+0000", 2024-02-19T21:41:29.186 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.6799999999999999e-06 2024-02-19T21:41:29.186 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.186 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.186 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:29.186 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220557+0000", 2024-02-19T21:41:29.187 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.8100000000000003e-06 2024-02-19T21:41:29.187 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.187 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.187 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:29.187 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220562+0000", 2024-02-19T21:41:29.187 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.5091e-05 2024-02-19T21:41:29.187 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.187 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.187 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.187 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220597+0000", 2024-02-19T21:41:29.187 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000105196 2024-02-19T21:41:29.187 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.187 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.187 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:29.187 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220703+0000", 2024-02-19T21:41:29.188 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000146749 2024-02-19T21:41:29.188 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.188 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.188 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:41:29.188 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220849+0000", 2024-02-19T21:41:29.188 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0024284160000000001 2024-02-19T21:41:29.188 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.188 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.188 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:29.188 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.223278+0000", 2024-02-19T21:41:29.188 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0010794349999999999 2024-02-19T21:41:29.188 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.188 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.189 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.189 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.224357+0000", 2024-02-19T21:41:29.189 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.015938191000000001 2024-02-19T21:41:29.189 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.189 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.189 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.189 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.240295+0000", 2024-02-19T21:41:29.189 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1103e-05 2024-02-19T21:41:29.189 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.189 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.189 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:41:29.189 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.240307+0000", 2024-02-19T21:41:29.189 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99564034099999998 2024-02-19T21:41:29.189 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.190 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.190 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.190 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.235947+0000", 2024-02-19T21:41:29.190 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.6800000000000004e-06 2024-02-19T21:41:29.190 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.190 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.190 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:41:29.190 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.235954+0000", 2024-02-19T21:41:29.190 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.271212308 2024-02-19T21:41:29.190 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.190 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.190 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.190 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.507166+0000", 2024-02-19T21:41:29.190 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.6069999999999994e-05 2024-02-19T21:41:29.191 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.191 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.191 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:29.191 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.507252+0000", 2024-02-19T21:41:29.191 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.2867079380000002 2024-02-19T21:41:29.191 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.191 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:29.191 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.191 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.191 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.191 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199212 7.7 7:e70492a0:::benchmark_data_smithi080_79222_object84478:head [delete] snapc 0=[] ondisk+write+known_if_redirected e143)", 2024-02-19T21:41:29.191 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:30.220597+0000", 2024-02-19T21:41:29.191 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 178.94022599499999, 2024-02-19T21:41:29.192 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.147553088, 2024-02-19T21:41:29.192 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:29.192 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "reached pg", 2024-02-19T21:41:29.192 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:29.192 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:41:29.192 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:41:29.192 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199212 2024-02-19T21:41:29.192 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.192 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:29.192 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.192 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:29.192 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220597+0000", 2024-02-19T21:41:29.192 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:29.192 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.193 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.193 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:29.193 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220597+0000", 2024-02-19T21:41:29.193 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:41:29.193 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.193 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.193 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:29.193 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220596+0000", 2024-02-19T21:41:29.193 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.281e-06 2024-02-19T21:41:29.193 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.193 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.193 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:29.193 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220599+0000", 2024-02-19T21:41:29.193 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.7270000000000001e-06 2024-02-19T21:41:29.194 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.194 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.194 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:29.194 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220606+0000", 2024-02-19T21:41:29.194 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.25e-06 2024-02-19T21:41:29.194 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.194 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.194 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:29.194 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220610+0000", 2024-02-19T21:41:29.194 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.8482000000000002e-05 2024-02-19T21:41:29.194 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.194 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.194 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.195 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220649+0000", 2024-02-19T21:41:29.195 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000108872 2024-02-19T21:41:29.195 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.195 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.195 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:29.195 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220758+0000", 2024-02-19T21:41:29.195 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00012441199999999999 2024-02-19T21:41:29.195 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.195 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.195 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,3", 2024-02-19T21:41:29.195 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220882+0000", 2024-02-19T21:41:29.195 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0028021500000000002 2024-02-19T21:41:29.195 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.196 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.196 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:29.196 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.223684+0000", 2024-02-19T21:41:29.196 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.019001483 2024-02-19T21:41:29.196 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.196 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.196 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.196 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.242686+0000", 2024-02-19T21:41:29.196 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.8170000000000004e-06 2024-02-19T21:41:29.196 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.196 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.196 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:41:29.196 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.242692+0000", 2024-02-19T21:41:29.196 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99385727800000001 2024-02-19T21:41:29.196 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.197 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.197 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.197 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236549+0000", 2024-02-19T21:41:29.197 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.7810000000000005e-06 2024-02-19T21:41:29.197 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.197 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.197 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:41:29.197 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236557+0000", 2024-02-19T21:41:29.197 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.131526008 2024-02-19T21:41:29.197 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.197 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.197 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.197 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368083+0000", 2024-02-19T21:41:29.198 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.7107999999999995e-05 2024-02-19T21:41:29.198 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.198 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.198 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:29.198 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368150+0000", 2024-02-19T21:41:29.198 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.147553088 2024-02-19T21:41:29.198 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.198 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:29.198 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.198 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.198 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.198 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199217 7.c 7:3d739445:::benchmark_data_smithi080_79222_object84483:head [delete] snapc 0=[] ondisk+write+known_if_redirected e143)", 2024-02-19T21:41:29.198 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:30.232520+0000", 2024-02-19T21:41:29.198 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 178.92830290500001, 2024-02-19T21:41:29.198 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.2748104329999999, 2024-02-19T21:41:29.199 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:29.199 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "reached pg", 2024-02-19T21:41:29.199 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:29.199 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:41:29.199 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:41:29.199 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199217 2024-02-19T21:41:29.199 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.199 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:29.199 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.199 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:29.199 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232520+0000", 2024-02-19T21:41:29.199 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:29.199 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.199 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.199 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:29.200 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232520+0000", 2024-02-19T21:41:29.200 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:41:29.200 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.200 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.200 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:29.200 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232518+0000", 2024-02-19T21:41:29.200 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.7600000000000002e-06 2024-02-19T21:41:29.200 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.200 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.200 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:29.200 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232526+0000", 2024-02-19T21:41:29.200 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.293e-05 2024-02-19T21:41:29.200 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.200 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.201 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:29.201 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232539+0000", 2024-02-19T21:41:29.201 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.289e-06 2024-02-19T21:41:29.201 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.201 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.201 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:29.201 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232546+0000", 2024-02-19T21:41:29.201 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014075900000000001 2024-02-19T21:41:29.201 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.201 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.201 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.201 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232687+0000", 2024-02-19T21:41:29.201 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000115995 2024-02-19T21:41:29.201 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.201 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.202 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:29.202 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232803+0000", 2024-02-19T21:41:29.202 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000129078 2024-02-19T21:41:29.202 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.202 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.202 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:41:29.202 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232932+0000", 2024-02-19T21:41:29.202 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0074053649999999997 2024-02-19T21:41:29.202 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.202 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.202 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.202 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.240337+0000", 2024-02-19T21:41:29.202 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.1230000000000002e-06 2024-02-19T21:41:29.202 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.202 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.203 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:41:29.203 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.240344+0000", 2024-02-19T21:41:29.203 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99568742200000004 2024-02-19T21:41:29.203 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.203 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.203 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.203 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236032+0000", 2024-02-19T21:41:29.203 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.6689999999999995e-06 2024-02-19T21:41:29.203 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.203 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.203 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:41:29.203 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236040+0000", 2024-02-19T21:41:29.203 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2712470330000001 2024-02-19T21:41:29.203 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.203 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.204 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.204 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.507287+0000", 2024-02-19T21:41:29.204 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.2701999999999999e-05 2024-02-19T21:41:29.204 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.204 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.204 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:29.204 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.507330+0000", 2024-02-19T21:41:29.204 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.2748104329999999 2024-02-19T21:41:29.204 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.204 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:29.204 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.204 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.204 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.204 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199218 7.7 7:e01213fa:::benchmark_data_smithi080_79222_object84484:head [delete] snapc 0=[] ondisk+write+known_if_redirected e143)", 2024-02-19T21:41:29.205 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:30.232563+0000", 2024-02-19T21:41:29.205 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 178.92825957700001, 2024-02-19T21:41:29.205 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1356496300000001, 2024-02-19T21:41:29.205 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:29.205 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "reached pg", 2024-02-19T21:41:29.205 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:29.205 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:41:29.205 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:41:29.205 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199218 2024-02-19T21:41:29.205 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.205 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:29.205 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.205 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:29.205 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232563+0000", 2024-02-19T21:41:29.206 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:29.206 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.206 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.206 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:29.206 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232563+0000", 2024-02-19T21:41:29.206 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:41:29.206 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.206 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.206 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:29.206 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232562+0000", 2024-02-19T21:41:29.206 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0990000000000001e-06 2024-02-19T21:41:29.206 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.206 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.206 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:29.206 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232566+0000", 2024-02-19T21:41:29.207 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.9300000000000003e-06 2024-02-19T21:41:29.207 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.207 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.207 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:29.207 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232574+0000", 2024-02-19T21:41:29.207 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.853e-06 2024-02-19T21:41:29.207 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.207 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.207 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:29.207 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232579+0000", 2024-02-19T21:41:29.207 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.7021999999999999e-05 2024-02-19T21:41:29.207 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.207 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.207 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.208 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232616+0000", 2024-02-19T21:41:29.208 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00010412300000000001 2024-02-19T21:41:29.208 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.208 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.208 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:29.208 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232720+0000", 2024-02-19T21:41:29.208 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000134203 2024-02-19T21:41:29.208 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.208 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.208 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,3", 2024-02-19T21:41:29.208 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232855+0000", 2024-02-19T21:41:29.208 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0098704629999999995 2024-02-19T21:41:29.208 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.208 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.208 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.209 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.242725+0000", 2024-02-19T21:41:29.209 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0609999999999997e-06 2024-02-19T21:41:29.209 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.209 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.209 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:41:29.209 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.242729+0000", 2024-02-19T21:41:29.209 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99385746399999997 2024-02-19T21:41:29.209 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.209 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.209 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.209 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236587+0000", 2024-02-19T21:41:29.209 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.4880000000000007e-06 2024-02-19T21:41:29.209 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.209 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.210 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:41:29.210 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236595+0000", 2024-02-19T21:41:29.210 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.131577593 2024-02-19T21:41:29.210 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.210 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.210 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.210 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368173+0000", 2024-02-19T21:41:29.210 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0005000000000001e-05 2024-02-19T21:41:29.210 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.210 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.210 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:29.210 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368213+0000", 2024-02-19T21:41:29.210 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1356496300000001 2024-02-19T21:41:29.210 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.210 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:29.211 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.211 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.211 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.211 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199222 7.1 7:84081eb6:::benchmark_data_smithi080_79222_object84488:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-02-19T21:41:29.211 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:30.243372+0000", 2024-02-19T21:41:29.211 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 178.91745048799999, 2024-02-19T21:41:29.211 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1006799549999999, 2024-02-19T21:41:29.211 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:29.211 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:29.211 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:29.211 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:41:29.211 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:41:29.211 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199222 2024-02-19T21:41:29.211 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.211 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:29.211 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.212 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:29.212 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.243372+0000", 2024-02-19T21:41:29.212 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:29.212 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.212 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.212 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:29.212 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.243372+0000", 2024-02-19T21:41:29.212 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:41:29.212 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.212 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.212 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:29.212 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.243371+0000", 2024-02-19T21:41:29.212 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.6840000000000001e-06 2024-02-19T21:41:29.212 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.213 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.213 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:29.213 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.243376+0000", 2024-02-19T21:41:29.213 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.9800000000000004e-06 2024-02-19T21:41:29.213 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.213 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.213 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:29.213 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.243385+0000", 2024-02-19T21:41:29.213 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.7089999999999999e-06 2024-02-19T21:41:29.213 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.213 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.213 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:29.213 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.243391+0000", 2024-02-19T21:41:29.213 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.8915999999999998e-05 2024-02-19T21:41:29.213 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.214 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.214 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.214 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.243430+0000", 2024-02-19T21:41:29.214 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.127e-06 2024-02-19T21:41:29.214 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.214 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.214 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:41:29.214 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.243436+0000", 2024-02-19T21:41:29.214 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99180459600000004 2024-02-19T21:41:29.214 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.214 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.214 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.214 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.235241+0000", 2024-02-19T21:41:29.214 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.8508e-05 2024-02-19T21:41:29.215 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.215 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.215 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:41:29.215 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.235259+0000", 2024-02-19T21:41:29.215 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.102905794 2024-02-19T21:41:29.215 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.215 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.215 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.215 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.338165+0000", 2024-02-19T21:41:29.215 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0011582179999999999 2024-02-19T21:41:29.215 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.215 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.215 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:29.215 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.339323+0000", 2024-02-19T21:41:29.215 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.4108000000000001e-05 2024-02-19T21:41:29.216 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.216 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.216 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,3,4", 2024-02-19T21:41:29.216 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.339417+0000", 2024-02-19T21:41:29.216 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0041340709999999996 2024-02-19T21:41:29.216 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.216 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.216 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:29.216 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.343551+0000", 2024-02-19T21:41:29.216 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000292906 2024-02-19T21:41:29.216 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.216 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.216 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.216 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.343844+0000", 2024-02-19T21:41:29.217 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.7210999999999999e-05 2024-02-19T21:41:29.217 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.217 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.217 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.217 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.343892+0000", 2024-02-19T21:41:29.217 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.8293000000000001e-05 2024-02-19T21:41:29.217 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.217 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.217 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.217 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.343930+0000", 2024-02-19T21:41:29.217 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.5883000000000002e-05 2024-02-19T21:41:29.217 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.217 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.217 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:29.217 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.343966+0000", 2024-02-19T21:41:29.218 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.6308000000000001e-05 2024-02-19T21:41:29.218 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.218 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.218 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:29.218 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.344052+0000", 2024-02-19T21:41:29.218 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1006799549999999 2024-02-19T21:41:29.218 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.218 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:29.218 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.218 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.218 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.218 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199223 7.1 7:8394c6aa:::benchmark_data_smithi080_79222_object84489:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-02-19T21:41:29.218 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:30.251632+0000", 2024-02-19T21:41:29.218 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 178.909190572, 2024-02-19T21:41:29.219 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.0927566039999999, 2024-02-19T21:41:29.219 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:29.219 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:29.219 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:29.219 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:41:29.219 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:41:29.219 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199223 2024-02-19T21:41:29.219 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.219 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:29.219 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.219 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:29.219 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.251632+0000", 2024-02-19T21:41:29.219 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:29.220 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.220 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.220 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:29.220 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.251632+0000", 2024-02-19T21:41:29.220 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:41:29.220 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.220 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.220 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:29.220 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.251631+0000", 2024-02-19T21:41:29.220 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.0610000000000002e-06 2024-02-19T21:41:29.220 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.220 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.220 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:29.220 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.251640+0000", 2024-02-19T21:41:29.221 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.7476999999999999e-05 2024-02-19T21:41:29.221 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.221 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.221 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:29.221 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.251657+0000", 2024-02-19T21:41:29.221 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0353999999999999e-05 2024-02-19T21:41:29.221 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.221 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.221 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:29.221 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.251667+0000", 2024-02-19T21:41:29.221 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.3464000000000002e-05 2024-02-19T21:41:29.221 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.221 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.221 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.222 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.251721+0000", 2024-02-19T21:41:29.222 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1721e-05 2024-02-19T21:41:29.222 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.222 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.222 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:41:29.222 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.251733+0000", 2024-02-19T21:41:29.222 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.98356867999999997 2024-02-19T21:41:29.222 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.222 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.222 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.222 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.235301+0000", 2024-02-19T21:41:29.222 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.7809999999999994e-06 2024-02-19T21:41:29.222 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.222 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.222 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:41:29.223 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.235310+0000", 2024-02-19T21:41:29.223 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1058049919999999 2024-02-19T21:41:29.223 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.223 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.223 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.223 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.341115+0000", 2024-02-19T21:41:29.223 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013287600000000001 2024-02-19T21:41:29.223 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.223 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.223 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:29.223 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.341248+0000", 2024-02-19T21:41:29.223 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00017378200000000001 2024-02-19T21:41:29.223 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.223 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.223 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,3,4", 2024-02-19T21:41:29.224 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.341422+0000", 2024-02-19T21:41:29.224 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.002243835 2024-02-19T21:41:29.224 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.224 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.224 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:29.224 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.343666+0000", 2024-02-19T21:41:29.224 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000430672 2024-02-19T21:41:29.224 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.224 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.224 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.224 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.344096+0000", 2024-02-19T21:41:29.224 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.6704e-05 2024-02-19T21:41:29.224 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.224 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.224 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.225 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.344123+0000", 2024-02-19T21:41:29.225 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000162521 2024-02-19T21:41:29.225 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.225 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.225 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.225 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.344286+0000", 2024-02-19T21:41:29.225 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.7529999999999999e-05 2024-02-19T21:41:29.225 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.225 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.225 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:29.225 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.344313+0000", 2024-02-19T21:41:29.225 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.5601999999999999e-05 2024-02-19T21:41:29.225 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.225 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.226 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:29.226 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.344389+0000", 2024-02-19T21:41:29.226 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.0927566039999999 2024-02-19T21:41:29.226 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.226 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:29.226 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.226 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.226 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.226 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199225 7.7 7:e7101b2c:::benchmark_data_smithi080_79222_object84491:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-02-19T21:41:29.226 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:30.264325+0000", 2024-02-19T21:41:29.226 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 178.89649728800001, 2024-02-19T21:41:29.226 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1224556250000002, 2024-02-19T21:41:29.226 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:29.226 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:29.227 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:29.227 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:41:29.227 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:41:29.227 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199225 2024-02-19T21:41:29.227 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.227 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:29.227 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.227 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:29.227 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.264325+0000", 2024-02-19T21:41:29.227 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:29.227 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.227 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.227 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:29.227 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.264325+0000", 2024-02-19T21:41:29.227 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:41:29.228 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.228 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.228 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:29.228 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.264324+0000", 2024-02-19T21:41:29.228 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.6960000000000002e-06 2024-02-19T21:41:29.228 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.228 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.228 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:29.228 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.264330+0000", 2024-02-19T21:41:29.228 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.3283e-05 2024-02-19T21:41:29.228 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.228 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.228 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:29.228 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.264343+0000", 2024-02-19T21:41:29.229 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.0099999999999998e-06 2024-02-19T21:41:29.229 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.229 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.229 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:29.229 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.264350+0000", 2024-02-19T21:41:29.229 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.9267000000000001e-05 2024-02-19T21:41:29.229 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.229 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.229 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.229 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.264400+0000", 2024-02-19T21:41:29.229 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0203e-05 2024-02-19T21:41:29.229 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.229 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.229 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:41:29.230 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.264410+0000", 2024-02-19T21:41:29.230 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.97221051000000003 2024-02-19T21:41:29.230 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.230 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.230 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.230 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236620+0000", 2024-02-19T21:41:29.230 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.2139999999999999e-06 2024-02-19T21:41:29.230 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.230 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.230 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:41:29.230 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236627+0000", 2024-02-19T21:41:29.230 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.131609898 2024-02-19T21:41:29.230 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.230 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.230 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.231 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368237+0000", 2024-02-19T21:41:29.231 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00011917999999999999 2024-02-19T21:41:29.231 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.231 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.231 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:29.231 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368357+0000", 2024-02-19T21:41:29.231 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00047232200000000001 2024-02-19T21:41:29.231 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.231 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.231 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1,3", 2024-02-19T21:41:29.231 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368829+0000", 2024-02-19T21:41:29.231 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0085057680000000004 2024-02-19T21:41:29.231 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.231 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.232 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:29.232 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.377335+0000", 2024-02-19T21:41:29.232 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0027407709999999999 2024-02-19T21:41:29.232 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.232 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.232 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.232 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.380075+0000", 2024-02-19T21:41:29.232 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0045583339999999998 2024-02-19T21:41:29.232 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.232 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.232 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.232 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.384634+0000", 2024-02-19T21:41:29.232 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0019395289999999999 2024-02-19T21:41:29.232 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.233 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.233 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.233 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.386573+0000", 2024-02-19T21:41:29.233 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.5507999999999997e-05 2024-02-19T21:41:29.233 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.233 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.233 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:29.233 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.386639+0000", 2024-02-19T21:41:29.233 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000142177 2024-02-19T21:41:29.233 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.233 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.233 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:29.233 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.386781+0000", 2024-02-19T21:41:29.233 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1224556250000002 2024-02-19T21:41:29.234 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.234 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:29.234 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.234 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.234 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.234 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199240 7.7 7:ecb96328:::benchmark_data_smithi080_79222_object84506:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-02-19T21:41:29.234 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:30.315926+0000", 2024-02-19T21:41:29.234 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 178.84489653, 2024-02-19T21:41:29.234 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.080005286, 2024-02-19T21:41:29.234 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:29.234 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:29.234 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:29.234 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:41:29.234 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:41:29.235 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199240 2024-02-19T21:41:29.235 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.235 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:29.235 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.235 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:29.235 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.315926+0000", 2024-02-19T21:41:29.235 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:29.235 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.235 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.235 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:29.235 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.315926+0000", 2024-02-19T21:41:29.235 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999976 2024-02-19T21:41:29.235 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.235 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.236 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:29.236 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.315924+0000", 2024-02-19T21:41:29.236 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.3709999999999999e-05 2024-02-19T21:41:29.236 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.236 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.236 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:29.236 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.315937+0000", 2024-02-19T21:41:29.236 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.8242000000000002e-05 2024-02-19T21:41:29.236 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.236 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.236 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:29.236 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.315966+0000", 2024-02-19T21:41:29.236 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2466999999999999e-05 2024-02-19T21:41:29.236 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.236 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.237 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:29.237 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.315978+0000", 2024-02-19T21:41:29.237 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.7517999999999997e-05 2024-02-19T21:41:29.237 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.237 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.237 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.237 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.316076+0000", 2024-02-19T21:41:29.237 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.8423e-05 2024-02-19T21:41:29.237 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.237 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.237 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:41:29.237 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.316094+0000", 2024-02-19T21:41:29.237 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.92064759600000001 2024-02-19T21:41:29.237 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.237 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.238 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.238 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236742+0000", 2024-02-19T21:41:29.238 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0042e-05 2024-02-19T21:41:29.238 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.238 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.238 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:41:29.238 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236752+0000", 2024-02-19T21:41:29.238 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.138470066 2024-02-19T21:41:29.238 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.238 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.238 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.238 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.375222+0000", 2024-02-19T21:41:29.238 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014873800000000001 2024-02-19T21:41:29.238 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.239 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.239 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:29.239 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.375371+0000", 2024-02-19T21:41:29.239 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00017589099999999999 2024-02-19T21:41:29.239 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.239 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.239 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1,3", 2024-02-19T21:41:29.239 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.375546+0000", 2024-02-19T21:41:29.239 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.001793258 2024-02-19T21:41:29.239 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.239 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.239 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:29.239 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.377340+0000", 2024-02-19T21:41:29.239 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0079979979999999992 2024-02-19T21:41:29.239 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.240 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.240 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.240 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.385338+0000", 2024-02-19T21:41:29.240 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0014799430000000001 2024-02-19T21:41:29.240 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.240 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.240 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.240 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.386818+0000", 2024-02-19T21:41:29.240 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0088757969999999995 2024-02-19T21:41:29.240 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.240 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.240 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.240 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.395693+0000", 2024-02-19T21:41:29.240 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.6478999999999998e-05 2024-02-19T21:41:29.241 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.241 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.241 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:29.241 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.395760+0000", 2024-02-19T21:41:29.241 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000171471 2024-02-19T21:41:29.241 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.241 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.241 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:29.241 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.395931+0000", 2024-02-19T21:41:29.241 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.080005286 2024-02-19T21:41:29.241 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.241 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:29.241 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.241 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.241 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.242 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199243 7.c 7:32d6b0d0:::benchmark_data_smithi080_79222_object84509:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:41:29.242 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:32.358612+0000", 2024-02-19T21:41:29.242 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 176.802210465, 2024-02-19T21:41:29.242 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.17102286999999999, 2024-02-19T21:41:29.242 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:29.242 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:29.242 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:29.242 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:41:29.242 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:41:29.242 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199243 2024-02-19T21:41:29.242 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.242 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:29.242 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.242 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:29.243 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.358612+0000", 2024-02-19T21:41:29.243 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:29.243 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.243 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.243 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:29.243 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.358612+0000", 2024-02-19T21:41:29.243 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:41:29.243 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.243 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.243 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:29.243 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.358610+0000", 2024-02-19T21:41:29.243 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.6910000000000003e-06 2024-02-19T21:41:29.243 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.243 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.244 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:29.244 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.358619+0000", 2024-02-19T21:41:29.244 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2391999999999999e-05 2024-02-19T21:41:29.244 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.244 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.244 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:29.244 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.358632+0000", 2024-02-19T21:41:29.244 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.5099999999999998e-06 2024-02-19T21:41:29.244 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.244 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.244 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:29.244 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.358637+0000", 2024-02-19T21:41:29.244 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.1888000000000002e-05 2024-02-19T21:41:29.244 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.244 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.245 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.245 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.358689+0000", 2024-02-19T21:41:29.245 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0662000000000001e-05 2024-02-19T21:41:29.245 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.245 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.245 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:41:29.245 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.358700+0000", 2024-02-19T21:41:29.245 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.14865595600000001 2024-02-19T21:41:29.245 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.245 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.245 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.245 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.507356+0000", 2024-02-19T21:41:29.245 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.4226000000000003e-05 2024-02-19T21:41:29.245 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.246 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.246 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:29.246 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.507440+0000", 2024-02-19T21:41:29.246 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00047858500000000001 2024-02-19T21:41:29.246 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.246 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.246 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 2,3,7", 2024-02-19T21:41:29.246 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.507918+0000", 2024-02-19T21:41:29.246 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.015245470000000001 2024-02-19T21:41:29.246 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.246 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.246 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.246 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.523164+0000", 2024-02-19T21:41:29.246 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.773e-05 2024-02-19T21:41:29.247 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.247 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.247 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.247 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.523202+0000", 2024-02-19T21:41:29.247 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.6146999999999998e-05 2024-02-19T21:41:29.247 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.247 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.247 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.247 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.523238+0000", 2024-02-19T21:41:29.247 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0062431229999999997 2024-02-19T21:41:29.247 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.247 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.247 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:29.248 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.529481+0000", 2024-02-19T21:41:29.248 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.8912000000000002e-05 2024-02-19T21:41:29.248 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.248 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.248 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:29.248 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.529530+0000", 2024-02-19T21:41:29.248 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00010529199999999999 2024-02-19T21:41:29.248 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.248 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.248 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:29.248 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.529635+0000", 2024-02-19T21:41:29.248 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.17102286999999999 2024-02-19T21:41:29.249 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.249 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:29.249 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.249 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.249 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.249 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199244 7.c 7:379204a8:::benchmark_data_smithi080_79222_object84510:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:41:29.249 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:32.368056+0000", 2024-02-19T21:41:29.249 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 176.792766357, 2024-02-19T21:41:29.249 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.161730017, 2024-02-19T21:41:29.249 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:29.249 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:29.249 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:29.249 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:41:29.249 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:41:29.250 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199244 2024-02-19T21:41:29.250 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.250 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:29.250 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.250 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:29.250 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368056+0000", 2024-02-19T21:41:29.250 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:29.250 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.250 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.250 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:29.250 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368056+0000", 2024-02-19T21:41:29.250 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:41:29.250 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.250 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.250 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:29.251 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368054+0000", 2024-02-19T21:41:29.251 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.8789999999999992e-06 2024-02-19T21:41:29.251 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.251 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.251 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:29.251 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368063+0000", 2024-02-19T21:41:29.251 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2001000000000001e-05 2024-02-19T21:41:29.251 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.251 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.251 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:29.251 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368075+0000", 2024-02-19T21:41:29.251 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.5289999999999997e-06 2024-02-19T21:41:29.251 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.251 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.252 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:29.252 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368082+0000", 2024-02-19T21:41:29.252 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0662999999999999e-05 2024-02-19T21:41:29.252 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.252 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.252 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.252 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368133+0000", 2024-02-19T21:41:29.252 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.6269999999999995e-06 2024-02-19T21:41:29.252 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.252 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.252 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:41:29.252 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368142+0000", 2024-02-19T21:41:29.252 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.14907314799999999 2024-02-19T21:41:29.252 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.253 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.253 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.253 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.517215+0000", 2024-02-19T21:41:29.253 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000144287 2024-02-19T21:41:29.253 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.253 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.253 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:29.253 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.517360+0000", 2024-02-19T21:41:29.253 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000171189 2024-02-19T21:41:29.253 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.253 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.253 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 2,3,7", 2024-02-19T21:41:29.253 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.517531+0000", 2024-02-19T21:41:29.253 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0057492419999999999 2024-02-19T21:41:29.254 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.254 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.254 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.254 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.523280+0000", 2024-02-19T21:41:29.254 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.6207e-05 2024-02-19T21:41:29.254 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.254 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.254 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.254 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.523326+0000", 2024-02-19T21:41:29.254 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0056854949999999996 2024-02-19T21:41:29.254 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.254 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.254 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.254 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.529012+0000", 2024-02-19T21:41:29.254 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00063114099999999999 2024-02-19T21:41:29.255 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.255 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.255 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:29.255 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.529643+0000", 2024-02-19T21:41:29.255 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0198999999999999e-05 2024-02-19T21:41:29.255 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.255 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.255 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:29.255 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.529683+0000", 2024-02-19T21:41:29.255 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0001032 2024-02-19T21:41:29.255 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.255 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.255 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:29.255 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.529786+0000", 2024-02-19T21:41:29.256 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.161730017 2024-02-19T21:41:29.256 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.256 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:29.256 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.256 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.256 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.256 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:206643 7.7 7:ed6e881f:::benchmark_data_smithi080_79222_object91909:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:41:29.256 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:40.951493+0000", 2024-02-19T21:41:29.256 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 168.209329185, 2024-02-19T21:41:29.256 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.086843371000000003, 2024-02-19T21:41:29.256 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:29.256 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:29.256 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:29.256 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:41:29.257 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:41:29.257 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 206643 2024-02-19T21:41:29.257 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.257 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:29.257 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.257 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:29.257 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.951493+0000", 2024-02-19T21:41:29.257 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:29.257 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.257 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.257 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:29.257 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.951493+0000", 2024-02-19T21:41:29.257 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:41:29.257 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.257 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.258 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:29.258 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.951492+0000", 2024-02-19T21:41:29.258 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.8870000000000003e-06 2024-02-19T21:41:29.258 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.258 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.258 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:29.258 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.951499+0000", 2024-02-19T21:41:29.258 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.7589999999999992e-06 2024-02-19T21:41:29.258 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.258 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.258 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:29.258 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.951509+0000", 2024-02-19T21:41:29.258 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.7649999999999999e-06 2024-02-19T21:41:29.258 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.259 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.259 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:29.259 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.951515+0000", 2024-02-19T21:41:29.259 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00021464499999999999 2024-02-19T21:41:29.259 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.259 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.259 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.259 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.951729+0000", 2024-02-19T21:41:29.259 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000126231 2024-02-19T21:41:29.259 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.259 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.259 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:29.259 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.951855+0000", 2024-02-19T21:41:29.259 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00015909999999999999 2024-02-19T21:41:29.260 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.260 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.260 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1,3", 2024-02-19T21:41:29.260 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.952015+0000", 2024-02-19T21:41:29.260 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0030639819999999998 2024-02-19T21:41:29.260 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.260 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.260 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:29.260 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.955079+0000", 2024-02-19T21:41:29.260 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.015306619 2024-02-19T21:41:29.260 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.260 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.260 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.260 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.970385+0000", 2024-02-19T21:41:29.261 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00049222899999999995 2024-02-19T21:41:29.261 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.261 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.261 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.261 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.970877+0000", 2024-02-19T21:41:29.261 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.067260906999999995 2024-02-19T21:41:29.261 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.261 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.261 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.261 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:41.038138+0000", 2024-02-19T21:41:29.261 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.982e-05 2024-02-19T21:41:29.261 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.261 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.261 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:29.262 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:41.038198+0000", 2024-02-19T21:41:29.262 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013866900000000001 2024-02-19T21:41:29.262 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.262 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.262 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:29.262 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:41.038337+0000", 2024-02-19T21:41:29.262 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.086843371000000003 2024-02-19T21:41:29.262 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.262 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:29.262 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.262 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.263 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.263 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:206653 7.d 7:b0a06478:::benchmark_data_smithi080_79222_object91919:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:41:29.263 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:40.963286+0000", 2024-02-19T21:41:29.263 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 168.19753662299999, 2024-02-19T21:41:29.263 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.081431297, 2024-02-19T21:41:29.263 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:29.263 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:29.263 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:29.263 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:41:29.263 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:41:29.263 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 206653 2024-02-19T21:41:29.263 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.263 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:29.263 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.263 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:29.264 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.963286+0000", 2024-02-19T21:41:29.264 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:29.264 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.264 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.264 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:29.264 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.963286+0000", 2024-02-19T21:41:29.264 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:41:29.264 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.264 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.264 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:29.264 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.963285+0000", 2024-02-19T21:41:29.264 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.9349999999999997e-06 2024-02-19T21:41:29.264 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.264 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.265 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:29.265 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.963291+0000", 2024-02-19T21:41:29.265 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.5730999999999999e-05 2024-02-19T21:41:29.265 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.265 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.265 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:29.265 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.963307+0000", 2024-02-19T21:41:29.265 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.1879999999999999e-06 2024-02-19T21:41:29.265 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.265 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.265 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:29.265 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.963313+0000", 2024-02-19T21:41:29.265 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.2889000000000002e-05 2024-02-19T21:41:29.265 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.266 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.266 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.266 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.963356+0000", 2024-02-19T21:41:29.266 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00010317 2024-02-19T21:41:29.266 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.266 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.266 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:29.266 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.963459+0000", 2024-02-19T21:41:29.266 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00011767100000000001 2024-02-19T21:41:29.266 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.266 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.266 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:41:29.266 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.963577+0000", 2024-02-19T21:41:29.266 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0025371909999999998 2024-02-19T21:41:29.266 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.267 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.267 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:29.267 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.966114+0000", 2024-02-19T21:41:29.267 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0087907550000000008 2024-02-19T21:41:29.267 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.267 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.267 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.267 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.974905+0000", 2024-02-19T21:41:29.267 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.069734184000000005 2024-02-19T21:41:29.267 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.267 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.267 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.267 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:41.044639+0000", 2024-02-19T21:41:29.267 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.1242000000000003e-05 2024-02-19T21:41:29.267 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.268 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.268 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:29.268 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:41.044680+0000", 2024-02-19T21:41:29.268 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.6803e-05 2024-02-19T21:41:29.268 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.268 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.268 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:29.268 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:41.044717+0000", 2024-02-19T21:41:29.268 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.081431297 2024-02-19T21:41:29.268 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.268 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:29.268 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.268 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.268 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.268 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:207584 7.7 7:ec3844c7:::benchmark_data_smithi080_79222_object92850:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:41:29.269 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:42.091282+0000", 2024-02-19T21:41:29.269 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 167.06954038800001, 2024-02-19T21:41:29.269 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.10409320900000001, 2024-02-19T21:41:29.269 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:29.269 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:29.269 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:29.269 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:41:29.269 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:41:29.269 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 207584 2024-02-19T21:41:29.269 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.269 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:29.269 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.269 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:29.269 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.091282+0000", 2024-02-19T21:41:29.269 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:29.270 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.270 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.270 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:29.270 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.091282+0000", 2024-02-19T21:41:29.270 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:41:29.270 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.270 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.270 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:29.270 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.091281+0000", 2024-02-19T21:41:29.270 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.7429999999999996e-06 2024-02-19T21:41:29.270 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.270 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.270 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:29.270 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.091288+0000", 2024-02-19T21:41:29.270 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2091e-05 2024-02-19T21:41:29.271 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.271 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.271 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:29.271 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.091300+0000", 2024-02-19T21:41:29.271 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.9460000000000003e-06 2024-02-19T21:41:29.271 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.271 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.271 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:29.271 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.091306+0000", 2024-02-19T21:41:29.271 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.9030999999999997e-05 2024-02-19T21:41:29.271 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.271 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.271 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.271 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.091375+0000", 2024-02-19T21:41:29.272 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00011971 2024-02-19T21:41:29.272 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.272 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.272 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:29.272 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.091495+0000", 2024-02-19T21:41:29.272 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00016302499999999999 2024-02-19T21:41:29.272 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.272 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.272 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1,3", 2024-02-19T21:41:29.272 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.091658+0000", 2024-02-19T21:41:29.272 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0064095289999999997 2024-02-19T21:41:29.272 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.272 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.272 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:29.273 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.098067+0000", 2024-02-19T21:41:29.273 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.001025693 2024-02-19T21:41:29.273 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.273 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.273 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.273 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099093+0000", 2024-02-19T21:41:29.273 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0040436500000000002 2024-02-19T21:41:29.273 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.273 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.273 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.273 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.103137+0000", 2024-02-19T21:41:29.273 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.092109941000000001 2024-02-19T21:41:29.273 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.273 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.273 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.274 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.195247+0000", 2024-02-19T21:41:29.274 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.7958999999999999e-05 2024-02-19T21:41:29.274 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.274 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.274 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:29.274 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.195294+0000", 2024-02-19T21:41:29.274 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.0958999999999995e-05 2024-02-19T21:41:29.274 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.274 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.274 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:29.274 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.195375+0000", 2024-02-19T21:41:29.274 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.10409320900000001 2024-02-19T21:41:29.274 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.274 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:29.275 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.275 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.275 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.275 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:207586 7.d 7:b9ba961f:::benchmark_data_smithi080_79222_object92852:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:41:29.275 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:42.094622+0000", 2024-02-19T21:41:29.275 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 167.06620087900001, 2024-02-19T21:41:29.275 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.089242795999999999, 2024-02-19T21:41:29.275 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:29.275 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:29.275 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:29.275 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:41:29.275 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:41:29.275 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 207586 2024-02-19T21:41:29.275 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.276 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:29.276 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.276 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:29.276 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094622+0000", 2024-02-19T21:41:29.276 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:29.276 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.276 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.276 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:29.276 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094622+0000", 2024-02-19T21:41:29.276 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:41:29.276 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.276 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.276 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:29.276 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094620+0000", 2024-02-19T21:41:29.276 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.1400000000000002e-06 2024-02-19T21:41:29.277 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.277 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.277 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:29.277 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094627+0000", 2024-02-19T21:41:29.277 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1995e-05 2024-02-19T21:41:29.277 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.277 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.277 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:29.277 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094639+0000", 2024-02-19T21:41:29.277 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.0249999999999999e-06 2024-02-19T21:41:29.277 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.277 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.277 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:29.277 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094645+0000", 2024-02-19T21:41:29.277 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.5117000000000002e-05 2024-02-19T21:41:29.278 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.278 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.278 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.278 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094690+0000", 2024-02-19T21:41:29.278 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00012526900000000001 2024-02-19T21:41:29.278 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.278 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.278 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:29.278 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094816+0000", 2024-02-19T21:41:29.278 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00012976599999999999 2024-02-19T21:41:29.278 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.278 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.278 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:41:29.278 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094945+0000", 2024-02-19T21:41:29.278 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0028760909999999999 2024-02-19T21:41:29.279 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.279 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.279 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:29.279 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.097821+0000", 2024-02-19T21:41:29.279 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0070416719999999997 2024-02-19T21:41:29.279 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.279 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.279 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.279 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.104863+0000", 2024-02-19T21:41:29.279 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.078907110000000003 2024-02-19T21:41:29.279 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.279 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.279 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.279 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.183770+0000", 2024-02-19T21:41:29.280 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0040000000000002e-05 2024-02-19T21:41:29.280 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.280 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.280 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:29.280 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.183820+0000", 2024-02-19T21:41:29.280 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.4211000000000001e-05 2024-02-19T21:41:29.280 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.280 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.280 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:29.280 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.183865+0000", 2024-02-19T21:41:29.280 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.089242795999999999 2024-02-19T21:41:29.280 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.280 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:29.280 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.281 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.281 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.281 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:207589 7.7 7:e6ce6b61:::benchmark_data_smithi080_79222_object92855:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:41:29.281 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:42.094660+0000", 2024-02-19T21:41:29.281 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 167.06616252399999, 2024-02-19T21:41:29.281 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.10097279000000001, 2024-02-19T21:41:29.281 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:29.281 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:29.281 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:29.281 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:41:29.281 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:41:29.281 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 207589 2024-02-19T21:41:29.281 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.281 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:29.281 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.282 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:29.282 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094660+0000", 2024-02-19T21:41:29.282 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:29.282 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.282 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.282 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:29.282 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094660+0000", 2024-02-19T21:41:29.282 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:41:29.282 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.282 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.282 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:29.282 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094660+0000", 2024-02-19T21:41:29.282 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.948e-06 2024-02-19T21:41:29.282 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.282 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.283 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:29.283 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094663+0000", 2024-02-19T21:41:29.283 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.2609999999999999e-06 2024-02-19T21:41:29.283 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.283 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.283 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:29.283 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094669+0000", 2024-02-19T21:41:29.283 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.7189999999999999e-06 2024-02-19T21:41:29.283 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.283 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.283 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:29.283 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094673+0000", 2024-02-19T21:41:29.283 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.3884999999999997e-05 2024-02-19T21:41:29.283 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.283 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.284 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.284 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094716+0000", 2024-02-19T21:41:29.284 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00011217099999999999 2024-02-19T21:41:29.284 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.284 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.284 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:29.284 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094829+0000", 2024-02-19T21:41:29.284 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00040904199999999998 2024-02-19T21:41:29.284 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.284 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.284 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1,3", 2024-02-19T21:41:29.284 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.095238+0000", 2024-02-19T21:41:29.284 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0029471250000000001 2024-02-19T21:41:29.285 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.285 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.285 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:29.285 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.098185+0000", 2024-02-19T21:41:29.285 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0049020060000000004 2024-02-19T21:41:29.285 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.285 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.285 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.285 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.103087+0000", 2024-02-19T21:41:29.285 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.8848e-05 2024-02-19T21:41:29.285 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.285 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.286 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.286 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.103176+0000", 2024-02-19T21:41:29.286 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.092253600000000005 2024-02-19T21:41:29.286 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.286 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.286 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.286 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.195429+0000", 2024-02-19T21:41:29.286 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.7788999999999998e-05 2024-02-19T21:41:29.286 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.286 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.286 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:29.286 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.195487+0000", 2024-02-19T21:41:29.286 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014587199999999999 2024-02-19T21:41:29.286 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.287 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.287 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:29.287 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.195633+0000", 2024-02-19T21:41:29.287 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.10097279000000001 2024-02-19T21:41:29.287 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.287 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:29.287 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.287 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.287 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.287 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:207593 7.d 7:bde9a27f:::benchmark_data_smithi080_79222_object92859:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:41:29.287 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:42.099023+0000", 2024-02-19T21:41:29.287 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 167.06179995400001, 2024-02-19T21:41:29.287 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.085093337000000005, 2024-02-19T21:41:29.287 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:29.288 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:29.288 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:29.288 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:41:29.288 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:41:29.288 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 207593 2024-02-19T21:41:29.288 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.288 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:29.288 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.288 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:29.288 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099023+0000", 2024-02-19T21:41:29.288 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:29.288 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.288 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.288 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:29.289 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099023+0000", 2024-02-19T21:41:29.289 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:41:29.289 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.289 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.289 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:29.289 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099021+0000", 2024-02-19T21:41:29.289 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.3240000000000003e-06 2024-02-19T21:41:29.289 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.289 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.289 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:29.289 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099030+0000", 2024-02-19T21:41:29.289 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.6010000000000001e-05 2024-02-19T21:41:29.289 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.289 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.289 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:29.290 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099046+0000", 2024-02-19T21:41:29.290 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.99e-06 2024-02-19T21:41:29.290 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.290 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.290 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:29.290 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099053+0000", 2024-02-19T21:41:29.290 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.0587999999999995e-05 2024-02-19T21:41:29.290 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.290 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.290 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.290 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099133+0000", 2024-02-19T21:41:29.290 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00012628800000000001 2024-02-19T21:41:29.290 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.290 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.290 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:29.291 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099259+0000", 2024-02-19T21:41:29.291 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014891700000000001 2024-02-19T21:41:29.291 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.291 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.291 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:41:29.291 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099408+0000", 2024-02-19T21:41:29.291 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0022343329999999998 2024-02-19T21:41:29.291 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.291 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.291 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:29.291 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.101643+0000", 2024-02-19T21:41:29.291 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.004290477 2024-02-19T21:41:29.291 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.291 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.291 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.292 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.105933+0000", 2024-02-19T21:41:29.292 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.078084543000000006 2024-02-19T21:41:29.292 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.292 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.292 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.292 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.184018+0000", 2024-02-19T21:41:29.292 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.6813000000000001e-05 2024-02-19T21:41:29.292 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.292 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.292 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:29.292 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.184065+0000", 2024-02-19T21:41:29.292 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.1437000000000002e-05 2024-02-19T21:41:29.292 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.292 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.293 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:29.293 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.184116+0000", 2024-02-19T21:41:29.293 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.085093337000000005 2024-02-19T21:41:29.293 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.293 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:29.293 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.293 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.293 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.293 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:207771 7.d 7:bbed4a8a:::benchmark_data_smithi080_79222_object93037:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:41:29.293 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:42.355377+0000", 2024-02-19T21:41:29.293 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 166.80544563399999, 2024-02-19T21:41:29.293 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.086960934000000004, 2024-02-19T21:41:29.293 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:29.293 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:41:29.294 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:41:29.294 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:41:29.294 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:41:29.294 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 207771 2024-02-19T21:41:29.294 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.294 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:29.294 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.294 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:29.294 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.355377+0000", 2024-02-19T21:41:29.294 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:29.294 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.294 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.294 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:29.294 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.355377+0000", 2024-02-19T21:41:29.294 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:41:29.295 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.295 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.295 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:29.295 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.355376+0000", 2024-02-19T21:41:29.295 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.5729999999999996e-06 2024-02-19T21:41:29.295 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.295 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.295 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:29.295 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.355382+0000", 2024-02-19T21:41:29.295 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2806000000000001e-05 2024-02-19T21:41:29.295 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.295 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.295 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:29.295 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.355395+0000", 2024-02-19T21:41:29.296 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.9199999999999998e-06 2024-02-19T21:41:29.296 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.296 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.296 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:29.296 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.355402+0000", 2024-02-19T21:41:29.296 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0016894709999999999 2024-02-19T21:41:29.296 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.296 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.296 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:29.296 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.357092+0000", 2024-02-19T21:41:29.296 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.1039999999999996e-05 2024-02-19T21:41:29.296 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.296 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.296 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:29.296 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.357183+0000", 2024-02-19T21:41:29.297 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000119494 2024-02-19T21:41:29.297 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.297 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.297 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:41:29.297 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.357302+0000", 2024-02-19T21:41:29.297 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.001513588 2024-02-19T21:41:29.297 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.297 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.297 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:41:29.297 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.358816+0000", 2024-02-19T21:41:29.297 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00024683700000000002 2024-02-19T21:41:29.297 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.297 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.298 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.298 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.359063+0000", 2024-02-19T21:41:29.298 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.083179931999999998 2024-02-19T21:41:29.298 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.298 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.298 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:41:29.298 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.442243+0000", 2024-02-19T21:41:29.298 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.4695999999999999e-05 2024-02-19T21:41:29.298 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.298 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.298 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:41:29.298 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.442297+0000", 2024-02-19T21:41:29.298 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0704999999999997e-05 2024-02-19T21:41:29.298 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:29.298 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:29.299 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:41:29.299 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.442338+0000", 2024-02-19T21:41:29.299 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.086960934000000004 2024-02-19T21:41:29.299 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.299 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:29.299 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.299 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:29.299 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:29.299 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:41:29.299 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:41:29.301 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:29.301 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:41:29.301 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:41:29.342 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:28.117517+0000 mon.c (mon.2) 46 : audit [INF] from='client.? 172.21.15.80:0/1439194036' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "4.1", "id": [4, 2, 6]}]: dispatch 2024-02-19T21:41:29.342 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:28.117894+0000 mon.a (mon.0) 1050 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "4.1", "id": [4, 2, 6]}]: dispatch 2024-02-19T21:41:29.342 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:28.117517+0000 mon.c (mon.2) 46 : audit [INF] from='client.? 172.21.15.80:0/1439194036' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "4.1", "id": [4, 2, 6]}]: dispatch 2024-02-19T21:41:29.343 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:28.117894+0000 mon.a (mon.0) 1050 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "4.1", "id": [4, 2, 6]}]: dispatch 2024-02-19T21:41:29.402 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:41:29.450 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:29.496 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:41:29.501 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:29.501 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:41:29.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:28.117517+0000 mon.c (mon.2) 46 : audit [INF] from='client.? 172.21.15.80:0/1439194036' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "4.1", "id": [4, 2, 6]}]: dispatch 2024-02-19T21:41:29.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:28.117894+0000 mon.a (mon.0) 1050 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "4.1", "id": [4, 2, 6]}]: dispatch 2024-02-19T21:41:29.602 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:41:29.668 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:30.041 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:41:30.052 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:30.053 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:41:30.063 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.7 dump_ops_in_flight 2024-02-19T21:41:30.153 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:41:30.200 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:30.304 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:28.983283+0000 mgr.y (mgr.14514) 344 : cluster [DBG] pgmap v377: 148 pgs: 148 active+clean; 7.7 GiB data, 25 GiB used, 601 GiB / 626 GiB avail; 1023 B/s rd, 66 MiB/s wr, 1.05k op/s 2024-02-19T21:41:30.304 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:29.084579+0000 mon.a (mon.0) 1051 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pg-upmap", "pgid": "4.1", "id": [4, 2, 6]}]': finished 2024-02-19T21:41:30.304 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:29.084649+0000 mon.a (mon.0) 1052 : cluster [DBG] osdmap e187: 8 total, 8 up, 7 in 2024-02-19T21:41:30.304 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:29.552753+0000 osd.4 (osd.4) 128 : cluster [DBG] 8.2 scrub ok 2024-02-19T21:41:30.305 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:29.637386+0000 osd.5 (osd.5) 163 : cluster [DBG] 5.6 scrub starts 2024-02-19T21:41:30.305 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:29.640424+0000 osd.5 (osd.5) 164 : cluster [DBG] 5.6 scrub ok 2024-02-19T21:41:30.305 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:41:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:41:30.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:28.983283+0000 mgr.y (mgr.14514) 344 : cluster [DBG] pgmap v377: 148 pgs: 148 active+clean; 7.7 GiB data, 25 GiB used, 601 GiB / 626 GiB avail; 1023 B/s rd, 66 MiB/s wr, 1.05k op/s 2024-02-19T21:41:30.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:29.084579+0000 mon.a (mon.0) 1051 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pg-upmap", "pgid": "4.1", "id": [4, 2, 6]}]': finished 2024-02-19T21:41:30.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:29.084649+0000 mon.a (mon.0) 1052 : cluster [DBG] osdmap e187: 8 total, 8 up, 7 in 2024-02-19T21:41:30.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:29.552753+0000 osd.4 (osd.4) 128 : cluster [DBG] 8.2 scrub ok 2024-02-19T21:41:30.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:29.637386+0000 osd.5 (osd.5) 163 : cluster [DBG] 5.6 scrub starts 2024-02-19T21:41:30.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:29.640424+0000 osd.5 (osd.5) 164 : cluster [DBG] 5.6 scrub ok 2024-02-19T21:41:30.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:28.983283+0000 mgr.y (mgr.14514) 344 : cluster [DBG] pgmap v377: 148 pgs: 148 active+clean; 7.7 GiB data, 25 GiB used, 601 GiB / 626 GiB avail; 1023 B/s rd, 66 MiB/s wr, 1.05k op/s 2024-02-19T21:41:30.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:29.084579+0000 mon.a (mon.0) 1051 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pg-upmap", "pgid": "4.1", "id": [4, 2, 6]}]': finished 2024-02-19T21:41:30.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:29.084649+0000 mon.a (mon.0) 1052 : cluster [DBG] osdmap e187: 8 total, 8 up, 7 in 2024-02-19T21:41:30.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:29.552753+0000 osd.4 (osd.4) 128 : cluster [DBG] 8.2 scrub ok 2024-02-19T21:41:30.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:29.637386+0000 osd.5 (osd.5) 163 : cluster [DBG] 5.6 scrub starts 2024-02-19T21:41:30.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:29.640424+0000 osd.5 (osd.5) 164 : cluster [DBG] 5.6 scrub ok 2024-02-19T21:41:30.530 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:41:30.660 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:41:30.666 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:30.666 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:41:30.767 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:41:30.810 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:31.032 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:41:31.036 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:31.037 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:41:31.037 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:41:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:41:30] "GET /metrics HTTP/1.1" 200 175857 "" "Prometheus/2.33.4" 2024-02-19T21:41:31.081 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:41:31.137 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:41:31.184 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:31.217 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:30.301680+0000 mgr.y (mgr.14514) 345 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:41:31.217 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:30.605410+0000 osd.5 (osd.5) 165 : cluster [DBG] 5.e scrub starts 2024-02-19T21:41:31.217 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:30.610847+0000 osd.5 (osd.5) 166 : cluster [DBG] 5.e scrub ok 2024-02-19T21:41:31.268 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:41:31.272 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:31.273 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:41:31.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:30.301680+0000 mgr.y (mgr.14514) 345 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:41:31.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:30.605410+0000 osd.5 (osd.5) 165 : cluster [DBG] 5.e scrub starts 2024-02-19T21:41:31.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:30.610847+0000 osd.5 (osd.5) 166 : cluster [DBG] 5.e scrub ok 2024-02-19T21:41:31.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:30.301680+0000 mgr.y (mgr.14514) 345 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:41:31.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:30.605410+0000 osd.5 (osd.5) 165 : cluster [DBG] 5.e scrub starts 2024-02-19T21:41:31.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:30.610847+0000 osd.5 (osd.5) 166 : cluster [DBG] 5.e scrub ok 2024-02-19T21:41:31.373 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:41:31.424 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:31.572 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:41:31.575 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:31.575 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:41:31.676 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:41:31.712 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:32.093 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:41:32.098 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:32.098 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:41:32.141 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-02-19T21:41:32.199 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:41:32.248 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:32.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:30.182497+0000 osd.1 (osd.1) 151 : cluster [DBG] 5.0 scrub starts 2024-02-19T21:41:32.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:30.192418+0000 osd.1 (osd.1) 152 : cluster [DBG] 5.0 scrub ok 2024-02-19T21:41:32.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:30.983971+0000 mgr.y (mgr.14514) 346 : cluster [DBG] pgmap v379: 148 pgs: 148 active+clean; 7.6 GiB data, 25 GiB used, 601 GiB / 626 GiB avail; 1.2 KiB/s rd, 50 MiB/s wr, 1.14k op/s 2024-02-19T21:41:32.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:31.273077+0000 mon.a (mon.0) 1053 : audit [INF] from='client.? 172.21.15.80:0/1896476580' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:41:32.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:31.565090+0000 osd.5 (osd.5) 167 : cluster [DBG] 4.1 scrub starts 2024-02-19T21:41:32.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:31.580696+0000 osd.5 (osd.5) 168 : cluster [DBG] 4.1 scrub ok 2024-02-19T21:41:32.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:31.629350+0000 osd.0 (osd.0) 163 : cluster [DBG] 6.18 scrub starts 2024-02-19T21:41:32.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:31.631295+0000 osd.0 (osd.0) 164 : cluster [DBG] 6.18 scrub ok 2024-02-19T21:41:32.509 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:41:32.515 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:32.516 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:41:32.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:30.182497+0000 osd.1 (osd.1) 151 : cluster [DBG] 5.0 scrub starts 2024-02-19T21:41:32.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:30.192418+0000 osd.1 (osd.1) 152 : cluster [DBG] 5.0 scrub ok 2024-02-19T21:41:32.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:30.983971+0000 mgr.y (mgr.14514) 346 : cluster [DBG] pgmap v379: 148 pgs: 148 active+clean; 7.6 GiB data, 25 GiB used, 601 GiB / 626 GiB avail; 1.2 KiB/s rd, 50 MiB/s wr, 1.14k op/s 2024-02-19T21:41:32.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:31.273077+0000 mon.a (mon.0) 1053 : audit [INF] from='client.? 172.21.15.80:0/1896476580' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:41:32.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:31.565090+0000 osd.5 (osd.5) 167 : cluster [DBG] 4.1 scrub starts 2024-02-19T21:41:32.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:31.580696+0000 osd.5 (osd.5) 168 : cluster [DBG] 4.1 scrub ok 2024-02-19T21:41:32.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:31.629350+0000 osd.0 (osd.0) 163 : cluster [DBG] 6.18 scrub starts 2024-02-19T21:41:32.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:31.631295+0000 osd.0 (osd.0) 164 : cluster [DBG] 6.18 scrub ok 2024-02-19T21:41:32.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:30.182497+0000 osd.1 (osd.1) 151 : cluster [DBG] 5.0 scrub starts 2024-02-19T21:41:32.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:30.192418+0000 osd.1 (osd.1) 152 : cluster [DBG] 5.0 scrub ok 2024-02-19T21:41:32.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:30.983971+0000 mgr.y (mgr.14514) 346 : cluster [DBG] pgmap v379: 148 pgs: 148 active+clean; 7.6 GiB data, 25 GiB used, 601 GiB / 626 GiB avail; 1.2 KiB/s rd, 50 MiB/s wr, 1.14k op/s 2024-02-19T21:41:32.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:31.273077+0000 mon.a (mon.0) 1053 : audit [INF] from='client.? 172.21.15.80:0/1896476580' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:41:32.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:31.565090+0000 osd.5 (osd.5) 167 : cluster [DBG] 4.1 scrub starts 2024-02-19T21:41:32.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:31.580696+0000 osd.5 (osd.5) 168 : cluster [DBG] 4.1 scrub ok 2024-02-19T21:41:32.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:31.629350+0000 osd.0 (osd.0) 163 : cluster [DBG] 6.18 scrub starts 2024-02-19T21:41:32.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:31.631295+0000 osd.0 (osd.0) 164 : cluster [DBG] 6.18 scrub ok 2024-02-19T21:41:32.617 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:41:32.676 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:32.712 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:41:32.715 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:32.716 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:41:32.817 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:41:32.900 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:41:32.900 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [ 2024-02-19T21:41:32.900 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.900 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_repop(client.24932.0:134166 8.5 e188/165 8:ace10914:::benchmark_data_smithi080_100924_object6448:head v 188'8398, mlcod=188'8396)", 2024-02-19T21:41:32.900 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:41:32.888046+0000", 2024-02-19T21:41:32.900 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.0093927690000000005, 2024-02-19T21:41:32.900 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0094170899999999995, 2024-02-19T21:41:32.900 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:32.901 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "started", 2024-02-19T21:41:32.901 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:32.901 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.901 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:32.901 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.888046+0000", 2024-02-19T21:41:32.901 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:32.901 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.901 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.901 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:32.901 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.888046+0000", 2024-02-19T21:41:32.901 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:41:32.901 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.901 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.901 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:32.902 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.888045+0000", 2024-02-19T21:41:32.902 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.8890000000000008e-06 2024-02-19T21:41:32.902 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.902 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.902 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:32.902 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.888054+0000", 2024-02-19T21:41:32.902 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.5636000000000001e-05 2024-02-19T21:41:32.902 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.902 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.902 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:32.902 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.888070+0000", 2024-02-19T21:41:32.902 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.1759999999999998e-06 2024-02-19T21:41:32.902 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.902 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.903 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:32.903 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.888076+0000", 2024-02-19T21:41:32.903 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.7328000000000001e-05 2024-02-19T21:41:32.903 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.903 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.903 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:32.903 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.888163+0000", 2024-02-19T21:41:32.903 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.8396000000000001e-05 2024-02-19T21:41:32.903 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.903 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.903 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:32.903 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.888182+0000", 2024-02-19T21:41:32.903 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013533299999999999 2024-02-19T21:41:32.903 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:32.904 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:32.904 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:32.904 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.904 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.904 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_repop(client.24932.0:134172 8.6 e188/165 8:6ce8086b:::benchmark_data_smithi080_100924_object6454:head v 188'8413, mlcod=188'8410)", 2024-02-19T21:41:32.904 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:41:32.889229+0000", 2024-02-19T21:41:32.904 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.0082105709999999998, 2024-02-19T21:41:32.904 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0082796220000000004, 2024-02-19T21:41:32.904 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:32.904 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "started", 2024-02-19T21:41:32.904 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:32.904 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.904 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:32.904 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.889229+0000", 2024-02-19T21:41:32.905 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:32.905 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.905 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.905 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:32.905 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.889229+0000", 2024-02-19T21:41:32.905 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:41:32.905 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.905 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.905 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:32.905 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.889228+0000", 2024-02-19T21:41:32.905 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0345e-05 2024-02-19T21:41:32.905 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.905 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.905 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:32.905 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.889238+0000", 2024-02-19T21:41:32.906 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1625e-05 2024-02-19T21:41:32.906 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.906 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.906 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:32.906 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.889250+0000", 2024-02-19T21:41:32.906 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.2700000000000001e-06 2024-02-19T21:41:32.906 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.906 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.906 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:32.906 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.889256+0000", 2024-02-19T21:41:32.906 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.9833999999999998e-05 2024-02-19T21:41:32.906 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.906 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.906 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:32.906 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.889306+0000", 2024-02-19T21:41:32.907 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.0577999999999998e-05 2024-02-19T21:41:32.907 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.907 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.907 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:32.907 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.889326+0000", 2024-02-19T21:41:32.907 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.7769000000000005e-05 2024-02-19T21:41:32.907 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:32.907 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:32.907 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:32.907 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.907 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.907 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_repop(client.24932.0:134175 8.6 e188/165 8:6f7ca3aa:::benchmark_data_smithi080_100924_object6457:head v 188'8414, mlcod=188'8410)", 2024-02-19T21:41:32.907 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:41:32.895309+0000", 2024-02-19T21:41:32.907 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.0021297180000000001, 2024-02-19T21:41:32.908 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.002234944, 2024-02-19T21:41:32.908 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:32.908 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "started", 2024-02-19T21:41:32.908 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:32.908 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.908 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:32.908 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.895309+0000", 2024-02-19T21:41:32.908 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:32.908 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.908 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.908 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:32.908 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.895309+0000", 2024-02-19T21:41:32.908 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:41:32.909 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.909 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.909 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:32.909 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.895308+0000", 2024-02-19T21:41:32.909 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.1640000000000001e-06 2024-02-19T21:41:32.909 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.909 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.909 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:32.909 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.895317+0000", 2024-02-19T21:41:32.909 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0818e-05 2024-02-19T21:41:32.909 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.909 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.909 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:32.909 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.895327+0000", 2024-02-19T21:41:32.909 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.1970000000000004e-06 2024-02-19T21:41:32.910 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.910 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.910 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:32.910 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.895333+0000", 2024-02-19T21:41:32.910 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0886999999999997e-05 2024-02-19T21:41:32.910 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.910 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.910 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:32.910 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.895373+0000", 2024-02-19T21:41:32.910 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.0916000000000001e-05 2024-02-19T21:41:32.910 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.910 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.910 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:32.910 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.895394+0000", 2024-02-19T21:41:32.911 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.4955000000000002e-05 2024-02-19T21:41:32.911 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:32.911 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:32.911 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:32.911 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.911 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.911 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_repop(client.24932.0:134177 8.e e188/165 8:73f53b36:::benchmark_data_smithi080_100924_object6459:head v 188'8484, mlcod=188'8482)", 2024-02-19T21:41:32.911 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:41:32.895345+0000", 2024-02-19T21:41:32.911 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.0020942719999999999, 2024-02-19T21:41:32.911 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.002234027, 2024-02-19T21:41:32.911 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:32.911 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "started", 2024-02-19T21:41:32.911 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:32.911 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.911 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:32.912 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.895345+0000", 2024-02-19T21:41:32.912 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:32.912 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.912 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.912 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:32.912 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.895345+0000", 2024-02-19T21:41:32.912 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:41:32.912 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.912 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.912 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:32.912 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.895345+0000", 2024-02-19T21:41:32.912 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.6519999999999997e-06 2024-02-19T21:41:32.912 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.912 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.913 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:32.913 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.895349+0000", 2024-02-19T21:41:32.913 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.1380000000000004e-06 2024-02-19T21:41:32.913 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.913 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.913 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:32.913 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.895355+0000", 2024-02-19T21:41:32.913 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.2209999999999999e-06 2024-02-19T21:41:32.913 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.913 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.913 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:32.913 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.895360+0000", 2024-02-19T21:41:32.913 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.9244000000000001e-05 2024-02-19T21:41:32.913 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.914 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.914 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:41:32.914 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.895459+0000", 2024-02-19T21:41:32.914 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.7181e-05 2024-02-19T21:41:32.914 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.914 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.914 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:41:32.914 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.895476+0000", 2024-02-19T21:41:32.914 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000131142 2024-02-19T21:41:32.914 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:32.914 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:32.914 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:32.914 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.915 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.915 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_repop(client.24932.0:134174 8.8 e188/165)", 2024-02-19T21:41:32.915 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:41:32.895374+0000", 2024-02-19T21:41:32.915 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.002064747, 2024-02-19T21:41:32.915 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0022385320000000001, 2024-02-19T21:41:32.915 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:41:32.915 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "queued for pg", 2024-02-19T21:41:32.915 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:41:32.915 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.915 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:41:32.915 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.895374+0000", 2024-02-19T21:41:32.915 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:41:32.915 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.915 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.916 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:41:32.916 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.895374+0000", 2024-02-19T21:41:32.916 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:41:32.916 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.916 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.916 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:41:32.916 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.895374+0000", 2024-02-19T21:41:32.916 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.5709999999999999e-06 2024-02-19T21:41:32.916 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.916 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.916 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:41:32.916 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.895379+0000", 2024-02-19T21:41:32.916 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.6109999999999999e-06 2024-02-19T21:41:32.916 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.917 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.917 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:41:32.917 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.895385+0000", 2024-02-19T21:41:32.917 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.9140000000000001e-06 2024-02-19T21:41:32.917 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:41:32.917 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:41:32.917 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:41:32.917 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:41:32.895389+0000", 2024-02-19T21:41:32.917 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.4708e-05 2024-02-19T21:41:32.917 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:32.917 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:41:32.917 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:32.917 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:41:32.917 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-02-19T21:41:32.918 INFO:teuthology.orchestra.run.smithi157.stdout: "num_ops": 5 2024-02-19T21:41:32.918 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:41:32.918 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:32.932 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:41:32.937 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:32.937 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:41:33.038 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:41:33.098 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:33.228 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:41:33.231 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:33.232 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:41:33.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:32.113900+0000 mon.a (mon.0) 1054 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:41:33.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:32.113930+0000 mon.a (mon.0) 1055 : cluster [INF] Cluster is now healthy 2024-02-19T21:41:33.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:32.127604+0000 mon.a (mon.0) 1056 : audit [INF] from='client.? 172.21.15.80:0/1896476580' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:41:33.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:32.127667+0000 mon.a (mon.0) 1057 : cluster [DBG] osdmap e188: 8 total, 8 up, 7 in 2024-02-19T21:41:33.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:32.573538+0000 osd.5 (osd.5) 169 : cluster [DBG] 5.1b scrub starts 2024-02-19T21:41:33.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:32.576691+0000 osd.5 (osd.5) 170 : cluster [DBG] 5.1b scrub ok 2024-02-19T21:41:33.333 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:41:33.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:32.113900+0000 mon.a (mon.0) 1054 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:41:33.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:32.113930+0000 mon.a (mon.0) 1055 : cluster [INF] Cluster is now healthy 2024-02-19T21:41:33.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:32.127604+0000 mon.a (mon.0) 1056 : audit [INF] from='client.? 172.21.15.80:0/1896476580' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:41:33.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:32.127667+0000 mon.a (mon.0) 1057 : cluster [DBG] osdmap e188: 8 total, 8 up, 7 in 2024-02-19T21:41:33.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:32.573538+0000 osd.5 (osd.5) 169 : cluster [DBG] 5.1b scrub starts 2024-02-19T21:41:33.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:32.576691+0000 osd.5 (osd.5) 170 : cluster [DBG] 5.1b scrub ok 2024-02-19T21:41:33.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:32.113900+0000 mon.a (mon.0) 1054 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:41:33.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:32.113930+0000 mon.a (mon.0) 1055 : cluster [INF] Cluster is now healthy 2024-02-19T21:41:33.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:32.127604+0000 mon.a (mon.0) 1056 : audit [INF] from='client.? 172.21.15.80:0/1896476580' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:41:33.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:32.127667+0000 mon.a (mon.0) 1057 : cluster [DBG] osdmap e188: 8 total, 8 up, 7 in 2024-02-19T21:41:33.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:32.573538+0000 osd.5 (osd.5) 169 : cluster [DBG] 5.1b scrub starts 2024-02-19T21:41:33.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:32.576691+0000 osd.5 (osd.5) 170 : cluster [DBG] 5.1b scrub ok 2024-02-19T21:41:33.403 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:33.769 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:41:33.775 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:33.775 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:41:33.792 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.7 dump_blocked_ops 2024-02-19T21:41:33.877 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:41:33.947 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:33.988 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:41:33.991 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:33.991 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:41:34.092 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:41:34.130 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:34.283 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:41:34.285 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:32.868037+0000 osd.4 (osd.4) 129 : cluster [DBG] 8.b scrub starts 2024-02-19T21:41:34.285 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:32.984980+0000 mgr.y (mgr.14514) 347 : cluster [DBG] pgmap v381: 148 pgs: 148 active+clean; 7.6 GiB data, 25 GiB used, 601 GiB / 626 GiB avail; 767 B/s rd, 29 MiB/s wr, 852 op/s 2024-02-19T21:41:34.286 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:33.953227+0000 mon.a (mon.0) 1058 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:41:34.286 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:34.287 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:41:34.287 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:32.868037+0000 osd.4 (osd.4) 129 : cluster [DBG] 8.b scrub starts 2024-02-19T21:41:34.287 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:32.984980+0000 mgr.y (mgr.14514) 347 : cluster [DBG] pgmap v381: 148 pgs: 148 active+clean; 7.6 GiB data, 25 GiB used, 601 GiB / 626 GiB avail; 767 B/s rd, 29 MiB/s wr, 852 op/s 2024-02-19T21:41:34.287 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:33.953227+0000 mon.a (mon.0) 1058 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:41:34.295 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:41:34.388 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:41:34.446 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:34.558 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:41:34.558 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:41:34.558 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:41:34.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:32.868037+0000 osd.4 (osd.4) 129 : cluster [DBG] 8.b scrub starts 2024-02-19T21:41:34.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:32.984980+0000 mgr.y (mgr.14514) 347 : cluster [DBG] pgmap v381: 148 pgs: 148 active+clean; 7.6 GiB data, 25 GiB used, 601 GiB / 626 GiB avail; 767 B/s rd, 29 MiB/s wr, 852 op/s 2024-02-19T21:41:34.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:33.953227+0000 mon.a (mon.0) 1058 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:41:34.566 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:41:34.578 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:41:34.582 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:34.583 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:41:34.598 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:41:34.623 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:41:34.659 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:41:34.684 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:41:34.694 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:41:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:41:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:41:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:41:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:41:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:41:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:41:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:41:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:41:34.732 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:34.760 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:41:34.765 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:34.765 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:41:34.866 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:41:34.938 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:35.299 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:41:35.306 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:35.306 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:41:35.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:34.432040+0000 mon.a (mon.0) 1059 : audit [DBG] from='client.? 172.21.15.80:0/95417728' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:41:35.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:34.432040+0000 mon.a (mon.0) 1059 : audit [DBG] from='client.? 172.21.15.80:0/95417728' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:41:35.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:34.432040+0000 mon.a (mon.0) 1059 : audit [DBG] from='client.? 172.21.15.80:0/95417728' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:41:35.407 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:41:35.466 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:35.621 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:41:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:41:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:41:35.673 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 6, 7] out_osds: [2] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:41:35.673 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:41:35.673 INFO:tasks.thrashosds.thrasher:Reweighting osd 3 to 0.41832630222901257 2024-02-19T21:41:35.673 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd reweight 3 0.41832630222901257 2024-02-19T21:41:36.033 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set noscrub 2024-02-19T21:41:36.067 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:41:36.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:34.985575+0000 mgr.y (mgr.14514) 348 : cluster [DBG] pgmap v382: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 7.4 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 1.4 KiB/s rd, 16 MiB/s wr, 1.11k op/s 2024-02-19T21:41:36.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:35.727656+0000 osd.6 (osd.6) 136 : cluster [DBG] 2.14 scrub starts 2024-02-19T21:41:36.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:35.735990+0000 osd.6 (osd.6) 137 : cluster [DBG] 2.14 scrub ok 2024-02-19T21:41:36.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:34.985575+0000 mgr.y (mgr.14514) 348 : cluster [DBG] pgmap v382: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 7.4 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 1.4 KiB/s rd, 16 MiB/s wr, 1.11k op/s 2024-02-19T21:41:36.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:35.727656+0000 osd.6 (osd.6) 136 : cluster [DBG] 2.14 scrub starts 2024-02-19T21:41:36.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:35.735990+0000 osd.6 (osd.6) 137 : cluster [DBG] 2.14 scrub ok 2024-02-19T21:41:36.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:34.985575+0000 mgr.y (mgr.14514) 348 : cluster [DBG] pgmap v382: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 7.4 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 1.4 KiB/s rd, 16 MiB/s wr, 1.11k op/s 2024-02-19T21:41:36.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:35.727656+0000 osd.6 (osd.6) 136 : cluster [DBG] 2.14 scrub starts 2024-02-19T21:41:36.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:35.735990+0000 osd.6 (osd.6) 137 : cluster [DBG] 2.14 scrub ok 2024-02-19T21:41:36.575 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:41:36.582 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:36.582 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:41:36.599 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:41:36.599 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:41:36.683 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:41:36.733 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:37.017 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:41:37.023 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:37.024 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:41:37.039 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:41:37.124 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:41:37.189 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:37.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:36.200213+0000 osd.4 (osd.4) 130 : cluster [DBG] 8.b scrub ok 2024-02-19T21:41:37.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:36.633676+0000 osd.0 (osd.0) 165 : cluster [DBG] 2.1 scrub starts 2024-02-19T21:41:37.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:36.635929+0000 osd.0 (osd.0) 166 : cluster [DBG] 2.1 scrub ok 2024-02-19T21:41:37.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:36.692259+0000 osd.6 (osd.6) 138 : cluster [DBG] 6.f scrub starts 2024-02-19T21:41:37.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:36.725657+0000 osd.6 (osd.6) 139 : cluster [DBG] 6.f scrub ok 2024-02-19T21:41:37.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:36.200213+0000 osd.4 (osd.4) 130 : cluster [DBG] 8.b scrub ok 2024-02-19T21:41:37.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:36.633676+0000 osd.0 (osd.0) 165 : cluster [DBG] 2.1 scrub starts 2024-02-19T21:41:37.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:36.635929+0000 osd.0 (osd.0) 166 : cluster [DBG] 2.1 scrub ok 2024-02-19T21:41:37.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:36.692259+0000 osd.6 (osd.6) 138 : cluster [DBG] 6.f scrub starts 2024-02-19T21:41:37.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:36.725657+0000 osd.6 (osd.6) 139 : cluster [DBG] 6.f scrub ok 2024-02-19T21:41:37.499 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:36.200213+0000 osd.4 (osd.4) 130 : cluster [DBG] 8.b scrub ok 2024-02-19T21:41:37.499 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:36.633676+0000 osd.0 (osd.0) 165 : cluster [DBG] 2.1 scrub starts 2024-02-19T21:41:37.499 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:36.635929+0000 osd.0 (osd.0) 166 : cluster [DBG] 2.1 scrub ok 2024-02-19T21:41:37.499 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:36.692259+0000 osd.6 (osd.6) 138 : cluster [DBG] 6.f scrub starts 2024-02-19T21:41:37.499 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:36.725657+0000 osd.6 (osd.6) 139 : cluster [DBG] 6.f scrub ok 2024-02-19T21:41:37.528 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.7 dump_historic_ops 2024-02-19T21:41:37.565 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:41:37.571 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:37.572 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:41:37.622 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:41:37.673 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:41:37.724 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:37.802 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:41:37.807 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:37.807 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:41:37.908 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:41:37.964 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:41:37.972 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:38.002 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:38.003 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:41:38.003 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:41:38.104 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:41:38.156 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:38.188 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:41:38.197 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:38.197 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:41:38.295 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:36.936639+0000 osd.7 (osd.7) 155 : cluster [DBG] 5.10 scrub starts 2024-02-19T21:41:38.295 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:36.941544+0000 osd.7 (osd.7) 156 : cluster [DBG] 5.10 scrub ok 2024-02-19T21:41:38.295 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:36.989622+0000 mgr.y (mgr.14514) 349 : cluster [DBG] pgmap v383: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 7.3 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 1.4 KiB/s rd, 16 MiB/s wr, 1.32k op/s 2024-02-19T21:41:38.298 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:41:38.367 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:38.387 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:41:38.393 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:38.393 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:41:38.494 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:41:38.525 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:36.936639+0000 osd.7 (osd.7) 155 : cluster [DBG] 5.10 scrub starts 2024-02-19T21:41:38.525 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:36.941544+0000 osd.7 (osd.7) 156 : cluster [DBG] 5.10 scrub ok 2024-02-19T21:41:38.525 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:36.989622+0000 mgr.y (mgr.14514) 349 : cluster [DBG] pgmap v383: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 7.3 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 1.4 KiB/s rd, 16 MiB/s wr, 1.32k op/s 2024-02-19T21:41:38.525 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:36.936639+0000 osd.7 (osd.7) 155 : cluster [DBG] 5.10 scrub starts 2024-02-19T21:41:38.525 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:36.941544+0000 osd.7 (osd.7) 156 : cluster [DBG] 5.10 scrub ok 2024-02-19T21:41:38.525 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:36.989622+0000 mgr.y (mgr.14514) 349 : cluster [DBG] pgmap v383: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 7.3 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 1.4 KiB/s rd, 16 MiB/s wr, 1.32k op/s 2024-02-19T21:41:38.533 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:39.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:38.691429+0000 osd.6 (osd.6) 140 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:41:39.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:38.697175+0000 osd.6 (osd.6) 141 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:41:39.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:38.877232+0000 osd.3 (osd.3) 167 : cluster [DBG] 8.0 scrub starts 2024-02-19T21:41:39.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:38.691429+0000 osd.6 (osd.6) 140 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:41:39.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:38.697175+0000 osd.6 (osd.6) 141 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:41:39.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:38.877232+0000 osd.3 (osd.3) 167 : cluster [DBG] 8.0 scrub starts 2024-02-19T21:41:39.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:38.691429+0000 osd.6 (osd.6) 140 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:41:39.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:38.697175+0000 osd.6 (osd.6) 141 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:41:39.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:38.877232+0000 osd.3 (osd.3) 167 : cluster [DBG] 8.0 scrub starts 2024-02-19T21:41:40.093 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:41:40.096 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:40.096 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:41:40.197 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:41:40.218 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:38.990009+0000 mgr.y (mgr.14514) 350 : cluster [DBG] pgmap v384: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 7.3 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 1.1 KiB/s rd, 13 MiB/s wr, 1.06k op/s 2024-02-19T21:41:40.271 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:40.312 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:41:40.317 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:41:40.317 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:41:40.320 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:40.321 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:41:40.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:38.990009+0000 mgr.y (mgr.14514) 350 : cluster [DBG] pgmap v384: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 7.3 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 1.1 KiB/s rd, 13 MiB/s wr, 1.06k op/s 2024-02-19T21:41:40.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:38.990009+0000 mgr.y (mgr.14514) 350 : cluster [DBG] pgmap v384: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 7.3 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 1.1 KiB/s rd, 13 MiB/s wr, 1.06k op/s 2024-02-19T21:41:40.421 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:41:40.475 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:41:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:41:40.479 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:40.773 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:41:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:41:40] "GET /metrics HTTP/1.1" 200 175853 "" "Prometheus/2.33.4" 2024-02-19T21:41:40.919 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:41:41.150 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:41:41.155 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:41.156 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:41:41.171 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_ops_in_flight 2024-02-19T21:41:41.247 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.3 to 0.418326 (6b17) 2024-02-19T21:41:41.249 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-02-19T21:41:41.257 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:41:41.345 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:41.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:40.312584+0000 mgr.y (mgr.14514) 351 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:41:41.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:40.900762+0000 osd.2 (osd.2) 117 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:41:41.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:40.900809+0000 osd.2 (osd.2) 118 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:41:41.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:41.017726+0000 mon.b (mon.1) 48 : audit [INF] from='client.? 172.21.15.80:0/2821736438' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 0.41832630222901257}]: dispatch 2024-02-19T21:41:41.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:41.018690+0000 mon.a (mon.0) 1060 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 0.41832630222901257}]: dispatch 2024-02-19T21:41:41.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:41.108862+0000 mon.a (mon.0) 1061 : audit [INF] from='client.? 172.21.15.80:0/3078109039' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:41:41.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:40.312584+0000 mgr.y (mgr.14514) 351 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:41:41.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:40.900762+0000 osd.2 (osd.2) 117 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:41:41.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:40.900809+0000 osd.2 (osd.2) 118 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:41:41.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:41.017726+0000 mon.b (mon.1) 48 : audit [INF] from='client.? 172.21.15.80:0/2821736438' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 0.41832630222901257}]: dispatch 2024-02-19T21:41:41.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:41.018690+0000 mon.a (mon.0) 1060 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 0.41832630222901257}]: dispatch 2024-02-19T21:41:41.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:41.108862+0000 mon.a (mon.0) 1061 : audit [INF] from='client.? 172.21.15.80:0/3078109039' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:41:41.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:40.312584+0000 mgr.y (mgr.14514) 351 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:41:41.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:40.900762+0000 osd.2 (osd.2) 117 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:41:41.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:40.900809+0000 osd.2 (osd.2) 118 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:41:41.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:41.017726+0000 mon.b (mon.1) 48 : audit [INF] from='client.? 172.21.15.80:0/2821736438' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 0.41832630222901257}]: dispatch 2024-02-19T21:41:41.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:41.018690+0000 mon.a (mon.0) 1060 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 0.41832630222901257}]: dispatch 2024-02-19T21:41:41.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:41.108862+0000 mon.a (mon.0) 1061 : audit [INF] from='client.? 172.21.15.80:0/3078109039' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:41:42.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:40.990778+0000 mgr.y (mgr.14514) 352 : cluster [DBG] pgmap v385: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 6.9 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 1.08k op/s 2024-02-19T21:41:42.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:41.222410+0000 mon.a (mon.0) 1062 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:41:42.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:41.233855+0000 mon.a (mon.0) 1063 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 0.41832630222901257}]': finished 2024-02-19T21:41:42.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:41.233937+0000 mon.a (mon.0) 1064 : audit [INF] from='client.? 172.21.15.80:0/3078109039' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:41:42.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:41.234020+0000 mon.a (mon.0) 1065 : cluster [DBG] osdmap e189: 8 total, 8 up, 7 in 2024-02-19T21:41:42.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:40.990778+0000 mgr.y (mgr.14514) 352 : cluster [DBG] pgmap v385: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 6.9 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 1.08k op/s 2024-02-19T21:41:42.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:41.222410+0000 mon.a (mon.0) 1062 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:41:42.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:41.233855+0000 mon.a (mon.0) 1063 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 0.41832630222901257}]': finished 2024-02-19T21:41:42.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:41.233937+0000 mon.a (mon.0) 1064 : audit [INF] from='client.? 172.21.15.80:0/3078109039' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:41:42.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:41.234020+0000 mon.a (mon.0) 1065 : cluster [DBG] osdmap e189: 8 total, 8 up, 7 in 2024-02-19T21:41:42.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:40.990778+0000 mgr.y (mgr.14514) 352 : cluster [DBG] pgmap v385: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 6.9 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 1.08k op/s 2024-02-19T21:41:42.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:41.222410+0000 mon.a (mon.0) 1062 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:41:42.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:41.233855+0000 mon.a (mon.0) 1063 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 0.41832630222901257}]': finished 2024-02-19T21:41:42.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:41.233937+0000 mon.a (mon.0) 1064 : audit [INF] from='client.? 172.21.15.80:0/3078109039' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:41:42.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:41.234020+0000 mon.a (mon.0) 1065 : cluster [DBG] osdmap e189: 8 total, 8 up, 7 in 2024-02-19T21:41:42.904 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:41:42.906 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:42.907 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:41:43.007 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:41:43.041 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:43.063 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:41:43.066 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:43.067 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:41:43.167 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:41:43.196 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:43.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:42.240518+0000 mon.a (mon.0) 1066 : cluster [DBG] osdmap e190: 8 total, 8 up, 7 in 2024-02-19T21:41:43.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:42.240518+0000 mon.a (mon.0) 1066 : cluster [DBG] osdmap e190: 8 total, 8 up, 7 in 2024-02-19T21:41:43.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:42.240518+0000 mon.a (mon.0) 1066 : cluster [DBG] osdmap e190: 8 total, 8 up, 7 in 2024-02-19T21:41:44.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:42.737716+0000 osd.7 (osd.7) 157 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:41:44.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:42.737791+0000 osd.7 (osd.7) 158 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:41:44.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:42.991266+0000 mgr.y (mgr.14514) 353 : cluster [DBG] pgmap v388: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 6.9 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 886 op/s 2024-02-19T21:41:44.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:43.245625+0000 mon.a (mon.0) 1067 : cluster [DBG] osdmap e191: 8 total, 8 up, 7 in 2024-02-19T21:41:44.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:43.251462+0000 osd.5 (osd.5) 171 : cluster [DBG] 8.8 starting backfill to osd.3 from (0'0,0'0] MAX to 188'8956 2024-02-19T21:41:44.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:42.737716+0000 osd.7 (osd.7) 157 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:41:44.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:42.737791+0000 osd.7 (osd.7) 158 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:41:44.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:42.991266+0000 mgr.y (mgr.14514) 353 : cluster [DBG] pgmap v388: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 6.9 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 886 op/s 2024-02-19T21:41:44.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:43.245625+0000 mon.a (mon.0) 1067 : cluster [DBG] osdmap e191: 8 total, 8 up, 7 in 2024-02-19T21:41:44.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:43.251462+0000 osd.5 (osd.5) 171 : cluster [DBG] 8.8 starting backfill to osd.3 from (0'0,0'0] MAX to 188'8956 2024-02-19T21:41:44.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:42.737716+0000 osd.7 (osd.7) 157 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:41:44.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:42.737791+0000 osd.7 (osd.7) 158 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:41:44.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:42.991266+0000 mgr.y (mgr.14514) 353 : cluster [DBG] pgmap v388: 148 pgs: 1 active+clean+scrubbing, 147 active+clean; 6.9 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 886 op/s 2024-02-19T21:41:44.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:43.245625+0000 mon.a (mon.0) 1067 : cluster [DBG] osdmap e191: 8 total, 8 up, 7 in 2024-02-19T21:41:44.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:43.251462+0000 osd.5 (osd.5) 171 : cluster [DBG] 8.8 starting backfill to osd.3 from (0'0,0'0] MAX to 188'8956 2024-02-19T21:41:44.775 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-19T21:41:45.739 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:41:45.739 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:41:45.739 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:41:45.739 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:41:45.739 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:41:45.740 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:41:45.740 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:41:45.740 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:41:45.740 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:41:45.740 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:41:45.740 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:41:45.740 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:41:45.740 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:41:45.740 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:41:45.740 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:41:45.741 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:41:46.057 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:41:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:41:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:41:46.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:44.992011+0000 mgr.y (mgr.14514) 354 : cluster [DBG] pgmap v390: 148 pgs: 1 active+remapped+backfilling, 1 active+clean+scrubbing, 146 active+clean; 6.8 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.22k op/s; 6962/336192 objects misplaced (2.071%); 117 KiB/s, 1 objects/s recovering 2024-02-19T21:41:46.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:45.060265+0000 mon.c (mon.2) 47 : audit [DBG] from='client.? 172.21.15.80:0/2619072830' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:41:46.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:44.992011+0000 mgr.y (mgr.14514) 354 : cluster [DBG] pgmap v390: 148 pgs: 1 active+remapped+backfilling, 1 active+clean+scrubbing, 146 active+clean; 6.8 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.22k op/s; 6962/336192 objects misplaced (2.071%); 117 KiB/s, 1 objects/s recovering 2024-02-19T21:41:46.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:45.060265+0000 mon.c (mon.2) 47 : audit [DBG] from='client.? 172.21.15.80:0/2619072830' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:41:46.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:44.992011+0000 mgr.y (mgr.14514) 354 : cluster [DBG] pgmap v390: 148 pgs: 1 active+remapped+backfilling, 1 active+clean+scrubbing, 146 active+clean; 6.8 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.22k op/s; 6962/336192 objects misplaced (2.071%); 117 KiB/s, 1 objects/s recovering 2024-02-19T21:41:46.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:45.060265+0000 mon.c (mon.2) 47 : audit [DBG] from='client.? 172.21.15.80:0/2619072830' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:41:47.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:45.925114+0000 osd.3 (osd.3) 168 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:41:47.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:45.925164+0000 osd.3 (osd.3) 169 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:41:47.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:46.040922+0000 osd.6 (osd.6) 142 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:41:47.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:46.040975+0000 osd.6 (osd.6) 143 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:41:47.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:46.264310+0000 mon.a (mon.0) 1068 : cluster [DBG] osdmap e192: 8 total, 8 up, 7 in 2024-02-19T21:41:47.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:45.925114+0000 osd.3 (osd.3) 168 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:41:47.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:45.925164+0000 osd.3 (osd.3) 169 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:41:47.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:46.040922+0000 osd.6 (osd.6) 142 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:41:47.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:46.040975+0000 osd.6 (osd.6) 143 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:41:47.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:46.264310+0000 mon.a (mon.0) 1068 : cluster [DBG] osdmap e192: 8 total, 8 up, 7 in 2024-02-19T21:41:47.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:45.925114+0000 osd.3 (osd.3) 168 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:41:47.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:45.925164+0000 osd.3 (osd.3) 169 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:41:47.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:46.040922+0000 osd.6 (osd.6) 142 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:41:47.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:46.040975+0000 osd.6 (osd.6) 143 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:41:47.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:46.264310+0000 mon.a (mon.0) 1068 : cluster [DBG] osdmap e192: 8 total, 8 up, 7 in 2024-02-19T21:41:48.359 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:41:48.363 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:48.363 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:41:48.370 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:41:48.464 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:41:48.530 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:48.553 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:41:48.559 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:48.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:46.992384+0000 mgr.y (mgr.14514) 355 : cluster [DBG] pgmap v392: 148 pgs: 1 active+remapped+backfilling, 147 active+clean; 6.8 GiB data, 22 GiB used, 603 GiB / 626 GiB avail; 888 B/s rd, 0 B/s wr, 492 op/s; 6962/333438 objects misplaced (2.088%); 122 KiB/s, 2 objects/s recovering 2024-02-19T21:41:48.560 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:41:48.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:46.992384+0000 mgr.y (mgr.14514) 355 : cluster [DBG] pgmap v392: 148 pgs: 1 active+remapped+backfilling, 147 active+clean; 6.8 GiB data, 22 GiB used, 603 GiB / 626 GiB avail; 888 B/s rd, 0 B/s wr, 492 op/s; 6962/333438 objects misplaced (2.088%); 122 KiB/s, 2 objects/s recovering 2024-02-19T21:41:48.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:46.992384+0000 mgr.y (mgr.14514) 355 : cluster [DBG] pgmap v392: 148 pgs: 1 active+remapped+backfilling, 147 active+clean; 6.8 GiB data, 22 GiB used, 603 GiB / 626 GiB avail; 888 B/s rd, 0 B/s wr, 492 op/s; 6962/333438 objects misplaced (2.088%); 122 KiB/s, 2 objects/s recovering 2024-02-19T21:41:48.660 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:41:48.718 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:48.756 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:41:48.760 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:48.760 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:41:48.861 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:41:48.913 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:49.817 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 6, 7] out_osds: [2] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:41:49.817 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:41:49.818 INFO:tasks.thrashosds.thrasher:Reweighting osd 7 to 0.4823920204948361 2024-02-19T21:41:49.818 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd reweight 7 0.4823920204948361 2024-02-19T21:41:50.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:48.960913+0000 mon.a (mon.0) 1069 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:41:50.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:48.992786+0000 mgr.y (mgr.14514) 356 : cluster [DBG] pgmap v393: 148 pgs: 1 active+remapped+backfilling, 147 active+clean; 6.8 GiB data, 22 GiB used, 603 GiB / 626 GiB avail; 758 B/s rd, 0 B/s wr, 420 op/s; 6962/333438 objects misplaced (2.088%); 104 KiB/s, 2 objects/s recovering 2024-02-19T21:41:50.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:48.960913+0000 mon.a (mon.0) 1069 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:41:50.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:48.992786+0000 mgr.y (mgr.14514) 356 : cluster [DBG] pgmap v393: 148 pgs: 1 active+remapped+backfilling, 147 active+clean; 6.8 GiB data, 22 GiB used, 603 GiB / 626 GiB avail; 758 B/s rd, 0 B/s wr, 420 op/s; 6962/333438 objects misplaced (2.088%); 104 KiB/s, 2 objects/s recovering 2024-02-19T21:41:50.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:48.960913+0000 mon.a (mon.0) 1069 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:41:50.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:48.992786+0000 mgr.y (mgr.14514) 356 : cluster [DBG] pgmap v393: 148 pgs: 1 active+remapped+backfilling, 147 active+clean; 6.8 GiB data, 22 GiB used, 603 GiB / 626 GiB avail; 758 B/s rd, 0 B/s wr, 420 op/s; 6962/333438 objects misplaced (2.088%); 104 KiB/s, 2 objects/s recovering 2024-02-19T21:41:50.777 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:41:50.788 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:50.789 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:41:50.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:41:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:41:50.889 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:41:50.943 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:50.980 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:48.991624+0000 osd.5 (osd.5) 172 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:41:50.981 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:48.991674+0000 osd.5 (osd.5) 173 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:41:50.981 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:50.002288+0000 mon.a (mon.0) 1070 : cluster [DBG] osdmap e193: 8 total, 8 up, 7 in 2024-02-19T21:41:50.981 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:50.326156+0000 mgr.y (mgr.14514) 357 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:41:50.981 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:41:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:41:50] "GET /metrics HTTP/1.1" 200 175879 "" "Prometheus/2.33.4" 2024-02-19T21:41:51.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:48.991624+0000 osd.5 (osd.5) 172 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:41:51.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:48.991674+0000 osd.5 (osd.5) 173 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:41:51.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:50.002288+0000 mon.a (mon.0) 1070 : cluster [DBG] osdmap e193: 8 total, 8 up, 7 in 2024-02-19T21:41:51.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:50.326156+0000 mgr.y (mgr.14514) 357 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:41:51.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:48.991624+0000 osd.5 (osd.5) 172 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:41:51.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:48.991674+0000 osd.5 (osd.5) 173 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:41:51.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:50.002288+0000 mon.a (mon.0) 1070 : cluster [DBG] osdmap e193: 8 total, 8 up, 7 in 2024-02-19T21:41:51.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:50.326156+0000 mgr.y (mgr.14514) 357 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:41:51.601 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:41:51.607 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:41:51.609 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:51.609 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:41:51.710 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:41:51.780 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:51.804 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:41:51.810 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:51.811 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:41:51.912 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:41:51.965 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:52.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:50.636355+0000 osd.1 (osd.1) 153 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:41:52.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:50.636411+0000 osd.1 (osd.1) 154 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:41:52.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:50.993345+0000 mgr.y (mgr.14514) 358 : cluster [DBG] pgmap v395: 148 pgs: 1 active+remapped+backfilling, 147 active+clean; 6.4 GiB data, 21 GiB used, 604 GiB / 626 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.06k op/s; 6596/317253 objects misplaced (2.079%); 570 KiB/s, 9 objects/s recovering 2024-02-19T21:41:52.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:50.996494+0000 mon.a (mon.0) 1071 : cluster [DBG] osdmap e194: 8 total, 8 up, 7 in 2024-02-19T21:41:52.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:50.636355+0000 osd.1 (osd.1) 153 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:41:52.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:50.636411+0000 osd.1 (osd.1) 154 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:41:52.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:50.993345+0000 mgr.y (mgr.14514) 358 : cluster [DBG] pgmap v395: 148 pgs: 1 active+remapped+backfilling, 147 active+clean; 6.4 GiB data, 21 GiB used, 604 GiB / 626 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.06k op/s; 6596/317253 objects misplaced (2.079%); 570 KiB/s, 9 objects/s recovering 2024-02-19T21:41:52.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:50.996494+0000 mon.a (mon.0) 1071 : cluster [DBG] osdmap e194: 8 total, 8 up, 7 in 2024-02-19T21:41:52.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:50.636355+0000 osd.1 (osd.1) 153 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:41:52.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:50.636411+0000 osd.1 (osd.1) 154 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:41:52.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:50.993345+0000 mgr.y (mgr.14514) 358 : cluster [DBG] pgmap v395: 148 pgs: 1 active+remapped+backfilling, 147 active+clean; 6.4 GiB data, 21 GiB used, 604 GiB / 626 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.06k op/s; 6596/317253 objects misplaced (2.079%); 570 KiB/s, 9 objects/s recovering 2024-02-19T21:41:52.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:50.996494+0000 mon.a (mon.0) 1071 : cluster [DBG] osdmap e194: 8 total, 8 up, 7 in 2024-02-19T21:41:53.638 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:41:53.722 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:41:53.723 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:41:53.728 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:53.728 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:41:53.829 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:41:53.881 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:53.911 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:41:53.915 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:53.916 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:41:54.017 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:41:54.076 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:54.311 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:52.993736+0000 mgr.y (mgr.14514) 359 : cluster [DBG] pgmap v397: 148 pgs: 1 active+remapped+backfilling, 147 active+clean; 6.4 GiB data, 21 GiB used, 604 GiB / 626 GiB avail; 760 B/s rd, 0 B/s wr, 802 op/s; 6596/317253 objects misplaced (2.079%); 552 KiB/s, 8 objects/s recovering 2024-02-19T21:41:54.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:52.993736+0000 mgr.y (mgr.14514) 359 : cluster [DBG] pgmap v397: 148 pgs: 1 active+remapped+backfilling, 147 active+clean; 6.4 GiB data, 21 GiB used, 604 GiB / 626 GiB avail; 760 B/s rd, 0 B/s wr, 802 op/s; 6596/317253 objects misplaced (2.079%); 552 KiB/s, 8 objects/s recovering 2024-02-19T21:41:54.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:52.993736+0000 mgr.y (mgr.14514) 359 : cluster [DBG] pgmap v397: 148 pgs: 1 active+remapped+backfilling, 147 active+clean; 6.4 GiB data, 21 GiB used, 604 GiB / 626 GiB avail; 760 B/s rd, 0 B/s wr, 802 op/s; 6596/317253 objects misplaced (2.079%); 552 KiB/s, 8 objects/s recovering 2024-02-19T21:41:54.865 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:41:54.870 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:54.871 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:41:54.972 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:41:55.030 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:55.075 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:41:55.082 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:55.083 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:41:55.183 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:41:55.258 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:55.302 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:41:55.306 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:55.306 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:41:55.407 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:41:55.473 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:55.511 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:41:55.515 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:55.515 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:41:55.616 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:41:55.670 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:56.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:41:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:41:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:41:56.069 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:54.994485+0000 mgr.y (mgr.14514) 360 : cluster [DBG] pgmap v398: 148 pgs: 1 active+remapped+backfilling, 147 active+clean; 6.2 GiB data, 21 GiB used, 605 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.14k op/s; 6198/306036 objects misplaced (2.025%); 928 KiB/s, 14 objects/s recovering 2024-02-19T21:41:56.069 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:55.806990+0000 mon.c (mon.2) 48 : audit [INF] from='client.? 172.21.15.80:0/2102629524' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:41:56.069 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:55.807529+0000 mon.a (mon.0) 1072 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:41:56.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:54.994485+0000 mgr.y (mgr.14514) 360 : cluster [DBG] pgmap v398: 148 pgs: 1 active+remapped+backfilling, 147 active+clean; 6.2 GiB data, 21 GiB used, 605 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.14k op/s; 6198/306036 objects misplaced (2.025%); 928 KiB/s, 14 objects/s recovering 2024-02-19T21:41:56.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:55.806990+0000 mon.c (mon.2) 48 : audit [INF] from='client.? 172.21.15.80:0/2102629524' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:41:56.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:55.807529+0000 mon.a (mon.0) 1072 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:41:56.070 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-02-19T21:41:56.128 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:41:56.136 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:56.136 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:41:56.237 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:41:56.285 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:56.318 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:41:56.322 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:56.322 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:41:56.423 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:41:56.470 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:56.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:54.994485+0000 mgr.y (mgr.14514) 360 : cluster [DBG] pgmap v398: 148 pgs: 1 active+remapped+backfilling, 147 active+clean; 6.2 GiB data, 21 GiB used, 605 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.14k op/s; 6198/306036 objects misplaced (2.025%); 928 KiB/s, 14 objects/s recovering 2024-02-19T21:41:56.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:55.806990+0000 mon.c (mon.2) 48 : audit [INF] from='client.? 172.21.15.80:0/2102629524' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:41:56.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:55.807529+0000 mon.a (mon.0) 1072 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:41:56.569 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:41:56.569 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-02-19T21:41:56.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.569 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.24932.0:155410 8.9 e194/165 8:9dd17e1f:::benchmark_data_smithi080_100924_object27692:head v 194'9499, mlcod=194'9497)", 2024-02-19T21:41:56.569 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:41:55.019128+0000", 2024-02-19T21:41:56.569 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0053288069999999996, 2024-02-19T21:41:56.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053568189999999996, 2024-02-19T21:41:56.569 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:41:56.569 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:41:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:41:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:41:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.019128+0000", 2024-02-19T21:41:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:41:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:41:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.019128+0000", 2024-02-19T21:41:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:41:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:41:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.019126+0000", 2024-02-19T21:41:56.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0536e-05 2024-02-19T21:41:56.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:41:56.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.019137+0000", 2024-02-19T21:41:56.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5437000000000001e-05 2024-02-19T21:41:56.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:41:56.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.019152+0000", 2024-02-19T21:41:56.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8949999999999998e-06 2024-02-19T21:41:56.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:41:56.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.019160+0000", 2024-02-19T21:41:56.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045848490000000002 2024-02-19T21:41:56.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:41:56.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.023745+0000", 2024-02-19T21:41:56.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8882999999999999e-05 2024-02-19T21:41:56.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:41:56.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.023764+0000", 2024-02-19T21:41:56.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046363109999999997 2024-02-19T21:41:56.572 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:41:56.572 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:41:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:41:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.24932.0:155405 8.2 e194/165 8:471368bb:::benchmark_data_smithi080_100924_object27687:head v 194'9549, mlcod=194'9546)", 2024-02-19T21:41:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:41:55.021127+0000", 2024-02-19T21:41:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.00332913, 2024-02-19T21:41:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00342603, 2024-02-19T21:41:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:41:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:41:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:41:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:41:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.021127+0000", 2024-02-19T21:41:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:41:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:41:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.021127+0000", 2024-02-19T21:41:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:41:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:41:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.021126+0000", 2024-02-19T21:41:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.927e-06 2024-02-19T21:41:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:41:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.021136+0000", 2024-02-19T21:41:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4768e-05 2024-02-19T21:41:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:41:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.021151+0000", 2024-02-19T21:41:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3539999999999996e-06 2024-02-19T21:41:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:41:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.021157+0000", 2024-02-19T21:41:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8836999999999999e-05 2024-02-19T21:41:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:41:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.021216+0000", 2024-02-19T21:41:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0299e-05 2024-02-19T21:41:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:41:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.021237+0000", 2024-02-19T21:41:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010914800000000001 2024-02-19T21:41:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:41:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:41:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:41:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:155415 8.6 8:6eb61479:::benchmark_data_smithi080_100924_object27697:head [delete] snapc 0=[] ondisk+write+known_if_redirected e194)", 2024-02-19T21:41:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:41:55.022929+0000", 2024-02-19T21:41:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0015278030000000001, 2024-02-19T21:41:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00168933, 2024-02-19T21:41:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:41:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:41:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:41:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:41:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:41:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 155415 2024-02-19T21:41:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:41:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:41:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.022929+0000", 2024-02-19T21:41:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:41:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:41:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.022929+0000", 2024-02-19T21:41:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:41:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:41:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.022927+0000", 2024-02-19T21:41:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1079999999999999e-06 2024-02-19T21:41:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:41:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.022936+0000", 2024-02-19T21:41:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5211000000000001e-05 2024-02-19T21:41:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:41:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.022951+0000", 2024-02-19T21:41:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8589999999999999e-06 2024-02-19T21:41:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:41:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.022958+0000", 2024-02-19T21:41:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8285999999999998e-05 2024-02-19T21:41:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:41:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.023006+0000", 2024-02-19T21:41:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000128558 2024-02-19T21:41:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:41:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.023135+0000", 2024-02-19T21:41:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013055200000000001 2024-02-19T21:41:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6,7", 2024-02-19T21:41:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.023265+0000", 2024-02-19T21:41:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000336652 2024-02-19T21:41:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:41:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:41:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:41:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.24932.0:155413 8.9 e194/165)", 2024-02-19T21:41:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:41:55.023244+0000", 2024-02-19T21:41:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0012126019999999999, 2024-02-19T21:41:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001445329, 2024-02-19T21:41:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:41:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "queued for pg", 2024-02-19T21:41:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:41:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:41:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.023244+0000", 2024-02-19T21:41:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:41:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:41:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.023244+0000", 2024-02-19T21:41:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:41:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:41:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.023243+0000", 2024-02-19T21:41:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0460000000000006e-06 2024-02-19T21:41:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:41:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.023251+0000", 2024-02-19T21:41:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0492999999999999e-05 2024-02-19T21:41:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:41:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.023262+0000", 2024-02-19T21:41:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1e-06 2024-02-19T21:41:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:41:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:41:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:41:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:41:55.023268+0000", 2024-02-19T21:41:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3676000000000002e-05 2024-02-19T21:41:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:41:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:41:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:41:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:41:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:41:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 4 2024-02-19T21:41:56.583 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:41:57.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:55.688072+0000 osd.4 (osd.4) 131 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:41:57.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:55.688123+0000 osd.4 (osd.4) 132 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:41:57.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:56.051087+0000 mon.a (mon.0) 1073 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:41:57.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:41:56.056006+0000 mon.a (mon.0) 1074 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:41:57.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:56.056415+0000 mon.a (mon.0) 1075 : cluster [DBG] osdmap e195: 8 total, 8 up, 7 in 2024-02-19T21:41:57.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:55.688072+0000 osd.4 (osd.4) 131 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:41:57.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:55.688123+0000 osd.4 (osd.4) 132 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:41:57.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:56.051087+0000 mon.a (mon.0) 1073 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:41:57.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:41:56.056006+0000 mon.a (mon.0) 1074 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:41:57.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:56.056415+0000 mon.a (mon.0) 1075 : cluster [DBG] osdmap e195: 8 total, 8 up, 7 in 2024-02-19T21:41:57.509 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_blocked_ops 2024-02-19T21:41:57.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:55.688072+0000 osd.4 (osd.4) 131 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:41:57.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:55.688123+0000 osd.4 (osd.4) 132 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:41:57.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:56.051087+0000 mon.a (mon.0) 1073 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:41:57.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:41:56.056006+0000 mon.a (mon.0) 1074 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:41:57.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:56.056415+0000 mon.a (mon.0) 1075 : cluster [DBG] osdmap e195: 8 total, 8 up, 7 in 2024-02-19T21:41:58.040 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:41:58.045 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:58.046 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:41:58.147 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:41:58.206 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:58.239 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:41:58.241 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:58.241 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:41:58.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:41:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:56.994925+0000 mgr.y (mgr.14514) 361 : cluster [DBG] pgmap v400: 148 pgs: 1 active+remapped+backfilling, 147 active+clean; 6.1 GiB data, 20 GiB used, 605 GiB / 626 GiB avail; 729 B/s rd, 0 B/s wr, 1.03k op/s; 6198/300894 objects misplaced (2.060%); 529 KiB/s, 8 objects/s recovering 2024-02-19T21:41:58.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:41:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:56.994925+0000 mgr.y (mgr.14514) 361 : cluster [DBG] pgmap v400: 148 pgs: 1 active+remapped+backfilling, 147 active+clean; 6.1 GiB data, 20 GiB used, 605 GiB / 626 GiB avail; 729 B/s rd, 0 B/s wr, 1.03k op/s; 6198/300894 objects misplaced (2.060%); 529 KiB/s, 8 objects/s recovering 2024-02-19T21:41:58.342 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:41:58.408 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:41:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:56.994925+0000 mgr.y (mgr.14514) 361 : cluster [DBG] pgmap v400: 148 pgs: 1 active+remapped+backfilling, 147 active+clean; 6.1 GiB data, 20 GiB used, 605 GiB / 626 GiB avail; 729 B/s rd, 0 B/s wr, 1.03k op/s; 6198/300894 objects misplaced (2.060%); 529 KiB/s, 8 objects/s recovering 2024-02-19T21:41:58.410 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:58.457 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:41:58.463 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:58.464 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:41:58.565 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:41:58.610 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:41:58.620 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:58.658 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:41:58.660 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:58.661 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:41:58.674 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:41:58.762 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:41:58.814 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:58.839 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:41:58.846 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:58.847 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:41:58.948 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:41:58.994 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:59.204 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:41:59.208 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:59.208 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:41:59.309 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:41:59.362 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:59.400 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:41:59.411 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:59.412 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:41:59.513 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:41:59.554 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:59.762 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:41:59.764 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:59.765 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:41:59.865 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:41:59.918 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:41:59.960 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:41:59.965 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:41:59.965 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:42:00.016 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset noscrub 2024-02-19T21:42:00.066 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:42:00.117 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:00.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:41:58.995463+0000 mgr.y (mgr.14514) 362 : cluster [DBG] pgmap v401: 148 pgs: 1 active+remapped+backfilling, 147 active+clean; 6.1 GiB data, 20 GiB used, 605 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 682 op/s; 6198/300894 objects misplaced (2.060%); 464 KiB/s, 7 objects/s recovering 2024-02-19T21:42:00.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:41:58.995463+0000 mgr.y (mgr.14514) 362 : cluster [DBG] pgmap v401: 148 pgs: 1 active+remapped+backfilling, 147 active+clean; 6.1 GiB data, 20 GiB used, 605 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 682 op/s; 6198/300894 objects misplaced (2.060%); 464 KiB/s, 7 objects/s recovering 2024-02-19T21:42:00.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:41:58.995463+0000 mgr.y (mgr.14514) 362 : cluster [DBG] pgmap v401: 148 pgs: 1 active+remapped+backfilling, 147 active+clean; 6.1 GiB data, 20 GiB used, 605 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 682 op/s; 6198/300894 objects misplaced (2.060%); 464 KiB/s, 7 objects/s recovering 2024-02-19T21:42:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:42:00.696 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:00.696 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:42:00.797 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:42:00.807 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:42:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:42:00.854 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:00.884 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:42:00.889 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:00.890 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:42:00.990 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:42:01.055 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:01.096 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:42:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:42:00] "GET /metrics HTTP/1.1" 200 175879 "" "Prometheus/2.33.4" 2024-02-19T21:42:01.103 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:42:01.112 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:01.112 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:42:01.213 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:42:01.260 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:01.345 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:42:01.365 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:01.365 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:42:01.466 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:42:01.502 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:00.340476+0000 mgr.y (mgr.14514) 363 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:42:01.503 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:01.504 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:00.340476+0000 mgr.y (mgr.14514) 363 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:42:01.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:00.340476+0000 mgr.y (mgr.14514) 363 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:42:02.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:00.996274+0000 mgr.y (mgr.14514) 364 : cluster [DBG] pgmap v402: 148 pgs: 1 active+remapped+backfilling, 147 active+clean; 5.8 GiB data, 19 GiB used, 606 GiB / 626 GiB avail; 1 KiB/s rd, 0 B/s wr, 1.08k op/s; 5838/284859 objects misplaced (2.049%); 742 KiB/s, 11 objects/s recovering 2024-02-19T21:42:02.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:01.223024+0000 osd.0 (osd.0) 167 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:42:02.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:01.223084+0000 osd.0 (osd.0) 168 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:42:02.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:00.996274+0000 mgr.y (mgr.14514) 364 : cluster [DBG] pgmap v402: 148 pgs: 1 active+remapped+backfilling, 147 active+clean; 5.8 GiB data, 19 GiB used, 606 GiB / 626 GiB avail; 1 KiB/s rd, 0 B/s wr, 1.08k op/s; 5838/284859 objects misplaced (2.049%); 742 KiB/s, 11 objects/s recovering 2024-02-19T21:42:02.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:01.223024+0000 osd.0 (osd.0) 167 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:42:02.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:01.223084+0000 osd.0 (osd.0) 168 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:42:02.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:00.996274+0000 mgr.y (mgr.14514) 364 : cluster [DBG] pgmap v402: 148 pgs: 1 active+remapped+backfilling, 147 active+clean; 5.8 GiB data, 19 GiB used, 606 GiB / 626 GiB avail; 1 KiB/s rd, 0 B/s wr, 1.08k op/s; 5838/284859 objects misplaced (2.049%); 742 KiB/s, 11 objects/s recovering 2024-02-19T21:42:02.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:01.223024+0000 osd.0 (osd.0) 167 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:42:02.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:01.223084+0000 osd.0 (osd.0) 168 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:42:02.746 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:42:02.751 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:42:02.760 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:02.760 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:42:02.815 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:42:02.844 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:42:02.861 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:42:02.869 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:42:02.894 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:42:02.914 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:02.922 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:42:02.948 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:42:02.953 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:02.953 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:42:02.961 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:42:02.999 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:42:03.025 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:42:03.029 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:42:03.029 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:42:03.029 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:42:03.029 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:42:03.029 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:42:03.029 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:42:03.029 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:42:03.030 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:42:03.054 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:42:03.099 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:03.151 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:42:03.156 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:03.156 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:42:03.207 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:02.179031+0000 mon.a (mon.0) 1076 : cluster [DBG] osdmap e196: 8 total, 8 up, 7 in 2024-02-19T21:42:03.207 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:02.302798+0000 mon.a (mon.0) 1077 : audit [INF] from='client.? 172.21.15.80:0/1767163268' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 0.4823920204948361}]: dispatch 2024-02-19T21:42:03.207 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:02.764471+0000 mon.a (mon.0) 1078 : audit [DBG] from='client.? 172.21.15.80:0/254097398' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:42:03.208 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.7 to 0.482392 (7b7e) 2024-02-19T21:42:03.257 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:42:03.293 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:03.319 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:02.179031+0000 mon.a (mon.0) 1076 : cluster [DBG] osdmap e196: 8 total, 8 up, 7 in 2024-02-19T21:42:03.319 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:02.302798+0000 mon.a (mon.0) 1077 : audit [INF] from='client.? 172.21.15.80:0/1767163268' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 0.4823920204948361}]: dispatch 2024-02-19T21:42:03.319 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:02.764471+0000 mon.a (mon.0) 1078 : audit [DBG] from='client.? 172.21.15.80:0/254097398' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:42:03.319 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:02.179031+0000 mon.a (mon.0) 1076 : cluster [DBG] osdmap e196: 8 total, 8 up, 7 in 2024-02-19T21:42:03.319 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:02.302798+0000 mon.a (mon.0) 1077 : audit [INF] from='client.? 172.21.15.80:0/1767163268' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 0.4823920204948361}]: dispatch 2024-02-19T21:42:03.319 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:02.764471+0000 mon.a (mon.0) 1078 : audit [DBG] from='client.? 172.21.15.80:0/254097398' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:42:04.343 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:42:04.350 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:04.351 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:42:04.451 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:42:04.475 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:02.996696+0000 mgr.y (mgr.14514) 365 : cluster [DBG] pgmap v404: 148 pgs: 1 active+remapped+backfilling, 147 active+clean; 5.8 GiB data, 19 GiB used, 606 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 882 op/s; 5838/284859 objects misplaced (2.049%); 464 KiB/s, 7 objects/s recovering 2024-02-19T21:42:04.475 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:03.187753+0000 mon.a (mon.0) 1079 : audit [INF] from='client.? 172.21.15.80:0/1767163268' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 0.4823920204948361}]': finished 2024-02-19T21:42:04.475 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:03.187830+0000 mon.a (mon.0) 1080 : cluster [DBG] osdmap e197: 8 total, 8 up, 7 in 2024-02-19T21:42:04.475 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:04.184708+0000 mon.a (mon.0) 1081 : cluster [DBG] osdmap e198: 8 total, 8 up, 7 in 2024-02-19T21:42:04.477 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:04.496 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:42:04.499 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:04.499 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:42:04.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:02.996696+0000 mgr.y (mgr.14514) 365 : cluster [DBG] pgmap v404: 148 pgs: 1 active+remapped+backfilling, 147 active+clean; 5.8 GiB data, 19 GiB used, 606 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 882 op/s; 5838/284859 objects misplaced (2.049%); 464 KiB/s, 7 objects/s recovering 2024-02-19T21:42:04.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:03.187753+0000 mon.a (mon.0) 1079 : audit [INF] from='client.? 172.21.15.80:0/1767163268' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 0.4823920204948361}]': finished 2024-02-19T21:42:04.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:03.187830+0000 mon.a (mon.0) 1080 : cluster [DBG] osdmap e197: 8 total, 8 up, 7 in 2024-02-19T21:42:04.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:04.184708+0000 mon.a (mon.0) 1081 : cluster [DBG] osdmap e198: 8 total, 8 up, 7 in 2024-02-19T21:42:04.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:02.996696+0000 mgr.y (mgr.14514) 365 : cluster [DBG] pgmap v404: 148 pgs: 1 active+remapped+backfilling, 147 active+clean; 5.8 GiB data, 19 GiB used, 606 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 882 op/s; 5838/284859 objects misplaced (2.049%); 464 KiB/s, 7 objects/s recovering 2024-02-19T21:42:04.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:03.187753+0000 mon.a (mon.0) 1079 : audit [INF] from='client.? 172.21.15.80:0/1767163268' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 0.4823920204948361}]': finished 2024-02-19T21:42:04.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:03.187830+0000 mon.a (mon.0) 1080 : cluster [DBG] osdmap e197: 8 total, 8 up, 7 in 2024-02-19T21:42:04.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:04.184708+0000 mon.a (mon.0) 1081 : cluster [DBG] osdmap e198: 8 total, 8 up, 7 in 2024-02-19T21:42:04.601 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:42:04.627 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:42:04.753 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:04.753 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:42:04.855 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:42:04.881 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:05.030 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:42:05.033 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:05.033 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:42:05.036 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:42:05.036 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:42:05.135 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:42:05.160 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:05.178 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:42:05.180 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:05.181 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:42:05.282 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:42:05.365 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:05.416 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:42:05.422 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:05.423 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:42:05.523 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:42:05.574 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:05.735 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:42:05.741 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:05.741 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:42:05.808 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:42:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:42:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:42:05.842 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:42:05.879 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:06.011 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:42:06.017 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:06.017 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:42:06.118 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:42:06.185 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:06.188 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:04.997264+0000 mgr.y (mgr.14514) 366 : cluster [DBG] pgmap v407: 148 pgs: 2 remapped+peering, 1 active+remapped+backfilling, 2 active+recovering, 143 active+clean; 5.6 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.30k op/s; 5566/277500 objects misplaced (2.006%); 1.2 MiB/s, 22 objects/s recovering 2024-02-19T21:42:06.188 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:05.185214+0000 osd.4 (osd.4) 133 : cluster [DBG] 8.b starting backfill to osd.0 from (0'0,0'0] MAX to 196'10276 2024-02-19T21:42:06.189 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:05.185488+0000 mon.a (mon.0) 1082 : cluster [DBG] osdmap e199: 8 total, 8 up, 7 in 2024-02-19T21:42:06.189 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:05.186820+0000 osd.0 (osd.0) 169 : cluster [DBG] 8.c starting backfill to osd.5 from (0'0,0'0] MAX to 196'10373 2024-02-19T21:42:06.189 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:05.188912+0000 osd.5 (osd.5) 174 : cluster [DBG] 8.d starting backfill to osd.1 from (0'0,0'0] MAX to 196'10066 2024-02-19T21:42:06.223 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:42:06.229 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:06.230 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:42:06.331 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:42:06.384 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:06.432 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:42:06.441 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:06.442 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:42:06.442 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:04.997264+0000 mgr.y (mgr.14514) 366 : cluster [DBG] pgmap v407: 148 pgs: 2 remapped+peering, 1 active+remapped+backfilling, 2 active+recovering, 143 active+clean; 5.6 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.30k op/s; 5566/277500 objects misplaced (2.006%); 1.2 MiB/s, 22 objects/s recovering 2024-02-19T21:42:06.443 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:05.185214+0000 osd.4 (osd.4) 133 : cluster [DBG] 8.b starting backfill to osd.0 from (0'0,0'0] MAX to 196'10276 2024-02-19T21:42:06.443 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:05.185488+0000 mon.a (mon.0) 1082 : cluster [DBG] osdmap e199: 8 total, 8 up, 7 in 2024-02-19T21:42:06.443 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:05.186820+0000 osd.0 (osd.0) 169 : cluster [DBG] 8.c starting backfill to osd.5 from (0'0,0'0] MAX to 196'10373 2024-02-19T21:42:06.443 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:05.188912+0000 osd.5 (osd.5) 174 : cluster [DBG] 8.d starting backfill to osd.1 from (0'0,0'0] MAX to 196'10066 2024-02-19T21:42:06.543 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:42:06.571 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:04.997264+0000 mgr.y (mgr.14514) 366 : cluster [DBG] pgmap v407: 148 pgs: 2 remapped+peering, 1 active+remapped+backfilling, 2 active+recovering, 143 active+clean; 5.6 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.30k op/s; 5566/277500 objects misplaced (2.006%); 1.2 MiB/s, 22 objects/s recovering 2024-02-19T21:42:06.571 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:05.185214+0000 osd.4 (osd.4) 133 : cluster [DBG] 8.b starting backfill to osd.0 from (0'0,0'0] MAX to 196'10276 2024-02-19T21:42:06.571 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:05.185488+0000 mon.a (mon.0) 1082 : cluster [DBG] osdmap e199: 8 total, 8 up, 7 in 2024-02-19T21:42:06.571 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:05.186820+0000 osd.0 (osd.0) 169 : cluster [DBG] 8.c starting backfill to osd.5 from (0'0,0'0] MAX to 196'10373 2024-02-19T21:42:06.571 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:05.188912+0000 osd.5 (osd.5) 174 : cluster [DBG] 8.d starting backfill to osd.1 from (0'0,0'0] MAX to 196'10066 2024-02-19T21:42:06.597 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_historic_ops 2024-02-19T21:42:06.612 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:06.644 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:42:06.649 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:06.650 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:42:06.751 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:42:06.806 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:07.014 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:42:07.020 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:07.020 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:42:07.121 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:42:07.172 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:07.222 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:42:07.225 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:07.225 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:42:07.326 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:42:07.361 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:07.400 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:42:07.406 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:07.407 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:42:07.507 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:42:07.550 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:07.706 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:42:07.711 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:07.712 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:42:07.813 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:42:07.873 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:07.923 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:42:07.928 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:07.928 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:42:08.029 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:42:08.083 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:08.115 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:42:08.120 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:08.120 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:42:08.121 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:42:08.221 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:42:08.272 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:08.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:06.997678+0000 mgr.y (mgr.14514) 367 : cluster [DBG] pgmap v409: 148 pgs: 3 remapped+peering, 1 active+remapped+backfilling, 3 active+recovering, 141 active+clean; 5.6 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 724 op/s; 5570/274398 objects misplaced (2.030%); 731 KiB/s, 19 objects/s recovering 2024-02-19T21:42:08.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:06.997678+0000 mgr.y (mgr.14514) 367 : cluster [DBG] pgmap v409: 148 pgs: 3 remapped+peering, 1 active+remapped+backfilling, 3 active+recovering, 141 active+clean; 5.6 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 724 op/s; 5570/274398 objects misplaced (2.030%); 731 KiB/s, 19 objects/s recovering 2024-02-19T21:42:08.493 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:42:08.497 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:08.497 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:42:08.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:06.997678+0000 mgr.y (mgr.14514) 367 : cluster [DBG] pgmap v409: 148 pgs: 3 remapped+peering, 1 active+remapped+backfilling, 3 active+recovering, 141 active+clean; 5.6 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 724 op/s; 5570/274398 objects misplaced (2.030%); 731 KiB/s, 19 objects/s recovering 2024-02-19T21:42:08.597 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:42:08.639 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:08.701 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:42:08.707 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:08.708 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:42:08.809 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:42:08.907 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:08.945 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:42:08.948 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:08.949 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:42:09.049 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:42:09.085 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:09.118 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:42:09.123 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:09.124 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:42:09.218 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:08.350452+0000 mon.c (mon.2) 49 : audit [INF] from='client.? 172.21.15.80:0/3198680520' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:42:09.218 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:08.351230+0000 mon.a (mon.0) 1083 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:42:09.224 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-02-19T21:42:09.225 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:42:09.305 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:09.341 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:42:09.345 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:09.345 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:42:09.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:08.350452+0000 mon.c (mon.2) 49 : audit [INF] from='client.? 172.21.15.80:0/3198680520' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:42:09.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:08.351230+0000 mon.a (mon.0) 1083 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:42:09.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:08.350452+0000 mon.c (mon.2) 49 : audit [INF] from='client.? 172.21.15.80:0/3198680520' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:42:09.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:08.351230+0000 mon.a (mon.0) 1083 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:42:09.417 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:42:09.446 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:42:09.520 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:09.758 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 6, 7] out_osds: [2] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:42:09.758 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:42:09.758 INFO:tasks.thrashosds.thrasher:Shrinking pool default.rgw.meta 2024-02-19T21:42:09.758 INFO:tasks.cephadm.ceph_manager.ceph:contract_pool default.rgw.meta by 10 min 8 2024-02-19T21:42:09.759 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:42:10.391 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:42:10.396 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:10.396 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:42:10.497 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:42:10.540 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:08.998076+0000 mgr.y (mgr.14514) 368 : cluster [DBG] pgmap v410: 148 pgs: 3 remapped+peering, 1 active+remapped+backfilling, 3 active+recovering, 141 active+clean; 5.6 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 581 op/s; 5570/274398 objects misplaced (2.030%); 587 KiB/s, 15 objects/s recovering 2024-02-19T21:42:10.540 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:09.198676+0000 mon.a (mon.0) 1084 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:42:10.540 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:09.215202+0000 mon.a (mon.0) 1085 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:42:10.540 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:09.215250+0000 mon.a (mon.0) 1086 : cluster [DBG] osdmap e200: 8 total, 8 up, 7 in 2024-02-19T21:42:10.541 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:08.998076+0000 mgr.y (mgr.14514) 368 : cluster [DBG] pgmap v410: 148 pgs: 3 remapped+peering, 1 active+remapped+backfilling, 3 active+recovering, 141 active+clean; 5.6 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 581 op/s; 5570/274398 objects misplaced (2.030%); 587 KiB/s, 15 objects/s recovering 2024-02-19T21:42:10.541 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:09.198676+0000 mon.a (mon.0) 1084 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:42:10.541 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:09.215202+0000 mon.a (mon.0) 1085 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:42:10.541 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:09.215250+0000 mon.a (mon.0) 1086 : cluster [DBG] osdmap e200: 8 total, 8 up, 7 in 2024-02-19T21:42:10.543 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:10.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:08.998076+0000 mgr.y (mgr.14514) 368 : cluster [DBG] pgmap v410: 148 pgs: 3 remapped+peering, 1 active+remapped+backfilling, 3 active+recovering, 141 active+clean; 5.6 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 581 op/s; 5570/274398 objects misplaced (2.030%); 587 KiB/s, 15 objects/s recovering 2024-02-19T21:42:10.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:09.198676+0000 mon.a (mon.0) 1084 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:42:10.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:09.215202+0000 mon.a (mon.0) 1085 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:42:10.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:09.215250+0000 mon.a (mon.0) 1086 : cluster [DBG] osdmap e200: 8 total, 8 up, 7 in 2024-02-19T21:42:10.558 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:42:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:42:10.612 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:42:10.617 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:10.618 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:42:10.719 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:42:10.766 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:10.786 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:42:10.787 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:42:10.787 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:42:10.798 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:42:10.801 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:10.801 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:42:10.809 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:42:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:42:10] "GET /metrics HTTP/1.1" 200 175899 "" "Prometheus/2.33.4" 2024-02-19T21:42:10.902 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:42:10.969 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:11.021 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:42:11.026 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:11.026 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:42:11.127 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:42:11.197 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:11.224 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:42:11.228 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:11.229 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:42:11.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:10.350588+0000 mgr.y (mgr.14514) 369 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:42:11.330 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:42:11.370 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:11.434 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:42:11.438 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:11.439 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:42:11.540 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:42:11.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:10.350588+0000 mgr.y (mgr.14514) 369 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:42:11.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:10.350588+0000 mgr.y (mgr.14514) 369 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:42:11.631 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:11.664 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:42:11.667 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:11.668 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:42:11.769 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:42:11.811 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:12.524 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:10.998767+0000 mgr.y (mgr.14514) 370 : cluster [DBG] pgmap v412: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 5.3 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.18k op/s; 20442/260832 objects misplaced (7.837%); 12 MiB/s, 191 objects/s recovering 2024-02-19T21:42:12.525 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:10.998767+0000 mgr.y (mgr.14514) 370 : cluster [DBG] pgmap v412: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 5.3 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.18k op/s; 20442/260832 objects misplaced (7.837%); 12 MiB/s, 191 objects/s recovering 2024-02-19T21:42:12.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:10.998767+0000 mgr.y (mgr.14514) 370 : cluster [DBG] pgmap v412: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 5.3 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.18k op/s; 20442/260832 objects misplaced (7.837%); 12 MiB/s, 191 objects/s recovering 2024-02-19T21:42:13.460 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-19T21:42:14.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:12.999169+0000 mgr.y (mgr.14514) 371 : cluster [DBG] pgmap v413: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 5.3 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 511 B/s rd, 0 B/s wr, 694 op/s; 20442/260832 objects misplaced (7.837%); 9.4 MiB/s, 153 objects/s recovering 2024-02-19T21:42:14.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:12.999169+0000 mgr.y (mgr.14514) 371 : cluster [DBG] pgmap v413: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 5.3 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 511 B/s rd, 0 B/s wr, 694 op/s; 20442/260832 objects misplaced (7.837%); 9.4 MiB/s, 153 objects/s recovering 2024-02-19T21:42:14.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:12.999169+0000 mgr.y (mgr.14514) 371 : cluster [DBG] pgmap v413: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 5.3 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 511 B/s rd, 0 B/s wr, 694 op/s; 20442/260832 objects misplaced (7.837%); 9.4 MiB/s, 153 objects/s recovering 2024-02-19T21:42:16.057 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:42:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:42:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:42:16.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:14.999888+0000 mgr.y (mgr.14514) 372 : cluster [DBG] pgmap v414: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 5.1 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 938 B/s rd, 0 B/s wr, 797 op/s; 18808/250935 objects misplaced (7.495%); 13 MiB/s, 204 objects/s recovering 2024-02-19T21:42:16.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:14.999888+0000 mgr.y (mgr.14514) 372 : cluster [DBG] pgmap v414: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 5.1 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 938 B/s rd, 0 B/s wr, 797 op/s; 18808/250935 objects misplaced (7.495%); 13 MiB/s, 204 objects/s recovering 2024-02-19T21:42:16.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:14.999888+0000 mgr.y (mgr.14514) 372 : cluster [DBG] pgmap v414: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 5.1 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 938 B/s rd, 0 B/s wr, 797 op/s; 18808/250935 objects misplaced (7.495%); 13 MiB/s, 204 objects/s recovering 2024-02-19T21:42:18.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:17.000432+0000 mgr.y (mgr.14514) 373 : cluster [DBG] pgmap v415: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 5.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 921 B/s rd, 0 B/s wr, 926 op/s; 18053/246621 objects misplaced (7.320%); 16 MiB/s, 250 objects/s recovering 2024-02-19T21:42:18.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:17.000432+0000 mgr.y (mgr.14514) 373 : cluster [DBG] pgmap v415: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 5.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 921 B/s rd, 0 B/s wr, 926 op/s; 18053/246621 objects misplaced (7.320%); 16 MiB/s, 250 objects/s recovering 2024-02-19T21:42:18.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:17.000432+0000 mgr.y (mgr.14514) 373 : cluster [DBG] pgmap v415: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 5.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 921 B/s rd, 0 B/s wr, 926 op/s; 18053/246621 objects misplaced (7.320%); 16 MiB/s, 250 objects/s recovering 2024-02-19T21:42:19.078 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:42:19.085 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:19.085 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:42:19.105 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.1 dump_ops_in_flight 2024-02-19T21:42:19.186 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:42:19.249 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:19.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:18.758952+0000 mon.a (mon.0) 1087 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:42:19.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:19.243067+0000 mon.a (mon.0) 1088 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:42:19.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:19.248871+0000 mon.a (mon.0) 1089 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:42:19.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:18.758952+0000 mon.a (mon.0) 1087 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:42:19.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:19.243067+0000 mon.a (mon.0) 1088 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:42:19.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:19.248871+0000 mon.a (mon.0) 1089 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:42:19.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:18.758952+0000 mon.a (mon.0) 1087 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:42:19.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:19.243067+0000 mon.a (mon.0) 1088 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:42:19.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:19.248871+0000 mon.a (mon.0) 1089 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:42:20.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:19.000776+0000 mgr.y (mgr.14514) 374 : cluster [DBG] pgmap v416: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 5.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 921 B/s rd, 0 B/s wr, 926 op/s; 18053/246621 objects misplaced (7.320%); 16 MiB/s, 250 objects/s recovering 2024-02-19T21:42:20.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:19.262349+0000 mon.a (mon.0) 1090 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:42:20.558 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:42:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:42:20.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:19.000776+0000 mgr.y (mgr.14514) 374 : cluster [DBG] pgmap v416: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 5.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 921 B/s rd, 0 B/s wr, 926 op/s; 18053/246621 objects misplaced (7.320%); 16 MiB/s, 250 objects/s recovering 2024-02-19T21:42:20.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:19.262349+0000 mon.a (mon.0) 1090 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:42:20.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:19.000776+0000 mgr.y (mgr.14514) 374 : cluster [DBG] pgmap v416: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 5.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 921 B/s rd, 0 B/s wr, 926 op/s; 18053/246621 objects misplaced (7.320%); 16 MiB/s, 250 objects/s recovering 2024-02-19T21:42:20.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:19.262349+0000 mon.a (mon.0) 1090 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:42:20.902 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:42:20.915 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:20.916 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:42:21.017 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:42:21.067 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:21.097 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:42:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:42:20] "GET /metrics HTTP/1.1" 200 175924 "" "Prometheus/2.33.4" 2024-02-19T21:42:21.120 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:42:21.125 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:21.126 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:42:21.227 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:42:21.297 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:21.328 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:20.362655+0000 mgr.y (mgr.14514) 375 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:42:21.330 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:42:21.333 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:21.334 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:42:21.435 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:42:21.476 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:21.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:20.362655+0000 mgr.y (mgr.14514) 375 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:42:21.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:20.362655+0000 mgr.y (mgr.14514) 375 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:42:21.684 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:42:21.690 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:21.691 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:42:21.791 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:42:21.846 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:21.871 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:42:21.874 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:21.875 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:42:21.976 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:42:22.006 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:42:22.008 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:42:22.032 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:22.059 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:42:22.061 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:22.062 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:42:22.163 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:42:22.211 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:22.321 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:21.001572+0000 mgr.y (mgr.14514) 376 : cluster [DBG] pgmap v417: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 4.7 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s; 15716/232317 objects misplaced (6.765%); 20 MiB/s, 322 objects/s recovering 2024-02-19T21:42:22.340 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:42:22.354 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:42:22.484 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:42:22.490 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:22.490 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:42:22.591 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:42:22.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:21.001572+0000 mgr.y (mgr.14514) 376 : cluster [DBG] pgmap v417: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 4.7 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s; 15716/232317 objects misplaced (6.765%); 20 MiB/s, 322 objects/s recovering 2024-02-19T21:42:22.647 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:21.001572+0000 mgr.y (mgr.14514) 376 : cluster [DBG] pgmap v417: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 4.7 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s; 15716/232317 objects misplaced (6.765%); 20 MiB/s, 322 objects/s recovering 2024-02-19T21:42:22.655 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:22.733 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:42:22.737 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:22.738 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:42:22.839 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:42:22.909 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:22.945 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:42:22.949 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:22.949 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:42:23.050 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:42:23.118 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:23.145 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:42:23.151 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:23.151 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:42:23.252 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:42:23.296 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:23.325 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:42:23.331 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:23.332 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:42:23.433 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:42:23.475 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:23.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:22.318001+0000 mgr.y (mgr.14514) 377 : audit [DBG] from='client.24919 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:42:23.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:22.318001+0000 mgr.y (mgr.14514) 377 : audit [DBG] from='client.24919 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:42:23.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:22.318001+0000 mgr.y (mgr.14514) 377 : audit [DBG] from='client.24919 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:42:24.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:23.001962+0000 mgr.y (mgr.14514) 378 : cluster [DBG] pgmap v418: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 4.7 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 792 op/s; 15716/232317 objects misplaced (6.765%); 13 MiB/s, 215 objects/s recovering 2024-02-19T21:42:24.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:23.001962+0000 mgr.y (mgr.14514) 378 : cluster [DBG] pgmap v418: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 4.7 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 792 op/s; 15716/232317 objects misplaced (6.765%); 13 MiB/s, 215 objects/s recovering 2024-02-19T21:42:24.741 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":417,"stamp":"2024-02-19T21:42:21.000926+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5062399676,"num_objects":77439,"num_object_clones":0,"num_object_copies":232317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":15716,"num_objects_unfound":0,"num_objects_dirty":77439,"num_whiteouts":0,"num_read":1288,"num_read_kb":1040,"num_write":178613,"num_write_kb":8173802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4230,"num_bytes_recovered":264311408,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74552,"ondisk_log_size":74552,"up":444,"acting":444,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":448,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":656216064,"kb_used":17335288,"kb_used_data":15192960,"kb_used_omap":0,"kb_used_meta":2141952,"kb_avail":638880776,"statfs":{"total":671965249536,"available":654213914624,"internally_reserved":0,"allocated":15557591040,"data_stored":15555409828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2193358848},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-919273472,"num_objects":-14027,"num_object_clones":0,"num_object_copies":-42081,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":10146,"num_objects_unfound":0,"num_objects_dirty":-14027,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":14027,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3800,"num_bytes_recovered":248578158,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.789499"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":17,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.204594+0000","last_change":"2024-02-19T21:42:04.194214+0000","last_active":"2024-02-19T21:42:05.204594+0000","last_peered":"2024-02-19T21:42:05.204594+0000","last_clean":"2024-02-19T21:42:05.204594+0000","last_became_active":"2024-02-19T21:42:04.194009+0000","last_became_peered":"2024-02-19T21:42:04.194009+0000","last_unstale":"2024-02-19T21:42:05.204594+0000","last_undegraded":"2024-02-19T21:42:05.204594+0000","last_fullsized":"2024-02-19T21:42:05.204594+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:12.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:12.925421+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":126,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.203423+0000","last_change":"2024-02-19T21:40:23.364671+0000","last_active":"2024-02-19T21:42:05.203423+0000","last_peered":"2024-02-19T21:42:05.203423+0000","last_clean":"2024-02-19T21:42:05.203423+0000","last_became_active":"2024-02-19T21:35:14.511920+0000","last_became_peered":"2024-02-19T21:35:14.511920+0000","last_unstale":"2024-02-19T21:42:05.203423+0000","last_undegraded":"2024-02-19T21:42:05.203423+0000","last_fullsized":"2024-02-19T21:42:05.203423+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:23.364579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:23.364579+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":170,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.186569+0000","last_change":"2024-02-19T21:40:28.473842+0000","last_active":"2024-02-19T21:42:05.186569+0000","last_peered":"2024-02-19T21:42:05.186569+0000","last_clean":"2024-02-19T21:42:05.186569+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:42:05.186569+0000","last_undegraded":"2024-02-19T21:42:05.186569+0000","last_fullsized":"2024-02-19T21:42:05.186569+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:28.473778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:28.473778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"66'15","reported_seq":124,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.185516+0000","last_change":"2024-02-19T21:39:51.546188+0000","last_active":"2024-02-19T21:42:05.185516+0000","last_peered":"2024-02-19T21:42:05.185516+0000","last_clean":"2024-02-19T21:42:05.185516+0000","last_became_active":"2024-02-19T21:39:51.536424+0000","last_became_peered":"2024-02-19T21:39:51.536424+0000","last_unstale":"2024-02-19T21:42:05.185516+0000","last_undegraded":"2024-02-19T21:42:05.185516+0000","last_fullsized":"2024-02-19T21:42:05.185516+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:39:29.269819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:29.269819+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":124,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.187758+0000","last_change":"2024-02-19T21:39:29.064310+0000","last_active":"2024-02-19T21:42:05.187758+0000","last_peered":"2024-02-19T21:42:05.187758+0000","last_clean":"2024-02-19T21:42:05.187758+0000","last_became_active":"2024-02-19T21:35:14.517794+0000","last_became_peered":"2024-02-19T21:35:14.517794+0000","last_unstale":"2024-02-19T21:42:05.187758+0000","last_undegraded":"2024-02-19T21:42:05.187758+0000","last_fullsized":"2024-02-19T21:42:05.187758+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:29.064185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:29.064185+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":170,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.196987+0000","last_change":"2024-02-19T21:42:04.201771+0000","last_active":"2024-02-19T21:42:05.196987+0000","last_peered":"2024-02-19T21:42:05.196987+0000","last_clean":"2024-02-19T21:42:05.196987+0000","last_became_active":"2024-02-19T21:42:04.201530+0000","last_became_peered":"2024-02-19T21:42:04.201530+0000","last_unstale":"2024-02-19T21:42:05.196987+0000","last_undegraded":"2024-02-19T21:42:05.196987+0000","last_fullsized":"2024-02-19T21:42:05.196987+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:25.265482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:25.265482+0000","last_clean_scrub_stamp":"2024-02-19T21:40:25.265482+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":169,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195308+0000","last_change":"2024-02-19T21:39:45.432311+0000","last_active":"2024-02-19T21:42:05.195308+0000","last_peered":"2024-02-19T21:42:05.195308+0000","last_clean":"2024-02-19T21:42:05.195308+0000","last_became_active":"2024-02-19T21:32:23.356975+0000","last_became_peered":"2024-02-19T21:32:23.356975+0000","last_unstale":"2024-02-19T21:42:05.195308+0000","last_undegraded":"2024-02-19T21:42:05.195308+0000","last_fullsized":"2024-02-19T21:42:05.195308+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:45.432184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:39:45.432184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"92'13","reported_seq":200,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.184638+0000","last_change":"2024-02-19T21:41:38.975835+0000","last_active":"2024-02-19T21:42:05.184638+0000","last_peered":"2024-02-19T21:42:05.184638+0000","last_clean":"2024-02-19T21:42:05.184638+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:42:05.184638+0000","last_undegraded":"2024-02-19T21:42:05.184638+0000","last_fullsized":"2024-02-19T21:42:05.184638+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"92'13","last_scrub_stamp":"2024-02-19T21:39:38.475440+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.475440+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":176,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.187462+0000","last_change":"2024-02-19T21:39:39.467763+0000","last_active":"2024-02-19T21:42:05.187462+0000","last_peered":"2024-02-19T21:42:05.187462+0000","last_clean":"2024-02-19T21:42:05.187462+0000","last_became_active":"2024-02-19T21:39:39.467350+0000","last_became_peered":"2024-02-19T21:39:39.467350+0000","last_unstale":"2024-02-19T21:42:05.187462+0000","last_undegraded":"2024-02-19T21:42:05.187462+0000","last_fullsized":"2024-02-19T21:42:05.187462+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:30.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:30.102789+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":160,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195433+0000","last_change":"2024-02-19T21:39:32.209318+0000","last_active":"2024-02-19T21:42:05.195433+0000","last_peered":"2024-02-19T21:42:05.195433+0000","last_clean":"2024-02-19T21:42:05.195433+0000","last_became_active":"2024-02-19T21:32:27.370308+0000","last_became_peered":"2024-02-19T21:32:27.370308+0000","last_unstale":"2024-02-19T21:42:05.195433+0000","last_undegraded":"2024-02-19T21:42:05.195433+0000","last_fullsized":"2024-02-19T21:42:05.195433+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:32.209233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:32.209233+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":171,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195524+0000","last_change":"2024-02-19T21:40:34.884850+0000","last_active":"2024-02-19T21:42:05.195524+0000","last_peered":"2024-02-19T21:42:05.195524+0000","last_clean":"2024-02-19T21:42:05.195524+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:42:05.195524+0000","last_undegraded":"2024-02-19T21:42:05.195524+0000","last_fullsized":"2024-02-19T21:42:05.195524+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:34.884780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:08.490788+0000","last_clean_scrub_stamp":"2024-02-19T21:40:34.884780+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"66'5","reported_seq":161,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195012+0000","last_change":"2024-02-19T21:39:44.444043+0000","last_active":"2024-02-19T21:42:05.195012+0000","last_peered":"2024-02-19T21:42:05.195012+0000","last_clean":"2024-02-19T21:42:05.195012+0000","last_became_active":"2024-02-19T21:39:39.471143+0000","last_became_peered":"2024-02-19T21:39:39.471143+0000","last_unstale":"2024-02-19T21:42:05.195012+0000","last_undegraded":"2024-02-19T21:42:05.195012+0000","last_fullsized":"2024-02-19T21:42:05.195012+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'5","last_scrub_stamp":"2024-02-19T21:39:44.443963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:44.443963+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":165,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.185514+0000","last_change":"2024-02-19T21:41:31.631386+0000","last_active":"2024-02-19T21:42:05.185514+0000","last_peered":"2024-02-19T21:42:05.185514+0000","last_clean":"2024-02-19T21:42:05.185514+0000","last_became_active":"2024-02-19T21:32:29.373010+0000","last_became_peered":"2024-02-19T21:32:29.373010+0000","last_unstale":"2024-02-19T21:42:05.185514+0000","last_undegraded":"2024-02-19T21:42:05.185514+0000","last_fullsized":"2024-02-19T21:42:05.185514+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:41:31.631303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:41:31.631303+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":179,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.187866+0000","last_change":"2024-02-19T21:42:04.205008+0000","last_active":"2024-02-19T21:42:05.187866+0000","last_peered":"2024-02-19T21:42:05.187866+0000","last_clean":"2024-02-19T21:42:05.187866+0000","last_became_active":"2024-02-19T21:42:04.204559+0000","last_became_peered":"2024-02-19T21:42:04.204559+0000","last_unstale":"2024-02-19T21:42:05.187866+0000","last_undegraded":"2024-02-19T21:42:05.187866+0000","last_fullsized":"2024-02-19T21:42:05.187866+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:32.576698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:46.543259+0000","last_clean_scrub_stamp":"2024-02-19T21:41:32.576698+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":178,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195087+0000","last_change":"2024-02-19T21:40:16.864005+0000","last_active":"2024-02-19T21:42:05.195087+0000","last_peered":"2024-02-19T21:42:05.195087+0000","last_clean":"2024-02-19T21:42:05.195087+0000","last_became_active":"2024-02-19T21:39:39.473759+0000","last_became_peered":"2024-02-19T21:39:39.473759+0000","last_unstale":"2024-02-19T21:42:05.195087+0000","last_undegraded":"2024-02-19T21:42:05.195087+0000","last_fullsized":"2024-02-19T21:42:05.195087+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:16.863939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:16.863939+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"89'13","reported_seq":183,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195742+0000","last_change":"2024-02-19T21:39:47.395697+0000","last_active":"2024-02-19T21:42:05.195742+0000","last_peered":"2024-02-19T21:42:05.195742+0000","last_clean":"2024-02-19T21:42:05.195742+0000","last_became_active":"2024-02-19T21:35:14.514971+0000","last_became_peered":"2024-02-19T21:35:14.514971+0000","last_unstale":"2024-02-19T21:42:05.195742+0000","last_undegraded":"2024-02-19T21:42:05.195742+0000","last_fullsized":"2024-02-19T21:42:05.195742+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'13","last_scrub_stamp":"2024-02-19T21:39:47.395572+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:39:47.395572+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":163,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195342+0000","last_change":"2024-02-19T21:40:41.667390+0000","last_active":"2024-02-19T21:42:05.195342+0000","last_peered":"2024-02-19T21:42:05.195342+0000","last_clean":"2024-02-19T21:42:05.195342+0000","last_became_active":"2024-02-19T21:32:29.597266+0000","last_became_peered":"2024-02-19T21:32:29.597266+0000","last_unstale":"2024-02-19T21:42:05.195342+0000","last_undegraded":"2024-02-19T21:42:05.195342+0000","last_fullsized":"2024-02-19T21:42:05.195342+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:41.667287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:41.667287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":142,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195229+0000","last_change":"2024-02-19T21:42:04.195331+0000","last_active":"2024-02-19T21:42:05.195229+0000","last_peered":"2024-02-19T21:42:05.195229+0000","last_clean":"2024-02-19T21:42:05.195229+0000","last_became_active":"2024-02-19T21:42:04.194933+0000","last_became_peered":"2024-02-19T21:42:04.194933+0000","last_unstale":"2024-02-19T21:42:05.195229+0000","last_undegraded":"2024-02-19T21:42:05.195229+0000","last_fullsized":"2024-02-19T21:42:05.195229+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:34.364412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:34.364412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":51,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.204384+0000","last_change":"2024-02-19T21:42:04.201407+0000","last_active":"2024-02-19T21:42:05.204384+0000","last_peered":"2024-02-19T21:42:05.204384+0000","last_clean":"2024-02-19T21:42:05.204384+0000","last_became_active":"2024-02-19T21:42:04.201106+0000","last_became_peered":"2024-02-19T21:42:04.201106+0000","last_unstale":"2024-02-19T21:42:05.204384+0000","last_undegraded":"2024-02-19T21:42:05.204384+0000","last_fullsized":"2024-02-19T21:42:05.204384+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:24.788644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:24.788644+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,5],"acting":[6,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"66'12","reported_seq":119,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195821+0000","last_change":"2024-02-19T21:39:21.126642+0000","last_active":"2024-02-19T21:42:05.195821+0000","last_peered":"2024-02-19T21:42:05.195821+0000","last_clean":"2024-02-19T21:42:05.195821+0000","last_became_active":"2024-02-19T21:38:31.247067+0000","last_became_peered":"2024-02-19T21:38:31.247067+0000","last_unstale":"2024-02-19T21:42:05.195821+0000","last_undegraded":"2024-02-19T21:42:05.195821+0000","last_fullsized":"2024-02-19T21:42:05.195821+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'12","last_scrub_stamp":"2024-02-19T21:39:21.126563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:21.126563+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":24,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":169,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.185568+0000","last_change":"2024-02-19T21:40:38.796583+0000","last_active":"2024-02-19T21:42:05.185568+0000","last_peered":"2024-02-19T21:42:05.185568+0000","last_clean":"2024-02-19T21:42:05.185568+0000","last_became_active":"2024-02-19T21:32:29.597365+0000","last_became_peered":"2024-02-19T21:32:29.597365+0000","last_unstale":"2024-02-19T21:42:05.185568+0000","last_undegraded":"2024-02-19T21:42:05.185568+0000","last_fullsized":"2024-02-19T21:42:05.185568+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:38.796496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:38.796496+0000","last_clean_scrub_stamp":"2024-02-19T21:40:38.796496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":161,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195914+0000","last_change":"2024-02-19T21:40:15.269827+0000","last_active":"2024-02-19T21:42:05.195914+0000","last_peered":"2024-02-19T21:42:05.195914+0000","last_clean":"2024-02-19T21:42:05.195914+0000","last_became_active":"2024-02-19T21:32:27.369757+0000","last_became_peered":"2024-02-19T21:32:27.369757+0000","last_unstale":"2024-02-19T21:42:05.195914+0000","last_undegraded":"2024-02-19T21:42:05.195914+0000","last_fullsized":"2024-02-19T21:42:05.195914+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:15.269720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:15.269720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":174,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.204016+0000","last_change":"2024-02-19T21:40:38.600031+0000","last_active":"2024-02-19T21:42:05.204016+0000","last_peered":"2024-02-19T21:42:05.204016+0000","last_clean":"2024-02-19T21:42:05.204016+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:42:05.204016+0000","last_undegraded":"2024-02-19T21:42:05.204016+0000","last_fullsized":"2024-02-19T21:42:05.204016+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:38.599939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:38.599939+0000","last_clean_scrub_stamp":"2024-02-19T21:40:38.599939+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"93'22","reported_seq":138,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.196476+0000","last_change":"2024-02-19T21:40:36.287163+0000","last_active":"2024-02-19T21:42:05.196476+0000","last_peered":"2024-02-19T21:42:05.196476+0000","last_clean":"2024-02-19T21:42:05.196476+0000","last_became_active":"2024-02-19T21:39:39.477429+0000","last_became_peered":"2024-02-19T21:39:39.477429+0000","last_unstale":"2024-02-19T21:42:05.196476+0000","last_undegraded":"2024-02-19T21:42:05.196476+0000","last_fullsized":"2024-02-19T21:42:05.196476+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'22","last_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.287051+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":159,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195369+0000","last_change":"2024-02-19T21:40:32.280767+0000","last_active":"2024-02-19T21:42:05.195369+0000","last_peered":"2024-02-19T21:42:05.195369+0000","last_clean":"2024-02-19T21:42:05.195369+0000","last_became_active":"2024-02-19T21:32:29.373361+0000","last_became_peered":"2024-02-19T21:32:29.373361+0000","last_unstale":"2024-02-19T21:42:05.195369+0000","last_undegraded":"2024-02-19T21:42:05.195369+0000","last_fullsized":"2024-02-19T21:42:05.195369+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:32.280705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:12.945581+0000","last_clean_scrub_stamp":"2024-02-19T21:40:32.280705+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":175,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.186626+0000","last_change":"2024-02-19T21:39:39.471709+0000","last_active":"2024-02-19T21:42:05.186626+0000","last_peered":"2024-02-19T21:42:05.186626+0000","last_clean":"2024-02-19T21:42:05.186626+0000","last_became_active":"2024-02-19T21:39:39.471214+0000","last_became_peered":"2024-02-19T21:39:39.471214+0000","last_unstale":"2024-02-19T21:42:05.186626+0000","last_undegraded":"2024-02-19T21:42:05.186626+0000","last_fullsized":"2024-02-19T21:42:05.186626+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:37.169503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:37.169503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":95,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.203534+0000","last_change":"2024-02-19T21:42:04.198922+0000","last_active":"2024-02-19T21:42:05.203534+0000","last_peered":"2024-02-19T21:42:05.203534+0000","last_clean":"2024-02-19T21:42:05.203534+0000","last_became_active":"2024-02-19T21:42:04.198592+0000","last_became_peered":"2024-02-19T21:42:04.198592+0000","last_unstale":"2024-02-19T21:42:05.203534+0000","last_undegraded":"2024-02-19T21:42:05.203534+0000","last_fullsized":"2024-02-19T21:42:05.203534+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:33.515188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:33.515188+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"66'11","reported_seq":57,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.186505+0000","last_change":"2024-02-19T21:39:51.559559+0000","last_active":"2024-02-19T21:42:05.186505+0000","last_peered":"2024-02-19T21:42:05.186505+0000","last_clean":"2024-02-19T21:42:05.186505+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:42:05.186505+0000","last_undegraded":"2024-02-19T21:42:05.186505+0000","last_fullsized":"2024-02-19T21:42:05.186505+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:39:43.209803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:43.209803+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":182,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-02-19T21:42:17.946570+0000","last_change":"2024-02-19T21:42:17.949461+0000","last_active":"2024-02-19T21:42:17.946570+0000","last_peered":"2024-02-19T21:42:17.946570+0000","last_clean":"2024-02-19T21:42:17.946570+0000","last_became_active":"2024-02-19T21:39:39.473146+0000","last_became_peered":"2024-02-19T21:39:39.473146+0000","last_unstale":"2024-02-19T21:42:17.946570+0000","last_undegraded":"2024-02-19T21:42:17.946570+0000","last_fullsized":"2024-02-19T21:42:17.946570+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:38:25.883927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:38:25.883927+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"199'9","reported_seq":310,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-02-19T21:42:11.976880+0000","last_change":"2024-02-19T21:42:04.290659+0000","last_active":"2024-02-19T21:42:11.976880+0000","last_peered":"2024-02-19T21:42:11.976880+0000","last_clean":"2024-02-19T21:42:11.976880+0000","last_became_active":"2024-02-19T21:42:04.199656+0000","last_became_peered":"2024-02-19T21:42:04.199656+0000","last_unstale":"2024-02-19T21:42:11.976880+0000","last_undegraded":"2024-02-19T21:42:11.976880+0000","last_fullsized":"2024-02-19T21:42:11.976880+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:40:19.276740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:19.276740+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":178,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.187331+0000","last_change":"2024-02-19T21:42:04.199658+0000","last_active":"2024-02-19T21:42:05.187331+0000","last_peered":"2024-02-19T21:42:05.187331+0000","last_clean":"2024-02-19T21:42:05.187331+0000","last_became_active":"2024-02-19T21:42:04.199323+0000","last_became_peered":"2024-02-19T21:42:04.199323+0000","last_unstale":"2024-02-19T21:42:05.187331+0000","last_undegraded":"2024-02-19T21:42:05.187331+0000","last_fullsized":"2024-02-19T21:42:05.187331+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.080601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.080601+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"66'10","reported_seq":234,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.186616+0000","last_change":"2024-02-19T21:42:04.205219+0000","last_active":"2024-02-19T21:42:05.186616+0000","last_peered":"2024-02-19T21:42:05.186616+0000","last_clean":"2024-02-19T21:42:05.186616+0000","last_became_active":"2024-02-19T21:42:04.204882+0000","last_became_peered":"2024-02-19T21:42:04.204882+0000","last_unstale":"2024-02-19T21:42:05.186616+0000","last_undegraded":"2024-02-19T21:42:05.186616+0000","last_fullsized":"2024-02-19T21:42:05.186616+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:39:33.125904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:33.125904+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":81,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.185764+0000","last_change":"2024-02-19T21:39:39.471651+0000","last_active":"2024-02-19T21:42:05.185764+0000","last_peered":"2024-02-19T21:42:05.185764+0000","last_clean":"2024-02-19T21:42:05.185764+0000","last_became_active":"2024-02-19T21:39:39.471332+0000","last_became_peered":"2024-02-19T21:39:39.471332+0000","last_unstale":"2024-02-19T21:42:05.185764+0000","last_undegraded":"2024-02-19T21:42:05.185764+0000","last_fullsized":"2024-02-19T21:42:05.185764+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:23.270251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:39:23.270251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":167,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195646+0000","last_change":"2024-02-19T21:41:36.941622+0000","last_active":"2024-02-19T21:42:05.195646+0000","last_peered":"2024-02-19T21:42:05.195646+0000","last_clean":"2024-02-19T21:42:05.195646+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:42:05.195646+0000","last_undegraded":"2024-02-19T21:42:05.195646+0000","last_fullsized":"2024-02-19T21:42:05.195646+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:36.941549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:41:36.941549+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":178,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.204099+0000","last_change":"2024-02-19T21:39:45.211467+0000","last_active":"2024-02-19T21:42:05.204099+0000","last_peered":"2024-02-19T21:42:05.204099+0000","last_clean":"2024-02-19T21:42:05.204099+0000","last_became_active":"2024-02-19T21:39:39.478633+0000","last_became_peered":"2024-02-19T21:39:39.478633+0000","last_unstale":"2024-02-19T21:42:05.204099+0000","last_undegraded":"2024-02-19T21:42:05.204099+0000","last_fullsized":"2024-02-19T21:42:05.204099+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:45.211388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:39:45.211388+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"66'11","reported_seq":207,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195492+0000","last_change":"2024-02-19T21:42:04.641915+0000","last_active":"2024-02-19T21:42:05.195492+0000","last_peered":"2024-02-19T21:42:05.195492+0000","last_clean":"2024-02-19T21:42:05.195492+0000","last_became_active":"2024-02-19T21:42:04.205379+0000","last_became_peered":"2024-02-19T21:42:04.205379+0000","last_unstale":"2024-02-19T21:42:05.195492+0000","last_undegraded":"2024-02-19T21:42:05.195492+0000","last_fullsized":"2024-02-19T21:42:05.195492+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:39:46.421117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:46.421117+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":167,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195579+0000","last_change":"2024-02-19T21:39:39.471671+0000","last_active":"2024-02-19T21:42:05.195579+0000","last_peered":"2024-02-19T21:42:05.195579+0000","last_clean":"2024-02-19T21:42:05.195579+0000","last_became_active":"2024-02-19T21:39:39.471306+0000","last_became_peered":"2024-02-19T21:39:39.471306+0000","last_unstale":"2024-02-19T21:42:05.195579+0000","last_undegraded":"2024-02-19T21:42:05.195579+0000","last_fullsized":"2024-02-19T21:42:05.195579+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:37.104831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:39:37.104831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":178,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-02-19T21:42:15.956641+0000","last_change":"2024-02-19T21:42:15.957303+0000","last_active":"2024-02-19T21:42:15.956641+0000","last_peered":"2024-02-19T21:42:15.956641+0000","last_clean":"2024-02-19T21:42:15.956641+0000","last_became_active":"2024-02-19T21:42:04.196794+0000","last_became_peered":"2024-02-19T21:42:04.196794+0000","last_unstale":"2024-02-19T21:42:15.956641+0000","last_undegraded":"2024-02-19T21:42:15.956641+0000","last_fullsized":"2024-02-19T21:42:15.956641+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:41.234250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:41.234250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":173,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.188249+0000","last_change":"2024-02-19T21:39:39.480521+0000","last_active":"2024-02-19T21:42:05.188249+0000","last_peered":"2024-02-19T21:42:05.188249+0000","last_clean":"2024-02-19T21:42:05.188249+0000","last_became_active":"2024-02-19T21:39:39.479927+0000","last_became_peered":"2024-02-19T21:39:39.479927+0000","last_unstale":"2024-02-19T21:42:05.188249+0000","last_undegraded":"2024-02-19T21:42:05.188249+0000","last_fullsized":"2024-02-19T21:42:05.188249+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:39:37.085374+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"66'4","reported_seq":26,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.194755+0000","last_change":"2024-02-19T21:41:42.590833+0000","last_active":"2024-02-19T21:42:05.194755+0000","last_peered":"2024-02-19T21:42:05.194755+0000","last_clean":"2024-02-19T21:42:05.194755+0000","last_became_active":"2024-02-19T21:41:42.243259+0000","last_became_peered":"2024-02-19T21:41:42.243259+0000","last_unstale":"2024-02-19T21:42:05.194755+0000","last_undegraded":"2024-02-19T21:42:05.194755+0000","last_fullsized":"2024-02-19T21:42:05.194755+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'4","last_scrub_stamp":"2024-02-19T21:40:18.214846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:18.214846+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":81,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.185429+0000","last_change":"2024-02-19T21:39:39.462663+0000","last_active":"2024-02-19T21:42:05.185429+0000","last_peered":"2024-02-19T21:42:05.185429+0000","last_clean":"2024-02-19T21:42:05.185429+0000","last_became_active":"2024-02-19T21:39:39.462363+0000","last_became_peered":"2024-02-19T21:39:39.462363+0000","last_unstale":"2024-02-19T21:42:05.185429+0000","last_undegraded":"2024-02-19T21:42:05.185429+0000","last_fullsized":"2024-02-19T21:42:05.185429+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:26.311526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:39:26.311526+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":179,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.196496+0000","last_change":"2024-02-19T21:42:04.199063+0000","last_active":"2024-02-19T21:42:05.196496+0000","last_peered":"2024-02-19T21:42:05.196496+0000","last_clean":"2024-02-19T21:42:05.196496+0000","last_became_active":"2024-02-19T21:42:04.198684+0000","last_became_peered":"2024-02-19T21:42:04.198684+0000","last_unstale":"2024-02-19T21:42:05.196496+0000","last_undegraded":"2024-02-19T21:42:05.196496+0000","last_fullsized":"2024-02-19T21:42:05.196496+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:26.272653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:26.272653+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":167,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195504+0000","last_change":"2024-02-19T21:39:33.957921+0000","last_active":"2024-02-19T21:42:05.195504+0000","last_peered":"2024-02-19T21:42:05.195504+0000","last_clean":"2024-02-19T21:42:05.195504+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:42:05.195504+0000","last_undegraded":"2024-02-19T21:42:05.195504+0000","last_fullsized":"2024-02-19T21:42:05.195504+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:33.957814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:39:33.957814+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"66'11","reported_seq":197,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.185313+0000","last_change":"2024-02-19T21:41:23.880621+0000","last_active":"2024-02-19T21:42:05.185313+0000","last_peered":"2024-02-19T21:42:05.185313+0000","last_clean":"2024-02-19T21:42:05.185313+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:42:05.185313+0000","last_undegraded":"2024-02-19T21:42:05.185313+0000","last_fullsized":"2024-02-19T21:42:05.185313+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:41:23.880501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:41:23.880501+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":166,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.185243+0000","last_change":"2024-02-19T21:38:29.972418+0000","last_active":"2024-02-19T21:42:05.185243+0000","last_peered":"2024-02-19T21:42:05.185243+0000","last_clean":"2024-02-19T21:42:05.185243+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:42:05.185243+0000","last_undegraded":"2024-02-19T21:42:05.185243+0000","last_fullsized":"2024-02-19T21:42:05.185243+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:29.972337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:42.527849+0000","last_clean_scrub_stamp":"2024-02-19T21:38:29.972337+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":169,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195099+0000","last_change":"2024-02-19T21:39:51.535010+0000","last_active":"2024-02-19T21:42:05.195099+0000","last_peered":"2024-02-19T21:42:05.195099+0000","last_clean":"2024-02-19T21:42:05.195099+0000","last_became_active":"2024-02-19T21:39:51.534750+0000","last_became_peered":"2024-02-19T21:39:51.534750+0000","last_unstale":"2024-02-19T21:42:05.195099+0000","last_undegraded":"2024-02-19T21:42:05.195099+0000","last_fullsized":"2024-02-19T21:42:05.195099+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:33.360066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:33.360066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":174,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.203908+0000","last_change":"2024-02-19T21:41:35.736077+0000","last_active":"2024-02-19T21:42:05.203908+0000","last_peered":"2024-02-19T21:42:05.203908+0000","last_clean":"2024-02-19T21:42:05.203908+0000","last_became_active":"2024-02-19T21:32:23.357338+0000","last_became_peered":"2024-02-19T21:32:23.357338+0000","last_unstale":"2024-02-19T21:42:05.203908+0000","last_undegraded":"2024-02-19T21:42:05.203908+0000","last_fullsized":"2024-02-19T21:42:05.203908+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:35.735995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:41:35.735995+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"66'9","reported_seq":198,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.196391+0000","last_change":"2024-02-19T21:39:45.026756+0000","last_active":"2024-02-19T21:42:05.196391+0000","last_peered":"2024-02-19T21:42:05.196391+0000","last_clean":"2024-02-19T21:42:05.196391+0000","last_became_active":"2024-02-19T21:39:39.466843+0000","last_became_peered":"2024-02-19T21:39:39.466843+0000","last_unstale":"2024-02-19T21:42:05.196391+0000","last_undegraded":"2024-02-19T21:42:05.196391+0000","last_fullsized":"2024-02-19T21:42:05.196391+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:39:45.026689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:45.026689+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":54,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.188149+0000","last_change":"2024-02-19T21:39:41.032181+0000","last_active":"2024-02-19T21:42:05.188149+0000","last_peered":"2024-02-19T21:42:05.188149+0000","last_clean":"2024-02-19T21:42:05.188149+0000","last_became_active":"2024-02-19T21:39:39.474430+0000","last_became_peered":"2024-02-19T21:39:39.474430+0000","last_unstale":"2024-02-19T21:42:05.188149+0000","last_undegraded":"2024-02-19T21:42:05.188149+0000","last_fullsized":"2024-02-19T21:42:05.188149+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:41.032064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:41.032064+0000","last_clean_scrub_stamp":"2024-02-19T21:39:41.032064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"199'13","reported_seq":108,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-02-19T21:42:11.974497+0000","last_change":"2024-02-19T21:42:04.202258+0000","last_active":"2024-02-19T21:42:11.974497+0000","last_peered":"2024-02-19T21:42:11.974497+0000","last_clean":"2024-02-19T21:42:11.974497+0000","last_became_active":"2024-02-19T21:42:04.195103+0000","last_became_peered":"2024-02-19T21:42:04.195103+0000","last_unstale":"2024-02-19T21:42:11.974497+0000","last_undegraded":"2024-02-19T21:42:11.974497+0000","last_fullsized":"2024-02-19T21:42:11.974497+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'11","last_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:39:46.054888+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":179,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.185897+0000","last_change":"2024-02-19T21:40:33.532430+0000","last_active":"2024-02-19T21:42:05.185897+0000","last_peered":"2024-02-19T21:42:05.185897+0000","last_clean":"2024-02-19T21:42:05.185897+0000","last_became_active":"2024-02-19T21:32:23.361680+0000","last_became_peered":"2024-02-19T21:32:23.361680+0000","last_unstale":"2024-02-19T21:42:05.185897+0000","last_undegraded":"2024-02-19T21:42:05.185897+0000","last_fullsized":"2024-02-19T21:42:05.185897+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:33.532354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:33.550655+0000","last_clean_scrub_stamp":"2024-02-19T21:40:33.532354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"133'13","reported_seq":187,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.190074+0000","last_change":"2024-02-19T21:40:37.730352+0000","last_active":"2024-02-19T21:42:05.190074+0000","last_peered":"2024-02-19T21:42:05.190074+0000","last_clean":"2024-02-19T21:42:05.190074+0000","last_became_active":"2024-02-19T21:32:25.372206+0000","last_became_peered":"2024-02-19T21:32:25.372206+0000","last_unstale":"2024-02-19T21:42:05.190074+0000","last_undegraded":"2024-02-19T21:42:05.190074+0000","last_fullsized":"2024-02-19T21:42:05.190074+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'13","last_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:40:37.730197+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":187,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.186413+0000","last_change":"2024-02-19T21:42:04.207152+0000","last_active":"2024-02-19T21:42:05.186413+0000","last_peered":"2024-02-19T21:42:05.186413+0000","last_clean":"2024-02-19T21:42:05.186413+0000","last_became_active":"2024-02-19T21:42:04.206348+0000","last_became_peered":"2024-02-19T21:42:04.206348+0000","last_unstale":"2024-02-19T21:42:05.186413+0000","last_undegraded":"2024-02-19T21:42:05.186413+0000","last_fullsized":"2024-02-19T21:42:05.186413+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:29.506785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:29.506785+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":293,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-02-19T21:42:11.977126+0000","last_change":"2024-02-19T21:40:32.679041+0000","last_active":"2024-02-19T21:42:11.977126+0000","last_peered":"2024-02-19T21:42:11.977126+0000","last_clean":"2024-02-19T21:42:11.977126+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:42:11.977126+0000","last_undegraded":"2024-02-19T21:42:11.977126+0000","last_fullsized":"2024-02-19T21:42:11.977126+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:40:32.678933+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":180,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.187836+0000","last_change":"2024-02-19T21:42:04.205987+0000","last_active":"2024-02-19T21:42:05.187836+0000","last_peered":"2024-02-19T21:42:05.187836+0000","last_clean":"2024-02-19T21:42:05.187836+0000","last_became_active":"2024-02-19T21:42:04.205401+0000","last_became_peered":"2024-02-19T21:42:04.205401+0000","last_unstale":"2024-02-19T21:42:05.187836+0000","last_undegraded":"2024-02-19T21:42:05.187836+0000","last_fullsized":"2024-02-19T21:42:05.187836+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:25.759697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:40:25.759697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"182'15","reported_seq":187,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195193+0000","last_change":"2024-02-19T21:40:39.592088+0000","last_active":"2024-02-19T21:42:05.195193+0000","last_peered":"2024-02-19T21:42:05.195193+0000","last_clean":"2024-02-19T21:42:05.195193+0000","last_became_active":"2024-02-19T21:32:25.372060+0000","last_became_peered":"2024-02-19T21:32:25.372060+0000","last_unstale":"2024-02-19T21:42:05.195193+0000","last_undegraded":"2024-02-19T21:42:05.195193+0000","last_fullsized":"2024-02-19T21:42:05.195193+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'15","last_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:40:39.591994+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":167,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195451+0000","last_change":"2024-02-19T21:40:31.892048+0000","last_active":"2024-02-19T21:42:05.195451+0000","last_peered":"2024-02-19T21:42:05.195451+0000","last_clean":"2024-02-19T21:42:05.195451+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:42:05.195451+0000","last_undegraded":"2024-02-19T21:42:05.195451+0000","last_fullsized":"2024-02-19T21:42:05.195451+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:31.891967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_clean_scrub_stamp":"2024-02-19T21:40:31.891967+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":160,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.188015+0000","last_change":"2024-02-19T21:39:36.067452+0000","last_active":"2024-02-19T21:42:05.188015+0000","last_peered":"2024-02-19T21:42:05.188015+0000","last_clean":"2024-02-19T21:42:05.188015+0000","last_became_active":"2024-02-19T21:32:27.369002+0000","last_became_peered":"2024-02-19T21:32:27.369002+0000","last_unstale":"2024-02-19T21:42:05.188015+0000","last_undegraded":"2024-02-19T21:42:05.188015+0000","last_fullsized":"2024-02-19T21:42:05.188015+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:36.067354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:36.067354+0000","last_clean_scrub_stamp":"2024-02-19T21:39:36.067354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":169,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.204647+0000","last_change":"2024-02-19T21:40:29.421893+0000","last_active":"2024-02-19T21:42:05.204647+0000","last_peered":"2024-02-19T21:42:05.204647+0000","last_clean":"2024-02-19T21:42:05.204647+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:42:05.204647+0000","last_undegraded":"2024-02-19T21:42:05.204647+0000","last_fullsized":"2024-02-19T21:42:05.204647+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:29.421791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:29.421791+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"66'6","reported_seq":43,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.196605+0000","last_change":"2024-02-19T21:42:04.203612+0000","last_active":"2024-02-19T21:42:05.196605+0000","last_peered":"2024-02-19T21:42:05.196605+0000","last_clean":"2024-02-19T21:42:05.196605+0000","last_became_active":"2024-02-19T21:42:04.192291+0000","last_became_peered":"2024-02-19T21:42:04.192291+0000","last_unstale":"2024-02-19T21:42:05.196605+0000","last_undegraded":"2024-02-19T21:42:05.196605+0000","last_fullsized":"2024-02-19T21:42:05.196605+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'6","last_scrub_stamp":"2024-02-19T21:39:24.011489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:24.011489+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":51,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.185300+0000","last_change":"2024-02-19T21:39:41.367764+0000","last_active":"2024-02-19T21:42:05.185300+0000","last_peered":"2024-02-19T21:42:05.185300+0000","last_clean":"2024-02-19T21:42:05.185300+0000","last_became_active":"2024-02-19T21:39:39.469477+0000","last_became_peered":"2024-02-19T21:39:39.469477+0000","last_unstale":"2024-02-19T21:42:05.185300+0000","last_undegraded":"2024-02-19T21:42:05.185300+0000","last_fullsized":"2024-02-19T21:42:05.185300+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:41.367692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:41.367692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":81,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.196701+0000","last_change":"2024-02-19T21:42:04.195734+0000","last_active":"2024-02-19T21:42:05.196701+0000","last_peered":"2024-02-19T21:42:05.196701+0000","last_clean":"2024-02-19T21:42:05.196701+0000","last_became_active":"2024-02-19T21:42:04.195167+0000","last_became_peered":"2024-02-19T21:42:04.195167+0000","last_unstale":"2024-02-19T21:42:05.196701+0000","last_undegraded":"2024-02-19T21:42:05.196701+0000","last_fullsized":"2024-02-19T21:42:05.196701+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:34.284787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:34.284787+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":46,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195902+0000","last_change":"2024-02-19T21:39:39.477623+0000","last_active":"2024-02-19T21:42:05.195902+0000","last_peered":"2024-02-19T21:42:05.195902+0000","last_clean":"2024-02-19T21:42:05.195902+0000","last_became_active":"2024-02-19T21:39:39.477308+0000","last_became_peered":"2024-02-19T21:39:39.477308+0000","last_unstale":"2024-02-19T21:42:05.195902+0000","last_undegraded":"2024-02-19T21:42:05.195902+0000","last_fullsized":"2024-02-19T21:42:05.195902+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:26.250620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:38:26.250620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"66'9","reported_seq":241,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.186497+0000","last_change":"2024-02-19T21:42:04.226031+0000","last_active":"2024-02-19T21:42:05.186497+0000","last_peered":"2024-02-19T21:42:05.186497+0000","last_clean":"2024-02-19T21:42:05.186497+0000","last_became_active":"2024-02-19T21:42:04.207069+0000","last_became_peered":"2024-02-19T21:42:04.207069+0000","last_unstale":"2024-02-19T21:42:05.186497+0000","last_undegraded":"2024-02-19T21:42:05.186497+0000","last_fullsized":"2024-02-19T21:42:05.186497+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:39:46.193426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:46.193426+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"200'11197","reported_seq":11240,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-02-19T21:42:19.860495+0000","last_change":"2024-02-19T21:39:39.469485+0000","last_active":"2024-02-19T21:42:19.860495+0000","last_peered":"2024-02-19T21:42:19.860495+0000","last_clean":"2024-02-19T21:42:19.860495+0000","last_became_active":"2024-02-19T21:39:39.469130+0000","last_became_peered":"2024-02-19T21:39:39.469130+0000","last_unstale":"2024-02-19T21:42:19.860495+0000","last_undegraded":"2024-02-19T21:42:19.860495+0000","last_fullsized":"2024-02-19T21:42:19.860495+0000","mapping_epoch":165,"log_start":"185'6952","ondisk_log_start":"185'6952","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4245,"ondisk_log_size":4245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":313065472,"num_objects":4777,"num_object_clones":0,"num_object_copies":14331,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4777,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11197,"num_write_kb":511168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":172,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195183+0000","last_change":"2024-02-19T21:42:04.192557+0000","last_active":"2024-02-19T21:42:05.195183+0000","last_peered":"2024-02-19T21:42:05.195183+0000","last_clean":"2024-02-19T21:42:05.195183+0000","last_became_active":"2024-02-19T21:42:04.192195+0000","last_became_peered":"2024-02-19T21:42:04.192195+0000","last_unstale":"2024-02-19T21:42:05.195183+0000","last_undegraded":"2024-02-19T21:42:05.195183+0000","last_fullsized":"2024-02-19T21:42:05.195183+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:35.539219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:40:35.539219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"59'2","reported_seq":197,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.185905+0000","last_change":"2024-02-19T21:41:24.914001+0000","last_active":"2024-02-19T21:42:05.185905+0000","last_peered":"2024-02-19T21:42:05.185905+0000","last_clean":"2024-02-19T21:42:05.185905+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:42:05.185905+0000","last_undegraded":"2024-02-19T21:42:05.185905+0000","last_fullsized":"2024-02-19T21:42:05.185905+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-02-19T21:41:24.913925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:41:24.913925+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"83'17","reported_seq":200,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.196902+0000","last_change":"2024-02-19T21:40:37.318743+0000","last_active":"2024-02-19T21:42:05.196902+0000","last_peered":"2024-02-19T21:42:05.196902+0000","last_clean":"2024-02-19T21:42:05.196902+0000","last_became_active":"2024-02-19T21:38:31.247821+0000","last_became_peered":"2024-02-19T21:38:31.247821+0000","last_unstale":"2024-02-19T21:42:05.196902+0000","last_undegraded":"2024-02-19T21:42:05.196902+0000","last_fullsized":"2024-02-19T21:42:05.196902+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'17","last_scrub_stamp":"2024-02-19T21:40:37.318642+0000","last_deep_scrub":"83'17","last_deep_scrub_stamp":"2024-02-19T21:33:43.418450+0000","last_clean_scrub_stamp":"2024-02-19T21:40:37.318642+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":46,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.185608+0000","last_change":"2024-02-19T21:39:39.467760+0000","last_active":"2024-02-19T21:42:05.185608+0000","last_peered":"2024-02-19T21:42:05.185608+0000","last_clean":"2024-02-19T21:42:05.185608+0000","last_became_active":"2024-02-19T21:39:39.467210+0000","last_became_peered":"2024-02-19T21:39:39.467210+0000","last_unstale":"2024-02-19T21:42:05.185608+0000","last_undegraded":"2024-02-19T21:42:05.185608+0000","last_fullsized":"2024-02-19T21:42:05.185608+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:37.384723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:37.384723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"200'11348","reported_seq":11391,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-02-19T21:42:20.076878+0000","last_change":"2024-02-19T21:39:39.471871+0000","last_active":"2024-02-19T21:42:20.076878+0000","last_peered":"2024-02-19T21:42:20.076878+0000","last_clean":"2024-02-19T21:42:20.076878+0000","last_became_active":"2024-02-19T21:39:39.471575+0000","last_became_peered":"2024-02-19T21:39:39.471575+0000","last_unstale":"2024-02-19T21:42:20.076878+0000","last_undegraded":"2024-02-19T21:42:20.076878+0000","last_fullsized":"2024-02-19T21:42:20.076878+0000","mapping_epoch":165,"log_start":"185'7144","ondisk_log_start":"185'7144","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4204,"ondisk_log_size":4204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":319029248,"num_objects":4868,"num_object_clones":0,"num_object_copies":14604,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4868,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11348,"num_write_kb":518912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":191,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.185239+0000","last_change":"2024-02-19T21:41:42.246007+0000","last_active":"2024-02-19T21:42:05.185239+0000","last_peered":"2024-02-19T21:42:05.185239+0000","last_clean":"2024-02-19T21:42:05.185239+0000","last_became_active":"2024-02-19T21:41:42.245788+0000","last_became_peered":"2024-02-19T21:41:42.245788+0000","last_unstale":"2024-02-19T21:42:05.185239+0000","last_undegraded":"2024-02-19T21:42:05.185239+0000","last_fullsized":"2024-02-19T21:42:05.185239+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:40.474333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:40.474333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":165,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.196394+0000","last_change":"2024-02-19T21:39:34.971980+0000","last_active":"2024-02-19T21:42:05.196394+0000","last_peered":"2024-02-19T21:42:05.196394+0000","last_clean":"2024-02-19T21:42:05.196394+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:42:05.196394+0000","last_undegraded":"2024-02-19T21:42:05.196394+0000","last_fullsized":"2024-02-19T21:42:05.196394+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:34.971917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:39:34.971917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"66'10","reported_seq":61,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.196446+0000","last_change":"2024-02-19T21:41:22.195267+0000","last_active":"2024-02-19T21:42:05.196446+0000","last_peered":"2024-02-19T21:42:05.196446+0000","last_clean":"2024-02-19T21:42:05.196446+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:42:05.196446+0000","last_undegraded":"2024-02-19T21:42:05.196446+0000","last_fullsized":"2024-02-19T21:42:05.196446+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:41:22.195164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:41:22.195164+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":295,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-02-19T21:42:11.974390+0000","last_change":"2024-02-19T21:40:25.363354+0000","last_active":"2024-02-19T21:42:11.974390+0000","last_peered":"2024-02-19T21:42:11.974390+0000","last_clean":"2024-02-19T21:42:11.974390+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:42:11.974390+0000","last_undegraded":"2024-02-19T21:42:11.974390+0000","last_fullsized":"2024-02-19T21:42:11.974390+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:40:25.363236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:25.363236+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"200'11151","reported_seq":12030,"reported_epoch":200,"state":"active+remapped+backfilling","last_fresh":"2024-02-19T21:42:19.877897+0000","last_change":"2024-02-19T21:41:43.859967+0000","last_active":"2024-02-19T21:42:19.877897+0000","last_peered":"2024-02-19T21:42:19.877897+0000","last_clean":"2024-02-19T21:41:41.233905+0000","last_became_active":"2024-02-19T21:41:43.731261+0000","last_became_peered":"2024-02-19T21:41:43.731261+0000","last_unstale":"2024-02-19T21:42:19.877897+0000","last_undegraded":"2024-02-19T21:42:19.877897+0000","last_fullsized":"2024-02-19T21:42:19.877897+0000","mapping_epoch":190,"log_start":"185'7194","ondisk_log_start":"185'7194","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":3957,"ondisk_log_size":3957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":319094784,"num_objects":4869,"num_object_clones":0,"num_object_copies":14607,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":4545,"num_objects_unfound":0,"num_objects_dirty":4869,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11151,"num_write_kb":512640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":411,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,7,0],"avail_no_missing":["5","0","7"],"object_location_counts":[{"shards":"0,5,7","objects":4869}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":77,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.185665+0000","last_change":"2024-02-19T21:40:27.767533+0000","last_active":"2024-02-19T21:42:05.185665+0000","last_peered":"2024-02-19T21:42:05.185665+0000","last_clean":"2024-02-19T21:42:05.185665+0000","last_became_active":"2024-02-19T21:38:31.244787+0000","last_became_peered":"2024-02-19T21:38:31.244787+0000","last_unstale":"2024-02-19T21:42:05.185665+0000","last_undegraded":"2024-02-19T21:42:05.185665+0000","last_fullsized":"2024-02-19T21:42:05.185665+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:27.767442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:27.767442+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":169,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.187882+0000","last_change":"2024-02-19T21:39:27.079886+0000","last_active":"2024-02-19T21:42:05.187882+0000","last_peered":"2024-02-19T21:42:05.187882+0000","last_clean":"2024-02-19T21:42:05.187882+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:42:05.187882+0000","last_undegraded":"2024-02-19T21:42:05.187882+0000","last_fullsized":"2024-02-19T21:42:05.187882+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:27.079784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:39:27.079784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"199'31","reported_seq":424,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-02-19T21:42:11.974606+0000","last_change":"2024-02-19T21:42:04.218868+0000","last_active":"2024-02-19T21:42:11.974606+0000","last_peered":"2024-02-19T21:42:11.974606+0000","last_clean":"2024-02-19T21:42:11.974606+0000","last_became_active":"2024-02-19T21:42:04.196382+0000","last_became_peered":"2024-02-19T21:42:04.196382+0000","last_unstale":"2024-02-19T21:42:11.974606+0000","last_undegraded":"2024-02-19T21:42:11.974606+0000","last_fullsized":"2024-02-19T21:42:11.974606+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'30","last_scrub_stamp":"2024-02-19T21:39:43.996511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:43.996511+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":1074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,5],"acting":[1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":161,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.186472+0000","last_change":"2024-02-19T21:38:16.890343+0000","last_active":"2024-02-19T21:42:05.186472+0000","last_peered":"2024-02-19T21:42:05.186472+0000","last_clean":"2024-02-19T21:42:05.186472+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:42:05.186472+0000","last_undegraded":"2024-02-19T21:42:05.186472+0000","last_fullsized":"2024-02-19T21:42:05.186472+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:16.890269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:16.890269+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"200'11198","reported_seq":11566,"reported_epoch":200,"state":"active+remapped+backfilling","last_fresh":"2024-02-19T21:42:19.889625+0000","last_change":"2024-02-19T21:42:05.313986+0000","last_active":"2024-02-19T21:42:19.889625+0000","last_peered":"2024-02-19T21:42:19.889625+0000","last_clean":"2024-02-19T21:42:03.157828+0000","last_became_active":"2024-02-19T21:42:05.261493+0000","last_became_peered":"2024-02-19T21:42:05.261493+0000","last_unstale":"2024-02-19T21:42:19.889625+0000","last_undegraded":"2024-02-19T21:42:19.889625+0000","last_fullsized":"2024-02-19T21:42:19.889625+0000","mapping_epoch":198,"log_start":"185'6829","ondisk_log_start":"185'6829","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"188'8618","last_scrub_stamp":"2024-02-19T21:41:36.200222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:41:36.200222+0000","log_size":4369,"ondisk_log_size":4369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":313393152,"num_objects":4782,"num_object_clones":0,"num_object_copies":14346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":4639,"num_objects_unfound":0,"num_objects_dirty":4782,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11198,"num_write_kb":511360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":10158080,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,7],"avail_no_missing":["4","1","7"],"object_location_counts":[{"shards":"1,4,7","objects":4782}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":158,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195659+0000","last_change":"2024-02-19T21:39:29.085751+0000","last_active":"2024-02-19T21:42:05.195659+0000","last_peered":"2024-02-19T21:42:05.195659+0000","last_clean":"2024-02-19T21:42:05.195659+0000","last_became_active":"2024-02-19T21:32:29.597365+0000","last_became_peered":"2024-02-19T21:32:29.597365+0000","last_unstale":"2024-02-19T21:42:05.195659+0000","last_undegraded":"2024-02-19T21:42:05.195659+0000","last_fullsized":"2024-02-19T21:42:05.195659+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:29.085642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:29.085642+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"67'5","reported_seq":767,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-02-19T21:42:18.023147+0000","last_change":"2024-02-19T21:39:39.576551+0000","last_active":"2024-02-19T21:42:18.023147+0000","last_peered":"2024-02-19T21:42:18.023147+0000","last_clean":"2024-02-19T21:42:18.023147+0000","last_became_active":"2024-02-19T21:39:39.464361+0000","last_became_peered":"2024-02-19T21:39:39.464361+0000","last_unstale":"2024-02-19T21:42:18.023147+0000","last_undegraded":"2024-02-19T21:42:18.023147+0000","last_fullsized":"2024-02-19T21:42:18.023147+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5","last_scrub_stamp":"2024-02-19T21:38:17.997743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:38:17.997743+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":583,"num_read_kb":578,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":167,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.185328+0000","last_change":"2024-02-19T21:41:36.636023+0000","last_active":"2024-02-19T21:42:05.185328+0000","last_peered":"2024-02-19T21:42:05.185328+0000","last_clean":"2024-02-19T21:42:05.185328+0000","last_became_active":"2024-02-19T21:39:39.468113+0000","last_became_peered":"2024-02-19T21:39:39.468113+0000","last_unstale":"2024-02-19T21:42:05.185328+0000","last_undegraded":"2024-02-19T21:42:05.185328+0000","last_fullsized":"2024-02-19T21:42:05.185328+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:36.635936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:41:36.635936+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"66'13","reported_seq":200,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.196428+0000","last_change":"2024-02-19T21:37:32.806098+0000","last_active":"2024-02-19T21:42:05.196428+0000","last_peered":"2024-02-19T21:42:05.196428+0000","last_clean":"2024-02-19T21:42:05.196428+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:42:05.196428+0000","last_undegraded":"2024-02-19T21:42:05.196428+0000","last_fullsized":"2024-02-19T21:42:05.196428+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'13","last_scrub_stamp":"2024-02-19T21:37:32.805993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:32.805993+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":51,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.188338+0000","last_change":"2024-02-19T21:41:29.640521+0000","last_active":"2024-02-19T21:42:05.188338+0000","last_peered":"2024-02-19T21:42:05.188338+0000","last_clean":"2024-02-19T21:42:05.188338+0000","last_became_active":"2024-02-19T21:39:39.475190+0000","last_became_peered":"2024-02-19T21:39:39.475190+0000","last_unstale":"2024-02-19T21:42:05.188338+0000","last_undegraded":"2024-02-19T21:42:05.188338+0000","last_fullsized":"2024-02-19T21:42:05.188338+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:29.640431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:29.640431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"200'10941","reported_seq":10984,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-02-19T21:42:19.884935+0000","last_change":"2024-02-19T21:39:39.475831+0000","last_active":"2024-02-19T21:42:19.884935+0000","last_peered":"2024-02-19T21:42:19.884935+0000","last_clean":"2024-02-19T21:42:19.884935+0000","last_became_active":"2024-02-19T21:39:39.475531+0000","last_became_peered":"2024-02-19T21:39:39.475531+0000","last_unstale":"2024-02-19T21:42:19.884935+0000","last_undegraded":"2024-02-19T21:42:19.884935+0000","last_fullsized":"2024-02-19T21:42:19.884935+0000","mapping_epoch":165,"log_start":"185'6676","ondisk_log_start":"185'6676","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4265,"ondisk_log_size":4265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":314638336,"num_objects":4801,"num_object_clones":0,"num_object_copies":14403,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4801,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10941,"num_write_kb":503744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":163,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.188396+0000","last_change":"2024-02-19T21:40:33.758226+0000","last_active":"2024-02-19T21:42:05.188396+0000","last_peered":"2024-02-19T21:42:05.188396+0000","last_clean":"2024-02-19T21:42:05.188396+0000","last_became_active":"2024-02-19T21:32:29.372547+0000","last_became_peered":"2024-02-19T21:32:29.372547+0000","last_unstale":"2024-02-19T21:42:05.188396+0000","last_undegraded":"2024-02-19T21:42:05.188396+0000","last_fullsized":"2024-02-19T21:42:05.188396+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:33.758127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:40:33.758127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":72,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.188360+0000","last_change":"2024-02-19T21:40:30.692471+0000","last_active":"2024-02-19T21:42:05.188360+0000","last_peered":"2024-02-19T21:42:05.188360+0000","last_clean":"2024-02-19T21:42:05.188360+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:42:05.188360+0000","last_undegraded":"2024-02-19T21:42:05.188360+0000","last_fullsized":"2024-02-19T21:42:05.188360+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:30.692385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:40:30.692385+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":187,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.187947+0000","last_change":"2024-02-19T21:42:04.213108+0000","last_active":"2024-02-19T21:42:05.187947+0000","last_peered":"2024-02-19T21:42:05.187947+0000","last_clean":"2024-02-19T21:42:05.187947+0000","last_became_active":"2024-02-19T21:42:04.212730+0000","last_became_peered":"2024-02-19T21:42:04.212730+0000","last_unstale":"2024-02-19T21:42:05.187947+0000","last_undegraded":"2024-02-19T21:42:05.187947+0000","last_fullsized":"2024-02-19T21:42:05.187947+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:39.714982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:39.714982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":50,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.185331+0000","last_change":"2024-02-19T21:42:04.197235+0000","last_active":"2024-02-19T21:42:05.185331+0000","last_peered":"2024-02-19T21:42:05.185331+0000","last_clean":"2024-02-19T21:42:05.185331+0000","last_became_active":"2024-02-19T21:42:04.196943+0000","last_became_peered":"2024-02-19T21:42:04.196943+0000","last_unstale":"2024-02-19T21:42:05.185331+0000","last_undegraded":"2024-02-19T21:42:05.185331+0000","last_fullsized":"2024-02-19T21:42:05.185331+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:38.927472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:40:38.927472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,1],"acting":[0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"143'21","reported_seq":196,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.204386+0000","last_change":"2024-02-19T21:40:24.331961+0000","last_active":"2024-02-19T21:42:05.204386+0000","last_peered":"2024-02-19T21:42:05.204386+0000","last_clean":"2024-02-19T21:42:05.204386+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:42:05.204386+0000","last_undegraded":"2024-02-19T21:42:05.204386+0000","last_fullsized":"2024-02-19T21:42:05.204386+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"143'21","last_scrub_stamp":"2024-02-19T21:40:24.331869+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:40:24.331869+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":140,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.188085+0000","last_change":"2024-02-19T21:42:04.205688+0000","last_active":"2024-02-19T21:42:05.188085+0000","last_peered":"2024-02-19T21:42:05.188085+0000","last_clean":"2024-02-19T21:42:05.188085+0000","last_became_active":"2024-02-19T21:42:04.205342+0000","last_became_peered":"2024-02-19T21:42:04.205342+0000","last_unstale":"2024-02-19T21:42:05.188085+0000","last_undegraded":"2024-02-19T21:42:05.188085+0000","last_fullsized":"2024-02-19T21:42:05.188085+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:22.826680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:22.826680+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"200'11020","reported_seq":11062,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-02-19T21:42:19.919603+0000","last_change":"2024-02-19T21:39:39.480146+0000","last_active":"2024-02-19T21:42:19.919603+0000","last_peered":"2024-02-19T21:42:19.919603+0000","last_clean":"2024-02-19T21:42:19.919603+0000","last_became_active":"2024-02-19T21:39:39.479576+0000","last_became_peered":"2024-02-19T21:39:39.479576+0000","last_unstale":"2024-02-19T21:42:19.919603+0000","last_undegraded":"2024-02-19T21:42:19.919603+0000","last_fullsized":"2024-02-19T21:42:19.919603+0000","mapping_epoch":165,"log_start":"185'7297","ondisk_log_start":"185'7297","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":3723,"ondisk_log_size":3723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":319815680,"num_objects":4880,"num_object_clones":0,"num_object_copies":14640,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4880,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11020,"num_write_kb":508800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":168,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.196653+0000","last_change":"2024-02-19T21:40:29.250688+0000","last_active":"2024-02-19T21:42:05.196653+0000","last_peered":"2024-02-19T21:42:05.196653+0000","last_clean":"2024-02-19T21:42:05.196653+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:42:05.196653+0000","last_undegraded":"2024-02-19T21:42:05.196653+0000","last_fullsized":"2024-02-19T21:42:05.196653+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:40:29.250599+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":179,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.185425+0000","last_change":"2024-02-19T21:41:22.644476+0000","last_active":"2024-02-19T21:42:05.185425+0000","last_peered":"2024-02-19T21:42:05.185425+0000","last_clean":"2024-02-19T21:42:05.185425+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:42:05.185425+0000","last_undegraded":"2024-02-19T21:42:05.185425+0000","last_fullsized":"2024-02-19T21:42:05.185425+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:22.644405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:41:22.644405+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":164,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195430+0000","last_change":"2024-02-19T21:39:30.117111+0000","last_active":"2024-02-19T21:42:05.195430+0000","last_peered":"2024-02-19T21:42:05.195430+0000","last_clean":"2024-02-19T21:42:05.195430+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:42:05.195430+0000","last_undegraded":"2024-02-19T21:42:05.195430+0000","last_fullsized":"2024-02-19T21:42:05.195430+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:30.117032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:39:30.117032+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"66'12","reported_seq":254,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.186467+0000","last_change":"2024-02-19T21:42:04.647669+0000","last_active":"2024-02-19T21:42:05.186467+0000","last_peered":"2024-02-19T21:42:05.186467+0000","last_clean":"2024-02-19T21:42:05.186467+0000","last_became_active":"2024-02-19T21:42:04.206790+0000","last_became_peered":"2024-02-19T21:42:04.206790+0000","last_unstale":"2024-02-19T21:42:05.186467+0000","last_undegraded":"2024-02-19T21:42:05.186467+0000","last_fullsized":"2024-02-19T21:42:05.186467+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'12","last_scrub_stamp":"2024-02-19T21:38:18.908732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:38:18.908732+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":165,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.188320+0000","last_change":"2024-02-19T21:41:23.683433+0000","last_active":"2024-02-19T21:42:05.188320+0000","last_peered":"2024-02-19T21:42:05.188320+0000","last_clean":"2024-02-19T21:42:05.188320+0000","last_became_active":"2024-02-19T21:32:27.372460+0000","last_became_peered":"2024-02-19T21:32:27.372460+0000","last_unstale":"2024-02-19T21:42:05.188320+0000","last_undegraded":"2024-02-19T21:42:05.188320+0000","last_fullsized":"2024-02-19T21:42:05.188320+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:23.683337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:23.683337+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"200'11046","reported_seq":11089,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-02-19T21:42:19.972818+0000","last_change":"2024-02-19T21:39:39.468511+0000","last_active":"2024-02-19T21:42:19.972818+0000","last_peered":"2024-02-19T21:42:19.972818+0000","last_clean":"2024-02-19T21:42:19.972818+0000","last_became_active":"2024-02-19T21:39:39.468217+0000","last_became_peered":"2024-02-19T21:39:39.468217+0000","last_unstale":"2024-02-19T21:42:19.972818+0000","last_undegraded":"2024-02-19T21:42:19.972818+0000","last_fullsized":"2024-02-19T21:42:19.972818+0000","mapping_epoch":165,"log_start":"173'2412","ondisk_log_start":"173'2412","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":8634,"ondisk_log_size":8634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":311033856,"num_objects":4746,"num_object_clones":0,"num_object_copies":14238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4746,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11046,"num_write_kb":505344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":177,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.197007+0000","last_change":"2024-02-19T21:42:04.193367+0000","last_active":"2024-02-19T21:42:05.197007+0000","last_peered":"2024-02-19T21:42:05.197007+0000","last_clean":"2024-02-19T21:42:05.197007+0000","last_became_active":"2024-02-19T21:42:04.193058+0000","last_became_peered":"2024-02-19T21:42:04.193058+0000","last_unstale":"2024-02-19T21:42:05.197007+0000","last_undegraded":"2024-02-19T21:42:05.197007+0000","last_fullsized":"2024-02-19T21:42:05.197007+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:39:42.020832+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":164,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195735+0000","last_change":"2024-02-19T21:40:11.877814+0000","last_active":"2024-02-19T21:42:05.195735+0000","last_peered":"2024-02-19T21:42:05.195735+0000","last_clean":"2024-02-19T21:42:05.195735+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:42:05.195735+0000","last_undegraded":"2024-02-19T21:42:05.195735+0000","last_fullsized":"2024-02-19T21:42:05.195735+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:11.877751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:11.877751+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"83'27","reported_seq":212,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.185856+0000","last_change":"2024-02-19T21:40:26.405558+0000","last_active":"2024-02-19T21:42:05.185856+0000","last_peered":"2024-02-19T21:42:05.185856+0000","last_clean":"2024-02-19T21:42:05.185856+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:42:05.185856+0000","last_undegraded":"2024-02-19T21:42:05.185856+0000","last_fullsized":"2024-02-19T21:42:05.185856+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'27","last_scrub_stamp":"2024-02-19T21:40:26.405455+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:40:26.405455+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":167,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.204105+0000","last_change":"2024-02-19T21:40:16.260329+0000","last_active":"2024-02-19T21:42:05.204105+0000","last_peered":"2024-02-19T21:42:05.204105+0000","last_clean":"2024-02-19T21:42:05.204105+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:42:05.204105+0000","last_undegraded":"2024-02-19T21:42:05.204105+0000","last_fullsized":"2024-02-19T21:42:05.204105+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:16.260223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:40:16.260223+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.c","version":"200'11258","reported_seq":14228,"reported_epoch":200,"state":"active+remapped+backfilling","last_fresh":"2024-02-19T21:42:20.081984+0000","last_change":"2024-02-19T21:42:05.272068+0000","last_active":"2024-02-19T21:42:20.081984+0000","last_peered":"2024-02-19T21:42:20.081984+0000","last_clean":"2024-02-19T21:42:03.139813+0000","last_became_active":"2024-02-19T21:42:05.246027+0000","last_became_peered":"2024-02-19T21:42:05.246027+0000","last_unstale":"2024-02-19T21:42:20.081984+0000","last_undegraded":"2024-02-19T21:42:20.081984+0000","last_fullsized":"2024-02-19T21:42:20.081984+0000","mapping_epoch":198,"log_start":"185'7064","ondisk_log_start":"185'7064","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4194,"ondisk_log_size":4194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":319422464,"num_objects":4874,"num_object_clones":0,"num_object_copies":14622,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":3536,"num_objects_unfound":0,"num_objects_dirty":4874,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11258,"num_write_kb":516224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1458,"num_bytes_recovered":95551488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,7],"avail_no_missing":["0","3","7"],"object_location_counts":[{"shards":"0,3,7","objects":4874}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":66,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.203787+0000","last_change":"2024-02-19T21:42:04.200629+0000","last_active":"2024-02-19T21:42:05.203787+0000","last_peered":"2024-02-19T21:42:05.203787+0000","last_clean":"2024-02-19T21:42:05.203787+0000","last_became_active":"2024-02-19T21:42:04.200292+0000","last_became_peered":"2024-02-19T21:42:04.200292+0000","last_unstale":"2024-02-19T21:42:05.203787+0000","last_undegraded":"2024-02-19T21:42:05.203787+0000","last_fullsized":"2024-02-19T21:42:05.203787+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:44.231420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:44.231420+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,5],"acting":[6,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":167,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195537+0000","last_change":"2024-02-19T21:38:28.036423+0000","last_active":"2024-02-19T21:42:05.195537+0000","last_peered":"2024-02-19T21:42:05.195537+0000","last_clean":"2024-02-19T21:42:05.195537+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:42:05.195537+0000","last_undegraded":"2024-02-19T21:42:05.195537+0000","last_fullsized":"2024-02-19T21:42:05.195537+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:38:28.036351+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"168'26","reported_seq":130,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.432273+0000","last_change":"2024-02-19T21:42:05.431988+0000","last_active":"2024-02-19T21:42:05.432273+0000","last_peered":"2024-02-19T21:42:05.432273+0000","last_clean":"2024-02-19T21:42:05.432273+0000","last_became_active":"2024-02-19T21:42:04.205907+0000","last_became_peered":"2024-02-19T21:42:04.205907+0000","last_unstale":"2024-02-19T21:42:05.432273+0000","last_undegraded":"2024-02-19T21:42:05.432273+0000","last_fullsized":"2024-02-19T21:42:05.432273+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"168'26","last_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:39:48.004702+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":33,"num_read_kb":21,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":54,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.204728+0000","last_change":"2024-02-19T21:42:04.200909+0000","last_active":"2024-02-19T21:42:05.204728+0000","last_peered":"2024-02-19T21:42:05.204728+0000","last_clean":"2024-02-19T21:42:05.204728+0000","last_became_active":"2024-02-19T21:42:04.200496+0000","last_became_peered":"2024-02-19T21:42:04.200496+0000","last_unstale":"2024-02-19T21:42:05.204728+0000","last_undegraded":"2024-02-19T21:42:05.204728+0000","last_fullsized":"2024-02-19T21:42:05.204728+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:38.697183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:38.697183+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.d","version":"200'10953","reported_seq":15028,"reported_epoch":200,"state":"active+remapped+backfilling","last_fresh":"2024-02-19T21:42:19.934551+0000","last_change":"2024-02-19T21:42:05.325379+0000","last_active":"2024-02-19T21:42:19.934551+0000","last_peered":"2024-02-19T21:42:19.934551+0000","last_clean":"2024-02-19T21:42:03.153144+0000","last_became_active":"2024-02-19T21:42:05.270872+0000","last_became_peered":"2024-02-19T21:42:05.270872+0000","last_unstale":"2024-02-19T21:42:19.934551+0000","last_undegraded":"2024-02-19T21:42:19.934551+0000","last_fullsized":"2024-02-19T21:42:19.934551+0000","mapping_epoch":198,"log_start":"185'6919","ondisk_log_start":"185'6919","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4034,"ondisk_log_size":4034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":317063192,"num_objects":4839,"num_object_clones":0,"num_object_copies":14517,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2996,"num_objects_unfound":0,"num_objects_dirty":4839,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10953,"num_write_kb":505281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2010,"num_bytes_recovered":131727360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,7],"avail_no_missing":["5","6","7"],"object_location_counts":[{"shards":"5,6,7","objects":4839}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":172,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195156+0000","last_change":"2024-02-19T21:40:28.874859+0000","last_active":"2024-02-19T21:42:05.195156+0000","last_peered":"2024-02-19T21:42:05.195156+0000","last_clean":"2024-02-19T21:42:05.195156+0000","last_became_active":"2024-02-19T21:39:39.481908+0000","last_became_peered":"2024-02-19T21:39:39.481908+0000","last_unstale":"2024-02-19T21:42:05.195156+0000","last_undegraded":"2024-02-19T21:42:05.195156+0000","last_fullsized":"2024-02-19T21:42:05.195156+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:28.874762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:28.874762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":187,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.204184+0000","last_change":"2024-02-19T21:42:04.197387+0000","last_active":"2024-02-19T21:42:05.204184+0000","last_peered":"2024-02-19T21:42:05.204184+0000","last_clean":"2024-02-19T21:42:05.204184+0000","last_became_active":"2024-02-19T21:42:04.197048+0000","last_became_peered":"2024-02-19T21:42:04.197048+0000","last_unstale":"2024-02-19T21:42:05.204184+0000","last_undegraded":"2024-02-19T21:42:05.204184+0000","last_fullsized":"2024-02-19T21:42:05.204184+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:32.498434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:32.498434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"66'14","reported_seq":162,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.188296+0000","last_change":"2024-02-19T21:41:31.580765+0000","last_active":"2024-02-19T21:42:05.188296+0000","last_peered":"2024-02-19T21:42:05.188296+0000","last_clean":"2024-02-19T21:42:05.188296+0000","last_became_active":"2024-02-19T21:35:14.513806+0000","last_became_peered":"2024-02-19T21:35:14.513806+0000","last_unstale":"2024-02-19T21:42:05.188296+0000","last_undegraded":"2024-02-19T21:42:05.188296+0000","last_fullsized":"2024-02-19T21:42:05.188296+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'14","last_scrub_stamp":"2024-02-19T21:41:31.580701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:41:31.580701+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":149,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-02-19T21:42:11.974487+0000","last_change":"2024-02-19T21:41:30.192537+0000","last_active":"2024-02-19T21:42:11.974487+0000","last_peered":"2024-02-19T21:42:11.974487+0000","last_clean":"2024-02-19T21:42:11.974487+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:42:11.974487+0000","last_undegraded":"2024-02-19T21:42:11.974487+0000","last_fullsized":"2024-02-19T21:42:11.974487+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'9","last_scrub_stamp":"2024-02-19T21:41:30.192427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:30.192427+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"200'10982","reported_seq":11030,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-02-19T21:42:19.894508+0000","last_change":"2024-02-19T21:41:29.552859+0000","last_active":"2024-02-19T21:42:19.894508+0000","last_peered":"2024-02-19T21:42:19.894508+0000","last_clean":"2024-02-19T21:42:19.894508+0000","last_became_active":"2024-02-19T21:39:39.471580+0000","last_became_peered":"2024-02-19T21:39:39.471580+0000","last_unstale":"2024-02-19T21:42:19.894508+0000","last_undegraded":"2024-02-19T21:42:19.894508+0000","last_fullsized":"2024-02-19T21:42:19.894508+0000","mapping_epoch":165,"log_start":"185'6552","ondisk_log_start":"185'6552","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"187'8036","last_scrub_stamp":"2024-02-19T21:41:29.552760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:41:29.552760+0000","log_size":4430,"ondisk_log_size":4430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":311951360,"num_objects":4760,"num_object_clones":0,"num_object_copies":14280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4760,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10982,"num_write_kb":503744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":49,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.204155+0000","last_change":"2024-02-19T21:40:21.371352+0000","last_active":"2024-02-19T21:42:05.204155+0000","last_peered":"2024-02-19T21:42:05.204155+0000","last_clean":"2024-02-19T21:42:05.204155+0000","last_became_active":"2024-02-19T21:39:39.477051+0000","last_became_peered":"2024-02-19T21:39:39.477051+0000","last_unstale":"2024-02-19T21:42:05.204155+0000","last_undegraded":"2024-02-19T21:42:05.204155+0000","last_fullsized":"2024-02-19T21:42:05.204155+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:21.371240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:40:21.371240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":165,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.188324+0000","last_change":"2024-02-19T21:40:22.774178+0000","last_active":"2024-02-19T21:42:05.188324+0000","last_peered":"2024-02-19T21:42:05.188324+0000","last_clean":"2024-02-19T21:42:05.188324+0000","last_became_active":"2024-02-19T21:32:27.362497+0000","last_became_peered":"2024-02-19T21:32:27.362497+0000","last_unstale":"2024-02-19T21:42:05.188324+0000","last_undegraded":"2024-02-19T21:42:05.188324+0000","last_fullsized":"2024-02-19T21:42:05.188324+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:22.774081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:22.774081+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":176,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195512+0000","last_change":"2024-02-19T21:40:41.901768+0000","last_active":"2024-02-19T21:42:05.195512+0000","last_peered":"2024-02-19T21:42:05.195512+0000","last_clean":"2024-02-19T21:42:05.195512+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:42:05.195512+0000","last_undegraded":"2024-02-19T21:42:05.195512+0000","last_fullsized":"2024-02-19T21:42:05.195512+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:40:41.901670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:41.901670+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"66'11","reported_seq":181,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.204284+0000","last_change":"2024-02-19T21:40:26.390284+0000","last_active":"2024-02-19T21:42:05.204284+0000","last_peered":"2024-02-19T21:42:05.204284+0000","last_clean":"2024-02-19T21:42:05.204284+0000","last_became_active":"2024-02-19T21:39:51.536649+0000","last_became_peered":"2024-02-19T21:39:51.536649+0000","last_unstale":"2024-02-19T21:42:05.204284+0000","last_undegraded":"2024-02-19T21:42:05.204284+0000","last_fullsized":"2024-02-19T21:42:05.204284+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:40:26.390173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:26.390173+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"200'11271","reported_seq":11314,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-02-19T21:42:19.943241+0000","last_change":"2024-02-19T21:39:39.479591+0000","last_active":"2024-02-19T21:42:19.943241+0000","last_peered":"2024-02-19T21:42:19.943241+0000","last_clean":"2024-02-19T21:42:19.943241+0000","last_became_active":"2024-02-19T21:39:39.479224+0000","last_became_peered":"2024-02-19T21:39:39.479224+0000","last_unstale":"2024-02-19T21:42:19.943241+0000","last_undegraded":"2024-02-19T21:42:19.943241+0000","last_fullsized":"2024-02-19T21:42:19.943241+0000","mapping_epoch":165,"log_start":"185'7491","ondisk_log_start":"185'7491","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":3780,"ondisk_log_size":3780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":319225856,"num_objects":4871,"num_object_clones":0,"num_object_copies":14613,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4871,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11271,"num_write_kb":516544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":163,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.190359+0000","last_change":"2024-02-19T21:40:16.845431+0000","last_active":"2024-02-19T21:42:05.190359+0000","last_peered":"2024-02-19T21:42:05.190359+0000","last_clean":"2024-02-19T21:42:05.190359+0000","last_became_active":"2024-02-19T21:32:29.378462+0000","last_became_peered":"2024-02-19T21:32:29.378462+0000","last_unstale":"2024-02-19T21:42:05.190359+0000","last_undegraded":"2024-02-19T21:42:05.190359+0000","last_fullsized":"2024-02-19T21:42:05.190359+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:16.845272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:16.845272+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"98'9","reported_seq":240,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-02-19T21:42:11.976213+0000","last_change":"2024-02-19T21:41:30.610945+0000","last_active":"2024-02-19T21:42:11.976213+0000","last_peered":"2024-02-19T21:42:11.976213+0000","last_clean":"2024-02-19T21:42:11.976213+0000","last_became_active":"2024-02-19T21:35:14.513802+0000","last_became_peered":"2024-02-19T21:35:14.513802+0000","last_unstale":"2024-02-19T21:42:11.976213+0000","last_undegraded":"2024-02-19T21:42:11.976213+0000","last_fullsized":"2024-02-19T21:42:11.976213+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'9","last_scrub_stamp":"2024-02-19T21:41:30.610855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:30.610855+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":170,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.196900+0000","last_change":"2024-02-19T21:40:14.294150+0000","last_active":"2024-02-19T21:42:05.196900+0000","last_peered":"2024-02-19T21:42:05.196900+0000","last_clean":"2024-02-19T21:42:05.196900+0000","last_became_active":"2024-02-19T21:32:23.362738+0000","last_became_peered":"2024-02-19T21:32:23.362738+0000","last_unstale":"2024-02-19T21:42:05.196900+0000","last_undegraded":"2024-02-19T21:42:05.196900+0000","last_fullsized":"2024-02-19T21:42:05.196900+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:14.294064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:40:14.294064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"66'15","reported_seq":61,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.187998+0000","last_change":"2024-02-19T21:40:12.838278+0000","last_active":"2024-02-19T21:42:05.187998+0000","last_peered":"2024-02-19T21:42:05.187998+0000","last_clean":"2024-02-19T21:42:05.187998+0000","last_became_active":"2024-02-19T21:39:51.539230+0000","last_became_peered":"2024-02-19T21:39:51.539230+0000","last_unstale":"2024-02-19T21:42:05.187998+0000","last_undegraded":"2024-02-19T21:42:05.187998+0000","last_fullsized":"2024-02-19T21:42:05.187998+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:40:12.838083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:12.838083+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.0","version":"200'11202","reported_seq":11249,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-02-19T21:42:19.981738+0000","last_change":"2024-02-19T21:41:41.239560+0000","last_active":"2024-02-19T21:42:19.981738+0000","last_peered":"2024-02-19T21:42:19.981738+0000","last_clean":"2024-02-19T21:42:19.981738+0000","last_became_active":"2024-02-19T21:39:39.465196+0000","last_became_peered":"2024-02-19T21:39:39.465196+0000","last_unstale":"2024-02-19T21:42:19.981738+0000","last_undegraded":"2024-02-19T21:42:19.981738+0000","last_fullsized":"2024-02-19T21:42:19.981738+0000","mapping_epoch":165,"log_start":"173'2627","ondisk_log_start":"173'2627","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":8575,"ondisk_log_size":8575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":318111744,"num_objects":4854,"num_object_clones":0,"num_object_copies":14562,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4854,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11202,"num_write_kb":513792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":133,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195699+0000","last_change":"2024-02-19T21:39:40.016015+0000","last_active":"2024-02-19T21:42:05.195699+0000","last_peered":"2024-02-19T21:42:05.195699+0000","last_clean":"2024-02-19T21:42:05.195699+0000","last_became_active":"2024-02-19T21:39:39.479567+0000","last_became_peered":"2024-02-19T21:39:39.479567+0000","last_unstale":"2024-02-19T21:42:05.195699+0000","last_undegraded":"2024-02-19T21:42:05.195699+0000","last_fullsized":"2024-02-19T21:42:05.195699+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:40.015907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:40.015907+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"170'11","reported_seq":154,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-02-19T21:42:11.976722+0000","last_change":"2024-02-19T21:40:21.864057+0000","last_active":"2024-02-19T21:42:11.976722+0000","last_peered":"2024-02-19T21:42:11.976722+0000","last_clean":"2024-02-19T21:42:11.976722+0000","last_became_active":"2024-02-19T21:39:51.534304+0000","last_became_peered":"2024-02-19T21:39:51.534304+0000","last_unstale":"2024-02-19T21:42:11.976722+0000","last_undegraded":"2024-02-19T21:42:11.976722+0000","last_fullsized":"2024-02-19T21:42:11.976722+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'11","last_scrub_stamp":"2024-02-19T21:40:21.863959+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:40:21.863959+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":167,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.196365+0000","last_change":"2024-02-19T21:39:31.018063+0000","last_active":"2024-02-19T21:42:05.196365+0000","last_peered":"2024-02-19T21:42:05.196365+0000","last_clean":"2024-02-19T21:42:05.196365+0000","last_became_active":"2024-02-19T21:32:23.363155+0000","last_became_peered":"2024-02-19T21:32:23.363155+0000","last_unstale":"2024-02-19T21:42:05.196365+0000","last_undegraded":"2024-02-19T21:42:05.196365+0000","last_fullsized":"2024-02-19T21:42:05.196365+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:31.018000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:39:31.018000+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"66'10","reported_seq":156,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195283+0000","last_change":"2024-02-19T21:41:21.872187+0000","last_active":"2024-02-19T21:42:05.195283+0000","last_peered":"2024-02-19T21:42:05.195283+0000","last_clean":"2024-02-19T21:42:05.195283+0000","last_became_active":"2024-02-19T21:35:14.514968+0000","last_became_peered":"2024-02-19T21:35:14.514968+0000","last_unstale":"2024-02-19T21:42:05.195283+0000","last_undegraded":"2024-02-19T21:42:05.195283+0000","last_fullsized":"2024-02-19T21:42:05.195283+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:41:21.872058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:41:21.872058+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6],"acting":[3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"200'11052","reported_seq":11095,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-02-19T21:42:19.951002+0000","last_change":"2024-02-19T21:39:39.480753+0000","last_active":"2024-02-19T21:42:19.951002+0000","last_peered":"2024-02-19T21:42:19.951002+0000","last_clean":"2024-02-19T21:42:19.951002+0000","last_became_active":"2024-02-19T21:39:39.480509+0000","last_became_peered":"2024-02-19T21:39:39.480509+0000","last_unstale":"2024-02-19T21:42:19.951002+0000","last_undegraded":"2024-02-19T21:42:19.951002+0000","last_fullsized":"2024-02-19T21:42:19.951002+0000","mapping_epoch":165,"log_start":"185'7306","ondisk_log_start":"185'7306","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":3746,"ondisk_log_size":3746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":318242816,"num_objects":4856,"num_object_clones":0,"num_object_copies":14568,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4856,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11052,"num_write_kb":509056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":159,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.204194+0000","last_change":"2024-02-19T21:41:36.725762+0000","last_active":"2024-02-19T21:42:05.204194+0000","last_peered":"2024-02-19T21:42:05.204194+0000","last_clean":"2024-02-19T21:42:05.204194+0000","last_became_active":"2024-02-19T21:39:39.469058+0000","last_became_peered":"2024-02-19T21:39:39.469058+0000","last_unstale":"2024-02-19T21:42:05.204194+0000","last_undegraded":"2024-02-19T21:42:05.204194+0000","last_fullsized":"2024-02-19T21:42:05.204194+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:36.725664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:41:36.725664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":161,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.196739+0000","last_change":"2024-02-19T21:39:39.002316+0000","last_active":"2024-02-19T21:42:05.196739+0000","last_peered":"2024-02-19T21:42:05.196739+0000","last_clean":"2024-02-19T21:42:05.196739+0000","last_became_active":"2024-02-19T21:32:27.369452+0000","last_became_peered":"2024-02-19T21:32:27.369452+0000","last_unstale":"2024-02-19T21:42:05.196739+0000","last_undegraded":"2024-02-19T21:42:05.196739+0000","last_fullsized":"2024-02-19T21:42:05.196739+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:39.002258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:39.002258+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":171,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195011+0000","last_change":"2024-02-19T21:40:32.869530+0000","last_active":"2024-02-19T21:42:05.195011+0000","last_peered":"2024-02-19T21:42:05.195011+0000","last_clean":"2024-02-19T21:42:05.195011+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:42:05.195011+0000","last_undegraded":"2024-02-19T21:42:05.195011+0000","last_fullsized":"2024-02-19T21:42:05.195011+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:32.869462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:40:32.869462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"66'17","reported_seq":104,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195596+0000","last_change":"2024-02-19T21:39:39.501787+0000","last_active":"2024-02-19T21:42:05.195596+0000","last_peered":"2024-02-19T21:42:05.195596+0000","last_clean":"2024-02-19T21:42:05.195596+0000","last_became_active":"2024-02-19T21:39:39.474668+0000","last_became_peered":"2024-02-19T21:39:39.474668+0000","last_unstale":"2024-02-19T21:42:05.195596+0000","last_undegraded":"2024-02-19T21:42:05.195596+0000","last_fullsized":"2024-02-19T21:42:05.195596+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'17","last_scrub_stamp":"2024-02-19T21:38:19.154753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:38:19.154753+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"200'11188","reported_seq":11231,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-02-19T21:42:20.073475+0000","last_change":"2024-02-19T21:39:39.471363+0000","last_active":"2024-02-19T21:42:20.073475+0000","last_peered":"2024-02-19T21:42:20.073475+0000","last_clean":"2024-02-19T21:42:20.073475+0000","last_became_active":"2024-02-19T21:39:39.470667+0000","last_became_peered":"2024-02-19T21:39:39.470667+0000","last_unstale":"2024-02-19T21:42:20.073475+0000","last_undegraded":"2024-02-19T21:42:20.073475+0000","last_fullsized":"2024-02-19T21:42:20.073475+0000","mapping_epoch":165,"log_start":"185'7027","ondisk_log_start":"185'7027","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4161,"ondisk_log_size":4161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":316014592,"num_objects":4822,"num_object_clones":0,"num_object_copies":14466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4822,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11188,"num_write_kb":512320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":138,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.194903+0000","last_change":"2024-02-19T21:42:04.193922+0000","last_active":"2024-02-19T21:42:05.194903+0000","last_peered":"2024-02-19T21:42:05.194903+0000","last_clean":"2024-02-19T21:42:05.194903+0000","last_became_active":"2024-02-19T21:42:04.193565+0000","last_became_peered":"2024-02-19T21:42:04.193565+0000","last_unstale":"2024-02-19T21:42:05.194903+0000","last_undegraded":"2024-02-19T21:42:05.194903+0000","last_fullsized":"2024-02-19T21:42:05.194903+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:36.890201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.890201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":60,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.185813+0000","last_change":"2024-02-19T21:42:04.205186+0000","last_active":"2024-02-19T21:42:05.185813+0000","last_peered":"2024-02-19T21:42:05.185813+0000","last_clean":"2024-02-19T21:42:05.185813+0000","last_became_active":"2024-02-19T21:42:04.204839+0000","last_became_peered":"2024-02-19T21:42:04.204839+0000","last_unstale":"2024-02-19T21:42:05.185813+0000","last_undegraded":"2024-02-19T21:42:05.185813+0000","last_fullsized":"2024-02-19T21:42:05.185813+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:23.324303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:46.372184+0000","last_clean_scrub_stamp":"2024-02-19T21:40:23.324303+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":64,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.188162+0000","last_change":"2024-02-19T21:40:28.696870+0000","last_active":"2024-02-19T21:42:05.188162+0000","last_peered":"2024-02-19T21:42:05.188162+0000","last_clean":"2024-02-19T21:42:05.188162+0000","last_became_active":"2024-02-19T21:39:39.479752+0000","last_became_peered":"2024-02-19T21:39:39.479752+0000","last_unstale":"2024-02-19T21:42:05.188162+0000","last_undegraded":"2024-02-19T21:42:05.188162+0000","last_fullsized":"2024-02-19T21:42:05.188162+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:40:28.696783+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"115'28","reported_seq":238,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.203987+0000","last_change":"2024-02-19T21:42:04.985140+0000","last_active":"2024-02-19T21:42:05.203987+0000","last_peered":"2024-02-19T21:42:05.203987+0000","last_clean":"2024-02-19T21:42:05.203987+0000","last_became_active":"2024-02-19T21:42:04.200393+0000","last_became_peered":"2024-02-19T21:42:04.200393+0000","last_unstale":"2024-02-19T21:42:05.203987+0000","last_undegraded":"2024-02-19T21:42:05.203987+0000","last_fullsized":"2024-02-19T21:42:05.203987+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'28","last_scrub_stamp":"2024-02-19T21:39:40.282677+0000","last_deep_scrub":"115'28","last_deep_scrub_stamp":"2024-02-19T21:36:09.031674+0000","last_clean_scrub_stamp":"2024-02-19T21:39:40.282677+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.7","version":"200'11002","reported_seq":11045,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-02-19T21:42:19.872405+0000","last_change":"2024-02-19T21:39:39.463794+0000","last_active":"2024-02-19T21:42:19.872405+0000","last_peered":"2024-02-19T21:42:19.872405+0000","last_clean":"2024-02-19T21:42:19.872405+0000","last_became_active":"2024-02-19T21:39:39.463542+0000","last_became_peered":"2024-02-19T21:39:39.463542+0000","last_unstale":"2024-02-19T21:42:19.872405+0000","last_undegraded":"2024-02-19T21:42:19.872405+0000","last_fullsized":"2024-02-19T21:42:19.872405+0000","mapping_epoch":165,"log_start":"185'7258","ondisk_log_start":"185'7258","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":3744,"ondisk_log_size":3744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":315359232,"num_objects":4812,"num_object_clones":0,"num_object_copies":14436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4812,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11002,"num_write_kb":506048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,6],"acting":[1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":173,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.185527+0000","last_change":"2024-02-19T21:39:42.230802+0000","last_active":"2024-02-19T21:42:05.185527+0000","last_peered":"2024-02-19T21:42:05.185527+0000","last_clean":"2024-02-19T21:42:05.185527+0000","last_became_active":"2024-02-19T21:39:39.470671+0000","last_became_peered":"2024-02-19T21:39:39.470671+0000","last_unstale":"2024-02-19T21:42:05.185527+0000","last_undegraded":"2024-02-19T21:42:05.185527+0000","last_fullsized":"2024-02-19T21:42:05.185527+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:42.230664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:42.230664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":156,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.185036+0000","last_change":"2024-02-19T21:40:40.799240+0000","last_active":"2024-02-19T21:42:05.185036+0000","last_peered":"2024-02-19T21:42:05.185036+0000","last_clean":"2024-02-19T21:42:05.185036+0000","last_became_active":"2024-02-19T21:39:39.468109+0000","last_became_peered":"2024-02-19T21:39:39.468109+0000","last_unstale":"2024-02-19T21:42:05.185036+0000","last_undegraded":"2024-02-19T21:42:05.185036+0000","last_fullsized":"2024-02-19T21:42:05.185036+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:40.799141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:40.799141+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1],"acting":[4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":165,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.195736+0000","last_change":"2024-02-19T21:37:36.883246+0000","last_active":"2024-02-19T21:42:05.195736+0000","last_peered":"2024-02-19T21:42:05.195736+0000","last_clean":"2024-02-19T21:42:05.195736+0000","last_became_active":"2024-02-19T21:32:23.357438+0000","last_became_peered":"2024-02-19T21:32:23.357438+0000","last_unstale":"2024-02-19T21:42:05.195736+0000","last_undegraded":"2024-02-19T21:42:05.195736+0000","last_fullsized":"2024-02-19T21:42:05.195736+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:36.883151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:37:36.883151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"66'9","reported_seq":184,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.185938+0000","last_change":"2024-02-19T21:39:36.193250+0000","last_active":"2024-02-19T21:42:05.185938+0000","last_peered":"2024-02-19T21:42:05.185938+0000","last_clean":"2024-02-19T21:42:05.185938+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:42:05.185938+0000","last_undegraded":"2024-02-19T21:42:05.185938+0000","last_fullsized":"2024-02-19T21:42:05.185938+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:39:36.193184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:36.193184+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"200'11376","reported_seq":11419,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-02-19T21:42:19.906263+0000","last_change":"2024-02-19T21:39:39.474614+0000","last_active":"2024-02-19T21:42:19.906263+0000","last_peered":"2024-02-19T21:42:19.906263+0000","last_clean":"2024-02-19T21:42:19.906263+0000","last_became_active":"2024-02-19T21:39:39.474311+0000","last_became_peered":"2024-02-19T21:39:39.474311+0000","last_unstale":"2024-02-19T21:42:19.906263+0000","last_undegraded":"2024-02-19T21:42:19.906263+0000","last_fullsized":"2024-02-19T21:42:19.906263+0000","mapping_epoch":165,"log_start":"185'7428","ondisk_log_start":"185'7428","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":3948,"ondisk_log_size":3948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":316932096,"num_objects":4836,"num_object_clones":0,"num_object_copies":14508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4836,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11376,"num_write_kb":518784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":163,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.187809+0000","last_change":"2024-02-19T21:40:17.853102+0000","last_active":"2024-02-19T21:42:05.187809+0000","last_peered":"2024-02-19T21:42:05.187809+0000","last_clean":"2024-02-19T21:42:05.187809+0000","last_became_active":"2024-02-19T21:32:29.597248+0000","last_became_peered":"2024-02-19T21:32:29.597248+0000","last_unstale":"2024-02-19T21:42:05.187809+0000","last_undegraded":"2024-02-19T21:42:05.187809+0000","last_fullsized":"2024-02-19T21:42:05.187809+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:17.853016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:40:17.853016+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":126,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.204489+0000","last_change":"2024-02-19T21:42:04.200518+0000","last_active":"2024-02-19T21:42:05.204489+0000","last_peered":"2024-02-19T21:42:05.204489+0000","last_clean":"2024-02-19T21:42:05.204489+0000","last_became_active":"2024-02-19T21:42:04.199889+0000","last_became_peered":"2024-02-19T21:42:04.199889+0000","last_unstale":"2024-02-19T21:42:05.204489+0000","last_undegraded":"2024-02-19T21:42:05.204489+0000","last_fullsized":"2024-02-19T21:42:05.204489+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:40:29.858805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"66'15","reported_seq":219,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-02-19T21:42:05.598070+0000","last_change":"2024-02-19T21:42:05.597864+0000","last_active":"2024-02-19T21:42:05.598070+0000","last_peered":"2024-02-19T21:42:05.598070+0000","last_clean":"2024-02-19T21:42:05.598070+0000","last_became_active":"2024-02-19T21:42:04.212731+0000","last_became_peered":"2024-02-19T21:42:04.212731+0000","last_unstale":"2024-02-19T21:42:05.598070+0000","last_undegraded":"2024-02-19T21:42:05.598070+0000","last_fullsized":"2024-02-19T21:42:05.598070+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:40:23.751886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:23.751886+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"66'8","reported_seq":292,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-02-19T21:42:11.976444+0000","last_change":"2024-02-19T21:40:19.870350+0000","last_active":"2024-02-19T21:42:11.976444+0000","last_peered":"2024-02-19T21:42:11.976444+0000","last_clean":"2024-02-19T21:42:11.976444+0000","last_became_active":"2024-02-19T21:32:27.369840+0000","last_became_peered":"2024-02-19T21:32:27.369840+0000","last_unstale":"2024-02-19T21:42:11.976444+0000","last_undegraded":"2024-02-19T21:42:11.976444+0000","last_fullsized":"2024-02-19T21:42:11.976444+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:40:19.870250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:19.870250+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":5062393880,"num_objects":77247,"num_object_clones":0,"num_object_copies":231741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":15716,"num_objects_unfound":0,"num_objects_dirty":77247,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":178185,"num_write_kb":8173761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4034,"num_bytes_recovered":264306688,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15428694016,"data_stored":15428681800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74009,"ondisk_log_size":74009,"up":48,"acting":48,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":583,"num_read_kb":578,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":687,"num_read_kb":444,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":3604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":455,"ondisk_log_size":455,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201402,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2497784,"kb_used_data":2192368,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":91247368,"statfs":{"total":95995035648,"available":93437304832,"internally_reserved":0,"allocated":2244984832,"data_stored":2244689415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:41:29 2024","interfaces":[{"interface":"back","average":{"1min":3.2519999999999998,"5min":1.593,"15min":0.92600000000000005},"min":{"1min":0.19800000000000001,"5min":0.189,"15min":0.189},"max":{"1min":13.645,"5min":13.645,"15min":13.645},"last":1.6060000000000001},{"interface":"front","average":{"1min":2.7949999999999999,"5min":1.7969999999999999,"15min":1.026},"min":{"1min":0.27600000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":14.212999999999999,"5min":14.212999999999999,"15min":14.212999999999999},"last":0.28799999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:41:29 2024","interfaces":[{"interface":"back","average":{"1min":3.7810000000000001,"5min":2.3149999999999999,"15min":1.157},"min":{"1min":0.47699999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":14.246,"5min":14.246,"15min":14.246},"last":0.26800000000000002},{"interface":"front","average":{"1min":2.5009999999999999,"5min":1.607,"15min":0.93200000000000005},"min":{"1min":0.23599999999999999,"5min":0.223,"15min":0.223},"max":{"1min":14.143000000000001,"5min":14.143000000000001,"15min":14.143000000000001},"last":1.635}]},{"osd":2,"last update":"Mon Feb 19 21:41:29 2024","interfaces":[{"interface":"back","average":{"1min":2.6269999999999998,"5min":1.6659999999999999,"15min":0.97099999999999997},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":7.6210000000000004,"5min":7.6210000000000004,"15min":7.6210000000000004},"last":1.7549999999999999},{"interface":"front","average":{"1min":2.9399999999999999,"5min":2.23,"15min":1.129},"min":{"1min":0.34999999999999998,"5min":0.28000000000000003,"15min":0.27800000000000002},"max":{"1min":7.4359999999999999,"5min":9.7010000000000005,"15min":9.7010000000000005},"last":4.835}]},{"osd":3,"last update":"Mon Feb 19 21:41:29 2024","interfaces":[{"interface":"back","average":{"1min":2.6899999999999999,"5min":2.6539999999999999,"15min":1.3149999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.26900000000000002},"max":{"1min":7.5940000000000003,"5min":31.559000000000001,"15min":31.559000000000001},"last":1.7829999999999999},{"interface":"front","average":{"1min":2.7679999999999998,"5min":2.5720000000000001,"15min":1.248},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":7.4660000000000002,"5min":30.812999999999999,"15min":30.812999999999999},"last":0.39200000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:41:29 2024","interfaces":[{"interface":"back","average":{"1min":2.7090000000000001,"5min":1.1910000000000001,"15min":0.71099999999999997},"min":{"1min":0.26500000000000001,"5min":0.247,"15min":0.247},"max":{"1min":8.9309999999999992,"5min":8.9309999999999992,"15min":8.9309999999999992},"last":0.44500000000000001},{"interface":"front","average":{"1min":3.9889999999999999,"5min":1.5640000000000001,"15min":0.84199999999999997},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.245},"max":{"1min":11.541,"5min":11.541,"15min":11.541},"last":8.4789999999999992}]},{"osd":5,"last update":"Mon Feb 19 21:41:29 2024","interfaces":[{"interface":"back","average":{"1min":2.9129999999999998,"5min":1.474,"15min":0.89800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":10.090999999999999,"5min":10.090999999999999,"15min":10.090999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":3.0329999999999999,"5min":1.462,"15min":0.82799999999999996},"min":{"1min":0.34399999999999997,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":9.3599999999999994,"5min":10.175000000000001,"15min":10.175000000000001},"last":0.63200000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:41:29 2024","interfaces":[{"interface":"back","average":{"1min":2.4350000000000001,"5min":1.21,"15min":0.76500000000000001},"min":{"1min":0.32200000000000001,"5min":0.32100000000000001,"15min":0.30299999999999999},"max":{"1min":8.9740000000000002,"5min":8.9740000000000002,"15min":8.9740000000000002},"last":1.6759999999999999},{"interface":"front","average":{"1min":3.3889999999999998,"5min":1.5529999999999999,"15min":1.081},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.29699999999999999},"max":{"1min":11.645,"5min":11.645,"15min":11.645},"last":1.7110000000000001}]}]},{"osd":6,"up_from":47,"seq":201863463041,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2483920,"kb_used_data":2186696,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":91261232,"statfs":{"total":95995035648,"available":93451501568,"internally_reserved":0,"allocated":2239176704,"data_stored":2238856771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:42:11 2024","interfaces":[{"interface":"back","average":{"1min":2.5449999999999999,"5min":2.0710000000000002,"15min":1.135},"min":{"1min":0.23400000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":18.673999999999999,"5min":18.673999999999999,"15min":18.673999999999999},"last":0.497},{"interface":"front","average":{"1min":2.581,"5min":2.2789999999999999,"15min":1.21},"min":{"1min":0.23499999999999999,"5min":0.221,"15min":0.221},"max":{"1min":20.548999999999999,"5min":20.548999999999999,"15min":20.548999999999999},"last":2.7509999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:42:11 2024","interfaces":[{"interface":"back","average":{"1min":1.792,"5min":1.706,"15min":1.0649999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":9.2439999999999998,"5min":11.122999999999999,"15min":12.574999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.5960000000000001,"5min":1.7070000000000001,"15min":0.96999999999999997},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":6.0499999999999998,"5min":11.19,"15min":11.19},"last":2.98}]},{"osd":2,"last update":"Mon Feb 19 21:42:11 2024","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.694,"15min":0.98799999999999999},"min":{"1min":0.28599999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":6.1109999999999998,"5min":8.3849999999999998,"15min":8.3849999999999998},"last":2.8860000000000001},{"interface":"front","average":{"1min":1.698,"5min":1.8280000000000001,"15min":1.0620000000000001},"min":{"1min":0.29299999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":8.5259999999999998,"5min":8.5259999999999998,"15min":18.068000000000001},"last":2.8319999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:42:11 2024","interfaces":[{"interface":"back","average":{"1min":1.946,"5min":1.8280000000000001,"15min":1.0960000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":9.2699999999999996,"5min":11.15,"15min":11.15},"last":0.52900000000000003},{"interface":"front","average":{"1min":1.494,"5min":1.7490000000000001,"15min":1.0669999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.246},"max":{"1min":6.0890000000000004,"5min":19.632999999999999,"15min":19.632999999999999},"last":2.915}]},{"osd":4,"last update":"Mon Feb 19 21:42:11 2024","interfaces":[{"interface":"back","average":{"1min":2.3109999999999999,"5min":1.704,"15min":0.85899999999999999},"min":{"1min":0.27300000000000002,"5min":0.247,"15min":0.247},"max":{"1min":8.5920000000000005,"5min":9.3759999999999994,"15min":9.3759999999999994},"last":3.0099999999999998},{"interface":"front","average":{"1min":2.3140000000000001,"5min":1.653,"15min":0.85599999999999998},"min":{"1min":0.28999999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":9.8140000000000001,"5min":16.594999999999999,"15min":16.594999999999999},"last":0.46300000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:42:11 2024","interfaces":[{"interface":"back","average":{"1min":2.6760000000000002,"5min":1.744,"15min":0.88800000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":8.6159999999999997,"5min":8.6159999999999997,"15min":8.6159999999999997},"last":2.7839999999999998},{"interface":"front","average":{"1min":2.6749999999999998,"5min":1.9419999999999999,"15min":0.95799999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.27900000000000003},"max":{"1min":15.497999999999999,"5min":15.497999999999999,"15min":15.497999999999999},"last":1.4610000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:41:29 2024","interfaces":[{"interface":"back","average":{"1min":3.5550000000000002,"5min":1.6100000000000001,"15min":0.88400000000000001},"min":{"1min":0.40100000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":14.721,"5min":14.721,"15min":14.721},"last":0.57999999999999996},{"interface":"front","average":{"1min":3.5920000000000001,"5min":1.6799999999999999,"15min":0.94799999999999995},"min":{"1min":0.47099999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":14.744999999999999,"5min":14.744999999999999,"15min":14.744999999999999},"last":0.60499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2604580,"kb_used_data":2295068,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":91140572,"statfs":{"total":95995035648,"available":93327945728,"internally_reserved":0,"allocated":2350149632,"data_stored":2349810725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:41:56 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":2.1779999999999999,"15min":1.1479999999999999},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":3.8399999999999999,"5min":42.776000000000003,"15min":42.776000000000003},"last":3.5960000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":2.379,"15min":1.137},"min":{"1min":0.19600000000000001,"5min":0.187,"15min":0.185},"max":{"1min":4.5110000000000001,"5min":44.845999999999997,"15min":44.845999999999997},"last":1.798}]},{"osd":2,"last update":"Mon Feb 19 21:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":1.8460000000000001,"15min":1.0089999999999999},"min":{"1min":0.23899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":2.8490000000000002,"5min":11.161,"15min":11.826000000000001},"last":3.6190000000000002},{"interface":"front","average":{"1min":1.359,"5min":2.1960000000000002,"15min":1.1519999999999999},"min":{"1min":0.26000000000000001,"5min":0.215,"15min":0.215},"max":{"1min":4.6180000000000003,"5min":12.26,"15min":12.26},"last":1.583}]},{"osd":3,"last update":"Mon Feb 19 21:41:56 2024","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":2.3439999999999999,"15min":1.2709999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":8.3469999999999995,"5min":41.607999999999997,"15min":41.607999999999997},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.204,"5min":1.9259999999999999,"15min":1.075},"min":{"1min":0.23499999999999999,"5min":0.217,"15min":0.217},"max":{"1min":3.9140000000000001,"5min":42.811999999999998,"15min":42.811999999999998},"last":3.5680000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:41:20 2024","interfaces":[{"interface":"back","average":{"1min":2.133,"5min":1.546,"15min":0.92600000000000005},"min":{"1min":0.33800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":5.5880000000000001,"5min":11.23,"15min":11.23},"last":3.4700000000000002},{"interface":"front","average":{"1min":2.3540000000000001,"5min":1.887,"15min":1.056},"min":{"1min":0.34000000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":6.4169999999999998,"5min":10.51,"15min":10.51},"last":1.0189999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:41:43 2024","interfaces":[{"interface":"back","average":{"1min":2.9710000000000001,"5min":1.863,"15min":1.0780000000000001},"min":{"1min":0.373,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":8.0760000000000005,"5min":8.0760000000000005,"15min":10.458},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.927,"5min":1.675,"15min":1.016},"min":{"1min":0.38500000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":4.7359999999999998,"5min":7.6950000000000003,"15min":7.6950000000000003},"last":0.92500000000000004}]},{"osd":6,"last update":"Mon Feb 19 21:42:14 2024","interfaces":[{"interface":"back","average":{"1min":2.8050000000000002,"5min":1.9650000000000001,"15min":1.1259999999999999},"min":{"1min":0.40999999999999998,"5min":0.33900000000000002,"15min":0.30099999999999999},"max":{"1min":10.291,"5min":11.638999999999999,"15min":11.638999999999999},"last":3.5110000000000001},{"interface":"front","average":{"1min":2.6930000000000001,"5min":1.835,"15min":1.139},"min":{"1min":0.32900000000000001,"5min":0.316,"15min":0.316},"max":{"1min":12.199,"5min":12.199,"15min":12.199},"last":0.94899999999999995}]},{"osd":7,"last update":"Mon Feb 19 21:41:31 2024","interfaces":[{"interface":"back","average":{"1min":2.1509999999999998,"5min":1.798,"15min":1.1040000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":5.54,"5min":7.718,"15min":10.638999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":2.1829999999999998,"5min":1.6779999999999999,"15min":1.0069999999999999},"min":{"1min":0.39500000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":7.2069999999999999,"5min":11.276,"15min":11.276},"last":3.5419999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738529,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2498644,"kb_used_data":2189068,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":91246508,"statfs":{"total":95995035648,"available":93436424192,"internally_reserved":0,"allocated":2241605632,"data_stored":2241282623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:41:58 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":1.657,"15min":0.86799999999999999},"min":{"1min":0.20000000000000001,"5min":0.19900000000000001,"15min":0.17499999999999999},"max":{"1min":4.5640000000000001,"5min":16.478000000000002,"15min":16.478000000000002},"last":1.869},{"interface":"front","average":{"1min":0.69199999999999995,"5min":1.883,"15min":1.071},"min":{"1min":0.20799999999999999,"5min":0.188,"15min":0.188},"max":{"1min":2.4489999999999998,"5min":13.422000000000001,"15min":13.422000000000001},"last":2.3300000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:41:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.962,"15min":1.022},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.23999999999999999},"max":{"1min":8.4559999999999995,"5min":13.638999999999999,"15min":13.638999999999999},"last":1.8180000000000001},{"interface":"front","average":{"1min":1.4339999999999999,"5min":2.21,"15min":1.159},"min":{"1min":0.22500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":13.134,"5min":13.134,"15min":13.134},"last":2.3730000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:41:46 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":2.3340000000000001,"15min":1.218},"min":{"1min":0.22600000000000001,"5min":0.217,"15min":0.217},"max":{"1min":6.0030000000000001,"5min":14.507999999999999,"15min":14.507999999999999},"last":3.7930000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":2.2869999999999999,"15min":1.2549999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.6020000000000001,"5min":18.759,"15min":18.759},"last":1.8480000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:41:22 2024","interfaces":[{"interface":"back","average":{"1min":2.6030000000000002,"5min":1.8919999999999999,"15min":1.0580000000000001},"min":{"1min":0.32400000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":13.278,"5min":13.278,"15min":13.278},"last":0.95599999999999996},{"interface":"front","average":{"1min":2.1110000000000002,"5min":1.675,"15min":0.995},"min":{"1min":0.35799999999999998,"5min":0.30099999999999999,"15min":0.255},"max":{"1min":8.4789999999999992,"5min":8.9450000000000003,"15min":8.9450000000000003},"last":1.7350000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:41:46 2024","interfaces":[{"interface":"back","average":{"1min":1.778,"5min":2.423,"15min":1.3240000000000001},"min":{"1min":0.38800000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":4.7789999999999999,"5min":42.799999999999997,"15min":42.799999999999997},"last":2.2429999999999999},{"interface":"front","average":{"1min":2.0760000000000001,"5min":2.3690000000000002,"15min":1.264},"min":{"1min":0.33500000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":7.2279999999999998,"5min":42.695,"15min":42.695},"last":1.016}]},{"osd":6,"last update":"Mon Feb 19 21:42:03 2024","interfaces":[{"interface":"back","average":{"1min":1.6559999999999999,"5min":2.1619999999999999,"15min":1.1850000000000001},"min":{"1min":0.39300000000000002,"5min":0.36499999999999999,"15min":0.27900000000000003},"max":{"1min":4.4980000000000002,"5min":42.777000000000001,"15min":42.777000000000001},"last":1.7969999999999999},{"interface":"front","average":{"1min":2.1600000000000001,"5min":2.2759999999999998,"15min":1.2829999999999999},"min":{"1min":0.39500000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":6.3090000000000002,"5min":9.7629999999999999,"15min":9.7629999999999999},"last":2.2749999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:41:31 2024","interfaces":[{"interface":"back","average":{"1min":2.54,"5min":2.133,"15min":1.167},"min":{"1min":0.37,"5min":0.31,"15min":0.31},"max":{"1min":13.26,"5min":42.758000000000003,"15min":42.758000000000003},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.746,"5min":1.976,"15min":1.1639999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.33200000000000002},"max":{"1min":8.5340000000000007,"5min":42.718000000000004,"15min":42.718000000000004},"last":1.774}]}]},{"osd":2,"up_from":0,"seq":77309411478,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":26,"seq":111669149841,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1890392,"kb_used_data":1584976,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":91854760,"statfs":{"total":95995035648,"available":94059274240,"internally_reserved":0,"allocated":1623015424,"data_stored":1622751399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:41:58 2024","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.78,"15min":1.0740000000000001},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":6.5039999999999996,"5min":11.292,"15min":17.992000000000001},"last":0.879},{"interface":"front","average":{"1min":0.873,"5min":2.532,"15min":1.3939999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":6.0449999999999999,"5min":46.654000000000003,"15min":46.654000000000003},"last":0.90500000000000003}]},{"osd":1,"last update":"Mon Feb 19 21:41:58 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.448,"15min":0.86299999999999999},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":6.444,"5min":9.9700000000000006,"15min":9.9700000000000006},"last":0.34599999999999997},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.9179999999999999,"15min":1.131},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.185},"max":{"1min":6.3460000000000001,"5min":11.196999999999999,"15min":13.135999999999999},"last":0.23100000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:41:58 2024","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":2.0680000000000001,"15min":1.1160000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.224},"max":{"1min":6.8879999999999999,"5min":11.175000000000001,"15min":11.175000000000001},"last":1.845},{"interface":"front","average":{"1min":0.61099999999999999,"5min":2.23,"15min":1.284},"min":{"1min":0.23499999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.8320000000000001,"5min":45.831000000000003,"15min":45.831000000000003},"last":3.8929999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:41:20 2024","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.4419999999999999,"15min":0.89500000000000002},"min":{"1min":0.28399999999999997,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":6.4690000000000003,"5min":6.4690000000000003,"15min":6.4690000000000003},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.968,"5min":1.9379999999999999,"15min":1.0649999999999999},"min":{"1min":0.28699999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":6.8289999999999997,"5min":11.093,"15min":11.093},"last":1.9419999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:41:37 2024","interfaces":[{"interface":"back","average":{"1min":2.7240000000000002,"5min":1.528,"15min":0.96699999999999997},"min":{"1min":0.33400000000000002,"5min":0.28399999999999997,"15min":0.27100000000000002},"max":{"1min":8.6950000000000003,"5min":8.6950000000000003,"15min":8.6950000000000003},"last":0.38200000000000001},{"interface":"front","average":{"1min":3.1960000000000002,"5min":2.1539999999999999,"15min":1.1899999999999999},"min":{"1min":0.49199999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":8.5809999999999995,"5min":11.128,"15min":11.128},"last":0.432}]},{"osd":6,"last update":"Mon Feb 19 21:42:07 2024","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.526,"15min":0.98299999999999998},"min":{"1min":0.36299999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.6579999999999999,"5min":17.443999999999999,"15min":17.443999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":2.3500000000000001,"5min":2.1070000000000002,"15min":1.214},"min":{"1min":0.32900000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":6.7800000000000002,"5min":18.219000000000001,"15min":18.219000000000001},"last":2.8050000000000002}]},{"osd":7,"last update":"Mon Feb 19 21:41:28 2024","interfaces":[{"interface":"back","average":{"1min":1.5980000000000001,"5min":2.444,"15min":1.3129999999999999},"min":{"1min":0.33200000000000002,"5min":0.318,"15min":0.318},"max":{"1min":4.2320000000000002,"5min":45.777999999999999,"15min":45.777999999999999},"last":1.964},{"interface":"front","average":{"1min":1.798,"5min":1.466,"15min":0.94799999999999995},"min":{"1min":0.35699999999999998,"5min":0.35499999999999998,"15min":0.35099999999999998},"max":{"1min":6.585,"5min":6.585,"15min":6.585},"last":1.8759999999999999}]}]},{"osd":4,"up_from":32,"seq":137438953610,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2162884,"kb_used_data":1849212,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":91582268,"statfs":{"total":95995035648,"available":93780242432,"internally_reserved":0,"allocated":1893593088,"data_stored":1893284874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:42:18 2024","interfaces":[{"interface":"back","average":{"1min":1.8340000000000001,"5min":2.0459999999999998,"15min":1.1319999999999999},"min":{"1min":0.249,"5min":0.219,"15min":0.219},"max":{"1min":7.6260000000000003,"5min":40.664000000000001,"15min":40.664000000000001},"last":1.8640000000000001},{"interface":"front","average":{"1min":2.7360000000000002,"5min":2.2789999999999999,"15min":1.3049999999999999},"min":{"1min":0.33200000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":9.2799999999999994,"5min":41.046999999999997,"15min":41.046999999999997},"last":7.5519999999999996}]},{"osd":1,"last update":"Mon Feb 19 21:42:18 2024","interfaces":[{"interface":"back","average":{"1min":2.0670000000000002,"5min":1.603,"15min":0.92200000000000004},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":7.0039999999999996,"5min":13.254,"15min":13.254},"last":1.9339999999999999},{"interface":"front","average":{"1min":2.1909999999999998,"5min":1.669,"15min":0.97299999999999998},"min":{"1min":0.35999999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":7.593,"5min":15.411,"15min":15.411},"last":7.593}]},{"osd":2,"last update":"Mon Feb 19 21:42:18 2024","interfaces":[{"interface":"back","average":{"1min":2.3130000000000002,"5min":1.859,"15min":1.0549999999999999},"min":{"1min":0.42399999999999999,"5min":0.307,"15min":0.27100000000000002},"max":{"1min":7.6459999999999999,"5min":16.788,"15min":16.788},"last":7.6459999999999999},{"interface":"front","average":{"1min":2.5819999999999999,"5min":2.2589999999999999,"15min":1.2909999999999999},"min":{"1min":0.34899999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":10.398999999999999,"5min":18.452999999999999,"15min":20.995999999999999},"last":2.0099999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:42:18 2024","interfaces":[{"interface":"back","average":{"1min":3.1709999999999998,"5min":2.2029999999999998,"15min":1.1830000000000001},"min":{"1min":0.36799999999999999,"5min":0.32800000000000001,"15min":0.316},"max":{"1min":10.970000000000001,"5min":15.914999999999999,"15min":15.914999999999999},"last":1.9810000000000001},{"interface":"front","average":{"1min":2.2000000000000002,"5min":1.752,"15min":1.046},"min":{"1min":0.32500000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":7.8120000000000003,"5min":13.321,"15min":13.321},"last":1.9119999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:41:58 2024","interfaces":[{"interface":"back","average":{"1min":2.883,"5min":1.5329999999999999,"15min":0.80300000000000005},"min":{"1min":0.27100000000000002,"5min":0.249,"15min":0.23499999999999999},"max":{"1min":12.33,"5min":12.33,"15min":12.33},"last":18.916},{"interface":"front","average":{"1min":3.577,"5min":1.7030000000000001,"15min":0.86899999999999999},"min":{"1min":0.30299999999999999,"5min":0.27300000000000002,"15min":0.26100000000000001},"max":{"1min":14.840999999999999,"5min":14.840999999999999,"15min":14.840999999999999},"last":9.1799999999999997}]},{"osd":6,"last update":"Mon Feb 19 21:42:18 2024","interfaces":[{"interface":"back","average":{"1min":2.4790000000000001,"5min":1.929,"15min":0.96499999999999997},"min":{"1min":0.32900000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":8.5519999999999996,"5min":13.27,"15min":13.27},"last":6.8410000000000002},{"interface":"front","average":{"1min":2.8180000000000001,"5min":1.599,"15min":0.86499999999999999},"min":{"1min":0.311,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":8.3659999999999997,"5min":8.3659999999999997,"15min":8.3659999999999997},"last":7.6210000000000004}]},{"osd":7,"last update":"Mon Feb 19 21:41:33 2024","interfaces":[{"interface":"back","average":{"1min":2.0800000000000001,"5min":1.161,"15min":0.745},"min":{"1min":0.36099999999999999,"5min":0.32700000000000001,"15min":0.28899999999999998},"max":{"1min":7.9320000000000004,"5min":7.9320000000000004,"15min":7.9320000000000004},"last":7.6699999999999999},{"interface":"front","average":{"1min":2.8900000000000001,"5min":1.718,"15min":0.93899999999999995},"min":{"1min":0.38700000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":10.048,"5min":10.707000000000001,"15min":10.707000000000001},"last":6.9119999999999999}]}]},{"osd":5,"up_from":38,"seq":163208757382,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3197084,"kb_used_data":2895572,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":90548068,"statfs":{"total":95995035648,"available":92721221632,"internally_reserved":0,"allocated":2965065728,"data_stored":2964734021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:41:48 2024","interfaces":[{"interface":"back","average":{"1min":1.7889999999999999,"5min":1.9330000000000001,"15min":1.05},"min":{"1min":0.28499999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":10.044,"5min":20.550999999999998,"15min":20.550999999999998},"last":0.28999999999999998},{"interface":"front","average":{"1min":2.718,"5min":2.0070000000000001,"15min":1.0760000000000001},"min":{"1min":0.32500000000000001,"5min":0.23999999999999999,"15min":0.23200000000000001},"max":{"1min":9.9390000000000001,"5min":20.879000000000001,"15min":20.879000000000001},"last":1.228}]},{"osd":1,"last update":"Mon Feb 19 21:41:48 2024","interfaces":[{"interface":"back","average":{"1min":3.0289999999999999,"5min":1.7370000000000001,"15min":0.995},"min":{"1min":0.373,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":10.42,"5min":10.42,"15min":10.42},"last":4.9050000000000002},{"interface":"front","average":{"1min":2.0299999999999998,"5min":1.778,"15min":1.0109999999999999},"min":{"1min":0.28399999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":10.021000000000001,"5min":10.316000000000001,"15min":10.316000000000001},"last":1.0980000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:41:48 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.8740000000000001,"15min":1.0580000000000001},"min":{"1min":0.35499999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":5.9260000000000002,"5min":20.186,"15min":20.186},"last":0.32200000000000001},{"interface":"front","average":{"1min":2.194,"5min":2.117,"15min":1.111},"min":{"1min":0.29899999999999999,"5min":0.28100000000000003,"15min":0.23200000000000001},"max":{"1min":7.3630000000000004,"5min":20.175000000000001,"15min":20.175000000000001},"last":1.25}]},{"osd":3,"last update":"Mon Feb 19 21:41:48 2024","interfaces":[{"interface":"back","average":{"1min":2.5819999999999999,"5min":2.2719999999999998,"15min":1.2170000000000001},"min":{"1min":0.35099999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":12.021000000000001,"5min":20.146999999999998,"15min":20.146999999999998},"last":0.37},{"interface":"front","average":{"1min":3.052,"5min":2.5579999999999998,"15min":1.341},"min":{"1min":0.36499999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":7.327,"5min":20.120000000000001,"15min":20.120000000000001},"last":4.9370000000000003}]},{"osd":4,"last update":"Mon Feb 19 21:41:48 2024","interfaces":[{"interface":"back","average":{"1min":2.0449999999999999,"5min":1.133,"15min":0.65100000000000002},"min":{"1min":0.30499999999999999,"5min":0.24399999999999999,"15min":0.23999999999999999},"max":{"1min":5.851,"5min":6.4610000000000003,"15min":6.4610000000000003},"last":21.577000000000002},{"interface":"front","average":{"1min":3.5049999999999999,"5min":1.6799999999999999,"15min":0.85199999999999998},"min":{"1min":0.28799999999999998,"5min":0.26000000000000001,"15min":0.25600000000000001},"max":{"1min":12.135,"5min":12.135,"15min":12.135},"last":0.34699999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:42:13 2024","interfaces":[{"interface":"back","average":{"1min":2.4910000000000001,"5min":1.671,"15min":0.87},"min":{"1min":0.32600000000000001,"5min":0.221,"15min":0.221},"max":{"1min":5.9720000000000004,"5min":8.4629999999999992,"15min":8.4629999999999992},"last":0.39400000000000002},{"interface":"front","average":{"1min":2.6059999999999999,"5min":1.913,"15min":0.97199999999999998},"min":{"1min":0.34799999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":13.532999999999999,"5min":13.532999999999999,"15min":13.532999999999999},"last":5.0149999999999997}]},{"osd":7,"last update":"Mon Feb 19 21:41:42 2024","interfaces":[{"interface":"back","average":{"1min":3.0680000000000001,"5min":1.708,"15min":0.95199999999999996},"min":{"1min":0.33800000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":10.032,"5min":10.032,"15min":10.032},"last":1.1990000000000001},{"interface":"front","average":{"1min":3.0219999999999998,"5min":1.6339999999999999,"15min":0.89400000000000002},"min":{"1min":0.34599999999999997,"5min":0.312,"15min":0.29099999999999998},"max":{"1min":13.116,"5min":17.759,"15min":17.759},"last":1.125}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":2118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2224553984,"data_stored":2224553984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2336358400,"data_stored":2336358400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1605107712,"data_stored":1605107712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1886453760,"data_stored":1886453760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2942504960,"data_stored":2942500888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2214006784,"data_stored":2214002712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2219708416,"data_stored":2219704344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:42:24.747 INFO:tasks.cephadm.ceph_manager.ceph:decrease pool size by 10 2024-02-19T21:42:24.748 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool set default.rgw.meta pg_num 22 2024-02-19T21:42:24.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:23.001962+0000 mgr.y (mgr.14514) 378 : cluster [DBG] pgmap v418: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 4.7 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 792 op/s; 15716/232317 objects misplaced (6.765%); 13 MiB/s, 215 objects/s recovering 2024-02-19T21:42:25.332 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:42:25.336 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:25.336 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:42:25.370 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:42:25.437 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:42:25.496 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:25.526 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:42:25.532 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:25.532 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:42:25.633 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:42:25.679 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:25.708 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:42:25.713 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:25.714 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:42:25.807 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:42:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:42:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:42:25.814 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:42:25.880 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:25.920 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:42:25.930 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:25.931 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:42:26.031 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:42:26.078 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:26.172 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:42:26.172 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:42:26.172 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:42:26.172 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:42:26.186 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:42:26.190 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:26.190 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:42:26.207 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:42:26.236 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:42:26.293 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:42:26.298 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:42:26.342 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:42:26.348 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:42:26.348 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:42:26.348 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:42:26.348 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:42:26.348 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:42:26.348 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:42:26.348 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:42:26.348 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:42:26.354 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:26.410 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:42:26.413 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:26.414 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:42:26.515 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:42:26.553 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:26.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:25.004913+0000 mgr.y (mgr.14514) 379 : cluster [DBG] pgmap v419: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 4.5 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.07k op/s; 14245/222453 objects misplaced (6.404%); 17 MiB/s, 278 objects/s recovering 2024-02-19T21:42:26.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:26.040433+0000 mon.b (mon.1) 49 : audit [DBG] from='client.? 172.21.15.80:0/3756736322' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:42:26.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:25.004913+0000 mgr.y (mgr.14514) 379 : cluster [DBG] pgmap v419: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 4.5 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.07k op/s; 14245/222453 objects misplaced (6.404%); 17 MiB/s, 278 objects/s recovering 2024-02-19T21:42:26.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:26.040433+0000 mon.b (mon.1) 49 : audit [DBG] from='client.? 172.21.15.80:0/3756736322' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:42:26.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:25.004913+0000 mgr.y (mgr.14514) 379 : cluster [DBG] pgmap v419: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 4.5 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.07k op/s; 14245/222453 objects misplaced (6.404%); 17 MiB/s, 278 objects/s recovering 2024-02-19T21:42:26.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:26.040433+0000 mon.b (mon.1) 49 : audit [DBG] from='client.? 172.21.15.80:0/3756736322' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:42:27.079 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:42:27.121 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:42:27.125 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:27.126 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:42:27.226 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:42:27.288 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:27.332 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:42:27.340 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:27.341 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:42:27.442 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:42:27.515 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:27.558 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:42:27.560 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:27.561 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:42:27.661 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:42:27.725 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:27.757 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:42:27.759 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:27.760 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:42:27.861 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:42:27.940 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:27.965 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:42:27.970 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:27.971 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:42:28.071 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:42:28.126 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:28.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:27.005374+0000 mgr.y (mgr.14514) 380 : cluster [DBG] pgmap v420: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 4.4 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 852 B/s rd, 0 B/s wr, 913 op/s; 13505/218064 objects misplaced (6.193%); 16 MiB/s, 256 objects/s recovering 2024-02-19T21:42:28.693 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:27.005374+0000 mgr.y (mgr.14514) 380 : cluster [DBG] pgmap v420: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 4.4 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 852 B/s rd, 0 B/s wr, 913 op/s; 13505/218064 objects misplaced (6.193%); 16 MiB/s, 256 objects/s recovering 2024-02-19T21:42:28.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:27.005374+0000 mgr.y (mgr.14514) 380 : cluster [DBG] pgmap v420: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 4.4 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 852 B/s rd, 0 B/s wr, 913 op/s; 13505/218064 objects misplaced (6.193%); 16 MiB/s, 256 objects/s recovering 2024-02-19T21:42:29.190 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:42:29.195 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:29.195 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:42:29.286 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:42:29.286 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-02-19T21:42:29.286 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:29.286 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:186464 8.7 8:e9cfc891:::benchmark_data_smithi080_100924_object58746:head [delete] snapc 0=[] ondisk+write+known_if_redirected e200)", 2024-02-19T21:42:29.287 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:42:28.723199+0000", 2024-02-19T21:42:29.287 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0083754290000000002, 2024-02-19T21:42:29.287 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0084064389999999999, 2024-02-19T21:42:29.287 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:42:29.287 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:42:29.287 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:42:29.287 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:42:29.287 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:42:29.287 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 186464 2024-02-19T21:42:29.287 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:29.287 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:42:29.287 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:29.287 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:42:29.287 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:42:28.723199+0000", 2024-02-19T21:42:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:42:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:42:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:42:28.723199+0000", 2024-02-19T21:42:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:42:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:42:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:42:28.723197+0000", 2024-02-19T21:42:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8749999999999997e-06 2024-02-19T21:42:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:42:29.289 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:42:28.723203+0000", 2024-02-19T21:42:29.289 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3089999999999998e-06 2024-02-19T21:42:29.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:29.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:29.289 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:42:29.289 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:42:28.723210+0000", 2024-02-19T21:42:29.289 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1760000000000003e-06 2024-02-19T21:42:29.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:29.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:29.289 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:42:29.289 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:42:28.723215+0000", 2024-02-19T21:42:29.289 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2809999999999999e-05 2024-02-19T21:42:29.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:29.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:29.290 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:42:29.290 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:42:28.723247+0000", 2024-02-19T21:42:29.290 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6732999999999997e-05 2024-02-19T21:42:29.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:29.290 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:29.290 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:42:29.290 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:42:28.723344+0000", 2024-02-19T21:42:29.290 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011181899999999999 2024-02-19T21:42:29.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:29.290 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:29.290 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,6", 2024-02-19T21:42:29.290 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:42:28.723456+0000", 2024-02-19T21:42:29.290 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002669004 2024-02-19T21:42:29.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:29.291 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:29.291 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:42:29.291 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:42:28.726125+0000", 2024-02-19T21:42:29.291 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036924190000000002 2024-02-19T21:42:29.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:29.291 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:29.291 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:42:29.291 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:42:28.729817+0000", 2024-02-19T21:42:29.291 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066189090000000001 2024-02-19T21:42:29.291 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:29.292 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:29.292 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:29.292 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:29.292 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:29.292 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:186471 8.a 8:5fc4597e:::benchmark_data_smithi080_100924_object58753:head [delete] snapc 0=[] ondisk+write+known_if_redirected e200)", 2024-02-19T21:42:29.292 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:42:28.731325+0000", 2024-02-19T21:42:29.292 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.00024861000000000002, 2024-02-19T21:42:29.292 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038591899999999998, 2024-02-19T21:42:29.292 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:42:29.292 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:42:29.292 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:42:29.292 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:42:29.292 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:42:29.292 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 186471 2024-02-19T21:42:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:42:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:42:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:42:28.731325+0000", 2024-02-19T21:42:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:42:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:42:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:42:28.731325+0000", 2024-02-19T21:42:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:42:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:42:29.294 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:42:28.731324+0000", 2024-02-19T21:42:29.294 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9609999999999999e-06 2024-02-19T21:42:29.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:29.294 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:29.294 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:42:29.294 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:42:28.731331+0000", 2024-02-19T21:42:29.294 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4959e-05 2024-02-19T21:42:29.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:29.294 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:29.294 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:42:29.294 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:42:28.731346+0000", 2024-02-19T21:42:29.294 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1180000000000003e-06 2024-02-19T21:42:29.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:29.294 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:29.295 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:42:29.295 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:42:28.731353+0000", 2024-02-19T21:42:29.295 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0489000000000003e-05 2024-02-19T21:42:29.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:29.295 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:29.295 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:42:29.295 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:42:28.731414+0000", 2024-02-19T21:42:29.295 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000111564 2024-02-19T21:42:29.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:29.295 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:29.295 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:42:29.295 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:42:28.731525+0000", 2024-02-19T21:42:29.295 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000100311 2024-02-19T21:42:29.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:29.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:29.296 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,5", 2024-02-19T21:42:29.296 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:42:28.731626+0000", 2024-02-19T21:42:29.296 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000300208 2024-02-19T21:42:29.296 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:29.296 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:29.296 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:29.296 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:29.296 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:42:29.296 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 2 2024-02-19T21:42:29.296 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:42:29.296 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:42:29.369 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:29.402 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:42:29.406 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:29.407 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:42:29.508 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:42:29.582 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:29.626 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:42:29.634 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:29.634 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:42:29.735 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:42:29.815 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:29.852 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:42:29.856 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:29.856 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:42:29.957 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:42:30.031 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:30.038 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.1 dump_blocked_ops 2024-02-19T21:42:30.068 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:42:30.072 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:30.073 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:42:30.174 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:42:30.239 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:30.355 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:42:30.360 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:30.361 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:42:30.462 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:42:30.529 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:30.570 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:42:30.577 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:30.577 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:42:30.678 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:42:30.752 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:29.005765+0000 mgr.y (mgr.14514) 381 : cluster [DBG] pgmap v421: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 4.4 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 852 B/s rd, 0 B/s wr, 793 op/s; 13505/218064 objects misplaced (6.193%); 13 MiB/s, 214 objects/s recovering 2024-02-19T21:42:30.753 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:42:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:42:30.760 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:30.771 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:29.005765+0000 mgr.y (mgr.14514) 381 : cluster [DBG] pgmap v421: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 4.4 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 852 B/s rd, 0 B/s wr, 793 op/s; 13505/218064 objects misplaced (6.193%); 13 MiB/s, 214 objects/s recovering 2024-02-19T21:42:30.771 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:29.005765+0000 mgr.y (mgr.14514) 381 : cluster [DBG] pgmap v421: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 4.4 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 852 B/s rd, 0 B/s wr, 793 op/s; 13505/218064 objects misplaced (6.193%); 13 MiB/s, 214 objects/s recovering 2024-02-19T21:42:30.797 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:42:30.800 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:30.800 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:42:30.901 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:42:30.966 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:30.999 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:42:31.001 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:31.002 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:42:31.097 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:42:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:42:30] "GET /metrics HTTP/1.1" 200 175924 "" "Prometheus/2.33.4" 2024-02-19T21:42:31.102 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:42:31.154 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:31.158 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:42:31.191 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:42:31.194 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:31.195 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:42:31.296 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:42:31.376 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:31.409 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:30.373893+0000 mgr.y (mgr.14514) 382 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:42:31.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:30.373893+0000 mgr.y (mgr.14514) 382 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:42:31.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:30.373893+0000 mgr.y (mgr.14514) 382 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:42:32.295 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:42:32.365 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:42:32.369 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:32.370 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:42:32.470 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:42:32.543 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:32.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:31.006589+0000 mgr.y (mgr.14514) 383 : cluster [DBG] pgmap v422: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 4.1 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s; 11370/203847 objects misplaced (5.578%); 20 MiB/s, 323 objects/s recovering 2024-02-19T21:42:32.635 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:31.006589+0000 mgr.y (mgr.14514) 383 : cluster [DBG] pgmap v422: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 4.1 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s; 11370/203847 objects misplaced (5.578%); 20 MiB/s, 323 objects/s recovering 2024-02-19T21:42:32.636 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:42:32.639 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:32.639 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:42:32.655 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:42:32.740 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:42:32.784 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:32.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:31.006589+0000 mgr.y (mgr.14514) 383 : cluster [DBG] pgmap v422: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 4.1 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s; 11370/203847 objects misplaced (5.578%); 20 MiB/s, 323 objects/s recovering 2024-02-19T21:42:32.915 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:42:32.921 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:32.922 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:42:33.023 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:42:33.070 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:33.444 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-02-19T21:42:33.452 INFO:teuthology.orchestra.run.smithi080.stderr:set pool 6 pg_num to 22 2024-02-19T21:42:33.475 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:32.421328+0000 mon.c (mon.2) 50 : audit [INF] from='client.? 172.21.15.80:0/2157631645' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "22"}]: dispatch 2024-02-19T21:42:33.475 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:32.421666+0000 mon.a (mon.0) 1091 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "22"}]: dispatch 2024-02-19T21:42:33.476 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:32.557396+0000 mon.a (mon.0) 1092 : audit [INF] from='client.? 172.21.15.80:0/1210067979' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:42:33.476 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:32.421328+0000 mon.c (mon.2) 50 : audit [INF] from='client.? 172.21.15.80:0/2157631645' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "22"}]: dispatch 2024-02-19T21:42:33.476 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:32.421666+0000 mon.a (mon.0) 1091 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "22"}]: dispatch 2024-02-19T21:42:33.476 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:32.557396+0000 mon.a (mon.0) 1092 : audit [INF] from='client.? 172.21.15.80:0/1210067979' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:42:33.726 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:42:33.731 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:33.732 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:42:33.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:32.421328+0000 mon.c (mon.2) 50 : audit [INF] from='client.? 172.21.15.80:0/2157631645' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "22"}]: dispatch 2024-02-19T21:42:33.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:32.421666+0000 mon.a (mon.0) 1091 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "22"}]: dispatch 2024-02-19T21:42:33.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:32.557396+0000 mon.a (mon.0) 1092 : audit [INF] from='client.? 172.21.15.80:0/1210067979' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:42:33.832 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:42:33.883 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:34.343 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:42:34.346 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:34.346 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:42:34.447 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:42:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:34.572 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:42:34.576 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:33.007000+0000 mgr.y (mgr.14514) 384 : cluster [DBG] pgmap v423: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 4.1 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 852 B/s rd, 0 B/s wr, 791 op/s; 11370/203847 objects misplaced (5.578%); 13 MiB/s, 215 objects/s recovering 2024-02-19T21:42:34.576 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:33.410658+0000 mon.a (mon.0) 1093 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:42:34.576 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:33.410686+0000 mon.a (mon.0) 1094 : cluster [INF] Cluster is now healthy 2024-02-19T21:42:34.576 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:33.426792+0000 mon.a (mon.0) 1095 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "22"}]': finished 2024-02-19T21:42:34.577 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:33.426863+0000 mon.a (mon.0) 1096 : audit [INF] from='client.? 172.21.15.80:0/1210067979' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:42:34.577 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:33.426903+0000 mon.a (mon.0) 1097 : cluster [DBG] osdmap e201: 8 total, 8 up, 7 in 2024-02-19T21:42:34.577 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:33.958781+0000 mon.a (mon.0) 1098 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:42:34.578 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:33.007000+0000 mgr.y (mgr.14514) 384 : cluster [DBG] pgmap v423: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 4.1 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 852 B/s rd, 0 B/s wr, 791 op/s; 11370/203847 objects misplaced (5.578%); 13 MiB/s, 215 objects/s recovering 2024-02-19T21:42:34.578 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:33.410658+0000 mon.a (mon.0) 1093 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:42:34.578 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:33.410686+0000 mon.a (mon.0) 1094 : cluster [INF] Cluster is now healthy 2024-02-19T21:42:34.578 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:33.426792+0000 mon.a (mon.0) 1095 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "22"}]': finished 2024-02-19T21:42:34.578 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:33.426863+0000 mon.a (mon.0) 1096 : audit [INF] from='client.? 172.21.15.80:0/1210067979' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:42:34.580 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:33.426903+0000 mon.a (mon.0) 1097 : cluster [DBG] osdmap e201: 8 total, 8 up, 7 in 2024-02-19T21:42:34.580 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:33.958781+0000 mon.a (mon.0) 1098 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:42:34.580 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:34.581 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:42:34.682 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:42:34.716 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:34.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:33.007000+0000 mgr.y (mgr.14514) 384 : cluster [DBG] pgmap v423: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 4.1 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 852 B/s rd, 0 B/s wr, 791 op/s; 11370/203847 objects misplaced (5.578%); 13 MiB/s, 215 objects/s recovering 2024-02-19T21:42:34.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:33.410658+0000 mon.a (mon.0) 1093 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:42:34.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:33.410686+0000 mon.a (mon.0) 1094 : cluster [INF] Cluster is now healthy 2024-02-19T21:42:34.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:33.426792+0000 mon.a (mon.0) 1095 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "22"}]': finished 2024-02-19T21:42:34.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:33.426863+0000 mon.a (mon.0) 1096 : audit [INF] from='client.? 172.21.15.80:0/1210067979' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:42:34.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:33.426903+0000 mon.a (mon.0) 1097 : cluster [DBG] osdmap e201: 8 total, 8 up, 7 in 2024-02-19T21:42:34.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:33.958781+0000 mon.a (mon.0) 1098 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:42:35.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:35.011745+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num_actual", "val": "22"}]: dispatch 2024-02-19T21:42:35.807 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:42:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:42:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:42:35.807 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:35.011745+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num_actual", "val": "22"}]: dispatch 2024-02-19T21:42:35.807 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:35.011745+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num_actual", "val": "22"}]: dispatch 2024-02-19T21:42:36.273 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:42:36.278 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:36.279 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:42:36.380 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:42:36.432 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:36.479 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:42:36.482 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:36.482 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:42:36.549 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:35.010706+0000 mgr.y (mgr.14514) 385 : cluster [DBG] pgmap v425: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 3.9 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 26 KiB/s rd, 0 B/s wr, 991 op/s; 10002/194007 objects misplaced (5.155%); 16 MiB/s, 254 objects/s recovering 2024-02-19T21:42:36.549 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:35.434534+0000 mon.a (mon.0) 1100 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num_actual", "val": "22"}]': finished 2024-02-19T21:42:36.549 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:35.434597+0000 mon.a (mon.0) 1101 : cluster [DBG] osdmap e202: 8 total, 8 up, 7 in 2024-02-19T21:42:36.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:35.010706+0000 mgr.y (mgr.14514) 385 : cluster [DBG] pgmap v425: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 3.9 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 26 KiB/s rd, 0 B/s wr, 991 op/s; 10002/194007 objects misplaced (5.155%); 16 MiB/s, 254 objects/s recovering 2024-02-19T21:42:36.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:35.434534+0000 mon.a (mon.0) 1100 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num_actual", "val": "22"}]': finished 2024-02-19T21:42:36.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:35.434597+0000 mon.a (mon.0) 1101 : cluster [DBG] osdmap e202: 8 total, 8 up, 7 in 2024-02-19T21:42:36.583 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:42:36.670 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:36.708 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:42:36.716 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:36.717 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:42:36.717 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:35.010706+0000 mgr.y (mgr.14514) 385 : cluster [DBG] pgmap v425: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 3.9 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 26 KiB/s rd, 0 B/s wr, 991 op/s; 10002/194007 objects misplaced (5.155%); 16 MiB/s, 254 objects/s recovering 2024-02-19T21:42:36.717 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:35.434534+0000 mon.a (mon.0) 1100 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num_actual", "val": "22"}]': finished 2024-02-19T21:42:36.717 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:35.434597+0000 mon.a (mon.0) 1101 : cluster [DBG] osdmap e202: 8 total, 8 up, 7 in 2024-02-19T21:42:36.818 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:42:36.861 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:36.924 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:42:36.932 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:36.933 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:42:37.019 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set noscrub 2024-02-19T21:42:37.034 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:42:37.090 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:37.123 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:42:37.138 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:42:37.143 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:37.144 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:42:37.151 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:42:37.181 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:42:37.217 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:42:37.245 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:42:37.249 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:42:37.293 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:42:37.305 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:37.336 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:42:37.339 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:37.340 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:42:37.342 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:42:37.355 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:42:37.355 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:42:37.379 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:42:37.389 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:42:37.389 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:42:37.389 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:42:37.389 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:42:37.389 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:42:37.389 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:42:37.389 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:42:37.389 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:42:37.440 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:42:37.502 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:37.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:36.450508+0000 mon.a (mon.0) 1102 : cluster [DBG] osdmap e203: 8 total, 8 up, 7 in 2024-02-19T21:42:37.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:37.089945+0000 mon.a (mon.0) 1103 : audit [DBG] from='client.? 172.21.15.80:0/2946766674' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:42:37.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:36.450508+0000 mon.a (mon.0) 1102 : cluster [DBG] osdmap e203: 8 total, 8 up, 7 in 2024-02-19T21:42:37.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:37.089945+0000 mon.a (mon.0) 1103 : audit [DBG] from='client.? 172.21.15.80:0/2946766674' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:42:37.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:36.450508+0000 mon.a (mon.0) 1102 : cluster [DBG] osdmap e203: 8 total, 8 up, 7 in 2024-02-19T21:42:37.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:37.089945+0000 mon.a (mon.0) 1103 : audit [DBG] from='client.? 172.21.15.80:0/2946766674' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:42:38.357 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:42:38.358 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.1 dump_historic_ops 2024-02-19T21:42:38.365 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:38.365 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:42:38.403 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:42:38.467 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:42:38.557 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:38.593 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:42:38.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:37.011134+0000 mgr.y (mgr.14514) 386 : cluster [DBG] pgmap v428: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 3.8 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 72 KiB/s rd, 0 B/s wr, 902 op/s; 9311/189747 objects misplaced (4.907%); 13 MiB/s, 213 objects/s recovering 2024-02-19T21:42:38.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:37.011134+0000 mgr.y (mgr.14514) 386 : cluster [DBG] pgmap v428: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 3.8 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 72 KiB/s rd, 0 B/s wr, 902 op/s; 9311/189747 objects misplaced (4.907%); 13 MiB/s, 213 objects/s recovering 2024-02-19T21:42:38.599 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:38.599 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:42:38.700 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:42:38.745 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:37.011134+0000 mgr.y (mgr.14514) 386 : cluster [DBG] pgmap v428: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 3.8 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 72 KiB/s rd, 0 B/s wr, 902 op/s; 9311/189747 objects misplaced (4.907%); 13 MiB/s, 213 objects/s recovering 2024-02-19T21:42:38.750 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:38.785 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:42:38.788 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:38.789 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:42:38.890 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:42:38.933 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:39.102 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:42:39.105 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:39.105 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:42:39.205 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:42:39.250 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:39.335 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 6, 7] out_osds: [2] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:42:39.335 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:42:39.335 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-02-19T21:42:39.335 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd dump -f json-pretty 2024-02-19T21:42:40.221 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:42:40.221 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:40.222 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:42:40.323 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:42:40.396 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:40.425 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:42:40.428 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:40.428 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:42:40.529 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:42:40.569 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:40.615 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:42:40.624 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:40.625 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:42:40.725 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:42:40.753 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:42:40.770 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:39.011547+0000 mgr.y (mgr.14514) 387 : cluster [DBG] pgmap v429: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 3.8 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 72 KiB/s rd, 0 B/s wr, 902 op/s; 9311/189747 objects misplaced (4.907%); 13 MiB/s, 213 objects/s recovering 2024-02-19T21:42:40.770 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:39.011547+0000 mgr.y (mgr.14514) 387 : cluster [DBG] pgmap v429: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 3.8 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 72 KiB/s rd, 0 B/s wr, 902 op/s; 9311/189747 objects misplaced (4.907%); 13 MiB/s, 213 objects/s recovering 2024-02-19T21:42:40.775 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:40.800 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:42:40.801 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:42:40.803 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:40.804 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:42:40.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:39.011547+0000 mgr.y (mgr.14514) 387 : cluster [DBG] pgmap v429: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 3.8 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 72 KiB/s rd, 0 B/s wr, 902 op/s; 9311/189747 objects misplaced (4.907%); 13 MiB/s, 213 objects/s recovering 2024-02-19T21:42:40.807 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:42:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:42:40.897 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:42:40.905 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:42:40.931 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:40.954 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:42:40.956 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:40.957 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:42:41.051 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:42:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:42:40] "GET /metrics HTTP/1.1" 200 175927 "" "Prometheus/2.33.4" 2024-02-19T21:42:41.057 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:42:41.093 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:41.506 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-02-19T21:42:41.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:40.384639+0000 mgr.y (mgr.14514) 388 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:42:41.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:40.481021+0000 mon.a (mon.0) 1104 : cluster [DBG] osdmap e204: 8 total, 8 up, 7 in 2024-02-19T21:42:41.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:41.006628+0000 mon.b (mon.1) 50 : audit [INF] from='client.? 172.21.15.80:0/1643912069' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:42:41.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:41.007141+0000 mon.a (mon.0) 1105 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:42:41.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:41.012651+0000 mon.a (mon.0) 1106 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-02-19T21:42:41.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:40.384639+0000 mgr.y (mgr.14514) 388 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:42:41.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:40.481021+0000 mon.a (mon.0) 1104 : cluster [DBG] osdmap e204: 8 total, 8 up, 7 in 2024-02-19T21:42:41.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:41.006628+0000 mon.b (mon.1) 50 : audit [INF] from='client.? 172.21.15.80:0/1643912069' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:42:41.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:41.007141+0000 mon.a (mon.0) 1105 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:42:41.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:41.012651+0000 mon.a (mon.0) 1106 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-02-19T21:42:41.841 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:40.384639+0000 mgr.y (mgr.14514) 388 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:42:41.842 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:40.481021+0000 mon.a (mon.0) 1104 : cluster [DBG] osdmap e204: 8 total, 8 up, 7 in 2024-02-19T21:42:41.842 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:41.006628+0000 mon.b (mon.1) 50 : audit [INF] from='client.? 172.21.15.80:0/1643912069' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:42:41.842 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:41.007141+0000 mon.a (mon.0) 1105 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:42:41.842 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:41.012651+0000 mon.a (mon.0) 1106 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-02-19T21:42:42.492 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:42:42.496 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:42.497 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:42:42.598 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:42:42.681 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:42.706 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:42:42.712 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:42.713 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:42:42.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:41.011916+0000 mgr.y (mgr.14514) 389 : cluster [DBG] pgmap v431: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 3.6 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 30 KiB/s rd, 0 B/s wr, 1.09k op/s; 7386/175275 objects misplaced (4.214%); 19 MiB/s, 301 objects/s recovering 2024-02-19T21:42:42.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:41.489641+0000 mon.a (mon.0) 1107 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:42:42.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:41.500937+0000 mon.a (mon.0) 1108 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:42:42.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:41.501011+0000 mon.a (mon.0) 1109 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "31"}]': finished 2024-02-19T21:42:42.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:41.501059+0000 mon.a (mon.0) 1110 : cluster [DBG] osdmap e205: 8 total, 8 up, 7 in 2024-02-19T21:42:42.814 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:42:42.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:41.011916+0000 mgr.y (mgr.14514) 389 : cluster [DBG] pgmap v431: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 3.6 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 30 KiB/s rd, 0 B/s wr, 1.09k op/s; 7386/175275 objects misplaced (4.214%); 19 MiB/s, 301 objects/s recovering 2024-02-19T21:42:42.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:41.489641+0000 mon.a (mon.0) 1107 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:42:42.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:41.500937+0000 mon.a (mon.0) 1108 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:42:42.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:41.501011+0000 mon.a (mon.0) 1109 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "31"}]': finished 2024-02-19T21:42:42.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:41.501059+0000 mon.a (mon.0) 1110 : cluster [DBG] osdmap e205: 8 total, 8 up, 7 in 2024-02-19T21:42:42.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:41.011916+0000 mgr.y (mgr.14514) 389 : cluster [DBG] pgmap v431: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 3.6 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 30 KiB/s rd, 0 B/s wr, 1.09k op/s; 7386/175275 objects misplaced (4.214%); 19 MiB/s, 301 objects/s recovering 2024-02-19T21:42:42.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:41.489641+0000 mon.a (mon.0) 1107 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:42:42.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:41.500937+0000 mon.a (mon.0) 1108 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:42:42.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:41.501011+0000 mon.a (mon.0) 1109 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "31"}]': finished 2024-02-19T21:42:42.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:41.501059+0000 mon.a (mon.0) 1110 : cluster [DBG] osdmap e205: 8 total, 8 up, 7 in 2024-02-19T21:42:42.866 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:42.913 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:42:42.916 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:42.917 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:42:43.018 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:42:43.066 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:43.115 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:42:43.124 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:43.124 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:42:43.225 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:42:43.275 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:43.485 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:42:43.491 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:43.491 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:42:43.524 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:42.501767+0000 mon.a (mon.0) 1111 : cluster [DBG] osdmap e206: 8 total, 8 up, 7 in 2024-02-19T21:42:43.593 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:42:43.659 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:43.685 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:42:43.691 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:43.691 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:42:43.786 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:42.501767+0000 mon.a (mon.0) 1111 : cluster [DBG] osdmap e206: 8 total, 8 up, 7 in 2024-02-19T21:42:43.792 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:42:43.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:42.501767+0000 mon.a (mon.0) 1111 : cluster [DBG] osdmap e206: 8 total, 8 up, 7 in 2024-02-19T21:42:43.885 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:43.921 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:42:43.924 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:43.925 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:42:44.025 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:42:44.088 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:44.114 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:42:44.133 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:44.133 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:42:44.234 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:42:44.292 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:44.324 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:42:44.327 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:44.328 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:42:44.428 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:42:44.500 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:44.532 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:42:44.534 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:44.535 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:42:44.635 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:42:44.672 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:44.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:43.012392+0000 mgr.y (mgr.14514) 390 : cluster [DBG] pgmap v434: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 3.6 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 804 op/s; 7386/175275 objects misplaced (4.214%); 13 MiB/s, 206 objects/s recovering 2024-02-19T21:42:44.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:43.531103+0000 mon.a (mon.0) 1112 : cluster [DBG] osdmap e207: 8 total, 8 up, 7 in 2024-02-19T21:42:44.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:43.012392+0000 mgr.y (mgr.14514) 390 : cluster [DBG] pgmap v434: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 3.6 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 804 op/s; 7386/175275 objects misplaced (4.214%); 13 MiB/s, 206 objects/s recovering 2024-02-19T21:42:44.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:43.531103+0000 mon.a (mon.0) 1112 : cluster [DBG] osdmap e207: 8 total, 8 up, 7 in 2024-02-19T21:42:44.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:43.012392+0000 mgr.y (mgr.14514) 390 : cluster [DBG] pgmap v434: 148 pgs: 4 active+remapped+backfilling, 144 active+clean; 3.6 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 804 op/s; 7386/175275 objects misplaced (4.214%); 13 MiB/s, 206 objects/s recovering 2024-02-19T21:42:44.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:43.531103+0000 mon.a (mon.0) 1112 : cluster [DBG] osdmap e207: 8 total, 8 up, 7 in 2024-02-19T21:42:45.025 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-19T21:42:45.026 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:42:45.028 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:45.028 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:42:45.129 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:42:45.157 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:45.178 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:42:45.181 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:45.181 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:42:45.221 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:42:45.221 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:42:45.282 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:42:45.308 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:42:45.352 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:42:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 208, 2024-02-19T21:42:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "6f763558-cf6d-11ee-95bb-87774f69a715", 2024-02-19T21:42:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2024-02-19T21:26:16.880265+0000", 2024-02-19T21:42:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2024-02-19T21:42:44.528416+0000", 2024-02-19T21:42:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2024-02-19T21:32:14.805693+0000", 2024-02-19T21:42:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2024-02-19T21:39:38.443319+0000", 2024-02-19T21:42:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-02-19T21:42:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5801984, 2024-02-19T21:42:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2024-02-19T21:42:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: "noscrub", 2024-02-19T21:42:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2024-02-19T21:42:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2024-02-19T21:42:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2024-02-19T21:42:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2024-02-19T21:42:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:42:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 18, 2024-02-19T21:42:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2024-02-19T21:42:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-02-19T21:42:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2024-02-19T21:42:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2024-02-19T21:42:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 8, 2024-02-19T21:42:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2024-02-19T21:42:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "luminous", 2024-02-19T21:42:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "luminous", 2024-02-19T21:42:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "pacific", 2024-02-19T21:42:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2024-02-19T21:42:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2024-02-19T21:42:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "device_health_metrics", 2024-02-19T21:42:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:30:05.947623+0000", 2024-02-19T21:42:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:42:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:42:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:42:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:42:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:42:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:42:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:42:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:42:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:42:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:42:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:42:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:42:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 1, 2024-02-19T21:42:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 1, 2024-02-19T21:42:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 1, 2024-02-19T21:42:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 1, 2024-02-19T21:42:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 1, 2024-02-19T21:42:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:42:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:42:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:42:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:42:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:42:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:42:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:42:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "74", 2024-02-19T21:42:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:42:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:42:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:42:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:42:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:42:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:42:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:42:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:42:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:42:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:42:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:42:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:42:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:42:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:42:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:42:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:42:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:42:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:42:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:42:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:42:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:42:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:42:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:42:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:42:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:42:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:42:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:42:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:42:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:42:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:42:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:42:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:42:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:42:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:42:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:42:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:42:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:42:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2024-02-19T21:42:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_max": 32, 2024-02-19T21:42:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 1 2024-02-19T21:42:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:42:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_devicehealth": {} 2024-02-19T21:42:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 2, 2024-02-19T21:42:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": ".rgw.root", 2024-02-19T21:42:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:22.082250+0000", 2024-02-19T21:42:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:42:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:42:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:42:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:42:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:42:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:42:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:42:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:42:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:42:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:42:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:42:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:42:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:42:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:42:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:42:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:42:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:42:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:42:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:42:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:42:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:42:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:42:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:42:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:42:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "60", 2024-02-19T21:42:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:42:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:42:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:42:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:42:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:42:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:42:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:42:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:42:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:42:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:42:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:42:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:42:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:42:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:42:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:42:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:42:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:42:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:42:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:42:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:42:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:42:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:42:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:42:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:42:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:42:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:42:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:42:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:42:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:42:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:42:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:42:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:42:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:42:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:42:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:42:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:42:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:42:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:42:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:42:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:42:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 3, 2024-02-19T21:42:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "iscsi", 2024-02-19T21:42:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:22.333164+0000", 2024-02-19T21:42:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:42:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:42:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:42:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:42:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:42:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:42:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:42:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:42:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:42:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:42:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:42:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:42:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 3, 2024-02-19T21:42:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 3, 2024-02-19T21:42:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 3, 2024-02-19T21:42:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 3, 2024-02-19T21:42:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 3, 2024-02-19T21:42:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:42:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:42:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:42:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:42:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:42:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:42:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:42:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "62", 2024-02-19T21:42:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:42:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:42:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:42:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:42:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:42:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:42:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:42:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:42:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:42:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:42:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:42:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:42:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:42:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:42:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:42:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:42:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:42:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:42:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:42:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:42:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:42:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:42:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:42:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:42:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:42:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:42:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:42:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:42:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:42:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:42:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:42:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:42:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:42:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:42:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:42:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:42:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:42:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:42:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:42:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2024-02-19T21:42:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 4, 2024-02-19T21:42:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.log", 2024-02-19T21:42:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:23.632615+0000", 2024-02-19T21:42:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:42:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:42:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:42:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:42:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:42:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:42:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:42:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:42:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:42:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:42:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:42:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:42:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:42:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:42:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:42:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:42:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:42:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:42:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:42:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:42:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:42:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:42:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:42:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:42:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "62", 2024-02-19T21:42:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:42:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:42:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:42:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:42:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:42:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:42:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:42:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:42:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:42:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:42:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:42:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:42:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:42:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:42:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:42:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:42:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:42:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:42:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:42:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:42:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:42:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:42:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:42:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:42:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:42:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:42:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:42:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:42:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:42:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:42:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:42:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:42:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:42:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:42:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:42:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:42:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:42:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:42:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:42:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:42:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 5, 2024-02-19T21:42:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.control", 2024-02-19T21:42:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:25.600876+0000", 2024-02-19T21:42:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:42:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:42:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:42:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:42:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:42:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:42:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:42:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:42:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:42:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:42:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:42:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:42:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:42:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:42:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:42:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:42:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:42:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:42:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:42:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:42:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:42:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:42:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:42:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:42:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "64", 2024-02-19T21:42:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:42:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:42:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:42:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:42:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:42:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:42:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:42:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:42:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:42:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:42:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:42:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:42:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:42:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:42:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:42:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:42:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:42:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:42:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:42:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:42:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:42:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:42:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:42:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:42:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:42:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:42:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:42:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:42:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:42:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:42:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:42:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:42:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:42:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:42:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:42:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:42:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:42:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:42:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:42:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:42:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 6, 2024-02-19T21:42:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.meta", 2024-02-19T21:42:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:27.661242+0000", 2024-02-19T21:42:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:42:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:42:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:42:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:42:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:42:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:42:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:42:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:42:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:42:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:42:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:42:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:42:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 31, 2024-02-19T21:42:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 22, 2024-02-19T21:42:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 22, 2024-02-19T21:42:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 22, 2024-02-19T21:42:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 31, 2024-02-19T21:42:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:42:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "6.1f", 2024-02-19T21:42:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 207, 2024-02-19T21:42:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 206, 2024-02-19T21:42:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 206, 2024-02-19T21:42:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:42:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:42:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "207", 2024-02-19T21:42:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:42:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "207", 2024-02-19T21:42:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "205", 2024-02-19T21:42:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:42:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:42:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:42:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:42:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:42:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:42:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:42:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:42:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:42:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:42:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:42:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:42:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:42:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:42:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:42:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:42:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:42:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:42:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:42:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:42:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:42:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:42:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:42:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:42:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:42:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:42:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:42:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:42:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:42:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:42:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:42:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:42:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:42:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:42:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2024-02-19T21:42:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4 2024-02-19T21:42:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:42:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:42:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 8, 2024-02-19T21:42:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "unique_pool_1", 2024-02-19T21:42:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:39:38.377517+0000", 2024-02-19T21:42:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:42:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:42:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:42:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:42:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:42:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:42:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:42:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:42:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:42:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:42:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:42:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:42:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 16, 2024-02-19T21:42:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 16, 2024-02-19T21:42:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 16, 2024-02-19T21:42:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 16, 2024-02-19T21:42:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 16, 2024-02-19T21:42:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:42:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:42:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:42:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:42:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:42:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:42:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:42:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "171", 2024-02-19T21:42:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:42:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:42:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:42:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:42:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:42:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:42:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:42:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:42:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:42:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:42:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:42:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:42:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:42:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:42:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:42:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:42:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:42:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:42:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:42:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:42:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:42:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:42:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:42:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:42:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:42:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:42:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:42:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:42:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:42:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:42:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:42:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:42:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:42:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:42:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:42:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:42:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:42:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:42:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:42:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "rados": {} 2024-02-19T21:42:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:42:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:42:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2024-02-19T21:42:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "a72c63f6-46b3-4202-99da-7b0c92b799a5", 2024-02-19T21:42:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:42:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:42:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:42:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:42:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:42:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:42:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 8, 2024-02-19T21:42:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 207, 2024-02-19T21:42:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:42:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:42:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:42:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2024-02-19T21:42:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:42:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2024-02-19T21:42:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:42:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:42:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2024-02-19T21:42:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:42:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2024-02-19T21:42:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:42:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:42:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2024-02-19T21:42:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:42:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2024-02-19T21:42:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:42:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:42:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2024-02-19T21:42:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:42:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2024-02-19T21:42:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:42:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6803/3531298825", 2024-02-19T21:42:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6805/3531298825", 2024-02-19T21:42:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6809/3531298825", 2024-02-19T21:42:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6807/3531298825", 2024-02-19T21:42:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:42:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:42:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:42:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2024-02-19T21:42:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "7d4e170e-b0ca-4e19-be35-4038ca126ee6", 2024-02-19T21:42:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:42:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:42:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:42:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:42:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:42:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:42:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-02-19T21:42:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 202, 2024-02-19T21:42:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:42:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:42:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:42:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2024-02-19T21:42:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:42:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2024-02-19T21:42:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:42:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:42:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2024-02-19T21:42:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:42:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2024-02-19T21:42:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:42:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:42:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2024-02-19T21:42:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:42:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2024-02-19T21:42:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:42:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:42:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2024-02-19T21:42:45.400 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:42:45.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.400 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.400 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2024-02-19T21:42:45.400 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:42:45.400 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.400 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.400 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6811/1497235950", 2024-02-19T21:42:45.400 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6813/1497235950", 2024-02-19T21:42:45.400 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6817/1497235950", 2024-02-19T21:42:45.400 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6815/1497235950", 2024-02-19T21:42:45.400 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:42:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:42:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:42:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2024-02-19T21:42:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "cf461b67-f3e8-45e9-b2f6-777752ba5574", 2024-02-19T21:42:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:42:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 0, 2024-02-19T21:42:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 0, 2024-02-19T21:42:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:42:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:42:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:42:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 18, 2024-02-19T21:42:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 144, 2024-02-19T21:42:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:42:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:42:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:42:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2024-02-19T21:42:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:42:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2024-02-19T21:42:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:42:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.403 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:42:45.403 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.403 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.403 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2024-02-19T21:42:45.403 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:42:45.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.403 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.403 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2024-02-19T21:42:45.403 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:42:45.403 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.403 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:42:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2024-02-19T21:42:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:42:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2024-02-19T21:42:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:42:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:42:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2024-02-19T21:42:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:42:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2024-02-19T21:42:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:42:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6819/3131848307", 2024-02-19T21:42:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6821/3131848307", 2024-02-19T21:42:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6825/3131848307", 2024-02-19T21:42:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6823/3131848307", 2024-02-19T21:42:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:42:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:42:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:42:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2024-02-19T21:42:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "76318cdd-5fce-4a40-95c9-300d55c34820", 2024-02-19T21:42:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:42:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:42:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 0.4183197021484375, 2024-02-19T21:42:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:42:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:42:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:42:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 26, 2024-02-19T21:42:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 202, 2024-02-19T21:42:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:42:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:42:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:42:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2024-02-19T21:42:45.408 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:42:45.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.408 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.408 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2024-02-19T21:42:45.408 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:42:45.408 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.408 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.408 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:42:45.408 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.408 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2024-02-19T21:42:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:42:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2024-02-19T21:42:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:42:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:42:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6832", 2024-02-19T21:42:45.410 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:42:45.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.410 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.410 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6833", 2024-02-19T21:42:45.410 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:42:45.410 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.410 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.410 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:42:45.410 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.410 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.410 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2024-02-19T21:42:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:42:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2024-02-19T21:42:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:42:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6827/2007978078", 2024-02-19T21:42:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6829/2007978078", 2024-02-19T21:42:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6833/2007978078", 2024-02-19T21:42:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6831/2007978078", 2024-02-19T21:42:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:42:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:42:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:42:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2024-02-19T21:42:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "6484964f-3391-4e1d-a56c-813f46124062", 2024-02-19T21:42:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:42:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:42:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:42:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 0.427398681640625, 2024-02-19T21:42:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:42:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:42:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 32, 2024-02-19T21:42:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 202, 2024-02-19T21:42:45.413 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:42:45.413 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:42:45.413 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:42:45.413 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.413 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.413 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6800", 2024-02-19T21:42:45.413 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:42:45.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.413 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.413 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6801", 2024-02-19T21:42:45.413 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:42:45.413 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:42:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6802", 2024-02-19T21:42:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:42:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6803", 2024-02-19T21:42:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:42:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:42:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6806", 2024-02-19T21:42:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:42:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6807", 2024-02-19T21:42:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:42:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:42:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6804", 2024-02-19T21:42:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:42:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6805", 2024-02-19T21:42:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:42:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.417 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6801/1922002860", 2024-02-19T21:42:45.417 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6803/1922002860", 2024-02-19T21:42:45.417 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6807/1922002860", 2024-02-19T21:42:45.417 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6805/1922002860", 2024-02-19T21:42:45.417 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:42:45.417 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:42:45.417 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:42:45.417 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.417 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2024-02-19T21:42:45.417 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "8c7e0309-8c3b-40b9-99d9-96620e52742f", 2024-02-19T21:42:45.417 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:42:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:42:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:42:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:42:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:42:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:42:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 38, 2024-02-19T21:42:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 204, 2024-02-19T21:42:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:42:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:42:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:42:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6808", 2024-02-19T21:42:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:42:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6809", 2024-02-19T21:42:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:42:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:42:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6810", 2024-02-19T21:42:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:42:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.420 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.420 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6811", 2024-02-19T21:42:45.420 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:42:45.420 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.420 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.420 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:42:45.420 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.420 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.420 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6814", 2024-02-19T21:42:45.420 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:42:45.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.421 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.421 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6815", 2024-02-19T21:42:45.421 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:42:45.421 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.421 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.421 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:42:45.421 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.421 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.421 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6812", 2024-02-19T21:42:45.422 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:42:45.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.422 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.422 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.422 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6813", 2024-02-19T21:42:45.422 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:42:45.422 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.422 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.422 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6809/960889603", 2024-02-19T21:42:45.422 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6811/960889603", 2024-02-19T21:42:45.422 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6815/960889603", 2024-02-19T21:42:45.422 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6813/960889603", 2024-02-19T21:42:45.422 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:42:45.422 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:42:45.423 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:42:45.423 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.423 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2024-02-19T21:42:45.423 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "5b7d44a3-197d-482c-bf9e-de5e9013a851", 2024-02-19T21:42:45.423 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:42:45.423 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:42:45.423 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:42:45.423 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:42:45.423 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:42:45.423 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:42:45.423 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 47, 2024-02-19T21:42:45.423 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 207, 2024-02-19T21:42:45.424 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:42:45.424 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:42:45.424 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:42:45.424 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.424 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.424 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6816", 2024-02-19T21:42:45.424 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:42:45.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.424 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.424 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6817", 2024-02-19T21:42:45.424 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:42:45.424 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.425 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.425 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:42:45.425 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.425 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.425 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6818", 2024-02-19T21:42:45.425 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:42:45.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.425 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.425 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6819", 2024-02-19T21:42:45.425 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:42:45.425 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.425 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.426 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:42:45.426 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.426 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.426 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6822", 2024-02-19T21:42:45.426 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:42:45.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.426 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.426 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6823", 2024-02-19T21:42:45.426 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:42:45.426 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.426 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.427 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:42:45.427 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.427 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.427 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6820", 2024-02-19T21:42:45.427 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:42:45.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.427 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.427 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6821", 2024-02-19T21:42:45.427 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:42:45.427 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.427 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.428 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6817/2598265223", 2024-02-19T21:42:45.428 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6819/2598265223", 2024-02-19T21:42:45.428 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6823/2598265223", 2024-02-19T21:42:45.428 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6821/2598265223", 2024-02-19T21:42:45.428 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:42:45.428 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:42:45.428 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:42:45.428 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.428 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2024-02-19T21:42:45.428 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "7e2d0287-928d-40f8-841b-6c2077fc08ac", 2024-02-19T21:42:45.428 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:42:45.428 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:42:45.429 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 0.482391357421875, 2024-02-19T21:42:45.429 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:42:45.429 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:42:45.429 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:42:45.429 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 55, 2024-02-19T21:42:45.429 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 169, 2024-02-19T21:42:45.429 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:42:45.429 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:42:45.429 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:42:45.429 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.429 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.429 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6824", 2024-02-19T21:42:45.429 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:42:45.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.430 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.430 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6825", 2024-02-19T21:42:45.430 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:42:45.430 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.430 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.430 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:42:45.430 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.430 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.430 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6826", 2024-02-19T21:42:45.430 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:42:45.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.430 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.431 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6827", 2024-02-19T21:42:45.431 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:42:45.431 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.431 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.431 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:42:45.431 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.431 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.431 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6830", 2024-02-19T21:42:45.431 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:42:45.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.431 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.432 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6831", 2024-02-19T21:42:45.432 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:42:45.432 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.432 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.432 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:42:45.432 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:42:45.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.432 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:42:45.432 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6828", 2024-02-19T21:42:45.432 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:42:45.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.432 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:42:45.432 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6829", 2024-02-19T21:42:45.433 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:42:45.433 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.433 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.433 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6825/3619345894", 2024-02-19T21:42:45.433 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6827/3619345894", 2024-02-19T21:42:45.433 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6831/3619345894", 2024-02-19T21:42:45.433 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6829/3619345894", 2024-02-19T21:42:45.433 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:42:45.433 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:42:45.433 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:42:45.433 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.433 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.433 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:42:45.433 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2024-02-19T21:42:45.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.434 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2024-02-19T21:42:45.434 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:42:45.434 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:42:45.434 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:42:45.434 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:42:45.434 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:42:45.434 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:42:01.223086+0000", 2024-02-19T21:42:45.434 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:42:45.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.434 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2024-02-19T21:42:45.434 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:42:45.434 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:42:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:42:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:42:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:42:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:41:50.636413+0000", 2024-02-19T21:42:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:42:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2024-02-19T21:42:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:42:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:42:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:42:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:42:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 65536, 2024-02-19T21:42:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:41:40.900813+0000", 2024-02-19T21:42:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:42:45.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.436 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2024-02-19T21:42:45.436 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:42:45.436 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:42:45.436 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:42:45.436 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:42:45.436 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:42:45.436 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:41:45.925166+0000", 2024-02-19T21:42:45.436 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:42:45.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.436 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2024-02-19T21:42:45.436 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:42:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:42:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:42:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:42:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:42:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:41:55.688127+0000", 2024-02-19T21:42:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:42:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2024-02-19T21:42:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:42:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:42:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:42:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:42:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:42:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:41:48.991677+0000", 2024-02-19T21:42:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:42:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2024-02-19T21:42:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:42:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:42:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:42:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:42:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:42:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:41:46.040977+0000", 2024-02-19T21:42:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:42:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2024-02-19T21:42:45.439 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:42:45.439 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:42:45.439 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:42:45.439 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:42:45.439 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:42:45.439 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:41:42.737795+0000", 2024-02-19T21:42:45.439 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:42:45.439 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.439 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:42:45.439 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [ 2024-02-19T21:42:45.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.439 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.1", 2024-02-19T21:42:45.439 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:42:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: 4, 2024-02-19T21:42:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: 2, 2024-02-19T21:42:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: 6 2024-02-19T21:42:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "6.c", 2024-02-19T21:42:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:42:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: 5, 2024-02-19T21:42:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: 0, 2024-02-19T21:42:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: 2 2024-02-19T21:42:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:42:45.441 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [ 2024-02-19T21:42:45.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.441 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.6", 2024-02-19T21:42:45.441 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:42:45.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.441 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:42:45.441 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 5 2024-02-19T21:42:45.441 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.441 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.441 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.e", 2024-02-19T21:42:45.441 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:42:45.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.442 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:42:45.442 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 7 2024-02-19T21:42:45.442 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.442 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.442 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.f", 2024-02-19T21:42:45.442 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:42:45.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.442 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:42:45.442 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 5 2024-02-19T21:42:45.442 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.442 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.443 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.19", 2024-02-19T21:42:45.443 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:42:45.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.443 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:42:45.443 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 7 2024-02-19T21:42:45.443 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.443 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.443 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.1f", 2024-02-19T21:42:45.443 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:42:45.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.443 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:42:45.443 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 7 2024-02-19T21:42:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 6, 2024-02-19T21:42:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 0 2024-02-19T21:42:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "5.1", 2024-02-19T21:42:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:42:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 4, 2024-02-19T21:42:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 6 2024-02-19T21:42:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "5.d", 2024-02-19T21:42:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:42:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 0, 2024-02-19T21:42:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 3 2024-02-19T21:42:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "5.13", 2024-02-19T21:42:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:42:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 0, 2024-02-19T21:42:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 6 2024-02-19T21:42:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:42:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [ 2024-02-19T21:42:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "8.8", 2024-02-19T21:42:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:42:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: 5, 2024-02-19T21:42:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: 7, 2024-02-19T21:42:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: 0 2024-02-19T21:42:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:42:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "8.b", 2024-02-19T21:42:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:42:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: 4, 2024-02-19T21:42:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: 1, 2024-02-19T21:42:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: 7 2024-02-19T21:42:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:42:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:42:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2024-02-19T21:42:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: "blocklist": { 2024-02-19T21:42:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6800/2867197629": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:42:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/1659656010": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:42:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6801/2272739550": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:42:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/867908385": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:42:45.448 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/398750494": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:42:45.448 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/2833137430": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:42:45.448 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/2520755315": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:42:45.448 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6800/2094869828": "2024-02-20T21:26:51.262073+0000", 2024-02-19T21:42:45.448 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6800/2272739550": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:42:45.448 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6801/2094869828": "2024-02-20T21:26:51.262073+0000", 2024-02-19T21:42:45.448 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/2130852198": "2024-02-20T21:26:51.262073+0000", 2024-02-19T21:42:45.448 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6801/2867197629": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:42:45.448 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/1952386920": "2024-02-20T21:26:51.262073+0000" 2024-02-19T21:42:45.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.448 INFO:teuthology.orchestra.run.smithi080.stdout: "range_blocklist": {}, 2024-02-19T21:42:45.448 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2024-02-19T21:42:45.448 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2024-02-19T21:42:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2024-02-19T21:42:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2024-02-19T21:42:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2024-02-19T21:42:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2024-02-19T21:42:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2024-02-19T21:42:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2024-02-19T21:42:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:42:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2024-02-19T21:42:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2024-02-19T21:42:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2024-02-19T21:42:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2024-02-19T21:42:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {}, 2024-02-19T21:42:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode": { 2024-02-19T21:42:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode_enabled": false, 2024-02-19T21:42:45.450 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_bucket_count": 0, 2024-02-19T21:42:45.450 INFO:teuthology.orchestra.run.smithi080.stdout: "degraded_stretch_mode": 0, 2024-02-19T21:42:45.450 INFO:teuthology.orchestra.run.smithi080.stdout: "recovering_stretch_mode": 0, 2024-02-19T21:42:45.450 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode_bucket": 0 2024-02-19T21:42:45.450 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:42:45.450 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:42:45.450 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:42:45.451 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:42:45.451 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:45.452 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:42:45.552 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:42:45.581 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:45.606 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:42:45.609 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:45.609 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:42:45.710 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:42:45.747 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:44.562885+0000 mon.a (mon.0) 1113 : cluster [DBG] osdmap e208: 8 total, 8 up, 7 in 2024-02-19T21:42:45.747 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:45.013773+0000 mon.a (mon.0) 1114 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "30"}]: dispatch 2024-02-19T21:42:45.747 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:45.349265+0000 mon.a (mon.0) 1115 : audit [DBG] from='client.? 172.21.15.80:0/3900770570' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-19T21:42:45.747 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:44.562885+0000 mon.a (mon.0) 1113 : cluster [DBG] osdmap e208: 8 total, 8 up, 7 in 2024-02-19T21:42:45.747 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:45.013773+0000 mon.a (mon.0) 1114 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "30"}]: dispatch 2024-02-19T21:42:45.747 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:45.349265+0000 mon.a (mon.0) 1115 : audit [DBG] from='client.? 172.21.15.80:0/3900770570' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-19T21:42:45.755 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:46.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:44.562885+0000 mon.a (mon.0) 1113 : cluster [DBG] osdmap e208: 8 total, 8 up, 7 in 2024-02-19T21:42:46.062 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:45.013773+0000 mon.a (mon.0) 1114 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "30"}]: dispatch 2024-02-19T21:42:46.062 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:45.349265+0000 mon.a (mon.0) 1115 : audit [DBG] from='client.? 172.21.15.80:0/3900770570' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-19T21:42:46.062 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:42:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:42:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:42:46.175 INFO:tasks.thrashosds.thrasher:j is {'epoch': 208, 'fsid': '6f763558-cf6d-11ee-95bb-87774f69a715', 'created': '2024-02-19T21:26:16.880265+0000', 'modified': '2024-02-19T21:42:44.528416+0000', 'last_up_change': '2024-02-19T21:32:14.805693+0000', 'last_in_change': '2024-02-19T21:39:38.443319+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 18, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 8, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-19T21:30:05.947623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2024-02-19T21:32:22.082250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2024-02-19T21:32:22.333164+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 3, 'pg_placement_num': 3, 'pg_placement_num_target': 3, 'pg_num_target': 3, 'pg_num_pending': 3, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2024-02-19T21:32:23.632615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2024-02-19T21:32:25.600876+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2024-02-19T21:32:27.661242+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 31, 'pg_placement_num': 22, 'pg_placement_num_target': 22, 'pg_num_target': 22, 'pg_num_pending': 31, 'last_pg_merge_meta': {'source_pgid': '6.1f', 'ready_epoch': 207, 'last_epoch_started': 206, 'last_epoch_clean': 206, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '207', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '207', 'last_force_op_resend_preluminous': '205', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}}, {'pool': 8, 'pool_name': 'unique_pool_1', 'create_time': '2024-02-19T21:39:38.377517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '171', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': 'a72c63f6-46b3-4202-99da-7b0c92b799a5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 207, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6802', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6803', 'nonce': 3531298825}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6804', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6805', 'nonce': 3531298825}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6808', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6809', 'nonce': 3531298825}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6806', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6807', 'nonce': 3531298825}]}, 'public_addr': '172.21.15.80:6803/3531298825', 'cluster_addr': '172.21.15.80:6805/3531298825', 'heartbeat_back_addr': '172.21.15.80:6809/3531298825', 'heartbeat_front_addr': '172.21.15.80:6807/3531298825', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7d4e170e-b0ca-4e19-be35-4038ca126ee6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 202, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6810', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6811', 'nonce': 1497235950}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6812', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6813', 'nonce': 1497235950}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6816', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6817', 'nonce': 1497235950}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6814', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6815', 'nonce': 1497235950}]}, 'public_addr': '172.21.15.80:6811/1497235950', 'cluster_addr': '172.21.15.80:6813/1497235950', 'heartbeat_back_addr': '172.21.15.80:6817/1497235950', 'heartbeat_front_addr': '172.21.15.80:6815/1497235950', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'cf461b67-f3e8-45e9-b2f6-777752ba5574', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 18, 'up_thru': 144, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6818', 'nonce': 3131848307}, {'type': 'v1', 'addr': '172.21.15.80:6819', 'nonce': 3131848307}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6820', 'nonce': 3131848307}, {'type': 'v1', 'addr': '172.21.15.80:6821', 'nonce': 3131848307}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6824', 'nonce': 3131848307}, {'type': 'v1', 'addr': '172.21.15.80:6825', 'nonce': 3131848307}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6822', 'nonce': 3131848307}, {'type': 'v1', 'addr': '172.21.15.80:6823', 'nonce': 3131848307}]}, 'public_addr': '172.21.15.80:6819/3131848307', 'cluster_addr': '172.21.15.80:6821/3131848307', 'heartbeat_back_addr': '172.21.15.80:6825/3131848307', 'heartbeat_front_addr': '172.21.15.80:6823/3131848307', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '76318cdd-5fce-4a40-95c9-300d55c34820', 'up': 1, 'in': 1, 'weight': 0.4183197021484375, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 26, 'up_thru': 202, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6826', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6827', 'nonce': 2007978078}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6828', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6829', 'nonce': 2007978078}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6832', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6833', 'nonce': 2007978078}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6830', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6831', 'nonce': 2007978078}]}, 'public_addr': '172.21.15.80:6827/2007978078', 'cluster_addr': '172.21.15.80:6829/2007978078', 'heartbeat_back_addr': '172.21.15.80:6833/2007978078', 'heartbeat_front_addr': '172.21.15.80:6831/2007978078', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '6484964f-3391-4e1d-a56c-813f46124062', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.427398681640625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 32, 'up_thru': 202, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6800', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6801', 'nonce': 1922002860}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6802', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6803', 'nonce': 1922002860}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6806', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6807', 'nonce': 1922002860}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6804', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6805', 'nonce': 1922002860}]}, 'public_addr': '172.21.15.157:6801/1922002860', 'cluster_addr': '172.21.15.157:6803/1922002860', 'heartbeat_back_addr': '172.21.15.157:6807/1922002860', 'heartbeat_front_addr': '172.21.15.157:6805/1922002860', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '8c7e0309-8c3b-40b9-99d9-96620e52742f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 38, 'up_thru': 204, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6808', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6809', 'nonce': 960889603}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6810', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6811', 'nonce': 960889603}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6814', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6815', 'nonce': 960889603}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6812', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6813', 'nonce': 960889603}]}, 'public_addr': '172.21.15.157:6809/960889603', 'cluster_addr': '172.21.15.157:6811/960889603', 'heartbeat_back_addr': '172.21.15.157:6815/960889603', 'heartbeat_front_addr': '172.21.15.157:6813/960889603', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '5b7d44a3-197d-482c-bf9e-de5e9013a851', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 47, 'up_thru': 207, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6816', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6817', 'nonce': 2598265223}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6818', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6819', 'nonce': 2598265223}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6822', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6823', 'nonce': 2598265223}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6820', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6821', 'nonce': 2598265223}]}, 'public_addr': '172.21.15.157:6817/2598265223', 'cluster_addr': '172.21.15.157:6819/2598265223', 'heartbeat_back_addr': '172.21.15.157:6823/2598265223', 'heartbeat_front_addr': '172.21.15.157:6821/2598265223', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '7e2d0287-928d-40f8-841b-6c2077fc08ac', 'up': 1, 'in': 1, 'weight': 0.482391357421875, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 55, 'up_thru': 169, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6824', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6825', 'nonce': 3619345894}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6826', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6827', 'nonce': 3619345894}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6830', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6831', 'nonce': 3619345894}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6828', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6829', 'nonce': 3619345894}]}, 'public_addr': '172.21.15.157:6825/3619345894', 'cluster_addr': '172.21.15.157:6827/3619345894', 'heartbeat_back_addr': '172.21.15.157:6831/3619345894', 'heartbeat_front_addr': '172.21.15.157:6829/3619345894', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:42:01.223086+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:41:50.636413+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-02-19T21:41:40.900813+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:41:45.925166+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:41:55.688127+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:41:48.991677+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:41:46.040977+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:41:42.737795+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '4.1', 'osds': [4, 2, 6]}, {'pgid': '6.c', 'osds': [5, 0, 2]}], 'pg_upmap_items': [{'pgid': '4.6', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.e', 'mappings': [{'from': 1, 'to': 7}]}, {'pgid': '4.f', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.19', 'mappings': [{'from': 1, 'to': 7}]}, {'pgid': '4.1f', 'mappings': [{'from': 1, 'to': 7}, {'from': 6, 'to': 0}]}, {'pgid': '5.1', 'mappings': [{'from': 4, 'to': 6}]}, {'pgid': '5.d', 'mappings': [{'from': 0, 'to': 3}]}, {'pgid': '5.13', 'mappings': [{'from': 0, 'to': 6}]}], 'pg_temp': [{'pgid': '8.8', 'osds': [5, 7, 0]}, {'pgid': '8.b', 'osds': [4, 1, 7]}], 'primary_temp': [], 'blocklist': {'172.21.15.80:6800/2867197629': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:0/1659656010': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:6801/2272739550': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:0/867908385': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:0/398750494': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:0/2833137430': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:0/2520755315': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:6800/2094869828': '2024-02-20T21:26:51.262073+0000', '172.21.15.80:6800/2272739550': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:6801/2094869828': '2024-02-20T21:26:51.262073+0000', '172.21.15.80:0/2130852198': '2024-02-20T21:26:51.262073+0000', '172.21.15.80:6801/2867197629': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:0/1952386920': '2024-02-20T21:26:51.262073+0000'}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-02-19T21:42:46.176 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:42:46.519 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:42:46.523 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:46.524 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:42:46.624 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:42:46.677 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:46.724 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:42:46.730 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:46.731 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:42:46.775 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:45.012964+0000 mgr.y (mgr.14514) 391 : cluster [DBG] pgmap v437: 147 pgs: 3 active+remapped+backfilling, 144 active+clean; 3.4 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 713 op/s; 6771/166725 objects misplaced (4.061%); 2.6 MiB/s, 41 objects/s recovering 2024-02-19T21:42:46.775 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:45.568579+0000 mon.a (mon.0) 1116 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "30"}]': finished 2024-02-19T21:42:46.775 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:45.568640+0000 mon.a (mon.0) 1117 : cluster [DBG] osdmap e209: 8 total, 8 up, 7 in 2024-02-19T21:42:46.775 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:45.845875+0000 osd.7 (osd.7) 159 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:42:46.775 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:45.845927+0000 osd.7 (osd.7) 160 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:42:46.776 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:45.012964+0000 mgr.y (mgr.14514) 391 : cluster [DBG] pgmap v437: 147 pgs: 3 active+remapped+backfilling, 144 active+clean; 3.4 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 713 op/s; 6771/166725 objects misplaced (4.061%); 2.6 MiB/s, 41 objects/s recovering 2024-02-19T21:42:46.776 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:45.568579+0000 mon.a (mon.0) 1116 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "30"}]': finished 2024-02-19T21:42:46.776 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:45.568640+0000 mon.a (mon.0) 1117 : cluster [DBG] osdmap e209: 8 total, 8 up, 7 in 2024-02-19T21:42:46.776 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:45.845875+0000 osd.7 (osd.7) 159 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:42:46.776 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:45.845927+0000 osd.7 (osd.7) 160 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:42:46.831 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:42:46.884 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:47.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:45.012964+0000 mgr.y (mgr.14514) 391 : cluster [DBG] pgmap v437: 147 pgs: 3 active+remapped+backfilling, 144 active+clean; 3.4 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 713 op/s; 6771/166725 objects misplaced (4.061%); 2.6 MiB/s, 41 objects/s recovering 2024-02-19T21:42:47.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:45.568579+0000 mon.a (mon.0) 1116 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "30"}]': finished 2024-02-19T21:42:47.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:45.568640+0000 mon.a (mon.0) 1117 : cluster [DBG] osdmap e209: 8 total, 8 up, 7 in 2024-02-19T21:42:47.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:45.845875+0000 osd.7 (osd.7) 159 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:42:47.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:45.845927+0000 osd.7 (osd.7) 160 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:42:48.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:46.587403+0000 mon.a (mon.0) 1118 : cluster [DBG] osdmap e210: 8 total, 8 up, 7 in 2024-02-19T21:42:48.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:46.587403+0000 mon.a (mon.0) 1118 : cluster [DBG] osdmap e210: 8 total, 8 up, 7 in 2024-02-19T21:42:48.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:46.587403+0000 mon.a (mon.0) 1118 : cluster [DBG] osdmap e210: 8 total, 8 up, 7 in 2024-02-19T21:42:49.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:47.013401+0000 mgr.y (mgr.14514) 392 : cluster [DBG] pgmap v440: 147 pgs: 1 peering, 2 active+remapped+backfilling, 144 active+clean; 3.3 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.02k op/s; 5982/163014 objects misplaced (3.670%); 15 MiB/s, 235 objects/s recovering 2024-02-19T21:42:49.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:47.604160+0000 mon.a (mon.0) 1119 : cluster [DBG] osdmap e211: 8 total, 8 up, 7 in 2024-02-19T21:42:49.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:47.013401+0000 mgr.y (mgr.14514) 392 : cluster [DBG] pgmap v440: 147 pgs: 1 peering, 2 active+remapped+backfilling, 144 active+clean; 3.3 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.02k op/s; 5982/163014 objects misplaced (3.670%); 15 MiB/s, 235 objects/s recovering 2024-02-19T21:42:49.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:47.604160+0000 mon.a (mon.0) 1119 : cluster [DBG] osdmap e211: 8 total, 8 up, 7 in 2024-02-19T21:42:49.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:47.013401+0000 mgr.y (mgr.14514) 392 : cluster [DBG] pgmap v440: 147 pgs: 1 peering, 2 active+remapped+backfilling, 144 active+clean; 3.3 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.02k op/s; 5982/163014 objects misplaced (3.670%); 15 MiB/s, 235 objects/s recovering 2024-02-19T21:42:49.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:47.604160+0000 mon.a (mon.0) 1119 : cluster [DBG] osdmap e211: 8 total, 8 up, 7 in 2024-02-19T21:42:50.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:48.606312+0000 mon.a (mon.0) 1120 : cluster [DBG] osdmap e212: 8 total, 8 up, 7 in 2024-02-19T21:42:50.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:48.961421+0000 mon.a (mon.0) 1121 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:42:50.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:49.015083+0000 mon.a (mon.0) 1122 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "29"}]: dispatch 2024-02-19T21:42:50.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:48.606312+0000 mon.a (mon.0) 1120 : cluster [DBG] osdmap e212: 8 total, 8 up, 7 in 2024-02-19T21:42:50.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:48.961421+0000 mon.a (mon.0) 1121 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:42:50.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:49.015083+0000 mon.a (mon.0) 1122 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "29"}]: dispatch 2024-02-19T21:42:50.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:48.606312+0000 mon.a (mon.0) 1120 : cluster [DBG] osdmap e212: 8 total, 8 up, 7 in 2024-02-19T21:42:50.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:48.961421+0000 mon.a (mon.0) 1121 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:42:50.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:49.015083+0000 mon.a (mon.0) 1122 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "29"}]: dispatch 2024-02-19T21:42:50.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:49.013793+0000 mgr.y (mgr.14514) 393 : cluster [DBG] pgmap v443: 146 pgs: 1 peering, 2 active+remapped+backfilling, 143 active+clean; 3.3 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 0 B/s wr, 309 op/s; 5982/163014 objects misplaced (3.670%); 12 MiB/s, 193 objects/s recovering 2024-02-19T21:42:50.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:49.963136+0000 mon.a (mon.0) 1123 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "29"}]': finished 2024-02-19T21:42:50.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:49.963195+0000 mon.a (mon.0) 1124 : cluster [DBG] osdmap e213: 8 total, 8 up, 7 in 2024-02-19T21:42:50.811 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:42:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:42:51.096 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:42:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:42:50] "GET /metrics HTTP/1.1" 200 175931 "" "Prometheus/2.33.4" 2024-02-19T21:42:51.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:49.013793+0000 mgr.y (mgr.14514) 393 : cluster [DBG] pgmap v443: 146 pgs: 1 peering, 2 active+remapped+backfilling, 143 active+clean; 3.3 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 0 B/s wr, 309 op/s; 5982/163014 objects misplaced (3.670%); 12 MiB/s, 193 objects/s recovering 2024-02-19T21:42:51.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:49.963136+0000 mon.a (mon.0) 1123 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "29"}]': finished 2024-02-19T21:42:51.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:49.963195+0000 mon.a (mon.0) 1124 : cluster [DBG] osdmap e213: 8 total, 8 up, 7 in 2024-02-19T21:42:51.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:49.013793+0000 mgr.y (mgr.14514) 393 : cluster [DBG] pgmap v443: 146 pgs: 1 peering, 2 active+remapped+backfilling, 143 active+clean; 3.3 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 0 B/s wr, 309 op/s; 5982/163014 objects misplaced (3.670%); 12 MiB/s, 193 objects/s recovering 2024-02-19T21:42:51.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:49.963136+0000 mon.a (mon.0) 1123 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "29"}]': finished 2024-02-19T21:42:51.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:49.963195+0000 mon.a (mon.0) 1124 : cluster [DBG] osdmap e213: 8 total, 8 up, 7 in 2024-02-19T21:42:52.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:50.403265+0000 mgr.y (mgr.14514) 394 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:42:52.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:50.983860+0000 mon.a (mon.0) 1125 : cluster [DBG] osdmap e214: 8 total, 8 up, 7 in 2024-02-19T21:42:52.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:50.403265+0000 mgr.y (mgr.14514) 394 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:42:52.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:50.983860+0000 mon.a (mon.0) 1125 : cluster [DBG] osdmap e214: 8 total, 8 up, 7 in 2024-02-19T21:42:52.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:50.403265+0000 mgr.y (mgr.14514) 394 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:42:52.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:50.983860+0000 mon.a (mon.0) 1125 : cluster [DBG] osdmap e214: 8 total, 8 up, 7 in 2024-02-19T21:42:52.882 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:42:52.896 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:51.014178+0000 mgr.y (mgr.14514) 395 : cluster [DBG] pgmap v446: 146 pgs: 2 active+remapped+backfilling, 144 active+clean; 3.0 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.15k op/s; 5391/149262 objects misplaced (3.612%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:42:52.896 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:51.181450+0000 osd.5 (osd.5) 175 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:42:52.896 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:51.181504+0000 osd.5 (osd.5) 176 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:42:52.896 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:51.991740+0000 mon.a (mon.0) 1126 : cluster [DBG] osdmap e215: 8 total, 8 up, 7 in 2024-02-19T21:42:52.897 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:51.014178+0000 mgr.y (mgr.14514) 395 : cluster [DBG] pgmap v446: 146 pgs: 2 active+remapped+backfilling, 144 active+clean; 3.0 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.15k op/s; 5391/149262 objects misplaced (3.612%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:42:52.897 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:51.181450+0000 osd.5 (osd.5) 175 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:42:52.897 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:51.181504+0000 osd.5 (osd.5) 176 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:42:52.897 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:51.991740+0000 mon.a (mon.0) 1126 : cluster [DBG] osdmap e215: 8 total, 8 up, 7 in 2024-02-19T21:42:52.897 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:52.898 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:42:52.905 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.2 dump_ops_in_flight 2024-02-19T21:42:52.999 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:42:53.045 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:53.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:51.014178+0000 mgr.y (mgr.14514) 395 : cluster [DBG] pgmap v446: 146 pgs: 2 active+remapped+backfilling, 144 active+clean; 3.0 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.15k op/s; 5391/149262 objects misplaced (3.612%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:42:53.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:51.181450+0000 osd.5 (osd.5) 175 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:42:53.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:51.181504+0000 osd.5 (osd.5) 176 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:42:53.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:51.991740+0000 mon.a (mon.0) 1126 : cluster [DBG] osdmap e215: 8 total, 8 up, 7 in 2024-02-19T21:42:54.311 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:52.992584+0000 mon.a (mon.0) 1127 : cluster [DBG] osdmap e216: 8 total, 8 up, 7 in 2024-02-19T21:42:54.311 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:53.014572+0000 mgr.y (mgr.14514) 396 : cluster [DBG] pgmap v449: 145 pgs: 2 active+remapped+backfilling, 143 active+clean; 3.0 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.15k op/s; 5391/149262 objects misplaced (3.612%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:42:54.312 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:53.015357+0000 mon.a (mon.0) 1128 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd rm-pg-upmap", "pgid": "6.c"}]: dispatch 2024-02-19T21:42:54.312 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:53.015499+0000 mon.a (mon.0) 1129 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd rm-pg-upmap-items", "pgid": "6.c"}]: dispatch 2024-02-19T21:42:54.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:52.992584+0000 mon.a (mon.0) 1127 : cluster [DBG] osdmap e216: 8 total, 8 up, 7 in 2024-02-19T21:42:54.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:53.014572+0000 mgr.y (mgr.14514) 396 : cluster [DBG] pgmap v449: 145 pgs: 2 active+remapped+backfilling, 143 active+clean; 3.0 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.15k op/s; 5391/149262 objects misplaced (3.612%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:42:54.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:53.015357+0000 mon.a (mon.0) 1128 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd rm-pg-upmap", "pgid": "6.c"}]: dispatch 2024-02-19T21:42:54.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:53.015499+0000 mon.a (mon.0) 1129 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd rm-pg-upmap-items", "pgid": "6.c"}]: dispatch 2024-02-19T21:42:54.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:52.992584+0000 mon.a (mon.0) 1127 : cluster [DBG] osdmap e216: 8 total, 8 up, 7 in 2024-02-19T21:42:54.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:53.014572+0000 mgr.y (mgr.14514) 396 : cluster [DBG] pgmap v449: 145 pgs: 2 active+remapped+backfilling, 143 active+clean; 3.0 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.15k op/s; 5391/149262 objects misplaced (3.612%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:42:54.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:53.015357+0000 mon.a (mon.0) 1128 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd rm-pg-upmap", "pgid": "6.c"}]: dispatch 2024-02-19T21:42:54.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:53.015499+0000 mon.a (mon.0) 1129 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd rm-pg-upmap-items", "pgid": "6.c"}]: dispatch 2024-02-19T21:42:55.015 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:42:55.018 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:55.018 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:42:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:42:55.214 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:42:55.264 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:55.307 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:42:55.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:53.994880+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd rm-pg-upmap", "pgid": "6.c"}]': finished 2024-02-19T21:42:55.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:53.994950+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd rm-pg-upmap-items", "pgid": "6.c"}]': finished 2024-02-19T21:42:55.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:53.994990+0000 mon.a (mon.0) 1132 : cluster [DBG] osdmap e217: 8 total, 8 up, 7 in 2024-02-19T21:42:55.311 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:55.312 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:42:55.341 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:53.994880+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd rm-pg-upmap", "pgid": "6.c"}]': finished 2024-02-19T21:42:55.341 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:53.994950+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd rm-pg-upmap-items", "pgid": "6.c"}]': finished 2024-02-19T21:42:55.341 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:53.994990+0000 mon.a (mon.0) 1132 : cluster [DBG] osdmap e217: 8 total, 8 up, 7 in 2024-02-19T21:42:55.342 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:53.994880+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd rm-pg-upmap", "pgid": "6.c"}]': finished 2024-02-19T21:42:55.343 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:53.994950+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd rm-pg-upmap-items", "pgid": "6.c"}]': finished 2024-02-19T21:42:55.343 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:53.994990+0000 mon.a (mon.0) 1132 : cluster [DBG] osdmap e217: 8 total, 8 up, 7 in 2024-02-19T21:42:55.412 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:42:55.488 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:55.515 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:42:55.528 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:55.528 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:42:55.618 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:42:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:42:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:42:55.630 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:42:55.715 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:55.754 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:42:55.758 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:55.759 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:42:55.860 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:42:55.917 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:55.958 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:55.959 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:42:55.959 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:42:56.060 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:42:56.135 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:56.160 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:42:56.163 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:56.163 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:42:56.164 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:55.015379+0000 mgr.y (mgr.14514) 397 : cluster [DBG] pgmap v451: 145 pgs: 2 active+remapped+backfilling, 143 active+clean; 2.8 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 871 op/s; 4750/138735 objects misplaced (3.424%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:42:56.164 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:55.016372+0000 mon.a (mon.0) 1133 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "28"}]: dispatch 2024-02-19T21:42:56.164 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:55.892689+0000 mon.c (mon.2) 51 : audit [DBG] from='client.? 172.21.15.80:0/3162840295' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:42:56.192 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:55.015379+0000 mgr.y (mgr.14514) 397 : cluster [DBG] pgmap v451: 145 pgs: 2 active+remapped+backfilling, 143 active+clean; 2.8 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 871 op/s; 4750/138735 objects misplaced (3.424%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:42:56.192 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:55.016372+0000 mon.a (mon.0) 1133 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "28"}]: dispatch 2024-02-19T21:42:56.192 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:55.892689+0000 mon.c (mon.2) 51 : audit [DBG] from='client.? 172.21.15.80:0/3162840295' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:42:56.193 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:55.015379+0000 mgr.y (mgr.14514) 397 : cluster [DBG] pgmap v451: 145 pgs: 2 active+remapped+backfilling, 143 active+clean; 2.8 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 871 op/s; 4750/138735 objects misplaced (3.424%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:42:56.193 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:55.016372+0000 mon.a (mon.0) 1133 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "28"}]: dispatch 2024-02-19T21:42:56.193 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:55.892689+0000 mon.c (mon.2) 51 : audit [DBG] from='client.? 172.21.15.80:0/3162840295' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:42:56.264 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:42:56.313 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:56.673 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:42:56.680 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:56.681 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:42:56.782 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:42:56.848 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:56.879 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:42:56.883 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:56.883 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:42:56.984 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:42:57.043 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:57.068 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:42:57.071 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:57.071 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:42:57.172 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:42:57.234 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:56.029389+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "28"}]': finished 2024-02-19T21:42:57.234 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:56.029451+0000 mon.a (mon.0) 1135 : cluster [DBG] osdmap e218: 8 total, 8 up, 7 in 2024-02-19T21:42:57.246 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:57.279 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:42:57.279 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:42:57.279 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:42:57.280 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:42:57.280 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:42:57.280 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:42:57.280 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:42:57.280 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:42:57.280 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:42:57.280 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:42:57.280 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:42:57.280 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:42:57.280 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:42:57.280 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:42:57.281 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:42:57.281 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:42:57.286 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:42:57.292 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:57.293 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:42:57.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:56.029389+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "28"}]': finished 2024-02-19T21:42:57.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:56.029451+0000 mon.a (mon.0) 1135 : cluster [DBG] osdmap e218: 8 total, 8 up, 7 in 2024-02-19T21:42:57.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:56.029389+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "28"}]': finished 2024-02-19T21:42:57.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:56.029451+0000 mon.a (mon.0) 1135 : cluster [DBG] osdmap e218: 8 total, 8 up, 7 in 2024-02-19T21:42:57.393 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:42:57.444 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:57.474 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:42:57.478 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:42:57.491 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:42:57.499 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:57.499 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:42:57.505 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:42:57.600 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:42:57.636 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:58.192 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:42:58.196 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:42:58.204 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:58.205 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:42:58.305 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:42:58.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:57.015860+0000 mgr.y (mgr.14514) 398 : cluster [DBG] pgmap v453: 145 pgs: 2 active+remapped+backfilling, 143 active+clean; 2.7 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1018 B/s rd, 0 B/s wr, 1.01k op/s; 4750/133992 objects misplaced (3.545%); 1.4 MiB/s, 21 objects/s recovering 2024-02-19T21:42:58.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:57.038713+0000 mon.a (mon.0) 1136 : cluster [DBG] osdmap e219: 8 total, 8 up, 7 in 2024-02-19T21:42:58.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:57.450227+0000 mgr.y (mgr.14514) 399 : audit [DBG] from='client.25064 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:42:58.342 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:57.015860+0000 mgr.y (mgr.14514) 398 : cluster [DBG] pgmap v453: 145 pgs: 2 active+remapped+backfilling, 143 active+clean; 2.7 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1018 B/s rd, 0 B/s wr, 1.01k op/s; 4750/133992 objects misplaced (3.545%); 1.4 MiB/s, 21 objects/s recovering 2024-02-19T21:42:58.342 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:57.038713+0000 mon.a (mon.0) 1136 : cluster [DBG] osdmap e219: 8 total, 8 up, 7 in 2024-02-19T21:42:58.342 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:57.450227+0000 mgr.y (mgr.14514) 399 : audit [DBG] from='client.25064 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:42:58.342 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:57.015860+0000 mgr.y (mgr.14514) 398 : cluster [DBG] pgmap v453: 145 pgs: 2 active+remapped+backfilling, 143 active+clean; 2.7 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1018 B/s rd, 0 B/s wr, 1.01k op/s; 4750/133992 objects misplaced (3.545%); 1.4 MiB/s, 21 objects/s recovering 2024-02-19T21:42:58.342 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:57.038713+0000 mon.a (mon.0) 1136 : cluster [DBG] osdmap e219: 8 total, 8 up, 7 in 2024-02-19T21:42:58.342 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:57.450227+0000 mgr.y (mgr.14514) 399 : audit [DBG] from='client.25064 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:42:58.350 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:58.428 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:42:58.433 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:58.434 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:42:58.534 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:42:58.604 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:58.650 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:42:58.655 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:58.655 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:42:58.756 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:42:58.811 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:58.839 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:42:58.845 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:58.845 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:42:58.946 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:42:58.991 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:59.295 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:58.072587+0000 mon.a (mon.0) 1137 : cluster [DBG] osdmap e220: 8 total, 8 up, 7 in 2024-02-19T21:42:59.296 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:42:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:59.017544+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "27"}]: dispatch 2024-02-19T21:42:59.296 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:58.072587+0000 mon.a (mon.0) 1137 : cluster [DBG] osdmap e220: 8 total, 8 up, 7 in 2024-02-19T21:42:59.296 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:42:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:59.017544+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "27"}]: dispatch 2024-02-19T21:42:59.326 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":454,"stamp":"2024-02-19T21:42:57.037046+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2914457276,"num_objects":44664,"num_object_clones":0,"num_object_copies":133992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":4750,"num_objects_unfound":0,"num_objects_dirty":44664,"num_whiteouts":0,"num_read":1752,"num_read_kb":1504,"num_write":211674,"num_write_kb":8173802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10502,"num_bytes_recovered":675222165,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76098,"ondisk_log_size":76098,"up":435,"acting":435,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":439,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":656216064,"kb_used":11274552,"kb_used_data":9144384,"kb_used_omap":0,"kb_used_meta":2129664,"kb_avail":644941512,"statfs":{"total":671965249536,"available":660420108288,"internally_reserved":0,"allocated":9363849216,"data_stored":9361607603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2180775936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-333578240,"num_objects":-5090,"num_object_clones":0,"num_object_copies":-15270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-641,"num_objects_unfound":0,"num_objects_dirty":-5090,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5090,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":7143424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.046242"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":24,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.009355+0000","last_change":"2024-02-19T21:42:36.472698+0000","last_active":"2024-02-19T21:42:53.009355+0000","last_peered":"2024-02-19T21:42:53.009355+0000","last_clean":"2024-02-19T21:42:53.009355+0000","last_became_active":"2024-02-19T21:42:36.472361+0000","last_became_peered":"2024-02-19T21:42:36.472361+0000","last_unstale":"2024-02-19T21:42:53.009355+0000","last_undegraded":"2024-02-19T21:42:53.009355+0000","last_fullsized":"2024-02-19T21:42:53.009355+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:12.925421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:12.925421+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":143,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.012674+0000","last_change":"2024-02-19T21:40:23.364671+0000","last_active":"2024-02-19T21:42:53.012674+0000","last_peered":"2024-02-19T21:42:53.012674+0000","last_clean":"2024-02-19T21:42:53.012674+0000","last_became_active":"2024-02-19T21:35:14.511920+0000","last_became_peered":"2024-02-19T21:35:14.511920+0000","last_unstale":"2024-02-19T21:42:53.012674+0000","last_undegraded":"2024-02-19T21:42:53.012674+0000","last_fullsized":"2024-02-19T21:42:53.012674+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:23.364579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:23.364579+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":187,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.027857+0000","last_change":"2024-02-19T21:40:28.473842+0000","last_active":"2024-02-19T21:42:53.027857+0000","last_peered":"2024-02-19T21:42:53.027857+0000","last_clean":"2024-02-19T21:42:53.027857+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:42:53.027857+0000","last_undegraded":"2024-02-19T21:42:53.027857+0000","last_fullsized":"2024-02-19T21:42:53.027857+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:28.473778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:28.473778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"201'27","reported_seq":159,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.028787+0000","last_change":"2024-02-19T21:39:51.546188+0000","last_active":"2024-02-19T21:42:53.028787+0000","last_peered":"2024-02-19T21:42:53.028787+0000","last_clean":"2024-02-19T21:42:53.028787+0000","last_became_active":"2024-02-19T21:39:51.536424+0000","last_became_peered":"2024-02-19T21:39:51.536424+0000","last_unstale":"2024-02-19T21:42:53.028787+0000","last_undegraded":"2024-02-19T21:42:53.028787+0000","last_fullsized":"2024-02-19T21:42:53.028787+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:39:29.269819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:29.269819+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":150,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.994445+0000","last_change":"2024-02-19T21:42:36.501892+0000","last_active":"2024-02-19T21:42:52.994445+0000","last_peered":"2024-02-19T21:42:52.994445+0000","last_clean":"2024-02-19T21:42:52.994445+0000","last_became_active":"2024-02-19T21:42:36.501507+0000","last_became_peered":"2024-02-19T21:42:36.501507+0000","last_unstale":"2024-02-19T21:42:52.994445+0000","last_undegraded":"2024-02-19T21:42:52.994445+0000","last_fullsized":"2024-02-19T21:42:52.994445+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:29.064185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:29.064185+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":187,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.023450+0000","last_change":"2024-02-19T21:42:04.201771+0000","last_active":"2024-02-19T21:42:53.023450+0000","last_peered":"2024-02-19T21:42:53.023450+0000","last_clean":"2024-02-19T21:42:53.023450+0000","last_became_active":"2024-02-19T21:42:04.201530+0000","last_became_peered":"2024-02-19T21:42:04.201530+0000","last_unstale":"2024-02-19T21:42:53.023450+0000","last_undegraded":"2024-02-19T21:42:53.023450+0000","last_fullsized":"2024-02-19T21:42:53.023450+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:25.265482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:25.265482+0000","last_clean_scrub_stamp":"2024-02-19T21:40:25.265482+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":186,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.009285+0000","last_change":"2024-02-19T21:39:45.432311+0000","last_active":"2024-02-19T21:42:53.009285+0000","last_peered":"2024-02-19T21:42:53.009285+0000","last_clean":"2024-02-19T21:42:53.009285+0000","last_became_active":"2024-02-19T21:32:23.356975+0000","last_became_peered":"2024-02-19T21:32:23.356975+0000","last_unstale":"2024-02-19T21:42:53.009285+0000","last_undegraded":"2024-02-19T21:42:53.009285+0000","last_fullsized":"2024-02-19T21:42:53.009285+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:45.432184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:39:45.432184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"200'19","reported_seq":226,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.991709+0000","last_change":"2024-02-19T21:41:38.975835+0000","last_active":"2024-02-19T21:42:52.991709+0000","last_peered":"2024-02-19T21:42:52.991709+0000","last_clean":"2024-02-19T21:42:52.991709+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:42:52.991709+0000","last_undegraded":"2024-02-19T21:42:52.991709+0000","last_fullsized":"2024-02-19T21:42:52.991709+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"92'13","last_scrub_stamp":"2024-02-19T21:39:38.475440+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.475440+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":159,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.028498+0000","last_change":"2024-02-19T21:42:36.466080+0000","last_active":"2024-02-19T21:42:53.028498+0000","last_peered":"2024-02-19T21:42:53.028498+0000","last_clean":"2024-02-19T21:42:53.028498+0000","last_became_active":"2024-02-19T21:42:36.465779+0000","last_became_peered":"2024-02-19T21:42:36.465779+0000","last_unstale":"2024-02-19T21:42:53.028498+0000","last_undegraded":"2024-02-19T21:42:53.028498+0000","last_fullsized":"2024-02-19T21:42:53.028498+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:30.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:30.102789+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":177,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.008594+0000","last_change":"2024-02-19T21:39:32.209318+0000","last_active":"2024-02-19T21:42:53.008594+0000","last_peered":"2024-02-19T21:42:53.008594+0000","last_clean":"2024-02-19T21:42:53.008594+0000","last_became_active":"2024-02-19T21:32:27.370308+0000","last_became_peered":"2024-02-19T21:32:27.370308+0000","last_unstale":"2024-02-19T21:42:53.008594+0000","last_undegraded":"2024-02-19T21:42:53.008594+0000","last_fullsized":"2024-02-19T21:42:53.008594+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:32.209233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:32.209233+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":188,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.009175+0000","last_change":"2024-02-19T21:40:34.884850+0000","last_active":"2024-02-19T21:42:53.009175+0000","last_peered":"2024-02-19T21:42:53.009175+0000","last_clean":"2024-02-19T21:42:53.009175+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:42:53.009175+0000","last_undegraded":"2024-02-19T21:42:53.009175+0000","last_fullsized":"2024-02-19T21:42:53.009175+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:34.884780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:08.490788+0000","last_clean_scrub_stamp":"2024-02-19T21:40:34.884780+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"200'7","reported_seq":181,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.009377+0000","last_change":"2024-02-19T21:39:44.444043+0000","last_active":"2024-02-19T21:42:53.009377+0000","last_peered":"2024-02-19T21:42:53.009377+0000","last_clean":"2024-02-19T21:42:53.009377+0000","last_became_active":"2024-02-19T21:39:39.471143+0000","last_became_peered":"2024-02-19T21:39:39.471143+0000","last_unstale":"2024-02-19T21:42:53.009377+0000","last_undegraded":"2024-02-19T21:42:53.009377+0000","last_fullsized":"2024-02-19T21:42:53.009377+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'5","last_scrub_stamp":"2024-02-19T21:39:44.443963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:44.443963+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":29,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.009126+0000","last_change":"2024-02-19T21:42:36.644022+0000","last_active":"2024-02-19T21:42:53.009126+0000","last_peered":"2024-02-19T21:42:53.009126+0000","last_clean":"2024-02-19T21:42:53.009126+0000","last_became_active":"2024-02-19T21:42:36.470286+0000","last_became_peered":"2024-02-19T21:42:36.470286+0000","last_unstale":"2024-02-19T21:42:53.009126+0000","last_undegraded":"2024-02-19T21:42:53.009126+0000","last_fullsized":"2024-02-19T21:42:53.009126+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:41:31.631303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:41:31.631303+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":196,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.994422+0000","last_change":"2024-02-19T21:42:04.205008+0000","last_active":"2024-02-19T21:42:52.994422+0000","last_peered":"2024-02-19T21:42:52.994422+0000","last_clean":"2024-02-19T21:42:52.994422+0000","last_became_active":"2024-02-19T21:42:04.204559+0000","last_became_peered":"2024-02-19T21:42:04.204559+0000","last_unstale":"2024-02-19T21:42:52.994422+0000","last_undegraded":"2024-02-19T21:42:52.994422+0000","last_fullsized":"2024-02-19T21:42:52.994422+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:32.576698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:46.543259+0000","last_clean_scrub_stamp":"2024-02-19T21:41:32.576698+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":195,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.008932+0000","last_change":"2024-02-19T21:40:16.864005+0000","last_active":"2024-02-19T21:42:53.008932+0000","last_peered":"2024-02-19T21:42:53.008932+0000","last_clean":"2024-02-19T21:42:53.008932+0000","last_became_active":"2024-02-19T21:39:39.473759+0000","last_became_peered":"2024-02-19T21:39:39.473759+0000","last_unstale":"2024-02-19T21:42:53.008932+0000","last_undegraded":"2024-02-19T21:42:53.008932+0000","last_fullsized":"2024-02-19T21:42:53.008932+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:16.863939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:16.863939+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"200'19","reported_seq":209,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.009409+0000","last_change":"2024-02-19T21:39:47.395697+0000","last_active":"2024-02-19T21:42:53.009409+0000","last_peered":"2024-02-19T21:42:53.009409+0000","last_clean":"2024-02-19T21:42:53.009409+0000","last_became_active":"2024-02-19T21:35:14.514971+0000","last_became_peered":"2024-02-19T21:35:14.514971+0000","last_unstale":"2024-02-19T21:42:53.009409+0000","last_undegraded":"2024-02-19T21:42:53.009409+0000","last_fullsized":"2024-02-19T21:42:53.009409+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'13","last_scrub_stamp":"2024-02-19T21:39:47.395572+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:39:47.395572+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":159,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.009825+0000","last_change":"2024-02-19T21:42:04.195331+0000","last_active":"2024-02-19T21:42:53.009825+0000","last_peered":"2024-02-19T21:42:53.009825+0000","last_clean":"2024-02-19T21:42:53.009825+0000","last_became_active":"2024-02-19T21:42:04.194933+0000","last_became_peered":"2024-02-19T21:42:04.194933+0000","last_unstale":"2024-02-19T21:42:53.009825+0000","last_undegraded":"2024-02-19T21:42:53.009825+0000","last_fullsized":"2024-02-19T21:42:53.009825+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:34.364412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:34.364412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":68,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.013017+0000","last_change":"2024-02-19T21:42:04.201407+0000","last_active":"2024-02-19T21:42:53.013017+0000","last_peered":"2024-02-19T21:42:53.013017+0000","last_clean":"2024-02-19T21:42:53.013017+0000","last_became_active":"2024-02-19T21:42:04.201106+0000","last_became_peered":"2024-02-19T21:42:04.201106+0000","last_unstale":"2024-02-19T21:42:53.013017+0000","last_undegraded":"2024-02-19T21:42:53.013017+0000","last_fullsized":"2024-02-19T21:42:53.013017+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:24.788644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:24.788644+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,5],"acting":[6,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"201'18","reported_seq":145,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.029670+0000","last_change":"2024-02-19T21:39:21.126642+0000","last_active":"2024-02-19T21:42:53.029670+0000","last_peered":"2024-02-19T21:42:53.029670+0000","last_clean":"2024-02-19T21:42:53.029670+0000","last_became_active":"2024-02-19T21:38:31.247067+0000","last_became_peered":"2024-02-19T21:38:31.247067+0000","last_unstale":"2024-02-19T21:42:53.029670+0000","last_undegraded":"2024-02-19T21:42:53.029670+0000","last_fullsized":"2024-02-19T21:42:53.029670+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'12","last_scrub_stamp":"2024-02-19T21:39:21.126563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:21.126563+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":178,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.029741+0000","last_change":"2024-02-19T21:40:15.269827+0000","last_active":"2024-02-19T21:42:53.029741+0000","last_peered":"2024-02-19T21:42:53.029741+0000","last_clean":"2024-02-19T21:42:53.029741+0000","last_became_active":"2024-02-19T21:32:27.369757+0000","last_became_peered":"2024-02-19T21:32:27.369757+0000","last_unstale":"2024-02-19T21:42:53.029741+0000","last_undegraded":"2024-02-19T21:42:53.029741+0000","last_fullsized":"2024-02-19T21:42:53.029741+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:15.269720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:15.269720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":191,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.013427+0000","last_change":"2024-02-19T21:40:38.600031+0000","last_active":"2024-02-19T21:42:53.013427+0000","last_peered":"2024-02-19T21:42:53.013427+0000","last_clean":"2024-02-19T21:42:53.013427+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:42:53.013427+0000","last_undegraded":"2024-02-19T21:42:53.013427+0000","last_fullsized":"2024-02-19T21:42:53.013427+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:38.599939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:38.599939+0000","last_clean_scrub_stamp":"2024-02-19T21:40:38.599939+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"200'34","reported_seq":173,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.028136+0000","last_change":"2024-02-19T21:40:36.287163+0000","last_active":"2024-02-19T21:42:53.028136+0000","last_peered":"2024-02-19T21:42:53.028136+0000","last_clean":"2024-02-19T21:42:53.028136+0000","last_became_active":"2024-02-19T21:39:39.477429+0000","last_became_peered":"2024-02-19T21:39:39.477429+0000","last_unstale":"2024-02-19T21:42:53.028136+0000","last_undegraded":"2024-02-19T21:42:53.028136+0000","last_fullsized":"2024-02-19T21:42:53.028136+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'22","last_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.287051+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":192,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.037753+0000","last_change":"2024-02-19T21:39:39.471709+0000","last_active":"2024-02-19T21:42:53.037753+0000","last_peered":"2024-02-19T21:42:53.037753+0000","last_clean":"2024-02-19T21:42:53.037753+0000","last_became_active":"2024-02-19T21:39:39.471214+0000","last_became_peered":"2024-02-19T21:39:39.471214+0000","last_unstale":"2024-02-19T21:42:53.037753+0000","last_undegraded":"2024-02-19T21:42:53.037753+0000","last_fullsized":"2024-02-19T21:42:53.037753+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:37.169503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:37.169503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":112,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.013456+0000","last_change":"2024-02-19T21:42:04.198922+0000","last_active":"2024-02-19T21:42:53.013456+0000","last_peered":"2024-02-19T21:42:53.013456+0000","last_clean":"2024-02-19T21:42:53.013456+0000","last_became_active":"2024-02-19T21:42:04.198592+0000","last_became_peered":"2024-02-19T21:42:04.198592+0000","last_unstale":"2024-02-19T21:42:53.013456+0000","last_undegraded":"2024-02-19T21:42:53.013456+0000","last_fullsized":"2024-02-19T21:42:53.013456+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:33.515188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:33.515188+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"201'19","reported_seq":86,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.027734+0000","last_change":"2024-02-19T21:39:51.559559+0000","last_active":"2024-02-19T21:42:53.027734+0000","last_peered":"2024-02-19T21:42:53.027734+0000","last_clean":"2024-02-19T21:42:53.027734+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:42:53.027734+0000","last_undegraded":"2024-02-19T21:42:53.027734+0000","last_fullsized":"2024-02-19T21:42:53.027734+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:39:43.209803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:43.209803+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":30,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.012906+0000","last_change":"2024-02-19T21:42:38.924511+0000","last_active":"2024-02-19T21:42:53.012906+0000","last_peered":"2024-02-19T21:42:53.012906+0000","last_clean":"2024-02-19T21:42:53.012906+0000","last_became_active":"2024-02-19T21:42:36.480592+0000","last_became_peered":"2024-02-19T21:42:36.480592+0000","last_unstale":"2024-02-19T21:42:53.012906+0000","last_undegraded":"2024-02-19T21:42:53.012906+0000","last_fullsized":"2024-02-19T21:42:53.012906+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:38:25.883927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:38:25.883927+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"199'9","reported_seq":334,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.013977+0000","last_change":"2024-02-19T21:42:04.290659+0000","last_active":"2024-02-19T21:42:53.013977+0000","last_peered":"2024-02-19T21:42:53.013977+0000","last_clean":"2024-02-19T21:42:53.013977+0000","last_became_active":"2024-02-19T21:42:04.199656+0000","last_became_peered":"2024-02-19T21:42:04.199656+0000","last_unstale":"2024-02-19T21:42:53.013977+0000","last_undegraded":"2024-02-19T21:42:53.013977+0000","last_fullsized":"2024-02-19T21:42:53.013977+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:40:19.276740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:19.276740+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":195,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.994074+0000","last_change":"2024-02-19T21:42:04.199658+0000","last_active":"2024-02-19T21:42:52.994074+0000","last_peered":"2024-02-19T21:42:52.994074+0000","last_clean":"2024-02-19T21:42:52.994074+0000","last_became_active":"2024-02-19T21:42:04.199323+0000","last_became_peered":"2024-02-19T21:42:04.199323+0000","last_unstale":"2024-02-19T21:42:52.994074+0000","last_undegraded":"2024-02-19T21:42:52.994074+0000","last_fullsized":"2024-02-19T21:42:52.994074+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.080601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.080601+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"201'20","reported_seq":266,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.037683+0000","last_change":"2024-02-19T21:42:04.205219+0000","last_active":"2024-02-19T21:42:53.037683+0000","last_peered":"2024-02-19T21:42:53.037683+0000","last_clean":"2024-02-19T21:42:53.037683+0000","last_became_active":"2024-02-19T21:42:04.204882+0000","last_became_peered":"2024-02-19T21:42:04.204882+0000","last_unstale":"2024-02-19T21:42:53.037683+0000","last_undegraded":"2024-02-19T21:42:53.037683+0000","last_fullsized":"2024-02-19T21:42:53.037683+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:39:33.125904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:33.125904+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":98,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.026419+0000","last_change":"2024-02-19T21:39:39.471651+0000","last_active":"2024-02-19T21:42:53.026419+0000","last_peered":"2024-02-19T21:42:53.026419+0000","last_clean":"2024-02-19T21:42:53.026419+0000","last_became_active":"2024-02-19T21:39:39.471332+0000","last_became_peered":"2024-02-19T21:39:39.471332+0000","last_unstale":"2024-02-19T21:42:53.026419+0000","last_undegraded":"2024-02-19T21:42:53.026419+0000","last_fullsized":"2024-02-19T21:42:53.026419+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:23.270251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:39:23.270251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":184,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.009211+0000","last_change":"2024-02-19T21:41:36.941622+0000","last_active":"2024-02-19T21:42:53.009211+0000","last_peered":"2024-02-19T21:42:53.009211+0000","last_clean":"2024-02-19T21:42:53.009211+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:42:53.009211+0000","last_undegraded":"2024-02-19T21:42:53.009211+0000","last_fullsized":"2024-02-19T21:42:53.009211+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:36.941549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:41:36.941549+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":195,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.013681+0000","last_change":"2024-02-19T21:39:45.211467+0000","last_active":"2024-02-19T21:42:53.013681+0000","last_peered":"2024-02-19T21:42:53.013681+0000","last_clean":"2024-02-19T21:42:53.013681+0000","last_became_active":"2024-02-19T21:39:39.478633+0000","last_became_peered":"2024-02-19T21:39:39.478633+0000","last_unstale":"2024-02-19T21:42:53.013681+0000","last_undegraded":"2024-02-19T21:42:53.013681+0000","last_fullsized":"2024-02-19T21:42:53.013681+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:45.211388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:39:45.211388+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"201'19","reported_seq":236,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.009110+0000","last_change":"2024-02-19T21:42:04.641915+0000","last_active":"2024-02-19T21:42:53.009110+0000","last_peered":"2024-02-19T21:42:53.009110+0000","last_clean":"2024-02-19T21:42:53.009110+0000","last_became_active":"2024-02-19T21:42:04.205379+0000","last_became_peered":"2024-02-19T21:42:04.205379+0000","last_unstale":"2024-02-19T21:42:53.009110+0000","last_undegraded":"2024-02-19T21:42:53.009110+0000","last_fullsized":"2024-02-19T21:42:53.009110+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:39:46.421117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:46.421117+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":184,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.008669+0000","last_change":"2024-02-19T21:39:39.471671+0000","last_active":"2024-02-19T21:42:53.008669+0000","last_peered":"2024-02-19T21:42:53.008669+0000","last_clean":"2024-02-19T21:42:53.008669+0000","last_became_active":"2024-02-19T21:39:39.471306+0000","last_became_peered":"2024-02-19T21:39:39.471306+0000","last_unstale":"2024-02-19T21:42:53.008669+0000","last_undegraded":"2024-02-19T21:42:53.008669+0000","last_fullsized":"2024-02-19T21:42:53.008669+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:37.104831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:39:37.104831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":205,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.013576+0000","last_change":"2024-02-19T21:42:35.953916+0000","last_active":"2024-02-19T21:42:53.013576+0000","last_peered":"2024-02-19T21:42:53.013576+0000","last_clean":"2024-02-19T21:42:53.013576+0000","last_became_active":"2024-02-19T21:42:04.196794+0000","last_became_peered":"2024-02-19T21:42:04.196794+0000","last_unstale":"2024-02-19T21:42:53.013576+0000","last_undegraded":"2024-02-19T21:42:53.013576+0000","last_fullsized":"2024-02-19T21:42:53.013576+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:41.234250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:41.234250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":190,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.995086+0000","last_change":"2024-02-19T21:39:39.480521+0000","last_active":"2024-02-19T21:42:52.995086+0000","last_peered":"2024-02-19T21:42:52.995086+0000","last_clean":"2024-02-19T21:42:52.995086+0000","last_became_active":"2024-02-19T21:39:39.479927+0000","last_became_peered":"2024-02-19T21:39:39.479927+0000","last_unstale":"2024-02-19T21:42:52.995086+0000","last_undegraded":"2024-02-19T21:42:52.995086+0000","last_fullsized":"2024-02-19T21:42:52.995086+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:39:37.085374+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"200'8","reported_seq":49,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.009275+0000","last_change":"2024-02-19T21:41:42.590833+0000","last_active":"2024-02-19T21:42:53.009275+0000","last_peered":"2024-02-19T21:42:53.009275+0000","last_clean":"2024-02-19T21:42:53.009275+0000","last_became_active":"2024-02-19T21:41:42.243259+0000","last_became_peered":"2024-02-19T21:41:42.243259+0000","last_unstale":"2024-02-19T21:42:53.009275+0000","last_undegraded":"2024-02-19T21:42:53.009275+0000","last_fullsized":"2024-02-19T21:42:53.009275+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'4","last_scrub_stamp":"2024-02-19T21:40:18.214846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:18.214846+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":98,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.028696+0000","last_change":"2024-02-19T21:39:39.462663+0000","last_active":"2024-02-19T21:42:53.028696+0000","last_peered":"2024-02-19T21:42:53.028696+0000","last_clean":"2024-02-19T21:42:53.028696+0000","last_became_active":"2024-02-19T21:39:39.462363+0000","last_became_peered":"2024-02-19T21:39:39.462363+0000","last_unstale":"2024-02-19T21:42:53.028696+0000","last_undegraded":"2024-02-19T21:42:53.028696+0000","last_fullsized":"2024-02-19T21:42:53.028696+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:26.311526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:39:26.311526+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":196,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.024266+0000","last_change":"2024-02-19T21:42:04.199063+0000","last_active":"2024-02-19T21:42:53.024266+0000","last_peered":"2024-02-19T21:42:53.024266+0000","last_clean":"2024-02-19T21:42:53.024266+0000","last_became_active":"2024-02-19T21:42:04.198684+0000","last_became_peered":"2024-02-19T21:42:04.198684+0000","last_unstale":"2024-02-19T21:42:53.024266+0000","last_undegraded":"2024-02-19T21:42:53.024266+0000","last_fullsized":"2024-02-19T21:42:53.024266+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:26.272653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:26.272653+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":184,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.029331+0000","last_change":"2024-02-19T21:39:33.957921+0000","last_active":"2024-02-19T21:42:53.029331+0000","last_peered":"2024-02-19T21:42:53.029331+0000","last_clean":"2024-02-19T21:42:53.029331+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:42:53.029331+0000","last_undegraded":"2024-02-19T21:42:53.029331+0000","last_fullsized":"2024-02-19T21:42:53.029331+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:33.957814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:39:33.957814+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"201'19","reported_seq":226,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.992512+0000","last_change":"2024-02-19T21:41:23.880621+0000","last_active":"2024-02-19T21:42:52.992512+0000","last_peered":"2024-02-19T21:42:52.992512+0000","last_clean":"2024-02-19T21:42:52.992512+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:42:52.992512+0000","last_undegraded":"2024-02-19T21:42:52.992512+0000","last_fullsized":"2024-02-19T21:42:52.992512+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:41:23.880501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:41:23.880501+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":183,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.025190+0000","last_change":"2024-02-19T21:38:29.972418+0000","last_active":"2024-02-19T21:42:53.025190+0000","last_peered":"2024-02-19T21:42:53.025190+0000","last_clean":"2024-02-19T21:42:53.025190+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:42:53.025190+0000","last_undegraded":"2024-02-19T21:42:53.025190+0000","last_fullsized":"2024-02-19T21:42:53.025190+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:29.972337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:42.527849+0000","last_clean_scrub_stamp":"2024-02-19T21:38:29.972337+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":186,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.009427+0000","last_change":"2024-02-19T21:39:51.535010+0000","last_active":"2024-02-19T21:42:53.009427+0000","last_peered":"2024-02-19T21:42:53.009427+0000","last_clean":"2024-02-19T21:42:53.009427+0000","last_became_active":"2024-02-19T21:39:51.534750+0000","last_became_peered":"2024-02-19T21:39:51.534750+0000","last_unstale":"2024-02-19T21:42:53.009427+0000","last_undegraded":"2024-02-19T21:42:53.009427+0000","last_fullsized":"2024-02-19T21:42:53.009427+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:33.360066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:33.360066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":191,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.013167+0000","last_change":"2024-02-19T21:41:35.736077+0000","last_active":"2024-02-19T21:42:53.013167+0000","last_peered":"2024-02-19T21:42:53.013167+0000","last_clean":"2024-02-19T21:42:53.013167+0000","last_became_active":"2024-02-19T21:32:23.357338+0000","last_became_peered":"2024-02-19T21:32:23.357338+0000","last_unstale":"2024-02-19T21:42:53.013167+0000","last_undegraded":"2024-02-19T21:42:53.013167+0000","last_fullsized":"2024-02-19T21:42:53.013167+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:35.735995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:41:35.735995+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"200'15","reported_seq":224,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.024102+0000","last_change":"2024-02-19T21:39:45.026756+0000","last_active":"2024-02-19T21:42:53.024102+0000","last_peered":"2024-02-19T21:42:53.024102+0000","last_clean":"2024-02-19T21:42:53.024102+0000","last_became_active":"2024-02-19T21:39:39.466843+0000","last_became_peered":"2024-02-19T21:39:39.466843+0000","last_unstale":"2024-02-19T21:42:53.024102+0000","last_undegraded":"2024-02-19T21:42:53.024102+0000","last_fullsized":"2024-02-19T21:42:53.024102+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:39:45.026689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:45.026689+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":80,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.995107+0000","last_change":"2024-02-19T21:42:36.488771+0000","last_active":"2024-02-19T21:42:52.995107+0000","last_peered":"2024-02-19T21:42:52.995107+0000","last_clean":"2024-02-19T21:42:52.995107+0000","last_became_active":"2024-02-19T21:42:36.488461+0000","last_became_peered":"2024-02-19T21:42:36.488461+0000","last_unstale":"2024-02-19T21:42:52.995107+0000","last_undegraded":"2024-02-19T21:42:52.995107+0000","last_fullsized":"2024-02-19T21:42:52.995107+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:41.032064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:41.032064+0000","last_clean_scrub_stamp":"2024-02-19T21:39:41.032064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"199'13","reported_seq":132,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.027861+0000","last_change":"2024-02-19T21:42:04.202258+0000","last_active":"2024-02-19T21:42:53.027861+0000","last_peered":"2024-02-19T21:42:53.027861+0000","last_clean":"2024-02-19T21:42:53.027861+0000","last_became_active":"2024-02-19T21:42:04.195103+0000","last_became_peered":"2024-02-19T21:42:04.195103+0000","last_unstale":"2024-02-19T21:42:53.027861+0000","last_undegraded":"2024-02-19T21:42:53.027861+0000","last_fullsized":"2024-02-19T21:42:53.027861+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'11","last_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:39:46.054888+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":196,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.026533+0000","last_change":"2024-02-19T21:40:33.532430+0000","last_active":"2024-02-19T21:42:53.026533+0000","last_peered":"2024-02-19T21:42:53.026533+0000","last_clean":"2024-02-19T21:42:53.026533+0000","last_became_active":"2024-02-19T21:32:23.361680+0000","last_became_peered":"2024-02-19T21:32:23.361680+0000","last_unstale":"2024-02-19T21:42:53.026533+0000","last_undegraded":"2024-02-19T21:42:53.026533+0000","last_fullsized":"2024-02-19T21:42:53.026533+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:33.532354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:33.550655+0000","last_clean_scrub_stamp":"2024-02-19T21:40:33.532354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"201'19","reported_seq":213,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.994672+0000","last_change":"2024-02-19T21:40:37.730352+0000","last_active":"2024-02-19T21:42:52.994672+0000","last_peered":"2024-02-19T21:42:52.994672+0000","last_clean":"2024-02-19T21:42:52.994672+0000","last_became_active":"2024-02-19T21:32:25.372206+0000","last_became_peered":"2024-02-19T21:32:25.372206+0000","last_unstale":"2024-02-19T21:42:52.994672+0000","last_undegraded":"2024-02-19T21:42:52.994672+0000","last_fullsized":"2024-02-19T21:42:52.994672+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'13","last_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:40:37.730197+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":202,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.992405+0000","last_change":"2024-02-19T21:42:36.490933+0000","last_active":"2024-02-19T21:42:52.992405+0000","last_peered":"2024-02-19T21:42:52.992405+0000","last_clean":"2024-02-19T21:42:52.992405+0000","last_became_active":"2024-02-19T21:42:36.490602+0000","last_became_peered":"2024-02-19T21:42:36.490602+0000","last_unstale":"2024-02-19T21:42:52.992405+0000","last_undegraded":"2024-02-19T21:42:52.992405+0000","last_fullsized":"2024-02-19T21:42:52.992405+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:29.506785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:29.506785+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":317,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.994812+0000","last_change":"2024-02-19T21:40:32.679041+0000","last_active":"2024-02-19T21:42:52.994812+0000","last_peered":"2024-02-19T21:42:52.994812+0000","last_clean":"2024-02-19T21:42:52.994812+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:42:52.994812+0000","last_undegraded":"2024-02-19T21:42:52.994812+0000","last_fullsized":"2024-02-19T21:42:52.994812+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:40:32.678933+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":197,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.994523+0000","last_change":"2024-02-19T21:42:04.205987+0000","last_active":"2024-02-19T21:42:52.994523+0000","last_peered":"2024-02-19T21:42:52.994523+0000","last_clean":"2024-02-19T21:42:52.994523+0000","last_became_active":"2024-02-19T21:42:04.205401+0000","last_became_peered":"2024-02-19T21:42:04.205401+0000","last_unstale":"2024-02-19T21:42:52.994523+0000","last_undegraded":"2024-02-19T21:42:52.994523+0000","last_fullsized":"2024-02-19T21:42:52.994523+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:25.759697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:40:25.759697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"201'25","reported_seq":219,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.009745+0000","last_change":"2024-02-19T21:40:39.592088+0000","last_active":"2024-02-19T21:42:53.009745+0000","last_peered":"2024-02-19T21:42:53.009745+0000","last_clean":"2024-02-19T21:42:53.009745+0000","last_became_active":"2024-02-19T21:32:25.372060+0000","last_became_peered":"2024-02-19T21:32:25.372060+0000","last_unstale":"2024-02-19T21:42:53.009745+0000","last_undegraded":"2024-02-19T21:42:53.009745+0000","last_fullsized":"2024-02-19T21:42:53.009745+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'15","last_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:40:39.591994+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":184,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.009098+0000","last_change":"2024-02-19T21:40:31.892048+0000","last_active":"2024-02-19T21:42:53.009098+0000","last_peered":"2024-02-19T21:42:53.009098+0000","last_clean":"2024-02-19T21:42:53.009098+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:42:53.009098+0000","last_undegraded":"2024-02-19T21:42:53.009098+0000","last_fullsized":"2024-02-19T21:42:53.009098+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:31.891967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_clean_scrub_stamp":"2024-02-19T21:40:31.891967+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":177,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.994883+0000","last_change":"2024-02-19T21:39:36.067452+0000","last_active":"2024-02-19T21:42:52.994883+0000","last_peered":"2024-02-19T21:42:52.994883+0000","last_clean":"2024-02-19T21:42:52.994883+0000","last_became_active":"2024-02-19T21:32:27.369002+0000","last_became_peered":"2024-02-19T21:32:27.369002+0000","last_unstale":"2024-02-19T21:42:52.994883+0000","last_undegraded":"2024-02-19T21:42:52.994883+0000","last_fullsized":"2024-02-19T21:42:52.994883+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:36.067354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:36.067354+0000","last_clean_scrub_stamp":"2024-02-19T21:39:36.067354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":186,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.013647+0000","last_change":"2024-02-19T21:40:29.421893+0000","last_active":"2024-02-19T21:42:53.013647+0000","last_peered":"2024-02-19T21:42:53.013647+0000","last_clean":"2024-02-19T21:42:53.013647+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:42:53.013647+0000","last_undegraded":"2024-02-19T21:42:53.013647+0000","last_fullsized":"2024-02-19T21:42:53.013647+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:29.421791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:29.421791+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"201'12","reported_seq":69,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.032666+0000","last_change":"2024-02-19T21:42:04.203612+0000","last_active":"2024-02-19T21:42:53.032666+0000","last_peered":"2024-02-19T21:42:53.032666+0000","last_clean":"2024-02-19T21:42:53.032666+0000","last_became_active":"2024-02-19T21:42:04.192291+0000","last_became_peered":"2024-02-19T21:42:04.192291+0000","last_unstale":"2024-02-19T21:42:53.032666+0000","last_undegraded":"2024-02-19T21:42:53.032666+0000","last_fullsized":"2024-02-19T21:42:53.032666+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'6","last_scrub_stamp":"2024-02-19T21:39:24.011489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:24.011489+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":68,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.992812+0000","last_change":"2024-02-19T21:39:41.367764+0000","last_active":"2024-02-19T21:42:52.992812+0000","last_peered":"2024-02-19T21:42:52.992812+0000","last_clean":"2024-02-19T21:42:52.992812+0000","last_became_active":"2024-02-19T21:39:39.469477+0000","last_became_peered":"2024-02-19T21:39:39.469477+0000","last_unstale":"2024-02-19T21:42:52.992812+0000","last_undegraded":"2024-02-19T21:42:52.992812+0000","last_fullsized":"2024-02-19T21:42:52.992812+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:41.367692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:41.367692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":98,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.032586+0000","last_change":"2024-02-19T21:42:04.195734+0000","last_active":"2024-02-19T21:42:53.032586+0000","last_peered":"2024-02-19T21:42:53.032586+0000","last_clean":"2024-02-19T21:42:53.032586+0000","last_became_active":"2024-02-19T21:42:04.195167+0000","last_became_peered":"2024-02-19T21:42:04.195167+0000","last_unstale":"2024-02-19T21:42:53.032586+0000","last_undegraded":"2024-02-19T21:42:53.032586+0000","last_fullsized":"2024-02-19T21:42:53.032586+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:34.284787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:34.284787+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":63,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.024876+0000","last_change":"2024-02-19T21:39:39.477623+0000","last_active":"2024-02-19T21:42:53.024876+0000","last_peered":"2024-02-19T21:42:53.024876+0000","last_clean":"2024-02-19T21:42:53.024876+0000","last_became_active":"2024-02-19T21:39:39.477308+0000","last_became_peered":"2024-02-19T21:39:39.477308+0000","last_unstale":"2024-02-19T21:42:53.024876+0000","last_undegraded":"2024-02-19T21:42:53.024876+0000","last_fullsized":"2024-02-19T21:42:53.024876+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:26.250620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:38:26.250620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"200'15","reported_seq":267,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.037512+0000","last_change":"2024-02-19T21:42:04.226031+0000","last_active":"2024-02-19T21:42:53.037512+0000","last_peered":"2024-02-19T21:42:53.037512+0000","last_clean":"2024-02-19T21:42:53.037512+0000","last_became_active":"2024-02-19T21:42:04.207069+0000","last_became_peered":"2024-02-19T21:42:04.207069+0000","last_unstale":"2024-02-19T21:42:53.037512+0000","last_undegraded":"2024-02-19T21:42:53.037512+0000","last_fullsized":"2024-02-19T21:42:53.037512+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:39:46.193426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:46.193426+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"217'13258","reported_seq":13318,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-02-19T21:42:54.911664+0000","last_change":"2024-02-19T21:39:39.469485+0000","last_active":"2024-02-19T21:42:54.911664+0000","last_peered":"2024-02-19T21:42:54.911664+0000","last_clean":"2024-02-19T21:42:54.911664+0000","last_became_active":"2024-02-19T21:39:39.469130+0000","last_became_peered":"2024-02-19T21:39:39.469130+0000","last_unstale":"2024-02-19T21:42:54.911664+0000","last_undegraded":"2024-02-19T21:42:54.911664+0000","last_fullsized":"2024-02-19T21:42:54.911664+0000","mapping_epoch":165,"log_start":"191'9114","ondisk_log_start":"191'9114","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4144,"ondisk_log_size":4144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":177995776,"num_objects":2716,"num_object_clones":0,"num_object_copies":8148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2716,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13258,"num_write_kb":511168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":189,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.009476+0000","last_change":"2024-02-19T21:42:04.192557+0000","last_active":"2024-02-19T21:42:53.009476+0000","last_peered":"2024-02-19T21:42:53.009476+0000","last_clean":"2024-02-19T21:42:53.009476+0000","last_became_active":"2024-02-19T21:42:04.192195+0000","last_became_peered":"2024-02-19T21:42:04.192195+0000","last_unstale":"2024-02-19T21:42:53.009476+0000","last_undegraded":"2024-02-19T21:42:53.009476+0000","last_fullsized":"2024-02-19T21:42:53.009476+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:35.539219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:40:35.539219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"59'2","reported_seq":214,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.992791+0000","last_change":"2024-02-19T21:41:24.914001+0000","last_active":"2024-02-19T21:42:52.992791+0000","last_peered":"2024-02-19T21:42:52.992791+0000","last_clean":"2024-02-19T21:42:52.992791+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:42:52.992791+0000","last_undegraded":"2024-02-19T21:42:52.992791+0000","last_fullsized":"2024-02-19T21:42:52.992791+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-02-19T21:41:24.913925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:41:24.913925+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"200'23","reported_seq":226,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.010773+0000","last_change":"2024-02-19T21:40:37.318743+0000","last_active":"2024-02-19T21:42:53.010773+0000","last_peered":"2024-02-19T21:42:53.010773+0000","last_clean":"2024-02-19T21:42:53.010773+0000","last_became_active":"2024-02-19T21:38:31.247821+0000","last_became_peered":"2024-02-19T21:38:31.247821+0000","last_unstale":"2024-02-19T21:42:53.010773+0000","last_undegraded":"2024-02-19T21:42:53.010773+0000","last_fullsized":"2024-02-19T21:42:53.010773+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'17","last_scrub_stamp":"2024-02-19T21:40:37.318642+0000","last_deep_scrub":"83'17","last_deep_scrub_stamp":"2024-02-19T21:33:43.418450+0000","last_clean_scrub_stamp":"2024-02-19T21:40:37.318642+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":63,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.025700+0000","last_change":"2024-02-19T21:39:39.467760+0000","last_active":"2024-02-19T21:42:53.025700+0000","last_peered":"2024-02-19T21:42:53.025700+0000","last_clean":"2024-02-19T21:42:53.025700+0000","last_became_active":"2024-02-19T21:39:39.467210+0000","last_became_peered":"2024-02-19T21:39:39.467210+0000","last_unstale":"2024-02-19T21:42:53.025700+0000","last_undegraded":"2024-02-19T21:42:53.025700+0000","last_fullsized":"2024-02-19T21:42:53.025700+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:37.384723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:37.384723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"217'13422","reported_seq":13482,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-02-19T21:42:55.063720+0000","last_change":"2024-02-19T21:39:39.471871+0000","last_active":"2024-02-19T21:42:55.063720+0000","last_peered":"2024-02-19T21:42:55.063720+0000","last_clean":"2024-02-19T21:42:55.063720+0000","last_became_active":"2024-02-19T21:39:39.471575+0000","last_became_peered":"2024-02-19T21:39:39.471575+0000","last_unstale":"2024-02-19T21:42:55.063720+0000","last_undegraded":"2024-02-19T21:42:55.063720+0000","last_fullsized":"2024-02-19T21:42:55.063720+0000","mapping_epoch":165,"log_start":"191'9115","ondisk_log_start":"191'9115","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4307,"ondisk_log_size":4307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":183107584,"num_objects":2794,"num_object_clones":0,"num_object_copies":8382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2794,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13422,"num_write_kb":518912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":208,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.025269+0000","last_change":"2024-02-19T21:41:42.246007+0000","last_active":"2024-02-19T21:42:53.025269+0000","last_peered":"2024-02-19T21:42:53.025269+0000","last_clean":"2024-02-19T21:42:53.025269+0000","last_became_active":"2024-02-19T21:41:42.245788+0000","last_became_peered":"2024-02-19T21:41:42.245788+0000","last_unstale":"2024-02-19T21:42:53.025269+0000","last_undegraded":"2024-02-19T21:42:53.025269+0000","last_fullsized":"2024-02-19T21:42:53.025269+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:40.474333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:40.474333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":182,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.028037+0000","last_change":"2024-02-19T21:39:34.971980+0000","last_active":"2024-02-19T21:42:53.028037+0000","last_peered":"2024-02-19T21:42:53.028037+0000","last_clean":"2024-02-19T21:42:53.028037+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:42:53.028037+0000","last_undegraded":"2024-02-19T21:42:53.028037+0000","last_fullsized":"2024-02-19T21:42:53.028037+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:34.971917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:39:34.971917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"201'20","reported_seq":93,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.024188+0000","last_change":"2024-02-19T21:41:22.195267+0000","last_active":"2024-02-19T21:42:53.024188+0000","last_peered":"2024-02-19T21:42:53.024188+0000","last_clean":"2024-02-19T21:42:53.024188+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:42:53.024188+0000","last_undegraded":"2024-02-19T21:42:53.024188+0000","last_fullsized":"2024-02-19T21:42:53.024188+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:41:22.195164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:41:22.195164+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":319,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.026610+0000","last_change":"2024-02-19T21:40:25.363354+0000","last_active":"2024-02-19T21:42:53.026610+0000","last_peered":"2024-02-19T21:42:53.026610+0000","last_clean":"2024-02-19T21:42:53.026610+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:42:53.026610+0000","last_undegraded":"2024-02-19T21:42:53.026610+0000","last_fullsized":"2024-02-19T21:42:53.026610+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:40:25.363236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:25.363236+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"217'13192","reported_seq":14908,"reported_epoch":217,"state":"active+remapped+backfilling","last_fresh":"2024-02-19T21:42:54.947187+0000","last_change":"2024-02-19T21:42:36.512210+0000","last_active":"2024-02-19T21:42:54.947187+0000","last_peered":"2024-02-19T21:42:54.947187+0000","last_clean":"2024-02-19T21:41:41.233905+0000","last_became_active":"2024-02-19T21:41:43.731261+0000","last_became_peered":"2024-02-19T21:41:43.731261+0000","last_unstale":"2024-02-19T21:42:54.947187+0000","last_undegraded":"2024-02-19T21:42:54.947187+0000","last_fullsized":"2024-02-19T21:42:54.947187+0000","mapping_epoch":190,"log_start":"188'8894","ondisk_log_start":"188'8894","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4298,"ondisk_log_size":4298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":185335808,"num_objects":2828,"num_object_clones":0,"num_object_copies":8484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2350,"num_objects_unfound":0,"num_objects_dirty":2828,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13192,"num_write_kb":512640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":819,"num_bytes_recovered":53608448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,7,0],"avail_no_missing":["5","0","7"],"object_location_counts":[{"shards":"0,5,7","objects":2828}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":94,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.992696+0000","last_change":"2024-02-19T21:40:27.767533+0000","last_active":"2024-02-19T21:42:52.992696+0000","last_peered":"2024-02-19T21:42:52.992696+0000","last_clean":"2024-02-19T21:42:52.992696+0000","last_became_active":"2024-02-19T21:38:31.244787+0000","last_became_peered":"2024-02-19T21:38:31.244787+0000","last_unstale":"2024-02-19T21:42:52.992696+0000","last_undegraded":"2024-02-19T21:42:52.992696+0000","last_fullsized":"2024-02-19T21:42:52.992696+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:27.767442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:27.767442+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":186,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.994561+0000","last_change":"2024-02-19T21:39:27.079886+0000","last_active":"2024-02-19T21:42:52.994561+0000","last_peered":"2024-02-19T21:42:52.994561+0000","last_clean":"2024-02-19T21:42:52.994561+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:42:52.994561+0000","last_undegraded":"2024-02-19T21:42:52.994561+0000","last_fullsized":"2024-02-19T21:42:52.994561+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:27.079784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:39:27.079784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"201'43","reported_seq":466,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.027959+0000","last_change":"2024-02-19T21:42:04.218868+0000","last_active":"2024-02-19T21:42:53.027959+0000","last_peered":"2024-02-19T21:42:53.027959+0000","last_clean":"2024-02-19T21:42:53.027959+0000","last_became_active":"2024-02-19T21:42:04.196382+0000","last_became_peered":"2024-02-19T21:42:04.196382+0000","last_unstale":"2024-02-19T21:42:53.027959+0000","last_undegraded":"2024-02-19T21:42:53.027959+0000","last_fullsized":"2024-02-19T21:42:53.027959+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'30","last_scrub_stamp":"2024-02-19T21:39:43.996511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:43.996511+0000","log_size":43,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":1074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,5],"acting":[1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":178,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.027647+0000","last_change":"2024-02-19T21:38:16.890343+0000","last_active":"2024-02-19T21:42:53.027647+0000","last_peered":"2024-02-19T21:42:53.027647+0000","last_clean":"2024-02-19T21:42:53.027647+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:42:53.027647+0000","last_undegraded":"2024-02-19T21:42:53.027647+0000","last_fullsized":"2024-02-19T21:42:53.027647+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:16.890269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:16.890269+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"217'13225","reported_seq":14352,"reported_epoch":217,"state":"active+remapped+backfilling","last_fresh":"2024-02-19T21:42:54.925718+0000","last_change":"2024-02-19T21:42:05.313986+0000","last_active":"2024-02-19T21:42:54.925718+0000","last_peered":"2024-02-19T21:42:54.925718+0000","last_clean":"2024-02-19T21:42:03.157828+0000","last_became_active":"2024-02-19T21:42:05.261493+0000","last_became_peered":"2024-02-19T21:42:05.261493+0000","last_unstale":"2024-02-19T21:42:54.925718+0000","last_undegraded":"2024-02-19T21:42:54.925718+0000","last_fullsized":"2024-02-19T21:42:54.925718+0000","mapping_epoch":198,"log_start":"188'8629","ondisk_log_start":"188'8629","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"188'8618","last_scrub_stamp":"2024-02-19T21:41:36.200222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:41:36.200222+0000","log_size":4596,"ondisk_log_size":4596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":180551680,"num_objects":2755,"num_object_clones":0,"num_object_copies":8265,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2400,"num_objects_unfound":0,"num_objects_dirty":2755,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13225,"num_write_kb":511360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":526,"num_bytes_recovered":34471936,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,7],"avail_no_missing":["4","1","7"],"object_location_counts":[{"shards":"1,4,7","objects":2755}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":175,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.009323+0000","last_change":"2024-02-19T21:39:29.085751+0000","last_active":"2024-02-19T21:42:53.009323+0000","last_peered":"2024-02-19T21:42:53.009323+0000","last_clean":"2024-02-19T21:42:53.009323+0000","last_became_active":"2024-02-19T21:32:29.597365+0000","last_became_peered":"2024-02-19T21:32:29.597365+0000","last_unstale":"2024-02-19T21:42:53.009323+0000","last_undegraded":"2024-02-19T21:42:53.009323+0000","last_fullsized":"2024-02-19T21:42:53.009323+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:29.085642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:29.085642+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"67'5","reported_seq":819,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-02-19T21:42:54.014554+0000","last_change":"2024-02-19T21:39:39.576551+0000","last_active":"2024-02-19T21:42:54.014554+0000","last_peered":"2024-02-19T21:42:54.014554+0000","last_clean":"2024-02-19T21:42:54.014554+0000","last_became_active":"2024-02-19T21:39:39.464361+0000","last_became_peered":"2024-02-19T21:39:39.464361+0000","last_unstale":"2024-02-19T21:42:54.014554+0000","last_undegraded":"2024-02-19T21:42:54.014554+0000","last_fullsized":"2024-02-19T21:42:54.014554+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5","last_scrub_stamp":"2024-02-19T21:38:17.997743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:38:17.997743+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":618,"num_read_kb":613,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":184,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.028616+0000","last_change":"2024-02-19T21:41:36.636023+0000","last_active":"2024-02-19T21:42:53.028616+0000","last_peered":"2024-02-19T21:42:53.028616+0000","last_clean":"2024-02-19T21:42:53.028616+0000","last_became_active":"2024-02-19T21:39:39.468113+0000","last_became_peered":"2024-02-19T21:39:39.468113+0000","last_unstale":"2024-02-19T21:42:53.028616+0000","last_undegraded":"2024-02-19T21:42:53.028616+0000","last_fullsized":"2024-02-19T21:42:53.028616+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:36.635936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:41:36.635936+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"200'17","reported_seq":223,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.032514+0000","last_change":"2024-02-19T21:37:32.806098+0000","last_active":"2024-02-19T21:42:53.032514+0000","last_peered":"2024-02-19T21:42:53.032514+0000","last_clean":"2024-02-19T21:42:53.032514+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:42:53.032514+0000","last_undegraded":"2024-02-19T21:42:53.032514+0000","last_fullsized":"2024-02-19T21:42:53.032514+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'13","last_scrub_stamp":"2024-02-19T21:37:32.805993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:32.805993+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":25,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":68,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.995071+0000","last_change":"2024-02-19T21:41:29.640521+0000","last_active":"2024-02-19T21:42:52.995071+0000","last_peered":"2024-02-19T21:42:52.995071+0000","last_clean":"2024-02-19T21:42:52.995071+0000","last_became_active":"2024-02-19T21:39:39.475190+0000","last_became_peered":"2024-02-19T21:39:39.475190+0000","last_unstale":"2024-02-19T21:42:52.995071+0000","last_undegraded":"2024-02-19T21:42:52.995071+0000","last_fullsized":"2024-02-19T21:42:52.995071+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:29.640431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:29.640431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"217'12979","reported_seq":13039,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-02-19T21:42:54.839539+0000","last_change":"2024-02-19T21:39:39.475831+0000","last_active":"2024-02-19T21:42:54.839539+0000","last_peered":"2024-02-19T21:42:54.839539+0000","last_clean":"2024-02-19T21:42:54.839539+0000","last_became_active":"2024-02-19T21:39:39.475531+0000","last_became_peered":"2024-02-19T21:39:39.475531+0000","last_unstale":"2024-02-19T21:42:54.839539+0000","last_undegraded":"2024-02-19T21:42:54.839539+0000","last_fullsized":"2024-02-19T21:42:54.839539+0000","mapping_epoch":165,"log_start":"191'8835","ondisk_log_start":"191'8835","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4144,"ondisk_log_size":4144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":181075968,"num_objects":2763,"num_object_clones":0,"num_object_copies":8289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2763,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12979,"num_write_kb":503744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":180,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.995439+0000","last_change":"2024-02-19T21:40:33.758226+0000","last_active":"2024-02-19T21:42:52.995439+0000","last_peered":"2024-02-19T21:42:52.995439+0000","last_clean":"2024-02-19T21:42:52.995439+0000","last_became_active":"2024-02-19T21:32:29.372547+0000","last_became_peered":"2024-02-19T21:32:29.372547+0000","last_unstale":"2024-02-19T21:42:52.995439+0000","last_undegraded":"2024-02-19T21:42:52.995439+0000","last_fullsized":"2024-02-19T21:42:52.995439+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:33.758127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:40:33.758127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":89,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.994645+0000","last_change":"2024-02-19T21:40:30.692471+0000","last_active":"2024-02-19T21:42:52.994645+0000","last_peered":"2024-02-19T21:42:52.994645+0000","last_clean":"2024-02-19T21:42:52.994645+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:42:52.994645+0000","last_undegraded":"2024-02-19T21:42:52.994645+0000","last_fullsized":"2024-02-19T21:42:52.994645+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:30.692385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:40:30.692385+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":204,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.994461+0000","last_change":"2024-02-19T21:42:04.213108+0000","last_active":"2024-02-19T21:42:52.994461+0000","last_peered":"2024-02-19T21:42:52.994461+0000","last_clean":"2024-02-19T21:42:52.994461+0000","last_became_active":"2024-02-19T21:42:04.212730+0000","last_became_peered":"2024-02-19T21:42:04.212730+0000","last_unstale":"2024-02-19T21:42:52.994461+0000","last_undegraded":"2024-02-19T21:42:52.994461+0000","last_fullsized":"2024-02-19T21:42:52.994461+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:39.714982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:39.714982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":67,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.025408+0000","last_change":"2024-02-19T21:42:04.197235+0000","last_active":"2024-02-19T21:42:53.025408+0000","last_peered":"2024-02-19T21:42:53.025408+0000","last_clean":"2024-02-19T21:42:53.025408+0000","last_became_active":"2024-02-19T21:42:04.196943+0000","last_became_peered":"2024-02-19T21:42:04.196943+0000","last_unstale":"2024-02-19T21:42:53.025408+0000","last_undegraded":"2024-02-19T21:42:53.025408+0000","last_fullsized":"2024-02-19T21:42:53.025408+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:38.927472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:40:38.927472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,1],"acting":[0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"201'33","reported_seq":231,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.013903+0000","last_change":"2024-02-19T21:40:24.331961+0000","last_active":"2024-02-19T21:42:53.013903+0000","last_peered":"2024-02-19T21:42:53.013903+0000","last_clean":"2024-02-19T21:42:53.013903+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:42:53.013903+0000","last_undegraded":"2024-02-19T21:42:53.013903+0000","last_fullsized":"2024-02-19T21:42:53.013903+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"143'21","last_scrub_stamp":"2024-02-19T21:40:24.331869+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:40:24.331869+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":157,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.994915+0000","last_change":"2024-02-19T21:42:04.205688+0000","last_active":"2024-02-19T21:42:52.994915+0000","last_peered":"2024-02-19T21:42:52.994915+0000","last_clean":"2024-02-19T21:42:52.994915+0000","last_became_active":"2024-02-19T21:42:04.205342+0000","last_became_peered":"2024-02-19T21:42:04.205342+0000","last_unstale":"2024-02-19T21:42:52.994915+0000","last_undegraded":"2024-02-19T21:42:52.994915+0000","last_fullsized":"2024-02-19T21:42:52.994915+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:22.826680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:22.826680+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"217'13033","reported_seq":13093,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-02-19T21:42:54.971600+0000","last_change":"2024-02-19T21:39:39.480146+0000","last_active":"2024-02-19T21:42:54.971600+0000","last_peered":"2024-02-19T21:42:54.971600+0000","last_clean":"2024-02-19T21:42:54.971600+0000","last_became_active":"2024-02-19T21:39:39.479576+0000","last_became_peered":"2024-02-19T21:39:39.479576+0000","last_unstale":"2024-02-19T21:42:54.971600+0000","last_undegraded":"2024-02-19T21:42:54.971600+0000","last_fullsized":"2024-02-19T21:42:54.971600+0000","mapping_epoch":165,"log_start":"192'9097","ondisk_log_start":"192'9097","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":3936,"ondisk_log_size":3936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":187891712,"num_objects":2867,"num_object_clones":0,"num_object_copies":8601,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2867,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13033,"num_write_kb":508800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":185,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.028403+0000","last_change":"2024-02-19T21:40:29.250688+0000","last_active":"2024-02-19T21:42:53.028403+0000","last_peered":"2024-02-19T21:42:53.028403+0000","last_clean":"2024-02-19T21:42:53.028403+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:42:53.028403+0000","last_undegraded":"2024-02-19T21:42:53.028403+0000","last_fullsized":"2024-02-19T21:42:53.028403+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:40:29.250599+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":196,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.028694+0000","last_change":"2024-02-19T21:41:22.644476+0000","last_active":"2024-02-19T21:42:53.028694+0000","last_peered":"2024-02-19T21:42:53.028694+0000","last_clean":"2024-02-19T21:42:53.028694+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:42:53.028694+0000","last_undegraded":"2024-02-19T21:42:53.028694+0000","last_fullsized":"2024-02-19T21:42:53.028694+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:22.644405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:41:22.644405+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":187,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.009052+0000","last_change":"2024-02-19T21:42:41.086755+0000","last_active":"2024-02-19T21:42:53.009052+0000","last_peered":"2024-02-19T21:42:53.009052+0000","last_clean":"2024-02-19T21:42:53.009052+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:42:53.009052+0000","last_undegraded":"2024-02-19T21:42:53.009052+0000","last_fullsized":"2024-02-19T21:42:53.009052+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:30.117032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:39:30.117032+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"200'24","reported_seq":289,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.037432+0000","last_change":"2024-02-19T21:42:04.647669+0000","last_active":"2024-02-19T21:42:53.037432+0000","last_peered":"2024-02-19T21:42:53.037432+0000","last_clean":"2024-02-19T21:42:53.037432+0000","last_became_active":"2024-02-19T21:42:04.206790+0000","last_became_peered":"2024-02-19T21:42:04.206790+0000","last_unstale":"2024-02-19T21:42:53.037432+0000","last_undegraded":"2024-02-19T21:42:53.037432+0000","last_fullsized":"2024-02-19T21:42:53.037432+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'12","last_scrub_stamp":"2024-02-19T21:38:18.908732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:38:18.908732+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":182,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.995381+0000","last_change":"2024-02-19T21:41:23.683433+0000","last_active":"2024-02-19T21:42:52.995381+0000","last_peered":"2024-02-19T21:42:52.995381+0000","last_clean":"2024-02-19T21:42:52.995381+0000","last_became_active":"2024-02-19T21:32:27.372460+0000","last_became_peered":"2024-02-19T21:32:27.372460+0000","last_unstale":"2024-02-19T21:42:52.995381+0000","last_undegraded":"2024-02-19T21:42:52.995381+0000","last_fullsized":"2024-02-19T21:42:52.995381+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:23.683337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:23.683337+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"217'13053","reported_seq":13113,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-02-19T21:42:55.003188+0000","last_change":"2024-02-19T21:39:39.468511+0000","last_active":"2024-02-19T21:42:55.003188+0000","last_peered":"2024-02-19T21:42:55.003188+0000","last_clean":"2024-02-19T21:42:55.003188+0000","last_became_active":"2024-02-19T21:39:39.468217+0000","last_became_peered":"2024-02-19T21:39:39.468217+0000","last_unstale":"2024-02-19T21:42:55.003188+0000","last_undegraded":"2024-02-19T21:42:55.003188+0000","last_fullsized":"2024-02-19T21:42:55.003188+0000","mapping_epoch":165,"log_start":"183'4881","ondisk_log_start":"183'4881","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":8172,"ondisk_log_size":8172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":179503104,"num_objects":2739,"num_object_clones":0,"num_object_copies":8217,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2739,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13053,"num_write_kb":505344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":194,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.023546+0000","last_change":"2024-02-19T21:42:04.193367+0000","last_active":"2024-02-19T21:42:53.023546+0000","last_peered":"2024-02-19T21:42:53.023546+0000","last_clean":"2024-02-19T21:42:53.023546+0000","last_became_active":"2024-02-19T21:42:04.193058+0000","last_became_peered":"2024-02-19T21:42:04.193058+0000","last_unstale":"2024-02-19T21:42:53.023546+0000","last_undegraded":"2024-02-19T21:42:53.023546+0000","last_fullsized":"2024-02-19T21:42:53.023546+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:39:42.020832+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.009411+0000","last_change":"2024-02-19T21:40:11.877814+0000","last_active":"2024-02-19T21:42:53.009411+0000","last_peered":"2024-02-19T21:42:53.009411+0000","last_clean":"2024-02-19T21:42:53.009411+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:42:53.009411+0000","last_undegraded":"2024-02-19T21:42:53.009411+0000","last_fullsized":"2024-02-19T21:42:53.009411+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:11.877751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:11.877751+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"201'37","reported_seq":244,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.026504+0000","last_change":"2024-02-19T21:40:26.405558+0000","last_active":"2024-02-19T21:42:53.026504+0000","last_peered":"2024-02-19T21:42:53.026504+0000","last_clean":"2024-02-19T21:42:53.026504+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:42:53.026504+0000","last_undegraded":"2024-02-19T21:42:53.026504+0000","last_fullsized":"2024-02-19T21:42:53.026504+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'27","last_scrub_stamp":"2024-02-19T21:40:26.405455+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:40:26.405455+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":184,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.013497+0000","last_change":"2024-02-19T21:40:16.260329+0000","last_active":"2024-02-19T21:42:53.013497+0000","last_peered":"2024-02-19T21:42:53.013497+0000","last_clean":"2024-02-19T21:42:53.013497+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:42:53.013497+0000","last_undegraded":"2024-02-19T21:42:53.013497+0000","last_fullsized":"2024-02-19T21:42:53.013497+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:16.260223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:40:16.260223+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.c","version":"217'13315","reported_seq":22158,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-02-19T21:42:55.045138+0000","last_change":"2024-02-19T21:42:45.605098+0000","last_active":"2024-02-19T21:42:55.045138+0000","last_peered":"2024-02-19T21:42:55.045138+0000","last_clean":"2024-02-19T21:42:55.045138+0000","last_became_active":"2024-02-19T21:42:45.572060+0000","last_became_peered":"2024-02-19T21:42:45.572060+0000","last_unstale":"2024-02-19T21:42:55.045138+0000","last_undegraded":"2024-02-19T21:42:55.045138+0000","last_fullsized":"2024-02-19T21:42:55.045138+0000","mapping_epoch":208,"log_start":"188'9002","ondisk_log_start":"188'9002","created":165,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4313,"ondisk_log_size":4313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184614912,"num_objects":2817,"num_object_clones":0,"num_object_copies":8451,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2817,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13315,"num_write_kb":516224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4380,"num_bytes_recovered":287047680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":83,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.013053+0000","last_change":"2024-02-19T21:42:04.200629+0000","last_active":"2024-02-19T21:42:53.013053+0000","last_peered":"2024-02-19T21:42:53.013053+0000","last_clean":"2024-02-19T21:42:53.013053+0000","last_became_active":"2024-02-19T21:42:04.200292+0000","last_became_peered":"2024-02-19T21:42:04.200292+0000","last_unstale":"2024-02-19T21:42:53.013053+0000","last_undegraded":"2024-02-19T21:42:53.013053+0000","last_fullsized":"2024-02-19T21:42:53.013053+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:44.231420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:44.231420+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,5],"acting":[6,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":184,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.028751+0000","last_change":"2024-02-19T21:38:28.036423+0000","last_active":"2024-02-19T21:42:53.028751+0000","last_peered":"2024-02-19T21:42:53.028751+0000","last_clean":"2024-02-19T21:42:53.028751+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:42:53.028751+0000","last_undegraded":"2024-02-19T21:42:53.028751+0000","last_fullsized":"2024-02-19T21:42:53.028751+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:38:28.036351+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"201'38","reported_seq":165,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.025548+0000","last_change":"2024-02-19T21:42:05.431988+0000","last_active":"2024-02-19T21:42:53.025548+0000","last_peered":"2024-02-19T21:42:53.025548+0000","last_clean":"2024-02-19T21:42:53.025548+0000","last_became_active":"2024-02-19T21:42:04.205907+0000","last_became_peered":"2024-02-19T21:42:04.205907+0000","last_unstale":"2024-02-19T21:42:53.025548+0000","last_undegraded":"2024-02-19T21:42:53.025548+0000","last_fullsized":"2024-02-19T21:42:53.025548+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"168'26","last_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:39:48.004702+0000","log_size":38,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":71,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.013869+0000","last_change":"2024-02-19T21:42:04.200909+0000","last_active":"2024-02-19T21:42:53.013869+0000","last_peered":"2024-02-19T21:42:53.013869+0000","last_clean":"2024-02-19T21:42:53.013869+0000","last_became_active":"2024-02-19T21:42:04.200496+0000","last_became_peered":"2024-02-19T21:42:04.200496+0000","last_unstale":"2024-02-19T21:42:53.013869+0000","last_undegraded":"2024-02-19T21:42:53.013869+0000","last_fullsized":"2024-02-19T21:42:53.013869+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:38.697183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:38.697183+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.d","version":"217'12984","reported_seq":22226,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-02-19T21:42:54.937392+0000","last_change":"2024-02-19T21:42:41.528426+0000","last_active":"2024-02-19T21:42:54.937392+0000","last_peered":"2024-02-19T21:42:54.937392+0000","last_clean":"2024-02-19T21:42:54.937392+0000","last_became_active":"2024-02-19T21:42:41.508003+0000","last_became_peered":"2024-02-19T21:42:41.508003+0000","last_unstale":"2024-02-19T21:42:54.937392+0000","last_undegraded":"2024-02-19T21:42:54.937392+0000","last_fullsized":"2024-02-19T21:42:54.937392+0000","mapping_epoch":204,"log_start":"188'8719","ondisk_log_start":"188'8719","created":165,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4265,"ondisk_log_size":4265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":183959576,"num_objects":2808,"num_object_clones":0,"num_object_copies":8424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2808,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12984,"num_write_kb":505281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4580,"num_bytes_recovered":300089368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":189,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.008902+0000","last_change":"2024-02-19T21:40:28.874859+0000","last_active":"2024-02-19T21:42:53.008902+0000","last_peered":"2024-02-19T21:42:53.008902+0000","last_clean":"2024-02-19T21:42:53.008902+0000","last_became_active":"2024-02-19T21:39:39.481908+0000","last_became_peered":"2024-02-19T21:39:39.481908+0000","last_unstale":"2024-02-19T21:42:53.008902+0000","last_undegraded":"2024-02-19T21:42:53.008902+0000","last_fullsized":"2024-02-19T21:42:53.008902+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:28.874762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:28.874762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":204,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.013762+0000","last_change":"2024-02-19T21:42:04.197387+0000","last_active":"2024-02-19T21:42:53.013762+0000","last_peered":"2024-02-19T21:42:53.013762+0000","last_clean":"2024-02-19T21:42:53.013762+0000","last_became_active":"2024-02-19T21:42:04.197048+0000","last_became_peered":"2024-02-19T21:42:04.197048+0000","last_unstale":"2024-02-19T21:42:53.013762+0000","last_undegraded":"2024-02-19T21:42:53.013762+0000","last_fullsized":"2024-02-19T21:42:53.013762+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:32.498434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:32.498434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"201'28","reported_seq":200,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.994208+0000","last_change":"2024-02-19T21:41:31.580765+0000","last_active":"2024-02-19T21:42:52.994208+0000","last_peered":"2024-02-19T21:42:52.994208+0000","last_clean":"2024-02-19T21:42:52.994208+0000","last_became_active":"2024-02-19T21:35:14.513806+0000","last_became_peered":"2024-02-19T21:35:14.513806+0000","last_unstale":"2024-02-19T21:42:52.994208+0000","last_undegraded":"2024-02-19T21:42:52.994208+0000","last_fullsized":"2024-02-19T21:42:52.994208+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'14","last_scrub_stamp":"2024-02-19T21:41:31.580701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:41:31.580701+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":34,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":173,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.024653+0000","last_change":"2024-02-19T21:41:30.192537+0000","last_active":"2024-02-19T21:42:53.024653+0000","last_peered":"2024-02-19T21:42:53.024653+0000","last_clean":"2024-02-19T21:42:53.024653+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:42:53.024653+0000","last_undegraded":"2024-02-19T21:42:53.024653+0000","last_fullsized":"2024-02-19T21:42:53.024653+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'9","last_scrub_stamp":"2024-02-19T21:41:30.192427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:30.192427+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"217'13097","reported_seq":13162,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-02-19T21:42:54.899781+0000","last_change":"2024-02-19T21:41:29.552859+0000","last_active":"2024-02-19T21:42:54.899781+0000","last_peered":"2024-02-19T21:42:54.899781+0000","last_clean":"2024-02-19T21:42:54.899781+0000","last_became_active":"2024-02-19T21:39:39.471580+0000","last_became_peered":"2024-02-19T21:39:39.471580+0000","last_unstale":"2024-02-19T21:42:54.899781+0000","last_undegraded":"2024-02-19T21:42:54.899781+0000","last_fullsized":"2024-02-19T21:42:54.899781+0000","mapping_epoch":165,"log_start":"188'8452","ondisk_log_start":"188'8452","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"187'8036","last_scrub_stamp":"2024-02-19T21:41:29.552760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:41:29.552760+0000","log_size":4645,"ondisk_log_size":4645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":173342720,"num_objects":2645,"num_object_clones":0,"num_object_copies":7935,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2645,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13097,"num_write_kb":503744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":66,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.013371+0000","last_change":"2024-02-19T21:40:21.371352+0000","last_active":"2024-02-19T21:42:53.013371+0000","last_peered":"2024-02-19T21:42:53.013371+0000","last_clean":"2024-02-19T21:42:53.013371+0000","last_became_active":"2024-02-19T21:39:39.477051+0000","last_became_peered":"2024-02-19T21:39:39.477051+0000","last_unstale":"2024-02-19T21:42:53.013371+0000","last_undegraded":"2024-02-19T21:42:53.013371+0000","last_fullsized":"2024-02-19T21:42:53.013371+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:21.371240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:40:21.371240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":182,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.995378+0000","last_change":"2024-02-19T21:40:22.774178+0000","last_active":"2024-02-19T21:42:52.995378+0000","last_peered":"2024-02-19T21:42:52.995378+0000","last_clean":"2024-02-19T21:42:52.995378+0000","last_became_active":"2024-02-19T21:32:27.362497+0000","last_became_peered":"2024-02-19T21:32:27.362497+0000","last_unstale":"2024-02-19T21:42:52.995378+0000","last_undegraded":"2024-02-19T21:42:52.995378+0000","last_fullsized":"2024-02-19T21:42:52.995378+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:22.774081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:22.774081+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":193,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.009135+0000","last_change":"2024-02-19T21:40:41.901768+0000","last_active":"2024-02-19T21:42:53.009135+0000","last_peered":"2024-02-19T21:42:53.009135+0000","last_clean":"2024-02-19T21:42:53.009135+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:42:53.009135+0000","last_undegraded":"2024-02-19T21:42:53.009135+0000","last_fullsized":"2024-02-19T21:42:53.009135+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:40:41.901670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:41.901670+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"201'19","reported_seq":210,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.013884+0000","last_change":"2024-02-19T21:40:26.390284+0000","last_active":"2024-02-19T21:42:53.013884+0000","last_peered":"2024-02-19T21:42:53.013884+0000","last_clean":"2024-02-19T21:42:53.013884+0000","last_became_active":"2024-02-19T21:39:51.536649+0000","last_became_peered":"2024-02-19T21:39:51.536649+0000","last_unstale":"2024-02-19T21:42:53.013884+0000","last_undegraded":"2024-02-19T21:42:53.013884+0000","last_fullsized":"2024-02-19T21:42:53.013884+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:40:26.390173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:26.390173+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"217'13316","reported_seq":13376,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-02-19T21:42:54.972174+0000","last_change":"2024-02-19T21:39:39.479591+0000","last_active":"2024-02-19T21:42:54.972174+0000","last_peered":"2024-02-19T21:42:54.972174+0000","last_clean":"2024-02-19T21:42:54.972174+0000","last_became_active":"2024-02-19T21:39:39.479224+0000","last_became_peered":"2024-02-19T21:39:39.479224+0000","last_unstale":"2024-02-19T21:42:54.972174+0000","last_undegraded":"2024-02-19T21:42:54.972174+0000","last_fullsized":"2024-02-19T21:42:54.972174+0000","mapping_epoch":165,"log_start":"192'9391","ondisk_log_start":"192'9391","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":3925,"ondisk_log_size":3925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":185204736,"num_objects":2826,"num_object_clones":0,"num_object_copies":8478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2826,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13316,"num_write_kb":516544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":198,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.027118+0000","last_change":"2024-02-19T21:42:53.026951+0000","last_active":"2024-02-19T21:42:53.027118+0000","last_peered":"2024-02-19T21:42:53.027118+0000","last_clean":"2024-02-19T21:42:53.027118+0000","last_became_active":"2024-02-19T21:42:53.026678+0000","last_became_peered":"2024-02-19T21:42:53.026678+0000","last_unstale":"2024-02-19T21:42:53.027118+0000","last_undegraded":"2024-02-19T21:42:53.027118+0000","last_fullsized":"2024-02-19T21:42:53.027118+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:16.845272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:16.845272+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"98'9","reported_seq":264,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.994961+0000","last_change":"2024-02-19T21:41:30.610945+0000","last_active":"2024-02-19T21:42:52.994961+0000","last_peered":"2024-02-19T21:42:52.994961+0000","last_clean":"2024-02-19T21:42:52.994961+0000","last_became_active":"2024-02-19T21:35:14.513802+0000","last_became_peered":"2024-02-19T21:35:14.513802+0000","last_unstale":"2024-02-19T21:42:52.994961+0000","last_undegraded":"2024-02-19T21:42:52.994961+0000","last_fullsized":"2024-02-19T21:42:52.994961+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'9","last_scrub_stamp":"2024-02-19T21:41:30.610855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:30.610855+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":187,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.025156+0000","last_change":"2024-02-19T21:40:14.294150+0000","last_active":"2024-02-19T21:42:53.025156+0000","last_peered":"2024-02-19T21:42:53.025156+0000","last_clean":"2024-02-19T21:42:53.025156+0000","last_became_active":"2024-02-19T21:32:23.362738+0000","last_became_peered":"2024-02-19T21:32:23.362738+0000","last_unstale":"2024-02-19T21:42:53.025156+0000","last_undegraded":"2024-02-19T21:42:53.025156+0000","last_fullsized":"2024-02-19T21:42:53.025156+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:14.294064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:40:14.294064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"201'27","reported_seq":96,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.995165+0000","last_change":"2024-02-19T21:40:12.838278+0000","last_active":"2024-02-19T21:42:52.995165+0000","last_peered":"2024-02-19T21:42:52.995165+0000","last_clean":"2024-02-19T21:42:52.995165+0000","last_became_active":"2024-02-19T21:39:51.539230+0000","last_became_peered":"2024-02-19T21:39:51.539230+0000","last_unstale":"2024-02-19T21:42:52.995165+0000","last_undegraded":"2024-02-19T21:42:52.995165+0000","last_fullsized":"2024-02-19T21:42:52.995165+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:40:12.838083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:12.838083+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.0","version":"217'13259","reported_seq":13324,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-02-19T21:42:55.003848+0000","last_change":"2024-02-19T21:41:41.239560+0000","last_active":"2024-02-19T21:42:55.003848+0000","last_peered":"2024-02-19T21:42:55.003848+0000","last_clean":"2024-02-19T21:42:55.003848+0000","last_became_active":"2024-02-19T21:39:39.465196+0000","last_became_peered":"2024-02-19T21:39:39.465196+0000","last_unstale":"2024-02-19T21:42:55.003848+0000","last_undegraded":"2024-02-19T21:42:55.003848+0000","last_fullsized":"2024-02-19T21:42:55.003848+0000","mapping_epoch":165,"log_start":"184'5064","ondisk_log_start":"184'5064","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":8195,"ondisk_log_size":8195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":183304192,"num_objects":2797,"num_object_clones":0,"num_object_copies":8391,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2797,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13259,"num_write_kb":513792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":168,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.029061+0000","last_change":"2024-02-19T21:42:48.626776+0000","last_active":"2024-02-19T21:42:53.029061+0000","last_peered":"2024-02-19T21:42:53.029061+0000","last_clean":"2024-02-19T21:42:53.029061+0000","last_became_active":"2024-02-19T21:42:48.626491+0000","last_became_peered":"2024-02-19T21:42:48.626491+0000","last_unstale":"2024-02-19T21:42:53.029061+0000","last_undegraded":"2024-02-19T21:42:53.029061+0000","last_fullsized":"2024-02-19T21:42:53.029061+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:40.015907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:40.015907+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"170'11","reported_seq":178,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.009555+0000","last_change":"2024-02-19T21:40:21.864057+0000","last_active":"2024-02-19T21:42:53.009555+0000","last_peered":"2024-02-19T21:42:53.009555+0000","last_clean":"2024-02-19T21:42:53.009555+0000","last_became_active":"2024-02-19T21:39:51.534304+0000","last_became_peered":"2024-02-19T21:39:51.534304+0000","last_unstale":"2024-02-19T21:42:53.009555+0000","last_undegraded":"2024-02-19T21:42:53.009555+0000","last_fullsized":"2024-02-19T21:42:53.009555+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'11","last_scrub_stamp":"2024-02-19T21:40:21.863959+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:40:21.863959+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":184,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.024569+0000","last_change":"2024-02-19T21:39:31.018063+0000","last_active":"2024-02-19T21:42:53.024569+0000","last_peered":"2024-02-19T21:42:53.024569+0000","last_clean":"2024-02-19T21:42:53.024569+0000","last_became_active":"2024-02-19T21:32:23.363155+0000","last_became_peered":"2024-02-19T21:32:23.363155+0000","last_unstale":"2024-02-19T21:42:53.024569+0000","last_undegraded":"2024-02-19T21:42:53.024569+0000","last_fullsized":"2024-02-19T21:42:53.024569+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:31.018000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:39:31.018000+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"200'20","reported_seq":188,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.009906+0000","last_change":"2024-02-19T21:41:21.872187+0000","last_active":"2024-02-19T21:42:53.009906+0000","last_peered":"2024-02-19T21:42:53.009906+0000","last_clean":"2024-02-19T21:42:53.009906+0000","last_became_active":"2024-02-19T21:35:14.514968+0000","last_became_peered":"2024-02-19T21:35:14.514968+0000","last_unstale":"2024-02-19T21:42:53.009906+0000","last_undegraded":"2024-02-19T21:42:53.009906+0000","last_fullsized":"2024-02-19T21:42:53.009906+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:41:21.872058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:41:21.872058+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6],"acting":[3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"217'13115","reported_seq":13175,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-02-19T21:42:54.955115+0000","last_change":"2024-02-19T21:39:39.480753+0000","last_active":"2024-02-19T21:42:54.955115+0000","last_peered":"2024-02-19T21:42:54.955115+0000","last_clean":"2024-02-19T21:42:54.955115+0000","last_became_active":"2024-02-19T21:39:39.480509+0000","last_became_peered":"2024-02-19T21:39:39.480509+0000","last_unstale":"2024-02-19T21:42:54.955115+0000","last_undegraded":"2024-02-19T21:42:54.955115+0000","last_fullsized":"2024-02-19T21:42:54.955115+0000","mapping_epoch":165,"log_start":"192'9212","ondisk_log_start":"192'9212","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":3903,"ondisk_log_size":3903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":183042048,"num_objects":2793,"num_object_clones":0,"num_object_copies":8379,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2793,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13115,"num_write_kb":509056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":194,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.013846+0000","last_change":"2024-02-19T21:42:44.595213+0000","last_active":"2024-02-19T21:42:53.013846+0000","last_peered":"2024-02-19T21:42:53.013846+0000","last_clean":"2024-02-19T21:42:53.013846+0000","last_became_active":"2024-02-19T21:42:44.592914+0000","last_became_peered":"2024-02-19T21:42:44.592914+0000","last_unstale":"2024-02-19T21:42:53.013846+0000","last_undegraded":"2024-02-19T21:42:53.013846+0000","last_fullsized":"2024-02-19T21:42:53.013846+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:36.725664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:41:36.725664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":178,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.028318+0000","last_change":"2024-02-19T21:39:39.002316+0000","last_active":"2024-02-19T21:42:53.028318+0000","last_peered":"2024-02-19T21:42:53.028318+0000","last_clean":"2024-02-19T21:42:53.028318+0000","last_became_active":"2024-02-19T21:32:27.369452+0000","last_became_peered":"2024-02-19T21:32:27.369452+0000","last_unstale":"2024-02-19T21:42:53.028318+0000","last_undegraded":"2024-02-19T21:42:53.028318+0000","last_fullsized":"2024-02-19T21:42:53.028318+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:39.002258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:39.002258+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":188,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.008795+0000","last_change":"2024-02-19T21:40:32.869530+0000","last_active":"2024-02-19T21:42:53.008795+0000","last_peered":"2024-02-19T21:42:53.008795+0000","last_clean":"2024-02-19T21:42:53.008795+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:42:53.008795+0000","last_undegraded":"2024-02-19T21:42:53.008795+0000","last_fullsized":"2024-02-19T21:42:53.008795+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:32.869462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:40:32.869462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"201'31","reported_seq":142,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.029410+0000","last_change":"2024-02-19T21:39:39.501787+0000","last_active":"2024-02-19T21:42:53.029410+0000","last_peered":"2024-02-19T21:42:53.029410+0000","last_clean":"2024-02-19T21:42:53.029410+0000","last_became_active":"2024-02-19T21:39:39.474668+0000","last_became_peered":"2024-02-19T21:39:39.474668+0000","last_unstale":"2024-02-19T21:42:53.029410+0000","last_undegraded":"2024-02-19T21:42:53.029410+0000","last_fullsized":"2024-02-19T21:42:53.029410+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'17","last_scrub_stamp":"2024-02-19T21:38:19.154753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:38:19.154753+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":49,"num_read_kb":39,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"217'13210","reported_seq":13270,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-02-19T21:42:55.076408+0000","last_change":"2024-02-19T21:39:39.471363+0000","last_active":"2024-02-19T21:42:55.076408+0000","last_peered":"2024-02-19T21:42:55.076408+0000","last_clean":"2024-02-19T21:42:55.076408+0000","last_became_active":"2024-02-19T21:39:39.470667+0000","last_became_peered":"2024-02-19T21:39:39.470667+0000","last_unstale":"2024-02-19T21:42:55.076408+0000","last_undegraded":"2024-02-19T21:42:55.076408+0000","last_fullsized":"2024-02-19T21:42:55.076408+0000","mapping_epoch":165,"log_start":"188'8975","ondisk_log_start":"188'8975","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4235,"ondisk_log_size":4235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":183500800,"num_objects":2800,"num_object_clones":0,"num_object_copies":8400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2800,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13210,"num_write_kb":512320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":155,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.009504+0000","last_change":"2024-02-19T21:42:04.193922+0000","last_active":"2024-02-19T21:42:53.009504+0000","last_peered":"2024-02-19T21:42:53.009504+0000","last_clean":"2024-02-19T21:42:53.009504+0000","last_became_active":"2024-02-19T21:42:04.193565+0000","last_became_peered":"2024-02-19T21:42:04.193565+0000","last_unstale":"2024-02-19T21:42:53.009504+0000","last_undegraded":"2024-02-19T21:42:53.009504+0000","last_fullsized":"2024-02-19T21:42:53.009504+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:36.890201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.890201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":77,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.026447+0000","last_change":"2024-02-19T21:42:04.205186+0000","last_active":"2024-02-19T21:42:53.026447+0000","last_peered":"2024-02-19T21:42:53.026447+0000","last_clean":"2024-02-19T21:42:53.026447+0000","last_became_active":"2024-02-19T21:42:04.204839+0000","last_became_peered":"2024-02-19T21:42:04.204839+0000","last_unstale":"2024-02-19T21:42:53.026447+0000","last_undegraded":"2024-02-19T21:42:53.026447+0000","last_fullsized":"2024-02-19T21:42:53.026447+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:23.324303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:46.372184+0000","last_clean_scrub_stamp":"2024-02-19T21:40:23.324303+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":81,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.994965+0000","last_change":"2024-02-19T21:40:28.696870+0000","last_active":"2024-02-19T21:42:52.994965+0000","last_peered":"2024-02-19T21:42:52.994965+0000","last_clean":"2024-02-19T21:42:52.994965+0000","last_became_active":"2024-02-19T21:39:39.479752+0000","last_became_peered":"2024-02-19T21:39:39.479752+0000","last_unstale":"2024-02-19T21:42:52.994965+0000","last_undegraded":"2024-02-19T21:42:52.994965+0000","last_fullsized":"2024-02-19T21:42:52.994965+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:40:28.696783+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"201'44","reported_seq":279,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.013355+0000","last_change":"2024-02-19T21:42:04.985140+0000","last_active":"2024-02-19T21:42:53.013355+0000","last_peered":"2024-02-19T21:42:53.013355+0000","last_clean":"2024-02-19T21:42:53.013355+0000","last_became_active":"2024-02-19T21:42:04.200393+0000","last_became_peered":"2024-02-19T21:42:04.200393+0000","last_unstale":"2024-02-19T21:42:53.013355+0000","last_undegraded":"2024-02-19T21:42:53.013355+0000","last_fullsized":"2024-02-19T21:42:53.013355+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'28","last_scrub_stamp":"2024-02-19T21:39:40.282677+0000","last_deep_scrub":"115'28","last_deep_scrub_stamp":"2024-02-19T21:36:09.031674+0000","last_clean_scrub_stamp":"2024-02-19T21:39:40.282677+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.7","version":"217'13111","reported_seq":13171,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-02-19T21:42:54.948987+0000","last_change":"2024-02-19T21:39:39.463794+0000","last_active":"2024-02-19T21:42:54.948987+0000","last_peered":"2024-02-19T21:42:54.948987+0000","last_clean":"2024-02-19T21:42:54.948987+0000","last_became_active":"2024-02-19T21:39:39.463542+0000","last_became_peered":"2024-02-19T21:39:39.463542+0000","last_unstale":"2024-02-19T21:42:54.948987+0000","last_undegraded":"2024-02-19T21:42:54.948987+0000","last_fullsized":"2024-02-19T21:42:54.948987+0000","mapping_epoch":165,"log_start":"192'9183","ondisk_log_start":"192'9183","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":3928,"ondisk_log_size":3928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":177143808,"num_objects":2703,"num_object_clones":0,"num_object_copies":8109,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2703,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13111,"num_write_kb":506048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,6],"acting":[1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":190,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.028866+0000","last_change":"2024-02-19T21:39:42.230802+0000","last_active":"2024-02-19T21:42:53.028866+0000","last_peered":"2024-02-19T21:42:53.028866+0000","last_clean":"2024-02-19T21:42:53.028866+0000","last_became_active":"2024-02-19T21:39:39.470671+0000","last_became_peered":"2024-02-19T21:39:39.470671+0000","last_unstale":"2024-02-19T21:42:53.028866+0000","last_undegraded":"2024-02-19T21:42:53.028866+0000","last_fullsized":"2024-02-19T21:42:53.028866+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:42.230664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:42.230664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":173,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.992257+0000","last_change":"2024-02-19T21:40:40.799240+0000","last_active":"2024-02-19T21:42:52.992257+0000","last_peered":"2024-02-19T21:42:52.992257+0000","last_clean":"2024-02-19T21:42:52.992257+0000","last_became_active":"2024-02-19T21:39:39.468109+0000","last_became_peered":"2024-02-19T21:39:39.468109+0000","last_unstale":"2024-02-19T21:42:52.992257+0000","last_undegraded":"2024-02-19T21:42:52.992257+0000","last_fullsized":"2024-02-19T21:42:52.992257+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:40.799141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:40.799141+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1],"acting":[4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":182,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.029546+0000","last_change":"2024-02-19T21:37:36.883246+0000","last_active":"2024-02-19T21:42:53.029546+0000","last_peered":"2024-02-19T21:42:53.029546+0000","last_clean":"2024-02-19T21:42:53.029546+0000","last_became_active":"2024-02-19T21:32:23.357438+0000","last_became_peered":"2024-02-19T21:32:23.357438+0000","last_unstale":"2024-02-19T21:42:53.029546+0000","last_undegraded":"2024-02-19T21:42:53.029546+0000","last_fullsized":"2024-02-19T21:42:53.029546+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:36.883151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:37:36.883151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"201'15","reported_seq":210,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.026591+0000","last_change":"2024-02-19T21:39:36.193250+0000","last_active":"2024-02-19T21:42:53.026591+0000","last_peered":"2024-02-19T21:42:53.026591+0000","last_clean":"2024-02-19T21:42:53.026591+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:42:53.026591+0000","last_undegraded":"2024-02-19T21:42:53.026591+0000","last_fullsized":"2024-02-19T21:42:53.026591+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:39:36.193184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:36.193184+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"217'13391","reported_seq":13451,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-02-19T21:42:54.938182+0000","last_change":"2024-02-19T21:39:39.474614+0000","last_active":"2024-02-19T21:42:54.938182+0000","last_peered":"2024-02-19T21:42:54.938182+0000","last_clean":"2024-02-19T21:42:54.938182+0000","last_became_active":"2024-02-19T21:39:39.474311+0000","last_became_peered":"2024-02-19T21:39:39.474311+0000","last_unstale":"2024-02-19T21:42:54.938182+0000","last_undegraded":"2024-02-19T21:42:54.938182+0000","last_fullsized":"2024-02-19T21:42:54.938182+0000","mapping_epoch":165,"log_start":"191'9128","ondisk_log_start":"191'9128","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4263,"ondisk_log_size":4263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184877056,"num_objects":2821,"num_object_clones":0,"num_object_copies":8463,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2821,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13391,"num_write_kb":518784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":180,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.994473+0000","last_change":"2024-02-19T21:40:17.853102+0000","last_active":"2024-02-19T21:42:52.994473+0000","last_peered":"2024-02-19T21:42:52.994473+0000","last_clean":"2024-02-19T21:42:52.994473+0000","last_became_active":"2024-02-19T21:32:29.597248+0000","last_became_peered":"2024-02-19T21:32:29.597248+0000","last_unstale":"2024-02-19T21:42:52.994473+0000","last_undegraded":"2024-02-19T21:42:52.994473+0000","last_fullsized":"2024-02-19T21:42:52.994473+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:17.853016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:40:17.853016+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":143,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.014030+0000","last_change":"2024-02-19T21:42:04.200518+0000","last_active":"2024-02-19T21:42:53.014030+0000","last_peered":"2024-02-19T21:42:53.014030+0000","last_clean":"2024-02-19T21:42:53.014030+0000","last_became_active":"2024-02-19T21:42:04.199889+0000","last_became_peered":"2024-02-19T21:42:04.199889+0000","last_unstale":"2024-02-19T21:42:53.014030+0000","last_undegraded":"2024-02-19T21:42:53.014030+0000","last_fullsized":"2024-02-19T21:42:53.014030+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:40:29.858805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"200'27","reported_seq":254,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:52.994062+0000","last_change":"2024-02-19T21:42:05.597864+0000","last_active":"2024-02-19T21:42:52.994062+0000","last_peered":"2024-02-19T21:42:52.994062+0000","last_clean":"2024-02-19T21:42:52.994062+0000","last_became_active":"2024-02-19T21:42:04.212731+0000","last_became_peered":"2024-02-19T21:42:04.212731+0000","last_unstale":"2024-02-19T21:42:52.994062+0000","last_undegraded":"2024-02-19T21:42:52.994062+0000","last_fullsized":"2024-02-19T21:42:52.994062+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:40:23.751886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:23.751886+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"66'8","reported_seq":316,"reported_epoch":216,"state":"active+clean","last_fresh":"2024-02-19T21:42:53.008417+0000","last_change":"2024-02-19T21:40:19.870350+0000","last_active":"2024-02-19T21:42:53.008417+0000","last_peered":"2024-02-19T21:42:53.008417+0000","last_clean":"2024-02-19T21:42:53.008417+0000","last_became_active":"2024-02-19T21:32:27.369840+0000","last_became_peered":"2024-02-19T21:32:27.369840+0000","last_unstale":"2024-02-19T21:42:53.008417+0000","last_undegraded":"2024-02-19T21:42:53.008417+0000","last_fullsized":"2024-02-19T21:42:53.008417+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:40:19.870250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:19.870250+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":2914451480,"num_objects":44472,"num_object_clones":0,"num_object_copies":133416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":4750,"num_objects_unfound":0,"num_objects_dirty":44472,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":210960,"num_write_kb":8173761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10305,"num_bytes_recovered":675217432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9215295488,"data_stored":9215279200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75269,"ondisk_log_size":75269,"up":48,"acting":48,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":618,"num_read_kb":613,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1116,"num_read_kb":873,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":3604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":741,"ondisk_log_size":741,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":29,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":382,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":87,"acting":87,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201409,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1615832,"kb_used_data":1318608,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":92129320,"statfs":{"total":95995035648,"available":94340423680,"internally_reserved":0,"allocated":1350254592,"data_stored":1349955211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:42:32 2024","interfaces":[{"interface":"back","average":{"1min":2.9430000000000001,"5min":1.9550000000000001,"15min":1.0860000000000001},"min":{"1min":0.23499999999999999,"5min":0.189,"15min":0.189},"max":{"1min":10.907,"5min":13.645,"15min":13.645},"last":0.61799999999999999},{"interface":"front","average":{"1min":2.8809999999999998,"5min":1.9730000000000001,"15min":1.1819999999999999},"min":{"1min":0.26100000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":14.099,"5min":14.212999999999999,"15min":14.212999999999999},"last":0.57799999999999996}]},{"osd":1,"last update":"Mon Feb 19 21:42:32 2024","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":2.0720000000000001,"15min":1.214},"min":{"1min":0.255,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":3.6520000000000001,"5min":14.246,"15min":14.246},"last":2.819},{"interface":"front","average":{"1min":3.1299999999999999,"5min":1.8340000000000001,"15min":1.105},"min":{"1min":0.29399999999999998,"5min":0.223,"15min":0.223},"max":{"1min":14.15,"5min":14.15,"15min":14.15},"last":0.54700000000000004}]},{"osd":2,"last update":"Mon Feb 19 21:42:32 2024","interfaces":[{"interface":"back","average":{"1min":3.2210000000000001,"5min":2.0289999999999999,"15min":1.1499999999999999},"min":{"1min":0.28599999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":10.965999999999999,"5min":10.965999999999999,"15min":10.965999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.5029999999999999,"5min":2.109,"15min":1.194},"min":{"1min":0.28899999999999998,"5min":0.28000000000000003,"15min":0.27800000000000002},"max":{"1min":4.835,"5min":9.7010000000000005,"15min":9.7010000000000005},"last":2.8690000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:42:32 2024","interfaces":[{"interface":"back","average":{"1min":3.3149999999999999,"5min":2.6669999999999998,"15min":1.5},"min":{"1min":0.29699999999999999,"5min":0.29199999999999998,"15min":0.26900000000000002},"max":{"1min":11.004,"5min":17.481999999999999,"15min":31.559000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.8169999999999999,"5min":2.1459999999999999,"15min":1.333},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":10.522,"5min":17.576000000000001,"15min":30.812999999999999},"last":2.843}]},{"osd":4,"last update":"Mon Feb 19 21:42:32 2024","interfaces":[{"interface":"back","average":{"1min":3.1080000000000001,"5min":1.667,"15min":0.88800000000000001},"min":{"1min":0.26900000000000002,"5min":0.247,"15min":0.247},"max":{"1min":14.208,"5min":14.208,"15min":14.208},"last":0.60499999999999998},{"interface":"front","average":{"1min":3.6749999999999998,"5min":2.1539999999999999,"15min":1.0549999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.245},"max":{"1min":11.029999999999999,"5min":11.541,"15min":11.541},"last":1.0149999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:42:32 2024","interfaces":[{"interface":"back","average":{"1min":1.853,"5min":1.6879999999999999,"15min":0.97699999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.7930000000000001,"5min":10.090999999999999,"15min":10.090999999999999},"last":2.7839999999999998},{"interface":"front","average":{"1min":3.637,"5min":1.9890000000000001,"15min":1.0389999999999999},"min":{"1min":0.315,"5min":0.30299999999999999,"15min":0.28799999999999998},"max":{"1min":17.012,"5min":17.012,"15min":17.012},"last":0.72999999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:42:32 2024","interfaces":[{"interface":"back","average":{"1min":3.052,"5min":1.6259999999999999,"15min":0.93400000000000005},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.30299999999999999},"max":{"1min":14.177,"5min":14.177,"15min":14.177},"last":1.8440000000000001},{"interface":"front","average":{"1min":4.2119999999999997,"5min":2.2429999999999999,"15min":1.2989999999999999},"min":{"1min":0.5,"5min":0.33000000000000002,"15min":0.29699999999999999},"max":{"1min":12.913,"5min":12.913,"15min":12.913},"last":0.52100000000000002}]}]},{"osd":6,"up_from":47,"seq":201863463048,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1582524,"kb_used_data":1272948,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":92162628,"statfs":{"total":95995035648,"available":94374531072,"internally_reserved":0,"allocated":1303498752,"data_stored":1303162962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:42:11 2024","interfaces":[{"interface":"back","average":{"1min":2.5449999999999999,"5min":2.0710000000000002,"15min":1.135},"min":{"1min":0.23400000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":18.673999999999999,"5min":18.673999999999999,"15min":18.673999999999999},"last":45.197000000000003},{"interface":"front","average":{"1min":2.581,"5min":2.2789999999999999,"15min":1.21},"min":{"1min":0.23499999999999999,"5min":0.221,"15min":0.221},"max":{"1min":20.548999999999999,"5min":20.548999999999999,"15min":20.548999999999999},"last":44.753}]},{"osd":1,"last update":"Mon Feb 19 21:42:11 2024","interfaces":[{"interface":"back","average":{"1min":1.792,"5min":1.706,"15min":1.0649999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":9.2439999999999998,"5min":11.122999999999999,"15min":12.574999999999999},"last":45.231999999999999},{"interface":"front","average":{"1min":1.5960000000000001,"5min":1.7070000000000001,"15min":0.96999999999999997},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":6.0499999999999998,"5min":11.19,"15min":11.19},"last":45.097999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:42:11 2024","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.694,"15min":0.98799999999999999},"min":{"1min":0.28599999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":6.1109999999999998,"5min":8.3849999999999998,"15min":8.3849999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":1.698,"5min":1.8280000000000001,"15min":1.0620000000000001},"min":{"1min":0.29299999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":8.5259999999999998,"5min":8.5259999999999998,"15min":18.068000000000001},"last":0.46000000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:42:11 2024","interfaces":[{"interface":"back","average":{"1min":1.946,"5min":1.8280000000000001,"15min":1.0960000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":9.2699999999999996,"5min":11.15,"15min":11.15},"last":0.38100000000000001},{"interface":"front","average":{"1min":1.494,"5min":1.7490000000000001,"15min":1.0669999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.246},"max":{"1min":6.0890000000000004,"5min":19.632999999999999,"15min":19.632999999999999},"last":0.44400000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:42:11 2024","interfaces":[{"interface":"back","average":{"1min":2.3109999999999999,"5min":1.704,"15min":0.85899999999999999},"min":{"1min":0.27300000000000002,"5min":0.247,"15min":0.247},"max":{"1min":8.5920000000000005,"5min":9.3759999999999994,"15min":9.3759999999999994},"last":0.51700000000000002},{"interface":"front","average":{"1min":2.3140000000000001,"5min":1.653,"15min":0.85599999999999998},"min":{"1min":0.28999999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":9.8140000000000001,"5min":16.594999999999999,"15min":16.594999999999999},"last":0.53400000000000003}]},{"osd":5,"last update":"Mon Feb 19 21:42:11 2024","interfaces":[{"interface":"back","average":{"1min":2.6760000000000002,"5min":1.744,"15min":0.88800000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":8.6159999999999997,"5min":8.6159999999999997,"15min":8.6159999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":2.6749999999999998,"5min":1.9419999999999999,"15min":0.95799999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.27900000000000003},"max":{"1min":15.497999999999999,"5min":15.497999999999999,"15min":15.497999999999999},"last":0.72399999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:42:29 2024","interfaces":[{"interface":"back","average":{"1min":3.2330000000000001,"5min":2.1320000000000001,"15min":1.0680000000000001},"min":{"1min":0.33400000000000002,"5min":0.28799999999999998,"15min":0.26700000000000002},"max":{"1min":9.3179999999999996,"5min":14.721,"15min":14.721},"last":0.751},{"interface":"front","average":{"1min":3.2650000000000001,"5min":2.173,"15min":1.129},"min":{"1min":0.44700000000000001,"5min":0.35799999999999998,"15min":0.32700000000000001},"max":{"1min":9.343,"5min":14.744999999999999,"15min":14.744999999999999},"last":0.77000000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575010,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1747976,"kb_used_data":1446656,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":91997176,"statfs":{"total":95995035648,"available":94205108224,"internally_reserved":0,"allocated":1481375744,"data_stored":1481028801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:41:56 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":2.1779999999999999,"15min":1.1479999999999999},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":3.8399999999999999,"5min":42.776000000000003,"15min":42.776000000000003},"last":0.23100000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":2.379,"15min":1.137},"min":{"1min":0.19600000000000001,"5min":0.187,"15min":0.185},"max":{"1min":4.5110000000000001,"5min":44.845999999999997,"15min":44.845999999999997},"last":3.9620000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:42:27 2024","interfaces":[{"interface":"back","average":{"1min":1.7210000000000001,"5min":1.383,"15min":1.1000000000000001},"min":{"1min":0.23899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":6.9640000000000004,"5min":11.161,"15min":11.826000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":1.504,"15min":1.1779999999999999},"min":{"1min":0.24399999999999999,"5min":0.215,"15min":0.215},"max":{"1min":3.3460000000000001,"5min":11.507,"15min":12.26},"last":3.3540000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:41:56 2024","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":2.3439999999999999,"15min":1.2709999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":8.3469999999999995,"5min":41.607999999999997,"15min":41.607999999999997},"last":1.9610000000000001},{"interface":"front","average":{"1min":1.204,"5min":1.9259999999999999,"15min":1.075},"min":{"1min":0.23499999999999999,"5min":0.217,"15min":0.217},"max":{"1min":3.9140000000000001,"5min":42.811999999999998,"15min":42.811999999999998},"last":0.27000000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:42:21 2024","interfaces":[{"interface":"back","average":{"1min":1.9470000000000001,"5min":1.643,"15min":1.014},"min":{"1min":0.33200000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":6.1100000000000003,"5min":11.23,"15min":11.23},"last":0.46600000000000003},{"interface":"front","average":{"1min":1.726,"5min":1.782,"15min":1.129},"min":{"1min":0.35899999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":6.1210000000000004,"5min":7.0919999999999996,"15min":10.51},"last":0.47499999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:42:45 2024","interfaces":[{"interface":"back","average":{"1min":1.615,"5min":1.8089999999999999,"15min":1.147},"min":{"1min":0.30599999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":5.9199999999999999,"5min":8.0760000000000005,"15min":10.458},"last":2.8170000000000002},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.587,"15min":1.0680000000000001},"min":{"1min":0.32600000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":6.0720000000000001,"5min":7.2389999999999999,"15min":7.6950000000000003},"last":3.1629999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:42:14 2024","interfaces":[{"interface":"back","average":{"1min":2.8050000000000002,"5min":1.9650000000000001,"15min":1.1259999999999999},"min":{"1min":0.40999999999999998,"5min":0.33900000000000002,"15min":0.30099999999999999},"max":{"1min":10.291,"5min":11.638999999999999,"15min":11.638999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":2.6930000000000001,"5min":1.835,"15min":1.139},"min":{"1min":0.32900000000000001,"5min":0.316,"15min":0.316},"max":{"1min":12.199,"5min":12.199,"15min":12.199},"last":3.125}]},{"osd":7,"last update":"Mon Feb 19 21:42:33 2024","interfaces":[{"interface":"back","average":{"1min":2.2999999999999998,"5min":1.7969999999999999,"15min":1.2190000000000001},"min":{"1min":0.39200000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":8.1699999999999999,"5min":8.1699999999999999,"15min":10.638999999999999},"last":3.4830000000000001},{"interface":"front","average":{"1min":2.5939999999999999,"5min":1.837,"15min":1.139},"min":{"1min":0.41699999999999998,"5min":0.39500000000000002,"15min":0.33600000000000002},"max":{"1min":8.1809999999999992,"5min":11.276,"15min":11.276},"last":3.4569999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738536,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1590072,"kb_used_data":1280560,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":92155080,"statfs":{"total":95995035648,"available":94366801920,"internally_reserved":0,"allocated":1311293440,"data_stored":1310962384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:41:58 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":1.657,"15min":0.86799999999999999},"min":{"1min":0.20000000000000001,"5min":0.19900000000000001,"15min":0.17499999999999999},"max":{"1min":4.5640000000000001,"5min":16.478000000000002,"15min":16.478000000000002},"last":3.5880000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":1.883,"15min":1.071},"min":{"1min":0.20799999999999999,"5min":0.188,"15min":0.188},"max":{"1min":2.4489999999999998,"5min":13.422000000000001,"15min":13.422000000000001},"last":3.3860000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:42:32 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":1.663,"15min":1.054},"min":{"1min":0.27100000000000002,"5min":0.24399999999999999,"15min":0.23999999999999999},"max":{"1min":4.5979999999999999,"5min":13.638999999999999,"15min":13.638999999999999},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.7130000000000001,"15min":1.198},"min":{"1min":0.23200000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":3.3290000000000002,"5min":13.134,"15min":13.134},"last":3.3570000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:42:48 2024","interfaces":[{"interface":"back","average":{"1min":2.0859999999999999,"5min":1.7869999999999999,"15min":1.331},"min":{"1min":0.22900000000000001,"5min":0.217,"15min":0.217},"max":{"1min":5.0990000000000002,"5min":13.776,"15min":14.507999999999999},"last":2.024},{"interface":"front","average":{"1min":1.105,"5min":1.917,"15min":1.2989999999999999},"min":{"1min":0.24199999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":4.5270000000000001,"5min":18.759,"15min":18.759},"last":0.40699999999999997}]},{"osd":4,"last update":"Mon Feb 19 21:42:26 2024","interfaces":[{"interface":"back","average":{"1min":1.8140000000000001,"5min":1.952,"15min":1.139},"min":{"1min":0.38300000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":7.8529999999999998,"5min":13.278,"15min":13.278},"last":2.0550000000000002},{"interface":"front","average":{"1min":1.8140000000000001,"5min":1.7689999999999999,"15min":1.075},"min":{"1min":0.33800000000000002,"5min":0.317,"15min":0.255},"max":{"1min":7.8739999999999997,"5min":8.9450000000000003,"15min":8.9450000000000003},"last":0.45000000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:42:48 2024","interfaces":[{"interface":"back","average":{"1min":1.7370000000000001,"5min":2.2650000000000001,"15min":1.397},"min":{"1min":0.30299999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":4.4169999999999998,"5min":42.799999999999997,"15min":42.799999999999997},"last":3.4249999999999998},{"interface":"front","average":{"1min":2.573,"5min":2.5070000000000001,"15min":1.3939999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":9.1600000000000001,"5min":42.695,"15min":42.695},"last":2.1200000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:42:03 2024","interfaces":[{"interface":"back","average":{"1min":1.6559999999999999,"5min":2.1619999999999999,"15min":1.1850000000000001},"min":{"1min":0.39300000000000002,"5min":0.36499999999999999,"15min":0.27900000000000003},"max":{"1min":4.4980000000000002,"5min":42.777000000000001,"15min":42.777000000000001},"last":1.3680000000000001},{"interface":"front","average":{"1min":2.1600000000000001,"5min":2.2759999999999998,"15min":1.2829999999999999},"min":{"1min":0.39500000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":6.3090000000000002,"5min":9.7629999999999999,"15min":9.7629999999999999},"last":3.4049999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:42:32 2024","interfaces":[{"interface":"back","average":{"1min":2.0529999999999999,"5min":2.2639999999999998,"15min":1.2629999999999999},"min":{"1min":0.38700000000000001,"5min":0.31,"15min":0.31},"max":{"1min":7.7009999999999996,"5min":42.758000000000003,"15min":42.758000000000003},"last":2.5510000000000002},{"interface":"front","average":{"1min":2.0499999999999998,"5min":2.1190000000000002,"15min":1.2569999999999999},"min":{"1min":0.432,"5min":0.371,"15min":0.33200000000000002},"max":{"1min":7.8899999999999997,"5min":42.718000000000004,"15min":42.718000000000004},"last":1.399}]}]},{"osd":2,"up_from":0,"seq":77309411485,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":26,"seq":111669149848,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1246908,"kb_used_data":941492,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":92498244,"statfs":{"total":95995035648,"available":94718201856,"internally_reserved":0,"allocated":964087808,"data_stored":963815380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:41:58 2024","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.78,"15min":1.0740000000000001},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":6.5039999999999996,"5min":11.292,"15min":17.992000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.873,"5min":2.532,"15min":1.3939999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":6.0449999999999999,"5min":46.654000000000003,"15min":46.654000000000003},"last":0.313}]},{"osd":1,"last update":"Mon Feb 19 21:41:58 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.448,"15min":0.86299999999999999},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":6.444,"5min":9.9700000000000006,"15min":9.9700000000000006},"last":0.41599999999999998},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.9179999999999999,"15min":1.131},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.185},"max":{"1min":6.3460000000000001,"5min":11.196999999999999,"15min":13.135999999999999},"last":0.23799999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:41:58 2024","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":2.0680000000000001,"15min":1.1160000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.224},"max":{"1min":6.8879999999999999,"5min":11.175000000000001,"15min":11.175000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":2.23,"15min":1.284},"min":{"1min":0.23499999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.8320000000000001,"5min":45.831000000000003,"15min":45.831000000000003},"last":0.34699999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:42:21 2024","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.329,"15min":0.94199999999999995},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":7.1660000000000004,"5min":7.1660000000000004,"15min":7.1660000000000004},"last":0.63600000000000001},{"interface":"front","average":{"1min":2.5550000000000002,"5min":1.8979999999999999,"15min":1.196},"min":{"1min":0.28999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":9.6720000000000006,"5min":9.6720000000000006,"15min":11.093},"last":4.0069999999999997}]},{"osd":5,"last update":"Mon Feb 19 21:42:38 2024","interfaces":[{"interface":"back","average":{"1min":2.032,"5min":1.647,"15min":1.0640000000000001},"min":{"1min":0.29099999999999998,"5min":0.28699999999999998,"15min":0.27100000000000002},"max":{"1min":12.257,"5min":12.257,"15min":12.257},"last":0.60499999999999998},{"interface":"front","average":{"1min":1.829,"5min":2.0600000000000001,"15min":1.2729999999999999},"min":{"1min":0.313,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":6.367,"5min":9.2579999999999991,"15min":11.128},"last":0.35399999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:42:07 2024","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.526,"15min":0.98299999999999998},"min":{"1min":0.36299999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.6579999999999999,"5min":17.443999999999999,"15min":17.443999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":2.3500000000000001,"5min":2.1070000000000002,"15min":1.214},"min":{"1min":0.32900000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":6.7800000000000002,"5min":18.219000000000001,"15min":18.219000000000001},"last":0.99199999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:42:32 2024","interfaces":[{"interface":"back","average":{"1min":2,"5min":2.335,"15min":1.411},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":8.7200000000000006,"5min":45.777999999999999,"15min":45.777999999999999},"last":9.0259999999999998},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.45,"15min":0.997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35099999999999998},"max":{"1min":6.5090000000000003,"5min":6.585,"15min":6.585},"last":0.65700000000000003}]}]},{"osd":4,"up_from":32,"seq":137438953617,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1362280,"kb_used_data":1060960,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":92382872,"statfs":{"total":95995035648,"available":94600060928,"internally_reserved":0,"allocated":1086423040,"data_stored":1086106779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:42:18 2024","interfaces":[{"interface":"back","average":{"1min":1.8340000000000001,"5min":2.0459999999999998,"15min":1.1319999999999999},"min":{"1min":0.249,"5min":0.219,"15min":0.219},"max":{"1min":7.6260000000000003,"5min":40.664000000000001,"15min":40.664000000000001},"last":4.96},{"interface":"front","average":{"1min":2.7360000000000002,"5min":2.2789999999999999,"15min":1.3049999999999999},"min":{"1min":0.33200000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":9.2799999999999994,"5min":41.046999999999997,"15min":41.046999999999997},"last":3.2770000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:42:18 2024","interfaces":[{"interface":"back","average":{"1min":2.0670000000000002,"5min":1.603,"15min":0.92200000000000004},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":7.0039999999999996,"5min":13.254,"15min":13.254},"last":4.8760000000000003},{"interface":"front","average":{"1min":2.1909999999999998,"5min":1.669,"15min":0.97299999999999998},"min":{"1min":0.35999999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":7.593,"5min":15.411,"15min":15.411},"last":3.3090000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:42:18 2024","interfaces":[{"interface":"back","average":{"1min":2.3130000000000002,"5min":1.859,"15min":1.0549999999999999},"min":{"1min":0.42399999999999999,"5min":0.307,"15min":0.27100000000000002},"max":{"1min":7.6459999999999999,"5min":16.788,"15min":16.788},"last":3.419},{"interface":"front","average":{"1min":2.5819999999999999,"5min":2.2589999999999999,"15min":1.2909999999999999},"min":{"1min":0.34899999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":10.398999999999999,"5min":18.452999999999999,"15min":20.995999999999999},"last":1.026}]},{"osd":3,"last update":"Mon Feb 19 21:42:18 2024","interfaces":[{"interface":"back","average":{"1min":3.1709999999999998,"5min":2.2029999999999998,"15min":1.1830000000000001},"min":{"1min":0.36799999999999999,"5min":0.32800000000000001,"15min":0.316},"max":{"1min":10.970000000000001,"5min":15.914999999999999,"15min":15.914999999999999},"last":1},{"interface":"front","average":{"1min":2.2000000000000002,"5min":1.752,"15min":1.046},"min":{"1min":0.32500000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":7.8120000000000003,"5min":13.321,"15min":13.321},"last":4.984}]},{"osd":5,"last update":"Mon Feb 19 21:41:58 2024","interfaces":[{"interface":"back","average":{"1min":2.883,"5min":1.5329999999999999,"15min":0.80300000000000005},"min":{"1min":0.27100000000000002,"5min":0.249,"15min":0.23499999999999999},"max":{"1min":12.33,"5min":12.33,"15min":12.33},"last":3.3959999999999999},{"interface":"front","average":{"1min":3.577,"5min":1.7030000000000001,"15min":0.86899999999999999},"min":{"1min":0.30299999999999999,"5min":0.27300000000000002,"15min":0.26100000000000001},"max":{"1min":14.840999999999999,"5min":14.840999999999999,"15min":14.840999999999999},"last":6.9550000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:42:18 2024","interfaces":[{"interface":"back","average":{"1min":2.4790000000000001,"5min":1.929,"15min":0.96499999999999997},"min":{"1min":0.32900000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":8.5519999999999996,"5min":13.27,"15min":13.27},"last":1.0660000000000001},{"interface":"front","average":{"1min":2.8180000000000001,"5min":1.599,"15min":0.86499999999999999},"min":{"1min":0.311,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":8.3659999999999997,"5min":8.3659999999999997,"15min":8.3659999999999997},"last":3.371}]},{"osd":7,"last update":"Mon Feb 19 21:42:36 2024","interfaces":[{"interface":"back","average":{"1min":3.3010000000000002,"5min":1.7310000000000001,"15min":0.93000000000000005},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.28899999999999998},"max":{"1min":8.9640000000000004,"5min":8.9640000000000004,"15min":8.9640000000000004},"last":3.3399999999999999},{"interface":"front","average":{"1min":2.7519999999999998,"5min":2.1509999999999998,"15min":1.0880000000000001},"min":{"1min":0.33500000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":8.5359999999999996,"5min":10.707000000000001,"15min":10.707000000000001},"last":1.048}]}]},{"osd":5,"up_from":38,"seq":163208757389,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2128960,"kb_used_data":1823160,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":91616192,"statfs":{"total":95995035648,"available":93814980608,"internally_reserved":0,"allocated":1866915840,"data_stored":1866576086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:42:51 2024","interfaces":[{"interface":"back","average":{"1min":1.556,"5min":1.52,"15min":1.1160000000000001},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":4.9820000000000002,"5min":10.044,"15min":20.550999999999998},"last":0.30299999999999999},{"interface":"front","average":{"1min":2.5569999999999999,"5min":1.988,"15min":1.208},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":9.4329999999999998,"5min":9.9390000000000001,"15min":20.879000000000001},"last":0.248}]},{"osd":1,"last update":"Mon Feb 19 21:42:51 2024","interfaces":[{"interface":"back","average":{"1min":2.827,"5min":2.036,"15min":1.145},"min":{"1min":0.28499999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":9.4670000000000005,"5min":10.42,"15min":10.42},"last":0.41999999999999998},{"interface":"front","average":{"1min":1.6739999999999999,"5min":1.6180000000000001,"15min":1.087},"min":{"1min":0.27400000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":6.4880000000000004,"5min":10.021000000000001,"15min":10.316000000000001},"last":1.946}]},{"osd":2,"last update":"Mon Feb 19 21:42:51 2024","interfaces":[{"interface":"back","average":{"1min":2.23,"5min":1.7170000000000001,"15min":1.171},"min":{"1min":0.32100000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":9.2629999999999999,"5min":9.2629999999999999,"15min":20.186},"last":0.49299999999999999},{"interface":"front","average":{"1min":2.3809999999999998,"5min":1.9219999999999999,"15min":1.2330000000000001},"min":{"1min":0.34799999999999998,"5min":0.29899999999999999,"15min":0.23200000000000001},"max":{"1min":9.4909999999999997,"5min":9.4909999999999997,"15min":20.175000000000001},"last":0.39300000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:42:51 2024","interfaces":[{"interface":"back","average":{"1min":2.3450000000000002,"5min":1.9670000000000001,"15min":1.335},"min":{"1min":0.28999999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":9.3629999999999995,"5min":12.021000000000001,"15min":20.146999999999998},"last":3.0699999999999998},{"interface":"front","average":{"1min":3.0379999999999998,"5min":2.339,"15min":1.502},"min":{"1min":0.42199999999999999,"5min":0.36499999999999999,"15min":0.35499999999999998},"max":{"1min":9.5150000000000006,"5min":9.5150000000000006,"15min":20.120000000000001},"last":3.29}]},{"osd":4,"last update":"Mon Feb 19 21:42:51 2024","interfaces":[{"interface":"back","average":{"1min":2.7989999999999999,"5min":1.5229999999999999,"15min":0.81100000000000005},"min":{"1min":0.252,"5min":0.24399999999999999,"15min":0.23999999999999999},"max":{"1min":21.577000000000002,"5min":21.577000000000002,"15min":21.577000000000002},"last":2.9510000000000001},{"interface":"front","average":{"1min":2.5910000000000002,"5min":2.0089999999999999,"15min":0.998},"min":{"1min":0.34699999999999998,"5min":0.26300000000000001,"15min":0.25600000000000001},"max":{"1min":9.3360000000000003,"5min":12.135,"15min":12.135},"last":3.0910000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:42:13 2024","interfaces":[{"interface":"back","average":{"1min":2.4910000000000001,"5min":1.671,"15min":0.87},"min":{"1min":0.32600000000000001,"5min":0.221,"15min":0.221},"max":{"1min":5.9720000000000004,"5min":8.4629999999999992,"15min":8.4629999999999992},"last":3.036},{"interface":"front","average":{"1min":2.6059999999999999,"5min":1.913,"15min":0.97199999999999998},"min":{"1min":0.34799999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":13.532999999999999,"5min":13.532999999999999,"15min":13.532999999999999},"last":0.72299999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:42:43 2024","interfaces":[{"interface":"back","average":{"1min":3.9409999999999998,"5min":2.3940000000000001,"15min":1.1779999999999999},"min":{"1min":0.34200000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":12.962,"5min":12.962,"15min":12.962},"last":5.125},{"interface":"front","average":{"1min":3.8340000000000001,"5min":2.278,"15min":1.115},"min":{"1min":0.42099999999999999,"5min":0.313,"15min":0.29099999999999998},"max":{"1min":12.853999999999999,"5min":17.759,"15min":17.759},"last":5.117}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":2118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1294794752,"data_stored":1294794752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1460408320,"data_stored":1460404248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":943652864,"data_stored":943652864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1080098816,"data_stored":1080098816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1832980480,"data_stored":1832976408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1275400192,"data_stored":1275396120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1327960064,"data_stored":1327955992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:42:59.332 INFO:tasks.thrashosds.thrasher:Setting 2.c to [6, 7, 2] 2024-02-19T21:42:59.332 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '2.c', '6', '7', '2'] 2024-02-19T21:42:59.332 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pg-upmap 2.c 6 7 2 2024-02-19T21:42:59.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:58.072587+0000 mon.a (mon.0) 1137 : cluster [DBG] osdmap e220: 8 total, 8 up, 7 in 2024-02-19T21:42:59.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:42:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:59.017544+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "27"}]: dispatch 2024-02-19T21:42:59.755 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:42:59.759 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:59.760 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:42:59.860 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:42:59.915 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:42:59.970 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:42:59.982 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:42:59.983 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:43:00.084 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:43:00.125 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:00.149 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:43:00.298 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:59.016273+0000 mgr.y (mgr.14514) 400 : cluster [DBG] pgmap v456: 144 pgs: 2 active+remapped+backfilling, 142 active+clean; 2.7 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1019 B/s rd, 0 B/s wr, 1.01k op/s; 4750/133989 objects misplaced (3.545%); 1.4 MiB/s, 21 objects/s recovering 2024-02-19T21:43:00.298 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:42:59.092770+0000 mon.a (mon.0) 1139 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "27"}]': finished 2024-02-19T21:43:00.298 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:42:59.092827+0000 mon.a (mon.0) 1140 : cluster [DBG] osdmap e221: 8 total, 8 up, 7 in 2024-02-19T21:43:00.299 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:59.016273+0000 mgr.y (mgr.14514) 400 : cluster [DBG] pgmap v456: 144 pgs: 2 active+remapped+backfilling, 142 active+clean; 2.7 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1019 B/s rd, 0 B/s wr, 1.01k op/s; 4750/133989 objects misplaced (3.545%); 1.4 MiB/s, 21 objects/s recovering 2024-02-19T21:43:00.299 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:42:59.092770+0000 mon.a (mon.0) 1139 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "27"}]': finished 2024-02-19T21:43:00.299 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:42:59.092827+0000 mon.a (mon.0) 1140 : cluster [DBG] osdmap e221: 8 total, 8 up, 7 in 2024-02-19T21:43:00.426 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:59.016273+0000 mgr.y (mgr.14514) 400 : cluster [DBG] pgmap v456: 144 pgs: 2 active+remapped+backfilling, 142 active+clean; 2.7 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1019 B/s rd, 0 B/s wr, 1.01k op/s; 4750/133989 objects misplaced (3.545%); 1.4 MiB/s, 21 objects/s recovering 2024-02-19T21:43:00.426 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:42:59.092770+0000 mon.a (mon.0) 1139 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "27"}]': finished 2024-02-19T21:43:00.426 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:42:59.092827+0000 mon.a (mon.0) 1140 : cluster [DBG] osdmap e221: 8 total, 8 up, 7 in 2024-02-19T21:43:00.426 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:43:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:43:00.777 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:43:00.780 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:00.781 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:43:00.881 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:43:00.923 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:00.966 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:43:00.970 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:00.970 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:43:01.071 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:43:01.096 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:43:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:43:00] "GET /metrics HTTP/1.1" 200 175931 "" "Prometheus/2.33.4" 2024-02-19T21:43:01.100 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:01.119 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:43:01.122 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:01.122 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:43:01.223 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:43:01.273 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:01.308 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:01.308 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:43:01.309 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:43:01.409 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:43:01.453 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:00.158550+0000 mon.a (mon.0) 1141 : cluster [DBG] osdmap e222: 8 total, 8 up, 7 in 2024-02-19T21:43:01.454 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:00.426433+0000 mgr.y (mgr.14514) 401 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:43:01.455 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:01.505 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:43:01.510 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:01.510 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:43:01.524 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:00.158550+0000 mon.a (mon.0) 1141 : cluster [DBG] osdmap e222: 8 total, 8 up, 7 in 2024-02-19T21:43:01.524 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:00.426433+0000 mgr.y (mgr.14514) 401 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:43:01.525 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:00.158550+0000 mon.a (mon.0) 1141 : cluster [DBG] osdmap e222: 8 total, 8 up, 7 in 2024-02-19T21:43:01.525 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:00.426433+0000 mgr.y (mgr.14514) 401 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:43:01.529 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:43:01.611 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:43:01.673 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:01.708 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:43:01.711 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:01.712 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:43:01.813 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:43:01.863 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:01.896 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:43:01.902 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:01.903 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:43:02.004 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:43:02.047 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:02.094 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:43:02.101 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:02.102 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:43:02.203 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:43:02.218 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-02-19T21:43:02.267 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:02.299 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:43:02.304 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:02.305 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:43:02.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:01.016661+0000 mgr.y (mgr.14514) 402 : cluster [DBG] pgmap v459: 144 pgs: 2 peering, 2 active+remapped+backfilling, 140 active+clean; 2.4 GiB data, 9.8 GiB used, 616 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.24k op/s; 4123/119079 objects misplaced (3.462%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:02.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:01.183251+0000 mon.a (mon.0) 1142 : cluster [DBG] osdmap e223: 8 total, 8 up, 7 in 2024-02-19T21:43:02.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:01.368677+0000 mon.a (mon.0) 1143 : audit [INF] from='client.? 172.21.15.80:0/1924043362' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:43:02.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:01.016661+0000 mgr.y (mgr.14514) 402 : cluster [DBG] pgmap v459: 144 pgs: 2 peering, 2 active+remapped+backfilling, 140 active+clean; 2.4 GiB data, 9.8 GiB used, 616 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.24k op/s; 4123/119079 objects misplaced (3.462%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:02.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:01.183251+0000 mon.a (mon.0) 1142 : cluster [DBG] osdmap e223: 8 total, 8 up, 7 in 2024-02-19T21:43:02.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:01.368677+0000 mon.a (mon.0) 1143 : audit [INF] from='client.? 172.21.15.80:0/1924043362' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:43:02.406 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:43:02.446 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:02.527 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:43:02.532 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:02.533 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:43:02.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:01.016661+0000 mgr.y (mgr.14514) 402 : cluster [DBG] pgmap v459: 144 pgs: 2 peering, 2 active+remapped+backfilling, 140 active+clean; 2.4 GiB data, 9.8 GiB used, 616 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.24k op/s; 4123/119079 objects misplaced (3.462%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:02.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:01.183251+0000 mon.a (mon.0) 1142 : cluster [DBG] osdmap e223: 8 total, 8 up, 7 in 2024-02-19T21:43:02.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:01.368677+0000 mon.a (mon.0) 1143 : audit [INF] from='client.? 172.21.15.80:0/1924043362' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:43:02.634 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:43:02.688 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:02.836 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:43:02.843 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:02.844 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:43:02.879 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:43:02.879 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-02-19T21:43:02.879 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-02-19T21:43:02.879 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:43:02.944 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:43:03.016 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:03.047 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:43:03.055 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:03.055 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:43:03.156 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:43:03.206 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:03.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:02.181069+0000 mon.a (mon.0) 1144 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:43:03.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:02.190021+0000 mon.a (mon.0) 1145 : audit [INF] from='client.? 172.21.15.80:0/1924043362' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:43:03.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:02.190076+0000 mon.a (mon.0) 1146 : cluster [DBG] osdmap e224: 8 total, 8 up, 7 in 2024-02-19T21:43:03.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:03.018208+0000 mon.a (mon.0) 1147 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "26"}]: dispatch 2024-02-19T21:43:03.431 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:43:03.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:02.181069+0000 mon.a (mon.0) 1144 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:43:03.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:02.190021+0000 mon.a (mon.0) 1145 : audit [INF] from='client.? 172.21.15.80:0/1924043362' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:43:03.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:02.190076+0000 mon.a (mon.0) 1146 : cluster [DBG] osdmap e224: 8 total, 8 up, 7 in 2024-02-19T21:43:03.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:03.018208+0000 mon.a (mon.0) 1147 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "26"}]: dispatch 2024-02-19T21:43:03.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:02.181069+0000 mon.a (mon.0) 1144 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:43:03.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:02.190021+0000 mon.a (mon.0) 1145 : audit [INF] from='client.? 172.21.15.80:0/1924043362' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:43:03.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:02.190076+0000 mon.a (mon.0) 1146 : cluster [DBG] osdmap e224: 8 total, 8 up, 7 in 2024-02-19T21:43:03.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:03.018208+0000 mon.a (mon.0) 1147 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "26"}]: dispatch 2024-02-19T21:43:03.774 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:43:03.778 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:03.779 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:43:03.879 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:43:03.920 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:04.213 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:43:04.219 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:04.220 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:43:04.321 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:43:04.358 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:04.562 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:43:04.562 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:03.017060+0000 mgr.y (mgr.14514) 403 : cluster [DBG] pgmap v462: 143 pgs: 1 peering, 2 active+remapped+backfilling, 140 active+clean; 2.4 GiB data, 9.8 GiB used, 616 GiB / 626 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1.24k op/s; 4123/119079 objects misplaced (3.462%); 1.7 MiB/s, 28 objects/s recovering 2024-02-19T21:43:04.562 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:03.205804+0000 mon.a (mon.0) 1148 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "26"}]': finished 2024-02-19T21:43:04.562 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:03.205857+0000 mon.a (mon.0) 1149 : cluster [DBG] osdmap e225: 8 total, 8 up, 7 in 2024-02-19T21:43:04.568 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:04.569 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:43:04.569 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:03.017060+0000 mgr.y (mgr.14514) 403 : cluster [DBG] pgmap v462: 143 pgs: 1 peering, 2 active+remapped+backfilling, 140 active+clean; 2.4 GiB data, 9.8 GiB used, 616 GiB / 626 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1.24k op/s; 4123/119079 objects misplaced (3.462%); 1.7 MiB/s, 28 objects/s recovering 2024-02-19T21:43:04.569 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:03.205804+0000 mon.a (mon.0) 1148 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "26"}]': finished 2024-02-19T21:43:04.569 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:03.205857+0000 mon.a (mon.0) 1149 : cluster [DBG] osdmap e225: 8 total, 8 up, 7 in 2024-02-19T21:43:04.569 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:03.017060+0000 mgr.y (mgr.14514) 403 : cluster [DBG] pgmap v462: 143 pgs: 1 peering, 2 active+remapped+backfilling, 140 active+clean; 2.4 GiB data, 9.8 GiB used, 616 GiB / 626 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1.24k op/s; 4123/119079 objects misplaced (3.462%); 1.7 MiB/s, 28 objects/s recovering 2024-02-19T21:43:04.569 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:03.205804+0000 mon.a (mon.0) 1148 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "26"}]': finished 2024-02-19T21:43:04.569 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:03.205857+0000 mon.a (mon.0) 1149 : cluster [DBG] osdmap e225: 8 total, 8 up, 7 in 2024-02-19T21:43:04.670 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:43:04.744 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:04.779 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:43:04.783 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:04.783 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:43:04.884 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.2 dump_blocked_ops 2024-02-19T21:43:04.884 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:43:04.933 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:04.965 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:43:04.971 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:04.972 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:43:05.073 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:43:05.124 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:05.151 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:43:05.155 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:05.156 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:43:05.255 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:04.242127+0000 mon.a (mon.0) 1150 : cluster [DBG] osdmap e226: 8 total, 8 up, 7 in 2024-02-19T21:43:05.256 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:04.242127+0000 mon.a (mon.0) 1150 : cluster [DBG] osdmap e226: 8 total, 8 up, 7 in 2024-02-19T21:43:05.257 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:43:05.303 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:05.335 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:43:05.346 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:05.347 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:43:05.448 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:43:05.514 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:04.242127+0000 mon.a (mon.0) 1150 : cluster [DBG] osdmap e226: 8 total, 8 up, 7 in 2024-02-19T21:43:05.532 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:05.561 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:43:05.563 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:05.564 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:43:05.664 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:43:05.718 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:05.748 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:43:05.754 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:05.754 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:43:05.807 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:43:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:43:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:43:05.856 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:43:05.937 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:05.967 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:43:05.972 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:05.972 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:43:05.976 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:43:06.073 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:43:06.120 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:06.244 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset noscrub 2024-02-19T21:43:06.254 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:05.017824+0000 mgr.y (mgr.14514) 404 : cluster [DBG] pgmap v465: 143 pgs: 2 clean+premerge+peered, 1 peering, 2 active+remapped+backfilling, 138 active+clean; 2.2 GiB data, 9.1 GiB used, 617 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 847 op/s; 3463/108918 objects misplaced (3.179%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:06.254 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:05.251348+0000 mon.a (mon.0) 1151 : cluster [DBG] osdmap e227: 8 total, 8 up, 7 in 2024-02-19T21:43:06.255 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:05.435270+0000 mon.a (mon.0) 1152 : audit [INF] from='client.? 172.21.15.80:0/643393635' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "2.c", "id": [6, 7, 2]}]: dispatch 2024-02-19T21:43:06.255 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:05.502873+0000 osd.2 (osd.2) 119 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:43:06.258 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:43:06.265 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:06.266 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:43:06.286 INFO:teuthology.orchestra.run.smithi080.stderr:set 2.c pg_upmap mapping to [6,7,2] 2024-02-19T21:43:06.367 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:43:06.399 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:05.017824+0000 mgr.y (mgr.14514) 404 : cluster [DBG] pgmap v465: 143 pgs: 2 clean+premerge+peered, 1 peering, 2 active+remapped+backfilling, 138 active+clean; 2.2 GiB data, 9.1 GiB used, 617 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 847 op/s; 3463/108918 objects misplaced (3.179%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:06.399 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:05.251348+0000 mon.a (mon.0) 1151 : cluster [DBG] osdmap e227: 8 total, 8 up, 7 in 2024-02-19T21:43:06.399 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:05.435270+0000 mon.a (mon.0) 1152 : audit [INF] from='client.? 172.21.15.80:0/643393635' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "2.c", "id": [6, 7, 2]}]: dispatch 2024-02-19T21:43:06.400 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:05.502873+0000 osd.2 (osd.2) 119 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:43:06.400 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:05.502935+0000 osd.2 (osd.2) 120 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:43:06.400 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:05.017824+0000 mgr.y (mgr.14514) 404 : cluster [DBG] pgmap v465: 143 pgs: 2 clean+premerge+peered, 1 peering, 2 active+remapped+backfilling, 138 active+clean; 2.2 GiB data, 9.1 GiB used, 617 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 847 op/s; 3463/108918 objects misplaced (3.179%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:06.400 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:05.251348+0000 mon.a (mon.0) 1151 : cluster [DBG] osdmap e227: 8 total, 8 up, 7 in 2024-02-19T21:43:06.400 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:05.435270+0000 mon.a (mon.0) 1152 : audit [INF] from='client.? 172.21.15.80:0/643393635' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "2.c", "id": [6, 7, 2]}]: dispatch 2024-02-19T21:43:06.400 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:05.502873+0000 osd.2 (osd.2) 119 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:43:06.400 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:05.502935+0000 osd.2 (osd.2) 120 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:43:06.419 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:06.453 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:43:06.461 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:06.461 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:43:06.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:05.502935+0000 osd.2 (osd.2) 120 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:43:06.562 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:43:06.627 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:06.665 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:43:06.675 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:06.676 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:43:06.777 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:43:06.838 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:06.876 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:43:06.881 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:06.882 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:43:06.983 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:43:07.037 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:07.095 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:43:07.100 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:07.101 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:43:07.201 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:43:07.241 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:07.293 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:06.264212+0000 mon.a (mon.0) 1153 : audit [INF] from='client.? 172.21.15.80:0/643393635' entity='client.admin' cmd='[{"prefix": "osd pg-upmap", "pgid": "2.c", "id": [6, 7, 2]}]': finished 2024-02-19T21:43:07.294 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:06.264269+0000 mon.a (mon.0) 1154 : cluster [DBG] osdmap e228: 8 total, 8 up, 7 in 2024-02-19T21:43:07.294 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:07.018972+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "25"}]: dispatch 2024-02-19T21:43:07.584 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:06.264212+0000 mon.a (mon.0) 1153 : audit [INF] from='client.? 172.21.15.80:0/643393635' entity='client.admin' cmd='[{"prefix": "osd pg-upmap", "pgid": "2.c", "id": [6, 7, 2]}]': finished 2024-02-19T21:43:07.584 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:06.264269+0000 mon.a (mon.0) 1154 : cluster [DBG] osdmap e228: 8 total, 8 up, 7 in 2024-02-19T21:43:07.584 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:07.018972+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "25"}]: dispatch 2024-02-19T21:43:07.584 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:06.264212+0000 mon.a (mon.0) 1153 : audit [INF] from='client.? 172.21.15.80:0/643393635' entity='client.admin' cmd='[{"prefix": "osd pg-upmap", "pgid": "2.c", "id": [6, 7, 2]}]': finished 2024-02-19T21:43:07.584 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:06.264269+0000 mon.a (mon.0) 1154 : cluster [DBG] osdmap e228: 8 total, 8 up, 7 in 2024-02-19T21:43:07.584 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:07.018972+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "25"}]: dispatch 2024-02-19T21:43:07.604 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:43:07.608 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:07.608 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:43:07.709 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:43:07.768 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:07.800 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:43:07.805 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:07.806 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:43:07.906 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:43:07.978 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:08.005 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:43:08.011 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:08.011 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:43:08.112 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:43:08.148 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:08.185 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:43:08.190 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:08.191 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:43:08.292 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:43:08.343 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:08.482 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:07.018198+0000 mgr.y (mgr.14514) 405 : cluster [DBG] pgmap v468: 142 pgs: 1 clean+premerge+peered, 2 active+remapped+backfilling, 139 active+clean; 2.1 GiB data, 8.9 GiB used, 617 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.25k op/s; 3463/104136 objects misplaced (3.325%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:08.483 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:07.273058+0000 mon.a (mon.0) 1156 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "25"}]': finished 2024-02-19T21:43:08.483 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:07.273137+0000 mon.a (mon.0) 1157 : cluster [DBG] osdmap e229: 8 total, 8 up, 7 in 2024-02-19T21:43:08.483 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:08.030625+0000 osd.0 (osd.0) 170 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:43:08.483 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:08.030669+0000 osd.0 (osd.0) 171 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:43:08.483 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:07.018198+0000 mgr.y (mgr.14514) 405 : cluster [DBG] pgmap v468: 142 pgs: 1 clean+premerge+peered, 2 active+remapped+backfilling, 139 active+clean; 2.1 GiB data, 8.9 GiB used, 617 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.25k op/s; 3463/104136 objects misplaced (3.325%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:08.483 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:07.273058+0000 mon.a (mon.0) 1156 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "25"}]': finished 2024-02-19T21:43:08.483 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:07.273137+0000 mon.a (mon.0) 1157 : cluster [DBG] osdmap e229: 8 total, 8 up, 7 in 2024-02-19T21:43:08.483 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:08.030625+0000 osd.0 (osd.0) 170 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:43:08.484 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:08.030669+0000 osd.0 (osd.0) 171 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:43:08.553 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:43:08.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:07.018198+0000 mgr.y (mgr.14514) 405 : cluster [DBG] pgmap v468: 142 pgs: 1 clean+premerge+peered, 2 active+remapped+backfilling, 139 active+clean; 2.1 GiB data, 8.9 GiB used, 617 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.25k op/s; 3463/104136 objects misplaced (3.325%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:08.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:07.273058+0000 mon.a (mon.0) 1156 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "25"}]': finished 2024-02-19T21:43:08.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:07.273137+0000 mon.a (mon.0) 1157 : cluster [DBG] osdmap e229: 8 total, 8 up, 7 in 2024-02-19T21:43:08.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:08.030625+0000 osd.0 (osd.0) 170 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:43:08.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:08.030669+0000 osd.0 (osd.0) 171 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:43:08.560 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:08.560 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:43:08.661 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:43:08.727 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:08.785 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:43:08.785 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-02-19T21:43:08.785 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-02-19T21:43:08.786 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-02-19T21:43:08.786 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:43:08.984 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:43:08.995 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:08.995 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:43:09.096 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:43:09.104 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:43:09.104 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:43:09.104 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:43:09.104 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:43:09.104 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:43:09.104 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:43:09.104 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:43:09.104 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:43:09.104 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:43:09.105 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:43:09.105 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:43:09.105 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:43:09.105 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:43:09.105 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:43:09.105 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:43:09.105 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:43:09.139 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:09.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:08.295375+0000 mon.a (mon.0) 1158 : cluster [DBG] osdmap e230: 8 total, 8 up, 7 in 2024-02-19T21:43:09.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:08.833718+0000 mon.c (mon.2) 52 : audit [DBG] from='client.? 172.21.15.80:0/1612303278' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:43:09.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:08.295375+0000 mon.a (mon.0) 1158 : cluster [DBG] osdmap e230: 8 total, 8 up, 7 in 2024-02-19T21:43:09.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:08.833718+0000 mon.c (mon.2) 52 : audit [DBG] from='client.? 172.21.15.80:0/1612303278' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:43:09.705 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:43:09.711 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:09.712 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:43:09.742 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.2 dump_historic_ops 2024-02-19T21:43:09.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:08.295375+0000 mon.a (mon.0) 1158 : cluster [DBG] osdmap e230: 8 total, 8 up, 7 in 2024-02-19T21:43:09.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:08.833718+0000 mon.c (mon.2) 52 : audit [DBG] from='client.? 172.21.15.80:0/1612303278' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:43:09.813 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:43:09.875 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:10.136 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:43:10.141 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:10.141 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:43:10.242 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:43:10.299 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:10.546 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:09.018630+0000 mgr.y (mgr.14514) 406 : cluster [DBG] pgmap v471: 142 pgs: 1 clean+premerge+peered, 2 active+remapped+backfilling, 139 active+clean; 2.1 GiB data, 8.9 GiB used, 617 GiB / 626 GiB avail; 0 B/s wr, 398 op/s; 3463/104136 objects misplaced (3.325%) 2024-02-19T21:43:10.546 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:09.312135+0000 mon.a (mon.0) 1159 : cluster [DBG] osdmap e231: 8 total, 8 up, 7 in 2024-02-19T21:43:10.546 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:09.733154+0000 osd.3 (osd.3) 170 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:43:10.546 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:09.733223+0000 osd.3 (osd.3) 171 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:43:10.547 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:09.018630+0000 mgr.y (mgr.14514) 406 : cluster [DBG] pgmap v471: 142 pgs: 1 clean+premerge+peered, 2 active+remapped+backfilling, 139 active+clean; 2.1 GiB data, 8.9 GiB used, 617 GiB / 626 GiB avail; 0 B/s wr, 398 op/s; 3463/104136 objects misplaced (3.325%) 2024-02-19T21:43:10.547 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:09.312135+0000 mon.a (mon.0) 1159 : cluster [DBG] osdmap e231: 8 total, 8 up, 7 in 2024-02-19T21:43:10.547 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:09.733154+0000 osd.3 (osd.3) 170 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:43:10.547 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:09.733223+0000 osd.3 (osd.3) 171 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:43:10.567 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:43:10.574 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:10.574 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:43:10.675 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:43:10.710 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:10.807 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:43:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:43:10.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:09.018630+0000 mgr.y (mgr.14514) 406 : cluster [DBG] pgmap v471: 142 pgs: 1 clean+premerge+peered, 2 active+remapped+backfilling, 139 active+clean; 2.1 GiB data, 8.9 GiB used, 617 GiB / 626 GiB avail; 0 B/s wr, 398 op/s; 3463/104136 objects misplaced (3.325%) 2024-02-19T21:43:10.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:09.312135+0000 mon.a (mon.0) 1159 : cluster [DBG] osdmap e231: 8 total, 8 up, 7 in 2024-02-19T21:43:10.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:09.733154+0000 osd.3 (osd.3) 170 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:43:10.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:09.733223+0000 osd.3 (osd.3) 171 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:43:10.846 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:43:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:43:10] "GET /metrics HTTP/1.1" 200 175950 "" "Prometheus/2.33.4" 2024-02-19T21:43:11.029 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:43:11.071 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:43:11.075 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:11.075 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:43:11.176 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:43:11.223 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:11.337 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:43:11.339 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:11.340 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:43:11.441 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:43:11.476 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:11.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:10.321114+0000 mon.a (mon.0) 1160 : cluster [DBG] osdmap e232: 8 total, 8 up, 7 in 2024-02-19T21:43:11.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:10.442541+0000 mgr.y (mgr.14514) 407 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:43:11.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:10.886730+0000 osd.1 (osd.1) 155 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:43:11.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:10.886774+0000 osd.1 (osd.1) 156 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:43:11.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:11.020152+0000 mon.a (mon.0) 1161 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "24"}]: dispatch 2024-02-19T21:43:11.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:10.321114+0000 mon.a (mon.0) 1160 : cluster [DBG] osdmap e232: 8 total, 8 up, 7 in 2024-02-19T21:43:11.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:10.442541+0000 mgr.y (mgr.14514) 407 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:43:11.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:10.886730+0000 osd.1 (osd.1) 155 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:43:11.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:10.886774+0000 osd.1 (osd.1) 156 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:43:11.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:11.020152+0000 mon.a (mon.0) 1161 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "24"}]: dispatch 2024-02-19T21:43:11.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:10.321114+0000 mon.a (mon.0) 1160 : cluster [DBG] osdmap e232: 8 total, 8 up, 7 in 2024-02-19T21:43:11.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:10.442541+0000 mgr.y (mgr.14514) 407 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:43:11.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:10.886730+0000 osd.1 (osd.1) 155 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:43:11.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:10.886774+0000 osd.1 (osd.1) 156 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:43:11.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:11.020152+0000 mon.a (mon.0) 1161 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "24"}]: dispatch 2024-02-19T21:43:12.355 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:43:12.675 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:11.018999+0000 mgr.y (mgr.14514) 408 : cluster [DBG] pgmap v474: 141 pgs: 1 peering, 2 active+remapped+backfilling, 138 active+clean; 1.8 GiB data, 7.9 GiB used, 618 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.23k op/s; 2900/89355 objects misplaced (3.245%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:12.675 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:11.364757+0000 mon.a (mon.0) 1162 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "24"}]': finished 2024-02-19T21:43:12.675 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:11.364820+0000 mon.a (mon.0) 1163 : cluster [DBG] osdmap e233: 8 total, 8 up, 7 in 2024-02-19T21:43:12.676 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:11.018999+0000 mgr.y (mgr.14514) 408 : cluster [DBG] pgmap v474: 141 pgs: 1 peering, 2 active+remapped+backfilling, 138 active+clean; 1.8 GiB data, 7.9 GiB used, 618 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.23k op/s; 2900/89355 objects misplaced (3.245%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:12.676 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:11.364757+0000 mon.a (mon.0) 1162 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "24"}]': finished 2024-02-19T21:43:12.676 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:11.364820+0000 mon.a (mon.0) 1163 : cluster [DBG] osdmap e233: 8 total, 8 up, 7 in 2024-02-19T21:43:12.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:11.018999+0000 mgr.y (mgr.14514) 408 : cluster [DBG] pgmap v474: 141 pgs: 1 peering, 2 active+remapped+backfilling, 138 active+clean; 1.8 GiB data, 7.9 GiB used, 618 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.23k op/s; 2900/89355 objects misplaced (3.245%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:12.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:11.364757+0000 mon.a (mon.0) 1162 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "24"}]': finished 2024-02-19T21:43:12.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:11.364820+0000 mon.a (mon.0) 1163 : cluster [DBG] osdmap e233: 8 total, 8 up, 7 in 2024-02-19T21:43:13.060 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:43:13.386 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:12.379277+0000 mon.a (mon.0) 1164 : cluster [DBG] osdmap e234: 8 total, 8 up, 7 in 2024-02-19T21:43:13.546 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:43:13.550 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:13.550 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:43:13.651 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:43:13.694 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:12.379277+0000 mon.a (mon.0) 1164 : cluster [DBG] osdmap e234: 8 total, 8 up, 7 in 2024-02-19T21:43:13.694 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:13.739 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:43:13.751 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:13.752 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:43:13.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:12.379277+0000 mon.a (mon.0) 1164 : cluster [DBG] osdmap e234: 8 total, 8 up, 7 in 2024-02-19T21:43:13.853 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:43:13.892 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:14.138 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:43:14.148 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:43:14.154 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:14.154 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:43:14.255 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:43:14.310 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:14.349 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:43:14.352 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:14.353 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:43:14.411 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:13.019399+0000 mgr.y (mgr.14514) 409 : cluster [DBG] pgmap v477: 141 pgs: 1 peering, 2 active+remapped+backfilling, 138 active+clean; 1.8 GiB data, 7.9 GiB used, 618 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.23k op/s; 2900/89355 objects misplaced (3.245%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:14.412 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:13.387508+0000 mon.a (mon.0) 1165 : cluster [DBG] osdmap e235: 8 total, 8 up, 7 in 2024-02-19T21:43:14.412 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:13.447587+0000 mon.c (mon.2) 53 : audit [INF] from='client.? 172.21.15.80:0/2684478103' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:43:14.412 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:13.447994+0000 mon.a (mon.0) 1166 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:43:14.412 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:13.019399+0000 mgr.y (mgr.14514) 409 : cluster [DBG] pgmap v477: 141 pgs: 1 peering, 2 active+remapped+backfilling, 138 active+clean; 1.8 GiB data, 7.9 GiB used, 618 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.23k op/s; 2900/89355 objects misplaced (3.245%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:14.412 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:13.387508+0000 mon.a (mon.0) 1165 : cluster [DBG] osdmap e235: 8 total, 8 up, 7 in 2024-02-19T21:43:14.413 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-02-19T21:43:14.453 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:43:14.501 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:14.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:13.019399+0000 mgr.y (mgr.14514) 409 : cluster [DBG] pgmap v477: 141 pgs: 1 peering, 2 active+remapped+backfilling, 138 active+clean; 1.8 GiB data, 7.9 GiB used, 618 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.23k op/s; 2900/89355 objects misplaced (3.245%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:14.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:13.387508+0000 mon.a (mon.0) 1165 : cluster [DBG] osdmap e235: 8 total, 8 up, 7 in 2024-02-19T21:43:14.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:13.447587+0000 mon.c (mon.2) 53 : audit [INF] from='client.? 172.21.15.80:0/2684478103' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:43:14.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:13.447994+0000 mon.a (mon.0) 1166 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:43:14.824 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:13.447587+0000 mon.c (mon.2) 53 : audit [INF] from='client.? 172.21.15.80:0/2684478103' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:43:14.824 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:13.447994+0000 mon.a (mon.0) 1166 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:43:15.579 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 6, 7] out_osds: [2] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:43:15.579 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:43:15.580 INFO:tasks.thrashosds.thrasher:Shrinking pool iscsi 2024-02-19T21:43:15.580 INFO:tasks.cephadm.ceph_manager.ceph:contract_pool iscsi by 10 min 8 2024-02-19T21:43:15.580 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:43:15.764 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:43:15.768 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:15.768 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:14.383216+0000 mon.a (mon.0) 1167 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:43:15.769 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:14.393482+0000 mon.a (mon.0) 1168 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:43:15.769 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:14.393585+0000 mon.a (mon.0) 1169 : cluster [DBG] osdmap e236: 8 total, 8 up, 7 in 2024-02-19T21:43:15.769 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:15.026468+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "23"}]: dispatch 2024-02-19T21:43:15.769 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:15.085081+0000 mon.a (mon.0) 1171 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "23"}]': finished 2024-02-19T21:43:15.769 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:15.085151+0000 mon.a (mon.0) 1172 : cluster [DBG] osdmap e237: 8 total, 8 up, 7 in 2024-02-19T21:43:15.769 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:14.383216+0000 mon.a (mon.0) 1167 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:43:15.769 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:14.393482+0000 mon.a (mon.0) 1168 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:43:15.770 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:14.393585+0000 mon.a (mon.0) 1169 : cluster [DBG] osdmap e236: 8 total, 8 up, 7 in 2024-02-19T21:43:15.770 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:15.026468+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "23"}]: dispatch 2024-02-19T21:43:15.770 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:15.085081+0000 mon.a (mon.0) 1171 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "23"}]': finished 2024-02-19T21:43:15.770 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:15.085151+0000 mon.a (mon.0) 1172 : cluster [DBG] osdmap e237: 8 total, 8 up, 7 in 2024-02-19T21:43:15.770 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:43:15.806 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:43:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:43:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:43:15.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:14.383216+0000 mon.a (mon.0) 1167 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:43:15.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:14.393482+0000 mon.a (mon.0) 1168 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:43:15.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:14.393585+0000 mon.a (mon.0) 1169 : cluster [DBG] osdmap e236: 8 total, 8 up, 7 in 2024-02-19T21:43:15.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:15.026468+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "23"}]: dispatch 2024-02-19T21:43:15.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:15.085081+0000 mon.a (mon.0) 1171 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "23"}]': finished 2024-02-19T21:43:15.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:15.085151+0000 mon.a (mon.0) 1172 : cluster [DBG] osdmap e237: 8 total, 8 up, 7 in 2024-02-19T21:43:15.871 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:43:15.942 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:15.963 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:43:15.965 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:15.965 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:43:16.066 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:43:16.125 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:16.153 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:43:16.158 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:16.158 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:43:16.259 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:43:16.324 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:16.360 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:43:16.367 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:16.367 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:43:16.468 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:43:16.505 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:16.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:15.025184+0000 mgr.y (mgr.14514) 410 : cluster [DBG] pgmap v480: 140 pgs: 1 peering, 2 active+remapped+backfilling, 137 active+clean; 1.6 GiB data, 7.3 GiB used, 619 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 870 op/s; 2302/78903 objects misplaced (2.918%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:16.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:15.157667+0000 osd.6 (osd.6) 144 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:43:16.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:15.157718+0000 osd.6 (osd.6) 145 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:43:16.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:15.385591+0000 osd.4 (osd.4) 134 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:43:16.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:15.385645+0000 osd.4 (osd.4) 135 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:43:16.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:16.093436+0000 mon.a (mon.0) 1173 : cluster [DBG] osdmap e238: 8 total, 8 up, 7 in 2024-02-19T21:43:16.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:15.025184+0000 mgr.y (mgr.14514) 410 : cluster [DBG] pgmap v480: 140 pgs: 1 peering, 2 active+remapped+backfilling, 137 active+clean; 1.6 GiB data, 7.3 GiB used, 619 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 870 op/s; 2302/78903 objects misplaced (2.918%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:16.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:15.157667+0000 osd.6 (osd.6) 144 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:43:16.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:15.157718+0000 osd.6 (osd.6) 145 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:43:16.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:15.385591+0000 osd.4 (osd.4) 134 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:43:16.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:15.385645+0000 osd.4 (osd.4) 135 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:43:16.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:16.093436+0000 mon.a (mon.0) 1173 : cluster [DBG] osdmap e238: 8 total, 8 up, 7 in 2024-02-19T21:43:16.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:15.025184+0000 mgr.y (mgr.14514) 410 : cluster [DBG] pgmap v480: 140 pgs: 1 peering, 2 active+remapped+backfilling, 137 active+clean; 1.6 GiB data, 7.3 GiB used, 619 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 870 op/s; 2302/78903 objects misplaced (2.918%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:16.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:15.157667+0000 osd.6 (osd.6) 144 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:43:16.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:15.157718+0000 osd.6 (osd.6) 145 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:43:16.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:15.385591+0000 osd.4 (osd.4) 134 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:43:16.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:15.385645+0000 osd.4 (osd.4) 135 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:43:16.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:16.093436+0000 mon.a (mon.0) 1173 : cluster [DBG] osdmap e238: 8 total, 8 up, 7 in 2024-02-19T21:43:17.064 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:43:17.065 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:43:17.901 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:43:17.905 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:17.905 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:43:17.921 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.3 dump_ops_in_flight 2024-02-19T21:43:18.006 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:43:18.066 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:18.182 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:43:18.189 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:18.190 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:17.027150+0000 mgr.y (mgr.14514) 411 : cluster [DBG] pgmap v483: 140 pgs: 2 active+remapped+backfilling, 138 active+clean; 1.5 GiB data, 7.0 GiB used, 619 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.26k op/s; 2302/74175 objects misplaced (3.103%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:18.190 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:17.104160+0000 mon.a (mon.0) 1174 : cluster [DBG] osdmap e239: 8 total, 8 up, 7 in 2024-02-19T21:43:18.190 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:17.027150+0000 mgr.y (mgr.14514) 411 : cluster [DBG] pgmap v483: 140 pgs: 2 active+remapped+backfilling, 138 active+clean; 1.5 GiB data, 7.0 GiB used, 619 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.26k op/s; 2302/74175 objects misplaced (3.103%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:18.190 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:17.104160+0000 mon.a (mon.0) 1174 : cluster [DBG] osdmap e239: 8 total, 8 up, 7 in 2024-02-19T21:43:18.191 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:43:18.292 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:43:18.354 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-19T21:43:18.365 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:18.404 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:43:18.408 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:17.027150+0000 mgr.y (mgr.14514) 411 : cluster [DBG] pgmap v483: 140 pgs: 2 active+remapped+backfilling, 138 active+clean; 1.5 GiB data, 7.0 GiB used, 619 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.26k op/s; 2302/74175 objects misplaced (3.103%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:18.408 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:17.104160+0000 mon.a (mon.0) 1174 : cluster [DBG] osdmap e239: 8 total, 8 up, 7 in 2024-02-19T21:43:18.409 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:18.409 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:43:18.503 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:43:18.509 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:43:18.584 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:43:18.606 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:18.621 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:43:18.668 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:43:18.701 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:43:18.733 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:43:18.757 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:43:18.796 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:43:18.829 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:43:18.835 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:18.836 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:43:18.843 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:43:18.857 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:43:18.857 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:43:18.857 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:43:18.857 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:43:18.857 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:43:18.857 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:43:18.857 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:43:18.858 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:43:18.936 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:43:18.983 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:19.146 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:18.115350+0000 mon.a (mon.0) 1175 : cluster [DBG] osdmap e240: 8 total, 8 up, 7 in 2024-02-19T21:43:19.146 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:18.528198+0000 mon.c (mon.2) 54 : audit [DBG] from='client.? 172.21.15.80:0/2288085109' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:43:19.146 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:19.028437+0000 mon.a (mon.0) 1176 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "22"}]: dispatch 2024-02-19T21:43:19.147 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:18.115350+0000 mon.a (mon.0) 1175 : cluster [DBG] osdmap e240: 8 total, 8 up, 7 in 2024-02-19T21:43:19.147 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:18.528198+0000 mon.c (mon.2) 54 : audit [DBG] from='client.? 172.21.15.80:0/2288085109' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:43:19.147 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:19.028437+0000 mon.a (mon.0) 1176 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "22"}]: dispatch 2024-02-19T21:43:19.199 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:43:19.203 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:19.204 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:43:19.305 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:43:19.391 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:19.422 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:43:19.424 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:19.425 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:43:19.425 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:18.115350+0000 mon.a (mon.0) 1175 : cluster [DBG] osdmap e240: 8 total, 8 up, 7 in 2024-02-19T21:43:19.425 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:18.528198+0000 mon.c (mon.2) 54 : audit [DBG] from='client.? 172.21.15.80:0/2288085109' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:43:19.425 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:19.028437+0000 mon.a (mon.0) 1176 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "22"}]: dispatch 2024-02-19T21:43:19.497 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:43:19.525 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:43:19.590 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:19.677 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:43:19.694 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:19.694 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:43:19.795 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:43:19.841 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:20.252 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:43:20.303 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:43:20.320 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:20.320 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:43:20.421 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:43:20.456 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:19.027489+0000 mgr.y (mgr.14514) 412 : cluster [DBG] pgmap v486: 139 pgs: 2 active+remapped+backfilling, 137 active+clean; 1.5 GiB data, 7.0 GiB used, 619 GiB / 626 GiB avail; 255 B/s wr, 394 op/s; 2302/74175 objects misplaced (3.103%); 3 B/s, 0 objects/s recovering 2024-02-19T21:43:20.456 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:19.133275+0000 mon.a (mon.0) 1177 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "22"}]': finished 2024-02-19T21:43:20.456 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:19.133321+0000 mon.a (mon.0) 1178 : cluster [DBG] osdmap e241: 8 total, 8 up, 7 in 2024-02-19T21:43:20.456 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:19.275371+0000 mon.a (mon.0) 1179 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:43:20.457 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:19.703090+0000 mon.a (mon.0) 1180 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:43:20.457 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:19.704065+0000 mon.a (mon.0) 1181 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:43:20.457 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:19.704872+0000 mon.a (mon.0) 1182 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:43:20.457 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:19.705577+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:43:20.457 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:43:19.706052+0000 mgr.y (mgr.14514) 413 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 3256M 2024-02-19T21:43:20.457 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:19.713316+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:43:20.457 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:19.746123+0000 mon.a (mon.0) 1185 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:43:20.457 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:19.746765+0000 mon.a (mon.0) 1186 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:43:20.457 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:19.747337+0000 mon.a (mon.0) 1187 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:43:20.457 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:19.747992+0000 mon.a (mon.0) 1188 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:43:20.457 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cephadm 2024-02-19T21:43:19.748511+0000 mgr.y (mgr.14514) 414 : cephadm [INF] Adjusting osd_memory_target on smithi157 to 3256M 2024-02-19T21:43:20.457 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:19.755705+0000 mon.a (mon.0) 1189 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:43:20.457 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:19.756482+0000 mon.a (mon.0) 1190 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:43:20.457 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:19.756989+0000 mon.a (mon.0) 1191 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:43:20.458 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:19.760852+0000 mon.a (mon.0) 1192 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:43:20.458 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:20.091242+0000 mon.a (mon.0) 1193 : cluster [DBG] osdmap e242: 8 total, 8 up, 7 in 2024-02-19T21:43:20.468 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:19.027489+0000 mgr.y (mgr.14514) 412 : cluster [DBG] pgmap v486: 139 pgs: 2 active+remapped+backfilling, 137 active+clean; 1.5 GiB data, 7.0 GiB used, 619 GiB / 626 GiB avail; 255 B/s wr, 394 op/s; 2302/74175 objects misplaced (3.103%); 3 B/s, 0 objects/s recovering 2024-02-19T21:43:20.468 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:19.133275+0000 mon.a (mon.0) 1177 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "22"}]': finished 2024-02-19T21:43:20.469 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:19.133321+0000 mon.a (mon.0) 1178 : cluster [DBG] osdmap e241: 8 total, 8 up, 7 in 2024-02-19T21:43:20.469 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:19.275371+0000 mon.a (mon.0) 1179 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:43:20.469 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:19.703090+0000 mon.a (mon.0) 1180 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:43:20.469 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:19.704065+0000 mon.a (mon.0) 1181 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:43:20.469 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:19.704872+0000 mon.a (mon.0) 1182 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:43:20.469 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:19.705577+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:43:20.469 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:43:19.706052+0000 mgr.y (mgr.14514) 413 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 3256M 2024-02-19T21:43:20.469 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:19.713316+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:43:20.469 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:19.746123+0000 mon.a (mon.0) 1185 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:43:20.469 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:19.746765+0000 mon.a (mon.0) 1186 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:43:20.469 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:19.747337+0000 mon.a (mon.0) 1187 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:43:20.469 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:19.747992+0000 mon.a (mon.0) 1188 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:43:20.469 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cephadm 2024-02-19T21:43:19.748511+0000 mgr.y (mgr.14514) 414 : cephadm [INF] Adjusting osd_memory_target on smithi157 to 3256M 2024-02-19T21:43:20.469 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:19.755705+0000 mon.a (mon.0) 1189 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:43:20.470 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:19.756482+0000 mon.a (mon.0) 1190 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:43:20.470 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:19.756989+0000 mon.a (mon.0) 1191 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:43:20.470 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:19.760852+0000 mon.a (mon.0) 1192 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:43:20.470 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:20.091242+0000 mon.a (mon.0) 1193 : cluster [DBG] osdmap e242: 8 total, 8 up, 7 in 2024-02-19T21:43:20.470 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:19.027489+0000 mgr.y (mgr.14514) 412 : cluster [DBG] pgmap v486: 139 pgs: 2 active+remapped+backfilling, 137 active+clean; 1.5 GiB data, 7.0 GiB used, 619 GiB / 626 GiB avail; 255 B/s wr, 394 op/s; 2302/74175 objects misplaced (3.103%); 3 B/s, 0 objects/s recovering 2024-02-19T21:43:20.470 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:19.133275+0000 mon.a (mon.0) 1177 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "22"}]': finished 2024-02-19T21:43:20.470 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:19.133321+0000 mon.a (mon.0) 1178 : cluster [DBG] osdmap e241: 8 total, 8 up, 7 in 2024-02-19T21:43:20.470 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:19.275371+0000 mon.a (mon.0) 1179 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:43:20.470 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:19.703090+0000 mon.a (mon.0) 1180 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:43:20.471 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:19.704065+0000 mon.a (mon.0) 1181 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:43:20.471 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:19.704872+0000 mon.a (mon.0) 1182 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:43:20.471 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:19.705577+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:43:20.471 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:43:19.706052+0000 mgr.y (mgr.14514) 413 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 3256M 2024-02-19T21:43:20.471 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:19.713316+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:43:20.471 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:19.746123+0000 mon.a (mon.0) 1185 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:43:20.471 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:19.746765+0000 mon.a (mon.0) 1186 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:43:20.471 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:19.747337+0000 mon.a (mon.0) 1187 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:43:20.471 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:19.747992+0000 mon.a (mon.0) 1188 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:43:20.472 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cephadm 2024-02-19T21:43:19.748511+0000 mgr.y (mgr.14514) 414 : cephadm [INF] Adjusting osd_memory_target on smithi157 to 3256M 2024-02-19T21:43:20.472 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:19.755705+0000 mon.a (mon.0) 1189 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:43:20.472 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:19.756482+0000 mon.a (mon.0) 1190 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:43:20.472 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:19.756989+0000 mon.a (mon.0) 1191 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:43:20.472 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:19.760852+0000 mon.a (mon.0) 1192 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:43:20.472 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:20.091242+0000 mon.a (mon.0) 1193 : cluster [DBG] osdmap e242: 8 total, 8 up, 7 in 2024-02-19T21:43:20.472 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:20.774 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:43:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:43:20] "GET /metrics HTTP/1.1" 200 175941 "" "Prometheus/2.33.4" 2024-02-19T21:43:20.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:43:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:43:21.435 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:43:21.438 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:21.439 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:43:21.458 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:20.454657+0000 mgr.y (mgr.14514) 415 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:43:21.458 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:21.093297+0000 mon.a (mon.0) 1194 : cluster [DBG] osdmap e243: 8 total, 8 up, 7 in 2024-02-19T21:43:21.458 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:20.454657+0000 mgr.y (mgr.14514) 415 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:43:21.458 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:21.093297+0000 mon.a (mon.0) 1194 : cluster [DBG] osdmap e243: 8 total, 8 up, 7 in 2024-02-19T21:43:21.540 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:43:21.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:20.454657+0000 mgr.y (mgr.14514) 415 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:43:21.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:21.093297+0000 mon.a (mon.0) 1194 : cluster [DBG] osdmap e243: 8 total, 8 up, 7 in 2024-02-19T21:43:21.602 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:21.652 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:43:21.657 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:21.657 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:43:21.758 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:43:21.802 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:22.179 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:43:22.182 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:22.183 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:43:22.284 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:43:22.323 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:22.455 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:43:22.458 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:22.459 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:43:22.459 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:21.028002+0000 mgr.y (mgr.14514) 416 : cluster [DBG] pgmap v489: 139 pgs: 2 peering, 2 active+remapped+backfilling, 135 active+clean; 1.2 GiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.20k op/s; 1741/59784 objects misplaced (2.912%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:22.459 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:22.114807+0000 mon.a (mon.0) 1195 : cluster [DBG] osdmap e244: 8 total, 8 up, 7 in 2024-02-19T21:43:22.459 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:21.028002+0000 mgr.y (mgr.14514) 416 : cluster [DBG] pgmap v489: 139 pgs: 2 peering, 2 active+remapped+backfilling, 135 active+clean; 1.2 GiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.20k op/s; 1741/59784 objects misplaced (2.912%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:22.460 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:22.114807+0000 mon.a (mon.0) 1195 : cluster [DBG] osdmap e244: 8 total, 8 up, 7 in 2024-02-19T21:43:22.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:21.028002+0000 mgr.y (mgr.14514) 416 : cluster [DBG] pgmap v489: 139 pgs: 2 peering, 2 active+remapped+backfilling, 135 active+clean; 1.2 GiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.20k op/s; 1741/59784 objects misplaced (2.912%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:22.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:22.114807+0000 mon.a (mon.0) 1195 : cluster [DBG] osdmap e244: 8 total, 8 up, 7 in 2024-02-19T21:43:22.559 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:43:22.609 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:24.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:23.028395+0000 mgr.y (mgr.14514) 417 : cluster [DBG] pgmap v492: 138 pgs: 1 peering, 2 active+remapped+backfilling, 135 active+clean; 1.2 GiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.20k op/s; 1741/59784 objects misplaced (2.912%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:24.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:23.028395+0000 mgr.y (mgr.14514) 417 : cluster [DBG] pgmap v492: 138 pgs: 1 peering, 2 active+remapped+backfilling, 135 active+clean; 1.2 GiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.20k op/s; 1741/59784 objects misplaced (2.912%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:24.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:23.028395+0000 mgr.y (mgr.14514) 417 : cluster [DBG] pgmap v492: 138 pgs: 1 peering, 2 active+remapped+backfilling, 135 active+clean; 1.2 GiB data, 6.1 GiB used, 620 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.20k op/s; 1741/59784 objects misplaced (2.912%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:24.665 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:43:24.665 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-02-19T21:43:24.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.666 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:240342 8.0 8:0b2adb2a:::benchmark_data_smithi080_100924_object112624:head [delete] snapc 0=[] ondisk+write+known_if_redirected e244)", 2024-02-19T21:43:24.666 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:24.637628+0000", 2024-02-19T21:43:24.666 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.027128691, 2024-02-19T21:43:24.666 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.027157994000000001, 2024-02-19T21:43:24.666 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:43:24.666 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:43:24.666 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:43:24.666 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:43:24.666 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:43:24.666 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 240342 2024-02-19T21:43:24.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.666 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:43:24.666 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.666 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:43:24.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.637628+0000", 2024-02-19T21:43:24.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:43:24.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:43:24.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.637628+0000", 2024-02-19T21:43:24.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:43:24.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:43:24.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.637627+0000", 2024-02-19T21:43:24.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8640000000000001e-06 2024-02-19T21:43:24.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:43:24.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.637633+0000", 2024-02-19T21:43:24.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0036e-05 2024-02-19T21:43:24.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:43:24.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.637643+0000", 2024-02-19T21:43:24.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6499999999999999e-06 2024-02-19T21:43:24.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:43:24.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.637650+0000", 2024-02-19T21:43:24.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049155229999999998 2024-02-19T21:43:24.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:43:24.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.642565+0000", 2024-02-19T21:43:24.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000114607 2024-02-19T21:43:24.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:43:24.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.642680+0000", 2024-02-19T21:43:24.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000131493 2024-02-19T21:43:24.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,5", 2024-02-19T21:43:24.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.642811+0000", 2024-02-19T21:43:24.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050223500000000001 2024-02-19T21:43:24.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.670 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:43:24.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.647833+0000", 2024-02-19T21:43:24.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001189615 2024-02-19T21:43:24.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.670 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:24.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.649023+0000", 2024-02-19T21:43:24.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011395137 2024-02-19T21:43:24.670 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:24.670 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:43:24.670 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:24.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.671 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:240352 8.f 8:f801a770:::benchmark_data_smithi080_100924_object112634:head [delete] snapc 0=[] ondisk+write+known_if_redirected e244)", 2024-02-19T21:43:24.671 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:24.652676+0000", 2024-02-19T21:43:24.671 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.012081120000000001, 2024-02-19T21:43:24.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012205934999999999, 2024-02-19T21:43:24.671 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:43:24.671 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:43:24.671 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:43:24.671 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:43:24.671 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:43:24.671 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 240352 2024-02-19T21:43:24.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.671 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:43:24.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:43:24.672 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.652676+0000", 2024-02-19T21:43:24.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:43:24.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:43:24.672 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.652676+0000", 2024-02-19T21:43:24.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:43:24.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:43:24.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.652674+0000", 2024-02-19T21:43:24.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2699999999999999e-06 2024-02-19T21:43:24.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:43:24.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.652681+0000", 2024-02-19T21:43:24.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2363e-05 2024-02-19T21:43:24.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:43:24.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.652694+0000", 2024-02-19T21:43:24.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2739999999999998e-06 2024-02-19T21:43:24.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:43:24.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.652699+0000", 2024-02-19T21:43:24.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6931999999999997e-05 2024-02-19T21:43:24.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:43:24.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.652746+0000", 2024-02-19T21:43:24.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012930400000000001 2024-02-19T21:43:24.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:43:24.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.652875+0000", 2024-02-19T21:43:24.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076776500000000001 2024-02-19T21:43:24.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,4", 2024-02-19T21:43:24.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.653643+0000", 2024-02-19T21:43:24.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010364257 2024-02-19T21:43:24.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:24.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.664007+0000", 2024-02-19T21:43:24.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2784000000000003e-05 2024-02-19T21:43:24.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:24.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.664040+0000", 2024-02-19T21:43:24.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011364475000000001 2024-02-19T21:43:24.676 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:24.676 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:43:24.676 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:24.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.676 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.24932.0:240354 8.8 e244/190 8:1ea6c21f:::benchmark_data_smithi080_100924_object112636:head v 244'15047, mlcod=244'15045)", 2024-02-19T21:43:24.676 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:24.658989+0000", 2024-02-19T21:43:24.676 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0057675219999999998, 2024-02-19T21:43:24.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059798050000000004, 2024-02-19T21:43:24.676 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:43:24.676 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:43:24.676 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:43:24.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.677 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:43:24.677 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.658989+0000", 2024-02-19T21:43:24.677 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:43:24.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.677 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:43:24.677 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.658989+0000", 2024-02-19T21:43:24.677 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:43:24.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.677 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:43:24.677 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.658988+0000", 2024-02-19T21:43:24.677 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0789e-05 2024-02-19T21:43:24.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:43:24.678 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.658998+0000", 2024-02-19T21:43:24.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5108e-05 2024-02-19T21:43:24.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:43:24.678 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.659014+0000", 2024-02-19T21:43:24.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3449999999999996e-06 2024-02-19T21:43:24.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:43:24.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.659019+0000", 2024-02-19T21:43:24.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000114598 2024-02-19T21:43:24.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:43:24.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.659133+0000", 2024-02-19T21:43:24.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3436000000000001e-05 2024-02-19T21:43:24.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:43:24.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.659157+0000", 2024-02-19T21:43:24.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016777299999999999 2024-02-19T21:43:24.680 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:24.680 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:43:24.680 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:24.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.680 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:240355 8.f 8:fbd2320e:::benchmark_data_smithi080_100924_object112637:head [delete] snapc 0=[] ondisk+write+known_if_redirected e244)", 2024-02-19T21:43:24.680 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:24.659052+0000", 2024-02-19T21:43:24.680 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0057047399999999998, 2024-02-19T21:43:24.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059799709999999997, 2024-02-19T21:43:24.681 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:43:24.681 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:43:24.681 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:43:24.681 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:43:24.681 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:43:24.681 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 240355 2024-02-19T21:43:24.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.681 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:43:24.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:43:24.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.659052+0000", 2024-02-19T21:43:24.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:43:24.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:43:24.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.659052+0000", 2024-02-19T21:43:24.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:43:24.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:43:24.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.659050+0000", 2024-02-19T21:43:24.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.362e-06 2024-02-19T21:43:24.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:43:24.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.659057+0000", 2024-02-19T21:43:24.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0963e-05 2024-02-19T21:43:24.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.683 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:43:24.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.659068+0000", 2024-02-19T21:43:24.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1449999999999996e-06 2024-02-19T21:43:24.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.683 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:43:24.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.659074+0000", 2024-02-19T21:43:24.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.299e-05 2024-02-19T21:43:24.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.683 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:43:24.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.659117+0000", 2024-02-19T21:43:24.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1576000000000006e-05 2024-02-19T21:43:24.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:43:24.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.659199+0000", 2024-02-19T21:43:24.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011407400000000001 2024-02-19T21:43:24.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,4", 2024-02-19T21:43:24.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.659313+0000", 2024-02-19T21:43:24.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000261224 2024-02-19T21:43:24.684 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:24.684 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:43:24.684 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:24.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.685 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.24932.0:240358 8.a e244/165 8:5fe22fd5:::benchmark_data_smithi080_100924_object112640:head v 244'14894, mlcod=244'14892)", 2024-02-19T21:43:24.685 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:24.662424+0000", 2024-02-19T21:43:24.685 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0023330640000000001, 2024-02-19T21:43:24.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026892140000000001, 2024-02-19T21:43:24.685 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:43:24.685 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:43:24.685 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:43:24.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:43:24.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.662424+0000", 2024-02-19T21:43:24.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:43:24.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:43:24.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.662424+0000", 2024-02-19T21:43:24.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:43:24.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:43:24.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.662423+0000", 2024-02-19T21:43:24.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7430000000000008e-06 2024-02-19T21:43:24.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:43:24.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.662431+0000", 2024-02-19T21:43:24.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4037e-05 2024-02-19T21:43:24.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:43:24.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.662445+0000", 2024-02-19T21:43:24.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3099999999999997e-06 2024-02-19T21:43:24.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:43:24.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.662452+0000", 2024-02-19T21:43:24.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0080000000000003e-05 2024-02-19T21:43:24.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:43:24.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.662492+0000", 2024-02-19T21:43:24.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8913e-05 2024-02-19T21:43:24.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:43:24.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.662511+0000", 2024-02-19T21:43:24.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7106000000000003e-05 2024-02-19T21:43:24.688 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:24.688 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:43:24.688 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:24.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.688 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.24932.0:240361 8.a e244/165 8:5df47153:::benchmark_data_smithi080_100924_object112643:head v 244'14895, mlcod=244'14892)", 2024-02-19T21:43:24.688 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:24.664391+0000", 2024-02-19T21:43:24.688 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.000365979, 2024-02-19T21:43:24.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00078165600000000004, 2024-02-19T21:43:24.689 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:43:24.689 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:43:24.689 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:43:24.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:43:24.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.664391+0000", 2024-02-19T21:43:24.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:43:24.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:43:24.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.664391+0000", 2024-02-19T21:43:24.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:43:24.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:43:24.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.664390+0000", 2024-02-19T21:43:24.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9049999999999997e-06 2024-02-19T21:43:24.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:43:24.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.664398+0000", 2024-02-19T21:43:24.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7484000000000001e-05 2024-02-19T21:43:24.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:43:24.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.664415+0000", 2024-02-19T21:43:24.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0249999999999999e-06 2024-02-19T21:43:24.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:43:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.664421+0000", 2024-02-19T21:43:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010426500000000001 2024-02-19T21:43:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:43:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.664525+0000", 2024-02-19T21:43:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8059000000000001e-05 2024-02-19T21:43:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:43:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:24.664543+0000", 2024-02-19T21:43:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015276600000000001 2024-02-19T21:43:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:43:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:24.692 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:24.692 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:43:24.692 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 6 2024-02-19T21:43:24.692 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:43:25.173 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:43:25.182 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:25.183 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:43:25.225 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:43:25.227 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:43:25.284 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:43:25.381 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:25.427 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:43:25.435 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:25.436 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:43:25.536 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:43:25.577 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:25.810 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:43:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:43:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:43:25.945 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:43:25.964 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:25.965 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:43:25.976 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.3 dump_blocked_ops 2024-02-19T21:43:26.066 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:43:26.145 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:26.263 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:43:26.270 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:26.271 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:43:26.372 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:43:26.422 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:26.439 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:43:26.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:25.029143+0000 mgr.y (mgr.14514) 418 : cluster [DBG] pgmap v493: 138 pgs: 2 active+remapped+backfilling, 136 active+clean; 1017 MiB data, 5.4 GiB used, 620 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.40k op/s; 1217/49392 objects misplaced (2.464%); 2.3 MiB/s, 37 objects/s recovering 2024-02-19T21:43:26.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:25.209056+0000 mgr.y (mgr.14514) 419 : audit [DBG] from='client.24979 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:43:26.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:25.029143+0000 mgr.y (mgr.14514) 418 : cluster [DBG] pgmap v493: 138 pgs: 2 active+remapped+backfilling, 136 active+clean; 1017 MiB data, 5.4 GiB used, 620 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.40k op/s; 1217/49392 objects misplaced (2.464%); 2.3 MiB/s, 37 objects/s recovering 2024-02-19T21:43:26.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:25.209056+0000 mgr.y (mgr.14514) 419 : audit [DBG] from='client.24979 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:43:26.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:25.029143+0000 mgr.y (mgr.14514) 418 : cluster [DBG] pgmap v493: 138 pgs: 2 active+remapped+backfilling, 136 active+clean; 1017 MiB data, 5.4 GiB used, 620 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.40k op/s; 1217/49392 objects misplaced (2.464%); 2.3 MiB/s, 37 objects/s recovering 2024-02-19T21:43:26.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:25.209056+0000 mgr.y (mgr.14514) 419 : audit [DBG] from='client.24979 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:43:26.733 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":493,"stamp":"2024-02-19T21:43:25.028557+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1066342076,"num_objects":16464,"num_object_clones":0,"num_object_copies":49392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1217,"num_objects_unfound":0,"num_objects_dirty":16464,"num_whiteouts":0,"num_read":1782,"num_read_kb":1534,"num_write":239874,"num_write_kb":8173802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11168,"num_bytes_recovered":718869141,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79896,"ondisk_log_size":79896,"up":414,"acting":414,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":418,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":656216064,"kb_used":5682684,"kb_used_data":3548356,"kb_used_omap":0,"kb_used_meta":2133760,"kb_avail":650533380,"statfs":{"total":671965249536,"available":666146181120,"internally_reserved":0,"allocated":3633516544,"data_stored":3630955965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2184970240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,0,5,4,4,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-541392896,"num_objects":-8261,"num_object_clones":0,"num_object_copies":-24783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-1085,"num_objects_unfound":0,"num_objects_dirty":-8261,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8261,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":221,"num_bytes_recovered":14483456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.896667"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":170,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.121638+0000","last_change":"2024-02-19T21:40:23.364671+0000","last_active":"2024-02-19T21:43:21.121638+0000","last_peered":"2024-02-19T21:43:21.121638+0000","last_clean":"2024-02-19T21:43:21.121638+0000","last_became_active":"2024-02-19T21:35:14.511920+0000","last_became_peered":"2024-02-19T21:35:14.511920+0000","last_unstale":"2024-02-19T21:43:21.121638+0000","last_undegraded":"2024-02-19T21:43:21.121638+0000","last_fullsized":"2024-02-19T21:43:21.121638+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:23.364579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:23.364579+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":212,"reported_epoch":241,"state":"active+clean","last_fresh":"2024-02-19T21:43:19.138651+0000","last_change":"2024-02-19T21:40:28.473842+0000","last_active":"2024-02-19T21:43:19.138651+0000","last_peered":"2024-02-19T21:43:19.138651+0000","last_clean":"2024-02-19T21:43:19.138651+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:43:19.138651+0000","last_undegraded":"2024-02-19T21:43:19.138651+0000","last_fullsized":"2024-02-19T21:43:19.138651+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:28.473778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:28.473778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"201'27","reported_seq":184,"reported_epoch":241,"state":"active+clean","last_fresh":"2024-02-19T21:43:19.138109+0000","last_change":"2024-02-19T21:39:51.546188+0000","last_active":"2024-02-19T21:43:19.138109+0000","last_peered":"2024-02-19T21:43:19.138109+0000","last_clean":"2024-02-19T21:43:19.138109+0000","last_became_active":"2024-02-19T21:39:51.536424+0000","last_became_peered":"2024-02-19T21:39:51.536424+0000","last_unstale":"2024-02-19T21:43:19.138109+0000","last_undegraded":"2024-02-19T21:43:19.138109+0000","last_fullsized":"2024-02-19T21:43:19.138109+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:39:29.269819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:29.269819+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":214,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.107141+0000","last_change":"2024-02-19T21:42:04.201771+0000","last_active":"2024-02-19T21:43:21.107141+0000","last_peered":"2024-02-19T21:43:21.107141+0000","last_clean":"2024-02-19T21:43:21.107141+0000","last_became_active":"2024-02-19T21:42:04.201530+0000","last_became_peered":"2024-02-19T21:42:04.201530+0000","last_unstale":"2024-02-19T21:43:21.107141+0000","last_undegraded":"2024-02-19T21:43:21.107141+0000","last_fullsized":"2024-02-19T21:43:21.107141+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:25.265482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:25.265482+0000","last_clean_scrub_stamp":"2024-02-19T21:40:25.265482+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":210,"reported_epoch":240,"state":"active+clean","last_fresh":"2024-02-19T21:43:18.122021+0000","last_change":"2024-02-19T21:39:45.432311+0000","last_active":"2024-02-19T21:43:18.122021+0000","last_peered":"2024-02-19T21:43:18.122021+0000","last_clean":"2024-02-19T21:43:18.122021+0000","last_became_active":"2024-02-19T21:32:23.356975+0000","last_became_peered":"2024-02-19T21:32:23.356975+0000","last_unstale":"2024-02-19T21:43:18.122021+0000","last_undegraded":"2024-02-19T21:43:18.122021+0000","last_fullsized":"2024-02-19T21:43:18.122021+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:45.432184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:39:45.432184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"200'19","reported_seq":253,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.113635+0000","last_change":"2024-02-19T21:41:38.975835+0000","last_active":"2024-02-19T21:43:21.113635+0000","last_peered":"2024-02-19T21:43:21.113635+0000","last_clean":"2024-02-19T21:43:21.113635+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:43:21.113635+0000","last_undegraded":"2024-02-19T21:43:21.113635+0000","last_fullsized":"2024-02-19T21:43:21.113635+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"92'13","last_scrub_stamp":"2024-02-19T21:39:38.475440+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.475440+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":204,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.105520+0000","last_change":"2024-02-19T21:39:32.209318+0000","last_active":"2024-02-19T21:43:21.105520+0000","last_peered":"2024-02-19T21:43:21.105520+0000","last_clean":"2024-02-19T21:43:21.105520+0000","last_became_active":"2024-02-19T21:32:27.370308+0000","last_became_peered":"2024-02-19T21:32:27.370308+0000","last_unstale":"2024-02-19T21:43:21.105520+0000","last_undegraded":"2024-02-19T21:43:21.105520+0000","last_fullsized":"2024-02-19T21:43:21.105520+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:32.209233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:32.209233+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":215,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.103925+0000","last_change":"2024-02-19T21:40:34.884850+0000","last_active":"2024-02-19T21:43:21.103925+0000","last_peered":"2024-02-19T21:43:21.103925+0000","last_clean":"2024-02-19T21:43:21.103925+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:43:21.103925+0000","last_undegraded":"2024-02-19T21:43:21.103925+0000","last_fullsized":"2024-02-19T21:43:21.103925+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:34.884780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:08.490788+0000","last_clean_scrub_stamp":"2024-02-19T21:40:34.884780+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"200'7","reported_seq":205,"reported_epoch":240,"state":"active+clean","last_fresh":"2024-02-19T21:43:18.121647+0000","last_change":"2024-02-19T21:39:44.444043+0000","last_active":"2024-02-19T21:43:18.121647+0000","last_peered":"2024-02-19T21:43:18.121647+0000","last_clean":"2024-02-19T21:43:18.121647+0000","last_became_active":"2024-02-19T21:39:39.471143+0000","last_became_peered":"2024-02-19T21:39:39.471143+0000","last_unstale":"2024-02-19T21:43:18.121647+0000","last_undegraded":"2024-02-19T21:43:18.121647+0000","last_fullsized":"2024-02-19T21:43:18.121647+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'5","last_scrub_stamp":"2024-02-19T21:39:44.443963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:44.443963+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":223,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.107517+0000","last_change":"2024-02-19T21:42:04.205008+0000","last_active":"2024-02-19T21:43:21.107517+0000","last_peered":"2024-02-19T21:43:21.107517+0000","last_clean":"2024-02-19T21:43:21.107517+0000","last_became_active":"2024-02-19T21:42:04.204559+0000","last_became_peered":"2024-02-19T21:42:04.204559+0000","last_unstale":"2024-02-19T21:43:21.107517+0000","last_undegraded":"2024-02-19T21:43:21.107517+0000","last_fullsized":"2024-02-19T21:43:21.107517+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:32.576698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:46.543259+0000","last_clean_scrub_stamp":"2024-02-19T21:41:32.576698+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":222,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.102034+0000","last_change":"2024-02-19T21:40:16.864005+0000","last_active":"2024-02-19T21:43:21.102034+0000","last_peered":"2024-02-19T21:43:21.102034+0000","last_clean":"2024-02-19T21:43:21.102034+0000","last_became_active":"2024-02-19T21:39:39.473759+0000","last_became_peered":"2024-02-19T21:39:39.473759+0000","last_unstale":"2024-02-19T21:43:21.102034+0000","last_undegraded":"2024-02-19T21:43:21.102034+0000","last_fullsized":"2024-02-19T21:43:21.102034+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:16.863939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:16.863939+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"200'19","reported_seq":233,"reported_epoch":240,"state":"active+clean","last_fresh":"2024-02-19T21:43:18.118505+0000","last_change":"2024-02-19T21:39:47.395697+0000","last_active":"2024-02-19T21:43:18.118505+0000","last_peered":"2024-02-19T21:43:18.118505+0000","last_clean":"2024-02-19T21:43:18.118505+0000","last_became_active":"2024-02-19T21:35:14.514971+0000","last_became_peered":"2024-02-19T21:35:14.514971+0000","last_unstale":"2024-02-19T21:43:18.118505+0000","last_undegraded":"2024-02-19T21:43:18.118505+0000","last_fullsized":"2024-02-19T21:43:18.118505+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'13","last_scrub_stamp":"2024-02-19T21:39:47.395572+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:39:47.395572+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":183,"reported_epoch":240,"state":"active+clean","last_fresh":"2024-02-19T21:43:18.122366+0000","last_change":"2024-02-19T21:42:04.195331+0000","last_active":"2024-02-19T21:43:18.122366+0000","last_peered":"2024-02-19T21:43:18.122366+0000","last_clean":"2024-02-19T21:43:18.122366+0000","last_became_active":"2024-02-19T21:42:04.194933+0000","last_became_peered":"2024-02-19T21:42:04.194933+0000","last_unstale":"2024-02-19T21:43:18.122366+0000","last_undegraded":"2024-02-19T21:43:18.122366+0000","last_fullsized":"2024-02-19T21:43:18.122366+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:34.364412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:34.364412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":95,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.115852+0000","last_change":"2024-02-19T21:42:04.201407+0000","last_active":"2024-02-19T21:43:21.115852+0000","last_peered":"2024-02-19T21:43:21.115852+0000","last_clean":"2024-02-19T21:43:21.115852+0000","last_became_active":"2024-02-19T21:42:04.201106+0000","last_became_peered":"2024-02-19T21:42:04.201106+0000","last_unstale":"2024-02-19T21:43:21.115852+0000","last_undegraded":"2024-02-19T21:43:21.115852+0000","last_fullsized":"2024-02-19T21:43:21.115852+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:24.788644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:24.788644+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,5],"acting":[6,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"201'18","reported_seq":172,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.106062+0000","last_change":"2024-02-19T21:39:21.126642+0000","last_active":"2024-02-19T21:43:21.106062+0000","last_peered":"2024-02-19T21:43:21.106062+0000","last_clean":"2024-02-19T21:43:21.106062+0000","last_became_active":"2024-02-19T21:38:31.247067+0000","last_became_peered":"2024-02-19T21:38:31.247067+0000","last_unstale":"2024-02-19T21:43:21.106062+0000","last_undegraded":"2024-02-19T21:43:21.106062+0000","last_fullsized":"2024-02-19T21:43:21.106062+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'12","last_scrub_stamp":"2024-02-19T21:39:21.126563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:21.126563+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":205,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.106105+0000","last_change":"2024-02-19T21:40:15.269827+0000","last_active":"2024-02-19T21:43:21.106105+0000","last_peered":"2024-02-19T21:43:21.106105+0000","last_clean":"2024-02-19T21:43:21.106105+0000","last_became_active":"2024-02-19T21:32:27.369757+0000","last_became_peered":"2024-02-19T21:32:27.369757+0000","last_unstale":"2024-02-19T21:43:21.106105+0000","last_undegraded":"2024-02-19T21:43:21.106105+0000","last_fullsized":"2024-02-19T21:43:21.106105+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:15.269720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:15.269720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":218,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.115842+0000","last_change":"2024-02-19T21:40:38.600031+0000","last_active":"2024-02-19T21:43:21.115842+0000","last_peered":"2024-02-19T21:43:21.115842+0000","last_clean":"2024-02-19T21:43:21.115842+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:43:21.115842+0000","last_undegraded":"2024-02-19T21:43:21.115842+0000","last_fullsized":"2024-02-19T21:43:21.115842+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:38.599939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:38.599939+0000","last_clean_scrub_stamp":"2024-02-19T21:40:38.599939+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"200'34","reported_seq":200,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.104269+0000","last_change":"2024-02-19T21:40:36.287163+0000","last_active":"2024-02-19T21:43:21.104269+0000","last_peered":"2024-02-19T21:43:21.104269+0000","last_clean":"2024-02-19T21:43:21.104269+0000","last_became_active":"2024-02-19T21:39:39.477429+0000","last_became_peered":"2024-02-19T21:39:39.477429+0000","last_unstale":"2024-02-19T21:43:21.104269+0000","last_undegraded":"2024-02-19T21:43:21.104269+0000","last_fullsized":"2024-02-19T21:43:21.104269+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'22","last_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.287051+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":217,"reported_epoch":241,"state":"active+clean","last_fresh":"2024-02-19T21:43:19.140716+0000","last_change":"2024-02-19T21:39:39.471709+0000","last_active":"2024-02-19T21:43:19.140716+0000","last_peered":"2024-02-19T21:43:19.140716+0000","last_clean":"2024-02-19T21:43:19.140716+0000","last_became_active":"2024-02-19T21:39:39.471214+0000","last_became_peered":"2024-02-19T21:39:39.471214+0000","last_unstale":"2024-02-19T21:43:19.140716+0000","last_undegraded":"2024-02-19T21:43:19.140716+0000","last_fullsized":"2024-02-19T21:43:19.140716+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:37.169503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:37.169503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":139,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.114397+0000","last_change":"2024-02-19T21:42:04.198922+0000","last_active":"2024-02-19T21:43:21.114397+0000","last_peered":"2024-02-19T21:43:21.114397+0000","last_clean":"2024-02-19T21:43:21.114397+0000","last_became_active":"2024-02-19T21:42:04.198592+0000","last_became_peered":"2024-02-19T21:42:04.198592+0000","last_unstale":"2024-02-19T21:43:21.114397+0000","last_undegraded":"2024-02-19T21:43:21.114397+0000","last_fullsized":"2024-02-19T21:43:21.114397+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:33.515188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:33.515188+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"201'19","reported_seq":111,"reported_epoch":241,"state":"active+clean","last_fresh":"2024-02-19T21:43:19.138516+0000","last_change":"2024-02-19T21:39:51.559559+0000","last_active":"2024-02-19T21:43:19.138516+0000","last_peered":"2024-02-19T21:43:19.138516+0000","last_clean":"2024-02-19T21:43:19.138516+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:43:19.138516+0000","last_undegraded":"2024-02-19T21:43:19.138516+0000","last_fullsized":"2024-02-19T21:43:19.138516+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:39:43.209803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:43.209803+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"199'9","reported_seq":367,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.990492+0000","last_change":"2024-02-19T21:42:04.290659+0000","last_active":"2024-02-19T21:43:21.990492+0000","last_peered":"2024-02-19T21:43:21.990492+0000","last_clean":"2024-02-19T21:43:21.990492+0000","last_became_active":"2024-02-19T21:42:04.199656+0000","last_became_peered":"2024-02-19T21:42:04.199656+0000","last_unstale":"2024-02-19T21:43:21.990492+0000","last_undegraded":"2024-02-19T21:43:21.990492+0000","last_fullsized":"2024-02-19T21:43:21.990492+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:40:19.276740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:19.276740+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":222,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.107344+0000","last_change":"2024-02-19T21:42:04.199658+0000","last_active":"2024-02-19T21:43:21.107344+0000","last_peered":"2024-02-19T21:43:21.107344+0000","last_clean":"2024-02-19T21:43:21.107344+0000","last_became_active":"2024-02-19T21:42:04.199323+0000","last_became_peered":"2024-02-19T21:42:04.199323+0000","last_unstale":"2024-02-19T21:43:21.107344+0000","last_undegraded":"2024-02-19T21:43:21.107344+0000","last_fullsized":"2024-02-19T21:43:21.107344+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.080601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.080601+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"201'20","reported_seq":291,"reported_epoch":241,"state":"active+clean","last_fresh":"2024-02-19T21:43:19.140702+0000","last_change":"2024-02-19T21:42:04.205219+0000","last_active":"2024-02-19T21:43:19.140702+0000","last_peered":"2024-02-19T21:43:19.140702+0000","last_clean":"2024-02-19T21:43:19.140702+0000","last_became_active":"2024-02-19T21:42:04.204882+0000","last_became_peered":"2024-02-19T21:42:04.204882+0000","last_unstale":"2024-02-19T21:43:19.140702+0000","last_undegraded":"2024-02-19T21:43:19.140702+0000","last_fullsized":"2024-02-19T21:43:19.140702+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:39:33.125904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:33.125904+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":123,"reported_epoch":241,"state":"active+clean","last_fresh":"2024-02-19T21:43:19.138036+0000","last_change":"2024-02-19T21:39:39.471651+0000","last_active":"2024-02-19T21:43:19.138036+0000","last_peered":"2024-02-19T21:43:19.138036+0000","last_clean":"2024-02-19T21:43:19.138036+0000","last_became_active":"2024-02-19T21:39:39.471332+0000","last_became_peered":"2024-02-19T21:39:39.471332+0000","last_unstale":"2024-02-19T21:43:19.138036+0000","last_undegraded":"2024-02-19T21:43:19.138036+0000","last_fullsized":"2024-02-19T21:43:19.138036+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:23.270251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:39:23.270251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":211,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.103646+0000","last_change":"2024-02-19T21:41:36.941622+0000","last_active":"2024-02-19T21:43:21.103646+0000","last_peered":"2024-02-19T21:43:21.103646+0000","last_clean":"2024-02-19T21:43:21.103646+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:43:21.103646+0000","last_undegraded":"2024-02-19T21:43:21.103646+0000","last_fullsized":"2024-02-19T21:43:21.103646+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:36.941549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:41:36.941549+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":222,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.119058+0000","last_change":"2024-02-19T21:39:45.211467+0000","last_active":"2024-02-19T21:43:21.119058+0000","last_peered":"2024-02-19T21:43:21.119058+0000","last_clean":"2024-02-19T21:43:21.119058+0000","last_became_active":"2024-02-19T21:39:39.478633+0000","last_became_peered":"2024-02-19T21:39:39.478633+0000","last_unstale":"2024-02-19T21:43:21.119058+0000","last_undegraded":"2024-02-19T21:43:21.119058+0000","last_fullsized":"2024-02-19T21:43:21.119058+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:45.211388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:39:45.211388+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"201'19","reported_seq":260,"reported_epoch":240,"state":"active+clean","last_fresh":"2024-02-19T21:43:18.118420+0000","last_change":"2024-02-19T21:42:04.641915+0000","last_active":"2024-02-19T21:43:18.118420+0000","last_peered":"2024-02-19T21:43:18.118420+0000","last_clean":"2024-02-19T21:43:18.118420+0000","last_became_active":"2024-02-19T21:42:04.205379+0000","last_became_peered":"2024-02-19T21:42:04.205379+0000","last_unstale":"2024-02-19T21:43:18.118420+0000","last_undegraded":"2024-02-19T21:43:18.118420+0000","last_fullsized":"2024-02-19T21:43:18.118420+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:39:46.421117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:46.421117+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":211,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.105627+0000","last_change":"2024-02-19T21:39:39.471671+0000","last_active":"2024-02-19T21:43:21.105627+0000","last_peered":"2024-02-19T21:43:21.105627+0000","last_clean":"2024-02-19T21:43:21.105627+0000","last_became_active":"2024-02-19T21:39:39.471306+0000","last_became_peered":"2024-02-19T21:39:39.471306+0000","last_unstale":"2024-02-19T21:43:21.105627+0000","last_undegraded":"2024-02-19T21:43:21.105627+0000","last_fullsized":"2024-02-19T21:43:21.105627+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:37.104831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:39:37.104831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":244,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:22.012128+0000","last_change":"2024-02-19T21:43:22.012128+0000","last_active":"2024-02-19T21:43:22.012128+0000","last_peered":"2024-02-19T21:43:22.012128+0000","last_clean":"2024-02-19T21:43:22.012128+0000","last_became_active":"2024-02-19T21:42:04.196794+0000","last_became_peered":"2024-02-19T21:42:04.196794+0000","last_unstale":"2024-02-19T21:43:22.012128+0000","last_undegraded":"2024-02-19T21:43:22.012128+0000","last_fullsized":"2024-02-19T21:43:22.012128+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:41.234250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:41.234250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":217,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.104357+0000","last_change":"2024-02-19T21:39:39.480521+0000","last_active":"2024-02-19T21:43:21.104357+0000","last_peered":"2024-02-19T21:43:21.104357+0000","last_clean":"2024-02-19T21:43:21.104357+0000","last_became_active":"2024-02-19T21:39:39.479927+0000","last_became_peered":"2024-02-19T21:39:39.479927+0000","last_unstale":"2024-02-19T21:43:21.104357+0000","last_undegraded":"2024-02-19T21:43:21.104357+0000","last_fullsized":"2024-02-19T21:43:21.104357+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:39:37.085374+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"200'8","reported_seq":73,"reported_epoch":240,"state":"active+clean","last_fresh":"2024-02-19T21:43:18.127906+0000","last_change":"2024-02-19T21:41:42.590833+0000","last_active":"2024-02-19T21:43:18.127906+0000","last_peered":"2024-02-19T21:43:18.127906+0000","last_clean":"2024-02-19T21:43:18.127906+0000","last_became_active":"2024-02-19T21:41:42.243259+0000","last_became_peered":"2024-02-19T21:41:42.243259+0000","last_unstale":"2024-02-19T21:43:18.127906+0000","last_undegraded":"2024-02-19T21:43:18.127906+0000","last_fullsized":"2024-02-19T21:43:18.127906+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'4","last_scrub_stamp":"2024-02-19T21:40:18.214846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:18.214846+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":123,"reported_epoch":241,"state":"active+clean","last_fresh":"2024-02-19T21:43:19.138000+0000","last_change":"2024-02-19T21:39:39.462663+0000","last_active":"2024-02-19T21:43:19.138000+0000","last_peered":"2024-02-19T21:43:19.138000+0000","last_clean":"2024-02-19T21:43:19.138000+0000","last_became_active":"2024-02-19T21:39:39.462363+0000","last_became_peered":"2024-02-19T21:39:39.462363+0000","last_unstale":"2024-02-19T21:43:19.138000+0000","last_undegraded":"2024-02-19T21:43:19.138000+0000","last_fullsized":"2024-02-19T21:43:19.138000+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:26.311526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:39:26.311526+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":223,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.104201+0000","last_change":"2024-02-19T21:42:04.199063+0000","last_active":"2024-02-19T21:43:21.104201+0000","last_peered":"2024-02-19T21:43:21.104201+0000","last_clean":"2024-02-19T21:43:21.104201+0000","last_became_active":"2024-02-19T21:42:04.198684+0000","last_became_peered":"2024-02-19T21:42:04.198684+0000","last_unstale":"2024-02-19T21:43:21.104201+0000","last_undegraded":"2024-02-19T21:43:21.104201+0000","last_fullsized":"2024-02-19T21:43:21.104201+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:26.272653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:26.272653+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":211,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.105911+0000","last_change":"2024-02-19T21:39:33.957921+0000","last_active":"2024-02-19T21:43:21.105911+0000","last_peered":"2024-02-19T21:43:21.105911+0000","last_clean":"2024-02-19T21:43:21.105911+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:43:21.105911+0000","last_undegraded":"2024-02-19T21:43:21.105911+0000","last_fullsized":"2024-02-19T21:43:21.105911+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:33.957814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:39:33.957814+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"201'19","reported_seq":253,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.114836+0000","last_change":"2024-02-19T21:41:23.880621+0000","last_active":"2024-02-19T21:43:21.114836+0000","last_peered":"2024-02-19T21:43:21.114836+0000","last_clean":"2024-02-19T21:43:21.114836+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:43:21.114836+0000","last_undegraded":"2024-02-19T21:43:21.114836+0000","last_fullsized":"2024-02-19T21:43:21.114836+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:41:23.880501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:41:23.880501+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":208,"reported_epoch":241,"state":"active+clean","last_fresh":"2024-02-19T21:43:19.137961+0000","last_change":"2024-02-19T21:38:29.972418+0000","last_active":"2024-02-19T21:43:19.137961+0000","last_peered":"2024-02-19T21:43:19.137961+0000","last_clean":"2024-02-19T21:43:19.137961+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:43:19.137961+0000","last_undegraded":"2024-02-19T21:43:19.137961+0000","last_fullsized":"2024-02-19T21:43:19.137961+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:29.972337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:42.527849+0000","last_clean_scrub_stamp":"2024-02-19T21:38:29.972337+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":210,"reported_epoch":240,"state":"active+clean","last_fresh":"2024-02-19T21:43:18.121718+0000","last_change":"2024-02-19T21:39:51.535010+0000","last_active":"2024-02-19T21:43:18.121718+0000","last_peered":"2024-02-19T21:43:18.121718+0000","last_clean":"2024-02-19T21:43:18.121718+0000","last_became_active":"2024-02-19T21:39:51.534750+0000","last_became_peered":"2024-02-19T21:39:51.534750+0000","last_unstale":"2024-02-19T21:43:18.121718+0000","last_undegraded":"2024-02-19T21:43:18.121718+0000","last_fullsized":"2024-02-19T21:43:18.121718+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:33.360066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:33.360066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":218,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.118611+0000","last_change":"2024-02-19T21:41:35.736077+0000","last_active":"2024-02-19T21:43:21.118611+0000","last_peered":"2024-02-19T21:43:21.118611+0000","last_clean":"2024-02-19T21:43:21.118611+0000","last_became_active":"2024-02-19T21:32:23.357338+0000","last_became_peered":"2024-02-19T21:32:23.357338+0000","last_unstale":"2024-02-19T21:43:21.118611+0000","last_undegraded":"2024-02-19T21:43:21.118611+0000","last_fullsized":"2024-02-19T21:43:21.118611+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:35.735995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:41:35.735995+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"200'15","reported_seq":251,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.102888+0000","last_change":"2024-02-19T21:39:45.026756+0000","last_active":"2024-02-19T21:43:21.102888+0000","last_peered":"2024-02-19T21:43:21.102888+0000","last_clean":"2024-02-19T21:43:21.102888+0000","last_became_active":"2024-02-19T21:39:39.466843+0000","last_became_peered":"2024-02-19T21:39:39.466843+0000","last_unstale":"2024-02-19T21:43:21.102888+0000","last_undegraded":"2024-02-19T21:43:21.102888+0000","last_fullsized":"2024-02-19T21:43:21.102888+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:39:45.026689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:45.026689+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"199'13","reported_seq":165,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.991448+0000","last_change":"2024-02-19T21:42:04.202258+0000","last_active":"2024-02-19T21:43:21.991448+0000","last_peered":"2024-02-19T21:43:21.991448+0000","last_clean":"2024-02-19T21:43:21.991448+0000","last_became_active":"2024-02-19T21:42:04.195103+0000","last_became_peered":"2024-02-19T21:42:04.195103+0000","last_unstale":"2024-02-19T21:43:21.991448+0000","last_undegraded":"2024-02-19T21:43:21.991448+0000","last_fullsized":"2024-02-19T21:43:21.991448+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'11","last_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:39:46.054888+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":221,"reported_epoch":241,"state":"active+clean","last_fresh":"2024-02-19T21:43:19.139045+0000","last_change":"2024-02-19T21:40:33.532430+0000","last_active":"2024-02-19T21:43:19.139045+0000","last_peered":"2024-02-19T21:43:19.139045+0000","last_clean":"2024-02-19T21:43:19.139045+0000","last_became_active":"2024-02-19T21:32:23.361680+0000","last_became_peered":"2024-02-19T21:32:23.361680+0000","last_unstale":"2024-02-19T21:43:19.139045+0000","last_undegraded":"2024-02-19T21:43:19.139045+0000","last_fullsized":"2024-02-19T21:43:19.139045+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:33.532354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:33.550655+0000","last_clean_scrub_stamp":"2024-02-19T21:40:33.532354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"201'19","reported_seq":240,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.111506+0000","last_change":"2024-02-19T21:40:37.730352+0000","last_active":"2024-02-19T21:43:21.111506+0000","last_peered":"2024-02-19T21:43:21.111506+0000","last_clean":"2024-02-19T21:43:21.111506+0000","last_became_active":"2024-02-19T21:32:25.372206+0000","last_became_peered":"2024-02-19T21:32:25.372206+0000","last_unstale":"2024-02-19T21:43:21.111506+0000","last_undegraded":"2024-02-19T21:43:21.111506+0000","last_fullsized":"2024-02-19T21:43:21.111506+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'13","last_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:40:37.730197+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":350,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.991666+0000","last_change":"2024-02-19T21:40:32.679041+0000","last_active":"2024-02-19T21:43:21.991666+0000","last_peered":"2024-02-19T21:43:21.991666+0000","last_clean":"2024-02-19T21:43:21.991666+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:43:21.991666+0000","last_undegraded":"2024-02-19T21:43:21.991666+0000","last_fullsized":"2024-02-19T21:43:21.991666+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:40:32.678933+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":224,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.104815+0000","last_change":"2024-02-19T21:42:04.205987+0000","last_active":"2024-02-19T21:43:21.104815+0000","last_peered":"2024-02-19T21:43:21.104815+0000","last_clean":"2024-02-19T21:43:21.104815+0000","last_became_active":"2024-02-19T21:42:04.205401+0000","last_became_peered":"2024-02-19T21:42:04.205401+0000","last_unstale":"2024-02-19T21:43:21.104815+0000","last_undegraded":"2024-02-19T21:43:21.104815+0000","last_fullsized":"2024-02-19T21:43:21.104815+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:25.759697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:40:25.759697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"201'25","reported_seq":243,"reported_epoch":240,"state":"active+clean","last_fresh":"2024-02-19T21:43:18.122288+0000","last_change":"2024-02-19T21:40:39.592088+0000","last_active":"2024-02-19T21:43:18.122288+0000","last_peered":"2024-02-19T21:43:18.122288+0000","last_clean":"2024-02-19T21:43:18.122288+0000","last_became_active":"2024-02-19T21:32:25.372060+0000","last_became_peered":"2024-02-19T21:32:25.372060+0000","last_unstale":"2024-02-19T21:43:18.122288+0000","last_undegraded":"2024-02-19T21:43:18.122288+0000","last_fullsized":"2024-02-19T21:43:18.122288+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'15","last_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:40:39.591994+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":211,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.103854+0000","last_change":"2024-02-19T21:40:31.892048+0000","last_active":"2024-02-19T21:43:21.103854+0000","last_peered":"2024-02-19T21:43:21.103854+0000","last_clean":"2024-02-19T21:43:21.103854+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:43:21.103854+0000","last_undegraded":"2024-02-19T21:43:21.103854+0000","last_fullsized":"2024-02-19T21:43:21.103854+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:31.891967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_clean_scrub_stamp":"2024-02-19T21:40:31.891967+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":204,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.104142+0000","last_change":"2024-02-19T21:39:36.067452+0000","last_active":"2024-02-19T21:43:21.104142+0000","last_peered":"2024-02-19T21:43:21.104142+0000","last_clean":"2024-02-19T21:43:21.104142+0000","last_became_active":"2024-02-19T21:32:27.369002+0000","last_became_peered":"2024-02-19T21:32:27.369002+0000","last_unstale":"2024-02-19T21:43:21.104142+0000","last_undegraded":"2024-02-19T21:43:21.104142+0000","last_fullsized":"2024-02-19T21:43:21.104142+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:36.067354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:36.067354+0000","last_clean_scrub_stamp":"2024-02-19T21:39:36.067354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":213,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.114609+0000","last_change":"2024-02-19T21:40:29.421893+0000","last_active":"2024-02-19T21:43:21.114609+0000","last_peered":"2024-02-19T21:43:21.114609+0000","last_clean":"2024-02-19T21:43:21.114609+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:43:21.114609+0000","last_undegraded":"2024-02-19T21:43:21.114609+0000","last_fullsized":"2024-02-19T21:43:21.114609+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:29.421791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:29.421791+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"201'12","reported_seq":96,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.104836+0000","last_change":"2024-02-19T21:42:04.203612+0000","last_active":"2024-02-19T21:43:21.104836+0000","last_peered":"2024-02-19T21:43:21.104836+0000","last_clean":"2024-02-19T21:43:21.104836+0000","last_became_active":"2024-02-19T21:42:04.192291+0000","last_became_peered":"2024-02-19T21:42:04.192291+0000","last_unstale":"2024-02-19T21:43:21.104836+0000","last_undegraded":"2024-02-19T21:43:21.104836+0000","last_fullsized":"2024-02-19T21:43:21.104836+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'6","last_scrub_stamp":"2024-02-19T21:39:24.011489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:24.011489+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":95,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.115244+0000","last_change":"2024-02-19T21:39:41.367764+0000","last_active":"2024-02-19T21:43:21.115244+0000","last_peered":"2024-02-19T21:43:21.115244+0000","last_clean":"2024-02-19T21:43:21.115244+0000","last_became_active":"2024-02-19T21:39:39.469477+0000","last_became_peered":"2024-02-19T21:39:39.469477+0000","last_unstale":"2024-02-19T21:43:21.115244+0000","last_undegraded":"2024-02-19T21:43:21.115244+0000","last_fullsized":"2024-02-19T21:43:21.115244+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:41.367692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:41.367692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":125,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.104775+0000","last_change":"2024-02-19T21:42:04.195734+0000","last_active":"2024-02-19T21:43:21.104775+0000","last_peered":"2024-02-19T21:43:21.104775+0000","last_clean":"2024-02-19T21:43:21.104775+0000","last_became_active":"2024-02-19T21:42:04.195167+0000","last_became_peered":"2024-02-19T21:42:04.195167+0000","last_unstale":"2024-02-19T21:43:21.104775+0000","last_undegraded":"2024-02-19T21:43:21.104775+0000","last_fullsized":"2024-02-19T21:43:21.104775+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:34.284787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:34.284787+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":90,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.103128+0000","last_change":"2024-02-19T21:39:39.477623+0000","last_active":"2024-02-19T21:43:21.103128+0000","last_peered":"2024-02-19T21:43:21.103128+0000","last_clean":"2024-02-19T21:43:21.103128+0000","last_became_active":"2024-02-19T21:39:39.477308+0000","last_became_peered":"2024-02-19T21:39:39.477308+0000","last_unstale":"2024-02-19T21:43:21.103128+0000","last_undegraded":"2024-02-19T21:43:21.103128+0000","last_fullsized":"2024-02-19T21:43:21.103128+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:26.250620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:38:26.250620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"200'15","reported_seq":292,"reported_epoch":241,"state":"active+clean","last_fresh":"2024-02-19T21:43:19.140590+0000","last_change":"2024-02-19T21:42:04.226031+0000","last_active":"2024-02-19T21:43:19.140590+0000","last_peered":"2024-02-19T21:43:19.140590+0000","last_clean":"2024-02-19T21:43:19.140590+0000","last_became_active":"2024-02-19T21:42:04.207069+0000","last_became_peered":"2024-02-19T21:42:04.207069+0000","last_unstale":"2024-02-19T21:43:19.140590+0000","last_undegraded":"2024-02-19T21:43:19.140590+0000","last_fullsized":"2024-02-19T21:43:19.140590+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:39:46.193426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:46.193426+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"244'15078","reported_seq":15165,"reported_epoch":244,"state":"active+clean","last_fresh":"2024-02-19T21:43:24.905448+0000","last_change":"2024-02-19T21:39:39.469485+0000","last_active":"2024-02-19T21:43:24.905448+0000","last_peered":"2024-02-19T21:43:24.905448+0000","last_clean":"2024-02-19T21:43:24.905448+0000","last_became_active":"2024-02-19T21:39:39.469130+0000","last_became_peered":"2024-02-19T21:39:39.469130+0000","last_unstale":"2024-02-19T21:43:24.905448+0000","last_undegraded":"2024-02-19T21:43:24.905448+0000","last_fullsized":"2024-02-19T21:43:24.905448+0000","mapping_epoch":165,"log_start":"200'10714","ondisk_log_start":"200'10714","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4364,"ondisk_log_size":4364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":58720256,"num_objects":896,"num_object_clones":0,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15078,"num_write_kb":511168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":231,"reported_epoch":240,"state":"active+clean","last_fresh":"2024-02-19T21:43:18.121788+0000","last_change":"2024-02-19T21:43:02.217061+0000","last_active":"2024-02-19T21:43:18.121788+0000","last_peered":"2024-02-19T21:43:18.121788+0000","last_clean":"2024-02-19T21:43:18.121788+0000","last_became_active":"2024-02-19T21:43:02.216721+0000","last_became_peered":"2024-02-19T21:43:02.216721+0000","last_unstale":"2024-02-19T21:43:18.121788+0000","last_undegraded":"2024-02-19T21:43:18.121788+0000","last_fullsized":"2024-02-19T21:43:18.121788+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:35.539219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:40:35.539219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"59'2","reported_seq":241,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.115829+0000","last_change":"2024-02-19T21:41:24.914001+0000","last_active":"2024-02-19T21:43:21.115829+0000","last_peered":"2024-02-19T21:43:21.115829+0000","last_clean":"2024-02-19T21:43:21.115829+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:43:21.115829+0000","last_undegraded":"2024-02-19T21:43:21.115829+0000","last_fullsized":"2024-02-19T21:43:21.115829+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-02-19T21:41:24.913925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:41:24.913925+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"200'23","reported_seq":253,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.107017+0000","last_change":"2024-02-19T21:40:37.318743+0000","last_active":"2024-02-19T21:43:21.107017+0000","last_peered":"2024-02-19T21:43:21.107017+0000","last_clean":"2024-02-19T21:43:21.107017+0000","last_became_active":"2024-02-19T21:38:31.247821+0000","last_became_peered":"2024-02-19T21:38:31.247821+0000","last_unstale":"2024-02-19T21:43:21.107017+0000","last_undegraded":"2024-02-19T21:43:21.107017+0000","last_fullsized":"2024-02-19T21:43:21.107017+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'17","last_scrub_stamp":"2024-02-19T21:40:37.318642+0000","last_deep_scrub":"83'17","last_deep_scrub_stamp":"2024-02-19T21:33:43.418450+0000","last_clean_scrub_stamp":"2024-02-19T21:40:37.318642+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":88,"reported_epoch":241,"state":"active+clean","last_fresh":"2024-02-19T21:43:19.138605+0000","last_change":"2024-02-19T21:39:39.467760+0000","last_active":"2024-02-19T21:43:19.138605+0000","last_peered":"2024-02-19T21:43:19.138605+0000","last_clean":"2024-02-19T21:43:19.138605+0000","last_became_active":"2024-02-19T21:39:39.467210+0000","last_became_peered":"2024-02-19T21:39:39.467210+0000","last_unstale":"2024-02-19T21:43:19.138605+0000","last_undegraded":"2024-02-19T21:43:19.138605+0000","last_fullsized":"2024-02-19T21:43:19.138605+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:37.384723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:37.384723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"241'14968","reported_seq":15053,"reported_epoch":241,"state":"active+clean","last_fresh":"2024-02-19T21:43:20.077260+0000","last_change":"2024-02-19T21:39:39.471871+0000","last_active":"2024-02-19T21:43:20.077260+0000","last_peered":"2024-02-19T21:43:20.077260+0000","last_clean":"2024-02-19T21:43:20.077260+0000","last_became_active":"2024-02-19T21:39:39.471575+0000","last_became_peered":"2024-02-19T21:39:39.471575+0000","last_unstale":"2024-02-19T21:43:20.077260+0000","last_undegraded":"2024-02-19T21:43:20.077260+0000","last_fullsized":"2024-02-19T21:43:20.077260+0000","mapping_epoch":165,"log_start":"199'10515","ondisk_log_start":"199'10515","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4453,"ondisk_log_size":4453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":81788928,"num_objects":1248,"num_object_clones":0,"num_object_copies":3744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1248,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14968,"num_write_kb":518912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":233,"reported_epoch":241,"state":"active+clean","last_fresh":"2024-02-19T21:43:19.137885+0000","last_change":"2024-02-19T21:41:42.246007+0000","last_active":"2024-02-19T21:43:19.137885+0000","last_peered":"2024-02-19T21:43:19.137885+0000","last_clean":"2024-02-19T21:43:19.137885+0000","last_became_active":"2024-02-19T21:41:42.245788+0000","last_became_peered":"2024-02-19T21:41:42.245788+0000","last_unstale":"2024-02-19T21:43:19.137885+0000","last_undegraded":"2024-02-19T21:43:19.137885+0000","last_fullsized":"2024-02-19T21:43:19.137885+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:40.474333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:40.474333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":209,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.103068+0000","last_change":"2024-02-19T21:39:34.971980+0000","last_active":"2024-02-19T21:43:21.103068+0000","last_peered":"2024-02-19T21:43:21.103068+0000","last_clean":"2024-02-19T21:43:21.103068+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:43:21.103068+0000","last_undegraded":"2024-02-19T21:43:21.103068+0000","last_fullsized":"2024-02-19T21:43:21.103068+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:34.971917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:39:34.971917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"201'20","reported_seq":120,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.102978+0000","last_change":"2024-02-19T21:41:22.195267+0000","last_active":"2024-02-19T21:43:21.102978+0000","last_peered":"2024-02-19T21:43:21.102978+0000","last_clean":"2024-02-19T21:43:21.102978+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:43:21.102978+0000","last_undegraded":"2024-02-19T21:43:21.102978+0000","last_fullsized":"2024-02-19T21:43:21.102978+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:41:22.195164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:41:22.195164+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":349,"reported_epoch":241,"state":"active+clean","last_fresh":"2024-02-19T21:43:19.139227+0000","last_change":"2024-02-19T21:40:25.363354+0000","last_active":"2024-02-19T21:43:19.139227+0000","last_peered":"2024-02-19T21:43:19.139227+0000","last_clean":"2024-02-19T21:43:19.139227+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:43:19.139227+0000","last_undegraded":"2024-02-19T21:43:19.139227+0000","last_fullsized":"2024-02-19T21:43:19.139227+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:40:25.363236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:25.363236+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"244'15076","reported_seq":17517,"reported_epoch":244,"state":"active+remapped+backfilling","last_fresh":"2024-02-19T21:43:24.991154+0000","last_change":"2024-02-19T21:42:36.512210+0000","last_active":"2024-02-19T21:43:24.991154+0000","last_peered":"2024-02-19T21:43:24.991154+0000","last_clean":"2024-02-19T21:41:41.233905+0000","last_became_active":"2024-02-19T21:41:43.731261+0000","last_became_peered":"2024-02-19T21:41:43.731261+0000","last_unstale":"2024-02-19T21:43:24.991154+0000","last_undegraded":"2024-02-19T21:43:24.991154+0000","last_fullsized":"2024-02-19T21:43:24.991154+0000","mapping_epoch":190,"log_start":"200'10594","ondisk_log_start":"200'10594","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4482,"ondisk_log_size":4482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":61865984,"num_objects":944,"num_object_clones":0,"num_object_copies":2832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":604,"num_objects_unfound":0,"num_objects_dirty":944,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15076,"num_write_kb":512640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1168,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,7,0],"avail_no_missing":["5","0","7"],"object_location_counts":[{"shards":"0,5,7","objects":944}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":139,"reported_epoch":244,"state":"active+clean","last_fresh":"2024-02-19T21:43:22.148986+0000","last_change":"2024-02-19T21:43:22.148986+0000","last_active":"2024-02-19T21:43:22.148986+0000","last_peered":"2024-02-19T21:43:22.148986+0000","last_clean":"2024-02-19T21:43:22.148986+0000","last_became_active":"2024-02-19T21:43:22.148701+0000","last_became_peered":"2024-02-19T21:43:22.148701+0000","last_unstale":"2024-02-19T21:43:22.148986+0000","last_undegraded":"2024-02-19T21:43:22.148986+0000","last_fullsized":"2024-02-19T21:43:22.148986+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:27.767442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:27.767442+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":213,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.104883+0000","last_change":"2024-02-19T21:39:27.079886+0000","last_active":"2024-02-19T21:43:21.104883+0000","last_peered":"2024-02-19T21:43:21.104883+0000","last_clean":"2024-02-19T21:43:21.104883+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:43:21.104883+0000","last_undegraded":"2024-02-19T21:43:21.104883+0000","last_fullsized":"2024-02-19T21:43:21.104883+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:27.079784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:39:27.079784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"201'43","reported_seq":499,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.991628+0000","last_change":"2024-02-19T21:42:04.218868+0000","last_active":"2024-02-19T21:43:21.991628+0000","last_peered":"2024-02-19T21:43:21.991628+0000","last_clean":"2024-02-19T21:43:21.991628+0000","last_became_active":"2024-02-19T21:42:04.196382+0000","last_became_peered":"2024-02-19T21:42:04.196382+0000","last_unstale":"2024-02-19T21:43:21.991628+0000","last_undegraded":"2024-02-19T21:43:21.991628+0000","last_fullsized":"2024-02-19T21:43:21.991628+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'30","last_scrub_stamp":"2024-02-19T21:39:43.996511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:43.996511+0000","log_size":43,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":1074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,5],"acting":[1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":203,"reported_epoch":241,"state":"active+clean","last_fresh":"2024-02-19T21:43:19.138422+0000","last_change":"2024-02-19T21:38:16.890343+0000","last_active":"2024-02-19T21:43:19.138422+0000","last_peered":"2024-02-19T21:43:19.138422+0000","last_clean":"2024-02-19T21:43:19.138422+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:43:19.138422+0000","last_undegraded":"2024-02-19T21:43:19.138422+0000","last_fullsized":"2024-02-19T21:43:19.138422+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:16.890269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:16.890269+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"244'15095","reported_seq":16882,"reported_epoch":244,"state":"active+remapped+backfilling","last_fresh":"2024-02-19T21:43:24.919143+0000","last_change":"2024-02-19T21:42:05.313986+0000","last_active":"2024-02-19T21:43:24.919143+0000","last_peered":"2024-02-19T21:43:24.919143+0000","last_clean":"2024-02-19T21:42:03.157828+0000","last_became_active":"2024-02-19T21:42:05.261493+0000","last_became_peered":"2024-02-19T21:42:05.261493+0000","last_unstale":"2024-02-19T21:43:24.919143+0000","last_undegraded":"2024-02-19T21:43:24.919143+0000","last_fullsized":"2024-02-19T21:43:24.919143+0000","mapping_epoch":198,"log_start":"199'10329","ondisk_log_start":"199'10329","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"188'8618","last_scrub_stamp":"2024-02-19T21:41:36.200222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:41:36.200222+0000","log_size":4766,"ondisk_log_size":4766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":57999360,"num_objects":885,"num_object_clones":0,"num_object_copies":2655,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":613,"num_objects_unfound":0,"num_objects_dirty":885,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15095,"num_write_kb":511360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":843,"num_bytes_recovered":55246848,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,7],"avail_no_missing":["4","1","7"],"object_location_counts":[{"shards":"1,4,7","objects":885}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":202,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.104069+0000","last_change":"2024-02-19T21:39:29.085751+0000","last_active":"2024-02-19T21:43:21.104069+0000","last_peered":"2024-02-19T21:43:21.104069+0000","last_clean":"2024-02-19T21:43:21.104069+0000","last_became_active":"2024-02-19T21:32:29.597365+0000","last_became_peered":"2024-02-19T21:32:29.597365+0000","last_unstale":"2024-02-19T21:43:21.104069+0000","last_undegraded":"2024-02-19T21:43:21.104069+0000","last_fullsized":"2024-02-19T21:43:21.104069+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:29.085642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:29.085642+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"67'5","reported_seq":876,"reported_epoch":244,"state":"active+clean","last_fresh":"2024-02-19T21:43:23.252639+0000","last_change":"2024-02-19T21:39:39.576551+0000","last_active":"2024-02-19T21:43:23.252639+0000","last_peered":"2024-02-19T21:43:23.252639+0000","last_clean":"2024-02-19T21:43:23.252639+0000","last_became_active":"2024-02-19T21:39:39.464361+0000","last_became_peered":"2024-02-19T21:39:39.464361+0000","last_unstale":"2024-02-19T21:43:23.252639+0000","last_undegraded":"2024-02-19T21:43:23.252639+0000","last_fullsized":"2024-02-19T21:43:23.252639+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5","last_scrub_stamp":"2024-02-19T21:38:17.997743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:38:17.997743+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":648,"num_read_kb":643,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":209,"reported_epoch":241,"state":"active+clean","last_fresh":"2024-02-19T21:43:19.137822+0000","last_change":"2024-02-19T21:41:36.636023+0000","last_active":"2024-02-19T21:43:19.137822+0000","last_peered":"2024-02-19T21:43:19.137822+0000","last_clean":"2024-02-19T21:43:19.137822+0000","last_became_active":"2024-02-19T21:39:39.468113+0000","last_became_peered":"2024-02-19T21:39:39.468113+0000","last_unstale":"2024-02-19T21:43:19.137822+0000","last_undegraded":"2024-02-19T21:43:19.137822+0000","last_fullsized":"2024-02-19T21:43:19.137822+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:36.635936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:41:36.635936+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"200'17","reported_seq":252,"reported_epoch":244,"state":"active+clean","last_fresh":"2024-02-19T21:43:24.275920+0000","last_change":"2024-02-19T21:43:24.276336+0000","last_active":"2024-02-19T21:43:24.275920+0000","last_peered":"2024-02-19T21:43:24.275920+0000","last_clean":"2024-02-19T21:43:24.275920+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:43:24.275920+0000","last_undegraded":"2024-02-19T21:43:24.275920+0000","last_fullsized":"2024-02-19T21:43:24.275920+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'13","last_scrub_stamp":"2024-02-19T21:37:32.805993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:32.805993+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":25,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":95,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.104425+0000","last_change":"2024-02-19T21:41:29.640521+0000","last_active":"2024-02-19T21:43:21.104425+0000","last_peered":"2024-02-19T21:43:21.104425+0000","last_clean":"2024-02-19T21:43:21.104425+0000","last_became_active":"2024-02-19T21:39:39.475190+0000","last_became_peered":"2024-02-19T21:39:39.475190+0000","last_unstale":"2024-02-19T21:43:21.104425+0000","last_undegraded":"2024-02-19T21:43:21.104425+0000","last_fullsized":"2024-02-19T21:43:21.104425+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:29.640431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:29.640431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"244'14812","reported_seq":14899,"reported_epoch":244,"state":"active+clean","last_fresh":"2024-02-19T21:43:24.912721+0000","last_change":"2024-02-19T21:39:39.475831+0000","last_active":"2024-02-19T21:43:24.912721+0000","last_peered":"2024-02-19T21:43:24.912721+0000","last_clean":"2024-02-19T21:43:24.912721+0000","last_became_active":"2024-02-19T21:39:39.475531+0000","last_became_peered":"2024-02-19T21:39:39.475531+0000","last_unstale":"2024-02-19T21:43:24.912721+0000","last_undegraded":"2024-02-19T21:43:24.912721+0000","last_fullsized":"2024-02-19T21:43:24.912721+0000","mapping_epoch":165,"log_start":"200'10435","ondisk_log_start":"200'10435","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4377,"ondisk_log_size":4377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60948480,"num_objects":930,"num_object_clones":0,"num_object_copies":2790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":930,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14812,"num_write_kb":503744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":225,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.106735+0000","last_change":"2024-02-19T21:43:18.128190+0000","last_active":"2024-02-19T21:43:21.106735+0000","last_peered":"2024-02-19T21:43:21.106735+0000","last_clean":"2024-02-19T21:43:21.106735+0000","last_became_active":"2024-02-19T21:43:18.127939+0000","last_became_peered":"2024-02-19T21:43:18.127939+0000","last_unstale":"2024-02-19T21:43:21.106735+0000","last_undegraded":"2024-02-19T21:43:21.106735+0000","last_fullsized":"2024-02-19T21:43:21.106735+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:33.758127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:40:33.758127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":116,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.105010+0000","last_change":"2024-02-19T21:40:30.692471+0000","last_active":"2024-02-19T21:43:21.105010+0000","last_peered":"2024-02-19T21:43:21.105010+0000","last_clean":"2024-02-19T21:43:21.105010+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:43:21.105010+0000","last_undegraded":"2024-02-19T21:43:21.105010+0000","last_fullsized":"2024-02-19T21:43:21.105010+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:30.692385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:40:30.692385+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":231,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.107592+0000","last_change":"2024-02-19T21:42:04.213108+0000","last_active":"2024-02-19T21:43:21.107592+0000","last_peered":"2024-02-19T21:43:21.107592+0000","last_clean":"2024-02-19T21:43:21.107592+0000","last_became_active":"2024-02-19T21:42:04.212730+0000","last_became_peered":"2024-02-19T21:42:04.212730+0000","last_unstale":"2024-02-19T21:43:21.107592+0000","last_undegraded":"2024-02-19T21:43:21.107592+0000","last_fullsized":"2024-02-19T21:43:21.107592+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:39.714982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:39.714982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":92,"reported_epoch":241,"state":"active+clean","last_fresh":"2024-02-19T21:43:19.138086+0000","last_change":"2024-02-19T21:42:04.197235+0000","last_active":"2024-02-19T21:43:19.138086+0000","last_peered":"2024-02-19T21:43:19.138086+0000","last_clean":"2024-02-19T21:43:19.138086+0000","last_became_active":"2024-02-19T21:42:04.196943+0000","last_became_peered":"2024-02-19T21:42:04.196943+0000","last_unstale":"2024-02-19T21:43:19.138086+0000","last_undegraded":"2024-02-19T21:43:19.138086+0000","last_fullsized":"2024-02-19T21:43:19.138086+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:38.927472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:40:38.927472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,1],"acting":[0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"201'33","reported_seq":258,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.115585+0000","last_change":"2024-02-19T21:40:24.331961+0000","last_active":"2024-02-19T21:43:21.115585+0000","last_peered":"2024-02-19T21:43:21.115585+0000","last_clean":"2024-02-19T21:43:21.115585+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:43:21.115585+0000","last_undegraded":"2024-02-19T21:43:21.115585+0000","last_fullsized":"2024-02-19T21:43:21.115585+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"143'21","last_scrub_stamp":"2024-02-19T21:40:24.331869+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:40:24.331869+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":184,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.104957+0000","last_change":"2024-02-19T21:42:04.205688+0000","last_active":"2024-02-19T21:43:21.104957+0000","last_peered":"2024-02-19T21:43:21.104957+0000","last_clean":"2024-02-19T21:43:21.104957+0000","last_became_active":"2024-02-19T21:42:04.205342+0000","last_became_peered":"2024-02-19T21:42:04.205342+0000","last_unstale":"2024-02-19T21:43:21.104957+0000","last_undegraded":"2024-02-19T21:43:21.104957+0000","last_fullsized":"2024-02-19T21:43:21.104957+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:22.826680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:22.826680+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"244'14926","reported_seq":15013,"reported_epoch":244,"state":"active+clean","last_fresh":"2024-02-19T21:43:24.975694+0000","last_change":"2024-02-19T21:39:39.480146+0000","last_active":"2024-02-19T21:43:24.975694+0000","last_peered":"2024-02-19T21:43:24.975694+0000","last_clean":"2024-02-19T21:43:24.975694+0000","last_became_active":"2024-02-19T21:39:39.479576+0000","last_became_peered":"2024-02-19T21:39:39.479576+0000","last_unstale":"2024-02-19T21:43:24.975694+0000","last_undegraded":"2024-02-19T21:43:24.975694+0000","last_fullsized":"2024-02-19T21:43:24.975694+0000","mapping_epoch":165,"log_start":"200'10897","ondisk_log_start":"200'10897","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4029,"ondisk_log_size":4029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":63832064,"num_objects":974,"num_object_clones":0,"num_object_copies":2922,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":974,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14926,"num_write_kb":508800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":212,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.104304+0000","last_change":"2024-02-19T21:40:29.250688+0000","last_active":"2024-02-19T21:43:21.104304+0000","last_peered":"2024-02-19T21:43:21.104304+0000","last_clean":"2024-02-19T21:43:21.104304+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:43:21.104304+0000","last_undegraded":"2024-02-19T21:43:21.104304+0000","last_fullsized":"2024-02-19T21:43:21.104304+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:40:29.250599+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":221,"reported_epoch":241,"state":"active+clean","last_fresh":"2024-02-19T21:43:19.137910+0000","last_change":"2024-02-19T21:41:22.644476+0000","last_active":"2024-02-19T21:43:19.137910+0000","last_peered":"2024-02-19T21:43:19.137910+0000","last_clean":"2024-02-19T21:43:19.137910+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:43:19.137910+0000","last_undegraded":"2024-02-19T21:43:19.137910+0000","last_fullsized":"2024-02-19T21:43:19.137910+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:22.644405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:41:22.644405+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":226,"reported_epoch":244,"state":"active+clean","last_fresh":"2024-02-19T21:43:22.944450+0000","last_change":"2024-02-19T21:43:22.945609+0000","last_active":"2024-02-19T21:43:22.944450+0000","last_peered":"2024-02-19T21:43:22.944450+0000","last_clean":"2024-02-19T21:43:22.944450+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:43:22.944450+0000","last_undegraded":"2024-02-19T21:43:22.944450+0000","last_fullsized":"2024-02-19T21:43:22.944450+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:30.117032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:39:30.117032+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"200'24","reported_seq":314,"reported_epoch":241,"state":"active+clean","last_fresh":"2024-02-19T21:43:19.140577+0000","last_change":"2024-02-19T21:42:04.647669+0000","last_active":"2024-02-19T21:43:19.140577+0000","last_peered":"2024-02-19T21:43:19.140577+0000","last_clean":"2024-02-19T21:43:19.140577+0000","last_became_active":"2024-02-19T21:42:04.206790+0000","last_became_peered":"2024-02-19T21:42:04.206790+0000","last_unstale":"2024-02-19T21:43:19.140577+0000","last_undegraded":"2024-02-19T21:43:19.140577+0000","last_fullsized":"2024-02-19T21:43:19.140577+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'12","last_scrub_stamp":"2024-02-19T21:38:18.908732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:38:18.908732+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":209,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.106645+0000","last_change":"2024-02-19T21:41:23.683433+0000","last_active":"2024-02-19T21:43:21.106645+0000","last_peered":"2024-02-19T21:43:21.106645+0000","last_clean":"2024-02-19T21:43:21.106645+0000","last_became_active":"2024-02-19T21:32:27.372460+0000","last_became_peered":"2024-02-19T21:32:27.372460+0000","last_unstale":"2024-02-19T21:43:21.106645+0000","last_undegraded":"2024-02-19T21:43:21.106645+0000","last_fullsized":"2024-02-19T21:43:21.106645+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:23.683337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:23.683337+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"241'14590","reported_seq":14674,"reported_epoch":241,"state":"active+clean","last_fresh":"2024-02-19T21:43:20.023481+0000","last_change":"2024-02-19T21:39:39.468511+0000","last_active":"2024-02-19T21:43:20.023481+0000","last_peered":"2024-02-19T21:43:20.023481+0000","last_clean":"2024-02-19T21:43:20.023481+0000","last_became_active":"2024-02-19T21:39:39.468217+0000","last_became_peered":"2024-02-19T21:39:39.468217+0000","last_unstale":"2024-02-19T21:43:20.023481+0000","last_undegraded":"2024-02-19T21:43:20.023481+0000","last_fullsized":"2024-02-19T21:43:20.023481+0000","mapping_epoch":165,"log_start":"184'5581","ondisk_log_start":"184'5581","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":9009,"ondisk_log_size":9009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":78774272,"num_objects":1202,"num_object_clones":0,"num_object_copies":3606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1202,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14590,"num_write_kb":505344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":221,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.107217+0000","last_change":"2024-02-19T21:42:04.193367+0000","last_active":"2024-02-19T21:43:21.107217+0000","last_peered":"2024-02-19T21:43:21.107217+0000","last_clean":"2024-02-19T21:43:21.107217+0000","last_became_active":"2024-02-19T21:42:04.193058+0000","last_became_peered":"2024-02-19T21:42:04.193058+0000","last_unstale":"2024-02-19T21:43:21.107217+0000","last_undegraded":"2024-02-19T21:43:21.107217+0000","last_fullsized":"2024-02-19T21:43:21.107217+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:39:42.020832+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":208,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.104142+0000","last_change":"2024-02-19T21:40:11.877814+0000","last_active":"2024-02-19T21:43:21.104142+0000","last_peered":"2024-02-19T21:43:21.104142+0000","last_clean":"2024-02-19T21:43:21.104142+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:43:21.104142+0000","last_undegraded":"2024-02-19T21:43:21.104142+0000","last_fullsized":"2024-02-19T21:43:21.104142+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:11.877751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:11.877751+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"201'37","reported_seq":269,"reported_epoch":241,"state":"active+clean","last_fresh":"2024-02-19T21:43:19.139344+0000","last_change":"2024-02-19T21:40:26.405558+0000","last_active":"2024-02-19T21:43:19.139344+0000","last_peered":"2024-02-19T21:43:19.139344+0000","last_clean":"2024-02-19T21:43:19.139344+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:43:19.139344+0000","last_undegraded":"2024-02-19T21:43:19.139344+0000","last_fullsized":"2024-02-19T21:43:19.139344+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'27","last_scrub_stamp":"2024-02-19T21:40:26.405455+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:40:26.405455+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":211,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.115917+0000","last_change":"2024-02-19T21:40:16.260329+0000","last_active":"2024-02-19T21:43:21.115917+0000","last_peered":"2024-02-19T21:43:21.115917+0000","last_clean":"2024-02-19T21:43:21.115917+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:43:21.115917+0000","last_undegraded":"2024-02-19T21:43:21.115917+0000","last_fullsized":"2024-02-19T21:43:21.115917+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:16.260223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:40:16.260223+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.c","version":"241'14887","reported_seq":23755,"reported_epoch":241,"state":"active+clean","last_fresh":"2024-02-19T21:43:20.083844+0000","last_change":"2024-02-19T21:42:45.605098+0000","last_active":"2024-02-19T21:43:20.083844+0000","last_peered":"2024-02-19T21:43:20.083844+0000","last_clean":"2024-02-19T21:43:20.083844+0000","last_became_active":"2024-02-19T21:42:45.572060+0000","last_became_peered":"2024-02-19T21:42:45.572060+0000","last_unstale":"2024-02-19T21:43:20.083844+0000","last_undegraded":"2024-02-19T21:43:20.083844+0000","last_fullsized":"2024-02-19T21:43:20.083844+0000","mapping_epoch":208,"log_start":"199'10402","ondisk_log_start":"199'10402","created":165,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4485,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":81592320,"num_objects":1245,"num_object_clones":0,"num_object_copies":3735,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1245,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14887,"num_write_kb":516224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4380,"num_bytes_recovered":287047680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":110,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.115438+0000","last_change":"2024-02-19T21:42:04.200629+0000","last_active":"2024-02-19T21:43:21.115438+0000","last_peered":"2024-02-19T21:43:21.115438+0000","last_clean":"2024-02-19T21:43:21.115438+0000","last_became_active":"2024-02-19T21:42:04.200292+0000","last_became_peered":"2024-02-19T21:42:04.200292+0000","last_unstale":"2024-02-19T21:43:21.115438+0000","last_undegraded":"2024-02-19T21:43:21.115438+0000","last_fullsized":"2024-02-19T21:43:21.115438+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:44.231420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:44.231420+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,5],"acting":[6,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":211,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.105450+0000","last_change":"2024-02-19T21:38:28.036423+0000","last_active":"2024-02-19T21:43:21.105450+0000","last_peered":"2024-02-19T21:43:21.105450+0000","last_clean":"2024-02-19T21:43:21.105450+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:43:21.105450+0000","last_undegraded":"2024-02-19T21:43:21.105450+0000","last_fullsized":"2024-02-19T21:43:21.105450+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:38:28.036351+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"201'38","reported_seq":190,"reported_epoch":241,"state":"active+clean","last_fresh":"2024-02-19T21:43:19.138184+0000","last_change":"2024-02-19T21:42:05.431988+0000","last_active":"2024-02-19T21:43:19.138184+0000","last_peered":"2024-02-19T21:43:19.138184+0000","last_clean":"2024-02-19T21:43:19.138184+0000","last_became_active":"2024-02-19T21:42:04.205907+0000","last_became_peered":"2024-02-19T21:42:04.205907+0000","last_unstale":"2024-02-19T21:43:19.138184+0000","last_undegraded":"2024-02-19T21:43:19.138184+0000","last_fullsized":"2024-02-19T21:43:19.138184+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"168'26","last_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:39:48.004702+0000","log_size":38,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":98,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.114813+0000","last_change":"2024-02-19T21:42:04.200909+0000","last_active":"2024-02-19T21:43:21.114813+0000","last_peered":"2024-02-19T21:43:21.114813+0000","last_clean":"2024-02-19T21:43:21.114813+0000","last_became_active":"2024-02-19T21:42:04.200496+0000","last_became_peered":"2024-02-19T21:42:04.200496+0000","last_unstale":"2024-02-19T21:43:21.114813+0000","last_undegraded":"2024-02-19T21:43:21.114813+0000","last_fullsized":"2024-02-19T21:43:21.114813+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:38.697183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:38.697183+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.d","version":"244'14828","reported_seq":24097,"reported_epoch":244,"state":"active+clean","last_fresh":"2024-02-19T21:43:24.952450+0000","last_change":"2024-02-19T21:42:41.528426+0000","last_active":"2024-02-19T21:43:24.952450+0000","last_peered":"2024-02-19T21:43:24.952450+0000","last_clean":"2024-02-19T21:43:24.952450+0000","last_became_active":"2024-02-19T21:42:41.508003+0000","last_became_peered":"2024-02-19T21:42:41.508003+0000","last_unstale":"2024-02-19T21:43:24.952450+0000","last_undegraded":"2024-02-19T21:43:24.952450+0000","last_fullsized":"2024-02-19T21:43:24.952450+0000","mapping_epoch":204,"log_start":"200'10319","ondisk_log_start":"200'10319","created":165,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4509,"ondisk_log_size":4509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":63111192,"num_objects":964,"num_object_clones":0,"num_object_copies":2892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":964,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14828,"num_write_kb":505281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4580,"num_bytes_recovered":300089368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":216,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.102444+0000","last_change":"2024-02-19T21:40:28.874859+0000","last_active":"2024-02-19T21:43:21.102444+0000","last_peered":"2024-02-19T21:43:21.102444+0000","last_clean":"2024-02-19T21:43:21.102444+0000","last_became_active":"2024-02-19T21:39:39.481908+0000","last_became_peered":"2024-02-19T21:39:39.481908+0000","last_unstale":"2024-02-19T21:43:21.102444+0000","last_undegraded":"2024-02-19T21:43:21.102444+0000","last_fullsized":"2024-02-19T21:43:21.102444+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:28.874762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:28.874762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":231,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.119093+0000","last_change":"2024-02-19T21:42:04.197387+0000","last_active":"2024-02-19T21:43:21.119093+0000","last_peered":"2024-02-19T21:43:21.119093+0000","last_clean":"2024-02-19T21:43:21.119093+0000","last_became_active":"2024-02-19T21:42:04.197048+0000","last_became_peered":"2024-02-19T21:42:04.197048+0000","last_unstale":"2024-02-19T21:43:21.119093+0000","last_undegraded":"2024-02-19T21:43:21.119093+0000","last_fullsized":"2024-02-19T21:43:21.119093+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:32.498434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:32.498434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"201'28","reported_seq":227,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.106483+0000","last_change":"2024-02-19T21:41:31.580765+0000","last_active":"2024-02-19T21:43:21.106483+0000","last_peered":"2024-02-19T21:43:21.106483+0000","last_clean":"2024-02-19T21:43:21.106483+0000","last_became_active":"2024-02-19T21:35:14.513806+0000","last_became_peered":"2024-02-19T21:35:14.513806+0000","last_unstale":"2024-02-19T21:43:21.106483+0000","last_undegraded":"2024-02-19T21:43:21.106483+0000","last_fullsized":"2024-02-19T21:43:21.106483+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'14","last_scrub_stamp":"2024-02-19T21:41:31.580701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:41:31.580701+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":34,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":206,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.991534+0000","last_change":"2024-02-19T21:41:30.192537+0000","last_active":"2024-02-19T21:43:21.991534+0000","last_peered":"2024-02-19T21:43:21.991534+0000","last_clean":"2024-02-19T21:43:21.991534+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:43:21.991534+0000","last_undegraded":"2024-02-19T21:43:21.991534+0000","last_fullsized":"2024-02-19T21:43:21.991534+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'9","last_scrub_stamp":"2024-02-19T21:41:30.192427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:30.192427+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"244'14866","reported_seq":14958,"reported_epoch":244,"state":"active+clean","last_fresh":"2024-02-19T21:43:24.945138+0000","last_change":"2024-02-19T21:41:29.552859+0000","last_active":"2024-02-19T21:43:24.945138+0000","last_peered":"2024-02-19T21:43:24.945138+0000","last_clean":"2024-02-19T21:43:24.945138+0000","last_became_active":"2024-02-19T21:39:39.471580+0000","last_became_peered":"2024-02-19T21:39:39.471580+0000","last_unstale":"2024-02-19T21:43:24.945138+0000","last_undegraded":"2024-02-19T21:43:24.945138+0000","last_fullsized":"2024-02-19T21:43:24.945138+0000","mapping_epoch":165,"log_start":"199'10152","ondisk_log_start":"199'10152","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"187'8036","last_scrub_stamp":"2024-02-19T21:41:29.552760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:41:29.552760+0000","log_size":4714,"ondisk_log_size":4714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":57409536,"num_objects":876,"num_object_clones":0,"num_object_copies":2628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":876,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14866,"num_write_kb":503744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"66'1","reported_seq":111,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.118849+0000","last_change":"2024-02-19T21:42:59.117856+0000","last_active":"2024-02-19T21:43:21.118849+0000","last_peered":"2024-02-19T21:43:21.118849+0000","last_clean":"2024-02-19T21:43:21.118849+0000","last_became_active":"2024-02-19T21:42:59.117513+0000","last_became_peered":"2024-02-19T21:42:59.117513+0000","last_unstale":"2024-02-19T21:43:21.118849+0000","last_undegraded":"2024-02-19T21:43:21.118849+0000","last_fullsized":"2024-02-19T21:43:21.118849+0000","mapping_epoch":165,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:21.371240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:40:21.371240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":209,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.106571+0000","last_change":"2024-02-19T21:40:22.774178+0000","last_active":"2024-02-19T21:43:21.106571+0000","last_peered":"2024-02-19T21:43:21.106571+0000","last_clean":"2024-02-19T21:43:21.106571+0000","last_became_active":"2024-02-19T21:32:27.362497+0000","last_became_peered":"2024-02-19T21:32:27.362497+0000","last_unstale":"2024-02-19T21:43:21.106571+0000","last_undegraded":"2024-02-19T21:43:21.106571+0000","last_fullsized":"2024-02-19T21:43:21.106571+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:22.774081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:22.774081+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":220,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.103571+0000","last_change":"2024-02-19T21:40:41.901768+0000","last_active":"2024-02-19T21:43:21.103571+0000","last_peered":"2024-02-19T21:43:21.103571+0000","last_clean":"2024-02-19T21:43:21.103571+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:43:21.103571+0000","last_undegraded":"2024-02-19T21:43:21.103571+0000","last_fullsized":"2024-02-19T21:43:21.103571+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:40:41.901670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:41.901670+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"201'19","reported_seq":237,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.114867+0000","last_change":"2024-02-19T21:40:26.390284+0000","last_active":"2024-02-19T21:43:21.114867+0000","last_peered":"2024-02-19T21:43:21.114867+0000","last_clean":"2024-02-19T21:43:21.114867+0000","last_became_active":"2024-02-19T21:39:51.536649+0000","last_became_peered":"2024-02-19T21:39:51.536649+0000","last_unstale":"2024-02-19T21:43:21.114867+0000","last_undegraded":"2024-02-19T21:43:21.114867+0000","last_fullsized":"2024-02-19T21:43:21.114867+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:40:26.390173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:26.390173+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"244'15184","reported_seq":15271,"reported_epoch":244,"state":"active+clean","last_fresh":"2024-02-19T21:43:24.965809+0000","last_change":"2024-02-19T21:39:39.479591+0000","last_active":"2024-02-19T21:43:24.965809+0000","last_peered":"2024-02-19T21:43:24.965809+0000","last_clean":"2024-02-19T21:43:24.965809+0000","last_became_active":"2024-02-19T21:39:39.479224+0000","last_became_peered":"2024-02-19T21:39:39.479224+0000","last_unstale":"2024-02-19T21:43:24.965809+0000","last_undegraded":"2024-02-19T21:43:24.965809+0000","last_fullsized":"2024-02-19T21:43:24.965809+0000","mapping_epoch":165,"log_start":"200'11191","ondisk_log_start":"200'11191","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":3993,"ondisk_log_size":3993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":62783488,"num_objects":958,"num_object_clones":0,"num_object_copies":2874,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":958,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15184,"num_write_kb":516544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":225,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.111796+0000","last_change":"2024-02-19T21:42:53.026951+0000","last_active":"2024-02-19T21:43:21.111796+0000","last_peered":"2024-02-19T21:43:21.111796+0000","last_clean":"2024-02-19T21:43:21.111796+0000","last_became_active":"2024-02-19T21:42:53.026678+0000","last_became_peered":"2024-02-19T21:42:53.026678+0000","last_unstale":"2024-02-19T21:43:21.111796+0000","last_undegraded":"2024-02-19T21:43:21.111796+0000","last_fullsized":"2024-02-19T21:43:21.111796+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:16.845272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:16.845272+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"98'9","reported_seq":297,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.991443+0000","last_change":"2024-02-19T21:41:30.610945+0000","last_active":"2024-02-19T21:43:21.991443+0000","last_peered":"2024-02-19T21:43:21.991443+0000","last_clean":"2024-02-19T21:43:21.991443+0000","last_became_active":"2024-02-19T21:35:14.513802+0000","last_became_peered":"2024-02-19T21:35:14.513802+0000","last_unstale":"2024-02-19T21:43:21.991443+0000","last_undegraded":"2024-02-19T21:43:21.991443+0000","last_fullsized":"2024-02-19T21:43:21.991443+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'9","last_scrub_stamp":"2024-02-19T21:41:30.610855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:30.610855+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":214,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.107116+0000","last_change":"2024-02-19T21:40:14.294150+0000","last_active":"2024-02-19T21:43:21.107116+0000","last_peered":"2024-02-19T21:43:21.107116+0000","last_clean":"2024-02-19T21:43:21.107116+0000","last_became_active":"2024-02-19T21:32:23.362738+0000","last_became_peered":"2024-02-19T21:32:23.362738+0000","last_unstale":"2024-02-19T21:43:21.107116+0000","last_undegraded":"2024-02-19T21:43:21.107116+0000","last_fullsized":"2024-02-19T21:43:21.107116+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:14.294064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:40:14.294064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"201'27","reported_seq":123,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.104505+0000","last_change":"2024-02-19T21:40:12.838278+0000","last_active":"2024-02-19T21:43:21.104505+0000","last_peered":"2024-02-19T21:43:21.104505+0000","last_clean":"2024-02-19T21:43:21.104505+0000","last_became_active":"2024-02-19T21:39:51.539230+0000","last_became_peered":"2024-02-19T21:39:51.539230+0000","last_unstale":"2024-02-19T21:43:21.104505+0000","last_undegraded":"2024-02-19T21:43:21.104505+0000","last_fullsized":"2024-02-19T21:43:21.104505+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:40:12.838083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:12.838083+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.0","version":"241'14856","reported_seq":14945,"reported_epoch":241,"state":"active+clean","last_fresh":"2024-02-19T21:43:19.944727+0000","last_change":"2024-02-19T21:41:41.239560+0000","last_active":"2024-02-19T21:43:19.944727+0000","last_peered":"2024-02-19T21:43:19.944727+0000","last_clean":"2024-02-19T21:43:19.944727+0000","last_became_active":"2024-02-19T21:39:39.465196+0000","last_became_peered":"2024-02-19T21:39:39.465196+0000","last_unstale":"2024-02-19T21:43:19.944727+0000","last_undegraded":"2024-02-19T21:43:19.944727+0000","last_fullsized":"2024-02-19T21:43:19.944727+0000","mapping_epoch":165,"log_start":"184'5764","ondisk_log_start":"184'5764","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":9092,"ondisk_log_size":9092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":78643200,"num_objects":1200,"num_object_clones":0,"num_object_copies":3600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1200,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14856,"num_write_kb":513792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":195,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.105783+0000","last_change":"2024-02-19T21:42:48.626776+0000","last_active":"2024-02-19T21:43:21.105783+0000","last_peered":"2024-02-19T21:43:21.105783+0000","last_clean":"2024-02-19T21:43:21.105783+0000","last_became_active":"2024-02-19T21:42:48.626491+0000","last_became_peered":"2024-02-19T21:42:48.626491+0000","last_unstale":"2024-02-19T21:43:21.105783+0000","last_undegraded":"2024-02-19T21:43:21.105783+0000","last_fullsized":"2024-02-19T21:43:21.105783+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:40.015907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:40.015907+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"170'11","reported_seq":211,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.990862+0000","last_change":"2024-02-19T21:40:21.864057+0000","last_active":"2024-02-19T21:43:21.990862+0000","last_peered":"2024-02-19T21:43:21.990862+0000","last_clean":"2024-02-19T21:43:21.990862+0000","last_became_active":"2024-02-19T21:39:51.534304+0000","last_became_peered":"2024-02-19T21:39:51.534304+0000","last_unstale":"2024-02-19T21:43:21.990862+0000","last_undegraded":"2024-02-19T21:43:21.990862+0000","last_fullsized":"2024-02-19T21:43:21.990862+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'11","last_scrub_stamp":"2024-02-19T21:40:21.863959+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:40:21.863959+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":211,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.103017+0000","last_change":"2024-02-19T21:39:31.018063+0000","last_active":"2024-02-19T21:43:21.103017+0000","last_peered":"2024-02-19T21:43:21.103017+0000","last_clean":"2024-02-19T21:43:21.103017+0000","last_became_active":"2024-02-19T21:32:23.363155+0000","last_became_peered":"2024-02-19T21:32:23.363155+0000","last_unstale":"2024-02-19T21:43:21.103017+0000","last_undegraded":"2024-02-19T21:43:21.103017+0000","last_fullsized":"2024-02-19T21:43:21.103017+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:31.018000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:39:31.018000+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"200'20","reported_seq":212,"reported_epoch":240,"state":"active+clean","last_fresh":"2024-02-19T21:43:18.122448+0000","last_change":"2024-02-19T21:41:21.872187+0000","last_active":"2024-02-19T21:43:18.122448+0000","last_peered":"2024-02-19T21:43:18.122448+0000","last_clean":"2024-02-19T21:43:18.122448+0000","last_became_active":"2024-02-19T21:35:14.514968+0000","last_became_peered":"2024-02-19T21:35:14.514968+0000","last_unstale":"2024-02-19T21:43:18.122448+0000","last_undegraded":"2024-02-19T21:43:18.122448+0000","last_fullsized":"2024-02-19T21:43:18.122448+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:41:21.872058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:41:21.872058+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6],"acting":[3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"244'14975","reported_seq":15062,"reported_epoch":244,"state":"active+clean","last_fresh":"2024-02-19T21:43:24.941167+0000","last_change":"2024-02-19T21:39:39.480753+0000","last_active":"2024-02-19T21:43:24.941167+0000","last_peered":"2024-02-19T21:43:24.941167+0000","last_clean":"2024-02-19T21:43:24.941167+0000","last_became_active":"2024-02-19T21:39:39.480509+0000","last_became_peered":"2024-02-19T21:39:39.480509+0000","last_unstale":"2024-02-19T21:43:24.941167+0000","last_undegraded":"2024-02-19T21:43:24.941167+0000","last_fullsized":"2024-02-19T21:43:24.941167+0000","mapping_epoch":165,"log_start":"200'11012","ondisk_log_start":"200'11012","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":3963,"ondisk_log_size":3963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":61145088,"num_objects":933,"num_object_clones":0,"num_object_copies":2799,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":933,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14975,"num_write_kb":509056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":221,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.119177+0000","last_change":"2024-02-19T21:42:44.595213+0000","last_active":"2024-02-19T21:43:21.119177+0000","last_peered":"2024-02-19T21:43:21.119177+0000","last_clean":"2024-02-19T21:43:21.119177+0000","last_became_active":"2024-02-19T21:42:44.592914+0000","last_became_peered":"2024-02-19T21:42:44.592914+0000","last_unstale":"2024-02-19T21:43:21.119177+0000","last_undegraded":"2024-02-19T21:43:21.119177+0000","last_fullsized":"2024-02-19T21:43:21.119177+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:36.725664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:41:36.725664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":205,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.104203+0000","last_change":"2024-02-19T21:39:39.002316+0000","last_active":"2024-02-19T21:43:21.104203+0000","last_peered":"2024-02-19T21:43:21.104203+0000","last_clean":"2024-02-19T21:43:21.104203+0000","last_became_active":"2024-02-19T21:32:27.369452+0000","last_became_peered":"2024-02-19T21:32:27.369452+0000","last_unstale":"2024-02-19T21:43:21.104203+0000","last_undegraded":"2024-02-19T21:43:21.104203+0000","last_fullsized":"2024-02-19T21:43:21.104203+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:39.002258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:39.002258+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":215,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.102308+0000","last_change":"2024-02-19T21:40:32.869530+0000","last_active":"2024-02-19T21:43:21.102308+0000","last_peered":"2024-02-19T21:43:21.102308+0000","last_clean":"2024-02-19T21:43:21.102308+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:43:21.102308+0000","last_undegraded":"2024-02-19T21:43:21.102308+0000","last_fullsized":"2024-02-19T21:43:21.102308+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:32.869462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:40:32.869462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"201'31","reported_seq":169,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.105947+0000","last_change":"2024-02-19T21:39:39.501787+0000","last_active":"2024-02-19T21:43:21.105947+0000","last_peered":"2024-02-19T21:43:21.105947+0000","last_clean":"2024-02-19T21:43:21.105947+0000","last_became_active":"2024-02-19T21:39:39.474668+0000","last_became_peered":"2024-02-19T21:39:39.474668+0000","last_unstale":"2024-02-19T21:43:21.105947+0000","last_undegraded":"2024-02-19T21:43:21.105947+0000","last_fullsized":"2024-02-19T21:43:21.105947+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'17","last_scrub_stamp":"2024-02-19T21:38:19.154753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:38:19.154753+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":49,"num_read_kb":39,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"241'14824","reported_seq":14909,"reported_epoch":241,"state":"active+clean","last_fresh":"2024-02-19T21:43:20.085545+0000","last_change":"2024-02-19T21:39:39.471363+0000","last_active":"2024-02-19T21:43:20.085545+0000","last_peered":"2024-02-19T21:43:20.085545+0000","last_clean":"2024-02-19T21:43:20.085545+0000","last_became_active":"2024-02-19T21:39:39.470667+0000","last_became_peered":"2024-02-19T21:39:39.470667+0000","last_unstale":"2024-02-19T21:43:20.085545+0000","last_undegraded":"2024-02-19T21:43:20.085545+0000","last_fullsized":"2024-02-19T21:43:20.085545+0000","mapping_epoch":165,"log_start":"199'10375","ondisk_log_start":"199'10375","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4449,"ondisk_log_size":4449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":77725696,"num_objects":1186,"num_object_clones":0,"num_object_copies":3558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1186,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14824,"num_write_kb":512320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"66'1","reported_seq":197,"reported_epoch":240,"state":"active+clean","last_fresh":"2024-02-19T21:43:18.128097+0000","last_change":"2024-02-19T21:43:14.407536+0000","last_active":"2024-02-19T21:43:18.128097+0000","last_peered":"2024-02-19T21:43:18.128097+0000","last_clean":"2024-02-19T21:43:18.128097+0000","last_became_active":"2024-02-19T21:43:14.407205+0000","last_became_peered":"2024-02-19T21:43:14.407205+0000","last_unstale":"2024-02-19T21:43:18.128097+0000","last_undegraded":"2024-02-19T21:43:18.128097+0000","last_fullsized":"2024-02-19T21:43:18.128097+0000","mapping_epoch":197,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":236,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:36.890201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.890201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":102,"reported_epoch":241,"state":"active+clean","last_fresh":"2024-02-19T21:43:19.138109+0000","last_change":"2024-02-19T21:42:04.205186+0000","last_active":"2024-02-19T21:43:19.138109+0000","last_peered":"2024-02-19T21:43:19.138109+0000","last_clean":"2024-02-19T21:43:19.138109+0000","last_became_active":"2024-02-19T21:42:04.204839+0000","last_became_peered":"2024-02-19T21:42:04.204839+0000","last_unstale":"2024-02-19T21:43:19.138109+0000","last_undegraded":"2024-02-19T21:43:19.138109+0000","last_fullsized":"2024-02-19T21:43:19.138109+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:23.324303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:46.372184+0000","last_clean_scrub_stamp":"2024-02-19T21:40:23.324303+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":108,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.107774+0000","last_change":"2024-02-19T21:40:28.696870+0000","last_active":"2024-02-19T21:43:21.107774+0000","last_peered":"2024-02-19T21:43:21.107774+0000","last_clean":"2024-02-19T21:43:21.107774+0000","last_became_active":"2024-02-19T21:39:39.479752+0000","last_became_peered":"2024-02-19T21:39:39.479752+0000","last_unstale":"2024-02-19T21:43:21.107774+0000","last_undegraded":"2024-02-19T21:43:21.107774+0000","last_fullsized":"2024-02-19T21:43:21.107774+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:40:28.696783+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"201'44","reported_seq":306,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.115764+0000","last_change":"2024-02-19T21:42:04.985140+0000","last_active":"2024-02-19T21:43:21.115764+0000","last_peered":"2024-02-19T21:43:21.115764+0000","last_clean":"2024-02-19T21:43:21.115764+0000","last_became_active":"2024-02-19T21:42:04.200393+0000","last_became_peered":"2024-02-19T21:42:04.200393+0000","last_unstale":"2024-02-19T21:43:21.115764+0000","last_undegraded":"2024-02-19T21:43:21.115764+0000","last_fullsized":"2024-02-19T21:43:21.115764+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'28","last_scrub_stamp":"2024-02-19T21:39:40.282677+0000","last_deep_scrub":"115'28","last_deep_scrub_stamp":"2024-02-19T21:36:09.031674+0000","last_clean_scrub_stamp":"2024-02-19T21:39:40.282677+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.7","version":"244'14934","reported_seq":15021,"reported_epoch":244,"state":"active+clean","last_fresh":"2024-02-19T21:43:24.968238+0000","last_change":"2024-02-19T21:39:39.463794+0000","last_active":"2024-02-19T21:43:24.968238+0000","last_peered":"2024-02-19T21:43:24.968238+0000","last_clean":"2024-02-19T21:43:24.968238+0000","last_became_active":"2024-02-19T21:39:39.463542+0000","last_became_peered":"2024-02-19T21:39:39.463542+0000","last_unstale":"2024-02-19T21:43:24.968238+0000","last_undegraded":"2024-02-19T21:43:24.968238+0000","last_fullsized":"2024-02-19T21:43:24.968238+0000","mapping_epoch":165,"log_start":"200'10983","ondisk_log_start":"200'10983","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":3951,"ondisk_log_size":3951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":57671680,"num_objects":880,"num_object_clones":0,"num_object_copies":2640,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":880,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14934,"num_write_kb":506048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,6],"acting":[1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":233,"reported_epoch":241,"state":"active+clean","last_fresh":"2024-02-19T21:43:19.138212+0000","last_change":"2024-02-19T21:43:10.349161+0000","last_active":"2024-02-19T21:43:19.138212+0000","last_peered":"2024-02-19T21:43:19.138212+0000","last_clean":"2024-02-19T21:43:19.138212+0000","last_became_active":"2024-02-19T21:43:10.348874+0000","last_became_peered":"2024-02-19T21:43:10.348874+0000","last_unstale":"2024-02-19T21:43:19.138212+0000","last_undegraded":"2024-02-19T21:43:19.138212+0000","last_fullsized":"2024-02-19T21:43:19.138212+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":232,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:42.230664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:42.230664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":200,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.115825+0000","last_change":"2024-02-19T21:40:40.799240+0000","last_active":"2024-02-19T21:43:21.115825+0000","last_peered":"2024-02-19T21:43:21.115825+0000","last_clean":"2024-02-19T21:43:21.115825+0000","last_became_active":"2024-02-19T21:39:39.468109+0000","last_became_peered":"2024-02-19T21:39:39.468109+0000","last_unstale":"2024-02-19T21:43:21.115825+0000","last_undegraded":"2024-02-19T21:43:21.115825+0000","last_fullsized":"2024-02-19T21:43:21.115825+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:40.799141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:40.799141+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1],"acting":[4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":209,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.106025+0000","last_change":"2024-02-19T21:37:36.883246+0000","last_active":"2024-02-19T21:43:21.106025+0000","last_peered":"2024-02-19T21:43:21.106025+0000","last_clean":"2024-02-19T21:43:21.106025+0000","last_became_active":"2024-02-19T21:32:23.357438+0000","last_became_peered":"2024-02-19T21:32:23.357438+0000","last_unstale":"2024-02-19T21:43:21.106025+0000","last_undegraded":"2024-02-19T21:43:21.106025+0000","last_fullsized":"2024-02-19T21:43:21.106025+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:36.883151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:37:36.883151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"201'15","reported_seq":235,"reported_epoch":241,"state":"active+clean","last_fresh":"2024-02-19T21:43:19.139149+0000","last_change":"2024-02-19T21:39:36.193250+0000","last_active":"2024-02-19T21:43:19.139149+0000","last_peered":"2024-02-19T21:43:19.139149+0000","last_clean":"2024-02-19T21:43:19.139149+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:43:19.139149+0000","last_undegraded":"2024-02-19T21:43:19.139149+0000","last_fullsized":"2024-02-19T21:43:19.139149+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:39:36.193184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:36.193184+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"244'15261","reported_seq":15348,"reported_epoch":244,"state":"active+clean","last_fresh":"2024-02-19T21:43:24.858701+0000","last_change":"2024-02-19T21:39:39.474614+0000","last_active":"2024-02-19T21:43:24.858701+0000","last_peered":"2024-02-19T21:43:24.858701+0000","last_clean":"2024-02-19T21:43:24.858701+0000","last_became_active":"2024-02-19T21:39:39.474311+0000","last_became_peered":"2024-02-19T21:39:39.474311+0000","last_unstale":"2024-02-19T21:43:24.858701+0000","last_undegraded":"2024-02-19T21:43:24.858701+0000","last_fullsized":"2024-02-19T21:43:24.858701+0000","mapping_epoch":165,"log_start":"200'10828","ondisk_log_start":"200'10828","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4433,"ondisk_log_size":4433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":62324736,"num_objects":951,"num_object_clones":0,"num_object_copies":2853,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":951,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15261,"num_write_kb":518784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":225,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.104741+0000","last_change":"2024-02-19T21:43:06.293725+0000","last_active":"2024-02-19T21:43:21.104741+0000","last_peered":"2024-02-19T21:43:21.104741+0000","last_clean":"2024-02-19T21:43:21.104741+0000","last_became_active":"2024-02-19T21:43:06.293389+0000","last_became_peered":"2024-02-19T21:43:06.293389+0000","last_unstale":"2024-02-19T21:43:21.104741+0000","last_undegraded":"2024-02-19T21:43:21.104741+0000","last_fullsized":"2024-02-19T21:43:21.104741+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:17.853016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:40:17.853016+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":170,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.115562+0000","last_change":"2024-02-19T21:42:04.200518+0000","last_active":"2024-02-19T21:43:21.115562+0000","last_peered":"2024-02-19T21:43:21.115562+0000","last_clean":"2024-02-19T21:43:21.115562+0000","last_became_active":"2024-02-19T21:42:04.199889+0000","last_became_peered":"2024-02-19T21:42:04.199889+0000","last_unstale":"2024-02-19T21:43:21.115562+0000","last_undegraded":"2024-02-19T21:43:21.115562+0000","last_fullsized":"2024-02-19T21:43:21.115562+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:40:29.858805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"200'27","reported_seq":281,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.107239+0000","last_change":"2024-02-19T21:42:05.597864+0000","last_active":"2024-02-19T21:43:21.107239+0000","last_peered":"2024-02-19T21:43:21.107239+0000","last_clean":"2024-02-19T21:43:21.107239+0000","last_became_active":"2024-02-19T21:42:04.212731+0000","last_became_peered":"2024-02-19T21:42:04.212731+0000","last_unstale":"2024-02-19T21:43:21.107239+0000","last_undegraded":"2024-02-19T21:43:21.107239+0000","last_fullsized":"2024-02-19T21:43:21.107239+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:40:23.751886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:23.751886+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"66'8","reported_seq":349,"reported_epoch":243,"state":"active+clean","last_fresh":"2024-02-19T21:43:21.990611+0000","last_change":"2024-02-19T21:40:19.870350+0000","last_active":"2024-02-19T21:43:21.990611+0000","last_peered":"2024-02-19T21:43:21.990611+0000","last_clean":"2024-02-19T21:43:21.990611+0000","last_became_active":"2024-02-19T21:32:27.369840+0000","last_became_peered":"2024-02-19T21:32:27.369840+0000","last_unstale":"2024-02-19T21:43:21.990611+0000","last_undegraded":"2024-02-19T21:43:21.990611+0000","last_fullsized":"2024-02-19T21:43:21.990611+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:40:19.870250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:19.870250+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":1066336280,"num_objects":16272,"num_object_clones":0,"num_object_copies":48816,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1217,"num_objects_unfound":0,"num_objects_dirty":16272,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":239160,"num_write_kb":8173761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10971,"num_bytes_recovered":718864408,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3487449088,"data_stored":3487432800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79069,"ondisk_log_size":79069,"up":48,"acting":48,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":648,"num_read_kb":643,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1116,"num_read_kb":873,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":3604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":741,"ondisk_log_size":741,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":22,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":382,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":66,"acting":66,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201415,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":904256,"kb_used_data":607032,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":92840896,"statfs":{"total":95995035648,"available":95069077504,"internally_reserved":0,"allocated":621600768,"data_stored":621251957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,3,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:42:32 2024","interfaces":[{"interface":"back","average":{"1min":2.9430000000000001,"5min":1.9550000000000001,"15min":1.0860000000000001},"min":{"1min":0.23499999999999999,"5min":0.189,"15min":0.189},"max":{"1min":10.907,"5min":13.645,"15min":13.645},"last":2.0230000000000001},{"interface":"front","average":{"1min":2.8809999999999998,"5min":1.9730000000000001,"15min":1.1819999999999999},"min":{"1min":0.26100000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":14.099,"5min":14.212999999999999,"15min":14.212999999999999},"last":3.2810000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:42:32 2024","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":2.0720000000000001,"15min":1.214},"min":{"1min":0.255,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":3.6520000000000001,"5min":14.246,"15min":14.246},"last":1.3140000000000001},{"interface":"front","average":{"1min":3.1299999999999999,"5min":1.8340000000000001,"15min":1.105},"min":{"1min":0.29399999999999998,"5min":0.223,"15min":0.223},"max":{"1min":14.15,"5min":14.15,"15min":14.15},"last":3.306}]},{"osd":2,"last update":"Mon Feb 19 21:42:32 2024","interfaces":[{"interface":"back","average":{"1min":3.2210000000000001,"5min":2.0289999999999999,"15min":1.1499999999999999},"min":{"1min":0.28599999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":10.965999999999999,"5min":10.965999999999999,"15min":10.965999999999999},"last":2.198},{"interface":"front","average":{"1min":1.5029999999999999,"5min":2.109,"15min":1.194},"min":{"1min":0.28899999999999998,"5min":0.28000000000000003,"15min":0.27800000000000002},"max":{"1min":4.835,"5min":9.7010000000000005,"15min":9.7010000000000005},"last":1.347}]},{"osd":3,"last update":"Mon Feb 19 21:42:32 2024","interfaces":[{"interface":"back","average":{"1min":3.3149999999999999,"5min":2.6669999999999998,"15min":1.5},"min":{"1min":0.29699999999999999,"5min":0.29199999999999998,"15min":0.26900000000000002},"max":{"1min":11.004,"5min":17.481999999999999,"15min":31.559000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":1.8169999999999999,"5min":2.1459999999999999,"15min":1.333},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":10.522,"5min":17.576000000000001,"15min":30.812999999999999},"last":2.2650000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:42:32 2024","interfaces":[{"interface":"back","average":{"1min":3.1080000000000001,"5min":1.667,"15min":0.88800000000000001},"min":{"1min":0.26900000000000002,"5min":0.247,"15min":0.247},"max":{"1min":14.208,"5min":14.208,"15min":14.208},"last":3.4319999999999999},{"interface":"front","average":{"1min":3.6749999999999998,"5min":2.1539999999999999,"15min":1.0549999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.245},"max":{"1min":11.029999999999999,"5min":11.541,"15min":11.541},"last":0.44700000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:42:32 2024","interfaces":[{"interface":"back","average":{"1min":1.853,"5min":1.6879999999999999,"15min":0.97699999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.7930000000000001,"5min":10.090999999999999,"15min":10.090999999999999},"last":2.3780000000000001},{"interface":"front","average":{"1min":3.637,"5min":1.9890000000000001,"15min":1.0389999999999999},"min":{"1min":0.315,"5min":0.30299999999999999,"15min":0.28799999999999998},"max":{"1min":17.012,"5min":17.012,"15min":17.012},"last":3.2519999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:42:32 2024","interfaces":[{"interface":"back","average":{"1min":3.052,"5min":1.6259999999999999,"15min":0.93400000000000005},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.30299999999999999},"max":{"1min":14.177,"5min":14.177,"15min":14.177},"last":3.5470000000000002},{"interface":"front","average":{"1min":4.2119999999999997,"5min":2.2429999999999999,"15min":1.2989999999999999},"min":{"1min":0.5,"5min":0.33000000000000002,"15min":0.29699999999999999},"max":{"1min":12.913,"5min":12.913,"15min":12.913},"last":0.63300000000000001}]}]},{"osd":6,"up_from":47,"seq":201863463054,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":740644,"kb_used_data":439324,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93004508,"statfs":{"total":95995035648,"available":95236616192,"internally_reserved":0,"allocated":449867776,"data_stored":449482556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:43:14 2024","interfaces":[{"interface":"back","average":{"1min":3.6040000000000001,"5min":2.395,"15min":1.343},"min":{"1min":0.23599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":45.197000000000003,"5min":45.197000000000003,"15min":45.197000000000003},"last":0.40699999999999997},{"interface":"front","average":{"1min":3.7400000000000002,"5min":2.504,"15min":1.4279999999999999},"min":{"1min":0.23799999999999999,"5min":0.23499999999999999,"15min":0.221},"max":{"1min":44.753,"5min":44.753,"15min":44.753},"last":0.28499999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:43:14 2024","interfaces":[{"interface":"back","average":{"1min":3.7989999999999999,"5min":2.2240000000000002,"15min":1.2849999999999999},"min":{"1min":0.26500000000000001,"5min":0.222,"15min":0.222},"max":{"1min":45.231999999999999,"5min":45.231999999999999,"15min":45.231999999999999},"last":0.441},{"interface":"front","average":{"1min":4.1509999999999998,"5min":2.0920000000000001,"15min":1.216},"min":{"1min":0.377,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":45.097999999999999,"5min":45.097999999999999,"15min":45.097999999999999},"last":0.253}]},{"osd":2,"last update":"Mon Feb 19 21:43:14 2024","interfaces":[{"interface":"back","average":{"1min":1.7729999999999999,"5min":1.611,"15min":1.073},"min":{"1min":0.35399999999999998,"5min":0.28599999999999998,"15min":0.26800000000000002},"max":{"1min":6.5899999999999999,"5min":8.3849999999999998,"15min":8.3849999999999998},"last":0.316},{"interface":"front","average":{"1min":1.585,"5min":1.744,"15min":1.1359999999999999},"min":{"1min":0.32500000000000001,"5min":0.29299999999999998,"15min":0.27300000000000002},"max":{"1min":5.7140000000000004,"5min":8.5259999999999998,"15min":18.068000000000001},"last":0.35499999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:43:14 2024","interfaces":[{"interface":"back","average":{"1min":1.988,"5min":1.758,"15min":1.1950000000000001},"min":{"1min":0.32500000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":7.6520000000000001,"5min":11.15,"15min":11.15},"last":0.46400000000000002},{"interface":"front","average":{"1min":2.0459999999999998,"5min":1.6120000000000001,"15min":1.171},"min":{"1min":0.35199999999999998,"5min":0.26400000000000001,"15min":0.246},"max":{"1min":6.6150000000000002,"5min":10.228999999999999,"15min":19.632999999999999},"last":0.29399999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:43:14 2024","interfaces":[{"interface":"back","average":{"1min":1.7230000000000001,"5min":1.8540000000000001,"15min":0.94899999999999995},"min":{"1min":0.32500000000000001,"5min":0.247,"15min":0.247},"max":{"1min":3.407,"5min":9.3759999999999994,"15min":9.3759999999999994},"last":0.48999999999999999},{"interface":"front","average":{"1min":2.871,"5min":2.085,"15min":1.02},"min":{"1min":0.40000000000000002,"5min":0.27300000000000002,"15min":0.23499999999999999},"max":{"1min":14.055,"5min":16.594999999999999,"15min":16.594999999999999},"last":4.7480000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:43:14 2024","interfaces":[{"interface":"back","average":{"1min":2.1779999999999999,"5min":1.9650000000000001,"15min":1.0049999999999999},"min":{"1min":0.314,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":7.4279999999999999,"5min":8.6159999999999997,"15min":8.6159999999999997},"last":0.32100000000000001},{"interface":"front","average":{"1min":2.7080000000000002,"5min":2.2469999999999999,"15min":1.111},"min":{"1min":0.34799999999999998,"5min":0.30299999999999999,"15min":0.27900000000000003},"max":{"1min":15.164,"5min":15.497999999999999,"15min":15.497999999999999},"last":4.851}]},{"osd":7,"last update":"Mon Feb 19 21:42:29 2024","interfaces":[{"interface":"back","average":{"1min":3.2330000000000001,"5min":2.1320000000000001,"15min":1.0680000000000001},"min":{"1min":0.33400000000000002,"5min":0.28799999999999998,"15min":0.26700000000000002},"max":{"1min":9.3179999999999996,"5min":14.721,"15min":14.721},"last":4.7910000000000004},{"interface":"front","average":{"1min":3.2650000000000001,"5min":2.173,"15min":1.129},"min":{"1min":0.44700000000000001,"5min":0.35799999999999998,"15min":0.32700000000000001},"max":{"1min":9.343,"5min":14.744999999999999,"15min":14.744999999999999},"last":4.8179999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575016,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":802992,"kb_used_data":497576,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":92942160,"statfs":{"total":95995035648,"available":95172771840,"internally_reserved":0,"allocated":509517824,"data_stored":509121451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.9610000000000001,"15min":1.2210000000000001},"min":{"1min":0.23100000000000001,"5min":0.161,"15min":0.161},"max":{"1min":6.9260000000000002,"5min":42.776000000000003,"15min":42.776000000000003},"last":0.17000000000000001},{"interface":"front","average":{"1min":1.5820000000000001,"5min":2.0430000000000001,"15min":1.22},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":5.2919999999999998,"5min":44.845999999999997,"15min":44.845999999999997},"last":1.8460000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:42:27 2024","interfaces":[{"interface":"back","average":{"1min":1.7210000000000001,"5min":1.383,"15min":1.1000000000000001},"min":{"1min":0.23899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":6.9640000000000004,"5min":11.161,"15min":11.826000000000001},"last":0.249},{"interface":"front","average":{"1min":0.77000000000000002,"5min":1.504,"15min":1.1779999999999999},"min":{"1min":0.24399999999999999,"5min":0.215,"15min":0.215},"max":{"1min":3.3460000000000001,"5min":11.507,"15min":12.26},"last":1.8779999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.901,"15min":1.3260000000000001},"min":{"1min":0.252,"5min":0.224,"15min":0.224},"max":{"1min":4.5099999999999998,"5min":41.607999999999997,"15min":41.607999999999997},"last":2.1549999999999998},{"interface":"front","average":{"1min":1.9930000000000001,"5min":1.895,"15min":1.179},"min":{"1min":0.27000000000000002,"5min":0.22500000000000001,"15min":0.217},"max":{"1min":8.7349999999999994,"5min":42.811999999999998,"15min":42.811999999999998},"last":0.216}]},{"osd":4,"last update":"Mon Feb 19 21:43:22 2024","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.7190000000000001,"15min":1.0669999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26800000000000002},"max":{"1min":7.2270000000000003,"5min":11.23,"15min":11.23},"last":0.26900000000000002},{"interface":"front","average":{"1min":1.25,"5min":1.627,"15min":1.171},"min":{"1min":0.30499999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":3.855,"5min":7.04,"15min":10.51},"last":0.30499999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:42:45 2024","interfaces":[{"interface":"back","average":{"1min":1.615,"5min":1.8089999999999999,"15min":1.147},"min":{"1min":0.30599999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":5.9199999999999999,"5min":8.0760000000000005,"15min":10.458},"last":0.35099999999999998},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.587,"15min":1.0680000000000001},"min":{"1min":0.32600000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":6.0720000000000001,"5min":7.2389999999999999,"15min":7.6950000000000003},"last":1.903}]},{"osd":6,"last update":"Mon Feb 19 21:43:17 2024","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":2.032,"15min":1.1919999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.30099999999999999},"max":{"1min":7.2830000000000004,"5min":11.638999999999999,"15min":11.638999999999999},"last":2.8530000000000002},{"interface":"front","average":{"1min":2.9649999999999999,"5min":2.1600000000000001,"15min":1.294},"min":{"1min":0.377,"5min":0.32900000000000001,"15min":0.316},"max":{"1min":6.9530000000000003,"5min":12.199,"15min":12.199},"last":1.931}]},{"osd":7,"last update":"Mon Feb 19 21:42:33 2024","interfaces":[{"interface":"back","average":{"1min":2.2999999999999998,"5min":1.7969999999999999,"15min":1.2190000000000001},"min":{"1min":0.39200000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":8.1699999999999999,"5min":8.1699999999999999,"15min":10.638999999999999},"last":1.9590000000000001},{"interface":"front","average":{"1min":2.5939999999999999,"5min":1.837,"15min":1.139},"min":{"1min":0.41699999999999998,"5min":0.39500000000000002,"15min":0.33600000000000002},"max":{"1min":8.1809999999999992,"5min":11.276,"15min":11.276},"last":0.32600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738541,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":890940,"kb_used_data":585524,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":92854212,"statfs":{"total":95995035648,"available":95082713088,"internally_reserved":0,"allocated":599576576,"data_stored":599207778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,0,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:43:03 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":1.2969999999999999,"15min":0.90100000000000002},"min":{"1min":0.182,"5min":0.182,"15min":0.17499999999999999},"max":{"1min":3.5880000000000001,"5min":16.478000000000002,"15min":16.478000000000002},"last":0.5},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.359,"15min":1.1240000000000001},"min":{"1min":0.20399999999999999,"5min":0.188,"15min":0.188},"max":{"1min":3.3860000000000001,"5min":13.422000000000001,"15min":13.422000000000001},"last":1.9970000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:42:32 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":1.663,"15min":1.054},"min":{"1min":0.27100000000000002,"5min":0.24399999999999999,"15min":0.23999999999999999},"max":{"1min":4.5979999999999999,"5min":13.638999999999999,"15min":13.638999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.7130000000000001,"15min":1.198},"min":{"1min":0.23200000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":3.3290000000000002,"5min":13.134,"15min":13.134},"last":3.3050000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:42:48 2024","interfaces":[{"interface":"back","average":{"1min":2.0859999999999999,"5min":1.7869999999999999,"15min":1.331},"min":{"1min":0.22900000000000001,"5min":0.217,"15min":0.217},"max":{"1min":5.0990000000000002,"5min":13.776,"15min":14.507999999999999},"last":2.996},{"interface":"front","average":{"1min":1.105,"5min":1.917,"15min":1.2989999999999999},"min":{"1min":0.24199999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":4.5270000000000001,"5min":18.759,"15min":18.759},"last":0.73399999999999999}]},{"osd":4,"last update":"Mon Feb 19 21:42:26 2024","interfaces":[{"interface":"back","average":{"1min":1.8140000000000001,"5min":1.952,"15min":1.139},"min":{"1min":0.38300000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":7.8529999999999998,"5min":13.278,"15min":13.278},"last":3.028},{"interface":"front","average":{"1min":1.8140000000000001,"5min":1.7689999999999999,"15min":1.075},"min":{"1min":0.33800000000000002,"5min":0.317,"15min":0.255},"max":{"1min":7.8739999999999997,"5min":8.9450000000000003,"15min":8.9450000000000003},"last":1.325}]},{"osd":5,"last update":"Mon Feb 19 21:42:48 2024","interfaces":[{"interface":"back","average":{"1min":1.7370000000000001,"5min":2.2650000000000001,"15min":1.397},"min":{"1min":0.30299999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":4.4169999999999998,"5min":42.799999999999997,"15min":42.799999999999997},"last":10.852},{"interface":"front","average":{"1min":2.573,"5min":2.5070000000000001,"15min":1.3939999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":9.1600000000000001,"5min":42.695,"15min":42.695},"last":10.842000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:43:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.5900000000000001,"15min":1.226},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.27900000000000003},"max":{"1min":4.8630000000000004,"5min":8.9039999999999999,"15min":42.777000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":2.6139999999999999,"5min":2.278,"15min":1.417},"min":{"1min":0.375,"5min":0.32300000000000001,"15min":0.28599999999999998},"max":{"1min":6.0519999999999996,"5min":8.2590000000000003,"15min":9.7629999999999999},"last":3.8860000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:42:32 2024","interfaces":[{"interface":"back","average":{"1min":2.0529999999999999,"5min":2.2639999999999998,"15min":1.2629999999999999},"min":{"1min":0.38700000000000001,"5min":0.31,"15min":0.31},"max":{"1min":7.7009999999999996,"5min":42.758000000000003,"15min":42.758000000000003},"last":4.5709999999999997},{"interface":"front","average":{"1min":2.0499999999999998,"5min":2.1190000000000002,"15min":1.2569999999999999},"min":{"1min":0.432,"5min":0.371,"15min":0.33200000000000002},"max":{"1min":7.8899999999999997,"5min":42.718000000000004,"15min":42.718000000000004},"last":1.9510000000000001}]}]},{"osd":2,"up_from":0,"seq":77309411491,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":26,"seq":111669149853,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":746420,"kb_used_data":436844,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":92998732,"statfs":{"total":95995035648,"available":95230701568,"internally_reserved":0,"allocated":447328256,"data_stored":447021754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":1.3080000000000001,"15min":1.103},"min":{"1min":0.19,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":4.952,"5min":11.292,"15min":17.992000000000001},"last":0.248},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.9039999999999999,"15min":1.431},"min":{"1min":0.22500000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":4.9370000000000003,"5min":46.654000000000003,"15min":46.654000000000003},"last":0.39500000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:42:58 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.1779999999999999,"15min":0.91800000000000004},"min":{"1min":0.22,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":5.4039999999999999,"5min":9.6289999999999996,"15min":9.9700000000000006},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":1.2889999999999999,"15min":1.153},"min":{"1min":0.22700000000000001,"5min":0.20799999999999999,"15min":0.185},"max":{"1min":3.5110000000000001,"5min":8.6890000000000001,"15min":13.135999999999999},"last":0.27800000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":1.411,"15min":1.143},"min":{"1min":0.26900000000000002,"5min":0.22900000000000001,"15min":0.224},"max":{"1min":3.5459999999999998,"5min":6.8879999999999999,"15min":11.175000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":1.6870000000000001,"5min":2.0219999999999998,"15min":1.3660000000000001},"min":{"1min":0.23799999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":12.723000000000001,"5min":45.831000000000003,"15min":45.831000000000003},"last":0.44600000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:42:21 2024","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.329,"15min":0.94199999999999995},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":7.1660000000000004,"5min":7.1660000000000004,"15min":7.1660000000000004},"last":0.79300000000000004},{"interface":"front","average":{"1min":2.5550000000000002,"5min":1.8979999999999999,"15min":1.196},"min":{"1min":0.28999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":9.6720000000000006,"5min":9.6720000000000006,"15min":11.093},"last":0.33600000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:42:38 2024","interfaces":[{"interface":"back","average":{"1min":2.032,"5min":1.647,"15min":1.0640000000000001},"min":{"1min":0.29099999999999998,"5min":0.28699999999999998,"15min":0.27100000000000002},"max":{"1min":12.257,"5min":12.257,"15min":12.257},"last":2.1989999999999998},{"interface":"front","average":{"1min":1.829,"5min":2.0600000000000001,"15min":1.2729999999999999},"min":{"1min":0.313,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":6.367,"5min":9.2579999999999991,"15min":11.128},"last":0.47599999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:43:10 2024","interfaces":[{"interface":"back","average":{"1min":1.6080000000000001,"5min":1.365,"15min":1.052},"min":{"1min":0.31900000000000001,"5min":0.309,"15min":0.30599999999999999},"max":{"1min":4.8929999999999998,"5min":6.6029999999999998,"15min":17.443999999999999},"last":1.8799999999999999},{"interface":"front","average":{"1min":2.4460000000000002,"5min":1.907,"15min":1.3380000000000001},"min":{"1min":0.41699999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":13.942,"5min":13.942,"15min":18.219000000000001},"last":0.69799999999999995}]},{"osd":7,"last update":"Mon Feb 19 21:42:32 2024","interfaces":[{"interface":"back","average":{"1min":2,"5min":2.335,"15min":1.411},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":8.7200000000000006,"5min":45.777999999999999,"15min":45.777999999999999},"last":2.0830000000000002},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.45,"15min":0.997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35099999999999998},"max":{"1min":6.5090000000000003,"5min":6.585,"15min":6.585},"last":0.89900000000000002}]}]},{"osd":4,"up_from":32,"seq":137438953623,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":657616,"kb_used_data":352200,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93087536,"statfs":{"total":95995035648,"available":95321636864,"internally_reserved":0,"allocated":360652800,"data_stored":360287109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:43:21 2024","interfaces":[{"interface":"back","average":{"1min":3.0579999999999998,"5min":2.4359999999999999,"15min":1.3009999999999999},"min":{"1min":0.40999999999999998,"5min":0.219,"15min":0.219},"max":{"1min":11.541,"5min":40.664000000000001,"15min":40.664000000000001},"last":1.7150000000000001},{"interface":"front","average":{"1min":1.698,"5min":2.3199999999999998,"15min":1.383},"min":{"1min":0.23799999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":5.3159999999999998,"5min":41.046999999999997,"15min":41.046999999999997},"last":0.307}]},{"osd":1,"last update":"Mon Feb 19 21:43:21 2024","interfaces":[{"interface":"back","average":{"1min":3.6909999999999998,"5min":2.0750000000000002,"15min":1.1319999999999999},"min":{"1min":0.41399999999999998,"5min":0.22,"15min":0.22},"max":{"1min":11.755000000000001,"5min":13.254,"15min":13.254},"last":6.1619999999999999},{"interface":"front","average":{"1min":1.655,"5min":1.5980000000000001,"15min":1.046},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":4.3460000000000001,"5min":7.593,"15min":15.411},"last":0.37}]},{"osd":2,"last update":"Mon Feb 19 21:43:21 2024","interfaces":[{"interface":"back","average":{"1min":1.9470000000000001,"5min":1.8919999999999999,"15min":1.1479999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.27100000000000002},"max":{"1min":4.7039999999999997,"5min":16.788,"15min":16.788},"last":0.34100000000000003},{"interface":"front","average":{"1min":1.8799999999999999,"5min":2.0369999999999999,"15min":1.3799999999999999},"min":{"1min":0.35099999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.0190000000000001,"5min":18.452999999999999,"15min":20.995999999999999},"last":6.0190000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:43:21 2024","interfaces":[{"interface":"back","average":{"1min":2.0230000000000001,"5min":2.016,"15min":1.282},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.316},"max":{"1min":6.0730000000000004,"5min":10.970000000000001,"15min":15.914999999999999},"last":6.0730000000000004},{"interface":"front","average":{"1min":3.512,"5min":2.2069999999999999,"15min":1.2430000000000001},"min":{"1min":0.34200000000000003,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":11.662000000000001,"5min":13.321,"15min":13.321},"last":5.6849999999999996}]},{"osd":5,"last update":"Mon Feb 19 21:43:02 2024","interfaces":[{"interface":"back","average":{"1min":3.21,"5min":2.0550000000000002,"15min":0.99099999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.23499999999999999},"max":{"1min":18.916,"5min":18.916,"15min":18.916},"last":0.39900000000000002},{"interface":"front","average":{"1min":5.476,"5min":2.6779999999999999,"15min":1.2070000000000001},"min":{"1min":0.28899999999999998,"5min":0.27300000000000002,"15min":0.26100000000000001},"max":{"1min":13.603999999999999,"5min":14.840999999999999,"15min":14.840999999999999},"last":1.391}]},{"osd":6,"last update":"Mon Feb 19 21:43:21 2024","interfaces":[{"interface":"back","average":{"1min":1.7010000000000001,"5min":2.1259999999999999,"15min":1.0489999999999999},"min":{"1min":0.316,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":7.5949999999999998,"5min":13.27,"15min":13.27},"last":0.63700000000000001},{"interface":"front","average":{"1min":3.3690000000000002,"5min":2.1429999999999998,"15min":1.0589999999999999},"min":{"1min":0.32800000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":14.127000000000001,"5min":14.127000000000001,"15min":14.127000000000001},"last":0.42299999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:42:36 2024","interfaces":[{"interface":"back","average":{"1min":3.3010000000000002,"5min":1.7310000000000001,"15min":0.93000000000000005},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.28899999999999998},"max":{"1min":8.9640000000000004,"5min":8.9640000000000004,"15min":8.9640000000000004},"last":0.82499999999999996},{"interface":"front","average":{"1min":2.7519999999999998,"5min":2.1509999999999998,"15min":1.0880000000000001},"min":{"1min":0.33500000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":8.5359999999999996,"5min":10.707000000000001,"15min":10.707000000000001},"last":0.67500000000000004}]}]},{"osd":5,"up_from":38,"seq":163208757395,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":939816,"kb_used_data":629856,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":92805336,"statfs":{"total":95995035648,"available":95032664064,"internally_reserved":0,"allocated":644972544,"data_stored":644583360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:42:51 2024","interfaces":[{"interface":"back","average":{"1min":1.556,"5min":1.52,"15min":1.1160000000000001},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":4.9820000000000002,"5min":10.044,"15min":20.550999999999998},"last":5.29},{"interface":"front","average":{"1min":2.5569999999999999,"5min":1.988,"15min":1.208},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":9.4329999999999998,"5min":9.9390000000000001,"15min":20.879000000000001},"last":4.9569999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:42:51 2024","interfaces":[{"interface":"back","average":{"1min":2.827,"5min":2.036,"15min":1.145},"min":{"1min":0.28499999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":9.4670000000000005,"5min":10.42,"15min":10.42},"last":4.9829999999999997},{"interface":"front","average":{"1min":1.6739999999999999,"5min":1.6180000000000001,"15min":1.087},"min":{"1min":0.27400000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":6.4880000000000004,"5min":10.021000000000001,"15min":10.316000000000001},"last":2.6749999999999998}]},{"osd":2,"last update":"Mon Feb 19 21:42:51 2024","interfaces":[{"interface":"back","average":{"1min":2.23,"5min":1.7170000000000001,"15min":1.171},"min":{"1min":0.32100000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":9.2629999999999999,"5min":9.2629999999999999,"15min":20.186},"last":5.2679999999999998},{"interface":"front","average":{"1min":2.3809999999999998,"5min":1.9219999999999999,"15min":1.2330000000000001},"min":{"1min":0.34799999999999998,"5min":0.29899999999999999,"15min":0.23200000000000001},"max":{"1min":9.4909999999999997,"5min":9.4909999999999997,"15min":20.175000000000001},"last":5.0410000000000004}]},{"osd":3,"last update":"Mon Feb 19 21:42:51 2024","interfaces":[{"interface":"back","average":{"1min":2.3450000000000002,"5min":1.9670000000000001,"15min":1.335},"min":{"1min":0.28999999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":9.3629999999999995,"5min":12.021000000000001,"15min":20.146999999999998},"last":5.2089999999999996},{"interface":"front","average":{"1min":3.0379999999999998,"5min":2.339,"15min":1.502},"min":{"1min":0.42199999999999999,"5min":0.36499999999999999,"15min":0.35499999999999998},"max":{"1min":9.5150000000000006,"5min":9.5150000000000006,"15min":20.120000000000001},"last":5.0259999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:42:51 2024","interfaces":[{"interface":"back","average":{"1min":2.7989999999999999,"5min":1.5229999999999999,"15min":0.81100000000000005},"min":{"1min":0.252,"5min":0.24399999999999999,"15min":0.23999999999999999},"max":{"1min":21.577000000000002,"5min":21.577000000000002,"15min":21.577000000000002},"last":2.54},{"interface":"front","average":{"1min":2.5910000000000002,"5min":2.0089999999999999,"15min":0.998},"min":{"1min":0.34699999999999998,"5min":0.26300000000000001,"15min":0.25600000000000001},"max":{"1min":9.3360000000000003,"5min":12.135,"15min":12.135},"last":5.2430000000000003}]},{"osd":6,"last update":"Mon Feb 19 21:43:14 2024","interfaces":[{"interface":"back","average":{"1min":3.2010000000000001,"5min":2.1259999999999999,"15min":1.0549999999999999},"min":{"1min":0.39400000000000002,"5min":0.221,"15min":0.221},"max":{"1min":13.138999999999999,"5min":13.138999999999999,"15min":13.138999999999999},"last":5.3109999999999999},{"interface":"front","average":{"1min":3.4950000000000001,"5min":2.419,"15min":1.1759999999999999},"min":{"1min":0.39600000000000002,"5min":0.28999999999999998,"15min":0.23599999999999999},"max":{"1min":12.932,"5min":13.532999999999999,"15min":13.532999999999999},"last":5.0700000000000003}]},{"osd":7,"last update":"Mon Feb 19 21:42:43 2024","interfaces":[{"interface":"back","average":{"1min":3.9409999999999998,"5min":2.3940000000000001,"15min":1.1779999999999999},"min":{"1min":0.34200000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":12.962,"5min":12.962,"15min":12.962},"last":5.0090000000000003},{"interface":"front","average":{"1min":3.8340000000000001,"5min":2.278,"15min":1.115},"min":{"1min":0.42099999999999999,"5min":0.313,"15min":0.29099999999999998},"max":{"1min":12.853999999999999,"5min":17.759,"15min":17.759},"last":2.573}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":2118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":583139328,"data_stored":583139328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":484118528,"data_stored":484114456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":429457408,"data_stored":429457408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":356057088,"data_stored":356057088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":614469632,"data_stored":614465560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":424087552,"data_stored":424083480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":596119552,"data_stored":596115480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:43:26.740 INFO:tasks.cephadm.ceph_manager.ceph:would drop below min_pgs, proj -7, currently 3 2024-02-19T21:43:27.367 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-02-19T21:43:27.389 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:43:27.394 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:27.395 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:43:27.495 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:43:27.547 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:27.235843+0000 mon.c (mon.2) 55 : audit [INF] from='client.? 172.21.15.80:0/2889457344' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:43:27.547 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:27.236203+0000 mon.a (mon.0) 1196 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:43:27.554 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:27.591 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:43:27.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:27.235843+0000 mon.c (mon.2) 55 : audit [INF] from='client.? 172.21.15.80:0/2889457344' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:43:27.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:27.236203+0000 mon.a (mon.0) 1196 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:43:27.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:27.235843+0000 mon.c (mon.2) 55 : audit [INF] from='client.? 172.21.15.80:0/2889457344' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:43:27.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:27.236203+0000 mon.a (mon.0) 1196 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:43:27.597 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:27.597 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:43:27.698 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:43:27.747 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:28.108 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:43:28.111 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:28.111 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:43:28.212 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:43:28.222 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:43:28.262 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:28.280 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:43:28.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:27.029686+0000 mgr.y (mgr.14514) 420 : cluster [DBG] pgmap v494: 138 pgs: 2 active+remapped+backfilling, 136 active+clean; 920 MiB data, 5.2 GiB used, 621 GiB / 626 GiB avail; 737 B/s rd, 0 B/s wr, 855 op/s; 1217/44760 objects misplaced (2.719%); 1024 KiB/s, 15 objects/s recovering 2024-02-19T21:43:28.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:27.257314+0000 mon.a (mon.0) 1197 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:43:28.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:27.257354+0000 mon.a (mon.0) 1198 : cluster [INF] Cluster is now healthy 2024-02-19T21:43:28.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:27.272939+0000 mon.a (mon.0) 1199 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:43:28.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:27.273019+0000 mon.a (mon.0) 1200 : cluster [DBG] osdmap e245: 8 total, 8 up, 7 in 2024-02-19T21:43:28.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:27.029686+0000 mgr.y (mgr.14514) 420 : cluster [DBG] pgmap v494: 138 pgs: 2 active+remapped+backfilling, 136 active+clean; 920 MiB data, 5.2 GiB used, 621 GiB / 626 GiB avail; 737 B/s rd, 0 B/s wr, 855 op/s; 1217/44760 objects misplaced (2.719%); 1024 KiB/s, 15 objects/s recovering 2024-02-19T21:43:28.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:27.257314+0000 mon.a (mon.0) 1197 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:43:28.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:27.257354+0000 mon.a (mon.0) 1198 : cluster [INF] Cluster is now healthy 2024-02-19T21:43:28.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:27.272939+0000 mon.a (mon.0) 1199 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:43:28.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:27.273019+0000 mon.a (mon.0) 1200 : cluster [DBG] osdmap e245: 8 total, 8 up, 7 in 2024-02-19T21:43:28.402 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:43:28.408 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:28.408 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:43:28.509 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:43:28.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:27.029686+0000 mgr.y (mgr.14514) 420 : cluster [DBG] pgmap v494: 138 pgs: 2 active+remapped+backfilling, 136 active+clean; 920 MiB data, 5.2 GiB used, 621 GiB / 626 GiB avail; 737 B/s rd, 0 B/s wr, 855 op/s; 1217/44760 objects misplaced (2.719%); 1024 KiB/s, 15 objects/s recovering 2024-02-19T21:43:28.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:27.257314+0000 mon.a (mon.0) 1197 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:43:28.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:27.257354+0000 mon.a (mon.0) 1198 : cluster [INF] Cluster is now healthy 2024-02-19T21:43:28.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:27.272939+0000 mon.a (mon.0) 1199 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:43:28.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:27.273019+0000 mon.a (mon.0) 1200 : cluster [DBG] osdmap e245: 8 total, 8 up, 7 in 2024-02-19T21:43:28.557 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:28.922 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:43:28.928 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:28.929 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:43:29.030 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:43:29.090 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:29.140 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:43:29.148 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:29.148 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:43:29.249 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:43:29.307 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:29.363 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:43:29.370 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:29.371 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:43:29.472 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:43:29.517 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:29.784 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:43:29.789 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:29.789 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:43:29.890 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:43:29.939 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:29.974 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:43:29.983 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:29.983 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:43:30.084 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:43:30.095 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set noscrub 2024-02-19T21:43:30.132 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:30.253 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:43:30.256 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:30.257 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:43:30.282 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:29.030089+0000 mgr.y (mgr.14514) 421 : cluster [DBG] pgmap v496: 138 pgs: 2 active+remapped+backfilling, 136 active+clean; 920 MiB data, 5.2 GiB used, 621 GiB / 626 GiB avail; 644 B/s rd, 0 B/s wr, 631 op/s; 1217/44760 objects misplaced (2.719%); 895 KiB/s, 13 objects/s recovering 2024-02-19T21:43:30.282 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:30.090037+0000 mon.a (mon.0) 1201 : cluster [DBG] osdmap e246: 8 total, 8 up, 7 in 2024-02-19T21:43:30.358 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:43:30.413 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:30.453 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:43:30.459 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:30.460 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:43:30.491 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:29.030089+0000 mgr.y (mgr.14514) 421 : cluster [DBG] pgmap v496: 138 pgs: 2 active+remapped+backfilling, 136 active+clean; 920 MiB data, 5.2 GiB used, 621 GiB / 626 GiB avail; 644 B/s rd, 0 B/s wr, 631 op/s; 1217/44760 objects misplaced (2.719%); 895 KiB/s, 13 objects/s recovering 2024-02-19T21:43:30.492 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:30.090037+0000 mon.a (mon.0) 1201 : cluster [DBG] osdmap e246: 8 total, 8 up, 7 in 2024-02-19T21:43:30.492 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:29.030089+0000 mgr.y (mgr.14514) 421 : cluster [DBG] pgmap v496: 138 pgs: 2 active+remapped+backfilling, 136 active+clean; 920 MiB data, 5.2 GiB used, 621 GiB / 626 GiB avail; 644 B/s rd, 0 B/s wr, 631 op/s; 1217/44760 objects misplaced (2.719%); 895 KiB/s, 13 objects/s recovering 2024-02-19T21:43:30.492 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:30.090037+0000 mon.a (mon.0) 1201 : cluster [DBG] osdmap e246: 8 total, 8 up, 7 in 2024-02-19T21:43:30.557 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:43:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:43:30.561 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:43:30.630 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:30.664 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:43:30.670 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:30.670 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:43:30.771 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:43:30.820 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:30.846 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:43:30.849 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:30.849 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:43:30.950 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:43:31.002 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:31.036 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:43:31.046 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:31.046 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:43:31.103 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:43:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:43:30] "GET /metrics HTTP/1.1" 200 175941 "" "Prometheus/2.33.4" 2024-02-19T21:43:31.146 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:43:31.199 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:31.288 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:43:31.288 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:43:31.288 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:43:31.288 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:43:31.288 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:43:31.288 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:43:31.288 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:43:31.288 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:43:31.288 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:43:31.289 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:43:31.289 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:43:31.289 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:43:31.289 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:43:31.289 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:43:31.289 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:43:31.289 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:43:31.294 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:30.464810+0000 mgr.y (mgr.14514) 422 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:43:31.294 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:30.893532+0000 mon.a (mon.0) 1202 : audit [DBG] from='client.? 172.21.15.80:0/2908943370' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:43:31.554 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:43:31.568 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:43:31.571 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:30.464810+0000 mgr.y (mgr.14514) 422 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:43:31.571 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:30.893532+0000 mon.a (mon.0) 1202 : audit [DBG] from='client.? 172.21.15.80:0/2908943370' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:43:31.574 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:31.575 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:30.464810+0000 mgr.y (mgr.14514) 422 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:43:31.575 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:30.893532+0000 mon.a (mon.0) 1202 : audit [DBG] from='client.? 172.21.15.80:0/2908943370' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:43:31.575 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:43:31.676 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:43:31.741 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 6, 7] out_osds: [2] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:43:31.741 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:43:31.741 INFO:tasks.thrashosds.thrasher:inject_pause on osd.7 2024-02-19T21:43:31.741 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-02-19T21:43:31.741 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-02-19T21:43:31.742 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.7 config set filestore_inject_stall 3 2024-02-19T21:43:31.742 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:31.773 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:43:31.776 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:31.776 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:43:31.877 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:43:31.910 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:32.152 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:43:32.299 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:31.030684+0000 mgr.y (mgr.14514) 423 : cluster [DBG] pgmap v498: 138 pgs: 2 active+remapped+backfilling, 136 active+clean; 615 MiB data, 4.3 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.24k op/s; 704/30102 objects misplaced (2.339%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:32.301 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:31.030684+0000 mgr.y (mgr.14514) 423 : cluster [DBG] pgmap v498: 138 pgs: 2 active+remapped+backfilling, 136 active+clean; 615 MiB data, 4.3 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.24k op/s; 704/30102 objects misplaced (2.339%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:32.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:31.030684+0000 mgr.y (mgr.14514) 423 : cluster [DBG] pgmap v498: 138 pgs: 2 active+remapped+backfilling, 136 active+clean; 615 MiB data, 4.3 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.24k op/s; 704/30102 objects misplaced (2.339%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:34.329 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:43:34.329 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:43:34.417 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:43:34.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:33.031081+0000 mgr.y (mgr.14514) 424 : cluster [DBG] pgmap v499: 138 pgs: 2 active+remapped+backfilling, 136 active+clean; 615 MiB data, 4.3 GiB used, 622 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 804 op/s; 704/30102 objects misplaced (2.339%); 888 KiB/s, 13 objects/s recovering 2024-02-19T21:43:34.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:33.959815+0000 mon.a (mon.0) 1203 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:43:34.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:33.031081+0000 mgr.y (mgr.14514) 424 : cluster [DBG] pgmap v499: 138 pgs: 2 active+remapped+backfilling, 136 active+clean; 615 MiB data, 4.3 GiB used, 622 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 804 op/s; 704/30102 objects misplaced (2.339%); 888 KiB/s, 13 objects/s recovering 2024-02-19T21:43:34.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:33.959815+0000 mon.a (mon.0) 1203 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:43:34.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:33.031081+0000 mgr.y (mgr.14514) 424 : cluster [DBG] pgmap v499: 138 pgs: 2 active+remapped+backfilling, 136 active+clean; 615 MiB data, 4.3 GiB used, 622 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 804 op/s; 704/30102 objects misplaced (2.339%); 888 KiB/s, 13 objects/s recovering 2024-02-19T21:43:34.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:33.959815+0000 mon.a (mon.0) 1203 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:43:35.178 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:43:35.182 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:35.182 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:43:35.275 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:43:35.276 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2024-02-19T21:43:35.276 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:43:35.283 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:43:35.314 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:35.388 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:43:35.390 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:35.391 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:43:35.491 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:43:35.579 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:36.039 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:43:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:43:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:43:36.060 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:43:36.067 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:36.067 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:43:36.168 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:43:36.236 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:36.250 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.3 dump_historic_ops 2024-02-19T21:43:36.266 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:43:36.271 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:36.271 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:43:36.372 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:43:36.385 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:43:36.407 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-02-19T21:43:36.433 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:36.456 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:43:36.461 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:36.461 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:43:36.562 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:43:36.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:35.031723+0000 mgr.y (mgr.14514) 425 : cluster [DBG] pgmap v500: 138 pgs: 2 active+remapped+backfilling, 136 active+clean; 410 MiB data, 3.6 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.02k op/s; 271/20238 objects misplaced (1.339%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:36.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:36.329516+0000 mon.c (mon.2) 56 : audit [INF] from='client.? 172.21.15.80:0/1125707838' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:43:36.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:36.330115+0000 mon.a (mon.0) 1204 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:43:36.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:35.031723+0000 mgr.y (mgr.14514) 425 : cluster [DBG] pgmap v500: 138 pgs: 2 active+remapped+backfilling, 136 active+clean; 410 MiB data, 3.6 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.02k op/s; 271/20238 objects misplaced (1.339%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:36.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:36.329516+0000 mon.c (mon.2) 56 : audit [INF] from='client.? 172.21.15.80:0/1125707838' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:43:36.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:36.330115+0000 mon.a (mon.0) 1204 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:43:36.613 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:35.031723+0000 mgr.y (mgr.14514) 425 : cluster [DBG] pgmap v500: 138 pgs: 2 active+remapped+backfilling, 136 active+clean; 410 MiB data, 3.6 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.02k op/s; 271/20238 objects misplaced (1.339%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:36.613 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:36.329516+0000 mon.c (mon.2) 56 : audit [INF] from='client.? 172.21.15.80:0/1125707838' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:43:36.613 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:36.330115+0000 mon.a (mon.0) 1204 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:43:36.618 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:36.652 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:43:36.659 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:36.659 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:43:36.760 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:43:36.809 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:37.375 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:43:37.378 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:37.378 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:43:37.479 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:43:37.533 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:37.561 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:43:37.563 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:37.564 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:43:37.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:36.381505+0000 mon.a (mon.0) 1205 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:43:37.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:36.392735+0000 mon.a (mon.0) 1206 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:43:37.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:36.392788+0000 mon.a (mon.0) 1207 : cluster [DBG] osdmap e247: 8 total, 8 up, 7 in 2024-02-19T21:43:37.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:36.381505+0000 mon.a (mon.0) 1205 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:43:37.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:36.392735+0000 mon.a (mon.0) 1206 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:43:37.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:36.392788+0000 mon.a (mon.0) 1207 : cluster [DBG] osdmap e247: 8 total, 8 up, 7 in 2024-02-19T21:43:37.664 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:43:37.713 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:37.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:36.381505+0000 mon.a (mon.0) 1205 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:43:37.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:36.392735+0000 mon.a (mon.0) 1206 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:43:37.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:36.392788+0000 mon.a (mon.0) 1207 : cluster [DBG] osdmap e247: 8 total, 8 up, 7 in 2024-02-19T21:43:37.821 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:43:37.828 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:37.829 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:43:37.858 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:43:37.930 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:43:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:38.667 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:37.032122+0000 mgr.y (mgr.14514) 426 : cluster [DBG] pgmap v502: 138 pgs: 2 active+remapped+backfilling, 136 active+clean; 320 MiB data, 3.3 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.20k op/s; 271/15942 objects misplaced (1.700%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:38.670 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:37.032122+0000 mgr.y (mgr.14514) 426 : cluster [DBG] pgmap v502: 138 pgs: 2 active+remapped+backfilling, 136 active+clean; 320 MiB data, 3.3 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.20k op/s; 271/15942 objects misplaced (1.700%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:38.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:37.032122+0000 mgr.y (mgr.14514) 426 : cluster [DBG] pgmap v502: 138 pgs: 2 active+remapped+backfilling, 136 active+clean; 320 MiB data, 3.3 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.20k op/s; 271/15942 objects misplaced (1.700%); 1.7 MiB/s, 27 objects/s recovering 2024-02-19T21:43:39.251 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:43:39.280 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:43:39.311 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:43:39.340 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:43:39.386 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:43:39.393 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-19T21:43:39.449 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:43:39.475 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:43:39.506 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:43:39.521 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:43:39.521 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:43:39.521 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:43:39.521 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:43:39.521 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:43:39.521 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:43:39.521 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:43:39.521 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:43:39.537 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:43:39.548 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:39.548 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:43:39.649 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:43:39.700 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:39.215730+0000 mon.a (mon.0) 1208 : audit [DBG] from='client.? 172.21.15.80:0/1103573640' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:43:39.700 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:39.215730+0000 mon.a (mon.0) 1208 : audit [DBG] from='client.? 172.21.15.80:0/1103573640' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:43:39.703 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:39.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:39.215730+0000 mon.a (mon.0) 1208 : audit [DBG] from='client.? 172.21.15.80:0/1103573640' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:43:39.815 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:43:39.820 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:39.820 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:43:39.921 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:43:39.978 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:40.018 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:43:40.023 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:40.024 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:43:40.124 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:43:40.163 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:40.182 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:43:40.187 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:40.187 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:43:40.288 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:43:40.315 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:40.334 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:43:40.336 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:40.336 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:43:40.437 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:43:40.464 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:40.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:39.032720+0000 mgr.y (mgr.14514) 427 : cluster [DBG] pgmap v503: 138 pgs: 2 active+remapped+backfilling, 136 active+clean; 320 MiB data, 3.3 GiB used, 622 GiB / 626 GiB avail; 572 B/s rd, 0 B/s wr, 628 op/s; 271/15942 objects misplaced (1.700%); 801 KiB/s, 12 objects/s recovering 2024-02-19T21:43:40.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:40.100142+0000 mon.a (mon.0) 1209 : cluster [DBG] osdmap e248: 8 total, 8 up, 7 in 2024-02-19T21:43:40.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:39.032720+0000 mgr.y (mgr.14514) 427 : cluster [DBG] pgmap v503: 138 pgs: 2 active+remapped+backfilling, 136 active+clean; 320 MiB data, 3.3 GiB used, 622 GiB / 626 GiB avail; 572 B/s rd, 0 B/s wr, 628 op/s; 271/15942 objects misplaced (1.700%); 801 KiB/s, 12 objects/s recovering 2024-02-19T21:43:40.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:40.100142+0000 mon.a (mon.0) 1209 : cluster [DBG] osdmap e248: 8 total, 8 up, 7 in 2024-02-19T21:43:40.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:43:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:43:40.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:39.032720+0000 mgr.y (mgr.14514) 427 : cluster [DBG] pgmap v503: 138 pgs: 2 active+remapped+backfilling, 136 active+clean; 320 MiB data, 3.3 GiB used, 622 GiB / 626 GiB avail; 572 B/s rd, 0 B/s wr, 628 op/s; 271/15942 objects misplaced (1.700%); 801 KiB/s, 12 objects/s recovering 2024-02-19T21:43:40.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:40.100142+0000 mon.a (mon.0) 1209 : cluster [DBG] osdmap e248: 8 total, 8 up, 7 in 2024-02-19T21:43:40.971 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:43:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:43:40] "GET /metrics HTTP/1.1" 200 175912 "" "Prometheus/2.33.4" 2024-02-19T21:43:41.068 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 6, 7] out_osds: [2] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:43:41.069 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:43:41.069 INFO:tasks.thrashosds.thrasher:Shrinking pool default.rgw.control 2024-02-19T21:43:41.069 INFO:tasks.cephadm.ceph_manager.ceph:contract_pool default.rgw.control by 10 min 8 2024-02-19T21:43:41.069 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:43:41.170 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Removed 127715 objects 2024-02-19T21:43:41.170 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Clean up completed and total clean up time :134.195 2024-02-19T21:43:41.217 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:43:41.221 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:41.222 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:43:41.231 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:43:41.232 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-02-19T21:43:41.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-02-19T21:43:41.232 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-02-19T21:43:41.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.232 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:146644 7.3 7:c955df93:::benchmark_data_smithi080_79222_object31910:head [delete] snapc 0=[] ondisk+write+known_if_redirected e133)", 2024-02-19T21:43:41.232 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:37:33.594824+0000", 2024-02-19T21:43:41.232 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 367.634547306, 2024-02-19T21:43:41.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.085638450000000005, 2024-02-19T21:43:41.232 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:43:41.232 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:43:41.232 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:43:41.232 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:43:41.232 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:43:41.232 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 146644 2024-02-19T21:43:41.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.233 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:43:41.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:43:41.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.594824+0000", 2024-02-19T21:43:41.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:43:41.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:43:41.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.594824+0000", 2024-02-19T21:43:41.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:43:41.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:43:41.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.594824+0000", 2024-02-19T21:43:41.234 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1889999999999999e-06 2024-02-19T21:43:41.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.234 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:43:41.234 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.594827+0000", 2024-02-19T21:43:41.234 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7150000000000001e-06 2024-02-19T21:43:41.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.234 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:43:41.234 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.594834+0000", 2024-02-19T21:43:41.234 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1570000000000002e-06 2024-02-19T21:43:41.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.234 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:43:41.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.594838+0000", 2024-02-19T21:43:41.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039128909999999999 2024-02-19T21:43:41.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:43:41.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.598751+0000", 2024-02-19T21:43:41.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010933399999999999 2024-02-19T21:43:41.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:43:41.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.598860+0000", 2024-02-19T21:43:41.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000108114 2024-02-19T21:43:41.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,4", 2024-02-19T21:43:41.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.598968+0000", 2024-02-19T21:43:41.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036184239999999999 2024-02-19T21:43:41.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.236 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.602587+0000", 2024-02-19T21:43:41.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00049427900000000003 2024-02-19T21:43:41.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.236 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.603081+0000", 2024-02-19T21:43:41.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.077295533 2024-02-19T21:43:41.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.237 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:43:41.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.680376+0000", 2024-02-19T21:43:41.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5877999999999997e-05 2024-02-19T21:43:41.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.237 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:43:41.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.680422+0000", 2024-02-19T21:43:41.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0484000000000001e-05 2024-02-19T21:43:41.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.237 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:43:41.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.680463+0000", 2024-02-19T21:43:41.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.085638450000000005 2024-02-19T21:43:41.237 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.237 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:43:41.237 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.238 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:146650 7.1 7:88a9e3a7:::benchmark_data_smithi080_79222_object31916:head [delete] snapc 0=[] ondisk+write+known_if_redirected e133)", 2024-02-19T21:43:41.238 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:37:33.597149+0000", 2024-02-19T21:43:41.238 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 367.63222221699999, 2024-02-19T21:43:41.238 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.083177503, 2024-02-19T21:43:41.238 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:43:41.238 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:43:41.238 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:43:41.238 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:43:41.238 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:43:41.238 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 146650 2024-02-19T21:43:41.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.238 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:43:41.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:43:41.239 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.597149+0000", 2024-02-19T21:43:41.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:43:41.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:43:41.239 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.597149+0000", 2024-02-19T21:43:41.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:43:41.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:43:41.239 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.597148+0000", 2024-02-19T21:43:41.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5899999999999996e-06 2024-02-19T21:43:41.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:43:41.240 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.597155+0000", 2024-02-19T21:43:41.240 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1384e-05 2024-02-19T21:43:41.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.240 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.240 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:43:41.240 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.597166+0000", 2024-02-19T21:43:41.240 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1630000000000001e-06 2024-02-19T21:43:41.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.240 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.240 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:43:41.240 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.597172+0000", 2024-02-19T21:43:41.240 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7366e-05 2024-02-19T21:43:41.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.241 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:43:41.241 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.597220+0000", 2024-02-19T21:43:41.241 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010116900000000001 2024-02-19T21:43:41.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.241 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:43:41.241 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.597321+0000", 2024-02-19T21:43:41.241 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011493900000000001 2024-02-19T21:43:41.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.241 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4,6", 2024-02-19T21:43:41.241 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.597436+0000", 2024-02-19T21:43:41.241 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049275109999999999 2024-02-19T21:43:41.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.242 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.242 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.602363+0000", 2024-02-19T21:43:41.242 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001010358 2024-02-19T21:43:41.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.242 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.242 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.603374+0000", 2024-02-19T21:43:41.242 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.076844318999999994 2024-02-19T21:43:41.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.242 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:43:41.242 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.680218+0000", 2024-02-19T21:43:41.242 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4690000000000006e-05 2024-02-19T21:43:41.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.243 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:43:41.243 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.680283+0000", 2024-02-19T21:43:41.243 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4320000000000003e-05 2024-02-19T21:43:41.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.243 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:43:41.243 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.680327+0000", 2024-02-19T21:43:41.243 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.083177503 2024-02-19T21:43:41.243 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.243 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:43:41.243 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.243 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.14793.0:146646 7.c e133/100 7:3b25307f:::benchmark_data_smithi080_79222_object31912:head v 133'9250, mlcod=133'9247)", 2024-02-19T21:43:41.243 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:37:33.599120+0000", 2024-02-19T21:43:41.244 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 367.63025165599998, 2024-02-19T21:43:41.244 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.081132095000000001, 2024-02-19T21:43:41.244 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:43:41.244 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:43:41.244 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:43:41.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.244 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:43:41.244 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.599120+0000", 2024-02-19T21:43:41.244 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:43:41.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.244 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:43:41.244 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.599120+0000", 2024-02-19T21:43:41.244 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:43:41.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.245 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:43:41.245 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.599119+0000", 2024-02-19T21:43:41.245 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4729999999999997e-06 2024-02-19T21:43:41.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.245 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:43:41.245 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.599126+0000", 2024-02-19T21:43:41.245 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2400000000000007e-06 2024-02-19T21:43:41.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.245 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:43:41.245 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.599134+0000", 2024-02-19T21:43:41.246 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6040000000000003e-06 2024-02-19T21:43:41.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.246 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:43:41.246 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.599139+0000", 2024-02-19T21:43:41.246 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3930999999999994e-05 2024-02-19T21:43:41.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.246 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:43:41.246 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.599213+0000", 2024-02-19T21:43:41.246 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9874e-05 2024-02-19T21:43:41.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.246 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:43:41.246 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.599233+0000", 2024-02-19T21:43:41.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.080984178000000004 2024-02-19T21:43:41.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.247 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:43:41.247 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.680217+0000", 2024-02-19T21:43:41.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5379000000000001e-05 2024-02-19T21:43:41.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.247 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:43:41.247 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.680252+0000", 2024-02-19T21:43:41.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.081132095000000001 2024-02-19T21:43:41.247 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.247 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:43:41.247 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.248 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.14793.0:146652 7.c e133/100 7:3c2dcaab:::benchmark_data_smithi080_79222_object31918:head v 133'9251, mlcod=133'9248)", 2024-02-19T21:43:41.248 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:37:33.600971+0000", 2024-02-19T21:43:41.248 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 367.62840111700001, 2024-02-19T21:43:41.248 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.079305205000000004, 2024-02-19T21:43:41.248 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:43:41.248 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:43:41.248 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:43:41.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.248 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:43:41.248 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.600971+0000", 2024-02-19T21:43:41.248 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:43:41.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.249 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:43:41.249 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.600971+0000", 2024-02-19T21:43:41.249 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:43:41.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.249 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:43:41.249 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.600970+0000", 2024-02-19T21:43:41.249 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4530000000000004e-06 2024-02-19T21:43:41.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.249 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:43:41.249 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.600974+0000", 2024-02-19T21:43:41.249 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5599999999999999e-06 2024-02-19T21:43:41.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.250 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:43:41.250 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.600981+0000", 2024-02-19T21:43:41.250 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8149999999999999e-06 2024-02-19T21:43:41.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.250 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.250 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:43:41.250 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.600985+0000", 2024-02-19T21:43:41.250 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011938890000000001 2024-02-19T21:43:41.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.250 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.250 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:43:41.250 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.602179+0000", 2024-02-19T21:43:41.250 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2456999999999999e-05 2024-02-19T21:43:41.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.250 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.251 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:43:41.251 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.602191+0000", 2024-02-19T21:43:41.251 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.078065796000000007 2024-02-19T21:43:41.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.251 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.251 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:43:41.251 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.680257+0000", 2024-02-19T21:43:41.251 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8853000000000001e-05 2024-02-19T21:43:41.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.251 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.251 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:43:41.251 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.680276+0000", 2024-02-19T21:43:41.251 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.079305205000000004 2024-02-19T21:43:41.251 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.251 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:43:41.252 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.252 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.252 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.252 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:146655 7.3 7:c13bbcaf:::benchmark_data_smithi080_79222_object31921:head [delete] snapc 0=[] ondisk+write+known_if_redirected e133)", 2024-02-19T21:43:41.252 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:37:33.604736+0000", 2024-02-19T21:43:41.252 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 367.62463610999998, 2024-02-19T21:43:41.252 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.075805560999999994, 2024-02-19T21:43:41.252 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:43:41.252 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:43:41.252 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:43:41.252 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:43:41.252 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:43:41.252 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 146655 2024-02-19T21:43:41.252 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.252 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:43:41.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.253 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:43:41.253 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.604736+0000", 2024-02-19T21:43:41.253 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:43:41.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.253 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:43:41.253 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.604736+0000", 2024-02-19T21:43:41.253 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:43:41.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.253 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:43:41.253 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.604734+0000", 2024-02-19T21:43:41.254 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7430000000000002e-06 2024-02-19T21:43:41.254 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.254 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.254 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:43:41.255 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.604739+0000", 2024-02-19T21:43:41.255 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5644000000000001e-05 2024-02-19T21:43:41.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.255 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:43:41.255 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.604754+0000", 2024-02-19T21:43:41.255 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2950000000000001e-06 2024-02-19T21:43:41.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.256 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:43:41.256 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.604760+0000", 2024-02-19T21:43:41.256 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9057999999999998e-05 2024-02-19T21:43:41.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.256 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.256 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:43:41.256 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.604799+0000", 2024-02-19T21:43:41.256 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1135000000000002e-05 2024-02-19T21:43:41.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.256 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.256 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:43:41.256 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.604880+0000", 2024-02-19T21:43:41.256 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5451000000000006e-05 2024-02-19T21:43:41.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.257 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.257 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,4", 2024-02-19T21:43:41.257 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.604965+0000", 2024-02-19T21:43:41.257 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026463049999999998 2024-02-19T21:43:41.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.257 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.257 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.257 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.607612+0000", 2024-02-19T21:43:41.257 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00055633699999999996 2024-02-19T21:43:41.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.257 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.257 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.258 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.608168+0000", 2024-02-19T21:43:41.258 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.072302115 2024-02-19T21:43:41.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.258 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.258 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:43:41.258 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.680470+0000", 2024-02-19T21:43:41.258 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6653000000000003e-05 2024-02-19T21:43:41.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.258 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.258 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:43:41.258 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.680507+0000", 2024-02-19T21:43:41.258 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4350000000000001e-05 2024-02-19T21:43:41.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.259 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:43:41.259 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.680541+0000", 2024-02-19T21:43:41.259 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.075805560999999994 2024-02-19T21:43:41.259 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.259 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:43:41.259 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.259 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:146657 7.1 7:8061afdc:::benchmark_data_smithi080_79222_object31923:head [delete] snapc 0=[] ondisk+write+known_if_redirected e133)", 2024-02-19T21:43:41.259 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:37:33.605009+0000", 2024-02-19T21:43:41.259 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 367.62436248, 2024-02-19T21:43:41.259 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.076026891999999999, 2024-02-19T21:43:41.260 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:43:41.260 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:43:41.260 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:43:41.260 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:43:41.260 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:43:41.260 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 146657 2024-02-19T21:43:41.260 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.260 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:43:41.260 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.260 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:43:41.260 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.605009+0000", 2024-02-19T21:43:41.260 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:43:41.260 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.261 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.261 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:43:41.261 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.605009+0000", 2024-02-19T21:43:41.261 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:43:41.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.261 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.261 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:43:41.261 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.605008+0000", 2024-02-19T21:43:41.261 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.251e-06 2024-02-19T21:43:41.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.261 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.261 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:43:41.262 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.605014+0000", 2024-02-19T21:43:41.262 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7790000000000001e-06 2024-02-19T21:43:41.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.262 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.262 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:43:41.262 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.605023+0000", 2024-02-19T21:43:41.262 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.117e-06 2024-02-19T21:43:41.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.262 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.262 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:43:41.262 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.605029+0000", 2024-02-19T21:43:41.262 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2880999999999998e-05 2024-02-19T21:43:41.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.262 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.263 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:43:41.263 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.605072+0000", 2024-02-19T21:43:41.263 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117608 2024-02-19T21:43:41.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.263 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:43:41.263 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.605190+0000", 2024-02-19T21:43:41.263 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012875000000000001 2024-02-19T21:43:41.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.263 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4,6", 2024-02-19T21:43:41.263 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.605319+0000", 2024-02-19T21:43:41.263 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.075017218999999996 2024-02-19T21:43:41.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.264 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:43:41.264 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.680336+0000", 2024-02-19T21:43:41.264 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0587000000000003e-05 2024-02-19T21:43:41.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.264 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.264 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.680376+0000", 2024-02-19T21:43:41.264 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00058807900000000003 2024-02-19T21:43:41.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.265 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.265 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.680964+0000", 2024-02-19T21:43:41.265 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8062999999999998e-05 2024-02-19T21:43:41.265 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.265 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.265 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:43:41.265 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.681002+0000", 2024-02-19T21:43:41.265 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3627999999999997e-05 2024-02-19T21:43:41.265 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.265 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.265 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:43:41.265 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.681036+0000", 2024-02-19T21:43:41.266 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.076026891999999999 2024-02-19T21:43:41.266 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.266 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:43:41.266 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.266 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.266 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.266 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.14793.0:146654 7.c e133/100 7:30f1511f:::benchmark_data_smithi080_79222_object31920:head v 133'9252, mlcod=133'9248)", 2024-02-19T21:43:41.266 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:37:33.607582+0000", 2024-02-19T21:43:41.266 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 367.62178997000001, 2024-02-19T21:43:41.266 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.072712969000000002, 2024-02-19T21:43:41.266 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:43:41.266 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:43:41.266 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:43:41.267 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.267 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:43:41.267 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.607582+0000", 2024-02-19T21:43:41.267 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:43:41.267 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.267 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.267 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:43:41.267 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.607582+0000", 2024-02-19T21:43:41.267 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:43:41.267 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.267 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.268 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:43:41.268 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.607581+0000", 2024-02-19T21:43:41.268 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1220000000000003e-06 2024-02-19T21:43:41.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.268 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:43:41.268 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.607586+0000", 2024-02-19T21:43:41.268 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9700000000000002e-06 2024-02-19T21:43:41.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.268 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:43:41.268 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.607593+0000", 2024-02-19T21:43:41.268 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3449999999999999e-06 2024-02-19T21:43:41.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.269 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:43:41.269 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.607598+0000", 2024-02-19T21:43:41.269 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4582000000000002e-05 2024-02-19T21:43:41.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.269 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:43:41.269 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.607632+0000", 2024-02-19T21:43:41.269 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6507e-05 2024-02-19T21:43:41.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.269 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:43:41.269 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.607649+0000", 2024-02-19T21:43:41.269 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.072629688999999997 2024-02-19T21:43:41.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.270 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.270 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:43:41.270 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.680278+0000", 2024-02-19T21:43:41.270 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6206999999999999e-05 2024-02-19T21:43:41.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.270 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.270 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:43:41.270 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.680295+0000", 2024-02-19T21:43:41.270 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.072712969000000002 2024-02-19T21:43:41.270 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.270 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:43:41.270 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.271 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.271 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.14793.0:146658 7.0 e133/100 7:08747e90:::benchmark_data_smithi080_79222_object31924:head v 133'9162, mlcod=133'9160)", 2024-02-19T21:43:41.271 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:37:33.608306+0000", 2024-02-19T21:43:41.271 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 367.62106574900002, 2024-02-19T21:43:41.271 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.075114342000000001, 2024-02-19T21:43:41.271 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:43:41.271 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:43:41.271 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:43:41.271 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.271 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:43:41.271 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.608306+0000", 2024-02-19T21:43:41.271 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:43:41.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.271 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.271 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:43:41.272 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.608306+0000", 2024-02-19T21:43:41.272 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:43:41.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.272 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.272 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:43:41.272 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.608305+0000", 2024-02-19T21:43:41.272 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0830000000000004e-06 2024-02-19T21:43:41.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.272 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.272 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:43:41.272 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.608313+0000", 2024-02-19T21:43:41.272 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0679000000000001e-05 2024-02-19T21:43:41.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.272 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.273 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:43:41.273 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.608324+0000", 2024-02-19T21:43:41.273 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5419999999999996e-06 2024-02-19T21:43:41.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.273 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.273 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:43:41.273 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.608329+0000", 2024-02-19T21:43:41.273 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7457000000000002e-05 2024-02-19T21:43:41.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.273 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.273 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:43:41.273 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.608387+0000", 2024-02-19T21:43:41.273 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5245e-05 2024-02-19T21:43:41.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.274 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.274 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:43:41.274 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.608412+0000", 2024-02-19T21:43:41.274 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.074980427000000002 2024-02-19T21:43:41.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.274 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.274 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:43:41.274 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.683393+0000", 2024-02-19T21:43:41.274 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.775e-05 2024-02-19T21:43:41.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.274 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.274 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:43:41.274 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:33.683420+0000", 2024-02-19T21:43:41.274 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.075114342000000001 2024-02-19T21:43:41.275 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.275 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:43:41.275 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.275 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:147634 7.a 7:530eb1e9:::benchmark_data_smithi080_79222_object32900:head [delete] snapc 0=[] ondisk+write+known_if_redirected e133)", 2024-02-19T21:43:41.275 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:37:34.590070+0000", 2024-02-19T21:43:41.275 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 366.63930199700002, 2024-02-19T21:43:41.275 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.075288369999999993, 2024-02-19T21:43:41.275 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:43:41.275 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:43:41.275 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:43:41.276 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:43:41.276 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:43:41.276 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 147634 2024-02-19T21:43:41.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.276 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:43:41.276 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.276 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:43:41.276 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.590070+0000", 2024-02-19T21:43:41.276 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:43:41.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.276 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.276 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:43:41.276 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.590070+0000", 2024-02-19T21:43:41.277 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:43:41.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.277 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.277 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:43:41.277 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.590069+0000", 2024-02-19T21:43:41.277 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6689999999999999e-06 2024-02-19T21:43:41.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.277 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.277 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:43:41.277 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.590072+0000", 2024-02-19T21:43:41.277 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2129999999999999e-06 2024-02-19T21:43:41.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.277 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.277 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:43:41.277 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.590077+0000", 2024-02-19T21:43:41.278 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0070000000000002e-06 2024-02-19T21:43:41.278 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.278 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.278 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:43:41.278 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.590080+0000", 2024-02-19T21:43:41.278 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020036000000000001 2024-02-19T21:43:41.278 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.278 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.278 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:43:41.278 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.590281+0000", 2024-02-19T21:43:41.278 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7392999999999994e-05 2024-02-19T21:43:41.278 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.278 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.279 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:43:41.279 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.590378+0000", 2024-02-19T21:43:41.279 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0939000000000006e-05 2024-02-19T21:43:41.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.279 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.279 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,5", 2024-02-19T21:43:41.279 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.590459+0000", 2024-02-19T21:43:41.279 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044952890000000004 2024-02-19T21:43:41.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.279 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.279 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.279 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.594954+0000", 2024-02-19T21:43:41.279 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059456880000000002 2024-02-19T21:43:41.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.280 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.280 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:43:41.280 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.600900+0000", 2024-02-19T21:43:41.280 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.064375634000000001 2024-02-19T21:43:41.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.280 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.280 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.280 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.665276+0000", 2024-02-19T21:43:41.280 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4428000000000002e-05 2024-02-19T21:43:41.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.280 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.280 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:43:41.280 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.665320+0000", 2024-02-19T21:43:41.281 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7839000000000001e-05 2024-02-19T21:43:41.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.281 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.281 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:43:41.281 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.665358+0000", 2024-02-19T21:43:41.281 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.075288369999999993 2024-02-19T21:43:41.281 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.281 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:43:41.281 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.281 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.281 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:147636 7.a 7:5b7fb70e:::benchmark_data_smithi080_79222_object32902:head [delete] snapc 0=[] ondisk+write+known_if_redirected e133)", 2024-02-19T21:43:41.281 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:37:34.590365+0000", 2024-02-19T21:43:41.281 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 366.63900660500002, 2024-02-19T21:43:41.281 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.075087837000000004, 2024-02-19T21:43:41.282 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:43:41.282 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:43:41.282 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:43:41.282 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:43:41.282 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:43:41.282 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 147636 2024-02-19T21:43:41.282 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.282 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:43:41.282 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.282 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:43:41.282 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.590365+0000", 2024-02-19T21:43:41.282 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:43:41.282 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.282 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.282 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:43:41.283 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.590365+0000", 2024-02-19T21:43:41.283 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:43:41.283 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.283 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.283 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:43:41.283 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.590364+0000", 2024-02-19T21:43:41.283 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4809999999999997e-06 2024-02-19T21:43:41.283 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.283 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.283 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:43:41.283 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.590369+0000", 2024-02-19T21:43:41.283 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5750000000000007e-06 2024-02-19T21:43:41.283 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.283 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.283 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:43:41.283 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.590379+0000", 2024-02-19T21:43:41.284 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2089999999999996e-06 2024-02-19T21:43:41.284 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.284 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.284 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:43:41.284 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.590384+0000", 2024-02-19T21:43:41.284 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0021857460000000001 2024-02-19T21:43:41.284 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.284 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.284 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:43:41.284 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.592570+0000", 2024-02-19T21:43:41.284 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3900000000000006e-05 2024-02-19T21:43:41.284 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.284 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.284 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:43:41.285 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.592664+0000", 2024-02-19T21:43:41.285 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011435899999999999 2024-02-19T21:43:41.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.285 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.285 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,5", 2024-02-19T21:43:41.285 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.592778+0000", 2024-02-19T21:43:41.285 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0080720960000000008 2024-02-19T21:43:41.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.285 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.285 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.285 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.600850+0000", 2024-02-19T21:43:41.285 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4969000000000002e-05 2024-02-19T21:43:41.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.285 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.285 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:43:41.286 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.600905+0000", 2024-02-19T21:43:41.286 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.064482801000000006 2024-02-19T21:43:41.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.286 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.286 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.286 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.665388+0000", 2024-02-19T21:43:41.286 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3973000000000002e-05 2024-02-19T21:43:41.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.286 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.286 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:43:41.286 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.665422+0000", 2024-02-19T21:43:41.286 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0817e-05 2024-02-19T21:43:41.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.286 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.287 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:43:41.287 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.665453+0000", 2024-02-19T21:43:41.287 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.075087837000000004 2024-02-19T21:43:41.287 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.287 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:43:41.287 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.287 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.287 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.287 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:147637 7.a 7:5e872576:::benchmark_data_smithi080_79222_object32903:head [delete] snapc 0=[] ondisk+write+known_if_redirected e133)", 2024-02-19T21:43:41.287 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:37:34.591249+0000", 2024-02-19T21:43:41.287 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 366.63812283099998, 2024-02-19T21:43:41.287 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.074293495000000001, 2024-02-19T21:43:41.287 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:43:41.288 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:43:41.288 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:43:41.288 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:43:41.288 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:43:41.288 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 147637 2024-02-19T21:43:41.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.288 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:43:41.288 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.288 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:43:41.288 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.591249+0000", 2024-02-19T21:43:41.288 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:43:41.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.289 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:43:41.289 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.591249+0000", 2024-02-19T21:43:41.289 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:43:41.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.289 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:43:41.289 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.591248+0000", 2024-02-19T21:43:41.289 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9449999999999998e-06 2024-02-19T21:43:41.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.289 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:43:41.289 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.591254+0000", 2024-02-19T21:43:41.289 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8660000000000001e-06 2024-02-19T21:43:41.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.290 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.290 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:43:41.290 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.591264+0000", 2024-02-19T21:43:41.290 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3089999999999997e-06 2024-02-19T21:43:41.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.290 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.290 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:43:41.290 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.591268+0000", 2024-02-19T21:43:41.290 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037091390000000002 2024-02-19T21:43:41.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.290 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.290 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:43:41.290 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.594977+0000", 2024-02-19T21:43:41.291 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000110988 2024-02-19T21:43:41.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.291 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.291 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:43:41.291 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.595088+0000", 2024-02-19T21:43:41.291 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012391799999999999 2024-02-19T21:43:41.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.291 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.291 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,5", 2024-02-19T21:43:41.291 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.595212+0000", 2024-02-19T21:43:41.291 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0056806369999999997 2024-02-19T21:43:41.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.291 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.292 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.292 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.600893+0000", 2024-02-19T21:43:41.292 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003097598 2024-02-19T21:43:41.292 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.292 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.292 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:43:41.292 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.603990+0000", 2024-02-19T21:43:41.292 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.061491005000000001 2024-02-19T21:43:41.292 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.292 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.292 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.292 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.665481+0000", 2024-02-19T21:43:41.292 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1829999999999998e-05 2024-02-19T21:43:41.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.293 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.293 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:43:41.293 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.665513+0000", 2024-02-19T21:43:41.293 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9291000000000001e-05 2024-02-19T21:43:41.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.293 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.293 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:43:41.293 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.665542+0000", 2024-02-19T21:43:41.293 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.074293495000000001 2024-02-19T21:43:41.293 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.293 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:43:41.293 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.294 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.294 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:147640 7.2 7:4d7ba940:::benchmark_data_smithi080_79222_object32906:head [delete] snapc 0=[] ondisk+write+known_if_redirected e133)", 2024-02-19T21:43:41.294 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:37:34.597195+0000", 2024-02-19T21:43:41.294 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 366.63217692900002, 2024-02-19T21:43:41.294 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.073196128999999999, 2024-02-19T21:43:41.294 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:43:41.294 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:43:41.294 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:43:41.294 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:43:41.294 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:43:41.294 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 147640 2024-02-19T21:43:41.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.295 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:43:41.295 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.295 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:43:41.295 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.597195+0000", 2024-02-19T21:43:41.295 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:43:41.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.295 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.295 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:43:41.295 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.597195+0000", 2024-02-19T21:43:41.295 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:43:41.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.295 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.295 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:43:41.295 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.597193+0000", 2024-02-19T21:43:41.296 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0889999999999996e-06 2024-02-19T21:43:41.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.296 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:43:41.296 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.597199+0000", 2024-02-19T21:43:41.296 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2709999999999998e-06 2024-02-19T21:43:41.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.296 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:43:41.296 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.597209+0000", 2024-02-19T21:43:41.296 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2689999999999999e-06 2024-02-19T21:43:41.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.296 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:43:41.297 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.597214+0000", 2024-02-19T21:43:41.297 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043082 2024-02-19T21:43:41.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.297 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.297 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:43:41.297 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.597645+0000", 2024-02-19T21:43:41.297 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4464999999999998e-05 2024-02-19T21:43:41.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.297 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.297 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:43:41.297 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.597739+0000", 2024-02-19T21:43:41.297 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000108255 2024-02-19T21:43:41.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.297 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.297 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,2", 2024-02-19T21:43:41.298 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.597847+0000", 2024-02-19T21:43:41.298 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061497449999999999 2024-02-19T21:43:41.298 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.298 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.298 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:43:41.298 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.603997+0000", 2024-02-19T21:43:41.298 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.061772318999999999 2024-02-19T21:43:41.298 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.298 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.298 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.298 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.665769+0000", 2024-02-19T21:43:41.298 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045372779999999996 2024-02-19T21:43:41.298 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.298 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.298 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.299 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.670307+0000", 2024-02-19T21:43:41.299 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5299000000000001e-05 2024-02-19T21:43:41.299 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.300 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.300 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:43:41.300 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.670352+0000", 2024-02-19T21:43:41.300 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8847999999999998e-05 2024-02-19T21:43:41.300 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.300 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.300 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:43:41.300 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:37:34.670391+0000", 2024-02-19T21:43:41.300 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.073196128999999999 2024-02-19T21:43:41.300 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.300 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:43:41.300 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.300 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.301 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.301 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:207954 7.a 7:515eebfe:::benchmark_data_smithi080_79222_object93220:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:43:41.301 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:42.600766+0000", 2024-02-19T21:43:41.301 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 298.62860593699997, 2024-02-19T21:43:41.301 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.071440000000000003, 2024-02-19T21:43:41.301 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:43:41.301 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:43:41.301 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:43:41.301 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:43:41.301 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:43:41.301 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 207954 2024-02-19T21:43:41.301 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.301 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:43:41.302 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.302 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:43:41.302 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.600766+0000", 2024-02-19T21:43:41.302 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:43:41.303 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.303 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.303 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:43:41.303 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.600766+0000", 2024-02-19T21:43:41.303 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:43:41.303 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.303 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.303 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:43:41.304 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.600764+0000", 2024-02-19T21:43:41.304 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4110000000000004e-06 2024-02-19T21:43:41.304 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.304 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.304 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:43:41.304 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.600770+0000", 2024-02-19T21:43:41.304 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0984e-05 2024-02-19T21:43:41.304 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.304 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.304 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:43:41.304 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.600781+0000", 2024-02-19T21:43:41.304 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7209999999999999e-06 2024-02-19T21:43:41.304 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.304 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.305 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:43:41.305 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.600786+0000", 2024-02-19T21:43:41.305 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3846e-05 2024-02-19T21:43:41.305 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.305 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.305 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:43:41.305 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.600830+0000", 2024-02-19T21:43:41.305 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104867 2024-02-19T21:43:41.305 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.305 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.305 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:43:41.305 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.600935+0000", 2024-02-19T21:43:41.305 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113119 2024-02-19T21:43:41.305 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.306 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.306 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,5", 2024-02-19T21:43:41.306 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.601048+0000", 2024-02-19T21:43:41.306 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0052069880000000001 2024-02-19T21:43:41.306 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.306 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.306 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:43:41.306 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.606255+0000", 2024-02-19T21:43:41.306 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00095145799999999997 2024-02-19T21:43:41.306 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.306 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.306 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.307 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.607207+0000", 2024-02-19T21:43:41.307 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.064912692999999994 2024-02-19T21:43:41.307 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.307 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.307 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.307 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.672119+0000", 2024-02-19T21:43:41.307 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9264000000000001e-05 2024-02-19T21:43:41.307 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.307 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.307 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:43:41.307 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.672169+0000", 2024-02-19T21:43:41.307 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7243999999999998e-05 2024-02-19T21:43:41.308 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.308 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.308 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:43:41.308 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:42.672206+0000", 2024-02-19T21:43:41.308 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.071440000000000003 2024-02-19T21:43:41.308 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.308 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:43:41.308 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.308 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.308 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.308 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:47320 8.0 8:05886699:::benchmark_data_smithi080_100924_object47319:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e173)", 2024-02-19T21:43:41.308 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:40:17.793464+0000", 2024-02-19T21:43:41.308 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 203.435907759, 2024-02-19T21:43:41.309 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.096610162999999999, 2024-02-19T21:43:41.309 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:43:41.309 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:43:41.309 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:43:41.309 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:43:41.309 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:43:41.309 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 47320 2024-02-19T21:43:41.309 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.309 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:43:41.309 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.310 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:43:41.310 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.793464+0000", 2024-02-19T21:43:41.310 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:43:41.310 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.310 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.310 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:43:41.310 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.793464+0000", 2024-02-19T21:43:41.310 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:43:41.310 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.310 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.311 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:43:41.311 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.793463+0000", 2024-02-19T21:43:41.311 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8553e-05 2024-02-19T21:43:41.311 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.311 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.311 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:43:41.311 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.793481+0000", 2024-02-19T21:43:41.311 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0362e-05 2024-02-19T21:43:41.311 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.311 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.311 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:43:41.311 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.793492+0000", 2024-02-19T21:43:41.311 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7949999999999998e-06 2024-02-19T21:43:41.311 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.311 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.312 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:43:41.312 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.793496+0000", 2024-02-19T21:43:41.312 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4679999999999999e-05 2024-02-19T21:43:41.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.312 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:43:41.312 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.793541+0000", 2024-02-19T21:43:41.312 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117094 2024-02-19T21:43:41.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.313 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:43:41.313 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.793658+0000", 2024-02-19T21:43:41.313 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015655000000000001 2024-02-19T21:43:41.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.313 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,5", 2024-02-19T21:43:41.313 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.793815+0000", 2024-02-19T21:43:41.313 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0021956409999999999 2024-02-19T21:43:41.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.313 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:43:41.313 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.796010+0000", 2024-02-19T21:43:41.313 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9471e-05 2024-02-19T21:43:41.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.314 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.314 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.796070+0000", 2024-02-19T21:43:41.314 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.093914855000000005 2024-02-19T21:43:41.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.314 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.314 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.889985+0000", 2024-02-19T21:43:41.314 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9607999999999997e-05 2024-02-19T21:43:41.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.314 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:43:41.314 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.890034+0000", 2024-02-19T21:43:41.314 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9875e-05 2024-02-19T21:43:41.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.315 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.315 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:43:41.315 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.890074+0000", 2024-02-19T21:43:41.315 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.096610162999999999 2024-02-19T21:43:41.315 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.315 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:43:41.315 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.315 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.315 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:235482 8.f 8:f3984343:::benchmark_data_smithi080_100924_object107764:head [delete] snapc 0=[] ondisk+write+known_if_redirected e241)", 2024-02-19T21:43:41.315 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:19.735518+0000", 2024-02-19T21:43:41.315 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.493853897000001, 2024-02-19T21:43:41.315 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.076482130999999995, 2024-02-19T21:43:41.315 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:43:41.316 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:43:41.316 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:43:41.316 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:43:41.316 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:43:41.316 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 235482 2024-02-19T21:43:41.316 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.316 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:43:41.316 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.316 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:43:41.316 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.735518+0000", 2024-02-19T21:43:41.317 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:43:41.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.317 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:43:41.318 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.735518+0000", 2024-02-19T21:43:41.318 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:43:41.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.318 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:43:41.318 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.735516+0000", 2024-02-19T21:43:41.318 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6100000000000002e-06 2024-02-19T21:43:41.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.318 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:43:41.318 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.735523+0000", 2024-02-19T21:43:41.318 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5580000000000001e-06 2024-02-19T21:43:41.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.319 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:43:41.319 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.735531+0000", 2024-02-19T21:43:41.319 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0800000000000002e-06 2024-02-19T21:43:41.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.319 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:43:41.319 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.735537+0000", 2024-02-19T21:43:41.319 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5188000000000003e-05 2024-02-19T21:43:41.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.319 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:43:41.320 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.735573+0000", 2024-02-19T21:43:41.320 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010925900000000001 2024-02-19T21:43:41.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.320 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.320 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:43:41.320 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.735682+0000", 2024-02-19T21:43:41.320 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3877999999999999e-05 2024-02-19T21:43:41.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.320 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.321 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,4", 2024-02-19T21:43:41.321 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.735766+0000", 2024-02-19T21:43:41.321 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041532189999999997 2024-02-19T21:43:41.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.321 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:43:41.321 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.739919+0000", 2024-02-19T21:43:41.321 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0077197749999999999 2024-02-19T21:43:41.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.321 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.321 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.747639+0000", 2024-02-19T21:43:41.321 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.064284648999999999 2024-02-19T21:43:41.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.322 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.322 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.811923+0000", 2024-02-19T21:43:41.322 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0442999999999999e-05 2024-02-19T21:43:41.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.322 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:43:41.322 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.811964+0000", 2024-02-19T21:43:41.322 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6108000000000001e-05 2024-02-19T21:43:41.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.322 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:43:41.322 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.812000+0000", 2024-02-19T21:43:41.322 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.076482130999999995 2024-02-19T21:43:41.323 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.323 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:43:41.323 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.323 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:235487 8.f 8:f5fa13c3:::benchmark_data_smithi080_100924_object107769:head [delete] snapc 0=[] ondisk+write+known_if_redirected e241)", 2024-02-19T21:43:41.323 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:19.740324+0000", 2024-02-19T21:43:41.323 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.489048016000002, 2024-02-19T21:43:41.323 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.076233601999999998, 2024-02-19T21:43:41.323 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:43:41.323 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:43:41.323 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:43:41.324 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:43:41.324 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:43:41.324 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 235487 2024-02-19T21:43:41.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.324 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:43:41.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.324 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:43:41.324 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740324+0000", 2024-02-19T21:43:41.324 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:43:41.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.324 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:43:41.324 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740324+0000", 2024-02-19T21:43:41.324 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:43:41.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.325 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:43:41.325 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740322+0000", 2024-02-19T21:43:41.325 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8430000000000004e-06 2024-02-19T21:43:41.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.325 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:43:41.325 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740329+0000", 2024-02-19T21:43:41.325 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1077000000000001e-05 2024-02-19T21:43:41.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.326 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:43:41.326 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740340+0000", 2024-02-19T21:43:41.326 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2260000000000002e-06 2024-02-19T21:43:41.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.326 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:43:41.326 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740346+0000", 2024-02-19T21:43:41.326 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5266000000000003e-05 2024-02-19T21:43:41.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.327 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:43:41.327 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740392+0000", 2024-02-19T21:43:41.327 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7865e-05 2024-02-19T21:43:41.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.327 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:43:41.327 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740479+0000", 2024-02-19T21:43:41.327 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5932000000000003e-05 2024-02-19T21:43:41.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.327 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,4", 2024-02-19T21:43:41.327 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740565+0000", 2024-02-19T21:43:41.328 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010454463000000001 2024-02-19T21:43:41.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.328 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.328 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:43:41.328 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.751020+0000", 2024-02-19T21:43:41.328 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.061026550999999998 2024-02-19T21:43:41.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.329 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.329 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.329 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.812046+0000", 2024-02-19T21:43:41.329 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044331300000000004 2024-02-19T21:43:41.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.329 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.329 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.329 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.816480+0000", 2024-02-19T21:43:41.330 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2168e-05 2024-02-19T21:43:41.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.330 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:43:41.330 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.816522+0000", 2024-02-19T21:43:41.330 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5574000000000002e-05 2024-02-19T21:43:41.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.330 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:43:41.330 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.816557+0000", 2024-02-19T21:43:41.330 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.076233601999999998 2024-02-19T21:43:41.330 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.330 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:43:41.331 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.331 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.331 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:235489 8.f 8:f3d3122d:::benchmark_data_smithi080_100924_object107771:head [delete] snapc 0=[] ondisk+write+known_if_redirected e241)", 2024-02-19T21:43:41.331 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:19.740404+0000", 2024-02-19T21:43:41.331 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.488967278000001, 2024-02-19T21:43:41.331 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.093998154, 2024-02-19T21:43:41.331 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:43:41.331 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:43:41.331 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:43:41.331 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:43:41.331 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:43:41.331 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 235489 2024-02-19T21:43:41.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.332 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:43:41.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.332 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:43:41.332 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740404+0000", 2024-02-19T21:43:41.332 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:43:41.332 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.333 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:43:41.333 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740404+0000", 2024-02-19T21:43:41.333 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:43:41.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.333 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.333 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:43:41.333 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740404+0000", 2024-02-19T21:43:41.334 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5269999999999998e-06 2024-02-19T21:43:41.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.334 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.334 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:43:41.334 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740409+0000", 2024-02-19T21:43:41.334 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9100000000000005e-06 2024-02-19T21:43:41.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.334 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.334 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:43:41.334 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740417+0000", 2024-02-19T21:43:41.334 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1329999999999998e-06 2024-02-19T21:43:41.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.334 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.334 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:43:41.335 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740422+0000", 2024-02-19T21:43:41.335 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036111979999999999 2024-02-19T21:43:41.335 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.335 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.335 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:43:41.335 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.744033+0000", 2024-02-19T21:43:41.335 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9303999999999998e-05 2024-02-19T21:43:41.335 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.335 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.335 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:43:41.335 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.744113+0000", 2024-02-19T21:43:41.335 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4865999999999998e-05 2024-02-19T21:43:41.335 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.335 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.335 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,4", 2024-02-19T21:43:41.336 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.744187+0000", 2024-02-19T21:43:41.336 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.067660415000000002 2024-02-19T21:43:41.336 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.336 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.336 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:43:41.336 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.811848+0000", 2024-02-19T21:43:41.336 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000227402 2024-02-19T21:43:41.336 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.336 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.336 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.336 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.812075+0000", 2024-02-19T21:43:41.336 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022250261 2024-02-19T21:43:41.336 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.337 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.337 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.337 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.834326+0000", 2024-02-19T21:43:41.337 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8209e-05 2024-02-19T21:43:41.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.337 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.337 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:43:41.337 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.834364+0000", 2024-02-19T21:43:41.337 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8825999999999997e-05 2024-02-19T21:43:41.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.337 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.337 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:43:41.338 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.834403+0000", 2024-02-19T21:43:41.338 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.093998154 2024-02-19T21:43:41.338 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.338 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:43:41.338 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.338 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.338 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.338 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:235493 8.f 8:f0c207d7:::benchmark_data_smithi080_100924_object107775:head [delete] snapc 0=[] ondisk+write+known_if_redirected e241)", 2024-02-19T21:43:41.338 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:19.743619+0000", 2024-02-19T21:43:41.338 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.485752752, 2024-02-19T21:43:41.338 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.090895461999999996, 2024-02-19T21:43:41.338 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:43:41.338 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:43:41.339 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:43:41.339 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:43:41.339 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:43:41.339 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 235493 2024-02-19T21:43:41.339 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.339 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:43:41.339 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.339 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:43:41.339 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.743619+0000", 2024-02-19T21:43:41.339 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:43:41.339 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.339 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.340 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:43:41.340 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.743619+0000", 2024-02-19T21:43:41.340 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:43:41.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.340 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:43:41.340 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.743618+0000", 2024-02-19T21:43:41.340 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0349999999999998e-06 2024-02-19T21:43:41.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.340 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:43:41.340 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.743624+0000", 2024-02-19T21:43:41.340 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0088999999999999e-05 2024-02-19T21:43:41.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.341 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.341 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:43:41.341 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.743634+0000", 2024-02-19T21:43:41.341 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5159999999999996e-06 2024-02-19T21:43:41.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.341 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.341 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:43:41.341 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.743638+0000", 2024-02-19T21:43:41.341 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040161190000000003 2024-02-19T21:43:41.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.342 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.342 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:43:41.342 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.747654+0000", 2024-02-19T21:43:41.342 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6434000000000006e-05 2024-02-19T21:43:41.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.342 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.342 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:43:41.342 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.747741+0000", 2024-02-19T21:43:41.342 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3380000000000006e-05 2024-02-19T21:43:41.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.342 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.342 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,4", 2024-02-19T21:43:41.342 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.747814+0000", 2024-02-19T21:43:41.342 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.064193940000000005 2024-02-19T21:43:41.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.343 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:43:41.343 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.812008+0000", 2024-02-19T21:43:41.343 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010293600000000001 2024-02-19T21:43:41.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.343 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.343 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.812111+0000", 2024-02-19T21:43:41.343 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022349099000000001 2024-02-19T21:43:41.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.344 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.344 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.834460+0000", 2024-02-19T21:43:41.344 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3632999999999999e-05 2024-02-19T21:43:41.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.344 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.344 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:43:41.344 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.834484+0000", 2024-02-19T21:43:41.344 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0474999999999999e-05 2024-02-19T21:43:41.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.344 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.344 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:43:41.344 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.834514+0000", 2024-02-19T21:43:41.344 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.090895461999999996 2024-02-19T21:43:41.345 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.345 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:43:41.345 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.345 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.345 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:235496 8.f 8:fe6f0e29:::benchmark_data_smithi080_100924_object107778:head [delete] snapc 0=[] ondisk+write+known_if_redirected e241)", 2024-02-19T21:43:41.345 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:19.745275+0000", 2024-02-19T21:43:41.345 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.484096987000001, 2024-02-19T21:43:41.345 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.099441477, 2024-02-19T21:43:41.345 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:43:41.345 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:43:41.345 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:43:41.345 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:43:41.345 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:43:41.345 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 235496 2024-02-19T21:43:41.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.346 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:43:41.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.346 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:43:41.346 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.745275+0000", 2024-02-19T21:43:41.346 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:43:41.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.346 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:43:41.346 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.745275+0000", 2024-02-19T21:43:41.346 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:43:41.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.346 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:43:41.346 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.745274+0000", 2024-02-19T21:43:41.346 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0380000000000002e-06 2024-02-19T21:43:41.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.347 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.347 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:43:41.347 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.745281+0000", 2024-02-19T21:43:41.347 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1302e-05 2024-02-19T21:43:41.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.347 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.347 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:43:41.347 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.745292+0000", 2024-02-19T21:43:41.347 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9379999999999997e-06 2024-02-19T21:43:41.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.348 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.348 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:43:41.348 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.745298+0000", 2024-02-19T21:43:41.348 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057582229999999998 2024-02-19T21:43:41.348 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.348 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.348 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:43:41.348 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.751056+0000", 2024-02-19T21:43:41.348 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121988 2024-02-19T21:43:41.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.349 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:43:41.349 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.751178+0000", 2024-02-19T21:43:41.349 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000122376 2024-02-19T21:43:41.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.349 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,4", 2024-02-19T21:43:41.349 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.751300+0000", 2024-02-19T21:43:41.349 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.060712954999999999 2024-02-19T21:43:41.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.350 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:43:41.350 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.812013+0000", 2024-02-19T21:43:41.350 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018012799999999999 2024-02-19T21:43:41.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.350 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.350 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.812194+0000", 2024-02-19T21:43:41.350 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.032426737999999997 2024-02-19T21:43:41.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.350 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.350 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.844620+0000", 2024-02-19T21:43:41.350 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2571999999999997e-05 2024-02-19T21:43:41.351 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.351 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:43:41.351 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.844673+0000", 2024-02-19T21:43:41.351 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3309999999999997e-05 2024-02-19T21:43:41.351 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.351 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:43:41.351 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.844716+0000", 2024-02-19T21:43:41.351 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.099441477 2024-02-19T21:43:41.351 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.351 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:43:41.352 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.352 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.352 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.352 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:235497 8.f 8:f9f5de8e:::benchmark_data_smithi080_100924_object107779:head [delete] snapc 0=[] ondisk+write+known_if_redirected e241)", 2024-02-19T21:43:41.352 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:19.745352+0000", 2024-02-19T21:43:41.352 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.484019242999999, 2024-02-19T21:43:41.352 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.099468952999999999, 2024-02-19T21:43:41.352 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:43:41.352 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:43:41.353 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:43:41.353 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:43:41.353 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:43:41.353 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 235497 2024-02-19T21:43:41.353 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.353 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:43:41.353 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.353 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:43:41.353 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.745352+0000", 2024-02-19T21:43:41.353 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:43:41.353 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.353 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.353 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:43:41.353 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.745352+0000", 2024-02-19T21:43:41.354 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:43:41.354 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.354 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:43:41.354 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.745352+0000", 2024-02-19T21:43:41.354 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0260000000000001e-06 2024-02-19T21:43:41.354 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.354 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:43:41.354 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.745356+0000", 2024-02-19T21:43:41.354 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5490000000000001e-06 2024-02-19T21:43:41.354 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.354 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:43:41.354 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.745363+0000", 2024-02-19T21:43:41.354 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3499999999999999e-06 2024-02-19T21:43:41.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.355 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.355 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:43:41.355 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.745368+0000", 2024-02-19T21:43:41.355 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.061193284000000001 2024-02-19T21:43:41.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.355 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.355 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:43:41.355 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.806561+0000", 2024-02-19T21:43:41.355 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013749199999999999 2024-02-19T21:43:41.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.355 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.355 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:43:41.355 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.806699+0000", 2024-02-19T21:43:41.355 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013396299999999999 2024-02-19T21:43:41.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.356 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.356 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,4", 2024-02-19T21:43:41.356 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.806832+0000", 2024-02-19T21:43:41.356 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066065960000000002 2024-02-19T21:43:41.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.356 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.356 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:43:41.356 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.813439+0000", 2024-02-19T21:43:41.356 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061247369999999999 2024-02-19T21:43:41.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.356 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.356 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.356 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.819564+0000", 2024-02-19T21:43:41.357 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025191222999999999 2024-02-19T21:43:41.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.357 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:43:41.357 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.844755+0000", 2024-02-19T21:43:41.357 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4584e-05 2024-02-19T21:43:41.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.357 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:43:41.357 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.844790+0000", 2024-02-19T21:43:41.357 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1770000000000002e-05 2024-02-19T21:43:41.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:43:41.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:43:41.357 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:43:41.357 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.844821+0000", 2024-02-19T21:43:41.358 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.099468952999999999 2024-02-19T21:43:41.358 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.358 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:43:41.358 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.358 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:43:41.358 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:43:41.358 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:43:41.359 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:43:41.387 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:41.485 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:43:41.487 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:41.487 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:43:41.588 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:43:41.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:40.475714+0000 mgr.y (mgr.14514) 428 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:43:41.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:41.114401+0000 mon.a (mon.0) 1210 : cluster [DBG] osdmap e249: 8 total, 8 up, 7 in 2024-02-19T21:43:41.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:40.475714+0000 mgr.y (mgr.14514) 428 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:43:41.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:41.114401+0000 mon.a (mon.0) 1210 : cluster [DBG] osdmap e249: 8 total, 8 up, 7 in 2024-02-19T21:43:41.616 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:41.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:40.475714+0000 mgr.y (mgr.14514) 428 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:43:41.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:41.114401+0000 mon.a (mon.0) 1210 : cluster [DBG] osdmap e249: 8 total, 8 up, 7 in 2024-02-19T21:43:41.926 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:43:41.946 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.4 dump_ops_in_flight 2024-02-19T21:43:41.967 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:43:41.969 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:43:41.970 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:41.970 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:43:42.071 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:43:42.100 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:42.119 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:43:42.122 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:42.122 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:43:42.223 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:43:42.230 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:43:42.251 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:42.293 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:43:42.442 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:41.033156+0000 mgr.y (mgr.14514) 429 : cluster [DBG] pgmap v505: 138 pgs: 2 active+clean+remapped, 136 active+clean; 14 MiB data, 2.4 GiB used, 623 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.20k op/s; 1.7 MiB/s, 26 objects/s recovering 2024-02-19T21:43:42.442 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:41.033156+0000 mgr.y (mgr.14514) 429 : cluster [DBG] pgmap v505: 138 pgs: 2 active+clean+remapped, 136 active+clean; 14 MiB data, 2.4 GiB used, 623 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.20k op/s; 1.7 MiB/s, 26 objects/s recovering 2024-02-19T21:43:42.519 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:41.033156+0000 mgr.y (mgr.14514) 429 : cluster [DBG] pgmap v505: 138 pgs: 2 active+clean+remapped, 136 active+clean; 14 MiB data, 2.4 GiB used, 623 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.20k op/s; 1.7 MiB/s, 26 objects/s recovering 2024-02-19T21:43:42.601 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:43:42.604 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:42.604 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:43:42.705 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:43:42.735 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:42.756 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:43:42.759 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:42.759 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:43:42.860 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:43:42.888 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:43.136 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:43:43.139 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:43.139 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:43:43.240 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:43:43.269 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:43.717 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:43:43.720 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:43.720 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:43:43.821 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:43:43.851 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:43.875 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:43:43.878 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:43.878 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:43:43.979 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:43:44.006 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:44.025 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:43:44.027 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:44.028 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:43:44.129 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:43:44.150 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:43:44.150 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [], 2024-02-19T21:43:44.151 INFO:teuthology.orchestra.run.smithi157.stdout: "num_ops": 0 2024-02-19T21:43:44.151 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:43:44.159 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:44.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:43.033693+0000 mgr.y (mgr.14514) 430 : cluster [DBG] pgmap v507: 138 pgs: 2 active+clean+remapped, 136 active+clean; 14 MiB data, 2.4 GiB used, 623 GiB / 626 GiB avail; 771 B/s rd, 0 B/s wr, 737 op/s; 973 KiB/s, 15 objects/s recovering 2024-02-19T21:43:44.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:43.033693+0000 mgr.y (mgr.14514) 430 : cluster [DBG] pgmap v507: 138 pgs: 2 active+clean+remapped, 136 active+clean; 14 MiB data, 2.4 GiB used, 623 GiB / 626 GiB avail; 771 B/s rd, 0 B/s wr, 737 op/s; 973 KiB/s, 15 objects/s recovering 2024-02-19T21:43:44.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:43.033693+0000 mgr.y (mgr.14514) 430 : cluster [DBG] pgmap v507: 138 pgs: 2 active+clean+remapped, 136 active+clean; 14 MiB data, 2.4 GiB used, 623 GiB / 626 GiB avail; 771 B/s rd, 0 B/s wr, 737 op/s; 973 KiB/s, 15 objects/s recovering 2024-02-19T21:43:44.871 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.4 dump_blocked_ops 2024-02-19T21:43:44.907 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:43:44.912 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:44.913 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:43:45.013 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:43:45.041 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:45.143 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:43:45.240 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:43:45.242 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:45.243 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:43:45.344 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:43:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:43:45.365 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:43:45.367 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:43:45.371 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:45.424 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:43:45.427 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:45.427 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:43:45.528 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:43:45.557 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:45.655 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:43:45.658 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:45.658 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:43:45.675 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:43:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:43:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:43:45.759 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:43:45.788 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:46.036 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:43:46.039 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:46.040 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:43:46.104 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-02-19T21:43:46.141 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:43:46.170 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:46.222 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:43:46.224 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:45.034277+0000 mgr.y (mgr.14514) 431 : cluster [DBG] pgmap v508: 138 pgs: 138 active+clean; 3.2 MiB data, 2.3 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 634 op/s; 808 KiB/s, 12 objects/s recovering 2024-02-19T21:43:46.224 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:45.096480+0000 mon.a (mon.0) 1211 : cluster [DBG] osdmap e250: 8 total, 8 up, 7 in 2024-02-19T21:43:46.224 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:45.318566+0000 mgr.y (mgr.14514) 432 : audit [DBG] from='client.15240 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:43:46.224 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:45.415518+0000 mon.c (mon.2) 57 : audit [INF] from='client.? 172.21.15.80:0/3484958315' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:43:46.224 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:45.415849+0000 mon.a (mon.0) 1212 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:43:46.224 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:45.034277+0000 mgr.y (mgr.14514) 431 : cluster [DBG] pgmap v508: 138 pgs: 138 active+clean; 3.2 MiB data, 2.3 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 634 op/s; 808 KiB/s, 12 objects/s recovering 2024-02-19T21:43:46.225 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:45.096480+0000 mon.a (mon.0) 1211 : cluster [DBG] osdmap e250: 8 total, 8 up, 7 in 2024-02-19T21:43:46.225 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:45.318566+0000 mgr.y (mgr.14514) 432 : audit [DBG] from='client.15240 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:43:46.225 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:45.415518+0000 mon.c (mon.2) 57 : audit [INF] from='client.? 172.21.15.80:0/3484958315' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:43:46.225 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:45.415849+0000 mon.a (mon.0) 1212 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:43:46.225 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:46.226 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:43:46.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:45.034277+0000 mgr.y (mgr.14514) 431 : cluster [DBG] pgmap v508: 138 pgs: 138 active+clean; 3.2 MiB data, 2.3 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 634 op/s; 808 KiB/s, 12 objects/s recovering 2024-02-19T21:43:46.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:45.096480+0000 mon.a (mon.0) 1211 : cluster [DBG] osdmap e250: 8 total, 8 up, 7 in 2024-02-19T21:43:46.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:45.318566+0000 mgr.y (mgr.14514) 432 : audit [DBG] from='client.15240 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:43:46.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:45.415518+0000 mon.c (mon.2) 57 : audit [INF] from='client.? 172.21.15.80:0/3484958315' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:43:46.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:45.415849+0000 mon.a (mon.0) 1212 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:43:46.326 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:43:46.353 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:46.426 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:43:46.429 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:46.429 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:43:46.530 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:43:46.558 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:46.581 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:43:46.584 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:46.584 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:43:46.685 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:43:46.713 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:43:46.913 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:46.914 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:43:47.014 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:43:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:47.119 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:43:47.119 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [], 2024-02-19T21:43:47.119 INFO:teuthology.orchestra.run.smithi157.stdout: "complaint_time": 30, 2024-02-19T21:43:47.119 INFO:teuthology.orchestra.run.smithi157.stdout: "num_blocked_ops": 0 2024-02-19T21:43:47.119 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:43:47.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:46.098775+0000 mon.a (mon.0) 1213 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:43:47.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:46.101666+0000 mon.a (mon.0) 1214 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:43:47.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:46.101723+0000 mon.a (mon.0) 1215 : cluster [DBG] osdmap e251: 8 total, 8 up, 7 in 2024-02-19T21:43:47.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:46.098775+0000 mon.a (mon.0) 1213 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:43:47.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:46.101666+0000 mon.a (mon.0) 1214 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:43:47.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:46.101723+0000 mon.a (mon.0) 1215 : cluster [DBG] osdmap e251: 8 total, 8 up, 7 in 2024-02-19T21:43:47.478 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:46.098775+0000 mon.a (mon.0) 1213 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:43:47.478 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:46.101666+0000 mon.a (mon.0) 1214 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:43:47.478 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:46.101723+0000 mon.a (mon.0) 1215 : cluster [DBG] osdmap e251: 8 total, 8 up, 7 in 2024-02-19T21:43:47.489 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:43:47.492 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:47.492 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:43:47.593 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:43:47.622 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:47.843 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.4 dump_historic_ops 2024-02-19T21:43:47.870 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:43:47.872 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:47.873 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:43:47.905 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":509,"stamp":"2024-02-19T21:43:45.094164+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1840804,"num_objects":220,"num_object_clones":0,"num_object_copies":660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":1802,"num_read_kb":1554,"num_write":256118,"num_write_kb":8173802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11492,"num_bytes_recovered":740102805,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79940,"ondisk_log_size":79940,"up":414,"acting":414,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":418,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":656216064,"kb_used":2365772,"kb_used_data":248340,"kb_used_omap":0,"kb_used_meta":2117376,"kb_avail":653850292,"statfs":{"total":671965249536,"available":669542699008,"internally_reserved":0,"allocated":254300160,"data_stored":251595751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2168193024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-333774872,"num_objects":-5094,"num_object_clones":0,"num_object_copies":-15282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-271,"num_objects_unfound":0,"num_objects_dirty":-5094,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5094,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":6619136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.061688"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":175,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.108681+0000","last_change":"2024-02-19T21:40:23.364671+0000","last_active":"2024-02-19T21:43:40.108681+0000","last_peered":"2024-02-19T21:43:40.108681+0000","last_clean":"2024-02-19T21:43:40.108681+0000","last_became_active":"2024-02-19T21:35:14.511920+0000","last_became_peered":"2024-02-19T21:35:14.511920+0000","last_unstale":"2024-02-19T21:43:40.108681+0000","last_undegraded":"2024-02-19T21:43:40.108681+0000","last_fullsized":"2024-02-19T21:43:40.108681+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:23.364579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:23.364579+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":218,"reported_epoch":247,"state":"active+clean","last_fresh":"2024-02-19T21:43:36.401915+0000","last_change":"2024-02-19T21:40:28.473842+0000","last_active":"2024-02-19T21:43:36.401915+0000","last_peered":"2024-02-19T21:43:36.401915+0000","last_clean":"2024-02-19T21:43:36.401915+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:43:36.401915+0000","last_undegraded":"2024-02-19T21:43:36.401915+0000","last_fullsized":"2024-02-19T21:43:36.401915+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:28.473778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:28.473778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"201'27","reported_seq":190,"reported_epoch":247,"state":"active+clean","last_fresh":"2024-02-19T21:43:36.403894+0000","last_change":"2024-02-19T21:39:51.546188+0000","last_active":"2024-02-19T21:43:36.403894+0000","last_peered":"2024-02-19T21:43:36.403894+0000","last_clean":"2024-02-19T21:43:36.403894+0000","last_became_active":"2024-02-19T21:39:51.536424+0000","last_became_peered":"2024-02-19T21:39:51.536424+0000","last_unstale":"2024-02-19T21:43:36.403894+0000","last_undegraded":"2024-02-19T21:43:36.403894+0000","last_fullsized":"2024-02-19T21:43:36.403894+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:39:29.269819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:29.269819+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":219,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.112463+0000","last_change":"2024-02-19T21:42:04.201771+0000","last_active":"2024-02-19T21:43:40.112463+0000","last_peered":"2024-02-19T21:43:40.112463+0000","last_clean":"2024-02-19T21:43:40.112463+0000","last_became_active":"2024-02-19T21:42:04.201530+0000","last_became_peered":"2024-02-19T21:42:04.201530+0000","last_unstale":"2024-02-19T21:43:40.112463+0000","last_undegraded":"2024-02-19T21:43:40.112463+0000","last_fullsized":"2024-02-19T21:43:40.112463+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:25.265482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:25.265482+0000","last_clean_scrub_stamp":"2024-02-19T21:40:25.265482+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":218,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.116425+0000","last_change":"2024-02-19T21:39:45.432311+0000","last_active":"2024-02-19T21:43:40.116425+0000","last_peered":"2024-02-19T21:43:40.116425+0000","last_clean":"2024-02-19T21:43:40.116425+0000","last_became_active":"2024-02-19T21:32:23.356975+0000","last_became_peered":"2024-02-19T21:32:23.356975+0000","last_unstale":"2024-02-19T21:43:40.116425+0000","last_undegraded":"2024-02-19T21:43:40.116425+0000","last_fullsized":"2024-02-19T21:43:40.116425+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:45.432184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:39:45.432184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"200'19","reported_seq":258,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.103369+0000","last_change":"2024-02-19T21:41:38.975835+0000","last_active":"2024-02-19T21:43:40.103369+0000","last_peered":"2024-02-19T21:43:40.103369+0000","last_clean":"2024-02-19T21:43:40.103369+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:43:40.103369+0000","last_undegraded":"2024-02-19T21:43:40.103369+0000","last_fullsized":"2024-02-19T21:43:40.103369+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"92'13","last_scrub_stamp":"2024-02-19T21:39:38.475440+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.475440+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":209,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.094854+0000","last_change":"2024-02-19T21:39:32.209318+0000","last_active":"2024-02-19T21:43:40.094854+0000","last_peered":"2024-02-19T21:43:40.094854+0000","last_clean":"2024-02-19T21:43:40.094854+0000","last_became_active":"2024-02-19T21:32:27.370308+0000","last_became_peered":"2024-02-19T21:32:27.370308+0000","last_unstale":"2024-02-19T21:43:40.094854+0000","last_undegraded":"2024-02-19T21:43:40.094854+0000","last_fullsized":"2024-02-19T21:43:40.094854+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:32.209233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:32.209233+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":220,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.095910+0000","last_change":"2024-02-19T21:40:34.884850+0000","last_active":"2024-02-19T21:43:40.095910+0000","last_peered":"2024-02-19T21:43:40.095910+0000","last_clean":"2024-02-19T21:43:40.095910+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:43:40.095910+0000","last_undegraded":"2024-02-19T21:43:40.095910+0000","last_fullsized":"2024-02-19T21:43:40.095910+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:34.884780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:08.490788+0000","last_clean_scrub_stamp":"2024-02-19T21:40:34.884780+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"200'7","reported_seq":213,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.115862+0000","last_change":"2024-02-19T21:39:44.444043+0000","last_active":"2024-02-19T21:43:40.115862+0000","last_peered":"2024-02-19T21:43:40.115862+0000","last_clean":"2024-02-19T21:43:40.115862+0000","last_became_active":"2024-02-19T21:39:39.471143+0000","last_became_peered":"2024-02-19T21:39:39.471143+0000","last_unstale":"2024-02-19T21:43:40.115862+0000","last_undegraded":"2024-02-19T21:43:40.115862+0000","last_fullsized":"2024-02-19T21:43:40.115862+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'5","last_scrub_stamp":"2024-02-19T21:39:44.443963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:44.443963+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":228,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.103097+0000","last_change":"2024-02-19T21:42:04.205008+0000","last_active":"2024-02-19T21:43:40.103097+0000","last_peered":"2024-02-19T21:43:40.103097+0000","last_clean":"2024-02-19T21:43:40.103097+0000","last_became_active":"2024-02-19T21:42:04.204559+0000","last_became_peered":"2024-02-19T21:42:04.204559+0000","last_unstale":"2024-02-19T21:43:40.103097+0000","last_undegraded":"2024-02-19T21:43:40.103097+0000","last_fullsized":"2024-02-19T21:43:40.103097+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:32.576698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:46.543259+0000","last_clean_scrub_stamp":"2024-02-19T21:41:32.576698+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":227,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.095476+0000","last_change":"2024-02-19T21:40:16.864005+0000","last_active":"2024-02-19T21:43:40.095476+0000","last_peered":"2024-02-19T21:43:40.095476+0000","last_clean":"2024-02-19T21:43:40.095476+0000","last_became_active":"2024-02-19T21:39:39.473759+0000","last_became_peered":"2024-02-19T21:39:39.473759+0000","last_unstale":"2024-02-19T21:43:40.095476+0000","last_undegraded":"2024-02-19T21:43:40.095476+0000","last_fullsized":"2024-02-19T21:43:40.095476+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:16.863939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:16.863939+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"200'19","reported_seq":241,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.116569+0000","last_change":"2024-02-19T21:39:47.395697+0000","last_active":"2024-02-19T21:43:40.116569+0000","last_peered":"2024-02-19T21:43:40.116569+0000","last_clean":"2024-02-19T21:43:40.116569+0000","last_became_active":"2024-02-19T21:35:14.514971+0000","last_became_peered":"2024-02-19T21:35:14.514971+0000","last_unstale":"2024-02-19T21:43:40.116569+0000","last_undegraded":"2024-02-19T21:43:40.116569+0000","last_fullsized":"2024-02-19T21:43:40.116569+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'13","last_scrub_stamp":"2024-02-19T21:39:47.395572+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:39:47.395572+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":191,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.115980+0000","last_change":"2024-02-19T21:42:04.195331+0000","last_active":"2024-02-19T21:43:40.115980+0000","last_peered":"2024-02-19T21:43:40.115980+0000","last_clean":"2024-02-19T21:43:40.115980+0000","last_became_active":"2024-02-19T21:42:04.194933+0000","last_became_peered":"2024-02-19T21:42:04.194933+0000","last_unstale":"2024-02-19T21:43:40.115980+0000","last_undegraded":"2024-02-19T21:43:40.115980+0000","last_fullsized":"2024-02-19T21:43:40.115980+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:34.364412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:34.364412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":100,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.112604+0000","last_change":"2024-02-19T21:42:04.201407+0000","last_active":"2024-02-19T21:43:40.112604+0000","last_peered":"2024-02-19T21:43:40.112604+0000","last_clean":"2024-02-19T21:43:40.112604+0000","last_became_active":"2024-02-19T21:42:04.201106+0000","last_became_peered":"2024-02-19T21:42:04.201106+0000","last_unstale":"2024-02-19T21:43:40.112604+0000","last_undegraded":"2024-02-19T21:43:40.112604+0000","last_fullsized":"2024-02-19T21:43:40.112604+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:24.788644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:24.788644+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,5],"acting":[6,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"201'18","reported_seq":177,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.115759+0000","last_change":"2024-02-19T21:39:21.126642+0000","last_active":"2024-02-19T21:43:40.115759+0000","last_peered":"2024-02-19T21:43:40.115759+0000","last_clean":"2024-02-19T21:43:40.115759+0000","last_became_active":"2024-02-19T21:38:31.247067+0000","last_became_peered":"2024-02-19T21:38:31.247067+0000","last_unstale":"2024-02-19T21:43:40.115759+0000","last_undegraded":"2024-02-19T21:43:40.115759+0000","last_fullsized":"2024-02-19T21:43:40.115759+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'12","last_scrub_stamp":"2024-02-19T21:39:21.126563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:21.126563+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":210,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.115836+0000","last_change":"2024-02-19T21:40:15.269827+0000","last_active":"2024-02-19T21:43:40.115836+0000","last_peered":"2024-02-19T21:43:40.115836+0000","last_clean":"2024-02-19T21:43:40.115836+0000","last_became_active":"2024-02-19T21:32:27.369757+0000","last_became_peered":"2024-02-19T21:32:27.369757+0000","last_unstale":"2024-02-19T21:43:40.115836+0000","last_undegraded":"2024-02-19T21:43:40.115836+0000","last_fullsized":"2024-02-19T21:43:40.115836+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:15.269720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:15.269720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":223,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.109673+0000","last_change":"2024-02-19T21:40:38.600031+0000","last_active":"2024-02-19T21:43:40.109673+0000","last_peered":"2024-02-19T21:43:40.109673+0000","last_clean":"2024-02-19T21:43:40.109673+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:43:40.109673+0000","last_undegraded":"2024-02-19T21:43:40.109673+0000","last_fullsized":"2024-02-19T21:43:40.109673+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:38.599939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:38.599939+0000","last_clean_scrub_stamp":"2024-02-19T21:40:38.599939+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"200'34","reported_seq":205,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.113876+0000","last_change":"2024-02-19T21:40:36.287163+0000","last_active":"2024-02-19T21:43:40.113876+0000","last_peered":"2024-02-19T21:43:40.113876+0000","last_clean":"2024-02-19T21:43:40.113876+0000","last_became_active":"2024-02-19T21:39:39.477429+0000","last_became_peered":"2024-02-19T21:39:39.477429+0000","last_unstale":"2024-02-19T21:43:40.113876+0000","last_undegraded":"2024-02-19T21:43:40.113876+0000","last_fullsized":"2024-02-19T21:43:40.113876+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'22","last_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.287051+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":223,"reported_epoch":247,"state":"active+clean","last_fresh":"2024-02-19T21:43:36.406594+0000","last_change":"2024-02-19T21:39:39.471709+0000","last_active":"2024-02-19T21:43:36.406594+0000","last_peered":"2024-02-19T21:43:36.406594+0000","last_clean":"2024-02-19T21:43:36.406594+0000","last_became_active":"2024-02-19T21:39:39.471214+0000","last_became_peered":"2024-02-19T21:39:39.471214+0000","last_unstale":"2024-02-19T21:43:36.406594+0000","last_undegraded":"2024-02-19T21:43:36.406594+0000","last_fullsized":"2024-02-19T21:43:36.406594+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:37.169503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:37.169503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":144,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.109209+0000","last_change":"2024-02-19T21:42:04.198922+0000","last_active":"2024-02-19T21:43:40.109209+0000","last_peered":"2024-02-19T21:43:40.109209+0000","last_clean":"2024-02-19T21:43:40.109209+0000","last_became_active":"2024-02-19T21:42:04.198592+0000","last_became_peered":"2024-02-19T21:42:04.198592+0000","last_unstale":"2024-02-19T21:43:40.109209+0000","last_undegraded":"2024-02-19T21:43:40.109209+0000","last_fullsized":"2024-02-19T21:43:40.109209+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:33.515188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:33.515188+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"201'19","reported_seq":117,"reported_epoch":247,"state":"active+clean","last_fresh":"2024-02-19T21:43:36.401922+0000","last_change":"2024-02-19T21:39:51.559559+0000","last_active":"2024-02-19T21:43:36.401922+0000","last_peered":"2024-02-19T21:43:36.401922+0000","last_clean":"2024-02-19T21:43:36.401922+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:43:36.401922+0000","last_undegraded":"2024-02-19T21:43:36.401922+0000","last_fullsized":"2024-02-19T21:43:36.401922+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:39:43.209803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:43.209803+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"199'9","reported_seq":376,"reported_epoch":249,"state":"active+clean","last_fresh":"2024-02-19T21:43:41.165182+0000","last_change":"2024-02-19T21:42:04.290659+0000","last_active":"2024-02-19T21:43:41.165182+0000","last_peered":"2024-02-19T21:43:41.165182+0000","last_clean":"2024-02-19T21:43:41.165182+0000","last_became_active":"2024-02-19T21:42:04.199656+0000","last_became_peered":"2024-02-19T21:42:04.199656+0000","last_unstale":"2024-02-19T21:43:41.165182+0000","last_undegraded":"2024-02-19T21:43:41.165182+0000","last_fullsized":"2024-02-19T21:43:41.165182+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:40:19.276740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:19.276740+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":227,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.105533+0000","last_change":"2024-02-19T21:42:04.199658+0000","last_active":"2024-02-19T21:43:40.105533+0000","last_peered":"2024-02-19T21:43:40.105533+0000","last_clean":"2024-02-19T21:43:40.105533+0000","last_became_active":"2024-02-19T21:42:04.199323+0000","last_became_peered":"2024-02-19T21:42:04.199323+0000","last_unstale":"2024-02-19T21:43:40.105533+0000","last_undegraded":"2024-02-19T21:43:40.105533+0000","last_fullsized":"2024-02-19T21:43:40.105533+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.080601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.080601+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"201'20","reported_seq":297,"reported_epoch":247,"state":"active+clean","last_fresh":"2024-02-19T21:43:36.418267+0000","last_change":"2024-02-19T21:42:04.205219+0000","last_active":"2024-02-19T21:43:36.418267+0000","last_peered":"2024-02-19T21:43:36.418267+0000","last_clean":"2024-02-19T21:43:36.418267+0000","last_became_active":"2024-02-19T21:42:04.204882+0000","last_became_peered":"2024-02-19T21:42:04.204882+0000","last_unstale":"2024-02-19T21:43:36.418267+0000","last_undegraded":"2024-02-19T21:43:36.418267+0000","last_fullsized":"2024-02-19T21:43:36.418267+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:39:33.125904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:33.125904+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":129,"reported_epoch":247,"state":"active+clean","last_fresh":"2024-02-19T21:43:36.400594+0000","last_change":"2024-02-19T21:39:39.471651+0000","last_active":"2024-02-19T21:43:36.400594+0000","last_peered":"2024-02-19T21:43:36.400594+0000","last_clean":"2024-02-19T21:43:36.400594+0000","last_became_active":"2024-02-19T21:39:39.471332+0000","last_became_peered":"2024-02-19T21:39:39.471332+0000","last_unstale":"2024-02-19T21:43:36.400594+0000","last_undegraded":"2024-02-19T21:43:36.400594+0000","last_fullsized":"2024-02-19T21:43:36.400594+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:23.270251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:39:23.270251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":216,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.094596+0000","last_change":"2024-02-19T21:41:36.941622+0000","last_active":"2024-02-19T21:43:40.094596+0000","last_peered":"2024-02-19T21:43:40.094596+0000","last_clean":"2024-02-19T21:43:40.094596+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:43:40.094596+0000","last_undegraded":"2024-02-19T21:43:40.094596+0000","last_fullsized":"2024-02-19T21:43:40.094596+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:36.941549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:41:36.941549+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":227,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.113255+0000","last_change":"2024-02-19T21:39:45.211467+0000","last_active":"2024-02-19T21:43:40.113255+0000","last_peered":"2024-02-19T21:43:40.113255+0000","last_clean":"2024-02-19T21:43:40.113255+0000","last_became_active":"2024-02-19T21:39:39.478633+0000","last_became_peered":"2024-02-19T21:39:39.478633+0000","last_unstale":"2024-02-19T21:43:40.113255+0000","last_undegraded":"2024-02-19T21:43:40.113255+0000","last_fullsized":"2024-02-19T21:43:40.113255+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:45.211388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:39:45.211388+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"201'19","reported_seq":268,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.115649+0000","last_change":"2024-02-19T21:42:04.641915+0000","last_active":"2024-02-19T21:43:40.115649+0000","last_peered":"2024-02-19T21:43:40.115649+0000","last_clean":"2024-02-19T21:43:40.115649+0000","last_became_active":"2024-02-19T21:42:04.205379+0000","last_became_peered":"2024-02-19T21:42:04.205379+0000","last_unstale":"2024-02-19T21:43:40.115649+0000","last_undegraded":"2024-02-19T21:43:40.115649+0000","last_fullsized":"2024-02-19T21:43:40.115649+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:39:46.421117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:46.421117+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":216,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.094935+0000","last_change":"2024-02-19T21:39:39.471671+0000","last_active":"2024-02-19T21:43:40.094935+0000","last_peered":"2024-02-19T21:43:40.094935+0000","last_clean":"2024-02-19T21:43:40.094935+0000","last_became_active":"2024-02-19T21:39:39.471306+0000","last_became_peered":"2024-02-19T21:39:39.471306+0000","last_unstale":"2024-02-19T21:43:40.094935+0000","last_undegraded":"2024-02-19T21:43:40.094935+0000","last_fullsized":"2024-02-19T21:43:40.094935+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:37.104831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:39:37.104831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":257,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.109348+0000","last_change":"2024-02-19T21:43:35.107549+0000","last_active":"2024-02-19T21:43:40.109348+0000","last_peered":"2024-02-19T21:43:40.109348+0000","last_clean":"2024-02-19T21:43:40.109348+0000","last_became_active":"2024-02-19T21:42:04.196794+0000","last_became_peered":"2024-02-19T21:42:04.196794+0000","last_unstale":"2024-02-19T21:43:40.109348+0000","last_undegraded":"2024-02-19T21:43:40.109348+0000","last_fullsized":"2024-02-19T21:43:40.109348+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:41.234250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:41.234250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":222,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.103299+0000","last_change":"2024-02-19T21:39:39.480521+0000","last_active":"2024-02-19T21:43:40.103299+0000","last_peered":"2024-02-19T21:43:40.103299+0000","last_clean":"2024-02-19T21:43:40.103299+0000","last_became_active":"2024-02-19T21:39:39.479927+0000","last_became_peered":"2024-02-19T21:39:39.479927+0000","last_unstale":"2024-02-19T21:43:40.103299+0000","last_undegraded":"2024-02-19T21:43:40.103299+0000","last_fullsized":"2024-02-19T21:43:40.103299+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:39:37.085374+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"200'8","reported_seq":81,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.116802+0000","last_change":"2024-02-19T21:41:42.590833+0000","last_active":"2024-02-19T21:43:40.116802+0000","last_peered":"2024-02-19T21:43:40.116802+0000","last_clean":"2024-02-19T21:43:40.116802+0000","last_became_active":"2024-02-19T21:41:42.243259+0000","last_became_peered":"2024-02-19T21:41:42.243259+0000","last_unstale":"2024-02-19T21:43:40.116802+0000","last_undegraded":"2024-02-19T21:43:40.116802+0000","last_fullsized":"2024-02-19T21:43:40.116802+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'4","last_scrub_stamp":"2024-02-19T21:40:18.214846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:18.214846+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":129,"reported_epoch":247,"state":"active+clean","last_fresh":"2024-02-19T21:43:36.403839+0000","last_change":"2024-02-19T21:39:39.462663+0000","last_active":"2024-02-19T21:43:36.403839+0000","last_peered":"2024-02-19T21:43:36.403839+0000","last_clean":"2024-02-19T21:43:36.403839+0000","last_became_active":"2024-02-19T21:39:39.462363+0000","last_became_peered":"2024-02-19T21:39:39.462363+0000","last_unstale":"2024-02-19T21:43:36.403839+0000","last_undegraded":"2024-02-19T21:43:36.403839+0000","last_fullsized":"2024-02-19T21:43:36.403839+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:26.311526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:39:26.311526+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":228,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.109727+0000","last_change":"2024-02-19T21:42:04.199063+0000","last_active":"2024-02-19T21:43:40.109727+0000","last_peered":"2024-02-19T21:43:40.109727+0000","last_clean":"2024-02-19T21:43:40.109727+0000","last_became_active":"2024-02-19T21:42:04.198684+0000","last_became_peered":"2024-02-19T21:42:04.198684+0000","last_unstale":"2024-02-19T21:43:40.109727+0000","last_undegraded":"2024-02-19T21:43:40.109727+0000","last_fullsized":"2024-02-19T21:43:40.109727+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:26.272653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:26.272653+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":216,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.115448+0000","last_change":"2024-02-19T21:39:33.957921+0000","last_active":"2024-02-19T21:43:40.115448+0000","last_peered":"2024-02-19T21:43:40.115448+0000","last_clean":"2024-02-19T21:43:40.115448+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:43:40.115448+0000","last_undegraded":"2024-02-19T21:43:40.115448+0000","last_fullsized":"2024-02-19T21:43:40.115448+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:33.957814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:39:33.957814+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"201'19","reported_seq":258,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.109665+0000","last_change":"2024-02-19T21:41:23.880621+0000","last_active":"2024-02-19T21:43:40.109665+0000","last_peered":"2024-02-19T21:43:40.109665+0000","last_clean":"2024-02-19T21:43:40.109665+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:43:40.109665+0000","last_undegraded":"2024-02-19T21:43:40.109665+0000","last_fullsized":"2024-02-19T21:43:40.109665+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:41:23.880501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:41:23.880501+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":214,"reported_epoch":247,"state":"active+clean","last_fresh":"2024-02-19T21:43:36.399870+0000","last_change":"2024-02-19T21:38:29.972418+0000","last_active":"2024-02-19T21:43:36.399870+0000","last_peered":"2024-02-19T21:43:36.399870+0000","last_clean":"2024-02-19T21:43:36.399870+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:43:36.399870+0000","last_undegraded":"2024-02-19T21:43:36.399870+0000","last_fullsized":"2024-02-19T21:43:36.399870+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:29.972337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:42.527849+0000","last_clean_scrub_stamp":"2024-02-19T21:38:29.972337+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":218,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.115947+0000","last_change":"2024-02-19T21:39:51.535010+0000","last_active":"2024-02-19T21:43:40.115947+0000","last_peered":"2024-02-19T21:43:40.115947+0000","last_clean":"2024-02-19T21:43:40.115947+0000","last_became_active":"2024-02-19T21:39:51.534750+0000","last_became_peered":"2024-02-19T21:39:51.534750+0000","last_unstale":"2024-02-19T21:43:40.115947+0000","last_undegraded":"2024-02-19T21:43:40.115947+0000","last_fullsized":"2024-02-19T21:43:40.115947+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:33.360066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:33.360066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":223,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.112604+0000","last_change":"2024-02-19T21:41:35.736077+0000","last_active":"2024-02-19T21:43:40.112604+0000","last_peered":"2024-02-19T21:43:40.112604+0000","last_clean":"2024-02-19T21:43:40.112604+0000","last_became_active":"2024-02-19T21:32:23.357338+0000","last_became_peered":"2024-02-19T21:32:23.357338+0000","last_unstale":"2024-02-19T21:43:40.112604+0000","last_undegraded":"2024-02-19T21:43:40.112604+0000","last_fullsized":"2024-02-19T21:43:40.112604+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:35.735995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:41:35.735995+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"200'15","reported_seq":256,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.109583+0000","last_change":"2024-02-19T21:39:45.026756+0000","last_active":"2024-02-19T21:43:40.109583+0000","last_peered":"2024-02-19T21:43:40.109583+0000","last_clean":"2024-02-19T21:43:40.109583+0000","last_became_active":"2024-02-19T21:39:39.466843+0000","last_became_peered":"2024-02-19T21:39:39.466843+0000","last_unstale":"2024-02-19T21:43:40.109583+0000","last_undegraded":"2024-02-19T21:43:40.109583+0000","last_fullsized":"2024-02-19T21:43:40.109583+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:39:45.026689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:45.026689+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"199'13","reported_seq":174,"reported_epoch":249,"state":"active+clean","last_fresh":"2024-02-19T21:43:41.113365+0000","last_change":"2024-02-19T21:42:04.202258+0000","last_active":"2024-02-19T21:43:41.113365+0000","last_peered":"2024-02-19T21:43:41.113365+0000","last_clean":"2024-02-19T21:43:41.113365+0000","last_became_active":"2024-02-19T21:42:04.195103+0000","last_became_peered":"2024-02-19T21:42:04.195103+0000","last_unstale":"2024-02-19T21:43:41.113365+0000","last_undegraded":"2024-02-19T21:43:41.113365+0000","last_fullsized":"2024-02-19T21:43:41.113365+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'11","last_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:39:46.054888+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":227,"reported_epoch":247,"state":"active+clean","last_fresh":"2024-02-19T21:43:36.400822+0000","last_change":"2024-02-19T21:40:33.532430+0000","last_active":"2024-02-19T21:43:36.400822+0000","last_peered":"2024-02-19T21:43:36.400822+0000","last_clean":"2024-02-19T21:43:36.400822+0000","last_became_active":"2024-02-19T21:32:23.361680+0000","last_became_peered":"2024-02-19T21:32:23.361680+0000","last_unstale":"2024-02-19T21:43:36.400822+0000","last_undegraded":"2024-02-19T21:43:36.400822+0000","last_fullsized":"2024-02-19T21:43:36.400822+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:33.532354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:33.550655+0000","last_clean_scrub_stamp":"2024-02-19T21:40:33.532354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"201'19","reported_seq":245,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.102360+0000","last_change":"2024-02-19T21:40:37.730352+0000","last_active":"2024-02-19T21:43:40.102360+0000","last_peered":"2024-02-19T21:43:40.102360+0000","last_clean":"2024-02-19T21:43:40.102360+0000","last_became_active":"2024-02-19T21:32:25.372206+0000","last_became_peered":"2024-02-19T21:32:25.372206+0000","last_unstale":"2024-02-19T21:43:40.102360+0000","last_undegraded":"2024-02-19T21:43:40.102360+0000","last_fullsized":"2024-02-19T21:43:40.102360+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'13","last_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:40:37.730197+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":359,"reported_epoch":249,"state":"active+clean","last_fresh":"2024-02-19T21:43:41.116215+0000","last_change":"2024-02-19T21:40:32.679041+0000","last_active":"2024-02-19T21:43:41.116215+0000","last_peered":"2024-02-19T21:43:41.116215+0000","last_clean":"2024-02-19T21:43:41.116215+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:43:41.116215+0000","last_undegraded":"2024-02-19T21:43:41.116215+0000","last_fullsized":"2024-02-19T21:43:41.116215+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:40:32.678933+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":229,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.103569+0000","last_change":"2024-02-19T21:42:04.205987+0000","last_active":"2024-02-19T21:43:40.103569+0000","last_peered":"2024-02-19T21:43:40.103569+0000","last_clean":"2024-02-19T21:43:40.103569+0000","last_became_active":"2024-02-19T21:42:04.205401+0000","last_became_peered":"2024-02-19T21:42:04.205401+0000","last_unstale":"2024-02-19T21:43:40.103569+0000","last_undegraded":"2024-02-19T21:43:40.103569+0000","last_fullsized":"2024-02-19T21:43:40.103569+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:25.759697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:40:25.759697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"201'25","reported_seq":251,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.115897+0000","last_change":"2024-02-19T21:40:39.592088+0000","last_active":"2024-02-19T21:43:40.115897+0000","last_peered":"2024-02-19T21:43:40.115897+0000","last_clean":"2024-02-19T21:43:40.115897+0000","last_became_active":"2024-02-19T21:32:25.372060+0000","last_became_peered":"2024-02-19T21:32:25.372060+0000","last_unstale":"2024-02-19T21:43:40.115897+0000","last_undegraded":"2024-02-19T21:43:40.115897+0000","last_fullsized":"2024-02-19T21:43:40.115897+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'15","last_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:40:39.591994+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":216,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.095840+0000","last_change":"2024-02-19T21:40:31.892048+0000","last_active":"2024-02-19T21:43:40.095840+0000","last_peered":"2024-02-19T21:43:40.095840+0000","last_clean":"2024-02-19T21:43:40.095840+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:43:40.095840+0000","last_undegraded":"2024-02-19T21:43:40.095840+0000","last_fullsized":"2024-02-19T21:43:40.095840+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:31.891967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_clean_scrub_stamp":"2024-02-19T21:40:31.891967+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":209,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.103077+0000","last_change":"2024-02-19T21:39:36.067452+0000","last_active":"2024-02-19T21:43:40.103077+0000","last_peered":"2024-02-19T21:43:40.103077+0000","last_clean":"2024-02-19T21:43:40.103077+0000","last_became_active":"2024-02-19T21:32:27.369002+0000","last_became_peered":"2024-02-19T21:32:27.369002+0000","last_unstale":"2024-02-19T21:43:40.103077+0000","last_undegraded":"2024-02-19T21:43:40.103077+0000","last_fullsized":"2024-02-19T21:43:40.103077+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:36.067354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:36.067354+0000","last_clean_scrub_stamp":"2024-02-19T21:39:36.067354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":218,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.109426+0000","last_change":"2024-02-19T21:40:29.421893+0000","last_active":"2024-02-19T21:43:40.109426+0000","last_peered":"2024-02-19T21:43:40.109426+0000","last_clean":"2024-02-19T21:43:40.109426+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:43:40.109426+0000","last_undegraded":"2024-02-19T21:43:40.109426+0000","last_fullsized":"2024-02-19T21:43:40.109426+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:29.421791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:29.421791+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"201'12","reported_seq":101,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.117026+0000","last_change":"2024-02-19T21:42:04.203612+0000","last_active":"2024-02-19T21:43:40.117026+0000","last_peered":"2024-02-19T21:43:40.117026+0000","last_clean":"2024-02-19T21:43:40.117026+0000","last_became_active":"2024-02-19T21:42:04.192291+0000","last_became_peered":"2024-02-19T21:42:04.192291+0000","last_unstale":"2024-02-19T21:43:40.117026+0000","last_undegraded":"2024-02-19T21:43:40.117026+0000","last_fullsized":"2024-02-19T21:43:40.117026+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'6","last_scrub_stamp":"2024-02-19T21:39:24.011489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:24.011489+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":100,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.104470+0000","last_change":"2024-02-19T21:39:41.367764+0000","last_active":"2024-02-19T21:43:40.104470+0000","last_peered":"2024-02-19T21:43:40.104470+0000","last_clean":"2024-02-19T21:43:40.104470+0000","last_became_active":"2024-02-19T21:39:39.469477+0000","last_became_peered":"2024-02-19T21:39:39.469477+0000","last_unstale":"2024-02-19T21:43:40.104470+0000","last_undegraded":"2024-02-19T21:43:40.104470+0000","last_fullsized":"2024-02-19T21:43:40.104470+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:41.367692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:41.367692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":130,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.116937+0000","last_change":"2024-02-19T21:42:04.195734+0000","last_active":"2024-02-19T21:43:40.116937+0000","last_peered":"2024-02-19T21:43:40.116937+0000","last_clean":"2024-02-19T21:43:40.116937+0000","last_became_active":"2024-02-19T21:42:04.195167+0000","last_became_peered":"2024-02-19T21:42:04.195167+0000","last_unstale":"2024-02-19T21:43:40.116937+0000","last_undegraded":"2024-02-19T21:43:40.116937+0000","last_fullsized":"2024-02-19T21:43:40.116937+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:34.284787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:34.284787+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":95,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.109194+0000","last_change":"2024-02-19T21:39:39.477623+0000","last_active":"2024-02-19T21:43:40.109194+0000","last_peered":"2024-02-19T21:43:40.109194+0000","last_clean":"2024-02-19T21:43:40.109194+0000","last_became_active":"2024-02-19T21:39:39.477308+0000","last_became_peered":"2024-02-19T21:39:39.477308+0000","last_unstale":"2024-02-19T21:43:40.109194+0000","last_undegraded":"2024-02-19T21:43:40.109194+0000","last_fullsized":"2024-02-19T21:43:40.109194+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:26.250620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:38:26.250620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"200'15","reported_seq":298,"reported_epoch":247,"state":"active+clean","last_fresh":"2024-02-19T21:43:36.403477+0000","last_change":"2024-02-19T21:42:04.226031+0000","last_active":"2024-02-19T21:43:36.403477+0000","last_peered":"2024-02-19T21:43:36.403477+0000","last_clean":"2024-02-19T21:43:36.403477+0000","last_became_active":"2024-02-19T21:42:04.207069+0000","last_became_peered":"2024-02-19T21:42:04.207069+0000","last_unstale":"2024-02-19T21:43:36.403477+0000","last_undegraded":"2024-02-19T21:43:36.403477+0000","last_fullsized":"2024-02-19T21:43:36.403477+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:39:46.193426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:46.193426+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"248'15974","reported_seq":16066,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.214163+0000","last_change":"2024-02-19T21:39:39.469485+0000","last_active":"2024-02-19T21:43:40.214163+0000","last_peered":"2024-02-19T21:43:40.214163+0000","last_clean":"2024-02-19T21:43:40.214163+0000","last_became_active":"2024-02-19T21:39:39.469130+0000","last_became_peered":"2024-02-19T21:39:39.469130+0000","last_unstale":"2024-02-19T21:43:40.214163+0000","last_undegraded":"2024-02-19T21:43:40.214163+0000","last_fullsized":"2024-02-19T21:43:40.214163+0000","mapping_epoch":165,"log_start":"200'11614","ondisk_log_start":"200'11614","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4360,"ondisk_log_size":4360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15974,"num_write_kb":511168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":239,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.116029+0000","last_change":"2024-02-19T21:43:02.217061+0000","last_active":"2024-02-19T21:43:40.116029+0000","last_peered":"2024-02-19T21:43:40.116029+0000","last_clean":"2024-02-19T21:43:40.116029+0000","last_became_active":"2024-02-19T21:43:02.216721+0000","last_became_peered":"2024-02-19T21:43:02.216721+0000","last_unstale":"2024-02-19T21:43:40.116029+0000","last_undegraded":"2024-02-19T21:43:40.116029+0000","last_fullsized":"2024-02-19T21:43:40.116029+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:35.539219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:40:35.539219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"59'2","reported_seq":246,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.103961+0000","last_change":"2024-02-19T21:41:24.914001+0000","last_active":"2024-02-19T21:43:40.103961+0000","last_peered":"2024-02-19T21:43:40.103961+0000","last_clean":"2024-02-19T21:43:40.103961+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:43:40.103961+0000","last_undegraded":"2024-02-19T21:43:40.103961+0000","last_fullsized":"2024-02-19T21:43:40.103961+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-02-19T21:41:24.913925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:41:24.913925+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"200'23","reported_seq":258,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.112305+0000","last_change":"2024-02-19T21:40:37.318743+0000","last_active":"2024-02-19T21:43:40.112305+0000","last_peered":"2024-02-19T21:43:40.112305+0000","last_clean":"2024-02-19T21:43:40.112305+0000","last_became_active":"2024-02-19T21:38:31.247821+0000","last_became_peered":"2024-02-19T21:38:31.247821+0000","last_unstale":"2024-02-19T21:43:40.112305+0000","last_undegraded":"2024-02-19T21:43:40.112305+0000","last_fullsized":"2024-02-19T21:43:40.112305+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'17","last_scrub_stamp":"2024-02-19T21:40:37.318642+0000","last_deep_scrub":"83'17","last_deep_scrub_stamp":"2024-02-19T21:33:43.418450+0000","last_clean_scrub_stamp":"2024-02-19T21:40:37.318642+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":94,"reported_epoch":247,"state":"active+clean","last_fresh":"2024-02-19T21:43:36.400355+0000","last_change":"2024-02-19T21:39:39.467760+0000","last_active":"2024-02-19T21:43:36.400355+0000","last_peered":"2024-02-19T21:43:36.400355+0000","last_clean":"2024-02-19T21:43:36.400355+0000","last_became_active":"2024-02-19T21:39:39.467210+0000","last_became_peered":"2024-02-19T21:39:39.467210+0000","last_unstale":"2024-02-19T21:43:36.400355+0000","last_undegraded":"2024-02-19T21:43:36.400355+0000","last_fullsized":"2024-02-19T21:43:36.400355+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:37.384723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:37.384723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"248'16204","reported_seq":16295,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.103064+0000","last_change":"2024-02-19T21:39:39.471871+0000","last_active":"2024-02-19T21:43:40.103064+0000","last_peered":"2024-02-19T21:43:40.103064+0000","last_clean":"2024-02-19T21:43:40.103064+0000","last_became_active":"2024-02-19T21:39:39.471575+0000","last_became_peered":"2024-02-19T21:39:39.471575+0000","last_unstale":"2024-02-19T21:43:40.103064+0000","last_undegraded":"2024-02-19T21:43:40.103064+0000","last_fullsized":"2024-02-19T21:43:40.103064+0000","mapping_epoch":165,"log_start":"200'11715","ondisk_log_start":"200'11715","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4489,"ondisk_log_size":4489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16204,"num_write_kb":518912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":239,"reported_epoch":247,"state":"active+clean","last_fresh":"2024-02-19T21:43:36.399948+0000","last_change":"2024-02-19T21:41:42.246007+0000","last_active":"2024-02-19T21:43:36.399948+0000","last_peered":"2024-02-19T21:43:36.399948+0000","last_clean":"2024-02-19T21:43:36.399948+0000","last_became_active":"2024-02-19T21:41:42.245788+0000","last_became_peered":"2024-02-19T21:41:42.245788+0000","last_unstale":"2024-02-19T21:43:36.399948+0000","last_undegraded":"2024-02-19T21:43:36.399948+0000","last_fullsized":"2024-02-19T21:43:36.399948+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:40.474333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:40.474333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":214,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.113799+0000","last_change":"2024-02-19T21:39:34.971980+0000","last_active":"2024-02-19T21:43:40.113799+0000","last_peered":"2024-02-19T21:43:40.113799+0000","last_clean":"2024-02-19T21:43:40.113799+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:43:40.113799+0000","last_undegraded":"2024-02-19T21:43:40.113799+0000","last_fullsized":"2024-02-19T21:43:40.113799+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:34.971917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:39:34.971917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"201'20","reported_seq":125,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.109660+0000","last_change":"2024-02-19T21:41:22.195267+0000","last_active":"2024-02-19T21:43:40.109660+0000","last_peered":"2024-02-19T21:43:40.109660+0000","last_clean":"2024-02-19T21:43:40.109660+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:43:40.109660+0000","last_undegraded":"2024-02-19T21:43:40.109660+0000","last_fullsized":"2024-02-19T21:43:40.109660+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:41:22.195164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:41:22.195164+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":359,"reported_epoch":247,"state":"active+clean","last_fresh":"2024-02-19T21:43:36.992490+0000","last_change":"2024-02-19T21:40:25.363354+0000","last_active":"2024-02-19T21:43:36.992490+0000","last_peered":"2024-02-19T21:43:36.992490+0000","last_clean":"2024-02-19T21:43:36.992490+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:43:36.992490+0000","last_undegraded":"2024-02-19T21:43:36.992490+0000","last_fullsized":"2024-02-19T21:43:36.992490+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:40:25.363236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:25.363236+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"249'16020","reported_seq":18814,"reported_epoch":249,"state":"active+clean","last_fresh":"2024-02-19T21:43:41.165306+0000","last_change":"2024-02-19T21:43:41.154428+0000","last_active":"2024-02-19T21:43:41.165306+0000","last_peered":"2024-02-19T21:43:41.165306+0000","last_clean":"2024-02-19T21:43:41.165306+0000","last_became_active":"2024-02-19T21:43:41.119023+0000","last_became_peered":"2024-02-19T21:43:41.119023+0000","last_unstale":"2024-02-19T21:43:41.165306+0000","last_undegraded":"2024-02-19T21:43:41.165306+0000","last_fullsized":"2024-02-19T21:43:41.165306+0000","mapping_epoch":248,"log_start":"200'11594","ondisk_log_start":"200'11594","created":165,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16020,"num_write_kb":512640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1336,"num_bytes_recovered":87490560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":144,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.104221+0000","last_change":"2024-02-19T21:43:22.148986+0000","last_active":"2024-02-19T21:43:40.104221+0000","last_peered":"2024-02-19T21:43:40.104221+0000","last_clean":"2024-02-19T21:43:40.104221+0000","last_became_active":"2024-02-19T21:43:22.148701+0000","last_became_peered":"2024-02-19T21:43:22.148701+0000","last_unstale":"2024-02-19T21:43:40.104221+0000","last_undegraded":"2024-02-19T21:43:40.104221+0000","last_fullsized":"2024-02-19T21:43:40.104221+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:27.767442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:27.767442+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":218,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.103640+0000","last_change":"2024-02-19T21:39:27.079886+0000","last_active":"2024-02-19T21:43:40.103640+0000","last_peered":"2024-02-19T21:43:40.103640+0000","last_clean":"2024-02-19T21:43:40.103640+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:43:40.103640+0000","last_undegraded":"2024-02-19T21:43:40.103640+0000","last_fullsized":"2024-02-19T21:43:40.103640+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:27.079784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:39:27.079784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"201'43","reported_seq":508,"reported_epoch":249,"state":"active+clean","last_fresh":"2024-02-19T21:43:41.113453+0000","last_change":"2024-02-19T21:42:04.218868+0000","last_active":"2024-02-19T21:43:41.113453+0000","last_peered":"2024-02-19T21:43:41.113453+0000","last_clean":"2024-02-19T21:43:41.113453+0000","last_became_active":"2024-02-19T21:42:04.196382+0000","last_became_peered":"2024-02-19T21:42:04.196382+0000","last_unstale":"2024-02-19T21:43:41.113453+0000","last_undegraded":"2024-02-19T21:43:41.113453+0000","last_fullsized":"2024-02-19T21:43:41.113453+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'30","last_scrub_stamp":"2024-02-19T21:39:43.996511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:43.996511+0000","log_size":43,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":1074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,5],"acting":[1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":209,"reported_epoch":247,"state":"active+clean","last_fresh":"2024-02-19T21:43:36.402140+0000","last_change":"2024-02-19T21:38:16.890343+0000","last_active":"2024-02-19T21:43:36.402140+0000","last_peered":"2024-02-19T21:43:36.402140+0000","last_clean":"2024-02-19T21:43:36.402140+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:43:36.402140+0000","last_undegraded":"2024-02-19T21:43:36.402140+0000","last_fullsized":"2024-02-19T21:43:36.402140+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:16.890269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:38:16.890269+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"249'15980","reported_seq":18097,"reported_epoch":249,"state":"active+clean","last_fresh":"2024-02-19T21:43:41.170918+0000","last_change":"2024-02-19T21:43:41.158234+0000","last_active":"2024-02-19T21:43:41.170918+0000","last_peered":"2024-02-19T21:43:41.170918+0000","last_clean":"2024-02-19T21:43:41.170918+0000","last_became_active":"2024-02-19T21:43:41.118457+0000","last_became_peered":"2024-02-19T21:43:41.118457+0000","last_unstale":"2024-02-19T21:43:41.170918+0000","last_undegraded":"2024-02-19T21:43:41.170918+0000","last_fullsized":"2024-02-19T21:43:41.170918+0000","mapping_epoch":248,"log_start":"200'11229","ondisk_log_start":"200'11229","created":165,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"188'8618","last_scrub_stamp":"2024-02-19T21:41:36.200222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:41:36.200222+0000","log_size":4751,"ondisk_log_size":4751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15980,"num_write_kb":511360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":999,"num_bytes_recovered":65470464,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":207,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.096032+0000","last_change":"2024-02-19T21:39:29.085751+0000","last_active":"2024-02-19T21:43:40.096032+0000","last_peered":"2024-02-19T21:43:40.096032+0000","last_clean":"2024-02-19T21:43:40.096032+0000","last_became_active":"2024-02-19T21:32:29.597365+0000","last_became_peered":"2024-02-19T21:32:29.597365+0000","last_unstale":"2024-02-19T21:43:40.096032+0000","last_undegraded":"2024-02-19T21:43:40.096032+0000","last_fullsized":"2024-02-19T21:43:40.096032+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:29.085642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:29.085642+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"67'5","reported_seq":901,"reported_epoch":249,"state":"active+clean","last_fresh":"2024-02-19T21:43:43.315000+0000","last_change":"2024-02-19T21:39:39.576551+0000","last_active":"2024-02-19T21:43:43.315000+0000","last_peered":"2024-02-19T21:43:43.315000+0000","last_clean":"2024-02-19T21:43:43.315000+0000","last_became_active":"2024-02-19T21:39:39.464361+0000","last_became_peered":"2024-02-19T21:39:39.464361+0000","last_unstale":"2024-02-19T21:43:43.315000+0000","last_undegraded":"2024-02-19T21:43:43.315000+0000","last_fullsized":"2024-02-19T21:43:43.315000+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5","last_scrub_stamp":"2024-02-19T21:38:17.997743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:38:17.997743+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":668,"num_read_kb":663,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":215,"reported_epoch":247,"state":"active+clean","last_fresh":"2024-02-19T21:43:36.403714+0000","last_change":"2024-02-19T21:41:36.636023+0000","last_active":"2024-02-19T21:43:36.403714+0000","last_peered":"2024-02-19T21:43:36.403714+0000","last_clean":"2024-02-19T21:43:36.403714+0000","last_became_active":"2024-02-19T21:39:39.468113+0000","last_became_peered":"2024-02-19T21:39:39.468113+0000","last_unstale":"2024-02-19T21:43:36.403714+0000","last_undegraded":"2024-02-19T21:43:36.403714+0000","last_fullsized":"2024-02-19T21:43:36.403714+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:36.635936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:41:36.635936+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"200'17","reported_seq":271,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.116854+0000","last_change":"2024-02-19T21:43:36.416340+0000","last_active":"2024-02-19T21:43:40.116854+0000","last_peered":"2024-02-19T21:43:40.116854+0000","last_clean":"2024-02-19T21:43:40.116854+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:43:40.116854+0000","last_undegraded":"2024-02-19T21:43:40.116854+0000","last_fullsized":"2024-02-19T21:43:40.116854+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'13","last_scrub_stamp":"2024-02-19T21:37:32.805993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:37:32.805993+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":25,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":100,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.103535+0000","last_change":"2024-02-19T21:41:29.640521+0000","last_active":"2024-02-19T21:43:40.103535+0000","last_peered":"2024-02-19T21:43:40.103535+0000","last_clean":"2024-02-19T21:43:40.103535+0000","last_became_active":"2024-02-19T21:39:39.475190+0000","last_became_peered":"2024-02-19T21:39:39.475190+0000","last_unstale":"2024-02-19T21:43:40.103535+0000","last_undegraded":"2024-02-19T21:43:40.103535+0000","last_fullsized":"2024-02-19T21:43:40.103535+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:29.640431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:29.640431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"249'15742","reported_seq":15834,"reported_epoch":249,"state":"active+clean","last_fresh":"2024-02-19T21:43:41.165391+0000","last_change":"2024-02-19T21:39:39.475831+0000","last_active":"2024-02-19T21:43:41.165391+0000","last_peered":"2024-02-19T21:43:41.165391+0000","last_clean":"2024-02-19T21:43:41.165391+0000","last_became_active":"2024-02-19T21:39:39.475531+0000","last_became_peered":"2024-02-19T21:39:39.475531+0000","last_unstale":"2024-02-19T21:43:41.165391+0000","last_undegraded":"2024-02-19T21:43:41.165391+0000","last_fullsized":"2024-02-19T21:43:41.165391+0000","mapping_epoch":165,"log_start":"200'11335","ondisk_log_start":"200'11335","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4407,"ondisk_log_size":4407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15742,"num_write_kb":503744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":230,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.102842+0000","last_change":"2024-02-19T21:43:18.128190+0000","last_active":"2024-02-19T21:43:40.102842+0000","last_peered":"2024-02-19T21:43:40.102842+0000","last_clean":"2024-02-19T21:43:40.102842+0000","last_became_active":"2024-02-19T21:43:18.127939+0000","last_became_peered":"2024-02-19T21:43:18.127939+0000","last_unstale":"2024-02-19T21:43:40.102842+0000","last_undegraded":"2024-02-19T21:43:40.102842+0000","last_fullsized":"2024-02-19T21:43:40.102842+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:33.758127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:40:33.758127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":121,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.103770+0000","last_change":"2024-02-19T21:40:30.692471+0000","last_active":"2024-02-19T21:43:40.103770+0000","last_peered":"2024-02-19T21:43:40.103770+0000","last_clean":"2024-02-19T21:43:40.103770+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:43:40.103770+0000","last_undegraded":"2024-02-19T21:43:40.103770+0000","last_fullsized":"2024-02-19T21:43:40.103770+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:30.692385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:40:30.692385+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":236,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.103165+0000","last_change":"2024-02-19T21:42:04.213108+0000","last_active":"2024-02-19T21:43:40.103165+0000","last_peered":"2024-02-19T21:43:40.103165+0000","last_clean":"2024-02-19T21:43:40.103165+0000","last_became_active":"2024-02-19T21:42:04.212730+0000","last_became_peered":"2024-02-19T21:42:04.212730+0000","last_unstale":"2024-02-19T21:43:40.103165+0000","last_undegraded":"2024-02-19T21:43:40.103165+0000","last_fullsized":"2024-02-19T21:43:40.103165+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:39.714982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:39.714982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":98,"reported_epoch":247,"state":"active+clean","last_fresh":"2024-02-19T21:43:36.400073+0000","last_change":"2024-02-19T21:42:04.197235+0000","last_active":"2024-02-19T21:43:36.400073+0000","last_peered":"2024-02-19T21:43:36.400073+0000","last_clean":"2024-02-19T21:43:36.400073+0000","last_became_active":"2024-02-19T21:42:04.196943+0000","last_became_peered":"2024-02-19T21:42:04.196943+0000","last_unstale":"2024-02-19T21:43:36.400073+0000","last_undegraded":"2024-02-19T21:43:36.400073+0000","last_fullsized":"2024-02-19T21:43:36.400073+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:38.927472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:40:38.927472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,1],"acting":[0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"201'33","reported_seq":263,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.112873+0000","last_change":"2024-02-19T21:40:24.331961+0000","last_active":"2024-02-19T21:43:40.112873+0000","last_peered":"2024-02-19T21:43:40.112873+0000","last_clean":"2024-02-19T21:43:40.112873+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:43:40.112873+0000","last_undegraded":"2024-02-19T21:43:40.112873+0000","last_fullsized":"2024-02-19T21:43:40.112873+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"143'21","last_scrub_stamp":"2024-02-19T21:40:24.331869+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:40:24.331869+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":189,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.103705+0000","last_change":"2024-02-19T21:42:04.205688+0000","last_active":"2024-02-19T21:43:40.103705+0000","last_peered":"2024-02-19T21:43:40.103705+0000","last_clean":"2024-02-19T21:43:40.103705+0000","last_became_active":"2024-02-19T21:42:04.205342+0000","last_became_peered":"2024-02-19T21:42:04.205342+0000","last_unstale":"2024-02-19T21:43:40.103705+0000","last_undegraded":"2024-02-19T21:43:40.103705+0000","last_fullsized":"2024-02-19T21:43:40.103705+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:22.826680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:22.826680+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"249'15900","reported_seq":15992,"reported_epoch":249,"state":"active+clean","last_fresh":"2024-02-19T21:43:41.113428+0000","last_change":"2024-02-19T21:39:39.480146+0000","last_active":"2024-02-19T21:43:41.113428+0000","last_peered":"2024-02-19T21:43:41.113428+0000","last_clean":"2024-02-19T21:43:41.113428+0000","last_became_active":"2024-02-19T21:39:39.479576+0000","last_became_peered":"2024-02-19T21:39:39.479576+0000","last_unstale":"2024-02-19T21:43:41.113428+0000","last_undegraded":"2024-02-19T21:43:41.113428+0000","last_fullsized":"2024-02-19T21:43:41.113428+0000","mapping_epoch":165,"log_start":"201'11897","ondisk_log_start":"201'11897","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4003,"ondisk_log_size":4003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15900,"num_write_kb":508800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":217,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.114077+0000","last_change":"2024-02-19T21:40:29.250688+0000","last_active":"2024-02-19T21:43:40.114077+0000","last_peered":"2024-02-19T21:43:40.114077+0000","last_clean":"2024-02-19T21:43:40.114077+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:43:40.114077+0000","last_undegraded":"2024-02-19T21:43:40.114077+0000","last_fullsized":"2024-02-19T21:43:40.114077+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:40:29.250599+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":227,"reported_epoch":247,"state":"active+clean","last_fresh":"2024-02-19T21:43:36.403791+0000","last_change":"2024-02-19T21:41:22.644476+0000","last_active":"2024-02-19T21:43:36.403791+0000","last_peered":"2024-02-19T21:43:36.403791+0000","last_clean":"2024-02-19T21:43:36.403791+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:43:36.403791+0000","last_undegraded":"2024-02-19T21:43:36.403791+0000","last_fullsized":"2024-02-19T21:43:36.403791+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:22.644405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:41:22.644405+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":237,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.094438+0000","last_change":"2024-02-19T21:43:35.030296+0000","last_active":"2024-02-19T21:43:40.094438+0000","last_peered":"2024-02-19T21:43:40.094438+0000","last_clean":"2024-02-19T21:43:40.094438+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:43:40.094438+0000","last_undegraded":"2024-02-19T21:43:40.094438+0000","last_fullsized":"2024-02-19T21:43:40.094438+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:30.117032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:39:30.117032+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"200'24","reported_seq":320,"reported_epoch":247,"state":"active+clean","last_fresh":"2024-02-19T21:43:36.403388+0000","last_change":"2024-02-19T21:42:04.647669+0000","last_active":"2024-02-19T21:43:36.403388+0000","last_peered":"2024-02-19T21:43:36.403388+0000","last_clean":"2024-02-19T21:43:36.403388+0000","last_became_active":"2024-02-19T21:42:04.206790+0000","last_became_peered":"2024-02-19T21:42:04.206790+0000","last_unstale":"2024-02-19T21:43:36.403388+0000","last_undegraded":"2024-02-19T21:43:36.403388+0000","last_fullsized":"2024-02-19T21:43:36.403388+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'12","last_scrub_stamp":"2024-02-19T21:38:18.908732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:38:18.908732+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":214,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.102771+0000","last_change":"2024-02-19T21:41:23.683433+0000","last_active":"2024-02-19T21:43:40.102771+0000","last_peered":"2024-02-19T21:43:40.102771+0000","last_clean":"2024-02-19T21:43:40.102771+0000","last_became_active":"2024-02-19T21:32:27.372460+0000","last_became_peered":"2024-02-19T21:32:27.372460+0000","last_unstale":"2024-02-19T21:43:40.102771+0000","last_undegraded":"2024-02-19T21:43:40.102771+0000","last_fullsized":"2024-02-19T21:43:40.102771+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:23.683337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:23.683337+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"249'15792","reported_seq":15884,"reported_epoch":249,"state":"active+clean","last_fresh":"2024-02-19T21:43:41.118305+0000","last_change":"2024-02-19T21:39:39.468511+0000","last_active":"2024-02-19T21:43:41.118305+0000","last_peered":"2024-02-19T21:43:41.118305+0000","last_clean":"2024-02-19T21:43:41.118305+0000","last_became_active":"2024-02-19T21:39:39.468217+0000","last_became_peered":"2024-02-19T21:39:39.468217+0000","last_unstale":"2024-02-19T21:43:41.118305+0000","last_undegraded":"2024-02-19T21:43:41.118305+0000","last_fullsized":"2024-02-19T21:43:41.118305+0000","mapping_epoch":165,"log_start":"185'6681","ondisk_log_start":"185'6681","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":9111,"ondisk_log_size":9111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15792,"num_write_kb":505344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":226,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.112543+0000","last_change":"2024-02-19T21:42:04.193367+0000","last_active":"2024-02-19T21:43:40.112543+0000","last_peered":"2024-02-19T21:43:40.112543+0000","last_clean":"2024-02-19T21:43:40.112543+0000","last_became_active":"2024-02-19T21:42:04.193058+0000","last_became_peered":"2024-02-19T21:42:04.193058+0000","last_unstale":"2024-02-19T21:43:40.112543+0000","last_undegraded":"2024-02-19T21:43:40.112543+0000","last_fullsized":"2024-02-19T21:43:40.112543+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:39:42.020832+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":213,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.096099+0000","last_change":"2024-02-19T21:40:11.877814+0000","last_active":"2024-02-19T21:43:40.096099+0000","last_peered":"2024-02-19T21:43:40.096099+0000","last_clean":"2024-02-19T21:43:40.096099+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:43:40.096099+0000","last_undegraded":"2024-02-19T21:43:40.096099+0000","last_fullsized":"2024-02-19T21:43:40.096099+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:11.877751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:11.877751+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"201'37","reported_seq":275,"reported_epoch":247,"state":"active+clean","last_fresh":"2024-02-19T21:43:36.400750+0000","last_change":"2024-02-19T21:40:26.405558+0000","last_active":"2024-02-19T21:43:36.400750+0000","last_peered":"2024-02-19T21:43:36.400750+0000","last_clean":"2024-02-19T21:43:36.400750+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:43:36.400750+0000","last_undegraded":"2024-02-19T21:43:36.400750+0000","last_fullsized":"2024-02-19T21:43:36.400750+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'27","last_scrub_stamp":"2024-02-19T21:40:26.405455+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:40:26.405455+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":216,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.109751+0000","last_change":"2024-02-19T21:40:16.260329+0000","last_active":"2024-02-19T21:43:40.109751+0000","last_peered":"2024-02-19T21:43:40.109751+0000","last_clean":"2024-02-19T21:43:40.109751+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:43:40.109751+0000","last_undegraded":"2024-02-19T21:43:40.109751+0000","last_fullsized":"2024-02-19T21:43:40.109751+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:16.260223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:40:16.260223+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.c","version":"248'16124","reported_seq":24998,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.102432+0000","last_change":"2024-02-19T21:42:45.605098+0000","last_active":"2024-02-19T21:43:40.102432+0000","last_peered":"2024-02-19T21:43:40.102432+0000","last_clean":"2024-02-19T21:43:40.102432+0000","last_became_active":"2024-02-19T21:42:45.572060+0000","last_became_peered":"2024-02-19T21:42:45.572060+0000","last_unstale":"2024-02-19T21:43:40.102432+0000","last_undegraded":"2024-02-19T21:43:40.102432+0000","last_fullsized":"2024-02-19T21:43:40.102432+0000","mapping_epoch":208,"log_start":"200'11702","ondisk_log_start":"200'11702","created":165,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4422,"ondisk_log_size":4422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16124,"num_write_kb":516224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4380,"num_bytes_recovered":287047680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":115,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.109311+0000","last_change":"2024-02-19T21:42:04.200629+0000","last_active":"2024-02-19T21:43:40.109311+0000","last_peered":"2024-02-19T21:43:40.109311+0000","last_clean":"2024-02-19T21:43:40.109311+0000","last_became_active":"2024-02-19T21:42:04.200292+0000","last_became_peered":"2024-02-19T21:42:04.200292+0000","last_unstale":"2024-02-19T21:43:40.109311+0000","last_undegraded":"2024-02-19T21:43:40.109311+0000","last_fullsized":"2024-02-19T21:43:40.109311+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:44.231420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:44.231420+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,5],"acting":[6,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":216,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.114309+0000","last_change":"2024-02-19T21:38:28.036423+0000","last_active":"2024-02-19T21:43:40.114309+0000","last_peered":"2024-02-19T21:43:40.114309+0000","last_clean":"2024-02-19T21:43:40.114309+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:43:40.114309+0000","last_undegraded":"2024-02-19T21:43:40.114309+0000","last_fullsized":"2024-02-19T21:43:40.114309+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:38:28.036351+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"201'38","reported_seq":196,"reported_epoch":247,"state":"active+clean","last_fresh":"2024-02-19T21:43:36.400224+0000","last_change":"2024-02-19T21:42:05.431988+0000","last_active":"2024-02-19T21:43:36.400224+0000","last_peered":"2024-02-19T21:43:36.400224+0000","last_clean":"2024-02-19T21:43:36.400224+0000","last_became_active":"2024-02-19T21:42:04.205907+0000","last_became_peered":"2024-02-19T21:42:04.205907+0000","last_unstale":"2024-02-19T21:43:36.400224+0000","last_undegraded":"2024-02-19T21:43:36.400224+0000","last_fullsized":"2024-02-19T21:43:36.400224+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"168'26","last_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:39:48.004702+0000","log_size":38,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":103,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.109553+0000","last_change":"2024-02-19T21:42:04.200909+0000","last_active":"2024-02-19T21:43:40.109553+0000","last_peered":"2024-02-19T21:43:40.109553+0000","last_clean":"2024-02-19T21:43:40.109553+0000","last_became_active":"2024-02-19T21:42:04.200496+0000","last_became_peered":"2024-02-19T21:42:04.200496+0000","last_unstale":"2024-02-19T21:43:40.109553+0000","last_undegraded":"2024-02-19T21:43:40.109553+0000","last_fullsized":"2024-02-19T21:43:40.109553+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:38.697183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:38.697183+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.d","version":"249'15792","reported_seq":25066,"reported_epoch":249,"state":"active+clean","last_fresh":"2024-02-19T21:43:41.116042+0000","last_change":"2024-02-19T21:42:41.528426+0000","last_active":"2024-02-19T21:43:41.116042+0000","last_peered":"2024-02-19T21:43:41.116042+0000","last_clean":"2024-02-19T21:43:41.116042+0000","last_became_active":"2024-02-19T21:42:41.508003+0000","last_became_peered":"2024-02-19T21:42:41.508003+0000","last_unstale":"2024-02-19T21:43:41.116042+0000","last_undegraded":"2024-02-19T21:43:41.116042+0000","last_fullsized":"2024-02-19T21:43:41.116042+0000","mapping_epoch":204,"log_start":"200'11319","ondisk_log_start":"200'11319","created":165,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4473,"ondisk_log_size":4473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":15792,"num_write_kb":505281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4580,"num_bytes_recovered":300089368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":221,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.096963+0000","last_change":"2024-02-19T21:40:28.874859+0000","last_active":"2024-02-19T21:43:40.096963+0000","last_peered":"2024-02-19T21:43:40.096963+0000","last_clean":"2024-02-19T21:43:40.096963+0000","last_became_active":"2024-02-19T21:39:39.481908+0000","last_became_peered":"2024-02-19T21:39:39.481908+0000","last_unstale":"2024-02-19T21:43:40.096963+0000","last_undegraded":"2024-02-19T21:43:40.096963+0000","last_fullsized":"2024-02-19T21:43:40.096963+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:28.874762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:28.874762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":236,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.113311+0000","last_change":"2024-02-19T21:42:04.197387+0000","last_active":"2024-02-19T21:43:40.113311+0000","last_peered":"2024-02-19T21:43:40.113311+0000","last_clean":"2024-02-19T21:43:40.113311+0000","last_became_active":"2024-02-19T21:42:04.197048+0000","last_became_peered":"2024-02-19T21:42:04.197048+0000","last_unstale":"2024-02-19T21:43:40.113311+0000","last_undegraded":"2024-02-19T21:43:40.113311+0000","last_fullsized":"2024-02-19T21:43:40.113311+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:32.498434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:32.498434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"201'28","reported_seq":232,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.103677+0000","last_change":"2024-02-19T21:41:31.580765+0000","last_active":"2024-02-19T21:43:40.103677+0000","last_peered":"2024-02-19T21:43:40.103677+0000","last_clean":"2024-02-19T21:43:40.103677+0000","last_became_active":"2024-02-19T21:35:14.513806+0000","last_became_peered":"2024-02-19T21:35:14.513806+0000","last_unstale":"2024-02-19T21:43:40.103677+0000","last_undegraded":"2024-02-19T21:43:40.103677+0000","last_fullsized":"2024-02-19T21:43:40.103677+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'14","last_scrub_stamp":"2024-02-19T21:41:31.580701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:41:31.580701+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":34,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":215,"reported_epoch":249,"state":"active+clean","last_fresh":"2024-02-19T21:43:41.116179+0000","last_change":"2024-02-19T21:41:30.192537+0000","last_active":"2024-02-19T21:43:41.116179+0000","last_peered":"2024-02-19T21:43:41.116179+0000","last_clean":"2024-02-19T21:43:41.116179+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:43:41.116179+0000","last_undegraded":"2024-02-19T21:43:41.116179+0000","last_fullsized":"2024-02-19T21:43:41.116179+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'9","last_scrub_stamp":"2024-02-19T21:41:30.192427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:30.192427+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"248'15742","reported_seq":15839,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.243592+0000","last_change":"2024-02-19T21:41:29.552859+0000","last_active":"2024-02-19T21:43:40.243592+0000","last_peered":"2024-02-19T21:43:40.243592+0000","last_clean":"2024-02-19T21:43:40.243592+0000","last_became_active":"2024-02-19T21:39:39.471580+0000","last_became_peered":"2024-02-19T21:39:39.471580+0000","last_unstale":"2024-02-19T21:43:40.243592+0000","last_undegraded":"2024-02-19T21:43:40.243592+0000","last_fullsized":"2024-02-19T21:43:40.243592+0000","mapping_epoch":165,"log_start":"200'11052","ondisk_log_start":"200'11052","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"187'8036","last_scrub_stamp":"2024-02-19T21:41:29.552760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:41:29.552760+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15742,"num_write_kb":503744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"66'1","reported_seq":116,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.114035+0000","last_change":"2024-02-19T21:42:59.117856+0000","last_active":"2024-02-19T21:43:40.114035+0000","last_peered":"2024-02-19T21:43:40.114035+0000","last_clean":"2024-02-19T21:43:40.114035+0000","last_became_active":"2024-02-19T21:42:59.117513+0000","last_became_peered":"2024-02-19T21:42:59.117513+0000","last_unstale":"2024-02-19T21:43:40.114035+0000","last_undegraded":"2024-02-19T21:43:40.114035+0000","last_fullsized":"2024-02-19T21:43:40.114035+0000","mapping_epoch":165,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:21.371240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:40:21.371240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":214,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.102709+0000","last_change":"2024-02-19T21:40:22.774178+0000","last_active":"2024-02-19T21:43:40.102709+0000","last_peered":"2024-02-19T21:43:40.102709+0000","last_clean":"2024-02-19T21:43:40.102709+0000","last_became_active":"2024-02-19T21:32:27.362497+0000","last_became_peered":"2024-02-19T21:32:27.362497+0000","last_unstale":"2024-02-19T21:43:40.102709+0000","last_undegraded":"2024-02-19T21:43:40.102709+0000","last_fullsized":"2024-02-19T21:43:40.102709+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:22.774081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:22.774081+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":225,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.094521+0000","last_change":"2024-02-19T21:40:41.901768+0000","last_active":"2024-02-19T21:43:40.094521+0000","last_peered":"2024-02-19T21:43:40.094521+0000","last_clean":"2024-02-19T21:43:40.094521+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:43:40.094521+0000","last_undegraded":"2024-02-19T21:43:40.094521+0000","last_fullsized":"2024-02-19T21:43:40.094521+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:40:41.901670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:41.901670+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"201'19","reported_seq":242,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.113000+0000","last_change":"2024-02-19T21:40:26.390284+0000","last_active":"2024-02-19T21:43:40.113000+0000","last_peered":"2024-02-19T21:43:40.113000+0000","last_clean":"2024-02-19T21:43:40.113000+0000","last_became_active":"2024-02-19T21:39:51.536649+0000","last_became_peered":"2024-02-19T21:39:51.536649+0000","last_unstale":"2024-02-19T21:43:40.113000+0000","last_undegraded":"2024-02-19T21:43:40.113000+0000","last_fullsized":"2024-02-19T21:43:40.113000+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:40:26.390173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:26.390173+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"248'16142","reported_seq":16234,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.225144+0000","last_change":"2024-02-19T21:39:39.479591+0000","last_active":"2024-02-19T21:43:40.225144+0000","last_peered":"2024-02-19T21:43:40.225144+0000","last_clean":"2024-02-19T21:43:40.225144+0000","last_became_active":"2024-02-19T21:39:39.479224+0000","last_became_peered":"2024-02-19T21:39:39.479224+0000","last_unstale":"2024-02-19T21:43:40.225144+0000","last_undegraded":"2024-02-19T21:43:40.225144+0000","last_fullsized":"2024-02-19T21:43:40.225144+0000","mapping_epoch":165,"log_start":"201'12191","ondisk_log_start":"201'12191","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":3951,"ondisk_log_size":3951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16142,"num_write_kb":516544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":230,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.102689+0000","last_change":"2024-02-19T21:42:53.026951+0000","last_active":"2024-02-19T21:43:40.102689+0000","last_peered":"2024-02-19T21:43:40.102689+0000","last_clean":"2024-02-19T21:43:40.102689+0000","last_became_active":"2024-02-19T21:42:53.026678+0000","last_became_peered":"2024-02-19T21:42:53.026678+0000","last_unstale":"2024-02-19T21:43:40.102689+0000","last_undegraded":"2024-02-19T21:43:40.102689+0000","last_fullsized":"2024-02-19T21:43:40.102689+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:16.845272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:16.845272+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"98'9","reported_seq":306,"reported_epoch":249,"state":"active+clean","last_fresh":"2024-02-19T21:43:41.116616+0000","last_change":"2024-02-19T21:41:30.610945+0000","last_active":"2024-02-19T21:43:41.116616+0000","last_peered":"2024-02-19T21:43:41.116616+0000","last_clean":"2024-02-19T21:43:41.116616+0000","last_became_active":"2024-02-19T21:35:14.513802+0000","last_became_peered":"2024-02-19T21:35:14.513802+0000","last_unstale":"2024-02-19T21:43:41.116616+0000","last_undegraded":"2024-02-19T21:43:41.116616+0000","last_fullsized":"2024-02-19T21:43:41.116616+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'9","last_scrub_stamp":"2024-02-19T21:41:30.610855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:30.610855+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":219,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.112386+0000","last_change":"2024-02-19T21:40:14.294150+0000","last_active":"2024-02-19T21:43:40.112386+0000","last_peered":"2024-02-19T21:43:40.112386+0000","last_clean":"2024-02-19T21:43:40.112386+0000","last_became_active":"2024-02-19T21:32:23.362738+0000","last_became_peered":"2024-02-19T21:32:23.362738+0000","last_unstale":"2024-02-19T21:43:40.112386+0000","last_undegraded":"2024-02-19T21:43:40.112386+0000","last_fullsized":"2024-02-19T21:43:40.112386+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:14.294064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:40:14.294064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"201'27","reported_seq":128,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.102473+0000","last_change":"2024-02-19T21:40:12.838278+0000","last_active":"2024-02-19T21:43:40.102473+0000","last_peered":"2024-02-19T21:43:40.102473+0000","last_clean":"2024-02-19T21:43:40.102473+0000","last_became_active":"2024-02-19T21:39:51.539230+0000","last_became_peered":"2024-02-19T21:39:51.539230+0000","last_unstale":"2024-02-19T21:43:40.102473+0000","last_undegraded":"2024-02-19T21:43:40.102473+0000","last_fullsized":"2024-02-19T21:43:40.102473+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:40:12.838083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:12.838083+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.0","version":"248'16056","reported_seq":16153,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.245529+0000","last_change":"2024-02-19T21:41:41.239560+0000","last_active":"2024-02-19T21:43:40.245529+0000","last_peered":"2024-02-19T21:43:40.245529+0000","last_clean":"2024-02-19T21:43:40.245529+0000","last_became_active":"2024-02-19T21:39:39.465196+0000","last_became_peered":"2024-02-19T21:39:39.465196+0000","last_unstale":"2024-02-19T21:43:40.245529+0000","last_undegraded":"2024-02-19T21:43:40.245529+0000","last_fullsized":"2024-02-19T21:43:40.245529+0000","mapping_epoch":165,"log_start":"185'6964","ondisk_log_start":"185'6964","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":9092,"ondisk_log_size":9092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16056,"num_write_kb":513792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":200,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.114616+0000","last_change":"2024-02-19T21:42:48.626776+0000","last_active":"2024-02-19T21:43:40.114616+0000","last_peered":"2024-02-19T21:43:40.114616+0000","last_clean":"2024-02-19T21:43:40.114616+0000","last_became_active":"2024-02-19T21:42:48.626491+0000","last_became_peered":"2024-02-19T21:42:48.626491+0000","last_unstale":"2024-02-19T21:43:40.114616+0000","last_undegraded":"2024-02-19T21:43:40.114616+0000","last_fullsized":"2024-02-19T21:43:40.114616+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:40.015907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:40.015907+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"170'11","reported_seq":220,"reported_epoch":249,"state":"active+clean","last_fresh":"2024-02-19T21:43:41.118436+0000","last_change":"2024-02-19T21:40:21.864057+0000","last_active":"2024-02-19T21:43:41.118436+0000","last_peered":"2024-02-19T21:43:41.118436+0000","last_clean":"2024-02-19T21:43:41.118436+0000","last_became_active":"2024-02-19T21:39:51.534304+0000","last_became_peered":"2024-02-19T21:39:51.534304+0000","last_unstale":"2024-02-19T21:43:41.118436+0000","last_undegraded":"2024-02-19T21:43:41.118436+0000","last_fullsized":"2024-02-19T21:43:41.118436+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'11","last_scrub_stamp":"2024-02-19T21:40:21.863959+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:40:21.863959+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":216,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.109508+0000","last_change":"2024-02-19T21:39:31.018063+0000","last_active":"2024-02-19T21:43:40.109508+0000","last_peered":"2024-02-19T21:43:40.109508+0000","last_clean":"2024-02-19T21:43:40.109508+0000","last_became_active":"2024-02-19T21:32:23.363155+0000","last_became_peered":"2024-02-19T21:32:23.363155+0000","last_unstale":"2024-02-19T21:43:40.109508+0000","last_undegraded":"2024-02-19T21:43:40.109508+0000","last_fullsized":"2024-02-19T21:43:40.109508+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:31.018000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:39:31.018000+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"200'20","reported_seq":220,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.116067+0000","last_change":"2024-02-19T21:41:21.872187+0000","last_active":"2024-02-19T21:43:40.116067+0000","last_peered":"2024-02-19T21:43:40.116067+0000","last_clean":"2024-02-19T21:43:40.116067+0000","last_became_active":"2024-02-19T21:35:14.514968+0000","last_became_peered":"2024-02-19T21:35:14.514968+0000","last_unstale":"2024-02-19T21:43:40.116067+0000","last_undegraded":"2024-02-19T21:43:40.116067+0000","last_fullsized":"2024-02-19T21:43:40.116067+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:41:21.872058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:41:21.872058+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6],"acting":[3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1","version":"249'15908","reported_seq":16000,"reported_epoch":249,"state":"active+clean","last_fresh":"2024-02-19T21:43:41.116199+0000","last_change":"2024-02-19T21:39:39.480753+0000","last_active":"2024-02-19T21:43:41.116199+0000","last_peered":"2024-02-19T21:43:41.116199+0000","last_clean":"2024-02-19T21:43:41.116199+0000","last_became_active":"2024-02-19T21:39:39.480509+0000","last_became_peered":"2024-02-19T21:39:39.480509+0000","last_unstale":"2024-02-19T21:43:41.116199+0000","last_undegraded":"2024-02-19T21:43:41.116199+0000","last_fullsized":"2024-02-19T21:43:41.116199+0000","mapping_epoch":165,"log_start":"201'11912","ondisk_log_start":"201'11912","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":3996,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15908,"num_write_kb":509056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":226,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.113339+0000","last_change":"2024-02-19T21:42:44.595213+0000","last_active":"2024-02-19T21:43:40.113339+0000","last_peered":"2024-02-19T21:43:40.113339+0000","last_clean":"2024-02-19T21:43:40.113339+0000","last_became_active":"2024-02-19T21:42:44.592914+0000","last_became_peered":"2024-02-19T21:42:44.592914+0000","last_unstale":"2024-02-19T21:43:40.113339+0000","last_undegraded":"2024-02-19T21:43:40.113339+0000","last_fullsized":"2024-02-19T21:43:40.113339+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:36.725664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:41:36.725664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":210,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.114000+0000","last_change":"2024-02-19T21:39:39.002316+0000","last_active":"2024-02-19T21:43:40.114000+0000","last_peered":"2024-02-19T21:43:40.114000+0000","last_clean":"2024-02-19T21:43:40.114000+0000","last_became_active":"2024-02-19T21:32:27.369452+0000","last_became_peered":"2024-02-19T21:32:27.369452+0000","last_unstale":"2024-02-19T21:43:40.114000+0000","last_undegraded":"2024-02-19T21:43:40.114000+0000","last_fullsized":"2024-02-19T21:43:40.114000+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:39.002258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:39.002258+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":220,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.096836+0000","last_change":"2024-02-19T21:40:32.869530+0000","last_active":"2024-02-19T21:43:40.096836+0000","last_peered":"2024-02-19T21:43:40.096836+0000","last_clean":"2024-02-19T21:43:40.096836+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:43:40.096836+0000","last_undegraded":"2024-02-19T21:43:40.096836+0000","last_fullsized":"2024-02-19T21:43:40.096836+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:32.869462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:40:32.869462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"201'31","reported_seq":174,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.115535+0000","last_change":"2024-02-19T21:39:39.501787+0000","last_active":"2024-02-19T21:43:40.115535+0000","last_peered":"2024-02-19T21:43:40.115535+0000","last_clean":"2024-02-19T21:43:40.115535+0000","last_became_active":"2024-02-19T21:39:39.474668+0000","last_became_peered":"2024-02-19T21:39:39.474668+0000","last_unstale":"2024-02-19T21:43:40.115535+0000","last_undegraded":"2024-02-19T21:43:40.115535+0000","last_fullsized":"2024-02-19T21:43:40.115535+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'17","last_scrub_stamp":"2024-02-19T21:38:19.154753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:38:19.154753+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":49,"num_read_kb":39,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"247'16002","reported_seq":16093,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.106132+0000","last_change":"2024-02-19T21:39:39.471363+0000","last_active":"2024-02-19T21:43:40.106132+0000","last_peered":"2024-02-19T21:43:40.106132+0000","last_clean":"2024-02-19T21:43:40.106132+0000","last_became_active":"2024-02-19T21:39:39.470667+0000","last_became_peered":"2024-02-19T21:39:39.470667+0000","last_unstale":"2024-02-19T21:43:40.106132+0000","last_undegraded":"2024-02-19T21:43:40.106132+0000","last_fullsized":"2024-02-19T21:43:40.106132+0000","mapping_epoch":165,"log_start":"200'11575","ondisk_log_start":"200'11575","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4427,"ondisk_log_size":4427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16002,"num_write_kb":512320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"66'1","reported_seq":205,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.117001+0000","last_change":"2024-02-19T21:43:14.407536+0000","last_active":"2024-02-19T21:43:40.117001+0000","last_peered":"2024-02-19T21:43:40.117001+0000","last_clean":"2024-02-19T21:43:40.117001+0000","last_became_active":"2024-02-19T21:43:14.407205+0000","last_became_peered":"2024-02-19T21:43:14.407205+0000","last_unstale":"2024-02-19T21:43:40.117001+0000","last_undegraded":"2024-02-19T21:43:40.117001+0000","last_fullsized":"2024-02-19T21:43:40.117001+0000","mapping_epoch":197,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":236,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:36.890201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.890201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":108,"reported_epoch":247,"state":"active+clean","last_fresh":"2024-02-19T21:43:36.400671+0000","last_change":"2024-02-19T21:42:04.205186+0000","last_active":"2024-02-19T21:43:36.400671+0000","last_peered":"2024-02-19T21:43:36.400671+0000","last_clean":"2024-02-19T21:43:36.400671+0000","last_became_active":"2024-02-19T21:42:04.204839+0000","last_became_peered":"2024-02-19T21:42:04.204839+0000","last_unstale":"2024-02-19T21:43:36.400671+0000","last_undegraded":"2024-02-19T21:43:36.400671+0000","last_fullsized":"2024-02-19T21:43:36.400671+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:23.324303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:46.372184+0000","last_clean_scrub_stamp":"2024-02-19T21:40:23.324303+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":113,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.103789+0000","last_change":"2024-02-19T21:40:28.696870+0000","last_active":"2024-02-19T21:43:40.103789+0000","last_peered":"2024-02-19T21:43:40.103789+0000","last_clean":"2024-02-19T21:43:40.103789+0000","last_became_active":"2024-02-19T21:39:39.479752+0000","last_became_peered":"2024-02-19T21:39:39.479752+0000","last_unstale":"2024-02-19T21:43:40.103789+0000","last_undegraded":"2024-02-19T21:43:40.103789+0000","last_fullsized":"2024-02-19T21:43:40.103789+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:40:28.696783+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"201'44","reported_seq":311,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.109601+0000","last_change":"2024-02-19T21:42:04.985140+0000","last_active":"2024-02-19T21:43:40.109601+0000","last_peered":"2024-02-19T21:43:40.109601+0000","last_clean":"2024-02-19T21:43:40.109601+0000","last_became_active":"2024-02-19T21:42:04.200393+0000","last_became_peered":"2024-02-19T21:42:04.200393+0000","last_unstale":"2024-02-19T21:43:40.109601+0000","last_undegraded":"2024-02-19T21:43:40.109601+0000","last_fullsized":"2024-02-19T21:43:40.109601+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'28","last_scrub_stamp":"2024-02-19T21:39:40.282677+0000","last_deep_scrub":"115'28","last_deep_scrub_stamp":"2024-02-19T21:36:09.031674+0000","last_clean_scrub_stamp":"2024-02-19T21:39:40.282677+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.7","version":"248'15814","reported_seq":15906,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.232504+0000","last_change":"2024-02-19T21:39:39.463794+0000","last_active":"2024-02-19T21:43:40.232504+0000","last_peered":"2024-02-19T21:43:40.232504+0000","last_clean":"2024-02-19T21:43:40.232504+0000","last_became_active":"2024-02-19T21:39:39.463542+0000","last_became_peered":"2024-02-19T21:39:39.463542+0000","last_unstale":"2024-02-19T21:43:40.232504+0000","last_undegraded":"2024-02-19T21:43:40.232504+0000","last_fullsized":"2024-02-19T21:43:40.232504+0000","mapping_epoch":165,"log_start":"200'11783","ondisk_log_start":"200'11783","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4031,"ondisk_log_size":4031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15814,"num_write_kb":506048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,6],"acting":[1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":239,"reported_epoch":247,"state":"active+clean","last_fresh":"2024-02-19T21:43:36.403949+0000","last_change":"2024-02-19T21:43:10.349161+0000","last_active":"2024-02-19T21:43:36.403949+0000","last_peered":"2024-02-19T21:43:36.403949+0000","last_clean":"2024-02-19T21:43:36.403949+0000","last_became_active":"2024-02-19T21:43:10.348874+0000","last_became_peered":"2024-02-19T21:43:10.348874+0000","last_unstale":"2024-02-19T21:43:36.403949+0000","last_undegraded":"2024-02-19T21:43:36.403949+0000","last_fullsized":"2024-02-19T21:43:36.403949+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":232,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:42.230664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:42.230664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":205,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.105210+0000","last_change":"2024-02-19T21:40:40.799240+0000","last_active":"2024-02-19T21:43:40.105210+0000","last_peered":"2024-02-19T21:43:40.105210+0000","last_clean":"2024-02-19T21:43:40.105210+0000","last_became_active":"2024-02-19T21:39:39.468109+0000","last_became_peered":"2024-02-19T21:39:39.468109+0000","last_unstale":"2024-02-19T21:43:40.105210+0000","last_undegraded":"2024-02-19T21:43:40.105210+0000","last_fullsized":"2024-02-19T21:43:40.105210+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:40.799141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:40.799141+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1],"acting":[4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":214,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.115671+0000","last_change":"2024-02-19T21:37:36.883246+0000","last_active":"2024-02-19T21:43:40.115671+0000","last_peered":"2024-02-19T21:43:40.115671+0000","last_clean":"2024-02-19T21:43:40.115671+0000","last_became_active":"2024-02-19T21:32:23.357438+0000","last_became_peered":"2024-02-19T21:32:23.357438+0000","last_unstale":"2024-02-19T21:43:40.115671+0000","last_undegraded":"2024-02-19T21:43:40.115671+0000","last_fullsized":"2024-02-19T21:43:40.115671+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:37:36.883151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:37:36.883151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"201'15","reported_seq":241,"reported_epoch":247,"state":"active+clean","last_fresh":"2024-02-19T21:43:36.401076+0000","last_change":"2024-02-19T21:39:36.193250+0000","last_active":"2024-02-19T21:43:36.401076+0000","last_peered":"2024-02-19T21:43:36.401076+0000","last_clean":"2024-02-19T21:43:36.401076+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:43:36.401076+0000","last_undegraded":"2024-02-19T21:43:36.401076+0000","last_fullsized":"2024-02-19T21:43:36.401076+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:39:36.193184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:36.193184+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"249'16212","reported_seq":16304,"reported_epoch":249,"state":"active+clean","last_fresh":"2024-02-19T21:43:41.116029+0000","last_change":"2024-02-19T21:39:39.474614+0000","last_active":"2024-02-19T21:43:41.116029+0000","last_peered":"2024-02-19T21:43:41.116029+0000","last_clean":"2024-02-19T21:43:41.116029+0000","last_became_active":"2024-02-19T21:39:39.474311+0000","last_became_peered":"2024-02-19T21:39:39.474311+0000","last_unstale":"2024-02-19T21:43:41.116029+0000","last_undegraded":"2024-02-19T21:43:41.116029+0000","last_fullsized":"2024-02-19T21:43:41.116029+0000","mapping_epoch":165,"log_start":"200'11728","ondisk_log_start":"200'11728","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:38.443319+0000","last_clean_scrub_stamp":"2024-02-19T21:39:38.443319+0000","log_size":4484,"ondisk_log_size":4484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16212,"num_write_kb":518784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":230,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.103429+0000","last_change":"2024-02-19T21:43:06.293725+0000","last_active":"2024-02-19T21:43:40.103429+0000","last_peered":"2024-02-19T21:43:40.103429+0000","last_clean":"2024-02-19T21:43:40.103429+0000","last_became_active":"2024-02-19T21:43:06.293389+0000","last_became_peered":"2024-02-19T21:43:06.293389+0000","last_unstale":"2024-02-19T21:43:40.103429+0000","last_undegraded":"2024-02-19T21:43:40.103429+0000","last_fullsized":"2024-02-19T21:43:40.103429+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:17.853016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:40:17.853016+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":175,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.113122+0000","last_change":"2024-02-19T21:42:04.200518+0000","last_active":"2024-02-19T21:43:40.113122+0000","last_peered":"2024-02-19T21:43:40.113122+0000","last_clean":"2024-02-19T21:43:40.113122+0000","last_became_active":"2024-02-19T21:42:04.199889+0000","last_became_peered":"2024-02-19T21:42:04.199889+0000","last_unstale":"2024-02-19T21:43:40.113122+0000","last_undegraded":"2024-02-19T21:43:40.113122+0000","last_fullsized":"2024-02-19T21:43:40.113122+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:40:29.858805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"200'27","reported_seq":286,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-02-19T21:43:40.105464+0000","last_change":"2024-02-19T21:42:05.597864+0000","last_active":"2024-02-19T21:43:40.105464+0000","last_peered":"2024-02-19T21:43:40.105464+0000","last_clean":"2024-02-19T21:43:40.105464+0000","last_became_active":"2024-02-19T21:42:04.212731+0000","last_became_peered":"2024-02-19T21:42:04.212731+0000","last_unstale":"2024-02-19T21:43:40.105464+0000","last_undegraded":"2024-02-19T21:43:40.105464+0000","last_fullsized":"2024-02-19T21:43:40.105464+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:40:23.751886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:23.751886+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"66'8","reported_seq":358,"reported_epoch":249,"state":"active+clean","last_fresh":"2024-02-19T21:43:41.117657+0000","last_change":"2024-02-19T21:40:19.870350+0000","last_active":"2024-02-19T21:43:41.117657+0000","last_peered":"2024-02-19T21:43:41.117657+0000","last_clean":"2024-02-19T21:43:41.117657+0000","last_became_active":"2024-02-19T21:32:27.369840+0000","last_became_peered":"2024-02-19T21:32:27.369840+0000","last_unstale":"2024-02-19T21:43:41.117657+0000","last_undegraded":"2024-02-19T21:43:41.117657+0000","last_fullsized":"2024-02-19T21:43:41.117657+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:40:19.870250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:19.870250+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":255404,"num_write_kb":8173761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11295,"num_bytes_recovered":740098072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":223477760,"data_stored":223477760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79113,"ondisk_log_size":79113,"up":48,"acting":48,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":668,"num_read_kb":663,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1116,"num_read_kb":873,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":3604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":741,"ondisk_log_size":741,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":96,"acting":96,"num_store_stats":8},{"poolid":6,"num_pg":22,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":382,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":66,"acting":66,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201419,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":516472,"kb_used_data":219248,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93228680,"statfs":{"total":95995035648,"available":95466168320,"internally_reserved":0,"allocated":224509952,"data_stored":224145045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:43:35 2024","interfaces":[{"interface":"back","average":{"1min":2.0990000000000002,"5min":2.1190000000000002,"15min":1.1899999999999999},"min":{"1min":0.216,"5min":0.189,"15min":0.189},"max":{"1min":7.1109999999999998,"5min":13.645,"15min":13.645},"last":0.59599999999999997},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.9490000000000001,"15min":1.2450000000000001},"min":{"1min":0.253,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":3.6469999999999998,"5min":14.212999999999999,"15min":14.212999999999999},"last":0.44400000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:43:35 2024","interfaces":[{"interface":"back","average":{"1min":2.3100000000000001,"5min":2.1200000000000001,"15min":1.333},"min":{"1min":0.28799999999999998,"5min":0.255,"15min":0.23200000000000001},"max":{"1min":6.9130000000000003,"5min":14.246,"15min":14.246},"last":0.56200000000000006},{"interface":"front","average":{"1min":1.772,"5min":1.9139999999999999,"15min":1.1859999999999999},"min":{"1min":0.29699999999999999,"5min":0.223,"15min":0.223},"max":{"1min":5.6989999999999998,"5min":14.15,"15min":14.15},"last":0.48699999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:43:35 2024","interfaces":[{"interface":"back","average":{"1min":2.5430000000000001,"5min":2.262,"15min":1.284},"min":{"1min":0.34399999999999997,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":6.7850000000000001,"5min":10.965999999999999,"15min":10.965999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":2.2440000000000002,"5min":2.0249999999999999,"15min":1.3080000000000001},"min":{"1min":0.45900000000000002,"5min":0.28899999999999998,"15min":0.27800000000000002},"max":{"1min":6.8099999999999996,"5min":9.7010000000000005,"15min":9.7010000000000005},"last":0.63700000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:43:35 2024","interfaces":[{"interface":"back","average":{"1min":2.3660000000000001,"5min":2.5659999999999998,"15min":1.621},"min":{"1min":0.315,"5min":0.29199999999999998,"15min":0.26900000000000002},"max":{"1min":6.2050000000000001,"5min":15.438000000000001,"15min":31.559000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":2.9239999999999999,"5min":2.1930000000000001,"15min":1.4930000000000001},"min":{"1min":0.38600000000000001,"5min":0.309,"15min":0.309},"max":{"1min":6.9409999999999998,"5min":10.522,"15min":30.812999999999999},"last":0.61199999999999999}]},{"osd":4,"last update":"Mon Feb 19 21:43:35 2024","interfaces":[{"interface":"back","average":{"1min":2.1040000000000001,"5min":1.962,"15min":0.997},"min":{"1min":0.34000000000000002,"5min":0.247,"15min":0.247},"max":{"1min":8.1530000000000005,"5min":14.208,"15min":14.208},"last":0.54800000000000004},{"interface":"front","average":{"1min":2.6339999999999999,"5min":2.4950000000000001,"15min":1.1990000000000001},"min":{"1min":0.28699999999999998,"5min":0.26500000000000001,"15min":0.245},"max":{"1min":9.6110000000000007,"5min":11.541,"15min":11.541},"last":0.64700000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:43:35 2024","interfaces":[{"interface":"back","average":{"1min":2.6930000000000001,"5min":1.992,"15min":1.1120000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":6.8449999999999998,"5min":10.090999999999999,"15min":10.090999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":2.7709999999999999,"5min":2.415,"15min":1.1919999999999999},"min":{"1min":0.33200000000000002,"5min":0.30299999999999999,"15min":0.28799999999999998},"max":{"1min":8.5890000000000004,"5min":17.012,"15min":17.012},"last":0.62}]},{"osd":6,"last update":"Mon Feb 19 21:43:35 2024","interfaces":[{"interface":"back","average":{"1min":2.1699999999999999,"5min":1.9319999999999999,"15min":1.044},"min":{"1min":0.47599999999999998,"5min":0.31900000000000001,"15min":0.30299999999999999},"max":{"1min":5.6669999999999998,"5min":14.177,"15min":14.177},"last":0.58499999999999996},{"interface":"front","average":{"1min":2.3290000000000002,"5min":2.5379999999999998,"15min":1.391},"min":{"1min":0.40100000000000002,"5min":0.33000000000000002,"15min":0.29699999999999999},"max":{"1min":6.2510000000000003,"5min":12.913,"15min":12.913},"last":0.626}]}]},{"osd":6,"up_from":47,"seq":201863463058,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":306460,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93438692,"statfs":{"total":95995035648,"available":95681220608,"internally_reserved":0,"allocated":1069056,"data_stored":667740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:43:14 2024","interfaces":[{"interface":"back","average":{"1min":3.6040000000000001,"5min":2.395,"15min":1.343},"min":{"1min":0.23599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":45.197000000000003,"5min":45.197000000000003,"15min":45.197000000000003},"last":0.66600000000000004},{"interface":"front","average":{"1min":3.7400000000000002,"5min":2.504,"15min":1.4279999999999999},"min":{"1min":0.23799999999999999,"5min":0.23499999999999999,"15min":0.221},"max":{"1min":44.753,"5min":44.753,"15min":44.753},"last":0.61599999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:43:14 2024","interfaces":[{"interface":"back","average":{"1min":3.7989999999999999,"5min":2.2240000000000002,"15min":1.2849999999999999},"min":{"1min":0.26500000000000001,"5min":0.222,"15min":0.222},"max":{"1min":45.231999999999999,"5min":45.231999999999999,"15min":45.231999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":4.1509999999999998,"5min":2.0920000000000001,"15min":1.216},"min":{"1min":0.377,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":45.097999999999999,"5min":45.097999999999999,"15min":45.097999999999999},"last":0.68000000000000005}]},{"osd":2,"last update":"Mon Feb 19 21:43:14 2024","interfaces":[{"interface":"back","average":{"1min":1.7729999999999999,"5min":1.611,"15min":1.073},"min":{"1min":0.35399999999999998,"5min":0.28599999999999998,"15min":0.26800000000000002},"max":{"1min":6.5899999999999999,"5min":8.3849999999999998,"15min":8.3849999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":1.585,"5min":1.744,"15min":1.1359999999999999},"min":{"1min":0.32500000000000001,"5min":0.29299999999999998,"15min":0.27300000000000002},"max":{"1min":5.7140000000000004,"5min":8.5259999999999998,"15min":18.068000000000001},"last":0.65200000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:43:14 2024","interfaces":[{"interface":"back","average":{"1min":1.988,"5min":1.758,"15min":1.1950000000000001},"min":{"1min":0.32500000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":7.6520000000000001,"5min":11.15,"15min":11.15},"last":0.627},{"interface":"front","average":{"1min":2.0459999999999998,"5min":1.6120000000000001,"15min":1.171},"min":{"1min":0.35199999999999998,"5min":0.26400000000000001,"15min":0.246},"max":{"1min":6.6150000000000002,"5min":10.228999999999999,"15min":19.632999999999999},"last":0.63900000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:43:14 2024","interfaces":[{"interface":"back","average":{"1min":1.7230000000000001,"5min":1.8540000000000001,"15min":0.94899999999999995},"min":{"1min":0.32500000000000001,"5min":0.247,"15min":0.247},"max":{"1min":3.407,"5min":9.3759999999999994,"15min":9.3759999999999994},"last":0.41299999999999998},{"interface":"front","average":{"1min":2.871,"5min":2.085,"15min":1.02},"min":{"1min":0.40000000000000002,"5min":0.27300000000000002,"15min":0.23499999999999999},"max":{"1min":14.055,"5min":16.594999999999999,"15min":16.594999999999999},"last":0.443}]},{"osd":5,"last update":"Mon Feb 19 21:43:14 2024","interfaces":[{"interface":"back","average":{"1min":2.1779999999999999,"5min":1.9650000000000001,"15min":1.0049999999999999},"min":{"1min":0.314,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":7.4279999999999999,"5min":8.6159999999999997,"15min":8.6159999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":2.7080000000000002,"5min":2.2469999999999999,"15min":1.111},"min":{"1min":0.34799999999999998,"5min":0.30299999999999999,"15min":0.27900000000000003},"max":{"1min":15.164,"5min":15.497999999999999,"15min":15.497999999999999},"last":0.499}]},{"osd":7,"last update":"Mon Feb 19 21:43:33 2024","interfaces":[{"interface":"back","average":{"1min":2.5169999999999999,"5min":2.4460000000000002,"15min":1.204},"min":{"1min":0.32100000000000001,"5min":0.307,"15min":0.26700000000000002},"max":{"1min":8.4730000000000008,"5min":14.721,"15min":14.721},"last":0.54100000000000004},{"interface":"front","average":{"1min":2.548,"5min":2.4849999999999999,"15min":1.2629999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":8.5,"5min":14.744999999999999,"15min":14.744999999999999},"last":0.73799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575020,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298280,"kb_used_data":1056,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93446872,"statfs":{"total":95995035648,"available":95689596928,"internally_reserved":0,"allocated":1081344,"data_stored":668875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.9610000000000001,"15min":1.2210000000000001},"min":{"1min":0.23100000000000001,"5min":0.161,"15min":0.161},"max":{"1min":6.9260000000000002,"5min":42.776000000000003,"15min":42.776000000000003},"last":0.36499999999999999},{"interface":"front","average":{"1min":1.5820000000000001,"5min":2.0430000000000001,"15min":1.22},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":5.2919999999999998,"5min":44.845999999999997,"15min":44.845999999999997},"last":0.23899999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:43:27 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.2629999999999999,"15min":1.1479999999999999},"min":{"1min":0.23799999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":4.633,"5min":11.161,"15min":11.826000000000001},"last":0.25700000000000001},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.254,"15min":1.25},"min":{"1min":0.27300000000000002,"5min":0.215,"15min":0.215},"max":{"1min":4.3390000000000004,"5min":7.8140000000000001,"15min":12.26},"last":0.35099999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.901,"15min":1.3260000000000001},"min":{"1min":0.252,"5min":0.224,"15min":0.224},"max":{"1min":4.5099999999999998,"5min":41.607999999999997,"15min":41.607999999999997},"last":0.375},{"interface":"front","average":{"1min":1.9930000000000001,"5min":1.895,"15min":1.179},"min":{"1min":0.27000000000000002,"5min":0.22500000000000001,"15min":0.217},"max":{"1min":8.7349999999999994,"5min":42.811999999999998,"15min":42.811999999999998},"last":0.34300000000000003}]},{"osd":4,"last update":"Mon Feb 19 21:43:22 2024","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.7190000000000001,"15min":1.0669999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26800000000000002},"max":{"1min":7.2270000000000003,"5min":11.23,"15min":11.23},"last":0.48699999999999999},{"interface":"front","average":{"1min":1.25,"5min":1.627,"15min":1.171},"min":{"1min":0.30499999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":3.855,"5min":7.04,"15min":10.51},"last":0.496}]},{"osd":5,"last update":"Mon Feb 19 21:42:45 2024","interfaces":[{"interface":"back","average":{"1min":1.615,"5min":1.8089999999999999,"15min":1.147},"min":{"1min":0.30599999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":5.9199999999999999,"5min":8.0760000000000005,"15min":10.458},"last":0.443},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.587,"15min":1.0680000000000001},"min":{"1min":0.32600000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":6.0720000000000001,"5min":7.2389999999999999,"15min":7.6950000000000003},"last":0.50800000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:43:17 2024","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":2.032,"15min":1.1919999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.30099999999999999},"max":{"1min":7.2830000000000004,"5min":11.638999999999999,"15min":11.638999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":2.9649999999999999,"5min":2.1600000000000001,"15min":1.294},"min":{"1min":0.377,"5min":0.32900000000000001,"15min":0.316},"max":{"1min":6.9530000000000003,"5min":12.199,"15min":12.199},"last":0.47299999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:43:36 2024","interfaces":[{"interface":"back","average":{"1min":2.5030000000000001,"5min":1.9590000000000001,"15min":1.347},"min":{"1min":0.40100000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":5.0860000000000003,"5min":8.1699999999999999,"15min":10.638999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":2.004,"5min":1.946,"15min":1.2310000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":5.0979999999999999,"5min":11.276,"15min":11.276},"last":0.52600000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738545,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":329348,"kb_used_data":23932,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93415804,"statfs":{"total":95995035648,"available":95657783296,"internally_reserved":0,"allocated":24506368,"data_stored":24113816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:43:03 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":1.2969999999999999,"15min":0.90100000000000002},"min":{"1min":0.182,"5min":0.182,"15min":0.17499999999999999},"max":{"1min":3.5880000000000001,"5min":16.478000000000002,"15min":16.478000000000002},"last":2.9910000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.359,"15min":1.1240000000000001},"min":{"1min":0.20399999999999999,"5min":0.188,"15min":0.188},"max":{"1min":3.3860000000000001,"5min":13.422000000000001,"15min":13.422000000000001},"last":2.7709999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:43:32 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":1.2350000000000001,"15min":1.089},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":5.2510000000000003,"5min":13.638999999999999,"15min":13.638999999999999},"last":0.27400000000000002},{"interface":"front","average":{"1min":1.653,"5min":1.516,"15min":1.284},"min":{"1min":0.224,"5min":0.21199999999999999,"15min":0.19500000000000001},"max":{"1min":5.1500000000000004,"5min":13.134,"15min":13.134},"last":2.8010000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:42:48 2024","interfaces":[{"interface":"back","average":{"1min":2.0859999999999999,"5min":1.7869999999999999,"15min":1.331},"min":{"1min":0.22900000000000001,"5min":0.217,"15min":0.217},"max":{"1min":5.0990000000000002,"5min":13.776,"15min":14.507999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":1.105,"5min":1.917,"15min":1.2989999999999999},"min":{"1min":0.24199999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":4.5270000000000001,"5min":18.759,"15min":18.759},"last":2.9289999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:43:27 2024","interfaces":[{"interface":"back","average":{"1min":2.6899999999999999,"5min":2.0169999999999999,"15min":1.2789999999999999},"min":{"1min":0.33400000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":9.3900000000000006,"5min":13.278,"15min":13.278},"last":3.5129999999999999},{"interface":"front","average":{"1min":1.5569999999999999,"5min":1.7130000000000001,"15min":1.1379999999999999},"min":{"1min":0.38600000000000001,"5min":0.33200000000000002,"15min":0.255},"max":{"1min":8.3889999999999993,"5min":8.4789999999999992,"15min":8.9450000000000003},"last":3.504}]},{"osd":5,"last update":"Mon Feb 19 21:42:48 2024","interfaces":[{"interface":"back","average":{"1min":1.7370000000000001,"5min":2.2650000000000001,"15min":1.397},"min":{"1min":0.30299999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":4.4169999999999998,"5min":42.799999999999997,"15min":42.799999999999997},"last":2.7330000000000001},{"interface":"front","average":{"1min":2.573,"5min":2.5070000000000001,"15min":1.3939999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":9.1600000000000001,"5min":42.695,"15min":42.695},"last":0.51700000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:43:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.5900000000000001,"15min":1.226},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.27900000000000003},"max":{"1min":4.8630000000000004,"5min":8.9039999999999999,"15min":42.777000000000001},"last":2.8690000000000002},{"interface":"front","average":{"1min":2.6139999999999999,"5min":2.278,"15min":1.417},"min":{"1min":0.375,"5min":0.32300000000000001,"15min":0.28599999999999998},"max":{"1min":6.0519999999999996,"5min":8.2590000000000003,"15min":9.7629999999999999},"last":2.702}]},{"osd":7,"last update":"Mon Feb 19 21:43:32 2024","interfaces":[{"interface":"back","average":{"1min":2.496,"5min":1.8520000000000001,"15min":1.389},"min":{"1min":0.45900000000000002,"5min":0.33700000000000002,"15min":0.31},"max":{"1min":6.4740000000000002,"5min":13.26,"15min":42.758000000000003},"last":1.353},{"interface":"front","average":{"1min":1.6990000000000001,"5min":1.6759999999999999,"15min":1.327},"min":{"1min":0.38400000000000001,"5min":0.371,"15min":0.33200000000000002},"max":{"1min":6.4640000000000004,"5min":8.5340000000000007,"15min":42.718000000000004},"last":2.9630000000000001}]}]},{"osd":2,"up_from":0,"seq":77309411495,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":26,"seq":111669149858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":306400,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93438752,"statfs":{"total":95995035648,"available":95681282048,"internally_reserved":0,"allocated":1007616,"data_stored":665590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":1.3080000000000001,"15min":1.103},"min":{"1min":0.19,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":4.952,"5min":11.292,"15min":17.992000000000001},"last":0.26800000000000002},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.9039999999999999,"15min":1.431},"min":{"1min":0.22500000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":4.9370000000000003,"5min":46.654000000000003,"15min":46.654000000000003},"last":0.35199999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:42:58 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.1779999999999999,"15min":0.91800000000000004},"min":{"1min":0.22,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":5.4039999999999999,"5min":9.6289999999999996,"15min":9.9700000000000006},"last":0.373},{"interface":"front","average":{"1min":0.77300000000000002,"5min":1.2889999999999999,"15min":1.153},"min":{"1min":0.22700000000000001,"5min":0.20799999999999999,"15min":0.185},"max":{"1min":3.5110000000000001,"5min":8.6890000000000001,"15min":13.135999999999999},"last":0.30299999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":1.411,"15min":1.143},"min":{"1min":0.26900000000000002,"5min":0.22900000000000001,"15min":0.224},"max":{"1min":3.5459999999999998,"5min":6.8879999999999999,"15min":11.175000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":1.6870000000000001,"5min":2.0219999999999998,"15min":1.3660000000000001},"min":{"1min":0.23799999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":12.723000000000001,"5min":45.831000000000003,"15min":45.831000000000003},"last":0.38800000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:43:23 2024","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":1.387,"15min":1.01},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":5.6459999999999999,"5min":7.1660000000000004,"15min":7.1660000000000004},"last":0.499},{"interface":"front","average":{"1min":2.319,"5min":1.96,"15min":1.3120000000000001},"min":{"1min":0.31,"5min":0.28699999999999998,"15min":0.26800000000000002},"max":{"1min":7.8890000000000002,"5min":9.6720000000000006,"15min":11.093},"last":0.52300000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:43:42 2024","interfaces":[{"interface":"back","average":{"1min":1.9890000000000001,"5min":1.758,"15min":1.1579999999999999},"min":{"1min":0.30299999999999999,"5min":0.29099999999999998,"15min":0.27100000000000002},"max":{"1min":9.3650000000000002,"5min":12.257,"15min":12.257},"last":0.59499999999999997},{"interface":"front","average":{"1min":2.3250000000000002,"5min":2.0600000000000001,"15min":1.3899999999999999},"min":{"1min":0.33200000000000002,"5min":0.307,"15min":0.27800000000000002},"max":{"1min":7.8460000000000001,"5min":8.5809999999999995,"15min":11.128},"last":0.49299999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:43:10 2024","interfaces":[{"interface":"back","average":{"1min":1.6080000000000001,"5min":1.365,"15min":1.052},"min":{"1min":0.31900000000000001,"5min":0.309,"15min":0.30599999999999999},"max":{"1min":4.8929999999999998,"5min":6.6029999999999998,"15min":17.443999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":2.4460000000000002,"5min":1.907,"15min":1.3380000000000001},"min":{"1min":0.41699999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":13.942,"5min":13.942,"15min":18.219000000000001},"last":0.57299999999999995}]},{"osd":7,"last update":"Mon Feb 19 21:43:33 2024","interfaces":[{"interface":"back","average":{"1min":2.6699999999999999,"5min":2.0219999999999998,"15min":1.5529999999999999},"min":{"1min":0.34499999999999997,"5min":0.318,"15min":0.318},"max":{"1min":9.0259999999999998,"5min":10.035,"15min":45.777999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":1.7130000000000001,"5min":1.482,"15min":1.073},"min":{"1min":0.46899999999999997,"5min":0.35399999999999998,"15min":0.35099999999999998},"max":{"1min":5.7060000000000004,"5min":6.585,"15min":6.585},"last":0.56100000000000005}]}]},{"osd":4,"up_from":32,"seq":137438953627,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":306444,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93438708,"statfs":{"total":95995035648,"available":95681236992,"internally_reserved":0,"allocated":1052672,"data_stored":666813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:43:21 2024","interfaces":[{"interface":"back","average":{"1min":3.0579999999999998,"5min":2.4359999999999999,"15min":1.3009999999999999},"min":{"1min":0.40999999999999998,"5min":0.219,"15min":0.219},"max":{"1min":11.541,"5min":40.664000000000001,"15min":40.664000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":1.698,"5min":2.3199999999999998,"15min":1.383},"min":{"1min":0.23799999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":5.3159999999999998,"5min":41.046999999999997,"15min":41.046999999999997},"last":0.48799999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:43:21 2024","interfaces":[{"interface":"back","average":{"1min":3.6909999999999998,"5min":2.0750000000000002,"15min":1.1319999999999999},"min":{"1min":0.41399999999999998,"5min":0.22,"15min":0.22},"max":{"1min":11.755000000000001,"5min":13.254,"15min":13.254},"last":0.38},{"interface":"front","average":{"1min":1.655,"5min":1.5980000000000001,"15min":1.046},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":4.3460000000000001,"5min":7.593,"15min":15.411},"last":0.47199999999999998}]},{"osd":2,"last update":"Mon Feb 19 21:43:21 2024","interfaces":[{"interface":"back","average":{"1min":1.9470000000000001,"5min":1.8919999999999999,"15min":1.1479999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.27100000000000002},"max":{"1min":4.7039999999999997,"5min":16.788,"15min":16.788},"last":0.45300000000000001},{"interface":"front","average":{"1min":1.8799999999999999,"5min":2.0369999999999999,"15min":1.3799999999999999},"min":{"1min":0.35099999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.0190000000000001,"5min":18.452999999999999,"15min":20.995999999999999},"last":0.434}]},{"osd":3,"last update":"Mon Feb 19 21:43:21 2024","interfaces":[{"interface":"back","average":{"1min":2.0230000000000001,"5min":2.016,"15min":1.282},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.316},"max":{"1min":6.0730000000000004,"5min":10.970000000000001,"15min":15.914999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":3.512,"5min":2.2069999999999999,"15min":1.2430000000000001},"min":{"1min":0.34200000000000003,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":11.662000000000001,"5min":13.321,"15min":13.321},"last":0.44}]},{"osd":5,"last update":"Mon Feb 19 21:43:02 2024","interfaces":[{"interface":"back","average":{"1min":3.21,"5min":2.0550000000000002,"15min":0.99099999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.23499999999999999},"max":{"1min":18.916,"5min":18.916,"15min":18.916},"last":0.36799999999999999},{"interface":"front","average":{"1min":5.476,"5min":2.6779999999999999,"15min":1.2070000000000001},"min":{"1min":0.28899999999999998,"5min":0.27300000000000002,"15min":0.26100000000000001},"max":{"1min":13.603999999999999,"5min":14.840999999999999,"15min":14.840999999999999},"last":0.33200000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:43:21 2024","interfaces":[{"interface":"back","average":{"1min":1.7010000000000001,"5min":2.1259999999999999,"15min":1.0489999999999999},"min":{"1min":0.316,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":7.5949999999999998,"5min":13.27,"15min":13.27},"last":0.36099999999999999},{"interface":"front","average":{"1min":3.3690000000000002,"5min":2.1429999999999998,"15min":1.0589999999999999},"min":{"1min":0.32800000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":14.127000000000001,"5min":14.127000000000001,"15min":14.127000000000001},"last":0.39600000000000002}]},{"osd":7,"last update":"Mon Feb 19 21:43:41 2024","interfaces":[{"interface":"back","average":{"1min":2.8650000000000002,"5min":2.1200000000000001,"15min":1.087},"min":{"1min":0.35799999999999998,"5min":0.30399999999999999,"15min":0.28899999999999998},"max":{"1min":14.093,"5min":14.093,"15min":14.093},"last":0.42299999999999999},{"interface":"front","average":{"1min":2.5499999999999998,"5min":2.4990000000000001,"15min":1.2230000000000001},"min":{"1min":0.35799999999999998,"5min":0.33500000000000002,"15min":0.32900000000000001},"max":{"1min":12.808999999999999,"5min":12.808999999999999,"15min":12.808999999999999},"last":0.39200000000000002}]}]},{"osd":5,"up_from":38,"seq":163208757399,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":302368,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93442784,"statfs":{"total":95995035648,"available":95685410816,"internally_reserved":0,"allocated":1073152,"data_stored":667872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:42:51 2024","interfaces":[{"interface":"back","average":{"1min":1.556,"5min":1.52,"15min":1.1160000000000001},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":4.9820000000000002,"5min":10.044,"15min":20.550999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":2.5569999999999999,"5min":1.988,"15min":1.208},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":9.4329999999999998,"5min":9.9390000000000001,"15min":20.879000000000001},"last":0.50600000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:42:51 2024","interfaces":[{"interface":"back","average":{"1min":2.827,"5min":2.036,"15min":1.145},"min":{"1min":0.28499999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":9.4670000000000005,"5min":10.42,"15min":10.42},"last":0.48599999999999999},{"interface":"front","average":{"1min":1.6739999999999999,"5min":1.6180000000000001,"15min":1.087},"min":{"1min":0.27400000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":6.4880000000000004,"5min":10.021000000000001,"15min":10.316000000000001},"last":0.55900000000000005}]},{"osd":2,"last update":"Mon Feb 19 21:42:51 2024","interfaces":[{"interface":"back","average":{"1min":2.23,"5min":1.7170000000000001,"15min":1.171},"min":{"1min":0.32100000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":9.2629999999999999,"5min":9.2629999999999999,"15min":20.186},"last":0.53900000000000003},{"interface":"front","average":{"1min":2.3809999999999998,"5min":1.9219999999999999,"15min":1.2330000000000001},"min":{"1min":0.34799999999999998,"5min":0.29899999999999999,"15min":0.23200000000000001},"max":{"1min":9.4909999999999997,"5min":9.4909999999999997,"15min":20.175000000000001},"last":0.46200000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:42:51 2024","interfaces":[{"interface":"back","average":{"1min":2.3450000000000002,"5min":1.9670000000000001,"15min":1.335},"min":{"1min":0.28999999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":9.3629999999999995,"5min":12.021000000000001,"15min":20.146999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":3.0379999999999998,"5min":2.339,"15min":1.502},"min":{"1min":0.42199999999999999,"5min":0.36499999999999999,"15min":0.35499999999999998},"max":{"1min":9.5150000000000006,"5min":9.5150000000000006,"15min":20.120000000000001},"last":0.54800000000000004}]},{"osd":4,"last update":"Mon Feb 19 21:42:51 2024","interfaces":[{"interface":"back","average":{"1min":2.7989999999999999,"5min":1.5229999999999999,"15min":0.81100000000000005},"min":{"1min":0.252,"5min":0.24399999999999999,"15min":0.23999999999999999},"max":{"1min":21.577000000000002,"5min":21.577000000000002,"15min":21.577000000000002},"last":0.38200000000000001},{"interface":"front","average":{"1min":2.5910000000000002,"5min":2.0089999999999999,"15min":0.998},"min":{"1min":0.34699999999999998,"5min":0.26300000000000001,"15min":0.25600000000000001},"max":{"1min":9.3360000000000003,"5min":12.135,"15min":12.135},"last":0.34599999999999997}]},{"osd":6,"last update":"Mon Feb 19 21:43:14 2024","interfaces":[{"interface":"back","average":{"1min":3.2010000000000001,"5min":2.1259999999999999,"15min":1.0549999999999999},"min":{"1min":0.39400000000000002,"5min":0.221,"15min":0.221},"max":{"1min":13.138999999999999,"5min":13.138999999999999,"15min":13.138999999999999},"last":0.313},{"interface":"front","average":{"1min":3.4950000000000001,"5min":2.419,"15min":1.1759999999999999},"min":{"1min":0.39600000000000002,"5min":0.28999999999999998,"15min":0.23599999999999999},"max":{"1min":12.932,"5min":13.532999999999999,"15min":13.532999999999999},"last":0.35699999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:43:44 2024","interfaces":[{"interface":"back","average":{"1min":3.629,"5min":2.9100000000000001,"15min":1.383},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.29999999999999999},"max":{"1min":12.038,"5min":12.962,"15min":12.962},"last":0.32300000000000001},{"interface":"front","average":{"1min":1.95,"5min":2.419,"15min":1.21},"min":{"1min":0.311,"5min":0.311,"15min":0.29099999999999998},"max":{"1min":5.9580000000000002,"5min":17.759,"15min":17.759},"last":0.41499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":2118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3932160,"data_stored":3932160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":219545600,"data_stored":219545600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:43:47.911 INFO:tasks.cephadm.ceph_manager.ceph:decrease pool size by 10 2024-02-19T21:43:47.911 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool set default.rgw.control pg_num 22 2024-02-19T21:43:47.973 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:43:48.000 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:48.138 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:43:48.204 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:47.034612+0000 mgr.y (mgr.14514) 433 : cluster [DBG] pgmap v511: 138 pgs: 138 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 39 op/s 2024-02-19T21:43:48.204 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:47.034612+0000 mgr.y (mgr.14514) 433 : cluster [DBG] pgmap v511: 138 pgs: 138 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 39 op/s 2024-02-19T21:43:48.205 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:43:48.209 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:48.210 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:43:48.310 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:43:48.337 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:48.356 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:43:48.359 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:48.360 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:43:48.381 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:47.034612+0000 mgr.y (mgr.14514) 433 : cluster [DBG] pgmap v511: 138 pgs: 138 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 39 op/s 2024-02-19T21:43:48.460 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:43:48.478 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:43:48.488 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:48.495 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:43:48.501 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:43:48.513 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:43:48.516 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:48.516 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:43:48.523 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:43:48.541 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:43:48.559 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:43:48.577 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:43:48.594 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:43:48.612 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:43:48.613 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:43:48.613 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:43:48.614 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:43:48.614 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:43:48.614 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:43:48.614 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:43:48.614 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:43:48.614 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:43:48.617 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:43:48.644 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:48.767 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:43:48.770 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:48.771 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:43:48.872 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:43:48.901 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:48.918 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset noscrub 2024-02-19T21:43:48.929 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:43:48.931 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:48.932 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:43:49.033 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:43:49.060 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:49.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:48.453529+0000 mon.c (mon.2) 58 : audit [DBG] from='client.? 172.21.15.80:0/292876884' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:43:49.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:48.955615+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:43:49.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:48.453529+0000 mon.c (mon.2) 58 : audit [DBG] from='client.? 172.21.15.80:0/292876884' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:43:49.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:48.955615+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:43:49.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:48.453529+0000 mon.c (mon.2) 58 : audit [DBG] from='client.? 172.21.15.80:0/292876884' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:43:49.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:48.955615+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:43:50.022 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:43:50.022 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:43:50.208 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:43:50.210 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:50.211 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:43:50.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:49.034965+0000 mgr.y (mgr.14514) 434 : cluster [DBG] pgmap v512: 138 pgs: 138 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 646 B/s rd, 0 B/s wr, 29 op/s 2024-02-19T21:43:50.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:50.099796+0000 mon.a (mon.0) 1217 : cluster [DBG] osdmap e252: 8 total, 8 up, 7 in 2024-02-19T21:43:50.312 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:43:50.340 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:50.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:49.034965+0000 mgr.y (mgr.14514) 434 : cluster [DBG] pgmap v512: 138 pgs: 138 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 646 B/s rd, 0 B/s wr, 29 op/s 2024-02-19T21:43:50.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:50.099796+0000 mon.a (mon.0) 1217 : cluster [DBG] osdmap e252: 8 total, 8 up, 7 in 2024-02-19T21:43:50.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:49.034965+0000 mgr.y (mgr.14514) 434 : cluster [DBG] pgmap v512: 138 pgs: 138 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 646 B/s rd, 0 B/s wr, 29 op/s 2024-02-19T21:43:50.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:50.099796+0000 mon.a (mon.0) 1217 : cluster [DBG] osdmap e252: 8 total, 8 up, 7 in 2024-02-19T21:43:50.689 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:43:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:43:50.707 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.5 dump_ops_in_flight 2024-02-19T21:43:50.974 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:43:51.096 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:43:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:43:50] "GET /metrics HTTP/1.1" 200 175893 "" "Prometheus/2.33.4" 2024-02-19T21:43:51.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:50.481744+0000 mgr.y (mgr.14514) 435 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:43:51.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:50.481744+0000 mgr.y (mgr.14514) 435 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:43:51.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:50.481744+0000 mgr.y (mgr.14514) 435 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:43:51.875 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:43:52.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:51.035492+0000 mgr.y (mgr.14514) 436 : cluster [DBG] pgmap v514: 138 pgs: 138 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 9 op/s 2024-02-19T21:43:52.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:51.035492+0000 mgr.y (mgr.14514) 436 : cluster [DBG] pgmap v514: 138 pgs: 138 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 9 op/s 2024-02-19T21:43:52.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:51.035492+0000 mgr.y (mgr.14514) 436 : cluster [DBG] pgmap v514: 138 pgs: 138 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 9 op/s 2024-02-19T21:43:52.922 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:43:52.922 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:43:53.907 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.5 dump_blocked_ops 2024-02-19T21:43:54.175 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:43:54.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:53.035940+0000 mgr.y (mgr.14514) 437 : cluster [DBG] pgmap v515: 138 pgs: 138 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 644 B/s rd, 0 B/s wr, 4 op/s 2024-02-19T21:43:54.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:53.479096+0000 osd.7 (osd.7) 161 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:43:54.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:53.479182+0000 osd.7 (osd.7) 162 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:43:54.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:53.035940+0000 mgr.y (mgr.14514) 437 : cluster [DBG] pgmap v515: 138 pgs: 138 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 644 B/s rd, 0 B/s wr, 4 op/s 2024-02-19T21:43:54.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:53.479096+0000 osd.7 (osd.7) 161 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:43:54.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:53.479182+0000 osd.7 (osd.7) 162 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:43:54.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:53.035940+0000 mgr.y (mgr.14514) 437 : cluster [DBG] pgmap v515: 138 pgs: 138 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 644 B/s rd, 0 B/s wr, 4 op/s 2024-02-19T21:43:54.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:53.479096+0000 osd.7 (osd.7) 161 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:43:54.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:53.479182+0000 osd.7 (osd.7) 162 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:43:55.454 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:54.122525+0000 mon.a (mon.0) 1218 : cluster [DBG] osdmap e253: 8 total, 8 up, 7 in 2024-02-19T21:43:55.454 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:55.101141+0000 mon.a (mon.0) 1219 : cluster [DBG] osdmap e254: 8 total, 8 up, 7 in 2024-02-19T21:43:55.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:54.122525+0000 mon.a (mon.0) 1218 : cluster [DBG] osdmap e253: 8 total, 8 up, 7 in 2024-02-19T21:43:55.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:55.101141+0000 mon.a (mon.0) 1219 : cluster [DBG] osdmap e254: 8 total, 8 up, 7 in 2024-02-19T21:43:55.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:54.122525+0000 mon.a (mon.0) 1218 : cluster [DBG] osdmap e253: 8 total, 8 up, 7 in 2024-02-19T21:43:55.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:55.101141+0000 mon.a (mon.0) 1219 : cluster [DBG] osdmap e254: 8 total, 8 up, 7 in 2024-02-19T21:43:55.761 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:43:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:43:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:43:55.949 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:43:55.975 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:43:55.979 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:55.980 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:43:56.069 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:43:56.069 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:43:56.081 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:43:56.112 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:56.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:55.036621+0000 mgr.y (mgr.14514) 438 : cluster [DBG] pgmap v517: 138 pgs: 138 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:43:56.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:55.036621+0000 mgr.y (mgr.14514) 438 : cluster [DBG] pgmap v517: 138 pgs: 138 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:43:56.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:55.036621+0000 mgr.y (mgr.14514) 438 : cluster [DBG] pgmap v517: 138 pgs: 138 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:43:56.461 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:43:56.464 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:56.465 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:43:56.565 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:43:56.597 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:56.839 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.5 dump_historic_ops 2024-02-19T21:43:56.846 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:43:56.849 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:56.849 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:43:56.950 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:43:56.978 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:57.005 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:43:57.008 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:57.008 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:43:57.109 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:43:57.126 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:43:57.137 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:57.159 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:43:57.163 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:57.163 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:43:57.264 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:43:57.290 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:57.387 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:43:57.390 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:57.390 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:43:57.405 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:43:57.491 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:43:57.520 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:58.171 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:43:58.174 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:58.175 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:43:58.191 INFO:teuthology.orchestra.run.smithi080.stderr:set pool 5 pg_num to 22 2024-02-19T21:43:58.275 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:43:58.305 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:58.494 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:57.037120+0000 mgr.y (mgr.14514) 439 : cluster [DBG] pgmap v519: 138 pgs: 138 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 737 B/s rd, 0 op/s 2024-02-19T21:43:58.495 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:57.580302+0000 mon.c (mon.2) 59 : audit [INF] from='client.? 172.21.15.80:0/1764147361' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num", "val": "22"}]: dispatch 2024-02-19T21:43:58.495 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:57.580610+0000 mon.a (mon.0) 1220 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num", "val": "22"}]: dispatch 2024-02-19T21:43:58.504 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:43:58.507 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:58.508 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:43:58.575 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:57.037120+0000 mgr.y (mgr.14514) 439 : cluster [DBG] pgmap v519: 138 pgs: 138 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 737 B/s rd, 0 op/s 2024-02-19T21:43:58.575 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:57.580302+0000 mon.c (mon.2) 59 : audit [INF] from='client.? 172.21.15.80:0/1764147361' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num", "val": "22"}]: dispatch 2024-02-19T21:43:58.575 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:57.580610+0000 mon.a (mon.0) 1220 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num", "val": "22"}]: dispatch 2024-02-19T21:43:58.575 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:57.037120+0000 mgr.y (mgr.14514) 439 : cluster [DBG] pgmap v519: 138 pgs: 138 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 737 B/s rd, 0 op/s 2024-02-19T21:43:58.575 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:57.580302+0000 mon.c (mon.2) 59 : audit [INF] from='client.? 172.21.15.80:0/1764147361' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num", "val": "22"}]: dispatch 2024-02-19T21:43:58.575 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:57.580610+0000 mon.a (mon.0) 1220 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num", "val": "22"}]: dispatch 2024-02-19T21:43:58.609 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:43:58.636 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:59.006 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_1 2024-02-19T21:43:59.006 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool rm unique_pool_1 unique_pool_1 --yes-i-really-really-mean-it 2024-02-19T21:43:59.067 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:43:59.068 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:43:59.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:58.188393+0000 mon.a (mon.0) 1221 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num", "val": "22"}]': finished 2024-02-19T21:43:59.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:58.188492+0000 mon.a (mon.0) 1222 : cluster [DBG] osdmap e255: 8 total, 8 up, 7 in 2024-02-19T21:43:59.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:43:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:59.038183+0000 mon.a (mon.0) 1223 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pgp_num_actual", "val": "22"}]: dispatch 2024-02-19T21:43:59.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:58.188393+0000 mon.a (mon.0) 1221 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num", "val": "22"}]': finished 2024-02-19T21:43:59.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:58.188492+0000 mon.a (mon.0) 1222 : cluster [DBG] osdmap e255: 8 total, 8 up, 7 in 2024-02-19T21:43:59.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:43:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:59.038183+0000 mon.a (mon.0) 1223 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pgp_num_actual", "val": "22"}]: dispatch 2024-02-19T21:43:59.452 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:58.188393+0000 mon.a (mon.0) 1221 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num", "val": "22"}]': finished 2024-02-19T21:43:59.452 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:58.188492+0000 mon.a (mon.0) 1222 : cluster [DBG] osdmap e255: 8 total, 8 up, 7 in 2024-02-19T21:43:59.452 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:43:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:59.038183+0000 mon.a (mon.0) 1223 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pgp_num_actual", "val": "22"}]: dispatch 2024-02-19T21:43:59.485 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:43:59.487 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:59.487 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:43:59.588 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:43:59.618 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:43:59.786 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:43:59.788 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:43:59.789 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:43:59.795 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.6 dump_ops_in_flight 2024-02-19T21:43:59.889 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:43:59.918 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:00.101 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:44:00.203 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-02-19T21:44:00.456 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:59.037422+0000 mgr.y (mgr.14514) 440 : cluster [DBG] pgmap v521: 138 pgs: 138 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:44:00.456 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:59.186469+0000 mon.a (mon.0) 1224 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pgp_num_actual", "val": "22"}]': finished 2024-02-19T21:44:00.456 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:43:59.186533+0000 mon.a (mon.0) 1225 : cluster [DBG] osdmap e256: 8 total, 8 up, 7 in 2024-02-19T21:44:00.456 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:59.564280+0000 mon.c (mon.2) 60 : audit [INF] from='client.? 172.21.15.80:0/1530927378' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:44:00.456 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:43:59.564672+0000 mon.a (mon.0) 1226 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:44:00.456 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:00.184682+0000 mon.a (mon.0) 1227 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:44:00.456 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:00.193852+0000 mon.a (mon.0) 1228 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:44:00.456 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:00.193914+0000 mon.a (mon.0) 1229 : cluster [DBG] osdmap e257: 8 total, 8 up, 7 in 2024-02-19T21:44:00.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:59.037422+0000 mgr.y (mgr.14514) 440 : cluster [DBG] pgmap v521: 138 pgs: 138 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:44:00.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:59.186469+0000 mon.a (mon.0) 1224 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pgp_num_actual", "val": "22"}]': finished 2024-02-19T21:44:00.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:43:59.186533+0000 mon.a (mon.0) 1225 : cluster [DBG] osdmap e256: 8 total, 8 up, 7 in 2024-02-19T21:44:00.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:59.564280+0000 mon.c (mon.2) 60 : audit [INF] from='client.? 172.21.15.80:0/1530927378' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:44:00.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:43:59.564672+0000 mon.a (mon.0) 1226 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:44:00.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:00.184682+0000 mon.a (mon.0) 1227 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:44:00.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:00.193852+0000 mon.a (mon.0) 1228 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:44:00.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:00.193914+0000 mon.a (mon.0) 1229 : cluster [DBG] osdmap e257: 8 total, 8 up, 7 in 2024-02-19T21:44:00.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:59.037422+0000 mgr.y (mgr.14514) 440 : cluster [DBG] pgmap v521: 138 pgs: 138 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:44:00.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:59.186469+0000 mon.a (mon.0) 1224 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pgp_num_actual", "val": "22"}]': finished 2024-02-19T21:44:00.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:43:59.186533+0000 mon.a (mon.0) 1225 : cluster [DBG] osdmap e256: 8 total, 8 up, 7 in 2024-02-19T21:44:00.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:59.564280+0000 mon.c (mon.2) 60 : audit [INF] from='client.? 172.21.15.80:0/1530927378' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:44:00.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:43:59.564672+0000 mon.a (mon.0) 1226 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:44:00.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:00.184682+0000 mon.a (mon.0) 1227 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:44:00.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:00.193852+0000 mon.a (mon.0) 1228 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:44:00.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:00.193914+0000 mon.a (mon.0) 1229 : cluster [DBG] osdmap e257: 8 total, 8 up, 7 in 2024-02-19T21:44:00.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:44:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:44:01.096 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:44:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:44:00] "GET /metrics HTTP/1.1" 200 175893 "" "Prometheus/2.33.4" 2024-02-19T21:44:01.395 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:44:01.398 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:01.399 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:44:01.499 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:44:01.525 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:00.491710+0000 mgr.y (mgr.14514) 441 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:44:01.526 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:01.030812+0000 mon.c (mon.2) 61 : audit [DBG] from='client.? 172.21.15.80:0/2436854697' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:44:01.526 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:00.491710+0000 mgr.y (mgr.14514) 441 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:44:01.526 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:01.030812+0000 mon.c (mon.2) 61 : audit [DBG] from='client.? 172.21.15.80:0/2436854697' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:44:01.529 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:01.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:00.491710+0000 mgr.y (mgr.14514) 441 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:44:01.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:01.030812+0000 mon.c (mon.2) 61 : audit [DBG] from='client.? 172.21.15.80:0/2436854697' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:44:01.558 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:44:01.558 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:44:01.558 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:44:01.558 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:44:01.558 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:44:01.558 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:44:01.558 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:44:01.558 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:44:01.558 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:44:01.559 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:44:01.559 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:44:01.559 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:44:01.559 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:44:01.559 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:44:01.559 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:44:01.559 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:44:01.741 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:44:02.149 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:44:02.149 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [], 2024-02-19T21:44:02.149 INFO:teuthology.orchestra.run.smithi157.stdout: "num_ops": 0 2024-02-19T21:44:02.149 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:44:02.178 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:44:02.180 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:02.181 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:44:02.281 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:44:02.313 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:02.350 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:44:02.352 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:02.353 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:44:02.438 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:00.543649+0000 osd.1 (osd.1) 157 : cluster [DBG] 4.7 scrub starts 2024-02-19T21:44:02.438 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:00.545410+0000 osd.1 (osd.1) 158 : cluster [DBG] 4.7 scrub ok 2024-02-19T21:44:02.438 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:01.037807+0000 mgr.y (mgr.14514) 442 : cluster [DBG] pgmap v524: 138 pgs: 10 peering, 128 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 862 B/s rd, 0 op/s 2024-02-19T21:44:02.438 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:01.200001+0000 mon.a (mon.0) 1230 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering (PG_AVAILABILITY) 2024-02-19T21:44:02.438 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:01.260642+0000 osd.0 (osd.0) 172 : cluster [DBG] 4.6 scrub starts 2024-02-19T21:44:02.438 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:01.262613+0000 osd.0 (osd.0) 173 : cluster [DBG] 4.6 scrub ok 2024-02-19T21:44:02.438 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:00.543649+0000 osd.1 (osd.1) 157 : cluster [DBG] 4.7 scrub starts 2024-02-19T21:44:02.438 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:00.545410+0000 osd.1 (osd.1) 158 : cluster [DBG] 4.7 scrub ok 2024-02-19T21:44:02.439 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:01.037807+0000 mgr.y (mgr.14514) 442 : cluster [DBG] pgmap v524: 138 pgs: 10 peering, 128 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 862 B/s rd, 0 op/s 2024-02-19T21:44:02.439 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:01.200001+0000 mon.a (mon.0) 1230 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering (PG_AVAILABILITY) 2024-02-19T21:44:02.439 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:01.260642+0000 osd.0 (osd.0) 172 : cluster [DBG] 4.6 scrub starts 2024-02-19T21:44:02.439 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:01.262613+0000 osd.0 (osd.0) 173 : cluster [DBG] 4.6 scrub ok 2024-02-19T21:44:02.453 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:44:02.484 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:02.503 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:44:02.506 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:02.506 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:44:02.527 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:00.543649+0000 osd.1 (osd.1) 157 : cluster [DBG] 4.7 scrub starts 2024-02-19T21:44:02.528 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:00.545410+0000 osd.1 (osd.1) 158 : cluster [DBG] 4.7 scrub ok 2024-02-19T21:44:02.528 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:01.037807+0000 mgr.y (mgr.14514) 442 : cluster [DBG] pgmap v524: 138 pgs: 10 peering, 128 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 862 B/s rd, 0 op/s 2024-02-19T21:44:02.528 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:01.200001+0000 mon.a (mon.0) 1230 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering (PG_AVAILABILITY) 2024-02-19T21:44:02.528 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:01.260642+0000 osd.0 (osd.0) 172 : cluster [DBG] 4.6 scrub starts 2024-02-19T21:44:02.528 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:01.262613+0000 osd.0 (osd.0) 173 : cluster [DBG] 4.6 scrub ok 2024-02-19T21:44:02.606 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:44:02.634 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:02.868 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.6 dump_blocked_ops 2024-02-19T21:44:03.083 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:44:03.085 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:03.086 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:44:03.134 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:44:03.186 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:44:03.214 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:03.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:01.568482+0000 osd.1 (osd.1) 159 : cluster [DBG] 2.d scrub starts 2024-02-19T21:44:03.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:01.569607+0000 osd.1 (osd.1) 160 : cluster [DBG] 2.d scrub ok 2024-02-19T21:44:03.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:02.216587+0000 osd.0 (osd.0) 174 : cluster [DBG] 5.5 scrub starts 2024-02-19T21:44:03.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:02.217421+0000 osd.0 (osd.0) 175 : cluster [DBG] 5.5 scrub ok 2024-02-19T21:44:03.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:02.356781+0000 osd.5 (osd.5) 177 : cluster [DBG] 8.4 scrub starts 2024-02-19T21:44:03.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:02.379420+0000 osd.5 (osd.5) 178 : cluster [DBG] 8.4 scrub ok 2024-02-19T21:44:03.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:01.568482+0000 osd.1 (osd.1) 159 : cluster [DBG] 2.d scrub starts 2024-02-19T21:44:03.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:01.569607+0000 osd.1 (osd.1) 160 : cluster [DBG] 2.d scrub ok 2024-02-19T21:44:03.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:02.216587+0000 osd.0 (osd.0) 174 : cluster [DBG] 5.5 scrub starts 2024-02-19T21:44:03.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:02.217421+0000 osd.0 (osd.0) 175 : cluster [DBG] 5.5 scrub ok 2024-02-19T21:44:03.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:02.356781+0000 osd.5 (osd.5) 177 : cluster [DBG] 8.4 scrub starts 2024-02-19T21:44:03.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:02.379420+0000 osd.5 (osd.5) 178 : cluster [DBG] 8.4 scrub ok 2024-02-19T21:44:03.407 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-19T21:44:03.412 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:44:03.415 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:03.415 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:44:03.516 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:44:03.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:01.568482+0000 osd.1 (osd.1) 159 : cluster [DBG] 2.d scrub starts 2024-02-19T21:44:03.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:01.569607+0000 osd.1 (osd.1) 160 : cluster [DBG] 2.d scrub ok 2024-02-19T21:44:03.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:02.216587+0000 osd.0 (osd.0) 174 : cluster [DBG] 5.5 scrub starts 2024-02-19T21:44:03.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:02.217421+0000 osd.0 (osd.0) 175 : cluster [DBG] 5.5 scrub ok 2024-02-19T21:44:03.541 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:02.356781+0000 osd.5 (osd.5) 177 : cluster [DBG] 8.4 scrub starts 2024-02-19T21:44:03.541 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:02.379420+0000 osd.5 (osd.5) 178 : cluster [DBG] 8.4 scrub ok 2024-02-19T21:44:03.542 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:03.640 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:44:03.643 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:03.644 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:44:03.744 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:44:03.771 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:04.007 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 6, 7] out_osds: [2] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:44:04.007 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:44:04.008 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-02-19T21:44:04.008 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd dump -f json-pretty 2024-02-19T21:44:04.120 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:44:04.225 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:44:04.225 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:03.038301+0000 mgr.y (mgr.14514) 443 : cluster [DBG] pgmap v525: 138 pgs: 10 peering, 128 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:44:04.225 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:03.956415+0000 mon.a (mon.0) 1231 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:44:04.492 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:03.038301+0000 mgr.y (mgr.14514) 443 : cluster [DBG] pgmap v525: 138 pgs: 10 peering, 128 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:44:04.492 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:03.956415+0000 mon.a (mon.0) 1231 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:44:04.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:03.038301+0000 mgr.y (mgr.14514) 443 : cluster [DBG] pgmap v525: 138 pgs: 10 peering, 128 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:44:04.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:03.956415+0000 mon.a (mon.0) 1231 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:44:04.958 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:44:04.999 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:44:05.109 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'unique_pool_1' removed 2024-02-19T21:44:05.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:04.404619+0000 mon.a (mon.0) 1232 : audit [INF] from='client.? 172.21.15.80:0/1032101809' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T21:44:05.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:04.532572+0000 osd.3 (osd.3) 172 : cluster [DBG] 8.0 scrub starts 2024-02-19T21:44:05.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:04.552442+0000 osd.3 (osd.3) 173 : cluster [DBG] 8.0 scrub ok 2024-02-19T21:44:05.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:05.039605+0000 mon.a (mon.0) 1233 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-02-19T21:44:05.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:05.105451+0000 mon.a (mon.0) 1234 : audit [INF] from='client.? 172.21.15.80:0/1032101809' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]': finished 2024-02-19T21:44:05.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:05.105529+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "31"}]': finished 2024-02-19T21:44:05.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:05.105576+0000 mon.a (mon.0) 1236 : cluster [DBG] osdmap e258: 8 total, 8 up, 7 in 2024-02-19T21:44:05.570 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:04.404619+0000 mon.a (mon.0) 1232 : audit [INF] from='client.? 172.21.15.80:0/1032101809' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T21:44:05.570 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:04.532572+0000 osd.3 (osd.3) 172 : cluster [DBG] 8.0 scrub starts 2024-02-19T21:44:05.571 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:04.552442+0000 osd.3 (osd.3) 173 : cluster [DBG] 8.0 scrub ok 2024-02-19T21:44:05.571 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:05.039605+0000 mon.a (mon.0) 1233 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-02-19T21:44:05.571 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:05.105451+0000 mon.a (mon.0) 1234 : audit [INF] from='client.? 172.21.15.80:0/1032101809' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]': finished 2024-02-19T21:44:05.571 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:05.105529+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "31"}]': finished 2024-02-19T21:44:05.571 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:05.105576+0000 mon.a (mon.0) 1236 : cluster [DBG] osdmap e258: 8 total, 8 up, 7 in 2024-02-19T21:44:05.571 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:04.404619+0000 mon.a (mon.0) 1232 : audit [INF] from='client.? 172.21.15.80:0/1032101809' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T21:44:05.571 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:04.532572+0000 osd.3 (osd.3) 172 : cluster [DBG] 8.0 scrub starts 2024-02-19T21:44:05.571 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:04.552442+0000 osd.3 (osd.3) 173 : cluster [DBG] 8.0 scrub ok 2024-02-19T21:44:05.571 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:05.039605+0000 mon.a (mon.0) 1233 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-02-19T21:44:05.571 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:05.105451+0000 mon.a (mon.0) 1234 : audit [INF] from='client.? 172.21.15.80:0/1032101809' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]': finished 2024-02-19T21:44:05.571 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:05.105529+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "31"}]': finished 2024-02-19T21:44:05.572 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:05.105576+0000 mon.a (mon.0) 1236 : cluster [DBG] osdmap e258: 8 total, 8 up, 7 in 2024-02-19T21:44:05.922 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:44:05.923 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:44:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:44:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:44:05.924 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:05.925 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:44:06.025 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:44:06.055 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:06.094 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:44:06.104 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:06.104 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:44:06.205 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:44:06.238 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:06.337 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:44:06.339 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:06.339 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:44:06.440 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:44:06.467 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:06.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:05.029324+0000 osd.7 (osd.7) 163 : cluster [DBG] 2.0 scrub starts 2024-02-19T21:44:06.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:05.032326+0000 osd.7 (osd.7) 164 : cluster [DBG] 2.0 scrub ok 2024-02-19T21:44:06.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:05.038837+0000 mgr.y (mgr.14514) 444 : cluster [DBG] pgmap v526: 138 pgs: 2 peering, 136 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-19T21:44:06.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:05.550301+0000 osd.4 (osd.4) 136 : cluster [DBG] 5.1a scrub starts 2024-02-19T21:44:06.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:05.553183+0000 osd.4 (osd.4) 137 : cluster [DBG] 5.1a scrub ok 2024-02-19T21:44:06.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:06.116259+0000 mon.a (mon.0) 1237 : cluster [DBG] osdmap e259: 8 total, 8 up, 7 in 2024-02-19T21:44:06.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:05.029324+0000 osd.7 (osd.7) 163 : cluster [DBG] 2.0 scrub starts 2024-02-19T21:44:06.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:05.032326+0000 osd.7 (osd.7) 164 : cluster [DBG] 2.0 scrub ok 2024-02-19T21:44:06.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:05.038837+0000 mgr.y (mgr.14514) 444 : cluster [DBG] pgmap v526: 138 pgs: 2 peering, 136 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-19T21:44:06.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:05.550301+0000 osd.4 (osd.4) 136 : cluster [DBG] 5.1a scrub starts 2024-02-19T21:44:06.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:05.553183+0000 osd.4 (osd.4) 137 : cluster [DBG] 5.1a scrub ok 2024-02-19T21:44:06.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:06.116259+0000 mon.a (mon.0) 1237 : cluster [DBG] osdmap e259: 8 total, 8 up, 7 in 2024-02-19T21:44:06.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:05.029324+0000 osd.7 (osd.7) 163 : cluster [DBG] 2.0 scrub starts 2024-02-19T21:44:06.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:05.032326+0000 osd.7 (osd.7) 164 : cluster [DBG] 2.0 scrub ok 2024-02-19T21:44:06.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:05.038837+0000 mgr.y (mgr.14514) 444 : cluster [DBG] pgmap v526: 138 pgs: 2 peering, 136 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-19T21:44:06.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:05.550301+0000 osd.4 (osd.4) 136 : cluster [DBG] 5.1a scrub starts 2024-02-19T21:44:06.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:05.553183+0000 osd.4 (osd.4) 137 : cluster [DBG] 5.1a scrub ok 2024-02-19T21:44:06.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:06.116259+0000 mon.a (mon.0) 1237 : cluster [DBG] osdmap e259: 8 total, 8 up, 7 in 2024-02-19T21:44:06.789 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-02-19T21:44:06.789 INFO:tasks.radosbench:Beginning radosbench... 2024-02-19T21:44:06.789 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_2 2024-02-19T21:44:06.790 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool create unique_pool_2 16 2024-02-19T21:44:06.929 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:44:06.930 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [], 2024-02-19T21:44:06.930 INFO:teuthology.orchestra.run.smithi157.stdout: "complaint_time": 30, 2024-02-19T21:44:06.930 INFO:teuthology.orchestra.run.smithi157.stdout: "num_blocked_ops": 0 2024-02-19T21:44:06.930 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:44:07.703 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.6 dump_historic_ops 2024-02-19T21:44:07.972 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:44:07.999 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:44:07.999 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:44:07.999 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 260, 2024-02-19T21:44:07.999 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "6f763558-cf6d-11ee-95bb-87774f69a715", 2024-02-19T21:44:07.999 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2024-02-19T21:26:16.880265+0000", 2024-02-19T21:44:07.999 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2024-02-19T21:44:07.112534+0000", 2024-02-19T21:44:08.000 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2024-02-19T21:32:14.805693+0000", 2024-02-19T21:44:08.000 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2024-02-19T21:39:38.443319+0000", 2024-02-19T21:44:08.000 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-02-19T21:44:08.000 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5804032, 2024-02-19T21:44:08.000 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2024-02-19T21:44:08.000 INFO:teuthology.orchestra.run.smithi080.stdout: "nodeep-scrub", 2024-02-19T21:44:08.000 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2024-02-19T21:44:08.000 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2024-02-19T21:44:08.000 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2024-02-19T21:44:08.000 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2024-02-19T21:44:08.000 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:44:08.000 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 18, 2024-02-19T21:44:08.000 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2024-02-19T21:44:08.000 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-02-19T21:44:08.001 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2024-02-19T21:44:08.001 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2024-02-19T21:44:08.001 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 8, 2024-02-19T21:44:08.001 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2024-02-19T21:44:08.001 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "luminous", 2024-02-19T21:44:08.001 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "luminous", 2024-02-19T21:44:08.001 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "pacific", 2024-02-19T21:44:08.001 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2024-02-19T21:44:08.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.001 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2024-02-19T21:44:08.001 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "device_health_metrics", 2024-02-19T21:44:08.001 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:30:05.947623+0000", 2024-02-19T21:44:08.001 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:44:08.001 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:44:08.002 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:44:08.002 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:44:08.002 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:44:08.002 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:44:08.002 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:44:08.002 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:44:08.002 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:44:08.002 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:44:08.002 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:44:08.002 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:44:08.002 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 1, 2024-02-19T21:44:08.002 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 1, 2024-02-19T21:44:08.002 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 1, 2024-02-19T21:44:08.003 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 1, 2024-02-19T21:44:08.003 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 1, 2024-02-19T21:44:08.003 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:44:08.003 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:44:08.003 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:44:08.003 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:44:08.003 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:44:08.003 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:44:08.003 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:44:08.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.003 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "74", 2024-02-19T21:44:08.003 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:44:08.003 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:44:08.003 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:44:08.004 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:44:08.004 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:44:08.004 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:44:08.004 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:44:08.004 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:44:08.004 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:44:08.004 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:44:08.004 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:44:08.004 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:44:08.004 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:44:08.004 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:44:08.004 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:44:08.004 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:44:08.004 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:44:08.005 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:44:08.005 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:44:08.005 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:44:08.005 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:44:08.005 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:44:08.005 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:44:08.005 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:44:08.005 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:44:08.005 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:44:08.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.005 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:44:08.005 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:44:08.005 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:44:08.006 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:44:08.006 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:44:08.006 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:44:08.006 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:44:08.006 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:44:08.006 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:44:08.006 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:44:08.006 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:44:08.006 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2024-02-19T21:44:08.006 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_max": 32, 2024-02-19T21:44:08.006 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 1 2024-02-19T21:44:08.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.006 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:44:08.006 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_devicehealth": {} 2024-02-19T21:44:08.007 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.007 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 2, 2024-02-19T21:44:08.007 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": ".rgw.root", 2024-02-19T21:44:08.007 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:22.082250+0000", 2024-02-19T21:44:08.007 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:44:08.007 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:44:08.007 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:44:08.007 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:44:08.007 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:44:08.007 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:44:08.007 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:44:08.007 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:44:08.008 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:44:08.008 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:44:08.008 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:44:08.008 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:44:08.008 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:44:08.008 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:44:08.008 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:44:08.008 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:44:08.008 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:44:08.008 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:44:08.008 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:44:08.008 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:44:08.008 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:44:08.009 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:44:08.009 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:44:08.009 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:44:08.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.009 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "60", 2024-02-19T21:44:08.009 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:44:08.009 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:44:08.009 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:44:08.009 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:44:08.009 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:44:08.009 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:44:08.009 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:44:08.009 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:44:08.009 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:44:08.010 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:44:08.010 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:44:08.010 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:44:08.010 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:44:08.010 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:44:08.010 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:44:08.010 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:44:08.010 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:44:08.010 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:44:08.010 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:44:08.010 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:44:08.010 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:44:08.010 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:44:08.010 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:44:08.011 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:44:08.011 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:44:08.011 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:44:08.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.011 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:44:08.011 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:44:08.011 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:44:08.011 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:44:08.011 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:44:08.011 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:44:08.011 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:44:08.011 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:44:08.011 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:44:08.012 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:44:08.012 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:44:08.012 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:44:08.012 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:44:08.012 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:44:08.012 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.012 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 3, 2024-02-19T21:44:08.012 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "iscsi", 2024-02-19T21:44:08.012 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:22.333164+0000", 2024-02-19T21:44:08.012 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:44:08.012 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:44:08.013 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:44:08.013 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:44:08.013 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:44:08.013 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:44:08.013 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:44:08.013 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:44:08.013 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:44:08.013 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:44:08.013 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:44:08.013 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:44:08.013 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 3, 2024-02-19T21:44:08.013 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 3, 2024-02-19T21:44:08.013 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 3, 2024-02-19T21:44:08.013 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 3, 2024-02-19T21:44:08.014 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 3, 2024-02-19T21:44:08.014 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:44:08.014 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:44:08.014 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:44:08.014 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:44:08.014 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:44:08.014 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:44:08.014 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:44:08.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.014 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "62", 2024-02-19T21:44:08.014 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:44:08.014 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:44:08.014 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:44:08.014 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:44:08.015 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:44:08.015 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:44:08.015 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:44:08.015 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:44:08.015 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:44:08.015 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:44:08.015 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:44:08.015 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:44:08.015 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:44:08.015 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:44:08.015 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:44:08.015 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:44:08.015 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:44:08.015 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:44:08.016 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:44:08.016 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:44:08.016 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:44:08.016 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:44:08.016 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:44:08.016 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:44:08.016 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:44:08.016 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:44:08.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.017 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:44:08.017 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:44:08.017 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:44:08.017 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:44:08.017 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:44:08.017 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:44:08.017 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:44:08.017 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:44:08.017 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:44:08.017 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:44:08.017 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:44:08.017 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:44:08.017 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:44:08.017 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2024-02-19T21:44:08.018 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.018 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 4, 2024-02-19T21:44:08.018 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.log", 2024-02-19T21:44:08.018 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:23.632615+0000", 2024-02-19T21:44:08.018 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:44:08.018 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:44:08.018 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:44:08.018 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:44:08.018 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:44:08.018 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:44:08.018 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:44:08.018 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:44:08.018 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:44:08.019 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:44:08.019 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:44:08.019 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:44:08.019 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:44:08.019 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:44:08.019 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:44:08.019 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:44:08.019 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:44:08.019 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:44:08.019 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:44:08.019 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:44:08.019 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:44:08.019 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:44:08.020 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:44:08.020 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:44:08.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.020 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "62", 2024-02-19T21:44:08.020 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:44:08.020 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:44:08.020 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:44:08.020 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:44:08.020 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:44:08.020 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:44:08.020 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:44:08.020 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:44:08.020 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:44:08.020 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:44:08.020 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:44:08.021 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:44:08.021 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:44:08.021 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:44:08.021 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:44:08.021 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:44:08.021 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:44:08.021 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:44:08.021 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:44:08.021 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:44:08.021 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:44:08.021 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:44:08.021 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:44:08.021 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:44:08.021 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:44:08.022 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:44:08.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.022 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:44:08.022 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:44:08.022 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:44:08.022 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:44:08.022 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:44:08.022 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:44:08.022 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:44:08.022 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:44:08.022 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:44:08.022 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:44:08.022 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:44:08.022 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:44:08.022 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:44:08.022 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:44:08.023 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.023 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 5, 2024-02-19T21:44:08.023 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.control", 2024-02-19T21:44:08.023 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:25.600876+0000", 2024-02-19T21:44:08.023 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:44:08.023 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:44:08.023 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:44:08.023 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:44:08.023 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:44:08.023 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:44:08.023 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:44:08.023 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:44:08.023 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:44:08.024 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:44:08.024 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:44:08.024 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:44:08.024 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 31, 2024-02-19T21:44:08.024 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 22, 2024-02-19T21:44:08.024 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 22, 2024-02-19T21:44:08.024 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 22, 2024-02-19T21:44:08.024 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 31, 2024-02-19T21:44:08.024 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:44:08.024 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "5.1f", 2024-02-19T21:44:08.024 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 260, 2024-02-19T21:44:08.024 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 259, 2024-02-19T21:44:08.024 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 259, 2024-02-19T21:44:08.025 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "257'10", 2024-02-19T21:44:08.025 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:44:08.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.025 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "260", 2024-02-19T21:44:08.025 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:44:08.025 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "260", 2024-02-19T21:44:08.025 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "258", 2024-02-19T21:44:08.025 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:44:08.025 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:44:08.025 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:44:08.025 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:44:08.025 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:44:08.025 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:44:08.025 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:44:08.025 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:44:08.026 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:44:08.026 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:44:08.026 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:44:08.026 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:44:08.026 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:44:08.026 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:44:08.026 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:44:08.026 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:44:08.026 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:44:08.026 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:44:08.026 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:44:08.026 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:44:08.026 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:44:08.026 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:44:08.026 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:44:08.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.027 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:44:08.027 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:44:08.027 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:44:08.027 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:44:08.027 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:44:08.027 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:44:08.027 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:44:08.027 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:44:08.027 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:44:08.027 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:44:08.027 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:44:08.027 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:44:08.027 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:44:08.027 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:44:08.027 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.028 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 6, 2024-02-19T21:44:08.028 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.meta", 2024-02-19T21:44:08.028 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:27.661242+0000", 2024-02-19T21:44:08.028 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:44:08.028 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:44:08.028 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:44:08.028 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:44:08.028 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:44:08.028 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:44:08.028 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:44:08.028 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:44:08.028 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:44:08.028 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:44:08.029 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:44:08.029 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:44:08.029 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 22, 2024-02-19T21:44:08.029 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 22, 2024-02-19T21:44:08.029 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 22, 2024-02-19T21:44:08.029 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 22, 2024-02-19T21:44:08.029 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 22, 2024-02-19T21:44:08.029 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:44:08.029 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "6.16", 2024-02-19T21:44:08.029 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 243, 2024-02-19T21:44:08.029 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 242, 2024-02-19T21:44:08.029 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 242, 2024-02-19T21:44:08.029 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:44:08.029 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:44:08.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.029 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "243", 2024-02-19T21:44:08.030 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:44:08.030 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "243", 2024-02-19T21:44:08.030 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "241", 2024-02-19T21:44:08.030 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:44:08.030 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:44:08.030 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:44:08.030 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:44:08.030 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:44:08.030 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:44:08.030 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:44:08.030 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:44:08.030 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:44:08.030 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:44:08.030 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:44:08.030 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:44:08.030 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:44:08.031 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:44:08.031 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:44:08.031 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:44:08.031 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:44:08.031 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:44:08.031 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:44:08.031 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:44:08.031 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:44:08.031 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:44:08.031 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:44:08.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.031 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:44:08.031 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:44:08.031 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:44:08.031 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:44:08.031 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:44:08.032 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:44:08.032 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:44:08.032 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:44:08.032 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:44:08.032 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:44:08.032 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:44:08.032 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2024-02-19T21:44:08.032 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4 2024-02-19T21:44:08.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.032 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:44:08.032 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:44:08.032 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.032 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.032 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:44:08.033 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:44:08.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.033 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2024-02-19T21:44:08.033 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "a72c63f6-46b3-4202-99da-7b0c92b799a5", 2024-02-19T21:44:08.033 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:44:08.033 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:44:08.033 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:44:08.033 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:44:08.033 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:44:08.033 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:44:08.033 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 8, 2024-02-19T21:44:08.033 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 256, 2024-02-19T21:44:08.033 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:44:08.033 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:44:08.034 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:44:08.034 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.034 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.034 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2024-02-19T21:44:08.034 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:44:08.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.034 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.034 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2024-02-19T21:44:08.034 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:44:08.034 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.034 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.034 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:44:08.034 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.035 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.035 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2024-02-19T21:44:08.035 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:44:08.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.035 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.035 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2024-02-19T21:44:08.035 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:44:08.035 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.035 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.035 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:44:08.035 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.036 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.036 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2024-02-19T21:44:08.036 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:44:08.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.036 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.036 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2024-02-19T21:44:08.036 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:44:08.036 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.036 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.036 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:44:08.036 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.037 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.037 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2024-02-19T21:44:08.037 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:44:08.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.037 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.037 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2024-02-19T21:44:08.037 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:44:08.037 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.037 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.037 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6803/3531298825", 2024-02-19T21:44:08.037 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6805/3531298825", 2024-02-19T21:44:08.037 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6809/3531298825", 2024-02-19T21:44:08.038 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6807/3531298825", 2024-02-19T21:44:08.038 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:44:08.038 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:44:08.038 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:44:08.038 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.038 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2024-02-19T21:44:08.038 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "7d4e170e-b0ca-4e19-be35-4038ca126ee6", 2024-02-19T21:44:08.038 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:44:08.038 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:44:08.038 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:44:08.038 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:44:08.038 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:44:08.038 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:44:08.038 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-02-19T21:44:08.039 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 256, 2024-02-19T21:44:08.039 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:44:08.039 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:44:08.039 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:44:08.039 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.039 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.039 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2024-02-19T21:44:08.039 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:44:08.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.039 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.039 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2024-02-19T21:44:08.039 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:44:08.039 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.039 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.040 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:44:08.040 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.040 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.040 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2024-02-19T21:44:08.040 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:44:08.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.040 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.040 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2024-02-19T21:44:08.040 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:44:08.040 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.040 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.041 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:44:08.041 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.041 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.041 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2024-02-19T21:44:08.041 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:44:08.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.041 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.041 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2024-02-19T21:44:08.041 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:44:08.041 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.041 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.042 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:44:08.042 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.042 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.042 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2024-02-19T21:44:08.042 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:44:08.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.042 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.042 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2024-02-19T21:44:08.042 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:44:08.042 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.042 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.043 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6811/1497235950", 2024-02-19T21:44:08.043 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6813/1497235950", 2024-02-19T21:44:08.043 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6817/1497235950", 2024-02-19T21:44:08.043 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6815/1497235950", 2024-02-19T21:44:08.043 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:44:08.043 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:44:08.043 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:44:08.043 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.043 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2024-02-19T21:44:08.043 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "cf461b67-f3e8-45e9-b2f6-777752ba5574", 2024-02-19T21:44:08.043 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:44:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 0, 2024-02-19T21:44:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 0, 2024-02-19T21:44:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:44:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:44:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:44:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 18, 2024-02-19T21:44:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 144, 2024-02-19T21:44:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:44:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:44:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:44:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2024-02-19T21:44:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:44:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2024-02-19T21:44:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:44:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:44:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2024-02-19T21:44:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:44:08.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.046 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.046 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.046 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2024-02-19T21:44:08.046 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:44:08.046 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.046 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.046 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:44:08.046 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.046 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.046 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.046 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2024-02-19T21:44:08.046 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:44:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2024-02-19T21:44:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:44:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:44:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2024-02-19T21:44:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:44:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2024-02-19T21:44:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:44:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6819/3131848307", 2024-02-19T21:44:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6821/3131848307", 2024-02-19T21:44:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6825/3131848307", 2024-02-19T21:44:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6823/3131848307", 2024-02-19T21:44:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:44:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:44:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:44:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2024-02-19T21:44:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "76318cdd-5fce-4a40-95c9-300d55c34820", 2024-02-19T21:44:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:44:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:44:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 0.4183197021484375, 2024-02-19T21:44:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:44:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:44:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:44:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 26, 2024-02-19T21:44:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 235, 2024-02-19T21:44:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:44:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:44:08.050 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:44:08.050 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.050 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.050 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2024-02-19T21:44:08.050 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:44:08.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.050 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.050 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2024-02-19T21:44:08.050 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:44:08.050 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.051 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.051 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:44:08.051 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.051 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.051 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2024-02-19T21:44:08.051 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:44:08.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.051 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.051 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2024-02-19T21:44:08.051 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:44:08.051 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.052 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.052 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:44:08.052 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.052 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.052 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6832", 2024-02-19T21:44:08.052 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:44:08.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.052 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.052 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6833", 2024-02-19T21:44:08.052 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:44:08.052 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.052 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.053 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:44:08.053 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.053 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.053 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2024-02-19T21:44:08.053 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:44:08.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.053 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.053 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2024-02-19T21:44:08.053 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:44:08.053 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.053 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.053 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6827/2007978078", 2024-02-19T21:44:08.054 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6829/2007978078", 2024-02-19T21:44:08.054 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6833/2007978078", 2024-02-19T21:44:08.054 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6831/2007978078", 2024-02-19T21:44:08.054 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:44:08.054 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:44:08.054 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:44:08.054 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.054 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2024-02-19T21:44:08.054 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "6484964f-3391-4e1d-a56c-813f46124062", 2024-02-19T21:44:08.054 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:44:08.054 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:44:08.054 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:44:08.054 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 0.427398681640625, 2024-02-19T21:44:08.054 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:44:08.055 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:44:08.055 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 32, 2024-02-19T21:44:08.055 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 256, 2024-02-19T21:44:08.055 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:44:08.055 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:44:08.055 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:44:08.055 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.055 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.055 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6800", 2024-02-19T21:44:08.055 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:44:08.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.055 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.056 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6801", 2024-02-19T21:44:08.056 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:44:08.056 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.056 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.056 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:44:08.056 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.056 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.056 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6802", 2024-02-19T21:44:08.056 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:44:08.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.056 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.057 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6803", 2024-02-19T21:44:08.057 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:44:08.057 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.057 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.057 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:44:08.057 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.057 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.057 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6806", 2024-02-19T21:44:08.057 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:44:08.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.057 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.058 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6807", 2024-02-19T21:44:08.058 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:44:08.058 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.058 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.058 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:44:08.058 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.058 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.058 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6804", 2024-02-19T21:44:08.058 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:44:08.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.058 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.058 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6805", 2024-02-19T21:44:08.059 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:44:08.059 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.059 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.059 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6801/1922002860", 2024-02-19T21:44:08.059 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6803/1922002860", 2024-02-19T21:44:08.059 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6807/1922002860", 2024-02-19T21:44:08.059 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6805/1922002860", 2024-02-19T21:44:08.059 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:44:08.059 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:44:08.059 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:44:08.059 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.059 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.059 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2024-02-19T21:44:08.060 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "8c7e0309-8c3b-40b9-99d9-96620e52742f", 2024-02-19T21:44:08.060 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:44:08.060 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:44:08.060 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:44:08.060 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:44:08.060 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:44:08.060 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:44:08.060 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 38, 2024-02-19T21:44:08.060 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 258, 2024-02-19T21:44:08.060 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:44:08.060 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:44:08.060 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:44:08.060 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.061 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.061 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6808", 2024-02-19T21:44:08.061 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:44:08.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.061 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.061 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6809", 2024-02-19T21:44:08.061 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:44:08.061 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.061 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.061 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:44:08.061 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.062 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.062 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6810", 2024-02-19T21:44:08.062 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:44:08.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.062 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.062 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.062 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6811", 2024-02-19T21:44:08.062 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:44:08.062 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.062 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.062 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:44:08.062 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.062 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.063 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.063 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6814", 2024-02-19T21:44:08.063 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:44:08.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.063 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.063 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6815", 2024-02-19T21:44:08.063 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:44:08.063 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.063 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.063 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:44:08.063 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.063 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.063 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6812", 2024-02-19T21:44:08.064 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:44:08.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.064 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.064 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6813", 2024-02-19T21:44:08.064 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:44:08.064 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.064 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.064 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6809/960889603", 2024-02-19T21:44:08.065 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6811/960889603", 2024-02-19T21:44:08.065 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6815/960889603", 2024-02-19T21:44:08.065 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6813/960889603", 2024-02-19T21:44:08.065 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:44:08.065 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:44:08.065 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:44:08.065 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.065 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2024-02-19T21:44:08.065 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "5b7d44a3-197d-482c-bf9e-de5e9013a851", 2024-02-19T21:44:08.065 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:44:08.065 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:44:08.066 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:44:08.066 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:44:08.066 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:44:08.066 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:44:08.066 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 47, 2024-02-19T21:44:08.066 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 220, 2024-02-19T21:44:08.066 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:44:08.066 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:44:08.066 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:44:08.066 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.066 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.066 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6816", 2024-02-19T21:44:08.066 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:44:08.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.067 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.067 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6817", 2024-02-19T21:44:08.067 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:44:08.067 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.067 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.067 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:44:08.067 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.067 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.067 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6818", 2024-02-19T21:44:08.068 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:44:08.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.068 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.068 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6819", 2024-02-19T21:44:08.068 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:44:08.068 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.068 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.068 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:44:08.068 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.068 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.068 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6822", 2024-02-19T21:44:08.068 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:44:08.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.069 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.069 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6823", 2024-02-19T21:44:08.069 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:44:08.069 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.069 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.069 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:44:08.069 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.069 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.069 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6820", 2024-02-19T21:44:08.069 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:44:08.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.070 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.070 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6821", 2024-02-19T21:44:08.070 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:44:08.070 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.070 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.070 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6817/2598265223", 2024-02-19T21:44:08.070 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6819/2598265223", 2024-02-19T21:44:08.070 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6823/2598265223", 2024-02-19T21:44:08.070 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6821/2598265223", 2024-02-19T21:44:08.070 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:44:08.070 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:44:08.070 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:44:08.070 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.071 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2024-02-19T21:44:08.071 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "7e2d0287-928d-40f8-841b-6c2077fc08ac", 2024-02-19T21:44:08.071 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:44:08.071 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:44:08.071 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 0.482391357421875, 2024-02-19T21:44:08.071 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:44:08.071 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:44:08.071 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:44:08.071 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 55, 2024-02-19T21:44:08.071 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 256, 2024-02-19T21:44:08.071 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:44:08.071 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:44:08.071 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:44:08.071 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.072 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.072 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6824", 2024-02-19T21:44:08.072 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:44:08.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.072 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.072 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6825", 2024-02-19T21:44:08.072 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:44:08.072 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.072 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.072 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:44:08.072 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.072 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.073 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6826", 2024-02-19T21:44:08.073 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:44:08.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.073 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.073 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6827", 2024-02-19T21:44:08.073 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:44:08.073 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.073 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.073 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:44:08.073 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.073 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.073 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6830", 2024-02-19T21:44:08.074 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:44:08.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.074 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.074 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6831", 2024-02-19T21:44:08.074 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:44:08.074 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.074 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.074 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:44:08.074 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:44:08.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.074 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:44:08.074 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6828", 2024-02-19T21:44:08.075 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:44:08.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.075 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:44:08.075 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6829", 2024-02-19T21:44:08.075 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:44:08.075 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.075 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.075 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6825/3619345894", 2024-02-19T21:44:08.075 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6827/3619345894", 2024-02-19T21:44:08.075 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6831/3619345894", 2024-02-19T21:44:08.075 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6829/3619345894", 2024-02-19T21:44:08.075 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:44:08.075 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:44:08.076 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:44:08.076 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.076 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.076 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:44:08.076 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2024-02-19T21:44:08.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.076 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2024-02-19T21:44:08.076 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:44:08.076 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:44:08.076 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:44:08.076 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:44:08.076 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:44:08.076 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:43:08.030671+0000", 2024-02-19T21:44:08.076 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:44:08.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.077 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2024-02-19T21:44:08.077 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:44:08.077 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:44:08.077 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:44:08.077 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:44:08.077 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:44:08.077 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:43:10.886776+0000", 2024-02-19T21:44:08.077 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:44:08.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.077 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2024-02-19T21:44:08.077 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:44:08.078 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:44:08.078 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:44:08.078 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:44:08.078 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 65536, 2024-02-19T21:44:08.078 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:43:05.502937+0000", 2024-02-19T21:44:08.078 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:44:08.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.078 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2024-02-19T21:44:08.078 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:44:08.078 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:44:08.078 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:44:08.078 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:44:08.078 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:44:08.079 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:43:09.733227+0000", 2024-02-19T21:44:08.079 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:44:08.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.079 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2024-02-19T21:44:08.079 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:44:08.079 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:44:08.079 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:44:08.079 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:44:08.079 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:44:08.079 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:43:15.385648+0000", 2024-02-19T21:44:08.079 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:44:08.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.079 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2024-02-19T21:44:08.080 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:44:08.080 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:44:08.080 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:44:08.080 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:44:08.080 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:44:08.080 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:42:51.181508+0000", 2024-02-19T21:44:08.080 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:44:08.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.080 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2024-02-19T21:44:08.080 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:44:08.080 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:44:08.080 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:44:08.080 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:44:08.080 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:44:08.081 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:43:15.157722+0000", 2024-02-19T21:44:08.081 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:44:08.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.081 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2024-02-19T21:44:08.081 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:44:08.081 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:44:08.081 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:44:08.081 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:44:08.081 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:44:08.081 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:43:53.479186+0000", 2024-02-19T21:44:08.081 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:44:08.081 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.081 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:44:08.081 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [ 2024-02-19T21:44:08.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.081 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "2.c", 2024-02-19T21:44:08.082 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:44:08.082 INFO:teuthology.orchestra.run.smithi080.stdout: 6, 2024-02-19T21:44:08.082 INFO:teuthology.orchestra.run.smithi080.stdout: 7, 2024-02-19T21:44:08.082 INFO:teuthology.orchestra.run.smithi080.stdout: 2 2024-02-19T21:44:08.082 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.082 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.082 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.1", 2024-02-19T21:44:08.082 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:44:08.082 INFO:teuthology.orchestra.run.smithi080.stdout: 4, 2024-02-19T21:44:08.082 INFO:teuthology.orchestra.run.smithi080.stdout: 2, 2024-02-19T21:44:08.082 INFO:teuthology.orchestra.run.smithi080.stdout: 6 2024-02-19T21:44:08.082 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.082 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.082 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:44:08.082 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [ 2024-02-19T21:44:08.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.083 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.6", 2024-02-19T21:44:08.083 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:44:08.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.083 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:44:08.083 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 5 2024-02-19T21:44:08.083 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.083 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.083 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.e", 2024-02-19T21:44:08.083 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:44:08.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.083 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:44:08.083 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 7 2024-02-19T21:44:08.083 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.084 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.084 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.f", 2024-02-19T21:44:08.084 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:44:08.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.084 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:44:08.084 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 5 2024-02-19T21:44:08.084 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.084 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.084 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.19", 2024-02-19T21:44:08.084 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:44:08.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.084 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:44:08.084 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 7 2024-02-19T21:44:08.085 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.085 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.085 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.1f", 2024-02-19T21:44:08.085 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:44:08.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.085 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:44:08.085 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 7 2024-02-19T21:44:08.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.085 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 6, 2024-02-19T21:44:08.085 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 0 2024-02-19T21:44:08.085 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.086 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.086 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "5.1", 2024-02-19T21:44:08.086 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:44:08.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.086 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 4, 2024-02-19T21:44:08.086 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 6 2024-02-19T21:44:08.086 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.086 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.086 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "5.d", 2024-02-19T21:44:08.086 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:44:08.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.087 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 0, 2024-02-19T21:44:08.087 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 3 2024-02-19T21:44:08.087 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.087 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.087 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "5.13", 2024-02-19T21:44:08.087 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:44:08.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:08.087 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 0, 2024-02-19T21:44:08.087 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 6 2024-02-19T21:44:08.087 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.087 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:08.088 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.088 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:44:08.088 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [], 2024-02-19T21:44:08.088 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2024-02-19T21:44:08.088 INFO:teuthology.orchestra.run.smithi080.stdout: "blocklist": { 2024-02-19T21:44:08.088 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6800/2867197629": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:44:08.088 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/1659656010": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:44:08.088 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6801/2272739550": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:44:08.088 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/867908385": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:44:08.088 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/398750494": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:44:08.088 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/2833137430": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:44:08.088 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/2520755315": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:44:08.088 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6800/2094869828": "2024-02-20T21:26:51.262073+0000", 2024-02-19T21:44:08.089 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6800/2272739550": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:44:08.089 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6801/2094869828": "2024-02-20T21:26:51.262073+0000", 2024-02-19T21:44:08.089 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/2130852198": "2024-02-20T21:26:51.262073+0000", 2024-02-19T21:44:08.089 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6801/2867197629": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:44:08.089 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/1952386920": "2024-02-20T21:26:51.262073+0000" 2024-02-19T21:44:08.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.089 INFO:teuthology.orchestra.run.smithi080.stdout: "range_blocklist": {}, 2024-02-19T21:44:08.089 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2024-02-19T21:44:08.089 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2024-02-19T21:44:08.089 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2024-02-19T21:44:08.089 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2024-02-19T21:44:08.089 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2024-02-19T21:44:08.089 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2024-02-19T21:44:08.089 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2024-02-19T21:44:08.089 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2024-02-19T21:44:08.089 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:08.090 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2024-02-19T21:44:08.090 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2024-02-19T21:44:08.090 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2024-02-19T21:44:08.090 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2024-02-19T21:44:08.090 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {}, 2024-02-19T21:44:08.090 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode": { 2024-02-19T21:44:08.090 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode_enabled": false, 2024-02-19T21:44:08.090 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_bucket_count": 0, 2024-02-19T21:44:08.090 INFO:teuthology.orchestra.run.smithi080.stdout: "degraded_stretch_mode": 0, 2024-02-19T21:44:08.090 INFO:teuthology.orchestra.run.smithi080.stdout: "recovering_stretch_mode": 0, 2024-02-19T21:44:08.090 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode_bucket": 0 2024-02-19T21:44:08.090 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:08.090 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:44:08.277 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:07.039302+0000 mgr.y (mgr.14514) 445 : cluster [DBG] pgmap v529: 122 pgs: 122 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 598 B/s rd, 0 op/s 2024-02-19T21:44:08.278 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:07.116440+0000 mon.a (mon.0) 1238 : cluster [DBG] osdmap e260: 8 total, 8 up, 7 in 2024-02-19T21:44:08.278 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:07.235288+0000 mon.a (mon.0) 1239 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-19T21:44:08.278 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:07.259783+0000 osd.0 (osd.0) 176 : cluster [DBG] 6.10 scrub starts 2024-02-19T21:44:08.278 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:07.280324+0000 osd.0 (osd.0) 177 : cluster [DBG] 6.10 scrub ok 2024-02-19T21:44:08.278 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:07.462247+0000 mon.c (mon.2) 62 : audit [DBG] from='client.? 172.21.15.80:0/2157238546' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-19T21:44:08.278 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:07.578638+0000 osd.3 (osd.3) 174 : cluster [DBG] 4.1b scrub starts 2024-02-19T21:44:08.278 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:07.580112+0000 osd.3 (osd.3) 175 : cluster [DBG] 4.1b scrub ok 2024-02-19T21:44:08.278 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:07.039302+0000 mgr.y (mgr.14514) 445 : cluster [DBG] pgmap v529: 122 pgs: 122 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 598 B/s rd, 0 op/s 2024-02-19T21:44:08.278 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:07.116440+0000 mon.a (mon.0) 1238 : cluster [DBG] osdmap e260: 8 total, 8 up, 7 in 2024-02-19T21:44:08.278 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:07.235288+0000 mon.a (mon.0) 1239 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-19T21:44:08.279 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:07.259783+0000 osd.0 (osd.0) 176 : cluster [DBG] 6.10 scrub starts 2024-02-19T21:44:08.279 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:07.280324+0000 osd.0 (osd.0) 177 : cluster [DBG] 6.10 scrub ok 2024-02-19T21:44:08.279 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:07.462247+0000 mon.c (mon.2) 62 : audit [DBG] from='client.? 172.21.15.80:0/2157238546' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-19T21:44:08.279 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:07.578638+0000 osd.3 (osd.3) 174 : cluster [DBG] 4.1b scrub starts 2024-02-19T21:44:08.279 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:07.580112+0000 osd.3 (osd.3) 175 : cluster [DBG] 4.1b scrub ok 2024-02-19T21:44:08.516 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:07.039302+0000 mgr.y (mgr.14514) 445 : cluster [DBG] pgmap v529: 122 pgs: 122 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 598 B/s rd, 0 op/s 2024-02-19T21:44:08.516 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:07.116440+0000 mon.a (mon.0) 1238 : cluster [DBG] osdmap e260: 8 total, 8 up, 7 in 2024-02-19T21:44:08.516 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:07.235288+0000 mon.a (mon.0) 1239 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-19T21:44:08.516 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:07.259783+0000 osd.0 (osd.0) 176 : cluster [DBG] 6.10 scrub starts 2024-02-19T21:44:08.516 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:07.280324+0000 osd.0 (osd.0) 177 : cluster [DBG] 6.10 scrub ok 2024-02-19T21:44:08.516 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:07.462247+0000 mon.c (mon.2) 62 : audit [DBG] from='client.? 172.21.15.80:0/2157238546' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-19T21:44:08.517 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:07.578638+0000 osd.3 (osd.3) 174 : cluster [DBG] 4.1b scrub starts 2024-02-19T21:44:08.517 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:07.580112+0000 osd.3 (osd.3) 175 : cluster [DBG] 4.1b scrub ok 2024-02-19T21:44:08.685 INFO:tasks.thrashosds.thrasher:j is {'epoch': 260, 'fsid': '6f763558-cf6d-11ee-95bb-87774f69a715', 'created': '2024-02-19T21:26:16.880265+0000', 'modified': '2024-02-19T21:44:07.112534+0000', 'last_up_change': '2024-02-19T21:32:14.805693+0000', 'last_in_change': '2024-02-19T21:39:38.443319+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 18, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 8, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-19T21:30:05.947623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2024-02-19T21:32:22.082250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2024-02-19T21:32:22.333164+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 3, 'pg_placement_num': 3, 'pg_placement_num_target': 3, 'pg_num_target': 3, 'pg_num_pending': 3, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2024-02-19T21:32:23.632615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2024-02-19T21:32:25.600876+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 31, 'pg_placement_num': 22, 'pg_placement_num_target': 22, 'pg_num_target': 22, 'pg_num_pending': 31, 'last_pg_merge_meta': {'source_pgid': '5.1f', 'ready_epoch': 260, 'last_epoch_started': 259, 'last_epoch_clean': 259, 'source_version': "257'10", 'target_version': "0'0"}, 'last_change': '260', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '260', 'last_force_op_resend_preluminous': '258', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2024-02-19T21:32:27.661242+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 22, 'pg_placement_num': 22, 'pg_placement_num_target': 22, 'pg_num_target': 22, 'pg_num_pending': 22, 'last_pg_merge_meta': {'source_pgid': '6.16', 'ready_epoch': 243, 'last_epoch_started': 242, 'last_epoch_clean': 242, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '243', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '243', 'last_force_op_resend_preluminous': '241', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}}], 'osds': [{'osd': 0, 'uuid': 'a72c63f6-46b3-4202-99da-7b0c92b799a5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 256, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6802', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6803', 'nonce': 3531298825}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6804', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6805', 'nonce': 3531298825}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6808', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6809', 'nonce': 3531298825}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6806', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6807', 'nonce': 3531298825}]}, 'public_addr': '172.21.15.80:6803/3531298825', 'cluster_addr': '172.21.15.80:6805/3531298825', 'heartbeat_back_addr': '172.21.15.80:6809/3531298825', 'heartbeat_front_addr': '172.21.15.80:6807/3531298825', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7d4e170e-b0ca-4e19-be35-4038ca126ee6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 256, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6810', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6811', 'nonce': 1497235950}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6812', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6813', 'nonce': 1497235950}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6816', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6817', 'nonce': 1497235950}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6814', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6815', 'nonce': 1497235950}]}, 'public_addr': '172.21.15.80:6811/1497235950', 'cluster_addr': '172.21.15.80:6813/1497235950', 'heartbeat_back_addr': '172.21.15.80:6817/1497235950', 'heartbeat_front_addr': '172.21.15.80:6815/1497235950', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'cf461b67-f3e8-45e9-b2f6-777752ba5574', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 18, 'up_thru': 144, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6818', 'nonce': 3131848307}, {'type': 'v1', 'addr': '172.21.15.80:6819', 'nonce': 3131848307}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6820', 'nonce': 3131848307}, {'type': 'v1', 'addr': '172.21.15.80:6821', 'nonce': 3131848307}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6824', 'nonce': 3131848307}, {'type': 'v1', 'addr': '172.21.15.80:6825', 'nonce': 3131848307}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6822', 'nonce': 3131848307}, {'type': 'v1', 'addr': '172.21.15.80:6823', 'nonce': 3131848307}]}, 'public_addr': '172.21.15.80:6819/3131848307', 'cluster_addr': '172.21.15.80:6821/3131848307', 'heartbeat_back_addr': '172.21.15.80:6825/3131848307', 'heartbeat_front_addr': '172.21.15.80:6823/3131848307', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '76318cdd-5fce-4a40-95c9-300d55c34820', 'up': 1, 'in': 1, 'weight': 0.4183197021484375, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 26, 'up_thru': 235, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6826', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6827', 'nonce': 2007978078}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6828', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6829', 'nonce': 2007978078}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6832', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6833', 'nonce': 2007978078}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6830', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6831', 'nonce': 2007978078}]}, 'public_addr': '172.21.15.80:6827/2007978078', 'cluster_addr': '172.21.15.80:6829/2007978078', 'heartbeat_back_addr': '172.21.15.80:6833/2007978078', 'heartbeat_front_addr': '172.21.15.80:6831/2007978078', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '6484964f-3391-4e1d-a56c-813f46124062', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.427398681640625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 32, 'up_thru': 256, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6800', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6801', 'nonce': 1922002860}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6802', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6803', 'nonce': 1922002860}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6806', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6807', 'nonce': 1922002860}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6804', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6805', 'nonce': 1922002860}]}, 'public_addr': '172.21.15.157:6801/1922002860', 'cluster_addr': '172.21.15.157:6803/1922002860', 'heartbeat_back_addr': '172.21.15.157:6807/1922002860', 'heartbeat_front_addr': '172.21.15.157:6805/1922002860', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '8c7e0309-8c3b-40b9-99d9-96620e52742f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 38, 'up_thru': 258, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6808', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6809', 'nonce': 960889603}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6810', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6811', 'nonce': 960889603}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6814', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6815', 'nonce': 960889603}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6812', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6813', 'nonce': 960889603}]}, 'public_addr': '172.21.15.157:6809/960889603', 'cluster_addr': '172.21.15.157:6811/960889603', 'heartbeat_back_addr': '172.21.15.157:6815/960889603', 'heartbeat_front_addr': '172.21.15.157:6813/960889603', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '5b7d44a3-197d-482c-bf9e-de5e9013a851', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 47, 'up_thru': 220, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6816', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6817', 'nonce': 2598265223}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6818', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6819', 'nonce': 2598265223}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6822', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6823', 'nonce': 2598265223}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6820', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6821', 'nonce': 2598265223}]}, 'public_addr': '172.21.15.157:6817/2598265223', 'cluster_addr': '172.21.15.157:6819/2598265223', 'heartbeat_back_addr': '172.21.15.157:6823/2598265223', 'heartbeat_front_addr': '172.21.15.157:6821/2598265223', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '7e2d0287-928d-40f8-841b-6c2077fc08ac', 'up': 1, 'in': 1, 'weight': 0.482391357421875, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 55, 'up_thru': 256, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6824', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6825', 'nonce': 3619345894}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6826', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6827', 'nonce': 3619345894}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6830', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6831', 'nonce': 3619345894}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6828', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6829', 'nonce': 3619345894}]}, 'public_addr': '172.21.15.157:6825/3619345894', 'cluster_addr': '172.21.15.157:6827/3619345894', 'heartbeat_back_addr': '172.21.15.157:6831/3619345894', 'heartbeat_front_addr': '172.21.15.157:6829/3619345894', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:43:08.030671+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:43:10.886776+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-02-19T21:43:05.502937+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:43:09.733227+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:43:15.385648+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:42:51.181508+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:43:15.157722+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:43:53.479186+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.c', 'osds': [6, 7, 2]}, {'pgid': '4.1', 'osds': [4, 2, 6]}], 'pg_upmap_items': [{'pgid': '4.6', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.e', 'mappings': [{'from': 1, 'to': 7}]}, {'pgid': '4.f', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.19', 'mappings': [{'from': 1, 'to': 7}]}, {'pgid': '4.1f', 'mappings': [{'from': 1, 'to': 7}, {'from': 6, 'to': 0}]}, {'pgid': '5.1', 'mappings': [{'from': 4, 'to': 6}]}, {'pgid': '5.d', 'mappings': [{'from': 0, 'to': 3}]}, {'pgid': '5.13', 'mappings': [{'from': 0, 'to': 6}]}], 'pg_temp': [], 'primary_temp': [], 'blocklist': {'172.21.15.80:6800/2867197629': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:0/1659656010': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:6801/2272739550': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:0/867908385': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:0/398750494': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:0/2833137430': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:0/2520755315': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:6800/2094869828': '2024-02-20T21:26:51.262073+0000', '172.21.15.80:6800/2272739550': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:6801/2094869828': '2024-02-20T21:26:51.262073+0000', '172.21.15.80:0/2130852198': '2024-02-20T21:26:51.262073+0000', '172.21.15.80:6801/2867197629': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:0/1952386920': '2024-02-20T21:26:51.262073+0000'}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-02-19T21:44:08.685 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:44:08.845 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:44:08.848 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:08.848 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:44:08.949 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:44:08.978 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:09.139 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-02-19T21:44:09.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:07.232111+0000 osd.6 (osd.6) 146 : cluster [DBG] 5.11 scrub starts 2024-02-19T21:44:09.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:07.235061+0000 osd.6 (osd.6) 147 : cluster [DBG] 5.11 scrub ok 2024-02-19T21:44:09.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:07.339761+0000 osd.2 (osd.2) 121 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:44:09.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:07.339807+0000 osd.2 (osd.2) 122 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:44:09.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:08.112809+0000 osd.7 (osd.7) 165 : cluster [DBG] 6.5 scrub starts 2024-02-19T21:44:09.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:08.117968+0000 mon.a (mon.0) 1240 : cluster [DBG] osdmap e261: 8 total, 8 up, 7 in 2024-02-19T21:44:09.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:08.147347+0000 osd.7 (osd.7) 166 : cluster [DBG] 6.5 scrub ok 2024-02-19T21:44:09.291 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:08.552656+0000 osd.4 (osd.4) 138 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:44:09.291 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:08.556119+0000 osd.4 (osd.4) 139 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:44:09.291 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:08.573727+0000 osd.3 (osd.3) 176 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:44:09.291 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:08.574740+0000 osd.3 (osd.3) 177 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:44:09.291 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:08.682516+0000 mon.a (mon.0) 1241 : audit [INF] from='client.? 172.21.15.80:0/409874260' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:44:09.291 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:09.040349+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "30"}]: dispatch 2024-02-19T21:44:09.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:07.232111+0000 osd.6 (osd.6) 146 : cluster [DBG] 5.11 scrub starts 2024-02-19T21:44:09.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:07.235061+0000 osd.6 (osd.6) 147 : cluster [DBG] 5.11 scrub ok 2024-02-19T21:44:09.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:07.339761+0000 osd.2 (osd.2) 121 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:44:09.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:07.339807+0000 osd.2 (osd.2) 122 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:44:09.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:08.112809+0000 osd.7 (osd.7) 165 : cluster [DBG] 6.5 scrub starts 2024-02-19T21:44:09.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:08.117968+0000 mon.a (mon.0) 1240 : cluster [DBG] osdmap e261: 8 total, 8 up, 7 in 2024-02-19T21:44:09.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:08.147347+0000 osd.7 (osd.7) 166 : cluster [DBG] 6.5 scrub ok 2024-02-19T21:44:09.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:08.552656+0000 osd.4 (osd.4) 138 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:44:09.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:08.556119+0000 osd.4 (osd.4) 139 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:44:09.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:08.573727+0000 osd.3 (osd.3) 176 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:44:09.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:08.574740+0000 osd.3 (osd.3) 177 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:44:09.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:08.682516+0000 mon.a (mon.0) 1241 : audit [INF] from='client.? 172.21.15.80:0/409874260' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:44:09.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:09.040349+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "30"}]: dispatch 2024-02-19T21:44:09.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:07.232111+0000 osd.6 (osd.6) 146 : cluster [DBG] 5.11 scrub starts 2024-02-19T21:44:09.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:07.235061+0000 osd.6 (osd.6) 147 : cluster [DBG] 5.11 scrub ok 2024-02-19T21:44:09.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:07.339761+0000 osd.2 (osd.2) 121 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:44:09.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:07.339807+0000 osd.2 (osd.2) 122 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:44:09.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:08.112809+0000 osd.7 (osd.7) 165 : cluster [DBG] 6.5 scrub starts 2024-02-19T21:44:09.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:08.117968+0000 mon.a (mon.0) 1240 : cluster [DBG] osdmap e261: 8 total, 8 up, 7 in 2024-02-19T21:44:09.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:08.147347+0000 osd.7 (osd.7) 166 : cluster [DBG] 6.5 scrub ok 2024-02-19T21:44:09.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:08.552656+0000 osd.4 (osd.4) 138 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:44:09.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:08.556119+0000 osd.4 (osd.4) 139 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:44:09.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:08.573727+0000 osd.3 (osd.3) 176 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:44:09.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:08.574740+0000 osd.3 (osd.3) 177 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:44:09.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:08.682516+0000 mon.a (mon.0) 1241 : audit [INF] from='client.? 172.21.15.80:0/409874260' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:44:09.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:09.040349+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "30"}]: dispatch 2024-02-19T21:44:09.911 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:44:09.911 INFO:teuthology.orchestra.run.smithi157.stdout: "size": 20, 2024-02-19T21:44:09.911 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 600, 2024-02-19T21:44:09.911 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [ 2024-02-19T21:44:09.911 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.911 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:146646 7.c 7:3b25307f:::benchmark_data_smithi080_79222_object31912:head [delete] snapc 0=[] ondisk+write+known_if_redirected e133)", 2024-02-19T21:44:09.911 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:37:33.596284+0000", 2024-02-19T21:44:09.911 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 396.311935834, 2024-02-19T21:44:09.911 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.084397300999999994, 2024-02-19T21:44:09.911 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:44:09.911 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:44:09.912 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:44:09.912 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:44:09.912 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:44:09.912 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 146646 2024-02-19T21:44:09.912 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.912 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:44:09.912 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.912 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:44:09.912 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596284+0000", 2024-02-19T21:44:09.912 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:44:09.912 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.912 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.912 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:44:09.912 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596284+0000", 2024-02-19T21:44:09.913 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:44:09.913 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.913 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.913 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:44:09.913 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596283+0000", 2024-02-19T21:44:09.913 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.2260000000000001e-06 2024-02-19T21:44:09.913 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.913 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.913 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:44:09.913 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596287+0000", 2024-02-19T21:44:09.913 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.1700000000000002e-06 2024-02-19T21:44:09.913 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.913 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.913 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:44:09.914 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596293+0000", 2024-02-19T21:44:09.914 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.7910000000000002e-06 2024-02-19T21:44:09.914 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.914 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.914 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:44:09.914 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596297+0000", 2024-02-19T21:44:09.914 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.9220000000000005e-05 2024-02-19T21:44:09.914 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.914 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.914 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.914 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596366+0000", 2024-02-19T21:44:09.914 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000104897 2024-02-19T21:44:09.914 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.915 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.915 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:44:09.915 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596471+0000", 2024-02-19T21:44:09.915 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000122182 2024-02-19T21:44:09.915 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.915 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.915 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:44:09.915 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596593+0000", 2024-02-19T21:44:09.915 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.002585324 2024-02-19T21:44:09.915 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.915 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.915 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:44:09.915 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599178+0000", 2024-02-19T21:44:09.915 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0085386769999999997 2024-02-19T21:44:09.916 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.916 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.916 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:09.916 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.607717+0000", 2024-02-19T21:44:09.916 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.072893174000000005 2024-02-19T21:44:09.916 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.916 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.916 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:09.916 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.680610+0000", 2024-02-19T21:44:09.916 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.6788000000000001e-05 2024-02-19T21:44:09.916 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.917 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.917 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:44:09.917 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.680647+0000", 2024-02-19T21:44:09.917 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.4368e-05 2024-02-19T21:44:09.917 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.917 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.917 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:44:09.917 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.680681+0000", 2024-02-19T21:44:09.917 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.084397300999999994 2024-02-19T21:44:09.917 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:09.917 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:44:09.917 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:09.917 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.917 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.918 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:146652 7.c 7:3c2dcaab:::benchmark_data_smithi080_79222_object31918:head [delete] snapc 0=[] ondisk+write+known_if_redirected e133)", 2024-02-19T21:44:09.918 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:37:33.599542+0000", 2024-02-19T21:44:09.918 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 396.30867767799998, 2024-02-19T21:44:09.918 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.081263583, 2024-02-19T21:44:09.918 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:44:09.918 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:44:09.918 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:44:09.918 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:44:09.918 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:44:09.918 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 146652 2024-02-19T21:44:09.918 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.918 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:44:09.918 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.918 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:44:09.918 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599542+0000", 2024-02-19T21:44:09.919 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:44:09.919 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.919 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.919 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:44:09.919 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599542+0000", 2024-02-19T21:44:09.919 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:44:09.919 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.919 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.919 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:44:09.919 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599541+0000", 2024-02-19T21:44:09.919 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.0570000000000004e-06 2024-02-19T21:44:09.919 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.919 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.919 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:44:09.919 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599548+0000", 2024-02-19T21:44:09.920 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1291000000000001e-05 2024-02-19T21:44:09.920 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.920 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.920 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:44:09.920 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599559+0000", 2024-02-19T21:44:09.920 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.7070000000000003e-06 2024-02-19T21:44:09.920 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.920 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.920 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:44:09.920 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599566+0000", 2024-02-19T21:44:09.920 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.6984999999999998e-05 2024-02-19T21:44:09.920 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.920 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.921 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.921 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599613+0000", 2024-02-19T21:44:09.921 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.5153000000000004e-05 2024-02-19T21:44:09.921 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.921 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.921 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:44:09.921 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599688+0000", 2024-02-19T21:44:09.921 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.4678000000000006e-05 2024-02-19T21:44:09.921 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.921 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.921 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:44:09.921 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599763+0000", 2024-02-19T21:44:09.921 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0026663949999999998 2024-02-19T21:44:09.921 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.921 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.922 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:44:09.922 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.602429+0000", 2024-02-19T21:44:09.922 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0078935600000000009 2024-02-19T21:44:09.922 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.922 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.922 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:09.922 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.610323+0000", 2024-02-19T21:44:09.922 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.070400874000000002 2024-02-19T21:44:09.922 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.922 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.922 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:09.922 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.680724+0000", 2024-02-19T21:44:09.922 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.1516000000000001e-05 2024-02-19T21:44:09.922 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.922 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.923 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:44:09.923 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.680755+0000", 2024-02-19T21:44:09.923 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0662999999999999e-05 2024-02-19T21:44:09.923 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.923 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.923 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:44:09.923 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.680806+0000", 2024-02-19T21:44:09.923 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.081263583 2024-02-19T21:44:09.923 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:09.923 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:44:09.923 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:09.923 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.923 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.923 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199203 7.7 7:e4e0691c:::benchmark_data_smithi080_79222_object84469:head [delete] snapc 0=[] ondisk+write+known_if_redirected e143)", 2024-02-19T21:44:09.924 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:30.214329+0000", 2024-02-19T21:44:09.924 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 339.69389069300001, 2024-02-19T21:44:09.924 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1537202830000002, 2024-02-19T21:44:09.924 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:44:09.924 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "reached pg", 2024-02-19T21:44:09.924 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:44:09.924 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:44:09.924 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:44:09.924 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199203 2024-02-19T21:44:09.924 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.924 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:44:09.924 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.925 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:44:09.925 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.214329+0000", 2024-02-19T21:44:09.925 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:44:09.925 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.925 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.925 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:44:09.925 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.214329+0000", 2024-02-19T21:44:09.926 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:44:09.926 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.926 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.926 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:44:09.926 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.214329+0000", 2024-02-19T21:44:09.926 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.6859999999999999e-06 2024-02-19T21:44:09.926 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.926 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.926 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:44:09.926 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.214332+0000", 2024-02-19T21:44:09.926 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.5900000000000002e-06 2024-02-19T21:44:09.927 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.927 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.927 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:44:09.927 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.214340+0000", 2024-02-19T21:44:09.927 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.4649999999999996e-06 2024-02-19T21:44:09.927 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.927 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.927 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:44:09.927 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.214344+0000", 2024-02-19T21:44:09.927 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0033895370000000002 2024-02-19T21:44:09.927 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.927 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.927 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.927 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.217734+0000", 2024-02-19T21:44:09.928 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.0727000000000002e-05 2024-02-19T21:44:09.928 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.928 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.928 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:44:09.928 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.217805+0000", 2024-02-19T21:44:09.928 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.0567000000000002e-05 2024-02-19T21:44:09.928 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.928 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.928 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,3", 2024-02-19T21:44:09.928 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.217895+0000", 2024-02-19T21:44:09.928 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0021666659999999998 2024-02-19T21:44:09.928 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.929 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.929 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:44:09.929 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220062+0000", 2024-02-19T21:44:09.929 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.022580901 2024-02-19T21:44:09.929 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.929 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.929 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.929 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.242643+0000", 2024-02-19T21:44:09.929 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.5939999999999999e-06 2024-02-19T21:44:09.929 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.929 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.929 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:44:09.929 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.242649+0000", 2024-02-19T21:44:09.930 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99385833999999995 2024-02-19T21:44:09.930 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.930 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.930 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.930 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236508+0000", 2024-02-19T21:44:09.930 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0581000000000001e-05 2024-02-19T21:44:09.930 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.930 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.930 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:44:09.930 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236518+0000", 2024-02-19T21:44:09.930 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.131440564 2024-02-19T21:44:09.930 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.930 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.930 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.931 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.367959+0000", 2024-02-19T21:44:09.931 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.0580000000000004e-05 2024-02-19T21:44:09.931 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.931 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.931 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:44:09.931 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368049+0000", 2024-02-19T21:44:09.931 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1537202830000002 2024-02-19T21:44:09.931 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:09.931 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:44:09.932 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:09.932 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.932 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.932 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199209 7.c 7:366958b9:::benchmark_data_smithi080_79222_object84475:head [delete] snapc 0=[] ondisk+write+known_if_redirected e143)", 2024-02-19T21:44:09.932 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:30.220544+0000", 2024-02-19T21:44:09.932 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 339.68767581899999, 2024-02-19T21:44:09.932 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.2867079380000002, 2024-02-19T21:44:09.932 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:44:09.932 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "reached pg", 2024-02-19T21:44:09.933 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:44:09.933 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:44:09.933 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:44:09.933 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199209 2024-02-19T21:44:09.933 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.933 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:44:09.933 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.933 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:44:09.933 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220544+0000", 2024-02-19T21:44:09.933 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:44:09.933 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.933 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.933 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:44:09.933 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220544+0000", 2024-02-19T21:44:09.933 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:44:09.933 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.934 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.934 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:44:09.934 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220543+0000", 2024-02-19T21:44:09.934 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0220000000000004e-06 2024-02-19T21:44:09.934 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.934 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.934 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:44:09.934 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220548+0000", 2024-02-19T21:44:09.934 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.6799999999999999e-06 2024-02-19T21:44:09.934 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.934 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.934 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:44:09.934 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220557+0000", 2024-02-19T21:44:09.934 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.8100000000000003e-06 2024-02-19T21:44:09.935 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.935 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.935 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:44:09.935 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220562+0000", 2024-02-19T21:44:09.935 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.5091e-05 2024-02-19T21:44:09.935 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.935 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.935 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.935 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220597+0000", 2024-02-19T21:44:09.935 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000105196 2024-02-19T21:44:09.935 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.936 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.936 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:44:09.936 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220703+0000", 2024-02-19T21:44:09.936 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000146749 2024-02-19T21:44:09.936 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.936 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.936 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:44:09.936 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220849+0000", 2024-02-19T21:44:09.936 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0024284160000000001 2024-02-19T21:44:09.936 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.936 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.936 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:44:09.936 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.223278+0000", 2024-02-19T21:44:09.937 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0010794349999999999 2024-02-19T21:44:09.937 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.937 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.937 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:09.937 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.224357+0000", 2024-02-19T21:44:09.937 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.015938191000000001 2024-02-19T21:44:09.937 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.937 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.937 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.937 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.240295+0000", 2024-02-19T21:44:09.937 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1103e-05 2024-02-19T21:44:09.937 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.937 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.937 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:44:09.937 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.240307+0000", 2024-02-19T21:44:09.937 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99564034099999998 2024-02-19T21:44:09.938 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.938 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.938 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.938 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.235947+0000", 2024-02-19T21:44:09.938 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.6800000000000004e-06 2024-02-19T21:44:09.938 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.938 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.938 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:44:09.938 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.235954+0000", 2024-02-19T21:44:09.938 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.271212308 2024-02-19T21:44:09.938 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.938 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.938 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.938 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.507166+0000", 2024-02-19T21:44:09.938 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.6069999999999994e-05 2024-02-19T21:44:09.938 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.939 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.939 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:44:09.939 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.507252+0000", 2024-02-19T21:44:09.939 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.2867079380000002 2024-02-19T21:44:09.939 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:09.939 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:44:09.939 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:09.939 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.939 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.939 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199212 7.7 7:e70492a0:::benchmark_data_smithi080_79222_object84478:head [delete] snapc 0=[] ondisk+write+known_if_redirected e143)", 2024-02-19T21:44:09.939 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:30.220597+0000", 2024-02-19T21:44:09.939 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 339.68762318799998, 2024-02-19T21:44:09.939 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.147553088, 2024-02-19T21:44:09.939 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:44:09.939 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "reached pg", 2024-02-19T21:44:09.939 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:44:09.940 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:44:09.940 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:44:09.940 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199212 2024-02-19T21:44:09.940 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.940 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:44:09.940 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.940 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:44:09.940 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220597+0000", 2024-02-19T21:44:09.940 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:44:09.940 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.940 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.940 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:44:09.940 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220597+0000", 2024-02-19T21:44:09.940 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:44:09.941 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.941 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.941 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:44:09.941 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220596+0000", 2024-02-19T21:44:09.941 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.281e-06 2024-02-19T21:44:09.941 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.941 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.941 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:44:09.941 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220599+0000", 2024-02-19T21:44:09.941 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.7270000000000001e-06 2024-02-19T21:44:09.941 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.941 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.941 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:44:09.941 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220606+0000", 2024-02-19T21:44:09.942 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.25e-06 2024-02-19T21:44:09.942 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.942 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.942 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:44:09.942 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220610+0000", 2024-02-19T21:44:09.942 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.8482000000000002e-05 2024-02-19T21:44:09.942 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.942 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.942 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.942 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220649+0000", 2024-02-19T21:44:09.942 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000108872 2024-02-19T21:44:09.942 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.942 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.942 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:44:09.943 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220758+0000", 2024-02-19T21:44:09.943 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00012441199999999999 2024-02-19T21:44:09.943 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.943 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.943 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,3", 2024-02-19T21:44:09.943 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220882+0000", 2024-02-19T21:44:09.943 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0028021500000000002 2024-02-19T21:44:09.943 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.943 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.943 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:44:09.943 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.223684+0000", 2024-02-19T21:44:09.943 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.019001483 2024-02-19T21:44:09.943 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.943 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.943 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.944 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.242686+0000", 2024-02-19T21:44:09.944 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.8170000000000004e-06 2024-02-19T21:44:09.944 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.944 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.944 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:44:09.944 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.242692+0000", 2024-02-19T21:44:09.944 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99385727800000001 2024-02-19T21:44:09.944 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.944 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.944 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.944 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236549+0000", 2024-02-19T21:44:09.944 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.7810000000000005e-06 2024-02-19T21:44:09.944 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.945 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.945 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:44:09.945 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236557+0000", 2024-02-19T21:44:09.945 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.131526008 2024-02-19T21:44:09.945 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.945 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.945 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.945 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368083+0000", 2024-02-19T21:44:09.945 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.7107999999999995e-05 2024-02-19T21:44:09.945 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.945 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.945 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:44:09.945 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368150+0000", 2024-02-19T21:44:09.945 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.147553088 2024-02-19T21:44:09.946 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:09.946 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:44:09.946 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:09.946 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.946 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.946 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199217 7.c 7:3d739445:::benchmark_data_smithi080_79222_object84483:head [delete] snapc 0=[] ondisk+write+known_if_redirected e143)", 2024-02-19T21:44:09.946 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:30.232520+0000", 2024-02-19T21:44:09.946 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 339.67570009799999, 2024-02-19T21:44:09.946 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.2748104329999999, 2024-02-19T21:44:09.946 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:44:09.946 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "reached pg", 2024-02-19T21:44:09.946 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:44:09.946 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:44:09.947 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:44:09.947 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199217 2024-02-19T21:44:09.947 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.947 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:44:09.947 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.947 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:44:09.947 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232520+0000", 2024-02-19T21:44:09.947 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:44:09.947 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.947 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.947 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:44:09.947 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232520+0000", 2024-02-19T21:44:09.947 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:44:09.947 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.948 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.948 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:44:09.948 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232518+0000", 2024-02-19T21:44:09.948 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.7600000000000002e-06 2024-02-19T21:44:09.948 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.948 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.948 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:44:09.948 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232526+0000", 2024-02-19T21:44:09.948 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.293e-05 2024-02-19T21:44:09.948 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.948 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.948 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:44:09.948 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232539+0000", 2024-02-19T21:44:09.949 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.289e-06 2024-02-19T21:44:09.949 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.949 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.949 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:44:09.949 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232546+0000", 2024-02-19T21:44:09.949 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014075900000000001 2024-02-19T21:44:09.949 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.949 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.949 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.949 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232687+0000", 2024-02-19T21:44:09.949 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000115995 2024-02-19T21:44:09.949 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.949 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.949 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:44:09.950 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232803+0000", 2024-02-19T21:44:09.950 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000129078 2024-02-19T21:44:09.950 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.950 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.950 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:44:09.950 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232932+0000", 2024-02-19T21:44:09.950 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0074053649999999997 2024-02-19T21:44:09.950 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.950 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.950 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.950 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.240337+0000", 2024-02-19T21:44:09.950 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.1230000000000002e-06 2024-02-19T21:44:09.950 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.950 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.950 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:44:09.950 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.240344+0000", 2024-02-19T21:44:09.951 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99568742200000004 2024-02-19T21:44:09.951 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.951 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.951 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.951 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236032+0000", 2024-02-19T21:44:09.951 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.6689999999999995e-06 2024-02-19T21:44:09.951 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.951 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.951 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:44:09.951 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236040+0000", 2024-02-19T21:44:09.951 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2712470330000001 2024-02-19T21:44:09.951 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.951 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.951 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.951 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.507287+0000", 2024-02-19T21:44:09.952 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.2701999999999999e-05 2024-02-19T21:44:09.952 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.952 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.952 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:44:09.952 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.507330+0000", 2024-02-19T21:44:09.952 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.2748104329999999 2024-02-19T21:44:09.952 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:09.952 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:44:09.952 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:09.952 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.952 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.952 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199218 7.7 7:e01213fa:::benchmark_data_smithi080_79222_object84484:head [delete] snapc 0=[] ondisk+write+known_if_redirected e143)", 2024-02-19T21:44:09.952 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:30.232563+0000", 2024-02-19T21:44:09.952 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 339.67565676999999, 2024-02-19T21:44:09.953 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1356496300000001, 2024-02-19T21:44:09.953 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:44:09.953 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "reached pg", 2024-02-19T21:44:09.953 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:44:09.953 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:44:09.953 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:44:09.953 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199218 2024-02-19T21:44:09.953 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.953 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:44:09.953 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.953 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:44:09.953 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232563+0000", 2024-02-19T21:44:09.953 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:44:09.953 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.953 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.954 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:44:09.954 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232563+0000", 2024-02-19T21:44:09.954 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:44:09.954 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.954 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.954 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:44:09.954 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232562+0000", 2024-02-19T21:44:09.954 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0990000000000001e-06 2024-02-19T21:44:09.954 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.954 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.954 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:44:09.954 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232566+0000", 2024-02-19T21:44:09.954 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.9300000000000003e-06 2024-02-19T21:44:09.954 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.954 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.955 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:44:09.955 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232574+0000", 2024-02-19T21:44:09.955 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.853e-06 2024-02-19T21:44:09.955 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.955 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.955 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:44:09.955 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232579+0000", 2024-02-19T21:44:09.955 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.7021999999999999e-05 2024-02-19T21:44:09.955 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.955 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.955 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.955 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232616+0000", 2024-02-19T21:44:09.955 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00010412300000000001 2024-02-19T21:44:09.955 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.956 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.956 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:44:09.956 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232720+0000", 2024-02-19T21:44:09.956 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000134203 2024-02-19T21:44:09.956 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.956 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.956 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,3", 2024-02-19T21:44:09.956 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232855+0000", 2024-02-19T21:44:09.956 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0098704629999999995 2024-02-19T21:44:09.956 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.956 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.956 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.956 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.242725+0000", 2024-02-19T21:44:09.956 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0609999999999997e-06 2024-02-19T21:44:09.957 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.957 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.957 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:44:09.957 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.242729+0000", 2024-02-19T21:44:09.957 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99385746399999997 2024-02-19T21:44:09.957 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.957 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.957 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.957 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236587+0000", 2024-02-19T21:44:09.957 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.4880000000000007e-06 2024-02-19T21:44:09.957 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.957 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.957 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:44:09.957 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236595+0000", 2024-02-19T21:44:09.958 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.131577593 2024-02-19T21:44:09.958 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.958 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.958 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.958 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368173+0000", 2024-02-19T21:44:09.958 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0005000000000001e-05 2024-02-19T21:44:09.958 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.958 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.958 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:44:09.958 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368213+0000", 2024-02-19T21:44:09.958 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1356496300000001 2024-02-19T21:44:09.958 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:09.958 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:44:09.958 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:09.958 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.958 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.959 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199222 7.1 7:84081eb6:::benchmark_data_smithi080_79222_object84488:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-02-19T21:44:09.959 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:30.243372+0000", 2024-02-19T21:44:09.959 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 339.66484768100003, 2024-02-19T21:44:09.959 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1006799549999999, 2024-02-19T21:44:09.959 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:44:09.959 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:44:09.959 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:44:09.959 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:44:09.959 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:44:09.959 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199222 2024-02-19T21:44:09.959 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.959 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:44:09.959 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.959 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:44:09.959 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.243372+0000", 2024-02-19T21:44:09.959 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:44:09.960 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.960 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.960 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:44:09.960 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.243372+0000", 2024-02-19T21:44:09.960 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:44:09.960 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.960 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.960 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:44:09.960 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.243371+0000", 2024-02-19T21:44:09.960 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.6840000000000001e-06 2024-02-19T21:44:09.960 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.960 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.960 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:44:09.960 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.243376+0000", 2024-02-19T21:44:09.961 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.9800000000000004e-06 2024-02-19T21:44:09.961 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.961 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.961 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:44:09.961 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.243385+0000", 2024-02-19T21:44:09.961 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.7089999999999999e-06 2024-02-19T21:44:09.961 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.961 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.961 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:44:09.961 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.243391+0000", 2024-02-19T21:44:09.961 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.8915999999999998e-05 2024-02-19T21:44:09.961 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.961 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.961 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.961 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.243430+0000", 2024-02-19T21:44:09.962 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.127e-06 2024-02-19T21:44:09.962 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.962 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.962 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:44:09.962 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.243436+0000", 2024-02-19T21:44:09.962 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99180459600000004 2024-02-19T21:44:09.962 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.962 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.962 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.962 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.235241+0000", 2024-02-19T21:44:09.962 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.8508e-05 2024-02-19T21:44:09.962 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.962 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.963 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:44:09.963 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.235259+0000", 2024-02-19T21:44:09.963 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.102905794 2024-02-19T21:44:09.963 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.963 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.963 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.963 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.338165+0000", 2024-02-19T21:44:09.963 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0011582179999999999 2024-02-19T21:44:09.963 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.963 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.963 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:44:09.963 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.339323+0000", 2024-02-19T21:44:09.963 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.4108000000000001e-05 2024-02-19T21:44:09.963 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.964 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.964 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,3,4", 2024-02-19T21:44:09.964 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.339417+0000", 2024-02-19T21:44:09.964 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0041340709999999996 2024-02-19T21:44:09.964 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.964 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.964 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:44:09.964 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.343551+0000", 2024-02-19T21:44:09.964 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000292906 2024-02-19T21:44:09.964 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.964 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.964 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:09.964 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.343844+0000", 2024-02-19T21:44:09.965 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.7210999999999999e-05 2024-02-19T21:44:09.965 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.965 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.965 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:09.965 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.343892+0000", 2024-02-19T21:44:09.965 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.8293000000000001e-05 2024-02-19T21:44:09.965 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.965 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.965 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:09.965 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.343930+0000", 2024-02-19T21:44:09.965 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.5883000000000002e-05 2024-02-19T21:44:09.965 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.967 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.967 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:44:09.967 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.343966+0000", 2024-02-19T21:44:09.967 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.6308000000000001e-05 2024-02-19T21:44:09.967 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.967 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.967 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:44:09.967 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.344052+0000", 2024-02-19T21:44:09.967 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1006799549999999 2024-02-19T21:44:09.967 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:09.967 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:44:09.967 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:09.968 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.968 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.968 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199223 7.1 7:8394c6aa:::benchmark_data_smithi080_79222_object84489:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-02-19T21:44:09.968 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:30.251632+0000", 2024-02-19T21:44:09.968 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 339.65658776499998, 2024-02-19T21:44:09.968 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.0927566039999999, 2024-02-19T21:44:09.968 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:44:09.968 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:44:09.968 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:44:09.968 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:44:09.968 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:44:09.968 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199223 2024-02-19T21:44:09.968 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.969 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:44:09.969 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.969 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:44:09.969 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.251632+0000", 2024-02-19T21:44:09.969 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:44:09.969 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.969 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.969 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:44:09.969 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.251632+0000", 2024-02-19T21:44:09.969 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:44:09.969 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.969 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.969 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:44:09.969 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.251631+0000", 2024-02-19T21:44:09.970 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.0610000000000002e-06 2024-02-19T21:44:09.970 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.970 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.970 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:44:09.970 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.251640+0000", 2024-02-19T21:44:09.970 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.7476999999999999e-05 2024-02-19T21:44:09.970 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.970 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.970 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:44:09.970 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.251657+0000", 2024-02-19T21:44:09.970 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0353999999999999e-05 2024-02-19T21:44:09.970 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.970 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.970 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:44:09.971 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.251667+0000", 2024-02-19T21:44:09.971 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.3464000000000002e-05 2024-02-19T21:44:09.971 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.971 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.971 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.971 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.251721+0000", 2024-02-19T21:44:09.971 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1721e-05 2024-02-19T21:44:09.971 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.971 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.971 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:44:09.971 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.251733+0000", 2024-02-19T21:44:09.971 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.98356867999999997 2024-02-19T21:44:09.972 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.972 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.972 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.972 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.235301+0000", 2024-02-19T21:44:09.972 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.7809999999999994e-06 2024-02-19T21:44:09.972 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.972 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.972 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:44:09.972 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.235310+0000", 2024-02-19T21:44:09.972 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1058049919999999 2024-02-19T21:44:09.973 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.973 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.973 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.973 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.341115+0000", 2024-02-19T21:44:09.973 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013287600000000001 2024-02-19T21:44:09.973 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.973 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.973 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:44:09.973 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.341248+0000", 2024-02-19T21:44:09.973 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00017378200000000001 2024-02-19T21:44:09.973 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.973 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.973 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,3,4", 2024-02-19T21:44:09.974 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.341422+0000", 2024-02-19T21:44:09.974 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.002243835 2024-02-19T21:44:09.974 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.974 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.974 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:44:09.974 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.343666+0000", 2024-02-19T21:44:09.974 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000430672 2024-02-19T21:44:09.974 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.974 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.974 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:09.974 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.344096+0000", 2024-02-19T21:44:09.974 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.6704e-05 2024-02-19T21:44:09.974 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.974 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.975 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:09.975 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.344123+0000", 2024-02-19T21:44:09.975 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000162521 2024-02-19T21:44:09.975 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.975 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.975 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:09.975 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.344286+0000", 2024-02-19T21:44:09.975 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.7529999999999999e-05 2024-02-19T21:44:09.975 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.975 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.975 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:44:09.975 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.344313+0000", 2024-02-19T21:44:09.975 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.5601999999999999e-05 2024-02-19T21:44:09.975 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.975 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.976 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:44:09.976 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.344389+0000", 2024-02-19T21:44:09.976 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.0927566039999999 2024-02-19T21:44:09.976 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:09.976 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:44:09.976 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:09.976 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.976 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.976 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199225 7.7 7:e7101b2c:::benchmark_data_smithi080_79222_object84491:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-02-19T21:44:09.976 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:30.264325+0000", 2024-02-19T21:44:09.976 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 339.64389448100002, 2024-02-19T21:44:09.976 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1224556250000002, 2024-02-19T21:44:09.977 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:44:09.977 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:44:09.977 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:44:09.977 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:44:09.977 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:44:09.977 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199225 2024-02-19T21:44:09.977 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.977 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:44:09.977 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.977 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:44:09.977 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.264325+0000", 2024-02-19T21:44:09.977 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:44:09.977 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.977 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.977 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:44:09.978 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.264325+0000", 2024-02-19T21:44:09.978 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:44:09.978 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.978 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.978 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:44:09.978 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.264324+0000", 2024-02-19T21:44:09.978 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.6960000000000002e-06 2024-02-19T21:44:09.978 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.978 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.978 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:44:09.978 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.264330+0000", 2024-02-19T21:44:09.979 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.3283e-05 2024-02-19T21:44:09.979 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.979 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.979 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:44:09.979 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.264343+0000", 2024-02-19T21:44:09.979 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.0099999999999998e-06 2024-02-19T21:44:09.979 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.979 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.979 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:44:09.979 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.264350+0000", 2024-02-19T21:44:09.979 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.9267000000000001e-05 2024-02-19T21:44:09.979 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.980 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.980 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.980 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.264400+0000", 2024-02-19T21:44:09.980 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0203e-05 2024-02-19T21:44:09.980 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.980 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.980 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:44:09.980 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.264410+0000", 2024-02-19T21:44:09.980 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.97221051000000003 2024-02-19T21:44:09.980 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.980 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.980 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.980 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236620+0000", 2024-02-19T21:44:09.980 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.2139999999999999e-06 2024-02-19T21:44:09.981 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.981 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.981 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:44:09.981 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236627+0000", 2024-02-19T21:44:09.981 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.131609898 2024-02-19T21:44:09.981 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.981 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.981 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.981 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368237+0000", 2024-02-19T21:44:09.981 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00011917999999999999 2024-02-19T21:44:09.981 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.981 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.981 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:44:09.981 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368357+0000", 2024-02-19T21:44:09.981 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00047232200000000001 2024-02-19T21:44:09.982 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.982 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.982 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1,3", 2024-02-19T21:44:09.982 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368829+0000", 2024-02-19T21:44:09.982 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0085057680000000004 2024-02-19T21:44:09.982 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.982 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.982 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:44:09.982 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.377335+0000", 2024-02-19T21:44:09.982 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0027407709999999999 2024-02-19T21:44:09.982 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.982 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.982 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:09.982 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.380075+0000", 2024-02-19T21:44:09.982 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0045583339999999998 2024-02-19T21:44:09.982 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.983 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.983 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:09.983 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.384634+0000", 2024-02-19T21:44:09.983 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0019395289999999999 2024-02-19T21:44:09.983 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.983 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.983 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:09.983 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.386573+0000", 2024-02-19T21:44:09.983 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.5507999999999997e-05 2024-02-19T21:44:09.983 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.983 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.983 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:44:09.983 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.386639+0000", 2024-02-19T21:44:09.983 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000142177 2024-02-19T21:44:09.983 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.983 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.984 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:44:09.984 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.386781+0000", 2024-02-19T21:44:09.984 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1224556250000002 2024-02-19T21:44:09.984 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:09.984 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:44:09.984 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:09.984 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.984 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.984 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199240 7.7 7:ecb96328:::benchmark_data_smithi080_79222_object84506:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-02-19T21:44:09.984 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:30.315926+0000", 2024-02-19T21:44:09.984 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 339.59229372300001, 2024-02-19T21:44:09.984 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.080005286, 2024-02-19T21:44:09.984 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:44:09.984 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:44:09.985 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:44:09.985 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:44:09.985 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:44:09.985 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199240 2024-02-19T21:44:09.985 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.985 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:44:09.985 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.985 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:44:09.985 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.315926+0000", 2024-02-19T21:44:09.985 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:44:09.985 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.985 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.985 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:44:09.985 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.315926+0000", 2024-02-19T21:44:09.985 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999976 2024-02-19T21:44:09.986 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.986 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.986 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:44:09.986 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.315924+0000", 2024-02-19T21:44:09.986 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.3709999999999999e-05 2024-02-19T21:44:09.986 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.986 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.986 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:44:09.986 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.315937+0000", 2024-02-19T21:44:09.986 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.8242000000000002e-05 2024-02-19T21:44:09.986 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.986 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.986 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:44:09.986 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.315966+0000", 2024-02-19T21:44:09.986 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2466999999999999e-05 2024-02-19T21:44:09.987 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.987 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.987 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:44:09.987 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.315978+0000", 2024-02-19T21:44:09.987 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.7517999999999997e-05 2024-02-19T21:44:09.987 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.987 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.987 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.987 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.316076+0000", 2024-02-19T21:44:09.987 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.8423e-05 2024-02-19T21:44:09.987 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.987 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.987 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:44:09.987 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.316094+0000", 2024-02-19T21:44:09.988 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.92064759600000001 2024-02-19T21:44:09.988 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.988 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.988 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.988 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236742+0000", 2024-02-19T21:44:09.988 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0042e-05 2024-02-19T21:44:09.988 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.988 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.988 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:44:09.988 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236752+0000", 2024-02-19T21:44:09.988 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.138470066 2024-02-19T21:44:09.988 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.989 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.989 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.989 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.375222+0000", 2024-02-19T21:44:09.989 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014873800000000001 2024-02-19T21:44:09.989 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.989 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.989 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:44:09.989 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.375371+0000", 2024-02-19T21:44:09.989 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00017589099999999999 2024-02-19T21:44:09.989 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.989 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.989 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1,3", 2024-02-19T21:44:09.989 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.375546+0000", 2024-02-19T21:44:09.989 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.001793258 2024-02-19T21:44:09.989 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.989 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.990 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:44:09.990 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.377340+0000", 2024-02-19T21:44:09.990 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0079979979999999992 2024-02-19T21:44:09.990 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.990 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.990 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:09.990 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.385338+0000", 2024-02-19T21:44:09.990 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0014799430000000001 2024-02-19T21:44:09.990 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.990 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.990 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:09.990 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.386818+0000", 2024-02-19T21:44:09.990 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0088757969999999995 2024-02-19T21:44:09.990 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.990 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.990 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:09.991 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.395693+0000", 2024-02-19T21:44:09.991 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.6478999999999998e-05 2024-02-19T21:44:09.991 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.991 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.991 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:44:09.991 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.395760+0000", 2024-02-19T21:44:09.991 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000171471 2024-02-19T21:44:09.991 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.991 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.991 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:44:09.991 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.395931+0000", 2024-02-19T21:44:09.991 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.080005286 2024-02-19T21:44:09.991 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:09.991 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:44:09.991 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:09.992 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.992 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.992 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199243 7.c 7:32d6b0d0:::benchmark_data_smithi080_79222_object84509:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:44:09.992 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:32.358612+0000", 2024-02-19T21:44:09.992 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 337.54960765800001, 2024-02-19T21:44:09.992 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.17102286999999999, 2024-02-19T21:44:09.992 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:44:09.992 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:44:09.992 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:44:09.992 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:44:09.992 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:44:09.992 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199243 2024-02-19T21:44:09.992 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.992 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:44:09.992 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.993 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:44:09.993 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.358612+0000", 2024-02-19T21:44:09.993 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:44:09.993 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.993 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.993 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:44:09.993 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.358612+0000", 2024-02-19T21:44:09.993 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:44:09.993 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.993 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.993 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:44:09.993 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.358610+0000", 2024-02-19T21:44:09.993 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.6910000000000003e-06 2024-02-19T21:44:09.993 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.993 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.993 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:44:09.994 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.358619+0000", 2024-02-19T21:44:09.994 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2391999999999999e-05 2024-02-19T21:44:09.994 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.994 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.994 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:44:09.994 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.358632+0000", 2024-02-19T21:44:09.994 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.5099999999999998e-06 2024-02-19T21:44:09.994 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.994 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.994 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:44:09.994 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.358637+0000", 2024-02-19T21:44:09.995 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.1888000000000002e-05 2024-02-19T21:44:09.995 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.995 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.995 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.995 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.358689+0000", 2024-02-19T21:44:09.995 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0662000000000001e-05 2024-02-19T21:44:09.995 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.995 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.995 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:44:09.995 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.358700+0000", 2024-02-19T21:44:09.995 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.14865595600000001 2024-02-19T21:44:09.995 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.995 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.995 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:09.995 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.507356+0000", 2024-02-19T21:44:09.995 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.4226000000000003e-05 2024-02-19T21:44:09.996 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.996 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.996 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:44:09.996 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.507440+0000", 2024-02-19T21:44:09.996 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00047858500000000001 2024-02-19T21:44:09.996 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.996 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.996 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 2,3,7", 2024-02-19T21:44:09.996 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.507918+0000", 2024-02-19T21:44:09.996 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.015245470000000001 2024-02-19T21:44:09.996 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.996 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.996 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:09.996 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.523164+0000", 2024-02-19T21:44:09.996 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.773e-05 2024-02-19T21:44:09.997 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.997 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.997 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:09.997 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.523202+0000", 2024-02-19T21:44:09.997 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.6146999999999998e-05 2024-02-19T21:44:09.997 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.997 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.997 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:09.997 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.523238+0000", 2024-02-19T21:44:09.997 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0062431229999999997 2024-02-19T21:44:09.997 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.997 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.997 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:44:09.997 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.529481+0000", 2024-02-19T21:44:09.997 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.8912000000000002e-05 2024-02-19T21:44:09.997 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.998 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.998 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:44:09.998 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.529530+0000", 2024-02-19T21:44:09.998 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00010529199999999999 2024-02-19T21:44:09.998 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.998 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.998 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:44:09.998 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.529635+0000", 2024-02-19T21:44:09.998 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.17102286999999999 2024-02-19T21:44:09.998 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:09.998 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:44:09.998 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:09.998 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.999 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:09.999 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199244 7.c 7:379204a8:::benchmark_data_smithi080_79222_object84510:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:44:09.999 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:32.368056+0000", 2024-02-19T21:44:09.999 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 337.54016354999999, 2024-02-19T21:44:09.999 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.161730017, 2024-02-19T21:44:09.999 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:44:09.999 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:44:09.999 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:44:09.999 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:44:09.999 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:44:09.999 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199244 2024-02-19T21:44:09.999 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:09.999 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:44:09.999 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.000 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:44:10.000 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368056+0000", 2024-02-19T21:44:10.000 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:44:10.000 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.000 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.000 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:44:10.000 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368056+0000", 2024-02-19T21:44:10.000 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:44:10.000 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.000 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.000 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:44:10.000 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368054+0000", 2024-02-19T21:44:10.000 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.8789999999999992e-06 2024-02-19T21:44:10.000 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.001 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.001 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:44:10.001 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368063+0000", 2024-02-19T21:44:10.001 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2001000000000001e-05 2024-02-19T21:44:10.001 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.001 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.001 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:44:10.001 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368075+0000", 2024-02-19T21:44:10.001 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.5289999999999997e-06 2024-02-19T21:44:10.001 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.001 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.001 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:44:10.001 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368082+0000", 2024-02-19T21:44:10.001 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0662999999999999e-05 2024-02-19T21:44:10.001 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.001 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.002 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:10.002 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368133+0000", 2024-02-19T21:44:10.002 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.6269999999999995e-06 2024-02-19T21:44:10.002 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.002 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.002 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:44:10.002 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368142+0000", 2024-02-19T21:44:10.002 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.14907314799999999 2024-02-19T21:44:10.002 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.002 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.002 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:10.002 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.517215+0000", 2024-02-19T21:44:10.002 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000144287 2024-02-19T21:44:10.002 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.002 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.003 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:44:10.003 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.517360+0000", 2024-02-19T21:44:10.003 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000171189 2024-02-19T21:44:10.003 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.003 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.003 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 2,3,7", 2024-02-19T21:44:10.003 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.517531+0000", 2024-02-19T21:44:10.003 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0057492419999999999 2024-02-19T21:44:10.003 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.003 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.003 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:10.003 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.523280+0000", 2024-02-19T21:44:10.003 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.6207e-05 2024-02-19T21:44:10.004 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.004 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.004 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:10.004 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.523326+0000", 2024-02-19T21:44:10.004 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0056854949999999996 2024-02-19T21:44:10.004 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.004 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.004 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:10.004 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.529012+0000", 2024-02-19T21:44:10.004 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00063114099999999999 2024-02-19T21:44:10.004 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.004 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.004 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:44:10.004 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.529643+0000", 2024-02-19T21:44:10.005 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0198999999999999e-05 2024-02-19T21:44:10.005 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.005 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.005 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:44:10.005 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.529683+0000", 2024-02-19T21:44:10.005 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0001032 2024-02-19T21:44:10.005 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.005 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.005 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:44:10.005 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.529786+0000", 2024-02-19T21:44:10.005 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.161730017 2024-02-19T21:44:10.005 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:10.005 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:44:10.005 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:10.006 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.006 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.006 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:206643 7.7 7:ed6e881f:::benchmark_data_smithi080_79222_object91909:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:44:10.006 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:40.951493+0000", 2024-02-19T21:44:10.006 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 328.95672637799998, 2024-02-19T21:44:10.006 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.086843371000000003, 2024-02-19T21:44:10.006 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:44:10.006 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:44:10.006 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:44:10.006 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:44:10.006 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:44:10.006 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 206643 2024-02-19T21:44:10.006 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.007 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:44:10.007 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.007 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:44:10.007 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.951493+0000", 2024-02-19T21:44:10.007 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:44:10.007 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.007 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.007 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:44:10.007 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.951493+0000", 2024-02-19T21:44:10.007 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:44:10.007 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.007 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.007 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:44:10.007 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.951492+0000", 2024-02-19T21:44:10.007 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.8870000000000003e-06 2024-02-19T21:44:10.007 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.008 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.008 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:44:10.008 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.951499+0000", 2024-02-19T21:44:10.008 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.7589999999999992e-06 2024-02-19T21:44:10.008 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.008 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.008 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:44:10.008 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.951509+0000", 2024-02-19T21:44:10.008 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.7649999999999999e-06 2024-02-19T21:44:10.008 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.008 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.008 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:44:10.008 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.951515+0000", 2024-02-19T21:44:10.009 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00021464499999999999 2024-02-19T21:44:10.009 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.009 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.009 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:10.009 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.951729+0000", 2024-02-19T21:44:10.009 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000126231 2024-02-19T21:44:10.009 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.009 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.009 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:44:10.009 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.951855+0000", 2024-02-19T21:44:10.009 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00015909999999999999 2024-02-19T21:44:10.009 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.009 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.009 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1,3", 2024-02-19T21:44:10.009 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.952015+0000", 2024-02-19T21:44:10.010 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0030639819999999998 2024-02-19T21:44:10.010 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.010 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.010 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:44:10.010 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.955079+0000", 2024-02-19T21:44:10.010 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.015306619 2024-02-19T21:44:10.010 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.010 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.010 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:10.010 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.970385+0000", 2024-02-19T21:44:10.010 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00049222899999999995 2024-02-19T21:44:10.010 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.010 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.010 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:10.010 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.970877+0000", 2024-02-19T21:44:10.010 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.067260906999999995 2024-02-19T21:44:10.010 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.011 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.011 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:10.011 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:41.038138+0000", 2024-02-19T21:44:10.011 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.982e-05 2024-02-19T21:44:10.011 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.011 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.011 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:44:10.011 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:41.038198+0000", 2024-02-19T21:44:10.011 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013866900000000001 2024-02-19T21:44:10.011 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.011 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.011 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:44:10.011 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:41.038337+0000", 2024-02-19T21:44:10.011 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.086843371000000003 2024-02-19T21:44:10.011 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:10.012 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:44:10.012 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:10.012 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.012 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.012 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:206653 7.d 7:b0a06478:::benchmark_data_smithi080_79222_object91919:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:44:10.012 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:40.963286+0000", 2024-02-19T21:44:10.012 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 328.944933816, 2024-02-19T21:44:10.012 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.081431297, 2024-02-19T21:44:10.012 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:44:10.012 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:44:10.012 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:44:10.012 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:44:10.012 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:44:10.012 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 206653 2024-02-19T21:44:10.013 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.013 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:44:10.013 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.013 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:44:10.013 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.963286+0000", 2024-02-19T21:44:10.013 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:44:10.013 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.013 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.013 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:44:10.013 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.963286+0000", 2024-02-19T21:44:10.013 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:44:10.013 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.013 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.013 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:44:10.013 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.963285+0000", 2024-02-19T21:44:10.013 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.9349999999999997e-06 2024-02-19T21:44:10.014 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.014 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.014 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:44:10.014 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.963291+0000", 2024-02-19T21:44:10.014 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.5730999999999999e-05 2024-02-19T21:44:10.014 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.014 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.014 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:44:10.014 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.963307+0000", 2024-02-19T21:44:10.014 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.1879999999999999e-06 2024-02-19T21:44:10.014 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.014 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.014 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:44:10.014 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.963313+0000", 2024-02-19T21:44:10.015 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.2889000000000002e-05 2024-02-19T21:44:10.015 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.015 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.015 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:10.015 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.963356+0000", 2024-02-19T21:44:10.015 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00010317 2024-02-19T21:44:10.015 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.015 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.015 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:44:10.015 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.963459+0000", 2024-02-19T21:44:10.015 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00011767100000000001 2024-02-19T21:44:10.015 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.015 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.015 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:44:10.016 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.963577+0000", 2024-02-19T21:44:10.016 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0025371909999999998 2024-02-19T21:44:10.016 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.016 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.016 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:44:10.016 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.966114+0000", 2024-02-19T21:44:10.016 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0087907550000000008 2024-02-19T21:44:10.016 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.016 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.016 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:10.016 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.974905+0000", 2024-02-19T21:44:10.016 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.069734184000000005 2024-02-19T21:44:10.016 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.016 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.017 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:10.017 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:41.044639+0000", 2024-02-19T21:44:10.017 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.1242000000000003e-05 2024-02-19T21:44:10.017 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.017 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.017 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:44:10.017 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:41.044680+0000", 2024-02-19T21:44:10.017 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.6803e-05 2024-02-19T21:44:10.017 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.017 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.017 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:44:10.017 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:41.044717+0000", 2024-02-19T21:44:10.017 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.081431297 2024-02-19T21:44:10.018 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:10.018 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:44:10.018 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:10.018 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.018 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.018 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:207584 7.7 7:ec3844c7:::benchmark_data_smithi080_79222_object92850:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:44:10.018 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:42.091282+0000", 2024-02-19T21:44:10.018 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 327.81693758099999, 2024-02-19T21:44:10.018 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.10409320900000001, 2024-02-19T21:44:10.018 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:44:10.018 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:44:10.018 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:44:10.018 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:44:10.018 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:44:10.018 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 207584 2024-02-19T21:44:10.018 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.019 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:44:10.019 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.019 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:44:10.019 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.091282+0000", 2024-02-19T21:44:10.019 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:44:10.019 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.019 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.019 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:44:10.019 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.091282+0000", 2024-02-19T21:44:10.019 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:44:10.019 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.019 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.019 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:44:10.019 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.091281+0000", 2024-02-19T21:44:10.019 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.7429999999999996e-06 2024-02-19T21:44:10.020 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.020 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.020 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:44:10.020 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.091288+0000", 2024-02-19T21:44:10.020 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2091e-05 2024-02-19T21:44:10.020 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.020 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.020 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:44:10.020 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.091300+0000", 2024-02-19T21:44:10.020 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.9460000000000003e-06 2024-02-19T21:44:10.020 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.020 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.020 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:44:10.020 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.091306+0000", 2024-02-19T21:44:10.021 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.9030999999999997e-05 2024-02-19T21:44:10.021 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.021 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.021 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:10.021 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.091375+0000", 2024-02-19T21:44:10.021 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00011971 2024-02-19T21:44:10.021 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.021 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.021 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:44:10.021 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.091495+0000", 2024-02-19T21:44:10.021 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00016302499999999999 2024-02-19T21:44:10.021 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.021 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.021 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1,3", 2024-02-19T21:44:10.022 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.091658+0000", 2024-02-19T21:44:10.022 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0064095289999999997 2024-02-19T21:44:10.022 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.022 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.022 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:44:10.022 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.098067+0000", 2024-02-19T21:44:10.022 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.001025693 2024-02-19T21:44:10.022 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.022 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.022 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:10.022 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099093+0000", 2024-02-19T21:44:10.022 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0040436500000000002 2024-02-19T21:44:10.022 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.022 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.023 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:10.023 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.103137+0000", 2024-02-19T21:44:10.023 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.092109941000000001 2024-02-19T21:44:10.023 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.023 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.023 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:10.023 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.195247+0000", 2024-02-19T21:44:10.023 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.7958999999999999e-05 2024-02-19T21:44:10.023 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.023 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.023 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:44:10.023 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.195294+0000", 2024-02-19T21:44:10.023 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.0958999999999995e-05 2024-02-19T21:44:10.023 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.023 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.023 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:44:10.023 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.195375+0000", 2024-02-19T21:44:10.024 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.10409320900000001 2024-02-19T21:44:10.024 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:10.024 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:44:10.024 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:10.024 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.024 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.024 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:207586 7.d 7:b9ba961f:::benchmark_data_smithi080_79222_object92852:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:44:10.024 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:42.094622+0000", 2024-02-19T21:44:10.024 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 327.81359807199999, 2024-02-19T21:44:10.024 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.089242795999999999, 2024-02-19T21:44:10.024 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:44:10.024 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:44:10.024 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:44:10.024 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:44:10.025 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:44:10.025 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 207586 2024-02-19T21:44:10.025 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.025 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:44:10.025 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.025 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:44:10.025 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094622+0000", 2024-02-19T21:44:10.025 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:44:10.025 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.025 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.025 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:44:10.025 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094622+0000", 2024-02-19T21:44:10.025 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:44:10.025 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.025 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.026 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:44:10.026 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094620+0000", 2024-02-19T21:44:10.026 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.1400000000000002e-06 2024-02-19T21:44:10.026 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.026 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.026 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:44:10.026 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094627+0000", 2024-02-19T21:44:10.026 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1995e-05 2024-02-19T21:44:10.026 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.026 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.026 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:44:10.026 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094639+0000", 2024-02-19T21:44:10.026 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.0249999999999999e-06 2024-02-19T21:44:10.026 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.026 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.027 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:44:10.027 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094645+0000", 2024-02-19T21:44:10.027 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.5117000000000002e-05 2024-02-19T21:44:10.027 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.027 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.027 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:10.027 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094690+0000", 2024-02-19T21:44:10.027 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00012526900000000001 2024-02-19T21:44:10.027 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.027 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.027 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:44:10.027 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094816+0000", 2024-02-19T21:44:10.027 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00012976599999999999 2024-02-19T21:44:10.027 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.028 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.028 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:44:10.028 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094945+0000", 2024-02-19T21:44:10.028 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0028760909999999999 2024-02-19T21:44:10.028 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.028 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.028 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:44:10.028 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.097821+0000", 2024-02-19T21:44:10.028 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0070416719999999997 2024-02-19T21:44:10.028 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.028 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.028 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:10.028 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.104863+0000", 2024-02-19T21:44:10.028 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.078907110000000003 2024-02-19T21:44:10.029 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.029 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.029 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:10.029 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.183770+0000", 2024-02-19T21:44:10.029 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0040000000000002e-05 2024-02-19T21:44:10.029 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.029 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.029 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:44:10.029 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.183820+0000", 2024-02-19T21:44:10.029 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.4211000000000001e-05 2024-02-19T21:44:10.029 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.029 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.030 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:44:10.030 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.183865+0000", 2024-02-19T21:44:10.030 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.089242795999999999 2024-02-19T21:44:10.030 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:10.030 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:44:10.030 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:10.030 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.030 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.030 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:207589 7.7 7:e6ce6b61:::benchmark_data_smithi080_79222_object92855:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:44:10.030 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:42.094660+0000", 2024-02-19T21:44:10.030 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 327.81355971699998, 2024-02-19T21:44:10.030 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.10097279000000001, 2024-02-19T21:44:10.030 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:44:10.031 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:44:10.031 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:44:10.031 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:44:10.031 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:44:10.031 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 207589 2024-02-19T21:44:10.031 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.031 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:44:10.031 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.031 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:44:10.031 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094660+0000", 2024-02-19T21:44:10.031 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:44:10.031 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.031 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.031 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:44:10.031 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094660+0000", 2024-02-19T21:44:10.032 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:44:10.032 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.032 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.032 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:44:10.032 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094660+0000", 2024-02-19T21:44:10.032 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.948e-06 2024-02-19T21:44:10.032 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.032 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.032 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:44:10.032 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094663+0000", 2024-02-19T21:44:10.032 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.2609999999999999e-06 2024-02-19T21:44:10.032 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.033 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.033 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:44:10.033 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094669+0000", 2024-02-19T21:44:10.033 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.7189999999999999e-06 2024-02-19T21:44:10.033 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.033 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.033 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:44:10.033 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094673+0000", 2024-02-19T21:44:10.033 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.3884999999999997e-05 2024-02-19T21:44:10.033 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.033 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.033 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:10.033 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094716+0000", 2024-02-19T21:44:10.034 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00011217099999999999 2024-02-19T21:44:10.034 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.034 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.034 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:44:10.034 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094829+0000", 2024-02-19T21:44:10.034 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00040904199999999998 2024-02-19T21:44:10.034 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.034 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.034 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1,3", 2024-02-19T21:44:10.034 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.095238+0000", 2024-02-19T21:44:10.034 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0029471250000000001 2024-02-19T21:44:10.034 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.034 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.034 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:44:10.034 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.098185+0000", 2024-02-19T21:44:10.035 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0049020060000000004 2024-02-19T21:44:10.035 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.035 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.035 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:10.035 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.103087+0000", 2024-02-19T21:44:10.035 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.8848e-05 2024-02-19T21:44:10.035 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.035 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.035 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:10.035 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.103176+0000", 2024-02-19T21:44:10.035 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.092253600000000005 2024-02-19T21:44:10.035 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.035 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.035 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:10.036 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.195429+0000", 2024-02-19T21:44:10.036 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.7788999999999998e-05 2024-02-19T21:44:10.036 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.036 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.036 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:44:10.036 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.195487+0000", 2024-02-19T21:44:10.036 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014587199999999999 2024-02-19T21:44:10.036 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.036 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.036 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:44:10.036 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.195633+0000", 2024-02-19T21:44:10.037 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.10097279000000001 2024-02-19T21:44:10.037 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:10.037 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:44:10.037 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:10.037 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.037 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.037 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:207593 7.d 7:bde9a27f:::benchmark_data_smithi080_79222_object92859:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:44:10.037 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:42.099023+0000", 2024-02-19T21:44:10.037 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 327.80919714700002, 2024-02-19T21:44:10.037 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.085093337000000005, 2024-02-19T21:44:10.037 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:44:10.037 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:44:10.037 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:44:10.037 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:44:10.037 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:44:10.038 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 207593 2024-02-19T21:44:10.038 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.038 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:44:10.038 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.038 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:44:10.038 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099023+0000", 2024-02-19T21:44:10.038 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:44:10.038 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.038 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.038 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:44:10.038 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099023+0000", 2024-02-19T21:44:10.038 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:44:10.038 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.038 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.039 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:44:10.039 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099021+0000", 2024-02-19T21:44:10.039 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.3240000000000003e-06 2024-02-19T21:44:10.039 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.039 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.039 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:44:10.039 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099030+0000", 2024-02-19T21:44:10.039 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.6010000000000001e-05 2024-02-19T21:44:10.039 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.039 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.039 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:44:10.039 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099046+0000", 2024-02-19T21:44:10.039 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.99e-06 2024-02-19T21:44:10.039 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.039 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.040 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:44:10.040 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099053+0000", 2024-02-19T21:44:10.040 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.0587999999999995e-05 2024-02-19T21:44:10.040 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.040 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.040 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:10.040 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099133+0000", 2024-02-19T21:44:10.040 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00012628800000000001 2024-02-19T21:44:10.040 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.040 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.040 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:44:10.040 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099259+0000", 2024-02-19T21:44:10.040 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014891700000000001 2024-02-19T21:44:10.040 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.041 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.041 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:44:10.041 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099408+0000", 2024-02-19T21:44:10.041 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0022343329999999998 2024-02-19T21:44:10.041 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.041 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.041 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:44:10.041 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.101643+0000", 2024-02-19T21:44:10.041 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.004290477 2024-02-19T21:44:10.041 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.041 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.041 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:10.041 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.105933+0000", 2024-02-19T21:44:10.041 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.078084543000000006 2024-02-19T21:44:10.041 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.042 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.042 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:10.042 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.184018+0000", 2024-02-19T21:44:10.042 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.6813000000000001e-05 2024-02-19T21:44:10.042 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.042 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.042 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:44:10.042 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.184065+0000", 2024-02-19T21:44:10.042 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.1437000000000002e-05 2024-02-19T21:44:10.042 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.042 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.042 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:44:10.042 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.184116+0000", 2024-02-19T21:44:10.042 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.085093337000000005 2024-02-19T21:44:10.043 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:10.043 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:44:10.043 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:10.043 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.043 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.043 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:207771 7.d 7:bbed4a8a:::benchmark_data_smithi080_79222_object93037:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:44:10.043 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:42.355377+0000", 2024-02-19T21:44:10.043 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 327.55284282700001, 2024-02-19T21:44:10.043 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.086960934000000004, 2024-02-19T21:44:10.043 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:44:10.043 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:44:10.043 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:44:10.043 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:44:10.043 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:44:10.043 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 207771 2024-02-19T21:44:10.044 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.044 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:44:10.044 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.044 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:44:10.044 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.355377+0000", 2024-02-19T21:44:10.044 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:44:10.044 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.044 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.044 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:44:10.044 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.355377+0000", 2024-02-19T21:44:10.044 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:44:10.044 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.044 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.044 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:44:10.045 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.355376+0000", 2024-02-19T21:44:10.045 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.5729999999999996e-06 2024-02-19T21:44:10.045 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.045 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.045 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:44:10.045 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.355382+0000", 2024-02-19T21:44:10.045 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2806000000000001e-05 2024-02-19T21:44:10.045 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.045 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.045 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:44:10.045 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.355395+0000", 2024-02-19T21:44:10.045 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.9199999999999998e-06 2024-02-19T21:44:10.045 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.045 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.046 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:44:10.046 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.355402+0000", 2024-02-19T21:44:10.046 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0016894709999999999 2024-02-19T21:44:10.046 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.046 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.046 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:44:10.046 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.357092+0000", 2024-02-19T21:44:10.046 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.1039999999999996e-05 2024-02-19T21:44:10.046 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.046 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.046 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:44:10.046 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.357183+0000", 2024-02-19T21:44:10.046 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000119494 2024-02-19T21:44:10.047 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.047 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.047 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:44:10.047 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.357302+0000", 2024-02-19T21:44:10.047 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.001513588 2024-02-19T21:44:10.047 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.047 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.047 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:44:10.047 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.358816+0000", 2024-02-19T21:44:10.047 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00024683700000000002 2024-02-19T21:44:10.047 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.047 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.047 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:10.047 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.359063+0000", 2024-02-19T21:44:10.047 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.083179931999999998 2024-02-19T21:44:10.048 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.048 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.048 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:10.048 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.442243+0000", 2024-02-19T21:44:10.048 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.4695999999999999e-05 2024-02-19T21:44:10.048 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.048 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.048 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:44:10.048 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.442297+0000", 2024-02-19T21:44:10.048 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0704999999999997e-05 2024-02-19T21:44:10.048 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:44:10.048 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:44:10.048 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:44:10.048 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.442338+0000", 2024-02-19T21:44:10.049 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.086960934000000004 2024-02-19T21:44:10.049 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:10.049 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:44:10.049 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:10.049 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:44:10.049 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:44:10.049 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:44:10.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:08.269616+0000 osd.6 (osd.6) 148 : cluster [DBG] 6.2 scrub starts 2024-02-19T21:44:10.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:08.280934+0000 osd.6 (osd.6) 149 : cluster [DBG] 6.2 scrub ok 2024-02-19T21:44:10.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:09.039619+0000 mgr.y (mgr.14514) 446 : cluster [DBG] pgmap v532: 121 pgs: 121 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:44:10.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:09.120640+0000 mon.a (mon.0) 1243 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:44:10.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:09.120661+0000 mon.a (mon.0) 1244 : cluster [INF] Cluster is now healthy 2024-02-19T21:44:10.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:09.134908+0000 mon.a (mon.0) 1245 : audit [INF] from='client.? 172.21.15.80:0/409874260' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:44:10.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:09.134958+0000 mon.a (mon.0) 1246 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "30"}]': finished 2024-02-19T21:44:10.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:09.135008+0000 mon.a (mon.0) 1247 : cluster [DBG] osdmap e262: 8 total, 8 up, 7 in 2024-02-19T21:44:10.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:09.137361+0000 osd.7 (osd.7) 167 : cluster [DBG] 6.12 scrub starts 2024-02-19T21:44:10.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:09.151486+0000 osd.7 (osd.7) 168 : cluster [DBG] 6.12 scrub ok 2024-02-19T21:44:10.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:09.543144+0000 osd.3 (osd.3) 178 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:44:10.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:09.544241+0000 osd.3 (osd.3) 179 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:44:10.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:08.269616+0000 osd.6 (osd.6) 148 : cluster [DBG] 6.2 scrub starts 2024-02-19T21:44:10.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:08.280934+0000 osd.6 (osd.6) 149 : cluster [DBG] 6.2 scrub ok 2024-02-19T21:44:10.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:09.039619+0000 mgr.y (mgr.14514) 446 : cluster [DBG] pgmap v532: 121 pgs: 121 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:44:10.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:09.120640+0000 mon.a (mon.0) 1243 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:44:10.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:09.120661+0000 mon.a (mon.0) 1244 : cluster [INF] Cluster is now healthy 2024-02-19T21:44:10.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:09.134908+0000 mon.a (mon.0) 1245 : audit [INF] from='client.? 172.21.15.80:0/409874260' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:44:10.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:09.134958+0000 mon.a (mon.0) 1246 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "30"}]': finished 2024-02-19T21:44:10.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:09.135008+0000 mon.a (mon.0) 1247 : cluster [DBG] osdmap e262: 8 total, 8 up, 7 in 2024-02-19T21:44:10.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:09.137361+0000 osd.7 (osd.7) 167 : cluster [DBG] 6.12 scrub starts 2024-02-19T21:44:10.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:09.151486+0000 osd.7 (osd.7) 168 : cluster [DBG] 6.12 scrub ok 2024-02-19T21:44:10.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:09.543144+0000 osd.3 (osd.3) 178 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:44:10.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:09.544241+0000 osd.3 (osd.3) 179 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:44:10.427 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:44:10.430 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:10.431 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:44:10.499 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:08.269616+0000 osd.6 (osd.6) 148 : cluster [DBG] 6.2 scrub starts 2024-02-19T21:44:10.499 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:08.280934+0000 osd.6 (osd.6) 149 : cluster [DBG] 6.2 scrub ok 2024-02-19T21:44:10.500 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:09.039619+0000 mgr.y (mgr.14514) 446 : cluster [DBG] pgmap v532: 121 pgs: 121 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:44:10.500 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:09.120640+0000 mon.a (mon.0) 1243 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:44:10.500 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:09.120661+0000 mon.a (mon.0) 1244 : cluster [INF] Cluster is now healthy 2024-02-19T21:44:10.500 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:09.134908+0000 mon.a (mon.0) 1245 : audit [INF] from='client.? 172.21.15.80:0/409874260' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:44:10.500 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:09.134958+0000 mon.a (mon.0) 1246 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "30"}]': finished 2024-02-19T21:44:10.500 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:09.135008+0000 mon.a (mon.0) 1247 : cluster [DBG] osdmap e262: 8 total, 8 up, 7 in 2024-02-19T21:44:10.500 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:09.137361+0000 osd.7 (osd.7) 167 : cluster [DBG] 6.12 scrub starts 2024-02-19T21:44:10.500 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:09.151486+0000 osd.7 (osd.7) 168 : cluster [DBG] 6.12 scrub ok 2024-02-19T21:44:10.500 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:09.543144+0000 osd.3 (osd.3) 178 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:44:10.500 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:09.544241+0000 osd.3 (osd.3) 179 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:44:10.532 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:44:10.559 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:10.699 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.7 dump_ops_in_flight 2024-02-19T21:44:10.706 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:44:10.711 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:10.712 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:44:10.718 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:44:10.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:44:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:44:10.813 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:44:10.842 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:10.970 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:44:10.975 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:44:10.976 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:44:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:44:10] "GET /metrics HTTP/1.1" 200 175976 "" "Prometheus/2.33.4" 2024-02-19T21:44:10.978 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:10.979 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:44:11.080 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:44:11.109 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:11.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:09.642663+0000 osd.1 (osd.1) 161 : cluster [DBG] 2.10 scrub starts 2024-02-19T21:44:11.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:09.645603+0000 osd.1 (osd.1) 162 : cluster [DBG] 2.10 scrub ok 2024-02-19T21:44:11.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:10.183296+0000 mon.a (mon.0) 1248 : cluster [DBG] osdmap e263: 8 total, 8 up, 7 in 2024-02-19T21:44:11.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:10.499503+0000 mgr.y (mgr.14514) 447 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:44:11.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:10.522255+0000 osd.5 (osd.5) 179 : cluster [DBG] 2.2 scrub starts 2024-02-19T21:44:11.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:10.523327+0000 osd.5 (osd.5) 180 : cluster [DBG] 2.2 scrub ok 2024-02-19T21:44:11.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:10.530785+0000 osd.3 (osd.3) 180 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:44:11.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:10.534544+0000 osd.3 (osd.3) 181 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:44:11.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:09.642663+0000 osd.1 (osd.1) 161 : cluster [DBG] 2.10 scrub starts 2024-02-19T21:44:11.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:09.645603+0000 osd.1 (osd.1) 162 : cluster [DBG] 2.10 scrub ok 2024-02-19T21:44:11.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:10.183296+0000 mon.a (mon.0) 1248 : cluster [DBG] osdmap e263: 8 total, 8 up, 7 in 2024-02-19T21:44:11.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:10.499503+0000 mgr.y (mgr.14514) 447 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:44:11.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:10.522255+0000 osd.5 (osd.5) 179 : cluster [DBG] 2.2 scrub starts 2024-02-19T21:44:11.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:10.523327+0000 osd.5 (osd.5) 180 : cluster [DBG] 2.2 scrub ok 2024-02-19T21:44:11.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:10.530785+0000 osd.3 (osd.3) 180 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:44:11.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:10.534544+0000 osd.3 (osd.3) 181 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:44:11.516 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:09.642663+0000 osd.1 (osd.1) 161 : cluster [DBG] 2.10 scrub starts 2024-02-19T21:44:11.516 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:09.645603+0000 osd.1 (osd.1) 162 : cluster [DBG] 2.10 scrub ok 2024-02-19T21:44:11.516 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:10.183296+0000 mon.a (mon.0) 1248 : cluster [DBG] osdmap e263: 8 total, 8 up, 7 in 2024-02-19T21:44:11.516 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:10.499503+0000 mgr.y (mgr.14514) 447 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:44:11.516 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:10.522255+0000 osd.5 (osd.5) 179 : cluster [DBG] 2.2 scrub starts 2024-02-19T21:44:11.516 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:10.523327+0000 osd.5 (osd.5) 180 : cluster [DBG] 2.2 scrub ok 2024-02-19T21:44:11.516 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:10.530785+0000 osd.3 (osd.3) 180 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:44:11.516 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:10.534544+0000 osd.3 (osd.3) 181 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:44:11.542 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:44:11.545 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:11.545 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:44:11.646 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:44:11.676 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:11.839 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:44:11.839 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:44:11.839 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:44:11.839 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:44:11.839 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:44:11.840 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:44:11.840 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:44:11.840 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:44:11.840 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:44:11.840 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:44:11.840 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:44:11.840 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:44:11.840 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:44:11.840 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:44:11.840 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:44:11.841 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:44:12.022 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:44:12.051 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set noscrub 2024-02-19T21:44:12.247 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:11.040074+0000 mgr.y (mgr.14514) 448 : cluster [DBG] pgmap v535: 121 pgs: 2 peering, 119 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:44:12.247 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:11.160276+0000 osd.7 (osd.7) 169 : cluster [DBG] 5.9 scrub starts 2024-02-19T21:44:12.247 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:11.163715+0000 osd.7 (osd.7) 170 : cluster [DBG] 5.9 scrub ok 2024-02-19T21:44:12.247 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:11.195409+0000 mon.a (mon.0) 1249 : cluster [DBG] osdmap e264: 8 total, 8 up, 7 in 2024-02-19T21:44:12.247 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:11.208779+0000 mon.a (mon.0) 1250 : audit [DBG] from='client.? 172.21.15.80:0/2506211563' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:44:12.247 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:11.224719+0000 osd.6 (osd.6) 150 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:44:12.247 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:11.227737+0000 osd.6 (osd.6) 151 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:44:12.247 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:11.484615+0000 osd.5 (osd.5) 181 : cluster [DBG] 2.16 scrub starts 2024-02-19T21:44:12.247 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:11.487505+0000 osd.5 (osd.5) 182 : cluster [DBG] 2.16 scrub ok 2024-02-19T21:44:12.248 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:11.565862+0000 osd.4 (osd.4) 140 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:44:12.248 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:11.584410+0000 osd.4 (osd.4) 141 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:44:12.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:11.040074+0000 mgr.y (mgr.14514) 448 : cluster [DBG] pgmap v535: 121 pgs: 2 peering, 119 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:44:12.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:11.160276+0000 osd.7 (osd.7) 169 : cluster [DBG] 5.9 scrub starts 2024-02-19T21:44:12.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:11.163715+0000 osd.7 (osd.7) 170 : cluster [DBG] 5.9 scrub ok 2024-02-19T21:44:12.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:11.195409+0000 mon.a (mon.0) 1249 : cluster [DBG] osdmap e264: 8 total, 8 up, 7 in 2024-02-19T21:44:12.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:11.208779+0000 mon.a (mon.0) 1250 : audit [DBG] from='client.? 172.21.15.80:0/2506211563' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:44:12.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:11.224719+0000 osd.6 (osd.6) 150 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:44:12.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:11.227737+0000 osd.6 (osd.6) 151 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:44:12.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:11.484615+0000 osd.5 (osd.5) 181 : cluster [DBG] 2.16 scrub starts 2024-02-19T21:44:12.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:11.487505+0000 osd.5 (osd.5) 182 : cluster [DBG] 2.16 scrub ok 2024-02-19T21:44:12.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:11.565862+0000 osd.4 (osd.4) 140 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:44:12.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:11.584410+0000 osd.4 (osd.4) 141 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:44:12.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:11.040074+0000 mgr.y (mgr.14514) 448 : cluster [DBG] pgmap v535: 121 pgs: 2 peering, 119 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:44:12.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:11.160276+0000 osd.7 (osd.7) 169 : cluster [DBG] 5.9 scrub starts 2024-02-19T21:44:12.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:11.163715+0000 osd.7 (osd.7) 170 : cluster [DBG] 5.9 scrub ok 2024-02-19T21:44:12.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:11.195409+0000 mon.a (mon.0) 1249 : cluster [DBG] osdmap e264: 8 total, 8 up, 7 in 2024-02-19T21:44:12.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:11.208779+0000 mon.a (mon.0) 1250 : audit [DBG] from='client.? 172.21.15.80:0/2506211563' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:44:12.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:11.224719+0000 osd.6 (osd.6) 150 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:44:12.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:11.227737+0000 osd.6 (osd.6) 151 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:44:12.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:11.484615+0000 osd.5 (osd.5) 181 : cluster [DBG] 2.16 scrub starts 2024-02-19T21:44:12.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:11.487505+0000 osd.5 (osd.5) 182 : cluster [DBG] 2.16 scrub ok 2024-02-19T21:44:12.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:11.565862+0000 osd.4 (osd.4) 140 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:44:12.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:11.584410+0000 osd.4 (osd.4) 141 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:44:12.525 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:44:12.527 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:12.528 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:44:12.628 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:44:12.657 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:12.855 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:44:12.857 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:12.858 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:44:12.878 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:44:12.878 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:44:12.959 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:44:12.987 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:13.135 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:44:13.138 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:13.138 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:44:13.239 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:44:13.273 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:13.310 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:44:13.317 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:13.318 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:44:13.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:11.726331+0000 osd.1 (osd.1) 163 : cluster [DBG] 4.d scrub starts 2024-02-19T21:44:13.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:11.728407+0000 osd.1 (osd.1) 164 : cluster [DBG] 4.d scrub ok 2024-02-19T21:44:13.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:12.203537+0000 mon.a (mon.0) 1251 : cluster [DBG] osdmap e265: 8 total, 8 up, 7 in 2024-02-19T21:44:13.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:12.590818+0000 osd.4 (osd.4) 142 : cluster [DBG] 6.6 deep-scrub starts 2024-02-19T21:44:13.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:12.609166+0000 osd.4 (osd.4) 143 : cluster [DBG] 6.6 deep-scrub ok 2024-02-19T21:44:13.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:13.041138+0000 mon.a (mon.0) 1252 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd rm-pg-upmap", "pgid": "5.d"}]: dispatch 2024-02-19T21:44:13.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:13.041294+0000 mon.a (mon.0) 1253 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd rm-pg-upmap-items", "pgid": "5.d"}]: dispatch 2024-02-19T21:44:13.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:11.726331+0000 osd.1 (osd.1) 163 : cluster [DBG] 4.d scrub starts 2024-02-19T21:44:13.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:11.728407+0000 osd.1 (osd.1) 164 : cluster [DBG] 4.d scrub ok 2024-02-19T21:44:13.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:12.203537+0000 mon.a (mon.0) 1251 : cluster [DBG] osdmap e265: 8 total, 8 up, 7 in 2024-02-19T21:44:13.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:12.590818+0000 osd.4 (osd.4) 142 : cluster [DBG] 6.6 deep-scrub starts 2024-02-19T21:44:13.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:12.609166+0000 osd.4 (osd.4) 143 : cluster [DBG] 6.6 deep-scrub ok 2024-02-19T21:44:13.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:13.041138+0000 mon.a (mon.0) 1252 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd rm-pg-upmap", "pgid": "5.d"}]: dispatch 2024-02-19T21:44:13.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:13.041294+0000 mon.a (mon.0) 1253 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd rm-pg-upmap-items", "pgid": "5.d"}]: dispatch 2024-02-19T21:44:13.419 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:44:13.447 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:13.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:11.726331+0000 osd.1 (osd.1) 163 : cluster [DBG] 4.d scrub starts 2024-02-19T21:44:13.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:11.728407+0000 osd.1 (osd.1) 164 : cluster [DBG] 4.d scrub ok 2024-02-19T21:44:13.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:12.203537+0000 mon.a (mon.0) 1251 : cluster [DBG] osdmap e265: 8 total, 8 up, 7 in 2024-02-19T21:44:13.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:12.590818+0000 osd.4 (osd.4) 142 : cluster [DBG] 6.6 deep-scrub starts 2024-02-19T21:44:13.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:12.609166+0000 osd.4 (osd.4) 143 : cluster [DBG] 6.6 deep-scrub ok 2024-02-19T21:44:13.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:13.041138+0000 mon.a (mon.0) 1252 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd rm-pg-upmap", "pgid": "5.d"}]: dispatch 2024-02-19T21:44:13.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:13.041294+0000 mon.a (mon.0) 1253 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd rm-pg-upmap-items", "pgid": "5.d"}]: dispatch 2024-02-19T21:44:13.671 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.7 dump_blocked_ops 2024-02-19T21:44:13.695 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:44:13.698 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:13.698 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:44:13.799 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:44:13.827 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:13.892 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:44:13.900 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:44:13.903 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:13.903 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:44:13.959 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:44:14.004 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:44:14.031 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:14.129 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:44:14.132 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:14.133 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:44:14.233 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:44:14.261 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:14.281 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:44:14.284 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:14.285 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:44:14.385 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:44:14.412 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:14.427 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:44:14.453 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:13.040409+0000 mgr.y (mgr.14514) 449 : cluster [DBG] pgmap v538: 120 pgs: 1 peering, 119 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-02-19T21:44:14.453 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:13.204989+0000 mon.a (mon.0) 1254 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd rm-pg-upmap", "pgid": "5.d"}]': finished 2024-02-19T21:44:14.454 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:13.205068+0000 mon.a (mon.0) 1255 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd rm-pg-upmap-items", "pgid": "5.d"}]': finished 2024-02-19T21:44:14.454 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:13.205131+0000 mon.a (mon.0) 1256 : cluster [DBG] osdmap e266: 8 total, 8 up, 7 in 2024-02-19T21:44:14.454 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:13.508382+0000 osd.5 (osd.5) 183 : cluster [DBG] 5.16 scrub starts 2024-02-19T21:44:14.454 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:13.511567+0000 osd.5 (osd.5) 184 : cluster [DBG] 5.16 scrub ok 2024-02-19T21:44:14.454 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:13.040409+0000 mgr.y (mgr.14514) 449 : cluster [DBG] pgmap v538: 120 pgs: 1 peering, 119 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-02-19T21:44:14.454 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:13.204989+0000 mon.a (mon.0) 1254 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd rm-pg-upmap", "pgid": "5.d"}]': finished 2024-02-19T21:44:14.454 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:13.205068+0000 mon.a (mon.0) 1255 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd rm-pg-upmap-items", "pgid": "5.d"}]': finished 2024-02-19T21:44:14.454 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:13.205131+0000 mon.a (mon.0) 1256 : cluster [DBG] osdmap e266: 8 total, 8 up, 7 in 2024-02-19T21:44:14.454 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:13.508382+0000 osd.5 (osd.5) 183 : cluster [DBG] 5.16 scrub starts 2024-02-19T21:44:14.455 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:13.511567+0000 osd.5 (osd.5) 184 : cluster [DBG] 5.16 scrub ok 2024-02-19T21:44:14.485 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:44:14.487 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:13.040409+0000 mgr.y (mgr.14514) 449 : cluster [DBG] pgmap v538: 120 pgs: 1 peering, 119 active+clean; 5.7 KiB data, 2.2 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-02-19T21:44:14.487 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:13.204989+0000 mon.a (mon.0) 1254 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd rm-pg-upmap", "pgid": "5.d"}]': finished 2024-02-19T21:44:14.488 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:13.205068+0000 mon.a (mon.0) 1255 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd rm-pg-upmap-items", "pgid": "5.d"}]': finished 2024-02-19T21:44:14.488 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:13.205131+0000 mon.a (mon.0) 1256 : cluster [DBG] osdmap e266: 8 total, 8 up, 7 in 2024-02-19T21:44:14.488 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:13.508382+0000 osd.5 (osd.5) 183 : cluster [DBG] 5.16 scrub starts 2024-02-19T21:44:14.488 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:13.511567+0000 osd.5 (osd.5) 184 : cluster [DBG] 5.16 scrub ok 2024-02-19T21:44:14.489 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:14.490 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:44:14.591 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:44:14.619 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:15.115 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'unique_pool_2' created 2024-02-19T21:44:15.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:13.674306+0000 osd.1 (osd.1) 165 : cluster [DBG] 3.0 deep-scrub starts 2024-02-19T21:44:15.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:13.678336+0000 osd.1 (osd.1) 166 : cluster [DBG] 3.0 deep-scrub ok 2024-02-19T21:44:15.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:14.148156+0000 osd.7 (osd.7) 171 : cluster [DBG] 5.19 scrub starts 2024-02-19T21:44:15.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:14.151059+0000 osd.7 (osd.7) 172 : cluster [DBG] 5.19 scrub ok 2024-02-19T21:44:15.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:14.216083+0000 mon.a (mon.0) 1257 : cluster [DBG] osdmap e267: 8 total, 8 up, 7 in 2024-02-19T21:44:15.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:14.472010+0000 osd.5 (osd.5) 185 : cluster [DBG] 2.18 scrub starts 2024-02-19T21:44:15.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:14.474899+0000 osd.5 (osd.5) 186 : cluster [DBG] 2.18 scrub ok 2024-02-19T21:44:15.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:14.667170+0000 mon.c (mon.2) 63 : audit [INF] from='client.? 172.21.15.80:0/667834116' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]: dispatch 2024-02-19T21:44:15.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:14.667572+0000 mon.a (mon.0) 1258 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]: dispatch 2024-02-19T21:44:15.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:15.041998+0000 mon.a (mon.0) 1259 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "29"}]: dispatch 2024-02-19T21:44:15.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:15.108654+0000 mon.a (mon.0) 1260 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]': finished 2024-02-19T21:44:15.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:15.108739+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "29"}]': finished 2024-02-19T21:44:15.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:15.108791+0000 mon.a (mon.0) 1262 : cluster [DBG] osdmap e268: 8 total, 8 up, 7 in 2024-02-19T21:44:15.320 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:44:15.322 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:44:15.368 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:44:15.370 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:15.371 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:44:15.457 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:13.674306+0000 osd.1 (osd.1) 165 : cluster [DBG] 3.0 deep-scrub starts 2024-02-19T21:44:15.457 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:13.678336+0000 osd.1 (osd.1) 166 : cluster [DBG] 3.0 deep-scrub ok 2024-02-19T21:44:15.457 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:14.148156+0000 osd.7 (osd.7) 171 : cluster [DBG] 5.19 scrub starts 2024-02-19T21:44:15.458 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:14.151059+0000 osd.7 (osd.7) 172 : cluster [DBG] 5.19 scrub ok 2024-02-19T21:44:15.458 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:14.216083+0000 mon.a (mon.0) 1257 : cluster [DBG] osdmap e267: 8 total, 8 up, 7 in 2024-02-19T21:44:15.458 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:14.472010+0000 osd.5 (osd.5) 185 : cluster [DBG] 2.18 scrub starts 2024-02-19T21:44:15.458 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:14.474899+0000 osd.5 (osd.5) 186 : cluster [DBG] 2.18 scrub ok 2024-02-19T21:44:15.458 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:14.667170+0000 mon.c (mon.2) 63 : audit [INF] from='client.? 172.21.15.80:0/667834116' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]: dispatch 2024-02-19T21:44:15.458 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:14.667572+0000 mon.a (mon.0) 1258 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]: dispatch 2024-02-19T21:44:15.458 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:15.041998+0000 mon.a (mon.0) 1259 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "29"}]: dispatch 2024-02-19T21:44:15.458 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:15.108654+0000 mon.a (mon.0) 1260 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]': finished 2024-02-19T21:44:15.458 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:15.108739+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "29"}]': finished 2024-02-19T21:44:15.458 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:15.108791+0000 mon.a (mon.0) 1262 : cluster [DBG] osdmap e268: 8 total, 8 up, 7 in 2024-02-19T21:44:15.458 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:13.674306+0000 osd.1 (osd.1) 165 : cluster [DBG] 3.0 deep-scrub starts 2024-02-19T21:44:15.458 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:13.678336+0000 osd.1 (osd.1) 166 : cluster [DBG] 3.0 deep-scrub ok 2024-02-19T21:44:15.459 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:14.148156+0000 osd.7 (osd.7) 171 : cluster [DBG] 5.19 scrub starts 2024-02-19T21:44:15.459 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:14.151059+0000 osd.7 (osd.7) 172 : cluster [DBG] 5.19 scrub ok 2024-02-19T21:44:15.459 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:14.216083+0000 mon.a (mon.0) 1257 : cluster [DBG] osdmap e267: 8 total, 8 up, 7 in 2024-02-19T21:44:15.459 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:14.472010+0000 osd.5 (osd.5) 185 : cluster [DBG] 2.18 scrub starts 2024-02-19T21:44:15.459 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:14.474899+0000 osd.5 (osd.5) 186 : cluster [DBG] 2.18 scrub ok 2024-02-19T21:44:15.459 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:14.667170+0000 mon.c (mon.2) 63 : audit [INF] from='client.? 172.21.15.80:0/667834116' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]: dispatch 2024-02-19T21:44:15.459 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:14.667572+0000 mon.a (mon.0) 1258 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]: dispatch 2024-02-19T21:44:15.459 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:15.041998+0000 mon.a (mon.0) 1259 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "29"}]: dispatch 2024-02-19T21:44:15.459 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:15.108654+0000 mon.a (mon.0) 1260 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]': finished 2024-02-19T21:44:15.459 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:15.108739+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "29"}]': finished 2024-02-19T21:44:15.459 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:15.108791+0000 mon.a (mon.0) 1262 : cluster [DBG] osdmap e268: 8 total, 8 up, 7 in 2024-02-19T21:44:15.472 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:44:15.501 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:15.879 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:44:15.880 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:44:15.898 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:44:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:44:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:44:16.455 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:14.689689+0000 osd.1 (osd.1) 167 : cluster [DBG] 2.6 scrub starts 2024-02-19T21:44:16.456 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:14.690733+0000 osd.1 (osd.1) 168 : cluster [DBG] 2.6 scrub ok 2024-02-19T21:44:16.456 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:15.041023+0000 mgr.y (mgr.14514) 450 : cluster [DBG] pgmap v541: 120 pgs: 120 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-02-19T21:44:16.456 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:15.306516+0000 mgr.y (mgr.14514) 451 : audit [DBG] from='client.15306 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:44:16.456 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:15.544122+0000 osd.4 (osd.4) 144 : cluster [DBG] 5.a deep-scrub starts 2024-02-19T21:44:16.456 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:15.547124+0000 osd.4 (osd.4) 145 : cluster [DBG] 5.a deep-scrub ok 2024-02-19T21:44:16.456 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:16.108555+0000 mon.a (mon.0) 1263 : cluster [DBG] osdmap e269: 8 total, 8 up, 7 in 2024-02-19T21:44:16.456 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:14.689689+0000 osd.1 (osd.1) 167 : cluster [DBG] 2.6 scrub starts 2024-02-19T21:44:16.456 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:14.690733+0000 osd.1 (osd.1) 168 : cluster [DBG] 2.6 scrub ok 2024-02-19T21:44:16.456 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:15.041023+0000 mgr.y (mgr.14514) 450 : cluster [DBG] pgmap v541: 120 pgs: 120 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-02-19T21:44:16.456 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:15.306516+0000 mgr.y (mgr.14514) 451 : audit [DBG] from='client.15306 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:44:16.457 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:15.544122+0000 osd.4 (osd.4) 144 : cluster [DBG] 5.a deep-scrub starts 2024-02-19T21:44:16.457 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:15.547124+0000 osd.4 (osd.4) 145 : cluster [DBG] 5.a deep-scrub ok 2024-02-19T21:44:16.457 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:16.108555+0000 mon.a (mon.0) 1263 : cluster [DBG] osdmap e269: 8 total, 8 up, 7 in 2024-02-19T21:44:16.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:14.689689+0000 osd.1 (osd.1) 167 : cluster [DBG] 2.6 scrub starts 2024-02-19T21:44:16.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:14.690733+0000 osd.1 (osd.1) 168 : cluster [DBG] 2.6 scrub ok 2024-02-19T21:44:16.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:15.041023+0000 mgr.y (mgr.14514) 450 : cluster [DBG] pgmap v541: 120 pgs: 120 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-02-19T21:44:16.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:15.306516+0000 mgr.y (mgr.14514) 451 : audit [DBG] from='client.15306 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:44:16.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:15.544122+0000 osd.4 (osd.4) 144 : cluster [DBG] 5.a deep-scrub starts 2024-02-19T21:44:16.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:15.547124+0000 osd.4 (osd.4) 145 : cluster [DBG] 5.a deep-scrub ok 2024-02-19T21:44:16.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:16.108555+0000 mon.a (mon.0) 1263 : cluster [DBG] osdmap e269: 8 total, 8 up, 7 in 2024-02-19T21:44:16.630 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.7 dump_historic_ops 2024-02-19T21:44:16.750 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:44:16.753 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:16.753 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:44:16.854 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:44:16.883 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:16.897 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:44:16.956 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:44:16.960 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:16.961 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:44:17.062 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:44:17.090 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:17.188 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:44:17.193 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:17.194 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:44:17.295 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:44:17.320 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:17.456 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:15.697525+0000 osd.1 (osd.1) 169 : cluster [DBG] 4.1d scrub starts 2024-02-19T21:44:17.457 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:15.699274+0000 osd.1 (osd.1) 170 : cluster [DBG] 4.1d scrub ok 2024-02-19T21:44:17.457 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:16.251541+0000 osd.6 (osd.6) 152 : cluster [DBG] 4.a deep-scrub starts 2024-02-19T21:44:17.457 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:16.255044+0000 osd.6 (osd.6) 153 : cluster [DBG] 4.a deep-scrub ok 2024-02-19T21:44:17.457 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:17.045492+0000 osd.0 (osd.0) 178 : cluster [DBG] 6.11 scrub starts 2024-02-19T21:44:17.457 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:17.079386+0000 osd.0 (osd.0) 179 : cluster [DBG] 6.11 scrub ok 2024-02-19T21:44:17.457 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:17.109835+0000 mon.a (mon.0) 1264 : cluster [DBG] osdmap e270: 8 total, 8 up, 7 in 2024-02-19T21:44:17.457 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:17.141615+0000 mon.a (mon.0) 1265 : audit [INF] from='client.? 172.21.15.80:0/3336255068' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:44:17.523 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:15.697525+0000 osd.1 (osd.1) 169 : cluster [DBG] 4.1d scrub starts 2024-02-19T21:44:17.523 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:15.699274+0000 osd.1 (osd.1) 170 : cluster [DBG] 4.1d scrub ok 2024-02-19T21:44:17.523 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:16.251541+0000 osd.6 (osd.6) 152 : cluster [DBG] 4.a deep-scrub starts 2024-02-19T21:44:17.523 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:16.255044+0000 osd.6 (osd.6) 153 : cluster [DBG] 4.a deep-scrub ok 2024-02-19T21:44:17.523 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:17.045492+0000 osd.0 (osd.0) 178 : cluster [DBG] 6.11 scrub starts 2024-02-19T21:44:17.523 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:17.079386+0000 osd.0 (osd.0) 179 : cluster [DBG] 6.11 scrub ok 2024-02-19T21:44:17.523 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:17.109835+0000 mon.a (mon.0) 1264 : cluster [DBG] osdmap e270: 8 total, 8 up, 7 in 2024-02-19T21:44:17.523 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:17.141615+0000 mon.a (mon.0) 1265 : audit [INF] from='client.? 172.21.15.80:0/3336255068' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:44:17.524 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:15.697525+0000 osd.1 (osd.1) 169 : cluster [DBG] 4.1d scrub starts 2024-02-19T21:44:17.524 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:15.699274+0000 osd.1 (osd.1) 170 : cluster [DBG] 4.1d scrub ok 2024-02-19T21:44:17.524 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:16.251541+0000 osd.6 (osd.6) 152 : cluster [DBG] 4.a deep-scrub starts 2024-02-19T21:44:17.524 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:16.255044+0000 osd.6 (osd.6) 153 : cluster [DBG] 4.a deep-scrub ok 2024-02-19T21:44:17.524 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:17.045492+0000 osd.0 (osd.0) 178 : cluster [DBG] 6.11 scrub starts 2024-02-19T21:44:17.524 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:17.079386+0000 osd.0 (osd.0) 179 : cluster [DBG] 6.11 scrub ok 2024-02-19T21:44:17.524 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:17.109835+0000 mon.a (mon.0) 1264 : cluster [DBG] osdmap e270: 8 total, 8 up, 7 in 2024-02-19T21:44:17.524 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:17.141615+0000 mon.a (mon.0) 1265 : audit [INF] from='client.? 172.21.15.80:0/3336255068' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:44:17.540 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":542,"stamp":"2024-02-19T21:44:15.105661+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5796,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":1831,"num_read_kb":1583,"num_write":714,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":4733,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":813,"ondisk_log_size":813,"up":360,"acting":360,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":656216064,"kb_used":2241300,"kb_used_data":115676,"kb_used_omap":0,"kb_used_meta":2125568,"kb_avail":653974764,"statfs":{"total":671965249536,"available":669670158336,"internally_reserved":0,"allocated":118452224,"data_stored":115219281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2176581632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.912366"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":16,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-02-19T21:44:09.137907+0000","last_change":"2024-02-19T21:44:00.196871+0000","last_active":"2024-02-19T21:44:09.137907+0000","last_peered":"2024-02-19T21:44:09.137907+0000","last_clean":"2024-02-19T21:44:09.137907+0000","last_became_active":"2024-02-19T21:44:00.196460+0000","last_became_peered":"2024-02-19T21:44:00.196460+0000","last_unstale":"2024-02-19T21:44:09.137907+0000","last_undegraded":"2024-02-19T21:44:09.137907+0000","last_fullsized":"2024-02-19T21:44:09.137907+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:23.364579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:23.364579+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":233,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-02-19T21:44:09.139975+0000","last_change":"2024-02-19T21:40:28.473842+0000","last_active":"2024-02-19T21:44:09.139975+0000","last_peered":"2024-02-19T21:44:09.139975+0000","last_clean":"2024-02-19T21:44:09.139975+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:44:09.139975+0000","last_undegraded":"2024-02-19T21:44:09.139975+0000","last_fullsized":"2024-02-19T21:44:09.139975+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:28.473778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:28.473778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"201'27","reported_seq":205,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-02-19T21:44:09.139695+0000","last_change":"2024-02-19T21:39:51.546188+0000","last_active":"2024-02-19T21:44:09.139695+0000","last_peered":"2024-02-19T21:44:09.139695+0000","last_clean":"2024-02-19T21:44:09.139695+0000","last_became_active":"2024-02-19T21:39:51.536424+0000","last_became_peered":"2024-02-19T21:39:51.536424+0000","last_unstale":"2024-02-19T21:44:09.139695+0000","last_undegraded":"2024-02-19T21:44:09.139695+0000","last_fullsized":"2024-02-19T21:44:09.139695+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:39:29.269819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:29.269819+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":25,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:14.151149+0000","last_change":"2024-02-19T21:44:14.151126+0000","last_active":"2024-02-19T21:44:14.151149+0000","last_peered":"2024-02-19T21:44:14.151149+0000","last_clean":"2024-02-19T21:44:14.151149+0000","last_became_active":"2024-02-19T21:44:00.194595+0000","last_became_peered":"2024-02-19T21:44:00.194595+0000","last_unstale":"2024-02-19T21:44:14.151149+0000","last_undegraded":"2024-02-19T21:44:14.151149+0000","last_fullsized":"2024-02-19T21:44:14.151149+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:14.151063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:25.265482+0000","last_clean_scrub_stamp":"2024-02-19T21:44:14.151063+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":241,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.512868+0000","last_change":"2024-02-19T21:44:09.544309+0000","last_active":"2024-02-19T21:44:13.512868+0000","last_peered":"2024-02-19T21:44:13.512868+0000","last_clean":"2024-02-19T21:44:13.512868+0000","last_became_active":"2024-02-19T21:32:23.356975+0000","last_became_peered":"2024-02-19T21:32:23.356975+0000","last_unstale":"2024-02-19T21:44:13.512868+0000","last_undegraded":"2024-02-19T21:44:13.512868+0000","last_fullsized":"2024-02-19T21:44:13.512868+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:09.544245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:44:09.544245+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"200'19","reported_seq":281,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.203149+0000","last_change":"2024-02-19T21:44:08.556202+0000","last_active":"2024-02-19T21:44:13.203149+0000","last_peered":"2024-02-19T21:44:13.203149+0000","last_clean":"2024-02-19T21:44:13.203149+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:44:13.203149+0000","last_undegraded":"2024-02-19T21:44:13.203149+0000","last_fullsized":"2024-02-19T21:44:13.203149+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:44:08.556123+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:44:08.556123+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.203992+0000","last_change":"2024-02-19T21:44:05.553273+0000","last_active":"2024-02-19T21:44:13.203992+0000","last_peered":"2024-02-19T21:44:13.203992+0000","last_clean":"2024-02-19T21:44:13.203992+0000","last_became_active":"2024-02-19T21:44:00.196246+0000","last_became_peered":"2024-02-19T21:44:00.196246+0000","last_unstale":"2024-02-19T21:44:13.203992+0000","last_undegraded":"2024-02-19T21:44:13.203992+0000","last_fullsized":"2024-02-19T21:44:13.203992+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:05.553187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:05.553187+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1],"acting":[4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":238,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.511160+0000","last_change":"2024-02-19T21:40:34.884850+0000","last_active":"2024-02-19T21:44:13.511160+0000","last_peered":"2024-02-19T21:44:13.511160+0000","last_clean":"2024-02-19T21:44:13.511160+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:44:13.511160+0000","last_undegraded":"2024-02-19T21:44:13.511160+0000","last_fullsized":"2024-02-19T21:44:13.511160+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:34.884780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:08.490788+0000","last_clean_scrub_stamp":"2024-02-19T21:40:34.884780+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"200'7","reported_seq":236,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.512902+0000","last_change":"2024-02-19T21:44:07.580183+0000","last_active":"2024-02-19T21:44:13.512902+0000","last_peered":"2024-02-19T21:44:13.512902+0000","last_clean":"2024-02-19T21:44:13.512902+0000","last_became_active":"2024-02-19T21:39:39.471143+0000","last_became_peered":"2024-02-19T21:39:39.471143+0000","last_unstale":"2024-02-19T21:44:13.512902+0000","last_undegraded":"2024-02-19T21:44:13.512902+0000","last_fullsized":"2024-02-19T21:44:13.512902+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'7","last_scrub_stamp":"2024-02-19T21:44:07.580118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:07.580118+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":186,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-02-19T21:44:09.140068+0000","last_change":"2024-02-19T21:44:00.198055+0000","last_active":"2024-02-19T21:44:09.140068+0000","last_peered":"2024-02-19T21:44:09.140068+0000","last_clean":"2024-02-19T21:44:09.140068+0000","last_became_active":"2024-02-19T21:44:00.197676+0000","last_became_peered":"2024-02-19T21:44:00.197676+0000","last_unstale":"2024-02-19T21:44:09.140068+0000","last_undegraded":"2024-02-19T21:44:09.140068+0000","last_fullsized":"2024-02-19T21:44:09.140068+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:32.576698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:46.543259+0000","last_clean_scrub_stamp":"2024-02-19T21:41:32.576698+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":245,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.510920+0000","last_change":"2024-02-19T21:40:16.864005+0000","last_active":"2024-02-19T21:44:13.510920+0000","last_peered":"2024-02-19T21:44:13.510920+0000","last_clean":"2024-02-19T21:44:13.510920+0000","last_became_active":"2024-02-19T21:39:39.473759+0000","last_became_peered":"2024-02-19T21:39:39.473759+0000","last_unstale":"2024-02-19T21:44:13.510920+0000","last_undegraded":"2024-02-19T21:44:13.510920+0000","last_fullsized":"2024-02-19T21:44:13.510920+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:16.863939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:16.863939+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"200'19","reported_seq":259,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.512821+0000","last_change":"2024-02-19T21:39:47.395697+0000","last_active":"2024-02-19T21:44:13.512821+0000","last_peered":"2024-02-19T21:44:13.512821+0000","last_clean":"2024-02-19T21:44:13.512821+0000","last_became_active":"2024-02-19T21:35:14.514971+0000","last_became_peered":"2024-02-19T21:35:14.514971+0000","last_unstale":"2024-02-19T21:44:13.512821+0000","last_undegraded":"2024-02-19T21:44:13.512821+0000","last_fullsized":"2024-02-19T21:44:13.512821+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'13","last_scrub_stamp":"2024-02-19T21:39:47.395572+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:39:47.395572+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":153,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.205920+0000","last_change":"2024-02-19T21:44:00.198618+0000","last_active":"2024-02-19T21:44:13.205920+0000","last_peered":"2024-02-19T21:44:13.205920+0000","last_clean":"2024-02-19T21:44:13.205920+0000","last_became_active":"2024-02-19T21:44:00.198286+0000","last_became_peered":"2024-02-19T21:44:00.198286+0000","last_unstale":"2024-02-19T21:44:13.205920+0000","last_undegraded":"2024-02-19T21:44:13.205920+0000","last_fullsized":"2024-02-19T21:44:13.205920+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:34.364412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:34.364412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":118,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.674480+0000","last_change":"2024-02-19T21:42:04.201407+0000","last_active":"2024-02-19T21:44:13.674480+0000","last_peered":"2024-02-19T21:44:13.674480+0000","last_clean":"2024-02-19T21:44:13.674480+0000","last_became_active":"2024-02-19T21:42:04.201106+0000","last_became_peered":"2024-02-19T21:42:04.201106+0000","last_unstale":"2024-02-19T21:44:13.674480+0000","last_undegraded":"2024-02-19T21:44:13.674480+0000","last_fullsized":"2024-02-19T21:44:13.674480+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:24.788644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:24.788644+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,5],"acting":[6,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"201'18","reported_seq":195,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.205793+0000","last_change":"2024-02-19T21:39:21.126642+0000","last_active":"2024-02-19T21:44:13.205793+0000","last_peered":"2024-02-19T21:44:13.205793+0000","last_clean":"2024-02-19T21:44:13.205793+0000","last_became_active":"2024-02-19T21:38:31.247067+0000","last_became_peered":"2024-02-19T21:38:31.247067+0000","last_unstale":"2024-02-19T21:44:13.205793+0000","last_undegraded":"2024-02-19T21:44:13.205793+0000","last_fullsized":"2024-02-19T21:44:13.205793+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'12","last_scrub_stamp":"2024-02-19T21:39:21.126563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:21.126563+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.511367+0000","last_change":"2024-02-19T21:44:00.193976+0000","last_active":"2024-02-19T21:44:13.511367+0000","last_peered":"2024-02-19T21:44:13.511367+0000","last_clean":"2024-02-19T21:44:13.511367+0000","last_became_active":"2024-02-19T21:44:00.193680+0000","last_became_peered":"2024-02-19T21:44:00.193680+0000","last_unstale":"2024-02-19T21:44:13.511367+0000","last_undegraded":"2024-02-19T21:44:13.511367+0000","last_fullsized":"2024-02-19T21:44:13.511367+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:15.269720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:15.269720+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":241,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.674283+0000","last_change":"2024-02-19T21:40:38.600031+0000","last_active":"2024-02-19T21:44:13.674283+0000","last_peered":"2024-02-19T21:44:13.674283+0000","last_clean":"2024-02-19T21:44:13.674283+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:44:13.674283+0000","last_undegraded":"2024-02-19T21:44:13.674283+0000","last_fullsized":"2024-02-19T21:44:13.674283+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:38.599939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:38.599939+0000","last_clean_scrub_stamp":"2024-02-19T21:40:38.599939+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"200'34","reported_seq":223,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.206135+0000","last_change":"2024-02-19T21:40:36.287163+0000","last_active":"2024-02-19T21:44:13.206135+0000","last_peered":"2024-02-19T21:44:13.206135+0000","last_clean":"2024-02-19T21:44:13.206135+0000","last_became_active":"2024-02-19T21:39:39.477429+0000","last_became_peered":"2024-02-19T21:39:39.477429+0000","last_unstale":"2024-02-19T21:44:13.206135+0000","last_undegraded":"2024-02-19T21:44:13.206135+0000","last_fullsized":"2024-02-19T21:44:13.206135+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'22","last_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.287051+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":162,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.674004+0000","last_change":"2024-02-19T21:42:04.198922+0000","last_active":"2024-02-19T21:44:13.674004+0000","last_peered":"2024-02-19T21:44:13.674004+0000","last_clean":"2024-02-19T21:44:13.674004+0000","last_became_active":"2024-02-19T21:42:04.198592+0000","last_became_peered":"2024-02-19T21:42:04.198592+0000","last_unstale":"2024-02-19T21:44:13.674004+0000","last_undegraded":"2024-02-19T21:44:13.674004+0000","last_fullsized":"2024-02-19T21:44:13.674004+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:33.515188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:33.515188+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"201'19","reported_seq":132,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-02-19T21:44:09.139814+0000","last_change":"2024-02-19T21:39:51.559559+0000","last_active":"2024-02-19T21:44:09.139814+0000","last_peered":"2024-02-19T21:44:09.139814+0000","last_clean":"2024-02-19T21:44:09.139814+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:44:09.139814+0000","last_undegraded":"2024-02-19T21:44:09.139814+0000","last_fullsized":"2024-02-19T21:44:09.139814+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:39:43.209803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:43.209803+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":250,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-19T21:44:14.474971+0000","last_change":"2024-02-19T21:44:14.474971+0000","last_active":"2024-02-19T21:44:14.474971+0000","last_peered":"2024-02-19T21:44:14.474971+0000","last_clean":"2024-02-19T21:44:14.474971+0000","last_became_active":"2024-02-19T21:42:04.199323+0000","last_became_peered":"2024-02-19T21:42:04.199323+0000","last_unstale":"2024-02-19T21:44:14.474971+0000","last_undegraded":"2024-02-19T21:44:14.474971+0000","last_fullsized":"2024-02-19T21:44:14.474971+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:14.474903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:44:14.474903+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"201'20","reported_seq":312,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-02-19T21:44:09.140422+0000","last_change":"2024-02-19T21:42:04.205219+0000","last_active":"2024-02-19T21:44:09.140422+0000","last_peered":"2024-02-19T21:44:09.140422+0000","last_clean":"2024-02-19T21:44:09.140422+0000","last_became_active":"2024-02-19T21:42:04.204882+0000","last_became_peered":"2024-02-19T21:42:04.204882+0000","last_unstale":"2024-02-19T21:44:09.140422+0000","last_undegraded":"2024-02-19T21:44:09.140422+0000","last_fullsized":"2024-02-19T21:44:09.140422+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:39:33.125904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:33.125904+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":144,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-02-19T21:44:09.139662+0000","last_change":"2024-02-19T21:39:39.471651+0000","last_active":"2024-02-19T21:44:09.139662+0000","last_peered":"2024-02-19T21:44:09.139662+0000","last_clean":"2024-02-19T21:44:09.139662+0000","last_became_active":"2024-02-19T21:39:39.471332+0000","last_became_peered":"2024-02-19T21:39:39.471332+0000","last_unstale":"2024-02-19T21:44:09.139662+0000","last_undegraded":"2024-02-19T21:44:09.139662+0000","last_fullsized":"2024-02-19T21:44:09.139662+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:23.270251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:39:23.270251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":234,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.510671+0000","last_change":"2024-02-19T21:41:36.941622+0000","last_active":"2024-02-19T21:44:13.510671+0000","last_peered":"2024-02-19T21:44:13.510671+0000","last_clean":"2024-02-19T21:44:13.510671+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:44:13.510671+0000","last_undegraded":"2024-02-19T21:44:13.510671+0000","last_fullsized":"2024-02-19T21:44:13.510671+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:36.941549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:41:36.941549+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":250,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.674594+0000","last_change":"2024-02-19T21:44:11.227806+0000","last_active":"2024-02-19T21:44:13.674594+0000","last_peered":"2024-02-19T21:44:13.674594+0000","last_clean":"2024-02-19T21:44:13.674594+0000","last_became_active":"2024-02-19T21:39:39.478633+0000","last_became_peered":"2024-02-19T21:39:39.478633+0000","last_unstale":"2024-02-19T21:44:13.674594+0000","last_undegraded":"2024-02-19T21:44:13.674594+0000","last_fullsized":"2024-02-19T21:44:13.674594+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:11.227741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:11.227741+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"201'19","reported_seq":291,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.512896+0000","last_change":"2024-02-19T21:44:10.534619+0000","last_active":"2024-02-19T21:44:13.512896+0000","last_peered":"2024-02-19T21:44:13.512896+0000","last_clean":"2024-02-19T21:44:13.512896+0000","last_became_active":"2024-02-19T21:42:04.205379+0000","last_became_peered":"2024-02-19T21:42:04.205379+0000","last_unstale":"2024-02-19T21:44:13.512896+0000","last_undegraded":"2024-02-19T21:44:13.512896+0000","last_fullsized":"2024-02-19T21:44:13.512896+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:44:10.534549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:10.534549+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":239,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.511187+0000","last_change":"2024-02-19T21:44:09.151576+0000","last_active":"2024-02-19T21:44:13.511187+0000","last_peered":"2024-02-19T21:44:13.511187+0000","last_clean":"2024-02-19T21:44:13.511187+0000","last_became_active":"2024-02-19T21:39:39.471306+0000","last_became_peered":"2024-02-19T21:39:39.471306+0000","last_unstale":"2024-02-19T21:44:13.511187+0000","last_undegraded":"2024-02-19T21:44:13.511187+0000","last_fullsized":"2024-02-19T21:44:13.511187+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:09.151490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:44:09.151490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":280,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.674101+0000","last_change":"2024-02-19T21:44:07.235190+0000","last_active":"2024-02-19T21:44:13.674101+0000","last_peered":"2024-02-19T21:44:13.674101+0000","last_clean":"2024-02-19T21:44:13.674101+0000","last_became_active":"2024-02-19T21:42:04.196794+0000","last_became_peered":"2024-02-19T21:42:04.196794+0000","last_unstale":"2024-02-19T21:44:13.674101+0000","last_undegraded":"2024-02-19T21:44:13.674101+0000","last_fullsized":"2024-02-19T21:44:13.674101+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:07.235071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:07.235071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":245,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.509453+0000","last_change":"2024-02-19T21:44:11.487571+0000","last_active":"2024-02-19T21:44:13.509453+0000","last_peered":"2024-02-19T21:44:13.509453+0000","last_clean":"2024-02-19T21:44:13.509453+0000","last_became_active":"2024-02-19T21:39:39.479927+0000","last_became_peered":"2024-02-19T21:39:39.479927+0000","last_unstale":"2024-02-19T21:44:13.509453+0000","last_undegraded":"2024-02-19T21:44:13.509453+0000","last_fullsized":"2024-02-19T21:44:13.509453+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:11.487509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:44:11.487509+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"200'8","reported_seq":99,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.512669+0000","last_change":"2024-02-19T21:41:42.590833+0000","last_active":"2024-02-19T21:44:13.512669+0000","last_peered":"2024-02-19T21:44:13.512669+0000","last_clean":"2024-02-19T21:44:13.512669+0000","last_became_active":"2024-02-19T21:41:42.243259+0000","last_became_peered":"2024-02-19T21:41:42.243259+0000","last_unstale":"2024-02-19T21:44:13.512669+0000","last_undegraded":"2024-02-19T21:44:13.512669+0000","last_fullsized":"2024-02-19T21:44:13.512669+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'4","last_scrub_stamp":"2024-02-19T21:40:18.214846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:18.214846+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":144,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-02-19T21:44:09.139609+0000","last_change":"2024-02-19T21:39:39.462663+0000","last_active":"2024-02-19T21:44:09.139609+0000","last_peered":"2024-02-19T21:44:09.139609+0000","last_clean":"2024-02-19T21:44:09.139609+0000","last_became_active":"2024-02-19T21:39:39.462363+0000","last_became_peered":"2024-02-19T21:39:39.462363+0000","last_unstale":"2024-02-19T21:44:09.139609+0000","last_undegraded":"2024-02-19T21:44:09.139609+0000","last_fullsized":"2024-02-19T21:44:09.139609+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:26.311526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:39:26.311526+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":246,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.205993+0000","last_change":"2024-02-19T21:42:04.199063+0000","last_active":"2024-02-19T21:44:13.205993+0000","last_peered":"2024-02-19T21:44:13.205993+0000","last_clean":"2024-02-19T21:44:13.205993+0000","last_became_active":"2024-02-19T21:42:04.198684+0000","last_became_peered":"2024-02-19T21:42:04.198684+0000","last_unstale":"2024-02-19T21:44:13.205993+0000","last_undegraded":"2024-02-19T21:44:13.205993+0000","last_fullsized":"2024-02-19T21:44:13.205993+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:26.272653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:26.272653+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":234,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.205628+0000","last_change":"2024-02-19T21:39:33.957921+0000","last_active":"2024-02-19T21:44:13.205628+0000","last_peered":"2024-02-19T21:44:13.205628+0000","last_clean":"2024-02-19T21:44:13.205628+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:44:13.205628+0000","last_undegraded":"2024-02-19T21:44:13.205628+0000","last_fullsized":"2024-02-19T21:44:13.205628+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:33.957814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:39:33.957814+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"201'19","reported_seq":276,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.203605+0000","last_change":"2024-02-19T21:41:23.880621+0000","last_active":"2024-02-19T21:44:13.203605+0000","last_peered":"2024-02-19T21:44:13.203605+0000","last_clean":"2024-02-19T21:44:13.203605+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:44:13.203605+0000","last_undegraded":"2024-02-19T21:44:13.203605+0000","last_fullsized":"2024-02-19T21:44:13.203605+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:41:23.880501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:41:23.880501+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":236,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-02-19T21:44:09.138183+0000","last_change":"2024-02-19T21:44:07.280418+0000","last_active":"2024-02-19T21:44:09.138183+0000","last_peered":"2024-02-19T21:44:09.138183+0000","last_clean":"2024-02-19T21:44:09.138183+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:44:09.138183+0000","last_undegraded":"2024-02-19T21:44:09.138183+0000","last_fullsized":"2024-02-19T21:44:09.138183+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:07.280329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:42.527849+0000","last_clean_scrub_stamp":"2024-02-19T21:44:07.280329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":241,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.512988+0000","last_change":"2024-02-19T21:44:08.574844+0000","last_active":"2024-02-19T21:44:13.512988+0000","last_peered":"2024-02-19T21:44:13.512988+0000","last_clean":"2024-02-19T21:44:13.512988+0000","last_became_active":"2024-02-19T21:39:51.534750+0000","last_became_peered":"2024-02-19T21:39:51.534750+0000","last_unstale":"2024-02-19T21:44:13.512988+0000","last_undegraded":"2024-02-19T21:44:13.512988+0000","last_fullsized":"2024-02-19T21:44:13.512988+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:08.574749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:08.574749+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":241,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.674412+0000","last_change":"2024-02-19T21:41:35.736077+0000","last_active":"2024-02-19T21:44:13.674412+0000","last_peered":"2024-02-19T21:44:13.674412+0000","last_clean":"2024-02-19T21:44:13.674412+0000","last_became_active":"2024-02-19T21:32:23.357338+0000","last_became_peered":"2024-02-19T21:32:23.357338+0000","last_unstale":"2024-02-19T21:44:13.674412+0000","last_undegraded":"2024-02-19T21:44:13.674412+0000","last_fullsized":"2024-02-19T21:44:13.674412+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:35.735995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:41:35.735995+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"200'15","reported_seq":274,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.205756+0000","last_change":"2024-02-19T21:39:45.026756+0000","last_active":"2024-02-19T21:44:13.205756+0000","last_peered":"2024-02-19T21:44:13.205756+0000","last_clean":"2024-02-19T21:44:13.205756+0000","last_became_active":"2024-02-19T21:39:39.466843+0000","last_became_peered":"2024-02-19T21:39:39.466843+0000","last_unstale":"2024-02-19T21:44:13.205756+0000","last_undegraded":"2024-02-19T21:44:13.205756+0000","last_fullsized":"2024-02-19T21:44:13.205756+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:39:45.026689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:45.026689+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"199'13","reported_seq":198,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.206029+0000","last_change":"2024-02-19T21:42:04.202258+0000","last_active":"2024-02-19T21:44:13.206029+0000","last_peered":"2024-02-19T21:44:13.206029+0000","last_clean":"2024-02-19T21:44:13.206029+0000","last_became_active":"2024-02-19T21:42:04.195103+0000","last_became_peered":"2024-02-19T21:42:04.195103+0000","last_unstale":"2024-02-19T21:44:13.206029+0000","last_undegraded":"2024-02-19T21:44:13.206029+0000","last_fullsized":"2024-02-19T21:44:13.206029+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'11","last_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:39:46.054888+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":242,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-02-19T21:44:09.139917+0000","last_change":"2024-02-19T21:40:33.532430+0000","last_active":"2024-02-19T21:44:09.139917+0000","last_peered":"2024-02-19T21:44:09.139917+0000","last_clean":"2024-02-19T21:44:09.139917+0000","last_became_active":"2024-02-19T21:32:23.361680+0000","last_became_peered":"2024-02-19T21:32:23.361680+0000","last_unstale":"2024-02-19T21:44:09.139917+0000","last_undegraded":"2024-02-19T21:44:09.139917+0000","last_fullsized":"2024-02-19T21:44:09.139917+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:33.532354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:33.550655+0000","last_clean_scrub_stamp":"2024-02-19T21:40:33.532354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"201'19","reported_seq":263,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.509202+0000","last_change":"2024-02-19T21:40:37.730352+0000","last_active":"2024-02-19T21:44:13.509202+0000","last_peered":"2024-02-19T21:44:13.509202+0000","last_clean":"2024-02-19T21:44:13.509202+0000","last_became_active":"2024-02-19T21:32:25.372206+0000","last_became_peered":"2024-02-19T21:32:25.372206+0000","last_unstale":"2024-02-19T21:44:13.509202+0000","last_undegraded":"2024-02-19T21:44:13.509202+0000","last_fullsized":"2024-02-19T21:44:13.509202+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'13","last_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:40:37.730197+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":383,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.509482+0000","last_change":"2024-02-19T21:40:32.679041+0000","last_active":"2024-02-19T21:44:13.509482+0000","last_peered":"2024-02-19T21:44:13.509482+0000","last_clean":"2024-02-19T21:44:13.509482+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:44:13.509482+0000","last_undegraded":"2024-02-19T21:44:13.509482+0000","last_fullsized":"2024-02-19T21:44:13.509482+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:40:32.678933+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":247,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.509204+0000","last_change":"2024-02-19T21:42:04.205987+0000","last_active":"2024-02-19T21:44:13.509204+0000","last_peered":"2024-02-19T21:44:13.509204+0000","last_clean":"2024-02-19T21:44:13.509204+0000","last_became_active":"2024-02-19T21:42:04.205401+0000","last_became_peered":"2024-02-19T21:42:04.205401+0000","last_unstale":"2024-02-19T21:44:13.509204+0000","last_undegraded":"2024-02-19T21:44:13.509204+0000","last_fullsized":"2024-02-19T21:44:13.509204+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:25.759697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:40:25.759697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"201'25","reported_seq":269,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.512884+0000","last_change":"2024-02-19T21:40:39.592088+0000","last_active":"2024-02-19T21:44:13.512884+0000","last_peered":"2024-02-19T21:44:13.512884+0000","last_clean":"2024-02-19T21:44:13.512884+0000","last_became_active":"2024-02-19T21:32:25.372060+0000","last_became_peered":"2024-02-19T21:32:25.372060+0000","last_unstale":"2024-02-19T21:44:13.512884+0000","last_undegraded":"2024-02-19T21:44:13.512884+0000","last_fullsized":"2024-02-19T21:44:13.512884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'15","last_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:40:39.591994+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":234,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.511078+0000","last_change":"2024-02-19T21:40:31.892048+0000","last_active":"2024-02-19T21:44:13.511078+0000","last_peered":"2024-02-19T21:44:13.511078+0000","last_clean":"2024-02-19T21:44:13.511078+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:44:13.511078+0000","last_undegraded":"2024-02-19T21:44:13.511078+0000","last_fullsized":"2024-02-19T21:44:13.511078+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:31.891967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_clean_scrub_stamp":"2024-02-19T21:40:31.891967+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":241,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.511703+0000","last_change":"2024-02-19T21:44:13.511663+0000","last_active":"2024-02-19T21:44:13.511703+0000","last_peered":"2024-02-19T21:44:13.511703+0000","last_clean":"2024-02-19T21:44:13.511703+0000","last_became_active":"2024-02-19T21:44:00.196223+0000","last_became_peered":"2024-02-19T21:44:00.196223+0000","last_unstale":"2024-02-19T21:44:13.511703+0000","last_undegraded":"2024-02-19T21:44:13.511703+0000","last_fullsized":"2024-02-19T21:44:13.511703+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:13.511574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:36.067354+0000","last_clean_scrub_stamp":"2024-02-19T21:44:13.511574+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":236,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.674101+0000","last_change":"2024-02-19T21:40:29.421893+0000","last_active":"2024-02-19T21:44:13.674101+0000","last_peered":"2024-02-19T21:44:13.674101+0000","last_clean":"2024-02-19T21:44:13.674101+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:44:13.674101+0000","last_undegraded":"2024-02-19T21:44:13.674101+0000","last_fullsized":"2024-02-19T21:44:13.674101+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:29.421791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:29.421791+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"201'12","reported_seq":119,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.205224+0000","last_change":"2024-02-19T21:42:04.203612+0000","last_active":"2024-02-19T21:44:13.205224+0000","last_peered":"2024-02-19T21:44:13.205224+0000","last_clean":"2024-02-19T21:44:13.205224+0000","last_became_active":"2024-02-19T21:42:04.192291+0000","last_became_peered":"2024-02-19T21:42:04.192291+0000","last_unstale":"2024-02-19T21:44:13.205224+0000","last_undegraded":"2024-02-19T21:44:13.205224+0000","last_fullsized":"2024-02-19T21:44:13.205224+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'6","last_scrub_stamp":"2024-02-19T21:39:24.011489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:24.011489+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":123,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.203556+0000","last_change":"2024-02-19T21:44:11.584507+0000","last_active":"2024-02-19T21:44:13.203556+0000","last_peered":"2024-02-19T21:44:13.203556+0000","last_clean":"2024-02-19T21:44:13.203556+0000","last_became_active":"2024-02-19T21:39:39.469477+0000","last_became_peered":"2024-02-19T21:39:39.469477+0000","last_unstale":"2024-02-19T21:44:13.203556+0000","last_undegraded":"2024-02-19T21:44:13.203556+0000","last_fullsized":"2024-02-19T21:44:13.203556+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:11.584416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:44:11.584416+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.509649+0000","last_change":"2024-02-19T21:44:00.198873+0000","last_active":"2024-02-19T21:44:13.509649+0000","last_peered":"2024-02-19T21:44:13.509649+0000","last_clean":"2024-02-19T21:44:13.509649+0000","last_became_active":"2024-02-19T21:44:00.198539+0000","last_became_peered":"2024-02-19T21:44:00.198539+0000","last_unstale":"2024-02-19T21:44:13.509649+0000","last_undegraded":"2024-02-19T21:44:13.509649+0000","last_fullsized":"2024-02-19T21:44:13.509649+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:34.284787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:34.284787+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":118,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.204021+0000","last_change":"2024-02-19T21:44:09.645675+0000","last_active":"2024-02-19T21:44:13.204021+0000","last_peered":"2024-02-19T21:44:13.204021+0000","last_clean":"2024-02-19T21:44:13.204021+0000","last_became_active":"2024-02-19T21:39:39.477308+0000","last_became_peered":"2024-02-19T21:39:39.477308+0000","last_unstale":"2024-02-19T21:44:13.204021+0000","last_undegraded":"2024-02-19T21:44:13.204021+0000","last_fullsized":"2024-02-19T21:44:13.204021+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:09.645607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:44:09.645607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"200'15","reported_seq":313,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-02-19T21:44:09.140308+0000","last_change":"2024-02-19T21:42:04.226031+0000","last_active":"2024-02-19T21:44:09.140308+0000","last_peered":"2024-02-19T21:44:09.140308+0000","last_clean":"2024-02-19T21:44:09.140308+0000","last_became_active":"2024-02-19T21:42:04.207069+0000","last_became_peered":"2024-02-19T21:42:04.207069+0000","last_unstale":"2024-02-19T21:44:09.140308+0000","last_undegraded":"2024-02-19T21:44:09.140308+0000","last_fullsized":"2024-02-19T21:44:09.140308+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:39:46.193426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:46.193426+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-19T21:44:15.102141+0000","last_change":"2024-02-19T21:44:15.102141+0000","last_active":"2024-02-19T21:44:15.102141+0000","last_peered":"2024-02-19T21:44:15.102141+0000","last_clean":"2024-02-19T21:44:15.102141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-19T21:44:15.102141+0000","last_undegraded":"2024-02-19T21:44:15.102141+0000","last_fullsized":"2024-02-19T21:44:15.102141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":257,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.512975+0000","last_change":"2024-02-19T21:43:02.217061+0000","last_active":"2024-02-19T21:44:13.512975+0000","last_peered":"2024-02-19T21:44:13.512975+0000","last_clean":"2024-02-19T21:44:13.512975+0000","last_became_active":"2024-02-19T21:43:02.216721+0000","last_became_peered":"2024-02-19T21:43:02.216721+0000","last_unstale":"2024-02-19T21:44:13.512975+0000","last_undegraded":"2024-02-19T21:44:13.512975+0000","last_fullsized":"2024-02-19T21:44:13.512975+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:35.539219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:40:35.539219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"59'2","reported_seq":264,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.203731+0000","last_change":"2024-02-19T21:41:24.914001+0000","last_active":"2024-02-19T21:44:13.203731+0000","last_peered":"2024-02-19T21:44:13.203731+0000","last_clean":"2024-02-19T21:44:13.203731+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:44:13.203731+0000","last_undegraded":"2024-02-19T21:44:13.203731+0000","last_fullsized":"2024-02-19T21:44:13.203731+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-02-19T21:41:24.913925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:41:24.913925+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"200'23","reported_seq":276,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.203830+0000","last_change":"2024-02-19T21:40:37.318743+0000","last_active":"2024-02-19T21:44:13.203830+0000","last_peered":"2024-02-19T21:44:13.203830+0000","last_clean":"2024-02-19T21:44:13.203830+0000","last_became_active":"2024-02-19T21:38:31.247821+0000","last_became_peered":"2024-02-19T21:38:31.247821+0000","last_unstale":"2024-02-19T21:44:13.203830+0000","last_undegraded":"2024-02-19T21:44:13.203830+0000","last_fullsized":"2024-02-19T21:44:13.203830+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'17","last_scrub_stamp":"2024-02-19T21:40:37.318642+0000","last_deep_scrub":"83'17","last_deep_scrub_stamp":"2024-02-19T21:33:43.418450+0000","last_clean_scrub_stamp":"2024-02-19T21:40:37.318642+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":109,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-02-19T21:44:09.138424+0000","last_change":"2024-02-19T21:39:39.467760+0000","last_active":"2024-02-19T21:44:09.138424+0000","last_peered":"2024-02-19T21:44:09.138424+0000","last_clean":"2024-02-19T21:44:09.138424+0000","last_became_active":"2024-02-19T21:39:39.467210+0000","last_became_peered":"2024-02-19T21:39:39.467210+0000","last_unstale":"2024-02-19T21:44:09.138424+0000","last_undegraded":"2024-02-19T21:44:09.138424+0000","last_fullsized":"2024-02-19T21:44:09.138424+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:37.384723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:37.384723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-19T21:44:15.102141+0000","last_change":"2024-02-19T21:44:15.102141+0000","last_active":"2024-02-19T21:44:15.102141+0000","last_peered":"2024-02-19T21:44:15.102141+0000","last_clean":"2024-02-19T21:44:15.102141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-19T21:44:15.102141+0000","last_undegraded":"2024-02-19T21:44:15.102141+0000","last_fullsized":"2024-02-19T21:44:15.102141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":254,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-02-19T21:44:09.138196+0000","last_change":"2024-02-19T21:41:42.246007+0000","last_active":"2024-02-19T21:44:09.138196+0000","last_peered":"2024-02-19T21:44:09.138196+0000","last_clean":"2024-02-19T21:44:09.138196+0000","last_became_active":"2024-02-19T21:41:42.245788+0000","last_became_peered":"2024-02-19T21:41:42.245788+0000","last_unstale":"2024-02-19T21:44:09.138196+0000","last_undegraded":"2024-02-19T21:44:09.138196+0000","last_fullsized":"2024-02-19T21:44:09.138196+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:40.474333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:40.474333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":232,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.206128+0000","last_change":"2024-02-19T21:39:34.971980+0000","last_active":"2024-02-19T21:44:13.206128+0000","last_peered":"2024-02-19T21:44:13.206128+0000","last_clean":"2024-02-19T21:44:13.206128+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:44:13.206128+0000","last_undegraded":"2024-02-19T21:44:13.206128+0000","last_fullsized":"2024-02-19T21:44:13.206128+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:34.971917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:39:34.971917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"201'20","reported_seq":143,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.205879+0000","last_change":"2024-02-19T21:41:22.195267+0000","last_active":"2024-02-19T21:44:13.205879+0000","last_peered":"2024-02-19T21:44:13.205879+0000","last_clean":"2024-02-19T21:44:13.205879+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:44:13.205879+0000","last_undegraded":"2024-02-19T21:44:13.205879+0000","last_fullsized":"2024-02-19T21:44:13.205879+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:41:22.195164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:41:22.195164+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":380,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-02-19T21:44:09.140018+0000","last_change":"2024-02-19T21:40:25.363354+0000","last_active":"2024-02-19T21:44:09.140018+0000","last_peered":"2024-02-19T21:44:09.140018+0000","last_clean":"2024-02-19T21:44:09.140018+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:44:09.140018+0000","last_undegraded":"2024-02-19T21:44:09.140018+0000","last_fullsized":"2024-02-19T21:44:09.140018+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:40:25.363236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:25.363236+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-19T21:44:15.102141+0000","last_change":"2024-02-19T21:44:15.102141+0000","last_active":"2024-02-19T21:44:15.102141+0000","last_peered":"2024-02-19T21:44:15.102141+0000","last_clean":"2024-02-19T21:44:15.102141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-19T21:44:15.102141+0000","last_undegraded":"2024-02-19T21:44:15.102141+0000","last_fullsized":"2024-02-19T21:44:15.102141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":167,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.203912+0000","last_change":"2024-02-19T21:44:12.609252+0000","last_active":"2024-02-19T21:44:13.203912+0000","last_peered":"2024-02-19T21:44:13.203912+0000","last_clean":"2024-02-19T21:44:13.203912+0000","last_became_active":"2024-02-19T21:43:22.148701+0000","last_became_peered":"2024-02-19T21:43:22.148701+0000","last_unstale":"2024-02-19T21:44:13.203912+0000","last_undegraded":"2024-02-19T21:44:13.203912+0000","last_fullsized":"2024-02-19T21:44:13.203912+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:44:12.609170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":241,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.509255+0000","last_change":"2024-02-19T21:44:10.523394+0000","last_active":"2024-02-19T21:44:13.509255+0000","last_peered":"2024-02-19T21:44:13.509255+0000","last_clean":"2024-02-19T21:44:13.509255+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:44:13.509255+0000","last_undegraded":"2024-02-19T21:44:13.509255+0000","last_fullsized":"2024-02-19T21:44:13.509255+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:10.523331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:44:10.523331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"201'43","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.206055+0000","last_change":"2024-02-19T21:42:04.218868+0000","last_active":"2024-02-19T21:44:13.206055+0000","last_peered":"2024-02-19T21:44:13.206055+0000","last_clean":"2024-02-19T21:44:13.206055+0000","last_became_active":"2024-02-19T21:42:04.196382+0000","last_became_peered":"2024-02-19T21:42:04.196382+0000","last_unstale":"2024-02-19T21:44:13.206055+0000","last_undegraded":"2024-02-19T21:44:13.206055+0000","last_fullsized":"2024-02-19T21:44:13.206055+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'30","last_scrub_stamp":"2024-02-19T21:39:43.996511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:43.996511+0000","log_size":43,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":1074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,5],"acting":[1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":229,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-02-19T21:44:09.140012+0000","last_change":"2024-02-19T21:44:02.217493+0000","last_active":"2024-02-19T21:44:09.140012+0000","last_peered":"2024-02-19T21:44:09.140012+0000","last_clean":"2024-02-19T21:44:09.140012+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:44:09.140012+0000","last_undegraded":"2024-02-19T21:44:09.140012+0000","last_fullsized":"2024-02-19T21:44:09.140012+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:02.217425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:02.217425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-19T21:44:15.102141+0000","last_change":"2024-02-19T21:44:15.102141+0000","last_active":"2024-02-19T21:44:15.102141+0000","last_peered":"2024-02-19T21:44:15.102141+0000","last_clean":"2024-02-19T21:44:15.102141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-19T21:44:15.102141+0000","last_undegraded":"2024-02-19T21:44:15.102141+0000","last_fullsized":"2024-02-19T21:44:15.102141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":230,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.511308+0000","last_change":"2024-02-19T21:44:08.148554+0000","last_active":"2024-02-19T21:44:13.511308+0000","last_peered":"2024-02-19T21:44:13.511308+0000","last_clean":"2024-02-19T21:44:13.511308+0000","last_became_active":"2024-02-19T21:32:29.597365+0000","last_became_peered":"2024-02-19T21:32:29.597365+0000","last_unstale":"2024-02-19T21:44:13.511308+0000","last_undegraded":"2024-02-19T21:44:13.511308+0000","last_fullsized":"2024-02-19T21:44:13.511308+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:08.147351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:44:08.147351+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'6","reported_seq":955,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-19T21:44:14.215527+0000","last_change":"2024-02-19T21:44:13.678401+0000","last_active":"2024-02-19T21:44:14.215527+0000","last_peered":"2024-02-19T21:44:14.215527+0000","last_clean":"2024-02-19T21:44:14.215527+0000","last_became_active":"2024-02-19T21:39:39.464361+0000","last_became_peered":"2024-02-19T21:39:39.464361+0000","last_unstale":"2024-02-19T21:44:14.215527+0000","last_undegraded":"2024-02-19T21:44:14.215527+0000","last_fullsized":"2024-02-19T21:44:14.215527+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_clean_scrub_stamp":"2024-02-19T21:44:13.678341+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":698,"num_read_kb":693,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":230,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-02-19T21:44:09.139506+0000","last_change":"2024-02-19T21:41:36.636023+0000","last_active":"2024-02-19T21:44:09.139506+0000","last_peered":"2024-02-19T21:44:09.139506+0000","last_clean":"2024-02-19T21:44:09.139506+0000","last_became_active":"2024-02-19T21:39:39.468113+0000","last_became_peered":"2024-02-19T21:39:39.468113+0000","last_unstale":"2024-02-19T21:44:09.139506+0000","last_undegraded":"2024-02-19T21:44:09.139506+0000","last_fullsized":"2024-02-19T21:44:09.139506+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:36.635936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:41:36.635936+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"200'17","reported_seq":294,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.205075+0000","last_change":"2024-02-19T21:44:00.545486+0000","last_active":"2024-02-19T21:44:13.205075+0000","last_peered":"2024-02-19T21:44:13.205075+0000","last_clean":"2024-02-19T21:44:13.205075+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:44:13.205075+0000","last_undegraded":"2024-02-19T21:44:13.205075+0000","last_fullsized":"2024-02-19T21:44:13.205075+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'17","last_scrub_stamp":"2024-02-19T21:44:00.545415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:00.545415+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":25,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":118,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.509513+0000","last_change":"2024-02-19T21:41:29.640521+0000","last_active":"2024-02-19T21:44:13.509513+0000","last_peered":"2024-02-19T21:44:13.509513+0000","last_clean":"2024-02-19T21:44:13.509513+0000","last_became_active":"2024-02-19T21:39:39.475190+0000","last_became_peered":"2024-02-19T21:39:39.475190+0000","last_unstale":"2024-02-19T21:44:13.509513+0000","last_undegraded":"2024-02-19T21:44:13.509513+0000","last_fullsized":"2024-02-19T21:44:13.509513+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:29.640431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:29.640431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-19T21:44:15.102141+0000","last_change":"2024-02-19T21:44:15.102141+0000","last_active":"2024-02-19T21:44:15.102141+0000","last_peered":"2024-02-19T21:44:15.102141+0000","last_clean":"2024-02-19T21:44:15.102141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-19T21:44:15.102141+0000","last_undegraded":"2024-02-19T21:44:15.102141+0000","last_fullsized":"2024-02-19T21:44:15.102141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":248,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.509670+0000","last_change":"2024-02-19T21:43:18.128190+0000","last_active":"2024-02-19T21:44:13.509670+0000","last_peered":"2024-02-19T21:44:13.509670+0000","last_clean":"2024-02-19T21:44:13.509670+0000","last_became_active":"2024-02-19T21:43:18.127939+0000","last_became_peered":"2024-02-19T21:43:18.127939+0000","last_unstale":"2024-02-19T21:44:13.509670+0000","last_undegraded":"2024-02-19T21:44:13.509670+0000","last_fullsized":"2024-02-19T21:44:13.509670+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:33.758127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:40:33.758127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":139,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.509346+0000","last_change":"2024-02-19T21:40:30.692471+0000","last_active":"2024-02-19T21:44:13.509346+0000","last_peered":"2024-02-19T21:44:13.509346+0000","last_clean":"2024-02-19T21:44:13.509346+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:44:13.509346+0000","last_undegraded":"2024-02-19T21:44:13.509346+0000","last_fullsized":"2024-02-19T21:44:13.509346+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:30.692385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:40:30.692385+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":254,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.509307+0000","last_change":"2024-02-19T21:42:04.213108+0000","last_active":"2024-02-19T21:44:13.509307+0000","last_peered":"2024-02-19T21:44:13.509307+0000","last_clean":"2024-02-19T21:44:13.509307+0000","last_became_active":"2024-02-19T21:42:04.212730+0000","last_became_peered":"2024-02-19T21:42:04.212730+0000","last_unstale":"2024-02-19T21:44:13.509307+0000","last_undegraded":"2024-02-19T21:44:13.509307+0000","last_fullsized":"2024-02-19T21:44:13.509307+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:39.714982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:39.714982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":113,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-02-19T21:44:09.138268+0000","last_change":"2024-02-19T21:42:04.197235+0000","last_active":"2024-02-19T21:44:09.138268+0000","last_peered":"2024-02-19T21:44:09.138268+0000","last_clean":"2024-02-19T21:44:09.138268+0000","last_became_active":"2024-02-19T21:42:04.196943+0000","last_became_peered":"2024-02-19T21:42:04.196943+0000","last_unstale":"2024-02-19T21:44:09.138268+0000","last_undegraded":"2024-02-19T21:44:09.138268+0000","last_fullsized":"2024-02-19T21:44:09.138268+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:38.927472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:40:38.927472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,1],"acting":[0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"201'33","reported_seq":281,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.674457+0000","last_change":"2024-02-19T21:40:24.331961+0000","last_active":"2024-02-19T21:44:13.674457+0000","last_peered":"2024-02-19T21:44:13.674457+0000","last_clean":"2024-02-19T21:44:13.674457+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:44:13.674457+0000","last_undegraded":"2024-02-19T21:44:13.674457+0000","last_fullsized":"2024-02-19T21:44:13.674457+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"143'21","last_scrub_stamp":"2024-02-19T21:40:24.331869+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:40:24.331869+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":207,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.510139+0000","last_change":"2024-02-19T21:42:04.205688+0000","last_active":"2024-02-19T21:44:13.510139+0000","last_peered":"2024-02-19T21:44:13.510139+0000","last_clean":"2024-02-19T21:44:13.510139+0000","last_became_active":"2024-02-19T21:42:04.205342+0000","last_became_peered":"2024-02-19T21:42:04.205342+0000","last_unstale":"2024-02-19T21:44:13.510139+0000","last_undegraded":"2024-02-19T21:44:13.510139+0000","last_fullsized":"2024-02-19T21:44:13.510139+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:22.826680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:22.826680+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-19T21:44:15.102141+0000","last_change":"2024-02-19T21:44:15.102141+0000","last_active":"2024-02-19T21:44:15.102141+0000","last_peered":"2024-02-19T21:44:15.102141+0000","last_clean":"2024-02-19T21:44:15.102141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-19T21:44:15.102141+0000","last_undegraded":"2024-02-19T21:44:15.102141+0000","last_fullsized":"2024-02-19T21:44:15.102141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":235,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.206248+0000","last_change":"2024-02-19T21:40:29.250688+0000","last_active":"2024-02-19T21:44:13.206248+0000","last_peered":"2024-02-19T21:44:13.206248+0000","last_clean":"2024-02-19T21:44:13.206248+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:44:13.206248+0000","last_undegraded":"2024-02-19T21:44:13.206248+0000","last_fullsized":"2024-02-19T21:44:13.206248+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:40:29.250599+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":242,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-02-19T21:44:09.139594+0000","last_change":"2024-02-19T21:41:22.644476+0000","last_active":"2024-02-19T21:44:09.139594+0000","last_peered":"2024-02-19T21:44:09.139594+0000","last_clean":"2024-02-19T21:44:09.139594+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:44:09.139594+0000","last_undegraded":"2024-02-19T21:44:09.139594+0000","last_fullsized":"2024-02-19T21:44:09.139594+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:22.644405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:41:22.644405+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":260,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.510578+0000","last_change":"2024-02-19T21:44:05.032411+0000","last_active":"2024-02-19T21:44:13.510578+0000","last_peered":"2024-02-19T21:44:13.510578+0000","last_clean":"2024-02-19T21:44:13.510578+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:44:13.510578+0000","last_undegraded":"2024-02-19T21:44:13.510578+0000","last_fullsized":"2024-02-19T21:44:13.510578+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:05.032330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:05.032330+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"200'24","reported_seq":342,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-02-19T21:44:09.140220+0000","last_change":"2024-02-19T21:44:01.262696+0000","last_active":"2024-02-19T21:44:09.140220+0000","last_peered":"2024-02-19T21:44:09.140220+0000","last_clean":"2024-02-19T21:44:09.140220+0000","last_became_active":"2024-02-19T21:42:04.206790+0000","last_became_peered":"2024-02-19T21:42:04.206790+0000","last_unstale":"2024-02-19T21:44:09.140220+0000","last_undegraded":"2024-02-19T21:44:09.140220+0000","last_fullsized":"2024-02-19T21:44:09.140220+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'24","last_scrub_stamp":"2024-02-19T21:44:01.262618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:01.262618+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":232,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.509569+0000","last_change":"2024-02-19T21:41:23.683433+0000","last_active":"2024-02-19T21:44:13.509569+0000","last_peered":"2024-02-19T21:44:13.509569+0000","last_clean":"2024-02-19T21:44:13.509569+0000","last_became_active":"2024-02-19T21:32:27.372460+0000","last_became_peered":"2024-02-19T21:32:27.372460+0000","last_unstale":"2024-02-19T21:44:13.509569+0000","last_undegraded":"2024-02-19T21:44:13.509569+0000","last_fullsized":"2024-02-19T21:44:13.509569+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:23.683337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:23.683337+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-19T21:44:15.102141+0000","last_change":"2024-02-19T21:44:15.102141+0000","last_active":"2024-02-19T21:44:15.102141+0000","last_peered":"2024-02-19T21:44:15.102141+0000","last_clean":"2024-02-19T21:44:15.102141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-19T21:44:15.102141+0000","last_undegraded":"2024-02-19T21:44:15.102141+0000","last_fullsized":"2024-02-19T21:44:15.102141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":244,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.203994+0000","last_change":"2024-02-19T21:42:04.193367+0000","last_active":"2024-02-19T21:44:13.203994+0000","last_peered":"2024-02-19T21:44:13.203994+0000","last_clean":"2024-02-19T21:44:13.203994+0000","last_became_active":"2024-02-19T21:42:04.193058+0000","last_became_peered":"2024-02-19T21:42:04.193058+0000","last_unstale":"2024-02-19T21:44:13.203994+0000","last_undegraded":"2024-02-19T21:44:13.203994+0000","last_fullsized":"2024-02-19T21:44:13.203994+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:39:42.020832+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":231,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.511412+0000","last_change":"2024-02-19T21:40:11.877814+0000","last_active":"2024-02-19T21:44:13.511412+0000","last_peered":"2024-02-19T21:44:13.511412+0000","last_clean":"2024-02-19T21:44:13.511412+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:44:13.511412+0000","last_undegraded":"2024-02-19T21:44:13.511412+0000","last_fullsized":"2024-02-19T21:44:13.511412+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:11.877751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:11.877751+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"201'37","reported_seq":290,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-02-19T21:44:09.139870+0000","last_change":"2024-02-19T21:40:26.405558+0000","last_active":"2024-02-19T21:44:09.139870+0000","last_peered":"2024-02-19T21:44:09.139870+0000","last_clean":"2024-02-19T21:44:09.139870+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:44:09.139870+0000","last_undegraded":"2024-02-19T21:44:09.139870+0000","last_fullsized":"2024-02-19T21:44:09.139870+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'27","last_scrub_stamp":"2024-02-19T21:40:26.405455+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:40:26.405455+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":234,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.674344+0000","last_change":"2024-02-19T21:40:16.260329+0000","last_active":"2024-02-19T21:44:13.674344+0000","last_peered":"2024-02-19T21:44:13.674344+0000","last_clean":"2024-02-19T21:44:13.674344+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:44:13.674344+0000","last_undegraded":"2024-02-19T21:44:13.674344+0000","last_fullsized":"2024-02-19T21:44:13.674344+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:16.260223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:40:16.260223+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-19T21:44:15.102141+0000","last_change":"2024-02-19T21:44:15.102141+0000","last_active":"2024-02-19T21:44:15.102141+0000","last_peered":"2024-02-19T21:44:15.102141+0000","last_clean":"2024-02-19T21:44:15.102141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-19T21:44:15.102141+0000","last_undegraded":"2024-02-19T21:44:15.102141+0000","last_fullsized":"2024-02-19T21:44:15.102141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":138,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.674045+0000","last_change":"2024-02-19T21:44:08.281049+0000","last_active":"2024-02-19T21:44:13.674045+0000","last_peered":"2024-02-19T21:44:13.674045+0000","last_clean":"2024-02-19T21:44:13.674045+0000","last_became_active":"2024-02-19T21:42:04.200292+0000","last_became_peered":"2024-02-19T21:42:04.200292+0000","last_unstale":"2024-02-19T21:44:13.674045+0000","last_undegraded":"2024-02-19T21:44:13.674045+0000","last_fullsized":"2024-02-19T21:44:13.674045+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:08.280938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:44:08.280938+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,5],"acting":[6,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":239,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-19T21:44:14.690800+0000","last_change":"2024-02-19T21:44:14.690800+0000","last_active":"2024-02-19T21:44:14.690800+0000","last_peered":"2024-02-19T21:44:14.690800+0000","last_clean":"2024-02-19T21:44:14.690800+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:44:14.690800+0000","last_undegraded":"2024-02-19T21:44:14.690800+0000","last_fullsized":"2024-02-19T21:44:14.690800+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:14.690736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:44:14.690736+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"201'38","reported_seq":211,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-02-19T21:44:09.138355+0000","last_change":"2024-02-19T21:42:05.431988+0000","last_active":"2024-02-19T21:44:09.138355+0000","last_peered":"2024-02-19T21:44:09.138355+0000","last_clean":"2024-02-19T21:44:09.138355+0000","last_became_active":"2024-02-19T21:42:04.205907+0000","last_became_peered":"2024-02-19T21:42:04.205907+0000","last_unstale":"2024-02-19T21:44:09.138355+0000","last_undegraded":"2024-02-19T21:44:09.138355+0000","last_fullsized":"2024-02-19T21:44:09.138355+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"168'26","last_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:39:48.004702+0000","log_size":38,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":121,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.674280+0000","last_change":"2024-02-19T21:42:04.200909+0000","last_active":"2024-02-19T21:44:13.674280+0000","last_peered":"2024-02-19T21:44:13.674280+0000","last_clean":"2024-02-19T21:44:13.674280+0000","last_became_active":"2024-02-19T21:42:04.200496+0000","last_became_peered":"2024-02-19T21:42:04.200496+0000","last_unstale":"2024-02-19T21:44:13.674280+0000","last_undegraded":"2024-02-19T21:44:13.674280+0000","last_fullsized":"2024-02-19T21:44:13.674280+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:38.697183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:38.697183+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-19T21:44:15.102141+0000","last_change":"2024-02-19T21:44:15.102141+0000","last_active":"2024-02-19T21:44:15.102141+0000","last_peered":"2024-02-19T21:44:15.102141+0000","last_clean":"2024-02-19T21:44:15.102141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-19T21:44:15.102141+0000","last_undegraded":"2024-02-19T21:44:15.102141+0000","last_fullsized":"2024-02-19T21:44:15.102141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":239,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.510904+0000","last_change":"2024-02-19T21:40:28.874859+0000","last_active":"2024-02-19T21:44:13.510904+0000","last_peered":"2024-02-19T21:44:13.510904+0000","last_clean":"2024-02-19T21:44:13.510904+0000","last_became_active":"2024-02-19T21:39:39.481908+0000","last_became_peered":"2024-02-19T21:39:39.481908+0000","last_unstale":"2024-02-19T21:44:13.510904+0000","last_undegraded":"2024-02-19T21:44:13.510904+0000","last_fullsized":"2024-02-19T21:44:13.510904+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:28.874762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:28.874762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":254,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.674672+0000","last_change":"2024-02-19T21:42:04.197387+0000","last_active":"2024-02-19T21:44:13.674672+0000","last_peered":"2024-02-19T21:44:13.674672+0000","last_clean":"2024-02-19T21:44:13.674672+0000","last_became_active":"2024-02-19T21:42:04.197048+0000","last_became_peered":"2024-02-19T21:42:04.197048+0000","last_unstale":"2024-02-19T21:44:13.674672+0000","last_undegraded":"2024-02-19T21:44:13.674672+0000","last_fullsized":"2024-02-19T21:44:13.674672+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:32.498434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:32.498434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"201'28","reported_seq":250,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.508981+0000","last_change":"2024-02-19T21:41:31.580765+0000","last_active":"2024-02-19T21:44:13.508981+0000","last_peered":"2024-02-19T21:44:13.508981+0000","last_clean":"2024-02-19T21:44:13.508981+0000","last_became_active":"2024-02-19T21:35:14.513806+0000","last_became_peered":"2024-02-19T21:35:14.513806+0000","last_unstale":"2024-02-19T21:44:13.508981+0000","last_undegraded":"2024-02-19T21:44:13.508981+0000","last_fullsized":"2024-02-19T21:44:13.508981+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'14","last_scrub_stamp":"2024-02-19T21:41:31.580701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:41:31.580701+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":34,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":239,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.203769+0000","last_change":"2024-02-19T21:41:30.192537+0000","last_active":"2024-02-19T21:44:13.203769+0000","last_peered":"2024-02-19T21:44:13.203769+0000","last_clean":"2024-02-19T21:44:13.203769+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:44:13.203769+0000","last_undegraded":"2024-02-19T21:44:13.203769+0000","last_fullsized":"2024-02-19T21:44:13.203769+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'9","last_scrub_stamp":"2024-02-19T21:41:30.192427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:30.192427+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-19T21:44:15.102141+0000","last_change":"2024-02-19T21:44:15.102141+0000","last_active":"2024-02-19T21:44:15.102141+0000","last_peered":"2024-02-19T21:44:15.102141+0000","last_clean":"2024-02-19T21:44:15.102141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-19T21:44:15.102141+0000","last_undegraded":"2024-02-19T21:44:15.102141+0000","last_fullsized":"2024-02-19T21:44:15.102141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"66'1","reported_seq":134,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.674682+0000","last_change":"2024-02-19T21:42:59.117856+0000","last_active":"2024-02-19T21:44:13.674682+0000","last_peered":"2024-02-19T21:44:13.674682+0000","last_clean":"2024-02-19T21:44:13.674682+0000","last_became_active":"2024-02-19T21:42:59.117513+0000","last_became_peered":"2024-02-19T21:42:59.117513+0000","last_unstale":"2024-02-19T21:44:13.674682+0000","last_undegraded":"2024-02-19T21:44:13.674682+0000","last_fullsized":"2024-02-19T21:44:13.674682+0000","mapping_epoch":165,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:21.371240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:40:21.371240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"261'11","reported_seq":252,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.509551+0000","last_change":"2024-02-19T21:44:08.124240+0000","last_active":"2024-02-19T21:44:13.509551+0000","last_peered":"2024-02-19T21:44:13.509551+0000","last_clean":"2024-02-19T21:44:13.509551+0000","last_became_active":"2024-02-19T21:44:08.123392+0000","last_became_peered":"2024-02-19T21:44:08.123392+0000","last_unstale":"2024-02-19T21:44:13.509551+0000","last_undegraded":"2024-02-19T21:44:13.509551+0000","last_fullsized":"2024-02-19T21:44:13.509551+0000","mapping_epoch":62,"log_start":"257'10","ondisk_log_start":"257'10","created":62,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:22.774081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:22.774081+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":243,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.510612+0000","last_change":"2024-02-19T21:40:41.901768+0000","last_active":"2024-02-19T21:44:13.510612+0000","last_peered":"2024-02-19T21:44:13.510612+0000","last_clean":"2024-02-19T21:44:13.510612+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:44:13.510612+0000","last_undegraded":"2024-02-19T21:44:13.510612+0000","last_fullsized":"2024-02-19T21:44:13.510612+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:40:41.901670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:41.901670+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"201'19","reported_seq":260,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.674626+0000","last_change":"2024-02-19T21:40:26.390284+0000","last_active":"2024-02-19T21:44:13.674626+0000","last_peered":"2024-02-19T21:44:13.674626+0000","last_clean":"2024-02-19T21:44:13.674626+0000","last_became_active":"2024-02-19T21:39:51.536649+0000","last_became_peered":"2024-02-19T21:39:51.536649+0000","last_unstale":"2024-02-19T21:44:13.674626+0000","last_undegraded":"2024-02-19T21:44:13.674626+0000","last_fullsized":"2024-02-19T21:44:13.674626+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:40:26.390173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:26.390173+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-19T21:44:15.102141+0000","last_change":"2024-02-19T21:44:15.102141+0000","last_active":"2024-02-19T21:44:15.102141+0000","last_peered":"2024-02-19T21:44:15.102141+0000","last_clean":"2024-02-19T21:44:15.102141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-19T21:44:15.102141+0000","last_undegraded":"2024-02-19T21:44:15.102141+0000","last_fullsized":"2024-02-19T21:44:15.102141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":248,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.509581+0000","last_change":"2024-02-19T21:42:53.026951+0000","last_active":"2024-02-19T21:44:13.509581+0000","last_peered":"2024-02-19T21:44:13.509581+0000","last_clean":"2024-02-19T21:44:13.509581+0000","last_became_active":"2024-02-19T21:42:53.026678+0000","last_became_peered":"2024-02-19T21:42:53.026678+0000","last_unstale":"2024-02-19T21:44:13.509581+0000","last_undegraded":"2024-02-19T21:44:13.509581+0000","last_fullsized":"2024-02-19T21:44:13.509581+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:16.845272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:16.845272+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"265'11","reported_seq":349,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.509419+0000","last_change":"2024-02-19T21:44:12.206332+0000","last_active":"2024-02-19T21:44:13.509419+0000","last_peered":"2024-02-19T21:44:13.509419+0000","last_clean":"2024-02-19T21:44:13.509419+0000","last_became_active":"2024-02-19T21:44:12.205049+0000","last_became_peered":"2024-02-19T21:44:12.205049+0000","last_unstale":"2024-02-19T21:44:13.509419+0000","last_undegraded":"2024-02-19T21:44:13.509419+0000","last_fullsized":"2024-02-19T21:44:13.509419+0000","mapping_epoch":97,"log_start":"98'9","ondisk_log_start":"98'9","created":62,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'9","last_scrub_stamp":"2024-02-19T21:41:30.610855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:30.610855+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":237,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.203910+0000","last_change":"2024-02-19T21:40:14.294150+0000","last_active":"2024-02-19T21:44:13.203910+0000","last_peered":"2024-02-19T21:44:13.203910+0000","last_clean":"2024-02-19T21:44:13.203910+0000","last_became_active":"2024-02-19T21:32:23.362738+0000","last_became_peered":"2024-02-19T21:32:23.362738+0000","last_unstale":"2024-02-19T21:44:13.203910+0000","last_undegraded":"2024-02-19T21:44:13.203910+0000","last_fullsized":"2024-02-19T21:44:13.203910+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:14.294064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:40:14.294064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"201'27","reported_seq":146,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.509317+0000","last_change":"2024-02-19T21:40:12.838278+0000","last_active":"2024-02-19T21:44:13.509317+0000","last_peered":"2024-02-19T21:44:13.509317+0000","last_clean":"2024-02-19T21:44:13.509317+0000","last_became_active":"2024-02-19T21:39:51.539230+0000","last_became_peered":"2024-02-19T21:39:51.539230+0000","last_unstale":"2024-02-19T21:44:13.509317+0000","last_undegraded":"2024-02-19T21:44:13.509317+0000","last_fullsized":"2024-02-19T21:44:13.509317+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:40:12.838083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:12.838083+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-19T21:44:15.102141+0000","last_change":"2024-02-19T21:44:15.102141+0000","last_active":"2024-02-19T21:44:15.102141+0000","last_peered":"2024-02-19T21:44:15.102141+0000","last_clean":"2024-02-19T21:44:15.102141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-19T21:44:15.102141+0000","last_undegraded":"2024-02-19T21:44:15.102141+0000","last_fullsized":"2024-02-19T21:44:15.102141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":218,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.204815+0000","last_change":"2024-02-19T21:42:48.626776+0000","last_active":"2024-02-19T21:44:13.204815+0000","last_peered":"2024-02-19T21:44:13.204815+0000","last_clean":"2024-02-19T21:44:13.204815+0000","last_became_active":"2024-02-19T21:42:48.626491+0000","last_became_peered":"2024-02-19T21:42:48.626491+0000","last_unstale":"2024-02-19T21:44:13.204815+0000","last_undegraded":"2024-02-19T21:44:13.204815+0000","last_fullsized":"2024-02-19T21:44:13.204815+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:40.015907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:40.015907+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"170'11","reported_seq":257,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-02-19T21:44:14.312053+0000","last_change":"2024-02-19T21:44:14.312053+0000","last_active":"2024-02-19T21:44:14.312053+0000","last_peered":"2024-02-19T21:44:14.312053+0000","last_clean":"2024-02-19T21:44:14.312053+0000","last_became_active":"2024-02-19T21:44:14.220387+0000","last_became_peered":"2024-02-19T21:44:14.220387+0000","last_unstale":"2024-02-19T21:44:14.312053+0000","last_undegraded":"2024-02-19T21:44:14.312053+0000","last_fullsized":"2024-02-19T21:44:14.312053+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'11","last_scrub_stamp":"2024-02-19T21:40:21.863959+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:40:21.863959+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":234,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.205633+0000","last_change":"2024-02-19T21:39:31.018063+0000","last_active":"2024-02-19T21:44:13.205633+0000","last_peered":"2024-02-19T21:44:13.205633+0000","last_clean":"2024-02-19T21:44:13.205633+0000","last_became_active":"2024-02-19T21:32:23.363155+0000","last_became_peered":"2024-02-19T21:32:23.363155+0000","last_unstale":"2024-02-19T21:44:13.205633+0000","last_undegraded":"2024-02-19T21:44:13.205633+0000","last_fullsized":"2024-02-19T21:44:13.205633+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:31.018000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:39:31.018000+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"200'20","reported_seq":238,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.512960+0000","last_change":"2024-02-19T21:41:21.872187+0000","last_active":"2024-02-19T21:44:13.512960+0000","last_peered":"2024-02-19T21:44:13.512960+0000","last_clean":"2024-02-19T21:44:13.512960+0000","last_became_active":"2024-02-19T21:35:14.514968+0000","last_became_peered":"2024-02-19T21:35:14.514968+0000","last_unstale":"2024-02-19T21:44:13.512960+0000","last_undegraded":"2024-02-19T21:44:13.512960+0000","last_fullsized":"2024-02-19T21:44:13.512960+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:41:21.872058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:41:21.872058+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6],"acting":[3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-19T21:44:15.102141+0000","last_change":"2024-02-19T21:44:15.102141+0000","last_active":"2024-02-19T21:44:15.102141+0000","last_peered":"2024-02-19T21:44:15.102141+0000","last_clean":"2024-02-19T21:44:15.102141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-19T21:44:15.102141+0000","last_undegraded":"2024-02-19T21:44:15.102141+0000","last_fullsized":"2024-02-19T21:44:15.102141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":244,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.674689+0000","last_change":"2024-02-19T21:42:44.595213+0000","last_active":"2024-02-19T21:44:13.674689+0000","last_peered":"2024-02-19T21:44:13.674689+0000","last_clean":"2024-02-19T21:44:13.674689+0000","last_became_active":"2024-02-19T21:42:44.592914+0000","last_became_peered":"2024-02-19T21:42:44.592914+0000","last_unstale":"2024-02-19T21:44:13.674689+0000","last_undegraded":"2024-02-19T21:44:13.674689+0000","last_fullsized":"2024-02-19T21:44:13.674689+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:36.725664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:41:36.725664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":228,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.206221+0000","last_change":"2024-02-19T21:39:39.002316+0000","last_active":"2024-02-19T21:44:13.206221+0000","last_peered":"2024-02-19T21:44:13.206221+0000","last_clean":"2024-02-19T21:44:13.206221+0000","last_became_active":"2024-02-19T21:32:27.369452+0000","last_became_peered":"2024-02-19T21:32:27.369452+0000","last_unstale":"2024-02-19T21:44:13.206221+0000","last_undegraded":"2024-02-19T21:44:13.206221+0000","last_fullsized":"2024-02-19T21:44:13.206221+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:39.002258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:39.002258+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":238,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.510755+0000","last_change":"2024-02-19T21:40:32.869530+0000","last_active":"2024-02-19T21:44:13.510755+0000","last_peered":"2024-02-19T21:44:13.510755+0000","last_clean":"2024-02-19T21:44:13.510755+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:44:13.510755+0000","last_undegraded":"2024-02-19T21:44:13.510755+0000","last_fullsized":"2024-02-19T21:44:13.510755+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:32.869462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:40:32.869462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"201'31","reported_seq":197,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.205711+0000","last_change":"2024-02-19T21:44:11.728491+0000","last_active":"2024-02-19T21:44:13.205711+0000","last_peered":"2024-02-19T21:44:13.205711+0000","last_clean":"2024-02-19T21:44:13.205711+0000","last_became_active":"2024-02-19T21:39:39.474668+0000","last_became_peered":"2024-02-19T21:39:39.474668+0000","last_unstale":"2024-02-19T21:44:13.205711+0000","last_undegraded":"2024-02-19T21:44:13.205711+0000","last_fullsized":"2024-02-19T21:44:13.205711+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'31","last_scrub_stamp":"2024-02-19T21:44:11.728412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:11.728412+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":49,"num_read_kb":39,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-19T21:44:15.102141+0000","last_change":"2024-02-19T21:44:15.102141+0000","last_active":"2024-02-19T21:44:15.102141+0000","last_peered":"2024-02-19T21:44:15.102141+0000","last_clean":"2024-02-19T21:44:15.102141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-19T21:44:15.102141+0000","last_undegraded":"2024-02-19T21:44:15.102141+0000","last_fullsized":"2024-02-19T21:44:15.102141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"66'1","reported_seq":223,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.512741+0000","last_change":"2024-02-19T21:43:14.407536+0000","last_active":"2024-02-19T21:44:13.512741+0000","last_peered":"2024-02-19T21:44:13.512741+0000","last_clean":"2024-02-19T21:44:13.512741+0000","last_became_active":"2024-02-19T21:43:14.407205+0000","last_became_peered":"2024-02-19T21:43:14.407205+0000","last_unstale":"2024-02-19T21:44:13.512741+0000","last_undegraded":"2024-02-19T21:44:13.512741+0000","last_fullsized":"2024-02-19T21:44:13.512741+0000","mapping_epoch":197,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":236,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:36.890201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.890201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":123,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-02-19T21:44:09.139818+0000","last_change":"2024-02-19T21:42:04.205186+0000","last_active":"2024-02-19T21:44:09.139818+0000","last_peered":"2024-02-19T21:44:09.139818+0000","last_clean":"2024-02-19T21:44:09.139818+0000","last_became_active":"2024-02-19T21:42:04.204839+0000","last_became_peered":"2024-02-19T21:42:04.204839+0000","last_unstale":"2024-02-19T21:44:09.139818+0000","last_undegraded":"2024-02-19T21:44:09.139818+0000","last_fullsized":"2024-02-19T21:44:09.139818+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:23.324303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:46.372184+0000","last_clean_scrub_stamp":"2024-02-19T21:40:23.324303+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":131,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.510177+0000","last_change":"2024-02-19T21:40:28.696870+0000","last_active":"2024-02-19T21:44:13.510177+0000","last_peered":"2024-02-19T21:44:13.510177+0000","last_clean":"2024-02-19T21:44:13.510177+0000","last_became_active":"2024-02-19T21:39:39.479752+0000","last_became_peered":"2024-02-19T21:39:39.479752+0000","last_unstale":"2024-02-19T21:44:13.510177+0000","last_undegraded":"2024-02-19T21:44:13.510177+0000","last_fullsized":"2024-02-19T21:44:13.510177+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:40:28.696783+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"201'44","reported_seq":329,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.674229+0000","last_change":"2024-02-19T21:42:04.985140+0000","last_active":"2024-02-19T21:44:13.674229+0000","last_peered":"2024-02-19T21:44:13.674229+0000","last_clean":"2024-02-19T21:44:13.674229+0000","last_became_active":"2024-02-19T21:42:04.200393+0000","last_became_peered":"2024-02-19T21:42:04.200393+0000","last_unstale":"2024-02-19T21:44:13.674229+0000","last_undegraded":"2024-02-19T21:44:13.674229+0000","last_fullsized":"2024-02-19T21:44:13.674229+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'28","last_scrub_stamp":"2024-02-19T21:39:40.282677+0000","last_deep_scrub":"115'28","last_deep_scrub_stamp":"2024-02-19T21:36:09.031674+0000","last_clean_scrub_stamp":"2024-02-19T21:39:40.282677+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-19T21:44:15.102141+0000","last_change":"2024-02-19T21:44:15.102141+0000","last_active":"2024-02-19T21:44:15.102141+0000","last_peered":"2024-02-19T21:44:15.102141+0000","last_clean":"2024-02-19T21:44:15.102141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-19T21:44:15.102141+0000","last_undegraded":"2024-02-19T21:44:15.102141+0000","last_fullsized":"2024-02-19T21:44:15.102141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":254,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-02-19T21:44:09.139695+0000","last_change":"2024-02-19T21:43:10.349161+0000","last_active":"2024-02-19T21:44:09.139695+0000","last_peered":"2024-02-19T21:44:09.139695+0000","last_clean":"2024-02-19T21:44:09.139695+0000","last_became_active":"2024-02-19T21:43:10.348874+0000","last_became_peered":"2024-02-19T21:43:10.348874+0000","last_unstale":"2024-02-19T21:44:09.139695+0000","last_undegraded":"2024-02-19T21:44:09.139695+0000","last_fullsized":"2024-02-19T21:44:09.139695+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":232,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:42.230664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:42.230664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":223,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.203600+0000","last_change":"2024-02-19T21:40:40.799240+0000","last_active":"2024-02-19T21:44:13.203600+0000","last_peered":"2024-02-19T21:44:13.203600+0000","last_clean":"2024-02-19T21:44:13.203600+0000","last_became_active":"2024-02-19T21:39:39.468109+0000","last_became_peered":"2024-02-19T21:39:39.468109+0000","last_unstale":"2024-02-19T21:44:13.203600+0000","last_undegraded":"2024-02-19T21:44:13.203600+0000","last_fullsized":"2024-02-19T21:44:13.203600+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:40.799141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:40.799141+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1],"acting":[4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":237,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.205763+0000","last_change":"2024-02-19T21:44:01.569675+0000","last_active":"2024-02-19T21:44:13.205763+0000","last_peered":"2024-02-19T21:44:13.205763+0000","last_clean":"2024-02-19T21:44:13.205763+0000","last_became_active":"2024-02-19T21:32:23.357438+0000","last_became_peered":"2024-02-19T21:32:23.357438+0000","last_unstale":"2024-02-19T21:44:13.205763+0000","last_undegraded":"2024-02-19T21:44:13.205763+0000","last_fullsized":"2024-02-19T21:44:13.205763+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:01.569611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:01.569611+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"201'15","reported_seq":256,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-02-19T21:44:09.139962+0000","last_change":"2024-02-19T21:39:36.193250+0000","last_active":"2024-02-19T21:44:09.139962+0000","last_peered":"2024-02-19T21:44:09.139962+0000","last_clean":"2024-02-19T21:44:09.139962+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:44:09.139962+0000","last_undegraded":"2024-02-19T21:44:09.139962+0000","last_fullsized":"2024-02-19T21:44:09.139962+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:39:36.193184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:36.193184+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-19T21:44:15.102141+0000","last_change":"2024-02-19T21:44:15.102141+0000","last_active":"2024-02-19T21:44:15.102141+0000","last_peered":"2024-02-19T21:44:15.102141+0000","last_clean":"2024-02-19T21:44:15.102141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-19T21:44:15.102141+0000","last_undegraded":"2024-02-19T21:44:15.102141+0000","last_fullsized":"2024-02-19T21:44:15.102141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":248,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.509109+0000","last_change":"2024-02-19T21:43:06.293725+0000","last_active":"2024-02-19T21:44:13.509109+0000","last_peered":"2024-02-19T21:44:13.509109+0000","last_clean":"2024-02-19T21:44:13.509109+0000","last_became_active":"2024-02-19T21:43:06.293389+0000","last_became_peered":"2024-02-19T21:43:06.293389+0000","last_unstale":"2024-02-19T21:44:13.509109+0000","last_undegraded":"2024-02-19T21:44:13.509109+0000","last_fullsized":"2024-02-19T21:44:13.509109+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:17.853016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:40:17.853016+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":193,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.674686+0000","last_change":"2024-02-19T21:42:04.200518+0000","last_active":"2024-02-19T21:44:13.674686+0000","last_peered":"2024-02-19T21:44:13.674686+0000","last_clean":"2024-02-19T21:44:13.674686+0000","last_became_active":"2024-02-19T21:42:04.199889+0000","last_became_peered":"2024-02-19T21:42:04.199889+0000","last_unstale":"2024-02-19T21:44:13.674686+0000","last_undegraded":"2024-02-19T21:44:13.674686+0000","last_fullsized":"2024-02-19T21:44:13.674686+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:40:29.858805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"200'27","reported_seq":304,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.508997+0000","last_change":"2024-02-19T21:42:05.597864+0000","last_active":"2024-02-19T21:44:13.508997+0000","last_peered":"2024-02-19T21:44:13.508997+0000","last_clean":"2024-02-19T21:44:13.508997+0000","last_became_active":"2024-02-19T21:42:04.212731+0000","last_became_peered":"2024-02-19T21:42:04.212731+0000","last_unstale":"2024-02-19T21:44:13.508997+0000","last_undegraded":"2024-02-19T21:44:13.508997+0000","last_fullsized":"2024-02-19T21:44:13.508997+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:40:23.751886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:23.751886+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"66'8","reported_seq":387,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-02-19T21:44:13.510897+0000","last_change":"2024-02-19T21:44:11.163797+0000","last_active":"2024-02-19T21:44:13.510897+0000","last_peered":"2024-02-19T21:44:13.510897+0000","last_clean":"2024-02-19T21:44:13.510897+0000","last_became_active":"2024-02-19T21:32:27.369840+0000","last_became_peered":"2024-02-19T21:32:27.369840+0000","last_unstale":"2024-02-19T21:44:13.510897+0000","last_undegraded":"2024-02-19T21:44:13.510897+0000","last_fullsized":"2024-02-19T21:44:13.510897+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:44:11.163719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:11.163719+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":698,"num_read_kb":693,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1116,"num_read_kb":873,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":3604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":741,"ondisk_log_size":741,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":30,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":90,"acting":90,"num_store_stats":8},{"poolid":6,"num_pg":22,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":382,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":66,"acting":66,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201425,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":405448,"kb_used_data":108224,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93339704,"statfs":{"total":95995035648,"available":95579856896,"internally_reserved":0,"allocated":110821376,"data_stored":110382186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:43:35 2024","interfaces":[{"interface":"back","average":{"1min":2.0990000000000002,"5min":2.1190000000000002,"15min":1.1899999999999999},"min":{"1min":0.216,"5min":0.189,"15min":0.189},"max":{"1min":7.1109999999999998,"5min":13.645,"15min":13.645},"last":0.39900000000000002},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.9490000000000001,"15min":1.2450000000000001},"min":{"1min":0.253,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":3.6469999999999998,"5min":14.212999999999999,"15min":14.212999999999999},"last":0.40500000000000003}]},{"osd":1,"last update":"Mon Feb 19 21:43:35 2024","interfaces":[{"interface":"back","average":{"1min":2.3100000000000001,"5min":2.1200000000000001,"15min":1.333},"min":{"1min":0.28799999999999998,"5min":0.255,"15min":0.23200000000000001},"max":{"1min":6.9130000000000003,"5min":14.246,"15min":14.246},"last":0.432},{"interface":"front","average":{"1min":1.772,"5min":1.9139999999999999,"15min":1.1859999999999999},"min":{"1min":0.29699999999999999,"5min":0.223,"15min":0.223},"max":{"1min":5.6989999999999998,"5min":14.15,"15min":14.15},"last":0.371}]},{"osd":2,"last update":"Mon Feb 19 21:43:35 2024","interfaces":[{"interface":"back","average":{"1min":2.5430000000000001,"5min":2.262,"15min":1.284},"min":{"1min":0.34399999999999997,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":6.7850000000000001,"5min":10.965999999999999,"15min":10.965999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":2.2440000000000002,"5min":2.0249999999999999,"15min":1.3080000000000001},"min":{"1min":0.45900000000000002,"5min":0.28899999999999998,"15min":0.27800000000000002},"max":{"1min":6.8099999999999996,"5min":9.7010000000000005,"15min":9.7010000000000005},"last":0.496}]},{"osd":3,"last update":"Mon Feb 19 21:43:35 2024","interfaces":[{"interface":"back","average":{"1min":2.3660000000000001,"5min":2.5659999999999998,"15min":1.621},"min":{"1min":0.315,"5min":0.29199999999999998,"15min":0.26900000000000002},"max":{"1min":6.2050000000000001,"5min":15.438000000000001,"15min":31.559000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":2.9239999999999999,"5min":2.1930000000000001,"15min":1.4930000000000001},"min":{"1min":0.38600000000000001,"5min":0.309,"15min":0.309},"max":{"1min":6.9409999999999998,"5min":10.522,"15min":30.812999999999999},"last":0.53400000000000003}]},{"osd":4,"last update":"Mon Feb 19 21:43:35 2024","interfaces":[{"interface":"back","average":{"1min":2.1040000000000001,"5min":1.962,"15min":0.997},"min":{"1min":0.34000000000000002,"5min":0.247,"15min":0.247},"max":{"1min":8.1530000000000005,"5min":14.208,"15min":14.208},"last":0.33100000000000002},{"interface":"front","average":{"1min":2.6339999999999999,"5min":2.4950000000000001,"15min":1.1990000000000001},"min":{"1min":0.28699999999999998,"5min":0.26500000000000001,"15min":0.245},"max":{"1min":9.6110000000000007,"5min":11.541,"15min":11.541},"last":0.47899999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:43:35 2024","interfaces":[{"interface":"back","average":{"1min":2.6930000000000001,"5min":1.992,"15min":1.1120000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":6.8449999999999998,"5min":10.090999999999999,"15min":10.090999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":2.7709999999999999,"5min":2.415,"15min":1.1919999999999999},"min":{"1min":0.33200000000000002,"5min":0.30299999999999999,"15min":0.28799999999999998},"max":{"1min":8.5890000000000004,"5min":17.012,"15min":17.012},"last":0.45900000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:43:35 2024","interfaces":[{"interface":"back","average":{"1min":2.1699999999999999,"5min":1.9319999999999999,"15min":1.044},"min":{"1min":0.47599999999999998,"5min":0.31900000000000001,"15min":0.30299999999999999},"max":{"1min":5.6669999999999998,"5min":14.177,"15min":14.177},"last":0.48799999999999999},{"interface":"front","average":{"1min":2.3290000000000002,"5min":2.5379999999999998,"15min":1.391},"min":{"1min":0.40100000000000002,"5min":0.33000000000000002,"15min":0.29699999999999999},"max":{"1min":6.2510000000000003,"5min":12.913,"15min":12.913},"last":0.51100000000000001}]}]},{"osd":6,"up_from":47,"seq":201863463064,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":306668,"kb_used_data":1252,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93438484,"statfs":{"total":95995035648,"available":95681007616,"internally_reserved":0,"allocated":1282048,"data_stored":806449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:43:14 2024","interfaces":[{"interface":"back","average":{"1min":3.6040000000000001,"5min":2.395,"15min":1.343},"min":{"1min":0.23599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":45.197000000000003,"5min":45.197000000000003,"15min":45.197000000000003},"last":0.46000000000000002},{"interface":"front","average":{"1min":3.7400000000000002,"5min":2.504,"15min":1.4279999999999999},"min":{"1min":0.23799999999999999,"5min":0.23499999999999999,"15min":0.221},"max":{"1min":44.753,"5min":44.753,"15min":44.753},"last":0.35599999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:43:14 2024","interfaces":[{"interface":"back","average":{"1min":3.7989999999999999,"5min":2.2240000000000002,"15min":1.2849999999999999},"min":{"1min":0.26500000000000001,"5min":0.222,"15min":0.222},"max":{"1min":45.231999999999999,"5min":45.231999999999999,"15min":45.231999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":4.1509999999999998,"5min":2.0920000000000001,"15min":1.216},"min":{"1min":0.377,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":45.097999999999999,"5min":45.097999999999999,"15min":45.097999999999999},"last":0.39700000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:43:14 2024","interfaces":[{"interface":"back","average":{"1min":1.7729999999999999,"5min":1.611,"15min":1.073},"min":{"1min":0.35399999999999998,"5min":0.28599999999999998,"15min":0.26800000000000002},"max":{"1min":6.5899999999999999,"5min":8.3849999999999998,"15min":8.3849999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":1.585,"5min":1.744,"15min":1.1359999999999999},"min":{"1min":0.32500000000000001,"5min":0.29299999999999998,"15min":0.27300000000000002},"max":{"1min":5.7140000000000004,"5min":8.5259999999999998,"15min":18.068000000000001},"last":0.41499999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:43:14 2024","interfaces":[{"interface":"back","average":{"1min":1.988,"5min":1.758,"15min":1.1950000000000001},"min":{"1min":0.32500000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":7.6520000000000001,"5min":11.15,"15min":11.15},"last":0.48899999999999999},{"interface":"front","average":{"1min":2.0459999999999998,"5min":1.6120000000000001,"15min":1.171},"min":{"1min":0.35199999999999998,"5min":0.26400000000000001,"15min":0.246},"max":{"1min":6.6150000000000002,"5min":10.228999999999999,"15min":19.632999999999999},"last":0.441}]},{"osd":4,"last update":"Mon Feb 19 21:43:14 2024","interfaces":[{"interface":"back","average":{"1min":1.7230000000000001,"5min":1.8540000000000001,"15min":0.94899999999999995},"min":{"1min":0.32500000000000001,"5min":0.247,"15min":0.247},"max":{"1min":3.407,"5min":9.3759999999999994,"15min":9.3759999999999994},"last":0.26400000000000001},{"interface":"front","average":{"1min":2.871,"5min":2.085,"15min":1.02},"min":{"1min":0.40000000000000002,"5min":0.27300000000000002,"15min":0.23499999999999999},"max":{"1min":14.055,"5min":16.594999999999999,"15min":16.594999999999999},"last":0.27500000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:43:14 2024","interfaces":[{"interface":"back","average":{"1min":2.1779999999999999,"5min":1.9650000000000001,"15min":1.0049999999999999},"min":{"1min":0.314,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":7.4279999999999999,"5min":8.6159999999999997,"15min":8.6159999999999997},"last":0.29099999999999998},{"interface":"front","average":{"1min":2.7080000000000002,"5min":2.2469999999999999,"15min":1.111},"min":{"1min":0.34799999999999998,"5min":0.30299999999999999,"15min":0.27900000000000003},"max":{"1min":15.164,"5min":15.497999999999999,"15min":15.497999999999999},"last":0.34599999999999997}]},{"osd":7,"last update":"Mon Feb 19 21:43:33 2024","interfaces":[{"interface":"back","average":{"1min":2.5169999999999999,"5min":2.4460000000000002,"15min":1.204},"min":{"1min":0.32100000000000001,"5min":0.307,"15min":0.26700000000000002},"max":{"1min":8.4730000000000008,"5min":14.721,"15min":14.721},"last":0.317},{"interface":"front","average":{"1min":2.548,"5min":2.4849999999999999,"15min":1.2629999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":8.5,"5min":14.744999999999999,"15min":14.744999999999999},"last":0.38500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575026,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":302596,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93442556,"statfs":{"total":95995035648,"available":95685177344,"internally_reserved":0,"allocated":1306624,"data_stored":815398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:43:59 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.96399999999999997,"15min":1.24},"min":{"1min":0.17000000000000001,"5min":0.161,"15min":0.161},"max":{"1min":1.7849999999999999,"5min":11.305,"15min":42.776000000000003},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.90400000000000003,"5min":1.2589999999999999,"15min":1.258},"min":{"1min":0.20399999999999999,"5min":0.183,"15min":0.183},"max":{"1min":3.052,"5min":11.92,"15min":44.845999999999997},"last":0.76800000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:43:27 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.2629999999999999,"15min":1.1479999999999999},"min":{"1min":0.23799999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":4.633,"5min":11.161,"15min":11.826000000000001},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.254,"15min":1.25},"min":{"1min":0.27300000000000002,"5min":0.215,"15min":0.215},"max":{"1min":4.3390000000000004,"5min":7.8140000000000001,"15min":12.26},"last":1.0069999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:43:59 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.1870000000000001,"15min":1.363},"min":{"1min":0.29399999999999998,"5min":0.224,"15min":0.224},"max":{"1min":4.6120000000000001,"5min":8.3469999999999995,"15min":41.607999999999997},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.2310000000000001,"15min":1.2250000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":4.5529999999999999,"5min":11.204000000000001,"15min":42.811999999999998},"last":1.1200000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:43:22 2024","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.7190000000000001,"15min":1.0669999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26800000000000002},"max":{"1min":7.2270000000000003,"5min":11.23,"15min":11.23},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.25,"5min":1.627,"15min":1.171},"min":{"1min":0.30499999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":3.855,"5min":7.04,"15min":10.51},"last":0.91200000000000003}]},{"osd":5,"last update":"Mon Feb 19 21:43:47 2024","interfaces":[{"interface":"back","average":{"1min":2.0009999999999999,"5min":1.774,"15min":1.2410000000000001},"min":{"1min":0.35099999999999998,"5min":0.30599999999999999,"15min":0.28799999999999998},"max":{"1min":8.4269999999999996,"5min":8.4269999999999996,"15min":10.458},"last":0.94899999999999995},{"interface":"front","average":{"1min":2.044,"5min":1.6439999999999999,"15min":1.163},"min":{"1min":0.34000000000000002,"5min":0.32600000000000001,"15min":0.30099999999999999},"max":{"1min":6.5259999999999998,"5min":6.7320000000000002,"15min":7.6950000000000003},"last":1.048}]},{"osd":6,"last update":"Mon Feb 19 21:43:17 2024","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":2.032,"15min":1.1919999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.30099999999999999},"max":{"1min":7.2830000000000004,"5min":11.638999999999999,"15min":11.638999999999999},"last":1.177},{"interface":"front","average":{"1min":2.9649999999999999,"5min":2.1600000000000001,"15min":1.294},"min":{"1min":0.377,"5min":0.32900000000000001,"15min":0.316},"max":{"1min":6.9530000000000003,"5min":12.199,"15min":12.199},"last":1.0900000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:43:36 2024","interfaces":[{"interface":"back","average":{"1min":2.5030000000000001,"5min":1.9590000000000001,"15min":1.347},"min":{"1min":0.40100000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":5.0860000000000003,"5min":8.1699999999999999,"15min":10.638999999999999},"last":1.159},{"interface":"front","average":{"1min":2.004,"5min":1.946,"15min":1.2310000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":5.0979999999999999,"5min":11.276,"15min":11.276},"last":1.202}]}]},{"osd":0,"up_from":8,"seq":34359738551,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":310716,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93434436,"statfs":{"total":95995035648,"available":95676862464,"internally_reserved":0,"allocated":1232896,"data_stored":775404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:44:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.82899999999999996,"15min":0.92400000000000004},"min":{"1min":0.184,"5min":0.182,"15min":0.17499999999999999},"max":{"1min":2.9910000000000001,"5min":16.478000000000002,"15min":16.478000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.95099999999999996,"15min":1.1579999999999999},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":3.1680000000000001,"5min":8.0229999999999997,"15min":13.422000000000001},"last":0.253}]},{"osd":2,"last update":"Mon Feb 19 21:43:32 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":1.2350000000000001,"15min":1.089},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":5.2510000000000003,"5min":13.638999999999999,"15min":13.638999999999999},"last":0.377},{"interface":"front","average":{"1min":1.653,"5min":1.516,"15min":1.284},"min":{"1min":0.224,"5min":0.21199999999999999,"15min":0.19500000000000001},"max":{"1min":5.1500000000000004,"5min":13.134,"15min":13.134},"last":0.27700000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:43:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.2809999999999999,"15min":1.3819999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":3.383,"5min":13.292999999999999,"15min":14.507999999999999},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":1.131,"15min":1.3240000000000001},"min":{"1min":0.27400000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":2.9289999999999998,"5min":8.4169999999999998,"15min":18.759},"last":0.40200000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:43:27 2024","interfaces":[{"interface":"back","average":{"1min":2.6899999999999999,"5min":2.0169999999999999,"15min":1.2789999999999999},"min":{"1min":0.33400000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":9.3900000000000006,"5min":13.278,"15min":13.278},"last":0.56399999999999995},{"interface":"front","average":{"1min":1.5569999999999999,"5min":1.7130000000000001,"15min":1.1379999999999999},"min":{"1min":0.38600000000000001,"5min":0.33200000000000002,"15min":0.255},"max":{"1min":8.3889999999999993,"5min":8.4789999999999992,"15min":8.9450000000000003},"last":0.42899999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:43:50 2024","interfaces":[{"interface":"back","average":{"1min":3.0030000000000001,"5min":2.048,"15min":1.5549999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":10.852,"5min":10.852,"15min":42.799999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":3.0489999999999999,"5min":2.2130000000000001,"15min":1.5549999999999999},"min":{"1min":0.36599999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":10.842000000000001,"5min":13.237,"15min":42.695},"last":0.67300000000000004}]},{"osd":6,"last update":"Mon Feb 19 21:44:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.3169999999999999,"15min":1.2569999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.27900000000000003},"max":{"1min":4.4420000000000002,"5min":8.5009999999999994,"15min":42.777000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":1.7589999999999999,"5min":2.0990000000000002,"15min":1.4930000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.28599999999999998},"max":{"1min":13.289999999999999,"5min":13.289999999999999,"15min":13.289999999999999},"last":0.52700000000000002}]},{"osd":7,"last update":"Mon Feb 19 21:43:32 2024","interfaces":[{"interface":"back","average":{"1min":2.496,"5min":1.8520000000000001,"15min":1.389},"min":{"1min":0.45900000000000002,"5min":0.33700000000000002,"15min":0.31},"max":{"1min":6.4740000000000002,"5min":13.26,"15min":42.758000000000003},"last":0.58199999999999996},{"interface":"front","average":{"1min":1.6990000000000001,"5min":1.6759999999999999,"15min":1.327},"min":{"1min":0.38400000000000001,"5min":0.371,"15min":0.33200000000000002},"max":{"1min":6.4640000000000004,"5min":8.5340000000000007,"15min":42.718000000000004},"last":0.68899999999999995}]}]},{"osd":2,"up_from":0,"seq":77309411501,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":26,"seq":111669149864,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":306620,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93438532,"statfs":{"total":95995035648,"available":95681056768,"internally_reserved":0,"allocated":1232896,"data_stored":812113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:43:59 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.0740000000000001,"15min":1.1439999999999999},"min":{"1min":0.187,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":8.8529999999999998,"5min":8.8529999999999998,"15min":17.992000000000001},"last":0.254},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.131,"15min":1.5009999999999999},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":9.1120000000000001,"5min":9.1120000000000001,"15min":46.654000000000003},"last":0.35599999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:43:59 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.95499999999999996,"15min":0.94099999999999995},"min":{"1min":0.22600000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":2.847,"5min":9.6289999999999996,"15min":9.9700000000000006},"last":0.315},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.099,"15min":1.216},"min":{"1min":0.26200000000000001,"5min":0.20799999999999999,"15min":0.185},"max":{"1min":4.1429999999999998,"5min":6.3460000000000001,"15min":13.135999999999999},"last":0.30199999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:43:59 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.179,"15min":1.1870000000000001},"min":{"1min":0.23899999999999999,"5min":0.22900000000000001,"15min":0.224},"max":{"1min":4.484,"5min":6.8879999999999999,"15min":11.175000000000001},"last":0.32700000000000001},{"interface":"front","average":{"1min":1.304,"5min":1.0780000000000001,"15min":1.423},"min":{"1min":0.26800000000000002,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":9.1500000000000004,"5min":12.723000000000001,"15min":45.831000000000003},"last":0.38800000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:43:23 2024","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":1.387,"15min":1.01},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":5.6459999999999999,"5min":7.1660000000000004,"15min":7.1660000000000004},"last":0.55300000000000005},{"interface":"front","average":{"1min":2.319,"5min":1.96,"15min":1.3120000000000001},"min":{"1min":0.31,"5min":0.28699999999999998,"15min":0.26800000000000002},"max":{"1min":7.8890000000000002,"5min":9.6720000000000006,"15min":11.093},"last":0.41399999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:43:42 2024","interfaces":[{"interface":"back","average":{"1min":1.9890000000000001,"5min":1.758,"15min":1.1579999999999999},"min":{"1min":0.30299999999999999,"5min":0.29099999999999998,"15min":0.27100000000000002},"max":{"1min":9.3650000000000002,"5min":12.257,"15min":12.257},"last":0.40100000000000002},{"interface":"front","average":{"1min":2.3250000000000002,"5min":2.0600000000000001,"15min":1.3899999999999999},"min":{"1min":0.33200000000000002,"5min":0.307,"15min":0.27800000000000002},"max":{"1min":7.8460000000000001,"5min":8.5809999999999995,"15min":11.128},"last":0.47999999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:44:10 2024","interfaces":[{"interface":"back","average":{"1min":1.7030000000000001,"5min":1.411,"15min":1.1279999999999999},"min":{"1min":0.40100000000000002,"5min":0.309,"15min":0.30599999999999999},"max":{"1min":6.8380000000000001,"5min":6.8380000000000001,"15min":17.443999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.6859999999999999,"15min":1.3680000000000001},"min":{"1min":0.41699999999999998,"5min":0.32900000000000001,"15min":0.32300000000000001},"max":{"1min":4.4530000000000003,"5min":13.942,"15min":18.219000000000001},"last":0.437}]},{"osd":7,"last update":"Mon Feb 19 21:43:33 2024","interfaces":[{"interface":"back","average":{"1min":2.6699999999999999,"5min":2.0219999999999998,"15min":1.5529999999999999},"min":{"1min":0.34499999999999997,"5min":0.318,"15min":0.318},"max":{"1min":9.0259999999999998,"5min":10.035,"15min":45.777999999999999},"last":0.504},{"interface":"front","average":{"1min":1.7130000000000001,"5min":1.482,"15min":1.073},"min":{"1min":0.46899999999999997,"5min":0.35399999999999998,"15min":0.35099999999999998},"max":{"1min":5.7060000000000004,"5min":6.585,"15min":6.585},"last":0.42399999999999999}]}]},{"osd":4,"up_from":32,"seq":137438953633,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":306664,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93438488,"statfs":{"total":95995035648,"available":95681011712,"internally_reserved":0,"allocated":1277952,"data_stored":813336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:43:21 2024","interfaces":[{"interface":"back","average":{"1min":3.0579999999999998,"5min":2.4359999999999999,"15min":1.3009999999999999},"min":{"1min":0.40999999999999998,"5min":0.219,"15min":0.219},"max":{"1min":11.541,"5min":40.664000000000001,"15min":40.664000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":1.698,"5min":2.3199999999999998,"15min":1.383},"min":{"1min":0.23799999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":5.3159999999999998,"5min":41.046999999999997,"15min":41.046999999999997},"last":0.53200000000000003}]},{"osd":1,"last update":"Mon Feb 19 21:43:21 2024","interfaces":[{"interface":"back","average":{"1min":3.6909999999999998,"5min":2.0750000000000002,"15min":1.1319999999999999},"min":{"1min":0.41399999999999998,"5min":0.22,"15min":0.22},"max":{"1min":11.755000000000001,"5min":13.254,"15min":13.254},"last":0.49199999999999999},{"interface":"front","average":{"1min":1.655,"5min":1.5980000000000001,"15min":1.046},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":4.3460000000000001,"5min":7.593,"15min":15.411},"last":0.47199999999999998}]},{"osd":2,"last update":"Mon Feb 19 21:43:21 2024","interfaces":[{"interface":"back","average":{"1min":1.9470000000000001,"5min":1.8919999999999999,"15min":1.1479999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.27100000000000002},"max":{"1min":4.7039999999999997,"5min":16.788,"15min":16.788},"last":0.501},{"interface":"front","average":{"1min":1.8799999999999999,"5min":2.0369999999999999,"15min":1.3799999999999999},"min":{"1min":0.35099999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.0190000000000001,"5min":18.452999999999999,"15min":20.995999999999999},"last":0.48499999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:43:21 2024","interfaces":[{"interface":"back","average":{"1min":2.0230000000000001,"5min":2.016,"15min":1.282},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.316},"max":{"1min":6.0730000000000004,"5min":10.970000000000001,"15min":15.914999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":3.512,"5min":2.2069999999999999,"15min":1.2430000000000001},"min":{"1min":0.34200000000000003,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":11.662000000000001,"5min":13.321,"15min":13.321},"last":0.44700000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:44:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":2.0609999999999999,"15min":1.046},"min":{"1min":0.28799999999999998,"5min":0.24099999999999999,"15min":0.23499999999999999},"max":{"1min":7.5949999999999998,"5min":18.916,"15min":18.916},"last":0.33800000000000002},{"interface":"front","average":{"1min":1.4490000000000001,"5min":2.79,"15min":1.2769999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":5.915,"5min":14.840999999999999,"15min":14.840999999999999},"last":0.375}]},{"osd":6,"last update":"Mon Feb 19 21:43:21 2024","interfaces":[{"interface":"back","average":{"1min":1.7010000000000001,"5min":2.1259999999999999,"15min":1.0489999999999999},"min":{"1min":0.316,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":7.5949999999999998,"5min":13.27,"15min":13.27},"last":0.40999999999999998},{"interface":"front","average":{"1min":3.3690000000000002,"5min":2.1429999999999998,"15min":1.0589999999999999},"min":{"1min":0.32800000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":14.127000000000001,"5min":14.127000000000001,"15min":14.127000000000001},"last":0.39000000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:43:41 2024","interfaces":[{"interface":"back","average":{"1min":2.8650000000000002,"5min":2.1200000000000001,"15min":1.087},"min":{"1min":0.35799999999999998,"5min":0.30399999999999999,"15min":0.28899999999999998},"max":{"1min":14.093,"5min":14.093,"15min":14.093},"last":0.42399999999999999},{"interface":"front","average":{"1min":2.5499999999999998,"5min":2.4990000000000001,"15min":1.2230000000000001},"min":{"1min":0.35799999999999998,"5min":0.33500000000000002,"15min":0.32900000000000001},"max":{"1min":12.808999999999999,"5min":12.808999999999999,"15min":12.808999999999999},"last":0.434}]}]},{"osd":5,"up_from":38,"seq":163208757405,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":302588,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93442564,"statfs":{"total":95995035648,"available":95685185536,"internally_reserved":0,"allocated":1298432,"data_stored":814395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:43:51 2024","interfaces":[{"interface":"back","average":{"1min":3.4220000000000002,"5min":1.9219999999999999,"15min":1.3069999999999999},"min":{"1min":0.30299999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":15.048,"5min":15.048,"15min":20.550999999999998},"last":0.38200000000000001},{"interface":"front","average":{"1min":2.6309999999999998,"5min":2.1800000000000002,"15min":1.3460000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":8.8970000000000002,"5min":9.9390000000000001,"15min":20.879000000000001},"last":0.42799999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:43:51 2024","interfaces":[{"interface":"back","average":{"1min":2.4620000000000002,"5min":2.198,"15min":1.272},"min":{"1min":0.34100000000000003,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":8.8490000000000002,"5min":10.42,"15min":10.42},"last":0.38800000000000001},{"interface":"front","average":{"1min":1.387,"5min":1.397,"15min":1.143},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":5.8739999999999997,"5min":10.021000000000001,"15min":10.316000000000001},"last":0.35499999999999998}]},{"osd":2,"last update":"Mon Feb 19 21:43:51 2024","interfaces":[{"interface":"back","average":{"1min":3.2970000000000002,"5min":1.9159999999999999,"15min":1.3540000000000001},"min":{"1min":0.39200000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":15.015000000000001,"5min":15.015000000000001,"15min":20.186},"last":0.33000000000000002},{"interface":"front","average":{"1min":2.6160000000000001,"5min":2.0619999999999998,"15min":1.3700000000000001},"min":{"1min":0.35999999999999999,"5min":0.29899999999999999,"15min":0.23200000000000001},"max":{"1min":8.9030000000000005,"5min":9.4909999999999997,"15min":20.175000000000001},"last":0.49099999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:43:51 2024","interfaces":[{"interface":"back","average":{"1min":3.1850000000000001,"5min":2.1930000000000001,"15min":1.5089999999999999},"min":{"1min":0.44600000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":10.117000000000001,"5min":12.021000000000001,"15min":20.146999999999998},"last":0.42299999999999999},{"interface":"front","average":{"1min":2.9660000000000002,"5min":2.452,"15min":1.6579999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":8.8699999999999992,"5min":9.5150000000000006,"15min":20.120000000000001},"last":0.50700000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:43:51 2024","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.7270000000000001,"15min":0.89600000000000002},"min":{"1min":0.255,"5min":0.252,"15min":0.23999999999999999},"max":{"1min":5.7939999999999996,"5min":21.577000000000002,"15min":21.577000000000002},"last":0.31900000000000001},{"interface":"front","average":{"1min":3.899,"5min":2.6099999999999999,"15min":1.2310000000000001},"min":{"1min":0.33900000000000002,"5min":0.28799999999999998,"15min":0.25600000000000001},"max":{"1min":15.071999999999999,"5min":15.071999999999999,"15min":15.071999999999999},"last":0.36199999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:43:14 2024","interfaces":[{"interface":"back","average":{"1min":3.2010000000000001,"5min":2.1259999999999999,"15min":1.0549999999999999},"min":{"1min":0.39400000000000002,"5min":0.221,"15min":0.221},"max":{"1min":13.138999999999999,"5min":13.138999999999999,"15min":13.138999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":3.4950000000000001,"5min":2.419,"15min":1.1759999999999999},"min":{"1min":0.39600000000000002,"5min":0.28999999999999998,"15min":0.23599999999999999},"max":{"1min":12.932,"5min":13.532999999999999,"15min":13.532999999999999},"last":0.47499999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:43:44 2024","interfaces":[{"interface":"back","average":{"1min":3.629,"5min":2.9100000000000001,"15min":1.383},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.29999999999999999},"max":{"1min":12.038,"5min":12.962,"15min":12.962},"last":0.45500000000000002},{"interface":"front","average":{"1min":1.95,"5min":2.419,"15min":1.21},"min":{"1min":0.311,"5min":0.311,"15min":0.29099999999999998},"max":{"1min":5.9580000000000002,"5min":17.759,"15min":17.759},"last":0.44500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":2118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:44:17.548 INFO:tasks.thrashosds.thrasher:Setting 6.f to [7, 6, 3, 5, 4, 0] 2024-02-19T21:44:17.549 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '6.f', '7', '6', '3', '5', '4', '0'] 2024-02-19T21:44:17.549 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pg-upmap-items 6.f 7 6 3 5 4 0 2024-02-19T21:44:17.773 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:44:17.775 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:17.776 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:44:17.877 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:44:17.904 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:17.912 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool application enable unique_pool_2 rados --yes-i-really-mean-it || true 2024-02-19T21:44:17.921 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:44:17.928 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:44:17.956 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:44:17.970 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:17.970 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:44:18.071 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:44:18.098 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:18.117 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-02-19T21:44:18.403 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:44:18.406 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:17.041556+0000 mgr.y (mgr.14514) 452 : cluster [DBG] pgmap v544: 136 pgs: 4 creating+peering, 12 unknown, 120 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-02-19T21:44:18.406 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:17.169658+0000 osd.7 (osd.7) 173 : cluster [DBG] 2.1c scrub starts 2024-02-19T21:44:18.406 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:17.172537+0000 osd.7 (osd.7) 174 : cluster [DBG] 2.1c scrub ok 2024-02-19T21:44:18.406 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:17.445261+0000 osd.5 (osd.5) 187 : cluster [DBG] 4.f deep-scrub starts 2024-02-19T21:44:18.406 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:17.451142+0000 osd.5 (osd.5) 188 : cluster [DBG] 4.f deep-scrub ok 2024-02-19T21:44:18.406 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:17.498613+0000 osd.4 (osd.4) 146 : cluster [DBG] 2.f scrub starts 2024-02-19T21:44:18.406 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:17.499658+0000 osd.4 (osd.4) 147 : cluster [DBG] 2.f scrub ok 2024-02-19T21:44:18.406 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:18.015916+0000 osd.0 (osd.0) 180 : cluster [DBG] 6.13 scrub starts 2024-02-19T21:44:18.406 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:18.106814+0000 mon.a (mon.0) 1266 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:44:18.406 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:18.112038+0000 mon.a (mon.0) 1267 : audit [INF] from='client.? 172.21.15.80:0/3336255068' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:44:18.406 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:18.112100+0000 mon.a (mon.0) 1268 : cluster [DBG] osdmap e271: 8 total, 8 up, 7 in 2024-02-19T21:44:18.407 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:17.041556+0000 mgr.y (mgr.14514) 452 : cluster [DBG] pgmap v544: 136 pgs: 4 creating+peering, 12 unknown, 120 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-02-19T21:44:18.407 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:17.169658+0000 osd.7 (osd.7) 173 : cluster [DBG] 2.1c scrub starts 2024-02-19T21:44:18.407 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:17.172537+0000 osd.7 (osd.7) 174 : cluster [DBG] 2.1c scrub ok 2024-02-19T21:44:18.407 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:17.445261+0000 osd.5 (osd.5) 187 : cluster [DBG] 4.f deep-scrub starts 2024-02-19T21:44:18.407 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:17.451142+0000 osd.5 (osd.5) 188 : cluster [DBG] 4.f deep-scrub ok 2024-02-19T21:44:18.407 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:17.498613+0000 osd.4 (osd.4) 146 : cluster [DBG] 2.f scrub starts 2024-02-19T21:44:18.407 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:17.499658+0000 osd.4 (osd.4) 147 : cluster [DBG] 2.f scrub ok 2024-02-19T21:44:18.407 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:18.015916+0000 osd.0 (osd.0) 180 : cluster [DBG] 6.13 scrub starts 2024-02-19T21:44:18.407 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:18.106814+0000 mon.a (mon.0) 1266 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:44:18.407 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:18.112038+0000 mon.a (mon.0) 1267 : audit [INF] from='client.? 172.21.15.80:0/3336255068' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:44:18.407 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:18.112100+0000 mon.a (mon.0) 1268 : cluster [DBG] osdmap e271: 8 total, 8 up, 7 in 2024-02-19T21:44:18.408 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:18.408 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:44:18.509 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:44:18.537 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:18.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:17.041556+0000 mgr.y (mgr.14514) 452 : cluster [DBG] pgmap v544: 136 pgs: 4 creating+peering, 12 unknown, 120 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-02-19T21:44:18.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:17.169658+0000 osd.7 (osd.7) 173 : cluster [DBG] 2.1c scrub starts 2024-02-19T21:44:18.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:17.172537+0000 osd.7 (osd.7) 174 : cluster [DBG] 2.1c scrub ok 2024-02-19T21:44:18.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:17.445261+0000 osd.5 (osd.5) 187 : cluster [DBG] 4.f deep-scrub starts 2024-02-19T21:44:18.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:17.451142+0000 osd.5 (osd.5) 188 : cluster [DBG] 4.f deep-scrub ok 2024-02-19T21:44:18.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:17.498613+0000 osd.4 (osd.4) 146 : cluster [DBG] 2.f scrub starts 2024-02-19T21:44:18.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:17.499658+0000 osd.4 (osd.4) 147 : cluster [DBG] 2.f scrub ok 2024-02-19T21:44:18.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:18.015916+0000 osd.0 (osd.0) 180 : cluster [DBG] 6.13 scrub starts 2024-02-19T21:44:18.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:18.106814+0000 mon.a (mon.0) 1266 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:44:18.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:18.112038+0000 mon.a (mon.0) 1267 : audit [INF] from='client.? 172.21.15.80:0/3336255068' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:44:18.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:18.112100+0000 mon.a (mon.0) 1268 : cluster [DBG] osdmap e271: 8 total, 8 up, 7 in 2024-02-19T21:44:18.891 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:44:18.891 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:44:19.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:17.713985+0000 osd.1 (osd.1) 171 : cluster [DBG] 4.17 scrub starts 2024-02-19T21:44:19.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:17.715647+0000 osd.1 (osd.1) 172 : cluster [DBG] 4.17 scrub ok 2024-02-19T21:44:19.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:18.094472+0000 osd.0 (osd.0) 181 : cluster [DBG] 6.13 scrub ok 2024-02-19T21:44:19.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:18.201126+0000 osd.6 (osd.6) 154 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:44:19.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:18.380896+0000 osd.5 (osd.5) 189 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:44:19.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:18.380954+0000 osd.5 (osd.5) 190 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:44:19.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:18.956547+0000 mon.a (mon.0) 1269 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:44:19.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:19.042946+0000 mon.a (mon.0) 1270 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "28"}]: dispatch 2024-02-19T21:44:19.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:17.713985+0000 osd.1 (osd.1) 171 : cluster [DBG] 4.17 scrub starts 2024-02-19T21:44:19.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:17.715647+0000 osd.1 (osd.1) 172 : cluster [DBG] 4.17 scrub ok 2024-02-19T21:44:19.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:18.094472+0000 osd.0 (osd.0) 181 : cluster [DBG] 6.13 scrub ok 2024-02-19T21:44:19.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:18.201126+0000 osd.6 (osd.6) 154 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:44:19.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:18.380896+0000 osd.5 (osd.5) 189 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:44:19.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:18.380954+0000 osd.5 (osd.5) 190 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:44:19.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:18.956547+0000 mon.a (mon.0) 1269 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:44:19.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:19.042946+0000 mon.a (mon.0) 1270 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "28"}]: dispatch 2024-02-19T21:44:19.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:17.713985+0000 osd.1 (osd.1) 171 : cluster [DBG] 4.17 scrub starts 2024-02-19T21:44:19.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:17.715647+0000 osd.1 (osd.1) 172 : cluster [DBG] 4.17 scrub ok 2024-02-19T21:44:19.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:18.094472+0000 osd.0 (osd.0) 181 : cluster [DBG] 6.13 scrub ok 2024-02-19T21:44:19.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:18.201126+0000 osd.6 (osd.6) 154 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:44:19.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:18.380896+0000 osd.5 (osd.5) 189 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:44:19.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:18.380954+0000 osd.5 (osd.5) 190 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:44:19.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:18.956547+0000 mon.a (mon.0) 1269 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:44:19.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:19.042946+0000 mon.a (mon.0) 1270 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "28"}]: dispatch 2024-02-19T21:44:19.620 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_ops_in_flight 2024-02-19T21:44:20.510 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:19.042155+0000 mgr.y (mgr.14514) 453 : cluster [DBG] pgmap v547: 135 pgs: 4 creating+peering, 12 unknown, 119 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:44:20.510 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:19.237773+0000 mon.a (mon.0) 1271 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "28"}]': finished 2024-02-19T21:44:20.510 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:19.237837+0000 mon.a (mon.0) 1272 : cluster [DBG] osdmap e272: 8 total, 8 up, 7 in 2024-02-19T21:44:20.510 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:19.765232+0000 mon.a (mon.0) 1273 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:44:20.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:19.042155+0000 mgr.y (mgr.14514) 453 : cluster [DBG] pgmap v547: 135 pgs: 4 creating+peering, 12 unknown, 119 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:44:20.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:19.237773+0000 mon.a (mon.0) 1271 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "28"}]': finished 2024-02-19T21:44:20.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:19.237837+0000 mon.a (mon.0) 1272 : cluster [DBG] osdmap e272: 8 total, 8 up, 7 in 2024-02-19T21:44:20.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:19.765232+0000 mon.a (mon.0) 1273 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:44:20.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:19.042155+0000 mgr.y (mgr.14514) 453 : cluster [DBG] pgmap v547: 135 pgs: 4 creating+peering, 12 unknown, 119 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:44:20.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:19.237773+0000 mon.a (mon.0) 1271 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "28"}]': finished 2024-02-19T21:44:20.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:19.237837+0000 mon.a (mon.0) 1272 : cluster [DBG] osdmap e272: 8 total, 8 up, 7 in 2024-02-19T21:44:20.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:19.765232+0000 mon.a (mon.0) 1273 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:44:20.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:44:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:44:20.952 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-19T21:44:20.980 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:44:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:44:20] "GET /metrics HTTP/1.1" 200 176022 "" "Prometheus/2.33.4" 2024-02-19T21:44:21.254 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:20.238620+0000 mon.a (mon.0) 1274 : cluster [DBG] osdmap e273: 8 total, 8 up, 7 in 2024-02-19T21:44:21.254 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:20.509879+0000 mgr.y (mgr.14514) 454 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:44:21.254 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:21.240744+0000 mon.a (mon.0) 1275 : cluster [DBG] osdmap e274: 8 total, 8 up, 7 in 2024-02-19T21:44:21.288 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:44:21.291 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:21.292 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:44:21.393 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:44:21.421 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:21.520 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:44:21.520 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:20.238620+0000 mon.a (mon.0) 1274 : cluster [DBG] osdmap e273: 8 total, 8 up, 7 in 2024-02-19T21:44:21.520 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:20.509879+0000 mgr.y (mgr.14514) 454 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:44:21.520 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:21.240744+0000 mon.a (mon.0) 1275 : cluster [DBG] osdmap e274: 8 total, 8 up, 7 in 2024-02-19T21:44:21.522 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:21.523 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:44:21.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:20.238620+0000 mon.a (mon.0) 1274 : cluster [DBG] osdmap e273: 8 total, 8 up, 7 in 2024-02-19T21:44:21.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:20.509879+0000 mgr.y (mgr.14514) 454 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:44:21.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:21.240744+0000 mon.a (mon.0) 1275 : cluster [DBG] osdmap e274: 8 total, 8 up, 7 in 2024-02-19T21:44:21.624 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:44:21.653 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:21.971 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:44:21.981 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:44:21.984 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:21.984 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:44:21.986 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:44:22.010 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:44:22.029 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:44:22.035 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:44:22.048 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:44:22.069 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:44:22.085 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:44:22.131 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:44:22.131 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:44:22.131 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:44:22.132 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:44:22.132 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:44:22.132 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:44:22.132 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:44:22.132 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:44:22.132 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:44:22.132 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:44:22.132 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:44:22.161 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:22.182 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:44:22.185 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:22.185 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:44:22.246 INFO:teuthology.orchestra.run.smithi080.stderr:set 6.f pg_upmap_items mapping to [7->6,3->5,4->0] 2024-02-19T21:44:22.256 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:21.042742+0000 mgr.y (mgr.14514) 455 : cluster [DBG] pgmap v550: 135 pgs: 2 peering, 133 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:44:22.256 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:21.951591+0000 mon.a (mon.0) 1276 : audit [INF] from='client.? 172.21.15.80:0/1049188021' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "6.f", "id": [7, 6, 3, 5, 4, 0]}]: dispatch 2024-02-19T21:44:22.256 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:21.964227+0000 mon.a (mon.0) 1277 : audit [DBG] from='client.? 172.21.15.80:0/3964406817' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:44:22.256 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:22.241442+0000 mon.a (mon.0) 1278 : audit [INF] from='client.? 172.21.15.80:0/1049188021' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "6.f", "id": [7, 6, 3, 5, 4, 0]}]': finished 2024-02-19T21:44:22.256 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:22.241516+0000 mon.a (mon.0) 1279 : cluster [DBG] osdmap e275: 8 total, 8 up, 7 in 2024-02-19T21:44:22.256 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:21.042742+0000 mgr.y (mgr.14514) 455 : cluster [DBG] pgmap v550: 135 pgs: 2 peering, 133 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:44:22.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:21.951591+0000 mon.a (mon.0) 1276 : audit [INF] from='client.? 172.21.15.80:0/1049188021' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "6.f", "id": [7, 6, 3, 5, 4, 0]}]: dispatch 2024-02-19T21:44:22.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:21.964227+0000 mon.a (mon.0) 1277 : audit [DBG] from='client.? 172.21.15.80:0/3964406817' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:44:22.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:22.241442+0000 mon.a (mon.0) 1278 : audit [INF] from='client.? 172.21.15.80:0/1049188021' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "6.f", "id": [7, 6, 3, 5, 4, 0]}]': finished 2024-02-19T21:44:22.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:22.241516+0000 mon.a (mon.0) 1279 : cluster [DBG] osdmap e275: 8 total, 8 up, 7 in 2024-02-19T21:44:22.287 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:44:22.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:21.042742+0000 mgr.y (mgr.14514) 455 : cluster [DBG] pgmap v550: 135 pgs: 2 peering, 133 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:44:22.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:21.951591+0000 mon.a (mon.0) 1276 : audit [INF] from='client.? 172.21.15.80:0/1049188021' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "6.f", "id": [7, 6, 3, 5, 4, 0]}]: dispatch 2024-02-19T21:44:22.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:21.964227+0000 mon.a (mon.0) 1277 : audit [DBG] from='client.? 172.21.15.80:0/3964406817' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:44:22.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:22.241442+0000 mon.a (mon.0) 1278 : audit [INF] from='client.? 172.21.15.80:0/1049188021' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "6.f", "id": [7, 6, 3, 5, 4, 0]}]': finished 2024-02-19T21:44:22.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:22.241516+0000 mon.a (mon.0) 1279 : cluster [DBG] osdmap e275: 8 total, 8 up, 7 in 2024-02-19T21:44:22.318 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:22.675 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:44:23.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:23.043938+0000 mon.a (mon.0) 1280 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "27"}]: dispatch 2024-02-19T21:44:23.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:23.243353+0000 mon.a (mon.0) 1281 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "27"}]': finished 2024-02-19T21:44:23.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:23.243411+0000 mon.a (mon.0) 1282 : cluster [DBG] osdmap e276: 8 total, 8 up, 7 in 2024-02-19T21:44:23.567 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:23.043938+0000 mon.a (mon.0) 1280 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "27"}]: dispatch 2024-02-19T21:44:23.567 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:23.243353+0000 mon.a (mon.0) 1281 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "27"}]': finished 2024-02-19T21:44:23.567 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:23.243411+0000 mon.a (mon.0) 1282 : cluster [DBG] osdmap e276: 8 total, 8 up, 7 in 2024-02-19T21:44:23.567 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:23.043938+0000 mon.a (mon.0) 1280 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "27"}]: dispatch 2024-02-19T21:44:23.567 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:23.243353+0000 mon.a (mon.0) 1281 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "27"}]': finished 2024-02-19T21:44:23.567 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:23.243411+0000 mon.a (mon.0) 1282 : cluster [DBG] osdmap e276: 8 total, 8 up, 7 in 2024-02-19T21:44:23.568 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:44:23.571 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:23.571 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:44:23.672 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:44:23.700 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:24.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:23.043188+0000 mgr.y (mgr.14514) 456 : cluster [DBG] pgmap v553: 134 pgs: 1 peering, 133 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:44:24.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:24.246337+0000 mon.a (mon.0) 1283 : cluster [DBG] osdmap e277: 8 total, 8 up, 7 in 2024-02-19T21:44:24.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:23.043188+0000 mgr.y (mgr.14514) 456 : cluster [DBG] pgmap v553: 134 pgs: 1 peering, 133 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:44:24.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:24.246337+0000 mon.a (mon.0) 1283 : cluster [DBG] osdmap e277: 8 total, 8 up, 7 in 2024-02-19T21:44:24.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:23.043188+0000 mgr.y (mgr.14514) 456 : cluster [DBG] pgmap v553: 134 pgs: 1 peering, 133 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:44:24.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:24.246337+0000 mon.a (mon.0) 1283 : cluster [DBG] osdmap e277: 8 total, 8 up, 7 in 2024-02-19T21:44:24.882 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:44:24.885 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:24.885 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:44:24.986 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:44:25.016 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:25.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:24.304111+0000 mon.a (mon.0) 1284 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:44:25.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:25.109074+0000 mon.a (mon.0) 1285 : cluster [DBG] osdmap e278: 8 total, 8 up, 7 in 2024-02-19T21:44:25.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:24.304111+0000 mon.a (mon.0) 1284 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:44:25.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:25.109074+0000 mon.a (mon.0) 1285 : cluster [DBG] osdmap e278: 8 total, 8 up, 7 in 2024-02-19T21:44:25.618 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:24.304111+0000 mon.a (mon.0) 1284 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:44:25.618 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:25.109074+0000 mon.a (mon.0) 1285 : cluster [DBG] osdmap e278: 8 total, 8 up, 7 in 2024-02-19T21:44:26.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:44:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:44:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:44:26.465 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:44:26.468 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:26.468 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:44:26.569 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:44:26.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:25.043792+0000 mgr.y (mgr.14514) 457 : cluster [DBG] pgmap v556: 134 pgs: 134 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:44:26.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:26.125948+0000 mon.a (mon.0) 1286 : cluster [DBG] osdmap e279: 8 total, 8 up, 7 in 2024-02-19T21:44:26.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:25.043792+0000 mgr.y (mgr.14514) 457 : cluster [DBG] pgmap v556: 134 pgs: 134 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:44:26.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:26.125948+0000 mon.a (mon.0) 1286 : cluster [DBG] osdmap e279: 8 total, 8 up, 7 in 2024-02-19T21:44:26.600 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:25.043792+0000 mgr.y (mgr.14514) 457 : cluster [DBG] pgmap v556: 134 pgs: 134 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:44:26.600 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:26.125948+0000 mon.a (mon.0) 1286 : cluster [DBG] osdmap e279: 8 total, 8 up, 7 in 2024-02-19T21:44:26.604 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:26.625 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:44:26.628 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:26.628 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:44:26.729 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:44:26.760 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:26.780 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:44:26.783 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:26.783 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:44:26.884 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:44:26.912 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:26.932 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:44:26.935 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:26.935 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:44:27.036 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:44:27.064 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:27.083 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:44:27.086 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:27.087 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:44:27.187 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:44:27.216 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:27.447 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:27.045180+0000 mon.a (mon.0) 1287 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "26"}]: dispatch 2024-02-19T21:44:27.447 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:27.045180+0000 mon.a (mon.0) 1287 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "26"}]: dispatch 2024-02-19T21:44:27.664 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:44:27.667 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:27.668 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:44:27.769 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:44:27.798 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:27.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:27.045180+0000 mon.a (mon.0) 1287 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "26"}]: dispatch 2024-02-19T21:44:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:44:28.328 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:28.329 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:44:28.329 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-02-19T21:44:28.430 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:44:28.464 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:28.485 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:44:28.485 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:44:28.487 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:28.488 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:44:28.588 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:44:28.590 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:27.044384+0000 mgr.y (mgr.14514) 458 : cluster [DBG] pgmap v559: 133 pgs: 1 peering, 132 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:44:28.590 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:27.318821+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "26"}]': finished 2024-02-19T21:44:28.590 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:27.318884+0000 mon.a (mon.0) 1289 : cluster [DBG] osdmap e280: 8 total, 8 up, 7 in 2024-02-19T21:44:28.590 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:28.171955+0000 mon.a (mon.0) 1290 : audit [INF] from='client.? 172.21.15.80:0/1812268531' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:44:28.592 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:27.044384+0000 mgr.y (mgr.14514) 458 : cluster [DBG] pgmap v559: 133 pgs: 1 peering, 132 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:44:28.592 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:27.318821+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "26"}]': finished 2024-02-19T21:44:28.592 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:27.318884+0000 mon.a (mon.0) 1289 : cluster [DBG] osdmap e280: 8 total, 8 up, 7 in 2024-02-19T21:44:28.592 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:28.171955+0000 mon.a (mon.0) 1290 : audit [INF] from='client.? 172.21.15.80:0/1812268531' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:44:28.616 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:27.044384+0000 mgr.y (mgr.14514) 458 : cluster [DBG] pgmap v559: 133 pgs: 1 peering, 132 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:44:28.616 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:27.318821+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "26"}]': finished 2024-02-19T21:44:28.616 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:27.318884+0000 mon.a (mon.0) 1289 : cluster [DBG] osdmap e280: 8 total, 8 up, 7 in 2024-02-19T21:44:28.617 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:28.171955+0000 mon.a (mon.0) 1290 : audit [INF] from='client.? 172.21.15.80:0/1812268531' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:44:28.618 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:28.638 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:44:28.641 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:28.642 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:44:28.742 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:44:28.770 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:28.868 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:44:28.870 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:28.871 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:44:28.972 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:44:28.999 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:29.051 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:44:29.053 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:29.054 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:44:29.155 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:44:29.182 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:29.339 INFO:teuthology.orchestra.run.smithi080.stderr:enabled application 'rados' on pool 'unique_pool_2' 2024-02-19T21:44:29.580 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:28.316383+0000 mon.a (mon.0) 1291 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:44:29.580 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:28.321464+0000 mon.a (mon.0) 1292 : audit [INF] from='client.? 172.21.15.80:0/1812268531' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:44:29.580 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:28.321525+0000 mon.a (mon.0) 1293 : cluster [DBG] osdmap e281: 8 total, 8 up, 7 in 2024-02-19T21:44:29.580 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:28.644272+0000 mon.c (mon.2) 64 : audit [INF] from='client.? 172.21.15.80:0/3820023923' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T21:44:29.581 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:28.644631+0000 mon.a (mon.0) 1294 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T21:44:29.581 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:28.316383+0000 mon.a (mon.0) 1291 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:44:29.581 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:28.321464+0000 mon.a (mon.0) 1292 : audit [INF] from='client.? 172.21.15.80:0/1812268531' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:44:29.581 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:28.321525+0000 mon.a (mon.0) 1293 : cluster [DBG] osdmap e281: 8 total, 8 up, 7 in 2024-02-19T21:44:29.581 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:28.644272+0000 mon.c (mon.2) 64 : audit [INF] from='client.? 172.21.15.80:0/3820023923' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T21:44:29.581 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:28.644631+0000 mon.a (mon.0) 1294 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T21:44:29.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:28.316383+0000 mon.a (mon.0) 1291 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:44:29.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:28.321464+0000 mon.a (mon.0) 1292 : audit [INF] from='client.? 172.21.15.80:0/1812268531' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:44:29.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:28.321525+0000 mon.a (mon.0) 1293 : cluster [DBG] osdmap e281: 8 total, 8 up, 7 in 2024-02-19T21:44:29.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:28.644272+0000 mon.c (mon.2) 64 : audit [INF] from='client.? 172.21.15.80:0/3820023923' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T21:44:29.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:28.644631+0000 mon.a (mon.0) 1294 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T21:44:29.876 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:44:29.876 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-02-19T21:44:29.876 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-02-19T21:44:29.877 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:44:30.420 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 6, 7] out_osds: [2] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:44:30.420 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:44:30.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:29.044946+0000 mgr.y (mgr.14514) 459 : cluster [DBG] pgmap v562: 133 pgs: 1 peering, 132 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:44:30.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:29.333909+0000 mon.a (mon.0) 1295 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-19T21:44:30.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:29.333978+0000 mon.a (mon.0) 1296 : cluster [DBG] osdmap e282: 8 total, 8 up, 7 in 2024-02-19T21:44:30.578 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:29.044946+0000 mgr.y (mgr.14514) 459 : cluster [DBG] pgmap v562: 133 pgs: 1 peering, 132 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:44:30.578 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:29.333909+0000 mon.a (mon.0) 1295 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-19T21:44:30.578 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:29.333978+0000 mon.a (mon.0) 1296 : cluster [DBG] osdmap e282: 8 total, 8 up, 7 in 2024-02-19T21:44:30.596 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_blocked_ops 2024-02-19T21:44:30.631 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:44:30.634 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:30.635 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:44:30.736 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:44:30.765 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:29.044946+0000 mgr.y (mgr.14514) 459 : cluster [DBG] pgmap v562: 133 pgs: 1 peering, 132 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:44:30.766 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:29.333909+0000 mon.a (mon.0) 1295 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-19T21:44:30.766 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:29.333978+0000 mon.a (mon.0) 1296 : cluster [DBG] osdmap e282: 8 total, 8 up, 7 in 2024-02-19T21:44:30.766 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:44:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:44:30.768 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:30.790 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:44:30.793 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:30.793 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:44:30.846 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:44:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:44:30] "GET /metrics HTTP/1.1" 200 176022 "" "Prometheus/2.33.4" 2024-02-19T21:44:30.894 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:44:30.924 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:30.944 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:44:30.947 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:30.948 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:44:31.036 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:44:31.049 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:44:31.074 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:44:31.077 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:31.097 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:44:31.099 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:31.100 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:44:31.201 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:44:31.229 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:31.248 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:44:31.251 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:31.252 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:44:31.353 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:44:31.382 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:31.556 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:30.260430+0000 osd.3 (osd.3) 182 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:44:31.556 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:30.260518+0000 osd.3 (osd.3) 183 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:44:31.556 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:30.332743+0000 mon.a (mon.0) 1297 : cluster [DBG] osdmap e283: 8 total, 8 up, 7 in 2024-02-19T21:44:31.556 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:30.520840+0000 mgr.y (mgr.14514) 460 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:44:31.556 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:31.046162+0000 mon.a (mon.0) 1298 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "25"}]: dispatch 2024-02-19T21:44:31.557 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:30.260430+0000 osd.3 (osd.3) 182 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:44:31.557 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:30.260518+0000 osd.3 (osd.3) 183 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:44:31.557 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:30.332743+0000 mon.a (mon.0) 1297 : cluster [DBG] osdmap e283: 8 total, 8 up, 7 in 2024-02-19T21:44:31.557 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:30.520840+0000 mgr.y (mgr.14514) 460 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:44:31.557 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:31.046162+0000 mon.a (mon.0) 1298 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "25"}]: dispatch 2024-02-19T21:44:31.580 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:44:31.586 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:31.586 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:44:31.598 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset noscrub 2024-02-19T21:44:31.687 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:44:31.717 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:31.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:30.260430+0000 osd.3 (osd.3) 182 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:44:31.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:30.260518+0000 osd.3 (osd.3) 183 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:44:31.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:30.332743+0000 mon.a (mon.0) 1297 : cluster [DBG] osdmap e283: 8 total, 8 up, 7 in 2024-02-19T21:44:31.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:30.520840+0000 mgr.y (mgr.14514) 460 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:44:31.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:31.046162+0000 mon.a (mon.0) 1298 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "25"}]: dispatch 2024-02-19T21:44:31.844 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:44:31.849 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:31.849 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:44:31.950 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:44:31.978 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:32.022 DEBUG:teuthology.orchestra.run.smithi080:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_2 bench 90 write' 2024-02-19T21:44:32.022 INFO:tasks.thrashosds.thrasher:Growing pool default.rgw.meta 2024-02-19T21:44:32.022 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:44:32.024 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-02-19T21:44:32.024 INFO:teuthology.orchestra.run:waiting for 3000 2024-02-19T21:44:32.071 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:hints = 1 2024-02-19T21:44:32.072 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-02-19T21:44:32.072 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Object prefix: benchmark_data_smithi080_126364 2024-02-19T21:44:32.072 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-19T21:44:32.072 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 0 0 0 0 0 0 - 0 2024-02-19T21:44:32.427 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:44:32.430 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:32.430 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:44:32.491 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:31.045313+0000 mgr.y (mgr.14514) 461 : cluster [DBG] pgmap v565: 132 pgs: 1 peering, 131 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:44:32.491 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:31.257017+0000 osd.4 (osd.4) 148 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:44:32.491 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:31.257074+0000 osd.4 (osd.4) 149 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:44:32.491 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:31.341335+0000 mon.a (mon.0) 1299 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "25"}]': finished 2024-02-19T21:44:32.491 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:31.341421+0000 mon.a (mon.0) 1300 : cluster [DBG] osdmap e284: 8 total, 8 up, 7 in 2024-02-19T21:44:32.491 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:31.429738+0000 osd.6 (osd.6) 155 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:44:32.492 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:31.429789+0000 osd.6 (osd.6) 156 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:44:32.492 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:31.045313+0000 mgr.y (mgr.14514) 461 : cluster [DBG] pgmap v565: 132 pgs: 1 peering, 131 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:44:32.492 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:31.257017+0000 osd.4 (osd.4) 148 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:44:32.492 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:31.257074+0000 osd.4 (osd.4) 149 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:44:32.492 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:31.341335+0000 mon.a (mon.0) 1299 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "25"}]': finished 2024-02-19T21:44:32.492 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:31.341421+0000 mon.a (mon.0) 1300 : cluster [DBG] osdmap e284: 8 total, 8 up, 7 in 2024-02-19T21:44:32.492 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:31.429738+0000 osd.6 (osd.6) 155 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:44:32.492 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:31.429789+0000 osd.6 (osd.6) 156 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:44:32.531 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:44:32.577 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:32.607 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:44:32.609 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:32.610 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:44:32.711 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:44:32.759 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:32.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:31.045313+0000 mgr.y (mgr.14514) 461 : cluster [DBG] pgmap v565: 132 pgs: 1 peering, 131 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:44:32.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:31.257017+0000 osd.4 (osd.4) 148 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:44:32.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:31.257074+0000 osd.4 (osd.4) 149 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:44:32.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:31.341335+0000 mon.a (mon.0) 1299 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "25"}]': finished 2024-02-19T21:44:32.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:31.341421+0000 mon.a (mon.0) 1300 : cluster [DBG] osdmap e284: 8 total, 8 up, 7 in 2024-02-19T21:44:32.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:31.429738+0000 osd.6 (osd.6) 155 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:44:32.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:31.429789+0000 osd.6 (osd.6) 156 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:44:33.072 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 1 16 3560 3544 221.488 221.5 0.0037706 0.00449833 2024-02-19T21:44:33.319 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:44:33.323 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:33.324 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:44:33.425 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:44:33.469 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:33.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:32.221925+0000 osd.0 (osd.0) 182 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:44:33.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:32.221975+0000 osd.0 (osd.0) 183 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:44:33.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:32.353959+0000 mon.a (mon.0) 1301 : cluster [DBG] osdmap e285: 8 total, 8 up, 7 in 2024-02-19T21:44:33.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:32.221925+0000 osd.0 (osd.0) 182 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:44:33.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:32.221975+0000 osd.0 (osd.0) 183 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:44:33.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:32.353959+0000 mon.a (mon.0) 1301 : cluster [DBG] osdmap e285: 8 total, 8 up, 7 in 2024-02-19T21:44:33.679 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:44:33.685 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:33.685 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:44:33.786 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:44:33.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:32.221925+0000 osd.0 (osd.0) 182 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:44:33.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:32.221975+0000 osd.0 (osd.0) 183 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:44:33.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:32.353959+0000 mon.a (mon.0) 1301 : cluster [DBG] osdmap e285: 8 total, 8 up, 7 in 2024-02-19T21:44:33.830 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:33.859 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:44:33.863 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:33.863 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:44:33.964 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:44:34.007 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:34.034 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:44:34.038 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:34.038 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:44:34.072 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 2 16 6929 6913 216.013 210.562 0.00260217 0.00462013 2024-02-19T21:44:34.138 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:44:34.183 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:34.211 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:44:34.215 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:34.216 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:44:34.316 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:44:34.364 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:34.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:33.045768+0000 mgr.y (mgr.14514) 462 : cluster [DBG] pgmap v568: 132 pgs: 1 peering, 131 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:44:34.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:33.373360+0000 mon.a (mon.0) 1302 : cluster [DBG] osdmap e286: 8 total, 8 up, 7 in 2024-02-19T21:44:34.686 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:33.045768+0000 mgr.y (mgr.14514) 462 : cluster [DBG] pgmap v568: 132 pgs: 1 peering, 131 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:44:34.686 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:33.373360+0000 mon.a (mon.0) 1302 : cluster [DBG] osdmap e286: 8 total, 8 up, 7 in 2024-02-19T21:44:34.688 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:33.045768+0000 mgr.y (mgr.14514) 462 : cluster [DBG] pgmap v568: 132 pgs: 1 peering, 131 active+clean; 5.7 KiB data, 2.1 GiB used, 624 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:44:34.689 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:33.373360+0000 mon.a (mon.0) 1302 : cluster [DBG] osdmap e286: 8 total, 8 up, 7 in 2024-02-19T21:44:34.891 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:44:34.893 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:44:34.983 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:44:35.010 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:44:35.038 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:44:35.063 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:44:35.072 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 3 16 9779 9763 203.379 178.125 0.00599208 0.0049077 2024-02-19T21:44:35.094 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:44:35.141 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:44:35.166 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:44:35.197 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:44:35.202 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:44:35.202 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:44:35.202 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:44:35.202 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:44:35.202 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:44:35.202 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:44:35.202 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:44:35.202 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:44:35.390 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:34.378288+0000 mon.a (mon.0) 1303 : cluster [DBG] osdmap e287: 8 total, 8 up, 7 in 2024-02-19T21:44:35.390 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:34.944935+0000 mon.b (mon.1) 51 : audit [DBG] from='client.? 172.21.15.80:0/2994490814' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:44:35.390 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:35.049061+0000 mon.a (mon.0) 1304 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "24"}]: dispatch 2024-02-19T21:44:35.390 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:35.124500+0000 mon.a (mon.0) 1305 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "24"}]': finished 2024-02-19T21:44:35.390 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:35.124561+0000 mon.a (mon.0) 1306 : cluster [DBG] osdmap e288: 8 total, 8 up, 7 in 2024-02-19T21:44:35.685 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:34.378288+0000 mon.a (mon.0) 1303 : cluster [DBG] osdmap e287: 8 total, 8 up, 7 in 2024-02-19T21:44:35.685 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:34.944935+0000 mon.b (mon.1) 51 : audit [DBG] from='client.? 172.21.15.80:0/2994490814' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:44:35.685 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:35.049061+0000 mon.a (mon.0) 1304 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "24"}]: dispatch 2024-02-19T21:44:35.686 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:35.124500+0000 mon.a (mon.0) 1305 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "24"}]': finished 2024-02-19T21:44:35.686 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:35.124561+0000 mon.a (mon.0) 1306 : cluster [DBG] osdmap e288: 8 total, 8 up, 7 in 2024-02-19T21:44:35.806 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:44:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:44:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:44:35.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:34.378288+0000 mon.a (mon.0) 1303 : cluster [DBG] osdmap e287: 8 total, 8 up, 7 in 2024-02-19T21:44:35.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:34.944935+0000 mon.b (mon.1) 51 : audit [DBG] from='client.? 172.21.15.80:0/2994490814' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:44:35.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:35.049061+0000 mon.a (mon.0) 1304 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "24"}]: dispatch 2024-02-19T21:44:35.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:35.124500+0000 mon.a (mon.0) 1305 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "24"}]': finished 2024-02-19T21:44:35.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:35.124561+0000 mon.a (mon.0) 1306 : cluster [DBG] osdmap e288: 8 total, 8 up, 7 in 2024-02-19T21:44:35.905 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:44:35.905 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:44:36.072 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 4 16 12610 12594 196.764 176.938 0.00475813 0.0050753 2024-02-19T21:44:36.133 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:44:36.138 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:36.139 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:44:36.240 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:44:36.291 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:36.315 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:44:36.318 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:36.319 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:44:36.420 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:44:36.476 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:36.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:35.047835+0000 mgr.y (mgr.14514) 463 : cluster [DBG] pgmap v571: 131 pgs: 131 active+clean; 412 MiB data, 3.3 GiB used, 623 GiB / 626 GiB avail; 1.2 KiB/s rd, 103 MiB/s wr, 1.65k op/s 2024-02-19T21:44:36.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:36.124347+0000 mon.a (mon.0) 1307 : cluster [DBG] osdmap e289: 8 total, 8 up, 7 in 2024-02-19T21:44:36.611 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:44:36.614 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:36.614 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:44:36.715 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:44:36.716 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:35.047835+0000 mgr.y (mgr.14514) 463 : cluster [DBG] pgmap v571: 131 pgs: 131 active+clean; 412 MiB data, 3.3 GiB used, 623 GiB / 626 GiB avail; 1.2 KiB/s rd, 103 MiB/s wr, 1.65k op/s 2024-02-19T21:44:36.716 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:36.124347+0000 mon.a (mon.0) 1307 : cluster [DBG] osdmap e289: 8 total, 8 up, 7 in 2024-02-19T21:44:36.716 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:35.047835+0000 mgr.y (mgr.14514) 463 : cluster [DBG] pgmap v571: 131 pgs: 131 active+clean; 412 MiB data, 3.3 GiB used, 623 GiB / 626 GiB avail; 1.2 KiB/s rd, 103 MiB/s wr, 1.65k op/s 2024-02-19T21:44:36.716 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:36.124347+0000 mon.a (mon.0) 1307 : cluster [DBG] osdmap e289: 8 total, 8 up, 7 in 2024-02-19T21:44:36.765 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:36.799 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:44:36.803 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:36.804 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:44:36.905 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:44:36.946 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:37.072 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 5 16 15334 15318 191.459 170.25 0.00550435 0.0052182 2024-02-19T21:44:37.155 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:44:37.158 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:37.159 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:44:37.260 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:44:37.307 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:37.332 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:44:37.334 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:37.335 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:44:37.436 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:44:37.474 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:36.455753+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:44:37.474 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:37.127609+0000 mon.a (mon.0) 1309 : cluster [DBG] osdmap e290: 8 total, 8 up, 7 in 2024-02-19T21:44:37.481 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:37.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:36.455753+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:44:37.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:37.127609+0000 mon.a (mon.0) 1309 : cluster [DBG] osdmap e290: 8 total, 8 up, 7 in 2024-02-19T21:44:37.588 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:44:37.591 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:37.591 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:44:37.692 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:44:37.732 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:36.455753+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:44:37.732 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:37.127609+0000 mon.a (mon.0) 1309 : cluster [DBG] osdmap e290: 8 total, 8 up, 7 in 2024-02-19T21:44:37.733 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:38.072 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 6 16 18002 17986 187.338 166.75 0.00209558 0.00533085 2024-02-19T21:44:38.176 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_historic_ops 2024-02-19T21:44:38.392 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:44:38.402 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:38.403 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:44:38.504 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:44:38.570 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:38.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:37.048316+0000 mgr.y (mgr.14514) 464 : cluster [DBG] pgmap v574: 131 pgs: 2 peering, 129 active+clean; 610 MiB data, 3.6 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 152 MiB/s wr, 2.44k op/s 2024-02-19T21:44:38.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:38.131682+0000 mon.a (mon.0) 1310 : cluster [DBG] osdmap e291: 8 total, 8 up, 7 in 2024-02-19T21:44:38.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:37.048316+0000 mgr.y (mgr.14514) 464 : cluster [DBG] pgmap v574: 131 pgs: 2 peering, 129 active+clean; 610 MiB data, 3.6 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 152 MiB/s wr, 2.44k op/s 2024-02-19T21:44:38.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:38.131682+0000 mon.a (mon.0) 1310 : cluster [DBG] osdmap e291: 8 total, 8 up, 7 in 2024-02-19T21:44:38.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:37.048316+0000 mgr.y (mgr.14514) 464 : cluster [DBG] pgmap v574: 131 pgs: 2 peering, 129 active+clean; 610 MiB data, 3.6 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 152 MiB/s wr, 2.44k op/s 2024-02-19T21:44:38.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:38.131682+0000 mon.a (mon.0) 1310 : cluster [DBG] osdmap e291: 8 total, 8 up, 7 in 2024-02-19T21:44:39.072 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 7 16 20338 20322 181.431 146 0.00671067 0.00550602 2024-02-19T21:44:39.175 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:44:39.333 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:44:39.342 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:39.343 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:44:39.443 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:44:39.482 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:38.554392+0000 mon.a (mon.0) 1311 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:44:39.483 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:38.555534+0000 mon.a (mon.0) 1312 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:44:39.483 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:38.561497+0000 mon.a (mon.0) 1313 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:44:39.483 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:39.049825+0000 mon.a (mon.0) 1314 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "23"}]: dispatch 2024-02-19T21:44:39.499 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:39.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:38.554392+0000 mon.a (mon.0) 1311 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:44:39.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:38.555534+0000 mon.a (mon.0) 1312 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:44:39.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:38.561497+0000 mon.a (mon.0) 1313 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:44:39.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:39.049825+0000 mon.a (mon.0) 1314 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "23"}]: dispatch 2024-02-19T21:44:39.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:38.554392+0000 mon.a (mon.0) 1311 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:44:39.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:38.555534+0000 mon.a (mon.0) 1312 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:44:39.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:38.561497+0000 mon.a (mon.0) 1313 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:44:39.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:39.049825+0000 mon.a (mon.0) 1314 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "23"}]: dispatch 2024-02-19T21:44:39.868 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:44:39.871 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:39.872 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:44:39.899 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:44:39.976 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:44:40.024 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:40.051 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:44:40.055 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:40.056 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:44:40.072 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 8 16 22505 22489 175.681 135.438 0.00500227 0.00568658 2024-02-19T21:44:40.157 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:44:40.193 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:40.576 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:39.048761+0000 mgr.y (mgr.14514) 465 : cluster [DBG] pgmap v577: 130 pgs: 1 peering, 129 active+clean; 610 MiB data, 3.6 GiB used, 622 GiB / 626 GiB avail; 49 MiB/s wr, 790 op/s 2024-02-19T21:44:40.576 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:39.566161+0000 mon.a (mon.0) 1315 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "23"}]': finished 2024-02-19T21:44:40.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:39.048761+0000 mgr.y (mgr.14514) 465 : cluster [DBG] pgmap v577: 130 pgs: 1 peering, 129 active+clean; 610 MiB data, 3.6 GiB used, 622 GiB / 626 GiB avail; 49 MiB/s wr, 790 op/s 2024-02-19T21:44:40.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:39.566161+0000 mon.a (mon.0) 1315 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "23"}]': finished 2024-02-19T21:44:40.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:39.566213+0000 mon.a (mon.0) 1316 : cluster [DBG] osdmap e292: 8 total, 8 up, 7 in 2024-02-19T21:44:40.807 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:44:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:44:40.825 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:39.566213+0000 mon.a (mon.0) 1316 : cluster [DBG] osdmap e292: 8 total, 8 up, 7 in 2024-02-19T21:44:40.826 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:39.048761+0000 mgr.y (mgr.14514) 465 : cluster [DBG] pgmap v577: 130 pgs: 1 peering, 129 active+clean; 610 MiB data, 3.6 GiB used, 622 GiB / 626 GiB avail; 49 MiB/s wr, 790 op/s 2024-02-19T21:44:40.826 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:39.566161+0000 mon.a (mon.0) 1315 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "23"}]': finished 2024-02-19T21:44:40.826 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:39.566213+0000 mon.a (mon.0) 1316 : cluster [DBG] osdmap e292: 8 total, 8 up, 7 in 2024-02-19T21:44:40.826 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:44:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:44:40] "GET /metrics HTTP/1.1" 200 176022 "" "Prometheus/2.33.4" 2024-02-19T21:44:40.935 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:44:40.940 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:44:41.073 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 9 16 24590 24574 170.639 130.312 0.00693219 0.00585457 2024-02-19T21:44:41.252 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:44:41.259 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:41.259 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:44:41.266 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:44:41.360 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:44:41.413 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:41.443 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:44:41.448 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:41.448 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:44:41.549 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:44:41.598 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:41.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:40.533000+0000 mgr.y (mgr.14514) 466 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:44:41.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:40.589161+0000 mon.a (mon.0) 1317 : cluster [DBG] osdmap e293: 8 total, 8 up, 7 in 2024-02-19T21:44:41.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:40.533000+0000 mgr.y (mgr.14514) 466 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:44:41.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:40.589161+0000 mon.a (mon.0) 1317 : cluster [DBG] osdmap e293: 8 total, 8 up, 7 in 2024-02-19T21:44:41.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:40.533000+0000 mgr.y (mgr.14514) 466 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:44:41.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:40.589161+0000 mon.a (mon.0) 1317 : cluster [DBG] osdmap e293: 8 total, 8 up, 7 in 2024-02-19T21:44:42.072 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 10 16 26793 26777 167.342 137.688 0.00836194 0.00597107 2024-02-19T21:44:42.261 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:44:42.264 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:42.265 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:44:42.365 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:44:42.408 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:42.447 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:44:42.451 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:42.451 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:44:42.552 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:44:42.594 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:42.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:40.907373+0000 mgr.y (mgr.14514) 467 : audit [DBG] from='client.25229 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:44:42.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:41.049219+0000 mgr.y (mgr.14514) 468 : cluster [DBG] pgmap v580: 130 pgs: 2 peering, 128 active+clean; 1.4 GiB data, 6.0 GiB used, 620 GiB / 626 GiB avail; 1.2 KiB/s rd, 198 MiB/s wr, 3.17k op/s 2024-02-19T21:44:42.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:41.533791+0000 osd.1 (osd.1) 173 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:44:42.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:41.533830+0000 osd.1 (osd.1) 174 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:44:42.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:41.601429+0000 mon.a (mon.0) 1318 : cluster [DBG] osdmap e294: 8 total, 8 up, 7 in 2024-02-19T21:44:42.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:40.907373+0000 mgr.y (mgr.14514) 467 : audit [DBG] from='client.25229 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:44:42.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:41.049219+0000 mgr.y (mgr.14514) 468 : cluster [DBG] pgmap v580: 130 pgs: 2 peering, 128 active+clean; 1.4 GiB data, 6.0 GiB used, 620 GiB / 626 GiB avail; 1.2 KiB/s rd, 198 MiB/s wr, 3.17k op/s 2024-02-19T21:44:42.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:41.533791+0000 osd.1 (osd.1) 173 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:44:42.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:41.533830+0000 osd.1 (osd.1) 174 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:44:42.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:41.601429+0000 mon.a (mon.0) 1318 : cluster [DBG] osdmap e294: 8 total, 8 up, 7 in 2024-02-19T21:44:42.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:40.907373+0000 mgr.y (mgr.14514) 467 : audit [DBG] from='client.25229 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:44:42.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:41.049219+0000 mgr.y (mgr.14514) 468 : cluster [DBG] pgmap v580: 130 pgs: 2 peering, 128 active+clean; 1.4 GiB data, 6.0 GiB used, 620 GiB / 626 GiB avail; 1.2 KiB/s rd, 198 MiB/s wr, 3.17k op/s 2024-02-19T21:44:42.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:41.533791+0000 osd.1 (osd.1) 173 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:44:42.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:41.533830+0000 osd.1 (osd.1) 174 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:44:42.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:41.601429+0000 mon.a (mon.0) 1318 : cluster [DBG] osdmap e294: 8 total, 8 up, 7 in 2024-02-19T21:44:42.988 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":579,"stamp":"2024-02-19T21:44:40.587558+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1471551140,"num_objects":22646,"num_object_clones":0,"num_object_copies":67938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22646,"num_whiteouts":0,"num_read":1856,"num_read_kb":1608,"num_write":23168,"num_write_kb":1437097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":4733,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23259,"ondisk_log_size":23259,"up":390,"acting":390,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":393,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":656216064,"kb_used":6268664,"kb_used_data":4138944,"kb_used_omap":0,"kb_used_meta":2129664,"kb_avail":649947400,"statfs":{"total":671965249536,"available":665546137600,"internally_reserved":0,"allocated":4238278656,"data_stored":4234349329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2180775936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":831717376,"num_objects":12691,"num_object_clones":0,"num_object_copies":38073,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12691,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":12691,"num_write_kb":812224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.465258"},"pg_stats":[{"pgid":"2.1f","version":"0'0","reported_seq":262,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.131658+0000","last_change":"2024-02-19T21:40:28.473842+0000","last_active":"2024-02-19T21:44:38.131658+0000","last_peered":"2024-02-19T21:44:38.131658+0000","last_clean":"2024-02-19T21:44:38.131658+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:44:38.131658+0000","last_undegraded":"2024-02-19T21:44:38.131658+0000","last_fullsized":"2024-02-19T21:44:38.131658+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:28.473778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:28.473778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"201'27","reported_seq":234,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.132753+0000","last_change":"2024-02-19T21:39:51.546188+0000","last_active":"2024-02-19T21:44:38.132753+0000","last_peered":"2024-02-19T21:44:38.132753+0000","last_clean":"2024-02-19T21:44:38.132753+0000","last_became_active":"2024-02-19T21:39:51.536424+0000","last_became_peered":"2024-02-19T21:39:51.536424+0000","last_unstale":"2024-02-19T21:44:38.132753+0000","last_undegraded":"2024-02-19T21:44:38.132753+0000","last_fullsized":"2024-02-19T21:44:38.132753+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:39:29.269819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:29.269819+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":264,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.140578+0000","last_change":"2024-02-19T21:44:09.544309+0000","last_active":"2024-02-19T21:44:38.140578+0000","last_peered":"2024-02-19T21:44:38.140578+0000","last_clean":"2024-02-19T21:44:38.140578+0000","last_became_active":"2024-02-19T21:32:23.356975+0000","last_became_peered":"2024-02-19T21:32:23.356975+0000","last_unstale":"2024-02-19T21:44:38.140578+0000","last_undegraded":"2024-02-19T21:44:38.140578+0000","last_fullsized":"2024-02-19T21:44:38.140578+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:09.544245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:44:09.544245+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"200'19","reported_seq":306,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.133503+0000","last_change":"2024-02-19T21:44:08.556202+0000","last_active":"2024-02-19T21:44:38.133503+0000","last_peered":"2024-02-19T21:44:38.133503+0000","last_clean":"2024-02-19T21:44:38.133503+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:44:38.133503+0000","last_undegraded":"2024-02-19T21:44:38.133503+0000","last_fullsized":"2024-02-19T21:44:38.133503+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:44:08.556123+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:44:08.556123+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":262,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.133713+0000","last_change":"2024-02-19T21:40:34.884850+0000","last_active":"2024-02-19T21:44:38.133713+0000","last_peered":"2024-02-19T21:44:38.133713+0000","last_clean":"2024-02-19T21:44:38.133713+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:44:38.133713+0000","last_undegraded":"2024-02-19T21:44:38.133713+0000","last_fullsized":"2024-02-19T21:44:38.133713+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:34.884780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:08.490788+0000","last_clean_scrub_stamp":"2024-02-19T21:40:34.884780+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"200'7","reported_seq":259,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.140143+0000","last_change":"2024-02-19T21:44:07.580183+0000","last_active":"2024-02-19T21:44:38.140143+0000","last_peered":"2024-02-19T21:44:38.140143+0000","last_clean":"2024-02-19T21:44:38.140143+0000","last_became_active":"2024-02-19T21:39:39.471143+0000","last_became_peered":"2024-02-19T21:39:39.471143+0000","last_unstale":"2024-02-19T21:44:38.140143+0000","last_undegraded":"2024-02-19T21:44:38.140143+0000","last_fullsized":"2024-02-19T21:44:38.140143+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'7","last_scrub_stamp":"2024-02-19T21:44:07.580118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:07.580118+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":274,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.134335+0000","last_change":"2024-02-19T21:44:17.172601+0000","last_active":"2024-02-19T21:44:38.134335+0000","last_peered":"2024-02-19T21:44:38.134335+0000","last_clean":"2024-02-19T21:44:38.134335+0000","last_became_active":"2024-02-19T21:39:39.473759+0000","last_became_peered":"2024-02-19T21:39:39.473759+0000","last_unstale":"2024-02-19T21:44:38.134335+0000","last_undegraded":"2024-02-19T21:44:38.134335+0000","last_fullsized":"2024-02-19T21:44:38.134335+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:17.172541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:17.172541+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"200'19","reported_seq":282,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.139929+0000","last_change":"2024-02-19T21:39:47.395697+0000","last_active":"2024-02-19T21:44:38.139929+0000","last_peered":"2024-02-19T21:44:38.139929+0000","last_clean":"2024-02-19T21:44:38.139929+0000","last_became_active":"2024-02-19T21:35:14.514971+0000","last_became_peered":"2024-02-19T21:35:14.514971+0000","last_unstale":"2024-02-19T21:44:38.139929+0000","last_undegraded":"2024-02-19T21:44:38.139929+0000","last_fullsized":"2024-02-19T21:44:38.139929+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'13","last_scrub_stamp":"2024-02-19T21:39:47.395572+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:39:47.395572+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":142,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.140715+0000","last_change":"2024-02-19T21:42:04.201407+0000","last_active":"2024-02-19T21:44:38.140715+0000","last_peered":"2024-02-19T21:44:38.140715+0000","last_clean":"2024-02-19T21:44:38.140715+0000","last_became_active":"2024-02-19T21:42:04.201106+0000","last_became_peered":"2024-02-19T21:42:04.201106+0000","last_unstale":"2024-02-19T21:44:38.140715+0000","last_undegraded":"2024-02-19T21:44:38.140715+0000","last_fullsized":"2024-02-19T21:44:38.140715+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:24.788644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:24.788644+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,5],"acting":[6,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"201'18","reported_seq":225,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.137393+0000","last_change":"2024-02-19T21:44:15.699369+0000","last_active":"2024-02-19T21:44:38.137393+0000","last_peered":"2024-02-19T21:44:38.137393+0000","last_clean":"2024-02-19T21:44:38.137393+0000","last_became_active":"2024-02-19T21:38:31.247067+0000","last_became_peered":"2024-02-19T21:38:31.247067+0000","last_unstale":"2024-02-19T21:44:38.137393+0000","last_undegraded":"2024-02-19T21:44:38.137393+0000","last_fullsized":"2024-02-19T21:44:38.137393+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'18","last_scrub_stamp":"2024-02-19T21:44:15.699279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.699279+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":265,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.140569+0000","last_change":"2024-02-19T21:40:38.600031+0000","last_active":"2024-02-19T21:44:38.140569+0000","last_peered":"2024-02-19T21:44:38.140569+0000","last_clean":"2024-02-19T21:44:38.140569+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:44:38.140569+0000","last_undegraded":"2024-02-19T21:44:38.140569+0000","last_fullsized":"2024-02-19T21:44:38.140569+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:38.599939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:38.599939+0000","last_clean_scrub_stamp":"2024-02-19T21:40:38.599939+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"200'34","reported_seq":248,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.136596+0000","last_change":"2024-02-19T21:40:36.287163+0000","last_active":"2024-02-19T21:44:38.136596+0000","last_peered":"2024-02-19T21:44:38.136596+0000","last_clean":"2024-02-19T21:44:38.136596+0000","last_became_active":"2024-02-19T21:39:39.477429+0000","last_became_peered":"2024-02-19T21:39:39.477429+0000","last_unstale":"2024-02-19T21:44:38.136596+0000","last_undegraded":"2024-02-19T21:44:38.136596+0000","last_fullsized":"2024-02-19T21:44:38.136596+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'22","last_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.287051+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":189,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.140293+0000","last_change":"2024-02-19T21:44:18.202119+0000","last_active":"2024-02-19T21:44:38.140293+0000","last_peered":"2024-02-19T21:44:38.140293+0000","last_clean":"2024-02-19T21:44:38.140293+0000","last_became_active":"2024-02-19T21:42:04.198592+0000","last_became_peered":"2024-02-19T21:42:04.198592+0000","last_unstale":"2024-02-19T21:44:38.140293+0000","last_undegraded":"2024-02-19T21:44:38.140293+0000","last_fullsized":"2024-02-19T21:44:38.140293+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:33.515188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:33.515188+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"201'19","reported_seq":161,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.131504+0000","last_change":"2024-02-19T21:39:51.559559+0000","last_active":"2024-02-19T21:44:38.131504+0000","last_peered":"2024-02-19T21:44:38.131504+0000","last_clean":"2024-02-19T21:44:38.131504+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:44:38.131504+0000","last_undegraded":"2024-02-19T21:44:38.131504+0000","last_fullsized":"2024-02-19T21:44:38.131504+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:39:43.209803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:43.209803+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":275,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.136533+0000","last_change":"2024-02-19T21:44:14.474971+0000","last_active":"2024-02-19T21:44:38.136533+0000","last_peered":"2024-02-19T21:44:38.136533+0000","last_clean":"2024-02-19T21:44:38.136533+0000","last_became_active":"2024-02-19T21:42:04.199323+0000","last_became_peered":"2024-02-19T21:42:04.199323+0000","last_unstale":"2024-02-19T21:44:38.136533+0000","last_undegraded":"2024-02-19T21:44:38.136533+0000","last_fullsized":"2024-02-19T21:44:38.136533+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:14.474903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:44:14.474903+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"201'20","reported_seq":341,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.131776+0000","last_change":"2024-02-19T21:42:04.205219+0000","last_active":"2024-02-19T21:44:38.131776+0000","last_peered":"2024-02-19T21:44:38.131776+0000","last_clean":"2024-02-19T21:44:38.131776+0000","last_became_active":"2024-02-19T21:42:04.204882+0000","last_became_peered":"2024-02-19T21:42:04.204882+0000","last_unstale":"2024-02-19T21:44:38.131776+0000","last_undegraded":"2024-02-19T21:44:38.131776+0000","last_fullsized":"2024-02-19T21:44:38.131776+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:39:33.125904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:33.125904+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":178,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.131884+0000","last_change":"2024-02-19T21:44:18.094565+0000","last_active":"2024-02-19T21:44:38.131884+0000","last_peered":"2024-02-19T21:44:38.131884+0000","last_clean":"2024-02-19T21:44:38.131884+0000","last_became_active":"2024-02-19T21:39:39.471332+0000","last_became_peered":"2024-02-19T21:39:39.471332+0000","last_unstale":"2024-02-19T21:44:38.131884+0000","last_undegraded":"2024-02-19T21:44:38.131884+0000","last_fullsized":"2024-02-19T21:44:38.131884+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:18.094477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:44:18.094477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":258,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.133846+0000","last_change":"2024-02-19T21:41:36.941622+0000","last_active":"2024-02-19T21:44:38.133846+0000","last_peered":"2024-02-19T21:44:38.133846+0000","last_clean":"2024-02-19T21:44:38.133846+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:44:38.133846+0000","last_undegraded":"2024-02-19T21:44:38.133846+0000","last_fullsized":"2024-02-19T21:44:38.133846+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:36.941549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:41:36.941549+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":274,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.141170+0000","last_change":"2024-02-19T21:44:11.227806+0000","last_active":"2024-02-19T21:44:38.141170+0000","last_peered":"2024-02-19T21:44:38.141170+0000","last_clean":"2024-02-19T21:44:38.141170+0000","last_became_active":"2024-02-19T21:39:39.478633+0000","last_became_peered":"2024-02-19T21:39:39.478633+0000","last_unstale":"2024-02-19T21:44:38.141170+0000","last_undegraded":"2024-02-19T21:44:38.141170+0000","last_fullsized":"2024-02-19T21:44:38.141170+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:11.227741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:11.227741+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"201'19","reported_seq":314,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.139777+0000","last_change":"2024-02-19T21:44:10.534619+0000","last_active":"2024-02-19T21:44:38.139777+0000","last_peered":"2024-02-19T21:44:38.139777+0000","last_clean":"2024-02-19T21:44:38.139777+0000","last_became_active":"2024-02-19T21:42:04.205379+0000","last_became_peered":"2024-02-19T21:42:04.205379+0000","last_unstale":"2024-02-19T21:44:38.139777+0000","last_undegraded":"2024-02-19T21:44:38.139777+0000","last_fullsized":"2024-02-19T21:44:38.139777+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:44:10.534549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:10.534549+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":263,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.133716+0000","last_change":"2024-02-19T21:44:09.151576+0000","last_active":"2024-02-19T21:44:38.133716+0000","last_peered":"2024-02-19T21:44:38.133716+0000","last_clean":"2024-02-19T21:44:38.133716+0000","last_became_active":"2024-02-19T21:39:39.471306+0000","last_became_peered":"2024-02-19T21:39:39.471306+0000","last_unstale":"2024-02-19T21:44:38.133716+0000","last_undegraded":"2024-02-19T21:44:38.133716+0000","last_fullsized":"2024-02-19T21:44:38.133716+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:09.151490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:44:09.151490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":304,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.140434+0000","last_change":"2024-02-19T21:44:07.235190+0000","last_active":"2024-02-19T21:44:38.140434+0000","last_peered":"2024-02-19T21:44:38.140434+0000","last_clean":"2024-02-19T21:44:38.140434+0000","last_became_active":"2024-02-19T21:42:04.196794+0000","last_became_peered":"2024-02-19T21:42:04.196794+0000","last_unstale":"2024-02-19T21:44:38.140434+0000","last_undegraded":"2024-02-19T21:44:38.140434+0000","last_fullsized":"2024-02-19T21:44:38.140434+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:07.235071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:07.235071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":270,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.138283+0000","last_change":"2024-02-19T21:44:11.487571+0000","last_active":"2024-02-19T21:44:38.138283+0000","last_peered":"2024-02-19T21:44:38.138283+0000","last_clean":"2024-02-19T21:44:38.138283+0000","last_became_active":"2024-02-19T21:39:39.479927+0000","last_became_peered":"2024-02-19T21:39:39.479927+0000","last_unstale":"2024-02-19T21:44:38.138283+0000","last_undegraded":"2024-02-19T21:44:38.138283+0000","last_fullsized":"2024-02-19T21:44:38.138283+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:11.487509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:44:11.487509+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"200'8","reported_seq":122,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.139671+0000","last_change":"2024-02-19T21:41:42.590833+0000","last_active":"2024-02-19T21:44:38.139671+0000","last_peered":"2024-02-19T21:44:38.139671+0000","last_clean":"2024-02-19T21:44:38.139671+0000","last_became_active":"2024-02-19T21:41:42.243259+0000","last_became_peered":"2024-02-19T21:41:42.243259+0000","last_unstale":"2024-02-19T21:44:38.139671+0000","last_undegraded":"2024-02-19T21:44:38.139671+0000","last_fullsized":"2024-02-19T21:44:38.139671+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'4","last_scrub_stamp":"2024-02-19T21:40:18.214846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:18.214846+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":178,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.132755+0000","last_change":"2024-02-19T21:44:17.079476+0000","last_active":"2024-02-19T21:44:38.132755+0000","last_peered":"2024-02-19T21:44:38.132755+0000","last_clean":"2024-02-19T21:44:38.132755+0000","last_became_active":"2024-02-19T21:39:39.462363+0000","last_became_peered":"2024-02-19T21:39:39.462363+0000","last_unstale":"2024-02-19T21:44:38.132755+0000","last_undegraded":"2024-02-19T21:44:38.132755+0000","last_fullsized":"2024-02-19T21:44:38.132755+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:17.079391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:44:17.079391+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":271,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.137579+0000","last_change":"2024-02-19T21:42:04.199063+0000","last_active":"2024-02-19T21:44:38.137579+0000","last_peered":"2024-02-19T21:44:38.137579+0000","last_clean":"2024-02-19T21:44:38.137579+0000","last_became_active":"2024-02-19T21:42:04.198684+0000","last_became_peered":"2024-02-19T21:42:04.198684+0000","last_unstale":"2024-02-19T21:44:38.137579+0000","last_undegraded":"2024-02-19T21:44:38.137579+0000","last_fullsized":"2024-02-19T21:44:38.137579+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:26.272653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:26.272653+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":259,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.137080+0000","last_change":"2024-02-19T21:39:33.957921+0000","last_active":"2024-02-19T21:44:38.137080+0000","last_peered":"2024-02-19T21:44:38.137080+0000","last_clean":"2024-02-19T21:44:38.137080+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:44:38.137080+0000","last_undegraded":"2024-02-19T21:44:38.137080+0000","last_fullsized":"2024-02-19T21:44:38.137080+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:33.957814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:39:33.957814+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"201'19","reported_seq":301,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.135139+0000","last_change":"2024-02-19T21:41:23.880621+0000","last_active":"2024-02-19T21:44:38.135139+0000","last_peered":"2024-02-19T21:44:38.135139+0000","last_clean":"2024-02-19T21:44:38.135139+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:44:38.135139+0000","last_undegraded":"2024-02-19T21:44:38.135139+0000","last_fullsized":"2024-02-19T21:44:38.135139+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:41:23.880501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:41:23.880501+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":265,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.130880+0000","last_change":"2024-02-19T21:44:07.280418+0000","last_active":"2024-02-19T21:44:38.130880+0000","last_peered":"2024-02-19T21:44:38.130880+0000","last_clean":"2024-02-19T21:44:38.130880+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:44:38.130880+0000","last_undegraded":"2024-02-19T21:44:38.130880+0000","last_fullsized":"2024-02-19T21:44:38.130880+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:07.280329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:42.527849+0000","last_clean_scrub_stamp":"2024-02-19T21:44:07.280329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":264,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.140223+0000","last_change":"2024-02-19T21:44:08.574844+0000","last_active":"2024-02-19T21:44:38.140223+0000","last_peered":"2024-02-19T21:44:38.140223+0000","last_clean":"2024-02-19T21:44:38.140223+0000","last_became_active":"2024-02-19T21:39:51.534750+0000","last_became_peered":"2024-02-19T21:39:51.534750+0000","last_unstale":"2024-02-19T21:44:38.140223+0000","last_undegraded":"2024-02-19T21:44:38.140223+0000","last_fullsized":"2024-02-19T21:44:38.140223+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:08.574749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:08.574749+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":265,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.140218+0000","last_change":"2024-02-19T21:41:35.736077+0000","last_active":"2024-02-19T21:44:38.140218+0000","last_peered":"2024-02-19T21:44:38.140218+0000","last_clean":"2024-02-19T21:44:38.140218+0000","last_became_active":"2024-02-19T21:32:23.357338+0000","last_became_peered":"2024-02-19T21:32:23.357338+0000","last_unstale":"2024-02-19T21:44:38.140218+0000","last_undegraded":"2024-02-19T21:44:38.140218+0000","last_fullsized":"2024-02-19T21:44:38.140218+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:35.735995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:41:35.735995+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"200'15","reported_seq":299,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.137407+0000","last_change":"2024-02-19T21:39:45.026756+0000","last_active":"2024-02-19T21:44:38.137407+0000","last_peered":"2024-02-19T21:44:38.137407+0000","last_clean":"2024-02-19T21:44:38.137407+0000","last_became_active":"2024-02-19T21:39:39.466843+0000","last_became_peered":"2024-02-19T21:39:39.466843+0000","last_unstale":"2024-02-19T21:44:38.137407+0000","last_undegraded":"2024-02-19T21:44:38.137407+0000","last_fullsized":"2024-02-19T21:44:38.137407+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:39:45.026689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:45.026689+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"199'13","reported_seq":228,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.136453+0000","last_change":"2024-02-19T21:42:04.202258+0000","last_active":"2024-02-19T21:44:38.136453+0000","last_peered":"2024-02-19T21:44:38.136453+0000","last_clean":"2024-02-19T21:44:38.136453+0000","last_became_active":"2024-02-19T21:42:04.195103+0000","last_became_peered":"2024-02-19T21:42:04.195103+0000","last_unstale":"2024-02-19T21:44:38.136453+0000","last_undegraded":"2024-02-19T21:44:38.136453+0000","last_fullsized":"2024-02-19T21:44:38.136453+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'11","last_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:39:46.054888+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":271,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.132080+0000","last_change":"2024-02-19T21:40:33.532430+0000","last_active":"2024-02-19T21:44:38.132080+0000","last_peered":"2024-02-19T21:44:38.132080+0000","last_clean":"2024-02-19T21:44:38.132080+0000","last_became_active":"2024-02-19T21:32:23.361680+0000","last_became_peered":"2024-02-19T21:32:23.361680+0000","last_unstale":"2024-02-19T21:44:38.132080+0000","last_undegraded":"2024-02-19T21:44:38.132080+0000","last_fullsized":"2024-02-19T21:44:38.132080+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:33.532354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:33.550655+0000","last_clean_scrub_stamp":"2024-02-19T21:40:33.532354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"201'19","reported_seq":288,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.137656+0000","last_change":"2024-02-19T21:40:37.730352+0000","last_active":"2024-02-19T21:44:38.137656+0000","last_peered":"2024-02-19T21:44:38.137656+0000","last_clean":"2024-02-19T21:44:38.137656+0000","last_became_active":"2024-02-19T21:32:25.372206+0000","last_became_peered":"2024-02-19T21:32:25.372206+0000","last_unstale":"2024-02-19T21:44:38.137656+0000","last_undegraded":"2024-02-19T21:44:38.137656+0000","last_fullsized":"2024-02-19T21:44:38.137656+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'13","last_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:40:37.730197+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":413,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.139412+0000","last_change":"2024-02-19T21:40:32.679041+0000","last_active":"2024-02-19T21:44:38.139412+0000","last_peered":"2024-02-19T21:44:38.139412+0000","last_clean":"2024-02-19T21:44:38.139412+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:44:38.139412+0000","last_undegraded":"2024-02-19T21:44:38.139412+0000","last_fullsized":"2024-02-19T21:44:38.139412+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:40:32.678933+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":272,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.137494+0000","last_change":"2024-02-19T21:42:04.205987+0000","last_active":"2024-02-19T21:44:38.137494+0000","last_peered":"2024-02-19T21:44:38.137494+0000","last_clean":"2024-02-19T21:44:38.137494+0000","last_became_active":"2024-02-19T21:42:04.205401+0000","last_became_peered":"2024-02-19T21:42:04.205401+0000","last_unstale":"2024-02-19T21:44:38.137494+0000","last_undegraded":"2024-02-19T21:44:38.137494+0000","last_fullsized":"2024-02-19T21:44:38.137494+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:25.759697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:40:25.759697+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"201'25","reported_seq":292,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.139906+0000","last_change":"2024-02-19T21:40:39.592088+0000","last_active":"2024-02-19T21:44:38.139906+0000","last_peered":"2024-02-19T21:44:38.139906+0000","last_clean":"2024-02-19T21:44:38.139906+0000","last_became_active":"2024-02-19T21:32:25.372060+0000","last_became_peered":"2024-02-19T21:32:25.372060+0000","last_unstale":"2024-02-19T21:44:38.139906+0000","last_undegraded":"2024-02-19T21:44:38.139906+0000","last_fullsized":"2024-02-19T21:44:38.139906+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'15","last_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:40:39.591994+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":258,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.133549+0000","last_change":"2024-02-19T21:40:31.892048+0000","last_active":"2024-02-19T21:44:38.133549+0000","last_peered":"2024-02-19T21:44:38.133549+0000","last_clean":"2024-02-19T21:44:38.133549+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:44:38.133549+0000","last_undegraded":"2024-02-19T21:44:38.133549+0000","last_fullsized":"2024-02-19T21:44:38.133549+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:31.891967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_clean_scrub_stamp":"2024-02-19T21:40:31.891967+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":266,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.138083+0000","last_change":"2024-02-19T21:44:13.511663+0000","last_active":"2024-02-19T21:44:38.138083+0000","last_peered":"2024-02-19T21:44:38.138083+0000","last_clean":"2024-02-19T21:44:38.138083+0000","last_became_active":"2024-02-19T21:44:00.196223+0000","last_became_peered":"2024-02-19T21:44:00.196223+0000","last_unstale":"2024-02-19T21:44:38.138083+0000","last_undegraded":"2024-02-19T21:44:38.138083+0000","last_fullsized":"2024-02-19T21:44:38.138083+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:13.511574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:36.067354+0000","last_clean_scrub_stamp":"2024-02-19T21:44:13.511574+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":260,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.140501+0000","last_change":"2024-02-19T21:40:29.421893+0000","last_active":"2024-02-19T21:44:38.140501+0000","last_peered":"2024-02-19T21:44:38.140501+0000","last_clean":"2024-02-19T21:44:38.140501+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:44:38.140501+0000","last_undegraded":"2024-02-19T21:44:38.140501+0000","last_fullsized":"2024-02-19T21:44:38.140501+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:29.421791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:29.421791+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"201'12","reported_seq":149,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.138820+0000","last_change":"2024-02-19T21:44:17.715721+0000","last_active":"2024-02-19T21:44:38.138820+0000","last_peered":"2024-02-19T21:44:38.138820+0000","last_clean":"2024-02-19T21:44:38.138820+0000","last_became_active":"2024-02-19T21:42:04.192291+0000","last_became_peered":"2024-02-19T21:42:04.192291+0000","last_unstale":"2024-02-19T21:44:38.138820+0000","last_undegraded":"2024-02-19T21:44:38.138820+0000","last_fullsized":"2024-02-19T21:44:38.138820+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'12","last_scrub_stamp":"2024-02-19T21:44:17.715652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:17.715652+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":148,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.136459+0000","last_change":"2024-02-19T21:44:11.584507+0000","last_active":"2024-02-19T21:44:38.136459+0000","last_peered":"2024-02-19T21:44:38.136459+0000","last_clean":"2024-02-19T21:44:38.136459+0000","last_became_active":"2024-02-19T21:39:39.469477+0000","last_became_peered":"2024-02-19T21:39:39.469477+0000","last_unstale":"2024-02-19T21:44:38.136459+0000","last_undegraded":"2024-02-19T21:44:38.136459+0000","last_fullsized":"2024-02-19T21:44:38.136459+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:11.584416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:44:11.584416+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":46,"reported_epoch":292,"state":"peering","last_fresh":"2024-02-19T21:44:39.575880+0000","last_change":"2024-02-19T21:44:39.576110+0000","last_active":"2024-02-19T21:44:39.575880+0000","last_peered":"2024-02-19T21:44:38.138580+0000","last_clean":"2024-02-19T21:44:38.138580+0000","last_became_active":"2024-02-19T21:44:00.198539+0000","last_became_peered":"2024-02-19T21:44:00.198539+0000","last_unstale":"2024-02-19T21:44:39.575880+0000","last_undegraded":"2024-02-19T21:44:39.575880+0000","last_fullsized":"2024-02-19T21:44:39.575880+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:34.284787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:34.284787+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":143,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.134986+0000","last_change":"2024-02-19T21:44:09.645675+0000","last_active":"2024-02-19T21:44:38.134986+0000","last_peered":"2024-02-19T21:44:38.134986+0000","last_clean":"2024-02-19T21:44:38.134986+0000","last_became_active":"2024-02-19T21:39:39.477308+0000","last_became_peered":"2024-02-19T21:39:39.477308+0000","last_unstale":"2024-02-19T21:44:38.134986+0000","last_undegraded":"2024-02-19T21:44:38.134986+0000","last_fullsized":"2024-02-19T21:44:38.134986+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:09.645607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:44:09.645607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"200'15","reported_seq":342,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.131642+0000","last_change":"2024-02-19T21:42:04.226031+0000","last_active":"2024-02-19T21:44:38.131642+0000","last_peered":"2024-02-19T21:44:38.131642+0000","last_clean":"2024-02-19T21:44:38.131642+0000","last_became_active":"2024-02-19T21:42:04.207069+0000","last_became_peered":"2024-02-19T21:42:04.207069+0000","last_unstale":"2024-02-19T21:44:38.131642+0000","last_undegraded":"2024-02-19T21:44:38.131642+0000","last_fullsized":"2024-02-19T21:44:38.131642+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:39:46.193426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:46.193426+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"292'1465","reported_seq":1497,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-02-19T21:44:39.992024+0000","last_change":"2024-02-19T21:44:16.113820+0000","last_active":"2024-02-19T21:44:39.992024+0000","last_peered":"2024-02-19T21:44:39.992024+0000","last_clean":"2024-02-19T21:44:39.992024+0000","last_became_active":"2024-02-19T21:44:16.113593+0000","last_became_peered":"2024-02-19T21:44:16.113593+0000","last_unstale":"2024-02-19T21:44:39.992024+0000","last_undegraded":"2024-02-19T21:44:39.992024+0000","last_fullsized":"2024-02-19T21:44:39.992024+0000","mapping_epoch":268,"log_start":"0'0","ondisk_log_start":"0'0","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":1465,"ondisk_log_size":1465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":96010240,"num_objects":1465,"num_object_clones":0,"num_object_copies":4395,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1465,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1465,"num_write_kb":93760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":280,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.140313+0000","last_change":"2024-02-19T21:43:02.217061+0000","last_active":"2024-02-19T21:44:38.140313+0000","last_peered":"2024-02-19T21:44:38.140313+0000","last_clean":"2024-02-19T21:44:38.140313+0000","last_became_active":"2024-02-19T21:43:02.216721+0000","last_became_peered":"2024-02-19T21:43:02.216721+0000","last_unstale":"2024-02-19T21:44:38.140313+0000","last_undegraded":"2024-02-19T21:44:38.140313+0000","last_fullsized":"2024-02-19T21:44:38.140313+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:35.539219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:40:35.539219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"59'2","reported_seq":294,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.135414+0000","last_change":"2024-02-19T21:44:17.499729+0000","last_active":"2024-02-19T21:44:38.135414+0000","last_peered":"2024-02-19T21:44:38.135414+0000","last_clean":"2024-02-19T21:44:38.135414+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:44:38.135414+0000","last_undegraded":"2024-02-19T21:44:38.135414+0000","last_fullsized":"2024-02-19T21:44:38.135414+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-02-19T21:44:17.499663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:17.499663+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"200'23","reported_seq":301,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.134808+0000","last_change":"2024-02-19T21:40:37.318743+0000","last_active":"2024-02-19T21:44:38.134808+0000","last_peered":"2024-02-19T21:44:38.134808+0000","last_clean":"2024-02-19T21:44:38.134808+0000","last_became_active":"2024-02-19T21:38:31.247821+0000","last_became_peered":"2024-02-19T21:38:31.247821+0000","last_unstale":"2024-02-19T21:44:38.134808+0000","last_undegraded":"2024-02-19T21:44:38.134808+0000","last_fullsized":"2024-02-19T21:44:38.134808+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'17","last_scrub_stamp":"2024-02-19T21:40:37.318642+0000","last_deep_scrub":"83'17","last_deep_scrub_stamp":"2024-02-19T21:33:43.418450+0000","last_clean_scrub_stamp":"2024-02-19T21:40:37.318642+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":156,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.146200+0000","last_change":"2024-02-19T21:44:38.145377+0000","last_active":"2024-02-19T21:44:38.146200+0000","last_peered":"2024-02-19T21:44:38.146200+0000","last_clean":"2024-02-19T21:44:38.146200+0000","last_became_active":"2024-02-19T21:44:38.145122+0000","last_became_peered":"2024-02-19T21:44:38.145122+0000","last_unstale":"2024-02-19T21:44:38.146200+0000","last_undegraded":"2024-02-19T21:44:38.146200+0000","last_fullsized":"2024-02-19T21:44:38.146200+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:37.384723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:37.384723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"292'1438","reported_seq":1470,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-02-19T21:44:40.005019+0000","last_change":"2024-02-19T21:44:16.118671+0000","last_active":"2024-02-19T21:44:40.005019+0000","last_peered":"2024-02-19T21:44:40.005019+0000","last_clean":"2024-02-19T21:44:40.005019+0000","last_became_active":"2024-02-19T21:44:16.118362+0000","last_became_peered":"2024-02-19T21:44:16.118362+0000","last_unstale":"2024-02-19T21:44:40.005019+0000","last_undegraded":"2024-02-19T21:44:40.005019+0000","last_fullsized":"2024-02-19T21:44:40.005019+0000","mapping_epoch":268,"log_start":"0'0","ondisk_log_start":"0'0","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":1438,"ondisk_log_size":1438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94240768,"num_objects":1438,"num_object_clones":0,"num_object_copies":4314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1438,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1438,"num_write_kb":92032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4],"acting":[5,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":283,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.130882+0000","last_change":"2024-02-19T21:41:42.246007+0000","last_active":"2024-02-19T21:44:38.130882+0000","last_peered":"2024-02-19T21:44:38.130882+0000","last_clean":"2024-02-19T21:44:38.130882+0000","last_became_active":"2024-02-19T21:41:42.245788+0000","last_became_peered":"2024-02-19T21:41:42.245788+0000","last_unstale":"2024-02-19T21:44:38.130882+0000","last_undegraded":"2024-02-19T21:44:38.130882+0000","last_fullsized":"2024-02-19T21:44:38.130882+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:40.474333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:40.474333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":257,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.136548+0000","last_change":"2024-02-19T21:39:34.971980+0000","last_active":"2024-02-19T21:44:38.136548+0000","last_peered":"2024-02-19T21:44:38.136548+0000","last_clean":"2024-02-19T21:44:38.136548+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:44:38.136548+0000","last_undegraded":"2024-02-19T21:44:38.136548+0000","last_fullsized":"2024-02-19T21:44:38.136548+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:34.971917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:39:34.971917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"201'20","reported_seq":168,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.137499+0000","last_change":"2024-02-19T21:41:22.195267+0000","last_active":"2024-02-19T21:44:38.137499+0000","last_peered":"2024-02-19T21:44:38.137499+0000","last_clean":"2024-02-19T21:44:38.137499+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:44:38.137499+0000","last_undegraded":"2024-02-19T21:44:38.137499+0000","last_fullsized":"2024-02-19T21:44:38.137499+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:41:22.195164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:41:22.195164+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":415,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.132168+0000","last_change":"2024-02-19T21:40:25.363354+0000","last_active":"2024-02-19T21:44:38.132168+0000","last_peered":"2024-02-19T21:44:38.132168+0000","last_clean":"2024-02-19T21:44:38.132168+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:44:38.132168+0000","last_undegraded":"2024-02-19T21:44:38.132168+0000","last_fullsized":"2024-02-19T21:44:38.132168+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:40:25.363236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:25.363236+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"292'1395","reported_seq":1427,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-02-19T21:44:40.217170+0000","last_change":"2024-02-19T21:44:16.117157+0000","last_active":"2024-02-19T21:44:40.217170+0000","last_peered":"2024-02-19T21:44:40.217170+0000","last_clean":"2024-02-19T21:44:40.217170+0000","last_became_active":"2024-02-19T21:44:16.116819+0000","last_became_peered":"2024-02-19T21:44:16.116819+0000","last_unstale":"2024-02-19T21:44:40.217170+0000","last_undegraded":"2024-02-19T21:44:40.217170+0000","last_fullsized":"2024-02-19T21:44:40.217170+0000","mapping_epoch":268,"log_start":"0'0","ondisk_log_start":"0'0","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":1395,"ondisk_log_size":1395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":91422720,"num_objects":1395,"num_object_clones":0,"num_object_copies":4185,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1395,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1395,"num_write_kb":89280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":192,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.135377+0000","last_change":"2024-02-19T21:44:12.609252+0000","last_active":"2024-02-19T21:44:38.135377+0000","last_peered":"2024-02-19T21:44:38.135377+0000","last_clean":"2024-02-19T21:44:38.135377+0000","last_became_active":"2024-02-19T21:43:22.148701+0000","last_became_peered":"2024-02-19T21:43:22.148701+0000","last_unstale":"2024-02-19T21:44:38.135377+0000","last_undegraded":"2024-02-19T21:44:38.135377+0000","last_fullsized":"2024-02-19T21:44:38.135377+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":244,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:44:12.609170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":266,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.137566+0000","last_change":"2024-02-19T21:44:10.523394+0000","last_active":"2024-02-19T21:44:38.137566+0000","last_peered":"2024-02-19T21:44:38.137566+0000","last_clean":"2024-02-19T21:44:38.137566+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:44:38.137566+0000","last_undegraded":"2024-02-19T21:44:38.137566+0000","last_fullsized":"2024-02-19T21:44:38.137566+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:10.523331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:44:10.523331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"201'43","reported_seq":562,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.136506+0000","last_change":"2024-02-19T21:42:04.218868+0000","last_active":"2024-02-19T21:44:38.136506+0000","last_peered":"2024-02-19T21:44:38.136506+0000","last_clean":"2024-02-19T21:44:38.136506+0000","last_became_active":"2024-02-19T21:42:04.196382+0000","last_became_peered":"2024-02-19T21:42:04.196382+0000","last_unstale":"2024-02-19T21:44:38.136506+0000","last_undegraded":"2024-02-19T21:44:38.136506+0000","last_fullsized":"2024-02-19T21:44:38.136506+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'30","last_scrub_stamp":"2024-02-19T21:39:43.996511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:43.996511+0000","log_size":43,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":1074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,5],"acting":[1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":258,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.131644+0000","last_change":"2024-02-19T21:44:02.217493+0000","last_active":"2024-02-19T21:44:38.131644+0000","last_peered":"2024-02-19T21:44:38.131644+0000","last_clean":"2024-02-19T21:44:38.131644+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:44:38.131644+0000","last_undegraded":"2024-02-19T21:44:38.131644+0000","last_fullsized":"2024-02-19T21:44:38.131644+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:02.217425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:02.217425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"292'1391","reported_seq":1423,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-02-19T21:44:40.004210+0000","last_change":"2024-02-19T21:44:16.122030+0000","last_active":"2024-02-19T21:44:40.004210+0000","last_peered":"2024-02-19T21:44:40.004210+0000","last_clean":"2024-02-19T21:44:40.004210+0000","last_became_active":"2024-02-19T21:44:16.121785+0000","last_became_peered":"2024-02-19T21:44:16.121785+0000","last_unstale":"2024-02-19T21:44:40.004210+0000","last_undegraded":"2024-02-19T21:44:40.004210+0000","last_fullsized":"2024-02-19T21:44:40.004210+0000","mapping_epoch":268,"log_start":"0'0","ondisk_log_start":"0'0","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":1391,"ondisk_log_size":1391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":91160576,"num_objects":1391,"num_object_clones":0,"num_object_copies":4173,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1391,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1391,"num_write_kb":89024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":254,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.133868+0000","last_change":"2024-02-19T21:44:08.148554+0000","last_active":"2024-02-19T21:44:38.133868+0000","last_peered":"2024-02-19T21:44:38.133868+0000","last_clean":"2024-02-19T21:44:38.133868+0000","last_became_active":"2024-02-19T21:32:29.597365+0000","last_became_peered":"2024-02-19T21:32:29.597365+0000","last_unstale":"2024-02-19T21:44:38.133868+0000","last_undegraded":"2024-02-19T21:44:38.133868+0000","last_fullsized":"2024-02-19T21:44:38.133868+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:08.147351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:44:08.147351+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'6","reported_seq":1005,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:39.411674+0000","last_change":"2024-02-19T21:44:13.678401+0000","last_active":"2024-02-19T21:44:39.411674+0000","last_peered":"2024-02-19T21:44:39.411674+0000","last_clean":"2024-02-19T21:44:39.411674+0000","last_became_active":"2024-02-19T21:39:39.464361+0000","last_became_peered":"2024-02-19T21:39:39.464361+0000","last_unstale":"2024-02-19T21:44:39.411674+0000","last_undegraded":"2024-02-19T21:44:39.411674+0000","last_fullsized":"2024-02-19T21:44:39.411674+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_clean_scrub_stamp":"2024-02-19T21:44:13.678341+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":718,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":259,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.132595+0000","last_change":"2024-02-19T21:41:36.636023+0000","last_active":"2024-02-19T21:44:38.132595+0000","last_peered":"2024-02-19T21:44:38.132595+0000","last_clean":"2024-02-19T21:44:38.132595+0000","last_became_active":"2024-02-19T21:39:39.468113+0000","last_became_peered":"2024-02-19T21:39:39.468113+0000","last_unstale":"2024-02-19T21:44:38.132595+0000","last_undegraded":"2024-02-19T21:44:38.132595+0000","last_fullsized":"2024-02-19T21:44:38.132595+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:36.635936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:41:36.635936+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"200'17","reported_seq":319,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.138760+0000","last_change":"2024-02-19T21:44:00.545486+0000","last_active":"2024-02-19T21:44:38.138760+0000","last_peered":"2024-02-19T21:44:38.138760+0000","last_clean":"2024-02-19T21:44:38.138760+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:44:38.138760+0000","last_undegraded":"2024-02-19T21:44:38.138760+0000","last_fullsized":"2024-02-19T21:44:38.138760+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'17","last_scrub_stamp":"2024-02-19T21:44:00.545415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:00.545415+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":25,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":143,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.138349+0000","last_change":"2024-02-19T21:41:29.640521+0000","last_active":"2024-02-19T21:44:38.138349+0000","last_peered":"2024-02-19T21:44:38.138349+0000","last_clean":"2024-02-19T21:44:38.138349+0000","last_became_active":"2024-02-19T21:39:39.475190+0000","last_became_peered":"2024-02-19T21:39:39.475190+0000","last_unstale":"2024-02-19T21:44:38.138349+0000","last_undegraded":"2024-02-19T21:44:38.138349+0000","last_fullsized":"2024-02-19T21:44:38.138349+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:29.640431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:29.640431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"292'1386","reported_seq":1418,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-02-19T21:44:40.236767+0000","last_change":"2024-02-19T21:44:16.115922+0000","last_active":"2024-02-19T21:44:40.236767+0000","last_peered":"2024-02-19T21:44:40.236767+0000","last_clean":"2024-02-19T21:44:40.236767+0000","last_became_active":"2024-02-19T21:44:16.115625+0000","last_became_peered":"2024-02-19T21:44:16.115625+0000","last_unstale":"2024-02-19T21:44:40.236767+0000","last_undegraded":"2024-02-19T21:44:40.236767+0000","last_fullsized":"2024-02-19T21:44:40.236767+0000","mapping_epoch":268,"log_start":"0'0","ondisk_log_start":"0'0","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":1386,"ondisk_log_size":1386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90832896,"num_objects":1386,"num_object_clones":0,"num_object_copies":4158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1386,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1386,"num_write_kb":88704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":273,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.138650+0000","last_change":"2024-02-19T21:43:18.128190+0000","last_active":"2024-02-19T21:44:38.138650+0000","last_peered":"2024-02-19T21:44:38.138650+0000","last_clean":"2024-02-19T21:44:38.138650+0000","last_became_active":"2024-02-19T21:43:18.127939+0000","last_became_peered":"2024-02-19T21:43:18.127939+0000","last_unstale":"2024-02-19T21:44:38.138650+0000","last_undegraded":"2024-02-19T21:44:38.138650+0000","last_fullsized":"2024-02-19T21:44:38.138650+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":240,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:33.758127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:40:33.758127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":164,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.137692+0000","last_change":"2024-02-19T21:40:30.692471+0000","last_active":"2024-02-19T21:44:38.137692+0000","last_peered":"2024-02-19T21:44:38.137692+0000","last_clean":"2024-02-19T21:44:38.137692+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:44:38.137692+0000","last_undegraded":"2024-02-19T21:44:38.137692+0000","last_fullsized":"2024-02-19T21:44:38.137692+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:30.692385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:40:30.692385+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":279,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.137110+0000","last_change":"2024-02-19T21:42:04.213108+0000","last_active":"2024-02-19T21:44:38.137110+0000","last_peered":"2024-02-19T21:44:38.137110+0000","last_clean":"2024-02-19T21:44:38.137110+0000","last_became_active":"2024-02-19T21:42:04.212730+0000","last_became_peered":"2024-02-19T21:42:04.212730+0000","last_unstale":"2024-02-19T21:44:38.137110+0000","last_undegraded":"2024-02-19T21:44:38.137110+0000","last_fullsized":"2024-02-19T21:44:38.137110+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:39.714982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:39.714982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":142,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.131029+0000","last_change":"2024-02-19T21:42:04.197235+0000","last_active":"2024-02-19T21:44:38.131029+0000","last_peered":"2024-02-19T21:44:38.131029+0000","last_clean":"2024-02-19T21:44:38.131029+0000","last_became_active":"2024-02-19T21:42:04.196943+0000","last_became_peered":"2024-02-19T21:42:04.196943+0000","last_unstale":"2024-02-19T21:44:38.131029+0000","last_undegraded":"2024-02-19T21:44:38.131029+0000","last_fullsized":"2024-02-19T21:44:38.131029+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:38.927472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:40:38.927472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,1],"acting":[0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"201'33","reported_seq":305,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.140216+0000","last_change":"2024-02-19T21:40:24.331961+0000","last_active":"2024-02-19T21:44:38.140216+0000","last_peered":"2024-02-19T21:44:38.140216+0000","last_clean":"2024-02-19T21:44:38.140216+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:44:38.140216+0000","last_undegraded":"2024-02-19T21:44:38.140216+0000","last_fullsized":"2024-02-19T21:44:38.140216+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"143'21","last_scrub_stamp":"2024-02-19T21:40:24.331869+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:40:24.331869+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":232,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.137504+0000","last_change":"2024-02-19T21:42:04.205688+0000","last_active":"2024-02-19T21:44:38.137504+0000","last_peered":"2024-02-19T21:44:38.137504+0000","last_clean":"2024-02-19T21:44:38.137504+0000","last_became_active":"2024-02-19T21:42:04.205342+0000","last_became_peered":"2024-02-19T21:42:04.205342+0000","last_unstale":"2024-02-19T21:44:38.137504+0000","last_undegraded":"2024-02-19T21:44:38.137504+0000","last_fullsized":"2024-02-19T21:44:38.137504+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:22.826680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:22.826680+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"292'1410","reported_seq":1442,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-02-19T21:44:40.224452+0000","last_change":"2024-02-19T21:44:16.117097+0000","last_active":"2024-02-19T21:44:40.224452+0000","last_peered":"2024-02-19T21:44:40.224452+0000","last_clean":"2024-02-19T21:44:40.224452+0000","last_became_active":"2024-02-19T21:44:16.116833+0000","last_became_peered":"2024-02-19T21:44:16.116833+0000","last_unstale":"2024-02-19T21:44:40.224452+0000","last_undegraded":"2024-02-19T21:44:40.224452+0000","last_fullsized":"2024-02-19T21:44:40.224452+0000","mapping_epoch":268,"log_start":"0'0","ondisk_log_start":"0'0","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":1410,"ondisk_log_size":1410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92405760,"num_objects":1410,"num_object_clones":0,"num_object_copies":4230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1410,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1410,"num_write_kb":90240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":260,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.136749+0000","last_change":"2024-02-19T21:40:29.250688+0000","last_active":"2024-02-19T21:44:38.136749+0000","last_peered":"2024-02-19T21:44:38.136749+0000","last_clean":"2024-02-19T21:44:38.136749+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:44:38.136749+0000","last_undegraded":"2024-02-19T21:44:38.136749+0000","last_fullsized":"2024-02-19T21:44:38.136749+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:40:29.250599+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":271,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.132696+0000","last_change":"2024-02-19T21:41:22.644476+0000","last_active":"2024-02-19T21:44:38.132696+0000","last_peered":"2024-02-19T21:44:38.132696+0000","last_clean":"2024-02-19T21:44:38.132696+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:44:38.132696+0000","last_undegraded":"2024-02-19T21:44:38.132696+0000","last_fullsized":"2024-02-19T21:44:38.132696+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:22.644405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:41:22.644405+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":284,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.133199+0000","last_change":"2024-02-19T21:44:05.032411+0000","last_active":"2024-02-19T21:44:38.133199+0000","last_peered":"2024-02-19T21:44:38.133199+0000","last_clean":"2024-02-19T21:44:38.133199+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:44:38.133199+0000","last_undegraded":"2024-02-19T21:44:38.133199+0000","last_fullsized":"2024-02-19T21:44:38.133199+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:05.032330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:05.032330+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"200'24","reported_seq":371,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.131608+0000","last_change":"2024-02-19T21:44:01.262696+0000","last_active":"2024-02-19T21:44:38.131608+0000","last_peered":"2024-02-19T21:44:38.131608+0000","last_clean":"2024-02-19T21:44:38.131608+0000","last_became_active":"2024-02-19T21:42:04.206790+0000","last_became_peered":"2024-02-19T21:42:04.206790+0000","last_unstale":"2024-02-19T21:44:38.131608+0000","last_undegraded":"2024-02-19T21:44:38.131608+0000","last_fullsized":"2024-02-19T21:44:38.131608+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'24","last_scrub_stamp":"2024-02-19T21:44:01.262618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:01.262618+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":258,"reported_epoch":292,"state":"peering","last_fresh":"2024-02-19T21:44:39.575880+0000","last_change":"2024-02-19T21:44:39.576108+0000","last_active":"2024-02-19T21:44:39.575880+0000","last_peered":"2024-02-19T21:44:38.138517+0000","last_clean":"2024-02-19T21:44:38.138517+0000","last_became_active":"2024-02-19T21:32:27.372460+0000","last_became_peered":"2024-02-19T21:32:27.372460+0000","last_unstale":"2024-02-19T21:44:39.575880+0000","last_undegraded":"2024-02-19T21:44:39.575880+0000","last_fullsized":"2024-02-19T21:44:39.575880+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:23.683337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:23.683337+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.e","version":"292'1405","reported_seq":1437,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-02-19T21:44:39.997423+0000","last_change":"2024-02-19T21:44:16.118980+0000","last_active":"2024-02-19T21:44:39.997423+0000","last_peered":"2024-02-19T21:44:39.997423+0000","last_clean":"2024-02-19T21:44:39.997423+0000","last_became_active":"2024-02-19T21:44:16.118651+0000","last_became_peered":"2024-02-19T21:44:16.118651+0000","last_unstale":"2024-02-19T21:44:39.997423+0000","last_undegraded":"2024-02-19T21:44:39.997423+0000","last_fullsized":"2024-02-19T21:44:39.997423+0000","mapping_epoch":268,"log_start":"0'0","ondisk_log_start":"0'0","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":1405,"ondisk_log_size":1405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92078080,"num_objects":1405,"num_object_clones":0,"num_object_copies":4215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1405,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1405,"num_write_kb":89920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":269,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.134887+0000","last_change":"2024-02-19T21:42:04.193367+0000","last_active":"2024-02-19T21:44:38.134887+0000","last_peered":"2024-02-19T21:44:38.134887+0000","last_clean":"2024-02-19T21:44:38.134887+0000","last_became_active":"2024-02-19T21:42:04.193058+0000","last_became_peered":"2024-02-19T21:42:04.193058+0000","last_unstale":"2024-02-19T21:44:38.134887+0000","last_undegraded":"2024-02-19T21:44:38.134887+0000","last_fullsized":"2024-02-19T21:44:38.134887+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:39:42.020832+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":255,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.133964+0000","last_change":"2024-02-19T21:40:11.877814+0000","last_active":"2024-02-19T21:44:38.133964+0000","last_peered":"2024-02-19T21:44:38.133964+0000","last_clean":"2024-02-19T21:44:38.133964+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:44:38.133964+0000","last_undegraded":"2024-02-19T21:44:38.133964+0000","last_fullsized":"2024-02-19T21:44:38.133964+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:11.877751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:11.877751+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"201'37","reported_seq":319,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.132062+0000","last_change":"2024-02-19T21:40:26.405558+0000","last_active":"2024-02-19T21:44:38.132062+0000","last_peered":"2024-02-19T21:44:38.132062+0000","last_clean":"2024-02-19T21:44:38.132062+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:44:38.132062+0000","last_undegraded":"2024-02-19T21:44:38.132062+0000","last_fullsized":"2024-02-19T21:44:38.132062+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'27","last_scrub_stamp":"2024-02-19T21:40:26.405455+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:40:26.405455+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":258,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.140642+0000","last_change":"2024-02-19T21:40:16.260329+0000","last_active":"2024-02-19T21:44:38.140642+0000","last_peered":"2024-02-19T21:44:38.140642+0000","last_clean":"2024-02-19T21:44:38.140642+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:44:38.140642+0000","last_undegraded":"2024-02-19T21:44:38.140642+0000","last_fullsized":"2024-02-19T21:44:38.140642+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:16.260223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:40:16.260223+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"292'1397","reported_seq":1429,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-02-19T21:44:40.016177+0000","last_change":"2024-02-19T21:44:16.121994+0000","last_active":"2024-02-19T21:44:40.016177+0000","last_peered":"2024-02-19T21:44:40.016177+0000","last_clean":"2024-02-19T21:44:40.016177+0000","last_became_active":"2024-02-19T21:44:16.121703+0000","last_became_peered":"2024-02-19T21:44:16.121703+0000","last_unstale":"2024-02-19T21:44:40.016177+0000","last_undegraded":"2024-02-19T21:44:40.016177+0000","last_fullsized":"2024-02-19T21:44:40.016177+0000","mapping_epoch":268,"log_start":"0'0","ondisk_log_start":"0'0","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":1397,"ondisk_log_size":1397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":91553792,"num_objects":1397,"num_object_clones":0,"num_object_copies":4191,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1397,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1397,"num_write_kb":89408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":162,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.140149+0000","last_change":"2024-02-19T21:44:08.281049+0000","last_active":"2024-02-19T21:44:38.140149+0000","last_peered":"2024-02-19T21:44:38.140149+0000","last_clean":"2024-02-19T21:44:38.140149+0000","last_became_active":"2024-02-19T21:42:04.200292+0000","last_became_peered":"2024-02-19T21:42:04.200292+0000","last_unstale":"2024-02-19T21:44:38.140149+0000","last_undegraded":"2024-02-19T21:44:38.140149+0000","last_fullsized":"2024-02-19T21:44:38.140149+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:08.280938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:44:08.280938+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,5],"acting":[6,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":264,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.135163+0000","last_change":"2024-02-19T21:44:14.690800+0000","last_active":"2024-02-19T21:44:38.135163+0000","last_peered":"2024-02-19T21:44:38.135163+0000","last_clean":"2024-02-19T21:44:38.135163+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:44:38.135163+0000","last_undegraded":"2024-02-19T21:44:38.135163+0000","last_fullsized":"2024-02-19T21:44:38.135163+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:14.690736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:44:14.690736+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"201'38","reported_seq":240,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.131127+0000","last_change":"2024-02-19T21:42:05.431988+0000","last_active":"2024-02-19T21:44:38.131127+0000","last_peered":"2024-02-19T21:44:38.131127+0000","last_clean":"2024-02-19T21:44:38.131127+0000","last_became_active":"2024-02-19T21:42:04.205907+0000","last_became_peered":"2024-02-19T21:42:04.205907+0000","last_unstale":"2024-02-19T21:44:38.131127+0000","last_undegraded":"2024-02-19T21:44:38.131127+0000","last_fullsized":"2024-02-19T21:44:38.131127+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"168'26","last_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:39:48.004702+0000","log_size":38,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":145,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.140635+0000","last_change":"2024-02-19T21:42:04.200909+0000","last_active":"2024-02-19T21:44:38.140635+0000","last_peered":"2024-02-19T21:44:38.140635+0000","last_clean":"2024-02-19T21:44:38.140635+0000","last_became_active":"2024-02-19T21:42:04.200496+0000","last_became_peered":"2024-02-19T21:42:04.200496+0000","last_unstale":"2024-02-19T21:44:38.140635+0000","last_undegraded":"2024-02-19T21:44:38.140635+0000","last_fullsized":"2024-02-19T21:44:38.140635+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:38.697183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:38.697183+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"292'1318","reported_seq":1349,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-02-19T21:44:39.939650+0000","last_change":"2024-02-19T21:44:16.118900+0000","last_active":"2024-02-19T21:44:39.939650+0000","last_peered":"2024-02-19T21:44:39.939650+0000","last_clean":"2024-02-19T21:44:39.939650+0000","last_became_active":"2024-02-19T21:44:16.118628+0000","last_became_peered":"2024-02-19T21:44:16.118628+0000","last_unstale":"2024-02-19T21:44:39.939650+0000","last_undegraded":"2024-02-19T21:44:39.939650+0000","last_fullsized":"2024-02-19T21:44:39.939650+0000","mapping_epoch":268,"log_start":"0'0","ondisk_log_start":"0'0","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":1318,"ondisk_log_size":1318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":86376448,"num_objects":1318,"num_object_clones":0,"num_object_copies":3954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1318,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1318,"num_write_kb":84352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":263,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.133754+0000","last_change":"2024-02-19T21:40:28.874859+0000","last_active":"2024-02-19T21:44:38.133754+0000","last_peered":"2024-02-19T21:44:38.133754+0000","last_clean":"2024-02-19T21:44:38.133754+0000","last_became_active":"2024-02-19T21:39:39.481908+0000","last_became_peered":"2024-02-19T21:39:39.481908+0000","last_unstale":"2024-02-19T21:44:38.133754+0000","last_undegraded":"2024-02-19T21:44:38.133754+0000","last_fullsized":"2024-02-19T21:44:38.133754+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:28.874762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:28.874762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":278,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.141224+0000","last_change":"2024-02-19T21:42:04.197387+0000","last_active":"2024-02-19T21:44:38.141224+0000","last_peered":"2024-02-19T21:44:38.141224+0000","last_clean":"2024-02-19T21:44:38.141224+0000","last_became_active":"2024-02-19T21:42:04.197048+0000","last_became_peered":"2024-02-19T21:42:04.197048+0000","last_unstale":"2024-02-19T21:44:38.141224+0000","last_undegraded":"2024-02-19T21:44:38.141224+0000","last_fullsized":"2024-02-19T21:44:38.141224+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:32.498434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:32.498434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"201'28","reported_seq":275,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.136692+0000","last_change":"2024-02-19T21:41:31.580765+0000","last_active":"2024-02-19T21:44:38.136692+0000","last_peered":"2024-02-19T21:44:38.136692+0000","last_clean":"2024-02-19T21:44:38.136692+0000","last_became_active":"2024-02-19T21:35:14.513806+0000","last_became_peered":"2024-02-19T21:35:14.513806+0000","last_unstale":"2024-02-19T21:44:38.136692+0000","last_undegraded":"2024-02-19T21:44:38.136692+0000","last_fullsized":"2024-02-19T21:44:38.136692+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'14","last_scrub_stamp":"2024-02-19T21:41:31.580701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:41:31.580701+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":34,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":269,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.134940+0000","last_change":"2024-02-19T21:41:30.192537+0000","last_active":"2024-02-19T21:44:38.134940+0000","last_peered":"2024-02-19T21:44:38.134940+0000","last_clean":"2024-02-19T21:44:38.134940+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:44:38.134940+0000","last_undegraded":"2024-02-19T21:44:38.134940+0000","last_fullsized":"2024-02-19T21:44:38.134940+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'9","last_scrub_stamp":"2024-02-19T21:41:30.192427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:30.192427+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"292'1431","reported_seq":1463,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-02-19T21:44:40.016296+0000","last_change":"2024-02-19T21:44:16.122360+0000","last_active":"2024-02-19T21:44:40.016296+0000","last_peered":"2024-02-19T21:44:40.016296+0000","last_clean":"2024-02-19T21:44:40.016296+0000","last_became_active":"2024-02-19T21:44:16.122083+0000","last_became_peered":"2024-02-19T21:44:16.122083+0000","last_unstale":"2024-02-19T21:44:40.016296+0000","last_undegraded":"2024-02-19T21:44:40.016296+0000","last_fullsized":"2024-02-19T21:44:40.016296+0000","mapping_epoch":268,"log_start":"0'0","ondisk_log_start":"0'0","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":1431,"ondisk_log_size":1431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":93782016,"num_objects":1431,"num_object_clones":0,"num_object_copies":4293,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1431,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1431,"num_write_kb":91584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"66'1","reported_seq":158,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.140381+0000","last_change":"2024-02-19T21:42:59.117856+0000","last_active":"2024-02-19T21:44:38.140381+0000","last_peered":"2024-02-19T21:44:38.140381+0000","last_clean":"2024-02-19T21:44:38.140381+0000","last_became_active":"2024-02-19T21:42:59.117513+0000","last_became_peered":"2024-02-19T21:42:59.117513+0000","last_unstale":"2024-02-19T21:44:38.140381+0000","last_undegraded":"2024-02-19T21:44:38.140381+0000","last_fullsized":"2024-02-19T21:44:38.140381+0000","mapping_epoch":165,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:21.371240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:40:21.371240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"261'11","reported_seq":282,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.138452+0000","last_change":"2024-02-19T21:44:08.124240+0000","last_active":"2024-02-19T21:44:38.138452+0000","last_peered":"2024-02-19T21:44:38.138452+0000","last_clean":"2024-02-19T21:44:38.138452+0000","last_became_active":"2024-02-19T21:44:08.123392+0000","last_became_peered":"2024-02-19T21:44:08.123392+0000","last_unstale":"2024-02-19T21:44:38.138452+0000","last_undegraded":"2024-02-19T21:44:38.138452+0000","last_fullsized":"2024-02-19T21:44:38.138452+0000","mapping_epoch":62,"log_start":"257'10","ondisk_log_start":"257'10","created":62,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:22.774081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:22.774081+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":267,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.133253+0000","last_change":"2024-02-19T21:40:41.901768+0000","last_active":"2024-02-19T21:44:38.133253+0000","last_peered":"2024-02-19T21:44:38.133253+0000","last_clean":"2024-02-19T21:44:38.133253+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:44:38.133253+0000","last_undegraded":"2024-02-19T21:44:38.133253+0000","last_fullsized":"2024-02-19T21:44:38.133253+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:40:41.901670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:41.901670+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"201'19","reported_seq":284,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.140914+0000","last_change":"2024-02-19T21:40:26.390284+0000","last_active":"2024-02-19T21:44:38.140914+0000","last_peered":"2024-02-19T21:44:38.140914+0000","last_clean":"2024-02-19T21:44:38.140914+0000","last_became_active":"2024-02-19T21:39:51.536649+0000","last_became_peered":"2024-02-19T21:39:51.536649+0000","last_unstale":"2024-02-19T21:44:38.140914+0000","last_undegraded":"2024-02-19T21:44:38.140914+0000","last_fullsized":"2024-02-19T21:44:38.140914+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'11","last_scrub_stamp":"2024-02-19T21:40:26.390173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:26.390173+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2","version":"292'1364","reported_seq":1396,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-02-19T21:44:40.015563+0000","last_change":"2024-02-19T21:44:16.115513+0000","last_active":"2024-02-19T21:44:40.015563+0000","last_peered":"2024-02-19T21:44:40.015563+0000","last_clean":"2024-02-19T21:44:40.015563+0000","last_became_active":"2024-02-19T21:44:16.115219+0000","last_became_peered":"2024-02-19T21:44:16.115219+0000","last_unstale":"2024-02-19T21:44:40.015563+0000","last_undegraded":"2024-02-19T21:44:40.015563+0000","last_fullsized":"2024-02-19T21:44:40.015563+0000","mapping_epoch":268,"log_start":"0'0","ondisk_log_start":"0'0","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":1364,"ondisk_log_size":1364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":89391104,"num_objects":1364,"num_object_clones":0,"num_object_copies":4092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1364,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1364,"num_write_kb":87296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,6],"acting":[1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":273,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.137969+0000","last_change":"2024-02-19T21:42:53.026951+0000","last_active":"2024-02-19T21:44:38.137969+0000","last_peered":"2024-02-19T21:44:38.137969+0000","last_clean":"2024-02-19T21:44:38.137969+0000","last_became_active":"2024-02-19T21:42:53.026678+0000","last_became_peered":"2024-02-19T21:42:53.026678+0000","last_unstale":"2024-02-19T21:44:38.137969+0000","last_undegraded":"2024-02-19T21:44:38.137969+0000","last_fullsized":"2024-02-19T21:44:38.137969+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:16.845272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:16.845272+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"265'11","reported_seq":379,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.138203+0000","last_change":"2024-02-19T21:44:12.206332+0000","last_active":"2024-02-19T21:44:38.138203+0000","last_peered":"2024-02-19T21:44:38.138203+0000","last_clean":"2024-02-19T21:44:38.138203+0000","last_became_active":"2024-02-19T21:44:12.205049+0000","last_became_peered":"2024-02-19T21:44:12.205049+0000","last_unstale":"2024-02-19T21:44:38.138203+0000","last_undegraded":"2024-02-19T21:44:38.138203+0000","last_fullsized":"2024-02-19T21:44:38.138203+0000","mapping_epoch":97,"log_start":"98'9","ondisk_log_start":"98'9","created":62,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'9","last_scrub_stamp":"2024-02-19T21:41:30.610855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:30.610855+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":262,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.134794+0000","last_change":"2024-02-19T21:40:14.294150+0000","last_active":"2024-02-19T21:44:38.134794+0000","last_peered":"2024-02-19T21:44:38.134794+0000","last_clean":"2024-02-19T21:44:38.134794+0000","last_became_active":"2024-02-19T21:32:23.362738+0000","last_became_peered":"2024-02-19T21:32:23.362738+0000","last_unstale":"2024-02-19T21:44:38.134794+0000","last_undegraded":"2024-02-19T21:44:38.134794+0000","last_fullsized":"2024-02-19T21:44:38.134794+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:14.294064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:40:14.294064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"270'34","reported_seq":183,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.138212+0000","last_change":"2024-02-19T21:44:17.451246+0000","last_active":"2024-02-19T21:44:38.138212+0000","last_peered":"2024-02-19T21:44:38.138212+0000","last_clean":"2024-02-19T21:44:38.138212+0000","last_became_active":"2024-02-19T21:39:51.539230+0000","last_became_peered":"2024-02-19T21:39:51.539230+0000","last_unstale":"2024-02-19T21:44:38.138212+0000","last_undegraded":"2024-02-19T21:44:38.138212+0000","last_fullsized":"2024-02-19T21:44:38.138212+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"270'34","last_scrub_stamp":"2024-02-19T21:44:17.451151+0000","last_deep_scrub":"270'34","last_deep_scrub_stamp":"2024-02-19T21:44:17.451151+0000","last_clean_scrub_stamp":"2024-02-19T21:44:17.451151+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"292'1445","reported_seq":1475,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-02-19T21:44:40.007195+0000","last_change":"2024-02-19T21:44:16.116710+0000","last_active":"2024-02-19T21:44:40.007195+0000","last_peered":"2024-02-19T21:44:40.007195+0000","last_clean":"2024-02-19T21:44:40.007195+0000","last_became_active":"2024-02-19T21:44:16.116428+0000","last_became_peered":"2024-02-19T21:44:16.116428+0000","last_unstale":"2024-02-19T21:44:40.007195+0000","last_undegraded":"2024-02-19T21:44:40.007195+0000","last_fullsized":"2024-02-19T21:44:40.007195+0000","mapping_epoch":268,"log_start":"0'0","ondisk_log_start":"0'0","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":1445,"ondisk_log_size":1445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94699520,"num_objects":1445,"num_object_clones":0,"num_object_copies":4335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1445,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1445,"num_write_kb":92480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4],"acting":[3,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":243,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.136263+0000","last_change":"2024-02-19T21:42:48.626776+0000","last_active":"2024-02-19T21:44:38.136263+0000","last_peered":"2024-02-19T21:44:38.136263+0000","last_clean":"2024-02-19T21:44:38.136263+0000","last_became_active":"2024-02-19T21:42:48.626491+0000","last_became_peered":"2024-02-19T21:42:48.626491+0000","last_unstale":"2024-02-19T21:44:38.136263+0000","last_undegraded":"2024-02-19T21:44:38.136263+0000","last_fullsized":"2024-02-19T21:44:38.136263+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:40.015907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:40.015907+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"271'13","reported_seq":305,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.134119+0000","last_change":"2024-02-19T21:44:18.116546+0000","last_active":"2024-02-19T21:44:38.134119+0000","last_peered":"2024-02-19T21:44:38.134119+0000","last_clean":"2024-02-19T21:44:38.134119+0000","last_became_active":"2024-02-19T21:44:18.115023+0000","last_became_peered":"2024-02-19T21:44:18.115023+0000","last_unstale":"2024-02-19T21:44:38.134119+0000","last_undegraded":"2024-02-19T21:44:38.134119+0000","last_fullsized":"2024-02-19T21:44:38.134119+0000","mapping_epoch":266,"log_start":"170'11","ondisk_log_start":"170'11","created":62,"last_epoch_clean":271,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'11","last_scrub_stamp":"2024-02-19T21:40:21.863959+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:40:21.863959+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":259,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.135168+0000","last_change":"2024-02-19T21:39:31.018063+0000","last_active":"2024-02-19T21:44:38.135168+0000","last_peered":"2024-02-19T21:44:38.135168+0000","last_clean":"2024-02-19T21:44:38.135168+0000","last_became_active":"2024-02-19T21:32:23.363155+0000","last_became_peered":"2024-02-19T21:32:23.363155+0000","last_unstale":"2024-02-19T21:44:38.135168+0000","last_undegraded":"2024-02-19T21:44:38.135168+0000","last_fullsized":"2024-02-19T21:44:38.135168+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:31.018000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:39:31.018000+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"200'20","reported_seq":261,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.139953+0000","last_change":"2024-02-19T21:41:21.872187+0000","last_active":"2024-02-19T21:44:38.139953+0000","last_peered":"2024-02-19T21:44:38.139953+0000","last_clean":"2024-02-19T21:44:38.139953+0000","last_became_active":"2024-02-19T21:35:14.514968+0000","last_became_peered":"2024-02-19T21:35:14.514968+0000","last_unstale":"2024-02-19T21:44:38.139953+0000","last_undegraded":"2024-02-19T21:44:38.139953+0000","last_fullsized":"2024-02-19T21:44:38.139953+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:41:21.872058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:41:21.872058+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6],"acting":[3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"292'1377","reported_seq":1409,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-02-19T21:44:40.011190+0000","last_change":"2024-02-19T21:44:16.117207+0000","last_active":"2024-02-19T21:44:40.011190+0000","last_peered":"2024-02-19T21:44:40.011190+0000","last_clean":"2024-02-19T21:44:40.011190+0000","last_became_active":"2024-02-19T21:44:16.116913+0000","last_became_peered":"2024-02-19T21:44:16.116913+0000","last_unstale":"2024-02-19T21:44:40.011190+0000","last_undegraded":"2024-02-19T21:44:40.011190+0000","last_fullsized":"2024-02-19T21:44:40.011190+0000","mapping_epoch":268,"log_start":"0'0","ondisk_log_start":"0'0","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90243072,"num_objects":1377,"num_object_clones":0,"num_object_copies":4131,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1377,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1377,"num_write_kb":88128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":26,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.131403+0000","last_change":"2024-02-19T21:44:23.248253+0000","last_active":"2024-02-19T21:44:38.131403+0000","last_peered":"2024-02-19T21:44:38.131403+0000","last_clean":"2024-02-19T21:44:38.131403+0000","last_became_active":"2024-02-19T21:44:23.247833+0000","last_became_peered":"2024-02-19T21:44:23.247833+0000","last_unstale":"2024-02-19T21:44:38.131403+0000","last_undegraded":"2024-02-19T21:44:38.131403+0000","last_fullsized":"2024-02-19T21:44:38.131403+0000","mapping_epoch":275,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":276,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:36.725664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:41:36.725664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,1],"acting":[0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":271,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.136692+0000","last_change":"2024-02-19T21:44:22.246281+0000","last_active":"2024-02-19T21:44:38.136692+0000","last_peered":"2024-02-19T21:44:38.136692+0000","last_clean":"2024-02-19T21:44:38.136692+0000","last_became_active":"2024-02-19T21:44:22.245925+0000","last_became_peered":"2024-02-19T21:44:22.245925+0000","last_unstale":"2024-02-19T21:44:38.136692+0000","last_undegraded":"2024-02-19T21:44:38.136692+0000","last_fullsized":"2024-02-19T21:44:38.136692+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:39.002258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:39:39.002258+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":262,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.133297+0000","last_change":"2024-02-19T21:40:32.869530+0000","last_active":"2024-02-19T21:44:38.133297+0000","last_peered":"2024-02-19T21:44:38.133297+0000","last_clean":"2024-02-19T21:44:38.133297+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:44:38.133297+0000","last_undegraded":"2024-02-19T21:44:38.133297+0000","last_fullsized":"2024-02-19T21:44:38.133297+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:32.869462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:40:32.869462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"201'31","reported_seq":222,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.137178+0000","last_change":"2024-02-19T21:44:11.728491+0000","last_active":"2024-02-19T21:44:38.137178+0000","last_peered":"2024-02-19T21:44:38.137178+0000","last_clean":"2024-02-19T21:44:38.137178+0000","last_became_active":"2024-02-19T21:39:39.474668+0000","last_became_peered":"2024-02-19T21:39:39.474668+0000","last_unstale":"2024-02-19T21:44:38.137178+0000","last_undegraded":"2024-02-19T21:44:38.137178+0000","last_fullsized":"2024-02-19T21:44:38.137178+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'31","last_scrub_stamp":"2024-02-19T21:44:11.728412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:11.728412+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":49,"num_read_kb":39,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"292'1417","reported_seq":1449,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-02-19T21:44:39.993364+0000","last_change":"2024-02-19T21:44:16.117971+0000","last_active":"2024-02-19T21:44:39.993364+0000","last_peered":"2024-02-19T21:44:39.993364+0000","last_clean":"2024-02-19T21:44:39.993364+0000","last_became_active":"2024-02-19T21:44:16.117603+0000","last_became_peered":"2024-02-19T21:44:16.117603+0000","last_unstale":"2024-02-19T21:44:39.993364+0000","last_undegraded":"2024-02-19T21:44:39.993364+0000","last_fullsized":"2024-02-19T21:44:39.993364+0000","mapping_epoch":268,"log_start":"0'0","ondisk_log_start":"0'0","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":1417,"ondisk_log_size":1417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92864512,"num_objects":1417,"num_object_clones":0,"num_object_copies":4251,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1417,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1417,"num_write_kb":90688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"66'1","reported_seq":246,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.139729+0000","last_change":"2024-02-19T21:43:14.407536+0000","last_active":"2024-02-19T21:44:38.139729+0000","last_peered":"2024-02-19T21:44:38.139729+0000","last_clean":"2024-02-19T21:44:38.139729+0000","last_became_active":"2024-02-19T21:43:14.407205+0000","last_became_peered":"2024-02-19T21:43:14.407205+0000","last_unstale":"2024-02-19T21:44:38.139729+0000","last_undegraded":"2024-02-19T21:44:38.139729+0000","last_fullsized":"2024-02-19T21:44:38.139729+0000","mapping_epoch":197,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":236,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:36.890201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.890201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":170,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.131978+0000","last_change":"2024-02-19T21:44:26.882059+0000","last_active":"2024-02-19T21:44:38.131978+0000","last_peered":"2024-02-19T21:44:38.131978+0000","last_clean":"2024-02-19T21:44:38.131978+0000","last_became_active":"2024-02-19T21:44:26.881695+0000","last_became_peered":"2024-02-19T21:44:26.881695+0000","last_unstale":"2024-02-19T21:44:38.131978+0000","last_undegraded":"2024-02-19T21:44:38.131978+0000","last_fullsized":"2024-02-19T21:44:38.131978+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":279,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:23.324303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:46.372184+0000","last_clean_scrub_stamp":"2024-02-19T21:40:23.324303+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":156,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.137598+0000","last_change":"2024-02-19T21:40:28.696870+0000","last_active":"2024-02-19T21:44:38.137598+0000","last_peered":"2024-02-19T21:44:38.137598+0000","last_clean":"2024-02-19T21:44:38.137598+0000","last_became_active":"2024-02-19T21:39:39.479752+0000","last_became_peered":"2024-02-19T21:39:39.479752+0000","last_unstale":"2024-02-19T21:44:38.137598+0000","last_undegraded":"2024-02-19T21:44:38.137598+0000","last_fullsized":"2024-02-19T21:44:38.137598+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:40:28.696783+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"201'44","reported_seq":358,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.140493+0000","last_change":"2024-02-19T21:44:16.255128+0000","last_active":"2024-02-19T21:44:38.140493+0000","last_peered":"2024-02-19T21:44:38.140493+0000","last_clean":"2024-02-19T21:44:38.140493+0000","last_became_active":"2024-02-19T21:42:04.200393+0000","last_became_peered":"2024-02-19T21:42:04.200393+0000","last_unstale":"2024-02-19T21:44:38.140493+0000","last_undegraded":"2024-02-19T21:44:38.140493+0000","last_fullsized":"2024-02-19T21:44:38.140493+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'44","last_scrub_stamp":"2024-02-19T21:44:16.255049+0000","last_deep_scrub":"201'44","last_deep_scrub_stamp":"2024-02-19T21:44:16.255049+0000","last_clean_scrub_stamp":"2024-02-19T21:44:16.255049+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.6","version":"292'1458","reported_seq":1490,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-02-19T21:44:39.990379+0000","last_change":"2024-02-19T21:44:16.119031+0000","last_active":"2024-02-19T21:44:39.990379+0000","last_peered":"2024-02-19T21:44:39.990379+0000","last_clean":"2024-02-19T21:44:39.990379+0000","last_became_active":"2024-02-19T21:44:16.118369+0000","last_became_peered":"2024-02-19T21:44:16.118369+0000","last_unstale":"2024-02-19T21:44:39.990379+0000","last_undegraded":"2024-02-19T21:44:39.990379+0000","last_fullsized":"2024-02-19T21:44:39.990379+0000","mapping_epoch":268,"log_start":"0'0","ondisk_log_start":"0'0","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":1458,"ondisk_log_size":1458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":95551488,"num_objects":1458,"num_object_clones":0,"num_object_copies":4374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1458,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1458,"num_write_kb":93312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":283,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.132802+0000","last_change":"2024-02-19T21:43:10.349161+0000","last_active":"2024-02-19T21:44:38.132802+0000","last_peered":"2024-02-19T21:44:38.132802+0000","last_clean":"2024-02-19T21:44:38.132802+0000","last_became_active":"2024-02-19T21:43:10.348874+0000","last_became_peered":"2024-02-19T21:43:10.348874+0000","last_unstale":"2024-02-19T21:44:38.132802+0000","last_undegraded":"2024-02-19T21:44:38.132802+0000","last_fullsized":"2024-02-19T21:44:38.132802+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":232,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:42.230664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:42.230664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":271,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.135005+0000","last_change":"2024-02-19T21:44:30.337438+0000","last_active":"2024-02-19T21:44:38.135005+0000","last_peered":"2024-02-19T21:44:38.135005+0000","last_clean":"2024-02-19T21:44:38.135005+0000","last_became_active":"2024-02-19T21:44:30.337128+0000","last_became_peered":"2024-02-19T21:44:30.337128+0000","last_unstale":"2024-02-19T21:44:38.135005+0000","last_undegraded":"2024-02-19T21:44:38.135005+0000","last_fullsized":"2024-02-19T21:44:38.135005+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":283,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.547129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.547129+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.547129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1],"acting":[4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":262,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.137315+0000","last_change":"2024-02-19T21:44:01.569675+0000","last_active":"2024-02-19T21:44:38.137315+0000","last_peered":"2024-02-19T21:44:38.137315+0000","last_clean":"2024-02-19T21:44:38.137315+0000","last_became_active":"2024-02-19T21:32:23.357438+0000","last_became_peered":"2024-02-19T21:32:23.357438+0000","last_unstale":"2024-02-19T21:44:38.137315+0000","last_undegraded":"2024-02-19T21:44:38.137315+0000","last_fullsized":"2024-02-19T21:44:38.137315+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:01.569611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:01.569611+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"201'15","reported_seq":285,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.132172+0000","last_change":"2024-02-19T21:39:36.193250+0000","last_active":"2024-02-19T21:44:38.132172+0000","last_peered":"2024-02-19T21:44:38.132172+0000","last_clean":"2024-02-19T21:44:38.132172+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:44:38.132172+0000","last_undegraded":"2024-02-19T21:44:38.132172+0000","last_fullsized":"2024-02-19T21:44:38.132172+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'9","last_scrub_stamp":"2024-02-19T21:39:36.193184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:39:36.193184+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.5","version":"292'1357","reported_seq":1389,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-02-19T21:44:40.235297+0000","last_change":"2024-02-19T21:44:16.115677+0000","last_active":"2024-02-19T21:44:40.235297+0000","last_peered":"2024-02-19T21:44:40.235297+0000","last_clean":"2024-02-19T21:44:40.235297+0000","last_became_active":"2024-02-19T21:44:16.115394+0000","last_became_peered":"2024-02-19T21:44:16.115394+0000","last_unstale":"2024-02-19T21:44:40.235297+0000","last_undegraded":"2024-02-19T21:44:40.235297+0000","last_fullsized":"2024-02-19T21:44:40.235297+0000","mapping_epoch":268,"log_start":"0'0","ondisk_log_start":"0'0","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":1357,"ondisk_log_size":1357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":88932352,"num_objects":1357,"num_object_clones":0,"num_object_copies":4071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1357,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1357,"num_write_kb":86848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":273,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.137416+0000","last_change":"2024-02-19T21:43:06.293725+0000","last_active":"2024-02-19T21:44:38.137416+0000","last_peered":"2024-02-19T21:44:38.137416+0000","last_clean":"2024-02-19T21:44:38.137416+0000","last_became_active":"2024-02-19T21:43:06.293389+0000","last_became_peered":"2024-02-19T21:43:06.293389+0000","last_unstale":"2024-02-19T21:44:38.137416+0000","last_undegraded":"2024-02-19T21:44:38.137416+0000","last_fullsized":"2024-02-19T21:44:38.137416+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":228,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:17.853016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:40:17.853016+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":217,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.140999+0000","last_change":"2024-02-19T21:42:04.200518+0000","last_active":"2024-02-19T21:44:38.140999+0000","last_peered":"2024-02-19T21:44:38.140999+0000","last_clean":"2024-02-19T21:44:38.140999+0000","last_became_active":"2024-02-19T21:42:04.199889+0000","last_became_peered":"2024-02-19T21:42:04.199889+0000","last_unstale":"2024-02-19T21:44:38.140999+0000","last_undegraded":"2024-02-19T21:44:38.140999+0000","last_fullsized":"2024-02-19T21:44:38.140999+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:40:29.858805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"200'27","reported_seq":329,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.136455+0000","last_change":"2024-02-19T21:42:05.597864+0000","last_active":"2024-02-19T21:44:38.136455+0000","last_peered":"2024-02-19T21:44:38.136455+0000","last_clean":"2024-02-19T21:44:38.136455+0000","last_became_active":"2024-02-19T21:42:04.212731+0000","last_became_peered":"2024-02-19T21:42:04.212731+0000","last_unstale":"2024-02-19T21:44:38.136455+0000","last_undegraded":"2024-02-19T21:44:38.136455+0000","last_fullsized":"2024-02-19T21:44:38.136455+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'15","last_scrub_stamp":"2024-02-19T21:40:23.751886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:40:23.751886+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"287'10","reported_seq":435,"reported_epoch":291,"state":"active+clean","last_fresh":"2024-02-19T21:44:38.133785+0000","last_change":"2024-02-19T21:44:34.386226+0000","last_active":"2024-02-19T21:44:38.133785+0000","last_peered":"2024-02-19T21:44:38.133785+0000","last_clean":"2024-02-19T21:44:38.133785+0000","last_became_active":"2024-02-19T21:44:34.385140+0000","last_became_peered":"2024-02-19T21:44:34.385140+0000","last_unstale":"2024-02-19T21:44:38.133785+0000","last_undegraded":"2024-02-19T21:44:38.133785+0000","last_fullsized":"2024-02-19T21:44:38.133785+0000","mapping_epoch":62,"log_start":"66'8","ondisk_log_start":"66'8","created":62,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:44:11.163719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:11.163719+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":1471545344,"num_objects":22454,"num_object_clones":0,"num_object_copies":67362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22454,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22454,"num_write_kb":1437056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4402970624,"data_stored":4402970624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22454,"ondisk_log_size":22454,"up":48,"acting":48,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":718,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1116,"num_read_kb":873,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":3604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":748,"ondisk_log_size":748,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":24,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":72,"acting":72,"num_store_stats":8},{"poolid":6,"num_pg":22,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":382,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":66,"acting":66,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201430,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":637108,"kb_used_data":335788,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93108044,"statfs":{"total":95995035648,"available":95342637056,"internally_reserved":0,"allocated":343846912,"data_stored":343310317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:44:37 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":1.95,"15min":1.1850000000000001},"min":{"1min":0.25600000000000001,"5min":0.19800000000000001,"15min":0.189},"max":{"1min":0.68899999999999995,"5min":13.645,"15min":13.645},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":1.7969999999999999,"15min":1.246},"min":{"1min":0.28599999999999998,"5min":0.253,"15min":0.20999999999999999},"max":{"1min":1.421,"5min":14.212999999999999,"15min":14.212999999999999},"last":1.3759999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:44:37 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":1.8089999999999999,"15min":1.329},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23200000000000001},"max":{"1min":0.65700000000000003,"5min":14.246,"15min":14.246},"last":0.371},{"interface":"front","average":{"1min":0.56699999999999995,"5min":1.845,"15min":1.1879999999999999},"min":{"1min":0.371,"5min":0.23599999999999999,"15min":0.223},"max":{"1min":1.4419999999999999,"5min":14.15,"15min":14.15},"last":1.3200000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:44:37 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":1.9870000000000001,"15min":1.28},"min":{"1min":0.35199999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.70799999999999996,"5min":10.965999999999999,"15min":10.965999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":1.643,"15min":1.306},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.27800000000000002},"max":{"1min":0.63700000000000001,"5min":7.4359999999999999,"15min":9.7010000000000005},"last":0.503}]},{"osd":3,"last update":"Mon Feb 19 21:44:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":2.1419999999999999,"15min":1.619},"min":{"1min":0.40300000000000002,"5min":0.29199999999999998,"15min":0.26900000000000002},"max":{"1min":0.66400000000000003,"5min":11.004,"15min":31.559000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":1.871,"15min":1.4910000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.749,"5min":10.522,"15min":30.812999999999999},"last":0.749}]},{"osd":4,"last update":"Mon Feb 19 21:44:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":1.9259999999999999,"15min":1.002},"min":{"1min":0.28199999999999997,"5min":0.26500000000000001,"15min":0.247},"max":{"1min":1.4590000000000001,"5min":14.208,"15min":14.208},"last":1.264},{"interface":"front","average":{"1min":0.63900000000000001,"5min":2.4529999999999998,"15min":1.21},"min":{"1min":0.309,"5min":0.26500000000000001,"15min":0.245},"max":{"1min":3.1280000000000001,"5min":11.541,"15min":11.541},"last":3.1280000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:44:37 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":1.8280000000000001,"15min":1.101},"min":{"1min":0.29899999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.829,"5min":10.090999999999999,"15min":10.090999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":2.4180000000000001,"15min":1.2130000000000001},"min":{"1min":0.34100000000000003,"5min":0.315,"15min":0.28799999999999998},"max":{"1min":5.0199999999999996,"5min":17.012,"15min":17.012},"last":1.3480000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:44:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":1.903,"15min":1.048},"min":{"1min":0.32500000000000001,"5min":0.31900000000000001,"15min":0.30299999999999999},"max":{"1min":1.5940000000000001,"5min":14.177,"15min":14.177},"last":1.294},{"interface":"front","average":{"1min":0.67100000000000004,"5min":2.387,"15min":1.3720000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.29699999999999999},"max":{"1min":3.093,"5min":12.913,"15min":12.913},"last":3.093}]}]},{"osd":6,"up_from":47,"seq":201863463069,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":970200,"kb_used_data":664784,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":92774952,"statfs":{"total":95995035648,"available":95001550848,"internally_reserved":0,"allocated":680738816,"data_stored":680165812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:44:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.9890000000000001,"15min":1.3819999999999999},"min":{"1min":0.24199999999999999,"5min":0.23400000000000001,"15min":0.20599999999999999},"max":{"1min":7.1260000000000003,"5min":45.197000000000003,"15min":45.197000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.3180000000000001,"5min":2.286,"15min":1.484},"min":{"1min":0.247,"5min":0.23499999999999999,"15min":0.221},"max":{"1min":7.7199999999999998,"5min":44.753,"15min":44.753},"last":1.371}]},{"osd":1,"last update":"Mon Feb 19 21:44:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.9970000000000001,"15min":1.331},"min":{"1min":0.31,"5min":0.222,"15min":0.222},"max":{"1min":7.9000000000000004,"5min":45.231999999999999,"15min":45.231999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":1.7110000000000001,"5min":1.863,"15min":1.298},"min":{"1min":0.253,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":6.181,"5min":45.097999999999999,"15min":45.097999999999999},"last":0.30299999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:44:16 2024","interfaces":[{"interface":"back","average":{"1min":1.673,"5min":1.4450000000000001,"15min":1.151},"min":{"1min":0.316,"5min":0.28599999999999998,"15min":0.26800000000000002},"max":{"1min":7.6920000000000002,"5min":7.6920000000000002,"15min":8.3849999999999998},"last":0.33000000000000002},{"interface":"front","average":{"1min":1.089,"5min":1.5289999999999999,"15min":1.1779999999999999},"min":{"1min":0.34300000000000003,"5min":0.29299999999999998,"15min":0.27300000000000002},"max":{"1min":7.6900000000000004,"5min":8.5259999999999998,"15min":18.068000000000001},"last":1.6080000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:44:16 2024","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.669,"15min":1.2609999999999999},"min":{"1min":0.40300000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":7.8440000000000003,"5min":10.630000000000001,"15min":11.15},"last":1.532},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.3799999999999999,"15min":1.244},"min":{"1min":0.29399999999999998,"5min":0.26400000000000001,"15min":0.246},"max":{"1min":8.5969999999999995,"5min":8.5969999999999995,"15min":19.632999999999999},"last":0.35399999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:44:16 2024","interfaces":[{"interface":"back","average":{"1min":2.2810000000000001,"5min":2.0670000000000002,"15min":1.0760000000000001},"min":{"1min":0.26400000000000001,"5min":0.247,"15min":0.247},"max":{"1min":14.254,"5min":14.254,"15min":14.254},"last":0.88400000000000001},{"interface":"front","average":{"1min":2.1970000000000001,"5min":2.1349999999999998,"15min":1.1399999999999999},"min":{"1min":0.27500000000000002,"5min":0.27300000000000002,"15min":0.23499999999999999},"max":{"1min":11.536,"5min":14.055,"15min":16.594999999999999},"last":0.36199999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:44:16 2024","interfaces":[{"interface":"back","average":{"1min":1.6619999999999999,"5min":2.0529999999999999,"15min":1.0880000000000001},"min":{"1min":0.29099999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":14.223000000000001,"5min":14.223000000000001,"15min":14.223000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":2.6059999999999999,"5min":2.387,"15min":1.258},"min":{"1min":0.315,"5min":0.30299999999999999,"15min":0.27900000000000003},"max":{"1min":11.558999999999999,"5min":15.497999999999999,"15min":15.497999999999999},"last":0.39400000000000002}]},{"osd":7,"last update":"Mon Feb 19 21:44:34 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":2.3690000000000002,"15min":1.2609999999999999},"min":{"1min":0.317,"5min":0.307,"15min":0.26700000000000002},"max":{"1min":11.457000000000001,"5min":14.721,"15min":14.721},"last":0.54200000000000004},{"interface":"front","average":{"1min":1.3939999999999999,"5min":2.4079999999999999,"15min":1.3200000000000001},"min":{"1min":0.38500000000000001,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":11.500999999999999,"5min":14.744999999999999,"15min":14.744999999999999},"last":0.56999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575031,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1288944,"kb_used_data":979432,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":92456208,"statfs":{"total":95995035648,"available":94675156992,"internally_reserved":0,"allocated":1002938368,"data_stored":1002350461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:43:59 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.96399999999999997,"15min":1.24},"min":{"1min":0.17000000000000001,"5min":0.161,"15min":0.161},"max":{"1min":1.7849999999999999,"5min":11.305,"15min":42.776000000000003},"last":0.75},{"interface":"front","average":{"1min":0.90400000000000003,"5min":1.2589999999999999,"15min":1.258},"min":{"1min":0.20399999999999999,"5min":0.183,"15min":0.183},"max":{"1min":3.052,"5min":11.92,"15min":44.845999999999997},"last":1.0049999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:44:30 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.91600000000000004,"15min":1.157},"min":{"1min":0.25700000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.617,"5min":6.9640000000000004,"15min":11.826000000000001},"last":1.266},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.95199999999999996,"15min":1.2509999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.215},"max":{"1min":1.0069999999999999,"5min":4.6180000000000003,"15min":12.26},"last":2.5830000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:43:59 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.1870000000000001,"15min":1.363},"min":{"1min":0.29399999999999998,"5min":0.224,"15min":0.224},"max":{"1min":4.6120000000000001,"5min":8.3469999999999995,"15min":41.607999999999997},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.2310000000000001,"15min":1.2250000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":4.5529999999999999,"5min":11.204000000000001,"15min":42.811999999999998},"last":0.72199999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.5189999999999999,"15min":1.1120000000000001},"min":{"1min":0.32100000000000001,"5min":0.26900000000000002,"15min":0.26800000000000002},"max":{"1min":12.754,"5min":12.754,"15min":12.754},"last":1.024},{"interface":"front","average":{"1min":0.67200000000000004,"5min":1.3779999999999999,"15min":1.1739999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.004,"5min":6.4169999999999998,"15min":10.51},"last":1.048}]},{"osd":5,"last update":"Mon Feb 19 21:43:47 2024","interfaces":[{"interface":"back","average":{"1min":2.0009999999999999,"5min":1.774,"15min":1.2410000000000001},"min":{"1min":0.35099999999999998,"5min":0.30599999999999999,"15min":0.28799999999999998},"max":{"1min":8.4269999999999996,"5min":8.4269999999999996,"15min":10.458},"last":1.294},{"interface":"front","average":{"1min":2.044,"5min":1.6439999999999999,"15min":1.163},"min":{"1min":0.34000000000000002,"5min":0.32600000000000001,"15min":0.30099999999999999},"max":{"1min":6.5259999999999998,"5min":6.7320000000000002,"15min":7.6950000000000003},"last":1.6200000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4790000000000001,"5min":1.8180000000000001,"15min":1.25},"min":{"1min":0.42799999999999999,"5min":0.318,"15min":0.30099999999999999},"max":{"1min":4.5030000000000001,"5min":11.638999999999999,"15min":11.638999999999999},"last":1.75},{"interface":"front","average":{"1min":1.367,"5min":1.98,"15min":1.3440000000000001},"min":{"1min":0.376,"5min":0.32900000000000001,"15min":0.316},"max":{"1min":6.46,"5min":12.199,"15min":12.199},"last":1.643}]},{"osd":7,"last update":"Mon Feb 19 21:43:36 2024","interfaces":[{"interface":"back","average":{"1min":2.5030000000000001,"5min":1.9590000000000001,"15min":1.347},"min":{"1min":0.40100000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":5.0860000000000003,"5min":8.1699999999999999,"15min":10.638999999999999},"last":2.5270000000000001},{"interface":"front","average":{"1min":2.004,"5min":1.946,"15min":1.2310000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":5.0979999999999999,"5min":11.276,"15min":11.276},"last":3.085}]}]},{"osd":0,"up_from":8,"seq":34359738557,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":918820,"kb_used_data":613404,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":92826332,"statfs":{"total":95995035648,"available":95054163968,"internally_reserved":0,"allocated":628125696,"data_stored":627549604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:44:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.82899999999999996,"15min":0.92400000000000004},"min":{"1min":0.184,"5min":0.182,"15min":0.17499999999999999},"max":{"1min":2.9910000000000001,"5min":16.478000000000002,"15min":16.478000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.95099999999999996,"15min":1.1579999999999999},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":3.1680000000000001,"5min":8.0229999999999997,"15min":13.422000000000001},"last":0.25900000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:44:37 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.77300000000000002,"15min":1.089},"min":{"1min":0.25600000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.55100000000000005,"5min":8.4559999999999995,"15min":13.638999999999999},"last":0.499},{"interface":"front","average":{"1min":0.49299999999999999,"5min":1.1259999999999999,"15min":1.292},"min":{"1min":0.23300000000000001,"5min":0.224,"15min":0.19500000000000001},"max":{"1min":2.8010000000000002,"5min":13.134,"15min":13.134},"last":0.61799999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:43:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.2809999999999999,"15min":1.3819999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":3.383,"5min":13.292999999999999,"15min":14.507999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":1.131,"15min":1.3240000000000001},"min":{"1min":0.27400000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":2.9289999999999998,"5min":8.4169999999999998,"15min":18.759},"last":1.532}]},{"osd":4,"last update":"Mon Feb 19 21:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":1.764,"15min":1.2989999999999999},"min":{"1min":0.36899999999999999,"5min":0.32400000000000001,"15min":0.28299999999999997},"max":{"1min":3.5129999999999999,"5min":13.278,"15min":13.278},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.88600000000000001,"5min":1.4430000000000001,"15min":1.1559999999999999},"min":{"1min":0.371,"5min":0.33200000000000002,"15min":0.255},"max":{"1min":3.504,"5min":8.4789999999999992,"15min":8.9450000000000003},"last":0.47399999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:43:50 2024","interfaces":[{"interface":"back","average":{"1min":3.0030000000000001,"5min":2.048,"15min":1.5549999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":10.852,"5min":10.852,"15min":42.799999999999997},"last":0.378},{"interface":"front","average":{"1min":3.0489999999999999,"5min":2.2130000000000001,"15min":1.5549999999999999},"min":{"1min":0.36599999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":10.842000000000001,"5min":13.237,"15min":42.695},"last":0.46400000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:44:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.3169999999999999,"15min":1.2569999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.27900000000000003},"max":{"1min":4.4420000000000002,"5min":8.5009999999999994,"15min":42.777000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":1.7589999999999999,"5min":2.0990000000000002,"15min":1.4930000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.28599999999999998},"max":{"1min":13.289999999999999,"5min":13.289999999999999,"15min":13.289999999999999},"last":0.35799999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:44:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":1.7250000000000001,"15min":1.3879999999999999},"min":{"1min":0.378,"5min":0.37,"15min":0.31},"max":{"1min":1.353,"5min":13.26,"15min":42.758000000000003},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":1.45,"15min":1.331},"min":{"1min":0.40899999999999997,"5min":0.371,"15min":0.33200000000000002},"max":{"1min":2.9630000000000001,"5min":8.5340000000000007,"15min":42.718000000000004},"last":0.52900000000000003}]}]},{"osd":2,"up_from":0,"seq":77309411506,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":26,"seq":111669149869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":479976,"kb_used_data":182752,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93265176,"statfs":{"total":95995035648,"available":95503540224,"internally_reserved":0,"allocated":187138048,"data_stored":186620584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:43:59 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.0740000000000001,"15min":1.1439999999999999},"min":{"1min":0.187,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":8.8529999999999998,"5min":8.8529999999999998,"15min":17.992000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.131,"15min":1.5009999999999999},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":9.1120000000000001,"5min":9.1120000000000001,"15min":46.654000000000003},"last":0.22700000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:43:59 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.95499999999999996,"15min":0.94099999999999995},"min":{"1min":0.22600000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":2.847,"5min":9.6289999999999996,"15min":9.9700000000000006},"last":0.54400000000000004},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.099,"15min":1.216},"min":{"1min":0.26200000000000001,"5min":0.20799999999999999,"15min":0.185},"max":{"1min":4.1429999999999998,"5min":6.3460000000000001,"15min":13.135999999999999},"last":0.42099999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:43:59 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.179,"15min":1.1870000000000001},"min":{"1min":0.23899999999999999,"5min":0.22900000000000001,"15min":0.224},"max":{"1min":4.484,"5min":6.8879999999999999,"15min":11.175000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":1.304,"5min":1.0780000000000001,"15min":1.423},"min":{"1min":0.26800000000000002,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":9.1500000000000004,"5min":12.723000000000001,"15min":45.831000000000003},"last":0.38}]},{"osd":4,"last update":"Mon Feb 19 21:44:26 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":1.212,"15min":1.028},"min":{"1min":0.40400000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":4.7190000000000003,"5min":7.1660000000000004,"15min":7.1660000000000004},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":1.6870000000000001,"15min":1.321},"min":{"1min":0.41399999999999998,"5min":0.28699999999999998,"15min":0.26800000000000002},"max":{"1min":1.8720000000000001,"5min":9.6720000000000006,"15min":11.093},"last":0.64600000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:43:42 2024","interfaces":[{"interface":"back","average":{"1min":1.9890000000000001,"5min":1.758,"15min":1.1579999999999999},"min":{"1min":0.30299999999999999,"5min":0.29099999999999998,"15min":0.27100000000000002},"max":{"1min":9.3650000000000002,"5min":12.257,"15min":12.257},"last":1.675},{"interface":"front","average":{"1min":2.3250000000000002,"5min":2.0600000000000001,"15min":1.3899999999999999},"min":{"1min":0.33200000000000002,"5min":0.307,"15min":0.27800000000000002},"max":{"1min":7.8460000000000001,"5min":8.5809999999999995,"15min":11.128},"last":1.389}]},{"osd":6,"last update":"Mon Feb 19 21:44:10 2024","interfaces":[{"interface":"back","average":{"1min":1.7030000000000001,"5min":1.411,"15min":1.1279999999999999},"min":{"1min":0.40100000000000002,"5min":0.309,"15min":0.30599999999999999},"max":{"1min":6.8380000000000001,"5min":6.8380000000000001,"15min":17.443999999999999},"last":1.9219999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.6859999999999999,"15min":1.3680000000000001},"min":{"1min":0.41699999999999998,"5min":0.32900000000000001,"15min":0.32300000000000001},"max":{"1min":4.4530000000000003,"5min":13.942,"15min":18.219000000000001},"last":0.67700000000000005}]},{"osd":7,"last update":"Mon Feb 19 21:44:35 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.7110000000000001,"15min":1.5740000000000001},"min":{"1min":0.38900000000000001,"5min":0.33200000000000002,"15min":0.318},"max":{"1min":5.1740000000000004,"5min":9.0259999999999998,"15min":45.777999999999999},"last":1.3080000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":1.272,"15min":1.081},"min":{"1min":0.42399999999999999,"5min":0.35399999999999998,"15min":0.35099999999999998},"max":{"1min":1.4450000000000001,"5min":6.585,"15min":6.585},"last":1.27}]}]},{"osd":4,"up_from":32,"seq":137438953638,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":805896,"kb_used_data":504576,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":92939256,"statfs":{"total":95995035648,"available":95169798144,"internally_reserved":0,"allocated":516685824,"data_stored":516128277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":1.5609999999999999,"15min":1.3260000000000001},"min":{"1min":0.33000000000000002,"5min":0.219,"15min":0.219},"max":{"1min":6.7199999999999998,"5min":11.541,"15min":40.664000000000001},"last":2.157},{"interface":"front","average":{"1min":0.93000000000000005,"5min":1.532,"15min":1.409},"min":{"1min":0.372,"5min":0.23799999999999999,"15min":0.22600000000000001},"max":{"1min":7.5270000000000001,"5min":9.2799999999999994,"15min":41.046999999999997},"last":1.776}]},{"osd":1,"last update":"Mon Feb 19 21:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":1.7090000000000001,"15min":1.141},"min":{"1min":0.34699999999999998,"5min":0.22,"15min":0.22},"max":{"1min":2.1960000000000002,"5min":11.755000000000001,"15min":13.254},"last":2.1320000000000001},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.375,"15min":1.071},"min":{"1min":0.35499999999999998,"5min":0.25,"15min":0.25},"max":{"1min":7.6970000000000001,"5min":7.6970000000000001,"15min":15.411},"last":1.806}]},{"osd":2,"last update":"Mon Feb 19 21:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.6579999999999999,"15min":1.1899999999999999},"min":{"1min":0.307,"5min":0.30299999999999999,"15min":0.27100000000000002},"max":{"1min":7.6399999999999997,"5min":7.6459999999999999,"15min":16.788},"last":1.8300000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":1.6040000000000001,"15min":1.3899999999999999},"min":{"1min":0.36199999999999999,"5min":0.318,"15min":0.27300000000000002},"max":{"1min":3.302,"5min":10.603999999999999,"15min":20.995999999999999},"last":1.2949999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":1.6870000000000001,"15min":1.2909999999999999},"min":{"1min":0.35799999999999998,"5min":0.32800000000000001,"15min":0.316},"max":{"1min":3.9100000000000001,"5min":10.970000000000001,"15min":15.914999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":1.764,"15min":1.244},"min":{"1min":0.30299999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.407,"5min":11.662000000000001,"15min":13.321},"last":2.1779999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:44:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":2.0609999999999999,"15min":1.046},"min":{"1min":0.28799999999999998,"5min":0.24099999999999999,"15min":0.23499999999999999},"max":{"1min":7.5949999999999998,"5min":18.916,"15min":18.916},"last":1.8700000000000001},{"interface":"front","average":{"1min":1.4490000000000001,"5min":2.79,"15min":1.2769999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":5.915,"5min":14.840999999999999,"15min":14.840999999999999},"last":1.266}]},{"osd":6,"last update":"Mon Feb 19 21:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":1.7629999999999999,"15min":1.083},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":7.048,"5min":10.622999999999999,"15min":13.27},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.85699999999999998,"5min":2.0129999999999999,"15min":1.0860000000000001},"min":{"1min":0.28799999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":7.6180000000000003,"5min":14.127000000000001,"15min":14.127000000000001},"last":3.016}]},{"osd":7,"last update":"Mon Feb 19 21:43:41 2024","interfaces":[{"interface":"back","average":{"1min":2.8650000000000002,"5min":2.1200000000000001,"15min":1.087},"min":{"1min":0.35799999999999998,"5min":0.30399999999999999,"15min":0.28899999999999998},"max":{"1min":14.093,"5min":14.093,"15min":14.093},"last":3.0600000000000001},{"interface":"front","average":{"1min":2.5499999999999998,"5min":2.4990000000000001,"15min":1.2230000000000001},"min":{"1min":0.35799999999999998,"5min":0.33500000000000002,"15min":0.32900000000000001},"max":{"1min":12.808999999999999,"5min":12.808999999999999,"15min":12.808999999999999},"last":1.2050000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757410,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1167720,"kb_used_data":858208,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":92577432,"statfs":{"total":95995035648,"available":94799290368,"internally_reserved":0,"allocated":878804992,"data_stored":878224274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:43:51 2024","interfaces":[{"interface":"back","average":{"1min":3.4220000000000002,"5min":1.9219999999999999,"15min":1.3069999999999999},"min":{"1min":0.30299999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":15.048,"5min":15.048,"15min":20.550999999999998},"last":0.23100000000000001},{"interface":"front","average":{"1min":2.6309999999999998,"5min":2.1800000000000002,"15min":1.3460000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":8.8970000000000002,"5min":9.9390000000000001,"15min":20.879000000000001},"last":5.6900000000000004}]},{"osd":1,"last update":"Mon Feb 19 21:43:51 2024","interfaces":[{"interface":"back","average":{"1min":2.4620000000000002,"5min":2.198,"15min":1.272},"min":{"1min":0.34100000000000003,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":8.8490000000000002,"5min":10.42,"15min":10.42},"last":0.25600000000000001},{"interface":"front","average":{"1min":1.387,"5min":1.397,"15min":1.143},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":5.8739999999999997,"5min":10.021000000000001,"15min":10.316000000000001},"last":0.29599999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:43:51 2024","interfaces":[{"interface":"back","average":{"1min":3.2970000000000002,"5min":1.9159999999999999,"15min":1.3540000000000001},"min":{"1min":0.39200000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":15.015000000000001,"5min":15.015000000000001,"15min":20.186},"last":0.307},{"interface":"front","average":{"1min":2.6160000000000001,"5min":2.0619999999999998,"15min":1.3700000000000001},"min":{"1min":0.35999999999999999,"5min":0.29899999999999999,"15min":0.23200000000000001},"max":{"1min":8.9030000000000005,"5min":9.4909999999999997,"15min":20.175000000000001},"last":0.28899999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:43:51 2024","interfaces":[{"interface":"back","average":{"1min":3.1850000000000001,"5min":2.1930000000000001,"15min":1.5089999999999999},"min":{"1min":0.44600000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":10.117000000000001,"5min":12.021000000000001,"15min":20.146999999999998},"last":2.266},{"interface":"front","average":{"1min":2.9660000000000002,"5min":2.452,"15min":1.6579999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":8.8699999999999992,"5min":9.5150000000000006,"15min":20.120000000000001},"last":2.3359999999999999}]},{"osd":4,"last update":"Mon Feb 19 21:43:51 2024","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.7270000000000001,"15min":0.89600000000000002},"min":{"1min":0.255,"5min":0.252,"15min":0.23999999999999999},"max":{"1min":5.7939999999999996,"5min":21.577000000000002,"15min":21.577000000000002},"last":0.27100000000000002},{"interface":"front","average":{"1min":3.899,"5min":2.6099999999999999,"15min":1.2310000000000001},"min":{"1min":0.33900000000000002,"5min":0.28799999999999998,"15min":0.25600000000000001},"max":{"1min":15.071999999999999,"5min":15.071999999999999,"15min":15.071999999999999},"last":0.34200000000000003}]},{"osd":6,"last update":"Mon Feb 19 21:44:20 2024","interfaces":[{"interface":"back","average":{"1min":2.21,"5min":2.2650000000000001,"15min":1.173},"min":{"1min":0.313,"5min":0.27000000000000002,"15min":0.221},"max":{"1min":10.157,"5min":13.138999999999999,"15min":13.138999999999999},"last":0.374},{"interface":"front","average":{"1min":1.71,"5min":2.1970000000000001,"15min":1.262},"min":{"1min":0.35299999999999998,"5min":0.28999999999999998,"15min":0.23599999999999999},"max":{"1min":8.5589999999999993,"5min":13.532999999999999,"15min":13.532999999999999},"last":0.33700000000000002}]},{"osd":7,"last update":"Mon Feb 19 21:43:44 2024","interfaces":[{"interface":"back","average":{"1min":3.629,"5min":2.9100000000000001,"15min":1.383},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.29999999999999999},"max":{"1min":12.038,"5min":12.962,"15min":12.962},"last":0.443},{"interface":"front","average":{"1min":1.95,"5min":2.419,"15min":1.21},"min":{"1min":0.311,"5min":0.311,"15min":0.29099999999999998},"max":{"1min":5.9580000000000002,"5min":17.759,"15min":17.759},"last":0.45300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":2118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":637665280,"data_stored":637665280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1015676928,"data_stored":1015676928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":190971904,"data_stored":190971904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":554696704,"data_stored":554696704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":916914176,"data_stored":916914176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":732299264,"data_stored":732299264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":354746368,"data_stored":354746368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:44:42.994 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2024-02-19T21:44:42.994 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool set default.rgw.meta pg_num 32 2024-02-19T21:44:43.072 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 11 15 28940 28925 164.333 134.25 0.00707878 0.00608003 2024-02-19T21:44:43.750 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:44:43.755 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:43.755 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:44:43.856 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:44:43.899 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:42.613990+0000 mon.a (mon.0) 1319 : cluster [DBG] osdmap e295: 8 total, 8 up, 7 in 2024-02-19T21:44:43.899 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:43.051809+0000 mon.a (mon.0) 1320 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "22"}]: dispatch 2024-02-19T21:44:43.903 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:43.937 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:44:43.942 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:43.942 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:44:43.990 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:42.613990+0000 mon.a (mon.0) 1319 : cluster [DBG] osdmap e295: 8 total, 8 up, 7 in 2024-02-19T21:44:43.990 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:43.051809+0000 mon.a (mon.0) 1320 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "22"}]: dispatch 2024-02-19T21:44:43.990 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:42.613990+0000 mon.a (mon.0) 1319 : cluster [DBG] osdmap e295: 8 total, 8 up, 7 in 2024-02-19T21:44:43.990 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:43.051809+0000 mon.a (mon.0) 1320 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "22"}]: dispatch 2024-02-19T21:44:44.043 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:44:44.073 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 12 16 30972 30956 161.216 126.938 0.0123866 0.00619699 2024-02-19T21:44:44.083 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:45.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:43.049643+0000 mgr.y (mgr.14514) 469 : cluster [DBG] pgmap v583: 129 pgs: 1 peering, 128 active+clean; 1.4 GiB data, 6.0 GiB used, 620 GiB / 626 GiB avail; 1.2 KiB/s rd, 198 MiB/s wr, 3.17k op/s 2024-02-19T21:44:45.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:43.630088+0000 mon.a (mon.0) 1321 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "22"}]': finished 2024-02-19T21:44:45.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:43.630156+0000 mon.a (mon.0) 1322 : cluster [DBG] osdmap e296: 8 total, 8 up, 7 in 2024-02-19T21:44:45.073 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 13 16 32804 32788 157.622 114.5 0.00476207 0.0063394 2024-02-19T21:44:45.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:43.049643+0000 mgr.y (mgr.14514) 469 : cluster [DBG] pgmap v583: 129 pgs: 1 peering, 128 active+clean; 1.4 GiB data, 6.0 GiB used, 620 GiB / 626 GiB avail; 1.2 KiB/s rd, 198 MiB/s wr, 3.17k op/s 2024-02-19T21:44:45.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:43.630088+0000 mon.a (mon.0) 1321 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "22"}]': finished 2024-02-19T21:44:45.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:43.630156+0000 mon.a (mon.0) 1322 : cluster [DBG] osdmap e296: 8 total, 8 up, 7 in 2024-02-19T21:44:45.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:43.049643+0000 mgr.y (mgr.14514) 469 : cluster [DBG] pgmap v583: 129 pgs: 1 peering, 128 active+clean; 1.4 GiB data, 6.0 GiB used, 620 GiB / 626 GiB avail; 1.2 KiB/s rd, 198 MiB/s wr, 3.17k op/s 2024-02-19T21:44:45.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:43.630088+0000 mon.a (mon.0) 1321 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pg_num_actual", "val": "22"}]': finished 2024-02-19T21:44:45.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:43.630156+0000 mon.a (mon.0) 1322 : cluster [DBG] osdmap e296: 8 total, 8 up, 7 in 2024-02-19T21:44:45.343 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:44:45.347 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:45.348 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:44:45.449 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:44:45.495 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:46.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:44.654140+0000 mon.a (mon.0) 1323 : cluster [DBG] osdmap e297: 8 total, 8 up, 7 in 2024-02-19T21:44:46.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:45.121708+0000 mon.a (mon.0) 1324 : cluster [DBG] osdmap e298: 8 total, 8 up, 7 in 2024-02-19T21:44:46.057 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:44:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:44:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:44:46.073 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 14 16 34665 34649 154.671 116.312 0.0114675 0.00646056 2024-02-19T21:44:46.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:44.654140+0000 mon.a (mon.0) 1323 : cluster [DBG] osdmap e297: 8 total, 8 up, 7 in 2024-02-19T21:44:46.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:45.121708+0000 mon.a (mon.0) 1324 : cluster [DBG] osdmap e298: 8 total, 8 up, 7 in 2024-02-19T21:44:46.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:44.654140+0000 mon.a (mon.0) 1323 : cluster [DBG] osdmap e297: 8 total, 8 up, 7 in 2024-02-19T21:44:46.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:45.121708+0000 mon.a (mon.0) 1324 : cluster [DBG] osdmap e298: 8 total, 8 up, 7 in 2024-02-19T21:44:46.175 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:44:46.175 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:44:46.759 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:44:46.762 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:46.763 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:44:46.863 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:44:46.912 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:47.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:45.050189+0000 mgr.y (mgr.14514) 470 : cluster [DBG] pgmap v586: 129 pgs: 2 clean+premerge+peered, 127 active+clean; 1.6 GiB data, 7.1 GiB used, 619 GiB / 626 GiB avail; 61 MiB/s wr, 977 op/s 2024-02-19T21:44:47.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:46.140038+0000 mon.a (mon.0) 1325 : cluster [DBG] osdmap e299: 8 total, 8 up, 7 in 2024-02-19T21:44:47.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:46.575208+0000 mon.a (mon.0) 1326 : audit [INF] from='client.? 172.21.15.80:0/3352523590' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:44:47.073 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 15 15 36472 36457 151.892 113 0.0071932 0.00657853 2024-02-19T21:44:47.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:45.050189+0000 mgr.y (mgr.14514) 470 : cluster [DBG] pgmap v586: 129 pgs: 2 clean+premerge+peered, 127 active+clean; 1.6 GiB data, 7.1 GiB used, 619 GiB / 626 GiB avail; 61 MiB/s wr, 977 op/s 2024-02-19T21:44:47.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:46.140038+0000 mon.a (mon.0) 1325 : cluster [DBG] osdmap e299: 8 total, 8 up, 7 in 2024-02-19T21:44:47.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:46.575208+0000 mon.a (mon.0) 1326 : audit [INF] from='client.? 172.21.15.80:0/3352523590' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:44:47.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:45.050189+0000 mgr.y (mgr.14514) 470 : cluster [DBG] pgmap v586: 129 pgs: 2 clean+premerge+peered, 127 active+clean; 1.6 GiB data, 7.1 GiB used, 619 GiB / 626 GiB avail; 61 MiB/s wr, 977 op/s 2024-02-19T21:44:47.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:46.140038+0000 mon.a (mon.0) 1325 : cluster [DBG] osdmap e299: 8 total, 8 up, 7 in 2024-02-19T21:44:47.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:46.575208+0000 mon.a (mon.0) 1326 : audit [INF] from='client.? 172.21.15.80:0/3352523590' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:44:47.167 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-02-19T21:44:47.450 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.1 dump_ops_in_flight 2024-02-19T21:44:47.652 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:44:47.653 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:44:47.653 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:44:47.653 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:44:47.653 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:44:47.653 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:44:47.653 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:44:47.653 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:44:47.653 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:44:47.653 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:44:47.653 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:44:47.653 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:44:47.653 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:44:47.654 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:44:47.654 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:44:47.654 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:44:47.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:47.134615+0000 mon.a (mon.0) 1327 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:44:47.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:47.145345+0000 mon.a (mon.0) 1328 : audit [INF] from='client.? 172.21.15.80:0/3352523590' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:44:47.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:47.145400+0000 mon.a (mon.0) 1329 : cluster [DBG] osdmap e300: 8 total, 8 up, 7 in 2024-02-19T21:44:47.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:47.163566+0000 mon.a (mon.0) 1330 : audit [DBG] from='client.? 172.21.15.80:0/595641045' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:44:47.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:47.134615+0000 mon.a (mon.0) 1327 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:44:47.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:47.145345+0000 mon.a (mon.0) 1328 : audit [INF] from='client.? 172.21.15.80:0/3352523590' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:44:47.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:47.145400+0000 mon.a (mon.0) 1329 : cluster [DBG] osdmap e300: 8 total, 8 up, 7 in 2024-02-19T21:44:47.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:47.163566+0000 mon.a (mon.0) 1330 : audit [DBG] from='client.? 172.21.15.80:0/595641045' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:44:48.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:47.134615+0000 mon.a (mon.0) 1327 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:44:48.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:47.145345+0000 mon.a (mon.0) 1328 : audit [INF] from='client.? 172.21.15.80:0/3352523590' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:44:48.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:47.145400+0000 mon.a (mon.0) 1329 : cluster [DBG] osdmap e300: 8 total, 8 up, 7 in 2024-02-19T21:44:48.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:47.163566+0000 mon.a (mon.0) 1330 : audit [DBG] from='client.? 172.21.15.80:0/595641045' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:44:48.073 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 16 16 38233 38217 149.273 110 0.0113132 0.00669424 2024-02-19T21:44:48.579 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:44:48.582 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:48.582 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:44:48.683 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:44:48.733 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:48.766 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:44:48.769 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:48.770 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:44:48.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:47.052006+0000 mgr.y (mgr.14514) 471 : cluster [DBG] pgmap v589: 128 pgs: 1 clean+premerge+peered, 127 active+clean; 2.0 GiB data, 7.9 GiB used, 618 GiB / 626 GiB avail; 1.2 KiB/s rd, 161 MiB/s wr, 2.58k op/s 2024-02-19T21:44:48.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:47.274643+0000 osd.6 (osd.6) 157 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:44:48.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:47.281450+0000 osd.6 (osd.6) 158 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:44:48.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:47.739873+0000 osd.5 (osd.5) 191 : cluster [DBG] 2.12 scrub starts 2024-02-19T21:44:48.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:47.740900+0000 osd.5 (osd.5) 192 : cluster [DBG] 2.12 scrub ok 2024-02-19T21:44:48.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:47.797325+0000 osd.1 (osd.1) 175 : cluster [DBG] 2.4 scrub starts 2024-02-19T21:44:48.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:47.801760+0000 osd.1 (osd.1) 176 : cluster [DBG] 2.4 scrub ok 2024-02-19T21:44:48.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:48.017884+0000 osd.0 (osd.0) 184 : cluster [DBG] 4.19 scrub starts 2024-02-19T21:44:48.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:48.022008+0000 osd.0 (osd.0) 185 : cluster [DBG] 4.19 scrub ok 2024-02-19T21:44:48.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:48.468062+0000 osd.7 (osd.7) 175 : cluster [DBG] 5.d scrub starts 2024-02-19T21:44:48.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:48.477950+0000 osd.7 (osd.7) 176 : cluster [DBG] 5.d scrub ok 2024-02-19T21:44:48.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:47.052006+0000 mgr.y (mgr.14514) 471 : cluster [DBG] pgmap v589: 128 pgs: 1 clean+premerge+peered, 127 active+clean; 2.0 GiB data, 7.9 GiB used, 618 GiB / 626 GiB avail; 1.2 KiB/s rd, 161 MiB/s wr, 2.58k op/s 2024-02-19T21:44:48.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:47.274643+0000 osd.6 (osd.6) 157 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:44:48.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:47.281450+0000 osd.6 (osd.6) 158 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:44:48.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:47.739873+0000 osd.5 (osd.5) 191 : cluster [DBG] 2.12 scrub starts 2024-02-19T21:44:48.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:47.740900+0000 osd.5 (osd.5) 192 : cluster [DBG] 2.12 scrub ok 2024-02-19T21:44:48.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:47.797325+0000 osd.1 (osd.1) 175 : cluster [DBG] 2.4 scrub starts 2024-02-19T21:44:48.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:47.801760+0000 osd.1 (osd.1) 176 : cluster [DBG] 2.4 scrub ok 2024-02-19T21:44:48.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:48.017884+0000 osd.0 (osd.0) 184 : cluster [DBG] 4.19 scrub starts 2024-02-19T21:44:48.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:48.022008+0000 osd.0 (osd.0) 185 : cluster [DBG] 4.19 scrub ok 2024-02-19T21:44:48.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:48.468062+0000 osd.7 (osd.7) 175 : cluster [DBG] 5.d scrub starts 2024-02-19T21:44:48.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:48.477950+0000 osd.7 (osd.7) 176 : cluster [DBG] 5.d scrub ok 2024-02-19T21:44:48.870 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:44:48.925 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:48.956 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:44:48.961 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:48.961 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:47.052006+0000 mgr.y (mgr.14514) 471 : cluster [DBG] pgmap v589: 128 pgs: 1 clean+premerge+peered, 127 active+clean; 2.0 GiB data, 7.9 GiB used, 618 GiB / 626 GiB avail; 1.2 KiB/s rd, 161 MiB/s wr, 2.58k op/s 2024-02-19T21:44:48.961 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:47.274643+0000 osd.6 (osd.6) 157 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:44:48.961 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:47.281450+0000 osd.6 (osd.6) 158 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:44:48.961 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:47.739873+0000 osd.5 (osd.5) 191 : cluster [DBG] 2.12 scrub starts 2024-02-19T21:44:48.961 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:47.740900+0000 osd.5 (osd.5) 192 : cluster [DBG] 2.12 scrub ok 2024-02-19T21:44:48.961 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:47.797325+0000 osd.1 (osd.1) 175 : cluster [DBG] 2.4 scrub starts 2024-02-19T21:44:48.962 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:47.801760+0000 osd.1 (osd.1) 176 : cluster [DBG] 2.4 scrub ok 2024-02-19T21:44:48.962 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:48.017884+0000 osd.0 (osd.0) 184 : cluster [DBG] 4.19 scrub starts 2024-02-19T21:44:48.962 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:48.022008+0000 osd.0 (osd.0) 185 : cluster [DBG] 4.19 scrub ok 2024-02-19T21:44:48.962 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:48.468062+0000 osd.7 (osd.7) 175 : cluster [DBG] 5.d scrub starts 2024-02-19T21:44:48.962 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:48.477950+0000 osd.7 (osd.7) 176 : cluster [DBG] 5.d scrub ok 2024-02-19T21:44:48.962 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:44:49.063 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:44:49.074 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 17 16 40000 39984 146.988 110.438 0.00671278 0.0067979 2024-02-19T21:44:49.102 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:44:49.122 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:49.154 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:44:49.166 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:49.166 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:44:49.170 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:44:49.267 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:44:49.317 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:49.401 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:44:49.407 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:49.407 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:44:49.508 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:44:49.561 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:49.611 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:44:49.619 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:49.619 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:44:49.720 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:44:49.757 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:50.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:48.342236+0000 osd.4 (osd.4) 150 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:44:50.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:48.349919+0000 osd.4 (osd.4) 151 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:44:50.073 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 18 16 41649 41633 144.547 103.062 0.0130308 0.0069136 2024-02-19T21:44:50.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:48.342236+0000 osd.4 (osd.4) 150 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:44:50.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:48.349919+0000 osd.4 (osd.4) 151 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:44:50.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:48.342236+0000 osd.4 (osd.4) 150 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:44:50.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:48.349919+0000 osd.4 (osd.4) 151 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:44:50.171 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:44:50.182 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:50.183 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:44:50.284 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:44:50.333 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:50.366 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:44:50.370 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:50.370 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:44:50.471 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:44:50.519 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:50.571 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-19T21:44:50.705 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:44:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:44:50.705 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:49.052334+0000 mgr.y (mgr.14514) 472 : cluster [DBG] pgmap v591: 128 pgs: 1 clean+premerge+peered, 127 active+clean; 2.0 GiB data, 7.9 GiB used, 618 GiB / 626 GiB avail; 1.1 KiB/s rd, 147 MiB/s wr, 2.35k op/s 2024-02-19T21:44:50.706 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:49.250508+0000 osd.6 (osd.6) 159 : cluster [DBG] 5.2 scrub starts 2024-02-19T21:44:50.706 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:49.260682+0000 osd.6 (osd.6) 160 : cluster [DBG] 5.2 scrub ok 2024-02-19T21:44:50.706 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:50.473601+0000 osd.7 (osd.7) 177 : cluster [DBG] 2.5 scrub starts 2024-02-19T21:44:50.706 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:50.478682+0000 osd.7 (osd.7) 178 : cluster [DBG] 2.5 scrub ok 2024-02-19T21:44:50.776 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:49.052334+0000 mgr.y (mgr.14514) 472 : cluster [DBG] pgmap v591: 128 pgs: 1 clean+premerge+peered, 127 active+clean; 2.0 GiB data, 7.9 GiB used, 618 GiB / 626 GiB avail; 1.1 KiB/s rd, 147 MiB/s wr, 2.35k op/s 2024-02-19T21:44:50.777 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:49.250508+0000 osd.6 (osd.6) 159 : cluster [DBG] 5.2 scrub starts 2024-02-19T21:44:50.777 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:49.260682+0000 osd.6 (osd.6) 160 : cluster [DBG] 5.2 scrub ok 2024-02-19T21:44:50.777 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:50.473601+0000 osd.7 (osd.7) 177 : cluster [DBG] 2.5 scrub starts 2024-02-19T21:44:50.777 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:50.478682+0000 osd.7 (osd.7) 178 : cluster [DBG] 2.5 scrub ok 2024-02-19T21:44:50.778 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:44:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:44:50] "GET /metrics HTTP/1.1" 200 176099 "" "Prometheus/2.33.4" 2024-02-19T21:44:50.778 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:49.052334+0000 mgr.y (mgr.14514) 472 : cluster [DBG] pgmap v591: 128 pgs: 1 clean+premerge+peered, 127 active+clean; 2.0 GiB data, 7.9 GiB used, 618 GiB / 626 GiB avail; 1.1 KiB/s rd, 147 MiB/s wr, 2.35k op/s 2024-02-19T21:44:50.778 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:49.250508+0000 osd.6 (osd.6) 159 : cluster [DBG] 5.2 scrub starts 2024-02-19T21:44:50.778 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:49.260682+0000 osd.6 (osd.6) 160 : cluster [DBG] 5.2 scrub ok 2024-02-19T21:44:50.778 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:50.473601+0000 osd.7 (osd.7) 177 : cluster [DBG] 2.5 scrub starts 2024-02-19T21:44:50.778 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:50.478682+0000 osd.7 (osd.7) 178 : cluster [DBG] 2.5 scrub ok 2024-02-19T21:44:51.073 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 19 16 43221 43205 142.11 98.25 0.00747095 0.00703184 2024-02-19T21:44:51.097 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:44:51.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:50.543644+0000 mgr.y (mgr.14514) 473 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:44:51.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:50.645654+0000 osd.3 (osd.3) 184 : cluster [DBG] 4.1a scrub starts 2024-02-19T21:44:51.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:50.652692+0000 osd.3 (osd.3) 185 : cluster [DBG] 4.1a scrub ok 2024-02-19T21:44:51.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:51.024759+0000 osd.0 (osd.0) 186 : cluster [DBG] 4.1e scrub starts 2024-02-19T21:44:51.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:51.032699+0000 osd.0 (osd.0) 187 : cluster [DBG] 4.1e scrub ok 2024-02-19T21:44:51.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:51.465799+0000 osd.7 (osd.7) 179 : cluster [DBG] 2.b scrub starts 2024-02-19T21:44:51.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:51.468726+0000 osd.7 (osd.7) 180 : cluster [DBG] 2.b scrub ok 2024-02-19T21:44:51.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:50.543644+0000 mgr.y (mgr.14514) 473 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:44:51.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:50.645654+0000 osd.3 (osd.3) 184 : cluster [DBG] 4.1a scrub starts 2024-02-19T21:44:51.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:50.652692+0000 osd.3 (osd.3) 185 : cluster [DBG] 4.1a scrub ok 2024-02-19T21:44:51.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:51.024759+0000 osd.0 (osd.0) 186 : cluster [DBG] 4.1e scrub starts 2024-02-19T21:44:51.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:51.032699+0000 osd.0 (osd.0) 187 : cluster [DBG] 4.1e scrub ok 2024-02-19T21:44:51.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:51.465799+0000 osd.7 (osd.7) 179 : cluster [DBG] 2.b scrub starts 2024-02-19T21:44:51.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:51.468726+0000 osd.7 (osd.7) 180 : cluster [DBG] 2.b scrub ok 2024-02-19T21:44:52.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:50.543644+0000 mgr.y (mgr.14514) 473 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:44:52.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:50.645654+0000 osd.3 (osd.3) 184 : cluster [DBG] 4.1a scrub starts 2024-02-19T21:44:52.060 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:50.652692+0000 osd.3 (osd.3) 185 : cluster [DBG] 4.1a scrub ok 2024-02-19T21:44:52.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:51.024759+0000 osd.0 (osd.0) 186 : cluster [DBG] 4.1e scrub starts 2024-02-19T21:44:52.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:51.032699+0000 osd.0 (osd.0) 187 : cluster [DBG] 4.1e scrub ok 2024-02-19T21:44:52.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:51.465799+0000 osd.7 (osd.7) 179 : cluster [DBG] 2.b scrub starts 2024-02-19T21:44:52.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:51.468726+0000 osd.7 (osd.7) 180 : cluster [DBG] 2.b scrub ok 2024-02-19T21:44:52.073 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:2024-02-19T21:44:52.074588+0000 min lat: 0.00124015 max lat: 0.0684557 avg lat: 0.0071338 2024-02-19T21:44:52.073 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-19T21:44:52.073 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 20 16 44842 44826 140.07 101.312 0.0120474 0.0071338 2024-02-19T21:44:52.165 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:44:52.171 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:52.172 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:44:52.273 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:44:52.327 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:52.394 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:44:52.398 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:52.398 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:44:52.499 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:44:52.529 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:44:52.559 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:52.627 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:44:52.629 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:52.630 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:44:52.731 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:44:52.785 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:52.807 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:44:52.812 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:52.812 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:44:52.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:51.053076+0000 mgr.y (mgr.14514) 474 : cluster [DBG] pgmap v592: 128 pgs: 128 active+clean; 2.5 GiB data, 9.5 GiB used, 616 GiB / 626 GiB avail; 1.7 KiB/s rd, 159 MiB/s wr, 2.55k op/s 2024-02-19T21:44:52.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:51.188242+0000 osd.6 (osd.6) 161 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:44:52.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:51.194538+0000 osd.6 (osd.6) 162 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:44:52.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:52.141391+0000 osd.6 (osd.6) 163 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:44:52.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:52.148152+0000 osd.6 (osd.6) 164 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:44:52.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:51.053076+0000 mgr.y (mgr.14514) 474 : cluster [DBG] pgmap v592: 128 pgs: 128 active+clean; 2.5 GiB data, 9.5 GiB used, 616 GiB / 626 GiB avail; 1.7 KiB/s rd, 159 MiB/s wr, 2.55k op/s 2024-02-19T21:44:52.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:51.188242+0000 osd.6 (osd.6) 161 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:44:52.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:51.194538+0000 osd.6 (osd.6) 162 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:44:52.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:52.141391+0000 osd.6 (osd.6) 163 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:44:52.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:52.148152+0000 osd.6 (osd.6) 164 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:44:52.913 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:44:52.972 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:53.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:51.053076+0000 mgr.y (mgr.14514) 474 : cluster [DBG] pgmap v592: 128 pgs: 128 active+clean; 2.5 GiB data, 9.5 GiB used, 616 GiB / 626 GiB avail; 1.7 KiB/s rd, 159 MiB/s wr, 2.55k op/s 2024-02-19T21:44:53.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:51.188242+0000 osd.6 (osd.6) 161 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:44:53.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:51.194538+0000 osd.6 (osd.6) 162 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:44:53.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:52.141391+0000 osd.6 (osd.6) 163 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:44:53.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:52.148152+0000 osd.6 (osd.6) 164 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:44:53.073 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 21 16 46290 46274 137.709 90.5 0.00687672 0.00725687 2024-02-19T21:44:53.155 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:44:53.155 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-02-19T21:44:53.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.155 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:46398 9.d 9:b2fd32eb:::benchmark_data_smithi080_126364_object46397:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e300)", 2024-02-19T21:44:53.155 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:44:53.147043+0000", 2024-02-19T21:44:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0049837459999999998, 2024-02-19T21:44:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050133900000000004, 2024-02-19T21:44:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:44:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:44:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:44:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:44:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:44:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 46398 2024-02-19T21:44:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:44:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:44:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.147043+0000", 2024-02-19T21:44:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:44:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:44:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.147043+0000", 2024-02-19T21:44:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:44:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:44:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.147041+0000", 2024-02-19T21:44:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4788000000000001e-05 2024-02-19T21:44:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:44:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.147066+0000", 2024-02-19T21:44:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4603000000000001e-05 2024-02-19T21:44:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:44:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.147081+0000", 2024-02-19T21:44:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2949999999999999e-06 2024-02-19T21:44:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:44:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.147087+0000", 2024-02-19T21:44:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6708000000000001e-05 2024-02-19T21:44:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:44:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.147134+0000", 2024-02-19T21:44:53.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012991500000000001 2024-02-19T21:44:53.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:44:53.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.147264+0000", 2024-02-19T21:44:53.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016543999999999999 2024-02-19T21:44:53.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4,5", 2024-02-19T21:44:53.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.147429+0000", 2024-02-19T21:44:53.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0020639199999999999 2024-02-19T21:44:53.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:44:53.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.149493+0000", 2024-02-19T21:44:53.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002450308 2024-02-19T21:44:53.160 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:53.160 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:53.160 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:53.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.160 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.15345.0:46393 9.5 e300/268 9:a34180e5:::benchmark_data_smithi080_126364_object46392:head v 300'2832, mlcod=300'2829)", 2024-02-19T21:44:53.160 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:44:53.147576+0000", 2024-02-19T21:44:53.160 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.004450491, 2024-02-19T21:44:53.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045842749999999996, 2024-02-19T21:44:53.160 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:44:53.160 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:44:53.160 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:44:53.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:44:53.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.147576+0000", 2024-02-19T21:44:53.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:44:53.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:44:53.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.147576+0000", 2024-02-19T21:44:53.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:44:53.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:44:53.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.147575+0000", 2024-02-19T21:44:53.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7339000000000003e-05 2024-02-19T21:44:53.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:44:53.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.147612+0000", 2024-02-19T21:44:53.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0489000000000001e-05 2024-02-19T21:44:53.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:44:53.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.147623+0000", 2024-02-19T21:44:53.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2853e-05 2024-02-19T21:44:53.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:44:53.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.147636+0000", 2024-02-19T21:44:53.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018806490000000001 2024-02-19T21:44:53.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:44:53.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.149516+0000", 2024-02-19T21:44:53.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0441999999999998e-05 2024-02-19T21:44:53.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:44:53.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.149537+0000", 2024-02-19T21:44:53.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019608450000000001 2024-02-19T21:44:53.164 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:53.164 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:53.164 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:53.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.164 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.15345.0:46395 9.5 e300/268 9:a35595c5:::benchmark_data_smithi080_126364_object46394:head v 300'2833, mlcod=300'2829)", 2024-02-19T21:44:53.164 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:44:53.147645+0000", 2024-02-19T21:44:53.164 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0043813819999999996, 2024-02-19T21:44:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045772629999999998, 2024-02-19T21:44:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:44:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:44:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:44:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:44:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.147645+0000", 2024-02-19T21:44:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:44:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:44:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.147645+0000", 2024-02-19T21:44:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:44:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:44:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.147645+0000", 2024-02-19T21:44:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5242e-05 2024-02-19T21:44:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:44:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.147670+0000", 2024-02-19T21:44:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0469999999999994e-06 2024-02-19T21:44:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:44:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.147678+0000", 2024-02-19T21:44:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3229999999999999e-06 2024-02-19T21:44:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:44:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.147682+0000", 2024-02-19T21:44:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034482139999999998 2024-02-19T21:44:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:44:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.151131+0000", 2024-02-19T21:44:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4482e-05 2024-02-19T21:44:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:44:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.151155+0000", 2024-02-19T21:44:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035099480000000001 2024-02-19T21:44:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:53.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.168 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.15345.0:46397 9.5 e300/268 9:ac74b5d8:::benchmark_data_smithi080_126364_object46396:head v 300'2834, mlcod=300'2829)", 2024-02-19T21:44:53.171 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:44:53.147686+0000", 2024-02-19T21:44:53.171 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0043400870000000003, 2024-02-19T21:44:53.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045948100000000004, 2024-02-19T21:44:53.171 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:44:53.171 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:44:53.171 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:44:53.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:44:53.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.147686+0000", 2024-02-19T21:44:53.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:44:53.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:44:53.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.147686+0000", 2024-02-19T21:44:53.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:44:53.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:44:53.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.147686+0000", 2024-02-19T21:44:53.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.927e-05 2024-02-19T21:44:53.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:44:53.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.147705+0000", 2024-02-19T21:44:53.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1099999999999997e-06 2024-02-19T21:44:53.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:44:53.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.147712+0000", 2024-02-19T21:44:53.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.799e-06 2024-02-19T21:44:53.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:44:53.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.147716+0000", 2024-02-19T21:44:53.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042419040000000003 2024-02-19T21:44:53.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:44:53.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.151958+0000", 2024-02-19T21:44:53.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3672999999999999e-05 2024-02-19T21:44:53.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:44:53.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.151972+0000", 2024-02-19T21:44:53.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042854629999999998 2024-02-19T21:44:53.174 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:53.174 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:53.174 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:53.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.174 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:46403 9.4 9:2a1088a5:::benchmark_data_smithi080_126364_object46402:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e300)", 2024-02-19T21:44:53.174 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:44:53.151186+0000", 2024-02-19T21:44:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.00084077800000000003, 2024-02-19T21:44:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001160459, 2024-02-19T21:44:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:44:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:44:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:44:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:44:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:44:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 46403 2024-02-19T21:44:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:44:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:44:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.151186+0000", 2024-02-19T21:44:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:44:53.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:44:53.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.151186+0000", 2024-02-19T21:44:53.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:44:53.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:44:53.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.151184+0000", 2024-02-19T21:44:53.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9149000000000002e-05 2024-02-19T21:44:53.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:44:53.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.151213+0000", 2024-02-19T21:44:53.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2724999999999999e-05 2024-02-19T21:44:53.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:44:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.151226+0000", 2024-02-19T21:44:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9120000000000001e-06 2024-02-19T21:44:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:44:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.151233+0000", 2024-02-19T21:44:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9970999999999996e-05 2024-02-19T21:44:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:44:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.151323+0000", 2024-02-19T21:44:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013992200000000001 2024-02-19T21:44:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:44:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.151463+0000", 2024-02-19T21:44:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000156847 2024-02-19T21:44:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,4", 2024-02-19T21:44:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.151619+0000", 2024-02-19T21:44:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043385299999999999 2024-02-19T21:44:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:46404 9.0 9:07684fdd:::benchmark_data_smithi080_126364_object46403:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e300)", 2024-02-19T21:44:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:44:53.151250+0000", 2024-02-19T21:44:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.000776007, 2024-02-19T21:44:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001170503, 2024-02-19T21:44:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:44:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:44:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:44:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:44:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:44:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 46404 2024-02-19T21:44:53.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.181 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:44:53.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:44:53.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.151250+0000", 2024-02-19T21:44:53.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:44:53.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:44:53.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.151250+0000", 2024-02-19T21:44:53.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:44:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:44:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.151250+0000", 2024-02-19T21:44:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4777e-05 2024-02-19T21:44:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:44:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.151274+0000", 2024-02-19T21:44:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4205999999999999e-05 2024-02-19T21:44:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:44:53.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.151289+0000", 2024-02-19T21:44:53.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7640000000000002e-06 2024-02-19T21:44:53.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:44:53.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.151294+0000", 2024-02-19T21:44:53.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7593000000000002e-05 2024-02-19T21:44:53.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:44:53.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.151352+0000", 2024-02-19T21:44:53.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6927000000000002e-05 2024-02-19T21:44:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:44:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.151449+0000", 2024-02-19T21:44:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016191299999999999 2024-02-19T21:44:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:44:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:44:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,6", 2024-02-19T21:44:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:44:53.151611+0000", 2024-02-19T21:44:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036047999999999999 2024-02-19T21:44:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:44:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:44:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:44:53.185 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 6 2024-02-19T21:44:53.185 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:44:53.538 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:44:53.545 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:53.545 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:44:53.646 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:44:53.695 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:53.749 INFO:teuthology.orchestra.run.smithi080.stderr:set pool 6 pg_num to 32 2024-02-19T21:44:53.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:52.827232+0000 osd.1 (osd.1) 177 : cluster [DBG] 2.15 scrub starts 2024-02-19T21:44:53.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:52.828406+0000 osd.1 (osd.1) 178 : cluster [DBG] 2.15 scrub ok 2024-02-19T21:44:53.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:52.851561+0000 mon.c (mon.2) 65 : audit [INF] from='client.? 172.21.15.80:0/3833988302' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "32"}]: dispatch 2024-02-19T21:44:53.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:52.852759+0000 mon.a (mon.0) 1331 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "32"}]: dispatch 2024-02-19T21:44:53.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:53.064658+0000 osd.0 (osd.0) 188 : cluster [DBG] 4.16 scrub starts 2024-02-19T21:44:53.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:53.072739+0000 osd.0 (osd.0) 189 : cluster [DBG] 4.16 scrub ok 2024-02-19T21:44:53.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:52.827232+0000 osd.1 (osd.1) 177 : cluster [DBG] 2.15 scrub starts 2024-02-19T21:44:53.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:52.828406+0000 osd.1 (osd.1) 178 : cluster [DBG] 2.15 scrub ok 2024-02-19T21:44:53.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:52.851561+0000 mon.c (mon.2) 65 : audit [INF] from='client.? 172.21.15.80:0/3833988302' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "32"}]: dispatch 2024-02-19T21:44:53.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:52.852759+0000 mon.a (mon.0) 1331 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "32"}]: dispatch 2024-02-19T21:44:53.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:53.064658+0000 osd.0 (osd.0) 188 : cluster [DBG] 4.16 scrub starts 2024-02-19T21:44:53.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:53.072739+0000 osd.0 (osd.0) 189 : cluster [DBG] 4.16 scrub ok 2024-02-19T21:44:54.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:52.827232+0000 osd.1 (osd.1) 177 : cluster [DBG] 2.15 scrub starts 2024-02-19T21:44:54.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:52.828406+0000 osd.1 (osd.1) 178 : cluster [DBG] 2.15 scrub ok 2024-02-19T21:44:54.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:52.851561+0000 mon.c (mon.2) 65 : audit [INF] from='client.? 172.21.15.80:0/3833988302' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "32"}]: dispatch 2024-02-19T21:44:54.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:52.852759+0000 mon.a (mon.0) 1331 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "32"}]: dispatch 2024-02-19T21:44:54.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:53.064658+0000 osd.0 (osd.0) 188 : cluster [DBG] 4.16 scrub starts 2024-02-19T21:44:54.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:53.072739+0000 osd.0 (osd.0) 189 : cluster [DBG] 4.16 scrub ok 2024-02-19T21:44:54.074 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 22 16 47894 47878 136.006 100.25 0.00709093 0.00734873 2024-02-19T21:44:54.556 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:44:54.558 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:54.559 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:44:54.582 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:44:54.660 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:44:54.703 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:55.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:53.054399+0000 mgr.y (mgr.14514) 475 : cluster [DBG] pgmap v593: 128 pgs: 128 active+clean; 2.5 GiB data, 9.5 GiB used, 616 GiB / 626 GiB avail; 645 B/s rd, 90 MiB/s wr, 1.43k op/s 2024-02-19T21:44:55.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:53.731900+0000 mon.a (mon.0) 1332 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "32"}]': finished 2024-02-19T21:44:55.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:53.731980+0000 mon.a (mon.0) 1333 : cluster [DBG] osdmap e301: 8 total, 8 up, 7 in 2024-02-19T21:44:55.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:54.023511+0000 osd.0 (osd.0) 190 : cluster [DBG] 4.b scrub starts 2024-02-19T21:44:55.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:54.025804+0000 osd.0 (osd.0) 191 : cluster [DBG] 4.b scrub ok 2024-02-19T21:44:55.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:54.099438+0000 osd.6 (osd.6) 165 : cluster [DBG] 6.c scrub starts 2024-02-19T21:44:55.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:54.104910+0000 osd.6 (osd.6) 166 : cluster [DBG] 6.c scrub ok 2024-02-19T21:44:55.073 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 23 16 49476 49460 134.391 98.875 0.00569872 0.00743591 2024-02-19T21:44:55.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:53.054399+0000 mgr.y (mgr.14514) 475 : cluster [DBG] pgmap v593: 128 pgs: 128 active+clean; 2.5 GiB data, 9.5 GiB used, 616 GiB / 626 GiB avail; 645 B/s rd, 90 MiB/s wr, 1.43k op/s 2024-02-19T21:44:55.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:53.731900+0000 mon.a (mon.0) 1332 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "32"}]': finished 2024-02-19T21:44:55.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:53.731980+0000 mon.a (mon.0) 1333 : cluster [DBG] osdmap e301: 8 total, 8 up, 7 in 2024-02-19T21:44:55.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:54.023511+0000 osd.0 (osd.0) 190 : cluster [DBG] 4.b scrub starts 2024-02-19T21:44:55.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:54.025804+0000 osd.0 (osd.0) 191 : cluster [DBG] 4.b scrub ok 2024-02-19T21:44:55.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:54.099438+0000 osd.6 (osd.6) 165 : cluster [DBG] 6.c scrub starts 2024-02-19T21:44:55.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:54.104910+0000 osd.6 (osd.6) 166 : cluster [DBG] 6.c scrub ok 2024-02-19T21:44:55.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:53.054399+0000 mgr.y (mgr.14514) 475 : cluster [DBG] pgmap v593: 128 pgs: 128 active+clean; 2.5 GiB data, 9.5 GiB used, 616 GiB / 626 GiB avail; 645 B/s rd, 90 MiB/s wr, 1.43k op/s 2024-02-19T21:44:55.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:53.731900+0000 mon.a (mon.0) 1332 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num", "val": "32"}]': finished 2024-02-19T21:44:55.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:53.731980+0000 mon.a (mon.0) 1333 : cluster [DBG] osdmap e301: 8 total, 8 up, 7 in 2024-02-19T21:44:55.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:54.023511+0000 osd.0 (osd.0) 190 : cluster [DBG] 4.b scrub starts 2024-02-19T21:44:55.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:54.025804+0000 osd.0 (osd.0) 191 : cluster [DBG] 4.b scrub ok 2024-02-19T21:44:55.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:54.099438+0000 osd.6 (osd.6) 165 : cluster [DBG] 6.c scrub starts 2024-02-19T21:44:55.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:54.104910+0000 osd.6 (osd.6) 166 : cluster [DBG] 6.c scrub ok 2024-02-19T21:44:55.563 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:44:55.568 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:55.569 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:44:55.669 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:44:55.724 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:55.739 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:44:55.759 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:44:55.764 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:55.764 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:44:55.770 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:44:55.804 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:44:55.838 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:44:55.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:55.055436+0000 osd.6 (osd.6) 167 : cluster [DBG] 4.5 scrub starts 2024-02-19T21:44:55.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:55.057185+0000 mon.a (mon.0) 1334 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "32"}]: dispatch 2024-02-19T21:44:55.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:55.061618+0000 osd.6 (osd.6) 168 : cluster [DBG] 4.5 scrub ok 2024-02-19T21:44:55.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:55.128899+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "32"}]': finished 2024-02-19T21:44:55.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:55.128950+0000 mon.a (mon.0) 1336 : cluster [DBG] osdmap e302: 8 total, 8 up, 7 in 2024-02-19T21:44:55.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:55.713401+0000 mon.a (mon.0) 1337 : audit [DBG] from='client.? 172.21.15.80:0/3710406521' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:44:55.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:55.055436+0000 osd.6 (osd.6) 167 : cluster [DBG] 4.5 scrub starts 2024-02-19T21:44:55.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:55.057185+0000 mon.a (mon.0) 1334 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "32"}]: dispatch 2024-02-19T21:44:55.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:55.061618+0000 osd.6 (osd.6) 168 : cluster [DBG] 4.5 scrub ok 2024-02-19T21:44:55.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:55.128899+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "32"}]': finished 2024-02-19T21:44:55.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:55.128950+0000 mon.a (mon.0) 1336 : cluster [DBG] osdmap e302: 8 total, 8 up, 7 in 2024-02-19T21:44:55.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:55.713401+0000 mon.a (mon.0) 1337 : audit [DBG] from='client.? 172.21.15.80:0/3710406521' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:44:55.865 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:44:55.871 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:44:55.898 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:44:55.917 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:44:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:44:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:44:55.917 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:55.055436+0000 osd.6 (osd.6) 167 : cluster [DBG] 4.5 scrub starts 2024-02-19T21:44:55.917 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:55.057185+0000 mon.a (mon.0) 1334 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "32"}]: dispatch 2024-02-19T21:44:55.918 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:55.061618+0000 osd.6 (osd.6) 168 : cluster [DBG] 4.5 scrub ok 2024-02-19T21:44:55.918 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:55.128899+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_actual", "val": "32"}]': finished 2024-02-19T21:44:55.918 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:55.128950+0000 mon.a (mon.0) 1336 : cluster [DBG] osdmap e302: 8 total, 8 up, 7 in 2024-02-19T21:44:55.918 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:55.713401+0000 mon.a (mon.0) 1337 : audit [DBG] from='client.? 172.21.15.80:0/3710406521' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:44:55.923 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:55.934 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:44:55.955 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:44:55.959 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:55.959 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:44:55.972 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:44:55.975 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:44:55.975 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:44:55.975 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:44:55.975 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:44:55.975 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:44:55.975 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:44:55.975 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:44:55.975 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:44:56.060 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:44:56.073 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 24 16 50945 50929 132.617 91.8125 0.0107481 0.00753635 2024-02-19T21:44:56.111 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:56.144 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:44:56.154 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:56.155 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:44:56.249 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.1 dump_blocked_ops 2024-02-19T21:44:56.256 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:44:56.334 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:57.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:55.054999+0000 mgr.y (mgr.14514) 476 : cluster [DBG] pgmap v595: 128 pgs: 128 active+clean; 2.7 GiB data, 10 GiB used, 615 GiB / 626 GiB avail; 639 B/s rd, 92 MiB/s wr, 1.47k op/s 2024-02-19T21:44:57.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:55.580245+0000 osd.3 (osd.3) 186 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:44:57.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:55.590344+0000 osd.3 (osd.3) 187 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:44:57.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:55.753255+0000 osd.5 (osd.5) 193 : cluster [DBG] 4.8 scrub starts 2024-02-19T21:44:57.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:55.762621+0000 osd.5 (osd.5) 194 : cluster [DBG] 4.8 scrub ok 2024-02-19T21:44:57.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:55.776803+0000 osd.1 (osd.1) 179 : cluster [DBG] 6.1 scrub starts 2024-02-19T21:44:57.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:55.803869+0000 osd.1 (osd.1) 180 : cluster [DBG] 6.1 scrub ok 2024-02-19T21:44:57.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:56.132511+0000 mon.a (mon.0) 1338 : cluster [DBG] osdmap e303: 8 total, 8 up, 7 in 2024-02-19T21:44:57.074 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 25 16 52352 52336 130.829 87.9375 0.00703132 0.00763894 2024-02-19T21:44:57.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:55.054999+0000 mgr.y (mgr.14514) 476 : cluster [DBG] pgmap v595: 128 pgs: 128 active+clean; 2.7 GiB data, 10 GiB used, 615 GiB / 626 GiB avail; 639 B/s rd, 92 MiB/s wr, 1.47k op/s 2024-02-19T21:44:57.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:55.580245+0000 osd.3 (osd.3) 186 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:44:57.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:55.590344+0000 osd.3 (osd.3) 187 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:44:57.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:55.753255+0000 osd.5 (osd.5) 193 : cluster [DBG] 4.8 scrub starts 2024-02-19T21:44:57.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:55.762621+0000 osd.5 (osd.5) 194 : cluster [DBG] 4.8 scrub ok 2024-02-19T21:44:57.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:55.776803+0000 osd.1 (osd.1) 179 : cluster [DBG] 6.1 scrub starts 2024-02-19T21:44:57.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:55.803869+0000 osd.1 (osd.1) 180 : cluster [DBG] 6.1 scrub ok 2024-02-19T21:44:57.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:56.132511+0000 mon.a (mon.0) 1338 : cluster [DBG] osdmap e303: 8 total, 8 up, 7 in 2024-02-19T21:44:57.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:55.054999+0000 mgr.y (mgr.14514) 476 : cluster [DBG] pgmap v595: 128 pgs: 128 active+clean; 2.7 GiB data, 10 GiB used, 615 GiB / 626 GiB avail; 639 B/s rd, 92 MiB/s wr, 1.47k op/s 2024-02-19T21:44:57.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:55.580245+0000 osd.3 (osd.3) 186 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:44:57.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:55.590344+0000 osd.3 (osd.3) 187 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:44:57.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:55.753255+0000 osd.5 (osd.5) 193 : cluster [DBG] 4.8 scrub starts 2024-02-19T21:44:57.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:55.762621+0000 osd.5 (osd.5) 194 : cluster [DBG] 4.8 scrub ok 2024-02-19T21:44:57.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:55.776803+0000 osd.1 (osd.1) 179 : cluster [DBG] 6.1 scrub starts 2024-02-19T21:44:57.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:55.803869+0000 osd.1 (osd.1) 180 : cluster [DBG] 6.1 scrub ok 2024-02-19T21:44:57.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:56.132511+0000 mon.a (mon.0) 1338 : cluster [DBG] osdmap e303: 8 total, 8 up, 7 in 2024-02-19T21:44:58.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:56.764015+0000 osd.5 (osd.5) 195 : cluster [DBG] 4.15 scrub starts 2024-02-19T21:44:58.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:56.766946+0000 osd.5 (osd.5) 196 : cluster [DBG] 4.15 scrub ok 2024-02-19T21:44:58.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:57.057456+0000 mon.a (mon.0) 1339 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num_actual", "val": "32"}]: dispatch 2024-02-19T21:44:58.074 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 26 16 53797 53781 129.27 90.3125 0.00549403 0.00773061 2024-02-19T21:44:58.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:56.764015+0000 osd.5 (osd.5) 195 : cluster [DBG] 4.15 scrub starts 2024-02-19T21:44:58.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:56.766946+0000 osd.5 (osd.5) 196 : cluster [DBG] 4.15 scrub ok 2024-02-19T21:44:58.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:57.057456+0000 mon.a (mon.0) 1339 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num_actual", "val": "32"}]: dispatch 2024-02-19T21:44:58.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:56.764015+0000 osd.5 (osd.5) 195 : cluster [DBG] 4.15 scrub starts 2024-02-19T21:44:58.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:56.766946+0000 osd.5 (osd.5) 196 : cluster [DBG] 4.15 scrub ok 2024-02-19T21:44:58.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:57.057456+0000 mon.a (mon.0) 1339 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num_actual", "val": "32"}]: dispatch 2024-02-19T21:44:58.109 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:44:58.113 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:44:58.113 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:44:58.214 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:44:58.260 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:44:59.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:57.055472+0000 mgr.y (mgr.14514) 477 : cluster [DBG] pgmap v598: 138 pgs: 2 peering, 10 unknown, 126 active+clean; 3.0 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 852 B/s rd, 82 MiB/s wr, 1.31k op/s 2024-02-19T21:44:59.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:57.629766+0000 osd.3 (osd.3) 188 : cluster [DBG] 4.14 scrub starts 2024-02-19T21:44:59.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:57.633323+0000 osd.3 (osd.3) 189 : cluster [DBG] 4.14 scrub ok 2024-02-19T21:44:59.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:44:57.750357+0000 mon.a (mon.0) 1340 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num_actual", "val": "32"}]': finished 2024-02-19T21:44:59.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:57.750443+0000 mon.a (mon.0) 1341 : cluster [DBG] osdmap e304: 8 total, 8 up, 7 in 2024-02-19T21:44:59.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:57.751400+0000 osd.5 (osd.5) 197 : cluster [DBG] 5.4 scrub starts 2024-02-19T21:44:59.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:57.754445+0000 osd.5 (osd.5) 198 : cluster [DBG] 5.4 scrub ok 2024-02-19T21:44:59.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:58.006458+0000 osd.6 (osd.6) 169 : cluster [DBG] 4.e scrub starts 2024-02-19T21:44:59.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:58.015499+0000 osd.6 (osd.6) 170 : cluster [DBG] 4.e scrub ok 2024-02-19T21:44:59.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:58.039625+0000 osd.0 (osd.0) 192 : cluster [DBG] 5.8 scrub starts 2024-02-19T21:44:59.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:58.047552+0000 osd.0 (osd.0) 193 : cluster [DBG] 5.8 scrub ok 2024-02-19T21:44:59.074 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 27 16 55125 55109 127.556 83 0.0114894 0.00782799 2024-02-19T21:44:59.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:57.055472+0000 mgr.y (mgr.14514) 477 : cluster [DBG] pgmap v598: 138 pgs: 2 peering, 10 unknown, 126 active+clean; 3.0 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 852 B/s rd, 82 MiB/s wr, 1.31k op/s 2024-02-19T21:44:59.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:57.629766+0000 osd.3 (osd.3) 188 : cluster [DBG] 4.14 scrub starts 2024-02-19T21:44:59.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:57.633323+0000 osd.3 (osd.3) 189 : cluster [DBG] 4.14 scrub ok 2024-02-19T21:44:59.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:44:57.750357+0000 mon.a (mon.0) 1340 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num_actual", "val": "32"}]': finished 2024-02-19T21:44:59.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:57.750443+0000 mon.a (mon.0) 1341 : cluster [DBG] osdmap e304: 8 total, 8 up, 7 in 2024-02-19T21:44:59.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:57.751400+0000 osd.5 (osd.5) 197 : cluster [DBG] 5.4 scrub starts 2024-02-19T21:44:59.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:57.754445+0000 osd.5 (osd.5) 198 : cluster [DBG] 5.4 scrub ok 2024-02-19T21:44:59.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:58.006458+0000 osd.6 (osd.6) 169 : cluster [DBG] 4.e scrub starts 2024-02-19T21:44:59.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:58.015499+0000 osd.6 (osd.6) 170 : cluster [DBG] 4.e scrub ok 2024-02-19T21:44:59.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:58.039625+0000 osd.0 (osd.0) 192 : cluster [DBG] 5.8 scrub starts 2024-02-19T21:44:59.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:58.047552+0000 osd.0 (osd.0) 193 : cluster [DBG] 5.8 scrub ok 2024-02-19T21:44:59.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:57.055472+0000 mgr.y (mgr.14514) 477 : cluster [DBG] pgmap v598: 138 pgs: 2 peering, 10 unknown, 126 active+clean; 3.0 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 852 B/s rd, 82 MiB/s wr, 1.31k op/s 2024-02-19T21:44:59.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:57.629766+0000 osd.3 (osd.3) 188 : cluster [DBG] 4.14 scrub starts 2024-02-19T21:44:59.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:57.633323+0000 osd.3 (osd.3) 189 : cluster [DBG] 4.14 scrub ok 2024-02-19T21:44:59.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:44:57.750357+0000 mon.a (mon.0) 1340 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num_actual", "val": "32"}]': finished 2024-02-19T21:44:59.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:57.750443+0000 mon.a (mon.0) 1341 : cluster [DBG] osdmap e304: 8 total, 8 up, 7 in 2024-02-19T21:44:59.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:57.751400+0000 osd.5 (osd.5) 197 : cluster [DBG] 5.4 scrub starts 2024-02-19T21:44:59.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:57.754445+0000 osd.5 (osd.5) 198 : cluster [DBG] 5.4 scrub ok 2024-02-19T21:44:59.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:58.006458+0000 osd.6 (osd.6) 169 : cluster [DBG] 4.e scrub starts 2024-02-19T21:44:59.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:58.015499+0000 osd.6 (osd.6) 170 : cluster [DBG] 4.e scrub ok 2024-02-19T21:44:59.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:58.039625+0000 osd.0 (osd.0) 192 : cluster [DBG] 5.8 scrub starts 2024-02-19T21:44:59.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:58.047552+0000 osd.0 (osd.0) 193 : cluster [DBG] 5.8 scrub ok 2024-02-19T21:45:00.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:58.774463+0000 mon.a (mon.0) 1342 : cluster [DBG] osdmap e305: 8 total, 8 up, 7 in 2024-02-19T21:45:00.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:44:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:59.619734+0000 osd.7 (osd.7) 181 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:45:00.074 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 28 16 56514 56498 126.101 86.8125 0.00692803 0.00792601 2024-02-19T21:45:00.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:58.774463+0000 mon.a (mon.0) 1342 : cluster [DBG] osdmap e305: 8 total, 8 up, 7 in 2024-02-19T21:45:00.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:44:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:59.619734+0000 osd.7 (osd.7) 181 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:45:00.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:58.774463+0000 mon.a (mon.0) 1342 : cluster [DBG] osdmap e305: 8 total, 8 up, 7 in 2024-02-19T21:45:00.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:44:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:59.619734+0000 osd.7 (osd.7) 181 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:45:00.270 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 6, 7] out_osds: [2] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:45:00.271 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:45:00.271 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-02-19T21:45:00.271 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd dump -f json-pretty 2024-02-19T21:45:01.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:59.055898+0000 mgr.y (mgr.14514) 478 : cluster [DBG] pgmap v601: 138 pgs: 2 peering, 10 unknown, 126 active+clean; 3.0 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1.2 KiB/s rd, 77 MiB/s wr, 1.24k op/s 2024-02-19T21:45:01.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:59.684964+0000 osd.7 (osd.7) 182 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:45:01.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:59.788442+0000 mon.a (mon.0) 1343 : cluster [DBG] osdmap e306: 8 total, 8 up, 7 in 2024-02-19T21:45:01.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:59.794400+0000 osd.0 (osd.0) 194 : cluster [DBG] 6.18 starting backfill to osd.1 from (0'0,0'0] MAX to 66'1 2024-02-19T21:45:01.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:59.794528+0000 osd.0 (osd.0) 195 : cluster [DBG] 6.18 starting backfill to osd.7 from (0'0,0'0] MAX to 66'1 2024-02-19T21:45:01.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:44:59.798174+0000 osd.7 (osd.7) 183 : cluster [DBG] 6.1c starting backfill to osd.3 from (0'0,0'0] MAX to 66'1 2024-02-19T21:45:01.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:00.125525+0000 mon.a (mon.0) 1344 : cluster [DBG] osdmap e307: 8 total, 8 up, 7 in 2024-02-19T21:45:01.059 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:45:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:45:01.074 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 29 16 57507 57491 123.892 62.0625 0.0107669 0.00806703 2024-02-19T21:45:01.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:59.055898+0000 mgr.y (mgr.14514) 478 : cluster [DBG] pgmap v601: 138 pgs: 2 peering, 10 unknown, 126 active+clean; 3.0 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1.2 KiB/s rd, 77 MiB/s wr, 1.24k op/s 2024-02-19T21:45:01.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:59.684964+0000 osd.7 (osd.7) 182 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:45:01.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:59.788442+0000 mon.a (mon.0) 1343 : cluster [DBG] osdmap e306: 8 total, 8 up, 7 in 2024-02-19T21:45:01.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:59.794400+0000 osd.0 (osd.0) 194 : cluster [DBG] 6.18 starting backfill to osd.1 from (0'0,0'0] MAX to 66'1 2024-02-19T21:45:01.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:59.794528+0000 osd.0 (osd.0) 195 : cluster [DBG] 6.18 starting backfill to osd.7 from (0'0,0'0] MAX to 66'1 2024-02-19T21:45:01.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:44:59.798174+0000 osd.7 (osd.7) 183 : cluster [DBG] 6.1c starting backfill to osd.3 from (0'0,0'0] MAX to 66'1 2024-02-19T21:45:01.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:00.125525+0000 mon.a (mon.0) 1344 : cluster [DBG] osdmap e307: 8 total, 8 up, 7 in 2024-02-19T21:45:01.097 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:45:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:45:00] "GET /metrics HTTP/1.1" 200 176099 "" "Prometheus/2.33.4" 2024-02-19T21:45:01.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:59.055898+0000 mgr.y (mgr.14514) 478 : cluster [DBG] pgmap v601: 138 pgs: 2 peering, 10 unknown, 126 active+clean; 3.0 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1.2 KiB/s rd, 77 MiB/s wr, 1.24k op/s 2024-02-19T21:45:01.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:59.684964+0000 osd.7 (osd.7) 182 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:45:01.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:59.788442+0000 mon.a (mon.0) 1343 : cluster [DBG] osdmap e306: 8 total, 8 up, 7 in 2024-02-19T21:45:01.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:59.794400+0000 osd.0 (osd.0) 194 : cluster [DBG] 6.18 starting backfill to osd.1 from (0'0,0'0] MAX to 66'1 2024-02-19T21:45:01.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:59.794528+0000 osd.0 (osd.0) 195 : cluster [DBG] 6.18 starting backfill to osd.7 from (0'0,0'0] MAX to 66'1 2024-02-19T21:45:01.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:44:59.798174+0000 osd.7 (osd.7) 183 : cluster [DBG] 6.1c starting backfill to osd.3 from (0'0,0'0] MAX to 66'1 2024-02-19T21:45:01.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:00.125525+0000 mon.a (mon.0) 1344 : cluster [DBG] osdmap e307: 8 total, 8 up, 7 in 2024-02-19T21:45:02.074 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 30 16 58812 58796 122.481 81.5625 0.00377857 0.00816035 2024-02-19T21:45:02.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:00.554263+0000 mgr.y (mgr.14514) 479 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:45:02.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:00.640989+0000 osd.7 (osd.7) 184 : cluster [DBG] 2.1d scrub starts 2024-02-19T21:45:02.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:00.643877+0000 osd.7 (osd.7) 185 : cluster [DBG] 2.1d scrub ok 2024-02-19T21:45:02.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:00.742849+0000 osd.5 (osd.5) 199 : cluster [DBG] 2.c scrub starts 2024-02-19T21:45:02.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:00.748237+0000 osd.5 (osd.5) 200 : cluster [DBG] 2.c scrub ok 2024-02-19T21:45:02.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:00.764341+0000 osd.1 (osd.1) 181 : cluster [DBG] 2.a scrub starts 2024-02-19T21:45:02.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:00.765442+0000 osd.1 (osd.1) 182 : cluster [DBG] 2.a scrub ok 2024-02-19T21:45:02.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:01.133300+0000 mon.a (mon.0) 1345 : cluster [DBG] osdmap e308: 8 total, 8 up, 7 in 2024-02-19T21:45:02.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:00.554263+0000 mgr.y (mgr.14514) 479 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:45:02.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:00.640989+0000 osd.7 (osd.7) 184 : cluster [DBG] 2.1d scrub starts 2024-02-19T21:45:02.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:00.643877+0000 osd.7 (osd.7) 185 : cluster [DBG] 2.1d scrub ok 2024-02-19T21:45:02.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:00.742849+0000 osd.5 (osd.5) 199 : cluster [DBG] 2.c scrub starts 2024-02-19T21:45:02.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:00.748237+0000 osd.5 (osd.5) 200 : cluster [DBG] 2.c scrub ok 2024-02-19T21:45:02.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:00.764341+0000 osd.1 (osd.1) 181 : cluster [DBG] 2.a scrub starts 2024-02-19T21:45:02.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:00.765442+0000 osd.1 (osd.1) 182 : cluster [DBG] 2.a scrub ok 2024-02-19T21:45:02.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:01.133300+0000 mon.a (mon.0) 1345 : cluster [DBG] osdmap e308: 8 total, 8 up, 7 in 2024-02-19T21:45:02.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:00.554263+0000 mgr.y (mgr.14514) 479 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:45:02.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:00.640989+0000 osd.7 (osd.7) 184 : cluster [DBG] 2.1d scrub starts 2024-02-19T21:45:02.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:00.643877+0000 osd.7 (osd.7) 185 : cluster [DBG] 2.1d scrub ok 2024-02-19T21:45:02.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:00.742849+0000 osd.5 (osd.5) 199 : cluster [DBG] 2.c scrub starts 2024-02-19T21:45:02.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:00.748237+0000 osd.5 (osd.5) 200 : cluster [DBG] 2.c scrub ok 2024-02-19T21:45:02.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:00.764341+0000 osd.1 (osd.1) 181 : cluster [DBG] 2.a scrub starts 2024-02-19T21:45:02.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:00.765442+0000 osd.1 (osd.1) 182 : cluster [DBG] 2.a scrub ok 2024-02-19T21:45:02.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:01.133300+0000 mon.a (mon.0) 1345 : cluster [DBG] osdmap e308: 8 total, 8 up, 7 in 2024-02-19T21:45:03.074 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 31 16 60170 60154 121.268 84.875 0.00610012 0.0082421 2024-02-19T21:45:03.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:01.056451+0000 mgr.y (mgr.14514) 480 : cluster [DBG] pgmap v604: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfilling, 136 active+clean; 3.4 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 1.2 KiB/s rd, 109 MiB/s wr, 1.75k op/s; 3/170061 objects misplaced (0.002%); 90 B/s, 0 objects/s recovering 2024-02-19T21:45:03.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:01.566788+0000 osd.3 (osd.3) 190 : cluster [DBG] 4.c scrub starts 2024-02-19T21:45:03.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:01.568499+0000 osd.3 (osd.3) 191 : cluster [DBG] 4.c scrub ok 2024-02-19T21:45:03.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:01.713363+0000 osd.5 (osd.5) 201 : cluster [DBG] 5.f scrub starts 2024-02-19T21:45:03.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:01.716813+0000 osd.5 (osd.5) 202 : cluster [DBG] 5.f scrub ok 2024-02-19T21:45:03.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:01.791733+0000 mon.a (mon.0) 1346 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:45:03.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:01.797325+0000 osd.1 (osd.1) 183 : cluster [DBG] 5.c scrub starts 2024-02-19T21:45:03.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:01.798380+0000 osd.1 (osd.1) 184 : cluster [DBG] 5.c scrub ok 2024-02-19T21:45:03.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:02.082120+0000 osd.0 (osd.0) 196 : cluster [DBG] 4.1f scrub starts 2024-02-19T21:45:03.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:02.090418+0000 osd.0 (osd.0) 197 : cluster [DBG] 4.1f scrub ok 2024-02-19T21:45:03.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:01.056451+0000 mgr.y (mgr.14514) 480 : cluster [DBG] pgmap v604: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfilling, 136 active+clean; 3.4 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 1.2 KiB/s rd, 109 MiB/s wr, 1.75k op/s; 3/170061 objects misplaced (0.002%); 90 B/s, 0 objects/s recovering 2024-02-19T21:45:03.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:01.566788+0000 osd.3 (osd.3) 190 : cluster [DBG] 4.c scrub starts 2024-02-19T21:45:03.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:01.568499+0000 osd.3 (osd.3) 191 : cluster [DBG] 4.c scrub ok 2024-02-19T21:45:03.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:01.713363+0000 osd.5 (osd.5) 201 : cluster [DBG] 5.f scrub starts 2024-02-19T21:45:03.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:01.716813+0000 osd.5 (osd.5) 202 : cluster [DBG] 5.f scrub ok 2024-02-19T21:45:03.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:01.791733+0000 mon.a (mon.0) 1346 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:45:03.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:01.797325+0000 osd.1 (osd.1) 183 : cluster [DBG] 5.c scrub starts 2024-02-19T21:45:03.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:01.798380+0000 osd.1 (osd.1) 184 : cluster [DBG] 5.c scrub ok 2024-02-19T21:45:03.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:02.082120+0000 osd.0 (osd.0) 196 : cluster [DBG] 4.1f scrub starts 2024-02-19T21:45:03.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:02.090418+0000 osd.0 (osd.0) 197 : cluster [DBG] 4.1f scrub ok 2024-02-19T21:45:03.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:01.056451+0000 mgr.y (mgr.14514) 480 : cluster [DBG] pgmap v604: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfilling, 136 active+clean; 3.4 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 1.2 KiB/s rd, 109 MiB/s wr, 1.75k op/s; 3/170061 objects misplaced (0.002%); 90 B/s, 0 objects/s recovering 2024-02-19T21:45:03.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:01.566788+0000 osd.3 (osd.3) 190 : cluster [DBG] 4.c scrub starts 2024-02-19T21:45:03.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:01.568499+0000 osd.3 (osd.3) 191 : cluster [DBG] 4.c scrub ok 2024-02-19T21:45:03.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:01.713363+0000 osd.5 (osd.5) 201 : cluster [DBG] 5.f scrub starts 2024-02-19T21:45:03.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:01.716813+0000 osd.5 (osd.5) 202 : cluster [DBG] 5.f scrub ok 2024-02-19T21:45:03.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:01.791733+0000 mon.a (mon.0) 1346 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:45:03.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:01.797325+0000 osd.1 (osd.1) 183 : cluster [DBG] 5.c scrub starts 2024-02-19T21:45:03.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:01.798380+0000 osd.1 (osd.1) 184 : cluster [DBG] 5.c scrub ok 2024-02-19T21:45:03.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:02.082120+0000 osd.0 (osd.0) 196 : cluster [DBG] 4.1f scrub starts 2024-02-19T21:45:03.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:02.090418+0000 osd.0 (osd.0) 197 : cluster [DBG] 4.1f scrub ok 2024-02-19T21:45:04.075 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 32 16 61352 61336 119.787 73.875 0.0070347 0.00834309 2024-02-19T21:45:04.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:02.156177+0000 osd.4 (osd.4) 152 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:45:04.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:02.186747+0000 osd.4 (osd.4) 153 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:45:04.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:02.740934+0000 osd.5 (osd.5) 203 : cluster [DBG] 5.15 scrub starts 2024-02-19T21:45:04.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:02.745641+0000 osd.5 (osd.5) 204 : cluster [DBG] 5.15 scrub ok 2024-02-19T21:45:04.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:02.156177+0000 osd.4 (osd.4) 152 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:45:04.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:02.186747+0000 osd.4 (osd.4) 153 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:45:04.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:02.740934+0000 osd.5 (osd.5) 203 : cluster [DBG] 5.15 scrub starts 2024-02-19T21:45:04.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:02.745641+0000 osd.5 (osd.5) 204 : cluster [DBG] 5.15 scrub ok 2024-02-19T21:45:04.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:02.156177+0000 osd.4 (osd.4) 152 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:45:04.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:02.186747+0000 osd.4 (osd.4) 153 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:45:04.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:02.740934+0000 osd.5 (osd.5) 203 : cluster [DBG] 5.15 scrub starts 2024-02-19T21:45:04.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:02.745641+0000 osd.5 (osd.5) 204 : cluster [DBG] 5.15 scrub ok 2024-02-19T21:45:05.074 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 33 16 62556 62540 118.437 75.25 0.00890193 0.00843842 2024-02-19T21:45:05.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:03.056896+0000 mgr.y (mgr.14514) 481 : cluster [DBG] pgmap v606: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfilling, 136 active+clean; 3.4 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 1.2 KiB/s rd, 102 MiB/s wr, 1.63k op/s; 3/170061 objects misplaced (0.002%); 84 B/s, 0 objects/s recovering 2024-02-19T21:45:05.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:03.121638+0000 osd.4 (osd.4) 154 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:45:05.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:03.152258+0000 osd.4 (osd.4) 155 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:45:05.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:03.574282+0000 osd.3 (osd.3) 192 : cluster [DBG] 6.8 scrub starts 2024-02-19T21:45:05.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:03.607104+0000 osd.3 (osd.3) 193 : cluster [DBG] 6.8 scrub ok 2024-02-19T21:45:05.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:03.959185+0000 mon.a (mon.0) 1347 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:45:05.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:03.056896+0000 mgr.y (mgr.14514) 481 : cluster [DBG] pgmap v606: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfilling, 136 active+clean; 3.4 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 1.2 KiB/s rd, 102 MiB/s wr, 1.63k op/s; 3/170061 objects misplaced (0.002%); 84 B/s, 0 objects/s recovering 2024-02-19T21:45:05.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:03.121638+0000 osd.4 (osd.4) 154 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:45:05.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:03.152258+0000 osd.4 (osd.4) 155 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:45:05.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:03.574282+0000 osd.3 (osd.3) 192 : cluster [DBG] 6.8 scrub starts 2024-02-19T21:45:05.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:03.607104+0000 osd.3 (osd.3) 193 : cluster [DBG] 6.8 scrub ok 2024-02-19T21:45:05.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:03.959185+0000 mon.a (mon.0) 1347 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:45:05.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:03.056896+0000 mgr.y (mgr.14514) 481 : cluster [DBG] pgmap v606: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+remapped+backfilling, 136 active+clean; 3.4 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 1.2 KiB/s rd, 102 MiB/s wr, 1.63k op/s; 3/170061 objects misplaced (0.002%); 84 B/s, 0 objects/s recovering 2024-02-19T21:45:05.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:03.121638+0000 osd.4 (osd.4) 154 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:45:05.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:03.152258+0000 osd.4 (osd.4) 155 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:45:05.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:03.574282+0000 osd.3 (osd.3) 192 : cluster [DBG] 6.8 scrub starts 2024-02-19T21:45:05.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:03.607104+0000 osd.3 (osd.3) 193 : cluster [DBG] 6.8 scrub ok 2024-02-19T21:45:05.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:03.959185+0000 mon.a (mon.0) 1347 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:45:06.057 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:45:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:45:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:45:06.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:04.631001+0000 osd.3 (osd.3) 194 : cluster [DBG] 6.b scrub starts 2024-02-19T21:45:06.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:04.692799+0000 osd.3 (osd.3) 195 : cluster [DBG] 6.b scrub ok 2024-02-19T21:45:06.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:04.747375+0000 osd.1 (osd.1) 185 : cluster [DBG] 4.4 scrub starts 2024-02-19T21:45:06.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:04.755436+0000 osd.1 (osd.1) 186 : cluster [DBG] 4.4 scrub ok 2024-02-19T21:45:06.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:04.827540+0000 osd.5 (osd.5) 205 : cluster [DBG] 3.2 scrub starts 2024-02-19T21:45:06.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:04.833406+0000 osd.5 (osd.5) 206 : cluster [DBG] 3.2 scrub ok 2024-02-19T21:45:06.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:05.074692+0000 osd.0 (osd.0) 198 : cluster [DBG] 4.0 scrub starts 2024-02-19T21:45:06.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:05.077049+0000 osd.0 (osd.0) 199 : cluster [DBG] 4.0 scrub ok 2024-02-19T21:45:06.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:05.589388+0000 osd.7 (osd.7) 186 : cluster [DBG] 6.15 scrub starts 2024-02-19T21:45:06.074 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 34 16 63802 63786 117.244 77.875 0.0158283 0.00852433 2024-02-19T21:45:06.323 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:04.631001+0000 osd.3 (osd.3) 194 : cluster [DBG] 6.b scrub starts 2024-02-19T21:45:06.323 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:04.692799+0000 osd.3 (osd.3) 195 : cluster [DBG] 6.b scrub ok 2024-02-19T21:45:06.323 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:04.747375+0000 osd.1 (osd.1) 185 : cluster [DBG] 4.4 scrub starts 2024-02-19T21:45:06.324 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:04.755436+0000 osd.1 (osd.1) 186 : cluster [DBG] 4.4 scrub ok 2024-02-19T21:45:06.324 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:04.827540+0000 osd.5 (osd.5) 205 : cluster [DBG] 3.2 scrub starts 2024-02-19T21:45:06.324 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:04.833406+0000 osd.5 (osd.5) 206 : cluster [DBG] 3.2 scrub ok 2024-02-19T21:45:06.324 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:05.074692+0000 osd.0 (osd.0) 198 : cluster [DBG] 4.0 scrub starts 2024-02-19T21:45:06.324 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:05.077049+0000 osd.0 (osd.0) 199 : cluster [DBG] 4.0 scrub ok 2024-02-19T21:45:06.324 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:05.589388+0000 osd.7 (osd.7) 186 : cluster [DBG] 6.15 scrub starts 2024-02-19T21:45:06.324 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:04.631001+0000 osd.3 (osd.3) 194 : cluster [DBG] 6.b scrub starts 2024-02-19T21:45:06.324 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:04.692799+0000 osd.3 (osd.3) 195 : cluster [DBG] 6.b scrub ok 2024-02-19T21:45:06.324 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:04.747375+0000 osd.1 (osd.1) 185 : cluster [DBG] 4.4 scrub starts 2024-02-19T21:45:06.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:04.755436+0000 osd.1 (osd.1) 186 : cluster [DBG] 4.4 scrub ok 2024-02-19T21:45:06.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:04.827540+0000 osd.5 (osd.5) 205 : cluster [DBG] 3.2 scrub starts 2024-02-19T21:45:06.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:04.833406+0000 osd.5 (osd.5) 206 : cluster [DBG] 3.2 scrub ok 2024-02-19T21:45:06.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:05.074692+0000 osd.0 (osd.0) 198 : cluster [DBG] 4.0 scrub starts 2024-02-19T21:45:06.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:05.077049+0000 osd.0 (osd.0) 199 : cluster [DBG] 4.0 scrub ok 2024-02-19T21:45:06.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:05.589388+0000 osd.7 (osd.7) 186 : cluster [DBG] 6.15 scrub starts 2024-02-19T21:45:07.074 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 35 16 65126 65110 116.258 82.75 0.0132715 0.00859682 2024-02-19T21:45:07.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:05.057459+0000 mgr.y (mgr.14514) 482 : cluster [DBG] pgmap v607: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 3.6 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 853 B/s rd, 96 MiB/s wr, 1.54k op/s; 2/176835 objects misplaced (0.001%); 60 B/s, 0 objects/s recovering 2024-02-19T21:45:07.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:05.670579+0000 osd.7 (osd.7) 187 : cluster [DBG] 6.15 scrub ok 2024-02-19T21:45:07.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:05.716562+0000 osd.1 (osd.1) 187 : cluster [DBG] 5.14 scrub starts 2024-02-19T21:45:07.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:05.721701+0000 osd.1 (osd.1) 188 : cluster [DBG] 5.14 scrub ok 2024-02-19T21:45:07.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:05.057459+0000 mgr.y (mgr.14514) 482 : cluster [DBG] pgmap v607: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 3.6 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 853 B/s rd, 96 MiB/s wr, 1.54k op/s; 2/176835 objects misplaced (0.001%); 60 B/s, 0 objects/s recovering 2024-02-19T21:45:07.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:05.670579+0000 osd.7 (osd.7) 187 : cluster [DBG] 6.15 scrub ok 2024-02-19T21:45:07.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:05.716562+0000 osd.1 (osd.1) 187 : cluster [DBG] 5.14 scrub starts 2024-02-19T21:45:07.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:05.721701+0000 osd.1 (osd.1) 188 : cluster [DBG] 5.14 scrub ok 2024-02-19T21:45:07.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:05.057459+0000 mgr.y (mgr.14514) 482 : cluster [DBG] pgmap v607: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 3.6 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 853 B/s rd, 96 MiB/s wr, 1.54k op/s; 2/176835 objects misplaced (0.001%); 60 B/s, 0 objects/s recovering 2024-02-19T21:45:07.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:05.670579+0000 osd.7 (osd.7) 187 : cluster [DBG] 6.15 scrub ok 2024-02-19T21:45:07.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:05.716562+0000 osd.1 (osd.1) 187 : cluster [DBG] 5.14 scrub starts 2024-02-19T21:45:07.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:05.721701+0000 osd.1 (osd.1) 188 : cluster [DBG] 5.14 scrub ok 2024-02-19T21:45:07.456 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:45:07.472 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:45:07.474 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:07.474 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:45:07.575 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:45:07.656 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:07.765 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:45:07.770 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:07.770 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:45:07.871 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:45:07.922 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:07.922 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-02-19T21:45:08.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:06.523613+0000 osd.3 (osd.3) 196 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:45:08.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:06.621803+0000 osd.3 (osd.3) 197 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:45:08.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:07.781347+0000 mon.b (mon.1) 52 : audit [INF] from='client.? 172.21.15.80:0/3714236656' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:45:08.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:07.782492+0000 mon.a (mon.0) 1348 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:45:08.044 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:06.523613+0000 osd.3 (osd.3) 196 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:45:08.044 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:06.621803+0000 osd.3 (osd.3) 197 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:45:08.044 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:07.781347+0000 mon.b (mon.1) 52 : audit [INF] from='client.? 172.21.15.80:0/3714236656' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:45:08.044 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:07.782492+0000 mon.a (mon.0) 1348 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:45:08.074 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 36 16 66350 66334 115.153 76.5 0.00791693 0.00867996 2024-02-19T21:45:08.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:06.523613+0000 osd.3 (osd.3) 196 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:45:08.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:06.621803+0000 osd.3 (osd.3) 197 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:45:08.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:07.781347+0000 mon.b (mon.1) 52 : audit [INF] from='client.? 172.21.15.80:0/3714236656' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:45:08.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:07.782492+0000 mon.a (mon.0) 1348 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:45:08.790 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:45:08.971 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:07.058286+0000 mgr.y (mgr.14514) 483 : cluster [DBG] pgmap v608: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 3.8 GiB data, 13 GiB used, 612 GiB / 626 GiB avail; 1.4 KiB/s rd, 112 MiB/s wr, 1.79k op/s; 2/188190 objects misplaced (0.001%); 48 B/s, 0 objects/s recovering 2024-02-19T21:45:08.971 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:07.119126+0000 osd.0 (osd.0) 200 : cluster [DBG] 5.3 scrub starts 2024-02-19T21:45:08.971 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:07.121963+0000 osd.0 (osd.0) 201 : cluster [DBG] 5.3 scrub ok 2024-02-19T21:45:08.971 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:07.855428+0000 mon.a (mon.0) 1349 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:45:08.971 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:07.891737+0000 mon.a (mon.0) 1350 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:45:08.971 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:07.891797+0000 mon.a (mon.0) 1351 : cluster [DBG] osdmap e309: 8 total, 8 up, 7 in 2024-02-19T21:45:08.971 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:07.897122+0000 osd.5 (osd.5) 207 : cluster [DBG] 2.3 scrub starts 2024-02-19T21:45:08.971 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:07.901198+0000 osd.5 (osd.5) 208 : cluster [DBG] 2.3 scrub ok 2024-02-19T21:45:08.971 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:08.491639+0000 osd.7 (osd.7) 188 : cluster [DBG] 2.8 scrub starts 2024-02-19T21:45:08.971 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:08.496559+0000 osd.7 (osd.7) 189 : cluster [DBG] 2.8 scrub ok 2024-02-19T21:45:08.972 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:07.058286+0000 mgr.y (mgr.14514) 483 : cluster [DBG] pgmap v608: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 3.8 GiB data, 13 GiB used, 612 GiB / 626 GiB avail; 1.4 KiB/s rd, 112 MiB/s wr, 1.79k op/s; 2/188190 objects misplaced (0.001%); 48 B/s, 0 objects/s recovering 2024-02-19T21:45:08.972 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:07.119126+0000 osd.0 (osd.0) 200 : cluster [DBG] 5.3 scrub starts 2024-02-19T21:45:08.972 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:07.121963+0000 osd.0 (osd.0) 201 : cluster [DBG] 5.3 scrub ok 2024-02-19T21:45:08.972 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:07.855428+0000 mon.a (mon.0) 1349 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:45:08.972 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:07.891737+0000 mon.a (mon.0) 1350 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:45:08.972 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:07.891797+0000 mon.a (mon.0) 1351 : cluster [DBG] osdmap e309: 8 total, 8 up, 7 in 2024-02-19T21:45:08.972 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:07.897122+0000 osd.5 (osd.5) 207 : cluster [DBG] 2.3 scrub starts 2024-02-19T21:45:08.972 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:07.901198+0000 osd.5 (osd.5) 208 : cluster [DBG] 2.3 scrub ok 2024-02-19T21:45:08.972 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:08.491639+0000 osd.7 (osd.7) 188 : cluster [DBG] 2.8 scrub starts 2024-02-19T21:45:08.972 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:08.496559+0000 osd.7 (osd.7) 189 : cluster [DBG] 2.8 scrub ok 2024-02-19T21:45:08.989 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:45:09.003 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:09.004 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:45:09.011 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:45:09.074 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 37 16 67613 67597 114.174 78.9375 0.0124565 0.00875435 2024-02-19T21:45:09.105 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:45:09.165 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:09.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:07.058286+0000 mgr.y (mgr.14514) 483 : cluster [DBG] pgmap v608: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 3.8 GiB data, 13 GiB used, 612 GiB / 626 GiB avail; 1.4 KiB/s rd, 112 MiB/s wr, 1.79k op/s; 2/188190 objects misplaced (0.001%); 48 B/s, 0 objects/s recovering 2024-02-19T21:45:09.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:07.119126+0000 osd.0 (osd.0) 200 : cluster [DBG] 5.3 scrub starts 2024-02-19T21:45:09.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:07.121963+0000 osd.0 (osd.0) 201 : cluster [DBG] 5.3 scrub ok 2024-02-19T21:45:09.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:07.855428+0000 mon.a (mon.0) 1349 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:45:09.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:07.891737+0000 mon.a (mon.0) 1350 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:45:09.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:07.891797+0000 mon.a (mon.0) 1351 : cluster [DBG] osdmap e309: 8 total, 8 up, 7 in 2024-02-19T21:45:09.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:07.897122+0000 osd.5 (osd.5) 207 : cluster [DBG] 2.3 scrub starts 2024-02-19T21:45:09.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:07.901198+0000 osd.5 (osd.5) 208 : cluster [DBG] 2.3 scrub ok 2024-02-19T21:45:09.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:08.491639+0000 osd.7 (osd.7) 188 : cluster [DBG] 2.8 scrub starts 2024-02-19T21:45:09.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:08.496559+0000 osd.7 (osd.7) 189 : cluster [DBG] 2.8 scrub ok 2024-02-19T21:45:09.923 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:45:09.930 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:09.931 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:45:10.032 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:45:10.071 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:08.669757+0000 osd.1 (osd.1) 189 : cluster [DBG] 4.12 scrub starts 2024-02-19T21:45:10.071 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:08.678659+0000 osd.1 (osd.1) 190 : cluster [DBG] 4.12 scrub ok 2024-02-19T21:45:10.071 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:08.669757+0000 osd.1 (osd.1) 189 : cluster [DBG] 4.12 scrub starts 2024-02-19T21:45:10.072 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:08.678659+0000 osd.1 (osd.1) 190 : cluster [DBG] 4.12 scrub ok 2024-02-19T21:45:10.074 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:10.075 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 38 15 68864 68849 113.229 78.25 0.0165984 0.00882616 2024-02-19T21:45:10.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:08.669757+0000 osd.1 (osd.1) 189 : cluster [DBG] 4.12 scrub starts 2024-02-19T21:45:10.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:08.678659+0000 osd.1 (osd.1) 190 : cluster [DBG] 4.12 scrub ok 2024-02-19T21:45:10.644 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:45:10.650 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:10.650 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:45:10.688 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:45:10.752 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:45:10.823 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:10.852 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:45:10.872 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:10.873 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:45:10.903 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:09.060456+0000 mgr.y (mgr.14514) 484 : cluster [DBG] pgmap v610: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 3.8 GiB data, 13 GiB used, 612 GiB / 626 GiB avail; 639 B/s rd, 47 MiB/s wr, 755 op/s; 2/188190 objects misplaced (0.001%) 2024-02-19T21:45:10.904 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:09.910281+0000 osd.5 (osd.5) 209 : cluster [DBG] 5.7 deep-scrub starts 2024-02-19T21:45:10.904 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:09.918163+0000 osd.5 (osd.5) 210 : cluster [DBG] 5.7 deep-scrub ok 2024-02-19T21:45:10.904 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:09.927210+0000 osd.6 (osd.6) 171 : cluster [DBG] 2.e scrub starts 2024-02-19T21:45:10.904 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:09.932571+0000 osd.6 (osd.6) 172 : cluster [DBG] 2.e scrub ok 2024-02-19T21:45:10.904 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:10.132375+0000 mon.a (mon.0) 1352 : cluster [DBG] osdmap e310: 8 total, 8 up, 7 in 2024-02-19T21:45:10.905 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:45:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:45:10] "GET /metrics HTTP/1.1" 200 176112 "" "Prometheus/2.33.4" 2024-02-19T21:45:10.908 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:09.060456+0000 mgr.y (mgr.14514) 484 : cluster [DBG] pgmap v610: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 3.8 GiB data, 13 GiB used, 612 GiB / 626 GiB avail; 639 B/s rd, 47 MiB/s wr, 755 op/s; 2/188190 objects misplaced (0.001%) 2024-02-19T21:45:10.908 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:09.910281+0000 osd.5 (osd.5) 209 : cluster [DBG] 5.7 deep-scrub starts 2024-02-19T21:45:10.908 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:09.918163+0000 osd.5 (osd.5) 210 : cluster [DBG] 5.7 deep-scrub ok 2024-02-19T21:45:10.908 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:09.927210+0000 osd.6 (osd.6) 171 : cluster [DBG] 2.e scrub starts 2024-02-19T21:45:10.908 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:09.932571+0000 osd.6 (osd.6) 172 : cluster [DBG] 2.e scrub ok 2024-02-19T21:45:10.908 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:10.132375+0000 mon.a (mon.0) 1352 : cluster [DBG] osdmap e310: 8 total, 8 up, 7 in 2024-02-19T21:45:10.908 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:10.516511+0000 osd.7 (osd.7) 190 : cluster [DBG] 5.10 scrub starts 2024-02-19T21:45:10.908 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:10.521822+0000 osd.7 (osd.7) 191 : cluster [DBG] 5.10 scrub ok 2024-02-19T21:45:10.908 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:45:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:45:10.963 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:45:10.963 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:45:10.963 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 310, 2024-02-19T21:45:10.963 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "6f763558-cf6d-11ee-95bb-87774f69a715", 2024-02-19T21:45:10.963 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2024-02-19T21:26:16.880265+0000", 2024-02-19T21:45:10.963 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2024-02-19T21:45:10.123711+0000", 2024-02-19T21:45:10.963 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2024-02-19T21:32:14.805693+0000", 2024-02-19T21:45:10.963 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2024-02-19T21:39:38.443319+0000", 2024-02-19T21:45:10.964 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-02-19T21:45:10.964 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5799936, 2024-02-19T21:45:10.964 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2024-02-19T21:45:10.964 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2024-02-19T21:45:10.964 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2024-02-19T21:45:10.964 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2024-02-19T21:45:10.964 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2024-02-19T21:45:10.964 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:45:10.964 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 18, 2024-02-19T21:45:10.964 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2024-02-19T21:45:10.964 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-02-19T21:45:10.964 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2024-02-19T21:45:10.964 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2024-02-19T21:45:10.964 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 9, 2024-02-19T21:45:10.965 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2024-02-19T21:45:10.965 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "luminous", 2024-02-19T21:45:10.965 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "luminous", 2024-02-19T21:45:10.965 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "pacific", 2024-02-19T21:45:10.965 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2024-02-19T21:45:10.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:10.965 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2024-02-19T21:45:10.965 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "device_health_metrics", 2024-02-19T21:45:10.965 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:30:05.947623+0000", 2024-02-19T21:45:10.965 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:45:10.965 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:45:10.965 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:45:10.965 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:45:10.966 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:45:10.966 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:45:10.966 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:45:10.966 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:45:10.966 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:45:10.966 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:45:10.966 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:45:10.966 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:45:10.966 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 1, 2024-02-19T21:45:10.966 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 1, 2024-02-19T21:45:10.966 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 1, 2024-02-19T21:45:10.966 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 1, 2024-02-19T21:45:10.966 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 1, 2024-02-19T21:45:10.966 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:45:10.967 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:45:10.967 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:45:10.967 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:45:10.967 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:45:10.967 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:45:10.967 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:45:10.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:10.967 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "74", 2024-02-19T21:45:10.967 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:45:10.967 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:45:10.967 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:45:10.967 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:45:10.967 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:45:10.967 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:45:10.967 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:45:10.967 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:45:10.968 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:45:10.968 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:45:10.968 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:45:10.968 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:45:10.968 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:45:10.968 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:45:10.968 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:45:10.968 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:45:10.968 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:45:10.968 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:45:10.968 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:45:10.968 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:45:10.968 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:45:10.969 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:45:10.969 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:45:10.969 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:45:10.969 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:45:10.969 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:45:10.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:10.969 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:45:10.969 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:45:10.969 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:45:10.969 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:45:10.969 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:45:10.969 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:45:10.969 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:45:10.969 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:45:10.969 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:45:10.970 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:45:10.970 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:45:10.970 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2024-02-19T21:45:10.970 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_max": 32, 2024-02-19T21:45:10.970 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 1 2024-02-19T21:45:10.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:10.970 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:45:10.970 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_devicehealth": {} 2024-02-19T21:45:10.970 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:10.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:10.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:10.970 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 2, 2024-02-19T21:45:10.970 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": ".rgw.root", 2024-02-19T21:45:10.970 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:22.082250+0000", 2024-02-19T21:45:10.970 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:45:10.970 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:45:10.971 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:45:10.971 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:45:10.971 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:45:10.971 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:45:10.971 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:45:10.971 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:45:10.971 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:45:10.971 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:45:10.971 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:45:10.971 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:45:10.971 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:45:10.971 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:45:10.971 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:45:10.971 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:45:10.972 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:45:10.972 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:45:10.972 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:45:10.972 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:45:10.972 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:45:10.972 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:45:10.972 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:45:10.972 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:45:10.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:10.972 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "60", 2024-02-19T21:45:10.972 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:45:10.972 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:45:10.972 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:45:10.972 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:45:10.973 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:45:10.973 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:45:10.973 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:45:10.973 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:45:10.973 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:45:10.973 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:45:10.973 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:45:10.973 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:45:10.973 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:45:10.973 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:45:10.973 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:45:10.973 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:45:10.973 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:45:10.973 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:45:10.974 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:45:10.974 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:45:10.974 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:45:10.974 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:45:10.974 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:45:10.974 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:45:10.974 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:45:10.974 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:45:10.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:10.974 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:45:10.974 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:45:10.974 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:45:10.974 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:45:10.974 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:45:10.974 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:45:10.975 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:45:10.975 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:45:10.975 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:45:10.975 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:45:10.975 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:45:10.975 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:45:10.975 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:45:10.975 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:45:10.975 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:10.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:10.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:10.975 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 3, 2024-02-19T21:45:10.975 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "iscsi", 2024-02-19T21:45:10.975 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:22.333164+0000", 2024-02-19T21:45:10.976 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:45:10.976 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:45:10.976 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:45:10.976 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:45:10.976 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:45:10.976 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:45:10.976 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:45:10.976 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:45:10.976 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:45:10.976 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:45:10.976 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:45:10.976 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:45:10.976 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 3, 2024-02-19T21:45:10.977 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 3, 2024-02-19T21:45:10.977 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 3, 2024-02-19T21:45:10.977 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 3, 2024-02-19T21:45:10.977 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 3, 2024-02-19T21:45:10.977 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:45:10.977 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:45:10.977 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:45:10.977 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:45:10.977 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:45:10.977 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:45:10.977 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:45:10.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:10.977 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "62", 2024-02-19T21:45:10.977 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:45:10.977 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:45:10.977 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:45:10.978 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:45:10.978 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:45:10.978 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:45:10.978 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:45:10.978 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:45:10.978 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:45:10.978 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:45:10.978 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:45:10.978 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:45:10.978 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:45:10.978 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:45:10.978 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:45:10.978 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:45:10.978 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:45:10.978 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:45:10.978 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:45:10.979 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:45:10.979 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:45:10.979 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:45:10.979 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:45:10.979 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:45:10.979 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:45:10.979 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:45:10.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:10.979 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:45:10.979 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:45:10.981 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:45:10.981 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:45:10.981 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:45:10.981 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:45:10.981 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:45:10.981 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:45:10.981 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:45:10.981 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:45:10.981 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:45:10.981 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:45:10.981 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:45:10.981 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:45:10.981 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2024-02-19T21:45:10.981 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:10.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:10.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:10.982 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 4, 2024-02-19T21:45:10.982 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.log", 2024-02-19T21:45:10.982 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:23.632615+0000", 2024-02-19T21:45:10.982 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:45:10.982 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:45:10.982 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:45:10.982 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:45:10.982 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:45:10.982 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:45:10.982 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:45:10.982 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:45:10.982 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:45:10.982 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:45:10.982 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:45:10.983 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:45:10.983 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:45:10.983 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:45:10.983 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:45:10.983 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:45:10.983 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:45:10.983 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:45:10.983 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:45:10.983 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:45:10.983 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:45:10.983 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:45:10.983 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:45:10.983 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:45:10.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:10.983 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "62", 2024-02-19T21:45:10.983 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:45:10.984 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:45:10.984 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:45:10.984 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:45:10.984 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:45:10.984 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:45:10.984 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:45:10.984 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:45:10.984 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:45:10.984 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:45:10.984 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:45:10.984 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:45:10.984 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:45:10.984 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:45:10.985 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:45:10.985 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:45:10.985 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:45:10.985 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:45:10.985 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:45:10.985 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:45:10.985 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:45:10.985 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:45:10.985 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:45:10.985 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:45:10.985 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:45:10.985 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:45:10.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:10.985 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:45:10.986 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:45:10.986 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:45:10.986 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:45:10.986 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:45:10.986 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:45:10.986 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:45:10.986 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:45:10.986 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:45:10.986 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:45:10.986 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:45:10.986 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:45:10.986 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:45:10.986 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:45:10.986 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:10.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:10.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:10.987 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 5, 2024-02-19T21:45:10.987 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.control", 2024-02-19T21:45:10.987 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:25.600876+0000", 2024-02-19T21:45:10.987 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:45:10.987 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:45:10.987 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:45:10.987 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:45:10.987 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:45:10.987 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:45:10.987 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:45:10.987 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:45:10.987 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:45:10.987 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:45:10.987 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:45:10.987 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:45:10.988 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 22, 2024-02-19T21:45:10.988 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 22, 2024-02-19T21:45:10.988 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 22, 2024-02-19T21:45:10.988 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 22, 2024-02-19T21:45:10.988 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 22, 2024-02-19T21:45:10.988 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:45:10.988 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "5.16", 2024-02-19T21:45:10.988 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 298, 2024-02-19T21:45:10.988 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 297, 2024-02-19T21:45:10.988 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 297, 2024-02-19T21:45:10.989 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:45:10.989 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:45:10.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:10.989 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "298", 2024-02-19T21:45:10.989 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:45:10.989 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "298", 2024-02-19T21:45:10.989 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "296", 2024-02-19T21:45:10.989 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:45:10.989 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:45:10.989 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:45:10.989 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:45:10.989 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:45:10.989 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:45:10.989 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:45:10.989 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:45:10.990 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:45:10.990 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:45:10.990 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:45:10.990 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:45:10.990 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:45:10.990 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:45:10.990 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:45:10.990 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:45:10.990 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:45:10.990 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:45:10.990 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:45:10.990 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:45:10.990 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:45:10.991 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:45:10.991 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:45:10.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:10.991 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:45:10.991 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:45:10.991 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:45:10.991 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:45:10.991 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:45:10.991 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:45:10.991 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:45:10.991 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:45:10.991 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:45:10.991 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:45:10.991 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:45:10.992 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:45:10.992 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:45:10.992 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:45:10.992 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:10.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:10.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:10.992 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 6, 2024-02-19T21:45:10.992 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.meta", 2024-02-19T21:45:10.992 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:27.661242+0000", 2024-02-19T21:45:10.992 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:45:10.992 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:45:10.992 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:45:10.992 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:45:10.992 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:45:10.993 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:45:10.993 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:45:10.993 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:45:10.993 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:45:10.993 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:45:10.993 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:45:10.993 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:45:10.993 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:45:10.993 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:45:10.993 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:45:10.993 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:45:10.993 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:45:10.993 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:45:10.993 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "6.16", 2024-02-19T21:45:10.994 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 243, 2024-02-19T21:45:10.994 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 242, 2024-02-19T21:45:10.994 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 242, 2024-02-19T21:45:10.994 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:45:10.994 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:45:10.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:10.994 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "304", 2024-02-19T21:45:10.994 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:45:10.994 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "243", 2024-02-19T21:45:10.994 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "302", 2024-02-19T21:45:10.994 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:45:10.994 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:45:10.994 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:45:10.994 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:45:10.994 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:45:10.995 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:45:10.995 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:45:10.995 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:45:10.995 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:45:10.995 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:45:10.995 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:45:10.995 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:45:10.995 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:45:10.995 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:45:10.995 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:45:10.995 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:45:10.995 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:45:10.995 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:45:10.995 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:45:10.995 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:45:10.995 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:45:10.996 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:45:10.996 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:45:10.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:10.996 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:45:10.996 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:45:10.996 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:45:10.996 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:45:10.996 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:45:10.996 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:45:10.996 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:45:10.996 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:45:10.996 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:45:10.996 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:45:10.996 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:45:10.996 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2024-02-19T21:45:10.997 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4 2024-02-19T21:45:10.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:10.997 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:45:10.997 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:45:10.997 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:10.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:10.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:10.997 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 9, 2024-02-19T21:45:10.997 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "unique_pool_2", 2024-02-19T21:45:10.997 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:44:14.908840+0000", 2024-02-19T21:45:10.997 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:45:10.997 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:45:10.997 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:45:10.997 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:45:10.998 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:45:10.998 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:45:10.998 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:45:10.998 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:45:10.998 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:45:10.998 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:45:10.998 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:45:10.998 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:45:10.998 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 16, 2024-02-19T21:45:10.998 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 16, 2024-02-19T21:45:10.998 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 16, 2024-02-19T21:45:10.998 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 16, 2024-02-19T21:45:10.998 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 16, 2024-02-19T21:45:10.998 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:45:10.999 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:45:10.999 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:45:10.999 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:45:10.999 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:45:10.999 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:45:10.999 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:45:10.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:10.999 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "282", 2024-02-19T21:45:10.999 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:45:10.999 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:45:10.999 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:45:10.999 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:45:10.999 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:45:10.999 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:45:11.000 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:45:11.000 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:45:11.000 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:45:11.000 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:45:11.000 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:45:11.000 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:45:11.000 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:45:11.000 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:45:11.000 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:45:11.000 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:45:11.000 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:45:11.000 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:45:11.000 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:45:11.000 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:45:11.001 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:45:11.001 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:45:11.001 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:45:11.001 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:45:11.001 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:45:11.001 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:45:11.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.001 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:45:11.001 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:45:11.001 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:45:11.001 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:45:11.001 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:45:11.001 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:45:11.001 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:45:11.002 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:45:11.002 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:45:11.002 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:45:11.002 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:45:11.002 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:45:11.002 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:45:11.002 INFO:teuthology.orchestra.run.smithi080.stdout: "rados": {} 2024-02-19T21:45:11.002 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.002 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.002 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:45:11.002 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:45:11.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.002 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2024-02-19T21:45:11.002 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "a72c63f6-46b3-4202-99da-7b0c92b799a5", 2024-02-19T21:45:11.002 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:45:11.003 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:45:11.003 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:45:11.003 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:45:11.003 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:45:11.003 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:45:11.003 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 8, 2024-02-19T21:45:11.003 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 305, 2024-02-19T21:45:11.003 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:45:11.003 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:45:11.003 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:45:11.003 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.003 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.003 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2024-02-19T21:45:11.003 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:45:11.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.004 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.004 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2024-02-19T21:45:11.004 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:45:11.004 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.004 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.004 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:45:11.004 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.004 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.004 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2024-02-19T21:45:11.004 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:45:11.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.005 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.005 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2024-02-19T21:45:11.005 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:45:11.005 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.005 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.005 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:45:11.005 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.005 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.005 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2024-02-19T21:45:11.005 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:45:11.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.006 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.006 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2024-02-19T21:45:11.006 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:45:11.006 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.006 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.006 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:45:11.006 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.006 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.006 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2024-02-19T21:45:11.006 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:45:11.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.007 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.007 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2024-02-19T21:45:11.007 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:45:11.007 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.007 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.007 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6803/3531298825", 2024-02-19T21:45:11.007 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6805/3531298825", 2024-02-19T21:45:11.007 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6809/3531298825", 2024-02-19T21:45:11.007 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6807/3531298825", 2024-02-19T21:45:11.007 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:45:11.008 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:45:11.008 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:45:11.008 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.008 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2024-02-19T21:45:11.008 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "7d4e170e-b0ca-4e19-be35-4038ca126ee6", 2024-02-19T21:45:11.008 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:45:11.008 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:45:11.008 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:45:11.008 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:45:11.008 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:45:11.008 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:45:11.008 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-02-19T21:45:11.009 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 304, 2024-02-19T21:45:11.009 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:45:11.009 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:45:11.009 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:45:11.009 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.009 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.009 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2024-02-19T21:45:11.009 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:45:11.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.009 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.009 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2024-02-19T21:45:11.009 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:45:11.010 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.010 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.010 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:45:11.010 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.010 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.010 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2024-02-19T21:45:11.010 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:45:11.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.010 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.010 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2024-02-19T21:45:11.010 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:45:11.011 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.011 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.011 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:45:11.011 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.011 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.011 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2024-02-19T21:45:11.011 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:45:11.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.011 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.011 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2024-02-19T21:45:11.011 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:45:11.012 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.012 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.012 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:45:11.012 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.012 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.012 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2024-02-19T21:45:11.012 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:45:11.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.012 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.012 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2024-02-19T21:45:11.012 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:45:11.013 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.013 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.013 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6811/1497235950", 2024-02-19T21:45:11.013 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6813/1497235950", 2024-02-19T21:45:11.013 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6817/1497235950", 2024-02-19T21:45:11.013 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6815/1497235950", 2024-02-19T21:45:11.013 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:45:11.013 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:45:11.013 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:45:11.013 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.013 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2024-02-19T21:45:11.014 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "cf461b67-f3e8-45e9-b2f6-777752ba5574", 2024-02-19T21:45:11.014 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:45:11.014 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 0, 2024-02-19T21:45:11.014 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 0, 2024-02-19T21:45:11.014 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:45:11.014 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:45:11.014 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:45:11.014 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 18, 2024-02-19T21:45:11.014 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 144, 2024-02-19T21:45:11.014 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:45:11.014 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:45:11.014 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:45:11.014 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.014 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.015 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2024-02-19T21:45:11.015 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:45:11.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.015 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.015 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2024-02-19T21:45:11.015 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:45:11.015 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.015 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.015 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:45:11.015 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.015 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.016 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2024-02-19T21:45:11.016 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:45:11.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.016 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.016 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2024-02-19T21:45:11.016 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:45:11.016 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.016 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.016 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:45:11.016 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.016 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.017 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2024-02-19T21:45:11.017 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:45:11.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.017 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.017 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2024-02-19T21:45:11.017 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:45:11.017 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.017 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.017 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:45:11.017 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.017 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.017 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2024-02-19T21:45:11.018 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:45:11.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.018 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.018 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2024-02-19T21:45:11.018 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:45:11.018 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.018 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.018 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6819/3131848307", 2024-02-19T21:45:11.018 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6821/3131848307", 2024-02-19T21:45:11.018 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6825/3131848307", 2024-02-19T21:45:11.018 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6823/3131848307", 2024-02-19T21:45:11.018 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:45:11.019 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:45:11.019 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:45:11.019 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.019 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2024-02-19T21:45:11.019 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "76318cdd-5fce-4a40-95c9-300d55c34820", 2024-02-19T21:45:11.019 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:45:11.019 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:45:11.019 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 0.4183197021484375, 2024-02-19T21:45:11.019 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:45:11.019 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:45:11.019 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:45:11.019 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 26, 2024-02-19T21:45:11.020 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 304, 2024-02-19T21:45:11.020 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:45:11.020 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:45:11.020 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:45:11.020 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.020 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.020 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2024-02-19T21:45:11.020 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:45:11.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.020 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.020 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2024-02-19T21:45:11.020 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:45:11.021 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.021 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.021 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:45:11.021 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.021 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.021 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2024-02-19T21:45:11.021 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:45:11.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.021 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.021 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2024-02-19T21:45:11.021 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:45:11.021 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.022 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.022 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:45:11.022 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.022 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.022 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6832", 2024-02-19T21:45:11.022 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:45:11.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.022 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.022 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6833", 2024-02-19T21:45:11.022 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:45:11.022 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.022 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.023 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:45:11.023 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.023 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.023 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2024-02-19T21:45:11.023 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:45:11.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.023 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.023 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2024-02-19T21:45:11.023 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:45:11.023 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.023 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.023 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6827/2007978078", 2024-02-19T21:45:11.024 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6829/2007978078", 2024-02-19T21:45:11.024 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6833/2007978078", 2024-02-19T21:45:11.024 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6831/2007978078", 2024-02-19T21:45:11.024 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:45:11.024 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:45:11.024 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:45:11.024 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.024 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2024-02-19T21:45:11.024 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "6484964f-3391-4e1d-a56c-813f46124062", 2024-02-19T21:45:11.024 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:45:11.024 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:45:11.024 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:45:11.024 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 0.427398681640625, 2024-02-19T21:45:11.025 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:45:11.025 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:45:11.025 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 32, 2024-02-19T21:45:11.025 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 304, 2024-02-19T21:45:11.025 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:45:11.025 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:45:11.025 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:45:11.025 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.025 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.025 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6800", 2024-02-19T21:45:11.025 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:45:11.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.025 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.026 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6801", 2024-02-19T21:45:11.026 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:45:11.026 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.026 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.026 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:45:11.026 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.026 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.026 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6802", 2024-02-19T21:45:11.026 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:45:11.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.026 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.026 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6803", 2024-02-19T21:45:11.027 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:45:11.027 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.027 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.027 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:45:11.027 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.027 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.027 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6806", 2024-02-19T21:45:11.027 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:45:11.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.027 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.027 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6807", 2024-02-19T21:45:11.027 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:45:11.028 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.028 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.028 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:45:11.028 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.028 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.028 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6804", 2024-02-19T21:45:11.028 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:45:11.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.028 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.028 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6805", 2024-02-19T21:45:11.028 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:45:11.029 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.029 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.029 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6801/1922002860", 2024-02-19T21:45:11.029 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6803/1922002860", 2024-02-19T21:45:11.029 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6807/1922002860", 2024-02-19T21:45:11.029 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6805/1922002860", 2024-02-19T21:45:11.029 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:45:11.029 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:45:11.029 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:45:11.029 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.029 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2024-02-19T21:45:11.029 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "8c7e0309-8c3b-40b9-99d9-96620e52742f", 2024-02-19T21:45:11.029 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:45:11.030 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:45:11.030 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:45:11.030 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:45:11.030 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:45:11.030 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:45:11.030 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 38, 2024-02-19T21:45:11.030 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 304, 2024-02-19T21:45:11.030 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:45:11.030 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:45:11.030 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:45:11.030 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.030 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.030 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6808", 2024-02-19T21:45:11.030 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:45:11.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.031 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.031 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6809", 2024-02-19T21:45:11.031 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:45:11.031 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.031 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.031 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:45:11.031 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.031 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.031 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6810", 2024-02-19T21:45:11.031 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:45:11.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.032 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.032 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6811", 2024-02-19T21:45:11.032 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:45:11.032 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.032 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.032 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:45:11.032 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.032 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.032 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6814", 2024-02-19T21:45:11.033 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:45:11.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.033 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.033 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6815", 2024-02-19T21:45:11.033 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:45:11.033 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.033 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.033 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:45:11.033 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.033 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.033 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6812", 2024-02-19T21:45:11.033 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:45:11.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.034 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.034 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6813", 2024-02-19T21:45:11.034 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:45:11.034 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.034 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.034 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6809/960889603", 2024-02-19T21:45:11.034 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6811/960889603", 2024-02-19T21:45:11.034 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6815/960889603", 2024-02-19T21:45:11.034 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6813/960889603", 2024-02-19T21:45:11.034 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:45:11.034 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:45:11.034 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:45:11.034 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.035 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2024-02-19T21:45:11.035 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "5b7d44a3-197d-482c-bf9e-de5e9013a851", 2024-02-19T21:45:11.035 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:45:11.035 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:45:11.035 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:45:11.035 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:45:11.035 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:45:11.035 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:45:11.035 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 47, 2024-02-19T21:45:11.035 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 304, 2024-02-19T21:45:11.035 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:45:11.035 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:45:11.035 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:45:11.035 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.036 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.036 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6816", 2024-02-19T21:45:11.036 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:45:11.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.036 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.036 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6817", 2024-02-19T21:45:11.036 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:45:11.036 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.036 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.036 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:45:11.036 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.037 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.037 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6818", 2024-02-19T21:45:11.037 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:45:11.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.037 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.037 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6819", 2024-02-19T21:45:11.037 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:45:11.037 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.037 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.037 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:45:11.037 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.038 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.038 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6822", 2024-02-19T21:45:11.038 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:45:11.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.038 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.038 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6823", 2024-02-19T21:45:11.038 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:45:11.038 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.038 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.038 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:45:11.038 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.038 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.038 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6820", 2024-02-19T21:45:11.038 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:45:11.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.039 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.039 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6821", 2024-02-19T21:45:11.039 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:45:11.039 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.039 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.039 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6817/2598265223", 2024-02-19T21:45:11.039 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6819/2598265223", 2024-02-19T21:45:11.039 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6823/2598265223", 2024-02-19T21:45:11.039 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6821/2598265223", 2024-02-19T21:45:11.039 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:45:11.039 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:45:11.040 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:45:11.040 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.040 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2024-02-19T21:45:11.040 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "7e2d0287-928d-40f8-841b-6c2077fc08ac", 2024-02-19T21:45:11.040 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:45:11.040 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:45:11.040 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 0.482391357421875, 2024-02-19T21:45:11.040 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:45:11.040 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:45:11.040 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:45:11.040 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 55, 2024-02-19T21:45:11.041 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 307, 2024-02-19T21:45:11.041 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:45:11.041 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:45:11.041 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:45:11.041 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.041 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.041 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6824", 2024-02-19T21:45:11.041 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:45:11.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.041 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.041 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6825", 2024-02-19T21:45:11.041 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:45:11.041 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.042 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.042 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:45:11.042 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.042 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.042 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6826", 2024-02-19T21:45:11.042 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:45:11.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.042 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.042 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6827", 2024-02-19T21:45:11.042 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:45:11.042 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.043 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.043 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:45:11.043 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.043 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.043 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6830", 2024-02-19T21:45:11.043 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:45:11.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.043 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.043 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6831", 2024-02-19T21:45:11.043 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:45:11.043 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.044 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.044 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:45:11.044 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:45:11.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.044 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:45:11.044 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6828", 2024-02-19T21:45:11.044 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:45:11.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.044 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:45:11.044 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6829", 2024-02-19T21:45:11.044 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:45:11.044 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.044 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.045 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6825/3619345894", 2024-02-19T21:45:11.045 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6827/3619345894", 2024-02-19T21:45:11.045 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6831/3619345894", 2024-02-19T21:45:11.045 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6829/3619345894", 2024-02-19T21:45:11.045 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:45:11.045 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:45:11.045 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:45:11.045 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.045 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.045 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:45:11.045 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2024-02-19T21:45:11.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.045 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2024-02-19T21:45:11.045 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:45:11.045 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:45:11.045 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:45:11.046 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:45:11.046 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:45:11.046 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:44:32.221980+0000", 2024-02-19T21:45:11.046 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:45:11.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.046 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.046 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2024-02-19T21:45:11.046 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:45:11.046 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:45:11.046 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:45:11.046 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:45:11.046 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:45:11.046 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:44:41.533831+0000", 2024-02-19T21:45:11.046 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:45:11.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.046 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.046 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2024-02-19T21:45:11.047 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:45:11.047 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:45:11.047 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:45:11.047 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:45:11.047 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 65536, 2024-02-19T21:45:11.047 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:44:07.339809+0000", 2024-02-19T21:45:11.047 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:45:11.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.047 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2024-02-19T21:45:11.047 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:45:11.047 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:45:11.047 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:45:11.047 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:45:11.047 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:45:11.047 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:44:30.260525+0000", 2024-02-19T21:45:11.048 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:45:11.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.048 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2024-02-19T21:45:11.048 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:45:11.048 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:45:11.048 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:45:11.048 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:45:11.048 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:45:11.048 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:44:31.257077+0000", 2024-02-19T21:45:11.048 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:45:11.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.048 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2024-02-19T21:45:11.049 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:45:11.049 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:45:11.049 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:45:11.049 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:45:11.049 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:45:11.049 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:44:18.380957+0000", 2024-02-19T21:45:11.049 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:45:11.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.049 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2024-02-19T21:45:11.049 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:45:11.049 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:45:11.049 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:45:11.049 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:45:11.050 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:45:11.050 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:44:31.429791+0000", 2024-02-19T21:45:11.050 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:45:11.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.050 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2024-02-19T21:45:11.050 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:45:11.050 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:45:11.050 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:45:11.050 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:45:11.050 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:45:11.050 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:43:53.479186+0000", 2024-02-19T21:45:11.050 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:45:11.050 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.050 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:45:11.051 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [ 2024-02-19T21:45:11.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.051 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "2.c", 2024-02-19T21:45:11.051 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:45:11.051 INFO:teuthology.orchestra.run.smithi080.stdout: 6, 2024-02-19T21:45:11.051 INFO:teuthology.orchestra.run.smithi080.stdout: 7, 2024-02-19T21:45:11.051 INFO:teuthology.orchestra.run.smithi080.stdout: 2 2024-02-19T21:45:11.051 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.051 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.1", 2024-02-19T21:45:11.051 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:45:11.051 INFO:teuthology.orchestra.run.smithi080.stdout: 4, 2024-02-19T21:45:11.051 INFO:teuthology.orchestra.run.smithi080.stdout: 2, 2024-02-19T21:45:11.052 INFO:teuthology.orchestra.run.smithi080.stdout: 6 2024-02-19T21:45:11.052 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.052 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.052 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:45:11.052 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [ 2024-02-19T21:45:11.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.052 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.6", 2024-02-19T21:45:11.052 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:45:11.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.052 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:45:11.052 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 5 2024-02-19T21:45:11.052 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.052 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.053 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.e", 2024-02-19T21:45:11.053 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:45:11.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.053 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:45:11.053 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 7 2024-02-19T21:45:11.053 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.053 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.053 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.f", 2024-02-19T21:45:11.053 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:45:11.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.053 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:45:11.053 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 5 2024-02-19T21:45:11.054 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.054 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.054 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.19", 2024-02-19T21:45:11.054 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:45:11.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.054 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:45:11.054 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 7 2024-02-19T21:45:11.054 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.054 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.054 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.1f", 2024-02-19T21:45:11.054 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:45:11.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.055 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:45:11.055 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 7 2024-02-19T21:45:11.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.055 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 6, 2024-02-19T21:45:11.055 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 0 2024-02-19T21:45:11.055 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.055 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.055 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "5.1", 2024-02-19T21:45:11.055 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:45:11.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.055 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 4, 2024-02-19T21:45:11.055 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 6 2024-02-19T21:45:11.055 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.056 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.056 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "5.13", 2024-02-19T21:45:11.056 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:45:11.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.056 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 0, 2024-02-19T21:45:11.056 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 6 2024-02-19T21:45:11.056 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.056 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.056 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "6.f", 2024-02-19T21:45:11.056 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:45:11.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.057 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 4, 2024-02-19T21:45:11.057 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 0 2024-02-19T21:45:11.057 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.057 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.057 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.057 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:45:11.057 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [ 2024-02-19T21:45:11.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:11.057 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "6.18", 2024-02-19T21:45:11.057 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:45:11.057 INFO:teuthology.orchestra.run.smithi080.stdout: 0, 2024-02-19T21:45:11.057 INFO:teuthology.orchestra.run.smithi080.stdout: 3, 2024-02-19T21:45:11.057 INFO:teuthology.orchestra.run.smithi080.stdout: 6 2024-02-19T21:45:11.057 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:11.057 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.058 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:45:11.058 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2024-02-19T21:45:11.058 INFO:teuthology.orchestra.run.smithi080.stdout: "blocklist": { 2024-02-19T21:45:11.058 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6800/2867197629": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:45:11.058 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/1659656010": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:45:11.058 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6801/2272739550": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:45:11.058 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/867908385": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:45:11.058 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/398750494": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:45:11.058 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/2833137430": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:45:11.058 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/2520755315": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:45:11.058 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6800/2094869828": "2024-02-20T21:26:51.262073+0000", 2024-02-19T21:45:11.058 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6800/2272739550": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:45:11.058 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6801/2094869828": "2024-02-20T21:26:51.262073+0000", 2024-02-19T21:45:11.058 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/2130852198": "2024-02-20T21:26:51.262073+0000", 2024-02-19T21:45:11.058 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6801/2867197629": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:45:11.059 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/1952386920": "2024-02-20T21:26:51.262073+0000" 2024-02-19T21:45:11.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.059 INFO:teuthology.orchestra.run.smithi080.stdout: "range_blocklist": {}, 2024-02-19T21:45:11.059 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2024-02-19T21:45:11.059 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2024-02-19T21:45:11.059 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2024-02-19T21:45:11.059 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2024-02-19T21:45:11.059 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2024-02-19T21:45:11.059 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2024-02-19T21:45:11.059 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2024-02-19T21:45:11.059 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2024-02-19T21:45:11.059 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:11.059 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2024-02-19T21:45:11.059 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2024-02-19T21:45:11.060 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2024-02-19T21:45:11.060 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2024-02-19T21:45:11.060 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {}, 2024-02-19T21:45:11.060 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode": { 2024-02-19T21:45:11.060 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode_enabled": false, 2024-02-19T21:45:11.060 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_bucket_count": 0, 2024-02-19T21:45:11.060 INFO:teuthology.orchestra.run.smithi080.stdout: "degraded_stretch_mode": 0, 2024-02-19T21:45:11.060 INFO:teuthology.orchestra.run.smithi080.stdout: "recovering_stretch_mode": 0, 2024-02-19T21:45:11.060 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode_bucket": 0 2024-02-19T21:45:11.060 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:11.060 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:45:11.075 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 39 16 70012 69996 112.164 71.6875 0.00981748 0.00891147 2024-02-19T21:45:11.101 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:11.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:09.060456+0000 mgr.y (mgr.14514) 484 : cluster [DBG] pgmap v610: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 3.8 GiB data, 13 GiB used, 612 GiB / 626 GiB avail; 639 B/s rd, 47 MiB/s wr, 755 op/s; 2/188190 objects misplaced (0.001%) 2024-02-19T21:45:11.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:09.910281+0000 osd.5 (osd.5) 209 : cluster [DBG] 5.7 deep-scrub starts 2024-02-19T21:45:11.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:09.918163+0000 osd.5 (osd.5) 210 : cluster [DBG] 5.7 deep-scrub ok 2024-02-19T21:45:11.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:09.927210+0000 osd.6 (osd.6) 171 : cluster [DBG] 2.e scrub starts 2024-02-19T21:45:11.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:09.932571+0000 osd.6 (osd.6) 172 : cluster [DBG] 2.e scrub ok 2024-02-19T21:45:11.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:10.132375+0000 mon.a (mon.0) 1352 : cluster [DBG] osdmap e310: 8 total, 8 up, 7 in 2024-02-19T21:45:11.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:10.516511+0000 osd.7 (osd.7) 190 : cluster [DBG] 5.10 scrub starts 2024-02-19T21:45:11.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:10.521822+0000 osd.7 (osd.7) 191 : cluster [DBG] 5.10 scrub ok 2024-02-19T21:45:11.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:10.516511+0000 osd.7 (osd.7) 190 : cluster [DBG] 5.10 scrub starts 2024-02-19T21:45:11.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:10.521822+0000 osd.7 (osd.7) 191 : cluster [DBG] 5.10 scrub ok 2024-02-19T21:45:11.479 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set noscrub 2024-02-19T21:45:11.995 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:45:12.002 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:12.003 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:45:12.075 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:2024-02-19T21:45:12.076349+0000 min lat: 0.00124015 max lat: 0.0961392 avg lat: 0.00898104 2024-02-19T21:45:12.075 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-19T21:45:12.075 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 40 16 71248 71232 111.291 77.25 0.0200339 0.00898104 2024-02-19T21:45:12.104 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:45:12.152 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:12.185 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:45:12.187 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:10.568078+0000 mgr.y (mgr.14514) 485 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:45:12.187 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:10.868085+0000 osd.5 (osd.5) 211 : cluster [DBG] 5.6 scrub starts 2024-02-19T21:45:12.188 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:10.871105+0000 osd.5 (osd.5) 212 : cluster [DBG] 5.6 scrub ok 2024-02-19T21:45:12.188 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:10.961993+0000 mon.c (mon.2) 66 : audit [DBG] from='client.? 172.21.15.80:0/311180743' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-19T21:45:12.189 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:12.190 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:45:12.290 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:45:12.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:10.568078+0000 mgr.y (mgr.14514) 485 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:45:12.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:10.868085+0000 osd.5 (osd.5) 211 : cluster [DBG] 5.6 scrub starts 2024-02-19T21:45:12.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:10.871105+0000 osd.5 (osd.5) 212 : cluster [DBG] 5.6 scrub ok 2024-02-19T21:45:12.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:10.961993+0000 mon.c (mon.2) 66 : audit [DBG] from='client.? 172.21.15.80:0/311180743' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-19T21:45:12.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:10.568078+0000 mgr.y (mgr.14514) 485 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:45:12.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:10.868085+0000 osd.5 (osd.5) 211 : cluster [DBG] 5.6 scrub starts 2024-02-19T21:45:12.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:10.871105+0000 osd.5 (osd.5) 212 : cluster [DBG] 5.6 scrub ok 2024-02-19T21:45:12.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:10.961993+0000 mon.c (mon.2) 66 : audit [DBG] from='client.? 172.21.15.80:0/311180743' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-19T21:45:12.353 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:12.716 INFO:tasks.thrashosds.thrasher:j is {'epoch': 310, 'fsid': '6f763558-cf6d-11ee-95bb-87774f69a715', 'created': '2024-02-19T21:26:16.880265+0000', 'modified': '2024-02-19T21:45:10.123711+0000', 'last_up_change': '2024-02-19T21:32:14.805693+0000', 'last_in_change': '2024-02-19T21:39:38.443319+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 18, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 9, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-19T21:30:05.947623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2024-02-19T21:32:22.082250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2024-02-19T21:32:22.333164+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 3, 'pg_placement_num': 3, 'pg_placement_num_target': 3, 'pg_num_target': 3, 'pg_num_pending': 3, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2024-02-19T21:32:23.632615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2024-02-19T21:32:25.600876+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 22, 'pg_placement_num': 22, 'pg_placement_num_target': 22, 'pg_num_target': 22, 'pg_num_pending': 22, 'last_pg_merge_meta': {'source_pgid': '5.16', 'ready_epoch': 298, 'last_epoch_started': 297, 'last_epoch_clean': 297, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '298', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '298', 'last_force_op_resend_preluminous': '296', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2024-02-19T21:32:27.661242+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '6.16', 'ready_epoch': 243, 'last_epoch_started': 242, 'last_epoch_clean': 242, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '304', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '243', 'last_force_op_resend_preluminous': '302', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}}, {'pool': 9, 'pool_name': 'unique_pool_2', 'create_time': '2024-02-19T21:44:14.908840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '282', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': 'a72c63f6-46b3-4202-99da-7b0c92b799a5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 305, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6802', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6803', 'nonce': 3531298825}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6804', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6805', 'nonce': 3531298825}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6808', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6809', 'nonce': 3531298825}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6806', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6807', 'nonce': 3531298825}]}, 'public_addr': '172.21.15.80:6803/3531298825', 'cluster_addr': '172.21.15.80:6805/3531298825', 'heartbeat_back_addr': '172.21.15.80:6809/3531298825', 'heartbeat_front_addr': '172.21.15.80:6807/3531298825', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7d4e170e-b0ca-4e19-be35-4038ca126ee6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 304, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6810', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6811', 'nonce': 1497235950}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6812', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6813', 'nonce': 1497235950}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6816', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6817', 'nonce': 1497235950}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6814', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6815', 'nonce': 1497235950}]}, 'public_addr': '172.21.15.80:6811/1497235950', 'cluster_addr': '172.21.15.80:6813/1497235950', 'heartbeat_back_addr': '172.21.15.80:6817/1497235950', 'heartbeat_front_addr': '172.21.15.80:6815/1497235950', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'cf461b67-f3e8-45e9-b2f6-777752ba5574', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 18, 'up_thru': 144, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6818', 'nonce': 3131848307}, {'type': 'v1', 'addr': '172.21.15.80:6819', 'nonce': 3131848307}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6820', 'nonce': 3131848307}, {'type': 'v1', 'addr': '172.21.15.80:6821', 'nonce': 3131848307}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6824', 'nonce': 3131848307}, {'type': 'v1', 'addr': '172.21.15.80:6825', 'nonce': 3131848307}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6822', 'nonce': 3131848307}, {'type': 'v1', 'addr': '172.21.15.80:6823', 'nonce': 3131848307}]}, 'public_addr': '172.21.15.80:6819/3131848307', 'cluster_addr': '172.21.15.80:6821/3131848307', 'heartbeat_back_addr': '172.21.15.80:6825/3131848307', 'heartbeat_front_addr': '172.21.15.80:6823/3131848307', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '76318cdd-5fce-4a40-95c9-300d55c34820', 'up': 1, 'in': 1, 'weight': 0.4183197021484375, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 26, 'up_thru': 304, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6826', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6827', 'nonce': 2007978078}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6828', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6829', 'nonce': 2007978078}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6832', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6833', 'nonce': 2007978078}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6830', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6831', 'nonce': 2007978078}]}, 'public_addr': '172.21.15.80:6827/2007978078', 'cluster_addr': '172.21.15.80:6829/2007978078', 'heartbeat_back_addr': '172.21.15.80:6833/2007978078', 'heartbeat_front_addr': '172.21.15.80:6831/2007978078', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '6484964f-3391-4e1d-a56c-813f46124062', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.427398681640625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 32, 'up_thru': 304, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6800', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6801', 'nonce': 1922002860}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6802', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6803', 'nonce': 1922002860}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6806', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6807', 'nonce': 1922002860}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6804', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6805', 'nonce': 1922002860}]}, 'public_addr': '172.21.15.157:6801/1922002860', 'cluster_addr': '172.21.15.157:6803/1922002860', 'heartbeat_back_addr': '172.21.15.157:6807/1922002860', 'heartbeat_front_addr': '172.21.15.157:6805/1922002860', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '8c7e0309-8c3b-40b9-99d9-96620e52742f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 38, 'up_thru': 304, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6808', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6809', 'nonce': 960889603}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6810', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6811', 'nonce': 960889603}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6814', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6815', 'nonce': 960889603}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6812', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6813', 'nonce': 960889603}]}, 'public_addr': '172.21.15.157:6809/960889603', 'cluster_addr': '172.21.15.157:6811/960889603', 'heartbeat_back_addr': '172.21.15.157:6815/960889603', 'heartbeat_front_addr': '172.21.15.157:6813/960889603', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '5b7d44a3-197d-482c-bf9e-de5e9013a851', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 47, 'up_thru': 304, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6816', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6817', 'nonce': 2598265223}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6818', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6819', 'nonce': 2598265223}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6822', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6823', 'nonce': 2598265223}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6820', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6821', 'nonce': 2598265223}]}, 'public_addr': '172.21.15.157:6817/2598265223', 'cluster_addr': '172.21.15.157:6819/2598265223', 'heartbeat_back_addr': '172.21.15.157:6823/2598265223', 'heartbeat_front_addr': '172.21.15.157:6821/2598265223', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '7e2d0287-928d-40f8-841b-6c2077fc08ac', 'up': 1, 'in': 1, 'weight': 0.482391357421875, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 55, 'up_thru': 307, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6824', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6825', 'nonce': 3619345894}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6826', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6827', 'nonce': 3619345894}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6830', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6831', 'nonce': 3619345894}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6828', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6829', 'nonce': 3619345894}]}, 'public_addr': '172.21.15.157:6825/3619345894', 'cluster_addr': '172.21.15.157:6827/3619345894', 'heartbeat_back_addr': '172.21.15.157:6831/3619345894', 'heartbeat_front_addr': '172.21.15.157:6829/3619345894', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:44:32.221980+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:44:41.533831+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-02-19T21:44:07.339809+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:44:30.260525+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:44:31.257077+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:44:18.380957+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:44:31.429791+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:43:53.479186+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.c', 'osds': [6, 7, 2]}, {'pgid': '4.1', 'osds': [4, 2, 6]}], 'pg_upmap_items': [{'pgid': '4.6', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.e', 'mappings': [{'from': 1, 'to': 7}]}, {'pgid': '4.f', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.19', 'mappings': [{'from': 1, 'to': 7}]}, {'pgid': '4.1f', 'mappings': [{'from': 1, 'to': 7}, {'from': 6, 'to': 0}]}, {'pgid': '5.1', 'mappings': [{'from': 4, 'to': 6}]}, {'pgid': '5.13', 'mappings': [{'from': 0, 'to': 6}]}, {'pgid': '6.f', 'mappings': [{'from': 4, 'to': 0}]}], 'pg_temp': [{'pgid': '6.18', 'osds': [0, 3, 6]}], 'primary_temp': [], 'blocklist': {'172.21.15.80:6800/2867197629': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:0/1659656010': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:6801/2272739550': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:0/867908385': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:0/398750494': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:0/2833137430': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:0/2520755315': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:6800/2094869828': '2024-02-20T21:26:51.262073+0000', '172.21.15.80:6800/2272739550': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:6801/2094869828': '2024-02-20T21:26:51.262073+0000', '172.21.15.80:0/2130852198': '2024-02-20T21:26:51.262073+0000', '172.21.15.80:6801/2867197629': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:0/1952386920': '2024-02-20T21:26:51.262073+0000'}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-02-19T21:45:12.717 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:45:12.777 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:45:12.777 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:45:13.028 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:45:13.035 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:13.036 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:45:13.036 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:11.062445+0000 mgr.y (mgr.14514) 486 : cluster [DBG] pgmap v612: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 4.2 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1.2 KiB/s rd, 97 MiB/s wr, 1.55k op/s; 2/207162 objects misplaced (0.001%) 2024-02-19T21:45:13.036 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:12.507439+0000 osd.7 (osd.7) 192 : cluster [DBG] 6.1c scrub starts 2024-02-19T21:45:13.036 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:12.526458+0000 osd.7 (osd.7) 193 : cluster [DBG] 6.1c scrub ok 2024-02-19T21:45:13.037 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:11.062445+0000 mgr.y (mgr.14514) 486 : cluster [DBG] pgmap v612: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 4.2 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1.2 KiB/s rd, 97 MiB/s wr, 1.55k op/s; 2/207162 objects misplaced (0.001%) 2024-02-19T21:45:13.037 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:12.507439+0000 osd.7 (osd.7) 192 : cluster [DBG] 6.1c scrub starts 2024-02-19T21:45:13.037 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:12.526458+0000 osd.7 (osd.7) 193 : cluster [DBG] 6.1c scrub ok 2024-02-19T21:45:13.075 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 41 16 72485 72469 110.462 77.3125 0.0107231 0.00904872 2024-02-19T21:45:13.137 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:45:13.194 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:13.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:11.062445+0000 mgr.y (mgr.14514) 486 : cluster [DBG] pgmap v612: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 4.2 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1.2 KiB/s rd, 97 MiB/s wr, 1.55k op/s; 2/207162 objects misplaced (0.001%) 2024-02-19T21:45:13.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:12.507439+0000 osd.7 (osd.7) 192 : cluster [DBG] 6.1c scrub starts 2024-02-19T21:45:13.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:12.526458+0000 osd.7 (osd.7) 193 : cluster [DBG] 6.1c scrub ok 2024-02-19T21:45:13.553 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:45:13.556 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:13.556 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:45:13.657 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:45:13.704 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:13.840 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:45:13.849 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:13.849 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:45:13.950 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:45:14.016 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:14.055 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:45:14.065 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:14.065 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:45:14.075 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 42 16 73752 73736 109.717 79.1875 0.00505684 0.00911003 2024-02-19T21:45:14.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:12.162598+0000 osd.0 (osd.0) 202 : cluster [DBG] 5.b deep-scrub starts 2024-02-19T21:45:14.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:12.163817+0000 osd.0 (osd.0) 203 : cluster [DBG] 5.b deep-scrub ok 2024-02-19T21:45:14.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:12.969166+0000 osd.6 (osd.6) 173 : cluster [DBG] 2.7 scrub starts 2024-02-19T21:45:14.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:12.972359+0000 osd.6 (osd.6) 174 : cluster [DBG] 2.7 scrub ok 2024-02-19T21:45:14.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:13.062808+0000 mgr.y (mgr.14514) 487 : cluster [DBG] pgmap v613: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 4.2 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1.2 KiB/s rd, 79 MiB/s wr, 1.26k op/s; 2/207162 objects misplaced (0.001%) 2024-02-19T21:45:14.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:12.162598+0000 osd.0 (osd.0) 202 : cluster [DBG] 5.b deep-scrub starts 2024-02-19T21:45:14.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:12.163817+0000 osd.0 (osd.0) 203 : cluster [DBG] 5.b deep-scrub ok 2024-02-19T21:45:14.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:12.969166+0000 osd.6 (osd.6) 173 : cluster [DBG] 2.7 scrub starts 2024-02-19T21:45:14.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:12.972359+0000 osd.6 (osd.6) 174 : cluster [DBG] 2.7 scrub ok 2024-02-19T21:45:14.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:13.062808+0000 mgr.y (mgr.14514) 487 : cluster [DBG] pgmap v613: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 4.2 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1.2 KiB/s rd, 79 MiB/s wr, 1.26k op/s; 2/207162 objects misplaced (0.001%) 2024-02-19T21:45:14.166 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:45:14.203 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:12.162598+0000 osd.0 (osd.0) 202 : cluster [DBG] 5.b deep-scrub starts 2024-02-19T21:45:14.203 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:12.163817+0000 osd.0 (osd.0) 203 : cluster [DBG] 5.b deep-scrub ok 2024-02-19T21:45:14.203 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:12.969166+0000 osd.6 (osd.6) 173 : cluster [DBG] 2.7 scrub starts 2024-02-19T21:45:14.203 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:12.972359+0000 osd.6 (osd.6) 174 : cluster [DBG] 2.7 scrub ok 2024-02-19T21:45:14.203 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:13.062808+0000 mgr.y (mgr.14514) 487 : cluster [DBG] pgmap v613: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 4.2 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1.2 KiB/s rd, 79 MiB/s wr, 1.26k op/s; 2/207162 objects misplaced (0.001%) 2024-02-19T21:45:14.208 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:14.236 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:45:14.240 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:14.241 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:45:14.272 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.1 dump_historic_ops 2024-02-19T21:45:14.341 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:45:14.400 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:14.437 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:45:14.443 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:14.444 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:45:14.544 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:45:14.608 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:14.637 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:45:14.640 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:14.641 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:45:14.697 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:45:14.741 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:45:14.769 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:45:14.777 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:14.808 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:45:14.815 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:14.816 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:45:14.917 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:45:14.960 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:15.041 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:45:15.046 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:15.047 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:45:15.075 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 43 16 74924 74908 108.869 73.25 0.0145615 0.00918061 2024-02-19T21:45:15.148 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:45:15.199 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:15.230 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:45:15.234 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:15.234 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:45:15.266 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:14.167122+0000 osd.0 (osd.0) 204 : cluster [DBG] 4.3 scrub starts 2024-02-19T21:45:15.267 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:14.173128+0000 osd.0 (osd.0) 205 : cluster [DBG] 4.3 scrub ok 2024-02-19T21:45:15.268 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:14.167122+0000 osd.0 (osd.0) 204 : cluster [DBG] 4.3 scrub starts 2024-02-19T21:45:15.268 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:14.173128+0000 osd.0 (osd.0) 205 : cluster [DBG] 4.3 scrub ok 2024-02-19T21:45:15.334 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:45:15.402 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:15.430 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:45:15.438 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:15.439 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:45:15.439 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:14.167122+0000 osd.0 (osd.0) 204 : cluster [DBG] 4.3 scrub starts 2024-02-19T21:45:15.439 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:14.173128+0000 osd.0 (osd.0) 205 : cluster [DBG] 4.3 scrub ok 2024-02-19T21:45:15.540 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:45:15.606 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:15.656 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:45:15.693 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:45:15.727 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:45:15.753 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:45:15.783 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:45:15.806 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:45:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:45:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:45:15.812 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:45:15.844 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:45:15.884 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:45:15.890 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:45:15.890 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:45:15.890 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:45:15.890 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:45:15.890 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:45:15.890 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:45:15.890 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:45:15.890 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:45:16.076 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 44 15 76130 76115 108.109 75.4375 0.00372307 0.00924574 2024-02-19T21:45:16.184 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:15.068550+0000 mgr.y (mgr.14514) 488 : cluster [DBG] pgmap v614: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 4.3 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 639 B/s rd, 67 MiB/s wr, 1.08k op/s; 2/214107 objects misplaced (0.001%) 2024-02-19T21:45:16.185 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:15.620138+0000 mon.c (mon.2) 67 : audit [DBG] from='client.? 172.21.15.80:0/1844474377' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:45:16.185 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:15.790442+0000 osd.5 (osd.5) 213 : cluster [DBG] 5.e scrub starts 2024-02-19T21:45:16.185 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:15.802118+0000 osd.5 (osd.5) 214 : cluster [DBG] 5.e scrub ok 2024-02-19T21:45:16.185 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:15.068550+0000 mgr.y (mgr.14514) 488 : cluster [DBG] pgmap v614: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 4.3 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 639 B/s rd, 67 MiB/s wr, 1.08k op/s; 2/214107 objects misplaced (0.001%) 2024-02-19T21:45:16.185 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:15.620138+0000 mon.c (mon.2) 67 : audit [DBG] from='client.? 172.21.15.80:0/1844474377' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:45:16.185 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:15.790442+0000 osd.5 (osd.5) 213 : cluster [DBG] 5.e scrub starts 2024-02-19T21:45:16.185 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:15.802118+0000 osd.5 (osd.5) 214 : cluster [DBG] 5.e scrub ok 2024-02-19T21:45:16.561 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:15.068550+0000 mgr.y (mgr.14514) 488 : cluster [DBG] pgmap v614: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 4.3 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 639 B/s rd, 67 MiB/s wr, 1.08k op/s; 2/214107 objects misplaced (0.001%) 2024-02-19T21:45:16.561 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:15.620138+0000 mon.c (mon.2) 67 : audit [DBG] from='client.? 172.21.15.80:0/1844474377' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:45:16.561 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:15.790442+0000 osd.5 (osd.5) 213 : cluster [DBG] 5.e scrub starts 2024-02-19T21:45:16.561 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:15.802118+0000 osd.5 (osd.5) 214 : cluster [DBG] 5.e scrub ok 2024-02-19T21:45:17.075 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 45 16 77401 77385 107.47 79.375 0.0168375 0.00930114 2024-02-19T21:45:17.562 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:16.183260+0000 osd.0 (osd.0) 206 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:45:17.562 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:16.190167+0000 osd.0 (osd.0) 207 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:45:17.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:16.183260+0000 osd.0 (osd.0) 206 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:45:17.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:16.190167+0000 osd.0 (osd.0) 207 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:45:17.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:16.183260+0000 osd.0 (osd.0) 206 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:45:17.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:16.190167+0000 osd.0 (osd.0) 207 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:45:17.681 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:45:17.689 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:17.689 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:45:17.790 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:45:17.845 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:18.007 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:45:18.008 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:45:18.010 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:18.010 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:45:18.076 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 46 15 78646 78631 106.825 77.875 0.0191658 0.00935712 2024-02-19T21:45:18.111 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:45:18.154 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:18.185 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:45:18.190 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:18.191 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:45:18.291 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:45:18.338 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:18.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:16.691285+0000 osd.1 (osd.1) 191 : cluster [DBG] 2.9 scrub starts 2024-02-19T21:45:18.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:16.700880+0000 osd.1 (osd.1) 192 : cluster [DBG] 2.9 scrub ok 2024-02-19T21:45:18.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:17.069234+0000 mgr.y (mgr.14514) 489 : cluster [DBG] pgmap v615: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 4.6 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1.1 KiB/s rd, 84 MiB/s wr, 1.35k op/s; 2/225405 objects misplaced (0.001%) 2024-02-19T21:45:18.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:17.199188+0000 osd.0 (osd.0) 208 : cluster [DBG] 2.1f scrub starts 2024-02-19T21:45:18.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:17.200893+0000 osd.0 (osd.0) 209 : cluster [DBG] 2.1f scrub ok 2024-02-19T21:45:18.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:17.511413+0000 osd.7 (osd.7) 194 : cluster [DBG] 6.5 scrub starts 2024-02-19T21:45:18.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:17.575077+0000 osd.7 (osd.7) 195 : cluster [DBG] 6.5 scrub ok 2024-02-19T21:45:18.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:16.691285+0000 osd.1 (osd.1) 191 : cluster [DBG] 2.9 scrub starts 2024-02-19T21:45:18.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:16.700880+0000 osd.1 (osd.1) 192 : cluster [DBG] 2.9 scrub ok 2024-02-19T21:45:18.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:17.069234+0000 mgr.y (mgr.14514) 489 : cluster [DBG] pgmap v615: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 4.6 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1.1 KiB/s rd, 84 MiB/s wr, 1.35k op/s; 2/225405 objects misplaced (0.001%) 2024-02-19T21:45:18.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:17.199188+0000 osd.0 (osd.0) 208 : cluster [DBG] 2.1f scrub starts 2024-02-19T21:45:18.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:17.200893+0000 osd.0 (osd.0) 209 : cluster [DBG] 2.1f scrub ok 2024-02-19T21:45:18.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:17.511413+0000 osd.7 (osd.7) 194 : cluster [DBG] 6.5 scrub starts 2024-02-19T21:45:18.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:17.575077+0000 osd.7 (osd.7) 195 : cluster [DBG] 6.5 scrub ok 2024-02-19T21:45:18.378 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:45:18.385 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:18.386 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:45:18.487 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:45:18.523 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:16.691285+0000 osd.1 (osd.1) 191 : cluster [DBG] 2.9 scrub starts 2024-02-19T21:45:18.523 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:16.700880+0000 osd.1 (osd.1) 192 : cluster [DBG] 2.9 scrub ok 2024-02-19T21:45:18.523 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:17.069234+0000 mgr.y (mgr.14514) 489 : cluster [DBG] pgmap v615: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 4.6 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1.1 KiB/s rd, 84 MiB/s wr, 1.35k op/s; 2/225405 objects misplaced (0.001%) 2024-02-19T21:45:18.523 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:17.199188+0000 osd.0 (osd.0) 208 : cluster [DBG] 2.1f scrub starts 2024-02-19T21:45:18.523 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:17.200893+0000 osd.0 (osd.0) 209 : cluster [DBG] 2.1f scrub ok 2024-02-19T21:45:18.523 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:17.511413+0000 osd.7 (osd.7) 194 : cluster [DBG] 6.5 scrub starts 2024-02-19T21:45:18.524 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:17.575077+0000 osd.7 (osd.7) 195 : cluster [DBG] 6.5 scrub ok 2024-02-19T21:45:18.524 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:18.562 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:45:18.566 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:18.566 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:45:18.667 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:45:18.730 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:18.761 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:45:18.765 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:18.765 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:45:18.866 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:45:18.940 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:18.974 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:45:18.976 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:18.977 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:45:19.076 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 47 16 79836 79820 106.134 74.3125 0.00573906 0.00941816 2024-02-19T21:45:19.077 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:45:19.137 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:19.137 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:45:19.168 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:45:19.171 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:19.172 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:45:19.272 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:45:19.325 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:19.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:17.910418+0000 osd.6 (osd.6) 175 : cluster [DBG] 2.1a deep-scrub starts 2024-02-19T21:45:19.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:17.913616+0000 osd.6 (osd.6) 176 : cluster [DBG] 2.1a deep-scrub ok 2024-02-19T21:45:19.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:18.962316+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:45:19.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:17.910418+0000 osd.6 (osd.6) 175 : cluster [DBG] 2.1a deep-scrub starts 2024-02-19T21:45:19.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:17.913616+0000 osd.6 (osd.6) 176 : cluster [DBG] 2.1a deep-scrub ok 2024-02-19T21:45:19.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:18.962316+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:45:19.358 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:45:19.362 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:19.363 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:45:19.463 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:45:19.518 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:17.910418+0000 osd.6 (osd.6) 175 : cluster [DBG] 2.1a deep-scrub starts 2024-02-19T21:45:19.518 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:17.913616+0000 osd.6 (osd.6) 176 : cluster [DBG] 2.1a deep-scrub ok 2024-02-19T21:45:19.518 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:18.962316+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:45:19.521 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:19.548 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:45:19.550 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:19.550 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:45:19.651 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:45:19.695 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:20.076 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 48 16 81015 80999 105.457 73.6875 0.0137827 0.00947889 2024-02-19T21:45:20.466 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:45:20.479 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:45:20.504 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:19.070085+0000 mgr.y (mgr.14514) 490 : cluster [DBG] pgmap v616: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 4.6 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1023 B/s rd, 77 MiB/s wr, 1.24k op/s; 2/225405 objects misplaced (0.001%) 2024-02-19T21:45:20.504 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:19.070085+0000 mgr.y (mgr.14514) 490 : cluster [DBG] pgmap v616: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 4.6 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1023 B/s rd, 77 MiB/s wr, 1.24k op/s; 2/225405 objects misplaced (0.001%) 2024-02-19T21:45:20.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:19.070085+0000 mgr.y (mgr.14514) 490 : cluster [DBG] pgmap v616: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 4.6 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1023 B/s rd, 77 MiB/s wr, 1.24k op/s; 2/225405 objects misplaced (0.001%) 2024-02-19T21:45:21.056 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:45:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:45:21.063 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:45:21.063 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-02-19T21:45:21.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-02-19T21:45:21.063 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-02-19T21:45:21.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.063 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24317.0:1051 4.4 4:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94140601343872 gen 1] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-02-19T21:45:21.063 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:30.229453+0000", 2024-02-19T21:45:21.063 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 410.828931168, 2024-02-19T21:45:21.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.05225591, 2024-02-19T21:45:21.064 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:45:21.064 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:45:21.064 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:45:21.064 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24317", 2024-02-19T21:45:21.064 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3365055276", 2024-02-19T21:45:21.064 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1051 2024-02-19T21:45:21.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.064 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:45:21.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:45:21.064 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229453+0000", 2024-02-19T21:45:21.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:45:21.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:45:21.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229453+0000", 2024-02-19T21:45:21.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:45:21.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:45:21.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229452+0000", 2024-02-19T21:45:21.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5520000000000005e-06 2024-02-19T21:45:21.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:45:21.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229460+0000", 2024-02-19T21:45:21.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2584e-05 2024-02-19T21:45:21.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:45:21.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229473+0000", 2024-02-19T21:45:21.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5860000000000001e-06 2024-02-19T21:45:21.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:45:21.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229479+0000", 2024-02-19T21:45:21.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0021296599999999998 2024-02-19T21:45:21.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:45:21.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.231609+0000", 2024-02-19T21:45:21.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3160000000000002e-06 2024-02-19T21:45:21.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-02-19T21:45:21.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.231615+0000", 2024-02-19T21:45:21.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023975736000000001 2024-02-19T21:45:21.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:45:21.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.255591+0000", 2024-02-19T21:45:21.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7320000000000001e-06 2024-02-19T21:45:21.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:45:21.068 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.255598+0000", 2024-02-19T21:45:21.068 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0010299810000001 2024-02-19T21:45:21.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.068 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:45:21.068 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.256628+0000", 2024-02-19T21:45:21.068 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037642300000000002 2024-02-19T21:45:21.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.068 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for degraded object", 2024-02-19T21:45:21.068 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.257004+0000", 2024-02-19T21:45:21.068 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0067187469999999997 2024-02-19T21:45:21.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:45:21.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.263723+0000", 2024-02-19T21:45:21.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1997999999999997e-05 2024-02-19T21:45:21.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:45:21.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.263795+0000", 2024-02-19T21:45:21.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017914368 2024-02-19T21:45:21.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:45:21.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.281709+0000", 2024-02-19T21:45:21.070 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.05225591 2024-02-19T21:45:21.070 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.070 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:21.070 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.070 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24317.0:1052 5.0 5:05bf5b68:::notify.1:head [watch reconnect cookie 94140601335808 gen 1] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-02-19T21:45:21.070 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:30.229486+0000", 2024-02-19T21:45:21.070 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 410.82889898600001, 2024-02-19T21:45:21.070 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.084493935, 2024-02-19T21:45:21.070 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:45:21.070 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:45:21.070 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:45:21.070 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24317", 2024-02-19T21:45:21.071 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3365055276", 2024-02-19T21:45:21.071 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1052 2024-02-19T21:45:21.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.071 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:45:21.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:45:21.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229486+0000", 2024-02-19T21:45:21.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:45:21.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:45:21.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229486+0000", 2024-02-19T21:45:21.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:45:21.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:45:21.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229485+0000", 2024-02-19T21:45:21.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.852e-06 2024-02-19T21:45:21.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:45:21.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229488+0000", 2024-02-19T21:45:21.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2619999999999998e-06 2024-02-19T21:45:21.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:45:21.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229493+0000", 2024-02-19T21:45:21.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5200000000000002e-06 2024-02-19T21:45:21.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:45:21.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229497+0000", 2024-02-19T21:45:21.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.189e-05 2024-02-19T21:45:21.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:45:21.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229549+0000", 2024-02-19T21:45:21.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9360000000000002e-06 2024-02-19T21:45:21.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-02-19T21:45:21.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229556+0000", 2024-02-19T21:45:21.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.028262551 2024-02-19T21:45:21.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.074 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:45:21.074 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.257818+0000", 2024-02-19T21:45:21.074 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4749999999999999e-06 2024-02-19T21:45:21.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.074 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:45:21.074 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.257828+0000", 2024-02-19T21:45:21.074 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98989388899999997 2024-02-19T21:45:21.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.074 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:45:21.074 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.247721+0000", 2024-02-19T21:45:21.074 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032671799999999998 2024-02-19T21:45:21.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.075 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for degraded object", 2024-02-19T21:45:21.075 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.248048+0000", 2024-02-19T21:45:21.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015509772999999999 2024-02-19T21:45:21.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.075 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:45:21.075 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.263558+0000", 2024-02-19T21:45:21.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6105000000000003e-05 2024-02-19T21:45:21.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.075 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:45:21.075 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.263644+0000", 2024-02-19T21:45:21.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.050335412000000003 2024-02-19T21:45:21.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.076 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:45:21.076 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.313979+0000", 2024-02-19T21:45:21.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.084493935 2024-02-19T21:45:21.076 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.076 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:21.076 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.076 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:47301 8.a 8:50b2086c:::benchmark_data_smithi080_100924_object47300:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e173)", 2024-02-19T21:45:21.076 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:40:17.779727+0000", 2024-02-19T21:45:21.076 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 303.27865762699997, 2024-02-19T21:45:21.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.071594712000000005, 2024-02-19T21:45:21.077 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:45:21.077 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:45:21.077 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:45:21.077 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:45:21.077 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:45:21.077 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 47301 2024-02-19T21:45:21.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.077 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:45:21.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.077 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:45:21.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.779727+0000", 2024-02-19T21:45:21.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:45:21.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.077 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:45:21.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.779727+0000", 2024-02-19T21:45:21.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:45:21.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:45:21.078 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.779726+0000", 2024-02-19T21:45:21.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0078999999999999e-05 2024-02-19T21:45:21.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:45:21.078 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.779746+0000", 2024-02-19T21:45:21.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5540000000000003e-06 2024-02-19T21:45:21.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.079 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:45:21.079 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.779755+0000", 2024-02-19T21:45:21.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3769999999999998e-06 2024-02-19T21:45:21.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.079 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:45:21.079 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.779760+0000", 2024-02-19T21:45:21.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7783e-05 2024-02-19T21:45:21.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.079 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:45:21.079 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.779808+0000", 2024-02-19T21:45:21.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012571699999999999 2024-02-19T21:45:21.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:45:21.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.779933+0000", 2024-02-19T21:45:21.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017803599999999999 2024-02-19T21:45:21.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,5", 2024-02-19T21:45:21.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.780111+0000", 2024-02-19T21:45:21.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015318020000000001 2024-02-19T21:45:21.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:45:21.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.781643+0000", 2024-02-19T21:45:21.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025575480000000002 2024-02-19T21:45:21.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.784201+0000", 2024-02-19T21:45:21.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.067024392000000002 2024-02-19T21:45:21.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.851225+0000", 2024-02-19T21:45:21.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6121e-05 2024-02-19T21:45:21.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:45:21.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.851281+0000", 2024-02-19T21:45:21.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0457999999999998e-05 2024-02-19T21:45:21.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.082 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:45:21.082 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.851322+0000", 2024-02-19T21:45:21.082 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.071594712000000005 2024-02-19T21:45:21.082 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.082 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:21.082 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.082 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.082 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:47305 8.3 8:cac44c82:::benchmark_data_smithi080_100924_object47304:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e173)", 2024-02-19T21:45:21.082 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:40:17.781722+0000", 2024-02-19T21:45:21.082 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 303.27666277899999, 2024-02-19T21:45:21.082 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.069639026000000007, 2024-02-19T21:45:21.082 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:45:21.082 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:45:21.083 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:45:21.083 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:45:21.083 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:45:21.083 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 47305 2024-02-19T21:45:21.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.083 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:45:21.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:45:21.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.781722+0000", 2024-02-19T21:45:21.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:45:21.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:45:21.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.781722+0000", 2024-02-19T21:45:21.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:45:21.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:45:21.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.781721+0000", 2024-02-19T21:45:21.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4211000000000002e-05 2024-02-19T21:45:21.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:45:21.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.781755+0000", 2024-02-19T21:45:21.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1055e-05 2024-02-19T21:45:21.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:45:21.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.781766+0000", 2024-02-19T21:45:21.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8140000000000003e-06 2024-02-19T21:45:21.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:45:21.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.781773+0000", 2024-02-19T21:45:21.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8717000000000002e-05 2024-02-19T21:45:21.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:45:21.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.781811+0000", 2024-02-19T21:45:21.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117978 2024-02-19T21:45:21.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:45:21.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.781929+0000", 2024-02-19T21:45:21.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013957100000000001 2024-02-19T21:45:21.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.086 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:45:21.086 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.782069+0000", 2024-02-19T21:45:21.086 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001816846 2024-02-19T21:45:21.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.086 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:45:21.086 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.783886+0000", 2024-02-19T21:45:21.086 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032923449999999999 2024-02-19T21:45:21.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.086 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.086 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.787178+0000", 2024-02-19T21:45:21.087 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.064058207000000006 2024-02-19T21:45:21.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.087 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.087 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.851236+0000", 2024-02-19T21:45:21.087 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1557000000000005e-05 2024-02-19T21:45:21.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.087 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:45:21.087 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.851318+0000", 2024-02-19T21:45:21.087 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2833000000000001e-05 2024-02-19T21:45:21.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.087 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:45:21.088 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:40:17.851361+0000", 2024-02-19T21:45:21.088 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.069639026000000007 2024-02-19T21:45:21.088 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.088 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:21.088 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.088 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.088 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:216969 8.a 8:56a1a4cc:::benchmark_data_smithi080_100924_object89251:head [delete] snapc 0=[] ondisk+write+known_if_redirected e222)", 2024-02-19T21:45:21.088 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:01.054462+0000", 2024-02-19T21:45:21.088 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 140.003922639, 2024-02-19T21:45:21.088 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.084247599000000006, 2024-02-19T21:45:21.088 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:45:21.088 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:45:21.088 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:45:21.088 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:45:21.089 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:45:21.089 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216969 2024-02-19T21:45:21.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.089 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:45:21.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.089 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:45:21.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.054462+0000", 2024-02-19T21:45:21.089 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:45:21.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.089 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:45:21.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.054462+0000", 2024-02-19T21:45:21.089 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:45:21.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.090 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.090 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:45:21.090 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.054461+0000", 2024-02-19T21:45:21.090 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3330000000000002e-06 2024-02-19T21:45:21.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.090 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.090 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:45:21.090 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.054467+0000", 2024-02-19T21:45:21.090 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0383e-05 2024-02-19T21:45:21.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.090 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.090 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:45:21.090 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.054477+0000", 2024-02-19T21:45:21.090 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6239999999999999e-06 2024-02-19T21:45:21.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.091 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:45:21.091 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.054483+0000", 2024-02-19T21:45:21.091 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018483989999999999 2024-02-19T21:45:21.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.091 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:45:21.091 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.056331+0000", 2024-02-19T21:45:21.091 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012948500000000001 2024-02-19T21:45:21.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.091 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:45:21.091 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.056461+0000", 2024-02-19T21:45:21.091 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000142552 2024-02-19T21:45:21.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.091 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,5", 2024-02-19T21:45:21.092 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.056603+0000", 2024-02-19T21:45:21.092 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.005567743 2024-02-19T21:45:21.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.092 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:45:21.092 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.062171+0000", 2024-02-19T21:45:21.092 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001203937 2024-02-19T21:45:21.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.092 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.092 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.063375+0000", 2024-02-19T21:45:21.092 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.075269451000000001 2024-02-19T21:45:21.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.093 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.093 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.138645+0000", 2024-02-19T21:45:21.093 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9517999999999997e-05 2024-02-19T21:45:21.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.093 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.093 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:45:21.093 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.138684+0000", 2024-02-19T21:45:21.093 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5412999999999999e-05 2024-02-19T21:45:21.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.093 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.093 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:45:21.093 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.138709+0000", 2024-02-19T21:45:21.093 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.084247599000000006 2024-02-19T21:45:21.093 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.093 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:21.094 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.094 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.094 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:216977 8.7 8:efadf4f5:::benchmark_data_smithi080_100924_object89259:head [delete] snapc 0=[] ondisk+write+known_if_redirected e222)", 2024-02-19T21:45:21.094 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:01.067078+0000", 2024-02-19T21:45:21.094 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 139.991306041, 2024-02-19T21:45:21.094 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.069333170999999999, 2024-02-19T21:45:21.094 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:45:21.094 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:45:21.094 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:45:21.094 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:45:21.094 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:45:21.094 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216977 2024-02-19T21:45:21.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.094 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:45:21.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.095 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:45:21.095 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.067078+0000", 2024-02-19T21:45:21.095 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:45:21.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.095 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:45:21.095 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.067078+0000", 2024-02-19T21:45:21.095 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:45:21.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.095 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:45:21.095 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.067077+0000", 2024-02-19T21:45:21.095 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1340000000000004e-06 2024-02-19T21:45:21.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.096 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:45:21.096 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.067085+0000", 2024-02-19T21:45:21.096 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7876000000000001e-05 2024-02-19T21:45:21.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.096 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:45:21.096 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.067123+0000", 2024-02-19T21:45:21.096 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7009999999999999e-06 2024-02-19T21:45:21.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.096 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:45:21.096 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.067129+0000", 2024-02-19T21:45:21.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2144000000000004e-05 2024-02-19T21:45:21.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.097 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.097 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:45:21.097 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.067222+0000", 2024-02-19T21:45:21.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012513199999999999 2024-02-19T21:45:21.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.097 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.097 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:45:21.097 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.067347+0000", 2024-02-19T21:45:21.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014871400000000001 2024-02-19T21:45:21.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.097 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.097 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,6", 2024-02-19T21:45:21.097 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.067495+0000", 2024-02-19T21:45:21.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039859960000000003 2024-02-19T21:45:21.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.098 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.098 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.071481+0000", 2024-02-19T21:45:21.098 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0021308189999999999 2024-02-19T21:45:21.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.098 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:45:21.098 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.073612+0000", 2024-02-19T21:45:21.098 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.062710884999999994 2024-02-19T21:45:21.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.098 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.098 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.136323+0000", 2024-02-19T21:45:21.098 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8704e-05 2024-02-19T21:45:21.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.099 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:45:21.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.136372+0000", 2024-02-19T21:45:21.099 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9839000000000003e-05 2024-02-19T21:45:21.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.099 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:45:21.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.136412+0000", 2024-02-19T21:45:21.099 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.069333170999999999 2024-02-19T21:45:21.099 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.099 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:21.099 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.099 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:216978 8.7 8:e82262e4:::benchmark_data_smithi080_100924_object89260:head [delete] snapc 0=[] ondisk+write+known_if_redirected e222)", 2024-02-19T21:45:21.100 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:01.067143+0000", 2024-02-19T21:45:21.100 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 139.99124191199999, 2024-02-19T21:45:21.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.069379773000000006, 2024-02-19T21:45:21.100 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:45:21.100 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:45:21.100 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:45:21.100 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:45:21.100 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:45:21.100 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216978 2024-02-19T21:45:21.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.100 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:45:21.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:45:21.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.067143+0000", 2024-02-19T21:45:21.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:45:21.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:45:21.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.067143+0000", 2024-02-19T21:45:21.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:45:21.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:45:21.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.067142+0000", 2024-02-19T21:45:21.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3790000000000002e-06 2024-02-19T21:45:21.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.102 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:45:21.102 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.067145+0000", 2024-02-19T21:45:21.102 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9820000000000002e-06 2024-02-19T21:45:21.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.102 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.102 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:45:21.102 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.067152+0000", 2024-02-19T21:45:21.102 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8879999999999999e-06 2024-02-19T21:45:21.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.102 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.102 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:45:21.102 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.067156+0000", 2024-02-19T21:45:21.102 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024689830000000001 2024-02-19T21:45:21.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.103 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:45:21.103 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.069625+0000", 2024-02-19T21:45:21.103 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8655999999999999e-05 2024-02-19T21:45:21.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.103 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:45:21.103 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.069724+0000", 2024-02-19T21:45:21.103 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117154 2024-02-19T21:45:21.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.103 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,6", 2024-02-19T21:45:21.103 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.069841+0000", 2024-02-19T21:45:21.103 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003779981 2024-02-19T21:45:21.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.104 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:45:21.104 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.073621+0000", 2024-02-19T21:45:21.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9873999999999998e-05 2024-02-19T21:45:21.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.104 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.104 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.073661+0000", 2024-02-19T21:45:21.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.062788214999999994 2024-02-19T21:45:21.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.104 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.104 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.136449+0000", 2024-02-19T21:45:21.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8902000000000001e-05 2024-02-19T21:45:21.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:45:21.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.136488+0000", 2024-02-19T21:45:21.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4372000000000002e-05 2024-02-19T21:45:21.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:45:21.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.136522+0000", 2024-02-19T21:45:21.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.069379773000000006 2024-02-19T21:45:21.105 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.105 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:21.105 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.106 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:216981 8.3 8:cc01fd14:::benchmark_data_smithi080_100924_object89263:head [delete] snapc 0=[] ondisk+write+known_if_redirected e222)", 2024-02-19T21:45:21.106 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:01.067160+0000", 2024-02-19T21:45:21.106 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 139.99122409099999, 2024-02-19T21:45:21.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.072205228999999996, 2024-02-19T21:45:21.106 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:45:21.106 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:45:21.106 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:45:21.106 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:45:21.106 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:45:21.106 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216981 2024-02-19T21:45:21.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.106 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:45:21.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:45:21.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.067160+0000", 2024-02-19T21:45:21.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:45:21.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:45:21.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.067160+0000", 2024-02-19T21:45:21.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:45:21.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:45:21.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.067160+0000", 2024-02-19T21:45:21.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5490000000000001e-06 2024-02-19T21:45:21.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:45:21.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.067163+0000", 2024-02-19T21:45:21.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.463e-06 2024-02-19T21:45:21.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:45:21.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.067168+0000", 2024-02-19T21:45:21.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5599999999999998e-06 2024-02-19T21:45:21.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:45:21.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.067172+0000", 2024-02-19T21:45:21.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00067434600000000004 2024-02-19T21:45:21.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:45:21.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.067846+0000", 2024-02-19T21:45:21.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104199 2024-02-19T21:45:21.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:45:21.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.067950+0000", 2024-02-19T21:45:21.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121482 2024-02-19T21:45:21.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:45:21.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.068072+0000", 2024-02-19T21:45:21.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036772559999999998 2024-02-19T21:45:21.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.071749+0000", 2024-02-19T21:45:21.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4899999999999997e-06 2024-02-19T21:45:21.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:45:21.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.071755+0000", 2024-02-19T21:45:21.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.067544278999999999 2024-02-19T21:45:21.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.139300+0000", 2024-02-19T21:45:21.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9183000000000002e-05 2024-02-19T21:45:21.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:45:21.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.139329+0000", 2024-02-19T21:45:21.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6826000000000003e-05 2024-02-19T21:45:21.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:45:21.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.139366+0000", 2024-02-19T21:45:21.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.072205228999999996 2024-02-19T21:45:21.111 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.111 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:21.111 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.112 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:216984 8.7 8:ee4758d7:::benchmark_data_smithi080_100924_object89266:head [delete] snapc 0=[] ondisk+write+known_if_redirected e222)", 2024-02-19T21:45:21.112 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:01.071131+0000", 2024-02-19T21:45:21.112 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 139.98725346699999, 2024-02-19T21:45:21.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.067987789000000007, 2024-02-19T21:45:21.112 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:45:21.112 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:45:21.112 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:45:21.112 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:45:21.112 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:45:21.112 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216984 2024-02-19T21:45:21.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.112 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:45:21.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:45:21.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.071131+0000", 2024-02-19T21:45:21.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:45:21.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:45:21.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.071131+0000", 2024-02-19T21:45:21.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:45:21.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:45:21.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.071129+0000", 2024-02-19T21:45:21.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3599999999999996e-06 2024-02-19T21:45:21.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:45:21.114 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.071138+0000", 2024-02-19T21:45:21.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1612e-05 2024-02-19T21:45:21.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.114 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:45:21.114 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.071149+0000", 2024-02-19T21:45:21.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0900000000000001e-06 2024-02-19T21:45:21.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.114 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:45:21.114 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.071156+0000", 2024-02-19T21:45:21.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035399200000000002 2024-02-19T21:45:21.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:45:21.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.071509+0000", 2024-02-19T21:45:21.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010123099999999999 2024-02-19T21:45:21.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:45:21.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.071611+0000", 2024-02-19T21:45:21.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125203 2024-02-19T21:45:21.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,6", 2024-02-19T21:45:21.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.071736+0000", 2024-02-19T21:45:21.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0020131020000000001 2024-02-19T21:45:21.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:45:21.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.073749+0000", 2024-02-19T21:45:21.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022736900000000001 2024-02-19T21:45:21.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.076023+0000", 2024-02-19T21:45:21.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.062989567999999996 2024-02-19T21:45:21.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.139012+0000", 2024-02-19T21:45:21.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7120000000000003e-05 2024-02-19T21:45:21.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:45:21.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.139059+0000", 2024-02-19T21:45:21.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9413000000000002e-05 2024-02-19T21:45:21.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:45:21.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:01.139119+0000", 2024-02-19T21:45:21.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.067987789000000007 2024-02-19T21:45:21.117 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.118 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:21.118 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.118 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:221012 8.1 8:8f0796e7:::benchmark_data_smithi080_100924_object93294:head [delete] snapc 0=[] ondisk+write+known_if_redirected e226)", 2024-02-19T21:45:21.118 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:05.104151+0000", 2024-02-19T21:45:21.118 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 135.95423343499999, 2024-02-19T21:45:21.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.071057769000000007, 2024-02-19T21:45:21.118 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:45:21.118 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:45:21.118 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:45:21.118 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:45:21.118 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:45:21.118 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 221012 2024-02-19T21:45:21.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.118 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:45:21.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:45:21.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:05.104151+0000", 2024-02-19T21:45:21.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:45:21.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:45:21.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:05.104151+0000", 2024-02-19T21:45:21.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:45:21.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:45:21.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:05.104150+0000", 2024-02-19T21:45:21.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8919999999999999e-06 2024-02-19T21:45:21.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.120 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:45:21.120 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:05.104155+0000", 2024-02-19T21:45:21.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8959999999999997e-06 2024-02-19T21:45:21.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.120 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:45:21.120 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:05.104162+0000", 2024-02-19T21:45:21.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4139999999999996e-06 2024-02-19T21:45:21.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.120 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:45:21.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:05.104167+0000", 2024-02-19T21:45:21.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000146756 2024-02-19T21:45:21.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:45:21.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:05.104313+0000", 2024-02-19T21:45:21.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013074500000000001 2024-02-19T21:45:21.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:45:21.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:05.104444+0000", 2024-02-19T21:45:21.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053197909999999999 2024-02-19T21:45:21.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:45:21.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:05.109764+0000", 2024-02-19T21:45:21.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0058861169999999997 2024-02-19T21:45:21.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:45:21.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:05.115650+0000", 2024-02-19T21:45:21.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0097000660000000002 2024-02-19T21:45:21.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:05.125350+0000", 2024-02-19T21:45:21.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.049771388999999999 2024-02-19T21:45:21.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:05.175121+0000", 2024-02-19T21:45:21.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7602000000000003e-05 2024-02-19T21:45:21.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:45:21.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:05.175169+0000", 2024-02-19T21:45:21.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9830999999999999e-05 2024-02-19T21:45:21.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:45:21.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:05.175209+0000", 2024-02-19T21:45:21.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.071057769000000007 2024-02-19T21:45:21.124 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.124 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:21.124 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.124 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:235481 8.a 8:592965e1:::benchmark_data_smithi080_100924_object107763:head [delete] snapc 0=[] ondisk+write+known_if_redirected e241)", 2024-02-19T21:45:21.124 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:19.733120+0000", 2024-02-19T21:45:21.124 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 121.32526497400001, 2024-02-19T21:45:21.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.078741115, 2024-02-19T21:45:21.124 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:45:21.124 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:45:21.124 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:45:21.125 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:45:21.125 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:45:21.125 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 235481 2024-02-19T21:45:21.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.125 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:45:21.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:45:21.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.733120+0000", 2024-02-19T21:45:21.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:45:21.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:45:21.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.733120+0000", 2024-02-19T21:45:21.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:45:21.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:45:21.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.733119+0000", 2024-02-19T21:45:21.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5840000000000002e-06 2024-02-19T21:45:21.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:45:21.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.733124+0000", 2024-02-19T21:45:21.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0356e-05 2024-02-19T21:45:21.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:45:21.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.733134+0000", 2024-02-19T21:45:21.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6479999999999997e-06 2024-02-19T21:45:21.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:45:21.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.733141+0000", 2024-02-19T21:45:21.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1398e-05 2024-02-19T21:45:21.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:45:21.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.733173+0000", 2024-02-19T21:45:21.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7149000000000004e-05 2024-02-19T21:45:21.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:45:21.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.733240+0000", 2024-02-19T21:45:21.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3596000000000005e-05 2024-02-19T21:45:21.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,5", 2024-02-19T21:45:21.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.733313+0000", 2024-02-19T21:45:21.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018605340000000001 2024-02-19T21:45:21.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:45:21.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.735174+0000", 2024-02-19T21:45:21.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031266919999999999 2024-02-19T21:45:21.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.738300+0000", 2024-02-19T21:45:21.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.073461004999999996 2024-02-19T21:45:21.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.811761+0000", 2024-02-19T21:45:21.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3480999999999998e-05 2024-02-19T21:45:21.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:45:21.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.811815+0000", 2024-02-19T21:45:21.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5676000000000001e-05 2024-02-19T21:45:21.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:45:21.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.811861+0000", 2024-02-19T21:45:21.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.078741115 2024-02-19T21:45:21.130 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.130 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:21.130 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.130 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:235484 8.7 8:eefa317a:::benchmark_data_smithi080_100924_object107766:head [delete] snapc 0=[] ondisk+write+known_if_redirected e241)", 2024-02-19T21:45:21.130 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:19.740213+0000", 2024-02-19T21:45:21.130 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 121.318171492, 2024-02-19T21:45:21.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.075967186000000006, 2024-02-19T21:45:21.130 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:45:21.130 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:45:21.130 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:45:21.131 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:45:21.131 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:45:21.131 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 235484 2024-02-19T21:45:21.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.131 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:45:21.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:45:21.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740213+0000", 2024-02-19T21:45:21.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:45:21.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:45:21.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740213+0000", 2024-02-19T21:45:21.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:45:21.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:45:21.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740212+0000", 2024-02-19T21:45:21.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0829999999999998e-06 2024-02-19T21:45:21.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:45:21.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740219+0000", 2024-02-19T21:45:21.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1440000000000001e-05 2024-02-19T21:45:21.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:45:21.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740230+0000", 2024-02-19T21:45:21.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4899999999999997e-06 2024-02-19T21:45:21.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:45:21.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740237+0000", 2024-02-19T21:45:21.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2839999999999997e-05 2024-02-19T21:45:21.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:45:21.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740269+0000", 2024-02-19T21:45:21.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010362899999999999 2024-02-19T21:45:21.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:45:21.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740373+0000", 2024-02-19T21:45:21.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109707 2024-02-19T21:45:21.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,6", 2024-02-19T21:45:21.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740483+0000", 2024-02-19T21:45:21.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.070974319999999994 2024-02-19T21:45:21.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.811457+0000", 2024-02-19T21:45:21.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.528e-06 2024-02-19T21:45:21.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:45:21.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.811464+0000", 2024-02-19T21:45:21.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046206490000000001 2024-02-19T21:45:21.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.816084+0000", 2024-02-19T21:45:21.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7099000000000003e-05 2024-02-19T21:45:21.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:45:21.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.816141+0000", 2024-02-19T21:45:21.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8804999999999999e-05 2024-02-19T21:45:21.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:45:21.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.816180+0000", 2024-02-19T21:45:21.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.075967186000000006 2024-02-19T21:45:21.136 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.136 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:21.136 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.136 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:235485 8.a 8:50e17b75:::benchmark_data_smithi080_100924_object107767:head [delete] snapc 0=[] ondisk+write+known_if_redirected e241)", 2024-02-19T21:45:21.136 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:19.740255+0000", 2024-02-19T21:45:21.136 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 121.318129713, 2024-02-19T21:45:21.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.071723848000000007, 2024-02-19T21:45:21.136 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:45:21.136 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:45:21.136 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:45:21.137 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:45:21.137 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:45:21.137 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 235485 2024-02-19T21:45:21.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.137 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:45:21.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:45:21.137 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740255+0000", 2024-02-19T21:45:21.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:45:21.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:45:21.137 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740255+0000", 2024-02-19T21:45:21.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:45:21.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:45:21.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740254+0000", 2024-02-19T21:45:21.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6619999999999998e-06 2024-02-19T21:45:21.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:45:21.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740258+0000", 2024-02-19T21:45:21.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0049999999999998e-06 2024-02-19T21:45:21.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:45:21.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740265+0000", 2024-02-19T21:45:21.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7530000000000001e-06 2024-02-19T21:45:21.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:45:21.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740269+0000", 2024-02-19T21:45:21.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9391000000000003e-05 2024-02-19T21:45:21.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:45:21.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740309+0000", 2024-02-19T21:45:21.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9749999999999999e-05 2024-02-19T21:45:21.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:45:21.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740409+0000", 2024-02-19T21:45:21.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9964999999999998e-05 2024-02-19T21:45:21.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,5", 2024-02-19T21:45:21.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740489+0000", 2024-02-19T21:45:21.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.068877721000000003 2024-02-19T21:45:21.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:45:21.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.809366+0000", 2024-02-19T21:45:21.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023554679999999999 2024-02-19T21:45:21.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.811722+0000", 2024-02-19T21:45:21.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000179896 2024-02-19T21:45:21.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.811902+0000", 2024-02-19T21:45:21.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9169999999999999e-05 2024-02-19T21:45:21.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:45:21.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.811941+0000", 2024-02-19T21:45:21.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7834999999999999e-05 2024-02-19T21:45:21.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:45:21.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.811979+0000", 2024-02-19T21:45:21.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.071723848000000007 2024-02-19T21:45:21.141 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.141 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:21.141 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.142 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:235486 8.a 8:5d21566a:::benchmark_data_smithi080_100924_object107768:head [delete] snapc 0=[] ondisk+write+known_if_redirected e241)", 2024-02-19T21:45:21.142 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:19.740288+0000", 2024-02-19T21:45:21.142 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 121.318096584, 2024-02-19T21:45:21.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.077831897999999997, 2024-02-19T21:45:21.142 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:45:21.142 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:45:21.142 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:45:21.142 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:45:21.142 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:45:21.142 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 235486 2024-02-19T21:45:21.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.142 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:45:21.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:45:21.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740288+0000", 2024-02-19T21:45:21.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:45:21.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:45:21.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740288+0000", 2024-02-19T21:45:21.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:45:21.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:45:21.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740287+0000", 2024-02-19T21:45:21.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8870000000000002e-06 2024-02-19T21:45:21.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:45:21.144 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740291+0000", 2024-02-19T21:45:21.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1230000000000002e-06 2024-02-19T21:45:21.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.144 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:45:21.144 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740298+0000", 2024-02-19T21:45:21.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6410000000000001e-06 2024-02-19T21:45:21.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.144 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:45:21.144 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740303+0000", 2024-02-19T21:45:21.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.066633072000000002 2024-02-19T21:45:21.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:45:21.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.806936+0000", 2024-02-19T21:45:21.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121348 2024-02-19T21:45:21.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:45:21.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.807057+0000", 2024-02-19T21:45:21.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013179500000000001 2024-02-19T21:45:21.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,5", 2024-02-19T21:45:21.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.807189+0000", 2024-02-19T21:45:21.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004539001 2024-02-19T21:45:21.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:45:21.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.811728+0000", 2024-02-19T21:45:21.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0058609530000000003 2024-02-19T21:45:21.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.817589+0000", 2024-02-19T21:45:21.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000435964 2024-02-19T21:45:21.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.818025+0000", 2024-02-19T21:45:21.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7165e-05 2024-02-19T21:45:21.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:45:21.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.818072+0000", 2024-02-19T21:45:21.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7644e-05 2024-02-19T21:45:21.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:45:21.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.818120+0000", 2024-02-19T21:45:21.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.077831897999999997 2024-02-19T21:45:21.147 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.147 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:21.147 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.148 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:235488 8.a 8:5e9852e3:::benchmark_data_smithi080_100924_object107770:head [delete] snapc 0=[] ondisk+write+known_if_redirected e241)", 2024-02-19T21:45:21.148 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:19.740362+0000", 2024-02-19T21:45:21.148 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 121.318022274, 2024-02-19T21:45:21.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.078836319000000002, 2024-02-19T21:45:21.148 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:45:21.148 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:45:21.148 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:45:21.148 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:45:21.148 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:45:21.148 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 235488 2024-02-19T21:45:21.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.148 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:45:21.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:45:21.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740362+0000", 2024-02-19T21:45:21.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:45:21.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:45:21.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740362+0000", 2024-02-19T21:45:21.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:45:21.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:45:21.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740361+0000", 2024-02-19T21:45:21.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9370000000000003e-06 2024-02-19T21:45:21.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:45:21.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740366+0000", 2024-02-19T21:45:21.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2400000000000007e-06 2024-02-19T21:45:21.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:45:21.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740375+0000", 2024-02-19T21:45:21.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2889999999999997e-06 2024-02-19T21:45:21.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:45:21.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740380+0000", 2024-02-19T21:45:21.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.069012914999999994 2024-02-19T21:45:21.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:45:21.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.809393+0000", 2024-02-19T21:45:21.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106384 2024-02-19T21:45:21.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:45:21.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.809499+0000", 2024-02-19T21:45:21.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013233099999999999 2024-02-19T21:45:21.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,5", 2024-02-19T21:45:21.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.809631+0000", 2024-02-19T21:45:21.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049474499999999999 2024-02-19T21:45:21.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:45:21.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.814579+0000", 2024-02-19T21:45:21.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035741919999999999 2024-02-19T21:45:21.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.818153+0000", 2024-02-19T21:45:21.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00093479200000000004 2024-02-19T21:45:21.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.819088+0000", 2024-02-19T21:45:21.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3257999999999996e-05 2024-02-19T21:45:21.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:45:21.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.819161+0000", 2024-02-19T21:45:21.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7388000000000002e-05 2024-02-19T21:45:21.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:45:21.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.819199+0000", 2024-02-19T21:45:21.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.078836319000000002 2024-02-19T21:45:21.154 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.154 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:21.154 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.154 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.24932.0:235487 8.f e241/165 8:f5fa13c3:::benchmark_data_smithi080_100924_object107769:head v 241'14574, mlcod=241'14571)", 2024-02-19T21:45:21.154 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:19.740640+0000", 2024-02-19T21:45:21.154 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 121.31774404799999, 2024-02-19T21:45:21.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.075572748999999995, 2024-02-19T21:45:21.154 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:45:21.155 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:45:21.155 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:45:21.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:45:21.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740640+0000", 2024-02-19T21:45:21.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:45:21.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:45:21.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740640+0000", 2024-02-19T21:45:21.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:45:21.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:45:21.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740640+0000", 2024-02-19T21:45:21.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0979999999999996e-06 2024-02-19T21:45:21.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:45:21.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740647+0000", 2024-02-19T21:45:21.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6660000000000003e-06 2024-02-19T21:45:21.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:45:21.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740656+0000", 2024-02-19T21:45:21.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6690000000000003e-06 2024-02-19T21:45:21.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:45:21.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740662+0000", 2024-02-19T21:45:21.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.065918421000000005 2024-02-19T21:45:21.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:45:21.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.806581+0000", 2024-02-19T21:45:21.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5908e-05 2024-02-19T21:45:21.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:45:21.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.806606+0000", 2024-02-19T21:45:21.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0095784979999999995 2024-02-19T21:45:21.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:45:21.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.816185+0000", 2024-02-19T21:45:21.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8291000000000001e-05 2024-02-19T21:45:21.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:45:21.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.816213+0000", 2024-02-19T21:45:21.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.075572748999999995 2024-02-19T21:45:21.158 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.158 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:21.158 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.158 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:235491 8.a 8:568d0043:::benchmark_data_smithi080_100924_object107773:head [delete] snapc 0=[] ondisk+write+known_if_redirected e241)", 2024-02-19T21:45:21.158 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:19.741666+0000", 2024-02-19T21:45:21.158 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 121.316718842, 2024-02-19T21:45:21.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.077641357999999994, 2024-02-19T21:45:21.159 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:45:21.159 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:45:21.159 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:45:21.159 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:45:21.159 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:45:21.159 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 235491 2024-02-19T21:45:21.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.159 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:45:21.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:45:21.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.741666+0000", 2024-02-19T21:45:21.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:45:21.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:45:21.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.741666+0000", 2024-02-19T21:45:21.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:45:21.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:45:21.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.741665+0000", 2024-02-19T21:45:21.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9569999999999999e-06 2024-02-19T21:45:21.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:45:21.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.741671+0000", 2024-02-19T21:45:21.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.065434112000000003 2024-02-19T21:45:21.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:45:21.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.807105+0000", 2024-02-19T21:45:21.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2280000000000004e-06 2024-02-19T21:45:21.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:45:21.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.807114+0000", 2024-02-19T21:45:21.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049419010000000003 2024-02-19T21:45:21.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:45:21.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.812056+0000", 2024-02-19T21:45:21.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000133685 2024-02-19T21:45:21.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:45:21.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.812189+0000", 2024-02-19T21:45:21.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013994100000000001 2024-02-19T21:45:21.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,5", 2024-02-19T21:45:21.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.812329+0000", 2024-02-19T21:45:21.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024204059999999999 2024-02-19T21:45:21.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:45:21.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.814750+0000", 2024-02-19T21:45:21.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003428941 2024-02-19T21:45:21.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.818179+0000", 2024-02-19T21:45:21.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010540969999999999 2024-02-19T21:45:21.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.819233+0000", 2024-02-19T21:45:21.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8624999999999997e-05 2024-02-19T21:45:21.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:45:21.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.819271+0000", 2024-02-19T21:45:21.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5552000000000001e-05 2024-02-19T21:45:21.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:45:21.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.819307+0000", 2024-02-19T21:45:21.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.077641357999999994 2024-02-19T21:45:21.164 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.164 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:21.164 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.164 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop_reply(client.24932.0:235485 8.a e241/165 ondisk, result = 0)", 2024-02-19T21:45:21.164 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:19.742479+0000", 2024-02-19T21:45:21.164 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 121.31590535700001, 2024-02-19T21:45:21.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.069250113000000002, 2024-02-19T21:45:21.165 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:45:21.165 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:45:21.165 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:45:21.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:45:21.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.742479+0000", 2024-02-19T21:45:21.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:45:21.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:45:21.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.742479+0000", 2024-02-19T21:45:21.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:45:21.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:45:21.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.742478+0000", 2024-02-19T21:45:21.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7690000000000002e-06 2024-02-19T21:45:21.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:45:21.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.742484+0000", 2024-02-19T21:45:21.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.064445296999999999 2024-02-19T21:45:21.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:45:21.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.806929+0000", 2024-02-19T21:45:21.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9450000000000005e-06 2024-02-19T21:45:21.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:45:21.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.806939+0000", 2024-02-19T21:45:21.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047680489999999999 2024-02-19T21:45:21.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:45:21.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.811707+0000", 2024-02-19T21:45:21.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0119999999999999e-06 2024-02-19T21:45:21.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:45:21.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.811714+0000", 2024-02-19T21:45:21.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4792e-05 2024-02-19T21:45:21.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:45:21.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.811729+0000", 2024-02-19T21:45:21.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.069250113000000002 2024-02-19T21:45:21.168 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.168 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:21.168 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.168 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:241765 8.7 8:ebaa2ed5:::benchmark_data_smithi080_100924_object114047:head [delete] snapc 0=[] ondisk+write+known_if_redirected e244)", 2024-02-19T21:45:21.168 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:26.140971+0000", 2024-02-19T21:45:21.168 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 114.917413524, 2024-02-19T21:45:21.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.073294274000000006, 2024-02-19T21:45:21.168 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:45:21.168 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:45:21.168 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:45:21.169 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:45:21.169 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:45:21.169 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 241765 2024-02-19T21:45:21.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.169 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:45:21.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:45:21.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:26.140971+0000", 2024-02-19T21:45:21.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:45:21.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:45:21.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:26.140971+0000", 2024-02-19T21:45:21.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:45:21.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:45:21.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:26.140971+0000", 2024-02-19T21:45:21.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7199999999999998e-06 2024-02-19T21:45:21.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:45:21.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:26.140973+0000", 2024-02-19T21:45:21.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0050000000000004e-06 2024-02-19T21:45:21.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:45:21.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:26.140978+0000", 2024-02-19T21:45:21.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.72e-06 2024-02-19T21:45:21.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:45:21.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:26.140982+0000", 2024-02-19T21:45:21.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7051999999999997e-05 2024-02-19T21:45:21.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:45:21.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:26.141019+0000", 2024-02-19T21:45:21.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000124375 2024-02-19T21:45:21.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:45:21.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:26.141143+0000", 2024-02-19T21:45:21.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119492 2024-02-19T21:45:21.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,6", 2024-02-19T21:45:21.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:26.141263+0000", 2024-02-19T21:45:21.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.007264843 2024-02-19T21:45:21.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:26.148528+0000", 2024-02-19T21:45:21.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0080284369999999994 2024-02-19T21:45:21.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:45:21.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:26.156556+0000", 2024-02-19T21:45:21.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.057599121000000003 2024-02-19T21:45:21.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:26.214155+0000", 2024-02-19T21:45:21.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8010999999999996e-05 2024-02-19T21:45:21.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:45:21.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:26.214223+0000", 2024-02-19T21:45:21.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1854999999999998e-05 2024-02-19T21:45:21.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:45:21.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:26.214265+0000", 2024-02-19T21:45:21.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.073294274000000006 2024-02-19T21:45:21.174 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.174 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:21.174 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.174 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:241771 8.7 8:e08d4358:::benchmark_data_smithi080_100924_object114053:head [delete] snapc 0=[] ondisk+write+known_if_redirected e244)", 2024-02-19T21:45:21.174 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:26.145331+0000", 2024-02-19T21:45:21.174 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 114.91305385299999, 2024-02-19T21:45:21.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.069126120999999999, 2024-02-19T21:45:21.174 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:45:21.175 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:45:21.175 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:45:21.175 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:45:21.175 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:45:21.175 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 241771 2024-02-19T21:45:21.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.175 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:45:21.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:45:21.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:26.145331+0000", 2024-02-19T21:45:21.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:45:21.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:45:21.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:26.145331+0000", 2024-02-19T21:45:21.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:45:21.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:45:21.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:26.145329+0000", 2024-02-19T21:45:21.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5110000000000003e-06 2024-02-19T21:45:21.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:45:21.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:26.145338+0000", 2024-02-19T21:45:21.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2879e-05 2024-02-19T21:45:21.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:45:21.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:26.145350+0000", 2024-02-19T21:45:21.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7479999999999996e-06 2024-02-19T21:45:21.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:45:21.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:26.145357+0000", 2024-02-19T21:45:21.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000626755 2024-02-19T21:45:21.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:45:21.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:26.145984+0000", 2024-02-19T21:45:21.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106334 2024-02-19T21:45:21.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:45:21.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:26.146090+0000", 2024-02-19T21:45:21.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012819700000000001 2024-02-19T21:45:21.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,6", 2024-02-19T21:45:21.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:26.146218+0000", 2024-02-19T21:45:21.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049207419999999997 2024-02-19T21:45:21.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:26.151139+0000", 2024-02-19T21:45:21.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054722290000000003 2024-02-19T21:45:21.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:45:21.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:26.156611+0000", 2024-02-19T21:45:21.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.057769046999999997 2024-02-19T21:45:21.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:45:21.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:26.214380+0000", 2024-02-19T21:45:21.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4508000000000001e-05 2024-02-19T21:45:21.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.180 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:45:21.180 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:26.214435+0000", 2024-02-19T21:45:21.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1761000000000001e-05 2024-02-19T21:45:21.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:45:21.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:45:21.180 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:45:21.180 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:26.214457+0000", 2024-02-19T21:45:21.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.069126120999999999 2024-02-19T21:45:21.180 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.180 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:21.180 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.180 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:45:21.180 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:45:21.181 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:45:21.181 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 49 16 82211 82195 104.831 74.75 0.0116825 0.0095345 2024-02-19T21:45:21.181 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:45:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:45:20] "GET /metrics HTTP/1.1" 200 176118 "" "Prometheus/2.33.4" 2024-02-19T21:45:21.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:19.594212+0000 osd.1 (osd.1) 193 : cluster [DBG] 5.12 scrub starts 2024-02-19T21:45:21.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:19.596769+0000 osd.1 (osd.1) 194 : cluster [DBG] 5.12 scrub ok 2024-02-19T21:45:21.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:20.152500+0000 osd.0 (osd.0) 210 : cluster [DBG] 2.13 deep-scrub starts 2024-02-19T21:45:21.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:20.157474+0000 osd.0 (osd.0) 211 : cluster [DBG] 2.13 deep-scrub ok 2024-02-19T21:45:21.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:20.442827+0000 mgr.y (mgr.14514) 491 : audit [DBG] from='client.25123 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:45:21.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:20.492422+0000 osd.3 (osd.3) 198 : cluster [DBG] 4.1b deep-scrub starts 2024-02-19T21:45:21.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:20.506177+0000 osd.3 (osd.3) 199 : cluster [DBG] 4.1b deep-scrub ok 2024-02-19T21:45:21.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:20.579284+0000 mgr.y (mgr.14514) 492 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:45:21.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:20.933005+0000 osd.6 (osd.6) 177 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:45:21.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:20.935715+0000 osd.6 (osd.6) 178 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:45:21.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:19.594212+0000 osd.1 (osd.1) 193 : cluster [DBG] 5.12 scrub starts 2024-02-19T21:45:21.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:19.596769+0000 osd.1 (osd.1) 194 : cluster [DBG] 5.12 scrub ok 2024-02-19T21:45:21.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:20.152500+0000 osd.0 (osd.0) 210 : cluster [DBG] 2.13 deep-scrub starts 2024-02-19T21:45:21.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:20.157474+0000 osd.0 (osd.0) 211 : cluster [DBG] 2.13 deep-scrub ok 2024-02-19T21:45:21.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:20.442827+0000 mgr.y (mgr.14514) 491 : audit [DBG] from='client.25123 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:45:21.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:20.492422+0000 osd.3 (osd.3) 198 : cluster [DBG] 4.1b deep-scrub starts 2024-02-19T21:45:21.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:20.506177+0000 osd.3 (osd.3) 199 : cluster [DBG] 4.1b deep-scrub ok 2024-02-19T21:45:21.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:20.579284+0000 mgr.y (mgr.14514) 492 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:45:21.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:20.933005+0000 osd.6 (osd.6) 177 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:45:21.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:20.935715+0000 osd.6 (osd.6) 178 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:45:21.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:19.594212+0000 osd.1 (osd.1) 193 : cluster [DBG] 5.12 scrub starts 2024-02-19T21:45:21.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:19.596769+0000 osd.1 (osd.1) 194 : cluster [DBG] 5.12 scrub ok 2024-02-19T21:45:21.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:20.152500+0000 osd.0 (osd.0) 210 : cluster [DBG] 2.13 deep-scrub starts 2024-02-19T21:45:21.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:20.157474+0000 osd.0 (osd.0) 211 : cluster [DBG] 2.13 deep-scrub ok 2024-02-19T21:45:21.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:20.442827+0000 mgr.y (mgr.14514) 491 : audit [DBG] from='client.25123 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:45:21.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:20.492422+0000 osd.3 (osd.3) 198 : cluster [DBG] 4.1b deep-scrub starts 2024-02-19T21:45:21.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:20.506177+0000 osd.3 (osd.3) 199 : cluster [DBG] 4.1b deep-scrub ok 2024-02-19T21:45:21.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:20.579284+0000 mgr.y (mgr.14514) 492 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:45:21.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:20.933005+0000 osd.6 (osd.6) 177 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:45:21.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:20.935715+0000 osd.6 (osd.6) 178 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:45:21.869 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":616,"stamp":"2024-02-19T21:45:19.069822+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4911470422,"num_objects":75135,"num_object_clones":0,"num_object_copies":225405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":75135,"num_whiteouts":0,"num_read":1891,"num_read_kb":1643,"num_write":75656,"num_write_kb":4796392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":4535,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69048,"ondisk_log_size":69048,"up":414,"acting":414,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":416,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":656216064,"kb_used":16431812,"kb_used_data":14314380,"kb_used_omap":0,"kb_used_meta":2117376,"kb_avail":639784252,"statfs":{"total":671965249536,"available":655139074048,"internally_reserved":0,"allocated":14657925120,"data_stored":14653488138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2168193024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":812974264,"num_objects":12405,"num_object_clones":0,"num_object_copies":37215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12405,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":12404,"num_write_kb":793919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":-554,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.009651"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":307,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.900483+0000","last_change":"2024-02-19T21:44:58.792331+0000","last_active":"2024-02-19T21:45:07.900483+0000","last_peered":"2024-02-19T21:45:07.900483+0000","last_clean":"2024-02-19T21:45:07.900483+0000","last_became_active":"2024-02-19T21:44:58.791985+0000","last_became_peered":"2024-02-19T21:44:58.791985+0000","last_unstale":"2024-02-19T21:45:07.900483+0000","last_undegraded":"2024-02-19T21:45:07.900483+0000","last_fullsized":"2024-02-19T21:45:07.900483+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:35.539219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:40:35.539219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":280,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.895739+0000","last_change":"2024-02-19T21:40:28.473842+0000","last_active":"2024-02-19T21:45:07.895739+0000","last_peered":"2024-02-19T21:45:07.895739+0000","last_clean":"2024-02-19T21:45:07.895739+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:45:07.895739+0000","last_undegraded":"2024-02-19T21:45:07.895739+0000","last_fullsized":"2024-02-19T21:45:07.895739+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:28.473778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:40:28.473778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"201'27","reported_seq":257,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.897612+0000","last_change":"2024-02-19T21:44:48.022082+0000","last_active":"2024-02-19T21:45:07.897612+0000","last_peered":"2024-02-19T21:45:07.897612+0000","last_clean":"2024-02-19T21:45:07.897612+0000","last_became_active":"2024-02-19T21:39:51.536424+0000","last_became_peered":"2024-02-19T21:39:51.536424+0000","last_unstale":"2024-02-19T21:45:07.897612+0000","last_undegraded":"2024-02-19T21:45:07.897612+0000","last_fullsized":"2024-02-19T21:45:07.897612+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'27","last_scrub_stamp":"2024-02-19T21:44:48.022013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:48.022013+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":308,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.901196+0000","last_change":"2024-02-19T21:44:58.789873+0000","last_active":"2024-02-19T21:45:07.901196+0000","last_peered":"2024-02-19T21:45:07.901196+0000","last_clean":"2024-02-19T21:45:07.901196+0000","last_became_active":"2024-02-19T21:44:58.789475+0000","last_became_peered":"2024-02-19T21:44:58.789475+0000","last_unstale":"2024-02-19T21:45:07.901196+0000","last_undegraded":"2024-02-19T21:45:07.901196+0000","last_fullsized":"2024-02-19T21:45:07.901196+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:17.853016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:40:17.853016+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":282,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.903747+0000","last_change":"2024-02-19T21:44:09.544309+0000","last_active":"2024-02-19T21:45:07.903747+0000","last_peered":"2024-02-19T21:45:07.903747+0000","last_clean":"2024-02-19T21:45:07.903747+0000","last_became_active":"2024-02-19T21:32:23.356975+0000","last_became_peered":"2024-02-19T21:32:23.356975+0000","last_unstale":"2024-02-19T21:45:07.903747+0000","last_undegraded":"2024-02-19T21:45:07.903747+0000","last_fullsized":"2024-02-19T21:45:07.903747+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:09.544245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:44:09.544245+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"200'19","reported_seq":324,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.889394+0000","last_change":"2024-02-19T21:44:08.556202+0000","last_active":"2024-02-19T21:45:07.889394+0000","last_peered":"2024-02-19T21:45:07.889394+0000","last_clean":"2024-02-19T21:45:07.889394+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:45:07.889394+0000","last_undegraded":"2024-02-19T21:45:07.889394+0000","last_fullsized":"2024-02-19T21:45:07.889394+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:44:08.556123+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:44:08.556123+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.901155+0000","last_change":"2024-02-19T21:44:58.787250+0000","last_active":"2024-02-19T21:45:07.901155+0000","last_peered":"2024-02-19T21:45:07.901155+0000","last_clean":"2024-02-19T21:45:07.901155+0000","last_became_active":"2024-02-19T21:44:58.786889+0000","last_became_peered":"2024-02-19T21:44:58.786889+0000","last_unstale":"2024-02-19T21:45:07.901155+0000","last_undegraded":"2024-02-19T21:45:07.901155+0000","last_fullsized":"2024-02-19T21:45:07.901155+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:42.230664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:42.230664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":285,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.896299+0000","last_change":"2024-02-19T21:45:00.643941+0000","last_active":"2024-02-19T21:45:07.896299+0000","last_peered":"2024-02-19T21:45:07.896299+0000","last_clean":"2024-02-19T21:45:07.896299+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:45:07.896299+0000","last_undegraded":"2024-02-19T21:45:07.896299+0000","last_fullsized":"2024-02-19T21:45:07.896299+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:00.643880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:08.490788+0000","last_clean_scrub_stamp":"2024-02-19T21:45:00.643880+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"200'7","reported_seq":277,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.904059+0000","last_change":"2024-02-19T21:44:07.580183+0000","last_active":"2024-02-19T21:45:07.904059+0000","last_peered":"2024-02-19T21:45:07.904059+0000","last_clean":"2024-02-19T21:45:07.904059+0000","last_became_active":"2024-02-19T21:39:39.471143+0000","last_became_peered":"2024-02-19T21:39:39.471143+0000","last_unstale":"2024-02-19T21:45:07.904059+0000","last_undegraded":"2024-02-19T21:45:07.904059+0000","last_fullsized":"2024-02-19T21:45:07.904059+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'7","last_scrub_stamp":"2024-02-19T21:44:07.580118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:07.580118+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":193,"reported_epoch":309,"state":"active+remapped+backfill_toofull","last_fresh":"2024-02-19T21:45:07.894171+0000","last_change":"2024-02-19T21:44:59.818080+0000","last_active":"2024-02-19T21:45:07.894171+0000","last_peered":"2024-02-19T21:45:07.894171+0000","last_clean":"2024-02-19T21:43:10.331595+0000","last_became_active":"2024-02-19T21:44:59.810536+0000","last_became_peered":"2024-02-19T21:44:59.810536+0000","last_unstale":"2024-02-19T21:45:07.894171+0000","last_undegraded":"2024-02-19T21:45:07.894171+0000","last_fullsized":"2024-02-19T21:45:07.894171+0000","mapping_epoch":305,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:36.890201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.890201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,3,6],"avail_no_missing":["0","3","6"],"object_location_counts":[{"shards":"0,3,6","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":292,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.896173+0000","last_change":"2024-02-19T21:44:17.172601+0000","last_active":"2024-02-19T21:45:07.896173+0000","last_peered":"2024-02-19T21:45:07.896173+0000","last_clean":"2024-02-19T21:45:07.896173+0000","last_became_active":"2024-02-19T21:39:39.473759+0000","last_became_peered":"2024-02-19T21:39:39.473759+0000","last_unstale":"2024-02-19T21:45:07.896173+0000","last_undegraded":"2024-02-19T21:45:07.896173+0000","last_fullsized":"2024-02-19T21:45:07.896173+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:17.172541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:17.172541+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"200'19","reported_seq":305,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.902230+0000","last_change":"2024-02-19T21:44:50.652809+0000","last_active":"2024-02-19T21:45:07.902230+0000","last_peered":"2024-02-19T21:45:07.902230+0000","last_clean":"2024-02-19T21:45:07.902230+0000","last_became_active":"2024-02-19T21:35:14.514971+0000","last_became_peered":"2024-02-19T21:35:14.514971+0000","last_unstale":"2024-02-19T21:45:07.902230+0000","last_undegraded":"2024-02-19T21:45:07.902230+0000","last_fullsized":"2024-02-19T21:45:07.902230+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:44:50.652700+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:44:50.652700+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":20,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.902257+0000","last_change":"2024-02-19T21:45:06.621907+0000","last_active":"2024-02-19T21:45:07.902257+0000","last_peered":"2024-02-19T21:45:07.902257+0000","last_clean":"2024-02-19T21:45:07.902257+0000","last_became_active":"2024-02-19T21:44:58.789418+0000","last_became_peered":"2024-02-19T21:44:58.789418+0000","last_unstale":"2024-02-19T21:45:07.902257+0000","last_undegraded":"2024-02-19T21:45:07.902257+0000","last_fullsized":"2024-02-19T21:45:07.902257+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:06.621809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:45:06.621809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":165,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.900672+0000","last_change":"2024-02-19T21:44:51.194621+0000","last_active":"2024-02-19T21:45:07.900672+0000","last_peered":"2024-02-19T21:45:07.900672+0000","last_clean":"2024-02-19T21:45:07.900672+0000","last_became_active":"2024-02-19T21:42:04.201106+0000","last_became_peered":"2024-02-19T21:42:04.201106+0000","last_unstale":"2024-02-19T21:45:07.900672+0000","last_undegraded":"2024-02-19T21:45:07.900672+0000","last_fullsized":"2024-02-19T21:45:07.900672+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:51.194543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:51.194543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,5],"acting":[6,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"201'18","reported_seq":243,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.904791+0000","last_change":"2024-02-19T21:44:15.699369+0000","last_active":"2024-02-19T21:45:07.904791+0000","last_peered":"2024-02-19T21:45:07.904791+0000","last_clean":"2024-02-19T21:45:07.904791+0000","last_became_active":"2024-02-19T21:38:31.247067+0000","last_became_peered":"2024-02-19T21:38:31.247067+0000","last_unstale":"2024-02-19T21:45:07.904791+0000","last_undegraded":"2024-02-19T21:45:07.904791+0000","last_fullsized":"2024-02-19T21:45:07.904791+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'18","last_scrub_stamp":"2024-02-19T21:44:15.699279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.699279+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":275,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.891384+0000","last_change":"2024-02-19T21:45:03.152371+0000","last_active":"2024-02-19T21:45:07.891384+0000","last_peered":"2024-02-19T21:45:07.891384+0000","last_clean":"2024-02-19T21:45:07.891384+0000","last_became_active":"2024-02-19T21:44:58.788307+0000","last_became_peered":"2024-02-19T21:44:58.788307+0000","last_unstale":"2024-02-19T21:45:07.891384+0000","last_undegraded":"2024-02-19T21:45:07.891384+0000","last_fullsized":"2024-02-19T21:45:07.891384+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:03.152272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:45:03.152272+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":283,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.899939+0000","last_change":"2024-02-19T21:40:38.600031+0000","last_active":"2024-02-19T21:45:07.899939+0000","last_peered":"2024-02-19T21:45:07.899939+0000","last_clean":"2024-02-19T21:45:07.899939+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:45:07.899939+0000","last_undegraded":"2024-02-19T21:45:07.899939+0000","last_fullsized":"2024-02-19T21:45:07.899939+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:38.599939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:38.599939+0000","last_clean_scrub_stamp":"2024-02-19T21:40:38.599939+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"200'34","reported_seq":266,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.904366+0000","last_change":"2024-02-19T21:40:36.287163+0000","last_active":"2024-02-19T21:45:07.904366+0000","last_peered":"2024-02-19T21:45:07.904366+0000","last_clean":"2024-02-19T21:45:07.904366+0000","last_became_active":"2024-02-19T21:39:39.477429+0000","last_became_peered":"2024-02-19T21:39:39.477429+0000","last_unstale":"2024-02-19T21:45:07.904366+0000","last_undegraded":"2024-02-19T21:45:07.904366+0000","last_fullsized":"2024-02-19T21:45:07.904366+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'22","last_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.287051+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":300,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.904522+0000","last_change":"2024-02-19T21:44:58.790954+0000","last_active":"2024-02-19T21:45:07.904522+0000","last_peered":"2024-02-19T21:45:07.904522+0000","last_clean":"2024-02-19T21:45:07.904522+0000","last_became_active":"2024-02-19T21:44:58.790669+0000","last_became_peered":"2024-02-19T21:44:58.790669+0000","last_unstale":"2024-02-19T21:45:07.904522+0000","last_undegraded":"2024-02-19T21:45:07.904522+0000","last_fullsized":"2024-02-19T21:45:07.904522+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:16.845272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:16.845272+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":212,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.899941+0000","last_change":"2024-02-19T21:44:47.281527+0000","last_active":"2024-02-19T21:45:07.899941+0000","last_peered":"2024-02-19T21:45:07.899941+0000","last_clean":"2024-02-19T21:45:07.899941+0000","last_became_active":"2024-02-19T21:42:04.198592+0000","last_became_peered":"2024-02-19T21:42:04.198592+0000","last_unstale":"2024-02-19T21:45:07.899941+0000","last_undegraded":"2024-02-19T21:45:07.899941+0000","last_fullsized":"2024-02-19T21:45:07.899941+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:47.281454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:47.281454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"201'19","reported_seq":184,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.895671+0000","last_change":"2024-02-19T21:45:02.090506+0000","last_active":"2024-02-19T21:45:07.895671+0000","last_peered":"2024-02-19T21:45:07.895671+0000","last_clean":"2024-02-19T21:45:07.895671+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:45:07.895671+0000","last_undegraded":"2024-02-19T21:45:07.895671+0000","last_fullsized":"2024-02-19T21:45:07.895671+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:45:02.090422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:02.090422+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":106,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:12.526572+0000","last_change":"2024-02-19T21:45:12.526572+0000","last_active":"2024-02-19T21:45:12.526572+0000","last_peered":"2024-02-19T21:45:12.526572+0000","last_clean":"2024-02-19T21:45:12.526572+0000","last_became_active":"2024-02-19T21:45:01.146656+0000","last_became_peered":"2024-02-19T21:45:01.146656+0000","last_unstale":"2024-02-19T21:45:12.526572+0000","last_undegraded":"2024-02-19T21:45:12.526572+0000","last_fullsized":"2024-02-19T21:45:12.526572+0000","mapping_epoch":307,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":308,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:45:12.526466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.526466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":293,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.901243+0000","last_change":"2024-02-19T21:44:14.474971+0000","last_active":"2024-02-19T21:45:07.901243+0000","last_peered":"2024-02-19T21:45:07.901243+0000","last_clean":"2024-02-19T21:45:07.901243+0000","last_became_active":"2024-02-19T21:42:04.199323+0000","last_became_peered":"2024-02-19T21:42:04.199323+0000","last_unstale":"2024-02-19T21:45:07.901243+0000","last_undegraded":"2024-02-19T21:45:07.901243+0000","last_fullsized":"2024-02-19T21:45:07.901243+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:14.474903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:44:14.474903+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"201'20","reported_seq":364,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.894089+0000","last_change":"2024-02-19T21:44:51.032776+0000","last_active":"2024-02-19T21:45:07.894089+0000","last_peered":"2024-02-19T21:45:07.894089+0000","last_clean":"2024-02-19T21:45:07.894089+0000","last_became_active":"2024-02-19T21:42:04.204882+0000","last_became_peered":"2024-02-19T21:42:04.204882+0000","last_unstale":"2024-02-19T21:45:07.894089+0000","last_undegraded":"2024-02-19T21:45:07.894089+0000","last_fullsized":"2024-02-19T21:45:07.894089+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:44:51.032704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:51.032704+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":196,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.897155+0000","last_change":"2024-02-19T21:44:18.094565+0000","last_active":"2024-02-19T21:45:07.897155+0000","last_peered":"2024-02-19T21:45:07.897155+0000","last_clean":"2024-02-19T21:45:07.897155+0000","last_became_active":"2024-02-19T21:39:39.471332+0000","last_became_peered":"2024-02-19T21:39:39.471332+0000","last_unstale":"2024-02-19T21:45:07.897155+0000","last_undegraded":"2024-02-19T21:45:07.897155+0000","last_fullsized":"2024-02-19T21:45:07.897155+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:18.094477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:44:18.094477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":281,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:10.521912+0000","last_change":"2024-02-19T21:45:10.521912+0000","last_active":"2024-02-19T21:45:10.521912+0000","last_peered":"2024-02-19T21:45:10.521912+0000","last_clean":"2024-02-19T21:45:10.521912+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:45:10.521912+0000","last_undegraded":"2024-02-19T21:45:10.521912+0000","last_fullsized":"2024-02-19T21:45:10.521912+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:10.521830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:45:10.521830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":292,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.900128+0000","last_change":"2024-02-19T21:44:11.227806+0000","last_active":"2024-02-19T21:45:07.900128+0000","last_peered":"2024-02-19T21:45:07.900128+0000","last_clean":"2024-02-19T21:45:07.900128+0000","last_became_active":"2024-02-19T21:39:39.478633+0000","last_became_peered":"2024-02-19T21:39:39.478633+0000","last_unstale":"2024-02-19T21:45:07.900128+0000","last_undegraded":"2024-02-19T21:45:07.900128+0000","last_fullsized":"2024-02-19T21:45:07.900128+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:11.227741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:11.227741+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"201'19","reported_seq":332,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.902432+0000","last_change":"2024-02-19T21:44:10.534619+0000","last_active":"2024-02-19T21:45:07.902432+0000","last_peered":"2024-02-19T21:45:07.902432+0000","last_clean":"2024-02-19T21:45:07.902432+0000","last_became_active":"2024-02-19T21:42:04.205379+0000","last_became_peered":"2024-02-19T21:42:04.205379+0000","last_unstale":"2024-02-19T21:45:07.902432+0000","last_undegraded":"2024-02-19T21:45:07.902432+0000","last_fullsized":"2024-02-19T21:45:07.902432+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:44:10.534549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:10.534549+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":281,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.896145+0000","last_change":"2024-02-19T21:44:09.151576+0000","last_active":"2024-02-19T21:45:07.896145+0000","last_peered":"2024-02-19T21:45:07.896145+0000","last_clean":"2024-02-19T21:45:07.896145+0000","last_became_active":"2024-02-19T21:39:39.471306+0000","last_became_peered":"2024-02-19T21:39:39.471306+0000","last_unstale":"2024-02-19T21:45:07.896145+0000","last_undegraded":"2024-02-19T21:45:07.896145+0000","last_fullsized":"2024-02-19T21:45:07.896145+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:09.151490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:44:09.151490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":322,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.900059+0000","last_change":"2024-02-19T21:44:07.235190+0000","last_active":"2024-02-19T21:45:07.900059+0000","last_peered":"2024-02-19T21:45:07.900059+0000","last_clean":"2024-02-19T21:45:07.900059+0000","last_became_active":"2024-02-19T21:42:04.196794+0000","last_became_peered":"2024-02-19T21:42:04.196794+0000","last_unstale":"2024-02-19T21:45:07.900059+0000","last_undegraded":"2024-02-19T21:45:07.900059+0000","last_fullsized":"2024-02-19T21:45:07.900059+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:07.235071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:07.235071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":288,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.902520+0000","last_change":"2024-02-19T21:44:11.487571+0000","last_active":"2024-02-19T21:45:07.902520+0000","last_peered":"2024-02-19T21:45:07.902520+0000","last_clean":"2024-02-19T21:45:07.902520+0000","last_became_active":"2024-02-19T21:39:39.479927+0000","last_became_peered":"2024-02-19T21:39:39.479927+0000","last_unstale":"2024-02-19T21:45:07.902520+0000","last_undegraded":"2024-02-19T21:45:07.902520+0000","last_fullsized":"2024-02-19T21:45:07.902520+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:11.487509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:44:11.487509+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"200'8","reported_seq":145,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.902999+0000","last_change":"2024-02-19T21:44:55.590425+0000","last_active":"2024-02-19T21:45:07.902999+0000","last_peered":"2024-02-19T21:45:07.902999+0000","last_clean":"2024-02-19T21:45:07.902999+0000","last_became_active":"2024-02-19T21:41:42.243259+0000","last_became_peered":"2024-02-19T21:41:42.243259+0000","last_unstale":"2024-02-19T21:45:07.902999+0000","last_undegraded":"2024-02-19T21:45:07.902999+0000","last_fullsized":"2024-02-19T21:45:07.902999+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'8","last_scrub_stamp":"2024-02-19T21:44:55.590349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:55.590349+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":196,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.897526+0000","last_change":"2024-02-19T21:44:17.079476+0000","last_active":"2024-02-19T21:45:07.897526+0000","last_peered":"2024-02-19T21:45:07.897526+0000","last_clean":"2024-02-19T21:45:07.897526+0000","last_became_active":"2024-02-19T21:39:39.462363+0000","last_became_peered":"2024-02-19T21:39:39.462363+0000","last_unstale":"2024-02-19T21:45:07.897526+0000","last_undegraded":"2024-02-19T21:45:07.897526+0000","last_fullsized":"2024-02-19T21:45:07.897526+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:17.079391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:44:17.079391+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":289,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.905563+0000","last_change":"2024-02-19T21:42:04.199063+0000","last_active":"2024-02-19T21:45:07.905563+0000","last_peered":"2024-02-19T21:45:07.905563+0000","last_clean":"2024-02-19T21:45:07.905563+0000","last_became_active":"2024-02-19T21:42:04.198684+0000","last_became_peered":"2024-02-19T21:42:04.198684+0000","last_unstale":"2024-02-19T21:45:07.905563+0000","last_undegraded":"2024-02-19T21:45:07.905563+0000","last_fullsized":"2024-02-19T21:45:07.905563+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:26.272653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:40:26.272653+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":282,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.909330+0000","last_change":"2024-02-19T21:44:52.828511+0000","last_active":"2024-02-19T21:45:07.909330+0000","last_peered":"2024-02-19T21:45:07.909330+0000","last_clean":"2024-02-19T21:45:07.909330+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:45:07.909330+0000","last_undegraded":"2024-02-19T21:45:07.909330+0000","last_fullsized":"2024-02-19T21:45:07.909330+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:52.828413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:44:52.828413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"201'19","reported_seq":324,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.889773+0000","last_change":"2024-02-19T21:44:48.350026+0000","last_active":"2024-02-19T21:45:07.889773+0000","last_peered":"2024-02-19T21:45:07.889773+0000","last_clean":"2024-02-19T21:45:07.889773+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:45:07.889773+0000","last_undegraded":"2024-02-19T21:45:07.889773+0000","last_fullsized":"2024-02-19T21:45:07.889773+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:44:48.349927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:48.349927+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":283,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.893598+0000","last_change":"2024-02-19T21:44:07.280418+0000","last_active":"2024-02-19T21:45:07.893598+0000","last_peered":"2024-02-19T21:45:07.893598+0000","last_clean":"2024-02-19T21:45:07.893598+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:45:07.893598+0000","last_undegraded":"2024-02-19T21:45:07.893598+0000","last_fullsized":"2024-02-19T21:45:07.893598+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:07.280329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:42.527849+0000","last_clean_scrub_stamp":"2024-02-19T21:44:07.280329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":282,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.904137+0000","last_change":"2024-02-19T21:44:08.574844+0000","last_active":"2024-02-19T21:45:07.904137+0000","last_peered":"2024-02-19T21:45:07.904137+0000","last_clean":"2024-02-19T21:45:07.904137+0000","last_became_active":"2024-02-19T21:39:51.534750+0000","last_became_peered":"2024-02-19T21:39:51.534750+0000","last_unstale":"2024-02-19T21:45:07.904137+0000","last_undegraded":"2024-02-19T21:45:07.904137+0000","last_fullsized":"2024-02-19T21:45:07.904137+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:08.574749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:08.574749+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":283,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.899454+0000","last_change":"2024-02-19T21:41:35.736077+0000","last_active":"2024-02-19T21:45:07.899454+0000","last_peered":"2024-02-19T21:45:07.899454+0000","last_clean":"2024-02-19T21:45:07.899454+0000","last_became_active":"2024-02-19T21:32:23.357338+0000","last_became_peered":"2024-02-19T21:32:23.357338+0000","last_unstale":"2024-02-19T21:45:07.899454+0000","last_undegraded":"2024-02-19T21:45:07.899454+0000","last_fullsized":"2024-02-19T21:45:07.899454+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:35.735995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:41:35.735995+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"200'15","reported_seq":322,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:08.678809+0000","last_change":"2024-02-19T21:45:08.678772+0000","last_active":"2024-02-19T21:45:08.678809+0000","last_peered":"2024-02-19T21:45:08.678809+0000","last_clean":"2024-02-19T21:45:08.678809+0000","last_became_active":"2024-02-19T21:39:39.466843+0000","last_became_peered":"2024-02-19T21:39:39.466843+0000","last_unstale":"2024-02-19T21:45:08.678809+0000","last_undegraded":"2024-02-19T21:45:08.678809+0000","last_fullsized":"2024-02-19T21:45:08.678809+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:45:08.678669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:08.678669+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":308,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.902419+0000","last_change":"2024-02-19T21:44:58.788427+0000","last_active":"2024-02-19T21:45:07.902419+0000","last_peered":"2024-02-19T21:45:07.902419+0000","last_clean":"2024-02-19T21:45:07.902419+0000","last_became_active":"2024-02-19T21:44:58.788069+0000","last_became_peered":"2024-02-19T21:44:58.788069+0000","last_unstale":"2024-02-19T21:45:07.902419+0000","last_undegraded":"2024-02-19T21:45:07.902419+0000","last_fullsized":"2024-02-19T21:45:07.902419+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:33.758127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:40:33.758127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"199'13","reported_seq":258,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:10.144473+0000","last_change":"2024-02-19T21:45:05.721799+0000","last_active":"2024-02-19T21:45:10.144473+0000","last_peered":"2024-02-19T21:45:10.144473+0000","last_clean":"2024-02-19T21:45:10.144473+0000","last_became_active":"2024-02-19T21:42:04.195103+0000","last_became_peered":"2024-02-19T21:42:04.195103+0000","last_unstale":"2024-02-19T21:45:10.144473+0000","last_undegraded":"2024-02-19T21:45:10.144473+0000","last_fullsized":"2024-02-19T21:45:10.144473+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"199'13","last_scrub_stamp":"2024-02-19T21:45:05.721709+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:45:05.721709+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":289,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.897420+0000","last_change":"2024-02-19T21:40:33.532430+0000","last_active":"2024-02-19T21:45:07.897420+0000","last_peered":"2024-02-19T21:45:07.897420+0000","last_clean":"2024-02-19T21:45:07.897420+0000","last_became_active":"2024-02-19T21:32:23.361680+0000","last_became_peered":"2024-02-19T21:32:23.361680+0000","last_unstale":"2024-02-19T21:45:07.897420+0000","last_undegraded":"2024-02-19T21:45:07.897420+0000","last_fullsized":"2024-02-19T21:45:07.897420+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:33.532354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:33.550655+0000","last_clean_scrub_stamp":"2024-02-19T21:40:33.532354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"201'19","reported_seq":311,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.902826+0000","last_change":"2024-02-19T21:44:56.767033+0000","last_active":"2024-02-19T21:45:07.902826+0000","last_peered":"2024-02-19T21:45:07.902826+0000","last_clean":"2024-02-19T21:45:07.902826+0000","last_became_active":"2024-02-19T21:32:25.372206+0000","last_became_peered":"2024-02-19T21:32:25.372206+0000","last_unstale":"2024-02-19T21:45:07.902826+0000","last_undegraded":"2024-02-19T21:45:07.902826+0000","last_fullsized":"2024-02-19T21:45:07.902826+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:44:56.766950+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:44:56.766950+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.893685+0000","last_change":"2024-02-19T21:44:58.788818+0000","last_active":"2024-02-19T21:45:07.893685+0000","last_peered":"2024-02-19T21:45:07.893685+0000","last_clean":"2024-02-19T21:45:07.893685+0000","last_became_active":"2024-02-19T21:44:58.788519+0000","last_became_peered":"2024-02-19T21:44:58.788519+0000","last_unstale":"2024-02-19T21:45:07.893685+0000","last_undegraded":"2024-02-19T21:45:07.893685+0000","last_fullsized":"2024-02-19T21:45:07.893685+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:44:12.609170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":443,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:10.145725+0000","last_change":"2024-02-19T21:45:02.745748+0000","last_active":"2024-02-19T21:45:10.145725+0000","last_peered":"2024-02-19T21:45:10.145725+0000","last_clean":"2024-02-19T21:45:10.145725+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:45:10.145725+0000","last_undegraded":"2024-02-19T21:45:10.145725+0000","last_fullsized":"2024-02-19T21:45:10.145725+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:45:02.745649+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:45:02.745649+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":295,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.901638+0000","last_change":"2024-02-19T21:44:47.741002+0000","last_active":"2024-02-19T21:45:07.901638+0000","last_peered":"2024-02-19T21:45:07.901638+0000","last_clean":"2024-02-19T21:45:07.901638+0000","last_became_active":"2024-02-19T21:42:04.205401+0000","last_became_peered":"2024-02-19T21:42:04.205401+0000","last_unstale":"2024-02-19T21:45:07.901638+0000","last_undegraded":"2024-02-19T21:45:07.901638+0000","last_fullsized":"2024-02-19T21:45:07.901638+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:47.740904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:44:47.740904+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"201'25","reported_seq":315,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.902541+0000","last_change":"2024-02-19T21:44:57.633430+0000","last_active":"2024-02-19T21:45:07.902541+0000","last_peered":"2024-02-19T21:45:07.902541+0000","last_clean":"2024-02-19T21:45:07.902541+0000","last_became_active":"2024-02-19T21:32:25.372060+0000","last_became_peered":"2024-02-19T21:32:25.372060+0000","last_unstale":"2024-02-19T21:45:07.902541+0000","last_undegraded":"2024-02-19T21:45:07.902541+0000","last_fullsized":"2024-02-19T21:45:07.902541+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'25","last_scrub_stamp":"2024-02-19T21:44:57.633330+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:44:57.633330+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":281,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.896209+0000","last_change":"2024-02-19T21:45:05.670682+0000","last_active":"2024-02-19T21:45:07.896209+0000","last_peered":"2024-02-19T21:45:07.896209+0000","last_clean":"2024-02-19T21:45:07.896209+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:45:07.896209+0000","last_undegraded":"2024-02-19T21:45:07.896209+0000","last_fullsized":"2024-02-19T21:45:07.896209+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:05.670585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_clean_scrub_stamp":"2024-02-19T21:45:05.670585+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":283,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.900215+0000","last_change":"2024-02-19T21:44:52.148250+0000","last_active":"2024-02-19T21:45:07.900215+0000","last_peered":"2024-02-19T21:45:07.900215+0000","last_clean":"2024-02-19T21:45:07.900215+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:45:07.900215+0000","last_undegraded":"2024-02-19T21:45:07.900215+0000","last_fullsized":"2024-02-19T21:45:07.900215+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:52.148158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:52.148158+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"201'12","reported_seq":167,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.901471+0000","last_change":"2024-02-19T21:44:17.715721+0000","last_active":"2024-02-19T21:45:07.901471+0000","last_peered":"2024-02-19T21:45:07.901471+0000","last_clean":"2024-02-19T21:45:07.901471+0000","last_became_active":"2024-02-19T21:42:04.192291+0000","last_became_peered":"2024-02-19T21:42:04.192291+0000","last_unstale":"2024-02-19T21:45:07.901471+0000","last_undegraded":"2024-02-19T21:45:07.901471+0000","last_fullsized":"2024-02-19T21:45:07.901471+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'12","last_scrub_stamp":"2024-02-19T21:44:17.715652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:17.715652+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":166,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.889736+0000","last_change":"2024-02-19T21:44:11.584507+0000","last_active":"2024-02-19T21:45:07.889736+0000","last_peered":"2024-02-19T21:45:07.889736+0000","last_clean":"2024-02-19T21:45:07.889736+0000","last_became_active":"2024-02-19T21:39:39.469477+0000","last_became_peered":"2024-02-19T21:39:39.469477+0000","last_unstale":"2024-02-19T21:45:07.889736+0000","last_undegraded":"2024-02-19T21:45:07.889736+0000","last_fullsized":"2024-02-19T21:45:07.889736+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:11.584416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:44:11.584416+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":161,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.901458+0000","last_change":"2024-02-19T21:44:09.645675+0000","last_active":"2024-02-19T21:45:07.901458+0000","last_peered":"2024-02-19T21:45:07.901458+0000","last_clean":"2024-02-19T21:45:07.901458+0000","last_became_active":"2024-02-19T21:39:39.477308+0000","last_became_peered":"2024-02-19T21:39:39.477308+0000","last_unstale":"2024-02-19T21:45:07.901458+0000","last_undegraded":"2024-02-19T21:45:07.901458+0000","last_fullsized":"2024-02-19T21:45:07.901458+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:09.645607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:44:09.645607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"200'15","reported_seq":365,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.893911+0000","last_change":"2024-02-19T21:44:53.072845+0000","last_active":"2024-02-19T21:45:07.893911+0000","last_peered":"2024-02-19T21:45:07.893911+0000","last_clean":"2024-02-19T21:45:07.893911+0000","last_became_active":"2024-02-19T21:42:04.207069+0000","last_became_peered":"2024-02-19T21:42:04.207069+0000","last_unstale":"2024-02-19T21:45:07.893911+0000","last_undegraded":"2024-02-19T21:45:07.893911+0000","last_fullsized":"2024-02-19T21:45:07.893911+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:44:53.072746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:53.072746+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"310'4681","reported_seq":4731,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:15.034183+0000","last_change":"2024-02-19T21:44:16.113820+0000","last_active":"2024-02-19T21:45:15.034183+0000","last_peered":"2024-02-19T21:45:15.034183+0000","last_clean":"2024-02-19T21:45:15.034183+0000","last_became_active":"2024-02-19T21:44:16.113593+0000","last_became_peered":"2024-02-19T21:44:16.113593+0000","last_unstale":"2024-02-19T21:45:15.034183+0000","last_undegraded":"2024-02-19T21:45:15.034183+0000","last_fullsized":"2024-02-19T21:45:15.034183+0000","mapping_epoch":268,"log_start":"287'600","ondisk_log_start":"287'600","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4081,"ondisk_log_size":4081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":306774016,"num_objects":4681,"num_object_clones":0,"num_object_copies":14043,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4681,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4681,"num_write_kb":299584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":312,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.904209+0000","last_change":"2024-02-19T21:45:04.692907+0000","last_active":"2024-02-19T21:45:07.904209+0000","last_peered":"2024-02-19T21:45:07.904209+0000","last_clean":"2024-02-19T21:45:07.904209+0000","last_became_active":"2024-02-19T21:44:56.153136+0000","last_became_peered":"2024-02-19T21:44:56.153136+0000","last_unstale":"2024-02-19T21:45:07.904209+0000","last_undegraded":"2024-02-19T21:45:07.904209+0000","last_fullsized":"2024-02-19T21:45:07.904209+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:04.692807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.692807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"59'2","reported_seq":312,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.890380+0000","last_change":"2024-02-19T21:44:17.499729+0000","last_active":"2024-02-19T21:45:07.890380+0000","last_peered":"2024-02-19T21:45:07.890380+0000","last_clean":"2024-02-19T21:45:07.890380+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:45:07.890380+0000","last_undegraded":"2024-02-19T21:45:07.890380+0000","last_fullsized":"2024-02-19T21:45:07.890380+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-02-19T21:44:17.499663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:17.499663+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"200'23","reported_seq":319,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.904622+0000","last_change":"2024-02-19T21:40:37.318743+0000","last_active":"2024-02-19T21:45:07.904622+0000","last_peered":"2024-02-19T21:45:07.904622+0000","last_clean":"2024-02-19T21:45:07.904622+0000","last_became_active":"2024-02-19T21:38:31.247821+0000","last_became_peered":"2024-02-19T21:38:31.247821+0000","last_unstale":"2024-02-19T21:45:07.904622+0000","last_undegraded":"2024-02-19T21:45:07.904622+0000","last_fullsized":"2024-02-19T21:45:07.904622+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'17","last_scrub_stamp":"2024-02-19T21:40:37.318642+0000","last_deep_scrub":"83'17","last_deep_scrub_stamp":"2024-02-19T21:33:43.418450+0000","last_clean_scrub_stamp":"2024-02-19T21:40:37.318642+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":179,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.894341+0000","last_change":"2024-02-19T21:44:58.047618+0000","last_active":"2024-02-19T21:45:07.894341+0000","last_peered":"2024-02-19T21:45:07.894341+0000","last_clean":"2024-02-19T21:45:07.894341+0000","last_became_active":"2024-02-19T21:44:38.145122+0000","last_became_peered":"2024-02-19T21:44:38.145122+0000","last_unstale":"2024-02-19T21:45:07.894341+0000","last_undegraded":"2024-02-19T21:45:07.894341+0000","last_fullsized":"2024-02-19T21:45:07.894341+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:58.047556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:58.047556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"310'4669","reported_seq":4718,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:15.016381+0000","last_change":"2024-02-19T21:44:16.118671+0000","last_active":"2024-02-19T21:45:15.016381+0000","last_peered":"2024-02-19T21:45:15.016381+0000","last_clean":"2024-02-19T21:45:15.016381+0000","last_became_active":"2024-02-19T21:44:16.118362+0000","last_became_peered":"2024-02-19T21:44:16.118362+0000","last_unstale":"2024-02-19T21:45:15.016381+0000","last_undegraded":"2024-02-19T21:45:15.016381+0000","last_fullsized":"2024-02-19T21:45:15.016381+0000","mapping_epoch":268,"log_start":"287'500","ondisk_log_start":"287'500","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4169,"ondisk_log_size":4169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":305987584,"num_objects":4669,"num_object_clones":0,"num_object_copies":14007,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4669,"num_write_kb":298816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4],"acting":[5,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":301,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.893672+0000","last_change":"2024-02-19T21:41:42.246007+0000","last_active":"2024-02-19T21:45:07.893672+0000","last_peered":"2024-02-19T21:45:07.893672+0000","last_clean":"2024-02-19T21:45:07.893672+0000","last_became_active":"2024-02-19T21:41:42.245788+0000","last_became_peered":"2024-02-19T21:41:42.245788+0000","last_unstale":"2024-02-19T21:45:07.893672+0000","last_undegraded":"2024-02-19T21:45:07.893672+0000","last_fullsized":"2024-02-19T21:45:07.893672+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:40.474333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:40.474333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":280,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.904289+0000","last_change":"2024-02-19T21:44:47.801856+0000","last_active":"2024-02-19T21:45:07.904289+0000","last_peered":"2024-02-19T21:45:07.904289+0000","last_clean":"2024-02-19T21:45:07.904289+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:45:07.904289+0000","last_undegraded":"2024-02-19T21:45:07.904289+0000","last_fullsized":"2024-02-19T21:45:07.904289+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:47.801768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:47.801768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"201'20","reported_seq":186,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.905495+0000","last_change":"2024-02-19T21:41:22.195267+0000","last_active":"2024-02-19T21:45:07.905495+0000","last_peered":"2024-02-19T21:45:07.905495+0000","last_clean":"2024-02-19T21:45:07.905495+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:45:07.905495+0000","last_undegraded":"2024-02-19T21:45:07.905495+0000","last_fullsized":"2024-02-19T21:45:07.905495+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:41:22.195164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:41:22.195164+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":445,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:10.146021+0000","last_change":"2024-02-19T21:45:07.122114+0000","last_active":"2024-02-19T21:45:10.146021+0000","last_peered":"2024-02-19T21:45:10.146021+0000","last_clean":"2024-02-19T21:45:10.146021+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:45:10.146021+0000","last_undegraded":"2024-02-19T21:45:10.146021+0000","last_fullsized":"2024-02-19T21:45:10.146021+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:45:07.121970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:07.121970+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"310'4769","reported_seq":4819,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:15.236968+0000","last_change":"2024-02-19T21:44:16.117157+0000","last_active":"2024-02-19T21:45:15.236968+0000","last_peered":"2024-02-19T21:45:15.236968+0000","last_clean":"2024-02-19T21:45:15.236968+0000","last_became_active":"2024-02-19T21:44:16.116819+0000","last_became_peered":"2024-02-19T21:44:16.116819+0000","last_unstale":"2024-02-19T21:45:15.236968+0000","last_undegraded":"2024-02-19T21:45:15.236968+0000","last_fullsized":"2024-02-19T21:45:15.236968+0000","mapping_epoch":268,"log_start":"286'400","ondisk_log_start":"286'400","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4369,"ondisk_log_size":4369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":312541184,"num_objects":4769,"num_object_clones":0,"num_object_copies":14307,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4769,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4769,"num_write_kb":305216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":224,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.891795+0000","last_change":"2024-02-19T21:45:02.186835+0000","last_active":"2024-02-19T21:45:07.891795+0000","last_peered":"2024-02-19T21:45:07.891795+0000","last_clean":"2024-02-19T21:45:07.891795+0000","last_became_active":"2024-02-19T21:44:56.149476+0000","last_became_peered":"2024-02-19T21:44:56.149476+0000","last_unstale":"2024-02-19T21:45:07.891795+0000","last_undegraded":"2024-02-19T21:45:07.891795+0000","last_fullsized":"2024-02-19T21:45:07.891795+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:02.186754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:45:02.186754+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":284,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.901681+0000","last_change":"2024-02-19T21:44:10.523394+0000","last_active":"2024-02-19T21:45:07.901681+0000","last_peered":"2024-02-19T21:45:07.901681+0000","last_clean":"2024-02-19T21:45:07.901681+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:45:07.901681+0000","last_undegraded":"2024-02-19T21:45:07.901681+0000","last_fullsized":"2024-02-19T21:45:07.901681+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:10.523331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:44:10.523331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"201'43","reported_seq":592,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:10.144529+0000","last_change":"2024-02-19T21:45:04.755549+0000","last_active":"2024-02-19T21:45:10.144529+0000","last_peered":"2024-02-19T21:45:10.144529+0000","last_clean":"2024-02-19T21:45:10.144529+0000","last_became_active":"2024-02-19T21:42:04.196382+0000","last_became_peered":"2024-02-19T21:42:04.196382+0000","last_unstale":"2024-02-19T21:45:10.144529+0000","last_undegraded":"2024-02-19T21:45:10.144529+0000","last_fullsized":"2024-02-19T21:45:10.144529+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'43","last_scrub_stamp":"2024-02-19T21:45:04.755444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.755444+0000","log_size":43,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":1074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,5],"acting":[1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":276,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.894613+0000","last_change":"2024-02-19T21:44:02.217493+0000","last_active":"2024-02-19T21:45:07.894613+0000","last_peered":"2024-02-19T21:45:07.894613+0000","last_clean":"2024-02-19T21:45:07.894613+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:45:07.894613+0000","last_undegraded":"2024-02-19T21:45:07.894613+0000","last_fullsized":"2024-02-19T21:45:07.894613+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:02.217425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:02.217425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"310'4629","reported_seq":4679,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:15.012479+0000","last_change":"2024-02-19T21:44:16.122030+0000","last_active":"2024-02-19T21:45:15.012479+0000","last_peered":"2024-02-19T21:45:15.012479+0000","last_clean":"2024-02-19T21:45:15.012479+0000","last_became_active":"2024-02-19T21:44:16.121785+0000","last_became_peered":"2024-02-19T21:44:16.121785+0000","last_unstale":"2024-02-19T21:45:15.012479+0000","last_undegraded":"2024-02-19T21:45:15.012479+0000","last_fullsized":"2024-02-19T21:45:15.012479+0000","mapping_epoch":268,"log_start":"286'500","ondisk_log_start":"286'500","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4129,"ondisk_log_size":4129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":303366144,"num_objects":4629,"num_object_clones":0,"num_object_copies":13887,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4629,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4629,"num_write_kb":296256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":272,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.896439+0000","last_change":"2024-02-19T21:44:08.148554+0000","last_active":"2024-02-19T21:45:07.896439+0000","last_peered":"2024-02-19T21:45:07.896439+0000","last_clean":"2024-02-19T21:45:07.896439+0000","last_became_active":"2024-02-19T21:32:29.597365+0000","last_became_peered":"2024-02-19T21:32:29.597365+0000","last_unstale":"2024-02-19T21:45:07.896439+0000","last_undegraded":"2024-02-19T21:45:07.896439+0000","last_fullsized":"2024-02-19T21:45:07.896439+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:08.147351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:44:08.147351+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'6","reported_seq":1058,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:13.524651+0000","last_change":"2024-02-19T21:44:13.678401+0000","last_active":"2024-02-19T21:45:13.524651+0000","last_peered":"2024-02-19T21:45:13.524651+0000","last_clean":"2024-02-19T21:45:13.524651+0000","last_became_active":"2024-02-19T21:39:39.464361+0000","last_became_peered":"2024-02-19T21:39:39.464361+0000","last_unstale":"2024-02-19T21:45:13.524651+0000","last_undegraded":"2024-02-19T21:45:13.524651+0000","last_fullsized":"2024-02-19T21:45:13.524651+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_clean_scrub_stamp":"2024-02-19T21:44:13.678341+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":758,"num_read_kb":753,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":277,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.897289+0000","last_change":"2024-02-19T21:41:36.636023+0000","last_active":"2024-02-19T21:45:07.897289+0000","last_peered":"2024-02-19T21:45:07.897289+0000","last_clean":"2024-02-19T21:45:07.897289+0000","last_became_active":"2024-02-19T21:39:39.468113+0000","last_became_peered":"2024-02-19T21:39:39.468113+0000","last_unstale":"2024-02-19T21:45:07.897289+0000","last_undegraded":"2024-02-19T21:45:07.897289+0000","last_fullsized":"2024-02-19T21:45:07.897289+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:36.635936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:41:36.635936+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"200'17","reported_seq":337,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.901381+0000","last_change":"2024-02-19T21:44:00.545486+0000","last_active":"2024-02-19T21:45:07.901381+0000","last_peered":"2024-02-19T21:45:07.901381+0000","last_clean":"2024-02-19T21:45:07.901381+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:45:07.901381+0000","last_undegraded":"2024-02-19T21:45:07.901381+0000","last_fullsized":"2024-02-19T21:45:07.901381+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'17","last_scrub_stamp":"2024-02-19T21:44:00.545415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:00.545415+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":25,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":184,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:10.871326+0000","last_change":"2024-02-19T21:45:10.871326+0000","last_active":"2024-02-19T21:45:10.871326+0000","last_peered":"2024-02-19T21:45:10.871326+0000","last_clean":"2024-02-19T21:45:10.871326+0000","last_became_active":"2024-02-19T21:44:46.148156+0000","last_became_peered":"2024-02-19T21:44:46.148156+0000","last_unstale":"2024-02-19T21:45:10.871326+0000","last_undegraded":"2024-02-19T21:45:10.871326+0000","last_fullsized":"2024-02-19T21:45:10.871326+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":299,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:10.871111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:10.871111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"310'4745","reported_seq":4795,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:15.237553+0000","last_change":"2024-02-19T21:44:16.115922+0000","last_active":"2024-02-19T21:45:15.237553+0000","last_peered":"2024-02-19T21:45:15.237553+0000","last_clean":"2024-02-19T21:45:15.237553+0000","last_became_active":"2024-02-19T21:44:16.115625+0000","last_became_peered":"2024-02-19T21:44:16.115625+0000","last_unstale":"2024-02-19T21:45:15.237553+0000","last_undegraded":"2024-02-19T21:45:15.237553+0000","last_fullsized":"2024-02-19T21:45:15.237553+0000","mapping_epoch":268,"log_start":"286'400","ondisk_log_start":"286'400","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4345,"ondisk_log_size":4345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":310968320,"num_objects":4745,"num_object_clones":0,"num_object_copies":14235,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4745,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4745,"num_write_kb":303680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":300,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.902813+0000","last_change":"2024-02-19T21:44:56.157521+0000","last_active":"2024-02-19T21:45:07.902813+0000","last_peered":"2024-02-19T21:45:07.902813+0000","last_clean":"2024-02-19T21:45:07.902813+0000","last_became_active":"2024-02-19T21:44:56.157241+0000","last_became_peered":"2024-02-19T21:44:56.157241+0000","last_unstale":"2024-02-19T21:45:07.902813+0000","last_undegraded":"2024-02-19T21:45:07.902813+0000","last_fullsized":"2024-02-19T21:45:07.902813+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:33.758127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:40:33.758127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":187,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.902216+0000","last_change":"2024-02-19T21:45:04.833554+0000","last_active":"2024-02-19T21:45:07.902216+0000","last_peered":"2024-02-19T21:45:07.902216+0000","last_clean":"2024-02-19T21:45:07.902216+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:45:07.902216+0000","last_undegraded":"2024-02-19T21:45:07.902216+0000","last_fullsized":"2024-02-19T21:45:07.902216+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:04.833413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.833413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":302,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.903685+0000","last_change":"2024-02-19T21:45:07.901315+0000","last_active":"2024-02-19T21:45:07.903685+0000","last_peered":"2024-02-19T21:45:07.903685+0000","last_clean":"2024-02-19T21:45:07.903685+0000","last_became_active":"2024-02-19T21:42:04.212730+0000","last_became_peered":"2024-02-19T21:42:04.212730+0000","last_unstale":"2024-02-19T21:45:07.903685+0000","last_undegraded":"2024-02-19T21:45:07.903685+0000","last_fullsized":"2024-02-19T21:45:07.903685+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:07.901205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:07.901205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":160,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.893879+0000","last_change":"2024-02-19T21:42:04.197235+0000","last_active":"2024-02-19T21:45:07.893879+0000","last_peered":"2024-02-19T21:45:07.893879+0000","last_clean":"2024-02-19T21:45:07.893879+0000","last_became_active":"2024-02-19T21:42:04.196943+0000","last_became_peered":"2024-02-19T21:42:04.196943+0000","last_unstale":"2024-02-19T21:45:07.893879+0000","last_undegraded":"2024-02-19T21:45:07.893879+0000","last_fullsized":"2024-02-19T21:45:07.893879+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:38.927472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:40:38.927472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,1],"acting":[0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"201'33","reported_seq":328,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.899284+0000","last_change":"2024-02-19T21:44:55.061721+0000","last_active":"2024-02-19T21:45:07.899284+0000","last_peered":"2024-02-19T21:45:07.899284+0000","last_clean":"2024-02-19T21:45:07.899284+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:45:07.899284+0000","last_undegraded":"2024-02-19T21:45:07.899284+0000","last_fullsized":"2024-02-19T21:45:07.899284+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'33","last_scrub_stamp":"2024-02-19T21:44:55.061625+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:44:55.061625+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":255,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.901759+0000","last_change":"2024-02-19T21:44:57.754550+0000","last_active":"2024-02-19T21:45:07.901759+0000","last_peered":"2024-02-19T21:45:07.901759+0000","last_clean":"2024-02-19T21:45:07.901759+0000","last_became_active":"2024-02-19T21:42:04.205342+0000","last_became_peered":"2024-02-19T21:42:04.205342+0000","last_unstale":"2024-02-19T21:45:07.901759+0000","last_undegraded":"2024-02-19T21:45:07.901759+0000","last_fullsized":"2024-02-19T21:45:07.901759+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:57.754453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:57.754453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"310'4604","reported_seq":4653,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:15.268381+0000","last_change":"2024-02-19T21:44:16.117097+0000","last_active":"2024-02-19T21:45:15.268381+0000","last_peered":"2024-02-19T21:45:15.268381+0000","last_clean":"2024-02-19T21:45:15.268381+0000","last_became_active":"2024-02-19T21:44:16.116833+0000","last_became_peered":"2024-02-19T21:44:16.116833+0000","last_unstale":"2024-02-19T21:45:15.268381+0000","last_undegraded":"2024-02-19T21:45:15.268381+0000","last_fullsized":"2024-02-19T21:45:15.268381+0000","mapping_epoch":268,"log_start":"286'300","ondisk_log_start":"286'300","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4304,"ondisk_log_size":4304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":301727744,"num_objects":4604,"num_object_clones":0,"num_object_copies":13812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4604,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4604,"num_write_kb":294656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":278,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.904456+0000","last_change":"2024-02-19T21:40:29.250688+0000","last_active":"2024-02-19T21:45:07.904456+0000","last_peered":"2024-02-19T21:45:07.904456+0000","last_clean":"2024-02-19T21:45:07.904456+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:45:07.904456+0000","last_undegraded":"2024-02-19T21:45:07.904456+0000","last_fullsized":"2024-02-19T21:45:07.904456+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:40:29.250599+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":289,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.897407+0000","last_change":"2024-02-19T21:41:22.644476+0000","last_active":"2024-02-19T21:45:07.897407+0000","last_peered":"2024-02-19T21:45:07.897407+0000","last_clean":"2024-02-19T21:45:07.897407+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:45:07.897407+0000","last_undegraded":"2024-02-19T21:45:07.897407+0000","last_fullsized":"2024-02-19T21:45:07.897407+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:22.644405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:41:22.644405+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":302,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.897108+0000","last_change":"2024-02-19T21:44:05.032411+0000","last_active":"2024-02-19T21:45:07.897108+0000","last_peered":"2024-02-19T21:45:07.897108+0000","last_clean":"2024-02-19T21:45:07.897108+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:45:07.897108+0000","last_undegraded":"2024-02-19T21:45:07.897108+0000","last_fullsized":"2024-02-19T21:45:07.897108+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:05.032330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:05.032330+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"200'24","reported_seq":389,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.893830+0000","last_change":"2024-02-19T21:44:01.262696+0000","last_active":"2024-02-19T21:45:07.893830+0000","last_peered":"2024-02-19T21:45:07.893830+0000","last_clean":"2024-02-19T21:45:07.893830+0000","last_became_active":"2024-02-19T21:42:04.206790+0000","last_became_peered":"2024-02-19T21:42:04.206790+0000","last_unstale":"2024-02-19T21:45:07.893830+0000","last_undegraded":"2024-02-19T21:45:07.893830+0000","last_fullsized":"2024-02-19T21:45:07.893830+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'24","last_scrub_stamp":"2024-02-19T21:44:01.262618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:01.262618+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":298,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:09.918318+0000","last_change":"2024-02-19T21:45:09.918263+0000","last_active":"2024-02-19T21:45:09.918318+0000","last_peered":"2024-02-19T21:45:09.918318+0000","last_clean":"2024-02-19T21:45:09.918318+0000","last_became_active":"2024-02-19T21:44:42.624782+0000","last_became_peered":"2024-02-19T21:44:42.624782+0000","last_unstale":"2024-02-19T21:45:09.918318+0000","last_undegraded":"2024-02-19T21:45:09.918318+0000","last_fullsized":"2024-02-19T21:45:09.918318+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":295,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_clean_scrub_stamp":"2024-02-19T21:45:09.918170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.e","version":"310'4667","reported_seq":4717,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:14.999454+0000","last_change":"2024-02-19T21:44:16.118980+0000","last_active":"2024-02-19T21:45:14.999454+0000","last_peered":"2024-02-19T21:45:14.999454+0000","last_clean":"2024-02-19T21:45:14.999454+0000","last_became_active":"2024-02-19T21:44:16.118651+0000","last_became_peered":"2024-02-19T21:44:16.118651+0000","last_unstale":"2024-02-19T21:45:14.999454+0000","last_undegraded":"2024-02-19T21:45:14.999454+0000","last_fullsized":"2024-02-19T21:45:14.999454+0000","mapping_epoch":268,"log_start":"0'0","ondisk_log_start":"0'0","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4667,"ondisk_log_size":4667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":305856512,"num_objects":4667,"num_object_clones":0,"num_object_copies":14001,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4667,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4667,"num_write_kb":298688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":292,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.904792+0000","last_change":"2024-02-19T21:44:55.803955+0000","last_active":"2024-02-19T21:45:07.904792+0000","last_peered":"2024-02-19T21:45:07.904792+0000","last_clean":"2024-02-19T21:45:07.904792+0000","last_became_active":"2024-02-19T21:42:04.193058+0000","last_became_peered":"2024-02-19T21:42:04.193058+0000","last_unstale":"2024-02-19T21:45:07.904792+0000","last_undegraded":"2024-02-19T21:45:07.904792+0000","last_fullsized":"2024-02-19T21:45:07.904792+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:55.803876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:44:55.803876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":278,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.896513+0000","last_change":"2024-02-19T21:44:50.478790+0000","last_active":"2024-02-19T21:45:07.896513+0000","last_peered":"2024-02-19T21:45:07.896513+0000","last_clean":"2024-02-19T21:45:07.896513+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:45:07.896513+0000","last_undegraded":"2024-02-19T21:45:07.896513+0000","last_fullsized":"2024-02-19T21:45:07.896513+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:50.478689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:50.478689+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"201'37","reported_seq":342,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:14.173212+0000","last_change":"2024-02-19T21:45:14.173212+0000","last_active":"2024-02-19T21:45:14.173212+0000","last_peered":"2024-02-19T21:45:14.173212+0000","last_clean":"2024-02-19T21:45:14.173212+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:45:14.173212+0000","last_undegraded":"2024-02-19T21:45:14.173212+0000","last_fullsized":"2024-02-19T21:45:14.173212+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'37","last_scrub_stamp":"2024-02-19T21:45:14.173134+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:45:14.173134+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":281,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.900006+0000","last_change":"2024-02-19T21:44:49.260785+0000","last_active":"2024-02-19T21:45:07.900006+0000","last_peered":"2024-02-19T21:45:07.900006+0000","last_clean":"2024-02-19T21:45:07.900006+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:45:07.900006+0000","last_undegraded":"2024-02-19T21:45:07.900006+0000","last_fullsized":"2024-02-19T21:45:07.900006+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:49.260690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:44:49.260690+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"310'4725","reported_seq":4775,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:15.053825+0000","last_change":"2024-02-19T21:44:16.121994+0000","last_active":"2024-02-19T21:45:15.053825+0000","last_peered":"2024-02-19T21:45:15.053825+0000","last_clean":"2024-02-19T21:45:15.053825+0000","last_became_active":"2024-02-19T21:44:16.121703+0000","last_became_peered":"2024-02-19T21:44:16.121703+0000","last_unstale":"2024-02-19T21:45:15.053825+0000","last_undegraded":"2024-02-19T21:45:15.053825+0000","last_fullsized":"2024-02-19T21:45:15.053825+0000","mapping_epoch":268,"log_start":"288'700","ondisk_log_start":"288'700","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4025,"ondisk_log_size":4025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":309657600,"num_objects":4725,"num_object_clones":0,"num_object_copies":14175,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4725,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4725,"num_write_kb":302400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":180,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.899420+0000","last_change":"2024-02-19T21:44:08.281049+0000","last_active":"2024-02-19T21:45:07.899420+0000","last_peered":"2024-02-19T21:45:07.899420+0000","last_clean":"2024-02-19T21:45:07.899420+0000","last_became_active":"2024-02-19T21:42:04.200292+0000","last_became_peered":"2024-02-19T21:42:04.200292+0000","last_unstale":"2024-02-19T21:45:07.899420+0000","last_undegraded":"2024-02-19T21:45:07.899420+0000","last_fullsized":"2024-02-19T21:45:07.899420+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:08.280938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:44:08.280938+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,5],"acting":[6,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":282,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.901242+0000","last_change":"2024-02-19T21:44:14.690800+0000","last_active":"2024-02-19T21:45:07.901242+0000","last_peered":"2024-02-19T21:45:07.901242+0000","last_clean":"2024-02-19T21:45:07.901242+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:45:07.901242+0000","last_undegraded":"2024-02-19T21:45:07.901242+0000","last_fullsized":"2024-02-19T21:45:07.901242+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:14.690736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:44:14.690736+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"201'38","reported_seq":263,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.894010+0000","last_change":"2024-02-19T21:45:05.077354+0000","last_active":"2024-02-19T21:45:07.894010+0000","last_peered":"2024-02-19T21:45:07.894010+0000","last_clean":"2024-02-19T21:45:07.894010+0000","last_became_active":"2024-02-19T21:42:04.205907+0000","last_became_peered":"2024-02-19T21:42:04.205907+0000","last_unstale":"2024-02-19T21:45:07.894010+0000","last_undegraded":"2024-02-19T21:45:07.894010+0000","last_fullsized":"2024-02-19T21:45:07.894010+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'38","last_scrub_stamp":"2024-02-19T21:45:05.077057+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:45:05.077057+0000","log_size":38,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":163,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.900255+0000","last_change":"2024-02-19T21:42:04.200909+0000","last_active":"2024-02-19T21:45:07.900255+0000","last_peered":"2024-02-19T21:45:07.900255+0000","last_clean":"2024-02-19T21:45:07.900255+0000","last_became_active":"2024-02-19T21:42:04.200496+0000","last_became_peered":"2024-02-19T21:42:04.200496+0000","last_unstale":"2024-02-19T21:45:07.900255+0000","last_undegraded":"2024-02-19T21:45:07.900255+0000","last_fullsized":"2024-02-19T21:45:07.900255+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:38.697183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:38.697183+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"310'4603","reported_seq":4652,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:14.848533+0000","last_change":"2024-02-19T21:44:16.118900+0000","last_active":"2024-02-19T21:45:14.848533+0000","last_peered":"2024-02-19T21:45:14.848533+0000","last_clean":"2024-02-19T21:45:14.848533+0000","last_became_active":"2024-02-19T21:44:16.118628+0000","last_became_peered":"2024-02-19T21:44:16.118628+0000","last_unstale":"2024-02-19T21:45:14.848533+0000","last_undegraded":"2024-02-19T21:45:14.848533+0000","last_fullsized":"2024-02-19T21:45:14.848533+0000","mapping_epoch":268,"log_start":"0'0","ondisk_log_start":"0'0","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4603,"ondisk_log_size":4603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":301662208,"num_objects":4603,"num_object_clones":0,"num_object_copies":13809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4603,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4603,"num_write_kb":294592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":288,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.895982+0000","last_change":"2024-02-19T21:44:59.685042+0000","last_active":"2024-02-19T21:45:07.895982+0000","last_peered":"2024-02-19T21:45:07.895982+0000","last_clean":"2024-02-19T21:45:07.895982+0000","last_became_active":"2024-02-19T21:39:39.481908+0000","last_became_peered":"2024-02-19T21:39:39.481908+0000","last_unstale":"2024-02-19T21:45:07.895982+0000","last_undegraded":"2024-02-19T21:45:07.895982+0000","last_fullsized":"2024-02-19T21:45:07.895982+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:59.684971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:44:59.684971+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":301,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:12.972456+0000","last_change":"2024-02-19T21:45:12.972456+0000","last_active":"2024-02-19T21:45:12.972456+0000","last_peered":"2024-02-19T21:45:12.972456+0000","last_clean":"2024-02-19T21:45:12.972456+0000","last_became_active":"2024-02-19T21:42:04.197048+0000","last_became_peered":"2024-02-19T21:42:04.197048+0000","last_unstale":"2024-02-19T21:45:12.972456+0000","last_undegraded":"2024-02-19T21:45:12.972456+0000","last_fullsized":"2024-02-19T21:45:12.972456+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.972369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.972369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"201'28","reported_seq":293,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.902375+0000","last_change":"2024-02-19T21:41:31.580765+0000","last_active":"2024-02-19T21:45:07.902375+0000","last_peered":"2024-02-19T21:45:07.902375+0000","last_clean":"2024-02-19T21:45:07.902375+0000","last_became_active":"2024-02-19T21:35:14.513806+0000","last_became_peered":"2024-02-19T21:35:14.513806+0000","last_unstale":"2024-02-19T21:45:07.902375+0000","last_undegraded":"2024-02-19T21:45:07.902375+0000","last_fullsized":"2024-02-19T21:45:07.902375+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'14","last_scrub_stamp":"2024-02-19T21:41:31.580701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:41:31.580701+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":34,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":294,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:10.134491+0000","last_change":"2024-02-19T21:41:30.192537+0000","last_active":"2024-02-19T21:45:10.134491+0000","last_peered":"2024-02-19T21:45:10.134491+0000","last_clean":"2024-02-19T21:45:10.134491+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:45:10.134491+0000","last_undegraded":"2024-02-19T21:45:10.134491+0000","last_fullsized":"2024-02-19T21:45:10.134491+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'9","last_scrub_stamp":"2024-02-19T21:41:30.192427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:30.192427+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"310'4793","reported_seq":4843,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:15.041709+0000","last_change":"2024-02-19T21:44:16.122360+0000","last_active":"2024-02-19T21:45:15.041709+0000","last_peered":"2024-02-19T21:45:15.041709+0000","last_clean":"2024-02-19T21:45:15.041709+0000","last_became_active":"2024-02-19T21:44:16.122083+0000","last_became_peered":"2024-02-19T21:44:16.122083+0000","last_unstale":"2024-02-19T21:45:15.041709+0000","last_undegraded":"2024-02-19T21:45:15.041709+0000","last_fullsized":"2024-02-19T21:45:15.041709+0000","mapping_epoch":268,"log_start":"288'700","ondisk_log_start":"288'700","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4093,"ondisk_log_size":4093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":314114048,"num_objects":4793,"num_object_clones":0,"num_object_copies":14379,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4793,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4793,"num_write_kb":306752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"66'1","reported_seq":190,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.899766+0000","last_change":"2024-02-19T21:44:56.167353+0000","last_active":"2024-02-19T21:45:07.899766+0000","last_peered":"2024-02-19T21:45:07.899766+0000","last_clean":"2024-02-19T21:45:07.899766+0000","last_became_active":"2024-02-19T21:44:56.166670+0000","last_became_peered":"2024-02-19T21:44:56.166670+0000","last_unstale":"2024-02-19T21:45:07.899766+0000","last_undegraded":"2024-02-19T21:45:07.899766+0000","last_fullsized":"2024-02-19T21:45:07.899766+0000","mapping_epoch":165,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:44:54.104918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:44:54.104918+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"261'11","reported_seq":312,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:10.146442+0000","last_change":"2024-02-19T21:45:01.716882+0000","last_active":"2024-02-19T21:45:10.146442+0000","last_peered":"2024-02-19T21:45:10.146442+0000","last_clean":"2024-02-19T21:45:10.146442+0000","last_became_active":"2024-02-19T21:44:08.123392+0000","last_became_peered":"2024-02-19T21:44:08.123392+0000","last_unstale":"2024-02-19T21:45:10.146442+0000","last_undegraded":"2024-02-19T21:45:10.146442+0000","last_fullsized":"2024-02-19T21:45:10.146442+0000","mapping_epoch":62,"log_start":"257'10","ondisk_log_start":"257'10","created":62,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-02-19T21:45:01.716817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.716817+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":290,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:08.496707+0000","last_change":"2024-02-19T21:45:08.496668+0000","last_active":"2024-02-19T21:45:08.496707+0000","last_peered":"2024-02-19T21:45:08.496707+0000","last_clean":"2024-02-19T21:45:08.496707+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:45:08.496707+0000","last_undegraded":"2024-02-19T21:45:08.496707+0000","last_fullsized":"2024-02-19T21:45:08.496707+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:45:08.496566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:08.496566+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"201'19","reported_seq":307,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.899860+0000","last_change":"2024-02-19T21:44:58.015612+0000","last_active":"2024-02-19T21:45:07.899860+0000","last_peered":"2024-02-19T21:45:07.899860+0000","last_clean":"2024-02-19T21:45:07.899860+0000","last_became_active":"2024-02-19T21:39:51.536649+0000","last_became_peered":"2024-02-19T21:39:51.536649+0000","last_unstale":"2024-02-19T21:45:07.899860+0000","last_undegraded":"2024-02-19T21:45:07.899860+0000","last_fullsized":"2024-02-19T21:45:07.899860+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:44:58.015506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:58.015506+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2","version":"310'4541","reported_seq":4591,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:15.027193+0000","last_change":"2024-02-19T21:44:16.115513+0000","last_active":"2024-02-19T21:45:15.027193+0000","last_peered":"2024-02-19T21:45:15.027193+0000","last_clean":"2024-02-19T21:45:15.027193+0000","last_became_active":"2024-02-19T21:44:16.115219+0000","last_became_peered":"2024-02-19T21:44:16.115219+0000","last_unstale":"2024-02-19T21:45:15.027193+0000","last_undegraded":"2024-02-19T21:45:15.027193+0000","last_fullsized":"2024-02-19T21:45:15.027193+0000","mapping_epoch":268,"log_start":"287'500","ondisk_log_start":"287'500","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4041,"ondisk_log_size":4041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":297598976,"num_objects":4541,"num_object_clones":0,"num_object_copies":13623,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4541,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4541,"num_write_kb":290624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,6],"acting":[1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":300,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.902980+0000","last_change":"2024-02-19T21:44:56.155568+0000","last_active":"2024-02-19T21:45:07.902980+0000","last_peered":"2024-02-19T21:45:07.902980+0000","last_clean":"2024-02-19T21:45:07.902980+0000","last_became_active":"2024-02-19T21:44:56.155194+0000","last_became_peered":"2024-02-19T21:44:56.155194+0000","last_unstale":"2024-02-19T21:45:07.902980+0000","last_undegraded":"2024-02-19T21:45:07.902980+0000","last_fullsized":"2024-02-19T21:45:07.902980+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:16.845272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:16.845272+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"265'11","reported_seq":404,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:10.148717+0000","last_change":"2024-02-19T21:44:12.206332+0000","last_active":"2024-02-19T21:45:10.148717+0000","last_peered":"2024-02-19T21:45:10.148717+0000","last_clean":"2024-02-19T21:45:10.148717+0000","last_became_active":"2024-02-19T21:44:12.205049+0000","last_became_peered":"2024-02-19T21:44:12.205049+0000","last_unstale":"2024-02-19T21:45:10.148717+0000","last_undegraded":"2024-02-19T21:45:10.148717+0000","last_fullsized":"2024-02-19T21:45:10.148717+0000","mapping_epoch":97,"log_start":"98'9","ondisk_log_start":"98'9","created":62,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'9","last_scrub_stamp":"2024-02-19T21:41:30.610855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:30.610855+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":280,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.904705+0000","last_change":"2024-02-19T21:40:14.294150+0000","last_active":"2024-02-19T21:45:07.904705+0000","last_peered":"2024-02-19T21:45:07.904705+0000","last_clean":"2024-02-19T21:45:07.904705+0000","last_became_active":"2024-02-19T21:32:23.362738+0000","last_became_peered":"2024-02-19T21:32:23.362738+0000","last_unstale":"2024-02-19T21:45:07.904705+0000","last_undegraded":"2024-02-19T21:45:07.904705+0000","last_fullsized":"2024-02-19T21:45:07.904705+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:14.294064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:40:14.294064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"270'34","reported_seq":201,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.902606+0000","last_change":"2024-02-19T21:44:17.451246+0000","last_active":"2024-02-19T21:45:07.902606+0000","last_peered":"2024-02-19T21:45:07.902606+0000","last_clean":"2024-02-19T21:45:07.902606+0000","last_became_active":"2024-02-19T21:39:51.539230+0000","last_became_peered":"2024-02-19T21:39:51.539230+0000","last_unstale":"2024-02-19T21:45:07.902606+0000","last_undegraded":"2024-02-19T21:45:07.902606+0000","last_fullsized":"2024-02-19T21:45:07.902606+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"270'34","last_scrub_stamp":"2024-02-19T21:44:17.451151+0000","last_deep_scrub":"270'34","last_deep_scrub_stamp":"2024-02-19T21:44:17.451151+0000","last_clean_scrub_stamp":"2024-02-19T21:44:17.451151+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"310'4674","reported_seq":4722,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:15.060388+0000","last_change":"2024-02-19T21:44:16.116710+0000","last_active":"2024-02-19T21:45:15.060388+0000","last_peered":"2024-02-19T21:45:15.060388+0000","last_clean":"2024-02-19T21:45:15.060388+0000","last_became_active":"2024-02-19T21:44:16.116428+0000","last_became_peered":"2024-02-19T21:44:16.116428+0000","last_unstale":"2024-02-19T21:45:15.060388+0000","last_undegraded":"2024-02-19T21:45:15.060388+0000","last_fullsized":"2024-02-19T21:45:15.060388+0000","mapping_epoch":268,"log_start":"0'0","ondisk_log_start":"0'0","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4674,"ondisk_log_size":4674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":306315264,"num_objects":4674,"num_object_clones":0,"num_object_copies":14022,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4674,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4674,"num_write_kb":299136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4],"acting":[3,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":270,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.901352+0000","last_change":"2024-02-19T21:44:56.140705+0000","last_active":"2024-02-19T21:45:07.901352+0000","last_peered":"2024-02-19T21:45:07.901352+0000","last_clean":"2024-02-19T21:45:07.901352+0000","last_became_active":"2024-02-19T21:44:56.140445+0000","last_became_peered":"2024-02-19T21:44:56.140445+0000","last_unstale":"2024-02-19T21:45:07.901352+0000","last_undegraded":"2024-02-19T21:45:07.901352+0000","last_fullsized":"2024-02-19T21:45:07.901352+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:40.015907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:40.015907+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"271'13","reported_seq":335,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:10.157927+0000","last_change":"2024-02-19T21:44:48.478051+0000","last_active":"2024-02-19T21:45:10.157927+0000","last_peered":"2024-02-19T21:45:10.157927+0000","last_clean":"2024-02-19T21:45:10.157927+0000","last_became_active":"2024-02-19T21:44:18.115023+0000","last_became_peered":"2024-02-19T21:44:18.115023+0000","last_unstale":"2024-02-19T21:45:10.157927+0000","last_undegraded":"2024-02-19T21:45:10.157927+0000","last_fullsized":"2024-02-19T21:45:10.157927+0000","mapping_epoch":266,"log_start":"170'11","ondisk_log_start":"170'11","created":62,"last_epoch_clean":271,"parent":"0.0","parent_split_bits":0,"last_scrub":"271'13","last_scrub_stamp":"2024-02-19T21:44:48.477958+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:44:48.477958+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":282,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.905349+0000","last_change":"2024-02-19T21:45:00.765546+0000","last_active":"2024-02-19T21:45:07.905349+0000","last_peered":"2024-02-19T21:45:07.905349+0000","last_clean":"2024-02-19T21:45:07.905349+0000","last_became_active":"2024-02-19T21:32:23.363155+0000","last_became_peered":"2024-02-19T21:32:23.363155+0000","last_unstale":"2024-02-19T21:45:07.905349+0000","last_undegraded":"2024-02-19T21:45:07.905349+0000","last_fullsized":"2024-02-19T21:45:07.905349+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:00.765453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:45:00.765453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"200'20","reported_seq":284,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.902589+0000","last_change":"2024-02-19T21:45:01.568565+0000","last_active":"2024-02-19T21:45:07.902589+0000","last_peered":"2024-02-19T21:45:07.902589+0000","last_clean":"2024-02-19T21:45:07.902589+0000","last_became_active":"2024-02-19T21:35:14.514968+0000","last_became_peered":"2024-02-19T21:35:14.514968+0000","last_unstale":"2024-02-19T21:45:07.902589+0000","last_undegraded":"2024-02-19T21:45:07.902589+0000","last_fullsized":"2024-02-19T21:45:07.902589+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'20","last_scrub_stamp":"2024-02-19T21:45:01.568503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.568503+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6],"acting":[3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"310'4683","reported_seq":4731,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:15.053962+0000","last_change":"2024-02-19T21:44:16.117207+0000","last_active":"2024-02-19T21:45:15.053962+0000","last_peered":"2024-02-19T21:45:15.053962+0000","last_clean":"2024-02-19T21:45:15.053962+0000","last_became_active":"2024-02-19T21:44:16.116913+0000","last_became_peered":"2024-02-19T21:44:16.116913+0000","last_unstale":"2024-02-19T21:45:15.053962+0000","last_undegraded":"2024-02-19T21:45:15.053962+0000","last_fullsized":"2024-02-19T21:45:15.053962+0000","mapping_epoch":268,"log_start":"288'600","ondisk_log_start":"288'600","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4083,"ondisk_log_size":4083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":306905088,"num_objects":4683,"num_object_clones":0,"num_object_copies":14049,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4683,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4683,"num_write_kb":299712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":53,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.895606+0000","last_change":"2024-02-19T21:44:56.152950+0000","last_active":"2024-02-19T21:45:07.895606+0000","last_peered":"2024-02-19T21:45:07.895606+0000","last_clean":"2024-02-19T21:45:07.895606+0000","last_became_active":"2024-02-19T21:44:56.152672+0000","last_became_peered":"2024-02-19T21:44:56.152672+0000","last_unstale":"2024-02-19T21:45:07.895606+0000","last_undegraded":"2024-02-19T21:45:07.895606+0000","last_fullsized":"2024-02-19T21:45:07.895606+0000","mapping_epoch":275,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:36.725664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:41:36.725664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,1],"acting":[0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":294,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.904426+0000","last_change":"2024-02-19T21:45:01.798485+0000","last_active":"2024-02-19T21:45:07.904426+0000","last_peered":"2024-02-19T21:45:07.904426+0000","last_clean":"2024-02-19T21:45:07.904426+0000","last_became_active":"2024-02-19T21:44:22.245925+0000","last_became_peered":"2024-02-19T21:44:22.245925+0000","last_unstale":"2024-02-19T21:45:07.904426+0000","last_undegraded":"2024-02-19T21:45:07.904426+0000","last_fullsized":"2024-02-19T21:45:07.904426+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:01.798387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.798387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":285,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.895840+0000","last_change":"2024-02-19T21:44:51.468813+0000","last_active":"2024-02-19T21:45:07.895840+0000","last_peered":"2024-02-19T21:45:07.895840+0000","last_clean":"2024-02-19T21:45:07.895840+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:45:07.895840+0000","last_undegraded":"2024-02-19T21:45:07.895840+0000","last_fullsized":"2024-02-19T21:45:07.895840+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:51.468731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:44:51.468731+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"201'31","reported_seq":240,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.904665+0000","last_change":"2024-02-19T21:44:11.728491+0000","last_active":"2024-02-19T21:45:07.904665+0000","last_peered":"2024-02-19T21:45:07.904665+0000","last_clean":"2024-02-19T21:45:07.904665+0000","last_became_active":"2024-02-19T21:39:39.474668+0000","last_became_peered":"2024-02-19T21:39:39.474668+0000","last_unstale":"2024-02-19T21:45:07.904665+0000","last_undegraded":"2024-02-19T21:45:07.904665+0000","last_fullsized":"2024-02-19T21:45:07.904665+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'31","last_scrub_stamp":"2024-02-19T21:44:11.728412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:11.728412+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":49,"num_read_kb":39,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"310'4760","reported_seq":4810,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:15.009500+0000","last_change":"2024-02-19T21:44:16.117971+0000","last_active":"2024-02-19T21:45:15.009500+0000","last_peered":"2024-02-19T21:45:15.009500+0000","last_clean":"2024-02-19T21:45:15.009500+0000","last_became_active":"2024-02-19T21:44:16.117603+0000","last_became_peered":"2024-02-19T21:44:16.117603+0000","last_unstale":"2024-02-19T21:45:15.009500+0000","last_undegraded":"2024-02-19T21:45:15.009500+0000","last_fullsized":"2024-02-19T21:45:15.009500+0000","mapping_epoch":268,"log_start":"288'600","ondisk_log_start":"288'600","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4160,"ondisk_log_size":4160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":311951360,"num_objects":4760,"num_object_clones":0,"num_object_copies":14280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4760,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4760,"num_write_kb":304640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"66'1","reported_seq":278,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.903097+0000","last_change":"2024-02-19T21:45:03.607205+0000","last_active":"2024-02-19T21:45:07.903097+0000","last_peered":"2024-02-19T21:45:07.903097+0000","last_clean":"2024-02-19T21:45:07.903097+0000","last_became_active":"2024-02-19T21:44:56.145343+0000","last_became_peered":"2024-02-19T21:44:56.145343+0000","last_unstale":"2024-02-19T21:45:07.903097+0000","last_undegraded":"2024-02-19T21:45:07.903097+0000","last_fullsized":"2024-02-19T21:45:07.903097+0000","mapping_epoch":197,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:45:03.607112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:45:03.607112+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":193,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:12.163918+0000","last_change":"2024-02-19T21:45:12.163918+0000","last_active":"2024-02-19T21:45:12.163918+0000","last_peered":"2024-02-19T21:45:12.163918+0000","last_clean":"2024-02-19T21:45:12.163918+0000","last_became_active":"2024-02-19T21:44:26.881695+0000","last_became_peered":"2024-02-19T21:44:26.881695+0000","last_unstale":"2024-02-19T21:45:12.163918+0000","last_undegraded":"2024-02-19T21:45:12.163918+0000","last_fullsized":"2024-02-19T21:45:12.163918+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":279,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.163825+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":179,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.902320+0000","last_change":"2024-02-19T21:45:00.748363+0000","last_active":"2024-02-19T21:45:07.902320+0000","last_peered":"2024-02-19T21:45:07.902320+0000","last_clean":"2024-02-19T21:45:07.902320+0000","last_became_active":"2024-02-19T21:39:39.479752+0000","last_became_peered":"2024-02-19T21:39:39.479752+0000","last_unstale":"2024-02-19T21:45:07.902320+0000","last_undegraded":"2024-02-19T21:45:07.902320+0000","last_fullsized":"2024-02-19T21:45:07.902320+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:45:00.748244+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:45:00.748244+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"201'44","reported_seq":376,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.899868+0000","last_change":"2024-02-19T21:44:16.255128+0000","last_active":"2024-02-19T21:45:07.899868+0000","last_peered":"2024-02-19T21:45:07.899868+0000","last_clean":"2024-02-19T21:45:07.899868+0000","last_became_active":"2024-02-19T21:42:04.200393+0000","last_became_peered":"2024-02-19T21:42:04.200393+0000","last_unstale":"2024-02-19T21:45:07.899868+0000","last_undegraded":"2024-02-19T21:45:07.899868+0000","last_fullsized":"2024-02-19T21:45:07.899868+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'44","last_scrub_stamp":"2024-02-19T21:44:16.255049+0000","last_deep_scrub":"201'44","last_deep_scrub_stamp":"2024-02-19T21:44:16.255049+0000","last_clean_scrub_stamp":"2024-02-19T21:44:16.255049+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.6","version":"310'4780","reported_seq":4830,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:14.990953+0000","last_change":"2024-02-19T21:44:16.119031+0000","last_active":"2024-02-19T21:45:14.990953+0000","last_peered":"2024-02-19T21:45:14.990953+0000","last_clean":"2024-02-19T21:45:14.990953+0000","last_became_active":"2024-02-19T21:44:16.118369+0000","last_became_peered":"2024-02-19T21:44:16.118369+0000","last_unstale":"2024-02-19T21:45:14.990953+0000","last_undegraded":"2024-02-19T21:45:14.990953+0000","last_fullsized":"2024-02-19T21:45:14.990953+0000","mapping_epoch":268,"log_start":"287'600","ondisk_log_start":"287'600","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4180,"ondisk_log_size":4180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":313262080,"num_objects":4780,"num_object_clones":0,"num_object_copies":14340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4780,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4780,"num_write_kb":305920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":310,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.897685+0000","last_change":"2024-02-19T21:44:56.141248+0000","last_active":"2024-02-19T21:45:07.897685+0000","last_peered":"2024-02-19T21:45:07.897685+0000","last_clean":"2024-02-19T21:45:07.897685+0000","last_became_active":"2024-02-19T21:44:56.140918+0000","last_became_peered":"2024-02-19T21:44:56.140918+0000","last_unstale":"2024-02-19T21:45:07.897685+0000","last_undegraded":"2024-02-19T21:45:07.897685+0000","last_fullsized":"2024-02-19T21:45:07.897685+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:42.230664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:42.230664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":289,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.889915+0000","last_change":"2024-02-19T21:44:30.337438+0000","last_active":"2024-02-19T21:45:07.889915+0000","last_peered":"2024-02-19T21:45:07.889915+0000","last_clean":"2024-02-19T21:45:07.889915+0000","last_became_active":"2024-02-19T21:44:30.337128+0000","last_became_peered":"2024-02-19T21:44:30.337128+0000","last_unstale":"2024-02-19T21:45:07.889915+0000","last_undegraded":"2024-02-19T21:45:07.889915+0000","last_fullsized":"2024-02-19T21:45:07.889915+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":283,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.547129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.547129+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.547129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1],"acting":[4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":280,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.904742+0000","last_change":"2024-02-19T21:44:01.569675+0000","last_active":"2024-02-19T21:45:07.904742+0000","last_peered":"2024-02-19T21:45:07.904742+0000","last_clean":"2024-02-19T21:45:07.904742+0000","last_became_active":"2024-02-19T21:32:23.357438+0000","last_became_peered":"2024-02-19T21:32:23.357438+0000","last_unstale":"2024-02-19T21:45:07.904742+0000","last_undegraded":"2024-02-19T21:45:07.904742+0000","last_fullsized":"2024-02-19T21:45:07.904742+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:01.569611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:01.569611+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"201'15","reported_seq":308,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.897499+0000","last_change":"2024-02-19T21:44:54.025887+0000","last_active":"2024-02-19T21:45:07.897499+0000","last_peered":"2024-02-19T21:45:07.897499+0000","last_clean":"2024-02-19T21:45:07.897499+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:45:07.897499+0000","last_undegraded":"2024-02-19T21:45:07.897499+0000","last_fullsized":"2024-02-19T21:45:07.897499+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'15","last_scrub_stamp":"2024-02-19T21:44:54.025808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:54.025808+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.5","version":"310'4620","reported_seq":4670,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:15.251138+0000","last_change":"2024-02-19T21:44:16.115677+0000","last_active":"2024-02-19T21:45:15.251138+0000","last_peered":"2024-02-19T21:45:15.251138+0000","last_clean":"2024-02-19T21:45:15.251138+0000","last_became_active":"2024-02-19T21:44:16.115394+0000","last_became_peered":"2024-02-19T21:44:16.115394+0000","last_unstale":"2024-02-19T21:45:15.251138+0000","last_undegraded":"2024-02-19T21:45:15.251138+0000","last_fullsized":"2024-02-19T21:45:15.251138+0000","mapping_epoch":268,"log_start":"286'300","ondisk_log_start":"286'300","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4320,"ondisk_log_size":4320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":302776320,"num_objects":4620,"num_object_clones":0,"num_object_copies":13860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4620,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4620,"num_write_kb":295680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":300,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.901589+0000","last_change":"2024-02-19T21:44:56.160766+0000","last_active":"2024-02-19T21:45:07.901589+0000","last_peered":"2024-02-19T21:45:07.901589+0000","last_clean":"2024-02-19T21:45:07.901589+0000","last_became_active":"2024-02-19T21:44:56.160521+0000","last_became_peered":"2024-02-19T21:44:56.160521+0000","last_unstale":"2024-02-19T21:45:07.901589+0000","last_undegraded":"2024-02-19T21:45:07.901589+0000","last_fullsized":"2024-02-19T21:45:07.901589+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:17.853016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:40:17.853016+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":240,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:09.932701+0000","last_change":"2024-02-19T21:45:09.932653+0000","last_active":"2024-02-19T21:45:09.932701+0000","last_peered":"2024-02-19T21:45:09.932701+0000","last_clean":"2024-02-19T21:45:09.932701+0000","last_became_active":"2024-02-19T21:42:04.199889+0000","last_became_peered":"2024-02-19T21:42:04.199889+0000","last_unstale":"2024-02-19T21:45:09.932701+0000","last_undegraded":"2024-02-19T21:45:09.932701+0000","last_fullsized":"2024-02-19T21:45:09.932701+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:09.932575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:45:09.932575+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"200'27","reported_seq":352,"reported_epoch":309,"state":"active+clean","last_fresh":"2024-02-19T21:45:07.901203+0000","last_change":"2024-02-19T21:44:55.762734+0000","last_active":"2024-02-19T21:45:07.901203+0000","last_peered":"2024-02-19T21:45:07.901203+0000","last_clean":"2024-02-19T21:45:07.901203+0000","last_became_active":"2024-02-19T21:42:04.212731+0000","last_became_peered":"2024-02-19T21:42:04.212731+0000","last_unstale":"2024-02-19T21:45:07.901203+0000","last_undegraded":"2024-02-19T21:45:07.901203+0000","last_fullsized":"2024-02-19T21:45:07.901203+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'27","last_scrub_stamp":"2024-02-19T21:44:55.762629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:55.762629+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"287'10","reported_seq":460,"reported_epoch":310,"state":"active+clean","last_fresh":"2024-02-19T21:45:10.156455+0000","last_change":"2024-02-19T21:44:34.386226+0000","last_active":"2024-02-19T21:45:10.156455+0000","last_peered":"2024-02-19T21:45:10.156455+0000","last_clean":"2024-02-19T21:45:10.156455+0000","last_became_active":"2024-02-19T21:44:34.385140+0000","last_became_peered":"2024-02-19T21:44:34.385140+0000","last_unstale":"2024-02-19T21:45:10.156455+0000","last_undegraded":"2024-02-19T21:45:10.156455+0000","last_fullsized":"2024-02-19T21:45:10.156455+0000","mapping_epoch":62,"log_start":"66'8","ondisk_log_start":"66'8","created":62,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:44:11.163719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:11.163719+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":4911464448,"num_objects":74943,"num_object_clones":0,"num_object_copies":224829,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74943,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74943,"num_write_kb":4796352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":14725087232,"data_stored":14725087232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":68243,"ondisk_log_size":68243,"up":48,"acting":48,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":758,"num_read_kb":753,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1116,"num_read_kb":873,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":3604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":748,"ondisk_log_size":748,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":22,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":66,"acting":66,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":560,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201437,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1474328,"kb_used_data":1177104,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":92270824,"statfs":{"total":95995035648,"available":94485323776,"internally_reserved":0,"allocated":1205354496,"data_stored":1204743236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:44:37 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":1.95,"15min":1.1850000000000001},"min":{"1min":0.25600000000000001,"5min":0.19800000000000001,"15min":0.189},"max":{"1min":0.68899999999999995,"5min":13.645,"15min":13.645},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":1.7969999999999999,"15min":1.246},"min":{"1min":0.28599999999999998,"5min":0.253,"15min":0.20999999999999999},"max":{"1min":1.421,"5min":14.212999999999999,"15min":14.212999999999999},"last":0.90500000000000003}]},{"osd":1,"last update":"Mon Feb 19 21:44:37 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":1.8089999999999999,"15min":1.329},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23200000000000001},"max":{"1min":0.65700000000000003,"5min":14.246,"15min":14.246},"last":2.1680000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":1.845,"15min":1.1879999999999999},"min":{"1min":0.371,"5min":0.23599999999999999,"15min":0.223},"max":{"1min":1.4419999999999999,"5min":14.15,"15min":14.15},"last":1.548}]},{"osd":2,"last update":"Mon Feb 19 21:44:37 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":1.9870000000000001,"15min":1.28},"min":{"1min":0.35199999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.70799999999999996,"5min":10.965999999999999,"15min":10.965999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":1.643,"15min":1.306},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.27800000000000002},"max":{"1min":0.63700000000000001,"5min":7.4359999999999999,"15min":9.7010000000000005},"last":1.7410000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:44:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":2.1419999999999999,"15min":1.619},"min":{"1min":0.40300000000000002,"5min":0.29199999999999998,"15min":0.26900000000000002},"max":{"1min":0.66400000000000003,"5min":11.004,"15min":31.559000000000001},"last":1.1599999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":1.871,"15min":1.4910000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.749,"5min":10.522,"15min":30.812999999999999},"last":0.29299999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:44:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":1.9259999999999999,"15min":1.002},"min":{"1min":0.28199999999999997,"5min":0.26500000000000001,"15min":0.247},"max":{"1min":1.4590000000000001,"5min":14.208,"15min":14.208},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":2.4529999999999998,"15min":1.21},"min":{"1min":0.309,"5min":0.26500000000000001,"15min":0.245},"max":{"1min":3.1280000000000001,"5min":11.541,"15min":11.541},"last":0.98599999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:44:37 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":1.8280000000000001,"15min":1.101},"min":{"1min":0.29899999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.829,"5min":10.090999999999999,"15min":10.090999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":2.4180000000000001,"15min":1.2130000000000001},"min":{"1min":0.34100000000000003,"5min":0.315,"15min":0.28799999999999998},"max":{"1min":5.0199999999999996,"5min":17.012,"15min":17.012},"last":0.94199999999999995}]},{"osd":6,"last update":"Mon Feb 19 21:44:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":1.903,"15min":1.048},"min":{"1min":0.32500000000000001,"5min":0.31900000000000001,"15min":0.30299999999999999},"max":{"1min":1.5940000000000001,"5min":14.177,"15min":14.177},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":2.387,"15min":1.3720000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.29699999999999999},"max":{"1min":3.093,"5min":12.913,"15min":12.913},"last":0.36699999999999999}]}]},{"osd":6,"up_from":47,"seq":201863463076,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2708152,"kb_used_data":2402736,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":91037000,"statfs":{"total":95995035648,"available":93221888000,"internally_reserved":0,"allocated":2460401664,"data_stored":2459757722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:44:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.9890000000000001,"15min":1.3819999999999999},"min":{"1min":0.24199999999999999,"5min":0.23400000000000001,"15min":0.20599999999999999},"max":{"1min":7.1260000000000003,"5min":45.197000000000003,"15min":45.197000000000003},"last":2.734},{"interface":"front","average":{"1min":1.3180000000000001,"5min":2.286,"15min":1.484},"min":{"1min":0.247,"5min":0.23499999999999999,"15min":0.221},"max":{"1min":7.7199999999999998,"5min":44.753,"15min":44.753},"last":2.3820000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:44:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.9970000000000001,"15min":1.331},"min":{"1min":0.31,"5min":0.222,"15min":0.222},"max":{"1min":7.9000000000000004,"5min":45.231999999999999,"15min":45.231999999999999},"last":0.38800000000000001},{"interface":"front","average":{"1min":1.7110000000000001,"5min":1.863,"15min":1.298},"min":{"1min":0.253,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":6.181,"5min":45.097999999999999,"15min":45.097999999999999},"last":2.298}]},{"osd":2,"last update":"Mon Feb 19 21:44:16 2024","interfaces":[{"interface":"back","average":{"1min":1.673,"5min":1.4450000000000001,"15min":1.151},"min":{"1min":0.316,"5min":0.28599999999999998,"15min":0.26800000000000002},"max":{"1min":7.6920000000000002,"5min":7.6920000000000002,"15min":8.3849999999999998},"last":1.992},{"interface":"front","average":{"1min":1.089,"5min":1.5289999999999999,"15min":1.1779999999999999},"min":{"1min":0.34300000000000003,"5min":0.29299999999999998,"15min":0.27300000000000002},"max":{"1min":7.6900000000000004,"5min":8.5259999999999998,"15min":18.068000000000001},"last":1.9510000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:44:16 2024","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.669,"15min":1.2609999999999999},"min":{"1min":0.40300000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":7.8440000000000003,"5min":10.630000000000001,"15min":11.15},"last":1.9019999999999999},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.3799999999999999,"15min":1.244},"min":{"1min":0.29399999999999998,"5min":0.26400000000000001,"15min":0.246},"max":{"1min":8.5969999999999995,"5min":8.5969999999999995,"15min":19.632999999999999},"last":2.2480000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:44:16 2024","interfaces":[{"interface":"back","average":{"1min":2.2810000000000001,"5min":2.0670000000000002,"15min":1.0760000000000001},"min":{"1min":0.26400000000000001,"5min":0.247,"15min":0.247},"max":{"1min":14.254,"5min":14.254,"15min":14.254},"last":0.63800000000000001},{"interface":"front","average":{"1min":2.1970000000000001,"5min":2.1349999999999998,"15min":1.1399999999999999},"min":{"1min":0.27500000000000002,"5min":0.27300000000000002,"15min":0.23499999999999999},"max":{"1min":11.536,"5min":14.055,"15min":16.594999999999999},"last":1.5409999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:44:16 2024","interfaces":[{"interface":"back","average":{"1min":1.6619999999999999,"5min":2.0529999999999999,"15min":1.0880000000000001},"min":{"1min":0.29099999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":14.223000000000001,"5min":14.223000000000001,"15min":14.223000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":2.6059999999999999,"5min":2.387,"15min":1.258},"min":{"1min":0.315,"5min":0.30299999999999999,"15min":0.27900000000000003},"max":{"1min":11.558999999999999,"5min":15.497999999999999,"15min":15.497999999999999},"last":0.36199999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:44:34 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":2.3690000000000002,"15min":1.2609999999999999},"min":{"1min":0.317,"5min":0.307,"15min":0.26700000000000002},"max":{"1min":11.457000000000001,"5min":14.721,"15min":14.721},"last":5.3760000000000003},{"interface":"front","average":{"1min":1.3939999999999999,"5min":2.4079999999999999,"15min":1.3200000000000001},"min":{"1min":0.38500000000000001,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":11.500999999999999,"5min":14.744999999999999,"15min":14.744999999999999},"last":5.4059999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575038,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3583048,"kb_used_data":3281728,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":90162104,"statfs":{"total":95995035648,"available":92325994496,"internally_reserved":0,"allocated":3360489472,"data_stored":3359830650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:45:03 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":0.92900000000000005,"15min":1.286},"min":{"1min":0.19400000000000001,"5min":0.161,"15min":0.161},"max":{"1min":4.79,"5min":6.9260000000000002,"15min":42.776000000000003},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.85499999999999998,"5min":1.1279999999999999,"15min":1.2929999999999999},"min":{"1min":0.22600000000000001,"5min":0.183,"15min":0.183},"max":{"1min":2.3759999999999999,"5min":5.2919999999999998,"15min":44.845999999999997},"last":0.34300000000000003}]},{"osd":2,"last update":"Mon Feb 19 21:44:30 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.91600000000000004,"15min":1.157},"min":{"1min":0.25700000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.617,"5min":6.9640000000000004,"15min":11.826000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.95199999999999996,"15min":1.2509999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.215},"max":{"1min":1.0069999999999999,"5min":4.6180000000000003,"15min":12.26},"last":0.45900000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:45:03 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.1879999999999999,"15min":1.4159999999999999},"min":{"1min":0.33000000000000002,"5min":0.224,"15min":0.224},"max":{"1min":5.4500000000000002,"5min":8.3469999999999995,"15min":41.607999999999997},"last":0.623},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.2330000000000001,"15min":1.2729999999999999},"min":{"1min":0.30599999999999999,"5min":0.216,"15min":0.216},"max":{"1min":5.3070000000000004,"5min":8.7349999999999994,"15min":42.811999999999998},"last":0.61199999999999999}]},{"osd":4,"last update":"Mon Feb 19 21:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.5189999999999999,"15min":1.1120000000000001},"min":{"1min":0.32100000000000001,"5min":0.26900000000000002,"15min":0.26800000000000002},"max":{"1min":12.754,"5min":12.754,"15min":12.754},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":1.3779999999999999,"15min":1.1739999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.004,"5min":6.4169999999999998,"15min":10.51},"last":0.99199999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:44:48 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":1.7390000000000001,"15min":1.2450000000000001},"min":{"1min":0.35499999999999998,"5min":0.30599999999999999,"15min":0.28799999999999998},"max":{"1min":1.647,"5min":8.4269999999999996,"15min":10.458},"last":0.432},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.552,"15min":1.1850000000000001},"min":{"1min":0.36099999999999999,"5min":0.32600000000000001,"15min":0.30099999999999999},"max":{"1min":4.4109999999999996,"5min":6.5259999999999998,"15min":7.6950000000000003},"last":2.3050000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4790000000000001,"5min":1.8180000000000001,"15min":1.25},"min":{"1min":0.42799999999999999,"5min":0.318,"15min":0.30099999999999999},"max":{"1min":4.5030000000000001,"5min":11.638999999999999,"15min":11.638999999999999},"last":2.129},{"interface":"front","average":{"1min":1.367,"5min":1.98,"15min":1.3440000000000001},"min":{"1min":0.376,"5min":0.32900000000000001,"15min":0.316},"max":{"1min":6.46,"5min":12.199,"15min":12.199},"last":1.8120000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:44:41 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":1.758,"15min":1.365},"min":{"1min":0.41299999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.8439999999999999,"5min":8.1699999999999999,"15min":10.638999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":1.758,"15min":1.242},"min":{"1min":0.47799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":3.085,"5min":8.1809999999999992,"15min":11.276},"last":0.59099999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738564,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2393916,"kb_used_data":2092596,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":91351236,"statfs":{"total":95995035648,"available":93543665664,"internally_reserved":0,"allocated":2142818304,"data_stored":2142171297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:45:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.83599999999999997,"15min":0.94999999999999996},"min":{"1min":0.19,"5min":0.182,"15min":0.17499999999999999},"max":{"1min":4.2060000000000004,"5min":16.478000000000002,"15min":16.478000000000002},"last":0.183},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.96199999999999997,"15min":1.194},"min":{"1min":0.22,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":3.827,"5min":8.0229999999999997,"15min":13.422000000000001},"last":0.33700000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:44:37 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.77300000000000002,"15min":1.089},"min":{"1min":0.25600000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.55100000000000005,"5min":8.4559999999999995,"15min":13.638999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":1.1259999999999999,"15min":1.292},"min":{"1min":0.23300000000000001,"5min":0.224,"15min":0.19500000000000001},"max":{"1min":2.8010000000000002,"5min":13.134,"15min":13.134},"last":0.86799999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:44:53 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":1.202,"15min":1.3899999999999999},"min":{"1min":0.22700000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":3.419,"5min":13.292999999999999,"15min":14.507999999999999},"last":0.373},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.87,"15min":1.333},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.6539999999999999,"5min":8.4169999999999998,"15min":18.759},"last":0.27500000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":1.764,"15min":1.2989999999999999},"min":{"1min":0.36899999999999999,"5min":0.32400000000000001,"15min":0.28299999999999997},"max":{"1min":3.5129999999999999,"5min":13.278,"15min":13.278},"last":0.88},{"interface":"front","average":{"1min":0.88600000000000001,"5min":1.4430000000000001,"15min":1.1559999999999999},"min":{"1min":0.371,"5min":0.33200000000000002,"15min":0.255},"max":{"1min":3.504,"5min":8.4789999999999992,"15min":8.9450000000000003},"last":0.89500000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:44:53 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":1.8759999999999999,"15min":1.5569999999999999},"min":{"1min":0.28799999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":2.0070000000000001,"5min":10.852,"15min":42.799999999999997},"last":6.9260000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":2.024,"15min":1.556},"min":{"1min":0.36099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.1499999999999999,"5min":13.237,"15min":42.695},"last":6.9130000000000003}]},{"osd":6,"last update":"Mon Feb 19 21:45:08 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.3400000000000001,"15min":1.2769999999999999},"min":{"1min":0.35099999999999998,"5min":0.30599999999999999,"15min":0.27900000000000003},"max":{"1min":4.2910000000000004,"5min":8.5009999999999994,"15min":42.777000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.94699999999999995,"5min":2.0630000000000002,"15min":1.516},"min":{"1min":0.312,"5min":0.29799999999999999,"15min":0.28599999999999998},"max":{"1min":3.9100000000000001,"5min":13.289999999999999,"15min":13.289999999999999},"last":0.70499999999999996}]},{"osd":7,"last update":"Mon Feb 19 21:44:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":1.7250000000000001,"15min":1.3879999999999999},"min":{"1min":0.378,"5min":0.37,"15min":0.31},"max":{"1min":1.353,"5min":13.26,"15min":42.758000000000003},"last":1.8919999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":1.45,"15min":1.331},"min":{"1min":0.40899999999999997,"5min":0.371,"15min":0.33200000000000002},"max":{"1min":2.9630000000000001,"5min":8.5340000000000007,"15min":42.718000000000004},"last":1.802}]}]},{"osd":2,"up_from":0,"seq":77309411513,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":26,"seq":111669149876,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":903684,"kb_used_data":594172,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":92841468,"statfs":{"total":95995035648,"available":95069663232,"internally_reserved":0,"allocated":608432128,"data_stored":607840022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:45:00 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.1479999999999999,"15min":1.1830000000000001},"min":{"1min":0.254,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":6.1130000000000004,"5min":8.8529999999999998,"15min":17.992000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":1.0760000000000001,"15min":1.524},"min":{"1min":0.20499999999999999,"5min":0.191,"15min":0.191},"max":{"1min":6.149,"5min":9.1120000000000001,"15min":46.654000000000003},"last":0.85399999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:45:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.93100000000000005,"15min":0.97299999999999998},"min":{"1min":0.23300000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":5.2530000000000001,"5min":6.444,"15min":9.9700000000000006},"last":0.21099999999999999},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1579999999999999,"15min":1.262},"min":{"1min":0.28599999999999998,"5min":0.20799999999999999,"15min":0.185},"max":{"1min":5.3860000000000001,"5min":6.3460000000000001,"15min":13.135999999999999},"last":0.46899999999999997}]},{"osd":2,"last update":"Mon Feb 19 21:45:00 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":1.071,"15min":1.194},"min":{"1min":0.27700000000000002,"5min":0.22900000000000001,"15min":0.224},"max":{"1min":2.0739999999999998,"5min":6.8879999999999999,"15min":11.175000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":1.048,"15min":1.4419999999999999},"min":{"1min":0.26400000000000001,"5min":0.23499999999999999,"15min":0.21299999999999999},"max":{"1min":5.6900000000000004,"5min":12.723000000000001,"15min":45.831000000000003},"last":0.442}]},{"osd":4,"last update":"Mon Feb 19 21:44:26 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":1.212,"15min":1.028},"min":{"1min":0.40400000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":4.7190000000000003,"5min":7.1660000000000004,"15min":7.1660000000000004},"last":4.1600000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":1.6870000000000001,"15min":1.321},"min":{"1min":0.41399999999999998,"5min":0.28699999999999998,"15min":0.26800000000000002},"max":{"1min":1.8720000000000001,"5min":9.6720000000000006,"15min":11.093},"last":0.61299999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:44:45 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":1.669,"15min":1.1619999999999999},"min":{"1min":0.40100000000000002,"5min":0.29099999999999998,"15min":0.27100000000000002},"max":{"1min":1.675,"5min":12.257,"15min":12.257},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":1.835,"15min":1.393},"min":{"1min":0.44400000000000001,"5min":0.313,"15min":0.27800000000000002},"max":{"1min":1.389,"5min":8.5809999999999995,"15min":11.128},"last":4.8120000000000003}]},{"osd":6,"last update":"Mon Feb 19 21:45:10 2024","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.5620000000000001,"15min":1.1919999999999999},"min":{"1min":0.436,"5min":0.309,"15min":0.30599999999999999},"max":{"1min":7.5419999999999998,"5min":7.5419999999999998,"15min":17.443999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.7090000000000001,"15min":1.3999999999999999},"min":{"1min":0.437,"5min":0.32900000000000001,"15min":0.32300000000000001},"max":{"1min":3.8100000000000001,"5min":13.942,"15min":18.219000000000001},"last":1.421}]},{"osd":7,"last update":"Mon Feb 19 21:44:35 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.7110000000000001,"15min":1.5740000000000001},"min":{"1min":0.38900000000000001,"5min":0.33200000000000002,"15min":0.318},"max":{"1min":5.1740000000000004,"5min":9.0259999999999998,"15min":45.777999999999999},"last":1.78},{"interface":"front","average":{"1min":0.69199999999999995,"5min":1.272,"15min":1.081},"min":{"1min":0.42399999999999999,"5min":0.35399999999999998,"15min":0.35099999999999998},"max":{"1min":1.4450000000000001,"5min":6.585,"15min":6.585},"last":0.59299999999999997}]}]},{"osd":4,"up_from":32,"seq":137438953645,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2068844,"kb_used_data":1767524,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":91676308,"statfs":{"total":95995035648,"available":93876539392,"internally_reserved":0,"allocated":1809944576,"data_stored":1809312364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":1.5609999999999999,"15min":1.3260000000000001},"min":{"1min":0.33000000000000002,"5min":0.219,"15min":0.219},"max":{"1min":6.7199999999999998,"5min":11.541,"15min":40.664000000000001},"last":1.361},{"interface":"front","average":{"1min":0.93000000000000005,"5min":1.532,"15min":1.409},"min":{"1min":0.372,"5min":0.23799999999999999,"15min":0.22600000000000001},"max":{"1min":7.5270000000000001,"5min":9.2799999999999994,"15min":41.046999999999997},"last":0.58899999999999997}]},{"osd":1,"last update":"Mon Feb 19 21:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":1.7090000000000001,"15min":1.141},"min":{"1min":0.34699999999999998,"5min":0.22,"15min":0.22},"max":{"1min":2.1960000000000002,"5min":11.755000000000001,"15min":13.254},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.375,"15min":1.071},"min":{"1min":0.35499999999999998,"5min":0.25,"15min":0.25},"max":{"1min":7.6970000000000001,"5min":7.6970000000000001,"15min":15.411},"last":0.51900000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.6579999999999999,"15min":1.1899999999999999},"min":{"1min":0.307,"5min":0.30299999999999999,"15min":0.27100000000000002},"max":{"1min":7.6399999999999997,"5min":7.6459999999999999,"15min":16.788},"last":1.629},{"interface":"front","average":{"1min":0.68300000000000005,"5min":1.6040000000000001,"15min":1.3899999999999999},"min":{"1min":0.36199999999999999,"5min":0.318,"15min":0.27300000000000002},"max":{"1min":3.302,"5min":10.603999999999999,"15min":20.995999999999999},"last":0.32900000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":1.6870000000000001,"15min":1.2909999999999999},"min":{"1min":0.35799999999999998,"5min":0.32800000000000001,"15min":0.316},"max":{"1min":3.9100000000000001,"5min":10.970000000000001,"15min":15.914999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":1.764,"15min":1.244},"min":{"1min":0.30299999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.407,"5min":11.662000000000001,"15min":13.321},"last":0.40999999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:45:09 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":1.9530000000000001,"15min":1.079},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":2.9039999999999999,"5min":18.916,"15min":18.916},"last":6.5970000000000004},{"interface":"front","average":{"1min":0.753,"5min":2.625,"15min":1.3},"min":{"1min":0.317,"5min":0.253,"15min":0.253},"max":{"1min":2.2490000000000001,"5min":14.840999999999999,"15min":14.840999999999999},"last":6.5640000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":1.7629999999999999,"15min":1.083},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":7.048,"5min":10.622999999999999,"15min":13.27},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.85699999999999998,"5min":2.0129999999999999,"15min":1.0860000000000001},"min":{"1min":0.28799999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":7.6180000000000003,"5min":14.127000000000001,"15min":14.127000000000001},"last":0.60999999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:44:45 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":2.0579999999999998,"15min":1.105},"min":{"1min":0.30599999999999999,"5min":0.30399999999999999,"15min":0.28899999999999998},"max":{"1min":3.0600000000000001,"5min":14.093,"15min":14.093},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":2.1179999999999999,"15min":1.2230000000000001},"min":{"1min":0.33600000000000002,"5min":0.33500000000000002,"15min":0.32900000000000001},"max":{"1min":1.363,"5min":12.808999999999999,"15min":12.808999999999999},"last":0.78500000000000003}]}]},{"osd":5,"up_from":38,"seq":163208757417,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3299840,"kb_used_data":2998520,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":90445312,"statfs":{"total":95995035648,"available":92615999488,"internally_reserved":0,"allocated":3070484480,"data_stored":3069832847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:44:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":1.7529999999999999,"15min":1.3200000000000001},"min":{"1min":0.218,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":3.7879999999999998,"5min":15.048,"15min":20.550999999999998},"last":7.0529999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":2.0339999999999998,"15min":1.375},"min":{"1min":0.313,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":5.6900000000000004,"5min":9.9390000000000001,"15min":20.879000000000001},"last":0.54700000000000004}]},{"osd":1,"last update":"Mon Feb 19 21:44:55 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":2.1139999999999999,"15min":1.2929999999999999},"min":{"1min":0.25600000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.819,"5min":10.42,"15min":10.42},"last":0.501},{"interface":"front","average":{"1min":0.753,"5min":1.3220000000000001,"15min":1.1579999999999999},"min":{"1min":0.29599999999999999,"5min":0.247,"15min":0.247},"max":{"1min":2.5819999999999999,"5min":10.021000000000001,"15min":10.316000000000001},"last":0.48699999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:44:55 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":1.7909999999999999,"15min":1.373},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.25700000000000001},"max":{"1min":3.8260000000000001,"5min":15.015000000000001,"15min":20.186},"last":6.9580000000000002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":1.8580000000000001,"15min":1.385},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.23200000000000001},"max":{"1min":3.3199999999999998,"5min":9.4909999999999997,"15min":20.175000000000001},"last":0.52700000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:44:55 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":2.069,"15min":1.53},"min":{"1min":0.29699999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":3.8570000000000002,"5min":12.021000000000001,"15min":20.146999999999998},"last":6.9950000000000001},{"interface":"front","average":{"1min":0.85899999999999999,"5min":2.2869999999999999,"15min":1.673},"min":{"1min":0.35099999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":3.3639999999999999,"5min":9.5150000000000006,"15min":20.120000000000001},"last":0.47699999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:44:55 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":1.681,"15min":0.92700000000000005},"min":{"1min":0.27100000000000002,"5min":0.252,"15min":0.23999999999999999},"max":{"1min":4.1779999999999999,"5min":21.577000000000002,"15min":21.577000000000002},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":2.5,"15min":1.254},"min":{"1min":0.32200000000000001,"5min":0.28799999999999998,"15min":0.25600000000000001},"max":{"1min":3.75,"5min":15.071999999999999,"15min":15.071999999999999},"last":9.2859999999999996}]},{"osd":6,"last update":"Mon Feb 19 21:44:20 2024","interfaces":[{"interface":"back","average":{"1min":2.21,"5min":2.2650000000000001,"15min":1.173},"min":{"1min":0.313,"5min":0.27000000000000002,"15min":0.221},"max":{"1min":10.157,"5min":13.138999999999999,"15min":13.138999999999999},"last":7.024},{"interface":"front","average":{"1min":1.71,"5min":2.1970000000000001,"15min":1.262},"min":{"1min":0.35299999999999998,"5min":0.28999999999999998,"15min":0.23599999999999999},"max":{"1min":8.5589999999999993,"5min":13.532999999999999,"15min":13.532999999999999},"last":2.2429999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:44:44 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":2.5470000000000002,"15min":1.385},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.29999999999999999},"max":{"1min":1.6899999999999999,"5min":12.962,"15min":12.962},"last":2.4620000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":2.1190000000000002,"15min":1.2190000000000001},"min":{"1min":0.36799999999999999,"5min":0.311,"15min":0.29099999999999998},"max":{"1min":2.2240000000000002,"5min":13.116,"15min":17.759},"last":0.51200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":2118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2145976320,"data_stored":2145976320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3378577408,"data_stored":3378577408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":613351424,"data_stored":613351424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1835597824,"data_stored":1835597824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3081764864,"data_stored":3081764864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2458648576,"data_stored":2458648576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1211170816,"data_stored":1211170816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:45:21.875 INFO:tasks.thrashosds.thrasher:Setting 9.0 to [7, 2, 6] 2024-02-19T21:45:21.875 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '9.0', '7', '2', '6'] 2024-02-19T21:45:21.876 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pg-upmap 9.0 7 2 6 2024-02-19T21:45:22.076 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 50 16 83454 83438 104.288 77.6875 0.0073612 0.00958496 2024-02-19T21:45:22.278 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-02-19T21:45:22.563 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:20.554261+0000 osd.1 (osd.1) 195 : cluster [DBG] 4.9 scrub starts 2024-02-19T21:45:22.563 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:20.561858+0000 osd.1 (osd.1) 196 : cluster [DBG] 4.9 scrub ok 2024-02-19T21:45:22.563 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:21.070931+0000 mgr.y (mgr.14514) 493 : cluster [DBG] pgmap v617: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 4.9 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 936 B/s rd, 79 MiB/s wr, 1.26k op/s; 2/243708 objects misplaced (0.001%) 2024-02-19T21:45:22.563 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:21.608208+0000 osd.7 (osd.7) 196 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:45:22.563 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:21.608264+0000 osd.7 (osd.7) 197 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:45:22.563 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:21.707462+0000 mon.a (mon.0) 1354 : audit [INF] from='client.? 172.21.15.80:0/612398623' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:45:22.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:20.554261+0000 osd.1 (osd.1) 195 : cluster [DBG] 4.9 scrub starts 2024-02-19T21:45:22.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:20.561858+0000 osd.1 (osd.1) 196 : cluster [DBG] 4.9 scrub ok 2024-02-19T21:45:22.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:21.070931+0000 mgr.y (mgr.14514) 493 : cluster [DBG] pgmap v617: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 4.9 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 936 B/s rd, 79 MiB/s wr, 1.26k op/s; 2/243708 objects misplaced (0.001%) 2024-02-19T21:45:22.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:21.608208+0000 osd.7 (osd.7) 196 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:45:22.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:21.608264+0000 osd.7 (osd.7) 197 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:45:22.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:21.707462+0000 mon.a (mon.0) 1354 : audit [INF] from='client.? 172.21.15.80:0/612398623' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:45:22.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:20.554261+0000 osd.1 (osd.1) 195 : cluster [DBG] 4.9 scrub starts 2024-02-19T21:45:22.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:20.561858+0000 osd.1 (osd.1) 196 : cluster [DBG] 4.9 scrub ok 2024-02-19T21:45:22.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:21.070931+0000 mgr.y (mgr.14514) 493 : cluster [DBG] pgmap v617: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 4.9 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 936 B/s rd, 79 MiB/s wr, 1.26k op/s; 2/243708 objects misplaced (0.001%) 2024-02-19T21:45:22.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:21.608208+0000 osd.7 (osd.7) 196 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:45:22.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:21.608264+0000 osd.7 (osd.7) 197 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:45:22.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:21.707462+0000 mon.a (mon.0) 1354 : audit [INF] from='client.? 172.21.15.80:0/612398623' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:45:22.773 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.2 dump_ops_in_flight 2024-02-19T21:45:22.957 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:45:22.992 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:45:22.997 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:22.997 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:45:23.077 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 51 16 84573 84557 103.613 69.9375 0.0147295 0.0096467 2024-02-19T21:45:23.098 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:45:23.141 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:23.345 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:45:23.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:22.162812+0000 osd.0 (osd.0) 212 : cluster [DBG] 6.0 scrub starts 2024-02-19T21:45:23.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:22.180583+0000 osd.0 (osd.0) 213 : cluster [DBG] 6.0 scrub ok 2024-02-19T21:45:23.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:22.231470+0000 mon.a (mon.0) 1355 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:45:23.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:22.261614+0000 mon.a (mon.0) 1356 : audit [INF] from='client.? 172.21.15.80:0/612398623' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:45:23.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:22.261672+0000 mon.a (mon.0) 1357 : cluster [DBG] osdmap e311: 8 total, 8 up, 7 in 2024-02-19T21:45:23.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:22.162812+0000 osd.0 (osd.0) 212 : cluster [DBG] 6.0 scrub starts 2024-02-19T21:45:23.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:22.180583+0000 osd.0 (osd.0) 213 : cluster [DBG] 6.0 scrub ok 2024-02-19T21:45:23.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:22.231470+0000 mon.a (mon.0) 1355 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:45:23.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:22.261614+0000 mon.a (mon.0) 1356 : audit [INF] from='client.? 172.21.15.80:0/612398623' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:45:23.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:22.261672+0000 mon.a (mon.0) 1357 : cluster [DBG] osdmap e311: 8 total, 8 up, 7 in 2024-02-19T21:45:23.350 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:23.350 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:45:23.451 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:45:23.499 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:22.162812+0000 osd.0 (osd.0) 212 : cluster [DBG] 6.0 scrub starts 2024-02-19T21:45:23.500 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:22.180583+0000 osd.0 (osd.0) 213 : cluster [DBG] 6.0 scrub ok 2024-02-19T21:45:23.500 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:22.231470+0000 mon.a (mon.0) 1355 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:45:23.500 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:22.261614+0000 mon.a (mon.0) 1356 : audit [INF] from='client.? 172.21.15.80:0/612398623' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:45:23.500 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:22.261672+0000 mon.a (mon.0) 1357 : cluster [DBG] osdmap e311: 8 total, 8 up, 7 in 2024-02-19T21:45:23.500 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:23.539 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:45:23.543 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:23.544 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:45:23.645 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:45:23.703 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:23.743 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:45:23.748 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:23.749 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:45:23.849 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:45:23.897 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:24.077 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 52 16 85790 85774 103.083 76.0625 0.0123954 0.00969689 2024-02-19T21:45:24.105 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:45:24.105 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:45:24.110 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:24.110 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:45:24.211 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:45:24.259 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:24.295 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:45:24.298 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:24.299 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:45:24.400 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:45:24.411 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:23.071378+0000 mgr.y (mgr.14514) 494 : cluster [DBG] pgmap v619: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 4.9 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1023 B/s rd, 76 MiB/s wr, 1.22k op/s; 2/243708 objects misplaced (0.001%) 2024-02-19T21:45:24.411 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:23.071378+0000 mgr.y (mgr.14514) 494 : cluster [DBG] pgmap v619: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 4.9 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1023 B/s rd, 76 MiB/s wr, 1.22k op/s; 2/243708 objects misplaced (0.001%) 2024-02-19T21:45:24.458 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:24.515 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:45:24.522 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:24.522 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:45:24.561 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:23.071378+0000 mgr.y (mgr.14514) 494 : cluster [DBG] pgmap v619: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 4.9 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1023 B/s rd, 76 MiB/s wr, 1.22k op/s; 2/243708 objects misplaced (0.001%) 2024-02-19T21:45:24.623 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:45:24.686 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:24.711 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:45:24.713 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:24.713 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:45:24.814 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:45:24.856 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:24.888 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:45:24.899 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:24.899 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:45:24.900 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:45:25.000 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:45:25.042 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:25.078 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 53 16 86927 86911 102.476 71.0625 0.00854415 0.00975445 2024-02-19T21:45:25.088 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:45:25.091 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:25.092 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:45:25.193 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:45:25.219 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:25.249 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:45:25.254 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:25.255 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:45:25.355 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:45:25.402 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:25.436 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:45:25.442 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:25.443 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:45:25.544 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:45:25.584 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:25.644 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:45:25.647 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:25.647 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:45:25.694 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-19T21:45:25.749 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:45:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:25.960 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:45:25.962 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:25.963 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:45:26.057 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:45:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:45:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:45:26.063 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:45:26.078 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 54 16 88028 88012 101.853 68.8125 0.0146268 0.00981269 2024-02-19T21:45:26.101 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:26.144 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:45:26.148 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:26.148 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:45:26.235 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:45:26.249 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:45:26.271 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:45:26.285 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:25.072004+0000 mgr.y (mgr.14514) 495 : cluster [DBG] pgmap v620: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 5.1 GiB data, 17 GiB used, 608 GiB / 626 GiB avail; 1023 B/s rd, 78 MiB/s wr, 1.25k op/s; 2/251637 objects misplaced (0.001%) 2024-02-19T21:45:26.285 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:25.140957+0000 mon.a (mon.0) 1358 : cluster [DBG] osdmap e312: 8 total, 8 up, 7 in 2024-02-19T21:45:26.286 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:25.072004+0000 mgr.y (mgr.14514) 495 : cluster [DBG] pgmap v620: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 5.1 GiB data, 17 GiB used, 608 GiB / 626 GiB avail; 1023 B/s rd, 78 MiB/s wr, 1.25k op/s; 2/251637 objects misplaced (0.001%) 2024-02-19T21:45:26.286 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:25.140957+0000 mon.a (mon.0) 1358 : cluster [DBG] osdmap e312: 8 total, 8 up, 7 in 2024-02-19T21:45:26.297 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:26.301 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:45:26.336 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:45:26.362 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:45:26.401 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:45:26.428 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:45:26.463 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:45:26.475 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:45:26.475 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:45:26.475 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:45:26.475 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:45:26.475 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:45:26.475 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:45:26.475 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:45:26.475 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:45:26.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:25.072004+0000 mgr.y (mgr.14514) 495 : cluster [DBG] pgmap v620: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 5.1 GiB data, 17 GiB used, 608 GiB / 626 GiB avail; 1023 B/s rd, 78 MiB/s wr, 1.25k op/s; 2/251637 objects misplaced (0.001%) 2024-02-19T21:45:26.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:25.140957+0000 mon.a (mon.0) 1358 : cluster [DBG] osdmap e312: 8 total, 8 up, 7 in 2024-02-19T21:45:27.079 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 55 16 89175 89159 101.304 71.6875 0.00855704 0.00986741 2024-02-19T21:45:27.425 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:26.208799+0000 mon.c (mon.2) 68 : audit [DBG] from='client.? 172.21.15.80:0/1942487461' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:45:27.425 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:26.208799+0000 mon.c (mon.2) 68 : audit [DBG] from='client.? 172.21.15.80:0/1942487461' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:45:27.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:26.208799+0000 mon.c (mon.2) 68 : audit [DBG] from='client.? 172.21.15.80:0/1942487461' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:45:27.873 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:45:27.882 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:27.883 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:45:27.983 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:45:28.037 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:28.067 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:45:28.072 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:28.072 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:45:28.079 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 56 16 90410 90394 100.873 77.1875 0.0131064 0.00990911 2024-02-19T21:45:28.173 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:45:28.226 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:28.263 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:45:28.267 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:28.268 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:45:28.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:27.073619+0000 mgr.y (mgr.14514) 496 : cluster [DBG] pgmap v622: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 5.3 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1.2 KiB/s rd, 94 MiB/s wr, 1.50k op/s; 2/261399 objects misplaced (0.001%) 2024-02-19T21:45:28.369 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:45:28.406 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:28.445 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:45:28.447 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:27.073619+0000 mgr.y (mgr.14514) 496 : cluster [DBG] pgmap v622: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 5.3 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1.2 KiB/s rd, 94 MiB/s wr, 1.50k op/s; 2/261399 objects misplaced (0.001%) 2024-02-19T21:45:28.447 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:27.073619+0000 mgr.y (mgr.14514) 496 : cluster [DBG] pgmap v622: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 5.3 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1.2 KiB/s rd, 94 MiB/s wr, 1.50k op/s; 2/261399 objects misplaced (0.001%) 2024-02-19T21:45:28.453 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:28.453 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:45:28.554 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:45:28.597 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:29.079 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 57 16 91619 91603 100.429 75.5625 0.0150678 0.00995344 2024-02-19T21:45:29.732 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:45:29.760 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:45:29.763 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:29.764 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:45:29.789 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:45:29.789 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:45:29.865 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:45:29.867 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:45:29.921 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:30.084 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 58 16 92761 92745 99.9236 71.375 0.00806157 0.0100035 2024-02-19T21:45:30.184 INFO:teuthology.orchestra.run.smithi080.stderr:set 9.0 pg_upmap mapping to [7,2,6] 2024-02-19T21:45:30.188 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:45:30.191 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:30.192 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:45:30.293 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:45:30.347 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:30.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:29.074615+0000 mgr.y (mgr.14514) 497 : cluster [DBG] pgmap v623: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 5.3 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 639 B/s rd, 46 MiB/s wr, 737 op/s; 2/261399 objects misplaced (0.001%) 2024-02-19T21:45:30.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:29.752152+0000 mon.c (mon.2) 69 : audit [INF] from='client.? 172.21.15.80:0/206495183' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "9.0", "id": [7, 2, 6]}]: dispatch 2024-02-19T21:45:30.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:29.752819+0000 mon.a (mon.0) 1359 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "9.0", "id": [7, 2, 6]}]: dispatch 2024-02-19T21:45:30.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:29.074615+0000 mgr.y (mgr.14514) 497 : cluster [DBG] pgmap v623: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 5.3 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 639 B/s rd, 46 MiB/s wr, 737 op/s; 2/261399 objects misplaced (0.001%) 2024-02-19T21:45:30.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:29.752152+0000 mon.c (mon.2) 69 : audit [INF] from='client.? 172.21.15.80:0/206495183' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "9.0", "id": [7, 2, 6]}]: dispatch 2024-02-19T21:45:30.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:29.752819+0000 mon.a (mon.0) 1359 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "9.0", "id": [7, 2, 6]}]: dispatch 2024-02-19T21:45:30.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:29.074615+0000 mgr.y (mgr.14514) 497 : cluster [DBG] pgmap v623: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 5.3 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 639 B/s rd, 46 MiB/s wr, 737 op/s; 2/261399 objects misplaced (0.001%) 2024-02-19T21:45:30.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:29.752152+0000 mon.c (mon.2) 69 : audit [INF] from='client.? 172.21.15.80:0/206495183' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "9.0", "id": [7, 2, 6]}]: dispatch 2024-02-19T21:45:30.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:29.752819+0000 mon.a (mon.0) 1359 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "9.0", "id": [7, 2, 6]}]: dispatch 2024-02-19T21:45:30.609 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:45:30.614 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:30.615 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:45:30.715 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:45:30.773 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:30.801 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:45:30.809 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:30.809 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:45:30.911 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:45:30.953 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:45:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:45:30] "GET /metrics HTTP/1.1" 200 176118 "" "Prometheus/2.33.4" 2024-02-19T21:45:30.965 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:31.056 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:45:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:45:31.081 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 59 16 93943 93927 99.482 73.875 0.00580795 0.0100478 2024-02-19T21:45:31.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:30.166693+0000 mon.a (mon.0) 1360 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pg-upmap", "pgid": "9.0", "id": [7, 2, 6]}]': finished 2024-02-19T21:45:31.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:30.166761+0000 mon.a (mon.0) 1361 : cluster [DBG] osdmap e313: 8 total, 8 up, 7 in 2024-02-19T21:45:31.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:30.589676+0000 mgr.y (mgr.14514) 498 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:45:31.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:30.166693+0000 mon.a (mon.0) 1360 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pg-upmap", "pgid": "9.0", "id": [7, 2, 6]}]': finished 2024-02-19T21:45:31.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:30.166761+0000 mon.a (mon.0) 1361 : cluster [DBG] osdmap e313: 8 total, 8 up, 7 in 2024-02-19T21:45:31.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:30.589676+0000 mgr.y (mgr.14514) 498 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:45:31.523 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:45:31.525 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:31.526 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:45:31.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:30.166693+0000 mon.a (mon.0) 1360 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pg-upmap", "pgid": "9.0", "id": [7, 2, 6]}]': finished 2024-02-19T21:45:31.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:30.166761+0000 mon.a (mon.0) 1361 : cluster [DBG] osdmap e313: 8 total, 8 up, 7 in 2024-02-19T21:45:31.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:30.589676+0000 mgr.y (mgr.14514) 498 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:45:31.626 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:45:31.675 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:32.082 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:2024-02-19T21:45:32.083105+0000 min lat: 0.00124015 max lat: 0.0961392 avg lat: 0.0100839 2024-02-19T21:45:32.082 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-19T21:45:32.082 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 60 16 95196 95180 99.1291 78.3125 0.0103579 0.0100839 2024-02-19T21:45:32.226 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.2 dump_blocked_ops 2024-02-19T21:45:32.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:31.075166+0000 mgr.y (mgr.14514) 499 : cluster [DBG] pgmap v625: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 5.7 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 1.2 KiB/s rd, 92 MiB/s wr, 1.47k op/s; 2/278922 objects misplaced (0.001%) 2024-02-19T21:45:32.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:31.579397+0000 osd.2 (osd.2) 123 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:45:32.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:31.579453+0000 osd.2 (osd.2) 124 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:45:32.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:31.075166+0000 mgr.y (mgr.14514) 499 : cluster [DBG] pgmap v625: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 5.7 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 1.2 KiB/s rd, 92 MiB/s wr, 1.47k op/s; 2/278922 objects misplaced (0.001%) 2024-02-19T21:45:32.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:31.579397+0000 osd.2 (osd.2) 123 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:45:32.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:31.579453+0000 osd.2 (osd.2) 124 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:45:32.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:31.075166+0000 mgr.y (mgr.14514) 499 : cluster [DBG] pgmap v625: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 5.7 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 1.2 KiB/s rd, 92 MiB/s wr, 1.47k op/s; 2/278922 objects misplaced (0.001%) 2024-02-19T21:45:32.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:31.579397+0000 osd.2 (osd.2) 123 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:45:32.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:31.579453+0000 osd.2 (osd.2) 124 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:45:33.083 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 61 16 96162 96146 98.4925 60.375 0.0110095 0.0101485 2024-02-19T21:45:33.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:32.219409+0000 mon.a (mon.0) 1362 : cluster [DBG] osdmap e314: 8 total, 8 up, 7 in 2024-02-19T21:45:33.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:32.219409+0000 mon.a (mon.0) 1362 : cluster [DBG] osdmap e314: 8 total, 8 up, 7 in 2024-02-19T21:45:33.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:32.219409+0000 mon.a (mon.0) 1362 : cluster [DBG] osdmap e314: 8 total, 8 up, 7 in 2024-02-19T21:45:34.083 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 62 16 97340 97324 98.0914 73.625 0.0149267 0.0101906 2024-02-19T21:45:34.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:33.075509+0000 mgr.y (mgr.14514) 500 : cluster [DBG] pgmap v627: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 5.7 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 645 B/s rd, 57 MiB/s wr, 917 op/s; 2/278922 objects misplaced (0.001%) 2024-02-19T21:45:34.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:33.205550+0000 osd.4 (osd.4) 156 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:45:34.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:33.205614+0000 osd.4 (osd.4) 157 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:45:34.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:33.233346+0000 mon.a (mon.0) 1363 : cluster [DBG] osdmap e315: 8 total, 8 up, 7 in 2024-02-19T21:45:34.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:33.969005+0000 mon.a (mon.0) 1364 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:45:34.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:33.075509+0000 mgr.y (mgr.14514) 500 : cluster [DBG] pgmap v627: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 5.7 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 645 B/s rd, 57 MiB/s wr, 917 op/s; 2/278922 objects misplaced (0.001%) 2024-02-19T21:45:34.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:33.205550+0000 osd.4 (osd.4) 156 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:45:34.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:33.205614+0000 osd.4 (osd.4) 157 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:45:34.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:33.233346+0000 mon.a (mon.0) 1363 : cluster [DBG] osdmap e315: 8 total, 8 up, 7 in 2024-02-19T21:45:34.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:33.969005+0000 mon.a (mon.0) 1364 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:45:34.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:33.075509+0000 mgr.y (mgr.14514) 500 : cluster [DBG] pgmap v627: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 5.7 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 645 B/s rd, 57 MiB/s wr, 917 op/s; 2/278922 objects misplaced (0.001%) 2024-02-19T21:45:34.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:33.205550+0000 osd.4 (osd.4) 156 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:45:34.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:33.205614+0000 osd.4 (osd.4) 157 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:45:34.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:33.233346+0000 mon.a (mon.0) 1363 : cluster [DBG] osdmap e315: 8 total, 8 up, 7 in 2024-02-19T21:45:34.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:33.969005+0000 mon.a (mon.0) 1364 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:45:35.084 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 63 16 98544 98528 97.7263 75.25 0.0111905 0.0102282 2024-02-19T21:45:35.584 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:45:35.587 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:35.588 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:45:35.642 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:45:35.690 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:45:35.729 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:35.768 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:45:35.832 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:35.832 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:45:35.833 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:45:35.933 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:45:35.961 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:36.058 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:45:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:45:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:45:36.084 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 64 16 99594 99578 97.2247 65.625 0.00906936 0.0102813 2024-02-19T21:45:36.510 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 6, 7] out_osds: [2] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:45:36.510 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:45:36.510 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-02-19T21:45:36.510 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-02-19T21:45:36.510 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-02-19T21:45:36.511 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.5 config set filestore_inject_stall 3 2024-02-19T21:45:36.549 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:35.076185+0000 mgr.y (mgr.14514) 501 : cluster [DBG] pgmap v629: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 5.8 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 853 B/s rd, 87 MiB/s wr, 1.39k op/s; 2/286362 objects misplaced (0.001%) 2024-02-19T21:45:36.549 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:35.139924+0000 mon.a (mon.0) 1365 : cluster [DBG] osdmap e316: 8 total, 8 up, 7 in 2024-02-19T21:45:36.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:35.076185+0000 mgr.y (mgr.14514) 501 : cluster [DBG] pgmap v629: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 5.8 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 853 B/s rd, 87 MiB/s wr, 1.39k op/s; 2/286362 objects misplaced (0.001%) 2024-02-19T21:45:36.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:35.139924+0000 mon.a (mon.0) 1365 : cluster [DBG] osdmap e316: 8 total, 8 up, 7 in 2024-02-19T21:45:36.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:35.076185+0000 mgr.y (mgr.14514) 501 : cluster [DBG] pgmap v629: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 5.8 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 853 B/s rd, 87 MiB/s wr, 1.39k op/s; 2/286362 objects misplaced (0.001%) 2024-02-19T21:45:36.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:35.139924+0000 mon.a (mon.0) 1365 : cluster [DBG] osdmap e316: 8 total, 8 up, 7 in 2024-02-19T21:45:36.948 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:45:37.084 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 65 16 100676 100660 96.7693 67.625 0.0181288 0.0103295 2024-02-19T21:45:38.086 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 66 16 101800 101784 96.365 70.25 0.0142375 0.0103729 2024-02-19T21:45:38.174 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:45:38.216 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:38.217 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:45:38.318 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:45:38.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:37.076713+0000 mgr.y (mgr.14514) 502 : cluster [DBG] pgmap v631: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 6.0 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 853 B/s rd, 60 MiB/s wr, 961 op/s; 2/296226 objects misplaced (0.001%) 2024-02-19T21:45:38.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:37.623818+0000 osd.3 (osd.3) 200 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:45:38.350 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:37.623874+0000 osd.3 (osd.3) 201 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:45:38.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:37.076713+0000 mgr.y (mgr.14514) 502 : cluster [DBG] pgmap v631: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 6.0 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 853 B/s rd, 60 MiB/s wr, 961 op/s; 2/296226 objects misplaced (0.001%) 2024-02-19T21:45:38.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:37.623818+0000 osd.3 (osd.3) 200 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:45:38.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:37.623874+0000 osd.3 (osd.3) 201 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:45:38.365 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:38.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:37.076713+0000 mgr.y (mgr.14514) 502 : cluster [DBG] pgmap v631: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 6.0 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 853 B/s rd, 60 MiB/s wr, 961 op/s; 2/296226 objects misplaced (0.001%) 2024-02-19T21:45:38.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:37.623818+0000 osd.3 (osd.3) 200 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:45:38.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:37.623874+0000 osd.3 (osd.3) 201 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:45:39.086 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 67 16 102824 102808 95.882 64 0.013636 0.0104242 2024-02-19T21:45:39.171 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:38.157259+0000 mon.a (mon.0) 1366 : cluster [DBG] osdmap e317: 8 total, 8 up, 7 in 2024-02-19T21:45:39.171 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:38.568461+0000 mon.a (mon.0) 1367 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:45:39.171 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:38.821980+0000 mon.b (mon.1) 53 : audit [INF] from='client.? 172.21.15.80:0/3718162577' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:45:39.171 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:38.824180+0000 mon.a (mon.0) 1368 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:45:39.172 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:39.142800+0000 mon.a (mon.0) 1369 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:45:39.172 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:39.144066+0000 mon.a (mon.0) 1370 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:45:39.172 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:39.149702+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:45:39.192 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-02-19T21:45:39.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:38.157259+0000 mon.a (mon.0) 1366 : cluster [DBG] osdmap e317: 8 total, 8 up, 7 in 2024-02-19T21:45:39.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:38.568461+0000 mon.a (mon.0) 1367 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:45:39.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:38.821980+0000 mon.b (mon.1) 53 : audit [INF] from='client.? 172.21.15.80:0/3718162577' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:45:39.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:38.824180+0000 mon.a (mon.0) 1368 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:45:39.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:39.142800+0000 mon.a (mon.0) 1369 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:45:39.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:39.144066+0000 mon.a (mon.0) 1370 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:45:39.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:39.149702+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:45:39.396 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:45:39.396 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2024-02-19T21:45:39.396 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:45:39.570 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:38.157259+0000 mon.a (mon.0) 1366 : cluster [DBG] osdmap e317: 8 total, 8 up, 7 in 2024-02-19T21:45:39.570 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:38.568461+0000 mon.a (mon.0) 1367 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:45:39.570 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:38.821980+0000 mon.b (mon.1) 53 : audit [INF] from='client.? 172.21.15.80:0/3718162577' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:45:39.570 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:38.824180+0000 mon.a (mon.0) 1368 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:45:39.570 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:39.142800+0000 mon.a (mon.0) 1369 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:45:39.570 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:39.144066+0000 mon.a (mon.0) 1370 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:45:39.570 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:39.149702+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:45:40.086 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 68 16 103972 103956 95.527 71.75 0.0112763 0.0104641 2024-02-19T21:45:40.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:39.077133+0000 mgr.y (mgr.14514) 503 : cluster [DBG] pgmap v633: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 6.0 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 853 B/s rd, 60 MiB/s wr, 961 op/s; 2/296226 objects misplaced (0.001%) 2024-02-19T21:45:40.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:39.154984+0000 mon.a (mon.0) 1372 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:45:40.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:39.173816+0000 mon.a (mon.0) 1373 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:45:40.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:39.173856+0000 mon.a (mon.0) 1374 : cluster [DBG] osdmap e318: 8 total, 8 up, 7 in 2024-02-19T21:45:40.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:39.077133+0000 mgr.y (mgr.14514) 503 : cluster [DBG] pgmap v633: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 6.0 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 853 B/s rd, 60 MiB/s wr, 961 op/s; 2/296226 objects misplaced (0.001%) 2024-02-19T21:45:40.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:39.154984+0000 mon.a (mon.0) 1372 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:45:40.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:39.173816+0000 mon.a (mon.0) 1373 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:45:40.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:39.173856+0000 mon.a (mon.0) 1374 : cluster [DBG] osdmap e318: 8 total, 8 up, 7 in 2024-02-19T21:45:40.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:39.077133+0000 mgr.y (mgr.14514) 503 : cluster [DBG] pgmap v633: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 6.0 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 853 B/s rd, 60 MiB/s wr, 961 op/s; 2/296226 objects misplaced (0.001%) 2024-02-19T21:45:40.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:39.154984+0000 mon.a (mon.0) 1372 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:45:40.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:39.173816+0000 mon.a (mon.0) 1373 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:45:40.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:39.173856+0000 mon.a (mon.0) 1374 : cluster [DBG] osdmap e318: 8 total, 8 up, 7 in 2024-02-19T21:45:40.846 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:45:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:45:40] "GET /metrics HTTP/1.1" 200 176125 "" "Prometheus/2.33.4" 2024-02-19T21:45:41.059 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:45:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:45:41.090 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 69 16 105086 105070 95.1471 69.625 0.0162091 0.0105057 2024-02-19T21:45:41.236 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:45:41.237 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:45:41.242 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:41.242 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:45:41.272 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:45:41.305 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:45:41.333 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:45:41.343 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:45:41.367 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:45:41.393 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:45:41.402 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:41.420 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:45:41.447 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:45:41.449 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:41.450 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:45:41.474 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:45:41.476 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:45:41.476 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:45:41.476 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:45:41.476 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:45:41.476 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:45:41.476 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:45:41.476 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:45:41.476 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:45:41.504 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:39.646920+0000 osd.6 (osd.6) 179 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:45:41.505 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:39.646984+0000 osd.6 (osd.6) 180 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:45:41.505 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:40.230751+0000 mon.a (mon.0) 1375 : cluster [DBG] osdmap e319: 8 total, 8 up, 7 in 2024-02-19T21:45:41.505 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:40.601743+0000 mgr.y (mgr.14514) 504 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:45:41.505 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:41.201945+0000 mon.c (mon.2) 70 : audit [DBG] from='client.? 172.21.15.80:0/4244919952' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:45:41.505 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:39.646920+0000 osd.6 (osd.6) 179 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:45:41.505 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:39.646984+0000 osd.6 (osd.6) 180 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:45:41.505 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:40.230751+0000 mon.a (mon.0) 1375 : cluster [DBG] osdmap e319: 8 total, 8 up, 7 in 2024-02-19T21:45:41.505 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:40.601743+0000 mgr.y (mgr.14514) 504 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:45:41.505 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:41.201945+0000 mon.c (mon.2) 70 : audit [DBG] from='client.? 172.21.15.80:0/4244919952' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:45:41.551 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:45:41.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:39.646920+0000 osd.6 (osd.6) 179 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:45:41.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:39.646984+0000 osd.6 (osd.6) 180 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:45:41.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:40.230751+0000 mon.a (mon.0) 1375 : cluster [DBG] osdmap e319: 8 total, 8 up, 7 in 2024-02-19T21:45:41.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:40.601743+0000 mgr.y (mgr.14514) 504 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:45:41.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:41.201945+0000 mon.c (mon.2) 70 : audit [DBG] from='client.? 172.21.15.80:0/4244919952' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:45:41.599 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:41.637 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:45:41.645 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:41.645 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:45:41.746 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:45:41.797 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:41.886 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:45:41.891 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:41.892 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:45:41.993 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:45:42.049 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset noscrub 2024-02-19T21:45:42.056 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:42.083 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:45:42.087 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:42.088 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:45:42.090 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 70 16 106242 106226 94.8199 72.25 0.0176948 0.0105409 2024-02-19T21:45:42.188 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:45:42.257 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:42.296 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:45:42.306 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:42.306 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:45:42.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:41.077686+0000 mgr.y (mgr.14514) 505 : cluster [DBG] pgmap v636: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 6.3 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 862 B/s rd, 72 MiB/s wr, 1.15k op/s; 2/312492 objects misplaced (0.001%) 2024-02-19T21:45:42.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:41.396647+0000 osd.5 (osd.5) 215 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:45:42.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:41.396702+0000 osd.5 (osd.5) 216 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:45:42.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:41.077686+0000 mgr.y (mgr.14514) 505 : cluster [DBG] pgmap v636: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 6.3 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 862 B/s rd, 72 MiB/s wr, 1.15k op/s; 2/312492 objects misplaced (0.001%) 2024-02-19T21:45:42.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:41.396647+0000 osd.5 (osd.5) 215 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:45:42.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:41.396702+0000 osd.5 (osd.5) 216 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:45:42.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:41.077686+0000 mgr.y (mgr.14514) 505 : cluster [DBG] pgmap v636: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 6.3 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 862 B/s rd, 72 MiB/s wr, 1.15k op/s; 2/312492 objects misplaced (0.001%) 2024-02-19T21:45:42.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:41.396647+0000 osd.5 (osd.5) 215 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:45:42.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:41.396702+0000 osd.5 (osd.5) 216 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:45:42.407 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:45:42.463 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:42.506 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:45:42.511 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:42.512 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:45:42.613 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:45:42.652 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:42.909 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:45:42.920 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:42.920 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:45:43.021 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:45:43.087 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:43.090 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 71 16 107391 107375 94.4958 71.8125 0.0186126 0.0105784 2024-02-19T21:45:43.124 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:45:43.129 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:43.130 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:45:43.230 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:45:43.274 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:43.314 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:45:43.318 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:43.319 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:45:43.420 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:45:43.476 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:42.278270+0000 mon.a (mon.0) 1376 : cluster [DBG] osdmap e320: 8 total, 8 up, 7 in 2024-02-19T21:45:43.476 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:42.278270+0000 mon.a (mon.0) 1376 : cluster [DBG] osdmap e320: 8 total, 8 up, 7 in 2024-02-19T21:45:43.480 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:43.508 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:45:43.522 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:45:43.525 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:43.526 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:45:43.553 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:45:43.553 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-02-19T21:45:43.553 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-02-19T21:45:43.553 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-02-19T21:45:43.554 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:45:43.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:42.278270+0000 mon.a (mon.0) 1376 : cluster [DBG] osdmap e320: 8 total, 8 up, 7 in 2024-02-19T21:45:43.626 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:45:43.676 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:43.706 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:45:43.710 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:43.710 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:45:43.811 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:45:43.851 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:43.886 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:45:43.892 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:43.892 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:45:43.993 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:45:44.037 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:44.090 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 72 16 108508 108492 94.153 69.8125 0.00917766 0.010617 2024-02-19T21:45:44.453 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:45:44.458 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:44.459 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:45:44.460 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:43.078060+0000 mgr.y (mgr.14514) 506 : cluster [DBG] pgmap v638: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 6.3 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 1.0 KiB/s rd, 69 MiB/s wr, 1.10k op/s; 2/312492 objects misplaced (0.001%) 2024-02-19T21:45:44.460 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:43.078060+0000 mgr.y (mgr.14514) 506 : cluster [DBG] pgmap v638: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 6.3 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 1.0 KiB/s rd, 69 MiB/s wr, 1.10k op/s; 2/312492 objects misplaced (0.001%) 2024-02-19T21:45:44.477 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:45:44.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:43.078060+0000 mgr.y (mgr.14514) 506 : cluster [DBG] pgmap v638: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 6.3 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 1.0 KiB/s rd, 69 MiB/s wr, 1.10k op/s; 2/312492 objects misplaced (0.001%) 2024-02-19T21:45:44.559 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:45:44.610 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:44.647 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:45:44.649 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:44.649 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:45:44.750 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:45:44.802 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:44.844 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:45:44.853 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:44.853 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:45:44.954 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:45:45.002 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:45.090 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 73 16 109656 109640 93.8461 71.75 0.0139705 0.0106518 2024-02-19T21:45:45.193 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 6, 7] out_osds: [2] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:45:45.193 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:45:45.193 INFO:tasks.thrashosds.thrasher:fixing pg num pool default.rgw.control 2024-02-19T21:45:45.194 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:45:45.531 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.2 dump_historic_ops 2024-02-19T21:45:45.578 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:45:45.581 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:45.582 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:45:45.683 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:45:45.754 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:45.786 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:45:45.790 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:45.791 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:45:45.892 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:45:45.927 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:45.999 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:45:46.001 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:46.002 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:45:46.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:45:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:45:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:45:46.090 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 74 16 110702 110686 93.4613 65.375 0.0124077 0.0106958 2024-02-19T21:45:46.103 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:45:46.115 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:45:46.119 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:45:46.148 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:46.171 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:45:46.174 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:46.175 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:45:46.276 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:45:46.339 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:46.392 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:45:46.394 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:46.395 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:45:46.429 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:45:46.495 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:45:46.542 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:45.078631+0000 mgr.y (mgr.14514) 507 : cluster [DBG] pgmap v639: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 6.5 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 853 B/s rd, 82 MiB/s wr, 1.32k op/s; 2/319908 objects misplaced (0.001%) 2024-02-19T21:45:46.542 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:46.577 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:45:46.580 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:46.580 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:45:46.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:45.078631+0000 mgr.y (mgr.14514) 507 : cluster [DBG] pgmap v639: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 6.5 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 853 B/s rd, 82 MiB/s wr, 1.32k op/s; 2/319908 objects misplaced (0.001%) 2024-02-19T21:45:46.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:45.078631+0000 mgr.y (mgr.14514) 507 : cluster [DBG] pgmap v639: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 6.5 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 853 B/s rd, 82 MiB/s wr, 1.32k op/s; 2/319908 objects misplaced (0.001%) 2024-02-19T21:45:46.681 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:45:46.734 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:46.765 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:45:46.767 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:46.768 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:45:46.868 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:45:46.918 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:47.090 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 75 16 111774 111758 93.1085 67 0.0102502 0.0107359 2024-02-19T21:45:47.336 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-02-19T21:45:47.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:46.511102+0000 mon.a (mon.0) 1377 : audit [INF] from='client.? 172.21.15.80:0/2956239864' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:45:47.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:46.511102+0000 mon.a (mon.0) 1377 : audit [INF] from='client.? 172.21.15.80:0/2956239864' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:45:47.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:46.511102+0000 mon.a (mon.0) 1377 : audit [INF] from='client.? 172.21.15.80:0/2956239864' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:45:48.091 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 76 16 112981 112965 92.8759 75.4375 0.00922052 0.0107628 2024-02-19T21:45:48.293 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:45:48.318 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:48.319 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:45:48.420 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:45:48.476 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:48.508 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:45:48.513 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:48.514 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:45:48.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:47.079241+0000 mgr.y (mgr.14514) 508 : cluster [DBG] pgmap v640: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 6.7 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 1.3 KiB/s rd, 88 MiB/s wr, 1.41k op/s; 2/329580 objects misplaced (0.001%) 2024-02-19T21:45:48.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:47.309964+0000 mon.a (mon.0) 1378 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:45:48.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:47.320612+0000 mon.a (mon.0) 1379 : audit [INF] from='client.? 172.21.15.80:0/2956239864' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:45:48.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:47.320666+0000 mon.a (mon.0) 1380 : cluster [DBG] osdmap e321: 8 total, 8 up, 7 in 2024-02-19T21:45:48.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:47.633335+0000 osd.3 (osd.3) 202 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:45:48.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:47.636076+0000 osd.3 (osd.3) 203 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:45:48.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:47.079241+0000 mgr.y (mgr.14514) 508 : cluster [DBG] pgmap v640: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 6.7 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 1.3 KiB/s rd, 88 MiB/s wr, 1.41k op/s; 2/329580 objects misplaced (0.001%) 2024-02-19T21:45:48.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:47.309964+0000 mon.a (mon.0) 1378 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:45:48.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:47.320612+0000 mon.a (mon.0) 1379 : audit [INF] from='client.? 172.21.15.80:0/2956239864' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:45:48.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:47.320666+0000 mon.a (mon.0) 1380 : cluster [DBG] osdmap e321: 8 total, 8 up, 7 in 2024-02-19T21:45:48.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:47.633335+0000 osd.3 (osd.3) 202 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:45:48.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:47.636076+0000 osd.3 (osd.3) 203 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:45:48.614 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:45:48.633 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:45:48.674 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:48.677 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:45:48.708 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:45:48.738 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:45:48.772 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:45:48.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:47.079241+0000 mgr.y (mgr.14514) 508 : cluster [DBG] pgmap v640: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 6.7 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 1.3 KiB/s rd, 88 MiB/s wr, 1.41k op/s; 2/329580 objects misplaced (0.001%) 2024-02-19T21:45:48.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:47.309964+0000 mon.a (mon.0) 1378 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:45:48.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:47.320612+0000 mon.a (mon.0) 1379 : audit [INF] from='client.? 172.21.15.80:0/2956239864' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:45:48.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:47.320666+0000 mon.a (mon.0) 1380 : cluster [DBG] osdmap e321: 8 total, 8 up, 7 in 2024-02-19T21:45:48.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:47.633335+0000 osd.3 (osd.3) 202 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:45:48.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:47.636076+0000 osd.3 (osd.3) 203 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:45:48.807 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:45:48.808 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:45:48.814 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:48.815 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:45:48.839 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:45:48.877 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:45:48.883 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:45:48.883 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:45:48.883 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:45:48.883 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:45:48.883 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:45:48.883 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:45:48.883 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:45:48.883 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:45:48.916 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:45:48.967 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:49.090 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 77 16 114098 114082 92.5762 69.8125 0.0098856 0.0107979 2024-02-19T21:45:49.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:47.716311+0000 osd.1 (osd.1) 197 : cluster [DBG] 6.4 scrub starts 2024-02-19T21:45:49.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:47.723543+0000 osd.1 (osd.1) 198 : cluster [DBG] 6.4 scrub ok 2024-02-19T21:45:49.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:48.596796+0000 mon.c (mon.2) 71 : audit [DBG] from='client.? 172.21.15.80:0/1983402899' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:45:49.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:48.951384+0000 osd.6 (osd.6) 181 : cluster [DBG] 2.14 scrub starts 2024-02-19T21:45:49.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:48.957242+0000 osd.6 (osd.6) 182 : cluster [DBG] 2.14 scrub ok 2024-02-19T21:45:49.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:47.716311+0000 osd.1 (osd.1) 197 : cluster [DBG] 6.4 scrub starts 2024-02-19T21:45:49.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:47.723543+0000 osd.1 (osd.1) 198 : cluster [DBG] 6.4 scrub ok 2024-02-19T21:45:49.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:48.596796+0000 mon.c (mon.2) 71 : audit [DBG] from='client.? 172.21.15.80:0/1983402899' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:45:49.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:48.951384+0000 osd.6 (osd.6) 181 : cluster [DBG] 2.14 scrub starts 2024-02-19T21:45:49.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:48.957242+0000 osd.6 (osd.6) 182 : cluster [DBG] 2.14 scrub ok 2024-02-19T21:45:49.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:47.716311+0000 osd.1 (osd.1) 197 : cluster [DBG] 6.4 scrub starts 2024-02-19T21:45:49.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:47.723543+0000 osd.1 (osd.1) 198 : cluster [DBG] 6.4 scrub ok 2024-02-19T21:45:49.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:48.596796+0000 mon.c (mon.2) 71 : audit [DBG] from='client.? 172.21.15.80:0/1983402899' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:45:49.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:48.951384+0000 osd.6 (osd.6) 181 : cluster [DBG] 2.14 scrub starts 2024-02-19T21:45:49.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:48.957242+0000 osd.6 (osd.6) 182 : cluster [DBG] 2.14 scrub ok 2024-02-19T21:45:50.092 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 78 16 115300 115284 92.3524 75.125 0.0177439 0.0108242 2024-02-19T21:45:50.134 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:45:50.139 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:50.139 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:45:50.240 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:45:50.285 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:50.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:49.079610+0000 mgr.y (mgr.14514) 509 : cluster [DBG] pgmap v642: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 6.7 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 639 B/s rd, 44 MiB/s wr, 712 op/s; 2/329580 objects misplaced (0.001%) 2024-02-19T21:45:50.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:49.464839+0000 osd.0 (osd.0) 214 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:45:50.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:49.464880+0000 osd.0 (osd.0) 215 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:45:50.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:50.001186+0000 osd.6 (osd.6) 183 : cluster [DBG] 6.c scrub starts 2024-02-19T21:45:50.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:50.004298+0000 osd.6 (osd.6) 184 : cluster [DBG] 6.c scrub ok 2024-02-19T21:45:50.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:50.152231+0000 mon.a (mon.0) 1381 : cluster [DBG] osdmap e322: 8 total, 8 up, 7 in 2024-02-19T21:45:50.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:49.079610+0000 mgr.y (mgr.14514) 509 : cluster [DBG] pgmap v642: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 6.7 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 639 B/s rd, 44 MiB/s wr, 712 op/s; 2/329580 objects misplaced (0.001%) 2024-02-19T21:45:50.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:49.464839+0000 osd.0 (osd.0) 214 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:45:50.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:49.464880+0000 osd.0 (osd.0) 215 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:45:50.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:50.001186+0000 osd.6 (osd.6) 183 : cluster [DBG] 6.c scrub starts 2024-02-19T21:45:50.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:50.004298+0000 osd.6 (osd.6) 184 : cluster [DBG] 6.c scrub ok 2024-02-19T21:45:50.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:50.152231+0000 mon.a (mon.0) 1381 : cluster [DBG] osdmap e322: 8 total, 8 up, 7 in 2024-02-19T21:45:50.611 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:49.079610+0000 mgr.y (mgr.14514) 509 : cluster [DBG] pgmap v642: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 6.7 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 639 B/s rd, 44 MiB/s wr, 712 op/s; 2/329580 objects misplaced (0.001%) 2024-02-19T21:45:50.611 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:49.464839+0000 osd.0 (osd.0) 214 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:45:50.612 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:49.464880+0000 osd.0 (osd.0) 215 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:45:50.612 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:50.001186+0000 osd.6 (osd.6) 183 : cluster [DBG] 6.c scrub starts 2024-02-19T21:45:50.612 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:50.004298+0000 osd.6 (osd.6) 184 : cluster [DBG] 6.c scrub ok 2024-02-19T21:45:50.612 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:50.152231+0000 mon.a (mon.0) 1381 : cluster [DBG] osdmap e322: 8 total, 8 up, 7 in 2024-02-19T21:45:50.612 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:45:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:45:51.091 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 79 16 116488 116472 92.123 74.25 0.01788 0.0108511 2024-02-19T21:45:51.098 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:45:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:45:50] "GET /metrics HTTP/1.1" 200 176130 "" "Prometheus/2.33.4" 2024-02-19T21:45:51.153 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:45:51.157 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:51.158 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:45:51.258 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:45:51.304 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:51.370 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:45:51.375 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:51.376 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:45:51.466 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:49.719998+0000 osd.1 (osd.1) 199 : cluster [DBG] 4.1c scrub starts 2024-02-19T21:45:51.466 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:49.728726+0000 osd.1 (osd.1) 200 : cluster [DBG] 4.1c scrub ok 2024-02-19T21:45:51.466 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:50.611684+0000 mgr.y (mgr.14514) 510 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:45:51.466 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:49.719998+0000 osd.1 (osd.1) 199 : cluster [DBG] 4.1c scrub starts 2024-02-19T21:45:51.466 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:49.728726+0000 osd.1 (osd.1) 200 : cluster [DBG] 4.1c scrub ok 2024-02-19T21:45:51.467 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:50.611684+0000 mgr.y (mgr.14514) 510 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:45:51.477 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:45:51.531 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:51.558 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:45:51.563 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:51.564 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:45:51.664 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:45:51.704 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:49.719998+0000 osd.1 (osd.1) 199 : cluster [DBG] 4.1c scrub starts 2024-02-19T21:45:51.704 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:49.728726+0000 osd.1 (osd.1) 200 : cluster [DBG] 4.1c scrub ok 2024-02-19T21:45:51.704 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:50.611684+0000 mgr.y (mgr.14514) 510 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:45:51.707 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:51.736 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:45:51.741 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:51.742 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:45:51.814 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-19T21:45:51.843 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:45:51.910 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:51.943 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:45:51.948 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:51.949 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:45:52.050 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:45:52.090 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:52.091 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:2024-02-19T21:45:52.092382+0000 min lat: 0.00124015 max lat: 0.148674 avg lat: 0.0108858 2024-02-19T21:45:52.091 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-19T21:45:52.091 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 80 16 117581 117565 91.8254 68.3125 0.00911054 0.0108858 2024-02-19T21:45:52.121 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:45:52.124 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:52.124 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:45:52.225 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:45:52.270 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:52.305 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:45:52.310 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:52.310 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:45:52.351 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:50.733033+0000 osd.1 (osd.1) 201 : cluster [DBG] 5.0 scrub starts 2024-02-19T21:45:52.351 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:50.742518+0000 osd.1 (osd.1) 202 : cluster [DBG] 5.0 scrub ok 2024-02-19T21:45:52.389 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:45:52.397 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:45:52.411 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:45:52.454 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:52.487 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:45:52.490 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:52.490 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:45:52.591 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:45:52.630 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:50.733033+0000 osd.1 (osd.1) 201 : cluster [DBG] 5.0 scrub starts 2024-02-19T21:45:52.630 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:50.742518+0000 osd.1 (osd.1) 202 : cluster [DBG] 5.0 scrub ok 2024-02-19T21:45:52.630 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:50.972697+0000 osd.4 (osd.4) 158 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:45:52.630 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:50.978611+0000 osd.4 (osd.4) 159 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:45:52.630 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:51.080167+0000 mgr.y (mgr.14514) 511 : cluster [DBG] pgmap v644: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 7.0 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 1.2 KiB/s rd, 89 MiB/s wr, 1.42k op/s; 2/346521 objects misplaced (0.001%) 2024-02-19T21:45:52.630 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:51.242825+0000 osd.0 (osd.0) 216 : cluster [DBG] 3.1 scrub starts 2024-02-19T21:45:52.631 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:51.243652+0000 osd.0 (osd.0) 217 : cluster [DBG] 3.1 scrub ok 2024-02-19T21:45:52.631 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:51.642474+0000 osd.3 (osd.3) 204 : cluster [DBG] 9.1 scrub starts 2024-02-19T21:45:52.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:50.733033+0000 osd.1 (osd.1) 201 : cluster [DBG] 5.0 scrub starts 2024-02-19T21:45:52.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:50.742518+0000 osd.1 (osd.1) 202 : cluster [DBG] 5.0 scrub ok 2024-02-19T21:45:52.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:50.972697+0000 osd.4 (osd.4) 158 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:45:52.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:50.978611+0000 osd.4 (osd.4) 159 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:45:52.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:51.080167+0000 mgr.y (mgr.14514) 511 : cluster [DBG] pgmap v644: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 7.0 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 1.2 KiB/s rd, 89 MiB/s wr, 1.42k op/s; 2/346521 objects misplaced (0.001%) 2024-02-19T21:45:52.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:51.242825+0000 osd.0 (osd.0) 216 : cluster [DBG] 3.1 scrub starts 2024-02-19T21:45:52.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:51.243652+0000 osd.0 (osd.0) 217 : cluster [DBG] 3.1 scrub ok 2024-02-19T21:45:52.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:51.642474+0000 osd.3 (osd.3) 204 : cluster [DBG] 9.1 scrub starts 2024-02-19T21:45:52.636 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:52.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:50.972697+0000 osd.4 (osd.4) 158 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:45:52.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:50.978611+0000 osd.4 (osd.4) 159 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:45:52.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:51.080167+0000 mgr.y (mgr.14514) 511 : cluster [DBG] pgmap v644: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 7.0 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 1.2 KiB/s rd, 89 MiB/s wr, 1.42k op/s; 2/346521 objects misplaced (0.001%) 2024-02-19T21:45:52.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:51.242825+0000 osd.0 (osd.0) 216 : cluster [DBG] 3.1 scrub starts 2024-02-19T21:45:52.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:51.243652+0000 osd.0 (osd.0) 217 : cluster [DBG] 3.1 scrub ok 2024-02-19T21:45:52.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:51.642474+0000 osd.3 (osd.3) 204 : cluster [DBG] 9.1 scrub starts 2024-02-19T21:45:52.844 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:45:52.848 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:52.848 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:45:52.949 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:45:52.957 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:45:52.957 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:45:53.008 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:53.041 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:45:53.044 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:53.045 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:45:53.091 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 81 15 118607 118592 91.4841 64.1875 0.0102232 0.0109266 2024-02-19T21:45:53.146 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:45:53.191 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:53.221 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:45:53.226 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:53.226 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:45:53.327 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:45:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:53.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:52.368246+0000 mgr.y (mgr.14514) 512 : audit [DBG] from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:45:53.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:52.368246+0000 mgr.y (mgr.14514) 512 : audit [DBG] from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:45:53.746 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:45:53.750 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:53.751 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:45:53.770 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.3 dump_ops_in_flight 2024-02-19T21:45:53.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:52.368246+0000 mgr.y (mgr.14514) 512 : audit [DBG] from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:45:53.824 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:45:53.852 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:45:53.892 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:53.918 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:45:53.922 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:53.923 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:45:54.023 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:45:54.073 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:54.091 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 82 16 119687 119671 91.1909 67.4375 0.0181047 0.0109611 2024-02-19T21:45:54.108 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:45:54.112 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:54.113 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:45:54.214 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:45:54.250 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:54.262 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":644,"stamp":"2024-02-19T21:45:51.079769+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7557289814,"num_objects":115507,"num_object_clones":0,"num_object_copies":346521,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":115507,"num_whiteouts":0,"num_read":1926,"num_read_kb":1678,"num_write":116028,"num_write_kb":7380200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":4535,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74222,"ondisk_log_size":74222,"up":414,"acting":414,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":416,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":656216064,"kb_used":24765356,"kb_used_data":22062900,"kb_used_omap":0,"kb_used_meta":2702336,"kb_avail":631450708,"statfs":{"total":671965249536,"available":646605524992,"internally_reserved":0,"allocated":22592409600,"data_stored":22587660821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2767192064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,3,6,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":743374848,"num_objects":11343,"num_object_clones":0,"num_object_copies":34029,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11343,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11343,"num_write_kb":725952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001930"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":318,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.303092+0000","last_change":"2024-02-19T21:44:58.792331+0000","last_active":"2024-02-19T21:45:42.303092+0000","last_peered":"2024-02-19T21:45:42.303092+0000","last_clean":"2024-02-19T21:45:42.303092+0000","last_became_active":"2024-02-19T21:44:58.791985+0000","last_became_peered":"2024-02-19T21:44:58.791985+0000","last_unstale":"2024-02-19T21:45:42.303092+0000","last_undegraded":"2024-02-19T21:45:42.303092+0000","last_fullsized":"2024-02-19T21:45:42.303092+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:35.539219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:40:35.539219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":297,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.330900+0000","last_change":"2024-02-19T21:45:17.201007+0000","last_active":"2024-02-19T21:45:47.330900+0000","last_peered":"2024-02-19T21:45:47.330900+0000","last_clean":"2024-02-19T21:45:47.330900+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:45:47.330900+0000","last_undegraded":"2024-02-19T21:45:47.330900+0000","last_fullsized":"2024-02-19T21:45:47.330900+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:17.200897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:17.200897+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"201'27","reported_seq":269,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.329404+0000","last_change":"2024-02-19T21:44:48.022082+0000","last_active":"2024-02-19T21:45:47.329404+0000","last_peered":"2024-02-19T21:45:47.329404+0000","last_clean":"2024-02-19T21:45:47.329404+0000","last_became_active":"2024-02-19T21:39:51.536424+0000","last_became_peered":"2024-02-19T21:39:51.536424+0000","last_unstale":"2024-02-19T21:45:47.329404+0000","last_undegraded":"2024-02-19T21:45:47.329404+0000","last_fullsized":"2024-02-19T21:45:47.329404+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'27","last_scrub_stamp":"2024-02-19T21:44:48.022013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:48.022013+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":319,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.296273+0000","last_change":"2024-02-19T21:44:58.789873+0000","last_active":"2024-02-19T21:45:42.296273+0000","last_peered":"2024-02-19T21:45:42.296273+0000","last_clean":"2024-02-19T21:45:42.296273+0000","last_became_active":"2024-02-19T21:44:58.789475+0000","last_became_peered":"2024-02-19T21:44:58.789475+0000","last_unstale":"2024-02-19T21:45:42.296273+0000","last_undegraded":"2024-02-19T21:45:42.296273+0000","last_fullsized":"2024-02-19T21:45:42.296273+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:17.853016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:40:17.853016+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":298,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.636198+0000","last_change":"2024-02-19T21:45:47.636198+0000","last_active":"2024-02-19T21:45:47.636198+0000","last_peered":"2024-02-19T21:45:47.636198+0000","last_clean":"2024-02-19T21:45:47.636198+0000","last_became_active":"2024-02-19T21:32:23.356975+0000","last_became_peered":"2024-02-19T21:32:23.356975+0000","last_unstale":"2024-02-19T21:45:47.636198+0000","last_undegraded":"2024-02-19T21:45:47.636198+0000","last_fullsized":"2024-02-19T21:45:47.636198+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.636083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.636083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"200'19","reported_seq":335,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.297680+0000","last_change":"2024-02-19T21:44:08.556202+0000","last_active":"2024-02-19T21:45:42.297680+0000","last_peered":"2024-02-19T21:45:42.297680+0000","last_clean":"2024-02-19T21:45:42.297680+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:45:42.297680+0000","last_undegraded":"2024-02-19T21:45:42.297680+0000","last_fullsized":"2024-02-19T21:45:42.297680+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:44:08.556123+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:44:08.556123+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":26,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.293331+0000","last_change":"2024-02-19T21:44:58.787250+0000","last_active":"2024-02-19T21:45:42.293331+0000","last_peered":"2024-02-19T21:45:42.293331+0000","last_clean":"2024-02-19T21:45:42.293331+0000","last_became_active":"2024-02-19T21:44:58.786889+0000","last_became_peered":"2024-02-19T21:44:58.786889+0000","last_unstale":"2024-02-19T21:45:42.293331+0000","last_undegraded":"2024-02-19T21:45:42.293331+0000","last_fullsized":"2024-02-19T21:45:42.293331+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:42.230664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:42.230664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":296,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.288174+0000","last_change":"2024-02-19T21:45:00.643941+0000","last_active":"2024-02-19T21:45:42.288174+0000","last_peered":"2024-02-19T21:45:42.288174+0000","last_clean":"2024-02-19T21:45:42.288174+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:45:42.288174+0000","last_undegraded":"2024-02-19T21:45:42.288174+0000","last_fullsized":"2024-02-19T21:45:42.288174+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:00.643880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:08.490788+0000","last_clean_scrub_stamp":"2024-02-19T21:45:00.643880+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"310'9","reported_seq":295,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.298808+0000","last_change":"2024-02-19T21:45:20.506300+0000","last_active":"2024-02-19T21:45:42.298808+0000","last_peered":"2024-02-19T21:45:42.298808+0000","last_clean":"2024-02-19T21:45:42.298808+0000","last_became_active":"2024-02-19T21:39:39.471143+0000","last_became_peered":"2024-02-19T21:39:39.471143+0000","last_unstale":"2024-02-19T21:45:42.298808+0000","last_undegraded":"2024-02-19T21:45:42.298808+0000","last_fullsized":"2024-02-19T21:45:42.298808+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"310'9","last_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_deep_scrub":"310'9","last_deep_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.506188+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":209,"reported_epoch":321,"state":"active+remapped+backfill_toofull","last_fresh":"2024-02-19T21:45:47.328693+0000","last_change":"2024-02-19T21:45:29.828715+0000","last_active":"2024-02-19T21:45:47.328693+0000","last_peered":"2024-02-19T21:45:47.328693+0000","last_clean":"2024-02-19T21:43:10.331595+0000","last_became_active":"2024-02-19T21:44:59.810536+0000","last_became_peered":"2024-02-19T21:44:59.810536+0000","last_unstale":"2024-02-19T21:45:47.328693+0000","last_undegraded":"2024-02-19T21:45:47.328693+0000","last_fullsized":"2024-02-19T21:45:47.328693+0000","mapping_epoch":305,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:36.890201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.890201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,3,6],"avail_no_missing":["0","3","6"],"object_location_counts":[{"shards":"0,3,6","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":303,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.289414+0000","last_change":"2024-02-19T21:44:17.172601+0000","last_active":"2024-02-19T21:45:42.289414+0000","last_peered":"2024-02-19T21:45:42.289414+0000","last_clean":"2024-02-19T21:45:42.289414+0000","last_became_active":"2024-02-19T21:39:39.473759+0000","last_became_peered":"2024-02-19T21:39:39.473759+0000","last_unstale":"2024-02-19T21:45:42.289414+0000","last_undegraded":"2024-02-19T21:45:42.289414+0000","last_fullsized":"2024-02-19T21:45:42.289414+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:17.172541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:17.172541+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"200'19","reported_seq":316,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.298647+0000","last_change":"2024-02-19T21:44:50.652809+0000","last_active":"2024-02-19T21:45:42.298647+0000","last_peered":"2024-02-19T21:45:42.298647+0000","last_clean":"2024-02-19T21:45:42.298647+0000","last_became_active":"2024-02-19T21:35:14.514971+0000","last_became_peered":"2024-02-19T21:35:14.514971+0000","last_unstale":"2024-02-19T21:45:42.298647+0000","last_undegraded":"2024-02-19T21:45:42.298647+0000","last_fullsized":"2024-02-19T21:45:42.298647+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:44:50.652700+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:44:50.652700+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":31,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.299138+0000","last_change":"2024-02-19T21:45:06.621907+0000","last_active":"2024-02-19T21:45:42.299138+0000","last_peered":"2024-02-19T21:45:42.299138+0000","last_clean":"2024-02-19T21:45:42.299138+0000","last_became_active":"2024-02-19T21:44:58.789418+0000","last_became_peered":"2024-02-19T21:44:58.789418+0000","last_unstale":"2024-02-19T21:45:42.299138+0000","last_undegraded":"2024-02-19T21:45:42.299138+0000","last_fullsized":"2024-02-19T21:45:42.299138+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:06.621809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:45:06.621809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":176,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.303308+0000","last_change":"2024-02-19T21:44:51.194621+0000","last_active":"2024-02-19T21:45:42.303308+0000","last_peered":"2024-02-19T21:45:42.303308+0000","last_clean":"2024-02-19T21:45:42.303308+0000","last_became_active":"2024-02-19T21:42:04.201106+0000","last_became_peered":"2024-02-19T21:42:04.201106+0000","last_unstale":"2024-02-19T21:45:42.303308+0000","last_undegraded":"2024-02-19T21:45:42.303308+0000","last_fullsized":"2024-02-19T21:45:42.303308+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:51.194543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:51.194543+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,5],"acting":[6,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"201'18","reported_seq":254,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.294037+0000","last_change":"2024-02-19T21:44:15.699369+0000","last_active":"2024-02-19T21:45:42.294037+0000","last_peered":"2024-02-19T21:45:42.294037+0000","last_clean":"2024-02-19T21:45:42.294037+0000","last_became_active":"2024-02-19T21:38:31.247067+0000","last_became_peered":"2024-02-19T21:38:31.247067+0000","last_unstale":"2024-02-19T21:45:42.294037+0000","last_undegraded":"2024-02-19T21:45:42.294037+0000","last_fullsized":"2024-02-19T21:45:42.294037+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'18","last_scrub_stamp":"2024-02-19T21:44:15.699279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.699279+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":286,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.299452+0000","last_change":"2024-02-19T21:45:03.152371+0000","last_active":"2024-02-19T21:45:42.299452+0000","last_peered":"2024-02-19T21:45:42.299452+0000","last_clean":"2024-02-19T21:45:42.299452+0000","last_became_active":"2024-02-19T21:44:58.788307+0000","last_became_peered":"2024-02-19T21:44:58.788307+0000","last_unstale":"2024-02-19T21:45:42.299452+0000","last_undegraded":"2024-02-19T21:45:42.299452+0000","last_fullsized":"2024-02-19T21:45:42.299452+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:03.152272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:45:03.152272+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":299,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.298363+0000","last_change":"2024-02-19T21:45:17.913694+0000","last_active":"2024-02-19T21:45:42.298363+0000","last_peered":"2024-02-19T21:45:42.298363+0000","last_clean":"2024-02-19T21:45:42.298363+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:45:42.298363+0000","last_undegraded":"2024-02-19T21:45:42.298363+0000","last_fullsized":"2024-02-19T21:45:42.298363+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:17.913620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:17.913620+0000","last_clean_scrub_stamp":"2024-02-19T21:45:17.913620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"200'34","reported_seq":282,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:49.728831+0000","last_change":"2024-02-19T21:45:49.728831+0000","last_active":"2024-02-19T21:45:49.728831+0000","last_peered":"2024-02-19T21:45:49.728831+0000","last_clean":"2024-02-19T21:45:49.728831+0000","last_became_active":"2024-02-19T21:39:39.477429+0000","last_became_peered":"2024-02-19T21:39:39.477429+0000","last_unstale":"2024-02-19T21:45:49.728831+0000","last_undegraded":"2024-02-19T21:45:49.728831+0000","last_fullsized":"2024-02-19T21:45:49.728831+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'34","last_scrub_stamp":"2024-02-19T21:45:49.728734+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:45:49.728734+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":311,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.291697+0000","last_change":"2024-02-19T21:44:58.790954+0000","last_active":"2024-02-19T21:45:42.291697+0000","last_peered":"2024-02-19T21:45:42.291697+0000","last_clean":"2024-02-19T21:45:42.291697+0000","last_became_active":"2024-02-19T21:44:58.790669+0000","last_became_peered":"2024-02-19T21:44:58.790669+0000","last_unstale":"2024-02-19T21:45:42.291697+0000","last_undegraded":"2024-02-19T21:45:42.291697+0000","last_fullsized":"2024-02-19T21:45:42.291697+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:16.845272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:16.845272+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":223,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.297053+0000","last_change":"2024-02-19T21:44:47.281527+0000","last_active":"2024-02-19T21:45:42.297053+0000","last_peered":"2024-02-19T21:45:42.297053+0000","last_clean":"2024-02-19T21:45:42.297053+0000","last_became_active":"2024-02-19T21:42:04.198592+0000","last_became_peered":"2024-02-19T21:42:04.198592+0000","last_unstale":"2024-02-19T21:45:42.297053+0000","last_undegraded":"2024-02-19T21:45:42.297053+0000","last_fullsized":"2024-02-19T21:45:42.297053+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:47.281454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:47.281454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"201'19","reported_seq":196,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.331202+0000","last_change":"2024-02-19T21:45:02.090506+0000","last_active":"2024-02-19T21:45:47.331202+0000","last_peered":"2024-02-19T21:45:47.331202+0000","last_clean":"2024-02-19T21:45:47.331202+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:45:47.331202+0000","last_undegraded":"2024-02-19T21:45:47.331202+0000","last_fullsized":"2024-02-19T21:45:47.331202+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:45:02.090422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:02.090422+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":117,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.289175+0000","last_change":"2024-02-19T21:45:12.526572+0000","last_active":"2024-02-19T21:45:42.289175+0000","last_peered":"2024-02-19T21:45:42.289175+0000","last_clean":"2024-02-19T21:45:42.289175+0000","last_became_active":"2024-02-19T21:45:01.146656+0000","last_became_peered":"2024-02-19T21:45:01.146656+0000","last_unstale":"2024-02-19T21:45:42.289175+0000","last_undegraded":"2024-02-19T21:45:42.289175+0000","last_fullsized":"2024-02-19T21:45:42.289175+0000","mapping_epoch":307,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":308,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:45:12.526466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.526466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":304,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.294040+0000","last_change":"2024-02-19T21:44:14.474971+0000","last_active":"2024-02-19T21:45:42.294040+0000","last_peered":"2024-02-19T21:45:42.294040+0000","last_clean":"2024-02-19T21:45:42.294040+0000","last_became_active":"2024-02-19T21:42:04.199323+0000","last_became_peered":"2024-02-19T21:42:04.199323+0000","last_unstale":"2024-02-19T21:45:42.294040+0000","last_undegraded":"2024-02-19T21:45:42.294040+0000","last_fullsized":"2024-02-19T21:45:42.294040+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:14.474903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:44:14.474903+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"201'20","reported_seq":376,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.330752+0000","last_change":"2024-02-19T21:44:51.032776+0000","last_active":"2024-02-19T21:45:47.330752+0000","last_peered":"2024-02-19T21:45:47.330752+0000","last_clean":"2024-02-19T21:45:47.330752+0000","last_became_active":"2024-02-19T21:42:04.204882+0000","last_became_peered":"2024-02-19T21:42:04.204882+0000","last_unstale":"2024-02-19T21:45:47.330752+0000","last_undegraded":"2024-02-19T21:45:47.330752+0000","last_fullsized":"2024-02-19T21:45:47.330752+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:44:51.032704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:51.032704+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":208,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.329209+0000","last_change":"2024-02-19T21:44:18.094565+0000","last_active":"2024-02-19T21:45:47.329209+0000","last_peered":"2024-02-19T21:45:47.329209+0000","last_clean":"2024-02-19T21:45:47.329209+0000","last_became_active":"2024-02-19T21:39:39.471332+0000","last_became_peered":"2024-02-19T21:39:39.471332+0000","last_unstale":"2024-02-19T21:45:47.329209+0000","last_undegraded":"2024-02-19T21:45:47.329209+0000","last_fullsized":"2024-02-19T21:45:47.329209+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:18.094477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:44:18.094477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":292,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.287789+0000","last_change":"2024-02-19T21:45:10.521912+0000","last_active":"2024-02-19T21:45:42.287789+0000","last_peered":"2024-02-19T21:45:42.287789+0000","last_clean":"2024-02-19T21:45:42.287789+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:45:42.287789+0000","last_undegraded":"2024-02-19T21:45:42.287789+0000","last_fullsized":"2024-02-19T21:45:42.287789+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:10.521830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:45:10.521830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":303,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.302807+0000","last_change":"2024-02-19T21:44:11.227806+0000","last_active":"2024-02-19T21:45:42.302807+0000","last_peered":"2024-02-19T21:45:42.302807+0000","last_clean":"2024-02-19T21:45:42.302807+0000","last_became_active":"2024-02-19T21:39:39.478633+0000","last_became_peered":"2024-02-19T21:39:39.478633+0000","last_unstale":"2024-02-19T21:45:42.302807+0000","last_undegraded":"2024-02-19T21:45:42.302807+0000","last_fullsized":"2024-02-19T21:45:42.302807+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:11.227741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:11.227741+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"201'19","reported_seq":343,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.299349+0000","last_change":"2024-02-19T21:44:10.534619+0000","last_active":"2024-02-19T21:45:42.299349+0000","last_peered":"2024-02-19T21:45:42.299349+0000","last_clean":"2024-02-19T21:45:42.299349+0000","last_became_active":"2024-02-19T21:42:04.205379+0000","last_became_peered":"2024-02-19T21:42:04.205379+0000","last_unstale":"2024-02-19T21:45:42.299349+0000","last_undegraded":"2024-02-19T21:45:42.299349+0000","last_fullsized":"2024-02-19T21:45:42.299349+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:44:10.534549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:10.534549+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":292,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.288085+0000","last_change":"2024-02-19T21:44:09.151576+0000","last_active":"2024-02-19T21:45:42.288085+0000","last_peered":"2024-02-19T21:45:42.288085+0000","last_clean":"2024-02-19T21:45:42.288085+0000","last_became_active":"2024-02-19T21:39:39.471306+0000","last_became_peered":"2024-02-19T21:39:39.471306+0000","last_unstale":"2024-02-19T21:45:42.288085+0000","last_undegraded":"2024-02-19T21:45:42.288085+0000","last_fullsized":"2024-02-19T21:45:42.288085+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:09.151490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:44:09.151490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":333,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.297166+0000","last_change":"2024-02-19T21:44:07.235190+0000","last_active":"2024-02-19T21:45:42.297166+0000","last_peered":"2024-02-19T21:45:42.297166+0000","last_clean":"2024-02-19T21:45:42.297166+0000","last_became_active":"2024-02-19T21:42:04.196794+0000","last_became_peered":"2024-02-19T21:42:04.196794+0000","last_unstale":"2024-02-19T21:45:42.297166+0000","last_undegraded":"2024-02-19T21:45:42.297166+0000","last_fullsized":"2024-02-19T21:45:42.297166+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:07.235071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:07.235071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":299,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.296676+0000","last_change":"2024-02-19T21:44:11.487571+0000","last_active":"2024-02-19T21:45:42.296676+0000","last_peered":"2024-02-19T21:45:42.296676+0000","last_clean":"2024-02-19T21:45:42.296676+0000","last_became_active":"2024-02-19T21:39:39.479927+0000","last_became_peered":"2024-02-19T21:39:39.479927+0000","last_unstale":"2024-02-19T21:45:42.296676+0000","last_undegraded":"2024-02-19T21:45:42.296676+0000","last_fullsized":"2024-02-19T21:45:42.296676+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:11.487509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:44:11.487509+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"200'8","reported_seq":156,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.298407+0000","last_change":"2024-02-19T21:44:55.590425+0000","last_active":"2024-02-19T21:45:42.298407+0000","last_peered":"2024-02-19T21:45:42.298407+0000","last_clean":"2024-02-19T21:45:42.298407+0000","last_became_active":"2024-02-19T21:41:42.243259+0000","last_became_peered":"2024-02-19T21:41:42.243259+0000","last_unstale":"2024-02-19T21:45:42.298407+0000","last_undegraded":"2024-02-19T21:45:42.298407+0000","last_fullsized":"2024-02-19T21:45:42.298407+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'8","last_scrub_stamp":"2024-02-19T21:44:55.590349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:55.590349+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":208,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.329322+0000","last_change":"2024-02-19T21:44:17.079476+0000","last_active":"2024-02-19T21:45:47.329322+0000","last_peered":"2024-02-19T21:45:47.329322+0000","last_clean":"2024-02-19T21:45:47.329322+0000","last_became_active":"2024-02-19T21:39:39.462363+0000","last_became_peered":"2024-02-19T21:39:39.462363+0000","last_unstale":"2024-02-19T21:45:47.329322+0000","last_undegraded":"2024-02-19T21:45:47.329322+0000","last_fullsized":"2024-02-19T21:45:47.329322+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:17.079391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:44:17.079391+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":305,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.292643+0000","last_change":"2024-02-19T21:45:19.596864+0000","last_active":"2024-02-19T21:45:42.292643+0000","last_peered":"2024-02-19T21:45:42.292643+0000","last_clean":"2024-02-19T21:45:42.292643+0000","last_became_active":"2024-02-19T21:42:04.198684+0000","last_became_peered":"2024-02-19T21:42:04.198684+0000","last_unstale":"2024-02-19T21:45:42.292643+0000","last_undegraded":"2024-02-19T21:45:42.292643+0000","last_fullsized":"2024-02-19T21:45:42.292643+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:19.596775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:19.596775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":293,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.293784+0000","last_change":"2024-02-19T21:44:52.828511+0000","last_active":"2024-02-19T21:45:42.293784+0000","last_peered":"2024-02-19T21:45:42.293784+0000","last_clean":"2024-02-19T21:45:42.293784+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:45:42.293784+0000","last_undegraded":"2024-02-19T21:45:42.293784+0000","last_fullsized":"2024-02-19T21:45:42.293784+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:52.828413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:44:52.828413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"201'19","reported_seq":335,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.298746+0000","last_change":"2024-02-19T21:44:48.350026+0000","last_active":"2024-02-19T21:45:42.298746+0000","last_peered":"2024-02-19T21:45:42.298746+0000","last_clean":"2024-02-19T21:45:42.298746+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:45:42.298746+0000","last_undegraded":"2024-02-19T21:45:42.298746+0000","last_fullsized":"2024-02-19T21:45:42.298746+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:44:48.349927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:48.349927+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":295,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.328115+0000","last_change":"2024-02-19T21:44:07.280418+0000","last_active":"2024-02-19T21:45:47.328115+0000","last_peered":"2024-02-19T21:45:47.328115+0000","last_clean":"2024-02-19T21:45:47.328115+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:45:47.328115+0000","last_undegraded":"2024-02-19T21:45:47.328115+0000","last_fullsized":"2024-02-19T21:45:47.328115+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:07.280329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:42.527849+0000","last_clean_scrub_stamp":"2024-02-19T21:44:07.280329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":293,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.298890+0000","last_change":"2024-02-19T21:44:08.574844+0000","last_active":"2024-02-19T21:45:42.298890+0000","last_peered":"2024-02-19T21:45:42.298890+0000","last_clean":"2024-02-19T21:45:42.298890+0000","last_became_active":"2024-02-19T21:39:51.534750+0000","last_became_peered":"2024-02-19T21:39:51.534750+0000","last_unstale":"2024-02-19T21:45:42.298890+0000","last_undegraded":"2024-02-19T21:45:42.298890+0000","last_fullsized":"2024-02-19T21:45:42.298890+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:08.574749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:08.574749+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":299,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:48.957337+0000","last_change":"2024-02-19T21:45:48.957337+0000","last_active":"2024-02-19T21:45:48.957337+0000","last_peered":"2024-02-19T21:45:48.957337+0000","last_clean":"2024-02-19T21:45:48.957337+0000","last_became_active":"2024-02-19T21:32:23.357338+0000","last_became_peered":"2024-02-19T21:32:23.357338+0000","last_unstale":"2024-02-19T21:45:48.957337+0000","last_undegraded":"2024-02-19T21:45:48.957337+0000","last_fullsized":"2024-02-19T21:45:48.957337+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:48.957250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:45:48.957250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"200'15","reported_seq":333,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.292608+0000","last_change":"2024-02-19T21:45:08.678772+0000","last_active":"2024-02-19T21:45:42.292608+0000","last_peered":"2024-02-19T21:45:42.292608+0000","last_clean":"2024-02-19T21:45:42.292608+0000","last_became_active":"2024-02-19T21:39:39.466843+0000","last_became_peered":"2024-02-19T21:39:39.466843+0000","last_unstale":"2024-02-19T21:45:42.292608+0000","last_undegraded":"2024-02-19T21:45:42.292608+0000","last_fullsized":"2024-02-19T21:45:42.292608+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:45:08.678669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:08.678669+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":319,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.296045+0000","last_change":"2024-02-19T21:44:58.788427+0000","last_active":"2024-02-19T21:45:42.296045+0000","last_peered":"2024-02-19T21:45:42.296045+0000","last_clean":"2024-02-19T21:45:42.296045+0000","last_became_active":"2024-02-19T21:44:58.788069+0000","last_became_peered":"2024-02-19T21:44:58.788069+0000","last_unstale":"2024-02-19T21:45:42.296045+0000","last_undegraded":"2024-02-19T21:45:42.296045+0000","last_fullsized":"2024-02-19T21:45:42.296045+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:33.758127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:40:33.758127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"199'13","reported_seq":276,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.022009+0000","last_change":"2024-02-19T21:45:05.721799+0000","last_active":"2024-02-19T21:45:47.022009+0000","last_peered":"2024-02-19T21:45:47.022009+0000","last_clean":"2024-02-19T21:45:47.022009+0000","last_became_active":"2024-02-19T21:42:04.195103+0000","last_became_peered":"2024-02-19T21:42:04.195103+0000","last_unstale":"2024-02-19T21:45:47.022009+0000","last_undegraded":"2024-02-19T21:45:47.022009+0000","last_fullsized":"2024-02-19T21:45:47.022009+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"199'13","last_scrub_stamp":"2024-02-19T21:45:05.721709+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:45:05.721709+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":306,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.329423+0000","last_change":"2024-02-19T21:45:20.157554+0000","last_active":"2024-02-19T21:45:47.329423+0000","last_peered":"2024-02-19T21:45:47.329423+0000","last_clean":"2024-02-19T21:45:47.329423+0000","last_became_active":"2024-02-19T21:32:23.361680+0000","last_became_peered":"2024-02-19T21:32:23.361680+0000","last_unstale":"2024-02-19T21:45:47.329423+0000","last_undegraded":"2024-02-19T21:45:47.329423+0000","last_fullsized":"2024-02-19T21:45:47.329423+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.157478+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"201'19","reported_seq":322,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.296668+0000","last_change":"2024-02-19T21:44:56.767033+0000","last_active":"2024-02-19T21:45:42.296668+0000","last_peered":"2024-02-19T21:45:42.296668+0000","last_clean":"2024-02-19T21:45:42.296668+0000","last_became_active":"2024-02-19T21:32:25.372206+0000","last_became_peered":"2024-02-19T21:32:25.372206+0000","last_unstale":"2024-02-19T21:45:42.296668+0000","last_undegraded":"2024-02-19T21:45:42.296668+0000","last_fullsized":"2024-02-19T21:45:42.296668+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:44:56.766950+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:44:56.766950+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":27,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.330343+0000","last_change":"2024-02-19T21:44:58.788818+0000","last_active":"2024-02-19T21:45:47.330343+0000","last_peered":"2024-02-19T21:45:47.330343+0000","last_clean":"2024-02-19T21:45:47.330343+0000","last_became_active":"2024-02-19T21:44:58.788519+0000","last_became_peered":"2024-02-19T21:44:58.788519+0000","last_unstale":"2024-02-19T21:45:47.330343+0000","last_undegraded":"2024-02-19T21:45:47.330343+0000","last_fullsized":"2024-02-19T21:45:47.330343+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:44:12.609170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":461,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.022625+0000","last_change":"2024-02-19T21:45:02.745748+0000","last_active":"2024-02-19T21:45:47.022625+0000","last_peered":"2024-02-19T21:45:47.022625+0000","last_clean":"2024-02-19T21:45:47.022625+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:45:47.022625+0000","last_undegraded":"2024-02-19T21:45:47.022625+0000","last_fullsized":"2024-02-19T21:45:47.022625+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:45:02.745649+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:45:02.745649+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":306,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.295725+0000","last_change":"2024-02-19T21:44:47.741002+0000","last_active":"2024-02-19T21:45:42.295725+0000","last_peered":"2024-02-19T21:45:42.295725+0000","last_clean":"2024-02-19T21:45:42.295725+0000","last_became_active":"2024-02-19T21:42:04.205401+0000","last_became_peered":"2024-02-19T21:42:04.205401+0000","last_unstale":"2024-02-19T21:45:42.295725+0000","last_undegraded":"2024-02-19T21:45:42.295725+0000","last_fullsized":"2024-02-19T21:45:42.295725+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:47.740904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:44:47.740904+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"201'25","reported_seq":326,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.298976+0000","last_change":"2024-02-19T21:44:57.633430+0000","last_active":"2024-02-19T21:45:42.298976+0000","last_peered":"2024-02-19T21:45:42.298976+0000","last_clean":"2024-02-19T21:45:42.298976+0000","last_became_active":"2024-02-19T21:32:25.372060+0000","last_became_peered":"2024-02-19T21:32:25.372060+0000","last_unstale":"2024-02-19T21:45:42.298976+0000","last_undegraded":"2024-02-19T21:45:42.298976+0000","last_fullsized":"2024-02-19T21:45:42.298976+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'25","last_scrub_stamp":"2024-02-19T21:44:57.633330+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:44:57.633330+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":292,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.288108+0000","last_change":"2024-02-19T21:45:05.670682+0000","last_active":"2024-02-19T21:45:42.288108+0000","last_peered":"2024-02-19T21:45:42.288108+0000","last_clean":"2024-02-19T21:45:42.288108+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:45:42.288108+0000","last_undegraded":"2024-02-19T21:45:42.288108+0000","last_fullsized":"2024-02-19T21:45:42.288108+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:05.670585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_clean_scrub_stamp":"2024-02-19T21:45:05.670585+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":294,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.297229+0000","last_change":"2024-02-19T21:44:52.148250+0000","last_active":"2024-02-19T21:45:42.297229+0000","last_peered":"2024-02-19T21:45:42.297229+0000","last_clean":"2024-02-19T21:45:42.297229+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:45:42.297229+0000","last_undegraded":"2024-02-19T21:45:42.297229+0000","last_fullsized":"2024-02-19T21:45:42.297229+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:52.148158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:52.148158+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"201'12","reported_seq":178,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.293475+0000","last_change":"2024-02-19T21:44:17.715721+0000","last_active":"2024-02-19T21:45:42.293475+0000","last_peered":"2024-02-19T21:45:42.293475+0000","last_clean":"2024-02-19T21:45:42.293475+0000","last_became_active":"2024-02-19T21:42:04.192291+0000","last_became_peered":"2024-02-19T21:42:04.192291+0000","last_unstale":"2024-02-19T21:45:42.293475+0000","last_undegraded":"2024-02-19T21:45:42.293475+0000","last_fullsized":"2024-02-19T21:45:42.293475+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'12","last_scrub_stamp":"2024-02-19T21:44:17.715652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:17.715652+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":177,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.299040+0000","last_change":"2024-02-19T21:44:11.584507+0000","last_active":"2024-02-19T21:45:42.299040+0000","last_peered":"2024-02-19T21:45:42.299040+0000","last_clean":"2024-02-19T21:45:42.299040+0000","last_became_active":"2024-02-19T21:39:39.469477+0000","last_became_peered":"2024-02-19T21:39:39.469477+0000","last_unstale":"2024-02-19T21:45:42.299040+0000","last_undegraded":"2024-02-19T21:45:42.299040+0000","last_fullsized":"2024-02-19T21:45:42.299040+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:11.584416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:44:11.584416+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":172,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.291653+0000","last_change":"2024-02-19T21:44:09.645675+0000","last_active":"2024-02-19T21:45:42.291653+0000","last_peered":"2024-02-19T21:45:42.291653+0000","last_clean":"2024-02-19T21:45:42.291653+0000","last_became_active":"2024-02-19T21:39:39.477308+0000","last_became_peered":"2024-02-19T21:39:39.477308+0000","last_unstale":"2024-02-19T21:45:42.291653+0000","last_undegraded":"2024-02-19T21:45:42.291653+0000","last_fullsized":"2024-02-19T21:45:42.291653+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:09.645607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:44:09.645607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"200'15","reported_seq":377,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.330572+0000","last_change":"2024-02-19T21:44:53.072845+0000","last_active":"2024-02-19T21:45:47.330572+0000","last_peered":"2024-02-19T21:45:47.330572+0000","last_clean":"2024-02-19T21:45:47.330572+0000","last_became_active":"2024-02-19T21:42:04.207069+0000","last_became_peered":"2024-02-19T21:42:04.207069+0000","last_unstale":"2024-02-19T21:45:47.330572+0000","last_undegraded":"2024-02-19T21:45:47.330572+0000","last_fullsized":"2024-02-19T21:45:47.330572+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:44:53.072746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:53.072746+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"321'7215","reported_seq":7276,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:50.070289+0000","last_change":"2024-02-19T21:44:16.113820+0000","last_active":"2024-02-19T21:45:50.070289+0000","last_peered":"2024-02-19T21:45:50.070289+0000","last_clean":"2024-02-19T21:45:50.070289+0000","last_became_active":"2024-02-19T21:44:16.113593+0000","last_became_peered":"2024-02-19T21:44:16.113593+0000","last_unstale":"2024-02-19T21:45:50.070289+0000","last_undegraded":"2024-02-19T21:45:50.070289+0000","last_fullsized":"2024-02-19T21:45:50.070289+0000","mapping_epoch":268,"log_start":"302'3200","ondisk_log_start":"302'3200","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4015,"ondisk_log_size":4015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":472842240,"num_objects":7215,"num_object_clones":0,"num_object_copies":21645,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7215,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7215,"num_write_kb":461760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":323,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.298976+0000","last_change":"2024-02-19T21:45:04.692907+0000","last_active":"2024-02-19T21:45:42.298976+0000","last_peered":"2024-02-19T21:45:42.298976+0000","last_clean":"2024-02-19T21:45:42.298976+0000","last_became_active":"2024-02-19T21:44:56.153136+0000","last_became_peered":"2024-02-19T21:44:56.153136+0000","last_unstale":"2024-02-19T21:45:42.298976+0000","last_undegraded":"2024-02-19T21:45:42.298976+0000","last_fullsized":"2024-02-19T21:45:42.298976+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:04.692807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.692807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"59'2","reported_seq":323,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.301555+0000","last_change":"2024-02-19T21:44:17.499729+0000","last_active":"2024-02-19T21:45:42.301555+0000","last_peered":"2024-02-19T21:45:42.301555+0000","last_clean":"2024-02-19T21:45:42.301555+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:45:42.301555+0000","last_undegraded":"2024-02-19T21:45:42.301555+0000","last_fullsized":"2024-02-19T21:45:42.301555+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-02-19T21:44:17.499663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:17.499663+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"200'23","reported_seq":335,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.291523+0000","last_change":"2024-02-19T21:45:20.561937+0000","last_active":"2024-02-19T21:45:42.291523+0000","last_peered":"2024-02-19T21:45:42.291523+0000","last_clean":"2024-02-19T21:45:42.291523+0000","last_became_active":"2024-02-19T21:38:31.247821+0000","last_became_peered":"2024-02-19T21:38:31.247821+0000","last_unstale":"2024-02-19T21:45:42.291523+0000","last_undegraded":"2024-02-19T21:45:42.291523+0000","last_fullsized":"2024-02-19T21:45:42.291523+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'23","last_scrub_stamp":"2024-02-19T21:45:20.561862+0000","last_deep_scrub":"83'17","last_deep_scrub_stamp":"2024-02-19T21:33:43.418450+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.561862+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":191,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.328859+0000","last_change":"2024-02-19T21:44:58.047618+0000","last_active":"2024-02-19T21:45:47.328859+0000","last_peered":"2024-02-19T21:45:47.328859+0000","last_clean":"2024-02-19T21:45:47.328859+0000","last_became_active":"2024-02-19T21:44:38.145122+0000","last_became_peered":"2024-02-19T21:44:38.145122+0000","last_unstale":"2024-02-19T21:45:47.328859+0000","last_undegraded":"2024-02-19T21:45:47.328859+0000","last_fullsized":"2024-02-19T21:45:47.328859+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:58.047556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:58.047556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"321'7185","reported_seq":7246,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:50.030770+0000","last_change":"2024-02-19T21:44:16.118671+0000","last_active":"2024-02-19T21:45:50.030770+0000","last_peered":"2024-02-19T21:45:50.030770+0000","last_clean":"2024-02-19T21:45:50.030770+0000","last_became_active":"2024-02-19T21:44:16.118362+0000","last_became_peered":"2024-02-19T21:44:16.118362+0000","last_unstale":"2024-02-19T21:45:50.030770+0000","last_undegraded":"2024-02-19T21:45:50.030770+0000","last_fullsized":"2024-02-19T21:45:50.030770+0000","mapping_epoch":268,"log_start":"301'3000","ondisk_log_start":"301'3000","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4185,"ondisk_log_size":4185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":470876160,"num_objects":7185,"num_object_clones":0,"num_object_copies":21555,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7185,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7185,"num_write_kb":459840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4],"acting":[5,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":318,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.328194+0000","last_change":"2024-02-19T21:45:22.180685+0000","last_active":"2024-02-19T21:45:47.328194+0000","last_peered":"2024-02-19T21:45:47.328194+0000","last_clean":"2024-02-19T21:45:47.328194+0000","last_became_active":"2024-02-19T21:41:42.245788+0000","last_became_peered":"2024-02-19T21:41:42.245788+0000","last_unstale":"2024-02-19T21:45:47.328194+0000","last_undegraded":"2024-02-19T21:45:47.328194+0000","last_fullsized":"2024-02-19T21:45:47.328194+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:22.180593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:45:22.180593+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":291,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.291966+0000","last_change":"2024-02-19T21:44:47.801856+0000","last_active":"2024-02-19T21:45:42.291966+0000","last_peered":"2024-02-19T21:45:42.291966+0000","last_clean":"2024-02-19T21:45:42.291966+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:45:42.291966+0000","last_undegraded":"2024-02-19T21:45:42.291966+0000","last_fullsized":"2024-02-19T21:45:42.291966+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:47.801768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:47.801768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"201'20","reported_seq":197,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.292599+0000","last_change":"2024-02-19T21:41:22.195267+0000","last_active":"2024-02-19T21:45:42.292599+0000","last_peered":"2024-02-19T21:45:42.292599+0000","last_clean":"2024-02-19T21:45:42.292599+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:45:42.292599+0000","last_undegraded":"2024-02-19T21:45:42.292599+0000","last_fullsized":"2024-02-19T21:45:42.292599+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'10","last_scrub_stamp":"2024-02-19T21:41:22.195164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:41:22.195164+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":464,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.329576+0000","last_change":"2024-02-19T21:45:07.122114+0000","last_active":"2024-02-19T21:45:47.329576+0000","last_peered":"2024-02-19T21:45:47.329576+0000","last_clean":"2024-02-19T21:45:47.329576+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:45:47.329576+0000","last_undegraded":"2024-02-19T21:45:47.329576+0000","last_fullsized":"2024-02-19T21:45:47.329576+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:45:07.121970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:07.121970+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"322'7312","reported_seq":7374,"reported_epoch":322,"state":"active+clean","last_fresh":"2024-02-19T21:45:50.282391+0000","last_change":"2024-02-19T21:44:16.117157+0000","last_active":"2024-02-19T21:45:50.282391+0000","last_peered":"2024-02-19T21:45:50.282391+0000","last_clean":"2024-02-19T21:45:50.282391+0000","last_became_active":"2024-02-19T21:44:16.116819+0000","last_became_peered":"2024-02-19T21:44:16.116819+0000","last_unstale":"2024-02-19T21:45:50.282391+0000","last_undegraded":"2024-02-19T21:45:50.282391+0000","last_fullsized":"2024-02-19T21:45:50.282391+0000","mapping_epoch":268,"log_start":"300'3000","ondisk_log_start":"300'3000","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4312,"ondisk_log_size":4312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":479199232,"num_objects":7312,"num_object_clones":0,"num_object_copies":21936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7312,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7312,"num_write_kb":467968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":235,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.299710+0000","last_change":"2024-02-19T21:45:02.186835+0000","last_active":"2024-02-19T21:45:42.299710+0000","last_peered":"2024-02-19T21:45:42.299710+0000","last_clean":"2024-02-19T21:45:42.299710+0000","last_became_active":"2024-02-19T21:44:56.149476+0000","last_became_peered":"2024-02-19T21:44:56.149476+0000","last_unstale":"2024-02-19T21:45:42.299710+0000","last_undegraded":"2024-02-19T21:45:42.299710+0000","last_fullsized":"2024-02-19T21:45:42.299710+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:02.186754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:45:02.186754+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":295,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.295796+0000","last_change":"2024-02-19T21:44:10.523394+0000","last_active":"2024-02-19T21:45:42.295796+0000","last_peered":"2024-02-19T21:45:42.295796+0000","last_clean":"2024-02-19T21:45:42.295796+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:45:42.295796+0000","last_undegraded":"2024-02-19T21:45:42.295796+0000","last_fullsized":"2024-02-19T21:45:42.295796+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:10.523331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:44:10.523331+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"201'43","reported_seq":610,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.022025+0000","last_change":"2024-02-19T21:45:04.755549+0000","last_active":"2024-02-19T21:45:47.022025+0000","last_peered":"2024-02-19T21:45:47.022025+0000","last_clean":"2024-02-19T21:45:47.022025+0000","last_became_active":"2024-02-19T21:42:04.196382+0000","last_became_peered":"2024-02-19T21:42:04.196382+0000","last_unstale":"2024-02-19T21:45:47.022025+0000","last_undegraded":"2024-02-19T21:45:47.022025+0000","last_fullsized":"2024-02-19T21:45:47.022025+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'43","last_scrub_stamp":"2024-02-19T21:45:04.755444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.755444+0000","log_size":43,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":1074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,5],"acting":[1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":288,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.330488+0000","last_change":"2024-02-19T21:44:02.217493+0000","last_active":"2024-02-19T21:45:47.330488+0000","last_peered":"2024-02-19T21:45:47.330488+0000","last_clean":"2024-02-19T21:45:47.330488+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:45:47.330488+0000","last_undegraded":"2024-02-19T21:45:47.330488+0000","last_fullsized":"2024-02-19T21:45:47.330488+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:02.217425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:02.217425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"321'7194","reported_seq":7254,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:50.018453+0000","last_change":"2024-02-19T21:44:16.122030+0000","last_active":"2024-02-19T21:45:50.018453+0000","last_peered":"2024-02-19T21:45:50.018453+0000","last_clean":"2024-02-19T21:45:50.018453+0000","last_became_active":"2024-02-19T21:44:16.121785+0000","last_became_peered":"2024-02-19T21:44:16.121785+0000","last_unstale":"2024-02-19T21:45:50.018453+0000","last_undegraded":"2024-02-19T21:45:50.018453+0000","last_fullsized":"2024-02-19T21:45:50.018453+0000","mapping_epoch":268,"log_start":"301'3000","ondisk_log_start":"301'3000","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4194,"ondisk_log_size":4194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":471465984,"num_objects":7194,"num_object_clones":0,"num_object_copies":21582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7194,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7194,"num_write_kb":460416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":288,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.288316+0000","last_change":"2024-02-19T21:45:17.575173+0000","last_active":"2024-02-19T21:45:42.288316+0000","last_peered":"2024-02-19T21:45:42.288316+0000","last_clean":"2024-02-19T21:45:42.288316+0000","last_became_active":"2024-02-19T21:32:29.597365+0000","last_became_peered":"2024-02-19T21:32:29.597365+0000","last_unstale":"2024-02-19T21:45:42.288316+0000","last_undegraded":"2024-02-19T21:45:42.288316+0000","last_fullsized":"2024-02-19T21:45:42.288316+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:17.575084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:45:17.575084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'6","reported_seq":1104,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:48.676061+0000","last_change":"2024-02-19T21:44:13.678401+0000","last_active":"2024-02-19T21:45:48.676061+0000","last_peered":"2024-02-19T21:45:48.676061+0000","last_clean":"2024-02-19T21:45:48.676061+0000","last_became_active":"2024-02-19T21:39:39.464361+0000","last_became_peered":"2024-02-19T21:39:39.464361+0000","last_unstale":"2024-02-19T21:45:48.676061+0000","last_undegraded":"2024-02-19T21:45:48.676061+0000","last_fullsized":"2024-02-19T21:45:48.676061+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_clean_scrub_stamp":"2024-02-19T21:44:13.678341+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":793,"num_read_kb":788,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":289,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.329120+0000","last_change":"2024-02-19T21:41:36.636023+0000","last_active":"2024-02-19T21:45:47.329120+0000","last_peered":"2024-02-19T21:45:47.329120+0000","last_clean":"2024-02-19T21:45:47.329120+0000","last_became_active":"2024-02-19T21:39:39.468113+0000","last_became_peered":"2024-02-19T21:39:39.468113+0000","last_unstale":"2024-02-19T21:45:47.329120+0000","last_undegraded":"2024-02-19T21:45:47.329120+0000","last_fullsized":"2024-02-19T21:45:47.329120+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:36.635936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:41:36.635936+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"200'17","reported_seq":348,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.293422+0000","last_change":"2024-02-19T21:44:00.545486+0000","last_active":"2024-02-19T21:45:42.293422+0000","last_peered":"2024-02-19T21:45:42.293422+0000","last_clean":"2024-02-19T21:45:42.293422+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:45:42.293422+0000","last_undegraded":"2024-02-19T21:45:42.293422+0000","last_fullsized":"2024-02-19T21:45:42.293422+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'17","last_scrub_stamp":"2024-02-19T21:44:00.545415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:00.545415+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":25,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":195,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.296723+0000","last_change":"2024-02-19T21:45:10.871326+0000","last_active":"2024-02-19T21:45:42.296723+0000","last_peered":"2024-02-19T21:45:42.296723+0000","last_clean":"2024-02-19T21:45:42.296723+0000","last_became_active":"2024-02-19T21:44:46.148156+0000","last_became_peered":"2024-02-19T21:44:46.148156+0000","last_unstale":"2024-02-19T21:45:42.296723+0000","last_undegraded":"2024-02-19T21:45:42.296723+0000","last_fullsized":"2024-02-19T21:45:42.296723+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":299,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:10.871111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:10.871111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"322'7294","reported_seq":7356,"reported_epoch":322,"state":"active+clean","last_fresh":"2024-02-19T21:45:50.258447+0000","last_change":"2024-02-19T21:44:16.115922+0000","last_active":"2024-02-19T21:45:50.258447+0000","last_peered":"2024-02-19T21:45:50.258447+0000","last_clean":"2024-02-19T21:45:50.258447+0000","last_became_active":"2024-02-19T21:44:16.115625+0000","last_became_peered":"2024-02-19T21:44:16.115625+0000","last_unstale":"2024-02-19T21:45:50.258447+0000","last_undegraded":"2024-02-19T21:45:50.258447+0000","last_fullsized":"2024-02-19T21:45:50.258447+0000","mapping_epoch":268,"log_start":"300'3000","ondisk_log_start":"300'3000","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4294,"ondisk_log_size":4294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":478019584,"num_objects":7294,"num_object_clones":0,"num_object_copies":21882,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7294,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7294,"num_write_kb":466816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":311,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.297052+0000","last_change":"2024-02-19T21:44:56.157521+0000","last_active":"2024-02-19T21:45:42.297052+0000","last_peered":"2024-02-19T21:45:42.297052+0000","last_clean":"2024-02-19T21:45:42.297052+0000","last_became_active":"2024-02-19T21:44:56.157241+0000","last_became_peered":"2024-02-19T21:44:56.157241+0000","last_unstale":"2024-02-19T21:45:42.297052+0000","last_undegraded":"2024-02-19T21:45:42.297052+0000","last_fullsized":"2024-02-19T21:45:42.297052+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:33.758127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:40:33.758127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":198,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.295920+0000","last_change":"2024-02-19T21:45:04.833554+0000","last_active":"2024-02-19T21:45:42.295920+0000","last_peered":"2024-02-19T21:45:42.295920+0000","last_clean":"2024-02-19T21:45:42.295920+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:45:42.295920+0000","last_undegraded":"2024-02-19T21:45:42.295920+0000","last_fullsized":"2024-02-19T21:45:42.295920+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:04.833413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.833413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":313,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.295699+0000","last_change":"2024-02-19T21:45:07.901315+0000","last_active":"2024-02-19T21:45:42.295699+0000","last_peered":"2024-02-19T21:45:42.295699+0000","last_clean":"2024-02-19T21:45:42.295699+0000","last_became_active":"2024-02-19T21:42:04.212730+0000","last_became_peered":"2024-02-19T21:42:04.212730+0000","last_unstale":"2024-02-19T21:45:42.295699+0000","last_undegraded":"2024-02-19T21:45:42.295699+0000","last_fullsized":"2024-02-19T21:45:42.295699+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:07.901205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:07.901205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":177,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.328401+0000","last_change":"2024-02-19T21:45:16.190287+0000","last_active":"2024-02-19T21:45:47.328401+0000","last_peered":"2024-02-19T21:45:47.328401+0000","last_clean":"2024-02-19T21:45:47.328401+0000","last_became_active":"2024-02-19T21:42:04.196943+0000","last_became_peered":"2024-02-19T21:42:04.196943+0000","last_unstale":"2024-02-19T21:45:47.328401+0000","last_undegraded":"2024-02-19T21:45:47.328401+0000","last_fullsized":"2024-02-19T21:45:47.328401+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.190177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.190177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,1],"acting":[0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"201'33","reported_seq":339,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.302907+0000","last_change":"2024-02-19T21:44:55.061721+0000","last_active":"2024-02-19T21:45:42.302907+0000","last_peered":"2024-02-19T21:45:42.302907+0000","last_clean":"2024-02-19T21:45:42.302907+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:45:42.302907+0000","last_undegraded":"2024-02-19T21:45:42.302907+0000","last_fullsized":"2024-02-19T21:45:42.302907+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'33","last_scrub_stamp":"2024-02-19T21:44:55.061625+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:44:55.061625+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":266,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.296101+0000","last_change":"2024-02-19T21:44:57.754550+0000","last_active":"2024-02-19T21:45:42.296101+0000","last_peered":"2024-02-19T21:45:42.296101+0000","last_clean":"2024-02-19T21:45:42.296101+0000","last_became_active":"2024-02-19T21:42:04.205342+0000","last_became_peered":"2024-02-19T21:42:04.205342+0000","last_unstale":"2024-02-19T21:45:42.296101+0000","last_undegraded":"2024-02-19T21:45:42.296101+0000","last_fullsized":"2024-02-19T21:45:42.296101+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:57.754453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:57.754453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"322'6992","reported_seq":7054,"reported_epoch":322,"state":"active+clean","last_fresh":"2024-02-19T21:45:50.280241+0000","last_change":"2024-02-19T21:44:16.117097+0000","last_active":"2024-02-19T21:45:50.280241+0000","last_peered":"2024-02-19T21:45:50.280241+0000","last_clean":"2024-02-19T21:45:50.280241+0000","last_became_active":"2024-02-19T21:44:16.116833+0000","last_became_peered":"2024-02-19T21:44:16.116833+0000","last_unstale":"2024-02-19T21:45:50.280241+0000","last_undegraded":"2024-02-19T21:45:50.280241+0000","last_fullsized":"2024-02-19T21:45:50.280241+0000","mapping_epoch":268,"log_start":"300'2700","ondisk_log_start":"300'2700","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4292,"ondisk_log_size":4292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":458227712,"num_objects":6992,"num_object_clones":0,"num_object_copies":20976,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6992,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6992,"num_write_kb":447488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":294,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.723650+0000","last_change":"2024-02-19T21:45:47.723650+0000","last_active":"2024-02-19T21:45:47.723650+0000","last_peered":"2024-02-19T21:45:47.723650+0000","last_clean":"2024-02-19T21:45:47.723650+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:45:47.723650+0000","last_undegraded":"2024-02-19T21:45:47.723650+0000","last_fullsized":"2024-02-19T21:45:47.723650+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.723550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.723550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":301,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.329250+0000","last_change":"2024-02-19T21:41:22.644476+0000","last_active":"2024-02-19T21:45:47.329250+0000","last_peered":"2024-02-19T21:45:47.329250+0000","last_clean":"2024-02-19T21:45:47.329250+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:45:47.329250+0000","last_undegraded":"2024-02-19T21:45:47.329250+0000","last_fullsized":"2024-02-19T21:45:47.329250+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:22.644405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:41:22.644405+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":313,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.287641+0000","last_change":"2024-02-19T21:44:05.032411+0000","last_active":"2024-02-19T21:45:42.287641+0000","last_peered":"2024-02-19T21:45:42.287641+0000","last_clean":"2024-02-19T21:45:42.287641+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:45:42.287641+0000","last_undegraded":"2024-02-19T21:45:42.287641+0000","last_fullsized":"2024-02-19T21:45:42.287641+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:05.032330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:05.032330+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"200'24","reported_seq":401,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.330484+0000","last_change":"2024-02-19T21:44:01.262696+0000","last_active":"2024-02-19T21:45:47.330484+0000","last_peered":"2024-02-19T21:45:47.330484+0000","last_clean":"2024-02-19T21:45:47.330484+0000","last_became_active":"2024-02-19T21:42:04.206790+0000","last_became_peered":"2024-02-19T21:42:04.206790+0000","last_unstale":"2024-02-19T21:45:47.330484+0000","last_undegraded":"2024-02-19T21:45:47.330484+0000","last_fullsized":"2024-02-19T21:45:47.330484+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'24","last_scrub_stamp":"2024-02-19T21:44:01.262618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:01.262618+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":309,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.297009+0000","last_change":"2024-02-19T21:45:09.918263+0000","last_active":"2024-02-19T21:45:42.297009+0000","last_peered":"2024-02-19T21:45:42.297009+0000","last_clean":"2024-02-19T21:45:42.297009+0000","last_became_active":"2024-02-19T21:44:42.624782+0000","last_became_peered":"2024-02-19T21:44:42.624782+0000","last_unstale":"2024-02-19T21:45:42.297009+0000","last_undegraded":"2024-02-19T21:45:42.297009+0000","last_fullsized":"2024-02-19T21:45:42.297009+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":295,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_clean_scrub_stamp":"2024-02-19T21:45:09.918170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.e","version":"321'7145","reported_seq":7204,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:50.020757+0000","last_change":"2024-02-19T21:44:16.118980+0000","last_active":"2024-02-19T21:45:50.020757+0000","last_peered":"2024-02-19T21:45:50.020757+0000","last_clean":"2024-02-19T21:45:50.020757+0000","last_became_active":"2024-02-19T21:44:16.118651+0000","last_became_peered":"2024-02-19T21:44:16.118651+0000","last_unstale":"2024-02-19T21:45:50.020757+0000","last_undegraded":"2024-02-19T21:45:50.020757+0000","last_fullsized":"2024-02-19T21:45:50.020757+0000","mapping_epoch":268,"log_start":"299'2200","ondisk_log_start":"299'2200","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4945,"ondisk_log_size":4945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":468254720,"num_objects":7145,"num_object_clones":0,"num_object_copies":21435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7145,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7145,"num_write_kb":457280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":303,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.291609+0000","last_change":"2024-02-19T21:44:55.803955+0000","last_active":"2024-02-19T21:45:42.291609+0000","last_peered":"2024-02-19T21:45:42.291609+0000","last_clean":"2024-02-19T21:45:42.291609+0000","last_became_active":"2024-02-19T21:42:04.193058+0000","last_became_peered":"2024-02-19T21:42:04.193058+0000","last_unstale":"2024-02-19T21:45:42.291609+0000","last_undegraded":"2024-02-19T21:45:42.291609+0000","last_fullsized":"2024-02-19T21:45:42.291609+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:55.803876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:44:55.803876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":289,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.288383+0000","last_change":"2024-02-19T21:44:50.478790+0000","last_active":"2024-02-19T21:45:42.288383+0000","last_peered":"2024-02-19T21:45:42.288383+0000","last_clean":"2024-02-19T21:45:42.288383+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:45:42.288383+0000","last_undegraded":"2024-02-19T21:45:42.288383+0000","last_fullsized":"2024-02-19T21:45:42.288383+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:50.478689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:50.478689+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"201'37","reported_seq":354,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.329354+0000","last_change":"2024-02-19T21:45:14.173212+0000","last_active":"2024-02-19T21:45:47.329354+0000","last_peered":"2024-02-19T21:45:47.329354+0000","last_clean":"2024-02-19T21:45:47.329354+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:45:47.329354+0000","last_undegraded":"2024-02-19T21:45:47.329354+0000","last_fullsized":"2024-02-19T21:45:47.329354+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'37","last_scrub_stamp":"2024-02-19T21:45:14.173134+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:45:14.173134+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":292,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.298417+0000","last_change":"2024-02-19T21:44:49.260785+0000","last_active":"2024-02-19T21:45:42.298417+0000","last_peered":"2024-02-19T21:45:42.298417+0000","last_clean":"2024-02-19T21:45:42.298417+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:45:42.298417+0000","last_undegraded":"2024-02-19T21:45:42.298417+0000","last_fullsized":"2024-02-19T21:45:42.298417+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:49.260690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:44:49.260690+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"321'7277","reported_seq":7338,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:50.038851+0000","last_change":"2024-02-19T21:44:16.121994+0000","last_active":"2024-02-19T21:45:50.038851+0000","last_peered":"2024-02-19T21:45:50.038851+0000","last_clean":"2024-02-19T21:45:50.038851+0000","last_became_active":"2024-02-19T21:44:16.121703+0000","last_became_peered":"2024-02-19T21:44:16.121703+0000","last_unstale":"2024-02-19T21:45:50.038851+0000","last_undegraded":"2024-02-19T21:45:50.038851+0000","last_fullsized":"2024-02-19T21:45:50.038851+0000","mapping_epoch":268,"log_start":"303'3200","ondisk_log_start":"303'3200","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4077,"ondisk_log_size":4077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":476905472,"num_objects":7277,"num_object_clones":0,"num_object_copies":21831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7277,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7277,"num_write_kb":465728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":191,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.298021+0000","last_change":"2024-02-19T21:44:08.281049+0000","last_active":"2024-02-19T21:45:42.298021+0000","last_peered":"2024-02-19T21:45:42.298021+0000","last_clean":"2024-02-19T21:45:42.298021+0000","last_became_active":"2024-02-19T21:42:04.200292+0000","last_became_peered":"2024-02-19T21:42:04.200292+0000","last_unstale":"2024-02-19T21:45:42.298021+0000","last_undegraded":"2024-02-19T21:45:42.298021+0000","last_fullsized":"2024-02-19T21:45:42.298021+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:08.280938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:44:08.280938+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,5],"acting":[6,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":293,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.293439+0000","last_change":"2024-02-19T21:44:14.690800+0000","last_active":"2024-02-19T21:45:42.293439+0000","last_peered":"2024-02-19T21:45:42.293439+0000","last_clean":"2024-02-19T21:45:42.293439+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:45:42.293439+0000","last_undegraded":"2024-02-19T21:45:42.293439+0000","last_fullsized":"2024-02-19T21:45:42.293439+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:14.690736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:44:14.690736+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"201'38","reported_seq":275,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.328537+0000","last_change":"2024-02-19T21:45:05.077354+0000","last_active":"2024-02-19T21:45:47.328537+0000","last_peered":"2024-02-19T21:45:47.328537+0000","last_clean":"2024-02-19T21:45:47.328537+0000","last_became_active":"2024-02-19T21:42:04.205907+0000","last_became_peered":"2024-02-19T21:42:04.205907+0000","last_unstale":"2024-02-19T21:45:47.328537+0000","last_undegraded":"2024-02-19T21:45:47.328537+0000","last_fullsized":"2024-02-19T21:45:47.328537+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'38","last_scrub_stamp":"2024-02-19T21:45:05.077057+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:45:05.077057+0000","log_size":38,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":179,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.297402+0000","last_change":"2024-02-19T21:45:20.935817+0000","last_active":"2024-02-19T21:45:42.297402+0000","last_peered":"2024-02-19T21:45:42.297402+0000","last_clean":"2024-02-19T21:45:42.297402+0000","last_became_active":"2024-02-19T21:42:04.200496+0000","last_became_peered":"2024-02-19T21:42:04.200496+0000","last_unstale":"2024-02-19T21:45:42.297402+0000","last_undegraded":"2024-02-19T21:45:42.297402+0000","last_fullsized":"2024-02-19T21:45:42.297402+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:20.935723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.935723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"321'7204","reported_seq":7264,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:49.969396+0000","last_change":"2024-02-19T21:44:16.118900+0000","last_active":"2024-02-19T21:45:49.969396+0000","last_peered":"2024-02-19T21:45:49.969396+0000","last_clean":"2024-02-19T21:45:49.969396+0000","last_became_active":"2024-02-19T21:44:16.118628+0000","last_became_peered":"2024-02-19T21:44:16.118628+0000","last_unstale":"2024-02-19T21:45:49.969396+0000","last_undegraded":"2024-02-19T21:45:49.969396+0000","last_fullsized":"2024-02-19T21:45:49.969396+0000","mapping_epoch":268,"log_start":"0'0","ondisk_log_start":"0'0","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":7204,"ondisk_log_size":7204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":472121344,"num_objects":7204,"num_object_clones":0,"num_object_copies":21612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7204,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7204,"num_write_kb":461056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":299,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.288021+0000","last_change":"2024-02-19T21:44:59.685042+0000","last_active":"2024-02-19T21:45:42.288021+0000","last_peered":"2024-02-19T21:45:42.288021+0000","last_clean":"2024-02-19T21:45:42.288021+0000","last_became_active":"2024-02-19T21:39:39.481908+0000","last_became_peered":"2024-02-19T21:39:39.481908+0000","last_unstale":"2024-02-19T21:45:42.288021+0000","last_undegraded":"2024-02-19T21:45:42.288021+0000","last_fullsized":"2024-02-19T21:45:42.288021+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:59.684971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:44:59.684971+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":312,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.302888+0000","last_change":"2024-02-19T21:45:12.972456+0000","last_active":"2024-02-19T21:45:42.302888+0000","last_peered":"2024-02-19T21:45:42.302888+0000","last_clean":"2024-02-19T21:45:42.302888+0000","last_became_active":"2024-02-19T21:42:04.197048+0000","last_became_peered":"2024-02-19T21:42:04.197048+0000","last_unstale":"2024-02-19T21:45:42.302888+0000","last_undegraded":"2024-02-19T21:45:42.302888+0000","last_fullsized":"2024-02-19T21:45:42.302888+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.972369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.972369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"201'28","reported_seq":304,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.293570+0000","last_change":"2024-02-19T21:41:31.580765+0000","last_active":"2024-02-19T21:45:42.293570+0000","last_peered":"2024-02-19T21:45:42.293570+0000","last_clean":"2024-02-19T21:45:42.293570+0000","last_became_active":"2024-02-19T21:35:14.513806+0000","last_became_peered":"2024-02-19T21:35:14.513806+0000","last_unstale":"2024-02-19T21:45:42.293570+0000","last_undegraded":"2024-02-19T21:45:42.293570+0000","last_fullsized":"2024-02-19T21:45:42.293570+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'14","last_scrub_stamp":"2024-02-19T21:41:31.580701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:41:31.580701+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":34,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":312,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.022014+0000","last_change":"2024-02-19T21:41:30.192537+0000","last_active":"2024-02-19T21:45:47.022014+0000","last_peered":"2024-02-19T21:45:47.022014+0000","last_clean":"2024-02-19T21:45:47.022014+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:45:47.022014+0000","last_undegraded":"2024-02-19T21:45:47.022014+0000","last_fullsized":"2024-02-19T21:45:47.022014+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'9","last_scrub_stamp":"2024-02-19T21:41:30.192427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:41:30.192427+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"321'7251","reported_seq":7312,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:50.027077+0000","last_change":"2024-02-19T21:44:16.122360+0000","last_active":"2024-02-19T21:45:50.027077+0000","last_peered":"2024-02-19T21:45:50.027077+0000","last_clean":"2024-02-19T21:45:50.027077+0000","last_became_active":"2024-02-19T21:44:16.122083+0000","last_became_peered":"2024-02-19T21:44:16.122083+0000","last_unstale":"2024-02-19T21:45:50.027077+0000","last_undegraded":"2024-02-19T21:45:50.027077+0000","last_fullsized":"2024-02-19T21:45:50.027077+0000","mapping_epoch":268,"log_start":"302'3200","ondisk_log_start":"302'3200","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4051,"ondisk_log_size":4051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":475201536,"num_objects":7251,"num_object_clones":0,"num_object_copies":21753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7251,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7251,"num_write_kb":464064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"66'1","reported_seq":201,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.302794+0000","last_change":"2024-02-19T21:44:56.167353+0000","last_active":"2024-02-19T21:45:42.302794+0000","last_peered":"2024-02-19T21:45:42.302794+0000","last_clean":"2024-02-19T21:45:42.302794+0000","last_became_active":"2024-02-19T21:44:56.166670+0000","last_became_peered":"2024-02-19T21:44:56.166670+0000","last_unstale":"2024-02-19T21:45:42.302794+0000","last_undegraded":"2024-02-19T21:45:42.302794+0000","last_fullsized":"2024-02-19T21:45:42.302794+0000","mapping_epoch":165,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:44:54.104918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:44:54.104918+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"261'11","reported_seq":330,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.021325+0000","last_change":"2024-02-19T21:45:01.716882+0000","last_active":"2024-02-19T21:45:47.021325+0000","last_peered":"2024-02-19T21:45:47.021325+0000","last_clean":"2024-02-19T21:45:47.021325+0000","last_became_active":"2024-02-19T21:44:08.123392+0000","last_became_peered":"2024-02-19T21:44:08.123392+0000","last_unstale":"2024-02-19T21:45:47.021325+0000","last_undegraded":"2024-02-19T21:45:47.021325+0000","last_fullsized":"2024-02-19T21:45:47.021325+0000","mapping_epoch":62,"log_start":"257'10","ondisk_log_start":"257'10","created":62,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-02-19T21:45:01.716817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.716817+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":301,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.287719+0000","last_change":"2024-02-19T21:45:08.496668+0000","last_active":"2024-02-19T21:45:42.287719+0000","last_peered":"2024-02-19T21:45:42.287719+0000","last_clean":"2024-02-19T21:45:42.287719+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:45:42.287719+0000","last_undegraded":"2024-02-19T21:45:42.287719+0000","last_fullsized":"2024-02-19T21:45:42.287719+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:45:08.496566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:08.496566+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"201'19","reported_seq":318,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.303271+0000","last_change":"2024-02-19T21:44:58.015612+0000","last_active":"2024-02-19T21:45:42.303271+0000","last_peered":"2024-02-19T21:45:42.303271+0000","last_clean":"2024-02-19T21:45:42.303271+0000","last_became_active":"2024-02-19T21:39:51.536649+0000","last_became_peered":"2024-02-19T21:39:51.536649+0000","last_unstale":"2024-02-19T21:45:42.303271+0000","last_undegraded":"2024-02-19T21:45:42.303271+0000","last_fullsized":"2024-02-19T21:45:42.303271+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:44:58.015506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:58.015506+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2","version":"321'7202","reported_seq":7263,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:50.072951+0000","last_change":"2024-02-19T21:44:16.115513+0000","last_active":"2024-02-19T21:45:50.072951+0000","last_peered":"2024-02-19T21:45:50.072951+0000","last_clean":"2024-02-19T21:45:50.072951+0000","last_became_active":"2024-02-19T21:44:16.115219+0000","last_became_peered":"2024-02-19T21:44:16.115219+0000","last_unstale":"2024-02-19T21:45:50.072951+0000","last_undegraded":"2024-02-19T21:45:50.072951+0000","last_fullsized":"2024-02-19T21:45:50.072951+0000","mapping_epoch":268,"log_start":"303'3200","ondisk_log_start":"303'3200","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4002,"ondisk_log_size":4002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":471990272,"num_objects":7202,"num_object_clones":0,"num_object_copies":21606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7202,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7202,"num_write_kb":460928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,6],"acting":[1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":311,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.296931+0000","last_change":"2024-02-19T21:44:56.155568+0000","last_active":"2024-02-19T21:45:42.296931+0000","last_peered":"2024-02-19T21:45:42.296931+0000","last_clean":"2024-02-19T21:45:42.296931+0000","last_became_active":"2024-02-19T21:44:56.155194+0000","last_became_peered":"2024-02-19T21:44:56.155194+0000","last_unstale":"2024-02-19T21:45:42.296931+0000","last_undegraded":"2024-02-19T21:45:42.296931+0000","last_fullsized":"2024-02-19T21:45:42.296931+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:16.845272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:40:16.845272+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"265'11","reported_seq":427,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.021336+0000","last_change":"2024-02-19T21:45:15.802207+0000","last_active":"2024-02-19T21:45:47.021336+0000","last_peered":"2024-02-19T21:45:47.021336+0000","last_clean":"2024-02-19T21:45:47.021336+0000","last_became_active":"2024-02-19T21:44:12.205049+0000","last_became_peered":"2024-02-19T21:44:12.205049+0000","last_unstale":"2024-02-19T21:45:47.021336+0000","last_undegraded":"2024-02-19T21:45:47.021336+0000","last_fullsized":"2024-02-19T21:45:47.021336+0000","mapping_epoch":97,"log_start":"98'9","ondisk_log_start":"98'9","created":62,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'11","last_scrub_stamp":"2024-02-19T21:45:15.802126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:15.802126+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":296,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.291563+0000","last_change":"2024-02-19T21:45:16.700970+0000","last_active":"2024-02-19T21:45:42.291563+0000","last_peered":"2024-02-19T21:45:42.291563+0000","last_clean":"2024-02-19T21:45:42.291563+0000","last_became_active":"2024-02-19T21:32:23.362738+0000","last_became_peered":"2024-02-19T21:32:23.362738+0000","last_unstale":"2024-02-19T21:45:42.291563+0000","last_undegraded":"2024-02-19T21:45:42.291563+0000","last_fullsized":"2024-02-19T21:45:42.291563+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.700887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.700887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"270'34","reported_seq":212,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.296728+0000","last_change":"2024-02-19T21:44:17.451246+0000","last_active":"2024-02-19T21:45:42.296728+0000","last_peered":"2024-02-19T21:45:42.296728+0000","last_clean":"2024-02-19T21:45:42.296728+0000","last_became_active":"2024-02-19T21:39:51.539230+0000","last_became_peered":"2024-02-19T21:39:51.539230+0000","last_unstale":"2024-02-19T21:45:42.296728+0000","last_undegraded":"2024-02-19T21:45:42.296728+0000","last_fullsized":"2024-02-19T21:45:42.296728+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"270'34","last_scrub_stamp":"2024-02-19T21:44:17.451151+0000","last_deep_scrub":"270'34","last_deep_scrub_stamp":"2024-02-19T21:44:17.451151+0000","last_clean_scrub_stamp":"2024-02-19T21:44:17.451151+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"321'7149","reported_seq":7208,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:50.012838+0000","last_change":"2024-02-19T21:44:16.116710+0000","last_active":"2024-02-19T21:45:50.012838+0000","last_peered":"2024-02-19T21:45:50.012838+0000","last_clean":"2024-02-19T21:45:50.012838+0000","last_became_active":"2024-02-19T21:44:16.116428+0000","last_became_peered":"2024-02-19T21:44:16.116428+0000","last_unstale":"2024-02-19T21:45:50.012838+0000","last_undegraded":"2024-02-19T21:45:50.012838+0000","last_fullsized":"2024-02-19T21:45:50.012838+0000","mapping_epoch":268,"log_start":"0'0","ondisk_log_start":"0'0","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":7149,"ondisk_log_size":7149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":468516864,"num_objects":7149,"num_object_clones":0,"num_object_copies":21447,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7149,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7149,"num_write_kb":457536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4],"acting":[3,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":281,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.293646+0000","last_change":"2024-02-19T21:44:56.140705+0000","last_active":"2024-02-19T21:45:42.293646+0000","last_peered":"2024-02-19T21:45:42.293646+0000","last_clean":"2024-02-19T21:45:42.293646+0000","last_became_active":"2024-02-19T21:44:56.140445+0000","last_became_peered":"2024-02-19T21:44:56.140445+0000","last_unstale":"2024-02-19T21:45:42.293646+0000","last_undegraded":"2024-02-19T21:45:42.293646+0000","last_fullsized":"2024-02-19T21:45:42.293646+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:40.015907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:40.015907+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"271'13","reported_seq":353,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.020912+0000","last_change":"2024-02-19T21:44:48.478051+0000","last_active":"2024-02-19T21:45:47.020912+0000","last_peered":"2024-02-19T21:45:47.020912+0000","last_clean":"2024-02-19T21:45:47.020912+0000","last_became_active":"2024-02-19T21:44:18.115023+0000","last_became_peered":"2024-02-19T21:44:18.115023+0000","last_unstale":"2024-02-19T21:45:47.020912+0000","last_undegraded":"2024-02-19T21:45:47.020912+0000","last_fullsized":"2024-02-19T21:45:47.020912+0000","mapping_epoch":266,"log_start":"170'11","ondisk_log_start":"170'11","created":62,"last_epoch_clean":271,"parent":"0.0","parent_split_bits":0,"last_scrub":"271'13","last_scrub_stamp":"2024-02-19T21:44:48.477958+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:44:48.477958+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":293,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.292543+0000","last_change":"2024-02-19T21:45:00.765546+0000","last_active":"2024-02-19T21:45:42.292543+0000","last_peered":"2024-02-19T21:45:42.292543+0000","last_clean":"2024-02-19T21:45:42.292543+0000","last_became_active":"2024-02-19T21:32:23.363155+0000","last_became_peered":"2024-02-19T21:32:23.363155+0000","last_unstale":"2024-02-19T21:45:42.292543+0000","last_undegraded":"2024-02-19T21:45:42.292543+0000","last_fullsized":"2024-02-19T21:45:42.292543+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:00.765453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:45:00.765453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"200'20","reported_seq":295,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.299054+0000","last_change":"2024-02-19T21:45:01.568565+0000","last_active":"2024-02-19T21:45:42.299054+0000","last_peered":"2024-02-19T21:45:42.299054+0000","last_clean":"2024-02-19T21:45:42.299054+0000","last_became_active":"2024-02-19T21:35:14.514968+0000","last_became_peered":"2024-02-19T21:35:14.514968+0000","last_unstale":"2024-02-19T21:45:42.299054+0000","last_undegraded":"2024-02-19T21:45:42.299054+0000","last_fullsized":"2024-02-19T21:45:42.299054+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'20","last_scrub_stamp":"2024-02-19T21:45:01.568503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.568503+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6],"acting":[3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"321'7168","reported_seq":7229,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:50.064886+0000","last_change":"2024-02-19T21:44:16.117207+0000","last_active":"2024-02-19T21:45:50.064886+0000","last_peered":"2024-02-19T21:45:50.064886+0000","last_clean":"2024-02-19T21:45:50.064886+0000","last_became_active":"2024-02-19T21:44:16.116913+0000","last_became_peered":"2024-02-19T21:44:16.116913+0000","last_unstale":"2024-02-19T21:45:50.064886+0000","last_undegraded":"2024-02-19T21:45:50.064886+0000","last_fullsized":"2024-02-19T21:45:50.064886+0000","mapping_epoch":268,"log_start":"302'3100","ondisk_log_start":"302'3100","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4068,"ondisk_log_size":4068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":469762048,"num_objects":7168,"num_object_clones":0,"num_object_copies":21504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7168,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":65,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.330244+0000","last_change":"2024-02-19T21:44:56.152950+0000","last_active":"2024-02-19T21:45:47.330244+0000","last_peered":"2024-02-19T21:45:47.330244+0000","last_clean":"2024-02-19T21:45:47.330244+0000","last_became_active":"2024-02-19T21:44:56.152672+0000","last_became_peered":"2024-02-19T21:44:56.152672+0000","last_unstale":"2024-02-19T21:45:47.330244+0000","last_undegraded":"2024-02-19T21:45:47.330244+0000","last_fullsized":"2024-02-19T21:45:47.330244+0000","mapping_epoch":275,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:41:36.725664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:41:36.725664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,1],"acting":[0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":305,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.293047+0000","last_change":"2024-02-19T21:45:01.798485+0000","last_active":"2024-02-19T21:45:42.293047+0000","last_peered":"2024-02-19T21:45:42.293047+0000","last_clean":"2024-02-19T21:45:42.293047+0000","last_became_active":"2024-02-19T21:44:22.245925+0000","last_became_peered":"2024-02-19T21:44:22.245925+0000","last_unstale":"2024-02-19T21:45:42.293047+0000","last_undegraded":"2024-02-19T21:45:42.293047+0000","last_fullsized":"2024-02-19T21:45:42.293047+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:01.798387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.798387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":296,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.287890+0000","last_change":"2024-02-19T21:44:51.468813+0000","last_active":"2024-02-19T21:45:42.287890+0000","last_peered":"2024-02-19T21:45:42.287890+0000","last_clean":"2024-02-19T21:45:42.287890+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:45:42.287890+0000","last_undegraded":"2024-02-19T21:45:42.287890+0000","last_fullsized":"2024-02-19T21:45:42.287890+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:51.468731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:44:51.468731+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"201'31","reported_seq":251,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.293866+0000","last_change":"2024-02-19T21:44:11.728491+0000","last_active":"2024-02-19T21:45:42.293866+0000","last_peered":"2024-02-19T21:45:42.293866+0000","last_clean":"2024-02-19T21:45:42.293866+0000","last_became_active":"2024-02-19T21:39:39.474668+0000","last_became_peered":"2024-02-19T21:39:39.474668+0000","last_unstale":"2024-02-19T21:45:42.293866+0000","last_undegraded":"2024-02-19T21:45:42.293866+0000","last_fullsized":"2024-02-19T21:45:42.293866+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'31","last_scrub_stamp":"2024-02-19T21:44:11.728412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:11.728412+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":49,"num_read_kb":39,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"321'7246","reported_seq":7307,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:50.037306+0000","last_change":"2024-02-19T21:44:16.117971+0000","last_active":"2024-02-19T21:45:50.037306+0000","last_peered":"2024-02-19T21:45:50.037306+0000","last_clean":"2024-02-19T21:45:50.037306+0000","last_became_active":"2024-02-19T21:44:16.117603+0000","last_became_peered":"2024-02-19T21:44:16.117603+0000","last_unstale":"2024-02-19T21:45:50.037306+0000","last_undegraded":"2024-02-19T21:45:50.037306+0000","last_fullsized":"2024-02-19T21:45:50.037306+0000","mapping_epoch":268,"log_start":"301'3100","ondisk_log_start":"301'3100","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":474873856,"num_objects":7246,"num_object_clones":0,"num_object_copies":21738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7246,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7246,"num_write_kb":463744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"66'1","reported_seq":289,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.298500+0000","last_change":"2024-02-19T21:45:03.607205+0000","last_active":"2024-02-19T21:45:42.298500+0000","last_peered":"2024-02-19T21:45:42.298500+0000","last_clean":"2024-02-19T21:45:42.298500+0000","last_became_active":"2024-02-19T21:44:56.145343+0000","last_became_peered":"2024-02-19T21:44:56.145343+0000","last_unstale":"2024-02-19T21:45:42.298500+0000","last_undegraded":"2024-02-19T21:45:42.298500+0000","last_fullsized":"2024-02-19T21:45:42.298500+0000","mapping_epoch":197,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:45:03.607112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:45:03.607112+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":205,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.329281+0000","last_change":"2024-02-19T21:45:12.163918+0000","last_active":"2024-02-19T21:45:47.329281+0000","last_peered":"2024-02-19T21:45:47.329281+0000","last_clean":"2024-02-19T21:45:47.329281+0000","last_became_active":"2024-02-19T21:44:26.881695+0000","last_became_peered":"2024-02-19T21:44:26.881695+0000","last_unstale":"2024-02-19T21:45:47.329281+0000","last_undegraded":"2024-02-19T21:45:47.329281+0000","last_fullsized":"2024-02-19T21:45:47.329281+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":279,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.163825+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":190,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.296186+0000","last_change":"2024-02-19T21:45:00.748363+0000","last_active":"2024-02-19T21:45:42.296186+0000","last_peered":"2024-02-19T21:45:42.296186+0000","last_clean":"2024-02-19T21:45:42.296186+0000","last_became_active":"2024-02-19T21:39:39.479752+0000","last_became_peered":"2024-02-19T21:39:39.479752+0000","last_unstale":"2024-02-19T21:45:42.296186+0000","last_undegraded":"2024-02-19T21:45:42.296186+0000","last_fullsized":"2024-02-19T21:45:42.296186+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:45:00.748244+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:45:00.748244+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"201'44","reported_seq":387,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.298306+0000","last_change":"2024-02-19T21:44:16.255128+0000","last_active":"2024-02-19T21:45:42.298306+0000","last_peered":"2024-02-19T21:45:42.298306+0000","last_clean":"2024-02-19T21:45:42.298306+0000","last_became_active":"2024-02-19T21:42:04.200393+0000","last_became_peered":"2024-02-19T21:42:04.200393+0000","last_unstale":"2024-02-19T21:45:42.298306+0000","last_undegraded":"2024-02-19T21:45:42.298306+0000","last_fullsized":"2024-02-19T21:45:42.298306+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'44","last_scrub_stamp":"2024-02-19T21:44:16.255049+0000","last_deep_scrub":"201'44","last_deep_scrub_stamp":"2024-02-19T21:44:16.255049+0000","last_clean_scrub_stamp":"2024-02-19T21:44:16.255049+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.6","version":"321'7344","reported_seq":7405,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:50.031591+0000","last_change":"2024-02-19T21:44:16.119031+0000","last_active":"2024-02-19T21:45:50.031591+0000","last_peered":"2024-02-19T21:45:50.031591+0000","last_clean":"2024-02-19T21:45:50.031591+0000","last_became_active":"2024-02-19T21:44:16.118369+0000","last_became_peered":"2024-02-19T21:44:16.118369+0000","last_unstale":"2024-02-19T21:45:50.031591+0000","last_undegraded":"2024-02-19T21:45:50.031591+0000","last_fullsized":"2024-02-19T21:45:50.031591+0000","mapping_epoch":268,"log_start":"301'3200","ondisk_log_start":"301'3200","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4144,"ondisk_log_size":4144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":481296384,"num_objects":7344,"num_object_clones":0,"num_object_copies":22032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7344,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7344,"num_write_kb":470016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":322,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.329479+0000","last_change":"2024-02-19T21:44:56.141248+0000","last_active":"2024-02-19T21:45:47.329479+0000","last_peered":"2024-02-19T21:45:47.329479+0000","last_clean":"2024-02-19T21:45:47.329479+0000","last_became_active":"2024-02-19T21:44:56.140918+0000","last_became_peered":"2024-02-19T21:44:56.140918+0000","last_unstale":"2024-02-19T21:45:47.329479+0000","last_undegraded":"2024-02-19T21:45:47.329479+0000","last_fullsized":"2024-02-19T21:45:47.329479+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:39:42.230664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:39:42.230664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":300,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.298323+0000","last_change":"2024-02-19T21:44:30.337438+0000","last_active":"2024-02-19T21:45:42.298323+0000","last_peered":"2024-02-19T21:45:42.298323+0000","last_clean":"2024-02-19T21:45:42.298323+0000","last_became_active":"2024-02-19T21:44:30.337128+0000","last_became_peered":"2024-02-19T21:44:30.337128+0000","last_unstale":"2024-02-19T21:45:42.298323+0000","last_undegraded":"2024-02-19T21:45:42.298323+0000","last_fullsized":"2024-02-19T21:45:42.298323+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":283,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.547129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.547129+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.547129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1],"acting":[4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":291,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.293976+0000","last_change":"2024-02-19T21:44:01.569675+0000","last_active":"2024-02-19T21:45:42.293976+0000","last_peered":"2024-02-19T21:45:42.293976+0000","last_clean":"2024-02-19T21:45:42.293976+0000","last_became_active":"2024-02-19T21:32:23.357438+0000","last_became_peered":"2024-02-19T21:32:23.357438+0000","last_unstale":"2024-02-19T21:45:42.293976+0000","last_undegraded":"2024-02-19T21:45:42.293976+0000","last_fullsized":"2024-02-19T21:45:42.293976+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:01.569611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:01.569611+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"201'15","reported_seq":320,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.329497+0000","last_change":"2024-02-19T21:44:54.025887+0000","last_active":"2024-02-19T21:45:47.329497+0000","last_peered":"2024-02-19T21:45:47.329497+0000","last_clean":"2024-02-19T21:45:47.329497+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:45:47.329497+0000","last_undegraded":"2024-02-19T21:45:47.329497+0000","last_fullsized":"2024-02-19T21:45:47.329497+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'15","last_scrub_stamp":"2024-02-19T21:44:54.025808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:54.025808+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.5","version":"322'7137","reported_seq":7199,"reported_epoch":322,"state":"active+clean","last_fresh":"2024-02-19T21:45:50.271563+0000","last_change":"2024-02-19T21:44:16.115677+0000","last_active":"2024-02-19T21:45:50.271563+0000","last_peered":"2024-02-19T21:45:50.271563+0000","last_clean":"2024-02-19T21:45:50.271563+0000","last_became_active":"2024-02-19T21:44:16.115394+0000","last_became_peered":"2024-02-19T21:44:16.115394+0000","last_unstale":"2024-02-19T21:45:50.271563+0000","last_undegraded":"2024-02-19T21:45:50.271563+0000","last_fullsized":"2024-02-19T21:45:50.271563+0000","mapping_epoch":268,"log_start":"300'2800","ondisk_log_start":"300'2800","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4337,"ondisk_log_size":4337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":467730432,"num_objects":7137,"num_object_clones":0,"num_object_copies":21411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7137,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7137,"num_write_kb":456768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":311,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.295649+0000","last_change":"2024-02-19T21:44:56.160766+0000","last_active":"2024-02-19T21:45:42.295649+0000","last_peered":"2024-02-19T21:45:42.295649+0000","last_clean":"2024-02-19T21:45:42.295649+0000","last_became_active":"2024-02-19T21:44:56.160521+0000","last_became_peered":"2024-02-19T21:44:56.160521+0000","last_unstale":"2024-02-19T21:45:42.295649+0000","last_undegraded":"2024-02-19T21:45:42.295649+0000","last_fullsized":"2024-02-19T21:45:42.295649+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:17.853016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:40:17.853016+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":251,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.303353+0000","last_change":"2024-02-19T21:45:09.932653+0000","last_active":"2024-02-19T21:45:42.303353+0000","last_peered":"2024-02-19T21:45:42.303353+0000","last_clean":"2024-02-19T21:45:42.303353+0000","last_became_active":"2024-02-19T21:42:04.199889+0000","last_became_peered":"2024-02-19T21:42:04.199889+0000","last_unstale":"2024-02-19T21:45:42.303353+0000","last_undegraded":"2024-02-19T21:45:42.303353+0000","last_fullsized":"2024-02-19T21:45:42.303353+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:09.932575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:45:09.932575+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"200'27","reported_seq":363,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:42.293969+0000","last_change":"2024-02-19T21:44:55.762734+0000","last_active":"2024-02-19T21:45:42.293969+0000","last_peered":"2024-02-19T21:45:42.293969+0000","last_clean":"2024-02-19T21:45:42.293969+0000","last_became_active":"2024-02-19T21:42:04.212731+0000","last_became_peered":"2024-02-19T21:42:04.212731+0000","last_unstale":"2024-02-19T21:45:42.293969+0000","last_undegraded":"2024-02-19T21:45:42.293969+0000","last_fullsized":"2024-02-19T21:45:42.293969+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'27","last_scrub_stamp":"2024-02-19T21:44:55.762629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:55.762629+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"287'10","reported_seq":478,"reported_epoch":320,"state":"active+clean","last_fresh":"2024-02-19T21:45:47.020973+0000","last_change":"2024-02-19T21:44:34.386226+0000","last_active":"2024-02-19T21:45:47.020973+0000","last_peered":"2024-02-19T21:45:47.020973+0000","last_clean":"2024-02-19T21:45:47.020973+0000","last_became_active":"2024-02-19T21:44:34.385140+0000","last_became_peered":"2024-02-19T21:44:34.385140+0000","last_unstale":"2024-02-19T21:45:47.020973+0000","last_undegraded":"2024-02-19T21:45:47.020973+0000","last_fullsized":"2024-02-19T21:45:47.020973+0000","mapping_epoch":62,"log_start":"66'8","ondisk_log_start":"66'8","created":62,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:44:11.163719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:11.163719+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":7557283840,"num_objects":115315,"num_object_clones":0,"num_object_copies":345945,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":115315,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115315,"num_write_kb":7380160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":22664380416,"data_stored":22664380416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73415,"ondisk_log_size":73415,"up":48,"acting":48,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":793,"num_read_kb":788,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1116,"num_read_kb":873,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":3604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":750,"ondisk_log_size":750,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":22,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":66,"acting":66,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":560,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201444,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2132252,"kb_used_data":1835028,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":91612900,"statfs":{"total":95995035648,"available":93811609600,"internally_reserved":0,"allocated":1879068672,"data_stored":1878413437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:45:37 2024","interfaces":[{"interface":"back","average":{"1min":5.1689999999999996,"5min":2.7869999999999999,"15min":1.4930000000000001},"min":{"1min":0.29599999999999999,"5min":0.19800000000000001,"15min":0.189},"max":{"1min":70.477999999999994,"5min":70.477999999999994,"15min":70.477999999999994},"last":4.9029999999999996},{"interface":"front","average":{"1min":4.891,"5min":2.5230000000000001,"15min":1.5349999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.20999999999999999},"max":{"1min":68.052000000000007,"5min":68.052000000000007,"15min":68.052000000000007},"last":1.387}]},{"osd":1,"last update":"Mon Feb 19 21:45:37 2024","interfaces":[{"interface":"back","average":{"1min":5.2599999999999998,"5min":2.6320000000000001,"15min":1.645},"min":{"1min":0.27500000000000002,"5min":0.23799999999999999,"15min":0.23200000000000001},"max":{"1min":68.168000000000006,"5min":68.168000000000006,"15min":68.168000000000006},"last":3.2669999999999999},{"interface":"front","average":{"1min":5.7119999999999997,"5min":2.7360000000000002,"15min":1.532},"min":{"1min":0.29199999999999998,"5min":0.23599999999999999,"15min":0.223},"max":{"1min":68.444000000000003,"5min":68.444000000000003,"15min":68.444000000000003},"last":1.4670000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:45:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":2.028,"15min":1.329},"min":{"1min":0.35199999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.9900000000000002,"5min":10.965999999999999,"15min":10.965999999999999},"last":4.8490000000000002},{"interface":"front","average":{"1min":1.6180000000000001,"5min":1.7589999999999999,"15min":1.3779999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":6.0720000000000001,"5min":7.4359999999999999,"15min":9.7010000000000005},"last":2.4849999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:45:37 2024","interfaces":[{"interface":"back","average":{"1min":1.901,"5min":2.1560000000000001,"15min":1.71},"min":{"1min":0.43099999999999999,"5min":0.29199999999999998,"15min":0.26900000000000002},"max":{"1min":7.7510000000000003,"5min":11.004,"15min":31.559000000000001},"last":4.8719999999999999},{"interface":"front","average":{"1min":1.53,"5min":1.9099999999999999,"15min":1.5580000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":6.0890000000000004,"5min":10.522,"15min":30.812999999999999},"last":2.4550000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:45:37 2024","interfaces":[{"interface":"back","average":{"1min":1.6299999999999999,"5min":2.0179999999999998,"15min":1.0800000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":5.2309999999999999,"5min":14.208,"15min":14.208},"last":2.653},{"interface":"front","average":{"1min":1.6850000000000001,"5min":2.524,"15min":1.2909999999999999},"min":{"1min":0.32700000000000001,"5min":0.26500000000000001,"15min":0.245},"max":{"1min":7.7030000000000003,"5min":11.541,"15min":11.541},"last":7.7140000000000004}]},{"osd":5,"last update":"Mon Feb 19 21:45:37 2024","interfaces":[{"interface":"back","average":{"1min":1.7689999999999999,"5min":1.946,"15min":1.1739999999999999},"min":{"1min":0.314,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":6.0110000000000001,"5min":10.090999999999999,"15min":10.090999999999999},"last":2.423},{"interface":"front","average":{"1min":2.3109999999999999,"5min":2.5089999999999999,"15min":1.335},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.28799999999999998},"max":{"1min":6.5670000000000002,"5min":17.012,"15min":17.012},"last":5.1900000000000004}]},{"osd":6,"last update":"Mon Feb 19 21:45:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.9099999999999999,"15min":1.101},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":5.25,"5min":14.177,"15min":14.177},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.472,"5min":2.4140000000000001,"15min":1.407},"min":{"1min":0.36499999999999999,"5min":0.317,"15min":0.29699999999999999},"max":{"1min":5.0350000000000001,"5min":12.913,"15min":12.913},"last":4.8129999999999997}]}]},{"osd":6,"up_from":47,"seq":201863463083,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3948156,"kb_used_data":3650932,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":89796996,"statfs":{"total":95995035648,"available":91952123904,"internally_reserved":0,"allocated":3738554368,"data_stored":3737866451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:45:17 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":2.0409999999999999,"15min":1.4159999999999999},"min":{"1min":0.255,"5min":0.23400000000000001,"15min":0.20599999999999999},"max":{"1min":3.028,"5min":45.197000000000003,"15min":45.197000000000003},"last":0.33200000000000002},{"interface":"front","average":{"1min":1.7849999999999999,"5min":2.423,"15min":1.571},"min":{"1min":0.26600000000000001,"5min":0.23499999999999999,"15min":0.221},"max":{"1min":7.274,"5min":44.753,"15min":44.753},"last":0.45300000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:45:17 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":1.8939999999999999,"15min":1.343},"min":{"1min":0.23799999999999999,"5min":0.222,"15min":0.222},"max":{"1min":3.105,"5min":45.231999999999999,"15min":45.231999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":1.9119999999999999,"15min":1.3260000000000001},"min":{"1min":0.253,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":2.298,"5min":45.097999999999999,"15min":45.097999999999999},"last":1.4750000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:45:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.5469999999999999,"15min":1.1930000000000001},"min":{"1min":0.29699999999999999,"5min":0.28599999999999998,"15min":0.26800000000000002},"max":{"1min":7.4240000000000004,"5min":7.6920000000000002,"15min":8.3849999999999998},"last":1.506},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.6930000000000001,"15min":1.25},"min":{"1min":0.32100000000000001,"5min":0.29299999999999998,"15min":0.27300000000000002},"max":{"1min":7.3070000000000004,"5min":8.5259999999999998,"15min":18.068000000000001},"last":1.2989999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:45:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":1.671,"15min":1.2809999999999999},"min":{"1min":0.29999999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":3.0720000000000001,"5min":10.630000000000001,"15min":11.15},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":1.4039999999999999,"15min":1.262},"min":{"1min":0.29799999999999999,"5min":0.26400000000000001,"15min":0.246},"max":{"1min":2.2480000000000002,"5min":8.5969999999999995,"15min":19.632999999999999},"last":1.5309999999999999}]},{"osd":4,"last update":"Mon Feb 19 21:45:17 2024","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":2.2200000000000002,"15min":1.151},"min":{"1min":0.28199999999999997,"5min":0.247,"15min":0.247},"max":{"1min":7.327,"5min":14.254,"15min":14.254},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.3,"5min":2.2599999999999998,"15min":1.2},"min":{"1min":0.29799999999999999,"5min":0.27500000000000002,"15min":0.23499999999999999},"max":{"1min":4.7140000000000004,"5min":14.055,"15min":16.594999999999999},"last":2.343}]},{"osd":5,"last update":"Mon Feb 19 21:45:17 2024","interfaces":[{"interface":"back","average":{"1min":1.609,"5min":2.2509999999999999,"15min":1.1679999999999999},"min":{"1min":0.39100000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":7.343,"5min":14.223000000000001,"15min":14.223000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":1.0609999999999999,"5min":2.46,"15min":1.302},"min":{"1min":0.34799999999999998,"5min":0.30299999999999999,"15min":0.27900000000000003},"max":{"1min":3.1379999999999999,"5min":15.497999999999999,"15min":15.497999999999999},"last":1.641}]},{"osd":7,"last update":"Mon Feb 19 21:45:36 2024","interfaces":[{"interface":"back","average":{"1min":1.7709999999999999,"5min":2.4830000000000001,"15min":1.347},"min":{"1min":0.37,"5min":0.317,"15min":0.26700000000000002},"max":{"1min":6.367,"5min":14.721,"15min":14.721},"last":0.36499999999999999},{"interface":"front","average":{"1min":1.8009999999999999,"5min":2.52,"15min":1.403},"min":{"1min":0.42599999999999999,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":6.4139999999999997,"5min":14.744999999999999,"15min":14.744999999999999},"last":0.40400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575045,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5654796,"kb_used_data":5060996,"kb_used_omap":0,"kb_used_meta":593792,"kb_avail":88090356,"statfs":{"total":95995035648,"available":90204524544,"internally_reserved":0,"allocated":5182459904,"data_stored":5181757107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":608043008},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:45:03 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":0.92900000000000005,"15min":1.286},"min":{"1min":0.19400000000000001,"5min":0.161,"15min":0.161},"max":{"1min":4.79,"5min":6.9260000000000002,"15min":42.776000000000003},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.85499999999999998,"5min":1.1279999999999999,"15min":1.2929999999999999},"min":{"1min":0.22600000000000001,"5min":0.183,"15min":0.183},"max":{"1min":2.3759999999999999,"5min":5.2919999999999998,"15min":44.845999999999997},"last":0.30199999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:45:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.0469999999999999,"15min":1.2150000000000001},"min":{"1min":0.254,"5min":0.23799999999999999,"15min":0.20899999999999999},"max":{"1min":5.6799999999999997,"5min":6.9640000000000004,"15min":11.826000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":1.8340000000000001,"5min":1.167,"15min":1.3480000000000001},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":6.0250000000000004,"5min":6.0250000000000004,"15min":12.26},"last":2.2120000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:45:03 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.1879999999999999,"15min":1.4159999999999999},"min":{"1min":0.33000000000000002,"5min":0.224,"15min":0.224},"max":{"1min":5.4500000000000002,"5min":8.3469999999999995,"15min":41.607999999999997},"last":0.40300000000000002},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.2330000000000001,"15min":1.2729999999999999},"min":{"1min":0.30599999999999999,"5min":0.216,"15min":0.216},"max":{"1min":5.3070000000000004,"5min":8.7349999999999994,"15min":42.811999999999998},"last":0.56399999999999995}]},{"osd":4,"last update":"Mon Feb 19 21:45:25 2024","interfaces":[{"interface":"back","average":{"1min":1.8560000000000001,"5min":1.7310000000000001,"15min":1.194},"min":{"1min":0.45700000000000002,"5min":0.26900000000000002,"15min":0.26800000000000002},"max":{"1min":5.5049999999999999,"5min":12.754,"15min":12.754},"last":1.7989999999999999},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.5049999999999999,"15min":1.234},"min":{"1min":0.32300000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":5.2439999999999998,"5min":6.4169999999999998,"15min":10.51},"last":2.4980000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:44:48 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":1.7390000000000001,"15min":1.2450000000000001},"min":{"1min":0.35499999999999998,"5min":0.30599999999999999,"15min":0.28799999999999998},"max":{"1min":1.647,"5min":8.4269999999999996,"15min":10.458},"last":2.532},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.552,"15min":1.1850000000000001},"min":{"1min":0.36099999999999999,"5min":0.32600000000000001,"15min":0.30099999999999999},"max":{"1min":4.4109999999999996,"5min":6.5259999999999998,"15min":7.6950000000000003},"last":4.9290000000000003}]},{"osd":6,"last update":"Mon Feb 19 21:45:21 2024","interfaces":[{"interface":"back","average":{"1min":1.8049999999999999,"5min":2.0110000000000001,"15min":1.3300000000000001},"min":{"1min":0.48999999999999999,"5min":0.318,"15min":0.30099999999999999},"max":{"1min":5.5350000000000001,"5min":11.638999999999999,"15min":11.638999999999999},"last":1.6870000000000001},{"interface":"front","average":{"1min":1.78,"5min":2.1930000000000001,"15min":1.421},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":6.4729999999999999,"5min":12.199,"15min":12.199},"last":1.958}]},{"osd":7,"last update":"Mon Feb 19 21:45:46 2024","interfaces":[{"interface":"back","average":{"1min":2.0009999999999999,"5min":1.9610000000000001,"15min":1.46},"min":{"1min":0.38700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":5.4390000000000001,"5min":8.1699999999999999,"15min":10.638999999999999},"last":3.8450000000000002},{"interface":"front","average":{"1min":1.9159999999999999,"5min":1.895,"15min":1.329},"min":{"1min":0.50800000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":5.5570000000000004,"5min":8.1809999999999992,"15min":11.276},"last":3.8559999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738571,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3531340,"kb_used_data":3221764,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":90213812,"statfs":{"total":95995035648,"available":92378943488,"internally_reserved":0,"allocated":3299086336,"data_stored":3298391382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:45:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.83599999999999997,"15min":0.94999999999999996},"min":{"1min":0.19,"5min":0.182,"15min":0.17499999999999999},"max":{"1min":4.2060000000000004,"5min":16.478000000000002,"15min":16.478000000000002},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.96199999999999997,"15min":1.194},"min":{"1min":0.22,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":3.827,"5min":8.0229999999999997,"15min":13.422000000000001},"last":0.25800000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:45:39 2024","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":0.91700000000000004,"15min":1.155},"min":{"1min":0.32600000000000001,"5min":0.223,"15min":0.223},"max":{"1min":6.25,"5min":8.4559999999999995,"15min":13.638999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":1.0429999999999999,"15min":1.3129999999999999},"min":{"1min":0.23799999999999999,"5min":0.224,"15min":0.19500000000000001},"max":{"1min":2.5339999999999998,"5min":13.134,"15min":13.134},"last":0.312}]},{"osd":3,"last update":"Mon Feb 19 21:44:53 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":1.202,"15min":1.3899999999999999},"min":{"1min":0.22700000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":3.419,"5min":13.292999999999999,"15min":14.507999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.87,"15min":1.333},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.6539999999999999,"5min":8.4169999999999998,"15min":18.759},"last":0.32400000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:45:36 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.835,"15min":1.339},"min":{"1min":0.33500000000000002,"5min":0.32400000000000001,"15min":0.28299999999999997},"max":{"1min":5.1929999999999996,"5min":13.278,"15min":13.278},"last":0.33400000000000002},{"interface":"front","average":{"1min":1.5620000000000001,"5min":1.5860000000000001,"15min":1.2190000000000001},"min":{"1min":0.376,"5min":0.33800000000000002,"15min":0.255},"max":{"1min":4.4930000000000003,"5min":8.4789999999999992,"15min":8.9450000000000003},"last":0.36699999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:44:53 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":1.8759999999999999,"15min":1.5569999999999999},"min":{"1min":0.28799999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":2.0070000000000001,"5min":10.852,"15min":42.799999999999997},"last":1.744},{"interface":"front","average":{"1min":0.65200000000000002,"5min":2.024,"15min":1.556},"min":{"1min":0.36099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.1499999999999999,"5min":13.237,"15min":42.695},"last":1.7529999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:45:08 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.3400000000000001,"15min":1.2769999999999999},"min":{"1min":0.35099999999999998,"5min":0.30599999999999999,"15min":0.27900000000000003},"max":{"1min":4.2910000000000004,"5min":8.5009999999999994,"15min":42.777000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.94699999999999995,"5min":2.0630000000000002,"15min":1.516},"min":{"1min":0.312,"5min":0.29799999999999999,"15min":0.28599999999999998},"max":{"1min":3.9100000000000001,"5min":13.289999999999999,"15min":13.289999999999999},"last":0.65500000000000003}]},{"osd":7,"last update":"Mon Feb 19 21:45:39 2024","interfaces":[{"interface":"back","average":{"1min":1.893,"5min":1.915,"15min":1.474},"min":{"1min":0.46800000000000003,"5min":0.37,"15min":0.31},"max":{"1min":4.9240000000000004,"5min":13.26,"15min":42.758000000000003},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.8700000000000001,"5min":1.615,"15min":1.4119999999999999},"min":{"1min":0.39000000000000001,"5min":0.371,"15min":0.33200000000000002},"max":{"1min":4.266,"5min":8.5340000000000007,"15min":42.718000000000004},"last":0.86299999999999999}]}]},{"osd":2,"up_from":0,"seq":77309411520,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":26,"seq":111669149883,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1226120,"kb_used_data":916608,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":92519032,"statfs":{"total":95995035648,"available":94739488768,"internally_reserved":0,"allocated":938606592,"data_stored":937970511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:45:00 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.1479999999999999,"15min":1.1830000000000001},"min":{"1min":0.254,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":6.1130000000000004,"5min":8.8529999999999998,"15min":17.992000000000001},"last":2.4359999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":1.0760000000000001,"15min":1.524},"min":{"1min":0.20499999999999999,"5min":0.191,"15min":0.191},"max":{"1min":6.149,"5min":9.1120000000000001,"15min":46.654000000000003},"last":2.415}]},{"osd":1,"last update":"Mon Feb 19 21:45:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.93100000000000005,"15min":0.97299999999999998},"min":{"1min":0.23300000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":5.2530000000000001,"5min":6.444,"15min":9.9700000000000006},"last":0.25900000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1579999999999999,"15min":1.262},"min":{"1min":0.28599999999999998,"5min":0.20799999999999999,"15min":0.185},"max":{"1min":5.3860000000000001,"5min":6.3460000000000001,"15min":13.135999999999999},"last":0.315}]},{"osd":2,"last update":"Mon Feb 19 21:45:00 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":1.071,"15min":1.194},"min":{"1min":0.27700000000000002,"5min":0.22900000000000001,"15min":0.224},"max":{"1min":2.0739999999999998,"5min":6.8879999999999999,"15min":11.175000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":1.048,"15min":1.4419999999999999},"min":{"1min":0.26400000000000001,"5min":0.23499999999999999,"15min":0.21299999999999999},"max":{"1min":5.6900000000000004,"5min":12.723000000000001,"15min":45.831000000000003},"last":1.8120000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:45:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.371,"15min":1.0900000000000001},"min":{"1min":0.28499999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":5.899,"5min":7.1660000000000004,"15min":7.1660000000000004},"last":0.34699999999999998},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.7729999999999999,"15min":1.3700000000000001},"min":{"1min":0.40100000000000002,"5min":0.28699999999999998,"15min":0.26800000000000002},"max":{"1min":6.4580000000000002,"5min":9.6720000000000006,"15min":11.093},"last":1.1839999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:45:47 2024","interfaces":[{"interface":"back","average":{"1min":1.633,"5min":1.8009999999999999,"15min":1.232},"min":{"1min":0.31900000000000001,"5min":0.29099999999999998,"15min":0.27100000000000002},"max":{"1min":4.6970000000000001,"5min":12.257,"15min":12.257},"last":1.129},{"interface":"front","average":{"1min":1.5760000000000001,"5min":1.9119999999999999,"15min":1.46},"min":{"1min":0.33200000000000002,"5min":0.313,"15min":0.27800000000000002},"max":{"1min":5.3479999999999999,"5min":8.5809999999999995,"15min":11.128},"last":0.37}]},{"osd":6,"last update":"Mon Feb 19 21:45:10 2024","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.5620000000000001,"15min":1.1919999999999999},"min":{"1min":0.436,"5min":0.309,"15min":0.30599999999999999},"max":{"1min":7.5419999999999998,"5min":7.5419999999999998,"15min":17.443999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.7090000000000001,"15min":1.3999999999999999},"min":{"1min":0.437,"5min":0.32900000000000001,"15min":0.32300000000000001},"max":{"1min":3.8100000000000001,"5min":13.942,"15min":18.219000000000001},"last":0.53700000000000003}]},{"osd":7,"last update":"Mon Feb 19 21:45:38 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.7230000000000001,"15min":1.637},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":5.7729999999999997,"5min":9.0259999999999998,"15min":45.777999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.389,"15min":1.1379999999999999},"min":{"1min":0.47599999999999998,"5min":0.35399999999999998,"15min":0.35099999999999998},"max":{"1min":4.0890000000000004,"5min":6.585,"15min":6.585},"last":0.61899999999999999}]}]},{"osd":4,"up_from":32,"seq":137438953652,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3064176,"kb_used_data":2762856,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":90680976,"statfs":{"total":95995035648,"available":92857319424,"internally_reserved":0,"allocated":2829164544,"data_stored":2828488357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:45:25 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":1.597,"15min":1.349},"min":{"1min":0.23499999999999999,"5min":0.219,"15min":0.219},"max":{"1min":2.9340000000000002,"5min":11.541,"15min":40.664000000000001},"last":3.133},{"interface":"front","average":{"1min":1.181,"5min":1.5569999999999999,"15min":1.452},"min":{"1min":0.249,"5min":0.23799999999999999,"15min":0.22600000000000001},"max":{"1min":2.8719999999999999,"5min":9.2799999999999994,"15min":41.046999999999997},"last":2.9039999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:45:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.7949999999999999,"15min":1.181},"min":{"1min":0.27800000000000002,"5min":0.22,"15min":0.22},"max":{"1min":6.0430000000000001,"5min":11.755000000000001,"15min":13.254},"last":0.498},{"interface":"front","average":{"1min":1.248,"5min":1.4630000000000001,"15min":1.117},"min":{"1min":0.27700000000000002,"5min":0.25,"15min":0.25},"max":{"1min":2.9340000000000002,"5min":7.6970000000000001,"15min":15.411},"last":3.6520000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:45:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.6419999999999999,"15min":1.2310000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27100000000000002},"max":{"1min":2.98,"5min":7.6459999999999999,"15min":16.788},"last":3.0510000000000002},{"interface":"front","average":{"1min":0.85399999999999998,"5min":1.629,"15min":1.411},"min":{"1min":0.318,"5min":0.318,"15min":0.27300000000000002},"max":{"1min":2.9750000000000001,"5min":10.603999999999999,"15min":20.995999999999999},"last":3.8839999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:45:25 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":1.72,"15min":1.3140000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.316},"max":{"1min":2.5529999999999999,"5min":10.970000000000001,"15min":15.914999999999999},"last":3.9300000000000002},{"interface":"front","average":{"1min":0.92400000000000004,"5min":1.79,"15min":1.2689999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.02,"5min":11.662000000000001,"15min":13.321},"last":0.91400000000000003}]},{"osd":5,"last update":"Mon Feb 19 21:45:09 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":1.9530000000000001,"15min":1.079},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":2.9039999999999999,"5min":18.916,"15min":18.916},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.753,"5min":2.625,"15min":1.3},"min":{"1min":0.317,"5min":0.253,"15min":0.253},"max":{"1min":2.2490000000000001,"5min":14.840999999999999,"15min":14.840999999999999},"last":2.7280000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:45:25 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.734,"15min":1.1160000000000001},"min":{"1min":0.28899999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":4.4509999999999996,"5min":10.622999999999999,"15min":13.27},"last":0.33200000000000002},{"interface":"front","average":{"1min":1.6120000000000001,"5min":2.1709999999999998,"15min":1.163},"min":{"1min":0.36199999999999999,"5min":0.28799999999999998,"15min":0.27400000000000002},"max":{"1min":4.5209999999999999,"5min":14.127000000000001,"15min":14.127000000000001},"last":0.42399999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:45:48 2024","interfaces":[{"interface":"back","average":{"1min":2.4980000000000002,"5min":2.3079999999999998,"15min":1.2370000000000001},"min":{"1min":0.38700000000000001,"5min":0.30399999999999999,"15min":0.28899999999999998},"max":{"1min":8.4770000000000003,"5min":14.093,"15min":14.093},"last":2.121},{"interface":"front","average":{"1min":1.679,"5min":2.0800000000000001,"15min":1.3009999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":10.82,"5min":12.808999999999999,"15min":12.808999999999999},"last":0.31}]}]},{"osd":5,"up_from":38,"seq":163208757424,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5208516,"kb_used_data":4614716,"kb_used_omap":0,"kb_used_meta":593792,"kb_avail":88536636,"statfs":{"total":95995035648,"available":90661515264,"internally_reserved":0,"allocated":4725469184,"data_stored":4724773576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":608043008},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:44:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":1.7529999999999999,"15min":1.3200000000000001},"min":{"1min":0.218,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":3.7879999999999998,"5min":15.048,"15min":20.550999999999998},"last":10.106},{"interface":"front","average":{"1min":1.0149999999999999,"5min":2.0339999999999998,"15min":1.375},"min":{"1min":0.313,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":5.6900000000000004,"5min":9.9390000000000001,"15min":20.879000000000001},"last":5.1639999999999997}]},{"osd":1,"last update":"Mon Feb 19 21:44:55 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":2.1139999999999999,"15min":1.2929999999999999},"min":{"1min":0.25600000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.819,"5min":10.42,"15min":10.42},"last":5.0750000000000002},{"interface":"front","average":{"1min":0.753,"5min":1.3220000000000001,"15min":1.1579999999999999},"min":{"1min":0.29599999999999999,"5min":0.247,"15min":0.247},"max":{"1min":2.5819999999999999,"5min":10.021000000000001,"15min":10.316000000000001},"last":0.26600000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:44:55 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":1.7909999999999999,"15min":1.373},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.25700000000000001},"max":{"1min":3.8260000000000001,"5min":15.015000000000001,"15min":20.186},"last":2.4470000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":1.8580000000000001,"15min":1.385},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.23200000000000001},"max":{"1min":3.3199999999999998,"5min":9.4909999999999997,"15min":20.175000000000001},"last":5.1109999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:44:55 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":2.069,"15min":1.53},"min":{"1min":0.29699999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":3.8570000000000002,"5min":12.021000000000001,"15min":20.146999999999998},"last":1.2190000000000001},{"interface":"front","average":{"1min":0.85899999999999999,"5min":2.2869999999999999,"15min":1.673},"min":{"1min":0.35099999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":3.3639999999999999,"5min":9.5150000000000006,"15min":20.120000000000001},"last":5.1399999999999997}]},{"osd":4,"last update":"Mon Feb 19 21:44:55 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":1.681,"15min":0.92700000000000005},"min":{"1min":0.27100000000000002,"5min":0.252,"15min":0.23999999999999999},"max":{"1min":4.1779999999999999,"5min":21.577000000000002,"15min":21.577000000000002},"last":2.8679999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":2.5,"15min":1.254},"min":{"1min":0.32200000000000001,"5min":0.28799999999999998,"15min":0.25600000000000001},"max":{"1min":3.75,"5min":15.071999999999999,"15min":15.071999999999999},"last":10.122999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:45:20 2024","interfaces":[{"interface":"back","average":{"1min":2.1469999999999998,"5min":2.5739999999999998,"15min":1.288},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.221},"max":{"1min":7.024,"5min":13.138999999999999,"15min":13.138999999999999},"last":10.077},{"interface":"front","average":{"1min":1.5840000000000001,"5min":2.3900000000000001,"15min":1.339},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.23599999999999999},"max":{"1min":5.4729999999999999,"5min":13.532999999999999,"15min":13.532999999999999},"last":6.2030000000000003}]},{"osd":7,"last update":"Mon Feb 19 21:45:49 2024","interfaces":[{"interface":"back","average":{"1min":2.2989999999999999,"5min":2.7050000000000001,"15min":1.5009999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":9.0489999999999995,"5min":12.962,"15min":12.962},"last":8.7409999999999997},{"interface":"front","average":{"1min":2.2730000000000001,"5min":2.3460000000000001,"15min":1.335},"min":{"1min":0.309,"5min":0.309,"15min":0.29099999999999998},"max":{"1min":8.3330000000000002,"5min":13.116,"15min":17.759},"last":0.309}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":2118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3297902592,"data_stored":3297902592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5201723392,"data_stored":5201723392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":941490176,"data_stored":941490176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2829320192,"data_stored":2829320192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4729143296,"data_stored":4729143296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3773628416,"data_stored":3773628416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1891172352,"data_stored":1891172352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:45:54.268 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool set default.rgw.control pgp_num 22 2024-02-19T21:45:54.276 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:45:54.280 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:54.281 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:45:54.291 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:45:54.369 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:45:54.382 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:45:54.416 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:54.446 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:45:54.450 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:54.450 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:45:54.551 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:45:54.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:53.080606+0000 mgr.y (mgr.14514) 513 : cluster [DBG] pgmap v645: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 7.0 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 1.2 KiB/s rd, 69 MiB/s wr, 1.11k op/s; 2/346521 objects misplaced (0.001%) 2024-02-19T21:45:54.576 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:53.080606+0000 mgr.y (mgr.14514) 513 : cluster [DBG] pgmap v645: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 7.0 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 1.2 KiB/s rd, 69 MiB/s wr, 1.11k op/s; 2/346521 objects misplaced (0.001%) 2024-02-19T21:45:54.577 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:53.080606+0000 mgr.y (mgr.14514) 513 : cluster [DBG] pgmap v645: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 7.0 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 1.2 KiB/s rd, 69 MiB/s wr, 1.11k op/s; 2/346521 objects misplaced (0.001%) 2024-02-19T21:45:54.601 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:54.640 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:45:54.648 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:54.648 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:45:54.749 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:45:54.805 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:54.811 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:45:54.843 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:45:54.848 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:54.848 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:45:54.949 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:45:55.009 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:55.051 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:45:55.056 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:55.056 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:45:55.091 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 83 16 120648 120632 90.8158 60.0625 0.014606 0.0110072 2024-02-19T21:45:55.157 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:45:55.205 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:55.356 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:45:55.359 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:55.360 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:45:55.461 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:45:55.517 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:55.556 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:45:55.563 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:55.563 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:45:55.664 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:45:55.708 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:55.808 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:45:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:45:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:45:56.093 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 84 16 121750 121734 90.5528 68.875 0.0175998 0.0110397 2024-02-19T21:45:56.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:55.081307+0000 mgr.y (mgr.14514) 514 : cluster [DBG] pgmap v646: 138 pgs: 1 active+clean+scrubbing, 1 active+remapped+backfill_toofull, 136 active+clean; 7.2 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 639 B/s rd, 63 MiB/s wr, 1.00k op/s; 2/353616 objects misplaced (0.001%) 2024-02-19T21:45:56.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:55.152346+0000 osd.3 (osd.3) 205 : cluster [DBG] 9.1 scrub ok 2024-02-19T21:45:56.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:55.183353+0000 osd.0 (osd.0) 218 : cluster [DBG] 2.1 scrub starts 2024-02-19T21:45:56.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:55.195390+0000 osd.0 (osd.0) 219 : cluster [DBG] 2.1 scrub ok 2024-02-19T21:45:56.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:55.982133+0000 osd.5 (osd.5) 217 : cluster [DBG] 4.1 scrub starts 2024-02-19T21:45:56.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:55.998639+0000 osd.5 (osd.5) 218 : cluster [DBG] 4.1 scrub ok 2024-02-19T21:45:56.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:55.081307+0000 mgr.y (mgr.14514) 514 : cluster [DBG] pgmap v646: 138 pgs: 1 active+clean+scrubbing, 1 active+remapped+backfill_toofull, 136 active+clean; 7.2 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 639 B/s rd, 63 MiB/s wr, 1.00k op/s; 2/353616 objects misplaced (0.001%) 2024-02-19T21:45:56.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:55.152346+0000 osd.3 (osd.3) 205 : cluster [DBG] 9.1 scrub ok 2024-02-19T21:45:56.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:55.183353+0000 osd.0 (osd.0) 218 : cluster [DBG] 2.1 scrub starts 2024-02-19T21:45:56.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:55.195390+0000 osd.0 (osd.0) 219 : cluster [DBG] 2.1 scrub ok 2024-02-19T21:45:56.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:55.982133+0000 osd.5 (osd.5) 217 : cluster [DBG] 4.1 scrub starts 2024-02-19T21:45:56.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:55.998639+0000 osd.5 (osd.5) 218 : cluster [DBG] 4.1 scrub ok 2024-02-19T21:45:56.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:55.081307+0000 mgr.y (mgr.14514) 514 : cluster [DBG] pgmap v646: 138 pgs: 1 active+clean+scrubbing, 1 active+remapped+backfill_toofull, 136 active+clean; 7.2 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 639 B/s rd, 63 MiB/s wr, 1.00k op/s; 2/353616 objects misplaced (0.001%) 2024-02-19T21:45:56.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:55.152346+0000 osd.3 (osd.3) 205 : cluster [DBG] 9.1 scrub ok 2024-02-19T21:45:56.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:55.183353+0000 osd.0 (osd.0) 218 : cluster [DBG] 2.1 scrub starts 2024-02-19T21:45:56.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:55.195390+0000 osd.0 (osd.0) 219 : cluster [DBG] 2.1 scrub ok 2024-02-19T21:45:56.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:55.982133+0000 osd.5 (osd.5) 217 : cluster [DBG] 4.1 scrub starts 2024-02-19T21:45:56.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:55.998639+0000 osd.5 (osd.5) 218 : cluster [DBG] 4.1 scrub ok 2024-02-19T21:45:57.093 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 85 16 122934 122918 90.3579 74 0.0106575 0.0110631 2024-02-19T21:45:57.162 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:45:57.166 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:57.166 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:45:57.267 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:45:57.306 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:57.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:56.281705+0000 osd.7 (osd.7) 198 : cluster [DBG] 2.0 scrub starts 2024-02-19T21:45:57.495 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:56.289194+0000 osd.7 (osd.7) 199 : cluster [DBG] 2.0 scrub ok 2024-02-19T21:45:57.495 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:56.281705+0000 osd.7 (osd.7) 198 : cluster [DBG] 2.0 scrub starts 2024-02-19T21:45:57.495 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:56.289194+0000 osd.7 (osd.7) 199 : cluster [DBG] 2.0 scrub ok 2024-02-19T21:45:57.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:56.281705+0000 osd.7 (osd.7) 198 : cluster [DBG] 2.0 scrub starts 2024-02-19T21:45:57.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:56.289194+0000 osd.7 (osd.7) 199 : cluster [DBG] 2.0 scrub ok 2024-02-19T21:45:58.093 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 86 16 124128 124112 90.175 74.625 0.00654606 0.0110856 2024-02-19T21:45:58.464 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:57.033372+0000 osd.4 (osd.4) 160 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:45:58.464 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:57.039639+0000 osd.4 (osd.4) 161 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:45:58.464 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:57.081804+0000 mgr.y (mgr.14514) 515 : cluster [DBG] pgmap v647: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing, 136 active+clean; 7.4 GiB data, 25 GiB used, 601 GiB / 626 GiB avail; 1.0 KiB/s rd, 70 MiB/s wr, 1.13k op/s; 2/362568 objects misplaced (0.001%) 2024-02-19T21:45:58.465 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:57.033372+0000 osd.4 (osd.4) 160 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:45:58.465 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:57.039639+0000 osd.4 (osd.4) 161 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:45:58.465 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:57.081804+0000 mgr.y (mgr.14514) 515 : cluster [DBG] pgmap v647: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing, 136 active+clean; 7.4 GiB data, 25 GiB used, 601 GiB / 626 GiB avail; 1.0 KiB/s rd, 70 MiB/s wr, 1.13k op/s; 2/362568 objects misplaced (0.001%) 2024-02-19T21:45:58.666 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:45:58.672 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:58.673 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:45:58.773 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:45:58.815 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:57.033372+0000 osd.4 (osd.4) 160 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:45:58.815 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:57.039639+0000 osd.4 (osd.4) 161 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:45:58.815 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:57.081804+0000 mgr.y (mgr.14514) 515 : cluster [DBG] pgmap v647: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing, 136 active+clean; 7.4 GiB data, 25 GiB used, 601 GiB / 626 GiB avail; 1.0 KiB/s rd, 70 MiB/s wr, 1.13k op/s; 2/362568 objects misplaced (0.001%) 2024-02-19T21:45:58.828 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:58.859 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:45:58.862 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:58.862 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:45:58.963 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:45:59.013 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:59.043 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:45:59.050 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:45:59.051 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:45:59.094 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 87 16 125231 125215 89.9301 68.9375 0.0148352 0.0111159 2024-02-19T21:45:59.152 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:45:59.240 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:45:59.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:57.869848+0000 osd.1 (osd.1) 203 : cluster [DBG] 4.2 scrub starts 2024-02-19T21:45:59.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:57.877851+0000 osd.1 (osd.1) 204 : cluster [DBG] 4.2 scrub ok 2024-02-19T21:45:59.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:58.320825+0000 osd.7 (osd.7) 200 : cluster [DBG] 2.1c scrub starts 2024-02-19T21:45:59.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:58.329309+0000 osd.7 (osd.7) 201 : cluster [DBG] 2.1c scrub ok 2024-02-19T21:45:59.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:58.959475+0000 mon.a (mon.0) 1382 : audit [DBG] from='client.? 172.21.15.80:0/1788193664' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:45:59.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:58.996333+0000 osd.6 (osd.6) 185 : cluster [DBG] 6.1b scrub starts 2024-02-19T21:45:59.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:45:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:59.075594+0000 osd.6 (osd.6) 186 : cluster [DBG] 6.1b scrub ok 2024-02-19T21:45:59.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:57.869848+0000 osd.1 (osd.1) 203 : cluster [DBG] 4.2 scrub starts 2024-02-19T21:45:59.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:57.877851+0000 osd.1 (osd.1) 204 : cluster [DBG] 4.2 scrub ok 2024-02-19T21:45:59.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:58.320825+0000 osd.7 (osd.7) 200 : cluster [DBG] 2.1c scrub starts 2024-02-19T21:45:59.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:58.329309+0000 osd.7 (osd.7) 201 : cluster [DBG] 2.1c scrub ok 2024-02-19T21:45:59.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:58.959475+0000 mon.a (mon.0) 1382 : audit [DBG] from='client.? 172.21.15.80:0/1788193664' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:45:59.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:58.996333+0000 osd.6 (osd.6) 185 : cluster [DBG] 6.1b scrub starts 2024-02-19T21:45:59.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:45:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:59.075594+0000 osd.6 (osd.6) 186 : cluster [DBG] 6.1b scrub ok 2024-02-19T21:45:59.665 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:45:59.665 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:45:59.665 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:45:59.666 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:45:59.666 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:45:59.666 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:45:59.666 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:45:59.666 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:45:59.666 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:45:59.666 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:45:59.666 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:45:59.666 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:45:59.666 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:45:59.666 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:45:59.667 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:45:59.667 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:45:59.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:57.869848+0000 osd.1 (osd.1) 203 : cluster [DBG] 4.2 scrub starts 2024-02-19T21:45:59.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:57.877851+0000 osd.1 (osd.1) 204 : cluster [DBG] 4.2 scrub ok 2024-02-19T21:45:59.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:58.320825+0000 osd.7 (osd.7) 200 : cluster [DBG] 2.1c scrub starts 2024-02-19T21:45:59.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:58.329309+0000 osd.7 (osd.7) 201 : cluster [DBG] 2.1c scrub ok 2024-02-19T21:45:59.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:58.959475+0000 mon.a (mon.0) 1382 : audit [DBG] from='client.? 172.21.15.80:0/1788193664' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:45:59.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:58.996333+0000 osd.6 (osd.6) 185 : cluster [DBG] 6.1b scrub starts 2024-02-19T21:45:59.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:45:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:59.075594+0000 osd.6 (osd.6) 186 : cluster [DBG] 6.1b scrub ok 2024-02-19T21:46:00.094 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 88 16 126326 126310 89.6858 68.4375 0.0142935 0.0111458 2024-02-19T21:46:00.397 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:46:00.403 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:00.404 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:46:00.441 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-02-19T21:46:00.505 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:46:00.567 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:00.602 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:46:00.609 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:00.609 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:46:00.706 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:46:00.706 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-02-19T21:46:00.706 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-02-19T21:46:00.706 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:46:00.710 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:46:00.727 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:59.083903+0000 mgr.y (mgr.14514) 516 : cluster [DBG] pgmap v648: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing, 136 active+clean; 7.4 GiB data, 25 GiB used, 601 GiB / 626 GiB avail; 1023 B/s rd, 69 MiB/s wr, 1.10k op/s; 2/362568 objects misplaced (0.001%) 2024-02-19T21:46:00.727 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:59.306159+0000 osd.7 (osd.7) 202 : cluster [DBG] 6.12 scrub starts 2024-02-19T21:46:00.727 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:59.339641+0000 osd.7 (osd.7) 203 : cluster [DBG] 6.12 scrub ok 2024-02-19T21:46:00.727 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:59.437561+0000 mon.c (mon.2) 72 : audit [INF] from='client.? 172.21.15.80:0/64033871' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:46:00.727 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:45:59.437979+0000 mon.a (mon.0) 1383 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:46:00.727 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:59.535238+0000 osd.3 (osd.3) 206 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:46:00.728 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:45:59.539579+0000 osd.3 (osd.3) 207 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:46:00.728 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:00.014009+0000 osd.6 (osd.6) 187 : cluster [DBG] 5.11 scrub starts 2024-02-19T21:46:00.728 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:00.027129+0000 osd.6 (osd.6) 188 : cluster [DBG] 5.11 scrub ok 2024-02-19T21:46:00.728 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:59.083903+0000 mgr.y (mgr.14514) 516 : cluster [DBG] pgmap v648: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing, 136 active+clean; 7.4 GiB data, 25 GiB used, 601 GiB / 626 GiB avail; 1023 B/s rd, 69 MiB/s wr, 1.10k op/s; 2/362568 objects misplaced (0.001%) 2024-02-19T21:46:00.728 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:59.306159+0000 osd.7 (osd.7) 202 : cluster [DBG] 6.12 scrub starts 2024-02-19T21:46:00.728 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:59.339641+0000 osd.7 (osd.7) 203 : cluster [DBG] 6.12 scrub ok 2024-02-19T21:46:00.728 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:59.437561+0000 mon.c (mon.2) 72 : audit [INF] from='client.? 172.21.15.80:0/64033871' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:46:00.728 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:45:59.437979+0000 mon.a (mon.0) 1383 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:46:00.728 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:59.535238+0000 osd.3 (osd.3) 206 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:46:00.728 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:45:59.539579+0000 osd.3 (osd.3) 207 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:46:00.728 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:00.014009+0000 osd.6 (osd.6) 187 : cluster [DBG] 5.11 scrub starts 2024-02-19T21:46:00.728 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:00.027129+0000 osd.6 (osd.6) 188 : cluster [DBG] 5.11 scrub ok 2024-02-19T21:46:00.764 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:00.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:59.083903+0000 mgr.y (mgr.14514) 516 : cluster [DBG] pgmap v648: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing, 136 active+clean; 7.4 GiB data, 25 GiB used, 601 GiB / 626 GiB avail; 1023 B/s rd, 69 MiB/s wr, 1.10k op/s; 2/362568 objects misplaced (0.001%) 2024-02-19T21:46:00.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:59.306159+0000 osd.7 (osd.7) 202 : cluster [DBG] 6.12 scrub starts 2024-02-19T21:46:00.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:59.339641+0000 osd.7 (osd.7) 203 : cluster [DBG] 6.12 scrub ok 2024-02-19T21:46:00.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:59.437561+0000 mon.c (mon.2) 72 : audit [INF] from='client.? 172.21.15.80:0/64033871' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:46:00.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:45:59.437979+0000 mon.a (mon.0) 1383 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:46:00.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:59.535238+0000 osd.3 (osd.3) 206 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:46:00.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:45:59.539579+0000 osd.3 (osd.3) 207 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:46:00.813 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:00.014009+0000 osd.6 (osd.6) 187 : cluster [DBG] 5.11 scrub starts 2024-02-19T21:46:00.813 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:00.027129+0000 osd.6 (osd.6) 188 : cluster [DBG] 5.11 scrub ok 2024-02-19T21:46:00.813 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:46:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:46:01.094 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 89 16 127458 127442 89.473 70.75 0.0256402 0.0111722 2024-02-19T21:46:01.096 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:46:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:46:00] "GET /metrics HTTP/1.1" 200 176130 "" "Prometheus/2.33.4" 2024-02-19T21:46:01.123 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:46:01.564 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:00.408403+0000 mon.a (mon.0) 1384 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:46:01.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:00.419772+0000 mon.a (mon.0) 1385 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:46:01.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:00.419838+0000 mon.a (mon.0) 1386 : cluster [DBG] osdmap e323: 8 total, 8 up, 7 in 2024-02-19T21:46:01.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:00.539508+0000 osd.3 (osd.3) 208 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:46:01.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:00.562198+0000 osd.3 (osd.3) 209 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:46:01.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:00.625112+0000 mgr.y (mgr.14514) 517 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:46:01.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:00.993865+0000 osd.5 (osd.5) 219 : cluster [DBG] 6.d scrub starts 2024-02-19T21:46:01.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:01.031335+0000 osd.5 (osd.5) 220 : cluster [DBG] 6.d scrub ok 2024-02-19T21:46:01.565 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:00.408403+0000 mon.a (mon.0) 1384 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:46:01.565 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:00.419772+0000 mon.a (mon.0) 1385 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:46:01.565 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:00.419838+0000 mon.a (mon.0) 1386 : cluster [DBG] osdmap e323: 8 total, 8 up, 7 in 2024-02-19T21:46:01.565 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:00.539508+0000 osd.3 (osd.3) 208 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:46:01.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:00.562198+0000 osd.3 (osd.3) 209 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:46:01.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:00.625112+0000 mgr.y (mgr.14514) 517 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:46:01.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:00.993865+0000 osd.5 (osd.5) 219 : cluster [DBG] 6.d scrub starts 2024-02-19T21:46:01.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:01.031335+0000 osd.5 (osd.5) 220 : cluster [DBG] 6.d scrub ok 2024-02-19T21:46:01.594 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.3 dump_blocked_ops 2024-02-19T21:46:01.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:00.408403+0000 mon.a (mon.0) 1384 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:46:01.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:00.419772+0000 mon.a (mon.0) 1385 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:46:01.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:00.419838+0000 mon.a (mon.0) 1386 : cluster [DBG] osdmap e323: 8 total, 8 up, 7 in 2024-02-19T21:46:01.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:00.539508+0000 osd.3 (osd.3) 208 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:46:01.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:00.562198+0000 osd.3 (osd.3) 209 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:46:01.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:00.625112+0000 mgr.y (mgr.14514) 517 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:46:01.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:00.993865+0000 osd.5 (osd.5) 219 : cluster [DBG] 6.d scrub starts 2024-02-19T21:46:01.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:01.031335+0000 osd.5 (osd.5) 220 : cluster [DBG] 6.d scrub ok 2024-02-19T21:46:02.094 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Total time run: 90.0095 2024-02-19T21:46:02.095 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Total writes made: 128589 2024-02-19T21:46:02.095 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Write size: 65536 2024-02-19T21:46:02.095 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Object size: 65536 2024-02-19T21:46:02.095 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Bandwidth (MB/sec): 89.2885 2024-02-19T21:46:02.095 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Stddev Bandwidth: 32.8668 2024-02-19T21:46:02.095 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Max bandwidth (MB/sec): 221.5 2024-02-19T21:46:02.095 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Min bandwidth (MB/sec): 60.0625 2024-02-19T21:46:02.095 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Average IOPS: 1428 2024-02-19T21:46:02.095 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Stddev IOPS: 525.869 2024-02-19T21:46:02.095 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Max IOPS: 3544 2024-02-19T21:46:02.095 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Min IOPS: 961 2024-02-19T21:46:02.095 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Average Latency(s): 0.0111962 2024-02-19T21:46:02.095 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Stddev Latency(s): 0.00646208 2024-02-19T21:46:02.095 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Max latency(s): 0.148674 2024-02-19T21:46:02.096 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Min latency(s): 0.00124015 2024-02-19T21:46:02.098 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Cleaning up (deleting benchmark objects) 2024-02-19T21:46:02.253 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:46:02.261 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:02.261 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:46:02.362 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:46:02.422 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:46:02.430 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:02.475 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:46:02.482 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:02.483 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:46:02.519 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:01.084333+0000 mgr.y (mgr.14514) 518 : cluster [DBG] pgmap v650: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 7.7 GiB data, 26 GiB used, 600 GiB / 626 GiB avail; 1023 B/s rd, 69 MiB/s wr, 1.10k op/s; 2/379587 objects misplaced (0.001%) 2024-02-19T21:46:02.519 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:01.146968+0000 osd.0 (osd.0) 220 : cluster [DBG] 6.9 scrub starts 2024-02-19T21:46:02.519 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:01.176534+0000 osd.0 (osd.0) 221 : cluster [DBG] 6.9 scrub ok 2024-02-19T21:46:02.519 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:01.975736+0000 osd.5 (osd.5) 221 : cluster [DBG] 6.a scrub starts 2024-02-19T21:46:02.519 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:01.981858+0000 osd.5 (osd.5) 222 : cluster [DBG] 6.a scrub ok 2024-02-19T21:46:02.520 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:01.084333+0000 mgr.y (mgr.14514) 518 : cluster [DBG] pgmap v650: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 7.7 GiB data, 26 GiB used, 600 GiB / 626 GiB avail; 1023 B/s rd, 69 MiB/s wr, 1.10k op/s; 2/379587 objects misplaced (0.001%) 2024-02-19T21:46:02.520 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:01.146968+0000 osd.0 (osd.0) 220 : cluster [DBG] 6.9 scrub starts 2024-02-19T21:46:02.520 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:01.176534+0000 osd.0 (osd.0) 221 : cluster [DBG] 6.9 scrub ok 2024-02-19T21:46:02.520 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:01.975736+0000 osd.5 (osd.5) 221 : cluster [DBG] 6.a scrub starts 2024-02-19T21:46:02.520 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:01.981858+0000 osd.5 (osd.5) 222 : cluster [DBG] 6.a scrub ok 2024-02-19T21:46:02.583 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:46:02.648 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:02.681 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:46:02.691 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:02.691 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:01.084333+0000 mgr.y (mgr.14514) 518 : cluster [DBG] pgmap v650: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 7.7 GiB data, 26 GiB used, 600 GiB / 626 GiB avail; 1023 B/s rd, 69 MiB/s wr, 1.10k op/s; 2/379587 objects misplaced (0.001%) 2024-02-19T21:46:02.691 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:01.146968+0000 osd.0 (osd.0) 220 : cluster [DBG] 6.9 scrub starts 2024-02-19T21:46:02.691 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:01.176534+0000 osd.0 (osd.0) 221 : cluster [DBG] 6.9 scrub ok 2024-02-19T21:46:02.691 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:01.975736+0000 osd.5 (osd.5) 221 : cluster [DBG] 6.a scrub starts 2024-02-19T21:46:02.691 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:01.981858+0000 osd.5 (osd.5) 222 : cluster [DBG] 6.a scrub ok 2024-02-19T21:46:02.692 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:46:02.793 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:46:02.842 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:02.874 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:46:02.878 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:02.878 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:46:02.885 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:46:02.940 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:46:02.979 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:46:03.021 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:03.064 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:46:03.069 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:03.069 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:46:03.170 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:46:03.229 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:03.265 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:46:03.270 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:03.271 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:46:03.372 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:46:03.428 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:03.463 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:46:03.466 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:03.467 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:46:03.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:02.149221+0000 osd.0 (osd.0) 222 : cluster [DBG] 6.f scrub starts 2024-02-19T21:46:03.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:02.241311+0000 osd.0 (osd.0) 223 : cluster [DBG] 6.f scrub ok 2024-02-19T21:46:03.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:02.926694+0000 osd.1 (osd.1) 205 : cluster [DBG] 6.e scrub starts 2024-02-19T21:46:03.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:02.939406+0000 osd.1 (osd.1) 206 : cluster [DBG] 6.e scrub ok 2024-02-19T21:46:03.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:03.023730+0000 osd.6 (osd.6) 189 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:46:03.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:03.034834+0000 osd.6 (osd.6) 190 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:46:03.567 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:46:03.627 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:03.668 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:46:03.672 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:03.673 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:46:03.734 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:02.149221+0000 osd.0 (osd.0) 222 : cluster [DBG] 6.f scrub starts 2024-02-19T21:46:03.734 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:02.241311+0000 osd.0 (osd.0) 223 : cluster [DBG] 6.f scrub ok 2024-02-19T21:46:03.734 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:02.926694+0000 osd.1 (osd.1) 205 : cluster [DBG] 6.e scrub starts 2024-02-19T21:46:03.734 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:02.939406+0000 osd.1 (osd.1) 206 : cluster [DBG] 6.e scrub ok 2024-02-19T21:46:03.734 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:03.023730+0000 osd.6 (osd.6) 189 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:46:03.735 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:03.034834+0000 osd.6 (osd.6) 190 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:46:03.735 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:02.149221+0000 osd.0 (osd.0) 222 : cluster [DBG] 6.f scrub starts 2024-02-19T21:46:03.735 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:02.241311+0000 osd.0 (osd.0) 223 : cluster [DBG] 6.f scrub ok 2024-02-19T21:46:03.735 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:02.926694+0000 osd.1 (osd.1) 205 : cluster [DBG] 6.e scrub starts 2024-02-19T21:46:03.735 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:02.939406+0000 osd.1 (osd.1) 206 : cluster [DBG] 6.e scrub ok 2024-02-19T21:46:03.735 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:03.023730+0000 osd.6 (osd.6) 189 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:46:03.735 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:03.034834+0000 osd.6 (osd.6) 190 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:46:03.774 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:46:03.840 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:03.870 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:46:03.874 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:03.875 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:46:03.975 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:46:04.025 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set noscrub 2024-02-19T21:46:04.026 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:04.404 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:46:04.407 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:04.408 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:46:04.509 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:46:04.572 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:04.609 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:46:04.612 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:04.612 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:46:04.713 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:46:04.746 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:03.084683+0000 mgr.y (mgr.14514) 519 : cluster [DBG] pgmap v651: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 7.7 GiB data, 26 GiB used, 600 GiB / 626 GiB avail; 1023 B/s rd, 69 MiB/s wr, 1.10k op/s; 2/379587 objects misplaced (0.001%) 2024-02-19T21:46:04.746 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:03.533088+0000 osd.1 (osd.1) 207 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:46:04.746 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:03.533147+0000 osd.1 (osd.1) 208 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:46:04.746 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:03.960024+0000 osd.5 (osd.5) 223 : cluster [DBG] 6.7 deep-scrub starts 2024-02-19T21:46:04.747 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:03.963969+0000 mon.a (mon.0) 1387 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:46:04.747 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:04.035127+0000 osd.5 (osd.5) 224 : cluster [DBG] 6.7 deep-scrub ok 2024-02-19T21:46:04.747 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:04.072865+0000 osd.6 (osd.6) 191 : cluster [DBG] 6.2 scrub starts 2024-02-19T21:46:04.747 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:04.080889+0000 osd.6 (osd.6) 192 : cluster [DBG] 6.2 scrub ok 2024-02-19T21:46:04.747 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:04.103043+0000 osd.0 (osd.0) 224 : cluster [DBG] 6.16 scrub starts 2024-02-19T21:46:04.747 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:04.121763+0000 osd.0 (osd.0) 225 : cluster [DBG] 6.16 scrub ok 2024-02-19T21:46:04.747 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:03.084683+0000 mgr.y (mgr.14514) 519 : cluster [DBG] pgmap v651: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 7.7 GiB data, 26 GiB used, 600 GiB / 626 GiB avail; 1023 B/s rd, 69 MiB/s wr, 1.10k op/s; 2/379587 objects misplaced (0.001%) 2024-02-19T21:46:04.747 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:03.533088+0000 osd.1 (osd.1) 207 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:46:04.747 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:03.533147+0000 osd.1 (osd.1) 208 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:46:04.747 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:03.960024+0000 osd.5 (osd.5) 223 : cluster [DBG] 6.7 deep-scrub starts 2024-02-19T21:46:04.747 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:03.963969+0000 mon.a (mon.0) 1387 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:46:04.747 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:04.035127+0000 osd.5 (osd.5) 224 : cluster [DBG] 6.7 deep-scrub ok 2024-02-19T21:46:04.748 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:04.072865+0000 osd.6 (osd.6) 191 : cluster [DBG] 6.2 scrub starts 2024-02-19T21:46:04.748 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:04.080889+0000 osd.6 (osd.6) 192 : cluster [DBG] 6.2 scrub ok 2024-02-19T21:46:04.748 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:04.103043+0000 osd.0 (osd.0) 224 : cluster [DBG] 6.16 scrub starts 2024-02-19T21:46:04.748 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:04.121763+0000 osd.0 (osd.0) 225 : cluster [DBG] 6.16 scrub ok 2024-02-19T21:46:04.779 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:03.084683+0000 mgr.y (mgr.14514) 519 : cluster [DBG] pgmap v651: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 7.7 GiB data, 26 GiB used, 600 GiB / 626 GiB avail; 1023 B/s rd, 69 MiB/s wr, 1.10k op/s; 2/379587 objects misplaced (0.001%) 2024-02-19T21:46:04.780 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:03.533088+0000 osd.1 (osd.1) 207 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:46:04.780 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:03.533147+0000 osd.1 (osd.1) 208 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:46:04.780 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:03.960024+0000 osd.5 (osd.5) 223 : cluster [DBG] 6.7 deep-scrub starts 2024-02-19T21:46:04.780 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:03.963969+0000 mon.a (mon.0) 1387 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:46:04.780 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:04.035127+0000 osd.5 (osd.5) 224 : cluster [DBG] 6.7 deep-scrub ok 2024-02-19T21:46:04.780 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:04.072865+0000 osd.6 (osd.6) 191 : cluster [DBG] 6.2 scrub starts 2024-02-19T21:46:04.780 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:04.080889+0000 osd.6 (osd.6) 192 : cluster [DBG] 6.2 scrub ok 2024-02-19T21:46:04.780 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:04.103043+0000 osd.0 (osd.0) 224 : cluster [DBG] 6.16 scrub starts 2024-02-19T21:46:04.780 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:04.121763+0000 osd.0 (osd.0) 225 : cluster [DBG] 6.16 scrub ok 2024-02-19T21:46:04.784 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:04.814 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:46:04.821 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:04.821 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:46:04.922 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:46:04.965 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:05.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:04.455413+0000 mon.a (mon.0) 1388 : cluster [DBG] osdmap e324: 8 total, 8 up, 7 in 2024-02-19T21:46:05.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:04.952599+0000 osd.5 (osd.5) 225 : cluster [DBG] 6.1a scrub starts 2024-02-19T21:46:05.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:04.955397+0000 osd.5 (osd.5) 226 : cluster [DBG] 6.1a scrub ok 2024-02-19T21:46:05.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:05.093451+0000 osd.6 (osd.6) 193 : cluster [DBG] 4.a scrub starts 2024-02-19T21:46:05.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:05.098190+0000 osd.6 (osd.6) 194 : cluster [DBG] 4.a scrub ok 2024-02-19T21:46:05.810 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:46:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:46:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:46:05.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:04.455413+0000 mon.a (mon.0) 1388 : cluster [DBG] osdmap e324: 8 total, 8 up, 7 in 2024-02-19T21:46:05.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:04.952599+0000 osd.5 (osd.5) 225 : cluster [DBG] 6.1a scrub starts 2024-02-19T21:46:05.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:04.955397+0000 osd.5 (osd.5) 226 : cluster [DBG] 6.1a scrub ok 2024-02-19T21:46:05.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:05.093451+0000 osd.6 (osd.6) 193 : cluster [DBG] 4.a scrub starts 2024-02-19T21:46:05.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:05.098190+0000 osd.6 (osd.6) 194 : cluster [DBG] 4.a scrub ok 2024-02-19T21:46:05.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:04.455413+0000 mon.a (mon.0) 1388 : cluster [DBG] osdmap e324: 8 total, 8 up, 7 in 2024-02-19T21:46:05.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:04.952599+0000 osd.5 (osd.5) 225 : cluster [DBG] 6.1a scrub starts 2024-02-19T21:46:05.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:04.955397+0000 osd.5 (osd.5) 226 : cluster [DBG] 6.1a scrub ok 2024-02-19T21:46:05.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:05.093451+0000 osd.6 (osd.6) 193 : cluster [DBG] 4.a scrub starts 2024-02-19T21:46:05.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:05.098190+0000 osd.6 (osd.6) 194 : cluster [DBG] 4.a scrub ok 2024-02-19T21:46:06.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:05.085339+0000 mgr.y (mgr.14514) 520 : cluster [DBG] pgmap v653: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 7.7 GiB data, 26 GiB used, 600 GiB / 626 GiB avail; 639 B/s rd, 52 MiB/s wr, 1.02k op/s; 2/378105 objects misplaced (0.001%) 2024-02-19T21:46:06.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:05.101200+0000 osd.4 (osd.4) 162 : cluster [DBG] 2.f scrub starts 2024-02-19T21:46:06.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:05.104761+0000 osd.4 (osd.4) 163 : cluster [DBG] 2.f scrub ok 2024-02-19T21:46:06.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:05.206011+0000 osd.7 (osd.7) 204 : cluster [DBG] 5.9 deep-scrub starts 2024-02-19T21:46:06.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:05.210087+0000 osd.7 (osd.7) 205 : cluster [DBG] 5.9 deep-scrub ok 2024-02-19T21:46:06.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:06.094907+0000 osd.0 (osd.0) 226 : cluster [DBG] 6.10 deep-scrub starts 2024-02-19T21:46:06.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:06.096413+0000 osd.0 (osd.0) 227 : cluster [DBG] 6.10 deep-scrub ok 2024-02-19T21:46:06.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:05.085339+0000 mgr.y (mgr.14514) 520 : cluster [DBG] pgmap v653: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 7.7 GiB data, 26 GiB used, 600 GiB / 626 GiB avail; 639 B/s rd, 52 MiB/s wr, 1.02k op/s; 2/378105 objects misplaced (0.001%) 2024-02-19T21:46:06.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:05.101200+0000 osd.4 (osd.4) 162 : cluster [DBG] 2.f scrub starts 2024-02-19T21:46:06.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:05.104761+0000 osd.4 (osd.4) 163 : cluster [DBG] 2.f scrub ok 2024-02-19T21:46:06.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:05.206011+0000 osd.7 (osd.7) 204 : cluster [DBG] 5.9 deep-scrub starts 2024-02-19T21:46:06.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:05.210087+0000 osd.7 (osd.7) 205 : cluster [DBG] 5.9 deep-scrub ok 2024-02-19T21:46:06.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:06.094907+0000 osd.0 (osd.0) 226 : cluster [DBG] 6.10 deep-scrub starts 2024-02-19T21:46:06.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:06.096413+0000 osd.0 (osd.0) 227 : cluster [DBG] 6.10 deep-scrub ok 2024-02-19T21:46:06.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:05.085339+0000 mgr.y (mgr.14514) 520 : cluster [DBG] pgmap v653: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 7.7 GiB data, 26 GiB used, 600 GiB / 626 GiB avail; 639 B/s rd, 52 MiB/s wr, 1.02k op/s; 2/378105 objects misplaced (0.001%) 2024-02-19T21:46:06.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:05.101200+0000 osd.4 (osd.4) 162 : cluster [DBG] 2.f scrub starts 2024-02-19T21:46:06.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:05.104761+0000 osd.4 (osd.4) 163 : cluster [DBG] 2.f scrub ok 2024-02-19T21:46:06.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:05.206011+0000 osd.7 (osd.7) 204 : cluster [DBG] 5.9 deep-scrub starts 2024-02-19T21:46:06.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:05.210087+0000 osd.7 (osd.7) 205 : cluster [DBG] 5.9 deep-scrub ok 2024-02-19T21:46:06.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:06.094907+0000 osd.0 (osd.0) 226 : cluster [DBG] 6.10 deep-scrub starts 2024-02-19T21:46:06.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:06.096413+0000 osd.0 (osd.0) 227 : cluster [DBG] 6.10 deep-scrub ok 2024-02-19T21:46:07.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:06.115227+0000 osd.4 (osd.4) 164 : cluster [DBG] 5.a scrub starts 2024-02-19T21:46:07.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:06.123405+0000 osd.4 (osd.4) 165 : cluster [DBG] 5.a scrub ok 2024-02-19T21:46:07.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:06.962686+0000 osd.5 (osd.5) 227 : cluster [DBG] 6.19 scrub starts 2024-02-19T21:46:07.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:07.005229+0000 osd.5 (osd.5) 228 : cluster [DBG] 6.19 scrub ok 2024-02-19T21:46:07.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:07.081463+0000 osd.6 (osd.6) 195 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:46:07.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:07.091403+0000 osd.6 (osd.6) 196 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:46:07.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:06.115227+0000 osd.4 (osd.4) 164 : cluster [DBG] 5.a scrub starts 2024-02-19T21:46:07.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:06.123405+0000 osd.4 (osd.4) 165 : cluster [DBG] 5.a scrub ok 2024-02-19T21:46:07.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:06.962686+0000 osd.5 (osd.5) 227 : cluster [DBG] 6.19 scrub starts 2024-02-19T21:46:07.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:07.005229+0000 osd.5 (osd.5) 228 : cluster [DBG] 6.19 scrub ok 2024-02-19T21:46:07.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:07.081463+0000 osd.6 (osd.6) 195 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:46:07.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:07.091403+0000 osd.6 (osd.6) 196 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:46:07.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:06.115227+0000 osd.4 (osd.4) 164 : cluster [DBG] 5.a scrub starts 2024-02-19T21:46:07.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:06.123405+0000 osd.4 (osd.4) 165 : cluster [DBG] 5.a scrub ok 2024-02-19T21:46:07.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:06.962686+0000 osd.5 (osd.5) 227 : cluster [DBG] 6.19 scrub starts 2024-02-19T21:46:07.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:07.005229+0000 osd.5 (osd.5) 228 : cluster [DBG] 6.19 scrub ok 2024-02-19T21:46:07.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:07.081463+0000 osd.6 (osd.6) 195 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:46:07.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:07.091403+0000 osd.6 (osd.6) 196 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:46:08.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:07.085893+0000 mgr.y (mgr.14514) 521 : cluster [DBG] pgmap v654: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 7.6 GiB data, 26 GiB used, 600 GiB / 626 GiB avail; 1.4 KiB/s rd, 62 MiB/s wr, 1.42k op/s; 2/376155 objects misplaced (0.001%) 2024-02-19T21:46:08.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:07.548363+0000 osd.3 (osd.3) 210 : cluster [DBG] 4.14 scrub starts 2024-02-19T21:46:08.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:07.553682+0000 osd.3 (osd.3) 211 : cluster [DBG] 4.14 scrub ok 2024-02-19T21:46:08.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:08.042450+0000 osd.6 (osd.6) 197 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:46:08.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:08.045810+0000 osd.6 (osd.6) 198 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:46:08.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:08.102841+0000 osd.0 (osd.0) 228 : cluster [DBG] 4.6 deep-scrub starts 2024-02-19T21:46:08.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:08.110957+0000 osd.0 (osd.0) 229 : cluster [DBG] 4.6 deep-scrub ok 2024-02-19T21:46:08.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:07.085893+0000 mgr.y (mgr.14514) 521 : cluster [DBG] pgmap v654: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 7.6 GiB data, 26 GiB used, 600 GiB / 626 GiB avail; 1.4 KiB/s rd, 62 MiB/s wr, 1.42k op/s; 2/376155 objects misplaced (0.001%) 2024-02-19T21:46:08.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:07.548363+0000 osd.3 (osd.3) 210 : cluster [DBG] 4.14 scrub starts 2024-02-19T21:46:08.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:07.553682+0000 osd.3 (osd.3) 211 : cluster [DBG] 4.14 scrub ok 2024-02-19T21:46:08.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:08.042450+0000 osd.6 (osd.6) 197 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:46:08.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:08.045810+0000 osd.6 (osd.6) 198 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:46:08.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:08.102841+0000 osd.0 (osd.0) 228 : cluster [DBG] 4.6 deep-scrub starts 2024-02-19T21:46:08.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:08.110957+0000 osd.0 (osd.0) 229 : cluster [DBG] 4.6 deep-scrub ok 2024-02-19T21:46:08.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:07.085893+0000 mgr.y (mgr.14514) 521 : cluster [DBG] pgmap v654: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 7.6 GiB data, 26 GiB used, 600 GiB / 626 GiB avail; 1.4 KiB/s rd, 62 MiB/s wr, 1.42k op/s; 2/376155 objects misplaced (0.001%) 2024-02-19T21:46:08.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:07.548363+0000 osd.3 (osd.3) 210 : cluster [DBG] 4.14 scrub starts 2024-02-19T21:46:08.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:07.553682+0000 osd.3 (osd.3) 211 : cluster [DBG] 4.14 scrub ok 2024-02-19T21:46:08.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:08.042450+0000 osd.6 (osd.6) 197 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:46:08.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:08.045810+0000 osd.6 (osd.6) 198 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:46:08.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:08.102841+0000 osd.0 (osd.0) 228 : cluster [DBG] 4.6 deep-scrub starts 2024-02-19T21:46:08.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:08.110957+0000 osd.0 (osd.0) 229 : cluster [DBG] 4.6 deep-scrub ok 2024-02-19T21:46:09.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:08.901145+0000 osd.5 (osd.5) 229 : cluster [DBG] 6.17 scrub starts 2024-02-19T21:46:09.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:08.983916+0000 osd.5 (osd.5) 230 : cluster [DBG] 6.17 scrub ok 2024-02-19T21:46:09.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:08.901145+0000 osd.5 (osd.5) 229 : cluster [DBG] 6.17 scrub starts 2024-02-19T21:46:09.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:08.983916+0000 osd.5 (osd.5) 230 : cluster [DBG] 6.17 scrub ok 2024-02-19T21:46:09.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:08.901145+0000 osd.5 (osd.5) 229 : cluster [DBG] 6.17 scrub starts 2024-02-19T21:46:09.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:08.983916+0000 osd.5 (osd.5) 230 : cluster [DBG] 6.17 scrub ok 2024-02-19T21:46:10.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:09.086249+0000 mgr.y (mgr.14514) 522 : cluster [DBG] pgmap v655: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 7.6 GiB data, 26 GiB used, 600 GiB / 626 GiB avail; 708 B/s rd, 16 MiB/s wr, 652 op/s; 2/376155 objects misplaced (0.001%) 2024-02-19T21:46:10.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:09.114806+0000 osd.4 (osd.4) 166 : cluster [DBG] 9.e deep-scrub starts 2024-02-19T21:46:10.774 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:46:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:46:10] "GET /metrics HTTP/1.1" 200 176118 "" "Prometheus/2.33.4" 2024-02-19T21:46:10.775 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:09.086249+0000 mgr.y (mgr.14514) 522 : cluster [DBG] pgmap v655: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 7.6 GiB data, 26 GiB used, 600 GiB / 626 GiB avail; 708 B/s rd, 16 MiB/s wr, 652 op/s; 2/376155 objects misplaced (0.001%) 2024-02-19T21:46:10.775 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:09.114806+0000 osd.4 (osd.4) 166 : cluster [DBG] 9.e deep-scrub starts 2024-02-19T21:46:10.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:09.086249+0000 mgr.y (mgr.14514) 522 : cluster [DBG] pgmap v655: 138 pgs: 1 active+remapped+backfill_toofull, 137 active+clean; 7.6 GiB data, 26 GiB used, 600 GiB / 626 GiB avail; 708 B/s rd, 16 MiB/s wr, 652 op/s; 2/376155 objects misplaced (0.001%) 2024-02-19T21:46:10.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:09.114806+0000 osd.4 (osd.4) 166 : cluster [DBG] 9.e deep-scrub starts 2024-02-19T21:46:10.807 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:46:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:46:10.902 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:46:10.914 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:10.914 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:46:11.015 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:46:11.067 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:11.173 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:46:11.177 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:11.178 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:46:11.278 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:46:11.323 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:11.487 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:46:11.491 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:11.491 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:46:11.592 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:46:11.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:10.635635+0000 mgr.y (mgr.14514) 523 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:46:11.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:10.635635+0000 mgr.y (mgr.14514) 523 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:46:11.639 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:11.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:10.635635+0000 mgr.y (mgr.14514) 523 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:46:12.299 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:46:12.302 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:12.303 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:46:12.404 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:46:12.452 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:12.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:11.087110+0000 mgr.y (mgr.14514) 524 : cluster [DBG] pgmap v656: 138 pgs: 1 active+clean+scrubbing+deep, 1 active+remapped+backfill_toofull, 136 active+clean; 7.3 GiB data, 25 GiB used, 601 GiB / 626 GiB avail; 1.1 KiB/s rd, 14 MiB/s wr, 1.13k op/s; 2/359172 objects misplaced (0.001%) 2024-02-19T21:46:12.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:11.087110+0000 mgr.y (mgr.14514) 524 : cluster [DBG] pgmap v656: 138 pgs: 1 active+clean+scrubbing+deep, 1 active+remapped+backfill_toofull, 136 active+clean; 7.3 GiB data, 25 GiB used, 601 GiB / 626 GiB avail; 1.1 KiB/s rd, 14 MiB/s wr, 1.13k op/s; 2/359172 objects misplaced (0.001%) 2024-02-19T21:46:12.657 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:46:12.665 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:12.665 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:46:12.766 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:46:12.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:11.087110+0000 mgr.y (mgr.14514) 524 : cluster [DBG] pgmap v656: 138 pgs: 1 active+clean+scrubbing+deep, 1 active+remapped+backfill_toofull, 136 active+clean; 7.3 GiB data, 25 GiB used, 601 GiB / 626 GiB avail; 1.1 KiB/s rd, 14 MiB/s wr, 1.13k op/s; 2/359172 objects misplaced (0.001%) 2024-02-19T21:46:12.831 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:13.208 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:46:13.247 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:46:13.260 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:46:13.260 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-02-19T21:46:13.260 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-02-19T21:46:13.260 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-02-19T21:46:13.260 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:46:13.273 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:46:13.303 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:46:13.331 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:46:13.362 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:46:13.402 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:46:13.428 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:46:13.439 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:46:13.439 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:46:13.439 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:46:13.439 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:46:13.440 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:46:13.440 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:46:13.440 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:46:13.440 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:46:13.495 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:46:13.550 INFO:teuthology.orchestra.run.smithi080.stderr:set pool 5 pgp_num to 22 2024-02-19T21:46:13.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:12.995574+0000 mon.c (mon.2) 73 : audit [INF] from='client.? 172.21.15.80:0/3927550752' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pgp_num", "val": "22"}]: dispatch 2024-02-19T21:46:13.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:12.998679+0000 mon.a (mon.0) 1389 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pgp_num", "val": "22"}]: dispatch 2024-02-19T21:46:13.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:13.156424+0000 mon.b (mon.1) 54 : audit [DBG] from='client.? 172.21.15.80:0/2315127454' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:46:13.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:12.995574+0000 mon.c (mon.2) 73 : audit [INF] from='client.? 172.21.15.80:0/3927550752' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pgp_num", "val": "22"}]: dispatch 2024-02-19T21:46:13.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:12.998679+0000 mon.a (mon.0) 1389 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pgp_num", "val": "22"}]: dispatch 2024-02-19T21:46:13.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:13.156424+0000 mon.b (mon.1) 54 : audit [DBG] from='client.? 172.21.15.80:0/2315127454' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:46:13.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:12.995574+0000 mon.c (mon.2) 73 : audit [INF] from='client.? 172.21.15.80:0/3927550752' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pgp_num", "val": "22"}]: dispatch 2024-02-19T21:46:13.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:12.998679+0000 mon.a (mon.0) 1389 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pgp_num", "val": "22"}]: dispatch 2024-02-19T21:46:13.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:13.156424+0000 mon.b (mon.1) 54 : audit [DBG] from='client.? 172.21.15.80:0/2315127454' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:46:13.938 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:46:13.943 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:13.944 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:46:14.045 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:46:14.085 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:14.297 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:46:14.305 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:14.305 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:46:14.406 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:46:14.457 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:14.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:13.087487+0000 mgr.y (mgr.14514) 525 : cluster [DBG] pgmap v657: 138 pgs: 1 active+clean+scrubbing+deep, 1 active+remapped+backfill_toofull, 136 active+clean; 7.3 GiB data, 25 GiB used, 601 GiB / 626 GiB avail; 1.1 KiB/s rd, 14 MiB/s wr, 1.13k op/s; 2/359172 objects misplaced (0.001%) 2024-02-19T21:46:14.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:13.521115+0000 mon.a (mon.0) 1390 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pgp_num", "val": "22"}]': finished 2024-02-19T21:46:14.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:13.521181+0000 mon.a (mon.0) 1391 : cluster [DBG] osdmap e325: 8 total, 8 up, 7 in 2024-02-19T21:46:14.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:13.087487+0000 mgr.y (mgr.14514) 525 : cluster [DBG] pgmap v657: 138 pgs: 1 active+clean+scrubbing+deep, 1 active+remapped+backfill_toofull, 136 active+clean; 7.3 GiB data, 25 GiB used, 601 GiB / 626 GiB avail; 1.1 KiB/s rd, 14 MiB/s wr, 1.13k op/s; 2/359172 objects misplaced (0.001%) 2024-02-19T21:46:14.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:13.521115+0000 mon.a (mon.0) 1390 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pgp_num", "val": "22"}]': finished 2024-02-19T21:46:14.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:13.521181+0000 mon.a (mon.0) 1391 : cluster [DBG] osdmap e325: 8 total, 8 up, 7 in 2024-02-19T21:46:14.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:13.087487+0000 mgr.y (mgr.14514) 525 : cluster [DBG] pgmap v657: 138 pgs: 1 active+clean+scrubbing+deep, 1 active+remapped+backfill_toofull, 136 active+clean; 7.3 GiB data, 25 GiB used, 601 GiB / 626 GiB avail; 1.1 KiB/s rd, 14 MiB/s wr, 1.13k op/s; 2/359172 objects misplaced (0.001%) 2024-02-19T21:46:14.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:13.521115+0000 mon.a (mon.0) 1390 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.control", "var": "pgp_num", "val": "22"}]': finished 2024-02-19T21:46:14.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:13.521181+0000 mon.a (mon.0) 1391 : cluster [DBG] osdmap e325: 8 total, 8 up, 7 in 2024-02-19T21:46:15.405 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.3 dump_historic_ops 2024-02-19T21:46:16.057 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:46:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:46:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:46:16.124 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:46:16.135 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:16.136 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:46:16.237 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:46:16.277 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:16.304 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:46:16.325 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:16.325 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:46:16.426 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:46:16.460 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:15.088546+0000 mgr.y (mgr.14514) 526 : cluster [DBG] pgmap v659: 138 pgs: 1 active+clean+scrubbing+deep, 1 active+remapped+backfill_toofull, 136 active+clean; 7.2 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 1.1 KiB/s rd, 7.9 MiB/s wr, 1.10k op/s; 2/352608 objects misplaced (0.001%) 2024-02-19T21:46:16.460 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:15.164444+0000 mon.a (mon.0) 1392 : cluster [DBG] osdmap e326: 8 total, 8 up, 7 in 2024-02-19T21:46:16.467 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:16.490 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:46:16.496 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:16.496 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:46:16.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:15.088546+0000 mgr.y (mgr.14514) 526 : cluster [DBG] pgmap v659: 138 pgs: 1 active+clean+scrubbing+deep, 1 active+remapped+backfill_toofull, 136 active+clean; 7.2 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 1.1 KiB/s rd, 7.9 MiB/s wr, 1.10k op/s; 2/352608 objects misplaced (0.001%) 2024-02-19T21:46:16.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:15.164444+0000 mon.a (mon.0) 1392 : cluster [DBG] osdmap e326: 8 total, 8 up, 7 in 2024-02-19T21:46:16.597 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:46:16.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:15.088546+0000 mgr.y (mgr.14514) 526 : cluster [DBG] pgmap v659: 138 pgs: 1 active+clean+scrubbing+deep, 1 active+remapped+backfill_toofull, 136 active+clean; 7.2 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 1.1 KiB/s rd, 7.9 MiB/s wr, 1.10k op/s; 2/352608 objects misplaced (0.001%) 2024-02-19T21:46:16.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:15.164444+0000 mon.a (mon.0) 1392 : cluster [DBG] osdmap e326: 8 total, 8 up, 7 in 2024-02-19T21:46:16.642 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:16.670 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:46:16.673 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:16.673 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:46:16.675 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:46:16.774 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:46:16.836 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:16.887 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:46:16.895 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:16.895 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:46:16.996 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:46:17.009 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:46:17.043 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:17.502 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:46:17.513 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:17.514 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:46:17.615 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:46:17.655 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:17.690 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:46:17.702 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:17.702 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:46:17.803 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:46:17.867 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:18.190 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:17.088994+0000 mgr.y (mgr.14514) 527 : cluster [DBG] pgmap v661: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing+deep, 136 active+clean; 7.0 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.33k op/s; 2/344124 objects misplaced (0.001%) 2024-02-19T21:46:18.190 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:17.725576+0000 mon.b (mon.1) 55 : audit [INF] from='client.? 172.21.15.80:0/1112209442' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:46:18.190 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:17.726286+0000 mon.a (mon.0) 1393 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:46:18.191 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:17.088994+0000 mgr.y (mgr.14514) 527 : cluster [DBG] pgmap v661: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing+deep, 136 active+clean; 7.0 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.33k op/s; 2/344124 objects misplaced (0.001%) 2024-02-19T21:46:18.191 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:17.725576+0000 mon.b (mon.1) 55 : audit [INF] from='client.? 172.21.15.80:0/1112209442' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:46:18.191 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:17.726286+0000 mon.a (mon.0) 1393 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:46:18.193 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-02-19T21:46:18.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:17.088994+0000 mgr.y (mgr.14514) 527 : cluster [DBG] pgmap v661: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing+deep, 136 active+clean; 7.0 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.33k op/s; 2/344124 objects misplaced (0.001%) 2024-02-19T21:46:18.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:17.725576+0000 mon.b (mon.1) 55 : audit [INF] from='client.? 172.21.15.80:0/1112209442' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:46:18.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:17.726286+0000 mon.a (mon.0) 1393 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:46:19.023 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:46:19.031 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:19.031 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:46:19.132 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:46:19.198 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:19.221 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:46:19.223 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:19.224 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:46:19.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:18.164290+0000 mon.a (mon.0) 1394 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:46:19.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:18.174920+0000 mon.a (mon.0) 1395 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:46:19.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:18.174981+0000 mon.a (mon.0) 1396 : cluster [DBG] osdmap e327: 8 total, 8 up, 7 in 2024-02-19T21:46:19.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:18.959626+0000 mon.a (mon.0) 1397 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:46:19.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:18.164290+0000 mon.a (mon.0) 1394 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:46:19.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:18.174920+0000 mon.a (mon.0) 1395 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:46:19.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:18.174981+0000 mon.a (mon.0) 1396 : cluster [DBG] osdmap e327: 8 total, 8 up, 7 in 2024-02-19T21:46:19.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:18.959626+0000 mon.a (mon.0) 1397 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:46:19.325 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:46:19.381 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:19.411 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:46:19.420 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:19.420 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:46:19.521 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:46:19.529 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:46:19.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:18.164290+0000 mon.a (mon.0) 1394 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:46:19.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:18.174920+0000 mon.a (mon.0) 1395 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:46:19.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:18.174981+0000 mon.a (mon.0) 1396 : cluster [DBG] osdmap e327: 8 total, 8 up, 7 in 2024-02-19T21:46:19.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:18.959626+0000 mon.a (mon.0) 1397 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:46:19.561 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:19.589 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:46:19.591 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:19.592 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:46:19.608 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:46:19.608 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:46:19.693 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:46:19.743 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:20.013 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:46:20.017 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:20.017 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:46:20.118 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:46:20.201 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:20.238 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:46:20.246 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:20.246 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:46:20.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:19.089322+0000 mgr.y (mgr.14514) 528 : cluster [DBG] pgmap v663: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing+deep, 136 active+clean; 7.0 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 836 op/s; 2/344124 objects misplaced (0.001%) 2024-02-19T21:46:20.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:20.164256+0000 mon.a (mon.0) 1398 : cluster [DBG] osdmap e328: 8 total, 8 up, 7 in 2024-02-19T21:46:20.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:19.089322+0000 mgr.y (mgr.14514) 528 : cluster [DBG] pgmap v663: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing+deep, 136 active+clean; 7.0 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 836 op/s; 2/344124 objects misplaced (0.001%) 2024-02-19T21:46:20.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:20.164256+0000 mon.a (mon.0) 1398 : cluster [DBG] osdmap e328: 8 total, 8 up, 7 in 2024-02-19T21:46:20.347 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:46:20.386 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:20.529 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:46:20.534 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:20.535 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:46:20.552 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.4 dump_ops_in_flight 2024-02-19T21:46:20.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:19.089322+0000 mgr.y (mgr.14514) 528 : cluster [DBG] pgmap v663: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing+deep, 136 active+clean; 7.0 GiB data, 24 GiB used, 602 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 836 op/s; 2/344124 objects misplaced (0.001%) 2024-02-19T21:46:20.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:20.164256+0000 mon.a (mon.0) 1398 : cluster [DBG] osdmap e328: 8 total, 8 up, 7 in 2024-02-19T21:46:20.636 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:46:20.698 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:20.729 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:20.730 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:46:20.730 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:46:20.831 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:46:20.871 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:21.008 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:46:21.010 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:46:21.012 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:21.012 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:46:21.012 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:46:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:46:20] "GET /metrics HTTP/1.1" 200 176129 "" "Prometheus/2.33.4" 2024-02-19T21:46:21.031 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-19T21:46:21.057 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:46:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:46:21.113 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:46:21.143 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 6, 7] out_osds: [2] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:46:21.143 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:46:21.143 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-02-19T21:46:21.143 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-02-19T21:46:21.143 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-02-19T21:46:21.144 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.2 config set filestore_inject_stall 3 2024-02-19T21:46:21.147 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:21.210 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:46:21.215 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:21.216 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:46:21.317 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:46:21.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:20.648369+0000 mgr.y (mgr.14514) 529 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:46:21.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:20.648369+0000 mgr.y (mgr.14514) 529 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:46:21.390 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:21.401 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:20.648369+0000 mgr.y (mgr.14514) 529 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:46:21.417 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:46:21.422 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:21.422 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:46:21.523 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:46:21.558 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:21.646 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:46:21.651 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:21.651 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:46:21.752 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:46:21.807 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:22.025 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:46:22.030 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:22.031 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:46:22.131 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:46:22.181 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:22.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:21.089829+0000 mgr.y (mgr.14514) 530 : cluster [DBG] pgmap v665: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing+deep, 136 active+clean; 6.7 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.29k op/s; 2/329334 objects misplaced (0.001%) 2024-02-19T21:46:22.351 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:46:22.353 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:21.089829+0000 mgr.y (mgr.14514) 530 : cluster [DBG] pgmap v665: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing+deep, 136 active+clean; 6.7 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.29k op/s; 2/329334 objects misplaced (0.001%) 2024-02-19T21:46:22.353 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:46:22.361 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:46:22.409 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:46:22.433 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:46:22.458 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:46:22.493 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:46:22.531 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:46:22.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:21.089829+0000 mgr.y (mgr.14514) 530 : cluster [DBG] pgmap v665: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing+deep, 136 active+clean; 6.7 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.29k op/s; 2/329334 objects misplaced (0.001%) 2024-02-19T21:46:22.562 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:46:22.593 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:46:22.594 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:46:22.594 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:46:22.594 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:46:22.595 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:46:22.595 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:46:22.595 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:46:22.595 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:46:22.595 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:46:23.048 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:46:23.055 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:23.056 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:46:23.156 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:46:23.200 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:23.225 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:22.306427+0000 mon.b (mon.1) 56 : audit [DBG] from='client.? 172.21.15.80:0/3330951964' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:46:23.225 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:22.306427+0000 mon.b (mon.1) 56 : audit [DBG] from='client.? 172.21.15.80:0/3330951964' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:46:23.268 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:46:23.275 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:23.275 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:46:23.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:22.306427+0000 mon.b (mon.1) 56 : audit [DBG] from='client.? 172.21.15.80:0/3330951964' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:46:23.370 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:46:23.370 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [ 2024-02-19T21:46:23.370 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.370 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:150615 9.e 9:74542f76:::benchmark_data_smithi080_126364_object22023:head [delete] snapc 0=[] ondisk+write+known_if_redirected e328)", 2024-02-19T21:46:23.370 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:46:23.351019+0000", 2024-02-19T21:46:23.371 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.018740515999999999, 2024-02-19T21:46:23.371 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.018770113000000001, 2024-02-19T21:46:23.371 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:46:23.371 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:46:23.371 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:46:23.371 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:46:23.372 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:46:23.372 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 150615 2024-02-19T21:46:23.372 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.372 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:46:23.372 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.372 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:46:23.372 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.351019+0000", 2024-02-19T21:46:23.373 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:46:23.373 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.373 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.373 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:46:23.373 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.351019+0000", 2024-02-19T21:46:23.373 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:46:23.373 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.374 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.374 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:46:23.374 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.351018+0000", 2024-02-19T21:46:23.374 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.1600000000000004e-06 2024-02-19T21:46:23.374 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.374 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.375 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:46:23.375 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.351027+0000", 2024-02-19T21:46:23.375 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.031e-05 2024-02-19T21:46:23.375 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.375 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.375 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:46:23.375 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.351038+0000", 2024-02-19T21:46:23.375 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.6309999999999997e-06 2024-02-19T21:46:23.375 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.376 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.376 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:46:23.376 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.351044+0000", 2024-02-19T21:46:23.376 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0062517140000000002 2024-02-19T21:46:23.376 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.376 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.377 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:23.377 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.357296+0000", 2024-02-19T21:46:23.377 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000107017 2024-02-19T21:46:23.377 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.377 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.377 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:46:23.377 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.357403+0000", 2024-02-19T21:46:23.378 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013145400000000001 2024-02-19T21:46:23.378 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.378 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.378 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:46:23.378 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.357534+0000", 2024-02-19T21:46:23.378 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0028664060000000002 2024-02-19T21:46:23.379 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.379 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.379 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:46:23.379 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.360401+0000", 2024-02-19T21:46:23.379 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.009381393 2024-02-19T21:46:23.379 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:23.379 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:23.379 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:23.379 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.379 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.379 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_repop_reply(client.15345.0:150601 9.e e328/268)", 2024-02-19T21:46:23.380 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:46:23.361364+0000", 2024-02-19T21:46:23.380 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.0083960000000000007, 2024-02-19T21:46:23.380 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0085127889999999998, 2024-02-19T21:46:23.380 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:46:23.380 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "queued for pg", 2024-02-19T21:46:23.380 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:46:23.380 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.380 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:46:23.380 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.361364+0000", 2024-02-19T21:46:23.380 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:46:23.380 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.380 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.380 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:46:23.381 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.361364+0000", 2024-02-19T21:46:23.381 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:46:23.381 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.381 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.381 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:46:23.381 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.361363+0000", 2024-02-19T21:46:23.381 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.0890000000000002e-06 2024-02-19T21:46:23.381 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.381 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.381 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:46:23.381 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.361370+0000", 2024-02-19T21:46:23.381 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0349e-05 2024-02-19T21:46:23.381 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.381 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.381 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:46:23.382 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.361380+0000", 2024-02-19T21:46:23.382 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.5350000000000004e-06 2024-02-19T21:46:23.382 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.382 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.382 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:46:23.382 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.361386+0000", 2024-02-19T21:46:23.382 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.2042e-05 2024-02-19T21:46:23.382 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:23.382 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:23.382 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:23.382 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.382 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.382 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_repop_reply(client.15345.0:150615 9.e e328/268)", 2024-02-19T21:46:23.382 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:46:23.366314+0000", 2024-02-19T21:46:23.382 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.003445572, 2024-02-19T21:46:23.383 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0036101890000000002, 2024-02-19T21:46:23.383 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:46:23.383 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "queued for pg", 2024-02-19T21:46:23.383 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:46:23.383 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.383 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:46:23.383 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.366314+0000", 2024-02-19T21:46:23.383 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:46:23.383 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.383 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.383 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:46:23.383 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.366314+0000", 2024-02-19T21:46:23.383 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:46:23.383 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.384 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.384 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:46:23.384 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.366313+0000", 2024-02-19T21:46:23.384 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.6909999999999996e-06 2024-02-19T21:46:23.384 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.384 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.384 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:46:23.384 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.366318+0000", 2024-02-19T21:46:23.384 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0889e-05 2024-02-19T21:46:23.384 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.384 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.384 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:46:23.384 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.366329+0000", 2024-02-19T21:46:23.385 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.7370000000000003e-06 2024-02-19T21:46:23.385 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.385 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.385 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:46:23.385 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.366335+0000", 2024-02-19T21:46:23.385 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.0336e-05 2024-02-19T21:46:23.385 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:23.385 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:23.385 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:23.385 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.385 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.385 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:150601 9.e 9:7269d855:::benchmark_data_smithi080_126364_object22009:head [delete] snapc 0=[] ondisk+write+known_if_redirected e328)", 2024-02-19T21:46:23.385 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:46:23.337342+0000", 2024-02-19T21:46:23.385 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.032417578000000002, 2024-02-19T21:46:23.385 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.032636152000000002, 2024-02-19T21:46:23.386 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:46:23.386 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:46:23.386 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:46:23.386 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:46:23.386 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:46:23.386 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 150601 2024-02-19T21:46:23.386 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.386 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:46:23.386 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.386 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:46:23.387 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.337342+0000", 2024-02-19T21:46:23.387 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:46:23.387 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.387 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.387 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:46:23.387 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.337342+0000", 2024-02-19T21:46:23.387 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:46:23.387 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.387 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.387 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:46:23.387 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.337340+0000", 2024-02-19T21:46:23.387 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.5400000000000003e-06 2024-02-19T21:46:23.387 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.387 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.388 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:46:23.388 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.337346+0000", 2024-02-19T21:46:23.388 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.1260000000000004e-06 2024-02-19T21:46:23.388 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.388 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.388 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:46:23.388 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.337355+0000", 2024-02-19T21:46:23.388 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0050000000000004e-06 2024-02-19T21:46:23.388 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.388 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.388 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:46:23.388 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.337360+0000", 2024-02-19T21:46:23.389 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.017210300000000001 2024-02-19T21:46:23.389 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.389 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.389 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:23.389 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.354570+0000", 2024-02-19T21:46:23.389 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.7515000000000004e-05 2024-02-19T21:46:23.389 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.389 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.389 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:46:23.389 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.354668+0000", 2024-02-19T21:46:23.389 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00012243700000000001 2024-02-19T21:46:23.389 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.389 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.390 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:46:23.390 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.354790+0000", 2024-02-19T21:46:23.390 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0056045679999999999 2024-02-19T21:46:23.390 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:23.390 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:23.390 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:46:23.390 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:23.360395+0000", 2024-02-19T21:46:23.390 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.023052653999999999 2024-02-19T21:46:23.390 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:23.390 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:23.390 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:23.390 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:23.390 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-02-19T21:46:23.390 INFO:teuthology.orchestra.run.smithi157.stdout: "num_ops": 4 2024-02-19T21:46:23.390 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:46:23.391 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:46:23.458 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:23.681 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:46:23.689 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:23.689 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:46:23.790 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:46:23.829 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:24.181 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.4 dump_blocked_ops 2024-02-19T21:46:24.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:23.090255+0000 mgr.y (mgr.14514) 531 : cluster [DBG] pgmap v666: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing+deep, 136 active+clean; 6.7 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 646 B/s rd, 0 B/s wr, 776 op/s; 2/329334 objects misplaced (0.001%) 2024-02-19T21:46:24.586 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:46:24.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:23.090255+0000 mgr.y (mgr.14514) 531 : cluster [DBG] pgmap v666: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing+deep, 136 active+clean; 6.7 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 646 B/s rd, 0 B/s wr, 776 op/s; 2/329334 objects misplaced (0.001%) 2024-02-19T21:46:24.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:23.090255+0000 mgr.y (mgr.14514) 531 : cluster [DBG] pgmap v666: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing+deep, 136 active+clean; 6.7 GiB data, 23 GiB used, 603 GiB / 626 GiB avail; 646 B/s rd, 0 B/s wr, 776 op/s; 2/329334 objects misplaced (0.001%) 2024-02-19T21:46:25.395 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:46:25.403 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:25.404 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:46:25.504 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:46:25.574 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:25.609 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:46:25.615 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:25.615 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:46:25.716 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:46:25.777 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:25.805 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:46:25.809 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:25.810 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:46:25.911 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:46:25.969 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:25.971 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:46:25.971 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "" 2024-02-19T21:46:25.971 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:46:26.057 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:46:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:46:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:46:26.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:25.090930+0000 mgr.y (mgr.14514) 532 : cluster [DBG] pgmap v667: 138 pgs: 1 active+clean+scrubbing+deep, 1 active+remapped+backfill_toofull, 136 active+clean; 6.6 GiB data, 22 GiB used, 603 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 872 op/s; 2/323196 objects misplaced (0.001%) 2024-02-19T21:46:26.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:25.090930+0000 mgr.y (mgr.14514) 532 : cluster [DBG] pgmap v667: 138 pgs: 1 active+clean+scrubbing+deep, 1 active+remapped+backfill_toofull, 136 active+clean; 6.6 GiB data, 22 GiB used, 603 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 872 op/s; 2/323196 objects misplaced (0.001%) 2024-02-19T21:46:26.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:25.090930+0000 mgr.y (mgr.14514) 532 : cluster [DBG] pgmap v667: 138 pgs: 1 active+clean+scrubbing+deep, 1 active+remapped+backfill_toofull, 136 active+clean; 6.6 GiB data, 22 GiB used, 603 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 872 op/s; 2/323196 objects misplaced (0.001%) 2024-02-19T21:46:26.847 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:46:26.855 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:26.855 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:46:26.921 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:46:26.921 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [], 2024-02-19T21:46:26.921 INFO:teuthology.orchestra.run.smithi157.stdout: "complaint_time": 30, 2024-02-19T21:46:26.921 INFO:teuthology.orchestra.run.smithi157.stdout: "num_blocked_ops": 0 2024-02-19T21:46:26.921 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:46:26.956 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:46:26.997 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:27.283 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:26.904796+0000 mon.a (mon.0) 1399 : audit [INF] from='client.? 172.21.15.80:0/2824046928' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:46:27.323 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-02-19T21:46:27.436 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:46:27.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:26.904796+0000 mon.a (mon.0) 1399 : audit [INF] from='client.? 172.21.15.80:0/2824046928' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:46:27.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:26.904796+0000 mon.a (mon.0) 1399 : audit [INF] from='client.? 172.21.15.80:0/2824046928' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:46:27.854 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.4 dump_historic_ops 2024-02-19T21:46:27.962 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:46:27.966 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:27.967 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:46:28.068 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:46:28.104 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:28.286 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:27.091489+0000 mgr.y (mgr.14514) 533 : cluster [DBG] pgmap v668: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing+deep, 136 active+clean; 6.4 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.08k op/s; 2/315099 objects misplaced (0.001%) 2024-02-19T21:46:28.286 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:27.278382+0000 mon.a (mon.0) 1400 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:46:28.286 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:27.293080+0000 mon.a (mon.0) 1401 : audit [INF] from='client.? 172.21.15.80:0/2824046928' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:46:28.286 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:27.293137+0000 mon.a (mon.0) 1402 : cluster [DBG] osdmap e329: 8 total, 8 up, 7 in 2024-02-19T21:46:28.287 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:27.091489+0000 mgr.y (mgr.14514) 533 : cluster [DBG] pgmap v668: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing+deep, 136 active+clean; 6.4 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.08k op/s; 2/315099 objects misplaced (0.001%) 2024-02-19T21:46:28.287 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:27.278382+0000 mon.a (mon.0) 1400 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:46:28.287 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:27.293080+0000 mon.a (mon.0) 1401 : audit [INF] from='client.? 172.21.15.80:0/2824046928' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:46:28.287 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:27.293137+0000 mon.a (mon.0) 1402 : cluster [DBG] osdmap e329: 8 total, 8 up, 7 in 2024-02-19T21:46:28.287 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:46:28.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:27.091489+0000 mgr.y (mgr.14514) 533 : cluster [DBG] pgmap v668: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing+deep, 136 active+clean; 6.4 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.08k op/s; 2/315099 objects misplaced (0.001%) 2024-02-19T21:46:28.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:27.278382+0000 mon.a (mon.0) 1400 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:46:28.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:27.293080+0000 mon.a (mon.0) 1401 : audit [INF] from='client.? 172.21.15.80:0/2824046928' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:46:28.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:27.293137+0000 mon.a (mon.0) 1402 : cluster [DBG] osdmap e329: 8 total, 8 up, 7 in 2024-02-19T21:46:28.566 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:46:28.573 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:28.573 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:46:28.637 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:46:28.674 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:46:28.726 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:28.768 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:46:28.772 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:28.772 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:46:28.873 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:46:28.937 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:29.607 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:46:29.621 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:29.621 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:46:29.722 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:46:29.759 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:30.022 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:46:30.027 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:30.027 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:46:30.128 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:46:30.181 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:30.294 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:29.091834+0000 mgr.y (mgr.14514) 534 : cluster [DBG] pgmap v670: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing+deep, 136 active+clean; 6.4 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 573 B/s rd, 0 B/s wr, 663 op/s; 2/315099 objects misplaced (0.001%) 2024-02-19T21:46:30.294 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:30.173309+0000 mon.a (mon.0) 1403 : cluster [DBG] osdmap e330: 8 total, 8 up, 7 in 2024-02-19T21:46:30.294 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:29.091834+0000 mgr.y (mgr.14514) 534 : cluster [DBG] pgmap v670: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing+deep, 136 active+clean; 6.4 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 573 B/s rd, 0 B/s wr, 663 op/s; 2/315099 objects misplaced (0.001%) 2024-02-19T21:46:30.294 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:30.173309+0000 mon.a (mon.0) 1403 : cluster [DBG] osdmap e330: 8 total, 8 up, 7 in 2024-02-19T21:46:30.312 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:46:30.315 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:30.316 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:46:30.416 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:46:30.462 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:30.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:29.091834+0000 mgr.y (mgr.14514) 534 : cluster [DBG] pgmap v670: 138 pgs: 1 active+remapped+backfill_toofull, 1 active+clean+scrubbing+deep, 136 active+clean; 6.4 GiB data, 22 GiB used, 604 GiB / 626 GiB avail; 573 B/s rd, 0 B/s wr, 663 op/s; 2/315099 objects misplaced (0.001%) 2024-02-19T21:46:30.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:30.173309+0000 mon.a (mon.0) 1403 : cluster [DBG] osdmap e330: 8 total, 8 up, 7 in 2024-02-19T21:46:30.574 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset noscrub 2024-02-19T21:46:30.603 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:46:30.610 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:30.611 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:46:30.679 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:46:30.709 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:46:30.711 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:46:30.739 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:46:30.768 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:30.780 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:46:30.805 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:46:30.807 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:46:30.808 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:30.809 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:46:30.844 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:46:30.879 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:46:30.909 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:46:30.921 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:46:30.925 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:46:30.926 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:46:30.926 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:46:30.926 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:46:30.926 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:46:30.926 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:46:30.926 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:46:30.926 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:46:30.951 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:46:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:46:30] "GET /metrics HTTP/1.1" 200 176129 "" "Prometheus/2.33.4" 2024-02-19T21:46:30.970 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:31.032 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:46:31.032 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:46:31.053 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:46:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:46:31.231 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:46:31.235 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:31.235 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:46:31.247 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:46:31.336 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:46:31.406 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:31.474 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:46:31.482 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:31.483 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:46:31.583 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:46:31.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:30.645215+0000 mon.a (mon.0) 1404 : audit [DBG] from='client.? 172.21.15.80:0/1082453011' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:46:31.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:30.661245+0000 mgr.y (mgr.14514) 535 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:46:31.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:31.183257+0000 mon.a (mon.0) 1405 : cluster [DBG] osdmap e331: 8 total, 8 up, 7 in 2024-02-19T21:46:31.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:30.645215+0000 mon.a (mon.0) 1404 : audit [DBG] from='client.? 172.21.15.80:0/1082453011' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:46:31.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:30.661245+0000 mgr.y (mgr.14514) 535 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:46:31.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:31.183257+0000 mon.a (mon.0) 1405 : cluster [DBG] osdmap e331: 8 total, 8 up, 7 in 2024-02-19T21:46:31.635 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:30.645215+0000 mon.a (mon.0) 1404 : audit [DBG] from='client.? 172.21.15.80:0/1082453011' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:46:31.636 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:30.661245+0000 mgr.y (mgr.14514) 535 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:46:31.636 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:31.183257+0000 mon.a (mon.0) 1405 : cluster [DBG] osdmap e331: 8 total, 8 up, 7 in 2024-02-19T21:46:31.640 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:31.982 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.5 dump_ops_in_flight 2024-02-19T21:46:32.009 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:46:32.013 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:32.014 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:46:32.114 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:46:32.193 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:32.223 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:46:32.228 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:32.229 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:46:32.329 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:46:32.389 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:32.423 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:46:32.439 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:46:32.450 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:32.451 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:46:32.502 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:31.092335+0000 mgr.y (mgr.14514) 536 : cluster [DBG] pgmap v672: 138 pgs: 1 peering, 137 active+clean; 6.1 GiB data, 21 GiB used, 605 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.25k op/s; 1 B/s, 0 objects/s recovering 2024-02-19T21:46:32.503 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:31.294211+0000 mon.a (mon.0) 1406 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-19T21:46:32.503 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:31.092335+0000 mgr.y (mgr.14514) 536 : cluster [DBG] pgmap v672: 138 pgs: 1 peering, 137 active+clean; 6.1 GiB data, 21 GiB used, 605 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.25k op/s; 1 B/s, 0 objects/s recovering 2024-02-19T21:46:32.503 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:31.294211+0000 mon.a (mon.0) 1406 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-19T21:46:32.551 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:46:32.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:31.092335+0000 mgr.y (mgr.14514) 536 : cluster [DBG] pgmap v672: 138 pgs: 1 peering, 137 active+clean; 6.1 GiB data, 21 GiB used, 605 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.25k op/s; 1 B/s, 0 objects/s recovering 2024-02-19T21:46:32.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:31.294211+0000 mon.a (mon.0) 1406 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-19T21:46:32.585 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:32.714 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 6, 7] out_osds: [2] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:46:32.714 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:46:32.714 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-02-19T21:46:32.714 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd dump -f json-pretty 2024-02-19T21:46:32.790 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:46:32.796 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:32.797 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:46:32.897 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:46:32.951 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:33.860 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:46:33.980 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:46:34.113 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:46:34.119 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:34.120 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:46:34.221 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:46:34.265 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:34.417 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:46:34.422 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:33.092713+0000 mgr.y (mgr.14514) 537 : cluster [DBG] pgmap v674: 138 pgs: 1 peering, 137 active+clean; 6.1 GiB data, 21 GiB used, 605 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 869 op/s; 2 B/s, 0 objects/s recovering 2024-02-19T21:46:34.422 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:33.963369+0000 mon.a (mon.0) 1407 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:46:34.423 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:34.275554+0000 mon.b (mon.1) 57 : audit [INF] from='client.? 172.21.15.80:0/6183040' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:46:34.423 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:34.286411+0000 mon.a (mon.0) 1408 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:46:34.423 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:34.423 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:46:34.500 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:33.092713+0000 mgr.y (mgr.14514) 537 : cluster [DBG] pgmap v674: 138 pgs: 1 peering, 137 active+clean; 6.1 GiB data, 21 GiB used, 605 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 869 op/s; 2 B/s, 0 objects/s recovering 2024-02-19T21:46:34.500 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:33.963369+0000 mon.a (mon.0) 1407 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:46:34.500 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:34.275554+0000 mon.b (mon.1) 57 : audit [INF] from='client.? 172.21.15.80:0/6183040' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:46:34.500 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:34.286411+0000 mon.a (mon.0) 1408 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:46:34.501 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:33.092713+0000 mgr.y (mgr.14514) 537 : cluster [DBG] pgmap v674: 138 pgs: 1 peering, 137 active+clean; 6.1 GiB data, 21 GiB used, 605 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 869 op/s; 2 B/s, 0 objects/s recovering 2024-02-19T21:46:34.501 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:33.963369+0000 mon.a (mon.0) 1407 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:46:34.501 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:34.275554+0000 mon.b (mon.1) 57 : audit [INF] from='client.? 172.21.15.80:0/6183040' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:46:34.501 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:34.286411+0000 mon.a (mon.0) 1408 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:46:34.524 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:46:34.592 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:34.850 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:46:34.973 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-02-19T21:46:35.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:34.960666+0000 mon.a (mon.0) 1409 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:46:35.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:34.967576+0000 mon.a (mon.0) 1410 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:46:35.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:34.967634+0000 mon.a (mon.0) 1411 : cluster [DBG] osdmap e332: 8 total, 8 up, 7 in 2024-02-19T21:46:35.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:35.029362+0000 osd.6 (osd.6) 199 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:46:35.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:35.035035+0000 osd.6 (osd.6) 200 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:46:35.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:34.960666+0000 mon.a (mon.0) 1409 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:46:35.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:34.967576+0000 mon.a (mon.0) 1410 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:46:35.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:34.967634+0000 mon.a (mon.0) 1411 : cluster [DBG] osdmap e332: 8 total, 8 up, 7 in 2024-02-19T21:46:35.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:35.029362+0000 osd.6 (osd.6) 199 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:46:35.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:35.035035+0000 osd.6 (osd.6) 200 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:46:35.619 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:34.960666+0000 mon.a (mon.0) 1409 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:46:35.619 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:34.967576+0000 mon.a (mon.0) 1410 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:46:35.619 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:34.967634+0000 mon.a (mon.0) 1411 : cluster [DBG] osdmap e332: 8 total, 8 up, 7 in 2024-02-19T21:46:35.619 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:35.029362+0000 osd.6 (osd.6) 199 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:46:35.619 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:35.035035+0000 osd.6 (osd.6) 200 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:46:35.620 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:46:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:46:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:46:36.373 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:46:36.380 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:36.380 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:46:36.481 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:46:36.504 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:35.093350+0000 mgr.y (mgr.14514) 538 : cluster [DBG] pgmap v676: 138 pgs: 1 active+clean+scrubbing, 1 peering, 136 active+clean; 5.9 GiB data, 21 GiB used, 605 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 1.27k op/s; 2 B/s, 0 objects/s recovering 2024-02-19T21:46:36.504 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:35.166130+0000 osd.7 (osd.7) 206 : cluster [DBG] 9.c scrub starts 2024-02-19T21:46:36.504 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:35.093350+0000 mgr.y (mgr.14514) 538 : cluster [DBG] pgmap v676: 138 pgs: 1 active+clean+scrubbing, 1 peering, 136 active+clean; 5.9 GiB data, 21 GiB used, 605 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 1.27k op/s; 2 B/s, 0 objects/s recovering 2024-02-19T21:46:36.504 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:35.166130+0000 osd.7 (osd.7) 206 : cluster [DBG] 9.c scrub starts 2024-02-19T21:46:36.527 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:36.776 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:46:36.777 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:46:36.799 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:35.093350+0000 mgr.y (mgr.14514) 538 : cluster [DBG] pgmap v676: 138 pgs: 1 active+clean+scrubbing, 1 peering, 136 active+clean; 5.9 GiB data, 21 GiB used, 605 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 1.27k op/s; 2 B/s, 0 objects/s recovering 2024-02-19T21:46:36.799 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:35.166130+0000 osd.7 (osd.7) 206 : cluster [DBG] 9.c scrub starts 2024-02-19T21:46:37.759 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.5 dump_blocked_ops 2024-02-19T21:46:38.247 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:46:38.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:37.094329+0000 mgr.y (mgr.14514) 539 : cluster [DBG] pgmap v677: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 5.7 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 739 B/s rd, 0 B/s wr, 985 op/s; 1 B/s, 0 objects/s recovering 2024-02-19T21:46:38.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:37.094329+0000 mgr.y (mgr.14514) 539 : cluster [DBG] pgmap v677: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 5.7 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 739 B/s rd, 0 B/s wr, 985 op/s; 1 B/s, 0 objects/s recovering 2024-02-19T21:46:38.647 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:46:38.647 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:46:38.669 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:46:38.695 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:46:38.698 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:46:38.701 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:38.702 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:46:38.729 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:46:38.777 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:46:38.797 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:46:38.797 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:46:38.797 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 333, 2024-02-19T21:46:38.797 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "6f763558-cf6d-11ee-95bb-87774f69a715", 2024-02-19T21:46:38.797 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2024-02-19T21:26:16.880265+0000", 2024-02-19T21:46:38.797 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2024-02-19T21:46:38.335082+0000", 2024-02-19T21:46:38.797 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2024-02-19T21:32:14.805693+0000", 2024-02-19T21:46:38.797 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2024-02-19T21:39:38.443319+0000", 2024-02-19T21:46:38.797 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-02-19T21:46:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5804032, 2024-02-19T21:46:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2024-02-19T21:46:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: "nodeep-scrub", 2024-02-19T21:46:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2024-02-19T21:46:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2024-02-19T21:46:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2024-02-19T21:46:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2024-02-19T21:46:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:46:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 18, 2024-02-19T21:46:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2024-02-19T21:46:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-02-19T21:46:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2024-02-19T21:46:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2024-02-19T21:46:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 9, 2024-02-19T21:46:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2024-02-19T21:46:38.799 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "luminous", 2024-02-19T21:46:38.799 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "luminous", 2024-02-19T21:46:38.799 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "pacific", 2024-02-19T21:46:38.799 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2024-02-19T21:46:38.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.799 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2024-02-19T21:46:38.799 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "device_health_metrics", 2024-02-19T21:46:38.799 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:30:05.947623+0000", 2024-02-19T21:46:38.799 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:46:38.799 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:46:38.799 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:46:38.799 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:46:38.799 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:46:38.800 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:46:38.800 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:46:38.800 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:46:38.800 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:46:38.800 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:46:38.800 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:46:38.800 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:46:38.800 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 1, 2024-02-19T21:46:38.800 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 1, 2024-02-19T21:46:38.800 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 1, 2024-02-19T21:46:38.800 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 1, 2024-02-19T21:46:38.800 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 1, 2024-02-19T21:46:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:46:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:46:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:46:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:46:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:46:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:46:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:46:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "74", 2024-02-19T21:46:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:46:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:46:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:46:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:46:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:46:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:46:38.802 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:46:38.802 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:46:38.802 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:46:38.802 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:46:38.802 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:46:38.802 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:46:38.802 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:46:38.802 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:46:38.802 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:46:38.802 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:46:38.802 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:46:38.802 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:46:38.802 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:46:38.802 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:46:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:46:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:46:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:46:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:46:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:46:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:46:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:46:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:46:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:46:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:46:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:46:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:46:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:46:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:46:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:46:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:46:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:46:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2024-02-19T21:46:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_max": 32, 2024-02-19T21:46:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 1 2024-02-19T21:46:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:46:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_devicehealth": {} 2024-02-19T21:46:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 2, 2024-02-19T21:46:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": ".rgw.root", 2024-02-19T21:46:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:22.082250+0000", 2024-02-19T21:46:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:46:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:46:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:46:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:46:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:46:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:46:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:46:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:46:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:46:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:46:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:46:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:46:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:46:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:46:38.806 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:46:38.806 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:46:38.806 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:46:38.806 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:46:38.806 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:46:38.806 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:46:38.806 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:46:38.806 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:46:38.806 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:46:38.806 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:46:38.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.806 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "60", 2024-02-19T21:46:38.806 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:46:38.806 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:46:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:46:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:46:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:46:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:46:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:46:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:46:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:46:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:46:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:46:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:46:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:46:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:46:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:46:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:46:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:46:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:46:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:46:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:46:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:46:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:46:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:46:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:46:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:46:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:46:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:46:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:46:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:46:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:46:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:46:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:46:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:46:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:46:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:46:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:46:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:46:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:46:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:46:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:46:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 3, 2024-02-19T21:46:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "iscsi", 2024-02-19T21:46:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:22.333164+0000", 2024-02-19T21:46:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:46:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:46:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:46:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:46:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:46:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:46:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:46:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:46:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:46:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:46:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:46:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:46:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 3, 2024-02-19T21:46:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 3, 2024-02-19T21:46:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 3, 2024-02-19T21:46:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 3, 2024-02-19T21:46:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 3, 2024-02-19T21:46:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:46:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:46:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:46:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:46:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:46:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:46:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:46:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "62", 2024-02-19T21:46:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:46:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:46:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:46:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:46:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:46:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:46:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:46:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:46:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:46:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:46:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:46:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:46:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:46:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:46:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:46:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:46:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:46:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:46:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:46:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:46:38.813 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:46:38.813 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:46:38.813 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:46:38.813 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:46:38.813 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:46:38.813 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:46:38.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.813 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:46:38.813 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:46:38.813 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:46:38.813 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:46:38.813 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:46:38.813 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:46:38.814 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:46:38.814 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:46:38.814 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:46:38.814 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:46:38.814 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:46:38.814 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:46:38.814 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:46:38.814 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2024-02-19T21:46:38.814 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.814 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 4, 2024-02-19T21:46:38.814 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.log", 2024-02-19T21:46:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:23.632615+0000", 2024-02-19T21:46:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:46:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:46:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:46:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:46:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:46:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:46:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:46:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:46:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:46:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:46:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:46:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:46:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:46:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:46:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:46:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:46:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:46:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:46:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:46:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:46:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:46:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:46:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:46:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:46:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "62", 2024-02-19T21:46:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:46:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:46:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:46:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:46:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:46:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:46:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:46:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:46:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:46:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:46:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:46:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:46:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:46:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:46:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:46:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:46:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:46:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:46:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:46:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:46:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:46:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:46:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:46:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:46:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:46:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:46:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:46:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:46:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:46:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:46:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:46:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:46:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:46:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:46:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:46:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:46:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:46:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:46:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:46:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:46:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 5, 2024-02-19T21:46:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.control", 2024-02-19T21:46:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:25.600876+0000", 2024-02-19T21:46:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:46:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:46:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:46:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:46:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:46:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:46:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:46:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:46:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:46:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:46:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:46:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:46:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 22, 2024-02-19T21:46:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 22, 2024-02-19T21:46:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 22, 2024-02-19T21:46:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 22, 2024-02-19T21:46:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 22, 2024-02-19T21:46:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:46:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "5.16", 2024-02-19T21:46:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 298, 2024-02-19T21:46:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 297, 2024-02-19T21:46:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 297, 2024-02-19T21:46:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:46:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:46:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "325", 2024-02-19T21:46:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:46:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "298", 2024-02-19T21:46:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "296", 2024-02-19T21:46:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:46:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:46:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:46:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:46:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:46:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:46:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:46:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:46:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:46:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:46:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:46:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:46:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:46:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:46:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:46:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:46:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:46:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:46:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:46:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:46:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:46:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:46:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:46:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:46:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:46:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:46:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:46:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:46:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:46:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:46:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:46:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:46:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:46:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:46:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:46:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:46:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:46:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 6, 2024-02-19T21:46:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.meta", 2024-02-19T21:46:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:27.661242+0000", 2024-02-19T21:46:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:46:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:46:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:46:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:46:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:46:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:46:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:46:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:46:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:46:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:46:38.825 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:46:38.825 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:46:38.825 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:46:38.825 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:46:38.825 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:46:38.825 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:46:38.825 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:46:38.825 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:46:38.825 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "6.16", 2024-02-19T21:46:38.825 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 243, 2024-02-19T21:46:38.827 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 242, 2024-02-19T21:46:38.827 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 242, 2024-02-19T21:46:38.827 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:46:38.827 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:46:38.827 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.827 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "304", 2024-02-19T21:46:38.827 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:46:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "243", 2024-02-19T21:46:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "302", 2024-02-19T21:46:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:46:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:46:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:46:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:46:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:46:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:46:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:46:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:46:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:46:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:46:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:46:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:46:38.829 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:46:38.829 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:46:38.829 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:46:38.829 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:46:38.829 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:46:38.829 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:46:38.829 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:46:38.829 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:46:38.829 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:46:38.829 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:46:38.829 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:46:38.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.829 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:46:38.830 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:46:38.830 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:46:38.830 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:46:38.830 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:46:38.830 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:46:38.830 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:46:38.830 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:46:38.830 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:46:38.830 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:46:38.830 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:46:38.830 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2024-02-19T21:46:38.830 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4 2024-02-19T21:46:38.830 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.830 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:46:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:46:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 9, 2024-02-19T21:46:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "unique_pool_2", 2024-02-19T21:46:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:44:14.908840+0000", 2024-02-19T21:46:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:46:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:46:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:46:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:46:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:46:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:46:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:46:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:46:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:46:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:46:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:46:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:46:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 16, 2024-02-19T21:46:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 16, 2024-02-19T21:46:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 16, 2024-02-19T21:46:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 16, 2024-02-19T21:46:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 16, 2024-02-19T21:46:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:46:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:46:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:46:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:46:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:46:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:46:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:46:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "282", 2024-02-19T21:46:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:46:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:46:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:46:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:46:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:46:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:46:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:46:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:46:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:46:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:46:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:46:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:46:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:46:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:46:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:46:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:46:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:46:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:46:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:46:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:46:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:46:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:46:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:46:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:46:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:46:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:46:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:46:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:46:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:46:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:46:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:46:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:46:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:46:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:46:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:46:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:46:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:46:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:46:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:46:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: "rados": {} 2024-02-19T21:46:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:46:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:46:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.836 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2024-02-19T21:46:38.836 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "a72c63f6-46b3-4202-99da-7b0c92b799a5", 2024-02-19T21:46:38.836 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:46:38.836 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:46:38.836 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:46:38.836 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:46:38.836 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:46:38.836 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:46:38.836 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 8, 2024-02-19T21:46:38.836 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 330, 2024-02-19T21:46:38.836 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:46:38.836 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:46:38.836 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:46:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2024-02-19T21:46:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:46:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2024-02-19T21:46:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:46:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:46:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.838 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.838 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.838 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2024-02-19T21:46:38.838 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:46:38.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.838 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.838 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.838 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2024-02-19T21:46:38.838 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:46:38.838 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.838 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.838 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:46:38.838 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2024-02-19T21:46:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:46:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2024-02-19T21:46:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:46:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:46:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.840 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.840 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2024-02-19T21:46:38.840 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:46:38.840 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.840 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.840 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.840 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2024-02-19T21:46:38.840 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:46:38.840 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.840 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.840 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.840 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6803/3531298825", 2024-02-19T21:46:38.840 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6805/3531298825", 2024-02-19T21:46:38.840 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6809/3531298825", 2024-02-19T21:46:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6807/3531298825", 2024-02-19T21:46:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:46:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:46:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:46:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2024-02-19T21:46:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "7d4e170e-b0ca-4e19-be35-4038ca126ee6", 2024-02-19T21:46:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:46:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:46:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:46:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:46:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:46:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:46:38.842 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-02-19T21:46:38.842 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 304, 2024-02-19T21:46:38.842 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:46:38.842 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:46:38.842 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:46:38.842 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.842 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.842 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.842 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2024-02-19T21:46:38.842 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:46:38.842 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.842 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.842 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.842 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2024-02-19T21:46:38.842 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:46:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:46:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2024-02-19T21:46:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:46:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2024-02-19T21:46:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:46:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:46:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2024-02-19T21:46:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:46:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2024-02-19T21:46:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:46:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:46:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2024-02-19T21:46:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:46:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2024-02-19T21:46:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:46:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6811/1497235950", 2024-02-19T21:46:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6813/1497235950", 2024-02-19T21:46:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6817/1497235950", 2024-02-19T21:46:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6815/1497235950", 2024-02-19T21:46:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:46:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:46:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:46:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2024-02-19T21:46:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "cf461b67-f3e8-45e9-b2f6-777752ba5574", 2024-02-19T21:46:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:46:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 0, 2024-02-19T21:46:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 0, 2024-02-19T21:46:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:46:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:46:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:46:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 18, 2024-02-19T21:46:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 144, 2024-02-19T21:46:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:46:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:46:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:46:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2024-02-19T21:46:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:46:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2024-02-19T21:46:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:46:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:46:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2024-02-19T21:46:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:46:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.849 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.849 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2024-02-19T21:46:38.849 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:46:38.849 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.849 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.849 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:46:38.849 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.849 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.849 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2024-02-19T21:46:38.849 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:46:38.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.850 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.850 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.850 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2024-02-19T21:46:38.850 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:46:38.850 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.850 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.850 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.850 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:46:38.850 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.850 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.850 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.850 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2024-02-19T21:46:38.850 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:46:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2024-02-19T21:46:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3131848307 2024-02-19T21:46:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6819/3131848307", 2024-02-19T21:46:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6821/3131848307", 2024-02-19T21:46:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6825/3131848307", 2024-02-19T21:46:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6823/3131848307", 2024-02-19T21:46:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:46:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:46:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:46:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2024-02-19T21:46:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "76318cdd-5fce-4a40-95c9-300d55c34820", 2024-02-19T21:46:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:46:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:46:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 0.4183197021484375, 2024-02-19T21:46:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:46:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:46:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:46:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 26, 2024-02-19T21:46:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 304, 2024-02-19T21:46:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:46:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:46:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:46:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2024-02-19T21:46:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:46:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2024-02-19T21:46:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:46:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:46:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2024-02-19T21:46:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:46:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2024-02-19T21:46:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:46:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:46:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6832", 2024-02-19T21:46:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:46:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6833", 2024-02-19T21:46:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:46:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:46:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2024-02-19T21:46:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:46:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2024-02-19T21:46:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:46:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6827/2007978078", 2024-02-19T21:46:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6829/2007978078", 2024-02-19T21:46:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6833/2007978078", 2024-02-19T21:46:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6831/2007978078", 2024-02-19T21:46:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:46:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:46:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:46:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2024-02-19T21:46:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "6484964f-3391-4e1d-a56c-813f46124062", 2024-02-19T21:46:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:46:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:46:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:46:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 0.427398681640625, 2024-02-19T21:46:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:46:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:46:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 32, 2024-02-19T21:46:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 304, 2024-02-19T21:46:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:46:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:46:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:46:38.858 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.858 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.858 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.858 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6800", 2024-02-19T21:46:38.858 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:46:38.858 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.858 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.858 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.858 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6801", 2024-02-19T21:46:38.858 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:46:38.858 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.858 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.858 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.858 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:46:38.859 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.859 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.859 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.859 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6802", 2024-02-19T21:46:38.859 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:46:38.859 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.859 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.859 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.859 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6803", 2024-02-19T21:46:38.859 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:46:38.859 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.859 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.859 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.859 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:46:38.860 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.860 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.860 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6806", 2024-02-19T21:46:38.860 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:46:38.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.860 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.860 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6807", 2024-02-19T21:46:38.860 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:46:38.860 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.860 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:46:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6804", 2024-02-19T21:46:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:46:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6805", 2024-02-19T21:46:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:46:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6801/1922002860", 2024-02-19T21:46:38.862 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6803/1922002860", 2024-02-19T21:46:38.862 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6807/1922002860", 2024-02-19T21:46:38.862 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6805/1922002860", 2024-02-19T21:46:38.862 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:46:38.862 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:46:38.862 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:46:38.862 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.862 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2024-02-19T21:46:38.862 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "8c7e0309-8c3b-40b9-99d9-96620e52742f", 2024-02-19T21:46:38.862 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:46:38.862 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:46:38.862 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:46:38.862 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:46:38.862 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:46:38.862 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:46:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 38, 2024-02-19T21:46:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 304, 2024-02-19T21:46:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:46:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:46:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:46:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6808", 2024-02-19T21:46:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:46:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6809", 2024-02-19T21:46:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:46:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:46:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6810", 2024-02-19T21:46:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:46:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6811", 2024-02-19T21:46:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:46:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:46:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6814", 2024-02-19T21:46:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:46:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6815", 2024-02-19T21:46:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:46:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.866 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:46:38.866 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.866 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.866 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.866 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6812", 2024-02-19T21:46:38.866 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:46:38.866 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.866 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.866 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.866 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6813", 2024-02-19T21:46:38.866 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:46:38.866 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.866 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6809/960889603", 2024-02-19T21:46:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6811/960889603", 2024-02-19T21:46:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6815/960889603", 2024-02-19T21:46:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6813/960889603", 2024-02-19T21:46:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:46:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:46:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:46:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2024-02-19T21:46:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "5b7d44a3-197d-482c-bf9e-de5e9013a851", 2024-02-19T21:46:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:46:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:46:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:46:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:46:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:46:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:46:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 47, 2024-02-19T21:46:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 304, 2024-02-19T21:46:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:46:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:46:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:46:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6816", 2024-02-19T21:46:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:46:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6817", 2024-02-19T21:46:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:46:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:46:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6818", 2024-02-19T21:46:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:46:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6819", 2024-02-19T21:46:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:46:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:46:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6822", 2024-02-19T21:46:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:46:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6823", 2024-02-19T21:46:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:46:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:46:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6820", 2024-02-19T21:46:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:46:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6821", 2024-02-19T21:46:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:46:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6817/2598265223", 2024-02-19T21:46:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6819/2598265223", 2024-02-19T21:46:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6823/2598265223", 2024-02-19T21:46:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6821/2598265223", 2024-02-19T21:46:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:46:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:46:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:46:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2024-02-19T21:46:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "7e2d0287-928d-40f8-841b-6c2077fc08ac", 2024-02-19T21:46:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:46:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:46:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 0.482391357421875, 2024-02-19T21:46:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:46:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:46:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:46:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 55, 2024-02-19T21:46:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 307, 2024-02-19T21:46:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:46:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:46:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:46:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6824", 2024-02-19T21:46:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:46:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6825", 2024-02-19T21:46:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:46:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:46:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6826", 2024-02-19T21:46:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:46:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6827", 2024-02-19T21:46:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:46:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:46:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6830", 2024-02-19T21:46:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:46:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6831", 2024-02-19T21:46:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:46:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:46:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:46:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:46:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6828", 2024-02-19T21:46:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:46:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:46:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6829", 2024-02-19T21:46:38.877 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:46:38.877 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.877 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.877 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.877 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6825/3619345894", 2024-02-19T21:46:38.877 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6827/3619345894", 2024-02-19T21:46:38.877 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6831/3619345894", 2024-02-19T21:46:38.877 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6829/3619345894", 2024-02-19T21:46:38.877 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:46:38.877 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:46:38.877 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:46:38.877 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.877 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.877 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:46:38.878 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2024-02-19T21:46:38.878 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.878 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2024-02-19T21:46:38.878 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:46:38.878 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:46:38.878 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:46:38.878 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:46:38.878 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:46:38.878 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:45:49.464882+0000", 2024-02-19T21:46:38.878 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:46:38.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.878 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.878 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2024-02-19T21:46:38.878 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:46:38.878 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:46:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:46:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:46:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:46:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:46:03.533152+0000", 2024-02-19T21:46:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:46:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2024-02-19T21:46:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:46:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:46:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:46:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:46:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 65536, 2024-02-19T21:46:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:45:31.579456+0000", 2024-02-19T21:46:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:46:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2024-02-19T21:46:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:46:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:46:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:46:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:46:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:46:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:45:37.623876+0000", 2024-02-19T21:46:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:46:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2024-02-19T21:46:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:46:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:46:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:46:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:46:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:46:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:46:38.160673+0000", 2024-02-19T21:46:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:46:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2024-02-19T21:46:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:46:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:46:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:46:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:46:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:46:38.882 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:45:41.396705+0000", 2024-02-19T21:46:38.882 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:46:38.882 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.882 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.882 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2024-02-19T21:46:38.882 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:46:38.882 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:46:38.882 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:46:38.882 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:46:38.882 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:46:38.882 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:45:39.646987+0000", 2024-02-19T21:46:38.882 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:46:38.882 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2024-02-19T21:46:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:46:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:46:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:46:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:46:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:46:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:45:21.608272+0000", 2024-02-19T21:46:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:46:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:46:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [ 2024-02-19T21:46:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "2.c", 2024-02-19T21:46:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:46:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: 6, 2024-02-19T21:46:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: 7, 2024-02-19T21:46:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: 2 2024-02-19T21:46:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.1", 2024-02-19T21:46:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:46:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: 4, 2024-02-19T21:46:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: 2, 2024-02-19T21:46:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: 6 2024-02-19T21:46:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.885 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.885 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "9.0", 2024-02-19T21:46:38.885 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:46:38.885 INFO:teuthology.orchestra.run.smithi080.stdout: 7, 2024-02-19T21:46:38.885 INFO:teuthology.orchestra.run.smithi080.stdout: 2, 2024-02-19T21:46:38.885 INFO:teuthology.orchestra.run.smithi080.stdout: 6 2024-02-19T21:46:38.885 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.885 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.885 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:46:38.885 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [ 2024-02-19T21:46:38.885 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.885 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.6", 2024-02-19T21:46:38.885 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:46:38.885 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.886 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:46:38.886 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 5 2024-02-19T21:46:38.886 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.886 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.886 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.886 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.886 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.e", 2024-02-19T21:46:38.886 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:46:38.886 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.886 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:46:38.886 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 7 2024-02-19T21:46:38.886 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.886 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.886 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.f", 2024-02-19T21:46:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:46:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:46:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 5 2024-02-19T21:46:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.19", 2024-02-19T21:46:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:46:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:46:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 7 2024-02-19T21:46:38.888 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.888 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.888 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.888 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.888 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.1f", 2024-02-19T21:46:38.888 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:46:38.888 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.888 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:46:38.888 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 7 2024-02-19T21:46:38.888 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.888 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.888 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 6, 2024-02-19T21:46:38.888 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 0 2024-02-19T21:46:38.889 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.889 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.889 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.889 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.889 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "5.1", 2024-02-19T21:46:38.889 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:46:38.889 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.889 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 4, 2024-02-19T21:46:38.889 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 6 2024-02-19T21:46:38.889 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.889 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.889 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.889 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.889 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "5.13", 2024-02-19T21:46:38.890 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:46:38.890 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.890 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 0, 2024-02-19T21:46:38.890 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 6 2024-02-19T21:46:38.890 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.890 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.890 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.890 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.890 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "6.f", 2024-02-19T21:46:38.890 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:46:38.890 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:46:38.890 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 4, 2024-02-19T21:46:38.890 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 0 2024-02-19T21:46:38.891 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.891 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:46:38.891 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.891 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:46:38.891 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [], 2024-02-19T21:46:38.891 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2024-02-19T21:46:38.891 INFO:teuthology.orchestra.run.smithi080.stdout: "blocklist": { 2024-02-19T21:46:38.891 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6800/2867197629": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:46:38.891 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/1659656010": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:46:38.891 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6801/2272739550": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:46:38.891 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/867908385": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:46:38.891 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/398750494": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:46:38.891 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/2833137430": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:46:38.892 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/2520755315": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:46:38.892 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6800/2094869828": "2024-02-20T21:26:51.262073+0000", 2024-02-19T21:46:38.892 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6800/2272739550": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:46:38.892 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6801/2094869828": "2024-02-20T21:26:51.262073+0000", 2024-02-19T21:46:38.892 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/2130852198": "2024-02-20T21:26:51.262073+0000", 2024-02-19T21:46:38.892 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6801/2867197629": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:46:38.892 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/1952386920": "2024-02-20T21:26:51.262073+0000" 2024-02-19T21:46:38.892 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.892 INFO:teuthology.orchestra.run.smithi080.stdout: "range_blocklist": {}, 2024-02-19T21:46:38.892 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2024-02-19T21:46:38.892 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2024-02-19T21:46:38.892 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2024-02-19T21:46:38.892 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2024-02-19T21:46:38.892 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2024-02-19T21:46:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2024-02-19T21:46:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2024-02-19T21:46:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2024-02-19T21:46:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:46:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2024-02-19T21:46:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2024-02-19T21:46:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2024-02-19T21:46:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2024-02-19T21:46:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {}, 2024-02-19T21:46:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode": { 2024-02-19T21:46:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode_enabled": false, 2024-02-19T21:46:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_bucket_count": 0, 2024-02-19T21:46:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: "degraded_stretch_mode": 0, 2024-02-19T21:46:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: "recovering_stretch_mode": 0, 2024-02-19T21:46:38.894 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode_bucket": 0 2024-02-19T21:46:38.894 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:46:38.894 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:46:38.894 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:46:38.895 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:37.094329+0000 mgr.y (mgr.14514) 539 : cluster [DBG] pgmap v677: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 5.7 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 739 B/s rd, 0 B/s wr, 985 op/s; 1 B/s, 0 objects/s recovering 2024-02-19T21:46:38.895 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:46:38.896 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:46:38.896 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:46:38.896 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:46:38.896 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:46:38.896 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:46:38.896 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:46:38.896 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:46:38.896 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:46:38.896 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:46:38.950 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-19T21:46:38.951 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:39.221 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:46:39.230 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:39.230 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:46:39.331 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:46:39.384 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:39.420 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:46:39.429 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:39.429 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:46:39.530 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:46:39.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:38.160612+0000 osd.4 (osd.4) 167 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:46:39.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:38.160671+0000 osd.4 (osd.4) 168 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:46:39.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:38.339503+0000 mon.a (mon.0) 1412 : cluster [DBG] osdmap e333: 8 total, 8 up, 7 in 2024-02-19T21:46:39.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:38.420894+0000 osd.7 (osd.7) 207 : cluster [DBG] 9.c scrub ok 2024-02-19T21:46:39.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:38.472199+0000 osd.4 (osd.4) 169 : cluster [DBG] 9.e scrub starts 2024-02-19T21:46:39.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:38.580195+0000 mon.b (mon.1) 58 : audit [DBG] from='client.? 172.21.15.80:0/441352430' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:46:39.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:38.793791+0000 mon.a (mon.0) 1413 : audit [DBG] from='client.? 172.21.15.80:0/3906120108' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-19T21:46:39.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:39.157451+0000 mon.a (mon.0) 1414 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:46:39.590 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:39.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:38.160612+0000 osd.4 (osd.4) 167 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:46:39.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:38.160671+0000 osd.4 (osd.4) 168 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:46:39.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:38.339503+0000 mon.a (mon.0) 1412 : cluster [DBG] osdmap e333: 8 total, 8 up, 7 in 2024-02-19T21:46:39.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:38.420894+0000 osd.7 (osd.7) 207 : cluster [DBG] 9.c scrub ok 2024-02-19T21:46:39.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:38.472199+0000 osd.4 (osd.4) 169 : cluster [DBG] 9.e scrub starts 2024-02-19T21:46:39.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:38.580195+0000 mon.b (mon.1) 58 : audit [DBG] from='client.? 172.21.15.80:0/441352430' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:46:39.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:38.793791+0000 mon.a (mon.0) 1413 : audit [DBG] from='client.? 172.21.15.80:0/3906120108' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-19T21:46:39.850 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:39.157451+0000 mon.a (mon.0) 1414 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:46:39.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:38.160612+0000 osd.4 (osd.4) 167 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:46:39.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:38.160671+0000 osd.4 (osd.4) 168 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:46:39.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:38.339503+0000 mon.a (mon.0) 1412 : cluster [DBG] osdmap e333: 8 total, 8 up, 7 in 2024-02-19T21:46:39.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:38.420894+0000 osd.7 (osd.7) 207 : cluster [DBG] 9.c scrub ok 2024-02-19T21:46:39.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:38.472199+0000 osd.4 (osd.4) 169 : cluster [DBG] 9.e scrub starts 2024-02-19T21:46:39.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:38.580195+0000 mon.b (mon.1) 58 : audit [DBG] from='client.? 172.21.15.80:0/441352430' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:46:39.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:38.793791+0000 mon.a (mon.0) 1413 : audit [DBG] from='client.? 172.21.15.80:0/3906120108' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-19T21:46:39.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:39.157451+0000 mon.a (mon.0) 1414 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:46:39.952 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:46:39.956 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:39.957 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:46:40.058 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:46:40.125 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:40.278 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:46:40.280 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:40.281 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:46:40.360 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:46:40.370 INFO:tasks.thrashosds.thrasher:j is {'epoch': 333, 'fsid': '6f763558-cf6d-11ee-95bb-87774f69a715', 'created': '2024-02-19T21:26:16.880265+0000', 'modified': '2024-02-19T21:46:38.335082+0000', 'last_up_change': '2024-02-19T21:32:14.805693+0000', 'last_in_change': '2024-02-19T21:39:38.443319+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 18, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 9, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-19T21:30:05.947623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2024-02-19T21:32:22.082250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2024-02-19T21:32:22.333164+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 3, 'pg_placement_num': 3, 'pg_placement_num_target': 3, 'pg_num_target': 3, 'pg_num_pending': 3, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2024-02-19T21:32:23.632615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2024-02-19T21:32:25.600876+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 22, 'pg_placement_num': 22, 'pg_placement_num_target': 22, 'pg_num_target': 22, 'pg_num_pending': 22, 'last_pg_merge_meta': {'source_pgid': '5.16', 'ready_epoch': 298, 'last_epoch_started': 297, 'last_epoch_clean': 297, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '325', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '298', 'last_force_op_resend_preluminous': '296', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2024-02-19T21:32:27.661242+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '6.16', 'ready_epoch': 243, 'last_epoch_started': 242, 'last_epoch_clean': 242, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '304', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '243', 'last_force_op_resend_preluminous': '302', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}}, {'pool': 9, 'pool_name': 'unique_pool_2', 'create_time': '2024-02-19T21:44:14.908840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '282', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': 'a72c63f6-46b3-4202-99da-7b0c92b799a5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 330, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6802', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6803', 'nonce': 3531298825}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6804', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6805', 'nonce': 3531298825}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6808', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6809', 'nonce': 3531298825}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6806', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6807', 'nonce': 3531298825}]}, 'public_addr': '172.21.15.80:6803/3531298825', 'cluster_addr': '172.21.15.80:6805/3531298825', 'heartbeat_back_addr': '172.21.15.80:6809/3531298825', 'heartbeat_front_addr': '172.21.15.80:6807/3531298825', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7d4e170e-b0ca-4e19-be35-4038ca126ee6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 304, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6810', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6811', 'nonce': 1497235950}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6812', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6813', 'nonce': 1497235950}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6816', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6817', 'nonce': 1497235950}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6814', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6815', 'nonce': 1497235950}]}, 'public_addr': '172.21.15.80:6811/1497235950', 'cluster_addr': '172.21.15.80:6813/1497235950', 'heartbeat_back_addr': '172.21.15.80:6817/1497235950', 'heartbeat_front_addr': '172.21.15.80:6815/1497235950', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'cf461b67-f3e8-45e9-b2f6-777752ba5574', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 18, 'up_thru': 144, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6818', 'nonce': 3131848307}, {'type': 'v1', 'addr': '172.21.15.80:6819', 'nonce': 3131848307}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6820', 'nonce': 3131848307}, {'type': 'v1', 'addr': '172.21.15.80:6821', 'nonce': 3131848307}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6824', 'nonce': 3131848307}, {'type': 'v1', 'addr': '172.21.15.80:6825', 'nonce': 3131848307}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6822', 'nonce': 3131848307}, {'type': 'v1', 'addr': '172.21.15.80:6823', 'nonce': 3131848307}]}, 'public_addr': '172.21.15.80:6819/3131848307', 'cluster_addr': '172.21.15.80:6821/3131848307', 'heartbeat_back_addr': '172.21.15.80:6825/3131848307', 'heartbeat_front_addr': '172.21.15.80:6823/3131848307', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '76318cdd-5fce-4a40-95c9-300d55c34820', 'up': 1, 'in': 1, 'weight': 0.4183197021484375, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 26, 'up_thru': 304, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6826', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6827', 'nonce': 2007978078}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6828', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6829', 'nonce': 2007978078}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6832', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6833', 'nonce': 2007978078}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6830', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6831', 'nonce': 2007978078}]}, 'public_addr': '172.21.15.80:6827/2007978078', 'cluster_addr': '172.21.15.80:6829/2007978078', 'heartbeat_back_addr': '172.21.15.80:6833/2007978078', 'heartbeat_front_addr': '172.21.15.80:6831/2007978078', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '6484964f-3391-4e1d-a56c-813f46124062', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.427398681640625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 32, 'up_thru': 304, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6800', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6801', 'nonce': 1922002860}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6802', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6803', 'nonce': 1922002860}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6806', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6807', 'nonce': 1922002860}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6804', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6805', 'nonce': 1922002860}]}, 'public_addr': '172.21.15.157:6801/1922002860', 'cluster_addr': '172.21.15.157:6803/1922002860', 'heartbeat_back_addr': '172.21.15.157:6807/1922002860', 'heartbeat_front_addr': '172.21.15.157:6805/1922002860', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '8c7e0309-8c3b-40b9-99d9-96620e52742f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 38, 'up_thru': 304, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6808', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6809', 'nonce': 960889603}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6810', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6811', 'nonce': 960889603}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6814', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6815', 'nonce': 960889603}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6812', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6813', 'nonce': 960889603}]}, 'public_addr': '172.21.15.157:6809/960889603', 'cluster_addr': '172.21.15.157:6811/960889603', 'heartbeat_back_addr': '172.21.15.157:6815/960889603', 'heartbeat_front_addr': '172.21.15.157:6813/960889603', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '5b7d44a3-197d-482c-bf9e-de5e9013a851', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 47, 'up_thru': 304, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6816', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6817', 'nonce': 2598265223}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6818', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6819', 'nonce': 2598265223}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6822', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6823', 'nonce': 2598265223}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6820', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6821', 'nonce': 2598265223}]}, 'public_addr': '172.21.15.157:6817/2598265223', 'cluster_addr': '172.21.15.157:6819/2598265223', 'heartbeat_back_addr': '172.21.15.157:6823/2598265223', 'heartbeat_front_addr': '172.21.15.157:6821/2598265223', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '7e2d0287-928d-40f8-841b-6c2077fc08ac', 'up': 1, 'in': 1, 'weight': 0.482391357421875, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 55, 'up_thru': 307, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6824', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6825', 'nonce': 3619345894}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6826', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6827', 'nonce': 3619345894}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6830', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6831', 'nonce': 3619345894}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6828', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6829', 'nonce': 3619345894}]}, 'public_addr': '172.21.15.157:6825/3619345894', 'cluster_addr': '172.21.15.157:6827/3619345894', 'heartbeat_back_addr': '172.21.15.157:6831/3619345894', 'heartbeat_front_addr': '172.21.15.157:6829/3619345894', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:45:49.464882+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:46:03.533152+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-02-19T21:45:31.579456+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:45:37.623876+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:46:38.160673+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:45:41.396705+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:45:39.646987+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:45:21.608272+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.c', 'osds': [6, 7, 2]}, {'pgid': '4.1', 'osds': [4, 2, 6]}, {'pgid': '9.0', 'osds': [7, 2, 6]}], 'pg_upmap_items': [{'pgid': '4.6', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.e', 'mappings': [{'from': 1, 'to': 7}]}, {'pgid': '4.f', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.19', 'mappings': [{'from': 1, 'to': 7}]}, {'pgid': '4.1f', 'mappings': [{'from': 1, 'to': 7}, {'from': 6, 'to': 0}]}, {'pgid': '5.1', 'mappings': [{'from': 4, 'to': 6}]}, {'pgid': '5.13', 'mappings': [{'from': 0, 'to': 6}]}, {'pgid': '6.f', 'mappings': [{'from': 4, 'to': 0}]}], 'pg_temp': [], 'primary_temp': [], 'blocklist': {'172.21.15.80:6800/2867197629': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:0/1659656010': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:6801/2272739550': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:0/867908385': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:0/398750494': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:0/2833137430': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:0/2520755315': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:6800/2094869828': '2024-02-20T21:26:51.262073+0000', '172.21.15.80:6800/2272739550': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:6801/2094869828': '2024-02-20T21:26:51.262073+0000', '172.21.15.80:0/2130852198': '2024-02-20T21:26:51.262073+0000', '172.21.15.80:6801/2867197629': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:0/1952386920': '2024-02-20T21:26:51.262073+0000'}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-02-19T21:46:40.370 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:46:40.382 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:46:40.425 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:40.502 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:46:40.506 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:40.507 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:46:40.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:39.094652+0000 mgr.y (mgr.14514) 540 : cluster [DBG] pgmap v679: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 5.7 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 647 B/s rd, 0 B/s wr, 692 op/s 2024-02-19T21:46:40.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:40.137044+0000 mon.a (mon.0) 1415 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:46:40.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:40.138008+0000 mon.a (mon.0) 1416 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:46:40.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:40.145204+0000 mon.a (mon.0) 1417 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:46:40.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:40.186648+0000 mon.a (mon.0) 1418 : cluster [DBG] osdmap e334: 8 total, 8 up, 7 in 2024-02-19T21:46:40.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:39.094652+0000 mgr.y (mgr.14514) 540 : cluster [DBG] pgmap v679: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 5.7 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 647 B/s rd, 0 B/s wr, 692 op/s 2024-02-19T21:46:40.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:40.137044+0000 mon.a (mon.0) 1415 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:46:40.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:40.138008+0000 mon.a (mon.0) 1416 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:46:40.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:40.145204+0000 mon.a (mon.0) 1417 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:46:40.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:40.186648+0000 mon.a (mon.0) 1418 : cluster [DBG] osdmap e334: 8 total, 8 up, 7 in 2024-02-19T21:46:40.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:39.094652+0000 mgr.y (mgr.14514) 540 : cluster [DBG] pgmap v679: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 5.7 GiB data, 20 GiB used, 606 GiB / 626 GiB avail; 647 B/s rd, 0 B/s wr, 692 op/s 2024-02-19T21:46:40.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:40.137044+0000 mon.a (mon.0) 1415 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:46:40.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:40.138008+0000 mon.a (mon.0) 1416 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:46:40.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:40.145204+0000 mon.a (mon.0) 1417 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:46:40.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:40.186648+0000 mon.a (mon.0) 1418 : cluster [DBG] osdmap e334: 8 total, 8 up, 7 in 2024-02-19T21:46:40.608 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:46:40.666 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:40.686 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:46:40.686 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [], 2024-02-19T21:46:40.686 INFO:teuthology.orchestra.run.smithi157.stdout: "complaint_time": 30, 2024-02-19T21:46:40.686 INFO:teuthology.orchestra.run.smithi157.stdout: "num_blocked_ops": 0 2024-02-19T21:46:40.686 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:46:40.718 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:46:40.722 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:40.723 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:46:40.823 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:46:40.872 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:40.910 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:46:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:46:40] "GET /metrics HTTP/1.1" 200 176146 "" "Prometheus/2.33.4" 2024-02-19T21:46:41.035 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:46:41.039 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:41.040 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:46:41.040 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:46:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:46:41.141 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:46:41.202 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:41.235 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:46:41.239 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:41.239 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:46:41.340 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:46:41.381 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:41.716 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:40.675510+0000 mgr.y (mgr.14514) 541 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:46:41.748 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.5 dump_historic_ops 2024-02-19T21:46:41.781 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:40.675510+0000 mgr.y (mgr.14514) 541 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:46:41.781 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:40.675510+0000 mgr.y (mgr.14514) 541 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:46:41.781 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:46:41.886 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:46:42.047 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:46:42.054 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:42.054 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:46:42.155 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:46:42.176 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:46:42.205 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:42.314 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:46:42.318 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:42.318 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:46:42.419 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:46:42.466 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:42.496 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:46:42.502 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:42.502 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:46:42.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:41.095151+0000 mgr.y (mgr.14514) 542 : cluster [DBG] pgmap v681: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 5.4 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1.76k op/s 2024-02-19T21:46:42.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:41.140684+0000 osd.4 (osd.4) 170 : cluster [DBG] 9.e scrub ok 2024-02-19T21:46:42.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:41.729167+0000 osd.2 (osd.2) 125 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:46:42.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:41.729217+0000 osd.2 (osd.2) 126 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:46:42.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:41.831311+0000 osd.5 (osd.5) 231 : cluster [DBG] 2.2 scrub starts 2024-02-19T21:46:42.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:41.834241+0000 osd.5 (osd.5) 232 : cluster [DBG] 2.2 scrub ok 2024-02-19T21:46:42.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:41.095151+0000 mgr.y (mgr.14514) 542 : cluster [DBG] pgmap v681: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 5.4 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1.76k op/s 2024-02-19T21:46:42.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:41.140684+0000 osd.4 (osd.4) 170 : cluster [DBG] 9.e scrub ok 2024-02-19T21:46:42.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:41.729167+0000 osd.2 (osd.2) 125 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:46:42.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:41.729217+0000 osd.2 (osd.2) 126 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:46:42.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:41.831311+0000 osd.5 (osd.5) 231 : cluster [DBG] 2.2 scrub starts 2024-02-19T21:46:42.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:41.834241+0000 osd.5 (osd.5) 232 : cluster [DBG] 2.2 scrub ok 2024-02-19T21:46:42.603 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:46:42.654 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:41.095151+0000 mgr.y (mgr.14514) 542 : cluster [DBG] pgmap v681: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 5.4 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1.76k op/s 2024-02-19T21:46:42.654 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:41.140684+0000 osd.4 (osd.4) 170 : cluster [DBG] 9.e scrub ok 2024-02-19T21:46:42.654 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:41.729167+0000 osd.2 (osd.2) 125 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:46:42.654 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:41.729217+0000 osd.2 (osd.2) 126 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:46:42.654 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:41.831311+0000 osd.5 (osd.5) 231 : cluster [DBG] 2.2 scrub starts 2024-02-19T21:46:42.655 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:41.834241+0000 osd.5 (osd.5) 232 : cluster [DBG] 2.2 scrub ok 2024-02-19T21:46:42.655 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:42.686 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:46:42.693 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:42.694 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:46:42.794 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:46:42.843 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:43.705 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:42.087808+0000 osd.7 (osd.7) 208 : cluster [DBG] 2.1d scrub starts 2024-02-19T21:46:43.705 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:42.091596+0000 osd.7 (osd.7) 209 : cluster [DBG] 2.1d scrub ok 2024-02-19T21:46:43.705 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:42.405595+0000 mon.a (mon.0) 1419 : cluster [DBG] osdmap e335: 8 total, 8 up, 7 in 2024-02-19T21:46:43.705 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:42.971504+0000 mon.c (mon.2) 74 : audit [INF] from='client.? 172.21.15.80:0/779344352' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:46:43.705 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:42.971900+0000 mon.a (mon.0) 1420 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:46:43.705 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:43.080567+0000 osd.6 (osd.6) 201 : cluster [DBG] 4.e scrub starts 2024-02-19T21:46:43.705 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:43.088728+0000 osd.6 (osd.6) 202 : cluster [DBG] 4.e scrub ok 2024-02-19T21:46:43.706 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:42.087808+0000 osd.7 (osd.7) 208 : cluster [DBG] 2.1d scrub starts 2024-02-19T21:46:43.706 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:42.091596+0000 osd.7 (osd.7) 209 : cluster [DBG] 2.1d scrub ok 2024-02-19T21:46:43.706 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:42.405595+0000 mon.a (mon.0) 1419 : cluster [DBG] osdmap e335: 8 total, 8 up, 7 in 2024-02-19T21:46:43.706 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:42.971504+0000 mon.c (mon.2) 74 : audit [INF] from='client.? 172.21.15.80:0/779344352' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:46:43.706 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:42.971900+0000 mon.a (mon.0) 1420 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:46:43.707 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:43.080567+0000 osd.6 (osd.6) 201 : cluster [DBG] 4.e scrub starts 2024-02-19T21:46:43.707 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:43.088728+0000 osd.6 (osd.6) 202 : cluster [DBG] 4.e scrub ok 2024-02-19T21:46:43.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:42.087808+0000 osd.7 (osd.7) 208 : cluster [DBG] 2.1d scrub starts 2024-02-19T21:46:43.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:42.091596+0000 osd.7 (osd.7) 209 : cluster [DBG] 2.1d scrub ok 2024-02-19T21:46:43.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:42.405595+0000 mon.a (mon.0) 1419 : cluster [DBG] osdmap e335: 8 total, 8 up, 7 in 2024-02-19T21:46:43.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:42.971504+0000 mon.c (mon.2) 74 : audit [INF] from='client.? 172.21.15.80:0/779344352' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:46:43.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:42.971900+0000 mon.a (mon.0) 1420 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:46:43.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:43.080567+0000 osd.6 (osd.6) 201 : cluster [DBG] 4.e scrub starts 2024-02-19T21:46:43.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:43.088728+0000 osd.6 (osd.6) 202 : cluster [DBG] 4.e scrub ok 2024-02-19T21:46:44.113 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:46:44.123 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:44.123 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:46:44.224 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:46:44.272 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:44.421 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:43.053485+0000 osd.7 (osd.7) 210 : cluster [DBG] 2.b scrub starts 2024-02-19T21:46:44.421 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:43.056392+0000 osd.7 (osd.7) 211 : cluster [DBG] 2.b scrub ok 2024-02-19T21:46:44.421 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:43.095542+0000 mgr.y (mgr.14514) 543 : cluster [DBG] pgmap v683: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 5.4 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 882 op/s 2024-02-19T21:46:44.421 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:43.402735+0000 mon.a (mon.0) 1421 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:46:44.421 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:43.402755+0000 mon.a (mon.0) 1422 : cluster [INF] Cluster is now healthy 2024-02-19T21:46:44.421 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:43.417759+0000 mon.a (mon.0) 1423 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:46:44.421 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:43.417806+0000 mon.a (mon.0) 1424 : cluster [DBG] osdmap e336: 8 total, 8 up, 7 in 2024-02-19T21:46:44.421 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:43.467760+0000 osd.4 (osd.4) 171 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:46:44.421 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:43.474977+0000 osd.4 (osd.4) 172 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:46:44.422 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:43.744206+0000 osd.3 (osd.3) 212 : cluster [DBG] 6.8 scrub starts 2024-02-19T21:46:44.422 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:43.773481+0000 osd.3 (osd.3) 213 : cluster [DBG] 6.8 scrub ok 2024-02-19T21:46:44.492 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:46:44.492 INFO:teuthology.orchestra.run.smithi157.stdout: "size": 20, 2024-02-19T21:46:44.492 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 600, 2024-02-19T21:46:44.492 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [ 2024-02-19T21:46:44.492 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.492 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199219 7.0 7:008a2300:::benchmark_data_smithi080_79222_object84485:head [delete] snapc 0=[] ondisk+write+known_if_redirected e143)", 2024-02-19T21:46:44.492 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:30.236350+0000", 2024-02-19T21:46:44.493 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 494.25263855200001, 2024-02-19T21:46:44.493 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.3305712409999999, 2024-02-19T21:46:44.493 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:46:44.493 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "reached pg", 2024-02-19T21:46:44.493 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:46:44.493 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:46:44.493 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:46:44.493 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199219 2024-02-19T21:46:44.493 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.493 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:46:44.493 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.493 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:46:44.493 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.236350+0000", 2024-02-19T21:46:44.493 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:46:44.493 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.493 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.494 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:46:44.494 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.236350+0000", 2024-02-19T21:46:44.494 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:46:44.494 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.494 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.494 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:46:44.494 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.236348+0000", 2024-02-19T21:46:44.494 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.4510000000000003e-06 2024-02-19T21:46:44.494 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.494 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.494 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:46:44.494 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.236355+0000", 2024-02-19T21:46:44.494 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.257e-05 2024-02-19T21:46:44.494 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.495 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.495 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:46:44.495 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.236368+0000", 2024-02-19T21:46:44.495 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.0389999999999999e-06 2024-02-19T21:46:44.495 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.495 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.495 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:46:44.495 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.236375+0000", 2024-02-19T21:46:44.495 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.5358000000000001e-05 2024-02-19T21:46:44.495 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.495 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.495 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.495 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.236430+0000", 2024-02-19T21:46:44.495 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000115699 2024-02-19T21:46:44.496 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.496 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.496 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:46:44.496 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.236546+0000", 2024-02-19T21:46:44.496 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000119231 2024-02-19T21:46:44.496 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.496 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.496 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,3", 2024-02-19T21:46:44.496 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.236665+0000", 2024-02-19T21:46:44.496 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0089928769999999998 2024-02-19T21:46:44.496 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.496 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.496 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.497 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.245658+0000", 2024-02-19T21:46:44.497 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1632e-05 2024-02-19T21:46:44.497 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.497 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.497 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:46:44.497 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.245670+0000", 2024-02-19T21:46:44.497 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99828577699999999 2024-02-19T21:46:44.497 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.497 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.497 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.497 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.243956+0000", 2024-02-19T21:46:44.497 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.6150999999999998e-05 2024-02-19T21:46:44.497 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.497 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.498 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:46:44.498 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.243972+0000", 2024-02-19T21:46:44.498 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.285249519 2024-02-19T21:46:44.498 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.498 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.498 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.498 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.529221+0000", 2024-02-19T21:46:44.498 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00015943500000000001 2024-02-19T21:46:44.498 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.498 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.498 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for missing object", 2024-02-19T21:46:44.498 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.529381+0000", 2024-02-19T21:46:44.498 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.037443894999999998 2024-02-19T21:46:44.498 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.498 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.498 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.499 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.566825+0000", 2024-02-19T21:46:44.499 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.6427000000000004e-05 2024-02-19T21:46:44.499 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.499 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.499 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:46:44.499 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.566921+0000", 2024-02-19T21:46:44.499 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.3305712409999999 2024-02-19T21:46:44.499 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.499 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:44.499 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.499 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.499 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.499 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199245 7.0 7:0468ad2b:::benchmark_data_smithi080_79222_object84511:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:46:44.499 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:32.368334+0000", 2024-02-19T21:46:44.500 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 492.12065404200001, 2024-02-19T21:46:44.500 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.195594253, 2024-02-19T21:46:44.500 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:46:44.500 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:46:44.500 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:46:44.500 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:46:44.500 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:46:44.500 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199245 2024-02-19T21:46:44.500 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.500 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:46:44.500 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.500 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:46:44.500 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368334+0000", 2024-02-19T21:46:44.500 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:46:44.501 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.501 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.501 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:46:44.501 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368334+0000", 2024-02-19T21:46:44.501 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:46:44.501 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.501 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.501 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:46:44.501 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368333+0000", 2024-02-19T21:46:44.501 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.6379999999999993e-06 2024-02-19T21:46:44.501 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.501 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.501 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:46:44.501 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368341+0000", 2024-02-19T21:46:44.501 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.3957999999999999e-05 2024-02-19T21:46:44.502 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.502 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.502 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:46:44.502 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368355+0000", 2024-02-19T21:46:44.502 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.357e-06 2024-02-19T21:46:44.502 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.502 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.502 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:46:44.502 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368363+0000", 2024-02-19T21:46:44.502 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.8634000000000001e-05 2024-02-19T21:46:44.502 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.502 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.502 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.502 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368421+0000", 2024-02-19T21:46:44.503 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0349999999999999e-05 2024-02-19T21:46:44.503 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.503 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.503 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:46:44.503 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368432+0000", 2024-02-19T21:46:44.503 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.16097948000000001 2024-02-19T21:46:44.503 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.503 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.503 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.503 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.529411+0000", 2024-02-19T21:46:44.503 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000121179 2024-02-19T21:46:44.503 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.503 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.503 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:46:44.504 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.529532+0000", 2024-02-19T21:46:44.504 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00040755199999999999 2024-02-19T21:46:44.504 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.504 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.504 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,2,3", 2024-02-19T21:46:44.504 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.529940+0000", 2024-02-19T21:46:44.504 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.014569415 2024-02-19T21:46:44.504 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.504 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.504 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:46:44.504 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.544509+0000", 2024-02-19T21:46:44.504 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000316762 2024-02-19T21:46:44.504 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.505 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.505 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.505 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.544826+0000", 2024-02-19T21:46:44.505 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.4066000000000001e-05 2024-02-19T21:46:44.505 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.505 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.505 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.505 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.544870+0000", 2024-02-19T21:46:44.505 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.018901069 2024-02-19T21:46:44.505 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.505 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.505 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.505 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.563771+0000", 2024-02-19T21:46:44.505 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.0245999999999999e-05 2024-02-19T21:46:44.505 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.506 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.506 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:46:44.506 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.563831+0000", 2024-02-19T21:46:44.506 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.7231000000000005e-05 2024-02-19T21:46:44.506 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.506 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.506 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:46:44.506 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.563929+0000", 2024-02-19T21:46:44.506 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.195594253 2024-02-19T21:46:44.506 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.506 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:44.506 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.506 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.506 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.507 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199247 7.0 7:03662bec:::benchmark_data_smithi080_79222_object84513:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:46:44.507 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:32.368479+0000", 2024-02-19T21:46:44.507 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 492.12050973100003, 2024-02-19T21:46:44.507 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.195709675, 2024-02-19T21:46:44.507 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:46:44.507 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:46:44.507 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:46:44.507 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:46:44.507 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:46:44.507 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199247 2024-02-19T21:46:44.507 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.507 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:46:44.507 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.507 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:46:44.508 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368479+0000", 2024-02-19T21:46:44.508 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:46:44.508 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.508 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.508 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:46:44.508 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368479+0000", 2024-02-19T21:46:44.508 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:46:44.508 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.508 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.508 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:46:44.508 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368478+0000", 2024-02-19T21:46:44.508 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.5199999999999999e-06 2024-02-19T21:46:44.508 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.508 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.509 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:46:44.509 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368482+0000", 2024-02-19T21:46:44.509 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.5569999999999998e-06 2024-02-19T21:46:44.509 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.509 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.509 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:46:44.509 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368490+0000", 2024-02-19T21:46:44.509 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.1320000000000004e-06 2024-02-19T21:46:44.509 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.509 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.509 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:46:44.509 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368494+0000", 2024-02-19T21:46:44.509 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.7259000000000003e-05 2024-02-19T21:46:44.509 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.510 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.510 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.510 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368541+0000", 2024-02-19T21:46:44.510 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.0260000000000007e-06 2024-02-19T21:46:44.510 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.510 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.510 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:46:44.510 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368549+0000", 2024-02-19T21:46:44.510 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.16646153999999999 2024-02-19T21:46:44.510 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.510 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.510 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.510 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.535011+0000", 2024-02-19T21:46:44.510 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.0251e-05 2024-02-19T21:46:44.510 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.511 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.511 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:46:44.511 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.535101+0000", 2024-02-19T21:46:44.511 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00010227599999999999 2024-02-19T21:46:44.511 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.511 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.511 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,2,3", 2024-02-19T21:46:44.511 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.535204+0000", 2024-02-19T21:46:44.511 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0093148099999999998 2024-02-19T21:46:44.511 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.511 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.511 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:46:44.511 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.544518+0000", 2024-02-19T21:46:44.511 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000399014 2024-02-19T21:46:44.511 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.512 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.512 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.512 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.544917+0000", 2024-02-19T21:46:44.512 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0038933739999999998 2024-02-19T21:46:44.512 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.512 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.512 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.512 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.548811+0000", 2024-02-19T21:46:44.512 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.01518389 2024-02-19T21:46:44.512 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.512 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.512 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.512 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.563995+0000", 2024-02-19T21:46:44.513 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.4846000000000003e-05 2024-02-19T21:46:44.513 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.513 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.513 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:46:44.513 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.564049+0000", 2024-02-19T21:46:44.513 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000138849 2024-02-19T21:46:44.513 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.513 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.513 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:46:44.513 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.564188+0000", 2024-02-19T21:46:44.513 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.195709675 2024-02-19T21:46:44.513 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.513 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:44.513 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.514 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.514 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.514 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199267 7.0 7:0c7cb9ed:::benchmark_data_smithi080_79222_object84533:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:46:44.514 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:32.413729+0000", 2024-02-19T21:46:44.514 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 492.07525935000001, 2024-02-19T21:46:44.514 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.150689182, 2024-02-19T21:46:44.514 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:46:44.514 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:46:44.514 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:46:44.514 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:46:44.514 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:46:44.514 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199267 2024-02-19T21:46:44.514 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.514 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:46:44.514 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.515 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:46:44.515 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.413729+0000", 2024-02-19T21:46:44.515 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:46:44.515 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.515 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.515 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:46:44.515 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.413729+0000", 2024-02-19T21:46:44.515 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:46:44.515 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.515 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.515 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:46:44.515 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.413727+0000", 2024-02-19T21:46:44.515 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.6499999999999999e-06 2024-02-19T21:46:44.515 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.515 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.516 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:46:44.516 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.413734+0000", 2024-02-19T21:46:44.516 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0258000000000001e-05 2024-02-19T21:46:44.516 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.516 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.516 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:46:44.516 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.413744+0000", 2024-02-19T21:46:44.516 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.2290000000000002e-06 2024-02-19T21:46:44.516 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.516 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.516 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:46:44.516 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.413749+0000", 2024-02-19T21:46:44.516 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.5117999999999997e-05 2024-02-19T21:46:44.516 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.517 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.517 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.517 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.413795+0000", 2024-02-19T21:46:44.517 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0001e-05 2024-02-19T21:46:44.517 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.517 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.517 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:46:44.517 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.413805+0000", 2024-02-19T21:46:44.517 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.12308849600000001 2024-02-19T21:46:44.517 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.517 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.517 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.517 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.536893+0000", 2024-02-19T21:46:44.517 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00010344999999999999 2024-02-19T21:46:44.517 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.517 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.518 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:46:44.518 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.536997+0000", 2024-02-19T21:46:44.518 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.1219999999999997e-05 2024-02-19T21:46:44.518 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.518 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.518 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,2,3", 2024-02-19T21:46:44.518 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.537088+0000", 2024-02-19T21:46:44.518 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0074380660000000001 2024-02-19T21:46:44.518 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.518 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.518 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:46:44.518 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.544526+0000", 2024-02-19T21:46:44.518 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00042507999999999999 2024-02-19T21:46:44.518 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.518 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.519 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.519 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.544951+0000", 2024-02-19T21:46:44.519 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0039149349999999996 2024-02-19T21:46:44.519 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.519 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.519 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.519 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.548866+0000", 2024-02-19T21:46:44.519 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.015366348 2024-02-19T21:46:44.519 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.519 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.519 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.519 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.564232+0000", 2024-02-19T21:46:44.519 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0595e-05 2024-02-19T21:46:44.519 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.519 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.520 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:46:44.520 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.564273+0000", 2024-02-19T21:46:44.520 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014538600000000001 2024-02-19T21:46:44.520 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.520 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.520 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:46:44.520 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.564418+0000", 2024-02-19T21:46:44.520 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.150689182 2024-02-19T21:46:44.520 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.520 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:44.520 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.520 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.520 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.520 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199274 7.0 7:02b7d55e:::benchmark_data_smithi080_79222_object84540:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:46:44.520 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:32.426703+0000", 2024-02-19T21:46:44.521 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 492.06228542899999, 2024-02-19T21:46:44.521 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.137961326, 2024-02-19T21:46:44.521 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:46:44.521 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:46:44.521 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:46:44.521 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:46:44.521 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:46:44.521 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199274 2024-02-19T21:46:44.521 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.521 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:46:44.521 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.521 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:46:44.521 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.426703+0000", 2024-02-19T21:46:44.521 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:46:44.521 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.521 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.522 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:46:44.522 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.426703+0000", 2024-02-19T21:46:44.522 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:46:44.522 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.522 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.522 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:46:44.522 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.426701+0000", 2024-02-19T21:46:44.522 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.7780000000000002e-06 2024-02-19T21:46:44.522 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.522 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.522 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:46:44.522 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.426711+0000", 2024-02-19T21:46:44.522 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0484e-05 2024-02-19T21:46:44.522 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.522 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.522 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:46:44.523 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.426721+0000", 2024-02-19T21:46:44.523 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.9939999999999997e-06 2024-02-19T21:46:44.523 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.523 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.523 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:46:44.523 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.426727+0000", 2024-02-19T21:46:44.523 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00026808799999999999 2024-02-19T21:46:44.523 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.523 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.523 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.523 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.426995+0000", 2024-02-19T21:46:44.523 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.4859999999999997e-06 2024-02-19T21:46:44.523 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.523 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.524 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:46:44.524 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.427004+0000", 2024-02-19T21:46:44.524 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.111611845 2024-02-19T21:46:44.524 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.524 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.524 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.524 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.538616+0000", 2024-02-19T21:46:44.524 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014267699999999999 2024-02-19T21:46:44.524 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.524 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.524 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:46:44.524 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.538758+0000", 2024-02-19T21:46:44.524 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00017814799999999999 2024-02-19T21:46:44.524 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.525 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.525 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,2,3", 2024-02-19T21:46:44.525 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.538937+0000", 2024-02-19T21:46:44.525 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0057249129999999999 2024-02-19T21:46:44.525 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.525 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.525 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:46:44.525 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.544662+0000", 2024-02-19T21:46:44.525 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00033100600000000001 2024-02-19T21:46:44.525 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.525 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.525 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.525 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.544993+0000", 2024-02-19T21:46:44.525 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0074629220000000003 2024-02-19T21:46:44.525 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.526 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.526 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.526 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.552455+0000", 2024-02-19T21:46:44.526 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.012017865000000001 2024-02-19T21:46:44.526 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.526 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.526 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.526 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.564473+0000", 2024-02-19T21:46:44.526 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.4693e-05 2024-02-19T21:46:44.526 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.526 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.526 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:46:44.526 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.564528+0000", 2024-02-19T21:46:44.526 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000136198 2024-02-19T21:46:44.526 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.526 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.527 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:46:44.527 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.564664+0000", 2024-02-19T21:46:44.527 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.137961326 2024-02-19T21:46:44.527 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.527 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:44.527 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.527 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.527 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.527 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199275 7.0 7:0f90fb36:::benchmark_data_smithi080_79222_object84541:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:46:44.527 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:32.426746+0000", 2024-02-19T21:46:44.527 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 492.06224251100002, 2024-02-19T21:46:44.527 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.13808023999999999, 2024-02-19T21:46:44.527 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:46:44.527 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:46:44.528 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:46:44.528 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:46:44.528 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:46:44.528 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199275 2024-02-19T21:46:44.528 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.528 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:46:44.528 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.528 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:46:44.528 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.426746+0000", 2024-02-19T21:46:44.528 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:46:44.528 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.528 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.528 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:46:44.528 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.426746+0000", 2024-02-19T21:46:44.528 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:46:44.529 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.529 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.529 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:46:44.529 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.426745+0000", 2024-02-19T21:46:44.529 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.3160000000000001e-06 2024-02-19T21:46:44.529 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.529 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.529 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:46:44.529 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.426749+0000", 2024-02-19T21:46:44.529 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.5729999999999996e-06 2024-02-19T21:46:44.529 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.529 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.529 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:46:44.529 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.426755+0000", 2024-02-19T21:46:44.529 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0289999999999999e-06 2024-02-19T21:46:44.529 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.530 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.530 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:46:44.530 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.426759+0000", 2024-02-19T21:46:44.530 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00026425899999999998 2024-02-19T21:46:44.530 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.530 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.530 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.530 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.427023+0000", 2024-02-19T21:46:44.530 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.699e-06 2024-02-19T21:46:44.530 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.530 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.530 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:46:44.530 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.427029+0000", 2024-02-19T21:46:44.530 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.11400739 2024-02-19T21:46:44.530 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.530 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.531 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.531 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.541037+0000", 2024-02-19T21:46:44.531 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.6248000000000005e-05 2024-02-19T21:46:44.531 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.531 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.531 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:46:44.531 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.541123+0000", 2024-02-19T21:46:44.531 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.5384999999999996e-05 2024-02-19T21:46:44.531 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.531 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.531 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,2,3", 2024-02-19T21:46:44.531 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.541218+0000", 2024-02-19T21:46:44.531 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.003451951 2024-02-19T21:46:44.532 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.532 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.532 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:46:44.532 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.544670+0000", 2024-02-19T21:46:44.532 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00035230599999999998 2024-02-19T21:46:44.532 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.532 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.532 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.532 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.545022+0000", 2024-02-19T21:46:44.532 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0084526400000000008 2024-02-19T21:46:44.532 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.532 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.532 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.532 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.553475+0000", 2024-02-19T21:46:44.532 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.011229556 2024-02-19T21:46:44.533 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.533 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.533 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.533 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.564705+0000", 2024-02-19T21:46:44.533 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.2595999999999998e-05 2024-02-19T21:46:44.533 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.533 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.533 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:46:44.533 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.564737+0000", 2024-02-19T21:46:44.533 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.8850999999999993e-05 2024-02-19T21:46:44.534 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.534 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.534 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:46:44.534 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.564826+0000", 2024-02-19T21:46:44.534 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.13808023999999999 2024-02-19T21:46:44.534 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.534 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:44.534 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.534 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.534 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.534 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199276 7.0 7:0e071ec3:::benchmark_data_smithi080_79222_object84542:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:46:44.534 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:32.426769+0000", 2024-02-19T21:46:44.534 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 492.06221930100003, 2024-02-19T21:46:44.534 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.13829388200000001, 2024-02-19T21:46:44.534 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:46:44.535 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:46:44.535 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:46:44.535 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:46:44.535 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:46:44.535 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199276 2024-02-19T21:46:44.535 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.535 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:46:44.535 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.535 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:46:44.535 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.426769+0000", 2024-02-19T21:46:44.535 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:46:44.535 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.535 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.536 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:46:44.536 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.426769+0000", 2024-02-19T21:46:44.536 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:46:44.536 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.536 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.536 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:46:44.536 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.426769+0000", 2024-02-19T21:46:44.536 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.8800000000000001e-06 2024-02-19T21:46:44.536 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.536 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.536 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:46:44.536 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.426772+0000", 2024-02-19T21:46:44.536 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.3939999999999996e-06 2024-02-19T21:46:44.536 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.537 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.537 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:46:44.537 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.426781+0000", 2024-02-19T21:46:44.537 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.9729999999999999e-06 2024-02-19T21:46:44.537 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.537 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.537 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:46:44.537 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.426785+0000", 2024-02-19T21:46:44.537 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00026191700000000002 2024-02-19T21:46:44.537 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.537 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.537 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.537 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.427047+0000", 2024-02-19T21:46:44.537 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.7610000000000004e-06 2024-02-19T21:46:44.537 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.538 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.538 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:46:44.538 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.427053+0000", 2024-02-19T21:46:44.538 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.115517674 2024-02-19T21:46:44.538 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.538 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.538 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.538 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.542570+0000", 2024-02-19T21:46:44.538 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000125881 2024-02-19T21:46:44.538 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.538 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.538 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:46:44.538 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.542696+0000", 2024-02-19T21:46:44.538 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000169712 2024-02-19T21:46:44.539 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.539 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.539 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,2,3", 2024-02-19T21:46:44.539 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.542866+0000", 2024-02-19T21:46:44.539 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0019705339999999999 2024-02-19T21:46:44.539 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.539 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.539 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:46:44.539 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.544836+0000", 2024-02-19T21:46:44.539 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000226219 2024-02-19T21:46:44.539 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.539 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.539 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.539 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.545063+0000", 2024-02-19T21:46:44.540 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.013768828 2024-02-19T21:46:44.540 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.540 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.540 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.540 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.558831+0000", 2024-02-19T21:46:44.540 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0060431149999999999 2024-02-19T21:46:44.540 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.540 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.540 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.540 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.564874+0000", 2024-02-19T21:46:44.540 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.3380000000000001e-05 2024-02-19T21:46:44.540 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.540 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.541 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:46:44.541 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.564928+0000", 2024-02-19T21:46:44.541 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013507600000000001 2024-02-19T21:46:44.541 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.541 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.541 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:46:44.541 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.565063+0000", 2024-02-19T21:46:44.541 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.13829388200000001 2024-02-19T21:46:44.541 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.541 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:44.541 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.541 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.541 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.541 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:255326 8.8 8:103f1b56:::benchmark_data_smithi080_100924_object127608:head [delete] snapc 0=[] ondisk+write+known_if_redirected e248)", 2024-02-19T21:46:44.541 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:43:40.130079+0000", 2024-02-19T21:46:44.542 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 184.35890952, 2024-02-19T21:46:44.542 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.024614425, 2024-02-19T21:46:44.542 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:46:44.542 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:46:44.542 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:46:44.542 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:46:44.542 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:46:44.542 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 255326 2024-02-19T21:46:44.542 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.542 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:46:44.542 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.542 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:46:44.542 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.130079+0000", 2024-02-19T21:46:44.542 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:46:44.542 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.542 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.543 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:46:44.543 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.130079+0000", 2024-02-19T21:46:44.543 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:46:44.543 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.543 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.543 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:46:44.543 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.130078+0000", 2024-02-19T21:46:44.543 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.2619999999999998e-06 2024-02-19T21:46:44.543 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.543 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.543 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:46:44.543 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.130083+0000", 2024-02-19T21:46:44.543 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.9529999999999999e-06 2024-02-19T21:46:44.543 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.544 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.544 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:46:44.544 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.130091+0000", 2024-02-19T21:46:44.544 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.9939999999999997e-06 2024-02-19T21:46:44.544 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.544 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.544 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:46:44.544 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.130097+0000", 2024-02-19T21:46:44.544 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.9274999999999999e-05 2024-02-19T21:46:44.544 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.544 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.544 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.544 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.130136+0000", 2024-02-19T21:46:44.544 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.9750000000000004e-06 2024-02-19T21:46:44.545 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.545 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.545 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:46:44.545 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.130142+0000", 2024-02-19T21:46:44.545 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.010891354 2024-02-19T21:46:44.545 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.548 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.548 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.548 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.141033+0000", 2024-02-19T21:46:44.548 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.7e-05 2024-02-19T21:46:44.548 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.548 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.548 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:46:44.548 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.141130+0000", 2024-02-19T21:46:44.548 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.8831000000000003e-05 2024-02-19T21:46:44.548 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.548 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.548 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:46:44.548 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.141229+0000", 2024-02-19T21:46:44.549 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0063934939999999996 2024-02-19T21:46:44.549 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.549 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.549 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:46:44.549 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.147623+0000", 2024-02-19T21:46:44.549 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0069250630000000004 2024-02-19T21:46:44.549 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.549 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.549 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.549 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.154548+0000", 2024-02-19T21:46:44.549 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.7329999999999994e-05 2024-02-19T21:46:44.549 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.549 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.549 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.549 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.154615+0000", 2024-02-19T21:46:44.550 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0281999999999997e-05 2024-02-19T21:46:44.550 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.550 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.550 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:46:44.550 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.154665+0000", 2024-02-19T21:46:44.550 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.7764999999999999e-05 2024-02-19T21:46:44.550 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.550 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.550 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:46:44.550 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.154693+0000", 2024-02-19T21:46:44.550 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.024614425 2024-02-19T21:46:44.551 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.551 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:44.551 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.551 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.551 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.551 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:255358 8.8 8:1942b85c:::benchmark_data_smithi080_100924_object127640:head [delete] snapc 0=[] ondisk+write+known_if_redirected e248)", 2024-02-19T21:46:44.551 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:43:40.192892+0000", 2024-02-19T21:46:44.551 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 184.296096702, 2024-02-19T21:46:44.551 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.96204185799999997, 2024-02-19T21:46:44.551 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:46:44.551 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:46:44.551 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:46:44.551 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:46:44.551 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:46:44.551 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 255358 2024-02-19T21:46:44.552 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.552 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:46:44.552 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.552 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:46:44.552 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.192892+0000", 2024-02-19T21:46:44.552 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:46:44.552 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.552 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.552 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:46:44.552 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.192892+0000", 2024-02-19T21:46:44.552 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:46:44.552 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.552 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.552 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:46:44.553 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.192890+0000", 2024-02-19T21:46:44.553 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.7659999999999998e-06 2024-02-19T21:46:44.553 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.553 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.553 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:46:44.553 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.192898+0000", 2024-02-19T21:46:44.553 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2625e-05 2024-02-19T21:46:44.553 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.553 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.553 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:46:44.553 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.192910+0000", 2024-02-19T21:46:44.553 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.7490000000000001e-06 2024-02-19T21:46:44.553 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.553 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.553 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:46:44.553 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.192917+0000", 2024-02-19T21:46:44.554 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.7979000000000003e-05 2024-02-19T21:46:44.554 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.554 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.554 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.554 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.192965+0000", 2024-02-19T21:46:44.554 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.4090000000000003e-06 2024-02-19T21:46:44.554 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.554 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.554 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:46:44.554 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.192973+0000", 2024-02-19T21:46:44.554 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.95093640499999998 2024-02-19T21:46:44.554 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.554 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.554 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.554 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.143910+0000", 2024-02-19T21:46:44.554 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.5894000000000002e-05 2024-02-19T21:46:44.555 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.555 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.555 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:46:44.555 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.143986+0000", 2024-02-19T21:46:44.555 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013960000000000001 2024-02-19T21:46:44.555 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.555 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.555 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:46:44.555 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.144125+0000", 2024-02-19T21:46:44.555 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0069208560000000004 2024-02-19T21:46:44.555 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.555 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.555 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:46:44.555 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.151046+0000", 2024-02-19T21:46:44.555 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.003706979 2024-02-19T21:46:44.556 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.556 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.556 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.556 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.154753+0000", 2024-02-19T21:46:44.556 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000113428 2024-02-19T21:46:44.556 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.556 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.556 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.556 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.154867+0000", 2024-02-19T21:46:44.556 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.0709e-05 2024-02-19T21:46:44.556 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.556 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.556 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:46:44.557 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.154897+0000", 2024-02-19T21:46:44.557 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.6263999999999997e-05 2024-02-19T21:46:44.557 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.557 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.557 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:46:44.557 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.154933+0000", 2024-02-19T21:46:44.557 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.96204185799999997 2024-02-19T21:46:44.557 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.557 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:44.557 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.557 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.557 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.557 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:255392 8.8 8:16d3d2be:::benchmark_data_smithi080_100924_object127674:head [delete] snapc 0=[] ondisk+write+known_if_redirected e248)", 2024-02-19T21:46:44.557 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:43:40.220253+0000", 2024-02-19T21:46:44.557 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 184.268735599, 2024-02-19T21:46:44.558 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.93481943899999997, 2024-02-19T21:46:44.558 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:46:44.558 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:46:44.558 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:46:44.558 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:46:44.558 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:46:44.558 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 255392 2024-02-19T21:46:44.558 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.558 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:46:44.558 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.558 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:46:44.558 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.220253+0000", 2024-02-19T21:46:44.558 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:46:44.558 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.559 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.559 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:46:44.559 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.220253+0000", 2024-02-19T21:46:44.559 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:46:44.559 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.559 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.559 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:46:44.559 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.220251+0000", 2024-02-19T21:46:44.559 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.5699999999999998e-06 2024-02-19T21:46:44.559 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.559 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.559 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:46:44.559 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.220258+0000", 2024-02-19T21:46:44.559 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.2342000000000001e-05 2024-02-19T21:46:44.559 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.560 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.560 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:46:44.560 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.220280+0000", 2024-02-19T21:46:44.560 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.9070000000000001e-06 2024-02-19T21:46:44.560 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.560 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.560 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:46:44.560 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.220287+0000", 2024-02-19T21:46:44.560 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00046694999999999999 2024-02-19T21:46:44.560 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.560 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.560 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.560 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.220754+0000", 2024-02-19T21:46:44.560 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.4089999999999997e-06 2024-02-19T21:46:44.560 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.560 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.561 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:46:44.561 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.220761+0000", 2024-02-19T21:46:44.561 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.92515508099999999 2024-02-19T21:46:44.561 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.561 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.561 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.561 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.145916+0000", 2024-02-19T21:46:44.561 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.7277999999999999e-05 2024-02-19T21:46:44.561 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.561 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.561 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:46:44.561 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.146014+0000", 2024-02-19T21:46:44.561 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.9044999999999999e-05 2024-02-19T21:46:44.561 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.561 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.561 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:46:44.562 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.146103+0000", 2024-02-19T21:46:44.562 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0079851899999999996 2024-02-19T21:46:44.562 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.562 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.562 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:46:44.562 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.154088+0000", 2024-02-19T21:46:44.562 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00069928600000000003 2024-02-19T21:46:44.562 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.562 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.562 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.562 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.154787+0000", 2024-02-19T21:46:44.562 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00023436799999999999 2024-02-19T21:46:44.562 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.562 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.562 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.562 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.155022+0000", 2024-02-19T21:46:44.563 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.7898999999999998e-05 2024-02-19T21:46:44.563 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.563 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.563 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:46:44.563 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.155050+0000", 2024-02-19T21:46:44.563 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.2651e-05 2024-02-19T21:46:44.563 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.563 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.563 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:46:44.563 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.155072+0000", 2024-02-19T21:46:44.563 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.93481943899999997 2024-02-19T21:46:44.563 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.563 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:44.563 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.563 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.564 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.564 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:255408 8.8 8:1c38ff21:::benchmark_data_smithi080_100924_object127690:head [delete] snapc 0=[] ondisk+write+known_if_redirected e248)", 2024-02-19T21:46:44.564 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:43:40.237319+0000", 2024-02-19T21:46:44.564 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 184.25166982900001, 2024-02-19T21:46:44.564 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.91784396599999996, 2024-02-19T21:46:44.564 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:46:44.564 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:46:44.564 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:46:44.564 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:46:44.564 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:46:44.564 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 255408 2024-02-19T21:46:44.564 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.564 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:46:44.565 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.565 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:46:44.565 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.237319+0000", 2024-02-19T21:46:44.565 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:46:44.565 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.565 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.565 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:46:44.565 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.237319+0000", 2024-02-19T21:46:44.565 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:46:44.565 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.565 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.565 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:46:44.565 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.237318+0000", 2024-02-19T21:46:44.565 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.4789999999999998e-06 2024-02-19T21:46:44.566 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.566 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.566 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:46:44.566 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.237322+0000", 2024-02-19T21:46:44.566 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.8689999999999993e-06 2024-02-19T21:46:44.566 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.566 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.566 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:46:44.566 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.237331+0000", 2024-02-19T21:46:44.566 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.1799999999999998e-06 2024-02-19T21:46:44.566 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.566 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.566 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:46:44.566 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.237335+0000", 2024-02-19T21:46:44.566 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.1676e-05 2024-02-19T21:46:44.567 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.567 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.567 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.567 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.237367+0000", 2024-02-19T21:46:44.567 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.9860000000000002e-06 2024-02-19T21:46:44.567 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.567 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.567 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:46:44.567 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.237372+0000", 2024-02-19T21:46:44.567 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.910291619 2024-02-19T21:46:44.567 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.567 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.567 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.567 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.147663+0000", 2024-02-19T21:46:44.568 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000101567 2024-02-19T21:46:44.568 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.568 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.568 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:46:44.568 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.147765+0000", 2024-02-19T21:46:44.568 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00015295200000000001 2024-02-19T21:46:44.568 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.568 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.568 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:46:44.568 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.147918+0000", 2024-02-19T21:46:44.568 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0061748920000000004 2024-02-19T21:46:44.568 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.568 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.568 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:46:44.569 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.154093+0000", 2024-02-19T21:46:44.569 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00087836700000000001 2024-02-19T21:46:44.569 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.569 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.569 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.569 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.154971+0000", 2024-02-19T21:46:44.569 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013207599999999999 2024-02-19T21:46:44.569 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.569 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.569 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.569 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.155103+0000", 2024-02-19T21:46:44.569 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.7361000000000001e-05 2024-02-19T21:46:44.569 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.569 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.570 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:46:44.570 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.155131+0000", 2024-02-19T21:46:44.570 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.1841999999999998e-05 2024-02-19T21:46:44.570 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.570 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.570 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:46:44.570 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.155162+0000", 2024-02-19T21:46:44.570 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.91784396599999996 2024-02-19T21:46:44.570 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.570 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:44.570 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.570 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.570 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.570 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:255412 8.8 8:11f5f68f:::benchmark_data_smithi080_100924_object127694:head [delete] snapc 0=[] ondisk+write+known_if_redirected e248)", 2024-02-19T21:46:44.570 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:43:40.241137+0000", 2024-02-19T21:46:44.571 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 184.24785133399999, 2024-02-19T21:46:44.571 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.91410809000000004, 2024-02-19T21:46:44.571 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:46:44.571 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:46:44.571 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:46:44.571 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:46:44.571 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:46:44.571 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 255412 2024-02-19T21:46:44.571 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.571 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:46:44.571 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.571 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:46:44.571 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.241137+0000", 2024-02-19T21:46:44.572 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:46:44.572 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.572 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.572 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:46:44.572 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.241137+0000", 2024-02-19T21:46:44.572 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:46:44.572 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.572 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.572 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:46:44.572 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.241136+0000", 2024-02-19T21:46:44.572 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.6830000000000002e-06 2024-02-19T21:46:44.572 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.572 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.572 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:46:44.573 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.241142+0000", 2024-02-19T21:46:44.573 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0804e-05 2024-02-19T21:46:44.573 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.573 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.573 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:46:44.573 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.241153+0000", 2024-02-19T21:46:44.573 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.2940000000000002e-06 2024-02-19T21:46:44.573 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.573 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.573 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:46:44.573 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.241160+0000", 2024-02-19T21:46:44.573 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.5691000000000001e-05 2024-02-19T21:46:44.573 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.573 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.573 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.574 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.241195+0000", 2024-02-19T21:46:44.574 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.4100000000000001e-06 2024-02-19T21:46:44.574 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.574 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.574 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:46:44.574 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.241200+0000", 2024-02-19T21:46:44.574 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.90846244300000001 2024-02-19T21:46:44.574 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.574 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.574 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.574 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.149662+0000", 2024-02-19T21:46:44.574 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.7199000000000002e-05 2024-02-19T21:46:44.574 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.574 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.575 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:46:44.575 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.149759+0000", 2024-02-19T21:46:44.575 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.4388000000000006e-05 2024-02-19T21:46:44.575 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.575 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.575 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:46:44.575 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.149844+0000", 2024-02-19T21:46:44.575 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0046415199999999997 2024-02-19T21:46:44.575 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.575 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.575 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:46:44.575 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.154485+0000", 2024-02-19T21:46:44.575 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00051311399999999995 2024-02-19T21:46:44.575 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.575 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.575 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.576 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.154998+0000", 2024-02-19T21:46:44.576 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00019570300000000001 2024-02-19T21:46:44.576 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.576 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.576 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.576 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.155194+0000", 2024-02-19T21:46:44.576 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.7239000000000001e-05 2024-02-19T21:46:44.576 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.576 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.576 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:46:44.576 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.155221+0000", 2024-02-19T21:46:44.576 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.3853e-05 2024-02-19T21:46:44.577 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.577 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.577 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:46:44.577 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.155245+0000", 2024-02-19T21:46:44.577 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.91410809000000004 2024-02-19T21:46:44.577 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.577 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:44.577 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.577 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.577 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.577 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:255422 8.8 8:17c2779f:::benchmark_data_smithi080_100924_object127704:head [delete] snapc 0=[] ondisk+write+known_if_redirected e248)", 2024-02-19T21:46:44.577 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:43:40.255336+0000", 2024-02-19T21:46:44.577 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 184.23365260200001, 2024-02-19T21:46:44.577 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.90332147500000004, 2024-02-19T21:46:44.577 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:46:44.578 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:46:44.578 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:46:44.578 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:46:44.578 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:46:44.578 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 255422 2024-02-19T21:46:44.578 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.578 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:46:44.578 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.578 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:46:44.578 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.255336+0000", 2024-02-19T21:46:44.578 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:46:44.578 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.578 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.579 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:46:44.579 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.255336+0000", 2024-02-19T21:46:44.579 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:46:44.579 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.579 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.579 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:46:44.579 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.255335+0000", 2024-02-19T21:46:44.579 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.4339999999999999e-06 2024-02-19T21:46:44.579 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.579 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.579 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:46:44.579 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.255338+0000", 2024-02-19T21:46:44.579 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.233e-06 2024-02-19T21:46:44.579 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.579 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.579 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:46:44.580 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.255342+0000", 2024-02-19T21:46:44.580 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.6259999999999999e-06 2024-02-19T21:46:44.580 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.580 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.580 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:46:44.580 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.255345+0000", 2024-02-19T21:46:44.580 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.8992999999999997e-05 2024-02-19T21:46:44.580 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.580 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.580 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.580 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.255384+0000", 2024-02-19T21:46:44.580 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.8419999999999999e-06 2024-02-19T21:46:44.580 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.581 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.581 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:46:44.581 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.255390+0000", 2024-02-19T21:46:44.581 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.89569947400000005 2024-02-19T21:46:44.581 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.581 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.581 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.581 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.151090+0000", 2024-02-19T21:46:44.581 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000113601 2024-02-19T21:46:44.581 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.581 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.581 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:46:44.581 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.151204+0000", 2024-02-19T21:46:44.581 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00015081200000000001 2024-02-19T21:46:44.581 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.582 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.582 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:46:44.582 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.151354+0000", 2024-02-19T21:46:44.582 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0031377689999999999 2024-02-19T21:46:44.582 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.582 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.582 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:46:44.582 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.154492+0000", 2024-02-19T21:46:44.582 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00079721999999999996 2024-02-19T21:46:44.582 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.582 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.582 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.582 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.155289+0000", 2024-02-19T21:46:44.582 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0032789429999999999 2024-02-19T21:46:44.582 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.583 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.583 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.583 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.158568+0000", 2024-02-19T21:46:44.583 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0417000000000002e-05 2024-02-19T21:46:44.583 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.583 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.583 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:46:44.583 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.158619+0000", 2024-02-19T21:46:44.583 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.8528000000000001e-05 2024-02-19T21:46:44.583 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.583 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.583 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:46:44.583 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.158657+0000", 2024-02-19T21:46:44.583 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.90332147500000004 2024-02-19T21:46:44.583 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.584 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:44.584 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.584 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.584 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.584 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:255423 8.8 8:16f49fa1:::benchmark_data_smithi080_100924_object127705:head [delete] snapc 0=[] ondisk+write+known_if_redirected e248)", 2024-02-19T21:46:44.584 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:43:40.257929+0000", 2024-02-19T21:46:44.584 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 184.231059453, 2024-02-19T21:46:44.584 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.90741742199999997, 2024-02-19T21:46:44.584 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:46:44.584 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:46:44.584 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:46:44.584 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:46:44.584 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:46:44.584 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 255423 2024-02-19T21:46:44.584 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.585 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:46:44.585 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.585 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:46:44.585 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.257929+0000", 2024-02-19T21:46:44.585 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:46:44.585 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.585 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.585 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:46:44.585 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.257929+0000", 2024-02-19T21:46:44.585 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:46:44.585 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.585 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.585 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:46:44.585 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.257928+0000", 2024-02-19T21:46:44.585 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.3919999999999996e-06 2024-02-19T21:46:44.585 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.586 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.586 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:46:44.586 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.257933+0000", 2024-02-19T21:46:44.586 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.5089999999999993e-06 2024-02-19T21:46:44.586 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.586 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.586 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:46:44.586 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.257941+0000", 2024-02-19T21:46:44.586 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.9790000000000004e-06 2024-02-19T21:46:44.586 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.586 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.586 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:46:44.586 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.257945+0000", 2024-02-19T21:46:44.586 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.9496999999999999e-05 2024-02-19T21:46:44.586 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.587 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.587 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.587 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.257975+0000", 2024-02-19T21:46:44.587 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.1869999999999999e-06 2024-02-19T21:46:44.587 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.587 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.587 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:46:44.587 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.257979+0000", 2024-02-19T21:46:44.587 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.89459233999999999 2024-02-19T21:46:44.587 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.587 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.587 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.587 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.152571+0000", 2024-02-19T21:46:44.587 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000110806 2024-02-19T21:46:44.587 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.587 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.588 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:46:44.588 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.152682+0000", 2024-02-19T21:46:44.588 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014371100000000001 2024-02-19T21:46:44.588 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.588 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.588 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:46:44.588 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.152826+0000", 2024-02-19T21:46:44.588 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0018783020000000001 2024-02-19T21:46:44.588 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.588 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.588 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:46:44.588 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.154704+0000", 2024-02-19T21:46:44.588 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00060743400000000001 2024-02-19T21:46:44.588 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.589 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.589 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.589 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.155311+0000", 2024-02-19T21:46:44.589 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0099333870000000001 2024-02-19T21:46:44.589 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.589 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.589 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.589 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.165245+0000", 2024-02-19T21:46:44.589 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.0109000000000003e-05 2024-02-19T21:46:44.589 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.589 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.589 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:46:44.589 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.165305+0000", 2024-02-19T21:46:44.589 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.1489999999999997e-05 2024-02-19T21:46:44.589 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.589 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.590 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:46:44.590 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.165346+0000", 2024-02-19T21:46:44.590 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.90741742199999997 2024-02-19T21:46:44.590 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.590 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:44.590 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.590 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.590 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.590 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24317.0:1803 5.f 5:f95f44c2:::notify.0:head [watch reconnect cookie 94140586900096 gen 4] snapc 0=[] ondisk+write+known_if_redirected e260)", 2024-02-19T21:46:44.590 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:44:07.119177+0000", 2024-02-19T21:46:44.590 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 157.369811728, 2024-02-19T21:46:44.590 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0064791710000001, 2024-02-19T21:46:44.590 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:46:44.590 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "started", 2024-02-19T21:46:44.590 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:46:44.591 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24317", 2024-02-19T21:46:44.591 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3365055276", 2024-02-19T21:46:44.591 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 1803 2024-02-19T21:46:44.591 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.591 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:46:44.591 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.591 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:46:44.591 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:07.119177+0000", 2024-02-19T21:46:44.591 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:46:44.591 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.591 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.591 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:46:44.591 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:07.119177+0000", 2024-02-19T21:46:44.591 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:46:44.591 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.592 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.592 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:46:44.592 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:07.119175+0000", 2024-02-19T21:46:44.592 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.4520000000000002e-06 2024-02-19T21:46:44.592 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.592 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.592 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:46:44.592 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:07.119182+0000", 2024-02-19T21:46:44.592 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1046000000000001e-05 2024-02-19T21:46:44.592 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.592 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.592 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:46:44.592 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:07.119193+0000", 2024-02-19T21:46:44.593 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.2129999999999996e-06 2024-02-19T21:46:44.593 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.593 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.593 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:46:44.593 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:07.119199+0000", 2024-02-19T21:46:44.593 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00028196699999999999 2024-02-19T21:46:44.593 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.593 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.593 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.593 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:07.119481+0000", 2024-02-19T21:46:44.593 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.8050000000000001e-06 2024-02-19T21:46:44.593 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.593 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.593 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:46:44.593 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:07.119491+0000", 2024-02-19T21:46:44.594 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.004176231 2024-02-19T21:46:44.594 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.594 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.594 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.594 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:08.123667+0000", 2024-02-19T21:46:44.594 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000158398 2024-02-19T21:46:44.594 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.594 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.594 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:46:44.594 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:08.123826+0000", 2024-02-19T21:46:44.594 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.001830283 2024-02-19T21:46:44.594 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.594 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.594 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:46:44.594 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:08.125656+0000", 2024-02-19T21:46:44.594 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0064791710000001 2024-02-19T21:46:44.595 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.595 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:44.595 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.595 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.595 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.595 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:138145 9.6 9:6af22790:::benchmark_data_smithi080_126364_object9553:head [delete] snapc 0=[] ondisk+write+known_if_redirected e324)", 2024-02-19T21:46:44.595 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:46:10.607321+0000", 2024-02-19T21:46:44.595 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 33.881667684, 2024-02-19T21:46:44.595 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.15354489299999999, 2024-02-19T21:46:44.595 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:46:44.595 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:46:44.595 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:46:44.595 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:46:44.595 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:46:44.595 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 138145 2024-02-19T21:46:44.596 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.596 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:46:44.596 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.596 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:46:44.596 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.607321+0000", 2024-02-19T21:46:44.596 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:46:44.596 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.596 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.596 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:46:44.596 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.607321+0000", 2024-02-19T21:46:44.596 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:46:44.596 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.596 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.596 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:46:44.597 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.607320+0000", 2024-02-19T21:46:44.597 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.602e-06 2024-02-19T21:46:44.597 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.597 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.597 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:46:44.597 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.607324+0000", 2024-02-19T21:46:44.597 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.5194000000000001e-05 2024-02-19T21:46:44.597 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.597 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.597 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:46:44.597 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.607339+0000", 2024-02-19T21:46:44.597 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.9059999999999997e-06 2024-02-19T21:46:44.597 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.597 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.597 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:46:44.597 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.607349+0000", 2024-02-19T21:46:44.598 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0023708470000000001 2024-02-19T21:46:44.598 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.598 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.598 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.598 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.609720+0000", 2024-02-19T21:46:44.598 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00010139 2024-02-19T21:46:44.598 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.598 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.598 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:46:44.598 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.609821+0000", 2024-02-19T21:46:44.598 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000120099 2024-02-19T21:46:44.598 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.598 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.598 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,6", 2024-02-19T21:46:44.598 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.609941+0000", 2024-02-19T21:46:44.598 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0022358830000000001 2024-02-19T21:46:44.599 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.599 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.599 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:46:44.599 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.612177+0000", 2024-02-19T21:46:44.599 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0051232530000000004 2024-02-19T21:46:44.599 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.599 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.599 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.599 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.617300+0000", 2024-02-19T21:46:44.599 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.143462005 2024-02-19T21:46:44.599 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.599 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.599 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.599 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.760762+0000", 2024-02-19T21:46:44.600 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.3610999999999998e-05 2024-02-19T21:46:44.600 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.600 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.600 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:46:44.600 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.760826+0000", 2024-02-19T21:46:44.600 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.9712000000000002e-05 2024-02-19T21:46:44.600 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.600 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.600 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:46:44.600 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.760866+0000", 2024-02-19T21:46:44.600 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.15354489299999999 2024-02-19T21:46:44.600 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.600 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:44.600 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.601 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.601 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.601 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:138157 9.a 9:5cdc8190:::benchmark_data_smithi080_126364_object9565:head [delete] snapc 0=[] ondisk+write+known_if_redirected e324)", 2024-02-19T21:46:44.601 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:46:10.620786+0000", 2024-02-19T21:46:44.601 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 33.868202177999997, 2024-02-19T21:46:44.601 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.14924884999999999, 2024-02-19T21:46:44.601 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:46:44.601 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:46:44.601 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:46:44.601 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:46:44.601 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:46:44.601 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 138157 2024-02-19T21:46:44.601 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.601 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:46:44.601 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.601 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:46:44.601 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.620786+0000", 2024-02-19T21:46:44.602 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:46:44.602 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.602 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.602 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:46:44.602 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.620786+0000", 2024-02-19T21:46:44.602 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:46:44.602 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.602 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.602 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:46:44.602 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.620784+0000", 2024-02-19T21:46:44.602 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.494e-06 2024-02-19T21:46:44.602 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.602 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.602 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:46:44.602 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.620791+0000", 2024-02-19T21:46:44.602 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.173e-05 2024-02-19T21:46:44.603 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.603 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.603 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:46:44.603 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.620802+0000", 2024-02-19T21:46:44.603 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.6380000000000001e-06 2024-02-19T21:46:44.603 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.603 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.603 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:46:44.603 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.620808+0000", 2024-02-19T21:46:44.603 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.1619999999999998e-05 2024-02-19T21:46:44.603 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.603 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.603 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.603 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.620850+0000", 2024-02-19T21:46:44.603 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.2052999999999994e-05 2024-02-19T21:46:44.604 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.604 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.604 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:46:44.604 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.620942+0000", 2024-02-19T21:46:44.604 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00012273199999999999 2024-02-19T21:46:44.604 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.604 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.604 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,7", 2024-02-19T21:46:44.604 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.621065+0000", 2024-02-19T21:46:44.604 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0024041380000000001 2024-02-19T21:46:44.604 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.604 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.604 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:46:44.604 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.623469+0000", 2024-02-19T21:46:44.605 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0055234660000000003 2024-02-19T21:46:44.605 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.605 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.605 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.605 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.628992+0000", 2024-02-19T21:46:44.605 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.14094579900000001 2024-02-19T21:46:44.605 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.605 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.605 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.605 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.769938+0000", 2024-02-19T21:46:44.605 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.4651000000000002e-05 2024-02-19T21:46:44.605 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.605 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.605 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:46:44.605 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.769993+0000", 2024-02-19T21:46:44.606 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.2450999999999997e-05 2024-02-19T21:46:44.606 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.606 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.606 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:46:44.606 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.770035+0000", 2024-02-19T21:46:44.606 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.14924884999999999 2024-02-19T21:46:44.606 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.606 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:44.606 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.606 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.606 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.606 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:138162 9.a 9:59f77c0c:::benchmark_data_smithi080_126364_object9570:head [delete] snapc 0=[] ondisk+write+known_if_redirected e324)", 2024-02-19T21:46:44.606 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:46:10.623534+0000", 2024-02-19T21:46:44.606 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 33.865454016000001, 2024-02-19T21:46:44.606 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.14664105899999999, 2024-02-19T21:46:44.606 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:46:44.607 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:46:44.607 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:46:44.607 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:46:44.607 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:46:44.607 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 138162 2024-02-19T21:46:44.607 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.607 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:46:44.607 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.607 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:46:44.607 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.623534+0000", 2024-02-19T21:46:44.607 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:46:44.607 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.607 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.607 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:46:44.607 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.623534+0000", 2024-02-19T21:46:44.608 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:46:44.608 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.608 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.608 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:46:44.608 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.623533+0000", 2024-02-19T21:46:44.608 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.8619999999999997e-06 2024-02-19T21:46:44.608 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.608 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.608 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:46:44.608 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.623540+0000", 2024-02-19T21:46:44.608 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.7860000000000008e-06 2024-02-19T21:46:44.608 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.608 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.609 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:46:44.609 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.623550+0000", 2024-02-19T21:46:44.609 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.8590000000000001e-06 2024-02-19T21:46:44.609 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.609 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.609 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:46:44.609 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.623555+0000", 2024-02-19T21:46:44.609 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.9791999999999999e-05 2024-02-19T21:46:44.609 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.609 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.609 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.609 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.623585+0000", 2024-02-19T21:46:44.609 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.3638e-05 2024-02-19T21:46:44.609 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.609 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.610 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:46:44.610 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.623679+0000", 2024-02-19T21:46:44.610 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00012516099999999999 2024-02-19T21:46:44.610 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.610 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.610 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,7", 2024-02-19T21:46:44.610 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.623804+0000", 2024-02-19T21:46:44.610 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.002054214 2024-02-19T21:46:44.610 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.610 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.610 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:46:44.610 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.625858+0000", 2024-02-19T21:46:44.610 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0031936870000000002 2024-02-19T21:46:44.610 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.610 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.611 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.611 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.629052+0000", 2024-02-19T21:46:44.611 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.141034888 2024-02-19T21:46:44.611 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.611 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.611 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.611 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.770087+0000", 2024-02-19T21:46:44.611 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.9879999999999997e-05 2024-02-19T21:46:44.611 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.611 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.611 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:46:44.611 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.770137+0000", 2024-02-19T21:46:44.611 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.8742000000000003e-05 2024-02-19T21:46:44.611 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.611 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.611 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:46:44.612 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.770175+0000", 2024-02-19T21:46:44.612 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.14664105899999999 2024-02-19T21:46:44.612 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.612 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:44.612 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.612 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.612 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.612 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:138166 9.6 9:6fa3fc4e:::benchmark_data_smithi080_126364_object9574:head [delete] snapc 0=[] ondisk+write+known_if_redirected e324)", 2024-02-19T21:46:44.612 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:46:10.629215+0000", 2024-02-19T21:46:44.612 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 33.859773488999998, 2024-02-19T21:46:44.612 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.149096595, 2024-02-19T21:46:44.612 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:46:44.612 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:46:44.612 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:46:44.613 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:46:44.613 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:46:44.613 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 138166 2024-02-19T21:46:44.613 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.613 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:46:44.613 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.613 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:46:44.613 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.629215+0000", 2024-02-19T21:46:44.613 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:46:44.613 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.613 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.613 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:46:44.613 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.629215+0000", 2024-02-19T21:46:44.614 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:46:44.614 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.614 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.614 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:46:44.614 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.629214+0000", 2024-02-19T21:46:44.614 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.9409999999999998e-06 2024-02-19T21:46:44.614 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.614 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.614 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:46:44.614 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.629219+0000", 2024-02-19T21:46:44.614 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.7260000000000008e-06 2024-02-19T21:46:44.614 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.614 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.614 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:46:44.614 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.629227+0000", 2024-02-19T21:46:44.614 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.8709999999999999e-06 2024-02-19T21:46:44.615 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.615 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.615 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:46:44.615 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.629231+0000", 2024-02-19T21:46:44.615 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.1980000000000001e-05 2024-02-19T21:46:44.615 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.615 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.615 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.615 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.629273+0000", 2024-02-19T21:46:44.615 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.6702999999999999e-05 2024-02-19T21:46:44.615 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.615 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.615 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:46:44.615 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.629370+0000", 2024-02-19T21:46:44.615 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.2268000000000005e-05 2024-02-19T21:46:44.616 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.616 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.616 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,6", 2024-02-19T21:46:44.616 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.629462+0000", 2024-02-19T21:46:44.616 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0024790670000000002 2024-02-19T21:46:44.616 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.616 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.616 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:46:44.616 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.631941+0000", 2024-02-19T21:46:44.616 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000230953 2024-02-19T21:46:44.616 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.616 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.616 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.617 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.632172+0000", 2024-02-19T21:46:44.617 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.146035524 2024-02-19T21:46:44.617 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.617 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.617 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.617 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.778208+0000", 2024-02-19T21:46:44.617 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.8142000000000001e-05 2024-02-19T21:46:44.617 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.617 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.617 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:46:44.617 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.778256+0000", 2024-02-19T21:46:44.617 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.5612000000000002e-05 2024-02-19T21:46:44.617 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.617 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.617 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:46:44.618 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.778311+0000", 2024-02-19T21:46:44.618 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.149096595 2024-02-19T21:46:44.618 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.618 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:44.618 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.618 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.618 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.618 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:138169 9.a 9:5bcee966:::benchmark_data_smithi080_126364_object9577:head [delete] snapc 0=[] ondisk+write+known_if_redirected e324)", 2024-02-19T21:46:44.618 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:46:10.635296+0000", 2024-02-19T21:46:44.618 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 33.853692731999999, 2024-02-19T21:46:44.618 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.13504361600000001, 2024-02-19T21:46:44.618 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:46:44.618 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:46:44.618 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:46:44.618 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:46:44.619 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:46:44.619 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 138169 2024-02-19T21:46:44.619 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.619 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:46:44.619 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.619 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:46:44.619 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.635296+0000", 2024-02-19T21:46:44.619 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:46:44.619 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.619 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.619 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:46:44.619 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.635296+0000", 2024-02-19T21:46:44.619 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:46:44.619 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.620 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.620 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:46:44.620 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.635294+0000", 2024-02-19T21:46:44.620 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.8439999999999998e-06 2024-02-19T21:46:44.620 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.620 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.620 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:46:44.620 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.635302+0000", 2024-02-19T21:46:44.620 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.4554e-05 2024-02-19T21:46:44.620 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.620 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.620 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:46:44.620 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.635316+0000", 2024-02-19T21:46:44.621 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.0759999999999997e-06 2024-02-19T21:46:44.621 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.621 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.621 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:46:44.621 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.635323+0000", 2024-02-19T21:46:44.621 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.7428999999999997e-05 2024-02-19T21:46:44.621 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.621 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.621 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:44.621 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.635361+0000", 2024-02-19T21:46:44.621 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000104225 2024-02-19T21:46:44.621 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.621 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.621 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:46:44.622 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.635465+0000", 2024-02-19T21:46:44.622 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.0408999999999995e-05 2024-02-19T21:46:44.622 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.622 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.622 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,7", 2024-02-19T21:46:44.622 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.635545+0000", 2024-02-19T21:46:44.622 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0018066429999999999 2024-02-19T21:46:44.622 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.622 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.622 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:46:44.622 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.637352+0000", 2024-02-19T21:46:44.622 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00021042899999999999 2024-02-19T21:46:44.622 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.622 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.622 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.622 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.637563+0000", 2024-02-19T21:46:44.623 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.13269152100000001 2024-02-19T21:46:44.623 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.623 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.623 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:46:44.623 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.770254+0000", 2024-02-19T21:46:44.623 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.1570000000000003e-05 2024-02-19T21:46:44.623 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.623 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.623 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:46:44.623 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.770306+0000", 2024-02-19T21:46:44.623 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.3624000000000002e-05 2024-02-19T21:46:44.623 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:44.623 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:44.623 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:46:44.623 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:10.770339+0000", 2024-02-19T21:46:44.624 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.13504361600000001 2024-02-19T21:46:44.624 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.624 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:44.624 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.624 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:44.624 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:44.624 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:46:44.625 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:43.053485+0000 osd.7 (osd.7) 210 : cluster [DBG] 2.b scrub starts 2024-02-19T21:46:44.625 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:43.056392+0000 osd.7 (osd.7) 211 : cluster [DBG] 2.b scrub ok 2024-02-19T21:46:44.625 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:43.095542+0000 mgr.y (mgr.14514) 543 : cluster [DBG] pgmap v683: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 5.4 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 882 op/s 2024-02-19T21:46:44.625 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:43.402735+0000 mon.a (mon.0) 1421 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:46:44.625 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:43.402755+0000 mon.a (mon.0) 1422 : cluster [INF] Cluster is now healthy 2024-02-19T21:46:44.625 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:43.417759+0000 mon.a (mon.0) 1423 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:46:44.625 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:43.417806+0000 mon.a (mon.0) 1424 : cluster [DBG] osdmap e336: 8 total, 8 up, 7 in 2024-02-19T21:46:44.625 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:43.467760+0000 osd.4 (osd.4) 171 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:46:44.625 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:43.474977+0000 osd.4 (osd.4) 172 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:46:44.625 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:43.744206+0000 osd.3 (osd.3) 212 : cluster [DBG] 6.8 scrub starts 2024-02-19T21:46:44.625 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:43.773481+0000 osd.3 (osd.3) 213 : cluster [DBG] 6.8 scrub ok 2024-02-19T21:46:44.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:43.053485+0000 osd.7 (osd.7) 210 : cluster [DBG] 2.b scrub starts 2024-02-19T21:46:44.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:43.056392+0000 osd.7 (osd.7) 211 : cluster [DBG] 2.b scrub ok 2024-02-19T21:46:44.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:43.095542+0000 mgr.y (mgr.14514) 543 : cluster [DBG] pgmap v683: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 5.4 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 882 op/s 2024-02-19T21:46:44.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:43.402735+0000 mon.a (mon.0) 1421 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:46:44.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:43.402755+0000 mon.a (mon.0) 1422 : cluster [INF] Cluster is now healthy 2024-02-19T21:46:44.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:43.417759+0000 mon.a (mon.0) 1423 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:46:44.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:43.417806+0000 mon.a (mon.0) 1424 : cluster [DBG] osdmap e336: 8 total, 8 up, 7 in 2024-02-19T21:46:44.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:43.467760+0000 osd.4 (osd.4) 171 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:46:44.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:43.474977+0000 osd.4 (osd.4) 172 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:46:44.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:43.744206+0000 osd.3 (osd.3) 212 : cluster [DBG] 6.8 scrub starts 2024-02-19T21:46:44.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:43.773481+0000 osd.3 (osd.3) 213 : cluster [DBG] 6.8 scrub ok 2024-02-19T21:46:45.403 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.6 dump_ops_in_flight 2024-02-19T21:46:45.807 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:46:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:46:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:46:45.863 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:46:46.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:44.782367+0000 osd.5 (osd.5) 233 : cluster [DBG] 4.f scrub starts 2024-02-19T21:46:46.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:44.789303+0000 osd.5 (osd.5) 234 : cluster [DBG] 4.f scrub ok 2024-02-19T21:46:46.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:44.926462+0000 osd.1 (osd.1) 209 : cluster [DBG] 6.1d deep-scrub starts 2024-02-19T21:46:46.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:44.994289+0000 osd.1 (osd.1) 210 : cluster [DBG] 6.1d deep-scrub ok 2024-02-19T21:46:46.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:45.010652+0000 osd.7 (osd.7) 212 : cluster [DBG] 2.5 deep-scrub starts 2024-02-19T21:46:46.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:45.017689+0000 osd.7 (osd.7) 213 : cluster [DBG] 2.5 deep-scrub ok 2024-02-19T21:46:46.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:45.096189+0000 mgr.y (mgr.14514) 544 : cluster [DBG] pgmap v685: 138 pgs: 138 active+clean; 5.3 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 1.26k op/s 2024-02-19T21:46:46.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:45.215588+0000 osd.0 (osd.0) 230 : cluster [DBG] 5.5 scrub starts 2024-02-19T21:46:46.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:45.252335+0000 osd.0 (osd.0) 231 : cluster [DBG] 5.5 scrub ok 2024-02-19T21:46:46.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:45.476038+0000 osd.4 (osd.4) 173 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:46:46.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:45.499658+0000 osd.4 (osd.4) 174 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:46:46.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:45.795948+0000 osd.5 (osd.5) 235 : cluster [DBG] 2.18 scrub starts 2024-02-19T21:46:46.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:45.803599+0000 osd.5 (osd.5) 236 : cluster [DBG] 2.18 scrub ok 2024-02-19T21:46:46.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:44.782367+0000 osd.5 (osd.5) 233 : cluster [DBG] 4.f scrub starts 2024-02-19T21:46:46.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:44.789303+0000 osd.5 (osd.5) 234 : cluster [DBG] 4.f scrub ok 2024-02-19T21:46:46.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:44.926462+0000 osd.1 (osd.1) 209 : cluster [DBG] 6.1d deep-scrub starts 2024-02-19T21:46:46.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:44.994289+0000 osd.1 (osd.1) 210 : cluster [DBG] 6.1d deep-scrub ok 2024-02-19T21:46:46.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:45.010652+0000 osd.7 (osd.7) 212 : cluster [DBG] 2.5 deep-scrub starts 2024-02-19T21:46:46.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:45.017689+0000 osd.7 (osd.7) 213 : cluster [DBG] 2.5 deep-scrub ok 2024-02-19T21:46:46.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:45.096189+0000 mgr.y (mgr.14514) 544 : cluster [DBG] pgmap v685: 138 pgs: 138 active+clean; 5.3 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 1.26k op/s 2024-02-19T21:46:46.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:45.215588+0000 osd.0 (osd.0) 230 : cluster [DBG] 5.5 scrub starts 2024-02-19T21:46:46.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:45.252335+0000 osd.0 (osd.0) 231 : cluster [DBG] 5.5 scrub ok 2024-02-19T21:46:46.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:45.476038+0000 osd.4 (osd.4) 173 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:46:46.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:45.499658+0000 osd.4 (osd.4) 174 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:46:46.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:45.795948+0000 osd.5 (osd.5) 235 : cluster [DBG] 2.18 scrub starts 2024-02-19T21:46:46.600 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:45.803599+0000 osd.5 (osd.5) 236 : cluster [DBG] 2.18 scrub ok 2024-02-19T21:46:46.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:44.782367+0000 osd.5 (osd.5) 233 : cluster [DBG] 4.f scrub starts 2024-02-19T21:46:46.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:44.789303+0000 osd.5 (osd.5) 234 : cluster [DBG] 4.f scrub ok 2024-02-19T21:46:46.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:44.926462+0000 osd.1 (osd.1) 209 : cluster [DBG] 6.1d deep-scrub starts 2024-02-19T21:46:46.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:44.994289+0000 osd.1 (osd.1) 210 : cluster [DBG] 6.1d deep-scrub ok 2024-02-19T21:46:46.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:45.010652+0000 osd.7 (osd.7) 212 : cluster [DBG] 2.5 deep-scrub starts 2024-02-19T21:46:46.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:45.017689+0000 osd.7 (osd.7) 213 : cluster [DBG] 2.5 deep-scrub ok 2024-02-19T21:46:46.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:45.096189+0000 mgr.y (mgr.14514) 544 : cluster [DBG] pgmap v685: 138 pgs: 138 active+clean; 5.3 GiB data, 19 GiB used, 607 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 1.26k op/s 2024-02-19T21:46:46.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:45.215588+0000 osd.0 (osd.0) 230 : cluster [DBG] 5.5 scrub starts 2024-02-19T21:46:46.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:45.252335+0000 osd.0 (osd.0) 231 : cluster [DBG] 5.5 scrub ok 2024-02-19T21:46:46.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:45.476038+0000 osd.4 (osd.4) 173 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:46:46.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:45.499658+0000 osd.4 (osd.4) 174 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:46:46.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:45.795948+0000 osd.5 (osd.5) 235 : cluster [DBG] 2.18 scrub starts 2024-02-19T21:46:46.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:45.803599+0000 osd.5 (osd.5) 236 : cluster [DBG] 2.18 scrub ok 2024-02-19T21:46:47.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:46.036106+0000 osd.7 (osd.7) 214 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:46:47.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:46.036160+0000 osd.7 (osd.7) 215 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:46:47.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:46.188081+0000 osd.0 (osd.0) 232 : cluster [DBG] 6.13 scrub starts 2024-02-19T21:46:47.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:46.230634+0000 osd.0 (osd.0) 233 : cluster [DBG] 6.13 scrub ok 2024-02-19T21:46:47.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:46.429824+0000 mon.a (mon.0) 1425 : cluster [DBG] osdmap e337: 8 total, 8 up, 7 in 2024-02-19T21:46:47.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:46.036106+0000 osd.7 (osd.7) 214 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:46:47.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:46.036160+0000 osd.7 (osd.7) 215 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:46:47.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:46.188081+0000 osd.0 (osd.0) 232 : cluster [DBG] 6.13 scrub starts 2024-02-19T21:46:47.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:46.230634+0000 osd.0 (osd.0) 233 : cluster [DBG] 6.13 scrub ok 2024-02-19T21:46:47.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:46.429824+0000 mon.a (mon.0) 1425 : cluster [DBG] osdmap e337: 8 total, 8 up, 7 in 2024-02-19T21:46:47.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:46.036106+0000 osd.7 (osd.7) 214 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:46:47.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:46.036160+0000 osd.7 (osd.7) 215 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:46:47.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:46.188081+0000 osd.0 (osd.0) 232 : cluster [DBG] 6.13 scrub starts 2024-02-19T21:46:47.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:46.230634+0000 osd.0 (osd.0) 233 : cluster [DBG] 6.13 scrub ok 2024-02-19T21:46:47.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:46.429824+0000 mon.a (mon.0) 1425 : cluster [DBG] osdmap e337: 8 total, 8 up, 7 in 2024-02-19T21:46:48.442 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:46.972817+0000 osd.1 (osd.1) 211 : cluster [DBG] 2.d scrub starts 2024-02-19T21:46:48.442 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:46.978008+0000 osd.1 (osd.1) 212 : cluster [DBG] 2.d scrub ok 2024-02-19T21:46:48.443 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:47.061390+0000 osd.7 (osd.7) 216 : cluster [DBG] 5.d scrub starts 2024-02-19T21:46:48.443 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:47.072980+0000 osd.7 (osd.7) 217 : cluster [DBG] 5.d scrub ok 2024-02-19T21:46:48.443 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:47.096557+0000 mgr.y (mgr.14514) 545 : cluster [DBG] pgmap v687: 138 pgs: 138 active+clean; 5.1 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 901 op/s 2024-02-19T21:46:48.443 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:47.753769+0000 osd.3 (osd.3) 214 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:46:48.443 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:47.761673+0000 osd.3 (osd.3) 215 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:46:48.443 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:47.960377+0000 osd.6 (osd.6) 203 : cluster [DBG] 4.5 scrub starts 2024-02-19T21:46:48.443 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:47.969954+0000 osd.6 (osd.6) 204 : cluster [DBG] 4.5 scrub ok 2024-02-19T21:46:48.471 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-02-19T21:46:48.486 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:46:48.486 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [ 2024-02-19T21:46:48.486 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.487 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_repop(client.15345.0:177320 9.3 e337/268 9:ca624f9b:::benchmark_data_smithi080_126364_object48728:head v 337'11216, mlcod=337'11214)", 2024-02-19T21:46:48.487 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:46:48.465311+0000", 2024-02-19T21:46:48.487 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.005746101, 2024-02-19T21:46:48.487 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0057758799999999997, 2024-02-19T21:46:48.487 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:46:48.487 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "started", 2024-02-19T21:46:48.487 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:46:48.487 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.487 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:46:48.487 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.465311+0000", 2024-02-19T21:46:48.487 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:46:48.487 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.487 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.487 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:46:48.488 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.465311+0000", 2024-02-19T21:46:48.488 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:46:48.488 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.488 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.488 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:46:48.488 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.465310+0000", 2024-02-19T21:46:48.488 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0108999999999999e-05 2024-02-19T21:46:48.488 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.488 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.488 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:46:48.488 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.465320+0000", 2024-02-19T21:46:48.488 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2279000000000001e-05 2024-02-19T21:46:48.489 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.489 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.489 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:46:48.489 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.465332+0000", 2024-02-19T21:46:48.489 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.823e-06 2024-02-19T21:46:48.489 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.489 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.489 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:46:48.489 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.465338+0000", 2024-02-19T21:46:48.489 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00015336500000000001 2024-02-19T21:46:48.489 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.489 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.489 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:48.489 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.465492+0000", 2024-02-19T21:46:48.490 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.8309999999999999e-05 2024-02-19T21:46:48.490 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.490 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.490 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:46:48.490 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.465510+0000", 2024-02-19T21:46:48.490 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00019886099999999999 2024-02-19T21:46:48.490 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:48.490 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:48.490 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:48.490 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.490 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.490 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_repop(client.15345.0:177321 9.2 e337/268 9:4d13435e:::benchmark_data_smithi080_126364_object48729:head v 337'11020, mlcod=337'11018)", 2024-02-19T21:46:48.490 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:46:48.465351+0000", 2024-02-19T21:46:48.490 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.0057063879999999997, 2024-02-19T21:46:48.491 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0058059460000000002, 2024-02-19T21:46:48.491 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:46:48.491 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "started", 2024-02-19T21:46:48.491 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:46:48.491 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.491 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:46:48.491 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.465351+0000", 2024-02-19T21:46:48.491 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:46:48.491 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.491 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.491 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:46:48.491 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.465351+0000", 2024-02-19T21:46:48.491 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:46:48.492 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.492 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.492 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:46:48.492 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.465351+0000", 2024-02-19T21:46:48.492 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.9910000000000004e-06 2024-02-19T21:46:48.492 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.492 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.492 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:46:48.492 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.465355+0000", 2024-02-19T21:46:48.492 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.3040000000000001e-06 2024-02-19T21:46:48.492 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.492 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.492 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:46:48.492 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.465361+0000", 2024-02-19T21:46:48.493 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.5889999999999999e-06 2024-02-19T21:46:48.493 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.493 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.493 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:46:48.493 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.465364+0000", 2024-02-19T21:46:48.493 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.2336000000000003e-05 2024-02-19T21:46:48.493 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.493 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.493 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:48.493 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.465407+0000", 2024-02-19T21:46:48.493 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.2934000000000001e-05 2024-02-19T21:46:48.493 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.493 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.494 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:46:48.494 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.465430+0000", 2024-02-19T21:46:48.494 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.8855000000000003e-05 2024-02-19T21:46:48.494 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:48.494 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:48.494 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:48.494 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.494 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.494 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_repop(client.15345.0:177322 9.b e337/268 9:d2fb007f:::benchmark_data_smithi080_126364_object48730:head v 337'10785, mlcod=337'10783)", 2024-02-19T21:46:48.494 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:46:48.465406+0000", 2024-02-19T21:46:48.494 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.0056511479999999999, 2024-02-19T21:46:48.494 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0058128750000000003, 2024-02-19T21:46:48.494 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:46:48.494 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "started", 2024-02-19T21:46:48.494 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:46:48.495 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.495 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:46:48.495 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.465406+0000", 2024-02-19T21:46:48.495 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:46:48.495 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.495 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.495 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:46:48.495 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.465406+0000", 2024-02-19T21:46:48.495 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:46:48.495 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.495 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.495 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:46:48.495 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.465406+0000", 2024-02-19T21:46:48.495 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.941e-06 2024-02-19T21:46:48.495 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.495 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.496 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:46:48.496 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.465410+0000", 2024-02-19T21:46:48.496 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.1999999999999994e-06 2024-02-19T21:46:48.496 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.496 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.496 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:46:48.496 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.465418+0000", 2024-02-19T21:46:48.496 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.2930000000000001e-06 2024-02-19T21:46:48.496 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.496 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.496 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:46:48.496 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.465421+0000", 2024-02-19T21:46:48.497 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0020742489999999998 2024-02-19T21:46:48.497 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.497 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.497 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:46:48.497 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.467495+0000", 2024-02-19T21:46:48.497 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.501e-05 2024-02-19T21:46:48.497 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.497 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.497 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:46:48.497 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.467510+0000", 2024-02-19T21:46:48.497 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0021042970000000002 2024-02-19T21:46:48.497 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:48.497 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:48.497 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:48.497 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.498 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.498 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_repop(client.15345.0:177325 9.2 e337/268)", 2024-02-19T21:46:48.498 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:46:48.469544+0000", 2024-02-19T21:46:48.498 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.0015131739999999999, 2024-02-19T21:46:48.498 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.001738702, 2024-02-19T21:46:48.498 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:46:48.498 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "queued for pg", 2024-02-19T21:46:48.498 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:46:48.498 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.498 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:46:48.498 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.469544+0000", 2024-02-19T21:46:48.498 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:46:48.498 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.498 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.498 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:46:48.499 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.469544+0000", 2024-02-19T21:46:48.499 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:46:48.499 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.499 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.499 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:46:48.499 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.469543+0000", 2024-02-19T21:46:48.499 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.2689999999999996e-06 2024-02-19T21:46:48.499 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.499 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.499 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:46:48.499 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.469549+0000", 2024-02-19T21:46:48.499 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.8679999999999994e-06 2024-02-19T21:46:48.499 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.500 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.500 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:46:48.500 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.469559+0000", 2024-02-19T21:46:48.500 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.9840000000000001e-06 2024-02-19T21:46:48.500 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:46:48.500 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:46:48.500 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:46:48.500 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:48.469564+0000", 2024-02-19T21:46:48.500 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.0322e-05 2024-02-19T21:46:48.500 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:48.500 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:46:48.500 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:48.500 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:46:48.500 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-02-19T21:46:48.501 INFO:teuthology.orchestra.run.smithi157.stdout: "num_ops": 4 2024-02-19T21:46:48.501 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:46:48.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:46.972817+0000 osd.1 (osd.1) 211 : cluster [DBG] 2.d scrub starts 2024-02-19T21:46:48.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:46.978008+0000 osd.1 (osd.1) 212 : cluster [DBG] 2.d scrub ok 2024-02-19T21:46:48.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:47.061390+0000 osd.7 (osd.7) 216 : cluster [DBG] 5.d scrub starts 2024-02-19T21:46:48.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:47.072980+0000 osd.7 (osd.7) 217 : cluster [DBG] 5.d scrub ok 2024-02-19T21:46:48.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:47.096557+0000 mgr.y (mgr.14514) 545 : cluster [DBG] pgmap v687: 138 pgs: 138 active+clean; 5.1 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 901 op/s 2024-02-19T21:46:48.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:47.753769+0000 osd.3 (osd.3) 214 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:46:48.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:47.761673+0000 osd.3 (osd.3) 215 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:46:48.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:47.960377+0000 osd.6 (osd.6) 203 : cluster [DBG] 4.5 scrub starts 2024-02-19T21:46:48.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:47.969954+0000 osd.6 (osd.6) 204 : cluster [DBG] 4.5 scrub ok 2024-02-19T21:46:48.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:46.972817+0000 osd.1 (osd.1) 211 : cluster [DBG] 2.d scrub starts 2024-02-19T21:46:48.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:46.978008+0000 osd.1 (osd.1) 212 : cluster [DBG] 2.d scrub ok 2024-02-19T21:46:48.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:47.061390+0000 osd.7 (osd.7) 216 : cluster [DBG] 5.d scrub starts 2024-02-19T21:46:48.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:47.072980+0000 osd.7 (osd.7) 217 : cluster [DBG] 5.d scrub ok 2024-02-19T21:46:48.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:47.096557+0000 mgr.y (mgr.14514) 545 : cluster [DBG] pgmap v687: 138 pgs: 138 active+clean; 5.1 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 901 op/s 2024-02-19T21:46:48.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:47.753769+0000 osd.3 (osd.3) 214 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:46:48.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:47.761673+0000 osd.3 (osd.3) 215 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:46:48.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:47.960377+0000 osd.6 (osd.6) 203 : cluster [DBG] 4.5 scrub starts 2024-02-19T21:46:48.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:47.969954+0000 osd.6 (osd.6) 204 : cluster [DBG] 4.5 scrub ok 2024-02-19T21:46:49.315 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.6 dump_blocked_ops 2024-02-19T21:46:49.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:48.462077+0000 osd.4 (osd.4) 175 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:46:49.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:48.498935+0000 osd.4 (osd.4) 176 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:46:49.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:48.740649+0000 osd.3 (osd.3) 216 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:46:49.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:48.806930+0000 osd.3 (osd.3) 217 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:46:49.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:48.905099+0000 osd.1 (osd.1) 213 : cluster [DBG] 4.d deep-scrub starts 2024-02-19T21:46:49.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:48.923793+0000 osd.1 (osd.1) 214 : cluster [DBG] 4.d deep-scrub ok 2024-02-19T21:46:49.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:48.963415+0000 mon.a (mon.0) 1426 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:46:49.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:48.977588+0000 osd.6 (osd.6) 205 : cluster [DBG] 5.2 scrub starts 2024-02-19T21:46:49.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:48.988827+0000 osd.6 (osd.6) 206 : cluster [DBG] 5.2 scrub ok 2024-02-19T21:46:49.731 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:46:49.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:48.462077+0000 osd.4 (osd.4) 175 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:46:49.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:48.498935+0000 osd.4 (osd.4) 176 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:46:49.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:48.740649+0000 osd.3 (osd.3) 216 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:46:49.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:48.806930+0000 osd.3 (osd.3) 217 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:46:49.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:48.905099+0000 osd.1 (osd.1) 213 : cluster [DBG] 4.d deep-scrub starts 2024-02-19T21:46:49.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:48.923793+0000 osd.1 (osd.1) 214 : cluster [DBG] 4.d deep-scrub ok 2024-02-19T21:46:49.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:48.963415+0000 mon.a (mon.0) 1426 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:46:49.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:48.977588+0000 osd.6 (osd.6) 205 : cluster [DBG] 5.2 scrub starts 2024-02-19T21:46:49.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:48.988827+0000 osd.6 (osd.6) 206 : cluster [DBG] 5.2 scrub ok 2024-02-19T21:46:49.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:48.462077+0000 osd.4 (osd.4) 175 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:46:49.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:48.498935+0000 osd.4 (osd.4) 176 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:46:49.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:48.740649+0000 osd.3 (osd.3) 216 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:46:49.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:48.806930+0000 osd.3 (osd.3) 217 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:46:49.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:48.905099+0000 osd.1 (osd.1) 213 : cluster [DBG] 4.d deep-scrub starts 2024-02-19T21:46:49.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:48.923793+0000 osd.1 (osd.1) 214 : cluster [DBG] 4.d deep-scrub ok 2024-02-19T21:46:49.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:48.963415+0000 mon.a (mon.0) 1426 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:46:49.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:48.977588+0000 osd.6 (osd.6) 205 : cluster [DBG] 5.2 scrub starts 2024-02-19T21:46:49.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:48.988827+0000 osd.6 (osd.6) 206 : cluster [DBG] 5.2 scrub ok 2024-02-19T21:46:50.696 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:49.031032+0000 osd.7 (osd.7) 218 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:46:50.696 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:49.096945+0000 mgr.y (mgr.14514) 546 : cluster [DBG] pgmap v688: 138 pgs: 138 active+clean; 5.1 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 765 B/s rd, 0 B/s wr, 808 op/s 2024-02-19T21:46:50.696 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:49.110112+0000 osd.7 (osd.7) 219 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:46:50.696 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:50.183241+0000 mon.a (mon.0) 1427 : cluster [DBG] osdmap e338: 8 total, 8 up, 7 in 2024-02-19T21:46:50.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:49.031032+0000 osd.7 (osd.7) 218 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:46:50.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:49.096945+0000 mgr.y (mgr.14514) 546 : cluster [DBG] pgmap v688: 138 pgs: 138 active+clean; 5.1 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 765 B/s rd, 0 B/s wr, 808 op/s 2024-02-19T21:46:50.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:49.110112+0000 osd.7 (osd.7) 219 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:46:50.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:50.183241+0000 mon.a (mon.0) 1427 : cluster [DBG] osdmap e338: 8 total, 8 up, 7 in 2024-02-19T21:46:50.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:49.031032+0000 osd.7 (osd.7) 218 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:46:50.773 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:49.096945+0000 mgr.y (mgr.14514) 546 : cluster [DBG] pgmap v688: 138 pgs: 138 active+clean; 5.1 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 765 B/s rd, 0 B/s wr, 808 op/s 2024-02-19T21:46:50.773 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:49.110112+0000 osd.7 (osd.7) 219 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:46:50.773 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:50.183241+0000 mon.a (mon.0) 1427 : cluster [DBG] osdmap e338: 8 total, 8 up, 7 in 2024-02-19T21:46:51.056 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:46:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:46:51.099 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:46:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:46:50] "GET /metrics HTTP/1.1" 200 176158 "" "Prometheus/2.33.4" 2024-02-19T21:46:51.684 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:50.694335+0000 mgr.y (mgr.14514) 547 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:46:51.731 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:50.694335+0000 mgr.y (mgr.14514) 547 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:46:51.731 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:50.694335+0000 mgr.y (mgr.14514) 547 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:46:51.746 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:51.746 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:46:51.746 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:46:51.847 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:46:51.910 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:51.968 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:46:51.971 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:51.971 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:46:52.028 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:46:52.028 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [], 2024-02-19T21:46:52.028 INFO:teuthology.orchestra.run.smithi157.stdout: "complaint_time": 30, 2024-02-19T21:46:52.028 INFO:teuthology.orchestra.run.smithi157.stdout: "num_blocked_ops": 0 2024-02-19T21:46:52.028 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:46:52.072 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:46:52.115 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:52.467 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:51.097468+0000 mgr.y (mgr.14514) 548 : cluster [DBG] pgmap v690: 138 pgs: 138 active+clean; 4.8 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.40k op/s 2024-02-19T21:46:52.467 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:52.098745+0000 osd.6 (osd.6) 207 : cluster [DBG] 2.e scrub starts 2024-02-19T21:46:52.467 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:52.107408+0000 osd.6 (osd.6) 208 : cluster [DBG] 2.e scrub ok 2024-02-19T21:46:52.467 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:51.097468+0000 mgr.y (mgr.14514) 548 : cluster [DBG] pgmap v690: 138 pgs: 138 active+clean; 4.8 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.40k op/s 2024-02-19T21:46:52.468 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:52.098745+0000 osd.6 (osd.6) 207 : cluster [DBG] 2.e scrub starts 2024-02-19T21:46:52.468 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:52.107408+0000 osd.6 (osd.6) 208 : cluster [DBG] 2.e scrub ok 2024-02-19T21:46:52.797 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:46:52.804 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:52.805 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:46:52.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:51.097468+0000 mgr.y (mgr.14514) 548 : cluster [DBG] pgmap v690: 138 pgs: 138 active+clean; 4.8 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.40k op/s 2024-02-19T21:46:52.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:52.098745+0000 osd.6 (osd.6) 207 : cluster [DBG] 2.e scrub starts 2024-02-19T21:46:52.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:52.107408+0000 osd.6 (osd.6) 208 : cluster [DBG] 2.e scrub ok 2024-02-19T21:46:52.906 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:46:52.970 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:53.375 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:46:53.442 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:46:53.452 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:53.453 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:46:53.553 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:46:53.596 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:53.669 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:46:53.672 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:46:53.680 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:53.681 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:46:53.681 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:46:53.752 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:52.922603+0000 osd.1 (osd.1) 215 : cluster [DBG] 9.2 scrub starts 2024-02-19T21:46:53.756 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:52.922603+0000 osd.1 (osd.1) 215 : cluster [DBG] 9.2 scrub starts 2024-02-19T21:46:53.782 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:46:53.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:52.922603+0000 osd.1 (osd.1) 215 : cluster [DBG] 9.2 scrub starts 2024-02-19T21:46:53.834 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:54.400 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":691,"stamp":"2024-02-19T21:46:53.097641+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5118367414,"num_objects":78293,"num_object_clones":0,"num_object_copies":234879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78293,"num_whiteouts":0,"num_read":1987,"num_read_kb":1739,"num_write":179791,"num_write_kb":8229737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":4364,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78064,"ondisk_log_size":78064,"up":414,"acting":414,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":414,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":656216064,"kb_used":18105324,"kb_used_data":15089908,"kb_used_omap":0,"kb_used_meta":3015296,"kb_avail":638110740,"statfs":{"total":671965249536,"available":653425397760,"internally_reserved":0,"allocated":15452065792,"data_stored":15446860832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3087663104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,5,7,9,10],"upper_bound":32},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-555876352,"num_objects":-8482,"num_object_clones":0,"num_object_copies":-25446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-8482,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8482,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001940"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":339,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.427472+0000","last_change":"2024-02-19T21:45:59.075662+0000","last_active":"2024-02-19T21:46:43.427472+0000","last_peered":"2024-02-19T21:46:43.427472+0000","last_clean":"2024-02-19T21:46:43.427472+0000","last_became_active":"2024-02-19T21:44:58.791985+0000","last_became_peered":"2024-02-19T21:44:58.791985+0000","last_unstale":"2024-02-19T21:46:43.427472+0000","last_undegraded":"2024-02-19T21:46:43.427472+0000","last_fullsized":"2024-02-19T21:46:43.427472+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:59.075598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:45:59.075598+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":313,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.430272+0000","last_change":"2024-02-19T21:45:17.201007+0000","last_active":"2024-02-19T21:46:46.430272+0000","last_peered":"2024-02-19T21:46:46.430272+0000","last_clean":"2024-02-19T21:46:46.430272+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:46:46.430272+0000","last_undegraded":"2024-02-19T21:46:46.430272+0000","last_fullsized":"2024-02-19T21:46:46.430272+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:17.200897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:17.200897+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"201'27","reported_seq":285,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.430860+0000","last_change":"2024-02-19T21:44:48.022082+0000","last_active":"2024-02-19T21:46:46.430860+0000","last_peered":"2024-02-19T21:46:46.430860+0000","last_clean":"2024-02-19T21:46:46.430860+0000","last_became_active":"2024-02-19T21:39:51.536424+0000","last_became_peered":"2024-02-19T21:39:51.536424+0000","last_unstale":"2024-02-19T21:46:46.430860+0000","last_undegraded":"2024-02-19T21:46:46.430860+0000","last_fullsized":"2024-02-19T21:46:46.430860+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'27","last_scrub_stamp":"2024-02-19T21:44:48.022013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:48.022013+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":340,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.441387+0000","last_change":"2024-02-19T21:46:04.955465+0000","last_active":"2024-02-19T21:46:43.441387+0000","last_peered":"2024-02-19T21:46:43.441387+0000","last_clean":"2024-02-19T21:46:43.441387+0000","last_became_active":"2024-02-19T21:44:58.789475+0000","last_became_peered":"2024-02-19T21:44:58.789475+0000","last_unstale":"2024-02-19T21:46:43.441387+0000","last_undegraded":"2024-02-19T21:46:43.441387+0000","last_fullsized":"2024-02-19T21:46:43.441387+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.955401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.955401+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":314,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.430188+0000","last_change":"2024-02-19T21:45:47.636198+0000","last_active":"2024-02-19T21:46:43.430188+0000","last_peered":"2024-02-19T21:46:43.430188+0000","last_clean":"2024-02-19T21:46:43.430188+0000","last_became_active":"2024-02-19T21:32:23.356975+0000","last_became_peered":"2024-02-19T21:32:23.356975+0000","last_unstale":"2024-02-19T21:46:43.430188+0000","last_undegraded":"2024-02-19T21:46:43.430188+0000","last_fullsized":"2024-02-19T21:46:43.430188+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.636083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.636083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"200'19","reported_seq":356,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.425558+0000","last_change":"2024-02-19T21:45:50.978723+0000","last_active":"2024-02-19T21:46:43.425558+0000","last_peered":"2024-02-19T21:46:43.425558+0000","last_clean":"2024-02-19T21:46:43.425558+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:46:43.425558+0000","last_undegraded":"2024-02-19T21:46:43.425558+0000","last_fullsized":"2024-02-19T21:46:43.425558+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:45:50.978619+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:45:50.978619+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":47,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.432108+0000","last_change":"2024-02-19T21:46:07.005324+0000","last_active":"2024-02-19T21:46:43.432108+0000","last_peered":"2024-02-19T21:46:43.432108+0000","last_clean":"2024-02-19T21:46:43.432108+0000","last_became_active":"2024-02-19T21:44:58.786889+0000","last_became_peered":"2024-02-19T21:44:58.786889+0000","last_unstale":"2024-02-19T21:46:43.432108+0000","last_undegraded":"2024-02-19T21:46:43.432108+0000","last_fullsized":"2024-02-19T21:46:43.432108+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.005236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.005236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":321,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.425485+0000","last_change":"2024-02-19T21:46:42.091708+0000","last_active":"2024-02-19T21:46:43.425485+0000","last_peered":"2024-02-19T21:46:43.425485+0000","last_clean":"2024-02-19T21:46:43.425485+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:46:43.425485+0000","last_undegraded":"2024-02-19T21:46:43.425485+0000","last_fullsized":"2024-02-19T21:46:43.425485+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:42.091605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:08.490788+0000","last_clean_scrub_stamp":"2024-02-19T21:46:42.091605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"310'9","reported_seq":311,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.421918+0000","last_change":"2024-02-19T21:45:20.506300+0000","last_active":"2024-02-19T21:46:43.421918+0000","last_peered":"2024-02-19T21:46:43.421918+0000","last_clean":"2024-02-19T21:46:43.421918+0000","last_became_active":"2024-02-19T21:39:39.471143+0000","last_became_peered":"2024-02-19T21:39:39.471143+0000","last_unstale":"2024-02-19T21:46:43.421918+0000","last_undegraded":"2024-02-19T21:46:43.421918+0000","last_fullsized":"2024-02-19T21:46:43.421918+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"310'9","last_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_deep_scrub":"310'9","last_deep_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.506188+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":247,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.430579+0000","last_change":"2024-02-19T21:46:31.205220+0000","last_active":"2024-02-19T21:46:46.430579+0000","last_peered":"2024-02-19T21:46:46.430579+0000","last_clean":"2024-02-19T21:46:46.430579+0000","last_became_active":"2024-02-19T21:46:31.204816+0000","last_became_peered":"2024-02-19T21:46:31.204816+0000","last_unstale":"2024-02-19T21:46:46.430579+0000","last_undegraded":"2024-02-19T21:46:46.430579+0000","last_fullsized":"2024-02-19T21:46:46.430579+0000","mapping_epoch":330,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":331,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:36.890201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.890201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":324,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.425698+0000","last_change":"2024-02-19T21:45:58.329415+0000","last_active":"2024-02-19T21:46:43.425698+0000","last_peered":"2024-02-19T21:46:43.425698+0000","last_clean":"2024-02-19T21:46:43.425698+0000","last_became_active":"2024-02-19T21:39:39.473759+0000","last_became_peered":"2024-02-19T21:39:39.473759+0000","last_unstale":"2024-02-19T21:46:43.425698+0000","last_undegraded":"2024-02-19T21:46:43.425698+0000","last_fullsized":"2024-02-19T21:46:43.425698+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:58.329316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:58.329316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"200'19","reported_seq":332,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.422174+0000","last_change":"2024-02-19T21:44:50.652809+0000","last_active":"2024-02-19T21:46:43.422174+0000","last_peered":"2024-02-19T21:46:43.422174+0000","last_clean":"2024-02-19T21:46:43.422174+0000","last_became_active":"2024-02-19T21:35:14.514971+0000","last_became_peered":"2024-02-19T21:35:14.514971+0000","last_unstale":"2024-02-19T21:46:43.422174+0000","last_undegraded":"2024-02-19T21:46:43.422174+0000","last_fullsized":"2024-02-19T21:46:43.422174+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:44:50.652700+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:44:50.652700+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":52,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:48.807012+0000","last_change":"2024-02-19T21:46:48.807012+0000","last_active":"2024-02-19T21:46:48.807012+0000","last_peered":"2024-02-19T21:46:48.807012+0000","last_clean":"2024-02-19T21:46:48.807012+0000","last_became_active":"2024-02-19T21:44:58.789418+0000","last_became_peered":"2024-02-19T21:44:58.789418+0000","last_unstale":"2024-02-19T21:46:48.807012+0000","last_undegraded":"2024-02-19T21:46:48.807012+0000","last_fullsized":"2024-02-19T21:46:48.807012+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:48.806937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.806937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":197,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.427656+0000","last_change":"2024-02-19T21:46:08.045894+0000","last_active":"2024-02-19T21:46:43.427656+0000","last_peered":"2024-02-19T21:46:43.427656+0000","last_clean":"2024-02-19T21:46:43.427656+0000","last_became_active":"2024-02-19T21:42:04.201106+0000","last_became_peered":"2024-02-19T21:42:04.201106+0000","last_unstale":"2024-02-19T21:46:43.427656+0000","last_undegraded":"2024-02-19T21:46:43.427656+0000","last_fullsized":"2024-02-19T21:46:43.427656+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:08.045817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.045817+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,5],"acting":[6,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"201'18","reported_seq":270,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.429334+0000","last_change":"2024-02-19T21:44:15.699369+0000","last_active":"2024-02-19T21:46:43.429334+0000","last_peered":"2024-02-19T21:46:43.429334+0000","last_clean":"2024-02-19T21:46:43.429334+0000","last_became_active":"2024-02-19T21:38:31.247067+0000","last_became_peered":"2024-02-19T21:38:31.247067+0000","last_unstale":"2024-02-19T21:46:43.429334+0000","last_undegraded":"2024-02-19T21:46:43.429334+0000","last_fullsized":"2024-02-19T21:46:43.429334+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'18","last_scrub_stamp":"2024-02-19T21:44:15.699279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.699279+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":307,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:45.499810+0000","last_change":"2024-02-19T21:46:45.499769+0000","last_active":"2024-02-19T21:46:45.499810+0000","last_peered":"2024-02-19T21:46:45.499810+0000","last_clean":"2024-02-19T21:46:45.499810+0000","last_became_active":"2024-02-19T21:44:58.788307+0000","last_became_peered":"2024-02-19T21:44:58.788307+0000","last_unstale":"2024-02-19T21:46:45.499810+0000","last_undegraded":"2024-02-19T21:46:45.499810+0000","last_fullsized":"2024-02-19T21:46:45.499810+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.499666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.499666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":315,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.427364+0000","last_change":"2024-02-19T21:45:17.913694+0000","last_active":"2024-02-19T21:46:43.427364+0000","last_peered":"2024-02-19T21:46:43.427364+0000","last_clean":"2024-02-19T21:46:43.427364+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:46:43.427364+0000","last_undegraded":"2024-02-19T21:46:43.427364+0000","last_fullsized":"2024-02-19T21:46:43.427364+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:17.913620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:17.913620+0000","last_clean_scrub_stamp":"2024-02-19T21:45:17.913620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"200'34","reported_seq":298,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.427636+0000","last_change":"2024-02-19T21:45:49.728831+0000","last_active":"2024-02-19T21:46:43.427636+0000","last_peered":"2024-02-19T21:46:43.427636+0000","last_clean":"2024-02-19T21:46:43.427636+0000","last_became_active":"2024-02-19T21:39:39.477429+0000","last_became_peered":"2024-02-19T21:39:39.477429+0000","last_unstale":"2024-02-19T21:46:43.427636+0000","last_undegraded":"2024-02-19T21:46:43.427636+0000","last_fullsized":"2024-02-19T21:46:43.427636+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'34","last_scrub_stamp":"2024-02-19T21:45:49.728734+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:45:49.728734+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":332,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:44.994424+0000","last_change":"2024-02-19T21:46:44.994389+0000","last_active":"2024-02-19T21:46:44.994424+0000","last_peered":"2024-02-19T21:46:44.994424+0000","last_clean":"2024-02-19T21:46:44.994424+0000","last_became_active":"2024-02-19T21:44:58.790669+0000","last_became_peered":"2024-02-19T21:44:58.790669+0000","last_unstale":"2024-02-19T21:46:44.994424+0000","last_undegraded":"2024-02-19T21:46:44.994424+0000","last_fullsized":"2024-02-19T21:46:44.994424+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.994296+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":244,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.426989+0000","last_change":"2024-02-19T21:46:07.091499+0000","last_active":"2024-02-19T21:46:43.426989+0000","last_peered":"2024-02-19T21:46:43.426989+0000","last_clean":"2024-02-19T21:46:43.426989+0000","last_became_active":"2024-02-19T21:42:04.198592+0000","last_became_peered":"2024-02-19T21:42:04.198592+0000","last_unstale":"2024-02-19T21:46:43.426989+0000","last_undegraded":"2024-02-19T21:46:43.426989+0000","last_fullsized":"2024-02-19T21:46:43.426989+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.091409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.091409+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"201'19","reported_seq":212,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.430205+0000","last_change":"2024-02-19T21:45:02.090506+0000","last_active":"2024-02-19T21:46:46.430205+0000","last_peered":"2024-02-19T21:46:46.430205+0000","last_clean":"2024-02-19T21:46:46.430205+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:46:46.430205+0000","last_undegraded":"2024-02-19T21:46:46.430205+0000","last_fullsized":"2024-02-19T21:46:46.430205+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:45:02.090422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:02.090422+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":133,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.425444+0000","last_change":"2024-02-19T21:45:12.526572+0000","last_active":"2024-02-19T21:46:43.425444+0000","last_peered":"2024-02-19T21:46:43.425444+0000","last_clean":"2024-02-19T21:46:43.425444+0000","last_became_active":"2024-02-19T21:45:01.146656+0000","last_became_peered":"2024-02-19T21:45:01.146656+0000","last_unstale":"2024-02-19T21:46:43.425444+0000","last_undegraded":"2024-02-19T21:46:43.425444+0000","last_fullsized":"2024-02-19T21:46:43.425444+0000","mapping_epoch":307,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":308,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:45:12.526466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.526466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":325,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:45.803733+0000","last_change":"2024-02-19T21:46:45.803704+0000","last_active":"2024-02-19T21:46:45.803733+0000","last_peered":"2024-02-19T21:46:45.803733+0000","last_clean":"2024-02-19T21:46:45.803733+0000","last_became_active":"2024-02-19T21:42:04.199323+0000","last_became_peered":"2024-02-19T21:42:04.199323+0000","last_unstale":"2024-02-19T21:46:45.803733+0000","last_undegraded":"2024-02-19T21:46:45.803733+0000","last_fullsized":"2024-02-19T21:46:45.803733+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.803606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.803606+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"201'20","reported_seq":392,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.431055+0000","last_change":"2024-02-19T21:44:51.032776+0000","last_active":"2024-02-19T21:46:46.431055+0000","last_peered":"2024-02-19T21:46:46.431055+0000","last_clean":"2024-02-19T21:46:46.431055+0000","last_became_active":"2024-02-19T21:42:04.204882+0000","last_became_peered":"2024-02-19T21:42:04.204882+0000","last_unstale":"2024-02-19T21:46:46.431055+0000","last_undegraded":"2024-02-19T21:46:46.431055+0000","last_fullsized":"2024-02-19T21:46:46.431055+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:44:51.032704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:51.032704+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":229,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.429998+0000","last_change":"2024-02-19T21:46:46.230754+0000","last_active":"2024-02-19T21:46:46.429998+0000","last_peered":"2024-02-19T21:46:46.429998+0000","last_clean":"2024-02-19T21:46:46.429998+0000","last_became_active":"2024-02-19T21:39:39.471332+0000","last_became_peered":"2024-02-19T21:39:39.471332+0000","last_unstale":"2024-02-19T21:46:46.429998+0000","last_undegraded":"2024-02-19T21:46:46.429998+0000","last_fullsized":"2024-02-19T21:46:46.429998+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.230652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.230652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":308,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.425019+0000","last_change":"2024-02-19T21:45:10.521912+0000","last_active":"2024-02-19T21:46:43.425019+0000","last_peered":"2024-02-19T21:46:43.425019+0000","last_clean":"2024-02-19T21:46:43.425019+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:46:43.425019+0000","last_undegraded":"2024-02-19T21:46:43.425019+0000","last_fullsized":"2024-02-19T21:46:43.425019+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:10.521830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:45:10.521830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":324,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.428726+0000","last_change":"2024-02-19T21:46:03.034913+0000","last_active":"2024-02-19T21:46:43.428726+0000","last_peered":"2024-02-19T21:46:43.428726+0000","last_clean":"2024-02-19T21:46:43.428726+0000","last_became_active":"2024-02-19T21:39:39.478633+0000","last_became_peered":"2024-02-19T21:39:39.478633+0000","last_unstale":"2024-02-19T21:46:43.428726+0000","last_undegraded":"2024-02-19T21:46:43.428726+0000","last_fullsized":"2024-02-19T21:46:43.428726+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:03.034839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:03.034839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"201'19","reported_seq":364,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.421838+0000","last_change":"2024-02-19T21:46:00.562300+0000","last_active":"2024-02-19T21:46:43.421838+0000","last_peered":"2024-02-19T21:46:43.421838+0000","last_clean":"2024-02-19T21:46:43.421838+0000","last_became_active":"2024-02-19T21:42:04.205379+0000","last_became_peered":"2024-02-19T21:42:04.205379+0000","last_unstale":"2024-02-19T21:46:43.421838+0000","last_undegraded":"2024-02-19T21:46:43.421838+0000","last_fullsized":"2024-02-19T21:46:43.421838+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:46:00.562206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:46:00.562206+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":313,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.425353+0000","last_change":"2024-02-19T21:45:59.339756+0000","last_active":"2024-02-19T21:46:43.425353+0000","last_peered":"2024-02-19T21:46:43.425353+0000","last_clean":"2024-02-19T21:46:43.425353+0000","last_became_active":"2024-02-19T21:39:39.471306+0000","last_became_peered":"2024-02-19T21:39:39.471306+0000","last_unstale":"2024-02-19T21:46:43.425353+0000","last_undegraded":"2024-02-19T21:46:43.425353+0000","last_fullsized":"2024-02-19T21:46:43.425353+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:59.339649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:45:59.339649+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":354,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.427114+0000","last_change":"2024-02-19T21:46:00.027242+0000","last_active":"2024-02-19T21:46:43.427114+0000","last_peered":"2024-02-19T21:46:43.427114+0000","last_clean":"2024-02-19T21:46:43.427114+0000","last_became_active":"2024-02-19T21:42:04.196794+0000","last_became_peered":"2024-02-19T21:42:04.196794+0000","last_unstale":"2024-02-19T21:46:43.427114+0000","last_undegraded":"2024-02-19T21:46:43.427114+0000","last_fullsized":"2024-02-19T21:46:43.427114+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:00.027139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:46:00.027139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":315,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.435916+0000","last_change":"2024-02-19T21:44:11.487571+0000","last_active":"2024-02-19T21:46:43.435916+0000","last_peered":"2024-02-19T21:46:43.435916+0000","last_clean":"2024-02-19T21:46:43.435916+0000","last_became_active":"2024-02-19T21:39:39.479927+0000","last_became_peered":"2024-02-19T21:39:39.479927+0000","last_unstale":"2024-02-19T21:46:43.435916+0000","last_undegraded":"2024-02-19T21:46:43.435916+0000","last_fullsized":"2024-02-19T21:46:43.435916+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:11.487509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:44:11.487509+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"200'8","reported_seq":177,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:47.761750+0000","last_change":"2024-02-19T21:46:47.761750+0000","last_active":"2024-02-19T21:46:47.761750+0000","last_peered":"2024-02-19T21:46:47.761750+0000","last_clean":"2024-02-19T21:46:47.761750+0000","last_became_active":"2024-02-19T21:41:42.243259+0000","last_became_peered":"2024-02-19T21:41:42.243259+0000","last_unstale":"2024-02-19T21:46:47.761750+0000","last_undegraded":"2024-02-19T21:46:47.761750+0000","last_fullsized":"2024-02-19T21:46:47.761750+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'8","last_scrub_stamp":"2024-02-19T21:46:47.761677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.761677+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":224,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.430775+0000","last_change":"2024-02-19T21:44:17.079476+0000","last_active":"2024-02-19T21:46:46.430775+0000","last_peered":"2024-02-19T21:46:46.430775+0000","last_clean":"2024-02-19T21:46:46.430775+0000","last_became_active":"2024-02-19T21:39:39.462363+0000","last_became_peered":"2024-02-19T21:39:39.462363+0000","last_unstale":"2024-02-19T21:46:46.430775+0000","last_undegraded":"2024-02-19T21:46:46.430775+0000","last_fullsized":"2024-02-19T21:46:46.430775+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:17.079391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:44:17.079391+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":321,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.427218+0000","last_change":"2024-02-19T21:45:19.596864+0000","last_active":"2024-02-19T21:46:43.427218+0000","last_peered":"2024-02-19T21:46:43.427218+0000","last_clean":"2024-02-19T21:46:43.427218+0000","last_became_active":"2024-02-19T21:42:04.198684+0000","last_became_peered":"2024-02-19T21:42:04.198684+0000","last_unstale":"2024-02-19T21:46:43.427218+0000","last_undegraded":"2024-02-19T21:46:43.427218+0000","last_fullsized":"2024-02-19T21:46:43.427218+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:19.596775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:19.596775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":309,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.429038+0000","last_change":"2024-02-19T21:44:52.828511+0000","last_active":"2024-02-19T21:46:43.429038+0000","last_peered":"2024-02-19T21:46:43.429038+0000","last_clean":"2024-02-19T21:46:43.429038+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:46:43.429038+0000","last_undegraded":"2024-02-19T21:46:43.429038+0000","last_fullsized":"2024-02-19T21:46:43.429038+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:52.828413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:44:52.828413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"201'19","reported_seq":356,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.475132+0000","last_change":"2024-02-19T21:46:43.475089+0000","last_active":"2024-02-19T21:46:43.475132+0000","last_peered":"2024-02-19T21:46:43.475132+0000","last_clean":"2024-02-19T21:46:43.475132+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:46:43.475132+0000","last_undegraded":"2024-02-19T21:46:43.475132+0000","last_fullsized":"2024-02-19T21:46:43.475132+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:46:43.474985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:46:43.474985+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":318,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.429741+0000","last_change":"2024-02-19T21:46:06.096531+0000","last_active":"2024-02-19T21:46:46.429741+0000","last_peered":"2024-02-19T21:46:46.429741+0000","last_clean":"2024-02-19T21:46:46.429741+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:46:46.429741+0000","last_undegraded":"2024-02-19T21:46:46.429741+0000","last_fullsized":"2024-02-19T21:46:46.429741+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.096422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":314,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.421987+0000","last_change":"2024-02-19T21:45:59.539674+0000","last_active":"2024-02-19T21:46:43.421987+0000","last_peered":"2024-02-19T21:46:43.421987+0000","last_clean":"2024-02-19T21:46:43.421987+0000","last_became_active":"2024-02-19T21:39:51.534750+0000","last_became_peered":"2024-02-19T21:39:51.534750+0000","last_unstale":"2024-02-19T21:46:43.421987+0000","last_undegraded":"2024-02-19T21:46:43.421987+0000","last_fullsized":"2024-02-19T21:46:43.421987+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:59.539586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:59.539586+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":315,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.427035+0000","last_change":"2024-02-19T21:45:48.957337+0000","last_active":"2024-02-19T21:46:43.427035+0000","last_peered":"2024-02-19T21:46:43.427035+0000","last_clean":"2024-02-19T21:46:43.427035+0000","last_became_active":"2024-02-19T21:32:23.357338+0000","last_became_peered":"2024-02-19T21:32:23.357338+0000","last_unstale":"2024-02-19T21:46:43.427035+0000","last_undegraded":"2024-02-19T21:46:43.427035+0000","last_fullsized":"2024-02-19T21:46:43.427035+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:48.957250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:45:48.957250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"200'15","reported_seq":349,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.427163+0000","last_change":"2024-02-19T21:45:08.678772+0000","last_active":"2024-02-19T21:46:43.427163+0000","last_peered":"2024-02-19T21:46:43.427163+0000","last_clean":"2024-02-19T21:46:43.427163+0000","last_became_active":"2024-02-19T21:39:39.466843+0000","last_became_peered":"2024-02-19T21:39:39.466843+0000","last_unstale":"2024-02-19T21:46:43.427163+0000","last_undegraded":"2024-02-19T21:46:43.427163+0000","last_fullsized":"2024-02-19T21:46:43.427163+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:45:08.678669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:08.678669+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":340,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.433498+0000","last_change":"2024-02-19T21:46:08.984000+0000","last_active":"2024-02-19T21:46:43.433498+0000","last_peered":"2024-02-19T21:46:43.433498+0000","last_clean":"2024-02-19T21:46:43.433498+0000","last_became_active":"2024-02-19T21:44:58.788069+0000","last_became_peered":"2024-02-19T21:44:58.788069+0000","last_unstale":"2024-02-19T21:46:43.433498+0000","last_undegraded":"2024-02-19T21:46:43.433498+0000","last_fullsized":"2024-02-19T21:46:43.433498+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:08.983923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.983923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"199'13","reported_seq":304,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.439374+0000","last_change":"2024-02-19T21:45:05.721799+0000","last_active":"2024-02-19T21:46:46.439374+0000","last_peered":"2024-02-19T21:46:46.439374+0000","last_clean":"2024-02-19T21:46:46.439374+0000","last_became_active":"2024-02-19T21:42:04.195103+0000","last_became_peered":"2024-02-19T21:42:04.195103+0000","last_unstale":"2024-02-19T21:46:46.439374+0000","last_undegraded":"2024-02-19T21:46:46.439374+0000","last_fullsized":"2024-02-19T21:46:46.439374+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"199'13","last_scrub_stamp":"2024-02-19T21:45:05.721709+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:45:05.721709+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":322,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.430399+0000","last_change":"2024-02-19T21:45:20.157554+0000","last_active":"2024-02-19T21:46:46.430399+0000","last_peered":"2024-02-19T21:46:46.430399+0000","last_clean":"2024-02-19T21:46:46.430399+0000","last_became_active":"2024-02-19T21:32:23.361680+0000","last_became_peered":"2024-02-19T21:32:23.361680+0000","last_unstale":"2024-02-19T21:46:46.430399+0000","last_undegraded":"2024-02-19T21:46:46.430399+0000","last_fullsized":"2024-02-19T21:46:46.430399+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.157478+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"201'19","reported_seq":338,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.433177+0000","last_change":"2024-02-19T21:44:56.767033+0000","last_active":"2024-02-19T21:46:43.433177+0000","last_peered":"2024-02-19T21:46:43.433177+0000","last_clean":"2024-02-19T21:46:43.433177+0000","last_became_active":"2024-02-19T21:32:25.372206+0000","last_became_peered":"2024-02-19T21:32:25.372206+0000","last_unstale":"2024-02-19T21:46:43.433177+0000","last_undegraded":"2024-02-19T21:46:43.433177+0000","last_fullsized":"2024-02-19T21:46:43.433177+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:44:56.766950+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:44:56.766950+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":48,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.430079+0000","last_change":"2024-02-19T21:46:04.121841+0000","last_active":"2024-02-19T21:46:46.430079+0000","last_peered":"2024-02-19T21:46:46.430079+0000","last_clean":"2024-02-19T21:46:46.430079+0000","last_became_active":"2024-02-19T21:44:58.788519+0000","last_became_peered":"2024-02-19T21:44:58.788519+0000","last_unstale":"2024-02-19T21:46:46.430079+0000","last_undegraded":"2024-02-19T21:46:46.430079+0000","last_fullsized":"2024-02-19T21:46:46.430079+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.121769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.121769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":489,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.441489+0000","last_change":"2024-02-19T21:45:02.745748+0000","last_active":"2024-02-19T21:46:46.441489+0000","last_peered":"2024-02-19T21:46:46.441489+0000","last_clean":"2024-02-19T21:46:46.441489+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:46:46.441489+0000","last_undegraded":"2024-02-19T21:46:46.441489+0000","last_fullsized":"2024-02-19T21:46:46.441489+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:45:02.745649+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:45:02.745649+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":322,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.441736+0000","last_change":"2024-02-19T21:44:47.741002+0000","last_active":"2024-02-19T21:46:43.441736+0000","last_peered":"2024-02-19T21:46:43.441736+0000","last_clean":"2024-02-19T21:46:43.441736+0000","last_became_active":"2024-02-19T21:42:04.205401+0000","last_became_peered":"2024-02-19T21:42:04.205401+0000","last_unstale":"2024-02-19T21:46:43.441736+0000","last_undegraded":"2024-02-19T21:46:43.441736+0000","last_fullsized":"2024-02-19T21:46:43.441736+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:47.740904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:44:47.740904+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"201'25","reported_seq":347,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.425575+0000","last_change":"2024-02-19T21:46:07.553789+0000","last_active":"2024-02-19T21:46:43.425575+0000","last_peered":"2024-02-19T21:46:43.425575+0000","last_clean":"2024-02-19T21:46:43.425575+0000","last_became_active":"2024-02-19T21:32:25.372060+0000","last_became_peered":"2024-02-19T21:32:25.372060+0000","last_unstale":"2024-02-19T21:46:43.425575+0000","last_undegraded":"2024-02-19T21:46:43.425575+0000","last_fullsized":"2024-02-19T21:46:43.425575+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'25","last_scrub_stamp":"2024-02-19T21:46:07.553690+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.553690+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":308,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.425389+0000","last_change":"2024-02-19T21:45:05.670682+0000","last_active":"2024-02-19T21:46:43.425389+0000","last_peered":"2024-02-19T21:46:43.425389+0000","last_clean":"2024-02-19T21:46:43.425389+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:46:43.425389+0000","last_undegraded":"2024-02-19T21:46:43.425389+0000","last_fullsized":"2024-02-19T21:46:43.425389+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:05.670585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_clean_scrub_stamp":"2024-02-19T21:45:05.670585+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":319,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.427124+0000","last_change":"2024-02-19T21:46:35.035136+0000","last_active":"2024-02-19T21:46:43.427124+0000","last_peered":"2024-02-19T21:46:43.427124+0000","last_clean":"2024-02-19T21:46:43.427124+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:46:43.427124+0000","last_undegraded":"2024-02-19T21:46:43.427124+0000","last_fullsized":"2024-02-19T21:46:43.427124+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:35.035042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:35.035042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"201'12","reported_seq":194,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.430742+0000","last_change":"2024-02-19T21:44:17.715721+0000","last_active":"2024-02-19T21:46:43.430742+0000","last_peered":"2024-02-19T21:46:43.430742+0000","last_clean":"2024-02-19T21:46:43.430742+0000","last_became_active":"2024-02-19T21:42:04.192291+0000","last_became_peered":"2024-02-19T21:42:04.192291+0000","last_unstale":"2024-02-19T21:46:43.430742+0000","last_undegraded":"2024-02-19T21:46:43.430742+0000","last_fullsized":"2024-02-19T21:46:43.430742+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'12","last_scrub_stamp":"2024-02-19T21:44:17.715652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:17.715652+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":198,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.427991+0000","last_change":"2024-02-19T21:45:57.039736+0000","last_active":"2024-02-19T21:46:43.427991+0000","last_peered":"2024-02-19T21:46:43.427991+0000","last_clean":"2024-02-19T21:46:43.427991+0000","last_became_active":"2024-02-19T21:39:39.469477+0000","last_became_peered":"2024-02-19T21:39:39.469477+0000","last_unstale":"2024-02-19T21:46:43.427991+0000","last_undegraded":"2024-02-19T21:46:43.427991+0000","last_fullsized":"2024-02-19T21:46:43.427991+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:57.039646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:45:57.039646+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":188,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.426892+0000","last_change":"2024-02-19T21:44:09.645675+0000","last_active":"2024-02-19T21:46:43.426892+0000","last_peered":"2024-02-19T21:46:43.426892+0000","last_clean":"2024-02-19T21:46:43.426892+0000","last_became_active":"2024-02-19T21:39:39.477308+0000","last_became_peered":"2024-02-19T21:39:39.477308+0000","last_unstale":"2024-02-19T21:46:43.426892+0000","last_undegraded":"2024-02-19T21:46:43.426892+0000","last_fullsized":"2024-02-19T21:46:43.426892+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:09.645607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:44:09.645607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"200'15","reported_seq":393,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.430361+0000","last_change":"2024-02-19T21:44:53.072845+0000","last_active":"2024-02-19T21:46:46.430361+0000","last_peered":"2024-02-19T21:46:46.430361+0000","last_clean":"2024-02-19T21:46:46.430361+0000","last_became_active":"2024-02-19T21:42:04.207069+0000","last_became_peered":"2024-02-19T21:42:04.207069+0000","last_unstale":"2024-02-19T21:46:46.430361+0000","last_undegraded":"2024-02-19T21:46:46.430361+0000","last_fullsized":"2024-02-19T21:46:46.430361+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:44:53.072746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:53.072746+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"337'11270","reported_seq":11347,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:50.101819+0000","last_change":"2024-02-19T21:44:16.113820+0000","last_active":"2024-02-19T21:46:50.101819+0000","last_peered":"2024-02-19T21:46:50.101819+0000","last_clean":"2024-02-19T21:46:50.101819+0000","last_became_active":"2024-02-19T21:44:16.113593+0000","last_became_peered":"2024-02-19T21:44:16.113593+0000","last_unstale":"2024-02-19T21:46:50.101819+0000","last_undegraded":"2024-02-19T21:46:50.101819+0000","last_fullsized":"2024-02-19T21:46:50.101819+0000","mapping_epoch":268,"log_start":"321'7200","ondisk_log_start":"321'7200","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4070,"ondisk_log_size":4070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":321912832,"num_objects":4912,"num_object_clones":0,"num_object_copies":14736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4912,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11270,"num_write_kb":517824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":339,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.422056+0000","last_change":"2024-02-19T21:45:04.692907+0000","last_active":"2024-02-19T21:46:43.422056+0000","last_peered":"2024-02-19T21:46:43.422056+0000","last_clean":"2024-02-19T21:46:43.422056+0000","last_became_active":"2024-02-19T21:44:56.153136+0000","last_became_peered":"2024-02-19T21:44:56.153136+0000","last_unstale":"2024-02-19T21:46:43.422056+0000","last_undegraded":"2024-02-19T21:46:43.422056+0000","last_fullsized":"2024-02-19T21:46:43.422056+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:04.692807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.692807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"59'2","reported_seq":344,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.429239+0000","last_change":"2024-02-19T21:46:05.104826+0000","last_active":"2024-02-19T21:46:43.429239+0000","last_peered":"2024-02-19T21:46:43.429239+0000","last_clean":"2024-02-19T21:46:43.429239+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:46:43.429239+0000","last_undegraded":"2024-02-19T21:46:43.429239+0000","last_fullsized":"2024-02-19T21:46:43.429239+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-02-19T21:46:05.104766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:05.104766+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"200'23","reported_seq":351,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.426783+0000","last_change":"2024-02-19T21:45:20.561937+0000","last_active":"2024-02-19T21:46:43.426783+0000","last_peered":"2024-02-19T21:46:43.426783+0000","last_clean":"2024-02-19T21:46:43.426783+0000","last_became_active":"2024-02-19T21:38:31.247821+0000","last_became_peered":"2024-02-19T21:38:31.247821+0000","last_unstale":"2024-02-19T21:46:43.426783+0000","last_undegraded":"2024-02-19T21:46:43.426783+0000","last_fullsized":"2024-02-19T21:46:43.426783+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'23","last_scrub_stamp":"2024-02-19T21:45:20.561862+0000","last_deep_scrub":"83'17","last_deep_scrub_stamp":"2024-02-19T21:33:43.418450+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.561862+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":25,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":207,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.430662+0000","last_change":"2024-02-19T21:44:58.047618+0000","last_active":"2024-02-19T21:46:46.430662+0000","last_peered":"2024-02-19T21:46:46.430662+0000","last_clean":"2024-02-19T21:46:46.430662+0000","last_became_active":"2024-02-19T21:44:38.145122+0000","last_became_peered":"2024-02-19T21:44:38.145122+0000","last_unstale":"2024-02-19T21:46:46.430662+0000","last_undegraded":"2024-02-19T21:46:46.430662+0000","last_fullsized":"2024-02-19T21:46:46.430662+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:58.047556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:58.047556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"337'11138","reported_seq":11215,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:50.086897+0000","last_change":"2024-02-19T21:44:16.118671+0000","last_active":"2024-02-19T21:46:50.086897+0000","last_peered":"2024-02-19T21:46:50.086897+0000","last_clean":"2024-02-19T21:46:50.086897+0000","last_became_active":"2024-02-19T21:44:16.118362+0000","last_became_peered":"2024-02-19T21:44:16.118362+0000","last_unstale":"2024-02-19T21:46:50.086897+0000","last_undegraded":"2024-02-19T21:46:50.086897+0000","last_fullsized":"2024-02-19T21:46:50.086897+0000","mapping_epoch":268,"log_start":"321'7000","ondisk_log_start":"321'7000","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4138,"ondisk_log_size":4138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":318111744,"num_objects":4854,"num_object_clones":0,"num_object_copies":14562,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4854,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11138,"num_write_kb":511744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4],"acting":[5,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":334,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.429798+0000","last_change":"2024-02-19T21:45:22.180685+0000","last_active":"2024-02-19T21:46:46.429798+0000","last_peered":"2024-02-19T21:46:46.429798+0000","last_clean":"2024-02-19T21:46:46.429798+0000","last_became_active":"2024-02-19T21:41:42.245788+0000","last_became_peered":"2024-02-19T21:41:42.245788+0000","last_unstale":"2024-02-19T21:46:46.429798+0000","last_undegraded":"2024-02-19T21:46:46.429798+0000","last_fullsized":"2024-02-19T21:46:46.429798+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:22.180593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:45:22.180593+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,5],"acting":[0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":307,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.427605+0000","last_change":"2024-02-19T21:44:47.801856+0000","last_active":"2024-02-19T21:46:43.427605+0000","last_peered":"2024-02-19T21:46:43.427605+0000","last_clean":"2024-02-19T21:46:43.427605+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:46:43.427605+0000","last_undegraded":"2024-02-19T21:46:43.427605+0000","last_fullsized":"2024-02-19T21:46:43.427605+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:47.801768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:44:47.801768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"201'20","reported_seq":218,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.427202+0000","last_change":"2024-02-19T21:45:57.877936+0000","last_active":"2024-02-19T21:46:43.427202+0000","last_peered":"2024-02-19T21:46:43.427202+0000","last_clean":"2024-02-19T21:46:43.427202+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:46:43.427202+0000","last_undegraded":"2024-02-19T21:46:43.427202+0000","last_fullsized":"2024-02-19T21:46:43.427202+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:45:57.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:57.877856+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":492,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:47.033421+0000","last_change":"2024-02-19T21:45:07.122114+0000","last_active":"2024-02-19T21:46:47.033421+0000","last_peered":"2024-02-19T21:46:47.033421+0000","last_clean":"2024-02-19T21:46:47.033421+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:46:47.033421+0000","last_undegraded":"2024-02-19T21:46:47.033421+0000","last_fullsized":"2024-02-19T21:46:47.033421+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:45:07.121970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:07.121970+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"338'11331","reported_seq":11409,"reported_epoch":338,"state":"active+clean","last_fresh":"2024-02-19T21:46:50.306963+0000","last_change":"2024-02-19T21:44:16.117157+0000","last_active":"2024-02-19T21:46:50.306963+0000","last_peered":"2024-02-19T21:46:50.306963+0000","last_clean":"2024-02-19T21:46:50.306963+0000","last_became_active":"2024-02-19T21:44:16.116819+0000","last_became_peered":"2024-02-19T21:44:16.116819+0000","last_unstale":"2024-02-19T21:46:50.306963+0000","last_undegraded":"2024-02-19T21:46:50.306963+0000","last_fullsized":"2024-02-19T21:46:50.306963+0000","mapping_epoch":268,"log_start":"320'7000","ondisk_log_start":"320'7000","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4331,"ondisk_log_size":4331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":320536576,"num_objects":4891,"num_object_clones":0,"num_object_copies":14673,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4891,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11331,"num_write_kb":519104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":256,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:48.499044+0000","last_change":"2024-02-19T21:46:48.499044+0000","last_active":"2024-02-19T21:46:48.499044+0000","last_peered":"2024-02-19T21:46:48.499044+0000","last_clean":"2024-02-19T21:46:48.499044+0000","last_became_active":"2024-02-19T21:44:56.149476+0000","last_became_peered":"2024-02-19T21:44:56.149476+0000","last_unstale":"2024-02-19T21:46:48.499044+0000","last_undegraded":"2024-02-19T21:46:48.499044+0000","last_fullsized":"2024-02-19T21:46:48.499044+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:48.498944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.498944+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":324,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.441803+0000","last_change":"2024-02-19T21:46:41.834315+0000","last_active":"2024-02-19T21:46:43.441803+0000","last_peered":"2024-02-19T21:46:43.441803+0000","last_clean":"2024-02-19T21:46:43.441803+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:46:43.441803+0000","last_undegraded":"2024-02-19T21:46:43.441803+0000","last_fullsized":"2024-02-19T21:46:43.441803+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:41.834246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:46:41.834246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"201'43","reported_seq":638,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.439698+0000","last_change":"2024-02-19T21:45:04.755549+0000","last_active":"2024-02-19T21:46:46.439698+0000","last_peered":"2024-02-19T21:46:46.439698+0000","last_clean":"2024-02-19T21:46:46.439698+0000","last_became_active":"2024-02-19T21:42:04.196382+0000","last_became_peered":"2024-02-19T21:42:04.196382+0000","last_unstale":"2024-02-19T21:46:46.439698+0000","last_undegraded":"2024-02-19T21:46:46.439698+0000","last_fullsized":"2024-02-19T21:46:46.439698+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'43","last_scrub_stamp":"2024-02-19T21:45:04.755444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.755444+0000","log_size":43,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":1074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,5],"acting":[1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":309,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.431118+0000","last_change":"2024-02-19T21:46:45.252437+0000","last_active":"2024-02-19T21:46:46.431118+0000","last_peered":"2024-02-19T21:46:46.431118+0000","last_clean":"2024-02-19T21:46:46.431118+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:46:46.431118+0000","last_undegraded":"2024-02-19T21:46:46.431118+0000","last_fullsized":"2024-02-19T21:46:46.431118+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.252344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.252344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"337'11129","reported_seq":11206,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:50.076626+0000","last_change":"2024-02-19T21:44:16.122030+0000","last_active":"2024-02-19T21:46:50.076626+0000","last_peered":"2024-02-19T21:46:50.076626+0000","last_clean":"2024-02-19T21:46:50.076626+0000","last_became_active":"2024-02-19T21:44:16.121785+0000","last_became_peered":"2024-02-19T21:44:16.121785+0000","last_unstale":"2024-02-19T21:46:50.076626+0000","last_undegraded":"2024-02-19T21:46:50.076626+0000","last_fullsized":"2024-02-19T21:46:50.076626+0000","mapping_epoch":268,"log_start":"321'7000","ondisk_log_start":"321'7000","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4129,"ondisk_log_size":4129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":321716224,"num_objects":4909,"num_object_clones":0,"num_object_copies":14727,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4909,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11129,"num_write_kb":513216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":304,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.425620+0000","last_change":"2024-02-19T21:45:17.575173+0000","last_active":"2024-02-19T21:46:43.425620+0000","last_peered":"2024-02-19T21:46:43.425620+0000","last_clean":"2024-02-19T21:46:43.425620+0000","last_became_active":"2024-02-19T21:32:29.597365+0000","last_became_peered":"2024-02-19T21:32:29.597365+0000","last_unstale":"2024-02-19T21:46:43.425620+0000","last_undegraded":"2024-02-19T21:46:43.425620+0000","last_fullsized":"2024-02-19T21:46:43.425620+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:17.575084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:45:17.575084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'6","reported_seq":1180,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:48.901664+0000","last_change":"2024-02-19T21:44:13.678401+0000","last_active":"2024-02-19T21:46:48.901664+0000","last_peered":"2024-02-19T21:46:48.901664+0000","last_clean":"2024-02-19T21:46:48.901664+0000","last_became_active":"2024-02-19T21:39:39.464361+0000","last_became_peered":"2024-02-19T21:39:39.464361+0000","last_unstale":"2024-02-19T21:46:48.901664+0000","last_undegraded":"2024-02-19T21:46:48.901664+0000","last_fullsized":"2024-02-19T21:46:48.901664+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_clean_scrub_stamp":"2024-02-19T21:44:13.678341+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":853,"num_read_kb":848,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":312,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.429990+0000","last_change":"2024-02-19T21:45:55.195479+0000","last_active":"2024-02-19T21:46:46.429990+0000","last_peered":"2024-02-19T21:46:46.429990+0000","last_clean":"2024-02-19T21:46:46.429990+0000","last_became_active":"2024-02-19T21:39:39.468113+0000","last_became_peered":"2024-02-19T21:39:39.468113+0000","last_unstale":"2024-02-19T21:46:46.429990+0000","last_undegraded":"2024-02-19T21:46:46.429990+0000","last_fullsized":"2024-02-19T21:46:46.429990+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:55.195394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.195394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"200'17","reported_seq":364,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.430658+0000","last_change":"2024-02-19T21:44:00.545486+0000","last_active":"2024-02-19T21:46:43.430658+0000","last_peered":"2024-02-19T21:46:43.430658+0000","last_clean":"2024-02-19T21:46:43.430658+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:46:43.430658+0000","last_undegraded":"2024-02-19T21:46:43.430658+0000","last_fullsized":"2024-02-19T21:46:43.430658+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'17","last_scrub_stamp":"2024-02-19T21:44:00.545415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:00.545415+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":25,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":211,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.435981+0000","last_change":"2024-02-19T21:45:10.871326+0000","last_active":"2024-02-19T21:46:43.435981+0000","last_peered":"2024-02-19T21:46:43.435981+0000","last_clean":"2024-02-19T21:46:43.435981+0000","last_became_active":"2024-02-19T21:44:46.148156+0000","last_became_peered":"2024-02-19T21:44:46.148156+0000","last_unstale":"2024-02-19T21:46:43.435981+0000","last_undegraded":"2024-02-19T21:46:43.435981+0000","last_fullsized":"2024-02-19T21:46:43.435981+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":299,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:10.871111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:10.871111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"338'11337","reported_seq":11415,"reported_epoch":338,"state":"active+clean","last_fresh":"2024-02-19T21:46:50.319658+0000","last_change":"2024-02-19T21:44:16.115922+0000","last_active":"2024-02-19T21:46:50.319658+0000","last_peered":"2024-02-19T21:46:50.319658+0000","last_clean":"2024-02-19T21:46:50.319658+0000","last_became_active":"2024-02-19T21:44:16.115625+0000","last_became_peered":"2024-02-19T21:44:16.115625+0000","last_unstale":"2024-02-19T21:46:50.319658+0000","last_undegraded":"2024-02-19T21:46:50.319658+0000","last_fullsized":"2024-02-19T21:46:50.319658+0000","mapping_epoch":268,"log_start":"320'7000","ondisk_log_start":"320'7000","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4337,"ondisk_log_size":4337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":320667648,"num_objects":4893,"num_object_clones":0,"num_object_copies":14679,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4893,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11337,"num_write_kb":519360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":332,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.433954+0000","last_change":"2024-02-19T21:46:04.035224+0000","last_active":"2024-02-19T21:46:43.433954+0000","last_peered":"2024-02-19T21:46:43.433954+0000","last_clean":"2024-02-19T21:46:43.433954+0000","last_became_active":"2024-02-19T21:44:56.157241+0000","last_became_peered":"2024-02-19T21:44:56.157241+0000","last_unstale":"2024-02-19T21:46:43.433954+0000","last_undegraded":"2024-02-19T21:46:43.433954+0000","last_fullsized":"2024-02-19T21:46:43.433954+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.035136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":214,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.441919+0000","last_change":"2024-02-19T21:45:04.833554+0000","last_active":"2024-02-19T21:46:43.441919+0000","last_peered":"2024-02-19T21:46:43.441919+0000","last_clean":"2024-02-19T21:46:43.441919+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:46:43.441919+0000","last_undegraded":"2024-02-19T21:46:43.441919+0000","last_fullsized":"2024-02-19T21:46:43.441919+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:04.833413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.833413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":329,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.433046+0000","last_change":"2024-02-19T21:45:07.901315+0000","last_active":"2024-02-19T21:46:43.433046+0000","last_peered":"2024-02-19T21:46:43.433046+0000","last_clean":"2024-02-19T21:46:43.433046+0000","last_became_active":"2024-02-19T21:42:04.212730+0000","last_became_peered":"2024-02-19T21:42:04.212730+0000","last_unstale":"2024-02-19T21:46:43.433046+0000","last_undegraded":"2024-02-19T21:46:43.433046+0000","last_fullsized":"2024-02-19T21:46:43.433046+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:07.901205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:07.901205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":193,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.429884+0000","last_change":"2024-02-19T21:45:16.190287+0000","last_active":"2024-02-19T21:46:46.429884+0000","last_peered":"2024-02-19T21:46:46.429884+0000","last_clean":"2024-02-19T21:46:46.429884+0000","last_became_active":"2024-02-19T21:42:04.196943+0000","last_became_peered":"2024-02-19T21:42:04.196943+0000","last_unstale":"2024-02-19T21:46:46.429884+0000","last_undegraded":"2024-02-19T21:46:46.429884+0000","last_fullsized":"2024-02-19T21:46:46.429884+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.190177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.190177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,1],"acting":[0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"201'33","reported_seq":362,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:47.970066+0000","last_change":"2024-02-19T21:46:47.970066+0000","last_active":"2024-02-19T21:46:47.970066+0000","last_peered":"2024-02-19T21:46:47.970066+0000","last_clean":"2024-02-19T21:46:47.970066+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:46:47.970066+0000","last_undegraded":"2024-02-19T21:46:47.970066+0000","last_fullsized":"2024-02-19T21:46:47.970066+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'33","last_scrub_stamp":"2024-02-19T21:46:47.969961+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.969961+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":282,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.434417+0000","last_change":"2024-02-19T21:44:57.754550+0000","last_active":"2024-02-19T21:46:43.434417+0000","last_peered":"2024-02-19T21:46:43.434417+0000","last_clean":"2024-02-19T21:46:43.434417+0000","last_became_active":"2024-02-19T21:42:04.205342+0000","last_became_peered":"2024-02-19T21:42:04.205342+0000","last_unstale":"2024-02-19T21:46:43.434417+0000","last_undegraded":"2024-02-19T21:46:43.434417+0000","last_fullsized":"2024-02-19T21:46:43.434417+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:57.754453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:57.754453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"338'10899","reported_seq":10977,"reported_epoch":338,"state":"active+clean","last_fresh":"2024-02-19T21:46:50.332257+0000","last_change":"2024-02-19T21:44:16.117097+0000","last_active":"2024-02-19T21:46:50.332257+0000","last_peered":"2024-02-19T21:46:50.332257+0000","last_clean":"2024-02-19T21:46:50.332257+0000","last_became_active":"2024-02-19T21:44:16.116833+0000","last_became_peered":"2024-02-19T21:44:16.116833+0000","last_unstale":"2024-02-19T21:46:50.332257+0000","last_undegraded":"2024-02-19T21:46:50.332257+0000","last_fullsized":"2024-02-19T21:46:50.332257+0000","mapping_epoch":268,"log_start":"320'6600","ondisk_log_start":"320'6600","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4299,"ondisk_log_size":4299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":308871168,"num_objects":4713,"num_object_clones":0,"num_object_copies":14139,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4713,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10899,"num_write_kb":499584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":310,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.427712+0000","last_change":"2024-02-19T21:45:47.723650+0000","last_active":"2024-02-19T21:46:43.427712+0000","last_peered":"2024-02-19T21:46:43.427712+0000","last_clean":"2024-02-19T21:46:43.427712+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:46:43.427712+0000","last_undegraded":"2024-02-19T21:46:43.427712+0000","last_fullsized":"2024-02-19T21:46:43.427712+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.723550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.723550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":322,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.431084+0000","last_change":"2024-02-19T21:45:51.243726+0000","last_active":"2024-02-19T21:46:46.431084+0000","last_peered":"2024-02-19T21:46:46.431084+0000","last_clean":"2024-02-19T21:46:46.431084+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:46:46.431084+0000","last_undegraded":"2024-02-19T21:46:46.431084+0000","last_fullsized":"2024-02-19T21:46:46.431084+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:51.243656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:51.243656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":334,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.424877+0000","last_change":"2024-02-19T21:45:56.289296+0000","last_active":"2024-02-19T21:46:43.424877+0000","last_peered":"2024-02-19T21:46:43.424877+0000","last_clean":"2024-02-19T21:46:43.424877+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:46:43.424877+0000","last_undegraded":"2024-02-19T21:46:43.424877+0000","last_fullsized":"2024-02-19T21:46:43.424877+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:56.289200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:56.289200+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"324'30","reported_seq":428,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.430249+0000","last_change":"2024-02-19T21:46:08.111065+0000","last_active":"2024-02-19T21:46:46.430249+0000","last_peered":"2024-02-19T21:46:46.430249+0000","last_clean":"2024-02-19T21:46:46.430249+0000","last_became_active":"2024-02-19T21:42:04.206790+0000","last_became_peered":"2024-02-19T21:42:04.206790+0000","last_unstale":"2024-02-19T21:46:46.430249+0000","last_undegraded":"2024-02-19T21:46:46.430249+0000","last_fullsized":"2024-02-19T21:46:46.430249+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'30","last_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_deep_scrub":"324'30","last_deep_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.110965+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":325,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.433880+0000","last_change":"2024-02-19T21:45:09.918263+0000","last_active":"2024-02-19T21:46:43.433880+0000","last_peered":"2024-02-19T21:46:43.433880+0000","last_clean":"2024-02-19T21:46:43.433880+0000","last_became_active":"2024-02-19T21:44:42.624782+0000","last_became_peered":"2024-02-19T21:44:42.624782+0000","last_unstale":"2024-02-19T21:46:43.433880+0000","last_undegraded":"2024-02-19T21:46:43.433880+0000","last_fullsized":"2024-02-19T21:46:43.433880+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":295,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_clean_scrub_stamp":"2024-02-19T21:45:09.918170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.e","version":"337'14868","reported_seq":14953,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:50.074116+0000","last_change":"2024-02-19T21:46:41.140784+0000","last_active":"2024-02-19T21:46:50.074116+0000","last_peered":"2024-02-19T21:46:50.074116+0000","last_clean":"2024-02-19T21:46:50.074116+0000","last_became_active":"2024-02-19T21:44:16.118651+0000","last_became_peered":"2024-02-19T21:44:16.118651+0000","last_unstale":"2024-02-19T21:46:50.074116+0000","last_undegraded":"2024-02-19T21:46:50.074116+0000","last_fullsized":"2024-02-19T21:46:50.074116+0000","mapping_epoch":268,"log_start":"325'9900","ondisk_log_start":"325'9900","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"334'14284","last_scrub_stamp":"2024-02-19T21:46:41.140692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:46:41.140692+0000","log_size":4968,"ondisk_log_size":4968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":317652992,"num_objects":4847,"num_object_clones":0,"num_object_copies":14541,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4847,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11105,"num_write_kb":510464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":319,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.426870+0000","last_change":"2024-02-19T21:44:55.803955+0000","last_active":"2024-02-19T21:46:43.426870+0000","last_peered":"2024-02-19T21:46:43.426870+0000","last_clean":"2024-02-19T21:46:43.426870+0000","last_became_active":"2024-02-19T21:42:04.193058+0000","last_became_peered":"2024-02-19T21:42:04.193058+0000","last_unstale":"2024-02-19T21:46:43.426870+0000","last_undegraded":"2024-02-19T21:46:43.426870+0000","last_fullsized":"2024-02-19T21:46:43.426870+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:55.803876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:44:55.803876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":310,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:45.017829+0000","last_change":"2024-02-19T21:46:45.017787+0000","last_active":"2024-02-19T21:46:45.017829+0000","last_peered":"2024-02-19T21:46:45.017829+0000","last_clean":"2024-02-19T21:46:45.017829+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:46:45.017829+0000","last_undegraded":"2024-02-19T21:46:45.017829+0000","last_fullsized":"2024-02-19T21:46:45.017829+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.017696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:45.017696+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.017696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"201'37","reported_seq":370,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.430324+0000","last_change":"2024-02-19T21:45:14.173212+0000","last_active":"2024-02-19T21:46:46.430324+0000","last_peered":"2024-02-19T21:46:46.430324+0000","last_clean":"2024-02-19T21:46:46.430324+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:46:46.430324+0000","last_undegraded":"2024-02-19T21:46:46.430324+0000","last_fullsized":"2024-02-19T21:46:46.430324+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'37","last_scrub_stamp":"2024-02-19T21:45:14.173134+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:45:14.173134+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":313,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:48.988928+0000","last_change":"2024-02-19T21:46:48.988928+0000","last_active":"2024-02-19T21:46:48.988928+0000","last_peered":"2024-02-19T21:46:48.988928+0000","last_clean":"2024-02-19T21:46:48.988928+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:46:48.988928+0000","last_undegraded":"2024-02-19T21:46:48.988928+0000","last_fullsized":"2024-02-19T21:46:48.988928+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:48.988836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.988836+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"337'11313","reported_seq":11391,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:50.120880+0000","last_change":"2024-02-19T21:44:16.121994+0000","last_active":"2024-02-19T21:46:50.120880+0000","last_peered":"2024-02-19T21:46:50.120880+0000","last_clean":"2024-02-19T21:46:50.120880+0000","last_became_active":"2024-02-19T21:44:16.121703+0000","last_became_peered":"2024-02-19T21:44:16.121703+0000","last_unstale":"2024-02-19T21:46:50.120880+0000","last_undegraded":"2024-02-19T21:46:50.120880+0000","last_fullsized":"2024-02-19T21:46:50.120880+0000","mapping_epoch":268,"log_start":"322'7300","ondisk_log_start":"322'7300","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4013,"ondisk_log_size":4013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":325582872,"num_objects":4969,"num_object_clones":0,"num_object_copies":14907,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4969,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11313,"num_write_kb":520961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":212,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.426952+0000","last_change":"2024-02-19T21:46:04.080973+0000","last_active":"2024-02-19T21:46:43.426952+0000","last_peered":"2024-02-19T21:46:43.426952+0000","last_clean":"2024-02-19T21:46:43.426952+0000","last_became_active":"2024-02-19T21:42:04.200292+0000","last_became_peered":"2024-02-19T21:42:04.200292+0000","last_unstale":"2024-02-19T21:46:43.426952+0000","last_undegraded":"2024-02-19T21:46:43.426952+0000","last_fullsized":"2024-02-19T21:46:43.426952+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.080896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.080896+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,5],"acting":[6,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":309,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.429014+0000","last_change":"2024-02-19T21:44:14.690800+0000","last_active":"2024-02-19T21:46:43.429014+0000","last_peered":"2024-02-19T21:46:43.429014+0000","last_clean":"2024-02-19T21:46:43.429014+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:46:43.429014+0000","last_undegraded":"2024-02-19T21:46:43.429014+0000","last_fullsized":"2024-02-19T21:46:43.429014+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:14.690736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:44:14.690736+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"201'38","reported_seq":291,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.430705+0000","last_change":"2024-02-19T21:45:05.077354+0000","last_active":"2024-02-19T21:46:46.430705+0000","last_peered":"2024-02-19T21:46:46.430705+0000","last_clean":"2024-02-19T21:46:46.430705+0000","last_became_active":"2024-02-19T21:42:04.205907+0000","last_became_peered":"2024-02-19T21:42:04.205907+0000","last_unstale":"2024-02-19T21:46:46.430705+0000","last_undegraded":"2024-02-19T21:46:46.430705+0000","last_fullsized":"2024-02-19T21:46:46.430705+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'38","last_scrub_stamp":"2024-02-19T21:45:05.077057+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:45:05.077057+0000","log_size":38,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":195,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.427281+0000","last_change":"2024-02-19T21:45:20.935817+0000","last_active":"2024-02-19T21:46:43.427281+0000","last_peered":"2024-02-19T21:46:43.427281+0000","last_clean":"2024-02-19T21:46:43.427281+0000","last_became_active":"2024-02-19T21:42:04.200496+0000","last_became_peered":"2024-02-19T21:42:04.200496+0000","last_unstale":"2024-02-19T21:46:43.427281+0000","last_undegraded":"2024-02-19T21:46:43.427281+0000","last_fullsized":"2024-02-19T21:46:43.427281+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:20.935723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.935723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"337'11163","reported_seq":11252,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:49.995693+0000","last_change":"2024-02-19T21:46:38.420994+0000","last_active":"2024-02-19T21:46:49.995693+0000","last_peered":"2024-02-19T21:46:49.995693+0000","last_clean":"2024-02-19T21:46:49.995693+0000","last_became_active":"2024-02-19T21:44:16.118628+0000","last_became_peered":"2024-02-19T21:44:16.118628+0000","last_unstale":"2024-02-19T21:46:49.995693+0000","last_undegraded":"2024-02-19T21:46:49.995693+0000","last_fullsized":"2024-02-19T21:46:49.995693+0000","mapping_epoch":268,"log_start":"301'3000","ondisk_log_start":"301'3000","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"333'10404","last_scrub_stamp":"2024-02-19T21:46:38.420901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:46:38.420901+0000","log_size":8163,"ondisk_log_size":8163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":325779456,"num_objects":4971,"num_object_clones":0,"num_object_copies":14913,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4971,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11163,"num_write_kb":516288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":320,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:49.110186+0000","last_change":"2024-02-19T21:46:49.110186+0000","last_active":"2024-02-19T21:46:49.110186+0000","last_peered":"2024-02-19T21:46:49.110186+0000","last_clean":"2024-02-19T21:46:49.110186+0000","last_became_active":"2024-02-19T21:39:39.481908+0000","last_became_peered":"2024-02-19T21:39:39.481908+0000","last_unstale":"2024-02-19T21:46:49.110186+0000","last_undegraded":"2024-02-19T21:46:49.110186+0000","last_fullsized":"2024-02-19T21:46:49.110186+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:49.110117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:49.110117+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":328,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.428791+0000","last_change":"2024-02-19T21:45:12.972456+0000","last_active":"2024-02-19T21:46:43.428791+0000","last_peered":"2024-02-19T21:46:43.428791+0000","last_clean":"2024-02-19T21:46:43.428791+0000","last_became_active":"2024-02-19T21:42:04.197048+0000","last_became_peered":"2024-02-19T21:42:04.197048+0000","last_unstale":"2024-02-19T21:46:43.428791+0000","last_undegraded":"2024-02-19T21:46:43.428791+0000","last_fullsized":"2024-02-19T21:46:43.428791+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.972369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.972369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"201'28","reported_seq":325,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.432328+0000","last_change":"2024-02-19T21:45:55.998742+0000","last_active":"2024-02-19T21:46:43.432328+0000","last_peered":"2024-02-19T21:46:43.432328+0000","last_clean":"2024-02-19T21:46:43.432328+0000","last_became_active":"2024-02-19T21:35:14.513806+0000","last_became_peered":"2024-02-19T21:35:14.513806+0000","last_unstale":"2024-02-19T21:46:43.432328+0000","last_undegraded":"2024-02-19T21:46:43.432328+0000","last_fullsized":"2024-02-19T21:46:43.432328+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'28","last_scrub_stamp":"2024-02-19T21:45:55.998646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.998646+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":34,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":345,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.438928+0000","last_change":"2024-02-19T21:45:50.742626+0000","last_active":"2024-02-19T21:46:46.438928+0000","last_peered":"2024-02-19T21:46:46.438928+0000","last_clean":"2024-02-19T21:46:46.438928+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:46:46.438928+0000","last_undegraded":"2024-02-19T21:46:46.438928+0000","last_fullsized":"2024-02-19T21:46:46.438928+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'9","last_scrub_stamp":"2024-02-19T21:45:50.742526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:50.742526+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"337'11332","reported_seq":11409,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:50.079312+0000","last_change":"2024-02-19T21:44:16.122360+0000","last_active":"2024-02-19T21:46:50.079312+0000","last_peered":"2024-02-19T21:46:50.079312+0000","last_clean":"2024-02-19T21:46:50.079312+0000","last_became_active":"2024-02-19T21:44:16.122083+0000","last_became_peered":"2024-02-19T21:44:16.122083+0000","last_unstale":"2024-02-19T21:46:50.079312+0000","last_undegraded":"2024-02-19T21:46:50.079312+0000","last_fullsized":"2024-02-19T21:46:50.079312+0000","mapping_epoch":268,"log_start":"322'7300","ondisk_log_start":"322'7300","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4032,"ondisk_log_size":4032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":316669952,"num_objects":4832,"num_object_clones":0,"num_object_copies":14496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4832,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11332,"num_write_kb":517248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"66'1","reported_seq":222,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.427298+0000","last_change":"2024-02-19T21:45:50.004404+0000","last_active":"2024-02-19T21:46:43.427298+0000","last_peered":"2024-02-19T21:46:43.427298+0000","last_clean":"2024-02-19T21:46:43.427298+0000","last_became_active":"2024-02-19T21:44:56.166670+0000","last_became_peered":"2024-02-19T21:44:56.166670+0000","last_unstale":"2024-02-19T21:46:43.427298+0000","last_undegraded":"2024-02-19T21:46:43.427298+0000","last_fullsized":"2024-02-19T21:46:43.427298+0000","mapping_epoch":165,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:45:50.004305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:45:50.004305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"261'11","reported_seq":358,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.443605+0000","last_change":"2024-02-19T21:45:01.716882+0000","last_active":"2024-02-19T21:46:46.443605+0000","last_peered":"2024-02-19T21:46:46.443605+0000","last_clean":"2024-02-19T21:46:46.443605+0000","last_became_active":"2024-02-19T21:44:08.123392+0000","last_became_peered":"2024-02-19T21:44:08.123392+0000","last_unstale":"2024-02-19T21:46:46.443605+0000","last_undegraded":"2024-02-19T21:46:46.443605+0000","last_fullsized":"2024-02-19T21:46:46.443605+0000","mapping_epoch":62,"log_start":"257'10","ondisk_log_start":"257'10","created":62,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-02-19T21:45:01.716817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.716817+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":317,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.424952+0000","last_change":"2024-02-19T21:45:08.496668+0000","last_active":"2024-02-19T21:46:43.424952+0000","last_peered":"2024-02-19T21:46:43.424952+0000","last_clean":"2024-02-19T21:46:43.424952+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:46:43.424952+0000","last_undegraded":"2024-02-19T21:46:43.424952+0000","last_fullsized":"2024-02-19T21:46:43.424952+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:45:08.496566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:08.496566+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"201'19","reported_seq":343,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.428339+0000","last_change":"2024-02-19T21:46:43.088836+0000","last_active":"2024-02-19T21:46:43.428339+0000","last_peered":"2024-02-19T21:46:43.428339+0000","last_clean":"2024-02-19T21:46:43.428339+0000","last_became_active":"2024-02-19T21:39:51.536649+0000","last_became_peered":"2024-02-19T21:39:51.536649+0000","last_unstale":"2024-02-19T21:46:43.428339+0000","last_undegraded":"2024-02-19T21:46:43.428339+0000","last_fullsized":"2024-02-19T21:46:43.428339+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:46:43.088737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:46:43.088737+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2","version":"337'11129","reported_seq":11205,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:50.133210+0000","last_change":"2024-02-19T21:44:16.115513+0000","last_active":"2024-02-19T21:46:50.133210+0000","last_peered":"2024-02-19T21:46:50.133210+0000","last_clean":"2024-02-19T21:46:50.133210+0000","last_became_active":"2024-02-19T21:44:16.115219+0000","last_became_peered":"2024-02-19T21:44:16.115219+0000","last_unstale":"2024-02-19T21:46:50.133210+0000","last_undegraded":"2024-02-19T21:46:50.133210+0000","last_fullsized":"2024-02-19T21:46:50.133210+0000","mapping_epoch":268,"log_start":"321'7100","ondisk_log_start":"321'7100","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4029,"ondisk_log_size":4029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":326041600,"num_objects":4975,"num_object_clones":0,"num_object_copies":14925,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4975,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11129,"num_write_kb":515328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,6],"acting":[1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":334,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.433389+0000","last_change":"2024-02-19T21:46:01.031458+0000","last_active":"2024-02-19T21:46:43.433389+0000","last_peered":"2024-02-19T21:46:43.433389+0000","last_clean":"2024-02-19T21:46:43.433389+0000","last_became_active":"2024-02-19T21:44:56.155194+0000","last_became_peered":"2024-02-19T21:44:56.155194+0000","last_unstale":"2024-02-19T21:46:43.433389+0000","last_undegraded":"2024-02-19T21:46:43.433389+0000","last_fullsized":"2024-02-19T21:46:43.433389+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.031344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.031344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"265'11","reported_seq":455,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.441191+0000","last_change":"2024-02-19T21:45:15.802207+0000","last_active":"2024-02-19T21:46:46.441191+0000","last_peered":"2024-02-19T21:46:46.441191+0000","last_clean":"2024-02-19T21:46:46.441191+0000","last_became_active":"2024-02-19T21:44:12.205049+0000","last_became_peered":"2024-02-19T21:44:12.205049+0000","last_unstale":"2024-02-19T21:46:46.441191+0000","last_undegraded":"2024-02-19T21:46:46.441191+0000","last_fullsized":"2024-02-19T21:46:46.441191+0000","mapping_epoch":97,"log_start":"98'9","ondisk_log_start":"98'9","created":62,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'11","last_scrub_stamp":"2024-02-19T21:45:15.802126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:15.802126+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":312,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.426790+0000","last_change":"2024-02-19T21:45:16.700970+0000","last_active":"2024-02-19T21:46:43.426790+0000","last_peered":"2024-02-19T21:46:43.426790+0000","last_clean":"2024-02-19T21:46:43.426790+0000","last_became_active":"2024-02-19T21:32:23.362738+0000","last_became_peered":"2024-02-19T21:32:23.362738+0000","last_unstale":"2024-02-19T21:46:43.426790+0000","last_undegraded":"2024-02-19T21:46:43.426790+0000","last_fullsized":"2024-02-19T21:46:43.426790+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.700887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.700887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"270'34","reported_seq":233,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:44.789446+0000","last_change":"2024-02-19T21:46:44.789402+0000","last_active":"2024-02-19T21:46:44.789446+0000","last_peered":"2024-02-19T21:46:44.789446+0000","last_clean":"2024-02-19T21:46:44.789446+0000","last_became_active":"2024-02-19T21:39:51.539230+0000","last_became_peered":"2024-02-19T21:39:51.539230+0000","last_unstale":"2024-02-19T21:46:44.789446+0000","last_undegraded":"2024-02-19T21:46:44.789446+0000","last_fullsized":"2024-02-19T21:46:44.789446+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"270'34","last_scrub_stamp":"2024-02-19T21:46:44.789309+0000","last_deep_scrub":"270'34","last_deep_scrub_stamp":"2024-02-19T21:44:17.451151+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.789309+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"337'11117","reported_seq":11197,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:49.963835+0000","last_change":"2024-02-19T21:45:55.152452+0000","last_active":"2024-02-19T21:46:49.963835+0000","last_peered":"2024-02-19T21:46:49.963835+0000","last_clean":"2024-02-19T21:46:49.963835+0000","last_became_active":"2024-02-19T21:44:16.116428+0000","last_became_peered":"2024-02-19T21:44:16.116428+0000","last_unstale":"2024-02-19T21:46:49.963835+0000","last_undegraded":"2024-02-19T21:46:49.963835+0000","last_fullsized":"2024-02-19T21:46:49.963835+0000","mapping_epoch":268,"log_start":"290'1100","ondisk_log_start":"290'1100","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"322'7477","last_scrub_stamp":"2024-02-19T21:45:55.152354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.152354+0000","log_size":10017,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":320929792,"num_objects":4897,"num_object_clones":0,"num_object_copies":14691,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4897,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11117,"num_write_kb":512448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4],"acting":[3,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":302,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.429214+0000","last_change":"2024-02-19T21:46:02.939504+0000","last_active":"2024-02-19T21:46:43.429214+0000","last_peered":"2024-02-19T21:46:43.429214+0000","last_clean":"2024-02-19T21:46:43.429214+0000","last_became_active":"2024-02-19T21:44:56.140445+0000","last_became_peered":"2024-02-19T21:44:56.140445+0000","last_unstale":"2024-02-19T21:46:43.429214+0000","last_undegraded":"2024-02-19T21:46:43.429214+0000","last_fullsized":"2024-02-19T21:46:43.429214+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.939414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.939414+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"271'13","reported_seq":386,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:47.073096+0000","last_change":"2024-02-19T21:46:47.073096+0000","last_active":"2024-02-19T21:46:47.073096+0000","last_peered":"2024-02-19T21:46:47.073096+0000","last_clean":"2024-02-19T21:46:47.073096+0000","last_became_active":"2024-02-19T21:44:18.115023+0000","last_became_peered":"2024-02-19T21:44:18.115023+0000","last_unstale":"2024-02-19T21:46:47.073096+0000","last_undegraded":"2024-02-19T21:46:47.073096+0000","last_fullsized":"2024-02-19T21:46:47.073096+0000","mapping_epoch":266,"log_start":"170'11","ondisk_log_start":"170'11","created":62,"last_epoch_clean":271,"parent":"0.0","parent_split_bits":0,"last_scrub":"271'13","last_scrub_stamp":"2024-02-19T21:46:47.072988+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.072988+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":309,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.427125+0000","last_change":"2024-02-19T21:45:00.765546+0000","last_active":"2024-02-19T21:46:43.427125+0000","last_peered":"2024-02-19T21:46:43.427125+0000","last_clean":"2024-02-19T21:46:43.427125+0000","last_became_active":"2024-02-19T21:32:23.363155+0000","last_became_peered":"2024-02-19T21:32:23.363155+0000","last_unstale":"2024-02-19T21:46:43.427125+0000","last_undegraded":"2024-02-19T21:46:43.427125+0000","last_fullsized":"2024-02-19T21:46:43.427125+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:00.765453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:45:00.765453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"200'20","reported_seq":311,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.428262+0000","last_change":"2024-02-19T21:45:01.568565+0000","last_active":"2024-02-19T21:46:43.428262+0000","last_peered":"2024-02-19T21:46:43.428262+0000","last_clean":"2024-02-19T21:46:43.428262+0000","last_became_active":"2024-02-19T21:35:14.514968+0000","last_became_peered":"2024-02-19T21:35:14.514968+0000","last_unstale":"2024-02-19T21:46:43.428262+0000","last_undegraded":"2024-02-19T21:46:43.428262+0000","last_fullsized":"2024-02-19T21:46:43.428262+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'20","last_scrub_stamp":"2024-02-19T21:45:01.568503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.568503+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6],"acting":[3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"337'11163","reported_seq":11240,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:50.112654+0000","last_change":"2024-02-19T21:44:16.117207+0000","last_active":"2024-02-19T21:46:50.112654+0000","last_peered":"2024-02-19T21:46:50.112654+0000","last_clean":"2024-02-19T21:46:50.112654+0000","last_became_active":"2024-02-19T21:44:16.116913+0000","last_became_peered":"2024-02-19T21:44:16.116913+0000","last_unstale":"2024-02-19T21:46:50.112654+0000","last_undegraded":"2024-02-19T21:46:50.112654+0000","last_fullsized":"2024-02-19T21:46:50.112654+0000","mapping_epoch":268,"log_start":"321'7100","ondisk_log_start":"321'7100","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4063,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":317521920,"num_objects":4845,"num_object_clones":0,"num_object_copies":14535,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4845,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11163,"num_write_kb":512256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,0],"acting":[1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":86,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.430190+0000","last_change":"2024-02-19T21:46:02.241408+0000","last_active":"2024-02-19T21:46:46.430190+0000","last_peered":"2024-02-19T21:46:46.430190+0000","last_clean":"2024-02-19T21:46:46.430190+0000","last_became_active":"2024-02-19T21:44:56.152672+0000","last_became_peered":"2024-02-19T21:44:56.152672+0000","last_unstale":"2024-02-19T21:46:46.430190+0000","last_undegraded":"2024-02-19T21:46:46.430190+0000","last_fullsized":"2024-02-19T21:46:46.430190+0000","mapping_epoch":275,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.241319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.241319+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,1],"acting":[0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":321,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.427696+0000","last_change":"2024-02-19T21:45:01.798485+0000","last_active":"2024-02-19T21:46:43.427696+0000","last_peered":"2024-02-19T21:46:43.427696+0000","last_clean":"2024-02-19T21:46:43.427696+0000","last_became_active":"2024-02-19T21:44:22.245925+0000","last_became_peered":"2024-02-19T21:44:22.245925+0000","last_unstale":"2024-02-19T21:46:43.427696+0000","last_undegraded":"2024-02-19T21:46:43.427696+0000","last_fullsized":"2024-02-19T21:46:43.427696+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:01.798387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.798387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":317,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.425357+0000","last_change":"2024-02-19T21:46:43.056478+0000","last_active":"2024-02-19T21:46:43.425357+0000","last_peered":"2024-02-19T21:46:43.425357+0000","last_clean":"2024-02-19T21:46:43.425357+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:46:43.425357+0000","last_undegraded":"2024-02-19T21:46:43.425357+0000","last_fullsized":"2024-02-19T21:46:43.425357+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:43.056400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:46:43.056400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"337'39","reported_seq":280,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:48.923913+0000","last_change":"2024-02-19T21:46:48.923913+0000","last_active":"2024-02-19T21:46:48.923913+0000","last_peered":"2024-02-19T21:46:48.923913+0000","last_clean":"2024-02-19T21:46:48.923913+0000","last_became_active":"2024-02-19T21:39:39.474668+0000","last_became_peered":"2024-02-19T21:39:39.474668+0000","last_unstale":"2024-02-19T21:46:48.923913+0000","last_undegraded":"2024-02-19T21:46:48.923913+0000","last_fullsized":"2024-02-19T21:46:48.923913+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'39","last_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_deep_scrub":"337'39","last_deep_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.923809+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":49,"num_read_kb":39,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"337'11272","reported_seq":11349,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:50.075610+0000","last_change":"2024-02-19T21:44:16.117971+0000","last_active":"2024-02-19T21:46:50.075610+0000","last_peered":"2024-02-19T21:46:50.075610+0000","last_clean":"2024-02-19T21:46:50.075610+0000","last_became_active":"2024-02-19T21:44:16.117603+0000","last_became_peered":"2024-02-19T21:44:16.117603+0000","last_unstale":"2024-02-19T21:46:50.075610+0000","last_undegraded":"2024-02-19T21:46:50.075610+0000","last_fullsized":"2024-02-19T21:46:50.075610+0000","mapping_epoch":268,"log_start":"321'7100","ondisk_log_start":"321'7100","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4172,"ondisk_log_size":4172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":318636032,"num_objects":4862,"num_object_clones":0,"num_object_copies":14586,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4862,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11272,"num_write_kb":516288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"66'1","reported_seq":318,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.773605+0000","last_change":"2024-02-19T21:46:43.773570+0000","last_active":"2024-02-19T21:46:43.773605+0000","last_peered":"2024-02-19T21:46:43.773605+0000","last_clean":"2024-02-19T21:46:43.773605+0000","last_became_active":"2024-02-19T21:44:56.145343+0000","last_became_peered":"2024-02-19T21:44:56.145343+0000","last_unstale":"2024-02-19T21:46:43.773605+0000","last_undegraded":"2024-02-19T21:46:43.773605+0000","last_fullsized":"2024-02-19T21:46:43.773605+0000","mapping_epoch":197,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:46:43.773486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:46:43.773486+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":221,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.430244+0000","last_change":"2024-02-19T21:45:12.163918+0000","last_active":"2024-02-19T21:46:46.430244+0000","last_peered":"2024-02-19T21:46:46.430244+0000","last_clean":"2024-02-19T21:46:46.430244+0000","last_became_active":"2024-02-19T21:44:26.881695+0000","last_became_peered":"2024-02-19T21:44:26.881695+0000","last_unstale":"2024-02-19T21:46:46.430244+0000","last_undegraded":"2024-02-19T21:46:46.430244+0000","last_fullsized":"2024-02-19T21:46:46.430244+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":279,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.163825+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":206,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.434463+0000","last_change":"2024-02-19T21:45:00.748363+0000","last_active":"2024-02-19T21:46:43.434463+0000","last_peered":"2024-02-19T21:46:43.434463+0000","last_clean":"2024-02-19T21:46:43.434463+0000","last_became_active":"2024-02-19T21:39:39.479752+0000","last_became_peered":"2024-02-19T21:39:39.479752+0000","last_unstale":"2024-02-19T21:46:43.434463+0000","last_undegraded":"2024-02-19T21:46:43.434463+0000","last_fullsized":"2024-02-19T21:46:43.434463+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:45:00.748244+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:45:00.748244+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"201'44","reported_seq":408,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.427293+0000","last_change":"2024-02-19T21:46:05.098302+0000","last_active":"2024-02-19T21:46:43.427293+0000","last_peered":"2024-02-19T21:46:43.427293+0000","last_clean":"2024-02-19T21:46:43.427293+0000","last_became_active":"2024-02-19T21:42:04.200393+0000","last_became_peered":"2024-02-19T21:42:04.200393+0000","last_unstale":"2024-02-19T21:46:43.427293+0000","last_undegraded":"2024-02-19T21:46:43.427293+0000","last_fullsized":"2024-02-19T21:46:43.427293+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'44","last_scrub_stamp":"2024-02-19T21:46:05.098198+0000","last_deep_scrub":"201'44","last_deep_scrub_stamp":"2024-02-19T21:44:16.255049+0000","last_clean_scrub_stamp":"2024-02-19T21:46:05.098198+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.6","version":"337'11413","reported_seq":11490,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:50.053981+0000","last_change":"2024-02-19T21:44:16.119031+0000","last_active":"2024-02-19T21:46:50.053981+0000","last_peered":"2024-02-19T21:46:50.053981+0000","last_clean":"2024-02-19T21:46:50.053981+0000","last_became_active":"2024-02-19T21:44:16.118369+0000","last_became_peered":"2024-02-19T21:44:16.118369+0000","last_unstale":"2024-02-19T21:46:50.053981+0000","last_undegraded":"2024-02-19T21:46:50.053981+0000","last_fullsized":"2024-02-19T21:46:50.053981+0000","mapping_epoch":268,"log_start":"321'7300","ondisk_log_start":"321'7300","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4113,"ondisk_log_size":4113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":321585152,"num_objects":4907,"num_object_clones":0,"num_object_copies":14721,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4907,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11413,"num_write_kb":522240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":343,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.430937+0000","last_change":"2024-02-19T21:46:01.176704+0000","last_active":"2024-02-19T21:46:46.430937+0000","last_peered":"2024-02-19T21:46:46.430937+0000","last_clean":"2024-02-19T21:46:46.430937+0000","last_became_active":"2024-02-19T21:44:56.140918+0000","last_became_peered":"2024-02-19T21:44:56.140918+0000","last_unstale":"2024-02-19T21:46:46.430937+0000","last_undegraded":"2024-02-19T21:46:46.430937+0000","last_fullsized":"2024-02-19T21:46:46.430937+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.176542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.176542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":321,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.426182+0000","last_change":"2024-02-19T21:46:06.123514+0000","last_active":"2024-02-19T21:46:43.426182+0000","last_peered":"2024-02-19T21:46:43.426182+0000","last_clean":"2024-02-19T21:46:43.426182+0000","last_became_active":"2024-02-19T21:44:30.337128+0000","last_became_peered":"2024-02-19T21:44:30.337128+0000","last_unstale":"2024-02-19T21:46:43.426182+0000","last_undegraded":"2024-02-19T21:46:43.426182+0000","last_fullsized":"2024-02-19T21:46:43.426182+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":283,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.123413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.547129+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.123413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1],"acting":[4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":312,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.978121+0000","last_change":"2024-02-19T21:46:46.978121+0000","last_active":"2024-02-19T21:46:46.978121+0000","last_peered":"2024-02-19T21:46:46.978121+0000","last_clean":"2024-02-19T21:46:46.978121+0000","last_became_active":"2024-02-19T21:32:23.357438+0000","last_became_peered":"2024-02-19T21:32:23.357438+0000","last_unstale":"2024-02-19T21:46:46.978121+0000","last_undegraded":"2024-02-19T21:46:46.978121+0000","last_fullsized":"2024-02-19T21:46:46.978121+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.978015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.978015+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"201'15","reported_seq":336,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.430498+0000","last_change":"2024-02-19T21:44:54.025887+0000","last_active":"2024-02-19T21:46:46.430498+0000","last_peered":"2024-02-19T21:46:46.430498+0000","last_clean":"2024-02-19T21:46:46.430498+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:46:46.430498+0000","last_undegraded":"2024-02-19T21:46:46.430498+0000","last_fullsized":"2024-02-19T21:46:46.430498+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'15","last_scrub_stamp":"2024-02-19T21:44:54.025808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:54.025808+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.5","version":"338'10968","reported_seq":11046,"reported_epoch":338,"state":"active+clean","last_fresh":"2024-02-19T21:46:50.335306+0000","last_change":"2024-02-19T21:44:16.115677+0000","last_active":"2024-02-19T21:46:50.335306+0000","last_peered":"2024-02-19T21:46:50.335306+0000","last_clean":"2024-02-19T21:46:50.335306+0000","last_became_active":"2024-02-19T21:44:16.115394+0000","last_became_peered":"2024-02-19T21:44:16.115394+0000","last_unstale":"2024-02-19T21:46:50.335306+0000","last_undegraded":"2024-02-19T21:46:50.335306+0000","last_fullsized":"2024-02-19T21:46:50.335306+0000","mapping_epoch":268,"log_start":"320'6600","ondisk_log_start":"320'6600","created":268,"last_epoch_clean":269,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.102141+0000","last_clean_scrub_stamp":"2024-02-19T21:44:15.102141+0000","log_size":4368,"ondisk_log_size":4368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":316145664,"num_objects":4824,"num_object_clones":0,"num_object_copies":14472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4824,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10968,"num_write_kb":505344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":332,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.441664+0000","last_change":"2024-02-19T21:46:01.981923+0000","last_active":"2024-02-19T21:46:43.441664+0000","last_peered":"2024-02-19T21:46:43.441664+0000","last_clean":"2024-02-19T21:46:43.441664+0000","last_became_active":"2024-02-19T21:44:56.160521+0000","last_became_peered":"2024-02-19T21:44:56.160521+0000","last_unstale":"2024-02-19T21:46:43.441664+0000","last_undegraded":"2024-02-19T21:46:43.441664+0000","last_fullsized":"2024-02-19T21:46:43.441664+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.981866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.981866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":267,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.428472+0000","last_change":"2024-02-19T21:45:09.932653+0000","last_active":"2024-02-19T21:46:43.428472+0000","last_peered":"2024-02-19T21:46:43.428472+0000","last_clean":"2024-02-19T21:46:43.428472+0000","last_became_active":"2024-02-19T21:42:04.199889+0000","last_became_peered":"2024-02-19T21:42:04.199889+0000","last_unstale":"2024-02-19T21:46:43.428472+0000","last_undegraded":"2024-02-19T21:46:43.428472+0000","last_fullsized":"2024-02-19T21:46:43.428472+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:09.932575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:45:09.932575+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"200'27","reported_seq":379,"reported_epoch":336,"state":"active+clean","last_fresh":"2024-02-19T21:46:43.432971+0000","last_change":"2024-02-19T21:44:55.762734+0000","last_active":"2024-02-19T21:46:43.432971+0000","last_peered":"2024-02-19T21:46:43.432971+0000","last_clean":"2024-02-19T21:46:43.432971+0000","last_became_active":"2024-02-19T21:42:04.212731+0000","last_became_peered":"2024-02-19T21:42:04.212731+0000","last_unstale":"2024-02-19T21:46:43.432971+0000","last_undegraded":"2024-02-19T21:46:43.432971+0000","last_fullsized":"2024-02-19T21:46:43.432971+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'27","last_scrub_stamp":"2024-02-19T21:44:55.762629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:55.762629+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"324'11","reported_seq":512,"reported_epoch":337,"state":"active+clean","last_fresh":"2024-02-19T21:46:46.436806+0000","last_change":"2024-02-19T21:46:05.210187+0000","last_active":"2024-02-19T21:46:46.436806+0000","last_peered":"2024-02-19T21:46:46.436806+0000","last_clean":"2024-02-19T21:46:46.436806+0000","last_became_active":"2024-02-19T21:44:34.385140+0000","last_became_peered":"2024-02-19T21:44:34.385140+0000","last_unstale":"2024-02-19T21:46:46.436806+0000","last_undegraded":"2024-02-19T21:46:46.436806+0000","last_fullsized":"2024-02-19T21:46:46.436806+0000","mapping_epoch":62,"log_start":"66'8","ondisk_log_start":"66'8","created":62,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'11","last_scrub_stamp":"2024-02-19T21:46:05.210095+0000","last_deep_scrub":"324'11","last_deep_scrub_stamp":"2024-02-19T21:46:05.210095+0000","last_clean_scrub_stamp":"2024-02-19T21:46:05.210095+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":5118361624,"num_objects":78101,"num_object_clones":0,"num_object_copies":234303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78101,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":179079,"num_write_kb":8229697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15362961408,"data_stored":15362949192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77242,"ondisk_log_size":77242,"up":48,"acting":48,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":853,"num_read_kb":848,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":389,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1116,"num_read_kb":873,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":3604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":764,"ondisk_log_size":764,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":22,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":47,"ondisk_log_size":47,"up":66,"acting":66,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":376,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201456,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1590176,"kb_used_data":1284760,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":92154976,"statfs":{"total":95995035648,"available":94366695424,"internally_reserved":0,"allocated":1315594240,"data_stored":1314870931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:46:37 2024","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":2.4340000000000002,"15min":1.5549999999999999},"min":{"1min":0.19,"5min":0.19,"15min":0.189},"max":{"1min":11.179,"5min":70.477999999999994,"15min":70.477999999999994},"last":0.26900000000000002},{"interface":"front","average":{"1min":3.5379999999999998,"5min":2.6720000000000002,"15min":1.7350000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.20999999999999999},"max":{"1min":8.593,"5min":68.052000000000007,"15min":68.052000000000007},"last":0.51200000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:46:37 2024","interfaces":[{"interface":"back","average":{"1min":2.6070000000000002,"5min":2.3969999999999998,"15min":1.784},"min":{"1min":0.26200000000000001,"5min":0.23799999999999999,"15min":0.23200000000000001},"max":{"1min":10.17,"5min":68.168000000000006,"15min":68.168000000000006},"last":0.40300000000000002},{"interface":"front","average":{"1min":3.4550000000000001,"5min":2.927,"15min":1.7270000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.223},"max":{"1min":8.0370000000000008,"5min":68.444000000000003,"15min":68.444000000000003},"last":0.48999999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:46:37 2024","interfaces":[{"interface":"back","average":{"1min":1.732,"5min":1.849,"15min":1.409},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.25700000000000001},"max":{"1min":11.239000000000001,"5min":11.239000000000001,"15min":11.239000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":2.238,"5min":1.619,"15min":1.492},"min":{"1min":0.29299999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":10.250999999999999,"5min":10.250999999999999,"15min":10.250999999999999},"last":0.434}]},{"osd":3,"last update":"Mon Feb 19 21:46:37 2024","interfaces":[{"interface":"back","average":{"1min":2.4710000000000001,"5min":2.113,"15min":1.8380000000000001},"min":{"1min":0.35299999999999998,"5min":0.29699999999999999,"15min":0.26900000000000002},"max":{"1min":11.263,"5min":11.263,"15min":31.559000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":2.044,"5min":1.7649999999999999,"15min":1.659},"min":{"1min":0.314,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":10.218,"5min":10.522,"15min":30.812999999999999},"last":0.45700000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:46:37 2024","interfaces":[{"interface":"back","average":{"1min":2.7669999999999999,"5min":2.0289999999999999,"15min":1.2330000000000001},"min":{"1min":0.255,"5min":0.216,"15min":0.216},"max":{"1min":8,"5min":14.208,"15min":14.208},"last":0.81599999999999995},{"interface":"front","average":{"1min":2.7559999999999998,"5min":2.2770000000000001,"15min":1.4430000000000001},"min":{"1min":0.28899999999999998,"5min":0.26500000000000001,"15min":0.245},"max":{"1min":17.690999999999999,"5min":17.690999999999999,"15min":17.690999999999999},"last":0.29799999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:46:37 2024","interfaces":[{"interface":"back","average":{"1min":2.0390000000000001,"5min":1.772,"15min":1.266},"min":{"1min":0.30499999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":10.329000000000001,"5min":10.329000000000001,"15min":10.329000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":2.7080000000000002,"5min":2.444,"15min":1.484},"min":{"1min":0.39400000000000002,"5min":0.29799999999999999,"15min":0.28799999999999998},"max":{"1min":8.1159999999999997,"5min":17.012,"15min":17.012},"last":0.625}]},{"osd":6,"last update":"Mon Feb 19 21:46:37 2024","interfaces":[{"interface":"back","average":{"1min":2.641,"5min":1.9510000000000001,"15min":1.242},"min":{"1min":0.34100000000000003,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":8.0899999999999999,"5min":14.177,"15min":14.177},"last":8.7390000000000008},{"interface":"front","average":{"1min":2.2869999999999999,"5min":2.194,"15min":1.496},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":11.214,"5min":12.913,"15min":12.913},"last":1.284}]}]},{"osd":6,"up_from":47,"seq":201863463095,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2800120,"kb_used_data":2498800,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":90945032,"statfs":{"total":95995035648,"available":93127712768,"internally_reserved":0,"allocated":2558771200,"data_stored":2558023375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:46:17 2024","interfaces":[{"interface":"back","average":{"1min":1.867,"5min":2.016,"15min":1.508},"min":{"1min":0.215,"5min":0.215,"15min":0.20599999999999999},"max":{"1min":6.2800000000000002,"5min":45.197000000000003,"15min":45.197000000000003},"last":0.36899999999999999},{"interface":"front","average":{"1min":1.845,"5min":2.2530000000000001,"15min":1.6619999999999999},"min":{"1min":0.377,"5min":0.23499999999999999,"15min":0.221},"max":{"1min":4.3639999999999999,"5min":44.753,"15min":44.753},"last":3.3460000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:46:17 2024","interfaces":[{"interface":"back","average":{"1min":2.1659999999999999,"5min":1.9239999999999999,"15min":1.454},"min":{"1min":0.27300000000000002,"5min":0.222,"15min":0.222},"max":{"1min":6.3440000000000003,"5min":45.231999999999999,"15min":45.231999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":1.849,"5min":2.04,"15min":1.4179999999999999},"min":{"1min":0.25800000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":5.8490000000000002,"5min":45.097999999999999,"15min":45.097999999999999},"last":1.6759999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:46:17 2024","interfaces":[{"interface":"back","average":{"1min":1.9399999999999999,"5min":1.6259999999999999,"15min":1.288},"min":{"1min":0.28999999999999998,"5min":0.28599999999999998,"15min":0.26800000000000002},"max":{"1min":7.6230000000000002,"5min":7.6920000000000002,"15min":8.3849999999999998},"last":1.8},{"interface":"front","average":{"1min":1.6919999999999999,"5min":1.522,"15min":1.331},"min":{"1min":0.29499999999999998,"5min":0.29299999999999998,"15min":0.27300000000000002},"max":{"1min":4.3979999999999997,"5min":8.5259999999999998,"15min":18.068000000000001},"last":3.4060000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:46:17 2024","interfaces":[{"interface":"back","average":{"1min":2.028,"5min":1.6519999999999999,"15min":1.3819999999999999},"min":{"1min":0.30399999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":6.3150000000000004,"5min":9.2699999999999996,"15min":11.15},"last":0.42099999999999999},{"interface":"front","average":{"1min":1.462,"5min":1.4690000000000001,"15min":1.327},"min":{"1min":0.316,"5min":0.26400000000000001,"15min":0.246},"max":{"1min":4.6500000000000004,"5min":8.5969999999999995,"15min":19.632999999999999},"last":1.714}]},{"osd":4,"last update":"Mon Feb 19 21:46:17 2024","interfaces":[{"interface":"back","average":{"1min":1.7070000000000001,"5min":1.905,"15min":1.2390000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.247},"max":{"1min":4.9870000000000001,"5min":14.254,"15min":14.254},"last":8.2230000000000008},{"interface":"front","average":{"1min":2.7210000000000001,"5min":2.2799999999999998,"15min":1.3540000000000001},"min":{"1min":0.30099999999999999,"5min":0.27500000000000002,"15min":0.23499999999999999},"max":{"1min":7.3330000000000002,"5min":14.055,"15min":16.594999999999999},"last":3.2599999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:46:17 2024","interfaces":[{"interface":"back","average":{"1min":2.3319999999999999,"5min":2.0910000000000002,"15min":1.296},"min":{"1min":0.28699999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":7.6139999999999999,"5min":14.223000000000001,"15min":14.223000000000001},"last":3.3799999999999999},{"interface":"front","average":{"1min":2.5659999999999998,"5min":2.323,"15min":1.4470000000000001},"min":{"1min":0.34300000000000003,"5min":0.30299999999999999,"15min":0.27900000000000003},"max":{"1min":7.0650000000000004,"5min":15.497999999999999,"15min":15.497999999999999},"last":3.2330000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:46:37 2024","interfaces":[{"interface":"back","average":{"1min":2.4940000000000002,"5min":2.27,"15min":1.4810000000000001},"min":{"1min":0.32700000000000001,"5min":0.317,"15min":0.26700000000000002},"max":{"1min":7.3739999999999997,"5min":11.457000000000001,"15min":14.721},"last":3.2810000000000001},{"interface":"front","average":{"1min":2.5219999999999998,"5min":2.306,"15min":1.5349999999999999},"min":{"1min":0.35599999999999998,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":7.3979999999999997,"5min":11.500999999999999,"15min":14.744999999999999},"last":3.3010000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575057,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":4055828,"kb_used_data":3453836,"kb_used_omap":0,"kb_used_meta":601984,"kb_avail":89689324,"statfs":{"total":95995035648,"available":91841867776,"internally_reserved":0,"allocated":3536728064,"data_stored":3535953121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":616431616},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,4,1,0,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:46:07 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.014,"15min":1.3280000000000001},"min":{"1min":0.20499999999999999,"5min":0.161,"15min":0.161},"max":{"1min":5.6360000000000001,"5min":6.9260000000000002,"15min":42.776000000000003},"last":0.191},{"interface":"front","average":{"1min":1.6830000000000001,"5min":1.2769999999999999,"15min":1.3839999999999999},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":10.798,"5min":10.798,"15min":44.845999999999997},"last":1.256}]},{"osd":2,"last update":"Mon Feb 19 21:46:35 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.101,"15min":1.2549999999999999},"min":{"1min":0.24299999999999999,"5min":0.23799999999999999,"15min":0.20899999999999999},"max":{"1min":4.3959999999999999,"5min":6.9640000000000004,"15min":11.826000000000001},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.1819999999999999,"15min":1.4179999999999999},"min":{"1min":0.249,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":4.5999999999999996,"5min":6.0250000000000004,"15min":12.26},"last":0.36799999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:46:07 2024","interfaces":[{"interface":"back","average":{"1min":1.726,"5min":1.3160000000000001,"15min":1.502},"min":{"1min":0.29599999999999999,"5min":0.224,"15min":0.224},"max":{"1min":5.1660000000000004,"5min":8.3469999999999995,"15min":41.607999999999997},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.7390000000000001,"5min":1.4390000000000001,"15min":1.3600000000000001},"min":{"1min":0.28000000000000003,"5min":0.216,"15min":0.216},"max":{"1min":5.6589999999999998,"5min":8.7349999999999994,"15min":42.811999999999998},"last":0.32700000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:46:26 2024","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.6279999999999999,"15min":1.26},"min":{"1min":0.313,"5min":0.26900000000000002,"15min":0.26800000000000002},"max":{"1min":4.3479999999999999,"5min":12.754,"15min":12.754},"last":0.251},{"interface":"front","average":{"1min":2.1930000000000001,"5min":1.4730000000000001,"15min":1.339},"min":{"1min":0.28000000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":5.8650000000000002,"5min":6.1210000000000004,"15min":10.51},"last":0.44}]},{"osd":5,"last update":"Mon Feb 19 21:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.7509999999999999,"5min":1.7969999999999999,"15min":1.323},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":5.2839999999999998,"5min":8.4269999999999996,"15min":10.458},"last":0.82099999999999995},{"interface":"front","average":{"1min":2.2469999999999999,"5min":1.71,"15min":1.294},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.30099999999999999},"max":{"1min":5.0410000000000004,"5min":6.5259999999999998,"15min":7.6950000000000003},"last":1.6779999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:46:22 2024","interfaces":[{"interface":"back","average":{"1min":1.6539999999999999,"5min":1.869,"15min":1.399},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30099999999999999},"max":{"1min":4.3700000000000001,"5min":10.291,"15min":11.638999999999999},"last":1.3520000000000001},{"interface":"front","average":{"1min":2.5640000000000001,"5min":2.2730000000000001,"15min":1.55},"min":{"1min":0.441,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":8.6899999999999995,"5min":12.199,"15min":12.199},"last":0.52700000000000002}]},{"osd":7,"last update":"Mon Feb 19 21:46:48 2024","interfaces":[{"interface":"back","average":{"1min":3.359,"5min":2.202,"15min":1.645},"min":{"1min":0.42899999999999999,"5min":0.38700000000000001,"15min":0.32700000000000001},"max":{"1min":13.904,"5min":13.904,"15min":13.904},"last":0.51200000000000001},{"interface":"front","average":{"1min":3.1040000000000001,"5min":2.0790000000000002,"15min":1.4950000000000001},"min":{"1min":0.38100000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":13.894,"5min":13.894,"15min":13.894},"last":0.35499999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738583,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2773056,"kb_used_data":2179256,"kb_used_omap":0,"kb_used_meta":593792,"kb_avail":90972096,"statfs":{"total":95995035648,"available":93155426304,"internally_reserved":0,"allocated":2231558144,"data_stored":2230803171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":608043008},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:46:04 2024","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":0.79200000000000004,"15min":1.006},"min":{"1min":0.183,"5min":0.182,"15min":0.17499999999999999},"max":{"1min":5.234,"5min":5.234,"15min":16.478000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.88600000000000001,"15min":1.242},"min":{"1min":0.20899999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":3.2989999999999999,"5min":3.827,"15min":13.422000000000001},"last":0.52900000000000003}]},{"osd":2,"last update":"Mon Feb 19 21:46:43 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":0.91200000000000003,"15min":1.206},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":2.9340000000000002,"5min":6.25,"15min":13.638999999999999},"last":3.79},{"interface":"front","average":{"1min":1.974,"5min":1.151,"15min":1.4199999999999999},"min":{"1min":0.26200000000000001,"5min":0.224,"15min":0.19500000000000001},"max":{"1min":11.348000000000001,"5min":11.348000000000001,"15min":13.134},"last":3.7349999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:45:54 2024","interfaces":[{"interface":"back","average":{"1min":1.5049999999999999,"5min":1.2170000000000001,"15min":1.4630000000000001},"min":{"1min":0.216,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":7.1369999999999996,"5min":7.1369999999999996,"15min":14.507999999999999},"last":1.7090000000000001},{"interface":"front","average":{"1min":1.4770000000000001,"5min":0.89300000000000002,"15min":1.401},"min":{"1min":0.27500000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":6.2169999999999996,"5min":6.2169999999999996,"15min":18.759},"last":0.28899999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:46:37 2024","interfaces":[{"interface":"back","average":{"1min":1.909,"5min":1.696,"15min":1.4259999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":7.1079999999999997,"5min":9.3900000000000006,"15min":13.278},"last":2.754},{"interface":"front","average":{"1min":2.0329999999999999,"5min":1.5700000000000001,"15min":1.3140000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.255},"max":{"1min":5.1219999999999999,"5min":8.3889999999999993,"15min":8.9450000000000003},"last":0.47299999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:45:54 2024","interfaces":[{"interface":"back","average":{"1min":2.2200000000000002,"5min":1.879,"15min":1.663},"min":{"1min":0.45300000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":6.9260000000000002,"5min":10.852,"15min":42.799999999999997},"last":2.3239999999999998},{"interface":"front","average":{"1min":2.2570000000000001,"5min":2.121,"15min":1.665},"min":{"1min":0.379,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":6.9130000000000003,"5min":10.842000000000001,"15min":42.695},"last":2.0699999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:46:08 2024","interfaces":[{"interface":"back","average":{"1min":2.3639999999999999,"5min":1.4630000000000001,"15min":1.3919999999999999},"min":{"1min":0.40200000000000002,"5min":0.30599999999999999,"15min":0.27900000000000003},"max":{"1min":6.1959999999999997,"5min":6.1959999999999997,"15min":42.777000000000001},"last":1.6619999999999999},{"interface":"front","average":{"1min":1.7989999999999999,"5min":1.855,"15min":1.5960000000000001},"min":{"1min":0.48299999999999998,"5min":0.29799999999999999,"15min":0.28599999999999998},"max":{"1min":4.7229999999999999,"5min":13.289999999999999,"15min":13.289999999999999},"last":2.3580000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:46:43 2024","interfaces":[{"interface":"back","average":{"1min":2.3929999999999998,"5min":1.8859999999999999,"15min":1.593},"min":{"1min":0.38300000000000001,"5min":0.378,"15min":0.31},"max":{"1min":10.456,"5min":10.456,"15min":42.758000000000003},"last":1.7430000000000001},{"interface":"front","average":{"1min":2.403,"5min":1.746,"15min":1.528},"min":{"1min":0.45100000000000001,"5min":0.38400000000000001,"15min":0.33200000000000002},"max":{"1min":10.470000000000001,"5min":10.470000000000001,"15min":42.718000000000004},"last":0.97899999999999998}]}]},{"osd":2,"up_from":0,"seq":77309411532,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":26,"seq":111669149895,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":941892,"kb_used_data":632380,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":92803260,"statfs":{"total":95995035648,"available":95030538240,"internally_reserved":0,"allocated":647557120,"data_stored":646861131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,0,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:46:02 2024","interfaces":[{"interface":"back","average":{"1min":1.532,"5min":1.1930000000000001,"15min":1.2569999999999999},"min":{"1min":0.19600000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":6.0060000000000002,"5min":8.8529999999999998,"15min":17.992000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":2.0249999999999999,"5min":1.2410000000000001,"15min":1.629},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":6.1020000000000003,"5min":9.1120000000000001,"15min":46.654000000000003},"last":0.96599999999999997}]},{"osd":1,"last update":"Mon Feb 19 21:46:02 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.97899999999999998,"15min":1.008},"min":{"1min":0.21099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":3.347,"5min":6.444,"15min":9.9700000000000006},"last":0.215},{"interface":"front","average":{"1min":1.206,"5min":1.198,"15min":1.3129999999999999},"min":{"1min":0.27900000000000003,"5min":0.20799999999999999,"15min":0.185},"max":{"1min":6.5469999999999997,"5min":6.5469999999999997,"15min":13.135999999999999},"last":0.71899999999999997}]},{"osd":2,"last update":"Mon Feb 19 21:46:02 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.96299999999999997,"15min":1.214},"min":{"1min":0.26600000000000001,"5min":0.22900000000000001,"15min":0.224},"max":{"1min":4.0650000000000004,"5min":6.8879999999999999,"15min":11.175000000000001},"last":0.75},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.1399999999999999,"15min":1.5029999999999999},"min":{"1min":0.27700000000000002,"5min":0.23499999999999999,"15min":0.21299999999999999},"max":{"1min":5.7999999999999998,"5min":12.723000000000001,"15min":45.831000000000003},"last":0.92400000000000004}]},{"osd":4,"last update":"Mon Feb 19 21:46:26 2024","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3080000000000001,"15min":1.1359999999999999},"min":{"1min":0.34699999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":5.3499999999999996,"5min":7.1660000000000004,"15min":7.1660000000000004},"last":0.26600000000000001},{"interface":"front","average":{"1min":1.601,"5min":1.7,"15min":1.4379999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.26800000000000002},"max":{"1min":3.476,"5min":9.6720000000000006,"15min":11.093},"last":0.77200000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:46:48 2024","interfaces":[{"interface":"back","average":{"1min":2.0379999999999998,"5min":1.6639999999999999,"15min":1.3300000000000001},"min":{"1min":0.32200000000000001,"5min":0.29099999999999998,"15min":0.27100000000000002},"max":{"1min":6.2750000000000004,"5min":12.257,"15min":12.257},"last":0.32200000000000001},{"interface":"front","average":{"1min":1.925,"5min":1.6579999999999999,"15min":1.5489999999999999},"min":{"1min":0.35099999999999998,"5min":0.313,"15min":0.27800000000000002},"max":{"1min":4.3840000000000003,"5min":7.8460000000000001,"15min":11.128},"last":0.79900000000000004}]},{"osd":6,"last update":"Mon Feb 19 21:46:11 2024","interfaces":[{"interface":"back","average":{"1min":1.863,"5min":1.5800000000000001,"15min":1.278},"min":{"1min":0.36499999999999999,"5min":0.31900000000000001,"15min":0.30599999999999999},"max":{"1min":5.1909999999999998,"5min":7.5419999999999998,"15min":17.443999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.7350000000000001,"5min":1.7270000000000001,"15min":1.476},"min":{"1min":0.53700000000000003,"5min":0.32900000000000001,"15min":0.32300000000000001},"max":{"1min":5.8099999999999996,"5min":13.942,"15min":18.219000000000001},"last":0.84499999999999997}]},{"osd":7,"last update":"Mon Feb 19 21:46:38 2024","interfaces":[{"interface":"back","average":{"1min":1.887,"5min":1.7809999999999999,"15min":1.7270000000000001},"min":{"1min":0.33500000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":9.6959999999999997,"5min":9.6959999999999997,"15min":45.777999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.7430000000000001,"5min":1.3779999999999999,"15min":1.216},"min":{"1min":0.39500000000000002,"5min":0.35399999999999998,"15min":0.35099999999999998},"max":{"1min":6.3010000000000002,"5min":6.5090000000000003,"15min":6.585},"last":0.34599999999999997}]}]},{"osd":4,"up_from":32,"seq":137438953664,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2212084,"kb_used_data":1902508,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":91533068,"statfs":{"total":95995035648,"available":93729861632,"internally_reserved":0,"allocated":1948168192,"data_stored":1947423942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,3,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:46:29 2024","interfaces":[{"interface":"back","average":{"1min":1.913,"5min":1.7110000000000001,"15min":1.4419999999999999},"min":{"1min":0.23699999999999999,"5min":0.23499999999999999,"15min":0.219},"max":{"1min":5.617,"5min":11.541,"15min":40.664000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":2.3210000000000002,"5min":1.7729999999999999,"15min":1.5700000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.22600000000000001},"max":{"1min":7.2009999999999996,"5min":9.2799999999999994,"15min":41.046999999999997},"last":0.23599999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:46:29 2024","interfaces":[{"interface":"back","average":{"1min":1.9330000000000001,"5min":1.905,"15min":1.274},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":5.649,"5min":11.755000000000001,"15min":13.254},"last":0.376},{"interface":"front","average":{"1min":2.161,"5min":1.6399999999999999,"15min":1.2230000000000001},"min":{"1min":0.26100000000000001,"5min":0.25,"15min":0.25},"max":{"1min":7.4000000000000004,"5min":7.6970000000000001,"15min":15.411},"last":0.27500000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:46:29 2024","interfaces":[{"interface":"back","average":{"1min":2.0329999999999999,"5min":1.7310000000000001,"15min":1.3300000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.27100000000000002},"max":{"1min":7.3540000000000001,"5min":7.6459999999999999,"15min":16.788},"last":0.33500000000000002},{"interface":"front","average":{"1min":1.931,"5min":1.5860000000000001,"15min":1.504},"min":{"1min":0.35699999999999998,"5min":0.318,"15min":0.27300000000000002},"max":{"1min":4.6040000000000001,"5min":10.398999999999999,"15min":20.995999999999999},"last":5.3680000000000003}]},{"osd":3,"last update":"Mon Feb 19 21:46:29 2024","interfaces":[{"interface":"back","average":{"1min":1.8919999999999999,"5min":1.7330000000000001,"15min":1.4039999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.316},"max":{"1min":4.5430000000000001,"5min":10.970000000000001,"15min":15.914999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":2.2050000000000001,"5min":1.881,"15min":1.379},"min":{"1min":0.312,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":5.6820000000000004,"5min":11.662000000000001,"15min":13.321},"last":0.439}]},{"osd":5,"last update":"Mon Feb 19 21:46:11 2024","interfaces":[{"interface":"back","average":{"1min":3.1779999999999999,"5min":2.2759999999999998,"15min":1.2649999999999999},"min":{"1min":0.32200000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":7.4210000000000003,"5min":18.916,"15min":18.916},"last":0.36299999999999999},{"interface":"front","average":{"1min":2.907,"5min":2.8319999999999999,"15min":1.468},"min":{"1min":0.26200000000000001,"5min":0.253,"15min":0.253},"max":{"1min":6.5640000000000001,"5min":14.840999999999999,"15min":14.840999999999999},"last":5.4320000000000004}]},{"osd":6,"last update":"Mon Feb 19 21:46:29 2024","interfaces":[{"interface":"back","average":{"1min":1.9750000000000001,"5min":1.605,"15min":1.2190000000000001},"min":{"1min":0.29699999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":7.617,"5min":8.5519999999999996,"15min":13.27},"last":8.4559999999999995},{"interface":"front","average":{"1min":2.774,"5min":2.286,"15min":1.3180000000000001},"min":{"1min":0.40999999999999998,"5min":0.28799999999999998,"15min":0.27400000000000002},"max":{"1min":8.5350000000000001,"5min":14.127000000000001,"15min":14.127000000000001},"last":10.861000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:45:48 2024","interfaces":[{"interface":"back","average":{"1min":2.4980000000000002,"5min":2.3079999999999998,"15min":1.2370000000000001},"min":{"1min":0.38700000000000001,"5min":0.30399999999999999,"15min":0.28899999999999998},"max":{"1min":8.4770000000000003,"5min":14.093,"15min":14.093},"last":0.60399999999999998},{"interface":"front","average":{"1min":1.679,"5min":2.0800000000000001,"15min":1.3009999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":10.82,"5min":12.808999999999999,"15min":12.808999999999999},"last":0.47799999999999998}]}]},{"osd":5,"up_from":38,"seq":163208757436,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3732168,"kb_used_data":3138368,"kb_used_omap":0,"kb_used_meta":593792,"kb_avail":90012984,"statfs":{"total":95995035648,"available":92173295616,"internally_reserved":0,"allocated":3213688832,"data_stored":3212925161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":608043008},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:45:59 2024","interfaces":[{"interface":"back","average":{"1min":2.4420000000000002,"5min":1.994,"15min":1.446},"min":{"1min":0.22500000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":10.106,"5min":15.048,"15min":20.550999999999998},"last":1.3480000000000001},{"interface":"front","average":{"1min":3.7709999999999999,"5min":2.5379999999999998,"15min":1.589},"min":{"1min":0.28799999999999998,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":13.241,"5min":13.241,"15min":20.879000000000001},"last":0.33100000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:45:59 2024","interfaces":[{"interface":"back","average":{"1min":2.4390000000000001,"5min":2.3260000000000001,"15min":1.417},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":8.9789999999999992,"5min":10.42,"15min":10.42},"last":0.379},{"interface":"front","average":{"1min":2.3700000000000001,"5min":1.6419999999999999,"15min":1.28},"min":{"1min":0.26200000000000001,"5min":0.247,"15min":0.247},"max":{"1min":6.6870000000000003,"5min":10.021000000000001,"15min":10.316000000000001},"last":1.361}]},{"osd":2,"last update":"Mon Feb 19 21:45:59 2024","interfaces":[{"interface":"back","average":{"1min":2.036,"5min":1.9350000000000001,"15min":1.472},"min":{"1min":0.30599999999999999,"5min":0.26800000000000002,"15min":0.25700000000000001},"max":{"1min":6.9580000000000002,"5min":15.015000000000001,"15min":20.186},"last":1.3859999999999999},{"interface":"front","average":{"1min":2.8650000000000002,"5min":2.169,"15min":1.5389999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.23200000000000001},"max":{"1min":9.0039999999999996,"5min":9.4909999999999997,"15min":20.175000000000001},"last":0.36299999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:45:59 2024","interfaces":[{"interface":"back","average":{"1min":2.569,"5min":2.3130000000000002,"15min":1.663},"min":{"1min":0.34000000000000002,"5min":0.28999999999999998,"15min":0.24099999999999999},"max":{"1min":7.6070000000000002,"5min":12.021000000000001,"15min":20.146999999999998},"last":5.2249999999999996},{"interface":"front","average":{"1min":3.1899999999999999,"5min":2.621,"15min":1.8440000000000001},"min":{"1min":0.33000000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":9.0269999999999992,"5min":9.5150000000000006,"15min":20.120000000000001},"last":0.39400000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:45:59 2024","interfaces":[{"interface":"back","average":{"1min":2.3719999999999999,"5min":1.954,"15min":1.0580000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":6.8529999999999998,"5min":21.577000000000002,"15min":21.577000000000002},"last":0.32000000000000001},{"interface":"front","average":{"1min":2.5059999999999998,"5min":2.6520000000000001,"15min":1.3939999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.25600000000000001},"max":{"1min":10.122999999999999,"5min":15.071999999999999,"15min":15.071999999999999},"last":1.2989999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:46:20 2024","interfaces":[{"interface":"back","average":{"1min":2.1389999999999998,"5min":2.4369999999999998,"15min":1.401},"min":{"1min":0.307,"5min":0.26200000000000001,"15min":0.221},"max":{"1min":10.077,"5min":13.138999999999999,"15min":13.138999999999999},"last":5.1890000000000001},{"interface":"front","average":{"1min":2.4860000000000002,"5min":2.3759999999999999,"15min":1.476},"min":{"1min":0.34699999999999998,"5min":0.29799999999999999,"15min":0.23599999999999999},"max":{"1min":9.0739999999999998,"5min":13.532999999999999,"15min":13.532999999999999},"last":1.3959999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:45:49 2024","interfaces":[{"interface":"back","average":{"1min":2.2989999999999999,"5min":2.7050000000000001,"15min":1.5009999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":9.0489999999999995,"5min":12.962,"15min":12.962},"last":2.403},{"interface":"front","average":{"1min":2.2730000000000001,"5min":2.3460000000000001,"15min":1.335},"min":{"1min":0.309,"5min":0.309,"15min":0.29099999999999998},"max":{"1min":8.3330000000000002,"5min":13.116,"15min":17.759},"last":2.4239999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":2118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2223702016,"data_stored":2223702016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3521122304,"data_stored":3521118232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":642973696,"data_stored":642973696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1929973760,"data_stored":1929969688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3192590336,"data_stored":3192586264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2555707392,"data_stored":2555707392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1296891904,"data_stored":1296891904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:46:54.406 INFO:tasks.thrashosds.thrasher:Setting 6.19 to [4, 1, 7, 6, 0, 5] 2024-02-19T21:46:54.407 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '6.19', '4', '1', '7', '6', '0', '5'] 2024-02-19T21:46:54.407 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pg-upmap-items 6.19 4 1 7 6 0 5 2024-02-19T21:46:54.805 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set noscrub 2024-02-19T21:46:54.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:53.097872+0000 mgr.y (mgr.14514) 549 : cluster [DBG] pgmap v691: 138 pgs: 138 active+clean; 4.8 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.06k op/s 2024-02-19T21:46:54.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:53.646502+0000 mgr.y (mgr.14514) 550 : audit [DBG] from='client.15453 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:46:54.839 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:53.097872+0000 mgr.y (mgr.14514) 549 : cluster [DBG] pgmap v691: 138 pgs: 138 active+clean; 4.8 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.06k op/s 2024-02-19T21:46:54.839 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:53.646502+0000 mgr.y (mgr.14514) 550 : audit [DBG] from='client.15453 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:46:54.839 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:53.097872+0000 mgr.y (mgr.14514) 549 : cluster [DBG] pgmap v691: 138 pgs: 138 active+clean; 4.8 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.06k op/s 2024-02-19T21:46:54.839 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:53.646502+0000 mgr.y (mgr.14514) 550 : audit [DBG] from='client.15453 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:46:54.895 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:46:54.906 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:54.907 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:46:55.007 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:46:55.050 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:55.502 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:54.660313+0000 osd.1 (osd.1) 216 : cluster [DBG] 9.2 scrub ok 2024-02-19T21:46:55.503 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:54.820400+0000 osd.5 (osd.5) 237 : cluster [DBG] 9.6 scrub starts 2024-02-19T21:46:55.503 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:54.867145+0000 osd.3 (osd.3) 218 : cluster [DBG] 4.1a scrub starts 2024-02-19T21:46:55.503 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:54.873407+0000 osd.3 (osd.3) 219 : cluster [DBG] 4.1a scrub ok 2024-02-19T21:46:55.560 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:46:55.806 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:46:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:46:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:46:55.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:54.660313+0000 osd.1 (osd.1) 216 : cluster [DBG] 9.2 scrub ok 2024-02-19T21:46:55.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:54.820400+0000 osd.5 (osd.5) 237 : cluster [DBG] 9.6 scrub starts 2024-02-19T21:46:55.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:54.867145+0000 osd.3 (osd.3) 218 : cluster [DBG] 4.1a scrub starts 2024-02-19T21:46:55.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:54.873407+0000 osd.3 (osd.3) 219 : cluster [DBG] 4.1a scrub ok 2024-02-19T21:46:55.826 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:54.660313+0000 osd.1 (osd.1) 216 : cluster [DBG] 9.2 scrub ok 2024-02-19T21:46:55.826 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:54.820400+0000 osd.5 (osd.5) 237 : cluster [DBG] 9.6 scrub starts 2024-02-19T21:46:55.826 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:54.867145+0000 osd.3 (osd.3) 218 : cluster [DBG] 4.1a scrub starts 2024-02-19T21:46:55.826 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:54.873407+0000 osd.3 (osd.3) 219 : cluster [DBG] 4.1a scrub ok 2024-02-19T21:46:56.502 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:55.098553+0000 mgr.y (mgr.14514) 551 : cluster [DBG] pgmap v692: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 4.6 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 590 B/s rd, 0 B/s wr, 843 op/s 2024-02-19T21:46:56.553 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:46:56.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:55.098553+0000 mgr.y (mgr.14514) 551 : cluster [DBG] pgmap v692: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 4.6 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 590 B/s rd, 0 B/s wr, 843 op/s 2024-02-19T21:46:56.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:55.098553+0000 mgr.y (mgr.14514) 551 : cluster [DBG] pgmap v692: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 4.6 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 590 B/s rd, 0 B/s wr, 843 op/s 2024-02-19T21:46:56.866 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:46:56.892 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:46:56.921 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:46:56.948 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:46:56.978 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:46:57.009 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:46:57.053 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:46:57.093 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:46:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:46:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:46:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:46:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:46:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:46:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:46:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:46:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:46:57.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:56.828144+0000 mon.a (mon.0) 1428 : audit [DBG] from='client.? 172.21.15.80:0/304990721' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:46:57.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:56.828144+0000 mon.a (mon.0) 1428 : audit [DBG] from='client.? 172.21.15.80:0/304990721' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:46:57.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:56.828144+0000 mon.a (mon.0) 1428 : audit [DBG] from='client.? 172.21.15.80:0/304990721' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:46:58.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:57.099113+0000 mgr.y (mgr.14514) 552 : cluster [DBG] pgmap v693: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 4.4 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 1.06k op/s 2024-02-19T21:46:58.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:57.203564+0000 osd.5 (osd.5) 238 : cluster [DBG] 9.6 scrub ok 2024-02-19T21:46:58.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:57.287864+0000 osd.5 (osd.5) 239 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:46:58.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:57.287916+0000 osd.5 (osd.5) 240 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:46:58.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:57.518413+0000 mon.a (mon.0) 1429 : cluster [DBG] osdmap e339: 8 total, 8 up, 7 in 2024-02-19T21:46:58.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:46:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:57.763881+0000 osd.5 (osd.5) 241 : cluster [DBG] 9.7 deep-scrub starts 2024-02-19T21:46:58.804 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:57.099113+0000 mgr.y (mgr.14514) 552 : cluster [DBG] pgmap v693: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 4.4 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 1.06k op/s 2024-02-19T21:46:58.804 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:57.203564+0000 osd.5 (osd.5) 238 : cluster [DBG] 9.6 scrub ok 2024-02-19T21:46:58.804 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:57.287864+0000 osd.5 (osd.5) 239 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:46:58.804 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:57.287916+0000 osd.5 (osd.5) 240 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:46:58.804 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:57.518413+0000 mon.a (mon.0) 1429 : cluster [DBG] osdmap e339: 8 total, 8 up, 7 in 2024-02-19T21:46:58.804 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:46:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:57.763881+0000 osd.5 (osd.5) 241 : cluster [DBG] 9.7 deep-scrub starts 2024-02-19T21:46:58.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:57.099113+0000 mgr.y (mgr.14514) 552 : cluster [DBG] pgmap v693: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 4.4 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 1.06k op/s 2024-02-19T21:46:58.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:57.203564+0000 osd.5 (osd.5) 238 : cluster [DBG] 9.6 scrub ok 2024-02-19T21:46:58.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:57.287864+0000 osd.5 (osd.5) 239 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:46:58.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:57.287916+0000 osd.5 (osd.5) 240 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:46:58.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:57.518413+0000 mon.a (mon.0) 1429 : cluster [DBG] osdmap e339: 8 total, 8 up, 7 in 2024-02-19T21:46:58.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:46:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:57.763881+0000 osd.5 (osd.5) 241 : cluster [DBG] 9.7 deep-scrub starts 2024-02-19T21:46:58.922 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:46:58.927 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:58.928 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:46:58.942 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.6 dump_historic_ops 2024-02-19T21:46:59.028 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:46:59.068 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:59.213 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:46:59.221 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:59.222 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:46:59.322 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:46:59.358 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:46:59.421 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:46:59.730 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:46:59.738 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:46:59.738 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:46:59.839 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:46:59.904 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:00.195 INFO:teuthology.orchestra.run.smithi080.stderr:set 6.19 pg_upmap_items mapping to [4->1,7->6,0->5] 2024-02-19T21:47:00.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:59.099431+0000 mgr.y (mgr.14514) 553 : cluster [DBG] pgmap v695: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 4.4 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 574 B/s rd, 0 B/s wr, 743 op/s 2024-02-19T21:47:00.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:59.717816+0000 osd.3 (osd.3) 220 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:47:00.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:46:59.717858+0000 osd.3 (osd.3) 221 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:47:00.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:59.718060+0000 mon.c (mon.2) 75 : audit [INF] from='client.? 172.21.15.80:0/14950108' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "6.19", "id": [4, 1, 7, 6, 0, 5]}]: dispatch 2024-02-19T21:47:00.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:46:59.718379+0000 mon.a (mon.0) 1430 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "6.19", "id": [4, 1, 7, 6, 0, 5]}]: dispatch 2024-02-19T21:47:00.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:00.189421+0000 mon.a (mon.0) 1431 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "6.19", "id": [4, 1, 7, 6, 0, 5]}]': finished 2024-02-19T21:47:00.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:00.189474+0000 mon.a (mon.0) 1432 : cluster [DBG] osdmap e340: 8 total, 8 up, 7 in 2024-02-19T21:47:00.813 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:47:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:47:00.831 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:47:00.848 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:47:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:47:00] "GET /metrics HTTP/1.1" 200 176158 "" "Prometheus/2.33.4" 2024-02-19T21:47:00.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:59.099431+0000 mgr.y (mgr.14514) 553 : cluster [DBG] pgmap v695: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 4.4 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 574 B/s rd, 0 B/s wr, 743 op/s 2024-02-19T21:47:00.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:59.717816+0000 osd.3 (osd.3) 220 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:47:00.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:46:59.717858+0000 osd.3 (osd.3) 221 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:47:00.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:59.718060+0000 mon.c (mon.2) 75 : audit [INF] from='client.? 172.21.15.80:0/14950108' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "6.19", "id": [4, 1, 7, 6, 0, 5]}]: dispatch 2024-02-19T21:47:00.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:46:59.718379+0000 mon.a (mon.0) 1430 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "6.19", "id": [4, 1, 7, 6, 0, 5]}]: dispatch 2024-02-19T21:47:00.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:00.189421+0000 mon.a (mon.0) 1431 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "6.19", "id": [4, 1, 7, 6, 0, 5]}]': finished 2024-02-19T21:47:00.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:00.189474+0000 mon.a (mon.0) 1432 : cluster [DBG] osdmap e340: 8 total, 8 up, 7 in 2024-02-19T21:47:00.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:59.099431+0000 mgr.y (mgr.14514) 553 : cluster [DBG] pgmap v695: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 4.4 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 574 B/s rd, 0 B/s wr, 743 op/s 2024-02-19T21:47:00.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:59.717816+0000 osd.3 (osd.3) 220 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:47:00.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:46:59.717858+0000 osd.3 (osd.3) 221 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:47:00.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:59.718060+0000 mon.c (mon.2) 75 : audit [INF] from='client.? 172.21.15.80:0/14950108' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "6.19", "id": [4, 1, 7, 6, 0, 5]}]: dispatch 2024-02-19T21:47:00.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:46:59.718379+0000 mon.a (mon.0) 1430 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "6.19", "id": [4, 1, 7, 6, 0, 5]}]: dispatch 2024-02-19T21:47:00.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:00.189421+0000 mon.a (mon.0) 1431 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "6.19", "id": [4, 1, 7, 6, 0, 5]}]': finished 2024-02-19T21:47:00.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:00.189474+0000 mon.a (mon.0) 1432 : cluster [DBG] osdmap e340: 8 total, 8 up, 7 in 2024-02-19T21:47:01.241 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:47:01.562 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-02-19T21:47:01.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:00.621029+0000 mon.a (mon.0) 1433 : audit [INF] from='client.? 172.21.15.80:0/1796807952' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:47:01.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:00.710987+0000 mgr.y (mgr.14514) 554 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:47:01.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:00.621029+0000 mon.a (mon.0) 1433 : audit [INF] from='client.? 172.21.15.80:0/1796807952' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:47:01.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:00.710987+0000 mgr.y (mgr.14514) 554 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:47:01.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:00.621029+0000 mon.a (mon.0) 1433 : audit [INF] from='client.? 172.21.15.80:0/1796807952' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:47:01.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:00.710987+0000 mgr.y (mgr.14514) 554 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:47:02.175 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:47:02.181 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:02.181 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:47:02.282 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:47:02.319 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:02.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:01.102522+0000 mgr.y (mgr.14514) 555 : cluster [DBG] pgmap v697: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 4.1 GiB data, 15 GiB used, 610 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.26k op/s 2024-02-19T21:47:02.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:01.358453+0000 osd.4 (osd.4) 177 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:47:02.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:01.365473+0000 osd.4 (osd.4) 178 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:47:02.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:01.527925+0000 mon.a (mon.0) 1434 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:47:02.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:01.536753+0000 mon.a (mon.0) 1435 : audit [INF] from='client.? 172.21.15.80:0/1796807952' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:47:02.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:01.536809+0000 mon.a (mon.0) 1436 : cluster [DBG] osdmap e341: 8 total, 8 up, 7 in 2024-02-19T21:47:02.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:01.102522+0000 mgr.y (mgr.14514) 555 : cluster [DBG] pgmap v697: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 4.1 GiB data, 15 GiB used, 610 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.26k op/s 2024-02-19T21:47:02.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:01.358453+0000 osd.4 (osd.4) 177 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:47:02.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:01.365473+0000 osd.4 (osd.4) 178 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:47:02.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:01.527925+0000 mon.a (mon.0) 1434 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:47:02.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:01.536753+0000 mon.a (mon.0) 1435 : audit [INF] from='client.? 172.21.15.80:0/1796807952' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:47:02.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:01.536809+0000 mon.a (mon.0) 1436 : cluster [DBG] osdmap e341: 8 total, 8 up, 7 in 2024-02-19T21:47:02.777 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:47:02.780 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:02.780 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:47:02.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:01.102522+0000 mgr.y (mgr.14514) 555 : cluster [DBG] pgmap v697: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 4.1 GiB data, 15 GiB used, 610 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.26k op/s 2024-02-19T21:47:02.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:01.358453+0000 osd.4 (osd.4) 177 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:47:02.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:01.365473+0000 osd.4 (osd.4) 178 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:47:02.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:01.527925+0000 mon.a (mon.0) 1434 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:47:02.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:01.536753+0000 mon.a (mon.0) 1435 : audit [INF] from='client.? 172.21.15.80:0/1796807952' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:47:02.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:01.536809+0000 mon.a (mon.0) 1436 : cluster [DBG] osdmap e341: 8 total, 8 up, 7 in 2024-02-19T21:47:02.881 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:47:02.919 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:03.284 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:47:03.291 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:03.291 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:47:03.392 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:47:03.427 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:03.486 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:47:03.491 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:03.491 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:47:03.592 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:47:03.647 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:03.687 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:47:03.693 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:03.694 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:47:03.794 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:47:03.845 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:03.866 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:47:03.876 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:47:03.879 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:03.879 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:47:03.903 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:47:03.929 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:47:03.956 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:47:03.980 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:47:03.989 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:47:04.018 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:47:04.057 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:47:04.062 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:04.082 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:47:04.084 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:47:04.084 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:47:04.084 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:47:04.084 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:47:04.084 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:47:04.084 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:47:04.084 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:47:04.084 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:47:04.134 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:47:04.143 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:04.143 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:47:04.208 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:47:04.208 INFO:teuthology.orchestra.run.smithi157.stdout: "size": 20, 2024-02-19T21:47:04.208 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 600, 2024-02-19T21:47:04.208 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [ 2024-02-19T21:47:04.208 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.208 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:146646 7.c 7:3b25307f:::benchmark_data_smithi080_79222_object31912:head [delete] snapc 0=[] ondisk+write+known_if_redirected e133)", 2024-02-19T21:47:04.208 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:37:33.596284+0000", 2024-02-19T21:47:04.209 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 570.60509017499999, 2024-02-19T21:47:04.209 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.084397300999999994, 2024-02-19T21:47:04.209 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:47:04.209 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:04.209 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:47:04.209 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:47:04.209 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:04.209 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 146646 2024-02-19T21:47:04.209 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.209 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:47:04.209 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.209 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:47:04.210 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596284+0000", 2024-02-19T21:47:04.210 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:47:04.210 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.210 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.210 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:47:04.210 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596284+0000", 2024-02-19T21:47:04.210 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:47:04.210 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.210 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.210 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:47:04.210 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596283+0000", 2024-02-19T21:47:04.210 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.2260000000000001e-06 2024-02-19T21:47:04.210 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.211 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.211 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:47:04.211 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596287+0000", 2024-02-19T21:47:04.211 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.1700000000000002e-06 2024-02-19T21:47:04.211 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.211 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.211 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:47:04.211 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596293+0000", 2024-02-19T21:47:04.211 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.7910000000000002e-06 2024-02-19T21:47:04.211 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.211 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.211 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:47:04.211 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596297+0000", 2024-02-19T21:47:04.211 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.9220000000000005e-05 2024-02-19T21:47:04.211 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.212 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.212 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.212 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596366+0000", 2024-02-19T21:47:04.212 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000104897 2024-02-19T21:47:04.212 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.212 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.212 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:47:04.212 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596471+0000", 2024-02-19T21:47:04.212 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000122182 2024-02-19T21:47:04.212 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.212 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.212 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:47:04.212 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.596593+0000", 2024-02-19T21:47:04.213 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.002585324 2024-02-19T21:47:04.213 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.213 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.213 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:47:04.213 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599178+0000", 2024-02-19T21:47:04.213 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0085386769999999997 2024-02-19T21:47:04.213 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.213 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.213 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.213 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.607717+0000", 2024-02-19T21:47:04.213 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.072893174000000005 2024-02-19T21:47:04.213 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.213 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.213 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.213 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.680610+0000", 2024-02-19T21:47:04.213 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.6788000000000001e-05 2024-02-19T21:47:04.214 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.214 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.214 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:47:04.214 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.680647+0000", 2024-02-19T21:47:04.214 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.4368e-05 2024-02-19T21:47:04.214 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.214 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.214 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:47:04.214 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.680681+0000", 2024-02-19T21:47:04.214 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.084397300999999994 2024-02-19T21:47:04.214 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.214 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:47:04.214 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.214 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.215 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.215 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:146652 7.c 7:3c2dcaab:::benchmark_data_smithi080_79222_object31918:head [delete] snapc 0=[] ondisk+write+known_if_redirected e133)", 2024-02-19T21:47:04.215 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:37:33.599542+0000", 2024-02-19T21:47:04.215 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 570.60183201899997, 2024-02-19T21:47:04.215 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.081263583, 2024-02-19T21:47:04.215 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:47:04.215 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:04.215 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:47:04.215 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:47:04.215 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:04.215 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 146652 2024-02-19T21:47:04.215 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.215 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:47:04.215 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.215 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:47:04.216 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599542+0000", 2024-02-19T21:47:04.216 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:47:04.216 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.216 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.216 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:47:04.216 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599542+0000", 2024-02-19T21:47:04.216 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:47:04.216 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.216 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.216 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:47:04.216 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599541+0000", 2024-02-19T21:47:04.216 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.0570000000000004e-06 2024-02-19T21:47:04.216 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.216 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.216 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:47:04.217 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599548+0000", 2024-02-19T21:47:04.217 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1291000000000001e-05 2024-02-19T21:47:04.217 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.217 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.217 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:47:04.217 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599559+0000", 2024-02-19T21:47:04.217 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.7070000000000003e-06 2024-02-19T21:47:04.217 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.217 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.217 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:47:04.217 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599566+0000", 2024-02-19T21:47:04.217 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.6984999999999998e-05 2024-02-19T21:47:04.217 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.217 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.217 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.218 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599613+0000", 2024-02-19T21:47:04.218 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.5153000000000004e-05 2024-02-19T21:47:04.218 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.218 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.218 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:47:04.218 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599688+0000", 2024-02-19T21:47:04.218 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.4678000000000006e-05 2024-02-19T21:47:04.218 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.218 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.218 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:47:04.218 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.599763+0000", 2024-02-19T21:47:04.218 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0026663949999999998 2024-02-19T21:47:04.218 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.218 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.219 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:47:04.219 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.602429+0000", 2024-02-19T21:47:04.219 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0078935600000000009 2024-02-19T21:47:04.219 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.219 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.219 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.219 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.610323+0000", 2024-02-19T21:47:04.219 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.070400874000000002 2024-02-19T21:47:04.219 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.219 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.219 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.219 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.680724+0000", 2024-02-19T21:47:04.219 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.1516000000000001e-05 2024-02-19T21:47:04.220 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.220 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.220 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:47:04.220 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.680755+0000", 2024-02-19T21:47:04.220 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0662999999999999e-05 2024-02-19T21:47:04.220 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.220 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.220 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:47:04.220 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:37:33.680806+0000", 2024-02-19T21:47:04.220 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.081263583 2024-02-19T21:47:04.220 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.220 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:47:04.220 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.221 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.221 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.221 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199203 7.7 7:e4e0691c:::benchmark_data_smithi080_79222_object84469:head [delete] snapc 0=[] ondisk+write+known_if_redirected e143)", 2024-02-19T21:47:04.221 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:30.214329+0000", 2024-02-19T21:47:04.221 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 513.98704503399995, 2024-02-19T21:47:04.221 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1537202830000002, 2024-02-19T21:47:04.221 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:47:04.221 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "reached pg", 2024-02-19T21:47:04.221 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:47:04.221 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:47:04.221 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:04.221 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199203 2024-02-19T21:47:04.221 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.221 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:47:04.221 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.222 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:47:04.222 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.214329+0000", 2024-02-19T21:47:04.222 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:47:04.222 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.222 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.222 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:47:04.222 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.214329+0000", 2024-02-19T21:47:04.222 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:47:04.222 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.222 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.222 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:47:04.222 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.214329+0000", 2024-02-19T21:47:04.222 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.6859999999999999e-06 2024-02-19T21:47:04.223 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.223 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.223 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:47:04.223 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.214332+0000", 2024-02-19T21:47:04.223 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.5900000000000002e-06 2024-02-19T21:47:04.223 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.223 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.223 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:47:04.223 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.214340+0000", 2024-02-19T21:47:04.223 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.4649999999999996e-06 2024-02-19T21:47:04.223 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.223 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.223 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:47:04.223 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.214344+0000", 2024-02-19T21:47:04.223 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0033895370000000002 2024-02-19T21:47:04.224 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.224 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.224 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.224 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.217734+0000", 2024-02-19T21:47:04.224 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.0727000000000002e-05 2024-02-19T21:47:04.224 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.224 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.224 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:47:04.224 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.217805+0000", 2024-02-19T21:47:04.224 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.0567000000000002e-05 2024-02-19T21:47:04.224 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.224 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.224 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,3", 2024-02-19T21:47:04.224 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.217895+0000", 2024-02-19T21:47:04.225 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0021666659999999998 2024-02-19T21:47:04.225 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.225 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.225 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:47:04.225 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220062+0000", 2024-02-19T21:47:04.225 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.022580901 2024-02-19T21:47:04.225 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.225 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.225 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.225 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.242643+0000", 2024-02-19T21:47:04.225 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.5939999999999999e-06 2024-02-19T21:47:04.225 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.225 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.226 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:47:04.226 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.242649+0000", 2024-02-19T21:47:04.226 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99385833999999995 2024-02-19T21:47:04.226 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.226 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.226 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.226 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236508+0000", 2024-02-19T21:47:04.226 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0581000000000001e-05 2024-02-19T21:47:04.226 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.226 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.226 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:47:04.226 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236518+0000", 2024-02-19T21:47:04.226 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.131440564 2024-02-19T21:47:04.226 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.226 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.227 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.227 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.367959+0000", 2024-02-19T21:47:04.227 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.0580000000000004e-05 2024-02-19T21:47:04.227 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.227 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.227 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:47:04.227 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368049+0000", 2024-02-19T21:47:04.227 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1537202830000002 2024-02-19T21:47:04.227 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.227 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:47:04.227 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.227 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.227 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.227 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199209 7.c 7:366958b9:::benchmark_data_smithi080_79222_object84475:head [delete] snapc 0=[] ondisk+write+known_if_redirected e143)", 2024-02-19T21:47:04.227 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:30.220544+0000", 2024-02-19T21:47:04.228 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 513.98083015999998, 2024-02-19T21:47:04.228 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.2867079380000002, 2024-02-19T21:47:04.228 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:47:04.228 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "reached pg", 2024-02-19T21:47:04.228 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:47:04.228 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:47:04.228 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:04.228 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199209 2024-02-19T21:47:04.228 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.228 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:47:04.228 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.228 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:47:04.228 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220544+0000", 2024-02-19T21:47:04.229 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:47:04.229 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.229 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.229 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:47:04.229 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220544+0000", 2024-02-19T21:47:04.229 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:47:04.229 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.229 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.229 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:47:04.229 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220543+0000", 2024-02-19T21:47:04.229 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0220000000000004e-06 2024-02-19T21:47:04.229 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.229 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.229 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:47:04.230 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220548+0000", 2024-02-19T21:47:04.230 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.6799999999999999e-06 2024-02-19T21:47:04.230 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.230 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.230 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:47:04.230 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220557+0000", 2024-02-19T21:47:04.230 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.8100000000000003e-06 2024-02-19T21:47:04.230 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.230 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.230 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:47:04.230 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220562+0000", 2024-02-19T21:47:04.230 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.5091e-05 2024-02-19T21:47:04.230 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.230 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.231 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.231 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220597+0000", 2024-02-19T21:47:04.231 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000105196 2024-02-19T21:47:04.231 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.231 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.231 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:47:04.231 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220703+0000", 2024-02-19T21:47:04.231 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000146749 2024-02-19T21:47:04.231 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.231 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.231 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:47:04.231 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220849+0000", 2024-02-19T21:47:04.231 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0024284160000000001 2024-02-19T21:47:04.231 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.232 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.232 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:47:04.232 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.223278+0000", 2024-02-19T21:47:04.232 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0010794349999999999 2024-02-19T21:47:04.232 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.232 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.232 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.232 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.224357+0000", 2024-02-19T21:47:04.232 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.015938191000000001 2024-02-19T21:47:04.232 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.232 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.232 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.232 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.240295+0000", 2024-02-19T21:47:04.232 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1103e-05 2024-02-19T21:47:04.233 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.233 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.233 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:47:04.233 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.240307+0000", 2024-02-19T21:47:04.233 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99564034099999998 2024-02-19T21:47:04.233 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.233 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.233 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.233 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.235947+0000", 2024-02-19T21:47:04.233 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.6800000000000004e-06 2024-02-19T21:47:04.233 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.233 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.233 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:47:04.233 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.235954+0000", 2024-02-19T21:47:04.234 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.271212308 2024-02-19T21:47:04.234 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.234 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.234 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.234 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.507166+0000", 2024-02-19T21:47:04.234 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.6069999999999994e-05 2024-02-19T21:47:04.234 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.234 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.234 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:47:04.234 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.507252+0000", 2024-02-19T21:47:04.234 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.2867079380000002 2024-02-19T21:47:04.234 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.234 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:47:04.234 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.234 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.235 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.235 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199212 7.7 7:e70492a0:::benchmark_data_smithi080_79222_object84478:head [delete] snapc 0=[] ondisk+write+known_if_redirected e143)", 2024-02-19T21:47:04.235 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:30.220597+0000", 2024-02-19T21:47:04.235 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 513.98077752899997, 2024-02-19T21:47:04.235 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.147553088, 2024-02-19T21:47:04.235 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:47:04.235 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "reached pg", 2024-02-19T21:47:04.235 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:47:04.235 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:47:04.235 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:04.235 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199212 2024-02-19T21:47:04.235 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.235 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:47:04.235 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.236 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:47:04.236 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220597+0000", 2024-02-19T21:47:04.236 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:47:04.236 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.236 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.236 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:47:04.236 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220597+0000", 2024-02-19T21:47:04.236 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:47:04.236 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.236 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.236 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:47:04.236 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220596+0000", 2024-02-19T21:47:04.236 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.281e-06 2024-02-19T21:47:04.237 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.237 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.237 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:47:04.237 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220599+0000", 2024-02-19T21:47:04.237 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.7270000000000001e-06 2024-02-19T21:47:04.237 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.237 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.237 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:47:04.237 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220606+0000", 2024-02-19T21:47:04.237 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.25e-06 2024-02-19T21:47:04.237 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.237 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.237 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:47:04.237 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220610+0000", 2024-02-19T21:47:04.238 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.8482000000000002e-05 2024-02-19T21:47:04.238 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.238 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.238 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.238 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220649+0000", 2024-02-19T21:47:04.238 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000108872 2024-02-19T21:47:04.238 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.238 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.238 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:47:04.238 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220758+0000", 2024-02-19T21:47:04.238 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00012441199999999999 2024-02-19T21:47:04.238 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.238 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.238 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,3", 2024-02-19T21:47:04.239 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.220882+0000", 2024-02-19T21:47:04.239 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0028021500000000002 2024-02-19T21:47:04.239 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.239 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.239 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:47:04.239 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.223684+0000", 2024-02-19T21:47:04.239 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.019001483 2024-02-19T21:47:04.239 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.239 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.239 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.239 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.242686+0000", 2024-02-19T21:47:04.239 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.8170000000000004e-06 2024-02-19T21:47:04.239 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.239 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.240 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:47:04.240 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.242692+0000", 2024-02-19T21:47:04.240 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99385727800000001 2024-02-19T21:47:04.240 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.240 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.240 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.240 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236549+0000", 2024-02-19T21:47:04.240 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.7810000000000005e-06 2024-02-19T21:47:04.240 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.240 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.240 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:47:04.240 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236557+0000", 2024-02-19T21:47:04.240 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.131526008 2024-02-19T21:47:04.240 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.241 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.241 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.241 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368083+0000", 2024-02-19T21:47:04.241 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.7107999999999995e-05 2024-02-19T21:47:04.241 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.241 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.241 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:47:04.241 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368150+0000", 2024-02-19T21:47:04.241 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.147553088 2024-02-19T21:47:04.241 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.241 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:47:04.241 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.241 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.241 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.242 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199217 7.c 7:3d739445:::benchmark_data_smithi080_79222_object84483:head [delete] snapc 0=[] ondisk+write+known_if_redirected e143)", 2024-02-19T21:47:04.242 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:30.232520+0000", 2024-02-19T21:47:04.242 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 513.96885443899998, 2024-02-19T21:47:04.242 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.2748104329999999, 2024-02-19T21:47:04.242 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:47:04.242 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "reached pg", 2024-02-19T21:47:04.242 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:47:04.242 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:47:04.242 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:04.242 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199217 2024-02-19T21:47:04.242 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.242 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:47:04.242 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.242 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:47:04.242 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232520+0000", 2024-02-19T21:47:04.243 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:47:04.243 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.243 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.243 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:47:04.243 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232520+0000", 2024-02-19T21:47:04.243 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:47:04.243 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.243 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.243 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:47:04.243 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232518+0000", 2024-02-19T21:47:04.243 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.7600000000000002e-06 2024-02-19T21:47:04.243 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.243 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.243 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:47:04.244 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232526+0000", 2024-02-19T21:47:04.244 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.293e-05 2024-02-19T21:47:04.244 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.244 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.244 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:47:04.244 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232539+0000", 2024-02-19T21:47:04.244 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.289e-06 2024-02-19T21:47:04.244 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.244 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.244 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:47:04.244 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232546+0000", 2024-02-19T21:47:04.244 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014075900000000001 2024-02-19T21:47:04.244 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.244 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.244 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.245 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232687+0000", 2024-02-19T21:47:04.245 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000115995 2024-02-19T21:47:04.245 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.245 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.245 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:47:04.245 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232803+0000", 2024-02-19T21:47:04.245 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000129078 2024-02-19T21:47:04.245 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.245 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.245 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:47:04.245 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232932+0000", 2024-02-19T21:47:04.245 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0074053649999999997 2024-02-19T21:47:04.245 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.245 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.246 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.246 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.240337+0000", 2024-02-19T21:47:04.246 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.1230000000000002e-06 2024-02-19T21:47:04.246 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.246 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.246 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:47:04.246 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.240344+0000", 2024-02-19T21:47:04.246 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99568742200000004 2024-02-19T21:47:04.246 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.246 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.246 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.246 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236032+0000", 2024-02-19T21:47:04.246 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.6689999999999995e-06 2024-02-19T21:47:04.246 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.246 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.247 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:47:04.247 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236040+0000", 2024-02-19T21:47:04.247 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2712470330000001 2024-02-19T21:47:04.247 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.247 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.247 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.247 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.507287+0000", 2024-02-19T21:47:04.247 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.2701999999999999e-05 2024-02-19T21:47:04.247 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.247 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.247 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:47:04.247 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.507330+0000", 2024-02-19T21:47:04.247 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.2748104329999999 2024-02-19T21:47:04.247 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.247 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:47:04.247 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.247 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.248 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.248 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199218 7.7 7:e01213fa:::benchmark_data_smithi080_79222_object84484:head [delete] snapc 0=[] ondisk+write+known_if_redirected e143)", 2024-02-19T21:47:04.248 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:30.232563+0000", 2024-02-19T21:47:04.248 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 513.96881111100004, 2024-02-19T21:47:04.248 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1356496300000001, 2024-02-19T21:47:04.248 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:47:04.248 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "reached pg", 2024-02-19T21:47:04.248 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:47:04.248 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:47:04.248 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:04.248 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199218 2024-02-19T21:47:04.248 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.248 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:47:04.248 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.248 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:47:04.249 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232563+0000", 2024-02-19T21:47:04.249 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:47:04.249 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.249 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.249 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:47:04.249 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232563+0000", 2024-02-19T21:47:04.249 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:47:04.249 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.249 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.249 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:47:04.249 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232562+0000", 2024-02-19T21:47:04.249 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0990000000000001e-06 2024-02-19T21:47:04.249 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.250 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.250 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:47:04.250 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232566+0000", 2024-02-19T21:47:04.250 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.9300000000000003e-06 2024-02-19T21:47:04.250 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.250 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.250 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:47:04.250 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232574+0000", 2024-02-19T21:47:04.250 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.853e-06 2024-02-19T21:47:04.250 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.250 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.250 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:47:04.250 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232579+0000", 2024-02-19T21:47:04.250 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.7021999999999999e-05 2024-02-19T21:47:04.250 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.250 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.251 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.251 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232616+0000", 2024-02-19T21:47:04.251 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00010412300000000001 2024-02-19T21:47:04.251 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.251 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.251 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:47:04.251 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232720+0000", 2024-02-19T21:47:04.251 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000134203 2024-02-19T21:47:04.251 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.251 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.251 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,3", 2024-02-19T21:47:04.251 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.232855+0000", 2024-02-19T21:47:04.251 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0098704629999999995 2024-02-19T21:47:04.251 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.251 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.251 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.252 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.242725+0000", 2024-02-19T21:47:04.252 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0609999999999997e-06 2024-02-19T21:47:04.252 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.252 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.252 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:47:04.252 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.242729+0000", 2024-02-19T21:47:04.252 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99385746399999997 2024-02-19T21:47:04.252 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.252 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.252 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.252 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236587+0000", 2024-02-19T21:47:04.252 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.4880000000000007e-06 2024-02-19T21:47:04.252 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.252 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.253 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:47:04.253 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236595+0000", 2024-02-19T21:47:04.253 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.131577593 2024-02-19T21:47:04.253 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.253 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.253 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.253 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368173+0000", 2024-02-19T21:47:04.253 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0005000000000001e-05 2024-02-19T21:47:04.253 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.253 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.253 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:47:04.253 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368213+0000", 2024-02-19T21:47:04.253 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1356496300000001 2024-02-19T21:47:04.254 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.254 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:47:04.254 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.254 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.254 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.254 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199222 7.1 7:84081eb6:::benchmark_data_smithi080_79222_object84488:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-02-19T21:47:04.254 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:30.243372+0000", 2024-02-19T21:47:04.254 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 513.95800202199996, 2024-02-19T21:47:04.254 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1006799549999999, 2024-02-19T21:47:04.254 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:47:04.254 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:04.254 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:47:04.254 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:47:04.255 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:04.255 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199222 2024-02-19T21:47:04.255 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.255 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:47:04.255 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.255 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:47:04.255 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.243372+0000", 2024-02-19T21:47:04.255 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:47:04.255 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.255 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.255 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:47:04.255 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.243372+0000", 2024-02-19T21:47:04.255 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:47:04.256 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.256 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.256 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:47:04.256 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.243371+0000", 2024-02-19T21:47:04.256 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.6840000000000001e-06 2024-02-19T21:47:04.256 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.256 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.256 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:47:04.256 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.243376+0000", 2024-02-19T21:47:04.256 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.9800000000000004e-06 2024-02-19T21:47:04.256 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.256 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.256 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:47:04.256 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.243385+0000", 2024-02-19T21:47:04.256 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.7089999999999999e-06 2024-02-19T21:47:04.257 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.257 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.257 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:47:04.257 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.243391+0000", 2024-02-19T21:47:04.257 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.8915999999999998e-05 2024-02-19T21:47:04.257 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.257 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.257 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.257 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.243430+0000", 2024-02-19T21:47:04.257 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.127e-06 2024-02-19T21:47:04.257 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.257 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.257 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:47:04.257 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.243436+0000", 2024-02-19T21:47:04.258 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99180459600000004 2024-02-19T21:47:04.258 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.258 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.258 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.258 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.235241+0000", 2024-02-19T21:47:04.258 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.8508e-05 2024-02-19T21:47:04.258 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.258 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.258 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:47:04.258 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.235259+0000", 2024-02-19T21:47:04.258 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.102905794 2024-02-19T21:47:04.258 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.258 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.259 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.259 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.338165+0000", 2024-02-19T21:47:04.259 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0011582179999999999 2024-02-19T21:47:04.259 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.259 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.259 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:47:04.259 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.339323+0000", 2024-02-19T21:47:04.259 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.4108000000000001e-05 2024-02-19T21:47:04.259 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.259 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.259 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,3,4", 2024-02-19T21:47:04.259 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.339417+0000", 2024-02-19T21:47:04.259 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0041340709999999996 2024-02-19T21:47:04.260 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.260 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.260 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:47:04.260 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.343551+0000", 2024-02-19T21:47:04.260 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000292906 2024-02-19T21:47:04.260 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.260 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.260 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.260 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.343844+0000", 2024-02-19T21:47:04.260 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.7210999999999999e-05 2024-02-19T21:47:04.260 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.260 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.261 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.261 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.343892+0000", 2024-02-19T21:47:04.261 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.8293000000000001e-05 2024-02-19T21:47:04.261 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.261 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.261 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.261 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.343930+0000", 2024-02-19T21:47:04.261 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.5883000000000002e-05 2024-02-19T21:47:04.261 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.261 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.261 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:47:04.261 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.343966+0000", 2024-02-19T21:47:04.261 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.6308000000000001e-05 2024-02-19T21:47:04.261 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.262 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.262 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:47:04.262 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.344052+0000", 2024-02-19T21:47:04.262 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1006799549999999 2024-02-19T21:47:04.262 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.262 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:47:04.262 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.262 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.262 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.262 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199223 7.1 7:8394c6aa:::benchmark_data_smithi080_79222_object84489:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-02-19T21:47:04.262 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:30.251632+0000", 2024-02-19T21:47:04.262 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 513.94974210600003, 2024-02-19T21:47:04.262 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.0927566039999999, 2024-02-19T21:47:04.262 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:47:04.263 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:04.263 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:47:04.263 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:47:04.263 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:04.263 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199223 2024-02-19T21:47:04.263 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.263 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:47:04.263 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.263 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:47:04.263 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.251632+0000", 2024-02-19T21:47:04.263 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:47:04.263 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.263 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.263 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:47:04.264 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.251632+0000", 2024-02-19T21:47:04.264 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:47:04.264 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.264 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.264 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:47:04.264 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.251631+0000", 2024-02-19T21:47:04.264 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.0610000000000002e-06 2024-02-19T21:47:04.264 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.264 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.264 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:47:04.264 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.251640+0000", 2024-02-19T21:47:04.264 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.7476999999999999e-05 2024-02-19T21:47:04.264 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.265 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.265 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:47:04.265 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.251657+0000", 2024-02-19T21:47:04.265 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0353999999999999e-05 2024-02-19T21:47:04.265 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.265 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.265 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:47:04.265 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.251667+0000", 2024-02-19T21:47:04.265 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.3464000000000002e-05 2024-02-19T21:47:04.265 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.265 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.265 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.265 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.251721+0000", 2024-02-19T21:47:04.265 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1721e-05 2024-02-19T21:47:04.266 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.266 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.266 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:47:04.266 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.251733+0000", 2024-02-19T21:47:04.266 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.98356867999999997 2024-02-19T21:47:04.266 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.266 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.266 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.266 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.235301+0000", 2024-02-19T21:47:04.266 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.7809999999999994e-06 2024-02-19T21:47:04.266 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.266 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.266 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:47:04.266 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.235310+0000", 2024-02-19T21:47:04.267 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1058049919999999 2024-02-19T21:47:04.267 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.267 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.267 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.267 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.341115+0000", 2024-02-19T21:47:04.267 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013287600000000001 2024-02-19T21:47:04.267 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.267 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.267 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:47:04.267 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.341248+0000", 2024-02-19T21:47:04.267 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00017378200000000001 2024-02-19T21:47:04.267 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.267 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.267 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,3,4", 2024-02-19T21:47:04.268 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.341422+0000", 2024-02-19T21:47:04.268 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.002243835 2024-02-19T21:47:04.268 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.268 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.268 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:47:04.268 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.343666+0000", 2024-02-19T21:47:04.268 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000430672 2024-02-19T21:47:04.268 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.268 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.268 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.268 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.344096+0000", 2024-02-19T21:47:04.268 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.6704e-05 2024-02-19T21:47:04.268 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.268 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.269 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.269 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.344123+0000", 2024-02-19T21:47:04.269 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000162521 2024-02-19T21:47:04.269 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.269 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.269 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.269 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.344286+0000", 2024-02-19T21:47:04.269 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.7529999999999999e-05 2024-02-19T21:47:04.269 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.269 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.269 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:47:04.269 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.344313+0000", 2024-02-19T21:47:04.269 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.5601999999999999e-05 2024-02-19T21:47:04.269 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.269 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.270 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:47:04.270 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.344389+0000", 2024-02-19T21:47:04.270 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.0927566039999999 2024-02-19T21:47:04.270 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.270 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:47:04.270 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.270 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.270 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.270 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199225 7.7 7:e7101b2c:::benchmark_data_smithi080_79222_object84491:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-02-19T21:47:04.270 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:30.264325+0000", 2024-02-19T21:47:04.270 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 513.93704882199995, 2024-02-19T21:47:04.270 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1224556250000002, 2024-02-19T21:47:04.270 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:47:04.270 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:04.270 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:47:04.271 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:47:04.271 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:04.271 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199225 2024-02-19T21:47:04.271 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.271 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:47:04.271 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.271 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:47:04.271 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.264325+0000", 2024-02-19T21:47:04.271 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:47:04.271 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.271 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.271 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:47:04.271 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.264325+0000", 2024-02-19T21:47:04.271 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:47:04.271 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.272 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.272 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:47:04.272 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.264324+0000", 2024-02-19T21:47:04.272 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.6960000000000002e-06 2024-02-19T21:47:04.272 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.272 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.272 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:47:04.272 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.264330+0000", 2024-02-19T21:47:04.272 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.3283e-05 2024-02-19T21:47:04.272 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.272 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.272 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:47:04.272 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.264343+0000", 2024-02-19T21:47:04.272 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.0099999999999998e-06 2024-02-19T21:47:04.273 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.273 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.273 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:47:04.273 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.264350+0000", 2024-02-19T21:47:04.273 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.9267000000000001e-05 2024-02-19T21:47:04.273 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.273 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.273 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.273 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.264400+0000", 2024-02-19T21:47:04.273 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0203e-05 2024-02-19T21:47:04.273 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.273 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.273 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:47:04.273 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.264410+0000", 2024-02-19T21:47:04.273 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.97221051000000003 2024-02-19T21:47:04.274 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.274 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.274 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.274 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236620+0000", 2024-02-19T21:47:04.274 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.2139999999999999e-06 2024-02-19T21:47:04.274 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.274 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.274 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:47:04.274 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236627+0000", 2024-02-19T21:47:04.274 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.131609898 2024-02-19T21:47:04.274 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.274 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.274 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.274 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368237+0000", 2024-02-19T21:47:04.275 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00011917999999999999 2024-02-19T21:47:04.275 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.275 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.275 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:47:04.275 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368357+0000", 2024-02-19T21:47:04.275 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00047232200000000001 2024-02-19T21:47:04.275 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.275 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.275 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1,3", 2024-02-19T21:47:04.275 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368829+0000", 2024-02-19T21:47:04.275 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0085057680000000004 2024-02-19T21:47:04.275 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.275 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.275 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:47:04.275 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.377335+0000", 2024-02-19T21:47:04.276 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0027407709999999999 2024-02-19T21:47:04.276 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.276 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.276 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.276 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.380075+0000", 2024-02-19T21:47:04.276 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0045583339999999998 2024-02-19T21:47:04.276 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.276 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.276 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.276 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.384634+0000", 2024-02-19T21:47:04.276 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0019395289999999999 2024-02-19T21:47:04.276 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.276 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.276 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.277 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.386573+0000", 2024-02-19T21:47:04.277 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.5507999999999997e-05 2024-02-19T21:47:04.277 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.277 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.277 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:47:04.277 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.386639+0000", 2024-02-19T21:47:04.277 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000142177 2024-02-19T21:47:04.277 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.277 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.277 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:47:04.277 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.386781+0000", 2024-02-19T21:47:04.277 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1224556250000002 2024-02-19T21:47:04.277 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.277 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:47:04.278 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.278 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.278 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.278 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199240 7.7 7:ecb96328:::benchmark_data_smithi080_79222_object84506:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-02-19T21:47:04.278 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:30.315926+0000", 2024-02-19T21:47:04.278 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 513.885448064, 2024-02-19T21:47:04.278 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.080005286, 2024-02-19T21:47:04.278 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:47:04.278 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:04.278 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:47:04.278 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:47:04.278 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:04.278 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199240 2024-02-19T21:47:04.278 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.278 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:47:04.279 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.279 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:47:04.279 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.315926+0000", 2024-02-19T21:47:04.279 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:47:04.279 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.279 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.279 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:47:04.279 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.315926+0000", 2024-02-19T21:47:04.279 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999976 2024-02-19T21:47:04.279 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.279 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.279 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:47:04.279 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.315924+0000", 2024-02-19T21:47:04.280 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.3709999999999999e-05 2024-02-19T21:47:04.280 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.280 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.280 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:47:04.280 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.315937+0000", 2024-02-19T21:47:04.280 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.8242000000000002e-05 2024-02-19T21:47:04.280 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.280 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.280 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:47:04.280 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.315966+0000", 2024-02-19T21:47:04.280 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2466999999999999e-05 2024-02-19T21:47:04.280 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.280 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.280 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:47:04.280 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.315978+0000", 2024-02-19T21:47:04.281 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.7517999999999997e-05 2024-02-19T21:47:04.281 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.281 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.281 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.281 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.316076+0000", 2024-02-19T21:47:04.281 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.8423e-05 2024-02-19T21:47:04.281 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.281 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.281 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:47:04.281 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:30.316094+0000", 2024-02-19T21:47:04.281 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.92064759600000001 2024-02-19T21:47:04.281 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.281 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.281 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.282 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236742+0000", 2024-02-19T21:47:04.282 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0042e-05 2024-02-19T21:47:04.282 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.282 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.282 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:47:04.282 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:31.236752+0000", 2024-02-19T21:47:04.282 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.138470066 2024-02-19T21:47:04.282 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.282 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.282 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.282 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.375222+0000", 2024-02-19T21:47:04.282 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014873800000000001 2024-02-19T21:47:04.282 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.282 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.283 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:47:04.283 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.375371+0000", 2024-02-19T21:47:04.283 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00017589099999999999 2024-02-19T21:47:04.283 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.283 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.283 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1,3", 2024-02-19T21:47:04.283 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.375546+0000", 2024-02-19T21:47:04.283 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.001793258 2024-02-19T21:47:04.283 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.283 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.283 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:47:04.283 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.377340+0000", 2024-02-19T21:47:04.283 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0079979979999999992 2024-02-19T21:47:04.283 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.283 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.283 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.284 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.385338+0000", 2024-02-19T21:47:04.284 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0014799430000000001 2024-02-19T21:47:04.284 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.284 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.284 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.284 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.386818+0000", 2024-02-19T21:47:04.284 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0088757969999999995 2024-02-19T21:47:04.284 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.284 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.284 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.284 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.395693+0000", 2024-02-19T21:47:04.284 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.6478999999999998e-05 2024-02-19T21:47:04.284 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.284 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.285 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:47:04.285 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.395760+0000", 2024-02-19T21:47:04.285 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000171471 2024-02-19T21:47:04.285 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.285 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.285 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:47:04.285 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.395931+0000", 2024-02-19T21:47:04.285 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.080005286 2024-02-19T21:47:04.285 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.285 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:47:04.285 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.285 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.285 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.285 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199243 7.c 7:32d6b0d0:::benchmark_data_smithi080_79222_object84509:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:47:04.286 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:32.358612+0000", 2024-02-19T21:47:04.286 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 511.842761999, 2024-02-19T21:47:04.286 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.17102286999999999, 2024-02-19T21:47:04.286 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:47:04.286 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:04.286 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:47:04.286 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:47:04.286 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:04.286 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199243 2024-02-19T21:47:04.286 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.286 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:47:04.286 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.286 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:47:04.286 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.358612+0000", 2024-02-19T21:47:04.286 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:47:04.287 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.287 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.287 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:47:04.287 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.358612+0000", 2024-02-19T21:47:04.287 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:47:04.287 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.287 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.287 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:47:04.287 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.358610+0000", 2024-02-19T21:47:04.287 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.6910000000000003e-06 2024-02-19T21:47:04.287 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.287 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.287 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:47:04.287 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.358619+0000", 2024-02-19T21:47:04.287 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2391999999999999e-05 2024-02-19T21:47:04.287 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.288 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.288 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:47:04.288 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.358632+0000", 2024-02-19T21:47:04.288 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.5099999999999998e-06 2024-02-19T21:47:04.288 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.288 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.288 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:47:04.288 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.358637+0000", 2024-02-19T21:47:04.288 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.1888000000000002e-05 2024-02-19T21:47:04.288 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.288 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.288 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.288 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.358689+0000", 2024-02-19T21:47:04.288 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0662000000000001e-05 2024-02-19T21:47:04.288 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.289 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.289 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:47:04.289 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.358700+0000", 2024-02-19T21:47:04.289 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.14865595600000001 2024-02-19T21:47:04.289 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.289 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.289 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.289 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.507356+0000", 2024-02-19T21:47:04.289 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.4226000000000003e-05 2024-02-19T21:47:04.289 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.289 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.289 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:47:04.289 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.507440+0000", 2024-02-19T21:47:04.289 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00047858500000000001 2024-02-19T21:47:04.289 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.290 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.290 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 2,3,7", 2024-02-19T21:47:04.290 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.507918+0000", 2024-02-19T21:47:04.290 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.015245470000000001 2024-02-19T21:47:04.290 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.290 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.290 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.290 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.523164+0000", 2024-02-19T21:47:04.290 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.773e-05 2024-02-19T21:47:04.290 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.290 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.290 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.290 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.523202+0000", 2024-02-19T21:47:04.290 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.6146999999999998e-05 2024-02-19T21:47:04.291 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.291 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.291 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.291 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.523238+0000", 2024-02-19T21:47:04.291 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0062431229999999997 2024-02-19T21:47:04.291 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.291 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.291 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:47:04.291 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.529481+0000", 2024-02-19T21:47:04.291 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.8912000000000002e-05 2024-02-19T21:47:04.291 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.291 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.291 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:47:04.291 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.529530+0000", 2024-02-19T21:47:04.292 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00010529199999999999 2024-02-19T21:47:04.292 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.292 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.292 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:47:04.292 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.529635+0000", 2024-02-19T21:47:04.292 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.17102286999999999 2024-02-19T21:47:04.292 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.292 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:47:04.292 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.292 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.292 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.292 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:199244 7.c 7:379204a8:::benchmark_data_smithi080_79222_object84510:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:47:04.292 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:32.368056+0000", 2024-02-19T21:47:04.292 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 511.83331789099998, 2024-02-19T21:47:04.292 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.161730017, 2024-02-19T21:47:04.293 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:47:04.293 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:04.293 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:47:04.293 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:47:04.293 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:04.293 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 199244 2024-02-19T21:47:04.293 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.293 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:47:04.293 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.293 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:47:04.293 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368056+0000", 2024-02-19T21:47:04.293 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:47:04.293 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.293 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.293 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:47:04.294 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368056+0000", 2024-02-19T21:47:04.294 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:47:04.294 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.294 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.294 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:47:04.294 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368054+0000", 2024-02-19T21:47:04.294 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.8789999999999992e-06 2024-02-19T21:47:04.294 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.294 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.294 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:47:04.294 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368063+0000", 2024-02-19T21:47:04.294 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2001000000000001e-05 2024-02-19T21:47:04.294 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.294 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.294 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:47:04.295 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368075+0000", 2024-02-19T21:47:04.295 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.5289999999999997e-06 2024-02-19T21:47:04.295 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.295 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.295 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:47:04.295 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368082+0000", 2024-02-19T21:47:04.295 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0662999999999999e-05 2024-02-19T21:47:04.295 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.295 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.295 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.295 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368133+0000", 2024-02-19T21:47:04.295 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.6269999999999995e-06 2024-02-19T21:47:04.295 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.295 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.295 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:47:04.295 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.368142+0000", 2024-02-19T21:47:04.296 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.14907314799999999 2024-02-19T21:47:04.296 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.296 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.296 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.296 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.517215+0000", 2024-02-19T21:47:04.296 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000144287 2024-02-19T21:47:04.296 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.296 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.296 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:47:04.296 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.517360+0000", 2024-02-19T21:47:04.296 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000171189 2024-02-19T21:47:04.296 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.296 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.296 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 2,3,7", 2024-02-19T21:47:04.296 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.517531+0000", 2024-02-19T21:47:04.297 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0057492419999999999 2024-02-19T21:47:04.297 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.297 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.297 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.297 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.523280+0000", 2024-02-19T21:47:04.297 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.6207e-05 2024-02-19T21:47:04.297 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.297 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.297 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.297 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.523326+0000", 2024-02-19T21:47:04.297 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0056854949999999996 2024-02-19T21:47:04.297 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.297 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.297 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.297 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.529012+0000", 2024-02-19T21:47:04.297 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00063114099999999999 2024-02-19T21:47:04.298 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.298 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.298 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:47:04.298 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.529643+0000", 2024-02-19T21:47:04.298 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0198999999999999e-05 2024-02-19T21:47:04.298 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.298 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.298 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:47:04.298 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.529683+0000", 2024-02-19T21:47:04.298 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0001032 2024-02-19T21:47:04.298 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.298 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.298 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:47:04.298 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:32.529786+0000", 2024-02-19T21:47:04.298 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.161730017 2024-02-19T21:47:04.298 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.299 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:47:04.299 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.299 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.299 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.299 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:206643 7.7 7:ed6e881f:::benchmark_data_smithi080_79222_object91909:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:47:04.299 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:40.951493+0000", 2024-02-19T21:47:04.299 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 503.24988071899998, 2024-02-19T21:47:04.299 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.086843371000000003, 2024-02-19T21:47:04.299 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:47:04.299 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:04.299 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:47:04.299 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:47:04.299 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:04.299 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 206643 2024-02-19T21:47:04.299 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.299 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:47:04.299 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.300 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:47:04.300 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.951493+0000", 2024-02-19T21:47:04.300 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:47:04.300 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.300 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.300 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:47:04.300 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.951493+0000", 2024-02-19T21:47:04.300 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:47:04.300 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.300 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.300 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:47:04.300 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.951492+0000", 2024-02-19T21:47:04.300 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.8870000000000003e-06 2024-02-19T21:47:04.300 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.301 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.301 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:47:04.301 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.951499+0000", 2024-02-19T21:47:04.301 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.7589999999999992e-06 2024-02-19T21:47:04.301 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.301 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.301 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:47:04.301 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.951509+0000", 2024-02-19T21:47:04.301 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.7649999999999999e-06 2024-02-19T21:47:04.301 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.301 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.301 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:47:04.301 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.951515+0000", 2024-02-19T21:47:04.301 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00021464499999999999 2024-02-19T21:47:04.302 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.302 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.302 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.302 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.951729+0000", 2024-02-19T21:47:04.302 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000126231 2024-02-19T21:47:04.302 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.302 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.302 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:47:04.302 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.951855+0000", 2024-02-19T21:47:04.302 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00015909999999999999 2024-02-19T21:47:04.302 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.302 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.302 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1,3", 2024-02-19T21:47:04.302 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.952015+0000", 2024-02-19T21:47:04.303 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0030639819999999998 2024-02-19T21:47:04.303 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.303 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.303 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:47:04.303 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.955079+0000", 2024-02-19T21:47:04.303 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.015306619 2024-02-19T21:47:04.303 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.303 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.303 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.303 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.970385+0000", 2024-02-19T21:47:04.303 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00049222899999999995 2024-02-19T21:47:04.303 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.303 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.303 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.303 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.970877+0000", 2024-02-19T21:47:04.304 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.067260906999999995 2024-02-19T21:47:04.304 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.304 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.304 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.304 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:41.038138+0000", 2024-02-19T21:47:04.304 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.982e-05 2024-02-19T21:47:04.304 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.304 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.304 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:47:04.304 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:41.038198+0000", 2024-02-19T21:47:04.304 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013866900000000001 2024-02-19T21:47:04.304 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.304 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.304 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:47:04.305 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:41.038337+0000", 2024-02-19T21:47:04.305 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.086843371000000003 2024-02-19T21:47:04.305 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.305 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:47:04.305 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.305 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.305 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.305 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:206653 7.d 7:b0a06478:::benchmark_data_smithi080_79222_object91919:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:47:04.305 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:40.963286+0000", 2024-02-19T21:47:04.305 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 503.23808815699999, 2024-02-19T21:47:04.305 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.081431297, 2024-02-19T21:47:04.305 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:47:04.305 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:04.305 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:47:04.306 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:47:04.306 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:04.306 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 206653 2024-02-19T21:47:04.306 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.306 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:47:04.306 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.306 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:47:04.306 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.963286+0000", 2024-02-19T21:47:04.306 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:47:04.306 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.306 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.306 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:47:04.306 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.963286+0000", 2024-02-19T21:47:04.306 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:47:04.306 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.306 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.307 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:47:04.307 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.963285+0000", 2024-02-19T21:47:04.307 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.9349999999999997e-06 2024-02-19T21:47:04.307 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.307 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.307 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:47:04.307 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.963291+0000", 2024-02-19T21:47:04.307 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.5730999999999999e-05 2024-02-19T21:47:04.307 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.307 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.307 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:47:04.307 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.963307+0000", 2024-02-19T21:47:04.307 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.1879999999999999e-06 2024-02-19T21:47:04.307 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.308 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.308 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:47:04.308 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.963313+0000", 2024-02-19T21:47:04.308 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.2889000000000002e-05 2024-02-19T21:47:04.308 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.308 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.308 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.308 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.963356+0000", 2024-02-19T21:47:04.308 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00010317 2024-02-19T21:47:04.308 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.308 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.308 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:47:04.308 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.963459+0000", 2024-02-19T21:47:04.308 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00011767100000000001 2024-02-19T21:47:04.309 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.309 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.309 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:47:04.309 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.963577+0000", 2024-02-19T21:47:04.309 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0025371909999999998 2024-02-19T21:47:04.309 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.309 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.309 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:47:04.309 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.966114+0000", 2024-02-19T21:47:04.309 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0087907550000000008 2024-02-19T21:47:04.309 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.309 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.309 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.309 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:40.974905+0000", 2024-02-19T21:47:04.310 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.069734184000000005 2024-02-19T21:47:04.310 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.310 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.310 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.310 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:41.044639+0000", 2024-02-19T21:47:04.310 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.1242000000000003e-05 2024-02-19T21:47:04.310 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.310 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.310 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:47:04.310 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:41.044680+0000", 2024-02-19T21:47:04.310 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.6803e-05 2024-02-19T21:47:04.310 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.310 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.310 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:47:04.311 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:41.044717+0000", 2024-02-19T21:47:04.311 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.081431297 2024-02-19T21:47:04.311 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.311 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:47:04.311 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.311 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.311 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.311 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:207584 7.7 7:ec3844c7:::benchmark_data_smithi080_79222_object92850:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:47:04.311 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:42.091282+0000", 2024-02-19T21:47:04.311 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 502.11009192199998, 2024-02-19T21:47:04.311 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.10409320900000001, 2024-02-19T21:47:04.311 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:47:04.311 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:04.311 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:47:04.312 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:47:04.312 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:04.312 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 207584 2024-02-19T21:47:04.312 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.312 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:47:04.312 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.312 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:47:04.312 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.091282+0000", 2024-02-19T21:47:04.312 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:47:04.312 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.312 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.312 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:47:04.312 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.091282+0000", 2024-02-19T21:47:04.312 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:47:04.313 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.313 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.313 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:47:04.313 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.091281+0000", 2024-02-19T21:47:04.313 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.7429999999999996e-06 2024-02-19T21:47:04.313 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.313 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.313 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:47:04.313 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.091288+0000", 2024-02-19T21:47:04.313 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2091e-05 2024-02-19T21:47:04.313 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.313 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.313 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:47:04.313 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.091300+0000", 2024-02-19T21:47:04.313 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.9460000000000003e-06 2024-02-19T21:47:04.314 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.314 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.314 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:47:04.314 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.091306+0000", 2024-02-19T21:47:04.314 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.9030999999999997e-05 2024-02-19T21:47:04.314 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.314 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.314 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.314 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.091375+0000", 2024-02-19T21:47:04.314 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00011971 2024-02-19T21:47:04.314 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.314 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.314 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:47:04.314 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.091495+0000", 2024-02-19T21:47:04.314 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00016302499999999999 2024-02-19T21:47:04.315 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.315 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.315 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1,3", 2024-02-19T21:47:04.315 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.091658+0000", 2024-02-19T21:47:04.315 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0064095289999999997 2024-02-19T21:47:04.315 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.315 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.315 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:47:04.315 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.098067+0000", 2024-02-19T21:47:04.315 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.001025693 2024-02-19T21:47:04.315 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.315 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.315 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.315 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099093+0000", 2024-02-19T21:47:04.316 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0040436500000000002 2024-02-19T21:47:04.316 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.316 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.316 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.316 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.103137+0000", 2024-02-19T21:47:04.316 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.092109941000000001 2024-02-19T21:47:04.316 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.316 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.316 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.316 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.195247+0000", 2024-02-19T21:47:04.316 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.7958999999999999e-05 2024-02-19T21:47:04.316 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.316 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.316 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:47:04.317 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.195294+0000", 2024-02-19T21:47:04.317 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.0958999999999995e-05 2024-02-19T21:47:04.317 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.317 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.317 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:47:04.317 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.195375+0000", 2024-02-19T21:47:04.317 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.10409320900000001 2024-02-19T21:47:04.317 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.317 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:47:04.317 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.317 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.317 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.317 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:207586 7.d 7:b9ba961f:::benchmark_data_smithi080_79222_object92852:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:47:04.318 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:42.094622+0000", 2024-02-19T21:47:04.318 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 502.10675241299998, 2024-02-19T21:47:04.318 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.089242795999999999, 2024-02-19T21:47:04.318 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:47:04.318 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:04.318 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:47:04.318 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:47:04.318 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:04.318 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 207586 2024-02-19T21:47:04.318 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.318 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:47:04.318 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.318 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:47:04.319 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094622+0000", 2024-02-19T21:47:04.319 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:47:04.319 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.319 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.319 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:47:04.319 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094622+0000", 2024-02-19T21:47:04.319 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:47:04.319 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.319 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.319 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:47:04.319 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094620+0000", 2024-02-19T21:47:04.319 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.1400000000000002e-06 2024-02-19T21:47:04.319 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.319 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.320 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:47:04.320 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094627+0000", 2024-02-19T21:47:04.320 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1995e-05 2024-02-19T21:47:04.320 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.320 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.320 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:47:04.320 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094639+0000", 2024-02-19T21:47:04.320 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.0249999999999999e-06 2024-02-19T21:47:04.320 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.320 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.320 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:47:04.320 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094645+0000", 2024-02-19T21:47:04.320 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.5117000000000002e-05 2024-02-19T21:47:04.321 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.321 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.321 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.321 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094690+0000", 2024-02-19T21:47:04.321 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00012526900000000001 2024-02-19T21:47:04.321 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.321 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.321 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:47:04.321 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094816+0000", 2024-02-19T21:47:04.321 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00012976599999999999 2024-02-19T21:47:04.321 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.321 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.321 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:47:04.321 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094945+0000", 2024-02-19T21:47:04.321 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0028760909999999999 2024-02-19T21:47:04.322 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.322 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.322 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:47:04.322 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.097821+0000", 2024-02-19T21:47:04.322 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0070416719999999997 2024-02-19T21:47:04.322 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.322 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.322 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.322 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.104863+0000", 2024-02-19T21:47:04.322 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.078907110000000003 2024-02-19T21:47:04.322 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.322 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.322 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.322 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.183770+0000", 2024-02-19T21:47:04.322 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0040000000000002e-05 2024-02-19T21:47:04.322 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.323 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.323 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:47:04.323 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.183820+0000", 2024-02-19T21:47:04.323 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.4211000000000001e-05 2024-02-19T21:47:04.323 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.323 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.323 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:47:04.323 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.183865+0000", 2024-02-19T21:47:04.323 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.089242795999999999 2024-02-19T21:47:04.323 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.323 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:47:04.323 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.323 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.323 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.323 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:207589 7.7 7:e6ce6b61:::benchmark_data_smithi080_79222_object92855:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:47:04.324 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:42.094660+0000", 2024-02-19T21:47:04.324 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 502.10671405800002, 2024-02-19T21:47:04.324 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.10097279000000001, 2024-02-19T21:47:04.324 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:47:04.324 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:04.324 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:47:04.324 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:47:04.324 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:04.324 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 207589 2024-02-19T21:47:04.324 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.324 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:47:04.324 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.324 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:47:04.324 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094660+0000", 2024-02-19T21:47:04.325 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:47:04.325 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.325 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.325 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:47:04.325 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094660+0000", 2024-02-19T21:47:04.325 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:47:04.325 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.325 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.325 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:47:04.325 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094660+0000", 2024-02-19T21:47:04.325 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.948e-06 2024-02-19T21:47:04.325 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.325 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.325 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:47:04.325 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094663+0000", 2024-02-19T21:47:04.325 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.2609999999999999e-06 2024-02-19T21:47:04.326 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.326 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.326 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:47:04.326 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094669+0000", 2024-02-19T21:47:04.326 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.7189999999999999e-06 2024-02-19T21:47:04.326 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.326 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.326 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:47:04.326 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094673+0000", 2024-02-19T21:47:04.326 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.3884999999999997e-05 2024-02-19T21:47:04.326 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.326 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.326 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.326 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094716+0000", 2024-02-19T21:47:04.326 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00011217099999999999 2024-02-19T21:47:04.326 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.326 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.327 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:47:04.327 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.094829+0000", 2024-02-19T21:47:04.327 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00040904199999999998 2024-02-19T21:47:04.327 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.327 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.327 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1,3", 2024-02-19T21:47:04.327 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.095238+0000", 2024-02-19T21:47:04.327 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0029471250000000001 2024-02-19T21:47:04.327 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.327 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.327 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:47:04.327 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.098185+0000", 2024-02-19T21:47:04.327 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0049020060000000004 2024-02-19T21:47:04.327 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.327 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.327 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.328 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.103087+0000", 2024-02-19T21:47:04.328 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.8848e-05 2024-02-19T21:47:04.328 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.328 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.328 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.328 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.103176+0000", 2024-02-19T21:47:04.328 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.092253600000000005 2024-02-19T21:47:04.328 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.328 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.328 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.328 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.195429+0000", 2024-02-19T21:47:04.328 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.7788999999999998e-05 2024-02-19T21:47:04.328 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.328 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.328 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:47:04.329 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.195487+0000", 2024-02-19T21:47:04.329 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014587199999999999 2024-02-19T21:47:04.329 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.329 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.329 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:47:04.329 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.195633+0000", 2024-02-19T21:47:04.329 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.10097279000000001 2024-02-19T21:47:04.329 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.329 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:47:04.329 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.329 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.329 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.329 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:207593 7.d 7:bde9a27f:::benchmark_data_smithi080_79222_object92859:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:47:04.329 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:42.099023+0000", 2024-02-19T21:47:04.329 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 502.10235148800001, 2024-02-19T21:47:04.330 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.085093337000000005, 2024-02-19T21:47:04.330 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:47:04.330 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:04.330 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:47:04.330 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:47:04.330 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:04.330 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 207593 2024-02-19T21:47:04.330 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.330 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:47:04.330 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.330 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:47:04.330 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099023+0000", 2024-02-19T21:47:04.330 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:47:04.330 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.330 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.331 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:47:04.331 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099023+0000", 2024-02-19T21:47:04.331 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:47:04.331 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.331 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.331 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:47:04.331 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099021+0000", 2024-02-19T21:47:04.331 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.3240000000000003e-06 2024-02-19T21:47:04.331 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.331 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.331 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:47:04.331 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099030+0000", 2024-02-19T21:47:04.331 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.6010000000000001e-05 2024-02-19T21:47:04.331 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.331 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.331 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:47:04.332 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099046+0000", 2024-02-19T21:47:04.332 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.99e-06 2024-02-19T21:47:04.332 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.332 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.332 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:47:04.332 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099053+0000", 2024-02-19T21:47:04.332 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.0587999999999995e-05 2024-02-19T21:47:04.332 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.332 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.332 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.332 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099133+0000", 2024-02-19T21:47:04.332 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00012628800000000001 2024-02-19T21:47:04.332 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.333 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.333 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:47:04.333 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099259+0000", 2024-02-19T21:47:04.333 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014891700000000001 2024-02-19T21:47:04.333 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.333 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.333 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:47:04.333 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.099408+0000", 2024-02-19T21:47:04.333 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0022343329999999998 2024-02-19T21:47:04.333 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.333 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.333 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:47:04.333 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.101643+0000", 2024-02-19T21:47:04.333 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.004290477 2024-02-19T21:47:04.333 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.334 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.334 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.334 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.105933+0000", 2024-02-19T21:47:04.334 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.078084543000000006 2024-02-19T21:47:04.334 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.334 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.334 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.334 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.184018+0000", 2024-02-19T21:47:04.334 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.6813000000000001e-05 2024-02-19T21:47:04.334 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.334 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.334 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:47:04.334 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.184065+0000", 2024-02-19T21:47:04.334 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.1437000000000002e-05 2024-02-19T21:47:04.334 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.334 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.335 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:47:04.335 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.184116+0000", 2024-02-19T21:47:04.335 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.085093337000000005 2024-02-19T21:47:04.335 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.335 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:47:04.335 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.335 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.335 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.335 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.14793.0:207771 7.d 7:bbed4a8a:::benchmark_data_smithi080_79222_object93037:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:47:04.335 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:38:42.355377+0000", 2024-02-19T21:47:04.335 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 501.845997168, 2024-02-19T21:47:04.335 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.086960934000000004, 2024-02-19T21:47:04.335 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:47:04.336 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:04.336 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:47:04.336 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.14793", 2024-02-19T21:47:04.336 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:04.336 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 207771 2024-02-19T21:47:04.336 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.336 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:47:04.336 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.336 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:47:04.336 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.355377+0000", 2024-02-19T21:47:04.336 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:47:04.336 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.336 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.336 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:47:04.336 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.355377+0000", 2024-02-19T21:47:04.337 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:47:04.337 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.337 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.337 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:47:04.337 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.355376+0000", 2024-02-19T21:47:04.337 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.5729999999999996e-06 2024-02-19T21:47:04.337 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.337 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.337 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:47:04.337 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.355382+0000", 2024-02-19T21:47:04.337 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2806000000000001e-05 2024-02-19T21:47:04.337 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.337 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.337 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:47:04.337 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.355395+0000", 2024-02-19T21:47:04.337 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.9199999999999998e-06 2024-02-19T21:47:04.338 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.338 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.338 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:47:04.338 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.355402+0000", 2024-02-19T21:47:04.338 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0016894709999999999 2024-02-19T21:47:04.338 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.338 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.338 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:04.338 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.357092+0000", 2024-02-19T21:47:04.338 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.1039999999999996e-05 2024-02-19T21:47:04.338 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.338 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.338 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:47:04.338 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.357183+0000", 2024-02-19T21:47:04.338 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000119494 2024-02-19T21:47:04.339 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.339 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.339 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:47:04.339 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.357302+0000", 2024-02-19T21:47:04.339 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.001513588 2024-02-19T21:47:04.339 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.339 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.339 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:47:04.339 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.358816+0000", 2024-02-19T21:47:04.339 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00024683700000000002 2024-02-19T21:47:04.339 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.339 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.339 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.339 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.359063+0000", 2024-02-19T21:47:04.340 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.083179931999999998 2024-02-19T21:47:04.340 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.340 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.340 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:04.340 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.442243+0000", 2024-02-19T21:47:04.340 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.4695999999999999e-05 2024-02-19T21:47:04.340 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.340 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.340 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:47:04.340 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.442297+0000", 2024-02-19T21:47:04.340 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0704999999999997e-05 2024-02-19T21:47:04.340 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:04.341 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:04.341 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:47:04.341 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:38:42.442338+0000", 2024-02-19T21:47:04.341 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.086960934000000004 2024-02-19T21:47:04.341 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.341 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:47:04.341 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.341 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:04.341 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:47:04.341 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:47:04.341 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:47:04.386 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:04.722 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-19T21:47:04.756 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:03.102847+0000 mgr.y (mgr.14514) 556 : cluster [DBG] pgmap v699: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 4.1 GiB data, 15 GiB used, 610 GiB / 626 GiB avail; 852 B/s rd, 0 B/s wr, 807 op/s 2024-02-19T21:47:04.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:03.832119+0000 mon.c (mon.2) 76 : audit [DBG] from='client.? 172.21.15.80:0/4271653953' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:47:04.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:03.960023+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:47:04.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:03.102847+0000 mgr.y (mgr.14514) 556 : cluster [DBG] pgmap v699: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 4.1 GiB data, 15 GiB used, 610 GiB / 626 GiB avail; 852 B/s rd, 0 B/s wr, 807 op/s 2024-02-19T21:47:04.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:03.832119+0000 mon.c (mon.2) 76 : audit [DBG] from='client.? 172.21.15.80:0/4271653953' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:47:04.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:03.960023+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:47:04.948 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:47:04.951 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:04.951 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:47:05.052 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:47:05.065 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:03.102847+0000 mgr.y (mgr.14514) 556 : cluster [DBG] pgmap v699: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 4.1 GiB data, 15 GiB used, 610 GiB / 626 GiB avail; 852 B/s rd, 0 B/s wr, 807 op/s 2024-02-19T21:47:05.065 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:03.832119+0000 mon.c (mon.2) 76 : audit [DBG] from='client.? 172.21.15.80:0/4271653953' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:47:05.065 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:03.960023+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:47:05.097 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:47:05.109 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:05.111 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.7 dump_ops_in_flight 2024-02-19T21:47:05.148 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:47:05.152 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:05.152 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:47:05.253 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:47:05.282 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:05.331 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:47:05.336 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:05.337 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:47:05.438 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:47:05.491 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:05.540 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:47:05.544 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:05.544 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:47:05.573 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:47:05.625 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:47:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:47:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:47:05.645 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:47:05.694 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:05.784 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:47:05.788 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:05.789 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:47:05.890 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:47:05.958 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:05.992 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:47:05.994 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:05.995 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:47:06.095 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:47:06.124 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 6, 7] out_osds: [2] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:47:06.124 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:47:06.124 INFO:tasks.thrashosds.thrasher:Adding osd 2 2024-02-19T21:47:06.125 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd in 2 2024-02-19T21:47:06.141 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:06.204 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:05.103341+0000 mgr.y (mgr.14514) 557 : cluster [DBG] pgmap v700: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 4.1 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 675 B/s rd, 0 B/s wr, 716 op/s 2024-02-19T21:47:06.204 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:05.189777+0000 mon.a (mon.0) 1438 : cluster [DBG] osdmap e342: 8 total, 8 up, 7 in 2024-02-19T21:47:06.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:05.103341+0000 mgr.y (mgr.14514) 557 : cluster [DBG] pgmap v700: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 4.1 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 675 B/s rd, 0 B/s wr, 716 op/s 2024-02-19T21:47:06.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:05.189777+0000 mon.a (mon.0) 1438 : cluster [DBG] osdmap e342: 8 total, 8 up, 7 in 2024-02-19T21:47:06.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:05.103341+0000 mgr.y (mgr.14514) 557 : cluster [DBG] pgmap v700: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 4.1 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 675 B/s rd, 0 B/s wr, 716 op/s 2024-02-19T21:47:06.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:05.189777+0000 mon.a (mon.0) 1438 : cluster [DBG] osdmap e342: 8 total, 8 up, 7 in 2024-02-19T21:47:06.517 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:47:06.520 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:06.520 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:47:06.621 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:47:06.661 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:06.792 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:47:06.796 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:06.796 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:47:06.896 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:47:06.897 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:47:06.947 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:07.050 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:47:07.144 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:47:07.149 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:07.150 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:47:07.250 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:47:07.290 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:07.465 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:47:07.478 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:07.478 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:47:07.579 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:47:07.637 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:07.709 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:47:07.714 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:07.715 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:47:07.815 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:47:07.856 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:07.880 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:47:07.880 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [ 2024-02-19T21:47:07.880 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:07.881 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:196045 9.c 9:38abc013:::benchmark_data_smithi080_126364_object67453:head [delete] snapc 0=[] ondisk+write+known_if_redirected e343)", 2024-02-19T21:47:07.881 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:47:07.861018+0000", 2024-02-19T21:47:07.881 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.020148510000000001, 2024-02-19T21:47:07.881 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.020171927999999999, 2024-02-19T21:47:07.881 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:47:07.881 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:47:07.881 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:47:07.881 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:47:07.881 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:47:07.881 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 196045 2024-02-19T21:47:07.881 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:07.882 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:47:07.882 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:07.882 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:47:07.882 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:07.861018+0000", 2024-02-19T21:47:07.882 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:47:07.882 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:07.882 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:07.882 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:47:07.882 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:07.861018+0000", 2024-02-19T21:47:07.882 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:47:07.882 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:07.882 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:07.883 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:47:07.883 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:07.861017+0000", 2024-02-19T21:47:07.883 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.72e-06 2024-02-19T21:47:07.883 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:07.883 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:07.883 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:47:07.883 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:07.861021+0000", 2024-02-19T21:47:07.883 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.1659999999999997e-06 2024-02-19T21:47:07.883 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:07.883 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:07.883 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:47:07.883 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:07.861028+0000", 2024-02-19T21:47:07.883 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.3420000000000001e-06 2024-02-19T21:47:07.883 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:07.884 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:07.884 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:47:07.884 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:07.861032+0000", 2024-02-19T21:47:07.884 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0053182439999999997 2024-02-19T21:47:07.884 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:07.884 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:07.884 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:47:07.884 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:07.866350+0000", 2024-02-19T21:47:07.884 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000119222 2024-02-19T21:47:07.884 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:07.884 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:07.885 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:47:07.885 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:07.866470+0000", 2024-02-19T21:47:07.885 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000139954 2024-02-19T21:47:07.885 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:07.885 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:07.885 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:47:07.885 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:07.866610+0000", 2024-02-19T21:47:07.885 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0048686049999999998 2024-02-19T21:47:07.885 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:07.885 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:07.885 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:47:07.885 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:07.871478+0000", 2024-02-19T21:47:07.885 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0049830270000000001 2024-02-19T21:47:07.885 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:47:07.886 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:47:07.886 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:07.886 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:07.876461+0000", 2024-02-19T21:47:07.886 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.015443658000000001 2024-02-19T21:47:07.886 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:07.886 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:47:07.886 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:07.886 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:47:07.886 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-02-19T21:47:07.886 INFO:teuthology.orchestra.run.smithi157.stdout: "num_ops": 1 2024-02-19T21:47:07.886 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:47:07.917 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:47:07.922 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:07.922 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:47:07.961 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:47:08.023 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:47:08.066 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:08.220 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:47:08.221 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:06.538951+0000 osd.1 (osd.1) 217 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:47:08.221 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:06.539010+0000 osd.1 (osd.1) 218 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:47:08.221 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:07.104477+0000 mgr.y (mgr.14514) 558 : cluster [DBG] pgmap v702: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 3.9 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 740 B/s rd, 0 B/s wr, 839 op/s 2024-02-19T21:47:08.221 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:07.217924+0000 mon.a (mon.0) 1439 : cluster [DBG] osdmap e343: 8 total, 8 up, 7 in 2024-02-19T21:47:08.221 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:07.389478+0000 mon.b (mon.1) 59 : audit [INF] from='client.? 172.21.15.80:0/2714239229' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:47:08.221 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:07.392616+0000 mon.a (mon.0) 1440 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:47:08.223 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:08.224 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:47:08.224 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:06.538951+0000 osd.1 (osd.1) 217 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:47:08.224 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:06.539010+0000 osd.1 (osd.1) 218 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:47:08.225 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:07.104477+0000 mgr.y (mgr.14514) 558 : cluster [DBG] pgmap v702: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 3.9 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 740 B/s rd, 0 B/s wr, 839 op/s 2024-02-19T21:47:08.225 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:07.217924+0000 mon.a (mon.0) 1439 : cluster [DBG] osdmap e343: 8 total, 8 up, 7 in 2024-02-19T21:47:08.225 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:07.389478+0000 mon.b (mon.1) 59 : audit [INF] from='client.? 172.21.15.80:0/2714239229' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:47:08.225 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:07.392616+0000 mon.a (mon.0) 1440 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:47:08.242 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-02-19T21:47:08.325 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:47:08.372 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:08.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:06.538951+0000 osd.1 (osd.1) 217 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:47:08.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:06.539010+0000 osd.1 (osd.1) 218 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:47:08.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:07.104477+0000 mgr.y (mgr.14514) 558 : cluster [DBG] pgmap v702: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 3.9 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 740 B/s rd, 0 B/s wr, 839 op/s 2024-02-19T21:47:08.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:07.217924+0000 mon.a (mon.0) 1439 : cluster [DBG] osdmap e343: 8 total, 8 up, 7 in 2024-02-19T21:47:08.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:07.389478+0000 mon.b (mon.1) 59 : audit [INF] from='client.? 172.21.15.80:0/2714239229' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:47:08.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:07.392616+0000 mon.a (mon.0) 1440 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:47:08.759 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:47:08.770 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:08.770 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:47:08.794 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.7 dump_blocked_ops 2024-02-19T21:47:08.871 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:47:08.908 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:08.943 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:47:08.947 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:08.948 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:47:09.049 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:47:09.085 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:09.167 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:47:09.170 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:09.170 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:47:09.269 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:47:09.271 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:47:09.320 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:09.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:08.210658+0000 mon.a (mon.0) 1441 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:47:09.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:08.228996+0000 mon.a (mon.0) 1442 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:47:09.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:08.229067+0000 mon.a (mon.0) 1443 : cluster [DBG] osdmap e344: 8 total, 8 up, 7 in 2024-02-19T21:47:09.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:08.210658+0000 mon.a (mon.0) 1441 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:47:09.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:08.228996+0000 mon.a (mon.0) 1442 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:47:09.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:08.229067+0000 mon.a (mon.0) 1443 : cluster [DBG] osdmap e344: 8 total, 8 up, 7 in 2024-02-19T21:47:09.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:08.210658+0000 mon.a (mon.0) 1441 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:47:09.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:08.228996+0000 mon.a (mon.0) 1442 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:47:09.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:08.229067+0000 mon.a (mon.0) 1443 : cluster [DBG] osdmap e344: 8 total, 8 up, 7 in 2024-02-19T21:47:09.675 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:47:09.680 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:09.681 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:47:09.781 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:47:09.822 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:10.082 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:47:10.089 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:10.089 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:47:10.190 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:47:10.245 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:10.302 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:08.527902+0000 osd.6 (osd.6) 209 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:47:10.303 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:08.527957+0000 osd.6 (osd.6) 210 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:47:10.303 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:09.104870+0000 mgr.y (mgr.14514) 559 : cluster [DBG] pgmap v705: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 3.9 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 763 op/s 2024-02-19T21:47:10.303 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:09.244494+0000 mon.a (mon.0) 1444 : cluster [DBG] osdmap e345: 8 total, 8 up, 7 in 2024-02-19T21:47:10.303 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:10.193685+0000 mon.a (mon.0) 1445 : cluster [DBG] osdmap e346: 8 total, 8 up, 7 in 2024-02-19T21:47:10.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:08.527902+0000 osd.6 (osd.6) 209 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:47:10.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:08.527957+0000 osd.6 (osd.6) 210 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:47:10.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:09.104870+0000 mgr.y (mgr.14514) 559 : cluster [DBG] pgmap v705: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 3.9 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 763 op/s 2024-02-19T21:47:10.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:09.244494+0000 mon.a (mon.0) 1444 : cluster [DBG] osdmap e345: 8 total, 8 up, 7 in 2024-02-19T21:47:10.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:10.193685+0000 mon.a (mon.0) 1445 : cluster [DBG] osdmap e346: 8 total, 8 up, 7 in 2024-02-19T21:47:10.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:08.527902+0000 osd.6 (osd.6) 209 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:47:10.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:08.527957+0000 osd.6 (osd.6) 210 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:47:10.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:09.104870+0000 mgr.y (mgr.14514) 559 : cluster [DBG] pgmap v705: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 3.9 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 763 op/s 2024-02-19T21:47:10.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:09.244494+0000 mon.a (mon.0) 1444 : cluster [DBG] osdmap e345: 8 total, 8 up, 7 in 2024-02-19T21:47:10.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:10.193685+0000 mon.a (mon.0) 1445 : cluster [DBG] osdmap e346: 8 total, 8 up, 7 in 2024-02-19T21:47:10.396 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:47:10.414 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:10.415 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:47:10.516 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:47:10.559 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:10.599 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:47:10.602 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:10.603 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:47:10.703 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:47:10.764 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:10.772 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:47:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:47:10] "GET /metrics HTTP/1.1" 200 176161 "" "Prometheus/2.33.4" 2024-02-19T21:47:10.923 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:47:10.928 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:10.928 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:47:11.029 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:47:11.059 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:47:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:47:11.068 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:47:10.921+0000 7f2483437700 -1 mon.a@0(leader).osd e346 definitely_dead 0 2024-02-19T21:47:11.076 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:11.229 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:47:11.231 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:11.231 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:47:11.332 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:47:11.339 INFO:teuthology.orchestra.run.smithi080.stderr:marked in osd.2. 2024-02-19T21:47:11.355 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:10.721687+0000 mgr.y (mgr.14514) 560 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:47:11.355 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:10.922429+0000 mon.a (mon.0) 1446 : audit [DBG] from='client.? 172.21.15.80:0/2054116549' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["2"]}]: dispatch 2024-02-19T21:47:11.355 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:10.721687+0000 mgr.y (mgr.14514) 560 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:47:11.356 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:10.922429+0000 mon.a (mon.0) 1446 : audit [DBG] from='client.? 172.21.15.80:0/2054116549' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["2"]}]: dispatch 2024-02-19T21:47:11.376 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:11.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:10.721687+0000 mgr.y (mgr.14514) 560 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:47:11.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:10.922429+0000 mon.a (mon.0) 1446 : audit [DBG] from='client.? 172.21.15.80:0/2054116549' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["2"]}]: dispatch 2024-02-19T21:47:11.602 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:47:11.602 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [], 2024-02-19T21:47:11.602 INFO:teuthology.orchestra.run.smithi157.stdout: "complaint_time": 30, 2024-02-19T21:47:11.602 INFO:teuthology.orchestra.run.smithi157.stdout: "num_blocked_ops": 0 2024-02-19T21:47:11.602 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:47:11.624 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:47:11.626 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:11.627 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:47:11.659 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:47:11.659 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:47:11.659 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:47:11.659 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:47:11.659 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:47:11.659 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:47:11.659 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:47:11.659 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:47:11.660 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:47:11.660 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:47:11.660 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:47:11.660 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:47:11.660 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:47:11.660 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:47:11.660 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:47:11.660 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:47:11.692 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset noscrub 2024-02-19T21:47:11.728 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:47:11.756 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:12.381 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.7 dump_historic_ops 2024-02-19T21:47:12.433 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:47:12.436 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:12.437 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:47:12.538 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:47:12.563 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:12.582 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:47:12.584 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:11.107178+0000 mgr.y (mgr.14514) 561 : cluster [DBG] pgmap v708: 138 pgs: 138 active+clean; 3.6 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s 2024-02-19T21:47:12.584 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:11.320405+0000 mon.a (mon.0) 1447 : audit [INF] from='client.? 172.21.15.80:0/2054116549' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["2"]}]': finished 2024-02-19T21:47:12.584 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:11.320451+0000 mon.a (mon.0) 1448 : cluster [DBG] osdmap e347: 8 total, 8 up, 8 in 2024-02-19T21:47:12.584 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:11.512420+0000 mon.a (mon.0) 1449 : audit [DBG] from='client.? 172.21.15.80:0/999880689' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:47:12.585 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:12.585 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:47:12.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:11.107178+0000 mgr.y (mgr.14514) 561 : cluster [DBG] pgmap v708: 138 pgs: 138 active+clean; 3.6 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s 2024-02-19T21:47:12.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:11.320405+0000 mon.a (mon.0) 1447 : audit [INF] from='client.? 172.21.15.80:0/2054116549' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["2"]}]': finished 2024-02-19T21:47:12.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:11.320451+0000 mon.a (mon.0) 1448 : cluster [DBG] osdmap e347: 8 total, 8 up, 8 in 2024-02-19T21:47:12.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:11.512420+0000 mon.a (mon.0) 1449 : audit [DBG] from='client.? 172.21.15.80:0/999880689' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:47:12.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:11.107178+0000 mgr.y (mgr.14514) 561 : cluster [DBG] pgmap v708: 138 pgs: 138 active+clean; 3.6 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s 2024-02-19T21:47:12.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:11.320405+0000 mon.a (mon.0) 1447 : audit [INF] from='client.? 172.21.15.80:0/2054116549' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["2"]}]': finished 2024-02-19T21:47:12.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:11.320451+0000 mon.a (mon.0) 1448 : cluster [DBG] osdmap e347: 8 total, 8 up, 8 in 2024-02-19T21:47:12.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:11.512420+0000 mon.a (mon.0) 1449 : audit [DBG] from='client.? 172.21.15.80:0/999880689' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:47:12.686 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:47:12.692 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:47:12.714 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:13.298 INFO:tasks.thrashosds.thrasher:Added osd 2 2024-02-19T21:47:13.357 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:47:13.365 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:47:13.368 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:13.369 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:47:13.469 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:47:13.536 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:12.318279+0000 mon.a (mon.0) 1450 : cluster [DBG] osdmap e348: 8 total, 8 up, 8 in 2024-02-19T21:47:13.537 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:12.318279+0000 mon.a (mon.0) 1450 : cluster [DBG] osdmap e348: 8 total, 8 up, 8 in 2024-02-19T21:47:13.538 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:13.623 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:47:13.627 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:13.628 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:47:13.729 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:47:13.785 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:12.318279+0000 mon.a (mon.0) 1450 : cluster [DBG] osdmap e348: 8 total, 8 up, 8 in 2024-02-19T21:47:13.790 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:13.834 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:47:13.849 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:13.849 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:47:13.950 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:47:13.997 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:14.224 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:47:14.230 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:14.230 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:47:14.331 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:47:14.387 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:14.462 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:47:14.476 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:47:14.487 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:14.488 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:47:14.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:13.107465+0000 mgr.y (mgr.14514) 562 : cluster [DBG] pgmap v711: 138 pgs: 138 active+clean; 3.6 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s 2024-02-19T21:47:14.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:13.321027+0000 osd.5 (osd.5) 242 : cluster [DBG] 9.6 starting backfill to osd.2 from (0'0,0'0] MAX to 346'12700 2024-02-19T21:47:14.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:13.321763+0000 osd.0 (osd.0) 234 : cluster [DBG] 5.d starting backfill to osd.2 from (0'0,0'0] MAX to 271'13 2024-02-19T21:47:14.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:13.322546+0000 mon.a (mon.0) 1451 : cluster [DBG] osdmap e349: 8 total, 8 up, 8 in 2024-02-19T21:47:14.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:13.322709+0000 osd.1 (osd.1) 219 : cluster [DBG] 9.2 starting backfill to osd.2 from (0'0,0'0] MAX to 346'12369 2024-02-19T21:47:14.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:13.322887+0000 osd.5 (osd.5) 243 : cluster [DBG] 9.f starting backfill to osd.2 from (0'0,0'0] MAX to 346'12439 2024-02-19T21:47:14.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:13.323102+0000 osd.7 (osd.7) 220 : cluster [DBG] 6.1c starting backfill to osd.2 from (0'0,0'0] MAX to 66'1 2024-02-19T21:47:14.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:13.325395+0000 osd.0 (osd.0) 235 : cluster [DBG] 6.8 starting backfill to osd.2 from (0'0,0'0] MAX to 66'1 2024-02-19T21:47:14.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:13.325470+0000 osd.0 (osd.0) 236 : cluster [DBG] 9.0 starting backfill to osd.2 from (0'0,0'0] MAX to 346'12458 2024-02-19T21:47:14.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:13.332474+0000 osd.5 (osd.5) 244 : cluster [DBG] 9.7 starting backfill to osd.2 from (0'0,0'0] MAX to 346'15044 2024-02-19T21:47:14.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:13.333499+0000 osd.0 (osd.0) 237 : cluster [DBG] 9.0 starting backfill to osd.7 from (0'0,0'0] MAX to 346'12458 2024-02-19T21:47:14.588 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:47:14.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:13.107465+0000 mgr.y (mgr.14514) 562 : cluster [DBG] pgmap v711: 138 pgs: 138 active+clean; 3.6 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s 2024-02-19T21:47:14.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:13.321027+0000 osd.5 (osd.5) 242 : cluster [DBG] 9.6 starting backfill to osd.2 from (0'0,0'0] MAX to 346'12700 2024-02-19T21:47:14.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:13.321763+0000 osd.0 (osd.0) 234 : cluster [DBG] 5.d starting backfill to osd.2 from (0'0,0'0] MAX to 271'13 2024-02-19T21:47:14.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:13.322546+0000 mon.a (mon.0) 1451 : cluster [DBG] osdmap e349: 8 total, 8 up, 8 in 2024-02-19T21:47:14.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:13.322709+0000 osd.1 (osd.1) 219 : cluster [DBG] 9.2 starting backfill to osd.2 from (0'0,0'0] MAX to 346'12369 2024-02-19T21:47:14.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:13.322887+0000 osd.5 (osd.5) 243 : cluster [DBG] 9.f starting backfill to osd.2 from (0'0,0'0] MAX to 346'12439 2024-02-19T21:47:14.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:13.323102+0000 osd.7 (osd.7) 220 : cluster [DBG] 6.1c starting backfill to osd.2 from (0'0,0'0] MAX to 66'1 2024-02-19T21:47:14.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:13.325395+0000 osd.0 (osd.0) 235 : cluster [DBG] 6.8 starting backfill to osd.2 from (0'0,0'0] MAX to 66'1 2024-02-19T21:47:14.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:13.325470+0000 osd.0 (osd.0) 236 : cluster [DBG] 9.0 starting backfill to osd.2 from (0'0,0'0] MAX to 346'12458 2024-02-19T21:47:14.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:13.332474+0000 osd.5 (osd.5) 244 : cluster [DBG] 9.7 starting backfill to osd.2 from (0'0,0'0] MAX to 346'15044 2024-02-19T21:47:14.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:13.333499+0000 osd.0 (osd.0) 237 : cluster [DBG] 9.0 starting backfill to osd.7 from (0'0,0'0] MAX to 346'12458 2024-02-19T21:47:14.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:13.107465+0000 mgr.y (mgr.14514) 562 : cluster [DBG] pgmap v711: 138 pgs: 138 active+clean; 3.6 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s 2024-02-19T21:47:14.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:13.321027+0000 osd.5 (osd.5) 242 : cluster [DBG] 9.6 starting backfill to osd.2 from (0'0,0'0] MAX to 346'12700 2024-02-19T21:47:14.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:13.321763+0000 osd.0 (osd.0) 234 : cluster [DBG] 5.d starting backfill to osd.2 from (0'0,0'0] MAX to 271'13 2024-02-19T21:47:14.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:13.322546+0000 mon.a (mon.0) 1451 : cluster [DBG] osdmap e349: 8 total, 8 up, 8 in 2024-02-19T21:47:14.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:13.322709+0000 osd.1 (osd.1) 219 : cluster [DBG] 9.2 starting backfill to osd.2 from (0'0,0'0] MAX to 346'12369 2024-02-19T21:47:14.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:13.322887+0000 osd.5 (osd.5) 243 : cluster [DBG] 9.f starting backfill to osd.2 from (0'0,0'0] MAX to 346'12439 2024-02-19T21:47:14.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:13.323102+0000 osd.7 (osd.7) 220 : cluster [DBG] 6.1c starting backfill to osd.2 from (0'0,0'0] MAX to 66'1 2024-02-19T21:47:14.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:13.325395+0000 osd.0 (osd.0) 235 : cluster [DBG] 6.8 starting backfill to osd.2 from (0'0,0'0] MAX to 66'1 2024-02-19T21:47:14.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:13.325470+0000 osd.0 (osd.0) 236 : cluster [DBG] 9.0 starting backfill to osd.2 from (0'0,0'0] MAX to 346'12458 2024-02-19T21:47:14.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:13.332474+0000 osd.5 (osd.5) 244 : cluster [DBG] 9.7 starting backfill to osd.2 from (0'0,0'0] MAX to 346'15044 2024-02-19T21:47:14.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:13.333499+0000 osd.0 (osd.0) 237 : cluster [DBG] 9.0 starting backfill to osd.7 from (0'0,0'0] MAX to 346'12458 2024-02-19T21:47:14.640 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:14.791 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:47:14.799 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:14.800 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:47:14.901 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:47:14.918 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:47:14.918 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:47:14.985 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:15.255 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:47:15.258 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:15.259 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:47:15.360 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:47:15.386 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:14.368179+0000 mon.a (mon.0) 1452 : cluster [DBG] osdmap e350: 8 total, 8 up, 8 in 2024-02-19T21:47:15.387 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:14.368179+0000 mon.a (mon.0) 1452 : cluster [DBG] osdmap e350: 8 total, 8 up, 8 in 2024-02-19T21:47:15.422 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:47:15.422 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:15.462 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:47:15.466 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:15.467 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:47:15.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:14.368179+0000 mon.a (mon.0) 1452 : cluster [DBG] osdmap e350: 8 total, 8 up, 8 in 2024-02-19T21:47:15.567 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:47:15.618 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:15.678 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:47:15.686 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:15.686 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:47:15.774 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_ops_in_flight 2024-02-19T21:47:15.787 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:47:15.841 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:15.879 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:47:15.884 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:47:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:47:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:47:15.885 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:15.886 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:47:15.987 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:47:16.050 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:16.420 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:47:16.423 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:16.423 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-02-19T21:47:16.424 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:47:16.426 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:47:16.525 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:47:16.575 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:16.730 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:47:16.739 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:16.739 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:47:16.740 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:15.108070+0000 mgr.y (mgr.14514) 563 : cluster [DBG] pgmap v714: 138 pgs: 1 active+remapped+backfill_toofull, 1 peering, 136 active+clean; 3.6 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 0 B/s wr, 85 op/s; 1/175545 objects misplaced (0.001%); 264 B/s, 7 objects/s recovering 2024-02-19T21:47:16.740 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:15.354146+0000 mon.a (mon.0) 1453 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:47:16.740 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:15.385288+0000 mon.a (mon.0) 1454 : cluster [DBG] osdmap e351: 8 total, 8 up, 8 in 2024-02-19T21:47:16.740 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:15.781436+0000 mon.c (mon.2) 77 : audit [INF] from='client.? 172.21.15.80:0/3234648400' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:47:16.740 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:15.781819+0000 mon.a (mon.0) 1455 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:47:16.740 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:15.108070+0000 mgr.y (mgr.14514) 563 : cluster [DBG] pgmap v714: 138 pgs: 1 active+remapped+backfill_toofull, 1 peering, 136 active+clean; 3.6 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 0 B/s wr, 85 op/s; 1/175545 objects misplaced (0.001%); 264 B/s, 7 objects/s recovering 2024-02-19T21:47:16.740 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:15.354146+0000 mon.a (mon.0) 1453 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:47:16.740 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:15.385288+0000 mon.a (mon.0) 1454 : cluster [DBG] osdmap e351: 8 total, 8 up, 8 in 2024-02-19T21:47:16.740 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:15.781436+0000 mon.c (mon.2) 77 : audit [INF] from='client.? 172.21.15.80:0/3234648400' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:47:16.741 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:15.781819+0000 mon.a (mon.0) 1455 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:47:16.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:15.108070+0000 mgr.y (mgr.14514) 563 : cluster [DBG] pgmap v714: 138 pgs: 1 active+remapped+backfill_toofull, 1 peering, 136 active+clean; 3.6 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 0 B/s wr, 85 op/s; 1/175545 objects misplaced (0.001%); 264 B/s, 7 objects/s recovering 2024-02-19T21:47:16.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:15.354146+0000 mon.a (mon.0) 1453 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:47:16.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:15.385288+0000 mon.a (mon.0) 1454 : cluster [DBG] osdmap e351: 8 total, 8 up, 8 in 2024-02-19T21:47:16.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:15.781436+0000 mon.c (mon.2) 77 : audit [INF] from='client.? 172.21.15.80:0/3234648400' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:47:16.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:15.781819+0000 mon.a (mon.0) 1455 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:47:16.841 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:47:16.885 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:17.450 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:16.378978+0000 mon.a (mon.0) 1456 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:47:17.450 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:16.391332+0000 mon.a (mon.0) 1457 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:47:17.450 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:16.391383+0000 mon.a (mon.0) 1458 : cluster [DBG] osdmap e352: 8 total, 8 up, 8 in 2024-02-19T21:47:17.451 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:16.378978+0000 mon.a (mon.0) 1456 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:47:17.451 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:16.391332+0000 mon.a (mon.0) 1457 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:47:17.451 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:16.391383+0000 mon.a (mon.0) 1458 : cluster [DBG] osdmap e352: 8 total, 8 up, 8 in 2024-02-19T21:47:17.453 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:47:17.456 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:17.457 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:47:17.557 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:47:17.617 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:17.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:16.378978+0000 mon.a (mon.0) 1456 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:47:17.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:16.391332+0000 mon.a (mon.0) 1457 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:47:17.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:16.391383+0000 mon.a (mon.0) 1458 : cluster [DBG] osdmap e352: 8 total, 8 up, 8 in 2024-02-19T21:47:17.832 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:47:17.838 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:17.839 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:47:17.940 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:47:18.030 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:18.062 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:47:18.068 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:18.069 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:47:18.169 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:47:18.213 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:18.252 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:47:18.260 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:18.260 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:47:18.299 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 6, 7, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:47:18.299 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:47:18.299 INFO:tasks.thrashosds.thrasher:Removing osd 3, in_osds are: [0, 1, 3, 4, 5, 6, 7, 2] 2024-02-19T21:47:18.299 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd out 3 2024-02-19T21:47:18.361 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:47:18.405 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:18.432 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:17.108519+0000 mgr.y (mgr.14514) 564 : cluster [DBG] pgmap v717: 138 pgs: 3 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 1 peering, 130 active+clean; 3.4 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 255 B/s rd, 0 B/s wr, 693 op/s; 20328/168258 objects misplaced (12.081%); 7.6 MiB/s, 136 objects/s recovering 2024-02-19T21:47:18.432 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:17.680896+0000 osd.0 (osd.0) 238 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:47:18.432 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:17.680955+0000 osd.0 (osd.0) 239 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:47:18.436 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:47:18.442 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:18.442 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:47:18.543 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:47:18.592 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:18.623 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:47:18.626 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:18.626 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:47:18.727 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:47:18.786 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:17.108519+0000 mgr.y (mgr.14514) 564 : cluster [DBG] pgmap v717: 138 pgs: 3 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 1 peering, 130 active+clean; 3.4 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 255 B/s rd, 0 B/s wr, 693 op/s; 20328/168258 objects misplaced (12.081%); 7.6 MiB/s, 136 objects/s recovering 2024-02-19T21:47:18.786 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:17.680896+0000 osd.0 (osd.0) 238 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:47:18.786 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:17.680955+0000 osd.0 (osd.0) 239 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:47:18.789 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:18.829 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:47:18.837 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:18.838 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:47:18.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:17.108519+0000 mgr.y (mgr.14514) 564 : cluster [DBG] pgmap v717: 138 pgs: 3 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 1 peering, 130 active+clean; 3.4 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 255 B/s rd, 0 B/s wr, 693 op/s; 20328/168258 objects misplaced (12.081%); 7.6 MiB/s, 136 objects/s recovering 2024-02-19T21:47:18.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:17.680896+0000 osd.0 (osd.0) 238 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:47:18.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:17.680955+0000 osd.0 (osd.0) 239 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:47:18.938 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:47:18.999 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:19.159 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:47:19.163 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:19.164 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:47:19.220 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-19T21:47:19.264 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:47:19.306 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:19.358 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:47:19.365 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:19.365 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:47:19.466 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:47:19.533 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:19.534 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:18.419319+0000 mon.a (mon.0) 1459 : cluster [DBG] osdmap e353: 8 total, 8 up, 8 in 2024-02-19T21:47:19.534 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:18.969346+0000 mon.a (mon.0) 1460 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:47:19.534 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:19.309634+0000 mon.a (mon.0) 1461 : audit [DBG] from='client.? 172.21.15.80:0/2598351768' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:47:19.535 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:18.419319+0000 mon.a (mon.0) 1459 : cluster [DBG] osdmap e353: 8 total, 8 up, 8 in 2024-02-19T21:47:19.535 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:18.969346+0000 mon.a (mon.0) 1460 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:47:19.535 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:19.309634+0000 mon.a (mon.0) 1461 : audit [DBG] from='client.? 172.21.15.80:0/2598351768' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:47:19.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:18.419319+0000 mon.a (mon.0) 1459 : cluster [DBG] osdmap e353: 8 total, 8 up, 8 in 2024-02-19T21:47:19.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:18.969346+0000 mon.a (mon.0) 1460 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:47:19.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:19.309634+0000 mon.a (mon.0) 1461 : audit [DBG] from='client.? 172.21.15.80:0/2598351768' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:47:20.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:19.108876+0000 mgr.y (mgr.14514) 565 : cluster [DBG] pgmap v719: 138 pgs: 3 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 1 peering, 130 active+clean; 3.4 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 216 B/s rd, 0 B/s wr, 585 op/s; 20328/168258 objects misplaced (12.081%); 6.4 MiB/s, 115 objects/s recovering 2024-02-19T21:47:20.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:20.201300+0000 mon.a (mon.0) 1462 : cluster [DBG] osdmap e354: 8 total, 8 up, 8 in 2024-02-19T21:47:20.990 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:47:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:47:21.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:19.108876+0000 mgr.y (mgr.14514) 565 : cluster [DBG] pgmap v719: 138 pgs: 3 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 1 peering, 130 active+clean; 3.4 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 216 B/s rd, 0 B/s wr, 585 op/s; 20328/168258 objects misplaced (12.081%); 6.4 MiB/s, 115 objects/s recovering 2024-02-19T21:47:21.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:20.201300+0000 mon.a (mon.0) 1462 : cluster [DBG] osdmap e354: 8 total, 8 up, 8 in 2024-02-19T21:47:21.096 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:47:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:47:20] "GET /metrics HTTP/1.1" 200 176213 "" "Prometheus/2.33.4" 2024-02-19T21:47:21.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:19.108876+0000 mgr.y (mgr.14514) 565 : cluster [DBG] pgmap v719: 138 pgs: 3 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 1 peering, 130 active+clean; 3.4 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 216 B/s rd, 0 B/s wr, 585 op/s; 20328/168258 objects misplaced (12.081%); 6.4 MiB/s, 115 objects/s recovering 2024-02-19T21:47:21.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:20.201300+0000 mon.a (mon.0) 1462 : cluster [DBG] osdmap e354: 8 total, 8 up, 8 in 2024-02-19T21:47:22.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:20.732214+0000 mgr.y (mgr.14514) 566 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:47:22.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:20.732214+0000 mgr.y (mgr.14514) 566 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:47:22.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:20.732214+0000 mgr.y (mgr.14514) 566 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:47:23.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:21.109500+0000 mgr.y (mgr.14514) 567 : cluster [DBG] pgmap v721: 138 pgs: 3 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 131 active+clean; 3.1 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 894 B/s rd, 0 B/s wr, 791 op/s; 16987/154680 objects misplaced (10.982%); 14 MiB/s, 222 objects/s recovering 2024-02-19T21:47:23.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:21.109500+0000 mgr.y (mgr.14514) 567 : cluster [DBG] pgmap v721: 138 pgs: 3 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 131 active+clean; 3.1 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 894 B/s rd, 0 B/s wr, 791 op/s; 16987/154680 objects misplaced (10.982%); 14 MiB/s, 222 objects/s recovering 2024-02-19T21:47:23.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:21.109500+0000 mgr.y (mgr.14514) 567 : cluster [DBG] pgmap v721: 138 pgs: 3 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 131 active+clean; 3.1 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 894 B/s rd, 0 B/s wr, 791 op/s; 16987/154680 objects misplaced (10.982%); 14 MiB/s, 222 objects/s recovering 2024-02-19T21:47:24.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:23.110002+0000 mgr.y (mgr.14514) 568 : cluster [DBG] pgmap v722: 138 pgs: 3 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 131 active+clean; 3.1 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 762 B/s rd, 0 B/s wr, 674 op/s; 16987/154680 objects misplaced (10.982%); 12 MiB/s, 189 objects/s recovering 2024-02-19T21:47:24.328 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:47:24.329 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:47:24.329 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:47:24.329 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:47:24.329 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:47:24.329 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:47:24.329 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:47:24.329 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:47:24.329 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:47:24.329 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:47:24.329 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:47:24.330 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:47:24.330 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:47:24.330 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:47:24.330 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:47:24.330 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:47:24.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:23.110002+0000 mgr.y (mgr.14514) 568 : cluster [DBG] pgmap v722: 138 pgs: 3 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 131 active+clean; 3.1 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 762 B/s rd, 0 B/s wr, 674 op/s; 16987/154680 objects misplaced (10.982%); 12 MiB/s, 189 objects/s recovering 2024-02-19T21:47:24.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:23.110002+0000 mgr.y (mgr.14514) 568 : cluster [DBG] pgmap v722: 138 pgs: 3 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 131 active+clean; 3.1 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 762 B/s rd, 0 B/s wr, 674 op/s; 16987/154680 objects misplaced (10.982%); 12 MiB/s, 189 objects/s recovering 2024-02-19T21:47:25.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:24.311791+0000 mon.a (mon.0) 1463 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:47:25.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:25.193163+0000 mon.a (mon.0) 1464 : cluster [WRN] Health check update: Low space hindering backfill (add storage if this doesn't resolve itself): 2 pgs backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:47:25.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:24.311791+0000 mon.a (mon.0) 1463 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:47:25.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:25.193163+0000 mon.a (mon.0) 1464 : cluster [WRN] Health check update: Low space hindering backfill (add storage if this doesn't resolve itself): 2 pgs backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:47:25.618 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:24.311791+0000 mon.a (mon.0) 1463 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:47:25.618 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:25.193163+0000 mon.a (mon.0) 1464 : cluster [WRN] Health check update: Low space hindering backfill (add storage if this doesn't resolve itself): 2 pgs backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:47:25.619 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:47:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:47:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:47:26.064 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:47:26.069 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:26.069 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:47:26.170 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:47:26.234 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:26.275 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:47:26.281 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:26.281 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:47:26.382 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:47:26.431 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:26.459 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:47:26.459 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:26.460 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:47:26.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:25.110636+0000 mgr.y (mgr.14514) 569 : cluster [DBG] pgmap v723: 138 pgs: 3 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 131 active+clean; 3.1 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 635 op/s; 16987/153021 objects misplaced (11.101%); 10 MiB/s, 159 objects/s recovering 2024-02-19T21:47:26.561 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:47:26.585 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:25.110636+0000 mgr.y (mgr.14514) 569 : cluster [DBG] pgmap v723: 138 pgs: 3 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 131 active+clean; 3.1 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 635 op/s; 16987/153021 objects misplaced (11.101%); 10 MiB/s, 159 objects/s recovering 2024-02-19T21:47:26.585 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:25.110636+0000 mgr.y (mgr.14514) 569 : cluster [DBG] pgmap v723: 138 pgs: 3 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 131 active+clean; 3.1 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 635 op/s; 16987/153021 objects misplaced (11.101%); 10 MiB/s, 159 objects/s recovering 2024-02-19T21:47:26.612 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:26.649 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:47:26.658 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:26.658 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:47:26.759 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:47:26.819 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:27.081 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:47:27.087 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:27.088 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:47:27.150 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:47:27.173 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:47:27.189 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:47:27.258 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:27.290 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:47:27.297 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:27.298 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:47:27.399 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:47:27.456 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:27.501 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:47:27.507 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:27.508 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:47:27.609 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:47:27.663 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:27.690 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:47:27.696 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:27.697 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:47:27.798 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:47:27.856 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:27.975 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:47:27.981 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:27.981 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:47:28.082 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:47:28.125 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:28.154 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:47:28.157 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:28.157 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:47:28.258 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:47:28.296 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:28.314 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:47:28.314 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-02-19T21:47:28.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.314 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:212925 9.0 9:0fb14ca7:::benchmark_data_smithi080_126364_object84333:head [delete] snapc 0=[] ondisk+write+known_if_redirected e354)", 2024-02-19T21:47:28.314 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:28.248465+0000", 2024-02-19T21:47:28.314 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.010162330000000001, 2024-02-19T21:47:28.315 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010196884, 2024-02-19T21:47:28.315 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:47:28.315 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:47:28.315 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:47:28.315 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:47:28.315 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:47:28.315 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 212925 2024-02-19T21:47:28.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.315 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:47:28.315 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.315 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:47:28.315 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.248465+0000", 2024-02-19T21:47:28.315 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:47:28.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.316 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.316 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:47:28.316 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.248465+0000", 2024-02-19T21:47:28.316 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:47:28.316 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.316 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.316 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:47:28.316 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.248464+0000", 2024-02-19T21:47:28.316 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2880000000000004e-06 2024-02-19T21:47:28.316 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.316 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.316 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:47:28.316 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.248471+0000", 2024-02-19T21:47:28.317 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0183999999999999e-05 2024-02-19T21:47:28.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.317 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:47:28.317 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.248481+0000", 2024-02-19T21:47:28.317 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4299999999999997e-06 2024-02-19T21:47:28.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.317 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:47:28.317 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.248486+0000", 2024-02-19T21:47:28.317 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0021884460000000001 2024-02-19T21:47:28.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.317 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:28.317 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.250675+0000", 2024-02-19T21:47:28.318 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011860499999999999 2024-02-19T21:47:28.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.318 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:47:28.318 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.250794+0000", 2024-02-19T21:47:28.318 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000136744 2024-02-19T21:47:28.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.318 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,2,6,7", 2024-02-19T21:47:28.318 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.250930+0000", 2024-02-19T21:47:28.318 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053950320000000001 2024-02-19T21:47:28.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.318 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:47:28.318 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.256325+0000", 2024-02-19T21:47:28.319 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0078602859999999993 2024-02-19T21:47:28.319 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:28.319 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:47:28.319 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:28.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.319 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:212926 9.8 9:1b97262d:::benchmark_data_smithi080_126364_object84334:head [delete] snapc 0=[] ondisk+write+known_if_redirected e354)", 2024-02-19T21:47:28.319 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:28.248492+0000", 2024-02-19T21:47:28.319 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.010135076, 2024-02-19T21:47:28.319 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010263113000000001, 2024-02-19T21:47:28.320 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:47:28.320 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:47:28.320 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:47:28.320 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:47:28.320 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:47:28.320 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 212926 2024-02-19T21:47:28.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.320 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:47:28.320 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.320 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:47:28.320 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.248492+0000", 2024-02-19T21:47:28.320 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:47:28.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.320 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.321 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:47:28.321 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.248492+0000", 2024-02-19T21:47:28.321 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:47:28.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.321 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:47:28.321 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.248492+0000", 2024-02-19T21:47:28.321 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5289999999999998e-06 2024-02-19T21:47:28.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.321 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:47:28.321 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.248494+0000", 2024-02-19T21:47:28.321 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0540000000000002e-06 2024-02-19T21:47:28.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.322 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:47:28.322 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.248499+0000", 2024-02-19T21:47:28.322 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3550000000000001e-06 2024-02-19T21:47:28.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.322 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:47:28.322 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.248503+0000", 2024-02-19T21:47:28.322 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001035422 2024-02-19T21:47:28.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.322 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:28.322 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.249538+0000", 2024-02-19T21:47:28.322 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000103658 2024-02-19T21:47:28.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.323 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:47:28.323 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.249642+0000", 2024-02-19T21:47:28.323 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0498e-05 2024-02-19T21:47:28.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.323 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,7", 2024-02-19T21:47:28.323 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.249732+0000", 2024-02-19T21:47:28.323 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0065253910000000002 2024-02-19T21:47:28.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.323 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:47:28.323 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.256258+0000", 2024-02-19T21:47:28.323 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0077655299999999997 2024-02-19T21:47:28.323 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:28.324 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:47:28.324 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:28.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.324 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:212927 9.0 9:0e29376b:::benchmark_data_smithi080_126364_object84335:head [delete] snapc 0=[] ondisk+write+known_if_redirected e354)", 2024-02-19T21:47:28.324 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:28.248507+0000", 2024-02-19T21:47:28.324 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.01012074, 2024-02-19T21:47:28.324 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010298734, 2024-02-19T21:47:28.325 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:47:28.325 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:47:28.325 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:47:28.325 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:47:28.325 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:47:28.325 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 212927 2024-02-19T21:47:28.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.325 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:47:28.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.325 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:47:28.325 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.248507+0000", 2024-02-19T21:47:28.325 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:47:28.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.325 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:47:28.326 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.248507+0000", 2024-02-19T21:47:28.326 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:47:28.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.326 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:47:28.326 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.248506+0000", 2024-02-19T21:47:28.326 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2069999999999998e-06 2024-02-19T21:47:28.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.326 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:47:28.326 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.248508+0000", 2024-02-19T21:47:28.326 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8400000000000002e-06 2024-02-19T21:47:28.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.326 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:47:28.327 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.248513+0000", 2024-02-19T21:47:28.327 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1820000000000002e-06 2024-02-19T21:47:28.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.327 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:47:28.327 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.248517+0000", 2024-02-19T21:47:28.327 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050548440000000002 2024-02-19T21:47:28.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.327 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:28.327 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.253571+0000", 2024-02-19T21:47:28.327 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000148777 2024-02-19T21:47:28.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.327 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:47:28.328 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.253720+0000", 2024-02-19T21:47:28.328 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017863699999999999 2024-02-19T21:47:28.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.328 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.328 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,2,6,7", 2024-02-19T21:47:28.328 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.253899+0000", 2024-02-19T21:47:28.328 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027641440000000001 2024-02-19T21:47:28.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.328 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.328 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:47:28.328 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.256663+0000", 2024-02-19T21:47:28.328 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0081563209999999994 2024-02-19T21:47:28.328 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:28.328 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:47:28.328 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:28.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.329 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.329 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:212934 9.8 9:11ed7f7f:::benchmark_data_smithi080_126364_object84342:head [delete] snapc 0=[] ondisk+write+known_if_redirected e354)", 2024-02-19T21:47:28.329 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:28.256649+0000", 2024-02-19T21:47:28.329 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0019784849999999999, 2024-02-19T21:47:28.329 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002205088, 2024-02-19T21:47:28.329 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:47:28.329 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:47:28.329 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:47:28.329 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:47:28.329 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:47:28.329 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 212934 2024-02-19T21:47:28.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.329 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:47:28.329 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.330 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:47:28.330 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.256649+0000", 2024-02-19T21:47:28.330 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:47:28.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.330 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:47:28.330 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.256649+0000", 2024-02-19T21:47:28.330 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999971 2024-02-19T21:47:28.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.330 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:47:28.330 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.256646+0000", 2024-02-19T21:47:28.330 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9720000000000004e-06 2024-02-19T21:47:28.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.331 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:47:28.331 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.256656+0000", 2024-02-19T21:47:28.331 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2913e-05 2024-02-19T21:47:28.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.331 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.331 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:47:28.331 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.256669+0000", 2024-02-19T21:47:28.331 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9430000000000003e-06 2024-02-19T21:47:28.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.331 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.331 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:47:28.331 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.256676+0000", 2024-02-19T21:47:28.331 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8176000000000001e-05 2024-02-19T21:47:28.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.332 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:28.332 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.256724+0000", 2024-02-19T21:47:28.332 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012779299999999999 2024-02-19T21:47:28.332 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.332 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:47:28.332 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.256852+0000", 2024-02-19T21:47:28.332 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014723399999999999 2024-02-19T21:47:28.332 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:28.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:28.332 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,7", 2024-02-19T21:47:28.332 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:28.256999+0000", 2024-02-19T21:47:28.332 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035029499999999998 2024-02-19T21:47:28.332 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:28.333 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:47:28.333 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:28.333 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:28.333 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:47:28.333 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 4 2024-02-19T21:47:28.333 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:47:28.333 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:47:28.334 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:28.335 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:47:28.436 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:47:28.488 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:27.111252+0000 mgr.y (mgr.14514) 570 : cluster [DBG] pgmap v724: 138 pgs: 3 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 131 active+clean; 2.9 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.04k op/s; 13595/141054 objects misplaced (9.638%); 20 MiB/s, 315 objects/s recovering 2024-02-19T21:47:28.492 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:28.541 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:47:28.545 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:28.546 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:47:28.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:27.111252+0000 mgr.y (mgr.14514) 570 : cluster [DBG] pgmap v724: 138 pgs: 3 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 131 active+clean; 2.9 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.04k op/s; 13595/141054 objects misplaced (9.638%); 20 MiB/s, 315 objects/s recovering 2024-02-19T21:47:28.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:27.111252+0000 mgr.y (mgr.14514) 570 : cluster [DBG] pgmap v724: 138 pgs: 3 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 131 active+clean; 2.9 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.04k op/s; 13595/141054 objects misplaced (9.638%); 20 MiB/s, 315 objects/s recovering 2024-02-19T21:47:28.621 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:47:28.646 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:47:28.728 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:28.762 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:47:28.776 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:28.777 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:47:28.878 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:47:28.938 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:29.202 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:47:29.213 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:29.214 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:47:29.314 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:47:29.383 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:29.425 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:47:29.431 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:29.432 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:47:29.533 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:47:29.580 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:29.617 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:47:29.624 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:29.625 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:47:29.725 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:47:29.789 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:30.340 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:29.111680+0000 mgr.y (mgr.14514) 571 : cluster [DBG] pgmap v725: 138 pgs: 3 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 131 active+clean; 2.9 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 907 op/s; 13595/141054 objects misplaced (9.638%); 17 MiB/s, 274 objects/s recovering 2024-02-19T21:47:30.341 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:29.323446+0000 mon.a (mon.0) 1465 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:47:30.341 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:29.111680+0000 mgr.y (mgr.14514) 571 : cluster [DBG] pgmap v725: 138 pgs: 3 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 131 active+clean; 2.9 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 907 op/s; 13595/141054 objects misplaced (9.638%); 17 MiB/s, 274 objects/s recovering 2024-02-19T21:47:30.341 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:29.323446+0000 mon.a (mon.0) 1465 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:47:30.745 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:29.111680+0000 mgr.y (mgr.14514) 571 : cluster [DBG] pgmap v725: 138 pgs: 3 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 131 active+clean; 2.9 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 907 op/s; 13595/141054 objects misplaced (9.638%); 17 MiB/s, 274 objects/s recovering 2024-02-19T21:47:30.745 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:29.323446+0000 mon.a (mon.0) 1465 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:47:30.745 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:47:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:47:30.884 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_blocked_ops 2024-02-19T21:47:31.097 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:47:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:47:30] "GET /metrics HTTP/1.1" 200 176213 "" "Prometheus/2.33.4" 2024-02-19T21:47:31.166 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:47:31.171 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:31.171 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:47:31.272 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:47:31.321 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:31.427 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:47:31.439 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:31.439 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:47:31.440 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:30.742695+0000 mgr.y (mgr.14514) 572 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:47:31.440 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:30.742695+0000 mgr.y (mgr.14514) 572 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:47:31.541 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:47:31.579 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:31.605 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:47:31.610 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:30.742695+0000 mgr.y (mgr.14514) 572 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:47:31.611 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:31.611 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:47:31.712 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:47:31.795 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:31.820 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:47:31.927 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:47:31.938 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:31.939 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:47:32.040 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:47:32.084 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:32.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:47:31.882+0000 7f2483437700 -1 mon.a@0(leader).osd e354 definitely_dead 0 2024-02-19T21:47:32.127 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:47:32.134 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:32.135 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:47:32.235 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:47:32.285 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:32.313 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:47:32.341 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:32.341 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:47:32.404 INFO:teuthology.orchestra.run.smithi080.stderr:marked out osd.3. 2024-02-19T21:47:32.404 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-02-19T21:47:32.443 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:47:32.455 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:31.112669+0000 mgr.y (mgr.14514) 573 : cluster [DBG] pgmap v726: 138 pgs: 3 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 131 active+clean; 2.6 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 938 B/s rd, 0 B/s wr, 1.04k op/s; 10636/128106 objects misplaced (8.302%); 19 MiB/s, 304 objects/s recovering 2024-02-19T21:47:32.455 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:31.883760+0000 mon.a (mon.0) 1466 : audit [INF] from='client.? 172.21.15.80:0/3811259792' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["3"]}]: dispatch 2024-02-19T21:47:32.455 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:31.883857+0000 mon.a (mon.0) 1467 : cluster [INF] Client client.admin marked osd.3 out, while it was still marked up 2024-02-19T21:47:32.455 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:32.242419+0000 mon.a (mon.0) 1468 : audit [INF] from='client.? 172.21.15.80:0/382098292' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:47:32.456 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:31.112669+0000 mgr.y (mgr.14514) 573 : cluster [DBG] pgmap v726: 138 pgs: 3 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 131 active+clean; 2.6 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 938 B/s rd, 0 B/s wr, 1.04k op/s; 10636/128106 objects misplaced (8.302%); 19 MiB/s, 304 objects/s recovering 2024-02-19T21:47:32.456 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:31.883760+0000 mon.a (mon.0) 1466 : audit [INF] from='client.? 172.21.15.80:0/3811259792' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["3"]}]: dispatch 2024-02-19T21:47:32.456 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:31.883857+0000 mon.a (mon.0) 1467 : cluster [INF] Client client.admin marked osd.3 out, while it was still marked up 2024-02-19T21:47:32.456 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:32.242419+0000 mon.a (mon.0) 1468 : audit [INF] from='client.? 172.21.15.80:0/382098292' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:47:32.484 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:32.511 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:47:32.515 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:32.515 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:47:32.616 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:47:32.648 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:32.773 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:47:32.776 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:32.777 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:47:32.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:31.112669+0000 mgr.y (mgr.14514) 573 : cluster [DBG] pgmap v726: 138 pgs: 3 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 131 active+clean; 2.6 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 938 B/s rd, 0 B/s wr, 1.04k op/s; 10636/128106 objects misplaced (8.302%); 19 MiB/s, 304 objects/s recovering 2024-02-19T21:47:32.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:31.883760+0000 mon.a (mon.0) 1466 : audit [INF] from='client.? 172.21.15.80:0/3811259792' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["3"]}]: dispatch 2024-02-19T21:47:32.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:31.883857+0000 mon.a (mon.0) 1467 : cluster [INF] Client client.admin marked osd.3 out, while it was still marked up 2024-02-19T21:47:32.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:32.242419+0000 mon.a (mon.0) 1468 : audit [INF] from='client.? 172.21.15.80:0/382098292' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:47:32.878 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:47:32.906 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:32.929 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:47:32.935 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:32.936 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:47:33.036 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:47:33.066 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:33.309 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:47:33.804 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:32.356854+0000 mon.a (mon.0) 1469 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:47:33.804 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:32.375131+0000 mon.a (mon.0) 1470 : audit [INF] from='client.? 172.21.15.80:0/3811259792' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["3"]}]': finished 2024-02-19T21:47:33.804 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:32.375189+0000 mon.a (mon.0) 1471 : audit [INF] from='client.? 172.21.15.80:0/382098292' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:47:33.805 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:32.375222+0000 mon.a (mon.0) 1472 : cluster [DBG] osdmap e355: 8 total, 8 up, 7 in 2024-02-19T21:47:33.805 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:32.356854+0000 mon.a (mon.0) 1469 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:47:33.805 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:32.375131+0000 mon.a (mon.0) 1470 : audit [INF] from='client.? 172.21.15.80:0/3811259792' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["3"]}]': finished 2024-02-19T21:47:33.805 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:32.375189+0000 mon.a (mon.0) 1471 : audit [INF] from='client.? 172.21.15.80:0/382098292' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:47:33.805 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:32.375222+0000 mon.a (mon.0) 1472 : cluster [DBG] osdmap e355: 8 total, 8 up, 7 in 2024-02-19T21:47:33.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:32.356854+0000 mon.a (mon.0) 1469 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:47:33.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:32.375131+0000 mon.a (mon.0) 1470 : audit [INF] from='client.? 172.21.15.80:0/3811259792' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["3"]}]': finished 2024-02-19T21:47:33.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:32.375189+0000 mon.a (mon.0) 1471 : audit [INF] from='client.? 172.21.15.80:0/382098292' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:47:33.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:32.375222+0000 mon.a (mon.0) 1472 : cluster [DBG] osdmap e355: 8 total, 8 up, 7 in 2024-02-19T21:47:33.845 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:47:33.848 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:33.848 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:47:33.949 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:47:33.975 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:33.995 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:47:33.997 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:33.998 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:47:34.098 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:47:34.126 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:34.474 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:47:34.480 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:34.480 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:47:34.581 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:47:34.649 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:33.113062+0000 mgr.y (mgr.14514) 574 : cluster [DBG] pgmap v728: 138 pgs: 3 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 131 active+clean; 2.6 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 886 op/s; 10636/128106 objects misplaced (8.302%); 17 MiB/s, 278 objects/s recovering 2024-02-19T21:47:34.649 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:33.381375+0000 mon.a (mon.0) 1473 : cluster [DBG] osdmap e356: 8 total, 8 up, 7 in 2024-02-19T21:47:34.649 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:33.959864+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:47:34.650 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:34.694 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:47:34.703 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:33.113062+0000 mgr.y (mgr.14514) 574 : cluster [DBG] pgmap v728: 138 pgs: 3 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 131 active+clean; 2.6 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 886 op/s; 10636/128106 objects misplaced (8.302%); 17 MiB/s, 278 objects/s recovering 2024-02-19T21:47:34.703 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:33.381375+0000 mon.a (mon.0) 1473 : cluster [DBG] osdmap e356: 8 total, 8 up, 7 in 2024-02-19T21:47:34.704 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:33.959864+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:47:34.704 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:33.113062+0000 mgr.y (mgr.14514) 574 : cluster [DBG] pgmap v728: 138 pgs: 3 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 131 active+clean; 2.6 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 886 op/s; 10636/128106 objects misplaced (8.302%); 17 MiB/s, 278 objects/s recovering 2024-02-19T21:47:34.704 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:33.381375+0000 mon.a (mon.0) 1473 : cluster [DBG] osdmap e356: 8 total, 8 up, 7 in 2024-02-19T21:47:34.704 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:33.959864+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:47:34.714 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:34.715 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:47:34.815 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:47:34.866 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:34.907 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:47:34.921 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:34.921 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:47:35.022 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:47:35.085 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:35.120 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:47:35.138 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:35.138 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:47:35.239 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:47:35.290 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:35.352 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:47:35.357 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:35.358 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:47:35.444 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:47:35.445 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:47:35.445 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:47:35.445 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:47:35.445 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:47:35.445 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:47:35.445 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:47:35.445 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:47:35.445 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:47:35.445 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:47:35.445 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:47:35.445 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:47:35.445 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:47:35.446 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:47:35.446 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:47:35.446 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:47:35.459 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:47:35.534 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:35.569 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:47:35.577 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:35.578 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:47:35.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:34.384873+0000 osd.0 (osd.0) 240 : cluster [INF] 6.8 continuing backfill to osd.2 from (66'1,66'1] MIN to 66'1 2024-02-19T21:47:35.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:34.385534+0000 mon.a (mon.0) 1475 : cluster [DBG] osdmap e357: 8 total, 8 up, 7 in 2024-02-19T21:47:35.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:34.386613+0000 osd.6 (osd.6) 211 : cluster [DBG] 9.1 starting backfill to osd.2 from (0'0,0'0] MAX to 354'13462 2024-02-19T21:47:35.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:34.390853+0000 osd.1 (osd.1) 220 : cluster [DBG] 9.4 starting backfill to osd.0 from (0'0,0'0] MAX to 354'13543 2024-02-19T21:47:35.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:35.075545+0000 mon.c (mon.2) 78 : audit [DBG] from='client.? 172.21.15.80:0/3605146683' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:47:35.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:35.203561+0000 mon.a (mon.0) 1476 : cluster [DBG] osdmap e358: 8 total, 8 up, 7 in 2024-02-19T21:47:35.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:34.384873+0000 osd.0 (osd.0) 240 : cluster [INF] 6.8 continuing backfill to osd.2 from (66'1,66'1] MIN to 66'1 2024-02-19T21:47:35.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:34.385534+0000 mon.a (mon.0) 1475 : cluster [DBG] osdmap e357: 8 total, 8 up, 7 in 2024-02-19T21:47:35.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:34.386613+0000 osd.6 (osd.6) 211 : cluster [DBG] 9.1 starting backfill to osd.2 from (0'0,0'0] MAX to 354'13462 2024-02-19T21:47:35.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:34.390853+0000 osd.1 (osd.1) 220 : cluster [DBG] 9.4 starting backfill to osd.0 from (0'0,0'0] MAX to 354'13543 2024-02-19T21:47:35.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:35.075545+0000 mon.c (mon.2) 78 : audit [DBG] from='client.? 172.21.15.80:0/3605146683' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:47:35.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:35.203561+0000 mon.a (mon.0) 1476 : cluster [DBG] osdmap e358: 8 total, 8 up, 7 in 2024-02-19T21:47:35.678 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:47:35.719 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:35.790 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:47:35.801 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:35.801 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:47:35.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:34.384873+0000 osd.0 (osd.0) 240 : cluster [INF] 6.8 continuing backfill to osd.2 from (66'1,66'1] MIN to 66'1 2024-02-19T21:47:35.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:34.385534+0000 mon.a (mon.0) 1475 : cluster [DBG] osdmap e357: 8 total, 8 up, 7 in 2024-02-19T21:47:35.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:34.386613+0000 osd.6 (osd.6) 211 : cluster [DBG] 9.1 starting backfill to osd.2 from (0'0,0'0] MAX to 354'13462 2024-02-19T21:47:35.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:34.390853+0000 osd.1 (osd.1) 220 : cluster [DBG] 9.4 starting backfill to osd.0 from (0'0,0'0] MAX to 354'13543 2024-02-19T21:47:35.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:35.075545+0000 mon.c (mon.2) 78 : audit [DBG] from='client.? 172.21.15.80:0/3605146683' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:47:35.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:35.203561+0000 mon.a (mon.0) 1476 : cluster [DBG] osdmap e358: 8 total, 8 up, 7 in 2024-02-19T21:47:35.810 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:47:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:47:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:47:35.902 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:47:35.971 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:36.003 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:47:36.011 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:36.011 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:47:36.112 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:47:36.171 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:36.212 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:47:36.213 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:36.213 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:47:36.314 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:47:36.386 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:36.426 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:47:36.434 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:36.434 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:47:36.535 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:47:36.610 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:36.637 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:47:36.646 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:36.647 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:47:36.656 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:35.114682+0000 mgr.y (mgr.14514) 575 : cluster [DBG] pgmap v731: 138 pgs: 4 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 130 active+clean; 2.6 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 511 B/s rd, 0 B/s wr, 772 op/s; 13162/127152 objects misplaced (10.351%); 14 MiB/s, 222 objects/s recovering 2024-02-19T21:47:36.656 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:36.208328+0000 mon.a (mon.0) 1477 : cluster [DBG] osdmap e359: 8 total, 8 up, 7 in 2024-02-19T21:47:36.748 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:47:36.792 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:36.833 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:47:36.835 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:36.835 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:47:36.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:35.114682+0000 mgr.y (mgr.14514) 575 : cluster [DBG] pgmap v731: 138 pgs: 4 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 130 active+clean; 2.6 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 511 B/s rd, 0 B/s wr, 772 op/s; 13162/127152 objects misplaced (10.351%); 14 MiB/s, 222 objects/s recovering 2024-02-19T21:47:36.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:36.208328+0000 mon.a (mon.0) 1477 : cluster [DBG] osdmap e359: 8 total, 8 up, 7 in 2024-02-19T21:47:36.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:35.114682+0000 mgr.y (mgr.14514) 575 : cluster [DBG] pgmap v731: 138 pgs: 4 active+remapped+backfilling, 2 active+remapped+backfill_wait, 2 active+remapped+backfill_toofull, 130 active+clean; 2.6 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 511 B/s rd, 0 B/s wr, 772 op/s; 13162/127152 objects misplaced (10.351%); 14 MiB/s, 222 objects/s recovering 2024-02-19T21:47:36.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:36.208328+0000 mon.a (mon.0) 1477 : cluster [DBG] osdmap e359: 8 total, 8 up, 7 in 2024-02-19T21:47:36.936 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:47:36.998 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:37.025 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:47:37.036 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:37.037 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:47:37.138 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:47:37.193 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:37.376 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set noscrub 2024-02-19T21:47:37.793 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:37.412748+0000 mon.a (mon.0) 1478 : cluster [WRN] Health check update: Low space hindering backfill (add storage if this doesn't resolve itself): 4 pgs backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:47:37.794 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:37.412748+0000 mon.a (mon.0) 1478 : cluster [WRN] Health check update: Low space hindering backfill (add storage if this doesn't resolve itself): 4 pgs backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:47:37.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:37.412748+0000 mon.a (mon.0) 1478 : cluster [WRN] Health check update: Low space hindering backfill (add storage if this doesn't resolve itself): 4 pgs backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:47:37.851 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:47:37.855 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:37.855 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:47:37.956 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:47:37.999 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:38.083 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:47:38.089 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:38.090 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:47:38.143 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:47:38.143 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:47:38.150 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:47:38.158 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:47:38.191 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:47:38.254 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:38.292 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:47:38.297 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:38.298 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:47:38.399 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:47:38.456 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:38.536 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:37.117303+0000 mgr.y (mgr.14514) 576 : cluster [DBG] pgmap v734: 138 pgs: 4 active+remapped+backfilling, 4 active+remapped+backfill_toofull, 130 active+clean; 2.4 GiB data, 10 GiB used, 615 GiB / 626 GiB avail; 0 B/s wr, 619 op/s; 13342/120666 objects misplaced (11.057%); 19 MiB/s, 311 objects/s recovering 2024-02-19T21:47:38.616 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:47:38.624 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:38.624 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:47:38.725 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:47:38.766 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:37.117303+0000 mgr.y (mgr.14514) 576 : cluster [DBG] pgmap v734: 138 pgs: 4 active+remapped+backfilling, 4 active+remapped+backfill_toofull, 130 active+clean; 2.4 GiB data, 10 GiB used, 615 GiB / 626 GiB avail; 0 B/s wr, 619 op/s; 13342/120666 objects misplaced (11.057%); 19 MiB/s, 311 objects/s recovering 2024-02-19T21:47:38.766 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:37.117303+0000 mgr.y (mgr.14514) 576 : cluster [DBG] pgmap v734: 138 pgs: 4 active+remapped+backfilling, 4 active+remapped+backfill_toofull, 130 active+clean; 2.4 GiB data, 10 GiB used, 615 GiB / 626 GiB avail; 0 B/s wr, 619 op/s; 13342/120666 objects misplaced (11.057%); 19 MiB/s, 311 objects/s recovering 2024-02-19T21:47:38.768 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:38.803 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:47:38.819 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:38.819 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:47:38.822 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 4, 5, 6, 7, 2] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:47:38.822 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:47:38.822 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-02-19T21:47:38.822 INFO:tasks.thrashosds.thrasher:Setting osd 4 primary_affinity to 1.000000 2024-02-19T21:47:38.822 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd primary-affinity 4 1 2024-02-19T21:47:38.921 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:47:38.982 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:39.018 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:47:39.024 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:39.025 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:47:39.125 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:47:39.158 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_historic_ops 2024-02-19T21:47:39.198 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:40.269 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:47:40.275 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:40.275 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:47:40.376 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:47:40.436 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:40.482 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:47:40.486 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:40.487 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:47:40.517 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:47:40.588 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:47:40.644 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:40.777 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:39.120489+0000 mgr.y (mgr.14514) 577 : cluster [DBG] pgmap v735: 138 pgs: 4 active+remapped+backfilling, 4 active+remapped+backfill_toofull, 130 active+clean; 2.4 GiB data, 10 GiB used, 615 GiB / 626 GiB avail; 0 B/s wr, 431 op/s; 13342/120666 objects misplaced (11.057%); 13 MiB/s, 217 objects/s recovering 2024-02-19T21:47:40.777 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:40.150861+0000 mon.a (mon.0) 1479 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:47:40.777 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:40.215620+0000 mon.a (mon.0) 1480 : cluster [DBG] osdmap e360: 8 total, 8 up, 7 in 2024-02-19T21:47:40.777 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:47:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:47:40] "GET /metrics HTTP/1.1" 200 176201 "" "Prometheus/2.33.4" 2024-02-19T21:47:40.778 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:39.120489+0000 mgr.y (mgr.14514) 577 : cluster [DBG] pgmap v735: 138 pgs: 4 active+remapped+backfilling, 4 active+remapped+backfill_toofull, 130 active+clean; 2.4 GiB data, 10 GiB used, 615 GiB / 626 GiB avail; 0 B/s wr, 431 op/s; 13342/120666 objects misplaced (11.057%); 13 MiB/s, 217 objects/s recovering 2024-02-19T21:47:40.778 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:40.150861+0000 mon.a (mon.0) 1479 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:47:40.778 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:40.215620+0000 mon.a (mon.0) 1480 : cluster [DBG] osdmap e360: 8 total, 8 up, 7 in 2024-02-19T21:47:41.060 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:47:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:47:41.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:39.120489+0000 mgr.y (mgr.14514) 577 : cluster [DBG] pgmap v735: 138 pgs: 4 active+remapped+backfilling, 4 active+remapped+backfill_toofull, 130 active+clean; 2.4 GiB data, 10 GiB used, 615 GiB / 626 GiB avail; 0 B/s wr, 431 op/s; 13342/120666 objects misplaced (11.057%); 13 MiB/s, 217 objects/s recovering 2024-02-19T21:47:41.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:40.150861+0000 mon.a (mon.0) 1479 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:47:41.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:40.215620+0000 mon.a (mon.0) 1480 : cluster [DBG] osdmap e360: 8 total, 8 up, 7 in 2024-02-19T21:47:41.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:40.656084+0000 mon.a (mon.0) 1481 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:47:41.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:40.659529+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:47:41.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:40.665440+0000 mon.a (mon.0) 1483 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:47:41.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:40.752666+0000 mgr.y (mgr.14514) 578 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:47:41.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:41.263454+0000 mon.b (mon.1) 60 : audit [INF] from='client.? 172.21.15.80:0/3341509097' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:47:41.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:41.264160+0000 mon.a (mon.0) 1484 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:47:41.708 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-02-19T21:47:41.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:40.656084+0000 mon.a (mon.0) 1481 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:47:41.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:40.659529+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:47:41.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:40.665440+0000 mon.a (mon.0) 1483 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:47:41.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:40.752666+0000 mgr.y (mgr.14514) 578 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:47:41.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:41.263454+0000 mon.b (mon.1) 60 : audit [INF] from='client.? 172.21.15.80:0/3341509097' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:47:41.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:41.264160+0000 mon.a (mon.0) 1484 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:47:42.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:40.656084+0000 mon.a (mon.0) 1481 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:47:42.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:40.659529+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:47:42.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:40.665440+0000 mon.a (mon.0) 1483 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:47:42.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:40.752666+0000 mgr.y (mgr.14514) 578 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:47:42.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:41.263454+0000 mon.b (mon.1) 60 : audit [INF] from='client.? 172.21.15.80:0/3341509097' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:47:42.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:41.264160+0000 mon.a (mon.0) 1484 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:47:42.114 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:47:42.145 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:47:42.155 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:42.156 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:47:42.256 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:47:42.311 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:42.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:41.121307+0000 mgr.y (mgr.14514) 579 : cluster [DBG] pgmap v737: 138 pgs: 4 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 131 active+clean; 2.2 GiB data, 9.6 GiB used, 616 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.07k op/s; 10901/107919 objects misplaced (10.101%); 24 MiB/s, 389 objects/s recovering 2024-02-19T21:47:42.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:41.663062+0000 mon.a (mon.0) 1485 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:47:42.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:41.691697+0000 mon.a (mon.0) 1486 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:47:42.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:41.691752+0000 mon.a (mon.0) 1487 : cluster [DBG] osdmap e361: 8 total, 8 up, 7 in 2024-02-19T21:47:42.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:41.121307+0000 mgr.y (mgr.14514) 579 : cluster [DBG] pgmap v737: 138 pgs: 4 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 131 active+clean; 2.2 GiB data, 9.6 GiB used, 616 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.07k op/s; 10901/107919 objects misplaced (10.101%); 24 MiB/s, 389 objects/s recovering 2024-02-19T21:47:42.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:41.663062+0000 mon.a (mon.0) 1485 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:47:42.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:41.691697+0000 mon.a (mon.0) 1486 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:47:42.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:41.691752+0000 mon.a (mon.0) 1487 : cluster [DBG] osdmap e361: 8 total, 8 up, 7 in 2024-02-19T21:47:43.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:41.121307+0000 mgr.y (mgr.14514) 579 : cluster [DBG] pgmap v737: 138 pgs: 4 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 131 active+clean; 2.2 GiB data, 9.6 GiB used, 616 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.07k op/s; 10901/107919 objects misplaced (10.101%); 24 MiB/s, 389 objects/s recovering 2024-02-19T21:47:43.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:41.663062+0000 mon.a (mon.0) 1485 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:47:43.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:41.691697+0000 mon.a (mon.0) 1486 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:47:43.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:41.691752+0000 mon.a (mon.0) 1487 : cluster [DBG] osdmap e361: 8 total, 8 up, 7 in 2024-02-19T21:47:43.368 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:47:43.379 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:43.380 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:47:43.481 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:47:43.522 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:43.988 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:47:44.004 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:44.004 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:47:44.105 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:47:44.160 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:44.615 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:43.121695+0000 mgr.y (mgr.14514) 580 : cluster [DBG] pgmap v739: 138 pgs: 4 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 131 active+clean; 2.2 GiB data, 9.6 GiB used, 616 GiB / 626 GiB avail; 740 B/s rd, 0 B/s wr, 615 op/s; 10901/107919 objects misplaced (10.101%); 10 MiB/s, 160 objects/s recovering 2024-02-19T21:47:44.615 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:44.347378+0000 mon.a (mon.0) 1488 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:47:44.615 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:43.121695+0000 mgr.y (mgr.14514) 580 : cluster [DBG] pgmap v739: 138 pgs: 4 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 131 active+clean; 2.2 GiB data, 9.6 GiB used, 616 GiB / 626 GiB avail; 740 B/s rd, 0 B/s wr, 615 op/s; 10901/107919 objects misplaced (10.101%); 10 MiB/s, 160 objects/s recovering 2024-02-19T21:47:44.615 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:44.347378+0000 mon.a (mon.0) 1488 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:47:44.938 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:47:44.943 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:44.943 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:47:44.969 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:47:45.014 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:47:45.044 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:47:45.053 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:47:45.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:43.121695+0000 mgr.y (mgr.14514) 580 : cluster [DBG] pgmap v739: 138 pgs: 4 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 131 active+clean; 2.2 GiB data, 9.6 GiB used, 616 GiB / 626 GiB avail; 740 B/s rd, 0 B/s wr, 615 op/s; 10901/107919 objects misplaced (10.101%); 10 MiB/s, 160 objects/s recovering 2024-02-19T21:47:45.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:44.347378+0000 mon.a (mon.0) 1488 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:47:45.088 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:47:45.097 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:45.138 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:47:45.177 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:47:45.214 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:47:45.252 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:47:45.263 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:47:45.263 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:47:45.263 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:47:45.263 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:47:45.263 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:47:45.263 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:47:45.263 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:47:45.263 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:47:45.680 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:47:45.682 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:45.682 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:47:45.783 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:47:45.804 INFO:teuthology.orchestra.run.smithi080.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-02-19T21:47:45.813 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:45.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:44.927462+0000 mon.c (mon.2) 79 : audit [DBG] from='client.? 172.21.15.80:0/871884979' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:47:45.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:45.139430+0000 mon.c (mon.2) 80 : audit [INF] from='client.? 172.21.15.80:0/1364853352' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]: dispatch 2024-02-19T21:47:45.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:45.139962+0000 mon.a (mon.0) 1489 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]: dispatch 2024-02-19T21:47:45.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:45.206153+0000 mon.a (mon.0) 1490 : cluster [WRN] Health check update: Low space hindering backfill (add storage if this doesn't resolve itself): 3 pgs backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:47:45.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:45.223543+0000 mon.a (mon.0) 1491 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]': finished 2024-02-19T21:47:45.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:45.223626+0000 mon.a (mon.0) 1492 : cluster [DBG] osdmap e362: 8 total, 8 up, 7 in 2024-02-19T21:47:45.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:44.927462+0000 mon.c (mon.2) 79 : audit [DBG] from='client.? 172.21.15.80:0/871884979' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:47:45.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:45.139430+0000 mon.c (mon.2) 80 : audit [INF] from='client.? 172.21.15.80:0/1364853352' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]: dispatch 2024-02-19T21:47:45.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:45.139962+0000 mon.a (mon.0) 1489 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]: dispatch 2024-02-19T21:47:45.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:45.206153+0000 mon.a (mon.0) 1490 : cluster [WRN] Health check update: Low space hindering backfill (add storage if this doesn't resolve itself): 3 pgs backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:47:45.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:45.223543+0000 mon.a (mon.0) 1491 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]': finished 2024-02-19T21:47:45.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:45.223626+0000 mon.a (mon.0) 1492 : cluster [DBG] osdmap e362: 8 total, 8 up, 7 in 2024-02-19T21:47:46.004 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:47:46.012 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:47:46.015 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:46.015 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:47:46.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:47:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:47:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:47:46.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:44.927462+0000 mon.c (mon.2) 79 : audit [DBG] from='client.? 172.21.15.80:0/871884979' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:47:46.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:45.139430+0000 mon.c (mon.2) 80 : audit [INF] from='client.? 172.21.15.80:0/1364853352' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]: dispatch 2024-02-19T21:47:46.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:45.139962+0000 mon.a (mon.0) 1489 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]: dispatch 2024-02-19T21:47:46.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:45.206153+0000 mon.a (mon.0) 1490 : cluster [WRN] Health check update: Low space hindering backfill (add storage if this doesn't resolve itself): 3 pgs backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:47:46.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:45.223543+0000 mon.a (mon.0) 1491 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]': finished 2024-02-19T21:47:46.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:45.223626+0000 mon.a (mon.0) 1492 : cluster [DBG] osdmap e362: 8 total, 8 up, 7 in 2024-02-19T21:47:46.116 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:47:46.141 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:46.161 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:47:46.164 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:46.164 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:47:46.265 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:47:46.295 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:46.324 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:47:46.336 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:46.337 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:47:46.437 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:47:46.491 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:46.528 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:47:46.536 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:46.536 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:47:46.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:45.122382+0000 mgr.y (mgr.14514) 581 : cluster [DBG] pgmap v740: 138 pgs: 4 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 131 active+clean; 2.2 GiB data, 9.4 GiB used, 616 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 597 op/s; 10594/106332 objects misplaced (9.963%); 9.1 MiB/s, 145 objects/s recovering 2024-02-19T21:47:46.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:46.238636+0000 mon.a (mon.0) 1493 : cluster [DBG] osdmap e363: 8 total, 8 up, 7 in 2024-02-19T21:47:46.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:45.122382+0000 mgr.y (mgr.14514) 581 : cluster [DBG] pgmap v740: 138 pgs: 4 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 131 active+clean; 2.2 GiB data, 9.4 GiB used, 616 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 597 op/s; 10594/106332 objects misplaced (9.963%); 9.1 MiB/s, 145 objects/s recovering 2024-02-19T21:47:46.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:46.238636+0000 mon.a (mon.0) 1493 : cluster [DBG] osdmap e363: 8 total, 8 up, 7 in 2024-02-19T21:47:46.637 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:47:46.680 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:46.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:45.122382+0000 mgr.y (mgr.14514) 581 : cluster [DBG] pgmap v740: 138 pgs: 4 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 131 active+clean; 2.2 GiB data, 9.4 GiB used, 616 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 597 op/s; 10594/106332 objects misplaced (9.963%); 9.1 MiB/s, 145 objects/s recovering 2024-02-19T21:47:46.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:46.238636+0000 mon.a (mon.0) 1493 : cluster [DBG] osdmap e363: 8 total, 8 up, 7 in 2024-02-19T21:47:47.482 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-19T21:47:47.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:46.590330+0000 osd.7 (osd.7) 221 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:47:47.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:46.590389+0000 osd.7 (osd.7) 222 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:47:47.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:47.242573+0000 mon.a (mon.0) 1494 : cluster [DBG] osdmap e364: 8 total, 8 up, 7 in 2024-02-19T21:47:47.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:46.590330+0000 osd.7 (osd.7) 221 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:47:47.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:46.590389+0000 osd.7 (osd.7) 222 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:47:47.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:47.242573+0000 mon.a (mon.0) 1494 : cluster [DBG] osdmap e364: 8 total, 8 up, 7 in 2024-02-19T21:47:48.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:46.590330+0000 osd.7 (osd.7) 221 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:47:48.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:46.590389+0000 osd.7 (osd.7) 222 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:47:48.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:47.242573+0000 mon.a (mon.0) 1494 : cluster [DBG] osdmap e364: 8 total, 8 up, 7 in 2024-02-19T21:47:48.334 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:47:48.337 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:48.338 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:47:48.439 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:47:48.489 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:48.520 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:47:48.525 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:48.525 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:47:48.626 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:47:48.664 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:47:48.680 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:48.710 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:47:48.719 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:48.719 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:47:48.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:47.122765+0000 mgr.y (mgr.14514) 582 : cluster [DBG] pgmap v743: 138 pgs: 4 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 131 active+clean; 1.9 GiB data, 8.9 GiB used, 617 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 723 op/s; 8640/94908 objects misplaced (9.104%); 11 MiB/s, 175 objects/s recovering 2024-02-19T21:47:48.820 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:47:48.896 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:48.945 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:47:48.950 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:48.951 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:47:49.052 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:47:49.076 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:47.122765+0000 mgr.y (mgr.14514) 582 : cluster [DBG] pgmap v743: 138 pgs: 4 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 131 active+clean; 1.9 GiB data, 8.9 GiB used, 617 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 723 op/s; 8640/94908 objects misplaced (9.104%); 11 MiB/s, 175 objects/s recovering 2024-02-19T21:47:49.076 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:47.122765+0000 mgr.y (mgr.14514) 582 : cluster [DBG] pgmap v743: 138 pgs: 4 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 131 active+clean; 1.9 GiB data, 8.9 GiB used, 617 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 723 op/s; 8640/94908 objects misplaced (9.104%); 11 MiB/s, 175 objects/s recovering 2024-02-19T21:47:49.077 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:50.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:48.965366+0000 mon.a (mon.0) 1495 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:47:50.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:48.965366+0000 mon.a (mon.0) 1495 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:47:50.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:48.965366+0000 mon.a (mon.0) 1495 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:47:51.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:49.123167+0000 mgr.y (mgr.14514) 583 : cluster [DBG] pgmap v745: 138 pgs: 4 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 131 active+clean; 1.9 GiB data, 8.9 GiB used, 617 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 723 op/s; 8640/94908 objects misplaced (9.104%); 11 MiB/s, 175 objects/s recovering 2024-02-19T21:47:51.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:50.924810+0000 osd.4 (osd.4) 179 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:47:51.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:50.924869+0000 osd.4 (osd.4) 180 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:47:51.057 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:47:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:47:51.096 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:47:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:47:50] "GET /metrics HTTP/1.1" 200 176201 "" "Prometheus/2.33.4" 2024-02-19T21:47:51.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:49.123167+0000 mgr.y (mgr.14514) 583 : cluster [DBG] pgmap v745: 138 pgs: 4 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 131 active+clean; 1.9 GiB data, 8.9 GiB used, 617 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 723 op/s; 8640/94908 objects misplaced (9.104%); 11 MiB/s, 175 objects/s recovering 2024-02-19T21:47:51.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:50.924810+0000 osd.4 (osd.4) 179 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:47:51.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:50.924869+0000 osd.4 (osd.4) 180 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:47:51.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:49.123167+0000 mgr.y (mgr.14514) 583 : cluster [DBG] pgmap v745: 138 pgs: 4 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 131 active+clean; 1.9 GiB data, 8.9 GiB used, 617 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 723 op/s; 8640/94908 objects misplaced (9.104%); 11 MiB/s, 175 objects/s recovering 2024-02-19T21:47:51.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:50.924810+0000 osd.4 (osd.4) 179 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:47:51.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:50.924869+0000 osd.4 (osd.4) 180 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:47:52.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:50.768813+0000 mgr.y (mgr.14514) 584 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:47:52.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:51.224950+0000 mon.a (mon.0) 1496 : cluster [DBG] osdmap e365: 8 total, 8 up, 7 in 2024-02-19T21:47:52.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:50.768813+0000 mgr.y (mgr.14514) 584 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:47:52.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:51.224950+0000 mon.a (mon.0) 1496 : cluster [DBG] osdmap e365: 8 total, 8 up, 7 in 2024-02-19T21:47:52.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:50.768813+0000 mgr.y (mgr.14514) 584 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:47:52.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:51.224950+0000 mon.a (mon.0) 1496 : cluster [DBG] osdmap e365: 8 total, 8 up, 7 in 2024-02-19T21:47:53.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:51.124017+0000 mgr.y (mgr.14514) 585 : cluster [DBG] pgmap v746: 138 pgs: 3 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 132 active+clean; 1.7 GiB data, 8.7 GiB used, 617 GiB / 626 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.12k op/s; 7368/86235 objects misplaced (8.544%); 16 MiB/s, 245 objects/s recovering 2024-02-19T21:47:53.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:51.124017+0000 mgr.y (mgr.14514) 585 : cluster [DBG] pgmap v746: 138 pgs: 3 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 132 active+clean; 1.7 GiB data, 8.7 GiB used, 617 GiB / 626 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.12k op/s; 7368/86235 objects misplaced (8.544%); 16 MiB/s, 245 objects/s recovering 2024-02-19T21:47:53.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:51.124017+0000 mgr.y (mgr.14514) 585 : cluster [DBG] pgmap v746: 138 pgs: 3 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 132 active+clean; 1.7 GiB data, 8.7 GiB used, 617 GiB / 626 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.12k op/s; 7368/86235 objects misplaced (8.544%); 16 MiB/s, 245 objects/s recovering 2024-02-19T21:47:54.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:53.124425+0000 mgr.y (mgr.14514) 586 : cluster [DBG] pgmap v748: 138 pgs: 3 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 132 active+clean; 1.7 GiB data, 8.7 GiB used, 617 GiB / 626 GiB avail; 445 B/s rd, 0 B/s wr, 420 op/s; 7368/86235 objects misplaced (8.544%); 4.6 MiB/s, 69 objects/s recovering 2024-02-19T21:47:54.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:53.124425+0000 mgr.y (mgr.14514) 586 : cluster [DBG] pgmap v748: 138 pgs: 3 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 132 active+clean; 1.7 GiB data, 8.7 GiB used, 617 GiB / 626 GiB avail; 445 B/s rd, 0 B/s wr, 420 op/s; 7368/86235 objects misplaced (8.544%); 4.6 MiB/s, 69 objects/s recovering 2024-02-19T21:47:54.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:53.124425+0000 mgr.y (mgr.14514) 586 : cluster [DBG] pgmap v748: 138 pgs: 3 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 132 active+clean; 1.7 GiB data, 8.7 GiB used, 617 GiB / 626 GiB avail; 445 B/s rd, 0 B/s wr, 420 op/s; 7368/86235 objects misplaced (8.544%); 4.6 MiB/s, 69 objects/s recovering 2024-02-19T21:47:55.719 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:47:55.751 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:47:55.754 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:55.755 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:47:55.856 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:47:55.902 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:47:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:47:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:47:55.906 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:55.942 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:47:55.945 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:55.946 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:47:56.047 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:47:56.096 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:56.135 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:47:56.145 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:56.146 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:47:56.235 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:55.125200+0000 mgr.y (mgr.14514) 587 : cluster [DBG] pgmap v749: 138 pgs: 3 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 132 active+clean; 1.6 GiB data, 8.3 GiB used, 618 GiB / 626 GiB avail; 383 B/s rd, 0 B/s wr, 570 op/s; 6923/81222 objects misplaced (8.524%); 4.4 MiB/s, 66 objects/s recovering 2024-02-19T21:47:56.235 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:55.230485+0000 mon.a (mon.0) 1497 : cluster [DBG] osdmap e366: 8 total, 8 up, 7 in 2024-02-19T21:47:56.246 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:47:56.294 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:55.125200+0000 mgr.y (mgr.14514) 587 : cluster [DBG] pgmap v749: 138 pgs: 3 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 132 active+clean; 1.6 GiB data, 8.3 GiB used, 618 GiB / 626 GiB avail; 383 B/s rd, 0 B/s wr, 570 op/s; 6923/81222 objects misplaced (8.524%); 4.4 MiB/s, 66 objects/s recovering 2024-02-19T21:47:56.294 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:55.230485+0000 mon.a (mon.0) 1497 : cluster [DBG] osdmap e366: 8 total, 8 up, 7 in 2024-02-19T21:47:56.295 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:55.125200+0000 mgr.y (mgr.14514) 587 : cluster [DBG] pgmap v749: 138 pgs: 3 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 132 active+clean; 1.6 GiB data, 8.3 GiB used, 618 GiB / 626 GiB avail; 383 B/s rd, 0 B/s wr, 570 op/s; 6923/81222 objects misplaced (8.524%); 4.4 MiB/s, 66 objects/s recovering 2024-02-19T21:47:56.295 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:55.230485+0000 mon.a (mon.0) 1497 : cluster [DBG] osdmap e366: 8 total, 8 up, 7 in 2024-02-19T21:47:56.310 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:56.361 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:47:56.364 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:56.365 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:47:56.465 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:47:56.526 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:47:56.526 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-02-19T21:47:56.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-02-19T21:47:56.527 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-02-19T21:47:56.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.527 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:199205 7.f 7:f54f23d5:::benchmark_data_smithi080_79222_object84471:head [delete] snapc 0=[] ondisk+write+known_if_redirected e143)", 2024-02-19T21:47:56.527 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:30.217625+0000", 2024-02-19T21:47:56.527 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 566.30618250099997, 2024-02-19T21:47:56.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1406671500000001, 2024-02-19T21:47:56.527 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:47:56.527 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:47:56.527 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:47:56.527 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:47:56.527 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:56.527 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 199205 2024-02-19T21:47:56.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.528 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:47:56.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:47:56.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.217625+0000", 2024-02-19T21:47:56.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:47:56.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:47:56.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.217625+0000", 2024-02-19T21:47:56.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:47:56.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:47:56.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.217623+0000", 2024-02-19T21:47:56.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.859e-06 2024-02-19T21:47:56.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:47:56.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.217633+0000", 2024-02-19T21:47:56.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2663000000000001e-05 2024-02-19T21:47:56.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:47:56.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.217646+0000", 2024-02-19T21:47:56.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6120000000000004e-06 2024-02-19T21:47:56.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:47:56.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.217652+0000", 2024-02-19T21:47:56.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034955870000000001 2024-02-19T21:47:56.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.221148+0000", 2024-02-19T21:47:56.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113101 2024-02-19T21:47:56.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:47:56.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.221261+0000", 2024-02-19T21:47:56.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012301900000000001 2024-02-19T21:47:56.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:47:56.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.221384+0000", 2024-02-19T21:47:56.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085185150000000008 2024-02-19T21:47:56.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229902+0000", 2024-02-19T21:47:56.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035264179999999999 2024-02-19T21:47:56.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:47:56.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.233429+0000", 2024-02-19T21:47:56.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.030760246000000002 2024-02-19T21:47:56.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.264189+0000", 2024-02-19T21:47:56.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8979999999999999e-06 2024-02-19T21:47:56.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:47:56.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.264196+0000", 2024-02-19T21:47:56.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.981450779 2024-02-19T21:47:56.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.245647+0000", 2024-02-19T21:47:56.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1880000000000001e-05 2024-02-19T21:47:56.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:47:56.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.245669+0000", 2024-02-19T21:47:56.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.112543785 2024-02-19T21:47:56.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.358212+0000", 2024-02-19T21:47:56.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9555999999999995e-05 2024-02-19T21:47:56.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:47:56.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.358292+0000", 2024-02-19T21:47:56.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1406671500000001 2024-02-19T21:47:56.534 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.534 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:47:56.534 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.534 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:199215 7.f 7:fa880ab0:::benchmark_data_smithi080_79222_object84481:head [delete] snapc 0=[] ondisk+write+known_if_redirected e143)", 2024-02-19T21:47:56.534 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:30.224149+0000", 2024-02-19T21:47:56.534 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 566.29965798199999, 2024-02-19T21:47:56.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.143588313, 2024-02-19T21:47:56.534 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:47:56.534 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:47:56.534 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:47:56.535 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:47:56.535 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:56.535 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 199215 2024-02-19T21:47:56.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.535 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:47:56.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:47:56.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.224149+0000", 2024-02-19T21:47:56.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:47:56.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:47:56.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.224149+0000", 2024-02-19T21:47:56.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:47:56.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:47:56.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.224149+0000", 2024-02-19T21:47:56.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3409999999999999e-06 2024-02-19T21:47:56.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:47:56.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.224152+0000", 2024-02-19T21:47:56.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5140000000000001e-06 2024-02-19T21:47:56.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:47:56.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.224158+0000", 2024-02-19T21:47:56.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1470000000000003e-06 2024-02-19T21:47:56.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:47:56.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.224162+0000", 2024-02-19T21:47:56.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057741870000000001 2024-02-19T21:47:56.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229936+0000", 2024-02-19T21:47:56.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9172999999999995e-05 2024-02-19T21:47:56.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:47:56.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.230025+0000", 2024-02-19T21:47:56.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9171000000000003e-05 2024-02-19T21:47:56.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,7", 2024-02-19T21:47:56.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.230124+0000", 2024-02-19T21:47:56.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015308881999999999 2024-02-19T21:47:56.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:47:56.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.245433+0000", 2024-02-19T21:47:56.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020072105999999999 2024-02-19T21:47:56.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.265505+0000", 2024-02-19T21:47:56.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0350000000000007e-06 2024-02-19T21:47:56.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:47:56.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.265514+0000", 2024-02-19T21:47:56.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98018463700000003 2024-02-19T21:47:56.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.245699+0000", 2024-02-19T21:47:56.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1910000000000006e-06 2024-02-19T21:47:56.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:47:56.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.245708+0000", 2024-02-19T21:47:56.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1129750279999999 2024-02-19T21:47:56.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.358683+0000", 2024-02-19T21:47:56.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121438 2024-02-19T21:47:56.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for missing object", 2024-02-19T21:47:56.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.358805+0000", 2024-02-19T21:47:56.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0088367979999999999 2024-02-19T21:47:56.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.367642+0000", 2024-02-19T21:47:56.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6200999999999996e-05 2024-02-19T21:47:56.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:47:56.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.367738+0000", 2024-02-19T21:47:56.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.143588313 2024-02-19T21:47:56.541 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.541 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:47:56.541 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.542 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:199227 7.6 7:6852e908:::benchmark_data_smithi080_79222_object84493:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-02-19T21:47:56.542 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:30.272214+0000", 2024-02-19T21:47:56.542 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 566.25159348800003, 2024-02-19T21:47:56.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0968052400000001, 2024-02-19T21:47:56.542 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:47:56.542 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:56.542 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:47:56.542 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:47:56.542 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:56.542 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 199227 2024-02-19T21:47:56.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.542 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:47:56.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:47:56.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.272214+0000", 2024-02-19T21:47:56.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:47:56.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:47:56.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.272214+0000", 2024-02-19T21:47:56.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999976 2024-02-19T21:47:56.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:47:56.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.272212+0000", 2024-02-19T21:47:56.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2119999999999999e-05 2024-02-19T21:47:56.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:47:56.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.272224+0000", 2024-02-19T21:47:56.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4482e-05 2024-02-19T21:47:56.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:47:56.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.272238+0000", 2024-02-19T21:47:56.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4329999999999998e-06 2024-02-19T21:47:56.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:47:56.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.272246+0000", 2024-02-19T21:47:56.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7330000000000007e-05 2024-02-19T21:47:56.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.272323+0000", 2024-02-19T21:47:56.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1031e-05 2024-02-19T21:47:56.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:47:56.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.272334+0000", 2024-02-19T21:47:56.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.96913022000000004 2024-02-19T21:47:56.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.241464+0000", 2024-02-19T21:47:56.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2952000000000001e-05 2024-02-19T21:47:56.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:47:56.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.241477+0000", 2024-02-19T21:47:56.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1132234729999999 2024-02-19T21:47:56.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.354701+0000", 2024-02-19T21:47:56.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5845000000000001e-05 2024-02-19T21:47:56.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:47:56.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.354797+0000", 2024-02-19T21:47:56.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000422963 2024-02-19T21:47:56.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,5,7", 2024-02-19T21:47:56.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.355220+0000", 2024-02-19T21:47:56.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010195503 2024-02-19T21:47:56.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:47:56.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.365415+0000", 2024-02-19T21:47:56.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7411999999999999e-05 2024-02-19T21:47:56.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.365472+0000", 2024-02-19T21:47:56.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030797419999999999 2024-02-19T21:47:56.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.368552+0000", 2024-02-19T21:47:56.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026477599999999999 2024-02-19T21:47:56.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.368817+0000", 2024-02-19T21:47:56.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9876000000000007e-05 2024-02-19T21:47:56.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:47:56.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.368887+0000", 2024-02-19T21:47:56.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013229800000000001 2024-02-19T21:47:56.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:47:56.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.369019+0000", 2024-02-19T21:47:56.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0968052400000001 2024-02-19T21:47:56.549 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.549 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:47:56.549 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.549 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:199229 7.f 7:fdced05f:::benchmark_data_smithi080_79222_object84495:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-02-19T21:47:56.549 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:30.276663+0000", 2024-02-19T21:47:56.549 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 566.24714398900005, 2024-02-19T21:47:56.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0917742279999998, 2024-02-19T21:47:56.549 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:47:56.550 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:56.550 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:47:56.550 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:47:56.550 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:56.550 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 199229 2024-02-19T21:47:56.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.550 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:47:56.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:47:56.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.276663+0000", 2024-02-19T21:47:56.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:47:56.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:47:56.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.276663+0000", 2024-02-19T21:47:56.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:47:56.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:47:56.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.276662+0000", 2024-02-19T21:47:56.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7950000000000008e-06 2024-02-19T21:47:56.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:47:56.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.276670+0000", 2024-02-19T21:47:56.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3722e-05 2024-02-19T21:47:56.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:47:56.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.276683+0000", 2024-02-19T21:47:56.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0430000000000004e-06 2024-02-19T21:47:56.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:47:56.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.276689+0000", 2024-02-19T21:47:56.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1431000000000003e-05 2024-02-19T21:47:56.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.276741+0000", 2024-02-19T21:47:56.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0618999999999999e-05 2024-02-19T21:47:56.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:47:56.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.276751+0000", 2024-02-19T21:47:56.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.96898190399999995 2024-02-19T21:47:56.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.245733+0000", 2024-02-19T21:47:56.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7859999999999997e-06 2024-02-19T21:47:56.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:47:56.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.245741+0000", 2024-02-19T21:47:56.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.113100762 2024-02-19T21:47:56.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.358842+0000", 2024-02-19T21:47:56.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012274900000000001 2024-02-19T21:47:56.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:47:56.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.358965+0000", 2024-02-19T21:47:56.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000501824 2024-02-19T21:47:56.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,4,7", 2024-02-19T21:47:56.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.359466+0000", 2024-02-19T21:47:56.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061552739999999996 2024-02-19T21:47:56.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.365622+0000", 2024-02-19T21:47:56.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9379000000000001e-05 2024-02-19T21:47:56.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.365691+0000", 2024-02-19T21:47:56.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00044686599999999997 2024-02-19T21:47:56.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:47:56.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.366138+0000", 2024-02-19T21:47:56.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0021616090000000001 2024-02-19T21:47:56.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.368299+0000", 2024-02-19T21:47:56.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3013000000000003e-05 2024-02-19T21:47:56.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:47:56.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.368342+0000", 2024-02-19T21:47:56.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5144999999999998e-05 2024-02-19T21:47:56.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:47:56.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.368438+0000", 2024-02-19T21:47:56.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0917742279999998 2024-02-19T21:47:56.556 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.556 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:47:56.556 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.556 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:199231 7.6 7:684f5a25:::benchmark_data_smithi080_79222_object84497:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-02-19T21:47:56.557 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:30.278362+0000", 2024-02-19T21:47:56.557 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 566.24544560000004, 2024-02-19T21:47:56.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.091004968, 2024-02-19T21:47:56.557 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:47:56.557 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:56.557 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:47:56.557 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:47:56.557 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:56.557 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 199231 2024-02-19T21:47:56.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.557 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:47:56.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:47:56.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.278362+0000", 2024-02-19T21:47:56.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:47:56.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:47:56.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.278362+0000", 2024-02-19T21:47:56.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:47:56.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:47:56.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.278361+0000", 2024-02-19T21:47:56.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1339999999999998e-06 2024-02-19T21:47:56.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:47:56.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.278368+0000", 2024-02-19T21:47:56.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2194e-05 2024-02-19T21:47:56.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:47:56.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.278380+0000", 2024-02-19T21:47:56.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0460000000000002e-06 2024-02-19T21:47:56.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:47:56.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.278386+0000", 2024-02-19T21:47:56.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0667000000000001e-05 2024-02-19T21:47:56.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.278437+0000", 2024-02-19T21:47:56.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0003999999999999e-05 2024-02-19T21:47:56.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:47:56.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.278447+0000", 2024-02-19T21:47:56.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.96306393599999995 2024-02-19T21:47:56.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.241511+0000", 2024-02-19T21:47:56.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7559999999999999e-06 2024-02-19T21:47:56.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:47:56.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.241518+0000", 2024-02-19T21:47:56.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.117859503 2024-02-19T21:47:56.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.359378+0000", 2024-02-19T21:47:56.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3511999999999997e-05 2024-02-19T21:47:56.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:47:56.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.359451+0000", 2024-02-19T21:47:56.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6982000000000002e-05 2024-02-19T21:47:56.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,5,7", 2024-02-19T21:47:56.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.359538+0000", 2024-02-19T21:47:56.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0058835880000000004 2024-02-19T21:47:56.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:47:56.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.365422+0000", 2024-02-19T21:47:56.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6373999999999996e-05 2024-02-19T21:47:56.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.365518+0000", 2024-02-19T21:47:56.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032462139999999999 2024-02-19T21:47:56.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.368764+0000", 2024-02-19T21:47:56.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042471700000000002 2024-02-19T21:47:56.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.369189+0000", 2024-02-19T21:47:56.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1245000000000001e-05 2024-02-19T21:47:56.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:47:56.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.369240+0000", 2024-02-19T21:47:56.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012630599999999999 2024-02-19T21:47:56.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:47:56.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.369367+0000", 2024-02-19T21:47:56.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.091004968 2024-02-19T21:47:56.564 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.564 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:47:56.564 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.564 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:199239 7.6 7:61cef367:::benchmark_data_smithi080_79222_object84505:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-02-19T21:47:56.564 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:30.313389+0000", 2024-02-19T21:47:56.564 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 566.21041829900003, 2024-02-19T21:47:56.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0562398119999998, 2024-02-19T21:47:56.564 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:47:56.564 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:56.564 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:47:56.565 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:47:56.565 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:56.565 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 199239 2024-02-19T21:47:56.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.565 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:47:56.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:47:56.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.313389+0000", 2024-02-19T21:47:56.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:47:56.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:47:56.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.313389+0000", 2024-02-19T21:47:56.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:47:56.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:47:56.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.313387+0000", 2024-02-19T21:47:56.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3810000000000005e-06 2024-02-19T21:47:56.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:47:56.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.313397+0000", 2024-02-19T21:47:56.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6901e-05 2024-02-19T21:47:56.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:47:56.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.313413+0000", 2024-02-19T21:47:56.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6100000000000002e-06 2024-02-19T21:47:56.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:47:56.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.313420+0000", 2024-02-19T21:47:56.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5312000000000002e-05 2024-02-19T21:47:56.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.313475+0000", 2024-02-19T21:47:56.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0936e-05 2024-02-19T21:47:56.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:47:56.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.313486+0000", 2024-02-19T21:47:56.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.92994775100000004 2024-02-19T21:47:56.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.243434+0000", 2024-02-19T21:47:56.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1535000000000001e-05 2024-02-19T21:47:56.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:47:56.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.243446+0000", 2024-02-19T21:47:56.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.118529742 2024-02-19T21:47:56.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.361975+0000", 2024-02-19T21:47:56.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010784 2024-02-19T21:47:56.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:47:56.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.362083+0000", 2024-02-19T21:47:56.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000135792 2024-02-19T21:47:56.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,5,7", 2024-02-19T21:47:56.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.362219+0000", 2024-02-19T21:47:56.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003306893 2024-02-19T21:47:56.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:47:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.365526+0000", 2024-02-19T21:47:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035462369999999998 2024-02-19T21:47:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.369072+0000", 2024-02-19T21:47:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2008999999999994e-05 2024-02-19T21:47:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.369144+0000", 2024-02-19T21:47:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030739100000000001 2024-02-19T21:47:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.369452+0000", 2024-02-19T21:47:56.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0130999999999998e-05 2024-02-19T21:47:56.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:47:56.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.369502+0000", 2024-02-19T21:47:56.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000127238 2024-02-19T21:47:56.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:47:56.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:32.369629+0000", 2024-02-19T21:47:56.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0562398119999998 2024-02-19T21:47:56.571 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.571 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:47:56.572 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.572 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:210701 7.6 7:6ac72bc1:::benchmark_data_smithi080_79222_object95967:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:47:56.572 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:46.006216+0000", 2024-02-19T21:47:56.572 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 550.51759114499998, 2024-02-19T21:47:56.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0367069870000001, 2024-02-19T21:47:56.572 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:47:56.572 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:47:56.572 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:47:56.572 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:47:56.572 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:56.572 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210701 2024-02-19T21:47:56.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:47:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:47:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.006216+0000", 2024-02-19T21:47:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:47:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:47:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.006216+0000", 2024-02-19T21:47:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:47:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:47:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.006215+0000", 2024-02-19T21:47:56.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7510000000000008e-06 2024-02-19T21:47:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:47:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.006222+0000", 2024-02-19T21:47:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8026999999999999e-05 2024-02-19T21:47:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:47:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.006240+0000", 2024-02-19T21:47:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6569999999999997e-06 2024-02-19T21:47:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:47:56.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.006248+0000", 2024-02-19T21:47:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018719769999999999 2024-02-19T21:47:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.008120+0000", 2024-02-19T21:47:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8023999999999995e-05 2024-02-19T21:47:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:47:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.008218+0000", 2024-02-19T21:47:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011971799999999999 2024-02-19T21:47:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,5,7", 2024-02-19T21:47:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.008338+0000", 2024-02-19T21:47:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0075400900000000002 2024-02-19T21:47:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.015878+0000", 2024-02-19T21:47:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9990000000000008e-06 2024-02-19T21:47:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:47:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.015886+0000", 2024-02-19T21:47:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.026982287 2024-02-19T21:47:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.042868+0000", 2024-02-19T21:47:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5086000000000001e-05 2024-02-19T21:47:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:47:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.042923+0000", 2024-02-19T21:47:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0367069870000001 2024-02-19T21:47:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:47:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:210709 7.6 7:6e6a8f35:::benchmark_data_smithi080_79222_object95975:head [delete] snapc 0=[] ondisk+write+known_if_redirected e146)", 2024-02-19T21:47:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:46.012578+0000", 2024-02-19T21:47:56.577 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 550.51122943999997, 2024-02-19T21:47:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.03834815, 2024-02-19T21:47:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:47:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:47:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:47:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210709 2024-02-19T21:47:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:47:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:47:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.012578+0000", 2024-02-19T21:47:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:47:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:47:56.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.012578+0000", 2024-02-19T21:47:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:47:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:47:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.012576+0000", 2024-02-19T21:47:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0880000000000001e-06 2024-02-19T21:47:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:47:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.012585+0000", 2024-02-19T21:47:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2099000000000001e-05 2024-02-19T21:47:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:47:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.012597+0000", 2024-02-19T21:47:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4749999999999998e-06 2024-02-19T21:47:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:47:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.012604+0000", 2024-02-19T21:47:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033026069999999999 2024-02-19T21:47:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.015906+0000", 2024-02-19T21:47:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0079999999999999e-06 2024-02-19T21:47:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:47:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.015912+0000", 2024-02-19T21:47:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0273553 2024-02-19T21:47:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.043267+0000", 2024-02-19T21:47:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121174 2024-02-19T21:47:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:47:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.043389+0000", 2024-02-19T21:47:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013930099999999999 2024-02-19T21:47:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,7", 2024-02-19T21:47:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.043528+0000", 2024-02-19T21:47:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073013959999999999 2024-02-19T21:47:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.050829+0000", 2024-02-19T21:47:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0027999999999997e-05 2024-02-19T21:47:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.050869+0000", 2024-02-19T21:47:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1010000000000003e-06 2024-02-19T21:47:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:47:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.050876+0000", 2024-02-19T21:47:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7688999999999999e-05 2024-02-19T21:47:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:47:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.050904+0000", 2024-02-19T21:47:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1943e-05 2024-02-19T21:47:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:47:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.050926+0000", 2024-02-19T21:47:56.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.03834815 2024-02-19T21:47:56.584 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.584 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:47:56.584 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.584 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:210719 7.6 7:64d9e72c:::benchmark_data_smithi080_79222_object95985:head [delete] snapc 0=[] ondisk+write+known_if_redirected e147)", 2024-02-19T21:47:56.584 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:46.026989+0000", 2024-02-19T21:47:56.584 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 550.49681848199998, 2024-02-19T21:47:56.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0240782049999999, 2024-02-19T21:47:56.584 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:47:56.584 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:56.584 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:47:56.584 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:47:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210719 2024-02-19T21:47:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:47:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:47:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.026989+0000", 2024-02-19T21:47:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:47:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:47:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.026989+0000", 2024-02-19T21:47:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:47:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:47:56.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.026987+0000", 2024-02-19T21:47:56.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6559999999999998e-06 2024-02-19T21:47:56.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:47:56.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.026996+0000", 2024-02-19T21:47:56.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8037999999999999e-05 2024-02-19T21:47:56.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:47:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.027014+0000", 2024-02-19T21:47:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.391e-06 2024-02-19T21:47:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:47:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.027021+0000", 2024-02-19T21:47:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3176000000000006e-05 2024-02-19T21:47:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.027084+0000", 2024-02-19T21:47:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4861000000000001e-05 2024-02-19T21:47:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:47:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.027099+0000", 2024-02-19T21:47:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.019046833 2024-02-19T21:47:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.046146+0000", 2024-02-19T21:47:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011827100000000001 2024-02-19T21:47:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:47:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.046264+0000", 2024-02-19T21:47:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000146286 2024-02-19T21:47:56.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,7", 2024-02-19T21:47:56.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.046410+0000", 2024-02-19T21:47:56.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004523661 2024-02-19T21:47:56.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:47:56.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.050934+0000", 2024-02-19T21:47:56.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1031000000000002e-05 2024-02-19T21:47:56.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.050965+0000", 2024-02-19T21:47:56.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7708999999999998e-05 2024-02-19T21:47:56.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.050993+0000", 2024-02-19T21:47:56.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7109e-05 2024-02-19T21:47:56.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:47:56.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.051030+0000", 2024-02-19T21:47:56.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7237999999999998e-05 2024-02-19T21:47:56.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:47:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.051067+0000", 2024-02-19T21:47:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0240782049999999 2024-02-19T21:47:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:47:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:210745 7.6 7:6da67535:::benchmark_data_smithi080_79222_object96011:head [delete] snapc 0=[] ondisk+write+known_if_redirected e147)", 2024-02-19T21:47:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:46.051028+0000", 2024-02-19T21:47:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 550.47277959400003, 2024-02-19T21:47:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0002155180000001, 2024-02-19T21:47:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:47:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:47:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:47:56.592 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:56.592 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210745 2024-02-19T21:47:56.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.592 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:47:56.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:47:56.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.051028+0000", 2024-02-19T21:47:56.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:47:56.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:47:56.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.051028+0000", 2024-02-19T21:47:56.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:47:56.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:47:56.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.051026+0000", 2024-02-19T21:47:56.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8499999999999994e-06 2024-02-19T21:47:56.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:47:56.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.051034+0000", 2024-02-19T21:47:56.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1426999999999999e-05 2024-02-19T21:47:56.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:47:56.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.051046+0000", 2024-02-19T21:47:56.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5239999999999997e-06 2024-02-19T21:47:56.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:47:56.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.051052+0000", 2024-02-19T21:47:56.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6909e-05 2024-02-19T21:47:56.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.051109+0000", 2024-02-19T21:47:56.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.977e-06 2024-02-19T21:47:56.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:47:56.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.051117+0000", 2024-02-19T21:47:56.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.99756426399999998 2024-02-19T21:47:56.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.048681+0000", 2024-02-19T21:47:56.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000107496 2024-02-19T21:47:56.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:47:56.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.048789+0000", 2024-02-19T21:47:56.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000138236 2024-02-19T21:47:56.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,7", 2024-02-19T21:47:56.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.048927+0000", 2024-02-19T21:47:56.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002151264 2024-02-19T21:47:56.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:47:56.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.051078+0000", 2024-02-19T21:47:56.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6669999999999999e-05 2024-02-19T21:47:56.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.051125+0000", 2024-02-19T21:47:56.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0346999999999998e-05 2024-02-19T21:47:56.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.051175+0000", 2024-02-19T21:47:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9811999999999998e-05 2024-02-19T21:47:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:47:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.051205+0000", 2024-02-19T21:47:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8158999999999998e-05 2024-02-19T21:47:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:47:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.051243+0000", 2024-02-19T21:47:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0002155180000001 2024-02-19T21:47:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.598 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:47:56.598 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.598 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:210770 7.6 7:696320ab:::benchmark_data_smithi080_79222_object96036:head [delete] snapc 0=[] ondisk+write+known_if_redirected e147)", 2024-02-19T21:47:56.598 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:46.085540+0000", 2024-02-19T21:47:56.598 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 550.43826706899995, 2024-02-19T21:47:56.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98762682199999996, 2024-02-19T21:47:56.598 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:47:56.598 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:56.598 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:47:56.598 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:47:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210770 2024-02-19T21:47:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:47:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:47:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085540+0000", 2024-02-19T21:47:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:47:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:47:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085540+0000", 2024-02-19T21:47:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:47:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:47:56.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085539+0000", 2024-02-19T21:47:56.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0530000000000001e-06 2024-02-19T21:47:56.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:47:56.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085546+0000", 2024-02-19T21:47:56.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1626e-05 2024-02-19T21:47:56.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:47:56.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085558+0000", 2024-02-19T21:47:56.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0000000000000002e-06 2024-02-19T21:47:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:47:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085564+0000", 2024-02-19T21:47:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0708000000000002e-05 2024-02-19T21:47:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085625+0000", 2024-02-19T21:47:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0899999999999999e-06 2024-02-19T21:47:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:47:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085632+0000", 2024-02-19T21:47:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.965647649 2024-02-19T21:47:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.051279+0000", 2024-02-19T21:47:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0611000000000004e-05 2024-02-19T21:47:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:47:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.051370+0000", 2024-02-19T21:47:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000124559 2024-02-19T21:47:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,7", 2024-02-19T21:47:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.051494+0000", 2024-02-19T21:47:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057145379999999999 2024-02-19T21:47:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:47:56.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.057209+0000", 2024-02-19T21:47:56.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0075562199999999998 2024-02-19T21:47:56.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.064765+0000", 2024-02-19T21:47:56.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0083054649999999997 2024-02-19T21:47:56.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073071+0000", 2024-02-19T21:47:56.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8593e-05 2024-02-19T21:47:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:47:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073129+0000", 2024-02-19T21:47:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7911999999999999e-05 2024-02-19T21:47:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:47:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073167+0000", 2024-02-19T21:47:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98762682199999996 2024-02-19T21:47:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:47:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:210771 7.6 7:682866f3:::benchmark_data_smithi080_79222_object96037:head [delete] snapc 0=[] ondisk+write+known_if_redirected e147)", 2024-02-19T21:47:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:46.085578+0000", 2024-02-19T21:47:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 550.43822980799996, 2024-02-19T21:47:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98768554799999997, 2024-02-19T21:47:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:47:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:47:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:47:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210771 2024-02-19T21:47:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:47:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:47:56.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085578+0000", 2024-02-19T21:47:56.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:47:56.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:47:56.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085578+0000", 2024-02-19T21:47:56.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:47:56.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:47:56.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085577+0000", 2024-02-19T21:47:56.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.027e-06 2024-02-19T21:47:56.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:47:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085580+0000", 2024-02-19T21:47:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6269999999999997e-06 2024-02-19T21:47:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:47:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085586+0000", 2024-02-19T21:47:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.703e-06 2024-02-19T21:47:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:47:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085589+0000", 2024-02-19T21:47:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8749000000000003e-05 2024-02-19T21:47:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085648+0000", 2024-02-19T21:47:56.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8500000000000002e-06 2024-02-19T21:47:56.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:47:56.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.085653+0000", 2024-02-19T21:47:56.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.96758180299999996 2024-02-19T21:47:56.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.053235+0000", 2024-02-19T21:47:56.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000103496 2024-02-19T21:47:56.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:47:56.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.053338+0000", 2024-02-19T21:47:56.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013926800000000001 2024-02-19T21:47:56.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,7", 2024-02-19T21:47:56.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.053478+0000", 2024-02-19T21:47:56.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0052283870000000001 2024-02-19T21:47:56.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:47:56.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.058706+0000", 2024-02-19T21:47:56.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013529398999999999 2024-02-19T21:47:56.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.072235+0000", 2024-02-19T21:47:56.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00096582600000000003 2024-02-19T21:47:56.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073201+0000", 2024-02-19T21:47:56.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8152000000000001e-05 2024-02-19T21:47:56.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:47:56.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073229+0000", 2024-02-19T21:47:56.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3732000000000002e-05 2024-02-19T21:47:56.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:47:56.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073263+0000", 2024-02-19T21:47:56.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98768554799999997 2024-02-19T21:47:56.611 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.611 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:47:56.611 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.611 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:210799 7.6 7:646ebd13:::benchmark_data_smithi080_79222_object96065:head [delete] snapc 0=[] ondisk+write+known_if_redirected e147)", 2024-02-19T21:47:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:46.119803+0000", 2024-02-19T21:47:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 550.40400461800004, 2024-02-19T21:47:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.95356817999999999, 2024-02-19T21:47:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:47:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:47:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:47:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210799 2024-02-19T21:47:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:47:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:47:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.119803+0000", 2024-02-19T21:47:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:47:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:47:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.119803+0000", 2024-02-19T21:47:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:47:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:47:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.119802+0000", 2024-02-19T21:47:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2410000000000003e-06 2024-02-19T21:47:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:47:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.119807+0000", 2024-02-19T21:47:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2129999999999997e-06 2024-02-19T21:47:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:47:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.119816+0000", 2024-02-19T21:47:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5099999999999998e-06 2024-02-19T21:47:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:47:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.119822+0000", 2024-02-19T21:47:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4808000000000003e-05 2024-02-19T21:47:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.119857+0000", 2024-02-19T21:47:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5889999999999997e-06 2024-02-19T21:47:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:47:56.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.119864+0000", 2024-02-19T21:47:56.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.93562374299999995 2024-02-19T21:47:56.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.055488+0000", 2024-02-19T21:47:56.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2298000000000005e-05 2024-02-19T21:47:56.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:47:56.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.055560+0000", 2024-02-19T21:47:56.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1667000000000003e-05 2024-02-19T21:47:56.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,7", 2024-02-19T21:47:56.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.055642+0000", 2024-02-19T21:47:56.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.006240598 2024-02-19T21:47:56.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:47:56.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.061882+0000", 2024-02-19T21:47:56.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01041094 2024-02-19T21:47:56.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.072293+0000", 2024-02-19T21:47:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010072519999999999 2024-02-19T21:47:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073301+0000", 2024-02-19T21:47:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7805999999999997e-05 2024-02-19T21:47:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:47:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073338+0000", 2024-02-19T21:47:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2486e-05 2024-02-19T21:47:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:47:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073371+0000", 2024-02-19T21:47:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.95356817999999999 2024-02-19T21:47:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:47:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:210821 7.6 7:63bb4219:::benchmark_data_smithi080_79222_object96087:head [delete] snapc 0=[] ondisk+write+known_if_redirected e147)", 2024-02-19T21:47:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:46.151330+0000", 2024-02-19T21:47:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 550.37247735799997, 2024-02-19T21:47:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.92217702099999999, 2024-02-19T21:47:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:47:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:47:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:47:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210821 2024-02-19T21:47:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:47:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:47:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.151330+0000", 2024-02-19T21:47:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:47:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:47:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.151330+0000", 2024-02-19T21:47:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:47:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:47:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.151328+0000", 2024-02-19T21:47:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5220000000000001e-06 2024-02-19T21:47:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:47:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.151336+0000", 2024-02-19T21:47:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1793999999999999e-05 2024-02-19T21:47:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:47:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.151347+0000", 2024-02-19T21:47:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2960000000000004e-06 2024-02-19T21:47:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:47:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.151354+0000", 2024-02-19T21:47:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7815999999999998e-05 2024-02-19T21:47:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.151401+0000", 2024-02-19T21:47:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2060000000000007e-06 2024-02-19T21:47:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:47:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.151410+0000", 2024-02-19T21:47:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.90581814299999996 2024-02-19T21:47:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.057228+0000", 2024-02-19T21:47:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6113999999999995e-05 2024-02-19T21:47:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:47:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.057324+0000", 2024-02-19T21:47:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010802399999999999 2024-02-19T21:47:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,7", 2024-02-19T21:47:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.057432+0000", 2024-02-19T21:47:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073385899999999999 2024-02-19T21:47:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:47:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.064771+0000", 2024-02-19T21:47:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0075701199999999996 2024-02-19T21:47:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.072341+0000", 2024-02-19T21:47:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001079708 2024-02-19T21:47:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073420+0000", 2024-02-19T21:47:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6832999999999997e-05 2024-02-19T21:47:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:47:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073467+0000", 2024-02-19T21:47:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9817000000000002e-05 2024-02-19T21:47:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:47:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073507+0000", 2024-02-19T21:47:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.92217702099999999 2024-02-19T21:47:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:47:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:210840 7.6 7:669c4fd1:::benchmark_data_smithi080_79222_object96106:head [delete] snapc 0=[] ondisk+write+known_if_redirected e147)", 2024-02-19T21:47:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:46.179347+0000", 2024-02-19T21:47:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 550.34446023600003, 2024-02-19T21:47:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.89428998400000004, 2024-02-19T21:47:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:47:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:47:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:47:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210840 2024-02-19T21:47:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:47:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:47:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.179347+0000", 2024-02-19T21:47:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:47:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:47:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.179347+0000", 2024-02-19T21:47:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:47:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:47:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.179347+0000", 2024-02-19T21:47:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1469999999999999e-06 2024-02-19T21:47:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:47:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.179349+0000", 2024-02-19T21:47:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5379999999999996e-06 2024-02-19T21:47:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:47:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.179353+0000", 2024-02-19T21:47:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5890000000000001e-06 2024-02-19T21:47:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:47:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.179356+0000", 2024-02-19T21:47:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5544999999999998e-05 2024-02-19T21:47:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.179402+0000", 2024-02-19T21:47:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0530000000000003e-06 2024-02-19T21:47:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:47:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.179408+0000", 2024-02-19T21:47:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.87932612300000002 2024-02-19T21:47:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.058734+0000", 2024-02-19T21:47:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0507999999999996e-05 2024-02-19T21:47:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:47:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.058804+0000", 2024-02-19T21:47:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5167000000000006e-05 2024-02-19T21:47:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,7", 2024-02-19T21:47:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.058889+0000", 2024-02-19T21:47:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0058850129999999997 2024-02-19T21:47:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:47:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.064774+0000", 2024-02-19T21:47:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0076125489999999997 2024-02-19T21:47:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.072387+0000", 2024-02-19T21:47:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011695290000000001 2024-02-19T21:47:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073557+0000", 2024-02-19T21:47:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1776000000000001e-05 2024-02-19T21:47:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:47:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073598+0000", 2024-02-19T21:47:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8831000000000001e-05 2024-02-19T21:47:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:47:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073637+0000", 2024-02-19T21:47:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.89428998400000004 2024-02-19T21:47:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:47:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:210867 7.6 7:65e104c1:::benchmark_data_smithi080_79222_object96133:head [delete] snapc 0=[] ondisk+write+known_if_redirected e147)", 2024-02-19T21:47:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:46.216445+0000", 2024-02-19T21:47:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 550.307362055, 2024-02-19T21:47:56.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.85732473899999995, 2024-02-19T21:47:56.632 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:47:56.632 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:56.632 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:47:56.632 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:47:56.632 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:56.632 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210867 2024-02-19T21:47:56.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.632 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:47:56.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:47:56.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.216445+0000", 2024-02-19T21:47:56.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:47:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:47:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.216445+0000", 2024-02-19T21:47:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:47:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:47:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.216444+0000", 2024-02-19T21:47:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2060000000000001e-06 2024-02-19T21:47:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:47:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.216451+0000", 2024-02-19T21:47:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8649999999999996e-06 2024-02-19T21:47:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:47:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.216461+0000", 2024-02-19T21:47:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7880000000000003e-06 2024-02-19T21:47:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:47:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.216467+0000", 2024-02-19T21:47:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6378999999999998e-05 2024-02-19T21:47:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.216503+0000", 2024-02-19T21:47:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6389999999999997e-06 2024-02-19T21:47:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:47:56.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.216509+0000", 2024-02-19T21:47:56.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.843655092 2024-02-19T21:47:56.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.060164+0000", 2024-02-19T21:47:56.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6625999999999995e-05 2024-02-19T21:47:56.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:47:56.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.060230+0000", 2024-02-19T21:47:56.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013156999999999999 2024-02-19T21:47:56.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,7", 2024-02-19T21:47:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.060362+0000", 2024-02-19T21:47:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0070599089999999996 2024-02-19T21:47:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:47:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.067422+0000", 2024-02-19T21:47:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049995639999999997 2024-02-19T21:47:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.072421+0000", 2024-02-19T21:47:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001263126 2024-02-19T21:47:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073685+0000", 2024-02-19T21:47:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6437999999999998e-05 2024-02-19T21:47:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:47:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073731+0000", 2024-02-19T21:47:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9057999999999998e-05 2024-02-19T21:47:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:47:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073770+0000", 2024-02-19T21:47:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.85732473899999995 2024-02-19T21:47:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:47:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:210873 7.6 7:65e1aeb7:::benchmark_data_smithi080_79222_object96139:head [delete] snapc 0=[] ondisk+write+known_if_redirected e147)", 2024-02-19T21:47:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:46.220646+0000", 2024-02-19T21:47:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 550.303161305, 2024-02-19T21:47:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.85997098699999996, 2024-02-19T21:47:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:47:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:47:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:47:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210873 2024-02-19T21:47:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:47:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:47:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.220646+0000", 2024-02-19T21:47:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:47:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:47:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.220646+0000", 2024-02-19T21:47:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:47:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:47:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.220645+0000", 2024-02-19T21:47:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8300000000000001e-06 2024-02-19T21:47:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:47:56.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.220650+0000", 2024-02-19T21:47:56.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7310000000000005e-06 2024-02-19T21:47:56.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:47:56.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.220660+0000", 2024-02-19T21:47:56.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6880000000000002e-06 2024-02-19T21:47:56.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:47:56.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.220667+0000", 2024-02-19T21:47:56.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7011000000000001e-05 2024-02-19T21:47:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.220714+0000", 2024-02-19T21:47:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8490000000000001e-06 2024-02-19T21:47:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:47:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.220724+0000", 2024-02-19T21:47:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.84119965900000004 2024-02-19T21:47:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.061923+0000", 2024-02-19T21:47:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8426999999999998e-05 2024-02-19T21:47:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:47:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.062022+0000", 2024-02-19T21:47:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013361800000000001 2024-02-19T21:47:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,7", 2024-02-19T21:47:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.062155+0000", 2024-02-19T21:47:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0052730659999999999 2024-02-19T21:47:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:47:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.067428+0000", 2024-02-19T21:47:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0063878069999999997 2024-02-19T21:47:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073816+0000", 2024-02-19T21:47:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0067316260000000001 2024-02-19T21:47:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.080548+0000", 2024-02-19T21:47:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1437999999999999e-05 2024-02-19T21:47:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:47:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.080589+0000", 2024-02-19T21:47:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7710999999999999e-05 2024-02-19T21:47:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.644 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:47:56.644 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.080617+0000", 2024-02-19T21:47:56.644 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.85997098699999996 2024-02-19T21:47:56.644 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.644 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:47:56.644 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.644 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.644 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.644 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:210915 7.6 7:65513809:::benchmark_data_smithi080_79222_object96181:head [delete] snapc 0=[] ondisk+write+known_if_redirected e147)", 2024-02-19T21:47:56.644 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:46.272400+0000", 2024-02-19T21:47:56.644 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 550.25140710999995, 2024-02-19T21:47:56.644 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.80834293700000004, 2024-02-19T21:47:56.644 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:47:56.644 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:56.645 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:47:56.645 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:47:56.645 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:56.645 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210915 2024-02-19T21:47:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:47:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:47:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.272400+0000", 2024-02-19T21:47:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:47:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:47:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.272400+0000", 2024-02-19T21:47:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:47:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:47:56.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.272399+0000", 2024-02-19T21:47:56.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3350000000000001e-06 2024-02-19T21:47:56.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:47:56.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.272406+0000", 2024-02-19T21:47:56.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2659e-05 2024-02-19T21:47:56.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:47:56.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.272419+0000", 2024-02-19T21:47:56.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0839999999999997e-06 2024-02-19T21:47:56.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:47:56.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.272425+0000", 2024-02-19T21:47:56.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6866999999999997e-05 2024-02-19T21:47:56.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.272472+0000", 2024-02-19T21:47:56.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0942e-05 2024-02-19T21:47:56.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:47:56.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.272483+0000", 2024-02-19T21:47:56.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.79092001199999995 2024-02-19T21:47:56.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.063403+0000", 2024-02-19T21:47:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010090999999999999 2024-02-19T21:47:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:47:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.063504+0000", 2024-02-19T21:47:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011632400000000001 2024-02-19T21:47:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,7", 2024-02-19T21:47:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.063620+0000", 2024-02-19T21:47:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066519719999999999 2024-02-19T21:47:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.650 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:47:56.650 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.070272+0000", 2024-02-19T21:47:56.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035754519999999998 2024-02-19T21:47:56.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.650 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.650 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.073848+0000", 2024-02-19T21:47:56.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0068138699999999996 2024-02-19T21:47:56.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.650 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.650 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.080662+0000", 2024-02-19T21:47:56.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5765e-05 2024-02-19T21:47:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:47:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.080707+0000", 2024-02-19T21:47:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5941e-05 2024-02-19T21:47:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:47:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.080743+0000", 2024-02-19T21:47:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.80834293700000004 2024-02-19T21:47:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:47:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.652 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:210916 7.6 7:6ff02567:::benchmark_data_smithi080_79222_object96182:head [delete] snapc 0=[] ondisk+write+known_if_redirected e147)", 2024-02-19T21:47:56.652 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:46.275928+0000", 2024-02-19T21:47:56.652 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 550.24787910099997, 2024-02-19T21:47:56.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.80800256500000001, 2024-02-19T21:47:56.652 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:47:56.652 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:56.652 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:47:56.652 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:47:56.652 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:56.652 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210916 2024-02-19T21:47:56.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.652 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:47:56.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:47:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.275928+0000", 2024-02-19T21:47:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:47:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:47:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.275928+0000", 2024-02-19T21:47:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:47:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:47:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.275927+0000", 2024-02-19T21:47:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3810000000000001e-06 2024-02-19T21:47:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:47:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.275934+0000", 2024-02-19T21:47:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2346e-05 2024-02-19T21:47:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:47:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.275947+0000", 2024-02-19T21:47:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3230000000000003e-06 2024-02-19T21:47:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:47:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.275953+0000", 2024-02-19T21:47:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0070000000000001e-05 2024-02-19T21:47:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.275993+0000", 2024-02-19T21:47:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2469999999999997e-06 2024-02-19T21:47:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:47:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.275999+0000", 2024-02-19T21:47:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.78879722399999996 2024-02-19T21:47:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.064797+0000", 2024-02-19T21:47:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7978000000000005e-05 2024-02-19T21:47:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:47:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.064875+0000", 2024-02-19T21:47:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4245000000000005e-05 2024-02-19T21:47:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.656 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,7", 2024-02-19T21:47:56.656 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.064949+0000", 2024-02-19T21:47:56.656 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053302879999999999 2024-02-19T21:47:56.656 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.656 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:47:56.656 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.070279+0000", 2024-02-19T21:47:56.656 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011539819 2024-02-19T21:47:56.656 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.656 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.656 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.081819+0000", 2024-02-19T21:47:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002023249 2024-02-19T21:47:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.083842+0000", 2024-02-19T21:47:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7425000000000001e-05 2024-02-19T21:47:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:47:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.083890+0000", 2024-02-19T21:47:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1264000000000003e-05 2024-02-19T21:47:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:47:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.083931+0000", 2024-02-19T21:47:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.80800256500000001 2024-02-19T21:47:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:47:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.14793.0:210938 7.6 7:6ffb3d7f:::benchmark_data_smithi080_79222_object96204:head [delete] snapc 0=[] ondisk+write+known_if_redirected e147)", 2024-02-19T21:47:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:46.306311+0000", 2024-02-19T21:47:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 550.217496493, 2024-02-19T21:47:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.77772747499999995, 2024-02-19T21:47:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:47:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:47:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:47:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.14793", 2024-02-19T21:47:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3275500580", 2024-02-19T21:47:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210938 2024-02-19T21:47:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:47:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:47:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.306311+0000", 2024-02-19T21:47:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:47:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:47:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.306311+0000", 2024-02-19T21:47:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:47:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:47:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.306309+0000", 2024-02-19T21:47:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6769999999999998e-06 2024-02-19T21:47:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:47:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.306316+0000", 2024-02-19T21:47:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1129e-05 2024-02-19T21:47:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:47:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.306327+0000", 2024-02-19T21:47:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4849999999999997e-06 2024-02-19T21:47:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:47:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.306334+0000", 2024-02-19T21:47:56.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3414000000000002e-05 2024-02-19T21:47:56.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.661 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.661 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.306367+0000", 2024-02-19T21:47:56.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5029999999999997e-06 2024-02-19T21:47:56.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.661 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:47:56.661 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:46.306373+0000", 2024-02-19T21:47:56.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.75973460599999998 2024-02-19T21:47:56.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.661 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:47:56.662 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.066107+0000", 2024-02-19T21:47:56.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4220000000000003e-05 2024-02-19T21:47:56.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.662 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:47:56.662 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.066191+0000", 2024-02-19T21:47:56.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0946999999999996e-05 2024-02-19T21:47:56.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.662 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,7", 2024-02-19T21:47:56.662 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.066272+0000", 2024-02-19T21:47:56.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059189769999999997 2024-02-19T21:47:56.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:47:56.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.072191+0000", 2024-02-19T21:47:56.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00965389 2024-02-19T21:47:56.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.081845+0000", 2024-02-19T21:47:56.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0021186209999999998 2024-02-19T21:47:56.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:47:56.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.083964+0000", 2024-02-19T21:47:56.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.057e-05 2024-02-19T21:47:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:47:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.084004+0000", 2024-02-19T21:47:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3929e-05 2024-02-19T21:47:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:47:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:47:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:47:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:47.084038+0000", 2024-02-19T21:47:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.77772747499999995 2024-02-19T21:47:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:47:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:47:56.665 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:47:56.665 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:47:56.665 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:56.666 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:56.666 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:47:56.666 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:47:56.767 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:47:56.839 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:56.894 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:47:56.897 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:56.897 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:47:56.998 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:47:57.093 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:57.128 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:47:57.130 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:57.130 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:47:57.231 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:47:57.277 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:58.043 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:47:58.046 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:58.046 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:47:58.147 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:47:58.211 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:58.251 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:47:58.254 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:58.254 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:47:58.355 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:47:58.407 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:58.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:57.125730+0000 mgr.y (mgr.14514) 588 : cluster [DBG] pgmap v751: 138 pgs: 3 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 132 active+clean; 1.5 GiB data, 7.8 GiB used, 618 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 932 op/s; 6033/72534 objects misplaced (8.317%); 5.3 MiB/s, 81 objects/s recovering 2024-02-19T21:47:58.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:57.125730+0000 mgr.y (mgr.14514) 588 : cluster [DBG] pgmap v751: 138 pgs: 3 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 132 active+clean; 1.5 GiB data, 7.8 GiB used, 618 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 932 op/s; 6033/72534 objects misplaced (8.317%); 5.3 MiB/s, 81 objects/s recovering 2024-02-19T21:47:58.603 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:57.125730+0000 mgr.y (mgr.14514) 588 : cluster [DBG] pgmap v751: 138 pgs: 3 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 132 active+clean; 1.5 GiB data, 7.8 GiB used, 618 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 932 op/s; 6033/72534 objects misplaced (8.317%); 5.3 MiB/s, 81 objects/s recovering 2024-02-19T21:47:58.609 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:47:58.614 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:58.615 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:47:58.628 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.1 dump_ops_in_flight 2024-02-19T21:47:58.716 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:47:58.768 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:58.793 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:47:58.803 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:58.803 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:47:58.904 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:47:58.954 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:47:58.969 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:58.995 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:47:58.997 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:58.998 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:47:59.099 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:47:59.165 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:59.207 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:47:59.211 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:59.211 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:47:59.265 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-02-19T21:47:59.311 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:47:59.360 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:59.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:47:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:59.174352+0000 mon.a (mon.0) 1498 : audit [INF] from='client.? 172.21.15.80:0/4247835412' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:47:59.567 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:47:59.569 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:47:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:59.174352+0000 mon.a (mon.0) 1498 : audit [INF] from='client.? 172.21.15.80:0/4247835412' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:47:59.570 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:47:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:59.174352+0000 mon.a (mon.0) 1498 : audit [INF] from='client.? 172.21.15.80:0/4247835412' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:47:59.570 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:59.570 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:47:59.671 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:47:59.723 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:59.772 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:47:59.783 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:59.784 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:47:59.885 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:47:59.939 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:47:59.987 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:47:59.993 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:47:59.993 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:48:00.094 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:48:00.143 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:00.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:59.126254+0000 mgr.y (mgr.14514) 589 : cluster [DBG] pgmap v752: 138 pgs: 3 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 132 active+clean; 1.5 GiB data, 7.8 GiB used, 618 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 571 op/s; 6033/72534 objects misplaced (8.317%); 1.4 MiB/s, 21 objects/s recovering 2024-02-19T21:48:00.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:59.240392+0000 mon.a (mon.0) 1499 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:48:00.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:47:59.253089+0000 mon.a (mon.0) 1500 : audit [INF] from='client.? 172.21.15.80:0/4247835412' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:48:00.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:47:59.253153+0000 mon.a (mon.0) 1501 : cluster [DBG] osdmap e367: 8 total, 8 up, 7 in 2024-02-19T21:48:00.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:00.225143+0000 mon.a (mon.0) 1502 : cluster [DBG] osdmap e368: 8 total, 8 up, 7 in 2024-02-19T21:48:00.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:59.126254+0000 mgr.y (mgr.14514) 589 : cluster [DBG] pgmap v752: 138 pgs: 3 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 132 active+clean; 1.5 GiB data, 7.8 GiB used, 618 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 571 op/s; 6033/72534 objects misplaced (8.317%); 1.4 MiB/s, 21 objects/s recovering 2024-02-19T21:48:00.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:59.240392+0000 mon.a (mon.0) 1499 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:48:00.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:47:59.253089+0000 mon.a (mon.0) 1500 : audit [INF] from='client.? 172.21.15.80:0/4247835412' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:48:00.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:47:59.253153+0000 mon.a (mon.0) 1501 : cluster [DBG] osdmap e367: 8 total, 8 up, 7 in 2024-02-19T21:48:00.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:00.225143+0000 mon.a (mon.0) 1502 : cluster [DBG] osdmap e368: 8 total, 8 up, 7 in 2024-02-19T21:48:00.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:59.126254+0000 mgr.y (mgr.14514) 589 : cluster [DBG] pgmap v752: 138 pgs: 3 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 132 active+clean; 1.5 GiB data, 7.8 GiB used, 618 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 571 op/s; 6033/72534 objects misplaced (8.317%); 1.4 MiB/s, 21 objects/s recovering 2024-02-19T21:48:00.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:59.240392+0000 mon.a (mon.0) 1499 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:48:00.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:47:59.253089+0000 mon.a (mon.0) 1500 : audit [INF] from='client.? 172.21.15.80:0/4247835412' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:48:00.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:47:59.253153+0000 mon.a (mon.0) 1501 : cluster [DBG] osdmap e367: 8 total, 8 up, 7 in 2024-02-19T21:48:00.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:00.225143+0000 mon.a (mon.0) 1502 : cluster [DBG] osdmap e368: 8 total, 8 up, 7 in 2024-02-19T21:48:00.573 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:48:00.607 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:48:00.612 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:00.612 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:48:00.713 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:48:00.725 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 4, 5, 6, 7, 2] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:48:00.725 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:48:00.725 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [0, 1, 2, 3, 4, 5, 6, 7] 2024-02-19T21:48:00.725 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-02-19T21:48:00.725 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.2 2024-02-19T21:48:00.763 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:00.817 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 21:48:00 smithi080 systemd[1]: Stopping Ceph osd.2 for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T21:48:00.817 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:48:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:48:00] "GET /metrics HTTP/1.1" 200 176201 "" "Prometheus/2.33.4" 2024-02-19T21:48:00.852 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:48:00.856 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:00.857 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:48:00.958 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:48:01.016 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:01.056 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:48:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:48:01.097 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 21:48:00 smithi080 bash[144621]: Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:48:01.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:00.343831+0000 osd.2 (osd.2) 127 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:48:01.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:00.343877+0000 osd.2 (osd.2) 128 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:48:01.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:00.786570+0000 mgr.y (mgr.14514) 590 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:48:01.573 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:00.343831+0000 osd.2 (osd.2) 127 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:48:01.573 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:00.343877+0000 osd.2 (osd.2) 128 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:48:01.573 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:00.786570+0000 mgr.y (mgr.14514) 590 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:48:01.574 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:00.343831+0000 osd.2 (osd.2) 127 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:48:01.574 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:00.343877+0000 osd.2 (osd.2) 128 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:48:01.574 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:00.786570+0000 mgr.y (mgr.14514) 590 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:48:01.575 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:48:01.581 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:01.582 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:48:01.682 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:48:01.730 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:02.125 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:48:02.129 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:02.129 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:48:02.230 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:48:02.290 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:02.370 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:48:02.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:01.128183+0000 mgr.y (mgr.14514) 591 : cluster [DBG] pgmap v755: 138 pgs: 3 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 132 active+clean; 1.2 GiB data, 7.0 GiB used, 619 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.24k op/s; 4700/58986 objects misplaced (7.968%); 3.0 MiB/s, 47 objects/s recovering 2024-02-19T21:48:02.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:01.275065+0000 mon.a (mon.0) 1503 : cluster [DBG] osdmap e369: 8 total, 8 up, 7 in 2024-02-19T21:48:02.377 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:02.377 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:01.128183+0000 mgr.y (mgr.14514) 591 : cluster [DBG] pgmap v755: 138 pgs: 3 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 132 active+clean; 1.2 GiB data, 7.0 GiB used, 619 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.24k op/s; 4700/58986 objects misplaced (7.968%); 3.0 MiB/s, 47 objects/s recovering 2024-02-19T21:48:02.377 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:01.275065+0000 mon.a (mon.0) 1503 : cluster [DBG] osdmap e369: 8 total, 8 up, 7 in 2024-02-19T21:48:02.378 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:48:02.479 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:48:02.520 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:02.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:01.128183+0000 mgr.y (mgr.14514) 591 : cluster [DBG] pgmap v755: 138 pgs: 3 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 132 active+clean; 1.2 GiB data, 7.0 GiB used, 619 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.24k op/s; 4700/58986 objects misplaced (7.968%); 3.0 MiB/s, 47 objects/s recovering 2024-02-19T21:48:02.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:01.275065+0000 mon.a (mon.0) 1503 : cluster [DBG] osdmap e369: 8 total, 8 up, 7 in 2024-02-19T21:48:02.571 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:48:02.576 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:02.577 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:48:02.595 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset noscrub 2024-02-19T21:48:02.635 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 21:48:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-2[57744]: debug 2024-02-19T21:48:02.628+0000 7f77512aa700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-19T21:48:02.636 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 21:48:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-2[57744]: debug 2024-02-19T21:48:02.628+0000 7f77512aa700 -1 osd.2 369 *** Got signal Terminated *** 2024-02-19T21:48:02.636 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 21:48:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-2[57744]: debug 2024-02-19T21:48:02.628+0000 7f77512aa700 -1 osd.2 369 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T21:48:02.677 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:48:02.726 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:02.866 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:48:02.871 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:02.871 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:48:02.932 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:48:02.959 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:48:02.972 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:48:02.980 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:48:03.009 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:48:03.043 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:03.053 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:48:03.070 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:48:03.077 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:03.078 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:48:03.078 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:48:03.111 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:48:03.158 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:48:03.178 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:48:03.179 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:48:03.180 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:48:03.180 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:48:03.180 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:48:03.180 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:48:03.180 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:48:03.180 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:48:03.180 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:48:03.272 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:03.298 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:02.630742+0000 mon.a (mon.0) 1504 : cluster [INF] osd.2 marked itself down and dead 2024-02-19T21:48:03.299 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:02.901158+0000 mon.b (mon.1) 61 : audit [DBG] from='client.? 172.21.15.80:0/541922787' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:48:03.306 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:48:03.311 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:03.311 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:48:03.412 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:48:03.441 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:02.630742+0000 mon.a (mon.0) 1504 : cluster [INF] osd.2 marked itself down and dead 2024-02-19T21:48:03.441 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:02.901158+0000 mon.b (mon.1) 61 : audit [DBG] from='client.? 172.21.15.80:0/541922787' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:48:03.442 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:02.630742+0000 mon.a (mon.0) 1504 : cluster [INF] osd.2 marked itself down and dead 2024-02-19T21:48:03.442 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:02.901158+0000 mon.b (mon.1) 61 : audit [DBG] from='client.? 172.21.15.80:0/541922787' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:48:03.445 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:04.113 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:48:04.114 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:48:04.296 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 21:48:04 smithi080 bash[144788]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-2 2024-02-19T21:48:04.296 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:03.128842+0000 mgr.y (mgr.14514) 592 : cluster [DBG] pgmap v757: 138 pgs: 3 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 132 active+clean; 1.2 GiB data, 7.0 GiB used, 619 GiB / 626 GiB avail; 852 B/s rd, 0 B/s wr, 753 op/s; 4700/58986 objects misplaced (7.968%); 1.8 MiB/s, 28 objects/s recovering 2024-02-19T21:48:04.396 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:48:04.402 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:04.402 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:48:04.503 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:48:04.551 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:03.128842+0000 mgr.y (mgr.14514) 592 : cluster [DBG] pgmap v757: 138 pgs: 3 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 132 active+clean; 1.2 GiB data, 7.0 GiB used, 619 GiB / 626 GiB avail; 852 B/s rd, 0 B/s wr, 753 op/s; 4700/58986 objects misplaced (7.968%); 1.8 MiB/s, 28 objects/s recovering 2024-02-19T21:48:04.551 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:03.276522+0000 mon.a (mon.0) 1505 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T21:48:04.551 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:03.298901+0000 mon.a (mon.0) 1506 : cluster [DBG] osdmap e370: 8 total, 7 up, 7 in 2024-02-19T21:48:04.551 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:03.960812+0000 mon.a (mon.0) 1507 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:48:04.562 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:04.595 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:48:04.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:03.128842+0000 mgr.y (mgr.14514) 592 : cluster [DBG] pgmap v757: 138 pgs: 3 active+remapped+backfilling, 3 active+remapped+backfill_toofull, 132 active+clean; 1.2 GiB data, 7.0 GiB used, 619 GiB / 626 GiB avail; 852 B/s rd, 0 B/s wr, 753 op/s; 4700/58986 objects misplaced (7.968%); 1.8 MiB/s, 28 objects/s recovering 2024-02-19T21:48:04.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:03.276522+0000 mon.a (mon.0) 1505 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T21:48:04.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:03.298901+0000 mon.a (mon.0) 1506 : cluster [DBG] osdmap e370: 8 total, 7 up, 7 in 2024-02-19T21:48:04.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:03.960812+0000 mon.a (mon.0) 1507 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:48:04.600 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:04.601 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:48:04.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:03.276522+0000 mon.a (mon.0) 1505 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T21:48:04.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:03.298901+0000 mon.a (mon.0) 1506 : cluster [DBG] osdmap e370: 8 total, 7 up, 7 in 2024-02-19T21:48:04.602 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:03.960812+0000 mon.a (mon.0) 1507 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:48:04.702 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:48:04.757 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:04.759 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.1 dump_blocked_ops 2024-02-19T21:48:04.996 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:48:05.008 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:05.008 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:48:05.109 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:48:05.178 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:05.210 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:48:05.216 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:05.217 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:48:05.318 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:48:05.329 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:04.306398+0000 mon.a (mon.0) 1508 : cluster [DBG] osdmap e371: 8 total, 7 up, 7 in 2024-02-19T21:48:05.329 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:05.229375+0000 mon.a (mon.0) 1509 : cluster [DBG] osdmap e372: 8 total, 7 up, 7 in 2024-02-19T21:48:05.368 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:05.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:04.306398+0000 mon.a (mon.0) 1508 : cluster [DBG] osdmap e371: 8 total, 7 up, 7 in 2024-02-19T21:48:05.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:05.229375+0000 mon.a (mon.0) 1509 : cluster [DBG] osdmap e372: 8 total, 7 up, 7 in 2024-02-19T21:48:05.572 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:48:05.576 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:05.576 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:48:05.596 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:48:05.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:04.306398+0000 mon.a (mon.0) 1508 : cluster [DBG] osdmap e371: 8 total, 7 up, 7 in 2024-02-19T21:48:05.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:05.229375+0000 mon.a (mon.0) 1509 : cluster [DBG] osdmap e372: 8 total, 7 up, 7 in 2024-02-19T21:48:05.677 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:48:05.716 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:05.879 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:48:05.884 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:05.885 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:48:05.985 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:48:06.031 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:48:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:48:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:48:06.033 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:06.066 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:48:06.069 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:06.069 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:48:06.170 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:48:06.220 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:06.255 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:48:06.262 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:06.263 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:48:06.364 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:48:06.409 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:06.447 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:48:06.450 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:06.450 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:48:06.529 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:48:06.551 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:48:06.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:04.306089+0000 osd.0 (osd.0) 241 : cluster [INF] 9.0 continuing backfill to osd.7 from (331'10057,369'14980] 9:0c0e9f56:::benchmark_data_smithi080_126364_object118909:head to 369'14980 2024-02-19T21:48:06.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:05.129412+0000 mgr.y (mgr.14514) 593 : cluster [DBG] pgmap v760: 138 pgs: 2 active+clean+remapped, 102 active+clean, 18 active+undersized, 2 active+remapped+backfill_toofull, 2 active+remapped+backfilling, 7 stale+active+clean, 5 active+undersized+degraded; 1.1 GiB data, 6.7 GiB used, 619 GiB / 626 GiB avail; 0 B/s wr, 508 op/s; 19/54858 objects degraded (0.035%); 5327/54858 objects misplaced (9.711%); 2.0 MiB/s, 29 objects/s recovering 2024-02-19T21:48:06.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:05.300407+0000 mon.a (mon.0) 1510 : cluster [WRN] Health check update: Low space hindering backfill (add storage if this doesn't resolve itself): 2 pgs backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:48:06.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:05.300433+0000 mon.a (mon.0) 1511 : cluster [WRN] Health check failed: Degraded data redundancy: 19/54858 objects degraded (0.035%), 5 pgs degraded (PG_DEGRADED) 2024-02-19T21:48:06.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:04.306089+0000 osd.0 (osd.0) 241 : cluster [INF] 9.0 continuing backfill to osd.7 from (331'10057,369'14980] 9:0c0e9f56:::benchmark_data_smithi080_126364_object118909:head to 369'14980 2024-02-19T21:48:06.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:05.129412+0000 mgr.y (mgr.14514) 593 : cluster [DBG] pgmap v760: 138 pgs: 2 active+clean+remapped, 102 active+clean, 18 active+undersized, 2 active+remapped+backfill_toofull, 2 active+remapped+backfilling, 7 stale+active+clean, 5 active+undersized+degraded; 1.1 GiB data, 6.7 GiB used, 619 GiB / 626 GiB avail; 0 B/s wr, 508 op/s; 19/54858 objects degraded (0.035%); 5327/54858 objects misplaced (9.711%); 2.0 MiB/s, 29 objects/s recovering 2024-02-19T21:48:06.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:05.300407+0000 mon.a (mon.0) 1510 : cluster [WRN] Health check update: Low space hindering backfill (add storage if this doesn't resolve itself): 2 pgs backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:48:06.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:05.300433+0000 mon.a (mon.0) 1511 : cluster [WRN] Health check failed: Degraded data redundancy: 19/54858 objects degraded (0.035%), 5 pgs degraded (PG_DEGRADED) 2024-02-19T21:48:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:06.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:04.306089+0000 osd.0 (osd.0) 241 : cluster [INF] 9.0 continuing backfill to osd.7 from (331'10057,369'14980] 9:0c0e9f56:::benchmark_data_smithi080_126364_object118909:head to 369'14980 2024-02-19T21:48:06.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:05.129412+0000 mgr.y (mgr.14514) 593 : cluster [DBG] pgmap v760: 138 pgs: 2 active+clean+remapped, 102 active+clean, 18 active+undersized, 2 active+remapped+backfill_toofull, 2 active+remapped+backfilling, 7 stale+active+clean, 5 active+undersized+degraded; 1.1 GiB data, 6.7 GiB used, 619 GiB / 626 GiB avail; 0 B/s wr, 508 op/s; 19/54858 objects degraded (0.035%); 5327/54858 objects misplaced (9.711%); 2.0 MiB/s, 29 objects/s recovering 2024-02-19T21:48:06.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:05.300407+0000 mon.a (mon.0) 1510 : cluster [WRN] Health check update: Low space hindering backfill (add storage if this doesn't resolve itself): 2 pgs backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:48:06.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:05.300433+0000 mon.a (mon.0) 1511 : cluster [WRN] Health check failed: Degraded data redundancy: 19/54858 objects degraded (0.035%), 5 pgs degraded (PG_DEGRADED) 2024-02-19T21:48:07.351 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:48:07.364 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:07.365 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:48:07.466 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:48:07.524 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:07.558 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:48:07.561 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:48:07.563 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:07.564 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:48:07.665 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:48:07.725 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:08.311 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:48:08.320 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:08.320 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:48:08.421 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:48:08.459 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:08.500 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:48:08.505 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:08.505 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:48:08.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:07.130045+0000 mgr.y (mgr.14514) 594 : cluster [DBG] pgmap v762: 138 pgs: 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 1 active+remapped+backfill_toofull, 17 active+undersized+degraded; 985 MiB data, 6.3 GiB used, 619 GiB / 626 GiB avail; 524 B/s rd, 0 B/s wr, 633 op/s; 1070/47871 objects degraded (2.235%); 5106/47871 objects misplaced (10.666%); 1.1 MiB/s, 16 objects/s recovering 2024-02-19T21:48:08.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:07.130045+0000 mgr.y (mgr.14514) 594 : cluster [DBG] pgmap v762: 138 pgs: 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 1 active+remapped+backfill_toofull, 17 active+undersized+degraded; 985 MiB data, 6.3 GiB used, 619 GiB / 626 GiB avail; 524 B/s rd, 0 B/s wr, 633 op/s; 1070/47871 objects degraded (2.235%); 5106/47871 objects misplaced (10.666%); 1.1 MiB/s, 16 objects/s recovering 2024-02-19T21:48:08.606 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:48:08.649 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:07.130045+0000 mgr.y (mgr.14514) 594 : cluster [DBG] pgmap v762: 138 pgs: 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 1 active+remapped+backfill_toofull, 17 active+undersized+degraded; 985 MiB data, 6.3 GiB used, 619 GiB / 626 GiB avail; 524 B/s rd, 0 B/s wr, 633 op/s; 1070/47871 objects degraded (2.235%); 5106/47871 objects misplaced (10.666%); 1.1 MiB/s, 16 objects/s recovering 2024-02-19T21:48:08.656 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:08.687 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:48:08.690 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:08.690 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:48:08.791 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:48:08.853 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:08.888 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:48:08.891 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:08.892 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:48:08.993 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:48:09.038 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:09.078 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:48:09.083 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:09.083 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:48:09.184 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:48:09.233 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:09.260 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:48:09.263 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:09.264 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:48:09.364 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:48:09.425 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:09.456 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:48:09.463 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:09.463 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:48:09.564 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:48:09.613 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:09.662 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:48:09.679 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:09.680 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:48:09.780 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:48:09.858 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:09.889 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:48:09.896 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:09.897 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:48:09.997 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:48:10.036 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:10.143 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.2.service' 2024-02-19T21:48:10.148 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:48:10.153 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:10.154 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:48:10.212 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:48:10.254 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:48:10.263 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T21:48:10.263 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-02-19T21:48:10.263 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.2 2024-02-19T21:48:10.263 INFO:tasks.thrashosds.thrasher:remote for osd 2 is ubuntu@smithi080.front.sepia.ceph.com 2024-02-19T21:48:10.263 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -n osd.2 --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph-objectstore-tool --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal --op list-pgs 2024-02-19T21:48:10.297 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:10.327 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:48:10.333 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:10.333 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:48:10.415 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-02-19T21:48:10.434 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:48:10.496 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:10.523 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:48:10.527 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:10.527 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:48:10.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:09.130530+0000 mgr.y (mgr.14514) 595 : cluster [DBG] pgmap v763: 138 pgs: 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 1 active+remapped+backfill_toofull, 17 active+undersized+degraded; 985 MiB data, 6.3 GiB used, 619 GiB / 626 GiB avail; 511 B/s rd, 0 B/s wr, 617 op/s; 1070/47871 objects degraded (2.235%); 5106/47871 objects misplaced (10.666%); 1.1 MiB/s, 15 objects/s recovering 2024-02-19T21:48:10.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:09.834068+0000 mon.b (mon.1) 62 : audit [INF] from='client.? 172.21.15.80:0/176603017' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:48:10.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:09.834668+0000 mon.a (mon.0) 1512 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:48:10.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:09.130530+0000 mgr.y (mgr.14514) 595 : cluster [DBG] pgmap v763: 138 pgs: 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 1 active+remapped+backfill_toofull, 17 active+undersized+degraded; 985 MiB data, 6.3 GiB used, 619 GiB / 626 GiB avail; 511 B/s rd, 0 B/s wr, 617 op/s; 1070/47871 objects degraded (2.235%); 5106/47871 objects misplaced (10.666%); 1.1 MiB/s, 15 objects/s recovering 2024-02-19T21:48:10.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:09.834068+0000 mon.b (mon.1) 62 : audit [INF] from='client.? 172.21.15.80:0/176603017' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:48:10.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:09.834668+0000 mon.a (mon.0) 1512 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:48:10.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:09.130530+0000 mgr.y (mgr.14514) 595 : cluster [DBG] pgmap v763: 138 pgs: 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 1 active+remapped+backfill_toofull, 17 active+undersized+degraded; 985 MiB data, 6.3 GiB used, 619 GiB / 626 GiB avail; 511 B/s rd, 0 B/s wr, 617 op/s; 1070/47871 objects degraded (2.235%); 5106/47871 objects misplaced (10.666%); 1.1 MiB/s, 15 objects/s recovering 2024-02-19T21:48:10.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:09.834068+0000 mon.b (mon.1) 62 : audit [INF] from='client.? 172.21.15.80:0/176603017' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:48:10.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:09.834668+0000 mon.a (mon.0) 1512 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:48:10.629 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:48:10.689 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:10.690 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/osd.2/config 2024-02-19T21:48:10.714 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:48:10.717 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:10.718 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:48:10.818 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:48:10.877 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:10.911 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:48:10.917 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:10.918 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:48:11.018 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:48:11.054 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:48:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:48:10] "GET /metrics HTTP/1.1" 200 176252 "" "Prometheus/2.33.4" 2024-02-19T21:48:11.058 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:48:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:48:11.075 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:11.261 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:48:11.261 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:48:11.486 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:48:11.490 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:11.490 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:48:11.591 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:48:11.647 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:10.345034+0000 mon.a (mon.0) 1513 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:48:11.648 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:10.370846+0000 mon.a (mon.0) 1514 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:48:11.648 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:10.370906+0000 mon.a (mon.0) 1515 : cluster [DBG] osdmap e373: 8 total, 7 up, 7 in 2024-02-19T21:48:11.648 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:10.573569+0000 osd.6 (osd.6) 212 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:48:11.648 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:10.578401+0000 osd.6 (osd.6) 213 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:48:11.648 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:10.733981+0000 osd.5 (osd.5) 245 : cluster [DBG] 9.f scrub starts 2024-02-19T21:48:11.648 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:10.799615+0000 mgr.y (mgr.14514) 596 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:48:11.648 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:11.022744+0000 osd.5 (osd.5) 246 : cluster [DBG] 9.f scrub ok 2024-02-19T21:48:11.648 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:11.684 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:48:11.690 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:11.690 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:48:11.791 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:48:11.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:10.345034+0000 mon.a (mon.0) 1513 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:48:11.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:10.370846+0000 mon.a (mon.0) 1514 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:48:11.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:10.370906+0000 mon.a (mon.0) 1515 : cluster [DBG] osdmap e373: 8 total, 7 up, 7 in 2024-02-19T21:48:11.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:10.573569+0000 osd.6 (osd.6) 212 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:48:11.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:10.578401+0000 osd.6 (osd.6) 213 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:48:11.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:10.733981+0000 osd.5 (osd.5) 245 : cluster [DBG] 9.f scrub starts 2024-02-19T21:48:11.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:10.799615+0000 mgr.y (mgr.14514) 596 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:48:11.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:11.022744+0000 osd.5 (osd.5) 246 : cluster [DBG] 9.f scrub ok 2024-02-19T21:48:11.832 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:10.345034+0000 mon.a (mon.0) 1513 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:48:11.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:10.370846+0000 mon.a (mon.0) 1514 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:48:11.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:10.370906+0000 mon.a (mon.0) 1515 : cluster [DBG] osdmap e373: 8 total, 7 up, 7 in 2024-02-19T21:48:11.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:10.573569+0000 osd.6 (osd.6) 212 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:48:11.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:10.578401+0000 osd.6 (osd.6) 213 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:48:11.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:10.733981+0000 osd.5 (osd.5) 245 : cluster [DBG] 9.f scrub starts 2024-02-19T21:48:11.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:10.799615+0000 mgr.y (mgr.14514) 596 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:48:11.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:11.022744+0000 osd.5 (osd.5) 246 : cluster [DBG] 9.f scrub ok 2024-02-19T21:48:11.835 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:11.894 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:48:11.899 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:11.899 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:48:12.000 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:48:12.041 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:12.180 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:48:12.183 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:12.184 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:48:12.285 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:48:12.326 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:12.477 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:11.130962+0000 mgr.y (mgr.14514) 597 : cluster [DBG] pgmap v765: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 17 active+undersized+degraded; 626 MiB data, 5.3 GiB used, 620 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.39k op/s; 708/30627 objects degraded (2.312%); 3248/30627 objects misplaced (10.605%); 1003 KiB/s, 13 objects/s recovering 2024-02-19T21:48:12.478 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:11.367481+0000 mon.a (mon.0) 1516 : cluster [WRN] Health check update: Degraded data redundancy: 708/30627 objects degraded (2.312%), 17 pgs degraded (PG_DEGRADED) 2024-02-19T21:48:12.478 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:11.439537+0000 osd.5 (osd.5) 247 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:48:12.478 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:11.439598+0000 osd.5 (osd.5) 248 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:48:12.478 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:11.551428+0000 osd.6 (osd.6) 214 : cluster [DBG] 2.1a scrub starts 2024-02-19T21:48:12.478 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:11.557727+0000 osd.6 (osd.6) 215 : cluster [DBG] 2.1a scrub ok 2024-02-19T21:48:12.478 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:11.130962+0000 mgr.y (mgr.14514) 597 : cluster [DBG] pgmap v765: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 17 active+undersized+degraded; 626 MiB data, 5.3 GiB used, 620 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.39k op/s; 708/30627 objects degraded (2.312%); 3248/30627 objects misplaced (10.605%); 1003 KiB/s, 13 objects/s recovering 2024-02-19T21:48:12.478 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:11.367481+0000 mon.a (mon.0) 1516 : cluster [WRN] Health check update: Degraded data redundancy: 708/30627 objects degraded (2.312%), 17 pgs degraded (PG_DEGRADED) 2024-02-19T21:48:12.478 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:11.439537+0000 osd.5 (osd.5) 247 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:48:12.478 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:11.439598+0000 osd.5 (osd.5) 248 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:48:12.478 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:11.551428+0000 osd.6 (osd.6) 214 : cluster [DBG] 2.1a scrub starts 2024-02-19T21:48:12.478 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:11.557727+0000 osd.6 (osd.6) 215 : cluster [DBG] 2.1a scrub ok 2024-02-19T21:48:12.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:11.130962+0000 mgr.y (mgr.14514) 597 : cluster [DBG] pgmap v765: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 17 active+undersized+degraded; 626 MiB data, 5.3 GiB used, 620 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.39k op/s; 708/30627 objects degraded (2.312%); 3248/30627 objects misplaced (10.605%); 1003 KiB/s, 13 objects/s recovering 2024-02-19T21:48:12.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:11.367481+0000 mon.a (mon.0) 1516 : cluster [WRN] Health check update: Degraded data redundancy: 708/30627 objects degraded (2.312%), 17 pgs degraded (PG_DEGRADED) 2024-02-19T21:48:12.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:11.439537+0000 osd.5 (osd.5) 247 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:48:12.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:11.439598+0000 osd.5 (osd.5) 248 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:48:12.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:11.551428+0000 osd.6 (osd.6) 214 : cluster [DBG] 2.1a scrub starts 2024-02-19T21:48:12.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:11.557727+0000 osd.6 (osd.6) 215 : cluster [DBG] 2.1a scrub ok 2024-02-19T21:48:13.588 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:48:13.590 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:11.871958+0000 osd.1 (osd.1) 221 : cluster [DBG] 2.6 scrub starts 2024-02-19T21:48:13.590 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:11.879680+0000 osd.1 (osd.1) 222 : cluster [DBG] 2.6 scrub ok 2024-02-19T21:48:13.591 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:12.380773+0000 mon.a (mon.0) 1517 : cluster [DBG] osdmap e374: 8 total, 7 up, 7 in 2024-02-19T21:48:13.591 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:12.552152+0000 osd.6 (osd.6) 216 : cluster [DBG] 6.c scrub starts 2024-02-19T21:48:13.591 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:12.568727+0000 osd.6 (osd.6) 217 : cluster [DBG] 6.c scrub ok 2024-02-19T21:48:13.591 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:12.618207+0000 osd.4 (osd.4) 181 : cluster [DBG] 4.c scrub starts 2024-02-19T21:48:13.591 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:12.628692+0000 osd.4 (osd.4) 182 : cluster [DBG] 4.c scrub ok 2024-02-19T21:48:13.591 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:11.871958+0000 osd.1 (osd.1) 221 : cluster [DBG] 2.6 scrub starts 2024-02-19T21:48:13.591 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:11.879680+0000 osd.1 (osd.1) 222 : cluster [DBG] 2.6 scrub ok 2024-02-19T21:48:13.591 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:12.380773+0000 mon.a (mon.0) 1517 : cluster [DBG] osdmap e374: 8 total, 7 up, 7 in 2024-02-19T21:48:13.591 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:12.552152+0000 osd.6 (osd.6) 216 : cluster [DBG] 6.c scrub starts 2024-02-19T21:48:13.591 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:12.568727+0000 osd.6 (osd.6) 217 : cluster [DBG] 6.c scrub ok 2024-02-19T21:48:13.591 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:12.618207+0000 osd.4 (osd.4) 181 : cluster [DBG] 4.c scrub starts 2024-02-19T21:48:13.591 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:12.628692+0000 osd.4 (osd.4) 182 : cluster [DBG] 4.c scrub ok 2024-02-19T21:48:13.594 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:13.594 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:48:13.695 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:48:13.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:11.871958+0000 osd.1 (osd.1) 221 : cluster [DBG] 2.6 scrub starts 2024-02-19T21:48:13.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:11.879680+0000 osd.1 (osd.1) 222 : cluster [DBG] 2.6 scrub ok 2024-02-19T21:48:13.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:12.380773+0000 mon.a (mon.0) 1517 : cluster [DBG] osdmap e374: 8 total, 7 up, 7 in 2024-02-19T21:48:13.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:12.552152+0000 osd.6 (osd.6) 216 : cluster [DBG] 6.c scrub starts 2024-02-19T21:48:13.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:12.568727+0000 osd.6 (osd.6) 217 : cluster [DBG] 6.c scrub ok 2024-02-19T21:48:13.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:12.618207+0000 osd.4 (osd.4) 181 : cluster [DBG] 4.c scrub starts 2024-02-19T21:48:13.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:12.628692+0000 osd.4 (osd.4) 182 : cluster [DBG] 4.c scrub ok 2024-02-19T21:48:13.748 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:13.792 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:48:13.798 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:13.798 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:48:13.899 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:48:13.920 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-19T21:48:13.945 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:13.982 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:48:13.986 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:13.987 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:48:14.046 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.1 dump_historic_ops 2024-02-19T21:48:14.088 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:48:14.126 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:14.153 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:48:14.157 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:14.157 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:48:14.258 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:48:14.301 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:14.347 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:48:14.351 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:14.351 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:48:14.452 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:48:14.495 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:14.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:13.131393+0000 mgr.y (mgr.14514) 598 : cluster [DBG] pgmap v767: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 17 active+undersized+degraded; 626 MiB data, 5.3 GiB used, 620 GiB / 626 GiB avail; 647 B/s rd, 0 B/s wr, 846 op/s; 708/30627 objects degraded (2.312%); 3248/30627 objects misplaced (10.605%); 559 KiB/s, 8 objects/s recovering 2024-02-19T21:48:14.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:13.150658+0000 osd.7 (osd.7) 223 : cluster [DBG] 6.1c scrub starts 2024-02-19T21:48:14.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:13.196102+0000 osd.7 (osd.7) 224 : cluster [DBG] 6.1c scrub ok 2024-02-19T21:48:14.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:13.734987+0000 osd.3 (osd.3) 222 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:48:14.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:13.735029+0000 osd.3 (osd.3) 223 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:48:14.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:13.131393+0000 mgr.y (mgr.14514) 598 : cluster [DBG] pgmap v767: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 17 active+undersized+degraded; 626 MiB data, 5.3 GiB used, 620 GiB / 626 GiB avail; 647 B/s rd, 0 B/s wr, 846 op/s; 708/30627 objects degraded (2.312%); 3248/30627 objects misplaced (10.605%); 559 KiB/s, 8 objects/s recovering 2024-02-19T21:48:14.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:13.150658+0000 osd.7 (osd.7) 223 : cluster [DBG] 6.1c scrub starts 2024-02-19T21:48:14.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:13.196102+0000 osd.7 (osd.7) 224 : cluster [DBG] 6.1c scrub ok 2024-02-19T21:48:14.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:13.734987+0000 osd.3 (osd.3) 222 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:48:14.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:13.735029+0000 osd.3 (osd.3) 223 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:48:14.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:13.131393+0000 mgr.y (mgr.14514) 598 : cluster [DBG] pgmap v767: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 17 active+undersized+degraded; 626 MiB data, 5.3 GiB used, 620 GiB / 626 GiB avail; 647 B/s rd, 0 B/s wr, 846 op/s; 708/30627 objects degraded (2.312%); 3248/30627 objects misplaced (10.605%); 559 KiB/s, 8 objects/s recovering 2024-02-19T21:48:14.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:13.150658+0000 osd.7 (osd.7) 223 : cluster [DBG] 6.1c scrub starts 2024-02-19T21:48:14.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:13.196102+0000 osd.7 (osd.7) 224 : cluster [DBG] 6.1c scrub ok 2024-02-19T21:48:14.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:13.734987+0000 osd.3 (osd.3) 222 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:48:14.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:13.735029+0000 osd.3 (osd.3) 223 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:48:15.268 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:48:15.294 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:48:15.325 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:48:15.355 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:48:15.388 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:48:15.424 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:48:15.458 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:48:15.459 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:48:15.459 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:48:15.459 INFO:teuthology.orchestra.run.smithi080.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-02-19T21:48:15.459 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:48:15.459 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:48:15.459 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:48:15.459 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:48:15.459 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:48:15.471 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:48:15.477 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:15.477 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:48:15.578 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:48:15.630 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:15.791 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:48:15.795 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:14.319704+0000 osd.0 (osd.0) 242 : cluster [DBG] 9.9 scrub starts 2024-02-19T21:48:15.795 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:14.427740+0000 mon.a (mon.0) 1518 : cluster [DBG] osdmap e375: 8 total, 7 up, 7 in 2024-02-19T21:48:15.795 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:14.464562+0000 osd.0 (osd.0) 243 : cluster [DBG] 9.9 scrub ok 2024-02-19T21:48:15.795 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:14.590916+0000 osd.6 (osd.6) 218 : cluster [DBG] 2.14 scrub starts 2024-02-19T21:48:15.795 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:14.600277+0000 osd.6 (osd.6) 219 : cluster [DBG] 2.14 scrub ok 2024-02-19T21:48:15.795 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:14.635399+0000 osd.6 (osd.6) 220 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:48:15.795 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:14.635456+0000 osd.6 (osd.6) 221 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:48:15.795 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:15.221896+0000 mon.a (mon.0) 1519 : cluster [WRN] Health check update: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:48:15.795 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:15.228705+0000 mon.a (mon.0) 1520 : cluster [DBG] osdmap e376: 8 total, 7 up, 7 in 2024-02-19T21:48:15.795 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:15.233539+0000 mon.a (mon.0) 1521 : audit [DBG] from='client.? 172.21.15.80:0/4059240540' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:48:15.796 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:14.319704+0000 osd.0 (osd.0) 242 : cluster [DBG] 9.9 scrub starts 2024-02-19T21:48:15.796 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:14.427740+0000 mon.a (mon.0) 1518 : cluster [DBG] osdmap e375: 8 total, 7 up, 7 in 2024-02-19T21:48:15.796 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:14.464562+0000 osd.0 (osd.0) 243 : cluster [DBG] 9.9 scrub ok 2024-02-19T21:48:15.796 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:14.590916+0000 osd.6 (osd.6) 218 : cluster [DBG] 2.14 scrub starts 2024-02-19T21:48:15.796 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:14.600277+0000 osd.6 (osd.6) 219 : cluster [DBG] 2.14 scrub ok 2024-02-19T21:48:15.796 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:14.635399+0000 osd.6 (osd.6) 220 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:48:15.796 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:14.635456+0000 osd.6 (osd.6) 221 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:48:15.796 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:15.221896+0000 mon.a (mon.0) 1519 : cluster [WRN] Health check update: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:48:15.796 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:15.228705+0000 mon.a (mon.0) 1520 : cluster [DBG] osdmap e376: 8 total, 7 up, 7 in 2024-02-19T21:48:15.796 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:15.233539+0000 mon.a (mon.0) 1521 : audit [DBG] from='client.? 172.21.15.80:0/4059240540' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:48:15.797 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:15.797 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:48:15.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:14.319704+0000 osd.0 (osd.0) 242 : cluster [DBG] 9.9 scrub starts 2024-02-19T21:48:15.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:14.427740+0000 mon.a (mon.0) 1518 : cluster [DBG] osdmap e375: 8 total, 7 up, 7 in 2024-02-19T21:48:15.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:14.464562+0000 osd.0 (osd.0) 243 : cluster [DBG] 9.9 scrub ok 2024-02-19T21:48:15.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:14.590916+0000 osd.6 (osd.6) 218 : cluster [DBG] 2.14 scrub starts 2024-02-19T21:48:15.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:14.600277+0000 osd.6 (osd.6) 219 : cluster [DBG] 2.14 scrub ok 2024-02-19T21:48:15.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:14.635399+0000 osd.6 (osd.6) 220 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:48:15.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:14.635456+0000 osd.6 (osd.6) 221 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:48:15.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:15.221896+0000 mon.a (mon.0) 1519 : cluster [WRN] Health check update: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:48:15.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:15.228705+0000 mon.a (mon.0) 1520 : cluster [DBG] osdmap e376: 8 total, 7 up, 7 in 2024-02-19T21:48:15.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:15.233539+0000 mon.a (mon.0) 1521 : audit [DBG] from='client.? 172.21.15.80:0/4059240540' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:48:15.810 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:48:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:48:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:48:15.898 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:48:15.946 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:15.972 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:48:15.975 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:15.975 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:48:16.067 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:48:16.076 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:48:16.113 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:16.144 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:48:16.149 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:16.150 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:48:16.250 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:48:16.314 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:16.351 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:48:16.360 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:16.361 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:48:16.462 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:48:16.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:14.870272+0000 osd.1 (osd.1) 223 : cluster [DBG] 4.7 scrub starts 2024-02-19T21:48:16.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:14.878851+0000 osd.1 (osd.1) 224 : cluster [DBG] 4.7 scrub ok 2024-02-19T21:48:16.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:15.132190+0000 mgr.y (mgr.14514) 599 : cluster [DBG] pgmap v769: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 17 active+undersized+degraded; 492 MiB data, 4.9 GiB used, 621 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 1.31k op/s; 708/24216 objects degraded (2.924%); 2409/24216 objects misplaced (9.948%) 2024-02-19T21:48:16.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:15.365132+0000 osd.0 (osd.0) 244 : cluster [DBG] 9.8 scrub starts 2024-02-19T21:48:16.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:15.506563+0000 osd.0 (osd.0) 245 : cluster [DBG] 9.8 scrub ok 2024-02-19T21:48:16.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:15.667544+0000 osd.5 (osd.5) 249 : cluster [DBG] 9.a scrub starts 2024-02-19T21:48:16.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:15.777403+0000 osd.5 (osd.5) 250 : cluster [DBG] 9.a scrub ok 2024-02-19T21:48:16.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:14.870272+0000 osd.1 (osd.1) 223 : cluster [DBG] 4.7 scrub starts 2024-02-19T21:48:16.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:14.878851+0000 osd.1 (osd.1) 224 : cluster [DBG] 4.7 scrub ok 2024-02-19T21:48:16.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:15.132190+0000 mgr.y (mgr.14514) 599 : cluster [DBG] pgmap v769: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 17 active+undersized+degraded; 492 MiB data, 4.9 GiB used, 621 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 1.31k op/s; 708/24216 objects degraded (2.924%); 2409/24216 objects misplaced (9.948%) 2024-02-19T21:48:16.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:15.365132+0000 osd.0 (osd.0) 244 : cluster [DBG] 9.8 scrub starts 2024-02-19T21:48:16.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:15.506563+0000 osd.0 (osd.0) 245 : cluster [DBG] 9.8 scrub ok 2024-02-19T21:48:16.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:15.667544+0000 osd.5 (osd.5) 249 : cluster [DBG] 9.a scrub starts 2024-02-19T21:48:16.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:15.777403+0000 osd.5 (osd.5) 250 : cluster [DBG] 9.a scrub ok 2024-02-19T21:48:16.513 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:16.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:14.870272+0000 osd.1 (osd.1) 223 : cluster [DBG] 4.7 scrub starts 2024-02-19T21:48:16.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:14.878851+0000 osd.1 (osd.1) 224 : cluster [DBG] 4.7 scrub ok 2024-02-19T21:48:16.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:15.132190+0000 mgr.y (mgr.14514) 599 : cluster [DBG] pgmap v769: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 17 active+undersized+degraded; 492 MiB data, 4.9 GiB used, 621 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 1.31k op/s; 708/24216 objects degraded (2.924%); 2409/24216 objects misplaced (9.948%) 2024-02-19T21:48:16.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:15.365132+0000 osd.0 (osd.0) 244 : cluster [DBG] 9.8 scrub starts 2024-02-19T21:48:16.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:15.506563+0000 osd.0 (osd.0) 245 : cluster [DBG] 9.8 scrub ok 2024-02-19T21:48:16.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:15.667544+0000 osd.5 (osd.5) 249 : cluster [DBG] 9.a scrub starts 2024-02-19T21:48:16.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:15.777403+0000 osd.5 (osd.5) 250 : cluster [DBG] 9.a scrub ok 2024-02-19T21:48:16.651 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:48:16.658 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:16.658 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:48:16.676 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-02-19T21:48:16.677 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-02-19T21:48:16.759 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:48:16.813 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:16.854 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:48:16.861 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:16.861 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:48:16.900 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:48:16.961 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:48:17.009 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:17.037 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:48:17.041 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:17.042 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:48:17.143 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:48:17.187 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:48:17.318 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:17.319 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:48:17.420 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:48:17.474 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:15.854034+0000 osd.1 (osd.1) 225 : cluster [DBG] 9.d scrub starts 2024-02-19T21:48:17.474 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:15.996677+0000 osd.1 (osd.1) 226 : cluster [DBG] 9.d scrub ok 2024-02-19T21:48:17.474 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:16.410493+0000 osd.0 (osd.0) 246 : cluster [DBG] 9.5 scrub starts 2024-02-19T21:48:17.474 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:16.466630+0000 osd.0 (osd.0) 247 : cluster [DBG] 9.5 scrub ok 2024-02-19T21:48:17.474 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:16.719951+0000 osd.5 (osd.5) 251 : cluster [DBG] 9.7 scrub starts 2024-02-19T21:48:17.474 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:16.827742+0000 osd.5 (osd.5) 252 : cluster [DBG] 9.7 scrub ok 2024-02-19T21:48:17.475 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:15.854034+0000 osd.1 (osd.1) 225 : cluster [DBG] 9.d scrub starts 2024-02-19T21:48:17.475 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:15.996677+0000 osd.1 (osd.1) 226 : cluster [DBG] 9.d scrub ok 2024-02-19T21:48:17.475 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:16.410493+0000 osd.0 (osd.0) 246 : cluster [DBG] 9.5 scrub starts 2024-02-19T21:48:17.475 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:16.466630+0000 osd.0 (osd.0) 247 : cluster [DBG] 9.5 scrub ok 2024-02-19T21:48:17.475 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:16.719951+0000 osd.5 (osd.5) 251 : cluster [DBG] 9.7 scrub starts 2024-02-19T21:48:17.475 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:16.827742+0000 osd.5 (osd.5) 252 : cluster [DBG] 9.7 scrub ok 2024-02-19T21:48:17.476 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:17.508 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:48:17.511 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:17.511 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:48:17.612 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:48:17.651 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:17.679 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:48:17.684 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:17.684 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:48:17.785 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:48:17.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:15.854034+0000 osd.1 (osd.1) 225 : cluster [DBG] 9.d scrub starts 2024-02-19T21:48:17.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:15.996677+0000 osd.1 (osd.1) 226 : cluster [DBG] 9.d scrub ok 2024-02-19T21:48:17.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:16.410493+0000 osd.0 (osd.0) 246 : cluster [DBG] 9.5 scrub starts 2024-02-19T21:48:17.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:16.466630+0000 osd.0 (osd.0) 247 : cluster [DBG] 9.5 scrub ok 2024-02-19T21:48:17.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:16.719951+0000 osd.5 (osd.5) 251 : cluster [DBG] 9.7 scrub starts 2024-02-19T21:48:17.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:16.827742+0000 osd.5 (osd.5) 252 : cluster [DBG] 9.7 scrub ok 2024-02-19T21:48:17.840 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:17.874 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:48:17.877 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:17.877 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:48:17.978 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:48:18.044 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:18.187 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:48:18.198 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:18.198 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:48:18.299 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:48:18.353 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:18.471 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:17.132804+0000 mgr.y (mgr.14514) 600 : cluster [DBG] pgmap v771: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 17 active+undersized+degraded; 271 MiB data, 4.6 GiB used, 621 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 947 op/s; 355/13587 objects degraded (2.613%); 1392/13587 objects misplaced (10.245%) 2024-02-19T21:48:18.471 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:17.453835+0000 mon.a (mon.0) 1522 : cluster [WRN] Health check update: Degraded data redundancy: 355/13587 objects degraded (2.613%), 17 pgs degraded (PG_DEGRADED) 2024-02-19T21:48:18.630 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:48:18.635 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:18.636 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:48:18.674 INFO:teuthology.orchestra.run.smithi080.stdout:9.2 2024-02-19T21:48:18.675 INFO:teuthology.orchestra.run.smithi080.stdout:9.1 2024-02-19T21:48:18.675 INFO:teuthology.orchestra.run.smithi080.stdout:9.0 2024-02-19T21:48:18.675 INFO:teuthology.orchestra.run.smithi080.stdout:6.e 2024-02-19T21:48:18.675 INFO:teuthology.orchestra.run.smithi080.stdout:6.9 2024-02-19T21:48:18.675 INFO:teuthology.orchestra.run.smithi080.stdout:9.f 2024-02-19T21:48:18.675 INFO:teuthology.orchestra.run.smithi080.stdout:6.8 2024-02-19T21:48:18.675 INFO:teuthology.orchestra.run.smithi080.stdout:9.6 2024-02-19T21:48:18.675 INFO:teuthology.orchestra.run.smithi080.stdout:6.3 2024-02-19T21:48:18.675 INFO:teuthology.orchestra.run.smithi080.stdout:6.f 2024-02-19T21:48:18.675 INFO:teuthology.orchestra.run.smithi080.stdout:6.2 2024-02-19T21:48:18.675 INFO:teuthology.orchestra.run.smithi080.stdout:6.1 2024-02-19T21:48:18.675 INFO:teuthology.orchestra.run.smithi080.stdout:6.17 2024-02-19T21:48:18.676 INFO:teuthology.orchestra.run.smithi080.stdout:6.13 2024-02-19T21:48:18.676 INFO:teuthology.orchestra.run.smithi080.stdout:2.d 2024-02-19T21:48:18.676 INFO:teuthology.orchestra.run.smithi080.stdout:2.17 2024-02-19T21:48:18.676 INFO:teuthology.orchestra.run.smithi080.stdout:2.c 2024-02-19T21:48:18.676 INFO:teuthology.orchestra.run.smithi080.stdout:3.0 2024-02-19T21:48:18.676 INFO:teuthology.orchestra.run.smithi080.stdout:2.7 2024-02-19T21:48:18.676 INFO:teuthology.orchestra.run.smithi080.stdout:2.3 2024-02-19T21:48:18.676 INFO:teuthology.orchestra.run.smithi080.stdout:2.16 2024-02-19T21:48:18.676 INFO:teuthology.orchestra.run.smithi080.stdout:2.10 2024-02-19T21:48:18.676 INFO:teuthology.orchestra.run.smithi080.stdout:2.9 2024-02-19T21:48:18.676 INFO:teuthology.orchestra.run.smithi080.stdout:4.12 2024-02-19T21:48:18.676 INFO:teuthology.orchestra.run.smithi080.stdout:2.e 2024-02-19T21:48:18.676 INFO:teuthology.orchestra.run.smithi080.stdout:2.1e 2024-02-19T21:48:18.676 INFO:teuthology.orchestra.run.smithi080.stdout:4.1a 2024-02-19T21:48:18.677 INFO:teuthology.orchestra.run.smithi080.stdout:2.19 2024-02-19T21:48:18.677 INFO:teuthology.orchestra.run.smithi080.stdout:9.7 2024-02-19T21:48:18.677 INFO:teuthology.orchestra.run.smithi080.stdout:4.1b 2024-02-19T21:48:18.677 INFO:teuthology.orchestra.run.smithi080.stdout:6.11 2024-02-19T21:48:18.677 INFO:teuthology.orchestra.run.smithi080.stdout:2.1 2024-02-19T21:48:18.677 INFO:teuthology.orchestra.run.smithi080.stdout:2.1c 2024-02-19T21:48:18.677 INFO:teuthology.orchestra.run.smithi080.stdout:4.1c 2024-02-19T21:48:18.677 INFO:teuthology.orchestra.run.smithi080.stdout:5.a 2024-02-19T21:48:18.677 INFO:teuthology.orchestra.run.smithi080.stdout:6.5 2024-02-19T21:48:18.677 INFO:teuthology.orchestra.run.smithi080.stdout:4.16 2024-02-19T21:48:18.677 INFO:teuthology.orchestra.run.smithi080.stdout:6.19 2024-02-19T21:48:18.677 INFO:teuthology.orchestra.run.smithi080.stdout:6.14 2024-02-19T21:48:18.677 INFO:teuthology.orchestra.run.smithi080.stdout:5.4 2024-02-19T21:48:18.677 INFO:teuthology.orchestra.run.smithi080.stdout:5.8 2024-02-19T21:48:18.678 INFO:teuthology.orchestra.run.smithi080.stdout:4.19 2024-02-19T21:48:18.678 INFO:teuthology.orchestra.run.smithi080.stdout:4.1 2024-02-19T21:48:18.678 INFO:teuthology.orchestra.run.smithi080.stdout:6.1c 2024-02-19T21:48:18.678 INFO:teuthology.orchestra.run.smithi080.stdout:4.4 2024-02-19T21:48:18.678 INFO:teuthology.orchestra.run.smithi080.stdout:4.14 2024-02-19T21:48:18.678 INFO:teuthology.orchestra.run.smithi080.stdout:4.17 2024-02-19T21:48:18.678 INFO:teuthology.orchestra.run.smithi080.stdout:5.d 2024-02-19T21:48:18.678 INFO:teuthology.orchestra.run.smithi080.stdout:4.6 2024-02-19T21:48:18.678 INFO:teuthology.orchestra.run.smithi080.stdout:4.d 2024-02-19T21:48:18.678 INFO:teuthology.orchestra.run.smithi080.stdout:5.6 2024-02-19T21:48:18.678 INFO:teuthology.orchestra.run.smithi080.stdout:6.12 2024-02-19T21:48:18.678 INFO:teuthology.orchestra.run.smithi080.stdout:5.b 2024-02-19T21:48:18.678 INFO:teuthology.orchestra.run.smithi080.stdout:5.14 2024-02-19T21:48:18.678 INFO:teuthology.orchestra.run.smithi080.stdout:6.0 2024-02-19T21:48:18.679 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:48:18.736 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:17.132804+0000 mgr.y (mgr.14514) 600 : cluster [DBG] pgmap v771: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 17 active+undersized+degraded; 271 MiB data, 4.6 GiB used, 621 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 947 op/s; 355/13587 objects degraded (2.613%); 1392/13587 objects misplaced (10.245%) 2024-02-19T21:48:18.736 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:17.453835+0000 mon.a (mon.0) 1522 : cluster [WRN] Health check update: Degraded data redundancy: 355/13587 objects degraded (2.613%), 17 pgs degraded (PG_DEGRADED) 2024-02-19T21:48:18.737 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:48:18.782 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:17.132804+0000 mgr.y (mgr.14514) 600 : cluster [DBG] pgmap v771: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 17 active+undersized+degraded; 271 MiB data, 4.6 GiB used, 621 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 947 op/s; 355/13587 objects degraded (2.613%); 1392/13587 objects misplaced (10.245%) 2024-02-19T21:48:18.782 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:17.453835+0000 mon.a (mon.0) 1522 : cluster [WRN] Health check update: Degraded data redundancy: 355/13587 objects degraded (2.613%), 17 pgs degraded (PG_DEGRADED) 2024-02-19T21:48:18.788 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:18.844 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:48:18.848 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:18.849 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:48:18.949 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:48:18.974 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Removed 128589 objects 2024-02-19T21:48:18.974 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Clean up completed and total clean up time :136.876 2024-02-19T21:48:18.989 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:20.038 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:48:20.041 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:20.042 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:48:20.060 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -n osd.2 --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph-objectstore-tool --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal --op export --pgid 2.16 --file /var/log/ceph/exp.2.16.2 2024-02-19T21:48:20.143 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:48:20.176 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:20.196 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:48:20.199 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:20.199 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:48:20.300 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:48:20.301 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:18.344808+0000 osd.0 (osd.0) 248 : cluster [DBG] 9.b scrub starts 2024-02-19T21:48:20.301 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:18.426961+0000 osd.0 (osd.0) 249 : cluster [DBG] 9.b scrub ok 2024-02-19T21:48:20.301 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:18.963433+0000 mon.a (mon.0) 1523 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:48:20.301 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:19.182867+0000 osd.7 (osd.7) 225 : cluster [DBG] 2.8 scrub starts 2024-02-19T21:48:20.301 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:19.186350+0000 osd.7 (osd.7) 226 : cluster [DBG] 2.8 scrub ok 2024-02-19T21:48:20.302 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:18.344808+0000 osd.0 (osd.0) 248 : cluster [DBG] 9.b scrub starts 2024-02-19T21:48:20.302 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:18.426961+0000 osd.0 (osd.0) 249 : cluster [DBG] 9.b scrub ok 2024-02-19T21:48:20.302 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:18.963433+0000 mon.a (mon.0) 1523 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:48:20.302 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:19.182867+0000 osd.7 (osd.7) 225 : cluster [DBG] 2.8 scrub starts 2024-02-19T21:48:20.302 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:19.186350+0000 osd.7 (osd.7) 226 : cluster [DBG] 2.8 scrub ok 2024-02-19T21:48:20.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:18.344808+0000 osd.0 (osd.0) 248 : cluster [DBG] 9.b scrub starts 2024-02-19T21:48:20.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:18.426961+0000 osd.0 (osd.0) 249 : cluster [DBG] 9.b scrub ok 2024-02-19T21:48:20.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:18.963433+0000 mon.a (mon.0) 1523 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:48:20.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:19.182867+0000 osd.7 (osd.7) 225 : cluster [DBG] 2.8 scrub starts 2024-02-19T21:48:20.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:19.186350+0000 osd.7 (osd.7) 226 : cluster [DBG] 2.8 scrub ok 2024-02-19T21:48:20.317 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/osd.2/config 2024-02-19T21:48:20.331 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:20.351 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:48:20.353 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:20.353 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:48:20.454 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:48:20.484 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:20.522 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:48:20.525 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:20.526 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:48:20.554 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:48:20.554 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-02-19T21:48:20.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-02-19T21:48:20.554 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-02-19T21:48:20.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.554 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24317.0:1051 4.4 4:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94140601343872 gen 1] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-02-19T21:48:20.554 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:30.229453+0000", 2024-02-19T21:48:20.554 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 590.32217828099999, 2024-02-19T21:48:20.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.05225591, 2024-02-19T21:48:20.555 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:48:20.555 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:48:20.555 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:48:20.555 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24317", 2024-02-19T21:48:20.555 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3365055276", 2024-02-19T21:48:20.555 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1051 2024-02-19T21:48:20.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.555 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:48:20.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:48:20.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229453+0000", 2024-02-19T21:48:20.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:48:20.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:48:20.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229453+0000", 2024-02-19T21:48:20.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:48:20.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:48:20.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229452+0000", 2024-02-19T21:48:20.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5520000000000005e-06 2024-02-19T21:48:20.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:48:20.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229460+0000", 2024-02-19T21:48:20.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2584e-05 2024-02-19T21:48:20.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:48:20.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229473+0000", 2024-02-19T21:48:20.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5860000000000001e-06 2024-02-19T21:48:20.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:48:20.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229479+0000", 2024-02-19T21:48:20.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0021296599999999998 2024-02-19T21:48:20.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.231609+0000", 2024-02-19T21:48:20.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3160000000000002e-06 2024-02-19T21:48:20.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-02-19T21:48:20.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.231615+0000", 2024-02-19T21:48:20.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023975736000000001 2024-02-19T21:48:20.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.255591+0000", 2024-02-19T21:48:20.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7320000000000001e-06 2024-02-19T21:48:20.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.255598+0000", 2024-02-19T21:48:20.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0010299810000001 2024-02-19T21:48:20.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.256628+0000", 2024-02-19T21:48:20.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037642300000000002 2024-02-19T21:48:20.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for degraded object", 2024-02-19T21:48:20.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.257004+0000", 2024-02-19T21:48:20.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0067187469999999997 2024-02-19T21:48:20.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.263723+0000", 2024-02-19T21:48:20.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1997999999999997e-05 2024-02-19T21:48:20.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:48:20.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.263795+0000", 2024-02-19T21:48:20.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017914368 2024-02-19T21:48:20.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:48:20.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.281709+0000", 2024-02-19T21:48:20.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.05225591 2024-02-19T21:48:20.562 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.562 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:48:20.562 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.562 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24317.0:1052 5.0 5:05bf5b68:::notify.1:head [watch reconnect cookie 94140601335808 gen 1] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-02-19T21:48:20.562 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:38:30.229486+0000", 2024-02-19T21:48:20.562 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 590.32214609899995, 2024-02-19T21:48:20.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.084493935, 2024-02-19T21:48:20.562 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:48:20.562 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:48:20.562 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:48:20.563 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24317", 2024-02-19T21:48:20.563 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3365055276", 2024-02-19T21:48:20.563 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1052 2024-02-19T21:48:20.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.563 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:48:20.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:48:20.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229486+0000", 2024-02-19T21:48:20.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:48:20.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:48:20.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229486+0000", 2024-02-19T21:48:20.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:48:20.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:48:20.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229485+0000", 2024-02-19T21:48:20.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.852e-06 2024-02-19T21:48:20.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:48:20.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229488+0000", 2024-02-19T21:48:20.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2619999999999998e-06 2024-02-19T21:48:20.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:48:20.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229493+0000", 2024-02-19T21:48:20.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5200000000000002e-06 2024-02-19T21:48:20.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:48:20.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229497+0000", 2024-02-19T21:48:20.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.189e-05 2024-02-19T21:48:20.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229549+0000", 2024-02-19T21:48:20.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9360000000000002e-06 2024-02-19T21:48:20.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-02-19T21:48:20.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.229556+0000", 2024-02-19T21:48:20.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.028262551 2024-02-19T21:48:20.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.257818+0000", 2024-02-19T21:48:20.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4749999999999999e-06 2024-02-19T21:48:20.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:30.257828+0000", 2024-02-19T21:48:20.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98989388899999997 2024-02-19T21:48:20.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.247721+0000", 2024-02-19T21:48:20.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032671799999999998 2024-02-19T21:48:20.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for degraded object", 2024-02-19T21:48:20.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.248048+0000", 2024-02-19T21:48:20.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015509772999999999 2024-02-19T21:48:20.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.263558+0000", 2024-02-19T21:48:20.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6105000000000003e-05 2024-02-19T21:48:20.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:48:20.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.263644+0000", 2024-02-19T21:48:20.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.050335412000000003 2024-02-19T21:48:20.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:48:20.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:38:31.313979+0000", 2024-02-19T21:48:20.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.084493935 2024-02-19T21:48:20.568 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.568 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:48:20.568 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.568 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:216529 9.4 9:25b2d936:::benchmark_data_smithi080_126364_object87937:head [delete] snapc 0=[] ondisk+write+known_if_redirected e354)", 2024-02-19T21:48:20.568 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:32.376570+0000", 2024-02-19T21:48:20.568 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 48.175061171999999, 2024-02-19T21:48:20.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1118081640000002, 2024-02-19T21:48:20.569 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:48:20.569 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:48:20.569 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:48:20.569 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:48:20.569 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:48:20.569 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216529 2024-02-19T21:48:20.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.569 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:48:20.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:48:20.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376570+0000", 2024-02-19T21:48:20.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:48:20.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:48:20.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376570+0000", 2024-02-19T21:48:20.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:48:20.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:48:20.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376569+0000", 2024-02-19T21:48:20.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4410000000000001e-06 2024-02-19T21:48:20.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:48:20.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376575+0000", 2024-02-19T21:48:20.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0769999999999997e-06 2024-02-19T21:48:20.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:48:20.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376584+0000", 2024-02-19T21:48:20.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.361e-06 2024-02-19T21:48:20.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:48:20.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376589+0000", 2024-02-19T21:48:20.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00062081599999999995 2024-02-19T21:48:20.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.377210+0000", 2024-02-19T21:48:20.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012205300000000001 2024-02-19T21:48:20.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:48:20.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.377332+0000", 2024-02-19T21:48:20.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000136787 2024-02-19T21:48:20.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,4", 2024-02-19T21:48:20.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.377469+0000", 2024-02-19T21:48:20.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011198336999999999 2024-02-19T21:48:20.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.388667+0000", 2024-02-19T21:48:20.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1060000000000006e-06 2024-02-19T21:48:20.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.388676+0000", 2024-02-19T21:48:20.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.99675825699999998 2024-02-19T21:48:20.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.385434+0000", 2024-02-19T21:48:20.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1522000000000001e-05 2024-02-19T21:48:20.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.385446+0000", 2024-02-19T21:48:20.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.102835834 2024-02-19T21:48:20.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.488282+0000", 2024-02-19T21:48:20.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6827e-05 2024-02-19T21:48:20.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:48:20.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.488379+0000", 2024-02-19T21:48:20.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1118081640000002 2024-02-19T21:48:20.574 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.574 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:48:20.574 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.575 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:216530 9.4 9:28f5fd9c:::benchmark_data_smithi080_126364_object87938:head [delete] snapc 0=[] ondisk+write+known_if_redirected e354)", 2024-02-19T21:48:20.575 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:32.376603+0000", 2024-02-19T21:48:20.575 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 48.175028779000002, 2024-02-19T21:48:20.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1241626120000001, 2024-02-19T21:48:20.575 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:48:20.575 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:48:20.575 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:48:20.575 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:48:20.575 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:48:20.575 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216530 2024-02-19T21:48:20.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.575 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:48:20.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:48:20.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376603+0000", 2024-02-19T21:48:20.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:48:20.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:48:20.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376603+0000", 2024-02-19T21:48:20.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:48:20.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:48:20.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376602+0000", 2024-02-19T21:48:20.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0580000000000002e-06 2024-02-19T21:48:20.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:48:20.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376605+0000", 2024-02-19T21:48:20.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8050000000000003e-06 2024-02-19T21:48:20.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:48:20.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376611+0000", 2024-02-19T21:48:20.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0430000000000001e-06 2024-02-19T21:48:20.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:48:20.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376615+0000", 2024-02-19T21:48:20.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036348930000000002 2024-02-19T21:48:20.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.380250+0000", 2024-02-19T21:48:20.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012296299999999999 2024-02-19T21:48:20.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:48:20.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.380373+0000", 2024-02-19T21:48:20.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000139472 2024-02-19T21:48:20.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,4", 2024-02-19T21:48:20.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.380513+0000", 2024-02-19T21:48:20.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0081962920000000009 2024-02-19T21:48:20.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.388709+0000", 2024-02-19T21:48:20.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2509999999999997e-06 2024-02-19T21:48:20.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.388716+0000", 2024-02-19T21:48:20.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.99676181399999997 2024-02-19T21:48:20.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.385478+0000", 2024-02-19T21:48:20.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3409999999999997e-06 2024-02-19T21:48:20.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.385485+0000", 2024-02-19T21:48:20.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1032571179999999 2024-02-19T21:48:20.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.488742+0000", 2024-02-19T21:48:20.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9407000000000006e-05 2024-02-19T21:48:20.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for missing object", 2024-02-19T21:48:20.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.488842+0000", 2024-02-19T21:48:20.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011861345000000001 2024-02-19T21:48:20.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.500703+0000", 2024-02-19T21:48:20.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2373999999999996e-05 2024-02-19T21:48:20.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:48:20.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.500765+0000", 2024-02-19T21:48:20.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1241626120000001 2024-02-19T21:48:20.581 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.581 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:48:20.581 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.581 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:216531 9.4 9:2722ae18:::benchmark_data_smithi080_126364_object87939:head [delete] snapc 0=[] ondisk+write+known_if_redirected e354)", 2024-02-19T21:48:20.582 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:32.376620+0000", 2024-02-19T21:48:20.582 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 48.175012000000002, 2024-02-19T21:48:20.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1245084009999999, 2024-02-19T21:48:20.582 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:48:20.582 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:48:20.582 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:48:20.582 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:48:20.582 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:48:20.582 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216531 2024-02-19T21:48:20.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.582 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:48:20.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:48:20.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376620+0000", 2024-02-19T21:48:20.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:48:20.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:48:20.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376620+0000", 2024-02-19T21:48:20.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:48:20.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:48:20.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376619+0000", 2024-02-19T21:48:20.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4880000000000001e-06 2024-02-19T21:48:20.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:48:20.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376622+0000", 2024-02-19T21:48:20.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5450000000000003e-06 2024-02-19T21:48:20.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:48:20.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376627+0000", 2024-02-19T21:48:20.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6480000000000001e-06 2024-02-19T21:48:20.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:48:20.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376631+0000", 2024-02-19T21:48:20.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012146235999999999 2024-02-19T21:48:20.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.388777+0000", 2024-02-19T21:48:20.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8529999999999992e-06 2024-02-19T21:48:20.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.388785+0000", 2024-02-19T21:48:20.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.99672369199999999 2024-02-19T21:48:20.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.385509+0000", 2024-02-19T21:48:20.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9809999999999997e-06 2024-02-19T21:48:20.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.385516+0000", 2024-02-19T21:48:20.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.103355021 2024-02-19T21:48:20.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.488871+0000", 2024-02-19T21:48:20.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8314999999999997e-05 2024-02-19T21:48:20.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:48:20.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.488959+0000", 2024-02-19T21:48:20.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050823700000000003 2024-02-19T21:48:20.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,3,4", 2024-02-19T21:48:20.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.489467+0000", 2024-02-19T21:48:20.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0079199600000000002 2024-02-19T21:48:20.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.497387+0000", 2024-02-19T21:48:20.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4715000000000001e-05 2024-02-19T21:48:20.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:48:20.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.497402+0000", 2024-02-19T21:48:20.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029186379999999999 2024-02-19T21:48:20.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.500321+0000", 2024-02-19T21:48:20.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060752099999999997 2024-02-19T21:48:20.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.500928+0000", 2024-02-19T21:48:20.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2785999999999999e-05 2024-02-19T21:48:20.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:48:20.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.500981+0000", 2024-02-19T21:48:20.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014715299999999999 2024-02-19T21:48:20.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:48:20.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.501128+0000", 2024-02-19T21:48:20.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1245084009999999 2024-02-19T21:48:20.589 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.589 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:48:20.589 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.589 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:216532 9.4 9:24541b90:::benchmark_data_smithi080_126364_object87940:head [delete] snapc 0=[] ondisk+write+known_if_redirected e354)", 2024-02-19T21:48:20.589 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:32.376979+0000", 2024-02-19T21:48:20.589 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 48.174652705, 2024-02-19T21:48:20.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1245823119999998, 2024-02-19T21:48:20.589 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:48:20.590 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:48:20.590 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:48:20.590 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:48:20.590 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:48:20.590 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216532 2024-02-19T21:48:20.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.590 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:48:20.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:48:20.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376979+0000", 2024-02-19T21:48:20.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:48:20.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:48:20.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376979+0000", 2024-02-19T21:48:20.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:48:20.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:48:20.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376978+0000", 2024-02-19T21:48:20.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.224e-06 2024-02-19T21:48:20.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:48:20.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376984+0000", 2024-02-19T21:48:20.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1841000000000001e-05 2024-02-19T21:48:20.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:48:20.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376996+0000", 2024-02-19T21:48:20.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5779999999999998e-06 2024-02-19T21:48:20.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:48:20.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.377002+0000", 2024-02-19T21:48:20.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011808366000000001 2024-02-19T21:48:20.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.388810+0000", 2024-02-19T21:48:20.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9026999999999999e-05 2024-02-19T21:48:20.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.388829+0000", 2024-02-19T21:48:20.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.99670936600000004 2024-02-19T21:48:20.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.385538+0000", 2024-02-19T21:48:20.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5630000000000003e-06 2024-02-19T21:48:20.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.385546+0000", 2024-02-19T21:48:20.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1088639279999999 2024-02-19T21:48:20.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.494410+0000", 2024-02-19T21:48:20.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000143475 2024-02-19T21:48:20.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:48:20.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.494553+0000", 2024-02-19T21:48:20.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018708099999999999 2024-02-19T21:48:20.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,3,4", 2024-02-19T21:48:20.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.494740+0000", 2024-02-19T21:48:20.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028465209999999999 2024-02-19T21:48:20.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.497587+0000", 2024-02-19T21:48:20.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.114e-05 2024-02-19T21:48:20.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:48:20.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.497598+0000", 2024-02-19T21:48:20.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032621999999999998 2024-02-19T21:48:20.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.500860+0000", 2024-02-19T21:48:20.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053707600000000005 2024-02-19T21:48:20.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.501397+0000", 2024-02-19T21:48:20.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1771999999999998e-05 2024-02-19T21:48:20.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:48:20.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.501449+0000", 2024-02-19T21:48:20.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112176 2024-02-19T21:48:20.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:48:20.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.501561+0000", 2024-02-19T21:48:20.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1245823119999998 2024-02-19T21:48:20.597 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.597 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:48:20.597 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.597 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:216533 9.4 9:28eba302:::benchmark_data_smithi080_126364_object87941:head [delete] snapc 0=[] ondisk+write+known_if_redirected e354)", 2024-02-19T21:48:20.597 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:32.377014+0000", 2024-02-19T21:48:20.597 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 48.174617681999997, 2024-02-19T21:48:20.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1247602990000001, 2024-02-19T21:48:20.597 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:48:20.597 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:48:20.597 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:48:20.598 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:48:20.598 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:48:20.598 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216533 2024-02-19T21:48:20.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.598 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:48:20.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:48:20.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.377014+0000", 2024-02-19T21:48:20.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:48:20.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:48:20.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.377014+0000", 2024-02-19T21:48:20.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:48:20.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:48:20.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.377013+0000", 2024-02-19T21:48:20.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9699999999999999e-06 2024-02-19T21:48:20.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:48:20.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.377016+0000", 2024-02-19T21:48:20.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4680000000000003e-06 2024-02-19T21:48:20.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:48:20.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.377021+0000", 2024-02-19T21:48:20.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.74e-06 2024-02-19T21:48:20.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:48:20.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.377024+0000", 2024-02-19T21:48:20.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012101628 2024-02-19T21:48:20.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.389125+0000", 2024-02-19T21:48:20.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1890000000000007e-06 2024-02-19T21:48:20.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.389133+0000", 2024-02-19T21:48:20.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.996446006 2024-02-19T21:48:20.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.385579+0000", 2024-02-19T21:48:20.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2999999999999998e-06 2024-02-19T21:48:20.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.385586+0000", 2024-02-19T21:48:20.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.112045682 2024-02-19T21:48:20.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.497631+0000", 2024-02-19T21:48:20.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010573099999999999 2024-02-19T21:48:20.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:48:20.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.497737+0000", 2024-02-19T21:48:20.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147577 2024-02-19T21:48:20.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,3,4", 2024-02-19T21:48:20.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.497885+0000", 2024-02-19T21:48:20.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029878159999999999 2024-02-19T21:48:20.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:48:20.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.500872+0000", 2024-02-19T21:48:20.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000324901 2024-02-19T21:48:20.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.501197+0000", 2024-02-19T21:48:20.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7369e-05 2024-02-19T21:48:20.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.501245+0000", 2024-02-19T21:48:20.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000377916 2024-02-19T21:48:20.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.501623+0000", 2024-02-19T21:48:20.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7428e-05 2024-02-19T21:48:20.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:48:20.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.501680+0000", 2024-02-19T21:48:20.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4160999999999995e-05 2024-02-19T21:48:20.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:48:20.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.501774+0000", 2024-02-19T21:48:20.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1247602990000001 2024-02-19T21:48:20.604 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.604 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:48:20.605 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.605 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:216544 9.4 9:2e84a0c0:::benchmark_data_smithi080_126364_object87952:head [delete] snapc 0=[] ondisk+write+known_if_redirected e355)", 2024-02-19T21:48:20.605 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:32.409289+0000", 2024-02-19T21:48:20.605 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 48.142342917000001, 2024-02-19T21:48:20.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1086239870000001, 2024-02-19T21:48:20.605 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:48:20.605 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:48:20.605 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:48:20.605 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:48:20.605 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:48:20.605 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216544 2024-02-19T21:48:20.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.605 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:48:20.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:48:20.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.409289+0000", 2024-02-19T21:48:20.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:48:20.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:48:20.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.409289+0000", 2024-02-19T21:48:20.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:48:20.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:48:20.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.409287+0000", 2024-02-19T21:48:20.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9800000000000001e-06 2024-02-19T21:48:20.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:48:20.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.409294+0000", 2024-02-19T21:48:20.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.079e-05 2024-02-19T21:48:20.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:48:20.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.409305+0000", 2024-02-19T21:48:20.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7599999999999997e-06 2024-02-19T21:48:20.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:48:20.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.409312+0000", 2024-02-19T21:48:20.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9539000000000002e-05 2024-02-19T21:48:20.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.409351+0000", 2024-02-19T21:48:20.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8030000000000003e-06 2024-02-19T21:48:20.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.409360+0000", 2024-02-19T21:48:20.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.97626832799999996 2024-02-19T21:48:20.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.385628+0000", 2024-02-19T21:48:20.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3319999999999998e-06 2024-02-19T21:48:20.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.385638+0000", 2024-02-19T21:48:20.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1162569330000001 2024-02-19T21:48:20.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.501895+0000", 2024-02-19T21:48:20.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010942000000000001 2024-02-19T21:48:20.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:48:20.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.502004+0000", 2024-02-19T21:48:20.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000122292 2024-02-19T21:48:20.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,3,4", 2024-02-19T21:48:20.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.502126+0000", 2024-02-19T21:48:20.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010202218000000001 2024-02-19T21:48:20.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:48:20.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.512329+0000", 2024-02-19T21:48:20.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053133190000000004 2024-02-19T21:48:20.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.517642+0000", 2024-02-19T21:48:20.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5588999999999999e-05 2024-02-19T21:48:20.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.517698+0000", 2024-02-19T21:48:20.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5012000000000003e-05 2024-02-19T21:48:20.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.517733+0000", 2024-02-19T21:48:20.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4095000000000003e-05 2024-02-19T21:48:20.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:48:20.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.517787+0000", 2024-02-19T21:48:20.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000126067 2024-02-19T21:48:20.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:48:20.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.517913+0000", 2024-02-19T21:48:20.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1086239870000001 2024-02-19T21:48:20.612 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.612 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:48:20.613 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.613 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:216551 9.4 9:200a70aa:::benchmark_data_smithi080_126364_object87959:head [delete] snapc 0=[] ondisk+write+known_if_redirected e355)", 2024-02-19T21:48:20.613 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:32.418387+0000", 2024-02-19T21:48:20.613 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 48.133244722000001, 2024-02-19T21:48:20.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1040447520000001, 2024-02-19T21:48:20.613 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:48:20.613 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:48:20.613 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:48:20.613 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:48:20.613 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:48:20.613 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216551 2024-02-19T21:48:20.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.613 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:48:20.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:48:20.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.418387+0000", 2024-02-19T21:48:20.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:48:20.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:48:20.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.418387+0000", 2024-02-19T21:48:20.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:48:20.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:48:20.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.418385+0000", 2024-02-19T21:48:20.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3219999999999998e-06 2024-02-19T21:48:20.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:48:20.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.418392+0000", 2024-02-19T21:48:20.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0550000000000001e-05 2024-02-19T21:48:20.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:48:20.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.418402+0000", 2024-02-19T21:48:20.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7039999999999997e-06 2024-02-19T21:48:20.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:48:20.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.418409+0000", 2024-02-19T21:48:20.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1557999999999996e-05 2024-02-19T21:48:20.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.418471+0000", 2024-02-19T21:48:20.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0101e-05 2024-02-19T21:48:20.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.418481+0000", 2024-02-19T21:48:20.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.96718870400000001 2024-02-19T21:48:20.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.385669+0000", 2024-02-19T21:48:20.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6860000000000006e-06 2024-02-19T21:48:20.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.385677+0000", 2024-02-19T21:48:20.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1191880869999999 2024-02-19T21:48:20.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.504865+0000", 2024-02-19T21:48:20.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3245999999999995e-05 2024-02-19T21:48:20.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:48:20.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.504948+0000", 2024-02-19T21:48:20.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4557999999999998e-05 2024-02-19T21:48:20.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,3,4", 2024-02-19T21:48:20.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.505043+0000", 2024-02-19T21:48:20.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0098739569999999992 2024-02-19T21:48:20.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:48:20.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.514917+0000", 2024-02-19T21:48:20.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030477479999999999 2024-02-19T21:48:20.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.517965+0000", 2024-02-19T21:48:20.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.773e-05 2024-02-19T21:48:20.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.518002+0000", 2024-02-19T21:48:20.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042432579999999998 2024-02-19T21:48:20.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.522246+0000", 2024-02-19T21:48:20.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7979999999999997e-05 2024-02-19T21:48:20.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:48:20.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.522304+0000", 2024-02-19T21:48:20.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012795499999999999 2024-02-19T21:48:20.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:48:20.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.522432+0000", 2024-02-19T21:48:20.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1040447520000001 2024-02-19T21:48:20.620 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.620 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:48:20.620 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.620 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:216569 9.4 9:292c1153:::benchmark_data_smithi080_126364_object87977:head [delete] snapc 0=[] ondisk+write+known_if_redirected e355)", 2024-02-19T21:48:20.620 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:32.443747+0000", 2024-02-19T21:48:20.620 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 48.107884417000001, 2024-02-19T21:48:20.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.078890017, 2024-02-19T21:48:20.621 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:48:20.621 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:48:20.621 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:48:20.621 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:48:20.621 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:48:20.621 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216569 2024-02-19T21:48:20.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.621 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:48:20.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:48:20.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.443747+0000", 2024-02-19T21:48:20.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:48:20.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:48:20.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.443747+0000", 2024-02-19T21:48:20.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:48:20.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:48:20.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.443746+0000", 2024-02-19T21:48:20.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9399999999999996e-06 2024-02-19T21:48:20.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:48:20.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.443753+0000", 2024-02-19T21:48:20.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0711e-05 2024-02-19T21:48:20.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:48:20.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.443763+0000", 2024-02-19T21:48:20.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2040000000000002e-06 2024-02-19T21:48:20.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:48:20.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.443770+0000", 2024-02-19T21:48:20.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6851000000000002e-05 2024-02-19T21:48:20.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.443826+0000", 2024-02-19T21:48:20.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0393e-05 2024-02-19T21:48:20.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.443837+0000", 2024-02-19T21:48:20.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.94288491699999999 2024-02-19T21:48:20.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.386722+0000", 2024-02-19T21:48:20.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1679999999999993e-06 2024-02-19T21:48:20.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.386731+0000", 2024-02-19T21:48:20.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.120589367 2024-02-19T21:48:20.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.507320+0000", 2024-02-19T21:48:20.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000127575 2024-02-19T21:48:20.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:48:20.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.507448+0000", 2024-02-19T21:48:20.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000150586 2024-02-19T21:48:20.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,3,4", 2024-02-19T21:48:20.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.507598+0000", 2024-02-19T21:48:20.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073286310000000004 2024-02-19T21:48:20.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:48:20.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.514927+0000", 2024-02-19T21:48:20.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031059529999999998 2024-02-19T21:48:20.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.518033+0000", 2024-02-19T21:48:20.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0213e-05 2024-02-19T21:48:20.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.518063+0000", 2024-02-19T21:48:20.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044069560000000001 2024-02-19T21:48:20.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.522470+0000", 2024-02-19T21:48:20.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5942000000000002e-05 2024-02-19T21:48:20.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:48:20.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.522516+0000", 2024-02-19T21:48:20.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121105 2024-02-19T21:48:20.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:48:20.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.522637+0000", 2024-02-19T21:48:20.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.078890017 2024-02-19T21:48:20.628 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.628 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:48:20.628 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.628 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:216593 9.4 9:2af0bab1:::benchmark_data_smithi080_126364_object88001:head [delete] snapc 0=[] ondisk+write+known_if_redirected e355)", 2024-02-19T21:48:20.628 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:32.501255+0000", 2024-02-19T21:48:20.628 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 48.050376602, 2024-02-19T21:48:20.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0215764570000001, 2024-02-19T21:48:20.628 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:48:20.629 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:48:20.629 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:48:20.629 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:48:20.629 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:48:20.629 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216593 2024-02-19T21:48:20.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.629 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:48:20.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:48:20.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.501255+0000", 2024-02-19T21:48:20.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:48:20.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:48:20.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.501255+0000", 2024-02-19T21:48:20.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:48:20.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:48:20.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.501254+0000", 2024-02-19T21:48:20.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8849999999999999e-06 2024-02-19T21:48:20.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:48:20.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.501261+0000", 2024-02-19T21:48:20.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3342e-05 2024-02-19T21:48:20.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:48:20.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.501275+0000", 2024-02-19T21:48:20.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5130000000000002e-06 2024-02-19T21:48:20.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:48:20.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.501281+0000", 2024-02-19T21:48:20.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8888999999999998e-05 2024-02-19T21:48:20.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.501340+0000", 2024-02-19T21:48:20.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2503999999999999e-05 2024-02-19T21:48:20.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.501353+0000", 2024-02-19T21:48:20.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.88541654299999994 2024-02-19T21:48:20.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.386769+0000", 2024-02-19T21:48:20.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.174e-06 2024-02-19T21:48:20.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.386777+0000", 2024-02-19T21:48:20.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1232325700000001 2024-02-19T21:48:20.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.510010+0000", 2024-02-19T21:48:20.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010353600000000001 2024-02-19T21:48:20.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:48:20.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.510113+0000", 2024-02-19T21:48:20.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4610000000000004e-05 2024-02-19T21:48:20.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,3,4", 2024-02-19T21:48:20.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.510208+0000", 2024-02-19T21:48:20.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047280830000000001 2024-02-19T21:48:20.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:48:20.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.514936+0000", 2024-02-19T21:48:20.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031638769999999998 2024-02-19T21:48:20.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.518100+0000", 2024-02-19T21:48:20.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012784890000000001 2024-02-19T21:48:20.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.519379+0000", 2024-02-19T21:48:20.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032947200000000001 2024-02-19T21:48:20.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.522673+0000", 2024-02-19T21:48:20.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2883000000000003e-05 2024-02-19T21:48:20.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:48:20.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.522716+0000", 2024-02-19T21:48:20.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115326 2024-02-19T21:48:20.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:48:20.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.522831+0000", 2024-02-19T21:48:20.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0215764570000001 2024-02-19T21:48:20.635 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.636 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:48:20.636 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.636 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:216606 9.4 9:247c1ef3:::benchmark_data_smithi080_126364_object88014:head [delete] snapc 0=[] ondisk+write+known_if_redirected e355)", 2024-02-19T21:48:20.636 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:32.555394+0000", 2024-02-19T21:48:20.636 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 47.996237460000003, 2024-02-19T21:48:20.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9752198839999999, 2024-02-19T21:48:20.636 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:48:20.636 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:48:20.636 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:48:20.636 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:48:20.636 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:48:20.636 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216606 2024-02-19T21:48:20.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.637 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:48:20.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:48:20.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.555394+0000", 2024-02-19T21:48:20.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:48:20.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:48:20.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.555394+0000", 2024-02-19T21:48:20.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:48:20.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:48:20.638 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.555393+0000", 2024-02-19T21:48:20.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8830000000000006e-06 2024-02-19T21:48:20.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.638 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:48:20.638 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.555400+0000", 2024-02-19T21:48:20.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2904e-05 2024-02-19T21:48:20.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.638 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:48:20.638 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.555413+0000", 2024-02-19T21:48:20.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.576e-06 2024-02-19T21:48:20.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.638 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:48:20.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.555421+0000", 2024-02-19T21:48:20.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2614999999999998e-05 2024-02-19T21:48:20.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.555464+0000", 2024-02-19T21:48:20.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2900000000000002e-06 2024-02-19T21:48:20.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.555472+0000", 2024-02-19T21:48:20.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.83144490999999998 2024-02-19T21:48:20.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.386917+0000", 2024-02-19T21:48:20.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.909e-06 2024-02-19T21:48:20.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.386925+0000", 2024-02-19T21:48:20.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.125429821 2024-02-19T21:48:20.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.512354+0000", 2024-02-19T21:48:20.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7803e-05 2024-02-19T21:48:20.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:48:20.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.512432+0000", 2024-02-19T21:48:20.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012552900000000001 2024-02-19T21:48:20.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,3,4", 2024-02-19T21:48:20.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.512558+0000", 2024-02-19T21:48:20.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.006776738 2024-02-19T21:48:20.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.519335+0000", 2024-02-19T21:48:20.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031526500000000001 2024-02-19T21:48:20.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.519650+0000", 2024-02-19T21:48:20.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010732574 2024-02-19T21:48:20.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.530382+0000", 2024-02-19T21:48:20.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8949999999999997e-05 2024-02-19T21:48:20.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:48:20.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.530431+0000", 2024-02-19T21:48:20.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3427000000000002e-05 2024-02-19T21:48:20.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:48:20.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.530485+0000", 2024-02-19T21:48:20.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012929799999999999 2024-02-19T21:48:20.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:48:20.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.530614+0000", 2024-02-19T21:48:20.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9752198839999999 2024-02-19T21:48:20.643 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.643 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:48:20.643 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.643 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:226005 9.4 9:2c4fc160:::benchmark_data_smithi080_126364_object97413:head [delete] snapc 0=[] ondisk+write+known_if_redirected e363)", 2024-02-19T21:48:20.643 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:46.316375+0000", 2024-02-19T21:48:20.644 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.235256759000002, 2024-02-19T21:48:20.644 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.95729776, 2024-02-19T21:48:20.644 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:48:20.644 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:48:20.644 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:48:20.644 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:48:20.644 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:48:20.644 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 226005 2024-02-19T21:48:20.644 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.644 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:48:20.644 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.644 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:48:20.644 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.316375+0000", 2024-02-19T21:48:20.644 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:48:20.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:48:20.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.316375+0000", 2024-02-19T21:48:20.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:48:20.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:48:20.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.316373+0000", 2024-02-19T21:48:20.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2240000000000001e-06 2024-02-19T21:48:20.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:48:20.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.316382+0000", 2024-02-19T21:48:20.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5271999999999999e-05 2024-02-19T21:48:20.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.646 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:48:20.646 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.316398+0000", 2024-02-19T21:48:20.646 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9090000000000003e-06 2024-02-19T21:48:20.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.646 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:48:20.646 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.316405+0000", 2024-02-19T21:48:20.646 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4798e-05 2024-02-19T21:48:20.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.646 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.646 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.316449+0000", 2024-02-19T21:48:20.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9519999999999994e-06 2024-02-19T21:48:20.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.316457+0000", 2024-02-19T21:48:20.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.95032962799999998 2024-02-19T21:48:20.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.266787+0000", 2024-02-19T21:48:20.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104298 2024-02-19T21:48:20.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:48:20.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.266891+0000", 2024-02-19T21:48:20.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4517000000000003e-05 2024-02-19T21:48:20.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:48:20.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.266986+0000", 2024-02-19T21:48:20.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022953370000000002 2024-02-19T21:48:20.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.269281+0000", 2024-02-19T21:48:20.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001367023 2024-02-19T21:48:20.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:48:20.649 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.270648+0000", 2024-02-19T21:48:20.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029505999999999998 2024-02-19T21:48:20.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.649 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.273599+0000", 2024-02-19T21:48:20.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1844000000000002e-05 2024-02-19T21:48:20.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:48:20.649 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.273631+0000", 2024-02-19T21:48:20.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2073000000000002e-05 2024-02-19T21:48:20.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.650 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:48:20.650 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.273673+0000", 2024-02-19T21:48:20.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.95729776 2024-02-19T21:48:20.650 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.650 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:48:20.650 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.650 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:226031 9.4 9:206880c1:::benchmark_data_smithi080_126364_object97439:head [delete] snapc 0=[] ondisk+write+known_if_redirected e363)", 2024-02-19T21:48:20.650 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:46.370750+0000", 2024-02-19T21:48:20.650 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.180881407999998, 2024-02-19T21:48:20.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.90307898399999997, 2024-02-19T21:48:20.650 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:48:20.650 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:48:20.650 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:48:20.651 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:48:20.651 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:48:20.651 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 226031 2024-02-19T21:48:20.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.651 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:48:20.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:48:20.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.370750+0000", 2024-02-19T21:48:20.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:48:20.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:48:20.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.370750+0000", 2024-02-19T21:48:20.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:48:20.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:48:20.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.370748+0000", 2024-02-19T21:48:20.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7689999999999996e-06 2024-02-19T21:48:20.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:48:20.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.370756+0000", 2024-02-19T21:48:20.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2668e-05 2024-02-19T21:48:20.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:48:20.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.370769+0000", 2024-02-19T21:48:20.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9449999999999998e-06 2024-02-19T21:48:20.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:48:20.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.370775+0000", 2024-02-19T21:48:20.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1214999999999998e-05 2024-02-19T21:48:20.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.370816+0000", 2024-02-19T21:48:20.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4910000000000002e-06 2024-02-19T21:48:20.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.370822+0000", 2024-02-19T21:48:20.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.89849280600000003 2024-02-19T21:48:20.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.654 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.654 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.654 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.269315+0000", 2024-02-19T21:48:20.654 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5833000000000005e-05 2024-02-19T21:48:20.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.654 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.654 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:48:20.654 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.269381+0000", 2024-02-19T21:48:20.654 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3440000000000001e-05 2024-02-19T21:48:20.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.654 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.654 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:48:20.654 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.269464+0000", 2024-02-19T21:48:20.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039180370000000001 2024-02-19T21:48:20.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.655 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.655 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.655 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.273383+0000", 2024-02-19T21:48:20.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030051600000000002 2024-02-19T21:48:20.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.655 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.655 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:48:20.655 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.273683+0000", 2024-02-19T21:48:20.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7463000000000001e-05 2024-02-19T21:48:20.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.655 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.655 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.655 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.273750+0000", 2024-02-19T21:48:20.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2928e-05 2024-02-19T21:48:20.656 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.656 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:48:20.656 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.273793+0000", 2024-02-19T21:48:20.656 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5763000000000003e-05 2024-02-19T21:48:20.656 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.656 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:48:20.656 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.273829+0000", 2024-02-19T21:48:20.656 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.90307898399999997 2024-02-19T21:48:20.656 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.656 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:48:20.656 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.656 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.657 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:226065 9.4 9:2e9761dc:::benchmark_data_smithi080_126364_object97473:head [delete] snapc 0=[] ondisk+write+known_if_redirected e363)", 2024-02-19T21:48:20.657 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:46.410512+0000", 2024-02-19T21:48:20.657 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.141119207999999, 2024-02-19T21:48:20.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.86630932800000005, 2024-02-19T21:48:20.657 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:48:20.657 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:48:20.657 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:48:20.657 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:48:20.657 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:48:20.657 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 226065 2024-02-19T21:48:20.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.657 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:48:20.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.657 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:48:20.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.410512+0000", 2024-02-19T21:48:20.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:48:20.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:48:20.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.410512+0000", 2024-02-19T21:48:20.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:48:20.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:48:20.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.410512+0000", 2024-02-19T21:48:20.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7179999999999998e-06 2024-02-19T21:48:20.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:48:20.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.410515+0000", 2024-02-19T21:48:20.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3140000000000004e-06 2024-02-19T21:48:20.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:48:20.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.410524+0000", 2024-02-19T21:48:20.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7809999999999996e-06 2024-02-19T21:48:20.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:48:20.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.410529+0000", 2024-02-19T21:48:20.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7425e-05 2024-02-19T21:48:20.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.410586+0000", 2024-02-19T21:48:20.660 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8990000000000001e-06 2024-02-19T21:48:20.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.660 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.660 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.660 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.410594+0000", 2024-02-19T21:48:20.660 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.86009007800000004 2024-02-19T21:48:20.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.660 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.660 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.660 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.270684+0000", 2024-02-19T21:48:20.660 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0001019 2024-02-19T21:48:20.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.660 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.660 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:48:20.661 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.270786+0000", 2024-02-19T21:48:20.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2132000000000006e-05 2024-02-19T21:48:20.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.661 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:48:20.661 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.270868+0000", 2024-02-19T21:48:20.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002818769 2024-02-19T21:48:20.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.661 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:48:20.661 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.273687+0000", 2024-02-19T21:48:20.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4419999999999999e-05 2024-02-19T21:48:20.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.662 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.662 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.273721+0000", 2024-02-19T21:48:20.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030467530000000001 2024-02-19T21:48:20.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.662 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.662 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.276768+0000", 2024-02-19T21:48:20.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0159999999999999e-05 2024-02-19T21:48:20.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.662 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:48:20.662 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.276798+0000", 2024-02-19T21:48:20.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3628000000000001e-05 2024-02-19T21:48:20.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:48:20.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.276822+0000", 2024-02-19T21:48:20.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.86630932800000005 2024-02-19T21:48:20.663 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.663 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:48:20.663 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.663 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:226077 9.4 9:2685a4dd:::benchmark_data_smithi080_126364_object97485:head [delete] snapc 0=[] ondisk+write+known_if_redirected e363)", 2024-02-19T21:48:20.663 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:46.421546+0000", 2024-02-19T21:48:20.663 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.130085186000002, 2024-02-19T21:48:20.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.85538825299999999, 2024-02-19T21:48:20.663 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:48:20.663 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:48:20.664 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:48:20.664 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:48:20.664 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:48:20.664 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 226077 2024-02-19T21:48:20.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.664 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:48:20.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:48:20.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.421546+0000", 2024-02-19T21:48:20.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:48:20.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:48:20.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.421546+0000", 2024-02-19T21:48:20.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:48:20.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.665 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:48:20.665 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.421545+0000", 2024-02-19T21:48:20.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0840000000000003e-06 2024-02-19T21:48:20.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.665 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:48:20.665 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.421552+0000", 2024-02-19T21:48:20.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.327e-05 2024-02-19T21:48:20.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.665 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:48:20.666 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.421566+0000", 2024-02-19T21:48:20.666 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8329999999999996e-06 2024-02-19T21:48:20.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.666 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.666 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:48:20.666 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.421572+0000", 2024-02-19T21:48:20.666 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2280000000000002e-05 2024-02-19T21:48:20.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.666 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.666 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.666 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.421615+0000", 2024-02-19T21:48:20.666 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3279999999999996e-06 2024-02-19T21:48:20.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.666 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.421620+0000", 2024-02-19T21:48:20.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.850279165 2024-02-19T21:48:20.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.271899+0000", 2024-02-19T21:48:20.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2007000000000002e-05 2024-02-19T21:48:20.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:48:20.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.271991+0000", 2024-02-19T21:48:20.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9845000000000005e-05 2024-02-19T21:48:20.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:48:20.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.272081+0000", 2024-02-19T21:48:20.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0017580149999999999 2024-02-19T21:48:20.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:48:20.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.273839+0000", 2024-02-19T21:48:20.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6344000000000002e-05 2024-02-19T21:48:20.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.273885+0000", 2024-02-19T21:48:20.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002978681 2024-02-19T21:48:20.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.276864+0000", 2024-02-19T21:48:20.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5762000000000001e-05 2024-02-19T21:48:20.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:48:20.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.276900+0000", 2024-02-19T21:48:20.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4836000000000003e-05 2024-02-19T21:48:20.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:48:20.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.276935+0000", 2024-02-19T21:48:20.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.85538825299999999 2024-02-19T21:48:20.670 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.670 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:48:20.670 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.670 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:226091 9.4 9:27b12d5c:::benchmark_data_smithi080_126364_object97499:head [delete] snapc 0=[] ondisk+write+known_if_redirected e363)", 2024-02-19T21:48:20.670 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:46.435564+0000", 2024-02-19T21:48:20.670 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.116067356999999, 2024-02-19T21:48:20.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.84576922700000001, 2024-02-19T21:48:20.670 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:48:20.670 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:48:20.670 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:48:20.670 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:48:20.671 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:48:20.671 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 226091 2024-02-19T21:48:20.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.671 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:48:20.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.671 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:48:20.671 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.435564+0000", 2024-02-19T21:48:20.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:48:20.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.671 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:48:20.671 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.435564+0000", 2024-02-19T21:48:20.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:48:20.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:48:20.672 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.435563+0000", 2024-02-19T21:48:20.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7490000000000001e-06 2024-02-19T21:48:20.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:48:20.672 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.435570+0000", 2024-02-19T21:48:20.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0606e-05 2024-02-19T21:48:20.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:48:20.672 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.435580+0000", 2024-02-19T21:48:20.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0040000000000002e-06 2024-02-19T21:48:20.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:48:20.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.435587+0000", 2024-02-19T21:48:20.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027718590000000002 2024-02-19T21:48:20.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.438359+0000", 2024-02-19T21:48:20.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1400000000000002e-06 2024-02-19T21:48:20.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.438366+0000", 2024-02-19T21:48:20.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.83555307000000001 2024-02-19T21:48:20.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.273919+0000", 2024-02-19T21:48:20.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1989000000000006e-05 2024-02-19T21:48:20.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:48:20.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.273981+0000", 2024-02-19T21:48:20.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8942000000000005e-05 2024-02-19T21:48:20.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:48:20.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.274050+0000", 2024-02-19T21:48:20.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029313379999999999 2024-02-19T21:48:20.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.276982+0000", 2024-02-19T21:48:20.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.229e-06 2024-02-19T21:48:20.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:48:20.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.276988+0000", 2024-02-19T21:48:20.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042792230000000004 2024-02-19T21:48:20.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.281267+0000", 2024-02-19T21:48:20.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9638e-05 2024-02-19T21:48:20.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.676 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:48:20.676 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.281297+0000", 2024-02-19T21:48:20.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6878999999999997e-05 2024-02-19T21:48:20.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.676 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:48:20.676 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.281333+0000", 2024-02-19T21:48:20.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.84576922700000001 2024-02-19T21:48:20.676 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.676 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:48:20.676 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.677 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:226128 9.4 9:290be770:::benchmark_data_smithi080_126364_object97536:head [delete] snapc 0=[] ondisk+write+known_if_redirected e363)", 2024-02-19T21:48:20.677 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:46.489677+0000", 2024-02-19T21:48:20.677 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.061955001999998, 2024-02-19T21:48:20.677 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.79177427899999997, 2024-02-19T21:48:20.677 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:48:20.677 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:48:20.677 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:48:20.677 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:48:20.677 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:48:20.677 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 226128 2024-02-19T21:48:20.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.677 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:48:20.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.677 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:48:20.677 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.489677+0000", 2024-02-19T21:48:20.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:48:20.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:48:20.678 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.489677+0000", 2024-02-19T21:48:20.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:48:20.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:48:20.678 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.489675+0000", 2024-02-19T21:48:20.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8089999999999998e-06 2024-02-19T21:48:20.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:48:20.678 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.489681+0000", 2024-02-19T21:48:20.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2183e-05 2024-02-19T21:48:20.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:48:20.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.489693+0000", 2024-02-19T21:48:20.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5939999999999996e-06 2024-02-19T21:48:20.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:48:20.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.489701+0000", 2024-02-19T21:48:20.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5311000000000001e-05 2024-02-19T21:48:20.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.489736+0000", 2024-02-19T21:48:20.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9540000000000003e-06 2024-02-19T21:48:20.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.489741+0000", 2024-02-19T21:48:20.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.78555000500000005 2024-02-19T21:48:20.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.275291+0000", 2024-02-19T21:48:20.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000100398 2024-02-19T21:48:20.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:48:20.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.275392+0000", 2024-02-19T21:48:20.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010252899999999999 2024-02-19T21:48:20.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:48:20.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.275494+0000", 2024-02-19T21:48:20.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015537109999999999 2024-02-19T21:48:20.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.277048+0000", 2024-02-19T21:48:20.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0017784890000000001 2024-02-19T21:48:20.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:48:20.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.278826+0000", 2024-02-19T21:48:20.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025460259999999998 2024-02-19T21:48:20.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.281372+0000", 2024-02-19T21:48:20.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2975000000000001e-05 2024-02-19T21:48:20.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:48:20.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.281415+0000", 2024-02-19T21:48:20.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5497000000000003e-05 2024-02-19T21:48:20.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:48:20.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.281451+0000", 2024-02-19T21:48:20.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.79177427899999997 2024-02-19T21:48:20.683 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.683 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:48:20.683 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.683 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:226139 9.4 9:20801f36:::benchmark_data_smithi080_126364_object97547:head [delete] snapc 0=[] ondisk+write+known_if_redirected e363)", 2024-02-19T21:48:20.683 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:46.502821+0000", 2024-02-19T21:48:20.683 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.048810717999999, 2024-02-19T21:48:20.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.785912045, 2024-02-19T21:48:20.683 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:48:20.683 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:48:20.683 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:48:20.683 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:48:20.683 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:48:20.684 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 226139 2024-02-19T21:48:20.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.684 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:48:20.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:48:20.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.502821+0000", 2024-02-19T21:48:20.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:48:20.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:48:20.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.502821+0000", 2024-02-19T21:48:20.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:48:20.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:48:20.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.502820+0000", 2024-02-19T21:48:20.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6490000000000002e-06 2024-02-19T21:48:20.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:48:20.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.502826+0000", 2024-02-19T21:48:20.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2104e-05 2024-02-19T21:48:20.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:48:20.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.502838+0000", 2024-02-19T21:48:20.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2469999999999999e-06 2024-02-19T21:48:20.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:48:20.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.502844+0000", 2024-02-19T21:48:20.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2051000000000002e-05 2024-02-19T21:48:20.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.502876+0000", 2024-02-19T21:48:20.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5080000000000002e-06 2024-02-19T21:48:20.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.502882+0000", 2024-02-19T21:48:20.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.77419403399999998 2024-02-19T21:48:20.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.277076+0000", 2024-02-19T21:48:20.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6303000000000005e-05 2024-02-19T21:48:20.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:48:20.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.277153+0000", 2024-02-19T21:48:20.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4896999999999998e-05 2024-02-19T21:48:20.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:48:20.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.277227+0000", 2024-02-19T21:48:20.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040033350000000002 2024-02-19T21:48:20.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.281231+0000", 2024-02-19T21:48:20.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.007380841 2024-02-19T21:48:20.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:48:20.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.288612+0000", 2024-02-19T21:48:20.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4524999999999997e-05 2024-02-19T21:48:20.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.288666+0000", 2024-02-19T21:48:20.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1702999999999998e-05 2024-02-19T21:48:20.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:48:20.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.288698+0000", 2024-02-19T21:48:20.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5088e-05 2024-02-19T21:48:20.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:48:20.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.288733+0000", 2024-02-19T21:48:20.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.785912045 2024-02-19T21:48:20.689 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.689 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:48:20.689 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.689 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:226170 9.4 9:286852bd:::benchmark_data_smithi080_126364_object97578:head [delete] snapc 0=[] ondisk+write+known_if_redirected e363)", 2024-02-19T21:48:20.689 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:46.545528+0000", 2024-02-19T21:48:20.690 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.006103566999997, 2024-02-19T21:48:20.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.74331496900000005, 2024-02-19T21:48:20.690 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:48:20.690 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:48:20.690 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:48:20.690 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:48:20.690 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:48:20.690 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 226170 2024-02-19T21:48:20.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.690 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:48:20.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:48:20.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.545528+0000", 2024-02-19T21:48:20.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:48:20.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:48:20.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.545528+0000", 2024-02-19T21:48:20.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:48:20.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:48:20.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.545527+0000", 2024-02-19T21:48:20.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9210000000000002e-06 2024-02-19T21:48:20.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:48:20.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.545531+0000", 2024-02-19T21:48:20.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8240000000000002e-06 2024-02-19T21:48:20.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:48:20.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.545538+0000", 2024-02-19T21:48:20.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3420000000000001e-06 2024-02-19T21:48:20.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:48:20.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.545542+0000", 2024-02-19T21:48:20.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4168000000000001e-05 2024-02-19T21:48:20.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.545587+0000", 2024-02-19T21:48:20.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1999999999999997e-06 2024-02-19T21:48:20.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:48:20.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.545594+0000", 2024-02-19T21:48:20.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.733272853 2024-02-19T21:48:20.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:48:20.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.278867+0000", 2024-02-19T21:48:20.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000110064 2024-02-19T21:48:20.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:48:20.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.278977+0000", 2024-02-19T21:48:20.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000136217 2024-02-19T21:48:20.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:48:20.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.279113+0000", 2024-02-19T21:48:20.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.009504495 2024-02-19T21:48:20.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:48:20.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.288617+0000", 2024-02-19T21:48:20.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6953000000000001e-05 2024-02-19T21:48:20.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.288644+0000", 2024-02-19T21:48:20.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015265400000000001 2024-02-19T21:48:20.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:48:20.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.288797+0000", 2024-02-19T21:48:20.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5210000000000001e-05 2024-02-19T21:48:20.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:48:20.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.288822+0000", 2024-02-19T21:48:20.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0761e-05 2024-02-19T21:48:20.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:48:20.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:48:20.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:48:20.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.288843+0000", 2024-02-19T21:48:20.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.74331496900000005 2024-02-19T21:48:20.696 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.696 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:48:20.696 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.696 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:48:20.696 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:48:20.696 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:48:20.696 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:48:20.726 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:20.745 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:48:20.748 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:20.748 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:48:20.846 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:48:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:48:20] "GET /metrics HTTP/1.1" 200 176326 "" "Prometheus/2.33.4" 2024-02-19T21:48:20.849 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:48:20.876 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:21.056 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:48:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:48:21.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:19.133265+0000 mgr.y (mgr.14514) 601 : cluster [DBG] pgmap v772: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 17 active+undersized+degraded; 271 MiB data, 4.6 GiB used, 621 GiB / 626 GiB avail; 758 B/s rd, 0 B/s wr, 842 op/s; 355/13587 objects degraded (2.613%); 1392/13587 objects misplaced (10.245%) 2024-02-19T21:48:21.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:20.959418+0000 mon.a (mon.0) 1524 : audit [INF] from='client.? 172.21.15.80:0/3892815094' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:48:21.266 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:19.133265+0000 mgr.y (mgr.14514) 601 : cluster [DBG] pgmap v772: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 17 active+undersized+degraded; 271 MiB data, 4.6 GiB used, 621 GiB / 626 GiB avail; 758 B/s rd, 0 B/s wr, 842 op/s; 355/13587 objects degraded (2.613%); 1392/13587 objects misplaced (10.245%) 2024-02-19T21:48:21.266 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:20.959418+0000 mon.a (mon.0) 1524 : audit [INF] from='client.? 172.21.15.80:0/3892815094' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:48:21.266 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:19.133265+0000 mgr.y (mgr.14514) 601 : cluster [DBG] pgmap v772: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 17 active+undersized+degraded; 271 MiB data, 4.6 GiB used, 621 GiB / 626 GiB avail; 758 B/s rd, 0 B/s wr, 842 op/s; 355/13587 objects degraded (2.613%); 1392/13587 objects misplaced (10.245%) 2024-02-19T21:48:21.266 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:20.959418+0000 mon.a (mon.0) 1524 : audit [INF] from='client.? 172.21.15.80:0/3892815094' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:48:21.495 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-02-19T21:48:22.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:20.813862+0000 mgr.y (mgr.14514) 602 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:48:22.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:21.186720+0000 osd.7 (osd.7) 227 : cluster [DBG] 6.15 scrub starts 2024-02-19T21:48:22.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:21.232089+0000 mon.a (mon.0) 1525 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:48:22.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:21.236260+0000 mon.a (mon.0) 1526 : audit [INF] from='client.? 172.21.15.80:0/3892815094' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:48:22.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:21.236308+0000 mon.a (mon.0) 1527 : cluster [DBG] osdmap e377: 8 total, 7 up, 7 in 2024-02-19T21:48:22.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:21.256349+0000 osd.7 (osd.7) 228 : cluster [DBG] 6.15 scrub ok 2024-02-19T21:48:22.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:20.813862+0000 mgr.y (mgr.14514) 602 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:48:22.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:21.186720+0000 osd.7 (osd.7) 227 : cluster [DBG] 6.15 scrub starts 2024-02-19T21:48:22.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:21.232089+0000 mon.a (mon.0) 1525 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:48:22.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:21.236260+0000 mon.a (mon.0) 1526 : audit [INF] from='client.? 172.21.15.80:0/3892815094' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:48:22.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:21.236308+0000 mon.a (mon.0) 1527 : cluster [DBG] osdmap e377: 8 total, 7 up, 7 in 2024-02-19T21:48:22.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:21.256349+0000 osd.7 (osd.7) 228 : cluster [DBG] 6.15 scrub ok 2024-02-19T21:48:22.226 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:48:22.228 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:22.229 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:48:22.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:20.813862+0000 mgr.y (mgr.14514) 602 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:48:22.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:21.186720+0000 osd.7 (osd.7) 227 : cluster [DBG] 6.15 scrub starts 2024-02-19T21:48:22.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:21.232089+0000 mon.a (mon.0) 1525 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:48:22.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:21.236260+0000 mon.a (mon.0) 1526 : audit [INF] from='client.? 172.21.15.80:0/3892815094' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:48:22.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:21.236308+0000 mon.a (mon.0) 1527 : cluster [DBG] osdmap e377: 8 total, 7 up, 7 in 2024-02-19T21:48:22.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:21.256349+0000 osd.7 (osd.7) 228 : cluster [DBG] 6.15 scrub ok 2024-02-19T21:48:22.329 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:48:22.359 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:22.608 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:48:22.611 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:22.611 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:48:22.712 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:48:22.738 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:22.810 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:48:22.813 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:22.813 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:48:22.914 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:48:22.941 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:23.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:21.133967+0000 mgr.y (mgr.14514) 603 : cluster [DBG] pgmap v773: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 17 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.25k op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:23.263 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:21.574418+0000 osd.6 (osd.6) 222 : cluster [DBG] 6.1b scrub starts 2024-02-19T21:48:23.263 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:21.643211+0000 osd.6 (osd.6) 223 : cluster [DBG] 6.1b scrub ok 2024-02-19T21:48:23.263 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:22.168708+0000 osd.7 (osd.7) 229 : cluster [DBG] 5.10 scrub starts 2024-02-19T21:48:23.263 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:22.171597+0000 osd.7 (osd.7) 230 : cluster [DBG] 5.10 scrub ok 2024-02-19T21:48:23.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:21.133967+0000 mgr.y (mgr.14514) 603 : cluster [DBG] pgmap v773: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 17 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.25k op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:23.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:21.574418+0000 osd.6 (osd.6) 222 : cluster [DBG] 6.1b scrub starts 2024-02-19T21:48:23.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:21.643211+0000 osd.6 (osd.6) 223 : cluster [DBG] 6.1b scrub ok 2024-02-19T21:48:23.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:22.168708+0000 osd.7 (osd.7) 229 : cluster [DBG] 5.10 scrub starts 2024-02-19T21:48:23.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:22.171597+0000 osd.7 (osd.7) 230 : cluster [DBG] 5.10 scrub ok 2024-02-19T21:48:23.264 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:48:23.288 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:48:23.292 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:23.292 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:48:23.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:21.133967+0000 mgr.y (mgr.14514) 603 : cluster [DBG] pgmap v773: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 17 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.25k op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:23.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:21.574418+0000 osd.6 (osd.6) 222 : cluster [DBG] 6.1b scrub starts 2024-02-19T21:48:23.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:21.643211+0000 osd.6 (osd.6) 223 : cluster [DBG] 6.1b scrub ok 2024-02-19T21:48:23.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:22.168708+0000 osd.7 (osd.7) 229 : cluster [DBG] 5.10 scrub starts 2024-02-19T21:48:23.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:22.171597+0000 osd.7 (osd.7) 230 : cluster [DBG] 5.10 scrub ok 2024-02-19T21:48:23.393 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:48:23.425 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:23.447 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:48:23.449 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:23.450 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:48:23.551 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:48:23.580 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:23.600 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:48:23.603 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:23.603 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:48:23.704 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:48:23.732 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:23.877 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_2 2024-02-19T21:48:23.877 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool rm unique_pool_2 unique_pool_2 --yes-i-really-really-mean-it 2024-02-19T21:48:24.011 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.3 dump_ops_in_flight 2024-02-19T21:48:24.163 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:22.515551+0000 osd.4 (osd.4) 183 : cluster [DBG] 4.9 deep-scrub starts 2024-02-19T21:48:24.163 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:22.519376+0000 osd.4 (osd.4) 184 : cluster [DBG] 4.9 deep-scrub ok 2024-02-19T21:48:24.163 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:22.557188+0000 osd.6 (osd.6) 224 : cluster [DBG] 5.11 deep-scrub starts 2024-02-19T21:48:24.163 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:22.560062+0000 osd.6 (osd.6) 225 : cluster [DBG] 5.11 deep-scrub ok 2024-02-19T21:48:24.163 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:23.215354+0000 osd.7 (osd.7) 231 : cluster [DBG] 2.0 scrub starts 2024-02-19T21:48:24.163 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:23.218277+0000 osd.7 (osd.7) 232 : cluster [DBG] 2.0 scrub ok 2024-02-19T21:48:24.163 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:22.515551+0000 osd.4 (osd.4) 183 : cluster [DBG] 4.9 deep-scrub starts 2024-02-19T21:48:24.163 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:22.519376+0000 osd.4 (osd.4) 184 : cluster [DBG] 4.9 deep-scrub ok 2024-02-19T21:48:24.163 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:22.557188+0000 osd.6 (osd.6) 224 : cluster [DBG] 5.11 deep-scrub starts 2024-02-19T21:48:24.164 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:22.560062+0000 osd.6 (osd.6) 225 : cluster [DBG] 5.11 deep-scrub ok 2024-02-19T21:48:24.164 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:23.215354+0000 osd.7 (osd.7) 231 : cluster [DBG] 2.0 scrub starts 2024-02-19T21:48:24.164 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:23.218277+0000 osd.7 (osd.7) 232 : cluster [DBG] 2.0 scrub ok 2024-02-19T21:48:24.190 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set noscrub 2024-02-19T21:48:24.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:22.515551+0000 osd.4 (osd.4) 183 : cluster [DBG] 4.9 deep-scrub starts 2024-02-19T21:48:24.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:22.519376+0000 osd.4 (osd.4) 184 : cluster [DBG] 4.9 deep-scrub ok 2024-02-19T21:48:24.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:22.557188+0000 osd.6 (osd.6) 224 : cluster [DBG] 5.11 deep-scrub starts 2024-02-19T21:48:24.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:22.560062+0000 osd.6 (osd.6) 225 : cluster [DBG] 5.11 deep-scrub ok 2024-02-19T21:48:24.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:23.215354+0000 osd.7 (osd.7) 231 : cluster [DBG] 2.0 scrub starts 2024-02-19T21:48:24.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:23.218277+0000 osd.7 (osd.7) 232 : cluster [DBG] 2.0 scrub ok 2024-02-19T21:48:24.982 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:48:24.986 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:24.987 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:48:25.088 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:48:25.116 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:25.213 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:48:25.217 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:25.217 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:48:25.235 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:23.134376+0000 mgr.y (mgr.14514) 604 : cluster [DBG] pgmap v775: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 17 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 985 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:25.235 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:23.323271+0000 osd.0 (osd.0) 250 : cluster [DBG] 4.b deep-scrub starts 2024-02-19T21:48:25.235 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:23.326535+0000 osd.0 (osd.0) 251 : cluster [DBG] 4.b deep-scrub ok 2024-02-19T21:48:25.235 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:23.134376+0000 mgr.y (mgr.14514) 604 : cluster [DBG] pgmap v775: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 17 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 985 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:25.236 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:23.323271+0000 osd.0 (osd.0) 250 : cluster [DBG] 4.b deep-scrub starts 2024-02-19T21:48:25.236 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:23.326535+0000 osd.0 (osd.0) 251 : cluster [DBG] 4.b deep-scrub ok 2024-02-19T21:48:25.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:23.134376+0000 mgr.y (mgr.14514) 604 : cluster [DBG] pgmap v775: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 17 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 985 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:25.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:23.323271+0000 osd.0 (osd.0) 250 : cluster [DBG] 4.b deep-scrub starts 2024-02-19T21:48:25.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:23.326535+0000 osd.0 (osd.0) 251 : cluster [DBG] 4.b deep-scrub ok 2024-02-19T21:48:25.318 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:48:25.347 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:25.504 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:48:25.508 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:25.508 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:48:25.609 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:48:25.637 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:25.710 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:48:25.712 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:25.713 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:48:25.814 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:48:25.840 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:25.847 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:48:25.858 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:48:25.861 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:25.862 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:48:25.962 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:48:25.987 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:48:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:48:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:48:25.989 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:26.008 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:48:26.010 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:26.011 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:48:26.112 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:48:26.120 INFO:teuthology.orchestra.run.smithi080.stderr:Exporting 2.16 info 2.16( empty local-lis/les=347/348 n=0 ec=58/58 lis/c=347/347 les/c/f=348/348/0 sis=347) 2024-02-19T21:48:26.120 INFO:teuthology.orchestra.run.smithi080.stderr:Export successful 2024-02-19T21:48:26.139 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:26.158 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:48:26.160 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:26.160 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:48:26.261 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:48:26.263 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:24.662182+0000 osd.5 (osd.5) 253 : cluster [DBG] 4.8 scrub starts 2024-02-19T21:48:26.263 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:24.665809+0000 osd.5 (osd.5) 254 : cluster [DBG] 4.8 scrub ok 2024-02-19T21:48:26.263 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:24.784069+0000 osd.1 (osd.1) 227 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:48:26.263 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:24.784156+0000 osd.1 (osd.1) 228 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:48:26.263 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:24.844812+0000 osd.0 (osd.0) 252 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:48:26.264 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:24.844875+0000 osd.0 (osd.0) 253 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:48:26.264 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:24.987771+0000 mon.a (mon.0) 1528 : cluster [DBG] osdmap e378: 8 total, 7 up, 7 in 2024-02-19T21:48:26.264 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:25.226788+0000 mon.a (mon.0) 1529 : cluster [WRN] Health check update: Degraded data redundancy: 71/576 objects degraded (12.326%), 17 pgs degraded (PG_DEGRADED) 2024-02-19T21:48:26.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:24.662182+0000 osd.5 (osd.5) 253 : cluster [DBG] 4.8 scrub starts 2024-02-19T21:48:26.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:24.665809+0000 osd.5 (osd.5) 254 : cluster [DBG] 4.8 scrub ok 2024-02-19T21:48:26.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:24.784069+0000 osd.1 (osd.1) 227 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:48:26.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:24.784156+0000 osd.1 (osd.1) 228 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:48:26.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:24.844812+0000 osd.0 (osd.0) 252 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:48:26.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:24.844875+0000 osd.0 (osd.0) 253 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:48:26.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:24.987771+0000 mon.a (mon.0) 1528 : cluster [DBG] osdmap e378: 8 total, 7 up, 7 in 2024-02-19T21:48:26.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:25.226788+0000 mon.a (mon.0) 1529 : cluster [WRN] Health check update: Degraded data redundancy: 71/576 objects degraded (12.326%), 17 pgs degraded (PG_DEGRADED) 2024-02-19T21:48:26.286 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:24.662182+0000 osd.5 (osd.5) 253 : cluster [DBG] 4.8 scrub starts 2024-02-19T21:48:26.286 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:24.665809+0000 osd.5 (osd.5) 254 : cluster [DBG] 4.8 scrub ok 2024-02-19T21:48:26.286 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:24.784069+0000 osd.1 (osd.1) 227 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:48:26.286 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:24.784156+0000 osd.1 (osd.1) 228 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:48:26.286 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:24.844812+0000 osd.0 (osd.0) 252 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:48:26.287 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:24.844875+0000 osd.0 (osd.0) 253 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:48:26.287 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:24.987771+0000 mon.a (mon.0) 1528 : cluster [DBG] osdmap e378: 8 total, 7 up, 7 in 2024-02-19T21:48:26.287 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:25.226788+0000 mon.a (mon.0) 1529 : cluster [WRN] Health check update: Degraded data redundancy: 71/576 objects degraded (12.326%), 17 pgs degraded (PG_DEGRADED) 2024-02-19T21:48:26.288 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:26.307 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:48:26.309 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:26.310 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:48:26.369 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:48:26.369 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:48:26.369 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:48:26.370 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:48:26.370 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:48:26.370 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:48:26.370 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:48:26.370 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:48:26.370 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:48:26.370 INFO:teuthology.orchestra.run.smithi080.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-02-19T21:48:26.370 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:48:26.370 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:48:26.370 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:48:26.370 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:48:26.371 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:48:26.411 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:48:26.437 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:26.456 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:48:26.458 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:26.459 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:48:26.559 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:48:26.589 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:27.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:25.134911+0000 mgr.y (mgr.14514) 605 : cluster [DBG] pgmap v777: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 17 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 542 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:27.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:25.346710+0000 osd.0 (osd.0) 254 : cluster [DBG] 4.1e scrub starts 2024-02-19T21:48:27.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:25.348431+0000 osd.0 (osd.0) 255 : cluster [DBG] 4.1e scrub ok 2024-02-19T21:48:27.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:25.484130+0000 osd.4 (osd.4) 185 : cluster [DBG] 5.e scrub starts 2024-02-19T21:48:27.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:25.487604+0000 osd.4 (osd.4) 186 : cluster [DBG] 5.e scrub ok 2024-02-19T21:48:27.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:25.732829+0000 osd.1 (osd.1) 229 : cluster [DBG] 4.1d scrub starts 2024-02-19T21:48:27.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:25.734586+0000 osd.1 (osd.1) 230 : cluster [DBG] 4.1d scrub ok 2024-02-19T21:48:27.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:26.126146+0000 mon.c (mon.2) 81 : audit [DBG] from='client.? 172.21.15.80:0/1762213675' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:48:27.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:26.289406+0000 osd.7 (osd.7) 233 : cluster [DBG] 5.9 scrub starts 2024-02-19T21:48:27.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:26.292901+0000 osd.7 (osd.7) 234 : cluster [DBG] 5.9 scrub ok 2024-02-19T21:48:27.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:25.134911+0000 mgr.y (mgr.14514) 605 : cluster [DBG] pgmap v777: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 17 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 542 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:27.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:25.346710+0000 osd.0 (osd.0) 254 : cluster [DBG] 4.1e scrub starts 2024-02-19T21:48:27.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:25.348431+0000 osd.0 (osd.0) 255 : cluster [DBG] 4.1e scrub ok 2024-02-19T21:48:27.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:25.484130+0000 osd.4 (osd.4) 185 : cluster [DBG] 5.e scrub starts 2024-02-19T21:48:27.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:25.487604+0000 osd.4 (osd.4) 186 : cluster [DBG] 5.e scrub ok 2024-02-19T21:48:27.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:25.732829+0000 osd.1 (osd.1) 229 : cluster [DBG] 4.1d scrub starts 2024-02-19T21:48:27.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:25.734586+0000 osd.1 (osd.1) 230 : cluster [DBG] 4.1d scrub ok 2024-02-19T21:48:27.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:26.126146+0000 mon.c (mon.2) 81 : audit [DBG] from='client.? 172.21.15.80:0/1762213675' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:48:27.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:26.289406+0000 osd.7 (osd.7) 233 : cluster [DBG] 5.9 scrub starts 2024-02-19T21:48:27.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:26.292901+0000 osd.7 (osd.7) 234 : cluster [DBG] 5.9 scrub ok 2024-02-19T21:48:27.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:25.134911+0000 mgr.y (mgr.14514) 605 : cluster [DBG] pgmap v777: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 32 active+undersized, 17 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 542 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:27.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:25.346710+0000 osd.0 (osd.0) 254 : cluster [DBG] 4.1e scrub starts 2024-02-19T21:48:27.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:25.348431+0000 osd.0 (osd.0) 255 : cluster [DBG] 4.1e scrub ok 2024-02-19T21:48:27.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:25.484130+0000 osd.4 (osd.4) 185 : cluster [DBG] 5.e scrub starts 2024-02-19T21:48:27.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:25.487604+0000 osd.4 (osd.4) 186 : cluster [DBG] 5.e scrub ok 2024-02-19T21:48:27.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:25.732829+0000 osd.1 (osd.1) 229 : cluster [DBG] 4.1d scrub starts 2024-02-19T21:48:27.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:25.734586+0000 osd.1 (osd.1) 230 : cluster [DBG] 4.1d scrub ok 2024-02-19T21:48:27.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:26.126146+0000 mon.c (mon.2) 81 : audit [DBG] from='client.? 172.21.15.80:0/1762213675' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:48:27.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:26.289406+0000 osd.7 (osd.7) 233 : cluster [DBG] 5.9 scrub starts 2024-02-19T21:48:27.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:26.292901+0000 osd.7 (osd.7) 234 : cluster [DBG] 5.9 scrub ok 2024-02-19T21:48:28.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:26.364776+0000 osd.0 (osd.0) 256 : cluster [DBG] 4.1f scrub starts 2024-02-19T21:48:28.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:26.366557+0000 osd.0 (osd.0) 257 : cluster [DBG] 4.1f scrub ok 2024-02-19T21:48:28.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:26.526669+0000 osd.4 (osd.4) 187 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:48:28.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:26.530156+0000 osd.4 (osd.4) 188 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:48:28.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:26.364776+0000 osd.0 (osd.0) 256 : cluster [DBG] 4.1f scrub starts 2024-02-19T21:48:28.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:26.366557+0000 osd.0 (osd.0) 257 : cluster [DBG] 4.1f scrub ok 2024-02-19T21:48:28.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:26.526669+0000 osd.4 (osd.4) 187 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:48:28.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:26.530156+0000 osd.4 (osd.4) 188 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:48:28.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:26.364776+0000 osd.0 (osd.0) 256 : cluster [DBG] 4.1f scrub starts 2024-02-19T21:48:28.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:26.366557+0000 osd.0 (osd.0) 257 : cluster [DBG] 4.1f scrub ok 2024-02-19T21:48:28.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:26.526669+0000 osd.4 (osd.4) 187 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:48:28.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:26.530156+0000 osd.4 (osd.4) 188 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:48:29.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:27.135542+0000 mgr.y (mgr.14514) 606 : cluster [DBG] pgmap v778: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 33 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 543 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:29.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:27.717993+0000 osd.5 (osd.5) 255 : cluster [DBG] 4.15 scrub starts 2024-02-19T21:48:29.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:27.719948+0000 osd.5 (osd.5) 256 : cluster [DBG] 4.15 scrub ok 2024-02-19T21:48:29.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:28.323808+0000 osd.7 (osd.7) 235 : cluster [DBG] 2.1d deep-scrub starts 2024-02-19T21:48:29.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:28.326933+0000 osd.7 (osd.7) 236 : cluster [DBG] 2.1d deep-scrub ok 2024-02-19T21:48:29.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:28.508117+0000 osd.4 (osd.4) 189 : cluster [DBG] 2.f deep-scrub starts 2024-02-19T21:48:29.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:28.510842+0000 osd.4 (osd.4) 190 : cluster [DBG] 2.f deep-scrub ok 2024-02-19T21:48:29.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:27.135542+0000 mgr.y (mgr.14514) 606 : cluster [DBG] pgmap v778: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 33 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 543 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:29.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:27.717993+0000 osd.5 (osd.5) 255 : cluster [DBG] 4.15 scrub starts 2024-02-19T21:48:29.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:27.719948+0000 osd.5 (osd.5) 256 : cluster [DBG] 4.15 scrub ok 2024-02-19T21:48:29.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:28.323808+0000 osd.7 (osd.7) 235 : cluster [DBG] 2.1d deep-scrub starts 2024-02-19T21:48:29.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:28.326933+0000 osd.7 (osd.7) 236 : cluster [DBG] 2.1d deep-scrub ok 2024-02-19T21:48:29.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:28.508117+0000 osd.4 (osd.4) 189 : cluster [DBG] 2.f deep-scrub starts 2024-02-19T21:48:29.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:28.510842+0000 osd.4 (osd.4) 190 : cluster [DBG] 2.f deep-scrub ok 2024-02-19T21:48:29.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:27.135542+0000 mgr.y (mgr.14514) 606 : cluster [DBG] pgmap v778: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 33 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 543 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:29.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:27.717993+0000 osd.5 (osd.5) 255 : cluster [DBG] 4.15 scrub starts 2024-02-19T21:48:29.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:27.719948+0000 osd.5 (osd.5) 256 : cluster [DBG] 4.15 scrub ok 2024-02-19T21:48:29.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:28.323808+0000 osd.7 (osd.7) 235 : cluster [DBG] 2.1d deep-scrub starts 2024-02-19T21:48:29.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:28.326933+0000 osd.7 (osd.7) 236 : cluster [DBG] 2.1d deep-scrub ok 2024-02-19T21:48:29.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:28.508117+0000 osd.4 (osd.4) 189 : cluster [DBG] 2.f deep-scrub starts 2024-02-19T21:48:29.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:28.510842+0000 osd.4 (osd.4) 190 : cluster [DBG] 2.f deep-scrub ok 2024-02-19T21:48:30.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:28.760167+0000 osd.1 (osd.1) 231 : cluster [DBG] 9.4 scrub starts 2024-02-19T21:48:30.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:28.782608+0000 osd.1 (osd.1) 232 : cluster [DBG] 9.4 scrub ok 2024-02-19T21:48:30.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:29.519929+0000 osd.4 (osd.4) 191 : cluster [DBG] 9.c scrub starts 2024-02-19T21:48:30.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:29.544129+0000 osd.4 (osd.4) 192 : cluster [DBG] 9.c scrub ok 2024-02-19T21:48:30.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:28.760167+0000 osd.1 (osd.1) 231 : cluster [DBG] 9.4 scrub starts 2024-02-19T21:48:30.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:28.782608+0000 osd.1 (osd.1) 232 : cluster [DBG] 9.4 scrub ok 2024-02-19T21:48:30.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:29.519929+0000 osd.4 (osd.4) 191 : cluster [DBG] 9.c scrub starts 2024-02-19T21:48:30.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:29.544129+0000 osd.4 (osd.4) 192 : cluster [DBG] 9.c scrub ok 2024-02-19T21:48:30.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:28.760167+0000 osd.1 (osd.1) 231 : cluster [DBG] 9.4 scrub starts 2024-02-19T21:48:30.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:28.782608+0000 osd.1 (osd.1) 232 : cluster [DBG] 9.4 scrub ok 2024-02-19T21:48:30.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:29.519929+0000 osd.4 (osd.4) 191 : cluster [DBG] 9.c scrub starts 2024-02-19T21:48:30.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:29.544129+0000 osd.4 (osd.4) 192 : cluster [DBG] 9.c scrub ok 2024-02-19T21:48:30.643 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:48:30.648 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:30.649 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:48:30.749 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:48:30.781 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:30.803 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:48:30.806 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:30.807 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:48:30.907 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:48:30.938 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:30.959 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:48:30.962 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:30.962 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:48:31.014 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:48:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:48:30] "GET /metrics HTTP/1.1" 200 176326 "" "Prometheus/2.33.4" 2024-02-19T21:48:31.056 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:48:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:48:31.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:29.135986+0000 mgr.y (mgr.14514) 607 : cluster [DBG] pgmap v779: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 33 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 639 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:31.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:29.457481+0000 osd.6 (osd.6) 226 : cluster [DBG] 9.1 scrub starts 2024-02-19T21:48:31.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:29.481139+0000 osd.6 (osd.6) 227 : cluster [DBG] 9.1 scrub ok 2024-02-19T21:48:31.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:30.228727+0000 mon.a (mon.0) 1530 : cluster [WRN] Health check update: Degraded data redundancy: 71/576 objects degraded (12.326%), 16 pgs degraded (PG_DEGRADED) 2024-02-19T21:48:31.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:30.274420+0000 osd.7 (osd.7) 237 : cluster [DBG] 2.b scrub starts 2024-02-19T21:48:31.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:30.277319+0000 osd.7 (osd.7) 238 : cluster [DBG] 2.b scrub ok 2024-02-19T21:48:31.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:30.513025+0000 osd.4 (osd.4) 193 : cluster [DBG] 6.1a scrub starts 2024-02-19T21:48:31.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:30.516116+0000 osd.4 (osd.4) 194 : cluster [DBG] 6.1a scrub ok 2024-02-19T21:48:31.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:30.823753+0000 mgr.y (mgr.14514) 608 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:48:31.063 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:48:31.092 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:31.111 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:48:31.114 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:31.114 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:48:31.215 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:48:31.251 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:31.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:29.135986+0000 mgr.y (mgr.14514) 607 : cluster [DBG] pgmap v779: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 33 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 639 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:31.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:29.457481+0000 osd.6 (osd.6) 226 : cluster [DBG] 9.1 scrub starts 2024-02-19T21:48:31.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:29.481139+0000 osd.6 (osd.6) 227 : cluster [DBG] 9.1 scrub ok 2024-02-19T21:48:31.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:30.228727+0000 mon.a (mon.0) 1530 : cluster [WRN] Health check update: Degraded data redundancy: 71/576 objects degraded (12.326%), 16 pgs degraded (PG_DEGRADED) 2024-02-19T21:48:31.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:30.274420+0000 osd.7 (osd.7) 237 : cluster [DBG] 2.b scrub starts 2024-02-19T21:48:31.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:30.277319+0000 osd.7 (osd.7) 238 : cluster [DBG] 2.b scrub ok 2024-02-19T21:48:31.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:30.513025+0000 osd.4 (osd.4) 193 : cluster [DBG] 6.1a scrub starts 2024-02-19T21:48:31.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:30.516116+0000 osd.4 (osd.4) 194 : cluster [DBG] 6.1a scrub ok 2024-02-19T21:48:31.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:30.823753+0000 mgr.y (mgr.14514) 608 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:48:31.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:29.135986+0000 mgr.y (mgr.14514) 607 : cluster [DBG] pgmap v779: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 33 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 639 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:31.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:29.457481+0000 osd.6 (osd.6) 226 : cluster [DBG] 9.1 scrub starts 2024-02-19T21:48:31.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:29.481139+0000 osd.6 (osd.6) 227 : cluster [DBG] 9.1 scrub ok 2024-02-19T21:48:31.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:30.228727+0000 mon.a (mon.0) 1530 : cluster [WRN] Health check update: Degraded data redundancy: 71/576 objects degraded (12.326%), 16 pgs degraded (PG_DEGRADED) 2024-02-19T21:48:31.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:30.274420+0000 osd.7 (osd.7) 237 : cluster [DBG] 2.b scrub starts 2024-02-19T21:48:31.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:30.277319+0000 osd.7 (osd.7) 238 : cluster [DBG] 2.b scrub ok 2024-02-19T21:48:31.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:30.513025+0000 osd.4 (osd.4) 193 : cluster [DBG] 6.1a scrub starts 2024-02-19T21:48:31.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:30.516116+0000 osd.4 (osd.4) 194 : cluster [DBG] 6.1a scrub ok 2024-02-19T21:48:31.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:30.823753+0000 mgr.y (mgr.14514) 608 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:48:32.021 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:31.136779+0000 mgr.y (mgr.14514) 609 : cluster [DBG] pgmap v780: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 33 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1.0 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:32.021 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:31.317131+0000 osd.7 (osd.7) 239 : cluster [DBG] 2.5 scrub starts 2024-02-19T21:48:32.021 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:31.320107+0000 osd.7 (osd.7) 240 : cluster [DBG] 2.5 scrub ok 2024-02-19T21:48:32.022 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:31.490932+0000 osd.4 (osd.4) 195 : cluster [DBG] 9.e scrub starts 2024-02-19T21:48:32.022 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:31.515177+0000 osd.4 (osd.4) 196 : cluster [DBG] 9.e scrub ok 2024-02-19T21:48:32.236 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:48:32.269 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -n osd.2 --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph-objectstore-tool --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal --force --op remove --pgid 2.16 2024-02-19T21:48:32.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:31.136779+0000 mgr.y (mgr.14514) 609 : cluster [DBG] pgmap v780: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 33 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1.0 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:32.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:31.317131+0000 osd.7 (osd.7) 239 : cluster [DBG] 2.5 scrub starts 2024-02-19T21:48:32.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:31.320107+0000 osd.7 (osd.7) 240 : cluster [DBG] 2.5 scrub ok 2024-02-19T21:48:32.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:31.490932+0000 osd.4 (osd.4) 195 : cluster [DBG] 9.e scrub starts 2024-02-19T21:48:32.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:31.515177+0000 osd.4 (osd.4) 196 : cluster [DBG] 9.e scrub ok 2024-02-19T21:48:32.335 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:31.136779+0000 mgr.y (mgr.14514) 609 : cluster [DBG] pgmap v780: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 33 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1.0 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:32.336 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:31.317131+0000 osd.7 (osd.7) 239 : cluster [DBG] 2.5 scrub starts 2024-02-19T21:48:32.336 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:31.320107+0000 osd.7 (osd.7) 240 : cluster [DBG] 2.5 scrub ok 2024-02-19T21:48:32.336 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:31.490932+0000 osd.4 (osd.4) 195 : cluster [DBG] 9.e scrub starts 2024-02-19T21:48:32.336 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:31.515177+0000 osd.4 (osd.4) 196 : cluster [DBG] 9.e scrub ok 2024-02-19T21:48:32.505 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:48:32.508 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:32.508 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:48:32.609 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:48:32.619 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/osd.2/config 2024-02-19T21:48:32.642 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:32.663 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:48:32.666 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:32.666 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:48:32.767 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:48:32.796 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:32.816 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:48:32.819 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:32.819 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:48:32.920 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:48:32.948 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:32.967 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:48:32.970 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:32.970 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:48:33.071 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:48:33.100 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:33.427 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:48:33.430 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:33.430 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:48:33.531 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:48:33.558 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:33.707 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:48:33.707 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:48:33.710 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:33.710 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:48:33.811 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:48:33.843 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:33.864 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:48:33.867 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:33.868 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:48:33.968 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:48:33.994 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:34.117 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:48:34.121 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:34.121 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:48:34.222 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:48:34.247 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:32.485620+0000 osd.6 (osd.6) 228 : cluster [DBG] 4.a scrub starts 2024-02-19T21:48:34.247 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:32.489080+0000 osd.6 (osd.6) 229 : cluster [DBG] 4.a scrub ok 2024-02-19T21:48:34.247 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:33.137270+0000 mgr.y (mgr.14514) 610 : cluster [DBG] pgmap v781: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 33 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1023 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:34.247 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:33.453708+0000 osd.4 (osd.4) 197 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:48:34.247 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:33.478711+0000 osd.4 (osd.4) 198 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:48:34.247 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:33.961530+0000 mon.a (mon.0) 1531 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:48:34.247 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:32.485620+0000 osd.6 (osd.6) 228 : cluster [DBG] 4.a scrub starts 2024-02-19T21:48:34.247 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:32.489080+0000 osd.6 (osd.6) 229 : cluster [DBG] 4.a scrub ok 2024-02-19T21:48:34.247 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:33.137270+0000 mgr.y (mgr.14514) 610 : cluster [DBG] pgmap v781: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 33 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1023 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:34.248 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:33.453708+0000 osd.4 (osd.4) 197 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:48:34.248 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:33.478711+0000 osd.4 (osd.4) 198 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:48:34.248 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:33.961530+0000 mon.a (mon.0) 1531 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:48:34.249 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:34.554 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-02-19T21:48:34.555 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-02-19T21:48:34.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:32.485620+0000 osd.6 (osd.6) 228 : cluster [DBG] 4.a scrub starts 2024-02-19T21:48:34.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:32.489080+0000 osd.6 (osd.6) 229 : cluster [DBG] 4.a scrub ok 2024-02-19T21:48:34.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:33.137270+0000 mgr.y (mgr.14514) 610 : cluster [DBG] pgmap v781: 138 pgs: 1 active+remapped+backfill_toofull, 5 active+clean+remapped, 83 active+clean, 33 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1023 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:34.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:33.453708+0000 osd.4 (osd.4) 197 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:48:34.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:33.478711+0000 osd.4 (osd.4) 198 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:48:34.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:33.961530+0000 mon.a (mon.0) 1531 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:48:35.292 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:34.482160+0000 osd.4 (osd.4) 199 : cluster [DBG] 4.e scrub starts 2024-02-19T21:48:35.292 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:34.485779+0000 osd.4 (osd.4) 200 : cluster [DBG] 4.e scrub ok 2024-02-19T21:48:35.292 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:34.482160+0000 osd.4 (osd.4) 199 : cluster [DBG] 4.e scrub starts 2024-02-19T21:48:35.292 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:34.485779+0000 osd.4 (osd.4) 200 : cluster [DBG] 4.e scrub ok 2024-02-19T21:48:35.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:34.482160+0000 osd.4 (osd.4) 199 : cluster [DBG] 4.e scrub starts 2024-02-19T21:48:35.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:34.485779+0000 osd.4 (osd.4) 200 : cluster [DBG] 4.e scrub ok 2024-02-19T21:48:36.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:48:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:48:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:48:36.199 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:35.137812+0000 mgr.y (mgr.14514) 611 : cluster [DBG] pgmap v782: 138 pgs: 6 active+clean+remapped, 83 active+clean, 33 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1008 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:36.199 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:35.191525+0000 mon.a (mon.0) 1532 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-19T21:48:36.300 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:48:36.303 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:36.303 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:48:36.404 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:48:36.436 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:36.531 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:35.137812+0000 mgr.y (mgr.14514) 611 : cluster [DBG] pgmap v782: 138 pgs: 6 active+clean+remapped, 83 active+clean, 33 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1008 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:36.531 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:35.191525+0000 mon.a (mon.0) 1532 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-19T21:48:36.531 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:35.196368+0000 mon.a (mon.0) 1533 : cluster [DBG] osdmap e379: 8 total, 7 up, 7 in 2024-02-19T21:48:36.531 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:35.235840+0000 mon.a (mon.0) 1534 : cluster [DBG] osdmap e380: 8 total, 7 up, 7 in 2024-02-19T21:48:36.531 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:35.196368+0000 mon.a (mon.0) 1533 : cluster [DBG] osdmap e379: 8 total, 7 up, 7 in 2024-02-19T21:48:36.531 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:35.235840+0000 mon.a (mon.0) 1534 : cluster [DBG] osdmap e380: 8 total, 7 up, 7 in 2024-02-19T21:48:36.556 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:48:36.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:35.137812+0000 mgr.y (mgr.14514) 611 : cluster [DBG] pgmap v782: 138 pgs: 6 active+clean+remapped, 83 active+clean, 33 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1008 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:36.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:35.191525+0000 mon.a (mon.0) 1532 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-19T21:48:36.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:35.196368+0000 mon.a (mon.0) 1533 : cluster [DBG] osdmap e379: 8 total, 7 up, 7 in 2024-02-19T21:48:36.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:35.235840+0000 mon.a (mon.0) 1534 : cluster [DBG] osdmap e380: 8 total, 7 up, 7 in 2024-02-19T21:48:37.539 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:35.860731+0000 osd.1 (osd.1) 233 : cluster [DBG] 9.3 scrub starts 2024-02-19T21:48:37.539 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:35.878943+0000 osd.1 (osd.1) 234 : cluster [DBG] 9.3 scrub ok 2024-02-19T21:48:37.539 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:35.860731+0000 osd.1 (osd.1) 233 : cluster [DBG] 9.3 scrub starts 2024-02-19T21:48:37.539 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:35.878943+0000 osd.1 (osd.1) 234 : cluster [DBG] 9.3 scrub ok 2024-02-19T21:48:37.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:35.860731+0000 osd.1 (osd.1) 233 : cluster [DBG] 9.3 scrub starts 2024-02-19T21:48:37.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:35.878943+0000 osd.1 (osd.1) 234 : cluster [DBG] 9.3 scrub ok 2024-02-19T21:48:37.964 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:48:37.964 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:48:38.252 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:37.138308+0000 mgr.y (mgr.14514) 612 : cluster [DBG] pgmap v785: 138 pgs: 6 active+clean+remapped, 83 active+clean, 33 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:38.252 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:37.617011+0000 mon.c (mon.2) 82 : audit [INF] from='client.? 172.21.15.80:0/2563790693' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T21:48:38.253 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:37.617324+0000 mon.a (mon.0) 1535 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T21:48:38.253 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:37.138308+0000 mgr.y (mgr.14514) 612 : cluster [DBG] pgmap v785: 138 pgs: 6 active+clean+remapped, 83 active+clean, 33 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:38.253 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:37.617011+0000 mon.c (mon.2) 82 : audit [INF] from='client.? 172.21.15.80:0/2563790693' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T21:48:38.253 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:37.617324+0000 mon.a (mon.0) 1535 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T21:48:38.461 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'unique_pool_2' removed 2024-02-19T21:48:38.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:37.138308+0000 mgr.y (mgr.14514) 612 : cluster [DBG] pgmap v785: 138 pgs: 6 active+clean+remapped, 83 active+clean, 33 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:38.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:37.617011+0000 mon.c (mon.2) 82 : audit [INF] from='client.? 172.21.15.80:0/2563790693' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T21:48:38.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:37.617324+0000 mon.a (mon.0) 1535 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T21:48:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: marking collection for removal 2024-02-19T21:48:38.821 INFO:teuthology.orchestra.run.smithi080.stdout:setting '_remove' omap key 2024-02-19T21:48:38.821 INFO:teuthology.orchestra.run.smithi080.stdout:finish_remove_pgs 2.16_head removing 2.16 2024-02-19T21:48:38.821 INFO:teuthology.orchestra.run.smithi080.stdout:Remove successful 2024-02-19T21:48:39.256 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-02-19T21:48:39.257 INFO:tasks.radosbench:Beginning radosbench... 2024-02-19T21:48:39.257 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_3 2024-02-19T21:48:39.257 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool create unique_pool_3 16 2024-02-19T21:48:39.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:37.788210+0000 osd.1 (osd.1) 235 : cluster [DBG] 2.4 scrub starts 2024-02-19T21:48:39.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:37.789393+0000 osd.1 (osd.1) 236 : cluster [DBG] 2.4 scrub ok 2024-02-19T21:48:39.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:38.212690+0000 mon.a (mon.0) 1536 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]': finished 2024-02-19T21:48:39.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:38.212763+0000 mon.a (mon.0) 1537 : cluster [DBG] osdmap e381: 8 total, 7 up, 7 in 2024-02-19T21:48:39.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:38.519426+0000 osd.4 (osd.4) 201 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:48:39.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:38.528969+0000 osd.4 (osd.4) 202 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:48:39.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:37.788210+0000 osd.1 (osd.1) 235 : cluster [DBG] 2.4 scrub starts 2024-02-19T21:48:39.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:37.789393+0000 osd.1 (osd.1) 236 : cluster [DBG] 2.4 scrub ok 2024-02-19T21:48:39.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:38.212690+0000 mon.a (mon.0) 1536 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]': finished 2024-02-19T21:48:39.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:38.212763+0000 mon.a (mon.0) 1537 : cluster [DBG] osdmap e381: 8 total, 7 up, 7 in 2024-02-19T21:48:39.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:38.519426+0000 osd.4 (osd.4) 201 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:48:39.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:38.528969+0000 osd.4 (osd.4) 202 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:48:39.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:37.788210+0000 osd.1 (osd.1) 235 : cluster [DBG] 2.4 scrub starts 2024-02-19T21:48:39.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:37.789393+0000 osd.1 (osd.1) 236 : cluster [DBG] 2.4 scrub ok 2024-02-19T21:48:39.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:38.212690+0000 mon.a (mon.0) 1536 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]': finished 2024-02-19T21:48:39.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:38.212763+0000 mon.a (mon.0) 1537 : cluster [DBG] osdmap e381: 8 total, 7 up, 7 in 2024-02-19T21:48:39.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:38.519426+0000 osd.4 (osd.4) 201 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:48:39.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:38.528969+0000 osd.4 (osd.4) 202 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:48:39.952 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -n osd.2 --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.2.16.2 2024-02-19T21:48:39.987 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:48:39.990 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:39.991 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:48:40.092 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:48:40.118 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:40.216 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:48:40.219 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:40.219 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:48:40.320 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:48:40.349 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:40.350 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/osd.2/config 2024-02-19T21:48:40.369 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:48:40.372 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:40.372 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:48:40.395 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:48:40.408 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:48:40.474 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:48:40.498 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:38.388517+0000 osd.6 (osd.6) 230 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:48:40.498 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:38.391428+0000 osd.6 (osd.6) 231 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:48:40.498 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:38.722036+0000 osd.5 (osd.5) 257 : cluster [DBG] 5.15 scrub starts 2024-02-19T21:48:40.498 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:38.723145+0000 osd.5 (osd.5) 258 : cluster [DBG] 5.15 scrub ok 2024-02-19T21:48:40.499 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:39.138920+0000 mgr.y (mgr.14514) 613 : cluster [DBG] pgmap v787: 122 pgs: 1 active+clean+remapped, 73 active+clean, 32 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 682 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:40.499 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:38.388517+0000 osd.6 (osd.6) 230 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:48:40.499 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:38.391428+0000 osd.6 (osd.6) 231 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:48:40.499 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:38.722036+0000 osd.5 (osd.5) 257 : cluster [DBG] 5.15 scrub starts 2024-02-19T21:48:40.499 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:38.723145+0000 osd.5 (osd.5) 258 : cluster [DBG] 5.15 scrub ok 2024-02-19T21:48:40.499 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:39.138920+0000 mgr.y (mgr.14514) 613 : cluster [DBG] pgmap v787: 122 pgs: 1 active+clean+remapped, 73 active+clean, 32 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 682 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:40.500 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:40.556 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 21:48:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T21:48:40+0000 lvl=info msg="Database locked, sleeping then retrying" logger=sqlstore error="database is locked" retry=0 2024-02-19T21:48:40.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:38.388517+0000 osd.6 (osd.6) 230 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:48:40.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:38.391428+0000 osd.6 (osd.6) 231 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:48:40.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:38.722036+0000 osd.5 (osd.5) 257 : cluster [DBG] 5.15 scrub starts 2024-02-19T21:48:40.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:38.723145+0000 osd.5 (osd.5) 258 : cluster [DBG] 5.15 scrub ok 2024-02-19T21:48:40.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:39.138920+0000 mgr.y (mgr.14514) 613 : cluster [DBG] pgmap v787: 122 pgs: 1 active+clean+remapped, 73 active+clean, 32 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 682 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:40.622 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:48:40.628 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:40.629 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:48:40.729 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:48:40.758 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:41.096 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:48:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:48:40] "GET /metrics HTTP/1.1" 200 176308 "" "Prometheus/2.33.4" 2024-02-19T21:48:41.237 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:48:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:48:41.247 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-02-19T21:48:41.505 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:39.376968+0000 osd.6 (osd.6) 232 : cluster [DBG] 4.11 deep-scrub starts 2024-02-19T21:48:41.505 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:39.382719+0000 osd.6 (osd.6) 233 : cluster [DBG] 4.11 deep-scrub ok 2024-02-19T21:48:41.505 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:40.237462+0000 mon.a (mon.0) 1538 : cluster [DBG] osdmap e382: 8 total, 7 up, 7 in 2024-02-19T21:48:41.505 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:40.498692+0000 osd.4 (osd.4) 203 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:48:41.506 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:40.527962+0000 osd.4 (osd.4) 204 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:48:41.506 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:40.536173+0000 mon.c (mon.2) 83 : audit [INF] from='client.? 172.21.15.80:0/258407093' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:48:41.506 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:40.536473+0000 mon.a (mon.0) 1539 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:48:41.506 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:40.670294+0000 mon.a (mon.0) 1540 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:48:41.506 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:40.833770+0000 mgr.y (mgr.14514) 614 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:48:41.506 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:39.376968+0000 osd.6 (osd.6) 232 : cluster [DBG] 4.11 deep-scrub starts 2024-02-19T21:48:41.506 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:39.382719+0000 osd.6 (osd.6) 233 : cluster [DBG] 4.11 deep-scrub ok 2024-02-19T21:48:41.506 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:40.237462+0000 mon.a (mon.0) 1538 : cluster [DBG] osdmap e382: 8 total, 7 up, 7 in 2024-02-19T21:48:41.506 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:40.498692+0000 osd.4 (osd.4) 203 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:48:41.506 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:40.527962+0000 osd.4 (osd.4) 204 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:48:41.506 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:40.536173+0000 mon.c (mon.2) 83 : audit [INF] from='client.? 172.21.15.80:0/258407093' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:48:41.507 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:40.536473+0000 mon.a (mon.0) 1539 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:48:41.507 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:40.670294+0000 mon.a (mon.0) 1540 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:48:41.507 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:40.833770+0000 mgr.y (mgr.14514) 614 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:48:41.508 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:48:41.510 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:41.511 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:48:41.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:39.376968+0000 osd.6 (osd.6) 232 : cluster [DBG] 4.11 deep-scrub starts 2024-02-19T21:48:41.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:39.382719+0000 osd.6 (osd.6) 233 : cluster [DBG] 4.11 deep-scrub ok 2024-02-19T21:48:41.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:40.237462+0000 mon.a (mon.0) 1538 : cluster [DBG] osdmap e382: 8 total, 7 up, 7 in 2024-02-19T21:48:41.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:40.498692+0000 osd.4 (osd.4) 203 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:48:41.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:40.527962+0000 osd.4 (osd.4) 204 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:48:41.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:40.536173+0000 mon.c (mon.2) 83 : audit [INF] from='client.? 172.21.15.80:0/258407093' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:48:41.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:40.536473+0000 mon.a (mon.0) 1539 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:48:41.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:40.670294+0000 mon.a (mon.0) 1540 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:48:41.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:40.833770+0000 mgr.y (mgr.14514) 614 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:48:41.612 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:48:41.638 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:41.657 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:48:41.659 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:41.660 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:48:41.761 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:48:41.789 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:42.045 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:48:42.048 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:42.048 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:48:42.149 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:48:42.177 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:42.197 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:48:42.199 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:42.200 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:48:42.301 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:48:42.327 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:42.338 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:41.139654+0000 mgr.y (mgr.14514) 615 : cluster [DBG] pgmap v789: 122 pgs: 1 active+clean+remapped, 73 active+clean, 32 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1.5 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:42.338 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:41.234322+0000 mon.a (mon.0) 1541 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:48:42.338 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:41.241721+0000 mon.a (mon.0) 1542 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:48:42.338 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:41.241786+0000 mon.a (mon.0) 1543 : cluster [DBG] osdmap e383: 8 total, 7 up, 7 in 2024-02-19T21:48:42.338 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:41.139654+0000 mgr.y (mgr.14514) 615 : cluster [DBG] pgmap v789: 122 pgs: 1 active+clean+remapped, 73 active+clean, 32 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1.5 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:42.338 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:41.234322+0000 mon.a (mon.0) 1541 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:48:42.338 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:41.241721+0000 mon.a (mon.0) 1542 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:48:42.339 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:41.241786+0000 mon.a (mon.0) 1543 : cluster [DBG] osdmap e383: 8 total, 7 up, 7 in 2024-02-19T21:48:42.346 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:48:42.348 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:42.349 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:48:42.450 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:48:42.474 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:41.139654+0000 mgr.y (mgr.14514) 615 : cluster [DBG] pgmap v789: 122 pgs: 1 active+clean+remapped, 73 active+clean, 32 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1.5 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:42.475 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:41.234322+0000 mon.a (mon.0) 1541 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:48:42.475 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:41.241721+0000 mon.a (mon.0) 1542 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:48:42.475 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:41.241786+0000 mon.a (mon.0) 1543 : cluster [DBG] osdmap e383: 8 total, 7 up, 7 in 2024-02-19T21:48:42.476 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:42.495 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:48:42.497 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:42.498 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:48:42.599 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:48:42.626 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:42.726 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:48:42.728 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:42.728 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:48:42.829 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:48:42.857 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:42.875 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:48:42.878 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:42.879 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:48:42.980 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:48:43.007 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:43.025 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:48:43.028 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:43.028 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:48:43.129 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:48:43.157 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:43.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:41.751800+0000 osd.1 (osd.1) 237 : cluster [DBG] 2.a scrub starts 2024-02-19T21:48:43.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:41.751800+0000 osd.1 (osd.1) 237 : cluster [DBG] 2.a scrub starts 2024-02-19T21:48:43.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:41.751800+0000 osd.1 (osd.1) 237 : cluster [DBG] 2.a scrub starts 2024-02-19T21:48:44.429 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:43.140073+0000 mgr.y (mgr.14514) 616 : cluster [DBG] pgmap v791: 122 pgs: 1 active+clean+remapped, 73 active+clean, 32 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 682 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:44.430 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:43.140073+0000 mgr.y (mgr.14514) 616 : cluster [DBG] pgmap v791: 122 pgs: 1 active+clean+remapped, 73 active+clean, 32 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 682 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:44.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:43.140073+0000 mgr.y (mgr.14514) 616 : cluster [DBG] pgmap v791: 122 pgs: 1 active+clean+remapped, 73 active+clean, 32 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 682 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:44.707 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:48:44.712 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:44.713 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:48:44.728 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-19T21:48:44.814 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:48:44.841 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:45.592 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.3 dump_blocked_ops 2024-02-19T21:48:45.692 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:48:45.694 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:45.695 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:48:45.795 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:48:45.823 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:45.841 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:48:45.843 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:45.844 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:48:45.945 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:48:45.975 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:46.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:48:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:48:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:48:46.112 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:48:46.113 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:48:46.117 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:48:46.123 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:48:46.126 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:46.126 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:48:46.135 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:48:46.154 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:48:46.172 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:48:46.189 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:48:46.190 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:48:46.190 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:48:46.190 INFO:teuthology.orchestra.run.smithi080.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-02-19T21:48:46.190 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:48:46.190 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:48:46.190 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:48:46.190 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:48:46.190 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:48:46.227 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:48:46.253 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:45.238418+0000 mon.a (mon.0) 1544 : cluster [DBG] osdmap e384: 8 total, 7 up, 7 in 2024-02-19T21:48:46.254 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:46.262 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:48:46.273 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:48:46.275 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:46.276 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:48:46.376 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:48:46.403 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:46.421 INFO:teuthology.orchestra.run.smithi080.stdout:get_pg_num_history pg_num_history pg_num_history(e369 pg_nums {1={19=1},2={58=32},3={58=3},4={60=32},5={62=32,260=31,264=30,270=29,274=28,278=27,282=26,286=25,290=24,294=23,298=22},6={64=32,207=31,211=30,215=29,220=28,223=27,227=26,231=25,235=24,239=23,243=22,302=32},8={165=16},9={268=16}} deleted_pools 258,8) 2024-02-19T21:48:46.421 INFO:teuthology.orchestra.run.smithi080.stdout:Importing pgid 2.16 2024-02-19T21:48:46.421 INFO:teuthology.orchestra.run.smithi080.stdout:write_pg epoch 348 info 2.16( empty local-lis/les=347/348 n=0 ec=58/58 lis/c=347/347 les/c/f=348/348/0 sis=347) 2024-02-19T21:48:46.421 INFO:teuthology.orchestra.run.smithi080.stdout:Import successful 2024-02-19T21:48:46.423 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:48:46.425 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:46.426 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:48:46.527 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:48:46.553 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:45.763052+0000 mon.a (mon.0) 1545 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:48:46.553 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:45.238418+0000 mon.a (mon.0) 1544 : cluster [DBG] osdmap e384: 8 total, 7 up, 7 in 2024-02-19T21:48:46.553 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:45.763052+0000 mon.a (mon.0) 1545 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:48:46.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:45.238418+0000 mon.a (mon.0) 1544 : cluster [DBG] osdmap e384: 8 total, 7 up, 7 in 2024-02-19T21:48:46.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:45.763052+0000 mon.a (mon.0) 1545 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:48:46.556 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:46.770 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'unique_pool_3' created 2024-02-19T21:48:47.010 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-02-19T21:48:47.011 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-02-19T21:48:47.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:45.140616+0000 mgr.y (mgr.14514) 617 : cluster [DBG] pgmap v792: 122 pgs: 1 active+clean+remapped, 73 active+clean, 32 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 738 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:47.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:45.999883+0000 mon.c (mon.2) 84 : audit [INF] from='client.? 172.21.15.80:0/3780554570' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]: dispatch 2024-02-19T21:48:47.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:46.000210+0000 mon.a (mon.0) 1546 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]: dispatch 2024-02-19T21:48:47.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:46.064844+0000 mon.b (mon.1) 63 : audit [DBG] from='client.? 172.21.15.80:0/3427175412' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:48:47.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:46.763600+0000 mon.a (mon.0) 1547 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]': finished 2024-02-19T21:48:47.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:46.763656+0000 mon.a (mon.0) 1548 : cluster [DBG] osdmap e385: 8 total, 7 up, 7 in 2024-02-19T21:48:47.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:45.140616+0000 mgr.y (mgr.14514) 617 : cluster [DBG] pgmap v792: 122 pgs: 1 active+clean+remapped, 73 active+clean, 32 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 738 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:47.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:45.999883+0000 mon.c (mon.2) 84 : audit [INF] from='client.? 172.21.15.80:0/3780554570' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]: dispatch 2024-02-19T21:48:47.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:46.000210+0000 mon.a (mon.0) 1546 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]: dispatch 2024-02-19T21:48:47.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:46.064844+0000 mon.b (mon.1) 63 : audit [DBG] from='client.? 172.21.15.80:0/3427175412' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:48:47.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:46.763600+0000 mon.a (mon.0) 1547 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]': finished 2024-02-19T21:48:47.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:46.763656+0000 mon.a (mon.0) 1548 : cluster [DBG] osdmap e385: 8 total, 7 up, 7 in 2024-02-19T21:48:47.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:45.140616+0000 mgr.y (mgr.14514) 617 : cluster [DBG] pgmap v792: 122 pgs: 1 active+clean+remapped, 73 active+clean, 32 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 738 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:47.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:45.999883+0000 mon.c (mon.2) 84 : audit [INF] from='client.? 172.21.15.80:0/3780554570' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]: dispatch 2024-02-19T21:48:47.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:46.000210+0000 mon.a (mon.0) 1546 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]: dispatch 2024-02-19T21:48:47.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:46.064844+0000 mon.b (mon.1) 63 : audit [DBG] from='client.? 172.21.15.80:0/3427175412' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:48:47.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:46.763600+0000 mon.a (mon.0) 1547 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]': finished 2024-02-19T21:48:47.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:46.763656+0000 mon.a (mon.0) 1548 : cluster [DBG] osdmap e385: 8 total, 7 up, 7 in 2024-02-19T21:48:47.807 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:48:47.808 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f /var/log/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/exp.2.16.2 2024-02-19T21:48:47.810 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:47.811 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:48:47.912 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:48:47.938 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:48.040 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:48:48.044 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:48.044 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:48:48.145 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:48:48.174 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:48.297 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:48:48.300 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:48.300 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:48:48.401 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:48:48.429 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:49.012 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:48:49.037 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:47.141230+0000 mgr.y (mgr.14514) 618 : cluster [DBG] pgmap v795: 138 pgs: 16 unknown, 1 active+clean+remapped, 73 active+clean, 32 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 853 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:49.038 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:47.768105+0000 mon.a (mon.0) 1549 : cluster [DBG] osdmap e386: 8 total, 7 up, 7 in 2024-02-19T21:48:49.038 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:47.905887+0000 mon.a (mon.0) 1550 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:48:49.038 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:47.906510+0000 mon.a (mon.0) 1551 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:48:49.038 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:47.910436+0000 mon.a (mon.0) 1552 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:48:49.038 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:47.141230+0000 mgr.y (mgr.14514) 618 : cluster [DBG] pgmap v795: 138 pgs: 16 unknown, 1 active+clean+remapped, 73 active+clean, 32 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 853 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:49.038 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:47.768105+0000 mon.a (mon.0) 1549 : cluster [DBG] osdmap e386: 8 total, 7 up, 7 in 2024-02-19T21:48:49.038 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:47.905887+0000 mon.a (mon.0) 1550 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:48:49.038 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:47.906510+0000 mon.a (mon.0) 1551 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:48:49.038 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:47.910436+0000 mon.a (mon.0) 1552 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:48:49.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:47.141230+0000 mgr.y (mgr.14514) 618 : cluster [DBG] pgmap v795: 138 pgs: 16 unknown, 1 active+clean+remapped, 73 active+clean, 32 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 853 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:49.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:47.768105+0000 mon.a (mon.0) 1549 : cluster [DBG] osdmap e386: 8 total, 7 up, 7 in 2024-02-19T21:48:49.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:47.905887+0000 mon.a (mon.0) 1550 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:48:49.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:47.906510+0000 mon.a (mon.0) 1551 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:48:49.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:47.910436+0000 mon.a (mon.0) 1552 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:48:49.467 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool application enable unique_pool_3 rados --yes-i-really-mean-it || true 2024-02-19T21:48:49.478 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:48:49.480 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:48:49.482 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:49.483 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:48:49.584 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:48:49.611 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:49.629 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:48:49.632 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:49.632 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:48:49.733 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:48:49.759 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:49.778 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:48:49.780 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:49.781 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:48:49.882 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:48:49.910 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:49.948 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:48:49.950 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:48.769356+0000 mon.a (mon.0) 1553 : cluster [DBG] osdmap e387: 8 total, 7 up, 7 in 2024-02-19T21:48:49.950 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:48.961637+0000 mon.a (mon.0) 1554 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:48:49.950 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:48.769356+0000 mon.a (mon.0) 1553 : cluster [DBG] osdmap e387: 8 total, 7 up, 7 in 2024-02-19T21:48:49.950 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:48.961637+0000 mon.a (mon.0) 1554 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:48:49.951 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:49.951 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:48:50.052 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:48:50.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:48.769356+0000 mon.a (mon.0) 1553 : cluster [DBG] osdmap e387: 8 total, 7 up, 7 in 2024-02-19T21:48:50.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:48.961637+0000 mon.a (mon.0) 1554 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:48:50.080 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:50.099 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:48:50.101 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:50.102 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:48:50.202 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:48:50.230 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:50.254 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:48:50.257 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:50.257 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:48:50.358 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:48:50.388 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:50.591 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:48:50.594 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:50.595 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:48:50.696 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:48:50.722 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:50.741 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:48:50.743 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:50.744 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:48:50.845 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:48:50.846 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:48:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:48:50] "GET /metrics HTTP/1.1" 200 176425 "" "Prometheus/2.33.4" 2024-02-19T21:48:50.873 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:51.056 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:48:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:48:51.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:49.141740+0000 mgr.y (mgr.14514) 619 : cluster [DBG] pgmap v798: 138 pgs: 16 unknown, 1 active+clean+remapped, 73 active+clean, 32 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:51.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:50.240674+0000 mon.a (mon.0) 1555 : cluster [DBG] osdmap e388: 8 total, 7 up, 7 in 2024-02-19T21:48:51.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:50.402789+0000 mon.c (mon.2) 85 : audit [INF] from='client.? 172.21.15.80:0/52808787' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:48:51.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:50.403188+0000 mon.a (mon.0) 1556 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:48:51.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:49.141740+0000 mgr.y (mgr.14514) 619 : cluster [DBG] pgmap v798: 138 pgs: 16 unknown, 1 active+clean+remapped, 73 active+clean, 32 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:51.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:50.240674+0000 mon.a (mon.0) 1555 : cluster [DBG] osdmap e388: 8 total, 7 up, 7 in 2024-02-19T21:48:51.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:50.402789+0000 mon.c (mon.2) 85 : audit [INF] from='client.? 172.21.15.80:0/52808787' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:48:51.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:50.403188+0000 mon.a (mon.0) 1556 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:48:51.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:49.141740+0000 mgr.y (mgr.14514) 619 : cluster [DBG] pgmap v798: 138 pgs: 16 unknown, 1 active+clean+remapped, 73 active+clean, 32 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1.2 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:51.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:50.240674+0000 mon.a (mon.0) 1555 : cluster [DBG] osdmap e388: 8 total, 7 up, 7 in 2024-02-19T21:48:51.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:50.402789+0000 mon.c (mon.2) 85 : audit [INF] from='client.? 172.21.15.80:0/52808787' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:48:51.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:50.403188+0000 mon.a (mon.0) 1556 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:48:51.144 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:48:51.158 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:48:51.251 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-02-19T21:48:52.023 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:48:52.043 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:52.044 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:48:52.144 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:48:52.162 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:48:52.162 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-02-19T21:48:52.162 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-02-19T21:48:52.162 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-02-19T21:48:52.162 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:48:52.173 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:52.193 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:48:52.196 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:52.197 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:48:52.297 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:48:52.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:50.844683+0000 mgr.y (mgr.14514) 620 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:48:52.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:51.237994+0000 mon.a (mon.0) 1557 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:48:52.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:51.243951+0000 mon.a (mon.0) 1558 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:48:52.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:51.243997+0000 mon.a (mon.0) 1559 : cluster [DBG] osdmap e389: 8 total, 7 up, 7 in 2024-02-19T21:48:52.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:50.844683+0000 mgr.y (mgr.14514) 620 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:48:52.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:51.237994+0000 mon.a (mon.0) 1557 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:48:52.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:51.243951+0000 mon.a (mon.0) 1558 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:48:52.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:51.243997+0000 mon.a (mon.0) 1559 : cluster [DBG] osdmap e389: 8 total, 7 up, 7 in 2024-02-19T21:48:52.325 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:50.844683+0000 mgr.y (mgr.14514) 620 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:48:52.325 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:51.237994+0000 mon.a (mon.0) 1557 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:48:52.325 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:51.243951+0000 mon.a (mon.0) 1558 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:48:52.325 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:51.243997+0000 mon.a (mon.0) 1559 : cluster [DBG] osdmap e389: 8 total, 7 up, 7 in 2024-02-19T21:48:52.327 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:52.355 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:48:52.357 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:52.358 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:48:52.458 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:48:52.487 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:52.508 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:48:52.510 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:52.511 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:48:52.611 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:48:52.639 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:52.661 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:48:52.664 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:52.664 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:48:52.765 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:48:52.794 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:52.814 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:48:52.817 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:52.818 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:48:52.842 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 4, 5, 6, 7, 2] out_osds: [3] dead_osds: [2] live_osds: [0, 1, 3, 4, 5, 6, 7] 2024-02-19T21:48:52.842 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2024-02-19T21:48:52.842 INFO:tasks.cephadm.osd.2:Restarting osd.2 (starting--it wasn't running)... 2024-02-19T21:48:52.842 DEBUG:teuthology.orchestra.run.smithi080:osd.2> sudo journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.2.service 2024-02-19T21:48:52.845 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl start ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.2 2024-02-19T21:48:52.876 INFO:journalctl@ceph.osd.2.smithi080.stdout:-- Logs begin at Mon 2024-02-19 21:10:15 UTC. -- 2024-02-19T21:48:52.918 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:48:52.946 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:52.966 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:48:52.969 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:52.970 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:48:53.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:51.142339+0000 mgr.y (mgr.14514) 621 : cluster [DBG] pgmap v800: 138 pgs: 1 active+clean+remapped, 82 active+clean, 39 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1.1 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:53.070 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:48:53.098 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:53.117 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:48:53.119 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:53.120 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:48:53.221 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:48:53.246 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 21:48:52 smithi080 systemd[1]: Starting Ceph osd.2 for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T21:48:53.246 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:51.142339+0000 mgr.y (mgr.14514) 621 : cluster [DBG] pgmap v800: 138 pgs: 1 active+clean+remapped, 82 active+clean, 39 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1.1 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:53.247 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:51.142339+0000 mgr.y (mgr.14514) 621 : cluster [DBG] pgmap v800: 138 pgs: 1 active+clean+remapped, 82 active+clean, 39 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1.1 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:53.250 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:53.271 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:48:53.274 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:53.275 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:48:53.294 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.3 dump_historic_ops 2024-02-19T21:48:53.376 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:48:53.404 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:53.424 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:48:53.427 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:53.428 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:48:53.528 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:48:53.558 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:53.580 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:48:53.583 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:53.584 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:48:53.685 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:48:53.713 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:53.733 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:48:53.735 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:53.736 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:48:53.836 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:48:53.864 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:53.882 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:48:53.885 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:53.885 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:48:53.986 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:48:54.013 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:54.033 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:48:54.035 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:54.036 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:48:54.137 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:48:54.163 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:54.182 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:48:54.184 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:54.185 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:48:54.286 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:48:54.319 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:54.675 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset noscrub 2024-02-19T21:48:55.136 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:48:55.145 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:48:55.156 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:48:55.171 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:48:55.174 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:55.174 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:48:55.183 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:48:55.204 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:48:55.222 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:48:55.242 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:48:55.260 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:48:55.260 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:48:55.261 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:48:55.261 INFO:teuthology.orchestra.run.smithi080.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-02-19T21:48:55.261 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:48:55.261 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:48:55.261 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:48:55.261 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:48:55.261 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:48:55.274 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:53.142750+0000 mgr.y (mgr.14514) 622 : cluster [DBG] pgmap v802: 138 pgs: 1 active+clean+remapped, 82 active+clean, 39 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 952 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:55.274 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:53.142750+0000 mgr.y (mgr.14514) 622 : cluster [DBG] pgmap v802: 138 pgs: 1 active+clean+remapped, 82 active+clean, 39 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 952 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:55.275 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:48:55.304 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:55.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:53.142750+0000 mgr.y (mgr.14514) 622 : cluster [DBG] pgmap v802: 138 pgs: 1 active+clean+remapped, 82 active+clean, 39 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 952 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:55.977 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:48:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:48:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:48:56.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:55.117421+0000 mon.a (mon.0) 1560 : audit [DBG] from='client.? 172.21.15.80:0/1865389494' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:48:56.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:55.241274+0000 mon.a (mon.0) 1561 : cluster [DBG] osdmap e390: 8 total, 7 up, 7 in 2024-02-19T21:48:56.345 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:55.117421+0000 mon.a (mon.0) 1560 : audit [DBG] from='client.? 172.21.15.80:0/1865389494' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:48:56.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:55.241274+0000 mon.a (mon.0) 1561 : cluster [DBG] osdmap e390: 8 total, 7 up, 7 in 2024-02-19T21:48:56.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:55.117421+0000 mon.a (mon.0) 1560 : audit [DBG] from='client.? 172.21.15.80:0/1865389494' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:48:56.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:55.241274+0000 mon.a (mon.0) 1561 : cluster [DBG] osdmap e390: 8 total, 7 up, 7 in 2024-02-19T21:48:57.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:55.143341+0000 mgr.y (mgr.14514) 623 : cluster [DBG] pgmap v803: 138 pgs: 1 active+clean+remapped, 82 active+clean, 39 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 803 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:57.331 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:55.143341+0000 mgr.y (mgr.14514) 623 : cluster [DBG] pgmap v803: 138 pgs: 1 active+clean+remapped, 82 active+clean, 39 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 803 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:57.331 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:55.143341+0000 mgr.y (mgr.14514) 623 : cluster [DBG] pgmap v803: 138 pgs: 1 active+clean+remapped, 82 active+clean, 39 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 803 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:57.355 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:48:57.359 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:57.359 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:48:57.460 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:48:57.492 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:57.513 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:48:57.516 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:57.517 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:48:57.618 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:48:57.652 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:57.804 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:48:57.807 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:57.807 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:48:57.908 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:48:57.940 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:57.961 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:48:57.964 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:57.964 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:48:58.065 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:48:58.095 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:58.116 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:48:58.118 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:58.119 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:48:58.219 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:48:58.252 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:58.346 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 21:48:58 smithi080 bash[152691]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-19T21:48:58.346 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 21:48:58 smithi080 bash[152691]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-19T21:48:58.346 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 21:48:58 smithi080 bash[152691]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2024-02-19T21:48:58.346 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 21:48:58 smithi080 bash[152691]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-19T21:48:58.346 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 21:48:58 smithi080 bash[152691]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2024-02-19T21:48:58.346 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 21:48:58 smithi080 bash[152691]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-19T21:48:58.346 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 21:48:58 smithi080 bash[152691]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-19T21:48:58.346 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 21:48:58 smithi080 bash[152691]: --> ceph-volume lvm activate successful for osd ID: 2 2024-02-19T21:48:58.350 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:48:58.353 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:58.353 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:48:58.454 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:48:58.485 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:58.506 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:48:58.509 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:58.510 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:48:58.610 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:48:58.638 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:58.711 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:48:58.713 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:58.714 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:48:58.814 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:48:58.843 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:58.967 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:48:58.976 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:48:58.977 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:48:58.992 INFO:teuthology.orchestra.run.smithi080.stderr:enabled application 'rados' on pool 'unique_pool_3' 2024-02-19T21:48:59.078 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:48:59.106 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:48:59.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:57.143910+0000 mgr.y (mgr.14514) 624 : cluster [DBG] pgmap v805: 138 pgs: 1 active+clean+remapped, 82 active+clean, 39 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 741 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:59.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:58.115403+0000 mon.c (mon.2) 86 : audit [INF] from='client.? 172.21.15.80:0/188554464' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T21:48:59.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:58.115739+0000 mon.a (mon.0) 1562 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T21:48:59.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:57.143910+0000 mgr.y (mgr.14514) 624 : cluster [DBG] pgmap v805: 138 pgs: 1 active+clean+remapped, 82 active+clean, 39 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 741 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:59.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:58.115403+0000 mon.c (mon.2) 86 : audit [INF] from='client.? 172.21.15.80:0/188554464' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T21:48:59.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:58.115739+0000 mon.a (mon.0) 1562 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T21:48:59.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:57.143910+0000 mgr.y (mgr.14514) 624 : cluster [DBG] pgmap v805: 138 pgs: 1 active+clean+remapped, 82 active+clean, 39 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 741 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:48:59.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:58.115403+0000 mon.c (mon.2) 86 : audit [INF] from='client.? 172.21.15.80:0/188554464' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T21:48:59.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:48:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:58.115739+0000 mon.a (mon.0) 1562 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T21:48:59.593 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:49:00.009 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-02-19T21:49:00.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:58.176903+0000 osd.4 (osd.4) 205 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:49:00.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:58.176955+0000 osd.4 (osd.4) 206 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:49:00.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:58.989506+0000 mon.a (mon.0) 1563 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-19T21:49:00.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:58.989586+0000 mon.a (mon.0) 1564 : cluster [DBG] osdmap e391: 8 total, 7 up, 7 in 2024-02-19T21:49:00.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:59.006165+0000 mon.c (mon.2) 87 : audit [INF] from='client.? 172.21.15.80:0/3896343734' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:49:00.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:48:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:48:59.006445+0000 mon.a (mon.0) 1565 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:49:00.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:58.176903+0000 osd.4 (osd.4) 205 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:49:00.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:58.176955+0000 osd.4 (osd.4) 206 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:49:00.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:58.989506+0000 mon.a (mon.0) 1563 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-19T21:49:00.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:58.989586+0000 mon.a (mon.0) 1564 : cluster [DBG] osdmap e391: 8 total, 7 up, 7 in 2024-02-19T21:49:00.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:59.006165+0000 mon.c (mon.2) 87 : audit [INF] from='client.? 172.21.15.80:0/3896343734' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:49:00.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:48:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:48:59.006445+0000 mon.a (mon.0) 1565 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:49:00.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:58.176903+0000 osd.4 (osd.4) 205 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:49:00.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:58.176955+0000 osd.4 (osd.4) 206 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:49:00.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:58.989506+0000 mon.a (mon.0) 1563 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-19T21:49:00.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:58.989586+0000 mon.a (mon.0) 1564 : cluster [DBG] osdmap e391: 8 total, 7 up, 7 in 2024-02-19T21:49:00.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:59.006165+0000 mon.c (mon.2) 87 : audit [INF] from='client.? 172.21.15.80:0/3896343734' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:49:00.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:48:59.006445+0000 mon.a (mon.0) 1565 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:49:00.846 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:49:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:49:00] "GET /metrics HTTP/1.1" 200 176425 "" "Prometheus/2.33.4" 2024-02-19T21:49:01.222 DEBUG:teuthology.orchestra.run.smithi080:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_3 bench 90 write' 2024-02-19T21:49:01.225 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-02-19T21:49:01.225 INFO:teuthology.orchestra.run:waiting for 3000 2024-02-19T21:49:01.272 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:hints = 1 2024-02-19T21:49:01.272 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-02-19T21:49:01.272 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Object prefix: benchmark_data_smithi080_153340 2024-02-19T21:49:01.272 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-19T21:49:01.272 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 0 0 0 0 0 0 - 0 2024-02-19T21:49:01.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:59.144401+0000 mgr.y (mgr.14514) 625 : cluster [DBG] pgmap v807: 138 pgs: 1 active+clean+remapped, 82 active+clean, 39 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 647 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:49:01.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:48:59.993752+0000 mon.a (mon.0) 1566 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:49:01.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:00.001306+0000 mon.a (mon.0) 1567 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:49:01.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:00.001363+0000 mon.a (mon.0) 1568 : cluster [DBG] osdmap e392: 8 total, 7 up, 7 in 2024-02-19T21:49:01.308 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:49:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:49:01.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:59.144401+0000 mgr.y (mgr.14514) 625 : cluster [DBG] pgmap v807: 138 pgs: 1 active+clean+remapped, 82 active+clean, 39 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 647 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:49:01.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:48:59.993752+0000 mon.a (mon.0) 1566 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:49:01.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:00.001306+0000 mon.a (mon.0) 1567 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:49:01.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:00.001363+0000 mon.a (mon.0) 1568 : cluster [DBG] osdmap e392: 8 total, 7 up, 7 in 2024-02-19T21:49:01.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:59.144401+0000 mgr.y (mgr.14514) 625 : cluster [DBG] pgmap v807: 138 pgs: 1 active+clean+remapped, 82 active+clean, 39 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 647 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:49:01.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:48:59.993752+0000 mon.a (mon.0) 1566 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:49:01.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:00.001306+0000 mon.a (mon.0) 1567 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:49:01.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:00.001363+0000 mon.a (mon.0) 1568 : cluster [DBG] osdmap e392: 8 total, 7 up, 7 in 2024-02-19T21:49:01.441 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-02-19T21:49:01.441 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-02-19T21:49:02.167 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 21:49:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-2[153400]: debug 2024-02-19T21:49:02.069+0000 7f158ce80700 1 -- 172.21.15.80:0/948327007 <== mon.0 v2:172.21.15.80:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ca822c4680 con 0x55ca8228b800 2024-02-19T21:49:02.167 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:00.855793+0000 mgr.y (mgr.14514) 626 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:49:02.168 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:01.009660+0000 osd.0 (osd.0) 258 : cluster [DBG] 5.3 scrub starts 2024-02-19T21:49:02.168 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:01.011072+0000 osd.0 (osd.0) 259 : cluster [DBG] 5.3 scrub ok 2024-02-19T21:49:02.168 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:00.855793+0000 mgr.y (mgr.14514) 626 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:49:02.168 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:01.009660+0000 osd.0 (osd.0) 258 : cluster [DBG] 5.3 scrub starts 2024-02-19T21:49:02.168 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:01.011072+0000 osd.0 (osd.0) 259 : cluster [DBG] 5.3 scrub ok 2024-02-19T21:49:02.272 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 1 16 3888 3872 241.987 242 0.00227362 0.00411972 2024-02-19T21:49:02.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:00.855793+0000 mgr.y (mgr.14514) 626 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:49:02.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:01.009660+0000 osd.0 (osd.0) 258 : cluster [DBG] 5.3 scrub starts 2024-02-19T21:49:02.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:01.011072+0000 osd.0 (osd.0) 259 : cluster [DBG] 5.3 scrub ok 2024-02-19T21:49:02.491 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:49:02.495 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:02.496 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:49:02.597 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:49:02.645 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:02.679 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:49:02.681 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:02.681 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.2 dump_ops_in_flight 2024-02-19T21:49:02.682 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:49:02.757 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 21:49:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-2[153400]: debug 2024-02-19T21:49:02.600+0000 7f159490e380 -1 Falling back to public interface 2024-02-19T21:49:02.757 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 21:49:02 smithi080 bash[153385]: 631053fcc5be7466f0eb5561f6065c9fde85e17549049989f0d02ebbeb80b995 2024-02-19T21:49:02.757 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 21:49:02 smithi080 systemd[1]: Started Ceph osd.2 for 6f763558-cf6d-11ee-95bb-87774f69a715. 2024-02-19T21:49:02.783 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:49:02.822 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:02.936 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-19T21:49:03.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:01.145130+0000 mgr.y (mgr.14514) 627 : cluster [DBG] pgmap v809: 138 pgs: 1 active+clean+remapped, 82 active+clean, 39 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1.7 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:49:03.272 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 2 16 7405 7389 230.891 219.812 0.00425774 0.00432216 2024-02-19T21:49:03.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:01.145130+0000 mgr.y (mgr.14514) 627 : cluster [DBG] pgmap v809: 138 pgs: 1 active+clean+remapped, 82 active+clean, 39 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1.7 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:49:03.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:01.145130+0000 mgr.y (mgr.14514) 627 : cluster [DBG] pgmap v809: 138 pgs: 1 active+clean+remapped, 82 active+clean, 39 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 1.7 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:49:03.442 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:49:04.210 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:49:04.213 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:04.214 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:49:04.272 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 3 16 10630 10614 221.071 201.562 0.00471168 0.00451806 2024-02-19T21:49:04.314 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:49:04.352 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:04.377 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:49:04.379 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:04.380 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:49:04.481 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:49:04.518 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:04.552 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:49:04.556 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:04.556 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:49:04.657 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:49:04.714 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:04.744 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:49:04.747 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:04.748 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:49:04.830 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:49:04.848 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:49:04.848 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:49:04.874 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:49:04.874 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:49:04.883 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:04.913 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:49:04.918 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:04.919 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:49:05.019 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:49:05.025 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:03.145604+0000 mgr.y (mgr.14514) 628 : cluster [DBG] pgmap v810: 138 pgs: 1 active+clean+remapped, 82 active+clean, 39 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 647 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:49:05.025 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:03.986003+0000 osd.1 (osd.1) 238 : cluster [DBG] 2.a scrub starts 2024-02-19T21:49:05.059 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:05.090 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:49:05.094 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:05.094 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:49:05.172 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:03.145604+0000 mgr.y (mgr.14514) 628 : cluster [DBG] pgmap v810: 138 pgs: 1 active+clean+remapped, 82 active+clean, 39 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 647 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:49:05.172 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:03.986003+0000 osd.1 (osd.1) 238 : cluster [DBG] 2.a scrub starts 2024-02-19T21:49:05.172 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:03.987742+0000 osd.1 (osd.1) 239 : cluster [DBG] 2.a scrub ok 2024-02-19T21:49:05.172 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:04.310856+0000 osd.6 (osd.6) 234 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:49:05.172 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:03.145604+0000 mgr.y (mgr.14514) 628 : cluster [DBG] pgmap v810: 138 pgs: 1 active+clean+remapped, 82 active+clean, 39 active+undersized, 16 active+undersized+degraded; 5.7 KiB data, 3.7 GiB used, 622 GiB / 626 GiB avail; 647 B/s rd, 0 op/s; 71/576 objects degraded (12.326%); 1/576 objects misplaced (0.174%) 2024-02-19T21:49:05.172 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:03.986003+0000 osd.1 (osd.1) 238 : cluster [DBG] 2.a scrub starts 2024-02-19T21:49:05.172 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:03.987742+0000 osd.1 (osd.1) 239 : cluster [DBG] 2.a scrub ok 2024-02-19T21:49:05.172 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:04.310856+0000 osd.6 (osd.6) 234 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:49:05.195 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:49:05.239 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:05.273 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 4 15 13154 13139 205.255 157.812 0.020877 0.00486856 2024-02-19T21:49:05.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:03.987742+0000 osd.1 (osd.1) 239 : cluster [DBG] 2.a scrub ok 2024-02-19T21:49:05.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:04.310856+0000 osd.6 (osd.6) 234 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:49:05.704 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:49:05.715 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:05.715 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:49:05.816 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:49:05.858 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:05.891 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:49:05.894 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:49:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:49:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:49:05.895 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:05.896 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:49:05.997 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:49:06.043 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:06.073 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:49:06.078 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:06.079 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:49:06.096 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 21:49:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-2[153400]: debug 2024-02-19T21:49:05.918+0000 7f159490e380 -1 osd.2 369 log_to_monitors {default=true} 2024-02-19T21:49:06.179 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:49:06.220 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:06.248 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:49:06.254 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:06.255 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:49:06.272 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 5 16 15621 15605 195.028 154.125 0.0146817 0.005116 2024-02-19T21:49:06.280 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.4 dump_ops_in_flight 2024-02-19T21:49:06.291 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:04.432727+0000 osd.6 (osd.6) 235 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:49:06.291 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:05.009927+0000 osd.1 (osd.1) 240 : cluster [DBG] 2.15 scrub starts 2024-02-19T21:49:06.291 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:05.012391+0000 osd.1 (osd.1) 241 : cluster [DBG] 2.15 scrub ok 2024-02-19T21:49:06.291 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:05.146614+0000 mgr.y (mgr.14514) 629 : cluster [DBG] pgmap v811: 138 pgs: 1 active+clean+remapped, 82 active+clean, 35 active+undersized, 20 active+undersized+degraded; 486 MiB data, 4.4 GiB used, 621 GiB / 626 GiB avail; 639 B/s rd, 61 MiB/s wr, 971 op/s; 3186/23886 objects degraded (13.338%); 1/23886 objects misplaced (0.004%) 2024-02-19T21:49:06.291 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:05.926588+0000 mon.c (mon.2) 88 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/2441376667,v1:172.21.15.80:6819/2441376667]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-19T21:49:06.292 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:05.927129+0000 mon.a (mon.0) 1569 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-19T21:49:06.292 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:06.021417+0000 mon.a (mon.0) 1570 : cluster [WRN] Health check update: Degraded data redundancy: 3186/23886 objects degraded (13.338%), 20 pgs degraded, 48 pgs undersized (PG_DEGRADED) 2024-02-19T21:49:06.356 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:49:06.384 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:06.596 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 21:49:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-2[153400]: debug 2024-02-19T21:49:06.295+0000 7f15875f8700 -1 osd.2 369 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T21:49:06.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:04.432727+0000 osd.6 (osd.6) 235 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:49:06.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:05.009927+0000 osd.1 (osd.1) 240 : cluster [DBG] 2.15 scrub starts 2024-02-19T21:49:06.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:05.012391+0000 osd.1 (osd.1) 241 : cluster [DBG] 2.15 scrub ok 2024-02-19T21:49:06.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:05.146614+0000 mgr.y (mgr.14514) 629 : cluster [DBG] pgmap v811: 138 pgs: 1 active+clean+remapped, 82 active+clean, 35 active+undersized, 20 active+undersized+degraded; 486 MiB data, 4.4 GiB used, 621 GiB / 626 GiB avail; 639 B/s rd, 61 MiB/s wr, 971 op/s; 3186/23886 objects degraded (13.338%); 1/23886 objects misplaced (0.004%) 2024-02-19T21:49:06.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:05.926588+0000 mon.c (mon.2) 88 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/2441376667,v1:172.21.15.80:6819/2441376667]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-19T21:49:06.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:05.927129+0000 mon.a (mon.0) 1569 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-19T21:49:06.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:06.021417+0000 mon.a (mon.0) 1570 : cluster [WRN] Health check update: Degraded data redundancy: 3186/23886 objects degraded (13.338%), 20 pgs degraded, 48 pgs undersized (PG_DEGRADED) 2024-02-19T21:49:06.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:04.432727+0000 osd.6 (osd.6) 235 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:49:06.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:05.009927+0000 osd.1 (osd.1) 240 : cluster [DBG] 2.15 scrub starts 2024-02-19T21:49:06.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:05.012391+0000 osd.1 (osd.1) 241 : cluster [DBG] 2.15 scrub ok 2024-02-19T21:49:06.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:05.146614+0000 mgr.y (mgr.14514) 629 : cluster [DBG] pgmap v811: 138 pgs: 1 active+clean+remapped, 82 active+clean, 35 active+undersized, 20 active+undersized+degraded; 486 MiB data, 4.4 GiB used, 621 GiB / 626 GiB avail; 639 B/s rd, 61 MiB/s wr, 971 op/s; 3186/23886 objects degraded (13.338%); 1/23886 objects misplaced (0.004%) 2024-02-19T21:49:06.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:05.926588+0000 mon.c (mon.2) 88 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/2441376667,v1:172.21.15.80:6819/2441376667]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-19T21:49:06.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:05.927129+0000 mon.a (mon.0) 1569 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-19T21:49:06.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:06.021417+0000 mon.a (mon.0) 1570 : cluster [WRN] Health check update: Degraded data redundancy: 3186/23886 objects degraded (13.338%), 20 pgs degraded, 48 pgs undersized (PG_DEGRADED) 2024-02-19T21:49:06.732 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:49:07.154 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:49:07.273 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 6 16 17787 17771 185.085 135.375 0.00709859 0.00539678 2024-02-19T21:49:07.435 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:49:07.439 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:07.440 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:05.740190+0000 osd.5 (osd.5) 259 : cluster [DBG] 3.2 scrub starts 2024-02-19T21:49:07.440 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:05.746350+0000 osd.5 (osd.5) 260 : cluster [DBG] 3.2 scrub ok 2024-02-19T21:49:07.440 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:05.920594+0000 osd.0 (osd.0) 260 : cluster [DBG] 4.0 scrub starts 2024-02-19T21:49:07.440 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:05.923619+0000 osd.0 (osd.0) 261 : cluster [DBG] 4.0 scrub ok 2024-02-19T21:49:07.440 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:05.976300+0000 osd.7 (osd.7) 241 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:49:07.440 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:05.976351+0000 osd.7 (osd.7) 242 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:49:07.440 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:06.257928+0000 mon.a (mon.0) 1571 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-19T21:49:07.440 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:06.257995+0000 mon.a (mon.0) 1572 : cluster [DBG] osdmap e393: 8 total, 7 up, 7 in 2024-02-19T21:49:07.441 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:06.260076+0000 mon.c (mon.2) 89 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/2441376667,v1:172.21.15.80:6819/2441376667]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-19T21:49:07.441 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:06.261246+0000 mon.a (mon.0) 1573 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-19T21:49:07.442 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:49:07.442 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:05.740190+0000 osd.5 (osd.5) 259 : cluster [DBG] 3.2 scrub starts 2024-02-19T21:49:07.442 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:05.746350+0000 osd.5 (osd.5) 260 : cluster [DBG] 3.2 scrub ok 2024-02-19T21:49:07.442 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:05.920594+0000 osd.0 (osd.0) 260 : cluster [DBG] 4.0 scrub starts 2024-02-19T21:49:07.442 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:05.923619+0000 osd.0 (osd.0) 261 : cluster [DBG] 4.0 scrub ok 2024-02-19T21:49:07.442 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:05.976300+0000 osd.7 (osd.7) 241 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:49:07.443 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:05.976351+0000 osd.7 (osd.7) 242 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:49:07.443 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:06.257928+0000 mon.a (mon.0) 1571 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-19T21:49:07.443 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:06.257995+0000 mon.a (mon.0) 1572 : cluster [DBG] osdmap e393: 8 total, 7 up, 7 in 2024-02-19T21:49:07.443 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:06.260076+0000 mon.c (mon.2) 89 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/2441376667,v1:172.21.15.80:6819/2441376667]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-19T21:49:07.443 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:06.261246+0000 mon.a (mon.0) 1573 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-19T21:49:07.543 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:49:07.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:05.740190+0000 osd.5 (osd.5) 259 : cluster [DBG] 3.2 scrub starts 2024-02-19T21:49:07.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:05.746350+0000 osd.5 (osd.5) 260 : cluster [DBG] 3.2 scrub ok 2024-02-19T21:49:07.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:05.920594+0000 osd.0 (osd.0) 260 : cluster [DBG] 4.0 scrub starts 2024-02-19T21:49:07.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:05.923619+0000 osd.0 (osd.0) 261 : cluster [DBG] 4.0 scrub ok 2024-02-19T21:49:07.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:05.976300+0000 osd.7 (osd.7) 241 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:49:07.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:05.976351+0000 osd.7 (osd.7) 242 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:49:07.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:06.257928+0000 mon.a (mon.0) 1571 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-19T21:49:07.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:06.257995+0000 mon.a (mon.0) 1572 : cluster [DBG] osdmap e393: 8 total, 7 up, 7 in 2024-02-19T21:49:07.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:06.260076+0000 mon.c (mon.2) 89 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/2441376667,v1:172.21.15.80:6819/2441376667]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-19T21:49:07.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:06.261246+0000 mon.a (mon.0) 1573 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-19T21:49:07.572 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:07.645 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:49:07.647 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:07.647 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:49:07.748 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:49:07.776 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:08.274 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 7 16 17874 17858 159.422 5.4375 0.00162557 0.00541925 2024-02-19T21:49:08.324 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:49:08.334 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:08.334 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:49:08.435 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:49:08.462 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:07.147441+0000 mgr.y (mgr.14514) 630 : cluster [DBG] pgmap v813: 138 pgs: 1 active+clean+remapped, 82 active+clean, 32 active+undersized, 23 active+undersized+degraded; 789 MiB data, 5.4 GiB used, 620 GiB / 626 GiB avail; 1.2 KiB/s rd, 99 MiB/s wr, 1.58k op/s; 5596/38430 objects degraded (14.562%); 1/38430 objects misplaced (0.003%) 2024-02-19T21:49:08.462 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:07.287138+0000 mon.a (mon.0) 1574 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T21:49:08.463 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:07.292543+0000 mon.a (mon.0) 1575 : cluster [INF] osd.2 [v2:172.21.15.80:6818/2441376667,v1:172.21.15.80:6819/2441376667] boot 2024-02-19T21:49:08.463 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:07.292592+0000 mon.a (mon.0) 1576 : cluster [DBG] osdmap e394: 8 total, 8 up, 7 in 2024-02-19T21:49:08.463 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:07.298446+0000 mon.a (mon.0) 1577 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:49:08.463 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:07.147441+0000 mgr.y (mgr.14514) 630 : cluster [DBG] pgmap v813: 138 pgs: 1 active+clean+remapped, 82 active+clean, 32 active+undersized, 23 active+undersized+degraded; 789 MiB data, 5.4 GiB used, 620 GiB / 626 GiB avail; 1.2 KiB/s rd, 99 MiB/s wr, 1.58k op/s; 5596/38430 objects degraded (14.562%); 1/38430 objects misplaced (0.003%) 2024-02-19T21:49:08.463 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:07.287138+0000 mon.a (mon.0) 1574 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T21:49:08.463 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:07.292543+0000 mon.a (mon.0) 1575 : cluster [INF] osd.2 [v2:172.21.15.80:6818/2441376667,v1:172.21.15.80:6819/2441376667] boot 2024-02-19T21:49:08.463 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:07.292592+0000 mon.a (mon.0) 1576 : cluster [DBG] osdmap e394: 8 total, 8 up, 7 in 2024-02-19T21:49:08.463 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:07.298446+0000 mon.a (mon.0) 1577 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:49:08.466 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:08.485 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:49:08.487 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:08.488 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:49:08.588 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:49:08.615 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:08.647 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:07.147441+0000 mgr.y (mgr.14514) 630 : cluster [DBG] pgmap v813: 138 pgs: 1 active+clean+remapped, 82 active+clean, 32 active+undersized, 23 active+undersized+degraded; 789 MiB data, 5.4 GiB used, 620 GiB / 626 GiB avail; 1.2 KiB/s rd, 99 MiB/s wr, 1.58k op/s; 5596/38430 objects degraded (14.562%); 1/38430 objects misplaced (0.003%) 2024-02-19T21:49:08.647 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:07.287138+0000 mon.a (mon.0) 1574 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T21:49:08.647 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:07.292543+0000 mon.a (mon.0) 1575 : cluster [INF] osd.2 [v2:172.21.15.80:6818/2441376667,v1:172.21.15.80:6819/2441376667] boot 2024-02-19T21:49:08.647 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:07.292592+0000 mon.a (mon.0) 1576 : cluster [DBG] osdmap e394: 8 total, 8 up, 7 in 2024-02-19T21:49:08.647 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:07.298446+0000 mon.a (mon.0) 1577 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:49:08.887 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:49:08.888 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:49:09.275 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 8 16 17874 17858 139.489 0 - 0.00541925 2024-02-19T21:49:09.364 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:49:09.367 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:09.367 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:49:09.468 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:49:09.493 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:06.889249+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:49:09.493 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:06.889332+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:49:09.493 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:07.723156+0000 osd.5 (osd.5) 261 : cluster [DBG] 2.12 scrub starts 2024-02-19T21:49:09.493 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:07.724092+0000 osd.5 (osd.5) 262 : cluster [DBG] 2.12 scrub ok 2024-02-19T21:49:09.494 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:08.229645+0000 osd.6 (osd.6) 236 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:49:09.494 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:08.232535+0000 osd.6 (osd.6) 237 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:49:09.494 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:08.314747+0000 mon.a (mon.0) 1578 : cluster [DBG] osdmap e395: 8 total, 8 up, 7 in 2024-02-19T21:49:09.494 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:08.316500+0000 osd.7 (osd.7) 243 : cluster [INF] 6.1c continuing backfill to osd.2 from (66'1,66'1] MIN to 66'1 2024-02-19T21:49:09.494 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:08.917105+0000 osd.0 (osd.0) 262 : cluster [DBG] 6.11 scrub starts 2024-02-19T21:49:09.494 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:08.918079+0000 osd.0 (osd.0) 263 : cluster [DBG] 6.11 scrub ok 2024-02-19T21:49:09.494 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:09.312973+0000 mon.a (mon.0) 1579 : cluster [DBG] osdmap e396: 8 total, 8 up, 7 in 2024-02-19T21:49:09.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:06.889249+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:49:09.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:06.889332+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:49:09.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:07.723156+0000 osd.5 (osd.5) 261 : cluster [DBG] 2.12 scrub starts 2024-02-19T21:49:09.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:07.724092+0000 osd.5 (osd.5) 262 : cluster [DBG] 2.12 scrub ok 2024-02-19T21:49:09.495 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:08.229645+0000 osd.6 (osd.6) 236 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:49:09.495 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:08.232535+0000 osd.6 (osd.6) 237 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:49:09.495 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:08.314747+0000 mon.a (mon.0) 1578 : cluster [DBG] osdmap e395: 8 total, 8 up, 7 in 2024-02-19T21:49:09.495 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:08.316500+0000 osd.7 (osd.7) 243 : cluster [INF] 6.1c continuing backfill to osd.2 from (66'1,66'1] MIN to 66'1 2024-02-19T21:49:09.495 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:08.917105+0000 osd.0 (osd.0) 262 : cluster [DBG] 6.11 scrub starts 2024-02-19T21:49:09.495 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:08.918079+0000 osd.0 (osd.0) 263 : cluster [DBG] 6.11 scrub ok 2024-02-19T21:49:09.495 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:09.312973+0000 mon.a (mon.0) 1579 : cluster [DBG] osdmap e396: 8 total, 8 up, 7 in 2024-02-19T21:49:09.496 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:09.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:06.889249+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:49:09.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:06.889332+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:49:09.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:07.723156+0000 osd.5 (osd.5) 261 : cluster [DBG] 2.12 scrub starts 2024-02-19T21:49:09.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:07.724092+0000 osd.5 (osd.5) 262 : cluster [DBG] 2.12 scrub ok 2024-02-19T21:49:09.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:08.229645+0000 osd.6 (osd.6) 236 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:49:09.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:08.232535+0000 osd.6 (osd.6) 237 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:49:09.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:08.314747+0000 mon.a (mon.0) 1578 : cluster [DBG] osdmap e395: 8 total, 8 up, 7 in 2024-02-19T21:49:09.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:08.316500+0000 osd.7 (osd.7) 243 : cluster [INF] 6.1c continuing backfill to osd.2 from (66'1,66'1] MIN to 66'1 2024-02-19T21:49:09.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:08.917105+0000 osd.0 (osd.0) 262 : cluster [DBG] 6.11 scrub starts 2024-02-19T21:49:09.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:08.918079+0000 osd.0 (osd.0) 263 : cluster [DBG] 6.11 scrub ok 2024-02-19T21:49:09.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:09.312973+0000 mon.a (mon.0) 1579 : cluster [DBG] osdmap e396: 8 total, 8 up, 7 in 2024-02-19T21:49:09.596 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:49:09.598 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:09.599 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:49:09.650 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:49:09.650 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-02-19T21:49:09.650 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-02-19T21:49:09.650 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:49:09.700 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:49:09.730 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:10.273 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 9 15 18795 18780 130.393 28.8125 0.0055931 0.00766195 2024-02-19T21:49:10.357 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-02-19T21:49:10.578 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd reweight 0 1 2024-02-19T21:49:10.625 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:08.911012+0000 osd.1 (osd.1) 242 : cluster [DBG] 4.17 scrub starts 2024-02-19T21:49:10.625 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:08.912634+0000 osd.1 (osd.1) 243 : cluster [DBG] 4.17 scrub ok 2024-02-19T21:49:10.625 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:09.148145+0000 mgr.y (mgr.14514) 631 : cluster [DBG] pgmap v816: 138 pgs: 1 active+clean+remapped, 82 active+clean, 32 active+undersized, 23 active+undersized+degraded; 789 MiB data, 5.4 GiB used, 620 GiB / 626 GiB avail; 852 B/s rd, 131 MiB/s wr, 2.10k op/s; 5596/38430 objects degraded (14.562%); 1/38430 objects misplaced (0.003%) 2024-02-19T21:49:10.625 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:09.186007+0000 osd.7 (osd.7) 244 : cluster [DBG] 6.5 scrub starts 2024-02-19T21:49:10.625 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:09.227350+0000 osd.7 (osd.7) 245 : cluster [DBG] 6.5 scrub ok 2024-02-19T21:49:10.625 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:09.756790+0000 osd.5 (osd.5) 263 : cluster [DBG] 2.16 scrub starts 2024-02-19T21:49:10.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:09.765562+0000 osd.5 (osd.5) 264 : cluster [DBG] 2.16 scrub ok 2024-02-19T21:49:10.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:10.008541+0000 mon.c (mon.2) 90 : audit [INF] from='client.? 172.21.15.80:0/3782473827' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:49:10.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:10.009143+0000 mon.a (mon.0) 1580 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:49:10.626 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:08.911012+0000 osd.1 (osd.1) 242 : cluster [DBG] 4.17 scrub starts 2024-02-19T21:49:10.626 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:08.912634+0000 osd.1 (osd.1) 243 : cluster [DBG] 4.17 scrub ok 2024-02-19T21:49:10.626 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:09.148145+0000 mgr.y (mgr.14514) 631 : cluster [DBG] pgmap v816: 138 pgs: 1 active+clean+remapped, 82 active+clean, 32 active+undersized, 23 active+undersized+degraded; 789 MiB data, 5.4 GiB used, 620 GiB / 626 GiB avail; 852 B/s rd, 131 MiB/s wr, 2.10k op/s; 5596/38430 objects degraded (14.562%); 1/38430 objects misplaced (0.003%) 2024-02-19T21:49:10.627 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:09.186007+0000 osd.7 (osd.7) 244 : cluster [DBG] 6.5 scrub starts 2024-02-19T21:49:10.627 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:09.227350+0000 osd.7 (osd.7) 245 : cluster [DBG] 6.5 scrub ok 2024-02-19T21:49:10.627 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:09.756790+0000 osd.5 (osd.5) 263 : cluster [DBG] 2.16 scrub starts 2024-02-19T21:49:10.627 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:09.765562+0000 osd.5 (osd.5) 264 : cluster [DBG] 2.16 scrub ok 2024-02-19T21:49:10.627 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:10.008541+0000 mon.c (mon.2) 90 : audit [INF] from='client.? 172.21.15.80:0/3782473827' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:49:10.627 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:10.009143+0000 mon.a (mon.0) 1580 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:49:10.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:08.911012+0000 osd.1 (osd.1) 242 : cluster [DBG] 4.17 scrub starts 2024-02-19T21:49:10.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:08.912634+0000 osd.1 (osd.1) 243 : cluster [DBG] 4.17 scrub ok 2024-02-19T21:49:10.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:09.148145+0000 mgr.y (mgr.14514) 631 : cluster [DBG] pgmap v816: 138 pgs: 1 active+clean+remapped, 82 active+clean, 32 active+undersized, 23 active+undersized+degraded; 789 MiB data, 5.4 GiB used, 620 GiB / 626 GiB avail; 852 B/s rd, 131 MiB/s wr, 2.10k op/s; 5596/38430 objects degraded (14.562%); 1/38430 objects misplaced (0.003%) 2024-02-19T21:49:10.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:09.186007+0000 osd.7 (osd.7) 244 : cluster [DBG] 6.5 scrub starts 2024-02-19T21:49:10.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:09.227350+0000 osd.7 (osd.7) 245 : cluster [DBG] 6.5 scrub ok 2024-02-19T21:49:10.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:09.756790+0000 osd.5 (osd.5) 263 : cluster [DBG] 2.16 scrub starts 2024-02-19T21:49:10.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:09.765562+0000 osd.5 (osd.5) 264 : cluster [DBG] 2.16 scrub ok 2024-02-19T21:49:10.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:10.008541+0000 mon.c (mon.2) 90 : audit [INF] from='client.? 172.21.15.80:0/3782473827' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:49:10.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:10.009143+0000 mon.a (mon.0) 1580 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:49:10.904 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:49:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:49:10] "GET /metrics HTTP/1.1" 200 176433 "" "Prometheus/2.33.4" 2024-02-19T21:49:11.273 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 10 16 20554 20538 128.341 109.875 0.0106432 0.00778591 2024-02-19T21:49:11.307 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:49:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:49:11.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:10.334822+0000 mon.a (mon.0) 1581 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:49:11.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:10.343154+0000 mon.a (mon.0) 1582 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:49:11.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:10.343237+0000 mon.a (mon.0) 1583 : cluster [DBG] osdmap e397: 8 total, 8 up, 7 in 2024-02-19T21:49:11.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:10.866241+0000 mgr.y (mgr.14514) 632 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:49:11.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:10.334822+0000 mon.a (mon.0) 1581 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:49:11.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:10.343154+0000 mon.a (mon.0) 1582 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:49:11.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:10.343237+0000 mon.a (mon.0) 1583 : cluster [DBG] osdmap e397: 8 total, 8 up, 7 in 2024-02-19T21:49:11.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:10.866241+0000 mgr.y (mgr.14514) 632 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:49:11.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:10.334822+0000 mon.a (mon.0) 1581 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:49:11.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:10.343154+0000 mon.a (mon.0) 1582 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:49:11.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:10.343237+0000 mon.a (mon.0) 1583 : cluster [DBG] osdmap e397: 8 total, 8 up, 7 in 2024-02-19T21:49:11.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:10.866241+0000 mgr.y (mgr.14514) 632 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:49:11.811 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:49:11.938 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.4 dump_blocked_ops 2024-02-19T21:49:11.964 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:49:11.970 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:11.971 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:49:12.072 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:49:12.121 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:12.207 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:49:12.210 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:12.210 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:49:12.274 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 11 16 22163 22147 125.804 100.562 0.00811094 0.00794235 2024-02-19T21:49:12.311 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:49:12.382 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:12.416 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:49:12.424 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:49:12.434 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:12.434 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:49:12.535 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:49:12.582 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:12.585 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:11.148606+0000 mgr.y (mgr.14514) 633 : cluster [DBG] pgmap v819: 138 pgs: 1 active+remapped+backfill_toofull, 115 active+clean, 11 active+undersized, 3 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped, 4 active+undersized+degraded; 1.1 GiB data, 6.8 GiB used, 619 GiB / 626 GiB avail; 767 B/s rd, 90 MiB/s wr, 1.45k op/s; 7785/55776 objects degraded (13.958%); 1/55776 objects misplaced (0.002%); 208 KiB/s, 3 objects/s recovering 2024-02-19T21:49:12.586 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:11.353391+0000 mon.a (mon.0) 1584 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:49:12.586 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:11.353432+0000 mon.a (mon.0) 1585 : cluster [WRN] Health check update: Degraded data redundancy: 7785/55776 objects degraded (13.958%), 11 pgs degraded, 15 pgs undersized (PG_DEGRADED) 2024-02-19T21:49:12.586 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:11.148606+0000 mgr.y (mgr.14514) 633 : cluster [DBG] pgmap v819: 138 pgs: 1 active+remapped+backfill_toofull, 115 active+clean, 11 active+undersized, 3 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped, 4 active+undersized+degraded; 1.1 GiB data, 6.8 GiB used, 619 GiB / 626 GiB avail; 767 B/s rd, 90 MiB/s wr, 1.45k op/s; 7785/55776 objects degraded (13.958%); 1/55776 objects misplaced (0.002%); 208 KiB/s, 3 objects/s recovering 2024-02-19T21:49:12.586 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:11.353391+0000 mon.a (mon.0) 1584 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:49:12.587 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:11.353432+0000 mon.a (mon.0) 1585 : cluster [WRN] Health check update: Degraded data redundancy: 7785/55776 objects degraded (13.958%), 11 pgs degraded, 15 pgs undersized (PG_DEGRADED) 2024-02-19T21:49:12.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:11.148606+0000 mgr.y (mgr.14514) 633 : cluster [DBG] pgmap v819: 138 pgs: 1 active+remapped+backfill_toofull, 115 active+clean, 11 active+undersized, 3 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped, 4 active+undersized+degraded; 1.1 GiB data, 6.8 GiB used, 619 GiB / 626 GiB avail; 767 B/s rd, 90 MiB/s wr, 1.45k op/s; 7785/55776 objects degraded (13.958%); 1/55776 objects misplaced (0.002%); 208 KiB/s, 3 objects/s recovering 2024-02-19T21:49:12.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:11.353391+0000 mon.a (mon.0) 1584 : cluster [WRN] Health check failed: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:49:12.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:11.353432+0000 mon.a (mon.0) 1585 : cluster [WRN] Health check update: Degraded data redundancy: 7785/55776 objects degraded (13.958%), 11 pgs degraded, 15 pgs undersized (PG_DEGRADED) 2024-02-19T21:49:12.997 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:49:12.998 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:49:12.998 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:49:12.998 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:49:12.998 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:49:12.998 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:49:12.998 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:49:12.998 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:49:12.998 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:49:12.999 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:49:12.999 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:49:12.999 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:49:12.999 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:49:12.999 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:49:12.999 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:49:12.999 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:49:13.259 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set noscrub 2024-02-19T21:49:13.274 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 12 16 23754 23738 123.606 99.4375 0.00807287 0.00808184 2024-02-19T21:49:13.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:12.616402+0000 osd.5 (osd.5) 265 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:49:13.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:12.616456+0000 osd.5 (osd.5) 266 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:49:13.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:12.620410+0000 mon.b (mon.1) 64 : audit [DBG] from='client.? 172.21.15.80:0/212796733' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:49:13.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:12.616402+0000 osd.5 (osd.5) 265 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:49:13.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:12.616456+0000 osd.5 (osd.5) 266 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:49:13.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:12.620410+0000 mon.b (mon.1) 64 : audit [DBG] from='client.? 172.21.15.80:0/212796733' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:49:13.650 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:49:13.658 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:13.658 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:49:13.660 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:12.616402+0000 osd.5 (osd.5) 265 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:49:13.660 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:12.616456+0000 osd.5 (osd.5) 266 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:49:13.660 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:12.620410+0000 mon.b (mon.1) 64 : audit [DBG] from='client.? 172.21.15.80:0/212796733' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:49:13.760 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:49:13.821 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:14.275 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 13 16 25423 25407 122.117 104.312 0.00873914 0.00818234 2024-02-19T21:49:14.292 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:49:14.305 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:14.306 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:49:14.361 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:49:14.407 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:49:14.451 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:14.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:13.149147+0000 mgr.y (mgr.14514) 634 : cluster [DBG] pgmap v820: 138 pgs: 1 active+remapped+backfill_toofull, 130 active+clean, 3 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped; 1.1 GiB data, 6.8 GiB used, 619 GiB / 626 GiB avail; 349 B/s rd, 62 MiB/s wr, 987 op/s; 7769/55776 objects degraded (13.929%); 1/55776 objects misplaced (0.002%); 142 KiB/s, 1 objects/s recovering 2024-02-19T21:49:14.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:13.395539+0000 mon.a (mon.0) 1586 : cluster [DBG] osdmap e398: 8 total, 8 up, 7 in 2024-02-19T21:49:14.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:13.936381+0000 osd.3 (osd.3) 224 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:49:14.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:13.936418+0000 osd.3 (osd.3) 225 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:49:14.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:13.149147+0000 mgr.y (mgr.14514) 634 : cluster [DBG] pgmap v820: 138 pgs: 1 active+remapped+backfill_toofull, 130 active+clean, 3 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped; 1.1 GiB data, 6.8 GiB used, 619 GiB / 626 GiB avail; 349 B/s rd, 62 MiB/s wr, 987 op/s; 7769/55776 objects degraded (13.929%); 1/55776 objects misplaced (0.002%); 142 KiB/s, 1 objects/s recovering 2024-02-19T21:49:14.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:13.395539+0000 mon.a (mon.0) 1586 : cluster [DBG] osdmap e398: 8 total, 8 up, 7 in 2024-02-19T21:49:14.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:13.936381+0000 osd.3 (osd.3) 224 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:49:14.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:13.936418+0000 osd.3 (osd.3) 225 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:49:14.611 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:49:14.615 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:14.615 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:49:14.679 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:13.149147+0000 mgr.y (mgr.14514) 634 : cluster [DBG] pgmap v820: 138 pgs: 1 active+remapped+backfill_toofull, 130 active+clean, 3 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped; 1.1 GiB data, 6.8 GiB used, 619 GiB / 626 GiB avail; 349 B/s rd, 62 MiB/s wr, 987 op/s; 7769/55776 objects degraded (13.929%); 1/55776 objects misplaced (0.002%); 142 KiB/s, 1 objects/s recovering 2024-02-19T21:49:14.679 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:13.395539+0000 mon.a (mon.0) 1586 : cluster [DBG] osdmap e398: 8 total, 8 up, 7 in 2024-02-19T21:49:14.679 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:13.936381+0000 osd.3 (osd.3) 224 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:49:14.680 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:13.936418+0000 osd.3 (osd.3) 225 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:49:14.716 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:49:14.768 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:14.853 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:49:14.858 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:14.859 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:49:14.959 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:49:15.010 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:15.275 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 14 16 26864 26848 119.827 90.0625 0.0195371 0.00833688 2024-02-19T21:49:15.378 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:49:15.382 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:15.383 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:49:15.483 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:49:15.521 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:15.548 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:49:15.552 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:15.552 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:49:15.653 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:49:15.704 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:14.398935+0000 mon.a (mon.0) 1587 : cluster [DBG] osdmap e399: 8 total, 8 up, 7 in 2024-02-19T21:49:15.704 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:15.252024+0000 mon.a (mon.0) 1588 : cluster [DBG] osdmap e400: 8 total, 8 up, 7 in 2024-02-19T21:49:15.704 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:14.398935+0000 mon.a (mon.0) 1587 : cluster [DBG] osdmap e399: 8 total, 8 up, 7 in 2024-02-19T21:49:15.704 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:15.252024+0000 mon.a (mon.0) 1588 : cluster [DBG] osdmap e400: 8 total, 8 up, 7 in 2024-02-19T21:49:15.710 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:14.398935+0000 mon.a (mon.0) 1587 : cluster [DBG] osdmap e399: 8 total, 8 up, 7 in 2024-02-19T21:49:15.710 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:15.252024+0000 mon.a (mon.0) 1588 : cluster [DBG] osdmap e400: 8 total, 8 up, 7 in 2024-02-19T21:49:15.710 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:49:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:49:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:49:15.712 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:15.807 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:49:16.077 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:49:16.083 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:16.084 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:49:16.185 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:49:16.230 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:16.275 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 15 16 28191 28175 117.368 82.9375 0.0126396 0.00851254 2024-02-19T21:49:16.424 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.0 to 1 (10000) 2024-02-19T21:49:16.453 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:49:16.460 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:16.461 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:49:16.562 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:49:16.604 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:16.662 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:49:16.668 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:16.669 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:49:16.769 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:49:16.792 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:49:16.792 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [], 2024-02-19T21:49:16.792 INFO:teuthology.orchestra.run.smithi157.stdout: "complaint_time": 30, 2024-02-19T21:49:16.792 INFO:teuthology.orchestra.run.smithi157.stdout: "num_blocked_ops": 0 2024-02-19T21:49:16.792 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:49:16.796 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:15.149788+0000 mgr.y (mgr.14514) 635 : cluster [DBG] pgmap v823: 138 pgs: 1 active+remapped+backfill_toofull, 130 active+clean, 3 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped; 1.4 GiB data, 7.3 GiB used, 619 GiB / 626 GiB avail; 350 B/s rd, 117 MiB/s wr, 1.87k op/s; 6787/71178 objects degraded (9.535%); 1/71178 objects misplaced (0.001%); 11 MiB/s, 169 objects/s recovering 2024-02-19T21:49:16.796 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:15.409218+0000 mon.c (mon.2) 91 : audit [INF] from='client.? 172.21.15.80:0/1822416318' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-19T21:49:16.796 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:15.415889+0000 mon.a (mon.0) 1589 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-19T21:49:16.796 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:15.149788+0000 mgr.y (mgr.14514) 635 : cluster [DBG] pgmap v823: 138 pgs: 1 active+remapped+backfill_toofull, 130 active+clean, 3 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped; 1.4 GiB data, 7.3 GiB used, 619 GiB / 626 GiB avail; 350 B/s rd, 117 MiB/s wr, 1.87k op/s; 6787/71178 objects degraded (9.535%); 1/71178 objects misplaced (0.001%); 11 MiB/s, 169 objects/s recovering 2024-02-19T21:49:16.796 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:15.409218+0000 mon.c (mon.2) 91 : audit [INF] from='client.? 172.21.15.80:0/1822416318' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-19T21:49:16.796 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:15.415889+0000 mon.a (mon.0) 1589 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-19T21:49:16.799 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:16.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:15.149788+0000 mgr.y (mgr.14514) 635 : cluster [DBG] pgmap v823: 138 pgs: 1 active+remapped+backfill_toofull, 130 active+clean, 3 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped; 1.4 GiB data, 7.3 GiB used, 619 GiB / 626 GiB avail; 350 B/s rd, 117 MiB/s wr, 1.87k op/s; 6787/71178 objects degraded (9.535%); 1/71178 objects misplaced (0.001%); 11 MiB/s, 169 objects/s recovering 2024-02-19T21:49:16.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:15.409218+0000 mon.c (mon.2) 91 : audit [INF] from='client.? 172.21.15.80:0/1822416318' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-19T21:49:16.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:15.415889+0000 mon.a (mon.0) 1589 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-19T21:49:16.909 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:49:16.922 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:49:16.925 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:16.926 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:49:17.027 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:49:17.052 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:17.071 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:49:17.074 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:17.075 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:49:17.175 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:49:17.204 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:17.276 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 16 16 28563 28547 111.486 23.25 0.00205445 0.00854018 2024-02-19T21:49:17.438 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-02-19T21:49:17.531 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd reweight 1 1 2024-02-19T21:49:17.671 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:49:17.674 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:17.675 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:49:17.676 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.4 dump_historic_ops 2024-02-19T21:49:17.764 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:16.419131+0000 mon.a (mon.0) 1590 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-02-19T21:49:17.764 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:16.419217+0000 mon.a (mon.0) 1591 : cluster [DBG] osdmap e401: 8 total, 8 up, 7 in 2024-02-19T21:49:17.765 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:17.094028+0000 mon.c (mon.2) 92 : audit [INF] from='client.? 172.21.15.80:0/3979426128' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:49:17.765 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:17.094313+0000 mon.a (mon.0) 1592 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:49:17.776 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:49:17.813 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:16.419131+0000 mon.a (mon.0) 1590 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-02-19T21:49:17.813 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:16.419217+0000 mon.a (mon.0) 1591 : cluster [DBG] osdmap e401: 8 total, 8 up, 7 in 2024-02-19T21:49:17.813 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:17.094028+0000 mon.c (mon.2) 92 : audit [INF] from='client.? 172.21.15.80:0/3979426128' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:49:17.813 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:17.094313+0000 mon.a (mon.0) 1592 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:49:17.813 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:16.419131+0000 mon.a (mon.0) 1590 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-02-19T21:49:17.813 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:16.419217+0000 mon.a (mon.0) 1591 : cluster [DBG] osdmap e401: 8 total, 8 up, 7 in 2024-02-19T21:49:17.813 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:17.094028+0000 mon.c (mon.2) 92 : audit [INF] from='client.? 172.21.15.80:0/3979426128' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:49:17.814 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:17.094313+0000 mon.a (mon.0) 1592 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:49:17.815 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:17.850 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:49:17.860 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:17.860 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:49:17.961 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:49:18.000 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:18.172 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:49:18.197 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:49:18.200 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:18.201 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:49:18.274 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:49:18.275 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 17 16 29580 29564 108.667 63.5625 0.00960511 0.00919702 2024-02-19T21:49:18.302 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:49:18.363 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:18.479 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:49:18.482 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:18.483 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:49:18.576 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:17.150158+0000 mgr.y (mgr.14514) 636 : cluster [DBG] pgmap v826: 138 pgs: 1 active+remapped+backfill_toofull, 130 active+clean, 3 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped; 1.6 GiB data, 8.2 GiB used, 618 GiB / 626 GiB avail; 1.2 KiB/s rd, 128 MiB/s wr, 2.04k op/s; 6729/80268 objects degraded (8.383%); 1/80268 objects misplaced (0.001%); 16 MiB/s, 259 objects/s recovering 2024-02-19T21:49:18.576 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:17.426205+0000 mon.a (mon.0) 1593 : cluster [WRN] Health check update: Degraded data redundancy: 6729/80268 objects degraded (8.383%), 7 pgs degraded (PG_DEGRADED) 2024-02-19T21:49:18.576 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:17.426865+0000 mon.a (mon.0) 1594 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:49:18.576 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:17.434691+0000 mon.a (mon.0) 1595 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:49:18.576 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:17.434749+0000 mon.a (mon.0) 1596 : cluster [DBG] osdmap e402: 8 total, 8 up, 7 in 2024-02-19T21:49:18.577 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:17.150158+0000 mgr.y (mgr.14514) 636 : cluster [DBG] pgmap v826: 138 pgs: 1 active+remapped+backfill_toofull, 130 active+clean, 3 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped; 1.6 GiB data, 8.2 GiB used, 618 GiB / 626 GiB avail; 1.2 KiB/s rd, 128 MiB/s wr, 2.04k op/s; 6729/80268 objects degraded (8.383%); 1/80268 objects misplaced (0.001%); 16 MiB/s, 259 objects/s recovering 2024-02-19T21:49:18.577 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:17.426205+0000 mon.a (mon.0) 1593 : cluster [WRN] Health check update: Degraded data redundancy: 6729/80268 objects degraded (8.383%), 7 pgs degraded (PG_DEGRADED) 2024-02-19T21:49:18.577 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:17.426865+0000 mon.a (mon.0) 1594 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:49:18.577 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:17.434691+0000 mon.a (mon.0) 1595 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:49:18.577 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:17.434749+0000 mon.a (mon.0) 1596 : cluster [DBG] osdmap e402: 8 total, 8 up, 7 in 2024-02-19T21:49:18.584 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:49:18.635 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:17.150158+0000 mgr.y (mgr.14514) 636 : cluster [DBG] pgmap v826: 138 pgs: 1 active+remapped+backfill_toofull, 130 active+clean, 3 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped; 1.6 GiB data, 8.2 GiB used, 618 GiB / 626 GiB avail; 1.2 KiB/s rd, 128 MiB/s wr, 2.04k op/s; 6729/80268 objects degraded (8.383%); 1/80268 objects misplaced (0.001%); 16 MiB/s, 259 objects/s recovering 2024-02-19T21:49:18.635 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:17.426205+0000 mon.a (mon.0) 1593 : cluster [WRN] Health check update: Degraded data redundancy: 6729/80268 objects degraded (8.383%), 7 pgs degraded (PG_DEGRADED) 2024-02-19T21:49:18.635 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:17.426865+0000 mon.a (mon.0) 1594 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:49:18.635 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:17.434691+0000 mon.a (mon.0) 1595 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:49:18.635 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:17.434749+0000 mon.a (mon.0) 1596 : cluster [DBG] osdmap e402: 8 total, 8 up, 7 in 2024-02-19T21:49:18.638 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:19.202 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:49:19.204 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:19.205 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:49:19.275 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 18 16 30854 30838 107.054 79.625 0.00868488 0.00933414 2024-02-19T21:49:19.306 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:49:19.364 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:20.020 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:49:20.025 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:20.025 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:49:20.126 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:49:20.200 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:18.963470+0000 mon.a (mon.0) 1597 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:49:20.204 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:20.215 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-19T21:49:20.240 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:49:20.244 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:20.245 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:49:20.245 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:18.963470+0000 mon.a (mon.0) 1597 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:49:20.246 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:18.963470+0000 mon.a (mon.0) 1597 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:49:20.278 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 19 16 32146 32130 105.665 80.75 0.0249192 0.00945626 2024-02-19T21:49:20.346 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:49:20.407 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:20.579 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:49:20.583 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:20.584 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:49:20.619 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:49:20.620 INFO:teuthology.orchestra.run.smithi157.stdout: "size": 20, 2024-02-19T21:49:20.620 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 600, 2024-02-19T21:49:20.620 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [ 2024-02-19T21:49:20.620 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.620 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:255339 8.b 8:dfd01bce:::benchmark_data_smithi080_100924_object127621:head [delete] snapc 0=[] ondisk+write+known_if_redirected e248)", 2024-02-19T21:49:20.620 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:43:40.144731+0000", 2024-02-19T21:49:20.620 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 340.468531509, 2024-02-19T21:49:20.620 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.013755234, 2024-02-19T21:49:20.620 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:20.620 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:49:20.620 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:49:20.620 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:49:20.621 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:49:20.621 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 255339 2024-02-19T21:49:20.621 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.621 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:20.621 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.621 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:20.621 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.144731+0000", 2024-02-19T21:49:20.621 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:20.621 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.621 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.621 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:20.621 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.144731+0000", 2024-02-19T21:49:20.621 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:49:20.621 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.621 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.622 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:20.622 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.144729+0000", 2024-02-19T21:49:20.622 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.0460000000000006e-06 2024-02-19T21:49:20.622 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.622 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.622 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:20.622 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.144737+0000", 2024-02-19T21:49:20.622 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.4035e-05 2024-02-19T21:49:20.622 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.622 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.622 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:20.622 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.144751+0000", 2024-02-19T21:49:20.622 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.1559999999999998e-06 2024-02-19T21:49:20.622 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.623 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.623 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:20.623 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.144758+0000", 2024-02-19T21:49:20.623 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.4398000000000003e-05 2024-02-19T21:49:20.623 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.623 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.623 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.623 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.144813+0000", 2024-02-19T21:49:20.623 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.9658000000000001e-05 2024-02-19T21:49:20.623 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.623 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.623 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:49:20.623 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.144832+0000", 2024-02-19T21:49:20.623 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99672955699999999 2024-02-19T21:49:20.623 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.624 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.624 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.624 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.141562+0000", 2024-02-19T21:49:20.624 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00010808 2024-02-19T21:49:20.624 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.624 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.624 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:49:20.624 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.141670+0000", 2024-02-19T21:49:20.624 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.7656000000000002e-05 2024-02-19T21:49:20.624 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.624 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.624 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:49:20.624 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.141757+0000", 2024-02-19T21:49:20.625 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0073231099999999999 2024-02-19T21:49:20.625 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.625 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.625 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:49:20.625 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.149081+0000", 2024-02-19T21:49:20.625 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0092449650000000008 2024-02-19T21:49:20.625 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.625 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.625 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.625 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.158326+0000", 2024-02-19T21:49:20.625 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.6935999999999997e-05 2024-02-19T21:49:20.625 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.625 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.625 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.626 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.158392+0000", 2024-02-19T21:49:20.626 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.2901000000000001e-05 2024-02-19T21:49:20.626 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.626 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.626 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:49:20.626 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.158445+0000", 2024-02-19T21:49:20.626 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0606999999999999e-05 2024-02-19T21:49:20.626 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.626 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.626 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:49:20.626 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.158486+0000", 2024-02-19T21:49:20.626 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.013755234 2024-02-19T21:49:20.626 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.626 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:20.627 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.627 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.627 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.627 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:255351 8.b 8:dc46f9ff:::benchmark_data_smithi080_100924_object127633:head [delete] snapc 0=[] ondisk+write+known_if_redirected e248)", 2024-02-19T21:49:20.627 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:43:40.185375+0000", 2024-02-19T21:49:20.627 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 340.42788711700001, 2024-02-19T21:49:20.627 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.97349277899999997, 2024-02-19T21:49:20.627 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:20.627 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:49:20.627 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:49:20.627 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:49:20.627 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:49:20.627 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 255351 2024-02-19T21:49:20.627 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.627 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:20.628 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.628 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:20.628 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.185375+0000", 2024-02-19T21:49:20.628 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:20.628 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.628 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.628 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:20.628 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.185375+0000", 2024-02-19T21:49:20.628 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:49:20.628 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.628 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.628 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:20.628 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.185374+0000", 2024-02-19T21:49:20.629 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.4570000000000002e-06 2024-02-19T21:49:20.629 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.629 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.629 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:20.629 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.185380+0000", 2024-02-19T21:49:20.629 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1221e-05 2024-02-19T21:49:20.629 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.629 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.629 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:20.629 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.185392+0000", 2024-02-19T21:49:20.629 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.254e-06 2024-02-19T21:49:20.629 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.629 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.629 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:20.630 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.185397+0000", 2024-02-19T21:49:20.630 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0028999999999999e-05 2024-02-19T21:49:20.630 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.630 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.630 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.630 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.185437+0000", 2024-02-19T21:49:20.630 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.9680000000000003e-06 2024-02-19T21:49:20.630 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.630 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.630 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:49:20.630 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.185443+0000", 2024-02-19T21:49:20.631 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.95832664599999995 2024-02-19T21:49:20.631 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.631 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.631 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.631 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.143769+0000", 2024-02-19T21:49:20.631 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000101143 2024-02-19T21:49:20.631 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.631 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.631 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:49:20.631 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.143871+0000", 2024-02-19T21:49:20.631 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.3349000000000004e-05 2024-02-19T21:49:20.631 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.631 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.631 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:49:20.632 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.143964+0000", 2024-02-19T21:49:20.632 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0086443219999999994 2024-02-19T21:49:20.632 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.632 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.632 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:49:20.632 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.152608+0000", 2024-02-19T21:49:20.632 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0059401410000000003 2024-02-19T21:49:20.632 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.632 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.632 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.632 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.158548+0000", 2024-02-19T21:49:20.632 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00022524000000000001 2024-02-19T21:49:20.632 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.632 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.633 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.633 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.158774+0000", 2024-02-19T21:49:20.633 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0464000000000003e-05 2024-02-19T21:49:20.633 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.633 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.633 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:49:20.633 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.158824+0000", 2024-02-19T21:49:20.633 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.3791999999999997e-05 2024-02-19T21:49:20.633 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.633 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.633 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:49:20.633 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.158868+0000", 2024-02-19T21:49:20.633 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.97349277899999997 2024-02-19T21:49:20.634 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.634 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:20.634 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.634 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.634 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.634 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:255352 8.b 8:d34b1380:::benchmark_data_smithi080_100924_object127634:head [delete] snapc 0=[] ondisk+write+known_if_redirected e248)", 2024-02-19T21:49:20.634 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:43:40.185413+0000", 2024-02-19T21:49:20.634 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 340.42784900200002, 2024-02-19T21:49:20.634 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.97531789599999996, 2024-02-19T21:49:20.634 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:20.634 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:49:20.634 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:49:20.634 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:49:20.634 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:49:20.634 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 255352 2024-02-19T21:49:20.635 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.635 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:20.635 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.635 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:20.635 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.185413+0000", 2024-02-19T21:49:20.635 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:20.635 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.635 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.635 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:20.635 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.185413+0000", 2024-02-19T21:49:20.635 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:49:20.635 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.636 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.636 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:20.636 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.185413+0000", 2024-02-19T21:49:20.636 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.6899999999999998e-06 2024-02-19T21:49:20.636 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.636 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.636 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:20.636 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.185416+0000", 2024-02-19T21:49:20.636 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.6799999999999998e-06 2024-02-19T21:49:20.636 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.636 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.636 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:20.636 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.185422+0000", 2024-02-19T21:49:20.637 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0559999999999998e-06 2024-02-19T21:49:20.637 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.637 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.637 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:20.637 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.185426+0000", 2024-02-19T21:49:20.637 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.1693000000000003e-05 2024-02-19T21:49:20.637 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.637 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.637 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.637 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.185458+0000", 2024-02-19T21:49:20.637 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.1619999999999996e-06 2024-02-19T21:49:20.637 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.637 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.637 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:49:20.637 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.185464+0000", 2024-02-19T21:49:20.638 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.96005090199999998 2024-02-19T21:49:20.638 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.638 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.638 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.638 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.145515+0000", 2024-02-19T21:49:20.638 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.0650999999999998e-05 2024-02-19T21:49:20.638 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.638 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.638 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:49:20.638 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.145585+0000", 2024-02-19T21:49:20.638 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.8423000000000005e-05 2024-02-19T21:49:20.638 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.638 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.638 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:49:20.639 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.145664+0000", 2024-02-19T21:49:20.639 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0069515239999999997 2024-02-19T21:49:20.639 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.639 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.639 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:49:20.639 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.152615+0000", 2024-02-19T21:49:20.639 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0059896649999999999 2024-02-19T21:49:20.639 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.639 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.639 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.639 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.158605+0000", 2024-02-19T21:49:20.639 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0020484629999999999 2024-02-19T21:49:20.639 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.639 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.639 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.640 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.160654+0000", 2024-02-19T21:49:20.640 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.9633999999999999e-05 2024-02-19T21:49:20.640 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.640 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.640 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:49:20.640 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.160703+0000", 2024-02-19T21:49:20.640 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.7949e-05 2024-02-19T21:49:20.640 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.640 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.640 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:49:20.640 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.160731+0000", 2024-02-19T21:49:20.640 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.97531789599999996 2024-02-19T21:49:20.640 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.641 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:20.641 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.641 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.641 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.641 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:255362 8.b 8:d3e77072:::benchmark_data_smithi080_100924_object127644:head [delete] snapc 0=[] ondisk+write+known_if_redirected e248)", 2024-02-19T21:49:20.641 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:43:40.195670+0000", 2024-02-19T21:49:20.641 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 340.41759192000001, 2024-02-19T21:49:20.641 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.96514260200000002, 2024-02-19T21:49:20.641 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:20.641 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:49:20.641 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:49:20.641 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:49:20.641 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:49:20.641 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 255362 2024-02-19T21:49:20.642 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.642 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:20.642 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.642 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:20.642 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.195670+0000", 2024-02-19T21:49:20.642 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:20.642 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.642 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.642 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:20.642 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.195670+0000", 2024-02-19T21:49:20.642 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:49:20.642 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.642 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.642 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:20.642 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.195668+0000", 2024-02-19T21:49:20.643 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.8980000000000002e-06 2024-02-19T21:49:20.643 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.643 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.643 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:20.643 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.195677+0000", 2024-02-19T21:49:20.643 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.3306999999999999e-05 2024-02-19T21:49:20.643 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.643 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.643 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:20.643 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.195701+0000", 2024-02-19T21:49:20.643 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.1060000000000002e-06 2024-02-19T21:49:20.643 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.643 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.643 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:20.643 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.195708+0000", 2024-02-19T21:49:20.644 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0223999999999999e-05 2024-02-19T21:49:20.644 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.644 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.644 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.644 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.195758+0000", 2024-02-19T21:49:20.644 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.401e-06 2024-02-19T21:49:20.644 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.644 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.644 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:49:20.644 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.195765+0000", 2024-02-19T21:49:20.644 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.95134948799999997 2024-02-19T21:49:20.644 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.644 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.645 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.645 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.147115+0000", 2024-02-19T21:49:20.645 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000115097 2024-02-19T21:49:20.645 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.645 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.645 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:49:20.645 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.147230+0000", 2024-02-19T21:49:20.645 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00015427999999999999 2024-02-19T21:49:20.645 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.645 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.645 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:49:20.645 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.147384+0000", 2024-02-19T21:49:20.645 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0085090740000000002 2024-02-19T21:49:20.645 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.645 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.646 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:49:20.646 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.155893+0000", 2024-02-19T21:49:20.646 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.002769185 2024-02-19T21:49:20.646 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.646 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.646 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.646 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.158663+0000", 2024-02-19T21:49:20.646 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0020964389999999999 2024-02-19T21:49:20.646 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.646 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.646 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.646 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.160759+0000", 2024-02-19T21:49:20.646 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.0127000000000001e-05 2024-02-19T21:49:20.646 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.647 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.647 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:49:20.647 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.160789+0000", 2024-02-19T21:49:20.647 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.3832000000000002e-05 2024-02-19T21:49:20.647 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.647 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.647 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:49:20.647 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.160813+0000", 2024-02-19T21:49:20.647 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.96514260200000002 2024-02-19T21:49:20.647 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.647 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:20.647 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.647 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.647 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.648 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:255365 8.b 8:d2074571:::benchmark_data_smithi080_100924_object127647:head [delete] snapc 0=[] ondisk+write+known_if_redirected e248)", 2024-02-19T21:49:20.648 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:43:40.195963+0000", 2024-02-19T21:49:20.648 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 340.417299152, 2024-02-19T21:49:20.648 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.97157890599999996, 2024-02-19T21:49:20.648 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:20.648 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:49:20.648 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:49:20.648 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:49:20.648 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:49:20.648 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 255365 2024-02-19T21:49:20.648 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.649 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:20.649 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.649 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:20.649 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.195963+0000", 2024-02-19T21:49:20.649 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:20.649 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.649 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.649 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:20.649 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.195963+0000", 2024-02-19T21:49:20.649 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:49:20.649 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.649 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.649 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:20.650 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.195962+0000", 2024-02-19T21:49:20.650 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.1689999999999997e-06 2024-02-19T21:49:20.650 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.650 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.650 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:20.650 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.195968+0000", 2024-02-19T21:49:20.650 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.5019e-05 2024-02-19T21:49:20.650 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.650 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.650 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:20.650 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.195983+0000", 2024-02-19T21:49:20.650 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.8009999999999998e-06 2024-02-19T21:49:20.650 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.650 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.650 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:20.651 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.195990+0000", 2024-02-19T21:49:20.651 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.2831999999999999e-05 2024-02-19T21:49:20.651 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.651 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.651 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.651 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.196033+0000", 2024-02-19T21:49:20.651 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.4769999999999997e-06 2024-02-19T21:49:20.651 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.651 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.651 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:49:20.651 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.196040+0000", 2024-02-19T21:49:20.651 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.95307037999999999 2024-02-19T21:49:20.651 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.651 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.652 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.652 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.149111+0000", 2024-02-19T21:49:20.652 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000111248 2024-02-19T21:49:20.652 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.652 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.652 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:49:20.652 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.149222+0000", 2024-02-19T21:49:20.652 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000150693 2024-02-19T21:49:20.652 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.652 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.652 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:49:20.652 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.149373+0000", 2024-02-19T21:49:20.652 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0065242540000000002 2024-02-19T21:49:20.653 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.653 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.653 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:49:20.653 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.155897+0000", 2024-02-19T21:49:20.653 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0088128300000000007 2024-02-19T21:49:20.653 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.653 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.653 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.653 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.164710+0000", 2024-02-19T21:49:20.653 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0027365359999999999 2024-02-19T21:49:20.653 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.653 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.653 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.654 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.167446+0000", 2024-02-19T21:49:20.654 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.3797e-05 2024-02-19T21:49:20.654 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.654 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.654 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:49:20.654 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.167500+0000", 2024-02-19T21:49:20.654 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.1928999999999998e-05 2024-02-19T21:49:20.654 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.654 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.654 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:49:20.654 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.167542+0000", 2024-02-19T21:49:20.654 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.97157890599999996 2024-02-19T21:49:20.654 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.654 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:20.655 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.655 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.655 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.655 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:255367 8.b 8:ddedfb29:::benchmark_data_smithi080_100924_object127649:head [delete] snapc 0=[] ondisk+write+known_if_redirected e248)", 2024-02-19T21:49:20.655 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:43:40.198299+0000", 2024-02-19T21:49:20.655 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 340.41496367100001, 2024-02-19T21:49:20.655 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.96936644400000005, 2024-02-19T21:49:20.655 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:20.655 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:49:20.655 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:49:20.655 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:49:20.655 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:49:20.655 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 255367 2024-02-19T21:49:20.656 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.656 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:20.656 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.656 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:20.656 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.198299+0000", 2024-02-19T21:49:20.656 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:20.656 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.656 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.656 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:20.656 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.198299+0000", 2024-02-19T21:49:20.656 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:49:20.656 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.656 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.656 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:20.656 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.198297+0000", 2024-02-19T21:49:20.657 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.1419999999999993e-06 2024-02-19T21:49:20.657 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.657 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.657 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:20.657 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.198305+0000", 2024-02-19T21:49:20.657 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.361e-05 2024-02-19T21:49:20.657 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.657 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.657 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:20.657 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.198319+0000", 2024-02-19T21:49:20.657 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.7909999999999999e-06 2024-02-19T21:49:20.657 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.657 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.657 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:20.658 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.198326+0000", 2024-02-19T21:49:20.658 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.5000999999999997e-05 2024-02-19T21:49:20.658 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.658 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.658 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.658 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.198381+0000", 2024-02-19T21:49:20.658 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.2510000000000002e-06 2024-02-19T21:49:20.658 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.658 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.658 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:49:20.658 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.198386+0000", 2024-02-19T21:49:20.658 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.95248649600000002 2024-02-19T21:49:20.658 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.659 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.659 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.659 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.150872+0000", 2024-02-19T21:49:20.659 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000107077 2024-02-19T21:49:20.659 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.659 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.659 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:49:20.659 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.150979+0000", 2024-02-19T21:49:20.660 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014630099999999999 2024-02-19T21:49:20.660 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.660 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.660 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:49:20.660 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.151126+0000", 2024-02-19T21:49:20.660 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0068970050000000003 2024-02-19T21:49:20.661 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.661 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.661 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:49:20.661 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.158023+0000", 2024-02-19T21:49:20.661 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0067261279999999996 2024-02-19T21:49:20.661 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.662 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.662 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.662 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.164749+0000", 2024-02-19T21:49:20.662 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0028444949999999998 2024-02-19T21:49:20.662 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.662 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.662 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.662 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.167593+0000", 2024-02-19T21:49:20.662 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.2533000000000001e-05 2024-02-19T21:49:20.662 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.662 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.662 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:49:20.662 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.167636+0000", 2024-02-19T21:49:20.663 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.9116999999999999e-05 2024-02-19T21:49:20.663 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.663 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.663 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:49:20.663 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.167665+0000", 2024-02-19T21:49:20.663 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.96936644400000005 2024-02-19T21:49:20.663 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.663 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:20.663 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.663 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.663 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.663 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:255371 8.b 8:d7d1db28:::benchmark_data_smithi080_100924_object127653:head [delete] snapc 0=[] ondisk+write+known_if_redirected e248)", 2024-02-19T21:49:20.663 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:43:40.198607+0000", 2024-02-19T21:49:20.663 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 340.41465551300001, 2024-02-19T21:49:20.664 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.97215293599999997, 2024-02-19T21:49:20.664 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:20.664 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:49:20.664 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:49:20.664 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:49:20.664 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:49:20.664 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 255371 2024-02-19T21:49:20.664 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.664 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:20.664 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.664 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:20.664 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.198607+0000", 2024-02-19T21:49:20.664 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:20.664 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.665 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.665 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:20.665 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.198607+0000", 2024-02-19T21:49:20.665 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:49:20.665 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.665 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.665 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:20.665 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.198606+0000", 2024-02-19T21:49:20.665 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.4730000000000002e-06 2024-02-19T21:49:20.665 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.665 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.665 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:20.665 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.198611+0000", 2024-02-19T21:49:20.665 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.8319999999999995e-06 2024-02-19T21:49:20.665 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.666 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.666 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:20.666 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.198619+0000", 2024-02-19T21:49:20.666 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.31e-06 2024-02-19T21:49:20.666 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.666 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.666 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:20.666 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.198625+0000", 2024-02-19T21:49:20.666 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.4443999999999997e-05 2024-02-19T21:49:20.666 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.666 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.666 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.666 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.198669+0000", 2024-02-19T21:49:20.666 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.6519999999999995e-06 2024-02-19T21:49:20.667 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.667 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.667 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:49:20.667 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.198678+0000", 2024-02-19T21:49:20.667 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.95397567299999997 2024-02-19T21:49:20.667 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.667 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.667 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.667 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.152653+0000", 2024-02-19T21:49:20.667 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.1518e-05 2024-02-19T21:49:20.667 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.667 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.667 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:49:20.667 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.152745+0000", 2024-02-19T21:49:20.667 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.5440999999999997e-05 2024-02-19T21:49:20.668 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.668 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.668 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:49:20.668 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.152830+0000", 2024-02-19T21:49:20.668 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0052001720000000003 2024-02-19T21:49:20.668 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.668 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.668 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:49:20.668 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.158031+0000", 2024-02-19T21:49:20.668 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0096761360000000001 2024-02-19T21:49:20.668 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.668 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.668 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.668 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.167707+0000", 2024-02-19T21:49:20.669 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0029878249999999999 2024-02-19T21:49:20.669 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.669 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.669 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.669 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.170695+0000", 2024-02-19T21:49:20.669 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.1065999999999997e-05 2024-02-19T21:49:20.669 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.669 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.669 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:49:20.669 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.170726+0000", 2024-02-19T21:49:20.669 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.4079999999999999e-05 2024-02-19T21:49:20.669 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.669 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.669 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:49:20.670 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.170760+0000", 2024-02-19T21:49:20.670 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.97215293599999997 2024-02-19T21:49:20.670 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.670 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:20.670 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.670 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.670 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.670 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:255394 8.b 8:d0bf5297:::benchmark_data_smithi080_100924_object127676:head [delete] snapc 0=[] ondisk+write+known_if_redirected e248)", 2024-02-19T21:49:20.670 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:43:40.222795+0000", 2024-02-19T21:49:20.670 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 340.39046774299999, 2024-02-19T21:49:20.670 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.94806262699999999, 2024-02-19T21:49:20.670 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:20.670 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:49:20.670 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:49:20.670 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:49:20.671 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:49:20.671 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 255394 2024-02-19T21:49:20.671 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.671 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:20.671 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.671 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:20.671 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.222795+0000", 2024-02-19T21:49:20.671 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:20.671 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.671 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.671 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:20.671 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.222795+0000", 2024-02-19T21:49:20.671 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:49:20.671 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.671 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.672 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:20.672 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.222793+0000", 2024-02-19T21:49:20.672 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0587999999999999e-05 2024-02-19T21:49:20.672 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.672 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.672 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:20.672 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.222803+0000", 2024-02-19T21:49:20.672 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.7620000000000007e-06 2024-02-19T21:49:20.672 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.672 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.672 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:20.672 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.222813+0000", 2024-02-19T21:49:20.672 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.1800000000000001e-06 2024-02-19T21:49:20.672 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.673 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.673 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:20.673 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.222819+0000", 2024-02-19T21:49:20.673 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.1717999999999994e-05 2024-02-19T21:49:20.673 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.673 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.673 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.673 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.222881+0000", 2024-02-19T21:49:20.673 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.2350000000000002e-06 2024-02-19T21:49:20.673 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.673 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.673 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:49:20.673 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.222888+0000", 2024-02-19T21:49:20.674 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.93140796299999995 2024-02-19T21:49:20.674 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.674 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.674 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.674 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.154296+0000", 2024-02-19T21:49:20.674 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.8961000000000003e-05 2024-02-19T21:49:20.674 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.674 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.674 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:49:20.674 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.154395+0000", 2024-02-19T21:49:20.674 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.5956000000000001e-05 2024-02-19T21:49:20.674 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.674 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.674 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:49:20.674 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.154491+0000", 2024-02-19T21:49:20.675 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0036142169999999999 2024-02-19T21:49:20.675 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.675 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.675 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:49:20.675 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.158105+0000", 2024-02-19T21:49:20.675 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0096231819999999992 2024-02-19T21:49:20.675 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.675 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.675 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.675 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.167728+0000", 2024-02-19T21:49:20.675 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.003069146 2024-02-19T21:49:20.675 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.675 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.675 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.675 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.170798+0000", 2024-02-19T21:49:20.676 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.3129000000000001e-05 2024-02-19T21:49:20.676 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.676 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.676 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:49:20.676 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.170831+0000", 2024-02-19T21:49:20.676 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.6474000000000001e-05 2024-02-19T21:49:20.676 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.676 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.676 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:49:20.676 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.170857+0000", 2024-02-19T21:49:20.676 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.94806262699999999 2024-02-19T21:49:20.676 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.676 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:20.676 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.677 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.677 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.677 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24932.0:255410 8.b 8:db3bb6a2:::benchmark_data_smithi080_100924_object127692:head [delete] snapc 0=[] ondisk+write+known_if_redirected e248)", 2024-02-19T21:49:20.677 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:43:40.238418+0000", 2024-02-19T21:49:20.677 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 340.37484412100002, 2024-02-19T21:49:20.677 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.93252470399999998, 2024-02-19T21:49:20.677 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:20.677 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:49:20.677 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:49:20.677 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24932", 2024-02-19T21:49:20.677 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:49:20.677 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 255410 2024-02-19T21:49:20.677 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.677 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:20.678 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.678 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:20.678 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.238418+0000", 2024-02-19T21:49:20.678 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:20.678 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.678 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.678 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:20.678 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.238418+0000", 2024-02-19T21:49:20.678 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:49:20.678 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.678 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.679 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:20.679 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.238417+0000", 2024-02-19T21:49:20.679 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.7469999999999999e-06 2024-02-19T21:49:20.679 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.679 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.679 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:20.679 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.238423+0000", 2024-02-19T21:49:20.679 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.3095000000000001e-05 2024-02-19T21:49:20.679 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.679 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.679 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:20.679 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.238436+0000", 2024-02-19T21:49:20.679 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.9059999999999996e-06 2024-02-19T21:49:20.679 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.679 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.680 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:20.680 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.238443+0000", 2024-02-19T21:49:20.680 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0637999999999999e-05 2024-02-19T21:49:20.680 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.680 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.680 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.680 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.238494+0000", 2024-02-19T21:49:20.680 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0030000000000001e-05 2024-02-19T21:49:20.680 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.680 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.680 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:49:20.680 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:40.238504+0000", 2024-02-19T21:49:20.680 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.91743139900000004 2024-02-19T21:49:20.681 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.681 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.681 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.681 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.155935+0000", 2024-02-19T21:49:20.681 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000131555 2024-02-19T21:49:20.681 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.681 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.681 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:49:20.681 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.156067+0000", 2024-02-19T21:49:20.681 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013120499999999999 2024-02-19T21:49:20.681 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.681 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.681 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:49:20.682 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.156198+0000", 2024-02-19T21:49:20.682 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0021375610000000001 2024-02-19T21:49:20.682 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.682 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.682 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:49:20.682 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.158336+0000", 2024-02-19T21:49:20.682 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.010999392 2024-02-19T21:49:20.682 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.682 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.682 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.682 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.169335+0000", 2024-02-19T21:49:20.682 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.001554047 2024-02-19T21:49:20.682 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.682 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.683 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.683 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.170889+0000", 2024-02-19T21:49:20.683 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.8636000000000002e-05 2024-02-19T21:49:20.683 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.683 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.683 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:49:20.683 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.170918+0000", 2024-02-19T21:49:20.683 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.5052999999999999e-05 2024-02-19T21:49:20.683 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.683 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.683 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:49:20.683 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:43:41.170943+0000", 2024-02-19T21:49:20.683 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.93252470399999998 2024-02-19T21:49:20.683 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.684 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:20.684 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.684 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.684 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.684 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:225712 9.c 9:3bc782ee:::benchmark_data_smithi080_126364_object97120:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e362)", 2024-02-19T21:49:20.684 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:47:45.245752+0000", 2024-02-19T21:49:20.684 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 95.367510143000004, 2024-02-19T21:49:20.684 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0509590870000001, 2024-02-19T21:49:20.684 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:20.684 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "reached pg", 2024-02-19T21:49:20.684 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:49:20.684 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:49:20.684 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:49:20.685 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 225712 2024-02-19T21:49:20.685 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.685 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:20.685 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.685 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:20.685 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.245752+0000", 2024-02-19T21:49:20.685 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:20.685 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.685 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.685 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:20.685 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.245752+0000", 2024-02-19T21:49:20.685 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:49:20.685 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.685 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.685 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:20.686 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.245750+0000", 2024-02-19T21:49:20.686 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.2829999999999998e-06 2024-02-19T21:49:20.686 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.686 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.686 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:20.686 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.245757+0000", 2024-02-19T21:49:20.686 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.876e-06 2024-02-19T21:49:20.686 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.686 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.686 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:20.686 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.245767+0000", 2024-02-19T21:49:20.686 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.7989999999999996e-06 2024-02-19T21:49:20.686 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.686 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.686 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:20.687 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.245773+0000", 2024-02-19T21:49:20.687 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00070042399999999995 2024-02-19T21:49:20.687 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.687 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.687 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.687 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.246474+0000", 2024-02-19T21:49:20.687 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.2969999999999992e-06 2024-02-19T21:49:20.687 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.687 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.687 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:49:20.688 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.246483+0000", 2024-02-19T21:49:20.688 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.04816248 2024-02-19T21:49:20.688 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.688 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.688 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.688 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.294646+0000", 2024-02-19T21:49:20.688 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0020656210000000001 2024-02-19T21:49:20.688 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.688 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.688 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:49:20.689 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.296711+0000", 2024-02-19T21:49:20.689 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0509590870000001 2024-02-19T21:49:20.689 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.689 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:20.689 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.689 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.689 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.689 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:225734 9.c 9:31ed6146:::benchmark_data_smithi080_126364_object97142:head [delete] snapc 0=[] ondisk+write+known_if_redirected e362)", 2024-02-19T21:49:20.689 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:47:45.264818+0000", 2024-02-19T21:49:20.689 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 95.348443844000002, 2024-02-19T21:49:20.689 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.082053854, 2024-02-19T21:49:20.689 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:20.689 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:49:20.689 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:49:20.690 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:49:20.690 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:49:20.690 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 225734 2024-02-19T21:49:20.690 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.690 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:20.690 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.690 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:20.690 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.264818+0000", 2024-02-19T21:49:20.690 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:20.690 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.690 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.690 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:20.690 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.264818+0000", 2024-02-19T21:49:20.690 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999976 2024-02-19T21:49:20.691 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.691 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.691 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:20.691 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.264816+0000", 2024-02-19T21:49:20.691 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1192000000000001e-05 2024-02-19T21:49:20.691 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.691 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.691 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:20.691 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.264827+0000", 2024-02-19T21:49:20.691 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1943999999999999e-05 2024-02-19T21:49:20.691 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.691 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.691 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:20.691 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.264849+0000", 2024-02-19T21:49:20.691 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.7780000000000002e-06 2024-02-19T21:49:20.692 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.692 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.692 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:20.692 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.264859+0000", 2024-02-19T21:49:20.692 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00010023599999999999 2024-02-19T21:49:20.692 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.692 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.692 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.692 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.264959+0000", 2024-02-19T21:49:20.692 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.431e-05 2024-02-19T21:49:20.692 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.693 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.693 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:49:20.693 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.264973+0000", 2024-02-19T21:49:20.693 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.031789719 2024-02-19T21:49:20.693 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.693 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.693 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.693 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.296763+0000", 2024-02-19T21:49:20.693 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00068677400000000002 2024-02-19T21:49:20.693 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.693 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.693 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:49:20.693 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.297450+0000", 2024-02-19T21:49:20.693 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00035103199999999998 2024-02-19T21:49:20.693 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.694 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.694 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:49:20.694 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.297801+0000", 2024-02-19T21:49:20.694 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.033695179999999998 2024-02-19T21:49:20.694 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.694 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.694 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:49:20.694 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.331496+0000", 2024-02-19T21:49:20.695 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.015243328 2024-02-19T21:49:20.695 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.695 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.695 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.695 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.346739+0000", 2024-02-19T21:49:20.695 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.9897000000000001e-05 2024-02-19T21:49:20.696 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.696 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.696 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.696 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.346779+0000", 2024-02-19T21:49:20.696 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.1029999999999998e-05 2024-02-19T21:49:20.696 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.696 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.696 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:49:20.696 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.346830+0000", 2024-02-19T21:49:20.696 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.1906000000000002e-05 2024-02-19T21:49:20.696 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.697 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.697 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:49:20.697 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.346872+0000", 2024-02-19T21:49:20.697 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.082053854 2024-02-19T21:49:20.697 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.697 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:20.697 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.697 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.697 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.697 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:225744 9.c 9:3a0a868b:::benchmark_data_smithi080_126364_object97152:head [delete] snapc 0=[] ondisk+write+known_if_redirected e362)", 2024-02-19T21:49:20.697 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:47:45.273857+0000", 2024-02-19T21:49:20.697 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 95.339405513000003, 2024-02-19T21:49:20.697 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.073203498, 2024-02-19T21:49:20.698 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:20.698 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:49:20.698 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:49:20.698 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:49:20.698 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:49:20.698 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 225744 2024-02-19T21:49:20.698 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.698 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:20.698 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.698 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:20.698 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.273857+0000", 2024-02-19T21:49:20.698 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:20.698 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.699 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.699 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:20.699 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.273857+0000", 2024-02-19T21:49:20.699 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:49:20.699 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.699 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.699 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:20.699 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.273855+0000", 2024-02-19T21:49:20.699 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0176999999999999e-05 2024-02-19T21:49:20.699 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.699 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.699 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:20.699 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.273865+0000", 2024-02-19T21:49:20.699 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.772e-05 2024-02-19T21:49:20.699 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.700 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.700 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:20.700 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.273883+0000", 2024-02-19T21:49:20.700 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.3510000000000002e-06 2024-02-19T21:49:20.700 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.700 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.700 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:20.700 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.273891+0000", 2024-02-19T21:49:20.700 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00016082600000000001 2024-02-19T21:49:20.700 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.700 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.700 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.701 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.274052+0000", 2024-02-19T21:49:20.701 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0776e-05 2024-02-19T21:49:20.701 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.701 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.701 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:49:20.701 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.274063+0000", 2024-02-19T21:49:20.701 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0460056259999999 2024-02-19T21:49:20.701 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.701 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.701 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.701 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.320068+0000", 2024-02-19T21:49:20.701 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013029299999999999 2024-02-19T21:49:20.701 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.701 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.702 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:49:20.702 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.320198+0000", 2024-02-19T21:49:20.702 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000180335 2024-02-19T21:49:20.702 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.702 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.702 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:49:20.702 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.320379+0000", 2024-02-19T21:49:20.702 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.011125680000000001 2024-02-19T21:49:20.702 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.702 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.702 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:49:20.702 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.331505+0000", 2024-02-19T21:49:20.702 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.015410283 2024-02-19T21:49:20.703 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.703 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.703 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.703 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.346915+0000", 2024-02-19T21:49:20.703 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.3844999999999996e-05 2024-02-19T21:49:20.703 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.703 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.703 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.703 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.346979+0000", 2024-02-19T21:49:20.703 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.3353000000000003e-05 2024-02-19T21:49:20.703 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.703 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.703 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:49:20.703 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.347022+0000", 2024-02-19T21:49:20.704 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.8260000000000003e-05 2024-02-19T21:49:20.704 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.704 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.704 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:49:20.704 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.347060+0000", 2024-02-19T21:49:20.704 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.073203498 2024-02-19T21:49:20.704 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.704 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:20.704 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.704 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.704 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.704 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:225745 9.c 9:34fcf8b4:::benchmark_data_smithi080_126364_object97153:head [delete] snapc 0=[] ondisk+write+known_if_redirected e362)", 2024-02-19T21:49:20.704 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:47:45.305995+0000", 2024-02-19T21:49:20.705 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 95.307267558000007, 2024-02-19T21:49:20.705 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0412780500000001, 2024-02-19T21:49:20.705 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:20.705 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:49:20.705 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:49:20.705 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:49:20.705 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:49:20.705 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 225745 2024-02-19T21:49:20.705 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.705 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:20.705 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.705 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:20.705 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.305995+0000", 2024-02-19T21:49:20.706 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:20.706 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.706 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.706 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:20.706 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.305995+0000", 2024-02-19T21:49:20.706 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999976 2024-02-19T21:49:20.706 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.706 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.706 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:20.706 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.305992+0000", 2024-02-19T21:49:20.706 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.3309999999999993e-06 2024-02-19T21:49:20.706 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.706 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.706 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:20.706 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.306002+0000", 2024-02-19T21:49:20.707 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.5984000000000001e-05 2024-02-19T21:49:20.707 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.707 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.707 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:20.707 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.306018+0000", 2024-02-19T21:49:20.707 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.1679999999999998e-06 2024-02-19T21:49:20.707 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.707 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.707 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:20.707 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.306025+0000", 2024-02-19T21:49:20.707 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.3211000000000002e-05 2024-02-19T21:49:20.707 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.707 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.707 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.708 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.306088+0000", 2024-02-19T21:49:20.708 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.7638e-05 2024-02-19T21:49:20.708 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.708 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.708 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:49:20.708 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.306106+0000", 2024-02-19T21:49:20.708 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0171034109999999 2024-02-19T21:49:20.708 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.708 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.708 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.708 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.323209+0000", 2024-02-19T21:49:20.708 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.3854e-05 2024-02-19T21:49:20.708 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.709 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.709 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:49:20.709 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.323303+0000", 2024-02-19T21:49:20.709 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00015583799999999999 2024-02-19T21:49:20.709 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.709 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.709 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:49:20.709 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.323459+0000", 2024-02-19T21:49:20.709 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0080547540000000008 2024-02-19T21:49:20.709 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.709 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.709 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:49:20.709 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.331514+0000", 2024-02-19T21:49:20.709 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.015584676 2024-02-19T21:49:20.710 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.710 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.710 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.710 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.347098+0000", 2024-02-19T21:49:20.710 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.8001000000000002e-05 2024-02-19T21:49:20.710 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.710 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.710 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.710 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.347166+0000", 2024-02-19T21:49:20.710 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.5717000000000003e-05 2024-02-19T21:49:20.710 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.710 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.710 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:49:20.710 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.347212+0000", 2024-02-19T21:49:20.710 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.0739999999999998e-05 2024-02-19T21:49:20.711 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.711 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.711 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:49:20.711 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.347273+0000", 2024-02-19T21:49:20.711 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0412780500000001 2024-02-19T21:49:20.711 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.711 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:20.711 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.711 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.711 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.711 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:225753 9.c 9:3e326219:::benchmark_data_smithi080_126364_object97161:head [delete] snapc 0=[] ondisk+write+known_if_redirected e362)", 2024-02-19T21:49:20.711 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:47:45.312458+0000", 2024-02-19T21:49:20.711 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 95.300804278000001, 2024-02-19T21:49:20.711 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0349517589999999, 2024-02-19T21:49:20.712 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:20.712 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:49:20.712 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:49:20.712 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:49:20.712 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:49:20.712 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 225753 2024-02-19T21:49:20.712 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.712 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:20.712 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.712 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:20.712 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.312458+0000", 2024-02-19T21:49:20.712 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:20.712 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.713 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.713 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:20.713 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.312458+0000", 2024-02-19T21:49:20.713 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:49:20.713 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.713 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.713 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:20.713 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.312456+0000", 2024-02-19T21:49:20.713 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.1620000000000008e-06 2024-02-19T21:49:20.713 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.713 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.713 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:20.713 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.312465+0000", 2024-02-19T21:49:20.713 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.3346999999999999e-05 2024-02-19T21:49:20.714 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.714 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.714 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:20.714 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.312478+0000", 2024-02-19T21:49:20.714 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.3820000000000001e-06 2024-02-19T21:49:20.714 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.714 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.714 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:20.714 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.312484+0000", 2024-02-19T21:49:20.714 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.2665999999999999e-05 2024-02-19T21:49:20.714 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.714 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.714 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.714 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.312547+0000", 2024-02-19T21:49:20.715 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.101e-05 2024-02-19T21:49:20.715 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.715 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.715 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:49:20.715 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.312558+0000", 2024-02-19T21:49:20.715 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.013436019 2024-02-19T21:49:20.715 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.715 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.715 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.715 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.325994+0000", 2024-02-19T21:49:20.715 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.5168999999999998e-05 2024-02-19T21:49:20.715 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.715 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.715 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:49:20.716 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.326069+0000", 2024-02-19T21:49:20.716 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.5698000000000005e-05 2024-02-19T21:49:20.716 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.716 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.716 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:49:20.716 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.326155+0000", 2024-02-19T21:49:20.716 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0087919950000000004 2024-02-19T21:49:20.716 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.716 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.716 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:49:20.716 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.334947+0000", 2024-02-19T21:49:20.716 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.012187575000000001 2024-02-19T21:49:20.717 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.717 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.717 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.717 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.347134+0000", 2024-02-19T21:49:20.717 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00019092499999999999 2024-02-19T21:49:20.717 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.717 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.717 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.717 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.347325+0000", 2024-02-19T21:49:20.717 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.5201999999999999e-05 2024-02-19T21:49:20.717 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.717 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.717 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:49:20.717 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.347371+0000", 2024-02-19T21:49:20.717 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.9175999999999999e-05 2024-02-19T21:49:20.718 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.718 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.718 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:49:20.718 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.347410+0000", 2024-02-19T21:49:20.718 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0349517589999999 2024-02-19T21:49:20.718 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.718 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:20.718 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.718 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.718 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.718 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:225767 9.c 9:3bac91ec:::benchmark_data_smithi080_126364_object97175:head [delete] snapc 0=[] ondisk+write+known_if_redirected e362)", 2024-02-19T21:49:20.718 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:47:45.326436+0000", 2024-02-19T21:49:20.718 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 95.286825918000005, 2024-02-19T21:49:20.718 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.021127728, 2024-02-19T21:49:20.718 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:20.718 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:49:20.719 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:49:20.719 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:49:20.719 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:49:20.719 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 225767 2024-02-19T21:49:20.719 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.719 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:20.719 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.719 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:20.719 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.326436+0000", 2024-02-19T21:49:20.719 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:20.719 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.719 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.719 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:20.719 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.326436+0000", 2024-02-19T21:49:20.720 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:49:20.720 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.720 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.720 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:20.720 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.326435+0000", 2024-02-19T21:49:20.720 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.3139999999999998e-06 2024-02-19T21:49:20.720 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.720 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.720 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:20.720 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.326442+0000", 2024-02-19T21:49:20.720 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2670000000000001e-05 2024-02-19T21:49:20.720 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.720 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.721 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:20.721 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.326455+0000", 2024-02-19T21:49:20.721 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.2269999999999998e-06 2024-02-19T21:49:20.721 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.721 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.721 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:20.721 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.326461+0000", 2024-02-19T21:49:20.721 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.3528000000000003e-05 2024-02-19T21:49:20.721 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.721 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.721 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.721 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.326555+0000", 2024-02-19T21:49:20.721 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.8099999999999992e-06 2024-02-19T21:49:20.721 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.722 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.722 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:49:20.722 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.326564+0000", 2024-02-19T21:49:20.722 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0018670789999999 2024-02-19T21:49:20.722 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.722 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.722 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.722 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.328431+0000", 2024-02-19T21:49:20.722 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000107612 2024-02-19T21:49:20.722 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.722 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.722 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:49:20.722 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.328539+0000", 2024-02-19T21:49:20.722 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.4015000000000001e-05 2024-02-19T21:49:20.722 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.722 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.723 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:49:20.723 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.328623+0000", 2024-02-19T21:49:20.723 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0063270660000000001 2024-02-19T21:49:20.723 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.723 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.723 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:49:20.723 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.334950+0000", 2024-02-19T21:49:20.723 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.012506032 2024-02-19T21:49:20.723 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.723 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.723 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.723 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.347456+0000", 2024-02-19T21:49:20.723 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.1170999999999997e-05 2024-02-19T21:49:20.723 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.723 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.723 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.724 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.347487+0000", 2024-02-19T21:49:20.724 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.2738999999999999e-05 2024-02-19T21:49:20.724 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.724 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.724 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:49:20.724 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.347530+0000", 2024-02-19T21:49:20.724 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.4008999999999999e-05 2024-02-19T21:49:20.724 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.724 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.724 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:49:20.724 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.347564+0000", 2024-02-19T21:49:20.724 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.021127728 2024-02-19T21:49:20.724 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.725 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:20.725 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.725 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.725 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.725 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:225777 9.c 9:382b9301:::benchmark_data_smithi080_126364_object97185:head [delete] snapc 0=[] ondisk+write+known_if_redirected e362)", 2024-02-19T21:49:20.725 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:47:45.336147+0000", 2024-02-19T21:49:20.725 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 95.277114921999996, 2024-02-19T21:49:20.725 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.011592869, 2024-02-19T21:49:20.725 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:20.725 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:49:20.725 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:49:20.725 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:49:20.725 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:49:20.725 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 225777 2024-02-19T21:49:20.725 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.726 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:20.726 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.726 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:20.726 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.336147+0000", 2024-02-19T21:49:20.726 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:20.726 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.726 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.726 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:20.726 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.336147+0000", 2024-02-19T21:49:20.726 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:49:20.726 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.726 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.726 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:20.726 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.336147+0000", 2024-02-19T21:49:20.727 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.27e-06 2024-02-19T21:49:20.727 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.727 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.727 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:20.727 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.336150+0000", 2024-02-19T21:49:20.727 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.3709999999999996e-06 2024-02-19T21:49:20.727 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.727 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.727 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:20.727 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.336156+0000", 2024-02-19T21:49:20.727 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0990000000000001e-06 2024-02-19T21:49:20.727 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.727 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.727 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:20.727 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.336161+0000", 2024-02-19T21:49:20.727 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.8263999999999997e-05 2024-02-19T21:49:20.728 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.728 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.728 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.728 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.336209+0000", 2024-02-19T21:49:20.728 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.4899999999999997e-06 2024-02-19T21:49:20.728 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.728 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.728 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:49:20.728 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.336215+0000", 2024-02-19T21:49:20.728 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99384565999999996 2024-02-19T21:49:20.728 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.728 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.728 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.728 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.330061+0000", 2024-02-19T21:49:20.729 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000106269 2024-02-19T21:49:20.729 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.729 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.729 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:49:20.729 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.330167+0000", 2024-02-19T21:49:20.729 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00015195700000000001 2024-02-19T21:49:20.729 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.729 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.729 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:49:20.729 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.330319+0000", 2024-02-19T21:49:20.729 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0066931559999999996 2024-02-19T21:49:20.729 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.729 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.729 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:49:20.730 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.337012+0000", 2024-02-19T21:49:20.730 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.010587716 2024-02-19T21:49:20.730 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.730 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.730 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.730 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.347600+0000", 2024-02-19T21:49:20.730 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.2646999999999998e-05 2024-02-19T21:49:20.730 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.730 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.730 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.730 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.347663+0000", 2024-02-19T21:49:20.730 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.3093999999999998e-05 2024-02-19T21:49:20.730 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.731 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.731 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:49:20.731 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.347706+0000", 2024-02-19T21:49:20.731 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.4377e-05 2024-02-19T21:49:20.731 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.731 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.731 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:49:20.731 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.347740+0000", 2024-02-19T21:49:20.731 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.011592869 2024-02-19T21:49:20.731 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.731 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:20.731 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.731 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.731 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.732 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:225839 9.c 9:33339f5b:::benchmark_data_smithi080_126364_object97247:head [delete] snapc 0=[] ondisk+write+known_if_redirected e362)", 2024-02-19T21:49:20.732 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:47:45.414250+0000", 2024-02-19T21:49:20.732 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 95.199012275000001, 2024-02-19T21:49:20.732 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.93363500899999996, 2024-02-19T21:49:20.732 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:20.732 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:49:20.732 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:49:20.732 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:49:20.733 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:49:20.733 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:49:20.734 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 225839 2024-02-19T21:49:20.734 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.734 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:20.734 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.734 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:20.734 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.414250+0000", 2024-02-19T21:49:20.734 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:20.734 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.734 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.734 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:20.734 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.414250+0000", 2024-02-19T21:49:20.734 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:49:20.734 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.734 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.735 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:20.735 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.414249+0000", 2024-02-19T21:49:20.735 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.9709999999999998e-06 2024-02-19T21:49:20.735 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.735 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.735 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:20.735 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.414253+0000", 2024-02-19T21:49:20.735 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.8029999999999999e-06 2024-02-19T21:49:20.735 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.735 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.735 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:20.736 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.414260+0000", 2024-02-19T21:49:20.736 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.5549999999999996e-06 2024-02-19T21:49:20.736 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.736 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.736 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:20.736 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.414265+0000", 2024-02-19T21:49:20.736 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.4524999999999997e-05 2024-02-19T21:49:20.736 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.736 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.736 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.736 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.414319+0000", 2024-02-19T21:49:20.736 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.8609999999999998e-06 2024-02-19T21:49:20.736 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.737 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.737 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:49:20.737 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.414327+0000", 2024-02-19T21:49:20.737 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.91722214199999996 2024-02-19T21:49:20.737 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.737 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.737 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.737 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.331549+0000", 2024-02-19T21:49:20.737 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.1340000000000003e-05 2024-02-19T21:49:20.737 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.737 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.737 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:49:20.737 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.331640+0000", 2024-02-19T21:49:20.737 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000126668 2024-02-19T21:49:20.738 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.738 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.738 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:49:20.738 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.331767+0000", 2024-02-19T21:49:20.738 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0052507600000000001 2024-02-19T21:49:20.738 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.738 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.738 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:49:20.738 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.337018+0000", 2024-02-19T21:49:20.738 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.010613581 2024-02-19T21:49:20.738 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.738 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.738 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.738 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.347631+0000", 2024-02-19T21:49:20.738 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00017674699999999999 2024-02-19T21:49:20.739 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.739 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.739 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.739 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.347808+0000", 2024-02-19T21:49:20.739 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.1699000000000002e-05 2024-02-19T21:49:20.739 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.739 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.739 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:49:20.739 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.347850+0000", 2024-02-19T21:49:20.739 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.5061999999999997e-05 2024-02-19T21:49:20.739 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.739 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.739 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:49:20.739 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.347885+0000", 2024-02-19T21:49:20.739 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.93363500899999996 2024-02-19T21:49:20.740 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.740 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:20.740 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.740 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.740 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.740 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:225855 9.c 9:3b68984c:::benchmark_data_smithi080_126364_object97263:head [delete] snapc 0=[] ondisk+write+known_if_redirected e362)", 2024-02-19T21:49:20.740 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:47:45.434939+0000", 2024-02-19T21:49:20.740 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 95.178323716999998, 2024-02-19T21:49:20.740 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.91306264100000001, 2024-02-19T21:49:20.740 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:20.740 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:49:20.740 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:49:20.740 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:49:20.741 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:49:20.741 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 225855 2024-02-19T21:49:20.741 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.741 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:20.741 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.741 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:20.741 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.434939+0000", 2024-02-19T21:49:20.741 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:20.741 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.741 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.741 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:20.741 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.434939+0000", 2024-02-19T21:49:20.741 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:49:20.741 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.741 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.742 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:20.742 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.434937+0000", 2024-02-19T21:49:20.742 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.4970000000000004e-06 2024-02-19T21:49:20.742 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.742 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.742 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:20.742 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.434944+0000", 2024-02-19T21:49:20.742 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.6137000000000002e-05 2024-02-19T21:49:20.742 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.742 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.742 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:20.742 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.434961+0000", 2024-02-19T21:49:20.742 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.5089999999999999e-06 2024-02-19T21:49:20.742 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.743 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.743 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:20.743 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.434967+0000", 2024-02-19T21:49:20.743 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.2811e-05 2024-02-19T21:49:20.743 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.743 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.743 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.743 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.435020+0000", 2024-02-19T21:49:20.743 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.7509999999999997e-06 2024-02-19T21:49:20.743 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.743 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.743 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:49:20.743 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.435029+0000", 2024-02-19T21:49:20.743 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.89841126500000001 2024-02-19T21:49:20.743 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.744 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.744 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.744 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.333440+0000", 2024-02-19T21:49:20.744 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.0982999999999994e-05 2024-02-19T21:49:20.744 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.744 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.744 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:49:20.744 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.333521+0000", 2024-02-19T21:49:20.744 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.9149999999999999e-05 2024-02-19T21:49:20.744 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.744 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.744 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:49:20.744 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.333610+0000", 2024-02-19T21:49:20.744 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.005212464 2024-02-19T21:49:20.745 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.745 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.745 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:49:20.745 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.338822+0000", 2024-02-19T21:49:20.745 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.008952102 2024-02-19T21:49:20.745 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.745 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.745 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.745 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.347775+0000", 2024-02-19T21:49:20.745 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014776599999999999 2024-02-19T21:49:20.745 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.745 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.745 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.745 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.347922+0000", 2024-02-19T21:49:20.746 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.5170999999999998e-05 2024-02-19T21:49:20.746 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.746 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.746 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:49:20.746 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.347967+0000", 2024-02-19T21:49:20.746 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.3691e-05 2024-02-19T21:49:20.746 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.746 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.746 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:49:20.746 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.348001+0000", 2024-02-19T21:49:20.746 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.91306264100000001 2024-02-19T21:49:20.746 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.746 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:20.746 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.747 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.747 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.747 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:225857 9.c 9:34c4b82e:::benchmark_data_smithi080_126364_object97265:head [delete] snapc 0=[] ondisk+write+known_if_redirected e362)", 2024-02-19T21:49:20.747 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:47:45.435667+0000", 2024-02-19T21:49:20.747 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 95.177595605999997, 2024-02-19T21:49:20.747 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.912461996, 2024-02-19T21:49:20.747 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:20.747 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:49:20.747 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:49:20.747 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:49:20.747 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:49:20.747 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 225857 2024-02-19T21:49:20.747 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.747 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:20.748 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.748 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:20.748 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.435667+0000", 2024-02-19T21:49:20.748 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:20.748 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.748 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.748 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:20.748 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.435667+0000", 2024-02-19T21:49:20.748 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:49:20.748 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.748 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.748 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:20.748 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.435666+0000", 2024-02-19T21:49:20.749 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.3299999999999998e-06 2024-02-19T21:49:20.749 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.749 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.749 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:20.749 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.435671+0000", 2024-02-19T21:49:20.749 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.6880000000000005e-06 2024-02-19T21:49:20.749 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.749 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.749 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:20.749 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.435680+0000", 2024-02-19T21:49:20.749 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.2900000000000002e-06 2024-02-19T21:49:20.749 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.750 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.750 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:20.750 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.435685+0000", 2024-02-19T21:49:20.750 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.4978999999999997e-05 2024-02-19T21:49:20.750 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.750 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.750 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.750 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.435730+0000", 2024-02-19T21:49:20.750 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.4060000000000005e-06 2024-02-19T21:49:20.750 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.750 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.750 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:49:20.750 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.435738+0000", 2024-02-19T21:49:20.750 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.89923846900000004 2024-02-19T21:49:20.750 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.751 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.751 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.751 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.334977+0000", 2024-02-19T21:49:20.751 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.4247999999999997e-05 2024-02-19T21:49:20.751 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.751 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.751 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:49:20.751 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.335061+0000", 2024-02-19T21:49:20.751 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.1379999999999997e-05 2024-02-19T21:49:20.751 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.751 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.751 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:49:20.751 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.335143+0000", 2024-02-19T21:49:20.751 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0051702670000000001 2024-02-19T21:49:20.752 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.752 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.752 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:49:20.752 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.340313+0000", 2024-02-19T21:49:20.752 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0077227069999999997 2024-02-19T21:49:20.752 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.752 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.752 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.752 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.348036+0000", 2024-02-19T21:49:20.752 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.6894e-05 2024-02-19T21:49:20.752 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.752 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.752 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.752 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.348062+0000", 2024-02-19T21:49:20.753 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.4314999999999999e-05 2024-02-19T21:49:20.753 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.753 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.753 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:49:20.753 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.348097+0000", 2024-02-19T21:49:20.753 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.1937000000000003e-05 2024-02-19T21:49:20.753 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.753 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.753 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:49:20.753 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.348129+0000", 2024-02-19T21:49:20.753 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.912461996 2024-02-19T21:49:20.753 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.753 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:20.754 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.754 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.754 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.754 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:225896 9.c 9:363f31a4:::benchmark_data_smithi080_126364_object97304:head [delete] snapc 0=[] ondisk+write+known_if_redirected e362)", 2024-02-19T21:49:20.754 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:47:45.488087+0000", 2024-02-19T21:49:20.754 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 95.125174849999993, 2024-02-19T21:49:20.754 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.86520100200000005, 2024-02-19T21:49:20.754 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:20.754 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:49:20.754 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:49:20.754 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:49:20.754 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:49:20.754 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 225896 2024-02-19T21:49:20.754 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.755 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:20.755 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.755 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:20.755 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.488087+0000", 2024-02-19T21:49:20.755 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:20.755 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.755 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.755 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:20.755 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.488087+0000", 2024-02-19T21:49:20.755 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:49:20.755 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.755 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.755 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:20.755 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.488086+0000", 2024-02-19T21:49:20.755 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.092e-06 2024-02-19T21:49:20.756 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.756 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.756 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:20.756 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.488093+0000", 2024-02-19T21:49:20.756 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.539e-05 2024-02-19T21:49:20.756 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.756 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.756 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:20.756 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.488108+0000", 2024-02-19T21:49:20.756 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.7100000000000001e-06 2024-02-19T21:49:20.756 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.757 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.757 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:20.757 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.488115+0000", 2024-02-19T21:49:20.757 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.2292000000000006e-05 2024-02-19T21:49:20.757 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.757 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.757 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.757 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.488177+0000", 2024-02-19T21:49:20.757 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1415e-05 2024-02-19T21:49:20.757 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.757 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.757 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:49:20.757 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:45.488189+0000", 2024-02-19T21:49:20.757 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.84885660799999996 2024-02-19T21:49:20.757 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.758 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.758 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:20.758 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.337045+0000", 2024-02-19T21:49:20.758 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000105615 2024-02-19T21:49:20.758 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.758 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.758 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:49:20.758 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.337151+0000", 2024-02-19T21:49:20.758 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014145499999999999 2024-02-19T21:49:20.758 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.758 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.758 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:49:20.758 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.337292+0000", 2024-02-19T21:49:20.758 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0061020110000000001 2024-02-19T21:49:20.758 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.758 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.759 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:49:20.759 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.343394+0000", 2024-02-19T21:49:20.759 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0047647030000000003 2024-02-19T21:49:20.759 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.759 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.759 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.759 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.348159+0000", 2024-02-19T21:49:20.759 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0050367379999999998 2024-02-19T21:49:20.759 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.759 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.759 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:20.759 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.353196+0000", 2024-02-19T21:49:20.759 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.8009000000000001e-05 2024-02-19T21:49:20.760 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.760 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.760 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:49:20.760 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.353244+0000", 2024-02-19T21:49:20.760 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.4508999999999997e-05 2024-02-19T21:49:20.760 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:20.760 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:20.760 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:49:20.760 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:46.353288+0000", 2024-02-19T21:49:20.760 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.86520100200000005 2024-02-19T21:49:20.760 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.760 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:20.760 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.760 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:20.761 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:20.761 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:49:20.766 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:20.903 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:49:20.906 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:49:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:49:20] "GET /metrics HTTP/1.1" 200 176382 "" "Prometheus/2.33.4" 2024-02-19T21:49:20.908 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:20.908 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:49:21.009 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:49:21.050 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:21.075 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:49:21.090 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:21.090 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:49:21.191 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:49:21.236 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:19.150712+0000 mgr.y (mgr.14514) 637 : cluster [DBG] pgmap v828: 138 pgs: 1 active+remapped+backfill_toofull, 130 active+clean, 3 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped; 1.6 GiB data, 8.2 GiB used, 618 GiB / 626 GiB avail; 1.1 KiB/s rd, 107 MiB/s wr, 1.72k op/s; 6729/80268 objects degraded (8.383%); 1/80268 objects misplaced (0.001%); 14 MiB/s, 218 objects/s recovering 2024-02-19T21:49:21.236 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:19.150712+0000 mgr.y (mgr.14514) 637 : cluster [DBG] pgmap v828: 138 pgs: 1 active+remapped+backfill_toofull, 130 active+clean, 3 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped; 1.6 GiB data, 8.2 GiB used, 618 GiB / 626 GiB avail; 1.1 KiB/s rd, 107 MiB/s wr, 1.72k op/s; 6729/80268 objects degraded (8.383%); 1/80268 objects misplaced (0.001%); 14 MiB/s, 218 objects/s recovering 2024-02-19T21:49:21.239 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:19.150712+0000 mgr.y (mgr.14514) 637 : cluster [DBG] pgmap v828: 138 pgs: 1 active+remapped+backfill_toofull, 130 active+clean, 3 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped; 1.6 GiB data, 8.2 GiB used, 618 GiB / 626 GiB avail; 1.1 KiB/s rd, 107 MiB/s wr, 1.72k op/s; 6729/80268 objects degraded (8.383%); 1/80268 objects misplaced (0.001%); 14 MiB/s, 218 objects/s recovering 2024-02-19T21:49:21.240 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:49:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:49:21.242 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:21.276 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:2024-02-19T21:49:21.278074+0000 min lat: 0.00134319 max lat: 2.47421 avg lat: 0.00959889 2024-02-19T21:49:21.277 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-19T21:49:21.277 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 20 16 33338 33322 104.107 74.5 0.00673091 0.00959889 2024-02-19T21:49:21.609 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:49:21.613 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:21.613 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:49:21.634 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.5 dump_ops_in_flight 2024-02-19T21:49:21.714 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:49:21.773 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:21.833 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:49:21.837 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:21.837 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:49:21.894 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:49:21.938 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:49:21.996 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.1 to 1 (10000) 2024-02-19T21:49:21.997 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:22.059 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:49:22.068 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:22.068 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:49:22.138 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:49:22.169 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:49:22.229 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:22.276 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 21 16 34409 34393 102.337 66.9375 0.031331 0.00976474 2024-02-19T21:49:22.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:20.878672+0000 mgr.y (mgr.14514) 638 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:49:22.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:21.573587+0000 mon.c (mon.2) 93 : audit [INF] from='client.? 172.21.15.80:0/466718054' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-02-19T21:49:22.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:21.574152+0000 mon.a (mon.0) 1598 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-02-19T21:49:22.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:20.878672+0000 mgr.y (mgr.14514) 638 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:49:22.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:21.573587+0000 mon.c (mon.2) 93 : audit [INF] from='client.? 172.21.15.80:0/466718054' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-02-19T21:49:22.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:21.574152+0000 mon.a (mon.0) 1598 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-02-19T21:49:22.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:20.878672+0000 mgr.y (mgr.14514) 638 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:49:22.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:21.573587+0000 mon.c (mon.2) 93 : audit [INF] from='client.? 172.21.15.80:0/466718054' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-02-19T21:49:22.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:21.574152+0000 mon.a (mon.0) 1598 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-02-19T21:49:22.364 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:49:22.364 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:49:22.364 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:49:22.364 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:49:22.364 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:49:22.368 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:49:22.397 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:49:22.438 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:49:22.440 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:49:22.440 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:49:22.440 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:49:22.440 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:49:22.440 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:49:22.440 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:49:22.440 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:49:22.440 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:49:22.505 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:49:22.508 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:22.509 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:49:22.610 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:49:22.679 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:23.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:21.151452+0000 mgr.y (mgr.14514) 639 : cluster [DBG] pgmap v829: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 1.9 GiB data, 9.3 GiB used, 616 GiB / 626 GiB avail; 1.7 KiB/s rd, 87 MiB/s wr, 1.40k op/s; 6407/96297 objects degraded (6.653%); 1/96297 objects misplaced (0.001%); 4.0 MiB/s, 63 objects/s recovering 2024-02-19T21:49:23.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:21.982634+0000 mon.a (mon.0) 1599 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-02-19T21:49:23.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:21.982687+0000 mon.a (mon.0) 1600 : cluster [DBG] osdmap e403: 8 total, 8 up, 7 in 2024-02-19T21:49:23.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:22.212788+0000 mon.c (mon.2) 94 : audit [DBG] from='client.? 172.21.15.80:0/3327271764' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:49:23.104 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:49:23.108 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:23.109 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:49:23.209 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:49:23.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:21.151452+0000 mgr.y (mgr.14514) 639 : cluster [DBG] pgmap v829: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 1.9 GiB data, 9.3 GiB used, 616 GiB / 626 GiB avail; 1.7 KiB/s rd, 87 MiB/s wr, 1.40k op/s; 6407/96297 objects degraded (6.653%); 1/96297 objects misplaced (0.001%); 4.0 MiB/s, 63 objects/s recovering 2024-02-19T21:49:23.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:21.982634+0000 mon.a (mon.0) 1599 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-02-19T21:49:23.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:21.982687+0000 mon.a (mon.0) 1600 : cluster [DBG] osdmap e403: 8 total, 8 up, 7 in 2024-02-19T21:49:23.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:22.212788+0000 mon.c (mon.2) 94 : audit [DBG] from='client.? 172.21.15.80:0/3327271764' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:49:23.243 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:21.151452+0000 mgr.y (mgr.14514) 639 : cluster [DBG] pgmap v829: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 1.9 GiB data, 9.3 GiB used, 616 GiB / 626 GiB avail; 1.7 KiB/s rd, 87 MiB/s wr, 1.40k op/s; 6407/96297 objects degraded (6.653%); 1/96297 objects misplaced (0.001%); 4.0 MiB/s, 63 objects/s recovering 2024-02-19T21:49:23.243 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:21.982634+0000 mon.a (mon.0) 1599 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-02-19T21:49:23.243 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:21.982687+0000 mon.a (mon.0) 1600 : cluster [DBG] osdmap e403: 8 total, 8 up, 7 in 2024-02-19T21:49:23.243 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:22.212788+0000 mon.c (mon.2) 94 : audit [DBG] from='client.? 172.21.15.80:0/3327271764' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:49:23.248 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:23.276 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 22 16 35617 35601 101.117 75.5 0.00808859 0.0098827 2024-02-19T21:49:23.404 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:49:23.407 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:23.408 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:49:23.509 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:49:23.586 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:23.704 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:49:23.710 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:23.711 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:49:23.812 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:49:23.850 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:24.277 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 23 16 36829 36813 100.014 75.75 0.00719751 0.00999164 2024-02-19T21:49:24.432 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:49:24.432 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:49:24.519 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:49:24.523 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:24.523 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:49:24.540 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd reweight 4 1 2024-02-19T21:49:24.624 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:49:24.683 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:24.721 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:49:24.727 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:24.728 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:49:24.829 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:49:24.870 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:25.267 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.5 dump_blocked_ops 2024-02-19T21:49:25.277 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 24 16 37959 37943 98.7892 70.625 0.0206166 0.010116 2024-02-19T21:49:25.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:23.151923+0000 mgr.y (mgr.14514) 640 : cluster [DBG] pgmap v831: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 1.9 GiB data, 9.5 GiB used, 616 GiB / 626 GiB avail; 760 B/s rd, 50 MiB/s wr, 794 op/s; 6407/96297 objects degraded (6.653%); 1/96297 objects misplaced (0.001%); 3.0 MiB/s, 47 objects/s recovering 2024-02-19T21:49:25.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:23.151923+0000 mgr.y (mgr.14514) 640 : cluster [DBG] pgmap v831: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 1.9 GiB data, 9.5 GiB used, 616 GiB / 626 GiB avail; 760 B/s rd, 50 MiB/s wr, 794 op/s; 6407/96297 objects degraded (6.653%); 1/96297 objects misplaced (0.001%); 3.0 MiB/s, 47 objects/s recovering 2024-02-19T21:49:25.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:23.151923+0000 mgr.y (mgr.14514) 640 : cluster [DBG] pgmap v831: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 1.9 GiB data, 9.5 GiB used, 616 GiB / 626 GiB avail; 760 B/s rd, 50 MiB/s wr, 794 op/s; 6407/96297 objects degraded (6.653%); 1/96297 objects misplaced (0.001%); 3.0 MiB/s, 47 objects/s recovering 2024-02-19T21:49:25.622 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:49:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:49:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:49:25.723 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:49:25.879 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:49:26.277 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 25 16 38966 38950 97.3551 62.9375 0.00666325 0.0102662 2024-02-19T21:49:26.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:25.247953+0000 mon.a (mon.0) 1601 : cluster [WRN] Health check update: Degraded data redundancy: 6407/96297 objects degraded (6.653%), 6 pgs degraded (PG_DEGRADED) 2024-02-19T21:49:26.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:25.256505+0000 mon.a (mon.0) 1602 : cluster [DBG] osdmap e404: 8 total, 8 up, 7 in 2024-02-19T21:49:26.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:25.247953+0000 mon.a (mon.0) 1601 : cluster [WRN] Health check update: Degraded data redundancy: 6407/96297 objects degraded (6.653%), 6 pgs degraded (PG_DEGRADED) 2024-02-19T21:49:26.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:25.256505+0000 mon.a (mon.0) 1602 : cluster [DBG] osdmap e404: 8 total, 8 up, 7 in 2024-02-19T21:49:26.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:25.247953+0000 mon.a (mon.0) 1601 : cluster [WRN] Health check update: Degraded data redundancy: 6407/96297 objects degraded (6.653%), 6 pgs degraded (PG_DEGRADED) 2024-02-19T21:49:26.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:25.256505+0000 mon.a (mon.0) 1602 : cluster [DBG] osdmap e404: 8 total, 8 up, 7 in 2024-02-19T21:49:27.277 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 26 16 40168 40152 96.5 75.125 0.0136651 0.0103548 2024-02-19T21:49:27.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:25.152577+0000 mgr.y (mgr.14514) 641 : cluster [DBG] pgmap v832: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 2.2 GiB data, 9.9 GiB used, 616 GiB / 626 GiB avail; 639 B/s rd, 70 MiB/s wr, 1.13k op/s; 6350/107286 objects degraded (5.919%); 1/107286 objects misplaced (0.001%); 3.0 MiB/s, 47 objects/s recovering 2024-02-19T21:49:27.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:25.152577+0000 mgr.y (mgr.14514) 641 : cluster [DBG] pgmap v832: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 2.2 GiB data, 9.9 GiB used, 616 GiB / 626 GiB avail; 639 B/s rd, 70 MiB/s wr, 1.13k op/s; 6350/107286 objects degraded (5.919%); 1/107286 objects misplaced (0.001%); 3.0 MiB/s, 47 objects/s recovering 2024-02-19T21:49:27.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:25.152577+0000 mgr.y (mgr.14514) 641 : cluster [DBG] pgmap v832: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 2.2 GiB data, 9.9 GiB used, 616 GiB / 626 GiB avail; 639 B/s rd, 70 MiB/s wr, 1.13k op/s; 6350/107286 objects degraded (5.919%); 1/107286 objects misplaced (0.001%); 3.0 MiB/s, 47 objects/s recovering 2024-02-19T21:49:28.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:27.153182+0000 mgr.y (mgr.14514) 642 : cluster [DBG] pgmap v834: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 2.3 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1.2 KiB/s rd, 87 MiB/s wr, 1.40k op/s; 6234/113733 objects degraded (5.481%); 1/113733 objects misplaced (0.001%); 3.9 MiB/s, 61 objects/s recovering 2024-02-19T21:49:28.173 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:49:28.173 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:49:28.277 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 27 16 41284 41268 95.5092 69.75 0.0169055 0.0104619 2024-02-19T21:49:28.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:27.153182+0000 mgr.y (mgr.14514) 642 : cluster [DBG] pgmap v834: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 2.3 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1.2 KiB/s rd, 87 MiB/s wr, 1.40k op/s; 6234/113733 objects degraded (5.481%); 1/113733 objects misplaced (0.001%); 3.9 MiB/s, 61 objects/s recovering 2024-02-19T21:49:28.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:27.153182+0000 mgr.y (mgr.14514) 642 : cluster [DBG] pgmap v834: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 2.3 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1.2 KiB/s rd, 87 MiB/s wr, 1.40k op/s; 6234/113733 objects degraded (5.481%); 1/113733 objects misplaced (0.001%); 3.9 MiB/s, 61 objects/s recovering 2024-02-19T21:49:29.065 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.5 dump_historic_ops 2024-02-19T21:49:29.277 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 28 16 42383 42367 94.5511 68.6875 0.0272507 0.0105706 2024-02-19T21:49:29.545 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:49:29.920 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:49:29.923 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:49:29.925 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:29.926 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:49:30.027 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:49:30.113 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:30.206 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:29.153586+0000 mgr.y (mgr.14514) 643 : cluster [DBG] pgmap v835: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 2.3 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 639 B/s rd, 45 MiB/s wr, 726 op/s; 6234/113733 objects degraded (5.481%); 1/113733 objects misplaced (0.001%); 1.4 MiB/s, 21 objects/s recovering 2024-02-19T21:49:30.206 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:29.153586+0000 mgr.y (mgr.14514) 643 : cluster [DBG] pgmap v835: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 2.3 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 639 B/s rd, 45 MiB/s wr, 726 op/s; 6234/113733 objects degraded (5.481%); 1/113733 objects misplaced (0.001%); 1.4 MiB/s, 21 objects/s recovering 2024-02-19T21:49:30.249 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:49:30.252 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:30.252 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:49:30.277 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 29 16 43359 43343 93.3941 61 0.0132031 0.0106996 2024-02-19T21:49:30.355 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:49:30.394 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:30.459 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:49:30.465 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:30.465 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:49:30.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:29.153586+0000 mgr.y (mgr.14514) 643 : cluster [DBG] pgmap v835: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 2.3 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 639 B/s rd, 45 MiB/s wr, 726 op/s; 6234/113733 objects degraded (5.481%); 1/113733 objects misplaced (0.001%); 1.4 MiB/s, 21 objects/s recovering 2024-02-19T21:49:30.566 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:49:30.619 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:30.771 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:49:30.775 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:49:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:49:30] "GET /metrics HTTP/1.1" 200 176382 "" "Prometheus/2.33.4" 2024-02-19T21:49:30.899 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:49:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:49:31.196 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:49:31.200 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:31.200 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:49:31.277 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 30 16 44428 44412 92.5081 66.8125 0.0176286 0.0108021 2024-02-19T21:49:31.283 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-02-19T21:49:31.301 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:49:31.355 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:31.461 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:30.249885+0000 mon.a (mon.0) 1603 : cluster [WRN] Health check update: Degraded data redundancy: 6234/113733 objects degraded (5.481%), 6 pgs degraded (PG_DEGRADED) 2024-02-19T21:49:31.461 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:30.895698+0000 mgr.y (mgr.14514) 644 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:49:31.461 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:31.098060+0000 mon.c (mon.2) 95 : audit [INF] from='client.? 172.21.15.80:0/1546635374' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:49:31.461 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:31.098878+0000 mon.a (mon.0) 1604 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:49:31.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:30.249885+0000 mon.a (mon.0) 1603 : cluster [WRN] Health check update: Degraded data redundancy: 6234/113733 objects degraded (5.481%), 6 pgs degraded (PG_DEGRADED) 2024-02-19T21:49:31.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:30.895698+0000 mgr.y (mgr.14514) 644 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:49:31.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:31.098060+0000 mon.c (mon.2) 95 : audit [INF] from='client.? 172.21.15.80:0/1546635374' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:49:31.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:31.098878+0000 mon.a (mon.0) 1604 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:49:31.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:30.249885+0000 mon.a (mon.0) 1603 : cluster [WRN] Health check update: Degraded data redundancy: 6234/113733 objects degraded (5.481%), 6 pgs degraded (PG_DEGRADED) 2024-02-19T21:49:31.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:30.895698+0000 mgr.y (mgr.14514) 644 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:49:31.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:31.098060+0000 mon.c (mon.2) 95 : audit [INF] from='client.? 172.21.15.80:0/1546635374' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:49:31.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:31.098878+0000 mon.a (mon.0) 1604 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:49:32.217 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:31.154460+0000 mgr.y (mgr.14514) 645 : cluster [DBG] pgmap v836: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 2.6 GiB data, 11 GiB used, 614 GiB / 626 GiB avail; 1.1 KiB/s rd, 77 MiB/s wr, 1.23k op/s; 6061/130092 objects degraded (4.659%); 1/130092 objects misplaced (0.001%); 2.4 MiB/s, 37 objects/s recovering 2024-02-19T21:49:32.217 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:31.255010+0000 mon.a (mon.0) 1605 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:49:32.217 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:31.269738+0000 mon.a (mon.0) 1606 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:49:32.217 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:31.269804+0000 mon.a (mon.0) 1607 : cluster [DBG] osdmap e405: 8 total, 8 up, 7 in 2024-02-19T21:49:32.277 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 31 16 45569 45553 91.8243 71.3125 0.0071466 0.0108813 2024-02-19T21:49:32.413 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:49:32.419 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:32.419 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:49:32.520 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:49:32.549 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:31.154460+0000 mgr.y (mgr.14514) 645 : cluster [DBG] pgmap v836: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 2.6 GiB data, 11 GiB used, 614 GiB / 626 GiB avail; 1.1 KiB/s rd, 77 MiB/s wr, 1.23k op/s; 6061/130092 objects degraded (4.659%); 1/130092 objects misplaced (0.001%); 2.4 MiB/s, 37 objects/s recovering 2024-02-19T21:49:32.549 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:31.255010+0000 mon.a (mon.0) 1605 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:49:32.549 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:31.269738+0000 mon.a (mon.0) 1606 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:49:32.549 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:31.269804+0000 mon.a (mon.0) 1607 : cluster [DBG] osdmap e405: 8 total, 8 up, 7 in 2024-02-19T21:49:32.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:31.154460+0000 mgr.y (mgr.14514) 645 : cluster [DBG] pgmap v836: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 2.6 GiB data, 11 GiB used, 614 GiB / 626 GiB avail; 1.1 KiB/s rd, 77 MiB/s wr, 1.23k op/s; 6061/130092 objects degraded (4.659%); 1/130092 objects misplaced (0.001%); 2.4 MiB/s, 37 objects/s recovering 2024-02-19T21:49:32.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:31.255010+0000 mon.a (mon.0) 1605 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:49:32.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:31.269738+0000 mon.a (mon.0) 1606 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:49:32.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:31.269804+0000 mon.a (mon.0) 1607 : cluster [DBG] osdmap e405: 8 total, 8 up, 7 in 2024-02-19T21:49:32.550 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:32.708 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:49:32.714 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:32.714 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:49:32.727 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:49:32.727 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:49:32.815 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:49:32.891 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:33.020 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:49:33.024 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:33.024 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:49:33.125 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:49:33.206 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:33.261 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:49:33.277 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 32 16 46575 46559 90.9195 62.875 0.0116319 0.010992 2024-02-19T21:49:33.279 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:33.281 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:49:33.381 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:49:33.444 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:33.662 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:49:33.668 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:33.669 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:49:33.688 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.6 dump_ops_in_flight 2024-02-19T21:49:33.770 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:49:33.808 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:33.834 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:49:33.838 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:33.839 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:49:33.939 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:49:34.022 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:34.054 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:49:34.057 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:34.057 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:49:34.158 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:49:34.224 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:34.248 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.4 to 1 (10000) 2024-02-19T21:49:34.277 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 33 16 47538 47522 89.9882 60.1875 0.0270318 0.0111061 2024-02-19T21:49:34.285 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:49:34.294 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:49:34.298 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:33.075089+0000 osd.6 (osd.6) 238 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:49:34.298 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:33.075145+0000 osd.6 (osd.6) 239 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:49:34.298 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:33.154967+0000 mgr.y (mgr.14514) 646 : cluster [DBG] pgmap v838: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 2.6 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 1.2 KiB/s rd, 59 MiB/s wr, 951 op/s; 6061/130092 objects degraded (4.659%); 1/130092 objects misplaced (0.001%); 2.3 MiB/s, 36 objects/s recovering 2024-02-19T21:49:34.298 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:33.235659+0000 mon.a (mon.0) 1608 : cluster [DBG] osdmap e406: 8 total, 8 up, 7 in 2024-02-19T21:49:34.299 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:33.797633+0000 mon.c (mon.2) 96 : audit [INF] from='client.? 172.21.15.80:0/1890611195' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-02-19T21:49:34.299 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:33.797935+0000 mon.a (mon.0) 1609 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-02-19T21:49:34.299 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:34.300 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:49:34.400 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:49:34.437 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:34.497 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:49:34.498 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:33.075089+0000 osd.6 (osd.6) 238 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:49:34.499 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:33.075145+0000 osd.6 (osd.6) 239 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:49:34.499 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:33.154967+0000 mgr.y (mgr.14514) 646 : cluster [DBG] pgmap v838: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 2.6 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 1.2 KiB/s rd, 59 MiB/s wr, 951 op/s; 6061/130092 objects degraded (4.659%); 1/130092 objects misplaced (0.001%); 2.3 MiB/s, 36 objects/s recovering 2024-02-19T21:49:34.499 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:33.235659+0000 mon.a (mon.0) 1608 : cluster [DBG] osdmap e406: 8 total, 8 up, 7 in 2024-02-19T21:49:34.499 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:33.797633+0000 mon.c (mon.2) 96 : audit [INF] from='client.? 172.21.15.80:0/1890611195' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-02-19T21:49:34.499 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:33.797935+0000 mon.a (mon.0) 1609 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-02-19T21:49:34.499 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:33.075089+0000 osd.6 (osd.6) 238 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:49:34.499 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:33.075145+0000 osd.6 (osd.6) 239 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:49:34.500 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:33.154967+0000 mgr.y (mgr.14514) 646 : cluster [DBG] pgmap v838: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 2.6 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 1.2 KiB/s rd, 59 MiB/s wr, 951 op/s; 6061/130092 objects degraded (4.659%); 1/130092 objects misplaced (0.001%); 2.3 MiB/s, 36 objects/s recovering 2024-02-19T21:49:34.500 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:33.235659+0000 mon.a (mon.0) 1608 : cluster [DBG] osdmap e406: 8 total, 8 up, 7 in 2024-02-19T21:49:34.500 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:33.797633+0000 mon.c (mon.2) 96 : audit [INF] from='client.? 172.21.15.80:0/1890611195' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-02-19T21:49:34.500 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:33.797935+0000 mon.a (mon.0) 1609 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-02-19T21:49:34.501 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:34.502 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:49:34.602 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:49:34.687 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:34.719 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:49:34.725 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:34.725 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:49:34.826 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:49:34.862 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:34.982 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd reweight 5 1 2024-02-19T21:49:35.177 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset noscrub 2024-02-19T21:49:35.221 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:49:35.234 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:35.234 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:49:35.270 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:34.242913+0000 mon.a (mon.0) 1610 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-02-19T21:49:35.270 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:34.242975+0000 mon.a (mon.0) 1611 : cluster [DBG] osdmap e407: 8 total, 8 up, 7 in 2024-02-19T21:49:35.278 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 34 16 48553 48537 89.2069 63.4375 0.0107758 0.0112025 2024-02-19T21:49:35.335 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:49:35.418 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:35.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:34.242913+0000 mon.a (mon.0) 1610 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-02-19T21:49:35.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:34.242975+0000 mon.a (mon.0) 1611 : cluster [DBG] osdmap e407: 8 total, 8 up, 7 in 2024-02-19T21:49:35.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:34.242913+0000 mon.a (mon.0) 1610 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-02-19T21:49:35.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:34.242975+0000 mon.a (mon.0) 1611 : cluster [DBG] osdmap e407: 8 total, 8 up, 7 in 2024-02-19T21:49:35.627 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:49:35.632 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:49:35.640 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:49:35.658 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:49:35.695 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:49:35.721 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:49:35.758 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:49:35.793 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:49:35.806 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:49:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:49:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:49:35.835 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:49:35.863 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:49:35.866 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:49:35.866 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:49:35.866 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:49:35.867 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:49:35.867 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:49:35.867 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:49:35.867 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:49:35.867 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:49:35.998 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:49:36.010 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:36.011 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:49:36.112 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:49:36.180 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:36.273 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:35.155639+0000 mgr.y (mgr.14514) 647 : cluster [DBG] pgmap v841: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 2.8 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 853 B/s rd, 90 MiB/s wr, 1.45k op/s; 6006/139770 objects degraded (4.297%); 1/139770 objects misplaced (0.001%); 2.4 MiB/s, 37 objects/s recovering 2024-02-19T21:49:36.273 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:35.251892+0000 mon.a (mon.0) 1612 : cluster [WRN] Health check update: Degraded data redundancy: 6061/130092 objects degraded (4.659%), 6 pgs degraded (PG_DEGRADED) 2024-02-19T21:49:36.274 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:35.280386+0000 mon.a (mon.0) 1613 : cluster [DBG] osdmap e408: 8 total, 8 up, 7 in 2024-02-19T21:49:36.274 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:35.592389+0000 mon.a (mon.0) 1614 : audit [DBG] from='client.? 172.21.15.80:0/1696119313' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:49:36.279 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 35 16 49555 49539 88.4474 62.625 0.0116747 0.0113002 2024-02-19T21:49:36.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:35.155639+0000 mgr.y (mgr.14514) 647 : cluster [DBG] pgmap v841: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 2.8 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 853 B/s rd, 90 MiB/s wr, 1.45k op/s; 6006/139770 objects degraded (4.297%); 1/139770 objects misplaced (0.001%); 2.4 MiB/s, 37 objects/s recovering 2024-02-19T21:49:36.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:35.251892+0000 mon.a (mon.0) 1612 : cluster [WRN] Health check update: Degraded data redundancy: 6061/130092 objects degraded (4.659%), 6 pgs degraded (PG_DEGRADED) 2024-02-19T21:49:36.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:35.280386+0000 mon.a (mon.0) 1613 : cluster [DBG] osdmap e408: 8 total, 8 up, 7 in 2024-02-19T21:49:36.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:35.592389+0000 mon.a (mon.0) 1614 : audit [DBG] from='client.? 172.21.15.80:0/1696119313' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:49:36.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:35.155639+0000 mgr.y (mgr.14514) 647 : cluster [DBG] pgmap v841: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 2.8 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 853 B/s rd, 90 MiB/s wr, 1.45k op/s; 6006/139770 objects degraded (4.297%); 1/139770 objects misplaced (0.001%); 2.4 MiB/s, 37 objects/s recovering 2024-02-19T21:49:36.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:35.251892+0000 mon.a (mon.0) 1612 : cluster [WRN] Health check update: Degraded data redundancy: 6061/130092 objects degraded (4.659%), 6 pgs degraded (PG_DEGRADED) 2024-02-19T21:49:36.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:35.280386+0000 mon.a (mon.0) 1613 : cluster [DBG] osdmap e408: 8 total, 8 up, 7 in 2024-02-19T21:49:36.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:35.592389+0000 mon.a (mon.0) 1614 : audit [DBG] from='client.? 172.21.15.80:0/1696119313' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:49:37.278 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 36 16 50614 50598 87.829 66.1875 0.0104834 0.0113802 2024-02-19T21:49:37.950 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:49:37.954 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:37.955 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:49:38.055 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:49:38.141 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:38.278 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 37 16 51622 51606 87.1578 63 0.0150453 0.0114679 2024-02-19T21:49:38.298 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:49:38.304 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:38.305 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:49:38.406 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:49:38.487 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:38.498 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:49:38.498 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [ 2024-02-19T21:49:38.498 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.498 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:51777 10.0 10:055d315c:::benchmark_data_smithi080_153340_object51776:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e409)", 2024-02-19T21:49:38.499 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:38.472348+0000", 2024-02-19T21:49:38.499 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.0200199, 2024-02-19T21:49:38.499 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.020052896000000001, 2024-02-19T21:49:38.499 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:38.499 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:49:38.499 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:49:38.499 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:49:38.499 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:49:38.499 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 51777 2024-02-19T21:49:38.499 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.499 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:38.499 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.499 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:38.499 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.472348+0000", 2024-02-19T21:49:38.500 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:38.500 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.500 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.500 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:38.500 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.472348+0000", 2024-02-19T21:49:38.500 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:49:38.500 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.500 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.500 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:38.500 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.472346+0000", 2024-02-19T21:49:38.500 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.5294999999999999e-05 2024-02-19T21:49:38.500 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.500 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.500 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:38.501 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.472391+0000", 2024-02-19T21:49:38.501 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.5138e-05 2024-02-19T21:49:38.501 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.501 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.501 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:38.501 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.472407+0000", 2024-02-19T21:49:38.501 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.9099999999999999e-06 2024-02-19T21:49:38.501 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.501 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.501 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:38.501 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.472413+0000", 2024-02-19T21:49:38.501 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0063909509999999998 2024-02-19T21:49:38.501 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.501 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.501 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:38.502 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478804+0000", 2024-02-19T21:49:38.502 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000114195 2024-02-19T21:49:38.502 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.502 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.502 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:49:38.502 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478919+0000", 2024-02-19T21:49:38.502 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000142068 2024-02-19T21:49:38.502 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.503 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.503 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,4", 2024-02-19T21:49:38.503 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.479061+0000", 2024-02-19T21:49:38.503 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.011979616 2024-02-19T21:49:38.503 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.504 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.504 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:49:38.504 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.491040+0000", 2024-02-19T21:49:38.504 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.018692434000000001 2024-02-19T21:49:38.504 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:38.504 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:38.505 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:38.505 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.505 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.505 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:51781 10.0 10:08b350b5:::benchmark_data_smithi080_153340_object51780:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e409)", 2024-02-19T21:49:38.505 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:38.478297+0000", 2024-02-19T21:49:38.505 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.014070539, 2024-02-19T21:49:38.505 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.014197675999999999, 2024-02-19T21:49:38.505 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:38.505 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:49:38.506 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:49:38.506 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:49:38.506 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:49:38.506 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 51781 2024-02-19T21:49:38.506 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.506 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:38.506 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.506 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:38.506 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478297+0000", 2024-02-19T21:49:38.506 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:38.506 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.506 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.506 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:38.507 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478297+0000", 2024-02-19T21:49:38.507 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:49:38.507 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.507 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.507 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:38.508 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478296+0000", 2024-02-19T21:49:38.508 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0779000000000003e-05 2024-02-19T21:49:38.508 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.508 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.508 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:38.508 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478347+0000", 2024-02-19T21:49:38.509 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.0061e-05 2024-02-19T21:49:38.509 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.509 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.509 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:38.509 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478367+0000", 2024-02-19T21:49:38.509 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.5900000000000008e-06 2024-02-19T21:49:38.509 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.509 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.509 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:38.509 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478375+0000", 2024-02-19T21:49:38.509 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0024553069999999999 2024-02-19T21:49:38.509 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.509 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.509 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:38.510 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.480831+0000", 2024-02-19T21:49:38.510 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000117588 2024-02-19T21:49:38.510 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.510 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.510 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:49:38.510 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.480948+0000", 2024-02-19T21:49:38.510 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.2309e-05 2024-02-19T21:49:38.510 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.510 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.510 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,4", 2024-02-19T21:49:38.510 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.481040+0000", 2024-02-19T21:49:38.510 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.010006699000000001 2024-02-19T21:49:38.510 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.510 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.511 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:49:38.511 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.491047+0000", 2024-02-19T21:49:38.511 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.012749912 2024-02-19T21:49:38.511 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:38.511 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:38.511 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:38.511 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.511 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.511 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:51783 10.f 10:fcd12fc4:::benchmark_data_smithi080_153340_object51782:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e409)", 2024-02-19T21:49:38.511 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:38.478385+0000", 2024-02-19T21:49:38.511 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.013983224000000001, 2024-02-19T21:49:38.511 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.014196184000000001, 2024-02-19T21:49:38.511 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:38.512 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:49:38.512 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:49:38.512 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:49:38.512 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:49:38.512 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 51783 2024-02-19T21:49:38.512 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.512 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:38.512 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.512 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:38.512 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478385+0000", 2024-02-19T21:49:38.512 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:38.512 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.512 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.513 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:38.513 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478385+0000", 2024-02-19T21:49:38.513 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:49:38.513 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.513 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.513 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:38.513 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478384+0000", 2024-02-19T21:49:38.513 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.6378000000000003e-05 2024-02-19T21:49:38.513 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.513 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.513 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:38.513 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478420+0000", 2024-02-19T21:49:38.513 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.5660000000000001e-06 2024-02-19T21:49:38.513 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.514 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.514 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:38.514 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478428+0000", 2024-02-19T21:49:38.514 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.5589999999999999e-06 2024-02-19T21:49:38.514 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.514 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.514 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:38.514 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478432+0000", 2024-02-19T21:49:38.514 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.6229000000000001e-05 2024-02-19T21:49:38.514 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.514 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.514 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:38.514 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478479+0000", 2024-02-19T21:49:38.514 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000177271 2024-02-19T21:49:38.514 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.515 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.515 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:49:38.515 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478656+0000", 2024-02-19T21:49:38.515 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00020298700000000001 2024-02-19T21:49:38.515 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.515 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.515 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 2,4", 2024-02-19T21:49:38.515 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478859+0000", 2024-02-19T21:49:38.515 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.012233279 2024-02-19T21:49:38.515 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.515 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.515 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:49:38.515 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.491092+0000", 2024-02-19T21:49:38.516 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.012707665 2024-02-19T21:49:38.516 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:38.516 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:38.516 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:38.516 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.516 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.516 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:51785 10.b 10:d6f60736:::benchmark_data_smithi080_153340_object51784:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e409)", 2024-02-19T21:49:38.516 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:38.478446+0000", 2024-02-19T21:49:38.516 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.013922131000000001, 2024-02-19T21:49:38.516 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.014192735, 2024-02-19T21:49:38.516 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:38.516 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:49:38.516 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:49:38.517 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:49:38.517 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:49:38.517 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 51785 2024-02-19T21:49:38.517 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.517 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:38.517 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.517 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:38.517 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478446+0000", 2024-02-19T21:49:38.517 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:38.517 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.517 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.517 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:38.517 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478446+0000", 2024-02-19T21:49:38.517 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:49:38.518 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.518 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.518 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:38.518 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478445+0000", 2024-02-19T21:49:38.518 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.7926000000000002e-05 2024-02-19T21:49:38.518 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.518 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.518 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:38.518 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478483+0000", 2024-02-19T21:49:38.518 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.2509999999999997e-06 2024-02-19T21:49:38.518 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.518 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.518 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:38.518 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478490+0000", 2024-02-19T21:49:38.518 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.369e-06 2024-02-19T21:49:38.519 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.519 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.519 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:38.519 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478495+0000", 2024-02-19T21:49:38.519 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0056061139999999997 2024-02-19T21:49:38.519 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.519 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.519 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:38.519 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.484101+0000", 2024-02-19T21:49:38.519 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00011738100000000001 2024-02-19T21:49:38.519 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.519 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.519 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:49:38.519 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.484218+0000", 2024-02-19T21:49:38.520 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000143938 2024-02-19T21:49:38.520 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.520 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.520 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:49:38.520 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.484362+0000", 2024-02-19T21:49:38.520 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0067633650000000003 2024-02-19T21:49:38.520 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.520 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.520 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:49:38.520 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.491125+0000", 2024-02-19T21:49:38.520 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0013952050000000001 2024-02-19T21:49:38.520 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.520 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.520 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:38.521 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.492521+0000", 2024-02-19T21:49:38.521 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.014075018999999999 2024-02-19T21:49:38.521 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:38.521 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:38.521 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:38.521 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.521 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.521 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:51786 10.b 10:da9bf35a:::benchmark_data_smithi080_153340_object51785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e409)", 2024-02-19T21:49:38.521 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:38.478509+0000", 2024-02-19T21:49:38.521 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.013858785, 2024-02-19T21:49:38.521 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.01419431, 2024-02-19T21:49:38.521 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:38.521 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:49:38.521 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:49:38.521 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:49:38.522 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:49:38.522 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 51786 2024-02-19T21:49:38.522 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.522 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:38.522 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.522 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:38.522 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478509+0000", 2024-02-19T21:49:38.522 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:38.522 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.522 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.522 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:38.522 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478509+0000", 2024-02-19T21:49:38.522 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:49:38.522 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.522 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.522 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:38.523 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478508+0000", 2024-02-19T21:49:38.523 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.3730999999999999e-05 2024-02-19T21:49:38.523 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.523 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.523 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:38.523 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478542+0000", 2024-02-19T21:49:38.523 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.255e-06 2024-02-19T21:49:38.523 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.523 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.523 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:38.523 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478549+0000", 2024-02-19T21:49:38.523 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.2740000000000001e-06 2024-02-19T21:49:38.523 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.523 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.523 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:38.524 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478554+0000", 2024-02-19T21:49:38.524 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0075738740000000004 2024-02-19T21:49:38.524 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.524 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.524 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:38.524 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.486128+0000", 2024-02-19T21:49:38.524 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000111328 2024-02-19T21:49:38.524 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.525 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.525 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:49:38.525 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.486239+0000", 2024-02-19T21:49:38.525 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000150696 2024-02-19T21:49:38.525 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.525 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.525 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:49:38.525 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.486390+0000", 2024-02-19T21:49:38.525 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0047413610000000004 2024-02-19T21:49:38.525 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.525 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.526 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:49:38.526 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.491131+0000", 2024-02-19T21:49:38.526 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.012622002 2024-02-19T21:49:38.526 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:38.526 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:38.526 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:38.526 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.526 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.527 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:51787 10.0 10:00dda6ca:::benchmark_data_smithi080_153340_object51786:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e409)", 2024-02-19T21:49:38.527 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:38.478559+0000", 2024-02-19T21:49:38.527 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.013809131000000001, 2024-02-19T21:49:38.527 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.014196693999999999, 2024-02-19T21:49:38.527 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:38.528 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:49:38.528 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:49:38.528 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:49:38.528 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:49:38.528 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 51787 2024-02-19T21:49:38.528 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.528 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:38.528 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.528 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:38.529 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478559+0000", 2024-02-19T21:49:38.529 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:38.529 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.529 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.529 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:38.529 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478559+0000", 2024-02-19T21:49:38.529 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:49:38.529 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.529 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.529 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:38.529 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478558+0000", 2024-02-19T21:49:38.529 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.5357e-05 2024-02-19T21:49:38.529 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.530 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.530 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:38.530 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478594+0000", 2024-02-19T21:49:38.530 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.3010000000000003e-06 2024-02-19T21:49:38.530 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.530 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.530 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:38.530 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478600+0000", 2024-02-19T21:49:38.530 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.335e-06 2024-02-19T21:49:38.530 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.530 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.530 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:38.531 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.478604+0000", 2024-02-19T21:49:38.531 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0040781639999999996 2024-02-19T21:49:38.531 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.531 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.531 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:38.531 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.482682+0000", 2024-02-19T21:49:38.531 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00010422800000000001 2024-02-19T21:49:38.531 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.531 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.531 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:49:38.531 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.482787+0000", 2024-02-19T21:49:38.531 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013523100000000001 2024-02-19T21:49:38.532 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.532 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.532 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,4", 2024-02-19T21:49:38.532 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.482922+0000", 2024-02-19T21:49:38.532 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0081311660000000004 2024-02-19T21:49:38.533 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.533 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.533 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:49:38.533 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.491053+0000", 2024-02-19T21:49:38.533 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.012494362 2024-02-19T21:49:38.534 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:38.534 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:38.534 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:38.534 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.534 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.534 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:51791 10.a 10:5cc43329:::benchmark_data_smithi080_153340_object51790:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e409)", 2024-02-19T21:49:38.534 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:38.481312+0000", 2024-02-19T21:49:38.534 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.011056101, 2024-02-19T21:49:38.534 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.011496411999999999, 2024-02-19T21:49:38.534 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:38.534 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:49:38.535 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:49:38.535 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:49:38.535 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:49:38.535 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 51791 2024-02-19T21:49:38.535 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.536 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:38.536 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.536 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:38.536 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.481312+0000", 2024-02-19T21:49:38.536 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:38.536 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.536 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.536 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:38.537 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.481312+0000", 2024-02-19T21:49:38.537 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:49:38.537 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.537 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.537 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:38.537 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.481310+0000", 2024-02-19T21:49:38.537 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.6822000000000001e-05 2024-02-19T21:49:38.538 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.538 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.538 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:38.538 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.481347+0000", 2024-02-19T21:49:38.538 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0848e-05 2024-02-19T21:49:38.538 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.538 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.538 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:38.538 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.481358+0000", 2024-02-19T21:49:38.539 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.9050000000000002e-06 2024-02-19T21:49:38.539 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.539 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.539 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:38.539 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.481364+0000", 2024-02-19T21:49:38.539 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00032508100000000001 2024-02-19T21:49:38.539 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.539 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.539 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:38.539 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.481689+0000", 2024-02-19T21:49:38.539 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000111357 2024-02-19T21:49:38.539 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.540 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.540 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:49:38.540 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.481800+0000", 2024-02-19T21:49:38.540 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000135928 2024-02-19T21:49:38.540 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.541 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.541 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:49:38.541 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.481936+0000", 2024-02-19T21:49:38.541 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0091553030000000001 2024-02-19T21:49:38.541 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.541 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.541 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:49:38.541 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.491092+0000", 2024-02-19T21:49:38.541 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0014451539999999999 2024-02-19T21:49:38.541 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.541 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.541 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:49:38.542 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.492537+0000", 2024-02-19T21:49:38.542 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.011225077 2024-02-19T21:49:38.542 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:38.542 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:38.542 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:38.542 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.542 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.542 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_repop_reply(client.25511.0:51791 10.a e409/385 ondisk, result = 0)", 2024-02-19T21:49:38.542 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:38.492673+0000", 2024-02-19T21:49:38.542 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 4294967295.9996948, 2024-02-19T21:49:38.542 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00020915199999999999, 2024-02-19T21:49:38.542 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:38.543 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "started", 2024-02-19T21:49:38.543 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:38.543 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.543 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:38.543 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.492673+0000", 2024-02-19T21:49:38.543 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:38.543 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.543 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.543 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:38.543 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.492673+0000", 2024-02-19T21:49:38.543 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:49:38.543 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.543 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.544 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:38.544 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.492673+0000", 2024-02-19T21:49:38.544 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.151e-06 2024-02-19T21:49:38.544 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.544 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.544 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:38.544 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.492676+0000", 2024-02-19T21:49:38.544 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.1899999999999995e-06 2024-02-19T21:49:38.544 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.544 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.544 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:38.544 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.492684+0000", 2024-02-19T21:49:38.544 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0570000000000003e-06 2024-02-19T21:49:38.545 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.545 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.545 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:38.545 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.492688+0000", 2024-02-19T21:49:38.545 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00015637600000000001 2024-02-19T21:49:38.546 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.546 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.546 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:38.546 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.492845+0000", 2024-02-19T21:49:38.546 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.755e-06 2024-02-19T21:49:38.546 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.546 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.546 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:49:38.546 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.492850+0000", 2024-02-19T21:49:38.546 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00017714299999999999 2024-02-19T21:49:38.546 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:38.546 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:38.547 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:38.547 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.547 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.547 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "MOSDPGPushReply(10.f 409/395 [PushReplyOp(10:f6498473:::benchmark_data_smithi080_153340_object5084:head)])", 2024-02-19T21:49:38.547 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:38.492751+0000", 2024-02-19T21:49:38.547 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 4294967295.9996166, 2024-02-19T21:49:38.548 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00019832399999999999, 2024-02-19T21:49:38.548 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:49:38.548 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "reached pg", 2024-02-19T21:49:38.548 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:49:38.548 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.548 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:49:38.548 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.492751+0000", 2024-02-19T21:49:38.548 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:49:38.549 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.549 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.549 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:49:38.549 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.492751+0000", 2024-02-19T21:49:38.549 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:49:38.549 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.549 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.549 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:49:38.549 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.492750+0000", 2024-02-19T21:49:38.549 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.9100000000000005e-06 2024-02-19T21:49:38.549 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.549 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.549 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:49:38.550 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.492758+0000", 2024-02-19T21:49:38.550 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.3967e-05 2024-02-19T21:49:38.550 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.550 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.550 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:49:38.550 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.492772+0000", 2024-02-19T21:49:38.551 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.0389999999999999e-06 2024-02-19T21:49:38.551 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.551 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.551 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:49:38.551 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.492779+0000", 2024-02-19T21:49:38.551 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000103762 2024-02-19T21:49:38.552 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:49:38.552 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:49:38.552 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:49:38.552 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.492883+0000", 2024-02-19T21:49:38.552 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000131827 2024-02-19T21:49:38.552 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:38.552 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:49:38.552 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:38.553 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:49:38.553 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-02-19T21:49:38.553 INFO:teuthology.orchestra.run.smithi157.stdout: "num_ops": 9 2024-02-19T21:49:38.553 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:49:38.553 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:37.156174+0000 mgr.y (mgr.14514) 648 : cluster [DBG] pgmap v843: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 2.9 GiB data, 12 GiB used, 613 GiB / 626 GiB avail; 869 B/s rd, 55 MiB/s wr, 877 op/s; 5890/145566 objects degraded (4.046%); 1/145566 objects misplaced (0.001%); 1.8 MiB/s, 29 objects/s recovering 2024-02-19T21:49:38.554 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:37.156174+0000 mgr.y (mgr.14514) 648 : cluster [DBG] pgmap v843: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 2.9 GiB data, 12 GiB used, 613 GiB / 626 GiB avail; 869 B/s rd, 55 MiB/s wr, 877 op/s; 5890/145566 objects degraded (4.046%); 1/145566 objects misplaced (0.001%); 1.8 MiB/s, 29 objects/s recovering 2024-02-19T21:49:38.554 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:38.554 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:49:38.555 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:49:38.555 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:37.156174+0000 mgr.y (mgr.14514) 648 : cluster [DBG] pgmap v843: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 2.9 GiB data, 12 GiB used, 613 GiB / 626 GiB avail; 869 B/s rd, 55 MiB/s wr, 877 op/s; 5890/145566 objects degraded (4.046%); 1/145566 objects misplaced (0.001%); 1.8 MiB/s, 29 objects/s recovering 2024-02-19T21:49:38.656 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:49:38.726 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:49:38.742 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:38.771 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:49:38.778 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:38.778 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:49:38.879 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:49:38.932 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:39.148 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:49:39.156 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:39.157 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:49:39.257 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:49:39.274 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.6 dump_blocked_ops 2024-02-19T21:49:39.278 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 38 16 52545 52529 86.3822 57.6875 0.00765647 0.011571 2024-02-19T21:49:39.293 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:39.400 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:49:39.405 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:39.406 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:49:39.410 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:37.873286+0000 osd.0 (osd.0) 264 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:49:39.410 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:37.873331+0000 osd.0 (osd.0) 265 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:49:39.410 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:38.289275+0000 mon.a (mon.0) 1615 : cluster [DBG] osdmap e409: 8 total, 8 up, 7 in 2024-02-19T21:49:39.410 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:37.873286+0000 osd.0 (osd.0) 264 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:49:39.411 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:37.873331+0000 osd.0 (osd.0) 265 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:49:39.411 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:38.289275+0000 mon.a (mon.0) 1615 : cluster [DBG] osdmap e409: 8 total, 8 up, 7 in 2024-02-19T21:49:39.507 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:49:39.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:37.873286+0000 osd.0 (osd.0) 264 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:49:39.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:37.873331+0000 osd.0 (osd.0) 265 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:49:39.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:38.289275+0000 mon.a (mon.0) 1615 : cluster [DBG] osdmap e409: 8 total, 8 up, 7 in 2024-02-19T21:49:39.585 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:39.617 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:49:39.624 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:39.624 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:49:39.725 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:49:39.733 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:49:39.798 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:39.980 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:49:40.018 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:49:40.025 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:40.026 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:49:40.126 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:49:40.191 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:40.278 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 39 16 53397 53381 85.5326 53.25 0.0245833 0.0116854 2024-02-19T21:49:40.285 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-02-19T21:49:40.306 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.5 to 1 (10000) 2024-02-19T21:49:40.317 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:49:40.325 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:40.325 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:49:40.426 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:49:40.467 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:40.547 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:49:40.553 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:40.554 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:49:40.554 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:39.156565+0000 mgr.y (mgr.14514) 649 : cluster [DBG] pgmap v845: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 2.9 GiB data, 12 GiB used, 613 GiB / 626 GiB avail; 864 B/s rd, 54 MiB/s wr, 871 op/s; 5890/145566 objects degraded (4.046%); 1/145566 objects misplaced (0.001%); 1.8 MiB/s, 28 objects/s recovering 2024-02-19T21:49:40.554 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:39.982660+0000 mon.a (mon.0) 1616 : audit [INF] from='client.? 172.21.15.80:0/1022380059' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:49:40.554 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:40.066267+0000 mon.c (mon.2) 97 : audit [INF] from='client.? 172.21.15.80:0/1234752050' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-19T21:49:40.554 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:40.066608+0000 mon.a (mon.0) 1617 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-19T21:49:40.554 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:40.254110+0000 mon.a (mon.0) 1618 : cluster [WRN] Health check update: Degraded data redundancy: 5890/145566 objects degraded (4.046%), 6 pgs degraded (PG_DEGRADED) 2024-02-19T21:49:40.554 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:40.254856+0000 mon.a (mon.0) 1619 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:49:40.554 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:40.270778+0000 mon.a (mon.0) 1620 : audit [INF] from='client.? 172.21.15.80:0/1022380059' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:49:40.555 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:40.270843+0000 mon.a (mon.0) 1621 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-02-19T21:49:40.555 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:40.270897+0000 mon.a (mon.0) 1622 : cluster [DBG] osdmap e410: 8 total, 8 up, 7 in 2024-02-19T21:49:40.555 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:39.156565+0000 mgr.y (mgr.14514) 649 : cluster [DBG] pgmap v845: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 2.9 GiB data, 12 GiB used, 613 GiB / 626 GiB avail; 864 B/s rd, 54 MiB/s wr, 871 op/s; 5890/145566 objects degraded (4.046%); 1/145566 objects misplaced (0.001%); 1.8 MiB/s, 28 objects/s recovering 2024-02-19T21:49:40.555 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:39.982660+0000 mon.a (mon.0) 1616 : audit [INF] from='client.? 172.21.15.80:0/1022380059' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:49:40.555 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:40.066267+0000 mon.c (mon.2) 97 : audit [INF] from='client.? 172.21.15.80:0/1234752050' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-19T21:49:40.555 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:40.066608+0000 mon.a (mon.0) 1617 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-19T21:49:40.555 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:40.254110+0000 mon.a (mon.0) 1618 : cluster [WRN] Health check update: Degraded data redundancy: 5890/145566 objects degraded (4.046%), 6 pgs degraded (PG_DEGRADED) 2024-02-19T21:49:40.555 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:40.254856+0000 mon.a (mon.0) 1619 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:49:40.555 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:40.270778+0000 mon.a (mon.0) 1620 : audit [INF] from='client.? 172.21.15.80:0/1022380059' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:49:40.555 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:40.270843+0000 mon.a (mon.0) 1621 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-02-19T21:49:40.555 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:40.270897+0000 mon.a (mon.0) 1622 : cluster [DBG] osdmap e410: 8 total, 8 up, 7 in 2024-02-19T21:49:40.655 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:49:40.727 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:39.156565+0000 mgr.y (mgr.14514) 649 : cluster [DBG] pgmap v845: 138 pgs: 1 active+remapped+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 2.9 GiB data, 12 GiB used, 613 GiB / 626 GiB avail; 864 B/s rd, 54 MiB/s wr, 871 op/s; 5890/145566 objects degraded (4.046%); 1/145566 objects misplaced (0.001%); 1.8 MiB/s, 28 objects/s recovering 2024-02-19T21:49:40.728 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:39.982660+0000 mon.a (mon.0) 1616 : audit [INF] from='client.? 172.21.15.80:0/1022380059' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:49:40.728 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:40.066267+0000 mon.c (mon.2) 97 : audit [INF] from='client.? 172.21.15.80:0/1234752050' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-19T21:49:40.728 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:40.066608+0000 mon.a (mon.0) 1617 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-19T21:49:40.728 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:40.254110+0000 mon.a (mon.0) 1618 : cluster [WRN] Health check update: Degraded data redundancy: 5890/145566 objects degraded (4.046%), 6 pgs degraded (PG_DEGRADED) 2024-02-19T21:49:40.728 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:40.254856+0000 mon.a (mon.0) 1619 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:49:40.728 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:40.270778+0000 mon.a (mon.0) 1620 : audit [INF] from='client.? 172.21.15.80:0/1022380059' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:49:40.728 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:40.270843+0000 mon.a (mon.0) 1621 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-02-19T21:49:40.728 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:40.270897+0000 mon.a (mon.0) 1622 : cluster [DBG] osdmap e410: 8 total, 8 up, 7 in 2024-02-19T21:49:40.734 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:40.787 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:49:40.793 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:40.793 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:49:40.846 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:49:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:49:40] "GET /metrics HTTP/1.1" 200 176453 "" "Prometheus/2.33.4" 2024-02-19T21:49:40.894 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:49:40.960 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:41.056 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:49:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:49:41.278 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:2024-02-19T21:49:41.279797+0000 min lat: 0.00134319 max lat: 2.47421 avg lat: 0.0117722 2024-02-19T21:49:41.278 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-19T21:49:41.278 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 40 16 54364 54348 84.9051 60.4375 0.0134936 0.0117722 2024-02-19T21:49:41.339 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:49:41.345 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:41.345 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:49:41.446 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:49:41.486 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:41.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:40.906832+0000 mgr.y (mgr.14514) 650 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:49:41.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:40.906832+0000 mgr.y (mgr.14514) 650 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:49:41.699 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:40.906832+0000 mgr.y (mgr.14514) 650 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:49:42.011 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:49:42.012 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [], 2024-02-19T21:49:42.012 INFO:teuthology.orchestra.run.smithi157.stdout: "complaint_time": 30, 2024-02-19T21:49:42.012 INFO:teuthology.orchestra.run.smithi157.stdout: "num_blocked_ops": 0 2024-02-19T21:49:42.012 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:49:42.278 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 41 16 55326 55310 84.3006 60.125 0.0227975 0.0118569 2024-02-19T21:49:42.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:41.157213+0000 mgr.y (mgr.14514) 651 : cluster [DBG] pgmap v847: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 3.2 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 1.7 KiB/s rd, 71 MiB/s wr, 1.14k op/s; 5717/160263 objects degraded (3.567%); 1/160263 objects misplaced (0.001%); 3.0 MiB/s, 48 objects/s recovering 2024-02-19T21:49:42.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:41.157213+0000 mgr.y (mgr.14514) 651 : cluster [DBG] pgmap v847: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 3.2 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 1.7 KiB/s rd, 71 MiB/s wr, 1.14k op/s; 5717/160263 objects degraded (3.567%); 1/160263 objects misplaced (0.001%); 3.0 MiB/s, 48 objects/s recovering 2024-02-19T21:49:42.739 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:49:42.744 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:42.744 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:49:42.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:41.157213+0000 mgr.y (mgr.14514) 651 : cluster [DBG] pgmap v847: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 3.2 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 1.7 KiB/s rd, 71 MiB/s wr, 1.14k op/s; 5717/160263 objects degraded (3.567%); 1/160263 objects misplaced (0.001%); 3.0 MiB/s, 48 objects/s recovering 2024-02-19T21:49:42.845 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:49:42.913 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.6 dump_historic_ops 2024-02-19T21:49:42.919 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:42.977 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:49:42.986 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:42.987 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:49:43.087 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:49:43.122 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:43.182 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:49:43.185 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:43.185 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:49:43.215 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd reweight 6 1 2024-02-19T21:49:43.278 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 42 16 56281 56265 83.7145 59.6875 0.0209976 0.0119389 2024-02-19T21:49:43.286 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:49:43.336 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:43.429 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:49:43.432 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:43.432 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:49:43.433 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:49:43.482 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:49:43.506 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:49:43.533 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:49:43.534 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:49:43.559 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:49:43.588 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:43.603 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:49:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:49:43.631 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:43.632 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:49:43.651 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:49:43.675 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:49:43.677 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:49:43.714 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:49:43.716 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:49:43.716 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:49:43.716 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:49:43.716 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:49:43.717 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:49:43.717 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:49:43.717 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:49:43.717 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:49:43.732 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:49:43.764 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:43.784 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-19T21:49:44.278 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 43 16 57192 57176 83.0918 56.9375 0.020873 0.0120286 2024-02-19T21:49:44.333 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:43.157655+0000 mgr.y (mgr.14514) 652 : cluster [DBG] pgmap v848: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 3.2 GiB data, 13 GiB used, 612 GiB / 626 GiB avail; 649 B/s rd, 44 MiB/s wr, 701 op/s; 5717/160263 objects degraded (3.567%); 1/160263 objects misplaced (0.001%); 1.4 MiB/s, 21 objects/s recovering 2024-02-19T21:49:44.333 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:43.454894+0000 mon.a (mon.0) 1623 : audit [DBG] from='client.? 172.21.15.80:0/747776861' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:49:44.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:43.157655+0000 mgr.y (mgr.14514) 652 : cluster [DBG] pgmap v848: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 3.2 GiB data, 13 GiB used, 612 GiB / 626 GiB avail; 649 B/s rd, 44 MiB/s wr, 701 op/s; 5717/160263 objects degraded (3.567%); 1/160263 objects misplaced (0.001%); 1.4 MiB/s, 21 objects/s recovering 2024-02-19T21:49:44.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:43.454894+0000 mon.a (mon.0) 1623 : audit [DBG] from='client.? 172.21.15.80:0/747776861' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:49:44.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:43.157655+0000 mgr.y (mgr.14514) 652 : cluster [DBG] pgmap v848: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 3.2 GiB data, 13 GiB used, 612 GiB / 626 GiB avail; 649 B/s rd, 44 MiB/s wr, 701 op/s; 5717/160263 objects degraded (3.567%); 1/160263 objects misplaced (0.001%); 1.4 MiB/s, 21 objects/s recovering 2024-02-19T21:49:44.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:43.454894+0000 mon.a (mon.0) 1623 : audit [DBG] from='client.? 172.21.15.80:0/747776861' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:49:44.624 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:49:44.628 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:44.628 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:49:44.729 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:49:44.846 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:44.915 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:49:45.018 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:45.019 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:49:45.119 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:49:45.170 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:45.197 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:49:45.200 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:45.200 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:49:45.278 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 44 16 58161 58145 82.5796 60.5625 0.0242406 0.0121046 2024-02-19T21:49:45.301 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:49:45.332 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:45.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:45.256236+0000 mon.a (mon.0) 1624 : cluster [WRN] Health check update: Degraded data redundancy: 5717/160263 objects degraded (3.567%), 6 pgs degraded (PG_DEGRADED) 2024-02-19T21:49:45.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:45.256236+0000 mon.a (mon.0) 1624 : cluster [WRN] Health check update: Degraded data redundancy: 5717/160263 objects degraded (3.567%), 6 pgs degraded (PG_DEGRADED) 2024-02-19T21:49:45.620 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:49:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:49:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:49:45.620 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:45.256236+0000 mon.a (mon.0) 1624 : cluster [WRN] Health check update: Degraded data redundancy: 5717/160263 objects degraded (3.567%), 6 pgs degraded (PG_DEGRADED) 2024-02-19T21:49:45.657 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:49:45.682 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:49:45.685 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:45.686 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:49:45.696 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:49:45.697 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:49:45.786 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:49:45.819 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:45.953 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:49:45.959 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:45.959 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:49:46.060 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:49:46.136 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:46.279 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 45 16 58999 58983 81.9083 52.375 0.0168843 0.0122022 2024-02-19T21:49:46.389 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:45.158235+0000 mgr.y (mgr.14514) 653 : cluster [DBG] pgmap v849: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 3.4 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 639 B/s rd, 61 MiB/s wr, 983 op/s; 5659/169152 objects degraded (3.346%); 1/169152 objects misplaced (0.001%); 1.8 MiB/s, 28 objects/s recovering 2024-02-19T21:49:46.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:45.158235+0000 mgr.y (mgr.14514) 653 : cluster [DBG] pgmap v849: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 3.4 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 639 B/s rd, 61 MiB/s wr, 983 op/s; 5659/169152 objects degraded (3.346%); 1/169152 objects misplaced (0.001%); 1.8 MiB/s, 28 objects/s recovering 2024-02-19T21:49:46.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:45.158235+0000 mgr.y (mgr.14514) 653 : cluster [DBG] pgmap v849: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 3.4 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 639 B/s rd, 61 MiB/s wr, 983 op/s; 5659/169152 objects degraded (3.346%); 1/169152 objects misplaced (0.001%); 1.8 MiB/s, 28 objects/s recovering 2024-02-19T21:49:46.611 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:49:46.616 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:46.617 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:49:46.642 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.7 dump_ops_in_flight 2024-02-19T21:49:46.717 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:49:46.817 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:46.853 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:49:46.862 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:46.863 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:49:46.964 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:49:47.027 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:47.074 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:49:47.079 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:47.080 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:49:47.164 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:49:47.181 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:49:47.200 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:49:47.248 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:47.279 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 46 16 59886 59870 81.3328 55.4375 0.0134594 0.0122893 2024-02-19T21:49:47.313 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:49:47.316 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:47.316 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:49:47.406 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.6 to 1 (10000) 2024-02-19T21:49:47.418 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:49:47.464 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:46.780144+0000 mon.c (mon.2) 98 : audit [INF] from='client.? 172.21.15.80:0/2919874785' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-02-19T21:49:47.464 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:46.780424+0000 mon.a (mon.0) 1625 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-02-19T21:49:47.465 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:46.780144+0000 mon.c (mon.2) 98 : audit [INF] from='client.? 172.21.15.80:0/2919874785' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-02-19T21:49:47.465 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:46.780424+0000 mon.a (mon.0) 1625 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-02-19T21:49:47.467 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:47.609 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:49:47.618 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:47.618 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:49:47.719 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:49:47.774 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:46.780144+0000 mon.c (mon.2) 98 : audit [INF] from='client.? 172.21.15.80:0/2919874785' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-02-19T21:49:47.774 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:46.780424+0000 mon.a (mon.0) 1625 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-02-19T21:49:47.778 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:47.897 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:49:47.910 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:47.910 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:49:48.011 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:49:48.111 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:48.279 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 47 16 60739 60723 80.7366 53.3125 0.0138798 0.0123802 2024-02-19T21:49:48.295 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:49:48.299 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:48.299 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:49:48.390 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd reweight 7 1 2024-02-19T21:49:48.400 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:49:48.417 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:47.158817+0000 mgr.y (mgr.14514) 654 : cluster [DBG] pgmap v850: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 3.5 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 1.1 KiB/s rd, 68 MiB/s wr, 1.08k op/s; 5542/174420 objects degraded (3.177%); 1/174420 objects misplaced (0.001%); 2.5 MiB/s, 39 objects/s recovering 2024-02-19T21:49:48.417 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:47.386762+0000 mon.a (mon.0) 1626 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-02-19T21:49:48.417 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:47.386826+0000 mon.a (mon.0) 1627 : cluster [DBG] osdmap e411: 8 total, 8 up, 7 in 2024-02-19T21:49:48.418 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:47.914618+0000 mon.a (mon.0) 1628 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:49:48.481 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:48.684 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:49:48.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:47.158817+0000 mgr.y (mgr.14514) 654 : cluster [DBG] pgmap v850: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 3.5 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 1.1 KiB/s rd, 68 MiB/s wr, 1.08k op/s; 5542/174420 objects degraded (3.177%); 1/174420 objects misplaced (0.001%); 2.5 MiB/s, 39 objects/s recovering 2024-02-19T21:49:48.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:47.386762+0000 mon.a (mon.0) 1626 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-02-19T21:49:48.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:47.386826+0000 mon.a (mon.0) 1627 : cluster [DBG] osdmap e411: 8 total, 8 up, 7 in 2024-02-19T21:49:48.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:47.914618+0000 mon.a (mon.0) 1628 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:49:48.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:47.158817+0000 mgr.y (mgr.14514) 654 : cluster [DBG] pgmap v850: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 3.5 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 1.1 KiB/s rd, 68 MiB/s wr, 1.08k op/s; 5542/174420 objects degraded (3.177%); 1/174420 objects misplaced (0.001%); 2.5 MiB/s, 39 objects/s recovering 2024-02-19T21:49:48.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:47.386762+0000 mon.a (mon.0) 1626 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-02-19T21:49:48.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:47.386826+0000 mon.a (mon.0) 1627 : cluster [DBG] osdmap e411: 8 total, 8 up, 7 in 2024-02-19T21:49:48.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:47.914618+0000 mon.a (mon.0) 1628 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:49:49.281 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 48 16 61613 61597 80.1894 54.625 0.0201345 0.012465 2024-02-19T21:49:49.425 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:48.401874+0000 mon.a (mon.0) 1629 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:49:49.425 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:48.955461+0000 mon.c (mon.2) 99 : audit [INF] from='client.? 172.21.15.80:0/442236637' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:49:49.425 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:48.955990+0000 mon.a (mon.0) 1630 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:49:49.437 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-02-19T21:49:49.565 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:49:49.572 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:49.572 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:49:49.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:48.401874+0000 mon.a (mon.0) 1629 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:49:49.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:48.955461+0000 mon.c (mon.2) 99 : audit [INF] from='client.? 172.21.15.80:0/442236637' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:49:49.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:48.955990+0000 mon.a (mon.0) 1630 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:49:49.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:48.401874+0000 mon.a (mon.0) 1629 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:49:49.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:48.955461+0000 mon.c (mon.2) 99 : audit [INF] from='client.? 172.21.15.80:0/442236637' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:49:49.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:48.955990+0000 mon.a (mon.0) 1630 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:49:49.673 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:49:49.728 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:49.767 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:49:49.833 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:49:49.837 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:49.838 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:49:49.938 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:49:49.982 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:50.090 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:49:50.094 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:50.094 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:49:50.195 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:49:50.267 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:49:50.267 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:49:50.281 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 49 16 62432 62416 79.5975 51.1875 0.0331106 0.0125558 2024-02-19T21:49:50.297 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:50.335 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:49:50.337 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:50.338 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:49:50.438 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:49:50.508 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:50.550 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:49:50.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:48.576348+0000 osd.1 (osd.1) 244 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:49:50.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:48.576392+0000 osd.1 (osd.1) 245 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:49:50.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:49.159198+0000 mgr.y (mgr.14514) 655 : cluster [DBG] pgmap v852: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 3.5 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 576 B/s rd, 37 MiB/s wr, 599 op/s; 5542/174420 objects degraded (3.177%); 1/174420 objects misplaced (0.001%); 1.2 MiB/s, 19 objects/s recovering 2024-02-19T21:49:50.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:49.413053+0000 mon.a (mon.0) 1631 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:49:50.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:49.428589+0000 mon.a (mon.0) 1632 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:49:50.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:49.428641+0000 mon.a (mon.0) 1633 : cluster [DBG] osdmap e412: 8 total, 8 up, 7 in 2024-02-19T21:49:50.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:49.752557+0000 mon.a (mon.0) 1634 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:49:50.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:49.753319+0000 mon.a (mon.0) 1635 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:49:50.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:49.761004+0000 mon.a (mon.0) 1636 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:49:50.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:50.258395+0000 mon.a (mon.0) 1637 : cluster [WRN] Health check update: Degraded data redundancy: 5542/174420 objects degraded (3.177%), 6 pgs degraded (PG_DEGRADED) 2024-02-19T21:49:50.558 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:50.559 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:49:50.659 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:49:50.673 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:48.576348+0000 osd.1 (osd.1) 244 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:49:50.673 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:48.576392+0000 osd.1 (osd.1) 245 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:49:50.673 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:49.159198+0000 mgr.y (mgr.14514) 655 : cluster [DBG] pgmap v852: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 3.5 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 576 B/s rd, 37 MiB/s wr, 599 op/s; 5542/174420 objects degraded (3.177%); 1/174420 objects misplaced (0.001%); 1.2 MiB/s, 19 objects/s recovering 2024-02-19T21:49:50.673 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:49.413053+0000 mon.a (mon.0) 1631 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:49:50.673 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:49.428589+0000 mon.a (mon.0) 1632 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:49:50.673 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:49.428641+0000 mon.a (mon.0) 1633 : cluster [DBG] osdmap e412: 8 total, 8 up, 7 in 2024-02-19T21:49:50.673 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:49.752557+0000 mon.a (mon.0) 1634 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:49:50.674 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:49.753319+0000 mon.a (mon.0) 1635 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:49:50.674 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:49.761004+0000 mon.a (mon.0) 1636 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:49:50.674 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:50.258395+0000 mon.a (mon.0) 1637 : cluster [WRN] Health check update: Degraded data redundancy: 5542/174420 objects degraded (3.177%), 6 pgs degraded (PG_DEGRADED) 2024-02-19T21:49:50.674 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:48.576348+0000 osd.1 (osd.1) 244 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:49:50.674 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:48.576392+0000 osd.1 (osd.1) 245 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:49:50.674 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:49.159198+0000 mgr.y (mgr.14514) 655 : cluster [DBG] pgmap v852: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 3.5 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 576 B/s rd, 37 MiB/s wr, 599 op/s; 5542/174420 objects degraded (3.177%); 1/174420 objects misplaced (0.001%); 1.2 MiB/s, 19 objects/s recovering 2024-02-19T21:49:50.674 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:49.413053+0000 mon.a (mon.0) 1631 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:49:50.674 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:49.428589+0000 mon.a (mon.0) 1632 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:49:50.674 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:49.428641+0000 mon.a (mon.0) 1633 : cluster [DBG] osdmap e412: 8 total, 8 up, 7 in 2024-02-19T21:49:50.674 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:49.752557+0000 mon.a (mon.0) 1634 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:49:50.675 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:49.753319+0000 mon.a (mon.0) 1635 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:49:50.675 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:49.761004+0000 mon.a (mon.0) 1636 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:49:50.675 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:50.258395+0000 mon.a (mon.0) 1637 : cluster [WRN] Health check update: Degraded data redundancy: 5542/174420 objects degraded (3.177%), 6 pgs degraded (PG_DEGRADED) 2024-02-19T21:49:50.730 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:50.949 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:49:50.957 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:50.957 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:49:51.058 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:49:51.096 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:49:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:49:50] "GET /metrics HTTP/1.1" 200 176482 "" "Prometheus/2.33.4" 2024-02-19T21:49:51.146 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.7 dump_blocked_ops 2024-02-19T21:49:51.146 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:51.189 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:49:51.191 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:49:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:49:51.193 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:51.193 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:49:51.281 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 50 16 63298 63282 79.0879 54.125 0.0177524 0.012638 2024-02-19T21:49:51.293 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:49:51.330 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:51.447 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:50.918886+0000 mgr.y (mgr.14514) 656 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:49:51.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:50.918886+0000 mgr.y (mgr.14514) 656 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:49:51.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:50.918886+0000 mgr.y (mgr.14514) 656 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:49:51.657 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:49:52.192 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:49:52.196 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:52.197 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:49:52.281 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 51 16 64137 64121 78.5653 52.4375 0.0150801 0.0127231 2024-02-19T21:49:52.297 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:49:52.353 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:52.401 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set noscrub 2024-02-19T21:49:52.694 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:51.159848+0000 mgr.y (mgr.14514) 657 : cluster [DBG] pgmap v854: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 3.8 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1.2 KiB/s rd, 71 MiB/s wr, 1.13k op/s; 5370/187350 objects degraded (2.866%); 1/187350 objects misplaced (0.001%); 2.7 MiB/s, 43 objects/s recovering 2024-02-19T21:49:52.694 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:51.159848+0000 mgr.y (mgr.14514) 657 : cluster [DBG] pgmap v854: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 3.8 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1.2 KiB/s rd, 71 MiB/s wr, 1.13k op/s; 5370/187350 objects degraded (2.866%); 1/187350 objects misplaced (0.001%); 2.7 MiB/s, 43 objects/s recovering 2024-02-19T21:49:52.737 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:49:52.746 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:52.747 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:49:52.747 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:51.159848+0000 mgr.y (mgr.14514) 657 : cluster [DBG] pgmap v854: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 3.8 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1.2 KiB/s rd, 71 MiB/s wr, 1.13k op/s; 5370/187350 objects degraded (2.866%); 1/187350 objects misplaced (0.001%); 2.7 MiB/s, 43 objects/s recovering 2024-02-19T21:49:52.848 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:49:52.885 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:52.954 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:49:52.977 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:49:53.008 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:49:53.035 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:49:53.076 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:49:53.100 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:49:53.106 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:53.107 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:49:53.112 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:49:53.150 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:49:53.192 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:49:53.201 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:49:53.201 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:49:53.201 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:49:53.202 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:49:53.202 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:49:53.202 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:49:53.202 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:49:53.202 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:49:53.208 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:49:53.240 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:49:53.270 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:53.281 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 52 16 65031 65015 78.129 55.875 0.0145871 0.0127941 2024-02-19T21:49:53.333 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:49:53.335 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:53.336 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:49:53.436 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:49:53.482 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:52.921103+0000 mon.c (mon.2) 100 : audit [DBG] from='client.? 172.21.15.80:0/179675983' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:49:53.482 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:53.384628+0000 mon.c (mon.2) 101 : audit [INF] from='client.? 172.21.15.80:0/1319895629' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-02-19T21:49:53.482 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:53.385011+0000 mon.a (mon.0) 1638 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-02-19T21:49:53.484 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:52.921103+0000 mon.c (mon.2) 100 : audit [DBG] from='client.? 172.21.15.80:0/179675983' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:49:53.485 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:53.384628+0000 mon.c (mon.2) 101 : audit [INF] from='client.? 172.21.15.80:0/1319895629' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-02-19T21:49:53.485 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:53.385011+0000 mon.a (mon.0) 1638 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-02-19T21:49:53.487 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:53.489 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.7 to 1 (10000) 2024-02-19T21:49:53.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:52.921103+0000 mon.c (mon.2) 100 : audit [DBG] from='client.? 172.21.15.80:0/179675983' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:49:53.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:53.384628+0000 mon.c (mon.2) 101 : audit [INF] from='client.? 172.21.15.80:0/1319895629' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-02-19T21:49:53.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:53.385011+0000 mon.a (mon.0) 1638 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-02-19T21:49:53.842 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:49:53.846 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:53.847 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:49:53.940 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:49:53.940 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [], 2024-02-19T21:49:53.940 INFO:teuthology.orchestra.run.smithi157.stdout: "complaint_time": 30, 2024-02-19T21:49:53.940 INFO:teuthology.orchestra.run.smithi157.stdout: "num_blocked_ops": 0 2024-02-19T21:49:53.940 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:49:53.947 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:49:53.979 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:54.232 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:49:54.235 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:54.236 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:49:54.281 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 53 16 65217 65201 76.8742 11.625 0.00309469 0.0128111 2024-02-19T21:49:54.337 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:49:54.366 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:54.568 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:53.160412+0000 mgr.y (mgr.14514) 658 : cluster [DBG] pgmap v855: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 3.8 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1.2 KiB/s rd, 47 MiB/s wr, 759 op/s; 5370/187350 objects degraded (2.866%); 1/187350 objects misplaced (0.001%); 2.3 MiB/s, 36 objects/s recovering 2024-02-19T21:49:54.568 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:53.468233+0000 mon.a (mon.0) 1639 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-02-19T21:49:54.568 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:53.468293+0000 mon.a (mon.0) 1640 : cluster [DBG] osdmap e413: 8 total, 8 up, 7 in 2024-02-19T21:49:54.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:53.160412+0000 mgr.y (mgr.14514) 658 : cluster [DBG] pgmap v855: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 3.8 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1.2 KiB/s rd, 47 MiB/s wr, 759 op/s; 5370/187350 objects degraded (2.866%); 1/187350 objects misplaced (0.001%); 2.3 MiB/s, 36 objects/s recovering 2024-02-19T21:49:54.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:53.468233+0000 mon.a (mon.0) 1639 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-02-19T21:49:54.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:53.468293+0000 mon.a (mon.0) 1640 : cluster [DBG] osdmap e413: 8 total, 8 up, 7 in 2024-02-19T21:49:54.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:53.160412+0000 mgr.y (mgr.14514) 658 : cluster [DBG] pgmap v855: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 131 active+clean, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 3.8 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1.2 KiB/s rd, 47 MiB/s wr, 759 op/s; 5370/187350 objects degraded (2.866%); 1/187350 objects misplaced (0.001%); 2.3 MiB/s, 36 objects/s recovering 2024-02-19T21:49:54.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:53.468233+0000 mon.a (mon.0) 1639 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-02-19T21:49:54.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:53.468293+0000 mon.a (mon.0) 1640 : cluster [DBG] osdmap e413: 8 total, 8 up, 7 in 2024-02-19T21:49:55.281 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 54 16 65217 65201 75.4508 0 - 0.0128111 2024-02-19T21:49:55.325 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd reweight 2 1 2024-02-19T21:49:55.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:54.469357+0000 mon.a (mon.0) 1641 : cluster [DBG] osdmap e414: 8 total, 8 up, 7 in 2024-02-19T21:49:55.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:55.259824+0000 mon.a (mon.0) 1642 : cluster [WRN] Health check update: Degraded data redundancy: 5370/187350 objects degraded (2.866%), 6 pgs degraded (PG_DEGRADED) 2024-02-19T21:49:55.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:55.471978+0000 mon.a (mon.0) 1643 : cluster [DBG] osdmap e415: 8 total, 8 up, 7 in 2024-02-19T21:49:55.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:54.469357+0000 mon.a (mon.0) 1641 : cluster [DBG] osdmap e414: 8 total, 8 up, 7 in 2024-02-19T21:49:55.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:55.259824+0000 mon.a (mon.0) 1642 : cluster [WRN] Health check update: Degraded data redundancy: 5370/187350 objects degraded (2.866%), 6 pgs degraded (PG_DEGRADED) 2024-02-19T21:49:55.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:55.471978+0000 mon.a (mon.0) 1643 : cluster [DBG] osdmap e415: 8 total, 8 up, 7 in 2024-02-19T21:49:55.806 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:49:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:49:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:49:55.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:54.469357+0000 mon.a (mon.0) 1641 : cluster [DBG] osdmap e414: 8 total, 8 up, 7 in 2024-02-19T21:49:55.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:55.259824+0000 mon.a (mon.0) 1642 : cluster [WRN] Health check update: Degraded data redundancy: 5370/187350 objects degraded (2.866%), 6 pgs degraded (PG_DEGRADED) 2024-02-19T21:49:55.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:55.471978+0000 mon.a (mon.0) 1643 : cluster [DBG] osdmap e415: 8 total, 8 up, 7 in 2024-02-19T21:49:56.281 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 55 16 65450 65434 74.3438 7.28125 0.00329591 0.0132977 2024-02-19T21:49:56.350 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:49:56.386 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:49:56.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:55.161011+0000 mgr.y (mgr.14514) 659 : cluster [DBG] pgmap v858: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 2 remapped+peering, 3 active+recovery_wait+degraded, 123 active+clean, 3 active+recovering, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 3.9 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 853 B/s rd, 63 MiB/s wr, 1.00k op/s; 5322/192471 objects degraded (2.765%); 11/192471 objects misplaced (0.006%); 2.4 MiB/s, 40 objects/s recovering 2024-02-19T21:49:56.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:55.472776+0000 osd.0 (osd.0) 266 : cluster [DBG] 6.8 starting backfill to osd.7 from (0'0,0'0] MAX to 66'1 2024-02-19T21:49:56.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:55.476706+0000 mon.a (mon.0) 1644 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-19T21:49:56.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:55.161011+0000 mgr.y (mgr.14514) 659 : cluster [DBG] pgmap v858: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 2 remapped+peering, 3 active+recovery_wait+degraded, 123 active+clean, 3 active+recovering, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 3.9 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 853 B/s rd, 63 MiB/s wr, 1.00k op/s; 5322/192471 objects degraded (2.765%); 11/192471 objects misplaced (0.006%); 2.4 MiB/s, 40 objects/s recovering 2024-02-19T21:49:56.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:55.472776+0000 osd.0 (osd.0) 266 : cluster [DBG] 6.8 starting backfill to osd.7 from (0'0,0'0] MAX to 66'1 2024-02-19T21:49:56.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:55.476706+0000 mon.a (mon.0) 1644 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-19T21:49:56.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:55.161011+0000 mgr.y (mgr.14514) 659 : cluster [DBG] pgmap v858: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 2 remapped+peering, 3 active+recovery_wait+degraded, 123 active+clean, 3 active+recovering, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 3.9 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 853 B/s rd, 63 MiB/s wr, 1.00k op/s; 5322/192471 objects degraded (2.765%); 11/192471 objects misplaced (0.006%); 2.4 MiB/s, 40 objects/s recovering 2024-02-19T21:49:56.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:55.472776+0000 osd.0 (osd.0) 266 : cluster [DBG] 6.8 starting backfill to osd.7 from (0'0,0'0] MAX to 66'1 2024-02-19T21:49:56.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:55.476706+0000 mon.a (mon.0) 1644 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-19T21:49:57.221 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.7 dump_historic_ops 2024-02-19T21:49:57.281 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 56 16 65450 65434 73.0164 0 - 0.0132977 2024-02-19T21:49:57.292 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:49:57.297 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:57.298 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:49:57.399 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:49:57.427 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:57.449 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:49:57.455 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:57.456 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:49:57.487 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:56.542890+0000 mon.a (mon.0) 1645 : audit [INF] from='client.? 172.21.15.80:0/440083928' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:49:57.494 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-02-19T21:49:57.557 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:49:57.587 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:57.610 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:49:57.613 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:49:57.619 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:57.619 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:49:57.720 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:49:57.746 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:56.542890+0000 mon.a (mon.0) 1645 : audit [INF] from='client.? 172.21.15.80:0/440083928' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:49:57.747 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:57.809 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:49:57.813 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:57.813 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:49:57.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:56.542890+0000 mon.a (mon.0) 1645 : audit [INF] from='client.? 172.21.15.80:0/440083928' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:49:57.914 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:49:57.940 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:58.038 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:49:58.040 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:49:58.041 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:49:58.141 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:49:58.168 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:49:58.273 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:49:58.281 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 57 16 65450 65434 71.7355 0 - 0.0132977 2024-02-19T21:49:58.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:57.161412+0000 mgr.y (mgr.14514) 660 : cluster [DBG] pgmap v860: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 3 remapped+peering, 3 active+recovery_wait+degraded, 123 active+clean, 3 active+recovering, 3 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped; 4.0 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 853 B/s rd, 29 MiB/s wr, 465 op/s; 4048/195711 objects degraded (2.068%); 11/195711 objects misplaced (0.006%); 1.8 MiB/s, 32 objects/s recovering 2024-02-19T21:49:58.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:57.481876+0000 mon.a (mon.0) 1646 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:49:58.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:57.489630+0000 mon.a (mon.0) 1647 : audit [INF] from='client.? 172.21.15.80:0/440083928' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:49:58.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:57.489682+0000 mon.a (mon.0) 1648 : cluster [DBG] osdmap e416: 8 total, 8 up, 7 in 2024-02-19T21:49:58.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:57.161412+0000 mgr.y (mgr.14514) 660 : cluster [DBG] pgmap v860: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 3 remapped+peering, 3 active+recovery_wait+degraded, 123 active+clean, 3 active+recovering, 3 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped; 4.0 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 853 B/s rd, 29 MiB/s wr, 465 op/s; 4048/195711 objects degraded (2.068%); 11/195711 objects misplaced (0.006%); 1.8 MiB/s, 32 objects/s recovering 2024-02-19T21:49:58.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:57.481876+0000 mon.a (mon.0) 1646 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:49:58.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:57.489630+0000 mon.a (mon.0) 1647 : audit [INF] from='client.? 172.21.15.80:0/440083928' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:49:58.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:57.489682+0000 mon.a (mon.0) 1648 : cluster [DBG] osdmap e416: 8 total, 8 up, 7 in 2024-02-19T21:49:58.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:57.161412+0000 mgr.y (mgr.14514) 660 : cluster [DBG] pgmap v860: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 3 remapped+peering, 3 active+recovery_wait+degraded, 123 active+clean, 3 active+recovering, 3 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped; 4.0 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 853 B/s rd, 29 MiB/s wr, 465 op/s; 4048/195711 objects degraded (2.068%); 11/195711 objects misplaced (0.006%); 1.8 MiB/s, 32 objects/s recovering 2024-02-19T21:49:58.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:57.481876+0000 mon.a (mon.0) 1646 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:49:58.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:57.489630+0000 mon.a (mon.0) 1647 : audit [INF] from='client.? 172.21.15.80:0/440083928' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:49:58.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:57.489682+0000 mon.a (mon.0) 1648 : cluster [DBG] osdmap e416: 8 total, 8 up, 7 in 2024-02-19T21:49:59.282 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 58 16 65450 65434 70.4988 0 - 0.0132977 2024-02-19T21:49:59.497 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.2 to 1 (10000) 2024-02-19T21:49:59.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:49:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:59.182022+0000 mon.a (mon.0) 1649 : audit [INF] from='client.? 172.21.15.80:0/1015382668' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-02-19T21:49:59.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:49:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:59.182022+0000 mon.a (mon.0) 1649 : audit [INF] from='client.? 172.21.15.80:0/1015382668' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-02-19T21:49:59.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:49:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:59.182022+0000 mon.a (mon.0) 1649 : audit [INF] from='client.? 172.21.15.80:0/1015382668' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-02-19T21:50:00.120 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:50:00.125 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:00.125 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:50:00.226 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:50:00.256 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:00.278 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:50:00.282 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 59 16 65450 65434 69.304 0 - 0.0132977 2024-02-19T21:50:00.282 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:00.282 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:50:00.383 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:50:00.413 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:00.435 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:50:00.438 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:00.438 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:50:00.496 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:59.161932+0000 mgr.y (mgr.14514) 661 : cluster [DBG] pgmap v862: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 3 remapped+peering, 3 active+recovery_wait+degraded, 123 active+clean, 3 active+recovering, 3 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped; 4.0 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 898 B/s rd, 31 MiB/s wr, 490 op/s; 4048/195711 objects degraded (2.068%); 11/195711 objects misplaced (0.006%); 1.9 MiB/s, 34 objects/s recovering 2024-02-19T21:50:00.496 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:49:59.495901+0000 mon.a (mon.0) 1650 : audit [INF] from='client.? 172.21.15.80:0/1015382668' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-02-19T21:50:00.496 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:49:59.495968+0000 mon.a (mon.0) 1651 : cluster [DBG] osdmap e417: 8 total, 8 up, 7 in 2024-02-19T21:50:00.497 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:00.000149+0000 mon.a (mon.0) 1652 : cluster [WRN] Health detail: HEALTH_WARN noscrub flag(s) set; Reduced data availability: 1 pg peering; Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull; Degraded data redundancy: 4048/195711 objects degraded (2.068%), 8 pgs degraded 2024-02-19T21:50:00.497 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:00.000172+0000 mon.a (mon.0) 1653 : cluster [WRN] [WRN] OSDMAP_FLAGS: noscrub flag(s) set 2024-02-19T21:50:00.497 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:00.000179+0000 mon.a (mon.0) 1654 : cluster [WRN] [WRN] PG_AVAILABILITY: Reduced data availability: 1 pg peering 2024-02-19T21:50:00.497 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:00.000188+0000 mon.a (mon.0) 1655 : cluster [WRN] pg 6.8 is stuck peering for 2m, current state remapped+peering, last acting [0,2,6] 2024-02-19T21:50:00.497 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:00.000197+0000 mon.a (mon.0) 1656 : cluster [WRN] [WRN] PG_BACKFILL_FULL: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull 2024-02-19T21:50:00.497 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:00.000205+0000 mon.a (mon.0) 1657 : cluster [WRN] pg 6.1c is active+remapped+backfill_wait+backfill_toofull, acting [7,5,3] 2024-02-19T21:50:00.497 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:00.000213+0000 mon.a (mon.0) 1658 : cluster [WRN] [WRN] PG_DEGRADED: Degraded data redundancy: 4048/195711 objects degraded (2.068%), 8 pgs degraded 2024-02-19T21:50:00.497 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:00.000219+0000 mon.a (mon.0) 1659 : cluster [WRN] pg 4.16 is active+recovery_wait+degraded, acting [0,7,2] 2024-02-19T21:50:00.497 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:00.000234+0000 mon.a (mon.0) 1660 : cluster [WRN] pg 4.17 is active+recovery_wait+degraded, acting [7,1,2] 2024-02-19T21:50:00.497 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:00.000242+0000 mon.a (mon.0) 1661 : cluster [WRN] pg 5.14 is active+recovery_wait+degraded, acting [7,2,1] 2024-02-19T21:50:00.497 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:00.000250+0000 mon.a (mon.0) 1662 : cluster [WRN] pg 10.3 is active+recovering+undersized+degraded+remapped, acting [4,5] 2024-02-19T21:50:00.497 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:00.000261+0000 mon.a (mon.0) 1663 : cluster [WRN] pg 10.5 is active+recovery_wait+undersized+degraded+remapped, acting [0,5] 2024-02-19T21:50:00.497 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:00.000270+0000 mon.a (mon.0) 1664 : cluster [WRN] pg 10.7 is active+recovery_wait+undersized+degraded+remapped, acting [6,5] 2024-02-19T21:50:00.498 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:00.000287+0000 mon.a (mon.0) 1665 : cluster [WRN] pg 10.e is active+recovering+undersized+degraded+remapped, acting [4,6] 2024-02-19T21:50:00.498 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:00.000296+0000 mon.a (mon.0) 1666 : cluster [WRN] pg 10.f is active+recovering+undersized+degraded+remapped, acting [6,4] 2024-02-19T21:50:00.498 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:00.261577+0000 mon.a (mon.0) 1667 : cluster [WRN] Health check update: Degraded data redundancy: 4048/195711 objects degraded (2.068%), 8 pgs degraded (PG_DEGRADED) 2024-02-19T21:50:00.498 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:00.266000+0000 mon.a (mon.0) 1668 : cluster [DBG] osdmap e418: 8 total, 8 up, 7 in 2024-02-19T21:50:00.539 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:50:00.568 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:00.754 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:59.161932+0000 mgr.y (mgr.14514) 661 : cluster [DBG] pgmap v862: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 3 remapped+peering, 3 active+recovery_wait+degraded, 123 active+clean, 3 active+recovering, 3 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped; 4.0 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 898 B/s rd, 31 MiB/s wr, 490 op/s; 4048/195711 objects degraded (2.068%); 11/195711 objects misplaced (0.006%); 1.9 MiB/s, 34 objects/s recovering 2024-02-19T21:50:00.754 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:49:59.495901+0000 mon.a (mon.0) 1650 : audit [INF] from='client.? 172.21.15.80:0/1015382668' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-02-19T21:50:00.754 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:49:59.495968+0000 mon.a (mon.0) 1651 : cluster [DBG] osdmap e417: 8 total, 8 up, 7 in 2024-02-19T21:50:00.754 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:00.000149+0000 mon.a (mon.0) 1652 : cluster [WRN] Health detail: HEALTH_WARN noscrub flag(s) set; Reduced data availability: 1 pg peering; Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull; Degraded data redundancy: 4048/195711 objects degraded (2.068%), 8 pgs degraded 2024-02-19T21:50:00.754 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:00.000172+0000 mon.a (mon.0) 1653 : cluster [WRN] [WRN] OSDMAP_FLAGS: noscrub flag(s) set 2024-02-19T21:50:00.754 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:00.000179+0000 mon.a (mon.0) 1654 : cluster [WRN] [WRN] PG_AVAILABILITY: Reduced data availability: 1 pg peering 2024-02-19T21:50:00.754 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:00.000188+0000 mon.a (mon.0) 1655 : cluster [WRN] pg 6.8 is stuck peering for 2m, current state remapped+peering, last acting [0,2,6] 2024-02-19T21:50:00.754 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:00.000197+0000 mon.a (mon.0) 1656 : cluster [WRN] [WRN] PG_BACKFILL_FULL: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull 2024-02-19T21:50:00.754 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:00.000205+0000 mon.a (mon.0) 1657 : cluster [WRN] pg 6.1c is active+remapped+backfill_wait+backfill_toofull, acting [7,5,3] 2024-02-19T21:50:00.754 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:00.000213+0000 mon.a (mon.0) 1658 : cluster [WRN] [WRN] PG_DEGRADED: Degraded data redundancy: 4048/195711 objects degraded (2.068%), 8 pgs degraded 2024-02-19T21:50:00.755 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:00.000219+0000 mon.a (mon.0) 1659 : cluster [WRN] pg 4.16 is active+recovery_wait+degraded, acting [0,7,2] 2024-02-19T21:50:00.755 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:00.000234+0000 mon.a (mon.0) 1660 : cluster [WRN] pg 4.17 is active+recovery_wait+degraded, acting [7,1,2] 2024-02-19T21:50:00.755 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:00.000242+0000 mon.a (mon.0) 1661 : cluster [WRN] pg 5.14 is active+recovery_wait+degraded, acting [7,2,1] 2024-02-19T21:50:00.755 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:00.000250+0000 mon.a (mon.0) 1662 : cluster [WRN] pg 10.3 is active+recovering+undersized+degraded+remapped, acting [4,5] 2024-02-19T21:50:00.755 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:00.000261+0000 mon.a (mon.0) 1663 : cluster [WRN] pg 10.5 is active+recovery_wait+undersized+degraded+remapped, acting [0,5] 2024-02-19T21:50:00.755 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:00.000270+0000 mon.a (mon.0) 1664 : cluster [WRN] pg 10.7 is active+recovery_wait+undersized+degraded+remapped, acting [6,5] 2024-02-19T21:50:00.755 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:00.000287+0000 mon.a (mon.0) 1665 : cluster [WRN] pg 10.e is active+recovering+undersized+degraded+remapped, acting [4,6] 2024-02-19T21:50:00.755 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:00.000296+0000 mon.a (mon.0) 1666 : cluster [WRN] pg 10.f is active+recovering+undersized+degraded+remapped, acting [6,4] 2024-02-19T21:50:00.755 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:00.261577+0000 mon.a (mon.0) 1667 : cluster [WRN] Health check update: Degraded data redundancy: 4048/195711 objects degraded (2.068%), 8 pgs degraded (PG_DEGRADED) 2024-02-19T21:50:00.755 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:00.266000+0000 mon.a (mon.0) 1668 : cluster [DBG] osdmap e418: 8 total, 8 up, 7 in 2024-02-19T21:50:00.774 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2024-02-19T21:50:00.775 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:50:00.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:59.161932+0000 mgr.y (mgr.14514) 661 : cluster [DBG] pgmap v862: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 3 remapped+peering, 3 active+recovery_wait+degraded, 123 active+clean, 3 active+recovering, 3 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped; 4.0 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 898 B/s rd, 31 MiB/s wr, 490 op/s; 4048/195711 objects degraded (2.068%); 11/195711 objects misplaced (0.006%); 1.9 MiB/s, 34 objects/s recovering 2024-02-19T21:50:00.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:49:59.495901+0000 mon.a (mon.0) 1650 : audit [INF] from='client.? 172.21.15.80:0/1015382668' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-02-19T21:50:00.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:49:59.495968+0000 mon.a (mon.0) 1651 : cluster [DBG] osdmap e417: 8 total, 8 up, 7 in 2024-02-19T21:50:00.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:00.000149+0000 mon.a (mon.0) 1652 : cluster [WRN] Health detail: HEALTH_WARN noscrub flag(s) set; Reduced data availability: 1 pg peering; Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull; Degraded data redundancy: 4048/195711 objects degraded (2.068%), 8 pgs degraded 2024-02-19T21:50:00.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:00.000172+0000 mon.a (mon.0) 1653 : cluster [WRN] [WRN] OSDMAP_FLAGS: noscrub flag(s) set 2024-02-19T21:50:00.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:00.000179+0000 mon.a (mon.0) 1654 : cluster [WRN] [WRN] PG_AVAILABILITY: Reduced data availability: 1 pg peering 2024-02-19T21:50:00.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:00.000188+0000 mon.a (mon.0) 1655 : cluster [WRN] pg 6.8 is stuck peering for 2m, current state remapped+peering, last acting [0,2,6] 2024-02-19T21:50:00.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:00.000197+0000 mon.a (mon.0) 1656 : cluster [WRN] [WRN] PG_BACKFILL_FULL: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull 2024-02-19T21:50:00.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:00.000205+0000 mon.a (mon.0) 1657 : cluster [WRN] pg 6.1c is active+remapped+backfill_wait+backfill_toofull, acting [7,5,3] 2024-02-19T21:50:00.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:00.000213+0000 mon.a (mon.0) 1658 : cluster [WRN] [WRN] PG_DEGRADED: Degraded data redundancy: 4048/195711 objects degraded (2.068%), 8 pgs degraded 2024-02-19T21:50:00.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:00.000219+0000 mon.a (mon.0) 1659 : cluster [WRN] pg 4.16 is active+recovery_wait+degraded, acting [0,7,2] 2024-02-19T21:50:00.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:00.000234+0000 mon.a (mon.0) 1660 : cluster [WRN] pg 4.17 is active+recovery_wait+degraded, acting [7,1,2] 2024-02-19T21:50:00.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:00.000242+0000 mon.a (mon.0) 1661 : cluster [WRN] pg 5.14 is active+recovery_wait+degraded, acting [7,2,1] 2024-02-19T21:50:00.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:00.000250+0000 mon.a (mon.0) 1662 : cluster [WRN] pg 10.3 is active+recovering+undersized+degraded+remapped, acting [4,5] 2024-02-19T21:50:00.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:00.000261+0000 mon.a (mon.0) 1663 : cluster [WRN] pg 10.5 is active+recovery_wait+undersized+degraded+remapped, acting [0,5] 2024-02-19T21:50:00.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:00.000270+0000 mon.a (mon.0) 1664 : cluster [WRN] pg 10.7 is active+recovery_wait+undersized+degraded+remapped, acting [6,5] 2024-02-19T21:50:00.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:00.000287+0000 mon.a (mon.0) 1665 : cluster [WRN] pg 10.e is active+recovering+undersized+degraded+remapped, acting [4,6] 2024-02-19T21:50:00.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:00.000296+0000 mon.a (mon.0) 1666 : cluster [WRN] pg 10.f is active+recovering+undersized+degraded+remapped, acting [6,4] 2024-02-19T21:50:00.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:00.261577+0000 mon.a (mon.0) 1667 : cluster [WRN] Health check update: Degraded data redundancy: 4048/195711 objects degraded (2.068%), 8 pgs degraded (PG_DEGRADED) 2024-02-19T21:50:00.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:00.266000+0000 mon.a (mon.0) 1668 : cluster [DBG] osdmap e418: 8 total, 8 up, 7 in 2024-02-19T21:50:01.096 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:50:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:50:00] "GET /metrics HTTP/1.1" 200 176482 "" "Prometheus/2.33.4" 2024-02-19T21:50:01.185 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:50:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:50:01.223 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:50:01.226 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:01.227 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:50:01.282 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:2024-02-19T21:50:01.283441+0000 min lat: 0.00134319 max lat: 2.47421 avg lat: 0.0132977 2024-02-19T21:50:01.282 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-19T21:50:01.282 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 60 16 65450 65434 68.149 0 - 0.0132977 2024-02-19T21:50:01.327 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:50:01.356 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:01.483 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:50:01.492 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:01.493 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:50:01.593 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:50:01.622 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:01.653 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:50:01.657 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:01.657 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:50:01.758 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:50:01.762 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:50:01.777 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:50:01.777 INFO:teuthology.orchestra.run.smithi157.stdout: "size": 20, 2024-02-19T21:50:01.777 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 600, 2024-02-19T21:50:01.777 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [ 2024-02-19T21:50:01.777 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.777 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24317.0:1853 5.9 5.84ada7c9 (undecoded) ondisk+write+known_if_redirected e279)", 2024-02-19T21:50:01.777 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:44:32.002424+0000", 2024-02-19T21:50:01.777 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 329.77208181200001, 2024-02-19T21:50:01.777 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.35665998100000001, 2024-02-19T21:50:01.778 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:50:01.778 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "reached pg", 2024-02-19T21:50:01.778 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:50:01.778 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24317", 2024-02-19T21:50:01.778 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3365055276", 2024-02-19T21:50:01.778 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 1853 2024-02-19T21:50:01.778 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.778 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:50:01.778 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.778 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:50:01.778 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:32.002424+0000", 2024-02-19T21:50:01.778 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:50:01.778 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.778 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.778 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:50:01.779 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:32.002424+0000", 2024-02-19T21:50:01.779 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:50:01.779 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.779 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.779 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:50:01.779 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:32.002423+0000", 2024-02-19T21:50:01.779 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.5499999999999996e-06 2024-02-19T21:50:01.779 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.779 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.779 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:50:01.779 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:32.002427+0000", 2024-02-19T21:50:01.779 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.0818999999999997e-05 2024-02-19T21:50:01.779 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.779 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.780 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:50:01.780 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:32.002458+0000", 2024-02-19T21:50:01.780 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.6019999999999996e-06 2024-02-19T21:50:01.780 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.780 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.780 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:50:01.780 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:32.002465+0000", 2024-02-19T21:50:01.780 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00019614799999999999 2024-02-19T21:50:01.780 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.780 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.780 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:50:01.780 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:32.002661+0000", 2024-02-19T21:50:01.780 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.7295999999999998e-05 2024-02-19T21:50:01.780 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.781 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.781 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:50:01.781 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:32.002678+0000", 2024-02-19T21:50:01.781 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.35638205499999998 2024-02-19T21:50:01.781 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.781 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.781 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:50:01.781 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:32.359060+0000", 2024-02-19T21:50:01.781 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.3275e-05 2024-02-19T21:50:01.781 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.781 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.781 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:50:01.781 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:32.359084+0000", 2024-02-19T21:50:01.781 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.35665998100000001 2024-02-19T21:50:01.782 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.782 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:50:01.782 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.782 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.782 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.782 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24317.0:1854 5.9 5.84ada7c9 (undecoded) ondisk+write+known_if_redirected e284)", 2024-02-19T21:50:01.782 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:44:32.002934+0000", 2024-02-19T21:50:01.782 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 329.77157096299999, 2024-02-19T21:50:01.782 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.356177782, 2024-02-19T21:50:01.782 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:50:01.782 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "reached pg", 2024-02-19T21:50:01.782 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:50:01.782 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24317", 2024-02-19T21:50:01.782 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3365055276", 2024-02-19T21:50:01.782 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 1854 2024-02-19T21:50:01.783 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.783 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:50:01.783 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.783 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:50:01.783 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:32.002934+0000", 2024-02-19T21:50:01.783 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:50:01.783 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.783 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.783 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:50:01.783 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:32.002934+0000", 2024-02-19T21:50:01.783 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:50:01.783 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.783 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.783 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:50:01.783 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:32.002933+0000", 2024-02-19T21:50:01.783 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.4139999999999999e-06 2024-02-19T21:50:01.784 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.784 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.784 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:50:01.784 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:32.002939+0000", 2024-02-19T21:50:01.784 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0900000000000001e-05 2024-02-19T21:50:01.784 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.784 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.784 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:50:01.784 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:32.002950+0000", 2024-02-19T21:50:01.784 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.5740000000000001e-06 2024-02-19T21:50:01.784 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.784 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.784 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:50:01.784 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:32.002957+0000", 2024-02-19T21:50:01.785 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.1443999999999997e-05 2024-02-19T21:50:01.785 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.785 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.785 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:50:01.785 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:32.003008+0000", 2024-02-19T21:50:01.785 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.5120000000000008e-06 2024-02-19T21:50:01.785 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.785 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.785 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:50:01.785 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:32.003017+0000", 2024-02-19T21:50:01.785 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.356088815 2024-02-19T21:50:01.785 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.785 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.785 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:50:01.786 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:32.359106+0000", 2024-02-19T21:50:01.786 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.5899999999999996e-06 2024-02-19T21:50:01.786 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.786 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.786 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:50:01.786 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:32.359112+0000", 2024-02-19T21:50:01.786 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.356177782 2024-02-19T21:50:01.786 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.786 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:50:01.786 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.786 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.786 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.786 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24317.0:1853 5.9 5:93e5b521:::notify.7:head [watch ping cookie 94140601342720] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e285)", 2024-02-19T21:50:01.786 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:44:33.380126+0000", 2024-02-19T21:50:01.787 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 328.39437892199999, 2024-02-19T21:50:01.787 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.005478358, 2024-02-19T21:50:01.787 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:50:01.787 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "started", 2024-02-19T21:50:01.787 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:50:01.787 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24317", 2024-02-19T21:50:01.787 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3365055276", 2024-02-19T21:50:01.787 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 1853 2024-02-19T21:50:01.787 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.787 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:50:01.787 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.787 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:50:01.787 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:33.380126+0000", 2024-02-19T21:50:01.787 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:50:01.787 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.788 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.788 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:50:01.788 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:33.380126+0000", 2024-02-19T21:50:01.788 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:50:01.788 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.788 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.788 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:50:01.788 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:33.380125+0000", 2024-02-19T21:50:01.788 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.7030000000000006e-06 2024-02-19T21:50:01.788 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.788 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.788 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:50:01.788 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:33.380133+0000", 2024-02-19T21:50:01.789 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2743e-05 2024-02-19T21:50:01.789 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.789 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.789 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:50:01.789 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:33.380145+0000", 2024-02-19T21:50:01.789 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.9e-06 2024-02-19T21:50:01.789 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.789 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.789 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:50:01.789 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:33.380152+0000", 2024-02-19T21:50:01.789 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000160242 2024-02-19T21:50:01.789 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.789 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.789 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:50:01.789 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:33.380312+0000", 2024-02-19T21:50:01.790 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0332999999999999e-05 2024-02-19T21:50:01.790 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.790 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.790 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:50:01.790 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:33.380323+0000", 2024-02-19T21:50:01.790 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.005104105 2024-02-19T21:50:01.790 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.790 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.790 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:50:01.790 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:34.385427+0000", 2024-02-19T21:50:01.790 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00011718399999999999 2024-02-19T21:50:01.790 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.790 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.790 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:50:01.791 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:34.385544+0000", 2024-02-19T21:50:01.791 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.0720000000000001e-05 2024-02-19T21:50:01.791 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.791 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.791 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:50:01.791 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:34.385605+0000", 2024-02-19T21:50:01.791 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.005478358 2024-02-19T21:50:01.791 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.791 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:50:01.791 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.791 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.791 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.791 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24317.0:1854 5.9 5:93e5b521:::notify.7:head [watch reconnect cookie 94140601342720 gen 1] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e285)", 2024-02-19T21:50:01.792 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:44:33.380167+0000", 2024-02-19T21:50:01.792 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 328.39433860299999, 2024-02-19T21:50:01.792 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.011091016, 2024-02-19T21:50:01.792 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:50:01.792 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "started", 2024-02-19T21:50:01.792 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:50:01.792 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24317", 2024-02-19T21:50:01.792 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3365055276", 2024-02-19T21:50:01.792 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 1854 2024-02-19T21:50:01.792 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.792 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:50:01.792 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.792 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:50:01.792 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:33.380167+0000", 2024-02-19T21:50:01.792 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:50:01.793 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.793 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.793 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:50:01.793 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:33.380167+0000", 2024-02-19T21:50:01.793 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:50:01.793 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.793 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.793 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:50:01.793 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:33.380166+0000", 2024-02-19T21:50:01.793 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.3289999999999998e-06 2024-02-19T21:50:01.793 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.793 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.793 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:50:01.793 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:33.380169+0000", 2024-02-19T21:50:01.793 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.5014999999999999e-05 2024-02-19T21:50:01.794 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.794 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.794 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:50:01.794 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:33.380184+0000", 2024-02-19T21:50:01.794 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.5699999999999998e-06 2024-02-19T21:50:01.794 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.794 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.794 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:50:01.794 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:33.380191+0000", 2024-02-19T21:50:01.794 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00015778100000000001 2024-02-19T21:50:01.794 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.794 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.794 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:50:01.794 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:33.380349+0000", 2024-02-19T21:50:01.795 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.3179999999999996e-06 2024-02-19T21:50:01.795 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.795 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.795 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:50:01.795 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:33.380358+0000", 2024-02-19T21:50:01.795 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0052663829999999 2024-02-19T21:50:01.795 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.795 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.795 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:50:01.795 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:34.385624+0000", 2024-02-19T21:50:01.795 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.4171999999999995e-05 2024-02-19T21:50:01.795 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.795 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.795 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:50:01.795 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:34.385689+0000", 2024-02-19T21:50:01.796 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0055691339999999999 2024-02-19T21:50:01.796 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.796 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.796 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:50:01.796 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:34.391258+0000", 2024-02-19T21:50:01.796 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.011091016 2024-02-19T21:50:01.796 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.796 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:50:01.796 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.796 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.796 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.796 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.24317.0:1855 5.9 5:93e5b521:::notify.7:head [watch reconnect cookie 94140601342720 gen 2] snapc 0=[] ondisk+write+known_if_redirected e286)", 2024-02-19T21:50:01.796 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:44:33.381756+0000", 2024-02-19T21:50:01.796 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 328.39274965499999, 2024-02-19T21:50:01.797 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.009682583, 2024-02-19T21:50:01.797 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:50:01.797 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "started", 2024-02-19T21:50:01.797 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:50:01.797 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.24317", 2024-02-19T21:50:01.797 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3365055276", 2024-02-19T21:50:01.797 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 1855 2024-02-19T21:50:01.797 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.797 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:50:01.797 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.797 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:50:01.797 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:33.381756+0000", 2024-02-19T21:50:01.797 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:50:01.797 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.797 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.798 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:50:01.798 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:33.381756+0000", 2024-02-19T21:50:01.798 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:50:01.798 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.798 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.798 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:50:01.798 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:33.381754+0000", 2024-02-19T21:50:01.798 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.8059999999999997e-06 2024-02-19T21:50:01.798 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.798 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.798 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:50:01.798 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:33.381761+0000", 2024-02-19T21:50:01.798 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.5088e-05 2024-02-19T21:50:01.798 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.798 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.799 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:50:01.799 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:33.381776+0000", 2024-02-19T21:50:01.799 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.3509999999999996e-06 2024-02-19T21:50:01.799 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.799 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.799 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:50:01.799 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:33.381784+0000", 2024-02-19T21:50:01.799 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.001001795 2024-02-19T21:50:01.799 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.799 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.799 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:50:01.799 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:33.382786+0000", 2024-02-19T21:50:01.799 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.7599999999999997e-06 2024-02-19T21:50:01.799 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.799 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.800 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:50:01.800 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:33.382795+0000", 2024-02-19T21:50:01.800 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0030865010000001 2024-02-19T21:50:01.800 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.800 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.800 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:50:01.800 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:34.385882+0000", 2024-02-19T21:50:01.800 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.7849999999999998e-05 2024-02-19T21:50:01.800 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.800 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.800 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:50:01.800 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:34.385920+0000", 2024-02-19T21:50:01.800 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.005518663 2024-02-19T21:50:01.800 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.801 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.801 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:50:01.801 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:44:34.391438+0000", 2024-02-19T21:50:01.801 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.009682583 2024-02-19T21:50:01.801 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.801 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:50:01.801 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.801 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.801 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.801 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:136667 9.c 9:392f0dde:::benchmark_data_smithi080_126364_object8075:head [delete] snapc 0=[] ondisk+write+known_if_redirected e324)", 2024-02-19T21:50:01.801 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:46:09.114962+0000", 2024-02-19T21:50:01.801 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 232.659542999, 2024-02-19T21:50:01.801 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.116160575, 2024-02-19T21:50:01.801 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:50:01.801 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:01.802 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:50:01.802 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:50:01.802 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:50:01.802 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 136667 2024-02-19T21:50:01.802 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.802 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:50:01.802 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.802 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:50:01.802 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.114962+0000", 2024-02-19T21:50:01.802 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:50:01.802 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.802 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.803 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:50:01.803 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.114962+0000", 2024-02-19T21:50:01.803 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999971 2024-02-19T21:50:01.803 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.803 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.803 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:50:01.803 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.114960+0000", 2024-02-19T21:50:01.803 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1331999999999999e-05 2024-02-19T21:50:01.803 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.803 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.803 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:50:01.803 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.114971+0000", 2024-02-19T21:50:01.803 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1350000000000001e-05 2024-02-19T21:50:01.803 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.803 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.803 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:50:01.804 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.114992+0000", 2024-02-19T21:50:01.804 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.49e-06 2024-02-19T21:50:01.804 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.804 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.804 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:50:01.804 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.115001+0000", 2024-02-19T21:50:01.804 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.1068e-05 2024-02-19T21:50:01.804 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.804 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.804 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:50:01.804 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.115052+0000", 2024-02-19T21:50:01.804 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00010778899999999999 2024-02-19T21:50:01.804 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.805 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.805 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:50:01.805 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.115160+0000", 2024-02-19T21:50:01.805 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00012431700000000001 2024-02-19T21:50:01.805 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.805 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.805 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:50:01.805 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.115284+0000", 2024-02-19T21:50:01.805 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0041207229999999997 2024-02-19T21:50:01.805 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.805 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.805 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:50:01.805 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.119405+0000", 2024-02-19T21:50:01.805 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0043233430000000003 2024-02-19T21:50:01.805 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.806 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.806 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:01.806 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.123728+0000", 2024-02-19T21:50:01.806 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.107307259 2024-02-19T21:50:01.806 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.806 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.806 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:01.806 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.231035+0000", 2024-02-19T21:50:01.806 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0720000000000002e-05 2024-02-19T21:50:01.806 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.806 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.806 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:50:01.806 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.231086+0000", 2024-02-19T21:50:01.806 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.6847000000000001e-05 2024-02-19T21:50:01.807 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.807 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.807 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:50:01.807 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.231123+0000", 2024-02-19T21:50:01.807 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.116160575 2024-02-19T21:50:01.807 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.807 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:50:01.807 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.807 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.807 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.807 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:136673 9.c 9:3b20f078:::benchmark_data_smithi080_126364_object8081:head [delete] snapc 0=[] ondisk+write+known_if_redirected e324)", 2024-02-19T21:50:01.807 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:46:09.127354+0000", 2024-02-19T21:50:01.807 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 232.647150866, 2024-02-19T21:50:01.807 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.103890881, 2024-02-19T21:50:01.808 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:50:01.808 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:01.808 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:50:01.808 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:50:01.808 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:50:01.808 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 136673 2024-02-19T21:50:01.808 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.808 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:50:01.808 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.808 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:50:01.808 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.127354+0000", 2024-02-19T21:50:01.808 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:50:01.808 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.808 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.809 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:50:01.809 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.127354+0000", 2024-02-19T21:50:01.809 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:50:01.809 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.809 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.809 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:50:01.809 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.127353+0000", 2024-02-19T21:50:01.809 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.6410000000000002e-06 2024-02-19T21:50:01.809 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.809 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.809 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:50:01.809 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.127361+0000", 2024-02-19T21:50:01.809 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.465e-05 2024-02-19T21:50:01.809 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.809 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.810 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:50:01.810 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.127375+0000", 2024-02-19T21:50:01.810 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.3189999999999997e-06 2024-02-19T21:50:01.810 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.810 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.810 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:50:01.810 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.127383+0000", 2024-02-19T21:50:01.810 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.7153999999999997e-05 2024-02-19T21:50:01.810 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.810 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.810 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:50:01.810 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.127420+0000", 2024-02-19T21:50:01.810 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.5963000000000003e-05 2024-02-19T21:50:01.810 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.811 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.811 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:50:01.811 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.127506+0000", 2024-02-19T21:50:01.811 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.8170000000000005e-05 2024-02-19T21:50:01.811 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.811 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.811 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:50:01.811 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.127594+0000", 2024-02-19T21:50:01.811 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.005388739 2024-02-19T21:50:01.811 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.811 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.811 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:50:01.811 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.132983+0000", 2024-02-19T21:50:01.811 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.8477999999999999e-05 2024-02-19T21:50:01.811 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.812 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.812 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:01.812 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.133031+0000", 2024-02-19T21:50:01.812 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.098157672000000001 2024-02-19T21:50:01.812 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.812 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.812 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:01.812 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.231189+0000", 2024-02-19T21:50:01.812 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.9368000000000001e-05 2024-02-19T21:50:01.812 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.812 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.812 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:50:01.812 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.231218+0000", 2024-02-19T21:50:01.812 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.7120000000000001e-05 2024-02-19T21:50:01.813 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.813 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.813 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:50:01.813 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.231245+0000", 2024-02-19T21:50:01.813 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.103890881 2024-02-19T21:50:01.813 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.813 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:50:01.813 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.813 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.813 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.813 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:136674 9.c 9:3fc2b4f2:::benchmark_data_smithi080_126364_object8082:head [delete] snapc 0=[] ondisk+write+known_if_redirected e324)", 2024-02-19T21:50:01.813 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:46:09.127401+0000", 2024-02-19T21:50:01.813 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 232.64710435500001, 2024-02-19T21:50:01.813 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.107860922, 2024-02-19T21:50:01.813 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:50:01.813 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:01.814 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:50:01.814 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:50:01.814 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:50:01.814 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 136674 2024-02-19T21:50:01.814 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.814 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:50:01.814 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.814 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:50:01.814 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.127401+0000", 2024-02-19T21:50:01.814 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:50:01.814 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.814 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.814 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:50:01.814 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.127401+0000", 2024-02-19T21:50:01.814 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:50:01.815 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.815 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.815 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:50:01.815 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.127400+0000", 2024-02-19T21:50:01.815 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0249999999999996e-06 2024-02-19T21:50:01.815 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.815 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.815 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:50:01.815 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.127404+0000", 2024-02-19T21:50:01.815 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.6720000000000001e-06 2024-02-19T21:50:01.815 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.815 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.815 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:50:01.815 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.127410+0000", 2024-02-19T21:50:01.815 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.1319999999999998e-06 2024-02-19T21:50:01.816 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.816 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.816 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:50:01.816 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.127413+0000", 2024-02-19T21:50:01.816 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0032364160000000002 2024-02-19T21:50:01.816 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.816 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.816 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:50:01.816 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.130650+0000", 2024-02-19T21:50:01.816 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000117587 2024-02-19T21:50:01.816 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.816 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.816 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:50:01.816 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.130767+0000", 2024-02-19T21:50:01.816 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.6032999999999995e-05 2024-02-19T21:50:01.817 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.817 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.817 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:50:01.817 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.130843+0000", 2024-02-19T21:50:01.817 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0023421150000000001 2024-02-19T21:50:01.817 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.817 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.817 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:50:01.817 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.133185+0000", 2024-02-19T21:50:01.817 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00068911099999999996 2024-02-19T21:50:01.817 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.817 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.817 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:01.817 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.133874+0000", 2024-02-19T21:50:01.817 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.101292563 2024-02-19T21:50:01.818 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.818 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.818 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:01.818 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.235167+0000", 2024-02-19T21:50:01.818 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.4419999999999997e-05 2024-02-19T21:50:01.818 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.818 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.818 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:50:01.818 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.235221+0000", 2024-02-19T21:50:01.818 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0460000000000002e-05 2024-02-19T21:50:01.818 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.818 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.818 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:50:01.818 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:09.235262+0000", 2024-02-19T21:50:01.818 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.107860922 2024-02-19T21:50:01.819 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.819 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:50:01.819 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.819 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.819 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.819 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:182693 9.c 9:3882df4a:::benchmark_data_smithi080_126364_object54101:head [delete] snapc 0=[] ondisk+write+known_if_redirected e338)", 2024-02-19T21:50:01.819 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:46:53.567142+0000", 2024-02-19T21:50:01.819 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 188.207363294, 2024-02-19T21:50:01.819 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.080288190999999995, 2024-02-19T21:50:01.819 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:50:01.819 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:01.819 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:50:01.819 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:50:01.819 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:50:01.820 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 182693 2024-02-19T21:50:01.820 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.820 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:50:01.820 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.820 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:50:01.820 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:53.567142+0000", 2024-02-19T21:50:01.820 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:50:01.820 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.820 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.820 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:50:01.820 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:53.567142+0000", 2024-02-19T21:50:01.820 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:50:01.820 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.820 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.820 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:50:01.821 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:53.567142+0000", 2024-02-19T21:50:01.821 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.5890000000000001e-06 2024-02-19T21:50:01.821 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.821 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.821 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:50:01.821 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:53.567144+0000", 2024-02-19T21:50:01.821 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.7770000000000002e-06 2024-02-19T21:50:01.821 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.821 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.821 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:50:01.821 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:53.567149+0000", 2024-02-19T21:50:01.821 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.774e-06 2024-02-19T21:50:01.821 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.821 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.821 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:50:01.821 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:53.567152+0000", 2024-02-19T21:50:01.822 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0042306380000000001 2024-02-19T21:50:01.822 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.822 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.822 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:50:01.822 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:53.571382+0000", 2024-02-19T21:50:01.822 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00011518699999999999 2024-02-19T21:50:01.822 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.822 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.822 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:50:01.822 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:53.571497+0000", 2024-02-19T21:50:01.822 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000128441 2024-02-19T21:50:01.822 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.822 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.822 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:50:01.823 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:53.571626+0000", 2024-02-19T21:50:01.823 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0044754499999999997 2024-02-19T21:50:01.823 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.823 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.823 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:50:01.823 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:53.576101+0000", 2024-02-19T21:50:01.823 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000102821 2024-02-19T21:50:01.823 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.823 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.823 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:01.823 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:53.576204+0000", 2024-02-19T21:50:01.823 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.003803889 2024-02-19T21:50:01.823 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.823 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.823 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:01.824 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:53.580008+0000", 2024-02-19T21:50:01.824 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.8598e-05 2024-02-19T21:50:01.824 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.824 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.824 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:50:01.824 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:53.580037+0000", 2024-02-19T21:50:01.824 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.067393546999999998 2024-02-19T21:50:01.824 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.824 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.824 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:50:01.824 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:46:53.647430+0000", 2024-02-19T21:50:01.824 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.080288190999999995 2024-02-19T21:50:01.824 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.824 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:50:01.825 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.825 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.825 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.825 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:34148 10.c 10:3c380b0b:::benchmark_data_smithi080_153340_object34147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e403)", 2024-02-19T21:50:01.825 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:21.998442+0000", 2024-02-19T21:50:01.825 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 39.776063503000003, 2024-02-19T21:50:01.825 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.035426200999999997, 2024-02-19T21:50:01.825 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:50:01.825 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:01.825 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:50:01.825 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:50:01.825 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:01.825 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 34148 2024-02-19T21:50:01.825 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.826 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:50:01.826 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.826 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:50:01.826 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:21.998442+0000", 2024-02-19T21:50:01.826 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:50:01.826 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.826 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.826 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:50:01.826 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:21.998442+0000", 2024-02-19T21:50:01.826 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999976 2024-02-19T21:50:01.826 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.826 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.826 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:50:01.826 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:21.998439+0000", 2024-02-19T21:50:01.826 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.3594000000000003e-05 2024-02-19T21:50:01.827 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.827 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.827 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:50:01.827 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:21.998483+0000", 2024-02-19T21:50:01.827 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.2441000000000001e-05 2024-02-19T21:50:01.827 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.827 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.827 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:50:01.827 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:21.998505+0000", 2024-02-19T21:50:01.827 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.3729999999999999e-06 2024-02-19T21:50:01.827 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.827 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.827 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:50:01.827 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:21.998515+0000", 2024-02-19T21:50:01.827 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.6067999999999999e-05 2024-02-19T21:50:01.827 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.828 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.828 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:50:01.828 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:21.998571+0000", 2024-02-19T21:50:01.828 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.6760000000000007e-06 2024-02-19T21:50:01.828 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.828 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.828 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op must wait for map", 2024-02-19T21:50:01.828 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:21.998579+0000", 2024-02-19T21:50:01.828 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.007438549 2024-02-19T21:50:01.828 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.828 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.828 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:50:01.828 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:22.006017+0000", 2024-02-19T21:50:01.828 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000135981 2024-02-19T21:50:01.829 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.829 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.829 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:50:01.829 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:22.006153+0000", 2024-02-19T21:50:01.829 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00016528300000000001 2024-02-19T21:50:01.829 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.829 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.829 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:50:01.829 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:22.006318+0000", 2024-02-19T21:50:01.829 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0033305520000000001 2024-02-19T21:50:01.829 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.829 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.829 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:01.829 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:22.009649+0000", 2024-02-19T21:50:01.829 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.3012999999999999e-05 2024-02-19T21:50:01.830 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.830 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.830 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:50:01.830 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:22.009742+0000", 2024-02-19T21:50:01.830 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.024032959999999999 2024-02-19T21:50:01.830 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.830 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.830 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:01.830 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:22.033775+0000", 2024-02-19T21:50:01.830 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0575000000000003e-05 2024-02-19T21:50:01.830 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.830 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.830 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:50:01.830 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:22.033826+0000", 2024-02-19T21:50:01.830 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.2543000000000002e-05 2024-02-19T21:50:01.831 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.831 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.831 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:50:01.831 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:22.033868+0000", 2024-02-19T21:50:01.831 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.035426200999999997 2024-02-19T21:50:01.831 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.831 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:50:01.831 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.831 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.831 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.831 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:49743 10.c 10:3ac41a64:::benchmark_data_smithi080_153340_object49742:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e408)", 2024-02-19T21:50:01.831 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:36.446244+0000", 2024-02-19T21:50:01.831 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 25.328261486999999, 2024-02-19T21:50:01.832 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.035391051, 2024-02-19T21:50:01.832 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:50:01.832 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:01.832 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:50:01.832 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:50:01.832 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:01.832 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 49743 2024-02-19T21:50:01.832 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.832 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:50:01.832 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.832 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:50:01.832 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.446244+0000", 2024-02-19T21:50:01.832 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:50:01.832 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.833 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.833 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:50:01.833 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.446244+0000", 2024-02-19T21:50:01.833 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:50:01.833 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.833 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.833 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:50:01.833 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.446243+0000", 2024-02-19T21:50:01.833 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.3501999999999998e-05 2024-02-19T21:50:01.833 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.833 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.833 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:50:01.833 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.446287+0000", 2024-02-19T21:50:01.833 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.8709999999999997e-06 2024-02-19T21:50:01.833 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.834 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.834 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:50:01.834 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.446295+0000", 2024-02-19T21:50:01.834 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.4469999999999997e-06 2024-02-19T21:50:01.834 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.834 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.834 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:50:01.834 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.446300+0000", 2024-02-19T21:50:01.834 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0040749660000000002 2024-02-19T21:50:01.834 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.834 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.834 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:50:01.834 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.450375+0000", 2024-02-19T21:50:01.834 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000110955 2024-02-19T21:50:01.835 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.835 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.835 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:50:01.835 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.450486+0000", 2024-02-19T21:50:01.835 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013932199999999999 2024-02-19T21:50:01.835 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.835 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.835 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:50:01.835 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.450625+0000", 2024-02-19T21:50:01.835 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0035416710000000001 2024-02-19T21:50:01.835 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.835 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.835 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:50:01.835 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.454167+0000", 2024-02-19T21:50:01.836 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0051844059999999999 2024-02-19T21:50:01.836 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.836 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.836 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:01.836 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.459351+0000", 2024-02-19T21:50:01.836 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.022183418 2024-02-19T21:50:01.836 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.836 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.836 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:01.836 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.481535+0000", 2024-02-19T21:50:01.836 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.5883e-05 2024-02-19T21:50:01.836 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.836 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.837 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:50:01.837 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.481591+0000", 2024-02-19T21:50:01.837 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.4141999999999999e-05 2024-02-19T21:50:01.837 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.837 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.837 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:50:01.837 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.481635+0000", 2024-02-19T21:50:01.837 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.035391051 2024-02-19T21:50:01.837 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.837 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:50:01.837 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.837 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.837 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.837 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:49749 10.c 10:303d776c:::benchmark_data_smithi080_153340_object49748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e408)", 2024-02-19T21:50:01.837 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:36.449882+0000", 2024-02-19T21:50:01.838 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 25.324623677000002, 2024-02-19T21:50:01.838 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.031927810000000001, 2024-02-19T21:50:01.838 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:50:01.838 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:01.838 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:50:01.838 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:50:01.838 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:01.838 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 49749 2024-02-19T21:50:01.838 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.838 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:50:01.838 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.838 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:50:01.838 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.449882+0000", 2024-02-19T21:50:01.838 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:50:01.838 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.839 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.839 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:50:01.839 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.449882+0000", 2024-02-19T21:50:01.839 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:50:01.839 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.839 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.839 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:50:01.839 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.449880+0000", 2024-02-19T21:50:01.839 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0655999999999998e-05 2024-02-19T21:50:01.839 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.839 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.839 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:50:01.839 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.449921+0000", 2024-02-19T21:50:01.839 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.3183000000000001e-05 2024-02-19T21:50:01.839 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.839 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.840 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:50:01.840 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.449934+0000", 2024-02-19T21:50:01.840 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.0119999999999999e-06 2024-02-19T21:50:01.840 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.840 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.840 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:50:01.840 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.449941+0000", 2024-02-19T21:50:01.840 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0023569950000000002 2024-02-19T21:50:01.840 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.840 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.840 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:50:01.840 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.452298+0000", 2024-02-19T21:50:01.840 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000120016 2024-02-19T21:50:01.840 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.841 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.841 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:50:01.841 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.452418+0000", 2024-02-19T21:50:01.841 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013964899999999999 2024-02-19T21:50:01.841 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.841 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.841 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:50:01.841 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.452558+0000", 2024-02-19T21:50:01.841 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.001615383 2024-02-19T21:50:01.841 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.841 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.841 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:50:01.841 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.454173+0000", 2024-02-19T21:50:01.841 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0052418150000000004 2024-02-19T21:50:01.841 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.842 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.842 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:01.842 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.459415+0000", 2024-02-19T21:50:01.842 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.022312789999999999 2024-02-19T21:50:01.842 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.842 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.842 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:01.842 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.481728+0000", 2024-02-19T21:50:01.842 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.5853999999999998e-05 2024-02-19T21:50:01.842 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.842 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.842 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:50:01.842 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.481774+0000", 2024-02-19T21:50:01.842 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.5899000000000003e-05 2024-02-19T21:50:01.842 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.842 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.843 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:50:01.843 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.481809+0000", 2024-02-19T21:50:01.843 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.031927810000000001 2024-02-19T21:50:01.843 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.843 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:50:01.843 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.843 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.843 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.843 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:53479 10.c 10:30b63fed:::benchmark_data_smithi080_153340_object53478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e410)", 2024-02-19T21:50:01.843 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:40.381256+0000", 2024-02-19T21:50:01.843 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 21.393249808, 2024-02-19T21:50:01.843 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.037687278999999997, 2024-02-19T21:50:01.843 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:50:01.843 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:01.844 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:50:01.844 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:50:01.844 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:01.844 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 53479 2024-02-19T21:50:01.844 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.844 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:50:01.844 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.844 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:50:01.844 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:40.381256+0000", 2024-02-19T21:50:01.844 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:50:01.844 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.844 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.844 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:50:01.844 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:40.381256+0000", 2024-02-19T21:50:01.844 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:50:01.845 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.845 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.845 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:50:01.845 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:40.381255+0000", 2024-02-19T21:50:01.845 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.1446999999999998e-05 2024-02-19T21:50:01.845 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.845 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.845 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:50:01.845 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:40.381296+0000", 2024-02-19T21:50:01.845 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.7800000000000006e-06 2024-02-19T21:50:01.845 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.845 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.845 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:50:01.845 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:40.381305+0000", 2024-02-19T21:50:01.846 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.8849999999999998e-06 2024-02-19T21:50:01.846 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.846 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.846 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:50:01.846 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:40.381310+0000", 2024-02-19T21:50:01.846 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0043440589999999999 2024-02-19T21:50:01.846 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.846 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.846 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:50:01.846 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:40.385654+0000", 2024-02-19T21:50:01.846 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013981200000000001 2024-02-19T21:50:01.846 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.846 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.846 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:50:01.846 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:40.385794+0000", 2024-02-19T21:50:01.847 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014417999999999999 2024-02-19T21:50:01.847 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.847 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.847 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:50:01.847 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:40.385938+0000", 2024-02-19T21:50:01.847 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0058128650000000004 2024-02-19T21:50:01.847 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.847 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.847 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:50:01.847 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:40.391751+0000", 2024-02-19T21:50:01.847 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.005889615 2024-02-19T21:50:01.847 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.847 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.847 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:01.847 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:40.397640+0000", 2024-02-19T21:50:01.848 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.021214342000000001 2024-02-19T21:50:01.848 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.848 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.848 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:01.848 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:40.418855+0000", 2024-02-19T21:50:01.848 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.9670999999999999e-05 2024-02-19T21:50:01.848 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.848 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.848 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:50:01.848 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:40.418905+0000", 2024-02-19T21:50:01.848 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.8309000000000002e-05 2024-02-19T21:50:01.848 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.848 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.848 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:50:01.849 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:40.418943+0000", 2024-02-19T21:50:01.849 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.037687278999999997 2024-02-19T21:50:01.849 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.849 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:50:01.849 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.849 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.849 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.849 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:53486 10.c 10:369565a1:::benchmark_data_smithi080_153340_object53485:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e410)", 2024-02-19T21:50:01.849 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:40.384183+0000", 2024-02-19T21:50:01.849 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 21.390322384000001, 2024-02-19T21:50:01.849 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.034852503999999999, 2024-02-19T21:50:01.849 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:50:01.849 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:01.849 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:50:01.849 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:50:01.850 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:01.850 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 53486 2024-02-19T21:50:01.850 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.850 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:50:01.850 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.850 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:50:01.850 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:40.384183+0000", 2024-02-19T21:50:01.850 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:50:01.850 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.850 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.850 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:50:01.850 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:40.384183+0000", 2024-02-19T21:50:01.850 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:50:01.850 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.850 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.851 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:50:01.851 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:40.384181+0000", 2024-02-19T21:50:01.851 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.2945999999999998e-05 2024-02-19T21:50:01.851 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.851 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.851 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:50:01.851 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:40.384234+0000", 2024-02-19T21:50:01.851 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.6424000000000001e-05 2024-02-19T21:50:01.851 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.851 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.851 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:50:01.851 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:40.384251+0000", 2024-02-19T21:50:01.851 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.985e-06 2024-02-19T21:50:01.851 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.851 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.851 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:50:01.852 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:40.384258+0000", 2024-02-19T21:50:01.852 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0034839039999999999 2024-02-19T21:50:01.852 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.852 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.852 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:50:01.852 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:40.387742+0000", 2024-02-19T21:50:01.852 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00011929099999999999 2024-02-19T21:50:01.852 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.852 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.852 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:50:01.852 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:40.387861+0000", 2024-02-19T21:50:01.852 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000102866 2024-02-19T21:50:01.852 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.852 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.852 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:50:01.853 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:40.387964+0000", 2024-02-19T21:50:01.853 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0097055000000000006 2024-02-19T21:50:01.853 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.853 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.853 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:01.853 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:40.397669+0000", 2024-02-19T21:50:01.853 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0037093920000000002 2024-02-19T21:50:01.853 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.853 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.853 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:50:01.853 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:40.401379+0000", 2024-02-19T21:50:01.853 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.017594764999999998 2024-02-19T21:50:01.853 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.853 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.853 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:01.854 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:40.418973+0000", 2024-02-19T21:50:01.854 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.3454000000000002e-05 2024-02-19T21:50:01.854 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.854 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.854 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:50:01.854 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:40.419007+0000", 2024-02-19T21:50:01.854 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.8564999999999998e-05 2024-02-19T21:50:01.854 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.854 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.854 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:50:01.854 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:40.419035+0000", 2024-02-19T21:50:01.854 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.034852503999999999 2024-02-19T21:50:01.854 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.854 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:50:01.854 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.855 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.855 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.855 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:54413 10.c 10:349e299a:::benchmark_data_smithi080_153340_object54412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e410)", 2024-02-19T21:50:01.855 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:41.329195+0000", 2024-02-19T21:50:01.855 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 20.445310823, 2024-02-19T21:50:01.855 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.037404246000000002, 2024-02-19T21:50:01.855 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:50:01.855 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:01.855 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:50:01.855 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:50:01.855 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:01.855 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 54413 2024-02-19T21:50:01.855 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.855 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:50:01.855 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.856 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:50:01.856 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.329195+0000", 2024-02-19T21:50:01.856 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:50:01.856 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.856 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.856 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:50:01.856 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.329195+0000", 2024-02-19T21:50:01.856 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999971 2024-02-19T21:50:01.856 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.856 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.856 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:50:01.856 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.329192+0000", 2024-02-19T21:50:01.856 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.1223000000000002e-05 2024-02-19T21:50:01.856 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.856 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.857 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:50:01.857 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.329233+0000", 2024-02-19T21:50:01.857 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.459e-05 2024-02-19T21:50:01.857 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.857 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.857 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:50:01.857 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.329257+0000", 2024-02-19T21:50:01.857 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.1084000000000001e-05 2024-02-19T21:50:01.857 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.857 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.857 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:50:01.857 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.329309+0000", 2024-02-19T21:50:01.857 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0025213610000000002 2024-02-19T21:50:01.857 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.857 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.858 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:50:01.858 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.331830+0000", 2024-02-19T21:50:01.858 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014094800000000001 2024-02-19T21:50:01.858 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.858 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.858 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:50:01.858 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.331971+0000", 2024-02-19T21:50:01.858 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000154151 2024-02-19T21:50:01.858 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.858 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.858 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:50:01.858 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.332125+0000", 2024-02-19T21:50:01.858 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0039911169999999998 2024-02-19T21:50:01.858 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.858 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.859 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:01.859 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.336116+0000", 2024-02-19T21:50:01.859 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0051594060000000001 2024-02-19T21:50:01.859 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.859 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.859 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:50:01.859 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.341276+0000", 2024-02-19T21:50:01.859 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.025229095 2024-02-19T21:50:01.859 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.859 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.859 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:01.859 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.366505+0000", 2024-02-19T21:50:01.859 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.4610000000000001e-05 2024-02-19T21:50:01.859 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.859 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.860 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:50:01.860 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.366559+0000", 2024-02-19T21:50:01.860 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.9529e-05 2024-02-19T21:50:01.860 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.860 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.860 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:50:01.860 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.366599+0000", 2024-02-19T21:50:01.860 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.037404246000000002 2024-02-19T21:50:01.860 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.860 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:50:01.860 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.860 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.860 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.861 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:54415 10.c 10:37577951:::benchmark_data_smithi080_153340_object54414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e410)", 2024-02-19T21:50:01.861 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:41.330471+0000", 2024-02-19T21:50:01.861 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 20.444034457000001, 2024-02-19T21:50:01.861 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.036233289000000002, 2024-02-19T21:50:01.861 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:50:01.861 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:01.861 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:50:01.861 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:50:01.861 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:01.861 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 54415 2024-02-19T21:50:01.861 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.861 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:50:01.861 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.861 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:50:01.861 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.330471+0000", 2024-02-19T21:50:01.861 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:50:01.862 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.862 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.862 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:50:01.862 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.330471+0000", 2024-02-19T21:50:01.862 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:50:01.862 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.862 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.862 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:50:01.862 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.330470+0000", 2024-02-19T21:50:01.862 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.7404999999999999e-05 2024-02-19T21:50:01.862 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.862 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.862 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:50:01.862 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.330497+0000", 2024-02-19T21:50:01.863 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1593999999999999e-05 2024-02-19T21:50:01.863 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.863 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.863 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:50:01.863 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.330509+0000", 2024-02-19T21:50:01.863 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.8409999999999996e-06 2024-02-19T21:50:01.863 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.863 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.863 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:50:01.863 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.330515+0000", 2024-02-19T21:50:01.863 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0035280810000000002 2024-02-19T21:50:01.863 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.863 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.863 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:50:01.863 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.334043+0000", 2024-02-19T21:50:01.864 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00011133699999999999 2024-02-19T21:50:01.864 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.864 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.864 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:50:01.864 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.334154+0000", 2024-02-19T21:50:01.864 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014310899999999999 2024-02-19T21:50:01.864 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.864 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.864 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:50:01.864 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.334297+0000", 2024-02-19T21:50:01.864 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0018438409999999999 2024-02-19T21:50:01.864 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.864 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.864 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:01.864 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.336141+0000", 2024-02-19T21:50:01.865 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0051429149999999996 2024-02-19T21:50:01.865 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.865 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.865 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:50:01.865 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.341284+0000", 2024-02-19T21:50:01.865 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.025349267000000002 2024-02-19T21:50:01.865 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.865 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.865 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:01.865 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.366633+0000", 2024-02-19T21:50:01.865 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.7319e-05 2024-02-19T21:50:01.865 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.865 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.865 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:50:01.865 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.366670+0000", 2024-02-19T21:50:01.866 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.3716e-05 2024-02-19T21:50:01.866 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.866 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.866 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:50:01.866 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.366704+0000", 2024-02-19T21:50:01.866 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.036233289000000002 2024-02-19T21:50:01.866 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.866 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:50:01.866 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.866 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.866 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.866 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:54416 10.c 10:3dfac3eb:::benchmark_data_smithi080_153340_object54415:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e410)", 2024-02-19T21:50:01.866 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:41.330521+0000", 2024-02-19T21:50:01.866 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 20.443983994, 2024-02-19T21:50:01.866 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.036284487999999997, 2024-02-19T21:50:01.867 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:50:01.867 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:01.867 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:50:01.867 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:50:01.867 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:01.867 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 54416 2024-02-19T21:50:01.867 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.867 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:50:01.867 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.867 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:50:01.867 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.330521+0000", 2024-02-19T21:50:01.867 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:50:01.867 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.867 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.867 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:50:01.868 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.330521+0000", 2024-02-19T21:50:01.868 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:50:01.868 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.868 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.868 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:50:01.868 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.330521+0000", 2024-02-19T21:50:01.868 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.1228e-05 2024-02-19T21:50:01.868 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.868 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.868 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:50:01.868 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.330552+0000", 2024-02-19T21:50:01.868 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.8409999999999999e-06 2024-02-19T21:50:01.869 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.869 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.869 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:50:01.869 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.330557+0000", 2024-02-19T21:50:01.869 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.365e-06 2024-02-19T21:50:01.869 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.869 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.869 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:50:01.869 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.330560+0000", 2024-02-19T21:50:01.869 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0056018839999999997 2024-02-19T21:50:01.869 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.869 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.869 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:50:01.869 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.336162+0000", 2024-02-19T21:50:01.869 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00012793700000000001 2024-02-19T21:50:01.869 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.870 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.870 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:50:01.870 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.336290+0000", 2024-02-19T21:50:01.870 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000152261 2024-02-19T21:50:01.870 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.870 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.870 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:50:01.870 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.336442+0000", 2024-02-19T21:50:01.870 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0050876819999999996 2024-02-19T21:50:01.870 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.870 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.870 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:01.870 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.341530+0000", 2024-02-19T21:50:01.870 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.011185219999999999 2024-02-19T21:50:01.871 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.871 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.871 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:50:01.871 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.352715+0000", 2024-02-19T21:50:01.871 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.014021811 2024-02-19T21:50:01.871 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.871 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.871 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:01.871 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.366737+0000", 2024-02-19T21:50:01.871 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.7252000000000002e-05 2024-02-19T21:50:01.871 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.871 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.871 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:50:01.871 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.366774+0000", 2024-02-19T21:50:01.871 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.1458999999999998e-05 2024-02-19T21:50:01.872 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.872 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.872 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:50:01.872 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.366806+0000", 2024-02-19T21:50:01.872 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.036284487999999997 2024-02-19T21:50:01.872 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.872 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:50:01.872 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.872 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.872 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.872 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:54938 10.c 10:3ac668e5:::benchmark_data_smithi080_153340_object54937:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e410)", 2024-02-19T21:50:01.872 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:41.855282+0000", 2024-02-19T21:50:01.872 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 19.919223713000001, 2024-02-19T21:50:01.872 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.035232659, 2024-02-19T21:50:01.873 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:50:01.873 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:01.873 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:50:01.873 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:50:01.873 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:01.873 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 54938 2024-02-19T21:50:01.873 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.873 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:50:01.873 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.873 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:50:01.873 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.855282+0000", 2024-02-19T21:50:01.873 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:50:01.873 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.873 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.874 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:50:01.874 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.855282+0000", 2024-02-19T21:50:01.874 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:50:01.874 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.874 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.874 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:50:01.874 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.855280+0000", 2024-02-19T21:50:01.874 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.9879999999999999e-05 2024-02-19T21:50:01.874 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.874 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.874 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:50:01.874 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.855379+0000", 2024-02-19T21:50:01.874 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1420000000000002e-05 2024-02-19T21:50:01.874 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.874 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.874 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:50:01.875 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.855401+0000", 2024-02-19T21:50:01.875 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1847e-05 2024-02-19T21:50:01.875 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.875 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.875 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:50:01.875 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.855413+0000", 2024-02-19T21:50:01.875 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00068935199999999996 2024-02-19T21:50:01.875 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.875 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.875 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:50:01.875 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.856102+0000", 2024-02-19T21:50:01.875 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00016054400000000001 2024-02-19T21:50:01.875 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.875 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.875 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:50:01.876 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.856263+0000", 2024-02-19T21:50:01.876 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00018349800000000001 2024-02-19T21:50:01.876 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.876 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.876 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:50:01.876 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.856446+0000", 2024-02-19T21:50:01.876 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0021965019999999999 2024-02-19T21:50:01.876 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.876 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.876 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:01.876 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.858643+0000", 2024-02-19T21:50:01.876 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00087612499999999995 2024-02-19T21:50:01.876 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.876 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.877 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:50:01.877 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.859519+0000", 2024-02-19T21:50:01.877 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.030907792999999999 2024-02-19T21:50:01.877 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.877 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.877 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:01.877 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.890427+0000", 2024-02-19T21:50:01.877 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.02e-05 2024-02-19T21:50:01.877 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.877 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.877 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:50:01.877 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.890477+0000", 2024-02-19T21:50:01.877 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.7574999999999999e-05 2024-02-19T21:50:01.877 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.877 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.878 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:50:01.878 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:41.890514+0000", 2024-02-19T21:50:01.878 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.035232659 2024-02-19T21:50:01.878 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.878 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:50:01.878 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.878 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.878 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.878 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_repop(client.25511.0:65228 10.8 e415/414 10:16610bcc:::benchmark_data_smithi080_153340_object65227:head v 415'3980, mlcod=0'0)", 2024-02-19T21:50:01.878 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:55.777288+0000", 2024-02-19T21:50:01.878 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 5.9972177899999997, 2024-02-19T21:50:01.878 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.034636276000000001, 2024-02-19T21:50:01.878 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:50:01.878 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:01.879 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:50:01.879 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.879 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:50:01.879 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:55.777288+0000", 2024-02-19T21:50:01.879 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:50:01.879 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.879 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.879 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:50:01.879 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:55.777288+0000", 2024-02-19T21:50:01.879 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:50:01.879 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.879 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.879 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:50:01.879 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:55.777286+0000", 2024-02-19T21:50:01.879 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.7706000000000001e-05 2024-02-19T21:50:01.880 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.880 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.880 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:50:01.880 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:55.777324+0000", 2024-02-19T21:50:01.880 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2548000000000001e-05 2024-02-19T21:50:01.880 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.880 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.880 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:50:01.880 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:55.777337+0000", 2024-02-19T21:50:01.880 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.6120000000000005e-06 2024-02-19T21:50:01.880 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.880 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.880 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:50:01.880 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:55.777346+0000", 2024-02-19T21:50:01.881 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.0391000000000001e-05 2024-02-19T21:50:01.881 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.881 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.881 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:50:01.881 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:55.777377+0000", 2024-02-19T21:50:01.881 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.6638000000000001e-05 2024-02-19T21:50:01.881 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.881 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.881 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:50:01.881 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:55.777403+0000", 2024-02-19T21:50:01.881 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.034477583999999999 2024-02-19T21:50:01.881 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.881 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.881 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:50:01.882 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:55.811881+0000", 2024-02-19T21:50:01.882 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.2966000000000002e-05 2024-02-19T21:50:01.882 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.882 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.882 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:50:01.882 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:55.811924+0000", 2024-02-19T21:50:01.882 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.034636276000000001 2024-02-19T21:50:01.882 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.882 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:50:01.882 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.882 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.882 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.882 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_repop(client.25511.0:65234 10.9 e415/414 10:9b2b0162:::benchmark_data_smithi080_153340_object65233:head v 415'4037, mlcod=0'0)", 2024-02-19T21:50:01.882 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:55.777372+0000", 2024-02-19T21:50:01.883 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 5.9971331210000001, 2024-02-19T21:50:01.883 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.035167592999999997, 2024-02-19T21:50:01.883 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:50:01.883 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:01.883 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:50:01.883 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.883 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:50:01.883 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:55.777372+0000", 2024-02-19T21:50:01.883 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:50:01.883 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.883 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.883 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:50:01.883 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:55.777372+0000", 2024-02-19T21:50:01.883 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:50:01.883 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.884 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.884 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:50:01.884 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:55.777372+0000", 2024-02-19T21:50:01.884 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.2345999999999999e-05 2024-02-19T21:50:01.884 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.884 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.884 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:50:01.884 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:55.777394+0000", 2024-02-19T21:50:01.884 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.072e-06 2024-02-19T21:50:01.884 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.884 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.884 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:50:01.884 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:55.777402+0000", 2024-02-19T21:50:01.884 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.3229999999999999e-06 2024-02-19T21:50:01.884 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.885 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.885 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:50:01.885 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:55.777406+0000", 2024-02-19T21:50:01.885 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.002012415 2024-02-19T21:50:01.885 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.885 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.885 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:50:01.885 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:55.779419+0000", 2024-02-19T21:50:01.885 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.0385000000000001e-05 2024-02-19T21:50:01.885 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.885 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.885 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:50:01.885 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:55.779449+0000", 2024-02-19T21:50:01.885 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.033057225000000003 2024-02-19T21:50:01.885 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.886 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.886 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:50:01.886 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:55.812506+0000", 2024-02-19T21:50:01.886 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.3426999999999997e-05 2024-02-19T21:50:01.886 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:50:01.886 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:50:01.886 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:50:01.886 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:55.812540+0000", 2024-02-19T21:50:01.886 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.035167592999999997 2024-02-19T21:50:01.886 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.886 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:50:01.886 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.886 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:50:01.886 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:50:01.887 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:50:01.887 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:50:01.887 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:00.931798+0000 mgr.y (mgr.14514) 662 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:50:01.888 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:00.931798+0000 mgr.y (mgr.14514) 662 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:50:01.888 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:00.931798+0000 mgr.y (mgr.14514) 662 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:50:01.888 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:01.889 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:50:01.889 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:50:01.889 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:50:01.889 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:50:01.889 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:50:01.898 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:50:01.918 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:50:01.919 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:50:01.919 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:50:01.919 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:50:01.919 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:50:01.919 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:50:01.919 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:50:01.919 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:50:01.919 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:50:02.241 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-19T21:50:02.282 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 61 16 65450 65434 67.0319 0 - 0.0132977 2024-02-19T21:50:02.502 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:01.162473+0000 mgr.y (mgr.14514) 663 : cluster [DBG] pgmap v865: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 3 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped; 4.0 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 899 B/s rd, 2.5 MiB/s wr, 40 op/s; 13037/196392 objects degraded (6.638%); 1/196392 objects misplaced (0.001%); 1.9 MiB/s, 32 objects/s recovering 2024-02-19T21:50:02.502 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:01.493780+0000 mon.a (mon.0) 1669 : cluster [WRN] Health check update: Low space hindering backfill (add storage if this doesn't resolve itself): 2 pgs backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:50:02.502 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:01.493818+0000 mon.a (mon.0) 1670 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-19T21:50:02.502 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:01.756334+0000 mon.c (mon.2) 102 : audit [DBG] from='client.? 172.21.15.80:0/3354244764' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:50:02.529 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.2 dump_ops_in_flight 2024-02-19T21:50:02.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:01.162473+0000 mgr.y (mgr.14514) 663 : cluster [DBG] pgmap v865: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 3 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped; 4.0 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 899 B/s rd, 2.5 MiB/s wr, 40 op/s; 13037/196392 objects degraded (6.638%); 1/196392 objects misplaced (0.001%); 1.9 MiB/s, 32 objects/s recovering 2024-02-19T21:50:02.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:01.493780+0000 mon.a (mon.0) 1669 : cluster [WRN] Health check update: Low space hindering backfill (add storage if this doesn't resolve itself): 2 pgs backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:50:02.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:01.493818+0000 mon.a (mon.0) 1670 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-19T21:50:02.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:01.756334+0000 mon.c (mon.2) 102 : audit [DBG] from='client.? 172.21.15.80:0/3354244764' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:50:02.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:01.162473+0000 mgr.y (mgr.14514) 663 : cluster [DBG] pgmap v865: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 3 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped; 4.0 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 899 B/s rd, 2.5 MiB/s wr, 40 op/s; 13037/196392 objects degraded (6.638%); 1/196392 objects misplaced (0.001%); 1.9 MiB/s, 32 objects/s recovering 2024-02-19T21:50:02.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:01.493780+0000 mon.a (mon.0) 1669 : cluster [WRN] Health check update: Low space hindering backfill (add storage if this doesn't resolve itself): 2 pgs backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:50:02.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:01.493818+0000 mon.a (mon.0) 1670 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-19T21:50:02.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:01.756334+0000 mon.c (mon.2) 102 : audit [DBG] from='client.? 172.21.15.80:0/3354244764' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:50:03.282 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 62 16 65450 65434 65.9508 0 - 0.0132977 2024-02-19T21:50:04.282 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 63 16 65614 65598 65.0667 1.28125 0.00347465 0.0149457 2024-02-19T21:50:04.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:03.162944+0000 mgr.y (mgr.14514) 664 : cluster [DBG] pgmap v866: 138 pgs: 1 activating+undersized+degraded+remapped, 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.0 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 853 B/s rd, 4.1 MiB/s wr, 65 op/s; 17158/196878 objects degraded (8.715%); 1/196878 objects misplaced (0.001%); 1.8 MiB/s, 30 objects/s recovering 2024-02-19T21:50:04.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:03.162944+0000 mgr.y (mgr.14514) 664 : cluster [DBG] pgmap v866: 138 pgs: 1 activating+undersized+degraded+remapped, 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.0 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 853 B/s rd, 4.1 MiB/s wr, 65 op/s; 17158/196878 objects degraded (8.715%); 1/196878 objects misplaced (0.001%); 1.8 MiB/s, 30 objects/s recovering 2024-02-19T21:50:04.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:03.162944+0000 mgr.y (mgr.14514) 664 : cluster [DBG] pgmap v866: 138 pgs: 1 activating+undersized+degraded+remapped, 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.0 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 853 B/s rd, 4.1 MiB/s wr, 65 op/s; 17158/196878 objects degraded (8.715%); 1/196878 objects misplaced (0.001%); 1.8 MiB/s, 30 objects/s recovering 2024-02-19T21:50:05.282 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 64 15 65868 65853 64.2991 15.9375 0.00387715 0.0154752 2024-02-19T21:50:05.744 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:50:05.748 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:05.748 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:50:05.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:05.263073+0000 mon.a (mon.0) 1671 : cluster [WRN] Health check update: Degraded data redundancy: 17158/196878 objects degraded (8.715%), 9 pgs degraded (PG_DEGRADED) 2024-02-19T21:50:05.806 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:50:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:50:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:50:05.845 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:05.263073+0000 mon.a (mon.0) 1671 : cluster [WRN] Health check update: Degraded data redundancy: 17158/196878 objects degraded (8.715%), 9 pgs degraded (PG_DEGRADED) 2024-02-19T21:50:05.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:05.263073+0000 mon.a (mon.0) 1671 : cluster [WRN] Health check update: Degraded data redundancy: 17158/196878 objects degraded (8.715%), 9 pgs degraded (PG_DEGRADED) 2024-02-19T21:50:05.849 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:50:05.883 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:06.282 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 65 16 66389 66373 63.8099 32.5 0.00350963 0.0156048 2024-02-19T21:50:06.642 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:50:06.646 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:06.647 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:50:06.678 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:50:06.717 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:50:06.748 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:50:06.777 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:05.163675+0000 mgr.y (mgr.14514) 665 : cluster [DBG] pgmap v867: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 1 activating+undersized+degraded+remapped, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.0 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 666 B/s rd, 4.6 MiB/s wr, 74 op/s; 17101/197421 objects degraded (8.662%); 1/197421 objects misplaced (0.001%); 1.9 MiB/s, 31 objects/s recovering 2024-02-19T21:50:06.781 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:06.807 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:50:06.809 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:06.810 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:50:06.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:05.163675+0000 mgr.y (mgr.14514) 665 : cluster [DBG] pgmap v867: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 1 activating+undersized+degraded+remapped, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.0 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 666 B/s rd, 4.6 MiB/s wr, 74 op/s; 17101/197421 objects degraded (8.662%); 1/197421 objects misplaced (0.001%); 1.9 MiB/s, 31 objects/s recovering 2024-02-19T21:50:06.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:05.163675+0000 mgr.y (mgr.14514) 665 : cluster [DBG] pgmap v867: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 1 activating+undersized+degraded+remapped, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 3 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.0 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 666 B/s rd, 4.6 MiB/s wr, 74 op/s; 17101/197421 objects degraded (8.662%); 1/197421 objects misplaced (0.001%); 1.9 MiB/s, 31 objects/s recovering 2024-02-19T21:50:06.910 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:50:06.941 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:07.072 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:50:07.077 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:07.077 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:50:07.178 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:50:07.209 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:07.282 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 66 16 66773 66757 63.2067 24 0.00372214 0.0157435 2024-02-19T21:50:07.863 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:50:07.866 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:07.866 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:50:07.967 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:50:08.000 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:08.103 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:50:08.106 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:08.107 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:50:08.207 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:50:08.235 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:08.282 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 67 16 67088 67072 62.5572 19.6875 0.00459606 0.015908 2024-02-19T21:50:08.518 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:07.164451+0000 mgr.y (mgr.14514) 666 : cluster [DBG] pgmap v868: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.0 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1.2 KiB/s rd, 6.1 MiB/s wr, 99 op/s; 12862/198060 objects degraded (6.494%); 4122/198060 objects misplaced (2.081%); 2.7 MiB/s, 44 objects/s recovering 2024-02-19T21:50:08.518 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:07.164451+0000 mgr.y (mgr.14514) 666 : cluster [DBG] pgmap v868: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.0 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1.2 KiB/s rd, 6.1 MiB/s wr, 99 op/s; 12862/198060 objects degraded (6.494%); 4122/198060 objects misplaced (2.081%); 2.7 MiB/s, 44 objects/s recovering 2024-02-19T21:50:08.659 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:50:08.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:07.164451+0000 mgr.y (mgr.14514) 666 : cluster [DBG] pgmap v868: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.0 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1.2 KiB/s rd, 6.1 MiB/s wr, 99 op/s; 12862/198060 objects degraded (6.494%); 4122/198060 objects misplaced (2.081%); 2.7 MiB/s, 44 objects/s recovering 2024-02-19T21:50:09.016 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:50:09.022 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:09.022 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:50:09.123 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:50:09.159 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:09.248 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:50:09.255 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:09.256 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:50:09.282 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 68 16 67409 67393 61.9323 20.0625 0.00336905 0.0160693 2024-02-19T21:50:09.357 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:50:09.369 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:50:09.371 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:50:09.391 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:09.740 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:50:09.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:08.218914+0000 osd.4 (osd.4) 207 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:50:09.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:08.218952+0000 osd.4 (osd.4) 208 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:50:09.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:08.525835+0000 mon.a (mon.0) 1672 : cluster [DBG] osdmap e419: 8 total, 8 up, 7 in 2024-02-19T21:50:09.743 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:08.218914+0000 osd.4 (osd.4) 207 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:50:09.743 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:08.218952+0000 osd.4 (osd.4) 208 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:50:09.744 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:08.525835+0000 mon.a (mon.0) 1672 : cluster [DBG] osdmap e419: 8 total, 8 up, 7 in 2024-02-19T21:50:09.744 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:09.744 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:50:09.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:08.218914+0000 osd.4 (osd.4) 207 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:50:09.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:08.218952+0000 osd.4 (osd.4) 208 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:50:09.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:08.525835+0000 mon.a (mon.0) 1672 : cluster [DBG] osdmap e419: 8 total, 8 up, 7 in 2024-02-19T21:50:09.845 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:50:09.877 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:10.013 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:50:10.021 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:10.022 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:50:10.123 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:50:10.154 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:10.283 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 69 16 67781 67765 61.3717 23.25 0.673676 0.0162233 2024-02-19T21:50:10.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:09.164906+0000 mgr.y (mgr.14514) 667 : cluster [DBG] pgmap v870: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.0 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 575 B/s rd, 4.2 MiB/s wr, 67 op/s; 12862/198060 objects degraded (6.494%); 4122/198060 objects misplaced (2.081%); 1.2 MiB/s, 19 objects/s recovering 2024-02-19T21:50:10.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:09.350515+0000 mgr.y (mgr.14514) 668 : audit [DBG] from='client.25628 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:50:10.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:10.264414+0000 mon.a (mon.0) 1673 : cluster [WRN] Health check update: Degraded data redundancy: 12862/198060 objects degraded (6.494%), 9 pgs degraded (PG_DEGRADED) 2024-02-19T21:50:10.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:10.269941+0000 mon.a (mon.0) 1674 : cluster [DBG] osdmap e420: 8 total, 8 up, 7 in 2024-02-19T21:50:10.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:09.164906+0000 mgr.y (mgr.14514) 667 : cluster [DBG] pgmap v870: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.0 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 575 B/s rd, 4.2 MiB/s wr, 67 op/s; 12862/198060 objects degraded (6.494%); 4122/198060 objects misplaced (2.081%); 1.2 MiB/s, 19 objects/s recovering 2024-02-19T21:50:10.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:09.350515+0000 mgr.y (mgr.14514) 668 : audit [DBG] from='client.25628 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:50:10.773 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:10.264414+0000 mon.a (mon.0) 1673 : cluster [WRN] Health check update: Degraded data redundancy: 12862/198060 objects degraded (6.494%), 9 pgs degraded (PG_DEGRADED) 2024-02-19T21:50:10.773 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:10.269941+0000 mon.a (mon.0) 1674 : cluster [DBG] osdmap e420: 8 total, 8 up, 7 in 2024-02-19T21:50:10.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:09.164906+0000 mgr.y (mgr.14514) 667 : cluster [DBG] pgmap v870: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.0 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 575 B/s rd, 4.2 MiB/s wr, 67 op/s; 12862/198060 objects degraded (6.494%); 4122/198060 objects misplaced (2.081%); 1.2 MiB/s, 19 objects/s recovering 2024-02-19T21:50:10.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:09.350515+0000 mgr.y (mgr.14514) 668 : audit [DBG] from='client.25628 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:50:10.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:10.264414+0000 mon.a (mon.0) 1673 : cluster [WRN] Health check update: Degraded data redundancy: 12862/198060 objects degraded (6.494%), 9 pgs degraded (PG_DEGRADED) 2024-02-19T21:50:10.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:10.269941+0000 mon.a (mon.0) 1674 : cluster [DBG] osdmap e420: 8 total, 8 up, 7 in 2024-02-19T21:50:10.810 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:50:10.814 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:10.814 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:50:10.915 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:50:10.922 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:50:10.922 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:50:10.949 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:11.096 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:50:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:50:10] "GET /metrics HTTP/1.1" 200 176464 "" "Prometheus/2.33.4" 2024-02-19T21:50:11.133 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:50:11.283 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 70 16 68163 68147 60.836 23.875 0.00545429 0.0163688 2024-02-19T21:50:11.308 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:50:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:50:11.543 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:10.941750+0000 mgr.y (mgr.14514) 669 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:50:11.544 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:11.045852+0000 mon.a (mon.0) 1675 : audit [INF] from='client.? 172.21.15.80:0/2676460815' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:50:11.551 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-02-19T21:50:11.701 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:50:11.705 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:11.705 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:50:11.731 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":870,"stamp":"2024-02-19T21:50:09.164616+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4314109604,"num_objects":66020,"num_object_clones":0,"num_object_copies":198060,"num_objects_missing_on_primary":1158,"num_objects_missing":1158,"num_objects_degraded":12862,"num_objects_misplaced":4122,"num_objects_unfound":0,"num_objects_dirty":66020,"num_whiteouts":0,"num_read":2165,"num_read_kb":1917,"num_write":66540,"num_write_kb":4213032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3213,"num_bytes_recovered":192092954,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":66673,"ondisk_log_size":66673,"up":414,"acting":407,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":421,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":656216064,"kb_used":16513152,"kb_used_data":12339912,"kb_used_omap":0,"kb_used_meta":4173183,"kb_avail":639702912,"statfs":{"total":671965249536,"available":655055781888,"internally_reserved":0,"allocated":12636069888,"data_stored":12628102771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":4273339444},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":38797312,"num_objects":592,"num_object_clones":0,"num_object_copies":1776,"num_objects_missing_on_primary":1155,"num_objects_missing":1155,"num_objects_degraded":5015,"num_objects_misplaced":4121,"num_objects_unfound":0,"num_objects_dirty":592,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":592,"num_write_kb":37888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":11403264,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.900988"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":14,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:50:00.107368+0000","last_change":"2024-02-19T21:49:54.492937+0000","last_active":"2024-02-19T21:50:00.107368+0000","last_peered":"2024-02-19T21:50:00.107368+0000","last_clean":"2024-02-19T21:50:00.107368+0000","last_became_active":"2024-02-19T21:49:54.492544+0000","last_became_peered":"2024-02-19T21:49:54.492544+0000","last_unstale":"2024-02-19T21:50:00.107368+0000","last_undegraded":"2024-02-19T21:50:00.107368+0000","last_fullsized":"2024-02-19T21:50:00.107368+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.643236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.643236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":393,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.913003+0000","last_change":"2024-02-19T21:45:17.201007+0000","last_active":"2024-02-19T21:49:59.913003+0000","last_peered":"2024-02-19T21:49:59.913003+0000","last_clean":"2024-02-19T21:49:59.913003+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:49:59.913003+0000","last_undegraded":"2024-02-19T21:49:59.913003+0000","last_fullsized":"2024-02-19T21:49:59.913003+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:17.200897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:17.200897+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"201'27","reported_seq":62,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.914676+0000","last_change":"2024-02-19T21:49:08.327817+0000","last_active":"2024-02-19T21:49:59.914676+0000","last_peered":"2024-02-19T21:49:59.914676+0000","last_clean":"2024-02-19T21:49:59.914676+0000","last_became_active":"2024-02-19T21:49:08.327416+0000","last_became_peered":"2024-02-19T21:49:08.327416+0000","last_unstale":"2024-02-19T21:49:59.914676+0000","last_undegraded":"2024-02-19T21:49:59.914676+0000","last_fullsized":"2024-02-19T21:49:59.914676+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'27","last_scrub_stamp":"2024-02-19T21:44:48.022013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:48.022013+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":366,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.494098+0000","last_change":"2024-02-19T21:48:30.516215+0000","last_active":"2024-02-19T21:49:59.494098+0000","last_peered":"2024-02-19T21:49:59.494098+0000","last_clean":"2024-02-19T21:49:59.494098+0000","last_became_active":"2024-02-19T21:47:46.250178+0000","last_became_peered":"2024-02-19T21:47:46.250178+0000","last_unstale":"2024-02-19T21:49:59.494098+0000","last_undegraded":"2024-02-19T21:49:59.494098+0000","last_fullsized":"2024-02-19T21:49:59.494098+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.516139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.516139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":89,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.913306+0000","last_change":"2024-02-19T21:49:08.330105+0000","last_active":"2024-02-19T21:49:59.913306+0000","last_peered":"2024-02-19T21:49:59.913306+0000","last_clean":"2024-02-19T21:49:59.913306+0000","last_became_active":"2024-02-19T21:49:08.328994+0000","last_became_peered":"2024-02-19T21:49:08.328994+0000","last_unstale":"2024-02-19T21:49:59.913306+0000","last_undegraded":"2024-02-19T21:49:59.913306+0000","last_fullsized":"2024-02-19T21:49:59.913306+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.636083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.636083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"200'19","reported_seq":462,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.493889+0000","last_change":"2024-02-19T21:48:26.530234+0000","last_active":"2024-02-19T21:49:59.493889+0000","last_peered":"2024-02-19T21:49:59.493889+0000","last_clean":"2024-02-19T21:49:59.493889+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:49:59.493889+0000","last_undegraded":"2024-02-19T21:49:59.493889+0000","last_fullsized":"2024-02-19T21:49:59.493889+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:48:26.530160+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.530160+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":150,"reported_epoch":416,"state":"active+clean","last_fresh":"2024-02-19T21:49:57.487860+0000","last_change":"2024-02-19T21:49:08.332091+0000","last_active":"2024-02-19T21:49:57.487860+0000","last_peered":"2024-02-19T21:49:57.487860+0000","last_clean":"2024-02-19T21:49:57.487860+0000","last_became_active":"2024-02-19T21:49:08.331753+0000","last_became_peered":"2024-02-19T21:49:08.331753+0000","last_unstale":"2024-02-19T21:49:57.487860+0000","last_undegraded":"2024-02-19T21:49:57.487860+0000","last_fullsized":"2024-02-19T21:49:57.487860+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.005236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.005236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":406,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:50:00.107483+0000","last_change":"2024-02-19T21:48:28.327028+0000","last_active":"2024-02-19T21:50:00.107483+0000","last_peered":"2024-02-19T21:50:00.107483+0000","last_clean":"2024-02-19T21:50:00.107483+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:50:00.107483+0000","last_undegraded":"2024-02-19T21:50:00.107483+0000","last_fullsized":"2024-02-19T21:50:00.107483+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.326938+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"310'9","reported_seq":360,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.494440+0000","last_change":"2024-02-19T21:49:08.329655+0000","last_active":"2024-02-19T21:49:59.494440+0000","last_peered":"2024-02-19T21:49:59.494440+0000","last_clean":"2024-02-19T21:49:59.494440+0000","last_became_active":"2024-02-19T21:49:08.329314+0000","last_became_peered":"2024-02-19T21:49:08.329314+0000","last_unstale":"2024-02-19T21:49:59.494440+0000","last_undegraded":"2024-02-19T21:49:59.494440+0000","last_fullsized":"2024-02-19T21:49:59.494440+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"310'9","last_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_deep_scrub":"310'9","last_deep_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.506188+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":327,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.913405+0000","last_change":"2024-02-19T21:46:31.205220+0000","last_active":"2024-02-19T21:49:59.913405+0000","last_peered":"2024-02-19T21:49:59.913405+0000","last_clean":"2024-02-19T21:49:59.913405+0000","last_became_active":"2024-02-19T21:46:31.204816+0000","last_became_peered":"2024-02-19T21:46:31.204816+0000","last_unstale":"2024-02-19T21:49:59.913405+0000","last_undegraded":"2024-02-19T21:49:59.913405+0000","last_fullsized":"2024-02-19T21:49:59.913405+0000","mapping_epoch":330,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":331,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:36.890201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.890201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":428,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:50:00.108431+0000","last_change":"2024-02-19T21:49:08.330669+0000","last_active":"2024-02-19T21:50:00.108431+0000","last_peered":"2024-02-19T21:50:00.108431+0000","last_clean":"2024-02-19T21:50:00.108431+0000","last_became_active":"2024-02-19T21:49:08.329998+0000","last_became_peered":"2024-02-19T21:49:08.329998+0000","last_unstale":"2024-02-19T21:50:00.108431+0000","last_undegraded":"2024-02-19T21:50:00.108431+0000","last_fullsized":"2024-02-19T21:50:00.108431+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:58.329316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:58.329316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"200'19","reported_seq":272,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.494289+0000","last_change":"2024-02-19T21:49:08.326162+0000","last_active":"2024-02-19T21:49:59.494289+0000","last_peered":"2024-02-19T21:49:59.494289+0000","last_clean":"2024-02-19T21:49:59.494289+0000","last_became_active":"2024-02-19T21:49:08.325802+0000","last_became_peered":"2024-02-19T21:49:08.325802+0000","last_unstale":"2024-02-19T21:49:59.494289+0000","last_undegraded":"2024-02-19T21:49:59.494289+0000","last_fullsized":"2024-02-19T21:49:59.494289+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:46:54.873416+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:46:54.873416+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2],"acting":[4,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":338,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.972673+0000","last_change":"2024-02-19T21:49:04.432817+0000","last_active":"2024-02-19T21:49:59.972673+0000","last_peered":"2024-02-19T21:49:59.972673+0000","last_clean":"2024-02-19T21:49:59.972673+0000","last_became_active":"2024-02-19T21:47:33.393708+0000","last_became_peered":"2024-02-19T21:47:33.393708+0000","last_unstale":"2024-02-19T21:49:59.972673+0000","last_undegraded":"2024-02-19T21:49:59.972673+0000","last_fullsized":"2024-02-19T21:49:59.972673+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:04.432733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:04.432733+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":14,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:50:00.107455+0000","last_change":"2024-02-19T21:49:54.492767+0000","last_active":"2024-02-19T21:50:00.107455+0000","last_peered":"2024-02-19T21:50:00.107455+0000","last_clean":"2024-02-19T21:50:00.107455+0000","last_became_active":"2024-02-19T21:49:54.491745+0000","last_became_peered":"2024-02-19T21:49:54.491745+0000","last_unstale":"2024-02-19T21:50:00.107455+0000","last_undegraded":"2024-02-19T21:50:00.107455+0000","last_fullsized":"2024-02-19T21:50:00.107455+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.232539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.232539+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1d","version":"201'18","reported_seq":356,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.495421+0000","last_change":"2024-02-19T21:48:25.734661+0000","last_active":"2024-02-19T21:49:59.495421+0000","last_peered":"2024-02-19T21:49:59.495421+0000","last_clean":"2024-02-19T21:49:59.495421+0000","last_became_active":"2024-02-19T21:38:31.247067+0000","last_became_peered":"2024-02-19T21:38:31.247067+0000","last_unstale":"2024-02-19T21:49:59.495421+0000","last_undegraded":"2024-02-19T21:49:59.495421+0000","last_fullsized":"2024-02-19T21:49:59.495421+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'18","last_scrub_stamp":"2024-02-19T21:48:25.734591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.734591+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":393,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.495080+0000","last_change":"2024-02-19T21:48:40.528082+0000","last_active":"2024-02-19T21:49:59.495080+0000","last_peered":"2024-02-19T21:49:59.495080+0000","last_clean":"2024-02-19T21:49:59.495080+0000","last_became_active":"2024-02-19T21:44:58.788307+0000","last_became_peered":"2024-02-19T21:44:58.788307+0000","last_unstale":"2024-02-19T21:49:59.495080+0000","last_undegraded":"2024-02-19T21:49:59.495080+0000","last_fullsized":"2024-02-19T21:49:59.495080+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:40.527970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:48:40.527970+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":401,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.971996+0000","last_change":"2024-02-19T21:48:11.557832+0000","last_active":"2024-02-19T21:49:59.971996+0000","last_peered":"2024-02-19T21:49:59.971996+0000","last_clean":"2024-02-19T21:49:59.971996+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:49:59.971996+0000","last_undegraded":"2024-02-19T21:49:59.971996+0000","last_fullsized":"2024-02-19T21:49:59.971996+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.557736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:17.913620+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.557736+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"200'34","reported_seq":63,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.915201+0000","last_change":"2024-02-19T21:49:08.332575+0000","last_active":"2024-02-19T21:49:59.915201+0000","last_peered":"2024-02-19T21:49:59.915201+0000","last_clean":"2024-02-19T21:49:59.915201+0000","last_became_active":"2024-02-19T21:49:08.331742+0000","last_became_peered":"2024-02-19T21:49:08.331742+0000","last_unstale":"2024-02-19T21:49:59.915201+0000","last_undegraded":"2024-02-19T21:49:59.915201+0000","last_fullsized":"2024-02-19T21:49:59.915201+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'34","last_scrub_stamp":"2024-02-19T21:45:49.728734+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:45:49.728734+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":413,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.495118+0000","last_change":"2024-02-19T21:46:44.994389+0000","last_active":"2024-02-19T21:49:59.495118+0000","last_peered":"2024-02-19T21:49:59.495118+0000","last_clean":"2024-02-19T21:49:59.495118+0000","last_became_active":"2024-02-19T21:44:58.790669+0000","last_became_peered":"2024-02-19T21:44:58.790669+0000","last_unstale":"2024-02-19T21:49:59.495118+0000","last_undegraded":"2024-02-19T21:49:59.495118+0000","last_fullsized":"2024-02-19T21:49:59.495118+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.994296+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":349,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.971864+0000","last_change":"2024-02-19T21:49:08.330330+0000","last_active":"2024-02-19T21:49:59.971864+0000","last_peered":"2024-02-19T21:49:59.971864+0000","last_clean":"2024-02-19T21:49:59.971864+0000","last_became_active":"2024-02-19T21:49:08.329986+0000","last_became_peered":"2024-02-19T21:49:08.329986+0000","last_unstale":"2024-02-19T21:49:59.971864+0000","last_undegraded":"2024-02-19T21:49:59.971864+0000","last_fullsized":"2024-02-19T21:49:59.971864+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.091409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.091409+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"201'19","reported_seq":297,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.912989+0000","last_change":"2024-02-19T21:48:26.366639+0000","last_active":"2024-02-19T21:49:59.912989+0000","last_peered":"2024-02-19T21:49:59.912989+0000","last_clean":"2024-02-19T21:49:59.912989+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:49:59.912989+0000","last_undegraded":"2024-02-19T21:49:59.912989+0000","last_fullsized":"2024-02-19T21:49:59.912989+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:26.366563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.366563+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":261,"reported_epoch":417,"state":"active+remapped+backfill_wait+backfill_toofull","last_fresh":"2024-02-19T21:50:00.108153+0000","last_change":"2024-02-19T21:49:38.335602+0000","last_active":"2024-02-19T21:50:00.108153+0000","last_peered":"2024-02-19T21:50:00.108153+0000","last_clean":"2024-02-19T21:49:06.309838+0000","last_became_active":"2024-02-19T21:49:08.329545+0000","last_became_peered":"2024-02-19T21:49:08.329545+0000","last_unstale":"2024-02-19T21:50:00.108153+0000","last_undegraded":"2024-02-19T21:50:00.108153+0000","last_fullsized":"2024-02-19T21:50:00.108153+0000","mapping_epoch":394,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":371,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:13.196112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:13.196112+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,3],"avail_no_missing":["7","3","5"],"object_location_counts":[{"shards":"3,5,7","objects":1}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":413,"reported_epoch":416,"state":"active+clean","last_fresh":"2024-02-19T21:49:57.487864+0000","last_change":"2024-02-19T21:49:54.491840+0000","last_active":"2024-02-19T21:49:57.487864+0000","last_peered":"2024-02-19T21:49:57.487864+0000","last_clean":"2024-02-19T21:49:57.487864+0000","last_became_active":"2024-02-19T21:49:54.491488+0000","last_became_peered":"2024-02-19T21:49:54.491488+0000","last_unstale":"2024-02-19T21:49:57.487864+0000","last_undegraded":"2024-02-19T21:49:57.487864+0000","last_fullsized":"2024-02-19T21:49:57.487864+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.803606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.803606+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"201'20","reported_seq":498,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.913472+0000","last_change":"2024-02-19T21:49:54.502402+0000","last_active":"2024-02-19T21:49:59.913472+0000","last_peered":"2024-02-19T21:49:59.913472+0000","last_clean":"2024-02-19T21:49:59.913472+0000","last_became_active":"2024-02-19T21:49:54.483748+0000","last_became_peered":"2024-02-19T21:49:54.483748+0000","last_unstale":"2024-02-19T21:49:59.913472+0000","last_undegraded":"2024-02-19T21:49:59.913472+0000","last_fullsized":"2024-02-19T21:49:59.913472+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:48:25.348437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.348437+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":333,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.912749+0000","last_change":"2024-02-19T21:49:08.328206+0000","last_active":"2024-02-19T21:49:59.912749+0000","last_peered":"2024-02-19T21:49:59.912749+0000","last_clean":"2024-02-19T21:49:59.912749+0000","last_became_active":"2024-02-19T21:49:08.327865+0000","last_became_peered":"2024-02-19T21:49:08.327865+0000","last_unstale":"2024-02-19T21:49:59.912749+0000","last_undegraded":"2024-02-19T21:49:59.912749+0000","last_fullsized":"2024-02-19T21:49:59.912749+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.230652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.230652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":393,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:50:00.107407+0000","last_change":"2024-02-19T21:48:22.171667+0000","last_active":"2024-02-19T21:50:00.107407+0000","last_peered":"2024-02-19T21:50:00.107407+0000","last_clean":"2024-02-19T21:50:00.107407+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:50:00.107407+0000","last_undegraded":"2024-02-19T21:50:00.107407+0000","last_fullsized":"2024-02-19T21:50:00.107407+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.171600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.171600+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":429,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.972806+0000","last_change":"2024-02-19T21:49:08.330636+0000","last_active":"2024-02-19T21:49:59.972806+0000","last_peered":"2024-02-19T21:49:59.972806+0000","last_clean":"2024-02-19T21:49:59.972806+0000","last_became_active":"2024-02-19T21:49:08.330293+0000","last_became_peered":"2024-02-19T21:49:08.330293+0000","last_unstale":"2024-02-19T21:49:59.972806+0000","last_undegraded":"2024-02-19T21:49:59.972806+0000","last_fullsized":"2024-02-19T21:49:59.972806+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:03.034839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:03.034839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"381'24","reported_seq":26,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:50:00.106963+0000","last_change":"2024-02-19T21:49:55.368481+0000","last_active":"2024-02-19T21:50:00.106963+0000","last_peered":"2024-02-19T21:50:00.106963+0000","last_clean":"2024-02-19T21:50:00.106963+0000","last_became_active":"2024-02-19T21:49:54.485438+0000","last_became_peered":"2024-02-19T21:49:54.485438+0000","last_unstale":"2024-02-19T21:50:00.106963+0000","last_undegraded":"2024-02-19T21:50:00.106963+0000","last_fullsized":"2024-02-19T21:50:00.106963+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"381'24","last_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_deep_scrub":"381'24","last_deep_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_clean_scrub_stamp":"2024-02-19T21:48:39.382725+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,5],"acting":[7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":421,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:50:00.107329+0000","last_change":"2024-02-19T21:49:17.193002+0000","last_active":"2024-02-19T21:50:00.107329+0000","last_peered":"2024-02-19T21:50:00.107329+0000","last_clean":"2024-02-19T21:50:00.107329+0000","last_became_active":"2024-02-19T21:49:08.333537+0000","last_became_peered":"2024-02-19T21:49:08.333537+0000","last_unstale":"2024-02-19T21:50:00.107329+0000","last_undegraded":"2024-02-19T21:50:00.107329+0000","last_fullsized":"2024-02-19T21:50:00.107329+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:59.339649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:45:59.339649+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":449,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.971944+0000","last_change":"2024-02-19T21:49:54.494561+0000","last_active":"2024-02-19T21:49:59.971944+0000","last_peered":"2024-02-19T21:49:59.971944+0000","last_clean":"2024-02-19T21:49:59.971944+0000","last_became_active":"2024-02-19T21:49:54.494146+0000","last_became_peered":"2024-02-19T21:49:54.494146+0000","last_unstale":"2024-02-19T21:49:59.971944+0000","last_undegraded":"2024-02-19T21:49:59.971944+0000","last_fullsized":"2024-02-19T21:49:59.971944+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.560066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":423,"reported_epoch":416,"state":"active+clean","last_fresh":"2024-02-19T21:49:57.488435+0000","last_change":"2024-02-19T21:49:09.765641+0000","last_active":"2024-02-19T21:49:57.488435+0000","last_peered":"2024-02-19T21:49:57.488435+0000","last_clean":"2024-02-19T21:49:57.488435+0000","last_became_active":"2024-02-19T21:49:08.331308+0000","last_became_peered":"2024-02-19T21:49:08.331308+0000","last_unstale":"2024-02-19T21:49:57.488435+0000","last_undegraded":"2024-02-19T21:49:57.488435+0000","last_fullsized":"2024-02-19T21:49:57.488435+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.765568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.765568+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"200'8","reported_seq":110,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.495038+0000","last_change":"2024-02-19T21:47:33.577363+0000","last_active":"2024-02-19T21:49:59.495038+0000","last_peered":"2024-02-19T21:49:59.495038+0000","last_clean":"2024-02-19T21:49:59.495038+0000","last_became_active":"2024-02-19T21:47:33.395217+0000","last_became_peered":"2024-02-19T21:47:33.395217+0000","last_unstale":"2024-02-19T21:49:59.495038+0000","last_undegraded":"2024-02-19T21:49:59.495038+0000","last_fullsized":"2024-02-19T21:49:59.495038+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'8","last_scrub_stamp":"2024-02-19T21:46:47.761677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.761677+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":333,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.912693+0000","last_change":"2024-02-19T21:49:08.918163+0000","last_active":"2024-02-19T21:49:59.912693+0000","last_peered":"2024-02-19T21:49:59.912693+0000","last_clean":"2024-02-19T21:49:59.912693+0000","last_became_active":"2024-02-19T21:49:08.328416+0000","last_became_peered":"2024-02-19T21:49:08.328416+0000","last_unstale":"2024-02-19T21:49:59.912693+0000","last_undegraded":"2024-02-19T21:49:59.912693+0000","last_fullsized":"2024-02-19T21:49:59.912693+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.918083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.918083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":411,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.496340+0000","last_change":"2024-02-19T21:49:54.480716+0000","last_active":"2024-02-19T21:49:59.496340+0000","last_peered":"2024-02-19T21:49:59.496340+0000","last_clean":"2024-02-19T21:49:59.496340+0000","last_became_active":"2024-02-19T21:49:54.480368+0000","last_became_peered":"2024-02-19T21:49:54.480368+0000","last_unstale":"2024-02-19T21:49:59.496340+0000","last_undegraded":"2024-02-19T21:49:59.496340+0000","last_fullsized":"2024-02-19T21:49:59.496340+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:19.596775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:19.596775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":395,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.495284+0000","last_change":"2024-02-19T21:49:05.012463+0000","last_active":"2024-02-19T21:49:59.495284+0000","last_peered":"2024-02-19T21:49:59.495284+0000","last_clean":"2024-02-19T21:49:59.495284+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:49:59.495284+0000","last_undegraded":"2024-02-19T21:49:59.495284+0000","last_fullsized":"2024-02-19T21:49:59.495284+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.012395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.012395+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"201'19","reported_seq":442,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.494782+0000","last_change":"2024-02-19T21:48:38.529106+0000","last_active":"2024-02-19T21:49:59.494782+0000","last_peered":"2024-02-19T21:49:59.494782+0000","last_clean":"2024-02-19T21:49:59.494782+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:49:59.494782+0000","last_undegraded":"2024-02-19T21:49:59.494782+0000","last_fullsized":"2024-02-19T21:49:59.494782+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:38.528977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.528977+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":398,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.912537+0000","last_change":"2024-02-19T21:46:06.096531+0000","last_active":"2024-02-19T21:49:59.912537+0000","last_peered":"2024-02-19T21:49:59.912537+0000","last_clean":"2024-02-19T21:49:59.912537+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:49:59.912537+0000","last_undegraded":"2024-02-19T21:49:59.912537+0000","last_fullsized":"2024-02-19T21:49:59.912537+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.096422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":209,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.972271+0000","last_change":"2024-02-19T21:48:38.391532+0000","last_active":"2024-02-19T21:49:59.972271+0000","last_peered":"2024-02-19T21:49:59.972271+0000","last_clean":"2024-02-19T21:49:59.972271+0000","last_became_active":"2024-02-19T21:47:33.395085+0000","last_became_peered":"2024-02-19T21:47:33.395085+0000","last_unstale":"2024-02-19T21:49:59.972271+0000","last_undegraded":"2024-02-19T21:49:59.972271+0000","last_fullsized":"2024-02-19T21:49:59.972271+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:38.391435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.391435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":410,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.972380+0000","last_change":"2024-02-19T21:48:14.600378+0000","last_active":"2024-02-19T21:49:59.972380+0000","last_peered":"2024-02-19T21:49:59.972380+0000","last_clean":"2024-02-19T21:49:59.972380+0000","last_became_active":"2024-02-19T21:47:33.393932+0000","last_became_peered":"2024-02-19T21:47:33.393932+0000","last_unstale":"2024-02-19T21:49:59.972380+0000","last_undegraded":"2024-02-19T21:49:59.972380+0000","last_fullsized":"2024-02-19T21:49:59.972380+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:14.600285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.600285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"200'15","reported_seq":464,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.496188+0000","last_change":"2024-02-19T21:49:08.334199+0000","last_active":"2024-02-19T21:49:59.496188+0000","last_peered":"2024-02-19T21:49:59.496188+0000","last_clean":"2024-02-19T21:49:59.496188+0000","last_became_active":"2024-02-19T21:49:08.333872+0000","last_became_peered":"2024-02-19T21:49:08.333872+0000","last_unstale":"2024-02-19T21:49:59.496188+0000","last_undegraded":"2024-02-19T21:49:59.496188+0000","last_fullsized":"2024-02-19T21:49:59.496188+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:45:08.678669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:08.678669+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":376,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.495146+0000","last_change":"2024-02-19T21:49:08.330114+0000","last_active":"2024-02-19T21:49:59.495146+0000","last_peered":"2024-02-19T21:49:59.495146+0000","last_clean":"2024-02-19T21:49:59.495146+0000","last_became_active":"2024-02-19T21:49:08.329770+0000","last_became_peered":"2024-02-19T21:49:08.329770+0000","last_unstale":"2024-02-19T21:49:59.495146+0000","last_undegraded":"2024-02-19T21:49:59.495146+0000","last_fullsized":"2024-02-19T21:49:59.495146+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:08.983923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.983923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"415'17","reported_seq":16,"reported_epoch":418,"state":"active+recovery_wait","last_fresh":"2024-02-19T21:50:00.353875+0000","last_change":"2024-02-19T21:49:57.074730+0000","last_active":"2024-02-19T21:50:00.353875+0000","last_peered":"2024-02-19T21:50:00.353875+0000","last_clean":"2024-02-19T21:47:10.198854+0000","last_became_active":"2024-02-19T21:49:54.486304+0000","last_became_peered":"2024-02-19T21:49:54.486304+0000","last_unstale":"2024-02-19T21:50:00.353875+0000","last_undegraded":"2024-02-19T21:50:00.353875+0000","last_fullsized":"2024-02-19T21:50:00.353875+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"199'13","last_scrub_stamp":"2024-02-19T21:45:05.721709+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:45:05.721709+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":["7","1","2","4"],"object_location_counts":[{"shards":"1,2,7","objects":1}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":420,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.912872+0000","last_change":"2024-02-19T21:49:54.484516+0000","last_active":"2024-02-19T21:49:59.912872+0000","last_peered":"2024-02-19T21:49:59.912872+0000","last_clean":"2024-02-19T21:49:59.912872+0000","last_became_active":"2024-02-19T21:49:54.483689+0000","last_became_peered":"2024-02-19T21:49:54.483689+0000","last_unstale":"2024-02-19T21:49:59.912872+0000","last_undegraded":"2024-02-19T21:49:59.912872+0000","last_fullsized":"2024-02-19T21:49:59.912872+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.157478+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"201'19","reported_seq":441,"reported_epoch":416,"state":"active+clean","last_fresh":"2024-02-19T21:49:57.488246+0000","last_change":"2024-02-19T21:48:27.720048+0000","last_active":"2024-02-19T21:49:57.488246+0000","last_peered":"2024-02-19T21:49:57.488246+0000","last_clean":"2024-02-19T21:49:57.488246+0000","last_became_active":"2024-02-19T21:47:33.398295+0000","last_became_peered":"2024-02-19T21:47:33.398295+0000","last_unstale":"2024-02-19T21:49:57.488246+0000","last_undegraded":"2024-02-19T21:49:57.488246+0000","last_fullsized":"2024-02-19T21:49:57.488246+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:27.719954+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:48:27.719954+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":137,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.913205+0000","last_change":"2024-02-19T21:49:54.484392+0000","last_active":"2024-02-19T21:49:59.913205+0000","last_peered":"2024-02-19T21:49:59.913205+0000","last_clean":"2024-02-19T21:49:59.913205+0000","last_became_active":"2024-02-19T21:49:54.484049+0000","last_became_peered":"2024-02-19T21:49:54.484049+0000","last_unstale":"2024-02-19T21:49:59.913205+0000","last_undegraded":"2024-02-19T21:49:59.913205+0000","last_fullsized":"2024-02-19T21:49:59.913205+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.121769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.121769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":612,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-19T21:50:00.353789+0000","last_change":"2024-02-19T21:48:38.723220+0000","last_active":"2024-02-19T21:50:00.353789+0000","last_peered":"2024-02-19T21:50:00.353789+0000","last_clean":"2024-02-19T21:50:00.353789+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:50:00.353789+0000","last_undegraded":"2024-02-19T21:50:00.353789+0000","last_fullsized":"2024-02-19T21:50:00.353789+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:48:38.723151+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.723151+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":424,"reported_epoch":416,"state":"active+clean","last_fresh":"2024-02-19T21:49:57.530949+0000","last_change":"2024-02-19T21:49:54.485462+0000","last_active":"2024-02-19T21:49:57.530949+0000","last_peered":"2024-02-19T21:49:57.530949+0000","last_clean":"2024-02-19T21:49:57.530949+0000","last_became_active":"2024-02-19T21:49:54.485121+0000","last_became_peered":"2024-02-19T21:49:54.485121+0000","last_unstale":"2024-02-19T21:49:57.530949+0000","last_undegraded":"2024-02-19T21:49:57.530949+0000","last_fullsized":"2024-02-19T21:49:57.530949+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:07.724097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:49:07.724097+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"201'25","reported_seq":302,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.495607+0000","last_change":"2024-02-19T21:49:08.335077+0000","last_active":"2024-02-19T21:49:59.495607+0000","last_peered":"2024-02-19T21:49:59.495607+0000","last_clean":"2024-02-19T21:49:59.495607+0000","last_became_active":"2024-02-19T21:49:08.334061+0000","last_became_peered":"2024-02-19T21:49:08.334061+0000","last_unstale":"2024-02-19T21:49:59.495607+0000","last_undegraded":"2024-02-19T21:49:59.495607+0000","last_fullsized":"2024-02-19T21:49:59.495607+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'25","last_scrub_stamp":"2024-02-19T21:46:07.553690+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.553690+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":393,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:50:00.107369+0000","last_change":"2024-02-19T21:48:21.256471+0000","last_active":"2024-02-19T21:50:00.107369+0000","last_peered":"2024-02-19T21:50:00.107369+0000","last_clean":"2024-02-19T21:50:00.107369+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:50:00.107369+0000","last_undegraded":"2024-02-19T21:50:00.107369+0000","last_fullsized":"2024-02-19T21:50:00.107369+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.256358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.256358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":400,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.972034+0000","last_change":"2024-02-19T21:46:35.035136+0000","last_active":"2024-02-19T21:49:59.972034+0000","last_peered":"2024-02-19T21:49:59.972034+0000","last_clean":"2024-02-19T21:49:59.972034+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:49:59.972034+0000","last_undegraded":"2024-02-19T21:49:59.972034+0000","last_fullsized":"2024-02-19T21:49:59.972034+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:35.035042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:35.035042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"201'12","reported_seq":12,"reported_epoch":417,"state":"active+recovery_wait+degraded","last_fresh":"2024-02-19T21:50:00.107822+0000","last_change":"2024-02-19T21:49:54.478418+0000","last_active":"2024-02-19T21:50:00.107822+0000","last_peered":"2024-02-19T21:50:00.107822+0000","last_clean":"2024-02-19T21:49:49.433484+0000","last_became_active":"2024-02-19T21:49:54.478094+0000","last_became_peered":"2024-02-19T21:49:54.478094+0000","last_unstale":"2024-02-19T21:50:00.107822+0000","last_undegraded":"2024-02-19T21:49:54.469051+0000","last_fullsized":"2024-02-19T21:50:00.107822+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'12","last_scrub_stamp":"2024-02-19T21:49:08.912638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.912638+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":3,"num_objects_missing":3,"num_objects_degraded":3,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":["1","2","6"],"object_location_counts":[{"shards":"1,2,6","objects":3}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":46,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.915250+0000","last_change":"2024-02-19T21:49:08.332757+0000","last_active":"2024-02-19T21:49:59.915250+0000","last_peered":"2024-02-19T21:49:59.915250+0000","last_clean":"2024-02-19T21:49:59.915250+0000","last_became_active":"2024-02-19T21:49:08.332176+0000","last_became_peered":"2024-02-19T21:49:08.332176+0000","last_unstale":"2024-02-19T21:49:59.915250+0000","last_undegraded":"2024-02-19T21:49:59.915250+0000","last_fullsized":"2024-02-19T21:49:59.915250+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:47:01.365477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:47:01.365477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":46,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.914663+0000","last_change":"2024-02-19T21:49:08.328632+0000","last_active":"2024-02-19T21:49:59.914663+0000","last_peered":"2024-02-19T21:49:59.914663+0000","last_clean":"2024-02-19T21:49:59.914663+0000","last_became_active":"2024-02-19T21:49:08.327826+0000","last_became_peered":"2024-02-19T21:49:08.327826+0000","last_unstale":"2024-02-19T21:49:59.914663+0000","last_undegraded":"2024-02-19T21:49:59.914663+0000","last_fullsized":"2024-02-19T21:49:59.914663+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:09.645607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:44:09.645607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"200'15","reported_seq":514,"reported_epoch":417,"state":"active+recovery_wait+degraded","last_fresh":"2024-02-19T21:49:59.913336+0000","last_change":"2024-02-19T21:49:54.484033+0000","last_active":"2024-02-19T21:49:59.913336+0000","last_peered":"2024-02-19T21:49:59.913336+0000","last_clean":"2024-02-19T21:49:49.432972+0000","last_became_active":"2024-02-19T21:49:54.483578+0000","last_became_peered":"2024-02-19T21:49:54.483578+0000","last_unstale":"2024-02-19T21:49:59.913336+0000","last_undegraded":"2024-02-19T21:49:54.471563+0000","last_fullsized":"2024-02-19T21:49:59.913336+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:44:53.072746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:53.072746+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":["0","2","6"],"object_location_counts":[{"shards":"0,2,6","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"418'4158","reported_seq":4204,"reported_epoch":418,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-02-19T21:50:04.894551+0000","last_change":"2024-02-19T21:49:09.774432+0000","last_active":"2024-02-19T21:50:04.894551+0000","last_peered":"2024-02-19T21:50:04.894551+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:09.770699+0000","last_became_peered":"2024-02-19T21:49:09.770699+0000","last_unstale":"2024-02-19T21:50:04.894551+0000","last_undegraded":"2024-02-19T21:49:09.328794+0000","last_fullsized":"2024-02-19T21:49:09.325036+0000","mapping_epoch":395,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4158,"ondisk_log_size":4158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":272498688,"num_objects":4158,"num_object_clones":0,"num_object_copies":12474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1108,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4158,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4158,"num_write_kb":266112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5],"avail_no_missing":["6","5"],"object_location_counts":[{"shards":"5,6","objects":3050}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":14,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:50:00.107255+0000","last_change":"2024-02-19T21:49:54.492844+0000","last_active":"2024-02-19T21:50:00.107255+0000","last_peered":"2024-02-19T21:50:00.107255+0000","last_clean":"2024-02-19T21:50:00.107255+0000","last_became_active":"2024-02-19T21:49:54.492156+0000","last_became_peered":"2024-02-19T21:49:54.492156+0000","last_unstale":"2024-02-19T21:50:00.107255+0000","last_undegraded":"2024-02-19T21:50:00.107255+0000","last_fullsized":"2024-02-19T21:50:00.107255+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:04.692807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.692807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"378'4","reported_seq":432,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.495223+0000","last_change":"2024-02-19T21:48:28.510929+0000","last_active":"2024-02-19T21:49:59.495223+0000","last_peered":"2024-02-19T21:49:59.495223+0000","last_clean":"2024-02-19T21:49:59.495223+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:49:59.495223+0000","last_undegraded":"2024-02-19T21:49:59.495223+0000","last_fullsized":"2024-02-19T21:49:59.495223+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"378'4","last_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_deep_scrub":"378'4","last_deep_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.510849+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"200'23","reported_seq":279,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.494379+0000","last_change":"2024-02-19T21:48:22.519465+0000","last_active":"2024-02-19T21:49:59.494379+0000","last_peered":"2024-02-19T21:49:59.494379+0000","last_clean":"2024-02-19T21:49:59.494379+0000","last_became_active":"2024-02-19T21:47:46.252085+0000","last_became_peered":"2024-02-19T21:47:46.252085+0000","last_unstale":"2024-02-19T21:49:59.494379+0000","last_undegraded":"2024-02-19T21:49:59.494379+0000","last_fullsized":"2024-02-19T21:49:59.494379+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'23","last_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_deep_scrub":"200'23","last_deep_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.519381+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6],"acting":[4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":46,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.914686+0000","last_change":"2024-02-19T21:49:08.328855+0000","last_active":"2024-02-19T21:49:59.914686+0000","last_peered":"2024-02-19T21:49:59.914686+0000","last_clean":"2024-02-19T21:49:59.914686+0000","last_became_active":"2024-02-19T21:49:08.328237+0000","last_became_peered":"2024-02-19T21:49:08.328237+0000","last_unstale":"2024-02-19T21:49:59.914686+0000","last_undegraded":"2024-02-19T21:49:59.914686+0000","last_fullsized":"2024-02-19T21:49:59.914686+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:58.047556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:58.047556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"418'4036","reported_seq":4076,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-19T21:50:04.787083+0000","last_change":"2024-02-19T21:48:47.778295+0000","last_active":"2024-02-19T21:50:04.787083+0000","last_peered":"2024-02-19T21:50:04.787083+0000","last_clean":"2024-02-19T21:50:04.787083+0000","last_became_active":"2024-02-19T21:48:47.777964+0000","last_became_peered":"2024-02-19T21:48:47.777964+0000","last_unstale":"2024-02-19T21:50:04.787083+0000","last_undegraded":"2024-02-19T21:50:04.787083+0000","last_fullsized":"2024-02-19T21:50:04.787083+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4036,"ondisk_log_size":4036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":264503296,"num_objects":4036,"num_object_clones":0,"num_object_copies":12108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4036,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4036,"num_write_kb":258304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":447,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.912639+0000","last_change":"2024-02-19T21:49:08.328019+0000","last_active":"2024-02-19T21:49:59.912639+0000","last_peered":"2024-02-19T21:49:59.912639+0000","last_clean":"2024-02-19T21:49:59.912639+0000","last_became_active":"2024-02-19T21:49:08.327581+0000","last_became_peered":"2024-02-19T21:49:08.327581+0000","last_unstale":"2024-02-19T21:49:59.912639+0000","last_undegraded":"2024-02-19T21:49:59.912639+0000","last_fullsized":"2024-02-19T21:49:59.912639+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:22.180593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:45:22.180593+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5],"acting":[0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":393,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.495466+0000","last_change":"2024-02-19T21:48:37.789514+0000","last_active":"2024-02-19T21:49:59.495466+0000","last_peered":"2024-02-19T21:49:59.495466+0000","last_clean":"2024-02-19T21:49:59.495466+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:49:59.495466+0000","last_undegraded":"2024-02-19T21:49:59.495466+0000","last_fullsized":"2024-02-19T21:49:59.495466+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:37.789400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:37.789400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"201'20","reported_seq":299,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.496275+0000","last_change":"2024-02-19T21:45:57.877936+0000","last_active":"2024-02-19T21:49:59.496275+0000","last_peered":"2024-02-19T21:49:59.496275+0000","last_clean":"2024-02-19T21:49:59.496275+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:49:59.496275+0000","last_undegraded":"2024-02-19T21:49:59.496275+0000","last_fullsized":"2024-02-19T21:49:59.496275+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:45:57.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:57.877856+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":616,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-19T21:50:00.352319+0000","last_change":"2024-02-19T21:49:01.011149+0000","last_active":"2024-02-19T21:50:00.352319+0000","last_peered":"2024-02-19T21:50:00.352319+0000","last_clean":"2024-02-19T21:50:00.352319+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:50:00.352319+0000","last_undegraded":"2024-02-19T21:50:00.352319+0000","last_fullsized":"2024-02-19T21:50:00.352319+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:49:01.011078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:49:01.011078+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.a","version":"418'4151","reported_seq":4192,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-19T21:50:04.905174+0000","last_change":"2024-02-19T21:48:47.778138+0000","last_active":"2024-02-19T21:50:04.905174+0000","last_peered":"2024-02-19T21:50:04.905174+0000","last_clean":"2024-02-19T21:50:04.905174+0000","last_became_active":"2024-02-19T21:48:47.777820+0000","last_became_peered":"2024-02-19T21:48:47.777820+0000","last_unstale":"2024-02-19T21:50:04.905174+0000","last_undegraded":"2024-02-19T21:50:04.905174+0000","last_fullsized":"2024-02-19T21:50:04.905174+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4151,"ondisk_log_size":4151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":272039936,"num_objects":4151,"num_object_clones":0,"num_object_copies":12453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4151,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4151,"num_write_kb":265664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":342,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.495342+0000","last_change":"2024-02-19T21:48:33.478821+0000","last_active":"2024-02-19T21:49:59.495342+0000","last_peered":"2024-02-19T21:49:59.495342+0000","last_clean":"2024-02-19T21:49:59.495342+0000","last_became_active":"2024-02-19T21:44:56.149476+0000","last_became_peered":"2024-02-19T21:44:56.149476+0000","last_unstale":"2024-02-19T21:49:59.495342+0000","last_undegraded":"2024-02-19T21:49:59.495342+0000","last_fullsized":"2024-02-19T21:49:59.495342+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:33.478715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:48:33.478715+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":403,"reported_epoch":416,"state":"active+clean","last_fresh":"2024-02-19T21:49:57.531060+0000","last_change":"2024-02-19T21:46:41.834315+0000","last_active":"2024-02-19T21:49:57.531060+0000","last_peered":"2024-02-19T21:49:57.531060+0000","last_clean":"2024-02-19T21:49:57.531060+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:49:57.531060+0000","last_undegraded":"2024-02-19T21:49:57.531060+0000","last_fullsized":"2024-02-19T21:49:57.531060+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:41.834246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:46:41.834246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"397'46","reported_seq":806,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-19T21:50:00.266312+0000","last_change":"2024-02-19T21:49:08.335296+0000","last_active":"2024-02-19T21:50:00.266312+0000","last_peered":"2024-02-19T21:50:00.266312+0000","last_clean":"2024-02-19T21:50:00.266312+0000","last_became_active":"2024-02-19T21:49:08.334527+0000","last_became_peered":"2024-02-19T21:49:08.334527+0000","last_unstale":"2024-02-19T21:50:00.266312+0000","last_undegraded":"2024-02-19T21:50:00.266312+0000","last_fullsized":"2024-02-19T21:50:00.266312+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'43","last_scrub_stamp":"2024-02-19T21:45:04.755444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.755444+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":389,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.913569+0000","last_change":"2024-02-19T21:46:45.252437+0000","last_active":"2024-02-19T21:49:59.913569+0000","last_peered":"2024-02-19T21:49:59.913569+0000","last_clean":"2024-02-19T21:49:59.913569+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:49:59.913569+0000","last_undegraded":"2024-02-19T21:49:59.913569+0000","last_fullsized":"2024-02-19T21:49:59.913569+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.252344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.252344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"418'4089","reported_seq":4140,"reported_epoch":418,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-02-19T21:50:05.224632+0000","last_change":"2024-02-19T21:49:55.766941+0000","last_active":"2024-02-19T21:50:05.224632+0000","last_peered":"2024-02-19T21:50:05.224632+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:55.752599+0000","last_became_peered":"2024-02-19T21:49:55.752599+0000","last_unstale":"2024-02-19T21:50:05.224632+0000","last_undegraded":"2024-02-19T21:49:55.655049+0000","last_fullsized":"2024-02-19T21:49:55.470938+0000","mapping_epoch":414,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4089,"ondisk_log_size":4089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":267976704,"num_objects":4089,"num_object_clones":0,"num_object_copies":12267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4089,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4089,"num_write_kb":261696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2],"avail_no_missing":["5","4"],"object_location_counts":[{"shards":"2,4,5","objects":2876},{"shards":"2,5","objects":56},{"shards":"4,5","objects":1157}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":417,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:50:00.107620+0000","last_change":"2024-02-19T21:49:09.227437+0000","last_active":"2024-02-19T21:50:00.107620+0000","last_peered":"2024-02-19T21:50:00.107620+0000","last_clean":"2024-02-19T21:50:00.107620+0000","last_became_active":"2024-02-19T21:49:08.328437+0000","last_became_peered":"2024-02-19T21:49:08.328437+0000","last_unstale":"2024-02-19T21:50:00.107620+0000","last_undegraded":"2024-02-19T21:50:00.107620+0000","last_fullsized":"2024-02-19T21:50:00.107620+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.227355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.227355+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'6","reported_seq":1491,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-19T21:50:03.508787+0000","last_change":"2024-02-19T21:49:51.604278+0000","last_active":"2024-02-19T21:50:03.508787+0000","last_peered":"2024-02-19T21:50:03.508787+0000","last_clean":"2024-02-19T21:50:03.508787+0000","last_became_active":"2024-02-19T21:49:08.331108+0000","last_became_peered":"2024-02-19T21:49:08.331108+0000","last_unstale":"2024-02-19T21:50:03.508787+0000","last_undegraded":"2024-02-19T21:50:03.508787+0000","last_fullsized":"2024-02-19T21:50:03.508787+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_clean_scrub_stamp":"2024-02-19T21:44:13.678341+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1041,"num_read_kb":1036,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.914768+0000","last_change":"2024-02-19T21:49:08.329710+0000","last_active":"2024-02-19T21:49:59.914768+0000","last_peered":"2024-02-19T21:49:59.914768+0000","last_clean":"2024-02-19T21:49:59.914768+0000","last_became_active":"2024-02-19T21:49:08.329378+0000","last_became_peered":"2024-02-19T21:49:08.329378+0000","last_unstale":"2024-02-19T21:49:59.914768+0000","last_undegraded":"2024-02-19T21:49:59.914768+0000","last_fullsized":"2024-02-19T21:49:59.914768+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:55.195394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.195394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"200'17","reported_seq":450,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.495711+0000","last_change":"2024-02-19T21:48:14.878933+0000","last_active":"2024-02-19T21:49:59.495711+0000","last_peered":"2024-02-19T21:49:59.495711+0000","last_clean":"2024-02-19T21:49:59.495711+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:49:59.495711+0000","last_undegraded":"2024-02-19T21:49:59.495711+0000","last_fullsized":"2024-02-19T21:49:59.495711+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'17","last_scrub_stamp":"2024-02-19T21:48:14.878857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.878857+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":25,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":46,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.915490+0000","last_change":"2024-02-19T21:49:08.325478+0000","last_active":"2024-02-19T21:49:59.915490+0000","last_peered":"2024-02-19T21:49:59.915490+0000","last_clean":"2024-02-19T21:49:59.915490+0000","last_became_active":"2024-02-19T21:49:08.325127+0000","last_became_peered":"2024-02-19T21:49:08.325127+0000","last_unstale":"2024-02-19T21:49:59.915490+0000","last_undegraded":"2024-02-19T21:49:59.915490+0000","last_fullsized":"2024-02-19T21:49:59.915490+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:10.871111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:10.871111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"418'4178","reported_seq":4219,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-19T21:50:04.897959+0000","last_change":"2024-02-19T21:48:47.778829+0000","last_active":"2024-02-19T21:50:04.897959+0000","last_peered":"2024-02-19T21:50:04.897959+0000","last_clean":"2024-02-19T21:50:04.897959+0000","last_became_active":"2024-02-19T21:48:47.778486+0000","last_became_peered":"2024-02-19T21:48:47.778486+0000","last_unstale":"2024-02-19T21:50:04.897959+0000","last_undegraded":"2024-02-19T21:50:04.897959+0000","last_fullsized":"2024-02-19T21:50:04.897959+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4178,"ondisk_log_size":4178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":273809408,"num_objects":4178,"num_object_clones":0,"num_object_copies":12534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4178,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4178,"num_write_kb":267392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":420,"reported_epoch":416,"state":"active+clean","last_fresh":"2024-02-19T21:49:57.530915+0000","last_change":"2024-02-19T21:47:33.400407+0000","last_active":"2024-02-19T21:49:57.530915+0000","last_peered":"2024-02-19T21:49:57.530915+0000","last_clean":"2024-02-19T21:49:57.530915+0000","last_became_active":"2024-02-19T21:47:33.400075+0000","last_became_peered":"2024-02-19T21:47:33.400075+0000","last_unstale":"2024-02-19T21:49:57.530915+0000","last_undegraded":"2024-02-19T21:49:57.530915+0000","last_fullsized":"2024-02-19T21:49:57.530915+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.035136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":298,"reported_epoch":416,"state":"active+clean","last_fresh":"2024-02-19T21:49:57.531181+0000","last_change":"2024-02-19T21:49:05.746443+0000","last_active":"2024-02-19T21:49:57.531181+0000","last_peered":"2024-02-19T21:49:57.531181+0000","last_clean":"2024-02-19T21:49:57.531181+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:49:57.531181+0000","last_undegraded":"2024-02-19T21:49:57.531181+0000","last_fullsized":"2024-02-19T21:49:57.531181+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.746358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.746358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":450,"reported_epoch":416,"state":"active+clean","last_fresh":"2024-02-19T21:49:57.530986+0000","last_change":"2024-02-19T21:49:54.485252+0000","last_active":"2024-02-19T21:49:57.530986+0000","last_peered":"2024-02-19T21:49:57.530986+0000","last_clean":"2024-02-19T21:49:57.530986+0000","last_became_active":"2024-02-19T21:49:54.484956+0000","last_became_peered":"2024-02-19T21:49:54.484956+0000","last_unstale":"2024-02-19T21:49:57.530986+0000","last_undegraded":"2024-02-19T21:49:57.530986+0000","last_fullsized":"2024-02-19T21:49:57.530986+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:07.901205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:07.901205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:50:00.106807+0000","last_change":"2024-02-19T21:49:54.483990+0000","last_active":"2024-02-19T21:50:00.106807+0000","last_peered":"2024-02-19T21:50:00.106807+0000","last_clean":"2024-02-19T21:50:00.106807+0000","last_became_active":"2024-02-19T21:49:54.483637+0000","last_became_peered":"2024-02-19T21:49:54.483637+0000","last_unstale":"2024-02-19T21:50:00.106807+0000","last_undegraded":"2024-02-19T21:50:00.106807+0000","last_fullsized":"2024-02-19T21:50:00.106807+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.190177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.190177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"201'33","reported_seq":443,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.972455+0000","last_change":"2024-02-19T21:46:47.970066+0000","last_active":"2024-02-19T21:49:59.972455+0000","last_peered":"2024-02-19T21:49:59.972455+0000","last_clean":"2024-02-19T21:49:59.972455+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:49:59.972455+0000","last_undegraded":"2024-02-19T21:49:59.972455+0000","last_fullsized":"2024-02-19T21:49:59.972455+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'33","last_scrub_stamp":"2024-02-19T21:46:47.969961+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.969961+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:50:00.108509+0000","last_change":"2024-02-19T21:49:54.478276+0000","last_active":"2024-02-19T21:50:00.108509+0000","last_peered":"2024-02-19T21:50:00.108509+0000","last_clean":"2024-02-19T21:50:00.108509+0000","last_became_active":"2024-02-19T21:49:54.477947+0000","last_became_peered":"2024-02-19T21:49:54.477947+0000","last_unstale":"2024-02-19T21:50:00.108509+0000","last_undegraded":"2024-02-19T21:50:00.108509+0000","last_fullsized":"2024-02-19T21:50:00.108509+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:57.754453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:57.754453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"418'4014","reported_seq":6243,"reported_epoch":418,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-02-19T21:50:04.661875+0000","last_change":"2024-02-19T21:49:55.726256+0000","last_active":"2024-02-19T21:50:04.661875+0000","last_peered":"2024-02-19T21:50:04.661875+0000","last_clean":"2024-02-19T21:49:53.438055+0000","last_became_active":"2024-02-19T21:49:55.720894+0000","last_became_peered":"2024-02-19T21:49:55.720894+0000","last_unstale":"2024-02-19T21:50:04.661875+0000","last_undegraded":"2024-02-19T21:49:55.557499+0000","last_fullsized":"2024-02-19T21:49:55.472563+0000","mapping_epoch":414,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4014,"ondisk_log_size":4014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":263061504,"num_objects":4014,"num_object_clones":0,"num_object_copies":12042,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3971,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4014,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4014,"num_write_kb":256896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1083,"num_bytes_recovered":70975488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7],"acting":[0,2],"avail_no_missing":["0","2","5"],"object_location_counts":[{"shards":"0,2","objects":43},{"shards":"0,2,5","objects":3971}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":391,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.495769+0000","last_change":"2024-02-19T21:45:47.723650+0000","last_active":"2024-02-19T21:49:59.495769+0000","last_peered":"2024-02-19T21:49:59.495769+0000","last_clean":"2024-02-19T21:49:59.495769+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:49:59.495769+0000","last_undegraded":"2024-02-19T21:49:59.495769+0000","last_fullsized":"2024-02-19T21:49:59.495769+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.723550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.723550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":402,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.912658+0000","last_change":"2024-02-19T21:45:51.243726+0000","last_active":"2024-02-19T21:49:59.912658+0000","last_peered":"2024-02-19T21:49:59.912658+0000","last_clean":"2024-02-19T21:49:59.912658+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:49:59.912658+0000","last_undegraded":"2024-02-19T21:49:59.912658+0000","last_fullsized":"2024-02-19T21:49:59.912658+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:51.243656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:51.243656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":419,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:50:00.107125+0000","last_change":"2024-02-19T21:48:23.218358+0000","last_active":"2024-02-19T21:50:00.107125+0000","last_peered":"2024-02-19T21:50:00.107125+0000","last_clean":"2024-02-19T21:50:00.107125+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:50:00.107125+0000","last_undegraded":"2024-02-19T21:50:00.107125+0000","last_fullsized":"2024-02-19T21:50:00.107125+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:23.218282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.218282+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"324'30","reported_seq":546,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.913228+0000","last_change":"2024-02-19T21:49:08.330490+0000","last_active":"2024-02-19T21:49:59.913228+0000","last_peered":"2024-02-19T21:49:59.913228+0000","last_clean":"2024-02-19T21:49:59.913228+0000","last_became_active":"2024-02-19T21:49:08.329761+0000","last_became_peered":"2024-02-19T21:49:08.329761+0000","last_unstale":"2024-02-19T21:49:59.913228+0000","last_undegraded":"2024-02-19T21:49:59.913228+0000","last_fullsized":"2024-02-19T21:49:59.913228+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'30","last_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_deep_scrub":"324'30","last_deep_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.110965+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":404,"reported_epoch":416,"state":"active+clean","last_fresh":"2024-02-19T21:49:57.530834+0000","last_change":"2024-02-19T21:45:09.918263+0000","last_active":"2024-02-19T21:49:57.530834+0000","last_peered":"2024-02-19T21:49:57.530834+0000","last_clean":"2024-02-19T21:49:57.530834+0000","last_became_active":"2024-02-19T21:44:42.624782+0000","last_became_peered":"2024-02-19T21:44:42.624782+0000","last_unstale":"2024-02-19T21:49:57.530834+0000","last_undegraded":"2024-02-19T21:49:57.530834+0000","last_fullsized":"2024-02-19T21:49:57.530834+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":295,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_clean_scrub_stamp":"2024-02-19T21:45:09.918170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"418'4084","reported_seq":4125,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-19T21:50:04.749319+0000","last_change":"2024-02-19T21:48:47.777963+0000","last_active":"2024-02-19T21:50:04.749319+0000","last_peered":"2024-02-19T21:50:04.749319+0000","last_clean":"2024-02-19T21:50:04.749319+0000","last_became_active":"2024-02-19T21:48:47.777644+0000","last_became_peered":"2024-02-19T21:48:47.777644+0000","last_unstale":"2024-02-19T21:50:04.749319+0000","last_undegraded":"2024-02-19T21:50:04.749319+0000","last_fullsized":"2024-02-19T21:50:04.749319+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4084,"ondisk_log_size":4084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":267649024,"num_objects":4084,"num_object_clones":0,"num_object_copies":12252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4084,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4084,"num_write_kb":261376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":424,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.495122+0000","last_change":"2024-02-19T21:49:08.331080+0000","last_active":"2024-02-19T21:49:59.495122+0000","last_peered":"2024-02-19T21:49:59.495122+0000","last_clean":"2024-02-19T21:49:59.495122+0000","last_became_active":"2024-02-19T21:49:08.330648+0000","last_became_peered":"2024-02-19T21:49:08.330648+0000","last_unstale":"2024-02-19T21:49:59.495122+0000","last_undegraded":"2024-02-19T21:49:59.495122+0000","last_fullsized":"2024-02-19T21:49:59.495122+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:55.803876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:44:55.803876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":395,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:50:00.107693+0000","last_change":"2024-02-19T21:48:31.320229+0000","last_active":"2024-02-19T21:50:00.107693+0000","last_peered":"2024-02-19T21:50:00.107693+0000","last_clean":"2024-02-19T21:50:00.107693+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:50:00.107693+0000","last_undegraded":"2024-02-19T21:50:00.107693+0000","last_fullsized":"2024-02-19T21:50:00.107693+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:31.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:45.017696+0000","last_clean_scrub_stamp":"2024-02-19T21:48:31.320133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"201'37","reported_seq":450,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.912881+0000","last_change":"2024-02-19T21:45:14.173212+0000","last_active":"2024-02-19T21:49:59.912881+0000","last_peered":"2024-02-19T21:49:59.912881+0000","last_clean":"2024-02-19T21:49:59.912881+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:49:59.912881+0000","last_undegraded":"2024-02-19T21:49:59.912881+0000","last_fullsized":"2024-02-19T21:49:59.912881+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'37","last_scrub_stamp":"2024-02-19T21:45:14.173134+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:45:14.173134+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":394,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.972052+0000","last_change":"2024-02-19T21:46:48.988928+0000","last_active":"2024-02-19T21:49:59.972052+0000","last_peered":"2024-02-19T21:49:59.972052+0000","last_clean":"2024-02-19T21:49:59.972052+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:49:59.972052+0000","last_undegraded":"2024-02-19T21:49:59.972052+0000","last_fullsized":"2024-02-19T21:49:59.972052+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:48.988836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.988836+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.e","version":"418'4007","reported_seq":5346,"reported_epoch":418,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:50:05.211785+0000","last_change":"2024-02-19T21:49:09.775842+0000","last_active":"2024-02-19T21:50:05.211785+0000","last_peered":"2024-02-19T21:50:05.211785+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:09.764242+0000","last_became_peered":"2024-02-19T21:49:09.764242+0000","last_unstale":"2024-02-19T21:50:05.211785+0000","last_undegraded":"2024-02-19T21:49:09.321602+0000","last_fullsized":"2024-02-19T21:49:09.313871+0000","mapping_epoch":395,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4007,"ondisk_log_size":4007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":262602752,"num_objects":4007,"num_object_clones":0,"num_object_copies":12021,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":389,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4007,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4007,"num_write_kb":256448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":646,"num_bytes_recovered":42336256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[{"shards":"4,6","objects":3618}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":137,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.494538+0000","last_change":"2024-02-19T21:49:08.326461+0000","last_active":"2024-02-19T21:49:59.494538+0000","last_peered":"2024-02-19T21:49:59.494538+0000","last_clean":"2024-02-19T21:49:59.494538+0000","last_became_active":"2024-02-19T21:49:08.326106+0000","last_became_peered":"2024-02-19T21:49:08.326106+0000","last_unstale":"2024-02-19T21:49:59.494538+0000","last_undegraded":"2024-02-19T21:49:59.494538+0000","last_fullsized":"2024-02-19T21:49:59.494538+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.080896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.080896+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":397,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.495383+0000","last_change":"2024-02-19T21:48:11.879787+0000","last_active":"2024-02-19T21:49:59.495383+0000","last_peered":"2024-02-19T21:49:59.495383+0000","last_clean":"2024-02-19T21:49:59.495383+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:49:59.495383+0000","last_undegraded":"2024-02-19T21:49:59.495383+0000","last_fullsized":"2024-02-19T21:49:59.495383+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.879687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.879687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"201'38","reported_seq":32,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:50:00.107358+0000","last_change":"2024-02-19T21:49:55.861358+0000","last_active":"2024-02-19T21:50:00.107358+0000","last_peered":"2024-02-19T21:50:00.107358+0000","last_clean":"2024-02-19T21:50:00.107358+0000","last_became_active":"2024-02-19T21:49:54.480413+0000","last_became_peered":"2024-02-19T21:49:54.480413+0000","last_unstale":"2024-02-19T21:50:00.107358+0000","last_undegraded":"2024-02-19T21:50:00.107358+0000","last_fullsized":"2024-02-19T21:50:00.107358+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":415,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'38","last_scrub_stamp":"2024-02-19T21:49:05.923627+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.923627+0000","log_size":38,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":290,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.972235+0000","last_change":"2024-02-19T21:49:54.495134+0000","last_active":"2024-02-19T21:49:59.972235+0000","last_peered":"2024-02-19T21:49:59.972235+0000","last_clean":"2024-02-19T21:49:59.972235+0000","last_became_active":"2024-02-19T21:49:54.494802+0000","last_became_peered":"2024-02-19T21:49:54.494802+0000","last_unstale":"2024-02-19T21:49:59.972235+0000","last_undegraded":"2024-02-19T21:49:59.972235+0000","last_fullsized":"2024-02-19T21:49:59.972235+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:10.578408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:10.578408+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.f","version":"418'4199","reported_seq":5490,"reported_epoch":418,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:50:05.042971+0000","last_change":"2024-02-19T21:49:09.782040+0000","last_active":"2024-02-19T21:50:05.042971+0000","last_peered":"2024-02-19T21:50:05.042971+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:09.769552+0000","last_became_peered":"2024-02-19T21:49:09.769552+0000","last_unstale":"2024-02-19T21:50:05.042971+0000","last_undegraded":"2024-02-19T21:49:09.324587+0000","last_fullsized":"2024-02-19T21:49:09.319762+0000","mapping_epoch":395,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4199,"ondisk_log_size":4199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":275185664,"num_objects":4199,"num_object_clones":0,"num_object_copies":12597,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":525,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4199,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4199,"num_write_kb":268736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":622,"num_bytes_recovered":40763392,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[{"shards":"4,6","objects":3674}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":424,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:50:00.107647+0000","last_change":"2024-02-19T21:49:08.328862+0000","last_active":"2024-02-19T21:50:00.107647+0000","last_peered":"2024-02-19T21:50:00.107647+0000","last_clean":"2024-02-19T21:50:00.107647+0000","last_became_active":"2024-02-19T21:49:08.328529+0000","last_became_peered":"2024-02-19T21:49:08.328529+0000","last_unstale":"2024-02-19T21:50:00.107647+0000","last_undegraded":"2024-02-19T21:50:00.107647+0000","last_fullsized":"2024-02-19T21:50:00.107647+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:49.110117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:49.110117+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":457,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.973351+0000","last_change":"2024-02-19T21:49:54.493367+0000","last_active":"2024-02-19T21:49:59.973351+0000","last_peered":"2024-02-19T21:49:59.973351+0000","last_clean":"2024-02-19T21:49:59.973351+0000","last_became_active":"2024-02-19T21:49:54.493041+0000","last_became_peered":"2024-02-19T21:49:54.493041+0000","last_unstale":"2024-02-19T21:49:59.973351+0000","last_undegraded":"2024-02-19T21:49:59.973351+0000","last_fullsized":"2024-02-19T21:49:59.973351+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.972369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.972369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"201'28","reported_seq":264,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.494296+0000","last_change":"2024-02-19T21:49:08.330818+0000","last_active":"2024-02-19T21:49:59.494296+0000","last_peered":"2024-02-19T21:49:59.494296+0000","last_clean":"2024-02-19T21:49:59.494296+0000","last_became_active":"2024-02-19T21:49:08.330477+0000","last_became_peered":"2024-02-19T21:49:08.330477+0000","last_unstale":"2024-02-19T21:49:59.494296+0000","last_undegraded":"2024-02-19T21:49:59.494296+0000","last_fullsized":"2024-02-19T21:49:59.494296+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'28","last_scrub_stamp":"2024-02-19T21:45:55.998646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.998646+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":40,"num_read_kb":33,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":465,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-19T21:50:00.264844+0000","last_change":"2024-02-19T21:45:50.742626+0000","last_active":"2024-02-19T21:50:00.264844+0000","last_peered":"2024-02-19T21:50:00.264844+0000","last_clean":"2024-02-19T21:50:00.264844+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:50:00.264844+0000","last_undegraded":"2024-02-19T21:50:00.264844+0000","last_fullsized":"2024-02-19T21:50:00.264844+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'9","last_scrub_stamp":"2024-02-19T21:45:50.742526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:50.742526+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"418'4035","reported_seq":4076,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-19T21:50:04.888114+0000","last_change":"2024-02-19T21:48:47.779506+0000","last_active":"2024-02-19T21:50:04.888114+0000","last_peered":"2024-02-19T21:50:04.888114+0000","last_clean":"2024-02-19T21:50:04.888114+0000","last_became_active":"2024-02-19T21:48:47.778325+0000","last_became_peered":"2024-02-19T21:48:47.778325+0000","last_unstale":"2024-02-19T21:50:04.888114+0000","last_undegraded":"2024-02-19T21:50:04.888114+0000","last_fullsized":"2024-02-19T21:50:04.888114+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4035,"ondisk_log_size":4035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":264437760,"num_objects":4035,"num_object_clones":0,"num_object_copies":12105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4035,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4035,"num_write_kb":258240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"66'1","reported_seq":308,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.972467+0000","last_change":"2024-02-19T21:48:12.568842+0000","last_active":"2024-02-19T21:49:59.972467+0000","last_peered":"2024-02-19T21:49:59.972467+0000","last_clean":"2024-02-19T21:49:59.972467+0000","last_became_active":"2024-02-19T21:44:56.166670+0000","last_became_peered":"2024-02-19T21:44:56.166670+0000","last_unstale":"2024-02-19T21:49:59.972467+0000","last_undegraded":"2024-02-19T21:49:59.972467+0000","last_fullsized":"2024-02-19T21:49:59.972467+0000","mapping_epoch":165,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:12.568734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.568734+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"261'11","reported_seq":476,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-19T21:50:00.354052+0000","last_change":"2024-02-19T21:45:01.716882+0000","last_active":"2024-02-19T21:50:00.354052+0000","last_peered":"2024-02-19T21:50:00.354052+0000","last_clean":"2024-02-19T21:50:00.354052+0000","last_became_active":"2024-02-19T21:44:08.123392+0000","last_became_peered":"2024-02-19T21:44:08.123392+0000","last_unstale":"2024-02-19T21:50:00.354052+0000","last_undegraded":"2024-02-19T21:50:00.354052+0000","last_fullsized":"2024-02-19T21:50:00.354052+0000","mapping_epoch":62,"log_start":"257'10","ondisk_log_start":"257'10","created":62,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-02-19T21:45:01.716817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.716817+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":406,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:50:00.107218+0000","last_change":"2024-02-19T21:48:19.186455+0000","last_active":"2024-02-19T21:50:00.107218+0000","last_peered":"2024-02-19T21:50:00.107218+0000","last_clean":"2024-02-19T21:50:00.107218+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:50:00.107218+0000","last_undegraded":"2024-02-19T21:50:00.107218+0000","last_fullsized":"2024-02-19T21:50:00.107218+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:48:19.186359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:19.186359+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"201'19","reported_seq":264,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.495090+0000","last_change":"2024-02-19T21:48:34.485865+0000","last_active":"2024-02-19T21:49:59.495090+0000","last_peered":"2024-02-19T21:49:59.495090+0000","last_clean":"2024-02-19T21:49:59.495090+0000","last_became_active":"2024-02-19T21:47:46.251550+0000","last_became_peered":"2024-02-19T21:47:46.251550+0000","last_unstale":"2024-02-19T21:49:59.495090+0000","last_undegraded":"2024-02-19T21:49:59.495090+0000","last_fullsized":"2024-02-19T21:49:59.495090+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:34.485787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:34.485787+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":23,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7],"acting":[4,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1","version":"418'4090","reported_seq":4131,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-19T21:50:04.968881+0000","last_change":"2024-02-19T21:48:47.772467+0000","last_active":"2024-02-19T21:50:04.968881+0000","last_peered":"2024-02-19T21:50:04.968881+0000","last_clean":"2024-02-19T21:50:04.968881+0000","last_became_active":"2024-02-19T21:48:47.772154+0000","last_became_peered":"2024-02-19T21:48:47.772154+0000","last_unstale":"2024-02-19T21:50:04.968881+0000","last_undegraded":"2024-02-19T21:50:04.968881+0000","last_fullsized":"2024-02-19T21:50:04.968881+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4090,"ondisk_log_size":4090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":268042240,"num_objects":4090,"num_object_clones":0,"num_object_copies":12270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4090,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4090,"num_write_kb":261760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":413,"reported_epoch":416,"state":"active+clean","last_fresh":"2024-02-19T21:49:57.488483+0000","last_change":"2024-02-19T21:46:01.031458+0000","last_active":"2024-02-19T21:49:57.488483+0000","last_peered":"2024-02-19T21:49:57.488483+0000","last_clean":"2024-02-19T21:49:57.488483+0000","last_became_active":"2024-02-19T21:44:56.155194+0000","last_became_peered":"2024-02-19T21:44:56.155194+0000","last_unstale":"2024-02-19T21:49:57.488483+0000","last_undegraded":"2024-02-19T21:49:57.488483+0000","last_fullsized":"2024-02-19T21:49:57.488483+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.031344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.031344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"363'12","reported_seq":188,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-19T21:50:00.269569+0000","last_change":"2024-02-19T21:48:25.487689+0000","last_active":"2024-02-19T21:50:00.269569+0000","last_peered":"2024-02-19T21:50:00.269569+0000","last_clean":"2024-02-19T21:50:00.269569+0000","last_became_active":"2024-02-19T21:47:46.260099+0000","last_became_peered":"2024-02-19T21:47:46.260099+0000","last_unstale":"2024-02-19T21:50:00.269569+0000","last_undegraded":"2024-02-19T21:50:00.269569+0000","last_fullsized":"2024-02-19T21:50:00.269569+0000","mapping_epoch":362,"log_start":"98'9","ondisk_log_start":"98'9","created":62,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"363'12","last_scrub_stamp":"2024-02-19T21:48:25.487608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.487608+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":417,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.495131+0000","last_change":"2024-02-19T21:49:08.335163+0000","last_active":"2024-02-19T21:49:59.495131+0000","last_peered":"2024-02-19T21:49:59.495131+0000","last_clean":"2024-02-19T21:49:59.495131+0000","last_became_active":"2024-02-19T21:49:08.334842+0000","last_became_peered":"2024-02-19T21:49:08.334842+0000","last_unstale":"2024-02-19T21:49:59.495131+0000","last_undegraded":"2024-02-19T21:49:59.495131+0000","last_fullsized":"2024-02-19T21:49:59.495131+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.700887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.700887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"270'34","reported_seq":337,"reported_epoch":416,"state":"active+clean","last_fresh":"2024-02-19T21:49:57.488491+0000","last_change":"2024-02-19T21:47:34.894164+0000","last_active":"2024-02-19T21:49:57.488491+0000","last_peered":"2024-02-19T21:49:57.488491+0000","last_clean":"2024-02-19T21:49:57.488491+0000","last_became_active":"2024-02-19T21:47:33.400012+0000","last_became_peered":"2024-02-19T21:47:33.400012+0000","last_unstale":"2024-02-19T21:49:57.488491+0000","last_undegraded":"2024-02-19T21:49:57.488491+0000","last_fullsized":"2024-02-19T21:49:57.488491+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":357,"parent":"0.0","parent_split_bits":0,"last_scrub":"270'34","last_scrub_stamp":"2024-02-19T21:46:44.789309+0000","last_deep_scrub":"270'34","last_deep_scrub_stamp":"2024-02-19T21:44:17.451151+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.789309+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2","version":"418'4148","reported_seq":4189,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-19T21:50:04.805619+0000","last_change":"2024-02-19T21:48:47.771305+0000","last_active":"2024-02-19T21:50:04.805619+0000","last_peered":"2024-02-19T21:50:04.805619+0000","last_clean":"2024-02-19T21:50:04.805619+0000","last_became_active":"2024-02-19T21:48:47.771000+0000","last_became_peered":"2024-02-19T21:48:47.771000+0000","last_unstale":"2024-02-19T21:50:04.805619+0000","last_undegraded":"2024-02-19T21:50:04.805619+0000","last_fullsized":"2024-02-19T21:50:04.805619+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4148,"ondisk_log_size":4148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":271843328,"num_objects":4148,"num_object_clones":0,"num_object_copies":12444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4148,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4148,"num_write_kb":265472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":395,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.495296+0000","last_change":"2024-02-19T21:49:08.329023+0000","last_active":"2024-02-19T21:49:59.495296+0000","last_peered":"2024-02-19T21:49:59.495296+0000","last_clean":"2024-02-19T21:49:59.495296+0000","last_became_active":"2024-02-19T21:49:08.328697+0000","last_became_peered":"2024-02-19T21:49:08.328697+0000","last_unstale":"2024-02-19T21:49:59.495296+0000","last_undegraded":"2024-02-19T21:49:59.495296+0000","last_fullsized":"2024-02-19T21:49:59.495296+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.939414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.939414+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"397'17","reported_seq":317,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-19T21:50:03.714817+0000","last_change":"2024-02-19T21:49:08.325927+0000","last_active":"2024-02-19T21:50:03.714817+0000","last_peered":"2024-02-19T21:50:03.714817+0000","last_clean":"2024-02-19T21:50:03.714817+0000","last_became_active":"2024-02-19T21:49:08.325034+0000","last_became_peered":"2024-02-19T21:49:08.325034+0000","last_unstale":"2024-02-19T21:50:03.714817+0000","last_undegraded":"2024-02-19T21:50:03.714817+0000","last_fullsized":"2024-02-19T21:50:03.714817+0000","mapping_epoch":394,"log_start":"170'11","ondisk_log_start":"170'11","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"271'13","last_scrub_stamp":"2024-02-19T21:46:47.072988+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.072988+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":407,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.496105+0000","last_change":"2024-02-19T21:49:03.987847+0000","last_active":"2024-02-19T21:49:59.496105+0000","last_peered":"2024-02-19T21:49:59.496105+0000","last_clean":"2024-02-19T21:49:59.496105+0000","last_became_active":"2024-02-19T21:47:33.395485+0000","last_became_peered":"2024-02-19T21:47:33.395485+0000","last_unstale":"2024-02-19T21:49:59.496105+0000","last_undegraded":"2024-02-19T21:49:59.496105+0000","last_fullsized":"2024-02-19T21:49:59.496105+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:03.987749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:49:03.987749+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,5],"acting":[1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"200'20","reported_seq":241,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.494681+0000","last_change":"2024-02-19T21:48:12.628796+0000","last_active":"2024-02-19T21:49:59.494681+0000","last_peered":"2024-02-19T21:49:59.494681+0000","last_clean":"2024-02-19T21:49:59.494681+0000","last_became_active":"2024-02-19T21:47:46.251725+0000","last_became_peered":"2024-02-19T21:47:46.251725+0000","last_unstale":"2024-02-19T21:49:59.494681+0000","last_undegraded":"2024-02-19T21:49:59.494681+0000","last_fullsized":"2024-02-19T21:49:59.494681+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'20","last_scrub_stamp":"2024-02-19T21:48:12.628700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.628700+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3","version":"418'4104","reported_seq":5307,"reported_epoch":418,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:50:05.208141+0000","last_change":"2024-02-19T21:49:15.423646+0000","last_active":"2024-02-19T21:50:05.208141+0000","last_peered":"2024-02-19T21:50:05.208141+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:09.769892+0000","last_became_peered":"2024-02-19T21:49:09.769892+0000","last_unstale":"2024-02-19T21:50:05.208141+0000","last_undegraded":"2024-02-19T21:49:09.318624+0000","last_fullsized":"2024-02-19T21:49:09.312732+0000","mapping_epoch":395,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4104,"ondisk_log_size":4104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":268959744,"num_objects":4104,"num_object_clones":0,"num_object_copies":12312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":517,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4104,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4104,"num_write_kb":262656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":580,"num_bytes_recovered":38010880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[{"shards":"4,5","objects":3587}],"blocked_by":[],"up_primary":2,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":46,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.915511+0000","last_change":"2024-02-19T21:49:08.327495+0000","last_active":"2024-02-19T21:49:59.915511+0000","last_peered":"2024-02-19T21:49:59.915511+0000","last_clean":"2024-02-19T21:49:59.915511+0000","last_became_active":"2024-02-19T21:49:08.327172+0000","last_became_peered":"2024-02-19T21:49:08.327172+0000","last_unstale":"2024-02-19T21:49:59.915511+0000","last_undegraded":"2024-02-19T21:49:59.915511+0000","last_fullsized":"2024-02-19T21:49:59.915511+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.241319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.241319+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,6],"acting":[2,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":402,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.495688+0000","last_change":"2024-02-19T21:45:01.798485+0000","last_active":"2024-02-19T21:49:59.495688+0000","last_peered":"2024-02-19T21:49:59.495688+0000","last_clean":"2024-02-19T21:49:59.495688+0000","last_became_active":"2024-02-19T21:44:22.245925+0000","last_became_peered":"2024-02-19T21:44:22.245925+0000","last_unstale":"2024-02-19T21:49:59.495688+0000","last_undegraded":"2024-02-19T21:49:59.495688+0000","last_fullsized":"2024-02-19T21:49:59.495688+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:01.798387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.798387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":402,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:50:00.107530+0000","last_change":"2024-02-19T21:48:30.277397+0000","last_active":"2024-02-19T21:50:00.107530+0000","last_peered":"2024-02-19T21:50:00.107530+0000","last_clean":"2024-02-19T21:50:00.107530+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:50:00.107530+0000","last_undegraded":"2024-02-19T21:50:00.107530+0000","last_fullsized":"2024-02-19T21:50:00.107530+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.277322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.277322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"337'39","reported_seq":350,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.494869+0000","last_change":"2024-02-19T21:49:08.326007+0000","last_active":"2024-02-19T21:49:59.494869+0000","last_peered":"2024-02-19T21:49:59.494869+0000","last_clean":"2024-02-19T21:49:59.494869+0000","last_became_active":"2024-02-19T21:49:08.325683+0000","last_became_peered":"2024-02-19T21:49:08.325683+0000","last_unstale":"2024-02-19T21:49:59.494869+0000","last_undegraded":"2024-02-19T21:49:59.494869+0000","last_fullsized":"2024-02-19T21:49:59.494869+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'39","last_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_deep_scrub":"337'39","last_deep_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.923809+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":49,"num_read_kb":39,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"418'4197","reported_seq":4238,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-19T21:50:04.640407+0000","last_change":"2024-02-19T21:48:47.776672+0000","last_active":"2024-02-19T21:50:04.640407+0000","last_peered":"2024-02-19T21:50:04.640407+0000","last_clean":"2024-02-19T21:50:04.640407+0000","last_became_active":"2024-02-19T21:48:47.776368+0000","last_became_peered":"2024-02-19T21:48:47.776368+0000","last_unstale":"2024-02-19T21:50:04.640407+0000","last_undegraded":"2024-02-19T21:50:04.640407+0000","last_fullsized":"2024-02-19T21:50:04.640407+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4197,"ondisk_log_size":4197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":275054592,"num_objects":4197,"num_object_clones":0,"num_object_copies":12591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4197,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4197,"num_write_kb":268608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"66'1","reported_seq":224,"reported_epoch":417,"state":"active+remapped+backfill_toofull","last_fresh":"2024-02-19T21:49:59.912450+0000","last_change":"2024-02-19T21:49:55.717652+0000","last_active":"2024-02-19T21:49:59.912450+0000","last_peered":"2024-02-19T21:49:59.912450+0000","last_clean":"2024-02-19T21:47:34.392763+0000","last_became_active":"2024-02-19T21:49:55.708866+0000","last_became_peered":"2024-02-19T21:49:55.708866+0000","last_unstale":"2024-02-19T21:49:59.912450+0000","last_undegraded":"2024-02-19T21:49:59.912450+0000","last_fullsized":"2024-02-19T21:49:59.912450+0000","mapping_epoch":414,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:46:43.773486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:46:43.773486+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[0,2,6],"avail_no_missing":["0","2","6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":46,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.915048+0000","last_change":"2024-02-19T21:49:08.326583+0000","last_active":"2024-02-19T21:49:59.915048+0000","last_peered":"2024-02-19T21:49:59.915048+0000","last_clean":"2024-02-19T21:49:59.915048+0000","last_became_active":"2024-02-19T21:49:08.324835+0000","last_became_peered":"2024-02-19T21:49:08.324835+0000","last_unstale":"2024-02-19T21:49:59.915048+0000","last_undegraded":"2024-02-19T21:49:59.915048+0000","last_fullsized":"2024-02-19T21:49:59.915048+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.163825+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":102,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.972225+0000","last_change":"2024-02-19T21:49:08.327553+0000","last_active":"2024-02-19T21:49:59.972225+0000","last_peered":"2024-02-19T21:49:59.972225+0000","last_clean":"2024-02-19T21:49:59.972225+0000","last_became_active":"2024-02-19T21:49:08.327186+0000","last_became_peered":"2024-02-19T21:49:08.327186+0000","last_unstale":"2024-02-19T21:49:59.972225+0000","last_undegraded":"2024-02-19T21:49:59.972225+0000","last_fullsized":"2024-02-19T21:49:59.972225+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:45:00.748244+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:45:00.748244+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"201'44","reported_seq":523,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.971974+0000","last_change":"2024-02-19T21:49:55.281324+0000","last_active":"2024-02-19T21:49:59.971974+0000","last_peered":"2024-02-19T21:49:59.971974+0000","last_clean":"2024-02-19T21:49:59.971974+0000","last_became_active":"2024-02-19T21:49:54.493167+0000","last_became_peered":"2024-02-19T21:49:54.493167+0000","last_unstale":"2024-02-19T21:49:59.971974+0000","last_undegraded":"2024-02-19T21:49:59.971974+0000","last_fullsized":"2024-02-19T21:49:59.971974+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'44","last_scrub_stamp":"2024-02-19T21:48:32.489084+0000","last_deep_scrub":"201'44","last_deep_scrub_stamp":"2024-02-19T21:44:16.255049+0000","last_clean_scrub_stamp":"2024-02-19T21:48:32.489084+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.5","version":"418'4181","reported_seq":4231,"reported_epoch":418,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:50:06.391960+0000","last_change":"2024-02-19T21:50:03.887248+0000","last_active":"2024-02-19T21:50:06.391960+0000","last_peered":"2024-02-19T21:50:06.391960+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:50:03.654321+0000","last_became_peered":"2024-02-19T21:50:03.654321+0000","last_unstale":"2024-02-19T21:50:06.391960+0000","last_undegraded":"2024-02-19T21:50:01.398577+0000","last_fullsized":"2024-02-19T21:49:55.473278+0000","mapping_epoch":414,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4181,"ondisk_log_size":4181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":274006016,"num_objects":4181,"num_object_clones":0,"num_object_copies":12543,"num_objects_missing_on_primary":1155,"num_objects_missing":1155,"num_objects_degraded":1155,"num_objects_misplaced":4121,"num_objects_unfound":0,"num_objects_dirty":4181,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4181,"num_write_kb":267584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0],"avail_no_missing":["0","5"],"object_location_counts":[{"shards":"0,2","objects":60},{"shards":"0,2,5","objects":2966},{"shards":"0,5","objects":1155}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":447,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.912774+0000","last_change":"2024-02-19T21:49:08.328667+0000","last_active":"2024-02-19T21:49:59.912774+0000","last_peered":"2024-02-19T21:49:59.912774+0000","last_clean":"2024-02-19T21:49:59.912774+0000","last_became_active":"2024-02-19T21:49:08.328287+0000","last_became_peered":"2024-02-19T21:49:08.328287+0000","last_unstale":"2024-02-19T21:49:59.912774+0000","last_undegraded":"2024-02-19T21:49:59.912774+0000","last_fullsized":"2024-02-19T21:49:59.912774+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.176542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.176542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":46,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.914833+0000","last_change":"2024-02-19T21:49:08.332637+0000","last_active":"2024-02-19T21:49:59.914833+0000","last_peered":"2024-02-19T21:49:59.914833+0000","last_clean":"2024-02-19T21:49:59.914833+0000","last_became_active":"2024-02-19T21:49:08.331451+0000","last_became_peered":"2024-02-19T21:49:08.331451+0000","last_unstale":"2024-02-19T21:49:59.914833+0000","last_undegraded":"2024-02-19T21:49:59.914833+0000","last_fullsized":"2024-02-19T21:49:59.914833+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.123413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.547129+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.123413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":417,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.495389+0000","last_change":"2024-02-19T21:49:08.331159+0000","last_active":"2024-02-19T21:49:59.495389+0000","last_peered":"2024-02-19T21:49:59.495389+0000","last_clean":"2024-02-19T21:49:59.495389+0000","last_became_active":"2024-02-19T21:49:08.330804+0000","last_became_peered":"2024-02-19T21:49:08.330804+0000","last_unstale":"2024-02-19T21:49:59.495389+0000","last_undegraded":"2024-02-19T21:49:59.495389+0000","last_fullsized":"2024-02-19T21:49:59.495389+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.978015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.978015+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"377'19","reported_seq":425,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.912972+0000","last_change":"2024-02-19T21:48:23.326608+0000","last_active":"2024-02-19T21:49:59.912972+0000","last_peered":"2024-02-19T21:49:59.912972+0000","last_clean":"2024-02-19T21:49:59.912972+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:49:59.912972+0000","last_undegraded":"2024-02-19T21:49:59.912972+0000","last_fullsized":"2024-02-19T21:49:59.912972+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"377'19","last_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_deep_scrub":"377'19","last_deep_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.326541+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"418'4157","reported_seq":4197,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-19T21:50:05.229309+0000","last_change":"2024-02-19T21:48:47.780368+0000","last_active":"2024-02-19T21:50:05.229309+0000","last_peered":"2024-02-19T21:50:05.229309+0000","last_clean":"2024-02-19T21:50:05.229309+0000","last_became_active":"2024-02-19T21:48:47.780046+0000","last_became_peered":"2024-02-19T21:48:47.780046+0000","last_unstale":"2024-02-19T21:50:05.229309+0000","last_undegraded":"2024-02-19T21:50:05.229309+0000","last_fullsized":"2024-02-19T21:50:05.229309+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4157,"ondisk_log_size":4157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":272433152,"num_objects":4157,"num_object_clones":0,"num_object_copies":12471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4157,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4157,"num_write_kb":266048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":411,"reported_epoch":416,"state":"active+clean","last_fresh":"2024-02-19T21:49:57.488662+0000","last_change":"2024-02-19T21:46:01.981923+0000","last_active":"2024-02-19T21:49:57.488662+0000","last_peered":"2024-02-19T21:49:57.488662+0000","last_clean":"2024-02-19T21:49:57.488662+0000","last_became_active":"2024-02-19T21:44:56.160521+0000","last_became_peered":"2024-02-19T21:44:56.160521+0000","last_unstale":"2024-02-19T21:49:57.488662+0000","last_undegraded":"2024-02-19T21:49:57.488662+0000","last_fullsized":"2024-02-19T21:49:57.488662+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.981866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.981866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":55,"reported_epoch":417,"state":"active+clean","last_fresh":"2024-02-19T21:49:59.915579+0000","last_change":"2024-02-19T21:49:54.485377+0000","last_active":"2024-02-19T21:49:59.915579+0000","last_peered":"2024-02-19T21:49:59.915579+0000","last_clean":"2024-02-19T21:49:59.915579+0000","last_became_active":"2024-02-19T21:49:54.485078+0000","last_became_peered":"2024-02-19T21:49:54.485078+0000","last_unstale":"2024-02-19T21:49:59.915579+0000","last_undegraded":"2024-02-19T21:49:59.915579+0000","last_fullsized":"2024-02-19T21:49:59.915579+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:52.107416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:46:52.107416+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"200'27","reported_seq":488,"reported_epoch":416,"state":"active+clean","last_fresh":"2024-02-19T21:49:57.487862+0000","last_change":"2024-02-19T21:49:55.109780+0000","last_active":"2024-02-19T21:49:57.487862+0000","last_peered":"2024-02-19T21:49:57.487862+0000","last_clean":"2024-02-19T21:49:57.487862+0000","last_became_active":"2024-02-19T21:49:54.486014+0000","last_became_peered":"2024-02-19T21:49:54.486014+0000","last_unstale":"2024-02-19T21:49:57.487862+0000","last_undegraded":"2024-02-19T21:49:57.487862+0000","last_fullsized":"2024-02-19T21:49:57.487862+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'27","last_scrub_stamp":"2024-02-19T21:48:24.665813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:24.665813+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"324'11","reported_seq":636,"reported_epoch":418,"state":"active+clean","last_fresh":"2024-02-19T21:50:00.356132+0000","last_change":"2024-02-19T21:48:26.293036+0000","last_active":"2024-02-19T21:50:00.356132+0000","last_peered":"2024-02-19T21:50:00.356132+0000","last_clean":"2024-02-19T21:50:00.356132+0000","last_became_active":"2024-02-19T21:44:34.385140+0000","last_became_peered":"2024-02-19T21:44:34.385140+0000","last_unstale":"2024-02-19T21:50:00.356132+0000","last_undegraded":"2024-02-19T21:50:00.356132+0000","last_fullsized":"2024-02-19T21:50:00.356132+0000","mapping_epoch":62,"log_start":"66'8","ondisk_log_start":"66'8","created":62,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'11","last_scrub_stamp":"2024-02-19T21:48:26.292909+0000","last_deep_scrub":"324'11","last_deep_scrub_stamp":"2024-02-19T21:46:05.210095+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.292909+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":4314103808,"num_objects":65828,"num_object_clones":0,"num_object_copies":197484,"num_objects_missing_on_primary":1155,"num_objects_missing":1155,"num_objects_degraded":12855,"num_objects_misplaced":4121,"num_objects_unfound":0,"num_objects_dirty":65828,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65828,"num_write_kb":4212992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2931,"num_bytes_recovered":192086016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12640911360,"data_stored":12640911360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65828,"ondisk_log_size":65828,"up":48,"acting":41,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1041,"num_read_kb":1036,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":3,"num_objects_missing":3,"num_objects_degraded":7,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1107,"num_read_kb":864,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":5062,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":776,"ondisk_log_size":776,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":22,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":66,"acting":66,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":382,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201495,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":823256,"kb_used_data":526032,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":92921896,"statfs":{"total":95995035648,"available":95152021504,"internally_reserved":0,"allocated":538656768,"data_stored":537513452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:49:49 2024","interfaces":[{"interface":"back","average":{"1min":1.8049999999999999,"5min":2.6440000000000001,"15min":1.8859999999999999},"min":{"1min":0.26000000000000001,"5min":0.19,"15min":0.189},"max":{"1min":11.653,"5min":70.477999999999994,"15min":70.477999999999994},"last":0.315},{"interface":"front","average":{"1min":2.0590000000000002,"5min":2.9199999999999999,"15min":2.0379999999999998},"min":{"1min":0.23100000000000001,"5min":0.21199999999999999,"15min":0.20999999999999999},"max":{"1min":12.242000000000001,"5min":68.052000000000007,"15min":68.052000000000007},"last":0.39000000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:49:49 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":2.7410000000000001,"15min":2.0710000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.23200000000000001},"max":{"1min":8.9629999999999992,"5min":68.168000000000006,"15min":68.168000000000006},"last":0.48999999999999999},{"interface":"front","average":{"1min":2.2799999999999998,"5min":3.298,"15min":2.1099999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.223},"max":{"1min":12.199,"5min":68.444000000000003,"15min":68.444000000000003},"last":0.42499999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:47:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.47,"15min":1.4610000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":6.133,"5min":11.239000000000001,"15min":11.239000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":1.486,"5min":1.615,"15min":1.5549999999999999},"min":{"1min":0.28199999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":6.1200000000000001,"5min":10.250999999999999,"15min":10.250999999999999},"last":0.40100000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:49:49 2024","interfaces":[{"interface":"back","average":{"1min":1.8380000000000001,"5min":2.121,"15min":2.1480000000000001},"min":{"1min":0.377,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":10.435,"5min":11.614000000000001,"15min":31.559000000000001},"last":0.437},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.744,"15min":1.895},"min":{"1min":0.33000000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":9.0129999999999999,"5min":13.473000000000001,"15min":30.812999999999999},"last":0.51700000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:49:49 2024","interfaces":[{"interface":"back","average":{"1min":3.0339999999999998,"5min":2.0720000000000001,"15min":1.5389999999999999},"min":{"1min":0.27400000000000002,"5min":0.216,"15min":0.216},"max":{"1min":17.716999999999999,"5min":17.716999999999999,"15min":17.716999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":3.4089999999999998,"5min":2.4529999999999998,"15min":1.8700000000000001},"min":{"1min":0.26500000000000001,"5min":0.253,"15min":0.245},"max":{"1min":15.666,"5min":17.690999999999999,"15min":17.690999999999999},"last":0.36699999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:49:49 2024","interfaces":[{"interface":"back","average":{"1min":2.1459999999999999,"5min":2.1579999999999999,"15min":1.609},"min":{"1min":0.30199999999999999,"5min":0.28499999999999998,"15min":0.24199999999999999},"max":{"1min":12.210000000000001,"5min":29.021000000000001,"15min":29.021000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":2.6219999999999999,"5min":2.5110000000000001,"15min":1.889},"min":{"1min":0.33800000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":17.670999999999999,"5min":29.091999999999999,"15min":29.091999999999999},"last":0.67400000000000004}]},{"osd":6,"last update":"Mon Feb 19 21:49:49 2024","interfaces":[{"interface":"back","average":{"1min":3.1320000000000001,"5min":2.452,"15min":1.6930000000000001},"min":{"1min":0.32500000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":12.271000000000001,"5min":19.286000000000001,"15min":19.286000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":2.6800000000000002,"5min":2.339,"15min":1.863},"min":{"1min":0.314,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":11.722,"5min":18.364000000000001,"15min":18.364000000000001},"last":0.58299999999999996}]}]},{"osd":6,"up_from":47,"seq":201863463134,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2437468,"kb_used_data":1843668,"kb_used_omap":0,"kb_used_meta":593792,"kb_avail":91307684,"statfs":{"total":95995035648,"available":93499068416,"internally_reserved":0,"allocated":1887916032,"data_stored":1886768130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":608043008},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:49:26 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":1.28,"15min":1.645},"min":{"1min":0.26800000000000002,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":7.8170000000000002,"5min":8.8079999999999998,"15min":45.197000000000003},"last":0.33000000000000002},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.8120000000000001,"15min":1.9259999999999999},"min":{"1min":0.28299999999999997,"5min":0.23499999999999999,"15min":0.221},"max":{"1min":5.9859999999999998,"5min":7.274,"15min":44.753},"last":0.30499999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:49:26 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":1.552,"15min":1.6799999999999999},"min":{"1min":0.30499999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":7.8639999999999999,"5min":8.8469999999999995,"15min":45.231999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.5169999999999999,"15min":1.6459999999999999},"min":{"1min":0.34499999999999997,"5min":0.245,"15min":0.23100000000000001},"max":{"1min":6.7009999999999996,"5min":7.3570000000000002,"15min":45.097999999999999},"last":0.42399999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:47:18 2024","interfaces":[{"interface":"back","average":{"1min":2.02,"5min":1.706,"15min":1.3899999999999999},"min":{"1min":0.376,"5min":0.28999999999999998,"15min":0.26800000000000002},"max":{"1min":10.224,"5min":10.224,"15min":10.224},"last":0.97399999999999998},{"interface":"front","average":{"1min":2.3239999999999998,"5min":1.647,"15min":1.4550000000000001},"min":{"1min":0.36399999999999999,"5min":0.29499999999999998,"15min":0.27300000000000002},"max":{"1min":7.008,"5min":7.6900000000000004,"15min":18.068000000000001},"last":0.41199999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:49:26 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.452,"15min":1.5740000000000001},"min":{"1min":0.34899999999999998,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":7.9210000000000003,"5min":8.9009999999999998,"15min":11.15},"last":0.53800000000000003},{"interface":"front","average":{"1min":1.198,"5min":1.4450000000000001,"15min":1.5620000000000001},"min":{"1min":0.313,"5min":0.29799999999999999,"15min":0.246},"max":{"1min":6.8010000000000002,"5min":7.3949999999999996,"15min":19.632999999999999},"last":0.496}]},{"osd":4,"last update":"Mon Feb 19 21:49:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.8819999999999999,"15min":1.5720000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":6.0910000000000002,"5min":8.2230000000000008,"15min":14.254},"last":1.6299999999999999},{"interface":"front","average":{"1min":1.403,"5min":1.8999999999999999,"15min":1.6359999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.23499999999999999},"max":{"1min":11.566000000000001,"5min":11.566000000000001,"15min":16.594999999999999},"last":0.77300000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:49:26 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":2.1480000000000001,"15min":1.6639999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27100000000000002},"max":{"1min":6.0629999999999997,"5min":14.695,"15min":14.695},"last":0.60699999999999998},{"interface":"front","average":{"1min":1.2070000000000001,"5min":2.2389999999999999,"15min":1.8660000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.27900000000000003},"max":{"1min":11.609999999999999,"5min":11.609999999999999,"15min":15.497999999999999},"last":0.66100000000000003}]},{"osd":7,"last update":"Mon Feb 19 21:49:48 2024","interfaces":[{"interface":"back","average":{"1min":1.7030000000000001,"5min":2.0800000000000001,"15min":1.7909999999999999},"min":{"1min":0.38300000000000001,"5min":0.27200000000000002,"15min":0.26700000000000002},"max":{"1min":7.9569999999999999,"5min":9.1929999999999996,"15min":14.721},"last":0.56200000000000006},{"interface":"front","average":{"1min":1.7390000000000001,"5min":2.1139999999999999,"15min":1.841},"min":{"1min":0.42099999999999999,"5min":0.35599999999999998,"15min":0.32700000000000001},"max":{"1min":7.9850000000000003,"5min":9.2240000000000002,"15min":14.744999999999999},"last":0.58199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575096,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1954284,"kb_used_data":1061860,"kb_used_omap":0,"kb_used_meta":892416,"kb_avail":91790868,"statfs":{"total":95995035648,"available":93993848832,"internally_reserved":0,"allocated":1087344640,"data_stored":1086181168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":913833984},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":1.0229999999999999,"15min":1.4610000000000001},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.161},"max":{"1min":3.6720000000000002,"5min":6.2789999999999999,"15min":42.776000000000003},"last":0.193},{"interface":"front","average":{"1min":0.67400000000000004,"5min":1.1319999999999999,"15min":1.514},"min":{"1min":0.19900000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":3.9620000000000002,"5min":10.798,"15min":44.845999999999997},"last":0.22}]},{"osd":2,"last update":"Mon Feb 19 21:47:38 2024","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.0029999999999999,"15min":1.3100000000000001},"min":{"1min":0.25,"5min":0.23799999999999999,"15min":0.20899999999999999},"max":{"1min":3.2679999999999998,"5min":5.6799999999999997,"15min":11.826000000000001},"last":0.23300000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.252,"15min":1.4610000000000001},"min":{"1min":0.21299999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":3.2029999999999998,"5min":6.0250000000000004,"15min":12.26},"last":0.20399999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":1.1850000000000001,"15min":1.613},"min":{"1min":0.24199999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":3.859,"5min":5.4500000000000002,"15min":41.607999999999997},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":1.2769999999999999,"15min":1.508},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":3.637,"5min":5.6589999999999998,"15min":42.811999999999998},"last":0.36799999999999999}]},{"osd":4,"last update":"Mon Feb 19 21:49:31 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.7030000000000001,"15min":1.482},"min":{"1min":0.30099999999999999,"5min":0.251,"15min":0.251},"max":{"1min":5.7590000000000003,"5min":15.853,"15min":15.853},"last":0.59699999999999998},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.754,"15min":1.5609999999999999},"min":{"1min":0.33200000000000002,"5min":0.28000000000000003,"15min":0.26500000000000001},"max":{"1min":6.7610000000000001,"5min":15.861000000000001,"15min":15.861000000000001},"last":0.28000000000000003}]},{"osd":5,"last update":"Mon Feb 19 21:49:59 2024","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.734,"15min":1.639},"min":{"1min":0.32400000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":4.0720000000000001,"5min":14.331,"15min":14.331},"last":0.30199999999999999},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.8979999999999999,"15min":1.625},"min":{"1min":0.307,"5min":0.307,"15min":0.30099999999999999},"max":{"1min":5.5229999999999997,"5min":14.496,"15min":14.496},"last":0.495}]},{"osd":6,"last update":"Mon Feb 19 21:49:31 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.657,"15min":1.6040000000000001},"min":{"1min":0.36199999999999999,"5min":0.30199999999999999,"15min":0.30099999999999999},"max":{"1min":2.6080000000000001,"5min":10.456,"15min":11.638999999999999},"last":1.8859999999999999},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.8160000000000001,"15min":1.746},"min":{"1min":0.379,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":4.0019999999999998,"5min":9.8049999999999997,"15min":12.199},"last":0.40699999999999997}]},{"osd":7,"last update":"Mon Feb 19 21:49:54 2024","interfaces":[{"interface":"back","average":{"1min":2.1419999999999999,"5min":2.0790000000000002,"15min":1.867},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":7.702,"5min":13.904,"15min":13.904},"last":0.42299999999999999},{"interface":"front","average":{"1min":2.0299999999999998,"5min":2.0779999999999998,"15min":1.7350000000000001},"min":{"1min":0.38900000000000001,"5min":0.35499999999999998,"15min":0.32600000000000001},"max":{"1min":7.6909999999999998,"5min":13.894,"15min":13.894},"last":0.48699999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738622,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3215316,"kb_used_data":2629708,"kb_used_omap":0,"kb_used_meta":585600,"kb_avail":90529836,"statfs":{"total":95995035648,"available":92702552064,"internally_reserved":0,"allocated":2692820992,"data_stored":2691681111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":599654400},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.88,"15min":1.105},"min":{"1min":0.19600000000000001,"5min":0.153,"15min":0.153},"max":{"1min":3.4889999999999999,"5min":6.1550000000000002,"15min":16.478000000000002},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":1.117,"15min":1.4059999999999999},"min":{"1min":0.20100000000000001,"5min":0.17899999999999999,"15min":0.17799999999999999},"max":{"1min":3.3450000000000002,"5min":6.9359999999999999,"15min":13.422000000000001},"last":0.26000000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:47:45 2024","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.0089999999999999,"15min":1.268},"min":{"1min":0.22600000000000001,"5min":0.221,"15min":0.221},"max":{"1min":5.6689999999999996,"5min":6.25,"15min":13.638999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":1.9359999999999999,"5min":1.347,"15min":1.5209999999999999},"min":{"1min":0.23599999999999999,"5min":0.224,"15min":0.19500000000000001},"max":{"1min":8.0749999999999993,"5min":11.348000000000001,"15min":13.134},"last":0.40500000000000003}]},{"osd":3,"last update":"Mon Feb 19 21:50:01 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.292,"15min":1.6819999999999999},"min":{"1min":0.255,"5min":0.216,"15min":0.21299999999999999},"max":{"1min":5.3570000000000002,"5min":12.691000000000001,"15min":14.507999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.099,"15min":1.552},"min":{"1min":0.32000000000000001,"5min":0.24099999999999999,"15min":0.23400000000000001},"max":{"1min":3.4569999999999999,"5min":6.6150000000000002,"15min":18.759},"last":0.44900000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:49:44 2024","interfaces":[{"interface":"back","average":{"1min":2.0649999999999999,"5min":1.768,"15min":1.6910000000000001},"min":{"1min":0.29899999999999999,"5min":0.252,"15min":0.252},"max":{"1min":7.766,"5min":10.311,"15min":13.278},"last":0.42099999999999999},{"interface":"front","average":{"1min":1.99,"5min":1.732,"15min":1.534},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.255},"max":{"1min":8.1219999999999999,"5min":10.109,"15min":10.109},"last":0.35499999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:50:01 2024","interfaces":[{"interface":"back","average":{"1min":1.6140000000000001,"5min":2.1850000000000001,"15min":2.0779999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.27600000000000002},"max":{"1min":8.1199999999999992,"5min":25.442,"15min":42.799999999999997},"last":0.32300000000000001},{"interface":"front","average":{"1min":2.1579999999999999,"5min":2.2429999999999999,"15min":2.0939999999999999},"min":{"1min":0.35099999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":8.5530000000000008,"5min":25.411999999999999,"15min":42.695},"last":0.51900000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:49:15 2024","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.651,"15min":1.6000000000000001},"min":{"1min":0.36499999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":9.3049999999999997,"5min":10.278,"15min":42.777000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":1.7410000000000001,"15min":1.8740000000000001},"min":{"1min":0.39000000000000001,"5min":0.29599999999999999,"15min":0.28599999999999998},"max":{"1min":2.198,"5min":11.84,"15min":13.289999999999999},"last":0.437}]},{"osd":7,"last update":"Mon Feb 19 21:49:48 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.8839999999999999,"15min":1.8100000000000001},"min":{"1min":0.38700000000000001,"5min":0.36799999999999999,"15min":0.31},"max":{"1min":9.6460000000000008,"5min":15.688000000000001,"15min":42.758000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":1.978,"5min":1.871,"15min":1.738},"min":{"1min":0.40000000000000002,"5min":0.36399999999999999,"15min":0.33200000000000002},"max":{"1min":9.6389999999999993,"5min":10.470000000000001,"15min":42.718000000000004},"last":0.47099999999999997}]}]},{"osd":2,"up_from":394,"seq":1692217114636,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1872964,"kb_used_data":1553020,"kb_used_omap":0,"kb_used_meta":319935,"kb_avail":91872188,"statfs":{"total":95995035648,"available":94077120512,"internally_reserved":0,"allocated":1590292480,"data_stored":1589168709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":327613492},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]}]},{"osd":3,"up_from":0,"seq":111669149934,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":32,"seq":137438953703,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3480200,"kb_used_data":2886400,"kb_used_omap":0,"kb_used_meta":593792,"kb_avail":90264952,"statfs":{"total":95995035648,"available":92431310848,"internally_reserved":0,"allocated":2955673600,"data_stored":2954545055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":608043008},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:49:32 2024","interfaces":[{"interface":"back","average":{"1min":1.623,"5min":2.1739999999999999,"15min":1.8819999999999999},"min":{"1min":0.35399999999999998,"5min":0.23499999999999999,"15min":0.219},"max":{"1min":9.0280000000000005,"5min":53.936,"15min":53.936},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.90000000000000002,"5min":2.3690000000000002,"15min":2.02},"min":{"1min":0.28299999999999997,"5min":0.23000000000000001,"15min":0.22600000000000001},"max":{"1min":4.1059999999999999,"5min":54.405999999999999,"15min":54.405999999999999},"last":0.56899999999999995}]},{"osd":1,"last update":"Mon Feb 19 21:49:32 2024","interfaces":[{"interface":"back","average":{"1min":1.8280000000000001,"5min":2.323,"15min":1.742},"min":{"1min":0.314,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":6.266,"5min":54.731000000000002,"15min":54.731000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":2.173,"15min":1.6120000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.25},"max":{"1min":4.1310000000000002,"5min":52.490000000000002,"15min":52.490000000000002},"last":0.66300000000000003}]},{"osd":2,"last update":"Mon Feb 19 21:47:30 2024","interfaces":[{"interface":"back","average":{"1min":2.4430000000000001,"5min":1.7569999999999999,"15min":1.456},"min":{"1min":0.33500000000000002,"5min":0.28799999999999998,"15min":0.27100000000000002},"max":{"1min":7.1550000000000002,"5min":7.6399999999999997,"15min":16.788},"last":0.46800000000000003},{"interface":"front","average":{"1min":2.8610000000000002,"5min":1.641,"15min":1.659},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.27300000000000002},"max":{"1min":8.1500000000000004,"5min":8.1500000000000004,"15min":20.995999999999999},"last":0.67200000000000004}]},{"osd":3,"last update":"Mon Feb 19 21:49:32 2024","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.5289999999999999,"15min":1.6200000000000001},"min":{"1min":0.33000000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":6.2750000000000004,"5min":6.5579999999999998,"15min":15.914999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":1.7330000000000001,"5min":1.7509999999999999,"15min":1.6499999999999999},"min":{"1min":0.38400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":9.1150000000000002,"5min":9.4000000000000004,"15min":13.321},"last":0.64700000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":2.1400000000000001,"15min":1.625},"min":{"1min":0.23799999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.81999999999999995,"5min":16.731999999999999,"15min":18.916},"last":0.371},{"interface":"front","average":{"1min":1.1040000000000001,"5min":2.1230000000000002,"15min":1.847},"min":{"1min":0.28299999999999997,"5min":0.26200000000000001,"15min":0.253},"max":{"1min":6.3029999999999999,"5min":8.2959999999999994,"15min":14.840999999999999},"last":0.45000000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:49:32 2024","interfaces":[{"interface":"back","average":{"1min":1.6240000000000001,"5min":1.7989999999999999,"15min":1.534},"min":{"1min":0.28999999999999998,"5min":0.28899999999999998,"15min":0.28599999999999998},"max":{"1min":6.2409999999999997,"5min":9.1720000000000006,"15min":13.27},"last":0.58199999999999996},{"interface":"front","average":{"1min":1.8029999999999999,"5min":2.3769999999999998,"15min":1.7230000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":9.5069999999999997,"5min":18.670000000000002,"15min":18.670000000000002},"last":0.629}]},{"osd":7,"last update":"Mon Feb 19 21:50:00 2024","interfaces":[{"interface":"back","average":{"1min":2.7650000000000001,"5min":2.4849999999999999,"15min":1.76},"min":{"1min":0.38,"5min":0.311,"15min":0.28899999999999998},"max":{"1min":13.765000000000001,"5min":16.763999999999999,"15min":16.763999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":3.0190000000000001,"5min":1.9199999999999999,"15min":1.6879999999999999},"min":{"1min":0.502,"5min":0.31,"15min":0.31},"max":{"1min":10.044,"5min":10.82,"15min":12.808999999999999},"last":0.68999999999999995}]}]},{"osd":5,"up_from":38,"seq":163208757475,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2729664,"kb_used_data":1839224,"kb_used_omap":0,"kb_used_meta":890432,"kb_avail":91015488,"statfs":{"total":95995035648,"available":93199859712,"internally_reserved":0,"allocated":1883365376,"data_stored":1882245146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":911802368},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:49:06 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":1.8029999999999999,"15min":1.728},"min":{"1min":0.246,"5min":0.214,"15min":0.20599999999999999},"max":{"1min":6.4950000000000001,"5min":19.236000000000001,"15min":20.550999999999998},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":1.992,"15min":1.8240000000000001},"min":{"1min":0.34599999999999997,"5min":0.246,"15min":0.20899999999999999},"max":{"1min":3.286,"5min":13.241,"15min":20.879000000000001},"last":0.57899999999999996}]},{"osd":1,"last update":"Mon Feb 19 21:49:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":1.6839999999999999,"15min":1.651},"min":{"1min":0.251,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":3.4039999999999999,"5min":8.9789999999999992,"15min":10.42},"last":0.626},{"interface":"front","average":{"1min":0.55400000000000005,"5min":1.798,"15min":1.5680000000000001},"min":{"1min":0.27100000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.9299999999999999,"5min":10.965,"15min":10.965},"last":1.0469999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:48:01 2024","interfaces":[{"interface":"back","average":{"1min":3.6019999999999999,"5min":2.2890000000000001,"15min":1.752},"min":{"1min":0.30599999999999999,"5min":0.26800000000000002,"15min":0.25700000000000001},"max":{"1min":19.298999999999999,"5min":19.298999999999999,"15min":20.186},"last":0.52600000000000002},{"interface":"front","average":{"1min":2.5939999999999999,"5min":2.1819999999999999,"15min":1.774},"min":{"1min":0.318,"5min":0.28199999999999997,"15min":0.23200000000000001},"max":{"1min":8.9469999999999992,"5min":9.0039999999999996,"15min":20.175000000000001},"last":0.64600000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":2.0089999999999999,"15min":1.9910000000000001},"min":{"1min":0.38300000000000001,"5min":0.26100000000000001,"15min":0.24099999999999999},"max":{"1min":6.5199999999999996,"5min":19.321000000000002,"15min":20.146999999999998},"last":0.502},{"interface":"front","average":{"1min":0.85999999999999999,"5min":1.8560000000000001,"15min":2.0739999999999998},"min":{"1min":0.375,"5min":0.311,"15min":0.29499999999999998},"max":{"1min":3.2440000000000002,"5min":9.0269999999999992,"15min":20.120000000000001},"last":0.60399999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.75,"15min":1.3440000000000001},"min":{"1min":0.28899999999999998,"5min":0.214,"15min":0.214},"max":{"1min":7.6710000000000003,"5min":16.643999999999998,"15min":21.577000000000002},"last":1.202},{"interface":"front","average":{"1min":0.873,"5min":1.9950000000000001,"15min":1.758},"min":{"1min":0.309,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":6.4580000000000002,"5min":19.274000000000001,"15min":19.274000000000001},"last":0.42499999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:49:25 2024","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":2.306,"15min":1.792},"min":{"1min":0.35399999999999998,"5min":0.26200000000000001,"15min":0.221},"max":{"1min":8.9079999999999995,"5min":19.884,"15min":19.884},"last":0.54900000000000004},{"interface":"front","average":{"1min":1.4199999999999999,"5min":2.0270000000000001,"15min":1.7869999999999999},"min":{"1min":0.316,"5min":0.26700000000000002,"15min":0.23599999999999999},"max":{"1min":10.260999999999999,"5min":10.260999999999999,"15min":13.532999999999999},"last":1.0089999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:49:52 2024","interfaces":[{"interface":"back","average":{"1min":1.8939999999999999,"5min":2.4319999999999999,"15min":2.0110000000000001},"min":{"1min":0.35899999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":9.6300000000000008,"5min":12.611000000000001,"15min":12.962},"last":0.98299999999999998},{"interface":"front","average":{"1min":2.2050000000000001,"5min":2.3540000000000001,"15min":1.8300000000000001},"min":{"1min":0.36099999999999999,"5min":0.221,"15min":0.221},"max":{"1min":9.5649999999999995,"5min":15.593999999999999,"15min":17.759},"last":1.0720000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2698641408,"data_stored":2698641408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1085734912,"data_stored":1085734912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1587216384,"data_stored":1587216384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2956263424,"data_stored":2956263424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1884946432,"data_stored":1884946432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1888026624,"data_stored":1888026624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":540082176,"data_stored":540082176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:50:11.765 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:50:11.805 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:10.941750+0000 mgr.y (mgr.14514) 669 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:50:11.805 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:11.045852+0000 mon.a (mon.0) 1675 : audit [INF] from='client.? 172.21.15.80:0/2676460815' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:50:11.806 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:50:11.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:10.941750+0000 mgr.y (mgr.14514) 669 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:50:11.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:11.045852+0000 mon.a (mon.0) 1675 : audit [INF] from='client.? 172.21.15.80:0/2676460815' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:50:11.841 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:12.283 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 71 16 68579 68563 60.3454 26 0.00379246 0.016497 2024-02-19T21:50:12.777 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:11.165380+0000 mgr.y (mgr.14514) 670 : cluster [DBG] pgmap v872: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.1 GiB data, 16 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 17 MiB/s wr, 273 op/s; 12688/203406 objects degraded (6.238%); 4122/203406 objects misplaced (2.026%); 2.7 MiB/s, 43 objects/s recovering 2024-02-19T21:50:12.778 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:11.534350+0000 mon.a (mon.0) 1676 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:50:12.778 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:11.546695+0000 mon.a (mon.0) 1677 : audit [INF] from='client.? 172.21.15.80:0/2676460815' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:50:12.778 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:11.546736+0000 mon.a (mon.0) 1678 : cluster [DBG] osdmap e421: 8 total, 8 up, 7 in 2024-02-19T21:50:12.778 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:11.165380+0000 mgr.y (mgr.14514) 670 : cluster [DBG] pgmap v872: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.1 GiB data, 16 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 17 MiB/s wr, 273 op/s; 12688/203406 objects degraded (6.238%); 4122/203406 objects misplaced (2.026%); 2.7 MiB/s, 43 objects/s recovering 2024-02-19T21:50:12.778 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:11.534350+0000 mon.a (mon.0) 1676 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:50:12.778 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:11.546695+0000 mon.a (mon.0) 1677 : audit [INF] from='client.? 172.21.15.80:0/2676460815' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:50:12.778 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:11.546736+0000 mon.a (mon.0) 1678 : cluster [DBG] osdmap e421: 8 total, 8 up, 7 in 2024-02-19T21:50:12.793 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:50:12.798 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:12.799 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:50:12.800 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.2 dump_blocked_ops 2024-02-19T21:50:12.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:11.165380+0000 mgr.y (mgr.14514) 670 : cluster [DBG] pgmap v872: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.1 GiB data, 16 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 17 MiB/s wr, 273 op/s; 12688/203406 objects degraded (6.238%); 4122/203406 objects misplaced (2.026%); 2.7 MiB/s, 43 objects/s recovering 2024-02-19T21:50:12.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:11.534350+0000 mon.a (mon.0) 1676 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:50:12.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:11.546695+0000 mon.a (mon.0) 1677 : audit [INF] from='client.? 172.21.15.80:0/2676460815' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:50:12.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:11.546736+0000 mon.a (mon.0) 1678 : cluster [DBG] osdmap e421: 8 total, 8 up, 7 in 2024-02-19T21:50:12.899 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:50:12.936 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:13.039 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:50:13.045 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:13.046 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:50:13.146 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:50:13.177 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:13.283 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 72 16 68879 68863 59.7677 18.75 0.00335237 0.0166433 2024-02-19T21:50:13.303 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:50:13.306 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:13.306 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:50:13.407 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:50:13.437 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:13.685 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:50:13.687 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:50:13.691 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:13.691 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:50:13.695 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:50:13.793 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:50:13.827 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:13.851 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:50:13.854 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:13.855 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:50:13.955 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:50:13.986 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:14.012 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:50:14.016 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:14.016 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:50:14.117 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:50:14.146 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:14.283 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 73 16 69175 69159 59.2024 18.5 0.00339886 0.0168044 2024-02-19T21:50:14.480 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset noscrub 2024-02-19T21:50:14.702 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:50:14.708 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:14.708 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:50:14.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:13.165824+0000 mgr.y (mgr.14514) 671 : cluster [DBG] pgmap v874: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.1 GiB data, 16 GiB used, 609 GiB / 626 GiB avail; 853 B/s rd, 20 MiB/s wr, 315 op/s; 12687/203721 objects degraded (6.228%); 4121/203721 objects misplaced (2.023%); 1.8 MiB/s, 29 objects/s recovering 2024-02-19T21:50:14.809 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:50:14.839 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:13.165824+0000 mgr.y (mgr.14514) 671 : cluster [DBG] pgmap v874: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.1 GiB data, 16 GiB used, 609 GiB / 626 GiB avail; 853 B/s rd, 20 MiB/s wr, 315 op/s; 12687/203721 objects degraded (6.228%); 4121/203721 objects misplaced (2.023%); 1.8 MiB/s, 29 objects/s recovering 2024-02-19T21:50:14.839 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:13.165824+0000 mgr.y (mgr.14514) 671 : cluster [DBG] pgmap v874: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.1 GiB data, 16 GiB used, 609 GiB / 626 GiB avail; 853 B/s rd, 20 MiB/s wr, 315 op/s; 12687/203721 objects degraded (6.228%); 4121/203721 objects misplaced (2.023%); 1.8 MiB/s, 29 objects/s recovering 2024-02-19T21:50:14.841 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:15.283 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 74 16 69471 69455 58.6524 18.5 0.0107028 0.016972 2024-02-19T21:50:15.806 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:50:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:50:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:50:15.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:15.266982+0000 mon.a (mon.0) 1679 : cluster [WRN] Health check update: Degraded data redundancy: 12687/203721 objects degraded (6.228%), 9 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:50:15.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:15.271414+0000 mon.a (mon.0) 1680 : cluster [DBG] osdmap e422: 8 total, 8 up, 7 in 2024-02-19T21:50:15.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:15.266982+0000 mon.a (mon.0) 1679 : cluster [WRN] Health check update: Degraded data redundancy: 12687/203721 objects degraded (6.228%), 9 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:50:15.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:15.271414+0000 mon.a (mon.0) 1680 : cluster [DBG] osdmap e422: 8 total, 8 up, 7 in 2024-02-19T21:50:15.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:15.266982+0000 mon.a (mon.0) 1679 : cluster [WRN] Health check update: Degraded data redundancy: 12687/203721 objects degraded (6.228%), 9 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:50:15.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:15.271414+0000 mon.a (mon.0) 1680 : cluster [DBG] osdmap e422: 8 total, 8 up, 7 in 2024-02-19T21:50:16.092 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:50:16.095 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:16.096 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:50:16.196 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:50:16.228 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:16.283 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 75 15 69737 69722 58.0929 16.6875 0.664532 0.0171464 2024-02-19T21:50:16.352 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:50:16.359 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:16.360 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:50:16.460 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:50:16.493 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:16.621 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:50:16.625 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:16.626 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:50:16.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:15.166491+0000 mgr.y (mgr.14514) 672 : cluster [DBG] pgmap v875: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.2 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 771 B/s rd, 27 MiB/s wr, 427 op/s; 12631/206565 objects degraded (6.115%); 4121/206565 objects misplaced (1.995%); 2.2 MiB/s, 34 objects/s recovering 2024-02-19T21:50:16.626 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:15.166491+0000 mgr.y (mgr.14514) 672 : cluster [DBG] pgmap v875: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.2 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 771 B/s rd, 27 MiB/s wr, 427 op/s; 12631/206565 objects degraded (6.115%); 4121/206565 objects misplaced (1.995%); 2.2 MiB/s, 34 objects/s recovering 2024-02-19T21:50:16.631 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:50:16.727 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:50:16.763 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:16.791 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:50:16.795 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:16.796 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:50:16.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:15.166491+0000 mgr.y (mgr.14514) 672 : cluster [DBG] pgmap v875: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.2 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 771 B/s rd, 27 MiB/s wr, 427 op/s; 12631/206565 objects degraded (6.115%); 4121/206565 objects misplaced (1.995%); 2.2 MiB/s, 34 objects/s recovering 2024-02-19T21:50:16.873 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:50:16.876 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:50:16.897 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:50:16.925 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:16.952 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:50:16.955 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:16.956 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:50:17.057 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:50:17.091 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:17.115 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:50:17.118 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:17.118 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:50:17.219 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:50:17.259 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:17.283 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 76 16 70105 70089 57.6303 22.9375 0.00800132 0.0172859 2024-02-19T21:50:17.291 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:50:17.294 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:17.294 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:50:17.395 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:50:17.427 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:17.453 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:50:17.455 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:17.456 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:50:17.557 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:50:17.586 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:17.595 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:16.849481+0000 mgr.y (mgr.14514) 673 : audit [DBG] from='client.15741 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:50:17.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:16.849481+0000 mgr.y (mgr.14514) 673 : audit [DBG] from='client.15741 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:50:17.608 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:50:17.613 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:17.613 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:50:17.714 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:50:17.749 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:17.876 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:50:17.880 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:17.880 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:50:17.981 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:50:18.001 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:50:18.010 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:16.849481+0000 mgr.y (mgr.14514) 673 : audit [DBG] from='client.15741 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:50:18.013 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:18.020 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:50:18.038 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:50:18.040 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:50:18.042 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:18.042 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:50:18.059 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:50:18.092 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:50:18.118 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:50:18.138 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:50:18.143 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:50:18.170 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:50:18.171 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:18.172 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:50:18.172 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:50:18.172 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:50:18.172 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:50:18.172 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:50:18.173 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:50:18.173 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:50:18.173 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:50:18.283 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 77 16 70452 70436 57.1636 21.6875 0.0038072 0.0174125 2024-02-19T21:50:18.344 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":876,"stamp":"2024-02-19T21:50:15.269157+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4528543396,"num_objects":69292,"num_object_clones":0,"num_object_copies":207876,"num_objects_missing_on_primary":1157,"num_objects_missing":1157,"num_objects_degraded":12515,"num_objects_misplaced":4121,"num_objects_unfound":0,"num_objects_dirty":69292,"num_whiteouts":0,"num_read":2175,"num_read_kb":1927,"num_write":69812,"num_write_kb":4422440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3560,"num_bytes_recovered":214833946,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69945,"ondisk_log_size":69945,"up":414,"acting":407,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":421,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":656216064,"kb_used":17430496,"kb_used_data":12936168,"kb_used_omap":0,"kb_used_meta":4494271,"kb_avail":638785568,"statfs":{"total":671965249536,"available":654116421632,"internally_reserved":0,"allocated":13246636032,"data_stored":13238526273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":4602133556},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":214433792,"num_objects":3272,"num_object_clones":0,"num_object_copies":9816,"num_objects_missing_on_primary":-1,"num_objects_missing":-1,"num_objects_degraded":-347,"num_objects_misplaced":-1,"num_objects_unfound":0,"num_objects_dirty":3272,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3272,"num_write_kb":209408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":347,"num_bytes_recovered":22740992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.104541"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":17,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.303543+0000","last_change":"2024-02-19T21:49:54.492937+0000","last_active":"2024-02-19T21:50:10.303543+0000","last_peered":"2024-02-19T21:50:10.303543+0000","last_clean":"2024-02-19T21:50:10.303543+0000","last_became_active":"2024-02-19T21:49:54.492544+0000","last_became_peered":"2024-02-19T21:49:54.492544+0000","last_unstale":"2024-02-19T21:50:10.303543+0000","last_undegraded":"2024-02-19T21:50:10.303543+0000","last_fullsized":"2024-02-19T21:50:10.303543+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.643236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.643236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":396,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.270625+0000","last_change":"2024-02-19T21:45:17.201007+0000","last_active":"2024-02-19T21:50:10.270625+0000","last_peered":"2024-02-19T21:50:10.270625+0000","last_clean":"2024-02-19T21:50:10.270625+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:50:10.270625+0000","last_undegraded":"2024-02-19T21:50:10.270625+0000","last_fullsized":"2024-02-19T21:50:10.270625+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:17.200897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:17.200897+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"201'27","reported_seq":64,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:08.526114+0000","last_change":"2024-02-19T21:49:08.327817+0000","last_active":"2024-02-19T21:50:08.526114+0000","last_peered":"2024-02-19T21:50:08.526114+0000","last_clean":"2024-02-19T21:50:08.526114+0000","last_became_active":"2024-02-19T21:49:08.327416+0000","last_became_peered":"2024-02-19T21:49:08.327416+0000","last_unstale":"2024-02-19T21:50:08.526114+0000","last_undegraded":"2024-02-19T21:50:08.526114+0000","last_fullsized":"2024-02-19T21:50:08.526114+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'27","last_scrub_stamp":"2024-02-19T21:44:48.022013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:48.022013+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":369,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.274754+0000","last_change":"2024-02-19T21:48:30.516215+0000","last_active":"2024-02-19T21:50:10.274754+0000","last_peered":"2024-02-19T21:50:10.274754+0000","last_clean":"2024-02-19T21:50:10.274754+0000","last_became_active":"2024-02-19T21:47:46.250178+0000","last_became_peered":"2024-02-19T21:47:46.250178+0000","last_unstale":"2024-02-19T21:50:10.274754+0000","last_undegraded":"2024-02-19T21:50:10.274754+0000","last_fullsized":"2024-02-19T21:50:10.274754+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.516139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.516139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":92,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.271105+0000","last_change":"2024-02-19T21:49:08.330105+0000","last_active":"2024-02-19T21:50:10.271105+0000","last_peered":"2024-02-19T21:50:10.271105+0000","last_clean":"2024-02-19T21:50:10.271105+0000","last_became_active":"2024-02-19T21:49:08.328994+0000","last_became_peered":"2024-02-19T21:49:08.328994+0000","last_unstale":"2024-02-19T21:50:10.271105+0000","last_undegraded":"2024-02-19T21:50:10.271105+0000","last_fullsized":"2024-02-19T21:50:10.271105+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.636083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.636083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"200'19","reported_seq":465,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.273595+0000","last_change":"2024-02-19T21:48:26.530234+0000","last_active":"2024-02-19T21:50:10.273595+0000","last_peered":"2024-02-19T21:50:10.273595+0000","last_clean":"2024-02-19T21:50:10.273595+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:50:10.273595+0000","last_undegraded":"2024-02-19T21:50:10.273595+0000","last_fullsized":"2024-02-19T21:50:10.273595+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:48:26.530160+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.530160+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":152,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:08.541339+0000","last_change":"2024-02-19T21:49:08.332091+0000","last_active":"2024-02-19T21:50:08.541339+0000","last_peered":"2024-02-19T21:50:08.541339+0000","last_clean":"2024-02-19T21:50:08.541339+0000","last_became_active":"2024-02-19T21:49:08.331753+0000","last_became_peered":"2024-02-19T21:49:08.331753+0000","last_unstale":"2024-02-19T21:50:08.541339+0000","last_undegraded":"2024-02-19T21:50:08.541339+0000","last_fullsized":"2024-02-19T21:50:08.541339+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.005236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.005236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":409,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.302970+0000","last_change":"2024-02-19T21:48:28.327028+0000","last_active":"2024-02-19T21:50:10.302970+0000","last_peered":"2024-02-19T21:50:10.302970+0000","last_clean":"2024-02-19T21:50:10.302970+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:50:10.302970+0000","last_undegraded":"2024-02-19T21:50:10.302970+0000","last_fullsized":"2024-02-19T21:50:10.302970+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.326938+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"310'9","reported_seq":363,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.273930+0000","last_change":"2024-02-19T21:49:08.329655+0000","last_active":"2024-02-19T21:50:10.273930+0000","last_peered":"2024-02-19T21:50:10.273930+0000","last_clean":"2024-02-19T21:50:10.273930+0000","last_became_active":"2024-02-19T21:49:08.329314+0000","last_became_peered":"2024-02-19T21:49:08.329314+0000","last_unstale":"2024-02-19T21:50:10.273930+0000","last_undegraded":"2024-02-19T21:50:10.273930+0000","last_fullsized":"2024-02-19T21:50:10.273930+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"310'9","last_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_deep_scrub":"310'9","last_deep_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.506188+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":330,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.275305+0000","last_change":"2024-02-19T21:46:31.205220+0000","last_active":"2024-02-19T21:50:10.275305+0000","last_peered":"2024-02-19T21:50:10.275305+0000","last_clean":"2024-02-19T21:50:10.275305+0000","last_became_active":"2024-02-19T21:46:31.204816+0000","last_became_peered":"2024-02-19T21:46:31.204816+0000","last_unstale":"2024-02-19T21:50:10.275305+0000","last_undegraded":"2024-02-19T21:50:10.275305+0000","last_fullsized":"2024-02-19T21:50:10.275305+0000","mapping_epoch":330,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":331,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:36.890201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.890201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":431,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.302514+0000","last_change":"2024-02-19T21:49:08.330669+0000","last_active":"2024-02-19T21:50:10.302514+0000","last_peered":"2024-02-19T21:50:10.302514+0000","last_clean":"2024-02-19T21:50:10.302514+0000","last_became_active":"2024-02-19T21:49:08.329998+0000","last_became_peered":"2024-02-19T21:49:08.329998+0000","last_unstale":"2024-02-19T21:50:10.302514+0000","last_undegraded":"2024-02-19T21:50:10.302514+0000","last_fullsized":"2024-02-19T21:50:10.302514+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:58.329316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:58.329316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"200'19","reported_seq":275,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.274937+0000","last_change":"2024-02-19T21:49:08.326162+0000","last_active":"2024-02-19T21:50:10.274937+0000","last_peered":"2024-02-19T21:50:10.274937+0000","last_clean":"2024-02-19T21:50:10.274937+0000","last_became_active":"2024-02-19T21:49:08.325802+0000","last_became_peered":"2024-02-19T21:49:08.325802+0000","last_unstale":"2024-02-19T21:50:10.274937+0000","last_undegraded":"2024-02-19T21:50:10.274937+0000","last_fullsized":"2024-02-19T21:50:10.274937+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:46:54.873416+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:46:54.873416+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2],"acting":[4,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":341,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.276089+0000","last_change":"2024-02-19T21:49:04.432817+0000","last_active":"2024-02-19T21:50:10.276089+0000","last_peered":"2024-02-19T21:50:10.276089+0000","last_clean":"2024-02-19T21:50:10.276089+0000","last_became_active":"2024-02-19T21:47:33.393708+0000","last_became_peered":"2024-02-19T21:47:33.393708+0000","last_unstale":"2024-02-19T21:50:10.276089+0000","last_undegraded":"2024-02-19T21:50:10.276089+0000","last_fullsized":"2024-02-19T21:50:10.276089+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:04.432733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:04.432733+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":17,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.304277+0000","last_change":"2024-02-19T21:49:54.492767+0000","last_active":"2024-02-19T21:50:10.304277+0000","last_peered":"2024-02-19T21:50:10.304277+0000","last_clean":"2024-02-19T21:50:10.304277+0000","last_became_active":"2024-02-19T21:49:54.491745+0000","last_became_peered":"2024-02-19T21:49:54.491745+0000","last_unstale":"2024-02-19T21:50:10.304277+0000","last_undegraded":"2024-02-19T21:50:10.304277+0000","last_fullsized":"2024-02-19T21:50:10.304277+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.232539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.232539+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1d","version":"201'18","reported_seq":359,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.273915+0000","last_change":"2024-02-19T21:48:25.734661+0000","last_active":"2024-02-19T21:50:10.273915+0000","last_peered":"2024-02-19T21:50:10.273915+0000","last_clean":"2024-02-19T21:50:10.273915+0000","last_became_active":"2024-02-19T21:38:31.247067+0000","last_became_peered":"2024-02-19T21:38:31.247067+0000","last_unstale":"2024-02-19T21:50:10.273915+0000","last_undegraded":"2024-02-19T21:50:10.273915+0000","last_fullsized":"2024-02-19T21:50:10.273915+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'18","last_scrub_stamp":"2024-02-19T21:48:25.734591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.734591+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":396,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.277565+0000","last_change":"2024-02-19T21:48:40.528082+0000","last_active":"2024-02-19T21:50:10.277565+0000","last_peered":"2024-02-19T21:50:10.277565+0000","last_clean":"2024-02-19T21:50:10.277565+0000","last_became_active":"2024-02-19T21:44:58.788307+0000","last_became_peered":"2024-02-19T21:44:58.788307+0000","last_unstale":"2024-02-19T21:50:10.277565+0000","last_undegraded":"2024-02-19T21:50:10.277565+0000","last_fullsized":"2024-02-19T21:50:10.277565+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:40.527970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:48:40.527970+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":404,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.275988+0000","last_change":"2024-02-19T21:48:11.557832+0000","last_active":"2024-02-19T21:50:10.275988+0000","last_peered":"2024-02-19T21:50:10.275988+0000","last_clean":"2024-02-19T21:50:10.275988+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:50:10.275988+0000","last_undegraded":"2024-02-19T21:50:10.275988+0000","last_fullsized":"2024-02-19T21:50:10.275988+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.557736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:17.913620+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.557736+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"200'34","reported_seq":65,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:08.525250+0000","last_change":"2024-02-19T21:49:08.332575+0000","last_active":"2024-02-19T21:50:08.525250+0000","last_peered":"2024-02-19T21:50:08.525250+0000","last_clean":"2024-02-19T21:50:08.525250+0000","last_became_active":"2024-02-19T21:49:08.331742+0000","last_became_peered":"2024-02-19T21:49:08.331742+0000","last_unstale":"2024-02-19T21:50:08.525250+0000","last_undegraded":"2024-02-19T21:50:08.525250+0000","last_fullsized":"2024-02-19T21:50:08.525250+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'34","last_scrub_stamp":"2024-02-19T21:45:49.728734+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:45:49.728734+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":416,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.273512+0000","last_change":"2024-02-19T21:46:44.994389+0000","last_active":"2024-02-19T21:50:10.273512+0000","last_peered":"2024-02-19T21:50:10.273512+0000","last_clean":"2024-02-19T21:50:10.273512+0000","last_became_active":"2024-02-19T21:44:58.790669+0000","last_became_peered":"2024-02-19T21:44:58.790669+0000","last_unstale":"2024-02-19T21:50:10.273512+0000","last_undegraded":"2024-02-19T21:50:10.273512+0000","last_fullsized":"2024-02-19T21:50:10.273512+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.994296+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":352,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.275088+0000","last_change":"2024-02-19T21:49:08.330330+0000","last_active":"2024-02-19T21:50:10.275088+0000","last_peered":"2024-02-19T21:50:10.275088+0000","last_clean":"2024-02-19T21:50:10.275088+0000","last_became_active":"2024-02-19T21:49:08.329986+0000","last_became_peered":"2024-02-19T21:49:08.329986+0000","last_unstale":"2024-02-19T21:50:10.275088+0000","last_undegraded":"2024-02-19T21:50:10.275088+0000","last_fullsized":"2024-02-19T21:50:10.275088+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.091409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.091409+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"201'19","reported_seq":300,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.270540+0000","last_change":"2024-02-19T21:48:26.366639+0000","last_active":"2024-02-19T21:50:10.270540+0000","last_peered":"2024-02-19T21:50:10.270540+0000","last_clean":"2024-02-19T21:50:10.270540+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:50:10.270540+0000","last_undegraded":"2024-02-19T21:50:10.270540+0000","last_fullsized":"2024-02-19T21:50:10.270540+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:26.366563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.366563+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":264,"reported_epoch":420,"state":"active+remapped+backfill_wait+backfill_toofull","last_fresh":"2024-02-19T21:50:10.302078+0000","last_change":"2024-02-19T21:49:38.335602+0000","last_active":"2024-02-19T21:50:10.302078+0000","last_peered":"2024-02-19T21:50:10.302078+0000","last_clean":"2024-02-19T21:49:06.309838+0000","last_became_active":"2024-02-19T21:49:08.329545+0000","last_became_peered":"2024-02-19T21:49:08.329545+0000","last_unstale":"2024-02-19T21:50:10.302078+0000","last_undegraded":"2024-02-19T21:50:10.302078+0000","last_fullsized":"2024-02-19T21:50:10.302078+0000","mapping_epoch":394,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":371,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:13.196112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:13.196112+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,3],"avail_no_missing":["7","3","5"],"object_location_counts":[{"shards":"3,5,7","objects":1}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":415,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:08.538313+0000","last_change":"2024-02-19T21:49:54.491840+0000","last_active":"2024-02-19T21:50:08.538313+0000","last_peered":"2024-02-19T21:50:08.538313+0000","last_clean":"2024-02-19T21:50:08.538313+0000","last_became_active":"2024-02-19T21:49:54.491488+0000","last_became_peered":"2024-02-19T21:49:54.491488+0000","last_unstale":"2024-02-19T21:50:08.538313+0000","last_undegraded":"2024-02-19T21:50:08.538313+0000","last_fullsized":"2024-02-19T21:50:08.538313+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.803606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.803606+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"201'20","reported_seq":501,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.271255+0000","last_change":"2024-02-19T21:49:54.502402+0000","last_active":"2024-02-19T21:50:10.271255+0000","last_peered":"2024-02-19T21:50:10.271255+0000","last_clean":"2024-02-19T21:50:10.271255+0000","last_became_active":"2024-02-19T21:49:54.483748+0000","last_became_peered":"2024-02-19T21:49:54.483748+0000","last_unstale":"2024-02-19T21:50:10.271255+0000","last_undegraded":"2024-02-19T21:50:10.271255+0000","last_fullsized":"2024-02-19T21:50:10.271255+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:48:25.348437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.348437+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":336,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.271462+0000","last_change":"2024-02-19T21:49:08.328206+0000","last_active":"2024-02-19T21:50:10.271462+0000","last_peered":"2024-02-19T21:50:10.271462+0000","last_clean":"2024-02-19T21:50:10.271462+0000","last_became_active":"2024-02-19T21:49:08.327865+0000","last_became_peered":"2024-02-19T21:49:08.327865+0000","last_unstale":"2024-02-19T21:50:10.271462+0000","last_undegraded":"2024-02-19T21:50:10.271462+0000","last_fullsized":"2024-02-19T21:50:10.271462+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.230652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.230652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":396,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.304152+0000","last_change":"2024-02-19T21:48:22.171667+0000","last_active":"2024-02-19T21:50:10.304152+0000","last_peered":"2024-02-19T21:50:10.304152+0000","last_clean":"2024-02-19T21:50:10.304152+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:50:10.304152+0000","last_undegraded":"2024-02-19T21:50:10.304152+0000","last_fullsized":"2024-02-19T21:50:10.304152+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.171600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.171600+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":432,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.276213+0000","last_change":"2024-02-19T21:49:08.330636+0000","last_active":"2024-02-19T21:50:10.276213+0000","last_peered":"2024-02-19T21:50:10.276213+0000","last_clean":"2024-02-19T21:50:10.276213+0000","last_became_active":"2024-02-19T21:49:08.330293+0000","last_became_peered":"2024-02-19T21:49:08.330293+0000","last_unstale":"2024-02-19T21:50:10.276213+0000","last_undegraded":"2024-02-19T21:50:10.276213+0000","last_fullsized":"2024-02-19T21:50:10.276213+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:03.034839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:03.034839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"381'24","reported_seq":29,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.302520+0000","last_change":"2024-02-19T21:49:55.368481+0000","last_active":"2024-02-19T21:50:10.302520+0000","last_peered":"2024-02-19T21:50:10.302520+0000","last_clean":"2024-02-19T21:50:10.302520+0000","last_became_active":"2024-02-19T21:49:54.485438+0000","last_became_peered":"2024-02-19T21:49:54.485438+0000","last_unstale":"2024-02-19T21:50:10.302520+0000","last_undegraded":"2024-02-19T21:50:10.302520+0000","last_fullsized":"2024-02-19T21:50:10.302520+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"381'24","last_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_deep_scrub":"381'24","last_deep_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_clean_scrub_stamp":"2024-02-19T21:48:39.382725+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,5],"acting":[7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":424,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.304464+0000","last_change":"2024-02-19T21:49:17.193002+0000","last_active":"2024-02-19T21:50:10.304464+0000","last_peered":"2024-02-19T21:50:10.304464+0000","last_clean":"2024-02-19T21:50:10.304464+0000","last_became_active":"2024-02-19T21:49:08.333537+0000","last_became_peered":"2024-02-19T21:49:08.333537+0000","last_unstale":"2024-02-19T21:50:10.304464+0000","last_undegraded":"2024-02-19T21:50:10.304464+0000","last_fullsized":"2024-02-19T21:50:10.304464+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:59.339649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:45:59.339649+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":452,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.275164+0000","last_change":"2024-02-19T21:49:54.494561+0000","last_active":"2024-02-19T21:50:10.275164+0000","last_peered":"2024-02-19T21:50:10.275164+0000","last_clean":"2024-02-19T21:50:10.275164+0000","last_became_active":"2024-02-19T21:49:54.494146+0000","last_became_peered":"2024-02-19T21:49:54.494146+0000","last_unstale":"2024-02-19T21:50:10.275164+0000","last_undegraded":"2024-02-19T21:50:10.275164+0000","last_fullsized":"2024-02-19T21:50:10.275164+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.560066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":425,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:08.539242+0000","last_change":"2024-02-19T21:49:09.765641+0000","last_active":"2024-02-19T21:50:08.539242+0000","last_peered":"2024-02-19T21:50:08.539242+0000","last_clean":"2024-02-19T21:50:08.539242+0000","last_became_active":"2024-02-19T21:49:08.331308+0000","last_became_peered":"2024-02-19T21:49:08.331308+0000","last_unstale":"2024-02-19T21:50:08.539242+0000","last_undegraded":"2024-02-19T21:50:08.539242+0000","last_fullsized":"2024-02-19T21:50:08.539242+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.765568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.765568+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"200'8","reported_seq":113,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.272855+0000","last_change":"2024-02-19T21:47:33.577363+0000","last_active":"2024-02-19T21:50:10.272855+0000","last_peered":"2024-02-19T21:50:10.272855+0000","last_clean":"2024-02-19T21:50:10.272855+0000","last_became_active":"2024-02-19T21:47:33.395217+0000","last_became_peered":"2024-02-19T21:47:33.395217+0000","last_unstale":"2024-02-19T21:50:10.272855+0000","last_undegraded":"2024-02-19T21:50:10.272855+0000","last_fullsized":"2024-02-19T21:50:10.272855+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'8","last_scrub_stamp":"2024-02-19T21:46:47.761677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.761677+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":336,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.271187+0000","last_change":"2024-02-19T21:49:08.918163+0000","last_active":"2024-02-19T21:50:10.271187+0000","last_peered":"2024-02-19T21:50:10.271187+0000","last_clean":"2024-02-19T21:50:10.271187+0000","last_became_active":"2024-02-19T21:49:08.328416+0000","last_became_peered":"2024-02-19T21:49:08.328416+0000","last_unstale":"2024-02-19T21:50:10.271187+0000","last_undegraded":"2024-02-19T21:50:10.271187+0000","last_fullsized":"2024-02-19T21:50:10.271187+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.918083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.918083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":414,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.273420+0000","last_change":"2024-02-19T21:49:54.480716+0000","last_active":"2024-02-19T21:50:10.273420+0000","last_peered":"2024-02-19T21:50:10.273420+0000","last_clean":"2024-02-19T21:50:10.273420+0000","last_became_active":"2024-02-19T21:49:54.480368+0000","last_became_peered":"2024-02-19T21:49:54.480368+0000","last_unstale":"2024-02-19T21:50:10.273420+0000","last_undegraded":"2024-02-19T21:50:10.273420+0000","last_fullsized":"2024-02-19T21:50:10.273420+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:19.596775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:19.596775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":398,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.273685+0000","last_change":"2024-02-19T21:49:05.012463+0000","last_active":"2024-02-19T21:50:10.273685+0000","last_peered":"2024-02-19T21:50:10.273685+0000","last_clean":"2024-02-19T21:50:10.273685+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:50:10.273685+0000","last_undegraded":"2024-02-19T21:50:10.273685+0000","last_fullsized":"2024-02-19T21:50:10.273685+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.012395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.012395+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"201'19","reported_seq":445,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.274075+0000","last_change":"2024-02-19T21:48:38.529106+0000","last_active":"2024-02-19T21:50:10.274075+0000","last_peered":"2024-02-19T21:50:10.274075+0000","last_clean":"2024-02-19T21:50:10.274075+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:50:10.274075+0000","last_undegraded":"2024-02-19T21:50:10.274075+0000","last_fullsized":"2024-02-19T21:50:10.274075+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:38.528977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.528977+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":401,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.271911+0000","last_change":"2024-02-19T21:46:06.096531+0000","last_active":"2024-02-19T21:50:10.271911+0000","last_peered":"2024-02-19T21:50:10.271911+0000","last_clean":"2024-02-19T21:50:10.271911+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:50:10.271911+0000","last_undegraded":"2024-02-19T21:50:10.271911+0000","last_fullsized":"2024-02-19T21:50:10.271911+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.096422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":212,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.276058+0000","last_change":"2024-02-19T21:48:38.391532+0000","last_active":"2024-02-19T21:50:10.276058+0000","last_peered":"2024-02-19T21:50:10.276058+0000","last_clean":"2024-02-19T21:50:10.276058+0000","last_became_active":"2024-02-19T21:47:33.395085+0000","last_became_peered":"2024-02-19T21:47:33.395085+0000","last_unstale":"2024-02-19T21:50:10.276058+0000","last_undegraded":"2024-02-19T21:50:10.276058+0000","last_fullsized":"2024-02-19T21:50:10.276058+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:38.391435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.391435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":413,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.275596+0000","last_change":"2024-02-19T21:48:14.600378+0000","last_active":"2024-02-19T21:50:10.275596+0000","last_peered":"2024-02-19T21:50:10.275596+0000","last_clean":"2024-02-19T21:50:10.275596+0000","last_became_active":"2024-02-19T21:47:33.393932+0000","last_became_peered":"2024-02-19T21:47:33.393932+0000","last_unstale":"2024-02-19T21:50:10.275596+0000","last_undegraded":"2024-02-19T21:50:10.275596+0000","last_fullsized":"2024-02-19T21:50:10.275596+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:14.600285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.600285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"200'15","reported_seq":467,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.273337+0000","last_change":"2024-02-19T21:49:08.334199+0000","last_active":"2024-02-19T21:50:10.273337+0000","last_peered":"2024-02-19T21:50:10.273337+0000","last_clean":"2024-02-19T21:50:10.273337+0000","last_became_active":"2024-02-19T21:49:08.333872+0000","last_became_peered":"2024-02-19T21:49:08.333872+0000","last_unstale":"2024-02-19T21:50:10.273337+0000","last_undegraded":"2024-02-19T21:50:10.273337+0000","last_fullsized":"2024-02-19T21:50:10.273337+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:45:08.678669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:08.678669+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":379,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.277686+0000","last_change":"2024-02-19T21:49:08.330114+0000","last_active":"2024-02-19T21:50:10.277686+0000","last_peered":"2024-02-19T21:50:10.277686+0000","last_clean":"2024-02-19T21:50:10.277686+0000","last_became_active":"2024-02-19T21:49:08.329770+0000","last_became_peered":"2024-02-19T21:49:08.329770+0000","last_unstale":"2024-02-19T21:50:10.277686+0000","last_undegraded":"2024-02-19T21:50:10.277686+0000","last_fullsized":"2024-02-19T21:50:10.277686+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:08.983923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.983923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"415'17","reported_seq":21,"reported_epoch":421,"state":"active+recovery_wait","last_fresh":"2024-02-19T21:50:11.552085+0000","last_change":"2024-02-19T21:49:57.074730+0000","last_active":"2024-02-19T21:50:11.552085+0000","last_peered":"2024-02-19T21:50:11.552085+0000","last_clean":"2024-02-19T21:47:10.198854+0000","last_became_active":"2024-02-19T21:49:54.486304+0000","last_became_peered":"2024-02-19T21:49:54.486304+0000","last_unstale":"2024-02-19T21:50:11.552085+0000","last_undegraded":"2024-02-19T21:50:11.552085+0000","last_fullsized":"2024-02-19T21:50:11.552085+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"199'13","last_scrub_stamp":"2024-02-19T21:45:05.721709+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:45:05.721709+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":["7","1","2","4"],"object_location_counts":[{"shards":"1,2,7","objects":1}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":423,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.271674+0000","last_change":"2024-02-19T21:49:54.484516+0000","last_active":"2024-02-19T21:50:10.271674+0000","last_peered":"2024-02-19T21:50:10.271674+0000","last_clean":"2024-02-19T21:50:10.271674+0000","last_became_active":"2024-02-19T21:49:54.483689+0000","last_became_peered":"2024-02-19T21:49:54.483689+0000","last_unstale":"2024-02-19T21:50:10.271674+0000","last_undegraded":"2024-02-19T21:50:10.271674+0000","last_fullsized":"2024-02-19T21:50:10.271674+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.157478+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"201'19","reported_seq":443,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:08.538551+0000","last_change":"2024-02-19T21:48:27.720048+0000","last_active":"2024-02-19T21:50:08.538551+0000","last_peered":"2024-02-19T21:50:08.538551+0000","last_clean":"2024-02-19T21:50:08.538551+0000","last_became_active":"2024-02-19T21:47:33.398295+0000","last_became_peered":"2024-02-19T21:47:33.398295+0000","last_unstale":"2024-02-19T21:50:08.538551+0000","last_undegraded":"2024-02-19T21:50:08.538551+0000","last_fullsized":"2024-02-19T21:50:08.538551+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:27.719954+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:48:27.719954+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":140,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.270792+0000","last_change":"2024-02-19T21:49:54.484392+0000","last_active":"2024-02-19T21:50:10.270792+0000","last_peered":"2024-02-19T21:50:10.270792+0000","last_clean":"2024-02-19T21:50:10.270792+0000","last_became_active":"2024-02-19T21:49:54.484049+0000","last_became_peered":"2024-02-19T21:49:54.484049+0000","last_unstale":"2024-02-19T21:50:10.270792+0000","last_undegraded":"2024-02-19T21:50:10.270792+0000","last_fullsized":"2024-02-19T21:50:10.270792+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.121769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.121769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":615,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:08.538729+0000","last_change":"2024-02-19T21:48:38.723220+0000","last_active":"2024-02-19T21:50:08.538729+0000","last_peered":"2024-02-19T21:50:08.538729+0000","last_clean":"2024-02-19T21:50:08.538729+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:50:08.538729+0000","last_undegraded":"2024-02-19T21:50:08.538729+0000","last_fullsized":"2024-02-19T21:50:08.538729+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:48:38.723151+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.723151+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":426,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:08.540055+0000","last_change":"2024-02-19T21:49:54.485462+0000","last_active":"2024-02-19T21:50:08.540055+0000","last_peered":"2024-02-19T21:50:08.540055+0000","last_clean":"2024-02-19T21:50:08.540055+0000","last_became_active":"2024-02-19T21:49:54.485121+0000","last_became_peered":"2024-02-19T21:49:54.485121+0000","last_unstale":"2024-02-19T21:50:08.540055+0000","last_undegraded":"2024-02-19T21:50:08.540055+0000","last_fullsized":"2024-02-19T21:50:08.540055+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:07.724097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:49:07.724097+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"201'25","reported_seq":305,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.274185+0000","last_change":"2024-02-19T21:49:08.335077+0000","last_active":"2024-02-19T21:50:10.274185+0000","last_peered":"2024-02-19T21:50:10.274185+0000","last_clean":"2024-02-19T21:50:10.274185+0000","last_became_active":"2024-02-19T21:49:08.334061+0000","last_became_peered":"2024-02-19T21:49:08.334061+0000","last_unstale":"2024-02-19T21:50:10.274185+0000","last_undegraded":"2024-02-19T21:50:10.274185+0000","last_fullsized":"2024-02-19T21:50:10.274185+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'25","last_scrub_stamp":"2024-02-19T21:46:07.553690+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.553690+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":396,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.302894+0000","last_change":"2024-02-19T21:48:21.256471+0000","last_active":"2024-02-19T21:50:10.302894+0000","last_peered":"2024-02-19T21:50:10.302894+0000","last_clean":"2024-02-19T21:50:10.302894+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:50:10.302894+0000","last_undegraded":"2024-02-19T21:50:10.302894+0000","last_fullsized":"2024-02-19T21:50:10.302894+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.256358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.256358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":403,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.275234+0000","last_change":"2024-02-19T21:46:35.035136+0000","last_active":"2024-02-19T21:50:10.275234+0000","last_peered":"2024-02-19T21:50:10.275234+0000","last_clean":"2024-02-19T21:50:10.275234+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:50:10.275234+0000","last_undegraded":"2024-02-19T21:50:10.275234+0000","last_fullsized":"2024-02-19T21:50:10.275234+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:35.035042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:35.035042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"201'12","reported_seq":15,"reported_epoch":420,"state":"active+recovery_wait+degraded","last_fresh":"2024-02-19T21:50:10.301950+0000","last_change":"2024-02-19T21:49:54.478418+0000","last_active":"2024-02-19T21:50:10.301950+0000","last_peered":"2024-02-19T21:50:10.301950+0000","last_clean":"2024-02-19T21:49:49.433484+0000","last_became_active":"2024-02-19T21:49:54.478094+0000","last_became_peered":"2024-02-19T21:49:54.478094+0000","last_unstale":"2024-02-19T21:50:10.301950+0000","last_undegraded":"2024-02-19T21:49:54.469051+0000","last_fullsized":"2024-02-19T21:50:10.301950+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'12","last_scrub_stamp":"2024-02-19T21:49:08.912638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.912638+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":3,"num_objects_missing":3,"num_objects_degraded":3,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":["1","2","6"],"object_location_counts":[{"shards":"1,2,6","objects":3}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":48,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:08.525336+0000","last_change":"2024-02-19T21:49:08.332757+0000","last_active":"2024-02-19T21:50:08.525336+0000","last_peered":"2024-02-19T21:50:08.525336+0000","last_clean":"2024-02-19T21:50:08.525336+0000","last_became_active":"2024-02-19T21:49:08.332176+0000","last_became_peered":"2024-02-19T21:49:08.332176+0000","last_unstale":"2024-02-19T21:50:08.525336+0000","last_undegraded":"2024-02-19T21:50:08.525336+0000","last_fullsized":"2024-02-19T21:50:08.525336+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:47:01.365477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:47:01.365477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":48,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:08.524637+0000","last_change":"2024-02-19T21:49:08.328632+0000","last_active":"2024-02-19T21:50:08.524637+0000","last_peered":"2024-02-19T21:50:08.524637+0000","last_clean":"2024-02-19T21:50:08.524637+0000","last_became_active":"2024-02-19T21:49:08.327826+0000","last_became_peered":"2024-02-19T21:49:08.327826+0000","last_unstale":"2024-02-19T21:50:08.524637+0000","last_undegraded":"2024-02-19T21:50:08.524637+0000","last_fullsized":"2024-02-19T21:50:08.524637+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:09.645607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:44:09.645607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"200'15","reported_seq":517,"reported_epoch":420,"state":"active+recovery_wait+degraded","last_fresh":"2024-02-19T21:50:10.271001+0000","last_change":"2024-02-19T21:49:54.484033+0000","last_active":"2024-02-19T21:50:10.271001+0000","last_peered":"2024-02-19T21:50:10.271001+0000","last_clean":"2024-02-19T21:49:49.432972+0000","last_became_active":"2024-02-19T21:49:54.483578+0000","last_became_peered":"2024-02-19T21:49:54.483578+0000","last_unstale":"2024-02-19T21:50:10.271001+0000","last_undegraded":"2024-02-19T21:49:54.471563+0000","last_fullsized":"2024-02-19T21:50:10.271001+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:44:53.072746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:53.072746+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":["0","2","6"],"object_location_counts":[{"shards":"0,2,6","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"421'4387","reported_seq":4436,"reported_epoch":421,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-02-19T21:50:14.972885+0000","last_change":"2024-02-19T21:49:09.774432+0000","last_active":"2024-02-19T21:50:14.972885+0000","last_peered":"2024-02-19T21:50:14.972885+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:09.770699+0000","last_became_peered":"2024-02-19T21:49:09.770699+0000","last_unstale":"2024-02-19T21:50:14.972885+0000","last_undegraded":"2024-02-19T21:49:09.328794+0000","last_fullsized":"2024-02-19T21:49:09.325036+0000","mapping_epoch":395,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4387,"ondisk_log_size":4387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":287506432,"num_objects":4387,"num_object_clones":0,"num_object_copies":13161,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1108,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4387,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4387,"num_write_kb":280768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5],"avail_no_missing":["6","5"],"object_location_counts":[{"shards":"5,6","objects":3279}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":17,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.303469+0000","last_change":"2024-02-19T21:49:54.492844+0000","last_active":"2024-02-19T21:50:10.303469+0000","last_peered":"2024-02-19T21:50:10.303469+0000","last_clean":"2024-02-19T21:50:10.303469+0000","last_became_active":"2024-02-19T21:49:54.492156+0000","last_became_peered":"2024-02-19T21:49:54.492156+0000","last_unstale":"2024-02-19T21:50:10.303469+0000","last_undegraded":"2024-02-19T21:50:10.303469+0000","last_fullsized":"2024-02-19T21:50:10.303469+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:04.692807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.692807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"378'4","reported_seq":435,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.277937+0000","last_change":"2024-02-19T21:48:28.510929+0000","last_active":"2024-02-19T21:50:10.277937+0000","last_peered":"2024-02-19T21:50:10.277937+0000","last_clean":"2024-02-19T21:50:10.277937+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:50:10.277937+0000","last_undegraded":"2024-02-19T21:50:10.277937+0000","last_fullsized":"2024-02-19T21:50:10.277937+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"378'4","last_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_deep_scrub":"378'4","last_deep_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.510849+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"200'23","reported_seq":282,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.273182+0000","last_change":"2024-02-19T21:48:22.519465+0000","last_active":"2024-02-19T21:50:10.273182+0000","last_peered":"2024-02-19T21:50:10.273182+0000","last_clean":"2024-02-19T21:50:10.273182+0000","last_became_active":"2024-02-19T21:47:46.252085+0000","last_became_peered":"2024-02-19T21:47:46.252085+0000","last_unstale":"2024-02-19T21:50:10.273182+0000","last_undegraded":"2024-02-19T21:50:10.273182+0000","last_fullsized":"2024-02-19T21:50:10.273182+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'23","last_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_deep_scrub":"200'23","last_deep_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.519381+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6],"acting":[4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":48,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:08.524717+0000","last_change":"2024-02-19T21:49:08.328855+0000","last_active":"2024-02-19T21:50:08.524717+0000","last_peered":"2024-02-19T21:50:08.524717+0000","last_clean":"2024-02-19T21:50:08.524717+0000","last_became_active":"2024-02-19T21:49:08.328237+0000","last_became_peered":"2024-02-19T21:49:08.328237+0000","last_unstale":"2024-02-19T21:50:08.524717+0000","last_undegraded":"2024-02-19T21:50:08.524717+0000","last_fullsized":"2024-02-19T21:50:08.524717+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:58.047556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:58.047556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"421'4253","reported_seq":4296,"reported_epoch":421,"state":"active+clean","last_fresh":"2024-02-19T21:50:14.622814+0000","last_change":"2024-02-19T21:48:47.778295+0000","last_active":"2024-02-19T21:50:14.622814+0000","last_peered":"2024-02-19T21:50:14.622814+0000","last_clean":"2024-02-19T21:50:14.622814+0000","last_became_active":"2024-02-19T21:48:47.777964+0000","last_became_peered":"2024-02-19T21:48:47.777964+0000","last_unstale":"2024-02-19T21:50:14.622814+0000","last_undegraded":"2024-02-19T21:50:14.622814+0000","last_fullsized":"2024-02-19T21:50:14.622814+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4253,"ondisk_log_size":4253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":278724608,"num_objects":4253,"num_object_clones":0,"num_object_copies":12759,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4253,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4253,"num_write_kb":272192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":450,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.271829+0000","last_change":"2024-02-19T21:49:08.328019+0000","last_active":"2024-02-19T21:50:10.271829+0000","last_peered":"2024-02-19T21:50:10.271829+0000","last_clean":"2024-02-19T21:50:10.271829+0000","last_became_active":"2024-02-19T21:49:08.327581+0000","last_became_peered":"2024-02-19T21:49:08.327581+0000","last_unstale":"2024-02-19T21:50:10.271829+0000","last_undegraded":"2024-02-19T21:50:10.271829+0000","last_fullsized":"2024-02-19T21:50:10.271829+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:22.180593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:45:22.180593+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5],"acting":[0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":396,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.274111+0000","last_change":"2024-02-19T21:48:37.789514+0000","last_active":"2024-02-19T21:50:10.274111+0000","last_peered":"2024-02-19T21:50:10.274111+0000","last_clean":"2024-02-19T21:50:10.274111+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:50:10.274111+0000","last_undegraded":"2024-02-19T21:50:10.274111+0000","last_fullsized":"2024-02-19T21:50:10.274111+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:37.789400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:37.789400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"201'20","reported_seq":302,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.273377+0000","last_change":"2024-02-19T21:45:57.877936+0000","last_active":"2024-02-19T21:50:10.273377+0000","last_peered":"2024-02-19T21:50:10.273377+0000","last_clean":"2024-02-19T21:50:10.273377+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:50:10.273377+0000","last_undegraded":"2024-02-19T21:50:10.273377+0000","last_fullsized":"2024-02-19T21:50:10.273377+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:45:57.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:57.877856+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":621,"reported_epoch":421,"state":"active+clean","last_fresh":"2024-02-19T21:50:11.547447+0000","last_change":"2024-02-19T21:49:01.011149+0000","last_active":"2024-02-19T21:50:11.547447+0000","last_peered":"2024-02-19T21:50:11.547447+0000","last_clean":"2024-02-19T21:50:11.547447+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:50:11.547447+0000","last_undegraded":"2024-02-19T21:50:11.547447+0000","last_fullsized":"2024-02-19T21:50:11.547447+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:49:01.011078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:49:01.011078+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.a","version":"421'4382","reported_seq":4426,"reported_epoch":421,"state":"active+clean","last_fresh":"2024-02-19T21:50:15.107853+0000","last_change":"2024-02-19T21:48:47.778138+0000","last_active":"2024-02-19T21:50:15.107853+0000","last_peered":"2024-02-19T21:50:15.107853+0000","last_clean":"2024-02-19T21:50:15.107853+0000","last_became_active":"2024-02-19T21:48:47.777820+0000","last_became_peered":"2024-02-19T21:48:47.777820+0000","last_unstale":"2024-02-19T21:50:15.107853+0000","last_undegraded":"2024-02-19T21:50:15.107853+0000","last_fullsized":"2024-02-19T21:50:15.107853+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4382,"ondisk_log_size":4382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":287178752,"num_objects":4382,"num_object_clones":0,"num_object_copies":13146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4382,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4382,"num_write_kb":280448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":345,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.278304+0000","last_change":"2024-02-19T21:48:33.478821+0000","last_active":"2024-02-19T21:50:10.278304+0000","last_peered":"2024-02-19T21:50:10.278304+0000","last_clean":"2024-02-19T21:50:10.278304+0000","last_became_active":"2024-02-19T21:44:56.149476+0000","last_became_peered":"2024-02-19T21:44:56.149476+0000","last_unstale":"2024-02-19T21:50:10.278304+0000","last_undegraded":"2024-02-19T21:50:10.278304+0000","last_fullsized":"2024-02-19T21:50:10.278304+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:33.478715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:48:33.478715+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":405,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:08.540137+0000","last_change":"2024-02-19T21:46:41.834315+0000","last_active":"2024-02-19T21:50:08.540137+0000","last_peered":"2024-02-19T21:50:08.540137+0000","last_clean":"2024-02-19T21:50:08.540137+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:50:08.540137+0000","last_undegraded":"2024-02-19T21:50:08.540137+0000","last_fullsized":"2024-02-19T21:50:08.540137+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:41.834246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:46:41.834246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"397'46","reported_seq":811,"reported_epoch":421,"state":"active+clean","last_fresh":"2024-02-19T21:50:11.577656+0000","last_change":"2024-02-19T21:49:08.335296+0000","last_active":"2024-02-19T21:50:11.577656+0000","last_peered":"2024-02-19T21:50:11.577656+0000","last_clean":"2024-02-19T21:50:11.577656+0000","last_became_active":"2024-02-19T21:49:08.334527+0000","last_became_peered":"2024-02-19T21:49:08.334527+0000","last_unstale":"2024-02-19T21:50:11.577656+0000","last_undegraded":"2024-02-19T21:50:11.577656+0000","last_fullsized":"2024-02-19T21:50:11.577656+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'43","last_scrub_stamp":"2024-02-19T21:45:04.755444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.755444+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":392,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.271912+0000","last_change":"2024-02-19T21:46:45.252437+0000","last_active":"2024-02-19T21:50:10.271912+0000","last_peered":"2024-02-19T21:50:10.271912+0000","last_clean":"2024-02-19T21:50:10.271912+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:50:10.271912+0000","last_undegraded":"2024-02-19T21:50:10.271912+0000","last_fullsized":"2024-02-19T21:50:10.271912+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.252344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.252344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"419'4215","reported_seq":4268,"reported_epoch":420,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-02-19T21:50:10.284525+0000","last_change":"2024-02-19T21:49:55.766941+0000","last_active":"2024-02-19T21:50:10.284525+0000","last_peered":"2024-02-19T21:50:10.284525+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:55.752599+0000","last_became_peered":"2024-02-19T21:49:55.752599+0000","last_unstale":"2024-02-19T21:50:10.284525+0000","last_undegraded":"2024-02-19T21:49:55.655049+0000","last_fullsized":"2024-02-19T21:49:55.470938+0000","mapping_epoch":414,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4215,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":276234240,"num_objects":4215,"num_object_clones":0,"num_object_copies":12645,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4215,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4215,"num_write_kb":269760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2],"avail_no_missing":["5","4"],"object_location_counts":[{"shards":"2,4,5","objects":2876},{"shards":"2,5","objects":182},{"shards":"4,5","objects":1157}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":420,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.303113+0000","last_change":"2024-02-19T21:49:09.227437+0000","last_active":"2024-02-19T21:50:10.303113+0000","last_peered":"2024-02-19T21:50:10.303113+0000","last_clean":"2024-02-19T21:50:10.303113+0000","last_became_active":"2024-02-19T21:49:08.328437+0000","last_became_peered":"2024-02-19T21:49:08.328437+0000","last_unstale":"2024-02-19T21:50:10.303113+0000","last_undegraded":"2024-02-19T21:50:10.303113+0000","last_fullsized":"2024-02-19T21:50:10.303113+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.227355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.227355+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'6","reported_seq":1504,"reported_epoch":421,"state":"active+clean","last_fresh":"2024-02-19T21:50:13.519806+0000","last_change":"2024-02-19T21:49:51.604278+0000","last_active":"2024-02-19T21:50:13.519806+0000","last_peered":"2024-02-19T21:50:13.519806+0000","last_clean":"2024-02-19T21:50:13.519806+0000","last_became_active":"2024-02-19T21:49:08.331108+0000","last_became_peered":"2024-02-19T21:49:08.331108+0000","last_unstale":"2024-02-19T21:50:13.519806+0000","last_undegraded":"2024-02-19T21:50:13.519806+0000","last_fullsized":"2024-02-19T21:50:13.519806+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_clean_scrub_stamp":"2024-02-19T21:44:13.678341+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1051,"num_read_kb":1046,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:08.526253+0000","last_change":"2024-02-19T21:49:08.329710+0000","last_active":"2024-02-19T21:50:08.526253+0000","last_peered":"2024-02-19T21:50:08.526253+0000","last_clean":"2024-02-19T21:50:08.526253+0000","last_became_active":"2024-02-19T21:49:08.329378+0000","last_became_peered":"2024-02-19T21:49:08.329378+0000","last_unstale":"2024-02-19T21:50:08.526253+0000","last_undegraded":"2024-02-19T21:50:08.526253+0000","last_fullsized":"2024-02-19T21:50:08.526253+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:55.195394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.195394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"200'17","reported_seq":453,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.273678+0000","last_change":"2024-02-19T21:48:14.878933+0000","last_active":"2024-02-19T21:50:10.273678+0000","last_peered":"2024-02-19T21:50:10.273678+0000","last_clean":"2024-02-19T21:50:10.273678+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:50:10.273678+0000","last_undegraded":"2024-02-19T21:50:10.273678+0000","last_fullsized":"2024-02-19T21:50:10.273678+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'17","last_scrub_stamp":"2024-02-19T21:48:14.878857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.878857+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":25,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":48,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:08.525719+0000","last_change":"2024-02-19T21:49:08.325478+0000","last_active":"2024-02-19T21:50:08.525719+0000","last_peered":"2024-02-19T21:50:08.525719+0000","last_clean":"2024-02-19T21:50:08.525719+0000","last_became_active":"2024-02-19T21:49:08.325127+0000","last_became_peered":"2024-02-19T21:49:08.325127+0000","last_unstale":"2024-02-19T21:50:08.525719+0000","last_undegraded":"2024-02-19T21:50:08.525719+0000","last_fullsized":"2024-02-19T21:50:08.525719+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:10.871111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:10.871111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"421'4418","reported_seq":4462,"reported_epoch":421,"state":"active+clean","last_fresh":"2024-02-19T21:50:14.794860+0000","last_change":"2024-02-19T21:48:47.778829+0000","last_active":"2024-02-19T21:50:14.794860+0000","last_peered":"2024-02-19T21:50:14.794860+0000","last_clean":"2024-02-19T21:50:14.794860+0000","last_became_active":"2024-02-19T21:48:47.778486+0000","last_became_peered":"2024-02-19T21:48:47.778486+0000","last_unstale":"2024-02-19T21:50:14.794860+0000","last_undegraded":"2024-02-19T21:50:14.794860+0000","last_fullsized":"2024-02-19T21:50:14.794860+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4418,"ondisk_log_size":4418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":289538048,"num_objects":4418,"num_object_clones":0,"num_object_copies":13254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4418,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4418,"num_write_kb":282752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":422,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:08.539612+0000","last_change":"2024-02-19T21:47:33.400407+0000","last_active":"2024-02-19T21:50:08.539612+0000","last_peered":"2024-02-19T21:50:08.539612+0000","last_clean":"2024-02-19T21:50:08.539612+0000","last_became_active":"2024-02-19T21:47:33.400075+0000","last_became_peered":"2024-02-19T21:47:33.400075+0000","last_unstale":"2024-02-19T21:50:08.539612+0000","last_undegraded":"2024-02-19T21:50:08.539612+0000","last_fullsized":"2024-02-19T21:50:08.539612+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.035136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":300,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:08.540228+0000","last_change":"2024-02-19T21:49:05.746443+0000","last_active":"2024-02-19T21:50:08.540228+0000","last_peered":"2024-02-19T21:50:08.540228+0000","last_clean":"2024-02-19T21:50:08.540228+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:50:08.540228+0000","last_undegraded":"2024-02-19T21:50:08.540228+0000","last_fullsized":"2024-02-19T21:50:08.540228+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.746358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.746358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":452,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:08.539664+0000","last_change":"2024-02-19T21:49:54.485252+0000","last_active":"2024-02-19T21:50:08.539664+0000","last_peered":"2024-02-19T21:50:08.539664+0000","last_clean":"2024-02-19T21:50:08.539664+0000","last_became_active":"2024-02-19T21:49:54.484956+0000","last_became_peered":"2024-02-19T21:49:54.484956+0000","last_unstale":"2024-02-19T21:50:08.539664+0000","last_undegraded":"2024-02-19T21:50:08.539664+0000","last_fullsized":"2024-02-19T21:50:08.539664+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:07.901205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:07.901205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.303545+0000","last_change":"2024-02-19T21:49:54.483990+0000","last_active":"2024-02-19T21:50:10.303545+0000","last_peered":"2024-02-19T21:50:10.303545+0000","last_clean":"2024-02-19T21:50:10.303545+0000","last_became_active":"2024-02-19T21:49:54.483637+0000","last_became_peered":"2024-02-19T21:49:54.483637+0000","last_unstale":"2024-02-19T21:50:10.303545+0000","last_undegraded":"2024-02-19T21:50:10.303545+0000","last_fullsized":"2024-02-19T21:50:10.303545+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.190177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.190177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"201'33","reported_seq":446,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.277041+0000","last_change":"2024-02-19T21:46:47.970066+0000","last_active":"2024-02-19T21:50:10.277041+0000","last_peered":"2024-02-19T21:50:10.277041+0000","last_clean":"2024-02-19T21:50:10.277041+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:50:10.277041+0000","last_undegraded":"2024-02-19T21:50:10.277041+0000","last_fullsized":"2024-02-19T21:50:10.277041+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'33","last_scrub_stamp":"2024-02-19T21:46:47.969961+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.969961+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":17,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.302646+0000","last_change":"2024-02-19T21:49:54.478276+0000","last_active":"2024-02-19T21:50:10.302646+0000","last_peered":"2024-02-19T21:50:10.302646+0000","last_clean":"2024-02-19T21:50:10.302646+0000","last_became_active":"2024-02-19T21:49:54.477947+0000","last_became_peered":"2024-02-19T21:49:54.477947+0000","last_unstale":"2024-02-19T21:50:10.302646+0000","last_undegraded":"2024-02-19T21:50:10.302646+0000","last_fullsized":"2024-02-19T21:50:10.302646+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:57.754453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:57.754453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"421'4248","reported_seq":6480,"reported_epoch":421,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-02-19T21:50:14.529443+0000","last_change":"2024-02-19T21:49:55.726256+0000","last_active":"2024-02-19T21:50:14.529443+0000","last_peered":"2024-02-19T21:50:14.529443+0000","last_clean":"2024-02-19T21:49:53.438055+0000","last_became_active":"2024-02-19T21:49:55.720894+0000","last_became_peered":"2024-02-19T21:49:55.720894+0000","last_unstale":"2024-02-19T21:50:14.529443+0000","last_undegraded":"2024-02-19T21:49:55.557499+0000","last_fullsized":"2024-02-19T21:49:55.472563+0000","mapping_epoch":414,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4248,"ondisk_log_size":4248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":278396928,"num_objects":4248,"num_object_clones":0,"num_object_copies":12744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3971,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4248,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4248,"num_write_kb":271872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1083,"num_bytes_recovered":70975488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7],"acting":[0,2],"avail_no_missing":["0","2","5"],"object_location_counts":[{"shards":"0,2","objects":277},{"shards":"0,2,5","objects":3971}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":394,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.274268+0000","last_change":"2024-02-19T21:45:47.723650+0000","last_active":"2024-02-19T21:50:10.274268+0000","last_peered":"2024-02-19T21:50:10.274268+0000","last_clean":"2024-02-19T21:50:10.274268+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:50:10.274268+0000","last_undegraded":"2024-02-19T21:50:10.274268+0000","last_fullsized":"2024-02-19T21:50:10.274268+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.723550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.723550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":405,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.271104+0000","last_change":"2024-02-19T21:45:51.243726+0000","last_active":"2024-02-19T21:50:10.271104+0000","last_peered":"2024-02-19T21:50:10.271104+0000","last_clean":"2024-02-19T21:50:10.271104+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:50:10.271104+0000","last_undegraded":"2024-02-19T21:50:10.271104+0000","last_fullsized":"2024-02-19T21:50:10.271104+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:51.243656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:51.243656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":422,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.303894+0000","last_change":"2024-02-19T21:48:23.218358+0000","last_active":"2024-02-19T21:50:10.303894+0000","last_peered":"2024-02-19T21:50:10.303894+0000","last_clean":"2024-02-19T21:50:10.303894+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:50:10.303894+0000","last_undegraded":"2024-02-19T21:50:10.303894+0000","last_fullsized":"2024-02-19T21:50:10.303894+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:23.218282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.218282+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"324'30","reported_seq":549,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.270877+0000","last_change":"2024-02-19T21:49:08.330490+0000","last_active":"2024-02-19T21:50:10.270877+0000","last_peered":"2024-02-19T21:50:10.270877+0000","last_clean":"2024-02-19T21:50:10.270877+0000","last_became_active":"2024-02-19T21:49:08.329761+0000","last_became_peered":"2024-02-19T21:49:08.329761+0000","last_unstale":"2024-02-19T21:50:10.270877+0000","last_undegraded":"2024-02-19T21:50:10.270877+0000","last_fullsized":"2024-02-19T21:50:10.270877+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'30","last_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_deep_scrub":"324'30","last_deep_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.110965+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":406,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:08.539548+0000","last_change":"2024-02-19T21:45:09.918263+0000","last_active":"2024-02-19T21:50:08.539548+0000","last_peered":"2024-02-19T21:50:08.539548+0000","last_clean":"2024-02-19T21:50:08.539548+0000","last_became_active":"2024-02-19T21:44:42.624782+0000","last_became_peered":"2024-02-19T21:44:42.624782+0000","last_unstale":"2024-02-19T21:50:08.539548+0000","last_undegraded":"2024-02-19T21:50:08.539548+0000","last_fullsized":"2024-02-19T21:50:08.539548+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":295,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_clean_scrub_stamp":"2024-02-19T21:45:09.918170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"421'4299","reported_seq":4343,"reported_epoch":421,"state":"active+clean","last_fresh":"2024-02-19T21:50:14.862079+0000","last_change":"2024-02-19T21:48:47.777963+0000","last_active":"2024-02-19T21:50:14.862079+0000","last_peered":"2024-02-19T21:50:14.862079+0000","last_clean":"2024-02-19T21:50:14.862079+0000","last_became_active":"2024-02-19T21:48:47.777644+0000","last_became_peered":"2024-02-19T21:48:47.777644+0000","last_unstale":"2024-02-19T21:50:14.862079+0000","last_undegraded":"2024-02-19T21:50:14.862079+0000","last_fullsized":"2024-02-19T21:50:14.862079+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4299,"ondisk_log_size":4299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":281739264,"num_objects":4299,"num_object_clones":0,"num_object_copies":12897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4299,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4299,"num_write_kb":275136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":427,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.273130+0000","last_change":"2024-02-19T21:49:08.331080+0000","last_active":"2024-02-19T21:50:10.273130+0000","last_peered":"2024-02-19T21:50:10.273130+0000","last_clean":"2024-02-19T21:50:10.273130+0000","last_became_active":"2024-02-19T21:49:08.330648+0000","last_became_peered":"2024-02-19T21:49:08.330648+0000","last_unstale":"2024-02-19T21:50:10.273130+0000","last_undegraded":"2024-02-19T21:50:10.273130+0000","last_fullsized":"2024-02-19T21:50:10.273130+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:55.803876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:44:55.803876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":398,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.303191+0000","last_change":"2024-02-19T21:48:31.320229+0000","last_active":"2024-02-19T21:50:10.303191+0000","last_peered":"2024-02-19T21:50:10.303191+0000","last_clean":"2024-02-19T21:50:10.303191+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:50:10.303191+0000","last_undegraded":"2024-02-19T21:50:10.303191+0000","last_fullsized":"2024-02-19T21:50:10.303191+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:31.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:45.017696+0000","last_clean_scrub_stamp":"2024-02-19T21:48:31.320133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"201'37","reported_seq":453,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.271604+0000","last_change":"2024-02-19T21:45:14.173212+0000","last_active":"2024-02-19T21:50:10.271604+0000","last_peered":"2024-02-19T21:50:10.271604+0000","last_clean":"2024-02-19T21:50:10.271604+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:50:10.271604+0000","last_undegraded":"2024-02-19T21:50:10.271604+0000","last_fullsized":"2024-02-19T21:50:10.271604+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'37","last_scrub_stamp":"2024-02-19T21:45:14.173134+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:45:14.173134+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":397,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.276060+0000","last_change":"2024-02-19T21:46:48.988928+0000","last_active":"2024-02-19T21:50:10.276060+0000","last_peered":"2024-02-19T21:50:10.276060+0000","last_clean":"2024-02-19T21:50:10.276060+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:50:10.276060+0000","last_undegraded":"2024-02-19T21:50:10.276060+0000","last_fullsized":"2024-02-19T21:50:10.276060+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:48.988836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.988836+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.e","version":"421'4250","reported_seq":5824,"reported_epoch":421,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:50:15.176983+0000","last_change":"2024-02-19T21:49:09.775842+0000","last_active":"2024-02-19T21:50:15.176983+0000","last_peered":"2024-02-19T21:50:15.176983+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:09.764242+0000","last_became_peered":"2024-02-19T21:49:09.764242+0000","last_unstale":"2024-02-19T21:50:15.176983+0000","last_undegraded":"2024-02-19T21:49:09.321602+0000","last_fullsized":"2024-02-19T21:49:09.313871+0000","mapping_epoch":395,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4250,"ondisk_log_size":4250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":278528000,"num_objects":4250,"num_object_clones":0,"num_object_copies":12750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":273,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4250,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4250,"num_write_kb":272000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":762,"num_bytes_recovered":49938432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[{"shards":"4,6","objects":3977}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":140,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.275149+0000","last_change":"2024-02-19T21:49:08.326461+0000","last_active":"2024-02-19T21:50:10.275149+0000","last_peered":"2024-02-19T21:50:10.275149+0000","last_clean":"2024-02-19T21:50:10.275149+0000","last_became_active":"2024-02-19T21:49:08.326106+0000","last_became_peered":"2024-02-19T21:49:08.326106+0000","last_unstale":"2024-02-19T21:50:10.275149+0000","last_undegraded":"2024-02-19T21:50:10.275149+0000","last_fullsized":"2024-02-19T21:50:10.275149+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.080896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.080896+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":400,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.273500+0000","last_change":"2024-02-19T21:48:11.879787+0000","last_active":"2024-02-19T21:50:10.273500+0000","last_peered":"2024-02-19T21:50:10.273500+0000","last_clean":"2024-02-19T21:50:10.273500+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:50:10.273500+0000","last_undegraded":"2024-02-19T21:50:10.273500+0000","last_fullsized":"2024-02-19T21:50:10.273500+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.879687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.879687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"201'38","reported_seq":35,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.304071+0000","last_change":"2024-02-19T21:49:55.861358+0000","last_active":"2024-02-19T21:50:10.304071+0000","last_peered":"2024-02-19T21:50:10.304071+0000","last_clean":"2024-02-19T21:50:10.304071+0000","last_became_active":"2024-02-19T21:49:54.480413+0000","last_became_peered":"2024-02-19T21:49:54.480413+0000","last_unstale":"2024-02-19T21:50:10.304071+0000","last_undegraded":"2024-02-19T21:50:10.304071+0000","last_fullsized":"2024-02-19T21:50:10.304071+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":415,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'38","last_scrub_stamp":"2024-02-19T21:49:05.923627+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.923627+0000","log_size":38,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":293,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.275434+0000","last_change":"2024-02-19T21:49:54.495134+0000","last_active":"2024-02-19T21:50:10.275434+0000","last_peered":"2024-02-19T21:50:10.275434+0000","last_clean":"2024-02-19T21:50:10.275434+0000","last_became_active":"2024-02-19T21:49:54.494802+0000","last_became_peered":"2024-02-19T21:49:54.494802+0000","last_unstale":"2024-02-19T21:50:10.275434+0000","last_undegraded":"2024-02-19T21:50:10.275434+0000","last_fullsized":"2024-02-19T21:50:10.275434+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:10.578408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:10.578408+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.f","version":"421'4430","reported_seq":5952,"reported_epoch":421,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:50:15.100941+0000","last_change":"2024-02-19T21:49:09.782040+0000","last_active":"2024-02-19T21:50:15.100941+0000","last_peered":"2024-02-19T21:50:15.100941+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:09.769552+0000","last_became_peered":"2024-02-19T21:49:09.769552+0000","last_unstale":"2024-02-19T21:50:15.100941+0000","last_undegraded":"2024-02-19T21:49:09.324587+0000","last_fullsized":"2024-02-19T21:49:09.319762+0000","mapping_epoch":395,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4430,"ondisk_log_size":4430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":290324480,"num_objects":4430,"num_object_clones":0,"num_object_copies":13290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":411,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4430,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4430,"num_write_kb":283520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":736,"num_bytes_recovered":48234496,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[{"shards":"4,6","objects":4019}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":427,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.304507+0000","last_change":"2024-02-19T21:49:08.328862+0000","last_active":"2024-02-19T21:50:10.304507+0000","last_peered":"2024-02-19T21:50:10.304507+0000","last_clean":"2024-02-19T21:50:10.304507+0000","last_became_active":"2024-02-19T21:49:08.328529+0000","last_became_peered":"2024-02-19T21:49:08.328529+0000","last_unstale":"2024-02-19T21:50:10.304507+0000","last_undegraded":"2024-02-19T21:50:10.304507+0000","last_fullsized":"2024-02-19T21:50:10.304507+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:49.110117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:49.110117+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":460,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.276758+0000","last_change":"2024-02-19T21:49:54.493367+0000","last_active":"2024-02-19T21:50:10.276758+0000","last_peered":"2024-02-19T21:50:10.276758+0000","last_clean":"2024-02-19T21:50:10.276758+0000","last_became_active":"2024-02-19T21:49:54.493041+0000","last_became_peered":"2024-02-19T21:49:54.493041+0000","last_unstale":"2024-02-19T21:50:10.276758+0000","last_undegraded":"2024-02-19T21:50:10.276758+0000","last_fullsized":"2024-02-19T21:50:10.276758+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.972369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.972369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"201'28","reported_seq":267,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.274319+0000","last_change":"2024-02-19T21:49:08.330818+0000","last_active":"2024-02-19T21:50:10.274319+0000","last_peered":"2024-02-19T21:50:10.274319+0000","last_clean":"2024-02-19T21:50:10.274319+0000","last_became_active":"2024-02-19T21:49:08.330477+0000","last_became_peered":"2024-02-19T21:49:08.330477+0000","last_unstale":"2024-02-19T21:50:10.274319+0000","last_undegraded":"2024-02-19T21:50:10.274319+0000","last_fullsized":"2024-02-19T21:50:10.274319+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'28","last_scrub_stamp":"2024-02-19T21:45:55.998646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.998646+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":40,"num_read_kb":33,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":470,"reported_epoch":421,"state":"active+clean","last_fresh":"2024-02-19T21:50:11.576381+0000","last_change":"2024-02-19T21:45:50.742626+0000","last_active":"2024-02-19T21:50:11.576381+0000","last_peered":"2024-02-19T21:50:11.576381+0000","last_clean":"2024-02-19T21:50:11.576381+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:50:11.576381+0000","last_undegraded":"2024-02-19T21:50:11.576381+0000","last_fullsized":"2024-02-19T21:50:11.576381+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'9","last_scrub_stamp":"2024-02-19T21:45:50.742526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:50.742526+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"421'4240","reported_seq":4284,"reported_epoch":421,"state":"active+clean","last_fresh":"2024-02-19T21:50:14.868602+0000","last_change":"2024-02-19T21:48:47.779506+0000","last_active":"2024-02-19T21:50:14.868602+0000","last_peered":"2024-02-19T21:50:14.868602+0000","last_clean":"2024-02-19T21:50:14.868602+0000","last_became_active":"2024-02-19T21:48:47.778325+0000","last_became_peered":"2024-02-19T21:48:47.778325+0000","last_unstale":"2024-02-19T21:50:14.868602+0000","last_undegraded":"2024-02-19T21:50:14.868602+0000","last_fullsized":"2024-02-19T21:50:14.868602+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4240,"ondisk_log_size":4240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":277872640,"num_objects":4240,"num_object_clones":0,"num_object_copies":12720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4240,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4240,"num_write_kb":271360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"66'1","reported_seq":311,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.275791+0000","last_change":"2024-02-19T21:48:12.568842+0000","last_active":"2024-02-19T21:50:10.275791+0000","last_peered":"2024-02-19T21:50:10.275791+0000","last_clean":"2024-02-19T21:50:10.275791+0000","last_became_active":"2024-02-19T21:44:56.166670+0000","last_became_peered":"2024-02-19T21:44:56.166670+0000","last_unstale":"2024-02-19T21:50:10.275791+0000","last_undegraded":"2024-02-19T21:50:10.275791+0000","last_fullsized":"2024-02-19T21:50:10.275791+0000","mapping_epoch":165,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:12.568734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.568734+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"261'11","reported_seq":479,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:08.539495+0000","last_change":"2024-02-19T21:45:01.716882+0000","last_active":"2024-02-19T21:50:08.539495+0000","last_peered":"2024-02-19T21:50:08.539495+0000","last_clean":"2024-02-19T21:50:08.539495+0000","last_became_active":"2024-02-19T21:44:08.123392+0000","last_became_peered":"2024-02-19T21:44:08.123392+0000","last_unstale":"2024-02-19T21:50:08.539495+0000","last_undegraded":"2024-02-19T21:50:08.539495+0000","last_fullsized":"2024-02-19T21:50:08.539495+0000","mapping_epoch":62,"log_start":"257'10","ondisk_log_start":"257'10","created":62,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-02-19T21:45:01.716817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.716817+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":409,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.303980+0000","last_change":"2024-02-19T21:48:19.186455+0000","last_active":"2024-02-19T21:50:10.303980+0000","last_peered":"2024-02-19T21:50:10.303980+0000","last_clean":"2024-02-19T21:50:10.303980+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:50:10.303980+0000","last_undegraded":"2024-02-19T21:50:10.303980+0000","last_fullsized":"2024-02-19T21:50:10.303980+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:48:19.186359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:19.186359+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"201'19","reported_seq":267,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.277637+0000","last_change":"2024-02-19T21:48:34.485865+0000","last_active":"2024-02-19T21:50:10.277637+0000","last_peered":"2024-02-19T21:50:10.277637+0000","last_clean":"2024-02-19T21:50:10.277637+0000","last_became_active":"2024-02-19T21:47:46.251550+0000","last_became_peered":"2024-02-19T21:47:46.251550+0000","last_unstale":"2024-02-19T21:50:10.277637+0000","last_undegraded":"2024-02-19T21:50:10.277637+0000","last_fullsized":"2024-02-19T21:50:10.277637+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:34.485787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:34.485787+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":23,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7],"acting":[4,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1","version":"421'4313","reported_seq":4357,"reported_epoch":421,"state":"active+clean","last_fresh":"2024-02-19T21:50:15.196302+0000","last_change":"2024-02-19T21:48:47.772467+0000","last_active":"2024-02-19T21:50:15.196302+0000","last_peered":"2024-02-19T21:50:15.196302+0000","last_clean":"2024-02-19T21:50:15.196302+0000","last_became_active":"2024-02-19T21:48:47.772154+0000","last_became_peered":"2024-02-19T21:48:47.772154+0000","last_unstale":"2024-02-19T21:50:15.196302+0000","last_undegraded":"2024-02-19T21:50:15.196302+0000","last_fullsized":"2024-02-19T21:50:15.196302+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4313,"ondisk_log_size":4313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":282656768,"num_objects":4313,"num_object_clones":0,"num_object_copies":12939,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4313,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4313,"num_write_kb":276032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":415,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:08.538812+0000","last_change":"2024-02-19T21:46:01.031458+0000","last_active":"2024-02-19T21:50:08.538812+0000","last_peered":"2024-02-19T21:50:08.538812+0000","last_clean":"2024-02-19T21:50:08.538812+0000","last_became_active":"2024-02-19T21:44:56.155194+0000","last_became_peered":"2024-02-19T21:44:56.155194+0000","last_unstale":"2024-02-19T21:50:08.538812+0000","last_undegraded":"2024-02-19T21:50:08.538812+0000","last_fullsized":"2024-02-19T21:50:08.538812+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.031344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.031344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"363'12","reported_seq":193,"reported_epoch":421,"state":"active+clean","last_fresh":"2024-02-19T21:50:11.547040+0000","last_change":"2024-02-19T21:48:25.487689+0000","last_active":"2024-02-19T21:50:11.547040+0000","last_peered":"2024-02-19T21:50:11.547040+0000","last_clean":"2024-02-19T21:50:11.547040+0000","last_became_active":"2024-02-19T21:47:46.260099+0000","last_became_peered":"2024-02-19T21:47:46.260099+0000","last_unstale":"2024-02-19T21:50:11.547040+0000","last_undegraded":"2024-02-19T21:50:11.547040+0000","last_fullsized":"2024-02-19T21:50:11.547040+0000","mapping_epoch":362,"log_start":"98'9","ondisk_log_start":"98'9","created":62,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"363'12","last_scrub_stamp":"2024-02-19T21:48:25.487608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.487608+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":420,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.273057+0000","last_change":"2024-02-19T21:49:08.335163+0000","last_active":"2024-02-19T21:50:10.273057+0000","last_peered":"2024-02-19T21:50:10.273057+0000","last_clean":"2024-02-19T21:50:10.273057+0000","last_became_active":"2024-02-19T21:49:08.334842+0000","last_became_peered":"2024-02-19T21:49:08.334842+0000","last_unstale":"2024-02-19T21:50:10.273057+0000","last_undegraded":"2024-02-19T21:50:10.273057+0000","last_fullsized":"2024-02-19T21:50:10.273057+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.700887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.700887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"270'34","reported_seq":339,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:08.539324+0000","last_change":"2024-02-19T21:47:34.894164+0000","last_active":"2024-02-19T21:50:08.539324+0000","last_peered":"2024-02-19T21:50:08.539324+0000","last_clean":"2024-02-19T21:50:08.539324+0000","last_became_active":"2024-02-19T21:47:33.400012+0000","last_became_peered":"2024-02-19T21:47:33.400012+0000","last_unstale":"2024-02-19T21:50:08.539324+0000","last_undegraded":"2024-02-19T21:50:08.539324+0000","last_fullsized":"2024-02-19T21:50:08.539324+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":357,"parent":"0.0","parent_split_bits":0,"last_scrub":"270'34","last_scrub_stamp":"2024-02-19T21:46:44.789309+0000","last_deep_scrub":"270'34","last_deep_scrub_stamp":"2024-02-19T21:44:17.451151+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.789309+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2","version":"421'4383","reported_seq":4427,"reported_epoch":421,"state":"active+clean","last_fresh":"2024-02-19T21:50:15.117415+0000","last_change":"2024-02-19T21:48:47.771305+0000","last_active":"2024-02-19T21:50:15.117415+0000","last_peered":"2024-02-19T21:50:15.117415+0000","last_clean":"2024-02-19T21:50:15.117415+0000","last_became_active":"2024-02-19T21:48:47.771000+0000","last_became_peered":"2024-02-19T21:48:47.771000+0000","last_unstale":"2024-02-19T21:50:15.117415+0000","last_undegraded":"2024-02-19T21:50:15.117415+0000","last_fullsized":"2024-02-19T21:50:15.117415+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4383,"ondisk_log_size":4383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":287244288,"num_objects":4383,"num_object_clones":0,"num_object_copies":13149,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4383,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4383,"num_write_kb":280512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":398,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.278211+0000","last_change":"2024-02-19T21:49:08.329023+0000","last_active":"2024-02-19T21:50:10.278211+0000","last_peered":"2024-02-19T21:50:10.278211+0000","last_clean":"2024-02-19T21:50:10.278211+0000","last_became_active":"2024-02-19T21:49:08.328697+0000","last_became_peered":"2024-02-19T21:49:08.328697+0000","last_unstale":"2024-02-19T21:50:10.278211+0000","last_undegraded":"2024-02-19T21:50:10.278211+0000","last_fullsized":"2024-02-19T21:50:10.278211+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.939414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.939414+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"397'17","reported_seq":320,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:08.557536+0000","last_change":"2024-02-19T21:49:08.325927+0000","last_active":"2024-02-19T21:50:08.557536+0000","last_peered":"2024-02-19T21:50:08.557536+0000","last_clean":"2024-02-19T21:50:08.557536+0000","last_became_active":"2024-02-19T21:49:08.325034+0000","last_became_peered":"2024-02-19T21:49:08.325034+0000","last_unstale":"2024-02-19T21:50:08.557536+0000","last_undegraded":"2024-02-19T21:50:08.557536+0000","last_fullsized":"2024-02-19T21:50:08.557536+0000","mapping_epoch":394,"log_start":"170'11","ondisk_log_start":"170'11","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"271'13","last_scrub_stamp":"2024-02-19T21:46:47.072988+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.072988+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":410,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.273283+0000","last_change":"2024-02-19T21:49:03.987847+0000","last_active":"2024-02-19T21:50:10.273283+0000","last_peered":"2024-02-19T21:50:10.273283+0000","last_clean":"2024-02-19T21:50:10.273283+0000","last_became_active":"2024-02-19T21:47:33.395485+0000","last_became_peered":"2024-02-19T21:47:33.395485+0000","last_unstale":"2024-02-19T21:50:10.273283+0000","last_undegraded":"2024-02-19T21:50:10.273283+0000","last_fullsized":"2024-02-19T21:50:10.273283+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:03.987749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:49:03.987749+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,5],"acting":[1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"200'20","reported_seq":244,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.274305+0000","last_change":"2024-02-19T21:48:12.628796+0000","last_active":"2024-02-19T21:50:10.274305+0000","last_peered":"2024-02-19T21:50:10.274305+0000","last_clean":"2024-02-19T21:50:10.274305+0000","last_became_active":"2024-02-19T21:47:46.251725+0000","last_became_peered":"2024-02-19T21:47:46.251725+0000","last_unstale":"2024-02-19T21:50:10.274305+0000","last_undegraded":"2024-02-19T21:50:10.274305+0000","last_fullsized":"2024-02-19T21:50:10.274305+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'20","last_scrub_stamp":"2024-02-19T21:48:12.628700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.628700+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3","version":"421'4332","reported_seq":5770,"reported_epoch":421,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:50:15.160930+0000","last_change":"2024-02-19T21:49:15.423646+0000","last_active":"2024-02-19T21:50:15.160930+0000","last_peered":"2024-02-19T21:50:15.160930+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:09.769892+0000","last_became_peered":"2024-02-19T21:49:09.769892+0000","last_unstale":"2024-02-19T21:50:15.160930+0000","last_undegraded":"2024-02-19T21:49:09.318624+0000","last_fullsized":"2024-02-19T21:49:09.312732+0000","mapping_epoch":395,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4332,"ondisk_log_size":4332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":283901952,"num_objects":4332,"num_object_clones":0,"num_object_copies":12996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":401,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4332,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4332,"num_write_kb":277248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":696,"num_bytes_recovered":45613056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[{"shards":"4,5","objects":3931}],"blocked_by":[],"up_primary":2,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":48,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:08.524936+0000","last_change":"2024-02-19T21:49:08.327495+0000","last_active":"2024-02-19T21:50:08.524936+0000","last_peered":"2024-02-19T21:50:08.524936+0000","last_clean":"2024-02-19T21:50:08.524936+0000","last_became_active":"2024-02-19T21:49:08.327172+0000","last_became_peered":"2024-02-19T21:49:08.327172+0000","last_unstale":"2024-02-19T21:50:08.524936+0000","last_undegraded":"2024-02-19T21:50:08.524936+0000","last_fullsized":"2024-02-19T21:50:08.524936+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.241319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.241319+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,6],"acting":[2,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":405,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.274224+0000","last_change":"2024-02-19T21:45:01.798485+0000","last_active":"2024-02-19T21:50:10.274224+0000","last_peered":"2024-02-19T21:50:10.274224+0000","last_clean":"2024-02-19T21:50:10.274224+0000","last_became_active":"2024-02-19T21:44:22.245925+0000","last_became_peered":"2024-02-19T21:44:22.245925+0000","last_unstale":"2024-02-19T21:50:10.274224+0000","last_undegraded":"2024-02-19T21:50:10.274224+0000","last_fullsized":"2024-02-19T21:50:10.274224+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:01.798387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.798387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":405,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.304359+0000","last_change":"2024-02-19T21:48:30.277397+0000","last_active":"2024-02-19T21:50:10.304359+0000","last_peered":"2024-02-19T21:50:10.304359+0000","last_clean":"2024-02-19T21:50:10.304359+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:50:10.304359+0000","last_undegraded":"2024-02-19T21:50:10.304359+0000","last_fullsized":"2024-02-19T21:50:10.304359+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.277322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.277322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"337'39","reported_seq":353,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.277591+0000","last_change":"2024-02-19T21:49:08.326007+0000","last_active":"2024-02-19T21:50:10.277591+0000","last_peered":"2024-02-19T21:50:10.277591+0000","last_clean":"2024-02-19T21:50:10.277591+0000","last_became_active":"2024-02-19T21:49:08.325683+0000","last_became_peered":"2024-02-19T21:49:08.325683+0000","last_unstale":"2024-02-19T21:50:10.277591+0000","last_undegraded":"2024-02-19T21:50:10.277591+0000","last_fullsized":"2024-02-19T21:50:10.277591+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'39","last_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_deep_scrub":"337'39","last_deep_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.923809+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":49,"num_read_kb":39,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"421'4410","reported_seq":4454,"reported_epoch":421,"state":"active+clean","last_fresh":"2024-02-19T21:50:14.775967+0000","last_change":"2024-02-19T21:48:47.776672+0000","last_active":"2024-02-19T21:50:14.775967+0000","last_peered":"2024-02-19T21:50:14.775967+0000","last_clean":"2024-02-19T21:50:14.775967+0000","last_became_active":"2024-02-19T21:48:47.776368+0000","last_became_peered":"2024-02-19T21:48:47.776368+0000","last_unstale":"2024-02-19T21:50:14.775967+0000","last_undegraded":"2024-02-19T21:50:14.775967+0000","last_fullsized":"2024-02-19T21:50:14.775967+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4410,"ondisk_log_size":4410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":289013760,"num_objects":4410,"num_object_clones":0,"num_object_copies":13230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4410,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4410,"num_write_kb":282240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"66'1","reported_seq":227,"reported_epoch":420,"state":"active+remapped+backfill_toofull","last_fresh":"2024-02-19T21:50:10.271642+0000","last_change":"2024-02-19T21:49:55.717652+0000","last_active":"2024-02-19T21:50:10.271642+0000","last_peered":"2024-02-19T21:50:10.271642+0000","last_clean":"2024-02-19T21:47:34.392763+0000","last_became_active":"2024-02-19T21:49:55.708866+0000","last_became_peered":"2024-02-19T21:49:55.708866+0000","last_unstale":"2024-02-19T21:50:10.271642+0000","last_undegraded":"2024-02-19T21:50:10.271642+0000","last_fullsized":"2024-02-19T21:50:10.271642+0000","mapping_epoch":414,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:46:43.773486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:46:43.773486+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[0,2,6],"avail_no_missing":["0","2","6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":48,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:08.525156+0000","last_change":"2024-02-19T21:49:08.326583+0000","last_active":"2024-02-19T21:50:08.525156+0000","last_peered":"2024-02-19T21:50:08.525156+0000","last_clean":"2024-02-19T21:50:08.525156+0000","last_became_active":"2024-02-19T21:49:08.324835+0000","last_became_peered":"2024-02-19T21:49:08.324835+0000","last_unstale":"2024-02-19T21:50:08.525156+0000","last_undegraded":"2024-02-19T21:50:08.525156+0000","last_fullsized":"2024-02-19T21:50:08.525156+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.163825+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":105,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.275468+0000","last_change":"2024-02-19T21:49:08.327553+0000","last_active":"2024-02-19T21:50:10.275468+0000","last_peered":"2024-02-19T21:50:10.275468+0000","last_clean":"2024-02-19T21:50:10.275468+0000","last_became_active":"2024-02-19T21:49:08.327186+0000","last_became_peered":"2024-02-19T21:49:08.327186+0000","last_unstale":"2024-02-19T21:50:10.275468+0000","last_undegraded":"2024-02-19T21:50:10.275468+0000","last_fullsized":"2024-02-19T21:50:10.275468+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:45:00.748244+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:45:00.748244+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"201'44","reported_seq":526,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.275914+0000","last_change":"2024-02-19T21:49:55.281324+0000","last_active":"2024-02-19T21:50:10.275914+0000","last_peered":"2024-02-19T21:50:10.275914+0000","last_clean":"2024-02-19T21:50:10.275914+0000","last_became_active":"2024-02-19T21:49:54.493167+0000","last_became_peered":"2024-02-19T21:49:54.493167+0000","last_unstale":"2024-02-19T21:50:10.275914+0000","last_undegraded":"2024-02-19T21:50:10.275914+0000","last_fullsized":"2024-02-19T21:50:10.275914+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'44","last_scrub_stamp":"2024-02-19T21:48:32.489084+0000","last_deep_scrub":"201'44","last_deep_scrub_stamp":"2024-02-19T21:44:16.255049+0000","last_clean_scrub_stamp":"2024-02-19T21:48:32.489084+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.5","version":"420'4286","reported_seq":4341,"reported_epoch":420,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:50:11.422644+0000","last_change":"2024-02-19T21:50:03.887248+0000","last_active":"2024-02-19T21:50:11.422644+0000","last_peered":"2024-02-19T21:50:11.422644+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:50:03.654321+0000","last_became_peered":"2024-02-19T21:50:03.654321+0000","last_unstale":"2024-02-19T21:50:11.422644+0000","last_undegraded":"2024-02-19T21:50:01.398577+0000","last_fullsized":"2024-02-19T21:49:55.473278+0000","mapping_epoch":414,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4286,"ondisk_log_size":4286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":280887296,"num_objects":4286,"num_object_clones":0,"num_object_copies":12858,"num_objects_missing_on_primary":1154,"num_objects_missing":1154,"num_objects_degraded":1154,"num_objects_misplaced":4120,"num_objects_unfound":0,"num_objects_dirty":4286,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4286,"num_write_kb":274304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0],"avail_no_missing":["0","5"],"object_location_counts":[{"shards":"0,2","objects":166},{"shards":"0,2,5","objects":2966},{"shards":"0,5","objects":1154}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":450,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.271326+0000","last_change":"2024-02-19T21:49:08.328667+0000","last_active":"2024-02-19T21:50:10.271326+0000","last_peered":"2024-02-19T21:50:10.271326+0000","last_clean":"2024-02-19T21:50:10.271326+0000","last_became_active":"2024-02-19T21:49:08.328287+0000","last_became_peered":"2024-02-19T21:49:08.328287+0000","last_unstale":"2024-02-19T21:50:10.271326+0000","last_undegraded":"2024-02-19T21:50:10.271326+0000","last_fullsized":"2024-02-19T21:50:10.271326+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.176542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.176542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":48,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:08.524676+0000","last_change":"2024-02-19T21:49:08.332637+0000","last_active":"2024-02-19T21:50:08.524676+0000","last_peered":"2024-02-19T21:50:08.524676+0000","last_clean":"2024-02-19T21:50:08.524676+0000","last_became_active":"2024-02-19T21:49:08.331451+0000","last_became_peered":"2024-02-19T21:49:08.331451+0000","last_unstale":"2024-02-19T21:50:08.524676+0000","last_undegraded":"2024-02-19T21:50:08.524676+0000","last_fullsized":"2024-02-19T21:50:08.524676+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.123413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.547129+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.123413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":420,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.273841+0000","last_change":"2024-02-19T21:49:08.331159+0000","last_active":"2024-02-19T21:50:10.273841+0000","last_peered":"2024-02-19T21:50:10.273841+0000","last_clean":"2024-02-19T21:50:10.273841+0000","last_became_active":"2024-02-19T21:49:08.330804+0000","last_became_peered":"2024-02-19T21:49:08.330804+0000","last_unstale":"2024-02-19T21:50:10.273841+0000","last_undegraded":"2024-02-19T21:50:10.273841+0000","last_fullsized":"2024-02-19T21:50:10.273841+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.978015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.978015+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"377'19","reported_seq":428,"reported_epoch":420,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.271745+0000","last_change":"2024-02-19T21:48:23.326608+0000","last_active":"2024-02-19T21:50:10.271745+0000","last_peered":"2024-02-19T21:50:10.271745+0000","last_clean":"2024-02-19T21:50:10.271745+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:50:10.271745+0000","last_undegraded":"2024-02-19T21:50:10.271745+0000","last_fullsized":"2024-02-19T21:50:10.271745+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"377'19","last_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_deep_scrub":"377'19","last_deep_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.326541+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"419'4254","reported_seq":4296,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:10.230401+0000","last_change":"2024-02-19T21:48:47.780368+0000","last_active":"2024-02-19T21:50:10.230401+0000","last_peered":"2024-02-19T21:50:10.230401+0000","last_clean":"2024-02-19T21:50:10.230401+0000","last_became_active":"2024-02-19T21:48:47.780046+0000","last_became_peered":"2024-02-19T21:48:47.780046+0000","last_unstale":"2024-02-19T21:50:10.230401+0000","last_undegraded":"2024-02-19T21:50:10.230401+0000","last_fullsized":"2024-02-19T21:50:10.230401+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4254,"ondisk_log_size":4254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":278790144,"num_objects":4254,"num_object_clones":0,"num_object_copies":12762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4254,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4254,"num_write_kb":272256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":413,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:08.540012+0000","last_change":"2024-02-19T21:46:01.981923+0000","last_active":"2024-02-19T21:50:08.540012+0000","last_peered":"2024-02-19T21:50:08.540012+0000","last_clean":"2024-02-19T21:50:08.540012+0000","last_became_active":"2024-02-19T21:44:56.160521+0000","last_became_peered":"2024-02-19T21:44:56.160521+0000","last_unstale":"2024-02-19T21:50:08.540012+0000","last_undegraded":"2024-02-19T21:50:08.540012+0000","last_fullsized":"2024-02-19T21:50:08.540012+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.981866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.981866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":57,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:08.525843+0000","last_change":"2024-02-19T21:49:54.485377+0000","last_active":"2024-02-19T21:50:08.525843+0000","last_peered":"2024-02-19T21:50:08.525843+0000","last_clean":"2024-02-19T21:50:08.525843+0000","last_became_active":"2024-02-19T21:49:54.485078+0000","last_became_peered":"2024-02-19T21:49:54.485078+0000","last_unstale":"2024-02-19T21:50:08.525843+0000","last_undegraded":"2024-02-19T21:50:08.525843+0000","last_fullsized":"2024-02-19T21:50:08.525843+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:52.107416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:46:52.107416+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"200'27","reported_seq":490,"reported_epoch":419,"state":"active+clean","last_fresh":"2024-02-19T21:50:08.538308+0000","last_change":"2024-02-19T21:49:55.109780+0000","last_active":"2024-02-19T21:50:08.538308+0000","last_peered":"2024-02-19T21:50:08.538308+0000","last_clean":"2024-02-19T21:50:08.538308+0000","last_became_active":"2024-02-19T21:49:54.486014+0000","last_became_peered":"2024-02-19T21:49:54.486014+0000","last_unstale":"2024-02-19T21:50:08.538308+0000","last_undegraded":"2024-02-19T21:50:08.538308+0000","last_fullsized":"2024-02-19T21:50:08.538308+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'27","last_scrub_stamp":"2024-02-19T21:48:24.665813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:24.665813+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"324'11","reported_seq":641,"reported_epoch":421,"state":"active+clean","last_fresh":"2024-02-19T21:50:11.549877+0000","last_change":"2024-02-19T21:48:26.293036+0000","last_active":"2024-02-19T21:50:11.549877+0000","last_peered":"2024-02-19T21:50:11.549877+0000","last_clean":"2024-02-19T21:50:11.549877+0000","last_became_active":"2024-02-19T21:44:34.385140+0000","last_became_peered":"2024-02-19T21:44:34.385140+0000","last_unstale":"2024-02-19T21:50:11.549877+0000","last_undegraded":"2024-02-19T21:50:11.549877+0000","last_fullsized":"2024-02-19T21:50:11.549877+0000","mapping_epoch":62,"log_start":"66'8","ondisk_log_start":"66'8","created":62,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'11","last_scrub_stamp":"2024-02-19T21:48:26.292909+0000","last_deep_scrub":"324'11","last_deep_scrub_stamp":"2024-02-19T21:46:05.210095+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.292909+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":4528537600,"num_objects":69100,"num_object_clones":0,"num_object_copies":207300,"num_objects_missing_on_primary":1154,"num_objects_missing":1154,"num_objects_degraded":12508,"num_objects_misplaced":4120,"num_objects_unfound":0,"num_objects_dirty":69100,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69100,"num_write_kb":4422400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3278,"num_bytes_recovered":214827008,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13271105536,"data_stored":13271105536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69100,"ondisk_log_size":69100,"up":48,"acting":41,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1051,"num_read_kb":1046,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":3,"num_objects_missing":3,"num_objects_degraded":7,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1107,"num_read_kb":864,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":5062,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":776,"ondisk_log_size":776,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":22,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":66,"acting":66,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":382,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201497,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":898568,"kb_used_data":597248,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":92846584,"statfs":{"total":95995035648,"available":95074902016,"internally_reserved":0,"allocated":611581952,"data_stored":610414854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:49:49 2024","interfaces":[{"interface":"back","average":{"1min":1.8049999999999999,"5min":2.6440000000000001,"15min":1.8859999999999999},"min":{"1min":0.26000000000000001,"5min":0.19,"15min":0.189},"max":{"1min":11.653,"5min":70.477999999999994,"15min":70.477999999999994},"last":0.58699999999999997},{"interface":"front","average":{"1min":2.0590000000000002,"5min":2.9199999999999999,"15min":2.0379999999999998},"min":{"1min":0.23100000000000001,"5min":0.21199999999999999,"15min":0.20999999999999999},"max":{"1min":12.242000000000001,"5min":68.052000000000007,"15min":68.052000000000007},"last":0.39900000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:49:49 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":2.7410000000000001,"15min":2.0710000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.23200000000000001},"max":{"1min":8.9629999999999992,"5min":68.168000000000006,"15min":68.168000000000006},"last":0.47499999999999998},{"interface":"front","average":{"1min":2.2799999999999998,"5min":3.298,"15min":2.1099999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.223},"max":{"1min":12.199,"5min":68.444000000000003,"15min":68.444000000000003},"last":0.45900000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:50:09 2024","interfaces":[{"interface":"back","average":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":12.304,"5min":12.304,"15min":12.304},"last":0.61799999999999999},{"interface":"front","average":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":11.69,"5min":11.69,"15min":11.69},"last":0.627}]},{"osd":3,"last update":"Mon Feb 19 21:49:49 2024","interfaces":[{"interface":"back","average":{"1min":1.8380000000000001,"5min":2.121,"15min":2.1480000000000001},"min":{"1min":0.377,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":10.435,"5min":11.614000000000001,"15min":31.559000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.744,"15min":1.895},"min":{"1min":0.33000000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":9.0129999999999999,"5min":13.473000000000001,"15min":30.812999999999999},"last":0.52700000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:49:49 2024","interfaces":[{"interface":"back","average":{"1min":3.0339999999999998,"5min":2.0720000000000001,"15min":1.5389999999999999},"min":{"1min":0.27400000000000002,"5min":0.216,"15min":0.216},"max":{"1min":17.716999999999999,"5min":17.716999999999999,"15min":17.716999999999999},"last":0.317},{"interface":"front","average":{"1min":3.4089999999999998,"5min":2.4529999999999998,"15min":1.8700000000000001},"min":{"1min":0.26500000000000001,"5min":0.253,"15min":0.245},"max":{"1min":15.666,"5min":17.690999999999999,"15min":17.690999999999999},"last":0.35899999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:49:49 2024","interfaces":[{"interface":"back","average":{"1min":2.1459999999999999,"5min":2.1579999999999999,"15min":1.609},"min":{"1min":0.30199999999999999,"5min":0.28499999999999998,"15min":0.24199999999999999},"max":{"1min":12.210000000000001,"5min":29.021000000000001,"15min":29.021000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":2.6219999999999999,"5min":2.5110000000000001,"15min":1.889},"min":{"1min":0.33800000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":17.670999999999999,"5min":29.091999999999999,"15min":29.091999999999999},"last":0.57299999999999995}]},{"osd":6,"last update":"Mon Feb 19 21:49:49 2024","interfaces":[{"interface":"back","average":{"1min":3.1320000000000001,"5min":2.452,"15min":1.6930000000000001},"min":{"1min":0.32500000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":12.271000000000001,"5min":19.286000000000001,"15min":19.286000000000001},"last":0.434},{"interface":"front","average":{"1min":2.6800000000000002,"5min":2.339,"15min":1.863},"min":{"1min":0.314,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":11.722,"5min":18.364000000000001,"15min":18.364000000000001},"last":0.55300000000000005}]}]},{"osd":6,"up_from":47,"seq":201863463136,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2542476,"kb_used_data":1944580,"kb_used_omap":0,"kb_used_meta":597888,"kb_avail":91202676,"statfs":{"total":95995035648,"available":93391540224,"internally_reserved":0,"allocated":1991249920,"data_stored":1990078236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":612237312},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:49:26 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":1.28,"15min":1.645},"min":{"1min":0.26800000000000002,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":7.8170000000000002,"5min":8.8079999999999998,"15min":45.197000000000003},"last":0.315},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.8120000000000001,"15min":1.9259999999999999},"min":{"1min":0.28299999999999997,"5min":0.23499999999999999,"15min":0.221},"max":{"1min":5.9859999999999998,"5min":7.274,"15min":44.753},"last":0.33700000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:49:26 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":1.552,"15min":1.6799999999999999},"min":{"1min":0.30499999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":7.8639999999999999,"5min":8.8469999999999995,"15min":45.231999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.5169999999999999,"15min":1.6459999999999999},"min":{"1min":0.34499999999999997,"5min":0.245,"15min":0.23100000000000001},"max":{"1min":6.7009999999999996,"5min":7.3570000000000002,"15min":45.097999999999999},"last":0.39200000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:50:09 2024","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.571,"15min":1.571},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":6.0330000000000004,"5min":6.0330000000000004,"15min":6.0330000000000004},"last":0.30399999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":7.8959999999999999,"5min":7.8959999999999999,"15min":7.8959999999999999},"last":0.68600000000000005}]},{"osd":3,"last update":"Mon Feb 19 21:49:26 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.452,"15min":1.5740000000000001},"min":{"1min":0.34899999999999998,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":7.9210000000000003,"5min":8.9009999999999998,"15min":11.15},"last":0.54400000000000004},{"interface":"front","average":{"1min":1.198,"5min":1.4450000000000001,"15min":1.5620000000000001},"min":{"1min":0.313,"5min":0.29799999999999999,"15min":0.246},"max":{"1min":6.8010000000000002,"5min":7.3949999999999996,"15min":19.632999999999999},"last":0.96799999999999997}]},{"osd":4,"last update":"Mon Feb 19 21:49:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.8819999999999999,"15min":1.5720000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":6.0910000000000002,"5min":8.2230000000000008,"15min":14.254},"last":0.40200000000000002},{"interface":"front","average":{"1min":1.403,"5min":1.8999999999999999,"15min":1.6359999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.23499999999999999},"max":{"1min":11.566000000000001,"5min":11.566000000000001,"15min":16.594999999999999},"last":0.44400000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:49:26 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":2.1480000000000001,"15min":1.6639999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27100000000000002},"max":{"1min":6.0629999999999997,"5min":14.695,"15min":14.695},"last":0.432},{"interface":"front","average":{"1min":1.2070000000000001,"5min":2.2389999999999999,"15min":1.8660000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.27900000000000003},"max":{"1min":11.609999999999999,"5min":11.609999999999999,"15min":15.497999999999999},"last":0.46999999999999997}]},{"osd":7,"last update":"Mon Feb 19 21:49:48 2024","interfaces":[{"interface":"back","average":{"1min":1.7030000000000001,"5min":2.0800000000000001,"15min":1.7909999999999999},"min":{"1min":0.38300000000000001,"5min":0.27200000000000002,"15min":0.26700000000000002},"max":{"1min":7.9569999999999999,"5min":9.1929999999999996,"15min":14.721},"last":0.495},{"interface":"front","average":{"1min":1.7390000000000001,"5min":2.1139999999999999,"15min":1.841},"min":{"1min":0.42099999999999999,"5min":0.35599999999999998,"15min":0.32700000000000001},"max":{"1min":7.9850000000000003,"5min":9.2240000000000002,"15min":14.744999999999999},"last":0.52100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575098,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2015388,"kb_used_data":1118868,"kb_used_omap":0,"kb_used_meta":896512,"kb_avail":91729764,"statfs":{"total":95995035648,"available":93931278336,"internally_reserved":0,"allocated":1145720832,"data_stored":1144533578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":918028288},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":1.0229999999999999,"15min":1.4610000000000001},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.161},"max":{"1min":3.6720000000000002,"5min":6.2789999999999999,"15min":42.776000000000003},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":1.1319999999999999,"15min":1.514},"min":{"1min":0.19900000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":3.9620000000000002,"5min":10.798,"15min":44.845999999999997},"last":0.23799999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:50:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":3.5649999999999999,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":0.27800000000000002},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":4.452,"5min":4.452,"15min":4.452},"last":0.254}]},{"osd":3,"last update":"Mon Feb 19 21:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":1.1850000000000001,"15min":1.613},"min":{"1min":0.24199999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":3.859,"5min":5.4500000000000002,"15min":41.607999999999997},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":1.2769999999999999,"15min":1.508},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":3.637,"5min":5.6589999999999998,"15min":42.811999999999998},"last":0.35499999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:49:31 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.7030000000000001,"15min":1.482},"min":{"1min":0.30099999999999999,"5min":0.251,"15min":0.251},"max":{"1min":5.7590000000000003,"5min":15.853,"15min":15.853},"last":0.316},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.754,"15min":1.5609999999999999},"min":{"1min":0.33200000000000002,"5min":0.28000000000000003,"15min":0.26500000000000001},"max":{"1min":6.7610000000000001,"5min":15.861000000000001,"15min":15.861000000000001},"last":0.36699999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:49:59 2024","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.734,"15min":1.639},"min":{"1min":0.32400000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":4.0720000000000001,"5min":14.331,"15min":14.331},"last":0.40000000000000002},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.8979999999999999,"15min":1.625},"min":{"1min":0.307,"5min":0.307,"15min":0.30099999999999999},"max":{"1min":5.5229999999999997,"5min":14.496,"15min":14.496},"last":0.47699999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:49:31 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.657,"15min":1.6040000000000001},"min":{"1min":0.36199999999999999,"5min":0.30199999999999999,"15min":0.30099999999999999},"max":{"1min":2.6080000000000001,"5min":10.456,"15min":11.638999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.8160000000000001,"15min":1.746},"min":{"1min":0.379,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":4.0019999999999998,"5min":9.8049999999999997,"15min":12.199},"last":0.44800000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:49:54 2024","interfaces":[{"interface":"back","average":{"1min":2.1419999999999999,"5min":2.0790000000000002,"15min":1.867},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":7.702,"5min":13.904,"15min":13.904},"last":0.502},{"interface":"front","average":{"1min":2.0299999999999998,"5min":2.0779999999999998,"15min":1.7350000000000001},"min":{"1min":0.38900000000000001,"5min":0.35499999999999998,"15min":0.32600000000000001},"max":{"1min":7.6909999999999998,"5min":13.894,"15min":13.894},"last":0.436}]}]},{"osd":0,"up_from":8,"seq":34359738624,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3668484,"kb_used_data":2769980,"kb_used_omap":0,"kb_used_meta":898496,"kb_avail":90076668,"statfs":{"total":95995035648,"available":92238508032,"internally_reserved":0,"allocated":2836459520,"data_stored":2835295857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":920059904},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:50:10 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.88300000000000001,"15min":1.1279999999999999},"min":{"1min":0.189,"5min":0.153,"15min":0.153},"max":{"1min":3.0800000000000001,"5min":6.1550000000000002,"15min":16.478000000000002},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":1.054,"15min":1.417},"min":{"1min":0.224,"5min":0.17899999999999999,"15min":0.17799999999999999},"max":{"1min":3.1669999999999998,"5min":6.9359999999999999,"15min":13.422000000000001},"last":0.39300000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:50:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":4.2510000000000003,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":0.22800000000000001},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":8.9960000000000004,"5min":8.9960000000000004,"15min":8.9960000000000004},"last":0.69799999999999995}]},{"osd":3,"last update":"Mon Feb 19 21:50:01 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.292,"15min":1.6819999999999999},"min":{"1min":0.255,"5min":0.216,"15min":0.21299999999999999},"max":{"1min":5.3570000000000002,"5min":12.691000000000001,"15min":14.507999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.099,"15min":1.552},"min":{"1min":0.32000000000000001,"5min":0.24099999999999999,"15min":0.23400000000000001},"max":{"1min":3.4569999999999999,"5min":6.6150000000000002,"15min":18.759},"last":0.51100000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:49:44 2024","interfaces":[{"interface":"back","average":{"1min":2.0649999999999999,"5min":1.768,"15min":1.6910000000000001},"min":{"1min":0.29899999999999999,"5min":0.252,"15min":0.252},"max":{"1min":7.766,"5min":10.311,"15min":13.278},"last":0.29899999999999999},{"interface":"front","average":{"1min":1.99,"5min":1.732,"15min":1.534},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.255},"max":{"1min":8.1219999999999999,"5min":10.109,"15min":10.109},"last":0.47899999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:50:01 2024","interfaces":[{"interface":"back","average":{"1min":1.6140000000000001,"5min":2.1850000000000001,"15min":2.0779999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.27600000000000002},"max":{"1min":8.1199999999999992,"5min":25.442,"15min":42.799999999999997},"last":0.36499999999999999},{"interface":"front","average":{"1min":2.1579999999999999,"5min":2.2429999999999999,"15min":2.0939999999999999},"min":{"1min":0.35099999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":8.5530000000000008,"5min":25.411999999999999,"15min":42.695},"last":1.0229999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:49:15 2024","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.651,"15min":1.6000000000000001},"min":{"1min":0.36499999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":9.3049999999999997,"5min":10.278,"15min":42.777000000000001},"last":1.5960000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":1.7410000000000001,"15min":1.8740000000000001},"min":{"1min":0.39000000000000001,"5min":0.29599999999999999,"15min":0.28599999999999998},"max":{"1min":2.198,"5min":11.84,"15min":13.289999999999999},"last":0.41599999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:49:48 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.8839999999999999,"15min":1.8100000000000001},"min":{"1min":0.38700000000000001,"5min":0.36799999999999999,"15min":0.31},"max":{"1min":9.6460000000000008,"5min":15.688000000000001,"15min":42.758000000000003},"last":1.298},{"interface":"front","average":{"1min":1.978,"5min":1.871,"15min":1.738},"min":{"1min":0.40000000000000002,"5min":0.36399999999999999,"15min":0.33200000000000002},"max":{"1min":9.6389999999999993,"5min":10.470000000000001,"15min":42.718000000000004},"last":1.3240000000000001}]}]},{"osd":2,"up_from":394,"seq":1692217114637,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1925732,"kb_used_data":1601692,"kb_used_omap":0,"kb_used_meta":324031,"kb_avail":91819420,"statfs":{"total":95995035648,"available":94023086080,"internally_reserved":0,"allocated":1640132608,"data_stored":1638992999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":331807796},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":9.1530000000000005,"5min":9.1530000000000005,"15min":9.1530000000000005},"last":0.22700000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":6.149,"5min":6.149,"15min":6.149},"last":0.34499999999999997}]},{"osd":1,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":2.8370000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.312},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":6.992,"5min":6.992,"15min":6.992},"last":0.33300000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.45,"15min":1.45},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":6.9470000000000001,"5min":6.9470000000000001,"15min":6.9470000000000001},"last":0.28100000000000003},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":6.6500000000000004,"5min":6.6500000000000004,"15min":6.6500000000000004},"last":0.496}]},{"osd":4,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":7.0339999999999998,"5min":7.0339999999999998,"15min":7.0339999999999998},"last":0.36299999999999999},{"interface":"front","average":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":7.0419999999999998,"5min":7.0419999999999998,"15min":7.0419999999999998},"last":0.41299999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":10.067,"5min":10.067,"15min":10.067},"last":0.46700000000000003},{"interface":"front","average":{"1min":1.821,"5min":1.821,"15min":1.821},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":13.558,"5min":13.558,"15min":13.558},"last":0.56899999999999995}]},{"osd":6,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.752,"5min":1.752,"15min":1.752},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":5.6829999999999998,"5min":5.6829999999999998,"15min":5.6829999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":7,"5min":7,"15min":7},"last":0.55600000000000005}]},{"osd":7,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":5.7750000000000004,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.782,"5min":2.782,"15min":2.782},"last":0.58499999999999996}]}]},{"osd":3,"up_from":0,"seq":111669149936,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":32,"seq":137438953705,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3613688,"kb_used_data":3028080,"kb_used_omap":0,"kb_used_meta":585600,"kb_avail":90131464,"statfs":{"total":95995035648,"available":92294619136,"internally_reserved":0,"allocated":3100753920,"data_stored":3099601593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":599654400},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:49:32 2024","interfaces":[{"interface":"back","average":{"1min":1.623,"5min":2.1739999999999999,"15min":1.8819999999999999},"min":{"1min":0.35399999999999998,"5min":0.23499999999999999,"15min":0.219},"max":{"1min":9.0280000000000005,"5min":53.936,"15min":53.936},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":2.3690000000000002,"15min":2.02},"min":{"1min":0.28299999999999997,"5min":0.23000000000000001,"15min":0.22600000000000001},"max":{"1min":4.1059999999999999,"5min":54.405999999999999,"15min":54.405999999999999},"last":0.46000000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:49:32 2024","interfaces":[{"interface":"back","average":{"1min":1.8280000000000001,"5min":2.323,"15min":1.742},"min":{"1min":0.314,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":6.266,"5min":54.731000000000002,"15min":54.731000000000002},"last":0.34200000000000003},{"interface":"front","average":{"1min":1.0249999999999999,"5min":2.173,"15min":1.6120000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.25},"max":{"1min":4.1310000000000002,"5min":52.490000000000002,"15min":52.490000000000002},"last":0.42999999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:50:10 2024","interfaces":[{"interface":"back","average":{"1min":2.077,"5min":2.077,"15min":2.077},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":9.0619999999999994,"5min":9.0619999999999994,"15min":9.0619999999999994},"last":0.314},{"interface":"front","average":{"1min":2.113,"5min":2.113,"15min":2.113},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":9.0899999999999999,"5min":9.0899999999999999,"15min":9.0899999999999999},"last":0.39300000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:49:32 2024","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.5289999999999999,"15min":1.6200000000000001},"min":{"1min":0.33000000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":6.2750000000000004,"5min":6.5579999999999998,"15min":15.914999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":1.7330000000000001,"5min":1.7509999999999999,"15min":1.6499999999999999},"min":{"1min":0.38400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":9.1150000000000002,"5min":9.4000000000000004,"15min":13.321},"last":0.41899999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":2.1400000000000001,"15min":1.625},"min":{"1min":0.23799999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.81999999999999995,"5min":16.731999999999999,"15min":18.916},"last":0.54900000000000004},{"interface":"front","average":{"1min":1.1040000000000001,"5min":2.1230000000000002,"15min":1.847},"min":{"1min":0.28299999999999997,"5min":0.26200000000000001,"15min":0.253},"max":{"1min":6.3029999999999999,"5min":8.2959999999999994,"15min":14.840999999999999},"last":0.629}]},{"osd":6,"last update":"Mon Feb 19 21:49:32 2024","interfaces":[{"interface":"back","average":{"1min":1.6240000000000001,"5min":1.7989999999999999,"15min":1.534},"min":{"1min":0.28999999999999998,"5min":0.28899999999999998,"15min":0.28599999999999998},"max":{"1min":6.2409999999999997,"5min":9.1720000000000006,"15min":13.27},"last":0.60499999999999998},{"interface":"front","average":{"1min":1.8029999999999999,"5min":2.3769999999999998,"15min":1.7230000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":9.5069999999999997,"5min":18.670000000000002,"15min":18.670000000000002},"last":0.48399999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:50:00 2024","interfaces":[{"interface":"back","average":{"1min":2.7650000000000001,"5min":2.4849999999999999,"15min":1.76},"min":{"1min":0.38,"5min":0.311,"15min":0.28899999999999998},"max":{"1min":13.765000000000001,"5min":16.763999999999999,"15min":16.763999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":3.0190000000000001,"5min":1.9199999999999999,"15min":1.6879999999999999},"min":{"1min":0.502,"5min":0.31,"15min":0.31},"max":{"1min":10.044,"5min":10.82,"15min":12.808999999999999},"last":0.77100000000000002}]}]},{"osd":5,"up_from":38,"seq":163208757476,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2766160,"kb_used_data":1875720,"kb_used_omap":0,"kb_used_meta":890432,"kb_avail":90978992,"statfs":{"total":95995035648,"available":93162487808,"internally_reserved":0,"allocated":1920737280,"data_stored":1919609156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":911802368},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.8540000000000001,"15min":1.762},"min":{"1min":0.26000000000000001,"5min":0.214,"15min":0.20599999999999999},"max":{"1min":4.0979999999999999,"5min":19.236000000000001,"15min":20.550999999999998},"last":0.27600000000000002},{"interface":"front","average":{"1min":1.3979999999999999,"5min":2.0680000000000001,"15min":1.8839999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.20899999999999999},"max":{"1min":3.7090000000000001,"5min":13.241,"15min":20.879000000000001},"last":0.29299999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.798,"15min":1.712},"min":{"1min":0.307,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":4.9569999999999999,"5min":8.9789999999999992,"15min":10.42},"last":0.52700000000000002},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.877,"15min":1.613},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":4.4829999999999997,"5min":10.965,"15min":10.965},"last":0.35799999999999998}]},{"osd":2,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":4.1280000000000001,"5min":4.1280000000000001,"15min":4.1280000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":4.2619999999999996,"5min":4.2619999999999996,"15min":4.2619999999999996},"last":0.45600000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.6619999999999999,"5min":2.1640000000000001,"15min":2.0649999999999999},"min":{"1min":0.32200000000000001,"5min":0.26100000000000001,"15min":0.24099999999999999},"max":{"1min":13.182,"5min":19.321000000000002,"15min":20.146999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":1.393,"5min":1.9630000000000001,"15min":2.129},"min":{"1min":0.40999999999999998,"5min":0.311,"15min":0.29499999999999998},"max":{"1min":4.3659999999999997,"5min":9.0269999999999992,"15min":20.120000000000001},"last":0.5}]},{"osd":4,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.8149999999999999,"15min":1.397},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":4.452,"5min":16.643999999999998,"15min":21.577000000000002},"last":0.39200000000000002},{"interface":"front","average":{"1min":2.254,"5min":2.294,"15min":1.879},"min":{"1min":0.26100000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":10.352,"5min":19.274000000000001,"15min":19.274000000000001},"last":0.372}]},{"osd":6,"last update":"Mon Feb 19 21:49:25 2024","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":2.306,"15min":1.792},"min":{"1min":0.35399999999999998,"5min":0.26200000000000001,"15min":0.221},"max":{"1min":8.9079999999999995,"5min":19.884,"15min":19.884},"last":0.34799999999999998},{"interface":"front","average":{"1min":1.4199999999999999,"5min":2.0270000000000001,"15min":1.7869999999999999},"min":{"1min":0.316,"5min":0.26700000000000002,"15min":0.23599999999999999},"max":{"1min":10.260999999999999,"5min":10.260999999999999,"15min":13.532999999999999},"last":0.58499999999999996}]},{"osd":7,"last update":"Mon Feb 19 21:49:52 2024","interfaces":[{"interface":"back","average":{"1min":1.8939999999999999,"5min":2.4319999999999999,"15min":2.0110000000000001},"min":{"1min":0.35899999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":9.6300000000000008,"5min":12.611000000000001,"15min":12.962},"last":0.55800000000000005},{"interface":"front","average":{"1min":2.2050000000000001,"5min":2.3540000000000001,"15min":1.8300000000000001},"min":{"1min":0.36099999999999999,"5min":0.221,"15min":0.221},"max":{"1min":9.5649999999999995,"5min":15.593999999999999,"15min":17.759},"last":0.42299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2844262400,"data_stored":2844262400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1144455168,"data_stored":1144455168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1649868800,"data_stored":1649868800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3101622272,"data_stored":3101622272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1924595712,"data_stored":1924595712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1992687616,"data_stored":1992687616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":613613568,"data_stored":613613568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:50:18.351 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph status --format=json 2024-02-19T21:50:18.524 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:50:18.528 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:18.529 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:50:18.629 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:50:18.660 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:18.785 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:17.167043+0000 mgr.y (mgr.14514) 674 : cluster [DBG] pgmap v877: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.2 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 742 B/s rd, 18 MiB/s wr, 295 op/s; 12512/208845 objects degraded (5.991%); 4119/208845 objects misplaced (1.972%); 1.6 MiB/s, 25 objects/s recovering 2024-02-19T21:50:18.786 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:17.983508+0000 mon.a (mon.0) 1681 : audit [DBG] from='client.? 172.21.15.80:0/218398878' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:50:18.786 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:17.167043+0000 mgr.y (mgr.14514) 674 : cluster [DBG] pgmap v877: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.2 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 742 B/s rd, 18 MiB/s wr, 295 op/s; 12512/208845 objects degraded (5.991%); 4119/208845 objects misplaced (1.972%); 1.6 MiB/s, 25 objects/s recovering 2024-02-19T21:50:18.786 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:17.983508+0000 mon.a (mon.0) 1681 : audit [DBG] from='client.? 172.21.15.80:0/218398878' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:50:19.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:17.167043+0000 mgr.y (mgr.14514) 674 : cluster [DBG] pgmap v877: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.2 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 742 B/s rd, 18 MiB/s wr, 295 op/s; 12512/208845 objects degraded (5.991%); 4119/208845 objects misplaced (1.972%); 1.6 MiB/s, 25 objects/s recovering 2024-02-19T21:50:19.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:17.983508+0000 mon.a (mon.0) 1681 : audit [DBG] from='client.? 172.21.15.80:0/218398878' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:50:19.188 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:50:19.188 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-02-19T21:50:19.188 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-02-19T21:50:19.188 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-02-19T21:50:19.188 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:50:19.283 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 78 16 70696 70680 56.6262 15.25 0.684434 0.0175843 2024-02-19T21:50:19.930 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.2 dump_historic_ops 2024-02-19T21:50:20.283 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 79 16 70958 70942 56.1167 16.375 0.00367137 0.0177277 2024-02-19T21:50:20.412 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:50:20.417 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:20.418 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:50:20.518 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:50:20.552 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:20.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:19.167546+0000 mgr.y (mgr.14514) 675 : cluster [DBG] pgmap v878: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.2 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 639 B/s rd, 14 MiB/s wr, 227 op/s; 12512/208845 objects degraded (5.991%); 4119/208845 objects misplaced (1.972%); 1.4 MiB/s, 21 objects/s recovering 2024-02-19T21:50:20.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:20.268503+0000 mon.a (mon.0) 1682 : cluster [WRN] Health check update: Degraded data redundancy: 12512/208845 objects degraded (5.991%), 9 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:50:20.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:19.167546+0000 mgr.y (mgr.14514) 675 : cluster [DBG] pgmap v878: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.2 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 639 B/s rd, 14 MiB/s wr, 227 op/s; 12512/208845 objects degraded (5.991%); 4119/208845 objects misplaced (1.972%); 1.4 MiB/s, 21 objects/s recovering 2024-02-19T21:50:20.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:20.268503+0000 mon.a (mon.0) 1682 : cluster [WRN] Health check update: Degraded data redundancy: 12512/208845 objects degraded (5.991%), 9 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:50:20.772 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:50:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:50:20] "GET /metrics HTTP/1.1" 200 176537 "" "Prometheus/2.33.4" 2024-02-19T21:50:20.951 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:19.167546+0000 mgr.y (mgr.14514) 675 : cluster [DBG] pgmap v878: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.2 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 639 B/s rd, 14 MiB/s wr, 227 op/s; 12512/208845 objects degraded (5.991%); 4119/208845 objects misplaced (1.972%); 1.4 MiB/s, 21 objects/s recovering 2024-02-19T21:50:20.951 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:20.268503+0000 mon.a (mon.0) 1682 : cluster [WRN] Health check update: Degraded data redundancy: 12512/208845 objects degraded (5.991%), 9 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:50:20.951 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:50:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:50:21.086 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:50:21.091 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:21.092 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:50:21.192 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:50:21.229 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:21.265 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:50:21.267 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:21.268 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:50:21.283 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:2024-02-19T21:50:21.285096+0000 min lat: 0.00134319 max lat: 10.2576 avg lat: 0.0178757 2024-02-19T21:50:21.283 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-19T21:50:21.283 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 80 16 71354 71338 55.7247 24.75 0.00397887 0.0178757 2024-02-19T21:50:21.369 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:50:21.411 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:21.436 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:50:21.440 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:21.441 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:50:21.541 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:50:21.574 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:21.604 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:50:21.608 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:21.608 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:50:21.709 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:50:21.739 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:21.799 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:50:21.807 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:20.951745+0000 mgr.y (mgr.14514) 676 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:50:21.808 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:20.951745+0000 mgr.y (mgr.14514) 676 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:50:21.808 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:21.809 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:50:21.909 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:50:21.955 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:21.956 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:20.951745+0000 mgr.y (mgr.14514) 676 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:50:21.992 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:50:21.995 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:21.996 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:50:22.084 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:50:22.085 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:50:22.097 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:50:22.125 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:22.149 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:50:22.154 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:22.154 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:50:22.255 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:50:22.283 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 81 16 71687 71671 55.2936 20.8125 0.00319899 0.0180124 2024-02-19T21:50:22.286 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:22.361 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:50:22.364 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:22.365 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:50:22.466 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:50:22.496 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:22.517 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:50:22.519 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:22.520 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:50:22.612 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-02-19T21:50:22.620 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:50:22.649 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:22.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:21.168415+0000 mgr.y (mgr.14514) 677 : cluster [DBG] pgmap v879: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.3 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.0 KiB/s rd, 20 MiB/s wr, 325 op/s; 12338/213102 objects degraded (5.790%); 4119/213102 objects misplaced (1.933%); 2.3 MiB/s, 36 objects/s recovering 2024-02-19T21:50:22.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:22.338098+0000 mon.b (mon.1) 65 : audit [INF] from='client.? 172.21.15.80:0/3199783649' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:50:22.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:22.338639+0000 mon.a (mon.0) 1683 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:50:23.004 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:21.168415+0000 mgr.y (mgr.14514) 677 : cluster [DBG] pgmap v879: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.3 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.0 KiB/s rd, 20 MiB/s wr, 325 op/s; 12338/213102 objects degraded (5.790%); 4119/213102 objects misplaced (1.933%); 2.3 MiB/s, 36 objects/s recovering 2024-02-19T21:50:23.005 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:22.338098+0000 mon.b (mon.1) 65 : audit [INF] from='client.? 172.21.15.80:0/3199783649' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:50:23.005 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:22.338639+0000 mon.a (mon.0) 1683 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:50:23.005 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:21.168415+0000 mgr.y (mgr.14514) 677 : cluster [DBG] pgmap v879: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.3 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.0 KiB/s rd, 20 MiB/s wr, 325 op/s; 12338/213102 objects degraded (5.790%); 4119/213102 objects misplaced (1.933%); 2.3 MiB/s, 36 objects/s recovering 2024-02-19T21:50:23.005 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:22.338098+0000 mon.b (mon.1) 65 : audit [INF] from='client.? 172.21.15.80:0/3199783649' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:50:23.005 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:22.338639+0000 mon.a (mon.0) 1683 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:50:23.284 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 82 16 71921 71905 54.7977 14.625 0.00362593 0.0181682 2024-02-19T21:50:23.306 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:50:23.309 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:23.309 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:50:23.410 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:50:23.439 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:23.461 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:50:23.470 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:23.471 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:50:23.571 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:50:23.581 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:50:23.610 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:23.635 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:50:23.639 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:23.639 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:50:23.740 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:50:23.780 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:23.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:22.596251+0000 mon.a (mon.0) 1684 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:50:23.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:22.600657+0000 mon.a (mon.0) 1685 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:50:23.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:22.600732+0000 mon.a (mon.0) 1686 : cluster [DBG] osdmap e423: 8 total, 8 up, 7 in 2024-02-19T21:50:24.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:22.596251+0000 mon.a (mon.0) 1684 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:50:24.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:22.600657+0000 mon.a (mon.0) 1685 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:50:24.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:22.600732+0000 mon.a (mon.0) 1686 : cluster [DBG] osdmap e423: 8 total, 8 up, 7 in 2024-02-19T21:50:24.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:22.596251+0000 mon.a (mon.0) 1684 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:50:24.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:22.600657+0000 mon.a (mon.0) 1685 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:50:24.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:22.600732+0000 mon.a (mon.0) 1686 : cluster [DBG] osdmap e423: 8 total, 8 up, 7 in 2024-02-19T21:50:24.283 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 83 16 72295 72279 54.4191 23.375 0.00616362 0.018309 2024-02-19T21:50:25.048 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:23.168947+0000 mgr.y (mgr.14514) 678 : cluster [DBG] pgmap v881: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.3 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 18 MiB/s wr, 286 op/s; 12336/213423 objects degraded (5.780%); 4117/213423 objects misplaced (1.929%); 2.3 MiB/s, 36 objects/s recovering 2024-02-19T21:50:25.048 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:23.168947+0000 mgr.y (mgr.14514) 678 : cluster [DBG] pgmap v881: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.3 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 18 MiB/s wr, 286 op/s; 12336/213423 objects degraded (5.780%); 4117/213423 objects misplaced (1.929%); 2.3 MiB/s, 36 objects/s recovering 2024-02-19T21:50:25.055 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:23.168947+0000 mgr.y (mgr.14514) 678 : cluster [DBG] pgmap v881: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.3 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 18 MiB/s wr, 286 op/s; 12336/213423 objects degraded (5.780%); 4117/213423 objects misplaced (1.929%); 2.3 MiB/s, 36 objects/s recovering 2024-02-19T21:50:25.285 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 84 16 72625 72609 54.0162 20.625 0.00662357 0.0184416 2024-02-19T21:50:25.335 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:50:25.338 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:25.339 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:50:25.439 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:50:25.475 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:25.497 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:50:25.500 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:25.500 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:50:25.601 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:50:25.604 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:50:25.629 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:25.650 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:50:25.654 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:25.655 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:50:25.663 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:50:25.663 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-02-19T21:50:25.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-02-19T21:50:25.663 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-02-19T21:50:25.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.663 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:17841 10.5 10.c6d3c8a5 (undecoded) ondisk+write+known_if_redirected e394)", 2024-02-19T21:50:25.664 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:49:07.331742+0000", 2024-02-19T21:50:25.664 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 78.329762586000001, 2024-02-19T21:50:25.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98537818600000004, 2024-02-19T21:50:25.664 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:25.664 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:50:25.664 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:25.664 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:25.664 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:25.664 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 17841 2024-02-19T21:50:25.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.664 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:25.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:25.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.331742+0000", 2024-02-19T21:50:25.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:25.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.665 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:25.665 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.331742+0000", 2024-02-19T21:50:25.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:50:25.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.665 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:25.665 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.331740+0000", 2024-02-19T21:50:25.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3974999999999996e-05 2024-02-19T21:50:25.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.665 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:25.665 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.331814+0000", 2024-02-19T21:50:25.666 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8023e-05 2024-02-19T21:50:25.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.666 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.666 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:25.666 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.331832+0000", 2024-02-19T21:50:25.666 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8290000000000008e-06 2024-02-19T21:50:25.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.666 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.666 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:25.666 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.331840+0000", 2024-02-19T21:50:25.666 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010142580000000001 2024-02-19T21:50:25.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.666 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.666 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:25.666 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.332854+0000", 2024-02-19T21:50:25.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9959999999999993e-06 2024-02-19T21:50:25.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:25.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.332862+0000", 2024-02-19T21:50:25.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98424552499999995 2024-02-19T21:50:25.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:25.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:08.317108+0000", 2024-02-19T21:50:25.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2449999999999999e-05 2024-02-19T21:50:25.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:25.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:08.317120+0000", 2024-02-19T21:50:25.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98537818600000004 2024-02-19T21:50:25.668 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.668 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:25.668 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.668 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:17860 10.5 10.263bba65 (undecoded) ondisk+write+known_if_redirected e394)", 2024-02-19T21:50:25.668 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:49:07.331861+0000", 2024-02-19T21:50:25.668 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 78.329643403999995, 2024-02-19T21:50:25.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98529670599999997, 2024-02-19T21:50:25.668 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:25.668 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:50:25.668 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:25.668 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:25.669 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:25.669 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 17860 2024-02-19T21:50:25.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.669 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:25.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:25.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.331861+0000", 2024-02-19T21:50:25.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:25.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:25.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.331861+0000", 2024-02-19T21:50:25.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:50:25.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.670 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:25.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.331860+0000", 2024-02-19T21:50:25.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4146000000000005e-05 2024-02-19T21:50:25.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.670 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:25.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.331935+0000", 2024-02-19T21:50:25.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7239999999999998e-06 2024-02-19T21:50:25.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.670 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:25.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.331943+0000", 2024-02-19T21:50:25.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7250000000000002e-06 2024-02-19T21:50:25.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.671 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:25.671 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.331949+0000", 2024-02-19T21:50:25.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00093233599999999997 2024-02-19T21:50:25.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.671 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:25.671 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.332881+0000", 2024-02-19T21:50:25.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7350000000000004e-06 2024-02-19T21:50:25.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.671 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:25.671 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.332886+0000", 2024-02-19T21:50:25.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98425952100000003 2024-02-19T21:50:25.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:25.672 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:08.317146+0000", 2024-02-19T21:50:25.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2295e-05 2024-02-19T21:50:25.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:25.672 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:08.317158+0000", 2024-02-19T21:50:25.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98529670599999997 2024-02-19T21:50:25.672 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.672 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:25.672 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.673 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:17861 10.3 10.e5188ef3 (undecoded) ondisk+write+known_if_redirected e394)", 2024-02-19T21:50:25.673 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:49:07.331955+0000", 2024-02-19T21:50:25.673 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 78.329549811000007, 2024-02-19T21:50:25.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98271464399999997, 2024-02-19T21:50:25.673 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:25.673 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:50:25.673 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:25.673 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:25.673 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:25.673 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 17861 2024-02-19T21:50:25.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.673 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:25.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:25.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.331955+0000", 2024-02-19T21:50:25.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:25.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:25.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.331955+0000", 2024-02-19T21:50:25.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:50:25.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:25.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.331954+0000", 2024-02-19T21:50:25.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1909999999999997e-05 2024-02-19T21:50:25.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:25.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.331996+0000", 2024-02-19T21:50:25.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5959999999999998e-06 2024-02-19T21:50:25.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:25.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.332004+0000", 2024-02-19T21:50:25.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3150000000000002e-06 2024-02-19T21:50:25.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:25.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.332008+0000", 2024-02-19T21:50:25.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016742040000000001 2024-02-19T21:50:25.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:25.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.333682+0000", 2024-02-19T21:50:25.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.956e-06 2024-02-19T21:50:25.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.676 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:25.676 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.333689+0000", 2024-02-19T21:50:25.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98097032100000003 2024-02-19T21:50:25.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.676 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:25.676 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:08.314659+0000", 2024-02-19T21:50:25.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9939999999999995e-06 2024-02-19T21:50:25.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.676 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:25.676 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:08.314669+0000", 2024-02-19T21:50:25.677 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98271464399999997 2024-02-19T21:50:25.677 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.677 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:25.677 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.677 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:17865 10.5 10.f2c26a35 (undecoded) ondisk+write+known_if_redirected e394)", 2024-02-19T21:50:25.677 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:49:07.332013+0000", 2024-02-19T21:50:25.677 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 78.329491747000006, 2024-02-19T21:50:25.677 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98520220400000003, 2024-02-19T21:50:25.677 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:25.677 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:50:25.677 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:25.677 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:25.677 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:25.678 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 17865 2024-02-19T21:50:25.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.678 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:25.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:25.678 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.332013+0000", 2024-02-19T21:50:25.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:25.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:25.678 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.332013+0000", 2024-02-19T21:50:25.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:50:25.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:25.678 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.332012+0000", 2024-02-19T21:50:25.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5639000000000001e-05 2024-02-19T21:50:25.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:25.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.332058+0000", 2024-02-19T21:50:25.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5839999999999997e-06 2024-02-19T21:50:25.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:25.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.332065+0000", 2024-02-19T21:50:25.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7069999999999997e-06 2024-02-19T21:50:25.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:25.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.332071+0000", 2024-02-19T21:50:25.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00083258300000000002 2024-02-19T21:50:25.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:25.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.332904+0000", 2024-02-19T21:50:25.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2529999999999998e-06 2024-02-19T21:50:25.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:25.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.332908+0000", 2024-02-19T21:50:25.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98429930899999996 2024-02-19T21:50:25.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:25.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:08.317207+0000", 2024-02-19T21:50:25.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7479999999999993e-06 2024-02-19T21:50:25.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:25.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:08.317215+0000", 2024-02-19T21:50:25.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98520220400000003 2024-02-19T21:50:25.681 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.681 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:25.681 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.681 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:17869 10.5 10.7795f505 (undecoded) ondisk+write+known_if_redirected e394)", 2024-02-19T21:50:25.681 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:49:07.336389+0000", 2024-02-19T21:50:25.681 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 78.325115538000006, 2024-02-19T21:50:25.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98085571699999996, 2024-02-19T21:50:25.681 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:25.682 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:50:25.682 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:25.682 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:25.682 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:25.682 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 17869 2024-02-19T21:50:25.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.682 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:25.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:25.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.336389+0000", 2024-02-19T21:50:25.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:25.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:25.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.336389+0000", 2024-02-19T21:50:25.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999976 2024-02-19T21:50:25.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.683 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:25.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.336387+0000", 2024-02-19T21:50:25.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2953e-05 2024-02-19T21:50:25.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.683 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:25.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.336430+0000", 2024-02-19T21:50:25.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2010000000000005e-06 2024-02-19T21:50:25.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.683 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:25.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.336439+0000", 2024-02-19T21:50:25.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9049999999999996e-06 2024-02-19T21:50:25.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:25.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.336444+0000", 2024-02-19T21:50:25.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7200999999999999e-05 2024-02-19T21:50:25.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:25.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.336471+0000", 2024-02-19T21:50:25.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0409999999999997e-06 2024-02-19T21:50:25.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:25.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.336476+0000", 2024-02-19T21:50:25.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98076181799999995 2024-02-19T21:50:25.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:25.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:08.317238+0000", 2024-02-19T21:50:25.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7889999999999997e-06 2024-02-19T21:50:25.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:25.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:08.317245+0000", 2024-02-19T21:50:25.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98085571699999996 2024-02-19T21:50:25.685 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.685 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:25.685 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.685 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:17871 10.5 10.2293315 (undecoded) ondisk+write+known_if_redirected e394)", 2024-02-19T21:50:25.685 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:49:07.338387+0000", 2024-02-19T21:50:25.686 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 78.323117694999993, 2024-02-19T21:50:25.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.97890178000000005, 2024-02-19T21:50:25.686 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:25.686 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:50:25.686 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:25.686 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:25.686 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:25.686 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 17871 2024-02-19T21:50:25.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.686 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:25.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:25.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.338387+0000", 2024-02-19T21:50:25.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:25.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:25.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.338387+0000", 2024-02-19T21:50:25.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:50:25.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:25.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.338385+0000", 2024-02-19T21:50:25.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7212000000000001e-05 2024-02-19T21:50:25.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:25.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.338433+0000", 2024-02-19T21:50:25.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3378e-05 2024-02-19T21:50:25.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:25.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.338446+0000", 2024-02-19T21:50:25.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9110000000000004e-06 2024-02-19T21:50:25.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:25.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.338453+0000", 2024-02-19T21:50:25.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6294999999999997e-05 2024-02-19T21:50:25.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:25.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.338489+0000", 2024-02-19T21:50:25.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7489999999999998e-06 2024-02-19T21:50:25.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:25.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:07.338494+0000", 2024-02-19T21:50:25.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.97878767899999997 2024-02-19T21:50:25.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:25.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:08.317282+0000", 2024-02-19T21:50:25.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0990000000000001e-06 2024-02-19T21:50:25.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:25.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:08.317289+0000", 2024-02-19T21:50:25.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.97890178000000005 2024-02-19T21:50:25.689 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.690 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:25.690 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.690 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "MOSDPGPushReply(10.5 422/414 [PushReplyOp(10:a6bd2865:::benchmark_data_smithi080_153340_object84:head)])", 2024-02-19T21:50:25.690 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:19.214603+0000", 2024-02-19T21:50:25.690 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 6.446901167, 2024-02-19T21:50:25.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3320758279999998, 2024-02-19T21:50:25.690 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:25.690 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:50:25.690 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:25.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:25.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.214603+0000", 2024-02-19T21:50:25.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:25.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:25.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.214603+0000", 2024-02-19T21:50:25.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:50:25.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:25.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.214603+0000", 2024-02-19T21:50:25.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2960000000000001e-06 2024-02-19T21:50:25.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:25.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.214610+0000", 2024-02-19T21:50:25.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6269999999999995e-06 2024-02-19T21:50:25.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:25.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.214619+0000", 2024-02-19T21:50:25.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7320000000000001e-06 2024-02-19T21:50:25.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:25.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.214626+0000", 2024-02-19T21:50:25.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.311022989 2024-02-19T21:50:25.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:25.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.525649+0000", 2024-02-19T21:50:25.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021029994 2024-02-19T21:50:25.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:25.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.546679+0000", 2024-02-19T21:50:25.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3320758279999998 2024-02-19T21:50:25.693 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.693 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:25.693 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.693 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:70729 10.5 10:a1b37663:::benchmark_data_smithi080_153340_object70728:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e422)", 2024-02-19T21:50:25.693 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:19.405517+0000", 2024-02-19T21:50:25.693 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 6.255987502, 2024-02-19T21:50:25.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.77948623800000005, 2024-02-19T21:50:25.694 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:25.694 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:25.694 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:25.694 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:25.694 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:25.694 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 70729 2024-02-19T21:50:25.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.694 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:25.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:25.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.405517+0000", 2024-02-19T21:50:25.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:25.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:25.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.405517+0000", 2024-02-19T21:50:25.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:50:25.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:25.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.405516+0000", 2024-02-19T21:50:25.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1848000000000002e-05 2024-02-19T21:50:25.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:25.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.405537+0000", 2024-02-19T21:50:25.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2125e-05 2024-02-19T21:50:25.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:25.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.405550+0000", 2024-02-19T21:50:25.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.339e-06 2024-02-19T21:50:25.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:25.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.405555+0000", 2024-02-19T21:50:25.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.70413997800000006 2024-02-19T21:50:25.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:25.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.109695+0000", 2024-02-19T21:50:25.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0095038320000000003 2024-02-19T21:50:25.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:25.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.119199+0000", 2024-02-19T21:50:25.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015780493 2024-02-19T21:50:25.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:50:25.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.134979+0000", 2024-02-19T21:50:25.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.034007025000000003 2024-02-19T21:50:25.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:25.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.168986+0000", 2024-02-19T21:50:25.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019737959999999999 2024-02-19T21:50:25.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:25.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.170960+0000", 2024-02-19T21:50:25.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00057004400000000002 2024-02-19T21:50:25.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:25.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.171530+0000", 2024-02-19T21:50:25.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026964900000000002 2024-02-19T21:50:25.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:50:25.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.174227+0000", 2024-02-19T21:50:25.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010776707999999999 2024-02-19T21:50:25.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:25.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.185003+0000", 2024-02-19T21:50:25.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.77948623800000005 2024-02-19T21:50:25.699 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.699 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:25.699 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.700 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "MOSDPGPush(10.5 422/414 [PushOp(10:a9225f3a:::benchmark_data_smithi080_153340_object122:head, version: 392'8, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(10:a9225f3a:::benchmark_data_smithi080_153340_object122:head@392'8, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-02-19T21:50:25.700 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:19.967853+0000", 2024-02-19T21:50:25.700 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.6936511850000002, 2024-02-19T21:50:25.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.356746711, 2024-02-19T21:50:25.700 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:25.700 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:50:25.700 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:25.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:25.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.967853+0000", 2024-02-19T21:50:25.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:25.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:25.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.967853+0000", 2024-02-19T21:50:25.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:50:25.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:25.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.967852+0000", 2024-02-19T21:50:25.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000105833 2024-02-19T21:50:25.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:25.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.967958+0000", 2024-02-19T21:50:25.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9928999999999998e-05 2024-02-19T21:50:25.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:25.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.967978+0000", 2024-02-19T21:50:25.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0701e-05 2024-02-19T21:50:25.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:25.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.967989+0000", 2024-02-19T21:50:25.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3380425790000001 2024-02-19T21:50:25.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:25.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.306031+0000", 2024-02-19T21:50:25.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053773899999999997 2024-02-19T21:50:25.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:25.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.306569+0000", 2024-02-19T21:50:25.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018030968000000001 2024-02-19T21:50:25.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:25.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.324600+0000", 2024-02-19T21:50:25.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.356746711 2024-02-19T21:50:25.704 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.704 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:25.704 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.704 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:70949 10.5 10:a9cd2b53:::benchmark_data_smithi080_153340_object70948:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e422)", 2024-02-19T21:50:25.704 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:20.112962+0000", 2024-02-19T21:50:25.704 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.5485428900000002, 2024-02-19T21:50:25.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.78973153500000004, 2024-02-19T21:50:25.704 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:25.704 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:25.704 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:25.704 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:25.704 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:25.704 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 70949 2024-02-19T21:50:25.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.705 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:25.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:25.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.112962+0000", 2024-02-19T21:50:25.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:25.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:25.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.112962+0000", 2024-02-19T21:50:25.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:50:25.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:25.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.112961+0000", 2024-02-19T21:50:25.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6371999999999998e-05 2024-02-19T21:50:25.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:25.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.112977+0000", 2024-02-19T21:50:25.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6519999999999995e-06 2024-02-19T21:50:25.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:25.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.112986+0000", 2024-02-19T21:50:25.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3869999999999997e-06 2024-02-19T21:50:25.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:25.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.112990+0000", 2024-02-19T21:50:25.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.68297099800000005 2024-02-19T21:50:25.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:25.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.795961+0000", 2024-02-19T21:50:25.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0064453280000000002 2024-02-19T21:50:25.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:25.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.802407+0000", 2024-02-19T21:50:25.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011112800000000001 2024-02-19T21:50:25.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:50:25.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.813519+0000", 2024-02-19T21:50:25.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.027383122999999999 2024-02-19T21:50:25.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:25.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.840903+0000", 2024-02-19T21:50:25.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016266340000000001 2024-02-19T21:50:25.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:25.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.842529+0000", 2024-02-19T21:50:25.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.046123322000000001 2024-02-19T21:50:25.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:25.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.888653+0000", 2024-02-19T21:50:25.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026560279999999999 2024-02-19T21:50:25.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:50:25.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.891309+0000", 2024-02-19T21:50:25.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011384610999999999 2024-02-19T21:50:25.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:25.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.902693+0000", 2024-02-19T21:50:25.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.78973153500000004 2024-02-19T21:50:25.709 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.709 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:25.709 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.709 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:70958 10.5 10:a7b67cd9:::benchmark_data_smithi080_153340_object70957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e422)", 2024-02-19T21:50:25.710 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:20.215206+0000", 2024-02-19T21:50:25.710 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.4462985120000003, 2024-02-19T21:50:25.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.77708459500000004, 2024-02-19T21:50:25.710 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:25.710 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:25.710 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:25.710 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:25.710 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:25.710 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 70958 2024-02-19T21:50:25.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.710 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:25.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.710 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:25.710 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.215206+0000", 2024-02-19T21:50:25.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:25.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:25.711 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.215206+0000", 2024-02-19T21:50:25.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999976 2024-02-19T21:50:25.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:25.711 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.215204+0000", 2024-02-19T21:50:25.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8101000000000001e-05 2024-02-19T21:50:25.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:25.711 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.215232+0000", 2024-02-19T21:50:25.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3233e-05 2024-02-19T21:50:25.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.712 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:25.712 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.215245+0000", 2024-02-19T21:50:25.712 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1559999999999998e-06 2024-02-19T21:50:25.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.712 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:25.712 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.215252+0000", 2024-02-19T21:50:25.712 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.70570904400000001 2024-02-19T21:50:25.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.712 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:25.712 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.920961+0000", 2024-02-19T21:50:25.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0064669710000000002 2024-02-19T21:50:25.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:25.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.927428+0000", 2024-02-19T21:50:25.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011406466000000001 2024-02-19T21:50:25.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:50:25.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.938835+0000", 2024-02-19T21:50:25.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.035880569000000001 2024-02-19T21:50:25.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:25.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.974715+0000", 2024-02-19T21:50:25.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060053000000000005 2024-02-19T21:50:25.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:25.714 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.975316+0000", 2024-02-19T21:50:25.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001730861 2024-02-19T21:50:25.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:25.714 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.977047+0000", 2024-02-19T21:50:25.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027512410000000002 2024-02-19T21:50:25.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:50:25.714 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.979798+0000", 2024-02-19T21:50:25.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012492609 2024-02-19T21:50:25.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:25.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.992291+0000", 2024-02-19T21:50:25.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.77708459500000004 2024-02-19T21:50:25.715 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.715 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:25.715 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.715 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:71175 10.5 10:af8ef75a:::benchmark_data_smithi080_153340_object71174:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e422)", 2024-02-19T21:50:25.715 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:20.829920+0000", 2024-02-19T21:50:25.715 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.831584672, 2024-02-19T21:50:25.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.81724333100000002, 2024-02-19T21:50:25.716 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:25.716 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:25.716 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:25.716 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:25.716 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:25.716 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 71175 2024-02-19T21:50:25.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.716 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:25.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:25.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.829920+0000", 2024-02-19T21:50:25.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:25.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:25.717 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.829920+0000", 2024-02-19T21:50:25.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:50:25.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:25.717 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.829919+0000", 2024-02-19T21:50:25.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2177000000000001e-05 2024-02-19T21:50:25.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:25.717 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.829941+0000", 2024-02-19T21:50:25.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1807999999999999e-05 2024-02-19T21:50:25.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:25.718 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.829953+0000", 2024-02-19T21:50:25.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.049e-06 2024-02-19T21:50:25.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.718 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:25.718 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:20.829959+0000", 2024-02-19T21:50:25.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.67964762999999995 2024-02-19T21:50:25.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.718 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:25.718 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:21.509606+0000", 2024-02-19T21:50:25.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0065718640000000002 2024-02-19T21:50:25.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.718 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:25.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:21.516178+0000", 2024-02-19T21:50:25.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011640025 2024-02-19T21:50:25.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.719 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:50:25.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:21.527818+0000", 2024-02-19T21:50:25.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.046849413999999999 2024-02-19T21:50:25.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.719 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:25.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:21.574668+0000", 2024-02-19T21:50:25.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034220610000000001 2024-02-19T21:50:25.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:25.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:21.578090+0000", 2024-02-19T21:50:25.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.054970278999999997 2024-02-19T21:50:25.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:25.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:21.633060+0000", 2024-02-19T21:50:25.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025793159999999999 2024-02-19T21:50:25.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:50:25.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:21.635639+0000", 2024-02-19T21:50:25.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011523876000000001 2024-02-19T21:50:25.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.721 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.721 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:25.721 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:21.647163+0000", 2024-02-19T21:50:25.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.81724333100000002 2024-02-19T21:50:25.721 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.721 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:25.721 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.721 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.721 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:71657 10.5 10:a743b362:::benchmark_data_smithi080_153340_object71656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e422)", 2024-02-19T21:50:25.721 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:22.050118+0000", 2024-02-19T21:50:25.721 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 3.6113867399999999, 2024-02-19T21:50:25.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.80787064399999997, 2024-02-19T21:50:25.721 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:25.721 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:25.722 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:25.722 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:25.722 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:25.722 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 71657 2024-02-19T21:50:25.722 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.722 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:25.722 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.722 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:25.722 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.050118+0000", 2024-02-19T21:50:25.722 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:25.722 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.722 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.722 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:25.722 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.050118+0000", 2024-02-19T21:50:25.722 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:50:25.722 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.722 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.723 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:25.723 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.050116+0000", 2024-02-19T21:50:25.723 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5568e-05 2024-02-19T21:50:25.723 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.723 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.723 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:25.723 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.050141+0000", 2024-02-19T21:50:25.723 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4313e-05 2024-02-19T21:50:25.723 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.723 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.723 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:25.723 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.050156+0000", 2024-02-19T21:50:25.723 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7489999999999998e-06 2024-02-19T21:50:25.723 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.723 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.723 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:25.723 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.050163+0000", 2024-02-19T21:50:25.724 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.74002689200000005 2024-02-19T21:50:25.724 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.724 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:25.724 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.790190+0000", 2024-02-19T21:50:25.724 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0070107010000000003 2024-02-19T21:50:25.724 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.724 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:25.724 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.797201+0000", 2024-02-19T21:50:25.724 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010917671 2024-02-19T21:50:25.724 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.724 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:50:25.724 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.808119+0000", 2024-02-19T21:50:25.724 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.034353404999999997 2024-02-19T21:50:25.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.725 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.725 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:25.725 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.842472+0000", 2024-02-19T21:50:25.725 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056903599999999998 2024-02-19T21:50:25.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.725 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.725 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:25.725 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.843041+0000", 2024-02-19T21:50:25.725 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015931140000000001 2024-02-19T21:50:25.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.725 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.725 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:25.725 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.844634+0000", 2024-02-19T21:50:25.725 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026925170000000002 2024-02-19T21:50:25.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.726 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.726 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:50:25.726 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.847327+0000", 2024-02-19T21:50:25.726 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010661643 2024-02-19T21:50:25.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.726 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.726 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:25.726 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.857988+0000", 2024-02-19T21:50:25.726 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.80787064399999997 2024-02-19T21:50:25.726 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.726 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:25.726 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.726 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.726 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:71658 10.5 10:aea5dd20:::benchmark_data_smithi080_153340_object71657:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e422)", 2024-02-19T21:50:25.726 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:22.053867+0000", 2024-02-19T21:50:25.727 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 3.607637811, 2024-02-19T21:50:25.727 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.82230144000000005, 2024-02-19T21:50:25.727 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:25.727 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:25.727 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:25.727 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:25.727 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:25.727 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 71658 2024-02-19T21:50:25.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.727 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:25.727 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.727 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:25.727 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.053867+0000", 2024-02-19T21:50:25.727 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:25.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.727 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.727 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:25.728 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.053867+0000", 2024-02-19T21:50:25.728 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999976 2024-02-19T21:50:25.728 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.728 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.728 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:25.728 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.053864+0000", 2024-02-19T21:50:25.728 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6840000000000001e-05 2024-02-19T21:50:25.728 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.728 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.728 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:25.728 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.053891+0000", 2024-02-19T21:50:25.728 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4365000000000001e-05 2024-02-19T21:50:25.728 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.728 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.728 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:25.728 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.053906+0000", 2024-02-19T21:50:25.729 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7800000000000001e-06 2024-02-19T21:50:25.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.729 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:25.729 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.053913+0000", 2024-02-19T21:50:25.729 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.76091211700000005 2024-02-19T21:50:25.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.729 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:25.729 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.814826+0000", 2024-02-19T21:50:25.729 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.006601417 2024-02-19T21:50:25.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.729 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:25.730 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.821427+0000", 2024-02-19T21:50:25.730 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012700293 2024-02-19T21:50:25.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.730 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.730 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:50:25.730 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.834127+0000", 2024-02-19T21:50:25.730 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025593708999999999 2024-02-19T21:50:25.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.730 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.730 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:25.730 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.859721+0000", 2024-02-19T21:50:25.730 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053342000000000005 2024-02-19T21:50:25.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.731 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:25.731 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.860254+0000", 2024-02-19T21:50:25.731 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016879589999999999 2024-02-19T21:50:25.731 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.731 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:25.731 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.861942+0000", 2024-02-19T21:50:25.731 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002598529 2024-02-19T21:50:25.731 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.731 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:50:25.731 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.864541+0000", 2024-02-19T21:50:25.731 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011627294999999999 2024-02-19T21:50:25.731 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.732 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:25.732 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.876168+0000", 2024-02-19T21:50:25.732 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.82230144000000005 2024-02-19T21:50:25.732 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.732 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:25.732 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.732 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.732 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.732 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:71676 10.5 10:aba9956b:::benchmark_data_smithi080_153340_object71675:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e422)", 2024-02-19T21:50:25.732 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:22.180471+0000", 2024-02-19T21:50:25.732 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 3.4810338359999999, 2024-02-19T21:50:25.732 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.78370078799999998, 2024-02-19T21:50:25.732 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:25.732 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:25.732 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:25.732 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:25.733 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:25.733 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 71676 2024-02-19T21:50:25.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.733 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:25.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.733 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:25.733 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.180471+0000", 2024-02-19T21:50:25.733 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:25.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.733 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:25.733 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.180471+0000", 2024-02-19T21:50:25.733 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999971 2024-02-19T21:50:25.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.733 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:25.734 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.180468+0000", 2024-02-19T21:50:25.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4219999999999999e-05 2024-02-19T21:50:25.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.734 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:25.734 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.180492+0000", 2024-02-19T21:50:25.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1956999999999999e-05 2024-02-19T21:50:25.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.734 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:25.734 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.180504+0000", 2024-02-19T21:50:25.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6829999999999996e-06 2024-02-19T21:50:25.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.734 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:25.734 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.180510+0000", 2024-02-19T21:50:25.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.72335706099999997 2024-02-19T21:50:25.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:25.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.903867+0000", 2024-02-19T21:50:25.735 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0072653020000000004 2024-02-19T21:50:25.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:25.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.911132+0000", 2024-02-19T21:50:25.735 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01073898 2024-02-19T21:50:25.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:50:25.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.921871+0000", 2024-02-19T21:50:25.735 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025288635 2024-02-19T21:50:25.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:25.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.947160+0000", 2024-02-19T21:50:25.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0020816839999999999 2024-02-19T21:50:25.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:25.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.949241+0000", 2024-02-19T21:50:25.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053364099999999995 2024-02-19T21:50:25.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:25.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.949775+0000", 2024-02-19T21:50:25.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031986829999999999 2024-02-19T21:50:25.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.737 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:50:25.737 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.952974+0000", 2024-02-19T21:50:25.737 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01119771 2024-02-19T21:50:25.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.737 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:25.737 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.964171+0000", 2024-02-19T21:50:25.737 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.78370078799999998 2024-02-19T21:50:25.737 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.737 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:25.737 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.738 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.738 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "MOSDPGPushReply(10.5 422/414 [PushReplyOp(10:a634bd6b:::benchmark_data_smithi080_153340_object102:head)])", 2024-02-19T21:50:25.738 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:22.194166+0000", 2024-02-19T21:50:25.738 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 3.4673389889999999, 2024-02-19T21:50:25.738 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.88346223199999996, 2024-02-19T21:50:25.738 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:25.738 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:50:25.738 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:25.738 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.738 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:25.738 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.194166+0000", 2024-02-19T21:50:25.738 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:25.738 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.738 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.738 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:25.739 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.194166+0000", 2024-02-19T21:50:25.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:50:25.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.739 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:25.739 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.194165+0000", 2024-02-19T21:50:25.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7559999999999996e-06 2024-02-19T21:50:25.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.739 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:25.739 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.194171+0000", 2024-02-19T21:50:25.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2720000000000003e-06 2024-02-19T21:50:25.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.740 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:25.740 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.194180+0000", 2024-02-19T21:50:25.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3529999999999997e-06 2024-02-19T21:50:25.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.740 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:25.740 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.194184+0000", 2024-02-19T21:50:25.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.85997385100000001 2024-02-19T21:50:25.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.740 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:25.740 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:23.054158+0000", 2024-02-19T21:50:25.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023469646 2024-02-19T21:50:25.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:25.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:23.077628+0000", 2024-02-19T21:50:25.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.88346223199999996 2024-02-19T21:50:25.741 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.741 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:25.741 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.741 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:71682 10.5 10:a4c81948:::benchmark_data_smithi080_153340_object71681:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e422)", 2024-02-19T21:50:25.741 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:22.217433+0000", 2024-02-19T21:50:25.741 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 3.4440719070000001, 2024-02-19T21:50:25.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.81809681199999995, 2024-02-19T21:50:25.742 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:25.742 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:25.742 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:25.742 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:25.742 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:25.742 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 71682 2024-02-19T21:50:25.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.742 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:25.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:25.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.217433+0000", 2024-02-19T21:50:25.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:25.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:25.743 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.217433+0000", 2024-02-19T21:50:25.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:50:25.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:25.743 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.217431+0000", 2024-02-19T21:50:25.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1087e-05 2024-02-19T21:50:25.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:25.743 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.217452+0000", 2024-02-19T21:50:25.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1693e-05 2024-02-19T21:50:25.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.744 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:25.744 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.217464+0000", 2024-02-19T21:50:25.744 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2970000000000003e-06 2024-02-19T21:50:25.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.744 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:25.744 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.217469+0000", 2024-02-19T21:50:25.744 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.74762612399999995 2024-02-19T21:50:25.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.744 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:25.744 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.965095+0000", 2024-02-19T21:50:25.744 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.006690901 2024-02-19T21:50:25.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:25.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.971786+0000", 2024-02-19T21:50:25.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012318358999999999 2024-02-19T21:50:25.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:50:25.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.984105+0000", 2024-02-19T21:50:25.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.034471905999999997 2024-02-19T21:50:25.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:25.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:23.018577+0000", 2024-02-19T21:50:25.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001664907 2024-02-19T21:50:25.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.746 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:25.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:23.020241+0000", 2024-02-19T21:50:25.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00052455799999999995 2024-02-19T21:50:25.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.746 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:25.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:23.020766+0000", 2024-02-19T21:50:25.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033919990000000001 2024-02-19T21:50:25.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:50:25.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:23.024158+0000", 2024-02-19T21:50:25.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011371424 2024-02-19T21:50:25.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:25.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:23.035529+0000", 2024-02-19T21:50:25.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.81809681199999995 2024-02-19T21:50:25.747 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.747 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:25.747 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.747 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:71750 10.5 10:a74cf9a9:::benchmark_data_smithi080_153340_object71749:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e422)", 2024-02-19T21:50:25.748 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:22.498185+0000", 2024-02-19T21:50:25.748 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 3.1633194179999999, 2024-02-19T21:50:25.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.80982817399999996, 2024-02-19T21:50:25.748 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:25.748 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:25.748 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:25.748 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:25.748 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:25.748 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 71750 2024-02-19T21:50:25.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.748 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:25.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:25.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.498185+0000", 2024-02-19T21:50:25.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:25.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:25.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.498185+0000", 2024-02-19T21:50:25.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:50:25.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:25.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.498183+0000", 2024-02-19T21:50:25.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5358999999999997e-05 2024-02-19T21:50:25.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:25.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.498229+0000", 2024-02-19T21:50:25.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2621e-05 2024-02-19T21:50:25.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:25.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.498241+0000", 2024-02-19T21:50:25.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6420000000000007e-06 2024-02-19T21:50:25.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:25.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.498249+0000", 2024-02-19T21:50:25.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.74200412900000001 2024-02-19T21:50:25.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:25.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:23.240253+0000", 2024-02-19T21:50:25.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.006593341 2024-02-19T21:50:25.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:25.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:23.246846+0000", 2024-02-19T21:50:25.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011041995000000001 2024-02-19T21:50:25.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:50:25.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:23.257888+0000", 2024-02-19T21:50:25.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.031689585999999999 2024-02-19T21:50:25.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:25.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:23.289578+0000", 2024-02-19T21:50:25.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0021377850000000001 2024-02-19T21:50:25.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:25.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:23.291716+0000", 2024-02-19T21:50:25.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00052133500000000005 2024-02-19T21:50:25.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:25.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:23.292237+0000", 2024-02-19T21:50:25.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033504189999999999 2024-02-19T21:50:25.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:50:25.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:23.295588+0000", 2024-02-19T21:50:25.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012425797000000001 2024-02-19T21:50:25.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:25.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:23.308013+0000", 2024-02-19T21:50:25.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.80982817399999996 2024-02-19T21:50:25.753 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.753 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:25.753 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.753 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:72410 10.5 10:a6800d65:::benchmark_data_smithi080_153340_object72409:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e423)", 2024-02-19T21:50:25.753 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:24.600053+0000", 2024-02-19T21:50:25.753 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.0614516489999999, 2024-02-19T21:50:25.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.82103764099999998, 2024-02-19T21:50:25.754 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:25.754 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:25.754 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:25.754 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:25.754 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:25.754 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 72410 2024-02-19T21:50:25.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.754 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:25.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.754 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:25.754 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:24.600053+0000", 2024-02-19T21:50:25.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:25.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:25.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:24.600053+0000", 2024-02-19T21:50:25.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:50:25.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:25.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:24.600051+0000", 2024-02-19T21:50:25.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3620000000000001e-05 2024-02-19T21:50:25.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:25.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:24.600075+0000", 2024-02-19T21:50:25.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2829e-05 2024-02-19T21:50:25.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:25.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:24.600087+0000", 2024-02-19T21:50:25.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6744000000000001e-05 2024-02-19T21:50:25.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:25.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:24.600104+0000", 2024-02-19T21:50:25.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.683391682 2024-02-19T21:50:25.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:25.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:25.283496+0000", 2024-02-19T21:50:25.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014546694000000001 2024-02-19T21:50:25.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:25.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:25.298043+0000", 2024-02-19T21:50:25.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015565188000000001 2024-02-19T21:50:25.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:50:25.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:25.313608+0000", 2024-02-19T21:50:25.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.030929673000000001 2024-02-19T21:50:25.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:25.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:25.344537+0000", 2024-02-19T21:50:25.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016005679999999999 2024-02-19T21:50:25.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:25.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:25.346138+0000", 2024-02-19T21:50:25.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.060316540000000002 2024-02-19T21:50:25.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:25.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:25.406455+0000", 2024-02-19T21:50:25.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002667979 2024-02-19T21:50:25.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:50:25.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:25.409123+0000", 2024-02-19T21:50:25.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011967983 2024-02-19T21:50:25.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:25.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:25.421091+0000", 2024-02-19T21:50:25.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.82103764099999998 2024-02-19T21:50:25.759 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.759 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:25.759 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.759 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:72416 10.5 10:a01bf592:::benchmark_data_smithi080_153340_object72415:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e423)", 2024-02-19T21:50:25.759 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:24.621927+0000", 2024-02-19T21:50:25.759 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.039577894, 2024-02-19T21:50:25.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.81422716500000003, 2024-02-19T21:50:25.759 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:25.759 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:25.759 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:25.760 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:25.760 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:25.760 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 72416 2024-02-19T21:50:25.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.760 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:25.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:25.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:24.621927+0000", 2024-02-19T21:50:25.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:25.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:25.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:24.621927+0000", 2024-02-19T21:50:25.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:50:25.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:25.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:24.621925+0000", 2024-02-19T21:50:25.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.234e-05 2024-02-19T21:50:25.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:25.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:24.621947+0000", 2024-02-19T21:50:25.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1559999999999999e-05 2024-02-19T21:50:25.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:25.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:24.621959+0000", 2024-02-19T21:50:25.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1780000000000002e-06 2024-02-19T21:50:25.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:25.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:24.621964+0000", 2024-02-19T21:50:25.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.72479587499999998 2024-02-19T21:50:25.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:25.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:25.346760+0000", 2024-02-19T21:50:25.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.007223429 2024-02-19T21:50:25.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:25.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:25.353983+0000", 2024-02-19T21:50:25.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012313119000000001 2024-02-19T21:50:25.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:50:25.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:25.366296+0000", 2024-02-19T21:50:25.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.035720571999999999 2024-02-19T21:50:25.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:25.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:25.402017+0000", 2024-02-19T21:50:25.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022663710000000001 2024-02-19T21:50:25.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:25.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:25.404283+0000", 2024-02-19T21:50:25.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017338566999999999 2024-02-19T21:50:25.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:25.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:25.421622+0000", 2024-02-19T21:50:25.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027280410000000001 2024-02-19T21:50:25.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:50:25.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:25.424350+0000", 2024-02-19T21:50:25.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011803799 2024-02-19T21:50:25.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:25.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:25.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:25.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:25.436154+0000", 2024-02-19T21:50:25.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.81422716500000003 2024-02-19T21:50:25.765 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.765 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:25.765 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.765 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:25.765 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:25.765 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:50:25.765 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:50:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:25.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:25.270269+0000 mon.a (mon.0) 1687 : cluster [WRN] Health check update: Degraded data redundancy: 12336/213423 objects degraded (5.780%), 9 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:50:25.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:25.278862+0000 mon.a (mon.0) 1688 : cluster [DBG] osdmap e424: 8 total, 8 up, 7 in 2024-02-19T21:50:25.807 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:50:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:50:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:50:25.856 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:50:25.861 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:25.861 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:50:25.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:25.270269+0000 mon.a (mon.0) 1687 : cluster [WRN] Health check update: Degraded data redundancy: 12336/213423 objects degraded (5.780%), 9 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:50:25.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:25.278862+0000 mon.a (mon.0) 1688 : cluster [DBG] osdmap e424: 8 total, 8 up, 7 in 2024-02-19T21:50:25.882 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:25.270269+0000 mon.a (mon.0) 1687 : cluster [WRN] Health check update: Degraded data redundancy: 12336/213423 objects degraded (5.780%), 9 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:50:25.882 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:25.278862+0000 mon.a (mon.0) 1688 : cluster [DBG] osdmap e424: 8 total, 8 up, 7 in 2024-02-19T21:50:25.963 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:50:26.000 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:26.029 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:50:26.034 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:26.034 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:50:26.134 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:50:26.178 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:26.214 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:50:26.217 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:26.217 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:50:26.218 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-19T21:50:26.287 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 85 16 72977 72961 53.6382 22 0.00670825 0.0185759 2024-02-19T21:50:26.318 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:50:26.374 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:26.731 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:50:26.739 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:26.740 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:50:26.841 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:50:26.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:25.169634+0000 mgr.y (mgr.14514) 679 : cluster [DBG] pgmap v882: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.4 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 517 B/s rd, 17 MiB/s wr, 276 op/s; 12279/216072 objects degraded (5.683%); 4117/216072 objects misplaced (1.905%); 1.5 MiB/s, 23 objects/s recovering 2024-02-19T21:50:26.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:25.249373+0000 osd.2 (osd.2) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:50:26.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:25.249421+0000 osd.2 (osd.2) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:50:26.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:25.169634+0000 mgr.y (mgr.14514) 679 : cluster [DBG] pgmap v882: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.4 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 517 B/s rd, 17 MiB/s wr, 276 op/s; 12279/216072 objects degraded (5.683%); 4117/216072 objects misplaced (1.905%); 1.5 MiB/s, 23 objects/s recovering 2024-02-19T21:50:26.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:25.249373+0000 osd.2 (osd.2) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:50:26.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:25.249421+0000 osd.2 (osd.2) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:50:26.878 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:26.948 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:50:26.949 INFO:teuthology.orchestra.run.smithi080.stdout:{"fsid":"6f763558-cf6d-11ee-95bb-87774f69a715","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"nodeep-scrub flag(s) set","count":12},"muted":false},"PG_BACKFILL_FULL":{"severity":"HEALTH_WARN","summary":{"message":"Low space hindering backfill (add storage if this doesn't resolve itself): 2 pgs backfill_toofull","count":2},"muted":false},"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 12279/216072 objects degraded (5.683%), 9 pgs degraded, 4 pgs undersized","count":13},"muted":false}},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1314,"monmap":{"epoch":3,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":424,"num_osds":8,"num_up_osds":8,"osd_up_since":1708379347,"num_in_osds":7,"osd_in_since":1708379252,"num_remapped_pgs":9},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":126},{"state_name":"active+recovering+undersized+degraded+remapped","count":4},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":3},{"state_name":"active+recovery_wait+degraded","count":2},{"state_name":"active+recovery_wait","count":1},{"state_name":"active+remapped+backfill_toofull","count":1},{"state_name":"active+remapped+backfill_wait+backfill_toofull","count":1}],"num_pgs":138,"num_pools":7,"num_objects":72024,"data_bytes":4707587748,"bytes_used":18400395264,"bytes_avail":653564854272,"bytes_total":671965249536,"degraded_objects":12279,"degraded_total":216072,"degraded_ratio":0.056828279462401425,"misplaced_objects":4117,"misplaced_total":216072,"misplaced_ratio":0.019053833907216114,"recovering_objects_per_sec":23,"recovering_bytes_per_sec":1555658,"recovering_keys_per_sec":0,"num_objects_recovered":235,"num_bytes_recovered":15400960,"num_keys_recovered":0,"read_bytes_sec":517,"write_bytes_sec":18085355,"read_op_per_sec":0,"write_op_per_sec":275},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"services":{"dashboard":"https://172.21.15.80:8443/","prometheus":"http://172.21.15.80:9283/"}},"servicemap":{"epoch":15,"modified":"2024-02-19T21:50:07.164150+0000","services":{"rgw":{"daemons":{"summary":"","14445":{"start_epoch":12,"start_stamp":"2024-02-19T21:32:30.457944+0000","gid":14445,"addr":"172.21.15.80:0/10763483","metadata":{"arch":"x86_64","ceph_release":"pacific","ceph_version":"ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)","ceph_version_short":"16.2.14-548-g81bd20d6","container_hostname":"smithi080","container_image":"quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9","cpu":"Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz","distro":"centos","distro_description":"CentOS Stream 8","distro_version":"8","frontend_config#0":"beast port=80","frontend_type#0":"beast","hostname":"smithi080","id":"foo.a","kernel_description":"#1 SMP Mon Feb 5 18:34:56 UTC 2024","kernel_version":"4.18.0-539.el8.x86_64","mem_swap_kb":"0","mem_total_kb":"32537572","num_handles":"1","os":"Linux","pid":"7","realm_id":"","realm_name":"","zone_id":"34a855d6-dbbc-4802-a6e9-a7d60f23c9d4","zone_name":"default","zonegroup_id":"7194a06a-53d8-4b5f-8306-5954e6d460c8","zonegroup_name":"default"},"task_status":{}}}}}},"progress_events":{"0d84ec8e-b738-4996-b3e9-d3d54263ac3b":{"message":"Global Recovery Event (2m)\n [=========================...] (remaining: 16s)","progress":0.91304349899291992,"add_to_ceph_s":true}}} 2024-02-19T21:50:27.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:25.169634+0000 mgr.y (mgr.14514) 679 : cluster [DBG] pgmap v882: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.4 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 517 B/s rd, 17 MiB/s wr, 276 op/s; 12279/216072 objects degraded (5.683%); 4117/216072 objects misplaced (1.905%); 1.5 MiB/s, 23 objects/s recovering 2024-02-19T21:50:27.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:25.249373+0000 osd.2 (osd.2) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:50:27.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:25.249421+0000 osd.2 (osd.2) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:50:27.288 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 86 16 73413 73397 53.3314 27.25 0.00370231 0.0186858 2024-02-19T21:50:27.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:26.949433+0000 mon.c (mon.2) 103 : audit [DBG] from='client.? 172.21.15.80:0/510936486' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-02-19T21:50:27.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:26.949433+0000 mon.c (mon.2) 103 : audit [DBG] from='client.? 172.21.15.80:0/510936486' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-02-19T21:50:28.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:26.949433+0000 mon.c (mon.2) 103 : audit [DBG] from='client.? 172.21.15.80:0/510936486' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-02-19T21:50:28.095 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_ops_in_flight 2024-02-19T21:50:28.287 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 87 16 73779 73763 52.9813 22.875 0.00387705 0.0188094 2024-02-19T21:50:28.767 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:27.170140+0000 mgr.y (mgr.14514) 680 : cluster [DBG] pgmap v884: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.4 GiB data, 17 GiB used, 608 GiB / 626 GiB avail; 1.2 KiB/s rd, 25 MiB/s wr, 393 op/s; 12161/218262 objects degraded (5.572%); 4115/218262 objects misplaced (1.885%); 2.7 MiB/s, 43 objects/s recovering 2024-02-19T21:50:28.767 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:27.765002+0000 osd.5 (osd.5) 267 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:50:28.767 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:27.765058+0000 osd.5 (osd.5) 268 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:50:28.768 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:27.170140+0000 mgr.y (mgr.14514) 680 : cluster [DBG] pgmap v884: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.4 GiB data, 17 GiB used, 608 GiB / 626 GiB avail; 1.2 KiB/s rd, 25 MiB/s wr, 393 op/s; 12161/218262 objects degraded (5.572%); 4115/218262 objects misplaced (1.885%); 2.7 MiB/s, 43 objects/s recovering 2024-02-19T21:50:28.768 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:27.765002+0000 osd.5 (osd.5) 267 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:50:28.768 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:27.765058+0000 osd.5 (osd.5) 268 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:50:28.795 INFO:tasks.cephadm.ceph_manager.ceph:making progress, resetting timeout 2024-02-19T21:50:28.795 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:50:29.033 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:50:29.037 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:29.038 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:50:29.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:27.170140+0000 mgr.y (mgr.14514) 680 : cluster [DBG] pgmap v884: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.4 GiB data, 17 GiB used, 608 GiB / 626 GiB avail; 1.2 KiB/s rd, 25 MiB/s wr, 393 op/s; 12161/218262 objects degraded (5.572%); 4115/218262 objects misplaced (1.885%); 2.7 MiB/s, 43 objects/s recovering 2024-02-19T21:50:29.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:27.765002+0000 osd.5 (osd.5) 267 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:50:29.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:27.765058+0000 osd.5 (osd.5) 268 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:50:29.138 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:50:29.171 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:29.229 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:50:29.232 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:29.233 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:50:29.287 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 88 16 74131 74115 52.6293 22 0.00409389 0.0189314 2024-02-19T21:50:29.333 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:50:29.371 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:29.397 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:50:29.398 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:50:29.401 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:29.402 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:50:29.422 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:50:29.422 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:50:29.465 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:50:29.476 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:50:29.496 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:50:29.503 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:50:29.524 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:50:29.535 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:29.550 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:50:29.568 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:50:29.572 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:29.572 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:50:29.574 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:50:29.594 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:50:29.596 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:50:29.596 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:50:29.596 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:50:29.596 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:50:29.596 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:50:29.596 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:50:29.596 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:50:29.596 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:50:29.673 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:50:29.698 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:29.721 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:50:29.724 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:29.724 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:50:29.825 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:50:29.856 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:30.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:28.642005+0000 mon.a (mon.0) 1689 : cluster [DBG] osdmap e425: 8 total, 8 up, 7 in 2024-02-19T21:50:30.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:29.370035+0000 mon.b (mon.1) 66 : audit [DBG] from='client.? 172.21.15.80:0/3225965861' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:50:30.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:28.642005+0000 mon.a (mon.0) 1689 : cluster [DBG] osdmap e425: 8 total, 8 up, 7 in 2024-02-19T21:50:30.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:29.370035+0000 mon.b (mon.1) 66 : audit [DBG] from='client.? 172.21.15.80:0/3225965861' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:50:30.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:28.642005+0000 mon.a (mon.0) 1689 : cluster [DBG] osdmap e425: 8 total, 8 up, 7 in 2024-02-19T21:50:30.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:29.370035+0000 mon.b (mon.1) 66 : audit [DBG] from='client.? 172.21.15.80:0/3225965861' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:50:30.287 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 89 16 74431 74415 52.2486 18.75 0.0080578 0.0190624 2024-02-19T21:50:30.308 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:50:30.312 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:30.312 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:50:30.325 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:50:30.413 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:50:30.451 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:30.476 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:50:30.479 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:30.479 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:50:30.580 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:50:30.610 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:30.636 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:50:30.641 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:30.642 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:50:30.742 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:50:30.782 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:29.170649+0000 mgr.y (mgr.14514) 681 : cluster [DBG] pgmap v886: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.4 GiB data, 17 GiB used, 608 GiB / 626 GiB avail; 779 B/s rd, 15 MiB/s wr, 246 op/s; 12161/218262 objects degraded (5.572%); 4115/218262 objects misplaced (1.885%); 1.7 MiB/s, 26 objects/s recovering 2024-02-19T21:50:30.782 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:30.272463+0000 mon.a (mon.0) 1690 : cluster [WRN] Health check update: Degraded data redundancy: 12161/218262 objects degraded (5.572%), 9 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:50:30.782 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:30.279899+0000 mon.a (mon.0) 1691 : cluster [DBG] osdmap e426: 8 total, 8 up, 7 in 2024-02-19T21:50:30.784 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:30.810 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:50:30.813 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:30.814 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:50:30.821 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:50:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:50:30] "GET /metrics HTTP/1.1" 200 176537 "" "Prometheus/2.33.4" 2024-02-19T21:50:30.823 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:29.170649+0000 mgr.y (mgr.14514) 681 : cluster [DBG] pgmap v886: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.4 GiB data, 17 GiB used, 608 GiB / 626 GiB avail; 779 B/s rd, 15 MiB/s wr, 246 op/s; 12161/218262 objects degraded (5.572%); 4115/218262 objects misplaced (1.885%); 1.7 MiB/s, 26 objects/s recovering 2024-02-19T21:50:30.823 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:30.272463+0000 mon.a (mon.0) 1690 : cluster [WRN] Health check update: Degraded data redundancy: 12161/218262 objects degraded (5.572%), 9 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:50:30.823 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:30.279899+0000 mon.a (mon.0) 1691 : cluster [DBG] osdmap e426: 8 total, 8 up, 7 in 2024-02-19T21:50:30.824 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:29.170649+0000 mgr.y (mgr.14514) 681 : cluster [DBG] pgmap v886: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.4 GiB data, 17 GiB used, 608 GiB / 626 GiB avail; 779 B/s rd, 15 MiB/s wr, 246 op/s; 12161/218262 objects degraded (5.572%); 4115/218262 objects misplaced (1.885%); 1.7 MiB/s, 26 objects/s recovering 2024-02-19T21:50:30.824 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:30.272463+0000 mon.a (mon.0) 1690 : cluster [WRN] Health check update: Degraded data redundancy: 12161/218262 objects degraded (5.572%), 9 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:50:30.824 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:30.279899+0000 mon.a (mon.0) 1691 : cluster [DBG] osdmap e426: 8 total, 8 up, 7 in 2024-02-19T21:50:30.914 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:50:30.950 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:30.983 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:50:30.986 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:30.986 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:50:31.056 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:50:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:50:31.087 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:50:31.119 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:31.288 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 90 14 74747 74733 51.8889 19.875 0.00358807 0.019207 2024-02-19T21:50:31.571 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:50:31.573 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:31.573 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:50:31.674 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:50:31.705 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:31.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:30.961793+0000 mgr.y (mgr.14514) 682 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:50:31.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:30.961793+0000 mgr.y (mgr.14514) 682 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:50:32.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:30.961793+0000 mgr.y (mgr.14514) 682 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:50:32.288 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Total time run: 90.5473 2024-02-19T21:50:32.288 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Total writes made: 74747 2024-02-19T21:50:32.288 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Write size: 65536 2024-02-19T21:50:32.288 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Object size: 65536 2024-02-19T21:50:32.288 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Bandwidth (MB/sec): 51.5939 2024-02-19T21:50:32.288 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Stddev Bandwidth: 46.8586 2024-02-19T21:50:32.288 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Max bandwidth (MB/sec): 242 2024-02-19T21:50:32.289 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Min bandwidth (MB/sec): 0 2024-02-19T21:50:32.289 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Average IOPS: 825 2024-02-19T21:50:32.289 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Stddev IOPS: 749.749 2024-02-19T21:50:32.289 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Max IOPS: 3872 2024-02-19T21:50:32.289 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Min IOPS: 0 2024-02-19T21:50:32.289 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Average Latency(s): 0.0193192 2024-02-19T21:50:32.289 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Stddev Latency(s): 0.145266 2024-02-19T21:50:32.289 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Max latency(s): 10.2576 2024-02-19T21:50:32.289 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Min latency(s): 0.00134319 2024-02-19T21:50:32.292 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Cleaning up (deleting benchmark objects) 2024-02-19T21:50:32.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:31.171194+0000 mgr.y (mgr.14514) 683 : cluster [DBG] pgmap v888: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.5 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1.7 KiB/s rd, 26 MiB/s wr, 412 op/s; 11988/223473 objects degraded (5.364%); 4115/223473 objects misplaced (1.841%); 3.0 MiB/s, 48 objects/s recovering 2024-02-19T21:50:32.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:31.171194+0000 mgr.y (mgr.14514) 683 : cluster [DBG] pgmap v888: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.5 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1.7 KiB/s rd, 26 MiB/s wr, 412 op/s; 11988/223473 objects degraded (5.364%); 4115/223473 objects misplaced (1.841%); 3.0 MiB/s, 48 objects/s recovering 2024-02-19T21:50:33.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:31.171194+0000 mgr.y (mgr.14514) 683 : cluster [DBG] pgmap v888: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.5 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1.7 KiB/s rd, 26 MiB/s wr, 412 op/s; 11988/223473 objects degraded (5.364%); 4115/223473 objects misplaced (1.841%); 3.0 MiB/s, 48 objects/s recovering 2024-02-19T21:50:33.857 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:50:33.862 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:33.863 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:50:33.964 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:50:33.990 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:34.011 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:50:34.016 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:34.016 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:50:34.117 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:50:34.150 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:34.189 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:50:34.193 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:34.193 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:50:34.294 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:50:34.325 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:34.553 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:50:34.556 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:34.557 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:50:34.658 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:50:34.671 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-02-19T21:50:34.696 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:34.723 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:50:34.725 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:34.725 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:50:34.826 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:50:34.860 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:34.882 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:50:34.883 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:34.884 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:50:34.920 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:50:34.948 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:33.171662+0000 mgr.y (mgr.14514) 684 : cluster [DBG] pgmap v889: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.5 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 648 B/s rd, 17 MiB/s wr, 271 op/s; 11986/223779 objects degraded (5.356%); 4112/223779 objects misplaced (1.838%); 1.4 MiB/s, 22 objects/s recovering 2024-02-19T21:50:34.948 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:34.424431+0000 mon.a (mon.0) 1692 : audit [INF] from='client.? 172.21.15.80:0/2752519371' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:50:34.949 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:33.171662+0000 mgr.y (mgr.14514) 684 : cluster [DBG] pgmap v889: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.5 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 648 B/s rd, 17 MiB/s wr, 271 op/s; 11986/223779 objects degraded (5.356%); 4112/223779 objects misplaced (1.838%); 1.4 MiB/s, 22 objects/s recovering 2024-02-19T21:50:34.949 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:34.424431+0000 mon.a (mon.0) 1692 : audit [INF] from='client.? 172.21.15.80:0/2752519371' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:50:34.985 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:50:35.023 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:35.054 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:50:35.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:33.171662+0000 mgr.y (mgr.14514) 684 : cluster [DBG] pgmap v889: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.5 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 648 B/s rd, 17 MiB/s wr, 271 op/s; 11986/223779 objects degraded (5.356%); 4112/223779 objects misplaced (1.838%); 1.4 MiB/s, 22 objects/s recovering 2024-02-19T21:50:35.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:34.424431+0000 mon.a (mon.0) 1692 : audit [INF] from='client.? 172.21.15.80:0/2752519371' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:50:35.058 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:35.059 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:50:35.160 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:50:35.190 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:35.215 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:50:35.221 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:35.221 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:50:35.322 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:50:35.353 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:35.386 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:50:35.387 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:50:36.019 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:34.656190+0000 mon.a (mon.0) 1693 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:50:36.019 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:34.663452+0000 mon.a (mon.0) 1694 : audit [INF] from='client.? 172.21.15.80:0/2752519371' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:50:36.019 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:34.663512+0000 mon.a (mon.0) 1695 : cluster [DBG] osdmap e427: 8 total, 8 up, 7 in 2024-02-19T21:50:36.019 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:35.274220+0000 mon.a (mon.0) 1696 : cluster [WRN] Health check update: Degraded data redundancy: 11986/223779 objects degraded (5.356%), 9 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:50:36.020 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:35.278618+0000 mon.a (mon.0) 1697 : cluster [DBG] osdmap e428: 8 total, 8 up, 7 in 2024-02-19T21:50:36.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:34.656190+0000 mon.a (mon.0) 1693 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:50:36.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:34.663452+0000 mon.a (mon.0) 1694 : audit [INF] from='client.? 172.21.15.80:0/2752519371' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:50:36.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:34.663512+0000 mon.a (mon.0) 1695 : cluster [DBG] osdmap e427: 8 total, 8 up, 7 in 2024-02-19T21:50:36.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:35.274220+0000 mon.a (mon.0) 1696 : cluster [WRN] Health check update: Degraded data redundancy: 11986/223779 objects degraded (5.356%), 9 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:50:36.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:35.278618+0000 mon.a (mon.0) 1697 : cluster [DBG] osdmap e428: 8 total, 8 up, 7 in 2024-02-19T21:50:36.044 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_blocked_ops 2024-02-19T21:50:36.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:50:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:50:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:50:36.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:34.656190+0000 mon.a (mon.0) 1693 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:50:36.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:34.663452+0000 mon.a (mon.0) 1694 : audit [INF] from='client.? 172.21.15.80:0/2752519371' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:50:36.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:34.663512+0000 mon.a (mon.0) 1695 : cluster [DBG] osdmap e427: 8 total, 8 up, 7 in 2024-02-19T21:50:36.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:35.274220+0000 mon.a (mon.0) 1696 : cluster [WRN] Health check update: Degraded data redundancy: 11986/223779 objects degraded (5.356%), 9 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:50:36.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:35.278618+0000 mon.a (mon.0) 1697 : cluster [DBG] osdmap e428: 8 total, 8 up, 7 in 2024-02-19T21:50:36.403 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:50:36.406 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:36.406 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:50:36.507 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:50:36.538 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:36.560 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:50:36.564 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:36.564 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:50:36.665 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:50:36.677 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:50:36.685 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:35.177801+0000 mgr.y (mgr.14514) 685 : cluster [DBG] pgmap v891: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.5 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 939 B/s rd, 20 MiB/s wr, 379 op/s; 11929/223182 objects degraded (5.345%); 4112/223182 objects misplaced (1.842%); 2.2 MiB/s, 35 objects/s recovering 2024-02-19T21:50:36.695 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:36.721 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:50:36.722 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:36.723 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:50:36.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:35.177801+0000 mgr.y (mgr.14514) 685 : cluster [DBG] pgmap v891: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.5 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 939 B/s rd, 20 MiB/s wr, 379 op/s; 11929/223182 objects degraded (5.345%); 4112/223182 objects misplaced (1.842%); 2.2 MiB/s, 35 objects/s recovering 2024-02-19T21:50:36.824 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:50:36.864 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:36.886 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:50:36.888 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:36.889 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:50:36.923 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:50:36.925 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:50:36.952 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:35.177801+0000 mgr.y (mgr.14514) 685 : cluster [DBG] pgmap v891: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.5 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 939 B/s rd, 20 MiB/s wr, 379 op/s; 11929/223182 objects degraded (5.345%); 4112/223182 objects misplaced (1.842%); 2.2 MiB/s, 35 objects/s recovering 2024-02-19T21:50:36.989 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:50:37.014 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:50:37.024 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:37.052 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:50:37.055 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:37.055 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:50:37.156 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:50:37.185 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:37.695 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:36.018314+0000 osd.7 (osd.7) 246 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:50:37.695 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:36.018363+0000 osd.7 (osd.7) 247 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:50:37.695 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:36.674938+0000 mon.a (mon.0) 1698 : cluster [DBG] osdmap e429: 8 total, 8 up, 7 in 2024-02-19T21:50:37.695 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:36.897668+0000 mgr.y (mgr.14514) 686 : audit [DBG] from='client.25435 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:50:38.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:36.018314+0000 osd.7 (osd.7) 246 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:50:38.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:36.018363+0000 osd.7 (osd.7) 247 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:50:38.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:36.674938+0000 mon.a (mon.0) 1698 : cluster [DBG] osdmap e429: 8 total, 8 up, 7 in 2024-02-19T21:50:38.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:36.897668+0000 mgr.y (mgr.14514) 686 : audit [DBG] from='client.25435 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:50:38.071 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:36.018314+0000 osd.7 (osd.7) 246 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:50:38.071 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:36.018363+0000 osd.7 (osd.7) 247 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:50:38.071 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:36.674938+0000 mon.a (mon.0) 1698 : cluster [DBG] osdmap e429: 8 total, 8 up, 7 in 2024-02-19T21:50:38.071 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:36.897668+0000 mgr.y (mgr.14514) 686 : audit [DBG] from='client.25435 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:50:38.094 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":893,"stamp":"2024-02-19T21:50:36.672703+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4852422332,"num_objects":74235,"num_object_clones":0,"num_object_copies":222705,"num_objects_missing_on_primary":1148,"num_objects_missing":1148,"num_objects_degraded":11735,"num_objects_misplaced":4112,"num_objects_unfound":0,"num_objects_dirty":74235,"num_whiteouts":0,"num_read":2196,"num_read_kb":1948,"num_write":76155,"num_write_kb":4783529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4301,"num_bytes_recovered":263396122,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76088,"ondisk_log_size":76088,"up":414,"acting":407,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":421,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":656216064,"kb_used":18536060,"kb_used_data":14025348,"kb_used_omap":0,"kb_used_meta":4510655,"kb_avail":637680004,"statfs":{"total":671965249536,"available":652984324096,"internally_reserved":0,"allocated":14361956352,"data_stored":14353509373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":4618910772},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2424808,"num_objects":-36,"num_object_clones":0,"num_object_copies":-108,"num_objects_missing_on_primary":-2,"num_objects_missing":-2,"num_objects_degraded":-253,"num_objects_misplaced":-3,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1364,"num_write_kb":42433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":14090240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.395365"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":23,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.297610+0000","last_change":"2024-02-19T21:49:54.492937+0000","last_active":"2024-02-19T21:50:30.297610+0000","last_peered":"2024-02-19T21:50:30.297610+0000","last_clean":"2024-02-19T21:50:30.297610+0000","last_became_active":"2024-02-19T21:49:54.492544+0000","last_became_peered":"2024-02-19T21:49:54.492544+0000","last_unstale":"2024-02-19T21:50:30.297610+0000","last_undegraded":"2024-02-19T21:50:30.297610+0000","last_fullsized":"2024-02-19T21:50:30.297610+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.643236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.643236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":402,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.288533+0000","last_change":"2024-02-19T21:45:17.201007+0000","last_active":"2024-02-19T21:50:30.288533+0000","last_peered":"2024-02-19T21:50:30.288533+0000","last_clean":"2024-02-19T21:50:30.288533+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:50:30.288533+0000","last_undegraded":"2024-02-19T21:50:30.288533+0000","last_fullsized":"2024-02-19T21:50:30.288533+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:17.200897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:17.200897+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"201'27","reported_seq":70,"reported_epoch":425,"state":"active+clean","last_fresh":"2024-02-19T21:50:28.646315+0000","last_change":"2024-02-19T21:49:08.327817+0000","last_active":"2024-02-19T21:50:28.646315+0000","last_peered":"2024-02-19T21:50:28.646315+0000","last_clean":"2024-02-19T21:50:28.646315+0000","last_became_active":"2024-02-19T21:49:08.327416+0000","last_became_peered":"2024-02-19T21:49:08.327416+0000","last_unstale":"2024-02-19T21:50:28.646315+0000","last_undegraded":"2024-02-19T21:50:28.646315+0000","last_fullsized":"2024-02-19T21:50:28.646315+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'27","last_scrub_stamp":"2024-02-19T21:44:48.022013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:48.022013+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":375,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.287451+0000","last_change":"2024-02-19T21:48:30.516215+0000","last_active":"2024-02-19T21:50:30.287451+0000","last_peered":"2024-02-19T21:50:30.287451+0000","last_clean":"2024-02-19T21:50:30.287451+0000","last_became_active":"2024-02-19T21:47:46.250178+0000","last_became_peered":"2024-02-19T21:47:46.250178+0000","last_unstale":"2024-02-19T21:50:30.287451+0000","last_undegraded":"2024-02-19T21:50:30.287451+0000","last_fullsized":"2024-02-19T21:50:30.287451+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.516139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.516139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":98,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.289361+0000","last_change":"2024-02-19T21:49:08.330105+0000","last_active":"2024-02-19T21:50:30.289361+0000","last_peered":"2024-02-19T21:50:30.289361+0000","last_clean":"2024-02-19T21:50:30.289361+0000","last_became_active":"2024-02-19T21:49:08.328994+0000","last_became_peered":"2024-02-19T21:49:08.328994+0000","last_unstale":"2024-02-19T21:50:30.289361+0000","last_undegraded":"2024-02-19T21:50:30.289361+0000","last_fullsized":"2024-02-19T21:50:30.289361+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.636083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.636083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"200'19","reported_seq":471,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.287353+0000","last_change":"2024-02-19T21:48:26.530234+0000","last_active":"2024-02-19T21:50:30.287353+0000","last_peered":"2024-02-19T21:50:30.287353+0000","last_clean":"2024-02-19T21:50:30.287353+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:50:30.287353+0000","last_undegraded":"2024-02-19T21:50:30.287353+0000","last_fullsized":"2024-02-19T21:50:30.287353+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:48:26.530160+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.530160+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":159,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.277335+0000","last_change":"2024-02-19T21:49:08.332091+0000","last_active":"2024-02-19T21:50:30.277335+0000","last_peered":"2024-02-19T21:50:30.277335+0000","last_clean":"2024-02-19T21:50:30.277335+0000","last_became_active":"2024-02-19T21:49:08.331753+0000","last_became_peered":"2024-02-19T21:49:08.331753+0000","last_unstale":"2024-02-19T21:50:30.277335+0000","last_undegraded":"2024-02-19T21:50:30.277335+0000","last_fullsized":"2024-02-19T21:50:30.277335+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.005236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.005236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":415,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.298058+0000","last_change":"2024-02-19T21:48:28.327028+0000","last_active":"2024-02-19T21:50:30.298058+0000","last_peered":"2024-02-19T21:50:30.298058+0000","last_clean":"2024-02-19T21:50:30.298058+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:50:30.298058+0000","last_undegraded":"2024-02-19T21:50:30.298058+0000","last_fullsized":"2024-02-19T21:50:30.298058+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.326938+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"310'9","reported_seq":369,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.287991+0000","last_change":"2024-02-19T21:49:08.329655+0000","last_active":"2024-02-19T21:50:30.287991+0000","last_peered":"2024-02-19T21:50:30.287991+0000","last_clean":"2024-02-19T21:50:30.287991+0000","last_became_active":"2024-02-19T21:49:08.329314+0000","last_became_peered":"2024-02-19T21:49:08.329314+0000","last_unstale":"2024-02-19T21:50:30.287991+0000","last_undegraded":"2024-02-19T21:50:30.287991+0000","last_fullsized":"2024-02-19T21:50:30.287991+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"310'9","last_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_deep_scrub":"310'9","last_deep_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.506188+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":336,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.288579+0000","last_change":"2024-02-19T21:46:31.205220+0000","last_active":"2024-02-19T21:50:30.288579+0000","last_peered":"2024-02-19T21:50:30.288579+0000","last_clean":"2024-02-19T21:50:30.288579+0000","last_became_active":"2024-02-19T21:46:31.204816+0000","last_became_peered":"2024-02-19T21:46:31.204816+0000","last_unstale":"2024-02-19T21:50:30.288579+0000","last_undegraded":"2024-02-19T21:50:30.288579+0000","last_fullsized":"2024-02-19T21:50:30.288579+0000","mapping_epoch":330,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":331,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:36.890201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.890201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":437,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.297945+0000","last_change":"2024-02-19T21:49:08.330669+0000","last_active":"2024-02-19T21:50:30.297945+0000","last_peered":"2024-02-19T21:50:30.297945+0000","last_clean":"2024-02-19T21:50:30.297945+0000","last_became_active":"2024-02-19T21:49:08.329998+0000","last_became_peered":"2024-02-19T21:49:08.329998+0000","last_unstale":"2024-02-19T21:50:30.297945+0000","last_undegraded":"2024-02-19T21:50:30.297945+0000","last_fullsized":"2024-02-19T21:50:30.297945+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:58.329316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:58.329316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"200'19","reported_seq":281,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.287624+0000","last_change":"2024-02-19T21:49:08.326162+0000","last_active":"2024-02-19T21:50:30.287624+0000","last_peered":"2024-02-19T21:50:30.287624+0000","last_clean":"2024-02-19T21:50:30.287624+0000","last_became_active":"2024-02-19T21:49:08.325802+0000","last_became_peered":"2024-02-19T21:49:08.325802+0000","last_unstale":"2024-02-19T21:50:30.287624+0000","last_undegraded":"2024-02-19T21:50:30.287624+0000","last_fullsized":"2024-02-19T21:50:30.287624+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:46:54.873416+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:46:54.873416+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2],"acting":[4,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":347,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.293914+0000","last_change":"2024-02-19T21:49:04.432817+0000","last_active":"2024-02-19T21:50:30.293914+0000","last_peered":"2024-02-19T21:50:30.293914+0000","last_clean":"2024-02-19T21:50:30.293914+0000","last_became_active":"2024-02-19T21:47:33.393708+0000","last_became_peered":"2024-02-19T21:47:33.393708+0000","last_unstale":"2024-02-19T21:50:30.293914+0000","last_undegraded":"2024-02-19T21:50:30.293914+0000","last_fullsized":"2024-02-19T21:50:30.293914+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:04.432733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:04.432733+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":23,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.297652+0000","last_change":"2024-02-19T21:49:54.492767+0000","last_active":"2024-02-19T21:50:30.297652+0000","last_peered":"2024-02-19T21:50:30.297652+0000","last_clean":"2024-02-19T21:50:30.297652+0000","last_became_active":"2024-02-19T21:49:54.491745+0000","last_became_peered":"2024-02-19T21:49:54.491745+0000","last_unstale":"2024-02-19T21:50:30.297652+0000","last_undegraded":"2024-02-19T21:50:30.297652+0000","last_fullsized":"2024-02-19T21:50:30.297652+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.232539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.232539+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1d","version":"201'18","reported_seq":365,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.320588+0000","last_change":"2024-02-19T21:48:25.734661+0000","last_active":"2024-02-19T21:50:30.320588+0000","last_peered":"2024-02-19T21:50:30.320588+0000","last_clean":"2024-02-19T21:50:30.320588+0000","last_became_active":"2024-02-19T21:38:31.247067+0000","last_became_peered":"2024-02-19T21:38:31.247067+0000","last_unstale":"2024-02-19T21:50:30.320588+0000","last_undegraded":"2024-02-19T21:50:30.320588+0000","last_fullsized":"2024-02-19T21:50:30.320588+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'18","last_scrub_stamp":"2024-02-19T21:48:25.734591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.734591+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":402,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.288970+0000","last_change":"2024-02-19T21:48:40.528082+0000","last_active":"2024-02-19T21:50:30.288970+0000","last_peered":"2024-02-19T21:50:30.288970+0000","last_clean":"2024-02-19T21:50:30.288970+0000","last_became_active":"2024-02-19T21:44:58.788307+0000","last_became_peered":"2024-02-19T21:44:58.788307+0000","last_unstale":"2024-02-19T21:50:30.288970+0000","last_undegraded":"2024-02-19T21:50:30.288970+0000","last_fullsized":"2024-02-19T21:50:30.288970+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:40.527970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:48:40.527970+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":410,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.292252+0000","last_change":"2024-02-19T21:48:11.557832+0000","last_active":"2024-02-19T21:50:30.292252+0000","last_peered":"2024-02-19T21:50:30.292252+0000","last_clean":"2024-02-19T21:50:30.292252+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:50:30.292252+0000","last_undegraded":"2024-02-19T21:50:30.292252+0000","last_fullsized":"2024-02-19T21:50:30.292252+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.557736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:17.913620+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.557736+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"200'34","reported_seq":71,"reported_epoch":425,"state":"active+clean","last_fresh":"2024-02-19T21:50:28.646925+0000","last_change":"2024-02-19T21:49:08.332575+0000","last_active":"2024-02-19T21:50:28.646925+0000","last_peered":"2024-02-19T21:50:28.646925+0000","last_clean":"2024-02-19T21:50:28.646925+0000","last_became_active":"2024-02-19T21:49:08.331742+0000","last_became_peered":"2024-02-19T21:49:08.331742+0000","last_unstale":"2024-02-19T21:50:28.646925+0000","last_undegraded":"2024-02-19T21:50:28.646925+0000","last_fullsized":"2024-02-19T21:50:28.646925+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'34","last_scrub_stamp":"2024-02-19T21:45:49.728734+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:45:49.728734+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":422,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.320145+0000","last_change":"2024-02-19T21:46:44.994389+0000","last_active":"2024-02-19T21:50:30.320145+0000","last_peered":"2024-02-19T21:50:30.320145+0000","last_clean":"2024-02-19T21:50:30.320145+0000","last_became_active":"2024-02-19T21:44:58.790669+0000","last_became_peered":"2024-02-19T21:44:58.790669+0000","last_unstale":"2024-02-19T21:50:30.320145+0000","last_undegraded":"2024-02-19T21:50:30.320145+0000","last_fullsized":"2024-02-19T21:50:30.320145+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.994296+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":358,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.291400+0000","last_change":"2024-02-19T21:49:08.330330+0000","last_active":"2024-02-19T21:50:30.291400+0000","last_peered":"2024-02-19T21:50:30.291400+0000","last_clean":"2024-02-19T21:50:30.291400+0000","last_became_active":"2024-02-19T21:49:08.329986+0000","last_became_peered":"2024-02-19T21:49:08.329986+0000","last_unstale":"2024-02-19T21:50:30.291400+0000","last_undegraded":"2024-02-19T21:50:30.291400+0000","last_fullsized":"2024-02-19T21:50:30.291400+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.091409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.091409+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"201'19","reported_seq":306,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.288445+0000","last_change":"2024-02-19T21:48:26.366639+0000","last_active":"2024-02-19T21:50:30.288445+0000","last_peered":"2024-02-19T21:50:30.288445+0000","last_clean":"2024-02-19T21:50:30.288445+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:50:30.288445+0000","last_undegraded":"2024-02-19T21:50:30.288445+0000","last_fullsized":"2024-02-19T21:50:30.288445+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:26.366563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.366563+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":270,"reported_epoch":426,"state":"active+remapped+backfill_wait+backfill_toofull","last_fresh":"2024-02-19T21:50:30.297481+0000","last_change":"2024-02-19T21:49:38.335602+0000","last_active":"2024-02-19T21:50:30.297481+0000","last_peered":"2024-02-19T21:50:30.297481+0000","last_clean":"2024-02-19T21:49:06.309838+0000","last_became_active":"2024-02-19T21:49:08.329545+0000","last_became_peered":"2024-02-19T21:49:08.329545+0000","last_unstale":"2024-02-19T21:50:30.297481+0000","last_undegraded":"2024-02-19T21:50:30.297481+0000","last_fullsized":"2024-02-19T21:50:30.297481+0000","mapping_epoch":394,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":371,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:13.196112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:13.196112+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,3],"avail_no_missing":["7","3","5"],"object_location_counts":[{"shards":"3,5,7","objects":1}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":422,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.275920+0000","last_change":"2024-02-19T21:49:54.491840+0000","last_active":"2024-02-19T21:50:30.275920+0000","last_peered":"2024-02-19T21:50:30.275920+0000","last_clean":"2024-02-19T21:50:30.275920+0000","last_became_active":"2024-02-19T21:49:54.491488+0000","last_became_peered":"2024-02-19T21:49:54.491488+0000","last_unstale":"2024-02-19T21:50:30.275920+0000","last_undegraded":"2024-02-19T21:50:30.275920+0000","last_fullsized":"2024-02-19T21:50:30.275920+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.803606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.803606+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"201'20","reported_seq":507,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.289454+0000","last_change":"2024-02-19T21:49:54.502402+0000","last_active":"2024-02-19T21:50:30.289454+0000","last_peered":"2024-02-19T21:50:30.289454+0000","last_clean":"2024-02-19T21:50:30.289454+0000","last_became_active":"2024-02-19T21:49:54.483748+0000","last_became_peered":"2024-02-19T21:49:54.483748+0000","last_unstale":"2024-02-19T21:50:30.289454+0000","last_undegraded":"2024-02-19T21:50:30.289454+0000","last_fullsized":"2024-02-19T21:50:30.289454+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:48:25.348437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.348437+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":342,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.287647+0000","last_change":"2024-02-19T21:49:08.328206+0000","last_active":"2024-02-19T21:50:30.287647+0000","last_peered":"2024-02-19T21:50:30.287647+0000","last_clean":"2024-02-19T21:50:30.287647+0000","last_became_active":"2024-02-19T21:49:08.327865+0000","last_became_peered":"2024-02-19T21:49:08.327865+0000","last_unstale":"2024-02-19T21:50:30.287647+0000","last_undegraded":"2024-02-19T21:50:30.287647+0000","last_fullsized":"2024-02-19T21:50:30.287647+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.230652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.230652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":402,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.297475+0000","last_change":"2024-02-19T21:48:22.171667+0000","last_active":"2024-02-19T21:50:30.297475+0000","last_peered":"2024-02-19T21:50:30.297475+0000","last_clean":"2024-02-19T21:50:30.297475+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:50:30.297475+0000","last_undegraded":"2024-02-19T21:50:30.297475+0000","last_fullsized":"2024-02-19T21:50:30.297475+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.171600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.171600+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":438,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.294046+0000","last_change":"2024-02-19T21:49:08.330636+0000","last_active":"2024-02-19T21:50:30.294046+0000","last_peered":"2024-02-19T21:50:30.294046+0000","last_clean":"2024-02-19T21:50:30.294046+0000","last_became_active":"2024-02-19T21:49:08.330293+0000","last_became_peered":"2024-02-19T21:49:08.330293+0000","last_unstale":"2024-02-19T21:50:30.294046+0000","last_undegraded":"2024-02-19T21:50:30.294046+0000","last_fullsized":"2024-02-19T21:50:30.294046+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:03.034839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:03.034839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"381'24","reported_seq":35,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.297460+0000","last_change":"2024-02-19T21:49:55.368481+0000","last_active":"2024-02-19T21:50:30.297460+0000","last_peered":"2024-02-19T21:50:30.297460+0000","last_clean":"2024-02-19T21:50:30.297460+0000","last_became_active":"2024-02-19T21:49:54.485438+0000","last_became_peered":"2024-02-19T21:49:54.485438+0000","last_unstale":"2024-02-19T21:50:30.297460+0000","last_undegraded":"2024-02-19T21:50:30.297460+0000","last_fullsized":"2024-02-19T21:50:30.297460+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"381'24","last_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_deep_scrub":"381'24","last_deep_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_clean_scrub_stamp":"2024-02-19T21:48:39.382725+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,5],"acting":[7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":430,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.297435+0000","last_change":"2024-02-19T21:49:17.193002+0000","last_active":"2024-02-19T21:50:30.297435+0000","last_peered":"2024-02-19T21:50:30.297435+0000","last_clean":"2024-02-19T21:50:30.297435+0000","last_became_active":"2024-02-19T21:49:08.333537+0000","last_became_peered":"2024-02-19T21:49:08.333537+0000","last_unstale":"2024-02-19T21:50:30.297435+0000","last_undegraded":"2024-02-19T21:50:30.297435+0000","last_fullsized":"2024-02-19T21:50:30.297435+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:59.339649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:45:59.339649+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":458,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.291479+0000","last_change":"2024-02-19T21:49:54.494561+0000","last_active":"2024-02-19T21:50:30.291479+0000","last_peered":"2024-02-19T21:50:30.291479+0000","last_clean":"2024-02-19T21:50:30.291479+0000","last_became_active":"2024-02-19T21:49:54.494146+0000","last_became_peered":"2024-02-19T21:49:54.494146+0000","last_unstale":"2024-02-19T21:50:30.291479+0000","last_undegraded":"2024-02-19T21:50:30.291479+0000","last_fullsized":"2024-02-19T21:50:30.291479+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.560066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":432,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.276972+0000","last_change":"2024-02-19T21:49:09.765641+0000","last_active":"2024-02-19T21:50:30.276972+0000","last_peered":"2024-02-19T21:50:30.276972+0000","last_clean":"2024-02-19T21:50:30.276972+0000","last_became_active":"2024-02-19T21:49:08.331308+0000","last_became_peered":"2024-02-19T21:49:08.331308+0000","last_unstale":"2024-02-19T21:50:30.276972+0000","last_undegraded":"2024-02-19T21:50:30.276972+0000","last_fullsized":"2024-02-19T21:50:30.276972+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.765568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.765568+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"200'8","reported_seq":119,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.319876+0000","last_change":"2024-02-19T21:47:33.577363+0000","last_active":"2024-02-19T21:50:30.319876+0000","last_peered":"2024-02-19T21:50:30.319876+0000","last_clean":"2024-02-19T21:50:30.319876+0000","last_became_active":"2024-02-19T21:47:33.395217+0000","last_became_peered":"2024-02-19T21:47:33.395217+0000","last_unstale":"2024-02-19T21:50:30.319876+0000","last_undegraded":"2024-02-19T21:50:30.319876+0000","last_fullsized":"2024-02-19T21:50:30.319876+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'8","last_scrub_stamp":"2024-02-19T21:46:47.761677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.761677+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":342,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.287726+0000","last_change":"2024-02-19T21:49:08.918163+0000","last_active":"2024-02-19T21:50:30.287726+0000","last_peered":"2024-02-19T21:50:30.287726+0000","last_clean":"2024-02-19T21:50:30.287726+0000","last_became_active":"2024-02-19T21:49:08.328416+0000","last_became_peered":"2024-02-19T21:49:08.328416+0000","last_unstale":"2024-02-19T21:50:30.287726+0000","last_undegraded":"2024-02-19T21:50:30.287726+0000","last_fullsized":"2024-02-19T21:50:30.287726+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.918083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.918083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":420,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.320666+0000","last_change":"2024-02-19T21:49:54.480716+0000","last_active":"2024-02-19T21:50:30.320666+0000","last_peered":"2024-02-19T21:50:30.320666+0000","last_clean":"2024-02-19T21:50:30.320666+0000","last_became_active":"2024-02-19T21:49:54.480368+0000","last_became_peered":"2024-02-19T21:49:54.480368+0000","last_unstale":"2024-02-19T21:50:30.320666+0000","last_undegraded":"2024-02-19T21:50:30.320666+0000","last_fullsized":"2024-02-19T21:50:30.320666+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:19.596775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:19.596775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":404,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.320329+0000","last_change":"2024-02-19T21:49:05.012463+0000","last_active":"2024-02-19T21:50:30.320329+0000","last_peered":"2024-02-19T21:50:30.320329+0000","last_clean":"2024-02-19T21:50:30.320329+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:50:30.320329+0000","last_undegraded":"2024-02-19T21:50:30.320329+0000","last_fullsized":"2024-02-19T21:50:30.320329+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.012395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.012395+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"201'19","reported_seq":451,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.288136+0000","last_change":"2024-02-19T21:48:38.529106+0000","last_active":"2024-02-19T21:50:30.288136+0000","last_peered":"2024-02-19T21:50:30.288136+0000","last_clean":"2024-02-19T21:50:30.288136+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:50:30.288136+0000","last_undegraded":"2024-02-19T21:50:30.288136+0000","last_fullsized":"2024-02-19T21:50:30.288136+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:38.528977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.528977+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":407,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.288254+0000","last_change":"2024-02-19T21:46:06.096531+0000","last_active":"2024-02-19T21:50:30.288254+0000","last_peered":"2024-02-19T21:50:30.288254+0000","last_clean":"2024-02-19T21:50:30.288254+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:50:30.288254+0000","last_undegraded":"2024-02-19T21:50:30.288254+0000","last_fullsized":"2024-02-19T21:50:30.288254+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.096422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":218,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.291872+0000","last_change":"2024-02-19T21:48:38.391532+0000","last_active":"2024-02-19T21:50:30.291872+0000","last_peered":"2024-02-19T21:50:30.291872+0000","last_clean":"2024-02-19T21:50:30.291872+0000","last_became_active":"2024-02-19T21:47:33.395085+0000","last_became_peered":"2024-02-19T21:47:33.395085+0000","last_unstale":"2024-02-19T21:50:30.291872+0000","last_undegraded":"2024-02-19T21:50:30.291872+0000","last_fullsized":"2024-02-19T21:50:30.291872+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:38.391435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.391435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":419,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.291930+0000","last_change":"2024-02-19T21:48:14.600378+0000","last_active":"2024-02-19T21:50:30.291930+0000","last_peered":"2024-02-19T21:50:30.291930+0000","last_clean":"2024-02-19T21:50:30.291930+0000","last_became_active":"2024-02-19T21:47:33.393932+0000","last_became_peered":"2024-02-19T21:47:33.393932+0000","last_unstale":"2024-02-19T21:50:30.291930+0000","last_undegraded":"2024-02-19T21:50:30.291930+0000","last_fullsized":"2024-02-19T21:50:30.291930+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:14.600285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.600285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"200'15","reported_seq":473,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.320506+0000","last_change":"2024-02-19T21:49:08.334199+0000","last_active":"2024-02-19T21:50:30.320506+0000","last_peered":"2024-02-19T21:50:30.320506+0000","last_clean":"2024-02-19T21:50:30.320506+0000","last_became_active":"2024-02-19T21:49:08.333872+0000","last_became_peered":"2024-02-19T21:49:08.333872+0000","last_unstale":"2024-02-19T21:50:30.320506+0000","last_undegraded":"2024-02-19T21:50:30.320506+0000","last_fullsized":"2024-02-19T21:50:30.320506+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:45:08.678669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:08.678669+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":385,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.288311+0000","last_change":"2024-02-19T21:49:08.330114+0000","last_active":"2024-02-19T21:50:30.288311+0000","last_peered":"2024-02-19T21:50:30.288311+0000","last_clean":"2024-02-19T21:50:30.288311+0000","last_became_active":"2024-02-19T21:49:08.329770+0000","last_became_peered":"2024-02-19T21:49:08.329770+0000","last_unstale":"2024-02-19T21:50:30.288311+0000","last_undegraded":"2024-02-19T21:50:30.288311+0000","last_fullsized":"2024-02-19T21:50:30.288311+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:08.983923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.983923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"415'17","reported_seq":31,"reported_epoch":426,"state":"active+recovery_wait","last_fresh":"2024-02-19T21:50:32.080801+0000","last_change":"2024-02-19T21:49:57.074730+0000","last_active":"2024-02-19T21:50:32.080801+0000","last_peered":"2024-02-19T21:50:32.080801+0000","last_clean":"2024-02-19T21:47:10.198854+0000","last_became_active":"2024-02-19T21:49:54.486304+0000","last_became_peered":"2024-02-19T21:49:54.486304+0000","last_unstale":"2024-02-19T21:50:32.080801+0000","last_undegraded":"2024-02-19T21:50:32.080801+0000","last_fullsized":"2024-02-19T21:50:32.080801+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"199'13","last_scrub_stamp":"2024-02-19T21:45:05.721709+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:45:05.721709+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":["7","1","2","4"],"object_location_counts":[{"shards":"1,2,7","objects":1}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":429,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.287853+0000","last_change":"2024-02-19T21:49:54.484516+0000","last_active":"2024-02-19T21:50:30.287853+0000","last_peered":"2024-02-19T21:50:30.287853+0000","last_clean":"2024-02-19T21:50:30.287853+0000","last_became_active":"2024-02-19T21:49:54.483689+0000","last_became_peered":"2024-02-19T21:49:54.483689+0000","last_unstale":"2024-02-19T21:50:30.287853+0000","last_undegraded":"2024-02-19T21:50:30.287853+0000","last_fullsized":"2024-02-19T21:50:30.287853+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.157478+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"201'19","reported_seq":450,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.276660+0000","last_change":"2024-02-19T21:48:27.720048+0000","last_active":"2024-02-19T21:50:30.276660+0000","last_peered":"2024-02-19T21:50:30.276660+0000","last_clean":"2024-02-19T21:50:30.276660+0000","last_became_active":"2024-02-19T21:47:33.398295+0000","last_became_peered":"2024-02-19T21:47:33.398295+0000","last_unstale":"2024-02-19T21:50:30.276660+0000","last_undegraded":"2024-02-19T21:50:30.276660+0000","last_fullsized":"2024-02-19T21:50:30.276660+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:27.719954+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:48:27.719954+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":146,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.289264+0000","last_change":"2024-02-19T21:49:54.484392+0000","last_active":"2024-02-19T21:50:30.289264+0000","last_peered":"2024-02-19T21:50:30.289264+0000","last_clean":"2024-02-19T21:50:30.289264+0000","last_became_active":"2024-02-19T21:49:54.484049+0000","last_became_peered":"2024-02-19T21:49:54.484049+0000","last_unstale":"2024-02-19T21:50:30.289264+0000","last_undegraded":"2024-02-19T21:50:30.289264+0000","last_fullsized":"2024-02-19T21:50:30.289264+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.121769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.121769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":627,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:32.080566+0000","last_change":"2024-02-19T21:48:38.723220+0000","last_active":"2024-02-19T21:50:32.080566+0000","last_peered":"2024-02-19T21:50:32.080566+0000","last_clean":"2024-02-19T21:50:32.080566+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:50:32.080566+0000","last_undegraded":"2024-02-19T21:50:32.080566+0000","last_fullsized":"2024-02-19T21:50:32.080566+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:48:38.723151+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.723151+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":433,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.276474+0000","last_change":"2024-02-19T21:49:54.485462+0000","last_active":"2024-02-19T21:50:30.276474+0000","last_peered":"2024-02-19T21:50:30.276474+0000","last_clean":"2024-02-19T21:50:30.276474+0000","last_became_active":"2024-02-19T21:49:54.485121+0000","last_became_peered":"2024-02-19T21:49:54.485121+0000","last_unstale":"2024-02-19T21:50:30.276474+0000","last_undegraded":"2024-02-19T21:50:30.276474+0000","last_fullsized":"2024-02-19T21:50:30.276474+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:07.724097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:49:07.724097+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"201'25","reported_seq":311,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.320997+0000","last_change":"2024-02-19T21:49:08.335077+0000","last_active":"2024-02-19T21:50:30.320997+0000","last_peered":"2024-02-19T21:50:30.320997+0000","last_clean":"2024-02-19T21:50:30.320997+0000","last_became_active":"2024-02-19T21:49:08.334061+0000","last_became_peered":"2024-02-19T21:49:08.334061+0000","last_unstale":"2024-02-19T21:50:30.320997+0000","last_undegraded":"2024-02-19T21:50:30.320997+0000","last_fullsized":"2024-02-19T21:50:30.320997+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'25","last_scrub_stamp":"2024-02-19T21:46:07.553690+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.553690+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":402,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.297984+0000","last_change":"2024-02-19T21:48:21.256471+0000","last_active":"2024-02-19T21:50:30.297984+0000","last_peered":"2024-02-19T21:50:30.297984+0000","last_clean":"2024-02-19T21:50:30.297984+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:50:30.297984+0000","last_undegraded":"2024-02-19T21:50:30.297984+0000","last_fullsized":"2024-02-19T21:50:30.297984+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.256358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.256358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":409,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.291551+0000","last_change":"2024-02-19T21:46:35.035136+0000","last_active":"2024-02-19T21:50:30.291551+0000","last_peered":"2024-02-19T21:50:30.291551+0000","last_clean":"2024-02-19T21:50:30.291551+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:50:30.291551+0000","last_undegraded":"2024-02-19T21:50:30.291551+0000","last_fullsized":"2024-02-19T21:50:30.291551+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:35.035042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:35.035042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"201'12","reported_seq":21,"reported_epoch":426,"state":"active+recovery_wait+degraded","last_fresh":"2024-02-19T21:50:30.298538+0000","last_change":"2024-02-19T21:49:54.478418+0000","last_active":"2024-02-19T21:50:30.298538+0000","last_peered":"2024-02-19T21:50:30.298538+0000","last_clean":"2024-02-19T21:49:49.433484+0000","last_became_active":"2024-02-19T21:49:54.478094+0000","last_became_peered":"2024-02-19T21:49:54.478094+0000","last_unstale":"2024-02-19T21:50:30.298538+0000","last_undegraded":"2024-02-19T21:49:54.469051+0000","last_fullsized":"2024-02-19T21:50:30.298538+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'12","last_scrub_stamp":"2024-02-19T21:49:08.912638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.912638+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":3,"num_objects_missing":3,"num_objects_degraded":3,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":["1","2","6"],"object_location_counts":[{"shards":"1,2,6","objects":3}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":54,"reported_epoch":425,"state":"active+clean","last_fresh":"2024-02-19T21:50:28.646970+0000","last_change":"2024-02-19T21:49:08.332757+0000","last_active":"2024-02-19T21:50:28.646970+0000","last_peered":"2024-02-19T21:50:28.646970+0000","last_clean":"2024-02-19T21:50:28.646970+0000","last_became_active":"2024-02-19T21:49:08.332176+0000","last_became_peered":"2024-02-19T21:49:08.332176+0000","last_unstale":"2024-02-19T21:50:28.646970+0000","last_undegraded":"2024-02-19T21:50:28.646970+0000","last_fullsized":"2024-02-19T21:50:28.646970+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:47:01.365477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:47:01.365477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":54,"reported_epoch":425,"state":"active+clean","last_fresh":"2024-02-19T21:50:28.646309+0000","last_change":"2024-02-19T21:49:08.328632+0000","last_active":"2024-02-19T21:50:28.646309+0000","last_peered":"2024-02-19T21:50:28.646309+0000","last_clean":"2024-02-19T21:50:28.646309+0000","last_became_active":"2024-02-19T21:49:08.327826+0000","last_became_peered":"2024-02-19T21:49:08.327826+0000","last_unstale":"2024-02-19T21:50:28.646309+0000","last_undegraded":"2024-02-19T21:50:28.646309+0000","last_fullsized":"2024-02-19T21:50:28.646309+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:09.645607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:44:09.645607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"200'15","reported_seq":523,"reported_epoch":426,"state":"active+recovery_wait+degraded","last_fresh":"2024-02-19T21:50:30.289392+0000","last_change":"2024-02-19T21:49:54.484033+0000","last_active":"2024-02-19T21:50:30.289392+0000","last_peered":"2024-02-19T21:50:30.289392+0000","last_clean":"2024-02-19T21:49:49.432972+0000","last_became_active":"2024-02-19T21:49:54.483578+0000","last_became_peered":"2024-02-19T21:49:54.483578+0000","last_unstale":"2024-02-19T21:50:30.289392+0000","last_undegraded":"2024-02-19T21:49:54.471563+0000","last_fullsized":"2024-02-19T21:50:30.289392+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:44:53.072746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:53.072746+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":["0","2","6"],"object_location_counts":[{"shards":"0,2,6","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"427'4796","reported_seq":4851,"reported_epoch":427,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-02-19T21:50:35.025994+0000","last_change":"2024-02-19T21:49:09.774432+0000","last_active":"2024-02-19T21:50:35.025994+0000","last_peered":"2024-02-19T21:50:35.025994+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:09.770699+0000","last_became_peered":"2024-02-19T21:49:09.770699+0000","last_unstale":"2024-02-19T21:50:35.025994+0000","last_undegraded":"2024-02-19T21:49:09.328794+0000","last_fullsized":"2024-02-19T21:49:09.325036+0000","mapping_epoch":395,"log_start":"392'100","ondisk_log_start":"392'100","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4696,"ondisk_log_size":4696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":306446336,"num_objects":4676,"num_object_clones":0,"num_object_copies":14028,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1108,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4676,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4796,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5],"avail_no_missing":["6","5"],"object_location_counts":[{"shards":"5,6","objects":3568}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":23,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.297564+0000","last_change":"2024-02-19T21:49:54.492844+0000","last_active":"2024-02-19T21:50:30.297564+0000","last_peered":"2024-02-19T21:50:30.297564+0000","last_clean":"2024-02-19T21:50:30.297564+0000","last_became_active":"2024-02-19T21:49:54.492156+0000","last_became_peered":"2024-02-19T21:49:54.492156+0000","last_unstale":"2024-02-19T21:50:30.297564+0000","last_undegraded":"2024-02-19T21:50:30.297564+0000","last_fullsized":"2024-02-19T21:50:30.297564+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:04.692807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.692807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"378'4","reported_seq":441,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.288413+0000","last_change":"2024-02-19T21:48:28.510929+0000","last_active":"2024-02-19T21:50:30.288413+0000","last_peered":"2024-02-19T21:50:30.288413+0000","last_clean":"2024-02-19T21:50:30.288413+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:50:30.288413+0000","last_undegraded":"2024-02-19T21:50:30.288413+0000","last_fullsized":"2024-02-19T21:50:30.288413+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"378'4","last_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_deep_scrub":"378'4","last_deep_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.510849+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"200'23","reported_seq":288,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.287940+0000","last_change":"2024-02-19T21:48:22.519465+0000","last_active":"2024-02-19T21:50:30.287940+0000","last_peered":"2024-02-19T21:50:30.287940+0000","last_clean":"2024-02-19T21:50:30.287940+0000","last_became_active":"2024-02-19T21:47:46.252085+0000","last_became_peered":"2024-02-19T21:47:46.252085+0000","last_unstale":"2024-02-19T21:50:30.287940+0000","last_undegraded":"2024-02-19T21:50:30.287940+0000","last_fullsized":"2024-02-19T21:50:30.287940+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'23","last_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_deep_scrub":"200'23","last_deep_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.519381+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6],"acting":[4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":54,"reported_epoch":425,"state":"active+clean","last_fresh":"2024-02-19T21:50:28.646356+0000","last_change":"2024-02-19T21:49:08.328855+0000","last_active":"2024-02-19T21:50:28.646356+0000","last_peered":"2024-02-19T21:50:28.646356+0000","last_clean":"2024-02-19T21:50:28.646356+0000","last_became_active":"2024-02-19T21:49:08.328237+0000","last_became_peered":"2024-02-19T21:49:08.328237+0000","last_unstale":"2024-02-19T21:50:28.646356+0000","last_undegraded":"2024-02-19T21:50:28.646356+0000","last_fullsized":"2024-02-19T21:50:28.646356+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:58.047556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:58.047556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"426'4624","reported_seq":4673,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:34.595866+0000","last_change":"2024-02-19T21:48:47.778295+0000","last_active":"2024-02-19T21:50:34.595866+0000","last_peered":"2024-02-19T21:50:34.595866+0000","last_clean":"2024-02-19T21:50:34.595866+0000","last_became_active":"2024-02-19T21:48:47.777964+0000","last_became_peered":"2024-02-19T21:48:47.777964+0000","last_unstale":"2024-02-19T21:50:34.595866+0000","last_undegraded":"2024-02-19T21:50:34.595866+0000","last_fullsized":"2024-02-19T21:50:34.595866+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4624,"ondisk_log_size":4624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":296615936,"num_objects":4526,"num_object_clones":0,"num_object_copies":13578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4526,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4624,"num_write_kb":292800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":456,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.288329+0000","last_change":"2024-02-19T21:49:08.328019+0000","last_active":"2024-02-19T21:50:30.288329+0000","last_peered":"2024-02-19T21:50:30.288329+0000","last_clean":"2024-02-19T21:50:30.288329+0000","last_became_active":"2024-02-19T21:49:08.327581+0000","last_became_peered":"2024-02-19T21:49:08.327581+0000","last_unstale":"2024-02-19T21:50:30.288329+0000","last_undegraded":"2024-02-19T21:50:30.288329+0000","last_fullsized":"2024-02-19T21:50:30.288329+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:22.180593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:45:22.180593+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5],"acting":[0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":402,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.320908+0000","last_change":"2024-02-19T21:48:37.789514+0000","last_active":"2024-02-19T21:50:30.320908+0000","last_peered":"2024-02-19T21:50:30.320908+0000","last_clean":"2024-02-19T21:50:30.320908+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:50:30.320908+0000","last_undegraded":"2024-02-19T21:50:30.320908+0000","last_fullsized":"2024-02-19T21:50:30.320908+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:37.789400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:37.789400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"201'20","reported_seq":308,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.320591+0000","last_change":"2024-02-19T21:45:57.877936+0000","last_active":"2024-02-19T21:50:30.320591+0000","last_peered":"2024-02-19T21:50:30.320591+0000","last_clean":"2024-02-19T21:50:30.320591+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:50:30.320591+0000","last_undegraded":"2024-02-19T21:50:30.320591+0000","last_fullsized":"2024-02-19T21:50:30.320591+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:45:57.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:57.877856+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":631,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:32.080618+0000","last_change":"2024-02-19T21:49:01.011149+0000","last_active":"2024-02-19T21:50:32.080618+0000","last_peered":"2024-02-19T21:50:32.080618+0000","last_clean":"2024-02-19T21:50:32.080618+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:50:32.080618+0000","last_undegraded":"2024-02-19T21:50:32.080618+0000","last_fullsized":"2024-02-19T21:50:32.080618+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:49:01.011078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:49:01.011078+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.a","version":"427'4739","reported_seq":4789,"reported_epoch":427,"state":"active+clean","last_fresh":"2024-02-19T21:50:35.064884+0000","last_change":"2024-02-19T21:48:47.778138+0000","last_active":"2024-02-19T21:50:35.064884+0000","last_peered":"2024-02-19T21:50:35.064884+0000","last_clean":"2024-02-19T21:50:35.064884+0000","last_became_active":"2024-02-19T21:48:47.777820+0000","last_became_peered":"2024-02-19T21:48:47.777820+0000","last_unstale":"2024-02-19T21:50:35.064884+0000","last_undegraded":"2024-02-19T21:50:35.064884+0000","last_fullsized":"2024-02-19T21:50:35.064884+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4739,"ondisk_log_size":4739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":305070080,"num_objects":4655,"num_object_clones":0,"num_object_copies":13965,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4655,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4739,"num_write_kb":300608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":351,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.289290+0000","last_change":"2024-02-19T21:48:33.478821+0000","last_active":"2024-02-19T21:50:30.289290+0000","last_peered":"2024-02-19T21:50:30.289290+0000","last_clean":"2024-02-19T21:50:30.289290+0000","last_became_active":"2024-02-19T21:44:56.149476+0000","last_became_peered":"2024-02-19T21:44:56.149476+0000","last_unstale":"2024-02-19T21:50:30.289290+0000","last_undegraded":"2024-02-19T21:50:30.289290+0000","last_fullsized":"2024-02-19T21:50:30.289290+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:33.478715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:48:33.478715+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":412,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.276608+0000","last_change":"2024-02-19T21:46:41.834315+0000","last_active":"2024-02-19T21:50:30.276608+0000","last_peered":"2024-02-19T21:50:30.276608+0000","last_clean":"2024-02-19T21:50:30.276608+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:50:30.276608+0000","last_undegraded":"2024-02-19T21:50:30.276608+0000","last_fullsized":"2024-02-19T21:50:30.276608+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:41.834246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:46:41.834246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"397'46","reported_seq":821,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:32.080619+0000","last_change":"2024-02-19T21:49:08.335296+0000","last_active":"2024-02-19T21:50:32.080619+0000","last_peered":"2024-02-19T21:50:32.080619+0000","last_clean":"2024-02-19T21:50:32.080619+0000","last_became_active":"2024-02-19T21:49:08.334527+0000","last_became_peered":"2024-02-19T21:49:08.334527+0000","last_unstale":"2024-02-19T21:50:32.080619+0000","last_undegraded":"2024-02-19T21:50:32.080619+0000","last_fullsized":"2024-02-19T21:50:32.080619+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'43","last_scrub_stamp":"2024-02-19T21:45:04.755444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.755444+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":398,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.288343+0000","last_change":"2024-02-19T21:46:45.252437+0000","last_active":"2024-02-19T21:50:30.288343+0000","last_peered":"2024-02-19T21:50:30.288343+0000","last_clean":"2024-02-19T21:50:30.288343+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:50:30.288343+0000","last_undegraded":"2024-02-19T21:50:30.288343+0000","last_fullsized":"2024-02-19T21:50:30.288343+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.252344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.252344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"427'4669","reported_seq":4846,"reported_epoch":427,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-02-19T21:50:35.230982+0000","last_change":"2024-02-19T21:49:55.766941+0000","last_active":"2024-02-19T21:50:35.230982+0000","last_peered":"2024-02-19T21:50:35.230982+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:55.752599+0000","last_became_peered":"2024-02-19T21:49:55.752599+0000","last_unstale":"2024-02-19T21:50:35.230982+0000","last_undegraded":"2024-02-19T21:49:55.655049+0000","last_fullsized":"2024-02-19T21:49:55.470938+0000","mapping_epoch":414,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4669,"ondisk_log_size":4669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":300875776,"num_objects":4591,"num_object_clones":0,"num_object_copies":13773,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5112,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4591,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4669,"num_write_kb":296320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":2555904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2],"avail_no_missing":["5","4"],"object_location_counts":[{"shards":"2,4,5","objects":2876},{"shards":"2,5","objects":597},{"shards":"4,5","objects":1118}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":426,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.298183+0000","last_change":"2024-02-19T21:49:09.227437+0000","last_active":"2024-02-19T21:50:30.298183+0000","last_peered":"2024-02-19T21:50:30.298183+0000","last_clean":"2024-02-19T21:50:30.298183+0000","last_became_active":"2024-02-19T21:49:08.328437+0000","last_became_peered":"2024-02-19T21:49:08.328437+0000","last_unstale":"2024-02-19T21:50:30.298183+0000","last_undegraded":"2024-02-19T21:50:30.298183+0000","last_fullsized":"2024-02-19T21:50:30.298183+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.227355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.227355+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'6","reported_seq":1530,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:34.547275+0000","last_change":"2024-02-19T21:49:51.604278+0000","last_active":"2024-02-19T21:50:34.547275+0000","last_peered":"2024-02-19T21:50:34.547275+0000","last_clean":"2024-02-19T21:50:34.547275+0000","last_became_active":"2024-02-19T21:49:08.331108+0000","last_became_peered":"2024-02-19T21:49:08.331108+0000","last_unstale":"2024-02-19T21:50:34.547275+0000","last_undegraded":"2024-02-19T21:50:34.547275+0000","last_fullsized":"2024-02-19T21:50:34.547275+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_clean_scrub_stamp":"2024-02-19T21:44:13.678341+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1071,"num_read_kb":1066,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":425,"state":"active+clean","last_fresh":"2024-02-19T21:50:28.646432+0000","last_change":"2024-02-19T21:49:08.329710+0000","last_active":"2024-02-19T21:50:28.646432+0000","last_peered":"2024-02-19T21:50:28.646432+0000","last_clean":"2024-02-19T21:50:28.646432+0000","last_became_active":"2024-02-19T21:49:08.329378+0000","last_became_peered":"2024-02-19T21:49:08.329378+0000","last_unstale":"2024-02-19T21:50:28.646432+0000","last_undegraded":"2024-02-19T21:50:28.646432+0000","last_fullsized":"2024-02-19T21:50:28.646432+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:55.195394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.195394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"200'17","reported_seq":459,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.320416+0000","last_change":"2024-02-19T21:48:14.878933+0000","last_active":"2024-02-19T21:50:30.320416+0000","last_peered":"2024-02-19T21:50:30.320416+0000","last_clean":"2024-02-19T21:50:30.320416+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:50:30.320416+0000","last_undegraded":"2024-02-19T21:50:30.320416+0000","last_fullsized":"2024-02-19T21:50:30.320416+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'17","last_scrub_stamp":"2024-02-19T21:48:14.878857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.878857+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":25,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":54,"reported_epoch":425,"state":"active+clean","last_fresh":"2024-02-19T21:50:28.646667+0000","last_change":"2024-02-19T21:49:08.325478+0000","last_active":"2024-02-19T21:50:28.646667+0000","last_peered":"2024-02-19T21:50:28.646667+0000","last_clean":"2024-02-19T21:50:28.646667+0000","last_became_active":"2024-02-19T21:49:08.325127+0000","last_became_peered":"2024-02-19T21:49:08.325127+0000","last_unstale":"2024-02-19T21:50:28.646667+0000","last_undegraded":"2024-02-19T21:50:28.646667+0000","last_fullsized":"2024-02-19T21:50:28.646667+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:10.871111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:10.871111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"427'4778","reported_seq":4828,"reported_epoch":427,"state":"active+clean","last_fresh":"2024-02-19T21:50:34.946801+0000","last_change":"2024-02-19T21:48:47.778829+0000","last_active":"2024-02-19T21:50:34.946801+0000","last_peered":"2024-02-19T21:50:34.946801+0000","last_clean":"2024-02-19T21:50:34.946801+0000","last_became_active":"2024-02-19T21:48:47.778486+0000","last_became_peered":"2024-02-19T21:48:47.778486+0000","last_unstale":"2024-02-19T21:50:34.946801+0000","last_undegraded":"2024-02-19T21:50:34.946801+0000","last_fullsized":"2024-02-19T21:50:34.946801+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4778,"ondisk_log_size":4778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":306839552,"num_objects":4682,"num_object_clones":0,"num_object_copies":14046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4682,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4778,"num_write_kb":302720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":429,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.277637+0000","last_change":"2024-02-19T21:47:33.400407+0000","last_active":"2024-02-19T21:50:30.277637+0000","last_peered":"2024-02-19T21:50:30.277637+0000","last_clean":"2024-02-19T21:50:30.277637+0000","last_became_active":"2024-02-19T21:47:33.400075+0000","last_became_peered":"2024-02-19T21:47:33.400075+0000","last_unstale":"2024-02-19T21:50:30.277637+0000","last_undegraded":"2024-02-19T21:50:30.277637+0000","last_fullsized":"2024-02-19T21:50:30.277637+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.035136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":307,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.276683+0000","last_change":"2024-02-19T21:49:05.746443+0000","last_active":"2024-02-19T21:50:30.276683+0000","last_peered":"2024-02-19T21:50:30.276683+0000","last_clean":"2024-02-19T21:50:30.276683+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:50:30.276683+0000","last_undegraded":"2024-02-19T21:50:30.276683+0000","last_fullsized":"2024-02-19T21:50:30.276683+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.746358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.746358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":459,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.276246+0000","last_change":"2024-02-19T21:49:54.485252+0000","last_active":"2024-02-19T21:50:30.276246+0000","last_peered":"2024-02-19T21:50:30.276246+0000","last_clean":"2024-02-19T21:50:30.276246+0000","last_became_active":"2024-02-19T21:49:54.484956+0000","last_became_peered":"2024-02-19T21:49:54.484956+0000","last_unstale":"2024-02-19T21:50:30.276246+0000","last_undegraded":"2024-02-19T21:50:30.276246+0000","last_fullsized":"2024-02-19T21:50:30.276246+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:07.901205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:07.901205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":23,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.297026+0000","last_change":"2024-02-19T21:49:54.483990+0000","last_active":"2024-02-19T21:50:30.297026+0000","last_peered":"2024-02-19T21:50:30.297026+0000","last_clean":"2024-02-19T21:50:30.297026+0000","last_became_active":"2024-02-19T21:49:54.483637+0000","last_became_peered":"2024-02-19T21:49:54.483637+0000","last_unstale":"2024-02-19T21:50:30.297026+0000","last_undegraded":"2024-02-19T21:50:30.297026+0000","last_fullsized":"2024-02-19T21:50:30.297026+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.190177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.190177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"201'33","reported_seq":452,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.291670+0000","last_change":"2024-02-19T21:46:47.970066+0000","last_active":"2024-02-19T21:50:30.291670+0000","last_peered":"2024-02-19T21:50:30.291670+0000","last_clean":"2024-02-19T21:50:30.291670+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:50:30.291670+0000","last_undegraded":"2024-02-19T21:50:30.291670+0000","last_fullsized":"2024-02-19T21:50:30.291670+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'33","last_scrub_stamp":"2024-02-19T21:46:47.969961+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.969961+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":23,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.298082+0000","last_change":"2024-02-19T21:49:54.478276+0000","last_active":"2024-02-19T21:50:30.298082+0000","last_peered":"2024-02-19T21:50:30.298082+0000","last_clean":"2024-02-19T21:50:30.298082+0000","last_became_active":"2024-02-19T21:49:54.477947+0000","last_became_peered":"2024-02-19T21:49:54.477947+0000","last_unstale":"2024-02-19T21:50:30.298082+0000","last_undegraded":"2024-02-19T21:50:30.298082+0000","last_fullsized":"2024-02-19T21:50:30.298082+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:57.754453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:57.754453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"426'4637","reported_seq":6875,"reported_epoch":426,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-02-19T21:50:34.395071+0000","last_change":"2024-02-19T21:49:55.726256+0000","last_active":"2024-02-19T21:50:34.395071+0000","last_peered":"2024-02-19T21:50:34.395071+0000","last_clean":"2024-02-19T21:49:53.438055+0000","last_became_active":"2024-02-19T21:49:55.720894+0000","last_became_peered":"2024-02-19T21:49:55.720894+0000","last_unstale":"2024-02-19T21:50:34.395071+0000","last_undegraded":"2024-02-19T21:49:55.557499+0000","last_fullsized":"2024-02-19T21:49:55.472563+0000","mapping_epoch":414,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4637,"ondisk_log_size":4637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":298778624,"num_objects":4559,"num_object_clones":0,"num_object_copies":13677,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3971,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4559,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4637,"num_write_kb":294272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1083,"num_bytes_recovered":70975488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7],"acting":[0,2],"avail_no_missing":["0","2","5"],"object_location_counts":[{"shards":"0,2","objects":588},{"shards":"0,2,5","objects":3932}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":400,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.321064+0000","last_change":"2024-02-19T21:45:47.723650+0000","last_active":"2024-02-19T21:50:30.321064+0000","last_peered":"2024-02-19T21:50:30.321064+0000","last_clean":"2024-02-19T21:50:30.321064+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:50:30.321064+0000","last_undegraded":"2024-02-19T21:50:30.321064+0000","last_fullsized":"2024-02-19T21:50:30.321064+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.723550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.723550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":411,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.287649+0000","last_change":"2024-02-19T21:45:51.243726+0000","last_active":"2024-02-19T21:50:30.287649+0000","last_peered":"2024-02-19T21:50:30.287649+0000","last_clean":"2024-02-19T21:50:30.287649+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:50:30.287649+0000","last_undegraded":"2024-02-19T21:50:30.287649+0000","last_fullsized":"2024-02-19T21:50:30.287649+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:51.243656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:51.243656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":428,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.297206+0000","last_change":"2024-02-19T21:48:23.218358+0000","last_active":"2024-02-19T21:50:30.297206+0000","last_peered":"2024-02-19T21:50:30.297206+0000","last_clean":"2024-02-19T21:50:30.297206+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:50:30.297206+0000","last_undegraded":"2024-02-19T21:50:30.297206+0000","last_fullsized":"2024-02-19T21:50:30.297206+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:23.218282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.218282+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"324'30","reported_seq":555,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.289317+0000","last_change":"2024-02-19T21:49:08.330490+0000","last_active":"2024-02-19T21:50:30.289317+0000","last_peered":"2024-02-19T21:50:30.289317+0000","last_clean":"2024-02-19T21:50:30.289317+0000","last_became_active":"2024-02-19T21:49:08.329761+0000","last_became_peered":"2024-02-19T21:49:08.329761+0000","last_unstale":"2024-02-19T21:50:30.289317+0000","last_undegraded":"2024-02-19T21:50:30.289317+0000","last_fullsized":"2024-02-19T21:50:30.289317+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'30","last_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_deep_scrub":"324'30","last_deep_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.110965+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":413,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.277591+0000","last_change":"2024-02-19T21:45:09.918263+0000","last_active":"2024-02-19T21:50:30.277591+0000","last_peered":"2024-02-19T21:50:30.277591+0000","last_clean":"2024-02-19T21:50:30.277591+0000","last_became_active":"2024-02-19T21:44:42.624782+0000","last_became_peered":"2024-02-19T21:44:42.624782+0000","last_unstale":"2024-02-19T21:50:30.277591+0000","last_undegraded":"2024-02-19T21:50:30.277591+0000","last_fullsized":"2024-02-19T21:50:30.277591+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":295,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_clean_scrub_stamp":"2024-02-19T21:45:09.918170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"427'4683","reported_seq":4734,"reported_epoch":427,"state":"active+clean","last_fresh":"2024-02-19T21:50:35.096955+0000","last_change":"2024-02-19T21:48:47.777963+0000","last_active":"2024-02-19T21:50:35.096955+0000","last_peered":"2024-02-19T21:50:35.096955+0000","last_clean":"2024-02-19T21:50:35.096955+0000","last_became_active":"2024-02-19T21:48:47.777644+0000","last_became_peered":"2024-02-19T21:48:47.777644+0000","last_unstale":"2024-02-19T21:50:35.096955+0000","last_undegraded":"2024-02-19T21:50:35.096955+0000","last_fullsized":"2024-02-19T21:50:35.096955+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4683,"ondisk_log_size":4683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":300548120,"num_objects":4587,"num_object_clones":0,"num_object_copies":13761,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4587,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4683,"num_write_kb":296577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":433,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.319942+0000","last_change":"2024-02-19T21:49:08.331080+0000","last_active":"2024-02-19T21:50:30.319942+0000","last_peered":"2024-02-19T21:50:30.319942+0000","last_clean":"2024-02-19T21:50:30.319942+0000","last_became_active":"2024-02-19T21:49:08.330648+0000","last_became_peered":"2024-02-19T21:49:08.330648+0000","last_unstale":"2024-02-19T21:50:30.319942+0000","last_undegraded":"2024-02-19T21:50:30.319942+0000","last_fullsized":"2024-02-19T21:50:30.319942+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:55.803876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:44:55.803876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":404,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.298251+0000","last_change":"2024-02-19T21:48:31.320229+0000","last_active":"2024-02-19T21:50:30.298251+0000","last_peered":"2024-02-19T21:50:30.298251+0000","last_clean":"2024-02-19T21:50:30.298251+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:50:30.298251+0000","last_undegraded":"2024-02-19T21:50:30.298251+0000","last_fullsized":"2024-02-19T21:50:30.298251+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:31.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:45.017696+0000","last_clean_scrub_stamp":"2024-02-19T21:48:31.320133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"201'37","reported_seq":459,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.287778+0000","last_change":"2024-02-19T21:45:14.173212+0000","last_active":"2024-02-19T21:50:30.287778+0000","last_peered":"2024-02-19T21:50:30.287778+0000","last_clean":"2024-02-19T21:50:30.287778+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:50:30.287778+0000","last_undegraded":"2024-02-19T21:50:30.287778+0000","last_fullsized":"2024-02-19T21:50:30.287778+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'37","last_scrub_stamp":"2024-02-19T21:45:14.173134+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:45:14.173134+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":403,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.292333+0000","last_change":"2024-02-19T21:46:48.988928+0000","last_active":"2024-02-19T21:50:30.292333+0000","last_peered":"2024-02-19T21:50:30.292333+0000","last_clean":"2024-02-19T21:50:30.292333+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:50:30.292333+0000","last_undegraded":"2024-02-19T21:50:30.292333+0000","last_fullsized":"2024-02-19T21:50:30.292333+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:48.988836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.988836+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.e","version":"427'4615","reported_seq":6661,"reported_epoch":427,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:50:35.200414+0000","last_change":"2024-02-19T21:49:09.775842+0000","last_active":"2024-02-19T21:50:35.200414+0000","last_peered":"2024-02-19T21:50:35.200414+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:09.764242+0000","last_became_peered":"2024-02-19T21:49:09.764242+0000","last_unstale":"2024-02-19T21:50:35.200414+0000","last_undegraded":"2024-02-19T21:49:09.321602+0000","last_fullsized":"2024-02-19T21:49:09.313871+0000","mapping_epoch":395,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4615,"ondisk_log_size":4615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":296288256,"num_objects":4521,"num_object_clones":0,"num_object_copies":13563,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":40,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4521,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4615,"num_write_kb":292352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":995,"num_bytes_recovered":65208320,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[{"shards":"4,6","objects":4481}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":146,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.287839+0000","last_change":"2024-02-19T21:49:08.326461+0000","last_active":"2024-02-19T21:50:30.287839+0000","last_peered":"2024-02-19T21:50:30.287839+0000","last_clean":"2024-02-19T21:50:30.287839+0000","last_became_active":"2024-02-19T21:49:08.326106+0000","last_became_peered":"2024-02-19T21:49:08.326106+0000","last_unstale":"2024-02-19T21:50:30.287839+0000","last_undegraded":"2024-02-19T21:50:30.287839+0000","last_fullsized":"2024-02-19T21:50:30.287839+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.080896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.080896+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":406,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.320228+0000","last_change":"2024-02-19T21:48:11.879787+0000","last_active":"2024-02-19T21:50:30.320228+0000","last_peered":"2024-02-19T21:50:30.320228+0000","last_clean":"2024-02-19T21:50:30.320228+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:50:30.320228+0000","last_undegraded":"2024-02-19T21:50:30.320228+0000","last_fullsized":"2024-02-19T21:50:30.320228+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.879687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.879687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"201'38","reported_seq":41,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.297393+0000","last_change":"2024-02-19T21:49:55.861358+0000","last_active":"2024-02-19T21:50:30.297393+0000","last_peered":"2024-02-19T21:50:30.297393+0000","last_clean":"2024-02-19T21:50:30.297393+0000","last_became_active":"2024-02-19T21:49:54.480413+0000","last_became_peered":"2024-02-19T21:49:54.480413+0000","last_unstale":"2024-02-19T21:50:30.297393+0000","last_undegraded":"2024-02-19T21:50:30.297393+0000","last_fullsized":"2024-02-19T21:50:30.297393+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":415,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'38","last_scrub_stamp":"2024-02-19T21:49:05.923627+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.923627+0000","log_size":38,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":299,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.291753+0000","last_change":"2024-02-19T21:49:54.495134+0000","last_active":"2024-02-19T21:50:30.291753+0000","last_peered":"2024-02-19T21:50:30.291753+0000","last_clean":"2024-02-19T21:50:30.291753+0000","last_became_active":"2024-02-19T21:49:54.494802+0000","last_became_peered":"2024-02-19T21:49:54.494802+0000","last_unstale":"2024-02-19T21:50:30.291753+0000","last_undegraded":"2024-02-19T21:50:30.291753+0000","last_fullsized":"2024-02-19T21:50:30.291753+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:10.578408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:10.578408+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.f","version":"427'4818","reported_seq":6800,"reported_epoch":427,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:50:35.123719+0000","last_change":"2024-02-19T21:49:09.782040+0000","last_active":"2024-02-19T21:50:35.123719+0000","last_peered":"2024-02-19T21:50:35.123719+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:09.769552+0000","last_became_peered":"2024-02-19T21:49:09.769552+0000","last_unstale":"2024-02-19T21:50:35.123719+0000","last_undegraded":"2024-02-19T21:49:09.324587+0000","last_fullsized":"2024-02-19T21:49:09.319762+0000","mapping_epoch":395,"log_start":"392'100","ondisk_log_start":"392'100","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4718,"ondisk_log_size":4718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":309329920,"num_objects":4720,"num_object_clones":0,"num_object_copies":14160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":184,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4720,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4818,"num_write_kb":305216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":963,"num_bytes_recovered":63111168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[{"shards":"4,6","objects":4536}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":433,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.297766+0000","last_change":"2024-02-19T21:49:08.328862+0000","last_active":"2024-02-19T21:50:30.297766+0000","last_peered":"2024-02-19T21:50:30.297766+0000","last_clean":"2024-02-19T21:50:30.297766+0000","last_became_active":"2024-02-19T21:49:08.328529+0000","last_became_peered":"2024-02-19T21:49:08.328529+0000","last_unstale":"2024-02-19T21:50:30.297766+0000","last_undegraded":"2024-02-19T21:50:30.297766+0000","last_fullsized":"2024-02-19T21:50:30.297766+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:49.110117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:49.110117+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":466,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.294579+0000","last_change":"2024-02-19T21:49:54.493367+0000","last_active":"2024-02-19T21:50:30.294579+0000","last_peered":"2024-02-19T21:50:30.294579+0000","last_clean":"2024-02-19T21:50:30.294579+0000","last_became_active":"2024-02-19T21:49:54.493041+0000","last_became_peered":"2024-02-19T21:49:54.493041+0000","last_unstale":"2024-02-19T21:50:30.294579+0000","last_undegraded":"2024-02-19T21:50:30.294579+0000","last_fullsized":"2024-02-19T21:50:30.294579+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.972369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.972369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"201'28","reported_seq":273,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.287861+0000","last_change":"2024-02-19T21:49:08.330818+0000","last_active":"2024-02-19T21:50:30.287861+0000","last_peered":"2024-02-19T21:50:30.287861+0000","last_clean":"2024-02-19T21:50:30.287861+0000","last_became_active":"2024-02-19T21:49:08.330477+0000","last_became_peered":"2024-02-19T21:49:08.330477+0000","last_unstale":"2024-02-19T21:50:30.287861+0000","last_undegraded":"2024-02-19T21:50:30.287861+0000","last_fullsized":"2024-02-19T21:50:30.287861+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'28","last_scrub_stamp":"2024-02-19T21:45:55.998646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.998646+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":40,"num_read_kb":33,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":480,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:32.080614+0000","last_change":"2024-02-19T21:45:50.742626+0000","last_active":"2024-02-19T21:50:32.080614+0000","last_peered":"2024-02-19T21:50:32.080614+0000","last_clean":"2024-02-19T21:50:32.080614+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:50:32.080614+0000","last_undegraded":"2024-02-19T21:50:32.080614+0000","last_fullsized":"2024-02-19T21:50:32.080614+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'9","last_scrub_stamp":"2024-02-19T21:45:50.742526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:50.742526+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"427'4610","reported_seq":4660,"reported_epoch":427,"state":"active+clean","last_fresh":"2024-02-19T21:50:35.026066+0000","last_change":"2024-02-19T21:48:47.779506+0000","last_active":"2024-02-19T21:50:35.026066+0000","last_peered":"2024-02-19T21:50:35.026066+0000","last_clean":"2024-02-19T21:50:35.026066+0000","last_became_active":"2024-02-19T21:48:47.778325+0000","last_became_peered":"2024-02-19T21:48:47.778325+0000","last_unstale":"2024-02-19T21:50:35.026066+0000","last_undegraded":"2024-02-19T21:50:35.026066+0000","last_fullsized":"2024-02-19T21:50:35.026066+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4610,"ondisk_log_size":4610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":296878080,"num_objects":4530,"num_object_clones":0,"num_object_copies":13590,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4530,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4610,"num_write_kb":292480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"66'1","reported_seq":317,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.292155+0000","last_change":"2024-02-19T21:48:12.568842+0000","last_active":"2024-02-19T21:50:30.292155+0000","last_peered":"2024-02-19T21:50:30.292155+0000","last_clean":"2024-02-19T21:50:30.292155+0000","last_became_active":"2024-02-19T21:44:56.166670+0000","last_became_peered":"2024-02-19T21:44:56.166670+0000","last_unstale":"2024-02-19T21:50:30.292155+0000","last_undegraded":"2024-02-19T21:50:30.292155+0000","last_fullsized":"2024-02-19T21:50:30.292155+0000","mapping_epoch":165,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:12.568734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.568734+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"261'11","reported_seq":491,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:32.080526+0000","last_change":"2024-02-19T21:45:01.716882+0000","last_active":"2024-02-19T21:50:32.080526+0000","last_peered":"2024-02-19T21:50:32.080526+0000","last_clean":"2024-02-19T21:50:32.080526+0000","last_became_active":"2024-02-19T21:44:08.123392+0000","last_became_peered":"2024-02-19T21:44:08.123392+0000","last_unstale":"2024-02-19T21:50:32.080526+0000","last_undegraded":"2024-02-19T21:50:32.080526+0000","last_fullsized":"2024-02-19T21:50:32.080526+0000","mapping_epoch":62,"log_start":"257'10","ondisk_log_start":"257'10","created":62,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-02-19T21:45:01.716817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.716817+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":415,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.297297+0000","last_change":"2024-02-19T21:48:19.186455+0000","last_active":"2024-02-19T21:50:30.297297+0000","last_peered":"2024-02-19T21:50:30.297297+0000","last_clean":"2024-02-19T21:50:30.297297+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:50:30.297297+0000","last_undegraded":"2024-02-19T21:50:30.297297+0000","last_fullsized":"2024-02-19T21:50:30.297297+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:48:19.186359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:19.186359+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"201'19","reported_seq":273,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.288976+0000","last_change":"2024-02-19T21:48:34.485865+0000","last_active":"2024-02-19T21:50:30.288976+0000","last_peered":"2024-02-19T21:50:30.288976+0000","last_clean":"2024-02-19T21:50:30.288976+0000","last_became_active":"2024-02-19T21:47:46.251550+0000","last_became_peered":"2024-02-19T21:47:46.251550+0000","last_unstale":"2024-02-19T21:50:30.288976+0000","last_undegraded":"2024-02-19T21:50:30.288976+0000","last_fullsized":"2024-02-19T21:50:30.288976+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:34.485787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:34.485787+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":23,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7],"acting":[4,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1","version":"427'4701","reported_seq":4751,"reported_epoch":427,"state":"active+clean","last_fresh":"2024-02-19T21:50:35.080486+0000","last_change":"2024-02-19T21:48:47.772467+0000","last_active":"2024-02-19T21:50:35.080486+0000","last_peered":"2024-02-19T21:50:35.080486+0000","last_clean":"2024-02-19T21:50:35.080486+0000","last_became_active":"2024-02-19T21:48:47.772154+0000","last_became_peered":"2024-02-19T21:48:47.772154+0000","last_unstale":"2024-02-19T21:50:35.080486+0000","last_undegraded":"2024-02-19T21:50:35.080486+0000","last_fullsized":"2024-02-19T21:50:35.080486+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4701,"ondisk_log_size":4701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":302317568,"num_objects":4613,"num_object_clones":0,"num_object_copies":13839,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4613,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4701,"num_write_kb":298048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":422,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.276929+0000","last_change":"2024-02-19T21:46:01.031458+0000","last_active":"2024-02-19T21:50:30.276929+0000","last_peered":"2024-02-19T21:50:30.276929+0000","last_clean":"2024-02-19T21:50:30.276929+0000","last_became_active":"2024-02-19T21:44:56.155194+0000","last_became_peered":"2024-02-19T21:44:56.155194+0000","last_unstale":"2024-02-19T21:50:30.276929+0000","last_undegraded":"2024-02-19T21:50:30.276929+0000","last_fullsized":"2024-02-19T21:50:30.276929+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.031344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.031344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"363'12","reported_seq":203,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:32.080526+0000","last_change":"2024-02-19T21:48:25.487689+0000","last_active":"2024-02-19T21:50:32.080526+0000","last_peered":"2024-02-19T21:50:32.080526+0000","last_clean":"2024-02-19T21:50:32.080526+0000","last_became_active":"2024-02-19T21:47:46.260099+0000","last_became_peered":"2024-02-19T21:47:46.260099+0000","last_unstale":"2024-02-19T21:50:32.080526+0000","last_undegraded":"2024-02-19T21:50:32.080526+0000","last_fullsized":"2024-02-19T21:50:32.080526+0000","mapping_epoch":362,"log_start":"98'9","ondisk_log_start":"98'9","created":62,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"363'12","last_scrub_stamp":"2024-02-19T21:48:25.487608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.487608+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":426,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.319862+0000","last_change":"2024-02-19T21:49:08.335163+0000","last_active":"2024-02-19T21:50:30.319862+0000","last_peered":"2024-02-19T21:50:30.319862+0000","last_clean":"2024-02-19T21:50:30.319862+0000","last_became_active":"2024-02-19T21:49:08.334842+0000","last_became_peered":"2024-02-19T21:49:08.334842+0000","last_unstale":"2024-02-19T21:50:30.319862+0000","last_undegraded":"2024-02-19T21:50:30.319862+0000","last_fullsized":"2024-02-19T21:50:30.319862+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.700887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.700887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"270'34","reported_seq":346,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.277284+0000","last_change":"2024-02-19T21:47:34.894164+0000","last_active":"2024-02-19T21:50:30.277284+0000","last_peered":"2024-02-19T21:50:30.277284+0000","last_clean":"2024-02-19T21:50:30.277284+0000","last_became_active":"2024-02-19T21:47:33.400012+0000","last_became_peered":"2024-02-19T21:47:33.400012+0000","last_unstale":"2024-02-19T21:50:30.277284+0000","last_undegraded":"2024-02-19T21:50:30.277284+0000","last_fullsized":"2024-02-19T21:50:30.277284+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":357,"parent":"0.0","parent_split_bits":0,"last_scrub":"270'34","last_scrub_stamp":"2024-02-19T21:46:44.789309+0000","last_deep_scrub":"270'34","last_deep_scrub_stamp":"2024-02-19T21:44:17.451151+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.789309+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2","version":"427'4768","reported_seq":4818,"reported_epoch":427,"state":"active+clean","last_fresh":"2024-02-19T21:50:35.143896+0000","last_change":"2024-02-19T21:48:47.771305+0000","last_active":"2024-02-19T21:50:35.143896+0000","last_peered":"2024-02-19T21:50:35.143896+0000","last_clean":"2024-02-19T21:50:35.143896+0000","last_became_active":"2024-02-19T21:48:47.771000+0000","last_became_peered":"2024-02-19T21:48:47.771000+0000","last_unstale":"2024-02-19T21:50:35.143896+0000","last_undegraded":"2024-02-19T21:50:35.143896+0000","last_fullsized":"2024-02-19T21:50:35.143896+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4768,"ondisk_log_size":4768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":305397760,"num_objects":4660,"num_object_clones":0,"num_object_copies":13980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4660,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4768,"num_write_kb":301696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":404,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.289201+0000","last_change":"2024-02-19T21:49:08.329023+0000","last_active":"2024-02-19T21:50:30.289201+0000","last_peered":"2024-02-19T21:50:30.289201+0000","last_clean":"2024-02-19T21:50:30.289201+0000","last_became_active":"2024-02-19T21:49:08.328697+0000","last_became_peered":"2024-02-19T21:49:08.328697+0000","last_unstale":"2024-02-19T21:50:30.289201+0000","last_undegraded":"2024-02-19T21:50:30.289201+0000","last_fullsized":"2024-02-19T21:50:30.289201+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.939414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.939414+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"397'17","reported_seq":330,"reported_epoch":425,"state":"active+clean","last_fresh":"2024-02-19T21:50:28.661825+0000","last_change":"2024-02-19T21:49:08.325927+0000","last_active":"2024-02-19T21:50:28.661825+0000","last_peered":"2024-02-19T21:50:28.661825+0000","last_clean":"2024-02-19T21:50:28.661825+0000","last_became_active":"2024-02-19T21:49:08.325034+0000","last_became_peered":"2024-02-19T21:49:08.325034+0000","last_unstale":"2024-02-19T21:50:28.661825+0000","last_undegraded":"2024-02-19T21:50:28.661825+0000","last_fullsized":"2024-02-19T21:50:28.661825+0000","mapping_epoch":394,"log_start":"170'11","ondisk_log_start":"170'11","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"271'13","last_scrub_stamp":"2024-02-19T21:46:47.072988+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.072988+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":416,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.320430+0000","last_change":"2024-02-19T21:49:03.987847+0000","last_active":"2024-02-19T21:50:30.320430+0000","last_peered":"2024-02-19T21:50:30.320430+0000","last_clean":"2024-02-19T21:50:30.320430+0000","last_became_active":"2024-02-19T21:47:33.395485+0000","last_became_peered":"2024-02-19T21:47:33.395485+0000","last_unstale":"2024-02-19T21:50:30.320430+0000","last_undegraded":"2024-02-19T21:50:30.320430+0000","last_fullsized":"2024-02-19T21:50:30.320430+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:03.987749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:49:03.987749+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,5],"acting":[1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"200'20","reported_seq":250,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.288308+0000","last_change":"2024-02-19T21:48:12.628796+0000","last_active":"2024-02-19T21:50:30.288308+0000","last_peered":"2024-02-19T21:50:30.288308+0000","last_clean":"2024-02-19T21:50:30.288308+0000","last_became_active":"2024-02-19T21:47:46.251725+0000","last_became_peered":"2024-02-19T21:47:46.251725+0000","last_unstale":"2024-02-19T21:50:30.288308+0000","last_undegraded":"2024-02-19T21:50:30.288308+0000","last_fullsized":"2024-02-19T21:50:30.288308+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'20","last_scrub_stamp":"2024-02-19T21:48:12.628700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.628700+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3","version":"427'4725","reported_seq":6635,"reported_epoch":427,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:50:35.176961+0000","last_change":"2024-02-19T21:49:15.423646+0000","last_active":"2024-02-19T21:50:35.176961+0000","last_peered":"2024-02-19T21:50:35.176961+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:09.769892+0000","last_became_peered":"2024-02-19T21:49:09.769892+0000","last_unstale":"2024-02-19T21:50:35.176961+0000","last_undegraded":"2024-02-19T21:49:09.318624+0000","last_fullsized":"2024-02-19T21:49:09.312732+0000","mapping_epoch":395,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4725,"ondisk_log_size":4725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":303759360,"num_objects":4635,"num_object_clones":0,"num_object_copies":13905,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4635,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4725,"num_write_kb":299520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":929,"num_bytes_recovered":60882944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[{"shards":"4,5","objects":4467}],"blocked_by":[],"up_primary":2,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":54,"reported_epoch":425,"state":"active+clean","last_fresh":"2024-02-19T21:50:28.647310+0000","last_change":"2024-02-19T21:49:08.327495+0000","last_active":"2024-02-19T21:50:28.647310+0000","last_peered":"2024-02-19T21:50:28.647310+0000","last_clean":"2024-02-19T21:50:28.647310+0000","last_became_active":"2024-02-19T21:49:08.327172+0000","last_became_peered":"2024-02-19T21:49:08.327172+0000","last_unstale":"2024-02-19T21:50:28.647310+0000","last_undegraded":"2024-02-19T21:50:28.647310+0000","last_fullsized":"2024-02-19T21:50:28.647310+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.241319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.241319+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,6],"acting":[2,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":411,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.320997+0000","last_change":"2024-02-19T21:45:01.798485+0000","last_active":"2024-02-19T21:50:30.320997+0000","last_peered":"2024-02-19T21:50:30.320997+0000","last_clean":"2024-02-19T21:50:30.320997+0000","last_became_active":"2024-02-19T21:44:22.245925+0000","last_became_peered":"2024-02-19T21:44:22.245925+0000","last_unstale":"2024-02-19T21:50:30.320997+0000","last_undegraded":"2024-02-19T21:50:30.320997+0000","last_fullsized":"2024-02-19T21:50:30.320997+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:01.798387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.798387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":411,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.297692+0000","last_change":"2024-02-19T21:48:30.277397+0000","last_active":"2024-02-19T21:50:30.297692+0000","last_peered":"2024-02-19T21:50:30.297692+0000","last_clean":"2024-02-19T21:50:30.297692+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:50:30.297692+0000","last_undegraded":"2024-02-19T21:50:30.297692+0000","last_fullsized":"2024-02-19T21:50:30.297692+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.277322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.277322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"337'39","reported_seq":359,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.288710+0000","last_change":"2024-02-19T21:49:08.326007+0000","last_active":"2024-02-19T21:50:30.288710+0000","last_peered":"2024-02-19T21:50:30.288710+0000","last_clean":"2024-02-19T21:50:30.288710+0000","last_became_active":"2024-02-19T21:49:08.325683+0000","last_became_peered":"2024-02-19T21:49:08.325683+0000","last_unstale":"2024-02-19T21:50:30.288710+0000","last_undegraded":"2024-02-19T21:50:30.288710+0000","last_fullsized":"2024-02-19T21:50:30.288710+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'39","last_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_deep_scrub":"337'39","last_deep_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.923809+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":49,"num_read_kb":39,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"426'4818","reported_seq":4868,"reported_epoch":427,"state":"active+clean","last_fresh":"2024-02-19T21:50:34.664645+0000","last_change":"2024-02-19T21:48:47.776672+0000","last_active":"2024-02-19T21:50:34.664645+0000","last_peered":"2024-02-19T21:50:34.664645+0000","last_clean":"2024-02-19T21:50:34.664645+0000","last_became_active":"2024-02-19T21:48:47.776368+0000","last_became_peered":"2024-02-19T21:48:47.776368+0000","last_unstale":"2024-02-19T21:50:34.664645+0000","last_undegraded":"2024-02-19T21:50:34.664645+0000","last_fullsized":"2024-02-19T21:50:34.664645+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4818,"ondisk_log_size":4818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":309985280,"num_objects":4730,"num_object_clones":0,"num_object_copies":14190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4730,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4818,"num_write_kb":305536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"66'1","reported_seq":237,"reported_epoch":426,"state":"active+remapped+backfill_toofull","last_fresh":"2024-02-19T21:50:30.287429+0000","last_change":"2024-02-19T21:50:25.718514+0000","last_active":"2024-02-19T21:50:30.287429+0000","last_peered":"2024-02-19T21:50:30.287429+0000","last_clean":"2024-02-19T21:47:34.392763+0000","last_became_active":"2024-02-19T21:49:55.708866+0000","last_became_peered":"2024-02-19T21:49:55.708866+0000","last_unstale":"2024-02-19T21:50:30.287429+0000","last_undegraded":"2024-02-19T21:50:30.287429+0000","last_fullsized":"2024-02-19T21:50:30.287429+0000","mapping_epoch":414,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:46:43.773486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:46:43.773486+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[0,2,6],"avail_no_missing":["0","2","6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":54,"reported_epoch":425,"state":"active+clean","last_fresh":"2024-02-19T21:50:28.646669+0000","last_change":"2024-02-19T21:49:08.326583+0000","last_active":"2024-02-19T21:50:28.646669+0000","last_peered":"2024-02-19T21:50:28.646669+0000","last_clean":"2024-02-19T21:50:28.646669+0000","last_became_active":"2024-02-19T21:49:08.324835+0000","last_became_peered":"2024-02-19T21:49:08.324835+0000","last_unstale":"2024-02-19T21:50:28.646669+0000","last_undegraded":"2024-02-19T21:50:28.646669+0000","last_fullsized":"2024-02-19T21:50:28.646669+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.163825+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":111,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.291775+0000","last_change":"2024-02-19T21:49:08.327553+0000","last_active":"2024-02-19T21:50:30.291775+0000","last_peered":"2024-02-19T21:50:30.291775+0000","last_clean":"2024-02-19T21:50:30.291775+0000","last_became_active":"2024-02-19T21:49:08.327186+0000","last_became_peered":"2024-02-19T21:49:08.327186+0000","last_unstale":"2024-02-19T21:50:30.291775+0000","last_undegraded":"2024-02-19T21:50:30.291775+0000","last_fullsized":"2024-02-19T21:50:30.291775+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:45:00.748244+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:45:00.748244+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"201'44","reported_seq":532,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.292163+0000","last_change":"2024-02-19T21:49:55.281324+0000","last_active":"2024-02-19T21:50:30.292163+0000","last_peered":"2024-02-19T21:50:30.292163+0000","last_clean":"2024-02-19T21:50:30.292163+0000","last_became_active":"2024-02-19T21:49:54.493167+0000","last_became_peered":"2024-02-19T21:49:54.493167+0000","last_unstale":"2024-02-19T21:50:30.292163+0000","last_undegraded":"2024-02-19T21:50:30.292163+0000","last_fullsized":"2024-02-19T21:50:30.292163+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'44","last_scrub_stamp":"2024-02-19T21:48:32.489084+0000","last_deep_scrub":"201'44","last_deep_scrub_stamp":"2024-02-19T21:44:16.255049+0000","last_clean_scrub_stamp":"2024-02-19T21:48:32.489084+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.5","version":"426'4706","reported_seq":4794,"reported_epoch":426,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:50:31.587672+0000","last_change":"2024-02-19T21:50:03.887248+0000","last_active":"2024-02-19T21:50:31.587672+0000","last_peered":"2024-02-19T21:50:31.587672+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:50:03.654321+0000","last_became_peered":"2024-02-19T21:50:03.654321+0000","last_unstale":"2024-02-19T21:50:31.587672+0000","last_undegraded":"2024-02-19T21:50:01.398577+0000","last_fullsized":"2024-02-19T21:49:55.473278+0000","mapping_epoch":414,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4706,"ondisk_log_size":4706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":308412416,"num_objects":4706,"num_object_clones":0,"num_object_copies":14118,"num_objects_missing_on_primary":1145,"num_objects_missing":1145,"num_objects_degraded":1145,"num_objects_misplaced":4111,"num_objects_unfound":0,"num_objects_dirty":4706,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4706,"num_write_kb":301184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":655360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0],"avail_no_missing":["0","5"],"object_location_counts":[{"shards":"0,2","objects":595},{"shards":"0,2,5","objects":2966},{"shards":"0,5","objects":1145}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":456,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.287862+0000","last_change":"2024-02-19T21:49:08.328667+0000","last_active":"2024-02-19T21:50:30.287862+0000","last_peered":"2024-02-19T21:50:30.287862+0000","last_clean":"2024-02-19T21:50:30.287862+0000","last_became_active":"2024-02-19T21:49:08.328287+0000","last_became_peered":"2024-02-19T21:49:08.328287+0000","last_unstale":"2024-02-19T21:50:30.287862+0000","last_undegraded":"2024-02-19T21:50:30.287862+0000","last_fullsized":"2024-02-19T21:50:30.287862+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.176542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.176542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":54,"reported_epoch":425,"state":"active+clean","last_fresh":"2024-02-19T21:50:28.647184+0000","last_change":"2024-02-19T21:49:08.332637+0000","last_active":"2024-02-19T21:50:28.647184+0000","last_peered":"2024-02-19T21:50:28.647184+0000","last_clean":"2024-02-19T21:50:28.647184+0000","last_became_active":"2024-02-19T21:49:08.331451+0000","last_became_peered":"2024-02-19T21:49:08.331451+0000","last_unstale":"2024-02-19T21:50:28.647184+0000","last_undegraded":"2024-02-19T21:50:28.647184+0000","last_fullsized":"2024-02-19T21:50:28.647184+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.123413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.547129+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.123413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":426,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.320507+0000","last_change":"2024-02-19T21:49:08.331159+0000","last_active":"2024-02-19T21:50:30.320507+0000","last_peered":"2024-02-19T21:50:30.320507+0000","last_clean":"2024-02-19T21:50:30.320507+0000","last_became_active":"2024-02-19T21:49:08.330804+0000","last_became_peered":"2024-02-19T21:49:08.330804+0000","last_unstale":"2024-02-19T21:50:30.320507+0000","last_undegraded":"2024-02-19T21:50:30.320507+0000","last_fullsized":"2024-02-19T21:50:30.320507+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.978015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.978015+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"377'19","reported_seq":434,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.287930+0000","last_change":"2024-02-19T21:48:23.326608+0000","last_active":"2024-02-19T21:50:30.287930+0000","last_peered":"2024-02-19T21:50:30.287930+0000","last_clean":"2024-02-19T21:50:30.287930+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:50:30.287930+0000","last_undegraded":"2024-02-19T21:50:30.287930+0000","last_fullsized":"2024-02-19T21:50:30.287930+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"377'19","last_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_deep_scrub":"377'19","last_deep_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.326541+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"427'4756","reported_seq":4805,"reported_epoch":427,"state":"active+clean","last_fresh":"2024-02-19T21:50:35.004866+0000","last_change":"2024-02-19T21:48:47.780368+0000","last_active":"2024-02-19T21:50:35.004866+0000","last_peered":"2024-02-19T21:50:35.004866+0000","last_clean":"2024-02-19T21:50:35.004866+0000","last_became_active":"2024-02-19T21:48:47.780046+0000","last_became_peered":"2024-02-19T21:48:47.780046+0000","last_unstale":"2024-02-19T21:50:35.004866+0000","last_undegraded":"2024-02-19T21:50:35.004866+0000","last_fullsized":"2024-02-19T21:50:35.004866+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4756,"ondisk_log_size":4756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":304873472,"num_objects":4652,"num_object_clones":0,"num_object_copies":13956,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4652,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4756,"num_write_kb":301056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":420,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.276417+0000","last_change":"2024-02-19T21:46:01.981923+0000","last_active":"2024-02-19T21:50:30.276417+0000","last_peered":"2024-02-19T21:50:30.276417+0000","last_clean":"2024-02-19T21:50:30.276417+0000","last_became_active":"2024-02-19T21:44:56.160521+0000","last_became_peered":"2024-02-19T21:44:56.160521+0000","last_unstale":"2024-02-19T21:50:30.276417+0000","last_undegraded":"2024-02-19T21:50:30.276417+0000","last_fullsized":"2024-02-19T21:50:30.276417+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.981866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.981866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":63,"reported_epoch":425,"state":"active+clean","last_fresh":"2024-02-19T21:50:28.646805+0000","last_change":"2024-02-19T21:49:54.485377+0000","last_active":"2024-02-19T21:50:28.646805+0000","last_peered":"2024-02-19T21:50:28.646805+0000","last_clean":"2024-02-19T21:50:28.646805+0000","last_became_active":"2024-02-19T21:49:54.485078+0000","last_became_peered":"2024-02-19T21:49:54.485078+0000","last_unstale":"2024-02-19T21:50:28.646805+0000","last_undegraded":"2024-02-19T21:50:28.646805+0000","last_fullsized":"2024-02-19T21:50:28.646805+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:52.107416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:46:52.107416+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"200'27","reported_seq":497,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:30.275906+0000","last_change":"2024-02-19T21:49:55.109780+0000","last_active":"2024-02-19T21:50:30.275906+0000","last_peered":"2024-02-19T21:50:30.275906+0000","last_clean":"2024-02-19T21:50:30.275906+0000","last_became_active":"2024-02-19T21:49:54.486014+0000","last_became_peered":"2024-02-19T21:49:54.486014+0000","last_unstale":"2024-02-19T21:50:30.275906+0000","last_undegraded":"2024-02-19T21:50:30.275906+0000","last_fullsized":"2024-02-19T21:50:30.275906+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'27","last_scrub_stamp":"2024-02-19T21:48:24.665813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:24.665813+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"324'11","reported_seq":651,"reported_epoch":426,"state":"active+clean","last_fresh":"2024-02-19T21:50:32.080601+0000","last_change":"2024-02-19T21:48:26.293036+0000","last_active":"2024-02-19T21:50:32.080601+0000","last_peered":"2024-02-19T21:50:32.080601+0000","last_clean":"2024-02-19T21:50:32.080601+0000","last_became_active":"2024-02-19T21:44:34.385140+0000","last_became_peered":"2024-02-19T21:44:34.385140+0000","last_unstale":"2024-02-19T21:50:32.080601+0000","last_undegraded":"2024-02-19T21:50:32.080601+0000","last_fullsized":"2024-02-19T21:50:32.080601+0000","mapping_epoch":62,"log_start":"66'8","ondisk_log_start":"66'8","created":62,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'11","last_scrub_stamp":"2024-02-19T21:48:26.292909+0000","last_deep_scrub":"324'11","last_deep_scrub_stamp":"2024-02-19T21:46:05.210095+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.292909+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":4852416536,"num_objects":74043,"num_object_clones":0,"num_object_copies":222129,"num_objects_missing_on_primary":1145,"num_objects_missing":1145,"num_objects_degraded":11728,"num_objects_misplaced":4111,"num_objects_unfound":0,"num_objects_dirty":74043,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":75443,"num_write_kb":4783489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4019,"num_bytes_recovered":263389184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":14321987584,"data_stored":14321975368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75243,"ondisk_log_size":75243,"up":48,"acting":41,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1071,"num_read_kb":1066,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":3,"num_objects_missing":3,"num_objects_degraded":7,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1107,"num_read_kb":864,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":5062,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":776,"ondisk_log_size":776,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":22,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":66,"acting":66,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":382,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201501,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1014552,"kb_used_data":705040,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":92730600,"statfs":{"total":95995035648,"available":94956134400,"internally_reserved":0,"allocated":721960960,"data_stored":720754242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:49:49 2024","interfaces":[{"interface":"back","average":{"1min":1.8049999999999999,"5min":2.6440000000000001,"15min":1.8859999999999999},"min":{"1min":0.26000000000000001,"5min":0.19,"15min":0.189},"max":{"1min":11.653,"5min":70.477999999999994,"15min":70.477999999999994},"last":0.39600000000000002},{"interface":"front","average":{"1min":2.0590000000000002,"5min":2.9199999999999999,"15min":2.0379999999999998},"min":{"1min":0.23100000000000001,"5min":0.21199999999999999,"15min":0.20999999999999999},"max":{"1min":12.242000000000001,"5min":68.052000000000007,"15min":68.052000000000007},"last":0.34300000000000003}]},{"osd":1,"last update":"Mon Feb 19 21:49:49 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":2.7410000000000001,"15min":2.0710000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.23200000000000001},"max":{"1min":8.9629999999999992,"5min":68.168000000000006,"15min":68.168000000000006},"last":0.501},{"interface":"front","average":{"1min":2.2799999999999998,"5min":3.298,"15min":2.1099999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.223},"max":{"1min":12.199,"5min":68.444000000000003,"15min":68.444000000000003},"last":0.48099999999999998}]},{"osd":2,"last update":"Mon Feb 19 21:50:09 2024","interfaces":[{"interface":"back","average":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":12.304,"5min":12.304,"15min":12.304},"last":0.52800000000000002},{"interface":"front","average":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":11.69,"5min":11.69,"15min":11.69},"last":0.42499999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:49:49 2024","interfaces":[{"interface":"back","average":{"1min":1.8380000000000001,"5min":2.121,"15min":2.1480000000000001},"min":{"1min":0.377,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":10.435,"5min":11.614000000000001,"15min":31.559000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.744,"15min":1.895},"min":{"1min":0.33000000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":9.0129999999999999,"5min":13.473000000000001,"15min":30.812999999999999},"last":0.54700000000000004}]},{"osd":4,"last update":"Mon Feb 19 21:49:49 2024","interfaces":[{"interface":"back","average":{"1min":3.0339999999999998,"5min":2.0720000000000001,"15min":1.5389999999999999},"min":{"1min":0.27400000000000002,"5min":0.216,"15min":0.216},"max":{"1min":17.716999999999999,"5min":17.716999999999999,"15min":17.716999999999999},"last":0.29599999999999999},{"interface":"front","average":{"1min":3.4089999999999998,"5min":2.4529999999999998,"15min":1.8700000000000001},"min":{"1min":0.26500000000000001,"5min":0.253,"15min":0.245},"max":{"1min":15.666,"5min":17.690999999999999,"15min":17.690999999999999},"last":0.45100000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:49:49 2024","interfaces":[{"interface":"back","average":{"1min":2.1459999999999999,"5min":2.1579999999999999,"15min":1.609},"min":{"1min":0.30199999999999999,"5min":0.28499999999999998,"15min":0.24199999999999999},"max":{"1min":12.210000000000001,"5min":29.021000000000001,"15min":29.021000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":2.6219999999999999,"5min":2.5110000000000001,"15min":1.889},"min":{"1min":0.33800000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":17.670999999999999,"5min":29.091999999999999,"15min":29.091999999999999},"last":0.56899999999999995}]},{"osd":6,"last update":"Mon Feb 19 21:49:49 2024","interfaces":[{"interface":"back","average":{"1min":3.1320000000000001,"5min":2.452,"15min":1.6930000000000001},"min":{"1min":0.32500000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":12.271000000000001,"5min":19.286000000000001,"15min":19.286000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":2.6800000000000002,"5min":2.339,"15min":1.863},"min":{"1min":0.314,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":11.722,"5min":18.364000000000001,"15min":18.364000000000001},"last":0.55600000000000005}]}]},{"osd":6,"up_from":47,"seq":201863463140,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2671856,"kb_used_data":2078056,"kb_used_omap":0,"kb_used_meta":593792,"kb_avail":91073296,"statfs":{"total":95995035648,"available":93259055104,"internally_reserved":0,"allocated":2127929344,"data_stored":2126706024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":608043008},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:50:27 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":1.2310000000000001,"15min":1.6599999999999999},"min":{"1min":0.245,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":2.9369999999999998,"5min":8.8079999999999998,"15min":45.197000000000003},"last":0.46500000000000002},{"interface":"front","average":{"1min":1.425,"5min":1.74,"15min":1.9890000000000001},"min":{"1min":0.27600000000000002,"5min":0.23499999999999999,"15min":0.221},"max":{"1min":4.2859999999999996,"5min":6.9699999999999998,"15min":44.753},"last":6.1120000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:50:27 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":1.5780000000000001,"15min":1.7},"min":{"1min":0.26600000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":2.9929999999999999,"5min":8.8469999999999995,"15min":45.231999999999999},"last":0.308},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.609,"15min":1.702},"min":{"1min":0.26400000000000001,"5min":0.245,"15min":0.23100000000000001},"max":{"1min":5.6050000000000004,"5min":7.3570000000000002,"15min":45.097999999999999},"last":0.88700000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:50:09 2024","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.571,"15min":1.571},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":6.0330000000000004,"5min":6.0330000000000004,"15min":6.0330000000000004},"last":6.1820000000000004},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":7.8959999999999999,"5min":7.8959999999999999,"15min":7.8959999999999999},"last":0.54700000000000004}]},{"osd":3,"last update":"Mon Feb 19 21:50:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.508,"15min":1.6100000000000001},"min":{"1min":0.36399999999999999,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":5.4729999999999999,"5min":8.9009999999999998,"15min":11.15},"last":0.34000000000000002},{"interface":"front","average":{"1min":1.909,"5min":1.675,"15min":1.6539999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.246},"max":{"1min":7.3970000000000002,"5min":7.3970000000000002,"15min":19.632999999999999},"last":0.36599999999999999}]},{"osd":4,"last update":"Mon Feb 19 21:50:27 2024","interfaces":[{"interface":"back","average":{"1min":3.3069999999999999,"5min":2.242,"15min":1.7609999999999999},"min":{"1min":0.34000000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":18.010000000000002,"5min":18.010000000000002,"15min":18.010000000000002},"last":6.1539999999999999},{"interface":"front","average":{"1min":1.7390000000000001,"5min":1.988,"15min":1.7190000000000001},"min":{"1min":0.32800000000000001,"5min":0.26300000000000001,"15min":0.23499999999999999},"max":{"1min":6.0659999999999998,"5min":11.566000000000001,"15min":16.594999999999999},"last":2.2919999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:50:27 2024","interfaces":[{"interface":"back","average":{"1min":2.218,"5min":2.27,"15min":1.778},"min":{"1min":0.376,"5min":0.27400000000000002,"15min":0.27100000000000002},"max":{"1min":9.5990000000000002,"5min":14.695,"15min":14.695},"last":6.2060000000000004},{"interface":"front","average":{"1min":1.1339999999999999,"5min":2.254,"15min":1.907},"min":{"1min":0.40999999999999998,"5min":0.28799999999999998,"15min":0.27900000000000003},"max":{"1min":3.2890000000000001,"5min":11.609999999999999,"15min":15.497999999999999},"last":2.077}]},{"osd":7,"last update":"Mon Feb 19 21:49:48 2024","interfaces":[{"interface":"back","average":{"1min":1.7030000000000001,"5min":2.0800000000000001,"15min":1.7909999999999999},"min":{"1min":0.38300000000000001,"5min":0.27200000000000002,"15min":0.26700000000000002},"max":{"1min":7.9569999999999999,"5min":9.1929999999999996,"15min":14.721},"last":2.4820000000000002},{"interface":"front","average":{"1min":1.7390000000000001,"5min":2.1139999999999999,"15min":1.841},"min":{"1min":0.42099999999999999,"5min":0.35599999999999998,"15min":0.32700000000000001},"max":{"1min":7.9850000000000003,"5min":9.2240000000000002,"15min":14.744999999999999},"last":2.5150000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575102,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2100284,"kb_used_data":1195572,"kb_used_omap":0,"kb_used_meta":904704,"kb_avail":91644868,"statfs":{"total":95995035648,"available":93844344832,"internally_reserved":0,"allocated":1224265728,"data_stored":1223030910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":926416896},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:50:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.0800000000000001,"15min":1.5289999999999999},"min":{"1min":0.184,"5min":0.16300000000000001,"15min":0.161},"max":{"1min":5.7889999999999997,"5min":6.2789999999999999,"15min":42.776000000000003},"last":0.255},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1919999999999999,"15min":1.5700000000000001},"min":{"1min":0.22,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":5.7119999999999997,"5min":10.798,"15min":44.845999999999997},"last":0.23300000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:50:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":3.5649999999999999,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":0.378},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":4.452,"5min":4.452,"15min":4.452},"last":0.26500000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:50:19 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":1.0920000000000001,"15min":1.6419999999999999},"min":{"1min":0.22800000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":3.5310000000000001,"5min":5.1660000000000004,"15min":41.607999999999997},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":1.1850000000000001,"15min":1.5289999999999999},"min":{"1min":0.25,"5min":0.215,"15min":0.215},"max":{"1min":2.4710000000000001,"5min":5.6589999999999998,"15min":42.811999999999998},"last":0.28699999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:50:34 2024","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.633,"15min":1.5429999999999999},"min":{"1min":0.316,"5min":0.251,"15min":0.251},"max":{"1min":9.8759999999999994,"5min":15.853,"15min":15.853},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":1.615,"15min":1.575},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.26500000000000001},"max":{"1min":2.746,"5min":15.861000000000001,"15min":15.861000000000001},"last":0.60199999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:49:59 2024","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.734,"15min":1.639},"min":{"1min":0.32400000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":4.0720000000000001,"5min":14.331,"15min":14.331},"last":1.385},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.8979999999999999,"15min":1.625},"min":{"1min":0.307,"5min":0.307,"15min":0.30099999999999999},"max":{"1min":5.5229999999999997,"5min":14.496,"15min":14.496},"last":0.42799999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:50:34 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.5700000000000001,"15min":1.657},"min":{"1min":0.40200000000000002,"5min":0.30199999999999999,"15min":0.30099999999999999},"max":{"1min":8.8309999999999995,"5min":10.456,"15min":11.638999999999999},"last":1.282},{"interface":"front","average":{"1min":1.179,"5min":1.696,"15min":1.786},"min":{"1min":0.38,"5min":0.36899999999999999,"15min":0.29699999999999999},"max":{"1min":3.863,"5min":9.8049999999999997,"15min":12.199},"last":0.47199999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:49:54 2024","interfaces":[{"interface":"back","average":{"1min":2.1419999999999999,"5min":2.0790000000000002,"15min":1.867},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":7.702,"5min":13.904,"15min":13.904},"last":0.49099999999999999},{"interface":"front","average":{"1min":2.0299999999999998,"5min":2.0779999999999998,"15min":1.7350000000000001},"min":{"1min":0.38900000000000001,"5min":0.35499999999999998,"15min":0.32600000000000001},"max":{"1min":7.6909999999999998,"5min":13.894,"15min":13.894},"last":0.41899999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738628,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3873560,"kb_used_data":2975056,"kb_used_omap":0,"kb_used_meta":898496,"kb_avail":89871592,"statfs":{"total":95995035648,"available":92028510208,"internally_reserved":0,"allocated":3046457344,"data_stored":3045249989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":920059904},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:50:10 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.88300000000000001,"15min":1.1279999999999999},"min":{"1min":0.189,"5min":0.153,"15min":0.153},"max":{"1min":3.0800000000000001,"5min":6.1550000000000002,"15min":16.478000000000002},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":1.054,"15min":1.417},"min":{"1min":0.224,"5min":0.17899999999999999,"15min":0.17799999999999999},"max":{"1min":3.1669999999999998,"5min":6.9359999999999999,"15min":13.422000000000001},"last":0.32800000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:50:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":4.2510000000000003,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":0.30199999999999999},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":8.9960000000000004,"5min":8.9960000000000004,"15min":8.9960000000000004},"last":0.24299999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:50:01 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.292,"15min":1.6819999999999999},"min":{"1min":0.255,"5min":0.216,"15min":0.21299999999999999},"max":{"1min":5.3570000000000002,"5min":12.691000000000001,"15min":14.507999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.099,"15min":1.552},"min":{"1min":0.32000000000000001,"5min":0.24099999999999999,"15min":0.23400000000000001},"max":{"1min":3.4569999999999999,"5min":6.6150000000000002,"15min":18.759},"last":0.32000000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:49:44 2024","interfaces":[{"interface":"back","average":{"1min":2.0649999999999999,"5min":1.768,"15min":1.6910000000000001},"min":{"1min":0.29899999999999999,"5min":0.252,"15min":0.252},"max":{"1min":7.766,"5min":10.311,"15min":13.278},"last":0.43099999999999999},{"interface":"front","average":{"1min":1.99,"5min":1.732,"15min":1.534},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.255},"max":{"1min":8.1219999999999999,"5min":10.109,"15min":10.109},"last":0.37}]},{"osd":5,"last update":"Mon Feb 19 21:50:01 2024","interfaces":[{"interface":"back","average":{"1min":1.6140000000000001,"5min":2.1850000000000001,"15min":2.0779999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.27600000000000002},"max":{"1min":8.1199999999999992,"5min":25.442,"15min":42.799999999999997},"last":0.40000000000000002},{"interface":"front","average":{"1min":2.1579999999999999,"5min":2.2429999999999999,"15min":2.0939999999999999},"min":{"1min":0.35099999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":8.5530000000000008,"5min":25.411999999999999,"15min":42.695},"last":0.53200000000000003}]},{"osd":6,"last update":"Mon Feb 19 21:50:16 2024","interfaces":[{"interface":"back","average":{"1min":2.2309999999999999,"5min":1.909,"15min":1.7070000000000001},"min":{"1min":0.33400000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":10.098000000000001,"5min":10.278,"15min":42.777000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":1.897,"5min":1.931,"15min":1.9590000000000001},"min":{"1min":0.39900000000000002,"5min":0.29599999999999999,"15min":0.28599999999999998},"max":{"1min":10.058999999999999,"5min":11.84,"15min":13.289999999999999},"last":0.441}]},{"osd":7,"last update":"Mon Feb 19 21:49:48 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.8839999999999999,"15min":1.8100000000000001},"min":{"1min":0.38700000000000001,"5min":0.36799999999999999,"15min":0.31},"max":{"1min":9.6460000000000008,"5min":15.688000000000001,"15min":42.758000000000003},"last":0.55100000000000005},{"interface":"front","average":{"1min":1.978,"5min":1.871,"15min":1.738},"min":{"1min":0.40000000000000002,"5min":0.36399999999999999,"15min":0.33200000000000002},"max":{"1min":9.6389999999999993,"5min":10.470000000000001,"15min":42.718000000000004},"last":0.49099999999999999}]}]},{"osd":2,"up_from":394,"seq":1692217114641,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2163268,"kb_used_data":1843324,"kb_used_omap":0,"kb_used_meta":319935,"kb_avail":91581884,"statfs":{"total":95995035648,"available":93779849216,"internally_reserved":0,"allocated":1887563776,"data_stored":1886376603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":327613492},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":9.1530000000000005,"5min":9.1530000000000005,"15min":9.1530000000000005},"last":0.20300000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":6.149,"5min":6.149,"15min":6.149},"last":0.25600000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":2.8370000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":6.992,"5min":6.992,"15min":6.992},"last":0.24399999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.45,"15min":1.45},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":6.9470000000000001,"5min":6.9470000000000001,"15min":6.9470000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":6.6500000000000004,"5min":6.6500000000000004,"15min":6.6500000000000004},"last":0.89000000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":7.0339999999999998,"5min":7.0339999999999998,"15min":7.0339999999999998},"last":0.443},{"interface":"front","average":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":7.0419999999999998,"5min":7.0419999999999998,"15min":7.0419999999999998},"last":0.314}]},{"osd":5,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":10.067,"5min":10.067,"15min":10.067},"last":0.29699999999999999},{"interface":"front","average":{"1min":1.821,"5min":1.821,"15min":1.821},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":13.558,"5min":13.558,"15min":13.558},"last":0.34999999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.752,"5min":1.752,"15min":1.752},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":5.6829999999999998,"5min":5.6829999999999998,"15min":5.6829999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":7,"5min":7,"15min":7},"last":1.599}]},{"osd":7,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":5.7750000000000004,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":2.8220000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.782,"5min":2.782,"15min":2.782},"last":0.42499999999999999}]}]},{"osd":3,"up_from":0,"seq":111669149940,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":32,"seq":137438953709,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3817436,"kb_used_data":3219540,"kb_used_omap":0,"kb_used_meta":597888,"kb_avail":89927716,"statfs":{"total":95995035648,"available":92085981184,"internally_reserved":0,"allocated":3296808960,"data_stored":3295604997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":612237312},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:50:33 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":2.173,"15min":1.905},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":5.8780000000000001,"5min":53.936,"15min":53.936},"last":0.32900000000000001},{"interface":"front","average":{"1min":1.282,"5min":2.3889999999999998,"15min":2.069},"min":{"1min":0.25900000000000001,"5min":0.23000000000000001,"15min":0.22600000000000001},"max":{"1min":9.7230000000000008,"5min":54.405999999999999,"15min":54.405999999999999},"last":0.29499999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:50:33 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":2.2669999999999999,"15min":1.7669999999999999},"min":{"1min":0.26500000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":5.8490000000000002,"5min":54.731000000000002,"15min":54.731000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":1.375,"5min":2.198,"15min":1.665},"min":{"1min":0.255,"5min":0.252,"15min":0.25},"max":{"1min":9.7639999999999993,"5min":52.490000000000002,"15min":52.490000000000002},"last":0.255}]},{"osd":2,"last update":"Mon Feb 19 21:50:10 2024","interfaces":[{"interface":"back","average":{"1min":2.077,"5min":2.077,"15min":2.077},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":9.0619999999999994,"5min":9.0619999999999994,"15min":9.0619999999999994},"last":0.42999999999999999},{"interface":"front","average":{"1min":2.113,"5min":2.113,"15min":2.113},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":9.0899999999999999,"5min":9.0899999999999999,"15min":9.0899999999999999},"last":0.46800000000000003}]},{"osd":3,"last update":"Mon Feb 19 21:50:33 2024","interfaces":[{"interface":"back","average":{"1min":1.653,"5min":1.6799999999999999,"15min":1.6899999999999999},"min":{"1min":0.372,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":6.3170000000000002,"5min":6.5579999999999998,"15min":15.914999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":1.115,"5min":1.7889999999999999,"15min":1.6879999999999999},"min":{"1min":0.40799999999999997,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":7.9569999999999999,"5min":9.4000000000000004,"15min":13.321},"last":0.45100000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:50:22 2024","interfaces":[{"interface":"back","average":{"1min":2.0899999999999999,"5min":2.3780000000000001,"15min":1.7330000000000001},"min":{"1min":0.33300000000000002,"5min":0.23799999999999999,"15min":0.23400000000000001},"max":{"1min":13.805999999999999,"5min":16.731999999999999,"15min":18.916},"last":0.32000000000000001},{"interface":"front","average":{"1min":1.889,"5min":2.3500000000000001,"15min":1.9390000000000001},"min":{"1min":0.35999999999999999,"5min":0.26200000000000001,"15min":0.253},"max":{"1min":7.3719999999999999,"5min":8.2959999999999994,"15min":14.840999999999999},"last":0.51100000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:50:33 2024","interfaces":[{"interface":"back","average":{"1min":1.756,"5min":1.9630000000000001,"15min":1.615},"min":{"1min":0.40200000000000002,"5min":0.28999999999999998,"15min":0.28599999999999998},"max":{"1min":7.4050000000000002,"5min":9.1720000000000006,"15min":13.27},"last":0.41499999999999998},{"interface":"front","average":{"1min":2.0819999999999999,"5min":2.4710000000000001,"15min":1.823},"min":{"1min":0.34300000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":13.715,"5min":18.670000000000002,"15min":18.670000000000002},"last":0.34300000000000003}]},{"osd":7,"last update":"Mon Feb 19 21:50:00 2024","interfaces":[{"interface":"back","average":{"1min":2.7650000000000001,"5min":2.4849999999999999,"15min":1.76},"min":{"1min":0.38,"5min":0.311,"15min":0.28899999999999998},"max":{"1min":13.765000000000001,"5min":16.763999999999999,"15min":16.763999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":3.0190000000000001,"5min":1.9199999999999999,"15min":1.6879999999999999},"min":{"1min":0.502,"5min":0.31,"15min":0.31},"max":{"1min":10.044,"5min":10.82,"15min":12.808999999999999},"last":0.59699999999999998}]}]},{"osd":5,"up_from":38,"seq":163208757481,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2895104,"kb_used_data":2008760,"kb_used_omap":0,"kb_used_meta":886336,"kb_avail":90850048,"statfs":{"total":95995035648,"available":93030449152,"internally_reserved":0,"allocated":2056970240,"data_stored":2055786608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":907608064},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.8540000000000001,"15min":1.762},"min":{"1min":0.26000000000000001,"5min":0.214,"15min":0.20599999999999999},"max":{"1min":4.0979999999999999,"5min":19.236000000000001,"15min":20.550999999999998},"last":0.26900000000000002},{"interface":"front","average":{"1min":1.3979999999999999,"5min":2.0680000000000001,"15min":1.8839999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.20899999999999999},"max":{"1min":3.7090000000000001,"5min":13.241,"15min":20.879000000000001},"last":0.28799999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.798,"15min":1.712},"min":{"1min":0.307,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":4.9569999999999999,"5min":8.9789999999999992,"15min":10.42},"last":0.32600000000000001},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.877,"15min":1.613},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":4.4829999999999997,"5min":10.965,"15min":10.965},"last":0.36199999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":4.1280000000000001,"5min":4.1280000000000001,"15min":4.1280000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":4.2619999999999996,"5min":4.2619999999999996,"15min":4.2619999999999996},"last":0.61099999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.6619999999999999,"5min":2.1640000000000001,"15min":2.0649999999999999},"min":{"1min":0.32200000000000001,"5min":0.26100000000000001,"15min":0.24099999999999999},"max":{"1min":13.182,"5min":19.321000000000002,"15min":20.146999999999998},"last":0.39100000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.9630000000000001,"15min":2.129},"min":{"1min":0.40999999999999998,"5min":0.311,"15min":0.29499999999999998},"max":{"1min":4.3659999999999997,"5min":9.0269999999999992,"15min":20.120000000000001},"last":0.55600000000000005}]},{"osd":4,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.8149999999999999,"15min":1.397},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":4.452,"5min":16.643999999999998,"15min":21.577000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":2.254,"5min":2.294,"15min":1.879},"min":{"1min":0.26100000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":10.352,"5min":19.274000000000001,"15min":19.274000000000001},"last":0.73799999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:50:30 2024","interfaces":[{"interface":"back","average":{"1min":2.0649999999999999,"5min":2.29,"15min":1.8979999999999999},"min":{"1min":0.34000000000000002,"5min":0.307,"15min":0.221},"max":{"1min":8.109,"5min":19.884,"15min":19.884},"last":0.45300000000000001},{"interface":"front","average":{"1min":1.6679999999999999,"5min":2.044,"15min":1.867},"min":{"1min":0.44900000000000001,"5min":0.26700000000000002,"15min":0.23599999999999999},"max":{"1min":6.0750000000000002,"5min":10.260999999999999,"15min":13.532999999999999},"last":0.63400000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:49:52 2024","interfaces":[{"interface":"back","average":{"1min":1.8939999999999999,"5min":2.4319999999999999,"15min":2.0110000000000001},"min":{"1min":0.35899999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":9.6300000000000008,"5min":12.611000000000001,"15min":12.962},"last":0.58599999999999997},{"interface":"front","average":{"1min":2.2050000000000001,"5min":2.3540000000000001,"15min":1.8300000000000001},"min":{"1min":0.36099999999999999,"5min":0.221,"15min":0.221},"max":{"1min":9.5649999999999995,"5min":15.593999999999999,"15min":17.759},"last":0.40100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3039629312,"data_stored":3039625240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1218314240,"data_stored":1218314240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1885339648,"data_stored":1885339648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3288272896,"data_stored":3288268824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2051014656,"data_stored":2051014656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2121338880,"data_stored":2121334808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":718077952,"data_stored":718077952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:50:38.397 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set noscrub 2024-02-19T21:50:38.740 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:50:38.745 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:38.745 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:50:38.846 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:50:38.875 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:39.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:37.178267+0000 mgr.y (mgr.14514) 687 : cluster [DBG] pgmap v894: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.5 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1022 B/s rd, 4.7 MiB/s wr, 200 op/s; 11685/222573 objects degraded (5.250%); 4073/222573 objects misplaced (1.830%); 2.6 MiB/s, 42 objects/s recovering 2024-02-19T21:50:39.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:37.178267+0000 mgr.y (mgr.14514) 687 : cluster [DBG] pgmap v894: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.5 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1022 B/s rd, 4.7 MiB/s wr, 200 op/s; 11685/222573 objects degraded (5.250%); 4073/222573 objects misplaced (1.830%); 2.6 MiB/s, 42 objects/s recovering 2024-02-19T21:50:39.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:37.178267+0000 mgr.y (mgr.14514) 687 : cluster [DBG] pgmap v894: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.5 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1022 B/s rd, 4.7 MiB/s wr, 200 op/s; 11685/222573 objects degraded (5.250%); 4073/222573 objects misplaced (1.830%); 2.6 MiB/s, 42 objects/s recovering 2024-02-19T21:50:39.076 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:50:39.079 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:39.080 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:50:39.181 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:50:39.212 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:39.337 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:50:39.340 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:39.340 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:50:39.441 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:50:39.466 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:39.486 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:50:39.488 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:39.489 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:50:39.590 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:50:39.622 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:39.644 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:50:39.647 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:39.648 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:50:39.748 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:50:39.786 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:39.810 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:50:39.814 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:39.815 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:50:39.915 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:50:39.941 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:39.965 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:50:39.969 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:39.969 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:50:40.028 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:50:40.028 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:50:40.064 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:50:40.070 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:50:40.103 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:40.304 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:50:40.307 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:40.307 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:50:40.408 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:50:40.439 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:40.463 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:50:40.465 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:40.466 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:50:40.566 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:50:40.596 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:40.711 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:39.178786+0000 mgr.y (mgr.14514) 688 : cluster [DBG] pgmap v895: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.5 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1022 B/s rd, 3.6 MiB/s wr, 183 op/s; 11685/222573 objects degraded (5.250%); 4073/222573 objects misplaced (1.830%); 2.6 MiB/s, 41 objects/s recovering 2024-02-19T21:50:40.711 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:39.703715+0000 mon.a (mon.0) 1699 : cluster [DBG] osdmap e430: 8 total, 8 up, 7 in 2024-02-19T21:50:40.711 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:40.275870+0000 mon.a (mon.0) 1700 : cluster [WRN] Health check update: Degraded data redundancy: 11685/222573 objects degraded (5.250%), 9 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:50:40.846 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:50:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:50:40] "GET /metrics HTTP/1.1" 200 176548 "" "Prometheus/2.33.4" 2024-02-19T21:50:40.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:39.178786+0000 mgr.y (mgr.14514) 688 : cluster [DBG] pgmap v895: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.5 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1022 B/s rd, 3.6 MiB/s wr, 183 op/s; 11685/222573 objects degraded (5.250%); 4073/222573 objects misplaced (1.830%); 2.6 MiB/s, 41 objects/s recovering 2024-02-19T21:50:40.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:39.703715+0000 mon.a (mon.0) 1699 : cluster [DBG] osdmap e430: 8 total, 8 up, 7 in 2024-02-19T21:50:40.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:40.275870+0000 mon.a (mon.0) 1700 : cluster [WRN] Health check update: Degraded data redundancy: 11685/222573 objects degraded (5.250%), 9 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:50:40.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:39.178786+0000 mgr.y (mgr.14514) 688 : cluster [DBG] pgmap v895: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 3 active+recovery_wait+undersized+degraded+remapped; 4.5 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 1022 B/s rd, 3.6 MiB/s wr, 183 op/s; 11685/222573 objects degraded (5.250%); 4073/222573 objects misplaced (1.830%); 2.6 MiB/s, 41 objects/s recovering 2024-02-19T21:50:40.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:39.703715+0000 mon.a (mon.0) 1699 : cluster [DBG] osdmap e430: 8 total, 8 up, 7 in 2024-02-19T21:50:40.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:40.275870+0000 mon.a (mon.0) 1700 : cluster [WRN] Health check update: Degraded data redundancy: 11685/222573 objects degraded (5.250%), 9 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:50:41.096 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_historic_ops 2024-02-19T21:50:41.101 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:50:41.306 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:50:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:50:42.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:40.107109+0000 osd.3 (osd.3) 226 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:50:42.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:40.107176+0000 osd.3 (osd.3) 227 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:50:42.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:40.707477+0000 mon.a (mon.0) 1701 : cluster [DBG] osdmap e431: 8 total, 8 up, 7 in 2024-02-19T21:50:42.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:40.972717+0000 mgr.y (mgr.14514) 689 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:50:42.076 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:40.107109+0000 osd.3 (osd.3) 226 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:50:42.076 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:40.107176+0000 osd.3 (osd.3) 227 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:50:42.076 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:40.707477+0000 mon.a (mon.0) 1701 : cluster [DBG] osdmap e431: 8 total, 8 up, 7 in 2024-02-19T21:50:42.076 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:40.972717+0000 mgr.y (mgr.14514) 689 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:50:42.076 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:40.107109+0000 osd.3 (osd.3) 226 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:50:42.076 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:40.107176+0000 osd.3 (osd.3) 227 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:50:42.077 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:40.707477+0000 mon.a (mon.0) 1701 : cluster [DBG] osdmap e431: 8 total, 8 up, 7 in 2024-02-19T21:50:42.077 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:40.972717+0000 mgr.y (mgr.14514) 689 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:50:42.450 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:50:42.454 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:42.455 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:50:42.555 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:50:42.589 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:42.719 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:41.179341+0000 mgr.y (mgr.14514) 690 : cluster [DBG] pgmap v898: 138 pgs: 1 peering, 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped; 4.5 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 867 B/s rd, 423 KiB/s wr, 141 op/s; 11439/220623 objects degraded (5.185%); 4073/220623 objects misplaced (1.846%); 2.9 MiB/s, 47 objects/s recovering 2024-02-19T21:50:42.788 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:50:42.792 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:42.793 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:50:42.893 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:50:42.920 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:42.946 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:50:42.949 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:42.949 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:50:43.038 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:50:43.050 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:50:43.055 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:50:43.055 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:41.179341+0000 mgr.y (mgr.14514) 690 : cluster [DBG] pgmap v898: 138 pgs: 1 peering, 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped; 4.5 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 867 B/s rd, 423 KiB/s wr, 141 op/s; 11439/220623 objects degraded (5.185%); 4073/220623 objects misplaced (1.846%); 2.9 MiB/s, 47 objects/s recovering 2024-02-19T21:50:43.077 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:43.078 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:50:43.095 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:41.179341+0000 mgr.y (mgr.14514) 690 : cluster [DBG] pgmap v898: 138 pgs: 1 peering, 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped; 4.5 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 867 B/s rd, 423 KiB/s wr, 141 op/s; 11439/220623 objects degraded (5.185%); 4073/220623 objects misplaced (1.846%); 2.9 MiB/s, 47 objects/s recovering 2024-02-19T21:50:43.097 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:50:43.099 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:50:43.102 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:43.102 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:50:43.115 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:50:43.133 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:50:43.162 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:50:43.182 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:50:43.202 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:50:43.202 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:50:43.205 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:50:43.205 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:50:43.205 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:50:43.206 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:50:43.206 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:50:43.206 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:50:43.206 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:50:43.206 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:50:43.234 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:43.291 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:50:43.297 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:43.297 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:50:43.398 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:50:43.428 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:43.977 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:50:43.981 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:50:43.986 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:43.028198+0000 mon.a (mon.0) 1702 : audit [DBG] from='client.? 172.21.15.80:0/2645902434' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:50:43.986 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:43.028198+0000 mon.a (mon.0) 1702 : audit [DBG] from='client.? 172.21.15.80:0/2645902434' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:50:43.987 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:43.987 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:50:44.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:43.028198+0000 mon.a (mon.0) 1702 : audit [DBG] from='client.? 172.21.15.80:0/2645902434' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:50:44.088 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:50:44.116 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:44.136 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:50:44.138 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:44.138 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:50:44.239 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:50:44.266 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:44.290 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:50:44.293 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:44.293 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:50:44.394 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:50:44.423 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:44.446 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:50:44.448 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:44.448 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:50:44.549 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:50:44.580 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:44.598 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:50:44.601 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:44.601 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:50:44.702 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:50:44.733 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:44.735 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-02-19T21:50:44.981 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:43.179831+0000 mgr.y (mgr.14514) 691 : cluster [DBG] pgmap v899: 138 pgs: 1 peering, 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped; 4.5 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 786 B/s rd, 49 KiB/s wr, 116 op/s; 11390/220473 objects degraded (5.166%); 4023/220473 objects misplaced (1.825%); 2.8 MiB/s, 44 objects/s recovering 2024-02-19T21:50:44.982 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:43.860036+0000 mon.c (mon.2) 104 : audit [INF] from='client.? 172.21.15.80:0/4247965606' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:50:44.982 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:43.860395+0000 mon.a (mon.0) 1703 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:50:44.982 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:43.179831+0000 mgr.y (mgr.14514) 691 : cluster [DBG] pgmap v899: 138 pgs: 1 peering, 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped; 4.5 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 786 B/s rd, 49 KiB/s wr, 116 op/s; 11390/220473 objects degraded (5.166%); 4023/220473 objects misplaced (1.825%); 2.8 MiB/s, 44 objects/s recovering 2024-02-19T21:50:44.982 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:43.860036+0000 mon.c (mon.2) 104 : audit [INF] from='client.? 172.21.15.80:0/4247965606' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:50:44.982 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:43.860395+0000 mon.a (mon.0) 1703 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:50:44.988 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:50:44.994 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:44.995 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:50:45.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:43.179831+0000 mgr.y (mgr.14514) 691 : cluster [DBG] pgmap v899: 138 pgs: 1 peering, 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped; 4.5 GiB data, 18 GiB used, 608 GiB / 626 GiB avail; 786 B/s rd, 49 KiB/s wr, 116 op/s; 11390/220473 objects degraded (5.166%); 4023/220473 objects misplaced (1.825%); 2.8 MiB/s, 44 objects/s recovering 2024-02-19T21:50:45.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:43.860036+0000 mon.c (mon.2) 104 : audit [INF] from='client.? 172.21.15.80:0/4247965606' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:50:45.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:43.860395+0000 mon.a (mon.0) 1703 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:50:45.096 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:50:45.127 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:46.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:50:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:50:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:50:46.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:44.723858+0000 mon.a (mon.0) 1704 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:50:46.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:44.732000+0000 mon.a (mon.0) 1705 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:50:46.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:44.732073+0000 mon.a (mon.0) 1706 : cluster [DBG] osdmap e432: 8 total, 8 up, 7 in 2024-02-19T21:50:46.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:45.277916+0000 mon.a (mon.0) 1707 : cluster [WRN] Health check update: Degraded data redundancy: 11390/220473 objects degraded (5.166%), 8 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:50:46.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:44.723858+0000 mon.a (mon.0) 1704 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:50:46.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:44.732000+0000 mon.a (mon.0) 1705 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:50:46.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:44.732073+0000 mon.a (mon.0) 1706 : cluster [DBG] osdmap e432: 8 total, 8 up, 7 in 2024-02-19T21:50:46.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:45.277916+0000 mon.a (mon.0) 1707 : cluster [WRN] Health check update: Degraded data redundancy: 11390/220473 objects degraded (5.166%), 8 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:50:46.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:44.723858+0000 mon.a (mon.0) 1704 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:50:46.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:44.732000+0000 mon.a (mon.0) 1705 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:50:46.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:44.732073+0000 mon.a (mon.0) 1706 : cluster [DBG] osdmap e432: 8 total, 8 up, 7 in 2024-02-19T21:50:46.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:45.277916+0000 mon.a (mon.0) 1707 : cluster [WRN] Health check update: Degraded data redundancy: 11390/220473 objects degraded (5.166%), 8 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:50:46.578 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:50:46.579 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:46.580 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:50:46.681 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:50:46.688 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:50:46.709 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:46.732 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:50:46.735 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:46.735 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:50:46.836 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:50:46.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:45.180474+0000 mgr.y (mgr.14514) 692 : cluster [DBG] pgmap v901: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 1 peering, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped; 4.4 GiB data, 17 GiB used, 608 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 182 op/s; 11332/219303 objects degraded (5.167%); 4023/219303 objects misplaced (1.834%); 3.2 MiB/s, 51 objects/s recovering 2024-02-19T21:50:46.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:45.180474+0000 mgr.y (mgr.14514) 692 : cluster [DBG] pgmap v901: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 1 peering, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped; 4.4 GiB data, 17 GiB used, 608 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 182 op/s; 11332/219303 objects degraded (5.167%); 4023/219303 objects misplaced (1.834%); 3.2 MiB/s, 51 objects/s recovering 2024-02-19T21:50:46.864 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:47.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:45.180474+0000 mgr.y (mgr.14514) 692 : cluster [DBG] pgmap v901: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 1 peering, 2 active+recovery_wait+degraded, 126 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped; 4.4 GiB data, 17 GiB used, 608 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 182 op/s; 11332/219303 objects degraded (5.167%); 4023/219303 objects misplaced (1.834%); 3.2 MiB/s, 51 objects/s recovering 2024-02-19T21:50:47.614 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:50:47.618 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:47.618 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:50:47.719 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:50:47.744 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-19T21:50:47.752 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:48.104 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:50:48.107 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:48.108 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:50:48.208 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:50:48.237 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:48.294 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:50:48.297 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:50:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:50:48.367 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:48.368 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:50:48.391 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:50:48.391 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-02-19T21:50:48.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-02-19T21:50:48.391 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-02-19T21:50:48.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.391 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:28383 10.8 10:146c08a9:::benchmark_data_smithi080_153340_object28382:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e400)", 2024-02-19T21:50:48.391 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:49:16.422486+0000", 2024-02-19T21:50:48.391 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.965900477000005, 2024-02-19T21:50:48.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0259395630000001, 2024-02-19T21:50:48.391 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:48.391 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:48.392 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:48.392 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:48.392 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:48.392 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 28383 2024-02-19T21:50:48.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.392 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:48.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.392 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:48.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.422486+0000", 2024-02-19T21:50:48.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:48.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.392 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:48.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.422486+0000", 2024-02-19T21:50:48.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:50:48.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:48.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.422484+0000", 2024-02-19T21:50:48.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2845999999999997e-05 2024-02-19T21:50:48.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:48.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.422517+0000", 2024-02-19T21:50:48.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3813e-05 2024-02-19T21:50:48.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:48.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.422530+0000", 2024-02-19T21:50:48.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9450000000000004e-06 2024-02-19T21:50:48.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:48.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.422537+0000", 2024-02-19T21:50:48.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00087446599999999996 2024-02-19T21:50:48.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.423412+0000", 2024-02-19T21:50:48.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2136999999999999e-05 2024-02-19T21:50:48.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.395 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.423424+0000", 2024-02-19T21:50:48.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0210667010000001 2024-02-19T21:50:48.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.395 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.444491+0000", 2024-02-19T21:50:48.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000103831 2024-02-19T21:50:48.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:48.395 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.444594+0000", 2024-02-19T21:50:48.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012663900000000001 2024-02-19T21:50:48.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,5", 2024-02-19T21:50:48.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.444721+0000", 2024-02-19T21:50:48.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035143069999999999 2024-02-19T21:50:48.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:48.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.448235+0000", 2024-02-19T21:50:48.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8488000000000001e-05 2024-02-19T21:50:48.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.448274+0000", 2024-02-19T21:50:48.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6772000000000002e-05 2024-02-19T21:50:48.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.448361+0000", 2024-02-19T21:50:48.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9777000000000002e-05 2024-02-19T21:50:48.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:50:48.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.448400+0000", 2024-02-19T21:50:48.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4749999999999999e-05 2024-02-19T21:50:48.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:48.398 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.448425+0000", 2024-02-19T21:50:48.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0259395630000001 2024-02-19T21:50:48.398 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.398 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:48.398 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.398 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:28397 10.8 10:1f16902b:::benchmark_data_smithi080_153340_object28396:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e401)", 2024-02-19T21:50:48.398 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:49:16.432051+0000", 2024-02-19T21:50:48.399 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.956335443, 2024-02-19T21:50:48.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.018626316, 2024-02-19T21:50:48.399 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:48.399 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:48.399 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:48.399 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:48.399 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:48.400 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 28397 2024-02-19T21:50:48.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.400 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:48.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.400 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:48.400 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.432051+0000", 2024-02-19T21:50:48.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:48.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.400 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:48.400 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.432051+0000", 2024-02-19T21:50:48.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:50:48.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:48.401 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.432049+0000", 2024-02-19T21:50:48.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7568000000000001e-05 2024-02-19T21:50:48.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:48.401 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.432076+0000", 2024-02-19T21:50:48.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4873999999999999e-05 2024-02-19T21:50:48.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:48.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.432101+0000", 2024-02-19T21:50:48.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0049e-05 2024-02-19T21:50:48.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:48.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.432111+0000", 2024-02-19T21:50:48.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7989000000000003e-05 2024-02-19T21:50:48.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.432169+0000", 2024-02-19T21:50:48.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1290000000000002e-06 2024-02-19T21:50:48.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.432178+0000", 2024-02-19T21:50:48.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0138431080000001 2024-02-19T21:50:48.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.446021+0000", 2024-02-19T21:50:48.404 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013342599999999999 2024-02-19T21:50:48.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.404 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:48.404 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.446155+0000", 2024-02-19T21:50:48.404 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000186987 2024-02-19T21:50:48.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.404 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,5", 2024-02-19T21:50:48.404 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.446342+0000", 2024-02-19T21:50:48.404 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001961122 2024-02-19T21:50:48.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.405 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.405 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.448303+0000", 2024-02-19T21:50:48.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6380000000000002e-05 2024-02-19T21:50:48.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.405 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:48.405 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.448329+0000", 2024-02-19T21:50:48.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022517190000000001 2024-02-19T21:50:48.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.405 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.405 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.450581+0000", 2024-02-19T21:50:48.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3603000000000002e-05 2024-02-19T21:50:48.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.405 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:50:48.406 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.450635+0000", 2024-02-19T21:50:48.406 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2469999999999998e-05 2024-02-19T21:50:48.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.406 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:48.406 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.450677+0000", 2024-02-19T21:50:48.406 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.018626316 2024-02-19T21:50:48.406 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.406 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:48.406 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.406 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:28404 10.8 10:10a2cf1c:::benchmark_data_smithi080_153340_object28403:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e401)", 2024-02-19T21:50:48.407 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:49:16.455907+0000", 2024-02-19T21:50:48.407 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.932479147999999, 2024-02-19T21:50:48.407 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.99493273299999996, 2024-02-19T21:50:48.407 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:48.407 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:48.407 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:48.407 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:48.407 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:48.407 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 28404 2024-02-19T21:50:48.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.407 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:48.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.407 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:48.407 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.455907+0000", 2024-02-19T21:50:48.407 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:48.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.408 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:48.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.455907+0000", 2024-02-19T21:50:48.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:50:48.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.408 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:48.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.455905+0000", 2024-02-19T21:50:48.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5956e-05 2024-02-19T21:50:48.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.408 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:48.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.455931+0000", 2024-02-19T21:50:48.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.348e-05 2024-02-19T21:50:48.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.409 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:48.409 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.455945+0000", 2024-02-19T21:50:48.409 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3180000000000001e-06 2024-02-19T21:50:48.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.409 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:48.409 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.455952+0000", 2024-02-19T21:50:48.409 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8683999999999997e-05 2024-02-19T21:50:48.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.409 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.409 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.456001+0000", 2024-02-19T21:50:48.409 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0129000000000001e-05 2024-02-19T21:50:48.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.410 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.410 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.456011+0000", 2024-02-19T21:50:48.410 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.99131954300000003 2024-02-19T21:50:48.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.410 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.411 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.447330+0000", 2024-02-19T21:50:48.411 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012863100000000001 2024-02-19T21:50:48.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.411 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:48.411 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.447459+0000", 2024-02-19T21:50:48.411 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121478 2024-02-19T21:50:48.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.411 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,5", 2024-02-19T21:50:48.412 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.447581+0000", 2024-02-19T21:50:48.412 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029422749999999998 2024-02-19T21:50:48.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.412 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.412 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.450523+0000", 2024-02-19T21:50:48.412 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2663999999999999e-05 2024-02-19T21:50:48.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.412 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:48.412 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.450535+0000", 2024-02-19T21:50:48.412 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000217519 2024-02-19T21:50:48.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.413 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.413 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.450753+0000", 2024-02-19T21:50:48.413 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1418000000000002e-05 2024-02-19T21:50:48.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.413 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:50:48.413 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.450794+0000", 2024-02-19T21:50:48.413 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5268000000000001e-05 2024-02-19T21:50:48.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.413 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:48.413 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.450840+0000", 2024-02-19T21:50:48.414 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.99493273299999996 2024-02-19T21:50:48.414 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.414 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:48.414 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.414 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:28410 10.8 10:12486f47:::benchmark_data_smithi080_153340_object28409:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e401)", 2024-02-19T21:50:48.414 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:49:16.460452+0000", 2024-02-19T21:50:48.414 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.927934207999996, 2024-02-19T21:50:48.414 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.99049717900000001, 2024-02-19T21:50:48.414 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:48.415 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:48.415 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:48.415 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:48.415 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:48.415 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 28410 2024-02-19T21:50:48.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.415 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:48.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.415 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:48.415 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.460452+0000", 2024-02-19T21:50:48.415 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:48.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:48.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.460452+0000", 2024-02-19T21:50:48.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:50:48.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:48.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.460451+0000", 2024-02-19T21:50:48.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2446000000000002e-05 2024-02-19T21:50:48.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:48.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.460473+0000", 2024-02-19T21:50:48.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9129999999999998e-06 2024-02-19T21:50:48.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:48.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.460483+0000", 2024-02-19T21:50:48.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0811e-05 2024-02-19T21:50:48.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:48.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.460494+0000", 2024-02-19T21:50:48.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4828999999999999e-05 2024-02-19T21:50:48.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.460559+0000", 2024-02-19T21:50:48.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.062e-05 2024-02-19T21:50:48.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.418 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.418 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.460570+0000", 2024-02-19T21:50:48.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98788835699999999 2024-02-19T21:50:48.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.418 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.418 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.448458+0000", 2024-02-19T21:50:48.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000103063 2024-02-19T21:50:48.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.418 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:48.418 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.448561+0000", 2024-02-19T21:50:48.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117009 2024-02-19T21:50:48.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,5", 2024-02-19T21:50:48.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.448678+0000", 2024-02-19T21:50:48.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0020435179999999998 2024-02-19T21:50:48.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.450721+0000", 2024-02-19T21:50:48.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000157856 2024-02-19T21:50:48.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.450879+0000", 2024-02-19T21:50:48.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.062e-06 2024-02-19T21:50:48.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:48.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.450884+0000", 2024-02-19T21:50:48.420 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9558000000000001e-05 2024-02-19T21:50:48.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:50:48.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.450914+0000", 2024-02-19T21:50:48.420 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5098000000000002e-05 2024-02-19T21:50:48.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.421 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:48.421 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.450949+0000", 2024-02-19T21:50:48.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.99049717900000001 2024-02-19T21:50:48.421 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.421 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:48.421 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.421 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:28416 10.8 10:1a931582:::benchmark_data_smithi080_153340_object28415:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e401)", 2024-02-19T21:50:48.421 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:49:16.465205+0000", 2024-02-19T21:50:48.421 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.923181395, 2024-02-19T21:50:48.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98800467199999997, 2024-02-19T21:50:48.421 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:48.422 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:48.422 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:48.422 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:48.422 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:48.422 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 28416 2024-02-19T21:50:48.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.422 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:48.422 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.422 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:48.422 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.465205+0000", 2024-02-19T21:50:48.422 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:48.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.422 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.422 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:48.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.465205+0000", 2024-02-19T21:50:48.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:50:48.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.423 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:48.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.465203+0000", 2024-02-19T21:50:48.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4619000000000002e-05 2024-02-19T21:50:48.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.423 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:48.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.465237+0000", 2024-02-19T21:50:48.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.291e-05 2024-02-19T21:50:48.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.424 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:48.424 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.465250+0000", 2024-02-19T21:50:48.424 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0094e-05 2024-02-19T21:50:48.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.424 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:48.424 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.465260+0000", 2024-02-19T21:50:48.424 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2781000000000003e-05 2024-02-19T21:50:48.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.424 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.424 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.465303+0000", 2024-02-19T21:50:48.424 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0230000000000004e-06 2024-02-19T21:50:48.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.465310+0000", 2024-02-19T21:50:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98422346699999996 2024-02-19T21:50:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.449534+0000", 2024-02-19T21:50:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2157000000000006e-05 2024-02-19T21:50:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.449616+0000", 2024-02-19T21:50:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2355999999999995e-05 2024-02-19T21:50:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,5", 2024-02-19T21:50:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.449708+0000", 2024-02-19T21:50:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003331713 2024-02-19T21:50:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.453040+0000", 2024-02-19T21:50:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6767999999999998e-05 2024-02-19T21:50:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.453077+0000", 2024-02-19T21:50:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3442000000000002e-05 2024-02-19T21:50:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.453120+0000", 2024-02-19T21:50:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0732999999999997e-05 2024-02-19T21:50:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:50:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.453171+0000", 2024-02-19T21:50:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8513000000000002e-05 2024-02-19T21:50:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.453209+0000", 2024-02-19T21:50:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98800467199999997 2024-02-19T21:50:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:28426 10.8 10:162d93b1:::benchmark_data_smithi080_153340_object28425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e401)", 2024-02-19T21:50:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:49:16.473552+0000", 2024-02-19T21:50:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.914834569999996, 2024-02-19T21:50:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98492085799999995, 2024-02-19T21:50:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 28426 2024-02-19T21:50:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.473552+0000", 2024-02-19T21:50:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.473552+0000", 2024-02-19T21:50:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:50:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.473551+0000", 2024-02-19T21:50:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2897000000000001e-05 2024-02-19T21:50:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.473574+0000", 2024-02-19T21:50:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9920000000000002e-06 2024-02-19T21:50:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.473584+0000", 2024-02-19T21:50:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0118999999999999e-05 2024-02-19T21:50:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.473594+0000", 2024-02-19T21:50:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4697999999999998e-05 2024-02-19T21:50:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.473638+0000", 2024-02-19T21:50:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6069999999999996e-06 2024-02-19T21:50:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.473645+0000", 2024-02-19T21:50:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.97734645499999995 2024-02-19T21:50:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.450991+0000", 2024-02-19T21:50:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014056800000000001 2024-02-19T21:50:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.451132+0000", 2024-02-19T21:50:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014443 2024-02-19T21:50:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,5", 2024-02-19T21:50:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.451276+0000", 2024-02-19T21:50:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018065780000000001 2024-02-19T21:50:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.453083+0000", 2024-02-19T21:50:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021248299999999999 2024-02-19T21:50:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.453295+0000", 2024-02-19T21:50:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0051089320000000001 2024-02-19T21:50:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.458404+0000", 2024-02-19T21:50:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0014e-05 2024-02-19T21:50:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:50:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.458444+0000", 2024-02-19T21:50:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7974e-05 2024-02-19T21:50:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.458472+0000", 2024-02-19T21:50:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98492085799999995 2024-02-19T21:50:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:28433 10.8 10:1aad12c2:::benchmark_data_smithi080_153340_object28432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e401)", 2024-02-19T21:50:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:49:16.480775+0000", 2024-02-19T21:50:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.907610652000002, 2024-02-19T21:50:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98136144800000003, 2024-02-19T21:50:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 28433 2024-02-19T21:50:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.480775+0000", 2024-02-19T21:50:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.480775+0000", 2024-02-19T21:50:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999971 2024-02-19T21:50:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.480772+0000", 2024-02-19T21:50:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2784999999999999e-05 2024-02-19T21:50:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.480805+0000", 2024-02-19T21:50:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4554e-05 2024-02-19T21:50:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.480820+0000", 2024-02-19T21:50:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9639999999999997e-06 2024-02-19T21:50:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.480827+0000", 2024-02-19T21:50:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2521000000000001e-05 2024-02-19T21:50:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.480879+0000", 2024-02-19T21:50:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3217999999999999e-05 2024-02-19T21:50:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.480893+0000", 2024-02-19T21:50:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.97112427000000001 2024-02-19T21:50:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.452017+0000", 2024-02-19T21:50:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010254 2024-02-19T21:50:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.452119+0000", 2024-02-19T21:50:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000114913 2024-02-19T21:50:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,5", 2024-02-19T21:50:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.452234+0000", 2024-02-19T21:50:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041126260000000003 2024-02-19T21:50:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.456347+0000", 2024-02-19T21:50:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9678999999999999e-05 2024-02-19T21:50:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.456367+0000", 2024-02-19T21:50:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0056948980000000003 2024-02-19T21:50:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.462061+0000", 2024-02-19T21:50:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9303e-05 2024-02-19T21:50:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:50:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.462101+0000", 2024-02-19T21:50:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6124999999999997e-05 2024-02-19T21:50:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.462137+0000", 2024-02-19T21:50:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98136144800000003 2024-02-19T21:50:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:28445 10.8 10:17d39fb6:::benchmark_data_smithi080_153340_object28444:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e401)", 2024-02-19T21:50:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:49:16.499700+0000", 2024-02-19T21:50:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.888685792000004, 2024-02-19T21:50:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.96520329500000002, 2024-02-19T21:50:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 28445 2024-02-19T21:50:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.499700+0000", 2024-02-19T21:50:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.499700+0000", 2024-02-19T21:50:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:50:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.499699+0000", 2024-02-19T21:50:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3198999999999999e-05 2024-02-19T21:50:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.499722+0000", 2024-02-19T21:50:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1749000000000001e-05 2024-02-19T21:50:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.499734+0000", 2024-02-19T21:50:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4249999999999997e-06 2024-02-19T21:50:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.499739+0000", 2024-02-19T21:50:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6749000000000002e-05 2024-02-19T21:50:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.499796+0000", 2024-02-19T21:50:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1844999999999999e-05 2024-02-19T21:50:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.499808+0000", 2024-02-19T21:50:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.953519581 2024-02-19T21:50:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.453327+0000", 2024-02-19T21:50:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014146300000000001 2024-02-19T21:50:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.453469+0000", 2024-02-19T21:50:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018795800000000001 2024-02-19T21:50:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,5", 2024-02-19T21:50:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.453657+0000", 2024-02-19T21:50:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027153960000000001 2024-02-19T21:50:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.456372+0000", 2024-02-19T21:50:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4669999999999998e-05 2024-02-19T21:50:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.456417+0000", 2024-02-19T21:50:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0084059319999999996 2024-02-19T21:50:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.464823+0000", 2024-02-19T21:50:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3501000000000002e-05 2024-02-19T21:50:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:50:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.464866+0000", 2024-02-19T21:50:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7537999999999999e-05 2024-02-19T21:50:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.464904+0000", 2024-02-19T21:50:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.96520329500000002 2024-02-19T21:50:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:28448 10.8 10:1262ee27:::benchmark_data_smithi080_153340_object28447:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e401)", 2024-02-19T21:50:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:49:16.500969+0000", 2024-02-19T21:50:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.887417434, 2024-02-19T21:50:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.96404624900000002, 2024-02-19T21:50:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 28448 2024-02-19T21:50:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.500969+0000", 2024-02-19T21:50:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.500969+0000", 2024-02-19T21:50:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:50:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.500968+0000", 2024-02-19T21:50:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8610999999999999e-05 2024-02-19T21:50:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.500986+0000", 2024-02-19T21:50:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0461e-05 2024-02-19T21:50:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.500997+0000", 2024-02-19T21:50:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6859999999999997e-06 2024-02-19T21:50:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.501001+0000", 2024-02-19T21:50:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0639999999999997e-05 2024-02-19T21:50:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.501042+0000", 2024-02-19T21:50:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8090000000000004e-06 2024-02-19T21:50:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:16.501049+0000", 2024-02-19T21:50:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.95350841600000003 2024-02-19T21:50:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.454557+0000", 2024-02-19T21:50:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109302 2024-02-19T21:50:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.454667+0000", 2024-02-19T21:50:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014098600000000001 2024-02-19T21:50:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,5", 2024-02-19T21:50:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.454807+0000", 2024-02-19T21:50:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001570386 2024-02-19T21:50:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.456378+0000", 2024-02-19T21:50:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0609000000000001e-05 2024-02-19T21:50:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.456448+0000", 2024-02-19T21:50:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085018909999999993 2024-02-19T21:50:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.464950+0000", 2024-02-19T21:50:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1139999999999997e-05 2024-02-19T21:50:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:50:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.464982+0000", 2024-02-19T21:50:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3395999999999997e-05 2024-02-19T21:50:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:17.465015+0000", 2024-02-19T21:50:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.96404624900000002 2024-02-19T21:50:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:65153 10.8 10:1d18666e:::benchmark_data_smithi080_153340_object65152:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e412)", 2024-02-19T21:50:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:49:53.447965+0000", 2024-02-19T21:50:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 54.940421489000002, 2024-02-19T21:50:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.278161206, 2024-02-19T21:50:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:50:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 65153 2024-02-19T21:50:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.447965+0000", 2024-02-19T21:50:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.447965+0000", 2024-02-19T21:50:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:50:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.447963+0000", 2024-02-19T21:50:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3608000000000002e-05 2024-02-19T21:50:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.447986+0000", 2024-02-19T21:50:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2224e-05 2024-02-19T21:50:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.447999+0000", 2024-02-19T21:50:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2160000000000003e-06 2024-02-19T21:50:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.448005+0000", 2024-02-19T21:50:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.876e-05 2024-02-19T21:50:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.448064+0000", 2024-02-19T21:50:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000157455 2024-02-19T21:50:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.448221+0000", 2024-02-19T21:50:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017050799999999999 2024-02-19T21:50:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,5", 2024-02-19T21:50:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.448392+0000", 2024-02-19T21:50:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042350110000000003 2024-02-19T21:50:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.452627+0000", 2024-02-19T21:50:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9118000000000001e-05 2024-02-19T21:50:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.452666+0000", 2024-02-19T21:50:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023482052999999999 2024-02-19T21:50:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.476148+0000", 2024-02-19T21:50:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1539000000000001e-05 2024-02-19T21:50:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.476159+0000", 2024-02-19T21:50:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.99815437399999996 2024-02-19T21:50:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:54.474314+0000", 2024-02-19T21:50:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2153999999999999e-05 2024-02-19T21:50:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:54.474326+0000", 2024-02-19T21:50:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.251704213 2024-02-19T21:50:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.726030+0000", 2024-02-19T21:50:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5832e-05 2024-02-19T21:50:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.726126+0000", 2024-02-19T21:50:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.278161206 2024-02-19T21:50:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:65159 10.8 10:12be95bc:::benchmark_data_smithi080_153340_object65158:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e412)", 2024-02-19T21:50:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:49:53.449828+0000", 2024-02-19T21:50:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 54.938558243999999, 2024-02-19T21:50:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2778617699999999, 2024-02-19T21:50:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:50:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 65159 2024-02-19T21:50:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.449828+0000", 2024-02-19T21:50:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.449828+0000", 2024-02-19T21:50:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:50:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.449827+0000", 2024-02-19T21:50:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3969e-05 2024-02-19T21:50:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.449851+0000", 2024-02-19T21:50:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1637000000000001e-05 2024-02-19T21:50:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.449862+0000", 2024-02-19T21:50:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.993e-06 2024-02-19T21:50:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.449868+0000", 2024-02-19T21:50:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000625116 2024-02-19T21:50:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.450493+0000", 2024-02-19T21:50:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115461 2024-02-19T21:50:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.450609+0000", 2024-02-19T21:50:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104652 2024-02-19T21:50:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,5", 2024-02-19T21:50:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.450714+0000", 2024-02-19T21:50:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002576268 2024-02-19T21:50:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.453290+0000", 2024-02-19T21:50:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001474459 2024-02-19T21:50:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.454764+0000", 2024-02-19T21:50:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021447489 2024-02-19T21:50:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.476212+0000", 2024-02-19T21:50:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8050000000000007e-06 2024-02-19T21:50:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.476220+0000", 2024-02-19T21:50:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.99814364700000002 2024-02-19T21:50:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:54.474363+0000", 2024-02-19T21:50:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9030000000000004e-06 2024-02-19T21:50:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:54.474371+0000", 2024-02-19T21:50:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2532469019999999 2024-02-19T21:50:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.727618+0000", 2024-02-19T21:50:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1605000000000003e-05 2024-02-19T21:50:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.727690+0000", 2024-02-19T21:50:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2778617699999999 2024-02-19T21:50:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:65166 10.8 10:1b53e5aa:::benchmark_data_smithi080_153340_object65165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e412)", 2024-02-19T21:50:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:49:53.456262+0000", 2024-02-19T21:50:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 54.932124563999999, 2024-02-19T21:50:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2715233650000002, 2024-02-19T21:50:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:50:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 65166 2024-02-19T21:50:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.456262+0000", 2024-02-19T21:50:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.456262+0000", 2024-02-19T21:50:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:50:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.456260+0000", 2024-02-19T21:50:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4275000000000001e-05 2024-02-19T21:50:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.456284+0000", 2024-02-19T21:50:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2065000000000001e-05 2024-02-19T21:50:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.456296+0000", 2024-02-19T21:50:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.528e-06 2024-02-19T21:50:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.456303+0000", 2024-02-19T21:50:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8651e-05 2024-02-19T21:50:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.456341+0000", 2024-02-19T21:50:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7478000000000004e-05 2024-02-19T21:50:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.456439+0000", 2024-02-19T21:50:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000107933 2024-02-19T21:50:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,5", 2024-02-19T21:50:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.456547+0000", 2024-02-19T21:50:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039194620000000003 2024-02-19T21:50:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.460466+0000", 2024-02-19T21:50:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016797159999999999 2024-02-19T21:50:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.462146+0000", 2024-02-19T21:50:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014109714000000001 2024-02-19T21:50:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.476256+0000", 2024-02-19T21:50:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3010000000000001e-06 2024-02-19T21:50:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.476263+0000", 2024-02-19T21:50:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.99814548000000003 2024-02-19T21:50:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:54.474408+0000", 2024-02-19T21:50:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1865000000000001e-05 2024-02-19T21:50:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:54.474420+0000", 2024-02-19T21:50:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2533036040000001 2024-02-19T21:50:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.727724+0000", 2024-02-19T21:50:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0943000000000002e-05 2024-02-19T21:50:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.727785+0000", 2024-02-19T21:50:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2715233650000002 2024-02-19T21:50:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:65170 10.8 10:18a8a9a7:::benchmark_data_smithi080_153340_object65169:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e412)", 2024-02-19T21:50:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:49:53.463996+0000", 2024-02-19T21:50:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 54.924389834999999, 2024-02-19T21:50:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2961268590000001, 2024-02-19T21:50:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:50:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 65170 2024-02-19T21:50:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.463996+0000", 2024-02-19T21:50:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.463996+0000", 2024-02-19T21:50:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:50:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.463994+0000", 2024-02-19T21:50:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9986000000000001e-05 2024-02-19T21:50:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.464024+0000", 2024-02-19T21:50:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2826999999999999e-05 2024-02-19T21:50:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.464037+0000", 2024-02-19T21:50:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5329999999999997e-06 2024-02-19T21:50:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.464045+0000", 2024-02-19T21:50:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4980999999999993e-05 2024-02-19T21:50:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.464110+0000", 2024-02-19T21:50:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000132588 2024-02-19T21:50:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.464242+0000", 2024-02-19T21:50:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012478000000000001 2024-02-19T21:50:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,5", 2024-02-19T21:50:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.464367+0000", 2024-02-19T21:50:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002283275 2024-02-19T21:50:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.466650+0000", 2024-02-19T21:50:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011317081999999999 2024-02-19T21:50:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.477967+0000", 2024-02-19T21:50:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0974e-05 2024-02-19T21:50:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.477978+0000", 2024-02-19T21:50:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.99647493499999995 2024-02-19T21:50:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:54.474453+0000", 2024-02-19T21:50:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8429999999999993e-06 2024-02-19T21:50:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:54.474461+0000", 2024-02-19T21:50:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2533521080000001 2024-02-19T21:50:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.727813+0000", 2024-02-19T21:50:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063056099999999997 2024-02-19T21:50:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for degraded object", 2024-02-19T21:50:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.728444+0000", 2024-02-19T21:50:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.031555463999999998 2024-02-19T21:50:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.759999+0000", 2024-02-19T21:50:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000123781 2024-02-19T21:50:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.760123+0000", 2024-02-19T21:50:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2961268590000001 2024-02-19T21:50:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:65173 10.8 10:16090c1f:::benchmark_data_smithi080_153340_object65172:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e412)", 2024-02-19T21:50:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:49:53.477848+0000", 2024-02-19T21:50:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 54.910537849000001, 2024-02-19T21:50:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2841394629999998, 2024-02-19T21:50:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 65173 2024-02-19T21:50:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.477848+0000", 2024-02-19T21:50:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.477848+0000", 2024-02-19T21:50:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999976 2024-02-19T21:50:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.477846+0000", 2024-02-19T21:50:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9153e-05 2024-02-19T21:50:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.477875+0000", 2024-02-19T21:50:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6971999999999999e-05 2024-02-19T21:50:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.477892+0000", 2024-02-19T21:50:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8640000000000002e-06 2024-02-19T21:50:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.477901+0000", 2024-02-19T21:50:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00052174299999999997 2024-02-19T21:50:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.478422+0000", 2024-02-19T21:50:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8720000000000008e-06 2024-02-19T21:50:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.478431+0000", 2024-02-19T21:50:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.99605508899999995 2024-02-19T21:50:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:54.474486+0000", 2024-02-19T21:50:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5240000000000003e-06 2024-02-19T21:50:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:54.474494+0000", 2024-02-19T21:50:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.25405452 2024-02-19T21:50:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.728548+0000", 2024-02-19T21:50:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012222000000000001 2024-02-19T21:50:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.728671+0000", 2024-02-19T21:50:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000182053 2024-02-19T21:50:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,7", 2024-02-19T21:50:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.728853+0000", 2024-02-19T21:50:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0082102909999999998 2024-02-19T21:50:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.737063+0000", 2024-02-19T21:50:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4131999999999998e-05 2024-02-19T21:50:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.737097+0000", 2024-02-19T21:50:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023093542000000002 2024-02-19T21:50:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.760191+0000", 2024-02-19T21:50:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4598999999999996e-05 2024-02-19T21:50:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:50:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.760255+0000", 2024-02-19T21:50:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0017324249999999999 2024-02-19T21:50:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.761988+0000", 2024-02-19T21:50:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2841394629999998 2024-02-19T21:50:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:65176 10.8 10:1e22a0b9:::benchmark_data_smithi080_153340_object65175:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e413)", 2024-02-19T21:50:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:49:53.485208+0000", 2024-02-19T21:50:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 54.903178453000002, 2024-02-19T21:50:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2817707889999999, 2024-02-19T21:50:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 65176 2024-02-19T21:50:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.485208+0000", 2024-02-19T21:50:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.485208+0000", 2024-02-19T21:50:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:50:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.485206+0000", 2024-02-19T21:50:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5441999999999997e-05 2024-02-19T21:50:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.485241+0000", 2024-02-19T21:50:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1928000000000001e-05 2024-02-19T21:50:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.485263+0000", 2024-02-19T21:50:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1100999999999999e-05 2024-02-19T21:50:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.485274+0000", 2024-02-19T21:50:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9623999999999997e-05 2024-02-19T21:50:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.485334+0000", 2024-02-19T21:50:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2101e-05 2024-02-19T21:50:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.485346+0000", 2024-02-19T21:50:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.98917177199999995 2024-02-19T21:50:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:54.474518+0000", 2024-02-19T21:50:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2989999999999999e-06 2024-02-19T21:50:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:54.474525+0000", 2024-02-19T21:50:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2562449440000001 2024-02-19T21:50:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.730770+0000", 2024-02-19T21:50:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015327400000000001 2024-02-19T21:50:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.730923+0000", 2024-02-19T21:50:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000123955 2024-02-19T21:50:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,7", 2024-02-19T21:50:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.731047+0000", 2024-02-19T21:50:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0060564160000000002 2024-02-19T21:50:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.737103+0000", 2024-02-19T21:50:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8878999999999997e-05 2024-02-19T21:50:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.737152+0000", 2024-02-19T21:50:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.027328989000000001 2024-02-19T21:50:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.764481+0000", 2024-02-19T21:50:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2087000000000004e-05 2024-02-19T21:50:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:50:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.764543+0000", 2024-02-19T21:50:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024350560000000001 2024-02-19T21:50:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.766978+0000", 2024-02-19T21:50:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2817707889999999 2024-02-19T21:50:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:65186 10.5 10.956ac665 (undecoded) ondisk+write+known_if_redirected e413)", 2024-02-19T21:50:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:49:53.509079+0000", 2024-02-19T21:50:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 54.879307019000002, 2024-02-19T21:50:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.96485720900000005, 2024-02-19T21:50:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:50:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 65186 2024-02-19T21:50:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.509079+0000", 2024-02-19T21:50:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.509079+0000", 2024-02-19T21:50:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:50:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.509077+0000", 2024-02-19T21:50:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9546999999999999e-05 2024-02-19T21:50:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.509117+0000", 2024-02-19T21:50:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3839000000000001e-05 2024-02-19T21:50:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.509131+0000", 2024-02-19T21:50:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8479999999999997e-06 2024-02-19T21:50:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.509137+0000", 2024-02-19T21:50:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3609999999999996e-05 2024-02-19T21:50:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.509200+0000", 2024-02-19T21:50:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4038000000000002e-05 2024-02-19T21:50:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.509234+0000", 2024-02-19T21:50:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.96468490799999995 2024-02-19T21:50:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:54.473919+0000", 2024-02-19T21:50:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7020999999999998e-05 2024-02-19T21:50:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:54.473936+0000", 2024-02-19T21:50:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.96485720900000005 2024-02-19T21:50:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:65188 10.8 10:1c7acbf9:::benchmark_data_smithi080_153340_object65187:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e413)", 2024-02-19T21:50:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:49:53.509784+0000", 2024-02-19T21:50:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 54.878602207, 2024-02-19T21:50:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2594700859999999, 2024-02-19T21:50:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 65188 2024-02-19T21:50:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.509784+0000", 2024-02-19T21:50:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.509784+0000", 2024-02-19T21:50:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:50:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.509783+0000", 2024-02-19T21:50:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4664999999999998e-05 2024-02-19T21:50:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.509808+0000", 2024-02-19T21:50:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3098000000000001e-05 2024-02-19T21:50:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.509821+0000", 2024-02-19T21:50:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2219999999999999e-06 2024-02-19T21:50:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.509827+0000", 2024-02-19T21:50:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8289999999999999e-05 2024-02-19T21:50:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.509885+0000", 2024-02-19T21:50:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.011e-05 2024-02-19T21:50:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.509895+0000", 2024-02-19T21:50:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.96465309499999996 2024-02-19T21:50:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:54.474548+0000", 2024-02-19T21:50:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4089999999999997e-06 2024-02-19T21:50:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:54.474556+0000", 2024-02-19T21:50:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.258350651 2024-02-19T21:50:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.732906+0000", 2024-02-19T21:50:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016354499999999999 2024-02-19T21:50:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.733070+0000", 2024-02-19T21:50:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023602000000000001 2024-02-19T21:50:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,7", 2024-02-19T21:50:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.733306+0000", 2024-02-19T21:50:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003802803 2024-02-19T21:50:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.737109+0000", 2024-02-19T21:50:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7719000000000006e-05 2024-02-19T21:50:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.737186+0000", 2024-02-19T21:50:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.029865427999999999 2024-02-19T21:50:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.767052+0000", 2024-02-19T21:50:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3406999999999999e-05 2024-02-19T21:50:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:50:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.767105+0000", 2024-02-19T21:50:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0021486809999999999 2024-02-19T21:50:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.769254+0000", 2024-02-19T21:50:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2594700859999999 2024-02-19T21:50:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:65191 10.8 10:1c75b39d:::benchmark_data_smithi080_153340_object65190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e413)", 2024-02-19T21:50:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:49:53.514775+0000", 2024-02-19T21:50:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 54.873611265000001, 2024-02-19T21:50:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2568540650000002, 2024-02-19T21:50:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 65191 2024-02-19T21:50:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.514775+0000", 2024-02-19T21:50:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.514775+0000", 2024-02-19T21:50:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999971 2024-02-19T21:50:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.514772+0000", 2024-02-19T21:50:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8209999999999999e-05 2024-02-19T21:50:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.514800+0000", 2024-02-19T21:50:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8627999999999999e-05 2024-02-19T21:50:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.514819+0000", 2024-02-19T21:50:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7759999999999997e-06 2024-02-19T21:50:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.514827+0000", 2024-02-19T21:50:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3257999999999996e-05 2024-02-19T21:50:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.514890+0000", 2024-02-19T21:50:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0045e-05 2024-02-19T21:50:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.514900+0000", 2024-02-19T21:50:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.95968118899999999 2024-02-19T21:50:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:54.474581+0000", 2024-02-19T21:50:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6550000000000004e-06 2024-02-19T21:50:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:54.474589+0000", 2024-02-19T21:50:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.262624207 2024-02-19T21:50:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.737213+0000", 2024-02-19T21:50:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010406 2024-02-19T21:50:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.737317+0000", 2024-02-19T21:50:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012934099999999999 2024-02-19T21:50:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,7", 2024-02-19T21:50:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.737447+0000", 2024-02-19T21:50:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055525820000000004 2024-02-19T21:50:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.742999+0000", 2024-02-19T21:50:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5830000000000003e-06 2024-02-19T21:50:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.743006+0000", 2024-02-19T21:50:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.026361723 2024-02-19T21:50:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.769367+0000", 2024-02-19T21:50:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4070000000000003e-05 2024-02-19T21:50:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:50:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.769411+0000", 2024-02-19T21:50:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022174019999999998 2024-02-19T21:50:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.771629+0000", 2024-02-19T21:50:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2568540650000002 2024-02-19T21:50:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:65215 10.8 10:10268671:::benchmark_data_smithi080_153340_object65214:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e413)", 2024-02-19T21:50:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:49:53.559771+0000", 2024-02-19T21:50:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 54.828614700999999, 2024-02-19T21:50:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2142441229999998, 2024-02-19T21:50:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 65215 2024-02-19T21:50:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.559771+0000", 2024-02-19T21:50:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.559771+0000", 2024-02-19T21:50:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:50:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.559770+0000", 2024-02-19T21:50:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.056e-05 2024-02-19T21:50:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.559790+0000", 2024-02-19T21:50:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1949e-05 2024-02-19T21:50:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.559802+0000", 2024-02-19T21:50:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7840000000000003e-06 2024-02-19T21:50:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.559807+0000", 2024-02-19T21:50:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7824000000000002e-05 2024-02-19T21:50:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.559855+0000", 2024-02-19T21:50:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1266e-05 2024-02-19T21:50:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.559866+0000", 2024-02-19T21:50:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.91474742799999997 2024-02-19T21:50:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:54.474613+0000", 2024-02-19T21:50:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3509999999999996e-06 2024-02-19T21:50:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:54.474621+0000", 2024-02-19T21:50:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2644498749999999 2024-02-19T21:50:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.739071+0000", 2024-02-19T21:50:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015170900000000001 2024-02-19T21:50:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.739222+0000", 2024-02-19T21:50:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000208839 2024-02-19T21:50:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,7", 2024-02-19T21:50:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.739431+0000", 2024-02-19T21:50:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036154749999999999 2024-02-19T21:50:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.743047+0000", 2024-02-19T21:50:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2483000000000001e-05 2024-02-19T21:50:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.743079+0000", 2024-02-19T21:50:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.02861145 2024-02-19T21:50:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.771691+0000", 2024-02-19T21:50:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8671000000000003e-05 2024-02-19T21:50:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:50:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.771729+0000", 2024-02-19T21:50:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00228626 2024-02-19T21:50:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.774016+0000", 2024-02-19T21:50:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2142441229999998 2024-02-19T21:50:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:65217 10.8 10:12fbc58b:::benchmark_data_smithi080_153340_object65216:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e413)", 2024-02-19T21:50:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:49:53.564035+0000", 2024-02-19T21:50:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 54.824350680999999, 2024-02-19T21:50:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2126842980000001, 2024-02-19T21:50:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:50:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:50:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:50:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:50:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:50:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 65217 2024-02-19T21:50:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:50:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:50:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.564035+0000", 2024-02-19T21:50:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:50:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:50:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.564035+0000", 2024-02-19T21:50:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:50:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:50:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.564034+0000", 2024-02-19T21:50:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9891999999999999e-05 2024-02-19T21:50:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:50:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.564054+0000", 2024-02-19T21:50:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0718e-05 2024-02-19T21:50:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:50:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.564065+0000", 2024-02-19T21:50:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5580000000000002e-06 2024-02-19T21:50:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:50:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.564069+0000", 2024-02-19T21:50:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2336999999999998e-05 2024-02-19T21:50:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.564112+0000", 2024-02-19T21:50:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0210000000000002e-06 2024-02-19T21:50:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:53.564119+0000", 2024-02-19T21:50:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.91056957100000002 2024-02-19T21:50:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:54.474688+0000", 2024-02-19T21:50:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4700000000000002e-06 2024-02-19T21:50:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:50:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:54.474697+0000", 2024-02-19T21:50:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2661147239999999 2024-02-19T21:50:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:50:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.740811+0000", 2024-02-19T21:50:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015990000000000001 2024-02-19T21:50:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:50:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.740971+0000", 2024-02-19T21:50:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023141599999999999 2024-02-19T21:50:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2,7", 2024-02-19T21:50:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.741203+0000", 2024-02-19T21:50:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001871618 2024-02-19T21:50:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.743074+0000", 2024-02-19T21:50:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3572000000000003e-05 2024-02-19T21:50:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:50:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.743108+0000", 2024-02-19T21:50:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.030973626000000001 2024-02-19T21:50:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:50:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.774082+0000", 2024-02-19T21:50:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0906000000000001e-05 2024-02-19T21:50:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:50:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.774162+0000", 2024-02-19T21:50:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025572519999999999 2024-02-19T21:50:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:50:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:50:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:50:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:49:55.776720+0000", 2024-02-19T21:50:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2126842980000001 2024-02-19T21:50:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:50:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:50:48.535 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:50:48.535 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:50:48.562 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:48.812 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:50:48.814 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:47.181260+0000 mgr.y (mgr.14514) 693 : cluster [DBG] pgmap v902: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 127 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped; 4.4 GiB data, 17 GiB used, 608 GiB / 626 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 189 op/s; 11122/218358 objects degraded (5.093%); 3974/218358 objects misplaced (1.820%); 3.9 MiB/s, 62 objects/s recovering 2024-02-19T21:50:48.814 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:47.181260+0000 mgr.y (mgr.14514) 693 : cluster [DBG] pgmap v902: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 127 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped; 4.4 GiB data, 17 GiB used, 608 GiB / 626 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 189 op/s; 11122/218358 objects degraded (5.093%); 3974/218358 objects misplaced (1.820%); 3.9 MiB/s, 62 objects/s recovering 2024-02-19T21:50:48.815 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:48.815 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:50:48.916 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:50:48.945 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:48.970 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:50:48.974 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:48.975 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:50:49.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:47.181260+0000 mgr.y (mgr.14514) 693 : cluster [DBG] pgmap v902: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 127 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped; 4.4 GiB data, 17 GiB used, 608 GiB / 626 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 189 op/s; 11122/218358 objects degraded (5.093%); 3974/218358 objects misplaced (1.820%); 3.9 MiB/s, 62 objects/s recovering 2024-02-19T21:50:49.075 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:50:49.106 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:49.130 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:50:49.132 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:49.133 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:50:49.234 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:50:49.264 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:49.293 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:50:49.296 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:49.296 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:50:49.381 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.1 dump_ops_in_flight 2024-02-19T21:50:49.397 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:50:49.424 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:49.447 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:50:49.452 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:49.452 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:50:49.553 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:50:49.586 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:49.610 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:50:49.615 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:49.616 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:50:49.717 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:50:49.748 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:48.280229+0000 mgr.y (mgr.14514) 694 : audit [DBG] from='client.25682 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:50:49.748 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:48.280229+0000 mgr.y (mgr.14514) 694 : audit [DBG] from='client.25682 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:50:49.751 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:49.915 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:50:49.919 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:49.919 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:50:49.941 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":902,"stamp":"2024-02-19T21:50:47.180646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4757460668,"num_objects":72786,"num_object_clones":0,"num_object_copies":218358,"num_objects_missing_on_primary":997,"num_objects_missing":997,"num_objects_degraded":11122,"num_objects_misplaced":3974,"num_objects_unfound":0,"num_objects_dirty":72786,"num_whiteouts":0,"num_read":2206,"num_read_kb":1958,"num_write":77614,"num_write_kb":4783849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4805,"num_bytes_recovered":296426266,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77247,"ondisk_log_size":77247,"up":414,"acting":408,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":421,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":656216064,"kb_used":18276072,"kb_used_data":13794032,"kb_used_omap":0,"kb_used_meta":4481983,"kb_avail":637939992,"statfs":{"total":671965249536,"available":653250551808,"internally_reserved":0,"allocated":14125088768,"data_stored":14116433847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":4589550644},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-92078080,"num_objects":-1405,"num_object_clones":0,"num_object_copies":-4215,"num_objects_missing_on_primary":-101,"num_objects_missing":-101,"num_objects_degraded":-563,"num_objects_misplaced":-99,"num_objects_unfound":0,"num_objects_dirty":-1405,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":1405,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":465,"num_bytes_recovered":30474240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.479583"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":28,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.727523+0000","last_change":"2024-02-19T21:49:54.492937+0000","last_active":"2024-02-19T21:50:40.727523+0000","last_peered":"2024-02-19T21:50:40.727523+0000","last_clean":"2024-02-19T21:50:40.727523+0000","last_became_active":"2024-02-19T21:49:54.492544+0000","last_became_peered":"2024-02-19T21:49:54.492544+0000","last_unstale":"2024-02-19T21:50:40.727523+0000","last_undegraded":"2024-02-19T21:50:40.727523+0000","last_fullsized":"2024-02-19T21:50:40.727523+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.643236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.643236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":407,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.721863+0000","last_change":"2024-02-19T21:45:17.201007+0000","last_active":"2024-02-19T21:50:40.721863+0000","last_peered":"2024-02-19T21:50:40.721863+0000","last_clean":"2024-02-19T21:50:40.721863+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:50:40.721863+0000","last_undegraded":"2024-02-19T21:50:40.721863+0000","last_fullsized":"2024-02-19T21:50:40.721863+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:17.200897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:17.200897+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"201'27","reported_seq":76,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.709146+0000","last_change":"2024-02-19T21:49:08.327817+0000","last_active":"2024-02-19T21:50:40.709146+0000","last_peered":"2024-02-19T21:50:40.709146+0000","last_clean":"2024-02-19T21:50:40.709146+0000","last_became_active":"2024-02-19T21:49:08.327416+0000","last_became_peered":"2024-02-19T21:49:08.327416+0000","last_unstale":"2024-02-19T21:50:40.709146+0000","last_undegraded":"2024-02-19T21:50:40.709146+0000","last_fullsized":"2024-02-19T21:50:40.709146+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'27","last_scrub_stamp":"2024-02-19T21:44:48.022013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:48.022013+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":380,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.702971+0000","last_change":"2024-02-19T21:48:30.516215+0000","last_active":"2024-02-19T21:50:40.702971+0000","last_peered":"2024-02-19T21:50:40.702971+0000","last_clean":"2024-02-19T21:50:40.702971+0000","last_became_active":"2024-02-19T21:47:46.250178+0000","last_became_peered":"2024-02-19T21:47:46.250178+0000","last_unstale":"2024-02-19T21:50:40.702971+0000","last_undegraded":"2024-02-19T21:50:40.702971+0000","last_fullsized":"2024-02-19T21:50:40.702971+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.516139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.516139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":103,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.723073+0000","last_change":"2024-02-19T21:49:08.330105+0000","last_active":"2024-02-19T21:50:40.723073+0000","last_peered":"2024-02-19T21:50:40.723073+0000","last_clean":"2024-02-19T21:50:40.723073+0000","last_became_active":"2024-02-19T21:49:08.328994+0000","last_became_peered":"2024-02-19T21:49:08.328994+0000","last_unstale":"2024-02-19T21:50:40.723073+0000","last_undegraded":"2024-02-19T21:50:40.723073+0000","last_fullsized":"2024-02-19T21:50:40.723073+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.636083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.636083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"200'19","reported_seq":476,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.703189+0000","last_change":"2024-02-19T21:48:26.530234+0000","last_active":"2024-02-19T21:50:40.703189+0000","last_peered":"2024-02-19T21:50:40.703189+0000","last_clean":"2024-02-19T21:50:40.703189+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:50:40.703189+0000","last_undegraded":"2024-02-19T21:50:40.703189+0000","last_fullsized":"2024-02-19T21:50:40.703189+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:48:26.530160+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.530160+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":164,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.723634+0000","last_change":"2024-02-19T21:49:08.332091+0000","last_active":"2024-02-19T21:50:40.723634+0000","last_peered":"2024-02-19T21:50:40.723634+0000","last_clean":"2024-02-19T21:50:40.723634+0000","last_became_active":"2024-02-19T21:49:08.331753+0000","last_became_peered":"2024-02-19T21:49:08.331753+0000","last_unstale":"2024-02-19T21:50:40.723634+0000","last_undegraded":"2024-02-19T21:50:40.723634+0000","last_fullsized":"2024-02-19T21:50:40.723634+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.005236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.005236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":420,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.727735+0000","last_change":"2024-02-19T21:48:28.327028+0000","last_active":"2024-02-19T21:50:40.727735+0000","last_peered":"2024-02-19T21:50:40.727735+0000","last_clean":"2024-02-19T21:50:40.727735+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:50:40.727735+0000","last_undegraded":"2024-02-19T21:50:40.727735+0000","last_fullsized":"2024-02-19T21:50:40.727735+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.326938+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"310'9","reported_seq":374,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.703367+0000","last_change":"2024-02-19T21:49:08.329655+0000","last_active":"2024-02-19T21:50:40.703367+0000","last_peered":"2024-02-19T21:50:40.703367+0000","last_clean":"2024-02-19T21:50:40.703367+0000","last_became_active":"2024-02-19T21:49:08.329314+0000","last_became_peered":"2024-02-19T21:49:08.329314+0000","last_unstale":"2024-02-19T21:50:40.703367+0000","last_undegraded":"2024-02-19T21:50:40.703367+0000","last_fullsized":"2024-02-19T21:50:40.703367+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"310'9","last_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_deep_scrub":"310'9","last_deep_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.506188+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":341,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.726618+0000","last_change":"2024-02-19T21:46:31.205220+0000","last_active":"2024-02-19T21:50:40.726618+0000","last_peered":"2024-02-19T21:50:40.726618+0000","last_clean":"2024-02-19T21:50:40.726618+0000","last_became_active":"2024-02-19T21:46:31.204816+0000","last_became_peered":"2024-02-19T21:46:31.204816+0000","last_unstale":"2024-02-19T21:50:40.726618+0000","last_undegraded":"2024-02-19T21:50:40.726618+0000","last_fullsized":"2024-02-19T21:50:40.726618+0000","mapping_epoch":330,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":331,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:36.890201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.890201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":442,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.728033+0000","last_change":"2024-02-19T21:49:08.330669+0000","last_active":"2024-02-19T21:50:40.728033+0000","last_peered":"2024-02-19T21:50:40.728033+0000","last_clean":"2024-02-19T21:50:40.728033+0000","last_became_active":"2024-02-19T21:49:08.329998+0000","last_became_peered":"2024-02-19T21:49:08.329998+0000","last_unstale":"2024-02-19T21:50:40.728033+0000","last_undegraded":"2024-02-19T21:50:40.728033+0000","last_fullsized":"2024-02-19T21:50:40.728033+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:58.329316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:58.329316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"200'19","reported_seq":286,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.703098+0000","last_change":"2024-02-19T21:49:08.326162+0000","last_active":"2024-02-19T21:50:40.703098+0000","last_peered":"2024-02-19T21:50:40.703098+0000","last_clean":"2024-02-19T21:50:40.703098+0000","last_became_active":"2024-02-19T21:49:08.325802+0000","last_became_peered":"2024-02-19T21:49:08.325802+0000","last_unstale":"2024-02-19T21:50:40.703098+0000","last_undegraded":"2024-02-19T21:50:40.703098+0000","last_fullsized":"2024-02-19T21:50:40.703098+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:46:54.873416+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:46:54.873416+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2],"acting":[4,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":352,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.708533+0000","last_change":"2024-02-19T21:49:04.432817+0000","last_active":"2024-02-19T21:50:40.708533+0000","last_peered":"2024-02-19T21:50:40.708533+0000","last_clean":"2024-02-19T21:50:40.708533+0000","last_became_active":"2024-02-19T21:47:33.393708+0000","last_became_peered":"2024-02-19T21:47:33.393708+0000","last_unstale":"2024-02-19T21:50:40.708533+0000","last_undegraded":"2024-02-19T21:50:40.708533+0000","last_fullsized":"2024-02-19T21:50:40.708533+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:04.432733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:04.432733+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":28,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.727596+0000","last_change":"2024-02-19T21:49:54.492767+0000","last_active":"2024-02-19T21:50:40.727596+0000","last_peered":"2024-02-19T21:50:40.727596+0000","last_clean":"2024-02-19T21:50:40.727596+0000","last_became_active":"2024-02-19T21:49:54.491745+0000","last_became_peered":"2024-02-19T21:49:54.491745+0000","last_unstale":"2024-02-19T21:50:40.727596+0000","last_undegraded":"2024-02-19T21:50:40.727596+0000","last_fullsized":"2024-02-19T21:50:40.727596+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.232539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.232539+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1d","version":"201'18","reported_seq":370,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.709957+0000","last_change":"2024-02-19T21:48:25.734661+0000","last_active":"2024-02-19T21:50:40.709957+0000","last_peered":"2024-02-19T21:50:40.709957+0000","last_clean":"2024-02-19T21:50:40.709957+0000","last_became_active":"2024-02-19T21:38:31.247067+0000","last_became_peered":"2024-02-19T21:38:31.247067+0000","last_unstale":"2024-02-19T21:50:40.709957+0000","last_undegraded":"2024-02-19T21:50:40.709957+0000","last_fullsized":"2024-02-19T21:50:40.709957+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'18","last_scrub_stamp":"2024-02-19T21:48:25.734591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.734591+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":407,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.703928+0000","last_change":"2024-02-19T21:48:40.528082+0000","last_active":"2024-02-19T21:50:40.703928+0000","last_peered":"2024-02-19T21:50:40.703928+0000","last_clean":"2024-02-19T21:50:40.703928+0000","last_became_active":"2024-02-19T21:44:58.788307+0000","last_became_peered":"2024-02-19T21:44:58.788307+0000","last_unstale":"2024-02-19T21:50:40.703928+0000","last_undegraded":"2024-02-19T21:50:40.703928+0000","last_fullsized":"2024-02-19T21:50:40.703928+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:40.527970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:48:40.527970+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":415,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.708713+0000","last_change":"2024-02-19T21:48:11.557832+0000","last_active":"2024-02-19T21:50:40.708713+0000","last_peered":"2024-02-19T21:50:40.708713+0000","last_clean":"2024-02-19T21:50:40.708713+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:50:40.708713+0000","last_undegraded":"2024-02-19T21:50:40.708713+0000","last_fullsized":"2024-02-19T21:50:40.708713+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.557736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:17.913620+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.557736+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"200'34","reported_seq":77,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.706533+0000","last_change":"2024-02-19T21:49:08.332575+0000","last_active":"2024-02-19T21:50:40.706533+0000","last_peered":"2024-02-19T21:50:40.706533+0000","last_clean":"2024-02-19T21:50:40.706533+0000","last_became_active":"2024-02-19T21:49:08.331742+0000","last_became_peered":"2024-02-19T21:49:08.331742+0000","last_unstale":"2024-02-19T21:50:40.706533+0000","last_undegraded":"2024-02-19T21:50:40.706533+0000","last_fullsized":"2024-02-19T21:50:40.706533+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'34","last_scrub_stamp":"2024-02-19T21:45:49.728734+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:45:49.728734+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":427,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.706740+0000","last_change":"2024-02-19T21:46:44.994389+0000","last_active":"2024-02-19T21:50:40.706740+0000","last_peered":"2024-02-19T21:50:40.706740+0000","last_clean":"2024-02-19T21:50:40.706740+0000","last_became_active":"2024-02-19T21:44:58.790669+0000","last_became_peered":"2024-02-19T21:44:58.790669+0000","last_unstale":"2024-02-19T21:50:40.706740+0000","last_undegraded":"2024-02-19T21:50:40.706740+0000","last_fullsized":"2024-02-19T21:50:40.706740+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.994296+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":363,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.707786+0000","last_change":"2024-02-19T21:49:08.330330+0000","last_active":"2024-02-19T21:50:40.707786+0000","last_peered":"2024-02-19T21:50:40.707786+0000","last_clean":"2024-02-19T21:50:40.707786+0000","last_became_active":"2024-02-19T21:49:08.329986+0000","last_became_peered":"2024-02-19T21:49:08.329986+0000","last_unstale":"2024-02-19T21:50:40.707786+0000","last_undegraded":"2024-02-19T21:50:40.707786+0000","last_fullsized":"2024-02-19T21:50:40.707786+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.091409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.091409+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"201'19","reported_seq":311,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.721781+0000","last_change":"2024-02-19T21:48:26.366639+0000","last_active":"2024-02-19T21:50:40.721781+0000","last_peered":"2024-02-19T21:50:40.721781+0000","last_clean":"2024-02-19T21:50:40.721781+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:50:40.721781+0000","last_undegraded":"2024-02-19T21:50:40.721781+0000","last_fullsized":"2024-02-19T21:50:40.721781+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:26.366563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.366563+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":275,"reported_epoch":431,"state":"active+remapped+backfill_wait+backfill_toofull","last_fresh":"2024-02-19T21:50:40.727616+0000","last_change":"2024-02-19T21:49:38.335602+0000","last_active":"2024-02-19T21:50:40.727616+0000","last_peered":"2024-02-19T21:50:40.727616+0000","last_clean":"2024-02-19T21:49:06.309838+0000","last_became_active":"2024-02-19T21:49:08.329545+0000","last_became_peered":"2024-02-19T21:49:08.329545+0000","last_unstale":"2024-02-19T21:50:40.727616+0000","last_undegraded":"2024-02-19T21:50:40.727616+0000","last_fullsized":"2024-02-19T21:50:40.727616+0000","mapping_epoch":394,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":371,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:13.196112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:13.196112+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,3],"avail_no_missing":["7","3","5"],"object_location_counts":[{"shards":"3,5,7","objects":1}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":427,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.721570+0000","last_change":"2024-02-19T21:49:54.491840+0000","last_active":"2024-02-19T21:50:40.721570+0000","last_peered":"2024-02-19T21:50:40.721570+0000","last_clean":"2024-02-19T21:50:40.721570+0000","last_became_active":"2024-02-19T21:49:54.491488+0000","last_became_peered":"2024-02-19T21:49:54.491488+0000","last_unstale":"2024-02-19T21:50:40.721570+0000","last_undegraded":"2024-02-19T21:50:40.721570+0000","last_fullsized":"2024-02-19T21:50:40.721570+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.803606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.803606+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"201'20","reported_seq":512,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.723238+0000","last_change":"2024-02-19T21:49:54.502402+0000","last_active":"2024-02-19T21:50:40.723238+0000","last_peered":"2024-02-19T21:50:40.723238+0000","last_clean":"2024-02-19T21:50:40.723238+0000","last_became_active":"2024-02-19T21:49:54.483748+0000","last_became_peered":"2024-02-19T21:49:54.483748+0000","last_unstale":"2024-02-19T21:50:40.723238+0000","last_undegraded":"2024-02-19T21:50:40.723238+0000","last_fullsized":"2024-02-19T21:50:40.723238+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:48:25.348437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.348437+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":347,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.722207+0000","last_change":"2024-02-19T21:49:08.328206+0000","last_active":"2024-02-19T21:50:40.722207+0000","last_peered":"2024-02-19T21:50:40.722207+0000","last_clean":"2024-02-19T21:50:40.722207+0000","last_became_active":"2024-02-19T21:49:08.327865+0000","last_became_peered":"2024-02-19T21:49:08.327865+0000","last_unstale":"2024-02-19T21:50:40.722207+0000","last_undegraded":"2024-02-19T21:50:40.722207+0000","last_fullsized":"2024-02-19T21:50:40.722207+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.230652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.230652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":407,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.726740+0000","last_change":"2024-02-19T21:48:22.171667+0000","last_active":"2024-02-19T21:50:40.726740+0000","last_peered":"2024-02-19T21:50:40.726740+0000","last_clean":"2024-02-19T21:50:40.726740+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:50:40.726740+0000","last_undegraded":"2024-02-19T21:50:40.726740+0000","last_fullsized":"2024-02-19T21:50:40.726740+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.171600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.171600+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":443,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.708616+0000","last_change":"2024-02-19T21:49:08.330636+0000","last_active":"2024-02-19T21:50:40.708616+0000","last_peered":"2024-02-19T21:50:40.708616+0000","last_clean":"2024-02-19T21:50:40.708616+0000","last_became_active":"2024-02-19T21:49:08.330293+0000","last_became_peered":"2024-02-19T21:49:08.330293+0000","last_unstale":"2024-02-19T21:50:40.708616+0000","last_undegraded":"2024-02-19T21:50:40.708616+0000","last_fullsized":"2024-02-19T21:50:40.708616+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:03.034839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:03.034839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"381'24","reported_seq":40,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.726979+0000","last_change":"2024-02-19T21:49:55.368481+0000","last_active":"2024-02-19T21:50:40.726979+0000","last_peered":"2024-02-19T21:50:40.726979+0000","last_clean":"2024-02-19T21:50:40.726979+0000","last_became_active":"2024-02-19T21:49:54.485438+0000","last_became_peered":"2024-02-19T21:49:54.485438+0000","last_unstale":"2024-02-19T21:50:40.726979+0000","last_undegraded":"2024-02-19T21:50:40.726979+0000","last_fullsized":"2024-02-19T21:50:40.726979+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"381'24","last_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_deep_scrub":"381'24","last_deep_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_clean_scrub_stamp":"2024-02-19T21:48:39.382725+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,5],"acting":[7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":435,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.727261+0000","last_change":"2024-02-19T21:49:17.193002+0000","last_active":"2024-02-19T21:50:40.727261+0000","last_peered":"2024-02-19T21:50:40.727261+0000","last_clean":"2024-02-19T21:50:40.727261+0000","last_became_active":"2024-02-19T21:49:08.333537+0000","last_became_peered":"2024-02-19T21:49:08.333537+0000","last_unstale":"2024-02-19T21:50:40.727261+0000","last_undegraded":"2024-02-19T21:50:40.727261+0000","last_fullsized":"2024-02-19T21:50:40.727261+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:59.339649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:45:59.339649+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":463,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.708277+0000","last_change":"2024-02-19T21:49:54.494561+0000","last_active":"2024-02-19T21:50:40.708277+0000","last_peered":"2024-02-19T21:50:40.708277+0000","last_clean":"2024-02-19T21:50:40.708277+0000","last_became_active":"2024-02-19T21:49:54.494146+0000","last_became_peered":"2024-02-19T21:49:54.494146+0000","last_unstale":"2024-02-19T21:50:40.708277+0000","last_undegraded":"2024-02-19T21:50:40.708277+0000","last_fullsized":"2024-02-19T21:50:40.708277+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.560066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":437,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.722836+0000","last_change":"2024-02-19T21:49:09.765641+0000","last_active":"2024-02-19T21:50:40.722836+0000","last_peered":"2024-02-19T21:50:40.722836+0000","last_clean":"2024-02-19T21:50:40.722836+0000","last_became_active":"2024-02-19T21:49:08.331308+0000","last_became_peered":"2024-02-19T21:49:08.331308+0000","last_unstale":"2024-02-19T21:50:40.722836+0000","last_undegraded":"2024-02-19T21:50:40.722836+0000","last_fullsized":"2024-02-19T21:50:40.722836+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.765568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.765568+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"200'8","reported_seq":124,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.706965+0000","last_change":"2024-02-19T21:47:33.577363+0000","last_active":"2024-02-19T21:50:40.706965+0000","last_peered":"2024-02-19T21:50:40.706965+0000","last_clean":"2024-02-19T21:50:40.706965+0000","last_became_active":"2024-02-19T21:47:33.395217+0000","last_became_peered":"2024-02-19T21:47:33.395217+0000","last_unstale":"2024-02-19T21:50:40.706965+0000","last_undegraded":"2024-02-19T21:50:40.706965+0000","last_fullsized":"2024-02-19T21:50:40.706965+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'8","last_scrub_stamp":"2024-02-19T21:46:47.761677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.761677+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":347,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.721802+0000","last_change":"2024-02-19T21:49:08.918163+0000","last_active":"2024-02-19T21:50:40.721802+0000","last_peered":"2024-02-19T21:50:40.721802+0000","last_clean":"2024-02-19T21:50:40.721802+0000","last_became_active":"2024-02-19T21:49:08.328416+0000","last_became_peered":"2024-02-19T21:49:08.328416+0000","last_unstale":"2024-02-19T21:50:40.721802+0000","last_undegraded":"2024-02-19T21:50:40.721802+0000","last_fullsized":"2024-02-19T21:50:40.721802+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.918083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.918083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":425,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.706627+0000","last_change":"2024-02-19T21:49:54.480716+0000","last_active":"2024-02-19T21:50:40.706627+0000","last_peered":"2024-02-19T21:50:40.706627+0000","last_clean":"2024-02-19T21:50:40.706627+0000","last_became_active":"2024-02-19T21:49:54.480368+0000","last_became_peered":"2024-02-19T21:49:54.480368+0000","last_unstale":"2024-02-19T21:50:40.706627+0000","last_undegraded":"2024-02-19T21:50:40.706627+0000","last_fullsized":"2024-02-19T21:50:40.706627+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:19.596775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:19.596775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":409,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.706919+0000","last_change":"2024-02-19T21:49:05.012463+0000","last_active":"2024-02-19T21:50:40.706919+0000","last_peered":"2024-02-19T21:50:40.706919+0000","last_clean":"2024-02-19T21:50:40.706919+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:50:40.706919+0000","last_undegraded":"2024-02-19T21:50:40.706919+0000","last_fullsized":"2024-02-19T21:50:40.706919+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.012395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.012395+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"201'19","reported_seq":456,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.703569+0000","last_change":"2024-02-19T21:48:38.529106+0000","last_active":"2024-02-19T21:50:40.703569+0000","last_peered":"2024-02-19T21:50:40.703569+0000","last_clean":"2024-02-19T21:50:40.703569+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:50:40.703569+0000","last_undegraded":"2024-02-19T21:50:40.703569+0000","last_fullsized":"2024-02-19T21:50:40.703569+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:38.528977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.528977+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":412,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.721435+0000","last_change":"2024-02-19T21:46:06.096531+0000","last_active":"2024-02-19T21:50:40.721435+0000","last_peered":"2024-02-19T21:50:40.721435+0000","last_clean":"2024-02-19T21:50:40.721435+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:50:40.721435+0000","last_undegraded":"2024-02-19T21:50:40.721435+0000","last_fullsized":"2024-02-19T21:50:40.721435+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.096422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":223,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.708294+0000","last_change":"2024-02-19T21:48:38.391532+0000","last_active":"2024-02-19T21:50:40.708294+0000","last_peered":"2024-02-19T21:50:40.708294+0000","last_clean":"2024-02-19T21:50:40.708294+0000","last_became_active":"2024-02-19T21:47:33.395085+0000","last_became_peered":"2024-02-19T21:47:33.395085+0000","last_unstale":"2024-02-19T21:50:40.708294+0000","last_undegraded":"2024-02-19T21:50:40.708294+0000","last_fullsized":"2024-02-19T21:50:40.708294+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:38.391435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.391435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":424,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.708245+0000","last_change":"2024-02-19T21:48:14.600378+0000","last_active":"2024-02-19T21:50:40.708245+0000","last_peered":"2024-02-19T21:50:40.708245+0000","last_clean":"2024-02-19T21:50:40.708245+0000","last_became_active":"2024-02-19T21:47:33.393932+0000","last_became_peered":"2024-02-19T21:47:33.393932+0000","last_unstale":"2024-02-19T21:50:40.708245+0000","last_undegraded":"2024-02-19T21:50:40.708245+0000","last_fullsized":"2024-02-19T21:50:40.708245+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:14.600285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.600285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"200'15","reported_seq":478,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.706507+0000","last_change":"2024-02-19T21:49:08.334199+0000","last_active":"2024-02-19T21:50:40.706507+0000","last_peered":"2024-02-19T21:50:40.706507+0000","last_clean":"2024-02-19T21:50:40.706507+0000","last_became_active":"2024-02-19T21:49:08.333872+0000","last_became_peered":"2024-02-19T21:49:08.333872+0000","last_unstale":"2024-02-19T21:50:40.706507+0000","last_undegraded":"2024-02-19T21:50:40.706507+0000","last_fullsized":"2024-02-19T21:50:40.706507+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:45:08.678669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:08.678669+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":390,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.703641+0000","last_change":"2024-02-19T21:49:08.330114+0000","last_active":"2024-02-19T21:50:40.703641+0000","last_peered":"2024-02-19T21:50:40.703641+0000","last_clean":"2024-02-19T21:50:40.703641+0000","last_became_active":"2024-02-19T21:49:08.329770+0000","last_became_peered":"2024-02-19T21:49:08.329770+0000","last_unstale":"2024-02-19T21:50:40.703641+0000","last_undegraded":"2024-02-19T21:50:40.703641+0000","last_fullsized":"2024-02-19T21:50:40.703641+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:08.983923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.983923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"415'17","reported_seq":38,"reported_epoch":431,"state":"active+recovery_wait","last_fresh":"2024-02-19T21:50:42.081928+0000","last_change":"2024-02-19T21:49:57.074730+0000","last_active":"2024-02-19T21:50:42.081928+0000","last_peered":"2024-02-19T21:50:42.081928+0000","last_clean":"2024-02-19T21:47:10.198854+0000","last_became_active":"2024-02-19T21:49:54.486304+0000","last_became_peered":"2024-02-19T21:49:54.486304+0000","last_unstale":"2024-02-19T21:50:42.081928+0000","last_undegraded":"2024-02-19T21:50:42.081928+0000","last_fullsized":"2024-02-19T21:50:42.081928+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"199'13","last_scrub_stamp":"2024-02-19T21:45:05.721709+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:45:05.721709+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":["7","1","2","4"],"object_location_counts":[{"shards":"1,2,7","objects":1}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":434,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.722410+0000","last_change":"2024-02-19T21:49:54.484516+0000","last_active":"2024-02-19T21:50:40.722410+0000","last_peered":"2024-02-19T21:50:40.722410+0000","last_clean":"2024-02-19T21:50:40.722410+0000","last_became_active":"2024-02-19T21:49:54.483689+0000","last_became_peered":"2024-02-19T21:49:54.483689+0000","last_unstale":"2024-02-19T21:50:40.722410+0000","last_undegraded":"2024-02-19T21:50:40.722410+0000","last_fullsized":"2024-02-19T21:50:40.722410+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.157478+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"201'19","reported_seq":455,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.722619+0000","last_change":"2024-02-19T21:48:27.720048+0000","last_active":"2024-02-19T21:50:40.722619+0000","last_peered":"2024-02-19T21:50:40.722619+0000","last_clean":"2024-02-19T21:50:40.722619+0000","last_became_active":"2024-02-19T21:47:33.398295+0000","last_became_peered":"2024-02-19T21:47:33.398295+0000","last_unstale":"2024-02-19T21:50:40.722619+0000","last_undegraded":"2024-02-19T21:50:40.722619+0000","last_fullsized":"2024-02-19T21:50:40.722619+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:27.719954+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:48:27.719954+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":151,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.722724+0000","last_change":"2024-02-19T21:49:54.484392+0000","last_active":"2024-02-19T21:50:40.722724+0000","last_peered":"2024-02-19T21:50:40.722724+0000","last_clean":"2024-02-19T21:50:40.722724+0000","last_became_active":"2024-02-19T21:49:54.484049+0000","last_became_peered":"2024-02-19T21:49:54.484049+0000","last_unstale":"2024-02-19T21:50:40.722724+0000","last_undegraded":"2024-02-19T21:50:40.722724+0000","last_fullsized":"2024-02-19T21:50:40.722724+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.121769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.121769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":634,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:42.081795+0000","last_change":"2024-02-19T21:48:38.723220+0000","last_active":"2024-02-19T21:50:42.081795+0000","last_peered":"2024-02-19T21:50:42.081795+0000","last_clean":"2024-02-19T21:50:42.081795+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:50:42.081795+0000","last_undegraded":"2024-02-19T21:50:42.081795+0000","last_fullsized":"2024-02-19T21:50:42.081795+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:48:38.723151+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.723151+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":438,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.721784+0000","last_change":"2024-02-19T21:49:54.485462+0000","last_active":"2024-02-19T21:50:40.721784+0000","last_peered":"2024-02-19T21:50:40.721784+0000","last_clean":"2024-02-19T21:50:40.721784+0000","last_became_active":"2024-02-19T21:49:54.485121+0000","last_became_peered":"2024-02-19T21:49:54.485121+0000","last_unstale":"2024-02-19T21:50:40.721784+0000","last_undegraded":"2024-02-19T21:50:40.721784+0000","last_fullsized":"2024-02-19T21:50:40.721784+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:07.724097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:49:07.724097+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"201'25","reported_seq":316,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.710342+0000","last_change":"2024-02-19T21:49:08.335077+0000","last_active":"2024-02-19T21:50:40.710342+0000","last_peered":"2024-02-19T21:50:40.710342+0000","last_clean":"2024-02-19T21:50:40.710342+0000","last_became_active":"2024-02-19T21:49:08.334061+0000","last_became_peered":"2024-02-19T21:49:08.334061+0000","last_unstale":"2024-02-19T21:50:40.710342+0000","last_undegraded":"2024-02-19T21:50:40.710342+0000","last_fullsized":"2024-02-19T21:50:40.710342+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'25","last_scrub_stamp":"2024-02-19T21:46:07.553690+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.553690+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":407,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.727648+0000","last_change":"2024-02-19T21:48:21.256471+0000","last_active":"2024-02-19T21:50:40.727648+0000","last_peered":"2024-02-19T21:50:40.727648+0000","last_clean":"2024-02-19T21:50:40.727648+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:50:40.727648+0000","last_undegraded":"2024-02-19T21:50:40.727648+0000","last_fullsized":"2024-02-19T21:50:40.727648+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.256358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.256358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":414,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.708180+0000","last_change":"2024-02-19T21:46:35.035136+0000","last_active":"2024-02-19T21:50:40.708180+0000","last_peered":"2024-02-19T21:50:40.708180+0000","last_clean":"2024-02-19T21:50:40.708180+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:50:40.708180+0000","last_undegraded":"2024-02-19T21:50:40.708180+0000","last_fullsized":"2024-02-19T21:50:40.708180+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:35.035042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:35.035042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"201'12","reported_seq":26,"reported_epoch":431,"state":"active+recovery_wait+degraded","last_fresh":"2024-02-19T21:50:40.727932+0000","last_change":"2024-02-19T21:49:54.478418+0000","last_active":"2024-02-19T21:50:40.727932+0000","last_peered":"2024-02-19T21:50:40.727932+0000","last_clean":"2024-02-19T21:49:49.433484+0000","last_became_active":"2024-02-19T21:49:54.478094+0000","last_became_peered":"2024-02-19T21:49:54.478094+0000","last_unstale":"2024-02-19T21:50:40.727932+0000","last_undegraded":"2024-02-19T21:49:54.469051+0000","last_fullsized":"2024-02-19T21:50:40.727932+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'12","last_scrub_stamp":"2024-02-19T21:49:08.912638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.912638+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":3,"num_objects_missing":3,"num_objects_degraded":3,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":["1","2","6"],"object_location_counts":[{"shards":"1,2,6","objects":3}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":60,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.706614+0000","last_change":"2024-02-19T21:49:08.332757+0000","last_active":"2024-02-19T21:50:40.706614+0000","last_peered":"2024-02-19T21:50:40.706614+0000","last_clean":"2024-02-19T21:50:40.706614+0000","last_became_active":"2024-02-19T21:49:08.332176+0000","last_became_peered":"2024-02-19T21:49:08.332176+0000","last_unstale":"2024-02-19T21:50:40.706614+0000","last_undegraded":"2024-02-19T21:50:40.706614+0000","last_fullsized":"2024-02-19T21:50:40.706614+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:47:01.365477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:47:01.365477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":60,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.705803+0000","last_change":"2024-02-19T21:49:08.328632+0000","last_active":"2024-02-19T21:50:40.705803+0000","last_peered":"2024-02-19T21:50:40.705803+0000","last_clean":"2024-02-19T21:50:40.705803+0000","last_became_active":"2024-02-19T21:49:08.327826+0000","last_became_peered":"2024-02-19T21:49:08.327826+0000","last_unstale":"2024-02-19T21:50:40.705803+0000","last_undegraded":"2024-02-19T21:50:40.705803+0000","last_fullsized":"2024-02-19T21:50:40.705803+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:09.645607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:44:09.645607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"200'15","reported_seq":528,"reported_epoch":431,"state":"active+recovery_wait+degraded","last_fresh":"2024-02-19T21:50:40.722915+0000","last_change":"2024-02-19T21:49:54.484033+0000","last_active":"2024-02-19T21:50:40.722915+0000","last_peered":"2024-02-19T21:50:40.722915+0000","last_clean":"2024-02-19T21:49:49.432972+0000","last_became_active":"2024-02-19T21:49:54.483578+0000","last_became_peered":"2024-02-19T21:49:54.483578+0000","last_unstale":"2024-02-19T21:50:40.722915+0000","last_undegraded":"2024-02-19T21:49:54.471563+0000","last_fullsized":"2024-02-19T21:50:40.722915+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:44:53.072746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:53.072746+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":["0","2","6"],"object_location_counts":[{"shards":"0,2,6","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"432'4884","reported_seq":5019,"reported_epoch":432,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:50:45.006179+0000","last_change":"2024-02-19T21:50:38.722849+0000","last_active":"2024-02-19T21:50:45.006179+0000","last_peered":"2024-02-19T21:50:45.006179+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:09.770699+0000","last_became_peered":"2024-02-19T21:49:09.770699+0000","last_unstale":"2024-02-19T21:50:45.006179+0000","last_undegraded":"2024-02-19T21:49:09.328794+0000","last_fullsized":"2024-02-19T21:49:09.325036+0000","mapping_epoch":395,"log_start":"392'100","ondisk_log_start":"392'100","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4784,"ondisk_log_size":4784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":300679168,"num_objects":4588,"num_object_clones":0,"num_object_copies":13764,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1071,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4588,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4884,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":2424832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5],"avail_no_missing":["6","5"],"object_location_counts":[{"shards":"5,6","objects":3517}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":28,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.727445+0000","last_change":"2024-02-19T21:49:54.492844+0000","last_active":"2024-02-19T21:50:40.727445+0000","last_peered":"2024-02-19T21:50:40.727445+0000","last_clean":"2024-02-19T21:50:40.727445+0000","last_became_active":"2024-02-19T21:49:54.492156+0000","last_became_peered":"2024-02-19T21:49:54.492156+0000","last_unstale":"2024-02-19T21:50:40.727445+0000","last_undegraded":"2024-02-19T21:50:40.727445+0000","last_fullsized":"2024-02-19T21:50:40.727445+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:04.692807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.692807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"378'4","reported_seq":446,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.703817+0000","last_change":"2024-02-19T21:48:28.510929+0000","last_active":"2024-02-19T21:50:40.703817+0000","last_peered":"2024-02-19T21:50:40.703817+0000","last_clean":"2024-02-19T21:50:40.703817+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:50:40.703817+0000","last_undegraded":"2024-02-19T21:50:40.703817+0000","last_fullsized":"2024-02-19T21:50:40.703817+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"378'4","last_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_deep_scrub":"378'4","last_deep_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.510849+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"200'23","reported_seq":293,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.703378+0000","last_change":"2024-02-19T21:48:22.519465+0000","last_active":"2024-02-19T21:50:40.703378+0000","last_peered":"2024-02-19T21:50:40.703378+0000","last_clean":"2024-02-19T21:50:40.703378+0000","last_became_active":"2024-02-19T21:47:46.252085+0000","last_became_peered":"2024-02-19T21:47:46.252085+0000","last_unstale":"2024-02-19T21:50:40.703378+0000","last_undegraded":"2024-02-19T21:50:40.703378+0000","last_fullsized":"2024-02-19T21:50:40.703378+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'23","last_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_deep_scrub":"200'23","last_deep_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.519381+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6],"acting":[4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":60,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.705861+0000","last_change":"2024-02-19T21:49:08.328855+0000","last_active":"2024-02-19T21:50:40.705861+0000","last_peered":"2024-02-19T21:50:40.705861+0000","last_clean":"2024-02-19T21:50:40.705861+0000","last_became_active":"2024-02-19T21:49:08.328237+0000","last_became_peered":"2024-02-19T21:49:08.328237+0000","last_unstale":"2024-02-19T21:50:40.705861+0000","last_undegraded":"2024-02-19T21:50:40.705861+0000","last_fullsized":"2024-02-19T21:50:40.705861+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:58.047556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:58.047556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"431'4725","reported_seq":4779,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:44.420660+0000","last_change":"2024-02-19T21:48:47.778295+0000","last_active":"2024-02-19T21:50:44.420660+0000","last_peered":"2024-02-19T21:50:44.420660+0000","last_clean":"2024-02-19T21:50:44.420660+0000","last_became_active":"2024-02-19T21:48:47.777964+0000","last_became_peered":"2024-02-19T21:48:47.777964+0000","last_unstale":"2024-02-19T21:50:44.420660+0000","last_undegraded":"2024-02-19T21:50:44.420660+0000","last_fullsized":"2024-02-19T21:50:44.420660+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4725,"ondisk_log_size":4725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":289996800,"num_objects":4425,"num_object_clones":0,"num_object_copies":13275,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4425,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4725,"num_write_kb":292800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":461,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.721529+0000","last_change":"2024-02-19T21:49:08.328019+0000","last_active":"2024-02-19T21:50:40.721529+0000","last_peered":"2024-02-19T21:50:40.721529+0000","last_clean":"2024-02-19T21:50:40.721529+0000","last_became_active":"2024-02-19T21:49:08.327581+0000","last_became_peered":"2024-02-19T21:49:08.327581+0000","last_unstale":"2024-02-19T21:50:40.721529+0000","last_undegraded":"2024-02-19T21:50:40.721529+0000","last_fullsized":"2024-02-19T21:50:40.721529+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:22.180593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:45:22.180593+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5],"acting":[0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":407,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.710275+0000","last_change":"2024-02-19T21:48:37.789514+0000","last_active":"2024-02-19T21:50:40.710275+0000","last_peered":"2024-02-19T21:50:40.710275+0000","last_clean":"2024-02-19T21:50:40.710275+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:50:40.710275+0000","last_undegraded":"2024-02-19T21:50:40.710275+0000","last_fullsized":"2024-02-19T21:50:40.710275+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:37.789400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:37.789400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"201'20","reported_seq":313,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.706577+0000","last_change":"2024-02-19T21:45:57.877936+0000","last_active":"2024-02-19T21:50:40.706577+0000","last_peered":"2024-02-19T21:50:40.706577+0000","last_clean":"2024-02-19T21:50:40.706577+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:50:40.706577+0000","last_undegraded":"2024-02-19T21:50:40.706577+0000","last_fullsized":"2024-02-19T21:50:40.706577+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:45:57.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:57.877856+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":638,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:42.083318+0000","last_change":"2024-02-19T21:49:01.011149+0000","last_active":"2024-02-19T21:50:42.083318+0000","last_peered":"2024-02-19T21:50:42.083318+0000","last_clean":"2024-02-19T21:50:42.083318+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:50:42.083318+0000","last_undegraded":"2024-02-19T21:50:42.083318+0000","last_fullsized":"2024-02-19T21:50:42.083318+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:49:01.011078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:49:01.011078+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.a","version":"432'4824","reported_seq":4879,"reported_epoch":432,"state":"active+clean","last_fresh":"2024-02-19T21:50:44.745468+0000","last_change":"2024-02-19T21:48:47.778138+0000","last_active":"2024-02-19T21:50:44.745468+0000","last_peered":"2024-02-19T21:50:44.745468+0000","last_clean":"2024-02-19T21:50:44.745468+0000","last_became_active":"2024-02-19T21:48:47.777820+0000","last_became_peered":"2024-02-19T21:48:47.777820+0000","last_unstale":"2024-02-19T21:50:44.745468+0000","last_undegraded":"2024-02-19T21:50:44.745468+0000","last_fullsized":"2024-02-19T21:50:44.745468+0000","mapping_epoch":385,"log_start":"392'100","ondisk_log_start":"392'100","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4724,"ondisk_log_size":4724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":299499520,"num_objects":4570,"num_object_clones":0,"num_object_copies":13710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4570,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4824,"num_write_kb":300608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":356,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.704428+0000","last_change":"2024-02-19T21:48:33.478821+0000","last_active":"2024-02-19T21:50:40.704428+0000","last_peered":"2024-02-19T21:50:40.704428+0000","last_clean":"2024-02-19T21:50:40.704428+0000","last_became_active":"2024-02-19T21:44:56.149476+0000","last_became_peered":"2024-02-19T21:44:56.149476+0000","last_unstale":"2024-02-19T21:50:40.704428+0000","last_undegraded":"2024-02-19T21:50:40.704428+0000","last_fullsized":"2024-02-19T21:50:40.704428+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:33.478715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:48:33.478715+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":417,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.721911+0000","last_change":"2024-02-19T21:46:41.834315+0000","last_active":"2024-02-19T21:50:40.721911+0000","last_peered":"2024-02-19T21:50:40.721911+0000","last_clean":"2024-02-19T21:50:40.721911+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:50:40.721911+0000","last_undegraded":"2024-02-19T21:50:40.721911+0000","last_fullsized":"2024-02-19T21:50:40.721911+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:41.834246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:46:41.834246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"397'46","reported_seq":828,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:42.082068+0000","last_change":"2024-02-19T21:49:08.335296+0000","last_active":"2024-02-19T21:50:42.082068+0000","last_peered":"2024-02-19T21:50:42.082068+0000","last_clean":"2024-02-19T21:50:42.082068+0000","last_became_active":"2024-02-19T21:49:08.334527+0000","last_became_peered":"2024-02-19T21:49:08.334527+0000","last_unstale":"2024-02-19T21:50:42.082068+0000","last_undegraded":"2024-02-19T21:50:42.082068+0000","last_fullsized":"2024-02-19T21:50:42.082068+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'43","last_scrub_stamp":"2024-02-19T21:45:04.755444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.755444+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":403,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.723229+0000","last_change":"2024-02-19T21:46:45.252437+0000","last_active":"2024-02-19T21:50:40.723229+0000","last_peered":"2024-02-19T21:50:40.723229+0000","last_clean":"2024-02-19T21:50:40.723229+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:50:40.723229+0000","last_undegraded":"2024-02-19T21:50:40.723229+0000","last_fullsized":"2024-02-19T21:50:40.723229+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.252344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.252344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"432'4765","reported_seq":5235,"reported_epoch":432,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-02-19T21:50:45.194800+0000","last_change":"2024-02-19T21:49:55.766941+0000","last_active":"2024-02-19T21:50:45.194800+0000","last_peered":"2024-02-19T21:50:45.194800+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:55.752599+0000","last_became_peered":"2024-02-19T21:49:55.752599+0000","last_unstale":"2024-02-19T21:50:45.194800+0000","last_undegraded":"2024-02-19T21:49:55.655049+0000","last_fullsized":"2024-02-19T21:49:55.470938+0000","mapping_epoch":414,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4765,"ondisk_log_size":4765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":294584320,"num_objects":4495,"num_object_clones":0,"num_object_copies":13485,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4920,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4495,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4765,"num_write_kb":296320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":8847360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2],"avail_no_missing":["5","4"],"object_location_counts":[{"shards":"2,4,5","objects":2876},{"shards":"2,5","objects":597},{"shards":"4,5","objects":1022}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":431,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.727868+0000","last_change":"2024-02-19T21:49:09.227437+0000","last_active":"2024-02-19T21:50:40.727868+0000","last_peered":"2024-02-19T21:50:40.727868+0000","last_clean":"2024-02-19T21:50:40.727868+0000","last_became_active":"2024-02-19T21:49:08.328437+0000","last_became_peered":"2024-02-19T21:49:08.328437+0000","last_unstale":"2024-02-19T21:50:40.727868+0000","last_undegraded":"2024-02-19T21:50:40.727868+0000","last_fullsized":"2024-02-19T21:50:40.727868+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.227355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.227355+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'6","reported_seq":1545,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:44.559815+0000","last_change":"2024-02-19T21:49:51.604278+0000","last_active":"2024-02-19T21:50:44.559815+0000","last_peered":"2024-02-19T21:50:44.559815+0000","last_clean":"2024-02-19T21:50:44.559815+0000","last_became_active":"2024-02-19T21:49:08.331108+0000","last_became_peered":"2024-02-19T21:49:08.331108+0000","last_unstale":"2024-02-19T21:50:44.559815+0000","last_undegraded":"2024-02-19T21:50:44.559815+0000","last_fullsized":"2024-02-19T21:50:44.559815+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_clean_scrub_stamp":"2024-02-19T21:44:13.678341+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1081,"num_read_kb":1076,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.709287+0000","last_change":"2024-02-19T21:49:08.329710+0000","last_active":"2024-02-19T21:50:40.709287+0000","last_peered":"2024-02-19T21:50:40.709287+0000","last_clean":"2024-02-19T21:50:40.709287+0000","last_became_active":"2024-02-19T21:49:08.329378+0000","last_became_peered":"2024-02-19T21:49:08.329378+0000","last_unstale":"2024-02-19T21:50:40.709287+0000","last_undegraded":"2024-02-19T21:50:40.709287+0000","last_fullsized":"2024-02-19T21:50:40.709287+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:55.195394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.195394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"200'17","reported_seq":464,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.709664+0000","last_change":"2024-02-19T21:48:14.878933+0000","last_active":"2024-02-19T21:50:40.709664+0000","last_peered":"2024-02-19T21:50:40.709664+0000","last_clean":"2024-02-19T21:50:40.709664+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:50:40.709664+0000","last_undegraded":"2024-02-19T21:50:40.709664+0000","last_fullsized":"2024-02-19T21:50:40.709664+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'17","last_scrub_stamp":"2024-02-19T21:48:14.878857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.878857+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":25,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":60,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.707426+0000","last_change":"2024-02-19T21:49:08.325478+0000","last_active":"2024-02-19T21:50:40.707426+0000","last_peered":"2024-02-19T21:50:40.707426+0000","last_clean":"2024-02-19T21:50:40.707426+0000","last_became_active":"2024-02-19T21:49:08.325127+0000","last_became_peered":"2024-02-19T21:49:08.325127+0000","last_unstale":"2024-02-19T21:50:40.707426+0000","last_undegraded":"2024-02-19T21:50:40.707426+0000","last_fullsized":"2024-02-19T21:50:40.707426+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:10.871111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:10.871111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"432'4863","reported_seq":4918,"reported_epoch":432,"state":"active+clean","last_fresh":"2024-02-19T21:50:45.051660+0000","last_change":"2024-02-19T21:48:47.778829+0000","last_active":"2024-02-19T21:50:45.051660+0000","last_peered":"2024-02-19T21:50:45.051660+0000","last_clean":"2024-02-19T21:50:45.051660+0000","last_became_active":"2024-02-19T21:48:47.778486+0000","last_became_peered":"2024-02-19T21:48:47.778486+0000","last_unstale":"2024-02-19T21:50:45.051660+0000","last_undegraded":"2024-02-19T21:50:45.051660+0000","last_fullsized":"2024-02-19T21:50:45.051660+0000","mapping_epoch":385,"log_start":"392'100","ondisk_log_start":"392'100","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4763,"ondisk_log_size":4763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":301268992,"num_objects":4597,"num_object_clones":0,"num_object_copies":13791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4597,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4863,"num_write_kb":302720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":434,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.723372+0000","last_change":"2024-02-19T21:47:33.400407+0000","last_active":"2024-02-19T21:50:40.723372+0000","last_peered":"2024-02-19T21:50:40.723372+0000","last_clean":"2024-02-19T21:50:40.723372+0000","last_became_active":"2024-02-19T21:47:33.400075+0000","last_became_peered":"2024-02-19T21:47:33.400075+0000","last_unstale":"2024-02-19T21:50:40.723372+0000","last_undegraded":"2024-02-19T21:50:40.723372+0000","last_fullsized":"2024-02-19T21:50:40.723372+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.035136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":312,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.722344+0000","last_change":"2024-02-19T21:49:05.746443+0000","last_active":"2024-02-19T21:50:40.722344+0000","last_peered":"2024-02-19T21:50:40.722344+0000","last_clean":"2024-02-19T21:50:40.722344+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:50:40.722344+0000","last_undegraded":"2024-02-19T21:50:40.722344+0000","last_fullsized":"2024-02-19T21:50:40.722344+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.746358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.746358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":464,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.722194+0000","last_change":"2024-02-19T21:49:54.485252+0000","last_active":"2024-02-19T21:50:40.722194+0000","last_peered":"2024-02-19T21:50:40.722194+0000","last_clean":"2024-02-19T21:50:40.722194+0000","last_became_active":"2024-02-19T21:49:54.484956+0000","last_became_peered":"2024-02-19T21:49:54.484956+0000","last_unstale":"2024-02-19T21:50:40.722194+0000","last_undegraded":"2024-02-19T21:50:40.722194+0000","last_fullsized":"2024-02-19T21:50:40.722194+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:07.901205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:07.901205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":28,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.726405+0000","last_change":"2024-02-19T21:49:54.483990+0000","last_active":"2024-02-19T21:50:40.726405+0000","last_peered":"2024-02-19T21:50:40.726405+0000","last_clean":"2024-02-19T21:50:40.726405+0000","last_became_active":"2024-02-19T21:49:54.483637+0000","last_became_peered":"2024-02-19T21:49:54.483637+0000","last_unstale":"2024-02-19T21:50:40.726405+0000","last_undegraded":"2024-02-19T21:50:40.726405+0000","last_fullsized":"2024-02-19T21:50:40.726405+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.190177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.190177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"201'33","reported_seq":457,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.708233+0000","last_change":"2024-02-19T21:46:47.970066+0000","last_active":"2024-02-19T21:50:40.708233+0000","last_peered":"2024-02-19T21:50:40.708233+0000","last_clean":"2024-02-19T21:50:40.708233+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:50:40.708233+0000","last_undegraded":"2024-02-19T21:50:40.708233+0000","last_fullsized":"2024-02-19T21:50:40.708233+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'33","last_scrub_stamp":"2024-02-19T21:46:47.969961+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.969961+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.728155+0000","last_change":"2024-02-19T21:49:54.478276+0000","last_active":"2024-02-19T21:50:40.728155+0000","last_peered":"2024-02-19T21:50:40.728155+0000","last_clean":"2024-02-19T21:50:40.728155+0000","last_became_active":"2024-02-19T21:49:54.477947+0000","last_became_peered":"2024-02-19T21:49:54.477947+0000","last_unstale":"2024-02-19T21:50:40.728155+0000","last_undegraded":"2024-02-19T21:50:40.728155+0000","last_fullsized":"2024-02-19T21:50:40.728155+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:57.754453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:57.754453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"431'4721","reported_seq":6964,"reported_epoch":431,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-02-19T21:50:44.547503+0000","last_change":"2024-02-19T21:49:55.726256+0000","last_active":"2024-02-19T21:50:44.547503+0000","last_peered":"2024-02-19T21:50:44.547503+0000","last_clean":"2024-02-19T21:49:53.438055+0000","last_became_active":"2024-02-19T21:49:55.720894+0000","last_became_peered":"2024-02-19T21:49:55.720894+0000","last_unstale":"2024-02-19T21:50:44.547503+0000","last_undegraded":"2024-02-19T21:49:55.557499+0000","last_fullsized":"2024-02-19T21:49:55.472563+0000","mapping_epoch":414,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4721,"ondisk_log_size":4721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":293273600,"num_objects":4475,"num_object_clones":0,"num_object_copies":13425,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3971,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4475,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4721,"num_write_kb":294272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1083,"num_bytes_recovered":70975488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7],"acting":[0,2],"avail_no_missing":["0","2","5"],"object_location_counts":[{"shards":"0,2","objects":504},{"shards":"0,2,5","objects":3848}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":405,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.710411+0000","last_change":"2024-02-19T21:45:47.723650+0000","last_active":"2024-02-19T21:50:40.710411+0000","last_peered":"2024-02-19T21:50:40.710411+0000","last_clean":"2024-02-19T21:50:40.710411+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:50:40.710411+0000","last_undegraded":"2024-02-19T21:50:40.710411+0000","last_fullsized":"2024-02-19T21:50:40.710411+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.723550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.723550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":416,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.721720+0000","last_change":"2024-02-19T21:45:51.243726+0000","last_active":"2024-02-19T21:50:40.721720+0000","last_peered":"2024-02-19T21:50:40.721720+0000","last_clean":"2024-02-19T21:50:40.721720+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:50:40.721720+0000","last_undegraded":"2024-02-19T21:50:40.721720+0000","last_fullsized":"2024-02-19T21:50:40.721720+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:51.243656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:51.243656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":433,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.726628+0000","last_change":"2024-02-19T21:48:23.218358+0000","last_active":"2024-02-19T21:50:40.726628+0000","last_peered":"2024-02-19T21:50:40.726628+0000","last_clean":"2024-02-19T21:50:40.726628+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:50:40.726628+0000","last_undegraded":"2024-02-19T21:50:40.726628+0000","last_fullsized":"2024-02-19T21:50:40.726628+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:23.218282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.218282+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"324'30","reported_seq":560,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.722804+0000","last_change":"2024-02-19T21:49:08.330490+0000","last_active":"2024-02-19T21:50:40.722804+0000","last_peered":"2024-02-19T21:50:40.722804+0000","last_clean":"2024-02-19T21:50:40.722804+0000","last_became_active":"2024-02-19T21:49:08.329761+0000","last_became_peered":"2024-02-19T21:49:08.329761+0000","last_unstale":"2024-02-19T21:50:40.722804+0000","last_undegraded":"2024-02-19T21:50:40.722804+0000","last_fullsized":"2024-02-19T21:50:40.722804+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'30","last_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_deep_scrub":"324'30","last_deep_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.110965+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":418,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.723293+0000","last_change":"2024-02-19T21:45:09.918263+0000","last_active":"2024-02-19T21:50:40.723293+0000","last_peered":"2024-02-19T21:50:40.723293+0000","last_clean":"2024-02-19T21:50:40.723293+0000","last_became_active":"2024-02-19T21:44:42.624782+0000","last_became_peered":"2024-02-19T21:44:42.624782+0000","last_unstale":"2024-02-19T21:50:40.723293+0000","last_undegraded":"2024-02-19T21:50:40.723293+0000","last_fullsized":"2024-02-19T21:50:40.723293+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":295,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_clean_scrub_stamp":"2024-02-19T21:45:09.918170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"432'4765","reported_seq":4821,"reported_epoch":432,"state":"active+clean","last_fresh":"2024-02-19T21:50:45.024724+0000","last_change":"2024-02-19T21:48:47.777963+0000","last_active":"2024-02-19T21:50:45.024724+0000","last_peered":"2024-02-19T21:50:45.024724+0000","last_clean":"2024-02-19T21:50:45.024724+0000","last_became_active":"2024-02-19T21:48:47.777644+0000","last_became_peered":"2024-02-19T21:48:47.777644+0000","last_unstale":"2024-02-19T21:50:45.024724+0000","last_undegraded":"2024-02-19T21:50:45.024724+0000","last_fullsized":"2024-02-19T21:50:45.024724+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4765,"ondisk_log_size":4765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":295174168,"num_objects":4505,"num_object_clones":0,"num_object_copies":13515,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4505,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4765,"num_write_kb":296577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":438,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.706552+0000","last_change":"2024-02-19T21:49:08.331080+0000","last_active":"2024-02-19T21:50:40.706552+0000","last_peered":"2024-02-19T21:50:40.706552+0000","last_clean":"2024-02-19T21:50:40.706552+0000","last_became_active":"2024-02-19T21:49:08.330648+0000","last_became_peered":"2024-02-19T21:49:08.330648+0000","last_unstale":"2024-02-19T21:50:40.706552+0000","last_undegraded":"2024-02-19T21:50:40.706552+0000","last_fullsized":"2024-02-19T21:50:40.706552+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:55.803876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:44:55.803876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":409,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.727942+0000","last_change":"2024-02-19T21:48:31.320229+0000","last_active":"2024-02-19T21:50:40.727942+0000","last_peered":"2024-02-19T21:50:40.727942+0000","last_clean":"2024-02-19T21:50:40.727942+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:50:40.727942+0000","last_undegraded":"2024-02-19T21:50:40.727942+0000","last_fullsized":"2024-02-19T21:50:40.727942+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:31.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:45.017696+0000","last_clean_scrub_stamp":"2024-02-19T21:48:31.320133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"201'37","reported_seq":464,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.722336+0000","last_change":"2024-02-19T21:45:14.173212+0000","last_active":"2024-02-19T21:50:40.722336+0000","last_peered":"2024-02-19T21:50:40.722336+0000","last_clean":"2024-02-19T21:50:40.722336+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:50:40.722336+0000","last_undegraded":"2024-02-19T21:50:40.722336+0000","last_fullsized":"2024-02-19T21:50:40.722336+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'37","last_scrub_stamp":"2024-02-19T21:45:14.173134+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:45:14.173134+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":408,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.708752+0000","last_change":"2024-02-19T21:46:48.988928+0000","last_active":"2024-02-19T21:50:40.708752+0000","last_peered":"2024-02-19T21:50:40.708752+0000","last_clean":"2024-02-19T21:50:40.708752+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:50:40.708752+0000","last_undegraded":"2024-02-19T21:50:40.708752+0000","last_fullsized":"2024-02-19T21:50:40.708752+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:48.988836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.988836+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.e","version":"432'4698","reported_seq":6839,"reported_epoch":432,"state":"active+clean","last_fresh":"2024-02-19T21:50:45.081739+0000","last_change":"2024-02-19T21:50:40.718822+0000","last_active":"2024-02-19T21:50:45.081739+0000","last_peered":"2024-02-19T21:50:45.081739+0000","last_clean":"2024-02-19T21:50:45.081739+0000","last_became_active":"2024-02-19T21:50:40.710425+0000","last_became_peered":"2024-02-19T21:50:40.710425+0000","last_unstale":"2024-02-19T21:50:45.081739+0000","last_undegraded":"2024-02-19T21:50:45.081739+0000","last_fullsized":"2024-02-19T21:50:45.081739+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4698,"ondisk_log_size":4698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":290848768,"num_objects":4438,"num_object_clones":0,"num_object_copies":13314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4438,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4698,"num_write_kb":292352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1035,"num_bytes_recovered":67829760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":151,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.703265+0000","last_change":"2024-02-19T21:49:08.326461+0000","last_active":"2024-02-19T21:50:40.703265+0000","last_peered":"2024-02-19T21:50:40.703265+0000","last_clean":"2024-02-19T21:50:40.703265+0000","last_became_active":"2024-02-19T21:49:08.326106+0000","last_became_peered":"2024-02-19T21:49:08.326106+0000","last_unstale":"2024-02-19T21:50:40.703265+0000","last_undegraded":"2024-02-19T21:50:40.703265+0000","last_fullsized":"2024-02-19T21:50:40.703265+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.080896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.080896+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":411,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.706842+0000","last_change":"2024-02-19T21:48:11.879787+0000","last_active":"2024-02-19T21:50:40.706842+0000","last_peered":"2024-02-19T21:50:40.706842+0000","last_clean":"2024-02-19T21:50:40.706842+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:50:40.706842+0000","last_undegraded":"2024-02-19T21:50:40.706842+0000","last_fullsized":"2024-02-19T21:50:40.706842+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.879687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.879687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"201'38","reported_seq":46,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.726712+0000","last_change":"2024-02-19T21:49:55.861358+0000","last_active":"2024-02-19T21:50:40.726712+0000","last_peered":"2024-02-19T21:50:40.726712+0000","last_clean":"2024-02-19T21:50:40.726712+0000","last_became_active":"2024-02-19T21:49:54.480413+0000","last_became_peered":"2024-02-19T21:49:54.480413+0000","last_unstale":"2024-02-19T21:50:40.726712+0000","last_undegraded":"2024-02-19T21:50:40.726712+0000","last_fullsized":"2024-02-19T21:50:40.726712+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":415,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'38","last_scrub_stamp":"2024-02-19T21:49:05.923627+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.923627+0000","log_size":38,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":304,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.708403+0000","last_change":"2024-02-19T21:49:54.495134+0000","last_active":"2024-02-19T21:50:40.708403+0000","last_peered":"2024-02-19T21:50:40.708403+0000","last_clean":"2024-02-19T21:50:40.708403+0000","last_became_active":"2024-02-19T21:49:54.494802+0000","last_became_peered":"2024-02-19T21:49:54.494802+0000","last_unstale":"2024-02-19T21:50:40.708403+0000","last_undegraded":"2024-02-19T21:50:40.708403+0000","last_fullsized":"2024-02-19T21:50:40.708403+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:10.578408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:10.578408+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.f","version":"432'4905","reported_seq":7046,"reported_epoch":432,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:50:45.089420+0000","last_change":"2024-02-19T21:49:09.782040+0000","last_active":"2024-02-19T21:50:45.089420+0000","last_peered":"2024-02-19T21:50:45.089420+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:09.769552+0000","last_became_peered":"2024-02-19T21:49:09.769552+0000","last_unstale":"2024-02-19T21:50:45.089420+0000","last_undegraded":"2024-02-19T21:49:09.324587+0000","last_fullsized":"2024-02-19T21:49:09.319762+0000","mapping_epoch":395,"log_start":"392'200","ondisk_log_start":"392'200","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4705,"ondisk_log_size":4705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":303628288,"num_objects":4633,"num_object_clones":0,"num_object_copies":13899,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":107,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4633,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4905,"num_write_kb":305216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1040,"num_bytes_recovered":68157440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[{"shards":"4,6","objects":4526}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":438,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.727866+0000","last_change":"2024-02-19T21:49:08.328862+0000","last_active":"2024-02-19T21:50:40.727866+0000","last_peered":"2024-02-19T21:50:40.727866+0000","last_clean":"2024-02-19T21:50:40.727866+0000","last_became_active":"2024-02-19T21:49:08.328529+0000","last_became_peered":"2024-02-19T21:49:08.328529+0000","last_unstale":"2024-02-19T21:50:40.727866+0000","last_undegraded":"2024-02-19T21:50:40.727866+0000","last_fullsized":"2024-02-19T21:50:40.727866+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:49.110117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:49.110117+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":471,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.708875+0000","last_change":"2024-02-19T21:49:54.493367+0000","last_active":"2024-02-19T21:50:40.708875+0000","last_peered":"2024-02-19T21:50:40.708875+0000","last_clean":"2024-02-19T21:50:40.708875+0000","last_became_active":"2024-02-19T21:49:54.493041+0000","last_became_peered":"2024-02-19T21:49:54.493041+0000","last_unstale":"2024-02-19T21:50:40.708875+0000","last_undegraded":"2024-02-19T21:50:40.708875+0000","last_fullsized":"2024-02-19T21:50:40.708875+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.972369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.972369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"201'28","reported_seq":278,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.703292+0000","last_change":"2024-02-19T21:49:08.330818+0000","last_active":"2024-02-19T21:50:40.703292+0000","last_peered":"2024-02-19T21:50:40.703292+0000","last_clean":"2024-02-19T21:50:40.703292+0000","last_became_active":"2024-02-19T21:49:08.330477+0000","last_became_peered":"2024-02-19T21:49:08.330477+0000","last_unstale":"2024-02-19T21:50:40.703292+0000","last_undegraded":"2024-02-19T21:50:40.703292+0000","last_fullsized":"2024-02-19T21:50:40.703292+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'28","last_scrub_stamp":"2024-02-19T21:45:55.998646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.998646+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":40,"num_read_kb":33,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":487,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:42.081878+0000","last_change":"2024-02-19T21:45:50.742626+0000","last_active":"2024-02-19T21:50:42.081878+0000","last_peered":"2024-02-19T21:50:42.081878+0000","last_clean":"2024-02-19T21:50:42.081878+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:50:42.081878+0000","last_undegraded":"2024-02-19T21:50:42.081878+0000","last_fullsized":"2024-02-19T21:50:42.081878+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'9","last_scrub_stamp":"2024-02-19T21:45:50.742526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:50.742526+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"432'4696","reported_seq":4751,"reported_epoch":432,"state":"active+clean","last_fresh":"2024-02-19T21:50:44.744896+0000","last_change":"2024-02-19T21:48:47.779506+0000","last_active":"2024-02-19T21:50:44.744896+0000","last_peered":"2024-02-19T21:50:44.744896+0000","last_clean":"2024-02-19T21:50:44.744896+0000","last_became_active":"2024-02-19T21:48:47.778325+0000","last_became_peered":"2024-02-19T21:48:47.778325+0000","last_unstale":"2024-02-19T21:50:44.744896+0000","last_undegraded":"2024-02-19T21:50:44.744896+0000","last_fullsized":"2024-02-19T21:50:44.744896+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4696,"ondisk_log_size":4696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":291241984,"num_objects":4444,"num_object_clones":0,"num_object_copies":13332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4444,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4696,"num_write_kb":292480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"66'1","reported_seq":322,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.708217+0000","last_change":"2024-02-19T21:48:12.568842+0000","last_active":"2024-02-19T21:50:40.708217+0000","last_peered":"2024-02-19T21:50:40.708217+0000","last_clean":"2024-02-19T21:50:40.708217+0000","last_became_active":"2024-02-19T21:44:56.166670+0000","last_became_peered":"2024-02-19T21:44:56.166670+0000","last_unstale":"2024-02-19T21:50:40.708217+0000","last_undegraded":"2024-02-19T21:50:40.708217+0000","last_fullsized":"2024-02-19T21:50:40.708217+0000","mapping_epoch":165,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:12.568734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.568734+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"261'11","reported_seq":498,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:42.081668+0000","last_change":"2024-02-19T21:45:01.716882+0000","last_active":"2024-02-19T21:50:42.081668+0000","last_peered":"2024-02-19T21:50:42.081668+0000","last_clean":"2024-02-19T21:50:42.081668+0000","last_became_active":"2024-02-19T21:44:08.123392+0000","last_became_peered":"2024-02-19T21:44:08.123392+0000","last_unstale":"2024-02-19T21:50:42.081668+0000","last_undegraded":"2024-02-19T21:50:42.081668+0000","last_fullsized":"2024-02-19T21:50:42.081668+0000","mapping_epoch":62,"log_start":"257'10","ondisk_log_start":"257'10","created":62,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-02-19T21:45:01.716817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.716817+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":420,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.726667+0000","last_change":"2024-02-19T21:48:19.186455+0000","last_active":"2024-02-19T21:50:40.726667+0000","last_peered":"2024-02-19T21:50:40.726667+0000","last_clean":"2024-02-19T21:50:40.726667+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:50:40.726667+0000","last_undegraded":"2024-02-19T21:50:40.726667+0000","last_fullsized":"2024-02-19T21:50:40.726667+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:48:19.186359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:19.186359+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"201'19","reported_seq":278,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.703999+0000","last_change":"2024-02-19T21:48:34.485865+0000","last_active":"2024-02-19T21:50:40.703999+0000","last_peered":"2024-02-19T21:50:40.703999+0000","last_clean":"2024-02-19T21:50:40.703999+0000","last_became_active":"2024-02-19T21:47:46.251550+0000","last_became_peered":"2024-02-19T21:47:46.251550+0000","last_unstale":"2024-02-19T21:50:40.703999+0000","last_undegraded":"2024-02-19T21:50:40.703999+0000","last_fullsized":"2024-02-19T21:50:40.703999+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:34.485787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:34.485787+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":23,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7],"acting":[4,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1","version":"432'4778","reported_seq":4833,"reported_epoch":432,"state":"active+clean","last_fresh":"2024-02-19T21:50:45.054830+0000","last_change":"2024-02-19T21:48:47.772467+0000","last_active":"2024-02-19T21:50:45.054830+0000","last_peered":"2024-02-19T21:50:45.054830+0000","last_clean":"2024-02-19T21:50:45.054830+0000","last_became_active":"2024-02-19T21:48:47.772154+0000","last_became_peered":"2024-02-19T21:48:47.772154+0000","last_unstale":"2024-02-19T21:50:45.054830+0000","last_undegraded":"2024-02-19T21:50:45.054830+0000","last_fullsized":"2024-02-19T21:50:45.054830+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4778,"ondisk_log_size":4778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":297271296,"num_objects":4536,"num_object_clones":0,"num_object_copies":13608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4536,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4778,"num_write_kb":298048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":427,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.722893+0000","last_change":"2024-02-19T21:46:01.031458+0000","last_active":"2024-02-19T21:50:40.722893+0000","last_peered":"2024-02-19T21:50:40.722893+0000","last_clean":"2024-02-19T21:50:40.722893+0000","last_became_active":"2024-02-19T21:44:56.155194+0000","last_became_peered":"2024-02-19T21:44:56.155194+0000","last_unstale":"2024-02-19T21:50:40.722893+0000","last_undegraded":"2024-02-19T21:50:40.722893+0000","last_fullsized":"2024-02-19T21:50:40.722893+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.031344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.031344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"363'12","reported_seq":210,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:42.081618+0000","last_change":"2024-02-19T21:48:25.487689+0000","last_active":"2024-02-19T21:50:42.081618+0000","last_peered":"2024-02-19T21:50:42.081618+0000","last_clean":"2024-02-19T21:50:42.081618+0000","last_became_active":"2024-02-19T21:47:46.260099+0000","last_became_peered":"2024-02-19T21:47:46.260099+0000","last_unstale":"2024-02-19T21:50:42.081618+0000","last_undegraded":"2024-02-19T21:50:42.081618+0000","last_fullsized":"2024-02-19T21:50:42.081618+0000","mapping_epoch":362,"log_start":"98'9","ondisk_log_start":"98'9","created":62,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"363'12","last_scrub_stamp":"2024-02-19T21:48:25.487608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.487608+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":431,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.706466+0000","last_change":"2024-02-19T21:49:08.335163+0000","last_active":"2024-02-19T21:50:40.706466+0000","last_peered":"2024-02-19T21:50:40.706466+0000","last_clean":"2024-02-19T21:50:40.706466+0000","last_became_active":"2024-02-19T21:49:08.334842+0000","last_became_peered":"2024-02-19T21:49:08.334842+0000","last_unstale":"2024-02-19T21:50:40.706466+0000","last_undegraded":"2024-02-19T21:50:40.706466+0000","last_fullsized":"2024-02-19T21:50:40.706466+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.700887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.700887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"270'34","reported_seq":351,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.723120+0000","last_change":"2024-02-19T21:47:34.894164+0000","last_active":"2024-02-19T21:50:40.723120+0000","last_peered":"2024-02-19T21:50:40.723120+0000","last_clean":"2024-02-19T21:50:40.723120+0000","last_became_active":"2024-02-19T21:47:33.400012+0000","last_became_peered":"2024-02-19T21:47:33.400012+0000","last_unstale":"2024-02-19T21:50:40.723120+0000","last_undegraded":"2024-02-19T21:50:40.723120+0000","last_fullsized":"2024-02-19T21:50:40.723120+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":357,"parent":"0.0","parent_split_bits":0,"last_scrub":"270'34","last_scrub_stamp":"2024-02-19T21:46:44.789309+0000","last_deep_scrub":"270'34","last_deep_scrub_stamp":"2024-02-19T21:44:17.451151+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.789309+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2","version":"432'4858","reported_seq":4913,"reported_epoch":432,"state":"active+clean","last_fresh":"2024-02-19T21:50:45.168866+0000","last_change":"2024-02-19T21:48:47.771305+0000","last_active":"2024-02-19T21:50:45.168866+0000","last_peered":"2024-02-19T21:50:45.168866+0000","last_clean":"2024-02-19T21:50:45.168866+0000","last_became_active":"2024-02-19T21:48:47.771000+0000","last_became_peered":"2024-02-19T21:48:47.771000+0000","last_unstale":"2024-02-19T21:50:45.168866+0000","last_undegraded":"2024-02-19T21:50:45.168866+0000","last_fullsized":"2024-02-19T21:50:45.168866+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4858,"ondisk_log_size":4858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":299499520,"num_objects":4570,"num_object_clones":0,"num_object_copies":13710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4570,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4858,"num_write_kb":301696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":409,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.704363+0000","last_change":"2024-02-19T21:49:08.329023+0000","last_active":"2024-02-19T21:50:40.704363+0000","last_peered":"2024-02-19T21:50:40.704363+0000","last_clean":"2024-02-19T21:50:40.704363+0000","last_became_active":"2024-02-19T21:49:08.328697+0000","last_became_peered":"2024-02-19T21:49:08.328697+0000","last_unstale":"2024-02-19T21:50:40.704363+0000","last_undegraded":"2024-02-19T21:50:40.704363+0000","last_fullsized":"2024-02-19T21:50:40.704363+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.939414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.939414+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"397'17","reported_seq":339,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:42.162041+0000","last_change":"2024-02-19T21:49:08.325927+0000","last_active":"2024-02-19T21:50:42.162041+0000","last_peered":"2024-02-19T21:50:42.162041+0000","last_clean":"2024-02-19T21:50:42.162041+0000","last_became_active":"2024-02-19T21:49:08.325034+0000","last_became_peered":"2024-02-19T21:49:08.325034+0000","last_unstale":"2024-02-19T21:50:42.162041+0000","last_undegraded":"2024-02-19T21:50:42.162041+0000","last_fullsized":"2024-02-19T21:50:42.162041+0000","mapping_epoch":394,"log_start":"170'11","ondisk_log_start":"170'11","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"271'13","last_scrub_stamp":"2024-02-19T21:46:47.072988+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.072988+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":421,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.706428+0000","last_change":"2024-02-19T21:49:03.987847+0000","last_active":"2024-02-19T21:50:40.706428+0000","last_peered":"2024-02-19T21:50:40.706428+0000","last_clean":"2024-02-19T21:50:40.706428+0000","last_became_active":"2024-02-19T21:47:33.395485+0000","last_became_peered":"2024-02-19T21:47:33.395485+0000","last_unstale":"2024-02-19T21:50:40.706428+0000","last_undegraded":"2024-02-19T21:50:40.706428+0000","last_fullsized":"2024-02-19T21:50:40.706428+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:03.987749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:49:03.987749+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,5],"acting":[1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"200'20","reported_seq":255,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.703586+0000","last_change":"2024-02-19T21:48:12.628796+0000","last_active":"2024-02-19T21:50:40.703586+0000","last_peered":"2024-02-19T21:50:40.703586+0000","last_clean":"2024-02-19T21:50:40.703586+0000","last_became_active":"2024-02-19T21:47:46.251725+0000","last_became_peered":"2024-02-19T21:47:46.251725+0000","last_unstale":"2024-02-19T21:50:40.703586+0000","last_undegraded":"2024-02-19T21:50:40.703586+0000","last_fullsized":"2024-02-19T21:50:40.703586+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'20","last_scrub_stamp":"2024-02-19T21:48:12.628700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.628700+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3","version":"432'4822","reported_seq":6969,"reported_epoch":432,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:50:45.146118+0000","last_change":"2024-02-19T21:49:15.423646+0000","last_active":"2024-02-19T21:50:45.146118+0000","last_peered":"2024-02-19T21:50:45.146118+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:09.769892+0000","last_became_peered":"2024-02-19T21:49:09.769892+0000","last_unstale":"2024-02-19T21:50:45.146118+0000","last_undegraded":"2024-02-19T21:49:09.318624+0000","last_fullsized":"2024-02-19T21:49:09.312732+0000","mapping_epoch":395,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4822,"ondisk_log_size":4822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":297402368,"num_objects":4538,"num_object_clones":0,"num_object_copies":13614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":52,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4538,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4822,"num_write_kb":299520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1045,"num_bytes_recovered":68485120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[{"shards":"4,5","objects":4486}],"blocked_by":[],"up_primary":2,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":60,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.706967+0000","last_change":"2024-02-19T21:49:08.327495+0000","last_active":"2024-02-19T21:50:40.706967+0000","last_peered":"2024-02-19T21:50:40.706967+0000","last_clean":"2024-02-19T21:50:40.706967+0000","last_became_active":"2024-02-19T21:49:08.327172+0000","last_became_peered":"2024-02-19T21:49:08.327172+0000","last_unstale":"2024-02-19T21:50:40.706967+0000","last_undegraded":"2024-02-19T21:50:40.706967+0000","last_fullsized":"2024-02-19T21:50:40.706967+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.241319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.241319+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,6],"acting":[2,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":416,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.710365+0000","last_change":"2024-02-19T21:45:01.798485+0000","last_active":"2024-02-19T21:50:40.710365+0000","last_peered":"2024-02-19T21:50:40.710365+0000","last_clean":"2024-02-19T21:50:40.710365+0000","last_became_active":"2024-02-19T21:44:22.245925+0000","last_became_peered":"2024-02-19T21:44:22.245925+0000","last_unstale":"2024-02-19T21:50:40.710365+0000","last_undegraded":"2024-02-19T21:50:40.710365+0000","last_fullsized":"2024-02-19T21:50:40.710365+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:01.798387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.798387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":416,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.727670+0000","last_change":"2024-02-19T21:48:30.277397+0000","last_active":"2024-02-19T21:50:40.727670+0000","last_peered":"2024-02-19T21:50:40.727670+0000","last_clean":"2024-02-19T21:50:40.727670+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:50:40.727670+0000","last_undegraded":"2024-02-19T21:50:40.727670+0000","last_fullsized":"2024-02-19T21:50:40.727670+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.277322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.277322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"337'39","reported_seq":364,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.703841+0000","last_change":"2024-02-19T21:49:08.326007+0000","last_active":"2024-02-19T21:50:40.703841+0000","last_peered":"2024-02-19T21:50:40.703841+0000","last_clean":"2024-02-19T21:50:40.703841+0000","last_became_active":"2024-02-19T21:49:08.325683+0000","last_became_peered":"2024-02-19T21:49:08.325683+0000","last_unstale":"2024-02-19T21:50:40.703841+0000","last_undegraded":"2024-02-19T21:50:40.703841+0000","last_fullsized":"2024-02-19T21:50:40.703841+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'39","last_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_deep_scrub":"337'39","last_deep_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.923809+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":49,"num_read_kb":39,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"431'4898","reported_seq":4953,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:44.373087+0000","last_change":"2024-02-19T21:48:47.776672+0000","last_active":"2024-02-19T21:50:44.373087+0000","last_peered":"2024-02-19T21:50:44.373087+0000","last_clean":"2024-02-19T21:50:44.373087+0000","last_became_active":"2024-02-19T21:48:47.776368+0000","last_became_peered":"2024-02-19T21:48:47.776368+0000","last_unstale":"2024-02-19T21:50:44.373087+0000","last_undegraded":"2024-02-19T21:50:44.373087+0000","last_fullsized":"2024-02-19T21:50:44.373087+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4898,"ondisk_log_size":4898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":304742400,"num_objects":4650,"num_object_clones":0,"num_object_copies":13950,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4650,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4898,"num_write_kb":305536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"66'1","reported_seq":242,"reported_epoch":431,"state":"active+remapped+backfill_toofull","last_fresh":"2024-02-19T21:50:40.721374+0000","last_change":"2024-02-19T21:50:25.718514+0000","last_active":"2024-02-19T21:50:40.721374+0000","last_peered":"2024-02-19T21:50:40.721374+0000","last_clean":"2024-02-19T21:47:34.392763+0000","last_became_active":"2024-02-19T21:49:55.708866+0000","last_became_peered":"2024-02-19T21:49:55.708866+0000","last_unstale":"2024-02-19T21:50:40.721374+0000","last_undegraded":"2024-02-19T21:50:40.721374+0000","last_fullsized":"2024-02-19T21:50:40.721374+0000","mapping_epoch":414,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:46:43.773486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:46:43.773486+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[0,2,6],"avail_no_missing":["0","2","6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":60,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.706269+0000","last_change":"2024-02-19T21:49:08.326583+0000","last_active":"2024-02-19T21:50:40.706269+0000","last_peered":"2024-02-19T21:50:40.706269+0000","last_clean":"2024-02-19T21:50:40.706269+0000","last_became_active":"2024-02-19T21:49:08.324835+0000","last_became_peered":"2024-02-19T21:49:08.324835+0000","last_unstale":"2024-02-19T21:50:40.706269+0000","last_undegraded":"2024-02-19T21:50:40.706269+0000","last_fullsized":"2024-02-19T21:50:40.706269+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.163825+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":116,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.707834+0000","last_change":"2024-02-19T21:49:08.327553+0000","last_active":"2024-02-19T21:50:40.707834+0000","last_peered":"2024-02-19T21:50:40.707834+0000","last_clean":"2024-02-19T21:50:40.707834+0000","last_became_active":"2024-02-19T21:49:08.327186+0000","last_became_peered":"2024-02-19T21:49:08.327186+0000","last_unstale":"2024-02-19T21:50:40.707834+0000","last_undegraded":"2024-02-19T21:50:40.707834+0000","last_fullsized":"2024-02-19T21:50:40.707834+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:45:00.748244+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:45:00.748244+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"201'44","reported_seq":537,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.708671+0000","last_change":"2024-02-19T21:49:55.281324+0000","last_active":"2024-02-19T21:50:40.708671+0000","last_peered":"2024-02-19T21:50:40.708671+0000","last_clean":"2024-02-19T21:50:40.708671+0000","last_became_active":"2024-02-19T21:49:54.493167+0000","last_became_peered":"2024-02-19T21:49:54.493167+0000","last_unstale":"2024-02-19T21:50:40.708671+0000","last_undegraded":"2024-02-19T21:50:40.708671+0000","last_fullsized":"2024-02-19T21:50:40.708671+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'44","last_scrub_stamp":"2024-02-19T21:48:32.489084+0000","last_deep_scrub":"201'44","last_deep_scrub_stamp":"2024-02-19T21:44:16.255049+0000","last_clean_scrub_stamp":"2024-02-19T21:48:32.489084+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.5","version":"432'4858","reported_seq":5379,"reported_epoch":432,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:50:46.797745+0000","last_change":"2024-02-19T21:50:03.887248+0000","last_active":"2024-02-19T21:50:46.797745+0000","last_peered":"2024-02-19T21:50:46.797745+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:50:03.654321+0000","last_became_peered":"2024-02-19T21:50:03.654321+0000","last_unstale":"2024-02-19T21:50:46.797745+0000","last_undegraded":"2024-02-19T21:50:01.398577+0000","last_fullsized":"2024-02-19T21:49:55.473278+0000","mapping_epoch":414,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4858,"ondisk_log_size":4858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":299106304,"num_objects":4564,"num_object_clones":0,"num_object_copies":13692,"num_objects_missing_on_primary":994,"num_objects_missing":994,"num_objects_degraded":994,"num_objects_misplaced":3973,"num_objects_unfound":0,"num_objects_dirty":4564,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4858,"num_write_kb":301504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":9699328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0],"avail_no_missing":["0","5"],"object_location_counts":[{"shards":"0,2","objects":591},{"shards":"0,2,5","objects":2979},{"shards":"0,5","objects":994}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":461,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.721946+0000","last_change":"2024-02-19T21:49:08.328667+0000","last_active":"2024-02-19T21:50:40.721946+0000","last_peered":"2024-02-19T21:50:40.721946+0000","last_clean":"2024-02-19T21:50:40.721946+0000","last_became_active":"2024-02-19T21:49:08.328287+0000","last_became_peered":"2024-02-19T21:49:08.328287+0000","last_unstale":"2024-02-19T21:50:40.721946+0000","last_undegraded":"2024-02-19T21:50:40.721946+0000","last_fullsized":"2024-02-19T21:50:40.721946+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.176542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.176542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":60,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.705975+0000","last_change":"2024-02-19T21:49:08.332637+0000","last_active":"2024-02-19T21:50:40.705975+0000","last_peered":"2024-02-19T21:50:40.705975+0000","last_clean":"2024-02-19T21:50:40.705975+0000","last_became_active":"2024-02-19T21:49:08.331451+0000","last_became_peered":"2024-02-19T21:49:08.331451+0000","last_unstale":"2024-02-19T21:50:40.705975+0000","last_undegraded":"2024-02-19T21:50:40.705975+0000","last_fullsized":"2024-02-19T21:50:40.705975+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.123413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.547129+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.123413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":431,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.709880+0000","last_change":"2024-02-19T21:49:08.331159+0000","last_active":"2024-02-19T21:50:40.709880+0000","last_peered":"2024-02-19T21:50:40.709880+0000","last_clean":"2024-02-19T21:50:40.709880+0000","last_became_active":"2024-02-19T21:49:08.330804+0000","last_became_peered":"2024-02-19T21:49:08.330804+0000","last_unstale":"2024-02-19T21:50:40.709880+0000","last_undegraded":"2024-02-19T21:50:40.709880+0000","last_fullsized":"2024-02-19T21:50:40.709880+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.978015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.978015+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"377'19","reported_seq":439,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.722488+0000","last_change":"2024-02-19T21:48:23.326608+0000","last_active":"2024-02-19T21:50:40.722488+0000","last_peered":"2024-02-19T21:50:40.722488+0000","last_clean":"2024-02-19T21:50:40.722488+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:50:40.722488+0000","last_undegraded":"2024-02-19T21:50:40.722488+0000","last_fullsized":"2024-02-19T21:50:40.722488+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"377'19","last_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_deep_scrub":"377'19","last_deep_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.326541+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"432'4842","reported_seq":4896,"reported_epoch":432,"state":"active+clean","last_fresh":"2024-02-19T21:50:45.101434+0000","last_change":"2024-02-19T21:48:47.780368+0000","last_active":"2024-02-19T21:50:45.101434+0000","last_peered":"2024-02-19T21:50:45.101434+0000","last_clean":"2024-02-19T21:50:45.101434+0000","last_became_active":"2024-02-19T21:48:47.780046+0000","last_became_peered":"2024-02-19T21:48:47.780046+0000","last_unstale":"2024-02-19T21:50:45.101434+0000","last_undegraded":"2024-02-19T21:50:45.101434+0000","last_fullsized":"2024-02-19T21:50:45.101434+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4842,"ondisk_log_size":4842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":299237376,"num_objects":4566,"num_object_clones":0,"num_object_copies":13698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4842,"num_write_kb":301056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":425,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.721710+0000","last_change":"2024-02-19T21:46:01.981923+0000","last_active":"2024-02-19T21:50:40.721710+0000","last_peered":"2024-02-19T21:50:40.721710+0000","last_clean":"2024-02-19T21:50:40.721710+0000","last_became_active":"2024-02-19T21:44:56.160521+0000","last_became_peered":"2024-02-19T21:44:56.160521+0000","last_unstale":"2024-02-19T21:50:40.721710+0000","last_undegraded":"2024-02-19T21:50:40.721710+0000","last_fullsized":"2024-02-19T21:50:40.721710+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.981866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.981866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":69,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.709489+0000","last_change":"2024-02-19T21:49:54.485377+0000","last_active":"2024-02-19T21:50:40.709489+0000","last_peered":"2024-02-19T21:50:40.709489+0000","last_clean":"2024-02-19T21:50:40.709489+0000","last_became_active":"2024-02-19T21:49:54.485078+0000","last_became_peered":"2024-02-19T21:49:54.485078+0000","last_unstale":"2024-02-19T21:50:40.709489+0000","last_undegraded":"2024-02-19T21:50:40.709489+0000","last_fullsized":"2024-02-19T21:50:40.709489+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:52.107416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:46:52.107416+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"200'27","reported_seq":502,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:40.721490+0000","last_change":"2024-02-19T21:49:55.109780+0000","last_active":"2024-02-19T21:50:40.721490+0000","last_peered":"2024-02-19T21:50:40.721490+0000","last_clean":"2024-02-19T21:50:40.721490+0000","last_became_active":"2024-02-19T21:49:54.486014+0000","last_became_peered":"2024-02-19T21:49:54.486014+0000","last_unstale":"2024-02-19T21:50:40.721490+0000","last_undegraded":"2024-02-19T21:50:40.721490+0000","last_fullsized":"2024-02-19T21:50:40.721490+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'27","last_scrub_stamp":"2024-02-19T21:48:24.665813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:24.665813+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"324'11","reported_seq":658,"reported_epoch":431,"state":"active+clean","last_fresh":"2024-02-19T21:50:42.081684+0000","last_change":"2024-02-19T21:48:26.293036+0000","last_active":"2024-02-19T21:50:42.081684+0000","last_peered":"2024-02-19T21:50:42.081684+0000","last_clean":"2024-02-19T21:50:42.081684+0000","last_became_active":"2024-02-19T21:44:34.385140+0000","last_became_peered":"2024-02-19T21:44:34.385140+0000","last_unstale":"2024-02-19T21:50:42.081684+0000","last_undegraded":"2024-02-19T21:50:42.081684+0000","last_fullsized":"2024-02-19T21:50:42.081684+0000","mapping_epoch":62,"log_start":"66'8","ondisk_log_start":"66'8","created":62,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'11","last_scrub_stamp":"2024-02-19T21:48:26.292909+0000","last_deep_scrub":"324'11","last_deep_scrub_stamp":"2024-02-19T21:46:05.210095+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.292909+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":4757454872,"num_objects":72594,"num_object_clones":0,"num_object_copies":217782,"num_objects_missing_on_primary":994,"num_objects_missing":994,"num_objects_degraded":11115,"num_objects_misplaced":3973,"num_objects_unfound":0,"num_objects_dirty":72594,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":76902,"num_write_kb":4783809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4523,"num_bytes_recovered":296419328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":14092742656,"data_stored":14092730440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76402,"ondisk_log_size":76402,"up":48,"acting":42,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1081,"num_read_kb":1076,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":3,"num_objects_missing":3,"num_objects_degraded":7,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1107,"num_read_kb":864,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":5062,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":776,"ondisk_log_size":776,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":22,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":66,"acting":66,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":382,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201503,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":991008,"kb_used_data":693784,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":92754144,"statfs":{"total":95995035648,"available":94980243456,"internally_reserved":0,"allocated":710434816,"data_stored":709196649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:49:49 2024","interfaces":[{"interface":"back","average":{"1min":1.8049999999999999,"5min":2.6440000000000001,"15min":1.8859999999999999},"min":{"1min":0.26000000000000001,"5min":0.19,"15min":0.189},"max":{"1min":11.653,"5min":70.477999999999994,"15min":70.477999999999994},"last":0.23100000000000001},{"interface":"front","average":{"1min":2.0590000000000002,"5min":2.9199999999999999,"15min":2.0379999999999998},"min":{"1min":0.23100000000000001,"5min":0.21199999999999999,"15min":0.20999999999999999},"max":{"1min":12.242000000000001,"5min":68.052000000000007,"15min":68.052000000000007},"last":0.39000000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:49:49 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":2.7410000000000001,"15min":2.0710000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.23200000000000001},"max":{"1min":8.9629999999999992,"5min":68.168000000000006,"15min":68.168000000000006},"last":0.374},{"interface":"front","average":{"1min":2.2799999999999998,"5min":3.298,"15min":2.1099999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.223},"max":{"1min":12.199,"5min":68.444000000000003,"15min":68.444000000000003},"last":0.44800000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:50:09 2024","interfaces":[{"interface":"back","average":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":12.304,"5min":12.304,"15min":12.304},"last":0.42399999999999999},{"interface":"front","average":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":11.69,"5min":11.69,"15min":11.69},"last":0.28299999999999997}]},{"osd":3,"last update":"Mon Feb 19 21:49:49 2024","interfaces":[{"interface":"back","average":{"1min":1.8380000000000001,"5min":2.121,"15min":2.1480000000000001},"min":{"1min":0.377,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":10.435,"5min":11.614000000000001,"15min":31.559000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.744,"15min":1.895},"min":{"1min":0.33000000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":9.0129999999999999,"5min":13.473000000000001,"15min":30.812999999999999},"last":0.40200000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:49:49 2024","interfaces":[{"interface":"back","average":{"1min":3.0339999999999998,"5min":2.0720000000000001,"15min":1.5389999999999999},"min":{"1min":0.27400000000000002,"5min":0.216,"15min":0.216},"max":{"1min":17.716999999999999,"5min":17.716999999999999,"15min":17.716999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":3.4089999999999998,"5min":2.4529999999999998,"15min":1.8700000000000001},"min":{"1min":0.26500000000000001,"5min":0.253,"15min":0.245},"max":{"1min":15.666,"5min":17.690999999999999,"15min":17.690999999999999},"last":0.30599999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:49:49 2024","interfaces":[{"interface":"back","average":{"1min":2.1459999999999999,"5min":2.1579999999999999,"15min":1.609},"min":{"1min":0.30199999999999999,"5min":0.28499999999999998,"15min":0.24199999999999999},"max":{"1min":12.210000000000001,"5min":29.021000000000001,"15min":29.021000000000001},"last":2.0539999999999998},{"interface":"front","average":{"1min":2.6219999999999999,"5min":2.5110000000000001,"15min":1.889},"min":{"1min":0.33800000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":17.670999999999999,"5min":29.091999999999999,"15min":29.091999999999999},"last":1.0069999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:49:49 2024","interfaces":[{"interface":"back","average":{"1min":3.1320000000000001,"5min":2.452,"15min":1.6930000000000001},"min":{"1min":0.32500000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":12.271000000000001,"5min":19.286000000000001,"15min":19.286000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":2.6800000000000002,"5min":2.339,"15min":1.863},"min":{"1min":0.314,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":11.722,"5min":18.364000000000001,"15min":18.364000000000001},"last":0.52400000000000002}]}]},{"osd":6,"up_from":47,"seq":201863463142,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2631656,"kb_used_data":2037856,"kb_used_omap":0,"kb_used_meta":593792,"kb_avail":91113496,"statfs":{"total":95995035648,"available":93300219904,"internally_reserved":0,"allocated":2086764544,"data_stored":2085517719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":608043008},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:50:27 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":1.2310000000000001,"15min":1.6599999999999999},"min":{"1min":0.245,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":2.9369999999999998,"5min":8.8079999999999998,"15min":45.197000000000003},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.425,"5min":1.74,"15min":1.9890000000000001},"min":{"1min":0.27600000000000002,"5min":0.23499999999999999,"15min":0.221},"max":{"1min":4.2859999999999996,"5min":6.9699999999999998,"15min":44.753},"last":0.35799999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:50:27 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":1.5780000000000001,"15min":1.7},"min":{"1min":0.26600000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":2.9929999999999999,"5min":8.8469999999999995,"15min":45.231999999999999},"last":0.374},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.609,"15min":1.702},"min":{"1min":0.26400000000000001,"5min":0.245,"15min":0.23100000000000001},"max":{"1min":5.6050000000000004,"5min":7.3570000000000002,"15min":45.097999999999999},"last":0.39100000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:50:09 2024","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.571,"15min":1.571},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":6.0330000000000004,"5min":6.0330000000000004,"15min":6.0330000000000004},"last":0.443},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":7.8959999999999999,"5min":7.8959999999999999,"15min":7.8959999999999999},"last":0.41899999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:50:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.508,"15min":1.6100000000000001},"min":{"1min":0.36399999999999999,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":5.4729999999999999,"5min":8.9009999999999998,"15min":11.15},"last":0.45500000000000002},{"interface":"front","average":{"1min":1.909,"5min":1.675,"15min":1.6539999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.246},"max":{"1min":7.3970000000000002,"5min":7.3970000000000002,"15min":19.632999999999999},"last":0.434}]},{"osd":4,"last update":"Mon Feb 19 21:50:27 2024","interfaces":[{"interface":"back","average":{"1min":3.3069999999999999,"5min":2.242,"15min":1.7609999999999999},"min":{"1min":0.34000000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":18.010000000000002,"5min":18.010000000000002,"15min":18.010000000000002},"last":0.313},{"interface":"front","average":{"1min":1.7390000000000001,"5min":1.988,"15min":1.7190000000000001},"min":{"1min":0.32800000000000001,"5min":0.26300000000000001,"15min":0.23499999999999999},"max":{"1min":6.0659999999999998,"5min":11.566000000000001,"15min":16.594999999999999},"last":0.53900000000000003}]},{"osd":5,"last update":"Mon Feb 19 21:50:27 2024","interfaces":[{"interface":"back","average":{"1min":2.218,"5min":2.27,"15min":1.778},"min":{"1min":0.376,"5min":0.27400000000000002,"15min":0.27100000000000002},"max":{"1min":9.5990000000000002,"5min":14.695,"15min":14.695},"last":0.40500000000000003},{"interface":"front","average":{"1min":1.1339999999999999,"5min":2.254,"15min":1.907},"min":{"1min":0.40999999999999998,"5min":0.28799999999999998,"15min":0.27900000000000003},"max":{"1min":3.2890000000000001,"5min":11.609999999999999,"15min":15.497999999999999},"last":0.51200000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:49:48 2024","interfaces":[{"interface":"back","average":{"1min":1.7030000000000001,"5min":2.0800000000000001,"15min":1.7909999999999999},"min":{"1min":0.38300000000000001,"5min":0.27200000000000002,"15min":0.26700000000000002},"max":{"1min":7.9569999999999999,"5min":9.1929999999999996,"15min":14.721},"last":0.48399999999999999},{"interface":"front","average":{"1min":1.7390000000000001,"5min":2.1139999999999999,"15min":1.841},"min":{"1min":0.42099999999999999,"5min":0.35599999999999998,"15min":0.32700000000000001},"max":{"1min":7.9850000000000003,"5min":9.2240000000000002,"15min":14.744999999999999},"last":0.58599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575104,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2077184,"kb_used_data":1172472,"kb_used_omap":0,"kb_used_meta":904704,"kb_avail":91667968,"statfs":{"total":95995035648,"available":93867999232,"internally_reserved":0,"allocated":1200611328,"data_stored":1199349128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":926416896},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:50:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.0800000000000001,"15min":1.5289999999999999},"min":{"1min":0.184,"5min":0.16300000000000001,"15min":0.161},"max":{"1min":5.7889999999999997,"5min":6.2789999999999999,"15min":42.776000000000003},"last":0.30399999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1919999999999999,"15min":1.5700000000000001},"min":{"1min":0.22,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":5.7119999999999997,"5min":10.798,"15min":44.845999999999997},"last":0.27400000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:50:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":3.5649999999999999,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":0.23899999999999999},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":4.452,"5min":4.452,"15min":4.452},"last":0.33600000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:50:19 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":1.0920000000000001,"15min":1.6419999999999999},"min":{"1min":0.22800000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":3.5310000000000001,"5min":5.1660000000000004,"15min":41.607999999999997},"last":0.315},{"interface":"front","average":{"1min":0.68400000000000005,"5min":1.1850000000000001,"15min":1.5289999999999999},"min":{"1min":0.25,"5min":0.215,"15min":0.215},"max":{"1min":2.4710000000000001,"5min":5.6589999999999998,"15min":42.811999999999998},"last":0.35399999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:50:34 2024","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.633,"15min":1.5429999999999999},"min":{"1min":0.316,"5min":0.251,"15min":0.251},"max":{"1min":9.8759999999999994,"5min":15.853,"15min":15.853},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.83099999999999996,"5min":1.615,"15min":1.575},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.26500000000000001},"max":{"1min":2.746,"5min":15.861000000000001,"15min":15.861000000000001},"last":0.378}]},{"osd":5,"last update":"Mon Feb 19 21:49:59 2024","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.734,"15min":1.639},"min":{"1min":0.32400000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":4.0720000000000001,"5min":14.331,"15min":14.331},"last":0.41299999999999998},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.8979999999999999,"15min":1.625},"min":{"1min":0.307,"5min":0.307,"15min":0.30099999999999999},"max":{"1min":5.5229999999999997,"5min":14.496,"15min":14.496},"last":0.52300000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:50:34 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.5700000000000001,"15min":1.657},"min":{"1min":0.40200000000000002,"5min":0.30199999999999999,"15min":0.30099999999999999},"max":{"1min":8.8309999999999995,"5min":10.456,"15min":11.638999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":1.179,"5min":1.696,"15min":1.786},"min":{"1min":0.38,"5min":0.36899999999999999,"15min":0.29699999999999999},"max":{"1min":3.863,"5min":9.8049999999999997,"15min":12.199},"last":0.49199999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:49:54 2024","interfaces":[{"interface":"back","average":{"1min":2.1419999999999999,"5min":2.0790000000000002,"15min":1.867},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":7.702,"5min":13.904,"15min":13.904},"last":0.54500000000000004},{"interface":"front","average":{"1min":2.0299999999999998,"5min":2.0779999999999998,"15min":1.7350000000000001},"min":{"1min":0.38900000000000001,"5min":0.35499999999999998,"15min":0.32600000000000001},"max":{"1min":7.6909999999999998,"5min":13.894,"15min":13.894},"last":0.41999999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738630,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3820064,"kb_used_data":2917464,"kb_used_omap":0,"kb_used_meta":902592,"kb_avail":89925088,"statfs":{"total":95995035648,"available":92083290112,"internally_reserved":0,"allocated":2987483136,"data_stored":2986244332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":924254208},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:50:10 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.88300000000000001,"15min":1.1279999999999999},"min":{"1min":0.189,"5min":0.153,"15min":0.153},"max":{"1min":3.0800000000000001,"5min":6.1550000000000002,"15min":16.478000000000002},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":1.054,"15min":1.417},"min":{"1min":0.224,"5min":0.17899999999999999,"15min":0.17799999999999999},"max":{"1min":3.1669999999999998,"5min":6.9359999999999999,"15min":13.422000000000001},"last":0.29499999999999998}]},{"osd":2,"last update":"Mon Feb 19 21:50:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":4.2510000000000003,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":0.28100000000000003},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":8.9960000000000004,"5min":8.9960000000000004,"15min":8.9960000000000004},"last":0.436}]},{"osd":3,"last update":"Mon Feb 19 21:50:01 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.292,"15min":1.6819999999999999},"min":{"1min":0.255,"5min":0.216,"15min":0.21299999999999999},"max":{"1min":5.3570000000000002,"5min":12.691000000000001,"15min":14.507999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.099,"15min":1.552},"min":{"1min":0.32000000000000001,"5min":0.24099999999999999,"15min":0.23400000000000001},"max":{"1min":3.4569999999999999,"5min":6.6150000000000002,"15min":18.759},"last":0.46300000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:49:44 2024","interfaces":[{"interface":"back","average":{"1min":2.0649999999999999,"5min":1.768,"15min":1.6910000000000001},"min":{"1min":0.29899999999999999,"5min":0.252,"15min":0.252},"max":{"1min":7.766,"5min":10.311,"15min":13.278},"last":0.379},{"interface":"front","average":{"1min":1.99,"5min":1.732,"15min":1.534},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.255},"max":{"1min":8.1219999999999999,"5min":10.109,"15min":10.109},"last":0.48099999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:50:01 2024","interfaces":[{"interface":"back","average":{"1min":1.6140000000000001,"5min":2.1850000000000001,"15min":2.0779999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.27600000000000002},"max":{"1min":8.1199999999999992,"5min":25.442,"15min":42.799999999999997},"last":0.35099999999999998},{"interface":"front","average":{"1min":2.1579999999999999,"5min":2.2429999999999999,"15min":2.0939999999999999},"min":{"1min":0.35099999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":8.5530000000000008,"5min":25.411999999999999,"15min":42.695},"last":0.44500000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:50:16 2024","interfaces":[{"interface":"back","average":{"1min":2.2309999999999999,"5min":1.909,"15min":1.7070000000000001},"min":{"1min":0.33400000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":10.098000000000001,"5min":10.278,"15min":42.777000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":1.897,"5min":1.931,"15min":1.9590000000000001},"min":{"1min":0.39900000000000002,"5min":0.29599999999999999,"15min":0.28599999999999998},"max":{"1min":10.058999999999999,"5min":11.84,"15min":13.289999999999999},"last":0.45600000000000002}]},{"osd":7,"last update":"Mon Feb 19 21:49:48 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.8839999999999999,"15min":1.8100000000000001},"min":{"1min":0.38700000000000001,"5min":0.36799999999999999,"15min":0.31},"max":{"1min":9.6460000000000008,"5min":15.688000000000001,"15min":42.758000000000003},"last":0.47099999999999997},{"interface":"front","average":{"1min":1.978,"5min":1.871,"15min":1.738},"min":{"1min":0.40000000000000002,"5min":0.36399999999999999,"15min":0.33200000000000002},"max":{"1min":9.6389999999999993,"5min":10.470000000000001,"15min":42.718000000000004},"last":0.55300000000000005}]}]},{"osd":2,"up_from":394,"seq":1692217114644,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2142872,"kb_used_data":1831120,"kb_used_omap":0,"kb_used_meta":311743,"kb_avail":91602280,"statfs":{"total":95995035648,"available":93800734720,"internally_reserved":0,"allocated":1875066880,"data_stored":1873844381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":319224884},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":9.1530000000000005,"5min":9.1530000000000005,"15min":9.1530000000000005},"last":0.29799999999999999},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":6.149,"5min":6.149,"15min":6.149},"last":0.33800000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":2.8370000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":6.992,"5min":6.992,"15min":6.992},"last":0.39600000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.45,"15min":1.45},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":6.9470000000000001,"5min":6.9470000000000001,"15min":6.9470000000000001},"last":0.35299999999999998},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":6.6500000000000004,"5min":6.6500000000000004,"15min":6.6500000000000004},"last":0.40899999999999997}]},{"osd":4,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":7.0339999999999998,"5min":7.0339999999999998,"15min":7.0339999999999998},"last":0.57199999999999995},{"interface":"front","average":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":7.0419999999999998,"5min":7.0419999999999998,"15min":7.0419999999999998},"last":0.379}]},{"osd":5,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":10.067,"5min":10.067,"15min":10.067},"last":0.47099999999999997},{"interface":"front","average":{"1min":1.821,"5min":1.821,"15min":1.821},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":13.558,"5min":13.558,"15min":13.558},"last":0.436}]},{"osd":6,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.752,"5min":1.752,"15min":1.752},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":5.6829999999999998,"5min":5.6829999999999998,"15min":5.6829999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":7,"5min":7,"15min":7},"last":0.55100000000000005}]},{"osd":7,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":5.7750000000000004,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.782,"5min":2.782,"15min":2.782},"last":0.59699999999999998}]}]},{"osd":3,"up_from":0,"seq":111669149942,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":32,"seq":137438953711,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3748128,"kb_used_data":3162520,"kb_used_omap":0,"kb_used_meta":585600,"kb_avail":89997024,"statfs":{"total":95995035648,"available":92156952576,"internally_reserved":0,"allocated":3238420480,"data_stored":3237189135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":599654400},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:50:33 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":2.173,"15min":1.905},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":5.8780000000000001,"5min":53.936,"15min":53.936},"last":0.36299999999999999},{"interface":"front","average":{"1min":1.282,"5min":2.3889999999999998,"15min":2.069},"min":{"1min":0.25900000000000001,"5min":0.23000000000000001,"15min":0.22600000000000001},"max":{"1min":9.7230000000000008,"5min":54.405999999999999,"15min":54.405999999999999},"last":0.36799999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:50:33 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":2.2669999999999999,"15min":1.7669999999999999},"min":{"1min":0.26500000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":5.8490000000000002,"5min":54.731000000000002,"15min":54.731000000000002},"last":0.33700000000000002},{"interface":"front","average":{"1min":1.375,"5min":2.198,"15min":1.665},"min":{"1min":0.255,"5min":0.252,"15min":0.25},"max":{"1min":9.7639999999999993,"5min":52.490000000000002,"15min":52.490000000000002},"last":0.39800000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:50:10 2024","interfaces":[{"interface":"back","average":{"1min":2.077,"5min":2.077,"15min":2.077},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":9.0619999999999994,"5min":9.0619999999999994,"15min":9.0619999999999994},"last":0.40999999999999998},{"interface":"front","average":{"1min":2.113,"5min":2.113,"15min":2.113},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":9.0899999999999999,"5min":9.0899999999999999,"15min":9.0899999999999999},"last":0.42499999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:50:33 2024","interfaces":[{"interface":"back","average":{"1min":1.653,"5min":1.6799999999999999,"15min":1.6899999999999999},"min":{"1min":0.372,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":6.3170000000000002,"5min":6.5579999999999998,"15min":15.914999999999999},"last":0.443},{"interface":"front","average":{"1min":1.115,"5min":1.7889999999999999,"15min":1.6879999999999999},"min":{"1min":0.40799999999999997,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":7.9569999999999999,"5min":9.4000000000000004,"15min":13.321},"last":0.39000000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:50:22 2024","interfaces":[{"interface":"back","average":{"1min":2.0899999999999999,"5min":2.3780000000000001,"15min":1.7330000000000001},"min":{"1min":0.33300000000000002,"5min":0.23799999999999999,"15min":0.23400000000000001},"max":{"1min":13.805999999999999,"5min":16.731999999999999,"15min":18.916},"last":0.28199999999999997},{"interface":"front","average":{"1min":1.889,"5min":2.3500000000000001,"15min":1.9390000000000001},"min":{"1min":0.35999999999999999,"5min":0.26200000000000001,"15min":0.253},"max":{"1min":7.3719999999999999,"5min":8.2959999999999994,"15min":14.840999999999999},"last":0.32400000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:50:33 2024","interfaces":[{"interface":"back","average":{"1min":1.756,"5min":1.9630000000000001,"15min":1.615},"min":{"1min":0.40200000000000002,"5min":0.28999999999999998,"15min":0.28599999999999998},"max":{"1min":7.4050000000000002,"5min":9.1720000000000006,"15min":13.27},"last":0.41599999999999998},{"interface":"front","average":{"1min":2.0819999999999999,"5min":2.4710000000000001,"15min":1.823},"min":{"1min":0.34300000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":13.715,"5min":18.670000000000002,"15min":18.670000000000002},"last":0.31900000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:50:00 2024","interfaces":[{"interface":"back","average":{"1min":2.7650000000000001,"5min":2.4849999999999999,"15min":1.76},"min":{"1min":0.38,"5min":0.311,"15min":0.28899999999999998},"max":{"1min":13.765000000000001,"5min":16.763999999999999,"15min":16.763999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":3.0190000000000001,"5min":1.9199999999999999,"15min":1.6879999999999999},"min":{"1min":0.502,"5min":0.31,"15min":0.31},"max":{"1min":10.044,"5min":10.82,"15min":12.808999999999999},"last":0.377}]}]},{"osd":5,"up_from":38,"seq":163208757483,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2865160,"kb_used_data":1978816,"kb_used_omap":0,"kb_used_meta":886336,"kb_avail":90879992,"statfs":{"total":95995035648,"available":93061111808,"internally_reserved":0,"allocated":2026307584,"data_stored":2025092503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":907608064},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.8540000000000001,"15min":1.762},"min":{"1min":0.26000000000000001,"5min":0.214,"15min":0.20599999999999999},"max":{"1min":4.0979999999999999,"5min":19.236000000000001,"15min":20.550999999999998},"last":0.29399999999999998},{"interface":"front","average":{"1min":1.3979999999999999,"5min":2.0680000000000001,"15min":1.8839999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.20899999999999999},"max":{"1min":3.7090000000000001,"5min":13.241,"15min":20.879000000000001},"last":1.903}]},{"osd":1,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.798,"15min":1.712},"min":{"1min":0.307,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":4.9569999999999999,"5min":8.9789999999999992,"15min":10.42},"last":1.9410000000000001},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.877,"15min":1.613},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":4.4829999999999997,"5min":10.965,"15min":10.965},"last":0.36599999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":4.1280000000000001,"5min":4.1280000000000001,"15min":4.1280000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":4.2619999999999996,"5min":4.2619999999999996,"15min":4.2619999999999996},"last":1.9650000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.6619999999999999,"5min":2.1640000000000001,"15min":2.0649999999999999},"min":{"1min":0.32200000000000001,"5min":0.26100000000000001,"15min":0.24099999999999999},"max":{"1min":13.182,"5min":19.321000000000002,"15min":20.146999999999998},"last":0.41599999999999998},{"interface":"front","average":{"1min":1.393,"5min":1.9630000000000001,"15min":2.129},"min":{"1min":0.40999999999999998,"5min":0.311,"15min":0.29499999999999998},"max":{"1min":4.3659999999999997,"5min":9.0269999999999992,"15min":20.120000000000001},"last":2.161}]},{"osd":4,"last update":"Mon Feb 19 21:50:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.8149999999999999,"15min":1.397},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":4.452,"5min":16.643999999999998,"15min":21.577000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":2.254,"5min":2.294,"15min":1.879},"min":{"1min":0.26100000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":10.352,"5min":19.274000000000001,"15min":19.274000000000001},"last":0.44800000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:50:30 2024","interfaces":[{"interface":"back","average":{"1min":2.0649999999999999,"5min":2.29,"15min":1.8979999999999999},"min":{"1min":0.34000000000000002,"5min":0.307,"15min":0.221},"max":{"1min":8.109,"5min":19.884,"15min":19.884},"last":0.61299999999999999},{"interface":"front","average":{"1min":1.6679999999999999,"5min":2.044,"15min":1.867},"min":{"1min":0.44900000000000001,"5min":0.26700000000000002,"15min":0.23599999999999999},"max":{"1min":6.0750000000000002,"5min":10.260999999999999,"15min":13.532999999999999},"last":2.1099999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:49:52 2024","interfaces":[{"interface":"back","average":{"1min":1.8939999999999999,"5min":2.4319999999999999,"15min":2.0110000000000001},"min":{"1min":0.35899999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":9.6300000000000008,"5min":12.611000000000001,"15min":12.962},"last":2.137},{"interface":"front","average":{"1min":2.2050000000000001,"5min":2.3540000000000001,"15min":1.8300000000000001},"min":{"1min":0.36099999999999999,"5min":0.221,"15min":0.221},"max":{"1min":9.5649999999999995,"5min":15.593999999999999,"15min":17.759},"last":0.59099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2981564416,"data_stored":2981560344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1196359680,"data_stored":1196359680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1871446016,"data_stored":1871446016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3232763904,"data_stored":3232759832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2021785600,"data_stored":2021785600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2082344960,"data_stored":2082340888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":706478080,"data_stored":706478080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:50:49.948 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph status --format=json 2024-02-19T21:50:50.020 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:50:50.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:48.280229+0000 mgr.y (mgr.14514) 694 : audit [DBG] from='client.25682 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:50:50.074 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:50:50.075 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:50:50.103 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:50.109 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:50:50.329 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:50:50.334 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:50.335 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:50:50.436 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:50:50.469 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:50.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:49.181654+0000 mgr.y (mgr.14514) 695 : cluster [DBG] pgmap v903: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 127 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped; 4.4 GiB data, 17 GiB used, 608 GiB / 626 GiB avail; 604 B/s rd, 0 B/s wr, 89 op/s; 11122/218358 objects degraded (5.093%); 3974/218358 objects misplaced (1.820%); 2.0 MiB/s, 31 objects/s recovering 2024-02-19T21:50:50.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:49.750333+0000 mon.a (mon.0) 1708 : cluster [DBG] osdmap e433: 8 total, 8 up, 7 in 2024-02-19T21:50:50.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:49.767281+0000 mon.a (mon.0) 1709 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:50:50.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:50.186943+0000 mon.a (mon.0) 1710 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:50:50.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:50.187675+0000 mon.a (mon.0) 1711 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:50:50.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:50.192029+0000 mon.a (mon.0) 1712 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:50:50.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:50.279707+0000 mon.a (mon.0) 1713 : cluster [WRN] Health check update: Degraded data redundancy: 11122/218358 objects degraded (5.093%), 8 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:50:50.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:50.284308+0000 mon.a (mon.0) 1714 : cluster [DBG] osdmap e434: 8 total, 8 up, 7 in 2024-02-19T21:50:50.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:49.181654+0000 mgr.y (mgr.14514) 695 : cluster [DBG] pgmap v903: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 127 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped; 4.4 GiB data, 17 GiB used, 608 GiB / 626 GiB avail; 604 B/s rd, 0 B/s wr, 89 op/s; 11122/218358 objects degraded (5.093%); 3974/218358 objects misplaced (1.820%); 2.0 MiB/s, 31 objects/s recovering 2024-02-19T21:50:50.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:49.750333+0000 mon.a (mon.0) 1708 : cluster [DBG] osdmap e433: 8 total, 8 up, 7 in 2024-02-19T21:50:50.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:49.767281+0000 mon.a (mon.0) 1709 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:50:50.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:50.186943+0000 mon.a (mon.0) 1710 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:50:50.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:50.187675+0000 mon.a (mon.0) 1711 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:50:50.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:50.192029+0000 mon.a (mon.0) 1712 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:50:50.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:50.279707+0000 mon.a (mon.0) 1713 : cluster [WRN] Health check update: Degraded data redundancy: 11122/218358 objects degraded (5.093%), 8 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:50:50.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:50.284308+0000 mon.a (mon.0) 1714 : cluster [DBG] osdmap e434: 8 total, 8 up, 7 in 2024-02-19T21:50:50.848 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:50:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:50:50] "GET /metrics HTTP/1.1" 200 176548 "" "Prometheus/2.33.4" 2024-02-19T21:50:51.022 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:50:51.025 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:51.025 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:50:51.056 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:50:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:50:51.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:49.181654+0000 mgr.y (mgr.14514) 695 : cluster [DBG] pgmap v903: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 2 active+recovery_wait+degraded, 127 active+clean, 1 active+recovery_wait, 4 active+recovering+undersized+degraded+remapped, 2 active+recovery_wait+undersized+degraded+remapped; 4.4 GiB data, 17 GiB used, 608 GiB / 626 GiB avail; 604 B/s rd, 0 B/s wr, 89 op/s; 11122/218358 objects degraded (5.093%); 3974/218358 objects misplaced (1.820%); 2.0 MiB/s, 31 objects/s recovering 2024-02-19T21:50:51.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:49.750333+0000 mon.a (mon.0) 1708 : cluster [DBG] osdmap e433: 8 total, 8 up, 7 in 2024-02-19T21:50:51.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:49.767281+0000 mon.a (mon.0) 1709 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:50:51.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:50.186943+0000 mon.a (mon.0) 1710 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:50:51.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:50.187675+0000 mon.a (mon.0) 1711 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:50:51.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:50.192029+0000 mon.a (mon.0) 1712 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:50:51.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:50.279707+0000 mon.a (mon.0) 1713 : cluster [WRN] Health check update: Degraded data redundancy: 11122/218358 objects degraded (5.093%), 8 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:50:51.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:50.284308+0000 mon.a (mon.0) 1714 : cluster [DBG] osdmap e434: 8 total, 8 up, 7 in 2024-02-19T21:50:51.126 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:50:51.156 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:51.706 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:50:51.710 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:51.710 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:50:51.811 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:50:51.846 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:52.006 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:50.982770+0000 mgr.y (mgr.14514) 696 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:50:52.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:50.982770+0000 mgr.y (mgr.14514) 696 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:50:52.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:50.982770+0000 mgr.y (mgr.14514) 696 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:50:52.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:51.182144+0000 mgr.y (mgr.14514) 697 : cluster [DBG] pgmap v906: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 130 active+clean, 1 active+recovery_wait+undersized+degraded+remapped, 5 active+recovering+undersized+degraded+remapped; 4.4 GiB data, 17 GiB used, 608 GiB / 626 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 227 op/s; 7130/216102 objects degraded (3.299%); 7769/216102 objects misplaced (3.595%); 3.3 MiB/s, 54 objects/s recovering 2024-02-19T21:50:52.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:51.182144+0000 mgr.y (mgr.14514) 697 : cluster [DBG] pgmap v906: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 130 active+clean, 1 active+recovery_wait+undersized+degraded+remapped, 5 active+recovering+undersized+degraded+remapped; 4.4 GiB data, 17 GiB used, 608 GiB / 626 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 227 op/s; 7130/216102 objects degraded (3.299%); 7769/216102 objects misplaced (3.595%); 3.3 MiB/s, 54 objects/s recovering 2024-02-19T21:50:53.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:51.182144+0000 mgr.y (mgr.14514) 697 : cluster [DBG] pgmap v906: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 130 active+clean, 1 active+recovery_wait+undersized+degraded+remapped, 5 active+recovering+undersized+degraded+remapped; 4.4 GiB data, 17 GiB used, 608 GiB / 626 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 227 op/s; 7130/216102 objects degraded (3.299%); 7769/216102 objects misplaced (3.595%); 3.3 MiB/s, 54 objects/s recovering 2024-02-19T21:50:53.299 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:50:53.308 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:53.308 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:50:53.409 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:50:53.439 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:53.545 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:50:53.552 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:53.552 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:50:53.653 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:50:53.686 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:53.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:52.869082+0000 osd.0 (osd.0) 267 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:50:53.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:52.869120+0000 osd.0 (osd.0) 268 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:50:53.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:52.869082+0000 osd.0 (osd.0) 267 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:50:53.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:52.869120+0000 osd.0 (osd.0) 268 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:50:54.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:52.869082+0000 osd.0 (osd.0) 267 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:50:54.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:52.869120+0000 osd.0 (osd.0) 268 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:50:54.741 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:50:54.747 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:54.748 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:50:54.848 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:50:54.882 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:54.984 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:50:54.984 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:50:54.984 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:50:54.984 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:50:54.984 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:50:54.985 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:50:54.985 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:50:54.985 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:50:54.985 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:50:54.985 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:50:54.985 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:50:54.985 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:50:54.985 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:50:54.985 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:50:54.985 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:50:54.985 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:50:55.050 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:53.182613+0000 mgr.y (mgr.14514) 698 : cluster [DBG] pgmap v907: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 131 active+clean, 1 active+recovery_wait+undersized+degraded+remapped, 4 active+recovering+undersized+degraded+remapped; 4.4 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 147 op/s; 7031/215799 objects degraded (3.258%); 7721/215799 objects misplaced (3.578%); 3.0 MiB/s, 48 objects/s recovering 2024-02-19T21:50:55.050 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:53.772070+0000 mon.a (mon.0) 1715 : cluster [DBG] osdmap e435: 8 total, 8 up, 7 in 2024-02-19T21:50:55.050 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:54.382786+0000 mon.c (mon.2) 105 : audit [DBG] from='client.? 172.21.15.80:0/1121454716' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:50:55.050 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:53.182613+0000 mgr.y (mgr.14514) 698 : cluster [DBG] pgmap v907: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 131 active+clean, 1 active+recovery_wait+undersized+degraded+remapped, 4 active+recovering+undersized+degraded+remapped; 4.4 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 147 op/s; 7031/215799 objects degraded (3.258%); 7721/215799 objects misplaced (3.578%); 3.0 MiB/s, 48 objects/s recovering 2024-02-19T21:50:55.050 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:53.772070+0000 mon.a (mon.0) 1715 : cluster [DBG] osdmap e435: 8 total, 8 up, 7 in 2024-02-19T21:50:55.050 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:54.382786+0000 mon.c (mon.2) 105 : audit [DBG] from='client.? 172.21.15.80:0/1121454716' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:50:55.055 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:53.182613+0000 mgr.y (mgr.14514) 698 : cluster [DBG] pgmap v907: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 131 active+clean, 1 active+recovery_wait+undersized+degraded+remapped, 4 active+recovering+undersized+degraded+remapped; 4.4 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 147 op/s; 7031/215799 objects degraded (3.258%); 7721/215799 objects misplaced (3.578%); 3.0 MiB/s, 48 objects/s recovering 2024-02-19T21:50:55.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:53.772070+0000 mon.a (mon.0) 1715 : cluster [DBG] osdmap e435: 8 total, 8 up, 7 in 2024-02-19T21:50:55.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:54.382786+0000 mon.c (mon.2) 105 : audit [DBG] from='client.? 172.21.15.80:0/1121454716' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:50:55.194 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:50:55.297 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-02-19T21:50:55.429 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:50:55.429 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:50:55.634 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:50:55.636 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:55.637 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:50:55.739 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:50:55.768 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:55.789 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:50:55.791 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:55.792 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:50:55.893 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:50:55.923 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:54.777709+0000 mon.c (mon.2) 106 : audit [INF] from='client.? 172.21.15.80:0/2021717062' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:50:55.923 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:54.778076+0000 mon.a (mon.0) 1716 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:50:55.923 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:55.281275+0000 mon.a (mon.0) 1717 : cluster [WRN] Health check update: Degraded data redundancy: 7031/215799 objects degraded (3.258%), 5 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-19T21:50:55.923 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:55.281761+0000 mon.a (mon.0) 1718 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:50:55.923 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:50:55.288215+0000 mon.a (mon.0) 1719 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:50:55.923 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:55.288289+0000 mon.a (mon.0) 1720 : cluster [DBG] osdmap e436: 8 total, 8 up, 7 in 2024-02-19T21:50:55.923 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:54.777709+0000 mon.c (mon.2) 106 : audit [INF] from='client.? 172.21.15.80:0/2021717062' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:50:55.923 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:54.778076+0000 mon.a (mon.0) 1716 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:50:55.924 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:55.281275+0000 mon.a (mon.0) 1717 : cluster [WRN] Health check update: Degraded data redundancy: 7031/215799 objects degraded (3.258%), 5 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-19T21:50:55.924 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:55.281761+0000 mon.a (mon.0) 1718 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:50:55.924 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:50:55.288215+0000 mon.a (mon.0) 1719 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:50:55.924 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:55.288289+0000 mon.a (mon.0) 1720 : cluster [DBG] osdmap e436: 8 total, 8 up, 7 in 2024-02-19T21:50:55.926 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:56.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:50:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:50:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:50:56.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:54.777709+0000 mon.c (mon.2) 106 : audit [INF] from='client.? 172.21.15.80:0/2021717062' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:50:56.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:54.778076+0000 mon.a (mon.0) 1716 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:50:56.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:55.281275+0000 mon.a (mon.0) 1717 : cluster [WRN] Health check update: Degraded data redundancy: 7031/215799 objects degraded (3.258%), 5 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-19T21:50:56.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:55.281761+0000 mon.a (mon.0) 1718 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:50:56.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:50:55.288215+0000 mon.a (mon.0) 1719 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:50:56.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:55.288289+0000 mon.a (mon.0) 1720 : cluster [DBG] osdmap e436: 8 total, 8 up, 7 in 2024-02-19T21:50:56.625 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.1 dump_blocked_ops 2024-02-19T21:50:56.932 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:55.183169+0000 mgr.y (mgr.14514) 699 : cluster [DBG] pgmap v909: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 131 active+clean, 1 active+recovery_wait+undersized+degraded+remapped, 4 active+recovering+undersized+degraded+remapped; 4.4 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 203 op/s; 6973/214704 objects degraded (3.248%); 7324/214704 objects misplaced (3.411%); 7.1 MiB/s, 114 objects/s recovering 2024-02-19T21:50:56.933 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:56.295957+0000 mon.a (mon.0) 1721 : cluster [DBG] osdmap e437: 8 total, 8 up, 7 in 2024-02-19T21:50:56.933 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:55.183169+0000 mgr.y (mgr.14514) 699 : cluster [DBG] pgmap v909: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 131 active+clean, 1 active+recovery_wait+undersized+degraded+remapped, 4 active+recovering+undersized+degraded+remapped; 4.4 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 203 op/s; 6973/214704 objects degraded (3.248%); 7324/214704 objects misplaced (3.411%); 7.1 MiB/s, 114 objects/s recovering 2024-02-19T21:50:56.933 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:56.295957+0000 mon.a (mon.0) 1721 : cluster [DBG] osdmap e437: 8 total, 8 up, 7 in 2024-02-19T21:50:57.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:55.183169+0000 mgr.y (mgr.14514) 699 : cluster [DBG] pgmap v909: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 131 active+clean, 1 active+recovery_wait+undersized+degraded+remapped, 4 active+recovering+undersized+degraded+remapped; 4.4 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 203 op/s; 6973/214704 objects degraded (3.248%); 7324/214704 objects misplaced (3.411%); 7.1 MiB/s, 114 objects/s recovering 2024-02-19T21:50:57.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:56.295957+0000 mon.a (mon.0) 1721 : cluster [DBG] osdmap e437: 8 total, 8 up, 7 in 2024-02-19T21:50:57.477 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:50:57.480 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:57.480 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:50:57.581 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:50:57.612 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:58.106 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:50:58.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:57.183612+0000 mgr.y (mgr.14514) 700 : cluster [DBG] pgmap v912: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 131 active+clean, 1 active+recovery_wait+undersized+degraded+remapped, 4 active+recovering+undersized+degraded+remapped; 4.3 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 128 op/s; 6829/213795 objects degraded (3.194%); 7277/213795 objects misplaced (3.404%); 6.8 MiB/s, 108 objects/s recovering 2024-02-19T21:50:58.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:50:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:57.298127+0000 mon.a (mon.0) 1722 : cluster [DBG] osdmap e438: 8 total, 8 up, 7 in 2024-02-19T21:50:58.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:57.183612+0000 mgr.y (mgr.14514) 700 : cluster [DBG] pgmap v912: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 131 active+clean, 1 active+recovery_wait+undersized+degraded+remapped, 4 active+recovering+undersized+degraded+remapped; 4.3 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 128 op/s; 6829/213795 objects degraded (3.194%); 7277/213795 objects misplaced (3.404%); 6.8 MiB/s, 108 objects/s recovering 2024-02-19T21:50:58.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:50:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:57.298127+0000 mon.a (mon.0) 1722 : cluster [DBG] osdmap e438: 8 total, 8 up, 7 in 2024-02-19T21:50:58.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:57.183612+0000 mgr.y (mgr.14514) 700 : cluster [DBG] pgmap v912: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 131 active+clean, 1 active+recovery_wait+undersized+degraded+remapped, 4 active+recovering+undersized+degraded+remapped; 4.3 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 128 op/s; 6829/213795 objects degraded (3.194%); 7277/213795 objects misplaced (3.404%); 6.8 MiB/s, 108 objects/s recovering 2024-02-19T21:50:58.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:50:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:57.298127+0000 mon.a (mon.0) 1722 : cluster [DBG] osdmap e438: 8 total, 8 up, 7 in 2024-02-19T21:50:58.562 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:50:58.570 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:58.570 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:50:58.671 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:50:58.703 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:58.869 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:50:58.906 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:50:58.914 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:58.915 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:50:58.922 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:50:59.016 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:50:59.043 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:59.195 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:50:59.199 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:59.199 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:50:59.288 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset noscrub 2024-02-19T21:50:59.300 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:50:59.328 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:59.348 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:50:59.351 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:59.351 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:50:59.452 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:50:59.483 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:59.517 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:50:59.525 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:59.526 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:50:59.627 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:50:59.657 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:59.680 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:50:59.686 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:59.686 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:50:59.787 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:50:59.819 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:50:59.844 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:50:59.847 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:50:59.848 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:50:59.949 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:50:59.983 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:00.008 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:51:00.011 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:00.012 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:51:00.113 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:51:00.139 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:00.162 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:51:00.169 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:00.169 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:51:00.271 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:51:00.300 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:00.325 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:51:00.331 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:00.332 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:51:00.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:50:59.184135+0000 mgr.y (mgr.14514) 701 : cluster [DBG] pgmap v914: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 131 active+clean, 1 active+recovery_wait+undersized+degraded+remapped, 4 active+recovering+undersized+degraded+remapped; 4.3 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 945 B/s rd, 0 B/s wr, 124 op/s; 6829/213795 objects degraded (3.194%); 7277/213795 objects misplaced (3.404%); 6.3 MiB/s, 101 objects/s recovering 2024-02-19T21:51:00.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:00.283667+0000 mon.a (mon.0) 1723 : cluster [WRN] Health check update: Degraded data redundancy: 6829/213795 objects degraded (3.194%), 5 pgs degraded, 5 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:00.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:50:59.184135+0000 mgr.y (mgr.14514) 701 : cluster [DBG] pgmap v914: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 131 active+clean, 1 active+recovery_wait+undersized+degraded+remapped, 4 active+recovering+undersized+degraded+remapped; 4.3 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 945 B/s rd, 0 B/s wr, 124 op/s; 6829/213795 objects degraded (3.194%); 7277/213795 objects misplaced (3.404%); 6.3 MiB/s, 101 objects/s recovering 2024-02-19T21:51:00.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:00.283667+0000 mon.a (mon.0) 1723 : cluster [WRN] Health check update: Degraded data redundancy: 6829/213795 objects degraded (3.194%), 5 pgs degraded, 5 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:00.433 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:51:00.469 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:51:00.506 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:00.506 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:51:00.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:50:59.184135+0000 mgr.y (mgr.14514) 701 : cluster [DBG] pgmap v914: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 1 active+remapped+backfill_toofull, 131 active+clean, 1 active+recovery_wait+undersized+degraded+remapped, 4 active+recovering+undersized+degraded+remapped; 4.3 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 945 B/s rd, 0 B/s wr, 124 op/s; 6829/213795 objects degraded (3.194%); 7277/213795 objects misplaced (3.404%); 6.3 MiB/s, 101 objects/s recovering 2024-02-19T21:51:00.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:00.283667+0000 mon.a (mon.0) 1723 : cluster [WRN] Health check update: Degraded data redundancy: 6829/213795 objects degraded (3.194%), 5 pgs degraded, 5 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:00.607 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:51:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:00.655 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:51:00.658 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:00.658 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:51:00.759 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:51:00.785 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:00.806 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:51:00.808 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:00.809 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:51:00.909 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:51:00.945 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:01.095 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:51:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:51:00] "GET /metrics HTTP/1.1" 200 176548 "" "Prometheus/2.33.4" 2024-02-19T21:51:01.197 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:51:01.199 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:01.200 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:51:01.301 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:51:01.304 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:51:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:51:01.331 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:01.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:00.992720+0000 mgr.y (mgr.14514) 702 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:51:01.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:00.992720+0000 mgr.y (mgr.14514) 702 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:51:01.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:00.992720+0000 mgr.y (mgr.14514) 702 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:51:01.680 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:51:01.685 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:01.685 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:51:01.786 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:51:01.817 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:01.947 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:51:01.952 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:01.953 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:51:02.053 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:51:02.084 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:02.127 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:51:02.131 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:02.132 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:51:02.233 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:51:02.270 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:02.324 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:51:02.329 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:51:02.333 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:51:02.341 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:02.341 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:51:02.358 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:51:02.384 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:51:02.404 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:51:02.436 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:51:02.442 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:51:02.468 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:51:02.469 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:02.491 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:51:02.493 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:51:02.493 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:51:02.493 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:51:02.493 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:51:02.493 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:51:02.493 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:51:02.493 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:51:02.493 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:51:02.493 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:51:02.494 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:02.495 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:51:02.522 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:00.534333+0000 osd.6 (osd.6) 240 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:51:02.522 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:00.534373+0000 osd.6 (osd.6) 241 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:51:02.522 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:01.184898+0000 mgr.y (mgr.14514) 703 : cluster [DBG] pgmap v915: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 132 active+clean, 1 active+recovery_wait+undersized+degraded+remapped, 4 active+recovering+undersized+degraded+remapped; 4.3 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 137 op/s; 6680/212250 objects degraded (3.147%); 6826/212250 objects misplaced (3.216%); 6.8 MiB/s, 108 objects/s recovering 2024-02-19T21:51:02.522 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:01.299927+0000 mon.a (mon.0) 1724 : cluster [WRN] Health check update: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:51:02.522 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:01.308244+0000 mon.a (mon.0) 1725 : cluster [DBG] osdmap e439: 8 total, 8 up, 7 in 2024-02-19T21:51:02.522 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:02.272450+0000 mon.b (mon.1) 67 : audit [DBG] from='client.? 172.21.15.80:0/3852900832' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:51:02.522 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:00.534333+0000 osd.6 (osd.6) 240 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:51:02.522 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:00.534373+0000 osd.6 (osd.6) 241 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:51:02.522 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:01.184898+0000 mgr.y (mgr.14514) 703 : cluster [DBG] pgmap v915: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 132 active+clean, 1 active+recovery_wait+undersized+degraded+remapped, 4 active+recovering+undersized+degraded+remapped; 4.3 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 137 op/s; 6680/212250 objects degraded (3.147%); 6826/212250 objects misplaced (3.216%); 6.8 MiB/s, 108 objects/s recovering 2024-02-19T21:51:02.523 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:01.299927+0000 mon.a (mon.0) 1724 : cluster [WRN] Health check update: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:51:02.523 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:01.308244+0000 mon.a (mon.0) 1725 : cluster [DBG] osdmap e439: 8 total, 8 up, 7 in 2024-02-19T21:51:02.523 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:02.272450+0000 mon.b (mon.1) 67 : audit [DBG] from='client.? 172.21.15.80:0/3852900832' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:51:02.595 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:51:02.627 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:02.684 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:51:02.684 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:51:02.684 INFO:teuthology.orchestra.run.smithi080.stdout:{"fsid":"6f763558-cf6d-11ee-95bb-87774f69a715","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"noscrub,nodeep-scrub flag(s) set","count":20},"muted":false},"PG_BACKFILL_FULL":{"severity":"HEALTH_WARN","summary":{"message":"Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull","count":1},"muted":false},"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 6680/212250 objects degraded (3.147%), 5 pgs degraded, 5 pgs undersized","count":10},"muted":false}},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1350,"monmap":{"epoch":3,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":439,"num_osds":8,"num_up_osds":8,"osd_up_since":1708379347,"num_in_osds":7,"osd_in_since":1708379252,"num_remapped_pgs":6},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":132},{"state_name":"active+recovering+undersized+degraded+remapped","count":4},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":1},{"state_name":"active+remapped+backfill_wait+backfill_toofull","count":1}],"num_pgs":138,"num_pools":7,"num_objects":70750,"data_bytes":4624029372,"bytes_used":18455400448,"bytes_avail":653509849088,"bytes_total":671965249536,"degraded_objects":6680,"degraded_total":212250,"degraded_ratio":0.031472320376914019,"misplaced_objects":6826,"misplaced_total":212250,"misplaced_ratio":0.032160188457008243,"recovering_objects_per_sec":108,"recovering_bytes_per_sec":7097916,"recovering_keys_per_sec":0,"num_objects_recovered":650,"num_bytes_recovered":42598400,"num_keys_recovered":0,"read_bytes_sec":1706,"write_bytes_sec":0,"read_op_per_sec":1,"write_op_per_sec":136},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"services":{"dashboard":"https://172.21.15.80:8443/","prometheus":"http://172.21.15.80:9283/"}},"servicemap":{"epoch":15,"modified":"2024-02-19T21:50:07.164150+0000","services":{"rgw":{"daemons":{"summary":"","14445":{"start_epoch":12,"start_stamp":"2024-02-19T21:32:30.457944+0000","gid":14445,"addr":"172.21.15.80:0/10763483","metadata":{"arch":"x86_64","ceph_release":"pacific","ceph_version":"ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)","ceph_version_short":"16.2.14-548-g81bd20d6","container_hostname":"smithi080","container_image":"quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9","cpu":"Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz","distro":"centos","distro_description":"CentOS Stream 8","distro_version":"8","frontend_config#0":"beast port=80","frontend_type#0":"beast","hostname":"smithi080","id":"foo.a","kernel_description":"#1 SMP Mon Feb 5 18:34:56 UTC 2024","kernel_version":"4.18.0-539.el8.x86_64","mem_swap_kb":"0","mem_total_kb":"32537572","num_handles":"1","os":"Linux","pid":"7","realm_id":"","realm_name":"","zone_id":"34a855d6-dbbc-4802-a6e9-a7d60f23c9d4","zone_name":"default","zonegroup_id":"7194a06a-53d8-4b5f-8306-5954e6d460c8","zonegroup_name":"default"},"task_status":{}}}}}},"progress_events":{"0d84ec8e-b738-4996-b3e9-d3d54263ac3b":{"message":"Global Recovery Event (3m)\n [=========================...] (remaining: 16s)","progress":0.92028987407684326,"add_to_ceph_s":true}}} 2024-02-19T21:51:02.690 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:02.691 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:51:02.791 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:51:02.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:00.534333+0000 osd.6 (osd.6) 240 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:51:02.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:00.534373+0000 osd.6 (osd.6) 241 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:51:02.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:01.184898+0000 mgr.y (mgr.14514) 703 : cluster [DBG] pgmap v915: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 132 active+clean, 1 active+recovery_wait+undersized+degraded+remapped, 4 active+recovering+undersized+degraded+remapped; 4.3 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 137 op/s; 6680/212250 objects degraded (3.147%); 6826/212250 objects misplaced (3.216%); 6.8 MiB/s, 108 objects/s recovering 2024-02-19T21:51:02.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:01.299927+0000 mon.a (mon.0) 1724 : cluster [WRN] Health check update: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull (PG_BACKFILL_FULL) 2024-02-19T21:51:02.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:01.308244+0000 mon.a (mon.0) 1725 : cluster [DBG] osdmap e439: 8 total, 8 up, 7 in 2024-02-19T21:51:02.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:02.272450+0000 mon.b (mon.1) 67 : audit [DBG] from='client.? 172.21.15.80:0/3852900832' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:51:02.817 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:02.835 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:51:02.838 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:02.838 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:51:02.939 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:51:02.971 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:02.993 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:51:02.995 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:02.996 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:51:03.097 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:51:03.124 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:03.142 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:51:03.145 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:03.145 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:51:03.246 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:51:03.256 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:51:03.256 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-02-19T21:51:03.256 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-02-19T21:51:03.256 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-02-19T21:51:03.256 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:51:03.272 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:03.291 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:51:03.295 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:03.295 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:51:03.396 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:51:03.425 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:02.685178+0000 mon.b (mon.1) 68 : audit [DBG] from='client.? 172.21.15.80:0/1374799309' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-02-19T21:51:03.427 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:03.450 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:51:03.453 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:03.453 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:51:03.554 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:51:03.591 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:03.595 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:02.685178+0000 mon.b (mon.1) 68 : audit [DBG] from='client.? 172.21.15.80:0/1374799309' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-02-19T21:51:03.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:02.685178+0000 mon.b (mon.1) 68 : audit [DBG] from='client.? 172.21.15.80:0/1374799309' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-02-19T21:51:03.623 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:51:03.626 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:03.627 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:51:03.727 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:51:03.761 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:03.789 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:51:03.792 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:03.793 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:51:03.894 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:51:03.923 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:03.941 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:51:03.945 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:03.945 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:51:04.046 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:51:04.079 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:04.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:03.185451+0000 mgr.y (mgr.14514) 704 : cluster [DBG] pgmap v917: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 132 active+clean, 1 active+recovery_wait+undersized+degraded+remapped, 4 active+recovering+undersized+degraded+remapped; 4.3 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 742 B/s rd, 0 B/s wr, 101 op/s; 6631/211959 objects degraded (3.128%); 6779/211959 objects misplaced (3.198%); 5.9 MiB/s, 94 objects/s recovering 2024-02-19T21:51:04.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:03.185451+0000 mgr.y (mgr.14514) 704 : cluster [DBG] pgmap v917: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 132 active+clean, 1 active+recovery_wait+undersized+degraded+remapped, 4 active+recovering+undersized+degraded+remapped; 4.3 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 742 B/s rd, 0 B/s wr, 101 op/s; 6631/211959 objects degraded (3.128%); 6779/211959 objects misplaced (3.198%); 5.9 MiB/s, 94 objects/s recovering 2024-02-19T21:51:04.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:03.185451+0000 mgr.y (mgr.14514) 704 : cluster [DBG] pgmap v917: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 132 active+clean, 1 active+recovery_wait+undersized+degraded+remapped, 4 active+recovering+undersized+degraded+remapped; 4.3 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 742 B/s rd, 0 B/s wr, 101 op/s; 6631/211959 objects degraded (3.128%); 6779/211959 objects misplaced (3.198%); 5.9 MiB/s, 94 objects/s recovering 2024-02-19T21:51:05.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:04.327877+0000 mon.a (mon.0) 1726 : cluster [DBG] osdmap e440: 8 total, 8 up, 7 in 2024-02-19T21:51:05.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:05.284700+0000 mon.a (mon.0) 1727 : cluster [WRN] Health check update: Degraded data redundancy: 6631/211959 objects degraded (3.128%), 5 pgs degraded, 5 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:05.806 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:51:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:51:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:51:05.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:04.327877+0000 mon.a (mon.0) 1726 : cluster [DBG] osdmap e440: 8 total, 8 up, 7 in 2024-02-19T21:51:05.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:05.284700+0000 mon.a (mon.0) 1727 : cluster [WRN] Health check update: Degraded data redundancy: 6631/211959 objects degraded (3.128%), 5 pgs degraded, 5 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:05.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:04.327877+0000 mon.a (mon.0) 1726 : cluster [DBG] osdmap e440: 8 total, 8 up, 7 in 2024-02-19T21:51:05.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:05.284700+0000 mon.a (mon.0) 1727 : cluster [WRN] Health check update: Degraded data redundancy: 6631/211959 objects degraded (3.128%), 5 pgs degraded, 5 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:06.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:05.186011+0000 mgr.y (mgr.14514) 705 : cluster [DBG] pgmap v919: 138 pgs: 1 peering, 1 active+remapped+backfill_wait+backfill_toofull, 132 active+clean, 1 active+recovery_wait+undersized+degraded+remapped, 3 active+recovering+undersized+degraded+remapped; 4.3 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 648 B/s rd, 0 B/s wr, 133 op/s; 6574/210645 objects degraded (3.121%); 6298/210645 objects misplaced (2.990%); 9.0 MiB/s, 144 objects/s recovering 2024-02-19T21:51:06.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:05.392985+0000 mon.a (mon.0) 1728 : cluster [DBG] osdmap e441: 8 total, 8 up, 7 in 2024-02-19T21:51:06.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:05.186011+0000 mgr.y (mgr.14514) 705 : cluster [DBG] pgmap v919: 138 pgs: 1 peering, 1 active+remapped+backfill_wait+backfill_toofull, 132 active+clean, 1 active+recovery_wait+undersized+degraded+remapped, 3 active+recovering+undersized+degraded+remapped; 4.3 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 648 B/s rd, 0 B/s wr, 133 op/s; 6574/210645 objects degraded (3.121%); 6298/210645 objects misplaced (2.990%); 9.0 MiB/s, 144 objects/s recovering 2024-02-19T21:51:06.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:05.392985+0000 mon.a (mon.0) 1728 : cluster [DBG] osdmap e441: 8 total, 8 up, 7 in 2024-02-19T21:51:06.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:05.186011+0000 mgr.y (mgr.14514) 705 : cluster [DBG] pgmap v919: 138 pgs: 1 peering, 1 active+remapped+backfill_wait+backfill_toofull, 132 active+clean, 1 active+recovery_wait+undersized+degraded+remapped, 3 active+recovering+undersized+degraded+remapped; 4.3 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 648 B/s rd, 0 B/s wr, 133 op/s; 6574/210645 objects degraded (3.121%); 6298/210645 objects misplaced (2.990%); 9.0 MiB/s, 144 objects/s recovering 2024-02-19T21:51:06.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:05.392985+0000 mon.a (mon.0) 1728 : cluster [DBG] osdmap e441: 8 total, 8 up, 7 in 2024-02-19T21:51:08.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:07.186420+0000 mgr.y (mgr.14514) 706 : cluster [DBG] pgmap v921: 138 pgs: 1 peering, 1 active+remapped+backfill_wait+backfill_toofull, 132 active+clean, 4 active+recovering+undersized+degraded+remapped; 4.3 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 144 op/s; 2728/209670 objects degraded (1.301%); 9934/209670 objects misplaced (4.738%); 7.2 MiB/s, 115 objects/s recovering 2024-02-19T21:51:08.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:07.186420+0000 mgr.y (mgr.14514) 706 : cluster [DBG] pgmap v921: 138 pgs: 1 peering, 1 active+remapped+backfill_wait+backfill_toofull, 132 active+clean, 4 active+recovering+undersized+degraded+remapped; 4.3 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 144 op/s; 2728/209670 objects degraded (1.301%); 9934/209670 objects misplaced (4.738%); 7.2 MiB/s, 115 objects/s recovering 2024-02-19T21:51:08.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:07.186420+0000 mgr.y (mgr.14514) 706 : cluster [DBG] pgmap v921: 138 pgs: 1 peering, 1 active+remapped+backfill_wait+backfill_toofull, 132 active+clean, 4 active+recovering+undersized+degraded+remapped; 4.3 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 144 op/s; 2728/209670 objects degraded (1.301%); 9934/209670 objects misplaced (4.738%); 7.2 MiB/s, 115 objects/s recovering 2024-02-19T21:51:10.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:09.187473+0000 mgr.y (mgr.14514) 707 : cluster [DBG] pgmap v922: 138 pgs: 1 peering, 1 active+remapped+backfill_wait+backfill_toofull, 132 active+clean, 4 active+recovering+undersized+degraded+remapped; 4.3 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 649 B/s rd, 0 B/s wr, 109 op/s; 2728/209670 objects degraded (1.301%); 9934/209670 objects misplaced (4.738%); 5.5 MiB/s, 87 objects/s recovering 2024-02-19T21:51:10.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:10.286325+0000 mon.a (mon.0) 1729 : cluster [WRN] Health check update: Degraded data redundancy: 2728/209670 objects degraded (1.301%), 4 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:10.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:10.291056+0000 mon.a (mon.0) 1730 : cluster [DBG] osdmap e442: 8 total, 8 up, 7 in 2024-02-19T21:51:10.772 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:51:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:51:10] "GET /metrics HTTP/1.1" 200 176560 "" "Prometheus/2.33.4" 2024-02-19T21:51:10.773 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:09.187473+0000 mgr.y (mgr.14514) 707 : cluster [DBG] pgmap v922: 138 pgs: 1 peering, 1 active+remapped+backfill_wait+backfill_toofull, 132 active+clean, 4 active+recovering+undersized+degraded+remapped; 4.3 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 649 B/s rd, 0 B/s wr, 109 op/s; 2728/209670 objects degraded (1.301%); 9934/209670 objects misplaced (4.738%); 5.5 MiB/s, 87 objects/s recovering 2024-02-19T21:51:10.773 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:10.286325+0000 mon.a (mon.0) 1729 : cluster [WRN] Health check update: Degraded data redundancy: 2728/209670 objects degraded (1.301%), 4 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:10.773 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:10.291056+0000 mon.a (mon.0) 1730 : cluster [DBG] osdmap e442: 8 total, 8 up, 7 in 2024-02-19T21:51:10.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:09.187473+0000 mgr.y (mgr.14514) 707 : cluster [DBG] pgmap v922: 138 pgs: 1 peering, 1 active+remapped+backfill_wait+backfill_toofull, 132 active+clean, 4 active+recovering+undersized+degraded+remapped; 4.3 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 649 B/s rd, 0 B/s wr, 109 op/s; 2728/209670 objects degraded (1.301%); 9934/209670 objects misplaced (4.738%); 5.5 MiB/s, 87 objects/s recovering 2024-02-19T21:51:10.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:10.286325+0000 mon.a (mon.0) 1729 : cluster [WRN] Health check update: Degraded data redundancy: 2728/209670 objects degraded (1.301%), 4 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:10.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:10.291056+0000 mon.a (mon.0) 1730 : cluster [DBG] osdmap e442: 8 total, 8 up, 7 in 2024-02-19T21:51:11.306 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:51:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:51:11.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:11.002780+0000 mgr.y (mgr.14514) 708 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:51:11.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:11.002780+0000 mgr.y (mgr.14514) 708 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:51:11.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:11.002780+0000 mgr.y (mgr.14514) 708 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:51:12.539 INFO:tasks.cephadm.ceph_manager.ceph:making progress, resetting timeout 2024-02-19T21:51:12.539 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:51:12.657 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:11.188006+0000 mgr.y (mgr.14514) 709 : cluster [DBG] pgmap v924: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 133 active+clean, 4 active+recovering+undersized+degraded+remapped; 4.2 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 203 op/s; 2611/207801 objects degraded (1.256%); 9290/207801 objects misplaced (4.471%); 12 MiB/s, 196 objects/s recovering 2024-02-19T21:51:12.657 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:11.188006+0000 mgr.y (mgr.14514) 709 : cluster [DBG] pgmap v924: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 133 active+clean, 4 active+recovering+undersized+degraded+remapped; 4.2 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 203 op/s; 2611/207801 objects degraded (1.256%); 9290/207801 objects misplaced (4.471%); 12 MiB/s, 196 objects/s recovering 2024-02-19T21:51:12.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:11.188006+0000 mgr.y (mgr.14514) 709 : cluster [DBG] pgmap v924: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 133 active+clean, 4 active+recovering+undersized+degraded+remapped; 4.2 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 203 op/s; 2611/207801 objects degraded (1.256%); 9290/207801 objects misplaced (4.471%); 12 MiB/s, 196 objects/s recovering 2024-02-19T21:51:13.230 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:51:13.237 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:51:13.247 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:13.248 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:51:13.261 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.1 dump_historic_ops 2024-02-19T21:51:13.348 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:51:13.378 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:13.531 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:51:13.534 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:13.534 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:51:13.549 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:51:13.635 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:51:13.663 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:13.683 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:51:13.688 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:13.688 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:51:13.789 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:51:13.819 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:13.847 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:51:13.853 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:13.853 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:51:13.954 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:51:13.981 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:14.000 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:51:14.002 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:14.002 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:51:14.103 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:51:14.130 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:14.149 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:51:14.152 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:14.152 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:51:14.253 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:51:14.287 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:14.314 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:51:14.322 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:14.322 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:51:14.423 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:51:14.453 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:14.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:13.188542+0000 mgr.y (mgr.14514) 710 : cluster [DBG] pgmap v925: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 133 active+clean, 4 active+recovering+undersized+degraded+remapped; 4.2 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 131 op/s; 2559/207528 objects degraded (1.233%); 9239/207528 objects misplaced (4.452%); 6.7 MiB/s, 107 objects/s recovering 2024-02-19T21:51:14.684 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:51:14.923 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:13.188542+0000 mgr.y (mgr.14514) 710 : cluster [DBG] pgmap v925: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 133 active+clean, 4 active+recovering+undersized+degraded+remapped; 4.2 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 131 op/s; 2559/207528 objects degraded (1.233%); 9239/207528 objects misplaced (4.452%); 6.7 MiB/s, 107 objects/s recovering 2024-02-19T21:51:14.924 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:13.188542+0000 mgr.y (mgr.14514) 710 : cluster [DBG] pgmap v925: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 133 active+clean, 4 active+recovering+undersized+degraded+remapped; 4.2 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 131 op/s; 2559/207528 objects degraded (1.233%); 9239/207528 objects misplaced (4.452%); 6.7 MiB/s, 107 objects/s recovering 2024-02-19T21:51:15.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:15.287758+0000 mon.a (mon.0) 1731 : cluster [WRN] Health check update: Degraded data redundancy: 2559/207528 objects degraded (1.233%), 4 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:15.806 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:51:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:51:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:51:15.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:15.287758+0000 mon.a (mon.0) 1731 : cluster [WRN] Health check update: Degraded data redundancy: 2559/207528 objects degraded (1.233%), 4 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:15.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:15.287758+0000 mon.a (mon.0) 1731 : cluster [WRN] Health check update: Degraded data redundancy: 2559/207528 objects degraded (1.233%), 4 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:16.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:15.189136+0000 mgr.y (mgr.14514) 711 : cluster [DBG] pgmap v926: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 133 active+clean, 4 active+recovering+undersized+degraded+remapped; 4.2 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 522 B/s rd, 0 B/s wr, 123 op/s; 2501/206352 objects degraded (1.212%); 8553/206352 objects misplaced (4.145%); 9.9 MiB/s, 157 objects/s recovering 2024-02-19T21:51:16.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:15.189136+0000 mgr.y (mgr.14514) 711 : cluster [DBG] pgmap v926: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 133 active+clean, 4 active+recovering+undersized+degraded+remapped; 4.2 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 522 B/s rd, 0 B/s wr, 123 op/s; 2501/206352 objects degraded (1.212%); 8553/206352 objects misplaced (4.145%); 9.9 MiB/s, 157 objects/s recovering 2024-02-19T21:51:16.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:15.189136+0000 mgr.y (mgr.14514) 711 : cluster [DBG] pgmap v926: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 133 active+clean, 4 active+recovering+undersized+degraded+remapped; 4.2 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 522 B/s rd, 0 B/s wr, 123 op/s; 2501/206352 objects degraded (1.212%); 8553/206352 objects misplaced (4.145%); 9.9 MiB/s, 157 objects/s recovering 2024-02-19T21:51:16.903 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:51:16.907 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:16.907 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:51:17.008 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:51:17.041 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:17.501 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:51:17.505 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:17.505 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:51:17.606 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:51:17.637 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:17.662 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:51:17.664 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:17.665 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:51:17.766 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:51:17.793 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:16.430158+0000 osd.1 (osd.1) 246 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:51:17.793 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:16.430211+0000 osd.1 (osd.1) 247 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:51:17.793 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:16.430158+0000 osd.1 (osd.1) 246 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:51:17.793 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:16.430211+0000 osd.1 (osd.1) 247 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:51:17.795 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:17.805 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:16.430158+0000 osd.1 (osd.1) 246 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:51:17.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:16.430211+0000 osd.1 (osd.1) 247 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:51:17.818 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:51:17.821 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:17.821 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:51:17.871 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:51:17.921 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:51:17.951 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:17.973 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:51:17.976 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:17.976 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:51:18.077 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:51:18.118 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:18.323 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:51:18.325 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:51:18.436 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:17.189707+0000 mgr.y (mgr.14514) 712 : cluster [DBG] pgmap v927: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 133 active+clean, 4 active+recovering+undersized+degraded+remapped; 4.2 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 145 op/s; 2391/205347 objects degraded (1.164%); 8443/205347 objects misplaced (4.112%); 10 MiB/s, 160 objects/s recovering 2024-02-19T21:51:18.436 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:17.436722+0000 mon.a (mon.0) 1732 : cluster [DBG] osdmap e443: 8 total, 8 up, 7 in 2024-02-19T21:51:18.439 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:17.189707+0000 mgr.y (mgr.14514) 712 : cluster [DBG] pgmap v927: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 133 active+clean, 4 active+recovering+undersized+degraded+remapped; 4.2 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 145 op/s; 2391/205347 objects degraded (1.164%); 8443/205347 objects misplaced (4.112%); 10 MiB/s, 160 objects/s recovering 2024-02-19T21:51:18.440 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:17.436722+0000 mon.a (mon.0) 1732 : cluster [DBG] osdmap e443: 8 total, 8 up, 7 in 2024-02-19T21:51:18.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:17.189707+0000 mgr.y (mgr.14514) 712 : cluster [DBG] pgmap v927: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 133 active+clean, 4 active+recovering+undersized+degraded+remapped; 4.2 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 145 op/s; 2391/205347 objects degraded (1.164%); 8443/205347 objects misplaced (4.112%); 10 MiB/s, 160 objects/s recovering 2024-02-19T21:51:18.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:17.436722+0000 mon.a (mon.0) 1732 : cluster [DBG] osdmap e443: 8 total, 8 up, 7 in 2024-02-19T21:51:19.474 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:51:19.477 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:19.477 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:51:19.578 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:51:19.664 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:19.695 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:18.306843+0000 mgr.y (mgr.14514) 713 : audit [DBG] from='client.25703 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:51:19.695 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:18.306843+0000 mgr.y (mgr.14514) 713 : audit [DBG] from='client.25703 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:51:19.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:18.306843+0000 mgr.y (mgr.14514) 713 : audit [DBG] from='client.25703 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:51:20.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:19.190078+0000 mgr.y (mgr.14514) 714 : cluster [DBG] pgmap v929: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 133 active+clean, 4 active+recovering+undersized+degraded+remapped; 4.2 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 575 B/s rd, 0 B/s wr, 102 op/s; 2391/205347 objects degraded (1.164%); 8443/205347 objects misplaced (4.112%); 6.8 MiB/s, 108 objects/s recovering 2024-02-19T21:51:20.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:20.288849+0000 mon.a (mon.0) 1733 : cluster [WRN] Health check update: Degraded data redundancy: 2391/205347 objects degraded (1.164%), 4 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:20.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:20.295117+0000 mon.a (mon.0) 1734 : cluster [DBG] osdmap e444: 8 total, 8 up, 7 in 2024-02-19T21:51:20.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:19.190078+0000 mgr.y (mgr.14514) 714 : cluster [DBG] pgmap v929: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 133 active+clean, 4 active+recovering+undersized+degraded+remapped; 4.2 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 575 B/s rd, 0 B/s wr, 102 op/s; 2391/205347 objects degraded (1.164%); 8443/205347 objects misplaced (4.112%); 6.8 MiB/s, 108 objects/s recovering 2024-02-19T21:51:20.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:20.288849+0000 mon.a (mon.0) 1733 : cluster [WRN] Health check update: Degraded data redundancy: 2391/205347 objects degraded (1.164%), 4 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:20.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:20.295117+0000 mon.a (mon.0) 1734 : cluster [DBG] osdmap e444: 8 total, 8 up, 7 in 2024-02-19T21:51:20.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:19.190078+0000 mgr.y (mgr.14514) 714 : cluster [DBG] pgmap v929: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 133 active+clean, 4 active+recovering+undersized+degraded+remapped; 4.2 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 575 B/s rd, 0 B/s wr, 102 op/s; 2391/205347 objects degraded (1.164%); 8443/205347 objects misplaced (4.112%); 6.8 MiB/s, 108 objects/s recovering 2024-02-19T21:51:20.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:20.288849+0000 mon.a (mon.0) 1733 : cluster [WRN] Health check update: Degraded data redundancy: 2391/205347 objects degraded (1.164%), 4 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:20.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:20.295117+0000 mon.a (mon.0) 1734 : cluster [DBG] osdmap e444: 8 total, 8 up, 7 in 2024-02-19T21:51:20.917 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":928,"stamp":"2024-02-19T21:51:17.434259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4473231036,"num_objects":68449,"num_object_clones":0,"num_object_copies":205347,"num_objects_missing_on_primary":699,"num_objects_missing":699,"num_objects_degraded":2391,"num_objects_misplaced":8443,"num_objects_unfound":0,"num_objects_dirty":68449,"num_whiteouts":0,"num_read":2236,"num_read_kb":1988,"num_write":81951,"num_write_kb":4783849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8442,"num_bytes_recovered":534322056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80684,"ondisk_log_size":80684,"up":414,"acting":410,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":417,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":656216064,"kb_used":17720480,"kb_used_data":13238440,"kb_used_omap":0,"kb_used_meta":4481983,"kb_avail":638495584,"statfs":{"total":671965249536,"available":653819478016,"internally_reserved":0,"allocated":13556162560,"data_stored":13547218193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":4589550644},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,0,0,2,1,1,3,5,7],"upper_bound":4096},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-94437376,"num_objects":-1441,"num_object_clones":0,"num_object_copies":-4323,"num_objects_missing_on_primary":-103,"num_objects_missing":-103,"num_objects_degraded":-337,"num_objects_misplaced":-1491,"num_objects_unfound":0,"num_objects_dirty":-1441,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":1441,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1607,"num_bytes_recovered":105316352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.247099"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":38,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.398787+0000","last_change":"2024-02-19T21:49:54.492937+0000","last_active":"2024-02-19T21:51:05.398787+0000","last_peered":"2024-02-19T21:51:05.398787+0000","last_clean":"2024-02-19T21:51:05.398787+0000","last_became_active":"2024-02-19T21:49:54.492544+0000","last_became_peered":"2024-02-19T21:49:54.492544+0000","last_unstale":"2024-02-19T21:51:05.398787+0000","last_undegraded":"2024-02-19T21:51:05.398787+0000","last_fullsized":"2024-02-19T21:51:05.398787+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.643236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.643236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":417,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.397226+0000","last_change":"2024-02-19T21:45:17.201007+0000","last_active":"2024-02-19T21:51:05.397226+0000","last_peered":"2024-02-19T21:51:05.397226+0000","last_clean":"2024-02-19T21:51:05.397226+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:51:05.397226+0000","last_undegraded":"2024-02-19T21:51:05.397226+0000","last_fullsized":"2024-02-19T21:51:05.397226+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:17.200897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:17.200897+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"201'27","reported_seq":86,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.392059+0000","last_change":"2024-02-19T21:49:08.327817+0000","last_active":"2024-02-19T21:51:05.392059+0000","last_peered":"2024-02-19T21:51:05.392059+0000","last_clean":"2024-02-19T21:51:05.392059+0000","last_became_active":"2024-02-19T21:49:08.327416+0000","last_became_peered":"2024-02-19T21:49:08.327416+0000","last_unstale":"2024-02-19T21:51:05.392059+0000","last_undegraded":"2024-02-19T21:51:05.392059+0000","last_fullsized":"2024-02-19T21:51:05.392059+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'27","last_scrub_stamp":"2024-02-19T21:44:48.022013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:48.022013+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":390,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.395838+0000","last_change":"2024-02-19T21:48:30.516215+0000","last_active":"2024-02-19T21:51:05.395838+0000","last_peered":"2024-02-19T21:51:05.395838+0000","last_clean":"2024-02-19T21:51:05.395838+0000","last_became_active":"2024-02-19T21:47:46.250178+0000","last_became_peered":"2024-02-19T21:47:46.250178+0000","last_unstale":"2024-02-19T21:51:05.395838+0000","last_undegraded":"2024-02-19T21:51:05.395838+0000","last_fullsized":"2024-02-19T21:51:05.395838+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.516139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.516139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":113,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.397196+0000","last_change":"2024-02-19T21:49:08.330105+0000","last_active":"2024-02-19T21:51:05.397196+0000","last_peered":"2024-02-19T21:51:05.397196+0000","last_clean":"2024-02-19T21:51:05.397196+0000","last_became_active":"2024-02-19T21:49:08.328994+0000","last_became_peered":"2024-02-19T21:49:08.328994+0000","last_unstale":"2024-02-19T21:51:05.397196+0000","last_undegraded":"2024-02-19T21:51:05.397196+0000","last_fullsized":"2024-02-19T21:51:05.397196+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.636083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.636083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"200'19","reported_seq":486,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.395989+0000","last_change":"2024-02-19T21:48:26.530234+0000","last_active":"2024-02-19T21:51:05.395989+0000","last_peered":"2024-02-19T21:51:05.395989+0000","last_clean":"2024-02-19T21:51:05.395989+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:51:05.395989+0000","last_undegraded":"2024-02-19T21:51:05.395989+0000","last_fullsized":"2024-02-19T21:51:05.395989+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:48:26.530160+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.530160+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":174,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.391110+0000","last_change":"2024-02-19T21:49:08.332091+0000","last_active":"2024-02-19T21:51:05.391110+0000","last_peered":"2024-02-19T21:51:05.391110+0000","last_clean":"2024-02-19T21:51:05.391110+0000","last_became_active":"2024-02-19T21:49:08.331753+0000","last_became_peered":"2024-02-19T21:49:08.331753+0000","last_unstale":"2024-02-19T21:51:05.391110+0000","last_undegraded":"2024-02-19T21:51:05.391110+0000","last_fullsized":"2024-02-19T21:51:05.391110+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.005236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.005236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":430,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.400605+0000","last_change":"2024-02-19T21:48:28.327028+0000","last_active":"2024-02-19T21:51:05.400605+0000","last_peered":"2024-02-19T21:51:05.400605+0000","last_clean":"2024-02-19T21:51:05.400605+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:51:05.400605+0000","last_undegraded":"2024-02-19T21:51:05.400605+0000","last_fullsized":"2024-02-19T21:51:05.400605+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.326938+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"310'9","reported_seq":384,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.396361+0000","last_change":"2024-02-19T21:49:08.329655+0000","last_active":"2024-02-19T21:51:05.396361+0000","last_peered":"2024-02-19T21:51:05.396361+0000","last_clean":"2024-02-19T21:51:05.396361+0000","last_became_active":"2024-02-19T21:49:08.329314+0000","last_became_peered":"2024-02-19T21:49:08.329314+0000","last_unstale":"2024-02-19T21:51:05.396361+0000","last_undegraded":"2024-02-19T21:51:05.396361+0000","last_fullsized":"2024-02-19T21:51:05.396361+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"310'9","last_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_deep_scrub":"310'9","last_deep_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.506188+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":351,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.397553+0000","last_change":"2024-02-19T21:46:31.205220+0000","last_active":"2024-02-19T21:51:05.397553+0000","last_peered":"2024-02-19T21:51:05.397553+0000","last_clean":"2024-02-19T21:51:05.397553+0000","last_became_active":"2024-02-19T21:46:31.204816+0000","last_became_peered":"2024-02-19T21:46:31.204816+0000","last_unstale":"2024-02-19T21:51:05.397553+0000","last_undegraded":"2024-02-19T21:51:05.397553+0000","last_fullsized":"2024-02-19T21:51:05.397553+0000","mapping_epoch":330,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":331,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:36.890201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.890201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":452,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.399669+0000","last_change":"2024-02-19T21:49:08.330669+0000","last_active":"2024-02-19T21:51:05.399669+0000","last_peered":"2024-02-19T21:51:05.399669+0000","last_clean":"2024-02-19T21:51:05.399669+0000","last_became_active":"2024-02-19T21:49:08.329998+0000","last_became_peered":"2024-02-19T21:49:08.329998+0000","last_unstale":"2024-02-19T21:51:05.399669+0000","last_undegraded":"2024-02-19T21:51:05.399669+0000","last_fullsized":"2024-02-19T21:51:05.399669+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:58.329316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:58.329316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"200'19","reported_seq":296,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.396029+0000","last_change":"2024-02-19T21:49:08.326162+0000","last_active":"2024-02-19T21:51:05.396029+0000","last_peered":"2024-02-19T21:51:05.396029+0000","last_clean":"2024-02-19T21:51:05.396029+0000","last_became_active":"2024-02-19T21:49:08.325802+0000","last_became_peered":"2024-02-19T21:49:08.325802+0000","last_unstale":"2024-02-19T21:51:05.396029+0000","last_undegraded":"2024-02-19T21:51:05.396029+0000","last_fullsized":"2024-02-19T21:51:05.396029+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:46:54.873416+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:46:54.873416+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2],"acting":[4,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":362,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.394207+0000","last_change":"2024-02-19T21:49:04.432817+0000","last_active":"2024-02-19T21:51:05.394207+0000","last_peered":"2024-02-19T21:51:05.394207+0000","last_clean":"2024-02-19T21:51:05.394207+0000","last_became_active":"2024-02-19T21:47:33.393708+0000","last_became_peered":"2024-02-19T21:47:33.393708+0000","last_unstale":"2024-02-19T21:51:05.394207+0000","last_undegraded":"2024-02-19T21:51:05.394207+0000","last_fullsized":"2024-02-19T21:51:05.394207+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:04.432733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:04.432733+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":38,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.398853+0000","last_change":"2024-02-19T21:49:54.492767+0000","last_active":"2024-02-19T21:51:05.398853+0000","last_peered":"2024-02-19T21:51:05.398853+0000","last_clean":"2024-02-19T21:51:05.398853+0000","last_became_active":"2024-02-19T21:49:54.491745+0000","last_became_peered":"2024-02-19T21:49:54.491745+0000","last_unstale":"2024-02-19T21:51:05.398853+0000","last_undegraded":"2024-02-19T21:51:05.398853+0000","last_fullsized":"2024-02-19T21:51:05.398853+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.232539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.232539+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1d","version":"201'18","reported_seq":380,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.394871+0000","last_change":"2024-02-19T21:48:25.734661+0000","last_active":"2024-02-19T21:51:05.394871+0000","last_peered":"2024-02-19T21:51:05.394871+0000","last_clean":"2024-02-19T21:51:05.394871+0000","last_became_active":"2024-02-19T21:38:31.247067+0000","last_became_peered":"2024-02-19T21:38:31.247067+0000","last_unstale":"2024-02-19T21:51:05.394871+0000","last_undegraded":"2024-02-19T21:51:05.394871+0000","last_fullsized":"2024-02-19T21:51:05.394871+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'18","last_scrub_stamp":"2024-02-19T21:48:25.734591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.734591+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":417,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.396943+0000","last_change":"2024-02-19T21:48:40.528082+0000","last_active":"2024-02-19T21:51:05.396943+0000","last_peered":"2024-02-19T21:51:05.396943+0000","last_clean":"2024-02-19T21:51:05.396943+0000","last_became_active":"2024-02-19T21:44:58.788307+0000","last_became_peered":"2024-02-19T21:44:58.788307+0000","last_unstale":"2024-02-19T21:51:05.396943+0000","last_undegraded":"2024-02-19T21:51:05.396943+0000","last_fullsized":"2024-02-19T21:51:05.396943+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:40.527970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:48:40.527970+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":425,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.394005+0000","last_change":"2024-02-19T21:48:11.557832+0000","last_active":"2024-02-19T21:51:05.394005+0000","last_peered":"2024-02-19T21:51:05.394005+0000","last_clean":"2024-02-19T21:51:05.394005+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:51:05.394005+0000","last_undegraded":"2024-02-19T21:51:05.394005+0000","last_fullsized":"2024-02-19T21:51:05.394005+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.557736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:17.913620+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.557736+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"200'34","reported_seq":87,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.393054+0000","last_change":"2024-02-19T21:49:08.332575+0000","last_active":"2024-02-19T21:51:05.393054+0000","last_peered":"2024-02-19T21:51:05.393054+0000","last_clean":"2024-02-19T21:51:05.393054+0000","last_became_active":"2024-02-19T21:49:08.331742+0000","last_became_peered":"2024-02-19T21:49:08.331742+0000","last_unstale":"2024-02-19T21:51:05.393054+0000","last_undegraded":"2024-02-19T21:51:05.393054+0000","last_fullsized":"2024-02-19T21:51:05.393054+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'34","last_scrub_stamp":"2024-02-19T21:45:49.728734+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:45:49.728734+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":437,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.394540+0000","last_change":"2024-02-19T21:46:44.994389+0000","last_active":"2024-02-19T21:51:05.394540+0000","last_peered":"2024-02-19T21:51:05.394540+0000","last_clean":"2024-02-19T21:51:05.394540+0000","last_became_active":"2024-02-19T21:44:58.790669+0000","last_became_peered":"2024-02-19T21:44:58.790669+0000","last_unstale":"2024-02-19T21:51:05.394540+0000","last_undegraded":"2024-02-19T21:51:05.394540+0000","last_fullsized":"2024-02-19T21:51:05.394540+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.994296+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":373,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.393545+0000","last_change":"2024-02-19T21:49:08.330330+0000","last_active":"2024-02-19T21:51:05.393545+0000","last_peered":"2024-02-19T21:51:05.393545+0000","last_clean":"2024-02-19T21:51:05.393545+0000","last_became_active":"2024-02-19T21:49:08.329986+0000","last_became_peered":"2024-02-19T21:49:08.329986+0000","last_unstale":"2024-02-19T21:51:05.393545+0000","last_undegraded":"2024-02-19T21:51:05.393545+0000","last_fullsized":"2024-02-19T21:51:05.393545+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.091409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.091409+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"201'19","reported_seq":321,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.397237+0000","last_change":"2024-02-19T21:48:26.366639+0000","last_active":"2024-02-19T21:51:05.397237+0000","last_peered":"2024-02-19T21:51:05.397237+0000","last_clean":"2024-02-19T21:51:05.397237+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:51:05.397237+0000","last_undegraded":"2024-02-19T21:51:05.397237+0000","last_fullsized":"2024-02-19T21:51:05.397237+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:26.366563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.366563+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":285,"reported_epoch":441,"state":"active+remapped+backfill_wait+backfill_toofull","last_fresh":"2024-02-19T21:51:05.399291+0000","last_change":"2024-02-19T21:49:38.335602+0000","last_active":"2024-02-19T21:51:05.399291+0000","last_peered":"2024-02-19T21:51:05.399291+0000","last_clean":"2024-02-19T21:49:06.309838+0000","last_became_active":"2024-02-19T21:49:08.329545+0000","last_became_peered":"2024-02-19T21:49:08.329545+0000","last_unstale":"2024-02-19T21:51:05.399291+0000","last_undegraded":"2024-02-19T21:51:05.399291+0000","last_fullsized":"2024-02-19T21:51:05.399291+0000","mapping_epoch":394,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":371,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:13.196112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:13.196112+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,3],"avail_no_missing":["7","3","5"],"object_location_counts":[{"shards":"3,5,7","objects":1}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":437,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.391144+0000","last_change":"2024-02-19T21:49:54.491840+0000","last_active":"2024-02-19T21:51:05.391144+0000","last_peered":"2024-02-19T21:51:05.391144+0000","last_clean":"2024-02-19T21:51:05.391144+0000","last_became_active":"2024-02-19T21:49:54.491488+0000","last_became_peered":"2024-02-19T21:49:54.491488+0000","last_unstale":"2024-02-19T21:51:05.391144+0000","last_undegraded":"2024-02-19T21:51:05.391144+0000","last_fullsized":"2024-02-19T21:51:05.391144+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.803606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.803606+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"201'20","reported_seq":522,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.397298+0000","last_change":"2024-02-19T21:49:54.502402+0000","last_active":"2024-02-19T21:51:05.397298+0000","last_peered":"2024-02-19T21:51:05.397298+0000","last_clean":"2024-02-19T21:51:05.397298+0000","last_became_active":"2024-02-19T21:49:54.483748+0000","last_became_peered":"2024-02-19T21:49:54.483748+0000","last_unstale":"2024-02-19T21:51:05.397298+0000","last_undegraded":"2024-02-19T21:51:05.397298+0000","last_fullsized":"2024-02-19T21:51:05.397298+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:48:25.348437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.348437+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":357,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.396467+0000","last_change":"2024-02-19T21:49:08.328206+0000","last_active":"2024-02-19T21:51:05.396467+0000","last_peered":"2024-02-19T21:51:05.396467+0000","last_clean":"2024-02-19T21:51:05.396467+0000","last_became_active":"2024-02-19T21:49:08.327865+0000","last_became_peered":"2024-02-19T21:49:08.327865+0000","last_unstale":"2024-02-19T21:51:05.396467+0000","last_undegraded":"2024-02-19T21:51:05.396467+0000","last_fullsized":"2024-02-19T21:51:05.396467+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.230652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.230652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":417,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.400223+0000","last_change":"2024-02-19T21:48:22.171667+0000","last_active":"2024-02-19T21:51:05.400223+0000","last_peered":"2024-02-19T21:51:05.400223+0000","last_clean":"2024-02-19T21:51:05.400223+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:51:05.400223+0000","last_undegraded":"2024-02-19T21:51:05.400223+0000","last_fullsized":"2024-02-19T21:51:05.400223+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.171600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.171600+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":453,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.394281+0000","last_change":"2024-02-19T21:49:08.330636+0000","last_active":"2024-02-19T21:51:05.394281+0000","last_peered":"2024-02-19T21:51:05.394281+0000","last_clean":"2024-02-19T21:51:05.394281+0000","last_became_active":"2024-02-19T21:49:08.330293+0000","last_became_peered":"2024-02-19T21:49:08.330293+0000","last_unstale":"2024-02-19T21:51:05.394281+0000","last_undegraded":"2024-02-19T21:51:05.394281+0000","last_fullsized":"2024-02-19T21:51:05.394281+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:03.034839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:03.034839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"381'24","reported_seq":50,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.398005+0000","last_change":"2024-02-19T21:49:55.368481+0000","last_active":"2024-02-19T21:51:05.398005+0000","last_peered":"2024-02-19T21:51:05.398005+0000","last_clean":"2024-02-19T21:51:05.398005+0000","last_became_active":"2024-02-19T21:49:54.485438+0000","last_became_peered":"2024-02-19T21:49:54.485438+0000","last_unstale":"2024-02-19T21:51:05.398005+0000","last_undegraded":"2024-02-19T21:51:05.398005+0000","last_fullsized":"2024-02-19T21:51:05.398005+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"381'24","last_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_deep_scrub":"381'24","last_deep_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_clean_scrub_stamp":"2024-02-19T21:48:39.382725+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,5],"acting":[7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":445,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.398543+0000","last_change":"2024-02-19T21:49:17.193002+0000","last_active":"2024-02-19T21:51:05.398543+0000","last_peered":"2024-02-19T21:51:05.398543+0000","last_clean":"2024-02-19T21:51:05.398543+0000","last_became_active":"2024-02-19T21:49:08.333537+0000","last_became_peered":"2024-02-19T21:49:08.333537+0000","last_unstale":"2024-02-19T21:51:05.398543+0000","last_undegraded":"2024-02-19T21:51:05.398543+0000","last_fullsized":"2024-02-19T21:51:05.398543+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:59.339649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:45:59.339649+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":473,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.393558+0000","last_change":"2024-02-19T21:49:54.494561+0000","last_active":"2024-02-19T21:51:05.393558+0000","last_peered":"2024-02-19T21:51:05.393558+0000","last_clean":"2024-02-19T21:51:05.393558+0000","last_became_active":"2024-02-19T21:49:54.494146+0000","last_became_peered":"2024-02-19T21:49:54.494146+0000","last_unstale":"2024-02-19T21:51:05.393558+0000","last_undegraded":"2024-02-19T21:51:05.393558+0000","last_fullsized":"2024-02-19T21:51:05.393558+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.560066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":447,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.392426+0000","last_change":"2024-02-19T21:49:09.765641+0000","last_active":"2024-02-19T21:51:05.392426+0000","last_peered":"2024-02-19T21:51:05.392426+0000","last_clean":"2024-02-19T21:51:05.392426+0000","last_became_active":"2024-02-19T21:49:08.331308+0000","last_became_peered":"2024-02-19T21:49:08.331308+0000","last_unstale":"2024-02-19T21:51:05.392426+0000","last_undegraded":"2024-02-19T21:51:05.392426+0000","last_fullsized":"2024-02-19T21:51:05.392426+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.765568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.765568+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"200'8","reported_seq":134,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.394105+0000","last_change":"2024-02-19T21:47:33.577363+0000","last_active":"2024-02-19T21:51:05.394105+0000","last_peered":"2024-02-19T21:51:05.394105+0000","last_clean":"2024-02-19T21:51:05.394105+0000","last_became_active":"2024-02-19T21:47:33.395217+0000","last_became_peered":"2024-02-19T21:47:33.395217+0000","last_unstale":"2024-02-19T21:51:05.394105+0000","last_undegraded":"2024-02-19T21:51:05.394105+0000","last_fullsized":"2024-02-19T21:51:05.394105+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'8","last_scrub_stamp":"2024-02-19T21:46:47.761677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.761677+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":357,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.396206+0000","last_change":"2024-02-19T21:49:08.918163+0000","last_active":"2024-02-19T21:51:05.396206+0000","last_peered":"2024-02-19T21:51:05.396206+0000","last_clean":"2024-02-19T21:51:05.396206+0000","last_became_active":"2024-02-19T21:49:08.328416+0000","last_became_peered":"2024-02-19T21:49:08.328416+0000","last_unstale":"2024-02-19T21:51:05.396206+0000","last_undegraded":"2024-02-19T21:51:05.396206+0000","last_fullsized":"2024-02-19T21:51:05.396206+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.918083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.918083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":435,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.394751+0000","last_change":"2024-02-19T21:49:54.480716+0000","last_active":"2024-02-19T21:51:05.394751+0000","last_peered":"2024-02-19T21:51:05.394751+0000","last_clean":"2024-02-19T21:51:05.394751+0000","last_became_active":"2024-02-19T21:49:54.480368+0000","last_became_peered":"2024-02-19T21:49:54.480368+0000","last_unstale":"2024-02-19T21:51:05.394751+0000","last_undegraded":"2024-02-19T21:51:05.394751+0000","last_fullsized":"2024-02-19T21:51:05.394751+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:19.596775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:19.596775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":419,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.394456+0000","last_change":"2024-02-19T21:49:05.012463+0000","last_active":"2024-02-19T21:51:05.394456+0000","last_peered":"2024-02-19T21:51:05.394456+0000","last_clean":"2024-02-19T21:51:05.394456+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:51:05.394456+0000","last_undegraded":"2024-02-19T21:51:05.394456+0000","last_fullsized":"2024-02-19T21:51:05.394456+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.012395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.012395+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"201'19","reported_seq":466,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.396549+0000","last_change":"2024-02-19T21:48:38.529106+0000","last_active":"2024-02-19T21:51:05.396549+0000","last_peered":"2024-02-19T21:51:05.396549+0000","last_clean":"2024-02-19T21:51:05.396549+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:51:05.396549+0000","last_undegraded":"2024-02-19T21:51:05.396549+0000","last_fullsized":"2024-02-19T21:51:05.396549+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:38.528977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.528977+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":422,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.396038+0000","last_change":"2024-02-19T21:46:06.096531+0000","last_active":"2024-02-19T21:51:05.396038+0000","last_peered":"2024-02-19T21:51:05.396038+0000","last_clean":"2024-02-19T21:51:05.396038+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:51:05.396038+0000","last_undegraded":"2024-02-19T21:51:05.396038+0000","last_fullsized":"2024-02-19T21:51:05.396038+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.096422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":233,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.394190+0000","last_change":"2024-02-19T21:48:38.391532+0000","last_active":"2024-02-19T21:51:05.394190+0000","last_peered":"2024-02-19T21:51:05.394190+0000","last_clean":"2024-02-19T21:51:05.394190+0000","last_became_active":"2024-02-19T21:47:33.395085+0000","last_became_peered":"2024-02-19T21:47:33.395085+0000","last_unstale":"2024-02-19T21:51:05.394190+0000","last_undegraded":"2024-02-19T21:51:05.394190+0000","last_fullsized":"2024-02-19T21:51:05.394190+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:38.391435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.391435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":434,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.394074+0000","last_change":"2024-02-19T21:48:14.600378+0000","last_active":"2024-02-19T21:51:05.394074+0000","last_peered":"2024-02-19T21:51:05.394074+0000","last_clean":"2024-02-19T21:51:05.394074+0000","last_became_active":"2024-02-19T21:47:33.393932+0000","last_became_peered":"2024-02-19T21:47:33.393932+0000","last_unstale":"2024-02-19T21:51:05.394074+0000","last_undegraded":"2024-02-19T21:51:05.394074+0000","last_fullsized":"2024-02-19T21:51:05.394074+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:14.600285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.600285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"200'15","reported_seq":488,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.394690+0000","last_change":"2024-02-19T21:49:08.334199+0000","last_active":"2024-02-19T21:51:05.394690+0000","last_peered":"2024-02-19T21:51:05.394690+0000","last_clean":"2024-02-19T21:51:05.394690+0000","last_became_active":"2024-02-19T21:49:08.333872+0000","last_became_peered":"2024-02-19T21:49:08.333872+0000","last_unstale":"2024-02-19T21:51:05.394690+0000","last_undegraded":"2024-02-19T21:51:05.394690+0000","last_fullsized":"2024-02-19T21:51:05.394690+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:45:08.678669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:08.678669+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":400,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.396378+0000","last_change":"2024-02-19T21:49:08.330114+0000","last_active":"2024-02-19T21:51:05.396378+0000","last_peered":"2024-02-19T21:51:05.396378+0000","last_clean":"2024-02-19T21:51:05.396378+0000","last_became_active":"2024-02-19T21:49:08.329770+0000","last_became_peered":"2024-02-19T21:49:08.329770+0000","last_unstale":"2024-02-19T21:51:05.396378+0000","last_undegraded":"2024-02-19T21:51:05.396378+0000","last_fullsized":"2024-02-19T21:51:05.396378+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:08.983923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.983923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"415'17","reported_seq":58,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-02-19T21:51:10.344374+0000","last_change":"2024-02-19T21:50:49.705247+0000","last_active":"2024-02-19T21:51:10.344374+0000","last_peered":"2024-02-19T21:51:10.344374+0000","last_clean":"2024-02-19T21:51:10.344374+0000","last_became_active":"2024-02-19T21:49:54.486304+0000","last_became_peered":"2024-02-19T21:49:54.486304+0000","last_unstale":"2024-02-19T21:51:10.344374+0000","last_undegraded":"2024-02-19T21:51:10.344374+0000","last_fullsized":"2024-02-19T21:51:10.344374+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"199'13","last_scrub_stamp":"2024-02-19T21:45:05.721709+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:45:05.721709+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":444,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.396739+0000","last_change":"2024-02-19T21:49:54.484516+0000","last_active":"2024-02-19T21:51:05.396739+0000","last_peered":"2024-02-19T21:51:05.396739+0000","last_clean":"2024-02-19T21:51:05.396739+0000","last_became_active":"2024-02-19T21:49:54.483689+0000","last_became_peered":"2024-02-19T21:49:54.483689+0000","last_unstale":"2024-02-19T21:51:05.396739+0000","last_undegraded":"2024-02-19T21:51:05.396739+0000","last_fullsized":"2024-02-19T21:51:05.396739+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.157478+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"201'19","reported_seq":465,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.392062+0000","last_change":"2024-02-19T21:48:27.720048+0000","last_active":"2024-02-19T21:51:05.392062+0000","last_peered":"2024-02-19T21:51:05.392062+0000","last_clean":"2024-02-19T21:51:05.392062+0000","last_became_active":"2024-02-19T21:47:33.398295+0000","last_became_peered":"2024-02-19T21:47:33.398295+0000","last_unstale":"2024-02-19T21:51:05.392062+0000","last_undegraded":"2024-02-19T21:51:05.392062+0000","last_fullsized":"2024-02-19T21:51:05.392062+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:27.719954+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:48:27.719954+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":161,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.396917+0000","last_change":"2024-02-19T21:49:54.484392+0000","last_active":"2024-02-19T21:51:05.396917+0000","last_peered":"2024-02-19T21:51:05.396917+0000","last_clean":"2024-02-19T21:51:05.396917+0000","last_became_active":"2024-02-19T21:49:54.484049+0000","last_became_peered":"2024-02-19T21:49:54.484049+0000","last_unstale":"2024-02-19T21:51:05.396917+0000","last_undegraded":"2024-02-19T21:51:05.396917+0000","last_fullsized":"2024-02-19T21:51:05.396917+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.121769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.121769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":650,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-02-19T21:51:10.332182+0000","last_change":"2024-02-19T21:48:38.723220+0000","last_active":"2024-02-19T21:51:10.332182+0000","last_peered":"2024-02-19T21:51:10.332182+0000","last_clean":"2024-02-19T21:51:10.332182+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:51:10.332182+0000","last_undegraded":"2024-02-19T21:51:10.332182+0000","last_fullsized":"2024-02-19T21:51:10.332182+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:48:38.723151+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.723151+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":448,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.391714+0000","last_change":"2024-02-19T21:49:54.485462+0000","last_active":"2024-02-19T21:51:05.391714+0000","last_peered":"2024-02-19T21:51:05.391714+0000","last_clean":"2024-02-19T21:51:05.391714+0000","last_became_active":"2024-02-19T21:49:54.485121+0000","last_became_peered":"2024-02-19T21:49:54.485121+0000","last_unstale":"2024-02-19T21:51:05.391714+0000","last_undegraded":"2024-02-19T21:51:05.391714+0000","last_fullsized":"2024-02-19T21:51:05.391714+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:07.724097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:49:07.724097+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"201'25","reported_seq":326,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.394575+0000","last_change":"2024-02-19T21:49:08.335077+0000","last_active":"2024-02-19T21:51:05.394575+0000","last_peered":"2024-02-19T21:51:05.394575+0000","last_clean":"2024-02-19T21:51:05.394575+0000","last_became_active":"2024-02-19T21:49:08.334061+0000","last_became_peered":"2024-02-19T21:49:08.334061+0000","last_unstale":"2024-02-19T21:51:05.394575+0000","last_undegraded":"2024-02-19T21:51:05.394575+0000","last_fullsized":"2024-02-19T21:51:05.394575+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'25","last_scrub_stamp":"2024-02-19T21:46:07.553690+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.553690+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":417,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.400547+0000","last_change":"2024-02-19T21:48:21.256471+0000","last_active":"2024-02-19T21:51:05.400547+0000","last_peered":"2024-02-19T21:51:05.400547+0000","last_clean":"2024-02-19T21:51:05.400547+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:51:05.400547+0000","last_undegraded":"2024-02-19T21:51:05.400547+0000","last_fullsized":"2024-02-19T21:51:05.400547+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.256358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.256358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":424,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.393894+0000","last_change":"2024-02-19T21:46:35.035136+0000","last_active":"2024-02-19T21:51:05.393894+0000","last_peered":"2024-02-19T21:51:05.393894+0000","last_clean":"2024-02-19T21:51:05.393894+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:51:05.393894+0000","last_undegraded":"2024-02-19T21:51:05.393894+0000","last_fullsized":"2024-02-19T21:51:05.393894+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:35.035042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:35.035042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"201'12","reported_seq":46,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.400277+0000","last_change":"2024-02-19T21:50:49.700758+0000","last_active":"2024-02-19T21:51:05.400277+0000","last_peered":"2024-02-19T21:51:05.400277+0000","last_clean":"2024-02-19T21:51:05.400277+0000","last_became_active":"2024-02-19T21:49:54.478094+0000","last_became_peered":"2024-02-19T21:49:54.478094+0000","last_unstale":"2024-02-19T21:51:05.400277+0000","last_undegraded":"2024-02-19T21:51:05.400277+0000","last_fullsized":"2024-02-19T21:51:05.400277+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'12","last_scrub_stamp":"2024-02-19T21:49:08.912638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.912638+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":70,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.393255+0000","last_change":"2024-02-19T21:49:08.332757+0000","last_active":"2024-02-19T21:51:05.393255+0000","last_peered":"2024-02-19T21:51:05.393255+0000","last_clean":"2024-02-19T21:51:05.393255+0000","last_became_active":"2024-02-19T21:49:08.332176+0000","last_became_peered":"2024-02-19T21:49:08.332176+0000","last_unstale":"2024-02-19T21:51:05.393255+0000","last_undegraded":"2024-02-19T21:51:05.393255+0000","last_fullsized":"2024-02-19T21:51:05.393255+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:47:01.365477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:47:01.365477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":70,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.391203+0000","last_change":"2024-02-19T21:49:08.328632+0000","last_active":"2024-02-19T21:51:05.391203+0000","last_peered":"2024-02-19T21:51:05.391203+0000","last_clean":"2024-02-19T21:51:05.391203+0000","last_became_active":"2024-02-19T21:49:08.327826+0000","last_became_peered":"2024-02-19T21:49:08.327826+0000","last_unstale":"2024-02-19T21:51:05.391203+0000","last_undegraded":"2024-02-19T21:51:05.391203+0000","last_fullsized":"2024-02-19T21:51:05.391203+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:09.645607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:44:09.645607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"200'15","reported_seq":550,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.397195+0000","last_change":"2024-02-19T21:50:49.704824+0000","last_active":"2024-02-19T21:51:05.397195+0000","last_peered":"2024-02-19T21:51:05.397195+0000","last_clean":"2024-02-19T21:51:05.397195+0000","last_became_active":"2024-02-19T21:49:54.483578+0000","last_became_peered":"2024-02-19T21:49:54.483578+0000","last_unstale":"2024-02-19T21:51:05.397195+0000","last_undegraded":"2024-02-19T21:51:05.397195+0000","last_fullsized":"2024-02-19T21:51:05.397195+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:44:53.072746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:53.072746+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"442'5156","reported_seq":5783,"reported_epoch":442,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:51:15.083170+0000","last_change":"2024-02-19T21:50:38.722849+0000","last_active":"2024-02-19T21:51:15.083170+0000","last_peered":"2024-02-19T21:51:15.083170+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:09.770699+0000","last_became_peered":"2024-02-19T21:49:09.770699+0000","last_unstale":"2024-02-19T21:51:15.083170+0000","last_undegraded":"2024-02-19T21:49:09.328794+0000","last_fullsized":"2024-02-19T21:49:09.325036+0000","mapping_epoch":395,"log_start":"392'300","ondisk_log_start":"392'300","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4856,"ondisk_log_size":4856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":282853376,"num_objects":4316,"num_object_clones":0,"num_object_copies":12948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":830,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4316,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5156,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":278,"num_bytes_recovered":18219008,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5],"avail_no_missing":["6","5"],"object_location_counts":[{"shards":"5,6","objects":3486}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":38,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.398716+0000","last_change":"2024-02-19T21:49:54.492844+0000","last_active":"2024-02-19T21:51:05.398716+0000","last_peered":"2024-02-19T21:51:05.398716+0000","last_clean":"2024-02-19T21:51:05.398716+0000","last_became_active":"2024-02-19T21:49:54.492156+0000","last_became_peered":"2024-02-19T21:49:54.492156+0000","last_unstale":"2024-02-19T21:51:05.398716+0000","last_undegraded":"2024-02-19T21:51:05.398716+0000","last_fullsized":"2024-02-19T21:51:05.398716+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:04.692807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.692807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"378'4","reported_seq":456,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.396549+0000","last_change":"2024-02-19T21:48:28.510929+0000","last_active":"2024-02-19T21:51:05.396549+0000","last_peered":"2024-02-19T21:51:05.396549+0000","last_clean":"2024-02-19T21:51:05.396549+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:51:05.396549+0000","last_undegraded":"2024-02-19T21:51:05.396549+0000","last_fullsized":"2024-02-19T21:51:05.396549+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"378'4","last_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_deep_scrub":"378'4","last_deep_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.510849+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"200'23","reported_seq":303,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.396052+0000","last_change":"2024-02-19T21:48:22.519465+0000","last_active":"2024-02-19T21:51:05.396052+0000","last_peered":"2024-02-19T21:51:05.396052+0000","last_clean":"2024-02-19T21:51:05.396052+0000","last_became_active":"2024-02-19T21:47:46.252085+0000","last_became_peered":"2024-02-19T21:47:46.252085+0000","last_unstale":"2024-02-19T21:51:05.396052+0000","last_undegraded":"2024-02-19T21:51:05.396052+0000","last_fullsized":"2024-02-19T21:51:05.396052+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'23","last_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_deep_scrub":"200'23","last_deep_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.519381+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6],"acting":[4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":70,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.391258+0000","last_change":"2024-02-19T21:49:08.328855+0000","last_active":"2024-02-19T21:51:05.391258+0000","last_peered":"2024-02-19T21:51:05.391258+0000","last_clean":"2024-02-19T21:51:05.391258+0000","last_became_active":"2024-02-19T21:49:08.328237+0000","last_became_peered":"2024-02-19T21:49:08.328237+0000","last_unstale":"2024-02-19T21:51:05.391258+0000","last_undegraded":"2024-02-19T21:51:05.391258+0000","last_fullsized":"2024-02-19T21:51:05.391258+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:58.047556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:58.047556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"442'4976","reported_seq":5040,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-02-19T21:51:14.785261+0000","last_change":"2024-02-19T21:48:47.778295+0000","last_active":"2024-02-19T21:51:14.785261+0000","last_peered":"2024-02-19T21:51:14.785261+0000","last_clean":"2024-02-19T21:51:14.785261+0000","last_became_active":"2024-02-19T21:48:47.777964+0000","last_became_peered":"2024-02-19T21:48:47.777964+0000","last_unstale":"2024-02-19T21:51:14.785261+0000","last_undegraded":"2024-02-19T21:51:14.785261+0000","last_fullsized":"2024-02-19T21:51:14.785261+0000","mapping_epoch":385,"log_start":"392'200","ondisk_log_start":"392'200","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4776,"ondisk_log_size":4776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":273547264,"num_objects":4174,"num_object_clones":0,"num_object_copies":12522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4174,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4976,"num_write_kb":292800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":471,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.396133+0000","last_change":"2024-02-19T21:49:08.328019+0000","last_active":"2024-02-19T21:51:05.396133+0000","last_peered":"2024-02-19T21:51:05.396133+0000","last_clean":"2024-02-19T21:51:05.396133+0000","last_became_active":"2024-02-19T21:49:08.327581+0000","last_became_peered":"2024-02-19T21:49:08.327581+0000","last_unstale":"2024-02-19T21:51:05.396133+0000","last_undegraded":"2024-02-19T21:51:05.396133+0000","last_fullsized":"2024-02-19T21:51:05.396133+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:22.180593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:45:22.180593+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5],"acting":[0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":417,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.394484+0000","last_change":"2024-02-19T21:48:37.789514+0000","last_active":"2024-02-19T21:51:05.394484+0000","last_peered":"2024-02-19T21:51:05.394484+0000","last_clean":"2024-02-19T21:51:05.394484+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:51:05.394484+0000","last_undegraded":"2024-02-19T21:51:05.394484+0000","last_fullsized":"2024-02-19T21:51:05.394484+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:37.789400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:37.789400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"201'20","reported_seq":323,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.394691+0000","last_change":"2024-02-19T21:45:57.877936+0000","last_active":"2024-02-19T21:51:05.394691+0000","last_peered":"2024-02-19T21:51:05.394691+0000","last_clean":"2024-02-19T21:51:05.394691+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:51:05.394691+0000","last_undegraded":"2024-02-19T21:51:05.394691+0000","last_fullsized":"2024-02-19T21:51:05.394691+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:45:57.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:57.877856+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":654,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-02-19T21:51:10.383533+0000","last_change":"2024-02-19T21:49:01.011149+0000","last_active":"2024-02-19T21:51:10.383533+0000","last_peered":"2024-02-19T21:51:10.383533+0000","last_clean":"2024-02-19T21:51:10.383533+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:51:10.383533+0000","last_undegraded":"2024-02-19T21:51:10.383533+0000","last_fullsized":"2024-02-19T21:51:10.383533+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:49:01.011078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:49:01.011078+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.a","version":"442'5093","reported_seq":5158,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-02-19T21:51:14.699087+0000","last_change":"2024-02-19T21:48:47.778138+0000","last_active":"2024-02-19T21:51:14.699087+0000","last_peered":"2024-02-19T21:51:14.699087+0000","last_clean":"2024-02-19T21:51:14.699087+0000","last_became_active":"2024-02-19T21:48:47.777820+0000","last_became_peered":"2024-02-19T21:48:47.777820+0000","last_unstale":"2024-02-19T21:51:14.699087+0000","last_undegraded":"2024-02-19T21:51:14.699087+0000","last_fullsized":"2024-02-19T21:51:14.699087+0000","mapping_epoch":385,"log_start":"392'200","ondisk_log_start":"392'200","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4893,"ondisk_log_size":4893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":281870336,"num_objects":4301,"num_object_clones":0,"num_object_copies":12903,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4301,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5093,"num_write_kb":300608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":366,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.397167+0000","last_change":"2024-02-19T21:48:33.478821+0000","last_active":"2024-02-19T21:51:05.397167+0000","last_peered":"2024-02-19T21:51:05.397167+0000","last_clean":"2024-02-19T21:51:05.397167+0000","last_became_active":"2024-02-19T21:44:56.149476+0000","last_became_peered":"2024-02-19T21:44:56.149476+0000","last_unstale":"2024-02-19T21:51:05.397167+0000","last_undegraded":"2024-02-19T21:51:05.397167+0000","last_fullsized":"2024-02-19T21:51:05.397167+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:33.478715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:48:33.478715+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":427,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.391831+0000","last_change":"2024-02-19T21:46:41.834315+0000","last_active":"2024-02-19T21:51:05.391831+0000","last_peered":"2024-02-19T21:51:05.391831+0000","last_clean":"2024-02-19T21:51:05.391831+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:51:05.391831+0000","last_undegraded":"2024-02-19T21:51:05.391831+0000","last_fullsized":"2024-02-19T21:51:05.391831+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:41.834246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:46:41.834246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"397'46","reported_seq":844,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-02-19T21:51:10.290150+0000","last_change":"2024-02-19T21:49:08.335296+0000","last_active":"2024-02-19T21:51:10.290150+0000","last_peered":"2024-02-19T21:51:10.290150+0000","last_clean":"2024-02-19T21:51:10.290150+0000","last_became_active":"2024-02-19T21:49:08.334527+0000","last_became_peered":"2024-02-19T21:49:08.334527+0000","last_unstale":"2024-02-19T21:51:10.290150+0000","last_undegraded":"2024-02-19T21:51:10.290150+0000","last_fullsized":"2024-02-19T21:51:10.290150+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'43","last_scrub_stamp":"2024-02-19T21:45:04.755444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.755444+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":413,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.397841+0000","last_change":"2024-02-19T21:46:45.252437+0000","last_active":"2024-02-19T21:51:05.397841+0000","last_peered":"2024-02-19T21:51:05.397841+0000","last_clean":"2024-02-19T21:51:05.397841+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:51:05.397841+0000","last_undegraded":"2024-02-19T21:51:05.397841+0000","last_fullsized":"2024-02-19T21:51:05.397841+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.252344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.252344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"442'5059","reported_seq":6530,"reported_epoch":442,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:51:15.314198+0000","last_change":"2024-02-19T21:51:03.650022+0000","last_active":"2024-02-19T21:51:15.314198+0000","last_peered":"2024-02-19T21:51:15.314198+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:55.752599+0000","last_became_peered":"2024-02-19T21:49:55.752599+0000","last_unstale":"2024-02-19T21:51:15.314198+0000","last_undegraded":"2024-02-19T21:49:55.655049+0000","last_fullsized":"2024-02-19T21:49:55.470938+0000","mapping_epoch":414,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5059,"ondisk_log_size":5059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":275316736,"num_objects":4201,"num_object_clones":0,"num_object_copies":12603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":692,"num_objects_misplaced":3568,"num_objects_unfound":0,"num_objects_dirty":4201,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5059,"num_write_kb":296320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":465,"num_bytes_recovered":30474240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2],"avail_no_missing":["5","4"],"object_location_counts":[{"shards":"2,4,5","objects":2876},{"shards":"2,5","objects":633},{"shards":"4,5","objects":692}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":441,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.400741+0000","last_change":"2024-02-19T21:49:09.227437+0000","last_active":"2024-02-19T21:51:05.400741+0000","last_peered":"2024-02-19T21:51:05.400741+0000","last_clean":"2024-02-19T21:51:05.400741+0000","last_became_active":"2024-02-19T21:49:08.328437+0000","last_became_peered":"2024-02-19T21:49:08.328437+0000","last_unstale":"2024-02-19T21:51:05.400741+0000","last_undegraded":"2024-02-19T21:51:05.400741+0000","last_fullsized":"2024-02-19T21:51:05.400741+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.227355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.227355+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'6","reported_seq":1585,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-02-19T21:51:13.600287+0000","last_change":"2024-02-19T21:49:51.604278+0000","last_active":"2024-02-19T21:51:13.600287+0000","last_peered":"2024-02-19T21:51:13.600287+0000","last_clean":"2024-02-19T21:51:13.600287+0000","last_became_active":"2024-02-19T21:49:08.331108+0000","last_became_peered":"2024-02-19T21:49:08.331108+0000","last_unstale":"2024-02-19T21:51:13.600287+0000","last_undegraded":"2024-02-19T21:51:13.600287+0000","last_fullsized":"2024-02-19T21:51:13.600287+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_clean_scrub_stamp":"2024-02-19T21:44:13.678341+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1111,"num_read_kb":1106,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":70,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.392173+0000","last_change":"2024-02-19T21:49:08.329710+0000","last_active":"2024-02-19T21:51:05.392173+0000","last_peered":"2024-02-19T21:51:05.392173+0000","last_clean":"2024-02-19T21:51:05.392173+0000","last_became_active":"2024-02-19T21:49:08.329378+0000","last_became_peered":"2024-02-19T21:49:08.329378+0000","last_unstale":"2024-02-19T21:51:05.392173+0000","last_undegraded":"2024-02-19T21:51:05.392173+0000","last_fullsized":"2024-02-19T21:51:05.392173+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:55.195394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.195394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"200'17","reported_seq":474,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.394596+0000","last_change":"2024-02-19T21:48:14.878933+0000","last_active":"2024-02-19T21:51:05.394596+0000","last_peered":"2024-02-19T21:51:05.394596+0000","last_clean":"2024-02-19T21:51:05.394596+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:51:05.394596+0000","last_undegraded":"2024-02-19T21:51:05.394596+0000","last_fullsized":"2024-02-19T21:51:05.394596+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'17","last_scrub_stamp":"2024-02-19T21:48:14.878857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.878857+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":25,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":70,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.391851+0000","last_change":"2024-02-19T21:49:08.325478+0000","last_active":"2024-02-19T21:51:05.391851+0000","last_peered":"2024-02-19T21:51:05.391851+0000","last_clean":"2024-02-19T21:51:05.391851+0000","last_became_active":"2024-02-19T21:49:08.325127+0000","last_became_peered":"2024-02-19T21:49:08.325127+0000","last_unstale":"2024-02-19T21:51:05.391851+0000","last_undegraded":"2024-02-19T21:51:05.391851+0000","last_fullsized":"2024-02-19T21:51:05.391851+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:10.871111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:10.871111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"442'5121","reported_seq":5186,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-02-19T21:51:14.677439+0000","last_change":"2024-02-19T21:48:47.778829+0000","last_active":"2024-02-19T21:51:14.677439+0000","last_peered":"2024-02-19T21:51:14.677439+0000","last_clean":"2024-02-19T21:51:14.677439+0000","last_became_active":"2024-02-19T21:48:47.778486+0000","last_became_peered":"2024-02-19T21:48:47.778486+0000","last_unstale":"2024-02-19T21:51:14.677439+0000","last_undegraded":"2024-02-19T21:51:14.677439+0000","last_fullsized":"2024-02-19T21:51:14.677439+0000","mapping_epoch":385,"log_start":"392'200","ondisk_log_start":"392'200","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4921,"ondisk_log_size":4921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":284360704,"num_objects":4339,"num_object_clones":0,"num_object_copies":13017,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4339,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5121,"num_write_kb":302720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":444,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.391926+0000","last_change":"2024-02-19T21:47:33.400407+0000","last_active":"2024-02-19T21:51:05.391926+0000","last_peered":"2024-02-19T21:51:05.391926+0000","last_clean":"2024-02-19T21:51:05.391926+0000","last_became_active":"2024-02-19T21:47:33.400075+0000","last_became_peered":"2024-02-19T21:47:33.400075+0000","last_unstale":"2024-02-19T21:51:05.391926+0000","last_undegraded":"2024-02-19T21:51:05.391926+0000","last_fullsized":"2024-02-19T21:51:05.391926+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.035136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":322,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.391942+0000","last_change":"2024-02-19T21:49:05.746443+0000","last_active":"2024-02-19T21:51:05.391942+0000","last_peered":"2024-02-19T21:51:05.391942+0000","last_clean":"2024-02-19T21:51:05.391942+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:51:05.391942+0000","last_undegraded":"2024-02-19T21:51:05.391942+0000","last_fullsized":"2024-02-19T21:51:05.391942+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.746358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.746358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":474,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.391400+0000","last_change":"2024-02-19T21:49:54.485252+0000","last_active":"2024-02-19T21:51:05.391400+0000","last_peered":"2024-02-19T21:51:05.391400+0000","last_clean":"2024-02-19T21:51:05.391400+0000","last_became_active":"2024-02-19T21:49:54.484956+0000","last_became_peered":"2024-02-19T21:49:54.484956+0000","last_unstale":"2024-02-19T21:51:05.391400+0000","last_undegraded":"2024-02-19T21:51:05.391400+0000","last_fullsized":"2024-02-19T21:51:05.391400+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:07.901205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:07.901205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":38,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.397682+0000","last_change":"2024-02-19T21:49:54.483990+0000","last_active":"2024-02-19T21:51:05.397682+0000","last_peered":"2024-02-19T21:51:05.397682+0000","last_clean":"2024-02-19T21:51:05.397682+0000","last_became_active":"2024-02-19T21:49:54.483637+0000","last_became_peered":"2024-02-19T21:49:54.483637+0000","last_unstale":"2024-02-19T21:51:05.397682+0000","last_undegraded":"2024-02-19T21:51:05.397682+0000","last_fullsized":"2024-02-19T21:51:05.397682+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.190177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.190177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"201'33","reported_seq":467,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.393923+0000","last_change":"2024-02-19T21:46:47.970066+0000","last_active":"2024-02-19T21:51:05.393923+0000","last_peered":"2024-02-19T21:51:05.393923+0000","last_clean":"2024-02-19T21:51:05.393923+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:51:05.393923+0000","last_undegraded":"2024-02-19T21:51:05.393923+0000","last_fullsized":"2024-02-19T21:51:05.393923+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'33","last_scrub_stamp":"2024-02-19T21:46:47.969961+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.969961+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.399785+0000","last_change":"2024-02-19T21:49:54.478276+0000","last_active":"2024-02-19T21:51:05.399785+0000","last_peered":"2024-02-19T21:51:05.399785+0000","last_clean":"2024-02-19T21:51:05.399785+0000","last_became_active":"2024-02-19T21:49:54.477947+0000","last_became_peered":"2024-02-19T21:49:54.477947+0000","last_unstale":"2024-02-19T21:51:05.399785+0000","last_undegraded":"2024-02-19T21:51:05.399785+0000","last_fullsized":"2024-02-19T21:51:05.399785+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:57.754453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:57.754453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"442'4974","reported_seq":12440,"reported_epoch":442,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:51:14.825727+0000","last_change":"2024-02-19T21:50:49.705851+0000","last_active":"2024-02-19T21:51:14.825727+0000","last_peered":"2024-02-19T21:51:14.825727+0000","last_clean":"2024-02-19T21:49:53.438055+0000","last_became_active":"2024-02-19T21:49:55.720894+0000","last_became_peered":"2024-02-19T21:49:55.720894+0000","last_unstale":"2024-02-19T21:51:14.825727+0000","last_undegraded":"2024-02-19T21:49:55.557499+0000","last_fullsized":"2024-02-19T21:49:55.472563+0000","mapping_epoch":414,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4974,"ondisk_log_size":4974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":276692992,"num_objects":4222,"num_object_clones":0,"num_object_copies":12666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":170,"num_objects_misplaced":1195,"num_objects_unfound":0,"num_objects_dirty":4222,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4974,"num_write_kb":294272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3689,"num_bytes_recovered":241762304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7],"acting":[0,2],"avail_no_missing":["0","2","5"],"object_location_counts":[{"shards":"0,2","objects":2857},{"shards":"0,2,5","objects":1195}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":415,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.394661+0000","last_change":"2024-02-19T21:45:47.723650+0000","last_active":"2024-02-19T21:51:05.394661+0000","last_peered":"2024-02-19T21:51:05.394661+0000","last_clean":"2024-02-19T21:51:05.394661+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:51:05.394661+0000","last_undegraded":"2024-02-19T21:51:05.394661+0000","last_fullsized":"2024-02-19T21:51:05.394661+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.723550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.723550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":426,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.396189+0000","last_change":"2024-02-19T21:45:51.243726+0000","last_active":"2024-02-19T21:51:05.396189+0000","last_peered":"2024-02-19T21:51:05.396189+0000","last_clean":"2024-02-19T21:51:05.396189+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:51:05.396189+0000","last_undegraded":"2024-02-19T21:51:05.396189+0000","last_fullsized":"2024-02-19T21:51:05.396189+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:51.243656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:51.243656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":443,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.399966+0000","last_change":"2024-02-19T21:48:23.218358+0000","last_active":"2024-02-19T21:51:05.399966+0000","last_peered":"2024-02-19T21:51:05.399966+0000","last_clean":"2024-02-19T21:51:05.399966+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:51:05.399966+0000","last_undegraded":"2024-02-19T21:51:05.399966+0000","last_fullsized":"2024-02-19T21:51:05.399966+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:23.218282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.218282+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"324'30","reported_seq":570,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.396923+0000","last_change":"2024-02-19T21:49:08.330490+0000","last_active":"2024-02-19T21:51:05.396923+0000","last_peered":"2024-02-19T21:51:05.396923+0000","last_clean":"2024-02-19T21:51:05.396923+0000","last_became_active":"2024-02-19T21:49:08.329761+0000","last_became_peered":"2024-02-19T21:49:08.329761+0000","last_unstale":"2024-02-19T21:51:05.396923+0000","last_undegraded":"2024-02-19T21:51:05.396923+0000","last_fullsized":"2024-02-19T21:51:05.396923+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'30","last_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_deep_scrub":"324'30","last_deep_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.110965+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":428,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.391868+0000","last_change":"2024-02-19T21:45:09.918263+0000","last_active":"2024-02-19T21:51:05.391868+0000","last_peered":"2024-02-19T21:51:05.391868+0000","last_clean":"2024-02-19T21:51:05.391868+0000","last_became_active":"2024-02-19T21:44:42.624782+0000","last_became_peered":"2024-02-19T21:44:42.624782+0000","last_unstale":"2024-02-19T21:51:05.391868+0000","last_undegraded":"2024-02-19T21:51:05.391868+0000","last_fullsized":"2024-02-19T21:51:05.391868+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":295,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_clean_scrub_stamp":"2024-02-19T21:45:09.918170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"442'5017","reported_seq":5083,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-02-19T21:51:15.021610+0000","last_change":"2024-02-19T21:48:47.777963+0000","last_active":"2024-02-19T21:51:15.021610+0000","last_peered":"2024-02-19T21:51:15.021610+0000","last_clean":"2024-02-19T21:51:15.021610+0000","last_became_active":"2024-02-19T21:48:47.777644+0000","last_became_peered":"2024-02-19T21:48:47.777644+0000","last_unstale":"2024-02-19T21:51:15.021610+0000","last_undegraded":"2024-02-19T21:51:15.021610+0000","last_fullsized":"2024-02-19T21:51:15.021610+0000","mapping_epoch":385,"log_start":"392'100","ondisk_log_start":"392'100","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4917,"ondisk_log_size":4917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":278659096,"num_objects":4253,"num_object_clones":0,"num_object_copies":12759,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4253,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5017,"num_write_kb":296577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":448,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.394158+0000","last_change":"2024-02-19T21:49:08.331080+0000","last_active":"2024-02-19T21:51:05.394158+0000","last_peered":"2024-02-19T21:51:05.394158+0000","last_clean":"2024-02-19T21:51:05.394158+0000","last_became_active":"2024-02-19T21:49:08.330648+0000","last_became_peered":"2024-02-19T21:49:08.330648+0000","last_unstale":"2024-02-19T21:51:05.394158+0000","last_undegraded":"2024-02-19T21:51:05.394158+0000","last_fullsized":"2024-02-19T21:51:05.394158+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:55.803876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:44:55.803876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":419,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.400727+0000","last_change":"2024-02-19T21:48:31.320229+0000","last_active":"2024-02-19T21:51:05.400727+0000","last_peered":"2024-02-19T21:51:05.400727+0000","last_clean":"2024-02-19T21:51:05.400727+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:51:05.400727+0000","last_undegraded":"2024-02-19T21:51:05.400727+0000","last_fullsized":"2024-02-19T21:51:05.400727+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:31.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:45.017696+0000","last_clean_scrub_stamp":"2024-02-19T21:48:31.320133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"201'37","reported_seq":474,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.396724+0000","last_change":"2024-02-19T21:45:14.173212+0000","last_active":"2024-02-19T21:51:05.396724+0000","last_peered":"2024-02-19T21:51:05.396724+0000","last_clean":"2024-02-19T21:51:05.396724+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:51:05.396724+0000","last_undegraded":"2024-02-19T21:51:05.396724+0000","last_fullsized":"2024-02-19T21:51:05.396724+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'37","last_scrub_stamp":"2024-02-19T21:45:14.173134+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:45:14.173134+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":418,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.394086+0000","last_change":"2024-02-19T21:46:48.988928+0000","last_active":"2024-02-19T21:51:05.394086+0000","last_peered":"2024-02-19T21:51:05.394086+0000","last_clean":"2024-02-19T21:51:05.394086+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:51:05.394086+0000","last_undegraded":"2024-02-19T21:51:05.394086+0000","last_fullsized":"2024-02-19T21:51:05.394086+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:48.988836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.988836+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.e","version":"442'4936","reported_seq":7087,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-02-19T21:51:15.186481+0000","last_change":"2024-02-19T21:50:40.718822+0000","last_active":"2024-02-19T21:51:15.186481+0000","last_peered":"2024-02-19T21:51:15.186481+0000","last_clean":"2024-02-19T21:51:15.186481+0000","last_became_active":"2024-02-19T21:50:40.710425+0000","last_became_peered":"2024-02-19T21:50:40.710425+0000","last_unstale":"2024-02-19T21:51:15.186481+0000","last_undegraded":"2024-02-19T21:51:15.186481+0000","last_fullsized":"2024-02-19T21:51:15.186481+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4936,"ondisk_log_size":4936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":275251200,"num_objects":4200,"num_object_clones":0,"num_object_copies":12600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4200,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4936,"num_write_kb":292352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1035,"num_bytes_recovered":67829760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":161,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.396264+0000","last_change":"2024-02-19T21:49:08.326461+0000","last_active":"2024-02-19T21:51:05.396264+0000","last_peered":"2024-02-19T21:51:05.396264+0000","last_clean":"2024-02-19T21:51:05.396264+0000","last_became_active":"2024-02-19T21:49:08.326106+0000","last_became_peered":"2024-02-19T21:49:08.326106+0000","last_unstale":"2024-02-19T21:51:05.396264+0000","last_undegraded":"2024-02-19T21:51:05.396264+0000","last_fullsized":"2024-02-19T21:51:05.396264+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.080896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.080896+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":421,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.394450+0000","last_change":"2024-02-19T21:48:11.879787+0000","last_active":"2024-02-19T21:51:05.394450+0000","last_peered":"2024-02-19T21:51:05.394450+0000","last_clean":"2024-02-19T21:51:05.394450+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:51:05.394450+0000","last_undegraded":"2024-02-19T21:51:05.394450+0000","last_fullsized":"2024-02-19T21:51:05.394450+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.879687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.879687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"201'38","reported_seq":56,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.400150+0000","last_change":"2024-02-19T21:49:55.861358+0000","last_active":"2024-02-19T21:51:05.400150+0000","last_peered":"2024-02-19T21:51:05.400150+0000","last_clean":"2024-02-19T21:51:05.400150+0000","last_became_active":"2024-02-19T21:49:54.480413+0000","last_became_peered":"2024-02-19T21:49:54.480413+0000","last_unstale":"2024-02-19T21:51:05.400150+0000","last_undegraded":"2024-02-19T21:51:05.400150+0000","last_fullsized":"2024-02-19T21:51:05.400150+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":415,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'38","last_scrub_stamp":"2024-02-19T21:49:05.923627+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.923627+0000","log_size":38,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":314,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.394068+0000","last_change":"2024-02-19T21:49:54.495134+0000","last_active":"2024-02-19T21:51:05.394068+0000","last_peered":"2024-02-19T21:51:05.394068+0000","last_clean":"2024-02-19T21:51:05.394068+0000","last_became_active":"2024-02-19T21:49:54.494802+0000","last_became_peered":"2024-02-19T21:49:54.494802+0000","last_unstale":"2024-02-19T21:51:05.394068+0000","last_undegraded":"2024-02-19T21:51:05.394068+0000","last_fullsized":"2024-02-19T21:51:05.394068+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:10.578408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:10.578408+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.f","version":"442'5173","reported_seq":7548,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-02-19T21:51:14.705867+0000","last_change":"2024-02-19T21:51:05.409700+0000","last_active":"2024-02-19T21:51:14.705867+0000","last_peered":"2024-02-19T21:51:14.705867+0000","last_clean":"2024-02-19T21:51:14.705867+0000","last_became_active":"2024-02-19T21:51:05.398355+0000","last_became_peered":"2024-02-19T21:51:05.398355+0000","last_unstale":"2024-02-19T21:51:14.705867+0000","last_undegraded":"2024-02-19T21:51:14.705867+0000","last_fullsized":"2024-02-19T21:51:14.705867+0000","mapping_epoch":440,"log_start":"392'300","ondisk_log_start":"392'300","created":385,"last_epoch_clean":441,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4873,"ondisk_log_size":4873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":286064640,"num_objects":4365,"num_object_clones":0,"num_object_copies":13095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4365,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5173,"num_write_kb":305216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1147,"num_bytes_recovered":75169792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":448,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.399033+0000","last_change":"2024-02-19T21:49:08.328862+0000","last_active":"2024-02-19T21:51:05.399033+0000","last_peered":"2024-02-19T21:51:05.399033+0000","last_clean":"2024-02-19T21:51:05.399033+0000","last_became_active":"2024-02-19T21:49:08.328529+0000","last_became_peered":"2024-02-19T21:49:08.328529+0000","last_unstale":"2024-02-19T21:51:05.399033+0000","last_undegraded":"2024-02-19T21:51:05.399033+0000","last_fullsized":"2024-02-19T21:51:05.399033+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:49.110117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:49.110117+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":481,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.394365+0000","last_change":"2024-02-19T21:49:54.493367+0000","last_active":"2024-02-19T21:51:05.394365+0000","last_peered":"2024-02-19T21:51:05.394365+0000","last_clean":"2024-02-19T21:51:05.394365+0000","last_became_active":"2024-02-19T21:49:54.493041+0000","last_became_peered":"2024-02-19T21:49:54.493041+0000","last_unstale":"2024-02-19T21:51:05.394365+0000","last_undegraded":"2024-02-19T21:51:05.394365+0000","last_fullsized":"2024-02-19T21:51:05.394365+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.972369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.972369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"201'28","reported_seq":288,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.395939+0000","last_change":"2024-02-19T21:49:08.330818+0000","last_active":"2024-02-19T21:51:05.395939+0000","last_peered":"2024-02-19T21:51:05.395939+0000","last_clean":"2024-02-19T21:51:05.395939+0000","last_became_active":"2024-02-19T21:49:08.330477+0000","last_became_peered":"2024-02-19T21:49:08.330477+0000","last_unstale":"2024-02-19T21:51:05.395939+0000","last_undegraded":"2024-02-19T21:51:05.395939+0000","last_fullsized":"2024-02-19T21:51:05.395939+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'28","last_scrub_stamp":"2024-02-19T21:45:55.998646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.998646+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":40,"num_read_kb":33,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":503,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-02-19T21:51:10.289644+0000","last_change":"2024-02-19T21:45:50.742626+0000","last_active":"2024-02-19T21:51:10.289644+0000","last_peered":"2024-02-19T21:51:10.289644+0000","last_clean":"2024-02-19T21:51:10.289644+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:51:10.289644+0000","last_undegraded":"2024-02-19T21:51:10.289644+0000","last_fullsized":"2024-02-19T21:51:10.289644+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'9","last_scrub_stamp":"2024-02-19T21:45:50.742526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:50.742526+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"442'4984","reported_seq":5049,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-02-19T21:51:14.791328+0000","last_change":"2024-02-19T21:48:47.779506+0000","last_active":"2024-02-19T21:51:14.791328+0000","last_peered":"2024-02-19T21:51:14.791328+0000","last_clean":"2024-02-19T21:51:14.791328+0000","last_became_active":"2024-02-19T21:48:47.778325+0000","last_became_peered":"2024-02-19T21:48:47.778325+0000","last_unstale":"2024-02-19T21:51:14.791328+0000","last_undegraded":"2024-02-19T21:51:14.791328+0000","last_fullsized":"2024-02-19T21:51:14.791328+0000","mapping_epoch":385,"log_start":"392'100","ondisk_log_start":"392'100","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4884,"ondisk_log_size":4884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":272367616,"num_objects":4156,"num_object_clones":0,"num_object_copies":12468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4156,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4984,"num_write_kb":292480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"66'1","reported_seq":332,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.394207+0000","last_change":"2024-02-19T21:48:12.568842+0000","last_active":"2024-02-19T21:51:05.394207+0000","last_peered":"2024-02-19T21:51:05.394207+0000","last_clean":"2024-02-19T21:51:05.394207+0000","last_became_active":"2024-02-19T21:44:56.166670+0000","last_became_peered":"2024-02-19T21:44:56.166670+0000","last_unstale":"2024-02-19T21:51:05.394207+0000","last_undegraded":"2024-02-19T21:51:05.394207+0000","last_fullsized":"2024-02-19T21:51:05.394207+0000","mapping_epoch":165,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:12.568734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.568734+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"261'11","reported_seq":514,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-02-19T21:51:10.332585+0000","last_change":"2024-02-19T21:45:01.716882+0000","last_active":"2024-02-19T21:51:10.332585+0000","last_peered":"2024-02-19T21:51:10.332585+0000","last_clean":"2024-02-19T21:51:10.332585+0000","last_became_active":"2024-02-19T21:44:08.123392+0000","last_became_peered":"2024-02-19T21:44:08.123392+0000","last_unstale":"2024-02-19T21:51:10.332585+0000","last_undegraded":"2024-02-19T21:51:10.332585+0000","last_fullsized":"2024-02-19T21:51:10.332585+0000","mapping_epoch":62,"log_start":"257'10","ondisk_log_start":"257'10","created":62,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-02-19T21:45:01.716817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.716817+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":430,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.400059+0000","last_change":"2024-02-19T21:48:19.186455+0000","last_active":"2024-02-19T21:51:05.400059+0000","last_peered":"2024-02-19T21:51:05.400059+0000","last_clean":"2024-02-19T21:51:05.400059+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:51:05.400059+0000","last_undegraded":"2024-02-19T21:51:05.400059+0000","last_fullsized":"2024-02-19T21:51:05.400059+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:48:19.186359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:19.186359+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"201'19","reported_seq":288,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.397002+0000","last_change":"2024-02-19T21:48:34.485865+0000","last_active":"2024-02-19T21:51:05.397002+0000","last_peered":"2024-02-19T21:51:05.397002+0000","last_clean":"2024-02-19T21:51:05.397002+0000","last_became_active":"2024-02-19T21:47:46.251550+0000","last_became_peered":"2024-02-19T21:47:46.251550+0000","last_unstale":"2024-02-19T21:51:05.397002+0000","last_undegraded":"2024-02-19T21:51:05.397002+0000","last_fullsized":"2024-02-19T21:51:05.397002+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:34.485787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:34.485787+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":23,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7],"acting":[4,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1","version":"442'5045","reported_seq":5110,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-02-19T21:51:15.045807+0000","last_change":"2024-02-19T21:48:47.772467+0000","last_active":"2024-02-19T21:51:15.045807+0000","last_peered":"2024-02-19T21:51:15.045807+0000","last_clean":"2024-02-19T21:51:15.045807+0000","last_became_active":"2024-02-19T21:48:47.772154+0000","last_became_peered":"2024-02-19T21:48:47.772154+0000","last_unstale":"2024-02-19T21:51:15.045807+0000","last_undegraded":"2024-02-19T21:51:15.045807+0000","last_fullsized":"2024-02-19T21:51:15.045807+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5045,"ondisk_log_size":5045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":279773184,"num_objects":4269,"num_object_clones":0,"num_object_copies":12807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4269,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5045,"num_write_kb":298048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":437,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.392213+0000","last_change":"2024-02-19T21:46:01.031458+0000","last_active":"2024-02-19T21:51:05.392213+0000","last_peered":"2024-02-19T21:51:05.392213+0000","last_clean":"2024-02-19T21:51:05.392213+0000","last_became_active":"2024-02-19T21:44:56.155194+0000","last_became_peered":"2024-02-19T21:44:56.155194+0000","last_unstale":"2024-02-19T21:51:05.392213+0000","last_undegraded":"2024-02-19T21:51:05.392213+0000","last_fullsized":"2024-02-19T21:51:05.392213+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.031344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.031344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"363'12","reported_seq":226,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-02-19T21:51:10.290594+0000","last_change":"2024-02-19T21:48:25.487689+0000","last_active":"2024-02-19T21:51:10.290594+0000","last_peered":"2024-02-19T21:51:10.290594+0000","last_clean":"2024-02-19T21:51:10.290594+0000","last_became_active":"2024-02-19T21:47:46.260099+0000","last_became_peered":"2024-02-19T21:47:46.260099+0000","last_unstale":"2024-02-19T21:51:10.290594+0000","last_undegraded":"2024-02-19T21:51:10.290594+0000","last_fullsized":"2024-02-19T21:51:10.290594+0000","mapping_epoch":362,"log_start":"98'9","ondisk_log_start":"98'9","created":62,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"363'12","last_scrub_stamp":"2024-02-19T21:48:25.487608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.487608+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":441,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.393972+0000","last_change":"2024-02-19T21:49:08.335163+0000","last_active":"2024-02-19T21:51:05.393972+0000","last_peered":"2024-02-19T21:51:05.393972+0000","last_clean":"2024-02-19T21:51:05.393972+0000","last_became_active":"2024-02-19T21:49:08.334842+0000","last_became_peered":"2024-02-19T21:49:08.334842+0000","last_unstale":"2024-02-19T21:51:05.393972+0000","last_undegraded":"2024-02-19T21:51:05.393972+0000","last_fullsized":"2024-02-19T21:51:05.393972+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.700887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.700887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"270'34","reported_seq":361,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.391686+0000","last_change":"2024-02-19T21:47:34.894164+0000","last_active":"2024-02-19T21:51:05.391686+0000","last_peered":"2024-02-19T21:51:05.391686+0000","last_clean":"2024-02-19T21:51:05.391686+0000","last_became_active":"2024-02-19T21:47:33.400012+0000","last_became_peered":"2024-02-19T21:47:33.400012+0000","last_unstale":"2024-02-19T21:51:05.391686+0000","last_undegraded":"2024-02-19T21:51:05.391686+0000","last_fullsized":"2024-02-19T21:51:05.391686+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":357,"parent":"0.0","parent_split_bits":0,"last_scrub":"270'34","last_scrub_stamp":"2024-02-19T21:46:44.789309+0000","last_deep_scrub":"270'34","last_deep_scrub_stamp":"2024-02-19T21:44:17.451151+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.789309+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2","version":"442'5150","reported_seq":5215,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-02-19T21:51:15.203902+0000","last_change":"2024-02-19T21:48:47.771305+0000","last_active":"2024-02-19T21:51:15.203902+0000","last_peered":"2024-02-19T21:51:15.203902+0000","last_clean":"2024-02-19T21:51:15.203902+0000","last_became_active":"2024-02-19T21:48:47.771000+0000","last_became_peered":"2024-02-19T21:48:47.771000+0000","last_unstale":"2024-02-19T21:51:15.203902+0000","last_undegraded":"2024-02-19T21:51:15.203902+0000","last_fullsized":"2024-02-19T21:51:15.203902+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5150,"ondisk_log_size":5150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":280363008,"num_objects":4278,"num_object_clones":0,"num_object_copies":12834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4278,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5150,"num_write_kb":301696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":419,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.397126+0000","last_change":"2024-02-19T21:49:08.329023+0000","last_active":"2024-02-19T21:51:05.397126+0000","last_peered":"2024-02-19T21:51:05.397126+0000","last_clean":"2024-02-19T21:51:05.397126+0000","last_became_active":"2024-02-19T21:49:08.328697+0000","last_became_peered":"2024-02-19T21:49:08.328697+0000","last_unstale":"2024-02-19T21:51:05.397126+0000","last_undegraded":"2024-02-19T21:51:05.397126+0000","last_fullsized":"2024-02-19T21:51:05.397126+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.939414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.939414+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"397'17","reported_seq":355,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-02-19T21:51:10.348639+0000","last_change":"2024-02-19T21:49:08.325927+0000","last_active":"2024-02-19T21:51:10.348639+0000","last_peered":"2024-02-19T21:51:10.348639+0000","last_clean":"2024-02-19T21:51:10.348639+0000","last_became_active":"2024-02-19T21:49:08.325034+0000","last_became_peered":"2024-02-19T21:49:08.325034+0000","last_unstale":"2024-02-19T21:51:10.348639+0000","last_undegraded":"2024-02-19T21:51:10.348639+0000","last_fullsized":"2024-02-19T21:51:10.348639+0000","mapping_epoch":394,"log_start":"170'11","ondisk_log_start":"170'11","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"271'13","last_scrub_stamp":"2024-02-19T21:46:47.072988+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.072988+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":431,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.394591+0000","last_change":"2024-02-19T21:49:03.987847+0000","last_active":"2024-02-19T21:51:05.394591+0000","last_peered":"2024-02-19T21:51:05.394591+0000","last_clean":"2024-02-19T21:51:05.394591+0000","last_became_active":"2024-02-19T21:47:33.395485+0000","last_became_peered":"2024-02-19T21:47:33.395485+0000","last_unstale":"2024-02-19T21:51:05.394591+0000","last_undegraded":"2024-02-19T21:51:05.394591+0000","last_fullsized":"2024-02-19T21:51:05.394591+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:03.987749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:49:03.987749+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,5],"acting":[1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"200'20","reported_seq":265,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.396862+0000","last_change":"2024-02-19T21:48:12.628796+0000","last_active":"2024-02-19T21:51:05.396862+0000","last_peered":"2024-02-19T21:51:05.396862+0000","last_clean":"2024-02-19T21:51:05.396862+0000","last_became_active":"2024-02-19T21:47:46.251725+0000","last_became_peered":"2024-02-19T21:47:46.251725+0000","last_unstale":"2024-02-19T21:51:05.396862+0000","last_undegraded":"2024-02-19T21:51:05.396862+0000","last_fullsized":"2024-02-19T21:51:05.396862+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'20","last_scrub_stamp":"2024-02-19T21:48:12.628700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.628700+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3","version":"442'5093","reported_seq":7362,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-02-19T21:51:16.917074+0000","last_change":"2024-02-19T21:50:50.296220+0000","last_active":"2024-02-19T21:51:16.917074+0000","last_peered":"2024-02-19T21:51:16.917074+0000","last_clean":"2024-02-19T21:51:16.917074+0000","last_became_active":"2024-02-19T21:50:50.289607+0000","last_became_peered":"2024-02-19T21:50:50.289607+0000","last_unstale":"2024-02-19T21:51:16.917074+0000","last_undegraded":"2024-02-19T21:51:16.917074+0000","last_fullsized":"2024-02-19T21:51:16.917074+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5093,"ondisk_log_size":5093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":279642112,"num_objects":4267,"num_object_clones":0,"num_object_copies":12801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4267,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5093,"num_write_kb":299520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1097,"num_bytes_recovered":71892992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":70,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.392430+0000","last_change":"2024-02-19T21:49:08.327495+0000","last_active":"2024-02-19T21:51:05.392430+0000","last_peered":"2024-02-19T21:51:05.392430+0000","last_clean":"2024-02-19T21:51:05.392430+0000","last_became_active":"2024-02-19T21:49:08.327172+0000","last_became_peered":"2024-02-19T21:49:08.327172+0000","last_unstale":"2024-02-19T21:51:05.392430+0000","last_undegraded":"2024-02-19T21:51:05.392430+0000","last_fullsized":"2024-02-19T21:51:05.392430+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.241319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.241319+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,6],"acting":[2,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":426,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.394588+0000","last_change":"2024-02-19T21:45:01.798485+0000","last_active":"2024-02-19T21:51:05.394588+0000","last_peered":"2024-02-19T21:51:05.394588+0000","last_clean":"2024-02-19T21:51:05.394588+0000","last_became_active":"2024-02-19T21:44:22.245925+0000","last_became_peered":"2024-02-19T21:44:22.245925+0000","last_unstale":"2024-02-19T21:51:05.394588+0000","last_undegraded":"2024-02-19T21:51:05.394588+0000","last_fullsized":"2024-02-19T21:51:05.394588+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:01.798387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.798387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":426,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.398917+0000","last_change":"2024-02-19T21:48:30.277397+0000","last_active":"2024-02-19T21:51:05.398917+0000","last_peered":"2024-02-19T21:51:05.398917+0000","last_clean":"2024-02-19T21:51:05.398917+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:51:05.398917+0000","last_undegraded":"2024-02-19T21:51:05.398917+0000","last_fullsized":"2024-02-19T21:51:05.398917+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.277322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.277322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"337'39","reported_seq":374,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.396147+0000","last_change":"2024-02-19T21:49:08.326007+0000","last_active":"2024-02-19T21:51:05.396147+0000","last_peered":"2024-02-19T21:51:05.396147+0000","last_clean":"2024-02-19T21:51:05.396147+0000","last_became_active":"2024-02-19T21:49:08.325683+0000","last_became_peered":"2024-02-19T21:49:08.325683+0000","last_unstale":"2024-02-19T21:51:05.396147+0000","last_undegraded":"2024-02-19T21:51:05.396147+0000","last_fullsized":"2024-02-19T21:51:05.396147+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'39","last_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_deep_scrub":"337'39","last_deep_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.923809+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":49,"num_read_kb":39,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"442'5183","reported_seq":5248,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-02-19T21:51:14.656135+0000","last_change":"2024-02-19T21:48:47.776672+0000","last_active":"2024-02-19T21:51:14.656135+0000","last_peered":"2024-02-19T21:51:14.656135+0000","last_clean":"2024-02-19T21:51:14.656135+0000","last_became_active":"2024-02-19T21:48:47.776368+0000","last_became_peered":"2024-02-19T21:48:47.776368+0000","last_unstale":"2024-02-19T21:51:14.656135+0000","last_undegraded":"2024-02-19T21:51:14.656135+0000","last_fullsized":"2024-02-19T21:51:14.656135+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5183,"ondisk_log_size":5183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":286064640,"num_objects":4365,"num_object_clones":0,"num_object_copies":13095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4365,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5183,"num_write_kb":305536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"66'1","reported_seq":264,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.397777+0000","last_change":"2024-02-19T21:50:57.303343+0000","last_active":"2024-02-19T21:51:05.397777+0000","last_peered":"2024-02-19T21:51:05.397777+0000","last_clean":"2024-02-19T21:51:05.397777+0000","last_became_active":"2024-02-19T21:50:57.302957+0000","last_became_peered":"2024-02-19T21:50:57.302957+0000","last_unstale":"2024-02-19T21:51:05.397777+0000","last_undegraded":"2024-02-19T21:51:05.397777+0000","last_fullsized":"2024-02-19T21:51:05.397777+0000","mapping_epoch":437,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":438,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:46:43.773486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:46:43.773486+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":70,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.391674+0000","last_change":"2024-02-19T21:49:08.326583+0000","last_active":"2024-02-19T21:51:05.391674+0000","last_peered":"2024-02-19T21:51:05.391674+0000","last_clean":"2024-02-19T21:51:05.391674+0000","last_became_active":"2024-02-19T21:49:08.324835+0000","last_became_peered":"2024-02-19T21:49:08.324835+0000","last_unstale":"2024-02-19T21:51:05.391674+0000","last_undegraded":"2024-02-19T21:51:05.391674+0000","last_fullsized":"2024-02-19T21:51:05.391674+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.163825+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":126,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.393790+0000","last_change":"2024-02-19T21:49:08.327553+0000","last_active":"2024-02-19T21:51:05.393790+0000","last_peered":"2024-02-19T21:51:05.393790+0000","last_clean":"2024-02-19T21:51:05.393790+0000","last_became_active":"2024-02-19T21:49:08.327186+0000","last_became_peered":"2024-02-19T21:49:08.327186+0000","last_unstale":"2024-02-19T21:51:05.393790+0000","last_undegraded":"2024-02-19T21:51:05.393790+0000","last_fullsized":"2024-02-19T21:51:05.393790+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:45:00.748244+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:45:00.748244+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"201'44","reported_seq":547,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.394224+0000","last_change":"2024-02-19T21:49:55.281324+0000","last_active":"2024-02-19T21:51:05.394224+0000","last_peered":"2024-02-19T21:51:05.394224+0000","last_clean":"2024-02-19T21:51:05.394224+0000","last_became_active":"2024-02-19T21:49:54.493167+0000","last_became_peered":"2024-02-19T21:49:54.493167+0000","last_unstale":"2024-02-19T21:51:05.394224+0000","last_undegraded":"2024-02-19T21:51:05.394224+0000","last_fullsized":"2024-02-19T21:51:05.394224+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'44","last_scrub_stamp":"2024-02-19T21:48:32.489084+0000","last_deep_scrub":"201'44","last_deep_scrub_stamp":"2024-02-19T21:44:16.255049+0000","last_clean_scrub_stamp":"2024-02-19T21:48:32.489084+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.5","version":"442'5153","reported_seq":6567,"reported_epoch":442,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:51:16.882525+0000","last_change":"2024-02-19T21:50:03.887248+0000","last_active":"2024-02-19T21:51:16.882525+0000","last_peered":"2024-02-19T21:51:16.882525+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:50:03.654321+0000","last_became_peered":"2024-02-19T21:50:03.654321+0000","last_unstale":"2024-02-19T21:51:16.882525+0000","last_undegraded":"2024-02-19T21:50:01.398577+0000","last_fullsized":"2024-02-19T21:49:55.473278+0000","mapping_epoch":414,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5153,"ondisk_log_size":5153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":279773184,"num_objects":4269,"num_object_clones":0,"num_object_copies":12807,"num_objects_missing_on_primary":699,"num_objects_missing":699,"num_objects_degraded":699,"num_objects_misplaced":3679,"num_objects_unfound":0,"num_objects_dirty":4269,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5153,"num_write_kb":301504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":442,"num_bytes_recovered":28966912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0],"avail_no_missing":["0","5"],"object_location_counts":[{"shards":"0,2","objects":590},{"shards":"0,2,5","objects":2980},{"shards":"0,5","objects":699}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":471,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.396311+0000","last_change":"2024-02-19T21:49:08.328667+0000","last_active":"2024-02-19T21:51:05.396311+0000","last_peered":"2024-02-19T21:51:05.396311+0000","last_clean":"2024-02-19T21:51:05.396311+0000","last_became_active":"2024-02-19T21:49:08.328287+0000","last_became_peered":"2024-02-19T21:49:08.328287+0000","last_unstale":"2024-02-19T21:51:05.396311+0000","last_undegraded":"2024-02-19T21:51:05.396311+0000","last_fullsized":"2024-02-19T21:51:05.396311+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.176542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.176542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":70,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.391430+0000","last_change":"2024-02-19T21:49:08.332637+0000","last_active":"2024-02-19T21:51:05.391430+0000","last_peered":"2024-02-19T21:51:05.391430+0000","last_clean":"2024-02-19T21:51:05.391430+0000","last_became_active":"2024-02-19T21:49:08.331451+0000","last_became_peered":"2024-02-19T21:49:08.331451+0000","last_unstale":"2024-02-19T21:51:05.391430+0000","last_undegraded":"2024-02-19T21:51:05.391430+0000","last_fullsized":"2024-02-19T21:51:05.391430+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.123413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.547129+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.123413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":441,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.394781+0000","last_change":"2024-02-19T21:49:08.331159+0000","last_active":"2024-02-19T21:51:05.394781+0000","last_peered":"2024-02-19T21:51:05.394781+0000","last_clean":"2024-02-19T21:51:05.394781+0000","last_became_active":"2024-02-19T21:49:08.330804+0000","last_became_peered":"2024-02-19T21:49:08.330804+0000","last_unstale":"2024-02-19T21:51:05.394781+0000","last_undegraded":"2024-02-19T21:51:05.394781+0000","last_fullsized":"2024-02-19T21:51:05.394781+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.978015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.978015+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"377'19","reported_seq":449,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.396826+0000","last_change":"2024-02-19T21:48:23.326608+0000","last_active":"2024-02-19T21:51:05.396826+0000","last_peered":"2024-02-19T21:51:05.396826+0000","last_clean":"2024-02-19T21:51:05.396826+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:51:05.396826+0000","last_undegraded":"2024-02-19T21:51:05.396826+0000","last_fullsized":"2024-02-19T21:51:05.396826+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"377'19","last_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_deep_scrub":"377'19","last_deep_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.326541+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"442'5126","reported_seq":5190,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-02-19T21:51:15.259812+0000","last_change":"2024-02-19T21:48:47.780368+0000","last_active":"2024-02-19T21:51:15.259812+0000","last_peered":"2024-02-19T21:51:15.259812+0000","last_clean":"2024-02-19T21:51:15.259812+0000","last_became_active":"2024-02-19T21:48:47.780046+0000","last_became_peered":"2024-02-19T21:48:47.780046+0000","last_unstale":"2024-02-19T21:51:15.259812+0000","last_undegraded":"2024-02-19T21:51:15.259812+0000","last_fullsized":"2024-02-19T21:51:15.259812+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5126,"ondisk_log_size":5126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":280625152,"num_objects":4282,"num_object_clones":0,"num_object_copies":12846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4282,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5126,"num_write_kb":301056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":435,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.391646+0000","last_change":"2024-02-19T21:46:01.981923+0000","last_active":"2024-02-19T21:51:05.391646+0000","last_peered":"2024-02-19T21:51:05.391646+0000","last_clean":"2024-02-19T21:51:05.391646+0000","last_became_active":"2024-02-19T21:44:56.160521+0000","last_became_peered":"2024-02-19T21:44:56.160521+0000","last_unstale":"2024-02-19T21:51:05.391646+0000","last_undegraded":"2024-02-19T21:51:05.391646+0000","last_fullsized":"2024-02-19T21:51:05.391646+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.981866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.981866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":79,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.391915+0000","last_change":"2024-02-19T21:49:54.485377+0000","last_active":"2024-02-19T21:51:05.391915+0000","last_peered":"2024-02-19T21:51:05.391915+0000","last_clean":"2024-02-19T21:51:05.391915+0000","last_became_active":"2024-02-19T21:49:54.485078+0000","last_became_peered":"2024-02-19T21:49:54.485078+0000","last_unstale":"2024-02-19T21:51:05.391915+0000","last_undegraded":"2024-02-19T21:51:05.391915+0000","last_fullsized":"2024-02-19T21:51:05.391915+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:52.107416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:46:52.107416+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"200'27","reported_seq":512,"reported_epoch":441,"state":"active+clean","last_fresh":"2024-02-19T21:51:05.391145+0000","last_change":"2024-02-19T21:49:55.109780+0000","last_active":"2024-02-19T21:51:05.391145+0000","last_peered":"2024-02-19T21:51:05.391145+0000","last_clean":"2024-02-19T21:51:05.391145+0000","last_became_active":"2024-02-19T21:49:54.486014+0000","last_became_peered":"2024-02-19T21:49:54.486014+0000","last_unstale":"2024-02-19T21:51:05.391145+0000","last_undegraded":"2024-02-19T21:51:05.391145+0000","last_fullsized":"2024-02-19T21:51:05.391145+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'27","last_scrub_stamp":"2024-02-19T21:48:24.665813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:24.665813+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"324'11","reported_seq":674,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-02-19T21:51:10.344016+0000","last_change":"2024-02-19T21:48:26.293036+0000","last_active":"2024-02-19T21:51:10.344016+0000","last_peered":"2024-02-19T21:51:10.344016+0000","last_clean":"2024-02-19T21:51:10.344016+0000","last_became_active":"2024-02-19T21:44:34.385140+0000","last_became_peered":"2024-02-19T21:44:34.385140+0000","last_unstale":"2024-02-19T21:51:10.344016+0000","last_undegraded":"2024-02-19T21:51:10.344016+0000","last_fullsized":"2024-02-19T21:51:10.344016+0000","mapping_epoch":62,"log_start":"66'8","ondisk_log_start":"66'8","created":62,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'11","last_scrub_stamp":"2024-02-19T21:48:26.292909+0000","last_deep_scrub":"324'11","last_deep_scrub_stamp":"2024-02-19T21:46:05.210095+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.292909+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":4473225240,"num_objects":68257,"num_object_clones":0,"num_object_copies":204771,"num_objects_missing_on_primary":699,"num_objects_missing":699,"num_objects_degraded":2391,"num_objects_misplaced":8442,"num_objects_unfound":0,"num_objects_dirty":68257,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":81239,"num_write_kb":4783809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8153,"num_bytes_recovered":534315008,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13523431424,"data_stored":13523419208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79839,"ondisk_log_size":79839,"up":48,"acting":44,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1111,"num_read_kb":1106,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1107,"num_read_kb":864,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":277,"num_bytes_recovered":5172,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":776,"ondisk_log_size":776,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":22,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":66,"acting":66,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":382,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201509,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1107432,"kb_used_data":810208,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":92637720,"statfs":{"total":95995035648,"available":94861025280,"internally_reserved":0,"allocated":829652992,"data_stored":828367828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":1.718,"15min":1.8839999999999999},"min":{"1min":0.23100000000000001,"5min":0.19,"15min":0.189},"max":{"1min":2.7530000000000001,"5min":22.07,"15min":70.477999999999994},"last":0.372},{"interface":"front","average":{"1min":1.0980000000000001,"5min":2.161,"15min":2.073},"min":{"1min":0.24199999999999999,"5min":0.21199999999999999,"15min":0.20999999999999999},"max":{"1min":11.962999999999999,"5min":22.457000000000001,"15min":68.052000000000007},"last":0.47499999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.8839999999999999,"15min":2.0979999999999999},"min":{"1min":0.26400000000000001,"5min":0.247,"15min":0.23200000000000001},"max":{"1min":9.9440000000000008,"5min":22.117999999999999,"15min":68.168000000000006},"last":0.378},{"interface":"front","average":{"1min":1.0309999999999999,"5min":2.3620000000000001,"15min":2.1400000000000001},"min":{"1min":0.33000000000000002,"5min":0.26300000000000001,"15min":0.223},"max":{"1min":9.8559999999999999,"5min":22.236000000000001,"15min":68.444000000000003},"last":0.40000000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:51:12 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":2.028,"15min":2.2759999999999998},"min":{"1min":0.29999999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.673,"5min":12.304,"15min":12.304},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":1.756,"15min":1.9610000000000001},"min":{"1min":0.28299999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":2.6840000000000002,"5min":11.69,"15min":11.69},"last":0.45000000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:50:50 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.966,"15min":2.1829999999999998},"min":{"1min":0.315,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":11.778,"5min":11.778,"15min":31.559000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":1.571,"15min":1.901},"min":{"1min":0.316,"5min":0.30299999999999999,"15min":0.29299999999999998},"max":{"1min":2.8039999999999998,"5min":13.473000000000001,"15min":30.812999999999999},"last":0.45700000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":1.875,"15min":1.5489999999999999},"min":{"1min":0.28199999999999997,"5min":0.245,"15min":0.216},"max":{"1min":2.8239999999999998,"5min":17.716999999999999,"15min":17.716999999999999},"last":0.311},{"interface":"front","average":{"1min":0.58699999999999997,"5min":2.2330000000000001,"15min":1.8740000000000001},"min":{"1min":0.30599999999999999,"5min":0.253,"15min":0.245},"max":{"1min":2.7839999999999998,"5min":17.690999999999999,"15min":17.690999999999999},"last":0.41999999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":1.9299999999999999,"15min":1.615},"min":{"1min":0.32000000000000001,"5min":0.28499999999999998,"15min":0.24199999999999999},"max":{"1min":2.5510000000000002,"5min":29.021000000000001,"15min":29.021000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":2.1880000000000002,"15min":1.8979999999999999},"min":{"1min":0.378,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":2.8500000000000001,"5min":29.091999999999999,"15min":29.091999999999999},"last":0.439}]},{"osd":6,"last update":"Mon Feb 19 21:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":2.3330000000000002,"15min":1.7},"min":{"1min":0.34399999999999997,"5min":0.31,"15min":0.24299999999999999},"max":{"1min":2.8849999999999998,"5min":19.286000000000001,"15min":19.286000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":2.173,"15min":1.8640000000000001},"min":{"1min":0.42699999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":2.988,"5min":18.364000000000001,"15min":18.364000000000001},"last":0.51200000000000001}]}]},{"osd":6,"up_from":47,"seq":201863463148,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2506024,"kb_used_data":1920416,"kb_used_omap":0,"kb_used_meta":585600,"kb_avail":91239128,"statfs":{"total":95995035648,"available":93428867072,"internally_reserved":0,"allocated":1966505984,"data_stored":1965220134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":599654400},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:50:27 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":1.2310000000000001,"15min":1.6599999999999999},"min":{"1min":0.245,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":2.9369999999999998,"5min":8.8079999999999998,"15min":45.197000000000003},"last":5.7069999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.74,"15min":1.9890000000000001},"min":{"1min":0.27600000000000002,"5min":0.23499999999999999,"15min":0.221},"max":{"1min":4.2859999999999996,"5min":6.9699999999999998,"15min":44.753},"last":5.6970000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:50:27 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":1.5780000000000001,"15min":1.7},"min":{"1min":0.26600000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":2.9929999999999999,"5min":8.8469999999999995,"15min":45.231999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.609,"15min":1.702},"min":{"1min":0.26400000000000001,"5min":0.245,"15min":0.23100000000000001},"max":{"1min":5.6050000000000004,"5min":7.3570000000000002,"15min":45.097999999999999},"last":0.34499999999999997}]},{"osd":2,"last update":"Mon Feb 19 21:51:11 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.4430000000000001,"15min":1.528},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":6.1820000000000004,"5min":6.1820000000000004,"15min":6.1820000000000004},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":1.145,"15min":1.2270000000000001},"min":{"1min":0.32300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":3.258,"5min":7.8959999999999999,"15min":7.8959999999999999},"last":0.436}]},{"osd":3,"last update":"Mon Feb 19 21:50:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.508,"15min":1.6100000000000001},"min":{"1min":0.36399999999999999,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":5.4729999999999999,"5min":8.9009999999999998,"15min":11.15},"last":0.375},{"interface":"front","average":{"1min":1.909,"5min":1.675,"15min":1.6539999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.246},"max":{"1min":7.3970000000000002,"5min":7.3970000000000002,"15min":19.632999999999999},"last":0.38300000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:50:27 2024","interfaces":[{"interface":"back","average":{"1min":3.3069999999999999,"5min":2.242,"15min":1.7609999999999999},"min":{"1min":0.34000000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":18.010000000000002,"5min":18.010000000000002,"15min":18.010000000000002},"last":0.36299999999999999},{"interface":"front","average":{"1min":1.7390000000000001,"5min":1.988,"15min":1.7190000000000001},"min":{"1min":0.32800000000000001,"5min":0.26300000000000001,"15min":0.23499999999999999},"max":{"1min":6.0659999999999998,"5min":11.566000000000001,"15min":16.594999999999999},"last":0.28399999999999997}]},{"osd":5,"last update":"Mon Feb 19 21:50:27 2024","interfaces":[{"interface":"back","average":{"1min":2.218,"5min":2.27,"15min":1.778},"min":{"1min":0.376,"5min":0.27400000000000002,"15min":0.27100000000000002},"max":{"1min":9.5990000000000002,"5min":14.695,"15min":14.695},"last":0.33300000000000002},{"interface":"front","average":{"1min":1.1339999999999999,"5min":2.254,"15min":1.907},"min":{"1min":0.40999999999999998,"5min":0.28799999999999998,"15min":0.27900000000000003},"max":{"1min":3.2890000000000001,"5min":11.609999999999999,"15min":15.497999999999999},"last":0.41599999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:50:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.9339999999999999,"15min":1.8200000000000001},"min":{"1min":0.41699999999999998,"5min":0.27200000000000002,"15min":0.26700000000000002},"max":{"1min":3.3399999999999999,"5min":9.1929999999999996,"15min":14.721},"last":0.40000000000000002},{"interface":"front","average":{"1min":1.089,"5min":1.972,"15min":1.869},"min":{"1min":0.49099999999999999,"5min":0.35599999999999998,"15min":0.32700000000000001},"max":{"1min":3.3540000000000001,"5min":9.2240000000000002,"15min":14.744999999999999},"last":0.45100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575110,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1993912,"kb_used_data":1101488,"kb_used_omap":0,"kb_used_meta":892416,"kb_avail":91751240,"statfs":{"total":95995035648,"available":93953269760,"internally_reserved":0,"allocated":1127923712,"data_stored":1126622378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":913833984},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:50:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.0800000000000001,"15min":1.5289999999999999},"min":{"1min":0.184,"5min":0.16300000000000001,"15min":0.161},"max":{"1min":5.7889999999999997,"5min":6.2789999999999999,"15min":42.776000000000003},"last":0.318},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1919999999999999,"15min":1.5700000000000001},"min":{"1min":0.22,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":5.7119999999999997,"5min":10.798,"15min":44.845999999999997},"last":0.25800000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:51:08 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.94999999999999996,"15min":1.038},"min":{"1min":0.22800000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.7270000000000001,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":0.37},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.89500000000000002,"15min":0.97299999999999998},"min":{"1min":0.254,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.6990000000000001,"5min":4.452,"15min":4.452},"last":0.63600000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:50:19 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":1.0920000000000001,"15min":1.6419999999999999},"min":{"1min":0.22800000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":3.5310000000000001,"5min":5.1660000000000004,"15min":41.607999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":1.1850000000000001,"15min":1.5289999999999999},"min":{"1min":0.25,"5min":0.215,"15min":0.215},"max":{"1min":2.4710000000000001,"5min":5.6589999999999998,"15min":42.811999999999998},"last":0.41199999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:50:34 2024","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.633,"15min":1.5429999999999999},"min":{"1min":0.316,"5min":0.251,"15min":0.251},"max":{"1min":9.8759999999999994,"5min":15.853,"15min":15.853},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":1.615,"15min":1.575},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.26500000000000001},"max":{"1min":2.746,"5min":15.861000000000001,"15min":15.861000000000001},"last":0.66100000000000003}]},{"osd":5,"last update":"Mon Feb 19 21:51:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":1.496,"15min":1.637},"min":{"1min":0.30199999999999999,"5min":0.29599999999999999,"15min":0.27900000000000003},"max":{"1min":1.7529999999999999,"5min":14.331,"15min":14.331},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":1.5629999999999999,"15min":1.619},"min":{"1min":0.39600000000000002,"5min":0.307,"15min":0.30099999999999999},"max":{"1min":2.2309999999999999,"5min":14.496,"15min":14.496},"last":0.46100000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:50:34 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.5700000000000001,"15min":1.657},"min":{"1min":0.40200000000000002,"5min":0.30199999999999999,"15min":0.30099999999999999},"max":{"1min":8.8309999999999995,"5min":10.456,"15min":11.638999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":1.179,"5min":1.696,"15min":1.786},"min":{"1min":0.38,"5min":0.36899999999999999,"15min":0.29699999999999999},"max":{"1min":3.863,"5min":9.8049999999999997,"15min":12.199},"last":0.498}]},{"osd":7,"last update":"Mon Feb 19 21:50:56 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":1.806,"15min":1.869},"min":{"1min":0.378,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":2.2549999999999999,"5min":13.904,"15min":13.904},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":1.823,"15min":1.736},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.32600000000000001},"max":{"1min":1.881,"5min":13.894,"15min":13.894},"last":0.54600000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738636,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3640356,"kb_used_data":2745948,"kb_used_omap":0,"kb_used_meta":894400,"kb_avail":90104796,"statfs":{"total":95995035648,"available":92267311104,"internally_reserved":0,"allocated":2811850752,"data_stored":2810568937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":915865600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:51:11 2024","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.71799999999999997,"15min":1.1120000000000001},"min":{"1min":0.20599999999999999,"5min":0.153,"15min":0.153},"max":{"1min":0.61299999999999999,"5min":6.1550000000000002,"15min":16.478000000000002},"last":0.245},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.97899999999999998,"15min":1.3979999999999999},"min":{"1min":0.23300000000000001,"5min":0.17899999999999999,"15min":0.17799999999999999},"max":{"1min":3.452,"5min":6.9359999999999999,"15min":13.422000000000001},"last":0.26900000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:51:11 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.60699999999999998,"15min":0.64300000000000002},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":2.0619999999999998,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.39700000000000002,"5min":1.0249999999999999,"15min":1.129},"min":{"1min":0.23699999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.69799999999999995,"5min":8.9960000000000004,"15min":8.9960000000000004},"last":0.34599999999999997}]},{"osd":3,"last update":"Mon Feb 19 21:51:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":1.107,"15min":1.698},"min":{"1min":0.255,"5min":0.217,"15min":0.21299999999999999},"max":{"1min":3.2080000000000002,"5min":12.691000000000001,"15min":14.507999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.94099999999999995,"15min":1.5740000000000001},"min":{"1min":0.308,"5min":0.24099999999999999,"15min":0.23400000000000001},"max":{"1min":3.722,"5min":6.6150000000000002,"15min":18.759},"last":0.28599999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:50:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":1.6759999999999999,"15min":1.698},"min":{"1min":0.29899999999999999,"5min":0.252,"15min":0.252},"max":{"1min":4.4530000000000003,"5min":10.311,"15min":13.278},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.6160000000000001,"15min":1.5589999999999999},"min":{"1min":0.35499999999999998,"5min":0.28999999999999998,"15min":0.255},"max":{"1min":9.0530000000000008,"5min":10.109,"15min":10.109},"last":0.375}]},{"osd":5,"last update":"Mon Feb 19 21:51:01 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":1.911,"15min":2.097},"min":{"1min":0.32500000000000001,"5min":0.317,"15min":0.27600000000000002},"max":{"1min":3.52,"5min":25.442,"15min":42.799999999999997},"last":0.437},{"interface":"front","average":{"1min":0.61199999999999999,"5min":1.9139999999999999,"15min":2.097},"min":{"1min":0.33200000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.597,"5min":25.411999999999999,"15min":42.695},"last":0.38800000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:50:16 2024","interfaces":[{"interface":"back","average":{"1min":2.2309999999999999,"5min":1.909,"15min":1.7070000000000001},"min":{"1min":0.33400000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":10.098000000000001,"5min":10.278,"15min":42.777000000000001},"last":0.495},{"interface":"front","average":{"1min":1.897,"5min":1.931,"15min":1.9590000000000001},"min":{"1min":0.39900000000000002,"5min":0.29599999999999999,"15min":0.28599999999999998},"max":{"1min":10.058999999999999,"5min":11.84,"15min":13.289999999999999},"last":0.48599999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":1.6579999999999999,"15min":1.8220000000000001},"min":{"1min":0.375,"5min":0.36799999999999999,"15min":0.31},"max":{"1min":4.0049999999999999,"5min":15.688000000000001,"15min":42.758000000000003},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.751,"5min":1.647,"15min":1.746},"min":{"1min":0.41199999999999998,"5min":0.36399999999999999,"15min":0.33200000000000002},"max":{"1min":4.0170000000000003,"5min":10.470000000000001,"15min":42.718000000000004},"last":0.46899999999999997}]}]},{"osd":2,"up_from":394,"seq":1692217114650,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2100880,"kb_used_data":1776840,"kb_used_omap":0,"kb_used_meta":324031,"kb_avail":91644272,"statfs":{"total":95995035648,"available":93843734528,"internally_reserved":0,"allocated":1819484160,"data_stored":1818222527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":331807796},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,2,1,1,3,5,7],"upper_bound":4096},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":1.044,"15min":1.1259999999999999},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":4.6219999999999999,"5min":9.1530000000000005,"15min":9.1530000000000005},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":1.0589999999999999,"15min":1.1679999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":2.2919999999999998,"5min":6.149,"15min":6.149},"last":0.26100000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.56699999999999995,"15min":0.60299999999999998},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.69899999999999995,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.89700000000000002,"15min":0.94399999999999995},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":4.6689999999999996,"5min":6.992,"15min":6.992},"last":0.27500000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":1.3169999999999999,"15min":1.405},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":6.0970000000000004,"5min":6.9470000000000001,"15min":6.9470000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":1.149,"15min":1.2450000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":2.258,"5min":6.6500000000000004,"15min":6.6500000000000004},"last":0.48299999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":1.867,"15min":2.0609999999999999},"min":{"1min":0.32600000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":3.8740000000000001,"5min":7.0339999999999998,"15min":7.0339999999999998},"last":0.436},{"interface":"front","average":{"1min":0.79800000000000004,"5min":1.7250000000000001,"15min":1.879},"min":{"1min":0.30299999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":4.7009999999999996,"5min":7.0419999999999998,"15min":7.0419999999999998},"last":0.39900000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.6870000000000001,"15min":1.7549999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":5.9260000000000002,"5min":10.067,"15min":10.067},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.63,"5min":1.5820000000000001,"15min":1.7410000000000001},"min":{"1min":0.34999999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":3.8730000000000002,"5min":13.558,"15min":13.558},"last":0.40699999999999997}]},{"osd":6,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":1.5600000000000001,"15min":1.6879999999999999},"min":{"1min":0.33700000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":3.843,"5min":5.6829999999999998,"15min":5.6829999999999998},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.97199999999999998,"15min":1.018},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.2719999999999998,"5min":7,"15min":7},"last":0.51200000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.3740000000000001,"15min":1.427},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":4.1230000000000002,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.78000000000000003,"15min":0.82299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.67700000000000005,"5min":2.782,"15min":2.782},"last":0.47499999999999998}]}]},{"osd":3,"up_from":0,"seq":111669149948,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":32,"seq":137438953717,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3589272,"kb_used_data":2991376,"kb_used_omap":0,"kb_used_meta":597888,"kb_avail":90155880,"statfs":{"total":95995035648,"available":92319621120,"internally_reserved":0,"allocated":3063169024,"data_stored":3061898545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":612237312},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:50:33 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":2.173,"15min":1.905},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":5.8780000000000001,"5min":53.936,"15min":53.936},"last":0.29399999999999998},{"interface":"front","average":{"1min":1.282,"5min":2.3889999999999998,"15min":2.069},"min":{"1min":0.25900000000000001,"5min":0.23000000000000001,"15min":0.22600000000000001},"max":{"1min":9.7230000000000008,"5min":54.405999999999999,"15min":54.405999999999999},"last":0.46500000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:50:33 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":2.2669999999999999,"15min":1.7669999999999999},"min":{"1min":0.26500000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":5.8490000000000002,"5min":54.731000000000002,"15min":54.731000000000002},"last":0.26300000000000001},{"interface":"front","average":{"1min":1.375,"5min":2.198,"15min":1.665},"min":{"1min":0.255,"5min":0.252,"15min":0.25},"max":{"1min":9.7639999999999993,"5min":52.490000000000002,"15min":52.490000000000002},"last":0.42599999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:51:10 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":1.77,"15min":1.974},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.274,"5min":9.0619999999999994,"15min":9.0619999999999994},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":1.8069999999999999,"15min":2.0110000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.2930000000000001,"5min":9.0899999999999999,"15min":9.0899999999999999},"last":0.35299999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:50:33 2024","interfaces":[{"interface":"back","average":{"1min":1.653,"5min":1.6799999999999999,"15min":1.6899999999999999},"min":{"1min":0.372,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":6.3170000000000002,"5min":6.5579999999999998,"15min":15.914999999999999},"last":2.464},{"interface":"front","average":{"1min":1.115,"5min":1.7889999999999999,"15min":1.6879999999999999},"min":{"1min":0.40799999999999997,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":7.9569999999999999,"5min":9.4000000000000004,"15min":13.321},"last":0.38100000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:50:22 2024","interfaces":[{"interface":"back","average":{"1min":2.0899999999999999,"5min":2.3780000000000001,"15min":1.7330000000000001},"min":{"1min":0.33300000000000002,"5min":0.23799999999999999,"15min":0.23400000000000001},"max":{"1min":13.805999999999999,"5min":16.731999999999999,"15min":18.916},"last":0.40500000000000003},{"interface":"front","average":{"1min":1.889,"5min":2.3500000000000001,"15min":1.9390000000000001},"min":{"1min":0.35999999999999999,"5min":0.26200000000000001,"15min":0.253},"max":{"1min":7.3719999999999999,"5min":8.2959999999999994,"15min":14.840999999999999},"last":2.4239999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:50:33 2024","interfaces":[{"interface":"back","average":{"1min":1.756,"5min":1.9630000000000001,"15min":1.615},"min":{"1min":0.40200000000000002,"5min":0.28999999999999998,"15min":0.28599999999999998},"max":{"1min":7.4050000000000002,"5min":9.1720000000000006,"15min":13.27},"last":2.4940000000000002},{"interface":"front","average":{"1min":2.0819999999999999,"5min":2.4710000000000001,"15min":1.823},"min":{"1min":0.34300000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":13.715,"5min":18.670000000000002,"15min":18.670000000000002},"last":0.44400000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:51:00 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":2.1309999999999998,"15min":1.7669999999999999},"min":{"1min":0.34599999999999997,"5min":0.311,"15min":0.28899999999999998},"max":{"1min":2.4780000000000002,"5min":16.763999999999999,"15min":16.763999999999999},"last":0.627},{"interface":"front","average":{"1min":0.63,"5min":1.71,"15min":1.6859999999999999},"min":{"1min":0.377,"5min":0.314,"15min":0.31},"max":{"1min":1.23,"5min":10.044,"15min":12.808999999999999},"last":2.5310000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757489,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2782604,"kb_used_data":1892164,"kb_used_omap":0,"kb_used_meta":890432,"kb_avail":90962548,"statfs":{"total":95995035648,"available":93145649152,"internally_reserved":0,"allocated":1937575936,"data_stored":1936317844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":911802368},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":1.5169999999999999,"15min":1.7729999999999999},"min":{"1min":0.23100000000000001,"5min":0.214,"15min":0.20599999999999999},"max":{"1min":5.9550000000000001,"5min":19.236000000000001,"15min":20.550999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.85499999999999998,"5min":1.4850000000000001,"15min":1.9059999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.20899999999999999},"max":{"1min":3.7949999999999999,"5min":10.887,"15min":20.879000000000001},"last":0.28699999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":1.462,"15min":1.726},"min":{"1min":0.28100000000000003,"5min":0.24299999999999999,"15min":0.23100000000000001},"max":{"1min":2.3220000000000001,"5min":8.2010000000000005,"15min":10.42},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":1.506,"15min":1.6100000000000001},"min":{"1min":0.28299999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.522,"5min":10.965,"15min":10.965},"last":0.46800000000000003}]},{"osd":2,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.29,"15min":1.361},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":7.0380000000000003,"5min":7.0380000000000003,"15min":7.0380000000000003},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.2450000000000001,"15min":1.29},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.1869999999999998,"5min":4.2619999999999996,"15min":4.2619999999999996},"last":0.35999999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":1.804,"15min":2.0779999999999998},"min":{"1min":0.35099999999999998,"5min":0.26100000000000001,"15min":0.24099999999999999},"max":{"1min":3.6320000000000001,"5min":19.321000000000002,"15min":20.146999999999998},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.5169999999999999,"15min":2.1520000000000001},"min":{"1min":0.33600000000000002,"5min":0.311,"15min":0.29499999999999998},"max":{"1min":3.6400000000000001,"5min":8.0359999999999996,"15min":20.120000000000001},"last":0.71499999999999997}]},{"osd":4,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":1.4239999999999999,"15min":1.393},"min":{"1min":0.255,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.0449999999999999,"5min":16.643999999999998,"15min":21.577000000000002},"last":0.435},{"interface":"front","average":{"1min":0.59799999999999998,"5min":1.913,"15min":1.883},"min":{"1min":0.32600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.3999999999999999,"5min":19.274000000000001,"15min":19.274000000000001},"last":0.36799999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:50:30 2024","interfaces":[{"interface":"back","average":{"1min":2.0649999999999999,"5min":2.29,"15min":1.8979999999999999},"min":{"1min":0.34000000000000002,"5min":0.307,"15min":0.221},"max":{"1min":8.109,"5min":19.884,"15min":19.884},"last":0.44600000000000001},{"interface":"front","average":{"1min":1.6679999999999999,"5min":2.044,"15min":1.867},"min":{"1min":0.44900000000000001,"5min":0.26700000000000002,"15min":0.23599999999999999},"max":{"1min":6.0750000000000002,"5min":10.260999999999999,"15min":13.532999999999999},"last":0.39700000000000002}]},{"osd":7,"last update":"Mon Feb 19 21:50:54 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":2.129,"15min":2.0249999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.27100000000000002},"max":{"1min":2.4900000000000002,"5min":12.611000000000001,"15min":12.962},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.626,"5min":2.024,"15min":1.8360000000000001},"min":{"1min":0.38100000000000001,"5min":0.221,"15min":0.221},"max":{"1min":1.681,"5min":15.593999999999999,"15min":17.759},"last":0.629}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2804092928,"data_stored":2804088856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1122566144,"data_stored":1122566144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1813643264,"data_stored":1813643264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3057717248,"data_stored":3057713176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1931935744,"data_stored":1931935744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1961562112,"data_stored":1961558040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":831913984,"data_stored":831913984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:51:20.923 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:20.924 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:51:20.924 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:51:21.025 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:51:21.077 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:51:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:51:20] "GET /metrics HTTP/1.1" 200 176570 "" "Prometheus/2.33.4" 2024-02-19T21:51:21.179 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:21.306 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:51:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:51:21.632 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:51:21.633 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:51:21.635 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:21.635 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:51:21.736 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:51:21.767 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:21.014342+0000 mgr.y (mgr.14514) 715 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:51:21.772 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:21.793 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:51:21.796 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:21.796 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:51:21.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:21.014342+0000 mgr.y (mgr.14514) 715 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:51:21.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:21.014342+0000 mgr.y (mgr.14514) 715 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:51:21.897 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:51:21.923 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:21.946 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:51:21.949 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:21.950 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:51:22.050 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:51:22.083 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:22.184 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:51:22.187 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:22.188 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:51:22.289 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:51:22.315 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:22.334 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:51:22.337 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:22.337 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:51:22.438 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:51:22.465 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-02-19T21:51:22.468 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:22.494 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:51:22.499 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:22.500 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:51:22.601 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:51:22.638 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:22.740 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:51:22.743 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:22.744 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:51:22.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:21.190665+0000 mgr.y (mgr.14514) 716 : cluster [DBG] pgmap v931: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 133 active+clean, 4 active+recovering+undersized+degraded+remapped; 4.1 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 205 op/s; 2275/202632 objects degraded (1.123%); 7454/202632 objects misplaced (3.679%); 15 MiB/s, 237 objects/s recovering 2024-02-19T21:51:22.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:21.454864+0000 mon.a (mon.0) 1735 : cluster [DBG] osdmap e445: 8 total, 8 up, 7 in 2024-02-19T21:51:22.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:21.530508+0000 mon.c (mon.2) 107 : audit [INF] from='client.? 172.21.15.80:0/1416486301' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:51:22.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:21.530799+0000 mon.a (mon.0) 1736 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:51:22.745 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:21.190665+0000 mgr.y (mgr.14514) 716 : cluster [DBG] pgmap v931: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 133 active+clean, 4 active+recovering+undersized+degraded+remapped; 4.1 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 205 op/s; 2275/202632 objects degraded (1.123%); 7454/202632 objects misplaced (3.679%); 15 MiB/s, 237 objects/s recovering 2024-02-19T21:51:22.745 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:21.454864+0000 mon.a (mon.0) 1735 : cluster [DBG] osdmap e445: 8 total, 8 up, 7 in 2024-02-19T21:51:22.745 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:21.530508+0000 mon.c (mon.2) 107 : audit [INF] from='client.? 172.21.15.80:0/1416486301' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:51:22.745 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:21.530799+0000 mon.a (mon.0) 1736 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:51:22.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:21.190665+0000 mgr.y (mgr.14514) 716 : cluster [DBG] pgmap v931: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 133 active+clean, 4 active+recovering+undersized+degraded+remapped; 4.1 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 205 op/s; 2275/202632 objects degraded (1.123%); 7454/202632 objects misplaced (3.679%); 15 MiB/s, 237 objects/s recovering 2024-02-19T21:51:22.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:21.454864+0000 mon.a (mon.0) 1735 : cluster [DBG] osdmap e445: 8 total, 8 up, 7 in 2024-02-19T21:51:22.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:21.530508+0000 mon.c (mon.2) 107 : audit [INF] from='client.? 172.21.15.80:0/1416486301' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:51:22.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:21.530799+0000 mon.a (mon.0) 1736 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:51:22.844 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:51:22.873 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:22.895 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:51:22.898 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:22.899 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:51:22.999 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:51:23.024 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:23.043 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:51:23.046 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:23.047 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:51:23.148 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:51:23.174 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:23.198 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:51:23.200 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:23.201 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:51:23.301 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:51:23.331 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:23.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:22.452138+0000 mon.a (mon.0) 1737 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:51:23.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:22.456438+0000 mon.a (mon.0) 1738 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:51:23.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:22.456509+0000 mon.a (mon.0) 1739 : cluster [DBG] osdmap e446: 8 total, 8 up, 7 in 2024-02-19T21:51:23.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:22.452138+0000 mon.a (mon.0) 1737 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:51:23.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:22.456438+0000 mon.a (mon.0) 1738 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:51:23.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:22.456509+0000 mon.a (mon.0) 1739 : cluster [DBG] osdmap e446: 8 total, 8 up, 7 in 2024-02-19T21:51:23.658 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:51:23.661 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:23.661 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:51:23.762 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:51:23.786 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:22.452138+0000 mon.a (mon.0) 1737 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:51:23.787 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:22.456438+0000 mon.a (mon.0) 1738 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:51:23.787 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:22.456509+0000 mon.a (mon.0) 1739 : cluster [DBG] osdmap e446: 8 total, 8 up, 7 in 2024-02-19T21:51:23.788 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:23.807 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:51:23.810 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:23.810 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:51:23.911 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:51:23.923 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:51:23.939 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:23.959 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:51:23.961 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:23.962 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:51:24.063 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:51:24.090 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:24.467 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:23.191216+0000 mgr.y (mgr.14514) 717 : cluster [DBG] pgmap v934: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 133 active+clean, 4 active+recovering+undersized+degraded+remapped; 4.1 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 889 B/s rd, 0 B/s wr, 176 op/s; 2227/202317 objects degraded (1.101%); 7399/202317 objects misplaced (3.657%); 12 MiB/s, 191 objects/s recovering 2024-02-19T21:51:24.467 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:23.191216+0000 mgr.y (mgr.14514) 717 : cluster [DBG] pgmap v934: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 133 active+clean, 4 active+recovering+undersized+degraded+remapped; 4.1 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 889 B/s rd, 0 B/s wr, 176 op/s; 2227/202317 objects degraded (1.101%); 7399/202317 objects misplaced (3.657%); 12 MiB/s, 191 objects/s recovering 2024-02-19T21:51:24.543 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:51:24.546 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:24.546 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:51:24.581 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:51:24.600 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:51:24.618 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:51:24.636 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:51:24.648 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:51:24.655 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:51:24.677 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:51:24.683 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:24.705 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:51:24.730 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:51:24.732 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:51:24.732 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:51:24.732 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:51:24.732 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:51:24.732 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:51:24.732 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:51:24.732 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:51:24.732 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:51:24.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:23.191216+0000 mgr.y (mgr.14514) 717 : cluster [DBG] pgmap v934: 138 pgs: 1 active+remapped+backfill_wait+backfill_toofull, 133 active+clean, 4 active+recovering+undersized+degraded+remapped; 4.1 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 889 B/s rd, 0 B/s wr, 176 op/s; 2227/202317 objects degraded (1.101%); 7399/202317 objects misplaced (3.657%); 12 MiB/s, 191 objects/s recovering 2024-02-19T21:51:25.806 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:51:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:51:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:51:25.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:24.561615+0000 mon.c (mon.2) 108 : audit [DBG] from='client.? 172.21.15.80:0/2308435662' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:51:25.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:25.290603+0000 mon.a (mon.0) 1740 : cluster [WRN] Health check update: Degraded data redundancy: 2227/202317 objects degraded (1.101%), 4 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:25.821 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:51:25.826 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:51:25.826 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:51:25.839 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:51:25.841 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:24.561615+0000 mon.c (mon.2) 108 : audit [DBG] from='client.? 172.21.15.80:0/2308435662' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:51:25.841 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:25.290603+0000 mon.a (mon.0) 1740 : cluster [WRN] Health check update: Degraded data redundancy: 2227/202317 objects degraded (1.101%), 4 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:25.841 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:24.561615+0000 mon.c (mon.2) 108 : audit [DBG] from='client.? 172.21.15.80:0/2308435662' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:51:25.842 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:25.290603+0000 mon.a (mon.0) 1740 : cluster [WRN] Health check update: Degraded data redundancy: 2227/202317 objects degraded (1.101%), 4 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:25.842 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:25.843 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:51:25.943 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:51:25.972 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:25.996 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:51:25.999 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:26.000 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:51:26.100 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:51:26.131 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:26.334 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:51:26.336 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:26.337 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:51:26.437 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:51:26.469 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:26.503 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:51:26.508 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:26.508 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:51:26.609 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:51:26.637 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:26.657 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:51:26.660 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:26.661 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:51:26.761 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:51:26.785 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:25.191740+0000 mgr.y (mgr.14514) 718 : cluster [DBG] pgmap v935: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 4.1 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 257 op/s; 1999/200724 objects degraded (0.996%); 7134/200724 objects misplaced (3.554%); 15 MiB/s, 265 objects/s recovering 2024-02-19T21:51:26.786 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:25.241473+0000 osd.4 (osd.4) 209 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:51:26.786 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:25.241515+0000 osd.4 (osd.4) 210 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:51:26.786 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:25.466466+0000 mon.a (mon.0) 1741 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-19T21:51:26.786 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:25.492347+0000 mon.a (mon.0) 1742 : cluster [DBG] osdmap e447: 8 total, 8 up, 7 in 2024-02-19T21:51:26.787 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:26.806 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:51:26.808 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:26.809 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:51:26.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:25.191740+0000 mgr.y (mgr.14514) 718 : cluster [DBG] pgmap v935: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 4.1 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 257 op/s; 1999/200724 objects degraded (0.996%); 7134/200724 objects misplaced (3.554%); 15 MiB/s, 265 objects/s recovering 2024-02-19T21:51:26.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:25.241473+0000 osd.4 (osd.4) 209 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:51:26.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:25.241515+0000 osd.4 (osd.4) 210 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:51:26.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:25.466466+0000 mon.a (mon.0) 1741 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-19T21:51:26.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:25.492347+0000 mon.a (mon.0) 1742 : cluster [DBG] osdmap e447: 8 total, 8 up, 7 in 2024-02-19T21:51:26.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:25.191740+0000 mgr.y (mgr.14514) 718 : cluster [DBG] pgmap v935: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 4.1 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 257 op/s; 1999/200724 objects degraded (0.996%); 7134/200724 objects misplaced (3.554%); 15 MiB/s, 265 objects/s recovering 2024-02-19T21:51:26.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:25.241473+0000 osd.4 (osd.4) 209 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:51:26.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:25.241515+0000 osd.4 (osd.4) 210 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:51:26.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:25.466466+0000 mon.a (mon.0) 1741 : cluster [INF] Health check cleared: PG_BACKFILL_FULL (was: Low space hindering backfill (add storage if this doesn't resolve itself): 1 pg backfill_toofull) 2024-02-19T21:51:26.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:25.492347+0000 mon.a (mon.0) 1742 : cluster [DBG] osdmap e447: 8 total, 8 up, 7 in 2024-02-19T21:51:26.910 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:51:26.938 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:26.941 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-19T21:51:26.977 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:51:26.982 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:26.982 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:51:27.083 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:51:27.108 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:27.130 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:51:27.132 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:27.133 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:51:27.233 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:51:27.262 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:27.285 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:51:27.289 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:27.289 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:51:27.390 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:51:27.411 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.3 dump_ops_in_flight 2024-02-19T21:51:27.432 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:27.581 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:51:27.886 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:51:27.889 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:27.890 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:51:27.990 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:51:28.017 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:28.216 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:51:28.219 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:28.220 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:51:28.320 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:51:28.345 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:28.370 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:51:28.374 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:28.374 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:51:28.475 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:51:28.478 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:51:28.486 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:51:28.503 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:28.523 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:51:28.525 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:28.526 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:51:28.626 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:51:28.651 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:27.192196+0000 mgr.y (mgr.14514) 719 : cluster [DBG] pgmap v937: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 4.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 175 op/s; 1884/199488 objects degraded (0.944%); 7023/199488 objects misplaced (3.521%); 5.1 MiB/s, 109 objects/s recovering 2024-02-19T21:51:28.653 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:28.674 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:51:28.678 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:28.678 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:51:28.722 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:51:28.724 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:51:28.779 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:51:28.802 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:27.192196+0000 mgr.y (mgr.14514) 719 : cluster [DBG] pgmap v937: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 4.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 175 op/s; 1884/199488 objects degraded (0.944%); 7023/199488 objects misplaced (3.521%); 5.1 MiB/s, 109 objects/s recovering 2024-02-19T21:51:28.802 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:27.192196+0000 mgr.y (mgr.14514) 719 : cluster [DBG] pgmap v937: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 4.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 175 op/s; 1884/199488 objects degraded (0.944%); 7023/199488 objects misplaced (3.521%); 5.1 MiB/s, 109 objects/s recovering 2024-02-19T21:51:28.805 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:28.829 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:51:28.832 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:28.832 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:51:28.933 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:51:28.961 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:28.987 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:51:28.990 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:28.990 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:51:29.091 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:51:29.119 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:29.502 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:28.702973+0000 mgr.y (mgr.14514) 720 : audit [DBG] from='client.25721 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:51:29.668 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:51:29.673 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:29.673 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:51:29.774 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:51:29.798 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:28.702973+0000 mgr.y (mgr.14514) 720 : audit [DBG] from='client.25721 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:51:29.800 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:29.818 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:51:29.821 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:29.821 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:51:29.833 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:28.702973+0000 mgr.y (mgr.14514) 720 : audit [DBG] from='client.25721 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:51:29.922 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:51:29.950 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:29.974 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:51:29.976 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:29.977 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:51:30.077 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:51:30.109 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:30.258 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:51:30.264 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:30.265 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:51:30.366 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:51:30.397 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:30.771 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:29.192603+0000 mgr.y (mgr.14514) 721 : cluster [DBG] pgmap v938: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 4.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 661 B/s rd, 0 B/s wr, 136 op/s; 1884/199488 objects degraded (0.944%); 7023/199488 objects misplaced (3.521%); 3.9 MiB/s, 85 objects/s recovering 2024-02-19T21:51:30.771 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:30.292433+0000 mon.a (mon.0) 1743 : cluster [WRN] Health check update: Degraded data redundancy: 1884/199488 objects degraded (0.944%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:30.771 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:30.302352+0000 mon.a (mon.0) 1744 : cluster [DBG] osdmap e448: 8 total, 8 up, 7 in 2024-02-19T21:51:30.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:29.192603+0000 mgr.y (mgr.14514) 721 : cluster [DBG] pgmap v938: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 4.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 661 B/s rd, 0 B/s wr, 136 op/s; 1884/199488 objects degraded (0.944%); 7023/199488 objects misplaced (3.521%); 3.9 MiB/s, 85 objects/s recovering 2024-02-19T21:51:30.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:30.292433+0000 mon.a (mon.0) 1743 : cluster [WRN] Health check update: Degraded data redundancy: 1884/199488 objects degraded (0.944%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:30.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:30.302352+0000 mon.a (mon.0) 1744 : cluster [DBG] osdmap e448: 8 total, 8 up, 7 in 2024-02-19T21:51:30.775 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:51:30.805 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":937,"stamp":"2024-02-19T21:51:27.191911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4345239228,"num_objects":66496,"num_object_clones":0,"num_object_copies":199488,"num_objects_missing_on_primary":594,"num_objects_missing":594,"num_objects_degraded":1884,"num_objects_misplaced":7023,"num_objects_unfound":0,"num_objects_dirty":66496,"num_whiteouts":0,"num_read":2246,"num_read_kb":1998,"num_write":83904,"num_write_kb":4783849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10147,"num_bytes_recovered":634919816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81437,"ondisk_log_size":81437,"up":414,"acting":411,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":417,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":656216064,"kb_used":17465532,"kb_used_data":12979396,"kb_used_omap":0,"kb_used_meta":4486079,"kb_avail":638750532,"statfs":{"total":671965249536,"available":654080544768,"internally_reserved":0,"allocated":13290901504,"data_stored":13281842053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":4593744948},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-68681728,"num_objects":-1048,"num_object_clones":0,"num_object_copies":-3144,"num_objects_missing_on_primary":-105,"num_objects_missing":-105,"num_objects_degraded":-391,"num_objects_misplaced":-431,"num_objects_unfound":0,"num_objects_dirty":-1048,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1048,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":658,"num_bytes_recovered":31981568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001659"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":42,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455646+0000","last_change":"2024-02-19T21:49:54.492937+0000","last_active":"2024-02-19T21:51:21.455646+0000","last_peered":"2024-02-19T21:51:21.455646+0000","last_clean":"2024-02-19T21:51:21.455646+0000","last_became_active":"2024-02-19T21:49:54.492544+0000","last_became_peered":"2024-02-19T21:49:54.492544+0000","last_unstale":"2024-02-19T21:51:21.455646+0000","last_undegraded":"2024-02-19T21:51:21.455646+0000","last_fullsized":"2024-02-19T21:51:21.455646+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.643236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.643236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":421,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.454234+0000","last_change":"2024-02-19T21:45:17.201007+0000","last_active":"2024-02-19T21:51:21.454234+0000","last_peered":"2024-02-19T21:51:21.454234+0000","last_clean":"2024-02-19T21:51:21.454234+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:51:21.454234+0000","last_undegraded":"2024-02-19T21:51:21.454234+0000","last_fullsized":"2024-02-19T21:51:21.454234+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:17.200897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:17.200897+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"201'27","reported_seq":91,"reported_epoch":446,"state":"active+clean","last_fresh":"2024-02-19T21:51:22.457604+0000","last_change":"2024-02-19T21:49:08.327817+0000","last_active":"2024-02-19T21:51:22.457604+0000","last_peered":"2024-02-19T21:51:22.457604+0000","last_clean":"2024-02-19T21:51:22.457604+0000","last_became_active":"2024-02-19T21:49:08.327416+0000","last_became_peered":"2024-02-19T21:49:08.327416+0000","last_unstale":"2024-02-19T21:51:22.457604+0000","last_undegraded":"2024-02-19T21:51:22.457604+0000","last_fullsized":"2024-02-19T21:51:22.457604+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'27","last_scrub_stamp":"2024-02-19T21:44:48.022013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:48.022013+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":394,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.568118+0000","last_change":"2024-02-19T21:48:30.516215+0000","last_active":"2024-02-19T21:51:21.568118+0000","last_peered":"2024-02-19T21:51:21.568118+0000","last_clean":"2024-02-19T21:51:21.568118+0000","last_became_active":"2024-02-19T21:47:46.250178+0000","last_became_peered":"2024-02-19T21:47:46.250178+0000","last_unstale":"2024-02-19T21:51:21.568118+0000","last_undegraded":"2024-02-19T21:51:21.568118+0000","last_fullsized":"2024-02-19T21:51:21.568118+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.516139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.516139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":117,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455234+0000","last_change":"2024-02-19T21:49:08.330105+0000","last_active":"2024-02-19T21:51:21.455234+0000","last_peered":"2024-02-19T21:51:21.455234+0000","last_clean":"2024-02-19T21:51:21.455234+0000","last_became_active":"2024-02-19T21:49:08.328994+0000","last_became_peered":"2024-02-19T21:49:08.328994+0000","last_unstale":"2024-02-19T21:51:21.455234+0000","last_undegraded":"2024-02-19T21:51:21.455234+0000","last_fullsized":"2024-02-19T21:51:21.455234+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.636083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.636083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"200'19","reported_seq":490,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.567685+0000","last_change":"2024-02-19T21:48:26.530234+0000","last_active":"2024-02-19T21:51:21.567685+0000","last_peered":"2024-02-19T21:51:21.567685+0000","last_clean":"2024-02-19T21:51:21.567685+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:51:21.567685+0000","last_undegraded":"2024-02-19T21:51:21.567685+0000","last_fullsized":"2024-02-19T21:51:21.567685+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:48:26.530160+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.530160+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":178,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.457500+0000","last_change":"2024-02-19T21:49:08.332091+0000","last_active":"2024-02-19T21:51:21.457500+0000","last_peered":"2024-02-19T21:51:21.457500+0000","last_clean":"2024-02-19T21:51:21.457500+0000","last_became_active":"2024-02-19T21:49:08.331753+0000","last_became_peered":"2024-02-19T21:49:08.331753+0000","last_unstale":"2024-02-19T21:51:21.457500+0000","last_undegraded":"2024-02-19T21:51:21.457500+0000","last_fullsized":"2024-02-19T21:51:21.457500+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.005236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.005236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":434,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.456673+0000","last_change":"2024-02-19T21:48:28.327028+0000","last_active":"2024-02-19T21:51:21.456673+0000","last_peered":"2024-02-19T21:51:21.456673+0000","last_clean":"2024-02-19T21:51:21.456673+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:51:21.456673+0000","last_undegraded":"2024-02-19T21:51:21.456673+0000","last_fullsized":"2024-02-19T21:51:21.456673+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.326938+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"310'9","reported_seq":390,"reported_epoch":446,"state":"active+clean","last_fresh":"2024-02-19T21:51:24.052433+0000","last_change":"2024-02-19T21:51:24.053067+0000","last_active":"2024-02-19T21:51:24.052433+0000","last_peered":"2024-02-19T21:51:24.052433+0000","last_clean":"2024-02-19T21:51:24.052433+0000","last_became_active":"2024-02-19T21:49:08.329314+0000","last_became_peered":"2024-02-19T21:49:08.329314+0000","last_unstale":"2024-02-19T21:51:24.052433+0000","last_undegraded":"2024-02-19T21:51:24.052433+0000","last_fullsized":"2024-02-19T21:51:24.052433+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"310'9","last_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_deep_scrub":"310'9","last_deep_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.506188+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":355,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.457063+0000","last_change":"2024-02-19T21:46:31.205220+0000","last_active":"2024-02-19T21:51:21.457063+0000","last_peered":"2024-02-19T21:51:21.457063+0000","last_clean":"2024-02-19T21:51:21.457063+0000","last_became_active":"2024-02-19T21:46:31.204816+0000","last_became_peered":"2024-02-19T21:46:31.204816+0000","last_unstale":"2024-02-19T21:51:21.457063+0000","last_undegraded":"2024-02-19T21:51:21.457063+0000","last_fullsized":"2024-02-19T21:51:21.457063+0000","mapping_epoch":330,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":331,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:36.890201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.890201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":456,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455963+0000","last_change":"2024-02-19T21:49:08.330669+0000","last_active":"2024-02-19T21:51:21.455963+0000","last_peered":"2024-02-19T21:51:21.455963+0000","last_clean":"2024-02-19T21:51:21.455963+0000","last_became_active":"2024-02-19T21:49:08.329998+0000","last_became_peered":"2024-02-19T21:49:08.329998+0000","last_unstale":"2024-02-19T21:51:21.455963+0000","last_undegraded":"2024-02-19T21:51:21.455963+0000","last_fullsized":"2024-02-19T21:51:21.455963+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:58.329316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:58.329316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"200'19","reported_seq":300,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.568218+0000","last_change":"2024-02-19T21:49:08.326162+0000","last_active":"2024-02-19T21:51:21.568218+0000","last_peered":"2024-02-19T21:51:21.568218+0000","last_clean":"2024-02-19T21:51:21.568218+0000","last_became_active":"2024-02-19T21:49:08.325802+0000","last_became_peered":"2024-02-19T21:49:08.325802+0000","last_unstale":"2024-02-19T21:51:21.568218+0000","last_undegraded":"2024-02-19T21:51:21.568218+0000","last_fullsized":"2024-02-19T21:51:21.568218+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:46:54.873416+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:46:54.873416+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2],"acting":[4,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":366,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.527912+0000","last_change":"2024-02-19T21:49:04.432817+0000","last_active":"2024-02-19T21:51:21.527912+0000","last_peered":"2024-02-19T21:51:21.527912+0000","last_clean":"2024-02-19T21:51:21.527912+0000","last_became_active":"2024-02-19T21:47:33.393708+0000","last_became_peered":"2024-02-19T21:47:33.393708+0000","last_unstale":"2024-02-19T21:51:21.527912+0000","last_undegraded":"2024-02-19T21:51:21.527912+0000","last_fullsized":"2024-02-19T21:51:21.527912+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:04.432733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:04.432733+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":42,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455732+0000","last_change":"2024-02-19T21:49:54.492767+0000","last_active":"2024-02-19T21:51:21.455732+0000","last_peered":"2024-02-19T21:51:21.455732+0000","last_clean":"2024-02-19T21:51:21.455732+0000","last_became_active":"2024-02-19T21:49:54.491745+0000","last_became_peered":"2024-02-19T21:49:54.491745+0000","last_unstale":"2024-02-19T21:51:21.455732+0000","last_undegraded":"2024-02-19T21:51:21.455732+0000","last_fullsized":"2024-02-19T21:51:21.455732+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.232539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.232539+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1d","version":"201'18","reported_seq":384,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455056+0000","last_change":"2024-02-19T21:48:25.734661+0000","last_active":"2024-02-19T21:51:21.455056+0000","last_peered":"2024-02-19T21:51:21.455056+0000","last_clean":"2024-02-19T21:51:21.455056+0000","last_became_active":"2024-02-19T21:38:31.247067+0000","last_became_peered":"2024-02-19T21:38:31.247067+0000","last_unstale":"2024-02-19T21:51:21.455056+0000","last_undegraded":"2024-02-19T21:51:21.455056+0000","last_fullsized":"2024-02-19T21:51:21.455056+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'18","last_scrub_stamp":"2024-02-19T21:48:25.734591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.734591+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":421,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.569435+0000","last_change":"2024-02-19T21:48:40.528082+0000","last_active":"2024-02-19T21:51:21.569435+0000","last_peered":"2024-02-19T21:51:21.569435+0000","last_clean":"2024-02-19T21:51:21.569435+0000","last_became_active":"2024-02-19T21:44:58.788307+0000","last_became_peered":"2024-02-19T21:44:58.788307+0000","last_unstale":"2024-02-19T21:51:21.569435+0000","last_undegraded":"2024-02-19T21:51:21.569435+0000","last_fullsized":"2024-02-19T21:51:21.569435+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:40.527970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:48:40.527970+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":429,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.527488+0000","last_change":"2024-02-19T21:48:11.557832+0000","last_active":"2024-02-19T21:51:21.527488+0000","last_peered":"2024-02-19T21:51:21.527488+0000","last_clean":"2024-02-19T21:51:21.527488+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:51:21.527488+0000","last_undegraded":"2024-02-19T21:51:21.527488+0000","last_fullsized":"2024-02-19T21:51:21.527488+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.557736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:17.913620+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.557736+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"200'34","reported_seq":92,"reported_epoch":446,"state":"active+clean","last_fresh":"2024-02-19T21:51:22.458761+0000","last_change":"2024-02-19T21:49:08.332575+0000","last_active":"2024-02-19T21:51:22.458761+0000","last_peered":"2024-02-19T21:51:22.458761+0000","last_clean":"2024-02-19T21:51:22.458761+0000","last_became_active":"2024-02-19T21:49:08.331742+0000","last_became_peered":"2024-02-19T21:49:08.331742+0000","last_unstale":"2024-02-19T21:51:22.458761+0000","last_undegraded":"2024-02-19T21:51:22.458761+0000","last_fullsized":"2024-02-19T21:51:22.458761+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'34","last_scrub_stamp":"2024-02-19T21:45:49.728734+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:45:49.728734+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":441,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.454607+0000","last_change":"2024-02-19T21:46:44.994389+0000","last_active":"2024-02-19T21:51:21.454607+0000","last_peered":"2024-02-19T21:51:21.454607+0000","last_clean":"2024-02-19T21:51:21.454607+0000","last_became_active":"2024-02-19T21:44:58.790669+0000","last_became_peered":"2024-02-19T21:44:58.790669+0000","last_unstale":"2024-02-19T21:51:21.454607+0000","last_undegraded":"2024-02-19T21:51:21.454607+0000","last_fullsized":"2024-02-19T21:51:21.454607+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.994296+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":377,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.527158+0000","last_change":"2024-02-19T21:49:08.330330+0000","last_active":"2024-02-19T21:51:21.527158+0000","last_peered":"2024-02-19T21:51:21.527158+0000","last_clean":"2024-02-19T21:51:21.527158+0000","last_became_active":"2024-02-19T21:49:08.329986+0000","last_became_peered":"2024-02-19T21:49:08.329986+0000","last_unstale":"2024-02-19T21:51:21.527158+0000","last_undegraded":"2024-02-19T21:51:21.527158+0000","last_fullsized":"2024-02-19T21:51:21.527158+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.091409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.091409+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"201'19","reported_seq":325,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.454154+0000","last_change":"2024-02-19T21:48:26.366639+0000","last_active":"2024-02-19T21:51:21.454154+0000","last_peered":"2024-02-19T21:51:21.454154+0000","last_clean":"2024-02-19T21:51:21.454154+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:51:21.454154+0000","last_undegraded":"2024-02-19T21:51:21.454154+0000","last_fullsized":"2024-02-19T21:51:21.454154+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:26.366563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.366563+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":302,"reported_epoch":446,"state":"active+clean","last_fresh":"2024-02-19T21:51:22.461995+0000","last_change":"2024-02-19T21:51:22.461995+0000","last_active":"2024-02-19T21:51:22.461995+0000","last_peered":"2024-02-19T21:51:22.461995+0000","last_clean":"2024-02-19T21:51:22.461995+0000","last_became_active":"2024-02-19T21:51:22.461599+0000","last_became_peered":"2024-02-19T21:51:22.461599+0000","last_unstale":"2024-02-19T21:51:22.461995+0000","last_undegraded":"2024-02-19T21:51:22.461995+0000","last_fullsized":"2024-02-19T21:51:22.461995+0000","mapping_epoch":445,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":446,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:13.196112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:13.196112+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":441,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.458985+0000","last_change":"2024-02-19T21:49:54.491840+0000","last_active":"2024-02-19T21:51:21.458985+0000","last_peered":"2024-02-19T21:51:21.458985+0000","last_clean":"2024-02-19T21:51:21.458985+0000","last_became_active":"2024-02-19T21:49:54.491488+0000","last_became_peered":"2024-02-19T21:49:54.491488+0000","last_unstale":"2024-02-19T21:51:21.458985+0000","last_undegraded":"2024-02-19T21:51:21.458985+0000","last_fullsized":"2024-02-19T21:51:21.458985+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.803606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.803606+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"201'20","reported_seq":526,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455364+0000","last_change":"2024-02-19T21:49:54.502402+0000","last_active":"2024-02-19T21:51:21.455364+0000","last_peered":"2024-02-19T21:51:21.455364+0000","last_clean":"2024-02-19T21:51:21.455364+0000","last_became_active":"2024-02-19T21:49:54.483748+0000","last_became_peered":"2024-02-19T21:49:54.483748+0000","last_unstale":"2024-02-19T21:51:21.455364+0000","last_undegraded":"2024-02-19T21:51:21.455364+0000","last_fullsized":"2024-02-19T21:51:21.455364+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:48:25.348437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.348437+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":361,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.454154+0000","last_change":"2024-02-19T21:49:08.328206+0000","last_active":"2024-02-19T21:51:21.454154+0000","last_peered":"2024-02-19T21:51:21.454154+0000","last_clean":"2024-02-19T21:51:21.454154+0000","last_became_active":"2024-02-19T21:49:08.327865+0000","last_became_peered":"2024-02-19T21:49:08.327865+0000","last_unstale":"2024-02-19T21:51:21.454154+0000","last_undegraded":"2024-02-19T21:51:21.454154+0000","last_fullsized":"2024-02-19T21:51:21.454154+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.230652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.230652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":421,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455504+0000","last_change":"2024-02-19T21:48:22.171667+0000","last_active":"2024-02-19T21:51:21.455504+0000","last_peered":"2024-02-19T21:51:21.455504+0000","last_clean":"2024-02-19T21:51:21.455504+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:51:21.455504+0000","last_undegraded":"2024-02-19T21:51:21.455504+0000","last_fullsized":"2024-02-19T21:51:21.455504+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.171600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.171600+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":457,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.527982+0000","last_change":"2024-02-19T21:49:08.330636+0000","last_active":"2024-02-19T21:51:21.527982+0000","last_peered":"2024-02-19T21:51:21.527982+0000","last_clean":"2024-02-19T21:51:21.527982+0000","last_became_active":"2024-02-19T21:49:08.330293+0000","last_became_peered":"2024-02-19T21:49:08.330293+0000","last_unstale":"2024-02-19T21:51:21.527982+0000","last_undegraded":"2024-02-19T21:51:21.527982+0000","last_fullsized":"2024-02-19T21:51:21.527982+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:03.034839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:03.034839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"381'24","reported_seq":54,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455261+0000","last_change":"2024-02-19T21:49:55.368481+0000","last_active":"2024-02-19T21:51:21.455261+0000","last_peered":"2024-02-19T21:51:21.455261+0000","last_clean":"2024-02-19T21:51:21.455261+0000","last_became_active":"2024-02-19T21:49:54.485438+0000","last_became_peered":"2024-02-19T21:49:54.485438+0000","last_unstale":"2024-02-19T21:51:21.455261+0000","last_undegraded":"2024-02-19T21:51:21.455261+0000","last_fullsized":"2024-02-19T21:51:21.455261+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"381'24","last_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_deep_scrub":"381'24","last_deep_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_clean_scrub_stamp":"2024-02-19T21:48:39.382725+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,5],"acting":[7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":449,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455558+0000","last_change":"2024-02-19T21:49:17.193002+0000","last_active":"2024-02-19T21:51:21.455558+0000","last_peered":"2024-02-19T21:51:21.455558+0000","last_clean":"2024-02-19T21:51:21.455558+0000","last_became_active":"2024-02-19T21:49:08.333537+0000","last_became_peered":"2024-02-19T21:49:08.333537+0000","last_unstale":"2024-02-19T21:51:21.455558+0000","last_undegraded":"2024-02-19T21:51:21.455558+0000","last_fullsized":"2024-02-19T21:51:21.455558+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:59.339649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:45:59.339649+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":477,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.527246+0000","last_change":"2024-02-19T21:49:54.494561+0000","last_active":"2024-02-19T21:51:21.527246+0000","last_peered":"2024-02-19T21:51:21.527246+0000","last_clean":"2024-02-19T21:51:21.527246+0000","last_became_active":"2024-02-19T21:49:54.494146+0000","last_became_peered":"2024-02-19T21:49:54.494146+0000","last_unstale":"2024-02-19T21:51:21.527246+0000","last_undegraded":"2024-02-19T21:51:21.527246+0000","last_fullsized":"2024-02-19T21:51:21.527246+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.560066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":451,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.458535+0000","last_change":"2024-02-19T21:49:09.765641+0000","last_active":"2024-02-19T21:51:21.458535+0000","last_peered":"2024-02-19T21:51:21.458535+0000","last_clean":"2024-02-19T21:51:21.458535+0000","last_became_active":"2024-02-19T21:49:08.331308+0000","last_became_peered":"2024-02-19T21:49:08.331308+0000","last_unstale":"2024-02-19T21:51:21.458535+0000","last_undegraded":"2024-02-19T21:51:21.458535+0000","last_fullsized":"2024-02-19T21:51:21.458535+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.765568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.765568+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"200'8","reported_seq":138,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.456236+0000","last_change":"2024-02-19T21:47:33.577363+0000","last_active":"2024-02-19T21:51:21.456236+0000","last_peered":"2024-02-19T21:51:21.456236+0000","last_clean":"2024-02-19T21:51:21.456236+0000","last_became_active":"2024-02-19T21:47:33.395217+0000","last_became_peered":"2024-02-19T21:47:33.395217+0000","last_unstale":"2024-02-19T21:51:21.456236+0000","last_undegraded":"2024-02-19T21:51:21.456236+0000","last_fullsized":"2024-02-19T21:51:21.456236+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'8","last_scrub_stamp":"2024-02-19T21:46:47.761677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.761677+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":361,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455881+0000","last_change":"2024-02-19T21:49:08.918163+0000","last_active":"2024-02-19T21:51:21.455881+0000","last_peered":"2024-02-19T21:51:21.455881+0000","last_clean":"2024-02-19T21:51:21.455881+0000","last_became_active":"2024-02-19T21:49:08.328416+0000","last_became_peered":"2024-02-19T21:49:08.328416+0000","last_unstale":"2024-02-19T21:51:21.455881+0000","last_undegraded":"2024-02-19T21:51:21.455881+0000","last_fullsized":"2024-02-19T21:51:21.455881+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.918083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.918083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":439,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.457622+0000","last_change":"2024-02-19T21:49:54.480716+0000","last_active":"2024-02-19T21:51:21.457622+0000","last_peered":"2024-02-19T21:51:21.457622+0000","last_clean":"2024-02-19T21:51:21.457622+0000","last_became_active":"2024-02-19T21:49:54.480368+0000","last_became_peered":"2024-02-19T21:49:54.480368+0000","last_unstale":"2024-02-19T21:51:21.457622+0000","last_undegraded":"2024-02-19T21:51:21.457622+0000","last_fullsized":"2024-02-19T21:51:21.457622+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:19.596775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:19.596775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":423,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.454782+0000","last_change":"2024-02-19T21:49:05.012463+0000","last_active":"2024-02-19T21:51:21.454782+0000","last_peered":"2024-02-19T21:51:21.454782+0000","last_clean":"2024-02-19T21:51:21.454782+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:51:21.454782+0000","last_undegraded":"2024-02-19T21:51:21.454782+0000","last_fullsized":"2024-02-19T21:51:21.454782+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.012395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.012395+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"201'19","reported_seq":470,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.567742+0000","last_change":"2024-02-19T21:48:38.529106+0000","last_active":"2024-02-19T21:51:21.567742+0000","last_peered":"2024-02-19T21:51:21.567742+0000","last_clean":"2024-02-19T21:51:21.567742+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:51:21.567742+0000","last_undegraded":"2024-02-19T21:51:21.567742+0000","last_fullsized":"2024-02-19T21:51:21.567742+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:38.528977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.528977+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":426,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455015+0000","last_change":"2024-02-19T21:46:06.096531+0000","last_active":"2024-02-19T21:51:21.455015+0000","last_peered":"2024-02-19T21:51:21.455015+0000","last_clean":"2024-02-19T21:51:21.455015+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:51:21.455015+0000","last_undegraded":"2024-02-19T21:51:21.455015+0000","last_fullsized":"2024-02-19T21:51:21.455015+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.096422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":237,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.527865+0000","last_change":"2024-02-19T21:48:38.391532+0000","last_active":"2024-02-19T21:51:21.527865+0000","last_peered":"2024-02-19T21:51:21.527865+0000","last_clean":"2024-02-19T21:51:21.527865+0000","last_became_active":"2024-02-19T21:47:33.395085+0000","last_became_peered":"2024-02-19T21:47:33.395085+0000","last_unstale":"2024-02-19T21:51:21.527865+0000","last_undegraded":"2024-02-19T21:51:21.527865+0000","last_fullsized":"2024-02-19T21:51:21.527865+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:38.391435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.391435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":438,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.527486+0000","last_change":"2024-02-19T21:48:14.600378+0000","last_active":"2024-02-19T21:51:21.527486+0000","last_peered":"2024-02-19T21:51:21.527486+0000","last_clean":"2024-02-19T21:51:21.527486+0000","last_became_active":"2024-02-19T21:47:33.393932+0000","last_became_peered":"2024-02-19T21:47:33.393932+0000","last_unstale":"2024-02-19T21:51:21.527486+0000","last_undegraded":"2024-02-19T21:51:21.527486+0000","last_fullsized":"2024-02-19T21:51:21.527486+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:14.600285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.600285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"200'15","reported_seq":492,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.456299+0000","last_change":"2024-02-19T21:49:08.334199+0000","last_active":"2024-02-19T21:51:21.456299+0000","last_peered":"2024-02-19T21:51:21.456299+0000","last_clean":"2024-02-19T21:51:21.456299+0000","last_became_active":"2024-02-19T21:49:08.333872+0000","last_became_peered":"2024-02-19T21:49:08.333872+0000","last_unstale":"2024-02-19T21:51:21.456299+0000","last_undegraded":"2024-02-19T21:51:21.456299+0000","last_fullsized":"2024-02-19T21:51:21.456299+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:45:08.678669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:08.678669+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":404,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.568201+0000","last_change":"2024-02-19T21:49:08.330114+0000","last_active":"2024-02-19T21:51:21.568201+0000","last_peered":"2024-02-19T21:51:21.568201+0000","last_clean":"2024-02-19T21:51:21.568201+0000","last_became_active":"2024-02-19T21:49:08.329770+0000","last_became_peered":"2024-02-19T21:49:08.329770+0000","last_unstale":"2024-02-19T21:51:21.568201+0000","last_undegraded":"2024-02-19T21:51:21.568201+0000","last_fullsized":"2024-02-19T21:51:21.568201+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:08.983923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.983923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"415'17","reported_seq":64,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:22.088621+0000","last_change":"2024-02-19T21:50:49.705247+0000","last_active":"2024-02-19T21:51:22.088621+0000","last_peered":"2024-02-19T21:51:22.088621+0000","last_clean":"2024-02-19T21:51:22.088621+0000","last_became_active":"2024-02-19T21:49:54.486304+0000","last_became_peered":"2024-02-19T21:49:54.486304+0000","last_unstale":"2024-02-19T21:51:22.088621+0000","last_undegraded":"2024-02-19T21:51:22.088621+0000","last_fullsized":"2024-02-19T21:51:22.088621+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"199'13","last_scrub_stamp":"2024-02-19T21:45:05.721709+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:45:05.721709+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":448,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.454362+0000","last_change":"2024-02-19T21:49:54.484516+0000","last_active":"2024-02-19T21:51:21.454362+0000","last_peered":"2024-02-19T21:51:21.454362+0000","last_clean":"2024-02-19T21:51:21.454362+0000","last_became_active":"2024-02-19T21:49:54.483689+0000","last_became_peered":"2024-02-19T21:49:54.483689+0000","last_unstale":"2024-02-19T21:51:21.454362+0000","last_undegraded":"2024-02-19T21:51:21.454362+0000","last_fullsized":"2024-02-19T21:51:21.454362+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.157478+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"201'19","reported_seq":469,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.457883+0000","last_change":"2024-02-19T21:48:27.720048+0000","last_active":"2024-02-19T21:51:21.457883+0000","last_peered":"2024-02-19T21:51:21.457883+0000","last_clean":"2024-02-19T21:51:21.457883+0000","last_became_active":"2024-02-19T21:47:33.398295+0000","last_became_peered":"2024-02-19T21:47:33.398295+0000","last_unstale":"2024-02-19T21:51:21.457883+0000","last_undegraded":"2024-02-19T21:51:21.457883+0000","last_fullsized":"2024-02-19T21:51:21.457883+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:27.719954+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:48:27.719954+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":165,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.454988+0000","last_change":"2024-02-19T21:49:54.484392+0000","last_active":"2024-02-19T21:51:21.454988+0000","last_peered":"2024-02-19T21:51:21.454988+0000","last_clean":"2024-02-19T21:51:21.454988+0000","last_became_active":"2024-02-19T21:49:54.484049+0000","last_became_peered":"2024-02-19T21:49:54.484049+0000","last_unstale":"2024-02-19T21:51:21.454988+0000","last_undegraded":"2024-02-19T21:51:21.454988+0000","last_fullsized":"2024-02-19T21:51:21.454988+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.121769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.121769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":656,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:22.088597+0000","last_change":"2024-02-19T21:48:38.723220+0000","last_active":"2024-02-19T21:51:22.088597+0000","last_peered":"2024-02-19T21:51:22.088597+0000","last_clean":"2024-02-19T21:51:22.088597+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:51:22.088597+0000","last_undegraded":"2024-02-19T21:51:22.088597+0000","last_fullsized":"2024-02-19T21:51:22.088597+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:48:38.723151+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.723151+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":452,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.457863+0000","last_change":"2024-02-19T21:49:54.485462+0000","last_active":"2024-02-19T21:51:21.457863+0000","last_peered":"2024-02-19T21:51:21.457863+0000","last_clean":"2024-02-19T21:51:21.457863+0000","last_became_active":"2024-02-19T21:49:54.485121+0000","last_became_peered":"2024-02-19T21:49:54.485121+0000","last_unstale":"2024-02-19T21:51:21.457863+0000","last_undegraded":"2024-02-19T21:51:21.457863+0000","last_fullsized":"2024-02-19T21:51:21.457863+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:07.724097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:49:07.724097+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"201'25","reported_seq":330,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455556+0000","last_change":"2024-02-19T21:49:08.335077+0000","last_active":"2024-02-19T21:51:21.455556+0000","last_peered":"2024-02-19T21:51:21.455556+0000","last_clean":"2024-02-19T21:51:21.455556+0000","last_became_active":"2024-02-19T21:49:08.334061+0000","last_became_peered":"2024-02-19T21:49:08.334061+0000","last_unstale":"2024-02-19T21:51:21.455556+0000","last_undegraded":"2024-02-19T21:51:21.455556+0000","last_fullsized":"2024-02-19T21:51:21.455556+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'25","last_scrub_stamp":"2024-02-19T21:46:07.553690+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.553690+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":421,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.456603+0000","last_change":"2024-02-19T21:48:21.256471+0000","last_active":"2024-02-19T21:51:21.456603+0000","last_peered":"2024-02-19T21:51:21.456603+0000","last_clean":"2024-02-19T21:51:21.456603+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:51:21.456603+0000","last_undegraded":"2024-02-19T21:51:21.456603+0000","last_fullsized":"2024-02-19T21:51:21.456603+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.256358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.256358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":428,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.527291+0000","last_change":"2024-02-19T21:46:35.035136+0000","last_active":"2024-02-19T21:51:21.527291+0000","last_peered":"2024-02-19T21:51:21.527291+0000","last_clean":"2024-02-19T21:51:21.527291+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:51:21.527291+0000","last_undegraded":"2024-02-19T21:51:21.527291+0000","last_fullsized":"2024-02-19T21:51:21.527291+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:35.035042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:35.035042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"201'12","reported_seq":50,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.456795+0000","last_change":"2024-02-19T21:50:49.700758+0000","last_active":"2024-02-19T21:51:21.456795+0000","last_peered":"2024-02-19T21:51:21.456795+0000","last_clean":"2024-02-19T21:51:21.456795+0000","last_became_active":"2024-02-19T21:49:54.478094+0000","last_became_peered":"2024-02-19T21:49:54.478094+0000","last_unstale":"2024-02-19T21:51:21.456795+0000","last_undegraded":"2024-02-19T21:51:21.456795+0000","last_fullsized":"2024-02-19T21:51:21.456795+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'12","last_scrub_stamp":"2024-02-19T21:49:08.912638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.912638+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":75,"reported_epoch":446,"state":"active+clean","last_fresh":"2024-02-19T21:51:22.458841+0000","last_change":"2024-02-19T21:49:08.332757+0000","last_active":"2024-02-19T21:51:22.458841+0000","last_peered":"2024-02-19T21:51:22.458841+0000","last_clean":"2024-02-19T21:51:22.458841+0000","last_became_active":"2024-02-19T21:49:08.332176+0000","last_became_peered":"2024-02-19T21:49:08.332176+0000","last_unstale":"2024-02-19T21:51:22.458841+0000","last_undegraded":"2024-02-19T21:51:22.458841+0000","last_fullsized":"2024-02-19T21:51:22.458841+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:47:01.365477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:47:01.365477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":75,"reported_epoch":446,"state":"active+clean","last_fresh":"2024-02-19T21:51:22.457628+0000","last_change":"2024-02-19T21:49:08.328632+0000","last_active":"2024-02-19T21:51:22.457628+0000","last_peered":"2024-02-19T21:51:22.457628+0000","last_clean":"2024-02-19T21:51:22.457628+0000","last_became_active":"2024-02-19T21:49:08.327826+0000","last_became_peered":"2024-02-19T21:49:08.327826+0000","last_unstale":"2024-02-19T21:51:22.457628+0000","last_undegraded":"2024-02-19T21:51:22.457628+0000","last_fullsized":"2024-02-19T21:51:22.457628+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:09.645607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:44:09.645607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"200'15","reported_seq":554,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455161+0000","last_change":"2024-02-19T21:50:49.704824+0000","last_active":"2024-02-19T21:51:21.455161+0000","last_peered":"2024-02-19T21:51:21.455161+0000","last_clean":"2024-02-19T21:51:21.455161+0000","last_became_active":"2024-02-19T21:49:54.483578+0000","last_became_peered":"2024-02-19T21:49:54.483578+0000","last_unstale":"2024-02-19T21:51:21.455161+0000","last_undegraded":"2024-02-19T21:51:21.455161+0000","last_fullsized":"2024-02-19T21:51:21.455161+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:44:53.072746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:53.072746+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"446'5260","reported_seq":6123,"reported_epoch":446,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:51:25.052140+0000","last_change":"2024-02-19T21:50:38.722849+0000","last_active":"2024-02-19T21:51:25.052140+0000","last_peered":"2024-02-19T21:51:25.052140+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:09.770699+0000","last_became_peered":"2024-02-19T21:49:09.770699+0000","last_unstale":"2024-02-19T21:51:25.052140+0000","last_undegraded":"2024-02-19T21:49:09.328794+0000","last_fullsized":"2024-02-19T21:49:09.325036+0000","mapping_epoch":395,"log_start":"392'400","ondisk_log_start":"392'400","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4860,"ondisk_log_size":4860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":276037632,"num_objects":4212,"num_object_clones":0,"num_object_copies":12636,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":714,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4212,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5260,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":25821184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5],"avail_no_missing":["6","5"],"object_location_counts":[{"shards":"5,6","objects":3498}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":42,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455688+0000","last_change":"2024-02-19T21:49:54.492844+0000","last_active":"2024-02-19T21:51:21.455688+0000","last_peered":"2024-02-19T21:51:21.455688+0000","last_clean":"2024-02-19T21:51:21.455688+0000","last_became_active":"2024-02-19T21:49:54.492156+0000","last_became_peered":"2024-02-19T21:49:54.492156+0000","last_unstale":"2024-02-19T21:51:21.455688+0000","last_undegraded":"2024-02-19T21:51:21.455688+0000","last_fullsized":"2024-02-19T21:51:21.455688+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:04.692807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.692807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"378'4","reported_seq":460,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.568398+0000","last_change":"2024-02-19T21:48:28.510929+0000","last_active":"2024-02-19T21:51:21.568398+0000","last_peered":"2024-02-19T21:51:21.568398+0000","last_clean":"2024-02-19T21:51:21.568398+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:51:21.568398+0000","last_undegraded":"2024-02-19T21:51:21.568398+0000","last_fullsized":"2024-02-19T21:51:21.568398+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"378'4","last_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_deep_scrub":"378'4","last_deep_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.510849+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"200'23","reported_seq":307,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.569156+0000","last_change":"2024-02-19T21:48:22.519465+0000","last_active":"2024-02-19T21:51:21.569156+0000","last_peered":"2024-02-19T21:51:21.569156+0000","last_clean":"2024-02-19T21:51:21.569156+0000","last_became_active":"2024-02-19T21:47:46.252085+0000","last_became_peered":"2024-02-19T21:47:46.252085+0000","last_unstale":"2024-02-19T21:51:21.569156+0000","last_undegraded":"2024-02-19T21:51:21.569156+0000","last_fullsized":"2024-02-19T21:51:21.569156+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'23","last_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_deep_scrub":"200'23","last_deep_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.519381+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6],"acting":[4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":75,"reported_epoch":446,"state":"active+clean","last_fresh":"2024-02-19T21:51:22.457708+0000","last_change":"2024-02-19T21:49:08.328855+0000","last_active":"2024-02-19T21:51:22.457708+0000","last_peered":"2024-02-19T21:51:22.457708+0000","last_clean":"2024-02-19T21:51:22.457708+0000","last_became_active":"2024-02-19T21:49:08.328237+0000","last_became_peered":"2024-02-19T21:49:08.328237+0000","last_unstale":"2024-02-19T21:51:22.457708+0000","last_undegraded":"2024-02-19T21:51:22.457708+0000","last_fullsized":"2024-02-19T21:51:22.457708+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:58.047556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:58.047556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"446'5086","reported_seq":5154,"reported_epoch":446,"state":"active+clean","last_fresh":"2024-02-19T21:51:24.689881+0000","last_change":"2024-02-19T21:48:47.778295+0000","last_active":"2024-02-19T21:51:24.689881+0000","last_peered":"2024-02-19T21:51:24.689881+0000","last_clean":"2024-02-19T21:51:24.689881+0000","last_became_active":"2024-02-19T21:48:47.777964+0000","last_became_peered":"2024-02-19T21:48:47.777964+0000","last_unstale":"2024-02-19T21:51:24.689881+0000","last_undegraded":"2024-02-19T21:51:24.689881+0000","last_fullsized":"2024-02-19T21:51:24.689881+0000","mapping_epoch":385,"log_start":"392'300","ondisk_log_start":"392'300","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4786,"ondisk_log_size":4786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":266338304,"num_objects":4064,"num_object_clones":0,"num_object_copies":12192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4064,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5086,"num_write_kb":292800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":475,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455089+0000","last_change":"2024-02-19T21:49:08.328019+0000","last_active":"2024-02-19T21:51:21.455089+0000","last_peered":"2024-02-19T21:51:21.455089+0000","last_clean":"2024-02-19T21:51:21.455089+0000","last_became_active":"2024-02-19T21:49:08.327581+0000","last_became_peered":"2024-02-19T21:49:08.327581+0000","last_unstale":"2024-02-19T21:51:21.455089+0000","last_undegraded":"2024-02-19T21:51:21.455089+0000","last_fullsized":"2024-02-19T21:51:21.455089+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:22.180593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:45:22.180593+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5],"acting":[0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":421,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455412+0000","last_change":"2024-02-19T21:48:37.789514+0000","last_active":"2024-02-19T21:51:21.455412+0000","last_peered":"2024-02-19T21:51:21.455412+0000","last_clean":"2024-02-19T21:51:21.455412+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:51:21.455412+0000","last_undegraded":"2024-02-19T21:51:21.455412+0000","last_fullsized":"2024-02-19T21:51:21.455412+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:37.789400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:37.789400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"201'20","reported_seq":327,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.457624+0000","last_change":"2024-02-19T21:45:57.877936+0000","last_active":"2024-02-19T21:51:21.457624+0000","last_peered":"2024-02-19T21:51:21.457624+0000","last_clean":"2024-02-19T21:51:21.457624+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:51:21.457624+0000","last_undegraded":"2024-02-19T21:51:21.457624+0000","last_fullsized":"2024-02-19T21:51:21.457624+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:45:57.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:57.877856+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":660,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:22.095845+0000","last_change":"2024-02-19T21:49:01.011149+0000","last_active":"2024-02-19T21:51:22.095845+0000","last_peered":"2024-02-19T21:51:22.095845+0000","last_clean":"2024-02-19T21:51:22.095845+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:51:22.095845+0000","last_undegraded":"2024-02-19T21:51:22.095845+0000","last_fullsized":"2024-02-19T21:51:22.095845+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:49:01.011078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:49:01.011078+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.a","version":"446'5219","reported_seq":5288,"reported_epoch":446,"state":"active+clean","last_fresh":"2024-02-19T21:51:24.705743+0000","last_change":"2024-02-19T21:48:47.778138+0000","last_active":"2024-02-19T21:51:24.705743+0000","last_peered":"2024-02-19T21:51:24.705743+0000","last_clean":"2024-02-19T21:51:24.705743+0000","last_became_active":"2024-02-19T21:48:47.777820+0000","last_became_peered":"2024-02-19T21:48:47.777820+0000","last_unstale":"2024-02-19T21:51:24.705743+0000","last_undegraded":"2024-02-19T21:51:24.705743+0000","last_fullsized":"2024-02-19T21:51:24.705743+0000","mapping_epoch":385,"log_start":"392'300","ondisk_log_start":"392'300","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4919,"ondisk_log_size":4919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":273612800,"num_objects":4175,"num_object_clones":0,"num_object_copies":12525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4175,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5219,"num_write_kb":300608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":370,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.569881+0000","last_change":"2024-02-19T21:48:33.478821+0000","last_active":"2024-02-19T21:51:21.569881+0000","last_peered":"2024-02-19T21:51:21.569881+0000","last_clean":"2024-02-19T21:51:21.569881+0000","last_became_active":"2024-02-19T21:44:56.149476+0000","last_became_peered":"2024-02-19T21:44:56.149476+0000","last_unstale":"2024-02-19T21:51:21.569881+0000","last_undegraded":"2024-02-19T21:51:21.569881+0000","last_fullsized":"2024-02-19T21:51:21.569881+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:33.478715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:48:33.478715+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":431,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.458004+0000","last_change":"2024-02-19T21:46:41.834315+0000","last_active":"2024-02-19T21:51:21.458004+0000","last_peered":"2024-02-19T21:51:21.458004+0000","last_clean":"2024-02-19T21:51:21.458004+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:51:21.458004+0000","last_undegraded":"2024-02-19T21:51:21.458004+0000","last_fullsized":"2024-02-19T21:51:21.458004+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:41.834246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:46:41.834246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"397'46","reported_seq":850,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:22.089464+0000","last_change":"2024-02-19T21:49:08.335296+0000","last_active":"2024-02-19T21:51:22.089464+0000","last_peered":"2024-02-19T21:51:22.089464+0000","last_clean":"2024-02-19T21:51:22.089464+0000","last_became_active":"2024-02-19T21:49:08.334527+0000","last_became_peered":"2024-02-19T21:49:08.334527+0000","last_unstale":"2024-02-19T21:51:22.089464+0000","last_undegraded":"2024-02-19T21:51:22.089464+0000","last_fullsized":"2024-02-19T21:51:22.089464+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'43","last_scrub_stamp":"2024-02-19T21:45:04.755444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.755444+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":417,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.454849+0000","last_change":"2024-02-19T21:46:45.252437+0000","last_active":"2024-02-19T21:51:21.454849+0000","last_peered":"2024-02-19T21:51:21.454849+0000","last_clean":"2024-02-19T21:51:21.454849+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:51:21.454849+0000","last_undegraded":"2024-02-19T21:51:21.454849+0000","last_fullsized":"2024-02-19T21:51:21.454849+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.252344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.252344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"446'5190","reported_seq":7013,"reported_epoch":446,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:51:25.281578+0000","last_change":"2024-02-19T21:51:03.650022+0000","last_active":"2024-02-19T21:51:25.281578+0000","last_peered":"2024-02-19T21:51:25.281578+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:55.752599+0000","last_became_peered":"2024-02-19T21:49:55.752599+0000","last_unstale":"2024-02-19T21:51:25.281578+0000","last_undegraded":"2024-02-19T21:49:55.655049+0000","last_fullsized":"2024-02-19T21:49:55.470938+0000","mapping_epoch":414,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5190,"ondisk_log_size":5190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":266731520,"num_objects":4070,"num_object_clones":0,"num_object_copies":12210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":576,"num_objects_misplaced":3452,"num_objects_unfound":0,"num_objects_dirty":4070,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5190,"num_write_kb":296320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":581,"num_bytes_recovered":38076416,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2],"avail_no_missing":["5","4"],"object_location_counts":[{"shards":"2,4,5","objects":2876},{"shards":"2,5","objects":618},{"shards":"4,5","objects":576}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":445,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.456799+0000","last_change":"2024-02-19T21:49:09.227437+0000","last_active":"2024-02-19T21:51:21.456799+0000","last_peered":"2024-02-19T21:51:21.456799+0000","last_clean":"2024-02-19T21:51:21.456799+0000","last_became_active":"2024-02-19T21:49:08.328437+0000","last_became_peered":"2024-02-19T21:49:08.328437+0000","last_unstale":"2024-02-19T21:51:21.456799+0000","last_undegraded":"2024-02-19T21:51:21.456799+0000","last_fullsized":"2024-02-19T21:51:21.456799+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.227355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.227355+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'6","reported_seq":1603,"reported_epoch":446,"state":"active+clean","last_fresh":"2024-02-19T21:51:24.523815+0000","last_change":"2024-02-19T21:51:24.523815+0000","last_active":"2024-02-19T21:51:24.523815+0000","last_peered":"2024-02-19T21:51:24.523815+0000","last_clean":"2024-02-19T21:51:24.523815+0000","last_became_active":"2024-02-19T21:49:08.331108+0000","last_became_peered":"2024-02-19T21:49:08.331108+0000","last_unstale":"2024-02-19T21:51:24.523815+0000","last_undegraded":"2024-02-19T21:51:24.523815+0000","last_fullsized":"2024-02-19T21:51:24.523815+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_clean_scrub_stamp":"2024-02-19T21:44:13.678341+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1121,"num_read_kb":1116,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":75,"reported_epoch":446,"state":"active+clean","last_fresh":"2024-02-19T21:51:22.457817+0000","last_change":"2024-02-19T21:49:08.329710+0000","last_active":"2024-02-19T21:51:22.457817+0000","last_peered":"2024-02-19T21:51:22.457817+0000","last_clean":"2024-02-19T21:51:22.457817+0000","last_became_active":"2024-02-19T21:49:08.329378+0000","last_became_peered":"2024-02-19T21:49:08.329378+0000","last_unstale":"2024-02-19T21:51:22.457817+0000","last_undegraded":"2024-02-19T21:51:22.457817+0000","last_fullsized":"2024-02-19T21:51:22.457817+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:55.195394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.195394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"200'17","reported_seq":478,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455548+0000","last_change":"2024-02-19T21:48:14.878933+0000","last_active":"2024-02-19T21:51:21.455548+0000","last_peered":"2024-02-19T21:51:21.455548+0000","last_clean":"2024-02-19T21:51:21.455548+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:51:21.455548+0000","last_undegraded":"2024-02-19T21:51:21.455548+0000","last_fullsized":"2024-02-19T21:51:21.455548+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'17","last_scrub_stamp":"2024-02-19T21:48:14.878857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.878857+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":25,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":75,"reported_epoch":446,"state":"active+clean","last_fresh":"2024-02-19T21:51:22.458045+0000","last_change":"2024-02-19T21:49:08.325478+0000","last_active":"2024-02-19T21:51:22.458045+0000","last_peered":"2024-02-19T21:51:22.458045+0000","last_clean":"2024-02-19T21:51:22.458045+0000","last_became_active":"2024-02-19T21:49:08.325127+0000","last_became_peered":"2024-02-19T21:49:08.325127+0000","last_unstale":"2024-02-19T21:51:22.458045+0000","last_undegraded":"2024-02-19T21:51:22.458045+0000","last_fullsized":"2024-02-19T21:51:22.458045+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:10.871111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:10.871111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"446'5247","reported_seq":5316,"reported_epoch":446,"state":"active+clean","last_fresh":"2024-02-19T21:51:24.833690+0000","last_change":"2024-02-19T21:48:47.778829+0000","last_active":"2024-02-19T21:51:24.833690+0000","last_peered":"2024-02-19T21:51:24.833690+0000","last_clean":"2024-02-19T21:51:24.833690+0000","last_became_active":"2024-02-19T21:48:47.778486+0000","last_became_peered":"2024-02-19T21:48:47.778486+0000","last_unstale":"2024-02-19T21:51:24.833690+0000","last_undegraded":"2024-02-19T21:51:24.833690+0000","last_fullsized":"2024-02-19T21:51:24.833690+0000","mapping_epoch":385,"log_start":"392'400","ondisk_log_start":"392'400","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4847,"ondisk_log_size":4847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":276103168,"num_objects":4213,"num_object_clones":0,"num_object_copies":12639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4213,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5247,"num_write_kb":302720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":448,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.458935+0000","last_change":"2024-02-19T21:47:33.400407+0000","last_active":"2024-02-19T21:51:21.458935+0000","last_peered":"2024-02-19T21:51:21.458935+0000","last_clean":"2024-02-19T21:51:21.458935+0000","last_became_active":"2024-02-19T21:47:33.400075+0000","last_became_peered":"2024-02-19T21:47:33.400075+0000","last_unstale":"2024-02-19T21:51:21.458935+0000","last_undegraded":"2024-02-19T21:51:21.458935+0000","last_fullsized":"2024-02-19T21:51:21.458935+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.035136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":326,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.458622+0000","last_change":"2024-02-19T21:49:05.746443+0000","last_active":"2024-02-19T21:51:21.458622+0000","last_peered":"2024-02-19T21:51:21.458622+0000","last_clean":"2024-02-19T21:51:21.458622+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:51:21.458622+0000","last_undegraded":"2024-02-19T21:51:21.458622+0000","last_fullsized":"2024-02-19T21:51:21.458622+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.746358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.746358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":478,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.458314+0000","last_change":"2024-02-19T21:49:54.485252+0000","last_active":"2024-02-19T21:51:21.458314+0000","last_peered":"2024-02-19T21:51:21.458314+0000","last_clean":"2024-02-19T21:51:21.458314+0000","last_became_active":"2024-02-19T21:49:54.484956+0000","last_became_peered":"2024-02-19T21:49:54.484956+0000","last_unstale":"2024-02-19T21:51:21.458314+0000","last_undegraded":"2024-02-19T21:51:21.458314+0000","last_fullsized":"2024-02-19T21:51:21.458314+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:07.901205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:07.901205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":42,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455114+0000","last_change":"2024-02-19T21:49:54.483990+0000","last_active":"2024-02-19T21:51:21.455114+0000","last_peered":"2024-02-19T21:51:21.455114+0000","last_clean":"2024-02-19T21:51:21.455114+0000","last_became_active":"2024-02-19T21:49:54.483637+0000","last_became_peered":"2024-02-19T21:49:54.483637+0000","last_unstale":"2024-02-19T21:51:21.455114+0000","last_undegraded":"2024-02-19T21:51:21.455114+0000","last_fullsized":"2024-02-19T21:51:21.455114+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.190177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.190177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"201'33","reported_seq":471,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.526982+0000","last_change":"2024-02-19T21:46:47.970066+0000","last_active":"2024-02-19T21:51:21.526982+0000","last_peered":"2024-02-19T21:51:21.526982+0000","last_clean":"2024-02-19T21:51:21.526982+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:51:21.526982+0000","last_undegraded":"2024-02-19T21:51:21.526982+0000","last_fullsized":"2024-02-19T21:51:21.526982+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'33","last_scrub_stamp":"2024-02-19T21:46:47.969961+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.969961+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":42,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.456100+0000","last_change":"2024-02-19T21:49:54.478276+0000","last_active":"2024-02-19T21:51:21.456100+0000","last_peered":"2024-02-19T21:51:21.456100+0000","last_clean":"2024-02-19T21:51:21.456100+0000","last_became_active":"2024-02-19T21:49:54.477947+0000","last_became_peered":"2024-02-19T21:49:54.477947+0000","last_unstale":"2024-02-19T21:51:21.456100+0000","last_undegraded":"2024-02-19T21:51:21.456100+0000","last_fullsized":"2024-02-19T21:51:21.456100+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:57.754453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:57.754453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"446'5102","reported_seq":15312,"reported_epoch":446,"state":"active+clean","last_fresh":"2024-02-19T21:51:24.670373+0000","last_change":"2024-02-19T21:51:22.472713+0000","last_active":"2024-02-19T21:51:24.670373+0000","last_peered":"2024-02-19T21:51:24.670373+0000","last_clean":"2024-02-19T21:51:24.670373+0000","last_became_active":"2024-02-19T21:51:22.462974+0000","last_became_peered":"2024-02-19T21:51:22.462974+0000","last_unstale":"2024-02-19T21:51:24.670373+0000","last_undegraded":"2024-02-19T21:51:24.670373+0000","last_fullsized":"2024-02-19T21:51:24.670373+0000","mapping_epoch":445,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":446,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5102,"ondisk_log_size":5102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":268304384,"num_objects":4094,"num_object_clones":0,"num_object_copies":12282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4094,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5102,"num_write_kb":294272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5054,"num_bytes_recovered":320077824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7],"acting":[0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":419,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455661+0000","last_change":"2024-02-19T21:45:47.723650+0000","last_active":"2024-02-19T21:51:21.455661+0000","last_peered":"2024-02-19T21:51:21.455661+0000","last_clean":"2024-02-19T21:51:21.455661+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:51:21.455661+0000","last_undegraded":"2024-02-19T21:51:21.455661+0000","last_fullsized":"2024-02-19T21:51:21.455661+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.723550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.723550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":430,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455764+0000","last_change":"2024-02-19T21:45:51.243726+0000","last_active":"2024-02-19T21:51:21.455764+0000","last_peered":"2024-02-19T21:51:21.455764+0000","last_clean":"2024-02-19T21:51:21.455764+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:51:21.455764+0000","last_undegraded":"2024-02-19T21:51:21.455764+0000","last_fullsized":"2024-02-19T21:51:21.455764+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:51.243656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:51.243656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":447,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455262+0000","last_change":"2024-02-19T21:48:23.218358+0000","last_active":"2024-02-19T21:51:21.455262+0000","last_peered":"2024-02-19T21:51:21.455262+0000","last_clean":"2024-02-19T21:51:21.455262+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:51:21.455262+0000","last_undegraded":"2024-02-19T21:51:21.455262+0000","last_fullsized":"2024-02-19T21:51:21.455262+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:23.218282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.218282+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"324'30","reported_seq":574,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455069+0000","last_change":"2024-02-19T21:49:08.330490+0000","last_active":"2024-02-19T21:51:21.455069+0000","last_peered":"2024-02-19T21:51:21.455069+0000","last_clean":"2024-02-19T21:51:21.455069+0000","last_became_active":"2024-02-19T21:49:08.329761+0000","last_became_peered":"2024-02-19T21:49:08.329761+0000","last_unstale":"2024-02-19T21:51:21.455069+0000","last_undegraded":"2024-02-19T21:51:21.455069+0000","last_fullsized":"2024-02-19T21:51:21.455069+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'30","last_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_deep_scrub":"324'30","last_deep_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.110965+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":432,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.458871+0000","last_change":"2024-02-19T21:45:09.918263+0000","last_active":"2024-02-19T21:51:21.458871+0000","last_peered":"2024-02-19T21:51:21.458871+0000","last_clean":"2024-02-19T21:51:21.458871+0000","last_became_active":"2024-02-19T21:44:42.624782+0000","last_became_peered":"2024-02-19T21:44:42.624782+0000","last_unstale":"2024-02-19T21:51:21.458871+0000","last_undegraded":"2024-02-19T21:51:21.458871+0000","last_fullsized":"2024-02-19T21:51:21.458871+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":295,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_clean_scrub_stamp":"2024-02-19T21:45:09.918170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"446'5139","reported_seq":5209,"reported_epoch":446,"state":"active+clean","last_fresh":"2024-02-19T21:51:25.037258+0000","last_change":"2024-02-19T21:48:47.777963+0000","last_active":"2024-02-19T21:51:25.037258+0000","last_peered":"2024-02-19T21:51:25.037258+0000","last_clean":"2024-02-19T21:51:25.037258+0000","last_became_active":"2024-02-19T21:48:47.777644+0000","last_became_peered":"2024-02-19T21:48:47.777644+0000","last_unstale":"2024-02-19T21:51:25.037258+0000","last_undegraded":"2024-02-19T21:51:25.037258+0000","last_fullsized":"2024-02-19T21:51:25.037258+0000","mapping_epoch":385,"log_start":"392'300","ondisk_log_start":"392'300","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4839,"ondisk_log_size":4839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":270663704,"num_objects":4131,"num_object_clones":0,"num_object_copies":12393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4131,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5139,"num_write_kb":296577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":452,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.454513+0000","last_change":"2024-02-19T21:49:08.331080+0000","last_active":"2024-02-19T21:51:21.454513+0000","last_peered":"2024-02-19T21:51:21.454513+0000","last_clean":"2024-02-19T21:51:21.454513+0000","last_became_active":"2024-02-19T21:49:08.330648+0000","last_became_peered":"2024-02-19T21:49:08.330648+0000","last_unstale":"2024-02-19T21:51:21.454513+0000","last_undegraded":"2024-02-19T21:51:21.454513+0000","last_fullsized":"2024-02-19T21:51:21.454513+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:55.803876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:44:55.803876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":423,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.456872+0000","last_change":"2024-02-19T21:48:31.320229+0000","last_active":"2024-02-19T21:51:21.456872+0000","last_peered":"2024-02-19T21:51:21.456872+0000","last_clean":"2024-02-19T21:51:21.456872+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:51:21.456872+0000","last_undegraded":"2024-02-19T21:51:21.456872+0000","last_fullsized":"2024-02-19T21:51:21.456872+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:31.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:45.017696+0000","last_clean_scrub_stamp":"2024-02-19T21:48:31.320133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"201'37","reported_seq":478,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.454290+0000","last_change":"2024-02-19T21:45:14.173212+0000","last_active":"2024-02-19T21:51:21.454290+0000","last_peered":"2024-02-19T21:51:21.454290+0000","last_clean":"2024-02-19T21:51:21.454290+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:51:21.454290+0000","last_undegraded":"2024-02-19T21:51:21.454290+0000","last_fullsized":"2024-02-19T21:51:21.454290+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'37","last_scrub_stamp":"2024-02-19T21:45:14.173134+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:45:14.173134+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":422,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.527572+0000","last_change":"2024-02-19T21:46:48.988928+0000","last_active":"2024-02-19T21:51:21.527572+0000","last_peered":"2024-02-19T21:51:21.527572+0000","last_clean":"2024-02-19T21:51:21.527572+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:51:21.527572+0000","last_undegraded":"2024-02-19T21:51:21.527572+0000","last_fullsized":"2024-02-19T21:51:21.527572+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:48.988836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.988836+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.e","version":"446'5061","reported_seq":7216,"reported_epoch":446,"state":"active+clean","last_fresh":"2024-02-19T21:51:24.695333+0000","last_change":"2024-02-19T21:50:40.718822+0000","last_active":"2024-02-19T21:51:24.695333+0000","last_peered":"2024-02-19T21:51:24.695333+0000","last_clean":"2024-02-19T21:51:24.695333+0000","last_became_active":"2024-02-19T21:50:40.710425+0000","last_became_peered":"2024-02-19T21:50:40.710425+0000","last_unstale":"2024-02-19T21:51:24.695333+0000","last_undegraded":"2024-02-19T21:51:24.695333+0000","last_fullsized":"2024-02-19T21:51:24.695333+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5061,"ondisk_log_size":5061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":267059200,"num_objects":4075,"num_object_clones":0,"num_object_copies":12225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4075,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5061,"num_write_kb":292352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1035,"num_bytes_recovered":67829760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":165,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.568366+0000","last_change":"2024-02-19T21:49:08.326461+0000","last_active":"2024-02-19T21:51:21.568366+0000","last_peered":"2024-02-19T21:51:21.568366+0000","last_clean":"2024-02-19T21:51:21.568366+0000","last_became_active":"2024-02-19T21:49:08.326106+0000","last_became_peered":"2024-02-19T21:49:08.326106+0000","last_unstale":"2024-02-19T21:51:21.568366+0000","last_undegraded":"2024-02-19T21:51:21.568366+0000","last_fullsized":"2024-02-19T21:51:21.568366+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.080896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.080896+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":425,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455203+0000","last_change":"2024-02-19T21:48:11.879787+0000","last_active":"2024-02-19T21:51:21.455203+0000","last_peered":"2024-02-19T21:51:21.455203+0000","last_clean":"2024-02-19T21:51:21.455203+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:51:21.455203+0000","last_undegraded":"2024-02-19T21:51:21.455203+0000","last_fullsized":"2024-02-19T21:51:21.455203+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.879687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.879687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"201'38","reported_seq":60,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455429+0000","last_change":"2024-02-19T21:49:55.861358+0000","last_active":"2024-02-19T21:51:21.455429+0000","last_peered":"2024-02-19T21:51:21.455429+0000","last_clean":"2024-02-19T21:51:21.455429+0000","last_became_active":"2024-02-19T21:49:54.480413+0000","last_became_peered":"2024-02-19T21:49:54.480413+0000","last_unstale":"2024-02-19T21:51:21.455429+0000","last_undegraded":"2024-02-19T21:51:21.455429+0000","last_fullsized":"2024-02-19T21:51:21.455429+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":415,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'38","last_scrub_stamp":"2024-02-19T21:49:05.923627+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.923627+0000","log_size":38,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":318,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.527398+0000","last_change":"2024-02-19T21:49:54.495134+0000","last_active":"2024-02-19T21:51:21.527398+0000","last_peered":"2024-02-19T21:51:21.527398+0000","last_clean":"2024-02-19T21:51:21.527398+0000","last_became_active":"2024-02-19T21:49:54.494802+0000","last_became_peered":"2024-02-19T21:49:54.494802+0000","last_unstale":"2024-02-19T21:51:21.527398+0000","last_undegraded":"2024-02-19T21:51:21.527398+0000","last_fullsized":"2024-02-19T21:51:21.527398+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:10.578408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:10.578408+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.f","version":"446'5316","reported_seq":7695,"reported_epoch":446,"state":"active+clean","last_fresh":"2024-02-19T21:51:25.034504+0000","last_change":"2024-02-19T21:51:05.409700+0000","last_active":"2024-02-19T21:51:25.034504+0000","last_peered":"2024-02-19T21:51:25.034504+0000","last_clean":"2024-02-19T21:51:25.034504+0000","last_became_active":"2024-02-19T21:51:05.398355+0000","last_became_peered":"2024-02-19T21:51:05.398355+0000","last_unstale":"2024-02-19T21:51:25.034504+0000","last_undegraded":"2024-02-19T21:51:25.034504+0000","last_fullsized":"2024-02-19T21:51:25.034504+0000","mapping_epoch":440,"log_start":"392'400","ondisk_log_start":"392'400","created":385,"last_epoch_clean":441,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4916,"ondisk_log_size":4916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":276692992,"num_objects":4222,"num_object_clones":0,"num_object_copies":12666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4222,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5316,"num_write_kb":305216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1147,"num_bytes_recovered":75169792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":452,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455826+0000","last_change":"2024-02-19T21:49:08.328862+0000","last_active":"2024-02-19T21:51:21.455826+0000","last_peered":"2024-02-19T21:51:21.455826+0000","last_clean":"2024-02-19T21:51:21.455826+0000","last_became_active":"2024-02-19T21:49:08.328529+0000","last_became_peered":"2024-02-19T21:49:08.328529+0000","last_unstale":"2024-02-19T21:51:21.455826+0000","last_undegraded":"2024-02-19T21:51:21.455826+0000","last_fullsized":"2024-02-19T21:51:21.455826+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:49.110117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:49.110117+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":485,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.528134+0000","last_change":"2024-02-19T21:49:54.493367+0000","last_active":"2024-02-19T21:51:21.528134+0000","last_peered":"2024-02-19T21:51:21.528134+0000","last_clean":"2024-02-19T21:51:21.528134+0000","last_became_active":"2024-02-19T21:49:54.493041+0000","last_became_peered":"2024-02-19T21:49:54.493041+0000","last_unstale":"2024-02-19T21:51:21.528134+0000","last_undegraded":"2024-02-19T21:51:21.528134+0000","last_fullsized":"2024-02-19T21:51:21.528134+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.972369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.972369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"201'28","reported_seq":292,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.569075+0000","last_change":"2024-02-19T21:49:08.330818+0000","last_active":"2024-02-19T21:51:21.569075+0000","last_peered":"2024-02-19T21:51:21.569075+0000","last_clean":"2024-02-19T21:51:21.569075+0000","last_became_active":"2024-02-19T21:49:08.330477+0000","last_became_peered":"2024-02-19T21:49:08.330477+0000","last_unstale":"2024-02-19T21:51:21.569075+0000","last_undegraded":"2024-02-19T21:51:21.569075+0000","last_fullsized":"2024-02-19T21:51:21.569075+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'28","last_scrub_stamp":"2024-02-19T21:45:55.998646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.998646+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":40,"num_read_kb":33,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":509,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:22.089519+0000","last_change":"2024-02-19T21:45:50.742626+0000","last_active":"2024-02-19T21:51:22.089519+0000","last_peered":"2024-02-19T21:51:22.089519+0000","last_clean":"2024-02-19T21:51:22.089519+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:51:22.089519+0000","last_undegraded":"2024-02-19T21:51:22.089519+0000","last_fullsized":"2024-02-19T21:51:22.089519+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'9","last_scrub_stamp":"2024-02-19T21:45:50.742526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:50.742526+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"446'5100","reported_seq":5169,"reported_epoch":446,"state":"active+clean","last_fresh":"2024-02-19T21:51:25.031812+0000","last_change":"2024-02-19T21:48:47.779506+0000","last_active":"2024-02-19T21:51:25.031812+0000","last_peered":"2024-02-19T21:51:25.031812+0000","last_clean":"2024-02-19T21:51:25.031812+0000","last_became_active":"2024-02-19T21:48:47.778325+0000","last_became_peered":"2024-02-19T21:48:47.778325+0000","last_unstale":"2024-02-19T21:51:25.031812+0000","last_undegraded":"2024-02-19T21:51:25.031812+0000","last_fullsized":"2024-02-19T21:51:25.031812+0000","mapping_epoch":385,"log_start":"392'200","ondisk_log_start":"392'200","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4900,"ondisk_log_size":4900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":264765440,"num_objects":4040,"num_object_clones":0,"num_object_copies":12120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4040,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5100,"num_write_kb":292480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"66'1","reported_seq":336,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.527586+0000","last_change":"2024-02-19T21:48:12.568842+0000","last_active":"2024-02-19T21:51:21.527586+0000","last_peered":"2024-02-19T21:51:21.527586+0000","last_clean":"2024-02-19T21:51:21.527586+0000","last_became_active":"2024-02-19T21:44:56.166670+0000","last_became_peered":"2024-02-19T21:44:56.166670+0000","last_unstale":"2024-02-19T21:51:21.527586+0000","last_undegraded":"2024-02-19T21:51:21.527586+0000","last_fullsized":"2024-02-19T21:51:21.527586+0000","mapping_epoch":165,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:12.568734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.568734+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"261'11","reported_seq":520,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:22.088823+0000","last_change":"2024-02-19T21:45:01.716882+0000","last_active":"2024-02-19T21:51:22.088823+0000","last_peered":"2024-02-19T21:51:22.088823+0000","last_clean":"2024-02-19T21:51:22.088823+0000","last_became_active":"2024-02-19T21:44:08.123392+0000","last_became_peered":"2024-02-19T21:44:08.123392+0000","last_unstale":"2024-02-19T21:51:22.088823+0000","last_undegraded":"2024-02-19T21:51:22.088823+0000","last_fullsized":"2024-02-19T21:51:22.088823+0000","mapping_epoch":62,"log_start":"257'10","ondisk_log_start":"257'10","created":62,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-02-19T21:45:01.716817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.716817+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":434,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455353+0000","last_change":"2024-02-19T21:48:19.186455+0000","last_active":"2024-02-19T21:51:21.455353+0000","last_peered":"2024-02-19T21:51:21.455353+0000","last_clean":"2024-02-19T21:51:21.455353+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:51:21.455353+0000","last_undegraded":"2024-02-19T21:51:21.455353+0000","last_fullsized":"2024-02-19T21:51:21.455353+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:48:19.186359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:19.186359+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"201'19","reported_seq":292,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.569515+0000","last_change":"2024-02-19T21:48:34.485865+0000","last_active":"2024-02-19T21:51:21.569515+0000","last_peered":"2024-02-19T21:51:21.569515+0000","last_clean":"2024-02-19T21:51:21.569515+0000","last_became_active":"2024-02-19T21:47:46.251550+0000","last_became_peered":"2024-02-19T21:47:46.251550+0000","last_unstale":"2024-02-19T21:51:21.569515+0000","last_undegraded":"2024-02-19T21:51:21.569515+0000","last_fullsized":"2024-02-19T21:51:21.569515+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:34.485787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:34.485787+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":23,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7],"acting":[4,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1","version":"446'5175","reported_seq":5244,"reported_epoch":446,"state":"active+clean","last_fresh":"2024-02-19T21:51:25.040481+0000","last_change":"2024-02-19T21:48:47.772467+0000","last_active":"2024-02-19T21:51:25.040481+0000","last_peered":"2024-02-19T21:51:25.040481+0000","last_clean":"2024-02-19T21:51:25.040481+0000","last_became_active":"2024-02-19T21:48:47.772154+0000","last_became_peered":"2024-02-19T21:48:47.772154+0000","last_unstale":"2024-02-19T21:51:25.040481+0000","last_undegraded":"2024-02-19T21:51:25.040481+0000","last_fullsized":"2024-02-19T21:51:25.040481+0000","mapping_epoch":385,"log_start":"392'100","ondisk_log_start":"392'100","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5075,"ondisk_log_size":5075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":271253504,"num_objects":4139,"num_object_clones":0,"num_object_copies":12417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5175,"num_write_kb":298048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":441,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.458185+0000","last_change":"2024-02-19T21:46:01.031458+0000","last_active":"2024-02-19T21:51:21.458185+0000","last_peered":"2024-02-19T21:51:21.458185+0000","last_clean":"2024-02-19T21:51:21.458185+0000","last_became_active":"2024-02-19T21:44:56.155194+0000","last_became_peered":"2024-02-19T21:44:56.155194+0000","last_unstale":"2024-02-19T21:51:21.458185+0000","last_undegraded":"2024-02-19T21:51:21.458185+0000","last_fullsized":"2024-02-19T21:51:21.458185+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.031344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.031344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"363'12","reported_seq":232,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:22.088566+0000","last_change":"2024-02-19T21:48:25.487689+0000","last_active":"2024-02-19T21:51:22.088566+0000","last_peered":"2024-02-19T21:51:22.088566+0000","last_clean":"2024-02-19T21:51:22.088566+0000","last_became_active":"2024-02-19T21:47:46.260099+0000","last_became_peered":"2024-02-19T21:47:46.260099+0000","last_unstale":"2024-02-19T21:51:22.088566+0000","last_undegraded":"2024-02-19T21:51:22.088566+0000","last_fullsized":"2024-02-19T21:51:22.088566+0000","mapping_epoch":362,"log_start":"98'9","ondisk_log_start":"98'9","created":62,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"363'12","last_scrub_stamp":"2024-02-19T21:48:25.487608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.487608+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":445,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.454437+0000","last_change":"2024-02-19T21:49:08.335163+0000","last_active":"2024-02-19T21:51:21.454437+0000","last_peered":"2024-02-19T21:51:21.454437+0000","last_clean":"2024-02-19T21:51:21.454437+0000","last_became_active":"2024-02-19T21:49:08.334842+0000","last_became_peered":"2024-02-19T21:49:08.334842+0000","last_unstale":"2024-02-19T21:51:21.454437+0000","last_undegraded":"2024-02-19T21:51:21.454437+0000","last_fullsized":"2024-02-19T21:51:21.454437+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.700887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.700887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"270'34","reported_seq":365,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.458613+0000","last_change":"2024-02-19T21:47:34.894164+0000","last_active":"2024-02-19T21:51:21.458613+0000","last_peered":"2024-02-19T21:51:21.458613+0000","last_clean":"2024-02-19T21:51:21.458613+0000","last_became_active":"2024-02-19T21:47:33.400012+0000","last_became_peered":"2024-02-19T21:47:33.400012+0000","last_unstale":"2024-02-19T21:51:21.458613+0000","last_undegraded":"2024-02-19T21:51:21.458613+0000","last_fullsized":"2024-02-19T21:51:21.458613+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":357,"parent":"0.0","parent_split_bits":0,"last_scrub":"270'34","last_scrub_stamp":"2024-02-19T21:46:44.789309+0000","last_deep_scrub":"270'34","last_deep_scrub_stamp":"2024-02-19T21:44:17.451151+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.789309+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2","version":"446'5257","reported_seq":5326,"reported_epoch":446,"state":"active+clean","last_fresh":"2024-02-19T21:51:25.064738+0000","last_change":"2024-02-19T21:48:47.771305+0000","last_active":"2024-02-19T21:51:25.064738+0000","last_peered":"2024-02-19T21:51:25.064738+0000","last_clean":"2024-02-19T21:51:25.064738+0000","last_became_active":"2024-02-19T21:48:47.771000+0000","last_became_peered":"2024-02-19T21:48:47.771000+0000","last_unstale":"2024-02-19T21:51:25.064738+0000","last_undegraded":"2024-02-19T21:51:25.064738+0000","last_fullsized":"2024-02-19T21:51:25.064738+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5257,"ondisk_log_size":5257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":273350656,"num_objects":4171,"num_object_clones":0,"num_object_copies":12513,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4171,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5257,"num_write_kb":301696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":423,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.569803+0000","last_change":"2024-02-19T21:49:08.329023+0000","last_active":"2024-02-19T21:51:21.569803+0000","last_peered":"2024-02-19T21:51:21.569803+0000","last_clean":"2024-02-19T21:51:21.569803+0000","last_became_active":"2024-02-19T21:49:08.328697+0000","last_became_peered":"2024-02-19T21:49:08.328697+0000","last_unstale":"2024-02-19T21:51:21.569803+0000","last_undegraded":"2024-02-19T21:51:21.569803+0000","last_fullsized":"2024-02-19T21:51:21.569803+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.939414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.939414+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"397'17","reported_seq":362,"reported_epoch":446,"state":"active+clean","last_fresh":"2024-02-19T21:51:22.480848+0000","last_change":"2024-02-19T21:49:08.325927+0000","last_active":"2024-02-19T21:51:22.480848+0000","last_peered":"2024-02-19T21:51:22.480848+0000","last_clean":"2024-02-19T21:51:22.480848+0000","last_became_active":"2024-02-19T21:49:08.325034+0000","last_became_peered":"2024-02-19T21:49:08.325034+0000","last_unstale":"2024-02-19T21:51:22.480848+0000","last_undegraded":"2024-02-19T21:51:22.480848+0000","last_fullsized":"2024-02-19T21:51:22.480848+0000","mapping_epoch":394,"log_start":"170'11","ondisk_log_start":"170'11","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"271'13","last_scrub_stamp":"2024-02-19T21:46:47.072988+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.072988+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":435,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.456187+0000","last_change":"2024-02-19T21:49:03.987847+0000","last_active":"2024-02-19T21:51:21.456187+0000","last_peered":"2024-02-19T21:51:21.456187+0000","last_clean":"2024-02-19T21:51:21.456187+0000","last_became_active":"2024-02-19T21:47:33.395485+0000","last_became_peered":"2024-02-19T21:47:33.395485+0000","last_unstale":"2024-02-19T21:51:21.456187+0000","last_undegraded":"2024-02-19T21:51:21.456187+0000","last_fullsized":"2024-02-19T21:51:21.456187+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:03.987749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:49:03.987749+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,5],"acting":[1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"200'20","reported_seq":269,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.570441+0000","last_change":"2024-02-19T21:48:12.628796+0000","last_active":"2024-02-19T21:51:21.570441+0000","last_peered":"2024-02-19T21:51:21.570441+0000","last_clean":"2024-02-19T21:51:21.570441+0000","last_became_active":"2024-02-19T21:47:46.251725+0000","last_became_peered":"2024-02-19T21:47:46.251725+0000","last_unstale":"2024-02-19T21:51:21.570441+0000","last_undegraded":"2024-02-19T21:51:21.570441+0000","last_fullsized":"2024-02-19T21:51:21.570441+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'20","last_scrub_stamp":"2024-02-19T21:48:12.628700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.628700+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3","version":"447'5212","reported_seq":7486,"reported_epoch":447,"state":"active+clean","last_fresh":"2024-02-19T21:51:26.860089+0000","last_change":"2024-02-19T21:50:50.296220+0000","last_active":"2024-02-19T21:51:26.860089+0000","last_peered":"2024-02-19T21:51:26.860089+0000","last_clean":"2024-02-19T21:51:26.860089+0000","last_became_active":"2024-02-19T21:50:50.289607+0000","last_became_peered":"2024-02-19T21:50:50.289607+0000","last_unstale":"2024-02-19T21:51:26.860089+0000","last_undegraded":"2024-02-19T21:51:26.860089+0000","last_fullsized":"2024-02-19T21:51:26.860089+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5212,"ondisk_log_size":5212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":271843328,"num_objects":4148,"num_object_clones":0,"num_object_copies":12444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4148,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5212,"num_write_kb":299520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1097,"num_bytes_recovered":71892992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":75,"reported_epoch":446,"state":"active+clean","last_fresh":"2024-02-19T21:51:22.458371+0000","last_change":"2024-02-19T21:49:08.327495+0000","last_active":"2024-02-19T21:51:22.458371+0000","last_peered":"2024-02-19T21:51:22.458371+0000","last_clean":"2024-02-19T21:51:22.458371+0000","last_became_active":"2024-02-19T21:49:08.327172+0000","last_became_peered":"2024-02-19T21:49:08.327172+0000","last_unstale":"2024-02-19T21:51:22.458371+0000","last_undegraded":"2024-02-19T21:51:22.458371+0000","last_fullsized":"2024-02-19T21:51:22.458371+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.241319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.241319+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,6],"acting":[2,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":430,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455612+0000","last_change":"2024-02-19T21:45:01.798485+0000","last_active":"2024-02-19T21:51:21.455612+0000","last_peered":"2024-02-19T21:51:21.455612+0000","last_clean":"2024-02-19T21:51:21.455612+0000","last_became_active":"2024-02-19T21:44:22.245925+0000","last_became_peered":"2024-02-19T21:44:22.245925+0000","last_unstale":"2024-02-19T21:51:21.455612+0000","last_undegraded":"2024-02-19T21:51:21.455612+0000","last_fullsized":"2024-02-19T21:51:21.455612+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:01.798387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.798387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":430,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455771+0000","last_change":"2024-02-19T21:48:30.277397+0000","last_active":"2024-02-19T21:51:21.455771+0000","last_peered":"2024-02-19T21:51:21.455771+0000","last_clean":"2024-02-19T21:51:21.455771+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:51:21.455771+0000","last_undegraded":"2024-02-19T21:51:21.455771+0000","last_fullsized":"2024-02-19T21:51:21.455771+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.277322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.277322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"337'39","reported_seq":378,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.568763+0000","last_change":"2024-02-19T21:49:08.326007+0000","last_active":"2024-02-19T21:51:21.568763+0000","last_peered":"2024-02-19T21:51:21.568763+0000","last_clean":"2024-02-19T21:51:21.568763+0000","last_became_active":"2024-02-19T21:49:08.325683+0000","last_became_peered":"2024-02-19T21:49:08.325683+0000","last_unstale":"2024-02-19T21:51:21.568763+0000","last_undegraded":"2024-02-19T21:51:21.568763+0000","last_fullsized":"2024-02-19T21:51:21.568763+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'39","last_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_deep_scrub":"337'39","last_deep_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.923809+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":49,"num_read_kb":39,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"446'5322","reported_seq":5391,"reported_epoch":446,"state":"active+clean","last_fresh":"2024-02-19T21:51:24.699191+0000","last_change":"2024-02-19T21:48:47.776672+0000","last_active":"2024-02-19T21:51:24.699191+0000","last_peered":"2024-02-19T21:51:24.699191+0000","last_clean":"2024-02-19T21:51:24.699191+0000","last_became_active":"2024-02-19T21:48:47.776368+0000","last_became_peered":"2024-02-19T21:48:47.776368+0000","last_unstale":"2024-02-19T21:51:24.699191+0000","last_undegraded":"2024-02-19T21:51:24.699191+0000","last_fullsized":"2024-02-19T21:51:24.699191+0000","mapping_epoch":385,"log_start":"392'200","ondisk_log_start":"392'200","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5122,"ondisk_log_size":5122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":276955136,"num_objects":4226,"num_object_clones":0,"num_object_copies":12678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4226,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5322,"num_write_kb":305536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"66'1","reported_seq":268,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.455134+0000","last_change":"2024-02-19T21:50:57.303343+0000","last_active":"2024-02-19T21:51:21.455134+0000","last_peered":"2024-02-19T21:51:21.455134+0000","last_clean":"2024-02-19T21:51:21.455134+0000","last_became_active":"2024-02-19T21:50:57.302957+0000","last_became_peered":"2024-02-19T21:50:57.302957+0000","last_unstale":"2024-02-19T21:51:21.455134+0000","last_undegraded":"2024-02-19T21:51:21.455134+0000","last_fullsized":"2024-02-19T21:51:21.455134+0000","mapping_epoch":437,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":438,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:46:43.773486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:46:43.773486+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":75,"reported_epoch":446,"state":"active+clean","last_fresh":"2024-02-19T21:51:22.458326+0000","last_change":"2024-02-19T21:49:08.326583+0000","last_active":"2024-02-19T21:51:22.458326+0000","last_peered":"2024-02-19T21:51:22.458326+0000","last_clean":"2024-02-19T21:51:22.458326+0000","last_became_active":"2024-02-19T21:49:08.324835+0000","last_became_peered":"2024-02-19T21:49:08.324835+0000","last_unstale":"2024-02-19T21:51:22.458326+0000","last_undegraded":"2024-02-19T21:51:22.458326+0000","last_fullsized":"2024-02-19T21:51:22.458326+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.163825+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":130,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.527335+0000","last_change":"2024-02-19T21:49:08.327553+0000","last_active":"2024-02-19T21:51:21.527335+0000","last_peered":"2024-02-19T21:51:21.527335+0000","last_clean":"2024-02-19T21:51:21.527335+0000","last_became_active":"2024-02-19T21:49:08.327186+0000","last_became_peered":"2024-02-19T21:49:08.327186+0000","last_unstale":"2024-02-19T21:51:21.527335+0000","last_undegraded":"2024-02-19T21:51:21.527335+0000","last_fullsized":"2024-02-19T21:51:21.527335+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:45:00.748244+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:45:00.748244+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"201'44","reported_seq":551,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.527502+0000","last_change":"2024-02-19T21:49:55.281324+0000","last_active":"2024-02-19T21:51:21.527502+0000","last_peered":"2024-02-19T21:51:21.527502+0000","last_clean":"2024-02-19T21:51:21.527502+0000","last_became_active":"2024-02-19T21:49:54.493167+0000","last_became_peered":"2024-02-19T21:49:54.493167+0000","last_unstale":"2024-02-19T21:51:21.527502+0000","last_undegraded":"2024-02-19T21:51:21.527502+0000","last_fullsized":"2024-02-19T21:51:21.527502+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'44","last_scrub_stamp":"2024-02-19T21:48:32.489084+0000","last_deep_scrub":"201'44","last_deep_scrub_stamp":"2024-02-19T21:44:16.255049+0000","last_clean_scrub_stamp":"2024-02-19T21:48:32.489084+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.5","version":"447'5261","reported_seq":7000,"reported_epoch":447,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:51:26.970067+0000","last_change":"2024-02-19T21:50:03.887248+0000","last_active":"2024-02-19T21:51:26.970067+0000","last_peered":"2024-02-19T21:51:26.970067+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:50:03.654321+0000","last_became_peered":"2024-02-19T21:50:03.654321+0000","last_unstale":"2024-02-19T21:51:26.970067+0000","last_undegraded":"2024-02-19T21:50:01.398577+0000","last_fullsized":"2024-02-19T21:49:55.473278+0000","mapping_epoch":414,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5261,"ondisk_log_size":5261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":272695296,"num_objects":4161,"num_object_clones":0,"num_object_copies":12483,"num_objects_missing_on_primary":594,"num_objects_missing":594,"num_objects_degraded":594,"num_objects_misplaced":3571,"num_objects_unfound":0,"num_objects_dirty":4161,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5261,"num_write_kb":301504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":550,"num_bytes_recovered":36044800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0],"avail_no_missing":["0","5"],"object_location_counts":[{"shards":"0,2","objects":590},{"shards":"0,2,5","objects":2977},{"shards":"0,5","objects":594}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":475,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.456026+0000","last_change":"2024-02-19T21:49:08.328667+0000","last_active":"2024-02-19T21:51:21.456026+0000","last_peered":"2024-02-19T21:51:21.456026+0000","last_clean":"2024-02-19T21:51:21.456026+0000","last_became_active":"2024-02-19T21:49:08.328287+0000","last_became_peered":"2024-02-19T21:49:08.328287+0000","last_unstale":"2024-02-19T21:51:21.456026+0000","last_undegraded":"2024-02-19T21:51:21.456026+0000","last_fullsized":"2024-02-19T21:51:21.456026+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.176542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.176542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":75,"reported_epoch":446,"state":"active+clean","last_fresh":"2024-02-19T21:51:22.457862+0000","last_change":"2024-02-19T21:49:08.332637+0000","last_active":"2024-02-19T21:51:22.457862+0000","last_peered":"2024-02-19T21:51:22.457862+0000","last_clean":"2024-02-19T21:51:22.457862+0000","last_became_active":"2024-02-19T21:49:08.331451+0000","last_became_peered":"2024-02-19T21:49:08.331451+0000","last_unstale":"2024-02-19T21:51:22.457862+0000","last_undegraded":"2024-02-19T21:51:22.457862+0000","last_fullsized":"2024-02-19T21:51:22.457862+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.123413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.547129+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.123413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":445,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.454972+0000","last_change":"2024-02-19T21:49:08.331159+0000","last_active":"2024-02-19T21:51:21.454972+0000","last_peered":"2024-02-19T21:51:21.454972+0000","last_clean":"2024-02-19T21:51:21.454972+0000","last_became_active":"2024-02-19T21:49:08.330804+0000","last_became_peered":"2024-02-19T21:49:08.330804+0000","last_unstale":"2024-02-19T21:51:21.454972+0000","last_undegraded":"2024-02-19T21:51:21.454972+0000","last_fullsized":"2024-02-19T21:51:21.454972+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.978015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.978015+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"377'19","reported_seq":453,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.454435+0000","last_change":"2024-02-19T21:48:23.326608+0000","last_active":"2024-02-19T21:51:21.454435+0000","last_peered":"2024-02-19T21:51:21.454435+0000","last_clean":"2024-02-19T21:51:21.454435+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:51:21.454435+0000","last_undegraded":"2024-02-19T21:51:21.454435+0000","last_fullsized":"2024-02-19T21:51:21.454435+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"377'19","last_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_deep_scrub":"377'19","last_deep_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.326541+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"446'5245","reported_seq":5313,"reported_epoch":446,"state":"active+clean","last_fresh":"2024-02-19T21:51:24.810469+0000","last_change":"2024-02-19T21:48:47.780368+0000","last_active":"2024-02-19T21:51:24.810469+0000","last_peered":"2024-02-19T21:51:24.810469+0000","last_clean":"2024-02-19T21:51:24.810469+0000","last_became_active":"2024-02-19T21:48:47.780046+0000","last_became_peered":"2024-02-19T21:48:47.780046+0000","last_unstale":"2024-02-19T21:51:24.810469+0000","last_undegraded":"2024-02-19T21:51:24.810469+0000","last_fullsized":"2024-02-19T21:51:24.810469+0000","mapping_epoch":385,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5245,"ondisk_log_size":5245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":272826368,"num_objects":4163,"num_object_clones":0,"num_object_copies":12489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4163,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5245,"num_write_kb":301056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":439,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.457776+0000","last_change":"2024-02-19T21:46:01.981923+0000","last_active":"2024-02-19T21:51:21.457776+0000","last_peered":"2024-02-19T21:51:21.457776+0000","last_clean":"2024-02-19T21:51:21.457776+0000","last_became_active":"2024-02-19T21:44:56.160521+0000","last_became_peered":"2024-02-19T21:44:56.160521+0000","last_unstale":"2024-02-19T21:51:21.457776+0000","last_undegraded":"2024-02-19T21:51:21.457776+0000","last_fullsized":"2024-02-19T21:51:21.457776+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.981866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.981866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":84,"reported_epoch":446,"state":"active+clean","last_fresh":"2024-02-19T21:51:22.458192+0000","last_change":"2024-02-19T21:49:54.485377+0000","last_active":"2024-02-19T21:51:22.458192+0000","last_peered":"2024-02-19T21:51:22.458192+0000","last_clean":"2024-02-19T21:51:22.458192+0000","last_became_active":"2024-02-19T21:49:54.485078+0000","last_became_peered":"2024-02-19T21:49:54.485078+0000","last_unstale":"2024-02-19T21:51:22.458192+0000","last_undegraded":"2024-02-19T21:51:22.458192+0000","last_fullsized":"2024-02-19T21:51:22.458192+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:52.107416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:46:52.107416+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"200'27","reported_seq":516,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:21.457544+0000","last_change":"2024-02-19T21:49:55.109780+0000","last_active":"2024-02-19T21:51:21.457544+0000","last_peered":"2024-02-19T21:51:21.457544+0000","last_clean":"2024-02-19T21:51:21.457544+0000","last_became_active":"2024-02-19T21:49:54.486014+0000","last_became_peered":"2024-02-19T21:49:54.486014+0000","last_unstale":"2024-02-19T21:51:21.457544+0000","last_undegraded":"2024-02-19T21:51:21.457544+0000","last_fullsized":"2024-02-19T21:51:21.457544+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'27","last_scrub_stamp":"2024-02-19T21:48:24.665813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:24.665813+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"324'11","reported_seq":680,"reported_epoch":445,"state":"active+clean","last_fresh":"2024-02-19T21:51:22.088662+0000","last_change":"2024-02-19T21:48:26.293036+0000","last_active":"2024-02-19T21:51:22.088662+0000","last_peered":"2024-02-19T21:51:22.088662+0000","last_clean":"2024-02-19T21:51:22.088662+0000","last_became_active":"2024-02-19T21:44:34.385140+0000","last_became_peered":"2024-02-19T21:44:34.385140+0000","last_unstale":"2024-02-19T21:51:22.088662+0000","last_undegraded":"2024-02-19T21:51:22.088662+0000","last_fullsized":"2024-02-19T21:51:22.088662+0000","mapping_epoch":62,"log_start":"66'8","ondisk_log_start":"66'8","created":62,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'11","last_scrub_stamp":"2024-02-19T21:48:26.292909+0000","last_deep_scrub":"324'11","last_deep_scrub_stamp":"2024-02-19T21:46:05.210095+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.292909+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":4345233432,"num_objects":66304,"num_object_clones":0,"num_object_copies":198912,"num_objects_missing_on_primary":594,"num_objects_missing":594,"num_objects_degraded":1884,"num_objects_misplaced":7023,"num_objects_unfound":0,"num_objects_dirty":66304,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":83192,"num_write_kb":4783809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9858,"num_bytes_recovered":634912768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13253881856,"data_stored":13253869640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80592,"ondisk_log_size":80592,"up":48,"acting":45,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1121,"num_read_kb":1116,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1107,"num_read_kb":864,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":277,"num_bytes_recovered":5172,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":776,"ondisk_log_size":776,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":22,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":66,"acting":66,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":382,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201511,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1178264,"kb_used_data":868752,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":92566888,"statfs":{"total":95995035648,"available":94788493312,"internally_reserved":0,"allocated":889602048,"data_stored":888301012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":1.718,"15min":1.8839999999999999},"min":{"1min":0.23100000000000001,"5min":0.19,"15min":0.189},"max":{"1min":2.7530000000000001,"5min":22.07,"15min":70.477999999999994},"last":0.57899999999999996},{"interface":"front","average":{"1min":1.0980000000000001,"5min":2.161,"15min":2.073},"min":{"1min":0.24199999999999999,"5min":0.21199999999999999,"15min":0.20999999999999999},"max":{"1min":11.962999999999999,"5min":22.457000000000001,"15min":68.052000000000007},"last":0.26800000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.8839999999999999,"15min":2.0979999999999999},"min":{"1min":0.26400000000000001,"5min":0.247,"15min":0.23200000000000001},"max":{"1min":9.9440000000000008,"5min":22.117999999999999,"15min":68.168000000000006},"last":0.314},{"interface":"front","average":{"1min":1.0309999999999999,"5min":2.3620000000000001,"15min":2.1400000000000001},"min":{"1min":0.33000000000000002,"5min":0.26300000000000001,"15min":0.223},"max":{"1min":9.8559999999999999,"5min":22.236000000000001,"15min":68.444000000000003},"last":3.3319999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:51:12 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":2.028,"15min":2.2759999999999998},"min":{"1min":0.29999999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.673,"5min":12.304,"15min":12.304},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":1.756,"15min":1.9610000000000001},"min":{"1min":0.28299999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":2.6840000000000002,"5min":11.69,"15min":11.69},"last":0.54200000000000004}]},{"osd":3,"last update":"Mon Feb 19 21:50:50 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.966,"15min":2.1829999999999998},"min":{"1min":0.315,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":11.778,"5min":11.778,"15min":31.559000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":1.571,"15min":1.901},"min":{"1min":0.316,"5min":0.30299999999999999,"15min":0.29299999999999998},"max":{"1min":2.8039999999999998,"5min":13.473000000000001,"15min":30.812999999999999},"last":0.68300000000000005}]},{"osd":4,"last update":"Mon Feb 19 21:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":1.875,"15min":1.5489999999999999},"min":{"1min":0.28199999999999997,"5min":0.245,"15min":0.216},"max":{"1min":2.8239999999999998,"5min":17.716999999999999,"15min":17.716999999999999},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":2.2330000000000001,"15min":1.8740000000000001},"min":{"1min":0.30599999999999999,"5min":0.253,"15min":0.245},"max":{"1min":2.7839999999999998,"5min":17.690999999999999,"15min":17.690999999999999},"last":0.38900000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":1.9299999999999999,"15min":1.615},"min":{"1min":0.32000000000000001,"5min":0.28499999999999998,"15min":0.24199999999999999},"max":{"1min":2.5510000000000002,"5min":29.021000000000001,"15min":29.021000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":2.1880000000000002,"15min":1.8979999999999999},"min":{"1min":0.378,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":2.8500000000000001,"5min":29.091999999999999,"15min":29.091999999999999},"last":0.502}]},{"osd":6,"last update":"Mon Feb 19 21:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":2.3330000000000002,"15min":1.7},"min":{"1min":0.34399999999999997,"5min":0.31,"15min":0.24299999999999999},"max":{"1min":2.8849999999999998,"5min":19.286000000000001,"15min":19.286000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":2.173,"15min":1.8640000000000001},"min":{"1min":0.42699999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":2.988,"5min":18.364000000000001,"15min":18.364000000000001},"last":0.45100000000000001}]}]},{"osd":6,"up_from":47,"seq":201863463150,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2455512,"kb_used_data":1865808,"kb_used_omap":0,"kb_used_meta":589696,"kb_avail":91289640,"statfs":{"total":95995035648,"available":93480591360,"internally_reserved":0,"allocated":1910587392,"data_stored":1909285670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":603848704},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:50:27 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":1.2310000000000001,"15min":1.6599999999999999},"min":{"1min":0.245,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":2.9369999999999998,"5min":8.8079999999999998,"15min":45.197000000000003},"last":0.33700000000000002},{"interface":"front","average":{"1min":1.425,"5min":1.74,"15min":1.9890000000000001},"min":{"1min":0.27600000000000002,"5min":0.23499999999999999,"15min":0.221},"max":{"1min":4.2859999999999996,"5min":6.9699999999999998,"15min":44.753},"last":0.40999999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:50:27 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":1.5780000000000001,"15min":1.7},"min":{"1min":0.26600000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":2.9929999999999999,"5min":8.8469999999999995,"15min":45.231999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.609,"15min":1.702},"min":{"1min":0.26400000000000001,"5min":0.245,"15min":0.23100000000000001},"max":{"1min":5.6050000000000004,"5min":7.3570000000000002,"15min":45.097999999999999},"last":0.36599999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:51:11 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.4430000000000001,"15min":1.528},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":6.1820000000000004,"5min":6.1820000000000004,"15min":6.1820000000000004},"last":0.44},{"interface":"front","average":{"1min":0.64900000000000002,"5min":1.145,"15min":1.2270000000000001},"min":{"1min":0.32300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":3.258,"5min":7.8959999999999999,"15min":7.8959999999999999},"last":0.30499999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:50:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.508,"15min":1.6100000000000001},"min":{"1min":0.36399999999999999,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":5.4729999999999999,"5min":8.9009999999999998,"15min":11.15},"last":0.379},{"interface":"front","average":{"1min":1.909,"5min":1.675,"15min":1.6539999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.246},"max":{"1min":7.3970000000000002,"5min":7.3970000000000002,"15min":19.632999999999999},"last":0.54400000000000004}]},{"osd":4,"last update":"Mon Feb 19 21:50:27 2024","interfaces":[{"interface":"back","average":{"1min":3.3069999999999999,"5min":2.242,"15min":1.7609999999999999},"min":{"1min":0.34000000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":18.010000000000002,"5min":18.010000000000002,"15min":18.010000000000002},"last":0.34799999999999998},{"interface":"front","average":{"1min":1.7390000000000001,"5min":1.988,"15min":1.7190000000000001},"min":{"1min":0.32800000000000001,"5min":0.26300000000000001,"15min":0.23499999999999999},"max":{"1min":6.0659999999999998,"5min":11.566000000000001,"15min":16.594999999999999},"last":0.41899999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:50:27 2024","interfaces":[{"interface":"back","average":{"1min":2.218,"5min":2.27,"15min":1.778},"min":{"1min":0.376,"5min":0.27400000000000002,"15min":0.27100000000000002},"max":{"1min":9.5990000000000002,"5min":14.695,"15min":14.695},"last":0.374},{"interface":"front","average":{"1min":1.1339999999999999,"5min":2.254,"15min":1.907},"min":{"1min":0.40999999999999998,"5min":0.28799999999999998,"15min":0.27900000000000003},"max":{"1min":3.2890000000000001,"5min":11.609999999999999,"15min":15.497999999999999},"last":0.48399999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:50:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.9339999999999999,"15min":1.8200000000000001},"min":{"1min":0.41699999999999998,"5min":0.27200000000000002,"15min":0.26700000000000002},"max":{"1min":3.3399999999999999,"5min":9.1929999999999996,"15min":14.721},"last":0.50800000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.972,"15min":1.869},"min":{"1min":0.49099999999999999,"5min":0.35599999999999998,"15min":0.32700000000000001},"max":{"1min":3.3540000000000001,"5min":9.2240000000000002,"15min":14.744999999999999},"last":0.52400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575112,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1967080,"kb_used_data":1070560,"kb_used_omap":0,"kb_used_meta":896512,"kb_avail":91778072,"statfs":{"total":95995035648,"available":93980745728,"internally_reserved":0,"allocated":1096253440,"data_stored":1094936234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":918028288},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:51:19 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.95499999999999996,"15min":1.502},"min":{"1min":0.20499999999999999,"5min":0.16300000000000001,"15min":0.161},"max":{"1min":0.77600000000000002,"5min":6.2789999999999999,"15min":42.776000000000003},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.94499999999999995,"15min":1.5429999999999999},"min":{"1min":0.23300000000000001,"5min":0.193,"15min":0.16400000000000001},"max":{"1min":2.1680000000000001,"5min":6.2000000000000002,"15min":44.845999999999997},"last":2.7250000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:51:08 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.94999999999999996,"15min":1.038},"min":{"1min":0.22800000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.7270000000000001,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":0.251},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.89500000000000002,"15min":0.97299999999999998},"min":{"1min":0.254,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.6990000000000001,"5min":4.452,"15min":4.452},"last":0.496}]},{"osd":3,"last update":"Mon Feb 19 21:51:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.83999999999999997,"15min":1.6000000000000001},"min":{"1min":0.24399999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":2.2050000000000001,"5min":4.6639999999999997,"15min":41.607999999999997},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.91900000000000004,"15min":1.5249999999999999},"min":{"1min":0.28599999999999998,"5min":0.215,"15min":0.215},"max":{"1min":1.0129999999999999,"5min":4.5190000000000001,"15min":42.811999999999998},"last":0.41899999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:50:34 2024","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.633,"15min":1.5429999999999999},"min":{"1min":0.316,"5min":0.251,"15min":0.251},"max":{"1min":9.8759999999999994,"5min":15.853,"15min":15.853},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.83099999999999996,"5min":1.615,"15min":1.575},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.26500000000000001},"max":{"1min":2.746,"5min":15.861000000000001,"15min":15.861000000000001},"last":0.35399999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:51:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":1.496,"15min":1.637},"min":{"1min":0.30199999999999999,"5min":0.29599999999999999,"15min":0.27900000000000003},"max":{"1min":1.7529999999999999,"5min":14.331,"15min":14.331},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":1.5629999999999999,"15min":1.619},"min":{"1min":0.39600000000000002,"5min":0.307,"15min":0.30099999999999999},"max":{"1min":2.2309999999999999,"5min":14.496,"15min":14.496},"last":0.47999999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:50:34 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.5700000000000001,"15min":1.657},"min":{"1min":0.40200000000000002,"5min":0.30199999999999999,"15min":0.30099999999999999},"max":{"1min":8.8309999999999995,"5min":10.456,"15min":11.638999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":1.179,"5min":1.696,"15min":1.786},"min":{"1min":0.38,"5min":0.36899999999999999,"15min":0.29699999999999999},"max":{"1min":3.863,"5min":9.8049999999999997,"15min":12.199},"last":0.52800000000000002}]},{"osd":7,"last update":"Mon Feb 19 21:50:56 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":1.806,"15min":1.869},"min":{"1min":0.378,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":2.2549999999999999,"5min":13.904,"15min":13.904},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":1.823,"15min":1.736},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.32600000000000001},"max":{"1min":1.881,"5min":13.894,"15min":13.894},"last":0.51100000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738638,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3566036,"kb_used_data":2667532,"kb_used_omap":0,"kb_used_meta":898496,"kb_avail":90179116,"statfs":{"total":95995035648,"available":92343414784,"internally_reserved":0,"allocated":2731552768,"data_stored":2730255081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":920059904},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:51:11 2024","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.71799999999999997,"15min":1.1120000000000001},"min":{"1min":0.20599999999999999,"5min":0.153,"15min":0.153},"max":{"1min":0.61299999999999999,"5min":6.1550000000000002,"15min":16.478000000000002},"last":0.253},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.97899999999999998,"15min":1.3979999999999999},"min":{"1min":0.23300000000000001,"5min":0.17899999999999999,"15min":0.17799999999999999},"max":{"1min":3.452,"5min":6.9359999999999999,"15min":13.422000000000001},"last":0.28199999999999997}]},{"osd":2,"last update":"Mon Feb 19 21:51:11 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.60699999999999998,"15min":0.64300000000000002},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":2.0619999999999998,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.39700000000000002,"5min":1.0249999999999999,"15min":1.129},"min":{"1min":0.23699999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.69799999999999995,"5min":8.9960000000000004,"15min":8.9960000000000004},"last":0.36699999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:51:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":1.107,"15min":1.698},"min":{"1min":0.255,"5min":0.217,"15min":0.21299999999999999},"max":{"1min":3.2080000000000002,"5min":12.691000000000001,"15min":14.507999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.94099999999999995,"15min":1.5740000000000001},"min":{"1min":0.308,"5min":0.24099999999999999,"15min":0.23400000000000001},"max":{"1min":3.722,"5min":6.6150000000000002,"15min":18.759},"last":0.57599999999999996}]},{"osd":4,"last update":"Mon Feb 19 21:50:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":1.6759999999999999,"15min":1.698},"min":{"1min":0.29899999999999999,"5min":0.252,"15min":0.252},"max":{"1min":4.4530000000000003,"5min":10.311,"15min":13.278},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.6160000000000001,"15min":1.5589999999999999},"min":{"1min":0.35499999999999998,"5min":0.28999999999999998,"15min":0.255},"max":{"1min":9.0530000000000008,"5min":10.109,"15min":10.109},"last":0.60499999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:51:01 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":1.911,"15min":2.097},"min":{"1min":0.32500000000000001,"5min":0.317,"15min":0.27600000000000002},"max":{"1min":3.52,"5min":25.442,"15min":42.799999999999997},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":1.9139999999999999,"15min":2.097},"min":{"1min":0.33200000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.597,"5min":25.411999999999999,"15min":42.695},"last":0.46100000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:51:16 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":1.544,"15min":1.6919999999999999},"min":{"1min":0.38700000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.749,"5min":10.278,"15min":42.777000000000001},"last":0.627},{"interface":"front","average":{"1min":0.71599999999999997,"5min":1.714,"15min":1.9450000000000001},"min":{"1min":0.39100000000000001,"5min":0.29599999999999999,"15min":0.28599999999999998},"max":{"1min":2.1909999999999998,"5min":11.84,"15min":13.289999999999999},"last":0.35699999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":1.6579999999999999,"15min":1.8220000000000001},"min":{"1min":0.375,"5min":0.36799999999999999,"15min":0.31},"max":{"1min":4.0049999999999999,"5min":15.688000000000001,"15min":42.758000000000003},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.751,"5min":1.647,"15min":1.746},"min":{"1min":0.41199999999999998,"5min":0.36399999999999999,"15min":0.33200000000000002},"max":{"1min":4.0170000000000003,"5min":10.470000000000001,"15min":42.718000000000004},"last":0.64800000000000002}]}]},{"osd":2,"up_from":394,"seq":1692217114652,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2060300,"kb_used_data":1748548,"kb_used_omap":0,"kb_used_meta":311743,"kb_avail":91684852,"statfs":{"total":95995035648,"available":93885288448,"internally_reserved":0,"allocated":1790513152,"data_stored":1789231667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":319224884},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":1.044,"15min":1.1259999999999999},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":4.6219999999999999,"5min":9.1530000000000005,"15min":9.1530000000000005},"last":3.1779999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":1.0589999999999999,"15min":1.1679999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":2.2919999999999998,"5min":6.149,"15min":6.149},"last":0.40999999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.56699999999999995,"15min":0.60299999999999998},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.69899999999999995,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":3.073},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.89700000000000002,"15min":0.94399999999999995},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":4.6689999999999996,"5min":6.992,"15min":6.992},"last":0.28100000000000003}]},{"osd":3,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":1.3169999999999999,"15min":1.405},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":6.0970000000000004,"5min":6.9470000000000001,"15min":6.9470000000000001},"last":0.37},{"interface":"front","average":{"1min":0.57699999999999996,"5min":1.149,"15min":1.2450000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":2.258,"5min":6.6500000000000004,"15min":6.6500000000000004},"last":0.442}]},{"osd":4,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":1.867,"15min":2.0609999999999999},"min":{"1min":0.32600000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":3.8740000000000001,"5min":7.0339999999999998,"15min":7.0339999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.79800000000000004,"5min":1.7250000000000001,"15min":1.879},"min":{"1min":0.30299999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":4.7009999999999996,"5min":7.0419999999999998,"15min":7.0419999999999998},"last":0.40500000000000003}]},{"osd":5,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.6870000000000001,"15min":1.7549999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":5.9260000000000002,"5min":10.067,"15min":10.067},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.63,"5min":1.5820000000000001,"15min":1.7410000000000001},"min":{"1min":0.34999999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":3.8730000000000002,"5min":13.558,"15min":13.558},"last":0.61299999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":1.5600000000000001,"15min":1.6879999999999999},"min":{"1min":0.33700000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":3.843,"5min":5.6829999999999998,"15min":5.6829999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.97199999999999998,"15min":1.018},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.2719999999999998,"5min":7,"15min":7},"last":0.48499999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.3740000000000001,"15min":1.427},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":4.1230000000000002,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.78000000000000003,"15min":0.82299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.67700000000000005,"5min":2.782,"15min":2.782},"last":0.51300000000000001}]}]},{"osd":3,"up_from":0,"seq":111669149950,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":32,"seq":137438953719,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3496392,"kb_used_data":2910784,"kb_used_omap":0,"kb_used_meta":585600,"kb_avail":90248760,"statfs":{"total":95995035648,"available":92414730240,"internally_reserved":0,"allocated":2980642816,"data_stored":2979356465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":599654400},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:50:33 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":2.173,"15min":1.905},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":5.8780000000000001,"5min":53.936,"15min":53.936},"last":0.221},{"interface":"front","average":{"1min":1.282,"5min":2.3889999999999998,"15min":2.069},"min":{"1min":0.25900000000000001,"5min":0.23000000000000001,"15min":0.22600000000000001},"max":{"1min":9.7230000000000008,"5min":54.405999999999999,"15min":54.405999999999999},"last":2.133}]},{"osd":1,"last update":"Mon Feb 19 21:50:33 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":2.2669999999999999,"15min":1.7669999999999999},"min":{"1min":0.26500000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":5.8490000000000002,"5min":54.731000000000002,"15min":54.731000000000002},"last":0.253},{"interface":"front","average":{"1min":1.375,"5min":2.198,"15min":1.665},"min":{"1min":0.255,"5min":0.252,"15min":0.25},"max":{"1min":9.7639999999999993,"5min":52.490000000000002,"15min":52.490000000000002},"last":2.048}]},{"osd":2,"last update":"Mon Feb 19 21:51:10 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":1.77,"15min":1.974},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.274,"5min":9.0619999999999994,"15min":9.0619999999999994},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":1.8069999999999999,"15min":2.0110000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.2930000000000001,"5min":9.0899999999999999,"15min":9.0899999999999999},"last":0.32100000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:50:33 2024","interfaces":[{"interface":"back","average":{"1min":1.653,"5min":1.6799999999999999,"15min":1.6899999999999999},"min":{"1min":0.372,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":6.3170000000000002,"5min":6.5579999999999998,"15min":15.914999999999999},"last":2.145},{"interface":"front","average":{"1min":1.115,"5min":1.7889999999999999,"15min":1.6879999999999999},"min":{"1min":0.40799999999999997,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":7.9569999999999999,"5min":9.4000000000000004,"15min":13.321},"last":0.30099999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:50:22 2024","interfaces":[{"interface":"back","average":{"1min":2.0899999999999999,"5min":2.3780000000000001,"15min":1.7330000000000001},"min":{"1min":0.33300000000000002,"5min":0.23799999999999999,"15min":0.23400000000000001},"max":{"1min":13.805999999999999,"5min":16.731999999999999,"15min":18.916},"last":2.0859999999999999},{"interface":"front","average":{"1min":1.889,"5min":2.3500000000000001,"15min":1.9390000000000001},"min":{"1min":0.35999999999999999,"5min":0.26200000000000001,"15min":0.253},"max":{"1min":7.3719999999999999,"5min":8.2959999999999994,"15min":14.840999999999999},"last":2.3199999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:50:33 2024","interfaces":[{"interface":"back","average":{"1min":1.756,"5min":1.9630000000000001,"15min":1.615},"min":{"1min":0.40200000000000002,"5min":0.28999999999999998,"15min":0.28599999999999998},"max":{"1min":7.4050000000000002,"5min":9.1720000000000006,"15min":13.27},"last":2.1819999999999999},{"interface":"front","average":{"1min":2.0819999999999999,"5min":2.4710000000000001,"15min":1.823},"min":{"1min":0.34300000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":13.715,"5min":18.670000000000002,"15min":18.670000000000002},"last":2.1619999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:51:00 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":2.1309999999999998,"15min":1.7669999999999999},"min":{"1min":0.34599999999999997,"5min":0.311,"15min":0.28899999999999998},"max":{"1min":2.4780000000000002,"5min":16.763999999999999,"15min":16.763999999999999},"last":2.1110000000000002},{"interface":"front","average":{"1min":0.63,"5min":1.71,"15min":1.6859999999999999},"min":{"1min":0.377,"5min":0.314,"15min":0.31},"max":{"1min":1.23,"5min":10.044,"15min":12.808999999999999},"last":2.403}]}]},{"osd":5,"up_from":38,"seq":163208757491,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2741948,"kb_used_data":1847412,"kb_used_omap":0,"kb_used_meta":894528,"kb_avail":91003204,"statfs":{"total":95995035648,"available":93187280896,"internally_reserved":0,"allocated":1891749888,"data_stored":1890475924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":915996672},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":1.5169999999999999,"15min":1.7729999999999999},"min":{"1min":0.23100000000000001,"5min":0.214,"15min":0.20599999999999999},"max":{"1min":5.9550000000000001,"5min":19.236000000000001,"15min":20.550999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":1.4850000000000001,"15min":1.9059999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.20899999999999999},"max":{"1min":3.7949999999999999,"5min":10.887,"15min":20.879000000000001},"last":0.35799999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":1.462,"15min":1.726},"min":{"1min":0.28100000000000003,"5min":0.24299999999999999,"15min":0.23100000000000001},"max":{"1min":2.3220000000000001,"5min":8.2010000000000005,"15min":10.42},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":1.506,"15min":1.6100000000000001},"min":{"1min":0.28299999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.522,"5min":10.965,"15min":10.965},"last":0.30199999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.29,"15min":1.361},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":7.0380000000000003,"5min":7.0380000000000003,"15min":7.0380000000000003},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.2450000000000001,"15min":1.29},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.1869999999999998,"5min":4.2619999999999996,"15min":4.2619999999999996},"last":0.38100000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":1.804,"15min":2.0779999999999998},"min":{"1min":0.35099999999999998,"5min":0.26100000000000001,"15min":0.24099999999999999},"max":{"1min":3.6320000000000001,"5min":19.321000000000002,"15min":20.146999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.5169999999999999,"15min":2.1520000000000001},"min":{"1min":0.33600000000000002,"5min":0.311,"15min":0.29499999999999998},"max":{"1min":3.6400000000000001,"5min":8.0359999999999996,"15min":20.120000000000001},"last":0.45200000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":1.4239999999999999,"15min":1.393},"min":{"1min":0.255,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.0449999999999999,"5min":16.643999999999998,"15min":21.577000000000002},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":1.913,"15min":1.883},"min":{"1min":0.32600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.3999999999999999,"5min":19.274000000000001,"15min":19.274000000000001},"last":0.54600000000000004}]},{"osd":6,"last update":"Mon Feb 19 21:50:30 2024","interfaces":[{"interface":"back","average":{"1min":2.0649999999999999,"5min":2.29,"15min":1.8979999999999999},"min":{"1min":0.34000000000000002,"5min":0.307,"15min":0.221},"max":{"1min":8.109,"5min":19.884,"15min":19.884},"last":0.59699999999999998},{"interface":"front","average":{"1min":1.6679999999999999,"5min":2.044,"15min":1.867},"min":{"1min":0.44900000000000001,"5min":0.26700000000000002,"15min":0.23599999999999999},"max":{"1min":6.0750000000000002,"5min":10.260999999999999,"15min":13.532999999999999},"last":0.41999999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:50:54 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":2.129,"15min":2.0249999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.27100000000000002},"max":{"1min":2.4900000000000002,"5min":12.611000000000001,"15min":12.962},"last":0.504},{"interface":"front","average":{"1min":0.626,"5min":2.024,"15min":1.8360000000000001},"min":{"1min":0.38100000000000001,"5min":0.221,"15min":0.221},"max":{"1min":1.681,"5min":15.593999999999999,"15min":17.759},"last":0.49399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2724335616,"data_stored":2724331544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1090846720,"data_stored":1090846720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1785593856,"data_stored":1785593856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2976583680,"data_stored":2976579608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1886650368,"data_stored":1886650368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1904939008,"data_stored":1904934936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":884932608,"data_stored":884932608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:51:30.811 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph status --format=json 2024-02-19T21:51:30.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:29.192603+0000 mgr.y (mgr.14514) 721 : cluster [DBG] pgmap v938: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 4.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 661 B/s rd, 0 B/s wr, 136 op/s; 1884/199488 objects degraded (0.944%); 7023/199488 objects misplaced (3.521%); 3.9 MiB/s, 85 objects/s recovering 2024-02-19T21:51:30.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:30.292433+0000 mon.a (mon.0) 1743 : cluster [WRN] Health check update: Degraded data redundancy: 1884/199488 objects degraded (0.944%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:30.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:30.302352+0000 mon.a (mon.0) 1744 : cluster [DBG] osdmap e448: 8 total, 8 up, 7 in 2024-02-19T21:51:31.045 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:51:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:51:30] "GET /metrics HTTP/1.1" 200 176570 "" "Prometheus/2.33.4" 2024-02-19T21:51:31.049 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:51:31.054 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:31.055 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:51:31.155 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:51:31.186 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:31.286 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:51:31.289 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:31.290 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:51:31.305 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:51:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:51:31.391 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:51:31.416 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:31.435 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:51:31.438 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:31.438 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:51:31.539 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:51:31.565 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:31.585 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:51:31.587 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:31.588 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:51:31.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:31.024738+0000 mgr.y (mgr.14514) 722 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:51:31.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:31.024738+0000 mgr.y (mgr.14514) 722 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:51:31.681 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:51:31.688 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:51:31.701 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:51:31.712 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:31.024738+0000 mgr.y (mgr.14514) 722 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:51:31.714 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:31.719 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:51:31.737 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:51:31.739 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:51:31.742 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:31.742 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:51:31.757 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:51:31.775 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:51:31.793 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:51:31.813 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:51:31.818 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:51:31.818 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:51:31.818 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:51:31.818 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:51:31.819 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:51:31.819 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:51:31.819 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:51:31.819 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:51:31.843 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:51:31.875 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:32.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:31.193160+0000 mgr.y (mgr.14514) 723 : cluster [DBG] pgmap v940: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 4.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 203 op/s; 1767/197469 objects degraded (0.895%); 6965/197469 objects misplaced (3.527%); 4.3 MiB/s, 89 objects/s recovering 2024-02-19T21:51:32.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:31.664660+0000 mon.a (mon.0) 1745 : audit [DBG] from='client.? 172.21.15.80:0/565932978' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:51:32.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:31.193160+0000 mgr.y (mgr.14514) 723 : cluster [DBG] pgmap v940: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 4.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 203 op/s; 1767/197469 objects degraded (0.895%); 6965/197469 objects misplaced (3.527%); 4.3 MiB/s, 89 objects/s recovering 2024-02-19T21:51:32.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:31.664660+0000 mon.a (mon.0) 1745 : audit [DBG] from='client.? 172.21.15.80:0/565932978' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:51:32.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:31.193160+0000 mgr.y (mgr.14514) 723 : cluster [DBG] pgmap v940: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 4.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 203 op/s; 1767/197469 objects degraded (0.895%); 6965/197469 objects misplaced (3.527%); 4.3 MiB/s, 89 objects/s recovering 2024-02-19T21:51:32.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:31.664660+0000 mon.a (mon.0) 1745 : audit [DBG] from='client.? 172.21.15.80:0/565932978' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:51:34.634 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:51:34.639 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:34.639 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:51:34.740 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:51:34.768 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:34.789 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:51:34.793 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:34.793 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:51:34.894 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:51:34.922 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:34.943 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:51:34.947 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:34.947 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:51:35.048 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:51:35.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:33.193597+0000 mgr.y (mgr.14514) 724 : cluster [DBG] pgmap v941: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 4.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 149 op/s; 1713/197166 objects degraded (0.869%); 6911/197166 objects misplaced (3.505%); 2.2 MiB/s, 35 objects/s recovering 2024-02-19T21:51:35.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:33.964714+0000 mon.a (mon.0) 1746 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:51:35.080 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:35.105 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:51:35.108 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:35.109 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:51:35.210 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:51:35.288 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:33.193597+0000 mgr.y (mgr.14514) 724 : cluster [DBG] pgmap v941: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 4.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 149 op/s; 1713/197166 objects degraded (0.869%); 6911/197166 objects misplaced (3.505%); 2.2 MiB/s, 35 objects/s recovering 2024-02-19T21:51:35.288 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:33.964714+0000 mon.a (mon.0) 1746 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:51:35.288 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:33.193597+0000 mgr.y (mgr.14514) 724 : cluster [DBG] pgmap v941: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 4.0 GiB data, 17 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 149 op/s; 1713/197166 objects degraded (0.869%); 6911/197166 objects misplaced (3.505%); 2.2 MiB/s, 35 objects/s recovering 2024-02-19T21:51:35.288 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:33.964714+0000 mon.a (mon.0) 1746 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:51:35.291 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:35.491 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:51:35.494 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:35.494 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:51:35.596 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:51:35.624 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:35.724 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:51:35.729 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:35.729 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:51:35.830 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:51:35.858 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:35.880 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:51:35.885 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:35.885 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:51:35.970 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:51:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:51:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:51:35.972 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:35.294156+0000 mon.a (mon.0) 1747 : cluster [WRN] Health check update: Degraded data redundancy: 1713/197166 objects degraded (0.869%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:35.986 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:51:36.024 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:36.126 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:51:36.130 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:36.130 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:51:36.231 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:51:36.247 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:51:36.261 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:51:36.261 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-02-19T21:51:36.261 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-02-19T21:51:36.261 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:51:36.263 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:35.294156+0000 mon.a (mon.0) 1747 : cluster [WRN] Health check update: Degraded data redundancy: 1713/197166 objects degraded (0.869%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:36.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:35.294156+0000 mon.a (mon.0) 1747 : cluster [WRN] Health check update: Degraded data redundancy: 1713/197166 objects degraded (0.869%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:36.265 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:36.985 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-02-19T21:51:37.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:35.194164+0000 mgr.y (mgr.14514) 725 : cluster [DBG] pgmap v942: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 4.0 GiB data, 16 GiB used, 609 GiB / 626 GiB avail; 527 B/s rd, 0 B/s wr, 142 op/s; 1655/195726 objects degraded (0.846%); 6911/195726 objects misplaced (3.531%); 1.8 MiB/s, 29 objects/s recovering 2024-02-19T21:51:37.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:36.257174+0000 mon.c (mon.2) 109 : audit [INF] from='client.? 172.21.15.80:0/2400099294' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:51:37.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:36.257591+0000 mon.a (mon.0) 1748 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:51:37.345 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:35.194164+0000 mgr.y (mgr.14514) 725 : cluster [DBG] pgmap v942: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 4.0 GiB data, 16 GiB used, 609 GiB / 626 GiB avail; 527 B/s rd, 0 B/s wr, 142 op/s; 1655/195726 objects degraded (0.846%); 6911/195726 objects misplaced (3.531%); 1.8 MiB/s, 29 objects/s recovering 2024-02-19T21:51:37.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:36.257174+0000 mon.c (mon.2) 109 : audit [INF] from='client.? 172.21.15.80:0/2400099294' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:51:37.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:36.257591+0000 mon.a (mon.0) 1748 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:51:37.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:35.194164+0000 mgr.y (mgr.14514) 725 : cluster [DBG] pgmap v942: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 4.0 GiB data, 16 GiB used, 609 GiB / 626 GiB avail; 527 B/s rd, 0 B/s wr, 142 op/s; 1655/195726 objects degraded (0.846%); 6911/195726 objects misplaced (3.531%); 1.8 MiB/s, 29 objects/s recovering 2024-02-19T21:51:37.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:36.257174+0000 mon.c (mon.2) 109 : audit [INF] from='client.? 172.21.15.80:0/2400099294' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:51:37.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:36.257591+0000 mon.a (mon.0) 1748 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:51:37.499 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:51:38.221 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:51:38.224 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:38.224 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:51:38.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:36.972207+0000 mon.a (mon.0) 1749 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:51:38.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:36.980904+0000 mon.a (mon.0) 1750 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:51:38.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:36.980971+0000 mon.a (mon.0) 1751 : cluster [DBG] osdmap e449: 8 total, 8 up, 7 in 2024-02-19T21:51:38.325 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:51:38.345 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:36.972207+0000 mon.a (mon.0) 1749 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:51:38.345 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:36.980904+0000 mon.a (mon.0) 1750 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:51:38.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:36.980971+0000 mon.a (mon.0) 1751 : cluster [DBG] osdmap e449: 8 total, 8 up, 7 in 2024-02-19T21:51:38.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:36.972207+0000 mon.a (mon.0) 1749 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:51:38.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:36.980904+0000 mon.a (mon.0) 1750 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:51:38.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:36.980971+0000 mon.a (mon.0) 1751 : cluster [DBG] osdmap e449: 8 total, 8 up, 7 in 2024-02-19T21:51:38.354 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:38.939 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.3 dump_blocked_ops 2024-02-19T21:51:39.006 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:51:39.009 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:39.010 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:51:39.110 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:51:39.138 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:39.172 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:37.194584+0000 mgr.y (mgr.14514) 726 : cluster [DBG] pgmap v944: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.9 GiB data, 16 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 205 op/s; 1539/194583 objects degraded (0.791%); 6796/194583 objects misplaced (3.493%); 2.7 MiB/s, 42 objects/s recovering 2024-02-19T21:51:39.173 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:37.194584+0000 mgr.y (mgr.14514) 726 : cluster [DBG] pgmap v944: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.9 GiB data, 16 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 205 op/s; 1539/194583 objects degraded (0.791%); 6796/194583 objects misplaced (3.493%); 2.7 MiB/s, 42 objects/s recovering 2024-02-19T21:51:39.177 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:51:39.180 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:39.180 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:51:39.281 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:51:39.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:37.194584+0000 mgr.y (mgr.14514) 726 : cluster [DBG] pgmap v944: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.9 GiB data, 16 GiB used, 609 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 205 op/s; 1539/194583 objects degraded (0.791%); 6796/194583 objects misplaced (3.493%); 2.7 MiB/s, 42 objects/s recovering 2024-02-19T21:51:39.313 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:39.331 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:51:39.335 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:39.335 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:51:39.436 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:51:39.464 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:39.482 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:51:39.485 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:39.486 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:51:39.586 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:51:39.617 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:51:39.617 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:39.644 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:51:39.649 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:39.650 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:51:39.751 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:51:39.779 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:39.805 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:51:39.807 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:39.808 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:51:39.909 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:51:39.939 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:40.142 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:51:40.146 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:40.146 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:51:40.213 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set noscrub 2024-02-19T21:51:40.247 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:51:40.283 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:40.310 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:51:40.313 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:40.314 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:51:40.414 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:51:40.456 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:40.503 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:51:40.514 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:40.515 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:51:40.616 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:51:40.643 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:40.673 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:51:40.675 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:40.676 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:51:40.773 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:51:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:51:40] "GET /metrics HTTP/1.1" 200 176567 "" "Prometheus/2.33.4" 2024-02-19T21:51:40.776 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:51:40.805 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:40.822 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:51:40.822 INFO:teuthology.orchestra.run.smithi080.stdout:{"fsid":"6f763558-cf6d-11ee-95bb-87774f69a715","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1539/194583 objects degraded (0.791%), 3 pgs degraded, 3 pgs undersized","count":6},"muted":false}},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1388,"monmap":{"epoch":3,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":450,"num_osds":8,"num_up_osds":8,"osd_up_since":1708379347,"num_in_osds":7,"osd_in_since":1708379252,"num_remapped_pgs":3},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":135},{"state_name":"active+recovering+undersized+degraded+remapped","count":3}],"num_pgs":138,"num_pools":7,"num_objects":64861,"data_bytes":4238087868,"bytes_used":17602666496,"bytes_avail":654362583040,"bytes_total":671965249536,"degraded_objects":1539,"degraded_total":194583,"degraded_ratio":0.0079092212577666094,"misplaced_objects":6796,"misplaced_total":194583,"misplaced_ratio":0.034925969894595107,"recovering_objects_per_sec":32,"recovering_bytes_per_sec":2099853,"recovering_keys_per_sec":0,"num_objects_recovered":285,"num_bytes_recovered":18677760,"num_keys_recovered":0,"read_bytes_sec":575,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":117},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"services":{"dashboard":"https://172.21.15.80:8443/","prometheus":"http://172.21.15.80:9283/"}},"servicemap":{"epoch":15,"modified":"2024-02-19T21:50:07.164150+0000","services":{"rgw":{"daemons":{"summary":"","14445":{"start_epoch":12,"start_stamp":"2024-02-19T21:32:30.457944+0000","gid":14445,"addr":"172.21.15.80:0/10763483","metadata":{"arch":"x86_64","ceph_release":"pacific","ceph_version":"ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)","ceph_version_short":"16.2.14-548-g81bd20d6","container_hostname":"smithi080","container_image":"quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9","cpu":"Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz","distro":"centos","distro_description":"CentOS Stream 8","distro_version":"8","frontend_config#0":"beast port=80","frontend_type#0":"beast","hostname":"smithi080","id":"foo.a","kernel_description":"#1 SMP Mon Feb 5 18:34:56 UTC 2024","kernel_version":"4.18.0-539.el8.x86_64","mem_swap_kb":"0","mem_total_kb":"32537572","num_handles":"1","os":"Linux","pid":"7","realm_id":"","realm_name":"","zone_id":"34a855d6-dbbc-4802-a6e9-a7d60f23c9d4","zone_name":"default","zonegroup_id":"7194a06a-53d8-4b5f-8306-5954e6d460c8","zonegroup_name":"default"},"task_status":{}}}}}},"progress_events":{"0d84ec8e-b738-4996-b3e9-d3d54263ac3b":{"message":"Global Recovery Event (4m)\n [===========================.] (remaining: 5s)","progress":0.97826087474822998,"add_to_ceph_s":true}}} 2024-02-19T21:51:40.832 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:51:40.835 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:40.835 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:51:40.936 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:51:40.968 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:40.983 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:39.194949+0000 mgr.y (mgr.14514) 727 : cluster [DBG] pgmap v945: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.9 GiB data, 16 GiB used, 609 GiB / 626 GiB avail; 575 B/s rd, 0 B/s wr, 118 op/s; 1539/194583 objects degraded (0.791%); 6796/194583 objects misplaced (3.493%); 2.0 MiB/s, 32 objects/s recovering 2024-02-19T21:51:40.983 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:40.295234+0000 mon.a (mon.0) 1752 : cluster [WRN] Health check update: Degraded data redundancy: 1539/194583 objects degraded (0.791%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:40.983 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:40.303086+0000 mon.a (mon.0) 1753 : cluster [DBG] osdmap e450: 8 total, 8 up, 7 in 2024-02-19T21:51:40.984 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:40.822642+0000 mon.b (mon.1) 69 : audit [DBG] from='client.? 172.21.15.80:0/2445013988' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-02-19T21:51:41.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:39.194949+0000 mgr.y (mgr.14514) 727 : cluster [DBG] pgmap v945: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.9 GiB data, 16 GiB used, 609 GiB / 626 GiB avail; 575 B/s rd, 0 B/s wr, 118 op/s; 1539/194583 objects degraded (0.791%); 6796/194583 objects misplaced (3.493%); 2.0 MiB/s, 32 objects/s recovering 2024-02-19T21:51:41.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:40.295234+0000 mon.a (mon.0) 1752 : cluster [WRN] Health check update: Degraded data redundancy: 1539/194583 objects degraded (0.791%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:41.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:40.303086+0000 mon.a (mon.0) 1753 : cluster [DBG] osdmap e450: 8 total, 8 up, 7 in 2024-02-19T21:51:41.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:40.822642+0000 mon.b (mon.1) 69 : audit [DBG] from='client.? 172.21.15.80:0/2445013988' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-02-19T21:51:41.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:39.194949+0000 mgr.y (mgr.14514) 727 : cluster [DBG] pgmap v945: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.9 GiB data, 16 GiB used, 609 GiB / 626 GiB avail; 575 B/s rd, 0 B/s wr, 118 op/s; 1539/194583 objects degraded (0.791%); 6796/194583 objects misplaced (3.493%); 2.0 MiB/s, 32 objects/s recovering 2024-02-19T21:51:41.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:40.295234+0000 mon.a (mon.0) 1752 : cluster [WRN] Health check update: Degraded data redundancy: 1539/194583 objects degraded (0.791%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:41.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:40.303086+0000 mon.a (mon.0) 1753 : cluster [DBG] osdmap e450: 8 total, 8 up, 7 in 2024-02-19T21:51:41.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:40.822642+0000 mon.b (mon.1) 69 : audit [DBG] from='client.? 172.21.15.80:0/2445013988' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-02-19T21:51:41.306 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:51:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:51:41.620 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:51:41.623 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:41.623 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:51:41.724 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:51:41.754 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:41.987 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:41.034707+0000 mgr.y (mgr.14514) 728 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:51:42.065 INFO:tasks.cephadm.ceph_manager.ceph:making progress, resetting timeout 2024-02-19T21:51:42.065 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:51:42.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:41.034707+0000 mgr.y (mgr.14514) 728 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:51:42.309 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:51:42.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:41.034707+0000 mgr.y (mgr.14514) 728 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:51:42.315 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:42.316 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:51:42.417 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:51:42.445 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:42.610 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:51:42.613 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:42.614 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:51:42.619 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:51:42.619 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:51:42.638 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:51:42.665 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:51:42.682 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:51:42.699 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:51:42.715 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:51:42.727 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:51:42.744 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:42.746 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:51:42.762 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:51:42.765 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:42.766 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:51:42.766 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:51:42.784 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:51:42.803 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:51:42.804 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:51:42.804 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:51:42.804 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:51:42.804 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:51:42.804 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:51:42.804 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:51:42.805 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:51:42.805 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:51:42.866 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:51:42.894 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:43.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:41.195429+0000 mgr.y (mgr.14514) 729 : cluster [DBG] pgmap v947: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.9 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 216 op/s; 1422/191997 objects degraded (0.741%); 6737/191997 objects misplaced (3.509%); 2.3 MiB/s, 36 objects/s recovering 2024-02-19T21:51:43.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:42.603519+0000 mon.a (mon.0) 1754 : audit [DBG] from='client.? 172.21.15.80:0/3199865962' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:51:43.228 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:41.195429+0000 mgr.y (mgr.14514) 729 : cluster [DBG] pgmap v947: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.9 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 216 op/s; 1422/191997 objects degraded (0.741%); 6737/191997 objects misplaced (3.509%); 2.3 MiB/s, 36 objects/s recovering 2024-02-19T21:51:43.228 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:42.603519+0000 mon.a (mon.0) 1754 : audit [DBG] from='client.? 172.21.15.80:0/3199865962' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:51:43.229 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:41.195429+0000 mgr.y (mgr.14514) 729 : cluster [DBG] pgmap v947: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.9 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 216 op/s; 1422/191997 objects degraded (0.741%); 6737/191997 objects misplaced (3.509%); 2.3 MiB/s, 36 objects/s recovering 2024-02-19T21:51:43.229 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:42.603519+0000 mon.a (mon.0) 1754 : audit [DBG] from='client.? 172.21.15.80:0/3199865962' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:51:44.545 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:51:44.550 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:44.550 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:51:44.651 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:51:44.684 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:45.283 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:43.195840+0000 mgr.y (mgr.14514) 730 : cluster [DBG] pgmap v948: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.9 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 174 op/s; 1367/191577 objects degraded (0.714%); 6681/191577 objects misplaced (3.487%); 2.2 MiB/s, 35 objects/s recovering 2024-02-19T21:51:45.283 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:44.027874+0000 osd.7 (osd.7) 248 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:51:45.283 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:44.027926+0000 osd.7 (osd.7) 249 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:51:45.284 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:43.195840+0000 mgr.y (mgr.14514) 730 : cluster [DBG] pgmap v948: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.9 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 174 op/s; 1367/191577 objects degraded (0.714%); 6681/191577 objects misplaced (3.487%); 2.2 MiB/s, 35 objects/s recovering 2024-02-19T21:51:45.284 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:44.027874+0000 osd.7 (osd.7) 248 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:51:45.284 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:44.027926+0000 osd.7 (osd.7) 249 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:51:45.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:43.195840+0000 mgr.y (mgr.14514) 730 : cluster [DBG] pgmap v948: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.9 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 174 op/s; 1367/191577 objects degraded (0.714%); 6681/191577 objects misplaced (3.487%); 2.2 MiB/s, 35 objects/s recovering 2024-02-19T21:51:45.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:44.027874+0000 osd.7 (osd.7) 248 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:51:45.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:44.027926+0000 osd.7 (osd.7) 249 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:51:46.004 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:51:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:51:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:51:46.004 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:44.995238+0000 mon.a (mon.0) 1755 : cluster [DBG] osdmap e451: 8 total, 8 up, 7 in 2024-02-19T21:51:46.004 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:45.297804+0000 mon.a (mon.0) 1756 : cluster [WRN] Health check update: Degraded data redundancy: 1367/191577 objects degraded (0.714%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:46.004 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:45.302046+0000 mon.a (mon.0) 1757 : cluster [DBG] osdmap e452: 8 total, 8 up, 7 in 2024-02-19T21:51:46.005 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:44.995238+0000 mon.a (mon.0) 1755 : cluster [DBG] osdmap e451: 8 total, 8 up, 7 in 2024-02-19T21:51:46.005 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:45.297804+0000 mon.a (mon.0) 1756 : cluster [WRN] Health check update: Degraded data redundancy: 1367/191577 objects degraded (0.714%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:46.005 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:45.302046+0000 mon.a (mon.0) 1757 : cluster [DBG] osdmap e452: 8 total, 8 up, 7 in 2024-02-19T21:51:46.236 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:51:46.241 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:46.241 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:51:46.276 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:44.995238+0000 mon.a (mon.0) 1755 : cluster [DBG] osdmap e451: 8 total, 8 up, 7 in 2024-02-19T21:51:46.276 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:45.297804+0000 mon.a (mon.0) 1756 : cluster [WRN] Health check update: Degraded data redundancy: 1367/191577 objects degraded (0.714%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:46.276 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:45.302046+0000 mon.a (mon.0) 1757 : cluster [DBG] osdmap e452: 8 total, 8 up, 7 in 2024-02-19T21:51:46.342 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:51:46.373 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:51:46.506 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:46.506 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:51:46.607 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:51:46.633 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:46.651 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:51:46.654 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:46.654 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:51:46.755 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:51:46.783 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:46.803 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:51:46.809 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:46.809 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:51:46.910 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:51:46.940 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:47.006 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:45.196419+0000 mgr.y (mgr.14514) 731 : cluster [DBG] pgmap v950: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.9 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 195 op/s; 1309/189900 objects degraded (0.689%); 6681/189900 objects misplaced (3.518%); 1.8 MiB/s, 28 objects/s recovering 2024-02-19T21:51:47.006 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:46.940279+0000 osd.2 (osd.2) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:51:47.006 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:46.940348+0000 osd.2 (osd.2) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:51:47.038 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:51:47.044 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:51:47.053 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:47.054 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:51:47.154 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:51:47.181 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:47.345 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:45.196419+0000 mgr.y (mgr.14514) 731 : cluster [DBG] pgmap v950: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.9 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 195 op/s; 1309/189900 objects degraded (0.689%); 6681/189900 objects misplaced (3.518%); 1.8 MiB/s, 28 objects/s recovering 2024-02-19T21:51:47.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:46.940279+0000 osd.2 (osd.2) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:51:47.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:46.940348+0000 osd.2 (osd.2) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:51:47.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:45.196419+0000 mgr.y (mgr.14514) 731 : cluster [DBG] pgmap v950: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.9 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 195 op/s; 1309/189900 objects degraded (0.689%); 6681/189900 objects misplaced (3.518%); 1.8 MiB/s, 28 objects/s recovering 2024-02-19T21:51:47.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:46.940279+0000 osd.2 (osd.2) 5 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:51:47.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:46.940348+0000 osd.2 (osd.2) 6 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:51:47.584 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:51:47.584 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:51:48.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:47.020665+0000 mon.a (mon.0) 1758 : cluster [DBG] osdmap e453: 8 total, 8 up, 7 in 2024-02-19T21:51:48.345 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:47.020665+0000 mon.a (mon.0) 1758 : cluster [DBG] osdmap e453: 8 total, 8 up, 7 in 2024-02-19T21:51:48.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:47.020665+0000 mon.a (mon.0) 1758 : cluster [DBG] osdmap e453: 8 total, 8 up, 7 in 2024-02-19T21:51:49.024 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:47.196864+0000 mgr.y (mgr.14514) 732 : cluster [DBG] pgmap v953: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.8 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 181 op/s; 1194/188748 objects degraded (0.633%); 6566/188748 objects misplaced (3.479%); 2.4 MiB/s, 38 objects/s recovering 2024-02-19T21:51:49.024 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:48.025431+0000 mon.c (mon.2) 110 : audit [INF] from='client.? 172.21.15.80:0/679025033' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:51:49.024 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:48.025693+0000 mon.a (mon.0) 1759 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:51:49.024 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:48.964430+0000 mon.a (mon.0) 1760 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:51:49.025 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:47.196864+0000 mgr.y (mgr.14514) 732 : cluster [DBG] pgmap v953: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.8 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 181 op/s; 1194/188748 objects degraded (0.633%); 6566/188748 objects misplaced (3.479%); 2.4 MiB/s, 38 objects/s recovering 2024-02-19T21:51:49.025 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:48.025431+0000 mon.c (mon.2) 110 : audit [INF] from='client.? 172.21.15.80:0/679025033' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:51:49.025 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:48.025693+0000 mon.a (mon.0) 1759 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:51:49.025 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:48.964430+0000 mon.a (mon.0) 1760 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:51:49.036 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-02-19T21:51:49.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:47.196864+0000 mgr.y (mgr.14514) 732 : cluster [DBG] pgmap v953: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.8 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 181 op/s; 1194/188748 objects degraded (0.633%); 6566/188748 objects misplaced (3.479%); 2.4 MiB/s, 38 objects/s recovering 2024-02-19T21:51:49.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:48.025431+0000 mon.c (mon.2) 110 : audit [INF] from='client.? 172.21.15.80:0/679025033' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:51:49.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:48.025693+0000 mon.a (mon.0) 1759 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:51:49.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:48.964430+0000 mon.a (mon.0) 1760 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:51:49.342 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:51:49.346 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:49.346 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:51:49.447 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:51:49.475 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:49.500 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:51:49.502 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:49.502 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:51:49.603 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:51:49.675 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:49.802 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.3 dump_historic_ops 2024-02-19T21:51:50.028 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:49.023571+0000 mon.a (mon.0) 1761 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:51:50.028 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:49.032183+0000 mon.a (mon.0) 1762 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:51:50.028 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:49.032271+0000 mon.a (mon.0) 1763 : cluster [DBG] osdmap e454: 8 total, 8 up, 7 in 2024-02-19T21:51:50.028 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:49.034040+0000 osd.3 (osd.3) 228 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:51:50.028 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:49.034119+0000 osd.3 (osd.3) 229 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:51:50.274 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:51:50.277 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:51:50.301 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:49.023571+0000 mon.a (mon.0) 1761 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:51:50.301 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:49.032183+0000 mon.a (mon.0) 1762 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:51:50.301 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:49.032271+0000 mon.a (mon.0) 1763 : cluster [DBG] osdmap e454: 8 total, 8 up, 7 in 2024-02-19T21:51:50.301 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:49.034040+0000 osd.3 (osd.3) 228 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:51:50.301 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:49.034119+0000 osd.3 (osd.3) 229 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:51:50.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:49.023571+0000 mon.a (mon.0) 1761 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:51:50.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:49.032183+0000 mon.a (mon.0) 1762 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:51:50.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:49.032271+0000 mon.a (mon.0) 1763 : cluster [DBG] osdmap e454: 8 total, 8 up, 7 in 2024-02-19T21:51:50.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:49.034040+0000 osd.3 (osd.3) 228 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:51:50.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:49.034119+0000 osd.3 (osd.3) 229 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:51:50.727 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:51:50.733 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:51:50.733 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:50.734 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:51:50.834 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:51:50.861 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:50.886 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:51:50.889 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:50.889 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:51:50.990 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:51:51.005 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:51:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:51:50] "GET /metrics HTTP/1.1" 200 176572 "" "Prometheus/2.33.4" 2024-02-19T21:51:51.026 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:51.306 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:51:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:51:51.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:49.197269+0000 mgr.y (mgr.14514) 733 : cluster [DBG] pgmap v955: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.8 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 182 op/s; 1194/188748 objects degraded (0.633%); 6566/188748 objects misplaced (3.479%); 2.6 MiB/s, 41 objects/s recovering 2024-02-19T21:51:51.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:50.045170+0000 mon.a (mon.0) 1764 : cluster [DBG] osdmap e455: 8 total, 8 up, 7 in 2024-02-19T21:51:51.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:50.196421+0000 mon.a (mon.0) 1765 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:51:51.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:50.299422+0000 mon.a (mon.0) 1766 : cluster [WRN] Health check update: Degraded data redundancy: 1194/188748 objects degraded (0.633%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:51.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:50.306086+0000 mon.a (mon.0) 1767 : cluster [DBG] osdmap e456: 8 total, 8 up, 7 in 2024-02-19T21:51:51.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:50.925186+0000 mon.a (mon.0) 1768 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:51:51.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:50.925863+0000 mon.a (mon.0) 1769 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:51:51.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:50.930437+0000 mon.a (mon.0) 1770 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:51:51.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:49.197269+0000 mgr.y (mgr.14514) 733 : cluster [DBG] pgmap v955: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.8 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 182 op/s; 1194/188748 objects degraded (0.633%); 6566/188748 objects misplaced (3.479%); 2.6 MiB/s, 41 objects/s recovering 2024-02-19T21:51:51.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:50.045170+0000 mon.a (mon.0) 1764 : cluster [DBG] osdmap e455: 8 total, 8 up, 7 in 2024-02-19T21:51:51.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:50.196421+0000 mon.a (mon.0) 1765 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:51:51.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:50.299422+0000 mon.a (mon.0) 1766 : cluster [WRN] Health check update: Degraded data redundancy: 1194/188748 objects degraded (0.633%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:51.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:50.306086+0000 mon.a (mon.0) 1767 : cluster [DBG] osdmap e456: 8 total, 8 up, 7 in 2024-02-19T21:51:51.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:50.925186+0000 mon.a (mon.0) 1768 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:51:51.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:50.925863+0000 mon.a (mon.0) 1769 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:51:51.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:50.930437+0000 mon.a (mon.0) 1770 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:51:51.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:49.197269+0000 mgr.y (mgr.14514) 733 : cluster [DBG] pgmap v955: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.8 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 182 op/s; 1194/188748 objects degraded (0.633%); 6566/188748 objects misplaced (3.479%); 2.6 MiB/s, 41 objects/s recovering 2024-02-19T21:51:51.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:50.045170+0000 mon.a (mon.0) 1764 : cluster [DBG] osdmap e455: 8 total, 8 up, 7 in 2024-02-19T21:51:51.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:50.196421+0000 mon.a (mon.0) 1765 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:51:51.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:50.299422+0000 mon.a (mon.0) 1766 : cluster [WRN] Health check update: Degraded data redundancy: 1194/188748 objects degraded (0.633%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:51.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:50.306086+0000 mon.a (mon.0) 1767 : cluster [DBG] osdmap e456: 8 total, 8 up, 7 in 2024-02-19T21:51:51.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:50.925186+0000 mon.a (mon.0) 1768 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:51:51.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:50.925863+0000 mon.a (mon.0) 1769 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:51:51.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:50.930437+0000 mon.a (mon.0) 1770 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:51:51.880 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:51:51.883 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:51.884 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:51:51.897 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":956,"stamp":"2024-02-19T21:51:50.043214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4100921020,"num_objects":62768,"num_object_clones":0,"num_object_copies":188304,"num_objects_missing_on_primary":370,"num_objects_missing":370,"num_objects_degraded":1194,"num_objects_misplaced":6566,"num_objects_unfound":0,"num_objects_dirty":62768,"num_whiteouts":0,"num_read":2266,"num_read_kb":2018,"num_write":87632,"num_write_kb":4783849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10837,"num_bytes_recovered":680139656,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81865,"ondisk_log_size":81865,"up":414,"acting":411,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":417,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":656216064,"kb_used":16780600,"kb_used_data":12290368,"kb_used_omap":0,"kb_used_meta":4490175,"kb_avail":639435464,"statfs":{"total":671965249536,"available":654781915136,"internally_reserved":0,"allocated":12585336832,"data_stored":12576128871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":4597939252},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,2],"upper_bound":4096},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-34865152,"num_objects":-532,"num_object_clones":0,"num_object_copies":-1596,"num_objects_missing_on_primary":-57,"num_objects_missing":-57,"num_objects_degraded":-115,"num_objects_misplaced":-115,"num_objects_unfound":0,"num_objects_dirty":-532,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":532,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":7536640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.847206"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":50,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.023876+0000","last_change":"2024-02-19T21:49:54.492937+0000","last_active":"2024-02-19T21:51:47.023876+0000","last_peered":"2024-02-19T21:51:47.023876+0000","last_clean":"2024-02-19T21:51:47.023876+0000","last_became_active":"2024-02-19T21:49:54.492544+0000","last_became_peered":"2024-02-19T21:49:54.492544+0000","last_unstale":"2024-02-19T21:51:47.023876+0000","last_undegraded":"2024-02-19T21:51:47.023876+0000","last_fullsized":"2024-02-19T21:51:47.023876+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.643236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.643236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":429,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.032203+0000","last_change":"2024-02-19T21:45:17.201007+0000","last_active":"2024-02-19T21:51:47.032203+0000","last_peered":"2024-02-19T21:51:47.032203+0000","last_clean":"2024-02-19T21:51:47.032203+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:51:47.032203+0000","last_undegraded":"2024-02-19T21:51:47.032203+0000","last_fullsized":"2024-02-19T21:51:47.032203+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:17.200897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:17.200897+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"201'27","reported_seq":97,"reported_epoch":452,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.309455+0000","last_change":"2024-02-19T21:49:08.327817+0000","last_active":"2024-02-19T21:51:45.309455+0000","last_peered":"2024-02-19T21:51:45.309455+0000","last_clean":"2024-02-19T21:51:45.309455+0000","last_became_active":"2024-02-19T21:49:08.327416+0000","last_became_peered":"2024-02-19T21:49:08.327416+0000","last_unstale":"2024-02-19T21:51:45.309455+0000","last_undegraded":"2024-02-19T21:51:45.309455+0000","last_fullsized":"2024-02-19T21:51:45.309455+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'27","last_scrub_stamp":"2024-02-19T21:44:48.022013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:48.022013+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":399,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.316878+0000","last_change":"2024-02-19T21:48:30.516215+0000","last_active":"2024-02-19T21:51:40.316878+0000","last_peered":"2024-02-19T21:51:40.316878+0000","last_clean":"2024-02-19T21:51:40.316878+0000","last_became_active":"2024-02-19T21:47:46.250178+0000","last_became_peered":"2024-02-19T21:47:46.250178+0000","last_unstale":"2024-02-19T21:51:40.316878+0000","last_undegraded":"2024-02-19T21:51:40.316878+0000","last_fullsized":"2024-02-19T21:51:40.316878+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.516139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.516139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":125,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.031020+0000","last_change":"2024-02-19T21:49:08.330105+0000","last_active":"2024-02-19T21:51:47.031020+0000","last_peered":"2024-02-19T21:51:47.031020+0000","last_clean":"2024-02-19T21:51:47.031020+0000","last_became_active":"2024-02-19T21:49:08.328994+0000","last_became_peered":"2024-02-19T21:49:08.328994+0000","last_unstale":"2024-02-19T21:51:47.031020+0000","last_undegraded":"2024-02-19T21:51:47.031020+0000","last_fullsized":"2024-02-19T21:51:47.031020+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.636083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.636083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"200'19","reported_seq":495,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.315434+0000","last_change":"2024-02-19T21:48:26.530234+0000","last_active":"2024-02-19T21:51:40.315434+0000","last_peered":"2024-02-19T21:51:40.315434+0000","last_clean":"2024-02-19T21:51:40.315434+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:51:40.315434+0000","last_undegraded":"2024-02-19T21:51:40.315434+0000","last_fullsized":"2024-02-19T21:51:40.315434+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:48:26.530160+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.530160+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":184,"reported_epoch":451,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.046317+0000","last_change":"2024-02-19T21:49:08.332091+0000","last_active":"2024-02-19T21:51:45.046317+0000","last_peered":"2024-02-19T21:51:45.046317+0000","last_clean":"2024-02-19T21:51:45.046317+0000","last_became_active":"2024-02-19T21:49:08.331753+0000","last_became_peered":"2024-02-19T21:49:08.331753+0000","last_unstale":"2024-02-19T21:51:45.046317+0000","last_undegraded":"2024-02-19T21:51:45.046317+0000","last_fullsized":"2024-02-19T21:51:45.046317+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.005236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.005236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":442,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.025199+0000","last_change":"2024-02-19T21:48:28.327028+0000","last_active":"2024-02-19T21:51:47.025199+0000","last_peered":"2024-02-19T21:51:47.025199+0000","last_clean":"2024-02-19T21:51:47.025199+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:51:47.025199+0000","last_undegraded":"2024-02-19T21:51:47.025199+0000","last_fullsized":"2024-02-19T21:51:47.025199+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.326938+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"310'9","reported_seq":409,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.315869+0000","last_change":"2024-02-19T21:51:37.044915+0000","last_active":"2024-02-19T21:51:40.315869+0000","last_peered":"2024-02-19T21:51:40.315869+0000","last_clean":"2024-02-19T21:51:40.315869+0000","last_became_active":"2024-02-19T21:49:08.329314+0000","last_became_peered":"2024-02-19T21:49:08.329314+0000","last_unstale":"2024-02-19T21:51:40.315869+0000","last_undegraded":"2024-02-19T21:51:40.315869+0000","last_fullsized":"2024-02-19T21:51:40.315869+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"310'9","last_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_deep_scrub":"310'9","last_deep_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.506188+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":363,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.030110+0000","last_change":"2024-02-19T21:46:31.205220+0000","last_active":"2024-02-19T21:51:47.030110+0000","last_peered":"2024-02-19T21:51:47.030110+0000","last_clean":"2024-02-19T21:51:47.030110+0000","last_became_active":"2024-02-19T21:46:31.204816+0000","last_became_peered":"2024-02-19T21:46:31.204816+0000","last_unstale":"2024-02-19T21:51:47.030110+0000","last_undegraded":"2024-02-19T21:51:47.030110+0000","last_fullsized":"2024-02-19T21:51:47.030110+0000","mapping_epoch":330,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":331,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:36.890201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.890201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":464,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.024763+0000","last_change":"2024-02-19T21:49:08.330669+0000","last_active":"2024-02-19T21:51:47.024763+0000","last_peered":"2024-02-19T21:51:47.024763+0000","last_clean":"2024-02-19T21:51:47.024763+0000","last_became_active":"2024-02-19T21:49:08.329998+0000","last_became_peered":"2024-02-19T21:49:08.329998+0000","last_unstale":"2024-02-19T21:51:47.024763+0000","last_undegraded":"2024-02-19T21:51:47.024763+0000","last_fullsized":"2024-02-19T21:51:47.024763+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:58.329316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:58.329316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"200'19","reported_seq":305,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.317017+0000","last_change":"2024-02-19T21:49:08.326162+0000","last_active":"2024-02-19T21:51:40.317017+0000","last_peered":"2024-02-19T21:51:40.317017+0000","last_clean":"2024-02-19T21:51:40.317017+0000","last_became_active":"2024-02-19T21:49:08.325802+0000","last_became_peered":"2024-02-19T21:49:08.325802+0000","last_unstale":"2024-02-19T21:51:40.317017+0000","last_undegraded":"2024-02-19T21:51:40.317017+0000","last_fullsized":"2024-02-19T21:51:40.317017+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:46:54.873416+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:46:54.873416+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2],"acting":[4,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":371,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.310175+0000","last_change":"2024-02-19T21:49:04.432817+0000","last_active":"2024-02-19T21:51:40.310175+0000","last_peered":"2024-02-19T21:51:40.310175+0000","last_clean":"2024-02-19T21:51:40.310175+0000","last_became_active":"2024-02-19T21:47:33.393708+0000","last_became_peered":"2024-02-19T21:47:33.393708+0000","last_unstale":"2024-02-19T21:51:40.310175+0000","last_undegraded":"2024-02-19T21:51:40.310175+0000","last_fullsized":"2024-02-19T21:51:40.310175+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:04.432733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:04.432733+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":50,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.023920+0000","last_change":"2024-02-19T21:49:54.492767+0000","last_active":"2024-02-19T21:51:47.023920+0000","last_peered":"2024-02-19T21:51:47.023920+0000","last_clean":"2024-02-19T21:51:47.023920+0000","last_became_active":"2024-02-19T21:49:54.491745+0000","last_became_peered":"2024-02-19T21:49:54.491745+0000","last_unstale":"2024-02-19T21:51:47.023920+0000","last_undegraded":"2024-02-19T21:51:47.023920+0000","last_fullsized":"2024-02-19T21:51:47.023920+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.232539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.232539+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1d","version":"201'18","reported_seq":389,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.305851+0000","last_change":"2024-02-19T21:48:25.734661+0000","last_active":"2024-02-19T21:51:40.305851+0000","last_peered":"2024-02-19T21:51:40.305851+0000","last_clean":"2024-02-19T21:51:40.305851+0000","last_became_active":"2024-02-19T21:38:31.247067+0000","last_became_peered":"2024-02-19T21:38:31.247067+0000","last_unstale":"2024-02-19T21:51:40.305851+0000","last_undegraded":"2024-02-19T21:51:40.305851+0000","last_fullsized":"2024-02-19T21:51:40.305851+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'18","last_scrub_stamp":"2024-02-19T21:48:25.734591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.734591+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":426,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.316406+0000","last_change":"2024-02-19T21:48:40.528082+0000","last_active":"2024-02-19T21:51:40.316406+0000","last_peered":"2024-02-19T21:51:40.316406+0000","last_clean":"2024-02-19T21:51:40.316406+0000","last_became_active":"2024-02-19T21:44:58.788307+0000","last_became_peered":"2024-02-19T21:44:58.788307+0000","last_unstale":"2024-02-19T21:51:40.316406+0000","last_undegraded":"2024-02-19T21:51:40.316406+0000","last_fullsized":"2024-02-19T21:51:40.316406+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:40.527970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:48:40.527970+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":434,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.302755+0000","last_change":"2024-02-19T21:48:11.557832+0000","last_active":"2024-02-19T21:51:40.302755+0000","last_peered":"2024-02-19T21:51:40.302755+0000","last_clean":"2024-02-19T21:51:40.302755+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:51:40.302755+0000","last_undegraded":"2024-02-19T21:51:40.302755+0000","last_fullsized":"2024-02-19T21:51:40.302755+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.557736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:17.913620+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.557736+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"200'34","reported_seq":98,"reported_epoch":452,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.310156+0000","last_change":"2024-02-19T21:49:08.332575+0000","last_active":"2024-02-19T21:51:45.310156+0000","last_peered":"2024-02-19T21:51:45.310156+0000","last_clean":"2024-02-19T21:51:45.310156+0000","last_became_active":"2024-02-19T21:49:08.331742+0000","last_became_peered":"2024-02-19T21:49:08.331742+0000","last_unstale":"2024-02-19T21:51:45.310156+0000","last_undegraded":"2024-02-19T21:51:45.310156+0000","last_fullsized":"2024-02-19T21:51:45.310156+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'34","last_scrub_stamp":"2024-02-19T21:45:49.728734+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:45:49.728734+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":446,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.305381+0000","last_change":"2024-02-19T21:46:44.994389+0000","last_active":"2024-02-19T21:51:40.305381+0000","last_peered":"2024-02-19T21:51:40.305381+0000","last_clean":"2024-02-19T21:51:40.305381+0000","last_became_active":"2024-02-19T21:44:58.790669+0000","last_became_peered":"2024-02-19T21:44:58.790669+0000","last_unstale":"2024-02-19T21:51:40.305381+0000","last_undegraded":"2024-02-19T21:51:40.305381+0000","last_fullsized":"2024-02-19T21:51:40.305381+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.994296+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":382,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.303519+0000","last_change":"2024-02-19T21:49:08.330330+0000","last_active":"2024-02-19T21:51:40.303519+0000","last_peered":"2024-02-19T21:51:40.303519+0000","last_clean":"2024-02-19T21:51:40.303519+0000","last_became_active":"2024-02-19T21:49:08.329986+0000","last_became_peered":"2024-02-19T21:49:08.329986+0000","last_unstale":"2024-02-19T21:51:40.303519+0000","last_undegraded":"2024-02-19T21:51:40.303519+0000","last_fullsized":"2024-02-19T21:51:40.303519+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.091409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.091409+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"201'19","reported_seq":333,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.030791+0000","last_change":"2024-02-19T21:48:26.366639+0000","last_active":"2024-02-19T21:51:47.030791+0000","last_peered":"2024-02-19T21:51:47.030791+0000","last_clean":"2024-02-19T21:51:47.030791+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:51:47.030791+0000","last_undegraded":"2024-02-19T21:51:47.030791+0000","last_fullsized":"2024-02-19T21:51:47.030791+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:26.366563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.366563+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":310,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.023777+0000","last_change":"2024-02-19T21:51:22.461995+0000","last_active":"2024-02-19T21:51:47.023777+0000","last_peered":"2024-02-19T21:51:47.023777+0000","last_clean":"2024-02-19T21:51:47.023777+0000","last_became_active":"2024-02-19T21:51:22.461599+0000","last_became_peered":"2024-02-19T21:51:22.461599+0000","last_unstale":"2024-02-19T21:51:47.023777+0000","last_undegraded":"2024-02-19T21:51:47.023777+0000","last_fullsized":"2024-02-19T21:51:47.023777+0000","mapping_epoch":445,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":446,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:13.196112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:13.196112+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":447,"reported_epoch":451,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.044960+0000","last_change":"2024-02-19T21:49:54.491840+0000","last_active":"2024-02-19T21:51:45.044960+0000","last_peered":"2024-02-19T21:51:45.044960+0000","last_clean":"2024-02-19T21:51:45.044960+0000","last_became_active":"2024-02-19T21:49:54.491488+0000","last_became_peered":"2024-02-19T21:49:54.491488+0000","last_unstale":"2024-02-19T21:51:45.044960+0000","last_undegraded":"2024-02-19T21:51:45.044960+0000","last_fullsized":"2024-02-19T21:51:45.044960+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.803606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.803606+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"201'20","reported_seq":534,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.031162+0000","last_change":"2024-02-19T21:49:54.502402+0000","last_active":"2024-02-19T21:51:47.031162+0000","last_peered":"2024-02-19T21:51:47.031162+0000","last_clean":"2024-02-19T21:51:47.031162+0000","last_became_active":"2024-02-19T21:49:54.483748+0000","last_became_peered":"2024-02-19T21:49:54.483748+0000","last_unstale":"2024-02-19T21:51:47.031162+0000","last_undegraded":"2024-02-19T21:51:47.031162+0000","last_fullsized":"2024-02-19T21:51:47.031162+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:48:25.348437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.348437+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":369,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.030145+0000","last_change":"2024-02-19T21:49:08.328206+0000","last_active":"2024-02-19T21:51:47.030145+0000","last_peered":"2024-02-19T21:51:47.030145+0000","last_clean":"2024-02-19T21:51:47.030145+0000","last_became_active":"2024-02-19T21:49:08.327865+0000","last_became_peered":"2024-02-19T21:49:08.327865+0000","last_unstale":"2024-02-19T21:51:47.030145+0000","last_undegraded":"2024-02-19T21:51:47.030145+0000","last_fullsized":"2024-02-19T21:51:47.030145+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.230652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.230652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":429,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.023959+0000","last_change":"2024-02-19T21:48:22.171667+0000","last_active":"2024-02-19T21:51:47.023959+0000","last_peered":"2024-02-19T21:51:47.023959+0000","last_clean":"2024-02-19T21:51:47.023959+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:51:47.023959+0000","last_undegraded":"2024-02-19T21:51:47.023959+0000","last_fullsized":"2024-02-19T21:51:47.023959+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.171600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.171600+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":462,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.310219+0000","last_change":"2024-02-19T21:49:08.330636+0000","last_active":"2024-02-19T21:51:40.310219+0000","last_peered":"2024-02-19T21:51:40.310219+0000","last_clean":"2024-02-19T21:51:40.310219+0000","last_became_active":"2024-02-19T21:49:08.330293+0000","last_became_peered":"2024-02-19T21:49:08.330293+0000","last_unstale":"2024-02-19T21:51:40.310219+0000","last_undegraded":"2024-02-19T21:51:40.310219+0000","last_fullsized":"2024-02-19T21:51:40.310219+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:03.034839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:03.034839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"381'24","reported_seq":62,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.024366+0000","last_change":"2024-02-19T21:49:55.368481+0000","last_active":"2024-02-19T21:51:47.024366+0000","last_peered":"2024-02-19T21:51:47.024366+0000","last_clean":"2024-02-19T21:51:47.024366+0000","last_became_active":"2024-02-19T21:49:54.485438+0000","last_became_peered":"2024-02-19T21:49:54.485438+0000","last_unstale":"2024-02-19T21:51:47.024366+0000","last_undegraded":"2024-02-19T21:51:47.024366+0000","last_fullsized":"2024-02-19T21:51:47.024366+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"381'24","last_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_deep_scrub":"381'24","last_deep_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_clean_scrub_stamp":"2024-02-19T21:48:39.382725+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,5],"acting":[7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":457,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.024092+0000","last_change":"2024-02-19T21:49:17.193002+0000","last_active":"2024-02-19T21:51:47.024092+0000","last_peered":"2024-02-19T21:51:47.024092+0000","last_clean":"2024-02-19T21:51:47.024092+0000","last_became_active":"2024-02-19T21:49:08.333537+0000","last_became_peered":"2024-02-19T21:49:08.333537+0000","last_unstale":"2024-02-19T21:51:47.024092+0000","last_undegraded":"2024-02-19T21:51:47.024092+0000","last_fullsized":"2024-02-19T21:51:47.024092+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:59.339649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:45:59.339649+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":482,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.303597+0000","last_change":"2024-02-19T21:49:54.494561+0000","last_active":"2024-02-19T21:51:40.303597+0000","last_peered":"2024-02-19T21:51:40.303597+0000","last_clean":"2024-02-19T21:51:40.303597+0000","last_became_active":"2024-02-19T21:49:54.494146+0000","last_became_peered":"2024-02-19T21:49:54.494146+0000","last_unstale":"2024-02-19T21:51:40.303597+0000","last_undegraded":"2024-02-19T21:51:40.303597+0000","last_fullsized":"2024-02-19T21:51:40.303597+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.560066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":457,"reported_epoch":451,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.046185+0000","last_change":"2024-02-19T21:49:09.765641+0000","last_active":"2024-02-19T21:51:45.046185+0000","last_peered":"2024-02-19T21:51:45.046185+0000","last_clean":"2024-02-19T21:51:45.046185+0000","last_became_active":"2024-02-19T21:49:08.331308+0000","last_became_peered":"2024-02-19T21:49:08.331308+0000","last_unstale":"2024-02-19T21:51:45.046185+0000","last_undegraded":"2024-02-19T21:51:45.046185+0000","last_fullsized":"2024-02-19T21:51:45.046185+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.765568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.765568+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"200'8","reported_seq":143,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.308728+0000","last_change":"2024-02-19T21:47:33.577363+0000","last_active":"2024-02-19T21:51:40.308728+0000","last_peered":"2024-02-19T21:51:40.308728+0000","last_clean":"2024-02-19T21:51:40.308728+0000","last_became_active":"2024-02-19T21:47:33.395217+0000","last_became_peered":"2024-02-19T21:47:33.395217+0000","last_unstale":"2024-02-19T21:51:40.308728+0000","last_undegraded":"2024-02-19T21:51:40.308728+0000","last_fullsized":"2024-02-19T21:51:40.308728+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'8","last_scrub_stamp":"2024-02-19T21:46:47.761677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.761677+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":369,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.030211+0000","last_change":"2024-02-19T21:49:08.918163+0000","last_active":"2024-02-19T21:51:47.030211+0000","last_peered":"2024-02-19T21:51:47.030211+0000","last_clean":"2024-02-19T21:51:47.030211+0000","last_became_active":"2024-02-19T21:49:08.328416+0000","last_became_peered":"2024-02-19T21:49:08.328416+0000","last_unstale":"2024-02-19T21:51:47.030211+0000","last_undegraded":"2024-02-19T21:51:47.030211+0000","last_fullsized":"2024-02-19T21:51:47.030211+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.918083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.918083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":444,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.306749+0000","last_change":"2024-02-19T21:49:54.480716+0000","last_active":"2024-02-19T21:51:40.306749+0000","last_peered":"2024-02-19T21:51:40.306749+0000","last_clean":"2024-02-19T21:51:40.306749+0000","last_became_active":"2024-02-19T21:49:54.480368+0000","last_became_peered":"2024-02-19T21:49:54.480368+0000","last_unstale":"2024-02-19T21:51:40.306749+0000","last_undegraded":"2024-02-19T21:51:40.306749+0000","last_fullsized":"2024-02-19T21:51:40.306749+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:19.596775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:19.596775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":428,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.305566+0000","last_change":"2024-02-19T21:49:05.012463+0000","last_active":"2024-02-19T21:51:40.305566+0000","last_peered":"2024-02-19T21:51:40.305566+0000","last_clean":"2024-02-19T21:51:40.305566+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:51:40.305566+0000","last_undegraded":"2024-02-19T21:51:40.305566+0000","last_fullsized":"2024-02-19T21:51:40.305566+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.012395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.012395+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"201'19","reported_seq":475,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.315995+0000","last_change":"2024-02-19T21:48:38.529106+0000","last_active":"2024-02-19T21:51:40.315995+0000","last_peered":"2024-02-19T21:51:40.315995+0000","last_clean":"2024-02-19T21:51:40.315995+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:51:40.315995+0000","last_undegraded":"2024-02-19T21:51:40.315995+0000","last_fullsized":"2024-02-19T21:51:40.315995+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:38.528977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.528977+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":434,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.029801+0000","last_change":"2024-02-19T21:46:06.096531+0000","last_active":"2024-02-19T21:51:47.029801+0000","last_peered":"2024-02-19T21:51:47.029801+0000","last_clean":"2024-02-19T21:51:47.029801+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:51:47.029801+0000","last_undegraded":"2024-02-19T21:51:47.029801+0000","last_fullsized":"2024-02-19T21:51:47.029801+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.096422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":242,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.302693+0000","last_change":"2024-02-19T21:48:38.391532+0000","last_active":"2024-02-19T21:51:40.302693+0000","last_peered":"2024-02-19T21:51:40.302693+0000","last_clean":"2024-02-19T21:51:40.302693+0000","last_became_active":"2024-02-19T21:47:33.395085+0000","last_became_peered":"2024-02-19T21:47:33.395085+0000","last_unstale":"2024-02-19T21:51:40.302693+0000","last_undegraded":"2024-02-19T21:51:40.302693+0000","last_fullsized":"2024-02-19T21:51:40.302693+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:38.391435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.391435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":443,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.309434+0000","last_change":"2024-02-19T21:48:14.600378+0000","last_active":"2024-02-19T21:51:40.309434+0000","last_peered":"2024-02-19T21:51:40.309434+0000","last_clean":"2024-02-19T21:51:40.309434+0000","last_became_active":"2024-02-19T21:47:33.393932+0000","last_became_peered":"2024-02-19T21:47:33.393932+0000","last_unstale":"2024-02-19T21:51:40.309434+0000","last_undegraded":"2024-02-19T21:51:40.309434+0000","last_fullsized":"2024-02-19T21:51:40.309434+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:14.600285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.600285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"200'15","reported_seq":497,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.306595+0000","last_change":"2024-02-19T21:49:08.334199+0000","last_active":"2024-02-19T21:51:40.306595+0000","last_peered":"2024-02-19T21:51:40.306595+0000","last_clean":"2024-02-19T21:51:40.306595+0000","last_became_active":"2024-02-19T21:49:08.333872+0000","last_became_peered":"2024-02-19T21:49:08.333872+0000","last_unstale":"2024-02-19T21:51:40.306595+0000","last_undegraded":"2024-02-19T21:51:40.306595+0000","last_fullsized":"2024-02-19T21:51:40.306595+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:45:08.678669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:08.678669+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":409,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.316764+0000","last_change":"2024-02-19T21:49:08.330114+0000","last_active":"2024-02-19T21:51:40.316764+0000","last_peered":"2024-02-19T21:51:40.316764+0000","last_clean":"2024-02-19T21:51:40.316764+0000","last_became_active":"2024-02-19T21:49:08.329770+0000","last_became_peered":"2024-02-19T21:49:08.329770+0000","last_unstale":"2024-02-19T21:51:40.316764+0000","last_undegraded":"2024-02-19T21:51:40.316764+0000","last_fullsized":"2024-02-19T21:51:40.316764+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:08.983923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.983923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"415'17","reported_seq":77,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.093457+0000","last_change":"2024-02-19T21:50:49.705247+0000","last_active":"2024-02-19T21:51:47.093457+0000","last_peered":"2024-02-19T21:51:47.093457+0000","last_clean":"2024-02-19T21:51:47.093457+0000","last_became_active":"2024-02-19T21:49:54.486304+0000","last_became_peered":"2024-02-19T21:49:54.486304+0000","last_unstale":"2024-02-19T21:51:47.093457+0000","last_undegraded":"2024-02-19T21:51:47.093457+0000","last_fullsized":"2024-02-19T21:51:47.093457+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"199'13","last_scrub_stamp":"2024-02-19T21:45:05.721709+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:45:05.721709+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":456,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.030371+0000","last_change":"2024-02-19T21:49:54.484516+0000","last_active":"2024-02-19T21:51:47.030371+0000","last_peered":"2024-02-19T21:51:47.030371+0000","last_clean":"2024-02-19T21:51:47.030371+0000","last_became_active":"2024-02-19T21:49:54.483689+0000","last_became_peered":"2024-02-19T21:49:54.483689+0000","last_unstale":"2024-02-19T21:51:47.030371+0000","last_undegraded":"2024-02-19T21:51:47.030371+0000","last_fullsized":"2024-02-19T21:51:47.030371+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.157478+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"201'19","reported_seq":475,"reported_epoch":451,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.045557+0000","last_change":"2024-02-19T21:48:27.720048+0000","last_active":"2024-02-19T21:51:45.045557+0000","last_peered":"2024-02-19T21:51:45.045557+0000","last_clean":"2024-02-19T21:51:45.045557+0000","last_became_active":"2024-02-19T21:47:33.398295+0000","last_became_peered":"2024-02-19T21:47:33.398295+0000","last_unstale":"2024-02-19T21:51:45.045557+0000","last_undegraded":"2024-02-19T21:51:45.045557+0000","last_fullsized":"2024-02-19T21:51:45.045557+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:27.719954+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:48:27.719954+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":173,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.030776+0000","last_change":"2024-02-19T21:49:54.484392+0000","last_active":"2024-02-19T21:51:47.030776+0000","last_peered":"2024-02-19T21:51:47.030776+0000","last_clean":"2024-02-19T21:51:47.030776+0000","last_became_active":"2024-02-19T21:49:54.484049+0000","last_became_peered":"2024-02-19T21:49:54.484049+0000","last_unstale":"2024-02-19T21:51:47.030776+0000","last_undegraded":"2024-02-19T21:51:47.030776+0000","last_fullsized":"2024-02-19T21:51:47.030776+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.121769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.121769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":666,"reported_epoch":451,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.045687+0000","last_change":"2024-02-19T21:48:38.723220+0000","last_active":"2024-02-19T21:51:45.045687+0000","last_peered":"2024-02-19T21:51:45.045687+0000","last_clean":"2024-02-19T21:51:45.045687+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:51:45.045687+0000","last_undegraded":"2024-02-19T21:51:45.045687+0000","last_fullsized":"2024-02-19T21:51:45.045687+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:48:38.723151+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.723151+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":458,"reported_epoch":451,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.046920+0000","last_change":"2024-02-19T21:49:54.485462+0000","last_active":"2024-02-19T21:51:45.046920+0000","last_peered":"2024-02-19T21:51:45.046920+0000","last_clean":"2024-02-19T21:51:45.046920+0000","last_became_active":"2024-02-19T21:49:54.485121+0000","last_became_peered":"2024-02-19T21:49:54.485121+0000","last_unstale":"2024-02-19T21:51:45.046920+0000","last_undegraded":"2024-02-19T21:51:45.046920+0000","last_fullsized":"2024-02-19T21:51:45.046920+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:07.724097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:49:07.724097+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"201'25","reported_seq":335,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.307192+0000","last_change":"2024-02-19T21:49:08.335077+0000","last_active":"2024-02-19T21:51:40.307192+0000","last_peered":"2024-02-19T21:51:40.307192+0000","last_clean":"2024-02-19T21:51:40.307192+0000","last_became_active":"2024-02-19T21:49:08.334061+0000","last_became_peered":"2024-02-19T21:49:08.334061+0000","last_unstale":"2024-02-19T21:51:40.307192+0000","last_undegraded":"2024-02-19T21:51:40.307192+0000","last_fullsized":"2024-02-19T21:51:40.307192+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'25","last_scrub_stamp":"2024-02-19T21:46:07.553690+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.553690+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":429,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.025318+0000","last_change":"2024-02-19T21:48:21.256471+0000","last_active":"2024-02-19T21:51:47.025318+0000","last_peered":"2024-02-19T21:51:47.025318+0000","last_clean":"2024-02-19T21:51:47.025318+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:51:47.025318+0000","last_undegraded":"2024-02-19T21:51:47.025318+0000","last_fullsized":"2024-02-19T21:51:47.025318+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.256358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.256358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":433,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.303676+0000","last_change":"2024-02-19T21:46:35.035136+0000","last_active":"2024-02-19T21:51:40.303676+0000","last_peered":"2024-02-19T21:51:40.303676+0000","last_clean":"2024-02-19T21:51:40.303676+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:51:40.303676+0000","last_undegraded":"2024-02-19T21:51:40.303676+0000","last_fullsized":"2024-02-19T21:51:40.303676+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:35.035042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:35.035042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"201'12","reported_seq":58,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.024560+0000","last_change":"2024-02-19T21:50:49.700758+0000","last_active":"2024-02-19T21:51:47.024560+0000","last_peered":"2024-02-19T21:51:47.024560+0000","last_clean":"2024-02-19T21:51:47.024560+0000","last_became_active":"2024-02-19T21:49:54.478094+0000","last_became_peered":"2024-02-19T21:49:54.478094+0000","last_unstale":"2024-02-19T21:51:47.024560+0000","last_undegraded":"2024-02-19T21:51:47.024560+0000","last_fullsized":"2024-02-19T21:51:47.024560+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'12","last_scrub_stamp":"2024-02-19T21:49:08.912638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.912638+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":81,"reported_epoch":452,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.310194+0000","last_change":"2024-02-19T21:49:08.332757+0000","last_active":"2024-02-19T21:51:45.310194+0000","last_peered":"2024-02-19T21:51:45.310194+0000","last_clean":"2024-02-19T21:51:45.310194+0000","last_became_active":"2024-02-19T21:49:08.332176+0000","last_became_peered":"2024-02-19T21:49:08.332176+0000","last_unstale":"2024-02-19T21:51:45.310194+0000","last_undegraded":"2024-02-19T21:51:45.310194+0000","last_fullsized":"2024-02-19T21:51:45.310194+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:47:01.365477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:47:01.365477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":81,"reported_epoch":452,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.309320+0000","last_change":"2024-02-19T21:49:08.328632+0000","last_active":"2024-02-19T21:51:45.309320+0000","last_peered":"2024-02-19T21:51:45.309320+0000","last_clean":"2024-02-19T21:51:45.309320+0000","last_became_active":"2024-02-19T21:49:08.327826+0000","last_became_peered":"2024-02-19T21:49:08.327826+0000","last_unstale":"2024-02-19T21:51:45.309320+0000","last_undegraded":"2024-02-19T21:51:45.309320+0000","last_fullsized":"2024-02-19T21:51:45.309320+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:09.645607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:44:09.645607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"200'15","reported_seq":562,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.030942+0000","last_change":"2024-02-19T21:50:49.704824+0000","last_active":"2024-02-19T21:51:47.030942+0000","last_peered":"2024-02-19T21:51:47.030942+0000","last_clean":"2024-02-19T21:51:47.030942+0000","last_became_active":"2024-02-19T21:49:54.483578+0000","last_became_peered":"2024-02-19T21:49:54.483578+0000","last_unstale":"2024-02-19T21:51:47.030942+0000","last_undegraded":"2024-02-19T21:51:47.030942+0000","last_fullsized":"2024-02-19T21:51:47.030942+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:44:53.072746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:53.072746+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"450'5487","reported_seq":6821,"reported_epoch":451,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:51:45.074545+0000","last_change":"2024-02-19T21:50:38.722849+0000","last_active":"2024-02-19T21:51:45.074545+0000","last_peered":"2024-02-19T21:51:45.074545+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:09.770699+0000","last_became_peered":"2024-02-19T21:49:09.770699+0000","last_unstale":"2024-02-19T21:51:45.074545+0000","last_undegraded":"2024-02-19T21:49:09.328794+0000","last_fullsized":"2024-02-19T21:49:09.325036+0000","mapping_epoch":395,"log_start":"392'600","ondisk_log_start":"392'600","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4887,"ondisk_log_size":4887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":261160960,"num_objects":3985,"num_object_clones":0,"num_object_copies":11955,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":481,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3985,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5487,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":627,"num_bytes_recovered":41091072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5],"avail_no_missing":["6","5"],"object_location_counts":[{"shards":"5,6","objects":3504}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":50,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.023812+0000","last_change":"2024-02-19T21:49:54.492844+0000","last_active":"2024-02-19T21:51:47.023812+0000","last_peered":"2024-02-19T21:51:47.023812+0000","last_clean":"2024-02-19T21:51:47.023812+0000","last_became_active":"2024-02-19T21:49:54.492156+0000","last_became_peered":"2024-02-19T21:49:54.492156+0000","last_unstale":"2024-02-19T21:51:47.023812+0000","last_undegraded":"2024-02-19T21:51:47.023812+0000","last_fullsized":"2024-02-19T21:51:47.023812+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:04.692807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.692807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"378'4","reported_seq":465,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.316906+0000","last_change":"2024-02-19T21:48:28.510929+0000","last_active":"2024-02-19T21:51:40.316906+0000","last_peered":"2024-02-19T21:51:40.316906+0000","last_clean":"2024-02-19T21:51:40.316906+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:51:40.316906+0000","last_undegraded":"2024-02-19T21:51:40.316906+0000","last_fullsized":"2024-02-19T21:51:40.316906+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"378'4","last_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_deep_scrub":"378'4","last_deep_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.510849+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"200'23","reported_seq":312,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.315898+0000","last_change":"2024-02-19T21:48:22.519465+0000","last_active":"2024-02-19T21:51:40.315898+0000","last_peered":"2024-02-19T21:51:40.315898+0000","last_clean":"2024-02-19T21:51:40.315898+0000","last_became_active":"2024-02-19T21:47:46.252085+0000","last_became_peered":"2024-02-19T21:47:46.252085+0000","last_unstale":"2024-02-19T21:51:40.315898+0000","last_undegraded":"2024-02-19T21:51:40.315898+0000","last_fullsized":"2024-02-19T21:51:40.315898+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'23","last_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_deep_scrub":"200'23","last_deep_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.519381+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6],"acting":[4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":81,"reported_epoch":452,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.309344+0000","last_change":"2024-02-19T21:49:08.328855+0000","last_active":"2024-02-19T21:51:45.309344+0000","last_peered":"2024-02-19T21:51:45.309344+0000","last_clean":"2024-02-19T21:51:45.309344+0000","last_became_active":"2024-02-19T21:49:08.328237+0000","last_became_peered":"2024-02-19T21:49:08.328237+0000","last_unstale":"2024-02-19T21:51:45.309344+0000","last_undegraded":"2024-02-19T21:51:45.309344+0000","last_fullsized":"2024-02-19T21:51:45.309344+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:58.047556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:58.047556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"454'5349","reported_seq":5425,"reported_epoch":454,"state":"active+clean","last_fresh":"2024-02-19T21:51:49.623351+0000","last_change":"2024-02-19T21:48:47.778295+0000","last_active":"2024-02-19T21:51:49.623351+0000","last_peered":"2024-02-19T21:51:49.623351+0000","last_clean":"2024-02-19T21:51:49.623351+0000","last_became_active":"2024-02-19T21:48:47.777964+0000","last_became_peered":"2024-02-19T21:48:47.777964+0000","last_unstale":"2024-02-19T21:51:49.623351+0000","last_undegraded":"2024-02-19T21:51:49.623351+0000","last_fullsized":"2024-02-19T21:51:49.623351+0000","mapping_epoch":385,"log_start":"392'600","ondisk_log_start":"392'600","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4749,"ondisk_log_size":4749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":249102336,"num_objects":3801,"num_object_clones":0,"num_object_copies":11403,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3801,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5349,"num_write_kb":292800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":483,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.029857+0000","last_change":"2024-02-19T21:49:08.328019+0000","last_active":"2024-02-19T21:51:47.029857+0000","last_peered":"2024-02-19T21:51:47.029857+0000","last_clean":"2024-02-19T21:51:47.029857+0000","last_became_active":"2024-02-19T21:49:08.327581+0000","last_became_peered":"2024-02-19T21:49:08.327581+0000","last_unstale":"2024-02-19T21:51:47.029857+0000","last_undegraded":"2024-02-19T21:51:47.029857+0000","last_fullsized":"2024-02-19T21:51:47.029857+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:22.180593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:45:22.180593+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5],"acting":[0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":426,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.307082+0000","last_change":"2024-02-19T21:48:37.789514+0000","last_active":"2024-02-19T21:51:40.307082+0000","last_peered":"2024-02-19T21:51:40.307082+0000","last_clean":"2024-02-19T21:51:40.307082+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:51:40.307082+0000","last_undegraded":"2024-02-19T21:51:40.307082+0000","last_fullsized":"2024-02-19T21:51:40.307082+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:37.789400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:37.789400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"201'20","reported_seq":332,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.306677+0000","last_change":"2024-02-19T21:45:57.877936+0000","last_active":"2024-02-19T21:51:40.306677+0000","last_peered":"2024-02-19T21:51:40.306677+0000","last_clean":"2024-02-19T21:51:40.306677+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:51:40.306677+0000","last_undegraded":"2024-02-19T21:51:40.306677+0000","last_fullsized":"2024-02-19T21:51:40.306677+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:45:57.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:57.877856+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":673,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.093564+0000","last_change":"2024-02-19T21:49:01.011149+0000","last_active":"2024-02-19T21:51:47.093564+0000","last_peered":"2024-02-19T21:51:47.093564+0000","last_clean":"2024-02-19T21:51:47.093564+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:51:47.093564+0000","last_undegraded":"2024-02-19T21:51:47.093564+0000","last_fullsized":"2024-02-19T21:51:47.093564+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:49:01.011078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:49:01.011078+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.a","version":"450'5453","reported_seq":5527,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:44.945020+0000","last_change":"2024-02-19T21:48:47.778138+0000","last_active":"2024-02-19T21:51:44.945020+0000","last_peered":"2024-02-19T21:51:44.945020+0000","last_clean":"2024-02-19T21:51:44.945020+0000","last_became_active":"2024-02-19T21:48:47.777820+0000","last_became_peered":"2024-02-19T21:48:47.777820+0000","last_unstale":"2024-02-19T21:51:44.945020+0000","last_undegraded":"2024-02-19T21:51:44.945020+0000","last_fullsized":"2024-02-19T21:51:44.945020+0000","mapping_epoch":385,"log_start":"392'600","ondisk_log_start":"392'600","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4853,"ondisk_log_size":4853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":258277376,"num_objects":3941,"num_object_clones":0,"num_object_copies":11823,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3941,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5453,"num_write_kb":300608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":375,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.316587+0000","last_change":"2024-02-19T21:48:33.478821+0000","last_active":"2024-02-19T21:51:40.316587+0000","last_peered":"2024-02-19T21:51:40.316587+0000","last_clean":"2024-02-19T21:51:40.316587+0000","last_became_active":"2024-02-19T21:44:56.149476+0000","last_became_peered":"2024-02-19T21:44:56.149476+0000","last_unstale":"2024-02-19T21:51:40.316587+0000","last_undegraded":"2024-02-19T21:51:40.316587+0000","last_fullsized":"2024-02-19T21:51:40.316587+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:33.478715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:48:33.478715+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":437,"reported_epoch":451,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.047057+0000","last_change":"2024-02-19T21:46:41.834315+0000","last_active":"2024-02-19T21:51:45.047057+0000","last_peered":"2024-02-19T21:51:45.047057+0000","last_clean":"2024-02-19T21:51:45.047057+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:51:45.047057+0000","last_undegraded":"2024-02-19T21:51:45.047057+0000","last_fullsized":"2024-02-19T21:51:45.047057+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:41.834246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:46:41.834246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"397'46","reported_seq":859,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:42.092639+0000","last_change":"2024-02-19T21:49:08.335296+0000","last_active":"2024-02-19T21:51:42.092639+0000","last_peered":"2024-02-19T21:51:42.092639+0000","last_clean":"2024-02-19T21:51:42.092639+0000","last_became_active":"2024-02-19T21:49:08.334527+0000","last_became_peered":"2024-02-19T21:49:08.334527+0000","last_unstale":"2024-02-19T21:51:42.092639+0000","last_undegraded":"2024-02-19T21:51:42.092639+0000","last_fullsized":"2024-02-19T21:51:42.092639+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'43","last_scrub_stamp":"2024-02-19T21:45:04.755444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.755444+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":425,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.031411+0000","last_change":"2024-02-19T21:46:45.252437+0000","last_active":"2024-02-19T21:51:47.031411+0000","last_peered":"2024-02-19T21:51:47.031411+0000","last_clean":"2024-02-19T21:51:47.031411+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:51:47.031411+0000","last_undegraded":"2024-02-19T21:51:47.031411+0000","last_fullsized":"2024-02-19T21:51:47.031411+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.252344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.252344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"451'5405","reported_seq":7933,"reported_epoch":452,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:51:45.307118+0000","last_change":"2024-02-19T21:51:03.650022+0000","last_active":"2024-02-19T21:51:45.307118+0000","last_peered":"2024-02-19T21:51:45.307118+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:55.752599+0000","last_became_peered":"2024-02-19T21:49:55.752599+0000","last_unstale":"2024-02-19T21:51:45.307118+0000","last_undegraded":"2024-02-19T21:49:55.655049+0000","last_fullsized":"2024-02-19T21:49:55.470938+0000","mapping_epoch":414,"log_start":"392'200","ondisk_log_start":"392'200","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5205,"ondisk_log_size":5205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":252641280,"num_objects":3855,"num_object_clones":0,"num_object_copies":11565,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":343,"num_objects_misplaced":3219,"num_objects_unfound":0,"num_objects_dirty":3855,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5405,"num_write_kb":296320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":814,"num_bytes_recovered":53346304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2],"avail_no_missing":["5","4"],"object_location_counts":[{"shards":"2,4,5","objects":2876},{"shards":"2,5","objects":636},{"shards":"4,5","objects":343}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":453,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.025351+0000","last_change":"2024-02-19T21:49:09.227437+0000","last_active":"2024-02-19T21:51:47.025351+0000","last_peered":"2024-02-19T21:51:47.025351+0000","last_clean":"2024-02-19T21:51:47.025351+0000","last_became_active":"2024-02-19T21:49:08.328437+0000","last_became_peered":"2024-02-19T21:49:08.328437+0000","last_unstale":"2024-02-19T21:51:47.025351+0000","last_undegraded":"2024-02-19T21:51:47.025351+0000","last_fullsized":"2024-02-19T21:51:47.025351+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.227355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.227355+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'6","reported_seq":1646,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:44.642061+0000","last_change":"2024-02-19T21:51:42.338269+0000","last_active":"2024-02-19T21:51:44.642061+0000","last_peered":"2024-02-19T21:51:44.642061+0000","last_clean":"2024-02-19T21:51:44.642061+0000","last_became_active":"2024-02-19T21:49:08.331108+0000","last_became_peered":"2024-02-19T21:49:08.331108+0000","last_unstale":"2024-02-19T21:51:44.642061+0000","last_undegraded":"2024-02-19T21:51:44.642061+0000","last_fullsized":"2024-02-19T21:51:44.642061+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_clean_scrub_stamp":"2024-02-19T21:44:13.678341+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1141,"num_read_kb":1136,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":81,"reported_epoch":452,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.309609+0000","last_change":"2024-02-19T21:49:08.329710+0000","last_active":"2024-02-19T21:51:45.309609+0000","last_peered":"2024-02-19T21:51:45.309609+0000","last_clean":"2024-02-19T21:51:45.309609+0000","last_became_active":"2024-02-19T21:49:08.329378+0000","last_became_peered":"2024-02-19T21:49:08.329378+0000","last_unstale":"2024-02-19T21:51:45.309609+0000","last_undegraded":"2024-02-19T21:51:45.309609+0000","last_fullsized":"2024-02-19T21:51:45.309609+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:55.195394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.195394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"200'17","reported_seq":483,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.306065+0000","last_change":"2024-02-19T21:48:14.878933+0000","last_active":"2024-02-19T21:51:40.306065+0000","last_peered":"2024-02-19T21:51:40.306065+0000","last_clean":"2024-02-19T21:51:40.306065+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:51:40.306065+0000","last_undegraded":"2024-02-19T21:51:40.306065+0000","last_fullsized":"2024-02-19T21:51:40.306065+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'17","last_scrub_stamp":"2024-02-19T21:48:14.878857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.878857+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":25,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":81,"reported_epoch":452,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.310437+0000","last_change":"2024-02-19T21:49:08.325478+0000","last_active":"2024-02-19T21:51:45.310437+0000","last_peered":"2024-02-19T21:51:45.310437+0000","last_clean":"2024-02-19T21:51:45.310437+0000","last_became_active":"2024-02-19T21:49:08.325127+0000","last_became_peered":"2024-02-19T21:49:08.325127+0000","last_unstale":"2024-02-19T21:51:45.310437+0000","last_undegraded":"2024-02-19T21:51:45.310437+0000","last_fullsized":"2024-02-19T21:51:45.310437+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:10.871111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:10.871111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"451'5483","reported_seq":5557,"reported_epoch":451,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.083560+0000","last_change":"2024-02-19T21:48:47.778829+0000","last_active":"2024-02-19T21:51:45.083560+0000","last_peered":"2024-02-19T21:51:45.083560+0000","last_clean":"2024-02-19T21:51:45.083560+0000","last_became_active":"2024-02-19T21:48:47.778486+0000","last_became_peered":"2024-02-19T21:48:47.778486+0000","last_unstale":"2024-02-19T21:51:45.083560+0000","last_undegraded":"2024-02-19T21:51:45.083560+0000","last_fullsized":"2024-02-19T21:51:45.083560+0000","mapping_epoch":385,"log_start":"392'600","ondisk_log_start":"392'600","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4883,"ondisk_log_size":4883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":260636672,"num_objects":3977,"num_object_clones":0,"num_object_copies":11931,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3977,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5483,"num_write_kb":302720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":454,"reported_epoch":451,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.049336+0000","last_change":"2024-02-19T21:47:33.400407+0000","last_active":"2024-02-19T21:51:45.049336+0000","last_peered":"2024-02-19T21:51:45.049336+0000","last_clean":"2024-02-19T21:51:45.049336+0000","last_became_active":"2024-02-19T21:47:33.400075+0000","last_became_peered":"2024-02-19T21:47:33.400075+0000","last_unstale":"2024-02-19T21:51:45.049336+0000","last_undegraded":"2024-02-19T21:51:45.049336+0000","last_fullsized":"2024-02-19T21:51:45.049336+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.035136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":332,"reported_epoch":451,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.047137+0000","last_change":"2024-02-19T21:49:05.746443+0000","last_active":"2024-02-19T21:51:45.047137+0000","last_peered":"2024-02-19T21:51:45.047137+0000","last_clean":"2024-02-19T21:51:45.047137+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:51:45.047137+0000","last_undegraded":"2024-02-19T21:51:45.047137+0000","last_fullsized":"2024-02-19T21:51:45.047137+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.746358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.746358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":484,"reported_epoch":451,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.046487+0000","last_change":"2024-02-19T21:49:54.485252+0000","last_active":"2024-02-19T21:51:45.046487+0000","last_peered":"2024-02-19T21:51:45.046487+0000","last_clean":"2024-02-19T21:51:45.046487+0000","last_became_active":"2024-02-19T21:49:54.484956+0000","last_became_peered":"2024-02-19T21:49:54.484956+0000","last_unstale":"2024-02-19T21:51:45.046487+0000","last_undegraded":"2024-02-19T21:51:45.046487+0000","last_fullsized":"2024-02-19T21:51:45.046487+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:07.901205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:07.901205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":50,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.023498+0000","last_change":"2024-02-19T21:49:54.483990+0000","last_active":"2024-02-19T21:51:47.023498+0000","last_peered":"2024-02-19T21:51:47.023498+0000","last_clean":"2024-02-19T21:51:47.023498+0000","last_became_active":"2024-02-19T21:49:54.483637+0000","last_became_peered":"2024-02-19T21:49:54.483637+0000","last_unstale":"2024-02-19T21:51:47.023498+0000","last_undegraded":"2024-02-19T21:51:47.023498+0000","last_fullsized":"2024-02-19T21:51:47.023498+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.190177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.190177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"201'33","reported_seq":476,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.309577+0000","last_change":"2024-02-19T21:46:47.970066+0000","last_active":"2024-02-19T21:51:40.309577+0000","last_peered":"2024-02-19T21:51:40.309577+0000","last_clean":"2024-02-19T21:51:40.309577+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:51:40.309577+0000","last_undegraded":"2024-02-19T21:51:40.309577+0000","last_fullsized":"2024-02-19T21:51:40.309577+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'33","last_scrub_stamp":"2024-02-19T21:46:47.969961+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.969961+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":50,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.024854+0000","last_change":"2024-02-19T21:49:54.478276+0000","last_active":"2024-02-19T21:51:47.024854+0000","last_peered":"2024-02-19T21:51:47.024854+0000","last_clean":"2024-02-19T21:51:47.024854+0000","last_became_active":"2024-02-19T21:49:54.477947+0000","last_became_peered":"2024-02-19T21:49:54.477947+0000","last_unstale":"2024-02-19T21:51:47.024854+0000","last_undegraded":"2024-02-19T21:51:47.024854+0000","last_fullsized":"2024-02-19T21:51:47.024854+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:57.754453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:57.754453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"454'5381","reported_seq":15599,"reported_epoch":454,"state":"active+clean","last_fresh":"2024-02-19T21:51:49.606012+0000","last_change":"2024-02-19T21:51:22.472713+0000","last_active":"2024-02-19T21:51:49.606012+0000","last_peered":"2024-02-19T21:51:49.606012+0000","last_clean":"2024-02-19T21:51:49.606012+0000","last_became_active":"2024-02-19T21:51:22.462974+0000","last_became_peered":"2024-02-19T21:51:22.462974+0000","last_unstale":"2024-02-19T21:51:49.606012+0000","last_undegraded":"2024-02-19T21:51:49.606012+0000","last_fullsized":"2024-02-19T21:51:49.606012+0000","mapping_epoch":445,"log_start":"392'200","ondisk_log_start":"392'200","created":385,"last_epoch_clean":446,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5181,"ondisk_log_size":5181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":250019840,"num_objects":3815,"num_object_clones":0,"num_object_copies":11445,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3815,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5381,"num_write_kb":294272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5054,"num_bytes_recovered":320077824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7],"acting":[0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":424,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.307281+0000","last_change":"2024-02-19T21:45:47.723650+0000","last_active":"2024-02-19T21:51:40.307281+0000","last_peered":"2024-02-19T21:51:40.307281+0000","last_clean":"2024-02-19T21:51:40.307281+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:51:40.307281+0000","last_undegraded":"2024-02-19T21:51:40.307281+0000","last_fullsized":"2024-02-19T21:51:40.307281+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.723550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.723550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":438,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.030123+0000","last_change":"2024-02-19T21:45:51.243726+0000","last_active":"2024-02-19T21:51:47.030123+0000","last_peered":"2024-02-19T21:51:47.030123+0000","last_clean":"2024-02-19T21:51:47.030123+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:51:47.030123+0000","last_undegraded":"2024-02-19T21:51:47.030123+0000","last_fullsized":"2024-02-19T21:51:47.030123+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:51.243656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:51.243656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":455,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.023728+0000","last_change":"2024-02-19T21:48:23.218358+0000","last_active":"2024-02-19T21:51:47.023728+0000","last_peered":"2024-02-19T21:51:47.023728+0000","last_clean":"2024-02-19T21:51:47.023728+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:51:47.023728+0000","last_undegraded":"2024-02-19T21:51:47.023728+0000","last_fullsized":"2024-02-19T21:51:47.023728+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:23.218282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.218282+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"324'30","reported_seq":582,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.030856+0000","last_change":"2024-02-19T21:49:08.330490+0000","last_active":"2024-02-19T21:51:47.030856+0000","last_peered":"2024-02-19T21:51:47.030856+0000","last_clean":"2024-02-19T21:51:47.030856+0000","last_became_active":"2024-02-19T21:49:08.329761+0000","last_became_peered":"2024-02-19T21:49:08.329761+0000","last_unstale":"2024-02-19T21:51:47.030856+0000","last_undegraded":"2024-02-19T21:51:47.030856+0000","last_fullsized":"2024-02-19T21:51:47.030856+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'30","last_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_deep_scrub":"324'30","last_deep_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.110965+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":438,"reported_epoch":451,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.049241+0000","last_change":"2024-02-19T21:45:09.918263+0000","last_active":"2024-02-19T21:51:45.049241+0000","last_peered":"2024-02-19T21:51:45.049241+0000","last_clean":"2024-02-19T21:51:45.049241+0000","last_became_active":"2024-02-19T21:44:42.624782+0000","last_became_peered":"2024-02-19T21:44:42.624782+0000","last_unstale":"2024-02-19T21:51:45.049241+0000","last_undegraded":"2024-02-19T21:51:45.049241+0000","last_fullsized":"2024-02-19T21:51:45.049241+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":295,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_clean_scrub_stamp":"2024-02-19T21:45:09.918170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"451'5383","reported_seq":5458,"reported_epoch":451,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.110385+0000","last_change":"2024-02-19T21:48:47.777963+0000","last_active":"2024-02-19T21:51:45.110385+0000","last_peered":"2024-02-19T21:51:45.110385+0000","last_clean":"2024-02-19T21:51:45.110385+0000","last_became_active":"2024-02-19T21:48:47.777644+0000","last_became_peered":"2024-02-19T21:48:47.777644+0000","last_unstale":"2024-02-19T21:51:45.110385+0000","last_undegraded":"2024-02-19T21:51:45.110385+0000","last_fullsized":"2024-02-19T21:51:45.110385+0000","mapping_epoch":385,"log_start":"392'500","ondisk_log_start":"392'500","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4883,"ondisk_log_size":4883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":254672920,"num_objects":3887,"num_object_clones":0,"num_object_copies":11661,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3887,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5383,"num_write_kb":296577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":457,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.305286+0000","last_change":"2024-02-19T21:49:08.331080+0000","last_active":"2024-02-19T21:51:40.305286+0000","last_peered":"2024-02-19T21:51:40.305286+0000","last_clean":"2024-02-19T21:51:40.305286+0000","last_became_active":"2024-02-19T21:49:08.330648+0000","last_became_peered":"2024-02-19T21:49:08.330648+0000","last_unstale":"2024-02-19T21:51:40.305286+0000","last_undegraded":"2024-02-19T21:51:40.305286+0000","last_fullsized":"2024-02-19T21:51:40.305286+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:55.803876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:44:55.803876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":431,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.025369+0000","last_change":"2024-02-19T21:48:31.320229+0000","last_active":"2024-02-19T21:51:47.025369+0000","last_peered":"2024-02-19T21:51:47.025369+0000","last_clean":"2024-02-19T21:51:47.025369+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:51:47.025369+0000","last_undegraded":"2024-02-19T21:51:47.025369+0000","last_fullsized":"2024-02-19T21:51:47.025369+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:31.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:45.017696+0000","last_clean_scrub_stamp":"2024-02-19T21:48:31.320133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"201'37","reported_seq":486,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.030292+0000","last_change":"2024-02-19T21:45:14.173212+0000","last_active":"2024-02-19T21:51:47.030292+0000","last_peered":"2024-02-19T21:51:47.030292+0000","last_clean":"2024-02-19T21:51:47.030292+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:51:47.030292+0000","last_undegraded":"2024-02-19T21:51:47.030292+0000","last_fullsized":"2024-02-19T21:51:47.030292+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'37","last_scrub_stamp":"2024-02-19T21:45:14.173134+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:45:14.173134+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":427,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.302796+0000","last_change":"2024-02-19T21:46:48.988928+0000","last_active":"2024-02-19T21:51:40.302796+0000","last_peered":"2024-02-19T21:51:40.302796+0000","last_clean":"2024-02-19T21:51:40.302796+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:51:40.302796+0000","last_undegraded":"2024-02-19T21:51:40.302796+0000","last_fullsized":"2024-02-19T21:51:40.302796+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:48.988836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.988836+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.e","version":"451'5277","reported_seq":7437,"reported_epoch":451,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.116438+0000","last_change":"2024-02-19T21:50:40.718822+0000","last_active":"2024-02-19T21:51:45.116438+0000","last_peered":"2024-02-19T21:51:45.116438+0000","last_clean":"2024-02-19T21:51:45.116438+0000","last_became_active":"2024-02-19T21:50:40.710425+0000","last_became_peered":"2024-02-19T21:50:40.710425+0000","last_unstale":"2024-02-19T21:51:45.116438+0000","last_undegraded":"2024-02-19T21:51:45.116438+0000","last_fullsized":"2024-02-19T21:51:45.116438+0000","mapping_epoch":430,"log_start":"392'200","ondisk_log_start":"392'200","created":385,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5077,"ondisk_log_size":5077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":252903424,"num_objects":3859,"num_object_clones":0,"num_object_copies":11577,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3859,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5277,"num_write_kb":292352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1035,"num_bytes_recovered":67829760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":170,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.317085+0000","last_change":"2024-02-19T21:49:08.326461+0000","last_active":"2024-02-19T21:51:40.317085+0000","last_peered":"2024-02-19T21:51:40.317085+0000","last_clean":"2024-02-19T21:51:40.317085+0000","last_became_active":"2024-02-19T21:49:08.326106+0000","last_became_peered":"2024-02-19T21:49:08.326106+0000","last_unstale":"2024-02-19T21:51:40.317085+0000","last_undegraded":"2024-02-19T21:51:40.317085+0000","last_fullsized":"2024-02-19T21:51:40.317085+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.080896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.080896+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":430,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.305725+0000","last_change":"2024-02-19T21:48:11.879787+0000","last_active":"2024-02-19T21:51:40.305725+0000","last_peered":"2024-02-19T21:51:40.305725+0000","last_clean":"2024-02-19T21:51:40.305725+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:51:40.305725+0000","last_undegraded":"2024-02-19T21:51:40.305725+0000","last_fullsized":"2024-02-19T21:51:40.305725+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.879687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.879687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"201'38","reported_seq":68,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.023886+0000","last_change":"2024-02-19T21:49:55.861358+0000","last_active":"2024-02-19T21:51:47.023886+0000","last_peered":"2024-02-19T21:51:47.023886+0000","last_clean":"2024-02-19T21:51:47.023886+0000","last_became_active":"2024-02-19T21:49:54.480413+0000","last_became_peered":"2024-02-19T21:49:54.480413+0000","last_unstale":"2024-02-19T21:51:47.023886+0000","last_undegraded":"2024-02-19T21:51:47.023886+0000","last_fullsized":"2024-02-19T21:51:47.023886+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":415,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'38","last_scrub_stamp":"2024-02-19T21:49:05.923627+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.923627+0000","log_size":38,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":323,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.303794+0000","last_change":"2024-02-19T21:49:54.495134+0000","last_active":"2024-02-19T21:51:40.303794+0000","last_peered":"2024-02-19T21:51:40.303794+0000","last_clean":"2024-02-19T21:51:40.303794+0000","last_became_active":"2024-02-19T21:49:54.494802+0000","last_became_peered":"2024-02-19T21:49:54.494802+0000","last_unstale":"2024-02-19T21:51:40.303794+0000","last_undegraded":"2024-02-19T21:51:40.303794+0000","last_fullsized":"2024-02-19T21:51:40.303794+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:10.578408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:10.578408+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.f","version":"451'5553","reported_seq":7937,"reported_epoch":451,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.049682+0000","last_change":"2024-02-19T21:51:05.409700+0000","last_active":"2024-02-19T21:51:45.049682+0000","last_peered":"2024-02-19T21:51:45.049682+0000","last_clean":"2024-02-19T21:51:45.049682+0000","last_became_active":"2024-02-19T21:51:05.398355+0000","last_became_peered":"2024-02-19T21:51:05.398355+0000","last_unstale":"2024-02-19T21:51:45.049682+0000","last_undegraded":"2024-02-19T21:51:45.049682+0000","last_fullsized":"2024-02-19T21:51:45.049682+0000","mapping_epoch":440,"log_start":"392'700","ondisk_log_start":"392'700","created":385,"last_epoch_clean":441,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4853,"ondisk_log_size":4853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":261160960,"num_objects":3985,"num_object_clones":0,"num_object_copies":11955,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3985,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5553,"num_write_kb":305216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1147,"num_bytes_recovered":75169792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":460,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.024107+0000","last_change":"2024-02-19T21:49:08.328862+0000","last_active":"2024-02-19T21:51:47.024107+0000","last_peered":"2024-02-19T21:51:47.024107+0000","last_clean":"2024-02-19T21:51:47.024107+0000","last_became_active":"2024-02-19T21:49:08.328529+0000","last_became_peered":"2024-02-19T21:49:08.328529+0000","last_unstale":"2024-02-19T21:51:47.024107+0000","last_undegraded":"2024-02-19T21:51:47.024107+0000","last_fullsized":"2024-02-19T21:51:47.024107+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:49.110117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:49.110117+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":490,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.310374+0000","last_change":"2024-02-19T21:49:54.493367+0000","last_active":"2024-02-19T21:51:40.310374+0000","last_peered":"2024-02-19T21:51:40.310374+0000","last_clean":"2024-02-19T21:51:40.310374+0000","last_became_active":"2024-02-19T21:49:54.493041+0000","last_became_peered":"2024-02-19T21:49:54.493041+0000","last_unstale":"2024-02-19T21:51:40.310374+0000","last_undegraded":"2024-02-19T21:51:40.310374+0000","last_fullsized":"2024-02-19T21:51:40.310374+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.972369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.972369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"201'28","reported_seq":297,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.315820+0000","last_change":"2024-02-19T21:49:08.330818+0000","last_active":"2024-02-19T21:51:40.315820+0000","last_peered":"2024-02-19T21:51:40.315820+0000","last_clean":"2024-02-19T21:51:40.315820+0000","last_became_active":"2024-02-19T21:49:08.330477+0000","last_became_peered":"2024-02-19T21:49:08.330477+0000","last_unstale":"2024-02-19T21:51:40.315820+0000","last_undegraded":"2024-02-19T21:51:40.315820+0000","last_fullsized":"2024-02-19T21:51:40.315820+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'28","last_scrub_stamp":"2024-02-19T21:45:55.998646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.998646+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":40,"num_read_kb":33,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":518,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:42.092806+0000","last_change":"2024-02-19T21:45:50.742626+0000","last_active":"2024-02-19T21:51:42.092806+0000","last_peered":"2024-02-19T21:51:42.092806+0000","last_clean":"2024-02-19T21:51:42.092806+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:51:42.092806+0000","last_undegraded":"2024-02-19T21:51:42.092806+0000","last_fullsized":"2024-02-19T21:51:42.092806+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'9","last_scrub_stamp":"2024-02-19T21:45:50.742526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:50.742526+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"451'5301","reported_seq":5375,"reported_epoch":451,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.047915+0000","last_change":"2024-02-19T21:48:47.779506+0000","last_active":"2024-02-19T21:51:45.047915+0000","last_peered":"2024-02-19T21:51:45.047915+0000","last_clean":"2024-02-19T21:51:45.047915+0000","last_became_active":"2024-02-19T21:48:47.778325+0000","last_became_peered":"2024-02-19T21:48:47.778325+0000","last_unstale":"2024-02-19T21:51:45.047915+0000","last_undegraded":"2024-02-19T21:51:45.047915+0000","last_fullsized":"2024-02-19T21:51:45.047915+0000","mapping_epoch":385,"log_start":"392'400","ondisk_log_start":"392'400","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4901,"ondisk_log_size":4901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":251592704,"num_objects":3839,"num_object_clones":0,"num_object_copies":11517,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3839,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5301,"num_write_kb":292480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"66'1","reported_seq":341,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.309657+0000","last_change":"2024-02-19T21:48:12.568842+0000","last_active":"2024-02-19T21:51:40.309657+0000","last_peered":"2024-02-19T21:51:40.309657+0000","last_clean":"2024-02-19T21:51:40.309657+0000","last_became_active":"2024-02-19T21:44:56.166670+0000","last_became_peered":"2024-02-19T21:44:56.166670+0000","last_unstale":"2024-02-19T21:51:40.309657+0000","last_undegraded":"2024-02-19T21:51:40.309657+0000","last_fullsized":"2024-02-19T21:51:40.309657+0000","mapping_epoch":165,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:12.568734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.568734+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"261'11","reported_seq":530,"reported_epoch":451,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.047114+0000","last_change":"2024-02-19T21:45:01.716882+0000","last_active":"2024-02-19T21:51:45.047114+0000","last_peered":"2024-02-19T21:51:45.047114+0000","last_clean":"2024-02-19T21:51:45.047114+0000","last_became_active":"2024-02-19T21:44:08.123392+0000","last_became_peered":"2024-02-19T21:44:08.123392+0000","last_unstale":"2024-02-19T21:51:45.047114+0000","last_undegraded":"2024-02-19T21:51:45.047114+0000","last_fullsized":"2024-02-19T21:51:45.047114+0000","mapping_epoch":62,"log_start":"257'10","ondisk_log_start":"257'10","created":62,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-02-19T21:45:01.716817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.716817+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":442,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.023804+0000","last_change":"2024-02-19T21:48:19.186455+0000","last_active":"2024-02-19T21:51:47.023804+0000","last_peered":"2024-02-19T21:51:47.023804+0000","last_clean":"2024-02-19T21:51:47.023804+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:51:47.023804+0000","last_undegraded":"2024-02-19T21:51:47.023804+0000","last_fullsized":"2024-02-19T21:51:47.023804+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:48:19.186359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:19.186359+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"201'19","reported_seq":297,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.316352+0000","last_change":"2024-02-19T21:48:34.485865+0000","last_active":"2024-02-19T21:51:40.316352+0000","last_peered":"2024-02-19T21:51:40.316352+0000","last_clean":"2024-02-19T21:51:40.316352+0000","last_became_active":"2024-02-19T21:47:46.251550+0000","last_became_peered":"2024-02-19T21:47:46.251550+0000","last_unstale":"2024-02-19T21:51:40.316352+0000","last_undegraded":"2024-02-19T21:51:40.316352+0000","last_fullsized":"2024-02-19T21:51:40.316352+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:34.485787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:34.485787+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":23,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7],"acting":[4,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1","version":"451'5380","reported_seq":5454,"reported_epoch":451,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.100074+0000","last_change":"2024-02-19T21:48:47.772467+0000","last_active":"2024-02-19T21:51:45.100074+0000","last_peered":"2024-02-19T21:51:45.100074+0000","last_clean":"2024-02-19T21:51:45.100074+0000","last_became_active":"2024-02-19T21:48:47.772154+0000","last_became_peered":"2024-02-19T21:48:47.772154+0000","last_unstale":"2024-02-19T21:51:45.100074+0000","last_undegraded":"2024-02-19T21:51:45.100074+0000","last_fullsized":"2024-02-19T21:51:45.100074+0000","mapping_epoch":385,"log_start":"392'300","ondisk_log_start":"392'300","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5080,"ondisk_log_size":5080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":257818624,"num_objects":3934,"num_object_clones":0,"num_object_copies":11802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3934,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5380,"num_write_kb":298048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":447,"reported_epoch":451,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.045815+0000","last_change":"2024-02-19T21:46:01.031458+0000","last_active":"2024-02-19T21:51:45.045815+0000","last_peered":"2024-02-19T21:51:45.045815+0000","last_clean":"2024-02-19T21:51:45.045815+0000","last_became_active":"2024-02-19T21:44:56.155194+0000","last_became_peered":"2024-02-19T21:44:56.155194+0000","last_unstale":"2024-02-19T21:51:45.045815+0000","last_undegraded":"2024-02-19T21:51:45.045815+0000","last_fullsized":"2024-02-19T21:51:45.045815+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.031344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.031344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"363'12","reported_seq":241,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:42.092456+0000","last_change":"2024-02-19T21:48:25.487689+0000","last_active":"2024-02-19T21:51:42.092456+0000","last_peered":"2024-02-19T21:51:42.092456+0000","last_clean":"2024-02-19T21:51:42.092456+0000","last_became_active":"2024-02-19T21:47:46.260099+0000","last_became_peered":"2024-02-19T21:47:46.260099+0000","last_unstale":"2024-02-19T21:51:42.092456+0000","last_undegraded":"2024-02-19T21:51:42.092456+0000","last_fullsized":"2024-02-19T21:51:42.092456+0000","mapping_epoch":362,"log_start":"98'9","ondisk_log_start":"98'9","created":62,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"363'12","last_scrub_stamp":"2024-02-19T21:48:25.487608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.487608+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":450,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.305209+0000","last_change":"2024-02-19T21:49:08.335163+0000","last_active":"2024-02-19T21:51:40.305209+0000","last_peered":"2024-02-19T21:51:40.305209+0000","last_clean":"2024-02-19T21:51:40.305209+0000","last_became_active":"2024-02-19T21:49:08.334842+0000","last_became_peered":"2024-02-19T21:49:08.334842+0000","last_unstale":"2024-02-19T21:51:40.305209+0000","last_undegraded":"2024-02-19T21:51:40.305209+0000","last_fullsized":"2024-02-19T21:51:40.305209+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.700887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.700887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"270'34","reported_seq":371,"reported_epoch":451,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.046863+0000","last_change":"2024-02-19T21:47:34.894164+0000","last_active":"2024-02-19T21:51:45.046863+0000","last_peered":"2024-02-19T21:51:45.046863+0000","last_clean":"2024-02-19T21:51:45.046863+0000","last_became_active":"2024-02-19T21:47:33.400012+0000","last_became_peered":"2024-02-19T21:47:33.400012+0000","last_unstale":"2024-02-19T21:51:45.046863+0000","last_undegraded":"2024-02-19T21:51:45.046863+0000","last_fullsized":"2024-02-19T21:51:45.046863+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":357,"parent":"0.0","parent_split_bits":0,"last_scrub":"270'34","last_scrub_stamp":"2024-02-19T21:46:44.789309+0000","last_deep_scrub":"270'34","last_deep_scrub_stamp":"2024-02-19T21:44:17.451151+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.789309+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2","version":"451'5466","reported_seq":5540,"reported_epoch":451,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.097417+0000","last_change":"2024-02-19T21:48:47.771305+0000","last_active":"2024-02-19T21:51:45.097417+0000","last_peered":"2024-02-19T21:51:45.097417+0000","last_clean":"2024-02-19T21:51:45.097417+0000","last_became_active":"2024-02-19T21:48:47.771000+0000","last_became_peered":"2024-02-19T21:48:47.771000+0000","last_unstale":"2024-02-19T21:51:45.097417+0000","last_undegraded":"2024-02-19T21:51:45.097417+0000","last_fullsized":"2024-02-19T21:51:45.097417+0000","mapping_epoch":385,"log_start":"392'200","ondisk_log_start":"392'200","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5266,"ondisk_log_size":5266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":259653632,"num_objects":3962,"num_object_clones":0,"num_object_copies":11886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3962,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5466,"num_write_kb":301696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":428,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.316532+0000","last_change":"2024-02-19T21:49:08.329023+0000","last_active":"2024-02-19T21:51:40.316532+0000","last_peered":"2024-02-19T21:51:40.316532+0000","last_clean":"2024-02-19T21:51:40.316532+0000","last_became_active":"2024-02-19T21:49:08.328697+0000","last_became_peered":"2024-02-19T21:49:08.328697+0000","last_unstale":"2024-02-19T21:51:40.316532+0000","last_undegraded":"2024-02-19T21:51:40.316532+0000","last_fullsized":"2024-02-19T21:51:40.316532+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.939414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.939414+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"397'17","reported_seq":372,"reported_epoch":452,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.313832+0000","last_change":"2024-02-19T21:49:08.325927+0000","last_active":"2024-02-19T21:51:45.313832+0000","last_peered":"2024-02-19T21:51:45.313832+0000","last_clean":"2024-02-19T21:51:45.313832+0000","last_became_active":"2024-02-19T21:49:08.325034+0000","last_became_peered":"2024-02-19T21:49:08.325034+0000","last_unstale":"2024-02-19T21:51:45.313832+0000","last_undegraded":"2024-02-19T21:51:45.313832+0000","last_fullsized":"2024-02-19T21:51:45.313832+0000","mapping_epoch":394,"log_start":"170'11","ondisk_log_start":"170'11","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"271'13","last_scrub_stamp":"2024-02-19T21:46:47.072988+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.072988+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":440,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.306521+0000","last_change":"2024-02-19T21:49:03.987847+0000","last_active":"2024-02-19T21:51:40.306521+0000","last_peered":"2024-02-19T21:51:40.306521+0000","last_clean":"2024-02-19T21:51:40.306521+0000","last_became_active":"2024-02-19T21:47:33.395485+0000","last_became_peered":"2024-02-19T21:47:33.395485+0000","last_unstale":"2024-02-19T21:51:40.306521+0000","last_undegraded":"2024-02-19T21:51:40.306521+0000","last_fullsized":"2024-02-19T21:51:40.306521+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:03.987749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:49:03.987749+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,5],"acting":[1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"200'20","reported_seq":274,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.316318+0000","last_change":"2024-02-19T21:48:12.628796+0000","last_active":"2024-02-19T21:51:40.316318+0000","last_peered":"2024-02-19T21:51:40.316318+0000","last_clean":"2024-02-19T21:51:40.316318+0000","last_became_active":"2024-02-19T21:47:46.251725+0000","last_became_peered":"2024-02-19T21:47:46.251725+0000","last_unstale":"2024-02-19T21:51:40.316318+0000","last_undegraded":"2024-02-19T21:51:40.316318+0000","last_fullsized":"2024-02-19T21:51:40.316318+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'20","last_scrub_stamp":"2024-02-19T21:48:12.628700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.628700+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3","version":"453'5442","reported_seq":7722,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.024327+0000","last_change":"2024-02-19T21:50:50.296220+0000","last_active":"2024-02-19T21:51:47.024327+0000","last_peered":"2024-02-19T21:51:47.024327+0000","last_clean":"2024-02-19T21:51:47.024327+0000","last_became_active":"2024-02-19T21:50:50.289607+0000","last_became_peered":"2024-02-19T21:50:50.289607+0000","last_unstale":"2024-02-19T21:51:47.024327+0000","last_undegraded":"2024-02-19T21:51:47.024327+0000","last_fullsized":"2024-02-19T21:51:47.024327+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":385,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5442,"ondisk_log_size":5442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":256770048,"num_objects":3918,"num_object_clones":0,"num_object_copies":11754,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3918,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5442,"num_write_kb":299520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1097,"num_bytes_recovered":71892992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":81,"reported_epoch":452,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.310530+0000","last_change":"2024-02-19T21:49:08.327495+0000","last_active":"2024-02-19T21:51:45.310530+0000","last_peered":"2024-02-19T21:51:45.310530+0000","last_clean":"2024-02-19T21:51:45.310530+0000","last_became_active":"2024-02-19T21:49:08.327172+0000","last_became_peered":"2024-02-19T21:49:08.327172+0000","last_unstale":"2024-02-19T21:51:45.310530+0000","last_undegraded":"2024-02-19T21:51:45.310530+0000","last_fullsized":"2024-02-19T21:51:45.310530+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.241319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.241319+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,6],"acting":[2,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":435,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.307237+0000","last_change":"2024-02-19T21:45:01.798485+0000","last_active":"2024-02-19T21:51:40.307237+0000","last_peered":"2024-02-19T21:51:40.307237+0000","last_clean":"2024-02-19T21:51:40.307237+0000","last_became_active":"2024-02-19T21:44:22.245925+0000","last_became_peered":"2024-02-19T21:44:22.245925+0000","last_unstale":"2024-02-19T21:51:40.307237+0000","last_undegraded":"2024-02-19T21:51:40.307237+0000","last_fullsized":"2024-02-19T21:51:40.307237+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:01.798387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.798387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":438,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.023977+0000","last_change":"2024-02-19T21:48:30.277397+0000","last_active":"2024-02-19T21:51:47.023977+0000","last_peered":"2024-02-19T21:51:47.023977+0000","last_clean":"2024-02-19T21:51:47.023977+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:51:47.023977+0000","last_undegraded":"2024-02-19T21:51:47.023977+0000","last_fullsized":"2024-02-19T21:51:47.023977+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.277322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.277322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"337'39","reported_seq":383,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.316647+0000","last_change":"2024-02-19T21:49:08.326007+0000","last_active":"2024-02-19T21:51:40.316647+0000","last_peered":"2024-02-19T21:51:40.316647+0000","last_clean":"2024-02-19T21:51:40.316647+0000","last_became_active":"2024-02-19T21:49:08.325683+0000","last_became_peered":"2024-02-19T21:49:08.325683+0000","last_unstale":"2024-02-19T21:51:40.316647+0000","last_undegraded":"2024-02-19T21:51:40.316647+0000","last_fullsized":"2024-02-19T21:51:40.316647+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'39","last_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_deep_scrub":"337'39","last_deep_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.923809+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":49,"num_read_kb":39,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"454'5605","reported_seq":5682,"reported_epoch":454,"state":"active+clean","last_fresh":"2024-02-19T21:51:49.634196+0000","last_change":"2024-02-19T21:48:47.776672+0000","last_active":"2024-02-19T21:51:49.634196+0000","last_peered":"2024-02-19T21:51:49.634196+0000","last_clean":"2024-02-19T21:51:49.634196+0000","last_became_active":"2024-02-19T21:48:47.776368+0000","last_became_peered":"2024-02-19T21:48:47.776368+0000","last_unstale":"2024-02-19T21:51:49.634196+0000","last_undegraded":"2024-02-19T21:51:49.634196+0000","last_fullsized":"2024-02-19T21:51:49.634196+0000","mapping_epoch":385,"log_start":"392'500","ondisk_log_start":"392'500","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5105,"ondisk_log_size":5105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":258408448,"num_objects":3943,"num_object_clones":0,"num_object_copies":11829,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3943,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5605,"num_write_kb":305536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"66'1","reported_seq":276,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.023512+0000","last_change":"2024-02-19T21:50:57.303343+0000","last_active":"2024-02-19T21:51:47.023512+0000","last_peered":"2024-02-19T21:51:47.023512+0000","last_clean":"2024-02-19T21:51:47.023512+0000","last_became_active":"2024-02-19T21:50:57.302957+0000","last_became_peered":"2024-02-19T21:50:57.302957+0000","last_unstale":"2024-02-19T21:51:47.023512+0000","last_undegraded":"2024-02-19T21:51:47.023512+0000","last_fullsized":"2024-02-19T21:51:47.023512+0000","mapping_epoch":437,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":438,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:46:43.773486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:46:43.773486+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":81,"reported_epoch":452,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.309987+0000","last_change":"2024-02-19T21:49:08.326583+0000","last_active":"2024-02-19T21:51:45.309987+0000","last_peered":"2024-02-19T21:51:45.309987+0000","last_clean":"2024-02-19T21:51:45.309987+0000","last_became_active":"2024-02-19T21:49:08.324835+0000","last_became_peered":"2024-02-19T21:49:08.324835+0000","last_unstale":"2024-02-19T21:51:45.309987+0000","last_undegraded":"2024-02-19T21:51:45.309987+0000","last_fullsized":"2024-02-19T21:51:45.309987+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.163825+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":135,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.302433+0000","last_change":"2024-02-19T21:49:08.327553+0000","last_active":"2024-02-19T21:51:40.302433+0000","last_peered":"2024-02-19T21:51:40.302433+0000","last_clean":"2024-02-19T21:51:40.302433+0000","last_became_active":"2024-02-19T21:49:08.327186+0000","last_became_peered":"2024-02-19T21:49:08.327186+0000","last_unstale":"2024-02-19T21:51:40.302433+0000","last_undegraded":"2024-02-19T21:51:40.302433+0000","last_fullsized":"2024-02-19T21:51:40.302433+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:45:00.748244+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:45:00.748244+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"201'44","reported_seq":556,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.302710+0000","last_change":"2024-02-19T21:49:55.281324+0000","last_active":"2024-02-19T21:51:40.302710+0000","last_peered":"2024-02-19T21:51:40.302710+0000","last_clean":"2024-02-19T21:51:40.302710+0000","last_became_active":"2024-02-19T21:49:54.493167+0000","last_became_peered":"2024-02-19T21:49:54.493167+0000","last_unstale":"2024-02-19T21:51:40.302710+0000","last_undegraded":"2024-02-19T21:51:40.302710+0000","last_fullsized":"2024-02-19T21:51:40.302710+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'44","last_scrub_stamp":"2024-02-19T21:48:32.489084+0000","last_deep_scrub":"201'44","last_deep_scrub_stamp":"2024-02-19T21:44:16.255049+0000","last_clean_scrub_stamp":"2024-02-19T21:48:32.489084+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.5","version":"452'5485","reported_seq":7902,"reported_epoch":452,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:51:47.025537+0000","last_change":"2024-02-19T21:50:03.887248+0000","last_active":"2024-02-19T21:51:47.025537+0000","last_peered":"2024-02-19T21:51:47.025537+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:50:03.654321+0000","last_became_peered":"2024-02-19T21:50:03.654321+0000","last_unstale":"2024-02-19T21:51:47.025537+0000","last_undegraded":"2024-02-19T21:50:01.398577+0000","last_fullsized":"2024-02-19T21:49:55.473278+0000","mapping_epoch":414,"log_start":"392'100","ondisk_log_start":"392'100","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5385,"ondisk_log_size":5385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":258015232,"num_objects":3937,"num_object_clones":0,"num_object_copies":11811,"num_objects_missing_on_primary":370,"num_objects_missing":370,"num_objects_degraded":370,"num_objects_misplaced":3347,"num_objects_unfound":0,"num_objects_dirty":3937,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5485,"num_write_kb":301504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":774,"num_bytes_recovered":50724864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0],"avail_no_missing":["0","5"],"object_location_counts":[{"shards":"0,2","objects":590},{"shards":"0,2,5","objects":2977},{"shards":"0,5","objects":370}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":483,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.030356+0000","last_change":"2024-02-19T21:49:08.328667+0000","last_active":"2024-02-19T21:51:47.030356+0000","last_peered":"2024-02-19T21:51:47.030356+0000","last_clean":"2024-02-19T21:51:47.030356+0000","last_became_active":"2024-02-19T21:49:08.328287+0000","last_became_peered":"2024-02-19T21:49:08.328287+0000","last_unstale":"2024-02-19T21:51:47.030356+0000","last_undegraded":"2024-02-19T21:51:47.030356+0000","last_fullsized":"2024-02-19T21:51:47.030356+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.176542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.176542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":81,"reported_epoch":452,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.309694+0000","last_change":"2024-02-19T21:49:08.332637+0000","last_active":"2024-02-19T21:51:45.309694+0000","last_peered":"2024-02-19T21:51:45.309694+0000","last_clean":"2024-02-19T21:51:45.309694+0000","last_became_active":"2024-02-19T21:49:08.331451+0000","last_became_peered":"2024-02-19T21:49:08.331451+0000","last_unstale":"2024-02-19T21:51:45.309694+0000","last_undegraded":"2024-02-19T21:51:45.309694+0000","last_fullsized":"2024-02-19T21:51:45.309694+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.123413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.547129+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.123413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":450,"reported_epoch":450,"state":"active+clean","last_fresh":"2024-02-19T21:51:40.305763+0000","last_change":"2024-02-19T21:49:08.331159+0000","last_active":"2024-02-19T21:51:40.305763+0000","last_peered":"2024-02-19T21:51:40.305763+0000","last_clean":"2024-02-19T21:51:40.305763+0000","last_became_active":"2024-02-19T21:49:08.330804+0000","last_became_peered":"2024-02-19T21:49:08.330804+0000","last_unstale":"2024-02-19T21:51:40.305763+0000","last_undegraded":"2024-02-19T21:51:40.305763+0000","last_fullsized":"2024-02-19T21:51:40.305763+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.978015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.978015+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"377'19","reported_seq":461,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.030447+0000","last_change":"2024-02-19T21:48:23.326608+0000","last_active":"2024-02-19T21:51:47.030447+0000","last_peered":"2024-02-19T21:51:47.030447+0000","last_clean":"2024-02-19T21:51:47.030447+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:51:47.030447+0000","last_undegraded":"2024-02-19T21:51:47.030447+0000","last_fullsized":"2024-02-19T21:51:47.030447+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"377'19","last_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_deep_scrub":"377'19","last_deep_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.326541+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"451'5470","reported_seq":5544,"reported_epoch":451,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.226035+0000","last_change":"2024-02-19T21:48:47.780368+0000","last_active":"2024-02-19T21:51:45.226035+0000","last_peered":"2024-02-19T21:51:45.226035+0000","last_clean":"2024-02-19T21:51:45.226035+0000","last_became_active":"2024-02-19T21:48:47.780046+0000","last_became_peered":"2024-02-19T21:48:47.780046+0000","last_unstale":"2024-02-19T21:51:45.226035+0000","last_undegraded":"2024-02-19T21:51:45.226035+0000","last_fullsized":"2024-02-19T21:51:45.226035+0000","mapping_epoch":385,"log_start":"392'200","ondisk_log_start":"392'200","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5270,"ondisk_log_size":5270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":258080768,"num_objects":3938,"num_object_clones":0,"num_object_copies":11814,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3938,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5470,"num_write_kb":301056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":445,"reported_epoch":451,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.046839+0000","last_change":"2024-02-19T21:46:01.981923+0000","last_active":"2024-02-19T21:51:45.046839+0000","last_peered":"2024-02-19T21:51:45.046839+0000","last_clean":"2024-02-19T21:51:45.046839+0000","last_became_active":"2024-02-19T21:44:56.160521+0000","last_became_peered":"2024-02-19T21:44:56.160521+0000","last_unstale":"2024-02-19T21:51:45.046839+0000","last_undegraded":"2024-02-19T21:51:45.046839+0000","last_fullsized":"2024-02-19T21:51:45.046839+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.981866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.981866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":90,"reported_epoch":452,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.310555+0000","last_change":"2024-02-19T21:49:54.485377+0000","last_active":"2024-02-19T21:51:45.310555+0000","last_peered":"2024-02-19T21:51:45.310555+0000","last_clean":"2024-02-19T21:51:45.310555+0000","last_became_active":"2024-02-19T21:49:54.485078+0000","last_became_peered":"2024-02-19T21:49:54.485078+0000","last_unstale":"2024-02-19T21:51:45.310555+0000","last_undegraded":"2024-02-19T21:51:45.310555+0000","last_fullsized":"2024-02-19T21:51:45.310555+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:52.107416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:46:52.107416+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"200'27","reported_seq":522,"reported_epoch":451,"state":"active+clean","last_fresh":"2024-02-19T21:51:45.044885+0000","last_change":"2024-02-19T21:49:55.109780+0000","last_active":"2024-02-19T21:51:45.044885+0000","last_peered":"2024-02-19T21:51:45.044885+0000","last_clean":"2024-02-19T21:51:45.044885+0000","last_became_active":"2024-02-19T21:49:54.486014+0000","last_became_peered":"2024-02-19T21:49:54.486014+0000","last_unstale":"2024-02-19T21:51:45.044885+0000","last_undegraded":"2024-02-19T21:51:45.044885+0000","last_fullsized":"2024-02-19T21:51:45.044885+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'27","last_scrub_stamp":"2024-02-19T21:48:24.665813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:24.665813+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"324'11","reported_seq":693,"reported_epoch":453,"state":"active+clean","last_fresh":"2024-02-19T21:51:47.093447+0000","last_change":"2024-02-19T21:48:26.293036+0000","last_active":"2024-02-19T21:51:47.093447+0000","last_peered":"2024-02-19T21:51:47.093447+0000","last_clean":"2024-02-19T21:51:47.093447+0000","last_became_active":"2024-02-19T21:44:34.385140+0000","last_became_peered":"2024-02-19T21:44:34.385140+0000","last_unstale":"2024-02-19T21:51:47.093447+0000","last_undegraded":"2024-02-19T21:51:47.093447+0000","last_fullsized":"2024-02-19T21:51:47.093447+0000","mapping_epoch":62,"log_start":"66'8","ondisk_log_start":"66'8","created":62,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'11","last_scrub_stamp":"2024-02-19T21:48:26.292909+0000","last_deep_scrub":"324'11","last_deep_scrub_stamp":"2024-02-19T21:46:05.210095+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.292909+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":4100915224,"num_objects":62576,"num_object_clones":0,"num_object_copies":187728,"num_objects_missing_on_primary":370,"num_objects_missing":370,"num_objects_degraded":1194,"num_objects_misplaced":6566,"num_objects_unfound":0,"num_objects_dirty":62576,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":86920,"num_write_kb":4783809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10548,"num_bytes_recovered":680132608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12542685184,"data_stored":12542672968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81020,"ondisk_log_size":81020,"up":48,"acting":45,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1141,"num_read_kb":1136,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1107,"num_read_kb":864,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":277,"num_bytes_recovered":5172,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":776,"ondisk_log_size":776,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":22,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":66,"acting":66,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":382,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201516,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1121708,"kb_used_data":820388,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":92623444,"statfs":{"total":95995035648,"available":94846406656,"internally_reserved":0,"allocated":840077312,"data_stored":838748216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":1.718,"15min":1.8839999999999999},"min":{"1min":0.23100000000000001,"5min":0.19,"15min":0.189},"max":{"1min":2.7530000000000001,"5min":22.07,"15min":70.477999999999994},"last":0.33100000000000002},{"interface":"front","average":{"1min":1.0980000000000001,"5min":2.161,"15min":2.073},"min":{"1min":0.24199999999999999,"5min":0.21199999999999999,"15min":0.20999999999999999},"max":{"1min":11.962999999999999,"5min":22.457000000000001,"15min":68.052000000000007},"last":0.622}]},{"osd":1,"last update":"Mon Feb 19 21:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.8839999999999999,"15min":2.0979999999999999},"min":{"1min":0.26400000000000001,"5min":0.247,"15min":0.23200000000000001},"max":{"1min":9.9440000000000008,"5min":22.117999999999999,"15min":68.168000000000006},"last":0.39400000000000002},{"interface":"front","average":{"1min":1.0309999999999999,"5min":2.3620000000000001,"15min":2.1400000000000001},"min":{"1min":0.33000000000000002,"5min":0.26300000000000001,"15min":0.223},"max":{"1min":9.8559999999999999,"5min":22.236000000000001,"15min":68.444000000000003},"last":0.497}]},{"osd":2,"last update":"Mon Feb 19 21:51:12 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":2.028,"15min":2.2759999999999998},"min":{"1min":0.29999999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.673,"5min":12.304,"15min":12.304},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":1.756,"15min":1.9610000000000001},"min":{"1min":0.28299999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":2.6840000000000002,"5min":11.69,"15min":11.69},"last":0.44600000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:50:50 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.966,"15min":2.1829999999999998},"min":{"1min":0.315,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":11.778,"5min":11.778,"15min":31.559000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":1.571,"15min":1.901},"min":{"1min":0.316,"5min":0.30299999999999999,"15min":0.29299999999999998},"max":{"1min":2.8039999999999998,"5min":13.473000000000001,"15min":30.812999999999999},"last":0.41799999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":1.875,"15min":1.5489999999999999},"min":{"1min":0.28199999999999997,"5min":0.245,"15min":0.216},"max":{"1min":2.8239999999999998,"5min":17.716999999999999,"15min":17.716999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":2.2330000000000001,"15min":1.8740000000000001},"min":{"1min":0.30599999999999999,"5min":0.253,"15min":0.245},"max":{"1min":2.7839999999999998,"5min":17.690999999999999,"15min":17.690999999999999},"last":0.59899999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":1.9299999999999999,"15min":1.615},"min":{"1min":0.32000000000000001,"5min":0.28499999999999998,"15min":0.24199999999999999},"max":{"1min":2.5510000000000002,"5min":29.021000000000001,"15min":29.021000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":2.1880000000000002,"15min":1.8979999999999999},"min":{"1min":0.378,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":2.8500000000000001,"5min":29.091999999999999,"15min":29.091999999999999},"last":0.64900000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":2.3330000000000002,"15min":1.7},"min":{"1min":0.34399999999999997,"5min":0.31,"15min":0.24299999999999999},"max":{"1min":2.8849999999999998,"5min":19.286000000000001,"15min":19.286000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":2.173,"15min":1.8640000000000001},"min":{"1min":0.42699999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":2.988,"5min":18.364000000000001,"15min":18.364000000000001},"last":0.52400000000000002}]}]},{"osd":6,"up_from":47,"seq":201863463154,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2362376,"kb_used_data":1764480,"kb_used_omap":0,"kb_used_meta":597888,"kb_avail":91382776,"statfs":{"total":95995035648,"available":93575962624,"internally_reserved":0,"allocated":1806827520,"data_stored":1805509728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":612237312},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":1.004,"15min":1.653},"min":{"1min":0.25700000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":5.7069999999999999,"5min":8.8079999999999998,"15min":45.197000000000003},"last":0.30599999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.5920000000000001,"15min":2.0070000000000001},"min":{"1min":0.252,"5min":0.23499999999999999,"15min":0.221},"max":{"1min":6.1120000000000001,"5min":6.9699999999999998,"15min":44.753},"last":0.29399999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":1.276,"15min":1.6779999999999999},"min":{"1min":0.24299999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":3.3980000000000001,"5min":8.8469999999999995,"15min":45.231999999999999},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":1.3480000000000001,"15min":1.6910000000000001},"min":{"1min":0.33200000000000002,"5min":0.245,"15min":0.23100000000000001},"max":{"1min":2.0179999999999998,"5min":7.3570000000000002,"15min":45.097999999999999},"last":0.32600000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:51:11 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.4430000000000001,"15min":1.528},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":6.1820000000000004,"5min":6.1820000000000004,"15min":6.1820000000000004},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":1.145,"15min":1.2270000000000001},"min":{"1min":0.32300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":3.258,"5min":7.8959999999999999,"15min":7.8959999999999999},"last":0.46999999999999997}]},{"osd":3,"last update":"Mon Feb 19 21:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":1.2490000000000001,"15min":1.6080000000000001},"min":{"1min":0.34000000000000002,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":3.02,"5min":8.9009999999999998,"15min":11.15},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":1.49,"15min":1.625},"min":{"1min":0.36599999999999999,"5min":0.30599999999999999,"15min":0.246},"max":{"1min":1.9770000000000001,"5min":7.3970000000000002,"15min":19.632999999999999},"last":0.40600000000000003}]},{"osd":4,"last update":"Mon Feb 19 21:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":2.0590000000000002,"15min":1.7749999999999999},"min":{"1min":0.308,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":6.1539999999999999,"5min":18.010000000000002,"15min":18.010000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":1.5529999999999999,"15min":1.716},"min":{"1min":0.28399999999999997,"5min":0.26300000000000001,"15min":0.23499999999999999},"max":{"1min":2.2919999999999998,"5min":11.566000000000001,"15min":16.594999999999999},"last":0.39700000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":1.9610000000000001,"15min":1.7909999999999999},"min":{"1min":0.315,"5min":0.27400000000000002,"15min":0.27100000000000002},"max":{"1min":6.2060000000000004,"5min":14.695,"15min":14.695},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":1.883,"15min":1.919},"min":{"1min":0.41599999999999998,"5min":0.28799999999999998,"15min":0.27900000000000003},"max":{"1min":2.4990000000000001,"5min":11.609999999999999,"15min":15.497999999999999},"last":0.374}]},{"osd":7,"last update":"Mon Feb 19 21:50:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.9339999999999999,"15min":1.8200000000000001},"min":{"1min":0.41699999999999998,"5min":0.27200000000000002,"15min":0.26700000000000002},"max":{"1min":3.3399999999999999,"5min":9.1929999999999996,"15min":14.721},"last":0.42299999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.972,"15min":1.869},"min":{"1min":0.49099999999999999,"5min":0.35599999999999998,"15min":0.32700000000000001},"max":{"1min":3.3540000000000001,"5min":9.2240000000000002,"15min":14.744999999999999},"last":0.495}]}]},{"osd":1,"up_from":13,"seq":55834575116,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1916760,"kb_used_data":1016144,"kb_used_omap":0,"kb_used_meta":900608,"kb_avail":91828392,"statfs":{"total":95995035648,"available":94032273408,"internally_reserved":0,"allocated":1040531456,"data_stored":1039198180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":922222592},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:51:19 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.95499999999999996,"15min":1.502},"min":{"1min":0.20499999999999999,"5min":0.16300000000000001,"15min":0.161},"max":{"1min":0.77600000000000002,"5min":6.2789999999999999,"15min":42.776000000000003},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.94499999999999995,"15min":1.5429999999999999},"min":{"1min":0.23300000000000001,"5min":0.193,"15min":0.16400000000000001},"max":{"1min":2.1680000000000001,"5min":6.2000000000000002,"15min":44.845999999999997},"last":0.33600000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:51:08 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.94999999999999996,"15min":1.038},"min":{"1min":0.22800000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.7270000000000001,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.89500000000000002,"15min":0.97299999999999998},"min":{"1min":0.254,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.6990000000000001,"5min":4.452,"15min":4.452},"last":0.29999999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:51:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.83999999999999997,"15min":1.6000000000000001},"min":{"1min":0.24399999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":2.2050000000000001,"5min":4.6639999999999997,"15min":41.607999999999997},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.91900000000000004,"15min":1.5249999999999999},"min":{"1min":0.28599999999999998,"5min":0.215,"15min":0.215},"max":{"1min":1.0129999999999999,"5min":4.5190000000000001,"15min":42.811999999999998},"last":0.27100000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:51:38 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":1.397,"15min":1.524},"min":{"1min":0.31900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.60899999999999999,"5min":15.853,"15min":15.853},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":1.2729999999999999,"15min":1.544},"min":{"1min":0.28100000000000003,"5min":0.28000000000000003,"15min":0.26500000000000001},"max":{"1min":1.7829999999999999,"5min":15.861000000000001,"15min":15.861000000000001},"last":0.503}]},{"osd":5,"last update":"Mon Feb 19 21:51:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":1.496,"15min":1.637},"min":{"1min":0.30199999999999999,"5min":0.29599999999999999,"15min":0.27900000000000003},"max":{"1min":1.7529999999999999,"5min":14.331,"15min":14.331},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":1.5629999999999999,"15min":1.619},"min":{"1min":0.39600000000000002,"5min":0.307,"15min":0.30099999999999999},"max":{"1min":2.2309999999999999,"5min":14.496,"15min":14.496},"last":0.51600000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:51:38 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":1.343,"15min":1.6419999999999999},"min":{"1min":0.33200000000000002,"5min":0.32300000000000001,"15min":0.30099999999999999},"max":{"1min":0.64000000000000001,"5min":10.456,"15min":11.638999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":1.282,"15min":1.762},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.29699999999999999},"max":{"1min":0.77200000000000002,"5min":9.8049999999999997,"15min":12.199},"last":0.59099999999999997}]},{"osd":7,"last update":"Mon Feb 19 21:50:56 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":1.806,"15min":1.869},"min":{"1min":0.378,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":2.2549999999999999,"5min":13.904,"15min":13.904},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":1.823,"15min":1.736},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.32600000000000001},"max":{"1min":1.881,"5min":13.894,"15min":13.894},"last":0.438}]}]},{"osd":0,"up_from":8,"seq":34359738643,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3386548,"kb_used_data":2492140,"kb_used_omap":0,"kb_used_meta":894400,"kb_avail":90358604,"statfs":{"total":95995035648,"available":92527210496,"internally_reserved":0,"allocated":2551951360,"data_stored":2550621583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":915865600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:51:11 2024","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.71799999999999997,"15min":1.1120000000000001},"min":{"1min":0.20599999999999999,"5min":0.153,"15min":0.153},"max":{"1min":0.61299999999999999,"5min":6.1550000000000002,"15min":16.478000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.97899999999999998,"15min":1.3979999999999999},"min":{"1min":0.23300000000000001,"5min":0.17899999999999999,"15min":0.17799999999999999},"max":{"1min":3.452,"5min":6.9359999999999999,"15min":13.422000000000001},"last":0.249}]},{"osd":2,"last update":"Mon Feb 19 21:51:11 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.60699999999999998,"15min":0.64300000000000002},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":2.0619999999999998,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.39700000000000002,"5min":1.0249999999999999,"15min":1.129},"min":{"1min":0.23699999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.69799999999999995,"5min":8.9960000000000004,"15min":8.9960000000000004},"last":0.20799999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:51:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":1.107,"15min":1.698},"min":{"1min":0.255,"5min":0.217,"15min":0.21299999999999999},"max":{"1min":3.2080000000000002,"5min":12.691000000000001,"15min":14.507999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.94099999999999995,"15min":1.5740000000000001},"min":{"1min":0.308,"5min":0.24099999999999999,"15min":0.23400000000000001},"max":{"1min":3.722,"5min":6.6150000000000002,"15min":18.759},"last":0.40400000000000003}]},{"osd":4,"last update":"Mon Feb 19 21:51:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":1.3859999999999999,"15min":1.6579999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.252},"max":{"1min":1.179,"5min":10.311,"15min":13.278},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":1.3009999999999999,"15min":1.5149999999999999},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1850000000000001,"5min":10.109,"15min":10.109},"last":0.373}]},{"osd":5,"last update":"Mon Feb 19 21:51:01 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":1.911,"15min":2.097},"min":{"1min":0.32500000000000001,"5min":0.317,"15min":0.27600000000000002},"max":{"1min":3.52,"5min":25.442,"15min":42.799999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":1.9139999999999999,"15min":2.097},"min":{"1min":0.33200000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.597,"5min":25.411999999999999,"15min":42.695},"last":0.39700000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:51:16 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":1.544,"15min":1.6919999999999999},"min":{"1min":0.38700000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.749,"5min":10.278,"15min":42.777000000000001},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":1.714,"15min":1.9450000000000001},"min":{"1min":0.39100000000000001,"5min":0.29599999999999999,"15min":0.28599999999999998},"max":{"1min":2.1909999999999998,"5min":11.84,"15min":13.289999999999999},"last":1.1639999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":1.6579999999999999,"15min":1.8220000000000001},"min":{"1min":0.375,"5min":0.36799999999999999,"15min":0.31},"max":{"1min":4.0049999999999999,"5min":15.688000000000001,"15min":42.758000000000003},"last":3.198},{"interface":"front","average":{"1min":0.751,"5min":1.647,"15min":1.746},"min":{"1min":0.41199999999999998,"5min":0.36399999999999999,"15min":0.33200000000000002},"max":{"1min":4.0170000000000003,"5min":10.470000000000001,"15min":42.718000000000004},"last":3.21}]}]},{"osd":2,"up_from":394,"seq":1692217114656,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2009672,"kb_used_data":1689728,"kb_used_omap":0,"kb_used_meta":319935,"kb_avail":91735480,"statfs":{"total":95995035648,"available":93937131520,"internally_reserved":0,"allocated":1730281472,"data_stored":1728979887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":327613492},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,2],"upper_bound":4096},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":1.044,"15min":1.1259999999999999},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":4.6219999999999999,"5min":9.1530000000000005,"15min":9.1530000000000005},"last":0.20300000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":1.0589999999999999,"15min":1.1679999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":2.2919999999999998,"5min":6.149,"15min":6.149},"last":0.26400000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.56699999999999995,"15min":0.60299999999999998},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.69899999999999995,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.89700000000000002,"15min":0.94399999999999995},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":4.6689999999999996,"5min":6.992,"15min":6.992},"last":0.27700000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":1.3169999999999999,"15min":1.405},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":6.0970000000000004,"5min":6.9470000000000001,"15min":6.9470000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":1.149,"15min":1.2450000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":2.258,"5min":6.6500000000000004,"15min":6.6500000000000004},"last":0.29699999999999999}]},{"osd":4,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":1.867,"15min":2.0609999999999999},"min":{"1min":0.32600000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":3.8740000000000001,"5min":7.0339999999999998,"15min":7.0339999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":1.7250000000000001,"15min":1.879},"min":{"1min":0.30299999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":4.7009999999999996,"5min":7.0419999999999998,"15min":7.0419999999999998},"last":0.39200000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.6870000000000001,"15min":1.7549999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":5.9260000000000002,"5min":10.067,"15min":10.067},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.63,"5min":1.5820000000000001,"15min":1.7410000000000001},"min":{"1min":0.34999999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":3.8730000000000002,"5min":13.558,"15min":13.558},"last":0.34599999999999997}]},{"osd":6,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":1.5600000000000001,"15min":1.6879999999999999},"min":{"1min":0.33700000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":3.843,"5min":5.6829999999999998,"15min":5.6829999999999998},"last":0.443},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.97199999999999998,"15min":1.018},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.2719999999999998,"5min":7,"15min":7},"last":0.42199999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.3740000000000001,"15min":1.427},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":4.1230000000000002,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.78000000000000003,"15min":0.82299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.67700000000000005,"5min":2.782,"15min":2.782},"last":0.38600000000000001}]}]},{"osd":3,"up_from":0,"seq":111669149954,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":32,"seq":137438953723,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3364612,"kb_used_data":2770812,"kb_used_omap":0,"kb_used_meta":593792,"kb_avail":90380540,"statfs":{"total":95995035648,"available":92549672960,"internally_reserved":0,"allocated":2837311488,"data_stored":2836005087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":608043008},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:51:33 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":1.8839999999999999,"15min":1.8939999999999999},"min":{"1min":0.221,"5min":0.219,"15min":0.219},"max":{"1min":2.1869999999999998,"5min":53.936,"15min":53.936},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.84299999999999997,"5min":2.0939999999999999,"15min":2.0720000000000001},"min":{"1min":0.252,"5min":0.23599999999999999,"15min":0.22600000000000001},"max":{"1min":2.6640000000000001,"5min":54.405999999999999,"15min":54.405999999999999},"last":0.44500000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:51:33 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":1.9790000000000001,"15min":1.7529999999999999},"min":{"1min":0.253,"5min":0.22,"15min":0.21199999999999999},"max":{"1min":2.2130000000000001,"5min":54.731000000000002,"15min":54.731000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":1.9330000000000001,"15min":1.6779999999999999},"min":{"1min":0.28299999999999997,"5min":0.252,"15min":0.25},"max":{"1min":2.903,"5min":52.490000000000002,"15min":52.490000000000002},"last":0.38800000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:51:10 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":1.77,"15min":1.974},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.274,"5min":9.0619999999999994,"15min":9.0619999999999994},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":1.8069999999999999,"15min":2.0110000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.2930000000000001,"5min":9.0899999999999999,"15min":9.0899999999999999},"last":0.34000000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:51:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":1.462,"15min":1.6899999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.464,"5min":6.5579999999999998,"15min":15.914999999999999},"last":0.434},{"interface":"front","average":{"1min":0.56399999999999995,"5min":1.4610000000000001,"15min":1.6819999999999999},"min":{"1min":0.30099999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":2.242,"5min":9.4000000000000004,"15min":13.321},"last":0.41499999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:51:25 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.9359999999999999,"15min":1.764},"min":{"1min":0.28199999999999997,"5min":0.23799999999999999,"15min":0.23400000000000001},"max":{"1min":3.02,"5min":16.731999999999999,"15min":18.916},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":1.9359999999999999,"15min":1.96},"min":{"1min":0.29599999999999999,"5min":0.26700000000000002,"15min":0.253},"max":{"1min":2.4239999999999999,"5min":8.2959999999999994,"15min":14.840999999999999},"last":0.40799999999999997}]},{"osd":6,"last update":"Mon Feb 19 21:51:33 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.7709999999999999,"15min":1.6459999999999999},"min":{"1min":0.33000000000000002,"5min":0.28999999999999998,"15min":0.28599999999999998},"max":{"1min":2.9289999999999998,"5min":9.1720000000000006,"15min":13.27},"last":0.37},{"interface":"front","average":{"1min":0.92500000000000004,"5min":2.101,"15min":1.8480000000000001},"min":{"1min":0.31900000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":2.9390000000000001,"5min":18.670000000000002,"15min":18.670000000000002},"last":0.32900000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:51:00 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":2.1309999999999998,"15min":1.7669999999999999},"min":{"1min":0.34599999999999997,"5min":0.311,"15min":0.28899999999999998},"max":{"1min":2.4780000000000002,"5min":16.763999999999999,"15min":16.763999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.63,"5min":1.71,"15min":1.6859999999999999},"min":{"1min":0.377,"5min":0.314,"15min":0.31},"max":{"1min":1.23,"5min":10.044,"15min":12.808999999999999},"last":0.46700000000000003}]}]},{"osd":5,"up_from":38,"seq":163208757495,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2618924,"kb_used_data":1736676,"kb_used_omap":0,"kb_used_meta":882240,"kb_avail":91126228,"statfs":{"total":95995035648,"available":93313257472,"internally_reserved":0,"allocated":1778356224,"data_stored":1777066190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":903413760},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":1.5169999999999999,"15min":1.7729999999999999},"min":{"1min":0.23100000000000001,"5min":0.214,"15min":0.20599999999999999},"max":{"1min":5.9550000000000001,"5min":19.236000000000001,"15min":20.550999999999998},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":1.4850000000000001,"15min":1.9059999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.20899999999999999},"max":{"1min":3.7949999999999999,"5min":10.887,"15min":20.879000000000001},"last":0.26500000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":1.462,"15min":1.726},"min":{"1min":0.28100000000000003,"5min":0.24299999999999999,"15min":0.23100000000000001},"max":{"1min":2.3220000000000001,"5min":8.2010000000000005,"15min":10.42},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":1.506,"15min":1.6100000000000001},"min":{"1min":0.28299999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.522,"5min":10.965,"15min":10.965},"last":1.1080000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.29,"15min":1.361},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":7.0380000000000003,"5min":7.0380000000000003,"15min":7.0380000000000003},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.2450000000000001,"15min":1.29},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.1869999999999998,"5min":4.2619999999999996,"15min":4.2619999999999996},"last":0.31900000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":1.804,"15min":2.0779999999999998},"min":{"1min":0.35099999999999998,"5min":0.26100000000000001,"15min":0.24099999999999999},"max":{"1min":3.6320000000000001,"5min":19.321000000000002,"15min":20.146999999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.5169999999999999,"15min":2.1520000000000001},"min":{"1min":0.33600000000000002,"5min":0.311,"15min":0.29499999999999998},"max":{"1min":3.6400000000000001,"5min":8.0359999999999996,"15min":20.120000000000001},"last":0.36599999999999999}]},{"osd":4,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":1.4239999999999999,"15min":1.393},"min":{"1min":0.255,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.0449999999999999,"5min":16.643999999999998,"15min":21.577000000000002},"last":1.054},{"interface":"front","average":{"1min":0.59799999999999998,"5min":1.913,"15min":1.883},"min":{"1min":0.32600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.3999999999999999,"5min":19.274000000000001,"15min":19.274000000000001},"last":0.376}]},{"osd":6,"last update":"Mon Feb 19 21:51:33 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":2.0529999999999999,"15min":1.9259999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.221},"max":{"1min":5.8819999999999997,"5min":19.884,"15min":19.884},"last":1.758},{"interface":"front","average":{"1min":0.66800000000000004,"5min":1.6799999999999999,"15min":1.8660000000000001},"min":{"1min":0.30199999999999999,"5min":0.26700000000000002,"15min":0.23599999999999999},"max":{"1min":2.1099999999999999,"5min":10.260999999999999,"15min":13.532999999999999},"last":1.5289999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:50:54 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":2.129,"15min":2.0249999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.27100000000000002},"max":{"1min":2.4900000000000002,"5min":12.611000000000001,"15min":12.962},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.626,"5min":2.024,"15min":1.8360000000000001},"min":{"1min":0.38100000000000001,"5min":0.221,"15min":0.221},"max":{"1min":1.681,"5min":15.593999999999999,"15min":17.759},"last":1.0880000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2545291264,"data_stored":2545287192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1033502720,"data_stored":1033502720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1724841984,"data_stored":1724841984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2830766080,"data_stored":2830762008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1772748800,"data_stored":1772748800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1800474624,"data_stored":1800470552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":835059712,"data_stored":835059712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:51:51.922 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:51:51.985 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:51:52.015 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:52.071 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:51:52.079 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:52.079 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:51:52.181 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:51:52.209 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:50.250356+0000 mgr.y (mgr.14514) 734 : audit [DBG] from='client.15861 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:51:52.209 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:51.044749+0000 mgr.y (mgr.14514) 735 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:51:52.209 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:50.250356+0000 mgr.y (mgr.14514) 734 : audit [DBG] from='client.15861 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:51:52.209 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:51.044749+0000 mgr.y (mgr.14514) 735 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:51:52.211 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:52.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:50.250356+0000 mgr.y (mgr.14514) 734 : audit [DBG] from='client.15861 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:51:52.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:51.044749+0000 mgr.y (mgr.14514) 735 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:51:52.417 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:51:52.420 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:52.420 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:51:52.521 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:51:52.545 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-19T21:51:52.546 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:52.568 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:51:52.571 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:52.572 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:51:52.672 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:51:52.699 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:52.722 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:51:52.729 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:52.730 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:51:52.831 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:51:52.855 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:52.881 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:51:52.883 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:52.883 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:51:52.984 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:51:53.015 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:53.038 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:51:53.040 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:53.041 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:51:53.142 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:51:53.170 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:51.197717+0000 mgr.y (mgr.14514) 736 : cluster [DBG] pgmap v958: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.8 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 189 op/s; 1078/186699 objects degraded (0.577%); 6508/186699 objects misplaced (3.486%); 2.6 MiB/s, 41 objects/s recovering 2024-02-19T21:51:53.171 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:51.197717+0000 mgr.y (mgr.14514) 736 : cluster [DBG] pgmap v958: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.8 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 189 op/s; 1078/186699 objects degraded (0.577%); 6508/186699 objects misplaced (3.486%); 2.6 MiB/s, 41 objects/s recovering 2024-02-19T21:51:53.174 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:53.303 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:51:53.305 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:51.197717+0000 mgr.y (mgr.14514) 736 : cluster [DBG] pgmap v958: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.8 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 189 op/s; 1078/186699 objects degraded (0.577%); 6508/186699 objects misplaced (3.486%); 2.6 MiB/s, 41 objects/s recovering 2024-02-19T21:51:53.306 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:53.307 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:51:53.408 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:51:53.433 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:53.458 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:51:53.464 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:53.464 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:51:53.565 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:51:53.592 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:53.603 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:51:53.613 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:51:53.615 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:53.616 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:51:53.624 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:51:53.634 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:51:53.646 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:51:53.670 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:51:53.691 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:51:53.709 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:51:53.717 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:51:53.729 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:51:53.748 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:53.761 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:51:53.763 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:51:53.763 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:51:53.763 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:51:53.763 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:51:53.763 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:51:53.763 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:51:53.763 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:51:53.763 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:51:54.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:53.198140+0000 mgr.y (mgr.14514) 737 : cluster [DBG] pgmap v959: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.8 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 131 op/s; 1019/186387 objects degraded (0.547%); 6450/186387 objects misplaced (3.461%); 1.8 MiB/s, 28 objects/s recovering 2024-02-19T21:51:54.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:53.575688+0000 mon.a (mon.0) 1771 : audit [DBG] from='client.? 172.21.15.80:0/720759352' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:51:54.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:53.198140+0000 mgr.y (mgr.14514) 737 : cluster [DBG] pgmap v959: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.8 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 131 op/s; 1019/186387 objects degraded (0.547%); 6450/186387 objects misplaced (3.461%); 1.8 MiB/s, 28 objects/s recovering 2024-02-19T21:51:54.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:53.575688+0000 mon.a (mon.0) 1771 : audit [DBG] from='client.? 172.21.15.80:0/720759352' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:51:54.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:53.198140+0000 mgr.y (mgr.14514) 737 : cluster [DBG] pgmap v959: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.8 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 131 op/s; 1019/186387 objects degraded (0.547%); 6450/186387 objects misplaced (3.461%); 1.8 MiB/s, 28 objects/s recovering 2024-02-19T21:51:54.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:53.575688+0000 mon.a (mon.0) 1771 : audit [DBG] from='client.? 172.21.15.80:0/720759352' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:51:54.701 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:51:54.704 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:54.704 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:51:54.805 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:51:54.831 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:54.856 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:51:54.858 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:54.859 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:51:54.905 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:51:54.959 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:51:54.998 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:55.024 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:51:55.027 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:55.027 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:51:55.128 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:51:55.158 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:55.190 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:51:55.195 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:55.195 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:51:55.296 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:51:55.333 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:55.987 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:51:55.995 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:55.995 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:51:56.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:51:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:51:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:51:56.096 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:51:56.125 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:56.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:54.806839+0000 osd.5 (osd.5) 269 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:51:56.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:54.806888+0000 osd.5 (osd.5) 270 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:51:56.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:54.906451+0000 osd.0 (osd.0) 269 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:51:56.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:54.906505+0000 osd.0 (osd.0) 270 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:51:56.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:55.063906+0000 mon.a (mon.0) 1772 : cluster [DBG] osdmap e457: 8 total, 8 up, 7 in 2024-02-19T21:51:56.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:55.198681+0000 mgr.y (mgr.14514) 738 : cluster [DBG] pgmap v961: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.8 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 206 op/s; 960/185043 objects degraded (0.519%); 6450/185043 objects misplaced (3.486%); 2.4 MiB/s, 38 objects/s recovering 2024-02-19T21:51:56.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:55.301636+0000 mon.a (mon.0) 1773 : cluster [WRN] Health check update: Degraded data redundancy: 1019/186387 objects degraded (0.547%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:56.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:55.310348+0000 mon.a (mon.0) 1774 : cluster [DBG] osdmap e458: 8 total, 8 up, 7 in 2024-02-19T21:51:56.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:54.806839+0000 osd.5 (osd.5) 269 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:51:56.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:54.806888+0000 osd.5 (osd.5) 270 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:51:56.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:54.906451+0000 osd.0 (osd.0) 269 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:51:56.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:54.906505+0000 osd.0 (osd.0) 270 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:51:56.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:55.063906+0000 mon.a (mon.0) 1772 : cluster [DBG] osdmap e457: 8 total, 8 up, 7 in 2024-02-19T21:51:56.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:55.198681+0000 mgr.y (mgr.14514) 738 : cluster [DBG] pgmap v961: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.8 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 206 op/s; 960/185043 objects degraded (0.519%); 6450/185043 objects misplaced (3.486%); 2.4 MiB/s, 38 objects/s recovering 2024-02-19T21:51:56.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:55.301636+0000 mon.a (mon.0) 1773 : cluster [WRN] Health check update: Degraded data redundancy: 1019/186387 objects degraded (0.547%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:56.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:55.310348+0000 mon.a (mon.0) 1774 : cluster [DBG] osdmap e458: 8 total, 8 up, 7 in 2024-02-19T21:51:56.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:54.806839+0000 osd.5 (osd.5) 269 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:51:56.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:54.806888+0000 osd.5 (osd.5) 270 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:51:56.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:54.906451+0000 osd.0 (osd.0) 269 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:51:56.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:54.906505+0000 osd.0 (osd.0) 270 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:51:56.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:55.063906+0000 mon.a (mon.0) 1772 : cluster [DBG] osdmap e457: 8 total, 8 up, 7 in 2024-02-19T21:51:56.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:55.198681+0000 mgr.y (mgr.14514) 738 : cluster [DBG] pgmap v961: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.8 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 206 op/s; 960/185043 objects degraded (0.519%); 6450/185043 objects misplaced (3.486%); 2.4 MiB/s, 38 objects/s recovering 2024-02-19T21:51:56.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:55.301636+0000 mon.a (mon.0) 1773 : cluster [WRN] Health check update: Degraded data redundancy: 1019/186387 objects degraded (0.547%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:51:56.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:55.310348+0000 mon.a (mon.0) 1774 : cluster [DBG] osdmap e458: 8 total, 8 up, 7 in 2024-02-19T21:51:56.580 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:51:56.596 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:56.596 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:51:56.697 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:51:56.728 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:57.077 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:51:57.081 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:57.081 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:51:57.182 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:51:57.209 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:57.235 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:51:57.237 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:57.237 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:51:57.338 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:51:57.372 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:57.624 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:51:57.630 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:57.630 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:51:57.731 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:51:57.746 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:51:57.747 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-02-19T21:51:57.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-02-19T21:51:57.747 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-02-19T21:51:57.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.747 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:235482 8.f 8:f3984343:::benchmark_data_smithi080_100924_object107764:head [delete] snapc 0=[] ondisk+write+known_if_redirected e241)", 2024-02-19T21:51:57.747 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:19.735518+0000", 2024-02-19T21:51:57.747 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 517.095928878, 2024-02-19T21:51:57.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.076482130999999995, 2024-02-19T21:51:57.747 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:51:57.747 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:51:57.747 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:51:57.747 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:51:57.747 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:51:57.748 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 235482 2024-02-19T21:51:57.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.748 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:51:57.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:51:57.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.735518+0000", 2024-02-19T21:51:57.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:51:57.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:51:57.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.735518+0000", 2024-02-19T21:51:57.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:51:57.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:51:57.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.735516+0000", 2024-02-19T21:51:57.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6100000000000002e-06 2024-02-19T21:51:57.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:51:57.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.735523+0000", 2024-02-19T21:51:57.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5580000000000001e-06 2024-02-19T21:51:57.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:51:57.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.735531+0000", 2024-02-19T21:51:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0800000000000002e-06 2024-02-19T21:51:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:51:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.735537+0000", 2024-02-19T21:51:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5188000000000003e-05 2024-02-19T21:51:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:51:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.735573+0000", 2024-02-19T21:51:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010925900000000001 2024-02-19T21:51:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:51:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.735682+0000", 2024-02-19T21:51:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3877999999999999e-05 2024-02-19T21:51:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,4", 2024-02-19T21:51:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.735766+0000", 2024-02-19T21:51:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041532189999999997 2024-02-19T21:51:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:51:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.739919+0000", 2024-02-19T21:51:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0077197749999999999 2024-02-19T21:51:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:51:57.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.747639+0000", 2024-02-19T21:51:57.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.064284648999999999 2024-02-19T21:51:57.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:51:57.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.811923+0000", 2024-02-19T21:51:57.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0442999999999999e-05 2024-02-19T21:51:57.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:51:57.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.811964+0000", 2024-02-19T21:51:57.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6108000000000001e-05 2024-02-19T21:51:57.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:51:57.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.812000+0000", 2024-02-19T21:51:57.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.076482130999999995 2024-02-19T21:51:57.753 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.753 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:51:57.753 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.753 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:235487 8.f 8:f5fa13c3:::benchmark_data_smithi080_100924_object107769:head [delete] snapc 0=[] ondisk+write+known_if_redirected e241)", 2024-02-19T21:51:57.753 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:19.740324+0000", 2024-02-19T21:51:57.753 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 517.09112299699996, 2024-02-19T21:51:57.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.076233601999999998, 2024-02-19T21:51:57.754 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:51:57.754 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:51:57.754 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:51:57.754 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:51:57.754 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:51:57.754 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 235487 2024-02-19T21:51:57.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.754 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:51:57.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.754 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:51:57.754 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740324+0000", 2024-02-19T21:51:57.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:51:57.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.754 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:51:57.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740324+0000", 2024-02-19T21:51:57.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:51:57.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:51:57.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740322+0000", 2024-02-19T21:51:57.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8430000000000004e-06 2024-02-19T21:51:57.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:51:57.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740329+0000", 2024-02-19T21:51:57.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1077000000000001e-05 2024-02-19T21:51:57.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:51:57.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740340+0000", 2024-02-19T21:51:57.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2260000000000002e-06 2024-02-19T21:51:57.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:51:57.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740346+0000", 2024-02-19T21:51:57.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5266000000000003e-05 2024-02-19T21:51:57.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:51:57.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740392+0000", 2024-02-19T21:51:57.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7865e-05 2024-02-19T21:51:57.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:51:57.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740479+0000", 2024-02-19T21:51:57.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5932000000000003e-05 2024-02-19T21:51:57.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,4", 2024-02-19T21:51:57.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740565+0000", 2024-02-19T21:51:57.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010454463000000001 2024-02-19T21:51:57.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:51:57.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.751020+0000", 2024-02-19T21:51:57.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.061026550999999998 2024-02-19T21:51:57.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:51:57.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.812046+0000", 2024-02-19T21:51:57.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044331300000000004 2024-02-19T21:51:57.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:51:57.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.816480+0000", 2024-02-19T21:51:57.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2168e-05 2024-02-19T21:51:57.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:51:57.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.816522+0000", 2024-02-19T21:51:57.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5574000000000002e-05 2024-02-19T21:51:57.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:51:57.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.816557+0000", 2024-02-19T21:51:57.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.076233601999999998 2024-02-19T21:51:57.759 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.759 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:51:57.759 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.759 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:235489 8.f 8:f3d3122d:::benchmark_data_smithi080_100924_object107771:head [delete] snapc 0=[] ondisk+write+known_if_redirected e241)", 2024-02-19T21:51:57.759 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:19.740404+0000", 2024-02-19T21:51:57.760 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 517.09104225900001, 2024-02-19T21:51:57.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.093998154, 2024-02-19T21:51:57.760 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:51:57.760 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:51:57.760 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:51:57.760 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:51:57.760 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:51:57.760 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 235489 2024-02-19T21:51:57.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.760 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:51:57.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:51:57.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740404+0000", 2024-02-19T21:51:57.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:51:57.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:51:57.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740404+0000", 2024-02-19T21:51:57.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:51:57.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:51:57.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740404+0000", 2024-02-19T21:51:57.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5269999999999998e-06 2024-02-19T21:51:57.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:51:57.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740409+0000", 2024-02-19T21:51:57.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9100000000000005e-06 2024-02-19T21:51:57.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:51:57.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740417+0000", 2024-02-19T21:51:57.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1329999999999998e-06 2024-02-19T21:51:57.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:51:57.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.740422+0000", 2024-02-19T21:51:57.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036111979999999999 2024-02-19T21:51:57.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:51:57.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.744033+0000", 2024-02-19T21:51:57.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9303999999999998e-05 2024-02-19T21:51:57.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:51:57.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.744113+0000", 2024-02-19T21:51:57.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4865999999999998e-05 2024-02-19T21:51:57.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,4", 2024-02-19T21:51:57.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.744187+0000", 2024-02-19T21:51:57.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.067660415000000002 2024-02-19T21:51:57.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:51:57.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.811848+0000", 2024-02-19T21:51:57.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000227402 2024-02-19T21:51:57.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:51:57.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.812075+0000", 2024-02-19T21:51:57.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022250261 2024-02-19T21:51:57.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:51:57.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.834326+0000", 2024-02-19T21:51:57.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8209e-05 2024-02-19T21:51:57.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:51:57.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.834364+0000", 2024-02-19T21:51:57.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8825999999999997e-05 2024-02-19T21:51:57.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:51:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.834403+0000", 2024-02-19T21:51:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.093998154 2024-02-19T21:51:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:51:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:235493 8.f 8:f0c207d7:::benchmark_data_smithi080_100924_object107775:head [delete] snapc 0=[] ondisk+write+known_if_redirected e241)", 2024-02-19T21:51:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:19.743619+0000", 2024-02-19T21:51:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 517.08782773300004, 2024-02-19T21:51:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.090895461999999996, 2024-02-19T21:51:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:51:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:51:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:51:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:51:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:51:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 235493 2024-02-19T21:51:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:51:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:51:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.743619+0000", 2024-02-19T21:51:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:51:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:51:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.743619+0000", 2024-02-19T21:51:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:51:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:51:57.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.743618+0000", 2024-02-19T21:51:57.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0349999999999998e-06 2024-02-19T21:51:57.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:51:57.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.743624+0000", 2024-02-19T21:51:57.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0088999999999999e-05 2024-02-19T21:51:57.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:51:57.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.743634+0000", 2024-02-19T21:51:57.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5159999999999996e-06 2024-02-19T21:51:57.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:51:57.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.743638+0000", 2024-02-19T21:51:57.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040161190000000003 2024-02-19T21:51:57.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:51:57.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.747654+0000", 2024-02-19T21:51:57.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6434000000000006e-05 2024-02-19T21:51:57.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:51:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.747741+0000", 2024-02-19T21:51:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3380000000000006e-05 2024-02-19T21:51:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,4", 2024-02-19T21:51:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.747814+0000", 2024-02-19T21:51:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.064193940000000005 2024-02-19T21:51:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:51:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.812008+0000", 2024-02-19T21:51:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010293600000000001 2024-02-19T21:51:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:51:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.812111+0000", 2024-02-19T21:51:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022349099000000001 2024-02-19T21:51:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:51:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.834460+0000", 2024-02-19T21:51:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3632999999999999e-05 2024-02-19T21:51:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:51:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.834484+0000", 2024-02-19T21:51:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0474999999999999e-05 2024-02-19T21:51:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.772 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:51:57.772 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.834514+0000", 2024-02-19T21:51:57.772 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.090895461999999996 2024-02-19T21:51:57.772 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.772 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:51:57.772 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.772 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:235496 8.f 8:fe6f0e29:::benchmark_data_smithi080_100924_object107778:head [delete] snapc 0=[] ondisk+write+known_if_redirected e241)", 2024-02-19T21:51:57.772 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:19.745275+0000", 2024-02-19T21:51:57.772 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 517.08617196800003, 2024-02-19T21:51:57.772 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.099441477, 2024-02-19T21:51:57.772 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:51:57.772 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:51:57.773 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:51:57.773 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:51:57.773 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:51:57.773 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 235496 2024-02-19T21:51:57.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.773 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:51:57.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:51:57.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.745275+0000", 2024-02-19T21:51:57.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:51:57.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:51:57.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.745275+0000", 2024-02-19T21:51:57.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:51:57.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:51:57.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.745274+0000", 2024-02-19T21:51:57.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0380000000000002e-06 2024-02-19T21:51:57.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:51:57.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.745281+0000", 2024-02-19T21:51:57.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1302e-05 2024-02-19T21:51:57.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:51:57.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.745292+0000", 2024-02-19T21:51:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9379999999999997e-06 2024-02-19T21:51:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:51:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.745298+0000", 2024-02-19T21:51:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057582229999999998 2024-02-19T21:51:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:51:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.751056+0000", 2024-02-19T21:51:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121988 2024-02-19T21:51:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:51:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.751178+0000", 2024-02-19T21:51:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000122376 2024-02-19T21:51:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,4", 2024-02-19T21:51:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.751300+0000", 2024-02-19T21:51:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.060712954999999999 2024-02-19T21:51:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:51:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.812013+0000", 2024-02-19T21:51:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018012799999999999 2024-02-19T21:51:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.777 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:51:57.777 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.812194+0000", 2024-02-19T21:51:57.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.032426737999999997 2024-02-19T21:51:57.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.777 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:51:57.777 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.844620+0000", 2024-02-19T21:51:57.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2571999999999997e-05 2024-02-19T21:51:57.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.777 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:51:57.777 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.844673+0000", 2024-02-19T21:51:57.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3309999999999997e-05 2024-02-19T21:51:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:51:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.844716+0000", 2024-02-19T21:51:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.099441477 2024-02-19T21:51:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:51:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24932.0:235497 8.f 8:f9f5de8e:::benchmark_data_smithi080_100924_object107779:head [delete] snapc 0=[] ondisk+write+known_if_redirected e241)", 2024-02-19T21:51:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:43:19.745352+0000", 2024-02-19T21:51:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 517.08609422400002, 2024-02-19T21:51:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.099468952999999999, 2024-02-19T21:51:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:51:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:51:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:51:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24932", 2024-02-19T21:51:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3775832129", 2024-02-19T21:51:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 235497 2024-02-19T21:51:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:51:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:51:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.745352+0000", 2024-02-19T21:51:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:51:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:51:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.745352+0000", 2024-02-19T21:51:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:51:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:51:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.745352+0000", 2024-02-19T21:51:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0260000000000001e-06 2024-02-19T21:51:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:51:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.745356+0000", 2024-02-19T21:51:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5490000000000001e-06 2024-02-19T21:51:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:51:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.745363+0000", 2024-02-19T21:51:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3499999999999999e-06 2024-02-19T21:51:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:51:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.745368+0000", 2024-02-19T21:51:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.061193284000000001 2024-02-19T21:51:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:51:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.806561+0000", 2024-02-19T21:51:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013749199999999999 2024-02-19T21:51:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:51:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.806699+0000", 2024-02-19T21:51:57.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013396299999999999 2024-02-19T21:51:57.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1,4", 2024-02-19T21:51:57.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.806832+0000", 2024-02-19T21:51:57.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066065960000000002 2024-02-19T21:51:57.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:51:57.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.813439+0000", 2024-02-19T21:51:57.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061247369999999999 2024-02-19T21:51:57.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:51:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.819564+0000", 2024-02-19T21:51:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025191222999999999 2024-02-19T21:51:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:51:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.844755+0000", 2024-02-19T21:51:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4584e-05 2024-02-19T21:51:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:51:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.844790+0000", 2024-02-19T21:51:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1770000000000002e-05 2024-02-19T21:51:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:51:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:43:19.844821+0000", 2024-02-19T21:51:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.099468952999999999 2024-02-19T21:51:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:51:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.15345.0:216535 9.1 e357/356 9:86425105:::benchmark_data_smithi080_126364_object87943:head v 357'13463, mlcod=0'0)", 2024-02-19T21:51:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:34.581319+0000", 2024-02-19T21:51:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 262.25012766499998, 2024-02-19T21:51:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.045199969999999999, 2024-02-19T21:51:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:51:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:51:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:51:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:51:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.581319+0000", 2024-02-19T21:51:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:51:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:51:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.581319+0000", 2024-02-19T21:51:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:51:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:51:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.581318+0000", 2024-02-19T21:51:57.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9010000000000006e-06 2024-02-19T21:51:57.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:51:57.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.581328+0000", 2024-02-19T21:51:57.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.279e-05 2024-02-19T21:51:57.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:51:57.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.581341+0000", 2024-02-19T21:51:57.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3409999999999999e-06 2024-02-19T21:51:57.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:51:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.581347+0000", 2024-02-19T21:51:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5249e-05 2024-02-19T21:51:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:51:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.581392+0000", 2024-02-19T21:51:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7216000000000002e-05 2024-02-19T21:51:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:51:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.581419+0000", 2024-02-19T21:51:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.045052944999999997 2024-02-19T21:51:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:51:57.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.626472+0000", 2024-02-19T21:51:57.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6618e-05 2024-02-19T21:51:57.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:51:57.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.626519+0000", 2024-02-19T21:51:57.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.045199969999999999 2024-02-19T21:51:57.788 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.788 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:51:57.788 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.15345.0:216729 9.4 e357/356 9:26c2aae2:::benchmark_data_smithi080_126364_object88137:head v 357'13560, mlcod=357'13556)", 2024-02-19T21:51:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:34.708917+0000", 2024-02-19T21:51:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 262.12252938199998, 2024-02-19T21:51:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011938447, 2024-02-19T21:51:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:51:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:51:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:51:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:51:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.708917+0000", 2024-02-19T21:51:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:51:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:51:57.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.708917+0000", 2024-02-19T21:51:57.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:51:57.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:51:57.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.708917+0000", 2024-02-19T21:51:57.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2790000000000004e-06 2024-02-19T21:51:57.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:51:57.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.708923+0000", 2024-02-19T21:51:57.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6589999999999996e-06 2024-02-19T21:51:57.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:51:57.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.708932+0000", 2024-02-19T21:51:57.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2289999999999997e-06 2024-02-19T21:51:57.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:51:57.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.708936+0000", 2024-02-19T21:51:57.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038092099999999999 2024-02-19T21:51:57.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:51:57.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.712745+0000", 2024-02-19T21:51:57.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8839999999999998e-05 2024-02-19T21:51:57.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:51:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.712774+0000", 2024-02-19T21:51:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0080374160000000004 2024-02-19T21:51:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:51:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.720811+0000", 2024-02-19T21:51:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4450000000000003e-05 2024-02-19T21:51:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:51:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.720856+0000", 2024-02-19T21:51:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011938447 2024-02-19T21:51:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:51:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.15345.0:225737 9.4 e362/356 9:2a3c6b5d:::benchmark_data_smithi080_126364_object97145:head v 362'14161, mlcod=361'14159)", 2024-02-19T21:51:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:45.267876+0000", 2024-02-19T21:51:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 251.56357100100001, 2024-02-19T21:51:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.038394027999999997, 2024-02-19T21:51:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:51:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:51:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:51:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:51:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.267876+0000", 2024-02-19T21:51:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:51:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:51:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.267876+0000", 2024-02-19T21:51:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:51:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:51:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.267874+0000", 2024-02-19T21:51:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4468e-05 2024-02-19T21:51:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:51:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.267899+0000", 2024-02-19T21:51:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3504000000000001e-05 2024-02-19T21:51:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:51:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.267922+0000", 2024-02-19T21:51:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5440000000000001e-06 2024-02-19T21:51:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:51:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.267930+0000", 2024-02-19T21:51:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9568000000000003e-05 2024-02-19T21:51:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:51:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.267989+0000", 2024-02-19T21:51:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9712e-05 2024-02-19T21:51:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:51:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.268009+0000", 2024-02-19T21:51:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.038208863000000003 2024-02-19T21:51:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:51:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.306218+0000", 2024-02-19T21:51:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1802000000000003e-05 2024-02-19T21:51:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:51:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.306270+0000", 2024-02-19T21:51:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.038394027999999997 2024-02-19T21:51:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:51:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.15345.0:225735 9.1 e362/356 9:84bfd385:::benchmark_data_smithi080_126364_object97143:head v 362'14000, mlcod=361'13998)", 2024-02-19T21:51:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:45.268417+0000", 2024-02-19T21:51:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 251.56302981900001, 2024-02-19T21:51:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.041499975000000001, 2024-02-19T21:51:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:51:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:51:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:51:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:51:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.268417+0000", 2024-02-19T21:51:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:51:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:51:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.268417+0000", 2024-02-19T21:51:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:51:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:51:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.268417+0000", 2024-02-19T21:51:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2019999999999997e-06 2024-02-19T21:51:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:51:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.268421+0000", 2024-02-19T21:51:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2697999999999999e-05 2024-02-19T21:51:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:51:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.268433+0000", 2024-02-19T21:51:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4759999999999997e-06 2024-02-19T21:51:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:51:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.268439+0000", 2024-02-19T21:51:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1921000000000003e-05 2024-02-19T21:51:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:51:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.268531+0000", 2024-02-19T21:51:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0839000000000002e-05 2024-02-19T21:51:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:51:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.268552+0000", 2024-02-19T21:51:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.041312763000000002 2024-02-19T21:51:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:51:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.309864+0000", 2024-02-19T21:51:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2336000000000002e-05 2024-02-19T21:51:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:51:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.309917+0000", 2024-02-19T21:51:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.041499975000000001 2024-02-19T21:51:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:51:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.15345.0:228828 9.1 e364/356 9:8a1f5058:::benchmark_data_smithi080_126364_object100236:head v 364'14198, mlcod=364'14196)", 2024-02-19T21:51:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:50.250828+0000", 2024-02-19T21:51:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 246.580618684, 2024-02-19T21:51:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.03925472, 2024-02-19T21:51:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:51:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:51:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:51:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:51:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:50.250828+0000", 2024-02-19T21:51:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:51:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:51:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:50.250828+0000", 2024-02-19T21:51:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:51:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:51:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:50.250826+0000", 2024-02-19T21:51:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5401e-05 2024-02-19T21:51:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:51:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:50.250842+0000", 2024-02-19T21:51:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9510000000000001e-05 2024-02-19T21:51:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:51:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:50.250861+0000", 2024-02-19T21:51:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9449999999999999e-06 2024-02-19T21:51:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:51:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:50.250870+0000", 2024-02-19T21:51:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4363999999999997e-05 2024-02-19T21:51:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:51:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:50.250914+0000", 2024-02-19T21:51:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2359000000000001e-05 2024-02-19T21:51:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:51:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:50.250937+0000", 2024-02-19T21:51:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.039103493000000003 2024-02-19T21:51:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:51:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:50.290040+0000", 2024-02-19T21:51:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2527999999999997e-05 2024-02-19T21:51:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:51:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:50.290083+0000", 2024-02-19T21:51:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.03925472 2024-02-19T21:51:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:51:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.15345.0:236714 9.1 e366/356 9:8e47f73b:::benchmark_data_smithi080_126364_object108122:head v 366'14685, mlcod=366'14683)", 2024-02-19T21:51:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:58.903624+0000", 2024-02-19T21:51:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 237.927823144, 2024-02-19T21:51:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012843795999999999, 2024-02-19T21:51:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:51:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:51:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:51:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:51:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:58.903624+0000", 2024-02-19T21:51:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:51:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:51:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:58.903624+0000", 2024-02-19T21:51:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:51:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:51:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:58.903622+0000", 2024-02-19T21:51:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3278999999999999e-05 2024-02-19T21:51:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:51:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:58.903635+0000", 2024-02-19T21:51:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9743000000000001e-05 2024-02-19T21:51:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:51:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:58.903655+0000", 2024-02-19T21:51:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4079999999999998e-06 2024-02-19T21:51:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:51:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:58.903663+0000", 2024-02-19T21:51:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043335530000000004 2024-02-19T21:51:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:51:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:58.907997+0000", 2024-02-19T21:51:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6925000000000001e-05 2024-02-19T21:51:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:51:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:58.908024+0000", 2024-02-19T21:51:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0083939389999999996 2024-02-19T21:51:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:51:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:58.916418+0000", 2024-02-19T21:51:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9438000000000003e-05 2024-02-19T21:51:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:51:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:58.916467+0000", 2024-02-19T21:51:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012843795999999999 2024-02-19T21:51:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:51:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.15345.0:238456 9.1 e368/356 9:86059f54:::benchmark_data_smithi080_126364_object109864:head v 368'14795, mlcod=368'14792)", 2024-02-19T21:51:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:48:00.881504+0000", 2024-02-19T21:51:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 235.949942674, 2024-02-19T21:51:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013221261999999999, 2024-02-19T21:51:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:51:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:51:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:51:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:51:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.881504+0000", 2024-02-19T21:51:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:51:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:51:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.881504+0000", 2024-02-19T21:51:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:51:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:51:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.881503+0000", 2024-02-19T21:51:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2939999999999994e-06 2024-02-19T21:51:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:51:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.881512+0000", 2024-02-19T21:51:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1895999999999999e-05 2024-02-19T21:51:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:51:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.881524+0000", 2024-02-19T21:51:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1999999999999997e-06 2024-02-19T21:51:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:51:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.881531+0000", 2024-02-19T21:51:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013258500000000001 2024-02-19T21:51:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:51:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.881664+0000", 2024-02-19T21:51:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7206e-05 2024-02-19T21:51:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:51:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.881691+0000", 2024-02-19T21:51:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012982845 2024-02-19T21:51:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:51:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.894674+0000", 2024-02-19T21:51:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1326999999999998e-05 2024-02-19T21:51:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:51:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.894725+0000", 2024-02-19T21:51:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013221261999999999 2024-02-19T21:51:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:51:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.15345.0:238459 9.1 e368/356 9:85c80d03:::benchmark_data_smithi080_126364_object109867:head v 368'14796, mlcod=368'14792)", 2024-02-19T21:51:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:48:00.885137+0000", 2024-02-19T21:51:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 235.946309695, 2024-02-19T21:51:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012069962, 2024-02-19T21:51:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:51:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:51:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:51:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:51:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.885137+0000", 2024-02-19T21:51:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:51:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:51:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.885137+0000", 2024-02-19T21:51:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:51:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:51:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.885135+0000", 2024-02-19T21:51:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1525000000000001e-05 2024-02-19T21:51:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:51:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.885147+0000", 2024-02-19T21:51:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6348e-05 2024-02-19T21:51:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:51:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.885163+0000", 2024-02-19T21:51:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1219999999999997e-06 2024-02-19T21:51:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:51:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.885170+0000", 2024-02-19T21:51:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6227999999999999e-05 2024-02-19T21:51:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:51:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.885217+0000", 2024-02-19T21:51:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7410999999999999e-05 2024-02-19T21:51:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:51:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.885244+0000", 2024-02-19T21:51:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011914381 2024-02-19T21:51:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:51:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.897158+0000", 2024-02-19T21:51:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8491e-05 2024-02-19T21:51:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:51:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.897207+0000", 2024-02-19T21:51:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012069962 2024-02-19T21:51:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:51:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.15345.0:238466 9.1 e368/356 9:811cb4da:::benchmark_data_smithi080_126364_object109874:head v 368'14797, mlcod=368'14792)", 2024-02-19T21:51:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:48:00.885181+0000", 2024-02-19T21:51:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 235.946266057, 2024-02-19T21:51:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012048143000000001, 2024-02-19T21:51:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:51:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:51:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:51:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:51:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.885181+0000", 2024-02-19T21:51:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:51:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:51:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.885181+0000", 2024-02-19T21:51:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:51:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:51:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.885180+0000", 2024-02-19T21:51:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5519999999999998e-06 2024-02-19T21:51:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:51:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.885185+0000", 2024-02-19T21:51:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4940000000000003e-06 2024-02-19T21:51:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:51:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.885190+0000", 2024-02-19T21:51:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2540000000000001e-06 2024-02-19T21:51:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:51:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.885194+0000", 2024-02-19T21:51:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025691910000000002 2024-02-19T21:51:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:51:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.887763+0000", 2024-02-19T21:51:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6983000000000001e-05 2024-02-19T21:51:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:51:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.887800+0000", 2024-02-19T21:51:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0094106959999999996 2024-02-19T21:51:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:51:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.897210+0000", 2024-02-19T21:51:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8278e-05 2024-02-19T21:51:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:51:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:00.897229+0000", 2024-02-19T21:51:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012048143000000001 2024-02-19T21:51:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:51:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.15345.0:254431 9.1 e376/370 9:8d2c3524:::benchmark_data_smithi080_126364_object125839:head v 376'15837, mlcod=376'15834)", 2024-02-19T21:51:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:48:16.516515+0000", 2024-02-19T21:51:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 220.31493128899999, 2024-02-19T21:51:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011772919999999999, 2024-02-19T21:51:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:51:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:51:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:51:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:51:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:16.516515+0000", 2024-02-19T21:51:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:51:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:51:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:16.516515+0000", 2024-02-19T21:51:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:51:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:51:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:16.516514+0000", 2024-02-19T21:51:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3709e-05 2024-02-19T21:51:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:51:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:16.516527+0000", 2024-02-19T21:51:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9959e-05 2024-02-19T21:51:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:51:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:16.516547+0000", 2024-02-19T21:51:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8409999999999995e-06 2024-02-19T21:51:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:51:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:16.516557+0000", 2024-02-19T21:51:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8439000000000002e-05 2024-02-19T21:51:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:51:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:16.516606+0000", 2024-02-19T21:51:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8053000000000001e-05 2024-02-19T21:51:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:51:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:16.516634+0000", 2024-02-19T21:51:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011615136 2024-02-19T21:51:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:51:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:16.528249+0000", 2024-02-19T21:51:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9504e-05 2024-02-19T21:51:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:51:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:16.528288+0000", 2024-02-19T21:51:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011772919999999999 2024-02-19T21:51:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:51:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.15345.0:255177 9.1 e376/370 9:8dde6673:::benchmark_data_smithi080_126364_object126585:head v 376'15889, mlcod=376'15887)", 2024-02-19T21:51:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:48:17.200951+0000", 2024-02-19T21:51:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 219.63049593, 2024-02-19T21:51:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011822463, 2024-02-19T21:51:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:51:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:51:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:51:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:51:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:17.200951+0000", 2024-02-19T21:51:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:51:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:51:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:17.200951+0000", 2024-02-19T21:51:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:51:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:51:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:17.200949+0000", 2024-02-19T21:51:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3066e-05 2024-02-19T21:51:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:51:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:17.200962+0000", 2024-02-19T21:51:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7912000000000001e-05 2024-02-19T21:51:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:51:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:17.200980+0000", 2024-02-19T21:51:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7510000000000008e-06 2024-02-19T21:51:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:51:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:17.200988+0000", 2024-02-19T21:51:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8714999999999995e-05 2024-02-19T21:51:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:51:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:17.201057+0000", 2024-02-19T21:51:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5763e-05 2024-02-19T21:51:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:51:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:17.201083+0000", 2024-02-19T21:51:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011640772000000001 2024-02-19T21:51:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:51:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:17.212723+0000", 2024-02-19T21:51:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9904999999999997e-05 2024-02-19T21:51:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:51:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:17.212773+0000", 2024-02-19T21:51:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011822463 2024-02-19T21:51:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:51:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.15345.0:256314 9.1 e376/370 9:8460cc89:::benchmark_data_smithi080_126364_object127722:head v 376'15956, mlcod=376'15954)", 2024-02-19T21:51:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:48:18.201193+0000", 2024-02-19T21:51:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 218.63025338400001, 2024-02-19T21:51:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012003346999999999, 2024-02-19T21:51:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:51:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:51:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:51:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:51:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:18.201193+0000", 2024-02-19T21:51:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:51:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:51:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:18.201193+0000", 2024-02-19T21:51:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:51:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:51:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:18.201192+0000", 2024-02-19T21:51:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1985e-05 2024-02-19T21:51:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:51:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:18.201204+0000", 2024-02-19T21:51:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9517e-05 2024-02-19T21:51:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:51:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:18.201223+0000", 2024-02-19T21:51:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.542e-06 2024-02-19T21:51:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:51:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:18.201231+0000", 2024-02-19T21:51:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5829999999999999e-05 2024-02-19T21:51:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:51:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:18.201287+0000", 2024-02-19T21:51:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3597000000000001e-05 2024-02-19T21:51:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:51:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:18.201310+0000", 2024-02-19T21:51:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011838912 2024-02-19T21:51:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:51:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:18.213149+0000", 2024-02-19T21:51:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.744e-05 2024-02-19T21:51:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:51:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:51:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:51:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:48:18.213197+0000", 2024-02-19T21:51:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012003346999999999 2024-02-19T21:51:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:51:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:51:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:51:57.837 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:51:57.837 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:58.154 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:51:58.270 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-02-19T21:51:58.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:57.199296+0000 mgr.y (mgr.14514) 739 : cluster [DBG] pgmap v963: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.7 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 742 B/s rd, 0 B/s wr, 145 op/s; 842/183993 objects degraded (0.458%); 6333/183993 objects misplaced (3.442%); 2.6 MiB/s, 42 objects/s recovering 2024-02-19T21:51:58.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:57.867738+0000 mon.c (mon.2) 111 : audit [INF] from='client.? 172.21.15.80:0/274348373' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:51:58.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:57.868059+0000 mon.a (mon.0) 1775 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:51:58.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:57.199296+0000 mgr.y (mgr.14514) 739 : cluster [DBG] pgmap v963: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.7 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 742 B/s rd, 0 B/s wr, 145 op/s; 842/183993 objects degraded (0.458%); 6333/183993 objects misplaced (3.442%); 2.6 MiB/s, 42 objects/s recovering 2024-02-19T21:51:58.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:57.867738+0000 mon.c (mon.2) 111 : audit [INF] from='client.? 172.21.15.80:0/274348373' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:51:58.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:57.868059+0000 mon.a (mon.0) 1775 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:51:58.514 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:51:58.520 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:58.520 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:51:58.536 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.4 dump_ops_in_flight 2024-02-19T21:51:58.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:57.199296+0000 mgr.y (mgr.14514) 739 : cluster [DBG] pgmap v963: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.7 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 742 B/s rd, 0 B/s wr, 145 op/s; 842/183993 objects degraded (0.458%); 6333/183993 objects misplaced (3.442%); 2.6 MiB/s, 42 objects/s recovering 2024-02-19T21:51:58.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:57.867738+0000 mon.c (mon.2) 111 : audit [INF] from='client.? 172.21.15.80:0/274348373' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:51:58.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:57.868059+0000 mon.a (mon.0) 1775 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:51:58.621 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:51:58.659 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:58.684 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:51:58.687 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:58.687 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:51:58.742 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:51:58.788 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:51:58.821 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:58.860 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:51:58.864 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:58.865 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:51:58.871 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:51:58.966 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:51:58.995 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:59.202 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:51:59.204 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:59.204 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:51:59.305 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:51:59.335 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:51:59.431 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:58.251671+0000 mon.a (mon.0) 1776 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:51:59.432 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:51:58.261666+0000 mon.a (mon.0) 1777 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:51:59.432 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:51:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:58.261724+0000 mon.a (mon.0) 1778 : cluster [DBG] osdmap e459: 8 total, 8 up, 7 in 2024-02-19T21:51:59.432 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:58.251671+0000 mon.a (mon.0) 1776 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:51:59.432 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:51:58.261666+0000 mon.a (mon.0) 1777 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:51:59.432 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:51:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:58.261724+0000 mon.a (mon.0) 1778 : cluster [DBG] osdmap e459: 8 total, 8 up, 7 in 2024-02-19T21:51:59.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:58.251671+0000 mon.a (mon.0) 1776 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:51:59.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:51:58.261666+0000 mon.a (mon.0) 1777 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:51:59.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:51:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:58.261724+0000 mon.a (mon.0) 1778 : cluster [DBG] osdmap e459: 8 total, 8 up, 7 in 2024-02-19T21:51:59.764 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:51:59.767 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:51:59.768 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:51:59.869 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:51:59.896 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:00.032 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:52:00.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:51:59.199661+0000 mgr.y (mgr.14514) 740 : cluster [DBG] pgmap v965: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.7 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 133 op/s; 842/183993 objects degraded (0.458%); 6333/183993 objects misplaced (3.442%); 1.8 MiB/s, 29 objects/s recovering 2024-02-19T21:52:00.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:51:59.199661+0000 mgr.y (mgr.14514) 740 : cluster [DBG] pgmap v965: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.7 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 133 op/s; 842/183993 objects degraded (0.458%); 6333/183993 objects misplaced (3.442%); 1.8 MiB/s, 29 objects/s recovering 2024-02-19T21:52:00.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:51:59.199661+0000 mgr.y (mgr.14514) 740 : cluster [DBG] pgmap v965: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.7 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 133 op/s; 842/183993 objects degraded (0.458%); 6333/183993 objects misplaced (3.442%); 1.8 MiB/s, 29 objects/s recovering 2024-02-19T21:52:00.750 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:52:00.754 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:00.755 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:52:00.855 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:52:00.883 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:01.096 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:52:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:52:00] "GET /metrics HTTP/1.1" 200 176572 "" "Prometheus/2.33.4" 2024-02-19T21:52:01.196 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset noscrub 2024-02-19T21:52:01.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:00.304079+0000 mon.a (mon.0) 1779 : cluster [WRN] Health check update: Degraded data redundancy: 842/183993 objects degraded (0.458%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:01.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:00.309010+0000 mon.a (mon.0) 1780 : cluster [DBG] osdmap e460: 8 total, 8 up, 7 in 2024-02-19T21:52:01.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:01.054732+0000 mgr.y (mgr.14514) 741 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:52:01.306 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:52:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:52:01.307 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:52:01.308 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [], 2024-02-19T21:52:01.308 INFO:teuthology.orchestra.run.smithi157.stdout: "num_ops": 0 2024-02-19T21:52:01.308 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:52:01.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:00.304079+0000 mon.a (mon.0) 1779 : cluster [WRN] Health check update: Degraded data redundancy: 842/183993 objects degraded (0.458%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:01.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:00.309010+0000 mon.a (mon.0) 1780 : cluster [DBG] osdmap e460: 8 total, 8 up, 7 in 2024-02-19T21:52:01.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:01.054732+0000 mgr.y (mgr.14514) 741 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:52:01.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:00.304079+0000 mon.a (mon.0) 1779 : cluster [WRN] Health check update: Degraded data redundancy: 842/183993 objects degraded (0.458%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:01.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:00.309010+0000 mon.a (mon.0) 1780 : cluster [DBG] osdmap e460: 8 total, 8 up, 7 in 2024-02-19T21:52:01.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:01.054732+0000 mgr.y (mgr.14514) 741 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:52:02.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:01.200188+0000 mgr.y (mgr.14514) 742 : cluster [DBG] pgmap v967: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.7 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 190 op/s; 726/181638 objects degraded (0.400%); 6275/181638 objects misplaced (3.455%); 2.4 MiB/s, 38 objects/s recovering 2024-02-19T21:52:02.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:01.200188+0000 mgr.y (mgr.14514) 742 : cluster [DBG] pgmap v967: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.7 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 190 op/s; 726/181638 objects degraded (0.400%); 6275/181638 objects misplaced (3.455%); 2.4 MiB/s, 38 objects/s recovering 2024-02-19T21:52:02.654 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:52:02.657 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:52:02.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:01.200188+0000 mgr.y (mgr.14514) 742 : cluster [DBG] pgmap v967: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.7 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 190 op/s; 726/181638 objects degraded (0.400%); 6275/181638 objects misplaced (3.455%); 2.4 MiB/s, 38 objects/s recovering 2024-02-19T21:52:03.136 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:52:03.139 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:03.139 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:52:03.229 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:52:03.240 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:52:03.247 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:52:03.271 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:03.277 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:52:03.301 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:52:03.314 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:52:03.323 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:52:03.327 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:03.327 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:52:03.342 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:52:03.362 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:52:03.391 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:52:03.393 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:52:03.393 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:52:03.393 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:52:03.393 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:52:03.393 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:52:03.393 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:52:03.393 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:52:03.393 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:52:03.428 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:52:03.454 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:02.640395+0000 mgr.y (mgr.14514) 743 : audit [DBG] from='client.15879 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:52:03.454 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:03.211213+0000 mon.a (mon.0) 1781 : audit [DBG] from='client.? 172.21.15.80:0/1331494473' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:52:03.457 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:03.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:02.640395+0000 mgr.y (mgr.14514) 743 : audit [DBG] from='client.15879 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:52:03.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:03.211213+0000 mon.a (mon.0) 1781 : audit [DBG] from='client.? 172.21.15.80:0/1331494473' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:52:03.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:02.640395+0000 mgr.y (mgr.14514) 743 : audit [DBG] from='client.15879 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:52:03.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:03.211213+0000 mon.a (mon.0) 1781 : audit [DBG] from='client.? 172.21.15.80:0/1331494473' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:52:03.783 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.4 dump_blocked_ops 2024-02-19T21:52:03.794 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":967,"stamp":"2024-02-19T21:52:01.199808+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3955300028,"num_objects":60546,"num_object_clones":0,"num_object_copies":181638,"num_objects_missing_on_primary":251,"num_objects_missing":251,"num_objects_degraded":726,"num_objects_misplaced":6275,"num_objects_unfound":0,"num_objects_dirty":60546,"num_whiteouts":0,"num_read":2281,"num_read_kb":2033,"num_write":89854,"num_write_kb":4783849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11303,"num_bytes_recovered":710679432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81787,"ondisk_log_size":81787,"up":414,"acting":411,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":417,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":656216064,"kb_used":16392488,"kb_used_data":11894064,"kb_used_omap":0,"kb_used_meta":4498367,"kb_avail":639823576,"statfs":{"total":671965249536,"available":655179341824,"internally_reserved":0,"allocated":12179521536,"data_stored":12170105465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":4606327860},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,1,1,0,2,1,1,0,5,5,3],"upper_bound":4096},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-74383360,"num_objects":-1135,"num_object_clones":0,"num_object_copies":-3405,"num_objects_missing_on_primary":-60,"num_objects_missing":-60,"num_objects_degraded":-234,"num_objects_misplaced":-175,"num_objects_unfound":0,"num_objects_dirty":-1135,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":1135,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":233,"num_bytes_recovered":15269888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001507"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":55,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.327667+0000","last_change":"2024-02-19T21:49:54.492937+0000","last_active":"2024-02-19T21:51:55.327667+0000","last_peered":"2024-02-19T21:51:55.327667+0000","last_clean":"2024-02-19T21:51:55.327667+0000","last_became_active":"2024-02-19T21:49:54.492544+0000","last_became_peered":"2024-02-19T21:49:54.492544+0000","last_unstale":"2024-02-19T21:51:55.327667+0000","last_undegraded":"2024-02-19T21:51:55.327667+0000","last_fullsized":"2024-02-19T21:51:55.327667+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.643236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.643236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":434,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.317939+0000","last_change":"2024-02-19T21:45:17.201007+0000","last_active":"2024-02-19T21:51:55.317939+0000","last_peered":"2024-02-19T21:51:55.317939+0000","last_clean":"2024-02-19T21:51:55.317939+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:51:55.317939+0000","last_undegraded":"2024-02-19T21:51:55.317939+0000","last_fullsized":"2024-02-19T21:51:55.317939+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:17.200897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:17.200897+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"201'27","reported_seq":102,"reported_epoch":457,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.068598+0000","last_change":"2024-02-19T21:49:08.327817+0000","last_active":"2024-02-19T21:51:55.068598+0000","last_peered":"2024-02-19T21:51:55.068598+0000","last_clean":"2024-02-19T21:51:55.068598+0000","last_became_active":"2024-02-19T21:49:08.327416+0000","last_became_peered":"2024-02-19T21:49:08.327416+0000","last_unstale":"2024-02-19T21:51:55.068598+0000","last_undegraded":"2024-02-19T21:51:55.068598+0000","last_fullsized":"2024-02-19T21:51:55.068598+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'27","last_scrub_stamp":"2024-02-19T21:44:48.022013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:48.022013+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":407,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.306575+0000","last_change":"2024-02-19T21:48:30.516215+0000","last_active":"2024-02-19T21:51:55.306575+0000","last_peered":"2024-02-19T21:51:55.306575+0000","last_clean":"2024-02-19T21:51:55.306575+0000","last_became_active":"2024-02-19T21:47:46.250178+0000","last_became_peered":"2024-02-19T21:47:46.250178+0000","last_unstale":"2024-02-19T21:51:55.306575+0000","last_undegraded":"2024-02-19T21:51:55.306575+0000","last_fullsized":"2024-02-19T21:51:55.306575+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.516139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.516139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":130,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.317216+0000","last_change":"2024-02-19T21:49:08.330105+0000","last_active":"2024-02-19T21:51:55.317216+0000","last_peered":"2024-02-19T21:51:55.317216+0000","last_clean":"2024-02-19T21:51:55.317216+0000","last_became_active":"2024-02-19T21:49:08.328994+0000","last_became_peered":"2024-02-19T21:49:08.328994+0000","last_unstale":"2024-02-19T21:51:55.317216+0000","last_undegraded":"2024-02-19T21:51:55.317216+0000","last_fullsized":"2024-02-19T21:51:55.317216+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.636083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.636083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"200'19","reported_seq":503,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.306256+0000","last_change":"2024-02-19T21:48:26.530234+0000","last_active":"2024-02-19T21:51:55.306256+0000","last_peered":"2024-02-19T21:51:55.306256+0000","last_clean":"2024-02-19T21:51:55.306256+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:51:55.306256+0000","last_undegraded":"2024-02-19T21:51:55.306256+0000","last_fullsized":"2024-02-19T21:51:55.306256+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:48:26.530160+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.530160+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":192,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:51:58.260362+0000","last_change":"2024-02-19T21:49:08.332091+0000","last_active":"2024-02-19T21:51:58.260362+0000","last_peered":"2024-02-19T21:51:58.260362+0000","last_clean":"2024-02-19T21:51:58.260362+0000","last_became_active":"2024-02-19T21:49:08.331753+0000","last_became_peered":"2024-02-19T21:49:08.331753+0000","last_unstale":"2024-02-19T21:51:58.260362+0000","last_undegraded":"2024-02-19T21:51:58.260362+0000","last_fullsized":"2024-02-19T21:51:58.260362+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.005236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.005236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":447,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.328348+0000","last_change":"2024-02-19T21:48:28.327028+0000","last_active":"2024-02-19T21:51:55.328348+0000","last_peered":"2024-02-19T21:51:55.328348+0000","last_clean":"2024-02-19T21:51:55.328348+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:51:55.328348+0000","last_undegraded":"2024-02-19T21:51:55.328348+0000","last_fullsized":"2024-02-19T21:51:55.328348+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.326938+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"310'9","reported_seq":419,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.306672+0000","last_change":"2024-02-19T21:51:47.010373+0000","last_active":"2024-02-19T21:51:55.306672+0000","last_peered":"2024-02-19T21:51:55.306672+0000","last_clean":"2024-02-19T21:51:55.306672+0000","last_became_active":"2024-02-19T21:49:08.329314+0000","last_became_peered":"2024-02-19T21:49:08.329314+0000","last_unstale":"2024-02-19T21:51:55.306672+0000","last_undegraded":"2024-02-19T21:51:55.306672+0000","last_fullsized":"2024-02-19T21:51:55.306672+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"310'9","last_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_deep_scrub":"310'9","last_deep_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.506188+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":368,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.316457+0000","last_change":"2024-02-19T21:46:31.205220+0000","last_active":"2024-02-19T21:51:55.316457+0000","last_peered":"2024-02-19T21:51:55.316457+0000","last_clean":"2024-02-19T21:51:55.316457+0000","last_became_active":"2024-02-19T21:46:31.204816+0000","last_became_peered":"2024-02-19T21:46:31.204816+0000","last_unstale":"2024-02-19T21:51:55.316457+0000","last_undegraded":"2024-02-19T21:51:55.316457+0000","last_fullsized":"2024-02-19T21:51:55.316457+0000","mapping_epoch":330,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":331,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:36.890201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.890201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":469,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.327672+0000","last_change":"2024-02-19T21:49:08.330669+0000","last_active":"2024-02-19T21:51:55.327672+0000","last_peered":"2024-02-19T21:51:55.327672+0000","last_clean":"2024-02-19T21:51:55.327672+0000","last_became_active":"2024-02-19T21:49:08.329998+0000","last_became_peered":"2024-02-19T21:49:08.329998+0000","last_unstale":"2024-02-19T21:51:55.327672+0000","last_undegraded":"2024-02-19T21:51:55.327672+0000","last_fullsized":"2024-02-19T21:51:55.327672+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:58.329316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:58.329316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"200'19","reported_seq":313,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.306731+0000","last_change":"2024-02-19T21:49:08.326162+0000","last_active":"2024-02-19T21:51:55.306731+0000","last_peered":"2024-02-19T21:51:55.306731+0000","last_clean":"2024-02-19T21:51:55.306731+0000","last_became_active":"2024-02-19T21:49:08.325802+0000","last_became_peered":"2024-02-19T21:49:08.325802+0000","last_unstale":"2024-02-19T21:51:55.306731+0000","last_undegraded":"2024-02-19T21:51:55.306731+0000","last_fullsized":"2024-02-19T21:51:55.306731+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:46:54.873416+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:46:54.873416+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2],"acting":[4,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":379,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.386419+0000","last_change":"2024-02-19T21:49:04.432817+0000","last_active":"2024-02-19T21:51:55.386419+0000","last_peered":"2024-02-19T21:51:55.386419+0000","last_clean":"2024-02-19T21:51:55.386419+0000","last_became_active":"2024-02-19T21:47:33.393708+0000","last_became_peered":"2024-02-19T21:47:33.393708+0000","last_unstale":"2024-02-19T21:51:55.386419+0000","last_undegraded":"2024-02-19T21:51:55.386419+0000","last_fullsized":"2024-02-19T21:51:55.386419+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:04.432733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:04.432733+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":55,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.327753+0000","last_change":"2024-02-19T21:49:54.492767+0000","last_active":"2024-02-19T21:51:55.327753+0000","last_peered":"2024-02-19T21:51:55.327753+0000","last_clean":"2024-02-19T21:51:55.327753+0000","last_became_active":"2024-02-19T21:49:54.491745+0000","last_became_peered":"2024-02-19T21:49:54.491745+0000","last_unstale":"2024-02-19T21:51:55.327753+0000","last_undegraded":"2024-02-19T21:51:55.327753+0000","last_fullsized":"2024-02-19T21:51:55.327753+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.232539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.232539+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1d","version":"201'18","reported_seq":397,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.313882+0000","last_change":"2024-02-19T21:48:25.734661+0000","last_active":"2024-02-19T21:51:55.313882+0000","last_peered":"2024-02-19T21:51:55.313882+0000","last_clean":"2024-02-19T21:51:55.313882+0000","last_became_active":"2024-02-19T21:38:31.247067+0000","last_became_peered":"2024-02-19T21:38:31.247067+0000","last_unstale":"2024-02-19T21:51:55.313882+0000","last_undegraded":"2024-02-19T21:51:55.313882+0000","last_fullsized":"2024-02-19T21:51:55.313882+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'18","last_scrub_stamp":"2024-02-19T21:48:25.734591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.734591+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":434,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.307057+0000","last_change":"2024-02-19T21:48:40.528082+0000","last_active":"2024-02-19T21:51:55.307057+0000","last_peered":"2024-02-19T21:51:55.307057+0000","last_clean":"2024-02-19T21:51:55.307057+0000","last_became_active":"2024-02-19T21:44:58.788307+0000","last_became_peered":"2024-02-19T21:44:58.788307+0000","last_unstale":"2024-02-19T21:51:55.307057+0000","last_undegraded":"2024-02-19T21:51:55.307057+0000","last_fullsized":"2024-02-19T21:51:55.307057+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:40.527970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:48:40.527970+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":442,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.386240+0000","last_change":"2024-02-19T21:48:11.557832+0000","last_active":"2024-02-19T21:51:55.386240+0000","last_peered":"2024-02-19T21:51:55.386240+0000","last_clean":"2024-02-19T21:51:55.386240+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:51:55.386240+0000","last_undegraded":"2024-02-19T21:51:55.386240+0000","last_fullsized":"2024-02-19T21:51:55.386240+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.557736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:17.913620+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.557736+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"200'34","reported_seq":103,"reported_epoch":457,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.069027+0000","last_change":"2024-02-19T21:49:08.332575+0000","last_active":"2024-02-19T21:51:55.069027+0000","last_peered":"2024-02-19T21:51:55.069027+0000","last_clean":"2024-02-19T21:51:55.069027+0000","last_became_active":"2024-02-19T21:49:08.331742+0000","last_became_peered":"2024-02-19T21:49:08.331742+0000","last_unstale":"2024-02-19T21:51:55.069027+0000","last_undegraded":"2024-02-19T21:51:55.069027+0000","last_fullsized":"2024-02-19T21:51:55.069027+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'34","last_scrub_stamp":"2024-02-19T21:45:49.728734+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:45:49.728734+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":454,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.313407+0000","last_change":"2024-02-19T21:46:44.994389+0000","last_active":"2024-02-19T21:51:55.313407+0000","last_peered":"2024-02-19T21:51:55.313407+0000","last_clean":"2024-02-19T21:51:55.313407+0000","last_became_active":"2024-02-19T21:44:58.790669+0000","last_became_peered":"2024-02-19T21:44:58.790669+0000","last_unstale":"2024-02-19T21:51:55.313407+0000","last_undegraded":"2024-02-19T21:51:55.313407+0000","last_fullsized":"2024-02-19T21:51:55.313407+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.994296+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":390,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.385873+0000","last_change":"2024-02-19T21:49:08.330330+0000","last_active":"2024-02-19T21:51:55.385873+0000","last_peered":"2024-02-19T21:51:55.385873+0000","last_clean":"2024-02-19T21:51:55.385873+0000","last_became_active":"2024-02-19T21:49:08.329986+0000","last_became_peered":"2024-02-19T21:49:08.329986+0000","last_unstale":"2024-02-19T21:51:55.385873+0000","last_undegraded":"2024-02-19T21:51:55.385873+0000","last_fullsized":"2024-02-19T21:51:55.385873+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.091409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.091409+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"201'19","reported_seq":338,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.316454+0000","last_change":"2024-02-19T21:48:26.366639+0000","last_active":"2024-02-19T21:51:55.316454+0000","last_peered":"2024-02-19T21:51:55.316454+0000","last_clean":"2024-02-19T21:51:55.316454+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:51:55.316454+0000","last_undegraded":"2024-02-19T21:51:55.316454+0000","last_fullsized":"2024-02-19T21:51:55.316454+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:26.366563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.366563+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":315,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.327372+0000","last_change":"2024-02-19T21:51:22.461995+0000","last_active":"2024-02-19T21:51:55.327372+0000","last_peered":"2024-02-19T21:51:55.327372+0000","last_clean":"2024-02-19T21:51:55.327372+0000","last_became_active":"2024-02-19T21:51:22.461599+0000","last_became_peered":"2024-02-19T21:51:22.461599+0000","last_unstale":"2024-02-19T21:51:55.327372+0000","last_undegraded":"2024-02-19T21:51:55.327372+0000","last_fullsized":"2024-02-19T21:51:55.327372+0000","mapping_epoch":445,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":446,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:13.196112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:13.196112+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":455,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:51:58.260216+0000","last_change":"2024-02-19T21:49:54.491840+0000","last_active":"2024-02-19T21:51:58.260216+0000","last_peered":"2024-02-19T21:51:58.260216+0000","last_clean":"2024-02-19T21:51:58.260216+0000","last_became_active":"2024-02-19T21:49:54.491488+0000","last_became_peered":"2024-02-19T21:49:54.491488+0000","last_unstale":"2024-02-19T21:51:58.260216+0000","last_undegraded":"2024-02-19T21:51:58.260216+0000","last_fullsized":"2024-02-19T21:51:58.260216+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.803606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.803606+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"201'20","reported_seq":539,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.317362+0000","last_change":"2024-02-19T21:49:54.502402+0000","last_active":"2024-02-19T21:51:55.317362+0000","last_peered":"2024-02-19T21:51:55.317362+0000","last_clean":"2024-02-19T21:51:55.317362+0000","last_became_active":"2024-02-19T21:49:54.483748+0000","last_became_peered":"2024-02-19T21:49:54.483748+0000","last_unstale":"2024-02-19T21:51:55.317362+0000","last_undegraded":"2024-02-19T21:51:55.317362+0000","last_fullsized":"2024-02-19T21:51:55.317362+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:48:25.348437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.348437+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":374,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.317515+0000","last_change":"2024-02-19T21:49:08.328206+0000","last_active":"2024-02-19T21:51:55.317515+0000","last_peered":"2024-02-19T21:51:55.317515+0000","last_clean":"2024-02-19T21:51:55.317515+0000","last_became_active":"2024-02-19T21:49:08.327865+0000","last_became_peered":"2024-02-19T21:49:08.327865+0000","last_unstale":"2024-02-19T21:51:55.317515+0000","last_undegraded":"2024-02-19T21:51:55.317515+0000","last_fullsized":"2024-02-19T21:51:55.317515+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.230652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.230652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":434,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.327058+0000","last_change":"2024-02-19T21:48:22.171667+0000","last_active":"2024-02-19T21:51:55.327058+0000","last_peered":"2024-02-19T21:51:55.327058+0000","last_clean":"2024-02-19T21:51:55.327058+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:51:55.327058+0000","last_undegraded":"2024-02-19T21:51:55.327058+0000","last_fullsized":"2024-02-19T21:51:55.327058+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.171600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.171600+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":470,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.386472+0000","last_change":"2024-02-19T21:49:08.330636+0000","last_active":"2024-02-19T21:51:55.386472+0000","last_peered":"2024-02-19T21:51:55.386472+0000","last_clean":"2024-02-19T21:51:55.386472+0000","last_became_active":"2024-02-19T21:49:08.330293+0000","last_became_peered":"2024-02-19T21:49:08.330293+0000","last_unstale":"2024-02-19T21:51:55.386472+0000","last_undegraded":"2024-02-19T21:51:55.386472+0000","last_fullsized":"2024-02-19T21:51:55.386472+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:03.034839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:03.034839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"381'24","reported_seq":67,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.328084+0000","last_change":"2024-02-19T21:49:55.368481+0000","last_active":"2024-02-19T21:51:55.328084+0000","last_peered":"2024-02-19T21:51:55.328084+0000","last_clean":"2024-02-19T21:51:55.328084+0000","last_became_active":"2024-02-19T21:49:54.485438+0000","last_became_peered":"2024-02-19T21:49:54.485438+0000","last_unstale":"2024-02-19T21:51:55.328084+0000","last_undegraded":"2024-02-19T21:51:55.328084+0000","last_fullsized":"2024-02-19T21:51:55.328084+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"381'24","last_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_deep_scrub":"381'24","last_deep_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_clean_scrub_stamp":"2024-02-19T21:48:39.382725+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,5],"acting":[7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":462,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.327353+0000","last_change":"2024-02-19T21:49:17.193002+0000","last_active":"2024-02-19T21:51:55.327353+0000","last_peered":"2024-02-19T21:51:55.327353+0000","last_clean":"2024-02-19T21:51:55.327353+0000","last_became_active":"2024-02-19T21:49:08.333537+0000","last_became_peered":"2024-02-19T21:49:08.333537+0000","last_unstale":"2024-02-19T21:51:55.327353+0000","last_undegraded":"2024-02-19T21:51:55.327353+0000","last_fullsized":"2024-02-19T21:51:55.327353+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:59.339649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:45:59.339649+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":490,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.385888+0000","last_change":"2024-02-19T21:49:54.494561+0000","last_active":"2024-02-19T21:51:55.385888+0000","last_peered":"2024-02-19T21:51:55.385888+0000","last_clean":"2024-02-19T21:51:55.385888+0000","last_became_active":"2024-02-19T21:49:54.494146+0000","last_became_peered":"2024-02-19T21:49:54.494146+0000","last_unstale":"2024-02-19T21:51:55.385888+0000","last_undegraded":"2024-02-19T21:51:55.385888+0000","last_fullsized":"2024-02-19T21:51:55.385888+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.560066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":465,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:51:58.261410+0000","last_change":"2024-02-19T21:49:09.765641+0000","last_active":"2024-02-19T21:51:58.261410+0000","last_peered":"2024-02-19T21:51:58.261410+0000","last_clean":"2024-02-19T21:51:58.261410+0000","last_became_active":"2024-02-19T21:49:08.331308+0000","last_became_peered":"2024-02-19T21:49:08.331308+0000","last_unstale":"2024-02-19T21:51:58.261410+0000","last_undegraded":"2024-02-19T21:51:58.261410+0000","last_fullsized":"2024-02-19T21:51:58.261410+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.765568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.765568+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"200'8","reported_seq":151,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.312826+0000","last_change":"2024-02-19T21:47:33.577363+0000","last_active":"2024-02-19T21:51:55.312826+0000","last_peered":"2024-02-19T21:51:55.312826+0000","last_clean":"2024-02-19T21:51:55.312826+0000","last_became_active":"2024-02-19T21:47:33.395217+0000","last_became_peered":"2024-02-19T21:47:33.395217+0000","last_unstale":"2024-02-19T21:51:55.312826+0000","last_undegraded":"2024-02-19T21:51:55.312826+0000","last_fullsized":"2024-02-19T21:51:55.312826+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'8","last_scrub_stamp":"2024-02-19T21:46:47.761677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.761677+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":374,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.318416+0000","last_change":"2024-02-19T21:49:08.918163+0000","last_active":"2024-02-19T21:51:55.318416+0000","last_peered":"2024-02-19T21:51:55.318416+0000","last_clean":"2024-02-19T21:51:55.318416+0000","last_became_active":"2024-02-19T21:49:08.328416+0000","last_became_peered":"2024-02-19T21:49:08.328416+0000","last_unstale":"2024-02-19T21:51:55.318416+0000","last_undegraded":"2024-02-19T21:51:55.318416+0000","last_fullsized":"2024-02-19T21:51:55.318416+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.918083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.918083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":452,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.313915+0000","last_change":"2024-02-19T21:49:54.480716+0000","last_active":"2024-02-19T21:51:55.313915+0000","last_peered":"2024-02-19T21:51:55.313915+0000","last_clean":"2024-02-19T21:51:55.313915+0000","last_became_active":"2024-02-19T21:49:54.480368+0000","last_became_peered":"2024-02-19T21:49:54.480368+0000","last_unstale":"2024-02-19T21:51:55.313915+0000","last_undegraded":"2024-02-19T21:51:55.313915+0000","last_fullsized":"2024-02-19T21:51:55.313915+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:19.596775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:19.596775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":436,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.313597+0000","last_change":"2024-02-19T21:49:05.012463+0000","last_active":"2024-02-19T21:51:55.313597+0000","last_peered":"2024-02-19T21:51:55.313597+0000","last_clean":"2024-02-19T21:51:55.313597+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:51:55.313597+0000","last_undegraded":"2024-02-19T21:51:55.313597+0000","last_fullsized":"2024-02-19T21:51:55.313597+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.012395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.012395+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"201'19","reported_seq":483,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.307005+0000","last_change":"2024-02-19T21:48:38.529106+0000","last_active":"2024-02-19T21:51:55.307005+0000","last_peered":"2024-02-19T21:51:55.307005+0000","last_clean":"2024-02-19T21:51:55.307005+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:51:55.307005+0000","last_undegraded":"2024-02-19T21:51:55.307005+0000","last_fullsized":"2024-02-19T21:51:55.307005+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:38.528977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.528977+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":439,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.315960+0000","last_change":"2024-02-19T21:46:06.096531+0000","last_active":"2024-02-19T21:51:55.315960+0000","last_peered":"2024-02-19T21:51:55.315960+0000","last_clean":"2024-02-19T21:51:55.315960+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:51:55.315960+0000","last_undegraded":"2024-02-19T21:51:55.315960+0000","last_fullsized":"2024-02-19T21:51:55.315960+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.096422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":250,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.386466+0000","last_change":"2024-02-19T21:48:38.391532+0000","last_active":"2024-02-19T21:51:55.386466+0000","last_peered":"2024-02-19T21:51:55.386466+0000","last_clean":"2024-02-19T21:51:55.386466+0000","last_became_active":"2024-02-19T21:47:33.395085+0000","last_became_peered":"2024-02-19T21:47:33.395085+0000","last_unstale":"2024-02-19T21:51:55.386466+0000","last_undegraded":"2024-02-19T21:51:55.386466+0000","last_fullsized":"2024-02-19T21:51:55.386466+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:38.391435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.391435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":451,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.386287+0000","last_change":"2024-02-19T21:48:14.600378+0000","last_active":"2024-02-19T21:51:55.386287+0000","last_peered":"2024-02-19T21:51:55.386287+0000","last_clean":"2024-02-19T21:51:55.386287+0000","last_became_active":"2024-02-19T21:47:33.393932+0000","last_became_peered":"2024-02-19T21:47:33.393932+0000","last_unstale":"2024-02-19T21:51:55.386287+0000","last_undegraded":"2024-02-19T21:51:55.386287+0000","last_fullsized":"2024-02-19T21:51:55.386287+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:14.600285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.600285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"200'15","reported_seq":505,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.313749+0000","last_change":"2024-02-19T21:49:08.334199+0000","last_active":"2024-02-19T21:51:55.313749+0000","last_peered":"2024-02-19T21:51:55.313749+0000","last_clean":"2024-02-19T21:51:55.313749+0000","last_became_active":"2024-02-19T21:49:08.333872+0000","last_became_peered":"2024-02-19T21:49:08.333872+0000","last_unstale":"2024-02-19T21:51:55.313749+0000","last_undegraded":"2024-02-19T21:51:55.313749+0000","last_fullsized":"2024-02-19T21:51:55.313749+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:45:08.678669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:08.678669+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":417,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.307485+0000","last_change":"2024-02-19T21:49:08.330114+0000","last_active":"2024-02-19T21:51:55.307485+0000","last_peered":"2024-02-19T21:51:55.307485+0000","last_clean":"2024-02-19T21:51:55.307485+0000","last_became_active":"2024-02-19T21:49:08.329770+0000","last_became_peered":"2024-02-19T21:49:08.329770+0000","last_unstale":"2024-02-19T21:51:55.307485+0000","last_undegraded":"2024-02-19T21:51:55.307485+0000","last_fullsized":"2024-02-19T21:51:55.307485+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:08.983923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.983923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"415'17","reported_seq":84,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:57.095639+0000","last_change":"2024-02-19T21:50:49.705247+0000","last_active":"2024-02-19T21:51:57.095639+0000","last_peered":"2024-02-19T21:51:57.095639+0000","last_clean":"2024-02-19T21:51:57.095639+0000","last_became_active":"2024-02-19T21:49:54.486304+0000","last_became_peered":"2024-02-19T21:49:54.486304+0000","last_unstale":"2024-02-19T21:51:57.095639+0000","last_undegraded":"2024-02-19T21:51:57.095639+0000","last_fullsized":"2024-02-19T21:51:57.095639+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"199'13","last_scrub_stamp":"2024-02-19T21:45:05.721709+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:45:05.721709+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":461,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.317706+0000","last_change":"2024-02-19T21:49:54.484516+0000","last_active":"2024-02-19T21:51:55.317706+0000","last_peered":"2024-02-19T21:51:55.317706+0000","last_clean":"2024-02-19T21:51:55.317706+0000","last_became_active":"2024-02-19T21:49:54.483689+0000","last_became_peered":"2024-02-19T21:49:54.483689+0000","last_unstale":"2024-02-19T21:51:55.317706+0000","last_undegraded":"2024-02-19T21:51:55.317706+0000","last_fullsized":"2024-02-19T21:51:55.317706+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.157478+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"201'19","reported_seq":483,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:51:58.260831+0000","last_change":"2024-02-19T21:48:27.720048+0000","last_active":"2024-02-19T21:51:58.260831+0000","last_peered":"2024-02-19T21:51:58.260831+0000","last_clean":"2024-02-19T21:51:58.260831+0000","last_became_active":"2024-02-19T21:47:33.398295+0000","last_became_peered":"2024-02-19T21:47:33.398295+0000","last_unstale":"2024-02-19T21:51:58.260831+0000","last_undegraded":"2024-02-19T21:51:58.260831+0000","last_fullsized":"2024-02-19T21:51:58.260831+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:27.719954+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:48:27.719954+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":178,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.316945+0000","last_change":"2024-02-19T21:49:54.484392+0000","last_active":"2024-02-19T21:51:55.316945+0000","last_peered":"2024-02-19T21:51:55.316945+0000","last_clean":"2024-02-19T21:51:55.316945+0000","last_became_active":"2024-02-19T21:49:54.484049+0000","last_became_peered":"2024-02-19T21:49:54.484049+0000","last_unstale":"2024-02-19T21:51:55.316945+0000","last_undegraded":"2024-02-19T21:51:55.316945+0000","last_fullsized":"2024-02-19T21:51:55.316945+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.121769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.121769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":677,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:51:58.260923+0000","last_change":"2024-02-19T21:48:38.723220+0000","last_active":"2024-02-19T21:51:58.260923+0000","last_peered":"2024-02-19T21:51:58.260923+0000","last_clean":"2024-02-19T21:51:58.260923+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:51:58.260923+0000","last_undegraded":"2024-02-19T21:51:58.260923+0000","last_fullsized":"2024-02-19T21:51:58.260923+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:48:38.723151+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.723151+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":466,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:51:58.260958+0000","last_change":"2024-02-19T21:49:54.485462+0000","last_active":"2024-02-19T21:51:58.260958+0000","last_peered":"2024-02-19T21:51:58.260958+0000","last_clean":"2024-02-19T21:51:58.260958+0000","last_became_active":"2024-02-19T21:49:54.485121+0000","last_became_peered":"2024-02-19T21:49:54.485121+0000","last_unstale":"2024-02-19T21:51:58.260958+0000","last_undegraded":"2024-02-19T21:51:58.260958+0000","last_fullsized":"2024-02-19T21:51:58.260958+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:07.724097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:49:07.724097+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"201'25","reported_seq":343,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.313558+0000","last_change":"2024-02-19T21:49:08.335077+0000","last_active":"2024-02-19T21:51:55.313558+0000","last_peered":"2024-02-19T21:51:55.313558+0000","last_clean":"2024-02-19T21:51:55.313558+0000","last_became_active":"2024-02-19T21:49:08.334061+0000","last_became_peered":"2024-02-19T21:49:08.334061+0000","last_unstale":"2024-02-19T21:51:55.313558+0000","last_undegraded":"2024-02-19T21:51:55.313558+0000","last_fullsized":"2024-02-19T21:51:55.313558+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'25","last_scrub_stamp":"2024-02-19T21:46:07.553690+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.553690+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":434,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.328232+0000","last_change":"2024-02-19T21:48:21.256471+0000","last_active":"2024-02-19T21:51:55.328232+0000","last_peered":"2024-02-19T21:51:55.328232+0000","last_clean":"2024-02-19T21:51:55.328232+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:51:55.328232+0000","last_undegraded":"2024-02-19T21:51:55.328232+0000","last_fullsized":"2024-02-19T21:51:55.328232+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.256358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.256358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":441,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.386050+0000","last_change":"2024-02-19T21:46:35.035136+0000","last_active":"2024-02-19T21:51:55.386050+0000","last_peered":"2024-02-19T21:51:55.386050+0000","last_clean":"2024-02-19T21:51:55.386050+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:51:55.386050+0000","last_undegraded":"2024-02-19T21:51:55.386050+0000","last_fullsized":"2024-02-19T21:51:55.386050+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:35.035042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:35.035042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"201'12","reported_seq":63,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.328353+0000","last_change":"2024-02-19T21:50:49.700758+0000","last_active":"2024-02-19T21:51:55.328353+0000","last_peered":"2024-02-19T21:51:55.328353+0000","last_clean":"2024-02-19T21:51:55.328353+0000","last_became_active":"2024-02-19T21:49:54.478094+0000","last_became_peered":"2024-02-19T21:49:54.478094+0000","last_unstale":"2024-02-19T21:51:55.328353+0000","last_undegraded":"2024-02-19T21:51:55.328353+0000","last_fullsized":"2024-02-19T21:51:55.328353+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'12","last_scrub_stamp":"2024-02-19T21:49:08.912638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.912638+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":86,"reported_epoch":457,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.069120+0000","last_change":"2024-02-19T21:49:08.332757+0000","last_active":"2024-02-19T21:51:55.069120+0000","last_peered":"2024-02-19T21:51:55.069120+0000","last_clean":"2024-02-19T21:51:55.069120+0000","last_became_active":"2024-02-19T21:49:08.332176+0000","last_became_peered":"2024-02-19T21:49:08.332176+0000","last_unstale":"2024-02-19T21:51:55.069120+0000","last_undegraded":"2024-02-19T21:51:55.069120+0000","last_fullsized":"2024-02-19T21:51:55.069120+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:47:01.365477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:47:01.365477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":86,"reported_epoch":457,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.068040+0000","last_change":"2024-02-19T21:49:08.328632+0000","last_active":"2024-02-19T21:51:55.068040+0000","last_peered":"2024-02-19T21:51:55.068040+0000","last_clean":"2024-02-19T21:51:55.068040+0000","last_became_active":"2024-02-19T21:49:08.327826+0000","last_became_peered":"2024-02-19T21:49:08.327826+0000","last_unstale":"2024-02-19T21:51:55.068040+0000","last_undegraded":"2024-02-19T21:51:55.068040+0000","last_fullsized":"2024-02-19T21:51:55.068040+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:09.645607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:44:09.645607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"200'15","reported_seq":567,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.317138+0000","last_change":"2024-02-19T21:50:49.704824+0000","last_active":"2024-02-19T21:51:55.317138+0000","last_peered":"2024-02-19T21:51:55.317138+0000","last_clean":"2024-02-19T21:51:55.317138+0000","last_became_active":"2024-02-19T21:49:54.483578+0000","last_became_peered":"2024-02-19T21:49:54.483578+0000","last_unstale":"2024-02-19T21:51:55.317138+0000","last_undegraded":"2024-02-19T21:51:55.317138+0000","last_fullsized":"2024-02-19T21:51:55.317138+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:44:53.072746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:53.072746+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"459'5652","reported_seq":7344,"reported_epoch":459,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:52:00.113571+0000","last_change":"2024-02-19T21:50:38.722849+0000","last_active":"2024-02-19T21:52:00.113571+0000","last_peered":"2024-02-19T21:52:00.113571+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:09.770699+0000","last_became_peered":"2024-02-19T21:49:09.770699+0000","last_unstale":"2024-02-19T21:52:00.113571+0000","last_undegraded":"2024-02-19T21:49:09.328794+0000","last_fullsized":"2024-02-19T21:49:09.325036+0000","mapping_epoch":395,"log_start":"392'800","ondisk_log_start":"392'800","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4852,"ondisk_log_size":4852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":250347520,"num_objects":3820,"num_object_clones":0,"num_object_copies":11460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":306,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3820,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5652,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":802,"num_bytes_recovered":52559872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5],"avail_no_missing":["6","5"],"object_location_counts":[{"shards":"5,6","objects":3514}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":55,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.327579+0000","last_change":"2024-02-19T21:49:54.492844+0000","last_active":"2024-02-19T21:51:55.327579+0000","last_peered":"2024-02-19T21:51:55.327579+0000","last_clean":"2024-02-19T21:51:55.327579+0000","last_became_active":"2024-02-19T21:49:54.492156+0000","last_became_peered":"2024-02-19T21:49:54.492156+0000","last_unstale":"2024-02-19T21:51:55.327579+0000","last_undegraded":"2024-02-19T21:51:55.327579+0000","last_fullsized":"2024-02-19T21:51:55.327579+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:04.692807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.692807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"378'4","reported_seq":473,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.307656+0000","last_change":"2024-02-19T21:48:28.510929+0000","last_active":"2024-02-19T21:51:55.307656+0000","last_peered":"2024-02-19T21:51:55.307656+0000","last_clean":"2024-02-19T21:51:55.307656+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:51:55.307656+0000","last_undegraded":"2024-02-19T21:51:55.307656+0000","last_fullsized":"2024-02-19T21:51:55.307656+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"378'4","last_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_deep_scrub":"378'4","last_deep_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.510849+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"200'23","reported_seq":320,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.306506+0000","last_change":"2024-02-19T21:48:22.519465+0000","last_active":"2024-02-19T21:51:55.306506+0000","last_peered":"2024-02-19T21:51:55.306506+0000","last_clean":"2024-02-19T21:51:55.306506+0000","last_became_active":"2024-02-19T21:47:46.252085+0000","last_became_peered":"2024-02-19T21:47:46.252085+0000","last_unstale":"2024-02-19T21:51:55.306506+0000","last_undegraded":"2024-02-19T21:51:55.306506+0000","last_fullsized":"2024-02-19T21:51:55.306506+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'23","last_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_deep_scrub":"200'23","last_deep_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.519381+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6],"acting":[4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":86,"reported_epoch":457,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.067916+0000","last_change":"2024-02-19T21:49:08.328855+0000","last_active":"2024-02-19T21:51:55.067916+0000","last_peered":"2024-02-19T21:51:55.067916+0000","last_clean":"2024-02-19T21:51:55.067916+0000","last_became_active":"2024-02-19T21:49:08.328237+0000","last_became_peered":"2024-02-19T21:49:08.328237+0000","last_unstale":"2024-02-19T21:51:55.067916+0000","last_undegraded":"2024-02-19T21:51:55.067916+0000","last_fullsized":"2024-02-19T21:51:55.067916+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:58.047556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:58.047556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"459'5462","reported_seq":5543,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:51:59.665063+0000","last_change":"2024-02-19T21:48:47.778295+0000","last_active":"2024-02-19T21:51:59.665063+0000","last_peered":"2024-02-19T21:51:59.665063+0000","last_clean":"2024-02-19T21:51:59.665063+0000","last_became_active":"2024-02-19T21:48:47.777964+0000","last_became_peered":"2024-02-19T21:48:47.777964+0000","last_unstale":"2024-02-19T21:51:59.665063+0000","last_undegraded":"2024-02-19T21:51:59.665063+0000","last_fullsized":"2024-02-19T21:51:59.665063+0000","mapping_epoch":385,"log_start":"392'700","ondisk_log_start":"392'700","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4762,"ondisk_log_size":4762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":241696768,"num_objects":3688,"num_object_clones":0,"num_object_copies":11064,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3688,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5462,"num_write_kb":292800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":488,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.316007+0000","last_change":"2024-02-19T21:49:08.328019+0000","last_active":"2024-02-19T21:51:55.316007+0000","last_peered":"2024-02-19T21:51:55.316007+0000","last_clean":"2024-02-19T21:51:55.316007+0000","last_became_active":"2024-02-19T21:49:08.327581+0000","last_became_peered":"2024-02-19T21:49:08.327581+0000","last_unstale":"2024-02-19T21:51:55.316007+0000","last_undegraded":"2024-02-19T21:51:55.316007+0000","last_fullsized":"2024-02-19T21:51:55.316007+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:22.180593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:45:22.180593+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5],"acting":[0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":434,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.313413+0000","last_change":"2024-02-19T21:48:37.789514+0000","last_active":"2024-02-19T21:51:55.313413+0000","last_peered":"2024-02-19T21:51:55.313413+0000","last_clean":"2024-02-19T21:51:55.313413+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:51:55.313413+0000","last_undegraded":"2024-02-19T21:51:55.313413+0000","last_fullsized":"2024-02-19T21:51:55.313413+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:37.789400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:37.789400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"201'20","reported_seq":340,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.313836+0000","last_change":"2024-02-19T21:45:57.877936+0000","last_active":"2024-02-19T21:51:55.313836+0000","last_peered":"2024-02-19T21:51:55.313836+0000","last_clean":"2024-02-19T21:51:55.313836+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:51:55.313836+0000","last_undegraded":"2024-02-19T21:51:55.313836+0000","last_fullsized":"2024-02-19T21:51:55.313836+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:45:57.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:57.877856+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":680,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:57.095831+0000","last_change":"2024-02-19T21:49:01.011149+0000","last_active":"2024-02-19T21:51:57.095831+0000","last_peered":"2024-02-19T21:51:57.095831+0000","last_clean":"2024-02-19T21:51:57.095831+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:51:57.095831+0000","last_undegraded":"2024-02-19T21:51:57.095831+0000","last_fullsized":"2024-02-19T21:51:57.095831+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:49:01.011078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:49:01.011078+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.a","version":"459'5616","reported_seq":5698,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.081149+0000","last_change":"2024-02-19T21:48:47.778138+0000","last_active":"2024-02-19T21:52:00.081149+0000","last_peered":"2024-02-19T21:52:00.081149+0000","last_clean":"2024-02-19T21:52:00.081149+0000","last_became_active":"2024-02-19T21:48:47.777820+0000","last_became_peered":"2024-02-19T21:48:47.777820+0000","last_unstale":"2024-02-19T21:52:00.081149+0000","last_undegraded":"2024-02-19T21:52:00.081149+0000","last_fullsized":"2024-02-19T21:52:00.081149+0000","mapping_epoch":385,"log_start":"392'700","ondisk_log_start":"392'700","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4916,"ondisk_log_size":4916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":247595008,"num_objects":3778,"num_object_clones":0,"num_object_copies":11334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3778,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5616,"num_write_kb":300608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":383,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.307510+0000","last_change":"2024-02-19T21:48:33.478821+0000","last_active":"2024-02-19T21:51:55.307510+0000","last_peered":"2024-02-19T21:51:55.307510+0000","last_clean":"2024-02-19T21:51:55.307510+0000","last_became_active":"2024-02-19T21:44:56.149476+0000","last_became_peered":"2024-02-19T21:44:56.149476+0000","last_unstale":"2024-02-19T21:51:55.307510+0000","last_undegraded":"2024-02-19T21:51:55.307510+0000","last_fullsized":"2024-02-19T21:51:55.307510+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:33.478715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:48:33.478715+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":445,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:51:58.261102+0000","last_change":"2024-02-19T21:46:41.834315+0000","last_active":"2024-02-19T21:51:58.261102+0000","last_peered":"2024-02-19T21:51:58.261102+0000","last_clean":"2024-02-19T21:51:58.261102+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:51:58.261102+0000","last_undegraded":"2024-02-19T21:51:58.261102+0000","last_fullsized":"2024-02-19T21:51:58.261102+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:41.834246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:46:41.834246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"397'46","reported_seq":870,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:57.095762+0000","last_change":"2024-02-19T21:49:08.335296+0000","last_active":"2024-02-19T21:51:57.095762+0000","last_peered":"2024-02-19T21:51:57.095762+0000","last_clean":"2024-02-19T21:51:57.095762+0000","last_became_active":"2024-02-19T21:49:08.334527+0000","last_became_peered":"2024-02-19T21:49:08.334527+0000","last_unstale":"2024-02-19T21:51:57.095762+0000","last_undegraded":"2024-02-19T21:51:57.095762+0000","last_fullsized":"2024-02-19T21:51:57.095762+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'43","last_scrub_stamp":"2024-02-19T21:45:04.755444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.755444+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":430,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.316789+0000","last_change":"2024-02-19T21:46:45.252437+0000","last_active":"2024-02-19T21:51:55.316789+0000","last_peered":"2024-02-19T21:51:55.316789+0000","last_clean":"2024-02-19T21:51:55.316789+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:51:55.316789+0000","last_undegraded":"2024-02-19T21:51:55.316789+0000","last_fullsized":"2024-02-19T21:51:55.316789+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.252344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.252344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"459'5547","reported_seq":8605,"reported_epoch":459,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:52:00.259926+0000","last_change":"2024-02-19T21:51:03.650022+0000","last_active":"2024-02-19T21:52:00.259926+0000","last_peered":"2024-02-19T21:52:00.259926+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:55.752599+0000","last_became_peered":"2024-02-19T21:49:55.752599+0000","last_unstale":"2024-02-19T21:52:00.259926+0000","last_undegraded":"2024-02-19T21:49:55.655049+0000","last_fullsized":"2024-02-19T21:49:55.470938+0000","mapping_epoch":414,"log_start":"392'300","ondisk_log_start":"392'300","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5247,"ondisk_log_size":5247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":243335168,"num_objects":3713,"num_object_clones":0,"num_object_copies":11139,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":169,"num_objects_misplaced":3045,"num_objects_unfound":0,"num_objects_dirty":3713,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5547,"num_write_kb":296320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":988,"num_bytes_recovered":64749568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2],"avail_no_missing":["5","4"],"object_location_counts":[{"shards":"2,4,5","objects":2876},{"shards":"2,5","objects":668},{"shards":"4,5","objects":169}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":458,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.328560+0000","last_change":"2024-02-19T21:49:09.227437+0000","last_active":"2024-02-19T21:51:55.328560+0000","last_peered":"2024-02-19T21:51:55.328560+0000","last_clean":"2024-02-19T21:51:55.328560+0000","last_became_active":"2024-02-19T21:49:08.328437+0000","last_became_peered":"2024-02-19T21:49:08.328437+0000","last_unstale":"2024-02-19T21:51:55.328560+0000","last_undegraded":"2024-02-19T21:51:55.328560+0000","last_fullsized":"2024-02-19T21:51:55.328560+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.227355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.227355+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'6","reported_seq":1673,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:51:58.662781+0000","last_change":"2024-02-19T21:51:48.470779+0000","last_active":"2024-02-19T21:51:58.662781+0000","last_peered":"2024-02-19T21:51:58.662781+0000","last_clean":"2024-02-19T21:51:58.662781+0000","last_became_active":"2024-02-19T21:49:08.331108+0000","last_became_peered":"2024-02-19T21:49:08.331108+0000","last_unstale":"2024-02-19T21:51:58.662781+0000","last_undegraded":"2024-02-19T21:51:58.662781+0000","last_fullsized":"2024-02-19T21:51:58.662781+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_clean_scrub_stamp":"2024-02-19T21:44:13.678341+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1156,"num_read_kb":1151,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":86,"reported_epoch":457,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.068810+0000","last_change":"2024-02-19T21:49:08.329710+0000","last_active":"2024-02-19T21:51:55.068810+0000","last_peered":"2024-02-19T21:51:55.068810+0000","last_clean":"2024-02-19T21:51:55.068810+0000","last_became_active":"2024-02-19T21:49:08.329378+0000","last_became_peered":"2024-02-19T21:49:08.329378+0000","last_unstale":"2024-02-19T21:51:55.068810+0000","last_undegraded":"2024-02-19T21:51:55.068810+0000","last_fullsized":"2024-02-19T21:51:55.068810+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:55.195394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.195394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"200'17","reported_seq":491,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.314259+0000","last_change":"2024-02-19T21:48:14.878933+0000","last_active":"2024-02-19T21:51:55.314259+0000","last_peered":"2024-02-19T21:51:55.314259+0000","last_clean":"2024-02-19T21:51:55.314259+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:51:55.314259+0000","last_undegraded":"2024-02-19T21:51:55.314259+0000","last_fullsized":"2024-02-19T21:51:55.314259+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'17","last_scrub_stamp":"2024-02-19T21:48:14.878857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.878857+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":25,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":86,"reported_epoch":457,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.070798+0000","last_change":"2024-02-19T21:49:08.325478+0000","last_active":"2024-02-19T21:51:55.070798+0000","last_peered":"2024-02-19T21:51:55.070798+0000","last_clean":"2024-02-19T21:51:55.070798+0000","last_became_active":"2024-02-19T21:49:08.325127+0000","last_became_peered":"2024-02-19T21:49:08.325127+0000","last_unstale":"2024-02-19T21:51:55.070798+0000","last_undegraded":"2024-02-19T21:51:55.070798+0000","last_fullsized":"2024-02-19T21:51:55.070798+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:10.871111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:10.871111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"459'5639","reported_seq":5721,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.041378+0000","last_change":"2024-02-19T21:48:47.778829+0000","last_active":"2024-02-19T21:52:00.041378+0000","last_peered":"2024-02-19T21:52:00.041378+0000","last_clean":"2024-02-19T21:52:00.041378+0000","last_became_active":"2024-02-19T21:48:47.778486+0000","last_became_peered":"2024-02-19T21:48:47.778486+0000","last_unstale":"2024-02-19T21:52:00.041378+0000","last_undegraded":"2024-02-19T21:52:00.041378+0000","last_fullsized":"2024-02-19T21:52:00.041378+0000","mapping_epoch":385,"log_start":"392'800","ondisk_log_start":"392'800","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4839,"ondisk_log_size":4839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":250413056,"num_objects":3821,"num_object_clones":0,"num_object_copies":11463,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3821,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5639,"num_write_kb":302720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":462,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:51:58.261843+0000","last_change":"2024-02-19T21:47:33.400407+0000","last_active":"2024-02-19T21:51:58.261843+0000","last_peered":"2024-02-19T21:51:58.261843+0000","last_clean":"2024-02-19T21:51:58.261843+0000","last_became_active":"2024-02-19T21:47:33.400075+0000","last_became_peered":"2024-02-19T21:47:33.400075+0000","last_unstale":"2024-02-19T21:51:58.261843+0000","last_undegraded":"2024-02-19T21:51:58.261843+0000","last_fullsized":"2024-02-19T21:51:58.261843+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.035136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":340,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:51:58.261233+0000","last_change":"2024-02-19T21:49:05.746443+0000","last_active":"2024-02-19T21:51:58.261233+0000","last_peered":"2024-02-19T21:51:58.261233+0000","last_clean":"2024-02-19T21:51:58.261233+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:51:58.261233+0000","last_undegraded":"2024-02-19T21:51:58.261233+0000","last_fullsized":"2024-02-19T21:51:58.261233+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.746358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.746358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":492,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:51:58.260970+0000","last_change":"2024-02-19T21:49:54.485252+0000","last_active":"2024-02-19T21:51:58.260970+0000","last_peered":"2024-02-19T21:51:58.260970+0000","last_clean":"2024-02-19T21:51:58.260970+0000","last_became_active":"2024-02-19T21:49:54.484956+0000","last_became_peered":"2024-02-19T21:49:54.484956+0000","last_unstale":"2024-02-19T21:51:58.260970+0000","last_undegraded":"2024-02-19T21:51:58.260970+0000","last_fullsized":"2024-02-19T21:51:58.260970+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:07.901205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:07.901205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":55,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.326591+0000","last_change":"2024-02-19T21:49:54.483990+0000","last_active":"2024-02-19T21:51:55.326591+0000","last_peered":"2024-02-19T21:51:55.326591+0000","last_clean":"2024-02-19T21:51:55.326591+0000","last_became_active":"2024-02-19T21:49:54.483637+0000","last_became_peered":"2024-02-19T21:49:54.483637+0000","last_unstale":"2024-02-19T21:51:55.326591+0000","last_undegraded":"2024-02-19T21:51:55.326591+0000","last_fullsized":"2024-02-19T21:51:55.326591+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.190177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.190177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"201'33","reported_seq":484,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.386312+0000","last_change":"2024-02-19T21:46:47.970066+0000","last_active":"2024-02-19T21:51:55.386312+0000","last_peered":"2024-02-19T21:51:55.386312+0000","last_clean":"2024-02-19T21:51:55.386312+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:51:55.386312+0000","last_undegraded":"2024-02-19T21:51:55.386312+0000","last_fullsized":"2024-02-19T21:51:55.386312+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'33","last_scrub_stamp":"2024-02-19T21:46:47.969961+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.969961+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":55,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.327800+0000","last_change":"2024-02-19T21:49:54.478276+0000","last_active":"2024-02-19T21:51:55.327800+0000","last_peered":"2024-02-19T21:51:55.327800+0000","last_clean":"2024-02-19T21:51:55.327800+0000","last_became_active":"2024-02-19T21:49:54.477947+0000","last_became_peered":"2024-02-19T21:49:54.477947+0000","last_unstale":"2024-02-19T21:51:55.327800+0000","last_undegraded":"2024-02-19T21:51:55.327800+0000","last_fullsized":"2024-02-19T21:51:55.327800+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:57.754453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:57.754453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"459'5462","reported_seq":15685,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:51:59.665224+0000","last_change":"2024-02-19T21:51:22.472713+0000","last_active":"2024-02-19T21:51:59.665224+0000","last_peered":"2024-02-19T21:51:59.665224+0000","last_clean":"2024-02-19T21:51:59.665224+0000","last_became_active":"2024-02-19T21:51:22.462974+0000","last_became_peered":"2024-02-19T21:51:22.462974+0000","last_unstale":"2024-02-19T21:51:59.665224+0000","last_undegraded":"2024-02-19T21:51:59.665224+0000","last_fullsized":"2024-02-19T21:51:59.665224+0000","mapping_epoch":445,"log_start":"392'300","ondisk_log_start":"392'300","created":385,"last_epoch_clean":446,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5162,"ondisk_log_size":5162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":244711424,"num_objects":3734,"num_object_clones":0,"num_object_copies":11202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3734,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5462,"num_write_kb":294272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5054,"num_bytes_recovered":320077824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7],"acting":[0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":432,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.313725+0000","last_change":"2024-02-19T21:45:47.723650+0000","last_active":"2024-02-19T21:51:55.313725+0000","last_peered":"2024-02-19T21:51:55.313725+0000","last_clean":"2024-02-19T21:51:55.313725+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:51:55.313725+0000","last_undegraded":"2024-02-19T21:51:55.313725+0000","last_fullsized":"2024-02-19T21:51:55.313725+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.723550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.723550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":443,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.318368+0000","last_change":"2024-02-19T21:45:51.243726+0000","last_active":"2024-02-19T21:51:55.318368+0000","last_peered":"2024-02-19T21:51:55.318368+0000","last_clean":"2024-02-19T21:51:55.318368+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:51:55.318368+0000","last_undegraded":"2024-02-19T21:51:55.318368+0000","last_fullsized":"2024-02-19T21:51:55.318368+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:51.243656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:51.243656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":460,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.326788+0000","last_change":"2024-02-19T21:48:23.218358+0000","last_active":"2024-02-19T21:51:55.326788+0000","last_peered":"2024-02-19T21:51:55.326788+0000","last_clean":"2024-02-19T21:51:55.326788+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:51:55.326788+0000","last_undegraded":"2024-02-19T21:51:55.326788+0000","last_fullsized":"2024-02-19T21:51:55.326788+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:23.218282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.218282+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"324'30","reported_seq":587,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.317032+0000","last_change":"2024-02-19T21:49:08.330490+0000","last_active":"2024-02-19T21:51:55.317032+0000","last_peered":"2024-02-19T21:51:55.317032+0000","last_clean":"2024-02-19T21:51:55.317032+0000","last_became_active":"2024-02-19T21:49:08.329761+0000","last_became_peered":"2024-02-19T21:49:08.329761+0000","last_unstale":"2024-02-19T21:51:55.317032+0000","last_undegraded":"2024-02-19T21:51:55.317032+0000","last_fullsized":"2024-02-19T21:51:55.317032+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'30","last_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_deep_scrub":"324'30","last_deep_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.110965+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":446,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:51:58.261834+0000","last_change":"2024-02-19T21:45:09.918263+0000","last_active":"2024-02-19T21:51:58.261834+0000","last_peered":"2024-02-19T21:51:58.261834+0000","last_clean":"2024-02-19T21:51:58.261834+0000","last_became_active":"2024-02-19T21:44:42.624782+0000","last_became_peered":"2024-02-19T21:44:42.624782+0000","last_unstale":"2024-02-19T21:51:58.261834+0000","last_undegraded":"2024-02-19T21:51:58.261834+0000","last_fullsized":"2024-02-19T21:51:58.261834+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":295,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_clean_scrub_stamp":"2024-02-19T21:45:09.918170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"459'5516","reported_seq":5599,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.120337+0000","last_change":"2024-02-19T21:48:47.777963+0000","last_active":"2024-02-19T21:52:00.120337+0000","last_peered":"2024-02-19T21:52:00.120337+0000","last_clean":"2024-02-19T21:52:00.120337+0000","last_became_active":"2024-02-19T21:48:47.777644+0000","last_became_peered":"2024-02-19T21:48:47.777644+0000","last_unstale":"2024-02-19T21:52:00.120337+0000","last_undegraded":"2024-02-19T21:52:00.120337+0000","last_fullsized":"2024-02-19T21:52:00.120337+0000","mapping_epoch":385,"log_start":"392'600","ondisk_log_start":"392'600","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4916,"ondisk_log_size":4916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":245956632,"num_objects":3754,"num_object_clones":0,"num_object_copies":11262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3754,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5516,"num_write_kb":296577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":465,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.312725+0000","last_change":"2024-02-19T21:49:08.331080+0000","last_active":"2024-02-19T21:51:55.312725+0000","last_peered":"2024-02-19T21:51:55.312725+0000","last_clean":"2024-02-19T21:51:55.312725+0000","last_became_active":"2024-02-19T21:49:08.330648+0000","last_became_peered":"2024-02-19T21:49:08.330648+0000","last_unstale":"2024-02-19T21:51:55.312725+0000","last_undegraded":"2024-02-19T21:51:55.312725+0000","last_fullsized":"2024-02-19T21:51:55.312725+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:55.803876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:44:55.803876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":436,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.328515+0000","last_change":"2024-02-19T21:48:31.320229+0000","last_active":"2024-02-19T21:51:55.328515+0000","last_peered":"2024-02-19T21:51:55.328515+0000","last_clean":"2024-02-19T21:51:55.328515+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:51:55.328515+0000","last_undegraded":"2024-02-19T21:51:55.328515+0000","last_fullsized":"2024-02-19T21:51:55.328515+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:31.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:45.017696+0000","last_clean_scrub_stamp":"2024-02-19T21:48:31.320133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"201'37","reported_seq":491,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.317639+0000","last_change":"2024-02-19T21:45:14.173212+0000","last_active":"2024-02-19T21:51:55.317639+0000","last_peered":"2024-02-19T21:51:55.317639+0000","last_clean":"2024-02-19T21:51:55.317639+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:51:55.317639+0000","last_undegraded":"2024-02-19T21:51:55.317639+0000","last_fullsized":"2024-02-19T21:51:55.317639+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'37","last_scrub_stamp":"2024-02-19T21:45:14.173134+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:45:14.173134+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":435,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.386251+0000","last_change":"2024-02-19T21:46:48.988928+0000","last_active":"2024-02-19T21:51:55.386251+0000","last_peered":"2024-02-19T21:51:55.386251+0000","last_clean":"2024-02-19T21:51:55.386251+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:51:55.386251+0000","last_undegraded":"2024-02-19T21:51:55.386251+0000","last_fullsized":"2024-02-19T21:51:55.386251+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:48.988836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.988836+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.e","version":"459'5417","reported_seq":7585,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.224970+0000","last_change":"2024-02-19T21:50:40.718822+0000","last_active":"2024-02-19T21:52:00.224970+0000","last_peered":"2024-02-19T21:52:00.224970+0000","last_clean":"2024-02-19T21:52:00.224970+0000","last_became_active":"2024-02-19T21:50:40.710425+0000","last_became_peered":"2024-02-19T21:50:40.710425+0000","last_unstale":"2024-02-19T21:52:00.224970+0000","last_undegraded":"2024-02-19T21:52:00.224970+0000","last_fullsized":"2024-02-19T21:52:00.224970+0000","mapping_epoch":430,"log_start":"392'400","ondisk_log_start":"392'400","created":385,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5017,"ondisk_log_size":5017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":243728384,"num_objects":3719,"num_object_clones":0,"num_object_copies":11157,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3719,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5417,"num_write_kb":292352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1035,"num_bytes_recovered":67829760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":178,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.306918+0000","last_change":"2024-02-19T21:49:08.326461+0000","last_active":"2024-02-19T21:51:55.306918+0000","last_peered":"2024-02-19T21:51:55.306918+0000","last_clean":"2024-02-19T21:51:55.306918+0000","last_became_active":"2024-02-19T21:49:08.326106+0000","last_became_peered":"2024-02-19T21:49:08.326106+0000","last_unstale":"2024-02-19T21:51:55.306918+0000","last_undegraded":"2024-02-19T21:51:55.306918+0000","last_fullsized":"2024-02-19T21:51:55.306918+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.080896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.080896+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":438,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.313977+0000","last_change":"2024-02-19T21:48:11.879787+0000","last_active":"2024-02-19T21:51:55.313977+0000","last_peered":"2024-02-19T21:51:55.313977+0000","last_clean":"2024-02-19T21:51:55.313977+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:51:55.313977+0000","last_undegraded":"2024-02-19T21:51:55.313977+0000","last_fullsized":"2024-02-19T21:51:55.313977+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.879687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.879687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"201'38","reported_seq":73,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.326989+0000","last_change":"2024-02-19T21:49:55.861358+0000","last_active":"2024-02-19T21:51:55.326989+0000","last_peered":"2024-02-19T21:51:55.326989+0000","last_clean":"2024-02-19T21:51:55.326989+0000","last_became_active":"2024-02-19T21:49:54.480413+0000","last_became_peered":"2024-02-19T21:49:54.480413+0000","last_unstale":"2024-02-19T21:51:55.326989+0000","last_undegraded":"2024-02-19T21:51:55.326989+0000","last_fullsized":"2024-02-19T21:51:55.326989+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":415,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'38","last_scrub_stamp":"2024-02-19T21:49:05.923627+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.923627+0000","log_size":38,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":331,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.386135+0000","last_change":"2024-02-19T21:49:54.495134+0000","last_active":"2024-02-19T21:51:55.386135+0000","last_peered":"2024-02-19T21:51:55.386135+0000","last_clean":"2024-02-19T21:51:55.386135+0000","last_became_active":"2024-02-19T21:49:54.494802+0000","last_became_peered":"2024-02-19T21:49:54.494802+0000","last_unstale":"2024-02-19T21:51:55.386135+0000","last_undegraded":"2024-02-19T21:51:55.386135+0000","last_fullsized":"2024-02-19T21:51:55.386135+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:10.578408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:10.578408+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.f","version":"459'5709","reported_seq":8101,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.123549+0000","last_change":"2024-02-19T21:51:05.409700+0000","last_active":"2024-02-19T21:52:00.123549+0000","last_peered":"2024-02-19T21:52:00.123549+0000","last_clean":"2024-02-19T21:52:00.123549+0000","last_became_active":"2024-02-19T21:51:05.398355+0000","last_became_peered":"2024-02-19T21:51:05.398355+0000","last_unstale":"2024-02-19T21:52:00.123549+0000","last_undegraded":"2024-02-19T21:52:00.123549+0000","last_fullsized":"2024-02-19T21:52:00.123549+0000","mapping_epoch":440,"log_start":"392'800","ondisk_log_start":"392'800","created":385,"last_epoch_clean":441,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4909,"ondisk_log_size":4909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":250937344,"num_objects":3829,"num_object_clones":0,"num_object_copies":11487,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3829,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5709,"num_write_kb":305216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1147,"num_bytes_recovered":75169792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":465,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.327987+0000","last_change":"2024-02-19T21:49:08.328862+0000","last_active":"2024-02-19T21:51:55.327987+0000","last_peered":"2024-02-19T21:51:55.327987+0000","last_clean":"2024-02-19T21:51:55.327987+0000","last_became_active":"2024-02-19T21:49:08.328529+0000","last_became_peered":"2024-02-19T21:49:08.328529+0000","last_unstale":"2024-02-19T21:51:55.327987+0000","last_undegraded":"2024-02-19T21:51:55.327987+0000","last_fullsized":"2024-02-19T21:51:55.327987+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:49.110117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:49.110117+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":498,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.386637+0000","last_change":"2024-02-19T21:49:54.493367+0000","last_active":"2024-02-19T21:51:55.386637+0000","last_peered":"2024-02-19T21:51:55.386637+0000","last_clean":"2024-02-19T21:51:55.386637+0000","last_became_active":"2024-02-19T21:49:54.493041+0000","last_became_peered":"2024-02-19T21:49:54.493041+0000","last_unstale":"2024-02-19T21:51:55.386637+0000","last_undegraded":"2024-02-19T21:51:55.386637+0000","last_fullsized":"2024-02-19T21:51:55.386637+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.972369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.972369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"201'28","reported_seq":305,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.306493+0000","last_change":"2024-02-19T21:49:08.330818+0000","last_active":"2024-02-19T21:51:55.306493+0000","last_peered":"2024-02-19T21:51:55.306493+0000","last_clean":"2024-02-19T21:51:55.306493+0000","last_became_active":"2024-02-19T21:49:08.330477+0000","last_became_peered":"2024-02-19T21:49:08.330477+0000","last_unstale":"2024-02-19T21:51:55.306493+0000","last_undegraded":"2024-02-19T21:51:55.306493+0000","last_fullsized":"2024-02-19T21:51:55.306493+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'28","last_scrub_stamp":"2024-02-19T21:45:55.998646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.998646+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":40,"num_read_kb":33,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":529,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:57.095872+0000","last_change":"2024-02-19T21:45:50.742626+0000","last_active":"2024-02-19T21:51:57.095872+0000","last_peered":"2024-02-19T21:51:57.095872+0000","last_clean":"2024-02-19T21:51:57.095872+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:51:57.095872+0000","last_undegraded":"2024-02-19T21:51:57.095872+0000","last_fullsized":"2024-02-19T21:51:57.095872+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'9","last_scrub_stamp":"2024-02-19T21:45:50.742526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:50.742526+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"459'5460","reported_seq":5542,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.110867+0000","last_change":"2024-02-19T21:48:47.779506+0000","last_active":"2024-02-19T21:52:00.110867+0000","last_peered":"2024-02-19T21:52:00.110867+0000","last_clean":"2024-02-19T21:52:00.110867+0000","last_became_active":"2024-02-19T21:48:47.778325+0000","last_became_peered":"2024-02-19T21:48:47.778325+0000","last_unstale":"2024-02-19T21:52:00.110867+0000","last_undegraded":"2024-02-19T21:52:00.110867+0000","last_fullsized":"2024-02-19T21:52:00.110867+0000","mapping_epoch":385,"log_start":"392'600","ondisk_log_start":"392'600","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4860,"ondisk_log_size":4860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":241172480,"num_objects":3680,"num_object_clones":0,"num_object_copies":11040,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3680,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5460,"num_write_kb":292480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"66'1","reported_seq":349,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.386490+0000","last_change":"2024-02-19T21:48:12.568842+0000","last_active":"2024-02-19T21:51:55.386490+0000","last_peered":"2024-02-19T21:51:55.386490+0000","last_clean":"2024-02-19T21:51:55.386490+0000","last_became_active":"2024-02-19T21:44:56.166670+0000","last_became_peered":"2024-02-19T21:44:56.166670+0000","last_unstale":"2024-02-19T21:51:55.386490+0000","last_undegraded":"2024-02-19T21:51:55.386490+0000","last_fullsized":"2024-02-19T21:51:55.386490+0000","mapping_epoch":165,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:12.568734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.568734+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"261'11","reported_seq":541,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:51:58.261720+0000","last_change":"2024-02-19T21:45:01.716882+0000","last_active":"2024-02-19T21:51:58.261720+0000","last_peered":"2024-02-19T21:51:58.261720+0000","last_clean":"2024-02-19T21:51:58.261720+0000","last_became_active":"2024-02-19T21:44:08.123392+0000","last_became_peered":"2024-02-19T21:44:08.123392+0000","last_unstale":"2024-02-19T21:51:58.261720+0000","last_undegraded":"2024-02-19T21:51:58.261720+0000","last_fullsized":"2024-02-19T21:51:58.261720+0000","mapping_epoch":62,"log_start":"257'10","ondisk_log_start":"257'10","created":62,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-02-19T21:45:01.716817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.716817+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":447,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.326865+0000","last_change":"2024-02-19T21:48:19.186455+0000","last_active":"2024-02-19T21:51:55.326865+0000","last_peered":"2024-02-19T21:51:55.326865+0000","last_clean":"2024-02-19T21:51:55.326865+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:51:55.326865+0000","last_undegraded":"2024-02-19T21:51:55.326865+0000","last_fullsized":"2024-02-19T21:51:55.326865+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:48:19.186359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:19.186359+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"201'19","reported_seq":305,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.307138+0000","last_change":"2024-02-19T21:48:34.485865+0000","last_active":"2024-02-19T21:51:55.307138+0000","last_peered":"2024-02-19T21:51:55.307138+0000","last_clean":"2024-02-19T21:51:55.307138+0000","last_became_active":"2024-02-19T21:47:46.251550+0000","last_became_peered":"2024-02-19T21:47:46.251550+0000","last_unstale":"2024-02-19T21:51:55.307138+0000","last_undegraded":"2024-02-19T21:51:55.307138+0000","last_fullsized":"2024-02-19T21:51:55.307138+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:34.485787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:34.485787+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":23,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7],"acting":[4,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1","version":"459'5547","reported_seq":5629,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.179664+0000","last_change":"2024-02-19T21:48:47.772467+0000","last_active":"2024-02-19T21:52:00.179664+0000","last_peered":"2024-02-19T21:52:00.179664+0000","last_clean":"2024-02-19T21:52:00.179664+0000","last_became_active":"2024-02-19T21:48:47.772154+0000","last_became_peered":"2024-02-19T21:48:47.772154+0000","last_unstale":"2024-02-19T21:52:00.179664+0000","last_undegraded":"2024-02-19T21:52:00.179664+0000","last_fullsized":"2024-02-19T21:52:00.179664+0000","mapping_epoch":385,"log_start":"392'500","ondisk_log_start":"392'500","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5047,"ondisk_log_size":5047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":246874112,"num_objects":3767,"num_object_clones":0,"num_object_copies":11301,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3767,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5547,"num_write_kb":298048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":455,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:51:58.261072+0000","last_change":"2024-02-19T21:46:01.031458+0000","last_active":"2024-02-19T21:51:58.261072+0000","last_peered":"2024-02-19T21:51:58.261072+0000","last_clean":"2024-02-19T21:51:58.261072+0000","last_became_active":"2024-02-19T21:44:56.155194+0000","last_became_peered":"2024-02-19T21:44:56.155194+0000","last_unstale":"2024-02-19T21:51:58.261072+0000","last_undegraded":"2024-02-19T21:51:58.261072+0000","last_fullsized":"2024-02-19T21:51:58.261072+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.031344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.031344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"363'12","reported_seq":252,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:57.095603+0000","last_change":"2024-02-19T21:48:25.487689+0000","last_active":"2024-02-19T21:51:57.095603+0000","last_peered":"2024-02-19T21:51:57.095603+0000","last_clean":"2024-02-19T21:51:57.095603+0000","last_became_active":"2024-02-19T21:47:46.260099+0000","last_became_peered":"2024-02-19T21:47:46.260099+0000","last_unstale":"2024-02-19T21:51:57.095603+0000","last_undegraded":"2024-02-19T21:51:57.095603+0000","last_fullsized":"2024-02-19T21:51:57.095603+0000","mapping_epoch":362,"log_start":"98'9","ondisk_log_start":"98'9","created":62,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"363'12","last_scrub_stamp":"2024-02-19T21:48:25.487608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.487608+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":458,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.312653+0000","last_change":"2024-02-19T21:49:08.335163+0000","last_active":"2024-02-19T21:51:55.312653+0000","last_peered":"2024-02-19T21:51:55.312653+0000","last_clean":"2024-02-19T21:51:55.312653+0000","last_became_active":"2024-02-19T21:49:08.334842+0000","last_became_peered":"2024-02-19T21:49:08.334842+0000","last_unstale":"2024-02-19T21:51:55.312653+0000","last_undegraded":"2024-02-19T21:51:55.312653+0000","last_fullsized":"2024-02-19T21:51:55.312653+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.700887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.700887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"270'34","reported_seq":379,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:51:58.261472+0000","last_change":"2024-02-19T21:47:34.894164+0000","last_active":"2024-02-19T21:51:58.261472+0000","last_peered":"2024-02-19T21:51:58.261472+0000","last_clean":"2024-02-19T21:51:58.261472+0000","last_became_active":"2024-02-19T21:47:33.400012+0000","last_became_peered":"2024-02-19T21:47:33.400012+0000","last_unstale":"2024-02-19T21:51:58.261472+0000","last_undegraded":"2024-02-19T21:51:58.261472+0000","last_fullsized":"2024-02-19T21:51:58.261472+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":357,"parent":"0.0","parent_split_bits":0,"last_scrub":"270'34","last_scrub_stamp":"2024-02-19T21:46:44.789309+0000","last_deep_scrub":"270'34","last_deep_scrub_stamp":"2024-02-19T21:44:17.451151+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.789309+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2","version":"459'5633","reported_seq":5715,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.077542+0000","last_change":"2024-02-19T21:48:47.771305+0000","last_active":"2024-02-19T21:52:00.077542+0000","last_peered":"2024-02-19T21:52:00.077542+0000","last_clean":"2024-02-19T21:52:00.077542+0000","last_became_active":"2024-02-19T21:48:47.771000+0000","last_became_peered":"2024-02-19T21:48:47.771000+0000","last_unstale":"2024-02-19T21:52:00.077542+0000","last_undegraded":"2024-02-19T21:52:00.077542+0000","last_fullsized":"2024-02-19T21:52:00.077542+0000","mapping_epoch":385,"log_start":"392'400","ondisk_log_start":"392'400","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5233,"ondisk_log_size":5233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":248709120,"num_objects":3795,"num_object_clones":0,"num_object_copies":11385,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3795,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5633,"num_write_kb":301696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":436,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.307436+0000","last_change":"2024-02-19T21:49:08.329023+0000","last_active":"2024-02-19T21:51:55.307436+0000","last_peered":"2024-02-19T21:51:55.307436+0000","last_clean":"2024-02-19T21:51:55.307436+0000","last_became_active":"2024-02-19T21:49:08.328697+0000","last_became_peered":"2024-02-19T21:49:08.328697+0000","last_unstale":"2024-02-19T21:51:55.307436+0000","last_undegraded":"2024-02-19T21:51:55.307436+0000","last_fullsized":"2024-02-19T21:51:55.307436+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.939414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.939414+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"397'17","reported_seq":379,"reported_epoch":457,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.103055+0000","last_change":"2024-02-19T21:49:08.325927+0000","last_active":"2024-02-19T21:51:55.103055+0000","last_peered":"2024-02-19T21:51:55.103055+0000","last_clean":"2024-02-19T21:51:55.103055+0000","last_became_active":"2024-02-19T21:49:08.325034+0000","last_became_peered":"2024-02-19T21:49:08.325034+0000","last_unstale":"2024-02-19T21:51:55.103055+0000","last_undegraded":"2024-02-19T21:51:55.103055+0000","last_fullsized":"2024-02-19T21:51:55.103055+0000","mapping_epoch":394,"log_start":"170'11","ondisk_log_start":"170'11","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"271'13","last_scrub_stamp":"2024-02-19T21:46:47.072988+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.072988+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":448,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.313659+0000","last_change":"2024-02-19T21:49:03.987847+0000","last_active":"2024-02-19T21:51:55.313659+0000","last_peered":"2024-02-19T21:51:55.313659+0000","last_clean":"2024-02-19T21:51:55.313659+0000","last_became_active":"2024-02-19T21:47:33.395485+0000","last_became_peered":"2024-02-19T21:47:33.395485+0000","last_unstale":"2024-02-19T21:51:55.313659+0000","last_undegraded":"2024-02-19T21:51:55.313659+0000","last_fullsized":"2024-02-19T21:51:55.313659+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:03.987749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:49:03.987749+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,5],"acting":[1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"200'20","reported_seq":282,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.306806+0000","last_change":"2024-02-19T21:48:12.628796+0000","last_active":"2024-02-19T21:51:55.306806+0000","last_peered":"2024-02-19T21:51:55.306806+0000","last_clean":"2024-02-19T21:51:55.306806+0000","last_became_active":"2024-02-19T21:47:46.251725+0000","last_became_peered":"2024-02-19T21:47:46.251725+0000","last_unstale":"2024-02-19T21:51:55.306806+0000","last_undegraded":"2024-02-19T21:51:55.306806+0000","last_fullsized":"2024-02-19T21:51:55.306806+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'20","last_scrub_stamp":"2024-02-19T21:48:12.628700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.628700+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3","version":"458'5528","reported_seq":7813,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:56.791961+0000","last_change":"2024-02-19T21:50:50.296220+0000","last_active":"2024-02-19T21:51:56.791961+0000","last_peered":"2024-02-19T21:51:56.791961+0000","last_clean":"2024-02-19T21:51:56.791961+0000","last_became_active":"2024-02-19T21:50:50.289607+0000","last_became_peered":"2024-02-19T21:50:50.289607+0000","last_unstale":"2024-02-19T21:51:56.791961+0000","last_undegraded":"2024-02-19T21:51:56.791961+0000","last_fullsized":"2024-02-19T21:51:56.791961+0000","mapping_epoch":433,"log_start":"392'100","ondisk_log_start":"392'100","created":385,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5428,"ondisk_log_size":5428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":251133952,"num_objects":3832,"num_object_clones":0,"num_object_copies":11496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3832,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5528,"num_write_kb":299520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1097,"num_bytes_recovered":71892992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":86,"reported_epoch":457,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.070897+0000","last_change":"2024-02-19T21:49:08.327495+0000","last_active":"2024-02-19T21:51:55.070897+0000","last_peered":"2024-02-19T21:51:55.070897+0000","last_clean":"2024-02-19T21:51:55.070897+0000","last_became_active":"2024-02-19T21:49:08.327172+0000","last_became_peered":"2024-02-19T21:49:08.327172+0000","last_unstale":"2024-02-19T21:51:55.070897+0000","last_undegraded":"2024-02-19T21:51:55.070897+0000","last_fullsized":"2024-02-19T21:51:55.070897+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.241319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.241319+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,6],"acting":[2,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":443,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.313638+0000","last_change":"2024-02-19T21:45:01.798485+0000","last_active":"2024-02-19T21:51:55.313638+0000","last_peered":"2024-02-19T21:51:55.313638+0000","last_clean":"2024-02-19T21:51:55.313638+0000","last_became_active":"2024-02-19T21:44:22.245925+0000","last_became_peered":"2024-02-19T21:44:22.245925+0000","last_unstale":"2024-02-19T21:51:55.313638+0000","last_undegraded":"2024-02-19T21:51:55.313638+0000","last_fullsized":"2024-02-19T21:51:55.313638+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:01.798387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.798387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":443,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.327832+0000","last_change":"2024-02-19T21:48:30.277397+0000","last_active":"2024-02-19T21:51:55.327832+0000","last_peered":"2024-02-19T21:51:55.327832+0000","last_clean":"2024-02-19T21:51:55.327832+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:51:55.327832+0000","last_undegraded":"2024-02-19T21:51:55.327832+0000","last_fullsized":"2024-02-19T21:51:55.327832+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.277322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.277322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"337'39","reported_seq":391,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.307403+0000","last_change":"2024-02-19T21:49:08.326007+0000","last_active":"2024-02-19T21:51:55.307403+0000","last_peered":"2024-02-19T21:51:55.307403+0000","last_clean":"2024-02-19T21:51:55.307403+0000","last_became_active":"2024-02-19T21:49:08.325683+0000","last_became_peered":"2024-02-19T21:49:08.325683+0000","last_unstale":"2024-02-19T21:51:55.307403+0000","last_undegraded":"2024-02-19T21:51:55.307403+0000","last_fullsized":"2024-02-19T21:51:55.307403+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'39","last_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_deep_scrub":"337'39","last_deep_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.923809+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":49,"num_read_kb":39,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"459'5722","reported_seq":5804,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:51:59.548959+0000","last_change":"2024-02-19T21:48:47.776672+0000","last_active":"2024-02-19T21:51:59.548959+0000","last_peered":"2024-02-19T21:51:59.548959+0000","last_clean":"2024-02-19T21:51:59.548959+0000","last_became_active":"2024-02-19T21:48:47.776368+0000","last_became_peered":"2024-02-19T21:48:47.776368+0000","last_unstale":"2024-02-19T21:51:59.548959+0000","last_undegraded":"2024-02-19T21:51:59.548959+0000","last_fullsized":"2024-02-19T21:51:59.548959+0000","mapping_epoch":385,"log_start":"392'600","ondisk_log_start":"392'600","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5122,"ondisk_log_size":5122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":250740736,"num_objects":3826,"num_object_clones":0,"num_object_copies":11478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3826,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5722,"num_write_kb":305536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"66'1","reported_seq":281,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.326596+0000","last_change":"2024-02-19T21:50:57.303343+0000","last_active":"2024-02-19T21:51:55.326596+0000","last_peered":"2024-02-19T21:51:55.326596+0000","last_clean":"2024-02-19T21:51:55.326596+0000","last_became_active":"2024-02-19T21:50:57.302957+0000","last_became_peered":"2024-02-19T21:50:57.302957+0000","last_unstale":"2024-02-19T21:51:55.326596+0000","last_undegraded":"2024-02-19T21:51:55.326596+0000","last_fullsized":"2024-02-19T21:51:55.326596+0000","mapping_epoch":437,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":438,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:46:43.773486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:46:43.773486+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":86,"reported_epoch":457,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.068560+0000","last_change":"2024-02-19T21:49:08.326583+0000","last_active":"2024-02-19T21:51:55.068560+0000","last_peered":"2024-02-19T21:51:55.068560+0000","last_clean":"2024-02-19T21:51:55.068560+0000","last_became_active":"2024-02-19T21:49:08.324835+0000","last_became_peered":"2024-02-19T21:49:08.324835+0000","last_unstale":"2024-02-19T21:51:55.068560+0000","last_undegraded":"2024-02-19T21:51:55.068560+0000","last_fullsized":"2024-02-19T21:51:55.068560+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.163825+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":143,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.386253+0000","last_change":"2024-02-19T21:49:08.327553+0000","last_active":"2024-02-19T21:51:55.386253+0000","last_peered":"2024-02-19T21:51:55.386253+0000","last_clean":"2024-02-19T21:51:55.386253+0000","last_became_active":"2024-02-19T21:49:08.327186+0000","last_became_peered":"2024-02-19T21:49:08.327186+0000","last_unstale":"2024-02-19T21:51:55.386253+0000","last_undegraded":"2024-02-19T21:51:55.386253+0000","last_fullsized":"2024-02-19T21:51:55.386253+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:45:00.748244+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:45:00.748244+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"201'44","reported_seq":564,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.386166+0000","last_change":"2024-02-19T21:49:55.281324+0000","last_active":"2024-02-19T21:51:55.386166+0000","last_peered":"2024-02-19T21:51:55.386166+0000","last_clean":"2024-02-19T21:51:55.386166+0000","last_became_active":"2024-02-19T21:49:54.493167+0000","last_became_peered":"2024-02-19T21:49:54.493167+0000","last_unstale":"2024-02-19T21:51:55.386166+0000","last_undegraded":"2024-02-19T21:51:55.386166+0000","last_fullsized":"2024-02-19T21:51:55.386166+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'44","last_scrub_stamp":"2024-02-19T21:48:32.489084+0000","last_deep_scrub":"201'44","last_deep_scrub_stamp":"2024-02-19T21:44:16.255049+0000","last_clean_scrub_stamp":"2024-02-19T21:48:32.489084+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.5","version":"458'5601","reported_seq":8377,"reported_epoch":458,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:51:57.087279+0000","last_change":"2024-02-19T21:50:03.887248+0000","last_active":"2024-02-19T21:51:57.087279+0000","last_peered":"2024-02-19T21:51:57.087279+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:50:03.654321+0000","last_became_peered":"2024-02-19T21:50:03.654321+0000","last_unstale":"2024-02-19T21:51:57.087279+0000","last_undegraded":"2024-02-19T21:50:01.398577+0000","last_fullsized":"2024-02-19T21:49:55.473278+0000","mapping_epoch":414,"log_start":"392'200","ondisk_log_start":"392'200","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5401,"ondisk_log_size":5401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":250413056,"num_objects":3821,"num_object_clones":0,"num_object_copies":11463,"num_objects_missing_on_primary":251,"num_objects_missing":251,"num_objects_degraded":251,"num_objects_misplaced":3230,"num_objects_unfound":0,"num_objects_dirty":3821,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5601,"num_write_kb":301504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":891,"num_bytes_recovered":58392576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0],"avail_no_missing":["0","5"],"object_location_counts":[{"shards":"0,2","objects":591},{"shards":"0,2,5","objects":2979},{"shards":"0,5","objects":251}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":488,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.318494+0000","last_change":"2024-02-19T21:49:08.328667+0000","last_active":"2024-02-19T21:51:55.318494+0000","last_peered":"2024-02-19T21:51:55.318494+0000","last_clean":"2024-02-19T21:51:55.318494+0000","last_became_active":"2024-02-19T21:49:08.328287+0000","last_became_peered":"2024-02-19T21:49:08.328287+0000","last_unstale":"2024-02-19T21:51:55.318494+0000","last_undegraded":"2024-02-19T21:51:55.318494+0000","last_fullsized":"2024-02-19T21:51:55.318494+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.176542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.176542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":86,"reported_epoch":457,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.068047+0000","last_change":"2024-02-19T21:49:08.332637+0000","last_active":"2024-02-19T21:51:55.068047+0000","last_peered":"2024-02-19T21:51:55.068047+0000","last_clean":"2024-02-19T21:51:55.068047+0000","last_became_active":"2024-02-19T21:49:08.331451+0000","last_became_peered":"2024-02-19T21:49:08.331451+0000","last_unstale":"2024-02-19T21:51:55.068047+0000","last_undegraded":"2024-02-19T21:51:55.068047+0000","last_fullsized":"2024-02-19T21:51:55.068047+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.123413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.547129+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.123413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":458,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.313797+0000","last_change":"2024-02-19T21:49:08.331159+0000","last_active":"2024-02-19T21:51:55.313797+0000","last_peered":"2024-02-19T21:51:55.313797+0000","last_clean":"2024-02-19T21:51:55.313797+0000","last_became_active":"2024-02-19T21:49:08.330804+0000","last_became_peered":"2024-02-19T21:49:08.330804+0000","last_unstale":"2024-02-19T21:51:55.313797+0000","last_undegraded":"2024-02-19T21:51:55.313797+0000","last_fullsized":"2024-02-19T21:51:55.313797+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.978015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.978015+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"377'19","reported_seq":466,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.317773+0000","last_change":"2024-02-19T21:48:23.326608+0000","last_active":"2024-02-19T21:51:55.317773+0000","last_peered":"2024-02-19T21:51:55.317773+0000","last_clean":"2024-02-19T21:51:55.317773+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:51:55.317773+0000","last_undegraded":"2024-02-19T21:51:55.317773+0000","last_fullsized":"2024-02-19T21:51:55.317773+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"377'19","last_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_deep_scrub":"377'19","last_deep_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.326541+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"459'5631","reported_seq":5713,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.280250+0000","last_change":"2024-02-19T21:48:47.780368+0000","last_active":"2024-02-19T21:52:00.280250+0000","last_peered":"2024-02-19T21:52:00.280250+0000","last_clean":"2024-02-19T21:52:00.280250+0000","last_became_active":"2024-02-19T21:48:47.780046+0000","last_became_peered":"2024-02-19T21:48:47.780046+0000","last_unstale":"2024-02-19T21:52:00.280250+0000","last_undegraded":"2024-02-19T21:52:00.280250+0000","last_fullsized":"2024-02-19T21:52:00.280250+0000","mapping_epoch":385,"log_start":"392'400","ondisk_log_start":"392'400","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5231,"ondisk_log_size":5231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":247529472,"num_objects":3777,"num_object_clones":0,"num_object_copies":11331,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3777,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5631,"num_write_kb":301056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":453,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:51:58.260858+0000","last_change":"2024-02-19T21:46:01.981923+0000","last_active":"2024-02-19T21:51:58.260858+0000","last_peered":"2024-02-19T21:51:58.260858+0000","last_clean":"2024-02-19T21:51:58.260858+0000","last_became_active":"2024-02-19T21:44:56.160521+0000","last_became_peered":"2024-02-19T21:44:56.160521+0000","last_unstale":"2024-02-19T21:51:58.260858+0000","last_undegraded":"2024-02-19T21:51:58.260858+0000","last_fullsized":"2024-02-19T21:51:58.260858+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.981866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.981866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":95,"reported_epoch":457,"state":"active+clean","last_fresh":"2024-02-19T21:51:55.070901+0000","last_change":"2024-02-19T21:49:54.485377+0000","last_active":"2024-02-19T21:51:55.070901+0000","last_peered":"2024-02-19T21:51:55.070901+0000","last_clean":"2024-02-19T21:51:55.070901+0000","last_became_active":"2024-02-19T21:49:54.485078+0000","last_became_peered":"2024-02-19T21:49:54.485078+0000","last_unstale":"2024-02-19T21:51:55.070901+0000","last_undegraded":"2024-02-19T21:51:55.070901+0000","last_fullsized":"2024-02-19T21:51:55.070901+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:52.107416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:46:52.107416+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"200'27","reported_seq":530,"reported_epoch":459,"state":"active+clean","last_fresh":"2024-02-19T21:51:58.260147+0000","last_change":"2024-02-19T21:49:55.109780+0000","last_active":"2024-02-19T21:51:58.260147+0000","last_peered":"2024-02-19T21:51:58.260147+0000","last_clean":"2024-02-19T21:51:58.260147+0000","last_became_active":"2024-02-19T21:49:54.486014+0000","last_became_peered":"2024-02-19T21:49:54.486014+0000","last_unstale":"2024-02-19T21:51:58.260147+0000","last_undegraded":"2024-02-19T21:51:58.260147+0000","last_fullsized":"2024-02-19T21:51:58.260147+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'27","last_scrub_stamp":"2024-02-19T21:48:24.665813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:24.665813+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"324'11","reported_seq":700,"reported_epoch":458,"state":"active+clean","last_fresh":"2024-02-19T21:51:57.095613+0000","last_change":"2024-02-19T21:48:26.293036+0000","last_active":"2024-02-19T21:51:57.095613+0000","last_peered":"2024-02-19T21:51:57.095613+0000","last_clean":"2024-02-19T21:51:57.095613+0000","last_became_active":"2024-02-19T21:44:34.385140+0000","last_became_peered":"2024-02-19T21:44:34.385140+0000","last_unstale":"2024-02-19T21:51:57.095613+0000","last_undegraded":"2024-02-19T21:51:57.095613+0000","last_fullsized":"2024-02-19T21:51:57.095613+0000","mapping_epoch":62,"log_start":"66'8","ondisk_log_start":"66'8","created":62,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'11","last_scrub_stamp":"2024-02-19T21:48:26.292909+0000","last_deep_scrub":"324'11","last_deep_scrub_stamp":"2024-02-19T21:46:05.210095+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.292909+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":3955294232,"num_objects":60354,"num_object_clones":0,"num_object_copies":181062,"num_objects_missing_on_primary":251,"num_objects_missing":251,"num_objects_degraded":726,"num_objects_misplaced":6275,"num_objects_unfound":0,"num_objects_dirty":60354,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":89142,"num_write_kb":4783809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11014,"num_bytes_recovered":710672384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12138328064,"data_stored":12138315848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80942,"ondisk_log_size":80942,"up":48,"acting":45,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1156,"num_read_kb":1151,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1107,"num_read_kb":864,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":277,"num_bytes_recovered":5172,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":776,"ondisk_log_size":776,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":22,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":66,"acting":66,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":382,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201518,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1103988,"kb_used_data":802668,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":92641164,"statfs":{"total":95995035648,"available":94864551936,"internally_reserved":0,"allocated":821932032,"data_stored":820578906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":1.49,"15min":1.839},"min":{"1min":0.23100000000000001,"5min":0.19400000000000001,"15min":0.189},"max":{"1min":0.57899999999999996,"5min":22.07,"15min":70.477999999999994},"last":0.311},{"interface":"front","average":{"1min":0.47099999999999997,"5min":1.548,"15min":2.0049999999999999},"min":{"1min":0.26800000000000002,"5min":0.21199999999999999,"15min":0.20999999999999999},"max":{"1min":1.1140000000000001,"5min":22.457000000000001,"15min":68.052000000000007},"last":0.47699999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":1.4319999999999999,"15min":2.048},"min":{"1min":0.27000000000000002,"5min":0.247,"15min":0.23200000000000001},"max":{"1min":0.434,"5min":22.117999999999999,"15min":68.168000000000006},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.624,"5min":1.796,"15min":2.1099999999999999},"min":{"1min":0.27300000000000002,"5min":0.26300000000000001,"15min":0.223},"max":{"1min":3.3319999999999999,"5min":22.236000000000001,"15min":68.444000000000003},"last":0.42499999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:51:12 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":2.028,"15min":2.2759999999999998},"min":{"1min":0.29999999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.673,"5min":12.304,"15min":12.304},"last":0.38},{"interface":"front","average":{"1min":0.52600000000000002,"5min":1.756,"15min":1.9610000000000001},"min":{"1min":0.28299999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":2.6840000000000002,"5min":11.69,"15min":11.69},"last":0.41499999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":1.595,"15min":2.1200000000000001},"min":{"1min":0.36799999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":3.0680000000000001,"5min":11.778,"15min":31.559000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.434,"5min":1.2490000000000001,"15min":1.8620000000000001},"min":{"1min":0.34100000000000003,"5min":0.30299999999999999,"15min":0.29299999999999998},"max":{"1min":0.68300000000000005,"5min":13.473000000000001,"15min":30.812999999999999},"last":0.439}]},{"osd":4,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":1.417,"15min":1.546},"min":{"1min":0.30399999999999999,"5min":0.245,"15min":0.216},"max":{"1min":1.173,"5min":17.716999999999999,"15min":17.716999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":1.7729999999999999,"15min":1.871},"min":{"1min":0.31900000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.67100000000000004,"5min":15.666,"15min":17.690999999999999},"last":0.39700000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":1.6200000000000001,"15min":1.6220000000000001},"min":{"1min":0.29599999999999999,"5min":0.28499999999999998,"15min":0.24199999999999999},"max":{"1min":1.6679999999999999,"5min":29.021000000000001,"15min":29.021000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":1.756,"15min":1.887},"min":{"1min":0.33900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.3700000000000001,"5min":29.091999999999999,"15min":29.091999999999999},"last":0.45800000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":1.9219999999999999,"15min":1.694},"min":{"1min":0.39500000000000002,"5min":0.31,"15min":0.24299999999999999},"max":{"1min":1.3919999999999999,"5min":19.286000000000001,"15min":19.286000000000001},"last":0.495},{"interface":"front","average":{"1min":0.52000000000000002,"5min":1.8200000000000001,"15min":1.8560000000000001},"min":{"1min":0.38700000000000001,"5min":0.309,"15min":0.26700000000000002},"max":{"1min":0.70599999999999996,"5min":18.364000000000001,"15min":18.364000000000001},"last":0.45300000000000001}]}]},{"osd":6,"up_from":47,"seq":201863463157,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2297204,"kb_used_data":1695212,"kb_used_omap":0,"kb_used_meta":601984,"kb_avail":91447948,"statfs":{"total":95995035648,"available":93642698752,"internally_reserved":0,"allocated":1735897088,"data_stored":1734543276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":616431616},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":1.004,"15min":1.653},"min":{"1min":0.25700000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":5.7069999999999999,"5min":8.8079999999999998,"15min":45.197000000000003},"last":0.35799999999999998},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.5920000000000001,"15min":2.0070000000000001},"min":{"1min":0.252,"5min":0.23499999999999999,"15min":0.221},"max":{"1min":6.1120000000000001,"5min":6.9699999999999998,"15min":44.753},"last":0.41199999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":1.276,"15min":1.6779999999999999},"min":{"1min":0.24299999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":3.3980000000000001,"5min":8.8469999999999995,"15min":45.231999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":1.3480000000000001,"15min":1.6910000000000001},"min":{"1min":0.33200000000000002,"5min":0.245,"15min":0.23100000000000001},"max":{"1min":2.0179999999999998,"5min":7.3570000000000002,"15min":45.097999999999999},"last":0.69799999999999995}]},{"osd":2,"last update":"Mon Feb 19 21:51:11 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.4430000000000001,"15min":1.528},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":6.1820000000000004,"5min":6.1820000000000004,"15min":6.1820000000000004},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":1.145,"15min":1.2270000000000001},"min":{"1min":0.32300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":3.258,"5min":7.8959999999999999,"15min":7.8959999999999999},"last":0.44500000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":1.2490000000000001,"15min":1.6080000000000001},"min":{"1min":0.34000000000000002,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":3.02,"5min":8.9009999999999998,"15min":11.15},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":1.49,"15min":1.625},"min":{"1min":0.36599999999999999,"5min":0.30599999999999999,"15min":0.246},"max":{"1min":1.9770000000000001,"5min":7.3970000000000002,"15min":19.632999999999999},"last":0.72399999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":2.0590000000000002,"15min":1.7749999999999999},"min":{"1min":0.308,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":6.1539999999999999,"5min":18.010000000000002,"15min":18.010000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":1.5529999999999999,"15min":1.716},"min":{"1min":0.28399999999999997,"5min":0.26300000000000001,"15min":0.23499999999999999},"max":{"1min":2.2919999999999998,"5min":11.566000000000001,"15min":16.594999999999999},"last":0.498}]},{"osd":5,"last update":"Mon Feb 19 21:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":1.9610000000000001,"15min":1.7909999999999999},"min":{"1min":0.315,"5min":0.27400000000000002,"15min":0.27100000000000002},"max":{"1min":6.2060000000000004,"5min":14.695,"15min":14.695},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":1.883,"15min":1.919},"min":{"1min":0.41599999999999998,"5min":0.28799999999999998,"15min":0.27900000000000003},"max":{"1min":2.4990000000000001,"5min":11.609999999999999,"15min":15.497999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:51:52 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":1.548,"15min":1.8089999999999999},"min":{"1min":0.32100000000000001,"5min":0.27200000000000002,"15min":0.26700000000000002},"max":{"1min":1.768,"5min":9.1929999999999996,"15min":14.721},"last":3.4609999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":1.5900000000000001,"15min":1.8580000000000001},"min":{"1min":0.39700000000000002,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":1.7989999999999999,"5min":9.2240000000000002,"15min":14.744999999999999},"last":3.492}]}]},{"osd":1,"up_from":13,"seq":55834575119,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1873796,"kb_used_data":973180,"kb_used_omap":0,"kb_used_meta":900608,"kb_avail":91871356,"statfs":{"total":95995035648,"available":94076268544,"internally_reserved":0,"allocated":996536320,"data_stored":995167024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":922222592},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:51:19 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.95499999999999996,"15min":1.502},"min":{"1min":0.20499999999999999,"5min":0.16300000000000001,"15min":0.161},"max":{"1min":0.77600000000000002,"5min":6.2789999999999999,"15min":42.776000000000003},"last":0.215},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.94499999999999995,"15min":1.5429999999999999},"min":{"1min":0.23300000000000001,"5min":0.193,"15min":0.16400000000000001},"max":{"1min":2.1680000000000001,"5min":6.2000000000000002,"15min":44.845999999999997},"last":0.32500000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:51:08 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.94999999999999996,"15min":1.038},"min":{"1min":0.22800000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.7270000000000001,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.89500000000000002,"15min":0.97299999999999998},"min":{"1min":0.254,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.6990000000000001,"5min":4.452,"15min":4.452},"last":0.30499999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:51:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.83999999999999997,"15min":1.6000000000000001},"min":{"1min":0.24399999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":2.2050000000000001,"5min":4.6639999999999997,"15min":41.607999999999997},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.91900000000000004,"15min":1.5249999999999999},"min":{"1min":0.28599999999999998,"5min":0.215,"15min":0.215},"max":{"1min":1.0129999999999999,"5min":4.5190000000000001,"15min":42.811999999999998},"last":0.41399999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:51:38 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":1.397,"15min":1.524},"min":{"1min":0.31900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.60899999999999999,"5min":15.853,"15min":15.853},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":1.2729999999999999,"15min":1.544},"min":{"1min":0.28100000000000003,"5min":0.28000000000000003,"15min":0.26500000000000001},"max":{"1min":1.7829999999999999,"5min":15.861000000000001,"15min":15.861000000000001},"last":0.54200000000000004}]},{"osd":5,"last update":"Mon Feb 19 21:51:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":1.496,"15min":1.637},"min":{"1min":0.30199999999999999,"5min":0.29599999999999999,"15min":0.27900000000000003},"max":{"1min":1.7529999999999999,"5min":14.331,"15min":14.331},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":1.5629999999999999,"15min":1.619},"min":{"1min":0.39600000000000002,"5min":0.307,"15min":0.30099999999999999},"max":{"1min":2.2309999999999999,"5min":14.496,"15min":14.496},"last":0.44500000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:51:38 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":1.343,"15min":1.6419999999999999},"min":{"1min":0.33200000000000002,"5min":0.32300000000000001,"15min":0.30099999999999999},"max":{"1min":0.64000000000000001,"5min":10.456,"15min":11.638999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":1.282,"15min":1.762},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.29699999999999999},"max":{"1min":0.77200000000000002,"5min":9.8049999999999997,"15min":12.199},"last":0.501}]},{"osd":7,"last update":"Mon Feb 19 21:51:57 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":1.2529999999999999,"15min":1.7509999999999999},"min":{"1min":0.35499999999999998,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":2.153,"5min":7.702,"15min":13.904},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":1.323,"15min":1.694},"min":{"1min":0.42799999999999999,"5min":0.35499999999999998,"15min":0.32600000000000001},"max":{"1min":2.4470000000000001,"5min":7.6909999999999998,"15min":13.894},"last":0.45600000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738645,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3322416,"kb_used_data":2423912,"kb_used_omap":0,"kb_used_meta":898496,"kb_avail":90422736,"statfs":{"total":95995035648,"available":92592881664,"internally_reserved":0,"allocated":2482085888,"data_stored":2480736111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":920059904},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:51:11 2024","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.71799999999999997,"15min":1.1120000000000001},"min":{"1min":0.20599999999999999,"5min":0.153,"15min":0.153},"max":{"1min":0.61299999999999999,"5min":6.1550000000000002,"15min":16.478000000000002},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.97899999999999998,"15min":1.3979999999999999},"min":{"1min":0.23300000000000001,"5min":0.17899999999999999,"15min":0.17799999999999999},"max":{"1min":3.452,"5min":6.9359999999999999,"15min":13.422000000000001},"last":0.246}]},{"osd":2,"last update":"Mon Feb 19 21:51:11 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.60699999999999998,"15min":0.64300000000000002},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":2.0619999999999998,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":1.0249999999999999,"15min":1.129},"min":{"1min":0.23699999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.69799999999999995,"5min":8.9960000000000004,"15min":8.9960000000000004},"last":0.41399999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:51:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":1.107,"15min":1.698},"min":{"1min":0.255,"5min":0.217,"15min":0.21299999999999999},"max":{"1min":3.2080000000000002,"5min":12.691000000000001,"15min":14.507999999999999},"last":1.4159999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.94099999999999995,"15min":1.5740000000000001},"min":{"1min":0.308,"5min":0.24099999999999999,"15min":0.23400000000000001},"max":{"1min":3.722,"5min":6.6150000000000002,"15min":18.759},"last":0.39000000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:51:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":1.3859999999999999,"15min":1.6579999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.252},"max":{"1min":1.179,"5min":10.311,"15min":13.278},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":1.3009999999999999,"15min":1.5149999999999999},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1850000000000001,"5min":10.109,"15min":10.109},"last":0.47299999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:51:01 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":1.911,"15min":2.097},"min":{"1min":0.32500000000000001,"5min":0.317,"15min":0.27600000000000002},"max":{"1min":3.52,"5min":25.442,"15min":42.799999999999997},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":1.9139999999999999,"15min":2.097},"min":{"1min":0.33200000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.597,"5min":25.411999999999999,"15min":42.695},"last":0.39600000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:51:16 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":1.544,"15min":1.6919999999999999},"min":{"1min":0.38700000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.749,"5min":10.278,"15min":42.777000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":1.714,"15min":1.9450000000000001},"min":{"1min":0.39100000000000001,"5min":0.29599999999999999,"15min":0.28599999999999998},"max":{"1min":2.1909999999999998,"5min":11.84,"15min":13.289999999999999},"last":0.36099999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:51:52 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":1.3149999999999999,"15min":1.778},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.31},"max":{"1min":3.198,"5min":15.688000000000001,"15min":42.758000000000003},"last":2.5259999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":1.3009999999999999,"15min":1.6739999999999999},"min":{"1min":0.40300000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":3.21,"5min":9.6389999999999993,"15min":42.718000000000004},"last":2.5379999999999998}]}]},{"osd":2,"up_from":394,"seq":1692217114658,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1992272,"kb_used_data":1668232,"kb_used_omap":0,"kb_used_meta":324031,"kb_avail":91752880,"statfs":{"total":95995035648,"available":93954949120,"internally_reserved":0,"allocated":1708269568,"data_stored":1706944003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":331807796},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,0,2,1,1,0,5,5,3],"upper_bound":4096},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":1.044,"15min":1.1259999999999999},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":4.6219999999999999,"5min":9.1530000000000005,"15min":9.1530000000000005},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":1.0589999999999999,"15min":1.1679999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":2.2919999999999998,"5min":6.149,"15min":6.149},"last":0.26500000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.56699999999999995,"15min":0.60299999999999998},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.69899999999999995,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":1.2230000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.89700000000000002,"15min":0.94399999999999995},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":4.6689999999999996,"5min":6.992,"15min":6.992},"last":0.505}]},{"osd":3,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":1.3169999999999999,"15min":1.405},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":6.0970000000000004,"5min":6.9470000000000001,"15min":6.9470000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":1.149,"15min":1.2450000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":2.258,"5min":6.6500000000000004,"15min":6.6500000000000004},"last":0.317}]},{"osd":4,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":1.867,"15min":2.0609999999999999},"min":{"1min":0.32600000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":3.8740000000000001,"5min":7.0339999999999998,"15min":7.0339999999999998},"last":1.399},{"interface":"front","average":{"1min":0.79800000000000004,"5min":1.7250000000000001,"15min":1.879},"min":{"1min":0.30299999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":4.7009999999999996,"5min":7.0419999999999998,"15min":7.0419999999999998},"last":0.65900000000000003}]},{"osd":5,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.6870000000000001,"15min":1.7549999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":5.9260000000000002,"5min":10.067,"15min":10.067},"last":1.9330000000000001},{"interface":"front","average":{"1min":0.63,"5min":1.5820000000000001,"15min":1.7410000000000001},"min":{"1min":0.34999999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":3.8730000000000002,"5min":13.558,"15min":13.558},"last":0.38400000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":1.5600000000000001,"15min":1.6879999999999999},"min":{"1min":0.33700000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":3.843,"5min":5.6829999999999998,"15min":5.6829999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.97199999999999998,"15min":1.018},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.2719999999999998,"5min":7,"15min":7},"last":2.024}]},{"osd":7,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.3740000000000001,"15min":1.427},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":4.1230000000000002,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.78000000000000003,"15min":0.82299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.67700000000000005,"5min":2.782,"15min":2.782},"last":1.429}]}]},{"osd":3,"up_from":0,"seq":111669149957,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":32,"seq":137438953726,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3257444,"kb_used_data":2671836,"kb_used_omap":0,"kb_used_meta":585600,"kb_avail":90487708,"statfs":{"total":95995035648,"available":92659412992,"internally_reserved":0,"allocated":2735960064,"data_stored":2734621623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":599654400},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:51:33 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":1.8839999999999999,"15min":1.8939999999999999},"min":{"1min":0.221,"5min":0.219,"15min":0.219},"max":{"1min":2.1869999999999998,"5min":53.936,"15min":53.936},"last":0.309},{"interface":"front","average":{"1min":0.84299999999999997,"5min":2.0939999999999999,"15min":2.0720000000000001},"min":{"1min":0.252,"5min":0.23599999999999999,"15min":0.22600000000000001},"max":{"1min":2.6640000000000001,"5min":54.405999999999999,"15min":54.405999999999999},"last":0.32500000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:51:33 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":1.9790000000000001,"15min":1.7529999999999999},"min":{"1min":0.253,"5min":0.22,"15min":0.21199999999999999},"max":{"1min":2.2130000000000001,"5min":54.731000000000002,"15min":54.731000000000002},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.83699999999999997,"5min":1.9330000000000001,"15min":1.6779999999999999},"min":{"1min":0.28299999999999997,"5min":0.252,"15min":0.25},"max":{"1min":2.903,"5min":52.490000000000002,"15min":52.490000000000002},"last":0.29499999999999998}]},{"osd":2,"last update":"Mon Feb 19 21:51:10 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":1.77,"15min":1.974},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.274,"5min":9.0619999999999994,"15min":9.0619999999999994},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":1.8069999999999999,"15min":2.0110000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.2930000000000001,"5min":9.0899999999999999,"15min":9.0899999999999999},"last":0.76000000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:51:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":1.462,"15min":1.6899999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.464,"5min":6.5579999999999998,"15min":15.914999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":1.4610000000000001,"15min":1.6819999999999999},"min":{"1min":0.30099999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":2.242,"5min":9.4000000000000004,"15min":13.321},"last":0.376}]},{"osd":5,"last update":"Mon Feb 19 21:51:25 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.9359999999999999,"15min":1.764},"min":{"1min":0.28199999999999997,"5min":0.23799999999999999,"15min":0.23400000000000001},"max":{"1min":3.02,"5min":16.731999999999999,"15min":18.916},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.83699999999999997,"5min":1.9359999999999999,"15min":1.96},"min":{"1min":0.29599999999999999,"5min":0.26700000000000002,"15min":0.253},"max":{"1min":2.4239999999999999,"5min":8.2959999999999994,"15min":14.840999999999999},"last":0.44500000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:51:33 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.7709999999999999,"15min":1.6459999999999999},"min":{"1min":0.33000000000000002,"5min":0.28999999999999998,"15min":0.28599999999999998},"max":{"1min":2.9289999999999998,"5min":9.1720000000000006,"15min":13.27},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.92500000000000004,"5min":2.101,"15min":1.8480000000000001},"min":{"1min":0.31900000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":2.9390000000000001,"5min":18.670000000000002,"15min":18.670000000000002},"last":0.435}]},{"osd":7,"last update":"Mon Feb 19 21:51:00 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":2.1309999999999998,"15min":1.7669999999999999},"min":{"1min":0.34599999999999997,"5min":0.311,"15min":0.28899999999999998},"max":{"1min":2.4780000000000002,"5min":16.763999999999999,"15min":16.763999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.63,"5min":1.71,"15min":1.6859999999999999},"min":{"1min":0.377,"5min":0.314,"15min":0.31},"max":{"1min":1.23,"5min":10.044,"15min":12.808999999999999},"last":0.58899999999999997}]}]},{"osd":5,"up_from":38,"seq":163208757498,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2545368,"kb_used_data":1659024,"kb_used_omap":0,"kb_used_meta":886336,"kb_avail":91199784,"statfs":{"total":95995035648,"available":93388578816,"internally_reserved":0,"allocated":1698840576,"data_stored":1697514522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":907608064},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":1.5169999999999999,"15min":1.7729999999999999},"min":{"1min":0.23100000000000001,"5min":0.214,"15min":0.20599999999999999},"max":{"1min":5.9550000000000001,"5min":19.236000000000001,"15min":20.550999999999998},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":1.4850000000000001,"15min":1.9059999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.20899999999999999},"max":{"1min":3.7949999999999999,"5min":10.887,"15min":20.879000000000001},"last":0.41899999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":1.462,"15min":1.726},"min":{"1min":0.28100000000000003,"5min":0.24299999999999999,"15min":0.23100000000000001},"max":{"1min":2.3220000000000001,"5min":8.2010000000000005,"15min":10.42},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.51400000000000001,"5min":1.506,"15min":1.6100000000000001},"min":{"1min":0.28299999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.522,"5min":10.965,"15min":10.965},"last":2.794}]},{"osd":2,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.29,"15min":1.361},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":7.0380000000000003,"5min":7.0380000000000003,"15min":7.0380000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.2450000000000001,"15min":1.29},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.1869999999999998,"5min":4.2619999999999996,"15min":4.2619999999999996},"last":0.313}]},{"osd":3,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":1.804,"15min":2.0779999999999998},"min":{"1min":0.35099999999999998,"5min":0.26100000000000001,"15min":0.24099999999999999},"max":{"1min":3.6320000000000001,"5min":19.321000000000002,"15min":20.146999999999998},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.5169999999999999,"15min":2.1520000000000001},"min":{"1min":0.33600000000000002,"5min":0.311,"15min":0.29499999999999998},"max":{"1min":3.6400000000000001,"5min":8.0359999999999996,"15min":20.120000000000001},"last":0.39100000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:51:09 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":1.4239999999999999,"15min":1.393},"min":{"1min":0.255,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.0449999999999999,"5min":16.643999999999998,"15min":21.577000000000002},"last":2.7280000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":1.913,"15min":1.883},"min":{"1min":0.32600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.3999999999999999,"5min":19.274000000000001,"15min":19.274000000000001},"last":0.48099999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:51:33 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":2.0529999999999999,"15min":1.9259999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.221},"max":{"1min":5.8819999999999997,"5min":19.884,"15min":19.884},"last":0.503},{"interface":"front","average":{"1min":0.66800000000000004,"5min":1.6799999999999999,"15min":1.8660000000000001},"min":{"1min":0.30199999999999999,"5min":0.26700000000000002,"15min":0.23599999999999999},"max":{"1min":2.1099999999999999,"5min":10.260999999999999,"15min":13.532999999999999},"last":2.6440000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":1.7110000000000001,"15min":2.0150000000000001},"min":{"1min":0.34200000000000003,"5min":0.33500000000000002,"15min":0.27100000000000002},"max":{"1min":1.976,"5min":12.611000000000001,"15min":12.962},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":1.611,"15min":1.843},"min":{"1min":0.38100000000000001,"5min":0.221,"15min":0.221},"max":{"1min":2.0099999999999998,"5min":15.593999999999999,"15min":17.759},"last":2.766}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2474250240,"data_stored":2474246168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":990576640,"data_stored":990576640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1704132608,"data_stored":1704132608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2729906176,"data_stored":2729902104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1693057024,"data_stored":1693057024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1730482176,"data_stored":1730478104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":815923200,"data_stored":815923200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:52:03.800 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph status --format=json 2024-02-19T21:52:03.812 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:52:03.814 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:03.815 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:52:03.915 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:52:03.948 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:03.972 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:52:03.974 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:03.975 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:52:04.075 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:52:04.108 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:04.120 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:52:04.130 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:52:04.133 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:04.134 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:52:04.234 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:52:04.262 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:04.537 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:52:04.810 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:52:04.814 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:04.814 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:52:04.915 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:52:04.946 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:05.051 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:52:05.054 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:05.054 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:52:05.073 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:03.200610+0000 mgr.y (mgr.14514) 744 : cluster [DBG] pgmap v968: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.7 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 648 B/s rd, 0 B/s wr, 140 op/s; 666/181284 objects degraded (0.367%); 6214/181284 objects misplaced (3.428%); 2.3 MiB/s, 37 objects/s recovering 2024-02-19T21:52:05.073 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:03.965544+0000 mon.a (mon.0) 1782 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:52:05.073 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:03.200610+0000 mgr.y (mgr.14514) 744 : cluster [DBG] pgmap v968: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.7 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 648 B/s rd, 0 B/s wr, 140 op/s; 666/181284 objects degraded (0.367%); 6214/181284 objects misplaced (3.428%); 2.3 MiB/s, 37 objects/s recovering 2024-02-19T21:52:05.073 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:03.965544+0000 mon.a (mon.0) 1782 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:52:05.155 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:52:05.186 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:05.214 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:03.200610+0000 mgr.y (mgr.14514) 744 : cluster [DBG] pgmap v968: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.7 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 648 B/s rd, 0 B/s wr, 140 op/s; 666/181284 objects degraded (0.367%); 6214/181284 objects misplaced (3.428%); 2.3 MiB/s, 37 objects/s recovering 2024-02-19T21:52:05.214 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:03.965544+0000 mon.a (mon.0) 1782 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:52:05.389 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:52:05.392 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:05.393 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:52:05.431 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:52:05.493 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:52:05.522 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:05.770 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:52:05.774 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:52:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:52:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:52:05.775 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:05.776 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:52:05.877 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:52:05.908 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:05.969 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:05.306019+0000 mon.a (mon.0) 1783 : cluster [WRN] Health check update: Degraded data redundancy: 666/181284 objects degraded (0.367%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:05.970 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:05.306019+0000 mon.a (mon.0) 1783 : cluster [WRN] Health check update: Degraded data redundancy: 666/181284 objects degraded (0.367%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:06.044 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:05.306019+0000 mon.a (mon.0) 1783 : cluster [WRN] Health check update: Degraded data redundancy: 666/181284 objects degraded (0.367%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:06.258 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:52:06.261 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:06.261 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:52:06.362 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:52:06.369 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:52:06.369 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:52:06.391 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:06.539 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:52:06.541 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:06.542 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:52:06.547 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:52:06.643 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:52:06.671 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:06.774 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:52:06.777 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:06.778 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:52:06.879 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:52:06.906 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:07.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:05.201257+0000 mgr.y (mgr.14514) 745 : cluster [DBG] pgmap v969: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.6 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 172 op/s; 608/179865 objects degraded (0.338%); 6214/179865 objects misplaced (3.455%); 1.8 MiB/s, 29 objects/s recovering 2024-02-19T21:52:07.322 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:52:07.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:05.201257+0000 mgr.y (mgr.14514) 745 : cluster [DBG] pgmap v969: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.6 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 172 op/s; 608/179865 objects degraded (0.338%); 6214/179865 objects misplaced (3.455%); 1.8 MiB/s, 29 objects/s recovering 2024-02-19T21:52:07.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:05.201257+0000 mgr.y (mgr.14514) 745 : cluster [DBG] pgmap v969: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.6 GiB data, 16 GiB used, 610 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 172 op/s; 608/179865 objects degraded (0.338%); 6214/179865 objects misplaced (3.455%); 1.8 MiB/s, 29 objects/s recovering 2024-02-19T21:52:07.355 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.4 dump_historic_ops 2024-02-19T21:52:07.358 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:52:07.360 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:07.360 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:52:07.461 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:52:07.494 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:07.675 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:52:07.943 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:52:07.945 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:07.946 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:52:07.987 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-02-19T21:52:08.047 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:52:08.078 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:08.204 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:07.053151+0000 mon.c (mon.2) 112 : audit [INF] from='client.? 172.21.15.80:0/1898889294' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:52:08.204 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:07.053462+0000 mon.a (mon.0) 1784 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:52:08.204 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:07.053151+0000 mon.c (mon.2) 112 : audit [INF] from='client.? 172.21.15.80:0/1898889294' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:52:08.204 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:07.053462+0000 mon.a (mon.0) 1784 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:52:08.208 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:52:08.211 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:08.211 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:52:08.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:07.053151+0000 mon.c (mon.2) 112 : audit [INF] from='client.? 172.21.15.80:0/1898889294' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:52:08.582 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:07.053462+0000 mon.a (mon.0) 1784 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:52:08.582 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:52:08.612 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:09.305 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:07.201987+0000 mgr.y (mgr.14514) 746 : cluster [DBG] pgmap v970: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.6 GiB data, 15 GiB used, 610 GiB / 626 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 201 op/s; 488/178614 objects degraded (0.273%); 6094/178614 objects misplaced (3.412%); 2.5 MiB/s, 39 objects/s recovering 2024-02-19T21:52:09.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:07.970637+0000 mon.a (mon.0) 1785 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:52:09.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:07.984808+0000 mon.a (mon.0) 1786 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:52:09.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:07.984866+0000 mon.a (mon.0) 1787 : cluster [DBG] osdmap e461: 8 total, 8 up, 7 in 2024-02-19T21:52:09.341 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:07.201987+0000 mgr.y (mgr.14514) 746 : cluster [DBG] pgmap v970: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.6 GiB data, 15 GiB used, 610 GiB / 626 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 201 op/s; 488/178614 objects degraded (0.273%); 6094/178614 objects misplaced (3.412%); 2.5 MiB/s, 39 objects/s recovering 2024-02-19T21:52:09.341 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:07.970637+0000 mon.a (mon.0) 1785 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:52:09.341 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:07.984808+0000 mon.a (mon.0) 1786 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:52:09.341 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:07.984866+0000 mon.a (mon.0) 1787 : cluster [DBG] osdmap e461: 8 total, 8 up, 7 in 2024-02-19T21:52:09.342 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:07.201987+0000 mgr.y (mgr.14514) 746 : cluster [DBG] pgmap v970: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.6 GiB data, 15 GiB used, 610 GiB / 626 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 201 op/s; 488/178614 objects degraded (0.273%); 6094/178614 objects misplaced (3.412%); 2.5 MiB/s, 39 objects/s recovering 2024-02-19T21:52:09.342 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:07.970637+0000 mon.a (mon.0) 1785 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:52:09.342 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:07.984808+0000 mon.a (mon.0) 1786 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:52:09.342 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:07.984866+0000 mon.a (mon.0) 1787 : cluster [DBG] osdmap e461: 8 total, 8 up, 7 in 2024-02-19T21:52:09.463 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:52:09.466 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:09.466 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:52:09.514 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:52:09.514 INFO:teuthology.orchestra.run.smithi080.stdout:{"fsid":"6f763558-cf6d-11ee-95bb-87774f69a715","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"nodeep-scrub flag(s) set","count":12},"muted":false},"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 488/178614 objects degraded (0.273%), 3 pgs degraded, 3 pgs undersized","count":6},"muted":false}},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1416,"monmap":{"epoch":3,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":461,"num_osds":8,"num_up_osds":8,"osd_up_since":1708379347,"num_in_osds":7,"osd_in_since":1708379252,"num_remapped_pgs":3},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":135},{"state_name":"active+recovering+undersized+degraded+remapped","count":3}],"num_pgs":138,"num_pools":7,"num_objects":59538,"data_bytes":3889239740,"bytes_used":16590249984,"bytes_avail":655374999552,"bytes_total":671965249536,"degraded_objects":488,"degraded_total":178614,"degraded_ratio":0.0027321486557604661,"misplaced_objects":6094,"misplaced_total":178614,"misplaced_ratio":0.034118266205336645,"recovering_objects_per_sec":39,"recovering_bytes_per_sec":2601609,"recovering_keys_per_sec":0,"num_objects_recovered":355,"num_bytes_recovered":23265280,"num_keys_recovered":0,"read_bytes_sec":1145,"write_bytes_sec":0,"read_op_per_sec":1,"write_op_per_sec":200},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"services":{"dashboard":"https://172.21.15.80:8443/","prometheus":"http://172.21.15.80:9283/"}},"servicemap":{"epoch":15,"modified":"2024-02-19T21:50:07.164150+0000","services":{"rgw":{"daemons":{"summary":"","14445":{"start_epoch":12,"start_stamp":"2024-02-19T21:32:30.457944+0000","gid":14445,"addr":"172.21.15.80:0/10763483","metadata":{"arch":"x86_64","ceph_release":"pacific","ceph_version":"ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)","ceph_version_short":"16.2.14-548-g81bd20d6","container_hostname":"smithi080","container_image":"quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9","cpu":"Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz","distro":"centos","distro_description":"CentOS Stream 8","distro_version":"8","frontend_config#0":"beast port=80","frontend_type#0":"beast","hostname":"smithi080","id":"foo.a","kernel_description":"#1 SMP Mon Feb 5 18:34:56 UTC 2024","kernel_version":"4.18.0-539.el8.x86_64","mem_swap_kb":"0","mem_total_kb":"32537572","num_handles":"1","os":"Linux","pid":"7","realm_id":"","realm_name":"","zone_id":"34a855d6-dbbc-4802-a6e9-a7d60f23c9d4","zone_name":"default","zonegroup_id":"7194a06a-53d8-4b5f-8306-5954e6d460c8","zonegroup_name":"default"},"task_status":{}}}}}},"progress_events":{"0d84ec8e-b738-4996-b3e9-d3d54263ac3b":{"message":"Global Recovery Event (4m)\n [===========================.] (remaining: 6s)","progress":0.97826087474822998,"add_to_ceph_s":true}}} 2024-02-19T21:52:09.567 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:52:09.607 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:10.194 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:09.515106+0000 mon.b (mon.1) 70 : audit [DBG] from='client.? 172.21.15.80:0/2498814667' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-02-19T21:52:10.195 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:09.515106+0000 mon.b (mon.1) 70 : audit [DBG] from='client.? 172.21.15.80:0/2498814667' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-02-19T21:52:10.223 INFO:tasks.cephadm.ceph_manager.ceph:making progress, resetting timeout 2024-02-19T21:52:10.224 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:52:10.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:09.515106+0000 mon.b (mon.1) 70 : audit [DBG] from='client.? 172.21.15.80:0/2498814667' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-02-19T21:52:10.539 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:52:10.542 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:10.542 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:52:10.643 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:52:10.674 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:10.845 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:52:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:52:10] "GET /metrics HTTP/1.1" 200 176560 "" "Prometheus/2.33.4" 2024-02-19T21:52:10.913 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:52:10.913 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:52:10.922 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:52:10.926 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:10.927 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:52:10.997 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-19T21:52:11.027 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:52:11.060 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:11.169 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:52:11.174 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:11.175 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:52:11.275 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:52:11.305 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:52:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:52:11.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:09.202344+0000 mgr.y (mgr.14514) 747 : cluster [DBG] pgmap v972: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.6 GiB data, 15 GiB used, 610 GiB / 626 GiB avail; 575 B/s rd, 0 B/s wr, 126 op/s; 488/178614 objects degraded (0.273%); 6094/178614 objects misplaced (3.412%); 2.1 MiB/s, 33 objects/s recovering 2024-02-19T21:52:11.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:10.307333+0000 mon.a (mon.0) 1788 : cluster [WRN] Health check update: Degraded data redundancy: 488/178614 objects degraded (0.273%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:11.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:10.313984+0000 mon.a (mon.0) 1789 : cluster [DBG] osdmap e462: 8 total, 8 up, 7 in 2024-02-19T21:52:11.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:09.202344+0000 mgr.y (mgr.14514) 747 : cluster [DBG] pgmap v972: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.6 GiB data, 15 GiB used, 610 GiB / 626 GiB avail; 575 B/s rd, 0 B/s wr, 126 op/s; 488/178614 objects degraded (0.273%); 6094/178614 objects misplaced (3.412%); 2.1 MiB/s, 33 objects/s recovering 2024-02-19T21:52:11.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:10.307333+0000 mon.a (mon.0) 1788 : cluster [WRN] Health check update: Degraded data redundancy: 488/178614 objects degraded (0.273%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:11.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:10.313984+0000 mon.a (mon.0) 1789 : cluster [DBG] osdmap e462: 8 total, 8 up, 7 in 2024-02-19T21:52:11.310 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:11.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:09.202344+0000 mgr.y (mgr.14514) 747 : cluster [DBG] pgmap v972: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.6 GiB data, 15 GiB used, 610 GiB / 626 GiB avail; 575 B/s rd, 0 B/s wr, 126 op/s; 488/178614 objects degraded (0.273%); 6094/178614 objects misplaced (3.412%); 2.1 MiB/s, 33 objects/s recovering 2024-02-19T21:52:11.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:10.307333+0000 mon.a (mon.0) 1788 : cluster [WRN] Health check update: Degraded data redundancy: 488/178614 objects degraded (0.273%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:11.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:10.313984+0000 mon.a (mon.0) 1789 : cluster [DBG] osdmap e462: 8 total, 8 up, 7 in 2024-02-19T21:52:11.393 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:52:11.397 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:52:11.401 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:11.401 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:52:11.502 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:52:11.533 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:11.682 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:52:11.686 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:11.686 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:52:11.760 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.5 dump_ops_in_flight 2024-02-19T21:52:11.787 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:52:11.816 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:12.067 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:52:12.311 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:52:12.311 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:52:12.311 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:52:12.311 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:52:12.312 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:52:12.312 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:52:12.312 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:52:12.312 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:52:12.312 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:52:12.312 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:52:12.312 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:52:12.312 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:52:12.312 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:52:12.312 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:52:12.312 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:52:12.312 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:52:12.579 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:10.559845+0000 osd.6 (osd.6) 242 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:52:12.580 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:10.559894+0000 osd.6 (osd.6) 243 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:52:12.580 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:11.064722+0000 mgr.y (mgr.14514) 748 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:52:12.580 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:11.202798+0000 mgr.y (mgr.14514) 749 : cluster [DBG] pgmap v974: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.6 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 207 op/s; 372/176334 objects degraded (0.211%); 6036/176334 objects misplaced (3.423%); 2.3 MiB/s, 36 objects/s recovering 2024-02-19T21:52:12.580 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:11.325208+0000 mon.a (mon.0) 1790 : cluster [DBG] osdmap e463: 8 total, 8 up, 7 in 2024-02-19T21:52:12.580 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:11.924710+0000 mon.c (mon.2) 113 : audit [DBG] from='client.? 172.21.15.80:0/3559012446' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:52:12.595 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:10.559845+0000 osd.6 (osd.6) 242 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:52:12.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:10.559894+0000 osd.6 (osd.6) 243 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:52:12.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:11.064722+0000 mgr.y (mgr.14514) 748 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:52:12.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:11.202798+0000 mgr.y (mgr.14514) 749 : cluster [DBG] pgmap v974: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.6 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 207 op/s; 372/176334 objects degraded (0.211%); 6036/176334 objects misplaced (3.423%); 2.3 MiB/s, 36 objects/s recovering 2024-02-19T21:52:12.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:11.325208+0000 mon.a (mon.0) 1790 : cluster [DBG] osdmap e463: 8 total, 8 up, 7 in 2024-02-19T21:52:12.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:11.924710+0000 mon.c (mon.2) 113 : audit [DBG] from='client.? 172.21.15.80:0/3559012446' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:52:12.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:10.559845+0000 osd.6 (osd.6) 242 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:52:12.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:10.559894+0000 osd.6 (osd.6) 243 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:52:12.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:11.064722+0000 mgr.y (mgr.14514) 748 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:52:12.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:11.202798+0000 mgr.y (mgr.14514) 749 : cluster [DBG] pgmap v974: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.6 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 207 op/s; 372/176334 objects degraded (0.211%); 6036/176334 objects misplaced (3.423%); 2.3 MiB/s, 36 objects/s recovering 2024-02-19T21:52:12.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:11.325208+0000 mon.a (mon.0) 1790 : cluster [DBG] osdmap e463: 8 total, 8 up, 7 in 2024-02-19T21:52:12.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:11.924710+0000 mon.c (mon.2) 113 : audit [DBG] from='client.? 172.21.15.80:0/3559012446' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:52:13.077 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:52:13.080 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:13.080 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:52:13.118 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:52:13.181 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:52:13.210 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:13.232 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:52:13.240 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:13.240 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:52:13.341 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:52:13.379 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:13.402 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:52:13.405 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:13.406 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:52:13.507 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:52:13.533 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:13.561 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:52:13.567 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:13.568 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:52:13.668 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:52:13.715 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:13.848 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:52:13.851 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:13.852 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:52:13.953 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:52:13.977 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:52:13.977 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [], 2024-02-19T21:52:13.977 INFO:teuthology.orchestra.run.smithi157.stdout: "num_ops": 0 2024-02-19T21:52:13.977 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:52:13.980 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:14.004 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:52:14.006 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:14.007 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:52:14.108 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:52:14.140 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:14.216 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:52:14.219 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:14.219 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:52:14.320 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:52:14.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:13.203229+0000 mgr.y (mgr.14514) 750 : cluster [DBG] pgmap v976: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.6 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 146 op/s; 310/175986 objects degraded (0.176%); 5974/175986 objects misplaced (3.395%); 1.9 MiB/s, 29 objects/s recovering 2024-02-19T21:52:14.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:13.203229+0000 mgr.y (mgr.14514) 750 : cluster [DBG] pgmap v976: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.6 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 146 op/s; 310/175986 objects degraded (0.176%); 5974/175986 objects misplaced (3.395%); 1.9 MiB/s, 29 objects/s recovering 2024-02-19T21:52:14.352 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:14.656 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:52:14.659 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:52:14.756 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:13.203229+0000 mgr.y (mgr.14514) 750 : cluster [DBG] pgmap v976: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.6 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 146 op/s; 310/175986 objects degraded (0.176%); 5974/175986 objects misplaced (3.395%); 1.9 MiB/s, 29 objects/s recovering 2024-02-19T21:52:14.778 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.5 dump_blocked_ops 2024-02-19T21:52:14.811 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:52:14.814 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:14.815 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:52:14.915 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:52:14.944 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:15.019 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:52:15.022 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:15.022 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:52:15.071 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:52:15.117 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:52:15.123 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:52:15.154 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:15.403 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:14.642225+0000 mgr.y (mgr.14514) 751 : audit [DBG] from='client.15909 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:52:15.403 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:15.309827+0000 mon.a (mon.0) 1791 : cluster [WRN] Health check update: Degraded data redundancy: 310/175986 objects degraded (0.176%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:15.403 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:15.314867+0000 mon.a (mon.0) 1792 : cluster [DBG] osdmap e464: 8 total, 8 up, 7 in 2024-02-19T21:52:15.409 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:52:15.413 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:15.413 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:52:15.514 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:52:15.543 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:15.589 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:14.642225+0000 mgr.y (mgr.14514) 751 : audit [DBG] from='client.15909 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:52:15.589 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:15.309827+0000 mon.a (mon.0) 1791 : cluster [WRN] Health check update: Degraded data redundancy: 310/175986 objects degraded (0.176%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:15.589 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:15.314867+0000 mon.a (mon.0) 1792 : cluster [DBG] osdmap e464: 8 total, 8 up, 7 in 2024-02-19T21:52:15.589 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:14.642225+0000 mgr.y (mgr.14514) 751 : audit [DBG] from='client.15909 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:52:15.589 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:15.309827+0000 mon.a (mon.0) 1791 : cluster [WRN] Health check update: Degraded data redundancy: 310/175986 objects degraded (0.176%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:15.589 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:15.314867+0000 mon.a (mon.0) 1792 : cluster [DBG] osdmap e464: 8 total, 8 up, 7 in 2024-02-19T21:52:15.590 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":976,"stamp":"2024-02-19T21:52:13.202948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3831830204,"num_objects":58662,"num_object_clones":0,"num_object_copies":175986,"num_objects_missing_on_primary":68,"num_objects_missing":68,"num_objects_degraded":310,"num_objects_misplaced":5974,"num_objects_unfound":0,"num_objects_dirty":58662,"num_whiteouts":0,"num_read":2291,"num_read_kb":2043,"num_write":91738,"num_write_kb":4783849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11720,"num_bytes_recovered":738007944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81871,"ondisk_log_size":81871,"up":414,"acting":411,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":417,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":656216064,"kb_used":16048244,"kb_used_data":11557948,"kb_used_omap":0,"kb_used_meta":4490175,"kb_avail":640167820,"statfs":{"total":671965249536,"available":655531847680,"internally_reserved":0,"allocated":11835338752,"data_stored":11825854221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":4597939252},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-57409536,"num_objects":-876,"num_object_clones":0,"num_object_copies":-2628,"num_objects_missing_on_primary":-62,"num_objects_missing":-62,"num_objects_degraded":-178,"num_objects_misplaced":-120,"num_objects_unfound":0,"num_objects_dirty":-876,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":876,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":11665408,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001523"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":57,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.320746+0000","last_change":"2024-02-19T21:49:54.492937+0000","last_active":"2024-02-19T21:52:00.320746+0000","last_peered":"2024-02-19T21:52:00.320746+0000","last_clean":"2024-02-19T21:52:00.320746+0000","last_became_active":"2024-02-19T21:49:54.492544+0000","last_became_peered":"2024-02-19T21:49:54.492544+0000","last_unstale":"2024-02-19T21:52:00.320746+0000","last_undegraded":"2024-02-19T21:52:00.320746+0000","last_fullsized":"2024-02-19T21:52:00.320746+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.643236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.643236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":436,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.318911+0000","last_change":"2024-02-19T21:45:17.201007+0000","last_active":"2024-02-19T21:52:00.318911+0000","last_peered":"2024-02-19T21:52:00.318911+0000","last_clean":"2024-02-19T21:52:00.318911+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:52:00.318911+0000","last_undegraded":"2024-02-19T21:52:00.318911+0000","last_fullsized":"2024-02-19T21:52:00.318911+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:17.200897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:17.200897+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"201'27","reported_seq":107,"reported_epoch":462,"state":"active+clean","last_fresh":"2024-02-19T21:52:10.316017+0000","last_change":"2024-02-19T21:49:08.327817+0000","last_active":"2024-02-19T21:52:10.316017+0000","last_peered":"2024-02-19T21:52:10.316017+0000","last_clean":"2024-02-19T21:52:10.316017+0000","last_became_active":"2024-02-19T21:49:08.327416+0000","last_became_peered":"2024-02-19T21:49:08.327416+0000","last_unstale":"2024-02-19T21:52:10.316017+0000","last_undegraded":"2024-02-19T21:52:10.316017+0000","last_fullsized":"2024-02-19T21:52:10.316017+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'27","last_scrub_stamp":"2024-02-19T21:44:48.022013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:48.022013+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":409,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.308039+0000","last_change":"2024-02-19T21:48:30.516215+0000","last_active":"2024-02-19T21:52:00.308039+0000","last_peered":"2024-02-19T21:52:00.308039+0000","last_clean":"2024-02-19T21:52:00.308039+0000","last_became_active":"2024-02-19T21:47:46.250178+0000","last_became_peered":"2024-02-19T21:47:46.250178+0000","last_unstale":"2024-02-19T21:52:00.308039+0000","last_undegraded":"2024-02-19T21:52:00.308039+0000","last_fullsized":"2024-02-19T21:52:00.308039+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.516139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.516139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":132,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.319345+0000","last_change":"2024-02-19T21:49:08.330105+0000","last_active":"2024-02-19T21:52:00.319345+0000","last_peered":"2024-02-19T21:52:00.319345+0000","last_clean":"2024-02-19T21:52:00.319345+0000","last_became_active":"2024-02-19T21:49:08.328994+0000","last_became_peered":"2024-02-19T21:49:08.328994+0000","last_unstale":"2024-02-19T21:52:00.319345+0000","last_undegraded":"2024-02-19T21:52:00.319345+0000","last_fullsized":"2024-02-19T21:52:00.319345+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.636083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.636083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"200'19","reported_seq":505,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.307840+0000","last_change":"2024-02-19T21:48:26.530234+0000","last_active":"2024-02-19T21:52:00.307840+0000","last_peered":"2024-02-19T21:52:00.307840+0000","last_clean":"2024-02-19T21:52:00.307840+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:52:00.307840+0000","last_undegraded":"2024-02-19T21:52:00.307840+0000","last_fullsized":"2024-02-19T21:52:00.307840+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:48:26.530160+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.530160+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":194,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:07.989673+0000","last_change":"2024-02-19T21:49:08.332091+0000","last_active":"2024-02-19T21:52:07.989673+0000","last_peered":"2024-02-19T21:52:07.989673+0000","last_clean":"2024-02-19T21:52:07.989673+0000","last_became_active":"2024-02-19T21:49:08.331753+0000","last_became_peered":"2024-02-19T21:49:08.331753+0000","last_unstale":"2024-02-19T21:52:07.989673+0000","last_undegraded":"2024-02-19T21:52:07.989673+0000","last_fullsized":"2024-02-19T21:52:07.989673+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.005236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.005236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":449,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.321195+0000","last_change":"2024-02-19T21:48:28.327028+0000","last_active":"2024-02-19T21:52:00.321195+0000","last_peered":"2024-02-19T21:52:00.321195+0000","last_clean":"2024-02-19T21:52:00.321195+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:52:00.321195+0000","last_undegraded":"2024-02-19T21:52:00.321195+0000","last_fullsized":"2024-02-19T21:52:00.321195+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.326938+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"310'9","reported_seq":423,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:09.185412+0000","last_change":"2024-02-19T21:52:09.186074+0000","last_active":"2024-02-19T21:52:09.185412+0000","last_peered":"2024-02-19T21:52:09.185412+0000","last_clean":"2024-02-19T21:52:09.185412+0000","last_became_active":"2024-02-19T21:49:08.329314+0000","last_became_peered":"2024-02-19T21:49:08.329314+0000","last_unstale":"2024-02-19T21:52:09.185412+0000","last_undegraded":"2024-02-19T21:52:09.185412+0000","last_fullsized":"2024-02-19T21:52:09.185412+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"310'9","last_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_deep_scrub":"310'9","last_deep_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.506188+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":370,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.319001+0000","last_change":"2024-02-19T21:46:31.205220+0000","last_active":"2024-02-19T21:52:00.319001+0000","last_peered":"2024-02-19T21:52:00.319001+0000","last_clean":"2024-02-19T21:52:00.319001+0000","last_became_active":"2024-02-19T21:46:31.204816+0000","last_became_peered":"2024-02-19T21:46:31.204816+0000","last_unstale":"2024-02-19T21:52:00.319001+0000","last_undegraded":"2024-02-19T21:52:00.319001+0000","last_fullsized":"2024-02-19T21:52:00.319001+0000","mapping_epoch":330,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":331,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:36.890201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.890201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":471,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.321131+0000","last_change":"2024-02-19T21:49:08.330669+0000","last_active":"2024-02-19T21:52:00.321131+0000","last_peered":"2024-02-19T21:52:00.321131+0000","last_clean":"2024-02-19T21:52:00.321131+0000","last_became_active":"2024-02-19T21:49:08.329998+0000","last_became_peered":"2024-02-19T21:49:08.329998+0000","last_unstale":"2024-02-19T21:52:00.321131+0000","last_undegraded":"2024-02-19T21:52:00.321131+0000","last_fullsized":"2024-02-19T21:52:00.321131+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:58.329316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:58.329316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"200'19","reported_seq":315,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.308320+0000","last_change":"2024-02-19T21:49:08.326162+0000","last_active":"2024-02-19T21:52:00.308320+0000","last_peered":"2024-02-19T21:52:00.308320+0000","last_clean":"2024-02-19T21:52:00.308320+0000","last_became_active":"2024-02-19T21:49:08.325802+0000","last_became_peered":"2024-02-19T21:49:08.325802+0000","last_unstale":"2024-02-19T21:52:00.308320+0000","last_undegraded":"2024-02-19T21:52:00.308320+0000","last_fullsized":"2024-02-19T21:52:00.308320+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:46:54.873416+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:46:54.873416+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2],"acting":[4,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":381,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.371026+0000","last_change":"2024-02-19T21:49:04.432817+0000","last_active":"2024-02-19T21:52:00.371026+0000","last_peered":"2024-02-19T21:52:00.371026+0000","last_clean":"2024-02-19T21:52:00.371026+0000","last_became_active":"2024-02-19T21:47:33.393708+0000","last_became_peered":"2024-02-19T21:47:33.393708+0000","last_unstale":"2024-02-19T21:52:00.371026+0000","last_undegraded":"2024-02-19T21:52:00.371026+0000","last_fullsized":"2024-02-19T21:52:00.371026+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:04.432733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:04.432733+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":57,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.320827+0000","last_change":"2024-02-19T21:49:54.492767+0000","last_active":"2024-02-19T21:52:00.320827+0000","last_peered":"2024-02-19T21:52:00.320827+0000","last_clean":"2024-02-19T21:52:00.320827+0000","last_became_active":"2024-02-19T21:49:54.491745+0000","last_became_peered":"2024-02-19T21:49:54.491745+0000","last_unstale":"2024-02-19T21:52:00.320827+0000","last_undegraded":"2024-02-19T21:52:00.320827+0000","last_fullsized":"2024-02-19T21:52:00.320827+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.232539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.232539+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1d","version":"201'18","reported_seq":399,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.310827+0000","last_change":"2024-02-19T21:48:25.734661+0000","last_active":"2024-02-19T21:52:00.310827+0000","last_peered":"2024-02-19T21:52:00.310827+0000","last_clean":"2024-02-19T21:52:00.310827+0000","last_became_active":"2024-02-19T21:38:31.247067+0000","last_became_peered":"2024-02-19T21:38:31.247067+0000","last_unstale":"2024-02-19T21:52:00.310827+0000","last_undegraded":"2024-02-19T21:52:00.310827+0000","last_fullsized":"2024-02-19T21:52:00.310827+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'18","last_scrub_stamp":"2024-02-19T21:48:25.734591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.734591+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":436,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.309101+0000","last_change":"2024-02-19T21:48:40.528082+0000","last_active":"2024-02-19T21:52:00.309101+0000","last_peered":"2024-02-19T21:52:00.309101+0000","last_clean":"2024-02-19T21:52:00.309101+0000","last_became_active":"2024-02-19T21:44:58.788307+0000","last_became_peered":"2024-02-19T21:44:58.788307+0000","last_unstale":"2024-02-19T21:52:00.309101+0000","last_undegraded":"2024-02-19T21:52:00.309101+0000","last_fullsized":"2024-02-19T21:52:00.309101+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:40.527970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:48:40.527970+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":444,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.370509+0000","last_change":"2024-02-19T21:48:11.557832+0000","last_active":"2024-02-19T21:52:00.370509+0000","last_peered":"2024-02-19T21:52:00.370509+0000","last_clean":"2024-02-19T21:52:00.370509+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:52:00.370509+0000","last_undegraded":"2024-02-19T21:52:00.370509+0000","last_fullsized":"2024-02-19T21:52:00.370509+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.557736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:17.913620+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.557736+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"200'34","reported_seq":108,"reported_epoch":462,"state":"active+clean","last_fresh":"2024-02-19T21:52:10.316737+0000","last_change":"2024-02-19T21:49:08.332575+0000","last_active":"2024-02-19T21:52:10.316737+0000","last_peered":"2024-02-19T21:52:10.316737+0000","last_clean":"2024-02-19T21:52:10.316737+0000","last_became_active":"2024-02-19T21:49:08.331742+0000","last_became_peered":"2024-02-19T21:49:08.331742+0000","last_unstale":"2024-02-19T21:52:10.316737+0000","last_undegraded":"2024-02-19T21:52:10.316737+0000","last_fullsized":"2024-02-19T21:52:10.316737+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'34","last_scrub_stamp":"2024-02-19T21:45:49.728734+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:45:49.728734+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":456,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.310401+0000","last_change":"2024-02-19T21:46:44.994389+0000","last_active":"2024-02-19T21:52:00.310401+0000","last_peered":"2024-02-19T21:52:00.310401+0000","last_clean":"2024-02-19T21:52:00.310401+0000","last_became_active":"2024-02-19T21:44:58.790669+0000","last_became_peered":"2024-02-19T21:44:58.790669+0000","last_unstale":"2024-02-19T21:52:00.310401+0000","last_undegraded":"2024-02-19T21:52:00.310401+0000","last_fullsized":"2024-02-19T21:52:00.310401+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.994296+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":392,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.370550+0000","last_change":"2024-02-19T21:49:08.330330+0000","last_active":"2024-02-19T21:52:00.370550+0000","last_peered":"2024-02-19T21:52:00.370550+0000","last_clean":"2024-02-19T21:52:00.370550+0000","last_became_active":"2024-02-19T21:49:08.329986+0000","last_became_peered":"2024-02-19T21:49:08.329986+0000","last_unstale":"2024-02-19T21:52:00.370550+0000","last_undegraded":"2024-02-19T21:52:00.370550+0000","last_fullsized":"2024-02-19T21:52:00.370550+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.091409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.091409+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"201'19","reported_seq":340,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.318789+0000","last_change":"2024-02-19T21:48:26.366639+0000","last_active":"2024-02-19T21:52:00.318789+0000","last_peered":"2024-02-19T21:52:00.318789+0000","last_clean":"2024-02-19T21:52:00.318789+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:52:00.318789+0000","last_undegraded":"2024-02-19T21:52:00.318789+0000","last_fullsized":"2024-02-19T21:52:00.318789+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:26.366563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.366563+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":317,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.320875+0000","last_change":"2024-02-19T21:51:22.461995+0000","last_active":"2024-02-19T21:52:00.320875+0000","last_peered":"2024-02-19T21:52:00.320875+0000","last_clean":"2024-02-19T21:52:00.320875+0000","last_became_active":"2024-02-19T21:51:22.461599+0000","last_became_peered":"2024-02-19T21:51:22.461599+0000","last_unstale":"2024-02-19T21:52:00.320875+0000","last_undegraded":"2024-02-19T21:52:00.320875+0000","last_fullsized":"2024-02-19T21:52:00.320875+0000","mapping_epoch":445,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":446,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:13.196112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:13.196112+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":457,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:07.989689+0000","last_change":"2024-02-19T21:49:54.491840+0000","last_active":"2024-02-19T21:52:07.989689+0000","last_peered":"2024-02-19T21:52:07.989689+0000","last_clean":"2024-02-19T21:52:07.989689+0000","last_became_active":"2024-02-19T21:49:54.491488+0000","last_became_peered":"2024-02-19T21:49:54.491488+0000","last_unstale":"2024-02-19T21:52:07.989689+0000","last_undegraded":"2024-02-19T21:52:07.989689+0000","last_fullsized":"2024-02-19T21:52:07.989689+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.803606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.803606+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"201'20","reported_seq":541,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.319460+0000","last_change":"2024-02-19T21:49:54.502402+0000","last_active":"2024-02-19T21:52:00.319460+0000","last_peered":"2024-02-19T21:52:00.319460+0000","last_clean":"2024-02-19T21:52:00.319460+0000","last_became_active":"2024-02-19T21:49:54.483748+0000","last_became_peered":"2024-02-19T21:49:54.483748+0000","last_unstale":"2024-02-19T21:52:00.319460+0000","last_undegraded":"2024-02-19T21:52:00.319460+0000","last_fullsized":"2024-02-19T21:52:00.319460+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:48:25.348437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.348437+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":376,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.319266+0000","last_change":"2024-02-19T21:49:08.328206+0000","last_active":"2024-02-19T21:52:00.319266+0000","last_peered":"2024-02-19T21:52:00.319266+0000","last_clean":"2024-02-19T21:52:00.319266+0000","last_became_active":"2024-02-19T21:49:08.327865+0000","last_became_peered":"2024-02-19T21:49:08.327865+0000","last_unstale":"2024-02-19T21:52:00.319266+0000","last_undegraded":"2024-02-19T21:52:00.319266+0000","last_fullsized":"2024-02-19T21:52:00.319266+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.230652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.230652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":436,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.320696+0000","last_change":"2024-02-19T21:48:22.171667+0000","last_active":"2024-02-19T21:52:00.320696+0000","last_peered":"2024-02-19T21:52:00.320696+0000","last_clean":"2024-02-19T21:52:00.320696+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:52:00.320696+0000","last_undegraded":"2024-02-19T21:52:00.320696+0000","last_fullsized":"2024-02-19T21:52:00.320696+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.171600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.171600+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":472,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.371059+0000","last_change":"2024-02-19T21:49:08.330636+0000","last_active":"2024-02-19T21:52:00.371059+0000","last_peered":"2024-02-19T21:52:00.371059+0000","last_clean":"2024-02-19T21:52:00.371059+0000","last_became_active":"2024-02-19T21:49:08.330293+0000","last_became_peered":"2024-02-19T21:49:08.330293+0000","last_unstale":"2024-02-19T21:52:00.371059+0000","last_undegraded":"2024-02-19T21:52:00.371059+0000","last_fullsized":"2024-02-19T21:52:00.371059+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:03.034839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:03.034839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"381'24","reported_seq":69,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.320471+0000","last_change":"2024-02-19T21:49:55.368481+0000","last_active":"2024-02-19T21:52:00.320471+0000","last_peered":"2024-02-19T21:52:00.320471+0000","last_clean":"2024-02-19T21:52:00.320471+0000","last_became_active":"2024-02-19T21:49:54.485438+0000","last_became_peered":"2024-02-19T21:49:54.485438+0000","last_unstale":"2024-02-19T21:52:00.320471+0000","last_undegraded":"2024-02-19T21:52:00.320471+0000","last_fullsized":"2024-02-19T21:52:00.320471+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"381'24","last_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_deep_scrub":"381'24","last_deep_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_clean_scrub_stamp":"2024-02-19T21:48:39.382725+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,5],"acting":[7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":464,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.321191+0000","last_change":"2024-02-19T21:49:17.193002+0000","last_active":"2024-02-19T21:52:00.321191+0000","last_peered":"2024-02-19T21:52:00.321191+0000","last_clean":"2024-02-19T21:52:00.321191+0000","last_became_active":"2024-02-19T21:49:08.333537+0000","last_became_peered":"2024-02-19T21:49:08.333537+0000","last_unstale":"2024-02-19T21:52:00.321191+0000","last_undegraded":"2024-02-19T21:52:00.321191+0000","last_fullsized":"2024-02-19T21:52:00.321191+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:59.339649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:45:59.339649+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":492,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.370173+0000","last_change":"2024-02-19T21:49:54.494561+0000","last_active":"2024-02-19T21:52:00.370173+0000","last_peered":"2024-02-19T21:52:00.370173+0000","last_clean":"2024-02-19T21:52:00.370173+0000","last_became_active":"2024-02-19T21:49:54.494146+0000","last_became_peered":"2024-02-19T21:49:54.494146+0000","last_unstale":"2024-02-19T21:52:00.370173+0000","last_undegraded":"2024-02-19T21:52:00.370173+0000","last_fullsized":"2024-02-19T21:52:00.370173+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.560066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":467,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:07.991191+0000","last_change":"2024-02-19T21:49:09.765641+0000","last_active":"2024-02-19T21:52:07.991191+0000","last_peered":"2024-02-19T21:52:07.991191+0000","last_clean":"2024-02-19T21:52:07.991191+0000","last_became_active":"2024-02-19T21:49:08.331308+0000","last_became_peered":"2024-02-19T21:49:08.331308+0000","last_unstale":"2024-02-19T21:52:07.991191+0000","last_undegraded":"2024-02-19T21:52:07.991191+0000","last_fullsized":"2024-02-19T21:52:07.991191+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.765568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.765568+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"200'8","reported_seq":153,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.310662+0000","last_change":"2024-02-19T21:47:33.577363+0000","last_active":"2024-02-19T21:52:00.310662+0000","last_peered":"2024-02-19T21:52:00.310662+0000","last_clean":"2024-02-19T21:52:00.310662+0000","last_became_active":"2024-02-19T21:47:33.395217+0000","last_became_peered":"2024-02-19T21:47:33.395217+0000","last_unstale":"2024-02-19T21:52:00.310662+0000","last_undegraded":"2024-02-19T21:52:00.310662+0000","last_fullsized":"2024-02-19T21:52:00.310662+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'8","last_scrub_stamp":"2024-02-19T21:46:47.761677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.761677+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":376,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.318691+0000","last_change":"2024-02-19T21:49:08.918163+0000","last_active":"2024-02-19T21:52:00.318691+0000","last_peered":"2024-02-19T21:52:00.318691+0000","last_clean":"2024-02-19T21:52:00.318691+0000","last_became_active":"2024-02-19T21:49:08.328416+0000","last_became_peered":"2024-02-19T21:49:08.328416+0000","last_unstale":"2024-02-19T21:52:00.318691+0000","last_undegraded":"2024-02-19T21:52:00.318691+0000","last_fullsized":"2024-02-19T21:52:00.318691+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.918083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.918083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":454,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.311394+0000","last_change":"2024-02-19T21:49:54.480716+0000","last_active":"2024-02-19T21:52:00.311394+0000","last_peered":"2024-02-19T21:52:00.311394+0000","last_clean":"2024-02-19T21:52:00.311394+0000","last_became_active":"2024-02-19T21:49:54.480368+0000","last_became_peered":"2024-02-19T21:49:54.480368+0000","last_unstale":"2024-02-19T21:52:00.311394+0000","last_undegraded":"2024-02-19T21:52:00.311394+0000","last_fullsized":"2024-02-19T21:52:00.311394+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:19.596775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:19.596775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":438,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.310564+0000","last_change":"2024-02-19T21:49:05.012463+0000","last_active":"2024-02-19T21:52:00.310564+0000","last_peered":"2024-02-19T21:52:00.310564+0000","last_clean":"2024-02-19T21:52:00.310564+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:52:00.310564+0000","last_undegraded":"2024-02-19T21:52:00.310564+0000","last_fullsized":"2024-02-19T21:52:00.310564+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.012395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.012395+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"201'19","reported_seq":485,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.308103+0000","last_change":"2024-02-19T21:48:38.529106+0000","last_active":"2024-02-19T21:52:00.308103+0000","last_peered":"2024-02-19T21:52:00.308103+0000","last_clean":"2024-02-19T21:52:00.308103+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:52:00.308103+0000","last_undegraded":"2024-02-19T21:52:00.308103+0000","last_fullsized":"2024-02-19T21:52:00.308103+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:38.528977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.528977+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":441,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.318354+0000","last_change":"2024-02-19T21:46:06.096531+0000","last_active":"2024-02-19T21:52:00.318354+0000","last_peered":"2024-02-19T21:52:00.318354+0000","last_clean":"2024-02-19T21:52:00.318354+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:52:00.318354+0000","last_undegraded":"2024-02-19T21:52:00.318354+0000","last_fullsized":"2024-02-19T21:52:00.318354+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.096422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":252,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.371348+0000","last_change":"2024-02-19T21:48:38.391532+0000","last_active":"2024-02-19T21:52:00.371348+0000","last_peered":"2024-02-19T21:52:00.371348+0000","last_clean":"2024-02-19T21:52:00.371348+0000","last_became_active":"2024-02-19T21:47:33.395085+0000","last_became_peered":"2024-02-19T21:47:33.395085+0000","last_unstale":"2024-02-19T21:52:00.371348+0000","last_undegraded":"2024-02-19T21:52:00.371348+0000","last_fullsized":"2024-02-19T21:52:00.371348+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:38.391435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.391435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":453,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.370371+0000","last_change":"2024-02-19T21:48:14.600378+0000","last_active":"2024-02-19T21:52:00.370371+0000","last_peered":"2024-02-19T21:52:00.370371+0000","last_clean":"2024-02-19T21:52:00.370371+0000","last_became_active":"2024-02-19T21:47:33.393932+0000","last_became_peered":"2024-02-19T21:47:33.393932+0000","last_unstale":"2024-02-19T21:52:00.370371+0000","last_undegraded":"2024-02-19T21:52:00.370371+0000","last_fullsized":"2024-02-19T21:52:00.370371+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:14.600285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.600285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"200'15","reported_seq":507,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.311268+0000","last_change":"2024-02-19T21:49:08.334199+0000","last_active":"2024-02-19T21:52:00.311268+0000","last_peered":"2024-02-19T21:52:00.311268+0000","last_clean":"2024-02-19T21:52:00.311268+0000","last_became_active":"2024-02-19T21:49:08.333872+0000","last_became_peered":"2024-02-19T21:49:08.333872+0000","last_unstale":"2024-02-19T21:52:00.311268+0000","last_undegraded":"2024-02-19T21:52:00.311268+0000","last_fullsized":"2024-02-19T21:52:00.311268+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:45:08.678669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:08.678669+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":419,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.309238+0000","last_change":"2024-02-19T21:49:08.330114+0000","last_active":"2024-02-19T21:52:00.309238+0000","last_peered":"2024-02-19T21:52:00.309238+0000","last_clean":"2024-02-19T21:52:00.309238+0000","last_became_active":"2024-02-19T21:49:08.329770+0000","last_became_peered":"2024-02-19T21:49:08.329770+0000","last_unstale":"2024-02-19T21:52:00.309238+0000","last_undegraded":"2024-02-19T21:52:00.309238+0000","last_fullsized":"2024-02-19T21:52:00.309238+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:08.983923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.983923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"415'17","reported_seq":88,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:07.096534+0000","last_change":"2024-02-19T21:50:49.705247+0000","last_active":"2024-02-19T21:52:07.096534+0000","last_peered":"2024-02-19T21:52:07.096534+0000","last_clean":"2024-02-19T21:52:07.096534+0000","last_became_active":"2024-02-19T21:49:54.486304+0000","last_became_peered":"2024-02-19T21:49:54.486304+0000","last_unstale":"2024-02-19T21:52:07.096534+0000","last_undegraded":"2024-02-19T21:52:07.096534+0000","last_fullsized":"2024-02-19T21:52:07.096534+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"199'13","last_scrub_stamp":"2024-02-19T21:45:05.721709+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:45:05.721709+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":463,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.319466+0000","last_change":"2024-02-19T21:49:54.484516+0000","last_active":"2024-02-19T21:52:00.319466+0000","last_peered":"2024-02-19T21:52:00.319466+0000","last_clean":"2024-02-19T21:52:00.319466+0000","last_became_active":"2024-02-19T21:49:54.483689+0000","last_became_peered":"2024-02-19T21:49:54.483689+0000","last_unstale":"2024-02-19T21:52:00.319466+0000","last_undegraded":"2024-02-19T21:52:00.319466+0000","last_fullsized":"2024-02-19T21:52:00.319466+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.157478+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"201'19","reported_seq":485,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:07.990820+0000","last_change":"2024-02-19T21:48:27.720048+0000","last_active":"2024-02-19T21:52:07.990820+0000","last_peered":"2024-02-19T21:52:07.990820+0000","last_clean":"2024-02-19T21:52:07.990820+0000","last_became_active":"2024-02-19T21:47:33.398295+0000","last_became_peered":"2024-02-19T21:47:33.398295+0000","last_unstale":"2024-02-19T21:52:07.990820+0000","last_undegraded":"2024-02-19T21:52:07.990820+0000","last_fullsized":"2024-02-19T21:52:07.990820+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:27.719954+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:48:27.719954+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":180,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.319223+0000","last_change":"2024-02-19T21:49:54.484392+0000","last_active":"2024-02-19T21:52:00.319223+0000","last_peered":"2024-02-19T21:52:00.319223+0000","last_clean":"2024-02-19T21:52:00.319223+0000","last_became_active":"2024-02-19T21:49:54.484049+0000","last_became_peered":"2024-02-19T21:49:54.484049+0000","last_unstale":"2024-02-19T21:52:00.319223+0000","last_undegraded":"2024-02-19T21:52:00.319223+0000","last_fullsized":"2024-02-19T21:52:00.319223+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.121769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.121769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":681,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:07.990893+0000","last_change":"2024-02-19T21:48:38.723220+0000","last_active":"2024-02-19T21:52:07.990893+0000","last_peered":"2024-02-19T21:52:07.990893+0000","last_clean":"2024-02-19T21:52:07.990893+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:52:07.990893+0000","last_undegraded":"2024-02-19T21:52:07.990893+0000","last_fullsized":"2024-02-19T21:52:07.990893+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:48:38.723151+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.723151+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":468,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:07.990277+0000","last_change":"2024-02-19T21:49:54.485462+0000","last_active":"2024-02-19T21:52:07.990277+0000","last_peered":"2024-02-19T21:52:07.990277+0000","last_clean":"2024-02-19T21:52:07.990277+0000","last_became_active":"2024-02-19T21:49:54.485121+0000","last_became_peered":"2024-02-19T21:49:54.485121+0000","last_unstale":"2024-02-19T21:52:07.990277+0000","last_undegraded":"2024-02-19T21:52:07.990277+0000","last_fullsized":"2024-02-19T21:52:07.990277+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:07.724097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:49:07.724097+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"201'25","reported_seq":345,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.310770+0000","last_change":"2024-02-19T21:49:08.335077+0000","last_active":"2024-02-19T21:52:00.310770+0000","last_peered":"2024-02-19T21:52:00.310770+0000","last_clean":"2024-02-19T21:52:00.310770+0000","last_became_active":"2024-02-19T21:49:08.334061+0000","last_became_peered":"2024-02-19T21:49:08.334061+0000","last_unstale":"2024-02-19T21:52:00.310770+0000","last_undegraded":"2024-02-19T21:52:00.310770+0000","last_fullsized":"2024-02-19T21:52:00.310770+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'25","last_scrub_stamp":"2024-02-19T21:46:07.553690+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.553690+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":436,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.321108+0000","last_change":"2024-02-19T21:48:21.256471+0000","last_active":"2024-02-19T21:52:00.321108+0000","last_peered":"2024-02-19T21:52:00.321108+0000","last_clean":"2024-02-19T21:52:00.321108+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:52:00.321108+0000","last_undegraded":"2024-02-19T21:52:00.321108+0000","last_fullsized":"2024-02-19T21:52:00.321108+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.256358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.256358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":443,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.370256+0000","last_change":"2024-02-19T21:46:35.035136+0000","last_active":"2024-02-19T21:52:00.370256+0000","last_peered":"2024-02-19T21:52:00.370256+0000","last_clean":"2024-02-19T21:52:00.370256+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:52:00.370256+0000","last_undegraded":"2024-02-19T21:52:00.370256+0000","last_fullsized":"2024-02-19T21:52:00.370256+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:35.035042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:35.035042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"201'12","reported_seq":65,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.321402+0000","last_change":"2024-02-19T21:50:49.700758+0000","last_active":"2024-02-19T21:52:00.321402+0000","last_peered":"2024-02-19T21:52:00.321402+0000","last_clean":"2024-02-19T21:52:00.321402+0000","last_became_active":"2024-02-19T21:49:54.478094+0000","last_became_peered":"2024-02-19T21:49:54.478094+0000","last_unstale":"2024-02-19T21:52:00.321402+0000","last_undegraded":"2024-02-19T21:52:00.321402+0000","last_fullsized":"2024-02-19T21:52:00.321402+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'12","last_scrub_stamp":"2024-02-19T21:49:08.912638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.912638+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":91,"reported_epoch":462,"state":"active+clean","last_fresh":"2024-02-19T21:52:10.316739+0000","last_change":"2024-02-19T21:49:08.332757+0000","last_active":"2024-02-19T21:52:10.316739+0000","last_peered":"2024-02-19T21:52:10.316739+0000","last_clean":"2024-02-19T21:52:10.316739+0000","last_became_active":"2024-02-19T21:49:08.332176+0000","last_became_peered":"2024-02-19T21:49:08.332176+0000","last_unstale":"2024-02-19T21:52:10.316739+0000","last_undegraded":"2024-02-19T21:52:10.316739+0000","last_fullsized":"2024-02-19T21:52:10.316739+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:47:01.365477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:47:01.365477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":91,"reported_epoch":462,"state":"active+clean","last_fresh":"2024-02-19T21:52:10.315890+0000","last_change":"2024-02-19T21:49:08.328632+0000","last_active":"2024-02-19T21:52:10.315890+0000","last_peered":"2024-02-19T21:52:10.315890+0000","last_clean":"2024-02-19T21:52:10.315890+0000","last_became_active":"2024-02-19T21:49:08.327826+0000","last_became_peered":"2024-02-19T21:49:08.327826+0000","last_unstale":"2024-02-19T21:52:10.315890+0000","last_undegraded":"2024-02-19T21:52:10.315890+0000","last_fullsized":"2024-02-19T21:52:10.315890+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:09.645607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:44:09.645607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"200'15","reported_seq":569,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.319327+0000","last_change":"2024-02-19T21:50:49.704824+0000","last_active":"2024-02-19T21:52:00.319327+0000","last_peered":"2024-02-19T21:52:00.319327+0000","last_clean":"2024-02-19T21:52:00.319327+0000","last_became_active":"2024-02-19T21:49:54.483578+0000","last_became_peered":"2024-02-19T21:49:54.483578+0000","last_unstale":"2024-02-19T21:52:00.319327+0000","last_undegraded":"2024-02-19T21:52:00.319327+0000","last_fullsized":"2024-02-19T21:52:00.319327+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:44:53.072746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:53.072746+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"461'5756","reported_seq":7682,"reported_epoch":461,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:52:10.082104+0000","last_change":"2024-02-19T21:50:38.722849+0000","last_active":"2024-02-19T21:52:10.082104+0000","last_peered":"2024-02-19T21:52:10.082104+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:09.770699+0000","last_became_peered":"2024-02-19T21:49:09.770699+0000","last_unstale":"2024-02-19T21:52:10.082104+0000","last_undegraded":"2024-02-19T21:49:09.328794+0000","last_fullsized":"2024-02-19T21:49:09.325036+0000","mapping_epoch":395,"log_start":"392'900","ondisk_log_start":"392'900","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4856,"ondisk_log_size":4856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":243531776,"num_objects":3716,"num_object_clones":0,"num_object_copies":11148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3716,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5756,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":918,"num_bytes_recovered":60162048,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5],"avail_no_missing":["6","5"],"object_location_counts":[{"shards":"5,6","objects":3526}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":57,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.320663+0000","last_change":"2024-02-19T21:49:54.492844+0000","last_active":"2024-02-19T21:52:00.320663+0000","last_peered":"2024-02-19T21:52:00.320663+0000","last_clean":"2024-02-19T21:52:00.320663+0000","last_became_active":"2024-02-19T21:49:54.492156+0000","last_became_peered":"2024-02-19T21:49:54.492156+0000","last_unstale":"2024-02-19T21:52:00.320663+0000","last_undegraded":"2024-02-19T21:52:00.320663+0000","last_fullsized":"2024-02-19T21:52:00.320663+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:04.692807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.692807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"378'4","reported_seq":475,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.309426+0000","last_change":"2024-02-19T21:48:28.510929+0000","last_active":"2024-02-19T21:52:00.309426+0000","last_peered":"2024-02-19T21:52:00.309426+0000","last_clean":"2024-02-19T21:52:00.309426+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:52:00.309426+0000","last_undegraded":"2024-02-19T21:52:00.309426+0000","last_fullsized":"2024-02-19T21:52:00.309426+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"378'4","last_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_deep_scrub":"378'4","last_deep_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.510849+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"200'23","reported_seq":322,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.308995+0000","last_change":"2024-02-19T21:48:22.519465+0000","last_active":"2024-02-19T21:52:00.308995+0000","last_peered":"2024-02-19T21:52:00.308995+0000","last_clean":"2024-02-19T21:52:00.308995+0000","last_became_active":"2024-02-19T21:47:46.252085+0000","last_became_peered":"2024-02-19T21:47:46.252085+0000","last_unstale":"2024-02-19T21:52:00.308995+0000","last_undegraded":"2024-02-19T21:52:00.308995+0000","last_fullsized":"2024-02-19T21:52:00.308995+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'23","last_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_deep_scrub":"200'23","last_deep_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.519381+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6],"acting":[4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":91,"reported_epoch":462,"state":"active+clean","last_fresh":"2024-02-19T21:52:10.315898+0000","last_change":"2024-02-19T21:49:08.328855+0000","last_active":"2024-02-19T21:52:10.315898+0000","last_peered":"2024-02-19T21:52:10.315898+0000","last_clean":"2024-02-19T21:52:10.315898+0000","last_became_active":"2024-02-19T21:49:08.328237+0000","last_became_peered":"2024-02-19T21:49:08.328237+0000","last_unstale":"2024-02-19T21:52:10.315898+0000","last_undegraded":"2024-02-19T21:52:10.315898+0000","last_fullsized":"2024-02-19T21:52:10.315898+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:58.047556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:58.047556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"461'5568","reported_seq":5651,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:09.567662+0000","last_change":"2024-02-19T21:48:47.778295+0000","last_active":"2024-02-19T21:52:09.567662+0000","last_peered":"2024-02-19T21:52:09.567662+0000","last_clean":"2024-02-19T21:52:09.567662+0000","last_became_active":"2024-02-19T21:48:47.777964+0000","last_became_peered":"2024-02-19T21:48:47.777964+0000","last_unstale":"2024-02-19T21:52:09.567662+0000","last_undegraded":"2024-02-19T21:52:09.567662+0000","last_fullsized":"2024-02-19T21:52:09.567662+0000","mapping_epoch":385,"log_start":"392'800","ondisk_log_start":"392'800","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4768,"ondisk_log_size":4768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":234749952,"num_objects":3582,"num_object_clones":0,"num_object_copies":10746,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3582,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5568,"num_write_kb":292800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":490,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.318434+0000","last_change":"2024-02-19T21:49:08.328019+0000","last_active":"2024-02-19T21:52:00.318434+0000","last_peered":"2024-02-19T21:52:00.318434+0000","last_clean":"2024-02-19T21:52:00.318434+0000","last_became_active":"2024-02-19T21:49:08.327581+0000","last_became_peered":"2024-02-19T21:49:08.327581+0000","last_unstale":"2024-02-19T21:52:00.318434+0000","last_undegraded":"2024-02-19T21:52:00.318434+0000","last_fullsized":"2024-02-19T21:52:00.318434+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:22.180593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:45:22.180593+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5],"acting":[0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":436,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.310582+0000","last_change":"2024-02-19T21:48:37.789514+0000","last_active":"2024-02-19T21:52:00.310582+0000","last_peered":"2024-02-19T21:52:00.310582+0000","last_clean":"2024-02-19T21:52:00.310582+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:52:00.310582+0000","last_undegraded":"2024-02-19T21:52:00.310582+0000","last_fullsized":"2024-02-19T21:52:00.310582+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:37.789400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:37.789400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"201'20","reported_seq":342,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.311347+0000","last_change":"2024-02-19T21:45:57.877936+0000","last_active":"2024-02-19T21:52:00.311347+0000","last_peered":"2024-02-19T21:52:00.311347+0000","last_clean":"2024-02-19T21:52:00.311347+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:52:00.311347+0000","last_undegraded":"2024-02-19T21:52:00.311347+0000","last_fullsized":"2024-02-19T21:52:00.311347+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:45:57.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:57.877856+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":684,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:07.096640+0000","last_change":"2024-02-19T21:49:01.011149+0000","last_active":"2024-02-19T21:52:07.096640+0000","last_peered":"2024-02-19T21:52:07.096640+0000","last_clean":"2024-02-19T21:52:07.096640+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:52:07.096640+0000","last_undegraded":"2024-02-19T21:52:07.096640+0000","last_fullsized":"2024-02-19T21:52:07.096640+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:49:01.011078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:49:01.011078+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.a","version":"461'5722","reported_seq":5806,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:10.020578+0000","last_change":"2024-02-19T21:48:47.778138+0000","last_active":"2024-02-19T21:52:10.020578+0000","last_peered":"2024-02-19T21:52:10.020578+0000","last_clean":"2024-02-19T21:52:10.020578+0000","last_became_active":"2024-02-19T21:48:47.777820+0000","last_became_peered":"2024-02-19T21:48:47.777820+0000","last_unstale":"2024-02-19T21:52:10.020578+0000","last_undegraded":"2024-02-19T21:52:10.020578+0000","last_fullsized":"2024-02-19T21:52:10.020578+0000","mapping_epoch":385,"log_start":"392'800","ondisk_log_start":"392'800","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4922,"ondisk_log_size":4922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":240648192,"num_objects":3672,"num_object_clones":0,"num_object_copies":11016,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3672,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5722,"num_write_kb":300608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":385,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.309395+0000","last_change":"2024-02-19T21:48:33.478821+0000","last_active":"2024-02-19T21:52:00.309395+0000","last_peered":"2024-02-19T21:52:00.309395+0000","last_clean":"2024-02-19T21:52:00.309395+0000","last_became_active":"2024-02-19T21:44:56.149476+0000","last_became_peered":"2024-02-19T21:44:56.149476+0000","last_unstale":"2024-02-19T21:52:00.309395+0000","last_undegraded":"2024-02-19T21:52:00.309395+0000","last_fullsized":"2024-02-19T21:52:00.309395+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:33.478715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:48:33.478715+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":447,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:07.990354+0000","last_change":"2024-02-19T21:46:41.834315+0000","last_active":"2024-02-19T21:52:07.990354+0000","last_peered":"2024-02-19T21:52:07.990354+0000","last_clean":"2024-02-19T21:52:07.990354+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:52:07.990354+0000","last_undegraded":"2024-02-19T21:52:07.990354+0000","last_fullsized":"2024-02-19T21:52:07.990354+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:41.834246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:46:41.834246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"397'46","reported_seq":874,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:07.096692+0000","last_change":"2024-02-19T21:49:08.335296+0000","last_active":"2024-02-19T21:52:07.096692+0000","last_peered":"2024-02-19T21:52:07.096692+0000","last_clean":"2024-02-19T21:52:07.096692+0000","last_became_active":"2024-02-19T21:49:08.334527+0000","last_became_peered":"2024-02-19T21:49:08.334527+0000","last_unstale":"2024-02-19T21:52:07.096692+0000","last_undegraded":"2024-02-19T21:52:07.096692+0000","last_fullsized":"2024-02-19T21:52:07.096692+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'43","last_scrub_stamp":"2024-02-19T21:45:04.755444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.755444+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":432,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.319892+0000","last_change":"2024-02-19T21:46:45.252437+0000","last_active":"2024-02-19T21:52:00.319892+0000","last_peered":"2024-02-19T21:52:00.319892+0000","last_clean":"2024-02-19T21:52:00.319892+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:52:00.319892+0000","last_undegraded":"2024-02-19T21:52:00.319892+0000","last_fullsized":"2024-02-19T21:52:00.319892+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.252344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.252344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"461'5676","reported_seq":9087,"reported_epoch":462,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:52:10.315934+0000","last_change":"2024-02-19T21:51:03.650022+0000","last_active":"2024-02-19T21:52:10.315934+0000","last_peered":"2024-02-19T21:52:10.315934+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:55.752599+0000","last_became_peered":"2024-02-19T21:49:55.752599+0000","last_unstale":"2024-02-19T21:52:10.315934+0000","last_undegraded":"2024-02-19T21:49:55.655049+0000","last_fullsized":"2024-02-19T21:49:55.470938+0000","mapping_epoch":414,"log_start":"392'500","ondisk_log_start":"392'500","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5176,"ondisk_log_size":5176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":234881024,"num_objects":3584,"num_object_clones":0,"num_object_copies":10752,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":52,"num_objects_misplaced":2928,"num_objects_unfound":0,"num_objects_dirty":3584,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5676,"num_write_kb":296320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1105,"num_bytes_recovered":72417280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2],"avail_no_missing":["5","4"],"object_location_counts":[{"shards":"2,4,5","objects":2876},{"shards":"2,5","objects":656},{"shards":"4,5","objects":52}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":460,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.321361+0000","last_change":"2024-02-19T21:49:09.227437+0000","last_active":"2024-02-19T21:52:00.321361+0000","last_peered":"2024-02-19T21:52:00.321361+0000","last_clean":"2024-02-19T21:52:00.321361+0000","last_became_active":"2024-02-19T21:49:08.328437+0000","last_became_peered":"2024-02-19T21:49:08.328437+0000","last_unstale":"2024-02-19T21:52:00.321361+0000","last_undegraded":"2024-02-19T21:52:00.321361+0000","last_fullsized":"2024-02-19T21:52:00.321361+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.227355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.227355+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'6","reported_seq":1689,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:09.620250+0000","last_change":"2024-02-19T21:52:09.620250+0000","last_active":"2024-02-19T21:52:09.620250+0000","last_peered":"2024-02-19T21:52:09.620250+0000","last_clean":"2024-02-19T21:52:09.620250+0000","last_became_active":"2024-02-19T21:49:08.331108+0000","last_became_peered":"2024-02-19T21:49:08.331108+0000","last_unstale":"2024-02-19T21:52:09.620250+0000","last_undegraded":"2024-02-19T21:52:09.620250+0000","last_fullsized":"2024-02-19T21:52:09.620250+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_clean_scrub_stamp":"2024-02-19T21:44:13.678341+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1166,"num_read_kb":1161,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":91,"reported_epoch":462,"state":"active+clean","last_fresh":"2024-02-19T21:52:10.316251+0000","last_change":"2024-02-19T21:49:08.329710+0000","last_active":"2024-02-19T21:52:10.316251+0000","last_peered":"2024-02-19T21:52:10.316251+0000","last_clean":"2024-02-19T21:52:10.316251+0000","last_became_active":"2024-02-19T21:49:08.329378+0000","last_became_peered":"2024-02-19T21:49:08.329378+0000","last_unstale":"2024-02-19T21:52:10.316251+0000","last_undegraded":"2024-02-19T21:52:10.316251+0000","last_fullsized":"2024-02-19T21:52:10.316251+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:55.195394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.195394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"200'17","reported_seq":493,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.310486+0000","last_change":"2024-02-19T21:48:14.878933+0000","last_active":"2024-02-19T21:52:00.310486+0000","last_peered":"2024-02-19T21:52:00.310486+0000","last_clean":"2024-02-19T21:52:00.310486+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:52:00.310486+0000","last_undegraded":"2024-02-19T21:52:00.310486+0000","last_fullsized":"2024-02-19T21:52:00.310486+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'17","last_scrub_stamp":"2024-02-19T21:48:14.878857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.878857+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":25,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":91,"reported_epoch":462,"state":"active+clean","last_fresh":"2024-02-19T21:52:10.316862+0000","last_change":"2024-02-19T21:49:08.325478+0000","last_active":"2024-02-19T21:52:10.316862+0000","last_peered":"2024-02-19T21:52:10.316862+0000","last_clean":"2024-02-19T21:52:10.316862+0000","last_became_active":"2024-02-19T21:49:08.325127+0000","last_became_peered":"2024-02-19T21:49:08.325127+0000","last_unstale":"2024-02-19T21:52:10.316862+0000","last_undegraded":"2024-02-19T21:52:10.316862+0000","last_fullsized":"2024-02-19T21:52:10.316862+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:10.871111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:10.871111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"461'5735","reported_seq":5819,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:09.588887+0000","last_change":"2024-02-19T21:48:47.778829+0000","last_active":"2024-02-19T21:52:09.588887+0000","last_peered":"2024-02-19T21:52:09.588887+0000","last_clean":"2024-02-19T21:52:09.588887+0000","last_became_active":"2024-02-19T21:48:47.778486+0000","last_became_peered":"2024-02-19T21:48:47.778486+0000","last_unstale":"2024-02-19T21:52:09.588887+0000","last_undegraded":"2024-02-19T21:52:09.588887+0000","last_fullsized":"2024-02-19T21:52:09.588887+0000","mapping_epoch":385,"log_start":"392'800","ondisk_log_start":"392'800","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4935,"ondisk_log_size":4935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":244121600,"num_objects":3725,"num_object_clones":0,"num_object_copies":11175,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3725,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5735,"num_write_kb":302720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":464,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:07.990677+0000","last_change":"2024-02-19T21:47:33.400407+0000","last_active":"2024-02-19T21:52:07.990677+0000","last_peered":"2024-02-19T21:52:07.990677+0000","last_clean":"2024-02-19T21:52:07.990677+0000","last_became_active":"2024-02-19T21:47:33.400075+0000","last_became_peered":"2024-02-19T21:47:33.400075+0000","last_unstale":"2024-02-19T21:52:07.990677+0000","last_undegraded":"2024-02-19T21:52:07.990677+0000","last_fullsized":"2024-02-19T21:52:07.990677+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.035136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":342,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:07.990456+0000","last_change":"2024-02-19T21:49:05.746443+0000","last_active":"2024-02-19T21:52:07.990456+0000","last_peered":"2024-02-19T21:52:07.990456+0000","last_clean":"2024-02-19T21:52:07.990456+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:52:07.990456+0000","last_undegraded":"2024-02-19T21:52:07.990456+0000","last_fullsized":"2024-02-19T21:52:07.990456+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.746358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.746358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":494,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:07.989997+0000","last_change":"2024-02-19T21:49:54.485252+0000","last_active":"2024-02-19T21:52:07.989997+0000","last_peered":"2024-02-19T21:52:07.989997+0000","last_clean":"2024-02-19T21:52:07.989997+0000","last_became_active":"2024-02-19T21:49:54.484956+0000","last_became_peered":"2024-02-19T21:49:54.484956+0000","last_unstale":"2024-02-19T21:52:07.989997+0000","last_undegraded":"2024-02-19T21:52:07.989997+0000","last_fullsized":"2024-02-19T21:52:07.989997+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:07.901205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:07.901205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":57,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.320387+0000","last_change":"2024-02-19T21:49:54.483990+0000","last_active":"2024-02-19T21:52:00.320387+0000","last_peered":"2024-02-19T21:52:00.320387+0000","last_clean":"2024-02-19T21:52:00.320387+0000","last_became_active":"2024-02-19T21:49:54.483637+0000","last_became_peered":"2024-02-19T21:49:54.483637+0000","last_unstale":"2024-02-19T21:52:00.320387+0000","last_undegraded":"2024-02-19T21:52:00.320387+0000","last_fullsized":"2024-02-19T21:52:00.320387+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.190177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.190177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"201'33","reported_seq":486,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.370750+0000","last_change":"2024-02-19T21:46:47.970066+0000","last_active":"2024-02-19T21:52:00.370750+0000","last_peered":"2024-02-19T21:52:00.370750+0000","last_clean":"2024-02-19T21:52:00.370750+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:52:00.370750+0000","last_undegraded":"2024-02-19T21:52:00.370750+0000","last_fullsized":"2024-02-19T21:52:00.370750+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'33","last_scrub_stamp":"2024-02-19T21:46:47.969961+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.969961+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":57,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.321220+0000","last_change":"2024-02-19T21:49:54.478276+0000","last_active":"2024-02-19T21:52:00.321220+0000","last_peered":"2024-02-19T21:52:00.321220+0000","last_clean":"2024-02-19T21:52:00.321220+0000","last_became_active":"2024-02-19T21:49:54.477947+0000","last_became_peered":"2024-02-19T21:49:54.477947+0000","last_unstale":"2024-02-19T21:52:00.321220+0000","last_undegraded":"2024-02-19T21:52:00.321220+0000","last_fullsized":"2024-02-19T21:52:00.321220+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:57.754453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:57.754453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"461'5576","reported_seq":15801,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:09.614259+0000","last_change":"2024-02-19T21:51:22.472713+0000","last_active":"2024-02-19T21:52:09.614259+0000","last_peered":"2024-02-19T21:52:09.614259+0000","last_clean":"2024-02-19T21:52:09.614259+0000","last_became_active":"2024-02-19T21:51:22.462974+0000","last_became_peered":"2024-02-19T21:51:22.462974+0000","last_unstale":"2024-02-19T21:52:09.614259+0000","last_undegraded":"2024-02-19T21:52:09.614259+0000","last_fullsized":"2024-02-19T21:52:09.614259+0000","mapping_epoch":445,"log_start":"392'400","ondisk_log_start":"392'400","created":385,"last_epoch_clean":446,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5176,"ondisk_log_size":5176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":237240320,"num_objects":3620,"num_object_clones":0,"num_object_copies":10860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3620,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5576,"num_write_kb":294272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5054,"num_bytes_recovered":320077824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7],"acting":[0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":434,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.310853+0000","last_change":"2024-02-19T21:45:47.723650+0000","last_active":"2024-02-19T21:52:00.310853+0000","last_peered":"2024-02-19T21:52:00.310853+0000","last_clean":"2024-02-19T21:52:00.310853+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:52:00.310853+0000","last_undegraded":"2024-02-19T21:52:00.310853+0000","last_fullsized":"2024-02-19T21:52:00.310853+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.723550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.723550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":445,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.318606+0000","last_change":"2024-02-19T21:45:51.243726+0000","last_active":"2024-02-19T21:52:00.318606+0000","last_peered":"2024-02-19T21:52:00.318606+0000","last_clean":"2024-02-19T21:52:00.318606+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:52:00.318606+0000","last_undegraded":"2024-02-19T21:52:00.318606+0000","last_fullsized":"2024-02-19T21:52:00.318606+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:51.243656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:51.243656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":462,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.320567+0000","last_change":"2024-02-19T21:48:23.218358+0000","last_active":"2024-02-19T21:52:00.320567+0000","last_peered":"2024-02-19T21:52:00.320567+0000","last_clean":"2024-02-19T21:52:00.320567+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:52:00.320567+0000","last_undegraded":"2024-02-19T21:52:00.320567+0000","last_fullsized":"2024-02-19T21:52:00.320567+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:23.218282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.218282+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"324'30","reported_seq":589,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.319265+0000","last_change":"2024-02-19T21:49:08.330490+0000","last_active":"2024-02-19T21:52:00.319265+0000","last_peered":"2024-02-19T21:52:00.319265+0000","last_clean":"2024-02-19T21:52:00.319265+0000","last_became_active":"2024-02-19T21:49:08.329761+0000","last_became_peered":"2024-02-19T21:49:08.329761+0000","last_unstale":"2024-02-19T21:52:00.319265+0000","last_undegraded":"2024-02-19T21:52:00.319265+0000","last_fullsized":"2024-02-19T21:52:00.319265+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'30","last_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_deep_scrub":"324'30","last_deep_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.110965+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":448,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:07.990603+0000","last_change":"2024-02-19T21:45:09.918263+0000","last_active":"2024-02-19T21:52:07.990603+0000","last_peered":"2024-02-19T21:52:07.990603+0000","last_clean":"2024-02-19T21:52:07.990603+0000","last_became_active":"2024-02-19T21:44:42.624782+0000","last_became_peered":"2024-02-19T21:44:42.624782+0000","last_unstale":"2024-02-19T21:52:07.990603+0000","last_undegraded":"2024-02-19T21:52:07.990603+0000","last_fullsized":"2024-02-19T21:52:07.990603+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":295,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_clean_scrub_stamp":"2024-02-19T21:45:09.918170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"461'5611","reported_seq":5696,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:09.860983+0000","last_change":"2024-02-19T21:48:47.777963+0000","last_active":"2024-02-19T21:52:09.860983+0000","last_peered":"2024-02-19T21:52:09.860983+0000","last_clean":"2024-02-19T21:52:09.860983+0000","last_became_active":"2024-02-19T21:48:47.777644+0000","last_became_peered":"2024-02-19T21:48:47.777644+0000","last_unstale":"2024-02-19T21:52:09.860983+0000","last_undegraded":"2024-02-19T21:52:09.860983+0000","last_fullsized":"2024-02-19T21:52:09.860983+0000","mapping_epoch":385,"log_start":"392'700","ondisk_log_start":"392'700","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4911,"ondisk_log_size":4911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":239730712,"num_objects":3659,"num_object_clones":0,"num_object_copies":10977,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3659,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5611,"num_write_kb":296577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":467,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.311012+0000","last_change":"2024-02-19T21:49:08.331080+0000","last_active":"2024-02-19T21:52:00.311012+0000","last_peered":"2024-02-19T21:52:00.311012+0000","last_clean":"2024-02-19T21:52:00.311012+0000","last_became_active":"2024-02-19T21:49:08.330648+0000","last_became_peered":"2024-02-19T21:49:08.330648+0000","last_unstale":"2024-02-19T21:52:00.311012+0000","last_undegraded":"2024-02-19T21:52:00.311012+0000","last_fullsized":"2024-02-19T21:52:00.311012+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:55.803876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:44:55.803876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":438,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.321404+0000","last_change":"2024-02-19T21:48:31.320229+0000","last_active":"2024-02-19T21:52:00.321404+0000","last_peered":"2024-02-19T21:52:00.321404+0000","last_clean":"2024-02-19T21:52:00.321404+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:52:00.321404+0000","last_undegraded":"2024-02-19T21:52:00.321404+0000","last_fullsized":"2024-02-19T21:52:00.321404+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:31.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:45.017696+0000","last_clean_scrub_stamp":"2024-02-19T21:48:31.320133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"201'37","reported_seq":493,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.319394+0000","last_change":"2024-02-19T21:45:14.173212+0000","last_active":"2024-02-19T21:52:00.319394+0000","last_peered":"2024-02-19T21:52:00.319394+0000","last_clean":"2024-02-19T21:52:00.319394+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:52:00.319394+0000","last_undegraded":"2024-02-19T21:52:00.319394+0000","last_fullsized":"2024-02-19T21:52:00.319394+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'37","last_scrub_stamp":"2024-02-19T21:45:14.173134+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:45:14.173134+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":437,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.370751+0000","last_change":"2024-02-19T21:46:48.988928+0000","last_active":"2024-02-19T21:52:00.370751+0000","last_peered":"2024-02-19T21:52:00.370751+0000","last_clean":"2024-02-19T21:52:00.370751+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:52:00.370751+0000","last_undegraded":"2024-02-19T21:52:00.370751+0000","last_fullsized":"2024-02-19T21:52:00.370751+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:48.988836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.988836+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.e","version":"461'5529","reported_seq":7699,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:10.170881+0000","last_change":"2024-02-19T21:50:40.718822+0000","last_active":"2024-02-19T21:52:10.170881+0000","last_peered":"2024-02-19T21:52:10.170881+0000","last_clean":"2024-02-19T21:52:10.170881+0000","last_became_active":"2024-02-19T21:50:40.710425+0000","last_became_peered":"2024-02-19T21:50:40.710425+0000","last_unstale":"2024-02-19T21:52:10.170881+0000","last_undegraded":"2024-02-19T21:52:10.170881+0000","last_fullsized":"2024-02-19T21:52:10.170881+0000","mapping_epoch":430,"log_start":"392'500","ondisk_log_start":"392'500","created":385,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5029,"ondisk_log_size":5029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":236388352,"num_objects":3607,"num_object_clones":0,"num_object_copies":10821,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3607,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5529,"num_write_kb":292352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1035,"num_bytes_recovered":67829760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":180,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.308437+0000","last_change":"2024-02-19T21:49:08.326461+0000","last_active":"2024-02-19T21:52:00.308437+0000","last_peered":"2024-02-19T21:52:00.308437+0000","last_clean":"2024-02-19T21:52:00.308437+0000","last_became_active":"2024-02-19T21:49:08.326106+0000","last_became_peered":"2024-02-19T21:49:08.326106+0000","last_unstale":"2024-02-19T21:52:00.308437+0000","last_undegraded":"2024-02-19T21:52:00.308437+0000","last_fullsized":"2024-02-19T21:52:00.308437+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.080896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.080896+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":440,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.310945+0000","last_change":"2024-02-19T21:48:11.879787+0000","last_active":"2024-02-19T21:52:00.310945+0000","last_peered":"2024-02-19T21:52:00.310945+0000","last_clean":"2024-02-19T21:52:00.310945+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:52:00.310945+0000","last_undegraded":"2024-02-19T21:52:00.310945+0000","last_fullsized":"2024-02-19T21:52:00.310945+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.879687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.879687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"201'38","reported_seq":75,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.320665+0000","last_change":"2024-02-19T21:49:55.861358+0000","last_active":"2024-02-19T21:52:00.320665+0000","last_peered":"2024-02-19T21:52:00.320665+0000","last_clean":"2024-02-19T21:52:00.320665+0000","last_became_active":"2024-02-19T21:49:54.480413+0000","last_became_peered":"2024-02-19T21:49:54.480413+0000","last_unstale":"2024-02-19T21:52:00.320665+0000","last_undegraded":"2024-02-19T21:52:00.320665+0000","last_fullsized":"2024-02-19T21:52:00.320665+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":415,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'38","last_scrub_stamp":"2024-02-19T21:49:05.923627+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.923627+0000","log_size":38,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":333,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.370623+0000","last_change":"2024-02-19T21:49:54.495134+0000","last_active":"2024-02-19T21:52:00.370623+0000","last_peered":"2024-02-19T21:52:00.370623+0000","last_clean":"2024-02-19T21:52:00.370623+0000","last_became_active":"2024-02-19T21:49:54.494802+0000","last_became_peered":"2024-02-19T21:49:54.494802+0000","last_unstale":"2024-02-19T21:52:00.370623+0000","last_undegraded":"2024-02-19T21:52:00.370623+0000","last_fullsized":"2024-02-19T21:52:00.370623+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:10.578408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:10.578408+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.f","version":"461'5816","reported_seq":8210,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:09.764994+0000","last_change":"2024-02-19T21:51:05.409700+0000","last_active":"2024-02-19T21:52:09.764994+0000","last_peered":"2024-02-19T21:52:09.764994+0000","last_clean":"2024-02-19T21:52:09.764994+0000","last_became_active":"2024-02-19T21:51:05.398355+0000","last_became_peered":"2024-02-19T21:51:05.398355+0000","last_unstale":"2024-02-19T21:52:09.764994+0000","last_undegraded":"2024-02-19T21:52:09.764994+0000","last_fullsized":"2024-02-19T21:52:09.764994+0000","mapping_epoch":440,"log_start":"392'900","ondisk_log_start":"392'900","created":385,"last_epoch_clean":441,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4916,"ondisk_log_size":4916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":243924992,"num_objects":3722,"num_object_clones":0,"num_object_copies":11166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3722,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5816,"num_write_kb":305216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1147,"num_bytes_recovered":75169792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":467,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.320931+0000","last_change":"2024-02-19T21:49:08.328862+0000","last_active":"2024-02-19T21:52:00.320931+0000","last_peered":"2024-02-19T21:52:00.320931+0000","last_clean":"2024-02-19T21:52:00.320931+0000","last_became_active":"2024-02-19T21:49:08.328529+0000","last_became_peered":"2024-02-19T21:49:08.328529+0000","last_unstale":"2024-02-19T21:52:00.320931+0000","last_undegraded":"2024-02-19T21:52:00.320931+0000","last_fullsized":"2024-02-19T21:52:00.320931+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:49.110117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:49.110117+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":500,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.371129+0000","last_change":"2024-02-19T21:49:54.493367+0000","last_active":"2024-02-19T21:52:00.371129+0000","last_peered":"2024-02-19T21:52:00.371129+0000","last_clean":"2024-02-19T21:52:00.371129+0000","last_became_active":"2024-02-19T21:49:54.493041+0000","last_became_peered":"2024-02-19T21:49:54.493041+0000","last_unstale":"2024-02-19T21:52:00.371129+0000","last_undegraded":"2024-02-19T21:52:00.371129+0000","last_fullsized":"2024-02-19T21:52:00.371129+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.972369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.972369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"201'28","reported_seq":307,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.308913+0000","last_change":"2024-02-19T21:49:08.330818+0000","last_active":"2024-02-19T21:52:00.308913+0000","last_peered":"2024-02-19T21:52:00.308913+0000","last_clean":"2024-02-19T21:52:00.308913+0000","last_became_active":"2024-02-19T21:49:08.330477+0000","last_became_peered":"2024-02-19T21:49:08.330477+0000","last_unstale":"2024-02-19T21:52:00.308913+0000","last_undegraded":"2024-02-19T21:52:00.308913+0000","last_fullsized":"2024-02-19T21:52:00.308913+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'28","last_scrub_stamp":"2024-02-19T21:45:55.998646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.998646+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":40,"num_read_kb":33,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":533,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:07.096639+0000","last_change":"2024-02-19T21:45:50.742626+0000","last_active":"2024-02-19T21:52:07.096639+0000","last_peered":"2024-02-19T21:52:07.096639+0000","last_clean":"2024-02-19T21:52:07.096639+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:52:07.096639+0000","last_undegraded":"2024-02-19T21:52:07.096639+0000","last_fullsized":"2024-02-19T21:52:07.096639+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'9","last_scrub_stamp":"2024-02-19T21:45:50.742526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:50.742526+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"461'5561","reported_seq":5645,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:09.740226+0000","last_change":"2024-02-19T21:48:47.779506+0000","last_active":"2024-02-19T21:52:09.740226+0000","last_peered":"2024-02-19T21:52:09.740226+0000","last_clean":"2024-02-19T21:52:09.740226+0000","last_became_active":"2024-02-19T21:48:47.778325+0000","last_became_peered":"2024-02-19T21:48:47.778325+0000","last_unstale":"2024-02-19T21:52:09.740226+0000","last_undegraded":"2024-02-19T21:52:09.740226+0000","last_fullsized":"2024-02-19T21:52:09.740226+0000","mapping_epoch":385,"log_start":"392'700","ondisk_log_start":"392'700","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4861,"ondisk_log_size":4861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":234553344,"num_objects":3579,"num_object_clones":0,"num_object_copies":10737,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3579,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5561,"num_write_kb":292480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"66'1","reported_seq":351,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.370537+0000","last_change":"2024-02-19T21:48:12.568842+0000","last_active":"2024-02-19T21:52:00.370537+0000","last_peered":"2024-02-19T21:52:00.370537+0000","last_clean":"2024-02-19T21:52:00.370537+0000","last_became_active":"2024-02-19T21:44:56.166670+0000","last_became_peered":"2024-02-19T21:44:56.166670+0000","last_unstale":"2024-02-19T21:52:00.370537+0000","last_undegraded":"2024-02-19T21:52:00.370537+0000","last_fullsized":"2024-02-19T21:52:00.370537+0000","mapping_epoch":165,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:12.568734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.568734+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"261'11","reported_seq":545,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:07.990530+0000","last_change":"2024-02-19T21:45:01.716882+0000","last_active":"2024-02-19T21:52:07.990530+0000","last_peered":"2024-02-19T21:52:07.990530+0000","last_clean":"2024-02-19T21:52:07.990530+0000","last_became_active":"2024-02-19T21:44:08.123392+0000","last_became_peered":"2024-02-19T21:44:08.123392+0000","last_unstale":"2024-02-19T21:52:07.990530+0000","last_undegraded":"2024-02-19T21:52:07.990530+0000","last_fullsized":"2024-02-19T21:52:07.990530+0000","mapping_epoch":62,"log_start":"257'10","ondisk_log_start":"257'10","created":62,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-02-19T21:45:01.716817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.716817+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":449,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.320621+0000","last_change":"2024-02-19T21:48:19.186455+0000","last_active":"2024-02-19T21:52:00.320621+0000","last_peered":"2024-02-19T21:52:00.320621+0000","last_clean":"2024-02-19T21:52:00.320621+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:52:00.320621+0000","last_undegraded":"2024-02-19T21:52:00.320621+0000","last_fullsized":"2024-02-19T21:52:00.320621+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:48:19.186359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:19.186359+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"201'19","reported_seq":307,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.309186+0000","last_change":"2024-02-19T21:48:34.485865+0000","last_active":"2024-02-19T21:52:00.309186+0000","last_peered":"2024-02-19T21:52:00.309186+0000","last_clean":"2024-02-19T21:52:00.309186+0000","last_became_active":"2024-02-19T21:47:46.251550+0000","last_became_peered":"2024-02-19T21:47:46.251550+0000","last_unstale":"2024-02-19T21:52:00.309186+0000","last_undegraded":"2024-02-19T21:52:00.309186+0000","last_fullsized":"2024-02-19T21:52:00.309186+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:34.485787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:34.485787+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":23,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7],"acting":[4,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1","version":"461'5645","reported_seq":5729,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:09.857548+0000","last_change":"2024-02-19T21:48:47.772467+0000","last_active":"2024-02-19T21:52:09.857548+0000","last_peered":"2024-02-19T21:52:09.857548+0000","last_clean":"2024-02-19T21:52:09.857548+0000","last_became_active":"2024-02-19T21:48:47.772154+0000","last_became_peered":"2024-02-19T21:48:47.772154+0000","last_unstale":"2024-02-19T21:52:09.857548+0000","last_undegraded":"2024-02-19T21:52:09.857548+0000","last_fullsized":"2024-02-19T21:52:09.857548+0000","mapping_epoch":385,"log_start":"392'600","ondisk_log_start":"392'600","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5045,"ondisk_log_size":5045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":240451584,"num_objects":3669,"num_object_clones":0,"num_object_copies":11007,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5645,"num_write_kb":298048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":457,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:07.990967+0000","last_change":"2024-02-19T21:46:01.031458+0000","last_active":"2024-02-19T21:52:07.990967+0000","last_peered":"2024-02-19T21:52:07.990967+0000","last_clean":"2024-02-19T21:52:07.990967+0000","last_became_active":"2024-02-19T21:44:56.155194+0000","last_became_peered":"2024-02-19T21:44:56.155194+0000","last_unstale":"2024-02-19T21:52:07.990967+0000","last_undegraded":"2024-02-19T21:52:07.990967+0000","last_fullsized":"2024-02-19T21:52:07.990967+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.031344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.031344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"363'12","reported_seq":256,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:07.096535+0000","last_change":"2024-02-19T21:48:25.487689+0000","last_active":"2024-02-19T21:52:07.096535+0000","last_peered":"2024-02-19T21:52:07.096535+0000","last_clean":"2024-02-19T21:52:07.096535+0000","last_became_active":"2024-02-19T21:47:46.260099+0000","last_became_peered":"2024-02-19T21:47:46.260099+0000","last_unstale":"2024-02-19T21:52:07.096535+0000","last_undegraded":"2024-02-19T21:52:07.096535+0000","last_fullsized":"2024-02-19T21:52:07.096535+0000","mapping_epoch":362,"log_start":"98'9","ondisk_log_start":"98'9","created":62,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"363'12","last_scrub_stamp":"2024-02-19T21:48:25.487608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.487608+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":460,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.310952+0000","last_change":"2024-02-19T21:49:08.335163+0000","last_active":"2024-02-19T21:52:00.310952+0000","last_peered":"2024-02-19T21:52:00.310952+0000","last_clean":"2024-02-19T21:52:00.310952+0000","last_became_active":"2024-02-19T21:49:08.334842+0000","last_became_peered":"2024-02-19T21:49:08.334842+0000","last_unstale":"2024-02-19T21:52:00.310952+0000","last_undegraded":"2024-02-19T21:52:00.310952+0000","last_fullsized":"2024-02-19T21:52:00.310952+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.700887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.700887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"270'34","reported_seq":381,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:07.990280+0000","last_change":"2024-02-19T21:47:34.894164+0000","last_active":"2024-02-19T21:52:07.990280+0000","last_peered":"2024-02-19T21:52:07.990280+0000","last_clean":"2024-02-19T21:52:07.990280+0000","last_became_active":"2024-02-19T21:47:33.400012+0000","last_became_peered":"2024-02-19T21:47:33.400012+0000","last_unstale":"2024-02-19T21:52:07.990280+0000","last_undegraded":"2024-02-19T21:52:07.990280+0000","last_fullsized":"2024-02-19T21:52:07.990280+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":357,"parent":"0.0","parent_split_bits":0,"last_scrub":"270'34","last_scrub_stamp":"2024-02-19T21:46:44.789309+0000","last_deep_scrub":"270'34","last_deep_scrub_stamp":"2024-02-19T21:44:17.451151+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.789309+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2","version":"461'5741","reported_seq":5825,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:10.149570+0000","last_change":"2024-02-19T21:48:47.771305+0000","last_active":"2024-02-19T21:52:10.149570+0000","last_peered":"2024-02-19T21:52:10.149570+0000","last_clean":"2024-02-19T21:52:10.149570+0000","last_became_active":"2024-02-19T21:48:47.771000+0000","last_became_peered":"2024-02-19T21:48:47.771000+0000","last_unstale":"2024-02-19T21:52:10.149570+0000","last_undegraded":"2024-02-19T21:52:10.149570+0000","last_fullsized":"2024-02-19T21:52:10.149570+0000","mapping_epoch":385,"log_start":"392'500","ondisk_log_start":"392'500","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5241,"ondisk_log_size":5241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":241631232,"num_objects":3687,"num_object_clones":0,"num_object_copies":11061,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3687,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5741,"num_write_kb":301696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":438,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.309322+0000","last_change":"2024-02-19T21:49:08.329023+0000","last_active":"2024-02-19T21:52:00.309322+0000","last_peered":"2024-02-19T21:52:00.309322+0000","last_clean":"2024-02-19T21:52:00.309322+0000","last_became_active":"2024-02-19T21:49:08.328697+0000","last_became_peered":"2024-02-19T21:49:08.328697+0000","last_unstale":"2024-02-19T21:52:00.309322+0000","last_undegraded":"2024-02-19T21:52:00.309322+0000","last_fullsized":"2024-02-19T21:52:00.309322+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.939414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.939414+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"397'17","reported_seq":388,"reported_epoch":463,"state":"active+clean","last_fresh":"2024-02-19T21:52:11.334274+0000","last_change":"2024-02-19T21:49:08.325927+0000","last_active":"2024-02-19T21:52:11.334274+0000","last_peered":"2024-02-19T21:52:11.334274+0000","last_clean":"2024-02-19T21:52:11.334274+0000","last_became_active":"2024-02-19T21:49:08.325034+0000","last_became_peered":"2024-02-19T21:49:08.325034+0000","last_unstale":"2024-02-19T21:52:11.334274+0000","last_undegraded":"2024-02-19T21:52:11.334274+0000","last_fullsized":"2024-02-19T21:52:11.334274+0000","mapping_epoch":394,"log_start":"170'11","ondisk_log_start":"170'11","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"271'13","last_scrub_stamp":"2024-02-19T21:46:47.072988+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.072988+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":450,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.311190+0000","last_change":"2024-02-19T21:49:03.987847+0000","last_active":"2024-02-19T21:52:00.311190+0000","last_peered":"2024-02-19T21:52:00.311190+0000","last_clean":"2024-02-19T21:52:00.311190+0000","last_became_active":"2024-02-19T21:47:33.395485+0000","last_became_peered":"2024-02-19T21:47:33.395485+0000","last_unstale":"2024-02-19T21:52:00.311190+0000","last_undegraded":"2024-02-19T21:52:00.311190+0000","last_fullsized":"2024-02-19T21:52:00.311190+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:03.987749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:49:03.987749+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,5],"acting":[1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"200'20","reported_seq":284,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.308528+0000","last_change":"2024-02-19T21:48:12.628796+0000","last_active":"2024-02-19T21:52:00.308528+0000","last_peered":"2024-02-19T21:52:00.308528+0000","last_clean":"2024-02-19T21:52:00.308528+0000","last_became_active":"2024-02-19T21:47:46.251725+0000","last_became_peered":"2024-02-19T21:47:46.251725+0000","last_unstale":"2024-02-19T21:52:00.308528+0000","last_undegraded":"2024-02-19T21:52:00.308528+0000","last_fullsized":"2024-02-19T21:52:00.308528+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'20","last_scrub_stamp":"2024-02-19T21:48:12.628700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.628700+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3","version":"463'5707","reported_seq":7997,"reported_epoch":463,"state":"active+clean","last_fresh":"2024-02-19T21:52:11.886212+0000","last_change":"2024-02-19T21:50:50.296220+0000","last_active":"2024-02-19T21:52:11.886212+0000","last_peered":"2024-02-19T21:52:11.886212+0000","last_clean":"2024-02-19T21:52:11.886212+0000","last_became_active":"2024-02-19T21:50:50.289607+0000","last_became_peered":"2024-02-19T21:50:50.289607+0000","last_unstale":"2024-02-19T21:52:11.886212+0000","last_undegraded":"2024-02-19T21:52:11.886212+0000","last_fullsized":"2024-02-19T21:52:11.886212+0000","mapping_epoch":433,"log_start":"392'300","ondisk_log_start":"392'300","created":385,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5407,"ondisk_log_size":5407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":239403008,"num_objects":3653,"num_object_clones":0,"num_object_copies":10959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3653,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5707,"num_write_kb":299520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1097,"num_bytes_recovered":71892992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":91,"reported_epoch":462,"state":"active+clean","last_fresh":"2024-02-19T21:52:10.316884+0000","last_change":"2024-02-19T21:49:08.327495+0000","last_active":"2024-02-19T21:52:10.316884+0000","last_peered":"2024-02-19T21:52:10.316884+0000","last_clean":"2024-02-19T21:52:10.316884+0000","last_became_active":"2024-02-19T21:49:08.327172+0000","last_became_peered":"2024-02-19T21:49:08.327172+0000","last_unstale":"2024-02-19T21:52:10.316884+0000","last_undegraded":"2024-02-19T21:52:10.316884+0000","last_fullsized":"2024-02-19T21:52:10.316884+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.241319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.241319+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,6],"acting":[2,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":445,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.310823+0000","last_change":"2024-02-19T21:45:01.798485+0000","last_active":"2024-02-19T21:52:00.310823+0000","last_peered":"2024-02-19T21:52:00.310823+0000","last_clean":"2024-02-19T21:52:00.310823+0000","last_became_active":"2024-02-19T21:44:22.245925+0000","last_became_peered":"2024-02-19T21:44:22.245925+0000","last_unstale":"2024-02-19T21:52:00.310823+0000","last_undegraded":"2024-02-19T21:52:00.310823+0000","last_fullsized":"2024-02-19T21:52:00.310823+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:01.798387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.798387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":445,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.320836+0000","last_change":"2024-02-19T21:48:30.277397+0000","last_active":"2024-02-19T21:52:00.320836+0000","last_peered":"2024-02-19T21:52:00.320836+0000","last_clean":"2024-02-19T21:52:00.320836+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:52:00.320836+0000","last_undegraded":"2024-02-19T21:52:00.320836+0000","last_fullsized":"2024-02-19T21:52:00.320836+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.277322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.277322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"337'39","reported_seq":393,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.308611+0000","last_change":"2024-02-19T21:49:08.326007+0000","last_active":"2024-02-19T21:52:00.308611+0000","last_peered":"2024-02-19T21:52:00.308611+0000","last_clean":"2024-02-19T21:52:00.308611+0000","last_became_active":"2024-02-19T21:49:08.325683+0000","last_became_peered":"2024-02-19T21:49:08.325683+0000","last_unstale":"2024-02-19T21:52:00.308611+0000","last_undegraded":"2024-02-19T21:52:00.308611+0000","last_fullsized":"2024-02-19T21:52:00.308611+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'39","last_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_deep_scrub":"337'39","last_deep_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.923809+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":49,"num_read_kb":39,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"461'5852","reported_seq":5936,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:09.768192+0000","last_change":"2024-02-19T21:48:47.776672+0000","last_active":"2024-02-19T21:52:09.768192+0000","last_peered":"2024-02-19T21:52:09.768192+0000","last_clean":"2024-02-19T21:52:09.768192+0000","last_became_active":"2024-02-19T21:48:47.776368+0000","last_became_peered":"2024-02-19T21:48:47.776368+0000","last_unstale":"2024-02-19T21:52:09.768192+0000","last_undegraded":"2024-02-19T21:52:09.768192+0000","last_fullsized":"2024-02-19T21:52:09.768192+0000","mapping_epoch":385,"log_start":"392'700","ondisk_log_start":"392'700","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5152,"ondisk_log_size":5152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":242221056,"num_objects":3696,"num_object_clones":0,"num_object_copies":11088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3696,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5852,"num_write_kb":305536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"66'1","reported_seq":283,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.320396+0000","last_change":"2024-02-19T21:50:57.303343+0000","last_active":"2024-02-19T21:52:00.320396+0000","last_peered":"2024-02-19T21:52:00.320396+0000","last_clean":"2024-02-19T21:52:00.320396+0000","last_became_active":"2024-02-19T21:50:57.302957+0000","last_became_peered":"2024-02-19T21:50:57.302957+0000","last_unstale":"2024-02-19T21:52:00.320396+0000","last_undegraded":"2024-02-19T21:52:00.320396+0000","last_fullsized":"2024-02-19T21:52:00.320396+0000","mapping_epoch":437,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":438,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:46:43.773486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:46:43.773486+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":91,"reported_epoch":462,"state":"active+clean","last_fresh":"2024-02-19T21:52:10.316428+0000","last_change":"2024-02-19T21:49:08.326583+0000","last_active":"2024-02-19T21:52:10.316428+0000","last_peered":"2024-02-19T21:52:10.316428+0000","last_clean":"2024-02-19T21:52:10.316428+0000","last_became_active":"2024-02-19T21:49:08.324835+0000","last_became_peered":"2024-02-19T21:49:08.324835+0000","last_unstale":"2024-02-19T21:52:10.316428+0000","last_undegraded":"2024-02-19T21:52:10.316428+0000","last_fullsized":"2024-02-19T21:52:10.316428+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.163825+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":145,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.370360+0000","last_change":"2024-02-19T21:49:08.327553+0000","last_active":"2024-02-19T21:52:00.370360+0000","last_peered":"2024-02-19T21:52:00.370360+0000","last_clean":"2024-02-19T21:52:00.370360+0000","last_became_active":"2024-02-19T21:49:08.327186+0000","last_became_peered":"2024-02-19T21:49:08.327186+0000","last_unstale":"2024-02-19T21:52:00.370360+0000","last_undegraded":"2024-02-19T21:52:00.370360+0000","last_fullsized":"2024-02-19T21:52:00.370360+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:45:00.748244+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:45:00.748244+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"201'44","reported_seq":566,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.370437+0000","last_change":"2024-02-19T21:49:55.281324+0000","last_active":"2024-02-19T21:52:00.370437+0000","last_peered":"2024-02-19T21:52:00.370437+0000","last_clean":"2024-02-19T21:52:00.370437+0000","last_became_active":"2024-02-19T21:49:54.493167+0000","last_became_peered":"2024-02-19T21:49:54.493167+0000","last_unstale":"2024-02-19T21:52:00.370437+0000","last_undegraded":"2024-02-19T21:52:00.370437+0000","last_fullsized":"2024-02-19T21:52:00.370437+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'44","last_scrub_stamp":"2024-02-19T21:48:32.489084+0000","last_deep_scrub":"201'44","last_deep_scrub_stamp":"2024-02-19T21:44:16.255049+0000","last_clean_scrub_stamp":"2024-02-19T21:48:32.489084+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.5","version":"463'5784","reported_seq":9116,"reported_epoch":463,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:52:12.149889+0000","last_change":"2024-02-19T21:50:03.887248+0000","last_active":"2024-02-19T21:52:12.149889+0000","last_peered":"2024-02-19T21:52:12.149889+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:50:03.654321+0000","last_became_peered":"2024-02-19T21:50:03.654321+0000","last_unstale":"2024-02-19T21:52:12.149889+0000","last_undegraded":"2024-02-19T21:50:01.398577+0000","last_fullsized":"2024-02-19T21:49:55.473278+0000","mapping_epoch":414,"log_start":"392'400","ondisk_log_start":"392'400","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5384,"ondisk_log_size":5384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":238419968,"num_objects":3638,"num_object_clones":0,"num_object_copies":10914,"num_objects_missing_on_primary":68,"num_objects_missing":68,"num_objects_degraded":68,"num_objects_misplaced":3046,"num_objects_unfound":0,"num_objects_dirty":3638,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5784,"num_write_kb":301504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1075,"num_bytes_recovered":70451200,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0],"avail_no_missing":["0","5"],"object_location_counts":[{"shards":"0,2","objects":592},{"shards":"0,2,5","objects":2978},{"shards":"0,5","objects":68}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":490,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.318833+0000","last_change":"2024-02-19T21:49:08.328667+0000","last_active":"2024-02-19T21:52:00.318833+0000","last_peered":"2024-02-19T21:52:00.318833+0000","last_clean":"2024-02-19T21:52:00.318833+0000","last_became_active":"2024-02-19T21:49:08.328287+0000","last_became_peered":"2024-02-19T21:49:08.328287+0000","last_unstale":"2024-02-19T21:52:00.318833+0000","last_undegraded":"2024-02-19T21:52:00.318833+0000","last_fullsized":"2024-02-19T21:52:00.318833+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.176542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.176542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":91,"reported_epoch":462,"state":"active+clean","last_fresh":"2024-02-19T21:52:10.316356+0000","last_change":"2024-02-19T21:49:08.332637+0000","last_active":"2024-02-19T21:52:10.316356+0000","last_peered":"2024-02-19T21:52:10.316356+0000","last_clean":"2024-02-19T21:52:10.316356+0000","last_became_active":"2024-02-19T21:49:08.331451+0000","last_became_peered":"2024-02-19T21:49:08.331451+0000","last_unstale":"2024-02-19T21:52:10.316356+0000","last_undegraded":"2024-02-19T21:52:10.316356+0000","last_fullsized":"2024-02-19T21:52:10.316356+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.123413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.547129+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.123413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":460,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.310742+0000","last_change":"2024-02-19T21:49:08.331159+0000","last_active":"2024-02-19T21:52:00.310742+0000","last_peered":"2024-02-19T21:52:00.310742+0000","last_clean":"2024-02-19T21:52:00.310742+0000","last_became_active":"2024-02-19T21:49:08.330804+0000","last_became_peered":"2024-02-19T21:49:08.330804+0000","last_unstale":"2024-02-19T21:52:00.310742+0000","last_undegraded":"2024-02-19T21:52:00.310742+0000","last_fullsized":"2024-02-19T21:52:00.310742+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.978015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.978015+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"377'19","reported_seq":468,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:00.319545+0000","last_change":"2024-02-19T21:48:23.326608+0000","last_active":"2024-02-19T21:52:00.319545+0000","last_peered":"2024-02-19T21:52:00.319545+0000","last_clean":"2024-02-19T21:52:00.319545+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:52:00.319545+0000","last_undegraded":"2024-02-19T21:52:00.319545+0000","last_fullsized":"2024-02-19T21:52:00.319545+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"377'19","last_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_deep_scrub":"377'19","last_deep_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.326541+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"462'5747","reported_seq":5831,"reported_epoch":462,"state":"active+clean","last_fresh":"2024-02-19T21:52:10.312177+0000","last_change":"2024-02-19T21:48:47.780368+0000","last_active":"2024-02-19T21:52:10.312177+0000","last_peered":"2024-02-19T21:52:10.312177+0000","last_clean":"2024-02-19T21:52:10.312177+0000","last_became_active":"2024-02-19T21:48:47.780046+0000","last_became_peered":"2024-02-19T21:48:47.780046+0000","last_unstale":"2024-02-19T21:52:10.312177+0000","last_undegraded":"2024-02-19T21:52:10.312177+0000","last_fullsized":"2024-02-19T21:52:10.312177+0000","mapping_epoch":385,"log_start":"392'500","ondisk_log_start":"392'500","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5247,"ondisk_log_size":5247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":239927296,"num_objects":3661,"num_object_clones":0,"num_object_copies":10983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3661,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5747,"num_write_kb":301056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":455,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:07.990227+0000","last_change":"2024-02-19T21:46:01.981923+0000","last_active":"2024-02-19T21:52:07.990227+0000","last_peered":"2024-02-19T21:52:07.990227+0000","last_clean":"2024-02-19T21:52:07.990227+0000","last_became_active":"2024-02-19T21:44:56.160521+0000","last_became_peered":"2024-02-19T21:44:56.160521+0000","last_unstale":"2024-02-19T21:52:07.990227+0000","last_undegraded":"2024-02-19T21:52:07.990227+0000","last_fullsized":"2024-02-19T21:52:07.990227+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.981866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.981866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":100,"reported_epoch":462,"state":"active+clean","last_fresh":"2024-02-19T21:52:10.316993+0000","last_change":"2024-02-19T21:49:54.485377+0000","last_active":"2024-02-19T21:52:10.316993+0000","last_peered":"2024-02-19T21:52:10.316993+0000","last_clean":"2024-02-19T21:52:10.316993+0000","last_became_active":"2024-02-19T21:49:54.485078+0000","last_became_peered":"2024-02-19T21:49:54.485078+0000","last_unstale":"2024-02-19T21:52:10.316993+0000","last_undegraded":"2024-02-19T21:52:10.316993+0000","last_fullsized":"2024-02-19T21:52:10.316993+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:52.107416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:46:52.107416+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"200'27","reported_seq":532,"reported_epoch":461,"state":"active+clean","last_fresh":"2024-02-19T21:52:07.989686+0000","last_change":"2024-02-19T21:49:55.109780+0000","last_active":"2024-02-19T21:52:07.989686+0000","last_peered":"2024-02-19T21:52:07.989686+0000","last_clean":"2024-02-19T21:52:07.989686+0000","last_became_active":"2024-02-19T21:49:54.486014+0000","last_became_peered":"2024-02-19T21:49:54.486014+0000","last_unstale":"2024-02-19T21:52:07.989686+0000","last_undegraded":"2024-02-19T21:52:07.989686+0000","last_fullsized":"2024-02-19T21:52:07.989686+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'27","last_scrub_stamp":"2024-02-19T21:48:24.665813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:24.665813+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"324'11","reported_seq":704,"reported_epoch":460,"state":"active+clean","last_fresh":"2024-02-19T21:52:07.096715+0000","last_change":"2024-02-19T21:48:26.293036+0000","last_active":"2024-02-19T21:52:07.096715+0000","last_peered":"2024-02-19T21:52:07.096715+0000","last_clean":"2024-02-19T21:52:07.096715+0000","last_became_active":"2024-02-19T21:44:34.385140+0000","last_became_peered":"2024-02-19T21:44:34.385140+0000","last_unstale":"2024-02-19T21:52:07.096715+0000","last_undegraded":"2024-02-19T21:52:07.096715+0000","last_fullsized":"2024-02-19T21:52:07.096715+0000","mapping_epoch":62,"log_start":"66'8","ondisk_log_start":"66'8","created":62,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'11","last_scrub_stamp":"2024-02-19T21:48:26.292909+0000","last_deep_scrub":"324'11","last_deep_scrub_stamp":"2024-02-19T21:46:05.210095+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.292909+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":3831824408,"num_objects":58470,"num_object_clones":0,"num_object_copies":175410,"num_objects_missing_on_primary":68,"num_objects_missing":68,"num_objects_degraded":310,"num_objects_misplaced":5974,"num_objects_unfound":0,"num_objects_dirty":58470,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":91026,"num_write_kb":4783809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11431,"num_bytes_recovered":738000896,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11793477632,"data_stored":11793465416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81026,"ondisk_log_size":81026,"up":48,"acting":45,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1166,"num_read_kb":1161,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1107,"num_read_kb":864,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":277,"num_bytes_recovered":5172,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":776,"ondisk_log_size":776,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":22,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":66,"acting":66,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":382,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201520,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1086796,"kb_used_data":781380,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":92658356,"statfs":{"total":95995035648,"available":94882156544,"internally_reserved":0,"allocated":800133120,"data_stored":798771934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":1.49,"15min":1.839},"min":{"1min":0.23100000000000001,"5min":0.19400000000000001,"15min":0.189},"max":{"1min":0.57899999999999996,"5min":22.07,"15min":70.477999999999994},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":1.548,"15min":2.0049999999999999},"min":{"1min":0.26800000000000002,"5min":0.21199999999999999,"15min":0.20999999999999999},"max":{"1min":1.1140000000000001,"5min":22.457000000000001,"15min":68.052000000000007},"last":0.38}]},{"osd":1,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":1.4319999999999999,"15min":2.048},"min":{"1min":0.27000000000000002,"5min":0.247,"15min":0.23200000000000001},"max":{"1min":0.434,"5min":22.117999999999999,"15min":68.168000000000006},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.624,"5min":1.796,"15min":2.1099999999999999},"min":{"1min":0.27300000000000002,"5min":0.26300000000000001,"15min":0.223},"max":{"1min":3.3319999999999999,"5min":22.236000000000001,"15min":68.444000000000003},"last":0.48499999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:51:12 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":2.028,"15min":2.2759999999999998},"min":{"1min":0.29999999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.673,"5min":12.304,"15min":12.304},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.52600000000000002,"5min":1.756,"15min":1.9610000000000001},"min":{"1min":0.28299999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":2.6840000000000002,"5min":11.69,"15min":11.69},"last":0.64000000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":1.595,"15min":2.1200000000000001},"min":{"1min":0.36799999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":3.0680000000000001,"5min":11.778,"15min":31.559000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.434,"5min":1.2490000000000001,"15min":1.8620000000000001},"min":{"1min":0.34100000000000003,"5min":0.30299999999999999,"15min":0.29299999999999998},"max":{"1min":0.68300000000000005,"5min":13.473000000000001,"15min":30.812999999999999},"last":1.5700000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":1.417,"15min":1.546},"min":{"1min":0.30399999999999999,"5min":0.245,"15min":0.216},"max":{"1min":1.173,"5min":17.716999999999999,"15min":17.716999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":1.7729999999999999,"15min":1.871},"min":{"1min":0.31900000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.67100000000000004,"5min":15.666,"15min":17.690999999999999},"last":0.47499999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":1.6200000000000001,"15min":1.6220000000000001},"min":{"1min":0.29599999999999999,"5min":0.28499999999999998,"15min":0.24199999999999999},"max":{"1min":1.6679999999999999,"5min":29.021000000000001,"15min":29.021000000000001},"last":1.607},{"interface":"front","average":{"1min":0.54700000000000004,"5min":1.756,"15min":1.887},"min":{"1min":0.33900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.3700000000000001,"5min":29.091999999999999,"15min":29.091999999999999},"last":0.85599999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":1.9219999999999999,"15min":1.694},"min":{"1min":0.39500000000000002,"5min":0.31,"15min":0.24299999999999999},"max":{"1min":1.3919999999999999,"5min":19.286000000000001,"15min":19.286000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":1.8200000000000001,"15min":1.8560000000000001},"min":{"1min":0.38700000000000001,"5min":0.309,"15min":0.26700000000000002},"max":{"1min":0.70599999999999996,"5min":18.364000000000001,"15min":18.364000000000001},"last":1.7450000000000001}]}]},{"osd":6,"up_from":47,"seq":201863463159,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2234572,"kb_used_data":1648964,"kb_used_omap":0,"kb_used_meta":585600,"kb_avail":91510580,"statfs":{"total":95995035648,"available":93706833920,"internally_reserved":0,"allocated":1688539136,"data_stored":1687177264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":599654400},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":1.004,"15min":1.653},"min":{"1min":0.25700000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":5.7069999999999999,"5min":8.8079999999999998,"15min":45.197000000000003},"last":0.27300000000000002},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.5920000000000001,"15min":2.0070000000000001},"min":{"1min":0.252,"5min":0.23499999999999999,"15min":0.221},"max":{"1min":6.1120000000000001,"5min":6.9699999999999998,"15min":44.753},"last":0.57499999999999996}]},{"osd":1,"last update":"Mon Feb 19 21:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":1.276,"15min":1.6779999999999999},"min":{"1min":0.24299999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":3.3980000000000001,"5min":8.8469999999999995,"15min":45.231999999999999},"last":0.309},{"interface":"front","average":{"1min":0.54600000000000004,"5min":1.3480000000000001,"15min":1.6910000000000001},"min":{"1min":0.33200000000000002,"5min":0.245,"15min":0.23100000000000001},"max":{"1min":2.0179999999999998,"5min":7.3570000000000002,"15min":45.097999999999999},"last":0.38600000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:51:11 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.4430000000000001,"15min":1.528},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":6.1820000000000004,"5min":6.1820000000000004,"15min":6.1820000000000004},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":1.145,"15min":1.2270000000000001},"min":{"1min":0.32300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":3.258,"5min":7.8959999999999999,"15min":7.8959999999999999},"last":0.33600000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":1.2490000000000001,"15min":1.6080000000000001},"min":{"1min":0.34000000000000002,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":3.02,"5min":8.9009999999999998,"15min":11.15},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":1.49,"15min":1.625},"min":{"1min":0.36599999999999999,"5min":0.30599999999999999,"15min":0.246},"max":{"1min":1.9770000000000001,"5min":7.3970000000000002,"15min":19.632999999999999},"last":0.432}]},{"osd":4,"last update":"Mon Feb 19 21:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":2.0590000000000002,"15min":1.7749999999999999},"min":{"1min":0.308,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":6.1539999999999999,"5min":18.010000000000002,"15min":18.010000000000002},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":1.5529999999999999,"15min":1.716},"min":{"1min":0.28399999999999997,"5min":0.26300000000000001,"15min":0.23499999999999999},"max":{"1min":2.2919999999999998,"5min":11.566000000000001,"15min":16.594999999999999},"last":0.49199999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":1.9610000000000001,"15min":1.7909999999999999},"min":{"1min":0.315,"5min":0.27400000000000002,"15min":0.27100000000000002},"max":{"1min":6.2060000000000004,"5min":14.695,"15min":14.695},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":1.883,"15min":1.919},"min":{"1min":0.41599999999999998,"5min":0.28799999999999998,"15min":0.27900000000000003},"max":{"1min":2.4990000000000001,"5min":11.609999999999999,"15min":15.497999999999999},"last":0.46500000000000002}]},{"osd":7,"last update":"Mon Feb 19 21:51:52 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":1.548,"15min":1.8089999999999999},"min":{"1min":0.32100000000000001,"5min":0.27200000000000002,"15min":0.26700000000000002},"max":{"1min":1.768,"5min":9.1929999999999996,"15min":14.721},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":1.5900000000000001,"15min":1.8580000000000001},"min":{"1min":0.39700000000000002,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":1.7989999999999999,"5min":9.2240000000000002,"15min":14.744999999999999},"last":0.58799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575121,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1849436,"kb_used_data":944724,"kb_used_omap":0,"kb_used_meta":904704,"kb_avail":91895716,"statfs":{"total":95995035648,"available":94101213184,"internally_reserved":0,"allocated":967397376,"data_stored":966020020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":926416896},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:51:19 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.95499999999999996,"15min":1.502},"min":{"1min":0.20499999999999999,"5min":0.16300000000000001,"15min":0.161},"max":{"1min":0.77600000000000002,"5min":6.2789999999999999,"15min":42.776000000000003},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.94499999999999995,"15min":1.5429999999999999},"min":{"1min":0.23300000000000001,"5min":0.193,"15min":0.16400000000000001},"max":{"1min":2.1680000000000001,"5min":6.2000000000000002,"15min":44.845999999999997},"last":0.29399999999999998}]},{"osd":2,"last update":"Mon Feb 19 21:51:08 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.94999999999999996,"15min":1.038},"min":{"1min":0.22800000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.7270000000000001,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":0.189},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.89500000000000002,"15min":0.97299999999999998},"min":{"1min":0.254,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.6990000000000001,"5min":4.452,"15min":4.452},"last":0.251}]},{"osd":3,"last update":"Mon Feb 19 21:51:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.83999999999999997,"15min":1.6000000000000001},"min":{"1min":0.24399999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":2.2050000000000001,"5min":4.6639999999999997,"15min":41.607999999999997},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.91900000000000004,"15min":1.5249999999999999},"min":{"1min":0.28599999999999998,"5min":0.215,"15min":0.215},"max":{"1min":1.0129999999999999,"5min":4.5190000000000001,"15min":42.811999999999998},"last":0.35099999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:51:38 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":1.397,"15min":1.524},"min":{"1min":0.31900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.60899999999999999,"5min":15.853,"15min":15.853},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":1.2729999999999999,"15min":1.544},"min":{"1min":0.28100000000000003,"5min":0.28000000000000003,"15min":0.26500000000000001},"max":{"1min":1.7829999999999999,"5min":15.861000000000001,"15min":15.861000000000001},"last":0.33900000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":1.0189999999999999,"15min":1.5589999999999999},"min":{"1min":0.307,"5min":0.29599999999999999,"15min":0.27900000000000003},"max":{"1min":2.8759999999999999,"5min":7.3339999999999996,"15min":14.331},"last":0.307},{"interface":"front","average":{"1min":0.54900000000000004,"5min":1.1160000000000001,"15min":1.5580000000000001},"min":{"1min":0.313,"5min":0.307,"15min":0.30099999999999999},"max":{"1min":2.0110000000000001,"5min":14.426,"15min":14.496},"last":0.503}]},{"osd":6,"last update":"Mon Feb 19 21:51:38 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":1.343,"15min":1.6419999999999999},"min":{"1min":0.33200000000000002,"5min":0.32300000000000001,"15min":0.30099999999999999},"max":{"1min":0.64000000000000001,"5min":10.456,"15min":11.638999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":1.282,"15min":1.762},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.29699999999999999},"max":{"1min":0.77200000000000002,"5min":9.8049999999999997,"15min":12.199},"last":0.53800000000000003}]},{"osd":7,"last update":"Mon Feb 19 21:51:57 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":1.2529999999999999,"15min":1.7509999999999999},"min":{"1min":0.35499999999999998,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":2.153,"5min":7.702,"15min":13.904},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":1.323,"15min":1.694},"min":{"1min":0.42799999999999999,"5min":0.35499999999999998,"15min":0.32600000000000001},"max":{"1min":2.4470000000000001,"5min":7.6909999999999998,"15min":13.894},"last":0.40699999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738647,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3256712,"kb_used_data":2354112,"kb_used_omap":0,"kb_used_meta":902592,"kb_avail":90488440,"statfs":{"total":95995035648,"available":92660162560,"internally_reserved":0,"allocated":2410610688,"data_stored":2409252851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":924254208},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:51:11 2024","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.71799999999999997,"15min":1.1120000000000001},"min":{"1min":0.20599999999999999,"5min":0.153,"15min":0.153},"max":{"1min":0.61299999999999999,"5min":6.1550000000000002,"15min":16.478000000000002},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.97899999999999998,"15min":1.3979999999999999},"min":{"1min":0.23300000000000001,"5min":0.17899999999999999,"15min":0.17799999999999999},"max":{"1min":3.452,"5min":6.9359999999999999,"15min":13.422000000000001},"last":0.57399999999999995}]},{"osd":2,"last update":"Mon Feb 19 21:51:11 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.60699999999999998,"15min":0.64300000000000002},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":2.0619999999999998,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.39700000000000002,"5min":1.0249999999999999,"15min":1.129},"min":{"1min":0.23699999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.69799999999999995,"5min":8.9960000000000004,"15min":8.9960000000000004},"last":0.64000000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:52:01 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.89700000000000002,"15min":1.5289999999999999},"min":{"1min":0.28000000000000003,"5min":0.217,"15min":0.21299999999999999},"max":{"1min":1.4159999999999999,"5min":12.691000000000001,"15min":14.507999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.80100000000000005,"15min":1.371},"min":{"1min":0.26300000000000001,"5min":0.24099999999999999,"15min":0.23400000000000001},"max":{"1min":1.3089999999999999,"5min":6.6150000000000002,"15min":18.759},"last":0.34000000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:51:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":1.3859999999999999,"15min":1.6579999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.252},"max":{"1min":1.179,"5min":10.311,"15min":13.278},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":1.3009999999999999,"15min":1.5149999999999999},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1850000000000001,"5min":10.109,"15min":10.109},"last":0.40799999999999997}]},{"osd":5,"last update":"Mon Feb 19 21:52:01 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":1.708,"15min":1.984},"min":{"1min":0.318,"5min":0.317,"15min":0.27600000000000002},"max":{"1min":1.014,"5min":25.442,"15min":42.799999999999997},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":1.696,"15min":2.0270000000000001},"min":{"1min":0.35799999999999998,"5min":0.33200000000000002,"15min":0.27300000000000002},"max":{"1min":0.65800000000000003,"5min":25.411999999999999,"15min":42.695},"last":0.42099999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:51:16 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":1.544,"15min":1.6919999999999999},"min":{"1min":0.38700000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.749,"5min":10.278,"15min":42.777000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":1.714,"15min":1.9450000000000001},"min":{"1min":0.39100000000000001,"5min":0.29599999999999999,"15min":0.28599999999999998},"max":{"1min":2.1909999999999998,"5min":11.84,"15min":13.289999999999999},"last":0.434}]},{"osd":7,"last update":"Mon Feb 19 21:51:52 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":1.3149999999999999,"15min":1.778},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.31},"max":{"1min":3.198,"5min":15.688000000000001,"15min":42.758000000000003},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":1.3009999999999999,"15min":1.6739999999999999},"min":{"1min":0.40300000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":3.21,"5min":9.6389999999999993,"15min":42.718000000000004},"last":0.51500000000000001}]}]},{"osd":2,"up_from":394,"seq":1692217114661,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1942156,"kb_used_data":1626244,"kb_used_omap":0,"kb_used_meta":315839,"kb_avail":91802996,"statfs":{"total":95995035648,"available":94006267904,"internally_reserved":0,"allocated":1665273856,"data_stored":1663928191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":323419188},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.91100000000000003,"15min":1.081},"min":{"1min":0.20300000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":3.1779999999999999,"5min":9.1530000000000005,"15min":9.1530000000000005},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.29299999999999998,"5min":0.873,"15min":1.1060000000000001},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.435,"5min":6.149,"15min":6.149},"last":0.30599999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55100000000000005,"15min":0.59799999999999998},"min":{"1min":0.20999999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":3.073,"5min":3.073,"15min":3.073},"last":0.20999999999999999},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.78500000000000003,"15min":0.90700000000000003},"min":{"1min":0.249,"5min":0.224,"15min":0.224},"max":{"1min":1.1439999999999999,"5min":6.992,"15min":6.992},"last":0.47499999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":1.115,"15min":1.3380000000000001},"min":{"1min":0.30599999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.117,"5min":6.9470000000000001,"15min":6.9470000000000001},"last":0.501},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.96499999999999997,"15min":1.1830000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.48299999999999998,"5min":6.6500000000000004,"15min":6.6500000000000004},"last":0.33500000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":1.54,"15min":1.952},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.7729999999999999,"5min":7.0339999999999998,"15min":7.0339999999999998},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":1.4399999999999999,"15min":1.784},"min":{"1min":0.38400000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.1699999999999999,"5min":7.0419999999999998,"15min":7.0419999999999998},"last":0.68100000000000005}]},{"osd":5,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":1.48,"15min":1.6859999999999999},"min":{"1min":0.36899999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":3.4300000000000002,"5min":10.067,"15min":10.067},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":1.3160000000000001,"15min":1.6519999999999999},"min":{"1min":0.33200000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.5,"5min":13.558,"15min":13.558},"last":1.5}]},{"osd":6,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":1.3080000000000001,"15min":1.6040000000000001},"min":{"1min":0.34200000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.1819999999999999,"5min":5.6829999999999998,"15min":5.6829999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.88300000000000001,"15min":0.98899999999999999},"min":{"1min":0.36699999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.024,"5min":7,"15min":7},"last":0.379}]},{"osd":7,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":1.177,"15min":1.361},"min":{"1min":0.39900000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67000000000000004,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.72699999999999998,"15min":0.80500000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.802,"5min":2.782,"15min":2.782},"last":0.438}]}]},{"osd":3,"up_from":0,"seq":111669149959,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":32,"seq":137438953728,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3189180,"kb_used_data":2599476,"kb_used_omap":0,"kb_used_meta":589696,"kb_avail":90555972,"statfs":{"total":95995035648,"available":92729315328,"internally_reserved":0,"allocated":2661863424,"data_stored":2660516923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":603848704},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:51:33 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":1.8839999999999999,"15min":1.8939999999999999},"min":{"1min":0.221,"5min":0.219,"15min":0.219},"max":{"1min":2.1869999999999998,"5min":53.936,"15min":53.936},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.84299999999999997,"5min":2.0939999999999999,"15min":2.0720000000000001},"min":{"1min":0.252,"5min":0.23599999999999999,"15min":0.22600000000000001},"max":{"1min":2.6640000000000001,"5min":54.405999999999999,"15min":54.405999999999999},"last":0.35399999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:51:33 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":1.9790000000000001,"15min":1.7529999999999999},"min":{"1min":0.253,"5min":0.22,"15min":0.21199999999999999},"max":{"1min":2.2130000000000001,"5min":54.731000000000002,"15min":54.731000000000002},"last":0.309},{"interface":"front","average":{"1min":0.83699999999999997,"5min":1.9330000000000001,"15min":1.6779999999999999},"min":{"1min":0.28299999999999997,"5min":0.252,"15min":0.25},"max":{"1min":2.903,"5min":52.490000000000002,"15min":52.490000000000002},"last":0.42799999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:51:10 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":1.77,"15min":1.974},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.274,"5min":9.0619999999999994,"15min":9.0619999999999994},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":1.8069999999999999,"15min":2.0110000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.2930000000000001,"5min":9.0899999999999999,"15min":9.0899999999999999},"last":0.51500000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:51:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":1.462,"15min":1.6899999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.464,"5min":6.5579999999999998,"15min":15.914999999999999},"last":0.373},{"interface":"front","average":{"1min":0.56399999999999995,"5min":1.4610000000000001,"15min":1.6819999999999999},"min":{"1min":0.30099999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":2.242,"5min":9.4000000000000004,"15min":13.321},"last":0.38800000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:51:25 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.9359999999999999,"15min":1.764},"min":{"1min":0.28199999999999997,"5min":0.23799999999999999,"15min":0.23400000000000001},"max":{"1min":3.02,"5min":16.731999999999999,"15min":18.916},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":1.9359999999999999,"15min":1.96},"min":{"1min":0.29599999999999999,"5min":0.26700000000000002,"15min":0.253},"max":{"1min":2.4239999999999999,"5min":8.2959999999999994,"15min":14.840999999999999},"last":0.45900000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:51:33 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.7709999999999999,"15min":1.6459999999999999},"min":{"1min":0.33000000000000002,"5min":0.28999999999999998,"15min":0.28599999999999998},"max":{"1min":2.9289999999999998,"5min":9.1720000000000006,"15min":13.27},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.92500000000000004,"5min":2.101,"15min":1.8480000000000001},"min":{"1min":0.31900000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":2.9390000000000001,"5min":18.670000000000002,"15min":18.670000000000002},"last":0.502}]},{"osd":7,"last update":"Mon Feb 19 21:52:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":1.7350000000000001,"15min":1.7849999999999999},"min":{"1min":0.36399999999999999,"5min":0.311,"15min":0.30399999999999999},"max":{"1min":2.8679999999999999,"5min":16.763999999999999,"15min":16.763999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":1.403,"15min":1.6970000000000001},"min":{"1min":0.36299999999999999,"5min":0.32400000000000001,"15min":0.31},"max":{"1min":2.5310000000000001,"5min":10.044,"15min":12.808999999999999},"last":0.48899999999999999}]}]},{"osd":5,"up_from":38,"seq":163208757500,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2489392,"kb_used_data":1603048,"kb_used_omap":0,"kb_used_meta":886336,"kb_avail":91255760,"statfs":{"total":95995035648,"available":93445898240,"internally_reserved":0,"allocated":1641521152,"data_stored":1640187038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":907608064},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":1.306,"15min":1.728},"min":{"1min":0.24199999999999999,"5min":0.23100000000000001,"15min":0.20599999999999999},"max":{"1min":2.96,"5min":19.236000000000001,"15min":20.550999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":1.204,"15min":1.853},"min":{"1min":0.24099999999999999,"5min":0.23699999999999999,"15min":0.20899999999999999},"max":{"1min":0.52800000000000002,"5min":10.887,"15min":20.879000000000001},"last":0.36299999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":1.1890000000000001,"15min":1.663},"min":{"1min":0.246,"5min":0.246,"15min":0.23100000000000001},"max":{"1min":0.51500000000000001,"5min":8.2010000000000005,"15min":10.42},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":1.05,"15min":1.5449999999999999},"min":{"1min":0.29099999999999998,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":2.794,"5min":10.315,"15min":10.965},"last":0.433}]},{"osd":2,"last update":"Mon Feb 19 21:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":1.131,"15min":1.3080000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":3.9470000000000001,"5min":7.0380000000000003,"15min":7.0380000000000003},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":1.0940000000000001,"15min":1.24},"min":{"1min":0.309,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.9119999999999999,"5min":4.2619999999999996,"15min":4.2619999999999996},"last":0.309}]},{"osd":3,"last update":"Mon Feb 19 21:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":1.4319999999999999,"15min":1.998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.24099999999999999},"max":{"1min":2.9039999999999999,"5min":19.321000000000002,"15min":20.146999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":1.24,"15min":2.0680000000000001},"min":{"1min":0.35899999999999999,"5min":0.33600000000000002,"15min":0.29499999999999998},"max":{"1min":2.883,"5min":8.0359999999999996,"15min":20.120000000000001},"last":0.41699999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.95299999999999996,"15min":1.4059999999999999},"min":{"1min":0.26200000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":2.7280000000000002,"5min":7.6710000000000003,"15min":21.577000000000002},"last":0.375},{"interface":"front","average":{"1min":0.46400000000000002,"5min":1.6040000000000001,"15min":1.879},"min":{"1min":0.317,"5min":0.26100000000000001,"15min":0.25600000000000001},"max":{"1min":0.872,"5min":19.274000000000001,"15min":19.274000000000001},"last":0.44800000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:51:33 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":2.0529999999999999,"15min":1.9259999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.221},"max":{"1min":5.8819999999999997,"5min":19.884,"15min":19.884},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":1.6799999999999999,"15min":1.8660000000000001},"min":{"1min":0.30199999999999999,"5min":0.26700000000000002,"15min":0.23599999999999999},"max":{"1min":2.1099999999999999,"5min":10.260999999999999,"15min":13.532999999999999},"last":0.46500000000000002}]},{"osd":7,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":1.7110000000000001,"15min":2.0150000000000001},"min":{"1min":0.34200000000000003,"5min":0.33500000000000002,"15min":0.27100000000000002},"max":{"1min":1.976,"5min":12.611000000000001,"15min":12.962},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":1.611,"15min":1.843},"min":{"1min":0.38100000000000001,"5min":0.221,"15min":0.221},"max":{"1min":2.0099999999999998,"5min":15.593999999999999,"15min":17.759},"last":0.52700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2401701888,"data_stored":2401697816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":961609728,"data_stored":961609728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1659764736,"data_stored":1659764736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2657751040,"data_stored":2657746968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1635516416,"data_stored":1635516416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1683034112,"data_stored":1683030040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":794099712,"data_stored":794099712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:52:15.806 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:52:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:52:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:52:15.950 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:52:15.954 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:15.954 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:52:16.055 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:52:16.083 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:16.208 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:52:16.212 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:16.212 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:52:16.228 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:52:16.313 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:52:16.343 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:16.500 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:15.203884+0000 mgr.y (mgr.14514) 752 : cluster [DBG] pgmap v977: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.5 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 708 B/s rd, 0 B/s wr, 194 op/s; 252/174417 objects degraded (0.144%); 5974/174417 objects misplaced (3.425%); 1.7 MiB/s, 32 objects/s recovering 2024-02-19T21:52:16.500 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:15.203884+0000 mgr.y (mgr.14514) 752 : cluster [DBG] pgmap v977: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.5 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 708 B/s rd, 0 B/s wr, 194 op/s; 252/174417 objects degraded (0.144%); 5974/174417 objects misplaced (3.425%); 1.7 MiB/s, 32 objects/s recovering 2024-02-19T21:52:16.543 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:52:16.547 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:16.547 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:52:16.648 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:52:16.679 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:16.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:15.203884+0000 mgr.y (mgr.14514) 752 : cluster [DBG] pgmap v977: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.5 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 708 B/s rd, 0 B/s wr, 194 op/s; 252/174417 objects degraded (0.144%); 5974/174417 objects misplaced (3.425%); 1.7 MiB/s, 32 objects/s recovering 2024-02-19T21:52:17.089 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:52:17.089 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [], 2024-02-19T21:52:17.089 INFO:teuthology.orchestra.run.smithi157.stdout: "complaint_time": 30, 2024-02-19T21:52:17.089 INFO:teuthology.orchestra.run.smithi157.stdout: "num_blocked_ops": 0 2024-02-19T21:52:17.089 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:52:17.338 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:17.150245+0000 mon.a (mon.0) 1793 : audit [INF] from='client.? 172.21.15.80:0/2289426196' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:52:17.339 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:52:17.342 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:17.343 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:52:17.346 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-02-19T21:52:17.444 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:52:17.455 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:17.150245+0000 mon.a (mon.0) 1793 : audit [INF] from='client.? 172.21.15.80:0/2289426196' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:52:17.478 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:17.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:17.150245+0000 mon.a (mon.0) 1793 : audit [INF] from='client.? 172.21.15.80:0/2289426196' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:52:17.825 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.5 dump_historic_ops 2024-02-19T21:52:17.839 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:52:17.848 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:17.849 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:52:17.950 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:52:17.991 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:18.123 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:52:18.130 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:18.130 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:52:18.231 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:52:18.267 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:18.324 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:52:18.572 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:17.204394+0000 mgr.y (mgr.14514) 753 : cluster [DBG] pgmap v979: 138 pgs: 1 active+recovering+undersized+remapped, 135 active+clean, 2 active+recovering+undersized+degraded+remapped; 3.5 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 742 B/s rd, 0 B/s wr, 159 op/s; 200/173451 objects degraded (0.115%); 5916/173451 objects misplaced (3.411%); 1.8 MiB/s, 34 objects/s recovering 2024-02-19T21:52:18.573 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:17.332120+0000 mon.a (mon.0) 1794 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:52:18.573 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:17.341259+0000 mon.a (mon.0) 1795 : audit [INF] from='client.? 172.21.15.80:0/2289426196' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:52:18.573 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:17.341313+0000 mon.a (mon.0) 1796 : cluster [DBG] osdmap e465: 8 total, 8 up, 7 in 2024-02-19T21:52:18.573 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:17.204394+0000 mgr.y (mgr.14514) 753 : cluster [DBG] pgmap v979: 138 pgs: 1 active+recovering+undersized+remapped, 135 active+clean, 2 active+recovering+undersized+degraded+remapped; 3.5 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 742 B/s rd, 0 B/s wr, 159 op/s; 200/173451 objects degraded (0.115%); 5916/173451 objects misplaced (3.411%); 1.8 MiB/s, 34 objects/s recovering 2024-02-19T21:52:18.573 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:17.332120+0000 mon.a (mon.0) 1794 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:52:18.573 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:17.341259+0000 mon.a (mon.0) 1795 : audit [INF] from='client.? 172.21.15.80:0/2289426196' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:52:18.574 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:17.341313+0000 mon.a (mon.0) 1796 : cluster [DBG] osdmap e465: 8 total, 8 up, 7 in 2024-02-19T21:52:18.597 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:52:18.626 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:52:18.632 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:18.632 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:52:18.635 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:17.204394+0000 mgr.y (mgr.14514) 753 : cluster [DBG] pgmap v979: 138 pgs: 1 active+recovering+undersized+remapped, 135 active+clean, 2 active+recovering+undersized+degraded+remapped; 3.5 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 742 B/s rd, 0 B/s wr, 159 op/s; 200/173451 objects degraded (0.115%); 5916/173451 objects misplaced (3.411%); 1.8 MiB/s, 34 objects/s recovering 2024-02-19T21:52:18.635 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:17.332120+0000 mon.a (mon.0) 1794 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:52:18.635 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:17.341259+0000 mon.a (mon.0) 1795 : audit [INF] from='client.? 172.21.15.80:0/2289426196' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:52:18.635 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:17.341313+0000 mon.a (mon.0) 1796 : cluster [DBG] osdmap e465: 8 total, 8 up, 7 in 2024-02-19T21:52:18.732 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:52:18.780 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:18.876 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:52:18.881 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:18.881 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:52:18.982 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:52:19.057 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:19.228 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:52:19.237 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:19.237 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:52:19.244 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:52:19.267 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:52:19.296 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:52:19.323 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:52:19.338 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:52:19.349 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:52:19.377 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:52:19.407 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:19.407 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:52:19.451 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:52:19.487 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:52:19.492 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:52:19.492 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:52:19.492 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:52:19.492 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:52:19.492 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:52:19.492 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:52:19.492 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:52:19.492 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:52:19.784 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:52:19.788 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:19.788 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:52:19.889 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:52:19.926 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:20.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:18.978854+0000 mon.a (mon.0) 1797 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:52:20.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:19.231074+0000 mon.a (mon.0) 1798 : audit [DBG] from='client.? 172.21.15.80:0/490607488' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:52:20.152 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set noscrub 2024-02-19T21:52:20.183 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:18.978854+0000 mon.a (mon.0) 1797 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:52:20.184 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:19.231074+0000 mon.a (mon.0) 1798 : audit [DBG] from='client.? 172.21.15.80:0/490607488' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:52:20.184 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:18.978854+0000 mon.a (mon.0) 1797 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:52:20.184 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:19.231074+0000 mon.a (mon.0) 1798 : audit [DBG] from='client.? 172.21.15.80:0/490607488' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:52:20.471 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:52:20.471 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:52:21.096 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:52:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:52:20] "GET /metrics HTTP/1.1" 200 176571 "" "Prometheus/2.33.4" 2024-02-19T21:52:21.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:19.204865+0000 mgr.y (mgr.14514) 754 : cluster [DBG] pgmap v981: 138 pgs: 1 active+recovering+undersized+remapped, 135 active+clean, 2 active+recovering+undersized+degraded+remapped; 3.5 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 649 B/s rd, 0 B/s wr, 138 op/s; 136/173067 objects degraded (0.079%); 5852/173067 objects misplaced (3.381%); 1.6 MiB/s, 30 objects/s recovering 2024-02-19T21:52:21.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:20.311800+0000 mon.a (mon.0) 1799 : cluster [WRN] Health check update: Degraded data redundancy: 136/173067 objects degraded (0.079%), 2 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:21.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:20.320573+0000 mon.a (mon.0) 1800 : cluster [DBG] osdmap e466: 8 total, 8 up, 7 in 2024-02-19T21:52:21.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:19.204865+0000 mgr.y (mgr.14514) 754 : cluster [DBG] pgmap v981: 138 pgs: 1 active+recovering+undersized+remapped, 135 active+clean, 2 active+recovering+undersized+degraded+remapped; 3.5 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 649 B/s rd, 0 B/s wr, 138 op/s; 136/173067 objects degraded (0.079%); 5852/173067 objects misplaced (3.381%); 1.6 MiB/s, 30 objects/s recovering 2024-02-19T21:52:21.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:20.311800+0000 mon.a (mon.0) 1799 : cluster [WRN] Health check update: Degraded data redundancy: 136/173067 objects degraded (0.079%), 2 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:21.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:20.320573+0000 mon.a (mon.0) 1800 : cluster [DBG] osdmap e466: 8 total, 8 up, 7 in 2024-02-19T21:52:21.219 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:19.204865+0000 mgr.y (mgr.14514) 754 : cluster [DBG] pgmap v981: 138 pgs: 1 active+recovering+undersized+remapped, 135 active+clean, 2 active+recovering+undersized+degraded+remapped; 3.5 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 649 B/s rd, 0 B/s wr, 138 op/s; 136/173067 objects degraded (0.079%); 5852/173067 objects misplaced (3.381%); 1.6 MiB/s, 30 objects/s recovering 2024-02-19T21:52:21.219 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:20.311800+0000 mon.a (mon.0) 1799 : cluster [WRN] Health check update: Degraded data redundancy: 136/173067 objects degraded (0.079%), 2 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:21.219 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:20.320573+0000 mon.a (mon.0) 1800 : cluster [DBG] osdmap e466: 8 total, 8 up, 7 in 2024-02-19T21:52:21.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:52:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:52:21.239 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.6 dump_ops_in_flight 2024-02-19T21:52:21.285 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:52:21.289 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:21.289 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:52:21.390 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:52:21.460 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:21.506 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:21.506 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:52:21.506 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:52:21.607 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:52:21.702 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:21.734 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:52:21.740 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:52:21.743 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:21.743 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:52:21.844 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:52:21.881 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:22.236 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:52:22.243 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:22.244 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:52:22.345 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:52:22.417 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:22.711 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:52:22.716 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:22.716 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:52:22.817 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:52:22.944 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:23.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:21.074727+0000 mgr.y (mgr.14514) 755 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:52:23.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:21.205401+0000 mgr.y (mgr.14514) 756 : cluster [DBG] pgmap v983: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.4 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 477 op/s; 152/165843 objects degraded (0.092%); 5719/165843 objects misplaced (3.448%); 1.9 MiB/s, 39 objects/s recovering 2024-02-19T21:52:23.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:21.074727+0000 mgr.y (mgr.14514) 755 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:52:23.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:21.205401+0000 mgr.y (mgr.14514) 756 : cluster [DBG] pgmap v983: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.4 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 477 op/s; 152/165843 objects degraded (0.092%); 5719/165843 objects misplaced (3.448%); 1.9 MiB/s, 39 objects/s recovering 2024-02-19T21:52:23.222 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:52:23.232 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:23.232 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:52:23.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:21.074727+0000 mgr.y (mgr.14514) 755 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:52:23.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:21.205401+0000 mgr.y (mgr.14514) 756 : cluster [DBG] pgmap v983: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.4 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 477 op/s; 152/165843 objects degraded (0.092%); 5719/165843 objects misplaced (3.448%); 1.9 MiB/s, 39 objects/s recovering 2024-02-19T21:52:23.333 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:52:23.358 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:23.568 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:52:23.571 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:23.571 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:52:23.672 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:52:23.736 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:23.766 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:52:23.775 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:23.776 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:52:23.876 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:52:23.946 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:52:23.947 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:52:23.953 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:24.265 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:52:24.277 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:24.278 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:52:24.379 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:52:24.905 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:52:25.185 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:25.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:23.205924+0000 mgr.y (mgr.14514) 757 : cluster [DBG] pgmap v984: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.3 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 648 B/s rd, 0 B/s wr, 400 op/s; 195/164376 objects degraded (0.119%); 5437/164376 objects misplaced (3.308%); 3.3 MiB/s, 60 objects/s recovering 2024-02-19T21:52:25.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:23.205924+0000 mgr.y (mgr.14514) 757 : cluster [DBG] pgmap v984: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.3 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 648 B/s rd, 0 B/s wr, 400 op/s; 195/164376 objects degraded (0.119%); 5437/164376 objects misplaced (3.308%); 3.3 MiB/s, 60 objects/s recovering 2024-02-19T21:52:25.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:23.205924+0000 mgr.y (mgr.14514) 757 : cluster [DBG] pgmap v984: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.3 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 648 B/s rd, 0 B/s wr, 400 op/s; 195/164376 objects degraded (0.119%); 5437/164376 objects misplaced (3.308%); 3.3 MiB/s, 60 objects/s recovering 2024-02-19T21:52:25.468 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:52:25.470 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:52:26.040 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:52:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:52:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:52:26.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:25.313746+0000 mon.a (mon.0) 1801 : cluster [WRN] Health check update: Degraded data redundancy: 195/164376 objects degraded (0.119%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:26.339 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:25.313746+0000 mon.a (mon.0) 1801 : cluster [WRN] Health check update: Degraded data redundancy: 195/164376 objects degraded (0.119%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:26.340 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:25.313746+0000 mon.a (mon.0) 1801 : cluster [WRN] Health check update: Degraded data redundancy: 195/164376 objects degraded (0.119%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:26.954 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:52:27.039 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:25.206612+0000 mgr.y (mgr.14514) 758 : cluster [DBG] pgmap v985: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.2 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 648 op/s; 137/157893 objects degraded (0.087%); 5437/157893 objects misplaced (3.443%); 2.8 MiB/s, 59 objects/s recovering 2024-02-19T21:52:27.040 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:25.453228+0000 mgr.y (mgr.14514) 759 : audit [DBG] from='client.15924 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:52:27.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:25.206612+0000 mgr.y (mgr.14514) 758 : cluster [DBG] pgmap v985: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.2 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 648 op/s; 137/157893 objects degraded (0.087%); 5437/157893 objects misplaced (3.443%); 2.8 MiB/s, 59 objects/s recovering 2024-02-19T21:52:27.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:25.453228+0000 mgr.y (mgr.14514) 759 : audit [DBG] from='client.15924 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:52:27.345 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:25.206612+0000 mgr.y (mgr.14514) 758 : cluster [DBG] pgmap v985: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.2 GiB data, 15 GiB used, 611 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 648 op/s; 137/157893 objects degraded (0.087%); 5437/157893 objects misplaced (3.443%); 2.8 MiB/s, 59 objects/s recovering 2024-02-19T21:52:27.345 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:25.453228+0000 mgr.y (mgr.14514) 759 : audit [DBG] from='client.15924 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:52:28.232 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:52:28.240 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:28.240 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:52:28.266 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.6 dump_blocked_ops 2024-02-19T21:52:28.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:27.053536+0000 mon.a (mon.0) 1802 : cluster [DBG] osdmap e467: 8 total, 8 up, 7 in 2024-02-19T21:52:28.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:27.059199+0000 osd.1 (osd.1) 248 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:52:28.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:27.059254+0000 osd.1 (osd.1) 249 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:52:28.341 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:52:28.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:27.053536+0000 mon.a (mon.0) 1802 : cluster [DBG] osdmap e467: 8 total, 8 up, 7 in 2024-02-19T21:52:28.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:27.059199+0000 osd.1 (osd.1) 248 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:52:28.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:27.059254+0000 osd.1 (osd.1) 249 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:52:28.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:27.053536+0000 mon.a (mon.0) 1802 : cluster [DBG] osdmap e467: 8 total, 8 up, 7 in 2024-02-19T21:52:28.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:27.059199+0000 osd.1 (osd.1) 248 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:52:28.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:27.059254+0000 osd.1 (osd.1) 249 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:52:28.417 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:28.481 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:52:28.487 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:28.488 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:52:28.588 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:52:28.711 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:28.905 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:52:28.913 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:52:28.919 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:28.920 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:52:29.021 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:52:29.067 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:29.223 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:52:29.230 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:29.231 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:52:29.231 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:27.207054+0000 mgr.y (mgr.14514) 760 : cluster [DBG] pgmap v987: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.1 GiB data, 14 GiB used, 611 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 796 op/s; 354/153969 objects degraded (0.230%); 5162/153969 objects misplaced (3.353%); 2.7 MiB/s, 58 objects/s recovering 2024-02-19T21:52:29.231 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:28.057630+0000 mon.a (mon.0) 1803 : cluster [DBG] osdmap e468: 8 total, 8 up, 7 in 2024-02-19T21:52:29.231 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:27.207054+0000 mgr.y (mgr.14514) 760 : cluster [DBG] pgmap v987: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.1 GiB data, 14 GiB used, 611 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 796 op/s; 354/153969 objects degraded (0.230%); 5162/153969 objects misplaced (3.353%); 2.7 MiB/s, 58 objects/s recovering 2024-02-19T21:52:29.232 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:28.057630+0000 mon.a (mon.0) 1803 : cluster [DBG] osdmap e468: 8 total, 8 up, 7 in 2024-02-19T21:52:29.318 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:27.207054+0000 mgr.y (mgr.14514) 760 : cluster [DBG] pgmap v987: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.1 GiB data, 14 GiB used, 611 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 796 op/s; 354/153969 objects degraded (0.230%); 5162/153969 objects misplaced (3.353%); 2.7 MiB/s, 58 objects/s recovering 2024-02-19T21:52:29.318 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:28.057630+0000 mon.a (mon.0) 1803 : cluster [DBG] osdmap e468: 8 total, 8 up, 7 in 2024-02-19T21:52:29.332 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:52:29.383 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:29.386 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":985,"stamp":"2024-02-19T21:52:25.206081+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3436582588,"num_objects":52631,"num_object_clones":0,"num_object_copies":157893,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":137,"num_objects_misplaced":5437,"num_objects_unfound":0,"num_objects_dirty":52631,"num_whiteouts":0,"num_read":2301,"num_read_kb":2053,"num_write":97769,"num_write_kb":4783849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12310,"num_bytes_recovered":766778248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81802,"ondisk_log_size":81802,"up":414,"acting":411,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":417,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":656216064,"kb_used":15416348,"kb_used_data":10608676,"kb_used_omap":0,"kb_used_meta":4807231,"kb_avail":640799716,"statfs":{"total":671965249536,"available":656178909184,"internally_reserved":0,"allocated":10863284224,"data_stored":10853679093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":4922604596},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-339869696,"num_objects":-5186,"num_object_clones":0,"num_object_copies":-15558,"num_objects_missing_on_primary":-68,"num_objects_missing":-68,"num_objects_degraded":-63,"num_objects_misplaced":-479,"num_objects_unfound":0,"num_objects_dirty":-5186,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5186,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":474,"num_bytes_recovered":23396352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002017"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":62,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.339920+0000","last_change":"2024-02-19T21:49:54.492937+0000","last_active":"2024-02-19T21:52:17.339920+0000","last_peered":"2024-02-19T21:52:17.339920+0000","last_clean":"2024-02-19T21:52:17.339920+0000","last_became_active":"2024-02-19T21:49:54.492544+0000","last_became_peered":"2024-02-19T21:49:54.492544+0000","last_unstale":"2024-02-19T21:52:17.339920+0000","last_undegraded":"2024-02-19T21:52:17.339920+0000","last_fullsized":"2024-02-19T21:52:17.339920+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.643236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.643236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":441,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.346198+0000","last_change":"2024-02-19T21:45:17.201007+0000","last_active":"2024-02-19T21:52:17.346198+0000","last_peered":"2024-02-19T21:52:17.346198+0000","last_clean":"2024-02-19T21:52:17.346198+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:52:17.346198+0000","last_undegraded":"2024-02-19T21:52:17.346198+0000","last_fullsized":"2024-02-19T21:52:17.346198+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:17.200897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:17.200897+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"201'27","reported_seq":110,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.347953+0000","last_change":"2024-02-19T21:49:08.327817+0000","last_active":"2024-02-19T21:52:17.347953+0000","last_peered":"2024-02-19T21:52:17.347953+0000","last_clean":"2024-02-19T21:52:17.347953+0000","last_became_active":"2024-02-19T21:49:08.327416+0000","last_became_peered":"2024-02-19T21:49:08.327416+0000","last_unstale":"2024-02-19T21:52:17.347953+0000","last_undegraded":"2024-02-19T21:52:17.347953+0000","last_fullsized":"2024-02-19T21:52:17.347953+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'27","last_scrub_stamp":"2024-02-19T21:44:48.022013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:48.022013+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":413,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.314094+0000","last_change":"2024-02-19T21:48:30.516215+0000","last_active":"2024-02-19T21:52:15.314094+0000","last_peered":"2024-02-19T21:52:15.314094+0000","last_clean":"2024-02-19T21:52:15.314094+0000","last_became_active":"2024-02-19T21:47:46.250178+0000","last_became_peered":"2024-02-19T21:47:46.250178+0000","last_unstale":"2024-02-19T21:52:15.314094+0000","last_undegraded":"2024-02-19T21:52:15.314094+0000","last_fullsized":"2024-02-19T21:52:15.314094+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.516139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.516139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":137,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.346355+0000","last_change":"2024-02-19T21:49:08.330105+0000","last_active":"2024-02-19T21:52:17.346355+0000","last_peered":"2024-02-19T21:52:17.346355+0000","last_clean":"2024-02-19T21:52:17.346355+0000","last_became_active":"2024-02-19T21:49:08.328994+0000","last_became_peered":"2024-02-19T21:49:08.328994+0000","last_unstale":"2024-02-19T21:52:17.346355+0000","last_undegraded":"2024-02-19T21:52:17.346355+0000","last_fullsized":"2024-02-19T21:52:17.346355+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.636083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.636083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"200'19","reported_seq":509,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.313513+0000","last_change":"2024-02-19T21:48:26.530234+0000","last_active":"2024-02-19T21:52:15.313513+0000","last_peered":"2024-02-19T21:52:15.313513+0000","last_clean":"2024-02-19T21:52:15.313513+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:52:15.313513+0000","last_undegraded":"2024-02-19T21:52:15.313513+0000","last_fullsized":"2024-02-19T21:52:15.313513+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:48:26.530160+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.530160+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":197,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.321513+0000","last_change":"2024-02-19T21:49:08.332091+0000","last_active":"2024-02-19T21:52:15.321513+0000","last_peered":"2024-02-19T21:52:15.321513+0000","last_clean":"2024-02-19T21:52:15.321513+0000","last_became_active":"2024-02-19T21:49:08.331753+0000","last_became_peered":"2024-02-19T21:49:08.331753+0000","last_unstale":"2024-02-19T21:52:15.321513+0000","last_undegraded":"2024-02-19T21:52:15.321513+0000","last_fullsized":"2024-02-19T21:52:15.321513+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.005236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.005236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":454,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.340537+0000","last_change":"2024-02-19T21:48:28.327028+0000","last_active":"2024-02-19T21:52:17.340537+0000","last_peered":"2024-02-19T21:52:17.340537+0000","last_clean":"2024-02-19T21:52:17.340537+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:52:17.340537+0000","last_undegraded":"2024-02-19T21:52:17.340537+0000","last_fullsized":"2024-02-19T21:52:17.340537+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.326938+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"310'9","reported_seq":435,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.197082+0000","last_change":"2024-02-19T21:52:17.197082+0000","last_active":"2024-02-19T21:52:17.197082+0000","last_peered":"2024-02-19T21:52:17.197082+0000","last_clean":"2024-02-19T21:52:17.197082+0000","last_became_active":"2024-02-19T21:49:08.329314+0000","last_became_peered":"2024-02-19T21:49:08.329314+0000","last_unstale":"2024-02-19T21:52:17.197082+0000","last_undegraded":"2024-02-19T21:52:17.197082+0000","last_fullsized":"2024-02-19T21:52:17.197082+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"310'9","last_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_deep_scrub":"310'9","last_deep_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.506188+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":375,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.345684+0000","last_change":"2024-02-19T21:46:31.205220+0000","last_active":"2024-02-19T21:52:17.345684+0000","last_peered":"2024-02-19T21:52:17.345684+0000","last_clean":"2024-02-19T21:52:17.345684+0000","last_became_active":"2024-02-19T21:46:31.204816+0000","last_became_peered":"2024-02-19T21:46:31.204816+0000","last_unstale":"2024-02-19T21:52:17.345684+0000","last_undegraded":"2024-02-19T21:52:17.345684+0000","last_fullsized":"2024-02-19T21:52:17.345684+0000","mapping_epoch":330,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":331,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:36.890201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.890201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":476,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.340141+0000","last_change":"2024-02-19T21:49:08.330669+0000","last_active":"2024-02-19T21:52:17.340141+0000","last_peered":"2024-02-19T21:52:17.340141+0000","last_clean":"2024-02-19T21:52:17.340141+0000","last_became_active":"2024-02-19T21:49:08.329998+0000","last_became_peered":"2024-02-19T21:49:08.329998+0000","last_unstale":"2024-02-19T21:52:17.340141+0000","last_undegraded":"2024-02-19T21:52:17.340141+0000","last_fullsized":"2024-02-19T21:52:17.340141+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:58.329316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:58.329316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"200'19","reported_seq":319,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.313936+0000","last_change":"2024-02-19T21:49:08.326162+0000","last_active":"2024-02-19T21:52:15.313936+0000","last_peered":"2024-02-19T21:52:15.313936+0000","last_clean":"2024-02-19T21:52:15.313936+0000","last_became_active":"2024-02-19T21:49:08.325802+0000","last_became_peered":"2024-02-19T21:49:08.325802+0000","last_unstale":"2024-02-19T21:52:15.313936+0000","last_undegraded":"2024-02-19T21:52:15.313936+0000","last_fullsized":"2024-02-19T21:52:15.313936+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:46:54.873416+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:46:54.873416+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2],"acting":[4,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":386,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.346372+0000","last_change":"2024-02-19T21:49:04.432817+0000","last_active":"2024-02-19T21:52:17.346372+0000","last_peered":"2024-02-19T21:52:17.346372+0000","last_clean":"2024-02-19T21:52:17.346372+0000","last_became_active":"2024-02-19T21:47:33.393708+0000","last_became_peered":"2024-02-19T21:47:33.393708+0000","last_unstale":"2024-02-19T21:52:17.346372+0000","last_undegraded":"2024-02-19T21:52:17.346372+0000","last_fullsized":"2024-02-19T21:52:17.346372+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:04.432733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:04.432733+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":62,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.339993+0000","last_change":"2024-02-19T21:49:54.492767+0000","last_active":"2024-02-19T21:52:17.339993+0000","last_peered":"2024-02-19T21:52:17.339993+0000","last_clean":"2024-02-19T21:52:17.339993+0000","last_became_active":"2024-02-19T21:49:54.491745+0000","last_became_peered":"2024-02-19T21:49:54.491745+0000","last_unstale":"2024-02-19T21:52:17.339993+0000","last_undegraded":"2024-02-19T21:52:17.339993+0000","last_fullsized":"2024-02-19T21:52:17.339993+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.232539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.232539+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1d","version":"201'18","reported_seq":403,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.316226+0000","last_change":"2024-02-19T21:48:25.734661+0000","last_active":"2024-02-19T21:52:15.316226+0000","last_peered":"2024-02-19T21:52:15.316226+0000","last_clean":"2024-02-19T21:52:15.316226+0000","last_became_active":"2024-02-19T21:38:31.247067+0000","last_became_peered":"2024-02-19T21:38:31.247067+0000","last_unstale":"2024-02-19T21:52:15.316226+0000","last_undegraded":"2024-02-19T21:52:15.316226+0000","last_fullsized":"2024-02-19T21:52:15.316226+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'18","last_scrub_stamp":"2024-02-19T21:48:25.734591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.734591+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":440,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.314376+0000","last_change":"2024-02-19T21:48:40.528082+0000","last_active":"2024-02-19T21:52:15.314376+0000","last_peered":"2024-02-19T21:52:15.314376+0000","last_clean":"2024-02-19T21:52:15.314376+0000","last_became_active":"2024-02-19T21:44:58.788307+0000","last_became_peered":"2024-02-19T21:44:58.788307+0000","last_unstale":"2024-02-19T21:52:15.314376+0000","last_undegraded":"2024-02-19T21:52:15.314376+0000","last_fullsized":"2024-02-19T21:52:15.314376+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:40.527970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:48:40.527970+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":449,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.345144+0000","last_change":"2024-02-19T21:48:11.557832+0000","last_active":"2024-02-19T21:52:17.345144+0000","last_peered":"2024-02-19T21:52:17.345144+0000","last_clean":"2024-02-19T21:52:17.345144+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:52:17.345144+0000","last_undegraded":"2024-02-19T21:52:17.345144+0000","last_fullsized":"2024-02-19T21:52:17.345144+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.557736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:17.913620+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.557736+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"200'34","reported_seq":111,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.349559+0000","last_change":"2024-02-19T21:49:08.332575+0000","last_active":"2024-02-19T21:52:17.349559+0000","last_peered":"2024-02-19T21:52:17.349559+0000","last_clean":"2024-02-19T21:52:17.349559+0000","last_became_active":"2024-02-19T21:49:08.331742+0000","last_became_peered":"2024-02-19T21:49:08.331742+0000","last_unstale":"2024-02-19T21:52:17.349559+0000","last_undegraded":"2024-02-19T21:52:17.349559+0000","last_fullsized":"2024-02-19T21:52:17.349559+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'34","last_scrub_stamp":"2024-02-19T21:45:49.728734+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:45:49.728734+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":34,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":460,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.315797+0000","last_change":"2024-02-19T21:46:44.994389+0000","last_active":"2024-02-19T21:52:15.315797+0000","last_peered":"2024-02-19T21:52:15.315797+0000","last_clean":"2024-02-19T21:52:15.315797+0000","last_became_active":"2024-02-19T21:44:58.790669+0000","last_became_peered":"2024-02-19T21:44:58.790669+0000","last_unstale":"2024-02-19T21:52:15.315797+0000","last_undegraded":"2024-02-19T21:52:15.315797+0000","last_fullsized":"2024-02-19T21:52:15.315797+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.994296+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":397,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.345261+0000","last_change":"2024-02-19T21:49:08.330330+0000","last_active":"2024-02-19T21:52:17.345261+0000","last_peered":"2024-02-19T21:52:17.345261+0000","last_clean":"2024-02-19T21:52:17.345261+0000","last_became_active":"2024-02-19T21:49:08.329986+0000","last_became_peered":"2024-02-19T21:49:08.329986+0000","last_unstale":"2024-02-19T21:52:17.345261+0000","last_undegraded":"2024-02-19T21:52:17.345261+0000","last_fullsized":"2024-02-19T21:52:17.345261+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.091409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.091409+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"201'19","reported_seq":345,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.346158+0000","last_change":"2024-02-19T21:48:26.366639+0000","last_active":"2024-02-19T21:52:17.346158+0000","last_peered":"2024-02-19T21:52:17.346158+0000","last_clean":"2024-02-19T21:52:17.346158+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:52:17.346158+0000","last_undegraded":"2024-02-19T21:52:17.346158+0000","last_fullsized":"2024-02-19T21:52:17.346158+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:26.366563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.366563+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":322,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.339831+0000","last_change":"2024-02-19T21:51:22.461995+0000","last_active":"2024-02-19T21:52:17.339831+0000","last_peered":"2024-02-19T21:52:17.339831+0000","last_clean":"2024-02-19T21:52:17.339831+0000","last_became_active":"2024-02-19T21:51:22.461599+0000","last_became_peered":"2024-02-19T21:51:22.461599+0000","last_unstale":"2024-02-19T21:52:17.339831+0000","last_undegraded":"2024-02-19T21:52:17.339831+0000","last_fullsized":"2024-02-19T21:52:17.339831+0000","mapping_epoch":445,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":446,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:13.196112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:13.196112+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":460,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.319476+0000","last_change":"2024-02-19T21:49:54.491840+0000","last_active":"2024-02-19T21:52:15.319476+0000","last_peered":"2024-02-19T21:52:15.319476+0000","last_clean":"2024-02-19T21:52:15.319476+0000","last_became_active":"2024-02-19T21:49:54.491488+0000","last_became_peered":"2024-02-19T21:49:54.491488+0000","last_unstale":"2024-02-19T21:52:15.319476+0000","last_undegraded":"2024-02-19T21:52:15.319476+0000","last_fullsized":"2024-02-19T21:52:15.319476+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.803606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.803606+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"201'20","reported_seq":546,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.346401+0000","last_change":"2024-02-19T21:49:54.502402+0000","last_active":"2024-02-19T21:52:17.346401+0000","last_peered":"2024-02-19T21:52:17.346401+0000","last_clean":"2024-02-19T21:52:17.346401+0000","last_became_active":"2024-02-19T21:49:54.483748+0000","last_became_peered":"2024-02-19T21:49:54.483748+0000","last_unstale":"2024-02-19T21:52:17.346401+0000","last_undegraded":"2024-02-19T21:52:17.346401+0000","last_fullsized":"2024-02-19T21:52:17.346401+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:48:25.348437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.348437+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":381,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.345817+0000","last_change":"2024-02-19T21:49:08.328206+0000","last_active":"2024-02-19T21:52:17.345817+0000","last_peered":"2024-02-19T21:52:17.345817+0000","last_clean":"2024-02-19T21:52:17.345817+0000","last_became_active":"2024-02-19T21:49:08.327865+0000","last_became_peered":"2024-02-19T21:49:08.327865+0000","last_unstale":"2024-02-19T21:52:17.345817+0000","last_undegraded":"2024-02-19T21:52:17.345817+0000","last_fullsized":"2024-02-19T21:52:17.345817+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.230652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.230652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":441,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.339666+0000","last_change":"2024-02-19T21:48:22.171667+0000","last_active":"2024-02-19T21:52:17.339666+0000","last_peered":"2024-02-19T21:52:17.339666+0000","last_clean":"2024-02-19T21:52:17.339666+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:52:17.339666+0000","last_undegraded":"2024-02-19T21:52:17.339666+0000","last_fullsized":"2024-02-19T21:52:17.339666+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.171600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.171600+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":477,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.346448+0000","last_change":"2024-02-19T21:49:08.330636+0000","last_active":"2024-02-19T21:52:17.346448+0000","last_peered":"2024-02-19T21:52:17.346448+0000","last_clean":"2024-02-19T21:52:17.346448+0000","last_became_active":"2024-02-19T21:49:08.330293+0000","last_became_peered":"2024-02-19T21:49:08.330293+0000","last_unstale":"2024-02-19T21:52:17.346448+0000","last_undegraded":"2024-02-19T21:52:17.346448+0000","last_fullsized":"2024-02-19T21:52:17.346448+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:03.034839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:03.034839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"381'24","reported_seq":74,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.339353+0000","last_change":"2024-02-19T21:49:55.368481+0000","last_active":"2024-02-19T21:52:17.339353+0000","last_peered":"2024-02-19T21:52:17.339353+0000","last_clean":"2024-02-19T21:52:17.339353+0000","last_became_active":"2024-02-19T21:49:54.485438+0000","last_became_peered":"2024-02-19T21:49:54.485438+0000","last_unstale":"2024-02-19T21:52:17.339353+0000","last_undegraded":"2024-02-19T21:52:17.339353+0000","last_fullsized":"2024-02-19T21:52:17.339353+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"381'24","last_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_deep_scrub":"381'24","last_deep_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_clean_scrub_stamp":"2024-02-19T21:48:39.382725+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,5],"acting":[7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":469,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.339662+0000","last_change":"2024-02-19T21:49:17.193002+0000","last_active":"2024-02-19T21:52:17.339662+0000","last_peered":"2024-02-19T21:52:17.339662+0000","last_clean":"2024-02-19T21:52:17.339662+0000","last_became_active":"2024-02-19T21:49:08.333537+0000","last_became_peered":"2024-02-19T21:49:08.333537+0000","last_unstale":"2024-02-19T21:52:17.339662+0000","last_undegraded":"2024-02-19T21:52:17.339662+0000","last_fullsized":"2024-02-19T21:52:17.339662+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:59.339649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:45:59.339649+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.345358+0000","last_change":"2024-02-19T21:49:54.494561+0000","last_active":"2024-02-19T21:52:17.345358+0000","last_peered":"2024-02-19T21:52:17.345358+0000","last_clean":"2024-02-19T21:52:17.345358+0000","last_became_active":"2024-02-19T21:49:54.494146+0000","last_became_peered":"2024-02-19T21:49:54.494146+0000","last_unstale":"2024-02-19T21:52:17.345358+0000","last_undegraded":"2024-02-19T21:52:17.345358+0000","last_fullsized":"2024-02-19T21:52:17.345358+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.560066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":470,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.321098+0000","last_change":"2024-02-19T21:49:09.765641+0000","last_active":"2024-02-19T21:52:15.321098+0000","last_peered":"2024-02-19T21:52:15.321098+0000","last_clean":"2024-02-19T21:52:15.321098+0000","last_became_active":"2024-02-19T21:49:08.331308+0000","last_became_peered":"2024-02-19T21:49:08.331308+0000","last_unstale":"2024-02-19T21:52:15.321098+0000","last_undegraded":"2024-02-19T21:52:15.321098+0000","last_fullsized":"2024-02-19T21:52:15.321098+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.765568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.765568+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"200'8","reported_seq":157,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.315042+0000","last_change":"2024-02-19T21:47:33.577363+0000","last_active":"2024-02-19T21:52:15.315042+0000","last_peered":"2024-02-19T21:52:15.315042+0000","last_clean":"2024-02-19T21:52:15.315042+0000","last_became_active":"2024-02-19T21:47:33.395217+0000","last_became_peered":"2024-02-19T21:47:33.395217+0000","last_unstale":"2024-02-19T21:52:15.315042+0000","last_undegraded":"2024-02-19T21:52:15.315042+0000","last_fullsized":"2024-02-19T21:52:15.315042+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'8","last_scrub_stamp":"2024-02-19T21:46:47.761677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.761677+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":381,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.345721+0000","last_change":"2024-02-19T21:49:08.918163+0000","last_active":"2024-02-19T21:52:17.345721+0000","last_peered":"2024-02-19T21:52:17.345721+0000","last_clean":"2024-02-19T21:52:17.345721+0000","last_became_active":"2024-02-19T21:49:08.328416+0000","last_became_peered":"2024-02-19T21:49:08.328416+0000","last_unstale":"2024-02-19T21:52:17.345721+0000","last_undegraded":"2024-02-19T21:52:17.345721+0000","last_fullsized":"2024-02-19T21:52:17.345721+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.918083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.918083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":458,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.315621+0000","last_change":"2024-02-19T21:49:54.480716+0000","last_active":"2024-02-19T21:52:15.315621+0000","last_peered":"2024-02-19T21:52:15.315621+0000","last_clean":"2024-02-19T21:52:15.315621+0000","last_became_active":"2024-02-19T21:49:54.480368+0000","last_became_peered":"2024-02-19T21:49:54.480368+0000","last_unstale":"2024-02-19T21:52:15.315621+0000","last_undegraded":"2024-02-19T21:52:15.315621+0000","last_fullsized":"2024-02-19T21:52:15.315621+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:19.596775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:19.596775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":442,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.315974+0000","last_change":"2024-02-19T21:49:05.012463+0000","last_active":"2024-02-19T21:52:15.315974+0000","last_peered":"2024-02-19T21:52:15.315974+0000","last_clean":"2024-02-19T21:52:15.315974+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:52:15.315974+0000","last_undegraded":"2024-02-19T21:52:15.315974+0000","last_fullsized":"2024-02-19T21:52:15.315974+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.012395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.012395+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"201'19","reported_seq":489,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.314227+0000","last_change":"2024-02-19T21:48:38.529106+0000","last_active":"2024-02-19T21:52:15.314227+0000","last_peered":"2024-02-19T21:52:15.314227+0000","last_clean":"2024-02-19T21:52:15.314227+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:52:15.314227+0000","last_undegraded":"2024-02-19T21:52:15.314227+0000","last_fullsized":"2024-02-19T21:52:15.314227+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:38.528977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.528977+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":446,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.345415+0000","last_change":"2024-02-19T21:46:06.096531+0000","last_active":"2024-02-19T21:52:17.345415+0000","last_peered":"2024-02-19T21:52:17.345415+0000","last_clean":"2024-02-19T21:52:17.345415+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:52:17.345415+0000","last_undegraded":"2024-02-19T21:52:17.345415+0000","last_fullsized":"2024-02-19T21:52:17.345415+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.096422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":257,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.345704+0000","last_change":"2024-02-19T21:48:38.391532+0000","last_active":"2024-02-19T21:52:17.345704+0000","last_peered":"2024-02-19T21:52:17.345704+0000","last_clean":"2024-02-19T21:52:17.345704+0000","last_became_active":"2024-02-19T21:47:33.395085+0000","last_became_peered":"2024-02-19T21:47:33.395085+0000","last_unstale":"2024-02-19T21:52:17.345704+0000","last_undegraded":"2024-02-19T21:52:17.345704+0000","last_fullsized":"2024-02-19T21:52:17.345704+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:38.391435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.391435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":458,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.344964+0000","last_change":"2024-02-19T21:48:14.600378+0000","last_active":"2024-02-19T21:52:17.344964+0000","last_peered":"2024-02-19T21:52:17.344964+0000","last_clean":"2024-02-19T21:52:17.344964+0000","last_became_active":"2024-02-19T21:47:33.393932+0000","last_became_peered":"2024-02-19T21:47:33.393932+0000","last_unstale":"2024-02-19T21:52:17.344964+0000","last_undegraded":"2024-02-19T21:52:17.344964+0000","last_fullsized":"2024-02-19T21:52:17.344964+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:14.600285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.600285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"200'15","reported_seq":511,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.315450+0000","last_change":"2024-02-19T21:49:08.334199+0000","last_active":"2024-02-19T21:52:15.315450+0000","last_peered":"2024-02-19T21:52:15.315450+0000","last_clean":"2024-02-19T21:52:15.315450+0000","last_became_active":"2024-02-19T21:49:08.333872+0000","last_became_peered":"2024-02-19T21:49:08.333872+0000","last_unstale":"2024-02-19T21:52:15.315450+0000","last_undegraded":"2024-02-19T21:52:15.315450+0000","last_fullsized":"2024-02-19T21:52:15.315450+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:45:08.678669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:08.678669+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":423,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.314263+0000","last_change":"2024-02-19T21:49:08.330114+0000","last_active":"2024-02-19T21:52:15.314263+0000","last_peered":"2024-02-19T21:52:15.314263+0000","last_clean":"2024-02-19T21:52:15.314263+0000","last_became_active":"2024-02-19T21:49:08.329770+0000","last_became_peered":"2024-02-19T21:49:08.329770+0000","last_unstale":"2024-02-19T21:52:15.314263+0000","last_undegraded":"2024-02-19T21:52:15.314263+0000","last_fullsized":"2024-02-19T21:52:15.314263+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:08.983923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.983923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"415'17","reported_seq":96,"reported_epoch":466,"state":"active+clean","last_fresh":"2024-02-19T21:52:20.354440+0000","last_change":"2024-02-19T21:50:49.705247+0000","last_active":"2024-02-19T21:52:20.354440+0000","last_peered":"2024-02-19T21:52:20.354440+0000","last_clean":"2024-02-19T21:52:20.354440+0000","last_became_active":"2024-02-19T21:49:54.486304+0000","last_became_peered":"2024-02-19T21:49:54.486304+0000","last_unstale":"2024-02-19T21:52:20.354440+0000","last_undegraded":"2024-02-19T21:52:20.354440+0000","last_fullsized":"2024-02-19T21:52:20.354440+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"199'13","last_scrub_stamp":"2024-02-19T21:45:05.721709+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:45:05.721709+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":468,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.345932+0000","last_change":"2024-02-19T21:49:54.484516+0000","last_active":"2024-02-19T21:52:17.345932+0000","last_peered":"2024-02-19T21:52:17.345932+0000","last_clean":"2024-02-19T21:52:17.345932+0000","last_became_active":"2024-02-19T21:49:54.483689+0000","last_became_peered":"2024-02-19T21:49:54.483689+0000","last_unstale":"2024-02-19T21:52:17.345932+0000","last_undegraded":"2024-02-19T21:52:17.345932+0000","last_fullsized":"2024-02-19T21:52:17.345932+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.157478+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"201'19","reported_seq":488,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.320487+0000","last_change":"2024-02-19T21:48:27.720048+0000","last_active":"2024-02-19T21:52:15.320487+0000","last_peered":"2024-02-19T21:52:15.320487+0000","last_clean":"2024-02-19T21:52:15.320487+0000","last_became_active":"2024-02-19T21:47:33.398295+0000","last_became_peered":"2024-02-19T21:47:33.398295+0000","last_unstale":"2024-02-19T21:52:15.320487+0000","last_undegraded":"2024-02-19T21:52:15.320487+0000","last_fullsized":"2024-02-19T21:52:15.320487+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:27.719954+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:48:27.719954+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":185,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.346224+0000","last_change":"2024-02-19T21:49:54.484392+0000","last_active":"2024-02-19T21:52:17.346224+0000","last_peered":"2024-02-19T21:52:17.346224+0000","last_clean":"2024-02-19T21:52:17.346224+0000","last_became_active":"2024-02-19T21:49:54.484049+0000","last_became_peered":"2024-02-19T21:49:54.484049+0000","last_unstale":"2024-02-19T21:52:17.346224+0000","last_undegraded":"2024-02-19T21:52:17.346224+0000","last_fullsized":"2024-02-19T21:52:17.346224+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.121769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.121769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":686,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.098711+0000","last_change":"2024-02-19T21:48:38.723220+0000","last_active":"2024-02-19T21:52:17.098711+0000","last_peered":"2024-02-19T21:52:17.098711+0000","last_clean":"2024-02-19T21:52:17.098711+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:52:17.098711+0000","last_undegraded":"2024-02-19T21:52:17.098711+0000","last_fullsized":"2024-02-19T21:52:17.098711+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:48:38.723151+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.723151+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":471,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.319791+0000","last_change":"2024-02-19T21:49:54.485462+0000","last_active":"2024-02-19T21:52:15.319791+0000","last_peered":"2024-02-19T21:52:15.319791+0000","last_clean":"2024-02-19T21:52:15.319791+0000","last_became_active":"2024-02-19T21:49:54.485121+0000","last_became_peered":"2024-02-19T21:49:54.485121+0000","last_unstale":"2024-02-19T21:52:15.319791+0000","last_undegraded":"2024-02-19T21:52:15.319791+0000","last_fullsized":"2024-02-19T21:52:15.319791+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:07.724097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:49:07.724097+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"201'25","reported_seq":349,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.315632+0000","last_change":"2024-02-19T21:49:08.335077+0000","last_active":"2024-02-19T21:52:15.315632+0000","last_peered":"2024-02-19T21:52:15.315632+0000","last_clean":"2024-02-19T21:52:15.315632+0000","last_became_active":"2024-02-19T21:49:08.334061+0000","last_became_peered":"2024-02-19T21:49:08.334061+0000","last_unstale":"2024-02-19T21:52:15.315632+0000","last_undegraded":"2024-02-19T21:52:15.315632+0000","last_fullsized":"2024-02-19T21:52:15.315632+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'25","last_scrub_stamp":"2024-02-19T21:46:07.553690+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.553690+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":24,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":441,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.340468+0000","last_change":"2024-02-19T21:48:21.256471+0000","last_active":"2024-02-19T21:52:17.340468+0000","last_peered":"2024-02-19T21:52:17.340468+0000","last_clean":"2024-02-19T21:52:17.340468+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:52:17.340468+0000","last_undegraded":"2024-02-19T21:52:17.340468+0000","last_fullsized":"2024-02-19T21:52:17.340468+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.256358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.256358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":448,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.345437+0000","last_change":"2024-02-19T21:46:35.035136+0000","last_active":"2024-02-19T21:52:17.345437+0000","last_peered":"2024-02-19T21:52:17.345437+0000","last_clean":"2024-02-19T21:52:17.345437+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:52:17.345437+0000","last_undegraded":"2024-02-19T21:52:17.345437+0000","last_fullsized":"2024-02-19T21:52:17.345437+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:35.035042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:35.035042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"201'12","reported_seq":70,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.340718+0000","last_change":"2024-02-19T21:50:49.700758+0000","last_active":"2024-02-19T21:52:17.340718+0000","last_peered":"2024-02-19T21:52:17.340718+0000","last_clean":"2024-02-19T21:52:17.340718+0000","last_became_active":"2024-02-19T21:49:54.478094+0000","last_became_peered":"2024-02-19T21:49:54.478094+0000","last_unstale":"2024-02-19T21:52:17.340718+0000","last_undegraded":"2024-02-19T21:52:17.340718+0000","last_fullsized":"2024-02-19T21:52:17.340718+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'12","last_scrub_stamp":"2024-02-19T21:49:08.912638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.912638+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":94,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.349611+0000","last_change":"2024-02-19T21:49:08.332757+0000","last_active":"2024-02-19T21:52:17.349611+0000","last_peered":"2024-02-19T21:52:17.349611+0000","last_clean":"2024-02-19T21:52:17.349611+0000","last_became_active":"2024-02-19T21:49:08.332176+0000","last_became_peered":"2024-02-19T21:49:08.332176+0000","last_unstale":"2024-02-19T21:52:17.349611+0000","last_undegraded":"2024-02-19T21:52:17.349611+0000","last_fullsized":"2024-02-19T21:52:17.349611+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:47:01.365477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:47:01.365477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":94,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.347701+0000","last_change":"2024-02-19T21:49:08.328632+0000","last_active":"2024-02-19T21:52:17.347701+0000","last_peered":"2024-02-19T21:52:17.347701+0000","last_clean":"2024-02-19T21:52:17.347701+0000","last_became_active":"2024-02-19T21:49:08.327826+0000","last_became_peered":"2024-02-19T21:49:08.327826+0000","last_unstale":"2024-02-19T21:52:17.347701+0000","last_undegraded":"2024-02-19T21:52:17.347701+0000","last_fullsized":"2024-02-19T21:52:17.347701+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:09.645607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:44:09.645607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"200'15","reported_seq":574,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.346324+0000","last_change":"2024-02-19T21:50:49.704824+0000","last_active":"2024-02-19T21:52:17.346324+0000","last_peered":"2024-02-19T21:52:17.346324+0000","last_clean":"2024-02-19T21:52:17.346324+0000","last_became_active":"2024-02-19T21:49:54.483578+0000","last_became_peered":"2024-02-19T21:49:54.483578+0000","last_unstale":"2024-02-19T21:52:17.346324+0000","last_undegraded":"2024-02-19T21:52:17.346324+0000","last_fullsized":"2024-02-19T21:52:17.346324+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:44:53.072746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:53.072746+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"466'6205","reported_seq":8486,"reported_epoch":466,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:52:25.148976+0000","last_change":"2024-02-19T21:50:38.722849+0000","last_active":"2024-02-19T21:52:25.148976+0000","last_peered":"2024-02-19T21:52:25.148976+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:09.770699+0000","last_became_peered":"2024-02-19T21:49:09.770699+0000","last_unstale":"2024-02-19T21:52:25.148976+0000","last_undegraded":"2024-02-19T21:49:09.328794+0000","last_fullsized":"2024-02-19T21:49:09.325036+0000","mapping_epoch":395,"log_start":"397'1300","ondisk_log_start":"397'1300","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4905,"ondisk_log_size":4905,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":214106112,"num_objects":3267,"num_object_clones":0,"num_object_copies":9801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":15,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3267,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6205,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1093,"num_bytes_recovered":61734912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5],"avail_no_missing":["6","5"],"object_location_counts":[{"shards":"5,6","objects":3252}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":62,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.339848+0000","last_change":"2024-02-19T21:49:54.492844+0000","last_active":"2024-02-19T21:52:17.339848+0000","last_peered":"2024-02-19T21:52:17.339848+0000","last_clean":"2024-02-19T21:52:17.339848+0000","last_became_active":"2024-02-19T21:49:54.492156+0000","last_became_peered":"2024-02-19T21:49:54.492156+0000","last_unstale":"2024-02-19T21:52:17.339848+0000","last_undegraded":"2024-02-19T21:52:17.339848+0000","last_fullsized":"2024-02-19T21:52:17.339848+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:04.692807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.692807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"378'4","reported_seq":479,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.314453+0000","last_change":"2024-02-19T21:48:28.510929+0000","last_active":"2024-02-19T21:52:15.314453+0000","last_peered":"2024-02-19T21:52:15.314453+0000","last_clean":"2024-02-19T21:52:15.314453+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:52:15.314453+0000","last_undegraded":"2024-02-19T21:52:15.314453+0000","last_fullsized":"2024-02-19T21:52:15.314453+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"378'4","last_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_deep_scrub":"378'4","last_deep_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.510849+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"200'23","reported_seq":326,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.313811+0000","last_change":"2024-02-19T21:48:22.519465+0000","last_active":"2024-02-19T21:52:15.313811+0000","last_peered":"2024-02-19T21:52:15.313811+0000","last_clean":"2024-02-19T21:52:15.313811+0000","last_became_active":"2024-02-19T21:47:46.252085+0000","last_became_peered":"2024-02-19T21:47:46.252085+0000","last_unstale":"2024-02-19T21:52:15.313811+0000","last_undegraded":"2024-02-19T21:52:15.313811+0000","last_fullsized":"2024-02-19T21:52:15.313811+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'23","last_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_deep_scrub":"200'23","last_deep_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.519381+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6],"acting":[4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":94,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.347757+0000","last_change":"2024-02-19T21:49:08.328855+0000","last_active":"2024-02-19T21:52:17.347757+0000","last_peered":"2024-02-19T21:52:17.347757+0000","last_clean":"2024-02-19T21:52:17.347757+0000","last_became_active":"2024-02-19T21:49:08.328237+0000","last_became_peered":"2024-02-19T21:49:08.328237+0000","last_unstale":"2024-02-19T21:52:17.347757+0000","last_undegraded":"2024-02-19T21:52:17.347757+0000","last_fullsized":"2024-02-19T21:52:17.347757+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:58.047556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:58.047556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"466'6012","reported_seq":6100,"reported_epoch":466,"state":"active+clean","last_fresh":"2024-02-19T21:52:24.773450+0000","last_change":"2024-02-19T21:48:47.778295+0000","last_active":"2024-02-19T21:52:24.773450+0000","last_peered":"2024-02-19T21:52:24.773450+0000","last_clean":"2024-02-19T21:52:24.773450+0000","last_became_active":"2024-02-19T21:48:47.777964+0000","last_became_peered":"2024-02-19T21:48:47.777964+0000","last_unstale":"2024-02-19T21:52:24.773450+0000","last_undegraded":"2024-02-19T21:52:24.773450+0000","last_fullsized":"2024-02-19T21:52:24.773450+0000","mapping_epoch":385,"log_start":"397'1300","ondisk_log_start":"397'1300","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4712,"ondisk_log_size":4712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":205651968,"num_objects":3138,"num_object_clones":0,"num_object_copies":9414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3138,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6012,"num_write_kb":292800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":495,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.345475+0000","last_change":"2024-02-19T21:49:08.328019+0000","last_active":"2024-02-19T21:52:17.345475+0000","last_peered":"2024-02-19T21:52:17.345475+0000","last_clean":"2024-02-19T21:52:17.345475+0000","last_became_active":"2024-02-19T21:49:08.327581+0000","last_became_peered":"2024-02-19T21:49:08.327581+0000","last_unstale":"2024-02-19T21:52:17.345475+0000","last_undegraded":"2024-02-19T21:52:17.345475+0000","last_fullsized":"2024-02-19T21:52:17.345475+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:22.180593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:45:22.180593+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5],"acting":[0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":440,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.315554+0000","last_change":"2024-02-19T21:48:37.789514+0000","last_active":"2024-02-19T21:52:15.315554+0000","last_peered":"2024-02-19T21:52:15.315554+0000","last_clean":"2024-02-19T21:52:15.315554+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:52:15.315554+0000","last_undegraded":"2024-02-19T21:52:15.315554+0000","last_fullsized":"2024-02-19T21:52:15.315554+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:37.789400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:37.789400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"201'20","reported_seq":346,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.315538+0000","last_change":"2024-02-19T21:45:57.877936+0000","last_active":"2024-02-19T21:52:15.315538+0000","last_peered":"2024-02-19T21:52:15.315538+0000","last_clean":"2024-02-19T21:52:15.315538+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:52:15.315538+0000","last_undegraded":"2024-02-19T21:52:15.315538+0000","last_fullsized":"2024-02-19T21:52:15.315538+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:45:57.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:57.877856+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":692,"reported_epoch":466,"state":"active+clean","last_fresh":"2024-02-19T21:52:20.332533+0000","last_change":"2024-02-19T21:49:01.011149+0000","last_active":"2024-02-19T21:52:20.332533+0000","last_peered":"2024-02-19T21:52:20.332533+0000","last_clean":"2024-02-19T21:52:20.332533+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:52:20.332533+0000","last_undegraded":"2024-02-19T21:52:20.332533+0000","last_fullsized":"2024-02-19T21:52:20.332533+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:49:01.011078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:49:01.011078+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.a","version":"466'6211","reported_seq":6299,"reported_epoch":466,"state":"active+clean","last_fresh":"2024-02-19T21:52:25.122973+0000","last_change":"2024-02-19T21:48:47.778138+0000","last_active":"2024-02-19T21:52:25.122973+0000","last_peered":"2024-02-19T21:52:25.122973+0000","last_clean":"2024-02-19T21:52:25.122973+0000","last_became_active":"2024-02-19T21:48:47.777820+0000","last_became_peered":"2024-02-19T21:48:47.777820+0000","last_unstale":"2024-02-19T21:52:25.122973+0000","last_undegraded":"2024-02-19T21:52:25.122973+0000","last_fullsized":"2024-02-19T21:52:25.122973+0000","mapping_epoch":385,"log_start":"397'1300","ondisk_log_start":"397'1300","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4911,"ondisk_log_size":4911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":208601088,"num_objects":3183,"num_object_clones":0,"num_object_copies":9549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3183,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6211,"num_write_kb":300608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":389,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.314807+0000","last_change":"2024-02-19T21:48:33.478821+0000","last_active":"2024-02-19T21:52:15.314807+0000","last_peered":"2024-02-19T21:52:15.314807+0000","last_clean":"2024-02-19T21:52:15.314807+0000","last_became_active":"2024-02-19T21:44:56.149476+0000","last_became_peered":"2024-02-19T21:44:56.149476+0000","last_unstale":"2024-02-19T21:52:15.314807+0000","last_undegraded":"2024-02-19T21:52:15.314807+0000","last_fullsized":"2024-02-19T21:52:15.314807+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:33.478715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:48:33.478715+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":450,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.319866+0000","last_change":"2024-02-19T21:46:41.834315+0000","last_active":"2024-02-19T21:52:15.319866+0000","last_peered":"2024-02-19T21:52:15.319866+0000","last_clean":"2024-02-19T21:52:15.319866+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:52:15.319866+0000","last_undegraded":"2024-02-19T21:52:15.319866+0000","last_fullsized":"2024-02-19T21:52:15.319866+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:41.834246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:46:41.834246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"397'46","reported_seq":880,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.098632+0000","last_change":"2024-02-19T21:49:08.335296+0000","last_active":"2024-02-19T21:52:17.098632+0000","last_peered":"2024-02-19T21:52:17.098632+0000","last_clean":"2024-02-19T21:52:17.098632+0000","last_became_active":"2024-02-19T21:49:08.334527+0000","last_became_peered":"2024-02-19T21:49:08.334527+0000","last_unstale":"2024-02-19T21:52:17.098632+0000","last_undegraded":"2024-02-19T21:52:17.098632+0000","last_fullsized":"2024-02-19T21:52:17.098632+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'43","last_scrub_stamp":"2024-02-19T21:45:04.755444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.755444+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":437,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.346350+0000","last_change":"2024-02-19T21:46:45.252437+0000","last_active":"2024-02-19T21:52:17.346350+0000","last_peered":"2024-02-19T21:52:17.346350+0000","last_clean":"2024-02-19T21:52:17.346350+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:52:17.346350+0000","last_undegraded":"2024-02-19T21:52:17.346350+0000","last_fullsized":"2024-02-19T21:52:17.346350+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.252344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.252344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"465'5925","reported_seq":9622,"reported_epoch":465,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:52:20.294422+0000","last_change":"2024-02-19T21:52:18.427835+0000","last_active":"2024-02-19T21:52:20.294422+0000","last_peered":"2024-02-19T21:52:20.294422+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:55.752599+0000","last_became_peered":"2024-02-19T21:49:55.752599+0000","last_unstale":"2024-02-19T21:52:20.294422+0000","last_undegraded":"2024-02-19T21:52:18.425538+0000","last_fullsized":"2024-02-19T21:49:55.470938+0000","mapping_epoch":414,"log_start":"392'700","ondisk_log_start":"392'700","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5225,"ondisk_log_size":5225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":218562560,"num_objects":3335,"num_object_clones":0,"num_object_copies":10005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":75,"num_objects_misplaced":2737,"num_objects_unfound":0,"num_objects_dirty":3335,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5925,"num_write_kb":296320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1221,"num_bytes_recovered":80019456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2],"avail_no_missing":["5","2","4"],"object_location_counts":[{"shards":"2,4,5","objects":2737},{"shards":"2,5","objects":523}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":465,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.340662+0000","last_change":"2024-02-19T21:49:09.227437+0000","last_active":"2024-02-19T21:52:17.340662+0000","last_peered":"2024-02-19T21:52:17.340662+0000","last_clean":"2024-02-19T21:52:17.340662+0000","last_became_active":"2024-02-19T21:49:08.328437+0000","last_became_peered":"2024-02-19T21:49:08.328437+0000","last_unstale":"2024-02-19T21:52:17.340662+0000","last_undegraded":"2024-02-19T21:52:17.340662+0000","last_fullsized":"2024-02-19T21:52:17.340662+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.227355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.227355+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'6","reported_seq":1709,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:18.771823+0000","last_change":"2024-02-19T21:52:18.771823+0000","last_active":"2024-02-19T21:52:18.771823+0000","last_peered":"2024-02-19T21:52:18.771823+0000","last_clean":"2024-02-19T21:52:18.771823+0000","last_became_active":"2024-02-19T21:49:08.331108+0000","last_became_peered":"2024-02-19T21:49:08.331108+0000","last_unstale":"2024-02-19T21:52:18.771823+0000","last_undegraded":"2024-02-19T21:52:18.771823+0000","last_fullsized":"2024-02-19T21:52:18.771823+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_clean_scrub_stamp":"2024-02-19T21:44:13.678341+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1176,"num_read_kb":1171,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":94,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.348162+0000","last_change":"2024-02-19T21:49:08.329710+0000","last_active":"2024-02-19T21:52:17.348162+0000","last_peered":"2024-02-19T21:52:17.348162+0000","last_clean":"2024-02-19T21:52:17.348162+0000","last_became_active":"2024-02-19T21:49:08.329378+0000","last_became_peered":"2024-02-19T21:49:08.329378+0000","last_unstale":"2024-02-19T21:52:17.348162+0000","last_undegraded":"2024-02-19T21:52:17.348162+0000","last_fullsized":"2024-02-19T21:52:17.348162+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:55.195394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.195394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"200'17","reported_seq":497,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.315260+0000","last_change":"2024-02-19T21:48:14.878933+0000","last_active":"2024-02-19T21:52:15.315260+0000","last_peered":"2024-02-19T21:52:15.315260+0000","last_clean":"2024-02-19T21:52:15.315260+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:52:15.315260+0000","last_undegraded":"2024-02-19T21:52:15.315260+0000","last_fullsized":"2024-02-19T21:52:15.315260+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'17","last_scrub_stamp":"2024-02-19T21:48:14.878857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.878857+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":25,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":94,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.349256+0000","last_change":"2024-02-19T21:49:08.325478+0000","last_active":"2024-02-19T21:52:17.349256+0000","last_peered":"2024-02-19T21:52:17.349256+0000","last_clean":"2024-02-19T21:52:17.349256+0000","last_became_active":"2024-02-19T21:49:08.325127+0000","last_became_peered":"2024-02-19T21:49:08.325127+0000","last_unstale":"2024-02-19T21:52:17.349256+0000","last_undegraded":"2024-02-19T21:52:17.349256+0000","last_fullsized":"2024-02-19T21:52:17.349256+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:10.871111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:10.871111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"466'6217","reported_seq":6306,"reported_epoch":466,"state":"active+clean","last_fresh":"2024-02-19T21:52:25.115659+0000","last_change":"2024-02-19T21:48:47.778829+0000","last_active":"2024-02-19T21:52:25.115659+0000","last_peered":"2024-02-19T21:52:25.115659+0000","last_clean":"2024-02-19T21:52:25.115659+0000","last_became_active":"2024-02-19T21:48:47.778486+0000","last_became_peered":"2024-02-19T21:48:47.778486+0000","last_unstale":"2024-02-19T21:52:25.115659+0000","last_undegraded":"2024-02-19T21:52:25.115659+0000","last_fullsized":"2024-02-19T21:52:25.115659+0000","mapping_epoch":385,"log_start":"397'1300","ondisk_log_start":"397'1300","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4917,"ondisk_log_size":4917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":212533248,"num_objects":3243,"num_object_clones":0,"num_object_copies":9729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3243,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6217,"num_write_kb":302720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":467,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.320910+0000","last_change":"2024-02-19T21:47:33.400407+0000","last_active":"2024-02-19T21:52:15.320910+0000","last_peered":"2024-02-19T21:52:15.320910+0000","last_clean":"2024-02-19T21:52:15.320910+0000","last_became_active":"2024-02-19T21:47:33.400075+0000","last_became_peered":"2024-02-19T21:47:33.400075+0000","last_unstale":"2024-02-19T21:52:15.320910+0000","last_undegraded":"2024-02-19T21:52:15.320910+0000","last_fullsized":"2024-02-19T21:52:15.320910+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.035136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":345,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.319938+0000","last_change":"2024-02-19T21:49:05.746443+0000","last_active":"2024-02-19T21:52:15.319938+0000","last_peered":"2024-02-19T21:52:15.319938+0000","last_clean":"2024-02-19T21:52:15.319938+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:52:15.319938+0000","last_undegraded":"2024-02-19T21:52:15.319938+0000","last_fullsized":"2024-02-19T21:52:15.319938+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.746358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.746358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":497,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.320174+0000","last_change":"2024-02-19T21:49:54.485252+0000","last_active":"2024-02-19T21:52:15.320174+0000","last_peered":"2024-02-19T21:52:15.320174+0000","last_clean":"2024-02-19T21:52:15.320174+0000","last_became_active":"2024-02-19T21:49:54.484956+0000","last_became_peered":"2024-02-19T21:49:54.484956+0000","last_unstale":"2024-02-19T21:52:15.320174+0000","last_undegraded":"2024-02-19T21:52:15.320174+0000","last_fullsized":"2024-02-19T21:52:15.320174+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:07.901205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:07.901205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":62,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.339732+0000","last_change":"2024-02-19T21:49:54.483990+0000","last_active":"2024-02-19T21:52:17.339732+0000","last_peered":"2024-02-19T21:52:17.339732+0000","last_clean":"2024-02-19T21:52:17.339732+0000","last_became_active":"2024-02-19T21:49:54.483637+0000","last_became_peered":"2024-02-19T21:49:54.483637+0000","last_unstale":"2024-02-19T21:52:17.339732+0000","last_undegraded":"2024-02-19T21:52:17.339732+0000","last_fullsized":"2024-02-19T21:52:17.339732+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.190177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.190177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"201'33","reported_seq":491,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.345912+0000","last_change":"2024-02-19T21:46:47.970066+0000","last_active":"2024-02-19T21:52:17.345912+0000","last_peered":"2024-02-19T21:52:17.345912+0000","last_clean":"2024-02-19T21:52:17.345912+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:52:17.345912+0000","last_undegraded":"2024-02-19T21:52:17.345912+0000","last_fullsized":"2024-02-19T21:52:17.345912+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'33","last_scrub_stamp":"2024-02-19T21:46:47.969961+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.969961+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":25,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":62,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.340270+0000","last_change":"2024-02-19T21:49:54.478276+0000","last_active":"2024-02-19T21:52:17.340270+0000","last_peered":"2024-02-19T21:52:17.340270+0000","last_clean":"2024-02-19T21:52:17.340270+0000","last_became_active":"2024-02-19T21:49:54.477947+0000","last_became_peered":"2024-02-19T21:49:54.477947+0000","last_unstale":"2024-02-19T21:52:17.340270+0000","last_undegraded":"2024-02-19T21:52:17.340270+0000","last_fullsized":"2024-02-19T21:52:17.340270+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:57.754453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:57.754453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"466'6066","reported_seq":16296,"reported_epoch":466,"state":"active+clean","last_fresh":"2024-02-19T21:52:24.748333+0000","last_change":"2024-02-19T21:51:22.472713+0000","last_active":"2024-02-19T21:52:24.748333+0000","last_peered":"2024-02-19T21:52:24.748333+0000","last_clean":"2024-02-19T21:52:24.748333+0000","last_became_active":"2024-02-19T21:51:22.462974+0000","last_became_peered":"2024-02-19T21:51:22.462974+0000","last_unstale":"2024-02-19T21:52:24.748333+0000","last_undegraded":"2024-02-19T21:52:24.748333+0000","last_fullsized":"2024-02-19T21:52:24.748333+0000","mapping_epoch":445,"log_start":"392'900","ondisk_log_start":"392'900","created":385,"last_epoch_clean":446,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5166,"ondisk_log_size":5166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":205127680,"num_objects":3130,"num_object_clones":0,"num_object_copies":9390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3130,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6066,"num_write_kb":294272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5054,"num_bytes_recovered":320077824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7],"acting":[0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":438,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.315723+0000","last_change":"2024-02-19T21:45:47.723650+0000","last_active":"2024-02-19T21:52:15.315723+0000","last_peered":"2024-02-19T21:52:15.315723+0000","last_clean":"2024-02-19T21:52:15.315723+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:52:15.315723+0000","last_undegraded":"2024-02-19T21:52:15.315723+0000","last_fullsized":"2024-02-19T21:52:15.315723+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.723550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.723550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":450,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.345678+0000","last_change":"2024-02-19T21:45:51.243726+0000","last_active":"2024-02-19T21:52:17.345678+0000","last_peered":"2024-02-19T21:52:17.345678+0000","last_clean":"2024-02-19T21:52:17.345678+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:52:17.345678+0000","last_undegraded":"2024-02-19T21:52:17.345678+0000","last_fullsized":"2024-02-19T21:52:17.345678+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:51.243656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:51.243656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":467,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.339423+0000","last_change":"2024-02-19T21:48:23.218358+0000","last_active":"2024-02-19T21:52:17.339423+0000","last_peered":"2024-02-19T21:52:17.339423+0000","last_clean":"2024-02-19T21:52:17.339423+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:52:17.339423+0000","last_undegraded":"2024-02-19T21:52:17.339423+0000","last_fullsized":"2024-02-19T21:52:17.339423+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:23.218282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.218282+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"324'30","reported_seq":594,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.346311+0000","last_change":"2024-02-19T21:49:08.330490+0000","last_active":"2024-02-19T21:52:17.346311+0000","last_peered":"2024-02-19T21:52:17.346311+0000","last_clean":"2024-02-19T21:52:17.346311+0000","last_became_active":"2024-02-19T21:49:08.329761+0000","last_became_peered":"2024-02-19T21:49:08.329761+0000","last_unstale":"2024-02-19T21:52:17.346311+0000","last_undegraded":"2024-02-19T21:52:17.346311+0000","last_fullsized":"2024-02-19T21:52:17.346311+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'30","last_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_deep_scrub":"324'30","last_deep_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.110965+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":451,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.320823+0000","last_change":"2024-02-19T21:45:09.918263+0000","last_active":"2024-02-19T21:52:15.320823+0000","last_peered":"2024-02-19T21:52:15.320823+0000","last_clean":"2024-02-19T21:52:15.320823+0000","last_became_active":"2024-02-19T21:44:42.624782+0000","last_became_peered":"2024-02-19T21:44:42.624782+0000","last_unstale":"2024-02-19T21:52:15.320823+0000","last_undegraded":"2024-02-19T21:52:15.320823+0000","last_fullsized":"2024-02-19T21:52:15.320823+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":295,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_clean_scrub_stamp":"2024-02-19T21:45:09.918170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"466'6096","reported_seq":6186,"reported_epoch":466,"state":"active+clean","last_fresh":"2024-02-19T21:52:25.119058+0000","last_change":"2024-02-19T21:48:47.777963+0000","last_active":"2024-02-19T21:52:25.119058+0000","last_peered":"2024-02-19T21:52:25.119058+0000","last_clean":"2024-02-19T21:52:25.119058+0000","last_became_active":"2024-02-19T21:48:47.777644+0000","last_became_peered":"2024-02-19T21:48:47.777644+0000","last_unstale":"2024-02-19T21:52:25.119058+0000","last_undegraded":"2024-02-19T21:52:25.119058+0000","last_fullsized":"2024-02-19T21:52:25.119058+0000","mapping_epoch":385,"log_start":"397'1200","ondisk_log_start":"397'1200","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4896,"ondisk_log_size":4896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":207945752,"num_objects":3174,"num_object_clones":0,"num_object_copies":9522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3174,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6096,"num_write_kb":296577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":471,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.315703+0000","last_change":"2024-02-19T21:49:08.331080+0000","last_active":"2024-02-19T21:52:15.315703+0000","last_peered":"2024-02-19T21:52:15.315703+0000","last_clean":"2024-02-19T21:52:15.315703+0000","last_became_active":"2024-02-19T21:49:08.330648+0000","last_became_peered":"2024-02-19T21:49:08.330648+0000","last_unstale":"2024-02-19T21:52:15.315703+0000","last_undegraded":"2024-02-19T21:52:15.315703+0000","last_fullsized":"2024-02-19T21:52:15.315703+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:55.803876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:44:55.803876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":443,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.340731+0000","last_change":"2024-02-19T21:48:31.320229+0000","last_active":"2024-02-19T21:52:17.340731+0000","last_peered":"2024-02-19T21:52:17.340731+0000","last_clean":"2024-02-19T21:52:17.340731+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:52:17.340731+0000","last_undegraded":"2024-02-19T21:52:17.340731+0000","last_fullsized":"2024-02-19T21:52:17.340731+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:31.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:45.017696+0000","last_clean_scrub_stamp":"2024-02-19T21:48:31.320133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"201'37","reported_seq":498,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.345932+0000","last_change":"2024-02-19T21:45:14.173212+0000","last_active":"2024-02-19T21:52:17.345932+0000","last_peered":"2024-02-19T21:52:17.345932+0000","last_clean":"2024-02-19T21:52:17.345932+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:52:17.345932+0000","last_undegraded":"2024-02-19T21:52:17.345932+0000","last_fullsized":"2024-02-19T21:52:17.345932+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'37","last_scrub_stamp":"2024-02-19T21:45:14.173134+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:45:14.173134+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":32,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":442,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.345222+0000","last_change":"2024-02-19T21:46:48.988928+0000","last_active":"2024-02-19T21:52:17.345222+0000","last_peered":"2024-02-19T21:52:17.345222+0000","last_clean":"2024-02-19T21:52:17.345222+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:52:17.345222+0000","last_undegraded":"2024-02-19T21:52:17.345222+0000","last_fullsized":"2024-02-19T21:52:17.345222+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:48.988836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.988836+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.e","version":"465'5743","reported_seq":7917,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:20.234508+0000","last_change":"2024-02-19T21:50:40.718822+0000","last_active":"2024-02-19T21:52:20.234508+0000","last_peered":"2024-02-19T21:52:20.234508+0000","last_clean":"2024-02-19T21:52:20.234508+0000","last_became_active":"2024-02-19T21:50:40.710425+0000","last_became_peered":"2024-02-19T21:50:40.710425+0000","last_unstale":"2024-02-19T21:52:20.234508+0000","last_undegraded":"2024-02-19T21:52:20.234508+0000","last_fullsized":"2024-02-19T21:52:20.234508+0000","mapping_epoch":430,"log_start":"392'700","ondisk_log_start":"392'700","created":385,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5043,"ondisk_log_size":5043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":222363648,"num_objects":3393,"num_object_clones":0,"num_object_copies":10179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3393,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5743,"num_write_kb":292352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1035,"num_bytes_recovered":67829760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":184,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.314180+0000","last_change":"2024-02-19T21:49:08.326461+0000","last_active":"2024-02-19T21:52:15.314180+0000","last_peered":"2024-02-19T21:52:15.314180+0000","last_clean":"2024-02-19T21:52:15.314180+0000","last_became_active":"2024-02-19T21:49:08.326106+0000","last_became_peered":"2024-02-19T21:49:08.326106+0000","last_unstale":"2024-02-19T21:52:15.314180+0000","last_undegraded":"2024-02-19T21:52:15.314180+0000","last_fullsized":"2024-02-19T21:52:15.314180+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.080896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.080896+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":444,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.315172+0000","last_change":"2024-02-19T21:48:11.879787+0000","last_active":"2024-02-19T21:52:15.315172+0000","last_peered":"2024-02-19T21:52:15.315172+0000","last_clean":"2024-02-19T21:52:15.315172+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:52:15.315172+0000","last_undegraded":"2024-02-19T21:52:15.315172+0000","last_fullsized":"2024-02-19T21:52:15.315172+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.879687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.879687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"201'38","reported_seq":80,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.339589+0000","last_change":"2024-02-19T21:49:55.861358+0000","last_active":"2024-02-19T21:52:17.339589+0000","last_peered":"2024-02-19T21:52:17.339589+0000","last_clean":"2024-02-19T21:52:17.339589+0000","last_became_active":"2024-02-19T21:49:54.480413+0000","last_became_peered":"2024-02-19T21:49:54.480413+0000","last_unstale":"2024-02-19T21:52:17.339589+0000","last_undegraded":"2024-02-19T21:52:17.339589+0000","last_fullsized":"2024-02-19T21:52:17.339589+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":415,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'38","last_scrub_stamp":"2024-02-19T21:49:05.923627+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.923627+0000","log_size":38,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":338,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.345639+0000","last_change":"2024-02-19T21:49:54.495134+0000","last_active":"2024-02-19T21:52:17.345639+0000","last_peered":"2024-02-19T21:52:17.345639+0000","last_clean":"2024-02-19T21:52:17.345639+0000","last_became_active":"2024-02-19T21:49:54.494802+0000","last_became_peered":"2024-02-19T21:49:54.494802+0000","last_unstale":"2024-02-19T21:52:17.345639+0000","last_undegraded":"2024-02-19T21:52:17.345639+0000","last_fullsized":"2024-02-19T21:52:17.345639+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:10.578408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:10.578408+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.f","version":"466'6304","reported_seq":8703,"reported_epoch":466,"state":"active+clean","last_fresh":"2024-02-19T21:52:25.070935+0000","last_change":"2024-02-19T21:51:05.409700+0000","last_active":"2024-02-19T21:52:25.070935+0000","last_peered":"2024-02-19T21:52:25.070935+0000","last_clean":"2024-02-19T21:52:25.070935+0000","last_became_active":"2024-02-19T21:51:05.398355+0000","last_became_peered":"2024-02-19T21:51:05.398355+0000","last_unstale":"2024-02-19T21:52:25.070935+0000","last_undegraded":"2024-02-19T21:52:25.070935+0000","last_fullsized":"2024-02-19T21:52:25.070935+0000","mapping_epoch":440,"log_start":"397'1400","ondisk_log_start":"397'1400","created":385,"last_epoch_clean":441,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4904,"ondisk_log_size":4904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":211943424,"num_objects":3234,"num_object_clones":0,"num_object_copies":9702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3234,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6304,"num_write_kb":305216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1147,"num_bytes_recovered":75169792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":472,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.340189+0000","last_change":"2024-02-19T21:49:08.328862+0000","last_active":"2024-02-19T21:52:17.340189+0000","last_peered":"2024-02-19T21:52:17.340189+0000","last_clean":"2024-02-19T21:52:17.340189+0000","last_became_active":"2024-02-19T21:49:08.328529+0000","last_became_peered":"2024-02-19T21:49:08.328529+0000","last_unstale":"2024-02-19T21:52:17.340189+0000","last_undegraded":"2024-02-19T21:52:17.340189+0000","last_fullsized":"2024-02-19T21:52:17.340189+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:49.110117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:49.110117+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":505,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.346606+0000","last_change":"2024-02-19T21:49:54.493367+0000","last_active":"2024-02-19T21:52:17.346606+0000","last_peered":"2024-02-19T21:52:17.346606+0000","last_clean":"2024-02-19T21:52:17.346606+0000","last_became_active":"2024-02-19T21:49:54.493041+0000","last_became_peered":"2024-02-19T21:49:54.493041+0000","last_unstale":"2024-02-19T21:52:17.346606+0000","last_undegraded":"2024-02-19T21:52:17.346606+0000","last_fullsized":"2024-02-19T21:52:17.346606+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.972369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.972369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"201'28","reported_seq":311,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.313804+0000","last_change":"2024-02-19T21:49:08.330818+0000","last_active":"2024-02-19T21:52:15.313804+0000","last_peered":"2024-02-19T21:52:15.313804+0000","last_clean":"2024-02-19T21:52:15.313804+0000","last_became_active":"2024-02-19T21:49:08.330477+0000","last_became_peered":"2024-02-19T21:49:08.330477+0000","last_unstale":"2024-02-19T21:52:15.313804+0000","last_undegraded":"2024-02-19T21:52:15.313804+0000","last_fullsized":"2024-02-19T21:52:15.313804+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'28","last_scrub_stamp":"2024-02-19T21:45:55.998646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.998646+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":40,"num_read_kb":33,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":539,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.098638+0000","last_change":"2024-02-19T21:45:50.742626+0000","last_active":"2024-02-19T21:52:17.098638+0000","last_peered":"2024-02-19T21:52:17.098638+0000","last_clean":"2024-02-19T21:52:17.098638+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:52:17.098638+0000","last_undegraded":"2024-02-19T21:52:17.098638+0000","last_fullsized":"2024-02-19T21:52:17.098638+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'9","last_scrub_stamp":"2024-02-19T21:45:50.742526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:50.742526+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"466'6012","reported_seq":6101,"reported_epoch":466,"state":"active+clean","last_fresh":"2024-02-19T21:52:25.118588+0000","last_change":"2024-02-19T21:48:47.779506+0000","last_active":"2024-02-19T21:52:25.118588+0000","last_peered":"2024-02-19T21:52:25.118588+0000","last_clean":"2024-02-19T21:52:25.118588+0000","last_became_active":"2024-02-19T21:48:47.778325+0000","last_became_peered":"2024-02-19T21:48:47.778325+0000","last_unstale":"2024-02-19T21:52:25.118588+0000","last_undegraded":"2024-02-19T21:52:25.118588+0000","last_fullsized":"2024-02-19T21:52:25.118588+0000","mapping_epoch":385,"log_start":"396'1100","ondisk_log_start":"396'1100","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4912,"ondisk_log_size":4912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":204996608,"num_objects":3128,"num_object_clones":0,"num_object_copies":9384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3128,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6012,"num_write_kb":292480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"66'1","reported_seq":356,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.345169+0000","last_change":"2024-02-19T21:48:12.568842+0000","last_active":"2024-02-19T21:52:17.345169+0000","last_peered":"2024-02-19T21:52:17.345169+0000","last_clean":"2024-02-19T21:52:17.345169+0000","last_became_active":"2024-02-19T21:44:56.166670+0000","last_became_peered":"2024-02-19T21:44:56.166670+0000","last_unstale":"2024-02-19T21:52:17.345169+0000","last_undegraded":"2024-02-19T21:52:17.345169+0000","last_fullsized":"2024-02-19T21:52:17.345169+0000","mapping_epoch":165,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:12.568734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.568734+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"261'11","reported_seq":550,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.098543+0000","last_change":"2024-02-19T21:45:01.716882+0000","last_active":"2024-02-19T21:52:17.098543+0000","last_peered":"2024-02-19T21:52:17.098543+0000","last_clean":"2024-02-19T21:52:17.098543+0000","last_became_active":"2024-02-19T21:44:08.123392+0000","last_became_peered":"2024-02-19T21:44:08.123392+0000","last_unstale":"2024-02-19T21:52:17.098543+0000","last_undegraded":"2024-02-19T21:52:17.098543+0000","last_fullsized":"2024-02-19T21:52:17.098543+0000","mapping_epoch":62,"log_start":"257'10","ondisk_log_start":"257'10","created":62,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-02-19T21:45:01.716817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.716817+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":454,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.339505+0000","last_change":"2024-02-19T21:48:19.186455+0000","last_active":"2024-02-19T21:52:17.339505+0000","last_peered":"2024-02-19T21:52:17.339505+0000","last_clean":"2024-02-19T21:52:17.339505+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:52:17.339505+0000","last_undegraded":"2024-02-19T21:52:17.339505+0000","last_fullsized":"2024-02-19T21:52:17.339505+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:48:19.186359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:19.186359+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"201'19","reported_seq":311,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.314487+0000","last_change":"2024-02-19T21:48:34.485865+0000","last_active":"2024-02-19T21:52:15.314487+0000","last_peered":"2024-02-19T21:52:15.314487+0000","last_clean":"2024-02-19T21:52:15.314487+0000","last_became_active":"2024-02-19T21:47:46.251550+0000","last_became_peered":"2024-02-19T21:47:46.251550+0000","last_unstale":"2024-02-19T21:52:15.314487+0000","last_undegraded":"2024-02-19T21:52:15.314487+0000","last_fullsized":"2024-02-19T21:52:15.314487+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:34.485787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:34.485787+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":23,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7],"acting":[4,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1","version":"465'5886","reported_seq":5974,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:20.227973+0000","last_change":"2024-02-19T21:48:47.772467+0000","last_active":"2024-02-19T21:52:20.227973+0000","last_peered":"2024-02-19T21:52:20.227973+0000","last_clean":"2024-02-19T21:52:20.227973+0000","last_became_active":"2024-02-19T21:48:47.772154+0000","last_became_peered":"2024-02-19T21:48:47.772154+0000","last_unstale":"2024-02-19T21:52:20.227973+0000","last_undegraded":"2024-02-19T21:52:20.227973+0000","last_fullsized":"2024-02-19T21:52:20.227973+0000","mapping_epoch":385,"log_start":"392'800","ondisk_log_start":"392'800","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5086,"ondisk_log_size":5086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":224657408,"num_objects":3428,"num_object_clones":0,"num_object_copies":10284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3428,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5886,"num_write_kb":298048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":460,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.320613+0000","last_change":"2024-02-19T21:46:01.031458+0000","last_active":"2024-02-19T21:52:15.320613+0000","last_peered":"2024-02-19T21:52:15.320613+0000","last_clean":"2024-02-19T21:52:15.320613+0000","last_became_active":"2024-02-19T21:44:56.155194+0000","last_became_peered":"2024-02-19T21:44:56.155194+0000","last_unstale":"2024-02-19T21:52:15.320613+0000","last_undegraded":"2024-02-19T21:52:15.320613+0000","last_fullsized":"2024-02-19T21:52:15.320613+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.031344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.031344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"363'12","reported_seq":262,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.098524+0000","last_change":"2024-02-19T21:48:25.487689+0000","last_active":"2024-02-19T21:52:17.098524+0000","last_peered":"2024-02-19T21:52:17.098524+0000","last_clean":"2024-02-19T21:52:17.098524+0000","last_became_active":"2024-02-19T21:47:46.260099+0000","last_became_peered":"2024-02-19T21:47:46.260099+0000","last_unstale":"2024-02-19T21:52:17.098524+0000","last_undegraded":"2024-02-19T21:52:17.098524+0000","last_fullsized":"2024-02-19T21:52:17.098524+0000","mapping_epoch":362,"log_start":"98'9","ondisk_log_start":"98'9","created":62,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"363'12","last_scrub_stamp":"2024-02-19T21:48:25.487608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.487608+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":464,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.315614+0000","last_change":"2024-02-19T21:49:08.335163+0000","last_active":"2024-02-19T21:52:15.315614+0000","last_peered":"2024-02-19T21:52:15.315614+0000","last_clean":"2024-02-19T21:52:15.315614+0000","last_became_active":"2024-02-19T21:49:08.334842+0000","last_became_peered":"2024-02-19T21:49:08.334842+0000","last_unstale":"2024-02-19T21:52:15.315614+0000","last_undegraded":"2024-02-19T21:52:15.315614+0000","last_fullsized":"2024-02-19T21:52:15.315614+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.700887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.700887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"270'34","reported_seq":384,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.320665+0000","last_change":"2024-02-19T21:47:34.894164+0000","last_active":"2024-02-19T21:52:15.320665+0000","last_peered":"2024-02-19T21:52:15.320665+0000","last_clean":"2024-02-19T21:52:15.320665+0000","last_became_active":"2024-02-19T21:47:33.400012+0000","last_became_peered":"2024-02-19T21:47:33.400012+0000","last_unstale":"2024-02-19T21:52:15.320665+0000","last_undegraded":"2024-02-19T21:52:15.320665+0000","last_fullsized":"2024-02-19T21:52:15.320665+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":357,"parent":"0.0","parent_split_bits":0,"last_scrub":"270'34","last_scrub_stamp":"2024-02-19T21:46:44.789309+0000","last_deep_scrub":"270'34","last_deep_scrub_stamp":"2024-02-19T21:44:17.451151+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.789309+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2","version":"465'5981","reported_seq":6068,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:20.194012+0000","last_change":"2024-02-19T21:48:47.771305+0000","last_active":"2024-02-19T21:52:20.194012+0000","last_peered":"2024-02-19T21:52:20.194012+0000","last_clean":"2024-02-19T21:52:20.194012+0000","last_became_active":"2024-02-19T21:48:47.771000+0000","last_became_peered":"2024-02-19T21:48:47.771000+0000","last_unstale":"2024-02-19T21:52:20.194012+0000","last_undegraded":"2024-02-19T21:52:20.194012+0000","last_fullsized":"2024-02-19T21:52:20.194012+0000","mapping_epoch":385,"log_start":"392'800","ondisk_log_start":"392'800","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5181,"ondisk_log_size":5181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":225902592,"num_objects":3447,"num_object_clones":0,"num_object_copies":10341,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3447,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5981,"num_write_kb":301696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":442,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.314756+0000","last_change":"2024-02-19T21:49:08.329023+0000","last_active":"2024-02-19T21:52:15.314756+0000","last_peered":"2024-02-19T21:52:15.314756+0000","last_clean":"2024-02-19T21:52:15.314756+0000","last_became_active":"2024-02-19T21:49:08.328697+0000","last_became_peered":"2024-02-19T21:49:08.328697+0000","last_unstale":"2024-02-19T21:52:15.314756+0000","last_undegraded":"2024-02-19T21:52:15.314756+0000","last_fullsized":"2024-02-19T21:52:15.314756+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.939414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.939414+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"397'17","reported_seq":393,"reported_epoch":466,"state":"active+clean","last_fresh":"2024-02-19T21:52:20.325730+0000","last_change":"2024-02-19T21:49:08.325927+0000","last_active":"2024-02-19T21:52:20.325730+0000","last_peered":"2024-02-19T21:52:20.325730+0000","last_clean":"2024-02-19T21:52:20.325730+0000","last_became_active":"2024-02-19T21:49:08.325034+0000","last_became_peered":"2024-02-19T21:49:08.325034+0000","last_unstale":"2024-02-19T21:52:20.325730+0000","last_undegraded":"2024-02-19T21:52:20.325730+0000","last_fullsized":"2024-02-19T21:52:20.325730+0000","mapping_epoch":394,"log_start":"170'11","ondisk_log_start":"170'11","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"271'13","last_scrub_stamp":"2024-02-19T21:46:47.072988+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.072988+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":454,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.315369+0000","last_change":"2024-02-19T21:49:03.987847+0000","last_active":"2024-02-19T21:52:15.315369+0000","last_peered":"2024-02-19T21:52:15.315369+0000","last_clean":"2024-02-19T21:52:15.315369+0000","last_became_active":"2024-02-19T21:47:33.395485+0000","last_became_peered":"2024-02-19T21:47:33.395485+0000","last_unstale":"2024-02-19T21:52:15.315369+0000","last_undegraded":"2024-02-19T21:52:15.315369+0000","last_fullsized":"2024-02-19T21:52:15.315369+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:03.987749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:49:03.987749+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,5],"acting":[1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"200'20","reported_seq":288,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.314072+0000","last_change":"2024-02-19T21:48:12.628796+0000","last_active":"2024-02-19T21:52:15.314072+0000","last_peered":"2024-02-19T21:52:15.314072+0000","last_clean":"2024-02-19T21:52:15.314072+0000","last_became_active":"2024-02-19T21:47:46.251725+0000","last_became_peered":"2024-02-19T21:47:46.251725+0000","last_unstale":"2024-02-19T21:52:15.314072+0000","last_undegraded":"2024-02-19T21:52:15.314072+0000","last_fullsized":"2024-02-19T21:52:15.314072+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'20","last_scrub_stamp":"2024-02-19T21:48:12.628700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.628700+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3","version":"466'5992","reported_seq":8285,"reported_epoch":466,"state":"active+clean","last_fresh":"2024-02-19T21:52:22.173850+0000","last_change":"2024-02-19T21:50:50.296220+0000","last_active":"2024-02-19T21:52:22.173850+0000","last_peered":"2024-02-19T21:52:22.173850+0000","last_clean":"2024-02-19T21:52:22.173850+0000","last_became_active":"2024-02-19T21:50:50.289607+0000","last_became_peered":"2024-02-19T21:50:50.289607+0000","last_unstale":"2024-02-19T21:52:22.173850+0000","last_undegraded":"2024-02-19T21:52:22.173850+0000","last_fullsized":"2024-02-19T21:52:22.173850+0000","mapping_epoch":433,"log_start":"392'600","ondisk_log_start":"392'600","created":385,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5392,"ondisk_log_size":5392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220725248,"num_objects":3368,"num_object_clones":0,"num_object_copies":10104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3368,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5992,"num_write_kb":299520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1097,"num_bytes_recovered":71892992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":94,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.347953+0000","last_change":"2024-02-19T21:49:08.327495+0000","last_active":"2024-02-19T21:52:17.347953+0000","last_peered":"2024-02-19T21:52:17.347953+0000","last_clean":"2024-02-19T21:52:17.347953+0000","last_became_active":"2024-02-19T21:49:08.327172+0000","last_became_peered":"2024-02-19T21:49:08.327172+0000","last_unstale":"2024-02-19T21:52:17.347953+0000","last_undegraded":"2024-02-19T21:52:17.347953+0000","last_fullsized":"2024-02-19T21:52:17.347953+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.241319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.241319+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,6],"acting":[2,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":449,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.315676+0000","last_change":"2024-02-19T21:45:01.798485+0000","last_active":"2024-02-19T21:52:15.315676+0000","last_peered":"2024-02-19T21:52:15.315676+0000","last_clean":"2024-02-19T21:52:15.315676+0000","last_became_active":"2024-02-19T21:44:22.245925+0000","last_became_peered":"2024-02-19T21:44:22.245925+0000","last_unstale":"2024-02-19T21:52:15.315676+0000","last_undegraded":"2024-02-19T21:52:15.315676+0000","last_fullsized":"2024-02-19T21:52:15.315676+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:01.798387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.798387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":450,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.340064+0000","last_change":"2024-02-19T21:48:30.277397+0000","last_active":"2024-02-19T21:52:17.340064+0000","last_peered":"2024-02-19T21:52:17.340064+0000","last_clean":"2024-02-19T21:52:17.340064+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:52:17.340064+0000","last_undegraded":"2024-02-19T21:52:17.340064+0000","last_fullsized":"2024-02-19T21:52:17.340064+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.277322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.277322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"337'39","reported_seq":397,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.314693+0000","last_change":"2024-02-19T21:49:08.326007+0000","last_active":"2024-02-19T21:52:15.314693+0000","last_peered":"2024-02-19T21:52:15.314693+0000","last_clean":"2024-02-19T21:52:15.314693+0000","last_became_active":"2024-02-19T21:49:08.325683+0000","last_became_peered":"2024-02-19T21:49:08.325683+0000","last_unstale":"2024-02-19T21:52:15.314693+0000","last_undegraded":"2024-02-19T21:52:15.314693+0000","last_fullsized":"2024-02-19T21:52:15.314693+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'39","last_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_deep_scrub":"337'39","last_deep_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.923809+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":49,"num_read_kb":39,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"466'6300","reported_seq":6389,"reported_epoch":466,"state":"active+clean","last_fresh":"2024-02-19T21:52:24.817926+0000","last_change":"2024-02-19T21:48:47.776672+0000","last_active":"2024-02-19T21:52:24.817926+0000","last_peered":"2024-02-19T21:52:24.817926+0000","last_clean":"2024-02-19T21:52:24.817926+0000","last_became_active":"2024-02-19T21:48:47.776368+0000","last_became_peered":"2024-02-19T21:48:47.776368+0000","last_unstale":"2024-02-19T21:52:24.817926+0000","last_undegraded":"2024-02-19T21:52:24.817926+0000","last_fullsized":"2024-02-19T21:52:24.817926+0000","mapping_epoch":385,"log_start":"396'1200","ondisk_log_start":"396'1200","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5100,"ondisk_log_size":5100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":212860928,"num_objects":3248,"num_object_clones":0,"num_object_copies":9744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3248,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6300,"num_write_kb":305536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"66'1","reported_seq":288,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.339189+0000","last_change":"2024-02-19T21:50:57.303343+0000","last_active":"2024-02-19T21:52:17.339189+0000","last_peered":"2024-02-19T21:52:17.339189+0000","last_clean":"2024-02-19T21:52:17.339189+0000","last_became_active":"2024-02-19T21:50:57.302957+0000","last_became_peered":"2024-02-19T21:50:57.302957+0000","last_unstale":"2024-02-19T21:52:17.339189+0000","last_undegraded":"2024-02-19T21:52:17.339189+0000","last_fullsized":"2024-02-19T21:52:17.339189+0000","mapping_epoch":437,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":438,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:46:43.773486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:46:43.773486+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":94,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.348537+0000","last_change":"2024-02-19T21:49:08.326583+0000","last_active":"2024-02-19T21:52:17.348537+0000","last_peered":"2024-02-19T21:52:17.348537+0000","last_clean":"2024-02-19T21:52:17.348537+0000","last_became_active":"2024-02-19T21:49:08.324835+0000","last_became_peered":"2024-02-19T21:49:08.324835+0000","last_unstale":"2024-02-19T21:52:17.348537+0000","last_undegraded":"2024-02-19T21:52:17.348537+0000","last_fullsized":"2024-02-19T21:52:17.348537+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.163825+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":150,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.344819+0000","last_change":"2024-02-19T21:49:08.327553+0000","last_active":"2024-02-19T21:52:17.344819+0000","last_peered":"2024-02-19T21:52:17.344819+0000","last_clean":"2024-02-19T21:52:17.344819+0000","last_became_active":"2024-02-19T21:49:08.327186+0000","last_became_peered":"2024-02-19T21:49:08.327186+0000","last_unstale":"2024-02-19T21:52:17.344819+0000","last_undegraded":"2024-02-19T21:52:17.344819+0000","last_fullsized":"2024-02-19T21:52:17.344819+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:45:00.748244+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:45:00.748244+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"201'44","reported_seq":571,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.345058+0000","last_change":"2024-02-19T21:49:55.281324+0000","last_active":"2024-02-19T21:52:17.345058+0000","last_peered":"2024-02-19T21:52:17.345058+0000","last_clean":"2024-02-19T21:52:17.345058+0000","last_became_active":"2024-02-19T21:49:54.493167+0000","last_became_peered":"2024-02-19T21:49:54.493167+0000","last_unstale":"2024-02-19T21:52:17.345058+0000","last_undegraded":"2024-02-19T21:52:17.345058+0000","last_fullsized":"2024-02-19T21:52:17.345058+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'44","last_scrub_stamp":"2024-02-19T21:48:32.489084+0000","last_deep_scrub":"201'44","last_deep_scrub_stamp":"2024-02-19T21:44:16.255049+0000","last_clean_scrub_stamp":"2024-02-19T21:48:32.489084+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.5","version":"466'6116","reported_seq":10117,"reported_epoch":466,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:52:22.204972+0000","last_change":"2024-02-19T21:52:17.602505+0000","last_active":"2024-02-19T21:52:22.204972+0000","last_peered":"2024-02-19T21:52:22.204972+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:50:03.654321+0000","last_became_peered":"2024-02-19T21:50:03.654321+0000","last_unstale":"2024-02-19T21:52:22.204972+0000","last_undegraded":"2024-02-19T21:52:17.600617+0000","last_fullsized":"2024-02-19T21:49:55.473278+0000","mapping_epoch":414,"log_start":"392'700","ondisk_log_start":"392'700","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5416,"ondisk_log_size":5416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":216662016,"num_objects":3306,"num_object_clones":0,"num_object_copies":9918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":47,"num_objects_misplaced":2700,"num_objects_unfound":0,"num_objects_dirty":3306,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6116,"num_write_kb":301504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1374,"num_bytes_recovered":90046464,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0],"avail_no_missing":["2","0","5"],"object_location_counts":[{"shards":"0,2","objects":559},{"shards":"0,2,5","objects":2700}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":495,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.345815+0000","last_change":"2024-02-19T21:49:08.328667+0000","last_active":"2024-02-19T21:52:17.345815+0000","last_peered":"2024-02-19T21:52:17.345815+0000","last_clean":"2024-02-19T21:52:17.345815+0000","last_became_active":"2024-02-19T21:49:08.328287+0000","last_became_peered":"2024-02-19T21:49:08.328287+0000","last_unstale":"2024-02-19T21:52:17.345815+0000","last_undegraded":"2024-02-19T21:52:17.345815+0000","last_fullsized":"2024-02-19T21:52:17.345815+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.176542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.176542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":94,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.349804+0000","last_change":"2024-02-19T21:49:08.332637+0000","last_active":"2024-02-19T21:52:17.349804+0000","last_peered":"2024-02-19T21:52:17.349804+0000","last_clean":"2024-02-19T21:52:17.349804+0000","last_became_active":"2024-02-19T21:49:08.331451+0000","last_became_peered":"2024-02-19T21:49:08.331451+0000","last_unstale":"2024-02-19T21:52:17.349804+0000","last_undegraded":"2024-02-19T21:52:17.349804+0000","last_fullsized":"2024-02-19T21:52:17.349804+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.123413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.547129+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.123413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":464,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.316168+0000","last_change":"2024-02-19T21:49:08.331159+0000","last_active":"2024-02-19T21:52:15.316168+0000","last_peered":"2024-02-19T21:52:15.316168+0000","last_clean":"2024-02-19T21:52:15.316168+0000","last_became_active":"2024-02-19T21:49:08.330804+0000","last_became_peered":"2024-02-19T21:49:08.330804+0000","last_unstale":"2024-02-19T21:52:15.316168+0000","last_undegraded":"2024-02-19T21:52:15.316168+0000","last_fullsized":"2024-02-19T21:52:15.316168+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.978015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.978015+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"377'19","reported_seq":473,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.346034+0000","last_change":"2024-02-19T21:48:23.326608+0000","last_active":"2024-02-19T21:52:17.346034+0000","last_peered":"2024-02-19T21:52:17.346034+0000","last_clean":"2024-02-19T21:52:17.346034+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:52:17.346034+0000","last_undegraded":"2024-02-19T21:52:17.346034+0000","last_fullsized":"2024-02-19T21:52:17.346034+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"377'19","last_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_deep_scrub":"377'19","last_deep_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.326541+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":20,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"465'5991","reported_seq":6078,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:20.333703+0000","last_change":"2024-02-19T21:48:47.780368+0000","last_active":"2024-02-19T21:52:20.333703+0000","last_peered":"2024-02-19T21:52:20.333703+0000","last_clean":"2024-02-19T21:52:20.333703+0000","last_became_active":"2024-02-19T21:48:47.780046+0000","last_became_peered":"2024-02-19T21:48:47.780046+0000","last_unstale":"2024-02-19T21:52:20.333703+0000","last_undegraded":"2024-02-19T21:52:20.333703+0000","last_fullsized":"2024-02-19T21:52:20.333703+0000","mapping_epoch":385,"log_start":"392'800","ondisk_log_start":"392'800","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5191,"ondisk_log_size":5191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":223936512,"num_objects":3417,"num_object_clones":0,"num_object_copies":10251,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3417,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5991,"num_write_kb":301056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":458,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.319775+0000","last_change":"2024-02-19T21:46:01.981923+0000","last_active":"2024-02-19T21:52:15.319775+0000","last_peered":"2024-02-19T21:52:15.319775+0000","last_clean":"2024-02-19T21:52:15.319775+0000","last_became_active":"2024-02-19T21:44:56.160521+0000","last_became_peered":"2024-02-19T21:44:56.160521+0000","last_unstale":"2024-02-19T21:52:15.319775+0000","last_undegraded":"2024-02-19T21:52:15.319775+0000","last_fullsized":"2024-02-19T21:52:15.319775+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.981866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.981866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":103,"reported_epoch":465,"state":"active+clean","last_fresh":"2024-02-19T21:52:17.349323+0000","last_change":"2024-02-19T21:49:54.485377+0000","last_active":"2024-02-19T21:52:17.349323+0000","last_peered":"2024-02-19T21:52:17.349323+0000","last_clean":"2024-02-19T21:52:17.349323+0000","last_became_active":"2024-02-19T21:49:54.485078+0000","last_became_peered":"2024-02-19T21:49:54.485078+0000","last_unstale":"2024-02-19T21:52:17.349323+0000","last_undegraded":"2024-02-19T21:52:17.349323+0000","last_fullsized":"2024-02-19T21:52:17.349323+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:52.107416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:46:52.107416+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"200'27","reported_seq":535,"reported_epoch":464,"state":"active+clean","last_fresh":"2024-02-19T21:52:15.319481+0000","last_change":"2024-02-19T21:49:55.109780+0000","last_active":"2024-02-19T21:52:15.319481+0000","last_peered":"2024-02-19T21:52:15.319481+0000","last_clean":"2024-02-19T21:52:15.319481+0000","last_became_active":"2024-02-19T21:49:54.486014+0000","last_became_peered":"2024-02-19T21:49:54.486014+0000","last_unstale":"2024-02-19T21:52:15.319481+0000","last_undegraded":"2024-02-19T21:52:15.319481+0000","last_fullsized":"2024-02-19T21:52:15.319481+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'27","last_scrub_stamp":"2024-02-19T21:48:24.665813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:24.665813+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"324'11","reported_seq":712,"reported_epoch":466,"state":"active+clean","last_fresh":"2024-02-19T21:52:20.354546+0000","last_change":"2024-02-19T21:48:26.293036+0000","last_active":"2024-02-19T21:52:20.354546+0000","last_peered":"2024-02-19T21:52:20.354546+0000","last_clean":"2024-02-19T21:52:20.354546+0000","last_became_active":"2024-02-19T21:44:34.385140+0000","last_became_peered":"2024-02-19T21:44:34.385140+0000","last_unstale":"2024-02-19T21:52:20.354546+0000","last_undegraded":"2024-02-19T21:52:20.354546+0000","last_fullsized":"2024-02-19T21:52:20.354546+0000","mapping_epoch":62,"log_start":"66'8","ondisk_log_start":"66'8","created":62,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'11","last_scrub_stamp":"2024-02-19T21:48:26.292909+0000","last_deep_scrub":"324'11","last_deep_scrub_stamp":"2024-02-19T21:46:05.210095+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.292909+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":3436576792,"num_objects":52439,"num_object_clones":0,"num_object_copies":157317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":137,"num_objects_misplaced":5437,"num_objects_unfound":0,"num_objects_dirty":52439,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":97057,"num_write_kb":4783809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12021,"num_bytes_recovered":766771200,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10722881536,"data_stored":10722869320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80957,"ondisk_log_size":80957,"up":48,"acting":45,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1176,"num_read_kb":1171,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1107,"num_read_kb":864,"num_write":703,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":277,"num_bytes_recovered":5172,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":776,"ondisk_log_size":776,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":22,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":66,"acting":66,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":382,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201523,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1280584,"kb_used_data":694976,"kb_used_omap":0,"kb_used_meta":585600,"kb_avail":92464568,"statfs":{"total":95995035648,"available":94683717632,"internally_reserved":0,"allocated":711655424,"data_stored":710274138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":599654400},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":1.49,"15min":1.839},"min":{"1min":0.23100000000000001,"5min":0.19400000000000001,"15min":0.189},"max":{"1min":0.57899999999999996,"5min":22.07,"15min":70.477999999999994},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":1.548,"15min":2.0049999999999999},"min":{"1min":0.26800000000000002,"5min":0.21199999999999999,"15min":0.20999999999999999},"max":{"1min":1.1140000000000001,"5min":22.457000000000001,"15min":68.052000000000007},"last":0.84299999999999997}]},{"osd":1,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":1.4319999999999999,"15min":2.048},"min":{"1min":0.27000000000000002,"5min":0.247,"15min":0.23200000000000001},"max":{"1min":0.434,"5min":22.117999999999999,"15min":68.168000000000006},"last":4.883},{"interface":"front","average":{"1min":0.624,"5min":1.796,"15min":2.1099999999999999},"min":{"1min":0.27300000000000002,"5min":0.26300000000000001,"15min":0.223},"max":{"1min":3.3319999999999999,"5min":22.236000000000001,"15min":68.444000000000003},"last":0.90100000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:52:16 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":1.6519999999999999,"15min":2.1499999999999999},"min":{"1min":0.29099999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1970000000000001,"5min":12.304,"15min":12.304},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":1.506,"15min":1.8779999999999999},"min":{"1min":0.375,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":6.2779999999999996,"5min":11.69,"15min":11.69},"last":0.51700000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":1.595,"15min":2.1200000000000001},"min":{"1min":0.36799999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":3.0680000000000001,"5min":11.778,"15min":31.559000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.434,"5min":1.2490000000000001,"15min":1.8620000000000001},"min":{"1min":0.34100000000000003,"5min":0.30299999999999999,"15min":0.29299999999999998},"max":{"1min":0.68300000000000005,"5min":13.473000000000001,"15min":30.812999999999999},"last":4.9080000000000004}]},{"osd":4,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":1.417,"15min":1.546},"min":{"1min":0.30399999999999999,"5min":0.245,"15min":0.216},"max":{"1min":1.173,"5min":17.716999999999999,"15min":17.716999999999999},"last":2.6259999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":1.7729999999999999,"15min":1.871},"min":{"1min":0.31900000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.67100000000000004,"5min":15.666,"15min":17.690999999999999},"last":0.42299999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":1.6200000000000001,"15min":1.6220000000000001},"min":{"1min":0.29599999999999999,"5min":0.28499999999999998,"15min":0.24199999999999999},"max":{"1min":1.6679999999999999,"5min":29.021000000000001,"15min":29.021000000000001},"last":4.8390000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":1.756,"15min":1.887},"min":{"1min":0.33900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.3700000000000001,"5min":29.091999999999999,"15min":29.091999999999999},"last":1.4219999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":1.9219999999999999,"15min":1.694},"min":{"1min":0.39500000000000002,"5min":0.31,"15min":0.24299999999999999},"max":{"1min":1.3919999999999999,"5min":19.286000000000001,"15min":19.286000000000001},"last":0.873},{"interface":"front","average":{"1min":0.52000000000000002,"5min":1.8200000000000001,"15min":1.8560000000000001},"min":{"1min":0.38700000000000001,"5min":0.309,"15min":0.26700000000000002},"max":{"1min":0.70599999999999996,"5min":18.364000000000001,"15min":18.364000000000001},"last":0.46400000000000002}]}]},{"osd":6,"up_from":47,"seq":201863463162,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2046792,"kb_used_data":1448832,"kb_used_omap":0,"kb_used_meta":597888,"kb_avail":91698360,"statfs":{"total":95995035648,"available":93899120640,"internally_reserved":0,"allocated":1483603968,"data_stored":1482221996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":612237312},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":1.004,"15min":1.653},"min":{"1min":0.25700000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":5.7069999999999999,"5min":8.8079999999999998,"15min":45.197000000000003},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.5920000000000001,"15min":2.0070000000000001},"min":{"1min":0.252,"5min":0.23499999999999999,"15min":0.221},"max":{"1min":6.1120000000000001,"5min":6.9699999999999998,"15min":44.753},"last":3.4180000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":1.276,"15min":1.6779999999999999},"min":{"1min":0.24299999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":3.3980000000000001,"5min":8.8469999999999995,"15min":45.231999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":1.3480000000000001,"15min":1.6910000000000001},"min":{"1min":0.33200000000000002,"5min":0.245,"15min":0.23100000000000001},"max":{"1min":2.0179999999999998,"5min":7.3570000000000002,"15min":45.097999999999999},"last":2.8370000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:52:12 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":1.2230000000000001,"15min":1.4550000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.70199999999999996,"5min":6.1820000000000004,"15min":6.1820000000000004},"last":3.4430000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.97299999999999998,"15min":1.1699999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.502,"5min":7.8959999999999999,"15min":7.8959999999999999},"last":0.66500000000000004}]},{"osd":3,"last update":"Mon Feb 19 21:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":1.2490000000000001,"15min":1.6080000000000001},"min":{"1min":0.34000000000000002,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":3.02,"5min":8.9009999999999998,"15min":11.15},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.53700000000000003,"5min":1.49,"15min":1.625},"min":{"1min":0.36599999999999999,"5min":0.30599999999999999,"15min":0.246},"max":{"1min":1.9770000000000001,"5min":7.3970000000000002,"15min":19.632999999999999},"last":2.8730000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":2.0590000000000002,"15min":1.7749999999999999},"min":{"1min":0.308,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":6.1539999999999999,"5min":18.010000000000002,"15min":18.010000000000002},"last":3.3599999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":1.5529999999999999,"15min":1.716},"min":{"1min":0.28399999999999997,"5min":0.26300000000000001,"15min":0.23499999999999999},"max":{"1min":2.2919999999999998,"5min":11.566000000000001,"15min":16.594999999999999},"last":0.70499999999999996}]},{"osd":5,"last update":"Mon Feb 19 21:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":1.9610000000000001,"15min":1.7909999999999999},"min":{"1min":0.315,"5min":0.27400000000000002,"15min":0.27100000000000002},"max":{"1min":6.2060000000000004,"5min":14.695,"15min":14.695},"last":6.2409999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":1.883,"15min":1.919},"min":{"1min":0.41599999999999998,"5min":0.28799999999999998,"15min":0.27900000000000003},"max":{"1min":2.4990000000000001,"5min":11.609999999999999,"15min":15.497999999999999},"last":5.7050000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:51:52 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":1.548,"15min":1.8089999999999999},"min":{"1min":0.32100000000000001,"5min":0.27200000000000002,"15min":0.26700000000000002},"max":{"1min":1.768,"5min":9.1929999999999996,"15min":14.721},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":1.5900000000000001,"15min":1.8580000000000001},"min":{"1min":0.39700000000000002,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":1.7989999999999999,"5min":9.2240000000000002,"15min":14.744999999999999},"last":0.747}]}]},{"osd":1,"up_from":13,"seq":55834575123,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1793868,"kb_used_data":889156,"kb_used_omap":0,"kb_used_meta":904704,"kb_avail":91951284,"statfs":{"total":95995035648,"available":94158114816,"internally_reserved":0,"allocated":910495744,"data_stored":909102318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":926416896},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:51:19 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.95499999999999996,"15min":1.502},"min":{"1min":0.20499999999999999,"5min":0.16300000000000001,"15min":0.161},"max":{"1min":0.77600000000000002,"5min":6.2789999999999999,"15min":42.776000000000003},"last":0.249},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.94499999999999995,"15min":1.5429999999999999},"min":{"1min":0.23300000000000001,"5min":0.193,"15min":0.16400000000000001},"max":{"1min":2.1680000000000001,"5min":6.2000000000000002,"15min":44.845999999999997},"last":2.7789999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:52:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.81799999999999995,"15min":0.99399999999999999},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":2.524,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.80900000000000005,"15min":0.94399999999999995},"min":{"1min":0.23899999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":2.823,"5min":4.452,"15min":4.452},"last":0.45500000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:51:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.83999999999999997,"15min":1.6000000000000001},"min":{"1min":0.24399999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":2.2050000000000001,"5min":4.6639999999999997,"15min":41.607999999999997},"last":4.3529999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.91900000000000004,"15min":1.5249999999999999},"min":{"1min":0.28599999999999998,"5min":0.215,"15min":0.215},"max":{"1min":1.0129999999999999,"5min":4.5190000000000001,"15min":42.811999999999998},"last":0.35599999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:51:38 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":1.397,"15min":1.524},"min":{"1min":0.31900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.60899999999999999,"5min":15.853,"15min":15.853},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":1.2729999999999999,"15min":1.544},"min":{"1min":0.28100000000000003,"5min":0.28000000000000003,"15min":0.26500000000000001},"max":{"1min":1.7829999999999999,"5min":15.861000000000001,"15min":15.861000000000001},"last":0.496}]},{"osd":5,"last update":"Mon Feb 19 21:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":1.0189999999999999,"15min":1.5589999999999999},"min":{"1min":0.307,"5min":0.29599999999999999,"15min":0.27900000000000003},"max":{"1min":2.8759999999999999,"5min":7.3339999999999996,"15min":14.331},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":1.1160000000000001,"15min":1.5580000000000001},"min":{"1min":0.313,"5min":0.307,"15min":0.30099999999999999},"max":{"1min":2.0110000000000001,"5min":14.426,"15min":14.496},"last":2.613}]},{"osd":6,"last update":"Mon Feb 19 21:51:38 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":1.343,"15min":1.6419999999999999},"min":{"1min":0.33200000000000002,"5min":0.32300000000000001,"15min":0.30099999999999999},"max":{"1min":0.64000000000000001,"5min":10.456,"15min":11.638999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":1.282,"15min":1.762},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.29699999999999999},"max":{"1min":0.77200000000000002,"5min":9.8049999999999997,"15min":12.199},"last":2.7330000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:51:57 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":1.2529999999999999,"15min":1.7509999999999999},"min":{"1min":0.35499999999999998,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":2.153,"5min":7.702,"15min":13.904},"last":2.7000000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":1.323,"15min":1.694},"min":{"1min":0.42799999999999999,"5min":0.35499999999999998,"15min":0.32600000000000001},"max":{"1min":2.4470000000000001,"5min":7.6909999999999998,"15min":13.894},"last":0.65900000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738650,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2969860,"kb_used_data":2063164,"kb_used_omap":0,"kb_used_meta":906688,"kb_avail":90775292,"statfs":{"total":95995035648,"available":92953899008,"internally_reserved":0,"allocated":2112679936,"data_stored":2111301999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":928448512},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:52:12 2024","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.63600000000000001,"15min":1.026},"min":{"1min":0.191,"5min":0.189,"15min":0.153},"max":{"1min":0.53500000000000003,"5min":6.1550000000000002,"15min":16.478000000000002},"last":2.1280000000000001},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.80300000000000005,"15min":1.2270000000000001},"min":{"1min":0.222,"5min":0.20100000000000001,"15min":0.17799999999999999},"max":{"1min":1.04,"5min":6.9359999999999999,"15min":13.422000000000001},"last":0.36299999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:52:12 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.56100000000000005,"15min":0.628},"min":{"1min":0.223,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.95699999999999996,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":2.169},{"interface":"front","average":{"1min":0.378,"5min":0.86399999999999999,"15min":1.0760000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.79200000000000004,"5min":8.9960000000000004,"15min":8.9960000000000004},"last":2.3740000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:52:01 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.89700000000000002,"15min":1.5289999999999999},"min":{"1min":0.28000000000000003,"5min":0.217,"15min":0.21299999999999999},"max":{"1min":1.4159999999999999,"5min":12.691000000000001,"15min":14.507999999999999},"last":2.4569999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.80100000000000005,"15min":1.371},"min":{"1min":0.26300000000000001,"5min":0.24099999999999999,"15min":0.23400000000000001},"max":{"1min":1.3089999999999999,"5min":6.6150000000000002,"15min":18.759},"last":2.6299999999999999}]},{"osd":4,"last update":"Mon Feb 19 21:51:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":1.3859999999999999,"15min":1.6579999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.252},"max":{"1min":1.179,"5min":10.311,"15min":13.278},"last":2.9449999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":1.3009999999999999,"15min":1.5149999999999999},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1850000000000001,"5min":10.109,"15min":10.109},"last":2.952}]},{"osd":5,"last update":"Mon Feb 19 21:52:01 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":1.708,"15min":1.984},"min":{"1min":0.318,"5min":0.317,"15min":0.27600000000000002},"max":{"1min":1.014,"5min":25.442,"15min":42.799999999999997},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":1.696,"15min":2.0270000000000001},"min":{"1min":0.35799999999999998,"5min":0.33200000000000002,"15min":0.27300000000000002},"max":{"1min":0.65800000000000003,"5min":25.411999999999999,"15min":42.695},"last":2.5259999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:52:16 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":1.3700000000000001,"15min":1.6459999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.27000000000000002},"max":{"1min":1.4390000000000001,"5min":10.278,"15min":42.777000000000001},"last":2.4780000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":1.4890000000000001,"15min":1.845},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.28599999999999998},"max":{"1min":1.6539999999999999,"5min":11.84,"15min":13.289999999999999},"last":6.1459999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:51:52 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":1.3149999999999999,"15min":1.778},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.31},"max":{"1min":3.198,"5min":15.688000000000001,"15min":42.758000000000003},"last":2.4199999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":1.3009999999999999,"15min":1.6739999999999999},"min":{"1min":0.40300000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":3.21,"5min":9.6389999999999993,"15min":42.718000000000004},"last":2.3069999999999999}]}]},{"osd":2,"up_from":394,"seq":1692217114663,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1837040,"kb_used_data":1513000,"kb_used_omap":0,"kb_used_meta":324031,"kb_avail":91908112,"statfs":{"total":95995035648,"available":94113906688,"internally_reserved":0,"allocated":1549312000,"data_stored":1547954245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":331807796},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.91100000000000003,"15min":1.081},"min":{"1min":0.20300000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":3.1779999999999999,"5min":9.1530000000000005,"15min":9.1530000000000005},"last":0.183},{"interface":"front","average":{"1min":0.29299999999999998,"5min":0.873,"15min":1.1060000000000001},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.435,"5min":6.149,"15min":6.149},"last":0.19700000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55100000000000005,"15min":0.59799999999999998},"min":{"1min":0.20999999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":3.073,"5min":3.073,"15min":3.073},"last":0.20899999999999999},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.78500000000000003,"15min":0.90700000000000003},"min":{"1min":0.249,"5min":0.224,"15min":0.224},"max":{"1min":1.1439999999999999,"5min":6.992,"15min":6.992},"last":0.32300000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":1.115,"15min":1.3380000000000001},"min":{"1min":0.30599999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.117,"5min":6.9470000000000001,"15min":6.9470000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.96499999999999997,"15min":1.1830000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.48299999999999998,"5min":6.6500000000000004,"15min":6.6500000000000004},"last":0.36199999999999999}]},{"osd":4,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":1.54,"15min":1.952},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.7729999999999999,"5min":7.0339999999999998,"15min":7.0339999999999998},"last":2.1309999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":1.4399999999999999,"15min":1.784},"min":{"1min":0.38400000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.1699999999999999,"5min":7.0419999999999998,"15min":7.0419999999999998},"last":8.1720000000000006}]},{"osd":5,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":1.48,"15min":1.6859999999999999},"min":{"1min":0.36899999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":3.4300000000000002,"5min":10.067,"15min":10.067},"last":3.2650000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":1.3160000000000001,"15min":1.6519999999999999},"min":{"1min":0.33200000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.5,"5min":13.558,"15min":13.558},"last":3.3330000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":1.3080000000000001,"15min":1.6040000000000001},"min":{"1min":0.34200000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.1819999999999999,"5min":5.6829999999999998,"15min":5.6829999999999998},"last":3.0870000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.88300000000000001,"15min":0.98899999999999999},"min":{"1min":0.36699999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.024,"5min":7,"15min":7},"last":2.7050000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":1.177,"15min":1.361},"min":{"1min":0.39900000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67000000000000004,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":1.8220000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.72699999999999998,"15min":0.80500000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.802,"5min":2.782,"15min":2.782},"last":6.0010000000000003}]}]},{"osd":3,"up_from":0,"seq":111669149962,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":32,"seq":137438953730,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3079916,"kb_used_data":2481700,"kb_used_omap":0,"kb_used_meta":597888,"kb_avail":90665236,"statfs":{"total":95995035648,"available":92841201664,"internally_reserved":0,"allocated":2541260800,"data_stored":2539898229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":612237312},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:51:33 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":1.8839999999999999,"15min":1.8939999999999999},"min":{"1min":0.221,"5min":0.219,"15min":0.219},"max":{"1min":2.1869999999999998,"5min":53.936,"15min":53.936},"last":1.403},{"interface":"front","average":{"1min":0.84299999999999997,"5min":2.0939999999999999,"15min":2.0720000000000001},"min":{"1min":0.252,"5min":0.23599999999999999,"15min":0.22600000000000001},"max":{"1min":2.6640000000000001,"5min":54.405999999999999,"15min":54.405999999999999},"last":0.98999999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:51:33 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":1.9790000000000001,"15min":1.7529999999999999},"min":{"1min":0.253,"5min":0.22,"15min":0.21199999999999999},"max":{"1min":2.2130000000000001,"5min":54.731000000000002,"15min":54.731000000000002},"last":1.3640000000000001},{"interface":"front","average":{"1min":0.83699999999999997,"5min":1.9330000000000001,"15min":1.6779999999999999},"min":{"1min":0.28299999999999997,"5min":0.252,"15min":0.25},"max":{"1min":2.903,"5min":52.490000000000002,"15min":52.490000000000002},"last":1.1759999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":1.444,"15min":1.8660000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.2070000000000001,"5min":9.0619999999999994,"15min":9.0619999999999994},"last":1.431},{"interface":"front","average":{"1min":0.496,"5min":1.4830000000000001,"15min":1.903},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.2370000000000001,"5min":9.0899999999999999,"15min":9.0899999999999999},"last":1.452}]},{"osd":3,"last update":"Mon Feb 19 21:51:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":1.462,"15min":1.6899999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.464,"5min":6.5579999999999998,"15min":15.914999999999999},"last":4.9320000000000004},{"interface":"front","average":{"1min":0.56399999999999995,"5min":1.4610000000000001,"15min":1.6819999999999999},"min":{"1min":0.30099999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":2.242,"5min":9.4000000000000004,"15min":13.321},"last":1.4750000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:51:25 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.9359999999999999,"15min":1.764},"min":{"1min":0.28199999999999997,"5min":0.23799999999999999,"15min":0.23400000000000001},"max":{"1min":3.02,"5min":16.731999999999999,"15min":18.916},"last":7.6680000000000001},{"interface":"front","average":{"1min":0.83699999999999997,"5min":1.9359999999999999,"15min":1.96},"min":{"1min":0.29599999999999999,"5min":0.26700000000000002,"15min":0.253},"max":{"1min":2.4239999999999999,"5min":8.2959999999999994,"15min":14.840999999999999},"last":14.532999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:51:33 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.7709999999999999,"15min":1.6459999999999999},"min":{"1min":0.33000000000000002,"5min":0.28999999999999998,"15min":0.28599999999999998},"max":{"1min":2.9289999999999998,"5min":9.1720000000000006,"15min":13.27},"last":4.968},{"interface":"front","average":{"1min":0.92500000000000004,"5min":2.101,"15min":1.8480000000000001},"min":{"1min":0.31900000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":2.9390000000000001,"5min":18.670000000000002,"15min":18.670000000000002},"last":1.204}]},{"osd":7,"last update":"Mon Feb 19 21:52:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":1.7350000000000001,"15min":1.7849999999999999},"min":{"1min":0.36399999999999999,"5min":0.311,"15min":0.30399999999999999},"max":{"1min":2.8679999999999999,"5min":16.763999999999999,"15min":16.763999999999999},"last":5.8689999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":1.403,"15min":1.6970000000000001},"min":{"1min":0.36299999999999999,"5min":0.32400000000000001,"15min":0.31},"max":{"1min":2.5310000000000001,"5min":10.044,"15min":12.808999999999999},"last":5.8129999999999997}]}]},{"osd":5,"up_from":38,"seq":163208757502,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2408288,"kb_used_data":1517848,"kb_used_omap":0,"kb_used_meta":890432,"kb_avail":91336864,"statfs":{"total":95995035648,"available":93528948736,"internally_reserved":0,"allocated":1554276352,"data_stored":1552926168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":911802368},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":1.306,"15min":1.728},"min":{"1min":0.24199999999999999,"5min":0.23100000000000001,"15min":0.20599999999999999},"max":{"1min":2.96,"5min":19.236000000000001,"15min":20.550999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":1.204,"15min":1.853},"min":{"1min":0.24099999999999999,"5min":0.23699999999999999,"15min":0.20899999999999999},"max":{"1min":0.52800000000000002,"5min":10.887,"15min":20.879000000000001},"last":0.376}]},{"osd":1,"last update":"Mon Feb 19 21:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":1.1890000000000001,"15min":1.663},"min":{"1min":0.246,"5min":0.246,"15min":0.23100000000000001},"max":{"1min":0.51500000000000001,"5min":8.2010000000000005,"15min":10.42},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":1.05,"15min":1.5449999999999999},"min":{"1min":0.29099999999999998,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":2.794,"5min":10.315,"15min":10.965},"last":1.4730000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":1.131,"15min":1.3080000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":3.9470000000000001,"5min":7.0380000000000003,"15min":7.0380000000000003},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":1.0940000000000001,"15min":1.24},"min":{"1min":0.309,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.9119999999999999,"5min":4.2619999999999996,"15min":4.2619999999999996},"last":0.433}]},{"osd":3,"last update":"Mon Feb 19 21:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":1.4319999999999999,"15min":1.998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.24099999999999999},"max":{"1min":2.9039999999999999,"5min":19.321000000000002,"15min":20.146999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":1.24,"15min":2.0680000000000001},"min":{"1min":0.35899999999999999,"5min":0.33600000000000002,"15min":0.29499999999999998},"max":{"1min":2.883,"5min":8.0359999999999996,"15min":20.120000000000001},"last":0.45600000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.95299999999999996,"15min":1.4059999999999999},"min":{"1min":0.26200000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":2.7280000000000002,"5min":7.6710000000000003,"15min":21.577000000000002},"last":1.4950000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":1.6040000000000001,"15min":1.879},"min":{"1min":0.317,"5min":0.26100000000000001,"15min":0.25600000000000001},"max":{"1min":0.872,"5min":19.274000000000001,"15min":19.274000000000001},"last":0.57199999999999995}]},{"osd":6,"last update":"Mon Feb 19 21:51:33 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":2.0529999999999999,"15min":1.9259999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.221},"max":{"1min":5.8819999999999997,"5min":19.884,"15min":19.884},"last":1.623},{"interface":"front","average":{"1min":0.66800000000000004,"5min":1.6799999999999999,"15min":1.8660000000000001},"min":{"1min":0.30199999999999999,"5min":0.26700000000000002,"15min":0.23599999999999999},"max":{"1min":2.1099999999999999,"5min":10.260999999999999,"15min":13.532999999999999},"last":1.7070000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":1.7110000000000001,"15min":2.0150000000000001},"min":{"1min":0.34200000000000003,"5min":0.33500000000000002,"15min":0.27100000000000002},"max":{"1min":1.976,"5min":12.611000000000001,"15min":12.962},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":1.611,"15min":1.843},"min":{"1min":0.38100000000000001,"5min":0.221,"15min":0.221},"max":{"1min":2.0099999999999998,"5min":15.593999999999999,"15min":17.759},"last":1.514}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2090274816,"data_stored":2090270744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":900399104,"data_stored":900399104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1525547008,"data_stored":1525547008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2504134656,"data_stored":2504130584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1537736704,"data_stored":1537736704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1467420672,"data_stored":1467416600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":697368576,"data_stored":697368576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:52:29.392 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph status --format=json 2024-02-19T21:52:29.502 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:52:29.507 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:29.508 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:52:29.609 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:52:29.681 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:29.691 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:52:30.110 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-02-19T21:52:30.345 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:29.952484+0000 mon.b (mon.1) 71 : audit [INF] from='client.? 172.21.15.80:0/1449671344' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:52:30.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:29.953021+0000 mon.a (mon.0) 1804 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:52:30.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:29.952484+0000 mon.b (mon.1) 71 : audit [INF] from='client.? 172.21.15.80:0/1449671344' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:52:30.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:29.953021+0000 mon.a (mon.0) 1804 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:52:30.655 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:29.952484+0000 mon.b (mon.1) 71 : audit [INF] from='client.? 172.21.15.80:0/1449671344' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:52:30.655 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:29.953021+0000 mon.a (mon.0) 1804 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:52:30.757 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:52:30.764 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:30.764 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:52:30.865 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:52:30.952 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:31.086 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:52:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:52:30] "GET /metrics HTTP/1.1" 200 176571 "" "Prometheus/2.33.4" 2024-02-19T21:52:31.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:29.207449+0000 mgr.y (mgr.14514) 761 : cluster [DBG] pgmap v989: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.1 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 558 op/s; 365/152445 objects degraded (0.239%); 4906/152445 objects misplaced (3.218%); 4.2 MiB/s, 74 objects/s recovering 2024-02-19T21:52:31.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:30.059361+0000 mon.a (mon.0) 1805 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:52:31.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:30.080216+0000 mon.a (mon.0) 1806 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:52:31.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:30.080259+0000 mon.a (mon.0) 1807 : cluster [DBG] osdmap e469: 8 total, 8 up, 7 in 2024-02-19T21:52:31.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:30.315533+0000 mon.a (mon.0) 1808 : cluster [WRN] Health check update: Degraded data redundancy: 365/152445 objects degraded (0.239%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:31.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:30.323327+0000 mon.a (mon.0) 1809 : cluster [DBG] osdmap e470: 8 total, 8 up, 7 in 2024-02-19T21:52:31.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:29.207449+0000 mgr.y (mgr.14514) 761 : cluster [DBG] pgmap v989: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.1 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 558 op/s; 365/152445 objects degraded (0.239%); 4906/152445 objects misplaced (3.218%); 4.2 MiB/s, 74 objects/s recovering 2024-02-19T21:52:31.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:30.059361+0000 mon.a (mon.0) 1805 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:52:31.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:30.080216+0000 mon.a (mon.0) 1806 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:52:31.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:30.080259+0000 mon.a (mon.0) 1807 : cluster [DBG] osdmap e469: 8 total, 8 up, 7 in 2024-02-19T21:52:31.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:30.315533+0000 mon.a (mon.0) 1808 : cluster [WRN] Health check update: Degraded data redundancy: 365/152445 objects degraded (0.239%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:31.350 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:30.323327+0000 mon.a (mon.0) 1809 : cluster [DBG] osdmap e470: 8 total, 8 up, 7 in 2024-02-19T21:52:31.575 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:29.207449+0000 mgr.y (mgr.14514) 761 : cluster [DBG] pgmap v989: 138 pgs: 135 active+clean, 3 active+recovering+undersized+degraded+remapped; 3.1 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 558 op/s; 365/152445 objects degraded (0.239%); 4906/152445 objects misplaced (3.218%); 4.2 MiB/s, 74 objects/s recovering 2024-02-19T21:52:31.575 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:30.059361+0000 mon.a (mon.0) 1805 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:52:31.575 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:30.080216+0000 mon.a (mon.0) 1806 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:52:31.575 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:30.080259+0000 mon.a (mon.0) 1807 : cluster [DBG] osdmap e469: 8 total, 8 up, 7 in 2024-02-19T21:52:31.575 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:30.315533+0000 mon.a (mon.0) 1808 : cluster [WRN] Health check update: Degraded data redundancy: 365/152445 objects degraded (0.239%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:31.575 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:30.323327+0000 mon.a (mon.0) 1809 : cluster [DBG] osdmap e470: 8 total, 8 up, 7 in 2024-02-19T21:52:31.576 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:52:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:52:31.772 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:52:31.779 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:52:31.787 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:31.788 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:52:31.889 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:52:31.941 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:32.025 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:52:32.029 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:32.030 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:52:32.131 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:52:32.225 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:32.259 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:52:32.263 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:32.264 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:52:32.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:31.086002+0000 mgr.y (mgr.14514) 762 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:52:32.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:31.207897+0000 mgr.y (mgr.14514) 763 : cluster [DBG] pgmap v992: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.9 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 879 op/s; 484/143037 objects degraded (0.338%); 4714/143037 objects misplaced (3.296%); 4.6 MiB/s, 76 objects/s recovering 2024-02-19T21:52:32.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:31.086002+0000 mgr.y (mgr.14514) 762 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:52:32.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:31.207897+0000 mgr.y (mgr.14514) 763 : cluster [DBG] pgmap v992: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.9 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 879 op/s; 484/143037 objects degraded (0.338%); 4714/143037 objects misplaced (3.296%); 4.6 MiB/s, 76 objects/s recovering 2024-02-19T21:52:32.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:31.086002+0000 mgr.y (mgr.14514) 762 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:52:32.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:31.207897+0000 mgr.y (mgr.14514) 763 : cluster [DBG] pgmap v992: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.9 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 879 op/s; 484/143037 objects degraded (0.338%); 4714/143037 objects misplaced (3.296%); 4.6 MiB/s, 76 objects/s recovering 2024-02-19T21:52:32.364 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:52:32.434 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:32.555 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:52:32.562 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:32.562 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:52:32.627 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:52:32.627 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:52:32.663 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:52:32.744 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:33.346 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.6 dump_historic_ops 2024-02-19T21:52:33.983 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:52:34.974 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:33.208382+0000 mgr.y (mgr.14514) 764 : cluster [DBG] pgmap v993: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.9 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 2.8 KiB/s rd, 0 B/s wr, 694 op/s; 484/141549 objects degraded (0.342%); 4370/141549 objects misplaced (3.087%); 6.7 MiB/s, 110 objects/s recovering 2024-02-19T21:52:34.974 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:33.400492+0000 osd.4 (osd.4) 211 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:52:34.974 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:33.400533+0000 osd.4 (osd.4) 212 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:52:34.974 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:33.971486+0000 mon.a (mon.0) 1810 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:52:34.974 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:34.276954+0000 mon.a (mon.0) 1811 : cluster [DBG] osdmap e471: 8 total, 8 up, 7 in 2024-02-19T21:52:34.974 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:33.208382+0000 mgr.y (mgr.14514) 764 : cluster [DBG] pgmap v993: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.9 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 2.8 KiB/s rd, 0 B/s wr, 694 op/s; 484/141549 objects degraded (0.342%); 4370/141549 objects misplaced (3.087%); 6.7 MiB/s, 110 objects/s recovering 2024-02-19T21:52:34.974 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:33.400492+0000 osd.4 (osd.4) 211 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:52:34.974 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:33.400533+0000 osd.4 (osd.4) 212 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:52:34.974 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:33.971486+0000 mon.a (mon.0) 1810 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:52:34.975 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:34.276954+0000 mon.a (mon.0) 1811 : cluster [DBG] osdmap e471: 8 total, 8 up, 7 in 2024-02-19T21:52:35.236 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:52:35.242 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:35.243 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:52:35.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:33.208382+0000 mgr.y (mgr.14514) 764 : cluster [DBG] pgmap v993: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.9 GiB data, 14 GiB used, 612 GiB / 626 GiB avail; 2.8 KiB/s rd, 0 B/s wr, 694 op/s; 484/141549 objects degraded (0.342%); 4370/141549 objects misplaced (3.087%); 6.7 MiB/s, 110 objects/s recovering 2024-02-19T21:52:35.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:33.400492+0000 osd.4 (osd.4) 211 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:52:35.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:33.400533+0000 osd.4 (osd.4) 212 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:52:35.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:33.971486+0000 mon.a (mon.0) 1810 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:52:35.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:34.276954+0000 mon.a (mon.0) 1811 : cluster [DBG] osdmap e471: 8 total, 8 up, 7 in 2024-02-19T21:52:35.343 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:52:35.396 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:35.419 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:52:35.451 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:52:35.483 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:52:35.516 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:52:35.541 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:52:35.565 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:52:35.606 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:52:35.638 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:52:35.639 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:52:35.639 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:52:35.639 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:52:35.639 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:52:35.639 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:52:35.639 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:52:35.640 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:52:35.640 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:52:35.668 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:52:35.671 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:35.672 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:52:35.703 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-19T21:52:35.773 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:52:35.831 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:36.007 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:52:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:52:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:52:36.007 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:35.316898+0000 mon.a (mon.0) 1812 : cluster [WRN] Health check update: Degraded data redundancy: 484/141549 objects degraded (0.342%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:36.007 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:35.322456+0000 mon.a (mon.0) 1813 : cluster [DBG] osdmap e472: 8 total, 8 up, 7 in 2024-02-19T21:52:36.007 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:35.383589+0000 mon.c (mon.2) 114 : audit [DBG] from='client.? 172.21.15.80:0/2613744166' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:52:36.345 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:35.316898+0000 mon.a (mon.0) 1812 : cluster [WRN] Health check update: Degraded data redundancy: 484/141549 objects degraded (0.342%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:36.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:35.322456+0000 mon.a (mon.0) 1813 : cluster [DBG] osdmap e472: 8 total, 8 up, 7 in 2024-02-19T21:52:36.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:35.383589+0000 mon.c (mon.2) 114 : audit [DBG] from='client.? 172.21.15.80:0/2613744166' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:52:36.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:35.316898+0000 mon.a (mon.0) 1812 : cluster [WRN] Health check update: Degraded data redundancy: 484/141549 objects degraded (0.342%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:36.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:35.322456+0000 mon.a (mon.0) 1813 : cluster [DBG] osdmap e472: 8 total, 8 up, 7 in 2024-02-19T21:52:36.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:35.383589+0000 mon.c (mon.2) 114 : audit [DBG] from='client.? 172.21.15.80:0/2613744166' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:52:37.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:35.212621+0000 mgr.y (mgr.14514) 765 : cluster [DBG] pgmap v995: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.7 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 29 KiB/s rd, 0 B/s wr, 1.08k op/s; 484/133857 objects degraded (0.362%); 4370/133857 objects misplaced (3.265%); 4.2 MiB/s, 69 objects/s recovering 2024-02-19T21:52:37.345 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:35.212621+0000 mgr.y (mgr.14514) 765 : cluster [DBG] pgmap v995: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.7 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 29 KiB/s rd, 0 B/s wr, 1.08k op/s; 484/133857 objects degraded (0.362%); 4370/133857 objects misplaced (3.265%); 4.2 MiB/s, 69 objects/s recovering 2024-02-19T21:52:37.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:35.212621+0000 mgr.y (mgr.14514) 765 : cluster [DBG] pgmap v995: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.7 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 29 KiB/s rd, 0 B/s wr, 1.08k op/s; 484/133857 objects degraded (0.362%); 4370/133857 objects misplaced (3.265%); 4.2 MiB/s, 69 objects/s recovering 2024-02-19T21:52:37.640 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:52:37.643 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:37.643 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:52:37.744 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:52:37.831 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:52:37.831 INFO:teuthology.orchestra.run.smithi157.stdout: "size": 20, 2024-02-19T21:52:37.831 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 600, 2024-02-19T21:52:37.831 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [ 2024-02-19T21:52:37.832 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.832 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:216516 9.1 9:8020748e:::benchmark_data_smithi080_126364_object87924:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e355)", 2024-02-19T21:52:37.832 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:47:32.391603+0000", 2024-02-19T21:52:37.832 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 305.43468688299998, 2024-02-19T21:52:37.832 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1874880449999998, 2024-02-19T21:52:37.832 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:52:37.832 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "reached pg", 2024-02-19T21:52:37.832 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:52:37.832 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:52:37.832 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:52:37.832 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 216516 2024-02-19T21:52:37.832 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.832 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:52:37.832 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.832 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:52:37.833 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391603+0000", 2024-02-19T21:52:37.833 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:52:37.833 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.833 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.833 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:52:37.833 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391603+0000", 2024-02-19T21:52:37.833 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:52:37.833 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.833 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.833 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:52:37.833 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391601+0000", 2024-02-19T21:52:37.833 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.0040000000000002e-06 2024-02-19T21:52:37.833 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.833 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.833 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:52:37.834 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391608+0000", 2024-02-19T21:52:37.834 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1270000000000001e-05 2024-02-19T21:52:37.834 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.834 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.834 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:52:37.834 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391619+0000", 2024-02-19T21:52:37.834 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.8329999999999996e-06 2024-02-19T21:52:37.834 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.834 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.834 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:52:37.834 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391626+0000", 2024-02-19T21:52:37.835 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.8105e-05 2024-02-19T21:52:37.835 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.835 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.835 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.835 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391684+0000", 2024-02-19T21:52:37.835 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.4050000000000003e-06 2024-02-19T21:52:37.835 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.835 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.835 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:52:37.835 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391692+0000", 2024-02-19T21:52:37.835 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99364586099999996 2024-02-19T21:52:37.835 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.835 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.835 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.835 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:33.385338+0000", 2024-02-19T21:52:37.836 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1124999999999999e-05 2024-02-19T21:52:37.836 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.836 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.836 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:52:37.836 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:33.385349+0000", 2024-02-19T21:52:37.836 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1912486499999999 2024-02-19T21:52:37.836 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.836 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.836 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.836 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.576597+0000", 2024-02-19T21:52:37.836 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0024935019999999999 2024-02-19T21:52:37.836 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.836 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.836 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:52:37.836 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.579091+0000", 2024-02-19T21:52:37.836 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1874880449999998 2024-02-19T21:52:37.837 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.837 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:52:37.837 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.837 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.837 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.837 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:216521 9.1 9:801b7e92:::benchmark_data_smithi080_126364_object87929:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e355)", 2024-02-19T21:52:37.837 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:47:32.391640+0000", 2024-02-19T21:52:37.837 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 305.43464996500001, 2024-02-19T21:52:37.837 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1875704169999999, 2024-02-19T21:52:37.837 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:52:37.837 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "reached pg", 2024-02-19T21:52:37.837 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:52:37.837 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:52:37.837 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:52:37.837 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 216521 2024-02-19T21:52:37.838 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.838 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:52:37.838 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.838 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:52:37.838 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391640+0000", 2024-02-19T21:52:37.838 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:52:37.838 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.838 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.838 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:52:37.838 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391640+0000", 2024-02-19T21:52:37.838 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:52:37.838 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.838 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.838 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:52:37.838 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391639+0000", 2024-02-19T21:52:37.839 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.0000000000000001e-06 2024-02-19T21:52:37.839 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.839 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.839 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:52:37.839 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391642+0000", 2024-02-19T21:52:37.839 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.3990000000000001e-06 2024-02-19T21:52:37.839 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.839 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.839 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:52:37.839 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391649+0000", 2024-02-19T21:52:37.839 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.9090000000000002e-06 2024-02-19T21:52:37.839 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.839 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.839 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:52:37.839 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391653+0000", 2024-02-19T21:52:37.840 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.6987e-05 2024-02-19T21:52:37.840 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.840 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.840 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.840 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391730+0000", 2024-02-19T21:52:37.840 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.3090000000000001e-06 2024-02-19T21:52:37.840 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.840 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.840 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:52:37.840 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391739+0000", 2024-02-19T21:52:37.840 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99363444899999998 2024-02-19T21:52:37.840 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.840 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.841 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.841 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:33.385373+0000", 2024-02-19T21:52:37.841 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.3329999999999999e-06 2024-02-19T21:52:37.841 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.841 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.841 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:52:37.841 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:33.385381+0000", 2024-02-19T21:52:37.841 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1937523780000001 2024-02-19T21:52:37.841 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.841 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.841 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.841 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.579133+0000", 2024-02-19T21:52:37.841 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.7134999999999999e-05 2024-02-19T21:52:37.841 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.841 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.842 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:52:37.842 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.579210+0000", 2024-02-19T21:52:37.842 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1875704169999999 2024-02-19T21:52:37.842 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.842 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:52:37.842 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.842 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.842 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.842 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:216535 9.1 9:86425105:::benchmark_data_smithi080_126364_object87943:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e355)", 2024-02-19T21:52:37.842 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:47:32.391658+0000", 2024-02-19T21:52:37.842 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 305.43463194899999, 2024-02-19T21:52:37.842 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.2627521640000001, 2024-02-19T21:52:37.842 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:52:37.842 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:52:37.843 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:52:37.843 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:52:37.843 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:52:37.843 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 216535 2024-02-19T21:52:37.843 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.843 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:52:37.843 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.843 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:52:37.843 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391658+0000", 2024-02-19T21:52:37.843 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:52:37.843 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.843 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.843 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:52:37.843 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391658+0000", 2024-02-19T21:52:37.844 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:52:37.844 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.844 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.844 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:52:37.844 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391657+0000", 2024-02-19T21:52:37.844 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.4600000000000002e-06 2024-02-19T21:52:37.844 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.844 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.844 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:52:37.844 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391660+0000", 2024-02-19T21:52:37.844 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.587e-06 2024-02-19T21:52:37.844 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.844 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.844 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:52:37.845 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391665+0000", 2024-02-19T21:52:37.845 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.895e-06 2024-02-19T21:52:37.845 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.845 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.845 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:52:37.845 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391669+0000", 2024-02-19T21:52:37.845 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.4252000000000006e-05 2024-02-19T21:52:37.845 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.845 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.845 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.845 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391754+0000", 2024-02-19T21:52:37.845 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0199999999999996e-06 2024-02-19T21:52:37.845 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.845 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.846 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:52:37.846 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391758+0000", 2024-02-19T21:52:37.846 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99364607000000005 2024-02-19T21:52:37.846 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.846 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.846 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.846 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:33.385404+0000", 2024-02-19T21:52:37.846 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.0169999999999999e-06 2024-02-19T21:52:37.846 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.846 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.846 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:52:37.846 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:33.385411+0000", 2024-02-19T21:52:37.846 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1938248819999999 2024-02-19T21:52:37.846 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.847 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.847 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.847 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.579236+0000", 2024-02-19T21:52:37.847 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00097764399999999995 2024-02-19T21:52:37.847 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.847 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.847 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:52:37.847 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.580213+0000", 2024-02-19T21:52:37.847 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00048398400000000002 2024-02-19T21:52:37.847 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.847 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.847 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 2,3,4", 2024-02-19T21:52:37.847 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.580697+0000", 2024-02-19T21:52:37.847 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.067799909000000005 2024-02-19T21:52:37.848 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.848 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.848 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:52:37.848 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.648497+0000", 2024-02-19T21:52:37.848 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0057387979999999998 2024-02-19T21:52:37.848 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.848 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.848 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.848 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654236+0000", 2024-02-19T21:52:37.848 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.0315000000000001e-05 2024-02-19T21:52:37.848 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.848 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.848 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.849 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654256+0000", 2024-02-19T21:52:37.849 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.8612e-05 2024-02-19T21:52:37.849 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.849 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.849 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.849 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654285+0000", 2024-02-19T21:52:37.849 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.9422999999999998e-05 2024-02-19T21:52:37.849 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.849 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.849 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:52:37.849 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654334+0000", 2024-02-19T21:52:37.849 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.5714e-05 2024-02-19T21:52:37.849 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.849 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.849 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:52:37.850 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654410+0000", 2024-02-19T21:52:37.850 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.2627521640000001 2024-02-19T21:52:37.850 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.850 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:52:37.850 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.850 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.850 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.850 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:216537 9.1 9:8be6914d:::benchmark_data_smithi080_126364_object87945:head [delete] snapc 0=[] ondisk+write+known_if_redirected e355)", 2024-02-19T21:52:37.850 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:47:32.391974+0000", 2024-02-19T21:52:37.850 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 305.43431600000002, 2024-02-19T21:52:37.850 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.26270266, 2024-02-19T21:52:37.850 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:52:37.850 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:52:37.850 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:52:37.850 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:52:37.851 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:52:37.851 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 216537 2024-02-19T21:52:37.851 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.851 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:52:37.851 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.851 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:52:37.851 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391974+0000", 2024-02-19T21:52:37.851 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:52:37.851 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.851 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.851 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:52:37.851 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391974+0000", 2024-02-19T21:52:37.851 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:52:37.851 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.851 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.852 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:52:37.852 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391973+0000", 2024-02-19T21:52:37.852 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.7809999999999999e-06 2024-02-19T21:52:37.852 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.852 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.852 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:52:37.852 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391977+0000", 2024-02-19T21:52:37.852 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.7260000000000002e-06 2024-02-19T21:52:37.852 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.852 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.852 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:52:37.852 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391985+0000", 2024-02-19T21:52:37.852 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.6129999999999997e-06 2024-02-19T21:52:37.852 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.852 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.853 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:52:37.853 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391989+0000", 2024-02-19T21:52:37.853 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1888000000000001e-05 2024-02-19T21:52:37.853 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.853 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.853 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.853 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.392011+0000", 2024-02-19T21:52:37.853 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.5810000000000001e-06 2024-02-19T21:52:37.853 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.853 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.853 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:52:37.853 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.392015+0000", 2024-02-19T21:52:37.853 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99341806200000005 2024-02-19T21:52:37.853 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.854 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.854 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.854 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:33.385433+0000", 2024-02-19T21:52:37.854 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.097e-06 2024-02-19T21:52:37.854 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.854 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.854 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:52:37.854 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:33.385440+0000", 2024-02-19T21:52:37.854 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.252371409 2024-02-19T21:52:37.854 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.854 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.854 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.854 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.637811+0000", 2024-02-19T21:52:37.854 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.6497999999999998e-05 2024-02-19T21:52:37.854 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.855 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.855 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:52:37.855 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.637898+0000", 2024-02-19T21:52:37.855 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014574100000000001 2024-02-19T21:52:37.855 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.855 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.855 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 2,3,4", 2024-02-19T21:52:37.855 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.638044+0000", 2024-02-19T21:52:37.855 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.010460565 2024-02-19T21:52:37.855 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.855 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.855 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:52:37.855 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.648504+0000", 2024-02-19T21:52:37.855 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0059303819999999997 2024-02-19T21:52:37.855 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.855 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.855 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.856 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654435+0000", 2024-02-19T21:52:37.856 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.9066e-05 2024-02-19T21:52:37.856 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.856 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.856 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.856 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654454+0000", 2024-02-19T21:52:37.856 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000106135 2024-02-19T21:52:37.856 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.856 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.856 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.856 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654560+0000", 2024-02-19T21:52:37.856 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.9955999999999999e-05 2024-02-19T21:52:37.856 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.856 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.856 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:52:37.857 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654590+0000", 2024-02-19T21:52:37.857 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.6743000000000006e-05 2024-02-19T21:52:37.857 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.857 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.857 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:52:37.857 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654676+0000", 2024-02-19T21:52:37.857 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.26270266 2024-02-19T21:52:37.857 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.857 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:52:37.857 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.857 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.857 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.857 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:216572 9.1 9:839b6075:::benchmark_data_smithi080_126364_object87980:head [delete] snapc 0=[] ondisk+write+known_if_redirected e355)", 2024-02-19T21:52:37.857 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:47:32.446303+0000", 2024-02-19T21:52:37.857 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 305.37998674699998, 2024-02-19T21:52:37.857 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.2085847759999999, 2024-02-19T21:52:37.858 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:52:37.858 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:52:37.858 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:52:37.858 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:52:37.858 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:52:37.858 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 216572 2024-02-19T21:52:37.858 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.858 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:52:37.858 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.858 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:52:37.858 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.446303+0000", 2024-02-19T21:52:37.858 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:52:37.858 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.858 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.858 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:52:37.858 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.446303+0000", 2024-02-19T21:52:37.859 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:52:37.859 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.859 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.859 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:52:37.859 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.446301+0000", 2024-02-19T21:52:37.859 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.5910000000000002e-06 2024-02-19T21:52:37.859 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.859 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.859 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:52:37.859 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.446311+0000", 2024-02-19T21:52:37.859 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.7887999999999999e-05 2024-02-19T21:52:37.859 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.859 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.860 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:52:37.860 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.446329+0000", 2024-02-19T21:52:37.860 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.1659999999999994e-06 2024-02-19T21:52:37.860 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.860 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.860 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:52:37.860 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.446337+0000", 2024-02-19T21:52:37.860 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.6020999999999998e-05 2024-02-19T21:52:37.860 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.860 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.860 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.860 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.446393+0000", 2024-02-19T21:52:37.860 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.401e-06 2024-02-19T21:52:37.861 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.861 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.861 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:52:37.861 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.446400+0000", 2024-02-19T21:52:37.861 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.93906151400000004 2024-02-19T21:52:37.861 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.861 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.861 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.861 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:33.385462+0000", 2024-02-19T21:52:37.861 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.131e-06 2024-02-19T21:52:37.861 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.861 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.861 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:52:37.861 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:33.385469+0000", 2024-02-19T21:52:37.861 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2550593160000001 2024-02-19T21:52:37.861 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.862 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.862 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.862 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.640528+0000", 2024-02-19T21:52:37.862 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000111433 2024-02-19T21:52:37.862 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.862 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.862 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:52:37.862 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.640640+0000", 2024-02-19T21:52:37.862 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000146148 2024-02-19T21:52:37.862 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.862 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.862 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 2,3,4", 2024-02-19T21:52:37.862 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.640786+0000", 2024-02-19T21:52:37.862 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0077245250000000003 2024-02-19T21:52:37.863 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.863 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.863 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:52:37.863 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.648510+0000", 2024-02-19T21:52:37.863 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0059610280000000002 2024-02-19T21:52:37.863 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.863 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.863 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.863 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654471+0000", 2024-02-19T21:52:37.863 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.7240000000000001e-05 2024-02-19T21:52:37.863 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.863 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.863 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.863 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654489+0000", 2024-02-19T21:52:37.863 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00030847300000000003 2024-02-19T21:52:37.863 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.864 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.864 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.864 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654797+0000", 2024-02-19T21:52:37.864 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.8161999999999999e-05 2024-02-19T21:52:37.864 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.864 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.864 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:52:37.864 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654825+0000", 2024-02-19T21:52:37.864 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.2558999999999995e-05 2024-02-19T21:52:37.864 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.864 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.864 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:52:37.864 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654888+0000", 2024-02-19T21:52:37.864 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.2085847759999999 2024-02-19T21:52:37.865 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.865 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:52:37.865 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.865 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.865 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.865 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:216594 9.1 9:83201e12:::benchmark_data_smithi080_126364_object88002:head [delete] snapc 0=[] ondisk+write+known_if_redirected e355)", 2024-02-19T21:52:37.865 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:47:32.501232+0000", 2024-02-19T21:52:37.865 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 305.32505811599998, 2024-02-19T21:52:37.865 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1537618759999999, 2024-02-19T21:52:37.865 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:52:37.865 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:52:37.865 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:52:37.865 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:52:37.865 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:52:37.865 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 216594 2024-02-19T21:52:37.866 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.866 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:52:37.866 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.866 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:52:37.866 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.501232+0000", 2024-02-19T21:52:37.866 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:52:37.866 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.866 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.866 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:52:37.866 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.501232+0000", 2024-02-19T21:52:37.866 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:52:37.866 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.866 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.867 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:52:37.867 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.501230+0000", 2024-02-19T21:52:37.867 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0129000000000001e-05 2024-02-19T21:52:37.867 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.867 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.867 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:52:37.867 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.501240+0000", 2024-02-19T21:52:37.867 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.7666999999999999e-05 2024-02-19T21:52:37.867 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.867 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.867 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:52:37.867 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.501258+0000", 2024-02-19T21:52:37.867 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.2890000000000003e-06 2024-02-19T21:52:37.867 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.867 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.867 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:52:37.868 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.501264+0000", 2024-02-19T21:52:37.868 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.3189999999999996e-05 2024-02-19T21:52:37.868 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.868 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.868 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.868 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.501337+0000", 2024-02-19T21:52:37.868 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1871e-05 2024-02-19T21:52:37.868 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.868 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.868 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:52:37.868 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.501349+0000", 2024-02-19T21:52:37.868 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.88478064000000001 2024-02-19T21:52:37.868 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.868 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.869 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.869 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:33.386130+0000", 2024-02-19T21:52:37.869 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.8720000000000008e-06 2024-02-19T21:52:37.869 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.869 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.869 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:52:37.869 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:33.386138+0000", 2024-02-19T21:52:37.869 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2562803220000001 2024-02-19T21:52:37.869 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.869 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.869 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.869 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.642419+0000", 2024-02-19T21:52:37.869 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.6604000000000001e-05 2024-02-19T21:52:37.869 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.869 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.870 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:52:37.870 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.642485+0000", 2024-02-19T21:52:37.870 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.5158e-05 2024-02-19T21:52:37.870 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.870 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.870 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 2,3,4", 2024-02-19T21:52:37.870 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.642570+0000", 2024-02-19T21:52:37.870 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.005945868 2024-02-19T21:52:37.870 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.870 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.870 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:52:37.870 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.648516+0000", 2024-02-19T21:52:37.870 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0059971670000000003 2024-02-19T21:52:37.870 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.871 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.871 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.871 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654514+0000", 2024-02-19T21:52:37.871 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.8680999999999999e-05 2024-02-19T21:52:37.871 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.871 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.871 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.871 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654542+0000", 2024-02-19T21:52:37.871 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00036769100000000001 2024-02-19T21:52:37.871 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.871 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.871 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.871 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654910+0000", 2024-02-19T21:52:37.871 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.4502999999999999e-05 2024-02-19T21:52:37.871 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.872 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.872 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:52:37.872 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654934+0000", 2024-02-19T21:52:37.872 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.9169999999999998e-05 2024-02-19T21:52:37.872 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.872 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.872 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:52:37.872 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654994+0000", 2024-02-19T21:52:37.872 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1537618759999999 2024-02-19T21:52:37.872 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.872 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:52:37.872 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.872 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.872 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.873 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_repop(client.15345.0:216629 9.9 e357/268 9:93c488c6:::benchmark_data_smithi080_126364_object88037:head v 357'13696, mlcod=355'13694)", 2024-02-19T21:52:37.873 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:47:34.541383+0000", 2024-02-19T21:52:37.873 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 303.28490723900001, 2024-02-19T21:52:37.873 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.11850343300000001, 2024-02-19T21:52:37.873 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:52:37.873 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:52:37.873 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:52:37.873 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.873 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:52:37.873 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.541383+0000", 2024-02-19T21:52:37.873 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:52:37.873 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.873 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.873 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:52:37.873 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.541383+0000", 2024-02-19T21:52:37.873 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:52:37.874 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.874 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.874 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:52:37.874 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.541382+0000", 2024-02-19T21:52:37.874 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.1250000000000004e-06 2024-02-19T21:52:37.874 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.874 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.874 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:52:37.874 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.541389+0000", 2024-02-19T21:52:37.874 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.0269999999999998e-06 2024-02-19T21:52:37.874 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.874 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.874 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:52:37.874 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.541396+0000", 2024-02-19T21:52:37.874 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0980000000000004e-06 2024-02-19T21:52:37.875 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.875 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.875 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:52:37.875 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.541400+0000", 2024-02-19T21:52:37.875 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.102686073 2024-02-19T21:52:37.875 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.875 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.875 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.875 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.644086+0000", 2024-02-19T21:52:37.875 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.9709000000000001e-05 2024-02-19T21:52:37.875 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.875 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.875 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:52:37.875 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.644106+0000", 2024-02-19T21:52:37.875 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.015751083999999999 2024-02-19T21:52:37.876 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.876 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.876 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:52:37.876 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.659857+0000", 2024-02-19T21:52:37.876 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.8841000000000001e-05 2024-02-19T21:52:37.876 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.876 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.876 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:52:37.876 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.659886+0000", 2024-02-19T21:52:37.876 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.11850343300000001 2024-02-19T21:52:37.876 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.876 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:52:37.876 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.877 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.877 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.877 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:216641 9.1 9:81d76787:::benchmark_data_smithi080_126364_object88049:head [delete] snapc 0=[] ondisk+write+known_if_redirected e357)", 2024-02-19T21:52:37.877 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:47:34.566293+0000", 2024-02-19T21:52:37.877 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 303.259996844, 2024-02-19T21:52:37.877 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.12324028300000001, 2024-02-19T21:52:37.877 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:52:37.877 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:52:37.877 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:52:37.877 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:52:37.877 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:52:37.877 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 216641 2024-02-19T21:52:37.877 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.877 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:52:37.878 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.878 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:52:37.878 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.566293+0000", 2024-02-19T21:52:37.878 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:52:37.878 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.878 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.878 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:52:37.878 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.566293+0000", 2024-02-19T21:52:37.878 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:52:37.878 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.878 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.878 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:52:37.878 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.566291+0000", 2024-02-19T21:52:37.878 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.4090000000000003e-06 2024-02-19T21:52:37.878 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.878 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.878 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:52:37.879 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.566300+0000", 2024-02-19T21:52:37.879 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1263e-05 2024-02-19T21:52:37.879 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.879 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.879 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:52:37.879 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.566311+0000", 2024-02-19T21:52:37.879 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.4980000000000003e-06 2024-02-19T21:52:37.879 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.879 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.879 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:52:37.879 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.566318+0000", 2024-02-19T21:52:37.879 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.088695993000000001 2024-02-19T21:52:37.879 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.879 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.880 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.880 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.655014+0000", 2024-02-19T21:52:37.880 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.2244999999999997e-05 2024-02-19T21:52:37.880 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.880 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.880 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:52:37.880 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.655086+0000", 2024-02-19T21:52:37.880 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.1160000000000001e-05 2024-02-19T21:52:37.880 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.880 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.880 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 2,3,4", 2024-02-19T21:52:37.880 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.655177+0000", 2024-02-19T21:52:37.880 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0047970410000000002 2024-02-19T21:52:37.880 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.881 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.881 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:52:37.881 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.659974+0000", 2024-02-19T21:52:37.881 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0056333449999999997 2024-02-19T21:52:37.881 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.881 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.881 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.881 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.665607+0000", 2024-02-19T21:52:37.881 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0047718120000000003 2024-02-19T21:52:37.881 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.881 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.881 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.881 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.670379+0000", 2024-02-19T21:52:37.881 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.018975845000000002 2024-02-19T21:52:37.881 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.882 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.882 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.882 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.689355+0000", 2024-02-19T21:52:37.882 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.6001999999999997e-05 2024-02-19T21:52:37.882 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.882 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.882 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:52:37.882 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.689411+0000", 2024-02-19T21:52:37.882 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00012227200000000001 2024-02-19T21:52:37.882 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.882 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.882 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:52:37.882 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.689533+0000", 2024-02-19T21:52:37.882 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.12324028300000001 2024-02-19T21:52:37.882 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.883 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:52:37.883 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.883 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.883 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.883 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:50052 10.b 10:dda59031:::benchmark_data_smithi080_153340_object50051:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e408)", 2024-02-19T21:52:37.883 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:36.737898+0000", 2024-02-19T21:52:37.883 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 181.088391728, 2024-02-19T21:52:37.883 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.089456771000000004, 2024-02-19T21:52:37.883 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:52:37.883 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:52:37.883 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:52:37.883 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:52:37.883 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:52:37.883 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 50052 2024-02-19T21:52:37.884 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.884 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:52:37.884 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.884 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:52:37.884 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.737898+0000", 2024-02-19T21:52:37.884 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:52:37.884 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.884 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.884 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:52:37.884 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.737898+0000", 2024-02-19T21:52:37.884 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:52:37.884 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.884 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.884 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:52:37.884 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.737897+0000", 2024-02-19T21:52:37.885 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.5018000000000007e-05 2024-02-19T21:52:37.885 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.885 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.885 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:52:37.885 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.737962+0000", 2024-02-19T21:52:37.885 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1868999999999999e-05 2024-02-19T21:52:37.885 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.885 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.885 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:52:37.885 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.737974+0000", 2024-02-19T21:52:37.885 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.9929999999999998e-06 2024-02-19T21:52:37.885 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.885 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.885 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:52:37.885 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.737981+0000", 2024-02-19T21:52:37.885 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00060545100000000001 2024-02-19T21:52:37.886 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.886 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.886 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.886 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738586+0000", 2024-02-19T21:52:37.886 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00010960599999999999 2024-02-19T21:52:37.886 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.886 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.886 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:52:37.886 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738696+0000", 2024-02-19T21:52:37.886 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013271100000000001 2024-02-19T21:52:37.886 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.886 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.886 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:52:37.886 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738828+0000", 2024-02-19T21:52:37.886 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0055840860000000003 2024-02-19T21:52:37.886 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.887 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.887 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:52:37.887 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.744412+0000", 2024-02-19T21:52:37.887 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.079400992000000004 2024-02-19T21:52:37.887 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.887 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.887 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.887 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.823813+0000", 2024-02-19T21:52:37.887 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0034461610000000001 2024-02-19T21:52:37.887 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.887 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.887 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.887 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.827260+0000", 2024-02-19T21:52:37.887 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.8201000000000001e-05 2024-02-19T21:52:37.888 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.888 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.888 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:52:37.888 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.827318+0000", 2024-02-19T21:52:37.888 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.7098999999999998e-05 2024-02-19T21:52:37.888 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.888 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.888 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:52:37.888 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.827355+0000", 2024-02-19T21:52:37.888 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.089456771000000004 2024-02-19T21:52:37.888 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.888 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:52:37.888 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.888 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.889 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.889 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:50053 10.d 10:b659345d:::benchmark_data_smithi080_153340_object50052:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e408)", 2024-02-19T21:52:37.889 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:36.737996+0000", 2024-02-19T21:52:37.889 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 181.088293738, 2024-02-19T21:52:37.889 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.082897344999999997, 2024-02-19T21:52:37.889 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:52:37.889 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:52:37.889 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:52:37.889 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:52:37.889 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:52:37.889 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 50053 2024-02-19T21:52:37.889 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.889 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:52:37.889 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.889 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:52:37.890 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.737996+0000", 2024-02-19T21:52:37.890 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:52:37.890 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.890 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.890 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:52:37.890 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.737996+0000", 2024-02-19T21:52:37.890 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:52:37.890 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.890 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.890 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:52:37.890 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.737995+0000", 2024-02-19T21:52:37.890 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.7658000000000006e-05 2024-02-19T21:52:37.890 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.890 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.890 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:52:37.891 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738093+0000", 2024-02-19T21:52:37.891 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.3949999999999998e-06 2024-02-19T21:52:37.891 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.891 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.891 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:52:37.891 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738099+0000", 2024-02-19T21:52:37.891 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.946e-06 2024-02-19T21:52:37.891 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.891 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.891 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:52:37.891 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738103+0000", 2024-02-19T21:52:37.891 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.7394999999999997e-05 2024-02-19T21:52:37.891 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.891 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.891 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.892 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738141+0000", 2024-02-19T21:52:37.892 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000131729 2024-02-19T21:52:37.892 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.892 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.892 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:52:37.892 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738273+0000", 2024-02-19T21:52:37.892 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014856900000000001 2024-02-19T21:52:37.892 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.892 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.892 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:52:37.892 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738421+0000", 2024-02-19T21:52:37.892 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0025586850000000002 2024-02-19T21:52:37.892 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.892 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.892 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.893 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.740980+0000", 2024-02-19T21:52:37.893 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0023580210000000001 2024-02-19T21:52:37.893 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.893 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.893 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:52:37.893 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.743338+0000", 2024-02-19T21:52:37.893 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.077452409 2024-02-19T21:52:37.893 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.893 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.893 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.893 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.820790+0000", 2024-02-19T21:52:37.893 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.9552999999999997e-05 2024-02-19T21:52:37.893 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.893 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.893 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:52:37.893 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.820850+0000", 2024-02-19T21:52:37.894 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.3640999999999998e-05 2024-02-19T21:52:37.894 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.894 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.894 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:52:37.894 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.820893+0000", 2024-02-19T21:52:37.894 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.082897344999999997 2024-02-19T21:52:37.894 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.894 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:52:37.894 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.894 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.894 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.894 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:50055 10.b 10:da981f1f:::benchmark_data_smithi080_153340_object50054:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e408)", 2024-02-19T21:52:37.894 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:36.738114+0000", 2024-02-19T21:52:37.894 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 181.08817589500001, 2024-02-19T21:52:37.894 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.089359016999999999, 2024-02-19T21:52:37.894 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:52:37.895 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:52:37.895 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:52:37.895 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:52:37.895 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:52:37.895 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 50055 2024-02-19T21:52:37.895 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.895 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:52:37.895 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.895 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:52:37.895 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738114+0000", 2024-02-19T21:52:37.895 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:52:37.895 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.895 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.895 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:52:37.895 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738114+0000", 2024-02-19T21:52:37.895 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:52:37.895 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.896 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.896 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:52:37.896 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738113+0000", 2024-02-19T21:52:37.896 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.8461000000000002e-05 2024-02-19T21:52:37.896 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.896 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.896 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:52:37.896 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738172+0000", 2024-02-19T21:52:37.896 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.5159999999999994e-06 2024-02-19T21:52:37.896 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.896 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.896 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:52:37.896 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738180+0000", 2024-02-19T21:52:37.896 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.4719999999999997e-06 2024-02-19T21:52:37.897 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.897 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.897 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:52:37.897 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738185+0000", 2024-02-19T21:52:37.897 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0023810910000000001 2024-02-19T21:52:37.897 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.897 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.897 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.897 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.740566+0000", 2024-02-19T21:52:37.897 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000103251 2024-02-19T21:52:37.897 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.897 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.897 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:52:37.897 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.740669+0000", 2024-02-19T21:52:37.897 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00017021199999999999 2024-02-19T21:52:37.897 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.898 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.898 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:52:37.898 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.740839+0000", 2024-02-19T21:52:37.898 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0035788920000000002 2024-02-19T21:52:37.898 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.898 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.898 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:52:37.898 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.744418+0000", 2024-02-19T21:52:37.898 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.079441259 2024-02-19T21:52:37.898 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.898 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.898 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.898 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.823859+0000", 2024-02-19T21:52:37.898 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0035401019999999998 2024-02-19T21:52:37.899 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.899 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.899 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.899 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.827400+0000", 2024-02-19T21:52:37.899 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.2043999999999999e-05 2024-02-19T21:52:37.899 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.899 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.899 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:52:37.899 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.827442+0000", 2024-02-19T21:52:37.899 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.1300000000000002e-05 2024-02-19T21:52:37.899 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.899 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.899 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:52:37.900 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.827473+0000", 2024-02-19T21:52:37.900 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.089359016999999999 2024-02-19T21:52:37.900 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.900 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:52:37.900 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.900 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.900 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.900 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:50056 10.b 10:d614b676:::benchmark_data_smithi080_153340_object50055:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e408)", 2024-02-19T21:52:37.900 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:36.738191+0000", 2024-02-19T21:52:37.900 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 181.08809893200001, 2024-02-19T21:52:37.900 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.089382210000000004, 2024-02-19T21:52:37.900 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:52:37.900 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:52:37.901 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:52:37.901 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:52:37.901 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:52:37.901 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 50056 2024-02-19T21:52:37.901 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.901 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:52:37.901 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.901 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:52:37.901 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738191+0000", 2024-02-19T21:52:37.901 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:52:37.901 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.901 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.901 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:52:37.901 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738191+0000", 2024-02-19T21:52:37.901 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:52:37.901 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.902 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.902 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:52:37.902 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738190+0000", 2024-02-19T21:52:37.902 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.1527999999999999e-05 2024-02-19T21:52:37.902 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.902 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.902 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:52:37.902 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738242+0000", 2024-02-19T21:52:37.902 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.5360000000000004e-06 2024-02-19T21:52:37.902 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.902 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.902 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:52:37.902 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738249+0000", 2024-02-19T21:52:37.902 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.702e-06 2024-02-19T21:52:37.902 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.903 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.903 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:52:37.903 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738254+0000", 2024-02-19T21:52:37.903 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0041879880000000001 2024-02-19T21:52:37.903 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.903 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.903 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.903 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.742442+0000", 2024-02-19T21:52:37.903 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00012031099999999999 2024-02-19T21:52:37.903 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.903 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.903 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:52:37.903 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.742562+0000", 2024-02-19T21:52:37.903 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014128400000000001 2024-02-19T21:52:37.904 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.904 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.904 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:52:37.904 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.742704+0000", 2024-02-19T21:52:37.904 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.081069557 2024-02-19T21:52:37.904 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.904 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.904 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:52:37.904 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.823773+0000", 2024-02-19T21:52:37.904 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000187615 2024-02-19T21:52:37.904 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.904 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.904 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.904 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.823961+0000", 2024-02-19T21:52:37.905 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0035429419999999999 2024-02-19T21:52:37.905 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.905 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.905 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.905 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.827504+0000", 2024-02-19T21:52:37.905 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.9115000000000001e-05 2024-02-19T21:52:37.905 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.905 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.905 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:52:37.905 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.827543+0000", 2024-02-19T21:52:37.905 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.0266000000000001e-05 2024-02-19T21:52:37.905 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.905 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.905 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:52:37.906 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.827573+0000", 2024-02-19T21:52:37.906 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.089382210000000004 2024-02-19T21:52:37.906 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.906 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:52:37.906 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.906 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.906 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.906 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:50057 10.a 10:55291a1e:::benchmark_data_smithi080_153340_object50056:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e408)", 2024-02-19T21:52:37.906 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:36.738260+0000", 2024-02-19T21:52:37.906 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 181.088030253, 2024-02-19T21:52:37.906 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.088615114999999994, 2024-02-19T21:52:37.906 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:52:37.906 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:52:37.906 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:52:37.906 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:52:37.907 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:52:37.907 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 50057 2024-02-19T21:52:37.907 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.907 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:52:37.907 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.907 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:52:37.907 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738260+0000", 2024-02-19T21:52:37.907 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:52:37.907 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.907 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.907 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:52:37.907 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738260+0000", 2024-02-19T21:52:37.907 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:52:37.907 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.908 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.908 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:52:37.908 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738259+0000", 2024-02-19T21:52:37.908 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000106388 2024-02-19T21:52:37.908 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.908 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.908 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:52:37.908 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738365+0000", 2024-02-19T21:52:37.908 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.1300000000000001e-06 2024-02-19T21:52:37.908 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.908 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.908 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:52:37.908 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738373+0000", 2024-02-19T21:52:37.909 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.2989999999999996e-06 2024-02-19T21:52:37.909 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.909 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.909 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:52:37.909 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738379+0000", 2024-02-19T21:52:37.909 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0019766380000000002 2024-02-19T21:52:37.909 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.909 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.909 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.909 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.740355+0000", 2024-02-19T21:52:37.909 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00012005 2024-02-19T21:52:37.909 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.909 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.909 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:52:37.910 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.740475+0000", 2024-02-19T21:52:37.910 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000153766 2024-02-19T21:52:37.910 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.910 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.910 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:52:37.910 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.740629+0000", 2024-02-19T21:52:37.910 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.002744706 2024-02-19T21:52:37.910 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.910 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.910 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:52:37.910 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.743374+0000", 2024-02-19T21:52:37.910 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.083333533000000001 2024-02-19T21:52:37.910 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.911 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.911 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.911 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.826707+0000", 2024-02-19T21:52:37.911 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.4950000000000006e-05 2024-02-19T21:52:37.911 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.911 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.911 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.911 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.826782+0000", 2024-02-19T21:52:37.911 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.2812000000000002e-05 2024-02-19T21:52:37.911 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.911 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.911 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:52:37.911 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.826835+0000", 2024-02-19T21:52:37.911 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.9419999999999999e-05 2024-02-19T21:52:37.912 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.912 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.912 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:52:37.912 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.826875+0000", 2024-02-19T21:52:37.912 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.088615114999999994 2024-02-19T21:52:37.912 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.912 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:52:37.912 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.912 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.912 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.912 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:50060 10.7 10:ecb14ca8:::benchmark_data_smithi080_153340_object50059:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e408)", 2024-02-19T21:52:37.912 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:36.738401+0000", 2024-02-19T21:52:37.912 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 181.08788929100001, 2024-02-19T21:52:37.912 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.085859495999999993, 2024-02-19T21:52:37.913 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:52:37.913 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:52:37.913 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:52:37.913 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:52:37.913 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:52:37.913 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 50060 2024-02-19T21:52:37.913 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.913 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:52:37.913 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.913 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:52:37.913 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738401+0000", 2024-02-19T21:52:37.913 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:52:37.913 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.913 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.914 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:52:37.914 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738401+0000", 2024-02-19T21:52:37.914 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999933 2024-02-19T21:52:37.914 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.914 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.914 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:52:37.914 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738394+0000", 2024-02-19T21:52:37.914 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.8285999999999997e-05 2024-02-19T21:52:37.914 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.914 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.914 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:52:37.914 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738452+0000", 2024-02-19T21:52:37.914 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.4169999999999992e-06 2024-02-19T21:52:37.914 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.915 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.915 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:52:37.915 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738461+0000", 2024-02-19T21:52:37.915 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0710000000000002e-06 2024-02-19T21:52:37.915 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.915 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.915 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:52:37.915 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738466+0000", 2024-02-19T21:52:37.915 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014713199999999999 2024-02-19T21:52:37.915 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.915 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.915 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.915 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738613+0000", 2024-02-19T21:52:37.915 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00012919599999999999 2024-02-19T21:52:37.916 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.916 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.916 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:52:37.916 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738742+0000", 2024-02-19T21:52:37.916 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00016828899999999999 2024-02-19T21:52:37.916 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.916 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.916 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 2,5", 2024-02-19T21:52:37.916 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.738910+0000", 2024-02-19T21:52:37.916 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0050755829999999998 2024-02-19T21:52:37.916 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.916 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.916 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:52:37.916 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.743986+0000", 2024-02-19T21:52:37.916 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.078775849999999994 2024-02-19T21:52:37.917 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.917 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.917 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.917 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.822762+0000", 2024-02-19T21:52:37.917 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00062471900000000003 2024-02-19T21:52:37.917 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.917 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.917 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.917 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.823387+0000", 2024-02-19T21:52:37.917 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.0244000000000001e-05 2024-02-19T21:52:37.917 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.917 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.917 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:52:37.917 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.823447+0000", 2024-02-19T21:52:37.917 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00081322800000000004 2024-02-19T21:52:37.918 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.918 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.918 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:52:37.918 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.824260+0000", 2024-02-19T21:52:37.918 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.085859495999999993 2024-02-19T21:52:37.918 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.918 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:52:37.918 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.918 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.918 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.918 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:50062 10.0 10:0a561d70:::benchmark_data_smithi080_153340_object50061:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e408)", 2024-02-19T21:52:37.918 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:36.743720+0000", 2024-02-19T21:52:37.918 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 181.082569982, 2024-02-19T21:52:37.918 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.092502629000000003, 2024-02-19T21:52:37.918 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:52:37.919 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:52:37.919 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:52:37.919 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:52:37.919 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:52:37.919 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 50062 2024-02-19T21:52:37.919 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.919 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:52:37.919 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.919 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:52:37.919 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.743720+0000", 2024-02-19T21:52:37.919 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:52:37.919 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.919 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.919 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:52:37.920 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.743720+0000", 2024-02-19T21:52:37.920 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:52:37.920 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.920 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.920 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:52:37.920 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.743718+0000", 2024-02-19T21:52:37.920 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.6156999999999997e-05 2024-02-19T21:52:37.920 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.920 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.920 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:52:37.920 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.743784+0000", 2024-02-19T21:52:37.920 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1415e-05 2024-02-19T21:52:37.920 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.920 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.920 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:52:37.921 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.743796+0000", 2024-02-19T21:52:37.921 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.2199999999999997e-06 2024-02-19T21:52:37.921 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.921 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.921 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:52:37.921 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.743802+0000", 2024-02-19T21:52:37.921 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0992999999999999e-05 2024-02-19T21:52:37.921 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.921 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.921 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.921 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.743843+0000", 2024-02-19T21:52:37.921 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00011644 2024-02-19T21:52:37.921 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.921 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.922 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:52:37.922 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.743959+0000", 2024-02-19T21:52:37.922 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014221899999999999 2024-02-19T21:52:37.922 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.922 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.922 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,4", 2024-02-19T21:52:37.922 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.744102+0000", 2024-02-19T21:52:37.922 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.079141816000000004 2024-02-19T21:52:37.922 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.922 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.922 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:52:37.922 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.823243+0000", 2024-02-19T21:52:37.922 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0065536809999999996 2024-02-19T21:52:37.922 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.922 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.923 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.923 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.829797+0000", 2024-02-19T21:52:37.923 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0063372769999999997 2024-02-19T21:52:37.923 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.923 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.923 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.923 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.836134+0000", 2024-02-19T21:52:37.923 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.7154999999999998e-05 2024-02-19T21:52:37.923 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.923 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.923 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:52:37.923 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.836182+0000", 2024-02-19T21:52:37.923 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0850999999999999e-05 2024-02-19T21:52:37.923 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.924 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.924 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:52:37.924 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.836222+0000", 2024-02-19T21:52:37.924 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.092502629000000003 2024-02-19T21:52:37.924 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.924 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:52:37.924 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.924 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.924 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.924 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:50066 10.d 10:bb4d6c08:::benchmark_data_smithi080_153340_object50065:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e408)", 2024-02-19T21:52:37.924 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:36.746091+0000", 2024-02-19T21:52:37.924 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 181.08019831199999, 2024-02-19T21:52:37.924 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.090454882, 2024-02-19T21:52:37.924 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:52:37.925 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:52:37.925 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:52:37.925 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:52:37.925 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:52:37.925 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 50066 2024-02-19T21:52:37.925 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.925 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:52:37.925 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.925 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:52:37.925 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.746091+0000", 2024-02-19T21:52:37.925 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:52:37.925 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.925 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.925 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:52:37.925 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.746091+0000", 2024-02-19T21:52:37.926 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:52:37.926 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.926 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.926 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:52:37.926 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.746090+0000", 2024-02-19T21:52:37.926 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.1481000000000003e-05 2024-02-19T21:52:37.926 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.926 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.926 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:52:37.926 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.746152+0000", 2024-02-19T21:52:37.926 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.074807546000000003 2024-02-19T21:52:37.926 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.926 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.926 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:52:37.927 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.820959+0000", 2024-02-19T21:52:37.927 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1661000000000001e-05 2024-02-19T21:52:37.927 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.927 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.927 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:52:37.927 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.820971+0000", 2024-02-19T21:52:37.927 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.001836957 2024-02-19T21:52:37.927 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.927 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.927 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.927 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.822808+0000", 2024-02-19T21:52:37.927 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00041138500000000001 2024-02-19T21:52:37.927 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.927 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.927 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:52:37.927 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.823219+0000", 2024-02-19T21:52:37.928 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00015554699999999999 2024-02-19T21:52:37.928 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.928 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.928 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:52:37.928 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.823375+0000", 2024-02-19T21:52:37.928 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0056457060000000003 2024-02-19T21:52:37.928 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.928 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.928 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:52:37.928 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.829021+0000", 2024-02-19T21:52:37.928 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0073204740000000004 2024-02-19T21:52:37.928 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.928 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.928 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.928 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.836341+0000", 2024-02-19T21:52:37.929 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000116155 2024-02-19T21:52:37.929 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.929 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.929 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.929 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.836457+0000", 2024-02-19T21:52:37.929 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.9313e-05 2024-02-19T21:52:37.929 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.929 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.929 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:52:37.929 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.836506+0000", 2024-02-19T21:52:37.929 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.9885999999999997e-05 2024-02-19T21:52:37.929 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.929 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.929 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:52:37.929 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:36.836546+0000", 2024-02-19T21:52:37.930 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.090454882 2024-02-19T21:52:37.930 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.930 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:52:37.930 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.930 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.930 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.930 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:51985 10.a 10:502e486f:::benchmark_data_smithi080_153340_object51984:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e409)", 2024-02-19T21:52:37.930 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:49:38.700772+0000", 2024-02-19T21:52:37.930 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 179.12551816600001, 2024-02-19T21:52:37.930 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.10272083, 2024-02-19T21:52:37.930 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:52:37.930 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:52:37.930 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:52:37.930 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:52:37.930 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:52:37.931 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 51985 2024-02-19T21:52:37.931 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.931 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:52:37.931 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.931 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:52:37.931 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.700772+0000", 2024-02-19T21:52:37.931 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:52:37.931 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.931 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.931 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:52:37.931 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.700772+0000", 2024-02-19T21:52:37.931 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999862 2024-02-19T21:52:37.931 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.931 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.931 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:52:37.931 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.700758+0000", 2024-02-19T21:52:37.931 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.6674999999999994e-05 2024-02-19T21:52:37.932 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.932 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.932 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:52:37.932 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.700824+0000", 2024-02-19T21:52:37.932 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2201000000000001e-05 2024-02-19T21:52:37.932 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.932 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.932 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:52:37.932 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.700836+0000", 2024-02-19T21:52:37.932 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.601e-06 2024-02-19T21:52:37.932 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.932 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.932 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:52:37.932 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.700843+0000", 2024-02-19T21:52:37.932 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.010967782000000001 2024-02-19T21:52:37.933 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.933 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.933 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.933 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.711811+0000", 2024-02-19T21:52:37.933 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.7478999999999995e-05 2024-02-19T21:52:37.933 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.933 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.933 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:52:37.933 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.711888+0000", 2024-02-19T21:52:37.933 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.0498e-05 2024-02-19T21:52:37.933 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.933 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.933 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:52:37.933 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.711979+0000", 2024-02-19T21:52:37.933 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0030036080000000001 2024-02-19T21:52:37.933 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.934 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.934 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.934 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.714982+0000", 2024-02-19T21:52:37.934 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.016776887000000001 2024-02-19T21:52:37.934 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.934 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.934 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.934 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.731759+0000", 2024-02-19T21:52:37.935 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:52:37.935 INFO:teuthology.orchestra.run.smithi080.stdout:{"fsid":"6f763558-cf6d-11ee-95bb-87774f69a715","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"noscrub flag(s) set","count":7},"muted":false},"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 484/133857 objects degraded (0.362%), 2 pgs degraded, 2 pgs undersized","count":4},"muted":false}},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1444,"monmap":{"epoch":3,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":472,"num_osds":8,"num_up_osds":8,"osd_up_since":1708379347,"num_in_osds":7,"osd_in_since":1708379252,"num_remapped_pgs":2},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":136},{"state_name":"active+recovering+undersized+degraded+remapped","count":2}],"num_pgs":138,"num_pools":7,"num_objects":44619,"data_bytes":2911508156,"bytes_used":14256287744,"bytes_avail":657708961792,"bytes_total":671965249536,"degraded_objects":484,"degraded_total":133857,"degraded_ratio":0.0036157989496253466,"misplaced_objects":4370,"misplaced_total":133857,"misplaced_ratio":0.032646779772443728,"recovering_objects_per_sec":69,"recovering_bytes_per_sec":4387262,"recovering_keys_per_sec":0,"num_objects_recovered":417,"num_bytes_recovered":26345472,"num_keys_recovered":0,"read_bytes_sec":30012,"write_bytes_sec":0,"read_op_per_sec":29,"write_op_per_sec":1050},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"services":{"dashboard":"https://172.21.15.80:8443/","prometheus":"http://172.21.15.80:9283/"}},"servicemap":{"epoch":15,"modified":"2024-02-19T21:50:07.164150+0000","services":{"rgw":{"daemons":{"summary":"","14445":{"start_epoch":12,"start_stamp":"2024-02-19T21:32:30.457944+0000","gid":14445,"addr":"172.21.15.80:0/10763483","metadata":{"arch":"x86_64","ceph_release":"pacific","ceph_version":"ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)","ceph_version_short":"16.2.14-548-g81bd20d6","container_hostname":"smithi080","container_image":"quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9","cpu":"Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz","distro":"centos","distro_description":"CentOS Stream 8","distro_version":"8","frontend_config#0":"beast port=80","frontend_type#0":"beast","hostname":"smithi080","id":"foo.a","kernel_description":"#1 SMP Mon Feb 5 18:34:56 UTC 2024","kernel_version":"4.18.0-539.el8.x86_64","mem_swap_kb":"0","mem_total_kb":"32537572","num_handles":"1","os":"Linux","pid":"7","realm_id":"","realm_name":"","zone_id":"34a855d6-dbbc-4802-a6e9-a7d60f23c9d4","zone_name":"default","zonegroup_id":"7194a06a-53d8-4b5f-8306-5954e6d460c8","zonegroup_name":"default"},"task_status":{}}}}}},"progress_events":{"0d84ec8e-b738-4996-b3e9-d3d54263ac3b":{"message":"Global Recovery Event (5m)\n [===========================.] (remaining: 4s)","progress":0.98550724983215332,"add_to_ceph_s":true}}} 2024-02-19T21:52:37.935 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.071631416000000003 2024-02-19T21:52:37.935 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.935 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.935 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:52:37.935 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.803391+0000", 2024-02-19T21:52:37.935 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.2791000000000002e-05 2024-02-19T21:52:37.935 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.936 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.936 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:52:37.936 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.803454+0000", 2024-02-19T21:52:37.936 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.8911000000000001e-05 2024-02-19T21:52:37.936 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.936 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.936 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:52:37.936 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:49:38.803492+0000", 2024-02-19T21:52:37.936 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.10272083 2024-02-19T21:52:37.936 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.936 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:52:37.936 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.936 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.937 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.937 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:79711 10.f 10:fbc66f72:::benchmark_data_smithi080_153340_object4961:head [delete] snapc 0=[] ondisk+write+known_if_redirected e440)", 2024-02-19T21:52:37.937 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:51:04.473413+0000", 2024-02-19T21:52:37.937 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 93.352877049, 2024-02-19T21:52:37.937 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.93658497500000004, 2024-02-19T21:52:37.937 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:52:37.937 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:52:37.937 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:52:37.937 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:52:37.937 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:52:37.937 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 79711 2024-02-19T21:52:37.937 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.937 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:52:37.937 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.938 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:52:37.938 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:04.473413+0000", 2024-02-19T21:52:37.938 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:52:37.938 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.938 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.938 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:52:37.938 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:04.473413+0000", 2024-02-19T21:52:37.938 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:52:37.938 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.938 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.938 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:52:37.938 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:04.473411+0000", 2024-02-19T21:52:37.938 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.1620000000000008e-06 2024-02-19T21:52:37.938 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.939 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.939 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:52:37.939 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:04.473419+0000", 2024-02-19T21:52:37.939 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.5668999999999999e-05 2024-02-19T21:52:37.939 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.939 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.939 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:52:37.939 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:04.473435+0000", 2024-02-19T21:52:37.939 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.9109999999999998e-06 2024-02-19T21:52:37.939 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.939 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.939 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:52:37.939 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:04.473441+0000", 2024-02-19T21:52:37.939 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.7632e-05 2024-02-19T21:52:37.939 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.940 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.940 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.940 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:04.473498+0000", 2024-02-19T21:52:37.940 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0893999999999999e-05 2024-02-19T21:52:37.940 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.940 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.940 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:52:37.940 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:04.473509+0000", 2024-02-19T21:52:37.940 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.93029979600000001 2024-02-19T21:52:37.940 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.940 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.940 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.940 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.403809+0000", 2024-02-19T21:52:37.940 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000104923 2024-02-19T21:52:37.941 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.941 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.941 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:52:37.941 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.403914+0000", 2024-02-19T21:52:37.941 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.3839999999999996e-05 2024-02-19T21:52:37.941 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.941 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.941 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 2,4", 2024-02-19T21:52:37.941 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.404008+0000", 2024-02-19T21:52:37.941 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0055697730000000001 2024-02-19T21:52:37.941 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.941 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.941 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:52:37.941 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.409578+0000", 2024-02-19T21:52:37.941 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00021556 2024-02-19T21:52:37.941 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.942 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.942 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.942 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.409793+0000", 2024-02-19T21:52:37.942 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000108441 2024-02-19T21:52:37.942 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.942 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.942 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.942 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.409902+0000", 2024-02-19T21:52:37.942 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0413e-05 2024-02-19T21:52:37.942 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.942 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.942 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:52:37.942 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.409952+0000", 2024-02-19T21:52:37.942 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.5643999999999999e-05 2024-02-19T21:52:37.942 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.942 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.943 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:52:37.943 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.409998+0000", 2024-02-19T21:52:37.943 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.93658497500000004 2024-02-19T21:52:37.943 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.943 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:52:37.943 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.943 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.943 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.943 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:79802 10.f 10:f48ca55f:::benchmark_data_smithi080_153340_object5052:head [delete] snapc 0=[] ondisk+write+known_if_redirected e440)", 2024-02-19T21:52:37.943 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:51:05.228035+0000", 2024-02-19T21:52:37.943 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 92.598254435000001, 2024-02-19T21:52:37.943 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.182090638, 2024-02-19T21:52:37.943 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:52:37.943 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:52:37.943 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:52:37.944 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:52:37.944 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:52:37.944 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 79802 2024-02-19T21:52:37.944 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.944 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:52:37.944 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.944 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:52:37.944 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.228035+0000", 2024-02-19T21:52:37.944 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:52:37.944 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.944 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.944 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:52:37.944 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.228035+0000", 2024-02-19T21:52:37.945 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:52:37.945 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.945 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.945 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:52:37.945 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.228034+0000", 2024-02-19T21:52:37.945 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.1339999999999998e-06 2024-02-19T21:52:37.945 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.945 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.945 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:52:37.945 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.228041+0000", 2024-02-19T21:52:37.945 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1766999999999999e-05 2024-02-19T21:52:37.945 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.945 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.945 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:52:37.946 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.228053+0000", 2024-02-19T21:52:37.946 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.1329999999999998e-06 2024-02-19T21:52:37.946 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.946 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.946 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:52:37.946 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.228058+0000", 2024-02-19T21:52:37.946 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0040999999999998e-05 2024-02-19T21:52:37.946 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.946 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.946 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.946 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.228098+0000", 2024-02-19T21:52:37.946 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.1370000000000002e-06 2024-02-19T21:52:37.946 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.946 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.946 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:52:37.947 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.228106+0000", 2024-02-19T21:52:37.947 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.17789721 2024-02-19T21:52:37.947 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.947 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.947 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.947 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.406003+0000", 2024-02-19T21:52:37.947 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000104949 2024-02-19T21:52:37.947 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.947 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.947 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:52:37.947 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.406108+0000", 2024-02-19T21:52:37.947 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.1636000000000002e-05 2024-02-19T21:52:37.947 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.947 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.948 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 2,4", 2024-02-19T21:52:37.948 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.406200+0000", 2024-02-19T21:52:37.948 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0036012940000000001 2024-02-19T21:52:37.948 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.948 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.948 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:52:37.948 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.409801+0000", 2024-02-19T21:52:37.948 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0569000000000003e-05 2024-02-19T21:52:37.948 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.948 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.948 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.948 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.409852+0000", 2024-02-19T21:52:37.948 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00021395299999999999 2024-02-19T21:52:37.949 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.949 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.949 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.949 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.410066+0000", 2024-02-19T21:52:37.949 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.6708999999999997e-05 2024-02-19T21:52:37.949 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.949 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.949 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:52:37.949 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.410103+0000", 2024-02-19T21:52:37.949 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.3492000000000001e-05 2024-02-19T21:52:37.949 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.949 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.949 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:52:37.950 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.410126+0000", 2024-02-19T21:52:37.950 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.182090638 2024-02-19T21:52:37.950 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.950 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:52:37.950 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.950 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.950 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.950 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:79816 10.f 10:f1283a88:::benchmark_data_smithi080_153340_object5066:head [delete] snapc 0=[] ondisk+write+known_if_redirected e440)", 2024-02-19T21:52:37.950 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:51:05.307450+0000", 2024-02-19T21:52:37.950 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 92.518839503999999, 2024-02-19T21:52:37.950 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.102788746, 2024-02-19T21:52:37.950 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:52:37.950 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:52:37.950 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:52:37.951 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:52:37.951 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:52:37.951 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 79816 2024-02-19T21:52:37.951 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.951 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:52:37.951 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.951 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:52:37.951 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.307450+0000", 2024-02-19T21:52:37.951 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:52:37.951 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.951 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.951 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:52:37.951 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.307450+0000", 2024-02-19T21:52:37.951 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:52:37.952 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.952 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.952 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:52:37.952 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.307449+0000", 2024-02-19T21:52:37.952 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.7429999999999997e-06 2024-02-19T21:52:37.952 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.952 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.952 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:52:37.952 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.307458+0000", 2024-02-19T21:52:37.952 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.7586999999999999e-05 2024-02-19T21:52:37.952 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.952 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.952 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:52:37.953 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.307476+0000", 2024-02-19T21:52:37.953 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.4829999999999999e-06 2024-02-19T21:52:37.953 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.953 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.953 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:52:37.953 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.307484+0000", 2024-02-19T21:52:37.953 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.1948999999999999e-05 2024-02-19T21:52:37.953 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.953 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.953 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.953 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.307546+0000", 2024-02-19T21:52:37.953 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2879e-05 2024-02-19T21:52:37.953 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.953 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.953 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:52:37.954 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.307559+0000", 2024-02-19T21:52:37.954 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.100361134 2024-02-19T21:52:37.954 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.954 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.954 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:52:37.954 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.407920+0000", 2024-02-19T21:52:37.954 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00011825299999999999 2024-02-19T21:52:37.954 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.954 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.954 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:52:37.954 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.408039+0000", 2024-02-19T21:52:37.954 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014113400000000001 2024-02-19T21:52:37.954 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.954 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.955 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 2,4", 2024-02-19T21:52:37.955 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.408180+0000", 2024-02-19T21:52:37.955 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.001628694 2024-02-19T21:52:37.955 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.955 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.955 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:52:37.955 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.409808+0000", 2024-02-19T21:52:37.955 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00036234700000000001 2024-02-19T21:52:37.955 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.955 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.955 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.955 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.410171+0000", 2024-02-19T21:52:37.955 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.4238000000000001e-05 2024-02-19T21:52:37.955 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.956 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.956 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:52:37.956 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.410195+0000", 2024-02-19T21:52:37.956 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.5381e-05 2024-02-19T21:52:37.956 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.956 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.956 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:52:37.956 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.410220+0000", 2024-02-19T21:52:37.956 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.8698999999999998e-05 2024-02-19T21:52:37.956 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:52:37.956 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:52:37.956 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:52:37.956 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.410239+0000", 2024-02-19T21:52:37.956 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.102788746 2024-02-19T21:52:37.956 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.957 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:52:37.957 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.957 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:52:37.957 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:52:37.957 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:52:38.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:37.530342+0000 mon.a (mon.0) 1814 : audit [DBG] from='client.? 172.21.15.80:0/2035706638' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-02-19T21:52:38.345 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:37.530342+0000 mon.a (mon.0) 1814 : audit [DBG] from='client.? 172.21.15.80:0/2035706638' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-02-19T21:52:38.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:37.530342+0000 mon.a (mon.0) 1814 : audit [DBG] from='client.? 172.21.15.80:0/2035706638' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-02-19T21:52:38.424 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:38.901 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:52:38.911 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:38.912 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:52:39.013 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:52:39.075 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:39.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:37.213176+0000 mgr.y (mgr.14514) 766 : cluster [DBG] pgmap v997: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.6 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 59 KiB/s rd, 0 B/s wr, 804 op/s; 720/129672 objects degraded (0.555%); 4075/129672 objects misplaced (3.143%); 4.2 MiB/s, 66 objects/s recovering 2024-02-19T21:52:39.345 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:37.213176+0000 mgr.y (mgr.14514) 766 : cluster [DBG] pgmap v997: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.6 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 59 KiB/s rd, 0 B/s wr, 804 op/s; 720/129672 objects degraded (0.555%); 4075/129672 objects misplaced (3.143%); 4.2 MiB/s, 66 objects/s recovering 2024-02-19T21:52:39.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:37.213176+0000 mgr.y (mgr.14514) 766 : cluster [DBG] pgmap v997: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.6 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 59 KiB/s rd, 0 B/s wr, 804 op/s; 720/129672 objects degraded (0.555%); 4075/129672 objects misplaced (3.143%); 4.2 MiB/s, 66 objects/s recovering 2024-02-19T21:52:39.535 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.7 dump_ops_in_flight 2024-02-19T21:52:39.562 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:52:39.569 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:39.569 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:52:39.670 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:52:39.739 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:39.776 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:52:39.780 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:39.781 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:52:39.869 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:52:39.882 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:52:39.886 INFO:tasks.cephadm.ceph_manager.ceph:making progress, resetting timeout 2024-02-19T21:52:39.887 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:52:39.954 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:40.048 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:52:40.163 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:52:40.167 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:40.168 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:52:40.268 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:52:40.325 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:40.380 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:52:40.383 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:40.384 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:52:40.485 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:52:40.530 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:40.775 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:52:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:52:40] "GET /metrics HTTP/1.1" 200 176585 "" "Prometheus/2.33.4" 2024-02-19T21:52:40.985 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:52:40.988 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:40.988 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:52:41.089 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:52:41.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:39.213719+0000 mgr.y (mgr.14514) 767 : cluster [DBG] pgmap v998: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.6 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 54 KiB/s rd, 0 B/s wr, 718 op/s; 720/127932 objects degraded (0.563%); 3807/127932 objects misplaced (2.976%); 5.2 MiB/s, 83 objects/s recovering 2024-02-19T21:52:41.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:40.318285+0000 mon.a (mon.0) 1815 : cluster [WRN] Health check update: Degraded data redundancy: 720/127932 objects degraded (0.563%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:41.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:39.213719+0000 mgr.y (mgr.14514) 767 : cluster [DBG] pgmap v998: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.6 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 54 KiB/s rd, 0 B/s wr, 718 op/s; 720/127932 objects degraded (0.563%); 3807/127932 objects misplaced (2.976%); 5.2 MiB/s, 83 objects/s recovering 2024-02-19T21:52:41.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:40.318285+0000 mon.a (mon.0) 1815 : cluster [WRN] Health check update: Degraded data redundancy: 720/127932 objects degraded (0.563%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:41.152 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:41.217 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:52:41.224 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:41.225 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:52:41.225 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:39.213719+0000 mgr.y (mgr.14514) 767 : cluster [DBG] pgmap v998: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.6 GiB data, 13 GiB used, 613 GiB / 626 GiB avail; 54 KiB/s rd, 0 B/s wr, 718 op/s; 720/127932 objects degraded (0.563%); 3807/127932 objects misplaced (2.976%); 5.2 MiB/s, 83 objects/s recovering 2024-02-19T21:52:41.225 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:40.318285+0000 mon.a (mon.0) 1815 : cluster [WRN] Health check update: Degraded data redundancy: 720/127932 objects degraded (0.563%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:41.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:52:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:52:41.234 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:52:41.326 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:52:41.379 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:41.520 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:52:41.527 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:41.527 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:52:41.598 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:52:41.628 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:52:41.680 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:41.842 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:52:41.847 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:41.847 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:52:41.948 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:52:42.012 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:42.279 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:52:42.284 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:42.285 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:52:42.386 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:52:42.421 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:42.570 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:52:42.576 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:42.577 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:52:42.677 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:52:42.757 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:43.291 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:41.099025+0000 mgr.y (mgr.14514) 768 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:52:43.292 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:41.214422+0000 mgr.y (mgr.14514) 769 : cluster [DBG] pgmap v999: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.4 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 53 KiB/s rd, 0 B/s wr, 1.13k op/s; 941/116541 objects degraded (0.807%); 3530/116541 objects misplaced (3.029%); 3.0 MiB/s, 47 objects/s recovering 2024-02-19T21:52:43.292 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:41.099025+0000 mgr.y (mgr.14514) 768 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:52:43.292 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:41.214422+0000 mgr.y (mgr.14514) 769 : cluster [DBG] pgmap v999: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.4 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 53 KiB/s rd, 0 B/s wr, 1.13k op/s; 941/116541 objects degraded (0.807%); 3530/116541 objects misplaced (3.029%); 3.0 MiB/s, 47 objects/s recovering 2024-02-19T21:52:43.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:41.099025+0000 mgr.y (mgr.14514) 768 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:52:43.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:41.214422+0000 mgr.y (mgr.14514) 769 : cluster [DBG] pgmap v999: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.4 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 53 KiB/s rd, 0 B/s wr, 1.13k op/s; 941/116541 objects degraded (0.807%); 3530/116541 objects misplaced (3.029%); 3.0 MiB/s, 47 objects/s recovering 2024-02-19T21:52:43.383 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:52:43.383 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [], 2024-02-19T21:52:43.383 INFO:teuthology.orchestra.run.smithi157.stdout: "num_ops": 0 2024-02-19T21:52:43.383 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:52:43.640 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:52:43.647 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:43.648 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:52:43.748 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:52:43.781 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:44.146 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:52:44.152 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:44.153 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:52:44.253 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:52:44.298 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:44.408 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.7 dump_blocked_ops 2024-02-19T21:52:44.658 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:52:44.661 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:44.661 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:52:44.762 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:52:44.833 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:44.877 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:52:44.881 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:44.881 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:52:44.918 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:52:44.983 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:52:45.027 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:43.214845+0000 mgr.y (mgr.14514) 770 : cluster [DBG] pgmap v1000: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.3 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 48 KiB/s rd, 0 B/s wr, 1.07k op/s; 941/114879 objects degraded (0.819%); 3208/114879 objects misplaced (2.793%); 4.9 MiB/s, 78 objects/s recovering 2024-02-19T21:52:45.047 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:45.194 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:52:45.200 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:45.200 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:52:45.202 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:43.214845+0000 mgr.y (mgr.14514) 770 : cluster [DBG] pgmap v1000: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.3 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 48 KiB/s rd, 0 B/s wr, 1.07k op/s; 941/114879 objects degraded (0.819%); 3208/114879 objects misplaced (2.793%); 4.9 MiB/s, 78 objects/s recovering 2024-02-19T21:52:45.301 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:52:45.351 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:43.214845+0000 mgr.y (mgr.14514) 770 : cluster [DBG] pgmap v1000: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.3 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 48 KiB/s rd, 0 B/s wr, 1.07k op/s; 941/114879 objects degraded (0.819%); 3208/114879 objects misplaced (2.793%); 4.9 MiB/s, 78 objects/s recovering 2024-02-19T21:52:45.364 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:45.389 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:52:45.391 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:45.391 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:52:45.492 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:52:45.606 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:45.711 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:52:45.714 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:45.715 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:52:45.815 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:52:45.886 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:52:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:52:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:52:45.890 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:45.910 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:52:46.179 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:45.320361+0000 mon.a (mon.0) 1816 : cluster [WRN] Health check update: Degraded data redundancy: 941/114879 objects degraded (0.819%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:46.180 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:45.386393+0000 mon.c (mon.2) 115 : audit [INF] from='client.? 172.21.15.80:0/4106525357' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:52:46.180 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:45.386704+0000 mon.a (mon.0) 1817 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:52:46.180 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:45.320361+0000 mon.a (mon.0) 1816 : cluster [WRN] Health check update: Degraded data redundancy: 941/114879 objects degraded (0.819%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:46.180 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:45.386393+0000 mon.c (mon.2) 115 : audit [INF] from='client.? 172.21.15.80:0/4106525357' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:52:46.180 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:45.386704+0000 mon.a (mon.0) 1817 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:52:46.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:45.320361+0000 mon.a (mon.0) 1816 : cluster [WRN] Health check update: Degraded data redundancy: 941/114879 objects degraded (0.819%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:46.291 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:45.386393+0000 mon.c (mon.2) 115 : audit [INF] from='client.? 172.21.15.80:0/4106525357' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:52:46.291 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:45.386704+0000 mon.a (mon.0) 1817 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:52:46.338 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-02-19T21:52:46.374 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:52:46.383 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:46.384 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:52:46.484 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:52:46.552 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:46.647 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:52:46.650 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:46.651 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:52:46.752 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:52:46.814 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:46.861 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:52:46.865 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:46.865 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:52:46.966 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:52:47.046 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:52:47.046 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [], 2024-02-19T21:52:47.046 INFO:teuthology.orchestra.run.smithi157.stdout: "complaint_time": 30, 2024-02-19T21:52:47.046 INFO:teuthology.orchestra.run.smithi157.stdout: "num_blocked_ops": 0 2024-02-19T21:52:47.046 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:52:47.046 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:47.066 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:45.218696+0000 mgr.y (mgr.14514) 771 : cluster [DBG] pgmap v1001: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.2 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 27 KiB/s rd, 0 B/s wr, 929 op/s; 941/107280 objects degraded (0.877%); 3208/107280 objects misplaced (2.990%); 4.4 MiB/s, 70 objects/s recovering 2024-02-19T21:52:47.066 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:46.324187+0000 mon.a (mon.0) 1818 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:52:47.067 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:46.330646+0000 mon.a (mon.0) 1819 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:52:47.067 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:46.330717+0000 mon.a (mon.0) 1820 : cluster [DBG] osdmap e473: 8 total, 8 up, 7 in 2024-02-19T21:52:47.086 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:52:47.094 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:47.095 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:52:47.195 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:52:47.245 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:47.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:45.218696+0000 mgr.y (mgr.14514) 771 : cluster [DBG] pgmap v1001: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.2 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 27 KiB/s rd, 0 B/s wr, 929 op/s; 941/107280 objects degraded (0.877%); 3208/107280 objects misplaced (2.990%); 4.4 MiB/s, 70 objects/s recovering 2024-02-19T21:52:47.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:46.324187+0000 mon.a (mon.0) 1818 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:52:47.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:46.330646+0000 mon.a (mon.0) 1819 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:52:47.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:46.330717+0000 mon.a (mon.0) 1820 : cluster [DBG] osdmap e473: 8 total, 8 up, 7 in 2024-02-19T21:52:47.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:45.218696+0000 mgr.y (mgr.14514) 771 : cluster [DBG] pgmap v1001: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.2 GiB data, 12 GiB used, 614 GiB / 626 GiB avail; 27 KiB/s rd, 0 B/s wr, 929 op/s; 941/107280 objects degraded (0.877%); 3208/107280 objects misplaced (2.990%); 4.4 MiB/s, 70 objects/s recovering 2024-02-19T21:52:47.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:46.324187+0000 mon.a (mon.0) 1818 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:52:47.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:46.330646+0000 mon.a (mon.0) 1819 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:52:47.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:46.330717+0000 mon.a (mon.0) 1820 : cluster [DBG] osdmap e473: 8 total, 8 up, 7 in 2024-02-19T21:52:47.478 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:52:47.483 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:52:48.532 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:52:48.536 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:48.537 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:52:48.637 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:52:48.714 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:49.063 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:47.219441+0000 mgr.y (mgr.14514) 772 : cluster [DBG] pgmap v1003: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.1 GiB data, 11 GiB used, 614 GiB / 626 GiB avail; 3.4 KiB/s rd, 0 B/s wr, 888 op/s; 1154/103161 objects degraded (1.119%); 2936/103161 objects misplaced (2.846%); 4.4 MiB/s, 70 objects/s recovering 2024-02-19T21:52:49.063 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:47.340525+0000 mgr.y (mgr.14514) 773 : audit [DBG] from='client.25838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:52:49.286 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:52:49.295 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:49.295 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:52:49.297 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.7 dump_historic_ops 2024-02-19T21:52:49.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:47.219441+0000 mgr.y (mgr.14514) 772 : cluster [DBG] pgmap v1003: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.1 GiB data, 11 GiB used, 614 GiB / 626 GiB avail; 3.4 KiB/s rd, 0 B/s wr, 888 op/s; 1154/103161 objects degraded (1.119%); 2936/103161 objects misplaced (2.846%); 4.4 MiB/s, 70 objects/s recovering 2024-02-19T21:52:49.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:47.340525+0000 mgr.y (mgr.14514) 773 : audit [DBG] from='client.25838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:52:49.392 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:47.219441+0000 mgr.y (mgr.14514) 772 : cluster [DBG] pgmap v1003: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.1 GiB data, 11 GiB used, 614 GiB / 626 GiB avail; 3.4 KiB/s rd, 0 B/s wr, 888 op/s; 1154/103161 objects degraded (1.119%); 2936/103161 objects misplaced (2.846%); 4.4 MiB/s, 70 objects/s recovering 2024-02-19T21:52:49.392 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:47.340525+0000 mgr.y (mgr.14514) 773 : audit [DBG] from='client.25838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:52:49.396 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:52:49.434 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:49.812 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:52:50.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:49.219916+0000 mgr.y (mgr.14514) 774 : cluster [DBG] pgmap v1004: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.1 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 882 op/s; 1154/101469 objects degraded (1.137%); 2630/101469 objects misplaced (2.592%); 4.6 MiB/s, 74 objects/s recovering 2024-02-19T21:52:50.595 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:49.219916+0000 mgr.y (mgr.14514) 774 : cluster [DBG] pgmap v1004: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.1 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 882 op/s; 1154/101469 objects degraded (1.137%); 2630/101469 objects misplaced (2.592%); 4.6 MiB/s, 74 objects/s recovering 2024-02-19T21:52:50.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:49.219916+0000 mgr.y (mgr.14514) 774 : cluster [DBG] pgmap v1004: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 2.1 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 882 op/s; 1154/101469 objects degraded (1.137%); 2630/101469 objects misplaced (2.592%); 4.6 MiB/s, 74 objects/s recovering 2024-02-19T21:52:50.698 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":1003,"stamp":"2024-02-19T21:52:47.219151+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2240943804,"num_objects":34387,"num_object_clones":0,"num_object_copies":103161,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1154,"num_objects_misplaced":2936,"num_objects_unfound":0,"num_objects_dirty":34387,"num_whiteouts":0,"num_read":2755,"num_read_kb":2507,"num_write":116299,"num_write_kb":4783849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13794,"num_bytes_recovered":863050632,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82032,"ondisk_log_size":82032,"up":414,"acting":412,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":417,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":656216064,"kb_used":11888248,"kb_used_data":7113536,"kb_used_omap":0,"kb_used_meta":4774463,"kb_avail":644327816,"statfs":{"total":671965249536,"available":659791683584,"internally_reserved":0,"allocated":7284260864,"data_stored":7274474124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":4889050164},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,2,3,2,7,5],"upper_bound":64},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-579141632,"num_objects":-8837,"num_object_clones":0,"num_object_copies":-26511,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":434,"num_objects_misplaced":-1139,"num_objects_unfound":0,"num_objects_dirty":-8837,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":8853,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":705,"num_bytes_recovered":46202880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.006381"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":68,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.294533+0000","last_change":"2024-02-19T21:49:54.492937+0000","last_active":"2024-02-19T21:52:34.294533+0000","last_peered":"2024-02-19T21:52:34.294533+0000","last_clean":"2024-02-19T21:52:34.294533+0000","last_became_active":"2024-02-19T21:49:54.492544+0000","last_became_peered":"2024-02-19T21:49:54.492544+0000","last_unstale":"2024-02-19T21:52:34.294533+0000","last_undegraded":"2024-02-19T21:52:34.294533+0000","last_fullsized":"2024-02-19T21:52:34.294533+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.643236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.643236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":447,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.283476+0000","last_change":"2024-02-19T21:45:17.201007+0000","last_active":"2024-02-19T21:52:34.283476+0000","last_peered":"2024-02-19T21:52:34.283476+0000","last_clean":"2024-02-19T21:52:34.283476+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:52:34.283476+0000","last_undegraded":"2024-02-19T21:52:34.283476+0000","last_fullsized":"2024-02-19T21:52:34.283476+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:17.200897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:17.200897+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"471'39","reported_seq":134,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.406266+0000","last_change":"2024-02-19T21:49:08.327817+0000","last_active":"2024-02-19T21:52:34.406266+0000","last_peered":"2024-02-19T21:52:34.406266+0000","last_clean":"2024-02-19T21:52:34.406266+0000","last_became_active":"2024-02-19T21:49:08.327416+0000","last_became_peered":"2024-02-19T21:49:08.327416+0000","last_unstale":"2024-02-19T21:52:34.406266+0000","last_undegraded":"2024-02-19T21:52:34.406266+0000","last_fullsized":"2024-02-19T21:52:34.406266+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'27","last_scrub_stamp":"2024-02-19T21:44:48.022013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:48.022013+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":420,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.286057+0000","last_change":"2024-02-19T21:48:30.516215+0000","last_active":"2024-02-19T21:52:34.286057+0000","last_peered":"2024-02-19T21:52:34.286057+0000","last_clean":"2024-02-19T21:52:34.286057+0000","last_became_active":"2024-02-19T21:47:46.250178+0000","last_became_peered":"2024-02-19T21:47:46.250178+0000","last_unstale":"2024-02-19T21:52:34.286057+0000","last_undegraded":"2024-02-19T21:52:34.286057+0000","last_fullsized":"2024-02-19T21:52:34.286057+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.516139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.516139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":143,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.283761+0000","last_change":"2024-02-19T21:49:08.330105+0000","last_active":"2024-02-19T21:52:34.283761+0000","last_peered":"2024-02-19T21:52:34.283761+0000","last_clean":"2024-02-19T21:52:34.283761+0000","last_became_active":"2024-02-19T21:49:08.328994+0000","last_became_peered":"2024-02-19T21:49:08.328994+0000","last_unstale":"2024-02-19T21:52:34.283761+0000","last_undegraded":"2024-02-19T21:52:34.283761+0000","last_fullsized":"2024-02-19T21:52:34.283761+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.636083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.636083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"470'25","reported_seq":525,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.285140+0000","last_change":"2024-02-19T21:48:26.530234+0000","last_active":"2024-02-19T21:52:34.285140+0000","last_peered":"2024-02-19T21:52:34.285140+0000","last_clean":"2024-02-19T21:52:34.285140+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:52:34.285140+0000","last_undegraded":"2024-02-19T21:52:34.285140+0000","last_fullsized":"2024-02-19T21:52:34.285140+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:48:26.530160+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.530160+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":204,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.291215+0000","last_change":"2024-02-19T21:49:08.332091+0000","last_active":"2024-02-19T21:52:34.291215+0000","last_peered":"2024-02-19T21:52:34.291215+0000","last_clean":"2024-02-19T21:52:34.291215+0000","last_became_active":"2024-02-19T21:49:08.331753+0000","last_became_peered":"2024-02-19T21:49:08.331753+0000","last_unstale":"2024-02-19T21:52:34.291215+0000","last_undegraded":"2024-02-19T21:52:34.291215+0000","last_fullsized":"2024-02-19T21:52:34.291215+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.005236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.005236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":460,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.317882+0000","last_change":"2024-02-19T21:48:28.327028+0000","last_active":"2024-02-19T21:52:34.317882+0000","last_peered":"2024-02-19T21:52:34.317882+0000","last_clean":"2024-02-19T21:52:34.317882+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:52:34.317882+0000","last_undegraded":"2024-02-19T21:52:34.317882+0000","last_fullsized":"2024-02-19T21:52:34.317882+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.326938+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"470'11","reported_seq":457,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.286449+0000","last_change":"2024-02-19T21:52:28.229053+0000","last_active":"2024-02-19T21:52:34.286449+0000","last_peered":"2024-02-19T21:52:34.286449+0000","last_clean":"2024-02-19T21:52:34.286449+0000","last_became_active":"2024-02-19T21:49:08.329314+0000","last_became_peered":"2024-02-19T21:49:08.329314+0000","last_unstale":"2024-02-19T21:52:34.286449+0000","last_undegraded":"2024-02-19T21:52:34.286449+0000","last_fullsized":"2024-02-19T21:52:34.286449+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"310'9","last_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_deep_scrub":"310'9","last_deep_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.506188+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":381,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.284799+0000","last_change":"2024-02-19T21:46:31.205220+0000","last_active":"2024-02-19T21:52:34.284799+0000","last_peered":"2024-02-19T21:52:34.284799+0000","last_clean":"2024-02-19T21:52:34.284799+0000","last_became_active":"2024-02-19T21:46:31.204816+0000","last_became_peered":"2024-02-19T21:46:31.204816+0000","last_unstale":"2024-02-19T21:52:34.284799+0000","last_undegraded":"2024-02-19T21:52:34.284799+0000","last_fullsized":"2024-02-19T21:52:34.284799+0000","mapping_epoch":330,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":331,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:36.890201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.890201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":482,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.297828+0000","last_change":"2024-02-19T21:49:08.330669+0000","last_active":"2024-02-19T21:52:34.297828+0000","last_peered":"2024-02-19T21:52:34.297828+0000","last_clean":"2024-02-19T21:52:34.297828+0000","last_became_active":"2024-02-19T21:49:08.329998+0000","last_became_peered":"2024-02-19T21:49:08.329998+0000","last_unstale":"2024-02-19T21:52:34.297828+0000","last_undegraded":"2024-02-19T21:52:34.297828+0000","last_fullsized":"2024-02-19T21:52:34.297828+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:58.329316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:58.329316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"470'25","reported_seq":335,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.286276+0000","last_change":"2024-02-19T21:49:08.326162+0000","last_active":"2024-02-19T21:52:34.286276+0000","last_peered":"2024-02-19T21:52:34.286276+0000","last_clean":"2024-02-19T21:52:34.286276+0000","last_became_active":"2024-02-19T21:49:08.325802+0000","last_became_peered":"2024-02-19T21:49:08.325802+0000","last_unstale":"2024-02-19T21:52:34.286276+0000","last_undegraded":"2024-02-19T21:52:34.286276+0000","last_fullsized":"2024-02-19T21:52:34.286276+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:46:54.873416+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:46:54.873416+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2],"acting":[4,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":392,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.289876+0000","last_change":"2024-02-19T21:49:04.432817+0000","last_active":"2024-02-19T21:52:34.289876+0000","last_peered":"2024-02-19T21:52:34.289876+0000","last_clean":"2024-02-19T21:52:34.289876+0000","last_became_active":"2024-02-19T21:47:33.393708+0000","last_became_peered":"2024-02-19T21:47:33.393708+0000","last_unstale":"2024-02-19T21:52:34.289876+0000","last_undegraded":"2024-02-19T21:52:34.289876+0000","last_fullsized":"2024-02-19T21:52:34.289876+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:04.432733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:04.432733+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":68,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.294602+0000","last_change":"2024-02-19T21:49:54.492767+0000","last_active":"2024-02-19T21:52:34.294602+0000","last_peered":"2024-02-19T21:52:34.294602+0000","last_clean":"2024-02-19T21:52:34.294602+0000","last_became_active":"2024-02-19T21:49:54.491745+0000","last_became_peered":"2024-02-19T21:49:54.491745+0000","last_unstale":"2024-02-19T21:52:34.294602+0000","last_undegraded":"2024-02-19T21:52:34.294602+0000","last_fullsized":"2024-02-19T21:52:34.294602+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.232539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.232539+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1d","version":"471'24","reported_seq":419,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.436920+0000","last_change":"2024-02-19T21:48:25.734661+0000","last_active":"2024-02-19T21:52:34.436920+0000","last_peered":"2024-02-19T21:52:34.436920+0000","last_clean":"2024-02-19T21:52:34.436920+0000","last_became_active":"2024-02-19T21:38:31.247067+0000","last_became_peered":"2024-02-19T21:38:31.247067+0000","last_unstale":"2024-02-19T21:52:34.436920+0000","last_undegraded":"2024-02-19T21:52:34.436920+0000","last_fullsized":"2024-02-19T21:52:34.436920+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'18","last_scrub_stamp":"2024-02-19T21:48:25.734591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.734591+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":33,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":447,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.285363+0000","last_change":"2024-02-19T21:48:40.528082+0000","last_active":"2024-02-19T21:52:34.285363+0000","last_peered":"2024-02-19T21:52:34.285363+0000","last_clean":"2024-02-19T21:52:34.285363+0000","last_became_active":"2024-02-19T21:44:58.788307+0000","last_became_peered":"2024-02-19T21:44:58.788307+0000","last_unstale":"2024-02-19T21:52:34.285363+0000","last_undegraded":"2024-02-19T21:52:34.285363+0000","last_fullsized":"2024-02-19T21:52:34.285363+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:40.527970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:48:40.527970+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":455,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.287822+0000","last_change":"2024-02-19T21:48:11.557832+0000","last_active":"2024-02-19T21:52:34.287822+0000","last_peered":"2024-02-19T21:52:34.287822+0000","last_clean":"2024-02-19T21:52:34.287822+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:52:34.287822+0000","last_undegraded":"2024-02-19T21:52:34.287822+0000","last_fullsized":"2024-02-19T21:52:34.287822+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.557736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:17.913620+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.557736+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"470'46","reported_seq":135,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.279511+0000","last_change":"2024-02-19T21:49:08.332575+0000","last_active":"2024-02-19T21:52:34.279511+0000","last_peered":"2024-02-19T21:52:34.279511+0000","last_clean":"2024-02-19T21:52:34.279511+0000","last_became_active":"2024-02-19T21:49:08.331742+0000","last_became_peered":"2024-02-19T21:49:08.331742+0000","last_unstale":"2024-02-19T21:52:34.279511+0000","last_undegraded":"2024-02-19T21:52:34.279511+0000","last_fullsized":"2024-02-19T21:52:34.279511+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'34","last_scrub_stamp":"2024-02-19T21:45:49.728734+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:45:49.728734+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":467,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.276493+0000","last_change":"2024-02-19T21:46:44.994389+0000","last_active":"2024-02-19T21:52:34.276493+0000","last_peered":"2024-02-19T21:52:34.276493+0000","last_clean":"2024-02-19T21:52:34.276493+0000","last_became_active":"2024-02-19T21:44:58.790669+0000","last_became_peered":"2024-02-19T21:44:58.790669+0000","last_unstale":"2024-02-19T21:52:34.276493+0000","last_undegraded":"2024-02-19T21:52:34.276493+0000","last_fullsized":"2024-02-19T21:52:34.276493+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.994296+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":403,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.281589+0000","last_change":"2024-02-19T21:49:08.330330+0000","last_active":"2024-02-19T21:52:34.281589+0000","last_peered":"2024-02-19T21:52:34.281589+0000","last_clean":"2024-02-19T21:52:34.281589+0000","last_became_active":"2024-02-19T21:49:08.329986+0000","last_became_peered":"2024-02-19T21:49:08.329986+0000","last_unstale":"2024-02-19T21:52:34.281589+0000","last_undegraded":"2024-02-19T21:52:34.281589+0000","last_fullsized":"2024-02-19T21:52:34.281589+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.091409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.091409+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"471'27","reported_seq":363,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.339487+0000","last_change":"2024-02-19T21:48:26.366639+0000","last_active":"2024-02-19T21:52:34.339487+0000","last_peered":"2024-02-19T21:52:34.339487+0000","last_clean":"2024-02-19T21:52:34.339487+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:52:34.339487+0000","last_undegraded":"2024-02-19T21:52:34.339487+0000","last_fullsized":"2024-02-19T21:52:34.339487+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:26.366563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.366563+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":36,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":328,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.298171+0000","last_change":"2024-02-19T21:51:22.461995+0000","last_active":"2024-02-19T21:52:34.298171+0000","last_peered":"2024-02-19T21:52:34.298171+0000","last_clean":"2024-02-19T21:52:34.298171+0000","last_became_active":"2024-02-19T21:51:22.461599+0000","last_became_peered":"2024-02-19T21:51:22.461599+0000","last_unstale":"2024-02-19T21:52:34.298171+0000","last_undegraded":"2024-02-19T21:52:34.298171+0000","last_fullsized":"2024-02-19T21:52:34.298171+0000","mapping_epoch":445,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":446,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:13.196112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:13.196112+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":467,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.291009+0000","last_change":"2024-02-19T21:49:54.491840+0000","last_active":"2024-02-19T21:52:34.291009+0000","last_peered":"2024-02-19T21:52:34.291009+0000","last_clean":"2024-02-19T21:52:34.291009+0000","last_became_active":"2024-02-19T21:49:54.491488+0000","last_became_peered":"2024-02-19T21:49:54.491488+0000","last_unstale":"2024-02-19T21:52:34.291009+0000","last_undegraded":"2024-02-19T21:52:34.291009+0000","last_fullsized":"2024-02-19T21:52:34.291009+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.803606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.803606+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"470'30","reported_seq":567,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.283836+0000","last_change":"2024-02-19T21:49:54.502402+0000","last_active":"2024-02-19T21:52:34.283836+0000","last_peered":"2024-02-19T21:52:34.283836+0000","last_clean":"2024-02-19T21:52:34.283836+0000","last_became_active":"2024-02-19T21:49:54.483748+0000","last_became_peered":"2024-02-19T21:49:54.483748+0000","last_unstale":"2024-02-19T21:52:34.283836+0000","last_undegraded":"2024-02-19T21:52:34.283836+0000","last_fullsized":"2024-02-19T21:52:34.283836+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:48:25.348437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.348437+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":387,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.284272+0000","last_change":"2024-02-19T21:49:08.328206+0000","last_active":"2024-02-19T21:52:34.284272+0000","last_peered":"2024-02-19T21:52:34.284272+0000","last_clean":"2024-02-19T21:52:34.284272+0000","last_became_active":"2024-02-19T21:49:08.327865+0000","last_became_peered":"2024-02-19T21:49:08.327865+0000","last_unstale":"2024-02-19T21:52:34.284272+0000","last_undegraded":"2024-02-19T21:52:34.284272+0000","last_fullsized":"2024-02-19T21:52:34.284272+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.230652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.230652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":447,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.296926+0000","last_change":"2024-02-19T21:48:22.171667+0000","last_active":"2024-02-19T21:52:34.296926+0000","last_peered":"2024-02-19T21:52:34.296926+0000","last_clean":"2024-02-19T21:52:34.296926+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:52:34.296926+0000","last_undegraded":"2024-02-19T21:52:34.296926+0000","last_fullsized":"2024-02-19T21:52:34.296926+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.171600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.171600+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":483,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.289935+0000","last_change":"2024-02-19T21:49:08.330636+0000","last_active":"2024-02-19T21:52:34.289935+0000","last_peered":"2024-02-19T21:52:34.289935+0000","last_clean":"2024-02-19T21:52:34.289935+0000","last_became_active":"2024-02-19T21:49:08.330293+0000","last_became_peered":"2024-02-19T21:49:08.330293+0000","last_unstale":"2024-02-19T21:52:34.289935+0000","last_undegraded":"2024-02-19T21:52:34.289935+0000","last_fullsized":"2024-02-19T21:52:34.289935+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:03.034839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:03.034839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"471'32","reported_seq":92,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.321380+0000","last_change":"2024-02-19T21:49:55.368481+0000","last_active":"2024-02-19T21:52:34.321380+0000","last_peered":"2024-02-19T21:52:34.321380+0000","last_clean":"2024-02-19T21:52:34.321380+0000","last_became_active":"2024-02-19T21:49:54.485438+0000","last_became_peered":"2024-02-19T21:49:54.485438+0000","last_unstale":"2024-02-19T21:52:34.321380+0000","last_undegraded":"2024-02-19T21:52:34.321380+0000","last_fullsized":"2024-02-19T21:52:34.321380+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"381'24","last_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_deep_scrub":"381'24","last_deep_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_clean_scrub_stamp":"2024-02-19T21:48:39.382725+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":36,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,5],"acting":[7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":475,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.298630+0000","last_change":"2024-02-19T21:49:17.193002+0000","last_active":"2024-02-19T21:52:34.298630+0000","last_peered":"2024-02-19T21:52:34.298630+0000","last_clean":"2024-02-19T21:52:34.298630+0000","last_became_active":"2024-02-19T21:49:08.333537+0000","last_became_peered":"2024-02-19T21:49:08.333537+0000","last_unstale":"2024-02-19T21:52:34.298630+0000","last_undegraded":"2024-02-19T21:52:34.298630+0000","last_fullsized":"2024-02-19T21:52:34.298630+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:59.339649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:45:59.339649+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":503,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.281652+0000","last_change":"2024-02-19T21:49:54.494561+0000","last_active":"2024-02-19T21:52:34.281652+0000","last_peered":"2024-02-19T21:52:34.281652+0000","last_clean":"2024-02-19T21:52:34.281652+0000","last_became_active":"2024-02-19T21:49:54.494146+0000","last_became_peered":"2024-02-19T21:49:54.494146+0000","last_unstale":"2024-02-19T21:52:34.281652+0000","last_undegraded":"2024-02-19T21:52:34.281652+0000","last_fullsized":"2024-02-19T21:52:34.281652+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.560066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":477,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.296951+0000","last_change":"2024-02-19T21:49:09.765641+0000","last_active":"2024-02-19T21:52:34.296951+0000","last_peered":"2024-02-19T21:52:34.296951+0000","last_clean":"2024-02-19T21:52:34.296951+0000","last_became_active":"2024-02-19T21:49:08.331308+0000","last_became_peered":"2024-02-19T21:49:08.331308+0000","last_unstale":"2024-02-19T21:52:34.296951+0000","last_undegraded":"2024-02-19T21:52:34.296951+0000","last_fullsized":"2024-02-19T21:52:34.296951+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.765568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.765568+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"470'12","reported_seq":170,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.275990+0000","last_change":"2024-02-19T21:47:33.577363+0000","last_active":"2024-02-19T21:52:34.275990+0000","last_peered":"2024-02-19T21:52:34.275990+0000","last_clean":"2024-02-19T21:52:34.275990+0000","last_became_active":"2024-02-19T21:47:33.395217+0000","last_became_peered":"2024-02-19T21:47:33.395217+0000","last_unstale":"2024-02-19T21:52:34.275990+0000","last_undegraded":"2024-02-19T21:52:34.275990+0000","last_fullsized":"2024-02-19T21:52:34.275990+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'8","last_scrub_stamp":"2024-02-19T21:46:47.761677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.761677+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":387,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.282958+0000","last_change":"2024-02-19T21:49:08.918163+0000","last_active":"2024-02-19T21:52:34.282958+0000","last_peered":"2024-02-19T21:52:34.282958+0000","last_clean":"2024-02-19T21:52:34.282958+0000","last_became_active":"2024-02-19T21:49:08.328416+0000","last_became_peered":"2024-02-19T21:49:08.328416+0000","last_unstale":"2024-02-19T21:52:34.282958+0000","last_undegraded":"2024-02-19T21:52:34.282958+0000","last_fullsized":"2024-02-19T21:52:34.282958+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.918083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.918083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":465,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.276496+0000","last_change":"2024-02-19T21:49:54.480716+0000","last_active":"2024-02-19T21:52:34.276496+0000","last_peered":"2024-02-19T21:52:34.276496+0000","last_clean":"2024-02-19T21:52:34.276496+0000","last_became_active":"2024-02-19T21:49:54.480368+0000","last_became_peered":"2024-02-19T21:49:54.480368+0000","last_unstale":"2024-02-19T21:52:34.276496+0000","last_undegraded":"2024-02-19T21:52:34.276496+0000","last_fullsized":"2024-02-19T21:52:34.276496+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:19.596775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:19.596775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":449,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.276652+0000","last_change":"2024-02-19T21:49:05.012463+0000","last_active":"2024-02-19T21:52:34.276652+0000","last_peered":"2024-02-19T21:52:34.276652+0000","last_clean":"2024-02-19T21:52:34.276652+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:52:34.276652+0000","last_undegraded":"2024-02-19T21:52:34.276652+0000","last_fullsized":"2024-02-19T21:52:34.276652+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.012395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.012395+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"470'27","reported_seq":508,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.286597+0000","last_change":"2024-02-19T21:48:38.529106+0000","last_active":"2024-02-19T21:52:34.286597+0000","last_peered":"2024-02-19T21:52:34.286597+0000","last_clean":"2024-02-19T21:52:34.286597+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:52:34.286597+0000","last_undegraded":"2024-02-19T21:52:34.286597+0000","last_fullsized":"2024-02-19T21:52:34.286597+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:38.528977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.528977+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":452,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.284300+0000","last_change":"2024-02-19T21:46:06.096531+0000","last_active":"2024-02-19T21:52:34.284300+0000","last_peered":"2024-02-19T21:52:34.284300+0000","last_clean":"2024-02-19T21:52:34.284300+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:52:34.284300+0000","last_undegraded":"2024-02-19T21:52:34.284300+0000","last_fullsized":"2024-02-19T21:52:34.284300+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.096422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":263,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.289547+0000","last_change":"2024-02-19T21:48:38.391532+0000","last_active":"2024-02-19T21:52:34.289547+0000","last_peered":"2024-02-19T21:52:34.289547+0000","last_clean":"2024-02-19T21:52:34.289547+0000","last_became_active":"2024-02-19T21:47:33.395085+0000","last_became_peered":"2024-02-19T21:47:33.395085+0000","last_unstale":"2024-02-19T21:52:34.289547+0000","last_undegraded":"2024-02-19T21:52:34.289547+0000","last_fullsized":"2024-02-19T21:52:34.289547+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:38.391435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.391435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":464,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.289839+0000","last_change":"2024-02-19T21:48:14.600378+0000","last_active":"2024-02-19T21:52:34.289839+0000","last_peered":"2024-02-19T21:52:34.289839+0000","last_clean":"2024-02-19T21:52:34.289839+0000","last_became_active":"2024-02-19T21:47:33.393932+0000","last_became_peered":"2024-02-19T21:47:33.393932+0000","last_unstale":"2024-02-19T21:52:34.289839+0000","last_undegraded":"2024-02-19T21:52:34.289839+0000","last_fullsized":"2024-02-19T21:52:34.289839+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:14.600285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.600285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"470'21","reported_seq":527,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.276344+0000","last_change":"2024-02-19T21:49:08.334199+0000","last_active":"2024-02-19T21:52:34.276344+0000","last_peered":"2024-02-19T21:52:34.276344+0000","last_clean":"2024-02-19T21:52:34.276344+0000","last_became_active":"2024-02-19T21:49:08.333872+0000","last_became_peered":"2024-02-19T21:49:08.333872+0000","last_unstale":"2024-02-19T21:52:34.276344+0000","last_undegraded":"2024-02-19T21:52:34.276344+0000","last_fullsized":"2024-02-19T21:52:34.276344+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:45:08.678669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:08.678669+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":430,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.285560+0000","last_change":"2024-02-19T21:49:08.330114+0000","last_active":"2024-02-19T21:52:34.285560+0000","last_peered":"2024-02-19T21:52:34.285560+0000","last_clean":"2024-02-19T21:52:34.285560+0000","last_became_active":"2024-02-19T21:49:08.329770+0000","last_became_peered":"2024-02-19T21:49:08.329770+0000","last_unstale":"2024-02-19T21:52:34.285560+0000","last_undegraded":"2024-02-19T21:52:34.285560+0000","last_fullsized":"2024-02-19T21:52:34.285560+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:08.983923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.983923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"415'17","reported_seq":106,"reported_epoch":472,"state":"active+clean","last_fresh":"2024-02-19T21:52:37.110868+0000","last_change":"2024-02-19T21:50:49.705247+0000","last_active":"2024-02-19T21:52:37.110868+0000","last_peered":"2024-02-19T21:52:37.110868+0000","last_clean":"2024-02-19T21:52:37.110868+0000","last_became_active":"2024-02-19T21:49:54.486304+0000","last_became_peered":"2024-02-19T21:49:54.486304+0000","last_unstale":"2024-02-19T21:52:37.110868+0000","last_undegraded":"2024-02-19T21:52:37.110868+0000","last_fullsized":"2024-02-19T21:52:37.110868+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"199'13","last_scrub_stamp":"2024-02-19T21:45:05.721709+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:45:05.721709+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":474,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.284367+0000","last_change":"2024-02-19T21:49:54.484516+0000","last_active":"2024-02-19T21:52:34.284367+0000","last_peered":"2024-02-19T21:52:34.284367+0000","last_clean":"2024-02-19T21:52:34.284367+0000","last_became_active":"2024-02-19T21:49:54.483689+0000","last_became_peered":"2024-02-19T21:49:54.483689+0000","last_unstale":"2024-02-19T21:52:34.284367+0000","last_undegraded":"2024-02-19T21:52:34.284367+0000","last_fullsized":"2024-02-19T21:52:34.284367+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.157478+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"470'25","reported_seq":504,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.298780+0000","last_change":"2024-02-19T21:48:27.720048+0000","last_active":"2024-02-19T21:52:34.298780+0000","last_peered":"2024-02-19T21:52:34.298780+0000","last_clean":"2024-02-19T21:52:34.298780+0000","last_became_active":"2024-02-19T21:47:33.398295+0000","last_became_peered":"2024-02-19T21:47:33.398295+0000","last_unstale":"2024-02-19T21:52:34.298780+0000","last_undegraded":"2024-02-19T21:52:34.298780+0000","last_fullsized":"2024-02-19T21:52:34.298780+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:27.719954+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:48:27.719954+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":191,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.283589+0000","last_change":"2024-02-19T21:49:54.484392+0000","last_active":"2024-02-19T21:52:34.283589+0000","last_peered":"2024-02-19T21:52:34.283589+0000","last_clean":"2024-02-19T21:52:34.283589+0000","last_became_active":"2024-02-19T21:49:54.484049+0000","last_became_peered":"2024-02-19T21:49:54.484049+0000","last_unstale":"2024-02-19T21:52:34.283589+0000","last_undegraded":"2024-02-19T21:52:34.283589+0000","last_fullsized":"2024-02-19T21:52:34.283589+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.121769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.121769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":698,"reported_epoch":472,"state":"active+clean","last_fresh":"2024-02-19T21:52:37.111071+0000","last_change":"2024-02-19T21:48:38.723220+0000","last_active":"2024-02-19T21:52:37.111071+0000","last_peered":"2024-02-19T21:52:37.111071+0000","last_clean":"2024-02-19T21:52:37.111071+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:52:37.111071+0000","last_undegraded":"2024-02-19T21:52:37.111071+0000","last_fullsized":"2024-02-19T21:52:37.111071+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:48:38.723151+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.723151+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":478,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.291757+0000","last_change":"2024-02-19T21:49:54.485462+0000","last_active":"2024-02-19T21:52:34.291757+0000","last_peered":"2024-02-19T21:52:34.291757+0000","last_clean":"2024-02-19T21:52:34.291757+0000","last_became_active":"2024-02-19T21:49:54.485121+0000","last_became_peered":"2024-02-19T21:49:54.485121+0000","last_unstale":"2024-02-19T21:52:34.291757+0000","last_undegraded":"2024-02-19T21:52:34.291757+0000","last_fullsized":"2024-02-19T21:52:34.291757+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:07.724097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:49:07.724097+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"470'35","reported_seq":371,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.277850+0000","last_change":"2024-02-19T21:49:08.335077+0000","last_active":"2024-02-19T21:52:34.277850+0000","last_peered":"2024-02-19T21:52:34.277850+0000","last_clean":"2024-02-19T21:52:34.277850+0000","last_became_active":"2024-02-19T21:49:08.334061+0000","last_became_peered":"2024-02-19T21:49:08.334061+0000","last_unstale":"2024-02-19T21:52:34.277850+0000","last_undegraded":"2024-02-19T21:52:34.277850+0000","last_fullsized":"2024-02-19T21:52:34.277850+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'25","last_scrub_stamp":"2024-02-19T21:46:07.553690+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.553690+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":447,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.317838+0000","last_change":"2024-02-19T21:48:21.256471+0000","last_active":"2024-02-19T21:52:34.317838+0000","last_peered":"2024-02-19T21:52:34.317838+0000","last_clean":"2024-02-19T21:52:34.317838+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:52:34.317838+0000","last_undegraded":"2024-02-19T21:52:34.317838+0000","last_fullsized":"2024-02-19T21:52:34.317838+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.256358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.256358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":454,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.281713+0000","last_change":"2024-02-19T21:46:35.035136+0000","last_active":"2024-02-19T21:52:34.281713+0000","last_peered":"2024-02-19T21:52:34.281713+0000","last_clean":"2024-02-19T21:52:34.281713+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:52:34.281713+0000","last_undegraded":"2024-02-19T21:52:34.281713+0000","last_fullsized":"2024-02-19T21:52:34.281713+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:35.035042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:35.035042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"470'18","reported_seq":85,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.317786+0000","last_change":"2024-02-19T21:50:49.700758+0000","last_active":"2024-02-19T21:52:34.317786+0000","last_peered":"2024-02-19T21:52:34.317786+0000","last_clean":"2024-02-19T21:52:34.317786+0000","last_became_active":"2024-02-19T21:49:54.478094+0000","last_became_peered":"2024-02-19T21:49:54.478094+0000","last_unstale":"2024-02-19T21:52:34.317786+0000","last_undegraded":"2024-02-19T21:52:34.317786+0000","last_fullsized":"2024-02-19T21:52:34.317786+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'12","last_scrub_stamp":"2024-02-19T21:49:08.912638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.912638+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":23,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":100,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.279590+0000","last_change":"2024-02-19T21:49:08.332757+0000","last_active":"2024-02-19T21:52:34.279590+0000","last_peered":"2024-02-19T21:52:34.279590+0000","last_clean":"2024-02-19T21:52:34.279590+0000","last_became_active":"2024-02-19T21:49:08.332176+0000","last_became_peered":"2024-02-19T21:49:08.332176+0000","last_unstale":"2024-02-19T21:52:34.279590+0000","last_undegraded":"2024-02-19T21:52:34.279590+0000","last_fullsized":"2024-02-19T21:52:34.279590+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:47:01.365477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:47:01.365477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":100,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.278798+0000","last_change":"2024-02-19T21:49:08.328632+0000","last_active":"2024-02-19T21:52:34.278798+0000","last_peered":"2024-02-19T21:52:34.278798+0000","last_clean":"2024-02-19T21:52:34.278798+0000","last_became_active":"2024-02-19T21:49:08.327826+0000","last_became_peered":"2024-02-19T21:49:08.327826+0000","last_unstale":"2024-02-19T21:52:34.278798+0000","last_undegraded":"2024-02-19T21:52:34.278798+0000","last_fullsized":"2024-02-19T21:52:34.278798+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:09.645607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:44:09.645607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"470'21","reported_seq":589,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.283702+0000","last_change":"2024-02-19T21:50:49.704824+0000","last_active":"2024-02-19T21:52:34.283702+0000","last_peered":"2024-02-19T21:52:34.283702+0000","last_clean":"2024-02-19T21:52:34.283702+0000","last_became_active":"2024-02-19T21:49:54.483578+0000","last_became_peered":"2024-02-19T21:49:54.483578+0000","last_unstale":"2024-02-19T21:52:34.283702+0000","last_undegraded":"2024-02-19T21:52:34.283702+0000","last_fullsized":"2024-02-19T21:52:34.283702+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:44:53.072746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:53.072746+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"472'7333","reported_seq":9657,"reported_epoch":472,"state":"active+clean","last_fresh":"2024-02-19T21:52:45.124438+0000","last_change":"2024-02-19T21:52:28.102395+0000","last_active":"2024-02-19T21:52:45.124438+0000","last_peered":"2024-02-19T21:52:45.124438+0000","last_clean":"2024-02-19T21:52:45.124438+0000","last_became_active":"2024-02-19T21:52:28.061558+0000","last_became_peered":"2024-02-19T21:52:28.061558+0000","last_unstale":"2024-02-19T21:52:45.124438+0000","last_undegraded":"2024-02-19T21:52:45.124438+0000","last_fullsized":"2024-02-19T21:52:45.124438+0000","mapping_epoch":467,"log_start":"404'2400","ondisk_log_start":"404'2400","created":385,"last_epoch_clean":468,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4933,"ondisk_log_size":4933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":140181504,"num_objects":2139,"num_object_clones":0,"num_object_copies":6417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7333,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1108,"num_bytes_recovered":61734912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":68,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.294455+0000","last_change":"2024-02-19T21:49:54.492844+0000","last_active":"2024-02-19T21:52:34.294455+0000","last_peered":"2024-02-19T21:52:34.294455+0000","last_clean":"2024-02-19T21:52:34.294455+0000","last_became_active":"2024-02-19T21:49:54.492156+0000","last_became_peered":"2024-02-19T21:49:54.492156+0000","last_unstale":"2024-02-19T21:52:34.294455+0000","last_undegraded":"2024-02-19T21:52:34.294455+0000","last_fullsized":"2024-02-19T21:52:34.294455+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:04.692807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.692807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"378'4","reported_seq":486,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.285762+0000","last_change":"2024-02-19T21:48:28.510929+0000","last_active":"2024-02-19T21:52:34.285762+0000","last_peered":"2024-02-19T21:52:34.285762+0000","last_clean":"2024-02-19T21:52:34.285762+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:52:34.285762+0000","last_undegraded":"2024-02-19T21:52:34.285762+0000","last_fullsized":"2024-02-19T21:52:34.285762+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"378'4","last_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_deep_scrub":"378'4","last_deep_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.510849+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"470'29","reported_seq":342,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.285870+0000","last_change":"2024-02-19T21:48:22.519465+0000","last_active":"2024-02-19T21:52:34.285870+0000","last_peered":"2024-02-19T21:52:34.285870+0000","last_clean":"2024-02-19T21:52:34.285870+0000","last_became_active":"2024-02-19T21:47:46.252085+0000","last_became_peered":"2024-02-19T21:47:46.252085+0000","last_unstale":"2024-02-19T21:52:34.285870+0000","last_undegraded":"2024-02-19T21:52:34.285870+0000","last_fullsized":"2024-02-19T21:52:34.285870+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'23","last_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_deep_scrub":"200'23","last_deep_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.519381+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":33,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6],"acting":[4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":100,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.278834+0000","last_change":"2024-02-19T21:49:08.328855+0000","last_active":"2024-02-19T21:52:34.278834+0000","last_peered":"2024-02-19T21:52:34.278834+0000","last_clean":"2024-02-19T21:52:34.278834+0000","last_became_active":"2024-02-19T21:49:08.328237+0000","last_became_peered":"2024-02-19T21:49:08.328237+0000","last_unstale":"2024-02-19T21:52:34.278834+0000","last_undegraded":"2024-02-19T21:52:34.278834+0000","last_fullsized":"2024-02-19T21:52:34.278834+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:58.047556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:58.047556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"472'7033","reported_seq":7126,"reported_epoch":472,"state":"active+clean","last_fresh":"2024-02-19T21:52:44.826513+0000","last_change":"2024-02-19T21:48:47.778295+0000","last_active":"2024-02-19T21:52:44.826513+0000","last_peered":"2024-02-19T21:52:44.826513+0000","last_clean":"2024-02-19T21:52:44.826513+0000","last_became_active":"2024-02-19T21:48:47.777964+0000","last_became_peered":"2024-02-19T21:48:47.777964+0000","last_unstale":"2024-02-19T21:52:44.826513+0000","last_undegraded":"2024-02-19T21:52:44.826513+0000","last_fullsized":"2024-02-19T21:52:44.826513+0000","mapping_epoch":385,"log_start":"404'2300","ondisk_log_start":"404'2300","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4733,"ondisk_log_size":4733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":138739712,"num_objects":2117,"num_object_clones":0,"num_object_copies":6351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7033,"num_write_kb":292800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":501,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.284388+0000","last_change":"2024-02-19T21:49:08.328019+0000","last_active":"2024-02-19T21:52:34.284388+0000","last_peered":"2024-02-19T21:52:34.284388+0000","last_clean":"2024-02-19T21:52:34.284388+0000","last_became_active":"2024-02-19T21:49:08.327581+0000","last_became_peered":"2024-02-19T21:49:08.327581+0000","last_unstale":"2024-02-19T21:52:34.284388+0000","last_undegraded":"2024-02-19T21:52:34.284388+0000","last_fullsized":"2024-02-19T21:52:34.284388+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:22.180593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:45:22.180593+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5],"acting":[0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":447,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.277716+0000","last_change":"2024-02-19T21:48:37.789514+0000","last_active":"2024-02-19T21:52:34.277716+0000","last_peered":"2024-02-19T21:52:34.277716+0000","last_clean":"2024-02-19T21:52:34.277716+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:52:34.277716+0000","last_undegraded":"2024-02-19T21:52:34.277716+0000","last_fullsized":"2024-02-19T21:52:34.277716+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:37.789400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:37.789400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"470'30","reported_seq":368,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.276419+0000","last_change":"2024-02-19T21:45:57.877936+0000","last_active":"2024-02-19T21:52:34.276419+0000","last_peered":"2024-02-19T21:52:34.276419+0000","last_clean":"2024-02-19T21:52:34.276419+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:52:34.276419+0000","last_undegraded":"2024-02-19T21:52:34.276419+0000","last_fullsized":"2024-02-19T21:52:34.276419+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:45:57.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:57.877856+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":702,"reported_epoch":472,"state":"active+clean","last_fresh":"2024-02-19T21:52:37.106467+0000","last_change":"2024-02-19T21:49:01.011149+0000","last_active":"2024-02-19T21:52:37.106467+0000","last_peered":"2024-02-19T21:52:37.106467+0000","last_clean":"2024-02-19T21:52:37.106467+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:52:37.106467+0000","last_undegraded":"2024-02-19T21:52:37.106467+0000","last_fullsized":"2024-02-19T21:52:37.106467+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:49:01.011078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:49:01.011078+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.a","version":"472'7259","reported_seq":7354,"reported_epoch":472,"state":"active+clean","last_fresh":"2024-02-19T21:52:45.141849+0000","last_change":"2024-02-19T21:48:47.778138+0000","last_active":"2024-02-19T21:52:45.141849+0000","last_peered":"2024-02-19T21:52:45.141849+0000","last_clean":"2024-02-19T21:52:45.141849+0000","last_became_active":"2024-02-19T21:48:47.777820+0000","last_became_peered":"2024-02-19T21:48:47.777820+0000","last_unstale":"2024-02-19T21:52:45.141849+0000","last_undegraded":"2024-02-19T21:52:45.141849+0000","last_fullsized":"2024-02-19T21:52:45.141849+0000","mapping_epoch":385,"log_start":"404'2400","ondisk_log_start":"404'2400","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4859,"ondisk_log_size":4859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":139919360,"num_objects":2135,"num_object_clones":0,"num_object_copies":6405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2135,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7259,"num_write_kb":300608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":396,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.286316+0000","last_change":"2024-02-19T21:48:33.478821+0000","last_active":"2024-02-19T21:52:34.286316+0000","last_peered":"2024-02-19T21:52:34.286316+0000","last_clean":"2024-02-19T21:52:34.286316+0000","last_became_active":"2024-02-19T21:44:56.149476+0000","last_became_peered":"2024-02-19T21:44:56.149476+0000","last_unstale":"2024-02-19T21:52:34.286316+0000","last_undegraded":"2024-02-19T21:52:34.286316+0000","last_fullsized":"2024-02-19T21:52:34.286316+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:33.478715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:48:33.478715+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":457,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.291873+0000","last_change":"2024-02-19T21:46:41.834315+0000","last_active":"2024-02-19T21:52:34.291873+0000","last_peered":"2024-02-19T21:52:34.291873+0000","last_clean":"2024-02-19T21:52:34.291873+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:52:34.291873+0000","last_undegraded":"2024-02-19T21:52:34.291873+0000","last_fullsized":"2024-02-19T21:52:34.291873+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:41.834246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:46:41.834246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"470'58","reported_seq":910,"reported_epoch":472,"state":"active+clean","last_fresh":"2024-02-19T21:52:37.106854+0000","last_change":"2024-02-19T21:49:08.335296+0000","last_active":"2024-02-19T21:52:37.106854+0000","last_peered":"2024-02-19T21:52:37.106854+0000","last_clean":"2024-02-19T21:52:37.106854+0000","last_became_active":"2024-02-19T21:49:08.334527+0000","last_became_peered":"2024-02-19T21:49:08.334527+0000","last_unstale":"2024-02-19T21:52:37.106854+0000","last_undegraded":"2024-02-19T21:52:37.106854+0000","last_fullsized":"2024-02-19T21:52:37.106854+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'43","last_scrub_stamp":"2024-02-19T21:45:04.755444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.755444+0000","log_size":58,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":50,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":443,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.283496+0000","last_change":"2024-02-19T21:46:45.252437+0000","last_active":"2024-02-19T21:52:34.283496+0000","last_peered":"2024-02-19T21:52:34.283496+0000","last_clean":"2024-02-19T21:52:34.283496+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:52:34.283496+0000","last_undegraded":"2024-02-19T21:52:34.283496+0000","last_fullsized":"2024-02-19T21:52:34.283496+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.252344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.252344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"472'7236","reported_seq":11521,"reported_epoch":472,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:52:45.329330+0000","last_change":"2024-02-19T21:52:18.427835+0000","last_active":"2024-02-19T21:52:45.329330+0000","last_peered":"2024-02-19T21:52:45.329330+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:55.752599+0000","last_became_peered":"2024-02-19T21:49:55.752599+0000","last_unstale":"2024-02-19T21:52:45.329330+0000","last_undegraded":"2024-02-19T21:52:18.425538+0000","last_fullsized":"2024-02-19T21:49:55.470938+0000","mapping_epoch":414,"log_start":"402'2000","ondisk_log_start":"402'2000","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5236,"ondisk_log_size":5236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":132644864,"num_objects":2024,"num_object_clones":0,"num_object_copies":6072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1096,"num_objects_misplaced":1426,"num_objects_unfound":0,"num_objects_dirty":2024,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7236,"num_write_kb":296320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1511,"num_bytes_recovered":99024896,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2],"avail_no_missing":["5","2","4"],"object_location_counts":[{"shards":"2,4,5","objects":1426},{"shards":"2,5","objects":-498}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":471,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.317959+0000","last_change":"2024-02-19T21:49:09.227437+0000","last_active":"2024-02-19T21:52:34.317959+0000","last_peered":"2024-02-19T21:52:34.317959+0000","last_clean":"2024-02-19T21:52:34.317959+0000","last_became_active":"2024-02-19T21:49:08.328437+0000","last_became_peered":"2024-02-19T21:49:08.328437+0000","last_unstale":"2024-02-19T21:52:34.317959+0000","last_undegraded":"2024-02-19T21:52:34.317959+0000","last_fullsized":"2024-02-19T21:52:34.317959+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.227355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.227355+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'6","reported_seq":1755,"reported_epoch":472,"state":"active+clean","last_fresh":"2024-02-19T21:52:43.788170+0000","last_change":"2024-02-19T21:52:29.904113+0000","last_active":"2024-02-19T21:52:43.788170+0000","last_peered":"2024-02-19T21:52:43.788170+0000","last_clean":"2024-02-19T21:52:43.788170+0000","last_became_active":"2024-02-19T21:49:08.331108+0000","last_became_peered":"2024-02-19T21:49:08.331108+0000","last_unstale":"2024-02-19T21:52:43.788170+0000","last_undegraded":"2024-02-19T21:52:43.788170+0000","last_fullsized":"2024-02-19T21:52:43.788170+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_clean_scrub_stamp":"2024-02-19T21:44:13.678341+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1201,"num_read_kb":1196,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":100,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.280078+0000","last_change":"2024-02-19T21:49:08.329710+0000","last_active":"2024-02-19T21:52:34.280078+0000","last_peered":"2024-02-19T21:52:34.280078+0000","last_clean":"2024-02-19T21:52:34.280078+0000","last_became_active":"2024-02-19T21:49:08.329378+0000","last_became_peered":"2024-02-19T21:49:08.329378+0000","last_unstale":"2024-02-19T21:52:34.280078+0000","last_undegraded":"2024-02-19T21:52:34.280078+0000","last_fullsized":"2024-02-19T21:52:34.280078+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:55.195394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.195394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"470'21","reported_seq":510,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.277251+0000","last_change":"2024-02-19T21:48:14.878933+0000","last_active":"2024-02-19T21:52:34.277251+0000","last_peered":"2024-02-19T21:52:34.277251+0000","last_clean":"2024-02-19T21:52:34.277251+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:52:34.277251+0000","last_undegraded":"2024-02-19T21:52:34.277251+0000","last_fullsized":"2024-02-19T21:52:34.277251+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'17","last_scrub_stamp":"2024-02-19T21:48:14.878857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.878857+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":31,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":100,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.280771+0000","last_change":"2024-02-19T21:49:08.325478+0000","last_active":"2024-02-19T21:52:34.280771+0000","last_peered":"2024-02-19T21:52:34.280771+0000","last_clean":"2024-02-19T21:52:34.280771+0000","last_became_active":"2024-02-19T21:49:08.325127+0000","last_became_peered":"2024-02-19T21:49:08.325127+0000","last_unstale":"2024-02-19T21:52:34.280771+0000","last_undegraded":"2024-02-19T21:52:34.280771+0000","last_fullsized":"2024-02-19T21:52:34.280771+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:10.871111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:10.871111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"472'7315","reported_seq":7410,"reported_epoch":472,"state":"active+clean","last_fresh":"2024-02-19T21:52:45.133618+0000","last_change":"2024-02-19T21:48:47.778829+0000","last_active":"2024-02-19T21:52:45.133618+0000","last_peered":"2024-02-19T21:52:45.133618+0000","last_clean":"2024-02-19T21:52:45.133618+0000","last_became_active":"2024-02-19T21:48:47.778486+0000","last_became_peered":"2024-02-19T21:48:47.778486+0000","last_unstale":"2024-02-19T21:52:45.133618+0000","last_undegraded":"2024-02-19T21:52:45.133618+0000","last_fullsized":"2024-02-19T21:52:45.133618+0000","mapping_epoch":385,"log_start":"403'2400","ondisk_log_start":"403'2400","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4915,"ondisk_log_size":4915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":140574720,"num_objects":2145,"num_object_clones":0,"num_object_copies":6435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2145,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7315,"num_write_kb":302720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":474,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.299601+0000","last_change":"2024-02-19T21:47:33.400407+0000","last_active":"2024-02-19T21:52:34.299601+0000","last_peered":"2024-02-19T21:52:34.299601+0000","last_clean":"2024-02-19T21:52:34.299601+0000","last_became_active":"2024-02-19T21:47:33.400075+0000","last_became_peered":"2024-02-19T21:47:33.400075+0000","last_unstale":"2024-02-19T21:52:34.299601+0000","last_undegraded":"2024-02-19T21:52:34.299601+0000","last_fullsized":"2024-02-19T21:52:34.299601+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.035136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":352,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.291985+0000","last_change":"2024-02-19T21:49:05.746443+0000","last_active":"2024-02-19T21:52:34.291985+0000","last_peered":"2024-02-19T21:52:34.291985+0000","last_clean":"2024-02-19T21:52:34.291985+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:52:34.291985+0000","last_undegraded":"2024-02-19T21:52:34.291985+0000","last_fullsized":"2024-02-19T21:52:34.291985+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.746358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.746358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":504,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.298662+0000","last_change":"2024-02-19T21:49:54.485252+0000","last_active":"2024-02-19T21:52:34.298662+0000","last_peered":"2024-02-19T21:52:34.298662+0000","last_clean":"2024-02-19T21:52:34.298662+0000","last_became_active":"2024-02-19T21:49:54.484956+0000","last_became_peered":"2024-02-19T21:49:54.484956+0000","last_unstale":"2024-02-19T21:52:34.298662+0000","last_undegraded":"2024-02-19T21:52:34.298662+0000","last_fullsized":"2024-02-19T21:52:34.298662+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:07.901205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:07.901205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":68,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.296464+0000","last_change":"2024-02-19T21:49:54.483990+0000","last_active":"2024-02-19T21:52:34.296464+0000","last_peered":"2024-02-19T21:52:34.296464+0000","last_clean":"2024-02-19T21:52:34.296464+0000","last_became_active":"2024-02-19T21:49:54.483637+0000","last_became_peered":"2024-02-19T21:49:54.483637+0000","last_unstale":"2024-02-19T21:52:34.296464+0000","last_undegraded":"2024-02-19T21:52:34.296464+0000","last_fullsized":"2024-02-19T21:52:34.296464+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.190177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.190177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"470'45","reported_seq":515,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.289489+0000","last_change":"2024-02-19T21:46:47.970066+0000","last_active":"2024-02-19T21:52:34.289489+0000","last_peered":"2024-02-19T21:52:34.289489+0000","last_clean":"2024-02-19T21:52:34.289489+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:52:34.289489+0000","last_undegraded":"2024-02-19T21:52:34.289489+0000","last_fullsized":"2024-02-19T21:52:34.289489+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'33","last_scrub_stamp":"2024-02-19T21:46:47.969961+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.969961+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":51,"num_write":37,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":68,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.297982+0000","last_change":"2024-02-19T21:49:54.478276+0000","last_active":"2024-02-19T21:52:34.297982+0000","last_peered":"2024-02-19T21:52:34.297982+0000","last_clean":"2024-02-19T21:52:34.297982+0000","last_became_active":"2024-02-19T21:49:54.477947+0000","last_became_peered":"2024-02-19T21:49:54.477947+0000","last_unstale":"2024-02-19T21:52:34.297982+0000","last_undegraded":"2024-02-19T21:52:34.297982+0000","last_fullsized":"2024-02-19T21:52:34.297982+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:57.754453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:57.754453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"472'7074","reported_seq":17310,"reported_epoch":472,"state":"active+clean","last_fresh":"2024-02-19T21:52:44.826944+0000","last_change":"2024-02-19T21:51:22.472713+0000","last_active":"2024-02-19T21:52:44.826944+0000","last_peered":"2024-02-19T21:52:44.826944+0000","last_clean":"2024-02-19T21:52:44.826944+0000","last_became_active":"2024-02-19T21:51:22.462974+0000","last_became_peered":"2024-02-19T21:51:22.462974+0000","last_unstale":"2024-02-19T21:52:44.826944+0000","last_undegraded":"2024-02-19T21:52:44.826944+0000","last_fullsized":"2024-02-19T21:52:44.826944+0000","mapping_epoch":445,"log_start":"402'1900","ondisk_log_start":"402'1900","created":385,"last_epoch_clean":446,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5174,"ondisk_log_size":5174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":139067392,"num_objects":2122,"num_object_clones":0,"num_object_copies":6366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7074,"num_write_kb":294272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5054,"num_bytes_recovered":320077824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7],"acting":[0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":445,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.277996+0000","last_change":"2024-02-19T21:45:47.723650+0000","last_active":"2024-02-19T21:52:34.277996+0000","last_peered":"2024-02-19T21:52:34.277996+0000","last_clean":"2024-02-19T21:52:34.277996+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:52:34.277996+0000","last_undegraded":"2024-02-19T21:52:34.277996+0000","last_fullsized":"2024-02-19T21:52:34.277996+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.723550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.723550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":456,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.282911+0000","last_change":"2024-02-19T21:45:51.243726+0000","last_active":"2024-02-19T21:52:34.282911+0000","last_peered":"2024-02-19T21:52:34.282911+0000","last_clean":"2024-02-19T21:52:34.282911+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:52:34.282911+0000","last_undegraded":"2024-02-19T21:52:34.282911+0000","last_fullsized":"2024-02-19T21:52:34.282911+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:51.243656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:51.243656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":473,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.296713+0000","last_change":"2024-02-19T21:48:23.218358+0000","last_active":"2024-02-19T21:52:34.296713+0000","last_peered":"2024-02-19T21:52:34.296713+0000","last_clean":"2024-02-19T21:52:34.296713+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:52:34.296713+0000","last_undegraded":"2024-02-19T21:52:34.296713+0000","last_fullsized":"2024-02-19T21:52:34.296713+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:23.218282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.218282+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"470'42","reported_seq":618,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.283647+0000","last_change":"2024-02-19T21:49:08.330490+0000","last_active":"2024-02-19T21:52:34.283647+0000","last_peered":"2024-02-19T21:52:34.283647+0000","last_clean":"2024-02-19T21:52:34.283647+0000","last_became_active":"2024-02-19T21:49:08.329761+0000","last_became_peered":"2024-02-19T21:49:08.329761+0000","last_unstale":"2024-02-19T21:52:34.283647+0000","last_undegraded":"2024-02-19T21:52:34.283647+0000","last_fullsized":"2024-02-19T21:52:34.283647+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'30","last_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_deep_scrub":"324'30","last_deep_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.110965+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":48,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":458,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.299524+0000","last_change":"2024-02-19T21:45:09.918263+0000","last_active":"2024-02-19T21:52:34.299524+0000","last_peered":"2024-02-19T21:52:34.299524+0000","last_clean":"2024-02-19T21:52:34.299524+0000","last_became_active":"2024-02-19T21:44:42.624782+0000","last_became_peered":"2024-02-19T21:44:42.624782+0000","last_unstale":"2024-02-19T21:52:34.299524+0000","last_undegraded":"2024-02-19T21:52:34.299524+0000","last_fullsized":"2024-02-19T21:52:34.299524+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":295,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_clean_scrub_stamp":"2024-02-19T21:45:09.918170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"472'7151","reported_seq":7247,"reported_epoch":472,"state":"active+clean","last_fresh":"2024-02-19T21:52:45.134310+0000","last_change":"2024-02-19T21:48:47.777963+0000","last_active":"2024-02-19T21:52:45.134310+0000","last_peered":"2024-02-19T21:52:45.134310+0000","last_clean":"2024-02-19T21:52:45.134310+0000","last_became_active":"2024-02-19T21:48:47.777644+0000","last_became_peered":"2024-02-19T21:48:47.777644+0000","last_unstale":"2024-02-19T21:52:45.134310+0000","last_undegraded":"2024-02-19T21:52:45.134310+0000","last_fullsized":"2024-02-19T21:52:45.134310+0000","mapping_epoch":385,"log_start":"403'2300","ondisk_log_start":"403'2300","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4851,"ondisk_log_size":4851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":138805272,"num_objects":2119,"num_object_clones":0,"num_object_copies":6357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2119,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7151,"num_write_kb":296577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":478,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.275930+0000","last_change":"2024-02-19T21:49:08.331080+0000","last_active":"2024-02-19T21:52:34.275930+0000","last_peered":"2024-02-19T21:52:34.275930+0000","last_clean":"2024-02-19T21:52:34.275930+0000","last_became_active":"2024-02-19T21:49:08.330648+0000","last_became_peered":"2024-02-19T21:49:08.330648+0000","last_unstale":"2024-02-19T21:52:34.275930+0000","last_undegraded":"2024-02-19T21:52:34.275930+0000","last_fullsized":"2024-02-19T21:52:34.275930+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:55.803876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:44:55.803876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":449,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.318000+0000","last_change":"2024-02-19T21:48:31.320229+0000","last_active":"2024-02-19T21:52:34.318000+0000","last_peered":"2024-02-19T21:52:34.318000+0000","last_clean":"2024-02-19T21:52:34.318000+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:52:34.318000+0000","last_undegraded":"2024-02-19T21:52:34.318000+0000","last_fullsized":"2024-02-19T21:52:34.318000+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:31.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:45.017696+0000","last_clean_scrub_stamp":"2024-02-19T21:48:31.320133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"470'47","reported_seq":519,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.284404+0000","last_change":"2024-02-19T21:45:14.173212+0000","last_active":"2024-02-19T21:52:34.284404+0000","last_peered":"2024-02-19T21:52:34.284404+0000","last_clean":"2024-02-19T21:52:34.284404+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:52:34.284404+0000","last_undegraded":"2024-02-19T21:52:34.284404+0000","last_fullsized":"2024-02-19T21:52:34.284404+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'37","last_scrub_stamp":"2024-02-19T21:45:14.173134+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:45:14.173134+0000","log_size":47,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":55,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":448,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.287887+0000","last_change":"2024-02-19T21:46:48.988928+0000","last_active":"2024-02-19T21:52:34.287887+0000","last_peered":"2024-02-19T21:52:34.287887+0000","last_clean":"2024-02-19T21:52:34.287887+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:52:34.287887+0000","last_undegraded":"2024-02-19T21:52:34.287887+0000","last_fullsized":"2024-02-19T21:52:34.287887+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:48.988836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.988836+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.e","version":"472'7050","reported_seq":9231,"reported_epoch":472,"state":"active+clean","last_fresh":"2024-02-19T21:52:45.239164+0000","last_change":"2024-02-19T21:50:40.718822+0000","last_active":"2024-02-19T21:52:45.239164+0000","last_peered":"2024-02-19T21:52:45.239164+0000","last_clean":"2024-02-19T21:52:45.239164+0000","last_became_active":"2024-02-19T21:50:40.710425+0000","last_became_peered":"2024-02-19T21:50:40.710425+0000","last_unstale":"2024-02-19T21:52:45.239164+0000","last_undegraded":"2024-02-19T21:52:45.239164+0000","last_fullsized":"2024-02-19T21:52:45.239164+0000","mapping_epoch":430,"log_start":"402'2000","ondisk_log_start":"402'2000","created":385,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5050,"ondisk_log_size":5050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":136708096,"num_objects":2086,"num_object_clones":0,"num_object_copies":6258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2086,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7050,"num_write_kb":292352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1035,"num_bytes_recovered":67829760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":191,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.286518+0000","last_change":"2024-02-19T21:49:08.326461+0000","last_active":"2024-02-19T21:52:34.286518+0000","last_peered":"2024-02-19T21:52:34.286518+0000","last_clean":"2024-02-19T21:52:34.286518+0000","last_became_active":"2024-02-19T21:49:08.326106+0000","last_became_peered":"2024-02-19T21:49:08.326106+0000","last_unstale":"2024-02-19T21:52:34.286518+0000","last_undegraded":"2024-02-19T21:52:34.286518+0000","last_fullsized":"2024-02-19T21:52:34.286518+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.080896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.080896+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":451,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.276968+0000","last_change":"2024-02-19T21:48:11.879787+0000","last_active":"2024-02-19T21:52:34.276968+0000","last_peered":"2024-02-19T21:52:34.276968+0000","last_clean":"2024-02-19T21:52:34.276968+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:52:34.276968+0000","last_undegraded":"2024-02-19T21:52:34.276968+0000","last_fullsized":"2024-02-19T21:52:34.276968+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.879687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.879687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"470'50","reported_seq":104,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.296859+0000","last_change":"2024-02-19T21:49:55.861358+0000","last_active":"2024-02-19T21:52:34.296859+0000","last_peered":"2024-02-19T21:52:34.296859+0000","last_clean":"2024-02-19T21:52:34.296859+0000","last_became_active":"2024-02-19T21:49:54.480413+0000","last_became_peered":"2024-02-19T21:49:54.480413+0000","last_unstale":"2024-02-19T21:52:34.296859+0000","last_undegraded":"2024-02-19T21:52:34.296859+0000","last_fullsized":"2024-02-19T21:52:34.296859+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":415,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'38","last_scrub_stamp":"2024-02-19T21:49:05.923627+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.923627+0000","log_size":50,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":57,"num_write":44,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":344,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.281894+0000","last_change":"2024-02-19T21:49:54.495134+0000","last_active":"2024-02-19T21:52:34.281894+0000","last_peered":"2024-02-19T21:52:34.281894+0000","last_clean":"2024-02-19T21:52:34.281894+0000","last_became_active":"2024-02-19T21:49:54.494802+0000","last_became_peered":"2024-02-19T21:49:54.494802+0000","last_unstale":"2024-02-19T21:52:34.281894+0000","last_undegraded":"2024-02-19T21:52:34.281894+0000","last_fullsized":"2024-02-19T21:52:34.281894+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:10.578408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:10.578408+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.f","version":"472'7414","reported_seq":9819,"reported_epoch":472,"state":"active+clean","last_fresh":"2024-02-19T21:52:45.119681+0000","last_change":"2024-02-19T21:51:05.409700+0000","last_active":"2024-02-19T21:52:45.119681+0000","last_peered":"2024-02-19T21:52:45.119681+0000","last_clean":"2024-02-19T21:52:45.119681+0000","last_became_active":"2024-02-19T21:51:05.398355+0000","last_became_peered":"2024-02-19T21:51:05.398355+0000","last_unstale":"2024-02-19T21:52:45.119681+0000","last_undegraded":"2024-02-19T21:52:45.119681+0000","last_fullsized":"2024-02-19T21:52:45.119681+0000","mapping_epoch":440,"log_start":"404'2500","ondisk_log_start":"404'2500","created":385,"last_epoch_clean":441,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4914,"ondisk_log_size":4914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":139198464,"num_objects":2124,"num_object_clones":0,"num_object_copies":6372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7414,"num_write_kb":305216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1147,"num_bytes_recovered":75169792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":478,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.294797+0000","last_change":"2024-02-19T21:49:08.328862+0000","last_active":"2024-02-19T21:52:34.294797+0000","last_peered":"2024-02-19T21:52:34.294797+0000","last_clean":"2024-02-19T21:52:34.294797+0000","last_became_active":"2024-02-19T21:49:08.328529+0000","last_became_peered":"2024-02-19T21:49:08.328529+0000","last_unstale":"2024-02-19T21:52:34.294797+0000","last_undegraded":"2024-02-19T21:52:34.294797+0000","last_fullsized":"2024-02-19T21:52:34.294797+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:49.110117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:49.110117+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":511,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.290103+0000","last_change":"2024-02-19T21:49:54.493367+0000","last_active":"2024-02-19T21:52:34.290103+0000","last_peered":"2024-02-19T21:52:34.290103+0000","last_clean":"2024-02-19T21:52:34.290103+0000","last_became_active":"2024-02-19T21:49:54.493041+0000","last_became_peered":"2024-02-19T21:49:54.493041+0000","last_unstale":"2024-02-19T21:52:34.290103+0000","last_undegraded":"2024-02-19T21:52:34.290103+0000","last_fullsized":"2024-02-19T21:52:34.290103+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.972369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.972369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"470'42","reported_seq":339,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.285779+0000","last_change":"2024-02-19T21:49:08.330818+0000","last_active":"2024-02-19T21:52:34.285779+0000","last_peered":"2024-02-19T21:52:34.285779+0000","last_clean":"2024-02-19T21:52:34.285779+0000","last_became_active":"2024-02-19T21:49:08.330477+0000","last_became_peered":"2024-02-19T21:49:08.330477+0000","last_unstale":"2024-02-19T21:52:34.285779+0000","last_undegraded":"2024-02-19T21:52:34.285779+0000","last_fullsized":"2024-02-19T21:52:34.285779+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'28","last_scrub_stamp":"2024-02-19T21:45:55.998646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.998646+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":551,"reported_epoch":472,"state":"active+clean","last_fresh":"2024-02-19T21:52:37.106554+0000","last_change":"2024-02-19T21:45:50.742626+0000","last_active":"2024-02-19T21:52:37.106554+0000","last_peered":"2024-02-19T21:52:37.106554+0000","last_clean":"2024-02-19T21:52:37.106554+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:52:37.106554+0000","last_undegraded":"2024-02-19T21:52:37.106554+0000","last_fullsized":"2024-02-19T21:52:37.106554+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'9","last_scrub_stamp":"2024-02-19T21:45:50.742526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:50.742526+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"472'7036","reported_seq":7131,"reported_epoch":472,"state":"active+clean","last_fresh":"2024-02-19T21:52:45.134971+0000","last_change":"2024-02-19T21:48:47.779506+0000","last_active":"2024-02-19T21:52:45.134971+0000","last_peered":"2024-02-19T21:52:45.134971+0000","last_clean":"2024-02-19T21:52:45.134971+0000","last_became_active":"2024-02-19T21:48:47.778325+0000","last_became_peered":"2024-02-19T21:48:47.778325+0000","last_unstale":"2024-02-19T21:52:45.134971+0000","last_undegraded":"2024-02-19T21:52:45.134971+0000","last_fullsized":"2024-02-19T21:52:45.134971+0000","mapping_epoch":385,"log_start":"403'2100","ondisk_log_start":"403'2100","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4936,"ondisk_log_size":4936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":137887744,"num_objects":2104,"num_object_clones":0,"num_object_copies":6312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2104,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7036,"num_write_kb":292480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"66'1","reported_seq":362,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.290115+0000","last_change":"2024-02-19T21:48:12.568842+0000","last_active":"2024-02-19T21:52:34.290115+0000","last_peered":"2024-02-19T21:52:34.290115+0000","last_clean":"2024-02-19T21:52:34.290115+0000","last_became_active":"2024-02-19T21:44:56.166670+0000","last_became_peered":"2024-02-19T21:44:56.166670+0000","last_unstale":"2024-02-19T21:52:34.290115+0000","last_undegraded":"2024-02-19T21:52:34.290115+0000","last_fullsized":"2024-02-19T21:52:34.290115+0000","mapping_epoch":165,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:12.568734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.568734+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"261'11","reported_seq":562,"reported_epoch":472,"state":"active+clean","last_fresh":"2024-02-19T21:52:37.108665+0000","last_change":"2024-02-19T21:45:01.716882+0000","last_active":"2024-02-19T21:52:37.108665+0000","last_peered":"2024-02-19T21:52:37.108665+0000","last_clean":"2024-02-19T21:52:37.108665+0000","last_became_active":"2024-02-19T21:44:08.123392+0000","last_became_peered":"2024-02-19T21:44:08.123392+0000","last_unstale":"2024-02-19T21:52:37.108665+0000","last_undegraded":"2024-02-19T21:52:37.108665+0000","last_fullsized":"2024-02-19T21:52:37.108665+0000","mapping_epoch":62,"log_start":"257'10","ondisk_log_start":"257'10","created":62,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-02-19T21:45:01.716817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.716817+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":460,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.296783+0000","last_change":"2024-02-19T21:48:19.186455+0000","last_active":"2024-02-19T21:52:34.296783+0000","last_peered":"2024-02-19T21:52:34.296783+0000","last_clean":"2024-02-19T21:52:34.296783+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:52:34.296783+0000","last_undegraded":"2024-02-19T21:52:34.296783+0000","last_fullsized":"2024-02-19T21:52:34.296783+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:48:19.186359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:19.186359+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"470'27","reported_seq":330,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.285950+0000","last_change":"2024-02-19T21:48:34.485865+0000","last_active":"2024-02-19T21:52:34.285950+0000","last_peered":"2024-02-19T21:52:34.285950+0000","last_clean":"2024-02-19T21:52:34.285950+0000","last_became_active":"2024-02-19T21:47:46.251550+0000","last_became_peered":"2024-02-19T21:47:46.251550+0000","last_unstale":"2024-02-19T21:52:34.285950+0000","last_undegraded":"2024-02-19T21:52:34.285950+0000","last_fullsized":"2024-02-19T21:52:34.285950+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:34.485787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:34.485787+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7],"acting":[4,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1","version":"472'7175","reported_seq":7270,"reported_epoch":472,"state":"active+clean","last_fresh":"2024-02-19T21:52:45.254282+0000","last_change":"2024-02-19T21:48:47.772467+0000","last_active":"2024-02-19T21:52:45.254282+0000","last_peered":"2024-02-19T21:52:45.254282+0000","last_clean":"2024-02-19T21:52:45.254282+0000","last_became_active":"2024-02-19T21:48:47.772154+0000","last_became_peered":"2024-02-19T21:48:47.772154+0000","last_unstale":"2024-02-19T21:52:45.254282+0000","last_undegraded":"2024-02-19T21:52:45.254282+0000","last_fullsized":"2024-02-19T21:52:45.254282+0000","mapping_epoch":385,"log_start":"402'2100","ondisk_log_start":"402'2100","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5075,"ondisk_log_size":5075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":140181504,"num_objects":2139,"num_object_clones":0,"num_object_copies":6417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7175,"num_write_kb":298048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":467,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.299051+0000","last_change":"2024-02-19T21:46:01.031458+0000","last_active":"2024-02-19T21:52:34.299051+0000","last_peered":"2024-02-19T21:52:34.299051+0000","last_clean":"2024-02-19T21:52:34.299051+0000","last_became_active":"2024-02-19T21:44:56.155194+0000","last_became_peered":"2024-02-19T21:44:56.155194+0000","last_unstale":"2024-02-19T21:52:34.299051+0000","last_undegraded":"2024-02-19T21:52:34.299051+0000","last_fullsized":"2024-02-19T21:52:34.299051+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.031344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.031344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"363'12","reported_seq":274,"reported_epoch":472,"state":"active+clean","last_fresh":"2024-02-19T21:52:37.112085+0000","last_change":"2024-02-19T21:48:25.487689+0000","last_active":"2024-02-19T21:52:37.112085+0000","last_peered":"2024-02-19T21:52:37.112085+0000","last_clean":"2024-02-19T21:52:37.112085+0000","last_became_active":"2024-02-19T21:47:46.260099+0000","last_became_peered":"2024-02-19T21:47:46.260099+0000","last_unstale":"2024-02-19T21:52:37.112085+0000","last_undegraded":"2024-02-19T21:52:37.112085+0000","last_fullsized":"2024-02-19T21:52:37.112085+0000","mapping_epoch":362,"log_start":"98'9","ondisk_log_start":"98'9","created":62,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"363'12","last_scrub_stamp":"2024-02-19T21:48:25.487608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.487608+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":471,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.275844+0000","last_change":"2024-02-19T21:49:08.335163+0000","last_active":"2024-02-19T21:52:34.275844+0000","last_peered":"2024-02-19T21:52:34.275844+0000","last_clean":"2024-02-19T21:52:34.275844+0000","last_became_active":"2024-02-19T21:49:08.334842+0000","last_became_peered":"2024-02-19T21:49:08.334842+0000","last_unstale":"2024-02-19T21:52:34.275844+0000","last_undegraded":"2024-02-19T21:52:34.275844+0000","last_fullsized":"2024-02-19T21:52:34.275844+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.700887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.700887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"471'46","reported_seq":409,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.548020+0000","last_change":"2024-02-19T21:47:34.894164+0000","last_active":"2024-02-19T21:52:34.548020+0000","last_peered":"2024-02-19T21:52:34.548020+0000","last_clean":"2024-02-19T21:52:34.548020+0000","last_became_active":"2024-02-19T21:47:33.400012+0000","last_became_peered":"2024-02-19T21:47:33.400012+0000","last_unstale":"2024-02-19T21:52:34.548020+0000","last_undegraded":"2024-02-19T21:52:34.548020+0000","last_fullsized":"2024-02-19T21:52:34.548020+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":357,"parent":"0.0","parent_split_bits":0,"last_scrub":"270'34","last_scrub_stamp":"2024-02-19T21:46:44.789309+0000","last_deep_scrub":"270'34","last_deep_scrub_stamp":"2024-02-19T21:44:17.451151+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.789309+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2","version":"472'7284","reported_seq":7379,"reported_epoch":472,"state":"active+clean","last_fresh":"2024-02-19T21:52:45.199062+0000","last_change":"2024-02-19T21:48:47.771305+0000","last_active":"2024-02-19T21:52:45.199062+0000","last_peered":"2024-02-19T21:52:45.199062+0000","last_clean":"2024-02-19T21:52:45.199062+0000","last_became_active":"2024-02-19T21:48:47.771000+0000","last_became_peered":"2024-02-19T21:48:47.771000+0000","last_unstale":"2024-02-19T21:52:45.199062+0000","last_undegraded":"2024-02-19T21:52:45.199062+0000","last_fullsized":"2024-02-19T21:52:45.199062+0000","mapping_epoch":385,"log_start":"402'2100","ondisk_log_start":"402'2100","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5184,"ondisk_log_size":5184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":140509184,"num_objects":2144,"num_object_clones":0,"num_object_copies":6432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7284,"num_write_kb":301696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":449,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.286223+0000","last_change":"2024-02-19T21:49:08.329023+0000","last_active":"2024-02-19T21:52:34.286223+0000","last_peered":"2024-02-19T21:52:34.286223+0000","last_clean":"2024-02-19T21:52:34.286223+0000","last_became_active":"2024-02-19T21:49:08.328697+0000","last_became_peered":"2024-02-19T21:49:08.328697+0000","last_unstale":"2024-02-19T21:52:34.286223+0000","last_undegraded":"2024-02-19T21:52:34.286223+0000","last_fullsized":"2024-02-19T21:52:34.286223+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.939414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.939414+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"397'17","reported_seq":403,"reported_epoch":472,"state":"active+clean","last_fresh":"2024-02-19T21:52:37.106545+0000","last_change":"2024-02-19T21:49:08.325927+0000","last_active":"2024-02-19T21:52:37.106545+0000","last_peered":"2024-02-19T21:52:37.106545+0000","last_clean":"2024-02-19T21:52:37.106545+0000","last_became_active":"2024-02-19T21:49:08.325034+0000","last_became_peered":"2024-02-19T21:49:08.325034+0000","last_unstale":"2024-02-19T21:52:37.106545+0000","last_undegraded":"2024-02-19T21:52:37.106545+0000","last_fullsized":"2024-02-19T21:52:37.106545+0000","mapping_epoch":394,"log_start":"170'11","ondisk_log_start":"170'11","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"271'13","last_scrub_stamp":"2024-02-19T21:46:47.072988+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.072988+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":461,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.276275+0000","last_change":"2024-02-19T21:49:03.987847+0000","last_active":"2024-02-19T21:52:34.276275+0000","last_peered":"2024-02-19T21:52:34.276275+0000","last_clean":"2024-02-19T21:52:34.276275+0000","last_became_active":"2024-02-19T21:47:33.395485+0000","last_became_peered":"2024-02-19T21:47:33.395485+0000","last_unstale":"2024-02-19T21:52:34.276275+0000","last_undegraded":"2024-02-19T21:52:34.276275+0000","last_fullsized":"2024-02-19T21:52:34.276275+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:03.987749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:49:03.987749+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,5],"acting":[1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"470'30","reported_seq":310,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.284799+0000","last_change":"2024-02-19T21:48:12.628796+0000","last_active":"2024-02-19T21:52:34.284799+0000","last_peered":"2024-02-19T21:52:34.284799+0000","last_clean":"2024-02-19T21:52:34.284799+0000","last_became_active":"2024-02-19T21:47:46.251725+0000","last_became_peered":"2024-02-19T21:47:46.251725+0000","last_unstale":"2024-02-19T21:52:34.284799+0000","last_undegraded":"2024-02-19T21:52:34.284799+0000","last_fullsized":"2024-02-19T21:52:34.284799+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'20","last_scrub_stamp":"2024-02-19T21:48:12.628700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.628700+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":38,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3","version":"472'7072","reported_seq":9371,"reported_epoch":472,"state":"active+clean","last_fresh":"2024-02-19T21:52:42.198689+0000","last_change":"2024-02-19T21:50:50.296220+0000","last_active":"2024-02-19T21:52:42.198689+0000","last_peered":"2024-02-19T21:52:42.198689+0000","last_clean":"2024-02-19T21:52:42.198689+0000","last_became_active":"2024-02-19T21:50:50.289607+0000","last_became_peered":"2024-02-19T21:50:50.289607+0000","last_unstale":"2024-02-19T21:52:42.198689+0000","last_undegraded":"2024-02-19T21:52:42.198689+0000","last_fullsized":"2024-02-19T21:52:42.198689+0000","mapping_epoch":433,"log_start":"400'1700","ondisk_log_start":"400'1700","created":385,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5372,"ondisk_log_size":5372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":149946368,"num_objects":2288,"num_object_clones":0,"num_object_copies":6864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2288,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7072,"num_write_kb":299520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1097,"num_bytes_recovered":71892992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":100,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.280634+0000","last_change":"2024-02-19T21:49:08.327495+0000","last_active":"2024-02-19T21:52:34.280634+0000","last_peered":"2024-02-19T21:52:34.280634+0000","last_clean":"2024-02-19T21:52:34.280634+0000","last_became_active":"2024-02-19T21:49:08.327172+0000","last_became_peered":"2024-02-19T21:49:08.327172+0000","last_unstale":"2024-02-19T21:52:34.280634+0000","last_undegraded":"2024-02-19T21:52:34.280634+0000","last_fullsized":"2024-02-19T21:52:34.280634+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.241319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.241319+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,6],"acting":[2,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":456,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.277919+0000","last_change":"2024-02-19T21:45:01.798485+0000","last_active":"2024-02-19T21:52:34.277919+0000","last_peered":"2024-02-19T21:52:34.277919+0000","last_clean":"2024-02-19T21:52:34.277919+0000","last_became_active":"2024-02-19T21:44:22.245925+0000","last_became_peered":"2024-02-19T21:44:22.245925+0000","last_unstale":"2024-02-19T21:52:34.277919+0000","last_undegraded":"2024-02-19T21:52:34.277919+0000","last_fullsized":"2024-02-19T21:52:34.277919+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:01.798387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.798387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":456,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.294668+0000","last_change":"2024-02-19T21:48:30.277397+0000","last_active":"2024-02-19T21:52:34.294668+0000","last_peered":"2024-02-19T21:52:34.294668+0000","last_clean":"2024-02-19T21:52:34.294668+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:52:34.294668+0000","last_undegraded":"2024-02-19T21:52:34.294668+0000","last_fullsized":"2024-02-19T21:52:34.294668+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.277322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.277322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"470'53","reported_seq":425,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.285282+0000","last_change":"2024-02-19T21:49:08.326007+0000","last_active":"2024-02-19T21:52:34.285282+0000","last_peered":"2024-02-19T21:52:34.285282+0000","last_clean":"2024-02-19T21:52:34.285282+0000","last_became_active":"2024-02-19T21:49:08.325683+0000","last_became_peered":"2024-02-19T21:49:08.325683+0000","last_unstale":"2024-02-19T21:52:34.285282+0000","last_undegraded":"2024-02-19T21:52:34.285282+0000","last_fullsized":"2024-02-19T21:52:34.285282+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'39","last_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_deep_scrub":"337'39","last_deep_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.923809+0000","log_size":53,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"472'7397","reported_seq":7492,"reported_epoch":472,"state":"active+clean","last_fresh":"2024-02-19T21:52:44.839265+0000","last_change":"2024-02-19T21:48:47.776672+0000","last_active":"2024-02-19T21:52:44.839265+0000","last_peered":"2024-02-19T21:52:44.839265+0000","last_clean":"2024-02-19T21:52:44.839265+0000","last_became_active":"2024-02-19T21:48:47.776368+0000","last_became_peered":"2024-02-19T21:48:47.776368+0000","last_unstale":"2024-02-19T21:52:44.839265+0000","last_undegraded":"2024-02-19T21:52:44.839265+0000","last_fullsized":"2024-02-19T21:52:44.839265+0000","mapping_epoch":385,"log_start":"403'2300","ondisk_log_start":"403'2300","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5097,"ondisk_log_size":5097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":140967936,"num_objects":2151,"num_object_clones":0,"num_object_copies":6453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2151,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7397,"num_write_kb":305536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"66'1","reported_seq":294,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.296540+0000","last_change":"2024-02-19T21:50:57.303343+0000","last_active":"2024-02-19T21:52:34.296540+0000","last_peered":"2024-02-19T21:52:34.296540+0000","last_clean":"2024-02-19T21:52:34.296540+0000","last_became_active":"2024-02-19T21:50:57.302957+0000","last_became_peered":"2024-02-19T21:50:57.302957+0000","last_unstale":"2024-02-19T21:52:34.296540+0000","last_undegraded":"2024-02-19T21:52:34.296540+0000","last_fullsized":"2024-02-19T21:52:34.296540+0000","mapping_epoch":437,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":438,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:46:43.773486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:46:43.773486+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":100,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.279111+0000","last_change":"2024-02-19T21:49:08.326583+0000","last_active":"2024-02-19T21:52:34.279111+0000","last_peered":"2024-02-19T21:52:34.279111+0000","last_clean":"2024-02-19T21:52:34.279111+0000","last_became_active":"2024-02-19T21:49:08.324835+0000","last_became_peered":"2024-02-19T21:49:08.324835+0000","last_unstale":"2024-02-19T21:52:34.279111+0000","last_undegraded":"2024-02-19T21:52:34.279111+0000","last_fullsized":"2024-02-19T21:52:34.279111+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.163825+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":160,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.289724+0000","last_change":"2024-02-19T21:52:29.644618+0000","last_active":"2024-02-19T21:52:34.289724+0000","last_peered":"2024-02-19T21:52:34.289724+0000","last_clean":"2024-02-19T21:52:34.289724+0000","last_became_active":"2024-02-19T21:49:08.327186+0000","last_became_peered":"2024-02-19T21:49:08.327186+0000","last_unstale":"2024-02-19T21:52:34.289724+0000","last_undegraded":"2024-02-19T21:52:34.289724+0000","last_fullsized":"2024-02-19T21:52:34.289724+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:45:00.748244+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:45:00.748244+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"471'60","reported_seq":601,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.515737+0000","last_change":"2024-02-19T21:49:55.281324+0000","last_active":"2024-02-19T21:52:34.515737+0000","last_peered":"2024-02-19T21:52:34.515737+0000","last_clean":"2024-02-19T21:52:34.515737+0000","last_became_active":"2024-02-19T21:49:54.493167+0000","last_became_peered":"2024-02-19T21:49:54.493167+0000","last_unstale":"2024-02-19T21:52:34.515737+0000","last_undegraded":"2024-02-19T21:52:34.515737+0000","last_fullsized":"2024-02-19T21:52:34.515737+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'44","last_scrub_stamp":"2024-02-19T21:48:32.489084+0000","last_deep_scrub":"201'44","last_deep_scrub_stamp":"2024-02-19T21:44:16.255049+0000","last_clean_scrub_stamp":"2024-02-19T21:48:32.489084+0000","log_size":60,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":80,"num_read_kb":69,"num_write":52,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.5","version":"472'7174","reported_seq":13539,"reported_epoch":472,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:52:42.217822+0000","last_change":"2024-02-19T21:52:17.602505+0000","last_active":"2024-02-19T21:52:42.217822+0000","last_peered":"2024-02-19T21:52:42.217822+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:50:03.654321+0000","last_became_peered":"2024-02-19T21:50:03.654321+0000","last_unstale":"2024-02-19T21:52:42.217822+0000","last_undegraded":"2024-02-19T21:52:17.600617+0000","last_fullsized":"2024-02-19T21:49:55.473278+0000","mapping_epoch":414,"log_start":"400'1800","ondisk_log_start":"400'1800","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5374,"ondisk_log_size":5374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":147324928,"num_objects":2248,"num_object_clones":0,"num_object_copies":6744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":58,"num_objects_misplaced":1510,"num_objects_unfound":0,"num_objects_dirty":2248,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7174,"num_write_kb":301504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2553,"num_bytes_recovered":167313408,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0],"avail_no_missing":["2","0","5"],"object_location_counts":[{"shards":"0,2","objects":680},{"shards":"0,2,5","objects":1510}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":501,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.283036+0000","last_change":"2024-02-19T21:49:08.328667+0000","last_active":"2024-02-19T21:52:34.283036+0000","last_peered":"2024-02-19T21:52:34.283036+0000","last_clean":"2024-02-19T21:52:34.283036+0000","last_became_active":"2024-02-19T21:49:08.328287+0000","last_became_peered":"2024-02-19T21:49:08.328287+0000","last_unstale":"2024-02-19T21:52:34.283036+0000","last_undegraded":"2024-02-19T21:52:34.283036+0000","last_fullsized":"2024-02-19T21:52:34.283036+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.176542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.176542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":100,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.279049+0000","last_change":"2024-02-19T21:49:08.332637+0000","last_active":"2024-02-19T21:52:34.279049+0000","last_peered":"2024-02-19T21:52:34.279049+0000","last_clean":"2024-02-19T21:52:34.279049+0000","last_became_active":"2024-02-19T21:49:08.331451+0000","last_became_peered":"2024-02-19T21:49:08.331451+0000","last_unstale":"2024-02-19T21:52:34.279049+0000","last_undegraded":"2024-02-19T21:52:34.279049+0000","last_fullsized":"2024-02-19T21:52:34.279049+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.123413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.547129+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.123413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":471,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.276815+0000","last_change":"2024-02-19T21:49:08.331159+0000","last_active":"2024-02-19T21:52:34.276815+0000","last_peered":"2024-02-19T21:52:34.276815+0000","last_clean":"2024-02-19T21:52:34.276815+0000","last_became_active":"2024-02-19T21:49:08.330804+0000","last_became_peered":"2024-02-19T21:49:08.330804+0000","last_unstale":"2024-02-19T21:52:34.276815+0000","last_undegraded":"2024-02-19T21:52:34.276815+0000","last_fullsized":"2024-02-19T21:52:34.276815+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.978015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.978015+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"470'25","reported_seq":488,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.284451+0000","last_change":"2024-02-19T21:48:23.326608+0000","last_active":"2024-02-19T21:52:34.284451+0000","last_peered":"2024-02-19T21:52:34.284451+0000","last_clean":"2024-02-19T21:52:34.284451+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:52:34.284451+0000","last_undegraded":"2024-02-19T21:52:34.284451+0000","last_fullsized":"2024-02-19T21:52:34.284451+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"377'19","last_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_deep_scrub":"377'19","last_deep_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.326541+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"472'7298","reported_seq":7392,"reported_epoch":472,"state":"active+clean","last_fresh":"2024-02-19T21:52:45.322048+0000","last_change":"2024-02-19T21:48:47.780368+0000","last_active":"2024-02-19T21:52:45.322048+0000","last_peered":"2024-02-19T21:52:45.322048+0000","last_clean":"2024-02-19T21:52:45.322048+0000","last_became_active":"2024-02-19T21:48:47.780046+0000","last_became_peered":"2024-02-19T21:48:47.780046+0000","last_unstale":"2024-02-19T21:52:45.322048+0000","last_undegraded":"2024-02-19T21:52:45.322048+0000","last_fullsized":"2024-02-19T21:52:45.322048+0000","mapping_epoch":385,"log_start":"402'2100","ondisk_log_start":"402'2100","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5198,"ondisk_log_size":5198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":138280960,"num_objects":2110,"num_object_clones":0,"num_object_copies":6330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2110,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7298,"num_write_kb":301056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":465,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.291692+0000","last_change":"2024-02-19T21:46:01.981923+0000","last_active":"2024-02-19T21:52:34.291692+0000","last_peered":"2024-02-19T21:52:34.291692+0000","last_clean":"2024-02-19T21:52:34.291692+0000","last_became_active":"2024-02-19T21:44:56.160521+0000","last_became_peered":"2024-02-19T21:44:56.160521+0000","last_unstale":"2024-02-19T21:52:34.291692+0000","last_undegraded":"2024-02-19T21:52:34.291692+0000","last_fullsized":"2024-02-19T21:52:34.291692+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.981866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.981866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":109,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.280599+0000","last_change":"2024-02-19T21:49:54.485377+0000","last_active":"2024-02-19T21:52:34.280599+0000","last_peered":"2024-02-19T21:52:34.280599+0000","last_clean":"2024-02-19T21:52:34.280599+0000","last_became_active":"2024-02-19T21:49:54.485078+0000","last_became_peered":"2024-02-19T21:49:54.485078+0000","last_unstale":"2024-02-19T21:52:34.280599+0000","last_undegraded":"2024-02-19T21:52:34.280599+0000","last_fullsized":"2024-02-19T21:52:34.280599+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:52.107416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:46:52.107416+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"470'39","reported_seq":560,"reported_epoch":471,"state":"active+clean","last_fresh":"2024-02-19T21:52:34.290893+0000","last_change":"2024-02-19T21:49:55.109780+0000","last_active":"2024-02-19T21:52:34.290893+0000","last_peered":"2024-02-19T21:52:34.290893+0000","last_clean":"2024-02-19T21:52:34.290893+0000","last_became_active":"2024-02-19T21:49:54.486014+0000","last_became_peered":"2024-02-19T21:49:54.486014+0000","last_unstale":"2024-02-19T21:52:34.290893+0000","last_undegraded":"2024-02-19T21:52:34.290893+0000","last_fullsized":"2024-02-19T21:52:34.290893+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'27","last_scrub_stamp":"2024-02-19T21:48:24.665813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:24.665813+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"324'11","reported_seq":722,"reported_epoch":472,"state":"active+clean","last_fresh":"2024-02-19T21:52:37.119915+0000","last_change":"2024-02-19T21:48:26.293036+0000","last_active":"2024-02-19T21:52:37.119915+0000","last_peered":"2024-02-19T21:52:37.119915+0000","last_clean":"2024-02-19T21:52:37.119915+0000","last_became_active":"2024-02-19T21:44:34.385140+0000","last_became_peered":"2024-02-19T21:44:34.385140+0000","last_unstale":"2024-02-19T21:52:37.119915+0000","last_undegraded":"2024-02-19T21:52:37.119915+0000","last_fullsized":"2024-02-19T21:52:37.119915+0000","mapping_epoch":62,"log_start":"66'8","ondisk_log_start":"66'8","created":62,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'11","last_scrub_stamp":"2024-02-19T21:48:26.292909+0000","last_deep_scrub":"324'11","last_deep_scrub_stamp":"2024-02-19T21:46:05.210095+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.292909+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":2240938008,"num_objects":34195,"num_object_clones":0,"num_object_copies":102585,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1154,"num_objects_misplaced":2936,"num_objects_unfound":0,"num_objects_dirty":34195,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":115301,"num_write_kb":4783809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13505,"num_bytes_recovered":863043584,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7178235904,"data_stored":7178223688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80901,"ondisk_log_size":80901,"up":48,"acting":46,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1201,"num_read_kb":1196,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1536,"num_read_kb":1293,"num_write":989,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":277,"num_bytes_recovered":5172,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1062,"ondisk_log_size":1062,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":22,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":66,"acting":66,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":382,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201527,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1093136,"kb_used_data":499208,"kb_used_omap":0,"kb_used_meta":593792,"kb_avail":92652016,"statfs":{"total":95995035648,"available":94875664384,"internally_reserved":0,"allocated":511188992,"data_stored":509783489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":608043008},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":1.49,"15min":1.839},"min":{"1min":0.23100000000000001,"5min":0.19400000000000001,"15min":0.189},"max":{"1min":0.57899999999999996,"5min":22.07,"15min":70.477999999999994},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":1.548,"15min":2.0049999999999999},"min":{"1min":0.26800000000000002,"5min":0.21199999999999999,"15min":0.20999999999999999},"max":{"1min":1.1140000000000001,"5min":22.457000000000001,"15min":68.052000000000007},"last":2.5680000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":1.4319999999999999,"15min":2.048},"min":{"1min":0.27000000000000002,"5min":0.247,"15min":0.23200000000000001},"max":{"1min":0.434,"5min":22.117999999999999,"15min":68.168000000000006},"last":0.441},{"interface":"front","average":{"1min":0.624,"5min":1.796,"15min":2.1099999999999999},"min":{"1min":0.27300000000000002,"5min":0.26300000000000001,"15min":0.223},"max":{"1min":3.3319999999999999,"5min":22.236000000000001,"15min":68.444000000000003},"last":0.504}]},{"osd":2,"last update":"Mon Feb 19 21:52:16 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":1.6519999999999999,"15min":2.1499999999999999},"min":{"1min":0.29099999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1970000000000001,"5min":12.304,"15min":12.304},"last":2.6230000000000002},{"interface":"front","average":{"1min":0.81499999999999995,"5min":1.506,"15min":1.8779999999999999},"min":{"1min":0.375,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":6.2779999999999996,"5min":11.69,"15min":11.69},"last":2.4780000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":1.595,"15min":2.1200000000000001},"min":{"1min":0.36799999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":3.0680000000000001,"5min":11.778,"15min":31.559000000000001},"last":2.5350000000000001},{"interface":"front","average":{"1min":0.434,"5min":1.2490000000000001,"15min":1.8620000000000001},"min":{"1min":0.34100000000000003,"5min":0.30299999999999999,"15min":0.29299999999999998},"max":{"1min":0.68300000000000005,"5min":13.473000000000001,"15min":30.812999999999999},"last":13.196}]},{"osd":4,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":1.417,"15min":1.546},"min":{"1min":0.30399999999999999,"5min":0.245,"15min":0.216},"max":{"1min":1.173,"5min":17.716999999999999,"15min":17.716999999999999},"last":3.004},{"interface":"front","average":{"1min":0.45500000000000002,"5min":1.7729999999999999,"15min":1.871},"min":{"1min":0.31900000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.67100000000000004,"5min":15.666,"15min":17.690999999999999},"last":2.96}]},{"osd":5,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":1.6200000000000001,"15min":1.6220000000000001},"min":{"1min":0.29599999999999999,"5min":0.28499999999999998,"15min":0.24199999999999999},"max":{"1min":1.6679999999999999,"5min":29.021000000000001,"15min":29.021000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":1.756,"15min":1.887},"min":{"1min":0.33900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.3700000000000001,"5min":29.091999999999999,"15min":29.091999999999999},"last":6.0019999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":1.9219999999999999,"15min":1.694},"min":{"1min":0.39500000000000002,"5min":0.31,"15min":0.24299999999999999},"max":{"1min":1.3919999999999999,"5min":19.286000000000001,"15min":19.286000000000001},"last":2.5979999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":1.8200000000000001,"15min":1.8560000000000001},"min":{"1min":0.38700000000000001,"5min":0.309,"15min":0.26700000000000002},"max":{"1min":0.70599999999999996,"5min":18.364000000000001,"15min":18.364000000000001},"last":2.5089999999999999}]}]},{"osd":6,"up_from":47,"seq":201863463166,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1551376,"kb_used_data":965768,"kb_used_omap":0,"kb_used_meta":585600,"kb_avail":92193776,"statfs":{"total":95995035648,"available":94406426624,"internally_reserved":0,"allocated":988946432,"data_stored":987540243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":599654400},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,5],"upper_bound":64},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:52:31 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.92500000000000004,"15min":1.5880000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.20100000000000001},"max":{"1min":3.9489999999999998,"5min":7.8170000000000002,"15min":45.197000000000003},"last":0.27000000000000002},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.391,"15min":1.948},"min":{"1min":0.29399999999999998,"5min":0.23499999999999999,"15min":0.221},"max":{"1min":3.7469999999999999,"5min":6.7320000000000002,"15min":44.753},"last":0.374}]},{"osd":1,"last update":"Mon Feb 19 21:52:31 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":1.091,"15min":1.577},"min":{"1min":0.26700000000000002,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":4.101,"5min":7.8639999999999999,"15min":45.231999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.3029999999999999,"15min":1.6950000000000001},"min":{"1min":0.28699999999999998,"5min":0.245,"15min":0.23100000000000001},"max":{"1min":9.3079999999999998,"5min":9.3079999999999998,"15min":45.097999999999999},"last":0.41099999999999998}]},{"osd":2,"last update":"Mon Feb 19 21:52:12 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":1.2230000000000001,"15min":1.4550000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.70199999999999996,"5min":6.1820000000000004,"15min":6.1820000000000004},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.97299999999999998,"15min":1.1699999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.502,"5min":7.8959999999999999,"15min":7.8959999999999999},"last":0.33000000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:52:31 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.0920000000000001,"15min":1.512},"min":{"1min":0.36699999999999999,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":4.0140000000000002,"5min":7.9210000000000003,"15min":11.15},"last":0.38400000000000001},{"interface":"front","average":{"1min":1.907,"5min":1.478,"15min":1.597},"min":{"1min":0.307,"5min":0.30599999999999999,"15min":0.26400000000000001},"max":{"1min":13.038,"5min":13.038,"15min":19.632999999999999},"last":0.437}]},{"osd":4,"last update":"Mon Feb 19 21:52:31 2024","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.821,"15min":1.8380000000000001},"min":{"1min":0.29399999999999998,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":8.5980000000000008,"5min":18.010000000000002,"15min":18.010000000000002},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3120000000000001,"15min":1.7589999999999999},"min":{"1min":0.317,"5min":0.26300000000000001,"15min":0.23499999999999999},"max":{"1min":6.4909999999999997,"5min":11.566000000000001,"15min":16.594999999999999},"last":1.167}]},{"osd":5,"last update":"Mon Feb 19 21:52:31 2024","interfaces":[{"interface":"back","average":{"1min":2.214,"5min":1.762,"15min":1.901},"min":{"1min":0.36799999999999999,"5min":0.27400000000000002,"15min":0.27100000000000002},"max":{"1min":7.7370000000000001,"5min":9.5990000000000002,"15min":14.695},"last":0.34699999999999998},{"interface":"front","average":{"1min":1.962,"5min":1.5800000000000001,"15min":2.0019999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":6.6959999999999997,"5min":11.609999999999999,"15min":15.497999999999999},"last":3.6200000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:51:52 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":1.548,"15min":1.8089999999999999},"min":{"1min":0.32100000000000001,"5min":0.27200000000000002,"15min":0.26700000000000002},"max":{"1min":1.768,"5min":9.1929999999999996,"15min":14.721},"last":2.1240000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":1.5900000000000001,"15min":1.8580000000000001},"min":{"1min":0.39700000000000002,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":1.7989999999999999,"5min":9.2240000000000002,"15min":14.744999999999999},"last":2.1440000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575128,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1450656,"kb_used_data":554136,"kb_used_omap":0,"kb_used_meta":896512,"kb_avail":92294496,"statfs":{"total":95995035648,"available":94509563904,"internally_reserved":0,"allocated":567435264,"data_stored":566013591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":918028288},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:52:20 2024","interfaces":[{"interface":"back","average":{"1min":0.25700000000000001,"5min":0.70599999999999996,"15min":1.329},"min":{"1min":0.186,"5min":0.16300000000000001,"15min":0.161},"max":{"1min":0.38500000000000001,"5min":5.7889999999999997,"15min":42.776000000000003},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.85399999999999998,"15min":1.504},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.16400000000000001},"max":{"1min":4.1020000000000003,"5min":5.7119999999999997,"15min":44.845999999999997},"last":0.255}]},{"osd":2,"last update":"Mon Feb 19 21:52:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.81799999999999995,"15min":0.99399999999999999},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":2.524,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.80900000000000005,"15min":0.94399999999999995},"min":{"1min":0.23899999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":2.823,"5min":4.452,"15min":4.452},"last":0.20699999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:52:20 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72099999999999997,"15min":1.456},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.20999999999999999},"max":{"1min":4.3529999999999998,"5min":4.3710000000000004,"15min":41.607999999999997},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.72299999999999998,"15min":1.381},"min":{"1min":0.27100000000000002,"5min":0.215,"15min":0.215},"max":{"1min":2.4889999999999999,"5min":4.5190000000000001,"15min":42.811999999999998},"last":0.433}]},{"osd":4,"last update":"Mon Feb 19 21:52:38 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.1579999999999999,"15min":1.5029999999999999},"min":{"1min":0.32000000000000001,"5min":0.26900000000000002,"15min":0.251},"max":{"1min":6.9690000000000003,"5min":9.8759999999999994,"15min":15.853},"last":2.8700000000000001},{"interface":"front","average":{"1min":1.3420000000000001,"5min":0.98599999999999999,"15min":1.484},"min":{"1min":0.33900000000000002,"5min":0.28000000000000003,"15min":0.26500000000000001},"max":{"1min":6.9800000000000004,"5min":6.9800000000000004,"15min":15.861000000000001},"last":3.851}]},{"osd":5,"last update":"Mon Feb 19 21:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":1.0189999999999999,"15min":1.5589999999999999},"min":{"1min":0.307,"5min":0.29599999999999999,"15min":0.27900000000000003},"max":{"1min":2.8759999999999999,"5min":7.3339999999999996,"15min":14.331},"last":3.891},{"interface":"front","average":{"1min":0.54900000000000004,"5min":1.1160000000000001,"15min":1.5580000000000001},"min":{"1min":0.313,"5min":0.307,"15min":0.30099999999999999},"max":{"1min":2.0110000000000001,"5min":14.426,"15min":14.496},"last":0.96699999999999997}]},{"osd":6,"last update":"Mon Feb 19 21:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":1.1060000000000001,"15min":1.5800000000000001},"min":{"1min":0.377,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":2.5779999999999998,"5min":10.456,"15min":11.638999999999999},"last":2.9990000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.1599999999999999,"15min":1.6870000000000001},"min":{"1min":0.36299999999999999,"5min":0.34699999999999998,"15min":0.29699999999999999},"max":{"1min":3.6480000000000001,"5min":9.8049999999999997,"15min":12.199},"last":1.4099999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:51:57 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":1.2529999999999999,"15min":1.7509999999999999},"min":{"1min":0.35499999999999998,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":2.153,"5min":7.702,"15min":13.904},"last":7.0679999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":1.323,"15min":1.694},"min":{"1min":0.42799999999999999,"5min":0.35499999999999998,"15min":0.32600000000000001},"max":{"1min":2.4470000000000001,"5min":7.6909999999999998,"15min":13.894},"last":7.0899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738654,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2280780,"kb_used_data":1386372,"kb_used_omap":0,"kb_used_meta":894400,"kb_avail":91464372,"statfs":{"total":95995035648,"available":93659516928,"internally_reserved":0,"allocated":1419644928,"data_stored":1418242774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":915865600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:52:12 2024","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.63600000000000001,"15min":1.026},"min":{"1min":0.191,"5min":0.189,"15min":0.153},"max":{"1min":0.53500000000000003,"5min":6.1550000000000002,"15min":16.478000000000002},"last":0.218},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.80300000000000005,"15min":1.2270000000000001},"min":{"1min":0.222,"5min":0.20100000000000001,"15min":0.17799999999999999},"max":{"1min":1.04,"5min":6.9359999999999999,"15min":13.422000000000001},"last":0.498}]},{"osd":2,"last update":"Mon Feb 19 21:52:12 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.56100000000000005,"15min":0.628},"min":{"1min":0.223,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.95699999999999996,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.86399999999999999,"15min":1.0760000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.79200000000000004,"5min":8.9960000000000004,"15min":8.9960000000000004},"last":0.312}]},{"osd":3,"last update":"Mon Feb 19 21:52:01 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.89700000000000002,"15min":1.5289999999999999},"min":{"1min":0.28000000000000003,"5min":0.217,"15min":0.21299999999999999},"max":{"1min":1.4159999999999999,"5min":12.691000000000001,"15min":14.507999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.80100000000000005,"15min":1.371},"min":{"1min":0.26300000000000001,"5min":0.24099999999999999,"15min":0.23400000000000001},"max":{"1min":1.3089999999999999,"5min":6.6150000000000002,"15min":18.759},"last":0.29299999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:51:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":1.3859999999999999,"15min":1.6579999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.252},"max":{"1min":1.179,"5min":10.311,"15min":13.278},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":1.3009999999999999,"15min":1.5149999999999999},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1850000000000001,"5min":10.109,"15min":10.109},"last":0.47899999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:52:01 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":1.708,"15min":1.984},"min":{"1min":0.318,"5min":0.317,"15min":0.27600000000000002},"max":{"1min":1.014,"5min":25.442,"15min":42.799999999999997},"last":6.4199999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":1.696,"15min":2.0270000000000001},"min":{"1min":0.35799999999999998,"5min":0.33200000000000002,"15min":0.27300000000000002},"max":{"1min":0.65800000000000003,"5min":25.411999999999999,"15min":42.695},"last":6.4269999999999996}]},{"osd":6,"last update":"Mon Feb 19 21:52:16 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":1.3700000000000001,"15min":1.6459999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.27000000000000002},"max":{"1min":1.4390000000000001,"5min":10.278,"15min":42.777000000000001},"last":12.364000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":1.4890000000000001,"15min":1.845},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.28599999999999998},"max":{"1min":1.6539999999999999,"5min":11.84,"15min":13.289999999999999},"last":0.47299999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:51:52 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":1.3149999999999999,"15min":1.778},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.31},"max":{"1min":3.198,"5min":15.688000000000001,"15min":42.758000000000003},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":1.3009999999999999,"15min":1.6739999999999999},"min":{"1min":0.40300000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":3.21,"5min":9.6389999999999993,"15min":42.718000000000004},"last":0.64500000000000002}]}]},{"osd":2,"up_from":394,"seq":1692217114667,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1361144,"kb_used_data":1041136,"kb_used_omap":0,"kb_used_meta":319935,"kb_avail":92384008,"statfs":{"total":95995035648,"available":94601224192,"internally_reserved":0,"allocated":1066123264,"data_stored":1064741292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":327613492},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.91100000000000003,"15min":1.081},"min":{"1min":0.20300000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":3.1779999999999999,"5min":9.1530000000000005,"15min":9.1530000000000005},"last":4.9580000000000002},{"interface":"front","average":{"1min":0.29299999999999998,"5min":0.873,"15min":1.1060000000000001},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.435,"5min":6.149,"15min":6.149},"last":0.95599999999999996}]},{"osd":1,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55100000000000005,"15min":0.59799999999999998},"min":{"1min":0.20999999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":3.073,"5min":3.073,"15min":3.073},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.78500000000000003,"15min":0.90700000000000003},"min":{"1min":0.249,"5min":0.224,"15min":0.224},"max":{"1min":1.1439999999999999,"5min":6.992,"15min":6.992},"last":0.47199999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":1.115,"15min":1.3380000000000001},"min":{"1min":0.30599999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.117,"5min":6.9470000000000001,"15min":6.9470000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.96499999999999997,"15min":1.1830000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.48299999999999998,"5min":6.6500000000000004,"15min":6.6500000000000004},"last":0.93000000000000005}]},{"osd":4,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":1.54,"15min":1.952},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.7729999999999999,"5min":7.0339999999999998,"15min":7.0339999999999998},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":1.4399999999999999,"15min":1.784},"min":{"1min":0.38400000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.1699999999999999,"5min":7.0419999999999998,"15min":7.0419999999999998},"last":0.53700000000000003}]},{"osd":5,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":1.48,"15min":1.6859999999999999},"min":{"1min":0.36899999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":3.4300000000000002,"5min":10.067,"15min":10.067},"last":4.9950000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":1.3160000000000001,"15min":1.6519999999999999},"min":{"1min":0.33200000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.5,"5min":13.558,"15min":13.558},"last":1.383}]},{"osd":6,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":1.3080000000000001,"15min":1.6040000000000001},"min":{"1min":0.34200000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.1819999999999999,"5min":5.6829999999999998,"15min":5.6829999999999998},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.88300000000000001,"15min":0.98899999999999999},"min":{"1min":0.36699999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.024,"5min":7,"15min":7},"last":1.4530000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":1.177,"15min":1.361},"min":{"1min":0.39900000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67000000000000004,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.872},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.72699999999999998,"15min":0.80500000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.802,"5min":2.782,"15min":2.782},"last":0.98699999999999999}]}]},{"osd":3,"up_from":0,"seq":111669149966,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":32,"seq":137438953735,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2205120,"kb_used_data":1619512,"kb_used_omap":0,"kb_used_meta":585600,"kb_avail":91540032,"statfs":{"total":95995035648,"available":93736992768,"internally_reserved":0,"allocated":1658380288,"data_stored":1656989470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":599654400},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,0,0,0,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:52:34 2024","interfaces":[{"interface":"back","average":{"1min":1.9099999999999999,"5min":1.857,"15min":1.885},"min":{"1min":0.25900000000000001,"5min":0.219,"15min":0.219},"max":{"1min":9.923,"5min":53.936,"15min":53.936},"last":2.056},{"interface":"front","average":{"1min":1.595,"5min":2.012,"15min":1.972},"min":{"1min":0.27200000000000002,"5min":0.252,"15min":0.22600000000000001},"max":{"1min":10.140000000000001,"5min":54.405999999999999,"15min":54.405999999999999},"last":4.4610000000000003}]},{"osd":1,"last update":"Mon Feb 19 21:52:34 2024","interfaces":[{"interface":"back","average":{"1min":2.0230000000000001,"5min":2.012,"15min":1.8260000000000001},"min":{"1min":0.26100000000000001,"5min":0.253,"15min":0.21199999999999999},"max":{"1min":12.439,"5min":54.731000000000002,"15min":54.731000000000002},"last":1.948},{"interface":"front","average":{"1min":1.532,"5min":1.9330000000000001,"15min":1.704},"min":{"1min":0.29499999999999998,"5min":0.252,"15min":0.25},"max":{"1min":8.4689999999999994,"5min":52.490000000000002,"15min":52.490000000000002},"last":2.1150000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":1.444,"15min":1.8660000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.2070000000000001,"5min":9.0619999999999994,"15min":9.0619999999999994},"last":1.974},{"interface":"front","average":{"1min":0.496,"5min":1.4830000000000001,"15min":1.903},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.2370000000000001,"5min":9.0899999999999999,"15min":9.0899999999999999},"last":1.998}]},{"osd":3,"last update":"Mon Feb 19 21:52:34 2024","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.3480000000000001,"15min":1.702},"min":{"1min":0.35099999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":9.9529999999999994,"5min":9.9529999999999994,"15min":15.914999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":2.1560000000000001,"5min":1.4970000000000001,"15min":1.6950000000000001},"min":{"1min":0.36299999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":12.486000000000001,"5min":12.486000000000001,"15min":13.321},"last":2.0299999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:52:28 2024","interfaces":[{"interface":"back","average":{"1min":2.1320000000000001,"5min":1.921,"15min":1.865},"min":{"1min":0.28100000000000003,"5min":0.23799999999999999,"15min":0.23400000000000001},"max":{"1min":13.458,"5min":16.731999999999999,"15min":18.916},"last":4.4930000000000003},{"interface":"front","average":{"1min":1.8740000000000001,"5min":1.653,"15min":2.044},"min":{"1min":0.30399999999999999,"5min":0.26700000000000002,"15min":0.253},"max":{"1min":14.532999999999999,"5min":14.532999999999999,"15min":14.840999999999999},"last":0.36199999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:52:34 2024","interfaces":[{"interface":"back","average":{"1min":2.4369999999999998,"5min":1.698,"15min":1.7649999999999999},"min":{"1min":0.33600000000000002,"5min":0.28999999999999998,"15min":0.28599999999999998},"max":{"1min":10.233000000000001,"5min":10.233000000000001,"15min":13.27},"last":4.4480000000000004},{"interface":"front","average":{"1min":2.4470000000000001,"5min":2.1699999999999999,"15min":1.9710000000000001},"min":{"1min":0.32900000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":13.433999999999999,"5min":18.670000000000002,"15min":18.670000000000002},"last":2.0899999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:52:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":1.7350000000000001,"15min":1.7849999999999999},"min":{"1min":0.36399999999999999,"5min":0.311,"15min":0.30399999999999999},"max":{"1min":2.8679999999999999,"5min":16.763999999999999,"15min":16.763999999999999},"last":4.5170000000000003},{"interface":"front","average":{"1min":0.80900000000000005,"5min":1.403,"15min":1.6970000000000001},"min":{"1min":0.36299999999999999,"5min":0.32400000000000001,"15min":0.31},"max":{"1min":2.5310000000000001,"5min":10.044,"15min":12.808999999999999},"last":0.5}]}]},{"osd":5,"up_from":38,"seq":163208757507,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1946036,"kb_used_data":1047404,"kb_used_omap":0,"kb_used_meta":898624,"kb_avail":91799116,"statfs":{"total":95995035648,"available":94002294784,"internally_reserved":0,"allocated":1072541696,"data_stored":1071163265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":920190976},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":1.306,"15min":1.728},"min":{"1min":0.24199999999999999,"5min":0.23100000000000001,"15min":0.20599999999999999},"max":{"1min":2.96,"5min":19.236000000000001,"15min":20.550999999999998},"last":3.5009999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":1.204,"15min":1.853},"min":{"1min":0.24099999999999999,"5min":0.23699999999999999,"15min":0.20899999999999999},"max":{"1min":0.52800000000000002,"5min":10.887,"15min":20.879000000000001},"last":5.7370000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":1.1890000000000001,"15min":1.663},"min":{"1min":0.246,"5min":0.246,"15min":0.23100000000000001},"max":{"1min":0.51500000000000001,"5min":8.2010000000000005,"15min":10.42},"last":5.8179999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":1.05,"15min":1.5449999999999999},"min":{"1min":0.29099999999999998,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":2.794,"5min":10.315,"15min":10.965},"last":0.249}]},{"osd":2,"last update":"Mon Feb 19 21:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":1.131,"15min":1.3080000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":3.9470000000000001,"5min":7.0380000000000003,"15min":7.0380000000000003},"last":3.5310000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":1.0940000000000001,"15min":1.24},"min":{"1min":0.309,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.9119999999999999,"5min":4.2619999999999996,"15min":4.2619999999999996},"last":5.7729999999999997}]},{"osd":3,"last update":"Mon Feb 19 21:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":1.4319999999999999,"15min":1.998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.24099999999999999},"max":{"1min":2.9039999999999999,"5min":19.321000000000002,"15min":20.146999999999998},"last":3.5529999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":1.24,"15min":2.0680000000000001},"min":{"1min":0.35899999999999999,"5min":0.33600000000000002,"15min":0.29499999999999998},"max":{"1min":2.883,"5min":8.0359999999999996,"15min":20.120000000000001},"last":5.7960000000000003}]},{"osd":4,"last update":"Mon Feb 19 21:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.95299999999999996,"15min":1.4059999999999999},"min":{"1min":0.26200000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":2.7280000000000002,"5min":7.6710000000000003,"15min":21.577000000000002},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":1.6040000000000001,"15min":1.879},"min":{"1min":0.317,"5min":0.26100000000000001,"15min":0.25600000000000001},"max":{"1min":0.872,"5min":19.274000000000001,"15min":19.274000000000001},"last":3.5779999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.641,"5min":1.954,"15min":1.9970000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.221},"max":{"1min":10.611000000000001,"5min":19.884,"15min":19.884},"last":3.6240000000000001},{"interface":"front","average":{"1min":1.8620000000000001,"5min":1.6599999999999999,"15min":1.9399999999999999},"min":{"1min":0.378,"5min":0.30199999999999999,"15min":0.23599999999999999},"max":{"1min":6.6500000000000004,"5min":10.260999999999999,"15min":13.532999999999999},"last":5.8760000000000003}]},{"osd":7,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":1.7110000000000001,"15min":2.0150000000000001},"min":{"1min":0.34200000000000003,"5min":0.33500000000000002,"15min":0.27100000000000002},"max":{"1min":1.976,"5min":12.611000000000001,"15min":12.962},"last":5.9020000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":1.611,"15min":1.843},"min":{"1min":0.38100000000000001,"5min":0.221,"15min":0.221},"max":{"1min":2.0099999999999998,"5min":15.593999999999999,"15min":17.759},"last":3.3690000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1400377344,"data_stored":1400373272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":556859392,"data_stored":556859392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1037828096,"data_stored":1037828096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1649086464,"data_stored":1649082392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1054736384,"data_stored":1054736384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":973148160,"data_stored":973144088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":506200064,"data_stored":506200064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:52:51.093 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:52:51.096 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:52:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:52:50] "GET /metrics HTTP/1.1" 200 176613 "" "Prometheus/2.33.4" 2024-02-19T21:52:51.104 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:51.104 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:52:51.114 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:52:51.146 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:52:51.177 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:52:51.205 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:52:51.220 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:52:51.259 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:52:51.294 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:52:51.314 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:51.338 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:52:51.374 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:52:51.375 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:52:51.375 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:52:51.375 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:52:51.375 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:52:51.375 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:52:51.376 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:52:51.376 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:52:51.376 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:52:51.399 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:50.321985+0000 mon.a (mon.0) 1821 : cluster [WRN] Health check update: Degraded data redundancy: 1154/101469 objects degraded (1.137%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:51.399 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:50.327637+0000 mon.a (mon.0) 1822 : cluster [DBG] osdmap e474: 8 total, 8 up, 7 in 2024-02-19T21:52:51.399 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:50.935635+0000 mon.a (mon.0) 1823 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:52:51.399 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:51.084039+0000 mon.b (mon.1) 72 : audit [DBG] from='client.? 172.21.15.80:0/124539608' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:52:51.399 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:50.321985+0000 mon.a (mon.0) 1821 : cluster [WRN] Health check update: Degraded data redundancy: 1154/101469 objects degraded (1.137%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:51.399 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:50.327637+0000 mon.a (mon.0) 1822 : cluster [DBG] osdmap e474: 8 total, 8 up, 7 in 2024-02-19T21:52:51.399 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:50.935635+0000 mon.a (mon.0) 1823 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:52:51.399 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:51.084039+0000 mon.b (mon.1) 72 : audit [DBG] from='client.? 172.21.15.80:0/124539608' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:52:51.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:50.321985+0000 mon.a (mon.0) 1821 : cluster [WRN] Health check update: Degraded data redundancy: 1154/101469 objects degraded (1.137%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:51.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:50.327637+0000 mon.a (mon.0) 1822 : cluster [DBG] osdmap e474: 8 total, 8 up, 7 in 2024-02-19T21:52:51.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:50.935635+0000 mon.a (mon.0) 1823 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:52:51.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:51.084039+0000 mon.b (mon.1) 72 : audit [DBG] from='client.? 172.21.15.80:0/124539608' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:52:51.557 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:52:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:52:52.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:51.112969+0000 mgr.y (mgr.14514) 775 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:52:52.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:51.220385+0000 mgr.y (mgr.14514) 776 : cluster [DBG] pgmap v1006: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 1.8 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.07k op/s; 1375/89265 objects degraded (1.540%); 2351/89265 objects misplaced (2.634%); 3.3 MiB/s, 52 objects/s recovering 2024-02-19T21:52:52.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:52.015669+0000 mon.a (mon.0) 1824 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:52:52.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:52.016320+0000 mon.a (mon.0) 1825 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:52:52.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:52.021292+0000 mon.a (mon.0) 1826 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:52:52.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:51.112969+0000 mgr.y (mgr.14514) 775 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:52:52.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:51.220385+0000 mgr.y (mgr.14514) 776 : cluster [DBG] pgmap v1006: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 1.8 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.07k op/s; 1375/89265 objects degraded (1.540%); 2351/89265 objects misplaced (2.634%); 3.3 MiB/s, 52 objects/s recovering 2024-02-19T21:52:52.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:52.015669+0000 mon.a (mon.0) 1824 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:52:52.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:52.016320+0000 mon.a (mon.0) 1825 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:52:52.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:52.021292+0000 mon.a (mon.0) 1826 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:52:52.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:51.112969+0000 mgr.y (mgr.14514) 775 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:52:52.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:51.220385+0000 mgr.y (mgr.14514) 776 : cluster [DBG] pgmap v1006: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 1.8 GiB data, 11 GiB used, 615 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.07k op/s; 1375/89265 objects degraded (1.540%); 2351/89265 objects misplaced (2.634%); 3.3 MiB/s, 52 objects/s recovering 2024-02-19T21:52:52.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:52.015669+0000 mon.a (mon.0) 1824 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:52:52.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:52.016320+0000 mon.a (mon.0) 1825 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:52:52.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:52.021292+0000 mon.a (mon.0) 1826 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:52:52.402 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:52:52.408 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:52.408 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:52:52.509 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:52:52.571 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:52.722 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:52:52.728 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:52.728 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:52:52.806 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset noscrub 2024-02-19T21:52:52.829 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:52:52.888 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:52.924 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:52:52.928 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:52.929 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:52:53.029 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:52:53.120 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:53.123 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:52:53.123 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:52:53.160 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:52:53.161 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:52:53.165 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:53.166 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:52:53.267 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:52:53.328 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:53.373 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:52:53.381 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:53.382 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:52:53.483 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:52:53.543 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:53.706 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:52:54.106 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:52:54.560 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:53.220911+0000 mgr.y (mgr.14514) 777 : cluster [DBG] pgmap v1007: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 1.8 GiB data, 10 GiB used, 615 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 822 op/s; 1375/87558 objects degraded (1.570%); 1999/87558 objects misplaced (2.283%); 6.1 MiB/s, 96 objects/s recovering 2024-02-19T21:52:54.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:53.220911+0000 mgr.y (mgr.14514) 777 : cluster [DBG] pgmap v1007: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 1.8 GiB data, 10 GiB used, 615 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 822 op/s; 1375/87558 objects degraded (1.570%); 1999/87558 objects misplaced (2.283%); 6.1 MiB/s, 96 objects/s recovering 2024-02-19T21:52:54.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:53.220911+0000 mgr.y (mgr.14514) 777 : cluster [DBG] pgmap v1007: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 1.8 GiB data, 10 GiB used, 615 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 822 op/s; 1375/87558 objects degraded (1.570%); 1999/87558 objects misplaced (2.283%); 6.1 MiB/s, 96 objects/s recovering 2024-02-19T21:52:54.702 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.2 dump_ops_in_flight 2024-02-19T21:52:54.730 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:52:54.735 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:54.735 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:52:54.836 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:52:54.889 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:55.729 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:52:55.762 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:52:55.768 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:55.769 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:52:55.869 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:52:55.926 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:52:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:52:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:52:55.938 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:55.975 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:52:55.980 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:55.981 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:52:56.081 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:52:56.130 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:56.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:55.221596+0000 mgr.y (mgr.14514) 778 : cluster [DBG] pgmap v1008: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 1.6 GiB data, 10 GiB used, 616 GiB / 626 GiB avail; 575 B/s rd, 0 B/s wr, 875 op/s; 1375/79824 objects degraded (1.723%); 1999/79824 objects misplaced (2.504%); 5.0 MiB/s, 80 objects/s recovering 2024-02-19T21:52:56.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:55.323986+0000 mon.a (mon.0) 1827 : cluster [WRN] Health check update: Degraded data redundancy: 1375/79824 objects degraded (1.723%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:56.545 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:55.221596+0000 mgr.y (mgr.14514) 778 : cluster [DBG] pgmap v1008: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 1.6 GiB data, 10 GiB used, 616 GiB / 626 GiB avail; 575 B/s rd, 0 B/s wr, 875 op/s; 1375/79824 objects degraded (1.723%); 1999/79824 objects misplaced (2.504%); 5.0 MiB/s, 80 objects/s recovering 2024-02-19T21:52:56.545 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:55.323986+0000 mon.a (mon.0) 1827 : cluster [WRN] Health check update: Degraded data redundancy: 1375/79824 objects degraded (1.723%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:56.545 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:55.221596+0000 mgr.y (mgr.14514) 778 : cluster [DBG] pgmap v1008: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 1.6 GiB data, 10 GiB used, 616 GiB / 626 GiB avail; 575 B/s rd, 0 B/s wr, 875 op/s; 1375/79824 objects degraded (1.723%); 1999/79824 objects misplaced (2.504%); 5.0 MiB/s, 80 objects/s recovering 2024-02-19T21:52:56.545 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:55.323986+0000 mon.a (mon.0) 1827 : cluster [WRN] Health check update: Degraded data redundancy: 1375/79824 objects degraded (1.723%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-19T21:52:57.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:56.853297+0000 mon.c (mon.2) 116 : audit [INF] from='client.? 172.21.15.80:0/1449777190' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:52:57.475 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-02-19T21:52:57.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:56.853922+0000 mon.a (mon.0) 1828 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:52:57.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:56.853297+0000 mon.c (mon.2) 116 : audit [INF] from='client.? 172.21.15.80:0/1449777190' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:52:57.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:56.853922+0000 mon.a (mon.0) 1828 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:52:57.684 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:52:57.688 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:57.688 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:52:57.753 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:52:57.753 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:52:57.789 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:52:57.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:56.853297+0000 mon.c (mon.2) 116 : audit [INF] from='client.? 172.21.15.80:0/1449777190' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:52:57.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:56.853922+0000 mon.a (mon.0) 1828 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:52:57.860 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:57.910 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:52:57.914 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:57.915 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:52:58.015 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:52:58.068 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:58.092 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:52:58.100 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:58.101 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:52:58.201 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:52:58.284 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:58.321 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:52:58.322 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:57.222260+0000 mgr.y (mgr.14514) 779 : cluster [DBG] pgmap v1009: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 1.5 GiB data, 9.8 GiB used, 616 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 914 op/s; 1579/75741 objects degraded (2.085%); 1737/75741 objects misplaced (2.293%); 4.8 MiB/s, 77 objects/s recovering 2024-02-19T21:52:58.322 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:57.290589+0000 mon.a (mon.0) 1829 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:52:58.322 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:57.313354+0000 mon.a (mon.0) 1830 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:52:58.322 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:57.313422+0000 mon.a (mon.0) 1831 : cluster [DBG] osdmap e475: 8 total, 8 up, 7 in 2024-02-19T21:52:58.324 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:58.325 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:52:58.426 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:52:58.493 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:58.527 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:52:58.538 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:58.538 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:52:58.543 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:57.222260+0000 mgr.y (mgr.14514) 779 : cluster [DBG] pgmap v1009: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 1.5 GiB data, 9.8 GiB used, 616 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 914 op/s; 1579/75741 objects degraded (2.085%); 1737/75741 objects misplaced (2.293%); 4.8 MiB/s, 77 objects/s recovering 2024-02-19T21:52:58.543 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:57.290589+0000 mon.a (mon.0) 1829 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:52:58.543 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:57.313354+0000 mon.a (mon.0) 1830 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:52:58.543 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:57.313422+0000 mon.a (mon.0) 1831 : cluster [DBG] osdmap e475: 8 total, 8 up, 7 in 2024-02-19T21:52:58.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:57.222260+0000 mgr.y (mgr.14514) 779 : cluster [DBG] pgmap v1009: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 1.5 GiB data, 9.8 GiB used, 616 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 914 op/s; 1579/75741 objects degraded (2.085%); 1737/75741 objects misplaced (2.293%); 4.8 MiB/s, 77 objects/s recovering 2024-02-19T21:52:58.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:57.290589+0000 mon.a (mon.0) 1829 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:52:58.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:57.313354+0000 mon.a (mon.0) 1830 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:52:58.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:57.313422+0000 mon.a (mon.0) 1831 : cluster [DBG] osdmap e475: 8 total, 8 up, 7 in 2024-02-19T21:52:58.639 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:52:58.704 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:58.742 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:52:58.751 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:58.752 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:52:58.852 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:52:58.900 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:58.939 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:52:58.944 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:58.945 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:52:59.046 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:52:59.086 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:59.113 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:52:59.119 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:59.119 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:52:59.220 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:52:59.266 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:59.301 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:52:59.305 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:59.306 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:52:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:52:59.372 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:52:59.407 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:52:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:59.516 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:52:59.522 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:52:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:52:58.627675+0000 mgr.y (mgr.14514) 780 : audit [DBG] from='client.25853 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:52:59.523 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:59.523 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:52:59.595 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:52:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:52:58.627675+0000 mgr.y (mgr.14514) 780 : audit [DBG] from='client.25853 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:52:59.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:52:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:52:58.627675+0000 mgr.y (mgr.14514) 780 : audit [DBG] from='client.25853 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:52:59.623 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:52:59.693 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:59.745 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:52:59.753 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:59.754 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:52:59.854 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:52:59.921 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:52:59.944 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:52:59.953 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:52:59.954 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:53:00.055 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:53:00.125 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:00.333 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:58.701612+0000 osd.0 (osd.0) 271 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:53:00.333 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:58.701667+0000 osd.0 (osd.0) 272 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:53:00.333 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:59.222690+0000 mgr.y (mgr.14514) 781 : cluster [DBG] pgmap v1011: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 1.5 GiB data, 9.7 GiB used, 616 GiB / 626 GiB avail; 575 B/s rd, 0 B/s wr, 638 op/s; 1579/73977 objects degraded (2.134%); 1334/73977 objects misplaced (1.803%); 6.1 MiB/s, 97 objects/s recovering 2024-02-19T21:53:00.333 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:52:59.340496+0000 mon.a (mon.0) 1832 : cluster [DBG] osdmap e476: 8 total, 8 up, 7 in 2024-02-19T21:53:00.333 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:00.325775+0000 mon.a (mon.0) 1833 : cluster [WRN] Health check update: Degraded data redundancy: 1579/73977 objects degraded (2.134%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-19T21:53:00.334 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:58.701612+0000 osd.0 (osd.0) 271 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:53:00.334 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:58.701667+0000 osd.0 (osd.0) 272 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:53:00.334 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:59.222690+0000 mgr.y (mgr.14514) 781 : cluster [DBG] pgmap v1011: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 1.5 GiB data, 9.7 GiB used, 616 GiB / 626 GiB avail; 575 B/s rd, 0 B/s wr, 638 op/s; 1579/73977 objects degraded (2.134%); 1334/73977 objects misplaced (1.803%); 6.1 MiB/s, 97 objects/s recovering 2024-02-19T21:53:00.334 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:52:59.340496+0000 mon.a (mon.0) 1832 : cluster [DBG] osdmap e476: 8 total, 8 up, 7 in 2024-02-19T21:53:00.334 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:00.325775+0000 mon.a (mon.0) 1833 : cluster [WRN] Health check update: Degraded data redundancy: 1579/73977 objects degraded (2.134%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-19T21:53:00.561 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":1010,"stamp":"2024-02-19T21:52:57.310140+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1603409596,"num_objects":24659,"num_object_clones":0,"num_object_copies":73977,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1579,"num_objects_misplaced":1334,"num_objects_unfound":0,"num_objects_dirty":24659,"num_whiteouts":0,"num_read":2765,"num_read_kb":2517,"num_write":126027,"num_write_kb":4783849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14971,"num_bytes_recovered":940186504,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82160,"ondisk_log_size":82160,"up":414,"acting":412,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":417,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":656216064,"kb_used":10122208,"kb_used_data":5314664,"kb_used_omap":0,"kb_used_meta":4807231,"kb_avail":646093856,"statfs":{"total":671965249536,"available":661600108544,"internally_reserved":0,"allocated":5442215936,"data_stored":5432372370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":4922604596},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,1,6,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-600571904,"num_objects":-9164,"num_object_clones":0,"num_object_copies":-27492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":425,"num_objects_misplaced":-1296,"num_objects_unfound":0,"num_objects_dirty":-9164,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":9164,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":871,"num_bytes_recovered":57081856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.090533"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":70,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.351050+0000","last_change":"2024-02-19T21:49:54.492937+0000","last_active":"2024-02-19T21:52:46.351050+0000","last_peered":"2024-02-19T21:52:46.351050+0000","last_clean":"2024-02-19T21:52:46.351050+0000","last_became_active":"2024-02-19T21:49:54.492544+0000","last_became_peered":"2024-02-19T21:49:54.492544+0000","last_unstale":"2024-02-19T21:52:46.351050+0000","last_undegraded":"2024-02-19T21:52:46.351050+0000","last_fullsized":"2024-02-19T21:52:46.351050+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.643236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.643236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":449,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.347158+0000","last_change":"2024-02-19T21:45:17.201007+0000","last_active":"2024-02-19T21:52:46.347158+0000","last_peered":"2024-02-19T21:52:46.347158+0000","last_clean":"2024-02-19T21:52:46.347158+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:52:46.347158+0000","last_undegraded":"2024-02-19T21:52:46.347158+0000","last_fullsized":"2024-02-19T21:52:46.347158+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:17.200897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:17.200897+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"471'39","reported_seq":136,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.335299+0000","last_change":"2024-02-19T21:49:08.327817+0000","last_active":"2024-02-19T21:52:46.335299+0000","last_peered":"2024-02-19T21:52:46.335299+0000","last_clean":"2024-02-19T21:52:46.335299+0000","last_became_active":"2024-02-19T21:49:08.327416+0000","last_became_peered":"2024-02-19T21:49:08.327416+0000","last_unstale":"2024-02-19T21:52:46.335299+0000","last_undegraded":"2024-02-19T21:52:46.335299+0000","last_fullsized":"2024-02-19T21:52:46.335299+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'27","last_scrub_stamp":"2024-02-19T21:44:48.022013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:48.022013+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":422,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.347493+0000","last_change":"2024-02-19T21:48:30.516215+0000","last_active":"2024-02-19T21:52:46.347493+0000","last_peered":"2024-02-19T21:52:46.347493+0000","last_clean":"2024-02-19T21:52:46.347493+0000","last_became_active":"2024-02-19T21:47:46.250178+0000","last_became_peered":"2024-02-19T21:47:46.250178+0000","last_unstale":"2024-02-19T21:52:46.347493+0000","last_undegraded":"2024-02-19T21:52:46.347493+0000","last_fullsized":"2024-02-19T21:52:46.347493+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.516139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.516139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":145,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.348133+0000","last_change":"2024-02-19T21:49:08.330105+0000","last_active":"2024-02-19T21:52:46.348133+0000","last_peered":"2024-02-19T21:52:46.348133+0000","last_clean":"2024-02-19T21:52:46.348133+0000","last_became_active":"2024-02-19T21:49:08.328994+0000","last_became_peered":"2024-02-19T21:49:08.328994+0000","last_unstale":"2024-02-19T21:52:46.348133+0000","last_undegraded":"2024-02-19T21:52:46.348133+0000","last_fullsized":"2024-02-19T21:52:46.348133+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.636083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.636083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"470'25","reported_seq":527,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.348045+0000","last_change":"2024-02-19T21:48:26.530234+0000","last_active":"2024-02-19T21:52:46.348045+0000","last_peered":"2024-02-19T21:52:46.348045+0000","last_clean":"2024-02-19T21:52:46.348045+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:52:46.348045+0000","last_undegraded":"2024-02-19T21:52:46.348045+0000","last_fullsized":"2024-02-19T21:52:46.348045+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:48:26.530160+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.530160+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":206,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.357001+0000","last_change":"2024-02-19T21:49:08.332091+0000","last_active":"2024-02-19T21:52:46.357001+0000","last_peered":"2024-02-19T21:52:46.357001+0000","last_clean":"2024-02-19T21:52:46.357001+0000","last_became_active":"2024-02-19T21:49:08.331753+0000","last_became_peered":"2024-02-19T21:49:08.331753+0000","last_unstale":"2024-02-19T21:52:46.357001+0000","last_undegraded":"2024-02-19T21:52:46.357001+0000","last_fullsized":"2024-02-19T21:52:46.357001+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.005236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.005236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":462,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.350012+0000","last_change":"2024-02-19T21:48:28.327028+0000","last_active":"2024-02-19T21:52:46.350012+0000","last_peered":"2024-02-19T21:52:46.350012+0000","last_clean":"2024-02-19T21:52:46.350012+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:52:46.350012+0000","last_undegraded":"2024-02-19T21:52:46.350012+0000","last_fullsized":"2024-02-19T21:52:46.350012+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.326938+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"470'11","reported_seq":459,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.347050+0000","last_change":"2024-02-19T21:52:28.229053+0000","last_active":"2024-02-19T21:52:46.347050+0000","last_peered":"2024-02-19T21:52:46.347050+0000","last_clean":"2024-02-19T21:52:46.347050+0000","last_became_active":"2024-02-19T21:49:08.329314+0000","last_became_peered":"2024-02-19T21:49:08.329314+0000","last_unstale":"2024-02-19T21:52:46.347050+0000","last_undegraded":"2024-02-19T21:52:46.347050+0000","last_fullsized":"2024-02-19T21:52:46.347050+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"310'9","last_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_deep_scrub":"310'9","last_deep_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.506188+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":383,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.348641+0000","last_change":"2024-02-19T21:46:31.205220+0000","last_active":"2024-02-19T21:52:46.348641+0000","last_peered":"2024-02-19T21:52:46.348641+0000","last_clean":"2024-02-19T21:52:46.348641+0000","last_became_active":"2024-02-19T21:46:31.204816+0000","last_became_peered":"2024-02-19T21:46:31.204816+0000","last_unstale":"2024-02-19T21:52:46.348641+0000","last_undegraded":"2024-02-19T21:52:46.348641+0000","last_fullsized":"2024-02-19T21:52:46.348641+0000","mapping_epoch":330,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":331,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:36.890201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.890201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":484,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.350816+0000","last_change":"2024-02-19T21:49:08.330669+0000","last_active":"2024-02-19T21:52:46.350816+0000","last_peered":"2024-02-19T21:52:46.350816+0000","last_clean":"2024-02-19T21:52:46.350816+0000","last_became_active":"2024-02-19T21:49:08.329998+0000","last_became_peered":"2024-02-19T21:49:08.329998+0000","last_unstale":"2024-02-19T21:52:46.350816+0000","last_undegraded":"2024-02-19T21:52:46.350816+0000","last_fullsized":"2024-02-19T21:52:46.350816+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:58.329316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:58.329316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"470'25","reported_seq":337,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.347656+0000","last_change":"2024-02-19T21:49:08.326162+0000","last_active":"2024-02-19T21:52:46.347656+0000","last_peered":"2024-02-19T21:52:46.347656+0000","last_clean":"2024-02-19T21:52:46.347656+0000","last_became_active":"2024-02-19T21:49:08.325802+0000","last_became_peered":"2024-02-19T21:49:08.325802+0000","last_unstale":"2024-02-19T21:52:46.347656+0000","last_undegraded":"2024-02-19T21:52:46.347656+0000","last_fullsized":"2024-02-19T21:52:46.347656+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:46:54.873416+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:46:54.873416+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2],"acting":[4,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":394,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.350691+0000","last_change":"2024-02-19T21:49:04.432817+0000","last_active":"2024-02-19T21:52:46.350691+0000","last_peered":"2024-02-19T21:52:46.350691+0000","last_clean":"2024-02-19T21:52:46.350691+0000","last_became_active":"2024-02-19T21:47:33.393708+0000","last_became_peered":"2024-02-19T21:47:33.393708+0000","last_unstale":"2024-02-19T21:52:46.350691+0000","last_undegraded":"2024-02-19T21:52:46.350691+0000","last_fullsized":"2024-02-19T21:52:46.350691+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:04.432733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:04.432733+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":70,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.351127+0000","last_change":"2024-02-19T21:49:54.492767+0000","last_active":"2024-02-19T21:52:46.351127+0000","last_peered":"2024-02-19T21:52:46.351127+0000","last_clean":"2024-02-19T21:52:46.351127+0000","last_became_active":"2024-02-19T21:49:54.491745+0000","last_became_peered":"2024-02-19T21:49:54.491745+0000","last_unstale":"2024-02-19T21:52:46.351127+0000","last_undegraded":"2024-02-19T21:52:46.351127+0000","last_fullsized":"2024-02-19T21:52:46.351127+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.232539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.232539+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1d","version":"471'24","reported_seq":421,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.350720+0000","last_change":"2024-02-19T21:48:25.734661+0000","last_active":"2024-02-19T21:52:46.350720+0000","last_peered":"2024-02-19T21:52:46.350720+0000","last_clean":"2024-02-19T21:52:46.350720+0000","last_became_active":"2024-02-19T21:38:31.247067+0000","last_became_peered":"2024-02-19T21:38:31.247067+0000","last_unstale":"2024-02-19T21:52:46.350720+0000","last_undegraded":"2024-02-19T21:52:46.350720+0000","last_fullsized":"2024-02-19T21:52:46.350720+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'18","last_scrub_stamp":"2024-02-19T21:48:25.734591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.734591+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":33,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":449,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.352422+0000","last_change":"2024-02-19T21:48:40.528082+0000","last_active":"2024-02-19T21:52:46.352422+0000","last_peered":"2024-02-19T21:52:46.352422+0000","last_clean":"2024-02-19T21:52:46.352422+0000","last_became_active":"2024-02-19T21:44:58.788307+0000","last_became_peered":"2024-02-19T21:44:58.788307+0000","last_unstale":"2024-02-19T21:52:46.352422+0000","last_undegraded":"2024-02-19T21:52:46.352422+0000","last_fullsized":"2024-02-19T21:52:46.352422+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:40.527970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:48:40.527970+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":457,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.347082+0000","last_change":"2024-02-19T21:48:11.557832+0000","last_active":"2024-02-19T21:52:46.347082+0000","last_peered":"2024-02-19T21:52:46.347082+0000","last_clean":"2024-02-19T21:52:46.347082+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:52:46.347082+0000","last_undegraded":"2024-02-19T21:52:46.347082+0000","last_fullsized":"2024-02-19T21:52:46.347082+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.557736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:17.913620+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.557736+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"470'46","reported_seq":137,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.336325+0000","last_change":"2024-02-19T21:49:08.332575+0000","last_active":"2024-02-19T21:52:46.336325+0000","last_peered":"2024-02-19T21:52:46.336325+0000","last_clean":"2024-02-19T21:52:46.336325+0000","last_became_active":"2024-02-19T21:49:08.331742+0000","last_became_peered":"2024-02-19T21:49:08.331742+0000","last_unstale":"2024-02-19T21:52:46.336325+0000","last_undegraded":"2024-02-19T21:52:46.336325+0000","last_fullsized":"2024-02-19T21:52:46.336325+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'34","last_scrub_stamp":"2024-02-19T21:45:49.728734+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:45:49.728734+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":469,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.350251+0000","last_change":"2024-02-19T21:46:44.994389+0000","last_active":"2024-02-19T21:52:46.350251+0000","last_peered":"2024-02-19T21:52:46.350251+0000","last_clean":"2024-02-19T21:52:46.350251+0000","last_became_active":"2024-02-19T21:44:58.790669+0000","last_became_peered":"2024-02-19T21:44:58.790669+0000","last_unstale":"2024-02-19T21:52:46.350251+0000","last_undegraded":"2024-02-19T21:52:46.350251+0000","last_fullsized":"2024-02-19T21:52:46.350251+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.994296+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":405,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.345280+0000","last_change":"2024-02-19T21:49:08.330330+0000","last_active":"2024-02-19T21:52:46.345280+0000","last_peered":"2024-02-19T21:52:46.345280+0000","last_clean":"2024-02-19T21:52:46.345280+0000","last_became_active":"2024-02-19T21:49:08.329986+0000","last_became_peered":"2024-02-19T21:49:08.329986+0000","last_unstale":"2024-02-19T21:52:46.345280+0000","last_undegraded":"2024-02-19T21:52:46.345280+0000","last_fullsized":"2024-02-19T21:52:46.345280+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.091409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.091409+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"471'27","reported_seq":365,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.347074+0000","last_change":"2024-02-19T21:48:26.366639+0000","last_active":"2024-02-19T21:52:46.347074+0000","last_peered":"2024-02-19T21:52:46.347074+0000","last_clean":"2024-02-19T21:52:46.347074+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:52:46.347074+0000","last_undegraded":"2024-02-19T21:52:46.347074+0000","last_fullsized":"2024-02-19T21:52:46.347074+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:26.366563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.366563+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":36,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":330,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.350593+0000","last_change":"2024-02-19T21:51:22.461995+0000","last_active":"2024-02-19T21:52:46.350593+0000","last_peered":"2024-02-19T21:52:46.350593+0000","last_clean":"2024-02-19T21:52:46.350593+0000","last_became_active":"2024-02-19T21:51:22.461599+0000","last_became_peered":"2024-02-19T21:51:22.461599+0000","last_unstale":"2024-02-19T21:52:46.350593+0000","last_undegraded":"2024-02-19T21:52:46.350593+0000","last_fullsized":"2024-02-19T21:52:46.350593+0000","mapping_epoch":445,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":446,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:13.196112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:13.196112+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":469,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.350374+0000","last_change":"2024-02-19T21:49:54.491840+0000","last_active":"2024-02-19T21:52:46.350374+0000","last_peered":"2024-02-19T21:52:46.350374+0000","last_clean":"2024-02-19T21:52:46.350374+0000","last_became_active":"2024-02-19T21:49:54.491488+0000","last_became_peered":"2024-02-19T21:49:54.491488+0000","last_unstale":"2024-02-19T21:52:46.350374+0000","last_undegraded":"2024-02-19T21:52:46.350374+0000","last_fullsized":"2024-02-19T21:52:46.350374+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.803606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.803606+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"470'30","reported_seq":569,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.348242+0000","last_change":"2024-02-19T21:49:54.502402+0000","last_active":"2024-02-19T21:52:46.348242+0000","last_peered":"2024-02-19T21:52:46.348242+0000","last_clean":"2024-02-19T21:52:46.348242+0000","last_became_active":"2024-02-19T21:49:54.483748+0000","last_became_peered":"2024-02-19T21:49:54.483748+0000","last_unstale":"2024-02-19T21:52:46.348242+0000","last_undegraded":"2024-02-19T21:52:46.348242+0000","last_fullsized":"2024-02-19T21:52:46.348242+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:48:25.348437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.348437+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":389,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.347482+0000","last_change":"2024-02-19T21:49:08.328206+0000","last_active":"2024-02-19T21:52:46.347482+0000","last_peered":"2024-02-19T21:52:46.347482+0000","last_clean":"2024-02-19T21:52:46.347482+0000","last_became_active":"2024-02-19T21:49:08.327865+0000","last_became_peered":"2024-02-19T21:49:08.327865+0000","last_unstale":"2024-02-19T21:52:46.347482+0000","last_undegraded":"2024-02-19T21:52:46.347482+0000","last_fullsized":"2024-02-19T21:52:46.347482+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.230652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.230652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":449,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.349189+0000","last_change":"2024-02-19T21:48:22.171667+0000","last_active":"2024-02-19T21:52:46.349189+0000","last_peered":"2024-02-19T21:52:46.349189+0000","last_clean":"2024-02-19T21:52:46.349189+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:52:46.349189+0000","last_undegraded":"2024-02-19T21:52:46.349189+0000","last_fullsized":"2024-02-19T21:52:46.349189+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.171600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.171600+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":485,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.350763+0000","last_change":"2024-02-19T21:49:08.330636+0000","last_active":"2024-02-19T21:52:46.350763+0000","last_peered":"2024-02-19T21:52:46.350763+0000","last_clean":"2024-02-19T21:52:46.350763+0000","last_became_active":"2024-02-19T21:49:08.330293+0000","last_became_peered":"2024-02-19T21:49:08.330293+0000","last_unstale":"2024-02-19T21:52:46.350763+0000","last_undegraded":"2024-02-19T21:52:46.350763+0000","last_fullsized":"2024-02-19T21:52:46.350763+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:03.034839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:03.034839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"471'32","reported_seq":94,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.348777+0000","last_change":"2024-02-19T21:49:55.368481+0000","last_active":"2024-02-19T21:52:46.348777+0000","last_peered":"2024-02-19T21:52:46.348777+0000","last_clean":"2024-02-19T21:52:46.348777+0000","last_became_active":"2024-02-19T21:49:54.485438+0000","last_became_peered":"2024-02-19T21:49:54.485438+0000","last_unstale":"2024-02-19T21:52:46.348777+0000","last_undegraded":"2024-02-19T21:52:46.348777+0000","last_fullsized":"2024-02-19T21:52:46.348777+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"381'24","last_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_deep_scrub":"381'24","last_deep_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_clean_scrub_stamp":"2024-02-19T21:48:39.382725+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":36,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,5],"acting":[7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":477,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.350104+0000","last_change":"2024-02-19T21:49:17.193002+0000","last_active":"2024-02-19T21:52:46.350104+0000","last_peered":"2024-02-19T21:52:46.350104+0000","last_clean":"2024-02-19T21:52:46.350104+0000","last_became_active":"2024-02-19T21:49:08.333537+0000","last_became_peered":"2024-02-19T21:49:08.333537+0000","last_unstale":"2024-02-19T21:52:46.350104+0000","last_undegraded":"2024-02-19T21:52:46.350104+0000","last_fullsized":"2024-02-19T21:52:46.350104+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:59.339649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:45:59.339649+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":505,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.345358+0000","last_change":"2024-02-19T21:49:54.494561+0000","last_active":"2024-02-19T21:52:46.345358+0000","last_peered":"2024-02-19T21:52:46.345358+0000","last_clean":"2024-02-19T21:52:46.345358+0000","last_became_active":"2024-02-19T21:49:54.494146+0000","last_became_peered":"2024-02-19T21:49:54.494146+0000","last_unstale":"2024-02-19T21:52:46.345358+0000","last_undegraded":"2024-02-19T21:52:46.345358+0000","last_fullsized":"2024-02-19T21:52:46.345358+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.560066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":479,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.351283+0000","last_change":"2024-02-19T21:49:09.765641+0000","last_active":"2024-02-19T21:52:46.351283+0000","last_peered":"2024-02-19T21:52:46.351283+0000","last_clean":"2024-02-19T21:52:46.351283+0000","last_became_active":"2024-02-19T21:49:08.331308+0000","last_became_peered":"2024-02-19T21:49:08.331308+0000","last_unstale":"2024-02-19T21:52:46.351283+0000","last_undegraded":"2024-02-19T21:52:46.351283+0000","last_fullsized":"2024-02-19T21:52:46.351283+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.765568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.765568+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"470'12","reported_seq":172,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.352549+0000","last_change":"2024-02-19T21:47:33.577363+0000","last_active":"2024-02-19T21:52:46.352549+0000","last_peered":"2024-02-19T21:52:46.352549+0000","last_clean":"2024-02-19T21:52:46.352549+0000","last_became_active":"2024-02-19T21:47:33.395217+0000","last_became_peered":"2024-02-19T21:47:33.395217+0000","last_unstale":"2024-02-19T21:52:46.352549+0000","last_undegraded":"2024-02-19T21:52:46.352549+0000","last_fullsized":"2024-02-19T21:52:46.352549+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'8","last_scrub_stamp":"2024-02-19T21:46:47.761677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.761677+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":389,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.346993+0000","last_change":"2024-02-19T21:49:08.918163+0000","last_active":"2024-02-19T21:52:46.346993+0000","last_peered":"2024-02-19T21:52:46.346993+0000","last_clean":"2024-02-19T21:52:46.346993+0000","last_became_active":"2024-02-19T21:49:08.328416+0000","last_became_peered":"2024-02-19T21:49:08.328416+0000","last_unstale":"2024-02-19T21:52:46.346993+0000","last_undegraded":"2024-02-19T21:52:46.346993+0000","last_fullsized":"2024-02-19T21:52:46.346993+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.918083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.918083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":467,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.350486+0000","last_change":"2024-02-19T21:49:54.480716+0000","last_active":"2024-02-19T21:52:46.350486+0000","last_peered":"2024-02-19T21:52:46.350486+0000","last_clean":"2024-02-19T21:52:46.350486+0000","last_became_active":"2024-02-19T21:49:54.480368+0000","last_became_peered":"2024-02-19T21:49:54.480368+0000","last_unstale":"2024-02-19T21:52:46.350486+0000","last_undegraded":"2024-02-19T21:52:46.350486+0000","last_fullsized":"2024-02-19T21:52:46.350486+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:19.596775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:19.596775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":451,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.350489+0000","last_change":"2024-02-19T21:49:05.012463+0000","last_active":"2024-02-19T21:52:46.350489+0000","last_peered":"2024-02-19T21:52:46.350489+0000","last_clean":"2024-02-19T21:52:46.350489+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:52:46.350489+0000","last_undegraded":"2024-02-19T21:52:46.350489+0000","last_fullsized":"2024-02-19T21:52:46.350489+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.012395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.012395+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"470'27","reported_seq":510,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.347169+0000","last_change":"2024-02-19T21:48:38.529106+0000","last_active":"2024-02-19T21:52:46.347169+0000","last_peered":"2024-02-19T21:52:46.347169+0000","last_clean":"2024-02-19T21:52:46.347169+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:52:46.347169+0000","last_undegraded":"2024-02-19T21:52:46.347169+0000","last_fullsized":"2024-02-19T21:52:46.347169+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:38.528977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.528977+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":454,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.348128+0000","last_change":"2024-02-19T21:46:06.096531+0000","last_active":"2024-02-19T21:52:46.348128+0000","last_peered":"2024-02-19T21:52:46.348128+0000","last_clean":"2024-02-19T21:52:46.348128+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:52:46.348128+0000","last_undegraded":"2024-02-19T21:52:46.348128+0000","last_fullsized":"2024-02-19T21:52:46.348128+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.096422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":265,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.345912+0000","last_change":"2024-02-19T21:48:38.391532+0000","last_active":"2024-02-19T21:52:46.345912+0000","last_peered":"2024-02-19T21:52:46.345912+0000","last_clean":"2024-02-19T21:52:46.345912+0000","last_became_active":"2024-02-19T21:47:33.395085+0000","last_became_peered":"2024-02-19T21:47:33.395085+0000","last_unstale":"2024-02-19T21:52:46.345912+0000","last_undegraded":"2024-02-19T21:52:46.345912+0000","last_fullsized":"2024-02-19T21:52:46.345912+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:38.391435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.391435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":466,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.345509+0000","last_change":"2024-02-19T21:48:14.600378+0000","last_active":"2024-02-19T21:52:46.345509+0000","last_peered":"2024-02-19T21:52:46.345509+0000","last_clean":"2024-02-19T21:52:46.345509+0000","last_became_active":"2024-02-19T21:47:33.393932+0000","last_became_peered":"2024-02-19T21:47:33.393932+0000","last_unstale":"2024-02-19T21:52:46.345509+0000","last_undegraded":"2024-02-19T21:52:46.345509+0000","last_fullsized":"2024-02-19T21:52:46.345509+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:14.600285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.600285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"470'21","reported_seq":529,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.350368+0000","last_change":"2024-02-19T21:49:08.334199+0000","last_active":"2024-02-19T21:52:46.350368+0000","last_peered":"2024-02-19T21:52:46.350368+0000","last_clean":"2024-02-19T21:52:46.350368+0000","last_became_active":"2024-02-19T21:49:08.333872+0000","last_became_peered":"2024-02-19T21:49:08.333872+0000","last_unstale":"2024-02-19T21:52:46.350368+0000","last_undegraded":"2024-02-19T21:52:46.350368+0000","last_fullsized":"2024-02-19T21:52:46.350368+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:45:08.678669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:08.678669+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":432,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.360424+0000","last_change":"2024-02-19T21:49:08.330114+0000","last_active":"2024-02-19T21:52:46.360424+0000","last_peered":"2024-02-19T21:52:46.360424+0000","last_clean":"2024-02-19T21:52:46.360424+0000","last_became_active":"2024-02-19T21:49:08.329770+0000","last_became_peered":"2024-02-19T21:49:08.329770+0000","last_unstale":"2024-02-19T21:52:46.360424+0000","last_undegraded":"2024-02-19T21:52:46.360424+0000","last_fullsized":"2024-02-19T21:52:46.360424+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:08.983923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.983923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"415'17","reported_seq":110,"reported_epoch":474,"state":"active+clean","last_fresh":"2024-02-19T21:52:50.353781+0000","last_change":"2024-02-19T21:50:49.705247+0000","last_active":"2024-02-19T21:52:50.353781+0000","last_peered":"2024-02-19T21:52:50.353781+0000","last_clean":"2024-02-19T21:52:50.353781+0000","last_became_active":"2024-02-19T21:49:54.486304+0000","last_became_peered":"2024-02-19T21:49:54.486304+0000","last_unstale":"2024-02-19T21:52:50.353781+0000","last_undegraded":"2024-02-19T21:52:50.353781+0000","last_fullsized":"2024-02-19T21:52:50.353781+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"199'13","last_scrub_stamp":"2024-02-19T21:45:05.721709+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:45:05.721709+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":476,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.347629+0000","last_change":"2024-02-19T21:49:54.484516+0000","last_active":"2024-02-19T21:52:46.347629+0000","last_peered":"2024-02-19T21:52:46.347629+0000","last_clean":"2024-02-19T21:52:46.347629+0000","last_became_active":"2024-02-19T21:49:54.483689+0000","last_became_peered":"2024-02-19T21:49:54.483689+0000","last_unstale":"2024-02-19T21:52:46.347629+0000","last_undegraded":"2024-02-19T21:52:46.347629+0000","last_fullsized":"2024-02-19T21:52:46.347629+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.157478+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"470'25","reported_seq":506,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.350799+0000","last_change":"2024-02-19T21:48:27.720048+0000","last_active":"2024-02-19T21:52:46.350799+0000","last_peered":"2024-02-19T21:52:46.350799+0000","last_clean":"2024-02-19T21:52:46.350799+0000","last_became_active":"2024-02-19T21:47:33.398295+0000","last_became_peered":"2024-02-19T21:47:33.398295+0000","last_unstale":"2024-02-19T21:52:46.350799+0000","last_undegraded":"2024-02-19T21:52:46.350799+0000","last_fullsized":"2024-02-19T21:52:46.350799+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:27.719954+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:48:27.719954+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":193,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.347886+0000","last_change":"2024-02-19T21:49:54.484392+0000","last_active":"2024-02-19T21:52:46.347886+0000","last_peered":"2024-02-19T21:52:46.347886+0000","last_clean":"2024-02-19T21:52:46.347886+0000","last_became_active":"2024-02-19T21:49:54.484049+0000","last_became_peered":"2024-02-19T21:49:54.484049+0000","last_unstale":"2024-02-19T21:52:46.347886+0000","last_undegraded":"2024-02-19T21:52:46.347886+0000","last_fullsized":"2024-02-19T21:52:46.347886+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.121769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.121769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":702,"reported_epoch":474,"state":"active+clean","last_fresh":"2024-02-19T21:52:50.351022+0000","last_change":"2024-02-19T21:48:38.723220+0000","last_active":"2024-02-19T21:52:50.351022+0000","last_peered":"2024-02-19T21:52:50.351022+0000","last_clean":"2024-02-19T21:52:50.351022+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:52:50.351022+0000","last_undegraded":"2024-02-19T21:52:50.351022+0000","last_fullsized":"2024-02-19T21:52:50.351022+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:48:38.723151+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.723151+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":480,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.353144+0000","last_change":"2024-02-19T21:49:54.485462+0000","last_active":"2024-02-19T21:52:46.353144+0000","last_peered":"2024-02-19T21:52:46.353144+0000","last_clean":"2024-02-19T21:52:46.353144+0000","last_became_active":"2024-02-19T21:49:54.485121+0000","last_became_peered":"2024-02-19T21:49:54.485121+0000","last_unstale":"2024-02-19T21:52:46.353144+0000","last_undegraded":"2024-02-19T21:52:46.353144+0000","last_fullsized":"2024-02-19T21:52:46.353144+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:07.724097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:49:07.724097+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"470'35","reported_seq":373,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.352179+0000","last_change":"2024-02-19T21:49:08.335077+0000","last_active":"2024-02-19T21:52:46.352179+0000","last_peered":"2024-02-19T21:52:46.352179+0000","last_clean":"2024-02-19T21:52:46.352179+0000","last_became_active":"2024-02-19T21:49:08.334061+0000","last_became_peered":"2024-02-19T21:49:08.334061+0000","last_unstale":"2024-02-19T21:52:46.352179+0000","last_undegraded":"2024-02-19T21:52:46.352179+0000","last_fullsized":"2024-02-19T21:52:46.352179+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'25","last_scrub_stamp":"2024-02-19T21:46:07.553690+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.553690+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":449,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.349937+0000","last_change":"2024-02-19T21:48:21.256471+0000","last_active":"2024-02-19T21:52:46.349937+0000","last_peered":"2024-02-19T21:52:46.349937+0000","last_clean":"2024-02-19T21:52:46.349937+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:52:46.349937+0000","last_undegraded":"2024-02-19T21:52:46.349937+0000","last_fullsized":"2024-02-19T21:52:46.349937+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.256358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.256358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":456,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.345433+0000","last_change":"2024-02-19T21:46:35.035136+0000","last_active":"2024-02-19T21:52:46.345433+0000","last_peered":"2024-02-19T21:52:46.345433+0000","last_clean":"2024-02-19T21:52:46.345433+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:52:46.345433+0000","last_undegraded":"2024-02-19T21:52:46.345433+0000","last_fullsized":"2024-02-19T21:52:46.345433+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:35.035042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:35.035042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"470'18","reported_seq":87,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.351511+0000","last_change":"2024-02-19T21:50:49.700758+0000","last_active":"2024-02-19T21:52:46.351511+0000","last_peered":"2024-02-19T21:52:46.351511+0000","last_clean":"2024-02-19T21:52:46.351511+0000","last_became_active":"2024-02-19T21:49:54.478094+0000","last_became_peered":"2024-02-19T21:49:54.478094+0000","last_unstale":"2024-02-19T21:52:46.351511+0000","last_undegraded":"2024-02-19T21:52:46.351511+0000","last_fullsized":"2024-02-19T21:52:46.351511+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'12","last_scrub_stamp":"2024-02-19T21:49:08.912638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.912638+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":23,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":102,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.336395+0000","last_change":"2024-02-19T21:49:08.332757+0000","last_active":"2024-02-19T21:52:46.336395+0000","last_peered":"2024-02-19T21:52:46.336395+0000","last_clean":"2024-02-19T21:52:46.336395+0000","last_became_active":"2024-02-19T21:49:08.332176+0000","last_became_peered":"2024-02-19T21:49:08.332176+0000","last_unstale":"2024-02-19T21:52:46.336395+0000","last_undegraded":"2024-02-19T21:52:46.336395+0000","last_fullsized":"2024-02-19T21:52:46.336395+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:47:01.365477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:47:01.365477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":102,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.334363+0000","last_change":"2024-02-19T21:49:08.328632+0000","last_active":"2024-02-19T21:52:46.334363+0000","last_peered":"2024-02-19T21:52:46.334363+0000","last_clean":"2024-02-19T21:52:46.334363+0000","last_became_active":"2024-02-19T21:49:08.327826+0000","last_became_peered":"2024-02-19T21:49:08.327826+0000","last_unstale":"2024-02-19T21:52:46.334363+0000","last_undegraded":"2024-02-19T21:52:46.334363+0000","last_fullsized":"2024-02-19T21:52:46.334363+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:09.645607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:44:09.645607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"470'21","reported_seq":591,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.348059+0000","last_change":"2024-02-19T21:50:49.704824+0000","last_active":"2024-02-19T21:52:46.348059+0000","last_peered":"2024-02-19T21:52:46.348059+0000","last_clean":"2024-02-19T21:52:46.348059+0000","last_became_active":"2024-02-19T21:49:54.483578+0000","last_became_peered":"2024-02-19T21:49:54.483578+0000","last_unstale":"2024-02-19T21:52:46.348059+0000","last_undegraded":"2024-02-19T21:52:46.348059+0000","last_fullsized":"2024-02-19T21:52:46.348059+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:44:53.072746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:53.072746+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"474'7897","reported_seq":10226,"reported_epoch":474,"state":"active+clean","last_fresh":"2024-02-19T21:52:55.153329+0000","last_change":"2024-02-19T21:52:28.102395+0000","last_active":"2024-02-19T21:52:55.153329+0000","last_peered":"2024-02-19T21:52:55.153329+0000","last_clean":"2024-02-19T21:52:55.153329+0000","last_became_active":"2024-02-19T21:52:28.061558+0000","last_became_peered":"2024-02-19T21:52:28.061558+0000","last_unstale":"2024-02-19T21:52:55.153329+0000","last_undegraded":"2024-02-19T21:52:55.153329+0000","last_fullsized":"2024-02-19T21:52:55.153329+0000","mapping_epoch":467,"log_start":"406'3000","ondisk_log_start":"406'3000","created":385,"last_epoch_clean":468,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4897,"ondisk_log_size":4897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":103219200,"num_objects":1575,"num_object_clones":0,"num_object_copies":4725,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1575,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7897,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1108,"num_bytes_recovered":61734912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":70,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.350964+0000","last_change":"2024-02-19T21:49:54.492844+0000","last_active":"2024-02-19T21:52:46.350964+0000","last_peered":"2024-02-19T21:52:46.350964+0000","last_clean":"2024-02-19T21:52:46.350964+0000","last_became_active":"2024-02-19T21:49:54.492156+0000","last_became_peered":"2024-02-19T21:49:54.492156+0000","last_unstale":"2024-02-19T21:52:46.350964+0000","last_undegraded":"2024-02-19T21:52:46.350964+0000","last_fullsized":"2024-02-19T21:52:46.350964+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:04.692807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.692807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"378'4","reported_seq":488,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.360609+0000","last_change":"2024-02-19T21:48:28.510929+0000","last_active":"2024-02-19T21:52:46.360609+0000","last_peered":"2024-02-19T21:52:46.360609+0000","last_clean":"2024-02-19T21:52:46.360609+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:52:46.360609+0000","last_undegraded":"2024-02-19T21:52:46.360609+0000","last_fullsized":"2024-02-19T21:52:46.360609+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"378'4","last_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_deep_scrub":"378'4","last_deep_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.510849+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"470'29","reported_seq":344,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.349472+0000","last_change":"2024-02-19T21:48:22.519465+0000","last_active":"2024-02-19T21:52:46.349472+0000","last_peered":"2024-02-19T21:52:46.349472+0000","last_clean":"2024-02-19T21:52:46.349472+0000","last_became_active":"2024-02-19T21:47:46.252085+0000","last_became_peered":"2024-02-19T21:47:46.252085+0000","last_unstale":"2024-02-19T21:52:46.349472+0000","last_undegraded":"2024-02-19T21:52:46.349472+0000","last_fullsized":"2024-02-19T21:52:46.349472+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'23","last_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_deep_scrub":"200'23","last_deep_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.519381+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":33,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6],"acting":[4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":102,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.334433+0000","last_change":"2024-02-19T21:49:08.328855+0000","last_active":"2024-02-19T21:52:46.334433+0000","last_peered":"2024-02-19T21:52:46.334433+0000","last_clean":"2024-02-19T21:52:46.334433+0000","last_became_active":"2024-02-19T21:49:08.328237+0000","last_became_peered":"2024-02-19T21:49:08.328237+0000","last_unstale":"2024-02-19T21:52:46.334433+0000","last_undegraded":"2024-02-19T21:52:46.334433+0000","last_fullsized":"2024-02-19T21:52:46.334433+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:58.047556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:58.047556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"474'7617","reported_seq":7713,"reported_epoch":474,"state":"active+clean","last_fresh":"2024-02-19T21:52:54.839759+0000","last_change":"2024-02-19T21:48:47.778295+0000","last_active":"2024-02-19T21:52:54.839759+0000","last_peered":"2024-02-19T21:52:54.839759+0000","last_clean":"2024-02-19T21:52:54.839759+0000","last_became_active":"2024-02-19T21:48:47.777964+0000","last_became_peered":"2024-02-19T21:48:47.777964+0000","last_unstale":"2024-02-19T21:52:54.839759+0000","last_undegraded":"2024-02-19T21:52:54.839759+0000","last_fullsized":"2024-02-19T21:52:54.839759+0000","mapping_epoch":385,"log_start":"406'2900","ondisk_log_start":"406'2900","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4717,"ondisk_log_size":4717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":100466688,"num_objects":1533,"num_object_clones":0,"num_object_copies":4599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1533,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7617,"num_write_kb":292800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":503,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.348210+0000","last_change":"2024-02-19T21:49:08.328019+0000","last_active":"2024-02-19T21:52:46.348210+0000","last_peered":"2024-02-19T21:52:46.348210+0000","last_clean":"2024-02-19T21:52:46.348210+0000","last_became_active":"2024-02-19T21:49:08.327581+0000","last_became_peered":"2024-02-19T21:49:08.327581+0000","last_unstale":"2024-02-19T21:52:46.348210+0000","last_undegraded":"2024-02-19T21:52:46.348210+0000","last_fullsized":"2024-02-19T21:52:46.348210+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:22.180593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:45:22.180593+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5],"acting":[0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":449,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.352051+0000","last_change":"2024-02-19T21:48:37.789514+0000","last_active":"2024-02-19T21:52:46.352051+0000","last_peered":"2024-02-19T21:52:46.352051+0000","last_clean":"2024-02-19T21:52:46.352051+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:52:46.352051+0000","last_undegraded":"2024-02-19T21:52:46.352051+0000","last_fullsized":"2024-02-19T21:52:46.352051+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:37.789400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:37.789400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"470'30","reported_seq":370,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.350471+0000","last_change":"2024-02-19T21:45:57.877936+0000","last_active":"2024-02-19T21:52:46.350471+0000","last_peered":"2024-02-19T21:52:46.350471+0000","last_clean":"2024-02-19T21:52:46.350471+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:52:46.350471+0000","last_undegraded":"2024-02-19T21:52:46.350471+0000","last_fullsized":"2024-02-19T21:52:46.350471+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:45:57.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:57.877856+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":706,"reported_epoch":474,"state":"active+clean","last_fresh":"2024-02-19T21:52:50.341301+0000","last_change":"2024-02-19T21:49:01.011149+0000","last_active":"2024-02-19T21:52:50.341301+0000","last_peered":"2024-02-19T21:52:50.341301+0000","last_clean":"2024-02-19T21:52:50.341301+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:52:50.341301+0000","last_undegraded":"2024-02-19T21:52:50.341301+0000","last_fullsized":"2024-02-19T21:52:50.341301+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:49:01.011078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:49:01.011078+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.a","version":"474'7836","reported_seq":7933,"reported_epoch":474,"state":"active+clean","last_fresh":"2024-02-19T21:52:55.141466+0000","last_change":"2024-02-19T21:48:47.778138+0000","last_active":"2024-02-19T21:52:55.141466+0000","last_peered":"2024-02-19T21:52:55.141466+0000","last_clean":"2024-02-19T21:52:55.141466+0000","last_became_active":"2024-02-19T21:48:47.777820+0000","last_became_peered":"2024-02-19T21:48:47.777820+0000","last_unstale":"2024-02-19T21:52:55.141466+0000","last_undegraded":"2024-02-19T21:52:55.141466+0000","last_fullsized":"2024-02-19T21:52:55.141466+0000","mapping_epoch":385,"log_start":"405'2900","ondisk_log_start":"405'2900","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4936,"ondisk_log_size":4936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":102105088,"num_objects":1558,"num_object_clones":0,"num_object_copies":4674,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1558,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7836,"num_write_kb":300608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":398,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.361600+0000","last_change":"2024-02-19T21:48:33.478821+0000","last_active":"2024-02-19T21:52:46.361600+0000","last_peered":"2024-02-19T21:52:46.361600+0000","last_clean":"2024-02-19T21:52:46.361600+0000","last_became_active":"2024-02-19T21:44:56.149476+0000","last_became_peered":"2024-02-19T21:44:56.149476+0000","last_unstale":"2024-02-19T21:52:46.361600+0000","last_undegraded":"2024-02-19T21:52:46.361600+0000","last_fullsized":"2024-02-19T21:52:46.361600+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:33.478715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:48:33.478715+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":459,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.353224+0000","last_change":"2024-02-19T21:46:41.834315+0000","last_active":"2024-02-19T21:52:46.353224+0000","last_peered":"2024-02-19T21:52:46.353224+0000","last_clean":"2024-02-19T21:52:46.353224+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:52:46.353224+0000","last_undegraded":"2024-02-19T21:52:46.353224+0000","last_fullsized":"2024-02-19T21:52:46.353224+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:41.834246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:46:41.834246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"470'58","reported_seq":914,"reported_epoch":474,"state":"active+clean","last_fresh":"2024-02-19T21:52:50.351424+0000","last_change":"2024-02-19T21:49:08.335296+0000","last_active":"2024-02-19T21:52:50.351424+0000","last_peered":"2024-02-19T21:52:50.351424+0000","last_clean":"2024-02-19T21:52:50.351424+0000","last_became_active":"2024-02-19T21:49:08.334527+0000","last_became_peered":"2024-02-19T21:49:08.334527+0000","last_unstale":"2024-02-19T21:52:50.351424+0000","last_undegraded":"2024-02-19T21:52:50.351424+0000","last_fullsized":"2024-02-19T21:52:50.351424+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'43","last_scrub_stamp":"2024-02-19T21:45:04.755444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.755444+0000","log_size":58,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":50,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":445,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.348647+0000","last_change":"2024-02-19T21:46:45.252437+0000","last_active":"2024-02-19T21:52:46.348647+0000","last_peered":"2024-02-19T21:52:46.348647+0000","last_clean":"2024-02-19T21:52:46.348647+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:52:46.348647+0000","last_undegraded":"2024-02-19T21:52:46.348647+0000","last_fullsized":"2024-02-19T21:52:46.348647+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.252344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.252344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"474'7778","reported_seq":12297,"reported_epoch":474,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:52:55.344520+0000","last_change":"2024-02-19T21:52:18.427835+0000","last_active":"2024-02-19T21:52:55.344520+0000","last_peered":"2024-02-19T21:52:55.344520+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:55.752599+0000","last_became_peered":"2024-02-19T21:49:55.752599+0000","last_unstale":"2024-02-19T21:52:55.344520+0000","last_undegraded":"2024-02-19T21:52:18.425538+0000","last_fullsized":"2024-02-19T21:49:55.470938+0000","mapping_epoch":414,"log_start":"404'2600","ondisk_log_start":"404'2600","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5178,"ondisk_log_size":5178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":97124352,"num_objects":1482,"num_object_clones":0,"num_object_copies":4446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1521,"num_objects_misplaced":885,"num_objects_unfound":0,"num_objects_dirty":1482,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7778,"num_write_kb":296320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1627,"num_bytes_recovered":106627072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2],"avail_no_missing":["5","2","4"],"object_location_counts":[{"shards":"2,4,5","objects":885},{"shards":"2,5","objects":-924}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":473,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.350145+0000","last_change":"2024-02-19T21:49:09.227437+0000","last_active":"2024-02-19T21:52:46.350145+0000","last_peered":"2024-02-19T21:52:46.350145+0000","last_clean":"2024-02-19T21:52:46.350145+0000","last_became_active":"2024-02-19T21:49:08.328437+0000","last_became_peered":"2024-02-19T21:49:08.328437+0000","last_unstale":"2024-02-19T21:52:46.350145+0000","last_undegraded":"2024-02-19T21:52:46.350145+0000","last_fullsized":"2024-02-19T21:52:46.350145+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.227355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.227355+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'6","reported_seq":1767,"reported_epoch":474,"state":"active+clean","last_fresh":"2024-02-19T21:52:53.809278+0000","last_change":"2024-02-19T21:52:29.904113+0000","last_active":"2024-02-19T21:52:53.809278+0000","last_peered":"2024-02-19T21:52:53.809278+0000","last_clean":"2024-02-19T21:52:53.809278+0000","last_became_active":"2024-02-19T21:49:08.331108+0000","last_became_peered":"2024-02-19T21:49:08.331108+0000","last_unstale":"2024-02-19T21:52:53.809278+0000","last_undegraded":"2024-02-19T21:52:53.809278+0000","last_fullsized":"2024-02-19T21:52:53.809278+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_clean_scrub_stamp":"2024-02-19T21:44:13.678341+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1211,"num_read_kb":1206,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":102,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.335524+0000","last_change":"2024-02-19T21:49:08.329710+0000","last_active":"2024-02-19T21:52:46.335524+0000","last_peered":"2024-02-19T21:52:46.335524+0000","last_clean":"2024-02-19T21:52:46.335524+0000","last_became_active":"2024-02-19T21:49:08.329378+0000","last_became_peered":"2024-02-19T21:49:08.329378+0000","last_unstale":"2024-02-19T21:52:46.335524+0000","last_undegraded":"2024-02-19T21:52:46.335524+0000","last_fullsized":"2024-02-19T21:52:46.335524+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:55.195394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.195394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"470'21","reported_seq":512,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.352560+0000","last_change":"2024-02-19T21:48:14.878933+0000","last_active":"2024-02-19T21:52:46.352560+0000","last_peered":"2024-02-19T21:52:46.352560+0000","last_clean":"2024-02-19T21:52:46.352560+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:52:46.352560+0000","last_undegraded":"2024-02-19T21:52:46.352560+0000","last_fullsized":"2024-02-19T21:52:46.352560+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'17","last_scrub_stamp":"2024-02-19T21:48:14.878857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.878857+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":31,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":102,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.336404+0000","last_change":"2024-02-19T21:49:08.325478+0000","last_active":"2024-02-19T21:52:46.336404+0000","last_peered":"2024-02-19T21:52:46.336404+0000","last_clean":"2024-02-19T21:52:46.336404+0000","last_became_active":"2024-02-19T21:49:08.325127+0000","last_became_peered":"2024-02-19T21:49:08.325127+0000","last_unstale":"2024-02-19T21:52:46.336404+0000","last_undegraded":"2024-02-19T21:52:46.336404+0000","last_fullsized":"2024-02-19T21:52:46.336404+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:10.871111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:10.871111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"474'7909","reported_seq":8006,"reported_epoch":474,"state":"active+clean","last_fresh":"2024-02-19T21:52:55.123051+0000","last_change":"2024-02-19T21:48:47.778829+0000","last_active":"2024-02-19T21:52:55.123051+0000","last_peered":"2024-02-19T21:52:55.123051+0000","last_clean":"2024-02-19T21:52:55.123051+0000","last_became_active":"2024-02-19T21:48:47.778486+0000","last_became_peered":"2024-02-19T21:48:47.778486+0000","last_unstale":"2024-02-19T21:52:55.123051+0000","last_undegraded":"2024-02-19T21:52:55.123051+0000","last_fullsized":"2024-02-19T21:52:55.123051+0000","mapping_epoch":385,"log_start":"406'3000","ondisk_log_start":"406'3000","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4909,"ondisk_log_size":4909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":101646336,"num_objects":1551,"num_object_clones":0,"num_object_copies":4653,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1551,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7909,"num_write_kb":302720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":476,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.353208+0000","last_change":"2024-02-19T21:47:33.400407+0000","last_active":"2024-02-19T21:52:46.353208+0000","last_peered":"2024-02-19T21:52:46.353208+0000","last_clean":"2024-02-19T21:52:46.353208+0000","last_became_active":"2024-02-19T21:47:33.400075+0000","last_became_peered":"2024-02-19T21:47:33.400075+0000","last_unstale":"2024-02-19T21:52:46.353208+0000","last_undegraded":"2024-02-19T21:52:46.353208+0000","last_fullsized":"2024-02-19T21:52:46.353208+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.035136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":354,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.353362+0000","last_change":"2024-02-19T21:49:05.746443+0000","last_active":"2024-02-19T21:52:46.353362+0000","last_peered":"2024-02-19T21:52:46.353362+0000","last_clean":"2024-02-19T21:52:46.353362+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:52:46.353362+0000","last_undegraded":"2024-02-19T21:52:46.353362+0000","last_fullsized":"2024-02-19T21:52:46.353362+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.746358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.746358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":506,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.350298+0000","last_change":"2024-02-19T21:49:54.485252+0000","last_active":"2024-02-19T21:52:46.350298+0000","last_peered":"2024-02-19T21:52:46.350298+0000","last_clean":"2024-02-19T21:52:46.350298+0000","last_became_active":"2024-02-19T21:49:54.484956+0000","last_became_peered":"2024-02-19T21:49:54.484956+0000","last_unstale":"2024-02-19T21:52:46.350298+0000","last_undegraded":"2024-02-19T21:52:46.350298+0000","last_fullsized":"2024-02-19T21:52:46.350298+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:07.901205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:07.901205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":70,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.348702+0000","last_change":"2024-02-19T21:49:54.483990+0000","last_active":"2024-02-19T21:52:46.348702+0000","last_peered":"2024-02-19T21:52:46.348702+0000","last_clean":"2024-02-19T21:52:46.348702+0000","last_became_active":"2024-02-19T21:49:54.483637+0000","last_became_peered":"2024-02-19T21:49:54.483637+0000","last_unstale":"2024-02-19T21:52:46.348702+0000","last_undegraded":"2024-02-19T21:52:46.348702+0000","last_fullsized":"2024-02-19T21:52:46.348702+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.190177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.190177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"470'45","reported_seq":517,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.342943+0000","last_change":"2024-02-19T21:46:47.970066+0000","last_active":"2024-02-19T21:52:46.342943+0000","last_peered":"2024-02-19T21:52:46.342943+0000","last_clean":"2024-02-19T21:52:46.342943+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:52:46.342943+0000","last_undegraded":"2024-02-19T21:52:46.342943+0000","last_fullsized":"2024-02-19T21:52:46.342943+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'33","last_scrub_stamp":"2024-02-19T21:46:47.969961+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.969961+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":51,"num_write":37,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":70,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.350964+0000","last_change":"2024-02-19T21:49:54.478276+0000","last_active":"2024-02-19T21:52:46.350964+0000","last_peered":"2024-02-19T21:52:46.350964+0000","last_clean":"2024-02-19T21:52:46.350964+0000","last_became_active":"2024-02-19T21:49:54.477947+0000","last_became_peered":"2024-02-19T21:49:54.477947+0000","last_unstale":"2024-02-19T21:52:46.350964+0000","last_undegraded":"2024-02-19T21:52:46.350964+0000","last_fullsized":"2024-02-19T21:52:46.350964+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:57.754453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:57.754453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"474'7622","reported_seq":17860,"reported_epoch":474,"state":"active+clean","last_fresh":"2024-02-19T21:52:54.816181+0000","last_change":"2024-02-19T21:51:22.472713+0000","last_active":"2024-02-19T21:52:54.816181+0000","last_peered":"2024-02-19T21:52:54.816181+0000","last_clean":"2024-02-19T21:52:54.816181+0000","last_became_active":"2024-02-19T21:51:22.462974+0000","last_became_peered":"2024-02-19T21:51:22.462974+0000","last_unstale":"2024-02-19T21:52:54.816181+0000","last_undegraded":"2024-02-19T21:52:54.816181+0000","last_fullsized":"2024-02-19T21:52:54.816181+0000","mapping_epoch":445,"log_start":"404'2500","ondisk_log_start":"404'2500","created":385,"last_epoch_clean":446,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5122,"ondisk_log_size":5122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":103153664,"num_objects":1574,"num_object_clones":0,"num_object_copies":4722,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1574,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7622,"num_write_kb":294272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5054,"num_bytes_recovered":320077824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7],"acting":[0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":447,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.352329+0000","last_change":"2024-02-19T21:45:47.723650+0000","last_active":"2024-02-19T21:52:46.352329+0000","last_peered":"2024-02-19T21:52:46.352329+0000","last_clean":"2024-02-19T21:52:46.352329+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:52:46.352329+0000","last_undegraded":"2024-02-19T21:52:46.352329+0000","last_fullsized":"2024-02-19T21:52:46.352329+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.723550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.723550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":458,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.346933+0000","last_change":"2024-02-19T21:45:51.243726+0000","last_active":"2024-02-19T21:52:46.346933+0000","last_peered":"2024-02-19T21:52:46.346933+0000","last_clean":"2024-02-19T21:52:46.346933+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:52:46.346933+0000","last_undegraded":"2024-02-19T21:52:46.346933+0000","last_fullsized":"2024-02-19T21:52:46.346933+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:51.243656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:51.243656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":475,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.348970+0000","last_change":"2024-02-19T21:48:23.218358+0000","last_active":"2024-02-19T21:52:46.348970+0000","last_peered":"2024-02-19T21:52:46.348970+0000","last_clean":"2024-02-19T21:52:46.348970+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:52:46.348970+0000","last_undegraded":"2024-02-19T21:52:46.348970+0000","last_fullsized":"2024-02-19T21:52:46.348970+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:23.218282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.218282+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"470'42","reported_seq":620,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.347968+0000","last_change":"2024-02-19T21:49:08.330490+0000","last_active":"2024-02-19T21:52:46.347968+0000","last_peered":"2024-02-19T21:52:46.347968+0000","last_clean":"2024-02-19T21:52:46.347968+0000","last_became_active":"2024-02-19T21:49:08.329761+0000","last_became_peered":"2024-02-19T21:49:08.329761+0000","last_unstale":"2024-02-19T21:52:46.347968+0000","last_undegraded":"2024-02-19T21:52:46.347968+0000","last_fullsized":"2024-02-19T21:52:46.347968+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'30","last_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_deep_scrub":"324'30","last_deep_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.110965+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":48,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":460,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.353217+0000","last_change":"2024-02-19T21:45:09.918263+0000","last_active":"2024-02-19T21:52:46.353217+0000","last_peered":"2024-02-19T21:52:46.353217+0000","last_clean":"2024-02-19T21:52:46.353217+0000","last_became_active":"2024-02-19T21:44:42.624782+0000","last_became_peered":"2024-02-19T21:44:42.624782+0000","last_unstale":"2024-02-19T21:52:46.353217+0000","last_undegraded":"2024-02-19T21:52:46.353217+0000","last_fullsized":"2024-02-19T21:52:46.353217+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":295,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_clean_scrub_stamp":"2024-02-19T21:45:09.918170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"474'7747","reported_seq":7843,"reported_epoch":474,"state":"active+clean","last_fresh":"2024-02-19T21:52:55.147083+0000","last_change":"2024-02-19T21:48:47.777963+0000","last_active":"2024-02-19T21:52:55.147083+0000","last_peered":"2024-02-19T21:52:55.147083+0000","last_clean":"2024-02-19T21:52:55.147083+0000","last_became_active":"2024-02-19T21:48:47.777644+0000","last_became_peered":"2024-02-19T21:48:47.777644+0000","last_unstale":"2024-02-19T21:52:55.147083+0000","last_undegraded":"2024-02-19T21:52:55.147083+0000","last_fullsized":"2024-02-19T21:52:55.147083+0000","mapping_epoch":385,"log_start":"406'2900","ondisk_log_start":"406'2900","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4847,"ondisk_log_size":4847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":99745816,"num_objects":1523,"num_object_clones":0,"num_object_copies":4569,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1523,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7747,"num_write_kb":296577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":480,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.350281+0000","last_change":"2024-02-19T21:49:08.331080+0000","last_active":"2024-02-19T21:52:46.350281+0000","last_peered":"2024-02-19T21:52:46.350281+0000","last_clean":"2024-02-19T21:52:46.350281+0000","last_became_active":"2024-02-19T21:49:08.330648+0000","last_became_peered":"2024-02-19T21:49:08.330648+0000","last_unstale":"2024-02-19T21:52:46.350281+0000","last_undegraded":"2024-02-19T21:52:46.350281+0000","last_fullsized":"2024-02-19T21:52:46.350281+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:55.803876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:44:55.803876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":451,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.350214+0000","last_change":"2024-02-19T21:48:31.320229+0000","last_active":"2024-02-19T21:52:46.350214+0000","last_peered":"2024-02-19T21:52:46.350214+0000","last_clean":"2024-02-19T21:52:46.350214+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:52:46.350214+0000","last_undegraded":"2024-02-19T21:52:46.350214+0000","last_fullsized":"2024-02-19T21:52:46.350214+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:31.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:45.017696+0000","last_clean_scrub_stamp":"2024-02-19T21:48:31.320133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"470'47","reported_seq":521,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.347587+0000","last_change":"2024-02-19T21:45:14.173212+0000","last_active":"2024-02-19T21:52:46.347587+0000","last_peered":"2024-02-19T21:52:46.347587+0000","last_clean":"2024-02-19T21:52:46.347587+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:52:46.347587+0000","last_undegraded":"2024-02-19T21:52:46.347587+0000","last_fullsized":"2024-02-19T21:52:46.347587+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'37","last_scrub_stamp":"2024-02-19T21:45:14.173134+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:45:14.173134+0000","log_size":47,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":55,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":450,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.347154+0000","last_change":"2024-02-19T21:46:48.988928+0000","last_active":"2024-02-19T21:52:46.347154+0000","last_peered":"2024-02-19T21:52:46.347154+0000","last_clean":"2024-02-19T21:52:46.347154+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:52:46.347154+0000","last_undegraded":"2024-02-19T21:52:46.347154+0000","last_fullsized":"2024-02-19T21:52:46.347154+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:48.988836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.988836+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.e","version":"474'7577","reported_seq":9760,"reported_epoch":474,"state":"active+clean","last_fresh":"2024-02-19T21:52:55.244331+0000","last_change":"2024-02-19T21:50:40.718822+0000","last_active":"2024-02-19T21:52:55.244331+0000","last_peered":"2024-02-19T21:52:55.244331+0000","last_clean":"2024-02-19T21:52:55.244331+0000","last_became_active":"2024-02-19T21:50:40.710425+0000","last_became_peered":"2024-02-19T21:50:40.710425+0000","last_unstale":"2024-02-19T21:52:55.244331+0000","last_undegraded":"2024-02-19T21:52:55.244331+0000","last_fullsized":"2024-02-19T21:52:55.244331+0000","mapping_epoch":430,"log_start":"404'2500","ondisk_log_start":"404'2500","created":385,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5077,"ondisk_log_size":5077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":102170624,"num_objects":1559,"num_object_clones":0,"num_object_copies":4677,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1559,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7577,"num_write_kb":292352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1035,"num_bytes_recovered":67829760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":193,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.347862+0000","last_change":"2024-02-19T21:49:08.326461+0000","last_active":"2024-02-19T21:52:46.347862+0000","last_peered":"2024-02-19T21:52:46.347862+0000","last_clean":"2024-02-19T21:52:46.347862+0000","last_became_active":"2024-02-19T21:49:08.326106+0000","last_became_peered":"2024-02-19T21:49:08.326106+0000","last_unstale":"2024-02-19T21:52:46.347862+0000","last_undegraded":"2024-02-19T21:52:46.347862+0000","last_fullsized":"2024-02-19T21:52:46.347862+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.080896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.080896+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":453,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.350692+0000","last_change":"2024-02-19T21:48:11.879787+0000","last_active":"2024-02-19T21:52:46.350692+0000","last_peered":"2024-02-19T21:52:46.350692+0000","last_clean":"2024-02-19T21:52:46.350692+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:52:46.350692+0000","last_undegraded":"2024-02-19T21:52:46.350692+0000","last_fullsized":"2024-02-19T21:52:46.350692+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.879687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.879687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"470'50","reported_seq":106,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.349121+0000","last_change":"2024-02-19T21:49:55.861358+0000","last_active":"2024-02-19T21:52:46.349121+0000","last_peered":"2024-02-19T21:52:46.349121+0000","last_clean":"2024-02-19T21:52:46.349121+0000","last_became_active":"2024-02-19T21:49:54.480413+0000","last_became_peered":"2024-02-19T21:49:54.480413+0000","last_unstale":"2024-02-19T21:52:46.349121+0000","last_undegraded":"2024-02-19T21:52:46.349121+0000","last_fullsized":"2024-02-19T21:52:46.349121+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":415,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'38","last_scrub_stamp":"2024-02-19T21:49:05.923627+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.923627+0000","log_size":50,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":57,"num_write":44,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":346,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.345730+0000","last_change":"2024-02-19T21:49:54.495134+0000","last_active":"2024-02-19T21:52:46.345730+0000","last_peered":"2024-02-19T21:52:46.345730+0000","last_clean":"2024-02-19T21:52:46.345730+0000","last_became_active":"2024-02-19T21:49:54.494802+0000","last_became_peered":"2024-02-19T21:49:54.494802+0000","last_unstale":"2024-02-19T21:52:46.345730+0000","last_undegraded":"2024-02-19T21:52:46.345730+0000","last_fullsized":"2024-02-19T21:52:46.345730+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:10.578408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:10.578408+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.f","version":"474'7967","reported_seq":10374,"reported_epoch":474,"state":"active+clean","last_fresh":"2024-02-19T21:52:55.152897+0000","last_change":"2024-02-19T21:51:05.409700+0000","last_active":"2024-02-19T21:52:55.152897+0000","last_peered":"2024-02-19T21:52:55.152897+0000","last_clean":"2024-02-19T21:52:55.152897+0000","last_became_active":"2024-02-19T21:51:05.398355+0000","last_became_peered":"2024-02-19T21:51:05.398355+0000","last_unstale":"2024-02-19T21:52:55.152897+0000","last_undegraded":"2024-02-19T21:52:55.152897+0000","last_fullsized":"2024-02-19T21:52:55.152897+0000","mapping_epoch":440,"log_start":"408'3100","ondisk_log_start":"408'3100","created":385,"last_epoch_clean":441,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4867,"ondisk_log_size":4867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":102957056,"num_objects":1571,"num_object_clones":0,"num_object_copies":4713,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1571,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7967,"num_write_kb":305216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1147,"num_bytes_recovered":75169792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":480,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.351346+0000","last_change":"2024-02-19T21:49:08.328862+0000","last_active":"2024-02-19T21:52:46.351346+0000","last_peered":"2024-02-19T21:52:46.351346+0000","last_clean":"2024-02-19T21:52:46.351346+0000","last_became_active":"2024-02-19T21:49:08.328529+0000","last_became_peered":"2024-02-19T21:49:08.328529+0000","last_unstale":"2024-02-19T21:52:46.351346+0000","last_undegraded":"2024-02-19T21:52:46.351346+0000","last_fullsized":"2024-02-19T21:52:46.351346+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:49.110117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:49.110117+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":513,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.350927+0000","last_change":"2024-02-19T21:49:54.493367+0000","last_active":"2024-02-19T21:52:46.350927+0000","last_peered":"2024-02-19T21:52:46.350927+0000","last_clean":"2024-02-19T21:52:46.350927+0000","last_became_active":"2024-02-19T21:49:54.493041+0000","last_became_peered":"2024-02-19T21:49:54.493041+0000","last_unstale":"2024-02-19T21:52:46.350927+0000","last_undegraded":"2024-02-19T21:52:46.350927+0000","last_fullsized":"2024-02-19T21:52:46.350927+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.972369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.972369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"470'42","reported_seq":341,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.349397+0000","last_change":"2024-02-19T21:49:08.330818+0000","last_active":"2024-02-19T21:52:46.349397+0000","last_peered":"2024-02-19T21:52:46.349397+0000","last_clean":"2024-02-19T21:52:46.349397+0000","last_became_active":"2024-02-19T21:49:08.330477+0000","last_became_peered":"2024-02-19T21:49:08.330477+0000","last_unstale":"2024-02-19T21:52:46.349397+0000","last_undegraded":"2024-02-19T21:52:46.349397+0000","last_fullsized":"2024-02-19T21:52:46.349397+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'28","last_scrub_stamp":"2024-02-19T21:45:55.998646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.998646+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":555,"reported_epoch":474,"state":"active+clean","last_fresh":"2024-02-19T21:52:50.352575+0000","last_change":"2024-02-19T21:45:50.742626+0000","last_active":"2024-02-19T21:52:50.352575+0000","last_peered":"2024-02-19T21:52:50.352575+0000","last_clean":"2024-02-19T21:52:50.352575+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:52:50.352575+0000","last_undegraded":"2024-02-19T21:52:50.352575+0000","last_fullsized":"2024-02-19T21:52:50.352575+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'9","last_scrub_stamp":"2024-02-19T21:45:50.742526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:50.742526+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"474'7632","reported_seq":7728,"reported_epoch":474,"state":"active+clean","last_fresh":"2024-02-19T21:52:55.171905+0000","last_change":"2024-02-19T21:48:47.779506+0000","last_active":"2024-02-19T21:52:55.171905+0000","last_peered":"2024-02-19T21:52:55.171905+0000","last_clean":"2024-02-19T21:52:55.171905+0000","last_became_active":"2024-02-19T21:48:47.778325+0000","last_became_peered":"2024-02-19T21:48:47.778325+0000","last_unstale":"2024-02-19T21:52:55.171905+0000","last_undegraded":"2024-02-19T21:52:55.171905+0000","last_fullsized":"2024-02-19T21:52:55.171905+0000","mapping_epoch":385,"log_start":"404'2700","ondisk_log_start":"404'2700","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4932,"ondisk_log_size":4932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":98828288,"num_objects":1508,"num_object_clones":0,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1508,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7632,"num_write_kb":292480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"66'1","reported_seq":364,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.345699+0000","last_change":"2024-02-19T21:48:12.568842+0000","last_active":"2024-02-19T21:52:46.345699+0000","last_peered":"2024-02-19T21:52:46.345699+0000","last_clean":"2024-02-19T21:52:46.345699+0000","last_became_active":"2024-02-19T21:44:56.166670+0000","last_became_peered":"2024-02-19T21:44:56.166670+0000","last_unstale":"2024-02-19T21:52:46.345699+0000","last_undegraded":"2024-02-19T21:52:46.345699+0000","last_fullsized":"2024-02-19T21:52:46.345699+0000","mapping_epoch":165,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:12.568734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.568734+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"261'11","reported_seq":566,"reported_epoch":474,"state":"active+clean","last_fresh":"2024-02-19T21:52:50.351228+0000","last_change":"2024-02-19T21:45:01.716882+0000","last_active":"2024-02-19T21:52:50.351228+0000","last_peered":"2024-02-19T21:52:50.351228+0000","last_clean":"2024-02-19T21:52:50.351228+0000","last_became_active":"2024-02-19T21:44:08.123392+0000","last_became_peered":"2024-02-19T21:44:08.123392+0000","last_unstale":"2024-02-19T21:52:50.351228+0000","last_undegraded":"2024-02-19T21:52:50.351228+0000","last_fullsized":"2024-02-19T21:52:50.351228+0000","mapping_epoch":62,"log_start":"257'10","ondisk_log_start":"257'10","created":62,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-02-19T21:45:01.716817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.716817+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":462,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.349043+0000","last_change":"2024-02-19T21:48:19.186455+0000","last_active":"2024-02-19T21:52:46.349043+0000","last_peered":"2024-02-19T21:52:46.349043+0000","last_clean":"2024-02-19T21:52:46.349043+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:52:46.349043+0000","last_undegraded":"2024-02-19T21:52:46.349043+0000","last_fullsized":"2024-02-19T21:52:46.349043+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:48:19.186359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:19.186359+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"470'27","reported_seq":332,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.352749+0000","last_change":"2024-02-19T21:48:34.485865+0000","last_active":"2024-02-19T21:52:46.352749+0000","last_peered":"2024-02-19T21:52:46.352749+0000","last_clean":"2024-02-19T21:52:46.352749+0000","last_became_active":"2024-02-19T21:47:46.251550+0000","last_became_peered":"2024-02-19T21:47:46.251550+0000","last_unstale":"2024-02-19T21:52:46.352749+0000","last_undegraded":"2024-02-19T21:52:46.352749+0000","last_fullsized":"2024-02-19T21:52:46.352749+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:34.485787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:34.485787+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7],"acting":[4,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1","version":"474'7772","reported_seq":7869,"reported_epoch":474,"state":"active+clean","last_fresh":"2024-02-19T21:52:55.253681+0000","last_change":"2024-02-19T21:48:47.772467+0000","last_active":"2024-02-19T21:52:55.253681+0000","last_peered":"2024-02-19T21:52:55.253681+0000","last_clean":"2024-02-19T21:52:55.253681+0000","last_became_active":"2024-02-19T21:48:47.772154+0000","last_became_peered":"2024-02-19T21:48:47.772154+0000","last_unstale":"2024-02-19T21:52:55.253681+0000","last_undegraded":"2024-02-19T21:52:55.253681+0000","last_fullsized":"2024-02-19T21:52:55.253681+0000","mapping_epoch":385,"log_start":"404'2700","ondisk_log_start":"404'2700","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5072,"ondisk_log_size":5072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":101056512,"num_objects":1542,"num_object_clones":0,"num_object_copies":4626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1542,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7772,"num_write_kb":298048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":469,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.350957+0000","last_change":"2024-02-19T21:46:01.031458+0000","last_active":"2024-02-19T21:52:46.350957+0000","last_peered":"2024-02-19T21:52:46.350957+0000","last_clean":"2024-02-19T21:52:46.350957+0000","last_became_active":"2024-02-19T21:44:56.155194+0000","last_became_peered":"2024-02-19T21:44:56.155194+0000","last_unstale":"2024-02-19T21:52:46.350957+0000","last_undegraded":"2024-02-19T21:52:46.350957+0000","last_fullsized":"2024-02-19T21:52:46.350957+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.031344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.031344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"363'12","reported_seq":278,"reported_epoch":474,"state":"active+clean","last_fresh":"2024-02-19T21:52:50.349299+0000","last_change":"2024-02-19T21:48:25.487689+0000","last_active":"2024-02-19T21:52:50.349299+0000","last_peered":"2024-02-19T21:52:50.349299+0000","last_clean":"2024-02-19T21:52:50.349299+0000","last_became_active":"2024-02-19T21:47:46.260099+0000","last_became_peered":"2024-02-19T21:47:46.260099+0000","last_unstale":"2024-02-19T21:52:50.349299+0000","last_undegraded":"2024-02-19T21:52:50.349299+0000","last_fullsized":"2024-02-19T21:52:50.349299+0000","mapping_epoch":362,"log_start":"98'9","ondisk_log_start":"98'9","created":62,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"363'12","last_scrub_stamp":"2024-02-19T21:48:25.487608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.487608+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":473,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.350185+0000","last_change":"2024-02-19T21:49:08.335163+0000","last_active":"2024-02-19T21:52:46.350185+0000","last_peered":"2024-02-19T21:52:46.350185+0000","last_clean":"2024-02-19T21:52:46.350185+0000","last_became_active":"2024-02-19T21:49:08.334842+0000","last_became_peered":"2024-02-19T21:49:08.334842+0000","last_unstale":"2024-02-19T21:52:46.350185+0000","last_undegraded":"2024-02-19T21:52:46.350185+0000","last_fullsized":"2024-02-19T21:52:46.350185+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.700887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.700887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"471'46","reported_seq":411,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.351523+0000","last_change":"2024-02-19T21:47:34.894164+0000","last_active":"2024-02-19T21:52:46.351523+0000","last_peered":"2024-02-19T21:52:46.351523+0000","last_clean":"2024-02-19T21:52:46.351523+0000","last_became_active":"2024-02-19T21:47:33.400012+0000","last_became_peered":"2024-02-19T21:47:33.400012+0000","last_unstale":"2024-02-19T21:52:46.351523+0000","last_undegraded":"2024-02-19T21:52:46.351523+0000","last_fullsized":"2024-02-19T21:52:46.351523+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":357,"parent":"0.0","parent_split_bits":0,"last_scrub":"270'34","last_scrub_stamp":"2024-02-19T21:46:44.789309+0000","last_deep_scrub":"270'34","last_deep_scrub_stamp":"2024-02-19T21:44:17.451151+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.789309+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2","version":"474'7870","reported_seq":7967,"reported_epoch":474,"state":"active+clean","last_fresh":"2024-02-19T21:52:55.234586+0000","last_change":"2024-02-19T21:48:47.771305+0000","last_active":"2024-02-19T21:52:55.234586+0000","last_peered":"2024-02-19T21:52:55.234586+0000","last_clean":"2024-02-19T21:52:55.234586+0000","last_became_active":"2024-02-19T21:48:47.771000+0000","last_became_peered":"2024-02-19T21:48:47.771000+0000","last_unstale":"2024-02-19T21:52:55.234586+0000","last_undegraded":"2024-02-19T21:52:55.234586+0000","last_fullsized":"2024-02-19T21:52:55.234586+0000","mapping_epoch":385,"log_start":"404'2600","ondisk_log_start":"404'2600","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5270,"ondisk_log_size":5270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":102105088,"num_objects":1558,"num_object_clones":0,"num_object_copies":4674,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1558,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7870,"num_write_kb":301696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":451,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.361552+0000","last_change":"2024-02-19T21:49:08.329023+0000","last_active":"2024-02-19T21:52:46.361552+0000","last_peered":"2024-02-19T21:52:46.361552+0000","last_clean":"2024-02-19T21:52:46.361552+0000","last_became_active":"2024-02-19T21:49:08.328697+0000","last_became_peered":"2024-02-19T21:49:08.328697+0000","last_unstale":"2024-02-19T21:52:46.361552+0000","last_undegraded":"2024-02-19T21:52:46.361552+0000","last_fullsized":"2024-02-19T21:52:46.361552+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.939414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.939414+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"397'17","reported_seq":408,"reported_epoch":474,"state":"active+clean","last_fresh":"2024-02-19T21:52:52.110668+0000","last_change":"2024-02-19T21:49:08.325927+0000","last_active":"2024-02-19T21:52:52.110668+0000","last_peered":"2024-02-19T21:52:52.110668+0000","last_clean":"2024-02-19T21:52:52.110668+0000","last_became_active":"2024-02-19T21:49:08.325034+0000","last_became_peered":"2024-02-19T21:49:08.325034+0000","last_unstale":"2024-02-19T21:52:52.110668+0000","last_undegraded":"2024-02-19T21:52:52.110668+0000","last_fullsized":"2024-02-19T21:52:52.110668+0000","mapping_epoch":394,"log_start":"170'11","ondisk_log_start":"170'11","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"271'13","last_scrub_stamp":"2024-02-19T21:46:47.072988+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.072988+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":463,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.350309+0000","last_change":"2024-02-19T21:49:03.987847+0000","last_active":"2024-02-19T21:52:46.350309+0000","last_peered":"2024-02-19T21:52:46.350309+0000","last_clean":"2024-02-19T21:52:46.350309+0000","last_became_active":"2024-02-19T21:47:33.395485+0000","last_became_peered":"2024-02-19T21:47:33.395485+0000","last_unstale":"2024-02-19T21:52:46.350309+0000","last_undegraded":"2024-02-19T21:52:46.350309+0000","last_fullsized":"2024-02-19T21:52:46.350309+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:03.987749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:49:03.987749+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,5],"acting":[1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"470'30","reported_seq":312,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.352001+0000","last_change":"2024-02-19T21:48:12.628796+0000","last_active":"2024-02-19T21:52:46.352001+0000","last_peered":"2024-02-19T21:52:46.352001+0000","last_clean":"2024-02-19T21:52:46.352001+0000","last_became_active":"2024-02-19T21:47:46.251725+0000","last_became_peered":"2024-02-19T21:47:46.251725+0000","last_unstale":"2024-02-19T21:52:46.352001+0000","last_undegraded":"2024-02-19T21:52:46.352001+0000","last_fullsized":"2024-02-19T21:52:46.352001+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'20","last_scrub_stamp":"2024-02-19T21:48:12.628700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.628700+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":38,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3","version":"474'7931","reported_seq":10232,"reported_epoch":474,"state":"active+clean","last_fresh":"2024-02-19T21:52:57.199295+0000","last_change":"2024-02-19T21:50:50.296220+0000","last_active":"2024-02-19T21:52:57.199295+0000","last_peered":"2024-02-19T21:52:57.199295+0000","last_clean":"2024-02-19T21:52:57.199295+0000","last_became_active":"2024-02-19T21:50:50.289607+0000","last_became_peered":"2024-02-19T21:50:50.289607+0000","last_unstale":"2024-02-19T21:52:57.199295+0000","last_undegraded":"2024-02-19T21:52:57.199295+0000","last_fullsized":"2024-02-19T21:52:57.199295+0000","mapping_epoch":433,"log_start":"404'2500","ondisk_log_start":"404'2500","created":385,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5431,"ondisk_log_size":5431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":93650944,"num_objects":1429,"num_object_clones":0,"num_object_copies":4287,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1429,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7931,"num_write_kb":299520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1097,"num_bytes_recovered":71892992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":102,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.336850+0000","last_change":"2024-02-19T21:49:08.327495+0000","last_active":"2024-02-19T21:52:46.336850+0000","last_peered":"2024-02-19T21:52:46.336850+0000","last_clean":"2024-02-19T21:52:46.336850+0000","last_became_active":"2024-02-19T21:49:08.327172+0000","last_became_peered":"2024-02-19T21:49:08.327172+0000","last_unstale":"2024-02-19T21:52:46.336850+0000","last_undegraded":"2024-02-19T21:52:46.336850+0000","last_fullsized":"2024-02-19T21:52:46.336850+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.241319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.241319+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,6],"acting":[2,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":458,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.352245+0000","last_change":"2024-02-19T21:45:01.798485+0000","last_active":"2024-02-19T21:52:46.352245+0000","last_peered":"2024-02-19T21:52:46.352245+0000","last_clean":"2024-02-19T21:52:46.352245+0000","last_became_active":"2024-02-19T21:44:22.245925+0000","last_became_peered":"2024-02-19T21:44:22.245925+0000","last_unstale":"2024-02-19T21:52:46.352245+0000","last_undegraded":"2024-02-19T21:52:46.352245+0000","last_fullsized":"2024-02-19T21:52:46.352245+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:01.798387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.798387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":458,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.351202+0000","last_change":"2024-02-19T21:48:30.277397+0000","last_active":"2024-02-19T21:52:46.351202+0000","last_peered":"2024-02-19T21:52:46.351202+0000","last_clean":"2024-02-19T21:52:46.351202+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:52:46.351202+0000","last_undegraded":"2024-02-19T21:52:46.351202+0000","last_fullsized":"2024-02-19T21:52:46.351202+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.277322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.277322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"470'53","reported_seq":427,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.350360+0000","last_change":"2024-02-19T21:49:08.326007+0000","last_active":"2024-02-19T21:52:46.350360+0000","last_peered":"2024-02-19T21:52:46.350360+0000","last_clean":"2024-02-19T21:52:46.350360+0000","last_became_active":"2024-02-19T21:49:08.325683+0000","last_became_peered":"2024-02-19T21:49:08.325683+0000","last_unstale":"2024-02-19T21:52:46.350360+0000","last_undegraded":"2024-02-19T21:52:46.350360+0000","last_fullsized":"2024-02-19T21:52:46.350360+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'39","last_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_deep_scrub":"337'39","last_deep_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.923809+0000","log_size":53,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"474'7964","reported_seq":8061,"reported_epoch":474,"state":"active+clean","last_fresh":"2024-02-19T21:52:54.839927+0000","last_change":"2024-02-19T21:48:47.776672+0000","last_active":"2024-02-19T21:52:54.839927+0000","last_peered":"2024-02-19T21:52:54.839927+0000","last_clean":"2024-02-19T21:52:54.839927+0000","last_became_active":"2024-02-19T21:48:47.776368+0000","last_became_peered":"2024-02-19T21:48:47.776368+0000","last_unstale":"2024-02-19T21:52:54.839927+0000","last_undegraded":"2024-02-19T21:52:54.839927+0000","last_fullsized":"2024-02-19T21:52:54.839927+0000","mapping_epoch":385,"log_start":"404'2800","ondisk_log_start":"404'2800","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5164,"ondisk_log_size":5164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":103809024,"num_objects":1584,"num_object_clones":0,"num_object_copies":4752,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1584,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7964,"num_write_kb":305536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"66'1","reported_seq":296,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.348787+0000","last_change":"2024-02-19T21:50:57.303343+0000","last_active":"2024-02-19T21:52:46.348787+0000","last_peered":"2024-02-19T21:52:46.348787+0000","last_clean":"2024-02-19T21:52:46.348787+0000","last_became_active":"2024-02-19T21:50:57.302957+0000","last_became_peered":"2024-02-19T21:50:57.302957+0000","last_unstale":"2024-02-19T21:52:46.348787+0000","last_undegraded":"2024-02-19T21:52:46.348787+0000","last_fullsized":"2024-02-19T21:52:46.348787+0000","mapping_epoch":437,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":438,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:46:43.773486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:46:43.773486+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":102,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.336000+0000","last_change":"2024-02-19T21:49:08.326583+0000","last_active":"2024-02-19T21:52:46.336000+0000","last_peered":"2024-02-19T21:52:46.336000+0000","last_clean":"2024-02-19T21:52:46.336000+0000","last_became_active":"2024-02-19T21:49:08.324835+0000","last_became_peered":"2024-02-19T21:49:08.324835+0000","last_unstale":"2024-02-19T21:52:46.336000+0000","last_undegraded":"2024-02-19T21:52:46.336000+0000","last_fullsized":"2024-02-19T21:52:46.336000+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.163825+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":162,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.345367+0000","last_change":"2024-02-19T21:52:29.644618+0000","last_active":"2024-02-19T21:52:46.345367+0000","last_peered":"2024-02-19T21:52:46.345367+0000","last_clean":"2024-02-19T21:52:46.345367+0000","last_became_active":"2024-02-19T21:49:08.327186+0000","last_became_peered":"2024-02-19T21:49:08.327186+0000","last_unstale":"2024-02-19T21:52:46.345367+0000","last_undegraded":"2024-02-19T21:52:46.345367+0000","last_fullsized":"2024-02-19T21:52:46.345367+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:45:00.748244+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:45:00.748244+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"471'60","reported_seq":603,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.347007+0000","last_change":"2024-02-19T21:49:55.281324+0000","last_active":"2024-02-19T21:52:46.347007+0000","last_peered":"2024-02-19T21:52:46.347007+0000","last_clean":"2024-02-19T21:52:46.347007+0000","last_became_active":"2024-02-19T21:49:54.493167+0000","last_became_peered":"2024-02-19T21:49:54.493167+0000","last_unstale":"2024-02-19T21:52:46.347007+0000","last_undegraded":"2024-02-19T21:52:46.347007+0000","last_fullsized":"2024-02-19T21:52:46.347007+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'44","last_scrub_stamp":"2024-02-19T21:48:32.489084+0000","last_deep_scrub":"201'44","last_deep_scrub_stamp":"2024-02-19T21:44:16.255049+0000","last_clean_scrub_stamp":"2024-02-19T21:48:32.489084+0000","log_size":60,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":80,"num_read_kb":69,"num_write":52,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.5","version":"474'8036","reported_seq":16525,"reported_epoch":474,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:52:57.207785+0000","last_change":"2024-02-19T21:52:17.602505+0000","last_active":"2024-02-19T21:52:57.207785+0000","last_peered":"2024-02-19T21:52:57.207785+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:50:03.654321+0000","last_became_peered":"2024-02-19T21:50:03.654321+0000","last_unstale":"2024-02-19T21:52:57.207785+0000","last_undegraded":"2024-02-19T21:52:17.600617+0000","last_fullsized":"2024-02-19T21:49:55.473278+0000","mapping_epoch":414,"log_start":"404'2600","ondisk_log_start":"404'2600","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5436,"ondisk_log_size":5436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90832896,"num_objects":1386,"num_object_clones":0,"num_object_copies":4158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":58,"num_objects_misplaced":449,"num_objects_unfound":0,"num_objects_dirty":1386,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8036,"num_write_kb":301504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3614,"num_bytes_recovered":236847104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0],"avail_no_missing":["2","0","5"],"object_location_counts":[{"shards":"0,2","objects":879},{"shards":"0,2,5","objects":449}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":503,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.347083+0000","last_change":"2024-02-19T21:49:08.328667+0000","last_active":"2024-02-19T21:52:46.347083+0000","last_peered":"2024-02-19T21:52:46.347083+0000","last_clean":"2024-02-19T21:52:46.347083+0000","last_became_active":"2024-02-19T21:49:08.328287+0000","last_became_peered":"2024-02-19T21:49:08.328287+0000","last_unstale":"2024-02-19T21:52:46.347083+0000","last_undegraded":"2024-02-19T21:52:46.347083+0000","last_fullsized":"2024-02-19T21:52:46.347083+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.176542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.176542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":102,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.335512+0000","last_change":"2024-02-19T21:49:08.332637+0000","last_active":"2024-02-19T21:52:46.335512+0000","last_peered":"2024-02-19T21:52:46.335512+0000","last_clean":"2024-02-19T21:52:46.335512+0000","last_became_active":"2024-02-19T21:49:08.331451+0000","last_became_peered":"2024-02-19T21:49:08.331451+0000","last_unstale":"2024-02-19T21:52:46.335512+0000","last_undegraded":"2024-02-19T21:52:46.335512+0000","last_fullsized":"2024-02-19T21:52:46.335512+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.123413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.547129+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.123413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":473,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.350674+0000","last_change":"2024-02-19T21:49:08.331159+0000","last_active":"2024-02-19T21:52:46.350674+0000","last_peered":"2024-02-19T21:52:46.350674+0000","last_clean":"2024-02-19T21:52:46.350674+0000","last_became_active":"2024-02-19T21:49:08.330804+0000","last_became_peered":"2024-02-19T21:49:08.330804+0000","last_unstale":"2024-02-19T21:52:46.350674+0000","last_undegraded":"2024-02-19T21:52:46.350674+0000","last_fullsized":"2024-02-19T21:52:46.350674+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.978015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.978015+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"470'25","reported_seq":490,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.347671+0000","last_change":"2024-02-19T21:48:23.326608+0000","last_active":"2024-02-19T21:52:46.347671+0000","last_peered":"2024-02-19T21:52:46.347671+0000","last_clean":"2024-02-19T21:52:46.347671+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:52:46.347671+0000","last_undegraded":"2024-02-19T21:52:46.347671+0000","last_fullsized":"2024-02-19T21:52:46.347671+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"377'19","last_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_deep_scrub":"377'19","last_deep_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.326541+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"474'7874","reported_seq":7970,"reported_epoch":474,"state":"active+clean","last_fresh":"2024-02-19T21:52:55.311792+0000","last_change":"2024-02-19T21:48:47.780368+0000","last_active":"2024-02-19T21:52:55.311792+0000","last_peered":"2024-02-19T21:52:55.311792+0000","last_clean":"2024-02-19T21:52:55.311792+0000","last_became_active":"2024-02-19T21:48:47.780046+0000","last_became_peered":"2024-02-19T21:48:47.780046+0000","last_unstale":"2024-02-19T21:52:55.311792+0000","last_undegraded":"2024-02-19T21:52:55.311792+0000","last_fullsized":"2024-02-19T21:52:55.311792+0000","mapping_epoch":385,"log_start":"404'2700","ondisk_log_start":"404'2700","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5174,"ondisk_log_size":5174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":100532224,"num_objects":1534,"num_object_clones":0,"num_object_copies":4602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1534,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7874,"num_write_kb":301056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":467,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.353129+0000","last_change":"2024-02-19T21:46:01.981923+0000","last_active":"2024-02-19T21:52:46.353129+0000","last_peered":"2024-02-19T21:52:46.353129+0000","last_clean":"2024-02-19T21:52:46.353129+0000","last_became_active":"2024-02-19T21:44:56.160521+0000","last_became_peered":"2024-02-19T21:44:56.160521+0000","last_unstale":"2024-02-19T21:52:46.353129+0000","last_undegraded":"2024-02-19T21:52:46.353129+0000","last_fullsized":"2024-02-19T21:52:46.353129+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.981866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.981866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":111,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.336535+0000","last_change":"2024-02-19T21:49:54.485377+0000","last_active":"2024-02-19T21:52:46.336535+0000","last_peered":"2024-02-19T21:52:46.336535+0000","last_clean":"2024-02-19T21:52:46.336535+0000","last_became_active":"2024-02-19T21:49:54.485078+0000","last_became_peered":"2024-02-19T21:49:54.485078+0000","last_unstale":"2024-02-19T21:52:46.336535+0000","last_undegraded":"2024-02-19T21:52:46.336535+0000","last_fullsized":"2024-02-19T21:52:46.336535+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:52.107416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:46:52.107416+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"470'39","reported_seq":562,"reported_epoch":473,"state":"active+clean","last_fresh":"2024-02-19T21:52:46.350298+0000","last_change":"2024-02-19T21:49:55.109780+0000","last_active":"2024-02-19T21:52:46.350298+0000","last_peered":"2024-02-19T21:52:46.350298+0000","last_clean":"2024-02-19T21:52:46.350298+0000","last_became_active":"2024-02-19T21:49:54.486014+0000","last_became_peered":"2024-02-19T21:49:54.486014+0000","last_unstale":"2024-02-19T21:52:46.350298+0000","last_undegraded":"2024-02-19T21:52:46.350298+0000","last_fullsized":"2024-02-19T21:52:46.350298+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'27","last_scrub_stamp":"2024-02-19T21:48:24.665813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:24.665813+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"324'11","reported_seq":726,"reported_epoch":474,"state":"active+clean","last_fresh":"2024-02-19T21:52:50.353047+0000","last_change":"2024-02-19T21:48:26.293036+0000","last_active":"2024-02-19T21:52:50.353047+0000","last_peered":"2024-02-19T21:52:50.353047+0000","last_clean":"2024-02-19T21:52:50.353047+0000","last_became_active":"2024-02-19T21:44:34.385140+0000","last_became_peered":"2024-02-19T21:44:34.385140+0000","last_unstale":"2024-02-19T21:52:50.353047+0000","last_undegraded":"2024-02-19T21:52:50.353047+0000","last_fullsized":"2024-02-19T21:52:50.353047+0000","mapping_epoch":62,"log_start":"66'8","ondisk_log_start":"66'8","created":62,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'11","last_scrub_stamp":"2024-02-19T21:48:26.292909+0000","last_deep_scrub":"324'11","last_deep_scrub_stamp":"2024-02-19T21:46:05.210095+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.292909+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":1603403800,"num_objects":24467,"num_object_clones":0,"num_object_copies":73401,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1579,"num_objects_misplaced":1334,"num_objects_unfound":0,"num_objects_dirty":24467,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":125029,"num_write_kb":4783809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14682,"num_bytes_recovered":940179456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5321469952,"data_stored":5321457736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81029,"ondisk_log_size":81029,"up":48,"acting":46,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1211,"num_read_kb":1206,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1536,"num_read_kb":1293,"num_write":989,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":277,"num_bytes_recovered":5172,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1062,"ondisk_log_size":1062,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":22,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":66,"acting":66,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":382,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201529,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":990440,"kb_used_data":400672,"kb_used_omap":0,"kb_used_meta":589696,"kb_avail":92754712,"statfs":{"total":95995035648,"available":94980825088,"internally_reserved":0,"allocated":410288128,"data_stored":408874507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":603848704},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":1.49,"15min":1.839},"min":{"1min":0.23100000000000001,"5min":0.19400000000000001,"15min":0.189},"max":{"1min":0.57899999999999996,"5min":22.07,"15min":70.477999999999994},"last":1.8759999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":1.548,"15min":2.0049999999999999},"min":{"1min":0.26800000000000002,"5min":0.21199999999999999,"15min":0.20999999999999999},"max":{"1min":1.1140000000000001,"5min":22.457000000000001,"15min":68.052000000000007},"last":1.8120000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":1.4319999999999999,"15min":2.048},"min":{"1min":0.27000000000000002,"5min":0.247,"15min":0.23200000000000001},"max":{"1min":0.434,"5min":22.117999999999999,"15min":68.168000000000006},"last":2.3879999999999999},{"interface":"front","average":{"1min":0.624,"5min":1.796,"15min":2.1099999999999999},"min":{"1min":0.27300000000000002,"5min":0.26300000000000001,"15min":0.223},"max":{"1min":3.3319999999999999,"5min":22.236000000000001,"15min":68.444000000000003},"last":1.8400000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:52:16 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":1.6519999999999999,"15min":2.1499999999999999},"min":{"1min":0.29099999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1970000000000001,"5min":12.304,"15min":12.304},"last":7.1790000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":1.506,"15min":1.8779999999999999},"min":{"1min":0.375,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":6.2779999999999996,"5min":11.69,"15min":11.69},"last":7.2750000000000004}]},{"osd":3,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":1.595,"15min":2.1200000000000001},"min":{"1min":0.36799999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":3.0680000000000001,"5min":11.778,"15min":31.559000000000001},"last":1.9350000000000001},{"interface":"front","average":{"1min":0.434,"5min":1.2490000000000001,"15min":1.8620000000000001},"min":{"1min":0.34100000000000003,"5min":0.30299999999999999,"15min":0.29299999999999998},"max":{"1min":0.68300000000000005,"5min":13.473000000000001,"15min":30.812999999999999},"last":2.423}]},{"osd":4,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":1.417,"15min":1.546},"min":{"1min":0.30399999999999999,"5min":0.245,"15min":0.216},"max":{"1min":1.173,"5min":17.716999999999999,"15min":17.716999999999999},"last":7.2039999999999997},{"interface":"front","average":{"1min":0.45500000000000002,"5min":1.7729999999999999,"15min":1.871},"min":{"1min":0.31900000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.67100000000000004,"5min":15.666,"15min":17.690999999999999},"last":15.961}]},{"osd":5,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":1.6200000000000001,"15min":1.6220000000000001},"min":{"1min":0.29599999999999999,"5min":0.28499999999999998,"15min":0.24199999999999999},"max":{"1min":1.6679999999999999,"5min":29.021000000000001,"15min":29.021000000000001},"last":2.589},{"interface":"front","average":{"1min":0.54700000000000004,"5min":1.756,"15min":1.887},"min":{"1min":0.33900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.3700000000000001,"5min":29.091999999999999,"15min":29.091999999999999},"last":7.1369999999999996}]},{"osd":6,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":1.9219999999999999,"15min":1.694},"min":{"1min":0.39500000000000002,"5min":0.31,"15min":0.24299999999999999},"max":{"1min":1.3919999999999999,"5min":19.286000000000001,"15min":19.286000000000001},"last":10.685},{"interface":"front","average":{"1min":0.52000000000000002,"5min":1.8200000000000001,"15min":1.8560000000000001},"min":{"1min":0.38700000000000001,"5min":0.309,"15min":0.26700000000000002},"max":{"1min":0.70599999999999996,"5min":18.364000000000001,"15min":18.364000000000001},"last":1.9099999999999999}]}]},{"osd":6,"up_from":47,"seq":201863463168,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1309928,"kb_used_data":711968,"kb_used_omap":0,"kb_used_meta":597888,"kb_avail":92435224,"statfs":{"total":95995035648,"available":94653669376,"internally_reserved":0,"allocated":729055232,"data_stored":727640925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":612237312},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,6],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:52:31 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.92500000000000004,"15min":1.5880000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.20100000000000001},"max":{"1min":3.9489999999999998,"5min":7.8170000000000002,"15min":45.197000000000003},"last":2.153},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.391,"15min":1.948},"min":{"1min":0.29399999999999998,"5min":0.23499999999999999,"15min":0.221},"max":{"1min":3.7469999999999999,"5min":6.7320000000000002,"15min":44.753},"last":1.2390000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:52:31 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":1.091,"15min":1.577},"min":{"1min":0.26700000000000002,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":4.101,"5min":7.8639999999999999,"15min":45.231999999999999},"last":2.2109999999999999},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.3029999999999999,"15min":1.6950000000000001},"min":{"1min":0.28699999999999998,"5min":0.245,"15min":0.23100000000000001},"max":{"1min":9.3079999999999998,"5min":9.3079999999999998,"15min":45.097999999999999},"last":1.29}]},{"osd":2,"last update":"Mon Feb 19 21:52:12 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":1.2230000000000001,"15min":1.4550000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.70199999999999996,"5min":6.1820000000000004,"15min":6.1820000000000004},"last":1.2689999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.97299999999999998,"15min":1.1699999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.502,"5min":7.8959999999999999,"15min":7.8959999999999999},"last":2.1850000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:52:31 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.0920000000000001,"15min":1.512},"min":{"1min":0.36699999999999999,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":4.0140000000000002,"5min":7.9210000000000003,"15min":11.15},"last":5.0279999999999996},{"interface":"front","average":{"1min":1.907,"5min":1.478,"15min":1.597},"min":{"1min":0.307,"5min":0.30599999999999999,"15min":0.26400000000000001},"max":{"1min":13.038,"5min":13.038,"15min":19.632999999999999},"last":1.3120000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:52:31 2024","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.821,"15min":1.8380000000000001},"min":{"1min":0.29399999999999998,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":8.5980000000000008,"5min":18.010000000000002,"15min":18.010000000000002},"last":5.0999999999999996},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3120000000000001,"15min":1.7589999999999999},"min":{"1min":0.317,"5min":0.26300000000000001,"15min":0.23499999999999999},"max":{"1min":6.4909999999999997,"5min":11.566000000000001,"15min":16.594999999999999},"last":5.0609999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:52:31 2024","interfaces":[{"interface":"back","average":{"1min":2.214,"5min":1.762,"15min":1.901},"min":{"1min":0.36799999999999999,"5min":0.27400000000000002,"15min":0.27100000000000002},"max":{"1min":7.7370000000000001,"5min":9.5990000000000002,"15min":14.695},"last":2.032},{"interface":"front","average":{"1min":1.962,"5min":1.5800000000000001,"15min":2.0019999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":6.6959999999999997,"5min":11.609999999999999,"15min":15.497999999999999},"last":2.2330000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:51:52 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":1.548,"15min":1.8089999999999999},"min":{"1min":0.32100000000000001,"5min":0.27200000000000002,"15min":0.26700000000000002},"max":{"1min":1.768,"5min":9.1929999999999996,"15min":14.721},"last":5.1900000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":1.5900000000000001,"15min":1.8580000000000001},"min":{"1min":0.39700000000000002,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":1.7989999999999999,"5min":9.2240000000000002,"15min":14.744999999999999},"last":5.2140000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575130,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1310584,"kb_used_data":405872,"kb_used_omap":0,"kb_used_meta":904704,"kb_avail":92434568,"statfs":{"total":95995035648,"available":94652997632,"internally_reserved":0,"allocated":415612928,"data_stored":414183137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":926416896},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:52:20 2024","interfaces":[{"interface":"back","average":{"1min":0.25700000000000001,"5min":0.70599999999999996,"15min":1.329},"min":{"1min":0.186,"5min":0.16300000000000001,"15min":0.161},"max":{"1min":0.38500000000000001,"5min":5.7889999999999997,"15min":42.776000000000003},"last":0.19},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.85399999999999998,"15min":1.504},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.16400000000000001},"max":{"1min":4.1020000000000003,"5min":5.7119999999999997,"15min":44.845999999999997},"last":0.41499999999999998}]},{"osd":2,"last update":"Mon Feb 19 21:52:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.81799999999999995,"15min":0.99399999999999999},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":2.524,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.80900000000000005,"15min":0.94399999999999995},"min":{"1min":0.23899999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":2.823,"5min":4.452,"15min":4.452},"last":1.9379999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:52:20 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72099999999999997,"15min":1.456},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.20999999999999999},"max":{"1min":4.3529999999999998,"5min":4.3710000000000004,"15min":41.607999999999997},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.72299999999999998,"15min":1.381},"min":{"1min":0.27100000000000002,"5min":0.215,"15min":0.215},"max":{"1min":2.4889999999999999,"5min":4.5190000000000001,"15min":42.811999999999998},"last":0.33700000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:52:38 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.1579999999999999,"15min":1.5029999999999999},"min":{"1min":0.32000000000000001,"5min":0.26900000000000002,"15min":0.251},"max":{"1min":6.9690000000000003,"5min":9.8759999999999994,"15min":15.853},"last":5.7229999999999999},{"interface":"front","average":{"1min":1.3420000000000001,"5min":0.98599999999999999,"15min":1.484},"min":{"1min":0.33900000000000002,"5min":0.28000000000000003,"15min":0.26500000000000001},"max":{"1min":6.9800000000000004,"5min":6.9800000000000004,"15min":15.861000000000001},"last":5.7350000000000003}]},{"osd":5,"last update":"Mon Feb 19 21:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":1.0189999999999999,"15min":1.5589999999999999},"min":{"1min":0.307,"5min":0.29599999999999999,"15min":0.27900000000000003},"max":{"1min":2.8759999999999999,"5min":7.3339999999999996,"15min":14.331},"last":1.909},{"interface":"front","average":{"1min":0.54900000000000004,"5min":1.1160000000000001,"15min":1.5580000000000001},"min":{"1min":0.313,"5min":0.307,"15min":0.30099999999999999},"max":{"1min":2.0110000000000001,"5min":14.426,"15min":14.496},"last":1.5940000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":1.1060000000000001,"15min":1.5800000000000001},"min":{"1min":0.377,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":2.5779999999999998,"5min":10.456,"15min":11.638999999999999},"last":2.1640000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.1599999999999999,"15min":1.6870000000000001},"min":{"1min":0.36299999999999999,"5min":0.34699999999999998,"15min":0.29699999999999999},"max":{"1min":3.6480000000000001,"5min":9.8049999999999997,"15min":12.199},"last":0.53300000000000003}]},{"osd":7,"last update":"Mon Feb 19 21:51:57 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":1.2529999999999999,"15min":1.7509999999999999},"min":{"1min":0.35499999999999998,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":2.153,"5min":7.702,"15min":13.904},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":1.323,"15min":1.694},"min":{"1min":0.42799999999999999,"5min":0.35499999999999998,"15min":0.32600000000000001},"max":{"1min":2.4470000000000001,"5min":7.6909999999999998,"15min":13.894},"last":0.39800000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738656,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1926948,"kb_used_data":1028444,"kb_used_omap":0,"kb_used_meta":898496,"kb_avail":91818204,"statfs":{"total":95995035648,"available":94021840896,"internally_reserved":0,"allocated":1053126656,"data_stored":1051716384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":920059904},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:52:12 2024","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.63600000000000001,"15min":1.026},"min":{"1min":0.191,"5min":0.189,"15min":0.153},"max":{"1min":0.53500000000000003,"5min":6.1550000000000002,"15min":16.478000000000002},"last":0.20899999999999999},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.80300000000000005,"15min":1.2270000000000001},"min":{"1min":0.222,"5min":0.20100000000000001,"15min":0.17799999999999999},"max":{"1min":1.04,"5min":6.9359999999999999,"15min":13.422000000000001},"last":0.28299999999999997}]},{"osd":2,"last update":"Mon Feb 19 21:52:12 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.56100000000000005,"15min":0.628},"min":{"1min":0.223,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.95699999999999996,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.86399999999999999,"15min":1.0760000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.79200000000000004,"5min":8.9960000000000004,"15min":8.9960000000000004},"last":0.25600000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:52:01 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.89700000000000002,"15min":1.5289999999999999},"min":{"1min":0.28000000000000003,"5min":0.217,"15min":0.21299999999999999},"max":{"1min":1.4159999999999999,"5min":12.691000000000001,"15min":14.507999999999999},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.80100000000000005,"15min":1.371},"min":{"1min":0.26300000000000001,"5min":0.24099999999999999,"15min":0.23400000000000001},"max":{"1min":1.3089999999999999,"5min":6.6150000000000002,"15min":18.759},"last":1.343}]},{"osd":4,"last update":"Mon Feb 19 21:52:48 2024","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.25,"15min":1.657},"min":{"1min":0.32800000000000001,"5min":0.29399999999999998,"15min":0.252},"max":{"1min":6.8310000000000004,"5min":10.311,"15min":13.278},"last":0.32500000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1599999999999999,"15min":1.498},"min":{"1min":0.33000000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":3.3679999999999999,"5min":10.109,"15min":10.109},"last":0.40000000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:52:01 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":1.708,"15min":1.984},"min":{"1min":0.318,"5min":0.317,"15min":0.27600000000000002},"max":{"1min":1.014,"5min":25.442,"15min":42.799999999999997},"last":0.318},{"interface":"front","average":{"1min":0.46700000000000003,"5min":1.696,"15min":2.0270000000000001},"min":{"1min":0.35799999999999998,"5min":0.33200000000000002,"15min":0.27300000000000002},"max":{"1min":0.65800000000000003,"5min":25.411999999999999,"15min":42.695},"last":0.41899999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:52:16 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":1.3700000000000001,"15min":1.6459999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.27000000000000002},"max":{"1min":1.4390000000000001,"5min":10.278,"15min":42.777000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":1.4890000000000001,"15min":1.845},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.28599999999999998},"max":{"1min":1.6539999999999999,"5min":11.84,"15min":13.289999999999999},"last":0.34000000000000002}]},{"osd":7,"last update":"Mon Feb 19 21:52:54 2024","interfaces":[{"interface":"back","average":{"1min":1.8320000000000001,"5min":1.274,"15min":1.8069999999999999},"min":{"1min":0.45700000000000002,"5min":0.36499999999999999,"15min":0.31},"max":{"1min":5.7229999999999999,"5min":9.6460000000000008,"15min":42.758000000000003},"last":0.47799999999999998},{"interface":"front","average":{"1min":1.554,"5min":1.2929999999999999,"15min":1.6890000000000001},"min":{"1min":0.435,"5min":0.40000000000000002,"15min":0.36399999999999999},"max":{"1min":5.7119999999999997,"5min":9.6389999999999993,"15min":42.718000000000004},"last":0.435}]}]},{"osd":2,"up_from":394,"seq":1692217114670,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":991824,"kb_used_data":667784,"kb_used_omap":0,"kb_used_meta":324031,"kb_avail":92753328,"statfs":{"total":95995035648,"available":94979407872,"internally_reserved":0,"allocated":683810816,"data_stored":682420726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":331807796},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.91100000000000003,"15min":1.081},"min":{"1min":0.20300000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":3.1779999999999999,"5min":9.1530000000000005,"15min":9.1530000000000005},"last":9.2629999999999999},{"interface":"front","average":{"1min":0.29299999999999998,"5min":0.873,"15min":1.1060000000000001},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.435,"5min":6.149,"15min":6.149},"last":5.0010000000000003}]},{"osd":1,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55100000000000005,"15min":0.59799999999999998},"min":{"1min":0.20999999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":3.073,"5min":3.073,"15min":3.073},"last":4.3650000000000002},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.78500000000000003,"15min":0.90700000000000003},"min":{"1min":0.249,"5min":0.224,"15min":0.224},"max":{"1min":1.1439999999999999,"5min":6.992,"15min":6.992},"last":4.2930000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":1.115,"15min":1.3380000000000001},"min":{"1min":0.30599999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.117,"5min":6.9470000000000001,"15min":6.9470000000000001},"last":2.4409999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.96499999999999997,"15min":1.1830000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.48299999999999998,"5min":6.6500000000000004,"15min":6.6500000000000004},"last":3.1160000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":1.54,"15min":1.952},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.7729999999999999,"5min":7.0339999999999998,"15min":7.0339999999999998},"last":3.1930000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":1.4399999999999999,"15min":1.784},"min":{"1min":0.38400000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.1699999999999999,"5min":7.0419999999999998,"15min":7.0419999999999998},"last":3.0499999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":1.48,"15min":1.6859999999999999},"min":{"1min":0.36899999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":3.4300000000000002,"5min":10.067,"15min":10.067},"last":2.4729999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":1.3160000000000001,"15min":1.6519999999999999},"min":{"1min":0.33200000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.5,"5min":13.558,"15min":13.558},"last":3.1549999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":1.3080000000000001,"15min":1.6040000000000001},"min":{"1min":0.34200000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.1819999999999999,"5min":5.6829999999999998,"15min":5.6829999999999998},"last":3.2989999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.88300000000000001,"15min":0.98899999999999999},"min":{"1min":0.36699999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.024,"5min":7,"15min":7},"last":6.5709999999999997}]},{"osd":7,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":1.177,"15min":1.361},"min":{"1min":0.39900000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67000000000000004,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":5.0339999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.72699999999999998,"15min":0.80500000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.802,"5min":2.782,"15min":2.782},"last":6.5309999999999997}]}]},{"osd":3,"up_from":0,"seq":111669149968,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":32,"seq":137438953737,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1852952,"kb_used_data":1250960,"kb_used_omap":0,"kb_used_meta":601984,"kb_avail":91892200,"statfs":{"total":95995035648,"available":94097612800,"internally_reserved":0,"allocated":1280983040,"data_stored":1279584104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":616431616},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:52:34 2024","interfaces":[{"interface":"back","average":{"1min":1.9099999999999999,"5min":1.857,"15min":1.885},"min":{"1min":0.25900000000000001,"5min":0.219,"15min":0.219},"max":{"1min":9.923,"5min":53.936,"15min":53.936},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.595,"5min":2.012,"15min":1.972},"min":{"1min":0.27200000000000002,"5min":0.252,"15min":0.22600000000000001},"max":{"1min":10.140000000000001,"5min":54.405999999999999,"15min":54.405999999999999},"last":0.60799999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:52:34 2024","interfaces":[{"interface":"back","average":{"1min":2.0230000000000001,"5min":2.012,"15min":1.8260000000000001},"min":{"1min":0.26100000000000001,"5min":0.253,"15min":0.21199999999999999},"max":{"1min":12.439,"5min":54.731000000000002,"15min":54.731000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":1.532,"5min":1.9330000000000001,"15min":1.704},"min":{"1min":0.29499999999999998,"5min":0.252,"15min":0.25},"max":{"1min":8.4689999999999994,"5min":52.490000000000002,"15min":52.490000000000002},"last":0.63400000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:52:11 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":1.444,"15min":1.8660000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.2070000000000001,"5min":9.0619999999999994,"15min":9.0619999999999994},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.496,"5min":1.4830000000000001,"15min":1.903},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.2370000000000001,"5min":9.0899999999999999,"15min":9.0899999999999999},"last":0.71499999999999997}]},{"osd":3,"last update":"Mon Feb 19 21:52:34 2024","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.3480000000000001,"15min":1.702},"min":{"1min":0.35099999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":9.9529999999999994,"5min":9.9529999999999994,"15min":15.914999999999999},"last":4.0439999999999996},{"interface":"front","average":{"1min":2.1560000000000001,"5min":1.4970000000000001,"15min":1.6950000000000001},"min":{"1min":0.36299999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":12.486000000000001,"5min":12.486000000000001,"15min":13.321},"last":0.69199999999999995}]},{"osd":5,"last update":"Mon Feb 19 21:52:28 2024","interfaces":[{"interface":"back","average":{"1min":2.1320000000000001,"5min":1.921,"15min":1.865},"min":{"1min":0.28100000000000003,"5min":0.23799999999999999,"15min":0.23400000000000001},"max":{"1min":13.458,"5min":16.731999999999999,"15min":18.916},"last":0.55800000000000005},{"interface":"front","average":{"1min":1.8740000000000001,"5min":1.653,"15min":2.044},"min":{"1min":0.30399999999999999,"5min":0.26700000000000002,"15min":0.253},"max":{"1min":14.532999999999999,"5min":14.532999999999999,"15min":14.840999999999999},"last":0.995}]},{"osd":6,"last update":"Mon Feb 19 21:52:34 2024","interfaces":[{"interface":"back","average":{"1min":2.4369999999999998,"5min":1.698,"15min":1.7649999999999999},"min":{"1min":0.33600000000000002,"5min":0.28999999999999998,"15min":0.28599999999999998},"max":{"1min":10.233000000000001,"5min":10.233000000000001,"15min":13.27},"last":1.1020000000000001},{"interface":"front","average":{"1min":2.4470000000000001,"5min":2.1699999999999999,"15min":1.9710000000000001},"min":{"1min":0.32900000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":13.433999999999999,"5min":18.670000000000002,"15min":18.670000000000002},"last":0.47299999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:52:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":1.7350000000000001,"15min":1.7849999999999999},"min":{"1min":0.36399999999999999,"5min":0.311,"15min":0.30399999999999999},"max":{"1min":2.8679999999999999,"5min":16.763999999999999,"15min":16.763999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.80900000000000005,"5min":1.403,"15min":1.6970000000000001},"min":{"1min":0.36299999999999999,"5min":0.32400000000000001,"15min":0.31},"max":{"1min":2.5310000000000001,"5min":10.044,"15min":12.808999999999999},"last":1.075}]}]},{"osd":5,"up_from":38,"seq":163208757509,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1739532,"kb_used_data":848964,"kb_used_omap":0,"kb_used_meta":890432,"kb_avail":92005620,"statfs":{"total":95995035648,"available":94213754880,"internally_reserved":0,"allocated":869339136,"data_stored":867952587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":911802368},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,0,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":1.306,"15min":1.728},"min":{"1min":0.24199999999999999,"5min":0.23100000000000001,"15min":0.20599999999999999},"max":{"1min":2.96,"5min":19.236000000000001,"15min":20.550999999999998},"last":5.306},{"interface":"front","average":{"1min":0.36399999999999999,"5min":1.204,"15min":1.853},"min":{"1min":0.24099999999999999,"5min":0.23699999999999999,"15min":0.20899999999999999},"max":{"1min":0.52800000000000002,"5min":10.887,"15min":20.879000000000001},"last":4.1509999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":1.1890000000000001,"15min":1.663},"min":{"1min":0.246,"5min":0.246,"15min":0.23100000000000001},"max":{"1min":0.51500000000000001,"5min":8.2010000000000005,"15min":10.42},"last":4.1159999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":1.05,"15min":1.5449999999999999},"min":{"1min":0.29099999999999998,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":2.794,"5min":10.315,"15min":10.965},"last":0.38800000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":1.131,"15min":1.3080000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":3.9470000000000001,"5min":7.0380000000000003,"15min":7.0380000000000003},"last":8.2889999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":1.0940000000000001,"15min":1.24},"min":{"1min":0.309,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.9119999999999999,"5min":4.2619999999999996,"15min":4.2619999999999996},"last":1.0449999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":1.4319999999999999,"15min":1.998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.24099999999999999},"max":{"1min":2.9039999999999999,"5min":19.321000000000002,"15min":20.146999999999998},"last":5.4009999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":1.24,"15min":2.0680000000000001},"min":{"1min":0.35899999999999999,"5min":0.33600000000000002,"15min":0.29499999999999998},"max":{"1min":2.883,"5min":8.0359999999999996,"15min":20.120000000000001},"last":4.0780000000000003}]},{"osd":4,"last update":"Mon Feb 19 21:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.95299999999999996,"15min":1.4059999999999999},"min":{"1min":0.26200000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":2.7280000000000002,"5min":7.6710000000000003,"15min":21.577000000000002},"last":0.443},{"interface":"front","average":{"1min":0.46400000000000002,"5min":1.6040000000000001,"15min":1.879},"min":{"1min":0.317,"5min":0.26100000000000001,"15min":0.25600000000000001},"max":{"1min":0.872,"5min":19.274000000000001,"15min":19.274000000000001},"last":8.2599999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.641,"5min":1.954,"15min":1.9970000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.221},"max":{"1min":10.611000000000001,"5min":19.884,"15min":19.884},"last":5.3399999999999999},{"interface":"front","average":{"1min":1.8620000000000001,"5min":1.6599999999999999,"15min":1.9399999999999999},"min":{"1min":0.378,"5min":0.30199999999999999,"15min":0.23599999999999999},"max":{"1min":6.6500000000000004,"5min":10.260999999999999,"15min":13.532999999999999},"last":0.98199999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":1.7110000000000001,"15min":2.0150000000000001},"min":{"1min":0.34200000000000003,"5min":0.33500000000000002,"15min":0.27100000000000002},"max":{"1min":1.976,"5min":12.611000000000001,"15min":12.962},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":1.611,"15min":1.843},"min":{"1min":0.38100000000000001,"5min":0.221,"15min":0.221},"max":{"1min":2.0099999999999998,"5min":15.593999999999999,"15min":17.759},"last":0.41999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1026035712,"data_stored":1026031640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":404422656,"data_stored":404422656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":653066240,"data_stored":653066240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1272582144,"data_stored":1272578072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":849543168,"data_stored":849543168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":710610944,"data_stored":710606872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":405209088,"data_stored":405209088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:53:00.568 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph status --format=json 2024-02-19T21:53:00.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:58.701612+0000 osd.0 (osd.0) 271 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:53:00.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:58.701667+0000 osd.0 (osd.0) 272 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:53:00.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:59.222690+0000 mgr.y (mgr.14514) 781 : cluster [DBG] pgmap v1011: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 1.5 GiB data, 9.7 GiB used, 616 GiB / 626 GiB avail; 575 B/s rd, 0 B/s wr, 638 op/s; 1579/73977 objects degraded (2.134%); 1334/73977 objects misplaced (1.803%); 6.1 MiB/s, 97 objects/s recovering 2024-02-19T21:53:00.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:52:59.340496+0000 mon.a (mon.0) 1832 : cluster [DBG] osdmap e476: 8 total, 8 up, 7 in 2024-02-19T21:53:00.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:00.325775+0000 mon.a (mon.0) 1833 : cluster [WRN] Health check update: Degraded data redundancy: 1579/73977 objects degraded (2.134%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-19T21:53:01.095 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:53:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:53:00] "GET /metrics HTTP/1.1" 200 176613 "" "Prometheus/2.33.4" 2024-02-19T21:53:01.189 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:53:01.194 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:01.195 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:53:01.295 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:53:01.346 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:01.556 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:53:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:53:01.568 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-19T21:53:02.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:01.128743+0000 mgr.y (mgr.14514) 782 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:53:02.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:01.223519+0000 mgr.y (mgr.14514) 783 : cluster [DBG] pgmap v1013: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 1.2 GiB data, 8.9 GiB used, 617 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.07k op/s; 1809/61836 objects degraded (2.925%); 1046/61836 objects misplaced (1.692%); 4.1 MiB/s, 64 objects/s recovering 2024-02-19T21:53:02.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:01.128743+0000 mgr.y (mgr.14514) 782 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:53:02.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:01.223519+0000 mgr.y (mgr.14514) 783 : cluster [DBG] pgmap v1013: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 1.2 GiB data, 8.9 GiB used, 617 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.07k op/s; 1809/61836 objects degraded (2.925%); 1046/61836 objects misplaced (1.692%); 4.1 MiB/s, 64 objects/s recovering 2024-02-19T21:53:02.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:01.128743+0000 mgr.y (mgr.14514) 782 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:53:02.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:01.223519+0000 mgr.y (mgr.14514) 783 : cluster [DBG] pgmap v1013: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 1.2 GiB data, 8.9 GiB used, 617 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.07k op/s; 1809/61836 objects degraded (2.925%); 1046/61836 objects misplaced (1.692%); 4.1 MiB/s, 64 objects/s recovering 2024-02-19T21:53:03.022 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:53:03.025 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:03.025 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:53:03.126 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:53:03.189 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:03.226 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:53:03.239 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:03.239 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:53:03.340 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:53:03.409 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:03.446 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:53:03.457 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:03.457 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:53:03.557 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:53:03.584 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:03.605 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:53:03.608 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:03.609 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:53:03.709 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:53:03.736 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:03.754 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:53:03.757 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:03.757 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:53:03.858 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:53:03.888 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:04.168 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:53:04.168 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:53:04.173 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:53:04.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:03.224027+0000 mgr.y (mgr.14514) 784 : cluster [DBG] pgmap v1014: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 1.2 GiB data, 8.8 GiB used, 617 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 825 op/s; 1809/60042 objects degraded (3.013%); 600/60042 objects misplaced (0.999%); 7.5 MiB/s, 120 objects/s recovering 2024-02-19T21:53:04.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:03.376097+0000 mon.a (mon.0) 1834 : cluster [DBG] osdmap e477: 8 total, 8 up, 7 in 2024-02-19T21:53:04.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:03.224027+0000 mgr.y (mgr.14514) 784 : cluster [DBG] pgmap v1014: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 1.2 GiB data, 8.8 GiB used, 617 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 825 op/s; 1809/60042 objects degraded (3.013%); 600/60042 objects misplaced (0.999%); 7.5 MiB/s, 120 objects/s recovering 2024-02-19T21:53:04.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:03.376097+0000 mon.a (mon.0) 1834 : cluster [DBG] osdmap e477: 8 total, 8 up, 7 in 2024-02-19T21:53:04.643 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:53:04.653 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:04.654 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:53:04.755 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:53:04.800 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:04.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:03.224027+0000 mgr.y (mgr.14514) 784 : cluster [DBG] pgmap v1014: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 1.2 GiB data, 8.8 GiB used, 617 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 825 op/s; 1809/60042 objects degraded (3.013%); 600/60042 objects misplaced (0.999%); 7.5 MiB/s, 120 objects/s recovering 2024-02-19T21:53:04.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:03.376097+0000 mon.a (mon.0) 1834 : cluster [DBG] osdmap e477: 8 total, 8 up, 7 in 2024-02-19T21:53:04.879 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:53:04.879 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:53:04.881 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:53:04.882 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:53:04.888 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:04.888 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:53:04.912 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:53:04.943 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:53:04.977 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:53:04.989 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:53:05.005 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:53:05.040 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:05.041 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:53:05.052 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:53:05.052 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:53:05.052 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:53:05.052 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:53:05.052 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:53:05.052 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:53:05.052 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:53:05.052 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:53:05.081 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:53:05.088 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:05.088 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:53:05.189 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:53:05.220 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:05.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:04.380203+0000 mon.a (mon.0) 1835 : cluster [DBG] osdmap e478: 8 total, 8 up, 7 in 2024-02-19T21:53:05.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:04.385581+0000 osd.5 (osd.5) 271 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:53:05.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:04.385624+0000 osd.5 (osd.5) 272 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:53:05.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:04.783868+0000 mon.a (mon.0) 1836 : audit [DBG] from='client.? 172.21.15.80:0/3168627782' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:53:05.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:05.326978+0000 mon.a (mon.0) 1837 : cluster [WRN] Health check update: Degraded data redundancy: 1809/60042 objects degraded (3.013%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-19T21:53:05.808 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:53:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:53:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:53:05.828 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:04.380203+0000 mon.a (mon.0) 1835 : cluster [DBG] osdmap e478: 8 total, 8 up, 7 in 2024-02-19T21:53:05.828 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:04.385581+0000 osd.5 (osd.5) 271 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:53:05.828 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:04.385624+0000 osd.5 (osd.5) 272 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:53:05.828 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:04.783868+0000 mon.a (mon.0) 1836 : audit [DBG] from='client.? 172.21.15.80:0/3168627782' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:53:05.829 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:05.326978+0000 mon.a (mon.0) 1837 : cluster [WRN] Health check update: Degraded data redundancy: 1809/60042 objects degraded (3.013%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-19T21:53:05.829 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:04.380203+0000 mon.a (mon.0) 1835 : cluster [DBG] osdmap e478: 8 total, 8 up, 7 in 2024-02-19T21:53:05.829 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:04.385581+0000 osd.5 (osd.5) 271 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:53:05.829 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:04.385624+0000 osd.5 (osd.5) 272 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:53:05.829 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:04.783868+0000 mon.a (mon.0) 1836 : audit [DBG] from='client.? 172.21.15.80:0/3168627782' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:53:05.829 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:05.326978+0000 mon.a (mon.0) 1837 : cluster [WRN] Health check update: Degraded data redundancy: 1809/60042 objects degraded (3.013%), 2 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2024-02-19T21:53:06.296 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.2 dump_blocked_ops 2024-02-19T21:53:06.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:05.097578+0000 osd.7 (osd.7) 250 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:53:06.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:05.097635+0000 osd.7 (osd.7) 251 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:53:06.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:05.224526+0000 mgr.y (mgr.14514) 785 : cluster [DBG] pgmap v1017: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 1.1 GiB data, 8.5 GiB used, 617 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 1.17k op/s; 1809/52962 objects degraded (3.416%); 600/52962 objects misplaced (1.133%); 5.2 MiB/s, 83 objects/s recovering 2024-02-19T21:53:06.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:05.455336+0000 mon.a (mon.0) 1838 : cluster [DBG] osdmap e479: 8 total, 8 up, 7 in 2024-02-19T21:53:06.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:05.097578+0000 osd.7 (osd.7) 250 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:53:06.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:05.097635+0000 osd.7 (osd.7) 251 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:53:06.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:05.224526+0000 mgr.y (mgr.14514) 785 : cluster [DBG] pgmap v1017: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 1.1 GiB data, 8.5 GiB used, 617 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 1.17k op/s; 1809/52962 objects degraded (3.416%); 600/52962 objects misplaced (1.133%); 5.2 MiB/s, 83 objects/s recovering 2024-02-19T21:53:06.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:05.455336+0000 mon.a (mon.0) 1838 : cluster [DBG] osdmap e479: 8 total, 8 up, 7 in 2024-02-19T21:53:06.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:05.097578+0000 osd.7 (osd.7) 250 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:53:06.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:05.097635+0000 osd.7 (osd.7) 251 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:53:06.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:05.224526+0000 mgr.y (mgr.14514) 785 : cluster [DBG] pgmap v1017: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 1.1 GiB data, 8.5 GiB used, 617 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 1.17k op/s; 1809/52962 objects degraded (3.416%); 600/52962 objects misplaced (1.133%); 5.2 MiB/s, 83 objects/s recovering 2024-02-19T21:53:06.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:05.455336+0000 mon.a (mon.0) 1838 : cluster [DBG] osdmap e479: 8 total, 8 up, 7 in 2024-02-19T21:53:06.932 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:53:07.483 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:53:07.486 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:07.486 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:53:07.587 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:53:07.683 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:07.711 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:53:07.713 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:07.714 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:53:07.814 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:53:07.856 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:07.964 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:53:07.967 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:07.967 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:53:08.068 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:53:08.103 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:08.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:07.129292+0000 osd.3 (osd.3) 230 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:53:08.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:07.129348+0000 osd.3 (osd.3) 231 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:53:08.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:07.224928+0000 mgr.y (mgr.14514) 786 : cluster [DBG] pgmap v1019: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 1015 MiB data, 8.2 GiB used, 618 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 697 op/s; 1983/49296 objects degraded (4.023%); 367/49296 objects misplaced (0.744%); 5.3 MiB/s, 84 objects/s recovering 2024-02-19T21:53:08.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:07.472880+0000 mon.a (mon.0) 1839 : cluster [DBG] osdmap e480: 8 total, 8 up, 7 in 2024-02-19T21:53:08.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:07.129292+0000 osd.3 (osd.3) 230 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:53:08.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:07.129348+0000 osd.3 (osd.3) 231 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:53:08.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:07.224928+0000 mgr.y (mgr.14514) 786 : cluster [DBG] pgmap v1019: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 1015 MiB data, 8.2 GiB used, 618 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 697 op/s; 1983/49296 objects degraded (4.023%); 367/49296 objects misplaced (0.744%); 5.3 MiB/s, 84 objects/s recovering 2024-02-19T21:53:08.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:07.472880+0000 mon.a (mon.0) 1839 : cluster [DBG] osdmap e480: 8 total, 8 up, 7 in 2024-02-19T21:53:08.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:07.129292+0000 osd.3 (osd.3) 230 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:53:08.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:07.129348+0000 osd.3 (osd.3) 231 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:53:08.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:07.224928+0000 mgr.y (mgr.14514) 786 : cluster [DBG] pgmap v1019: 138 pgs: 136 active+clean, 2 active+recovering+undersized+degraded+remapped; 1015 MiB data, 8.2 GiB used, 618 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 697 op/s; 1983/49296 objects degraded (4.023%); 367/49296 objects misplaced (0.744%); 5.3 MiB/s, 84 objects/s recovering 2024-02-19T21:53:08.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:07.472880+0000 mon.a (mon.0) 1839 : cluster [DBG] osdmap e480: 8 total, 8 up, 7 in 2024-02-19T21:53:09.563 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:53:09.568 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:09.568 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:53:09.669 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:53:09.722 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:09.782 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:53:09.788 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:09.788 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:53:09.889 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:53:09.935 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:10.133 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:53:10.144 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:53:10.149 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:10.149 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:53:10.250 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:53:10.297 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:10.492 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-02-19T21:53:10.541 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:53:10.541 INFO:teuthology.orchestra.run.smithi080.stdout:{"fsid":"6f763558-cf6d-11ee-95bb-87774f69a715","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1925/47724 objects degraded (4.034%), 1 pg degraded, 1 pg undersized","count":2},"muted":false}},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1477,"monmap":{"epoch":3,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":481,"num_osds":8,"num_up_osds":8,"osd_up_since":1708379347,"num_in_osds":7,"osd_in_since":1708379252,"num_remapped_pgs":1},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137},{"state_name":"active+recovering+undersized+degraded+remapped","count":1}],"num_pgs":138,"num_pools":7,"num_objects":15908,"data_bytes":1029904060,"bytes_used":8681537536,"bytes_avail":663283712000,"bytes_total":671965249536,"degraded_objects":1925,"degraded_total":47724,"degraded_ratio":0.040336099237281028,"misplaced_objects":364,"misplaced_total":47724,"misplaced_ratio":0.007627189673958595,"recovering_objects_per_sec":20,"recovering_bytes_per_sec":694945,"recovering_keys_per_sec":0,"num_objects_recovered":120,"num_bytes_recovered":4063232,"num_keys_recovered":0,"read_bytes_sec":875,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":702},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"services":{"dashboard":"https://172.21.15.80:8443/","prometheus":"http://172.21.15.80:9283/"}},"servicemap":{"epoch":15,"modified":"2024-02-19T21:50:07.164150+0000","services":{"rgw":{"daemons":{"summary":"","14445":{"start_epoch":12,"start_stamp":"2024-02-19T21:32:30.457944+0000","gid":14445,"addr":"172.21.15.80:0/10763483","metadata":{"arch":"x86_64","ceph_release":"pacific","ceph_version":"ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)","ceph_version_short":"16.2.14-548-g81bd20d6","container_hostname":"smithi080","container_image":"quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9","cpu":"Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz","distro":"centos","distro_description":"CentOS Stream 8","distro_version":"8","frontend_config#0":"beast port=80","frontend_type#0":"beast","hostname":"smithi080","id":"foo.a","kernel_description":"#1 SMP Mon Feb 5 18:34:56 UTC 2024","kernel_version":"4.18.0-539.el8.x86_64","mem_swap_kb":"0","mem_total_kb":"32537572","num_handles":"1","os":"Linux","pid":"7","realm_id":"","realm_name":"","zone_id":"34a855d6-dbbc-4802-a6e9-a7d60f23c9d4","zone_name":"default","zonegroup_id":"7194a06a-53d8-4b5f-8306-5954e6d460c8","zonegroup_name":"default"},"task_status":{}}}}}},"progress_events":{"0d84ec8e-b738-4996-b3e9-d3d54263ac3b":{"message":"Global Recovery Event (5m)\n [===========================.] (remaining: 4s)","progress":0.98550724983215332,"add_to_ceph_s":true}}} 2024-02-19T21:53:10.655 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:53:10.660 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:10.660 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:53:10.761 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:53:10.771 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:09.225378+0000 mgr.y (mgr.14514) 787 : cluster [DBG] pgmap v1021: 138 pgs: 137 active+clean, 1 active+recovering+undersized+degraded+remapped; 982 MiB data, 8.1 GiB used, 618 GiB / 626 GiB avail; 875 B/s rd, 0 B/s wr, 703 op/s; 1925/47724 objects degraded (4.034%); 364/47724 objects misplaced (0.763%); 679 KiB/s, 20 objects/s recovering 2024-02-19T21:53:10.771 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:10.018421+0000 mon.c (mon.2) 117 : audit [INF] from='client.? 172.21.15.80:0/2375496043' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:53:10.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:10.020934+0000 mon.a (mon.0) 1840 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:53:10.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:10.336157+0000 mon.a (mon.0) 1841 : cluster [WRN] Health check update: Degraded data redundancy: 1925/47724 objects degraded (4.034%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2024-02-19T21:53:10.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:09.225378+0000 mgr.y (mgr.14514) 787 : cluster [DBG] pgmap v1021: 138 pgs: 137 active+clean, 1 active+recovering+undersized+degraded+remapped; 982 MiB data, 8.1 GiB used, 618 GiB / 626 GiB avail; 875 B/s rd, 0 B/s wr, 703 op/s; 1925/47724 objects degraded (4.034%); 364/47724 objects misplaced (0.763%); 679 KiB/s, 20 objects/s recovering 2024-02-19T21:53:10.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:10.018421+0000 mon.c (mon.2) 117 : audit [INF] from='client.? 172.21.15.80:0/2375496043' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:53:10.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:10.020934+0000 mon.a (mon.0) 1840 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:53:10.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:10.336157+0000 mon.a (mon.0) 1841 : cluster [WRN] Health check update: Degraded data redundancy: 1925/47724 objects degraded (4.034%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2024-02-19T21:53:10.772 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:53:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:53:10] "GET /metrics HTTP/1.1" 200 176613 "" "Prometheus/2.33.4" 2024-02-19T21:53:10.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:09.225378+0000 mgr.y (mgr.14514) 787 : cluster [DBG] pgmap v1021: 138 pgs: 137 active+clean, 1 active+recovering+undersized+degraded+remapped; 982 MiB data, 8.1 GiB used, 618 GiB / 626 GiB avail; 875 B/s rd, 0 B/s wr, 703 op/s; 1925/47724 objects degraded (4.034%); 364/47724 objects misplaced (0.763%); 679 KiB/s, 20 objects/s recovering 2024-02-19T21:53:10.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:10.018421+0000 mon.c (mon.2) 117 : audit [INF] from='client.? 172.21.15.80:0/2375496043' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:53:10.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:10.020934+0000 mon.a (mon.0) 1840 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:53:10.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:10.336157+0000 mon.a (mon.0) 1841 : cluster [WRN] Health check update: Degraded data redundancy: 1925/47724 objects degraded (4.034%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2024-02-19T21:53:10.823 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:10.851 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:53:10.857 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:10.858 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:53:10.959 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:53:11.007 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:11.142 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:53:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:53:11.218 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:53:11.224 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:11.225 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:53:11.326 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:53:11.416 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:11.464 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:53:11.467 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:53:11.471 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:11.472 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:53:11.501 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:10.474328+0000 mon.a (mon.0) 1842 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:53:11.501 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:10.483968+0000 mon.a (mon.0) 1843 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:53:11.501 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:10.484050+0000 mon.a (mon.0) 1844 : cluster [DBG] osdmap e481: 8 total, 8 up, 7 in 2024-02-19T21:53:11.501 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:10.540290+0000 mon.b (mon.1) 73 : audit [DBG] from='client.? 172.21.15.80:0/2250593504' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-02-19T21:53:11.573 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:53:11.633 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:11.743 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:53:11.747 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:11.748 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:53:11.769 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:10.474328+0000 mon.a (mon.0) 1842 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:53:11.769 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:10.483968+0000 mon.a (mon.0) 1843 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:53:11.770 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:10.484050+0000 mon.a (mon.0) 1844 : cluster [DBG] osdmap e481: 8 total, 8 up, 7 in 2024-02-19T21:53:11.770 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:10.540290+0000 mon.b (mon.1) 73 : audit [DBG] from='client.? 172.21.15.80:0/2250593504' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-02-19T21:53:11.771 INFO:tasks.cephadm.ceph_manager.ceph:making progress, resetting timeout 2024-02-19T21:53:11.771 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:53:11.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:10.474328+0000 mon.a (mon.0) 1842 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:53:11.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:10.483968+0000 mon.a (mon.0) 1843 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:53:11.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:10.484050+0000 mon.a (mon.0) 1844 : cluster [DBG] osdmap e481: 8 total, 8 up, 7 in 2024-02-19T21:53:11.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:10.540290+0000 mon.b (mon.1) 73 : audit [DBG] from='client.? 172.21.15.80:0/2250593504' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-02-19T21:53:11.849 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:53:11.913 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:11.940 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:53:11.945 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:11.945 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:53:12.046 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:53:12.112 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:12.149 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:53:12.154 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:12.155 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:53:12.255 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:53:12.321 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:12.354 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:53:12.357 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:12.357 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:53:12.458 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:53:12.501 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:12.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:11.058546+0000 osd.2 (osd.2) 7 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:53:12.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:11.058605+0000 osd.2 (osd.2) 8 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:53:12.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:11.138819+0000 mgr.y (mgr.14514) 788 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:53:12.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:11.225827+0000 mgr.y (mgr.14514) 789 : cluster [DBG] pgmap v1023: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 701 MiB data, 7.3 GiB used, 619 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.04k op/s; 2165/34224 objects degraded (6.326%); 66/34224 objects misplaced (0.193%); 1.2 MiB/s, 29 objects/s recovering 2024-02-19T21:53:12.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:11.503024+0000 mon.a (mon.0) 1845 : cluster [DBG] osdmap e482: 8 total, 8 up, 7 in 2024-02-19T21:53:12.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:11.058546+0000 osd.2 (osd.2) 7 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:53:12.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:11.058605+0000 osd.2 (osd.2) 8 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:53:12.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:11.138819+0000 mgr.y (mgr.14514) 788 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:53:12.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:11.225827+0000 mgr.y (mgr.14514) 789 : cluster [DBG] pgmap v1023: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 701 MiB data, 7.3 GiB used, 619 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.04k op/s; 2165/34224 objects degraded (6.326%); 66/34224 objects misplaced (0.193%); 1.2 MiB/s, 29 objects/s recovering 2024-02-19T21:53:12.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:11.503024+0000 mon.a (mon.0) 1845 : cluster [DBG] osdmap e482: 8 total, 8 up, 7 in 2024-02-19T21:53:12.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:11.058546+0000 osd.2 (osd.2) 7 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:53:12.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:11.058605+0000 osd.2 (osd.2) 8 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:53:12.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:11.138819+0000 mgr.y (mgr.14514) 788 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:53:12.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:11.225827+0000 mgr.y (mgr.14514) 789 : cluster [DBG] pgmap v1023: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 701 MiB data, 7.3 GiB used, 619 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.04k op/s; 2165/34224 objects degraded (6.326%); 66/34224 objects misplaced (0.193%); 1.2 MiB/s, 29 objects/s recovering 2024-02-19T21:53:12.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:11.503024+0000 mon.a (mon.0) 1845 : cluster [DBG] osdmap e482: 8 total, 8 up, 7 in 2024-02-19T21:53:12.967 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:53:12.971 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:12.971 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:53:13.054 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:53:13.072 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:53:13.128 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:13.154 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:53:13.159 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:13.159 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:53:13.260 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:53:13.301 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:13.336 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:53:13.341 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:13.341 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:53:13.442 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:53:13.478 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:13.756 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:53:14.233 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:53:14.240 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:14.240 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:53:14.341 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:53:14.382 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:14.510 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:53:14.515 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:14.515 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:53:14.616 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:53:14.655 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:14.789 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:13.226610+0000 mgr.y (mgr.14514) 790 : cluster [DBG] pgmap v1025: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 664 MiB data, 7.2 GiB used, 619 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 935 op/s; 2165/32463 objects degraded (6.669%); 66/32463 objects misplaced (0.203%); 650 KiB/s, 19 objects/s recovering 2024-02-19T21:53:14.789 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:13.226610+0000 mgr.y (mgr.14514) 790 : cluster [DBG] pgmap v1025: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 664 MiB data, 7.2 GiB used, 619 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 935 op/s; 2165/32463 objects degraded (6.669%); 66/32463 objects misplaced (0.203%); 650 KiB/s, 19 objects/s recovering 2024-02-19T21:53:14.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:13.226610+0000 mgr.y (mgr.14514) 790 : cluster [DBG] pgmap v1025: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 664 MiB data, 7.2 GiB used, 619 GiB / 626 GiB avail; 853 B/s rd, 0 B/s wr, 935 op/s; 2165/32463 objects degraded (6.669%); 66/32463 objects misplaced (0.203%); 650 KiB/s, 19 objects/s recovering 2024-02-19T21:53:14.965 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set noscrub 2024-02-19T21:53:15.114 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:53:15.118 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:15.119 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:53:15.159 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:53:15.159 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-02-19T21:53:15.159 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-02-19T21:53:15.159 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-02-19T21:53:15.159 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:53:15.220 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:53:15.280 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:15.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:15.341210+0000 mon.a (mon.0) 1846 : cluster [WRN] Health check update: Degraded data redundancy: 2165/32463 objects degraded (6.669%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2024-02-19T21:53:15.807 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:53:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:53:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:53:15.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:15.341210+0000 mon.a (mon.0) 1846 : cluster [WRN] Health check update: Degraded data redundancy: 2165/32463 objects degraded (6.669%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2024-02-19T21:53:15.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:15.341210+0000 mon.a (mon.0) 1846 : cluster [WRN] Health check update: Degraded data redundancy: 2165/32463 objects degraded (6.669%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2024-02-19T21:53:16.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:15.227336+0000 mgr.y (mgr.14514) 791 : cluster [DBG] pgmap v1026: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 487 MiB data, 6.7 GiB used, 619 GiB / 626 GiB avail; 660 B/s rd, 0 B/s wr, 1.02k op/s; 2165/23940 objects degraded (9.043%); 66/23940 objects misplaced (0.276%); 479 KiB/s, 7 objects/s recovering 2024-02-19T21:53:16.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:15.227336+0000 mgr.y (mgr.14514) 791 : cluster [DBG] pgmap v1026: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 487 MiB data, 6.7 GiB used, 619 GiB / 626 GiB avail; 660 B/s rd, 0 B/s wr, 1.02k op/s; 2165/23940 objects degraded (9.043%); 66/23940 objects misplaced (0.276%); 479 KiB/s, 7 objects/s recovering 2024-02-19T21:53:17.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:15.227336+0000 mgr.y (mgr.14514) 791 : cluster [DBG] pgmap v1026: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 487 MiB data, 6.7 GiB used, 619 GiB / 626 GiB avail; 660 B/s rd, 0 B/s wr, 1.02k op/s; 2165/23940 objects degraded (9.043%); 66/23940 objects misplaced (0.276%); 479 KiB/s, 7 objects/s recovering 2024-02-19T21:53:18.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:17.227895+0000 mgr.y (mgr.14514) 792 : cluster [DBG] pgmap v1027: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 386 MiB data, 6.3 GiB used, 619 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s; 2173/19095 objects degraded (11.380%); 560 KiB/s, 14 objects/s recovering 2024-02-19T21:53:18.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:17.227895+0000 mgr.y (mgr.14514) 792 : cluster [DBG] pgmap v1027: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 386 MiB data, 6.3 GiB used, 619 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s; 2173/19095 objects degraded (11.380%); 560 KiB/s, 14 objects/s recovering 2024-02-19T21:53:19.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:17.227895+0000 mgr.y (mgr.14514) 792 : cluster [DBG] pgmap v1027: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 386 MiB data, 6.3 GiB used, 619 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s; 2173/19095 objects degraded (11.380%); 560 KiB/s, 14 objects/s recovering 2024-02-19T21:53:19.251 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:53:19.260 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:19.261 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:53:19.362 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:53:19.407 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:19.471 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:53:19.476 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:19.477 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:53:19.578 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:53:19.746 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:19.842 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:53:19.848 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:19.848 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:53:19.949 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:53:20.004 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:20.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:18.968540+0000 mon.a (mon.0) 1847 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:53:20.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:18.968540+0000 mon.a (mon.0) 1847 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:53:20.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:18.968540+0000 mon.a (mon.0) 1847 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:53:20.259 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:53:20.262 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:53:20.799 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:53:20.799 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:53:20.799 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:53:20.799 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:53:20.799 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:53:20.799 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:53:20.799 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:53:20.799 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:53:20.800 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:53:20.800 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:53:20.800 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:53:20.800 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:53:20.800 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:53:20.800 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:53:20.800 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:53:20.800 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:53:20.856 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Removed 74747 objects 2024-02-19T21:53:20.856 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Clean up completed and total clean up time :168.564 2024-02-19T21:53:21.095 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:53:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:53:20] "GET /metrics HTTP/1.1" 200 176608 "" "Prometheus/2.33.4" 2024-02-19T21:53:21.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:19.228332+0000 mgr.y (mgr.14514) 793 : cluster [DBG] pgmap v1028: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 346 MiB data, 6.2 GiB used, 620 GiB / 626 GiB avail; 585 B/s rd, 0 B/s wr, 649 op/s; 2173/17199 objects degraded (12.634%); 88 KiB/s, 6 objects/s recovering 2024-02-19T21:53:21.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:20.154363+0000 mon.b (mon.1) 74 : audit [DBG] from='client.? 172.21.15.80:0/834597887' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:53:21.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:20.342739+0000 mon.a (mon.0) 1848 : cluster [WRN] Health check update: Degraded data redundancy: 2173/17199 objects degraded (12.634%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2024-02-19T21:53:21.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:19.228332+0000 mgr.y (mgr.14514) 793 : cluster [DBG] pgmap v1028: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 346 MiB data, 6.2 GiB used, 620 GiB / 626 GiB avail; 585 B/s rd, 0 B/s wr, 649 op/s; 2173/17199 objects degraded (12.634%); 88 KiB/s, 6 objects/s recovering 2024-02-19T21:53:21.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:20.154363+0000 mon.b (mon.1) 74 : audit [DBG] from='client.? 172.21.15.80:0/834597887' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:53:21.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:20.342739+0000 mon.a (mon.0) 1848 : cluster [WRN] Health check update: Degraded data redundancy: 2173/17199 objects degraded (12.634%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2024-02-19T21:53:21.191 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:53:21.194 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:21.195 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:53:21.295 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:53:21.305 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:53:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:53:21.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:19.228332+0000 mgr.y (mgr.14514) 793 : cluster [DBG] pgmap v1028: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 346 MiB data, 6.2 GiB used, 620 GiB / 626 GiB avail; 585 B/s rd, 0 B/s wr, 649 op/s; 2173/17199 objects degraded (12.634%); 88 KiB/s, 6 objects/s recovering 2024-02-19T21:53:21.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:20.154363+0000 mon.b (mon.1) 74 : audit [DBG] from='client.? 172.21.15.80:0/834597887' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:53:21.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:20.342739+0000 mon.a (mon.0) 1848 : cluster [WRN] Health check update: Degraded data redundancy: 2173/17199 objects degraded (12.634%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2024-02-19T21:53:21.320 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:21.359 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:53:21.369 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:21.369 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:53:21.397 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.2 dump_historic_ops 2024-02-19T21:53:21.410 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:53:21.470 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:53:21.497 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:22.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:20.092954+0000 mgr.y (mgr.14514) 794 : audit [DBG] from='client.25624 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:53:22.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:20.092954+0000 mgr.y (mgr.14514) 794 : audit [DBG] from='client.25624 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:53:22.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:20.092954+0000 mgr.y (mgr.14514) 794 : audit [DBG] from='client.25624 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:53:22.357 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":1028,"stamp":"2024-02-19T21:53:19.228040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":363075260,"num_objects":5733,"num_object_clones":0,"num_object_copies":17199,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2173,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5733,"num_whiteouts":0,"num_read":2785,"num_read_kb":2537,"num_write":144953,"num_write_kb":4783849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15711,"num_bytes_recovered":981867400,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82186,"ondisk_log_size":82186,"up":414,"acting":413,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":417,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":656216064,"kb_used":6518272,"kb_used_data":1734920,"kb_used_omap":0,"kb_used_meta":4782655,"kb_avail":649697792,"statfs":{"total":671965249536,"available":665290539008,"internally_reserved":0,"allocated":1776558080,"data_stored":1766488001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":4897438772},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,3,4,9,6],"upper_bound":32},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-371916800,"num_objects":-5675,"num_object_clones":0,"num_object_copies":-17025,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":8,"num_objects_misplaced":-66,"num_objects_unfound":0,"num_objects_dirty":-5675,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5675,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":786432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.747195"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":78,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.500398+0000","last_change":"2024-02-19T21:49:54.492937+0000","last_active":"2024-02-19T21:53:10.500398+0000","last_peered":"2024-02-19T21:53:10.500398+0000","last_clean":"2024-02-19T21:53:10.500398+0000","last_became_active":"2024-02-19T21:49:54.492544+0000","last_became_peered":"2024-02-19T21:49:54.492544+0000","last_unstale":"2024-02-19T21:53:10.500398+0000","last_undegraded":"2024-02-19T21:53:10.500398+0000","last_fullsized":"2024-02-19T21:53:10.500398+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.643236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.643236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":457,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.486932+0000","last_change":"2024-02-19T21:45:17.201007+0000","last_active":"2024-02-19T21:53:10.486932+0000","last_peered":"2024-02-19T21:53:10.486932+0000","last_clean":"2024-02-19T21:53:10.486932+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:53:10.486932+0000","last_undegraded":"2024-02-19T21:53:10.486932+0000","last_fullsized":"2024-02-19T21:53:10.486932+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:17.200897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:17.200897+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"471'39","reported_seq":144,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.501976+0000","last_change":"2024-02-19T21:49:08.327817+0000","last_active":"2024-02-19T21:53:10.501976+0000","last_peered":"2024-02-19T21:53:10.501976+0000","last_clean":"2024-02-19T21:53:10.501976+0000","last_became_active":"2024-02-19T21:49:08.327416+0000","last_became_peered":"2024-02-19T21:49:08.327416+0000","last_unstale":"2024-02-19T21:53:10.501976+0000","last_undegraded":"2024-02-19T21:53:10.501976+0000","last_fullsized":"2024-02-19T21:53:10.501976+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'27","last_scrub_stamp":"2024-02-19T21:44:48.022013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:48.022013+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":430,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.486632+0000","last_change":"2024-02-19T21:48:30.516215+0000","last_active":"2024-02-19T21:53:10.486632+0000","last_peered":"2024-02-19T21:53:10.486632+0000","last_clean":"2024-02-19T21:53:10.486632+0000","last_became_active":"2024-02-19T21:47:46.250178+0000","last_became_peered":"2024-02-19T21:47:46.250178+0000","last_unstale":"2024-02-19T21:53:10.486632+0000","last_undegraded":"2024-02-19T21:53:10.486632+0000","last_fullsized":"2024-02-19T21:53:10.486632+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.516139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.516139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":153,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.485877+0000","last_change":"2024-02-19T21:49:08.330105+0000","last_active":"2024-02-19T21:53:10.485877+0000","last_peered":"2024-02-19T21:53:10.485877+0000","last_clean":"2024-02-19T21:53:10.485877+0000","last_became_active":"2024-02-19T21:49:08.328994+0000","last_became_peered":"2024-02-19T21:49:08.328994+0000","last_unstale":"2024-02-19T21:53:10.485877+0000","last_undegraded":"2024-02-19T21:53:10.485877+0000","last_fullsized":"2024-02-19T21:53:10.485877+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.636083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.636083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"470'25","reported_seq":535,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.486423+0000","last_change":"2024-02-19T21:48:26.530234+0000","last_active":"2024-02-19T21:53:10.486423+0000","last_peered":"2024-02-19T21:53:10.486423+0000","last_clean":"2024-02-19T21:53:10.486423+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:53:10.486423+0000","last_undegraded":"2024-02-19T21:53:10.486423+0000","last_fullsized":"2024-02-19T21:53:10.486423+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:48:26.530160+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.530160+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":214,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.490620+0000","last_change":"2024-02-19T21:49:08.332091+0000","last_active":"2024-02-19T21:53:10.490620+0000","last_peered":"2024-02-19T21:53:10.490620+0000","last_clean":"2024-02-19T21:53:10.490620+0000","last_became_active":"2024-02-19T21:49:08.331753+0000","last_became_peered":"2024-02-19T21:49:08.331753+0000","last_unstale":"2024-02-19T21:53:10.490620+0000","last_undegraded":"2024-02-19T21:53:10.490620+0000","last_fullsized":"2024-02-19T21:53:10.490620+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.005236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.005236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":470,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.501165+0000","last_change":"2024-02-19T21:48:28.327028+0000","last_active":"2024-02-19T21:53:10.501165+0000","last_peered":"2024-02-19T21:53:10.501165+0000","last_clean":"2024-02-19T21:53:10.501165+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:53:10.501165+0000","last_undegraded":"2024-02-19T21:53:10.501165+0000","last_fullsized":"2024-02-19T21:53:10.501165+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.326938+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"470'11","reported_seq":485,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:15.092889+0000","last_change":"2024-02-19T21:53:15.095893+0000","last_active":"2024-02-19T21:53:15.092889+0000","last_peered":"2024-02-19T21:53:15.092889+0000","last_clean":"2024-02-19T21:53:15.092889+0000","last_became_active":"2024-02-19T21:49:08.329314+0000","last_became_peered":"2024-02-19T21:49:08.329314+0000","last_unstale":"2024-02-19T21:53:15.092889+0000","last_undegraded":"2024-02-19T21:53:15.092889+0000","last_fullsized":"2024-02-19T21:53:15.092889+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"310'9","last_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_deep_scrub":"310'9","last_deep_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.506188+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":391,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.485514+0000","last_change":"2024-02-19T21:46:31.205220+0000","last_active":"2024-02-19T21:53:10.485514+0000","last_peered":"2024-02-19T21:53:10.485514+0000","last_clean":"2024-02-19T21:53:10.485514+0000","last_became_active":"2024-02-19T21:46:31.204816+0000","last_became_peered":"2024-02-19T21:46:31.204816+0000","last_unstale":"2024-02-19T21:53:10.485514+0000","last_undegraded":"2024-02-19T21:53:10.485514+0000","last_fullsized":"2024-02-19T21:53:10.485514+0000","mapping_epoch":330,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":331,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:36.890201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.890201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":492,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.502818+0000","last_change":"2024-02-19T21:49:08.330669+0000","last_active":"2024-02-19T21:53:10.502818+0000","last_peered":"2024-02-19T21:53:10.502818+0000","last_clean":"2024-02-19T21:53:10.502818+0000","last_became_active":"2024-02-19T21:49:08.329998+0000","last_became_peered":"2024-02-19T21:49:08.329998+0000","last_unstale":"2024-02-19T21:53:10.502818+0000","last_undegraded":"2024-02-19T21:53:10.502818+0000","last_fullsized":"2024-02-19T21:53:10.502818+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:58.329316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:58.329316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"470'25","reported_seq":345,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.486687+0000","last_change":"2024-02-19T21:49:08.326162+0000","last_active":"2024-02-19T21:53:10.486687+0000","last_peered":"2024-02-19T21:53:10.486687+0000","last_clean":"2024-02-19T21:53:10.486687+0000","last_became_active":"2024-02-19T21:49:08.325802+0000","last_became_peered":"2024-02-19T21:49:08.325802+0000","last_unstale":"2024-02-19T21:53:10.486687+0000","last_undegraded":"2024-02-19T21:53:10.486687+0000","last_fullsized":"2024-02-19T21:53:10.486687+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:46:54.873416+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:46:54.873416+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2],"acting":[4,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":402,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.491689+0000","last_change":"2024-02-19T21:49:04.432817+0000","last_active":"2024-02-19T21:53:10.491689+0000","last_peered":"2024-02-19T21:53:10.491689+0000","last_clean":"2024-02-19T21:53:10.491689+0000","last_became_active":"2024-02-19T21:47:33.393708+0000","last_became_peered":"2024-02-19T21:47:33.393708+0000","last_unstale":"2024-02-19T21:53:10.491689+0000","last_undegraded":"2024-02-19T21:53:10.491689+0000","last_fullsized":"2024-02-19T21:53:10.491689+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:04.432733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:04.432733+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":78,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.500439+0000","last_change":"2024-02-19T21:49:54.492767+0000","last_active":"2024-02-19T21:53:10.500439+0000","last_peered":"2024-02-19T21:53:10.500439+0000","last_clean":"2024-02-19T21:53:10.500439+0000","last_became_active":"2024-02-19T21:49:54.491745+0000","last_became_peered":"2024-02-19T21:49:54.491745+0000","last_unstale":"2024-02-19T21:53:10.500439+0000","last_undegraded":"2024-02-19T21:53:10.500439+0000","last_fullsized":"2024-02-19T21:53:10.500439+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.232539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.232539+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1d","version":"471'24","reported_seq":429,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.505617+0000","last_change":"2024-02-19T21:48:25.734661+0000","last_active":"2024-02-19T21:53:10.505617+0000","last_peered":"2024-02-19T21:53:10.505617+0000","last_clean":"2024-02-19T21:53:10.505617+0000","last_became_active":"2024-02-19T21:38:31.247067+0000","last_became_peered":"2024-02-19T21:38:31.247067+0000","last_unstale":"2024-02-19T21:53:10.505617+0000","last_undegraded":"2024-02-19T21:53:10.505617+0000","last_fullsized":"2024-02-19T21:53:10.505617+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'18","last_scrub_stamp":"2024-02-19T21:48:25.734591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.734591+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":33,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":457,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.489440+0000","last_change":"2024-02-19T21:48:40.528082+0000","last_active":"2024-02-19T21:53:10.489440+0000","last_peered":"2024-02-19T21:53:10.489440+0000","last_clean":"2024-02-19T21:53:10.489440+0000","last_became_active":"2024-02-19T21:44:58.788307+0000","last_became_peered":"2024-02-19T21:44:58.788307+0000","last_unstale":"2024-02-19T21:53:10.489440+0000","last_undegraded":"2024-02-19T21:53:10.489440+0000","last_fullsized":"2024-02-19T21:53:10.489440+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:40.527970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:48:40.527970+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":465,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.493420+0000","last_change":"2024-02-19T21:48:11.557832+0000","last_active":"2024-02-19T21:53:10.493420+0000","last_peered":"2024-02-19T21:53:10.493420+0000","last_clean":"2024-02-19T21:53:10.493420+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:53:10.493420+0000","last_undegraded":"2024-02-19T21:53:10.493420+0000","last_fullsized":"2024-02-19T21:53:10.493420+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.557736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:17.913620+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.557736+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"470'46","reported_seq":145,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.502796+0000","last_change":"2024-02-19T21:49:08.332575+0000","last_active":"2024-02-19T21:53:10.502796+0000","last_peered":"2024-02-19T21:53:10.502796+0000","last_clean":"2024-02-19T21:53:10.502796+0000","last_became_active":"2024-02-19T21:49:08.331742+0000","last_became_peered":"2024-02-19T21:49:08.331742+0000","last_unstale":"2024-02-19T21:53:10.502796+0000","last_undegraded":"2024-02-19T21:53:10.502796+0000","last_fullsized":"2024-02-19T21:53:10.502796+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'34","last_scrub_stamp":"2024-02-19T21:45:49.728734+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:45:49.728734+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":477,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.500757+0000","last_change":"2024-02-19T21:46:44.994389+0000","last_active":"2024-02-19T21:53:10.500757+0000","last_peered":"2024-02-19T21:53:10.500757+0000","last_clean":"2024-02-19T21:53:10.500757+0000","last_became_active":"2024-02-19T21:44:58.790669+0000","last_became_peered":"2024-02-19T21:44:58.790669+0000","last_unstale":"2024-02-19T21:53:10.500757+0000","last_undegraded":"2024-02-19T21:53:10.500757+0000","last_fullsized":"2024-02-19T21:53:10.500757+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.994296+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":413,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.492893+0000","last_change":"2024-02-19T21:49:08.330330+0000","last_active":"2024-02-19T21:53:10.492893+0000","last_peered":"2024-02-19T21:53:10.492893+0000","last_clean":"2024-02-19T21:53:10.492893+0000","last_became_active":"2024-02-19T21:49:08.329986+0000","last_became_peered":"2024-02-19T21:49:08.329986+0000","last_unstale":"2024-02-19T21:53:10.492893+0000","last_undegraded":"2024-02-19T21:53:10.492893+0000","last_fullsized":"2024-02-19T21:53:10.492893+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.091409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.091409+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"471'27","reported_seq":373,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.486868+0000","last_change":"2024-02-19T21:48:26.366639+0000","last_active":"2024-02-19T21:53:10.486868+0000","last_peered":"2024-02-19T21:53:10.486868+0000","last_clean":"2024-02-19T21:53:10.486868+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:53:10.486868+0000","last_undegraded":"2024-02-19T21:53:10.486868+0000","last_fullsized":"2024-02-19T21:53:10.486868+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:26.366563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.366563+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":36,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":338,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.502496+0000","last_change":"2024-02-19T21:51:22.461995+0000","last_active":"2024-02-19T21:53:10.502496+0000","last_peered":"2024-02-19T21:53:10.502496+0000","last_clean":"2024-02-19T21:53:10.502496+0000","last_became_active":"2024-02-19T21:51:22.461599+0000","last_became_peered":"2024-02-19T21:51:22.461599+0000","last_unstale":"2024-02-19T21:53:10.502496+0000","last_undegraded":"2024-02-19T21:53:10.502496+0000","last_fullsized":"2024-02-19T21:53:10.502496+0000","mapping_epoch":445,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":446,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:13.196112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:13.196112+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":477,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.490634+0000","last_change":"2024-02-19T21:49:54.491840+0000","last_active":"2024-02-19T21:53:10.490634+0000","last_peered":"2024-02-19T21:53:10.490634+0000","last_clean":"2024-02-19T21:53:10.490634+0000","last_became_active":"2024-02-19T21:49:54.491488+0000","last_became_peered":"2024-02-19T21:49:54.491488+0000","last_unstale":"2024-02-19T21:53:10.490634+0000","last_undegraded":"2024-02-19T21:53:10.490634+0000","last_fullsized":"2024-02-19T21:53:10.490634+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.803606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.803606+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"470'30","reported_seq":577,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.486021+0000","last_change":"2024-02-19T21:49:54.502402+0000","last_active":"2024-02-19T21:53:10.486021+0000","last_peered":"2024-02-19T21:53:10.486021+0000","last_clean":"2024-02-19T21:53:10.486021+0000","last_became_active":"2024-02-19T21:49:54.483748+0000","last_became_peered":"2024-02-19T21:49:54.483748+0000","last_unstale":"2024-02-19T21:53:10.486021+0000","last_undegraded":"2024-02-19T21:53:10.486021+0000","last_fullsized":"2024-02-19T21:53:10.486021+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:48:25.348437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.348437+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":397,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.485459+0000","last_change":"2024-02-19T21:49:08.328206+0000","last_active":"2024-02-19T21:53:10.485459+0000","last_peered":"2024-02-19T21:53:10.485459+0000","last_clean":"2024-02-19T21:53:10.485459+0000","last_became_active":"2024-02-19T21:49:08.327865+0000","last_became_peered":"2024-02-19T21:49:08.327865+0000","last_unstale":"2024-02-19T21:53:10.485459+0000","last_undegraded":"2024-02-19T21:53:10.485459+0000","last_fullsized":"2024-02-19T21:53:10.485459+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.230652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.230652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":457,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.502672+0000","last_change":"2024-02-19T21:48:22.171667+0000","last_active":"2024-02-19T21:53:10.502672+0000","last_peered":"2024-02-19T21:53:10.502672+0000","last_clean":"2024-02-19T21:53:10.502672+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:53:10.502672+0000","last_undegraded":"2024-02-19T21:53:10.502672+0000","last_fullsized":"2024-02-19T21:53:10.502672+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.171600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.171600+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":493,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.491764+0000","last_change":"2024-02-19T21:49:08.330636+0000","last_active":"2024-02-19T21:53:10.491764+0000","last_peered":"2024-02-19T21:53:10.491764+0000","last_clean":"2024-02-19T21:53:10.491764+0000","last_became_active":"2024-02-19T21:49:08.330293+0000","last_became_peered":"2024-02-19T21:49:08.330293+0000","last_unstale":"2024-02-19T21:53:10.491764+0000","last_undegraded":"2024-02-19T21:53:10.491764+0000","last_fullsized":"2024-02-19T21:53:10.491764+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:03.034839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:03.034839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"471'32","reported_seq":102,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.499856+0000","last_change":"2024-02-19T21:49:55.368481+0000","last_active":"2024-02-19T21:53:10.499856+0000","last_peered":"2024-02-19T21:53:10.499856+0000","last_clean":"2024-02-19T21:53:10.499856+0000","last_became_active":"2024-02-19T21:49:54.485438+0000","last_became_peered":"2024-02-19T21:49:54.485438+0000","last_unstale":"2024-02-19T21:53:10.499856+0000","last_undegraded":"2024-02-19T21:53:10.499856+0000","last_fullsized":"2024-02-19T21:53:10.499856+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"381'24","last_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_deep_scrub":"381'24","last_deep_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_clean_scrub_stamp":"2024-02-19T21:48:39.382725+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":36,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,5],"acting":[7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":485,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.500208+0000","last_change":"2024-02-19T21:49:17.193002+0000","last_active":"2024-02-19T21:53:10.500208+0000","last_peered":"2024-02-19T21:53:10.500208+0000","last_clean":"2024-02-19T21:53:10.500208+0000","last_became_active":"2024-02-19T21:49:08.333537+0000","last_became_peered":"2024-02-19T21:49:08.333537+0000","last_unstale":"2024-02-19T21:53:10.500208+0000","last_undegraded":"2024-02-19T21:53:10.500208+0000","last_fullsized":"2024-02-19T21:53:10.500208+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:59.339649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:45:59.339649+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":513,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.492970+0000","last_change":"2024-02-19T21:49:54.494561+0000","last_active":"2024-02-19T21:53:10.492970+0000","last_peered":"2024-02-19T21:53:10.492970+0000","last_clean":"2024-02-19T21:53:10.492970+0000","last_became_active":"2024-02-19T21:49:54.494146+0000","last_became_peered":"2024-02-19T21:49:54.494146+0000","last_unstale":"2024-02-19T21:53:10.492970+0000","last_undegraded":"2024-02-19T21:53:10.492970+0000","last_fullsized":"2024-02-19T21:53:10.492970+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.560066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":487,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.503571+0000","last_change":"2024-02-19T21:49:09.765641+0000","last_active":"2024-02-19T21:53:10.503571+0000","last_peered":"2024-02-19T21:53:10.503571+0000","last_clean":"2024-02-19T21:53:10.503571+0000","last_became_active":"2024-02-19T21:49:08.331308+0000","last_became_peered":"2024-02-19T21:49:08.331308+0000","last_unstale":"2024-02-19T21:53:10.503571+0000","last_undegraded":"2024-02-19T21:53:10.503571+0000","last_fullsized":"2024-02-19T21:53:10.503571+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.765568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.765568+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"470'12","reported_seq":180,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.500366+0000","last_change":"2024-02-19T21:47:33.577363+0000","last_active":"2024-02-19T21:53:10.500366+0000","last_peered":"2024-02-19T21:53:10.500366+0000","last_clean":"2024-02-19T21:53:10.500366+0000","last_became_active":"2024-02-19T21:47:33.395217+0000","last_became_peered":"2024-02-19T21:47:33.395217+0000","last_unstale":"2024-02-19T21:53:10.500366+0000","last_undegraded":"2024-02-19T21:53:10.500366+0000","last_fullsized":"2024-02-19T21:53:10.500366+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'8","last_scrub_stamp":"2024-02-19T21:46:47.761677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.761677+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":397,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.486549+0000","last_change":"2024-02-19T21:49:08.918163+0000","last_active":"2024-02-19T21:53:10.486549+0000","last_peered":"2024-02-19T21:53:10.486549+0000","last_clean":"2024-02-19T21:53:10.486549+0000","last_became_active":"2024-02-19T21:49:08.328416+0000","last_became_peered":"2024-02-19T21:49:08.328416+0000","last_unstale":"2024-02-19T21:53:10.486549+0000","last_undegraded":"2024-02-19T21:53:10.486549+0000","last_fullsized":"2024-02-19T21:53:10.486549+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.918083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.918083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":475,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.500957+0000","last_change":"2024-02-19T21:49:54.480716+0000","last_active":"2024-02-19T21:53:10.500957+0000","last_peered":"2024-02-19T21:53:10.500957+0000","last_clean":"2024-02-19T21:53:10.500957+0000","last_became_active":"2024-02-19T21:49:54.480368+0000","last_became_peered":"2024-02-19T21:49:54.480368+0000","last_unstale":"2024-02-19T21:53:10.500957+0000","last_undegraded":"2024-02-19T21:53:10.500957+0000","last_fullsized":"2024-02-19T21:53:10.500957+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:19.596775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:19.596775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":459,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.501115+0000","last_change":"2024-02-19T21:49:05.012463+0000","last_active":"2024-02-19T21:53:10.501115+0000","last_peered":"2024-02-19T21:53:10.501115+0000","last_clean":"2024-02-19T21:53:10.501115+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:53:10.501115+0000","last_undegraded":"2024-02-19T21:53:10.501115+0000","last_fullsized":"2024-02-19T21:53:10.501115+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.012395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.012395+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"470'27","reported_seq":518,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.488571+0000","last_change":"2024-02-19T21:48:38.529106+0000","last_active":"2024-02-19T21:53:10.488571+0000","last_peered":"2024-02-19T21:53:10.488571+0000","last_clean":"2024-02-19T21:53:10.488571+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:53:10.488571+0000","last_undegraded":"2024-02-19T21:53:10.488571+0000","last_fullsized":"2024-02-19T21:53:10.488571+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:38.528977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.528977+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":462,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.485086+0000","last_change":"2024-02-19T21:46:06.096531+0000","last_active":"2024-02-19T21:53:10.485086+0000","last_peered":"2024-02-19T21:53:10.485086+0000","last_clean":"2024-02-19T21:53:10.485086+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:53:10.485086+0000","last_undegraded":"2024-02-19T21:53:10.485086+0000","last_fullsized":"2024-02-19T21:53:10.485086+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.096422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":273,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.493536+0000","last_change":"2024-02-19T21:48:38.391532+0000","last_active":"2024-02-19T21:53:10.493536+0000","last_peered":"2024-02-19T21:53:10.493536+0000","last_clean":"2024-02-19T21:53:10.493536+0000","last_became_active":"2024-02-19T21:47:33.395085+0000","last_became_peered":"2024-02-19T21:47:33.395085+0000","last_unstale":"2024-02-19T21:53:10.493536+0000","last_undegraded":"2024-02-19T21:53:10.493536+0000","last_fullsized":"2024-02-19T21:53:10.493536+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:38.391435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.391435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":474,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.491401+0000","last_change":"2024-02-19T21:48:14.600378+0000","last_active":"2024-02-19T21:53:10.491401+0000","last_peered":"2024-02-19T21:53:10.491401+0000","last_clean":"2024-02-19T21:53:10.491401+0000","last_became_active":"2024-02-19T21:47:33.393932+0000","last_became_peered":"2024-02-19T21:47:33.393932+0000","last_unstale":"2024-02-19T21:53:10.491401+0000","last_undegraded":"2024-02-19T21:53:10.491401+0000","last_fullsized":"2024-02-19T21:53:10.491401+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:14.600285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.600285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"470'21","reported_seq":537,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.500754+0000","last_change":"2024-02-19T21:49:08.334199+0000","last_active":"2024-02-19T21:53:10.500754+0000","last_peered":"2024-02-19T21:53:10.500754+0000","last_clean":"2024-02-19T21:53:10.500754+0000","last_became_active":"2024-02-19T21:49:08.333872+0000","last_became_peered":"2024-02-19T21:49:08.333872+0000","last_unstale":"2024-02-19T21:53:10.500754+0000","last_undegraded":"2024-02-19T21:53:10.500754+0000","last_fullsized":"2024-02-19T21:53:10.500754+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:45:08.678669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:08.678669+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":440,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.489643+0000","last_change":"2024-02-19T21:49:08.330114+0000","last_active":"2024-02-19T21:53:10.489643+0000","last_peered":"2024-02-19T21:53:10.489643+0000","last_clean":"2024-02-19T21:53:10.489643+0000","last_became_active":"2024-02-19T21:49:08.329770+0000","last_became_peered":"2024-02-19T21:49:08.329770+0000","last_unstale":"2024-02-19T21:53:10.489643+0000","last_undegraded":"2024-02-19T21:53:10.489643+0000","last_fullsized":"2024-02-19T21:53:10.489643+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:08.983923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.983923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"415'17","reported_seq":122,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.517916+0000","last_change":"2024-02-19T21:50:49.705247+0000","last_active":"2024-02-19T21:53:11.517916+0000","last_peered":"2024-02-19T21:53:11.517916+0000","last_clean":"2024-02-19T21:53:11.517916+0000","last_became_active":"2024-02-19T21:49:54.486304+0000","last_became_peered":"2024-02-19T21:49:54.486304+0000","last_unstale":"2024-02-19T21:53:11.517916+0000","last_undegraded":"2024-02-19T21:53:11.517916+0000","last_fullsized":"2024-02-19T21:53:11.517916+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"199'13","last_scrub_stamp":"2024-02-19T21:45:05.721709+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:45:05.721709+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":484,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.485707+0000","last_change":"2024-02-19T21:49:54.484516+0000","last_active":"2024-02-19T21:53:10.485707+0000","last_peered":"2024-02-19T21:53:10.485707+0000","last_clean":"2024-02-19T21:53:10.485707+0000","last_became_active":"2024-02-19T21:49:54.483689+0000","last_became_peered":"2024-02-19T21:49:54.483689+0000","last_unstale":"2024-02-19T21:53:10.485707+0000","last_undegraded":"2024-02-19T21:53:10.485707+0000","last_fullsized":"2024-02-19T21:53:10.485707+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.157478+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"470'25","reported_seq":514,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.495456+0000","last_change":"2024-02-19T21:48:27.720048+0000","last_active":"2024-02-19T21:53:10.495456+0000","last_peered":"2024-02-19T21:53:10.495456+0000","last_clean":"2024-02-19T21:53:10.495456+0000","last_became_active":"2024-02-19T21:47:33.398295+0000","last_became_peered":"2024-02-19T21:47:33.398295+0000","last_unstale":"2024-02-19T21:53:10.495456+0000","last_undegraded":"2024-02-19T21:53:10.495456+0000","last_fullsized":"2024-02-19T21:53:10.495456+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:27.719954+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:48:27.719954+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":201,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.485599+0000","last_change":"2024-02-19T21:49:54.484392+0000","last_active":"2024-02-19T21:53:10.485599+0000","last_peered":"2024-02-19T21:53:10.485599+0000","last_clean":"2024-02-19T21:53:10.485599+0000","last_became_active":"2024-02-19T21:49:54.484049+0000","last_became_peered":"2024-02-19T21:49:54.484049+0000","last_unstale":"2024-02-19T21:53:10.485599+0000","last_undegraded":"2024-02-19T21:53:10.485599+0000","last_fullsized":"2024-02-19T21:53:10.485599+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.121769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.121769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":714,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.519572+0000","last_change":"2024-02-19T21:48:38.723220+0000","last_active":"2024-02-19T21:53:11.519572+0000","last_peered":"2024-02-19T21:53:11.519572+0000","last_clean":"2024-02-19T21:53:11.519572+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:53:11.519572+0000","last_undegraded":"2024-02-19T21:53:11.519572+0000","last_fullsized":"2024-02-19T21:53:11.519572+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:48:38.723151+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.723151+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":488,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.494610+0000","last_change":"2024-02-19T21:49:54.485462+0000","last_active":"2024-02-19T21:53:10.494610+0000","last_peered":"2024-02-19T21:53:10.494610+0000","last_clean":"2024-02-19T21:53:10.494610+0000","last_became_active":"2024-02-19T21:49:54.485121+0000","last_became_peered":"2024-02-19T21:49:54.485121+0000","last_unstale":"2024-02-19T21:53:10.494610+0000","last_undegraded":"2024-02-19T21:53:10.494610+0000","last_fullsized":"2024-02-19T21:53:10.494610+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:07.724097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:49:07.724097+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"470'35","reported_seq":381,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.507111+0000","last_change":"2024-02-19T21:49:08.335077+0000","last_active":"2024-02-19T21:53:10.507111+0000","last_peered":"2024-02-19T21:53:10.507111+0000","last_clean":"2024-02-19T21:53:10.507111+0000","last_became_active":"2024-02-19T21:49:08.334061+0000","last_became_peered":"2024-02-19T21:49:08.334061+0000","last_unstale":"2024-02-19T21:53:10.507111+0000","last_undegraded":"2024-02-19T21:53:10.507111+0000","last_fullsized":"2024-02-19T21:53:10.507111+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'25","last_scrub_stamp":"2024-02-19T21:46:07.553690+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.553690+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":457,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.501124+0000","last_change":"2024-02-19T21:48:21.256471+0000","last_active":"2024-02-19T21:53:10.501124+0000","last_peered":"2024-02-19T21:53:10.501124+0000","last_clean":"2024-02-19T21:53:10.501124+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:53:10.501124+0000","last_undegraded":"2024-02-19T21:53:10.501124+0000","last_fullsized":"2024-02-19T21:53:10.501124+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.256358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.256358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":464,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.493045+0000","last_change":"2024-02-19T21:46:35.035136+0000","last_active":"2024-02-19T21:53:10.493045+0000","last_peered":"2024-02-19T21:53:10.493045+0000","last_clean":"2024-02-19T21:53:10.493045+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:53:10.493045+0000","last_undegraded":"2024-02-19T21:53:10.493045+0000","last_fullsized":"2024-02-19T21:53:10.493045+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:35.035042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:35.035042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"470'18","reported_seq":95,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.500880+0000","last_change":"2024-02-19T21:50:49.700758+0000","last_active":"2024-02-19T21:53:10.500880+0000","last_peered":"2024-02-19T21:53:10.500880+0000","last_clean":"2024-02-19T21:53:10.500880+0000","last_became_active":"2024-02-19T21:49:54.478094+0000","last_became_peered":"2024-02-19T21:49:54.478094+0000","last_unstale":"2024-02-19T21:53:10.500880+0000","last_undegraded":"2024-02-19T21:53:10.500880+0000","last_fullsized":"2024-02-19T21:53:10.500880+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'12","last_scrub_stamp":"2024-02-19T21:49:08.912638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.912638+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":23,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":110,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.502876+0000","last_change":"2024-02-19T21:49:08.332757+0000","last_active":"2024-02-19T21:53:10.502876+0000","last_peered":"2024-02-19T21:53:10.502876+0000","last_clean":"2024-02-19T21:53:10.502876+0000","last_became_active":"2024-02-19T21:49:08.332176+0000","last_became_peered":"2024-02-19T21:49:08.332176+0000","last_unstale":"2024-02-19T21:53:10.502876+0000","last_undegraded":"2024-02-19T21:53:10.502876+0000","last_fullsized":"2024-02-19T21:53:10.502876+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:47:01.365477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:47:01.365477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":110,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.501900+0000","last_change":"2024-02-19T21:49:08.328632+0000","last_active":"2024-02-19T21:53:10.501900+0000","last_peered":"2024-02-19T21:53:10.501900+0000","last_clean":"2024-02-19T21:53:10.501900+0000","last_became_active":"2024-02-19T21:49:08.327826+0000","last_became_peered":"2024-02-19T21:49:08.327826+0000","last_unstale":"2024-02-19T21:53:10.501900+0000","last_undegraded":"2024-02-19T21:53:10.501900+0000","last_fullsized":"2024-02-19T21:53:10.501900+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:09.645607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:44:09.645607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"470'21","reported_seq":609,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:14.095703+0000","last_change":"2024-02-19T21:53:14.097645+0000","last_active":"2024-02-19T21:53:14.095703+0000","last_peered":"2024-02-19T21:53:14.095703+0000","last_clean":"2024-02-19T21:53:14.095703+0000","last_became_active":"2024-02-19T21:49:54.483578+0000","last_became_peered":"2024-02-19T21:49:54.483578+0000","last_unstale":"2024-02-19T21:53:14.095703+0000","last_undegraded":"2024-02-19T21:53:14.095703+0000","last_fullsized":"2024-02-19T21:53:14.095703+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:44:53.072746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:53.072746+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"482'9082","reported_seq":11418,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:15.166176+0000","last_change":"2024-02-19T21:52:28.102395+0000","last_active":"2024-02-19T21:53:15.166176+0000","last_peered":"2024-02-19T21:53:15.166176+0000","last_clean":"2024-02-19T21:53:15.166176+0000","last_became_active":"2024-02-19T21:52:28.061558+0000","last_became_peered":"2024-02-19T21:52:28.061558+0000","last_unstale":"2024-02-19T21:53:15.166176+0000","last_undegraded":"2024-02-19T21:53:15.166176+0000","last_fullsized":"2024-02-19T21:53:15.166176+0000","mapping_epoch":467,"log_start":"418'4200","ondisk_log_start":"418'4200","created":385,"last_epoch_clean":468,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4882,"ondisk_log_size":4882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25559040,"num_objects":390,"num_object_clones":0,"num_object_copies":1170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":390,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9082,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1108,"num_bytes_recovered":61734912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":78,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.500354+0000","last_change":"2024-02-19T21:49:54.492844+0000","last_active":"2024-02-19T21:53:10.500354+0000","last_peered":"2024-02-19T21:53:10.500354+0000","last_clean":"2024-02-19T21:53:10.500354+0000","last_became_active":"2024-02-19T21:49:54.492156+0000","last_became_peered":"2024-02-19T21:49:54.492156+0000","last_unstale":"2024-02-19T21:53:10.500354+0000","last_undegraded":"2024-02-19T21:53:10.500354+0000","last_fullsized":"2024-02-19T21:53:10.500354+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:04.692807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.692807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"378'4","reported_seq":496,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.489741+0000","last_change":"2024-02-19T21:48:28.510929+0000","last_active":"2024-02-19T21:53:10.489741+0000","last_peered":"2024-02-19T21:53:10.489741+0000","last_clean":"2024-02-19T21:53:10.489741+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:53:10.489741+0000","last_undegraded":"2024-02-19T21:53:10.489741+0000","last_fullsized":"2024-02-19T21:53:10.489741+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"378'4","last_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_deep_scrub":"378'4","last_deep_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.510849+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"470'29","reported_seq":352,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.486631+0000","last_change":"2024-02-19T21:48:22.519465+0000","last_active":"2024-02-19T21:53:10.486631+0000","last_peered":"2024-02-19T21:53:10.486631+0000","last_clean":"2024-02-19T21:53:10.486631+0000","last_became_active":"2024-02-19T21:47:46.252085+0000","last_became_peered":"2024-02-19T21:47:46.252085+0000","last_unstale":"2024-02-19T21:53:10.486631+0000","last_undegraded":"2024-02-19T21:53:10.486631+0000","last_fullsized":"2024-02-19T21:53:10.486631+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'23","last_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_deep_scrub":"200'23","last_deep_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.519381+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":33,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6],"acting":[4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":110,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.501988+0000","last_change":"2024-02-19T21:49:08.328855+0000","last_active":"2024-02-19T21:53:10.501988+0000","last_peered":"2024-02-19T21:53:10.501988+0000","last_clean":"2024-02-19T21:53:10.501988+0000","last_became_active":"2024-02-19T21:49:08.328237+0000","last_became_peered":"2024-02-19T21:49:08.328237+0000","last_unstale":"2024-02-19T21:53:10.501988+0000","last_undegraded":"2024-02-19T21:53:10.501988+0000","last_fullsized":"2024-02-19T21:53:10.501988+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:58.047556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:58.047556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"482'8787","reported_seq":8890,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:14.844366+0000","last_change":"2024-02-19T21:48:47.778295+0000","last_active":"2024-02-19T21:53:14.844366+0000","last_peered":"2024-02-19T21:53:14.844366+0000","last_clean":"2024-02-19T21:53:14.844366+0000","last_became_active":"2024-02-19T21:48:47.777964+0000","last_became_peered":"2024-02-19T21:48:47.777964+0000","last_unstale":"2024-02-19T21:53:14.844366+0000","last_undegraded":"2024-02-19T21:53:14.844366+0000","last_fullsized":"2024-02-19T21:53:14.844366+0000","mapping_epoch":385,"log_start":"413'4000","ondisk_log_start":"413'4000","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4787,"ondisk_log_size":4787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23789568,"num_objects":363,"num_object_clones":0,"num_object_copies":1089,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":363,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8787,"num_write_kb":292800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":511,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.485146+0000","last_change":"2024-02-19T21:49:08.328019+0000","last_active":"2024-02-19T21:53:10.485146+0000","last_peered":"2024-02-19T21:53:10.485146+0000","last_clean":"2024-02-19T21:53:10.485146+0000","last_became_active":"2024-02-19T21:49:08.327581+0000","last_became_peered":"2024-02-19T21:49:08.327581+0000","last_unstale":"2024-02-19T21:53:10.485146+0000","last_undegraded":"2024-02-19T21:53:10.485146+0000","last_fullsized":"2024-02-19T21:53:10.485146+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:22.180593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:45:22.180593+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5],"acting":[0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":457,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.506979+0000","last_change":"2024-02-19T21:48:37.789514+0000","last_active":"2024-02-19T21:53:10.506979+0000","last_peered":"2024-02-19T21:53:10.506979+0000","last_clean":"2024-02-19T21:53:10.506979+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:53:10.506979+0000","last_undegraded":"2024-02-19T21:53:10.506979+0000","last_fullsized":"2024-02-19T21:53:10.506979+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:37.789400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:37.789400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"470'30","reported_seq":378,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.500857+0000","last_change":"2024-02-19T21:45:57.877936+0000","last_active":"2024-02-19T21:53:10.500857+0000","last_peered":"2024-02-19T21:53:10.500857+0000","last_clean":"2024-02-19T21:53:10.500857+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:53:10.500857+0000","last_undegraded":"2024-02-19T21:53:10.500857+0000","last_fullsized":"2024-02-19T21:53:10.500857+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:45:57.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:57.877856+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":718,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.514159+0000","last_change":"2024-02-19T21:49:01.011149+0000","last_active":"2024-02-19T21:53:11.514159+0000","last_peered":"2024-02-19T21:53:11.514159+0000","last_clean":"2024-02-19T21:53:11.514159+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:53:11.514159+0000","last_undegraded":"2024-02-19T21:53:11.514159+0000","last_fullsized":"2024-02-19T21:53:11.514159+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:49:01.011078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:49:01.011078+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.a","version":"482'9056","reported_seq":9161,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:15.149513+0000","last_change":"2024-02-19T21:48:47.778138+0000","last_active":"2024-02-19T21:53:15.149513+0000","last_peered":"2024-02-19T21:53:15.149513+0000","last_clean":"2024-02-19T21:53:15.149513+0000","last_became_active":"2024-02-19T21:48:47.777820+0000","last_became_peered":"2024-02-19T21:48:47.777820+0000","last_unstale":"2024-02-19T21:53:15.149513+0000","last_undegraded":"2024-02-19T21:53:15.149513+0000","last_fullsized":"2024-02-19T21:53:15.149513+0000","mapping_epoch":385,"log_start":"418'4200","ondisk_log_start":"418'4200","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4856,"ondisk_log_size":4856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22151168,"num_objects":338,"num_object_clones":0,"num_object_copies":1014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":338,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9056,"num_write_kb":300608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":406,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.489890+0000","last_change":"2024-02-19T21:48:33.478821+0000","last_active":"2024-02-19T21:53:10.489890+0000","last_peered":"2024-02-19T21:53:10.489890+0000","last_clean":"2024-02-19T21:53:10.489890+0000","last_became_active":"2024-02-19T21:44:56.149476+0000","last_became_peered":"2024-02-19T21:44:56.149476+0000","last_unstale":"2024-02-19T21:53:10.489890+0000","last_undegraded":"2024-02-19T21:53:10.489890+0000","last_fullsized":"2024-02-19T21:53:10.489890+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:33.478715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:48:33.478715+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":467,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.494779+0000","last_change":"2024-02-19T21:46:41.834315+0000","last_active":"2024-02-19T21:53:10.494779+0000","last_peered":"2024-02-19T21:53:10.494779+0000","last_clean":"2024-02-19T21:53:10.494779+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:53:10.494779+0000","last_undegraded":"2024-02-19T21:53:10.494779+0000","last_fullsized":"2024-02-19T21:53:10.494779+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:41.834246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:46:41.834246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"470'58","reported_seq":926,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.519726+0000","last_change":"2024-02-19T21:49:08.335296+0000","last_active":"2024-02-19T21:53:11.519726+0000","last_peered":"2024-02-19T21:53:11.519726+0000","last_clean":"2024-02-19T21:53:11.519726+0000","last_became_active":"2024-02-19T21:49:08.334527+0000","last_became_peered":"2024-02-19T21:49:08.334527+0000","last_unstale":"2024-02-19T21:53:11.519726+0000","last_undegraded":"2024-02-19T21:53:11.519726+0000","last_fullsized":"2024-02-19T21:53:11.519726+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'43","last_scrub_stamp":"2024-02-19T21:45:04.755444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.755444+0000","log_size":58,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":50,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":453,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.486350+0000","last_change":"2024-02-19T21:46:45.252437+0000","last_active":"2024-02-19T21:53:10.486350+0000","last_peered":"2024-02-19T21:53:10.486350+0000","last_clean":"2024-02-19T21:53:10.486350+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:53:10.486350+0000","last_undegraded":"2024-02-19T21:53:10.486350+0000","last_fullsized":"2024-02-19T21:53:10.486350+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.252344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.252344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"482'8937","reported_seq":13930,"reported_epoch":482,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-02-19T21:53:15.371459+0000","last_change":"2024-02-19T21:52:18.427835+0000","last_active":"2024-02-19T21:53:15.371459+0000","last_peered":"2024-02-19T21:53:15.371459+0000","last_clean":"2024-02-19T21:48:46.759921+0000","last_became_active":"2024-02-19T21:49:55.752599+0000","last_became_peered":"2024-02-19T21:49:55.752599+0000","last_unstale":"2024-02-19T21:53:15.371459+0000","last_undegraded":"2024-02-19T21:52:18.425538+0000","last_fullsized":"2024-02-19T21:49:55.470938+0000","mapping_epoch":414,"log_start":"410'3700","ondisk_log_start":"410'3700","created":385,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5237,"ondisk_log_size":5237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2173,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":323,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8937,"num_write_kb":296320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1860,"num_bytes_recovered":118882304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2],"avail_no_missing":["5","2","4"],"object_location_counts":[{"shards":"2,5","objects":-1850}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":481,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.501239+0000","last_change":"2024-02-19T21:49:09.227437+0000","last_active":"2024-02-19T21:53:10.501239+0000","last_peered":"2024-02-19T21:53:10.501239+0000","last_clean":"2024-02-19T21:53:10.501239+0000","last_became_active":"2024-02-19T21:49:08.328437+0000","last_became_peered":"2024-02-19T21:49:08.328437+0000","last_unstale":"2024-02-19T21:53:10.501239+0000","last_undegraded":"2024-02-19T21:53:10.501239+0000","last_fullsized":"2024-02-19T21:53:10.501239+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.227355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.227355+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'6","reported_seq":1819,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:14.853286+0000","last_change":"2024-02-19T21:53:14.853286+0000","last_active":"2024-02-19T21:53:14.853286+0000","last_peered":"2024-02-19T21:53:14.853286+0000","last_clean":"2024-02-19T21:53:14.853286+0000","last_became_active":"2024-02-19T21:49:08.331108+0000","last_became_peered":"2024-02-19T21:49:08.331108+0000","last_unstale":"2024-02-19T21:53:14.853286+0000","last_undegraded":"2024-02-19T21:53:14.853286+0000","last_fullsized":"2024-02-19T21:53:14.853286+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_clean_scrub_stamp":"2024-02-19T21:44:13.678341+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1231,"num_read_kb":1226,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":110,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.502240+0000","last_change":"2024-02-19T21:49:08.329710+0000","last_active":"2024-02-19T21:53:10.502240+0000","last_peered":"2024-02-19T21:53:10.502240+0000","last_clean":"2024-02-19T21:53:10.502240+0000","last_became_active":"2024-02-19T21:49:08.329378+0000","last_became_peered":"2024-02-19T21:49:08.329378+0000","last_unstale":"2024-02-19T21:53:10.502240+0000","last_undegraded":"2024-02-19T21:53:10.502240+0000","last_fullsized":"2024-02-19T21:53:10.502240+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:55.195394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.195394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"470'21","reported_seq":520,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.500990+0000","last_change":"2024-02-19T21:48:14.878933+0000","last_active":"2024-02-19T21:53:10.500990+0000","last_peered":"2024-02-19T21:53:10.500990+0000","last_clean":"2024-02-19T21:53:10.500990+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:53:10.500990+0000","last_undegraded":"2024-02-19T21:53:10.500990+0000","last_fullsized":"2024-02-19T21:53:10.500990+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'17","last_scrub_stamp":"2024-02-19T21:48:14.878857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.878857+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":31,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":110,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.502821+0000","last_change":"2024-02-19T21:49:08.325478+0000","last_active":"2024-02-19T21:53:10.502821+0000","last_peered":"2024-02-19T21:53:10.502821+0000","last_clean":"2024-02-19T21:53:10.502821+0000","last_became_active":"2024-02-19T21:49:08.325127+0000","last_became_peered":"2024-02-19T21:49:08.325127+0000","last_unstale":"2024-02-19T21:53:10.502821+0000","last_undegraded":"2024-02-19T21:53:10.502821+0000","last_fullsized":"2024-02-19T21:53:10.502821+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:10.871111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:10.871111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"482'9123","reported_seq":9228,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:15.163378+0000","last_change":"2024-02-19T21:48:47.778829+0000","last_active":"2024-02-19T21:53:15.163378+0000","last_peered":"2024-02-19T21:53:15.163378+0000","last_clean":"2024-02-19T21:53:15.163378+0000","last_became_active":"2024-02-19T21:48:47.778486+0000","last_became_peered":"2024-02-19T21:48:47.778486+0000","last_unstale":"2024-02-19T21:53:15.163378+0000","last_undegraded":"2024-02-19T21:53:15.163378+0000","last_fullsized":"2024-02-19T21:53:15.163378+0000","mapping_epoch":385,"log_start":"418'4200","ondisk_log_start":"418'4200","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4923,"ondisk_log_size":4923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22085632,"num_objects":337,"num_object_clones":0,"num_object_copies":1011,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":337,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9123,"num_write_kb":302720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":484,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.503074+0000","last_change":"2024-02-19T21:47:33.400407+0000","last_active":"2024-02-19T21:53:10.503074+0000","last_peered":"2024-02-19T21:53:10.503074+0000","last_clean":"2024-02-19T21:53:10.503074+0000","last_became_active":"2024-02-19T21:47:33.400075+0000","last_became_peered":"2024-02-19T21:47:33.400075+0000","last_unstale":"2024-02-19T21:53:10.503074+0000","last_undegraded":"2024-02-19T21:53:10.503074+0000","last_fullsized":"2024-02-19T21:53:10.503074+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.035136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":362,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.494904+0000","last_change":"2024-02-19T21:49:05.746443+0000","last_active":"2024-02-19T21:53:10.494904+0000","last_peered":"2024-02-19T21:53:10.494904+0000","last_clean":"2024-02-19T21:53:10.494904+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:53:10.494904+0000","last_undegraded":"2024-02-19T21:53:10.494904+0000","last_fullsized":"2024-02-19T21:53:10.494904+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.746358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.746358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":514,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.495013+0000","last_change":"2024-02-19T21:49:54.485252+0000","last_active":"2024-02-19T21:53:10.495013+0000","last_peered":"2024-02-19T21:53:10.495013+0000","last_clean":"2024-02-19T21:53:10.495013+0000","last_became_active":"2024-02-19T21:49:54.484956+0000","last_became_peered":"2024-02-19T21:49:54.484956+0000","last_unstale":"2024-02-19T21:53:10.495013+0000","last_undegraded":"2024-02-19T21:53:10.495013+0000","last_fullsized":"2024-02-19T21:53:10.495013+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:07.901205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:07.901205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":78,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.502298+0000","last_change":"2024-02-19T21:49:54.483990+0000","last_active":"2024-02-19T21:53:10.502298+0000","last_peered":"2024-02-19T21:53:10.502298+0000","last_clean":"2024-02-19T21:53:10.502298+0000","last_became_active":"2024-02-19T21:49:54.483637+0000","last_became_peered":"2024-02-19T21:49:54.483637+0000","last_unstale":"2024-02-19T21:53:10.502298+0000","last_undegraded":"2024-02-19T21:53:10.502298+0000","last_fullsized":"2024-02-19T21:53:10.502298+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.190177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.190177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"470'45","reported_seq":525,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.491597+0000","last_change":"2024-02-19T21:46:47.970066+0000","last_active":"2024-02-19T21:53:10.491597+0000","last_peered":"2024-02-19T21:53:10.491597+0000","last_clean":"2024-02-19T21:53:10.491597+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:53:10.491597+0000","last_undegraded":"2024-02-19T21:53:10.491597+0000","last_fullsized":"2024-02-19T21:53:10.491597+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'33","last_scrub_stamp":"2024-02-19T21:46:47.969961+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.969961+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":51,"num_write":37,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":78,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.502878+0000","last_change":"2024-02-19T21:49:54.478276+0000","last_active":"2024-02-19T21:53:10.502878+0000","last_peered":"2024-02-19T21:53:10.502878+0000","last_clean":"2024-02-19T21:53:10.502878+0000","last_became_active":"2024-02-19T21:49:54.477947+0000","last_became_peered":"2024-02-19T21:49:54.477947+0000","last_unstale":"2024-02-19T21:53:10.502878+0000","last_undegraded":"2024-02-19T21:53:10.502878+0000","last_fullsized":"2024-02-19T21:53:10.502878+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:57.754453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:57.754453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"482'8800","reported_seq":19046,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:14.840209+0000","last_change":"2024-02-19T21:51:22.472713+0000","last_active":"2024-02-19T21:53:14.840209+0000","last_peered":"2024-02-19T21:53:14.840209+0000","last_clean":"2024-02-19T21:53:14.840209+0000","last_became_active":"2024-02-19T21:51:22.462974+0000","last_became_peered":"2024-02-19T21:51:22.462974+0000","last_unstale":"2024-02-19T21:53:14.840209+0000","last_undegraded":"2024-02-19T21:53:14.840209+0000","last_fullsized":"2024-02-19T21:53:14.840209+0000","mapping_epoch":445,"log_start":"411'3700","ondisk_log_start":"411'3700","created":385,"last_epoch_clean":446,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5100,"ondisk_log_size":5100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25952256,"num_objects":396,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":396,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8800,"num_write_kb":294272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5054,"num_bytes_recovered":320077824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7],"acting":[0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":455,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.507263+0000","last_change":"2024-02-19T21:45:47.723650+0000","last_active":"2024-02-19T21:53:10.507263+0000","last_peered":"2024-02-19T21:53:10.507263+0000","last_clean":"2024-02-19T21:53:10.507263+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:53:10.507263+0000","last_undegraded":"2024-02-19T21:53:10.507263+0000","last_fullsized":"2024-02-19T21:53:10.507263+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.723550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.723550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":466,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.486504+0000","last_change":"2024-02-19T21:45:51.243726+0000","last_active":"2024-02-19T21:53:10.486504+0000","last_peered":"2024-02-19T21:53:10.486504+0000","last_clean":"2024-02-19T21:53:10.486504+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:53:10.486504+0000","last_undegraded":"2024-02-19T21:53:10.486504+0000","last_fullsized":"2024-02-19T21:53:10.486504+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:51.243656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:51.243656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":483,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.502487+0000","last_change":"2024-02-19T21:48:23.218358+0000","last_active":"2024-02-19T21:53:10.502487+0000","last_peered":"2024-02-19T21:53:10.502487+0000","last_clean":"2024-02-19T21:53:10.502487+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:53:10.502487+0000","last_undegraded":"2024-02-19T21:53:10.502487+0000","last_fullsized":"2024-02-19T21:53:10.502487+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:23.218282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.218282+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"470'42","reported_seq":628,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.485697+0000","last_change":"2024-02-19T21:49:08.330490+0000","last_active":"2024-02-19T21:53:10.485697+0000","last_peered":"2024-02-19T21:53:10.485697+0000","last_clean":"2024-02-19T21:53:10.485697+0000","last_became_active":"2024-02-19T21:49:08.329761+0000","last_became_peered":"2024-02-19T21:49:08.329761+0000","last_unstale":"2024-02-19T21:53:10.485697+0000","last_undegraded":"2024-02-19T21:53:10.485697+0000","last_fullsized":"2024-02-19T21:53:10.485697+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'30","last_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_deep_scrub":"324'30","last_deep_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.110965+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":48,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":468,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.503000+0000","last_change":"2024-02-19T21:45:09.918263+0000","last_active":"2024-02-19T21:53:10.503000+0000","last_peered":"2024-02-19T21:53:10.503000+0000","last_clean":"2024-02-19T21:53:10.503000+0000","last_became_active":"2024-02-19T21:44:42.624782+0000","last_became_peered":"2024-02-19T21:44:42.624782+0000","last_unstale":"2024-02-19T21:53:10.503000+0000","last_undegraded":"2024-02-19T21:53:10.503000+0000","last_fullsized":"2024-02-19T21:53:10.503000+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":295,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_clean_scrub_stamp":"2024-02-19T21:45:09.918170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"482'8899","reported_seq":9004,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:15.150547+0000","last_change":"2024-02-19T21:48:47.777963+0000","last_active":"2024-02-19T21:53:15.150547+0000","last_peered":"2024-02-19T21:53:15.150547+0000","last_clean":"2024-02-19T21:53:15.150547+0000","last_became_active":"2024-02-19T21:48:47.777644+0000","last_became_peered":"2024-02-19T21:48:47.777644+0000","last_unstale":"2024-02-19T21:53:15.150547+0000","last_undegraded":"2024-02-19T21:53:15.150547+0000","last_fullsized":"2024-02-19T21:53:15.150547+0000","mapping_epoch":385,"log_start":"412'4000","ondisk_log_start":"412'4000","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4899,"ondisk_log_size":4899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24248344,"num_objects":371,"num_object_clones":0,"num_object_copies":1113,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":371,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":8899,"num_write_kb":296577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":488,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.500391+0000","last_change":"2024-02-19T21:49:08.331080+0000","last_active":"2024-02-19T21:53:10.500391+0000","last_peered":"2024-02-19T21:53:10.500391+0000","last_clean":"2024-02-19T21:53:10.500391+0000","last_became_active":"2024-02-19T21:49:08.330648+0000","last_became_peered":"2024-02-19T21:49:08.330648+0000","last_unstale":"2024-02-19T21:53:10.500391+0000","last_undegraded":"2024-02-19T21:53:10.500391+0000","last_fullsized":"2024-02-19T21:53:10.500391+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:55.803876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:44:55.803876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":459,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.501295+0000","last_change":"2024-02-19T21:48:31.320229+0000","last_active":"2024-02-19T21:53:10.501295+0000","last_peered":"2024-02-19T21:53:10.501295+0000","last_clean":"2024-02-19T21:53:10.501295+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:53:10.501295+0000","last_undegraded":"2024-02-19T21:53:10.501295+0000","last_fullsized":"2024-02-19T21:53:10.501295+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:31.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:45.017696+0000","last_clean_scrub_stamp":"2024-02-19T21:48:31.320133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"470'47","reported_seq":529,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.485632+0000","last_change":"2024-02-19T21:45:14.173212+0000","last_active":"2024-02-19T21:53:10.485632+0000","last_peered":"2024-02-19T21:53:10.485632+0000","last_clean":"2024-02-19T21:53:10.485632+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:53:10.485632+0000","last_undegraded":"2024-02-19T21:53:10.485632+0000","last_fullsized":"2024-02-19T21:53:10.485632+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'37","last_scrub_stamp":"2024-02-19T21:45:14.173134+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:45:14.173134+0000","log_size":47,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":55,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":458,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.493500+0000","last_change":"2024-02-19T21:46:48.988928+0000","last_active":"2024-02-19T21:53:10.493500+0000","last_peered":"2024-02-19T21:53:10.493500+0000","last_clean":"2024-02-19T21:53:10.493500+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:53:10.493500+0000","last_undegraded":"2024-02-19T21:53:10.493500+0000","last_fullsized":"2024-02-19T21:53:10.493500+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:48.988836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.988836+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.e","version":"482'8792","reported_seq":10983,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:15.253499+0000","last_change":"2024-02-19T21:50:40.718822+0000","last_active":"2024-02-19T21:53:15.253499+0000","last_peered":"2024-02-19T21:53:15.253499+0000","last_clean":"2024-02-19T21:53:15.253499+0000","last_became_active":"2024-02-19T21:50:40.710425+0000","last_became_peered":"2024-02-19T21:50:40.710425+0000","last_unstale":"2024-02-19T21:53:15.253499+0000","last_undegraded":"2024-02-19T21:53:15.253499+0000","last_fullsized":"2024-02-19T21:53:15.253499+0000","mapping_epoch":430,"log_start":"411'3700","ondisk_log_start":"411'3700","created":385,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5092,"ondisk_log_size":5092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22544384,"num_objects":344,"num_object_clones":0,"num_object_copies":1032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":344,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8792,"num_write_kb":292352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1035,"num_bytes_recovered":67829760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":201,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.486840+0000","last_change":"2024-02-19T21:49:08.326461+0000","last_active":"2024-02-19T21:53:10.486840+0000","last_peered":"2024-02-19T21:53:10.486840+0000","last_clean":"2024-02-19T21:53:10.486840+0000","last_became_active":"2024-02-19T21:49:08.326106+0000","last_became_peered":"2024-02-19T21:49:08.326106+0000","last_unstale":"2024-02-19T21:53:10.486840+0000","last_undegraded":"2024-02-19T21:53:10.486840+0000","last_fullsized":"2024-02-19T21:53:10.486840+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.080896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.080896+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":461,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.500780+0000","last_change":"2024-02-19T21:48:11.879787+0000","last_active":"2024-02-19T21:53:10.500780+0000","last_peered":"2024-02-19T21:53:10.500780+0000","last_clean":"2024-02-19T21:53:10.500780+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:53:10.500780+0000","last_undegraded":"2024-02-19T21:53:10.500780+0000","last_fullsized":"2024-02-19T21:53:10.500780+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.879687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.879687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"470'50","reported_seq":114,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.502749+0000","last_change":"2024-02-19T21:49:55.861358+0000","last_active":"2024-02-19T21:53:10.502749+0000","last_peered":"2024-02-19T21:53:10.502749+0000","last_clean":"2024-02-19T21:53:10.502749+0000","last_became_active":"2024-02-19T21:49:54.480413+0000","last_became_peered":"2024-02-19T21:49:54.480413+0000","last_unstale":"2024-02-19T21:53:10.502749+0000","last_undegraded":"2024-02-19T21:53:10.502749+0000","last_fullsized":"2024-02-19T21:53:10.502749+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":415,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'38","last_scrub_stamp":"2024-02-19T21:49:05.923627+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.923627+0000","log_size":50,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":57,"num_write":44,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":354,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.493234+0000","last_change":"2024-02-19T21:49:54.495134+0000","last_active":"2024-02-19T21:53:10.493234+0000","last_peered":"2024-02-19T21:53:10.493234+0000","last_clean":"2024-02-19T21:53:10.493234+0000","last_became_active":"2024-02-19T21:49:54.494802+0000","last_became_peered":"2024-02-19T21:49:54.494802+0000","last_unstale":"2024-02-19T21:53:10.493234+0000","last_undegraded":"2024-02-19T21:53:10.493234+0000","last_fullsized":"2024-02-19T21:53:10.493234+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:10.578408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:10.578408+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.f","version":"482'9180","reported_seq":11595,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:15.147734+0000","last_change":"2024-02-19T21:51:05.409700+0000","last_active":"2024-02-19T21:53:15.147734+0000","last_peered":"2024-02-19T21:53:15.147734+0000","last_clean":"2024-02-19T21:53:15.147734+0000","last_became_active":"2024-02-19T21:51:05.398355+0000","last_became_peered":"2024-02-19T21:51:05.398355+0000","last_unstale":"2024-02-19T21:53:15.147734+0000","last_undegraded":"2024-02-19T21:53:15.147734+0000","last_fullsized":"2024-02-19T21:53:15.147734+0000","mapping_epoch":440,"log_start":"419'4300","ondisk_log_start":"419'4300","created":385,"last_epoch_clean":441,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4880,"ondisk_log_size":4880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23461888,"num_objects":358,"num_object_clones":0,"num_object_copies":1074,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":358,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9180,"num_write_kb":305216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1147,"num_bytes_recovered":75169792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":488,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.500572+0000","last_change":"2024-02-19T21:49:08.328862+0000","last_active":"2024-02-19T21:53:10.500572+0000","last_peered":"2024-02-19T21:53:10.500572+0000","last_clean":"2024-02-19T21:53:10.500572+0000","last_became_active":"2024-02-19T21:49:08.328529+0000","last_became_peered":"2024-02-19T21:49:08.328529+0000","last_unstale":"2024-02-19T21:53:10.500572+0000","last_undegraded":"2024-02-19T21:53:10.500572+0000","last_fullsized":"2024-02-19T21:53:10.500572+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:49.110117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:49.110117+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":521,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.491913+0000","last_change":"2024-02-19T21:49:54.493367+0000","last_active":"2024-02-19T21:53:10.491913+0000","last_peered":"2024-02-19T21:53:10.491913+0000","last_clean":"2024-02-19T21:53:10.491913+0000","last_became_active":"2024-02-19T21:49:54.493041+0000","last_became_peered":"2024-02-19T21:49:54.493041+0000","last_unstale":"2024-02-19T21:53:10.491913+0000","last_undegraded":"2024-02-19T21:53:10.491913+0000","last_fullsized":"2024-02-19T21:53:10.491913+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.972369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.972369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"470'42","reported_seq":349,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.486618+0000","last_change":"2024-02-19T21:49:08.330818+0000","last_active":"2024-02-19T21:53:10.486618+0000","last_peered":"2024-02-19T21:53:10.486618+0000","last_clean":"2024-02-19T21:53:10.486618+0000","last_became_active":"2024-02-19T21:49:08.330477+0000","last_became_peered":"2024-02-19T21:49:08.330477+0000","last_unstale":"2024-02-19T21:53:10.486618+0000","last_undegraded":"2024-02-19T21:53:10.486618+0000","last_fullsized":"2024-02-19T21:53:10.486618+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'28","last_scrub_stamp":"2024-02-19T21:45:55.998646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.998646+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":567,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.519280+0000","last_change":"2024-02-19T21:45:50.742626+0000","last_active":"2024-02-19T21:53:11.519280+0000","last_peered":"2024-02-19T21:53:11.519280+0000","last_clean":"2024-02-19T21:53:11.519280+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:53:11.519280+0000","last_undegraded":"2024-02-19T21:53:11.519280+0000","last_fullsized":"2024-02-19T21:53:11.519280+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'9","last_scrub_stamp":"2024-02-19T21:45:50.742526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:50.742526+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"482'8781","reported_seq":8886,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:15.117838+0000","last_change":"2024-02-19T21:48:47.779506+0000","last_active":"2024-02-19T21:53:15.117838+0000","last_peered":"2024-02-19T21:53:15.117838+0000","last_clean":"2024-02-19T21:53:15.117838+0000","last_became_active":"2024-02-19T21:48:47.778325+0000","last_became_peered":"2024-02-19T21:48:47.778325+0000","last_unstale":"2024-02-19T21:53:15.117838+0000","last_undegraded":"2024-02-19T21:53:15.117838+0000","last_fullsized":"2024-02-19T21:53:15.117838+0000","mapping_epoch":385,"log_start":"412'3900","ondisk_log_start":"412'3900","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":4881,"ondisk_log_size":4881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23527424,"num_objects":359,"num_object_clones":0,"num_object_copies":1077,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":359,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8781,"num_write_kb":292480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4],"acting":[6,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"66'1","reported_seq":372,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.491532+0000","last_change":"2024-02-19T21:48:12.568842+0000","last_active":"2024-02-19T21:53:10.491532+0000","last_peered":"2024-02-19T21:53:10.491532+0000","last_clean":"2024-02-19T21:53:10.491532+0000","last_became_active":"2024-02-19T21:44:56.166670+0000","last_became_peered":"2024-02-19T21:44:56.166670+0000","last_unstale":"2024-02-19T21:53:10.491532+0000","last_undegraded":"2024-02-19T21:53:10.491532+0000","last_fullsized":"2024-02-19T21:53:10.491532+0000","mapping_epoch":165,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:12.568734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.568734+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"261'11","reported_seq":578,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.520571+0000","last_change":"2024-02-19T21:45:01.716882+0000","last_active":"2024-02-19T21:53:11.520571+0000","last_peered":"2024-02-19T21:53:11.520571+0000","last_clean":"2024-02-19T21:53:11.520571+0000","last_became_active":"2024-02-19T21:44:08.123392+0000","last_became_peered":"2024-02-19T21:44:08.123392+0000","last_unstale":"2024-02-19T21:53:11.520571+0000","last_undegraded":"2024-02-19T21:53:11.520571+0000","last_fullsized":"2024-02-19T21:53:11.520571+0000","mapping_epoch":62,"log_start":"257'10","ondisk_log_start":"257'10","created":62,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-02-19T21:45:01.716817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.716817+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":470,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.502570+0000","last_change":"2024-02-19T21:48:19.186455+0000","last_active":"2024-02-19T21:53:10.502570+0000","last_peered":"2024-02-19T21:53:10.502570+0000","last_clean":"2024-02-19T21:53:10.502570+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:53:10.502570+0000","last_undegraded":"2024-02-19T21:53:10.502570+0000","last_fullsized":"2024-02-19T21:53:10.502570+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:48:19.186359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:19.186359+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"470'27","reported_seq":340,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.489521+0000","last_change":"2024-02-19T21:48:34.485865+0000","last_active":"2024-02-19T21:53:10.489521+0000","last_peered":"2024-02-19T21:53:10.489521+0000","last_clean":"2024-02-19T21:53:10.489521+0000","last_became_active":"2024-02-19T21:47:46.251550+0000","last_became_peered":"2024-02-19T21:47:46.251550+0000","last_unstale":"2024-02-19T21:53:10.489521+0000","last_undegraded":"2024-02-19T21:53:10.489521+0000","last_fullsized":"2024-02-19T21:53:10.489521+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:34.485787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:34.485787+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7],"acting":[4,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1","version":"482'8950","reported_seq":9055,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:15.250503+0000","last_change":"2024-02-19T21:48:47.772467+0000","last_active":"2024-02-19T21:53:15.250503+0000","last_peered":"2024-02-19T21:53:15.250503+0000","last_clean":"2024-02-19T21:53:15.250503+0000","last_became_active":"2024-02-19T21:48:47.772154+0000","last_became_peered":"2024-02-19T21:48:47.772154+0000","last_unstale":"2024-02-19T21:53:15.250503+0000","last_undegraded":"2024-02-19T21:53:15.250503+0000","last_fullsized":"2024-02-19T21:53:15.250503+0000","mapping_epoch":385,"log_start":"412'3900","ondisk_log_start":"412'3900","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5050,"ondisk_log_size":5050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23855104,"num_objects":364,"num_object_clones":0,"num_object_copies":1092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":364,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8950,"num_write_kb":298048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0],"acting":[4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":477,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.495717+0000","last_change":"2024-02-19T21:46:01.031458+0000","last_active":"2024-02-19T21:53:10.495717+0000","last_peered":"2024-02-19T21:53:10.495717+0000","last_clean":"2024-02-19T21:53:10.495717+0000","last_became_active":"2024-02-19T21:44:56.155194+0000","last_became_peered":"2024-02-19T21:44:56.155194+0000","last_unstale":"2024-02-19T21:53:10.495717+0000","last_undegraded":"2024-02-19T21:53:10.495717+0000","last_fullsized":"2024-02-19T21:53:10.495717+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.031344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.031344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"363'12","reported_seq":290,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.509043+0000","last_change":"2024-02-19T21:48:25.487689+0000","last_active":"2024-02-19T21:53:11.509043+0000","last_peered":"2024-02-19T21:53:11.509043+0000","last_clean":"2024-02-19T21:53:11.509043+0000","last_became_active":"2024-02-19T21:47:46.260099+0000","last_became_peered":"2024-02-19T21:47:46.260099+0000","last_unstale":"2024-02-19T21:53:11.509043+0000","last_undegraded":"2024-02-19T21:53:11.509043+0000","last_fullsized":"2024-02-19T21:53:11.509043+0000","mapping_epoch":362,"log_start":"98'9","ondisk_log_start":"98'9","created":62,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"363'12","last_scrub_stamp":"2024-02-19T21:48:25.487608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.487608+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":481,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.500319+0000","last_change":"2024-02-19T21:49:08.335163+0000","last_active":"2024-02-19T21:53:10.500319+0000","last_peered":"2024-02-19T21:53:10.500319+0000","last_clean":"2024-02-19T21:53:10.500319+0000","last_became_active":"2024-02-19T21:49:08.334842+0000","last_became_peered":"2024-02-19T21:49:08.334842+0000","last_unstale":"2024-02-19T21:53:10.500319+0000","last_undegraded":"2024-02-19T21:53:10.500319+0000","last_fullsized":"2024-02-19T21:53:10.500319+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.700887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.700887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"471'46","reported_seq":419,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.502687+0000","last_change":"2024-02-19T21:47:34.894164+0000","last_active":"2024-02-19T21:53:10.502687+0000","last_peered":"2024-02-19T21:53:10.502687+0000","last_clean":"2024-02-19T21:53:10.502687+0000","last_became_active":"2024-02-19T21:47:33.400012+0000","last_became_peered":"2024-02-19T21:47:33.400012+0000","last_unstale":"2024-02-19T21:53:10.502687+0000","last_undegraded":"2024-02-19T21:53:10.502687+0000","last_fullsized":"2024-02-19T21:53:10.502687+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":357,"parent":"0.0","parent_split_bits":0,"last_scrub":"270'34","last_scrub_stamp":"2024-02-19T21:46:44.789309+0000","last_deep_scrub":"270'34","last_deep_scrub_stamp":"2024-02-19T21:44:17.451151+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.789309+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2","version":"482'9070","reported_seq":9175,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:15.216154+0000","last_change":"2024-02-19T21:48:47.771305+0000","last_active":"2024-02-19T21:53:15.216154+0000","last_peered":"2024-02-19T21:53:15.216154+0000","last_clean":"2024-02-19T21:53:15.216154+0000","last_became_active":"2024-02-19T21:48:47.771000+0000","last_became_peered":"2024-02-19T21:48:47.771000+0000","last_unstale":"2024-02-19T21:53:15.216154+0000","last_undegraded":"2024-02-19T21:53:15.216154+0000","last_fullsized":"2024-02-19T21:53:15.216154+0000","mapping_epoch":385,"log_start":"411'3800","ondisk_log_start":"411'3800","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5270,"ondisk_log_size":5270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23461888,"num_objects":358,"num_object_clones":0,"num_object_copies":1074,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":358,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9070,"num_write_kb":301696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":459,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.489816+0000","last_change":"2024-02-19T21:49:08.329023+0000","last_active":"2024-02-19T21:53:10.489816+0000","last_peered":"2024-02-19T21:53:10.489816+0000","last_clean":"2024-02-19T21:53:10.489816+0000","last_became_active":"2024-02-19T21:49:08.328697+0000","last_became_peered":"2024-02-19T21:49:08.328697+0000","last_unstale":"2024-02-19T21:53:10.489816+0000","last_undegraded":"2024-02-19T21:53:10.489816+0000","last_fullsized":"2024-02-19T21:53:10.489816+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.939414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.939414+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"397'17","reported_seq":420,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:12.117055+0000","last_change":"2024-02-19T21:49:08.325927+0000","last_active":"2024-02-19T21:53:12.117055+0000","last_peered":"2024-02-19T21:53:12.117055+0000","last_clean":"2024-02-19T21:53:12.117055+0000","last_became_active":"2024-02-19T21:49:08.325034+0000","last_became_peered":"2024-02-19T21:49:08.325034+0000","last_unstale":"2024-02-19T21:53:12.117055+0000","last_undegraded":"2024-02-19T21:53:12.117055+0000","last_fullsized":"2024-02-19T21:53:12.117055+0000","mapping_epoch":394,"log_start":"170'11","ondisk_log_start":"170'11","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"271'13","last_scrub_stamp":"2024-02-19T21:46:47.072988+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.072988+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":471,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.500665+0000","last_change":"2024-02-19T21:49:03.987847+0000","last_active":"2024-02-19T21:53:10.500665+0000","last_peered":"2024-02-19T21:53:10.500665+0000","last_clean":"2024-02-19T21:53:10.500665+0000","last_became_active":"2024-02-19T21:47:33.395485+0000","last_became_peered":"2024-02-19T21:47:33.395485+0000","last_unstale":"2024-02-19T21:53:10.500665+0000","last_undegraded":"2024-02-19T21:53:10.500665+0000","last_fullsized":"2024-02-19T21:53:10.500665+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:03.987749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:49:03.987749+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,5],"acting":[1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"470'30","reported_seq":320,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.486919+0000","last_change":"2024-02-19T21:48:12.628796+0000","last_active":"2024-02-19T21:53:10.486919+0000","last_peered":"2024-02-19T21:53:10.486919+0000","last_clean":"2024-02-19T21:53:10.486919+0000","last_became_active":"2024-02-19T21:47:46.251725+0000","last_became_peered":"2024-02-19T21:47:46.251725+0000","last_unstale":"2024-02-19T21:53:10.486919+0000","last_undegraded":"2024-02-19T21:53:10.486919+0000","last_fullsized":"2024-02-19T21:53:10.486919+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'20","last_scrub_stamp":"2024-02-19T21:48:12.628700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.628700+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":38,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3","version":"482'9110","reported_seq":11419,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:17.205315+0000","last_change":"2024-02-19T21:50:50.296220+0000","last_active":"2024-02-19T21:53:17.205315+0000","last_peered":"2024-02-19T21:53:17.205315+0000","last_clean":"2024-02-19T21:53:17.205315+0000","last_became_active":"2024-02-19T21:50:50.289607+0000","last_became_peered":"2024-02-19T21:50:50.289607+0000","last_unstale":"2024-02-19T21:53:17.205315+0000","last_undegraded":"2024-02-19T21:53:17.205315+0000","last_fullsized":"2024-02-19T21:53:17.205315+0000","mapping_epoch":433,"log_start":"410'3700","ondisk_log_start":"410'3700","created":385,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5410,"ondisk_log_size":5410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16384000,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":250,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9110,"num_write_kb":299520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1097,"num_bytes_recovered":71892992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":110,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.504277+0000","last_change":"2024-02-19T21:49:08.327495+0000","last_active":"2024-02-19T21:53:10.504277+0000","last_peered":"2024-02-19T21:53:10.504277+0000","last_clean":"2024-02-19T21:53:10.504277+0000","last_became_active":"2024-02-19T21:49:08.327172+0000","last_became_peered":"2024-02-19T21:49:08.327172+0000","last_unstale":"2024-02-19T21:53:10.504277+0000","last_undegraded":"2024-02-19T21:53:10.504277+0000","last_fullsized":"2024-02-19T21:53:10.504277+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.241319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.241319+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,6],"acting":[2,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":466,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.507179+0000","last_change":"2024-02-19T21:45:01.798485+0000","last_active":"2024-02-19T21:53:10.507179+0000","last_peered":"2024-02-19T21:53:10.507179+0000","last_clean":"2024-02-19T21:53:10.507179+0000","last_became_active":"2024-02-19T21:44:22.245925+0000","last_became_peered":"2024-02-19T21:44:22.245925+0000","last_unstale":"2024-02-19T21:53:10.507179+0000","last_undegraded":"2024-02-19T21:53:10.507179+0000","last_fullsized":"2024-02-19T21:53:10.507179+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:01.798387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.798387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":466,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.500478+0000","last_change":"2024-02-19T21:48:30.277397+0000","last_active":"2024-02-19T21:53:10.500478+0000","last_peered":"2024-02-19T21:53:10.500478+0000","last_clean":"2024-02-19T21:53:10.500478+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:53:10.500478+0000","last_undegraded":"2024-02-19T21:53:10.500478+0000","last_fullsized":"2024-02-19T21:53:10.500478+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.277322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.277322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"470'53","reported_seq":435,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.487425+0000","last_change":"2024-02-19T21:49:08.326007+0000","last_active":"2024-02-19T21:53:10.487425+0000","last_peered":"2024-02-19T21:53:10.487425+0000","last_clean":"2024-02-19T21:53:10.487425+0000","last_became_active":"2024-02-19T21:49:08.325683+0000","last_became_peered":"2024-02-19T21:49:08.325683+0000","last_unstale":"2024-02-19T21:53:10.487425+0000","last_undegraded":"2024-02-19T21:53:10.487425+0000","last_fullsized":"2024-02-19T21:53:10.487425+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'39","last_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_deep_scrub":"337'39","last_deep_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.923809+0000","log_size":53,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"482'9144","reported_seq":9249,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:14.816770+0000","last_change":"2024-02-19T21:48:47.776672+0000","last_active":"2024-02-19T21:53:14.816770+0000","last_peered":"2024-02-19T21:53:14.816770+0000","last_clean":"2024-02-19T21:53:14.816770+0000","last_became_active":"2024-02-19T21:48:47.776368+0000","last_became_peered":"2024-02-19T21:48:47.776368+0000","last_unstale":"2024-02-19T21:53:14.816770+0000","last_undegraded":"2024-02-19T21:53:14.816770+0000","last_fullsized":"2024-02-19T21:53:14.816770+0000","mapping_epoch":385,"log_start":"412'4000","ondisk_log_start":"412'4000","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5144,"ondisk_log_size":5144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26476544,"num_objects":404,"num_object_clones":0,"num_object_copies":1212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":404,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9144,"num_write_kb":305536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"66'1","reported_seq":304,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.502587+0000","last_change":"2024-02-19T21:50:57.303343+0000","last_active":"2024-02-19T21:53:10.502587+0000","last_peered":"2024-02-19T21:53:10.502587+0000","last_clean":"2024-02-19T21:53:10.502587+0000","last_became_active":"2024-02-19T21:50:57.302957+0000","last_became_peered":"2024-02-19T21:50:57.302957+0000","last_unstale":"2024-02-19T21:53:10.502587+0000","last_undegraded":"2024-02-19T21:53:10.502587+0000","last_fullsized":"2024-02-19T21:53:10.502587+0000","mapping_epoch":437,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":438,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:46:43.773486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:46:43.773486+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":110,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.502459+0000","last_change":"2024-02-19T21:49:08.326583+0000","last_active":"2024-02-19T21:53:10.502459+0000","last_peered":"2024-02-19T21:53:10.502459+0000","last_clean":"2024-02-19T21:53:10.502459+0000","last_became_active":"2024-02-19T21:49:08.324835+0000","last_became_peered":"2024-02-19T21:49:08.324835+0000","last_unstale":"2024-02-19T21:53:10.502459+0000","last_undegraded":"2024-02-19T21:53:10.502459+0000","last_fullsized":"2024-02-19T21:53:10.502459+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.163825+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":180,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:12.878393+0000","last_change":"2024-02-19T21:53:12.881095+0000","last_active":"2024-02-19T21:53:12.878393+0000","last_peered":"2024-02-19T21:53:12.878393+0000","last_clean":"2024-02-19T21:53:12.878393+0000","last_became_active":"2024-02-19T21:49:08.327186+0000","last_became_peered":"2024-02-19T21:49:08.327186+0000","last_unstale":"2024-02-19T21:53:12.878393+0000","last_undegraded":"2024-02-19T21:53:12.878393+0000","last_fullsized":"2024-02-19T21:53:12.878393+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:45:00.748244+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:45:00.748244+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"471'60","reported_seq":611,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.493338+0000","last_change":"2024-02-19T21:49:55.281324+0000","last_active":"2024-02-19T21:53:10.493338+0000","last_peered":"2024-02-19T21:53:10.493338+0000","last_clean":"2024-02-19T21:53:10.493338+0000","last_became_active":"2024-02-19T21:49:54.493167+0000","last_became_peered":"2024-02-19T21:49:54.493167+0000","last_unstale":"2024-02-19T21:53:10.493338+0000","last_undegraded":"2024-02-19T21:53:10.493338+0000","last_fullsized":"2024-02-19T21:53:10.493338+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'44","last_scrub_stamp":"2024-02-19T21:48:32.489084+0000","last_deep_scrub":"201'44","last_deep_scrub_stamp":"2024-02-19T21:44:16.255049+0000","last_clean_scrub_stamp":"2024-02-19T21:48:32.489084+0000","log_size":60,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":80,"num_read_kb":69,"num_write":52,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.5","version":"482'9198","reported_seq":18718,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:17.217553+0000","last_change":"2024-02-19T21:53:04.402237+0000","last_active":"2024-02-19T21:53:17.217553+0000","last_peered":"2024-02-19T21:53:17.217553+0000","last_clean":"2024-02-19T21:53:17.217553+0000","last_became_active":"2024-02-19T21:53:04.383797+0000","last_became_peered":"2024-02-19T21:53:04.383797+0000","last_unstale":"2024-02-19T21:53:17.217553+0000","last_undegraded":"2024-02-19T21:53:17.217553+0000","last_fullsized":"2024-02-19T21:53:17.217553+0000","mapping_epoch":477,"log_start":"410'3800","ondisk_log_start":"410'3800","created":385,"last_epoch_clean":478,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5398,"ondisk_log_size":5398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14680064,"num_objects":224,"num_object_clones":0,"num_object_copies":672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":224,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9198,"num_write_kb":301504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4121,"num_bytes_recovered":266272768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":511,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.486627+0000","last_change":"2024-02-19T21:49:08.328667+0000","last_active":"2024-02-19T21:53:10.486627+0000","last_peered":"2024-02-19T21:53:10.486627+0000","last_clean":"2024-02-19T21:53:10.486627+0000","last_became_active":"2024-02-19T21:49:08.328287+0000","last_became_peered":"2024-02-19T21:49:08.328287+0000","last_unstale":"2024-02-19T21:53:10.486627+0000","last_undegraded":"2024-02-19T21:53:10.486627+0000","last_fullsized":"2024-02-19T21:53:10.486627+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.176542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.176542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":110,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.502299+0000","last_change":"2024-02-19T21:49:08.332637+0000","last_active":"2024-02-19T21:53:10.502299+0000","last_peered":"2024-02-19T21:53:10.502299+0000","last_clean":"2024-02-19T21:53:10.502299+0000","last_became_active":"2024-02-19T21:49:08.331451+0000","last_became_peered":"2024-02-19T21:49:08.331451+0000","last_unstale":"2024-02-19T21:53:10.502299+0000","last_undegraded":"2024-02-19T21:53:10.502299+0000","last_fullsized":"2024-02-19T21:53:10.502299+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.123413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.547129+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.123413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":481,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.505532+0000","last_change":"2024-02-19T21:49:08.331159+0000","last_active":"2024-02-19T21:53:10.505532+0000","last_peered":"2024-02-19T21:53:10.505532+0000","last_clean":"2024-02-19T21:53:10.505532+0000","last_became_active":"2024-02-19T21:49:08.330804+0000","last_became_peered":"2024-02-19T21:49:08.330804+0000","last_unstale":"2024-02-19T21:53:10.505532+0000","last_undegraded":"2024-02-19T21:53:10.505532+0000","last_fullsized":"2024-02-19T21:53:10.505532+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.978015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.978015+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"470'25","reported_seq":498,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.485786+0000","last_change":"2024-02-19T21:48:23.326608+0000","last_active":"2024-02-19T21:53:10.485786+0000","last_peered":"2024-02-19T21:53:10.485786+0000","last_clean":"2024-02-19T21:53:10.485786+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:53:10.485786+0000","last_undegraded":"2024-02-19T21:53:10.485786+0000","last_fullsized":"2024-02-19T21:53:10.485786+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"377'19","last_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_deep_scrub":"377'19","last_deep_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.326541+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"482'9046","reported_seq":9150,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:15.355283+0000","last_change":"2024-02-19T21:48:47.780368+0000","last_active":"2024-02-19T21:53:15.355283+0000","last_peered":"2024-02-19T21:53:15.355283+0000","last_clean":"2024-02-19T21:53:15.355283+0000","last_became_active":"2024-02-19T21:48:47.780046+0000","last_became_peered":"2024-02-19T21:48:47.780046+0000","last_unstale":"2024-02-19T21:53:15.355283+0000","last_undegraded":"2024-02-19T21:53:15.355283+0000","last_fullsized":"2024-02-19T21:53:15.355283+0000","mapping_epoch":385,"log_start":"411'3800","ondisk_log_start":"411'3800","created":385,"last_epoch_clean":386,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:46.759921+0000","last_clean_scrub_stamp":"2024-02-19T21:48:46.759921+0000","log_size":5246,"ondisk_log_size":5246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23724032,"num_objects":362,"num_object_clones":0,"num_object_copies":1086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":362,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9046,"num_write_kb":301056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":475,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.494587+0000","last_change":"2024-02-19T21:46:01.981923+0000","last_active":"2024-02-19T21:53:10.494587+0000","last_peered":"2024-02-19T21:53:10.494587+0000","last_clean":"2024-02-19T21:53:10.494587+0000","last_became_active":"2024-02-19T21:44:56.160521+0000","last_became_peered":"2024-02-19T21:44:56.160521+0000","last_unstale":"2024-02-19T21:53:10.494587+0000","last_undegraded":"2024-02-19T21:53:10.494587+0000","last_fullsized":"2024-02-19T21:53:10.494587+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.981866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.981866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":119,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.502965+0000","last_change":"2024-02-19T21:49:54.485377+0000","last_active":"2024-02-19T21:53:10.502965+0000","last_peered":"2024-02-19T21:53:10.502965+0000","last_clean":"2024-02-19T21:53:10.502965+0000","last_became_active":"2024-02-19T21:49:54.485078+0000","last_became_peered":"2024-02-19T21:49:54.485078+0000","last_unstale":"2024-02-19T21:53:10.502965+0000","last_undegraded":"2024-02-19T21:53:10.502965+0000","last_fullsized":"2024-02-19T21:53:10.502965+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:52.107416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:46:52.107416+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"470'39","reported_seq":570,"reported_epoch":481,"state":"active+clean","last_fresh":"2024-02-19T21:53:10.490634+0000","last_change":"2024-02-19T21:49:55.109780+0000","last_active":"2024-02-19T21:53:10.490634+0000","last_peered":"2024-02-19T21:53:10.490634+0000","last_clean":"2024-02-19T21:53:10.490634+0000","last_became_active":"2024-02-19T21:49:54.486014+0000","last_became_peered":"2024-02-19T21:49:54.486014+0000","last_unstale":"2024-02-19T21:53:10.490634+0000","last_undegraded":"2024-02-19T21:53:10.490634+0000","last_fullsized":"2024-02-19T21:53:10.490634+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'27","last_scrub_stamp":"2024-02-19T21:48:24.665813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:24.665813+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"324'11","reported_seq":738,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.515638+0000","last_change":"2024-02-19T21:48:26.293036+0000","last_active":"2024-02-19T21:53:11.515638+0000","last_peered":"2024-02-19T21:53:11.515638+0000","last_clean":"2024-02-19T21:53:11.515638+0000","last_became_active":"2024-02-19T21:44:34.385140+0000","last_became_peered":"2024-02-19T21:44:34.385140+0000","last_unstale":"2024-02-19T21:53:11.515638+0000","last_undegraded":"2024-02-19T21:53:11.515638+0000","last_fullsized":"2024-02-19T21:53:11.515638+0000","mapping_epoch":62,"log_start":"66'8","ondisk_log_start":"66'8","created":62,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'11","last_scrub_stamp":"2024-02-19T21:48:26.292909+0000","last_deep_scrub":"324'11","last_deep_scrub_stamp":"2024-02-19T21:46:05.210095+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.292909+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":363069464,"num_objects":5541,"num_object_clones":0,"num_object_copies":16623,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2173,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5541,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":143955,"num_write_kb":4783809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15422,"num_bytes_recovered":981860352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1641623552,"data_stored":1641611336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81055,"ondisk_log_size":81055,"up":48,"acting":47,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1231,"num_read_kb":1226,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1536,"num_read_kb":1293,"num_write":989,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":277,"num_bytes_recovered":5172,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1062,"ondisk_log_size":1062,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":22,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":66,"acting":66,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":382,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201533,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":721288,"kb_used_data":127360,"kb_used_omap":0,"kb_used_meta":593792,"kb_avail":93023864,"statfs":{"total":95995035648,"available":95256436736,"internally_reserved":0,"allocated":130416640,"data_stored":128970660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":608043008},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:52:55 2024","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.329,"15min":1.857},"min":{"1min":0.26500000000000001,"5min":0.222,"15min":0.189},"max":{"1min":4.726,"5min":11.653,"15min":70.477999999999994},"last":0.20899999999999999},{"interface":"front","average":{"1min":1.851,"5min":1.351,"15min":1.9950000000000001},"min":{"1min":0.26800000000000002,"5min":0.23100000000000001,"15min":0.20999999999999999},"max":{"1min":9.8759999999999994,"5min":12.242000000000001,"15min":68.052000000000007},"last":0.40200000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:52:55 2024","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.1739999999999999,"15min":1.9670000000000001},"min":{"1min":0.25,"5min":0.247,"15min":0.23200000000000001},"max":{"1min":4.883,"5min":9.9440000000000008,"15min":68.168000000000006},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.6040000000000001,"5min":1.474,"15min":2.0840000000000001},"min":{"1min":0.40200000000000002,"5min":0.26300000000000001,"15min":0.223},"max":{"1min":9.9559999999999995,"5min":12.199,"15min":68.444000000000003},"last":0.42799999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:52:16 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":1.6519999999999999,"15min":2.1499999999999999},"min":{"1min":0.29099999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1970000000000001,"5min":12.304,"15min":12.304},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":1.506,"15min":1.8779999999999999},"min":{"1min":0.375,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":6.2779999999999996,"5min":11.69,"15min":11.69},"last":0.32900000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:52:55 2024","interfaces":[{"interface":"back","average":{"1min":2.5579999999999998,"5min":1.736,"15min":2.0739999999999998},"min":{"1min":0.37,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":7.6479999999999997,"5min":11.778,"15min":17.481999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":2.5459999999999998,"5min":1.3799999999999999,"15min":1.7689999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.29299999999999998},"max":{"1min":13.196,"5min":13.196,"15min":17.576000000000001},"last":1.127}]},{"osd":4,"last update":"Mon Feb 19 21:52:55 2024","interfaces":[{"interface":"back","average":{"1min":2.5870000000000002,"5min":1.619,"15min":1.6699999999999999},"min":{"1min":0.32100000000000001,"5min":0.245,"15min":0.216},"max":{"1min":10.656000000000001,"5min":17.716999999999999,"15min":17.716999999999999},"last":2.1549999999999998},{"interface":"front","average":{"1min":3.331,"5min":2.0899999999999999,"15min":2.0449999999999999},"min":{"1min":0.376,"5min":0.26500000000000001,"15min":0.253},"max":{"1min":15.961,"5min":15.961,"15min":17.690999999999999},"last":6.7949999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:52:55 2024","interfaces":[{"interface":"back","average":{"1min":2.2919999999999998,"5min":1.5029999999999999,"15min":1.722},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.24199999999999999},"max":{"1min":7.8609999999999998,"5min":12.210000000000001,"15min":29.021000000000001},"last":3.1859999999999999},{"interface":"front","average":{"1min":3.637,"5min":1.829,"15min":2.0630000000000002},"min":{"1min":0.45300000000000001,"5min":0.33800000000000002,"15min":0.28699999999999998},"max":{"1min":9.9269999999999996,"5min":17.670999999999999,"15min":29.091999999999999},"last":0.61099999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:52:55 2024","interfaces":[{"interface":"back","average":{"1min":3.0579999999999998,"5min":2.0899999999999999,"15min":1.833},"min":{"1min":0.42999999999999999,"5min":0.31,"15min":0.24299999999999999},"max":{"1min":15.426,"5min":19.286000000000001,"15min":19.286000000000001},"last":3.2120000000000002},{"interface":"front","average":{"1min":2.887,"5min":2.0920000000000001,"15min":1.9970000000000001},"min":{"1min":0.46400000000000002,"5min":0.314,"15min":0.26700000000000002},"max":{"1min":6.9690000000000003,"5min":18.364000000000001,"15min":18.364000000000001},"last":1.2629999999999999}]}]},{"osd":6,"up_from":47,"seq":201863463172,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":763656,"kb_used_data":173824,"kb_used_omap":0,"kb_used_meta":589696,"kb_avail":92981496,"statfs":{"total":95995035648,"available":95213051904,"internally_reserved":0,"allocated":177995776,"data_stored":176549110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":603848704},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:52:31 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.92500000000000004,"15min":1.5880000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.20100000000000001},"max":{"1min":3.9489999999999998,"5min":7.8170000000000002,"15min":45.197000000000003},"last":0.27500000000000002},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.391,"15min":1.948},"min":{"1min":0.29399999999999998,"5min":0.23499999999999999,"15min":0.221},"max":{"1min":3.7469999999999999,"5min":6.7320000000000002,"15min":44.753},"last":3.157}]},{"osd":1,"last update":"Mon Feb 19 21:52:31 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":1.091,"15min":1.577},"min":{"1min":0.26700000000000002,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":4.101,"5min":7.8639999999999999,"15min":45.231999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.3029999999999999,"15min":1.6950000000000001},"min":{"1min":0.28699999999999998,"5min":0.245,"15min":0.23100000000000001},"max":{"1min":9.3079999999999998,"5min":9.3079999999999998,"15min":45.097999999999999},"last":0.79500000000000004}]},{"osd":2,"last update":"Mon Feb 19 21:53:12 2024","interfaces":[{"interface":"back","average":{"1min":2.8149999999999999,"5min":1.472,"15min":1.538},"min":{"1min":0.29699999999999999,"5min":0.255,"15min":0.255},"max":{"1min":9.9369999999999994,"5min":9.9369999999999994,"15min":9.9369999999999994},"last":3.129},{"interface":"front","average":{"1min":2,"5min":1.1200000000000001,"15min":1.2190000000000001},"min":{"1min":0.311,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":9.7829999999999995,"5min":9.7829999999999995,"15min":9.7829999999999995},"last":0.30499999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:52:31 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.0920000000000001,"15min":1.512},"min":{"1min":0.36699999999999999,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":4.0140000000000002,"5min":7.9210000000000003,"15min":11.15},"last":0.36799999999999999},{"interface":"front","average":{"1min":1.907,"5min":1.478,"15min":1.597},"min":{"1min":0.307,"5min":0.30599999999999999,"15min":0.26400000000000001},"max":{"1min":13.038,"5min":13.038,"15min":19.632999999999999},"last":0.76500000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:52:31 2024","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.821,"15min":1.8380000000000001},"min":{"1min":0.29399999999999998,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":8.5980000000000008,"5min":18.010000000000002,"15min":18.010000000000002},"last":3.2320000000000002},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3120000000000001,"15min":1.7589999999999999},"min":{"1min":0.317,"5min":0.26300000000000001,"15min":0.23499999999999999},"max":{"1min":6.4909999999999997,"5min":11.566000000000001,"15min":16.594999999999999},"last":0.47999999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:52:31 2024","interfaces":[{"interface":"back","average":{"1min":2.214,"5min":1.762,"15min":1.901},"min":{"1min":0.36799999999999999,"5min":0.27400000000000002,"15min":0.27100000000000002},"max":{"1min":7.7370000000000001,"5min":9.5990000000000002,"15min":14.695},"last":6.851},{"interface":"front","average":{"1min":1.962,"5min":1.5800000000000001,"15min":2.0019999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":6.6959999999999997,"5min":11.609999999999999,"15min":15.497999999999999},"last":0.34899999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:52:55 2024","interfaces":[{"interface":"back","average":{"1min":2.8100000000000001,"5min":1.585,"15min":1.9550000000000001},"min":{"1min":0.34100000000000003,"5min":0.32100000000000001,"15min":0.27200000000000002},"max":{"1min":9.8170000000000002,"5min":9.8170000000000002,"15min":14.721},"last":6.7599999999999998},{"interface":"front","average":{"1min":2.8460000000000001,"5min":1.6279999999999999,"15min":1.9950000000000001},"min":{"1min":0.41799999999999998,"5min":0.35899999999999999,"15min":0.34300000000000003},"max":{"1min":9.8309999999999995,"5min":9.8309999999999995,"15min":14.744999999999999},"last":6.7889999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575134,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1006616,"kb_used_data":101904,"kb_used_omap":0,"kb_used_meta":904704,"kb_avail":92738536,"statfs":{"total":95995035648,"available":94964260864,"internally_reserved":0,"allocated":104349696,"data_stored":102887546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":926416896},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:52:20 2024","interfaces":[{"interface":"back","average":{"1min":0.25700000000000001,"5min":0.70599999999999996,"15min":1.329},"min":{"1min":0.186,"5min":0.16300000000000001,"15min":0.161},"max":{"1min":0.38500000000000001,"5min":5.7889999999999997,"15min":42.776000000000003},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.85399999999999998,"15min":1.504},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.16400000000000001},"max":{"1min":4.1020000000000003,"5min":5.7119999999999997,"15min":44.845999999999997},"last":2.4039999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:53:13 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.68600000000000005,"15min":0.94999999999999996},"min":{"1min":0.20499999999999999,"5min":0.189,"15min":0.189},"max":{"1min":1.093,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.79600000000000004,"15min":0.93999999999999995},"min":{"1min":0.20699999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":4.0179999999999998,"5min":4.452,"15min":4.452},"last":4.0179999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:52:20 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72099999999999997,"15min":1.456},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.20999999999999999},"max":{"1min":4.3529999999999998,"5min":4.3710000000000004,"15min":41.607999999999997},"last":2.383},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.72299999999999998,"15min":1.381},"min":{"1min":0.27100000000000002,"5min":0.215,"15min":0.215},"max":{"1min":2.4889999999999999,"5min":4.5190000000000001,"15min":42.811999999999998},"last":4.1130000000000004}]},{"osd":4,"last update":"Mon Feb 19 21:52:38 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.1579999999999999,"15min":1.5029999999999999},"min":{"1min":0.32000000000000001,"5min":0.26900000000000002,"15min":0.251},"max":{"1min":6.9690000000000003,"5min":9.8759999999999994,"15min":15.853},"last":1.042},{"interface":"front","average":{"1min":1.3420000000000001,"5min":0.98599999999999999,"15min":1.484},"min":{"1min":0.33900000000000002,"5min":0.28000000000000003,"15min":0.26500000000000001},"max":{"1min":6.9800000000000004,"5min":6.9800000000000004,"15min":15.861000000000001},"last":4.508}]},{"osd":5,"last update":"Mon Feb 19 21:53:07 2024","interfaces":[{"interface":"back","average":{"1min":1.665,"5min":0.95999999999999996,"15min":1.544},"min":{"1min":0.45000000000000001,"5min":0.29599999999999999,"15min":0.27900000000000003},"max":{"1min":3.891,"5min":4.0720000000000001,"15min":14.331},"last":2.7730000000000001},{"interface":"front","average":{"1min":2.0129999999999999,"5min":1.0569999999999999,"15min":1.5700000000000001},"min":{"1min":0.33300000000000002,"5min":0.307,"15min":0.30099999999999999},"max":{"1min":10.148999999999999,"5min":10.148999999999999,"15min":14.496},"last":2.351}]},{"osd":6,"last update":"Mon Feb 19 21:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":1.1060000000000001,"15min":1.5800000000000001},"min":{"1min":0.377,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":2.5779999999999998,"5min":10.456,"15min":11.638999999999999},"last":4.0819999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.1599999999999999,"15min":1.6870000000000001},"min":{"1min":0.36299999999999999,"5min":0.34699999999999998,"15min":0.29699999999999999},"max":{"1min":3.6480000000000001,"5min":9.8049999999999997,"15min":12.199},"last":2.4329999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:53:02 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.1659999999999999,"15min":1.694},"min":{"1min":0.35699999999999998,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":7.0679999999999996,"5min":7.702,"15min":13.904},"last":2.5910000000000002},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.2110000000000001,"15min":1.665},"min":{"1min":0.39800000000000002,"5min":0.38900000000000001,"15min":0.32600000000000001},"max":{"1min":7.0899999999999999,"5min":7.6909999999999998,"15min":13.894},"last":2.5840000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738660,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1170244,"kb_used_data":279932,"kb_used_omap":0,"kb_used_meta":890304,"kb_avail":92574908,"statfs":{"total":95995035648,"available":94796705792,"internally_reserved":0,"allocated":286650368,"data_stored":285207737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":911671296},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:52:12 2024","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.63600000000000001,"15min":1.026},"min":{"1min":0.191,"5min":0.189,"15min":0.153},"max":{"1min":0.53500000000000003,"5min":6.1550000000000002,"15min":16.478000000000002},"last":3.226},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.80300000000000005,"15min":1.2270000000000001},"min":{"1min":0.222,"5min":0.20100000000000001,"15min":0.17799999999999999},"max":{"1min":1.04,"5min":6.9359999999999999,"15min":13.422000000000001},"last":5.452}]},{"osd":2,"last update":"Mon Feb 19 21:52:12 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.56100000000000005,"15min":0.628},"min":{"1min":0.223,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.95699999999999996,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":1.7709999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.86399999999999999,"15min":1.0760000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.79200000000000004,"5min":8.9960000000000004,"15min":8.9960000000000004},"last":5.9370000000000003}]},{"osd":3,"last update":"Mon Feb 19 21:53:01 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":0.78300000000000003,"15min":1.284},"min":{"1min":0.26400000000000001,"5min":0.217,"15min":0.21299999999999999},"max":{"1min":3.0859999999999999,"5min":8.2279999999999998,"15min":13.776},"last":1.829},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.69499999999999995,"15min":1.2370000000000001},"min":{"1min":0.29299999999999998,"5min":0.24099999999999999,"15min":0.23400000000000001},"max":{"1min":2.948,"5min":3.722,"15min":18.759},"last":5.968}]},{"osd":4,"last update":"Mon Feb 19 21:52:48 2024","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.25,"15min":1.657},"min":{"1min":0.32800000000000001,"5min":0.29399999999999998,"15min":0.252},"max":{"1min":6.8310000000000004,"5min":10.311,"15min":13.278},"last":1.8069999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1599999999999999,"15min":1.498},"min":{"1min":0.33000000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":3.3679999999999999,"5min":10.109,"15min":10.109},"last":1.9970000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:53:01 2024","interfaces":[{"interface":"back","average":{"1min":2,"5min":1.22,"15min":1.9490000000000001},"min":{"1min":0.318,"5min":0.317,"15min":0.27600000000000002},"max":{"1min":7.2089999999999996,"5min":8.1199999999999992,"15min":42.799999999999997},"last":2.2970000000000002},{"interface":"front","average":{"1min":2.238,"5min":1.288,"15min":2.0510000000000002},"min":{"1min":0.40899999999999997,"5min":0.33200000000000002,"15min":0.27300000000000002},"max":{"1min":6.4269999999999996,"5min":8.5530000000000008,"15min":42.695},"last":3.0489999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:52:16 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":1.3700000000000001,"15min":1.6459999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.27000000000000002},"max":{"1min":1.4390000000000001,"5min":10.278,"15min":42.777000000000001},"last":1.895},{"interface":"front","average":{"1min":0.60799999999999998,"5min":1.4890000000000001,"15min":1.845},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.28599999999999998},"max":{"1min":1.6539999999999999,"5min":11.84,"15min":13.289999999999999},"last":2.1859999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:52:54 2024","interfaces":[{"interface":"back","average":{"1min":1.8320000000000001,"5min":1.274,"15min":1.8069999999999999},"min":{"1min":0.45700000000000002,"5min":0.36499999999999999,"15min":0.31},"max":{"1min":5.7229999999999999,"5min":9.6460000000000008,"15min":42.758000000000003},"last":3.0790000000000002},{"interface":"front","average":{"1min":1.554,"5min":1.2929999999999999,"15min":1.6890000000000001},"min":{"1min":0.435,"5min":0.40000000000000002,"15min":0.36399999999999999},"max":{"1min":5.7119999999999997,"5min":9.6389999999999993,"15min":42.718000000000004},"last":2.4460000000000002}]}]},{"osd":2,"up_from":394,"seq":1692217114674,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":458352,"kb_used_data":134184,"kb_used_omap":0,"kb_used_meta":324031,"kb_avail":93286800,"statfs":{"total":95995035648,"available":95525683200,"internally_reserved":0,"allocated":137404416,"data_stored":135981967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":331807796},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:53:13 2024","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":0.96099999999999997,"15min":1.0980000000000001},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":9.2629999999999999,"5min":9.2629999999999999,"15min":9.2629999999999999},"last":1.196},{"interface":"front","average":{"1min":1.034,"5min":0.83499999999999996,"15min":1.093},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":5.6440000000000001,"5min":6.149,"15min":6.149},"last":1.863}]},{"osd":1,"last update":"Mon Feb 19 21:53:13 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.59599999999999997,"15min":0.61299999999999999},"min":{"1min":0.20000000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":4.3650000000000002,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":1.3819999999999999},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.76000000000000001,"15min":0.89800000000000002},"min":{"1min":0.23400000000000001,"5min":0.224,"15min":0.224},"max":{"1min":4.2930000000000001,"5min":6.992,"15min":6.992},"last":1.0680000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:53:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0269999999999999,"15min":1.3089999999999999},"min":{"1min":0.28599999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":2.6819999999999999,"5min":6.9470000000000001,"15min":6.9470000000000001},"last":1.173},{"interface":"front","average":{"1min":1.181,"5min":0.94199999999999995,"15min":1.1759999999999999},"min":{"1min":0.27600000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":7.6669999999999998,"5min":7.6669999999999998,"15min":7.6669999999999998},"last":1.47}]},{"osd":4,"last update":"Mon Feb 19 21:53:13 2024","interfaces":[{"interface":"back","average":{"1min":1.841,"5min":1.476,"15min":1.9299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":8.843,"5min":8.843,"15min":8.843},"last":1.625},{"interface":"front","average":{"1min":2.6240000000000001,"5min":1.573,"15min":1.829},"min":{"1min":0.30299999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":9.3300000000000001,"5min":9.3300000000000001,"15min":9.3300000000000001},"last":4.9809999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:53:13 2024","interfaces":[{"interface":"back","average":{"1min":2.8769999999999998,"5min":1.6970000000000001,"15min":1.758},"min":{"1min":0.42299999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":11.129,"5min":11.129,"15min":11.129},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.2490000000000001,"15min":1.6299999999999999},"min":{"1min":0.32200000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":4.9790000000000001,"5min":13.558,"15min":13.558},"last":2.1789999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:53:13 2024","interfaces":[{"interface":"back","average":{"1min":3.266,"5min":1.611,"15min":1.7050000000000001},"min":{"1min":0.42099999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":9.6720000000000006,"5min":9.6720000000000006,"15min":9.6720000000000006},"last":3.9020000000000001},{"interface":"front","average":{"1min":2.5470000000000002,"5min":1.1839999999999999,"15min":1.089},"min":{"1min":0.38100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":8.3629999999999995,"5min":8.3629999999999995,"15min":8.3629999999999995},"last":1.5469999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:53:13 2024","interfaces":[{"interface":"back","average":{"1min":2.169,"5min":1.3200000000000001,"15min":1.409},"min":{"1min":0.36499999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":6.5949999999999998,"5min":6.5949999999999998,"15min":6.5949999999999998},"last":3.5979999999999999},{"interface":"front","average":{"1min":2.7370000000000001,"5min":1.105,"15min":0.93100000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":8.7780000000000005,"5min":8.7780000000000005,"15min":8.7780000000000005},"last":1.804}]}]},{"osd":3,"up_from":0,"seq":111669149972,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":32,"seq":137438953741,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1085240,"kb_used_data":499376,"kb_used_omap":0,"kb_used_meta":585600,"kb_avail":92659912,"statfs":{"total":95995035648,"available":94883749888,"internally_reserved":0,"allocated":511361024,"data_stored":509929729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":599654400},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,2,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:52:34 2024","interfaces":[{"interface":"back","average":{"1min":1.9099999999999999,"5min":1.857,"15min":1.885},"min":{"1min":0.25900000000000001,"5min":0.219,"15min":0.219},"max":{"1min":9.923,"5min":53.936,"15min":53.936},"last":10.173},{"interface":"front","average":{"1min":1.595,"5min":2.012,"15min":1.972},"min":{"1min":0.27200000000000002,"5min":0.252,"15min":0.22600000000000001},"max":{"1min":10.140000000000001,"5min":54.405999999999999,"15min":54.405999999999999},"last":2.0609999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:52:34 2024","interfaces":[{"interface":"back","average":{"1min":2.0230000000000001,"5min":2.012,"15min":1.8260000000000001},"min":{"1min":0.26100000000000001,"5min":0.253,"15min":0.21199999999999999},"max":{"1min":12.439,"5min":54.731000000000002,"15min":54.731000000000002},"last":10.134},{"interface":"front","average":{"1min":1.532,"5min":1.9330000000000001,"15min":1.704},"min":{"1min":0.29499999999999998,"5min":0.252,"15min":0.25},"max":{"1min":8.4689999999999994,"5min":52.490000000000002,"15min":52.490000000000002},"last":0.57399999999999995}]},{"osd":2,"last update":"Mon Feb 19 21:53:12 2024","interfaces":[{"interface":"back","average":{"1min":3.8029999999999999,"5min":1.79,"15min":1.9810000000000001},"min":{"1min":0.34000000000000002,"5min":0.255,"15min":0.255},"max":{"1min":12.516999999999999,"5min":12.516999999999999,"15min":12.516999999999999},"last":10.198},{"interface":"front","average":{"1min":3.8610000000000002,"5min":1.833,"15min":2.0190000000000001},"min":{"1min":0.377,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":12.541,"5min":12.541,"15min":12.541},"last":10.25}]},{"osd":3,"last update":"Mon Feb 19 21:52:34 2024","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.3480000000000001,"15min":1.702},"min":{"1min":0.35099999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":9.9529999999999994,"5min":9.9529999999999994,"15min":15.914999999999999},"last":2.75},{"interface":"front","average":{"1min":2.1560000000000001,"5min":1.4970000000000001,"15min":1.6950000000000001},"min":{"1min":0.36299999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":12.486000000000001,"5min":12.486000000000001,"15min":13.321},"last":10.226000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:52:28 2024","interfaces":[{"interface":"back","average":{"1min":2.1320000000000001,"5min":1.921,"15min":1.865},"min":{"1min":0.28100000000000003,"5min":0.23799999999999999,"15min":0.23400000000000001},"max":{"1min":13.458,"5min":16.731999999999999,"15min":18.916},"last":0.46300000000000002},{"interface":"front","average":{"1min":1.8740000000000001,"5min":1.653,"15min":2.044},"min":{"1min":0.30399999999999999,"5min":0.26700000000000002,"15min":0.253},"max":{"1min":14.532999999999999,"5min":14.532999999999999,"15min":14.840999999999999},"last":1.171}]},{"osd":6,"last update":"Mon Feb 19 21:52:34 2024","interfaces":[{"interface":"back","average":{"1min":2.4369999999999998,"5min":1.698,"15min":1.7649999999999999},"min":{"1min":0.33600000000000002,"5min":0.28999999999999998,"15min":0.28599999999999998},"max":{"1min":10.233000000000001,"5min":10.233000000000001,"15min":13.27},"last":1.3029999999999999},{"interface":"front","average":{"1min":2.4470000000000001,"5min":2.1699999999999999,"15min":1.9710000000000001},"min":{"1min":0.32900000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":13.433999999999999,"5min":18.670000000000002,"15min":18.670000000000002},"last":3.3940000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:53:06 2024","interfaces":[{"interface":"back","average":{"1min":3.1549999999999998,"5min":1.9119999999999999,"15min":1.9650000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.30399999999999999},"max":{"1min":13.398,"5min":16.763999999999999,"15min":16.763999999999999},"last":2.98},{"interface":"front","average":{"1min":2.8849999999999998,"5min":1.583,"15min":1.851},"min":{"1min":0.38700000000000001,"5min":0.33100000000000002,"15min":0.31},"max":{"1min":12.958,"5min":12.958,"15min":12.958},"last":1.034}]}]},{"osd":5,"up_from":38,"seq":163208757513,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1312876,"kb_used_data":418340,"kb_used_omap":0,"kb_used_meta":894528,"kb_avail":92432276,"statfs":{"total":95995035648,"available":94650650624,"internally_reserved":0,"allocated":428380160,"data_stored":426961252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":915996672},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,2,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:53:14 2024","interfaces":[{"interface":"back","average":{"1min":3.0390000000000001,"5min":1.2330000000000001,"15min":1.6890000000000001},"min":{"1min":0.23599999999999999,"5min":0.23100000000000001,"15min":0.20599999999999999},"max":{"1min":10.534000000000001,"5min":10.534000000000001,"15min":19.236000000000001},"last":5.3440000000000003},{"interface":"front","average":{"1min":2.3769999999999998,"5min":1.1619999999999999,"15min":1.835},"min":{"1min":0.24299999999999999,"5min":0.23699999999999999,"15min":0.20899999999999999},"max":{"1min":6.5449999999999999,"5min":6.5449999999999999,"15min":13.241},"last":0.26900000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:53:14 2024","interfaces":[{"interface":"back","average":{"1min":2.4089999999999998,"5min":1.145,"15min":1.734},"min":{"1min":0.27300000000000002,"5min":0.246,"15min":0.23100000000000001},"max":{"1min":6.625,"5min":6.625,"15min":10.42},"last":0.33400000000000002},{"interface":"front","average":{"1min":2.7709999999999999,"5min":1.113,"15min":1.5649999999999999},"min":{"1min":0.249,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":11.654,"5min":11.654,"15min":11.654},"last":0.34899999999999998}]},{"osd":2,"last update":"Mon Feb 19 21:53:14 2024","interfaces":[{"interface":"back","average":{"1min":4.6879999999999997,"5min":1.7889999999999999,"15min":1.5269999999999999},"min":{"1min":0.29999999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":39.055,"5min":39.055,"15min":39.055},"last":5.4080000000000004},{"interface":"front","average":{"1min":4.1959999999999997,"5min":1.671,"15min":1.4319999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":39.012999999999998,"5min":39.012999999999998,"15min":39.012999999999998},"last":1.2849999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:53:14 2024","interfaces":[{"interface":"back","average":{"1min":3.1110000000000002,"5min":1.4350000000000001,"15min":1.948},"min":{"1min":0.379,"5min":0.30199999999999999,"15min":0.24099999999999999},"max":{"1min":10.561,"5min":13.182,"15min":19.321000000000002},"last":5.4390000000000001},{"interface":"front","average":{"1min":2.6789999999999998,"5min":1.298,"15min":1.9710000000000001},"min":{"1min":0.44400000000000001,"5min":0.33600000000000002,"15min":0.29499999999999998},"max":{"1min":6.577,"5min":6.577,"15min":9.5150000000000006},"last":0.44400000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:53:14 2024","interfaces":[{"interface":"back","average":{"1min":3.4300000000000002,"5min":1.335,"15min":1.5780000000000001},"min":{"1min":0.28599999999999998,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":12.228,"5min":12.228,"15min":21.577000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":3.4249999999999998,"5min":1.522,"15min":2.044},"min":{"1min":0.29599999999999999,"5min":0.26100000000000001,"15min":0.25600000000000001},"max":{"1min":10.586,"5min":10.586,"15min":19.274000000000001},"last":5.4699999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.641,"5min":1.954,"15min":1.9970000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.221},"max":{"1min":10.611000000000001,"5min":19.884,"15min":19.884},"last":9.952},{"interface":"front","average":{"1min":1.8620000000000001,"5min":1.6599999999999999,"15min":1.9399999999999999},"min":{"1min":0.378,"5min":0.30199999999999999,"15min":0.23599999999999999},"max":{"1min":6.6500000000000004,"5min":10.260999999999999,"15min":13.532999999999999},"last":0.57699999999999996}]},{"osd":7,"last update":"Mon Feb 19 21:52:55 2024","interfaces":[{"interface":"back","average":{"1min":2.7879999999999998,"5min":1.728,"15min":2.1669999999999998},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.27100000000000002},"max":{"1min":8.6590000000000007,"5min":11.486000000000001,"15min":12.962},"last":6.4900000000000002},{"interface":"front","average":{"1min":3.1040000000000001,"5min":1.6539999999999999,"15min":2.0089999999999999},"min":{"1min":0.35399999999999998,"5min":0.35099999999999998,"15min":0.221},"max":{"1min":10.18,"5min":15.593999999999999,"15min":17.759},"last":6.8620000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":251072512,"data_stored":251068440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":93847552,"data_stored":93847552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":108003328,"data_stored":108003328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":499191808,"data_stored":499187736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401211392,"data_stored":401211392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":163844096,"data_stored":163840024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":124452864,"data_stored":124452864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:53:23.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:21.151898+0000 mgr.y (mgr.14514) 795 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:53:23.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:21.229164+0000 mgr.y (mgr.14514) 796 : cluster [DBG] pgmap v1029: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 69 MiB data, 5.4 GiB used, 620 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 1.01k op/s; 2115/3912 objects degraded (54.064%); 77 KiB/s, 11 objects/s recovering 2024-02-19T21:53:23.328 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:21.151898+0000 mgr.y (mgr.14514) 795 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:53:23.328 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:21.229164+0000 mgr.y (mgr.14514) 796 : cluster [DBG] pgmap v1029: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 69 MiB data, 5.4 GiB used, 620 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 1.01k op/s; 2115/3912 objects degraded (54.064%); 77 KiB/s, 11 objects/s recovering 2024-02-19T21:53:23.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:21.151898+0000 mgr.y (mgr.14514) 795 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:53:23.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:21.229164+0000 mgr.y (mgr.14514) 796 : cluster [DBG] pgmap v1029: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 69 MiB data, 5.4 GiB used, 620 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 1.01k op/s; 2115/3912 objects degraded (54.064%); 77 KiB/s, 11 objects/s recovering 2024-02-19T21:53:23.330 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:53:23.583 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_3 2024-02-19T21:53:23.584 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool rm unique_pool_3 unique_pool_3 --yes-i-really-really-mean-it 2024-02-19T21:53:23.777 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:53:23.780 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:23.781 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:53:23.882 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:53:23.911 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:25.004 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-02-19T21:53:25.063 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:53:25.091 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:23.229776+0000 mgr.y (mgr.14514) 797 : cluster [DBG] pgmap v1030: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 40 MiB data, 5.3 GiB used, 621 GiB / 626 GiB avail; 873 B/s rd, 0 B/s wr, 902 op/s; 2115/2490 objects degraded (84.940%); 65 KiB/s, 9 objects/s recovering 2024-02-19T21:53:25.091 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:24.281989+0000 mon.a (mon.0) 1849 : audit [INF] from='client.? 172.21.15.80:0/300332171' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:53:25.091 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:23.229776+0000 mgr.y (mgr.14514) 797 : cluster [DBG] pgmap v1030: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 40 MiB data, 5.3 GiB used, 621 GiB / 626 GiB avail; 873 B/s rd, 0 B/s wr, 902 op/s; 2115/2490 objects degraded (84.940%); 65 KiB/s, 9 objects/s recovering 2024-02-19T21:53:25.091 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:24.281989+0000 mon.a (mon.0) 1849 : audit [INF] from='client.? 172.21.15.80:0/300332171' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:53:25.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:23.229776+0000 mgr.y (mgr.14514) 797 : cluster [DBG] pgmap v1030: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 40 MiB data, 5.3 GiB used, 621 GiB / 626 GiB avail; 873 B/s rd, 0 B/s wr, 902 op/s; 2115/2490 objects degraded (84.940%); 65 KiB/s, 9 objects/s recovering 2024-02-19T21:53:25.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:24.281989+0000 mon.a (mon.0) 1849 : audit [INF] from='client.? 172.21.15.80:0/300332171' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:53:25.364 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:53:25.831 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:53:25.831 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:53:25.860 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:53:25.863 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:25.863 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:53:25.964 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:53:25.988 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:53:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:53:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:53:25.990 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:26.019 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:53:26.022 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:26.022 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:53:26.122 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:53:26.148 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:26.168 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:53:26.171 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:26.171 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:53:26.272 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:53:26.296 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:24.989915+0000 mon.a (mon.0) 1850 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:53:26.296 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:25.000997+0000 mon.a (mon.0) 1851 : audit [INF] from='client.? 172.21.15.80:0/300332171' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:53:26.296 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:25.001053+0000 mon.a (mon.0) 1852 : cluster [DBG] osdmap e483: 8 total, 8 up, 7 in 2024-02-19T21:53:26.296 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:25.344184+0000 mon.a (mon.0) 1853 : cluster [WRN] Health check update: Degraded data redundancy: 2115/2490 objects degraded (84.940%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2024-02-19T21:53:26.296 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:25.349017+0000 mon.a (mon.0) 1854 : cluster [DBG] osdmap e484: 8 total, 8 up, 7 in 2024-02-19T21:53:26.297 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:26.316 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:53:26.318 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:26.319 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:53:26.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:24.989915+0000 mon.a (mon.0) 1850 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:53:26.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:25.000997+0000 mon.a (mon.0) 1851 : audit [INF] from='client.? 172.21.15.80:0/300332171' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:53:26.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:25.001053+0000 mon.a (mon.0) 1852 : cluster [DBG] osdmap e483: 8 total, 8 up, 7 in 2024-02-19T21:53:26.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:25.344184+0000 mon.a (mon.0) 1853 : cluster [WRN] Health check update: Degraded data redundancy: 2115/2490 objects degraded (84.940%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2024-02-19T21:53:26.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:25.349017+0000 mon.a (mon.0) 1854 : cluster [DBG] osdmap e484: 8 total, 8 up, 7 in 2024-02-19T21:53:26.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:24.989915+0000 mon.a (mon.0) 1850 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:53:26.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:25.000997+0000 mon.a (mon.0) 1851 : audit [INF] from='client.? 172.21.15.80:0/300332171' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:53:26.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:25.001053+0000 mon.a (mon.0) 1852 : cluster [DBG] osdmap e483: 8 total, 8 up, 7 in 2024-02-19T21:53:26.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:25.344184+0000 mon.a (mon.0) 1853 : cluster [WRN] Health check update: Degraded data redundancy: 2115/2490 objects degraded (84.940%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2024-02-19T21:53:26.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:25.349017+0000 mon.a (mon.0) 1854 : cluster [DBG] osdmap e484: 8 total, 8 up, 7 in 2024-02-19T21:53:26.420 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:53:26.448 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:26.479 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:53:26.482 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:26.482 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:53:26.583 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:53:26.608 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:26.627 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:53:26.629 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:26.630 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:53:26.731 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:53:26.758 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:26.881 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:53:26.886 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:26.887 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:53:26.909 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_ops_in_flight 2024-02-19T21:53:26.939 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:53:26.939 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:53:26.940 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:53:26.987 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:53:27.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:25.230208+0000 mgr.y (mgr.14514) 798 : cluster [DBG] pgmap v1032: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 10 MiB data, 5.2 GiB used, 621 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 763 op/s; 2115/1065 objects degraded (198.592%); 77 KiB/s, 11 objects/s recovering 2024-02-19T21:53:27.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:25.230208+0000 mgr.y (mgr.14514) 798 : cluster [DBG] pgmap v1032: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 10 MiB data, 5.2 GiB used, 621 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 763 op/s; 2115/1065 objects degraded (198.592%); 77 KiB/s, 11 objects/s recovering 2024-02-19T21:53:27.014 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:27.305 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:25.230208+0000 mgr.y (mgr.14514) 798 : cluster [DBG] pgmap v1032: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 10 MiB data, 5.2 GiB used, 621 GiB / 626 GiB avail; 1023 B/s rd, 0 B/s wr, 763 op/s; 2115/1065 objects degraded (198.592%); 77 KiB/s, 11 objects/s recovering 2024-02-19T21:53:28.496 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-19T21:53:29.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:27.230568+0000 mgr.y (mgr.14514) 799 : cluster [DBG] pgmap v1034: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 5.7 KiB data, 5.1 GiB used, 621 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 693 op/s; 2056/576 objects degraded (356.944%); 0 B/s, 14 objects/s recovering 2024-02-19T21:53:29.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:27.230568+0000 mgr.y (mgr.14514) 799 : cluster [DBG] pgmap v1034: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 5.7 KiB data, 5.1 GiB used, 621 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 693 op/s; 2056/576 objects degraded (356.944%); 0 B/s, 14 objects/s recovering 2024-02-19T21:53:29.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:27.230568+0000 mgr.y (mgr.14514) 799 : cluster [DBG] pgmap v1034: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 5.7 KiB data, 5.1 GiB used, 621 GiB / 626 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 693 op/s; 2056/576 objects degraded (356.944%); 0 B/s, 14 objects/s recovering 2024-02-19T21:53:29.847 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:53:29.850 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:29.851 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:53:29.952 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:53:29.980 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:30.107 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:53:30.109 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:30.110 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:53:30.211 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:53:30.236 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:30.254 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:53:30.256 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:30.257 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:53:30.357 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:53:30.387 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:30.707 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:53:30.756 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:53:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:53:30.974 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:30.974 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:53:30.975 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:53:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:53:30] "GET /metrics HTTP/1.1" 200 176608 "" "Prometheus/2.33.4" 2024-02-19T21:53:31.075 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:53:31.103 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:31.230 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:29.231210+0000 mgr.y (mgr.14514) 800 : cluster [DBG] pgmap v1035: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 5.7 KiB data, 5.1 GiB used, 621 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 139 op/s; 2056/576 objects degraded (356.944%); 0 B/s, 7 objects/s recovering 2024-02-19T21:53:31.230 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:29.631775+0000 osd.1 (osd.1) 250 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:53:31.230 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:29.631822+0000 osd.1 (osd.1) 251 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:53:31.230 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:30.015244+0000 mon.a (mon.0) 1855 : cluster [DBG] osdmap e485: 8 total, 8 up, 7 in 2024-02-19T21:53:31.230 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:30.346231+0000 mon.a (mon.0) 1856 : cluster [WRN] Health check update: Degraded data redundancy: 2056/576 objects degraded (356.944%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2024-02-19T21:53:31.230 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:30.355616+0000 mon.a (mon.0) 1857 : cluster [DBG] osdmap e486: 8 total, 8 up, 7 in 2024-02-19T21:53:31.230 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:30.628857+0000 mon.c (mon.2) 118 : audit [INF] from='client.? 172.21.15.80:0/1744488769' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T21:53:31.230 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:30.629172+0000 mon.a (mon.0) 1858 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T21:53:31.231 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:29.231210+0000 mgr.y (mgr.14514) 800 : cluster [DBG] pgmap v1035: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 5.7 KiB data, 5.1 GiB used, 621 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 139 op/s; 2056/576 objects degraded (356.944%); 0 B/s, 7 objects/s recovering 2024-02-19T21:53:31.231 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:29.631775+0000 osd.1 (osd.1) 250 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:53:31.231 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:29.631822+0000 osd.1 (osd.1) 251 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:53:31.231 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:30.015244+0000 mon.a (mon.0) 1855 : cluster [DBG] osdmap e485: 8 total, 8 up, 7 in 2024-02-19T21:53:31.231 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:30.346231+0000 mon.a (mon.0) 1856 : cluster [WRN] Health check update: Degraded data redundancy: 2056/576 objects degraded (356.944%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2024-02-19T21:53:31.231 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:30.355616+0000 mon.a (mon.0) 1857 : cluster [DBG] osdmap e486: 8 total, 8 up, 7 in 2024-02-19T21:53:31.231 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:30.628857+0000 mon.c (mon.2) 118 : audit [INF] from='client.? 172.21.15.80:0/1744488769' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T21:53:31.231 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:30.629172+0000 mon.a (mon.0) 1858 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T21:53:31.306 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:53:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:53:31.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:29.231210+0000 mgr.y (mgr.14514) 800 : cluster [DBG] pgmap v1035: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 5.7 KiB data, 5.1 GiB used, 621 GiB / 626 GiB avail; 639 B/s rd, 0 B/s wr, 139 op/s; 2056/576 objects degraded (356.944%); 0 B/s, 7 objects/s recovering 2024-02-19T21:53:31.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:29.631775+0000 osd.1 (osd.1) 250 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:53:31.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:29.631822+0000 osd.1 (osd.1) 251 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:53:31.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:30.015244+0000 mon.a (mon.0) 1855 : cluster [DBG] osdmap e485: 8 total, 8 up, 7 in 2024-02-19T21:53:31.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:30.346231+0000 mon.a (mon.0) 1856 : cluster [WRN] Health check update: Degraded data redundancy: 2056/576 objects degraded (356.944%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2024-02-19T21:53:31.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:30.355616+0000 mon.a (mon.0) 1857 : cluster [DBG] osdmap e486: 8 total, 8 up, 7 in 2024-02-19T21:53:31.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:30.628857+0000 mon.c (mon.2) 118 : audit [INF] from='client.? 172.21.15.80:0/1744488769' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T21:53:31.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:30.629172+0000 mon.a (mon.0) 1858 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T21:53:31.390 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'unique_pool_3' removed 2024-02-19T21:53:32.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:31.157597+0000 mgr.y (mgr.14514) 801 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:53:32.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:31.231846+0000 mgr.y (mgr.14514) 802 : cluster [DBG] pgmap v1038: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 5.7 KiB data, 5.0 GiB used, 621 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 28 op/s; 1998/576 objects degraded (346.875%); 0 B/s, 19 objects/s recovering 2024-02-19T21:53:32.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:31.354228+0000 mon.a (mon.0) 1859 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]': finished 2024-02-19T21:53:32.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:31.354290+0000 mon.a (mon.0) 1860 : cluster [DBG] osdmap e487: 8 total, 8 up, 7 in 2024-02-19T21:53:32.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:31.157597+0000 mgr.y (mgr.14514) 801 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:53:32.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:31.231846+0000 mgr.y (mgr.14514) 802 : cluster [DBG] pgmap v1038: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 5.7 KiB data, 5.0 GiB used, 621 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 28 op/s; 1998/576 objects degraded (346.875%); 0 B/s, 19 objects/s recovering 2024-02-19T21:53:32.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:31.354228+0000 mon.a (mon.0) 1859 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]': finished 2024-02-19T21:53:32.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:31.354290+0000 mon.a (mon.0) 1860 : cluster [DBG] osdmap e487: 8 total, 8 up, 7 in 2024-02-19T21:53:32.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:31.157597+0000 mgr.y (mgr.14514) 801 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:53:32.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:31.231846+0000 mgr.y (mgr.14514) 802 : cluster [DBG] pgmap v1038: 138 pgs: 1 active+recovering+undersized+degraded+remapped, 137 active+clean; 5.7 KiB data, 5.0 GiB used, 621 GiB / 626 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 28 op/s; 1998/576 objects degraded (346.875%); 0 B/s, 19 objects/s recovering 2024-02-19T21:53:32.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:31.354228+0000 mon.a (mon.0) 1859 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]': finished 2024-02-19T21:53:32.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:31.354290+0000 mon.a (mon.0) 1860 : cluster [DBG] osdmap e487: 8 total, 8 up, 7 in 2024-02-19T21:53:32.879 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:53:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:53:32.922 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:53:32.939 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:53:32.955 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:53:32.973 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:53:32.992 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:53:33.010 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:53:33.028 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:53:33.046 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:53:33.047 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:53:33.047 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:53:33.047 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:53:33.047 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:53:33.047 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:53:33.047 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:53:33.047 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:53:33.048 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:53:33.555 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:53:33.559 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:33.560 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:53:33.661 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:53:33.701 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:32.866332+0000 mgr.y (mgr.14514) 803 : audit [DBG] from='client.25889 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:53:33.701 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:32.905826+0000 mon.c (mon.2) 119 : audit [DBG] from='client.? 172.21.15.80:0/551524898' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:53:33.703 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:33.725 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:53:33.728 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:33.728 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:53:33.777 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:32.866332+0000 mgr.y (mgr.14514) 803 : audit [DBG] from='client.25889 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:53:33.777 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:32.905826+0000 mon.c (mon.2) 119 : audit [DBG] from='client.? 172.21.15.80:0/551524898' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:53:33.777 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:32.866332+0000 mgr.y (mgr.14514) 803 : audit [DBG] from='client.25889 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:53:33.777 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:32.905826+0000 mon.c (mon.2) 119 : audit [DBG] from='client.? 172.21.15.80:0/551524898' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:53:33.829 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:53:33.858 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:33.878 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:53:33.881 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:33.881 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:53:33.982 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:53:34.010 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:34.030 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:53:34.033 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:34.033 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:53:34.134 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:53:34.164 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:34.548 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:33.232485+0000 mgr.y (mgr.14514) 804 : cluster [DBG] pgmap v1040: 122 pgs: 122 active+clean; 5.7 KiB data, 5.0 GiB used, 621 GiB / 626 GiB avail; 682 B/s rd, 0 op/s 2024-02-19T21:53:34.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:33.353073+0000 mon.a (mon.0) 1861 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1998/576 objects degraded (346.875%), 1 pg degraded, 1 pg undersized) 2024-02-19T21:53:34.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:33.966543+0000 mon.a (mon.0) 1862 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:53:34.549 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:33.232485+0000 mgr.y (mgr.14514) 804 : cluster [DBG] pgmap v1040: 122 pgs: 122 active+clean; 5.7 KiB data, 5.0 GiB used, 621 GiB / 626 GiB avail; 682 B/s rd, 0 op/s 2024-02-19T21:53:34.549 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:33.353073+0000 mon.a (mon.0) 1861 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1998/576 objects degraded (346.875%), 1 pg degraded, 1 pg undersized) 2024-02-19T21:53:34.549 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:33.966543+0000 mon.a (mon.0) 1862 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:53:34.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:33.232485+0000 mgr.y (mgr.14514) 804 : cluster [DBG] pgmap v1040: 122 pgs: 122 active+clean; 5.7 KiB data, 5.0 GiB used, 621 GiB / 626 GiB avail; 682 B/s rd, 0 op/s 2024-02-19T21:53:34.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:33.353073+0000 mon.a (mon.0) 1861 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1998/576 objects degraded (346.875%), 1 pg degraded, 1 pg undersized) 2024-02-19T21:53:34.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:33.966543+0000 mon.a (mon.0) 1862 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:53:34.915 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:53:34.918 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:34.919 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:53:35.020 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:53:35.052 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:35.074 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:53:35.076 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:35.077 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:53:35.177 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:53:35.205 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:35.440 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:53:35.440 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-02-19T21:53:35.440 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-02-19T21:53:35.440 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:53:36.009 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-02-19T21:53:36.009 INFO:tasks.radosbench:Beginning radosbench... 2024-02-19T21:53:36.009 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_4 2024-02-19T21:53:36.009 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool create unique_pool_4 16 2024-02-19T21:53:36.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:53:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:53:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:53:36.537 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_blocked_ops 2024-02-19T21:53:36.563 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:53:36.567 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:36.567 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:53:36.668 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:53:36.694 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:35.232981+0000 mgr.y (mgr.14514) 805 : cluster [DBG] pgmap v1041: 122 pgs: 122 active+clean; 5.7 KiB data, 5.0 GiB used, 621 GiB / 626 GiB avail; 682 B/s rd, 0 op/s 2024-02-19T21:53:36.694 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:35.355087+0000 mon.a (mon.0) 1863 : cluster [DBG] osdmap e488: 8 total, 8 up, 7 in 2024-02-19T21:53:36.695 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:35.232981+0000 mgr.y (mgr.14514) 805 : cluster [DBG] pgmap v1041: 122 pgs: 122 active+clean; 5.7 KiB data, 5.0 GiB used, 621 GiB / 626 GiB avail; 682 B/s rd, 0 op/s 2024-02-19T21:53:36.695 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:35.355087+0000 mon.a (mon.0) 1863 : cluster [DBG] osdmap e488: 8 total, 8 up, 7 in 2024-02-19T21:53:36.699 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:35.232981+0000 mgr.y (mgr.14514) 805 : cluster [DBG] pgmap v1041: 122 pgs: 122 active+clean; 5.7 KiB data, 5.0 GiB used, 621 GiB / 626 GiB avail; 682 B/s rd, 0 op/s 2024-02-19T21:53:36.699 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:35.355087+0000 mon.a (mon.0) 1863 : cluster [DBG] osdmap e488: 8 total, 8 up, 7 in 2024-02-19T21:53:36.701 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:36.722 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:53:36.725 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:36.725 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:53:36.826 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:53:36.855 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:36.874 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:53:36.877 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:36.877 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:53:36.978 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:53:37.008 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:37.242 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":1039,"stamp":"2024-02-19T21:53:31.352340+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5796,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":2799,"num_read_kb":2551,"num_write":998,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":7048,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1131,"ondisk_log_size":1131,"up":366,"acting":366,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":417,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":656216064,"kb_used":5288948,"kb_used_data":510332,"kb_used_omap":0,"kb_used_meta":4778559,"kb_avail":650927116,"statfs":{"total":671965249536,"available":666549366784,"internally_reserved":0,"allocated":522579968,"data_stored":512456797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":4893244468},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3473408,"num_objects":-53,"num_object_clones":0,"num_object_copies":-159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-2115,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-53,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":-149443,"num_write_kb":-4783809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-15480,"num_bytes_recovered":-981860352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.005526"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":80,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.496680+0000","last_change":"2024-02-19T21:49:54.492937+0000","last_active":"2024-02-19T21:53:25.496680+0000","last_peered":"2024-02-19T21:53:25.496680+0000","last_clean":"2024-02-19T21:53:25.496680+0000","last_became_active":"2024-02-19T21:49:54.492544+0000","last_became_peered":"2024-02-19T21:49:54.492544+0000","last_unstale":"2024-02-19T21:53:25.496680+0000","last_undegraded":"2024-02-19T21:53:25.496680+0000","last_fullsized":"2024-02-19T21:53:25.496680+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.643236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.643236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":458,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.515350+0000","last_change":"2024-02-19T21:45:17.201007+0000","last_active":"2024-02-19T21:53:11.515350+0000","last_peered":"2024-02-19T21:53:11.515350+0000","last_clean":"2024-02-19T21:53:11.515350+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:53:11.515350+0000","last_undegraded":"2024-02-19T21:53:11.515350+0000","last_fullsized":"2024-02-19T21:53:11.515350+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:17.200897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:17.200897+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"471'39","reported_seq":146,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.000759+0000","last_change":"2024-02-19T21:49:08.327817+0000","last_active":"2024-02-19T21:53:25.000759+0000","last_peered":"2024-02-19T21:53:25.000759+0000","last_clean":"2024-02-19T21:53:25.000759+0000","last_became_active":"2024-02-19T21:49:08.327416+0000","last_became_peered":"2024-02-19T21:49:08.327416+0000","last_unstale":"2024-02-19T21:53:25.000759+0000","last_undegraded":"2024-02-19T21:53:25.000759+0000","last_fullsized":"2024-02-19T21:53:25.000759+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'27","last_scrub_stamp":"2024-02-19T21:44:48.022013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:48.022013+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":433,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348802+0000","last_change":"2024-02-19T21:48:30.516215+0000","last_active":"2024-02-19T21:53:25.348802+0000","last_peered":"2024-02-19T21:53:25.348802+0000","last_clean":"2024-02-19T21:53:25.348802+0000","last_became_active":"2024-02-19T21:47:46.250178+0000","last_became_peered":"2024-02-19T21:47:46.250178+0000","last_unstale":"2024-02-19T21:53:25.348802+0000","last_undegraded":"2024-02-19T21:53:25.348802+0000","last_fullsized":"2024-02-19T21:53:25.348802+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.516139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.516139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":154,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.515376+0000","last_change":"2024-02-19T21:49:08.330105+0000","last_active":"2024-02-19T21:53:11.515376+0000","last_peered":"2024-02-19T21:53:11.515376+0000","last_clean":"2024-02-19T21:53:11.515376+0000","last_became_active":"2024-02-19T21:49:08.328994+0000","last_became_peered":"2024-02-19T21:49:08.328994+0000","last_unstale":"2024-02-19T21:53:11.515376+0000","last_undegraded":"2024-02-19T21:53:11.515376+0000","last_fullsized":"2024-02-19T21:53:11.515376+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.636083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.636083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"470'25","reported_seq":538,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.347916+0000","last_change":"2024-02-19T21:48:26.530234+0000","last_active":"2024-02-19T21:53:25.347916+0000","last_peered":"2024-02-19T21:53:25.347916+0000","last_clean":"2024-02-19T21:53:25.347916+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:53:25.347916+0000","last_undegraded":"2024-02-19T21:53:25.347916+0000","last_fullsized":"2024-02-19T21:53:25.347916+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:48:26.530160+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.530160+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":216,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.529656+0000","last_change":"2024-02-19T21:49:08.332091+0000","last_active":"2024-02-19T21:53:25.529656+0000","last_peered":"2024-02-19T21:53:25.529656+0000","last_clean":"2024-02-19T21:53:25.529656+0000","last_became_active":"2024-02-19T21:49:08.331753+0000","last_became_peered":"2024-02-19T21:49:08.331753+0000","last_unstale":"2024-02-19T21:53:25.529656+0000","last_undegraded":"2024-02-19T21:53:25.529656+0000","last_fullsized":"2024-02-19T21:53:25.529656+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.005236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.005236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":472,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.496289+0000","last_change":"2024-02-19T21:48:28.327028+0000","last_active":"2024-02-19T21:53:25.496289+0000","last_peered":"2024-02-19T21:53:25.496289+0000","last_clean":"2024-02-19T21:53:25.496289+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:53:25.496289+0000","last_undegraded":"2024-02-19T21:53:25.496289+0000","last_fullsized":"2024-02-19T21:53:25.496289+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.326938+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"470'11","reported_seq":492,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348082+0000","last_change":"2024-02-19T21:53:22.179516+0000","last_active":"2024-02-19T21:53:25.348082+0000","last_peered":"2024-02-19T21:53:25.348082+0000","last_clean":"2024-02-19T21:53:25.348082+0000","last_became_active":"2024-02-19T21:49:08.329314+0000","last_became_peered":"2024-02-19T21:49:08.329314+0000","last_unstale":"2024-02-19T21:53:25.348082+0000","last_undegraded":"2024-02-19T21:53:25.348082+0000","last_fullsized":"2024-02-19T21:53:25.348082+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"310'9","last_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_deep_scrub":"310'9","last_deep_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.506188+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":392,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.517558+0000","last_change":"2024-02-19T21:46:31.205220+0000","last_active":"2024-02-19T21:53:11.517558+0000","last_peered":"2024-02-19T21:53:11.517558+0000","last_clean":"2024-02-19T21:53:11.517558+0000","last_became_active":"2024-02-19T21:46:31.204816+0000","last_became_peered":"2024-02-19T21:46:31.204816+0000","last_unstale":"2024-02-19T21:53:11.517558+0000","last_undegraded":"2024-02-19T21:53:11.517558+0000","last_fullsized":"2024-02-19T21:53:11.517558+0000","mapping_epoch":330,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":331,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:40:36.890201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:40:36.890201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":13,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":494,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.496638+0000","last_change":"2024-02-19T21:49:08.330669+0000","last_active":"2024-02-19T21:53:25.496638+0000","last_peered":"2024-02-19T21:53:25.496638+0000","last_clean":"2024-02-19T21:53:25.496638+0000","last_became_active":"2024-02-19T21:49:08.329998+0000","last_became_peered":"2024-02-19T21:49:08.329998+0000","last_unstale":"2024-02-19T21:53:25.496638+0000","last_undegraded":"2024-02-19T21:53:25.496638+0000","last_fullsized":"2024-02-19T21:53:25.496638+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:58.329316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:58.329316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"470'25","reported_seq":348,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348583+0000","last_change":"2024-02-19T21:49:08.326162+0000","last_active":"2024-02-19T21:53:25.348583+0000","last_peered":"2024-02-19T21:53:25.348583+0000","last_clean":"2024-02-19T21:53:25.348583+0000","last_became_active":"2024-02-19T21:49:08.325802+0000","last_became_peered":"2024-02-19T21:49:08.325802+0000","last_unstale":"2024-02-19T21:53:25.348583+0000","last_undegraded":"2024-02-19T21:53:25.348583+0000","last_fullsized":"2024-02-19T21:53:25.348583+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:46:54.873416+0000","last_deep_scrub":"89'13","last_deep_scrub_stamp":"2024-02-19T21:34:07.313566+0000","last_clean_scrub_stamp":"2024-02-19T21:46:54.873416+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2],"acting":[4,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":403,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.512678+0000","last_change":"2024-02-19T21:49:04.432817+0000","last_active":"2024-02-19T21:53:11.512678+0000","last_peered":"2024-02-19T21:53:11.512678+0000","last_clean":"2024-02-19T21:53:11.512678+0000","last_became_active":"2024-02-19T21:47:33.393708+0000","last_became_peered":"2024-02-19T21:47:33.393708+0000","last_unstale":"2024-02-19T21:53:11.512678+0000","last_undegraded":"2024-02-19T21:53:11.512678+0000","last_fullsized":"2024-02-19T21:53:11.512678+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:04.432733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:04.432733+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":80,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.496693+0000","last_change":"2024-02-19T21:49:54.492767+0000","last_active":"2024-02-19T21:53:25.496693+0000","last_peered":"2024-02-19T21:53:25.496693+0000","last_clean":"2024-02-19T21:53:25.496693+0000","last_became_active":"2024-02-19T21:49:54.491745+0000","last_became_peered":"2024-02-19T21:49:54.491745+0000","last_unstale":"2024-02-19T21:53:25.496693+0000","last_undegraded":"2024-02-19T21:53:25.496693+0000","last_fullsized":"2024-02-19T21:53:25.496693+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.232539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.232539+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1d","version":"471'24","reported_seq":432,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348694+0000","last_change":"2024-02-19T21:48:25.734661+0000","last_active":"2024-02-19T21:53:25.348694+0000","last_peered":"2024-02-19T21:53:25.348694+0000","last_clean":"2024-02-19T21:53:25.348694+0000","last_became_active":"2024-02-19T21:38:31.247067+0000","last_became_peered":"2024-02-19T21:38:31.247067+0000","last_unstale":"2024-02-19T21:53:25.348694+0000","last_undegraded":"2024-02-19T21:53:25.348694+0000","last_fullsized":"2024-02-19T21:53:25.348694+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'18","last_scrub_stamp":"2024-02-19T21:48:25.734591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.734591+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":33,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":460,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348480+0000","last_change":"2024-02-19T21:48:40.528082+0000","last_active":"2024-02-19T21:53:25.348480+0000","last_peered":"2024-02-19T21:53:25.348480+0000","last_clean":"2024-02-19T21:53:25.348480+0000","last_became_active":"2024-02-19T21:44:58.788307+0000","last_became_peered":"2024-02-19T21:44:58.788307+0000","last_unstale":"2024-02-19T21:53:25.348480+0000","last_undegraded":"2024-02-19T21:53:25.348480+0000","last_fullsized":"2024-02-19T21:53:25.348480+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:40.527970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:48:40.527970+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":466,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.513229+0000","last_change":"2024-02-19T21:48:11.557832+0000","last_active":"2024-02-19T21:53:11.513229+0000","last_peered":"2024-02-19T21:53:11.513229+0000","last_clean":"2024-02-19T21:53:11.513229+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:53:11.513229+0000","last_undegraded":"2024-02-19T21:53:11.513229+0000","last_fullsized":"2024-02-19T21:53:11.513229+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.557736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:17.913620+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.557736+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"470'46","reported_seq":147,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.001179+0000","last_change":"2024-02-19T21:49:08.332575+0000","last_active":"2024-02-19T21:53:25.001179+0000","last_peered":"2024-02-19T21:53:25.001179+0000","last_clean":"2024-02-19T21:53:25.001179+0000","last_became_active":"2024-02-19T21:49:08.331742+0000","last_became_peered":"2024-02-19T21:49:08.331742+0000","last_unstale":"2024-02-19T21:53:25.001179+0000","last_undegraded":"2024-02-19T21:53:25.001179+0000","last_fullsized":"2024-02-19T21:53:25.001179+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'34","last_scrub_stamp":"2024-02-19T21:45:49.728734+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:45:49.728734+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":480,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348317+0000","last_change":"2024-02-19T21:46:44.994389+0000","last_active":"2024-02-19T21:53:25.348317+0000","last_peered":"2024-02-19T21:53:25.348317+0000","last_clean":"2024-02-19T21:53:25.348317+0000","last_became_active":"2024-02-19T21:44:58.790669+0000","last_became_peered":"2024-02-19T21:44:58.790669+0000","last_unstale":"2024-02-19T21:53:25.348317+0000","last_undegraded":"2024-02-19T21:53:25.348317+0000","last_fullsized":"2024-02-19T21:53:25.348317+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.994296+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":414,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.512328+0000","last_change":"2024-02-19T21:49:08.330330+0000","last_active":"2024-02-19T21:53:11.512328+0000","last_peered":"2024-02-19T21:53:11.512328+0000","last_clean":"2024-02-19T21:53:11.512328+0000","last_became_active":"2024-02-19T21:49:08.329986+0000","last_became_peered":"2024-02-19T21:49:08.329986+0000","last_unstale":"2024-02-19T21:53:11.512328+0000","last_undegraded":"2024-02-19T21:53:11.512328+0000","last_fullsized":"2024-02-19T21:53:11.512328+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:07.091409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.091409+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"471'27","reported_seq":374,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.515347+0000","last_change":"2024-02-19T21:48:26.366639+0000","last_active":"2024-02-19T21:53:11.515347+0000","last_peered":"2024-02-19T21:53:11.515347+0000","last_clean":"2024-02-19T21:53:11.515347+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:53:11.515347+0000","last_undegraded":"2024-02-19T21:53:11.515347+0000","last_fullsized":"2024-02-19T21:53:11.515347+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:26.366563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.366563+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":36,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":340,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.496536+0000","last_change":"2024-02-19T21:51:22.461995+0000","last_active":"2024-02-19T21:53:25.496536+0000","last_peered":"2024-02-19T21:53:25.496536+0000","last_clean":"2024-02-19T21:53:25.496536+0000","last_became_active":"2024-02-19T21:51:22.461599+0000","last_became_peered":"2024-02-19T21:51:22.461599+0000","last_unstale":"2024-02-19T21:53:25.496536+0000","last_undegraded":"2024-02-19T21:53:25.496536+0000","last_fullsized":"2024-02-19T21:53:25.496536+0000","mapping_epoch":445,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":446,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:13.196112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:13.196112+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":479,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.529657+0000","last_change":"2024-02-19T21:49:54.491840+0000","last_active":"2024-02-19T21:53:25.529657+0000","last_peered":"2024-02-19T21:53:25.529657+0000","last_clean":"2024-02-19T21:53:25.529657+0000","last_became_active":"2024-02-19T21:49:54.491488+0000","last_became_peered":"2024-02-19T21:49:54.491488+0000","last_unstale":"2024-02-19T21:53:25.529657+0000","last_undegraded":"2024-02-19T21:53:25.529657+0000","last_fullsized":"2024-02-19T21:53:25.529657+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.803606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.803606+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"470'30","reported_seq":578,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.515467+0000","last_change":"2024-02-19T21:49:54.502402+0000","last_active":"2024-02-19T21:53:11.515467+0000","last_peered":"2024-02-19T21:53:11.515467+0000","last_clean":"2024-02-19T21:53:11.515467+0000","last_became_active":"2024-02-19T21:49:54.483748+0000","last_became_peered":"2024-02-19T21:49:54.483748+0000","last_unstale":"2024-02-19T21:53:11.515467+0000","last_undegraded":"2024-02-19T21:53:11.515467+0000","last_fullsized":"2024-02-19T21:53:11.515467+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:48:25.348437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.348437+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":398,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.513793+0000","last_change":"2024-02-19T21:49:08.328206+0000","last_active":"2024-02-19T21:53:11.513793+0000","last_peered":"2024-02-19T21:53:11.513793+0000","last_clean":"2024-02-19T21:53:11.513793+0000","last_became_active":"2024-02-19T21:49:08.327865+0000","last_became_peered":"2024-02-19T21:49:08.327865+0000","last_unstale":"2024-02-19T21:53:11.513793+0000","last_undegraded":"2024-02-19T21:53:11.513793+0000","last_fullsized":"2024-02-19T21:53:11.513793+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.230652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.230652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":459,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.496295+0000","last_change":"2024-02-19T21:48:22.171667+0000","last_active":"2024-02-19T21:53:25.496295+0000","last_peered":"2024-02-19T21:53:25.496295+0000","last_clean":"2024-02-19T21:53:25.496295+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:53:25.496295+0000","last_undegraded":"2024-02-19T21:53:25.496295+0000","last_fullsized":"2024-02-19T21:53:25.496295+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.171600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.171600+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":494,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.514934+0000","last_change":"2024-02-19T21:49:08.330636+0000","last_active":"2024-02-19T21:53:11.514934+0000","last_peered":"2024-02-19T21:53:11.514934+0000","last_clean":"2024-02-19T21:53:11.514934+0000","last_became_active":"2024-02-19T21:49:08.330293+0000","last_became_peered":"2024-02-19T21:49:08.330293+0000","last_unstale":"2024-02-19T21:53:11.514934+0000","last_undegraded":"2024-02-19T21:53:11.514934+0000","last_fullsized":"2024-02-19T21:53:11.514934+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:03.034839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:03.034839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"471'32","reported_seq":104,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.496067+0000","last_change":"2024-02-19T21:49:55.368481+0000","last_active":"2024-02-19T21:53:25.496067+0000","last_peered":"2024-02-19T21:53:25.496067+0000","last_clean":"2024-02-19T21:53:25.496067+0000","last_became_active":"2024-02-19T21:49:54.485438+0000","last_became_peered":"2024-02-19T21:49:54.485438+0000","last_unstale":"2024-02-19T21:53:25.496067+0000","last_undegraded":"2024-02-19T21:53:25.496067+0000","last_fullsized":"2024-02-19T21:53:25.496067+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"381'24","last_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_deep_scrub":"381'24","last_deep_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_clean_scrub_stamp":"2024-02-19T21:48:39.382725+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":36,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,5],"acting":[7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":487,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.496815+0000","last_change":"2024-02-19T21:49:17.193002+0000","last_active":"2024-02-19T21:53:25.496815+0000","last_peered":"2024-02-19T21:53:25.496815+0000","last_clean":"2024-02-19T21:53:25.496815+0000","last_became_active":"2024-02-19T21:49:08.333537+0000","last_became_peered":"2024-02-19T21:49:08.333537+0000","last_unstale":"2024-02-19T21:53:25.496815+0000","last_undegraded":"2024-02-19T21:53:25.496815+0000","last_fullsized":"2024-02-19T21:53:25.496815+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:59.339649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:45:59.339649+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":514,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.512394+0000","last_change":"2024-02-19T21:49:54.494561+0000","last_active":"2024-02-19T21:53:11.512394+0000","last_peered":"2024-02-19T21:53:11.512394+0000","last_clean":"2024-02-19T21:53:11.512394+0000","last_became_active":"2024-02-19T21:49:54.494146+0000","last_became_peered":"2024-02-19T21:49:54.494146+0000","last_unstale":"2024-02-19T21:53:11.512394+0000","last_undegraded":"2024-02-19T21:53:11.512394+0000","last_fullsized":"2024-02-19T21:53:11.512394+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.560066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":489,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.530450+0000","last_change":"2024-02-19T21:49:09.765641+0000","last_active":"2024-02-19T21:53:25.530450+0000","last_peered":"2024-02-19T21:53:25.530450+0000","last_clean":"2024-02-19T21:53:25.530450+0000","last_became_active":"2024-02-19T21:49:08.331308+0000","last_became_peered":"2024-02-19T21:49:08.331308+0000","last_unstale":"2024-02-19T21:53:25.530450+0000","last_undegraded":"2024-02-19T21:53:25.530450+0000","last_fullsized":"2024-02-19T21:53:25.530450+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.765568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.765568+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"470'12","reported_seq":183,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.349308+0000","last_change":"2024-02-19T21:47:33.577363+0000","last_active":"2024-02-19T21:53:25.349308+0000","last_peered":"2024-02-19T21:53:25.349308+0000","last_clean":"2024-02-19T21:53:25.349308+0000","last_became_active":"2024-02-19T21:47:33.395217+0000","last_became_peered":"2024-02-19T21:47:33.395217+0000","last_unstale":"2024-02-19T21:53:25.349308+0000","last_undegraded":"2024-02-19T21:53:25.349308+0000","last_fullsized":"2024-02-19T21:53:25.349308+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'8","last_scrub_stamp":"2024-02-19T21:46:47.761677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.761677+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":398,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.513395+0000","last_change":"2024-02-19T21:49:08.918163+0000","last_active":"2024-02-19T21:53:11.513395+0000","last_peered":"2024-02-19T21:53:11.513395+0000","last_clean":"2024-02-19T21:53:11.513395+0000","last_became_active":"2024-02-19T21:49:08.328416+0000","last_became_peered":"2024-02-19T21:49:08.328416+0000","last_unstale":"2024-02-19T21:53:11.513395+0000","last_undegraded":"2024-02-19T21:53:11.513395+0000","last_fullsized":"2024-02-19T21:53:11.513395+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.918083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.918083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":478,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348592+0000","last_change":"2024-02-19T21:49:54.480716+0000","last_active":"2024-02-19T21:53:25.348592+0000","last_peered":"2024-02-19T21:53:25.348592+0000","last_clean":"2024-02-19T21:53:25.348592+0000","last_became_active":"2024-02-19T21:49:54.480368+0000","last_became_peered":"2024-02-19T21:49:54.480368+0000","last_unstale":"2024-02-19T21:53:25.348592+0000","last_undegraded":"2024-02-19T21:53:25.348592+0000","last_fullsized":"2024-02-19T21:53:25.348592+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:19.596775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:19.596775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":462,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348430+0000","last_change":"2024-02-19T21:49:05.012463+0000","last_active":"2024-02-19T21:53:25.348430+0000","last_peered":"2024-02-19T21:53:25.348430+0000","last_clean":"2024-02-19T21:53:25.348430+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:53:25.348430+0000","last_undegraded":"2024-02-19T21:53:25.348430+0000","last_fullsized":"2024-02-19T21:53:25.348430+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.012395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.012395+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"470'27","reported_seq":521,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348231+0000","last_change":"2024-02-19T21:48:38.529106+0000","last_active":"2024-02-19T21:53:25.348231+0000","last_peered":"2024-02-19T21:53:25.348231+0000","last_clean":"2024-02-19T21:53:25.348231+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:53:25.348231+0000","last_undegraded":"2024-02-19T21:53:25.348231+0000","last_fullsized":"2024-02-19T21:53:25.348231+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:38.528977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.528977+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":463,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.517216+0000","last_change":"2024-02-19T21:46:06.096531+0000","last_active":"2024-02-19T21:53:11.517216+0000","last_peered":"2024-02-19T21:53:11.517216+0000","last_clean":"2024-02-19T21:53:11.517216+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:53:11.517216+0000","last_undegraded":"2024-02-19T21:53:11.517216+0000","last_fullsized":"2024-02-19T21:53:11.517216+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.096422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":274,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.513189+0000","last_change":"2024-02-19T21:48:38.391532+0000","last_active":"2024-02-19T21:53:11.513189+0000","last_peered":"2024-02-19T21:53:11.513189+0000","last_clean":"2024-02-19T21:53:11.513189+0000","last_became_active":"2024-02-19T21:47:33.395085+0000","last_became_peered":"2024-02-19T21:47:33.395085+0000","last_unstale":"2024-02-19T21:53:11.513189+0000","last_undegraded":"2024-02-19T21:53:11.513189+0000","last_fullsized":"2024-02-19T21:53:11.513189+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:38.391435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.391435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":475,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.511863+0000","last_change":"2024-02-19T21:48:14.600378+0000","last_active":"2024-02-19T21:53:11.511863+0000","last_peered":"2024-02-19T21:53:11.511863+0000","last_clean":"2024-02-19T21:53:11.511863+0000","last_became_active":"2024-02-19T21:47:33.393932+0000","last_became_peered":"2024-02-19T21:47:33.393932+0000","last_unstale":"2024-02-19T21:53:11.511863+0000","last_undegraded":"2024-02-19T21:53:11.511863+0000","last_fullsized":"2024-02-19T21:53:11.511863+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:14.600285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.600285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"470'21","reported_seq":540,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348436+0000","last_change":"2024-02-19T21:49:08.334199+0000","last_active":"2024-02-19T21:53:25.348436+0000","last_peered":"2024-02-19T21:53:25.348436+0000","last_clean":"2024-02-19T21:53:25.348436+0000","last_became_active":"2024-02-19T21:49:08.333872+0000","last_became_peered":"2024-02-19T21:49:08.333872+0000","last_unstale":"2024-02-19T21:53:25.348436+0000","last_undegraded":"2024-02-19T21:53:25.348436+0000","last_fullsized":"2024-02-19T21:53:25.348436+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:45:08.678669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:08.678669+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":443,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348429+0000","last_change":"2024-02-19T21:49:08.330114+0000","last_active":"2024-02-19T21:53:25.348429+0000","last_peered":"2024-02-19T21:53:25.348429+0000","last_clean":"2024-02-19T21:53:25.348429+0000","last_became_active":"2024-02-19T21:49:08.329770+0000","last_became_peered":"2024-02-19T21:49:08.329770+0000","last_unstale":"2024-02-19T21:53:25.348429+0000","last_undegraded":"2024-02-19T21:53:25.348429+0000","last_fullsized":"2024-02-19T21:53:25.348429+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:08.983923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.983923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"415'17","reported_seq":127,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.497531+0000","last_change":"2024-02-19T21:50:49.705247+0000","last_active":"2024-02-19T21:53:25.497531+0000","last_peered":"2024-02-19T21:53:25.497531+0000","last_clean":"2024-02-19T21:53:25.497531+0000","last_became_active":"2024-02-19T21:49:54.486304+0000","last_became_peered":"2024-02-19T21:49:54.486304+0000","last_unstale":"2024-02-19T21:53:25.497531+0000","last_undegraded":"2024-02-19T21:53:25.497531+0000","last_fullsized":"2024-02-19T21:53:25.497531+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"199'13","last_scrub_stamp":"2024-02-19T21:45:05.721709+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:45:05.721709+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":485,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.514001+0000","last_change":"2024-02-19T21:49:54.484516+0000","last_active":"2024-02-19T21:53:11.514001+0000","last_peered":"2024-02-19T21:53:11.514001+0000","last_clean":"2024-02-19T21:53:11.514001+0000","last_became_active":"2024-02-19T21:49:54.483689+0000","last_became_peered":"2024-02-19T21:49:54.483689+0000","last_unstale":"2024-02-19T21:53:11.514001+0000","last_undegraded":"2024-02-19T21:53:11.514001+0000","last_fullsized":"2024-02-19T21:53:11.514001+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_clean_scrub_stamp":"2024-02-19T21:45:20.157478+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"470'25","reported_seq":516,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.530302+0000","last_change":"2024-02-19T21:48:27.720048+0000","last_active":"2024-02-19T21:53:25.530302+0000","last_peered":"2024-02-19T21:53:25.530302+0000","last_clean":"2024-02-19T21:53:25.530302+0000","last_became_active":"2024-02-19T21:47:33.398295+0000","last_became_peered":"2024-02-19T21:47:33.398295+0000","last_unstale":"2024-02-19T21:53:25.530302+0000","last_undegraded":"2024-02-19T21:53:25.530302+0000","last_fullsized":"2024-02-19T21:53:25.530302+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:27.719954+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:48:27.719954+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":202,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.515219+0000","last_change":"2024-02-19T21:49:54.484392+0000","last_active":"2024-02-19T21:53:11.515219+0000","last_peered":"2024-02-19T21:53:11.515219+0000","last_clean":"2024-02-19T21:53:11.515219+0000","last_became_active":"2024-02-19T21:49:54.484049+0000","last_became_peered":"2024-02-19T21:49:54.484049+0000","last_unstale":"2024-02-19T21:53:11.515219+0000","last_undegraded":"2024-02-19T21:53:11.515219+0000","last_fullsized":"2024-02-19T21:53:11.515219+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.121769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.121769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":719,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:27.119531+0000","last_change":"2024-02-19T21:48:38.723220+0000","last_active":"2024-02-19T21:53:27.119531+0000","last_peered":"2024-02-19T21:53:27.119531+0000","last_clean":"2024-02-19T21:53:27.119531+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:53:27.119531+0000","last_undegraded":"2024-02-19T21:53:27.119531+0000","last_fullsized":"2024-02-19T21:53:27.119531+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:48:38.723151+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.723151+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":490,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.529854+0000","last_change":"2024-02-19T21:49:54.485462+0000","last_active":"2024-02-19T21:53:25.529854+0000","last_peered":"2024-02-19T21:53:25.529854+0000","last_clean":"2024-02-19T21:53:25.529854+0000","last_became_active":"2024-02-19T21:49:54.485121+0000","last_became_peered":"2024-02-19T21:49:54.485121+0000","last_unstale":"2024-02-19T21:53:25.529854+0000","last_undegraded":"2024-02-19T21:53:25.529854+0000","last_fullsized":"2024-02-19T21:53:25.529854+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:07.724097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:49:07.724097+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"470'35","reported_seq":384,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348973+0000","last_change":"2024-02-19T21:49:08.335077+0000","last_active":"2024-02-19T21:53:25.348973+0000","last_peered":"2024-02-19T21:53:25.348973+0000","last_clean":"2024-02-19T21:53:25.348973+0000","last_became_active":"2024-02-19T21:49:08.334061+0000","last_became_peered":"2024-02-19T21:49:08.334061+0000","last_unstale":"2024-02-19T21:53:25.348973+0000","last_undegraded":"2024-02-19T21:53:25.348973+0000","last_fullsized":"2024-02-19T21:53:25.348973+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'25","last_scrub_stamp":"2024-02-19T21:46:07.553690+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:46:07.553690+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":459,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.496289+0000","last_change":"2024-02-19T21:48:21.256471+0000","last_active":"2024-02-19T21:53:25.496289+0000","last_peered":"2024-02-19T21:53:25.496289+0000","last_clean":"2024-02-19T21:53:25.496289+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:53:25.496289+0000","last_undegraded":"2024-02-19T21:53:25.496289+0000","last_fullsized":"2024-02-19T21:53:25.496289+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.256358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:27.036737+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.256358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":465,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.512134+0000","last_change":"2024-02-19T21:46:35.035136+0000","last_active":"2024-02-19T21:53:11.512134+0000","last_peered":"2024-02-19T21:53:11.512134+0000","last_clean":"2024-02-19T21:53:11.512134+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:53:11.512134+0000","last_undegraded":"2024-02-19T21:53:11.512134+0000","last_fullsized":"2024-02-19T21:53:11.512134+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:35.035042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:35.035042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"470'18","reported_seq":97,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.496437+0000","last_change":"2024-02-19T21:50:49.700758+0000","last_active":"2024-02-19T21:53:25.496437+0000","last_peered":"2024-02-19T21:53:25.496437+0000","last_clean":"2024-02-19T21:53:25.496437+0000","last_became_active":"2024-02-19T21:49:54.478094+0000","last_became_peered":"2024-02-19T21:49:54.478094+0000","last_unstale":"2024-02-19T21:53:25.496437+0000","last_undegraded":"2024-02-19T21:53:25.496437+0000","last_fullsized":"2024-02-19T21:53:25.496437+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'12","last_scrub_stamp":"2024-02-19T21:49:08.912638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.912638+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":23,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":112,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.001277+0000","last_change":"2024-02-19T21:49:08.332757+0000","last_active":"2024-02-19T21:53:25.001277+0000","last_peered":"2024-02-19T21:53:25.001277+0000","last_clean":"2024-02-19T21:53:25.001277+0000","last_became_active":"2024-02-19T21:49:08.332176+0000","last_became_peered":"2024-02-19T21:49:08.332176+0000","last_unstale":"2024-02-19T21:53:25.001277+0000","last_undegraded":"2024-02-19T21:53:25.001277+0000","last_fullsized":"2024-02-19T21:53:25.001277+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:47:01.365477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:47:01.365477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":112,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.000454+0000","last_change":"2024-02-19T21:49:08.328632+0000","last_active":"2024-02-19T21:53:25.000454+0000","last_peered":"2024-02-19T21:53:25.000454+0000","last_clean":"2024-02-19T21:53:25.000454+0000","last_became_active":"2024-02-19T21:49:08.327826+0000","last_became_peered":"2024-02-19T21:49:08.327826+0000","last_unstale":"2024-02-19T21:53:25.000454+0000","last_undegraded":"2024-02-19T21:53:25.000454+0000","last_fullsized":"2024-02-19T21:53:25.000454+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:09.645607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:44:09.645607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"470'21","reported_seq":616,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:21.186229+0000","last_change":"2024-02-19T21:53:21.186229+0000","last_active":"2024-02-19T21:53:21.186229+0000","last_peered":"2024-02-19T21:53:21.186229+0000","last_clean":"2024-02-19T21:53:21.186229+0000","last_became_active":"2024-02-19T21:49:54.483578+0000","last_became_peered":"2024-02-19T21:49:54.483578+0000","last_unstale":"2024-02-19T21:53:21.186229+0000","last_undegraded":"2024-02-19T21:53:21.186229+0000","last_fullsized":"2024-02-19T21:53:21.186229+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:44:53.072746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:44:53.072746+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":80,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.496588+0000","last_change":"2024-02-19T21:49:54.492844+0000","last_active":"2024-02-19T21:53:25.496588+0000","last_peered":"2024-02-19T21:53:25.496588+0000","last_clean":"2024-02-19T21:53:25.496588+0000","last_became_active":"2024-02-19T21:49:54.492156+0000","last_became_peered":"2024-02-19T21:49:54.492156+0000","last_unstale":"2024-02-19T21:53:25.496588+0000","last_undegraded":"2024-02-19T21:53:25.496588+0000","last_fullsized":"2024-02-19T21:53:25.496588+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:04.692807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.692807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"378'4","reported_seq":499,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348515+0000","last_change":"2024-02-19T21:48:28.510929+0000","last_active":"2024-02-19T21:53:25.348515+0000","last_peered":"2024-02-19T21:53:25.348515+0000","last_clean":"2024-02-19T21:53:25.348515+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:53:25.348515+0000","last_undegraded":"2024-02-19T21:53:25.348515+0000","last_fullsized":"2024-02-19T21:53:25.348515+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"378'4","last_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_deep_scrub":"378'4","last_deep_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.510849+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"470'29","reported_seq":355,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348305+0000","last_change":"2024-02-19T21:48:22.519465+0000","last_active":"2024-02-19T21:53:25.348305+0000","last_peered":"2024-02-19T21:53:25.348305+0000","last_clean":"2024-02-19T21:53:25.348305+0000","last_became_active":"2024-02-19T21:47:46.252085+0000","last_became_peered":"2024-02-19T21:47:46.252085+0000","last_unstale":"2024-02-19T21:53:25.348305+0000","last_undegraded":"2024-02-19T21:53:25.348305+0000","last_fullsized":"2024-02-19T21:53:25.348305+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'23","last_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_deep_scrub":"200'23","last_deep_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.519381+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":33,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6],"acting":[4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":112,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.000533+0000","last_change":"2024-02-19T21:49:08.328855+0000","last_active":"2024-02-19T21:53:25.000533+0000","last_peered":"2024-02-19T21:53:25.000533+0000","last_clean":"2024-02-19T21:53:25.000533+0000","last_became_active":"2024-02-19T21:49:08.328237+0000","last_became_peered":"2024-02-19T21:49:08.328237+0000","last_unstale":"2024-02-19T21:53:25.000533+0000","last_undegraded":"2024-02-19T21:53:25.000533+0000","last_fullsized":"2024-02-19T21:53:25.000533+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:58.047556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:58.047556+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":512,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.517273+0000","last_change":"2024-02-19T21:49:08.328019+0000","last_active":"2024-02-19T21:53:11.517273+0000","last_peered":"2024-02-19T21:53:11.517273+0000","last_clean":"2024-02-19T21:53:11.517273+0000","last_became_active":"2024-02-19T21:49:08.327581+0000","last_became_peered":"2024-02-19T21:49:08.327581+0000","last_unstale":"2024-02-19T21:53:11.517273+0000","last_undegraded":"2024-02-19T21:53:11.517273+0000","last_fullsized":"2024-02-19T21:53:11.517273+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:22.180593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:45:22.180593+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5],"acting":[0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":460,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348848+0000","last_change":"2024-02-19T21:48:37.789514+0000","last_active":"2024-02-19T21:53:25.348848+0000","last_peered":"2024-02-19T21:53:25.348848+0000","last_clean":"2024-02-19T21:53:25.348848+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:53:25.348848+0000","last_undegraded":"2024-02-19T21:53:25.348848+0000","last_fullsized":"2024-02-19T21:53:25.348848+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:37.789400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:37.789400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"470'30","reported_seq":381,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348515+0000","last_change":"2024-02-19T21:45:57.877936+0000","last_active":"2024-02-19T21:53:25.348515+0000","last_peered":"2024-02-19T21:53:25.348515+0000","last_clean":"2024-02-19T21:53:25.348515+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:53:25.348515+0000","last_undegraded":"2024-02-19T21:53:25.348515+0000","last_fullsized":"2024-02-19T21:53:25.348515+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:45:57.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:57.877856+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":722,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.653416+0000","last_change":"2024-02-19T21:49:01.011149+0000","last_active":"2024-02-19T21:53:25.653416+0000","last_peered":"2024-02-19T21:53:25.653416+0000","last_clean":"2024-02-19T21:53:25.653416+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:53:25.653416+0000","last_undegraded":"2024-02-19T21:53:25.653416+0000","last_fullsized":"2024-02-19T21:53:25.653416+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:49:01.011078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:49:01.011078+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":409,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348813+0000","last_change":"2024-02-19T21:48:33.478821+0000","last_active":"2024-02-19T21:53:25.348813+0000","last_peered":"2024-02-19T21:53:25.348813+0000","last_clean":"2024-02-19T21:53:25.348813+0000","last_became_active":"2024-02-19T21:44:56.149476+0000","last_became_peered":"2024-02-19T21:44:56.149476+0000","last_unstale":"2024-02-19T21:53:25.348813+0000","last_undegraded":"2024-02-19T21:53:25.348813+0000","last_fullsized":"2024-02-19T21:53:25.348813+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:33.478715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:48:33.478715+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":469,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.529966+0000","last_change":"2024-02-19T21:46:41.834315+0000","last_active":"2024-02-19T21:53:25.529966+0000","last_peered":"2024-02-19T21:53:25.529966+0000","last_clean":"2024-02-19T21:53:25.529966+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:53:25.529966+0000","last_undegraded":"2024-02-19T21:53:25.529966+0000","last_fullsized":"2024-02-19T21:53:25.529966+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:41.834246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:46:41.834246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"470'58","reported_seq":932,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:27.119605+0000","last_change":"2024-02-19T21:49:08.335296+0000","last_active":"2024-02-19T21:53:27.119605+0000","last_peered":"2024-02-19T21:53:27.119605+0000","last_clean":"2024-02-19T21:53:27.119605+0000","last_became_active":"2024-02-19T21:49:08.334527+0000","last_became_peered":"2024-02-19T21:49:08.334527+0000","last_unstale":"2024-02-19T21:53:27.119605+0000","last_undegraded":"2024-02-19T21:53:27.119605+0000","last_fullsized":"2024-02-19T21:53:27.119605+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'43","last_scrub_stamp":"2024-02-19T21:45:04.755444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.755444+0000","log_size":58,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":50,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":454,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.515458+0000","last_change":"2024-02-19T21:46:45.252437+0000","last_active":"2024-02-19T21:53:11.515458+0000","last_peered":"2024-02-19T21:53:11.515458+0000","last_clean":"2024-02-19T21:53:11.515458+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:53:11.515458+0000","last_undegraded":"2024-02-19T21:53:11.515458+0000","last_fullsized":"2024-02-19T21:53:11.515458+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.252344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.252344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":483,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.496430+0000","last_change":"2024-02-19T21:49:09.227437+0000","last_active":"2024-02-19T21:53:25.496430+0000","last_peered":"2024-02-19T21:53:25.496430+0000","last_clean":"2024-02-19T21:53:25.496430+0000","last_became_active":"2024-02-19T21:49:08.328437+0000","last_became_peered":"2024-02-19T21:49:08.328437+0000","last_unstale":"2024-02-19T21:53:25.496430+0000","last_undegraded":"2024-02-19T21:53:25.496430+0000","last_fullsized":"2024-02-19T21:53:25.496430+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.227355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.227355+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'6","reported_seq":1849,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:29.925771+0000","last_change":"2024-02-19T21:53:23.972462+0000","last_active":"2024-02-19T21:53:29.925771+0000","last_peered":"2024-02-19T21:53:29.925771+0000","last_clean":"2024-02-19T21:53:29.925771+0000","last_became_active":"2024-02-19T21:49:08.331108+0000","last_became_peered":"2024-02-19T21:49:08.331108+0000","last_unstale":"2024-02-19T21:53:29.925771+0000","last_undegraded":"2024-02-19T21:53:29.925771+0000","last_fullsized":"2024-02-19T21:53:29.925771+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_clean_scrub_stamp":"2024-02-19T21:44:13.678341+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1246,"num_read_kb":1241,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":112,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.000990+0000","last_change":"2024-02-19T21:49:08.329710+0000","last_active":"2024-02-19T21:53:25.000990+0000","last_peered":"2024-02-19T21:53:25.000990+0000","last_clean":"2024-02-19T21:53:25.000990+0000","last_became_active":"2024-02-19T21:49:08.329378+0000","last_became_peered":"2024-02-19T21:49:08.329378+0000","last_unstale":"2024-02-19T21:53:25.000990+0000","last_undegraded":"2024-02-19T21:53:25.000990+0000","last_fullsized":"2024-02-19T21:53:25.000990+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:55.195394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.195394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"470'21","reported_seq":523,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348889+0000","last_change":"2024-02-19T21:48:14.878933+0000","last_active":"2024-02-19T21:53:25.348889+0000","last_peered":"2024-02-19T21:53:25.348889+0000","last_clean":"2024-02-19T21:53:25.348889+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:53:25.348889+0000","last_undegraded":"2024-02-19T21:53:25.348889+0000","last_fullsized":"2024-02-19T21:53:25.348889+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'17","last_scrub_stamp":"2024-02-19T21:48:14.878857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.878857+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":31,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":112,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.001563+0000","last_change":"2024-02-19T21:49:08.325478+0000","last_active":"2024-02-19T21:53:25.001563+0000","last_peered":"2024-02-19T21:53:25.001563+0000","last_clean":"2024-02-19T21:53:25.001563+0000","last_became_active":"2024-02-19T21:49:08.325127+0000","last_became_peered":"2024-02-19T21:49:08.325127+0000","last_unstale":"2024-02-19T21:53:25.001563+0000","last_undegraded":"2024-02-19T21:53:25.001563+0000","last_fullsized":"2024-02-19T21:53:25.001563+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:10.871111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:10.871111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":486,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.529463+0000","last_change":"2024-02-19T21:47:33.400407+0000","last_active":"2024-02-19T21:53:25.529463+0000","last_peered":"2024-02-19T21:53:25.529463+0000","last_clean":"2024-02-19T21:53:25.529463+0000","last_became_active":"2024-02-19T21:47:33.400075+0000","last_became_peered":"2024-02-19T21:47:33.400075+0000","last_unstale":"2024-02-19T21:53:25.529463+0000","last_undegraded":"2024-02-19T21:53:25.529463+0000","last_fullsized":"2024-02-19T21:53:25.529463+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.035136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":364,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.530129+0000","last_change":"2024-02-19T21:49:05.746443+0000","last_active":"2024-02-19T21:53:25.530129+0000","last_peered":"2024-02-19T21:53:25.530129+0000","last_clean":"2024-02-19T21:53:25.530129+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:53:25.530129+0000","last_undegraded":"2024-02-19T21:53:25.530129+0000","last_fullsized":"2024-02-19T21:53:25.530129+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.746358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.746358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":516,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.530021+0000","last_change":"2024-02-19T21:49:54.485252+0000","last_active":"2024-02-19T21:53:25.530021+0000","last_peered":"2024-02-19T21:53:25.530021+0000","last_clean":"2024-02-19T21:53:25.530021+0000","last_became_active":"2024-02-19T21:49:54.484956+0000","last_became_peered":"2024-02-19T21:49:54.484956+0000","last_unstale":"2024-02-19T21:53:25.530021+0000","last_undegraded":"2024-02-19T21:53:25.530021+0000","last_fullsized":"2024-02-19T21:53:25.530021+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:07.901205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:07.901205+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":80,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.495909+0000","last_change":"2024-02-19T21:49:54.483990+0000","last_active":"2024-02-19T21:53:25.495909+0000","last_peered":"2024-02-19T21:53:25.495909+0000","last_clean":"2024-02-19T21:53:25.495909+0000","last_became_active":"2024-02-19T21:49:54.483637+0000","last_became_peered":"2024-02-19T21:49:54.483637+0000","last_unstale":"2024-02-19T21:53:25.495909+0000","last_undegraded":"2024-02-19T21:53:25.495909+0000","last_fullsized":"2024-02-19T21:53:25.495909+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.190177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.190177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"470'45","reported_seq":526,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.512779+0000","last_change":"2024-02-19T21:46:47.970066+0000","last_active":"2024-02-19T21:53:11.512779+0000","last_peered":"2024-02-19T21:53:11.512779+0000","last_clean":"2024-02-19T21:53:11.512779+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:53:11.512779+0000","last_undegraded":"2024-02-19T21:53:11.512779+0000","last_fullsized":"2024-02-19T21:53:11.512779+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'33","last_scrub_stamp":"2024-02-19T21:46:47.969961+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.969961+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":51,"num_write":37,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":80,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.496781+0000","last_change":"2024-02-19T21:49:54.478276+0000","last_active":"2024-02-19T21:53:25.496781+0000","last_peered":"2024-02-19T21:53:25.496781+0000","last_clean":"2024-02-19T21:53:25.496781+0000","last_became_active":"2024-02-19T21:49:54.477947+0000","last_became_peered":"2024-02-19T21:49:54.477947+0000","last_unstale":"2024-02-19T21:53:25.496781+0000","last_undegraded":"2024-02-19T21:53:25.496781+0000","last_fullsized":"2024-02-19T21:53:25.496781+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:57.754453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:44:57.754453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":458,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.349137+0000","last_change":"2024-02-19T21:45:47.723650+0000","last_active":"2024-02-19T21:53:25.349137+0000","last_peered":"2024-02-19T21:53:25.349137+0000","last_clean":"2024-02-19T21:53:25.349137+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:53:25.349137+0000","last_undegraded":"2024-02-19T21:53:25.349137+0000","last_fullsized":"2024-02-19T21:53:25.349137+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.723550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.723550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":467,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.513317+0000","last_change":"2024-02-19T21:45:51.243726+0000","last_active":"2024-02-19T21:53:11.513317+0000","last_peered":"2024-02-19T21:53:11.513317+0000","last_clean":"2024-02-19T21:53:11.513317+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:53:11.513317+0000","last_undegraded":"2024-02-19T21:53:11.513317+0000","last_fullsized":"2024-02-19T21:53:11.513317+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:51.243656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:51.243656+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":485,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.496090+0000","last_change":"2024-02-19T21:48:23.218358+0000","last_active":"2024-02-19T21:53:25.496090+0000","last_peered":"2024-02-19T21:53:25.496090+0000","last_clean":"2024-02-19T21:53:25.496090+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:53:25.496090+0000","last_undegraded":"2024-02-19T21:53:25.496090+0000","last_fullsized":"2024-02-19T21:53:25.496090+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:23.218282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.218282+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"470'42","reported_seq":629,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.515286+0000","last_change":"2024-02-19T21:49:08.330490+0000","last_active":"2024-02-19T21:53:11.515286+0000","last_peered":"2024-02-19T21:53:11.515286+0000","last_clean":"2024-02-19T21:53:11.515286+0000","last_became_active":"2024-02-19T21:49:08.329761+0000","last_became_peered":"2024-02-19T21:49:08.329761+0000","last_unstale":"2024-02-19T21:53:11.515286+0000","last_undegraded":"2024-02-19T21:53:11.515286+0000","last_fullsized":"2024-02-19T21:53:11.515286+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'30","last_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_deep_scrub":"324'30","last_deep_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.110965+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":48,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":470,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.530634+0000","last_change":"2024-02-19T21:45:09.918263+0000","last_active":"2024-02-19T21:53:25.530634+0000","last_peered":"2024-02-19T21:53:25.530634+0000","last_clean":"2024-02-19T21:53:25.530634+0000","last_became_active":"2024-02-19T21:44:42.624782+0000","last_became_peered":"2024-02-19T21:44:42.624782+0000","last_unstale":"2024-02-19T21:53:25.530634+0000","last_undegraded":"2024-02-19T21:53:25.530634+0000","last_fullsized":"2024-02-19T21:53:25.530634+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":295,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_clean_scrub_stamp":"2024-02-19T21:45:09.918170+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":491,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348284+0000","last_change":"2024-02-19T21:49:08.331080+0000","last_active":"2024-02-19T21:53:25.348284+0000","last_peered":"2024-02-19T21:53:25.348284+0000","last_clean":"2024-02-19T21:53:25.348284+0000","last_became_active":"2024-02-19T21:49:08.330648+0000","last_became_peered":"2024-02-19T21:49:08.330648+0000","last_unstale":"2024-02-19T21:53:25.348284+0000","last_undegraded":"2024-02-19T21:53:25.348284+0000","last_fullsized":"2024-02-19T21:53:25.348284+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:44:55.803876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:44:55.803876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":461,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.496509+0000","last_change":"2024-02-19T21:48:31.320229+0000","last_active":"2024-02-19T21:53:25.496509+0000","last_peered":"2024-02-19T21:53:25.496509+0000","last_clean":"2024-02-19T21:53:25.496509+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:53:25.496509+0000","last_undegraded":"2024-02-19T21:53:25.496509+0000","last_fullsized":"2024-02-19T21:53:25.496509+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:31.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:45.017696+0000","last_clean_scrub_stamp":"2024-02-19T21:48:31.320133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"470'47","reported_seq":530,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.513927+0000","last_change":"2024-02-19T21:45:14.173212+0000","last_active":"2024-02-19T21:53:11.513927+0000","last_peered":"2024-02-19T21:53:11.513927+0000","last_clean":"2024-02-19T21:53:11.513927+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:53:11.513927+0000","last_undegraded":"2024-02-19T21:53:11.513927+0000","last_fullsized":"2024-02-19T21:53:11.513927+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'37","last_scrub_stamp":"2024-02-19T21:45:14.173134+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:45:14.173134+0000","log_size":47,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":55,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":459,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.513646+0000","last_change":"2024-02-19T21:46:48.988928+0000","last_active":"2024-02-19T21:53:11.513646+0000","last_peered":"2024-02-19T21:53:11.513646+0000","last_clean":"2024-02-19T21:53:11.513646+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:53:11.513646+0000","last_undegraded":"2024-02-19T21:53:11.513646+0000","last_fullsized":"2024-02-19T21:53:11.513646+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:48.988836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.988836+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":204,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348827+0000","last_change":"2024-02-19T21:49:08.326461+0000","last_active":"2024-02-19T21:53:25.348827+0000","last_peered":"2024-02-19T21:53:25.348827+0000","last_clean":"2024-02-19T21:53:25.348827+0000","last_became_active":"2024-02-19T21:49:08.326106+0000","last_became_peered":"2024-02-19T21:49:08.326106+0000","last_unstale":"2024-02-19T21:53:25.348827+0000","last_undegraded":"2024-02-19T21:53:25.348827+0000","last_fullsized":"2024-02-19T21:53:25.348827+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.080896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.080896+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":464,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348744+0000","last_change":"2024-02-19T21:48:11.879787+0000","last_active":"2024-02-19T21:53:25.348744+0000","last_peered":"2024-02-19T21:53:25.348744+0000","last_clean":"2024-02-19T21:53:25.348744+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:53:25.348744+0000","last_undegraded":"2024-02-19T21:53:25.348744+0000","last_fullsized":"2024-02-19T21:53:25.348744+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.879687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.879687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"470'50","reported_seq":116,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.496193+0000","last_change":"2024-02-19T21:49:55.861358+0000","last_active":"2024-02-19T21:53:25.496193+0000","last_peered":"2024-02-19T21:53:25.496193+0000","last_clean":"2024-02-19T21:53:25.496193+0000","last_became_active":"2024-02-19T21:49:54.480413+0000","last_became_peered":"2024-02-19T21:49:54.480413+0000","last_unstale":"2024-02-19T21:53:25.496193+0000","last_undegraded":"2024-02-19T21:53:25.496193+0000","last_fullsized":"2024-02-19T21:53:25.496193+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":415,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'38","last_scrub_stamp":"2024-02-19T21:49:05.923627+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.923627+0000","log_size":50,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":57,"num_write":44,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":355,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.512584+0000","last_change":"2024-02-19T21:49:54.495134+0000","last_active":"2024-02-19T21:53:11.512584+0000","last_peered":"2024-02-19T21:53:11.512584+0000","last_clean":"2024-02-19T21:53:11.512584+0000","last_became_active":"2024-02-19T21:49:54.494802+0000","last_became_peered":"2024-02-19T21:49:54.494802+0000","last_unstale":"2024-02-19T21:53:11.512584+0000","last_undegraded":"2024-02-19T21:53:11.512584+0000","last_fullsized":"2024-02-19T21:53:11.512584+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:10.578408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:10.578408+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":490,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.496806+0000","last_change":"2024-02-19T21:49:08.328862+0000","last_active":"2024-02-19T21:53:25.496806+0000","last_peered":"2024-02-19T21:53:25.496806+0000","last_clean":"2024-02-19T21:53:25.496806+0000","last_became_active":"2024-02-19T21:49:08.328529+0000","last_became_peered":"2024-02-19T21:49:08.328529+0000","last_unstale":"2024-02-19T21:53:25.496806+0000","last_undegraded":"2024-02-19T21:53:25.496806+0000","last_fullsized":"2024-02-19T21:53:25.496806+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:49.110117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:49.110117+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.515082+0000","last_change":"2024-02-19T21:49:54.493367+0000","last_active":"2024-02-19T21:53:11.515082+0000","last_peered":"2024-02-19T21:53:11.515082+0000","last_clean":"2024-02-19T21:53:11.515082+0000","last_became_active":"2024-02-19T21:49:54.493041+0000","last_became_peered":"2024-02-19T21:49:54.493041+0000","last_unstale":"2024-02-19T21:53:11.515082+0000","last_undegraded":"2024-02-19T21:53:11.515082+0000","last_fullsized":"2024-02-19T21:53:11.515082+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.972369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.972369+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"470'42","reported_seq":352,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348211+0000","last_change":"2024-02-19T21:49:08.330818+0000","last_active":"2024-02-19T21:53:25.348211+0000","last_peered":"2024-02-19T21:53:25.348211+0000","last_clean":"2024-02-19T21:53:25.348211+0000","last_became_active":"2024-02-19T21:49:08.330477+0000","last_became_peered":"2024-02-19T21:49:08.330477+0000","last_unstale":"2024-02-19T21:53:25.348211+0000","last_undegraded":"2024-02-19T21:53:25.348211+0000","last_fullsized":"2024-02-19T21:53:25.348211+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'28","last_scrub_stamp":"2024-02-19T21:45:55.998646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:55.998646+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":573,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:27.119562+0000","last_change":"2024-02-19T21:45:50.742626+0000","last_active":"2024-02-19T21:53:27.119562+0000","last_peered":"2024-02-19T21:53:27.119562+0000","last_clean":"2024-02-19T21:53:27.119562+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:53:27.119562+0000","last_undegraded":"2024-02-19T21:53:27.119562+0000","last_fullsized":"2024-02-19T21:53:27.119562+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'9","last_scrub_stamp":"2024-02-19T21:45:50.742526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:50.742526+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"66'1","reported_seq":373,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.512044+0000","last_change":"2024-02-19T21:48:12.568842+0000","last_active":"2024-02-19T21:53:11.512044+0000","last_peered":"2024-02-19T21:53:11.512044+0000","last_clean":"2024-02-19T21:53:11.512044+0000","last_became_active":"2024-02-19T21:44:56.166670+0000","last_became_peered":"2024-02-19T21:44:56.166670+0000","last_unstale":"2024-02-19T21:53:11.512044+0000","last_undegraded":"2024-02-19T21:53:11.512044+0000","last_fullsized":"2024-02-19T21:53:11.512044+0000","mapping_epoch":165,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:12.568734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.568734+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"261'11","reported_seq":583,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:27.119489+0000","last_change":"2024-02-19T21:45:01.716882+0000","last_active":"2024-02-19T21:53:27.119489+0000","last_peered":"2024-02-19T21:53:27.119489+0000","last_clean":"2024-02-19T21:53:27.119489+0000","last_became_active":"2024-02-19T21:44:08.123392+0000","last_became_peered":"2024-02-19T21:44:08.123392+0000","last_unstale":"2024-02-19T21:53:27.119489+0000","last_undegraded":"2024-02-19T21:53:27.119489+0000","last_fullsized":"2024-02-19T21:53:27.119489+0000","mapping_epoch":62,"log_start":"257'10","ondisk_log_start":"257'10","created":62,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-02-19T21:45:01.716817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.716817+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":472,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.496148+0000","last_change":"2024-02-19T21:48:19.186455+0000","last_active":"2024-02-19T21:53:25.496148+0000","last_peered":"2024-02-19T21:53:25.496148+0000","last_clean":"2024-02-19T21:53:25.496148+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:53:25.496148+0000","last_undegraded":"2024-02-19T21:53:25.496148+0000","last_fullsized":"2024-02-19T21:53:25.496148+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:48:19.186359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:19.186359+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"470'27","reported_seq":343,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348587+0000","last_change":"2024-02-19T21:48:34.485865+0000","last_active":"2024-02-19T21:53:25.348587+0000","last_peered":"2024-02-19T21:53:25.348587+0000","last_clean":"2024-02-19T21:53:25.348587+0000","last_became_active":"2024-02-19T21:47:46.251550+0000","last_became_peered":"2024-02-19T21:47:46.251550+0000","last_unstale":"2024-02-19T21:53:25.348587+0000","last_undegraded":"2024-02-19T21:53:25.348587+0000","last_fullsized":"2024-02-19T21:53:25.348587+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:34.485787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:34.485787+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7],"acting":[4,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":479,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.530533+0000","last_change":"2024-02-19T21:46:01.031458+0000","last_active":"2024-02-19T21:53:25.530533+0000","last_peered":"2024-02-19T21:53:25.530533+0000","last_clean":"2024-02-19T21:53:25.530533+0000","last_became_active":"2024-02-19T21:44:56.155194+0000","last_became_peered":"2024-02-19T21:44:56.155194+0000","last_unstale":"2024-02-19T21:53:25.530533+0000","last_undegraded":"2024-02-19T21:53:25.530533+0000","last_fullsized":"2024-02-19T21:53:25.530533+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.031344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.031344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"363'12","reported_seq":296,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:27.119472+0000","last_change":"2024-02-19T21:48:25.487689+0000","last_active":"2024-02-19T21:53:27.119472+0000","last_peered":"2024-02-19T21:53:27.119472+0000","last_clean":"2024-02-19T21:53:27.119472+0000","last_became_active":"2024-02-19T21:47:46.260099+0000","last_became_peered":"2024-02-19T21:47:46.260099+0000","last_unstale":"2024-02-19T21:53:27.119472+0000","last_undegraded":"2024-02-19T21:53:27.119472+0000","last_fullsized":"2024-02-19T21:53:27.119472+0000","mapping_epoch":362,"log_start":"98'9","ondisk_log_start":"98'9","created":62,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"363'12","last_scrub_stamp":"2024-02-19T21:48:25.487608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.487608+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":484,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348194+0000","last_change":"2024-02-19T21:49:08.335163+0000","last_active":"2024-02-19T21:53:25.348194+0000","last_peered":"2024-02-19T21:53:25.348194+0000","last_clean":"2024-02-19T21:53:25.348194+0000","last_became_active":"2024-02-19T21:49:08.334842+0000","last_became_peered":"2024-02-19T21:49:08.334842+0000","last_unstale":"2024-02-19T21:53:25.348194+0000","last_undegraded":"2024-02-19T21:53:25.348194+0000","last_fullsized":"2024-02-19T21:53:25.348194+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.700887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.700887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2],"acting":[1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"471'46","reported_seq":421,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.529646+0000","last_change":"2024-02-19T21:47:34.894164+0000","last_active":"2024-02-19T21:53:25.529646+0000","last_peered":"2024-02-19T21:53:25.529646+0000","last_clean":"2024-02-19T21:53:25.529646+0000","last_became_active":"2024-02-19T21:47:33.400012+0000","last_became_peered":"2024-02-19T21:47:33.400012+0000","last_unstale":"2024-02-19T21:53:25.529646+0000","last_undegraded":"2024-02-19T21:53:25.529646+0000","last_fullsized":"2024-02-19T21:53:25.529646+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":357,"parent":"0.0","parent_split_bits":0,"last_scrub":"270'34","last_scrub_stamp":"2024-02-19T21:46:44.789309+0000","last_deep_scrub":"270'34","last_deep_scrub_stamp":"2024-02-19T21:44:17.451151+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.789309+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":462,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348759+0000","last_change":"2024-02-19T21:49:08.329023+0000","last_active":"2024-02-19T21:53:25.348759+0000","last_peered":"2024-02-19T21:53:25.348759+0000","last_clean":"2024-02-19T21:53:25.348759+0000","last_became_active":"2024-02-19T21:49:08.328697+0000","last_became_peered":"2024-02-19T21:49:08.328697+0000","last_unstale":"2024-02-19T21:53:25.348759+0000","last_undegraded":"2024-02-19T21:53:25.348759+0000","last_fullsized":"2024-02-19T21:53:25.348759+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.939414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.939414+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"397'17","reported_seq":424,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.351230+0000","last_change":"2024-02-19T21:49:08.325927+0000","last_active":"2024-02-19T21:53:25.351230+0000","last_peered":"2024-02-19T21:53:25.351230+0000","last_clean":"2024-02-19T21:53:25.351230+0000","last_became_active":"2024-02-19T21:49:08.325034+0000","last_became_peered":"2024-02-19T21:49:08.325034+0000","last_unstale":"2024-02-19T21:53:25.351230+0000","last_undegraded":"2024-02-19T21:53:25.351230+0000","last_fullsized":"2024-02-19T21:53:25.351230+0000","mapping_epoch":394,"log_start":"170'11","ondisk_log_start":"170'11","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"271'13","last_scrub_stamp":"2024-02-19T21:46:47.072988+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.072988+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":474,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348367+0000","last_change":"2024-02-19T21:49:03.987847+0000","last_active":"2024-02-19T21:53:25.348367+0000","last_peered":"2024-02-19T21:53:25.348367+0000","last_clean":"2024-02-19T21:53:25.348367+0000","last_became_active":"2024-02-19T21:47:33.395485+0000","last_became_peered":"2024-02-19T21:47:33.395485+0000","last_unstale":"2024-02-19T21:53:25.348367+0000","last_undegraded":"2024-02-19T21:53:25.348367+0000","last_fullsized":"2024-02-19T21:53:25.348367+0000","mapping_epoch":355,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":356,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:03.987749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:49:03.987749+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,5],"acting":[1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"470'30","reported_seq":323,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348400+0000","last_change":"2024-02-19T21:48:12.628796+0000","last_active":"2024-02-19T21:53:25.348400+0000","last_peered":"2024-02-19T21:53:25.348400+0000","last_clean":"2024-02-19T21:53:25.348400+0000","last_became_active":"2024-02-19T21:47:46.251725+0000","last_became_peered":"2024-02-19T21:47:46.251725+0000","last_unstale":"2024-02-19T21:53:25.348400+0000","last_undegraded":"2024-02-19T21:53:25.348400+0000","last_fullsized":"2024-02-19T21:53:25.348400+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'20","last_scrub_stamp":"2024-02-19T21:48:12.628700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.628700+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":38,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":112,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.001147+0000","last_change":"2024-02-19T21:49:08.327495+0000","last_active":"2024-02-19T21:53:25.001147+0000","last_peered":"2024-02-19T21:53:25.001147+0000","last_clean":"2024-02-19T21:53:25.001147+0000","last_became_active":"2024-02-19T21:49:08.327172+0000","last_became_peered":"2024-02-19T21:49:08.327172+0000","last_unstale":"2024-02-19T21:53:25.001147+0000","last_undegraded":"2024-02-19T21:53:25.001147+0000","last_fullsized":"2024-02-19T21:53:25.001147+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:02.241319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:02.241319+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,6],"acting":[2,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":469,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.349049+0000","last_change":"2024-02-19T21:45:01.798485+0000","last_active":"2024-02-19T21:53:25.349049+0000","last_peered":"2024-02-19T21:53:25.349049+0000","last_clean":"2024-02-19T21:53:25.349049+0000","last_became_active":"2024-02-19T21:44:22.245925+0000","last_became_peered":"2024-02-19T21:44:22.245925+0000","last_unstale":"2024-02-19T21:53:25.349049+0000","last_undegraded":"2024-02-19T21:53:25.349049+0000","last_fullsized":"2024-02-19T21:53:25.349049+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:01.798387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.798387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":468,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.496741+0000","last_change":"2024-02-19T21:48:30.277397+0000","last_active":"2024-02-19T21:53:25.496741+0000","last_peered":"2024-02-19T21:53:25.496741+0000","last_clean":"2024-02-19T21:53:25.496741+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:53:25.496741+0000","last_undegraded":"2024-02-19T21:53:25.496741+0000","last_fullsized":"2024-02-19T21:53:25.496741+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.277322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.277322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"470'53","reported_seq":438,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348698+0000","last_change":"2024-02-19T21:49:08.326007+0000","last_active":"2024-02-19T21:53:25.348698+0000","last_peered":"2024-02-19T21:53:25.348698+0000","last_clean":"2024-02-19T21:53:25.348698+0000","last_became_active":"2024-02-19T21:49:08.325683+0000","last_became_peered":"2024-02-19T21:49:08.325683+0000","last_unstale":"2024-02-19T21:53:25.348698+0000","last_undegraded":"2024-02-19T21:53:25.348698+0000","last_fullsized":"2024-02-19T21:53:25.348698+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'39","last_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_deep_scrub":"337'39","last_deep_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_clean_scrub_stamp":"2024-02-19T21:46:48.923809+0000","log_size":53,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"66'1","reported_seq":306,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.495984+0000","last_change":"2024-02-19T21:50:57.303343+0000","last_active":"2024-02-19T21:53:25.495984+0000","last_peered":"2024-02-19T21:53:25.495984+0000","last_clean":"2024-02-19T21:53:25.495984+0000","last_became_active":"2024-02-19T21:50:57.302957+0000","last_became_peered":"2024-02-19T21:50:57.302957+0000","last_unstale":"2024-02-19T21:53:25.495984+0000","last_undegraded":"2024-02-19T21:53:25.495984+0000","last_fullsized":"2024-02-19T21:53:25.495984+0000","mapping_epoch":437,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":438,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:46:43.773486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:46:43.773486+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":112,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.001688+0000","last_change":"2024-02-19T21:49:08.326583+0000","last_active":"2024-02-19T21:53:25.001688+0000","last_peered":"2024-02-19T21:53:25.001688+0000","last_clean":"2024-02-19T21:53:25.001688+0000","last_became_active":"2024-02-19T21:49:08.324835+0000","last_became_peered":"2024-02-19T21:49:08.324835+0000","last_unstale":"2024-02-19T21:53:25.001688+0000","last_undegraded":"2024-02-19T21:53:25.001688+0000","last_fullsized":"2024-02-19T21:53:25.001688+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_clean_scrub_stamp":"2024-02-19T21:45:12.163825+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":187,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:24.811608+0000","last_change":"2024-02-19T21:53:24.811608+0000","last_active":"2024-02-19T21:53:24.811608+0000","last_peered":"2024-02-19T21:53:24.811608+0000","last_clean":"2024-02-19T21:53:24.811608+0000","last_became_active":"2024-02-19T21:49:08.327186+0000","last_became_peered":"2024-02-19T21:49:08.327186+0000","last_unstale":"2024-02-19T21:53:24.811608+0000","last_undegraded":"2024-02-19T21:53:24.811608+0000","last_fullsized":"2024-02-19T21:53:24.811608+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:45:00.748244+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:45:00.748244+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"471'60","reported_seq":612,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.513568+0000","last_change":"2024-02-19T21:49:55.281324+0000","last_active":"2024-02-19T21:53:11.513568+0000","last_peered":"2024-02-19T21:53:11.513568+0000","last_clean":"2024-02-19T21:53:11.513568+0000","last_became_active":"2024-02-19T21:49:54.493167+0000","last_became_peered":"2024-02-19T21:49:54.493167+0000","last_unstale":"2024-02-19T21:53:11.513568+0000","last_undegraded":"2024-02-19T21:53:11.513568+0000","last_fullsized":"2024-02-19T21:53:11.513568+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'44","last_scrub_stamp":"2024-02-19T21:48:32.489084+0000","last_deep_scrub":"201'44","last_deep_scrub_stamp":"2024-02-19T21:44:16.255049+0000","last_clean_scrub_stamp":"2024-02-19T21:48:32.489084+0000","log_size":60,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":80,"num_read_kb":69,"num_write":52,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":512,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.513543+0000","last_change":"2024-02-19T21:49:08.328667+0000","last_active":"2024-02-19T21:53:11.513543+0000","last_peered":"2024-02-19T21:53:11.513543+0000","last_clean":"2024-02-19T21:53:11.513543+0000","last_became_active":"2024-02-19T21:49:08.328287+0000","last_became_peered":"2024-02-19T21:49:08.328287+0000","last_unstale":"2024-02-19T21:53:11.513543+0000","last_undegraded":"2024-02-19T21:53:11.513543+0000","last_fullsized":"2024-02-19T21:53:11.513543+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.176542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.176542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":112,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.000468+0000","last_change":"2024-02-19T21:49:08.332637+0000","last_active":"2024-02-19T21:53:25.000468+0000","last_peered":"2024-02-19T21:53:25.000468+0000","last_clean":"2024-02-19T21:53:25.000468+0000","last_became_active":"2024-02-19T21:49:08.331451+0000","last_became_peered":"2024-02-19T21:49:08.331451+0000","last_unstale":"2024-02-19T21:53:25.000468+0000","last_undegraded":"2024-02-19T21:53:25.000468+0000","last_fullsized":"2024-02-19T21:53:25.000468+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.123413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.547129+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.123413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":484,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.348587+0000","last_change":"2024-02-19T21:49:08.331159+0000","last_active":"2024-02-19T21:53:25.348587+0000","last_peered":"2024-02-19T21:53:25.348587+0000","last_clean":"2024-02-19T21:53:25.348587+0000","last_became_active":"2024-02-19T21:49:08.330804+0000","last_became_peered":"2024-02-19T21:49:08.330804+0000","last_unstale":"2024-02-19T21:53:25.348587+0000","last_undegraded":"2024-02-19T21:53:25.348587+0000","last_fullsized":"2024-02-19T21:53:25.348587+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.978015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.978015+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"470'25","reported_seq":499,"reported_epoch":482,"state":"active+clean","last_fresh":"2024-02-19T21:53:11.514078+0000","last_change":"2024-02-19T21:48:23.326608+0000","last_active":"2024-02-19T21:53:11.514078+0000","last_peered":"2024-02-19T21:53:11.514078+0000","last_clean":"2024-02-19T21:53:11.514078+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:53:11.514078+0000","last_undegraded":"2024-02-19T21:53:11.514078+0000","last_fullsized":"2024-02-19T21:53:11.514078+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"377'19","last_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_deep_scrub":"377'19","last_deep_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.326541+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":477,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.529780+0000","last_change":"2024-02-19T21:46:01.981923+0000","last_active":"2024-02-19T21:53:25.529780+0000","last_peered":"2024-02-19T21:53:25.529780+0000","last_clean":"2024-02-19T21:53:25.529780+0000","last_became_active":"2024-02-19T21:44:56.160521+0000","last_became_peered":"2024-02-19T21:44:56.160521+0000","last_unstale":"2024-02-19T21:53:25.529780+0000","last_undegraded":"2024-02-19T21:53:25.529780+0000","last_fullsized":"2024-02-19T21:53:25.529780+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:01.981866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:46:01.981866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":121,"reported_epoch":483,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.001698+0000","last_change":"2024-02-19T21:49:54.485377+0000","last_active":"2024-02-19T21:53:25.001698+0000","last_peered":"2024-02-19T21:53:25.001698+0000","last_clean":"2024-02-19T21:53:25.001698+0000","last_became_active":"2024-02-19T21:49:54.485078+0000","last_became_peered":"2024-02-19T21:49:54.485078+0000","last_unstale":"2024-02-19T21:53:25.001698+0000","last_undegraded":"2024-02-19T21:53:25.001698+0000","last_fullsized":"2024-02-19T21:53:25.001698+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:52.107416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:46:52.107416+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"470'39","reported_seq":572,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.529665+0000","last_change":"2024-02-19T21:49:55.109780+0000","last_active":"2024-02-19T21:53:25.529665+0000","last_peered":"2024-02-19T21:53:25.529665+0000","last_clean":"2024-02-19T21:53:25.529665+0000","last_became_active":"2024-02-19T21:49:54.486014+0000","last_became_peered":"2024-02-19T21:49:54.486014+0000","last_unstale":"2024-02-19T21:53:25.529665+0000","last_undegraded":"2024-02-19T21:53:25.529665+0000","last_fullsized":"2024-02-19T21:53:25.529665+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'27","last_scrub_stamp":"2024-02-19T21:48:24.665813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:24.665813+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"324'11","reported_seq":743,"reported_epoch":484,"state":"active+clean","last_fresh":"2024-02-19T21:53:25.497549+0000","last_change":"2024-02-19T21:48:26.293036+0000","last_active":"2024-02-19T21:53:25.497549+0000","last_peered":"2024-02-19T21:53:25.497549+0000","last_clean":"2024-02-19T21:53:25.497549+0000","last_became_active":"2024-02-19T21:44:34.385140+0000","last_became_peered":"2024-02-19T21:44:34.385140+0000","last_unstale":"2024-02-19T21:53:25.497549+0000","last_undegraded":"2024-02-19T21:53:25.497549+0000","last_fullsized":"2024-02-19T21:53:25.497549+0000","mapping_epoch":62,"log_start":"66'8","ondisk_log_start":"66'8","created":62,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'11","last_scrub_stamp":"2024-02-19T21:48:26.292909+0000","last_deep_scrub":"324'11","last_deep_scrub_stamp":"2024-02-19T21:46:05.210095+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.292909+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1246,"num_read_kb":1241,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1536,"num_read_kb":1293,"num_write":989,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":277,"num_bytes_recovered":5172,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1062,"ondisk_log_size":1062,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":22,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":66,"acting":66,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":382,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201536,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":589600,"kb_used_data":3992,"kb_used_omap":0,"kb_used_meta":585600,"kb_avail":93155552,"statfs":{"total":95995035648,"available":95391285248,"internally_reserved":0,"allocated":4087808,"data_stored":2633652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":599654400},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:52:55 2024","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.329,"15min":1.857},"min":{"1min":0.26500000000000001,"5min":0.222,"15min":0.189},"max":{"1min":4.726,"5min":11.653,"15min":70.477999999999994},"last":0.36799999999999999},{"interface":"front","average":{"1min":1.851,"5min":1.351,"15min":1.9950000000000001},"min":{"1min":0.26800000000000002,"5min":0.23100000000000001,"15min":0.20999999999999999},"max":{"1min":9.8759999999999994,"5min":12.242000000000001,"15min":68.052000000000007},"last":0.40600000000000003}]},{"osd":1,"last update":"Mon Feb 19 21:52:55 2024","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.1739999999999999,"15min":1.9670000000000001},"min":{"1min":0.25,"5min":0.247,"15min":0.23200000000000001},"max":{"1min":4.883,"5min":9.9440000000000008,"15min":68.168000000000006},"last":0.376},{"interface":"front","average":{"1min":1.6040000000000001,"5min":1.474,"15min":2.0840000000000001},"min":{"1min":0.40200000000000002,"5min":0.26300000000000001,"15min":0.223},"max":{"1min":9.9559999999999995,"5min":12.199,"15min":68.444000000000003},"last":0.38300000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:53:17 2024","interfaces":[{"interface":"back","average":{"1min":2.1379999999999999,"5min":1.599,"15min":2.133},"min":{"1min":0.42299999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":9.9830000000000005,"5min":12.304,"15min":12.304},"last":0.42299999999999999},{"interface":"front","average":{"1min":2.6099999999999999,"5min":1.615,"15min":1.9139999999999999},"min":{"1min":0.32900000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":7.2750000000000004,"5min":11.69,"15min":11.69},"last":0.41399999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:52:55 2024","interfaces":[{"interface":"back","average":{"1min":2.5579999999999998,"5min":1.736,"15min":2.0739999999999998},"min":{"1min":0.37,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":7.6479999999999997,"5min":11.778,"15min":17.481999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":2.5459999999999998,"5min":1.3799999999999999,"15min":1.7689999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.29299999999999998},"max":{"1min":13.196,"5min":13.196,"15min":17.576000000000001},"last":0.34300000000000003}]},{"osd":4,"last update":"Mon Feb 19 21:52:55 2024","interfaces":[{"interface":"back","average":{"1min":2.5870000000000002,"5min":1.619,"15min":1.6699999999999999},"min":{"1min":0.32100000000000001,"5min":0.245,"15min":0.216},"max":{"1min":10.656000000000001,"5min":17.716999999999999,"15min":17.716999999999999},"last":0.317},{"interface":"front","average":{"1min":3.331,"5min":2.0899999999999999,"15min":2.0449999999999999},"min":{"1min":0.376,"5min":0.26500000000000001,"15min":0.253},"max":{"1min":15.961,"5min":15.961,"15min":17.690999999999999},"last":0.26700000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:52:55 2024","interfaces":[{"interface":"back","average":{"1min":2.2919999999999998,"5min":1.5029999999999999,"15min":1.722},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.24199999999999999},"max":{"1min":7.8609999999999998,"5min":12.210000000000001,"15min":29.021000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":3.637,"5min":1.829,"15min":2.0630000000000002},"min":{"1min":0.45300000000000001,"5min":0.33800000000000002,"15min":0.28699999999999998},"max":{"1min":9.9269999999999996,"5min":17.670999999999999,"15min":29.091999999999999},"last":0.35399999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:52:55 2024","interfaces":[{"interface":"back","average":{"1min":3.0579999999999998,"5min":2.0899999999999999,"15min":1.833},"min":{"1min":0.42999999999999999,"5min":0.31,"15min":0.24299999999999999},"max":{"1min":15.426,"5min":19.286000000000001,"15min":19.286000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":2.887,"5min":2.0920000000000001,"15min":1.9970000000000001},"min":{"1min":0.46400000000000002,"5min":0.314,"15min":0.26700000000000002},"max":{"1min":6.9690000000000003,"5min":18.364000000000001,"15min":18.364000000000001},"last":0.33000000000000002}]}]},{"osd":6,"up_from":47,"seq":201863463175,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":601884,"kb_used_data":3988,"kb_used_omap":0,"kb_used_meta":597888,"kb_avail":93143268,"statfs":{"total":95995035648,"available":95378706432,"internally_reserved":0,"allocated":4083712,"data_stored":2632942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":612237312},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:52:31 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.92500000000000004,"15min":1.5880000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.20100000000000001},"max":{"1min":3.9489999999999998,"5min":7.8170000000000002,"15min":45.197000000000003},"last":0.34799999999999998},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.391,"15min":1.948},"min":{"1min":0.29399999999999998,"5min":0.23499999999999999,"15min":0.221},"max":{"1min":3.7469999999999999,"5min":6.7320000000000002,"15min":44.753},"last":0.40300000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:52:31 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":1.091,"15min":1.577},"min":{"1min":0.26700000000000002,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":4.101,"5min":7.8639999999999999,"15min":45.231999999999999},"last":0.38300000000000001},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.3029999999999999,"15min":1.6950000000000001},"min":{"1min":0.28699999999999998,"5min":0.245,"15min":0.23100000000000001},"max":{"1min":9.3079999999999998,"5min":9.3079999999999998,"15min":45.097999999999999},"last":0.36299999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:53:12 2024","interfaces":[{"interface":"back","average":{"1min":2.8149999999999999,"5min":1.472,"15min":1.538},"min":{"1min":0.29699999999999999,"5min":0.255,"15min":0.255},"max":{"1min":9.9369999999999994,"5min":9.9369999999999994,"15min":9.9369999999999994},"last":0.42199999999999999},{"interface":"front","average":{"1min":2,"5min":1.1200000000000001,"15min":1.2190000000000001},"min":{"1min":0.311,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":9.7829999999999995,"5min":9.7829999999999995,"15min":9.7829999999999995},"last":0.42999999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:52:31 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.0920000000000001,"15min":1.512},"min":{"1min":0.36699999999999999,"5min":0.28299999999999997,"15min":0.25900000000000001},"max":{"1min":4.0140000000000002,"5min":7.9210000000000003,"15min":11.15},"last":0.41199999999999998},{"interface":"front","average":{"1min":1.907,"5min":1.478,"15min":1.597},"min":{"1min":0.307,"5min":0.30599999999999999,"15min":0.26400000000000001},"max":{"1min":13.038,"5min":13.038,"15min":19.632999999999999},"last":0.39500000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:52:31 2024","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.821,"15min":1.8380000000000001},"min":{"1min":0.29399999999999998,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":8.5980000000000008,"5min":18.010000000000002,"15min":18.010000000000002},"last":0.311},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3120000000000001,"15min":1.7589999999999999},"min":{"1min":0.317,"5min":0.26300000000000001,"15min":0.23499999999999999},"max":{"1min":6.4909999999999997,"5min":11.566000000000001,"15min":16.594999999999999},"last":0.44500000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:52:31 2024","interfaces":[{"interface":"back","average":{"1min":2.214,"5min":1.762,"15min":1.901},"min":{"1min":0.36799999999999999,"5min":0.27400000000000002,"15min":0.27100000000000002},"max":{"1min":7.7370000000000001,"5min":9.5990000000000002,"15min":14.695},"last":0.375},{"interface":"front","average":{"1min":1.962,"5min":1.5800000000000001,"15min":2.0019999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":6.6959999999999997,"5min":11.609999999999999,"15min":15.497999999999999},"last":0.45900000000000002}]},{"osd":7,"last update":"Mon Feb 19 21:52:55 2024","interfaces":[{"interface":"back","average":{"1min":2.8100000000000001,"5min":1.585,"15min":1.9550000000000001},"min":{"1min":0.34100000000000003,"5min":0.32100000000000001,"15min":0.27200000000000002},"max":{"1min":9.8170000000000002,"5min":9.8170000000000002,"15min":14.721},"last":0.47599999999999998},{"interface":"front","average":{"1min":2.8460000000000001,"5min":1.6279999999999999,"15min":1.9950000000000001},"min":{"1min":0.41799999999999998,"5min":0.35899999999999999,"15min":0.34300000000000003},"max":{"1min":9.8309999999999995,"5min":9.8309999999999995,"15min":14.744999999999999},"last":0.48899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575137,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":900540,"kb_used_data":4020,"kb_used_omap":0,"kb_used_meta":896512,"kb_avail":92844612,"statfs":{"total":95995035648,"available":95072882688,"internally_reserved":0,"allocated":4116480,"data_stored":2642116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":918028288},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:53:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.627,"15min":1.204},"min":{"1min":0.19,"5min":0.16300000000000001,"15min":0.161},"max":{"1min":3.9649999999999999,"5min":5.7889999999999997,"15min":42.776000000000003},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.82199999999999995,"15min":1.347},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.16400000000000001},"max":{"1min":3.0880000000000001,"5min":5.7119999999999997,"15min":44.845999999999997},"last":0.41999999999999998}]},{"osd":2,"last update":"Mon Feb 19 21:53:13 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.68600000000000005,"15min":0.94999999999999996},"min":{"1min":0.20499999999999999,"5min":0.189,"15min":0.189},"max":{"1min":1.093,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.79600000000000004,"15min":0.93999999999999995},"min":{"1min":0.20699999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":4.0179999999999998,"5min":4.452,"15min":4.452},"last":0.38}]},{"osd":3,"last update":"Mon Feb 19 21:53:22 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":0.77000000000000002,"15min":1.3069999999999999},"min":{"1min":0.26200000000000001,"5min":0.22800000000000001,"15min":0.20999999999999999},"max":{"1min":7.8250000000000002,"5min":7.8250000000000002,"15min":41.607999999999997},"last":0.36599999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":0.70199999999999996,"15min":1.3120000000000001},"min":{"1min":0.26000000000000001,"5min":0.215,"15min":0.215},"max":{"1min":4.1130000000000004,"5min":4.1130000000000004,"15min":42.811999999999998},"last":0.47599999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:52:38 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.1579999999999999,"15min":1.5029999999999999},"min":{"1min":0.32000000000000001,"5min":0.26900000000000002,"15min":0.251},"max":{"1min":6.9690000000000003,"5min":9.8759999999999994,"15min":15.853},"last":0.505},{"interface":"front","average":{"1min":1.3420000000000001,"5min":0.98599999999999999,"15min":1.484},"min":{"1min":0.33900000000000002,"5min":0.28000000000000003,"15min":0.26500000000000001},"max":{"1min":6.9800000000000004,"5min":6.9800000000000004,"15min":15.861000000000001},"last":0.497}]},{"osd":5,"last update":"Mon Feb 19 21:53:07 2024","interfaces":[{"interface":"back","average":{"1min":1.665,"5min":0.95999999999999996,"15min":1.544},"min":{"1min":0.45000000000000001,"5min":0.29599999999999999,"15min":0.27900000000000003},"max":{"1min":3.891,"5min":4.0720000000000001,"15min":14.331},"last":0.46600000000000003},{"interface":"front","average":{"1min":2.0129999999999999,"5min":1.0569999999999999,"15min":1.5700000000000001},"min":{"1min":0.33300000000000002,"5min":0.307,"15min":0.30099999999999999},"max":{"1min":10.148999999999999,"5min":10.148999999999999,"15min":14.496},"last":0.45800000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":1.1060000000000001,"15min":1.5800000000000001},"min":{"1min":0.377,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":2.5779999999999998,"5min":10.456,"15min":11.638999999999999},"last":0.441},{"interface":"front","average":{"1min":1.048,"5min":1.1599999999999999,"15min":1.6870000000000001},"min":{"1min":0.36299999999999999,"5min":0.34699999999999998,"15min":0.29699999999999999},"max":{"1min":3.6480000000000001,"5min":9.8049999999999997,"15min":12.199},"last":0.48599999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:53:02 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.1659999999999999,"15min":1.694},"min":{"1min":0.35699999999999998,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":7.0679999999999996,"5min":7.702,"15min":13.904},"last":0.51700000000000002},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.2110000000000001,"15min":1.665},"min":{"1min":0.39800000000000002,"5min":0.38900000000000001,"15min":0.32600000000000001},"max":{"1min":7.0899999999999999,"5min":7.6909999999999998,"15min":13.894},"last":0.53400000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738663,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910680,"kb_used_data":3984,"kb_used_omap":0,"kb_used_meta":906688,"kb_avail":92834472,"statfs":{"total":95995035648,"available":95062499328,"internally_reserved":0,"allocated":4079616,"data_stored":2632881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":928448512},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:53:15 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.54100000000000004,"15min":0.90900000000000003},"min":{"1min":0.20899999999999999,"5min":0.189,"15min":0.153},"max":{"1min":3.226,"5min":3.4889999999999999,"15min":16.478000000000002},"last":0.38700000000000001},{"interface":"front","average":{"1min":1.54,"5min":0.72599999999999998,"15min":1.083},"min":{"1min":0.20799999999999999,"5min":0.20100000000000001,"15min":0.17799999999999999},"max":{"1min":7.1669999999999998,"5min":7.1669999999999998,"15min":13.422000000000001},"last":0.27100000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":0.69799999999999995,"15min":0.67400000000000004},"min":{"1min":0.224,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":3.8439999999999999,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":0.28000000000000003},{"interface":"front","average":{"1min":1.3049999999999999,"5min":0.88800000000000001,"15min":1.0840000000000001},"min":{"1min":0.25600000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":5.9370000000000003,"5min":8.9960000000000004,"15min":8.9960000000000004},"last":0.29299999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:53:01 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":0.78300000000000003,"15min":1.284},"min":{"1min":0.26400000000000001,"5min":0.217,"15min":0.21299999999999999},"max":{"1min":3.0859999999999999,"5min":8.2279999999999998,"15min":13.776},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.69499999999999995,"15min":1.2370000000000001},"min":{"1min":0.29299999999999998,"5min":0.24099999999999999,"15min":0.23400000000000001},"max":{"1min":2.948,"5min":3.722,"15min":18.759},"last":0.33300000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:52:48 2024","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.25,"15min":1.657},"min":{"1min":0.32800000000000001,"5min":0.29399999999999998,"15min":0.252},"max":{"1min":6.8310000000000004,"5min":10.311,"15min":13.278},"last":0.39800000000000002},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1599999999999999,"15min":1.498},"min":{"1min":0.33000000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":3.3679999999999999,"5min":10.109,"15min":10.109},"last":0.41099999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:53:01 2024","interfaces":[{"interface":"back","average":{"1min":2,"5min":1.22,"15min":1.9490000000000001},"min":{"1min":0.318,"5min":0.317,"15min":0.27600000000000002},"max":{"1min":7.2089999999999996,"5min":8.1199999999999992,"15min":42.799999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":2.238,"5min":1.288,"15min":2.0510000000000002},"min":{"1min":0.40899999999999997,"5min":0.33200000000000002,"15min":0.27300000000000002},"max":{"1min":6.4269999999999996,"5min":8.5530000000000008,"15min":42.695},"last":0.52000000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:53:18 2024","interfaces":[{"interface":"back","average":{"1min":2.335,"5min":1.405,"15min":1.528},"min":{"1min":0.46300000000000002,"5min":0.33300000000000002,"15min":0.27000000000000002},"max":{"1min":12.364000000000001,"5min":12.364000000000001,"15min":12.364000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":2.77,"5min":1.333,"15min":1.8560000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.29599999999999999},"max":{"1min":11.269,"5min":11.269,"15min":13.289999999999999},"last":0.44700000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:52:54 2024","interfaces":[{"interface":"back","average":{"1min":1.8320000000000001,"5min":1.274,"15min":1.8069999999999999},"min":{"1min":0.45700000000000002,"5min":0.36499999999999999,"15min":0.31},"max":{"1min":5.7229999999999999,"5min":9.6460000000000008,"15min":42.758000000000003},"last":0.55400000000000005},{"interface":"front","average":{"1min":1.554,"5min":1.2929999999999999,"15min":1.6890000000000001},"min":{"1min":0.435,"5min":0.40000000000000002,"15min":0.36399999999999999},"max":{"1min":5.7119999999999997,"5min":9.6389999999999993,"15min":42.718000000000004},"last":0.56000000000000005}]}]},{"osd":2,"up_from":394,"seq":1692217114676,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":319816,"kb_used_data":3968,"kb_used_omap":0,"kb_used_meta":315839,"kb_avail":93425336,"statfs":{"total":95995035648,"available":95667544064,"internally_reserved":0,"allocated":4063232,"data_stored":2632607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":323419188},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:53:13 2024","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":0.96099999999999997,"15min":1.0980000000000001},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":9.2629999999999999,"5min":9.2629999999999999,"15min":9.2629999999999999},"last":0.26900000000000002},{"interface":"front","average":{"1min":1.034,"5min":0.83499999999999996,"15min":1.093},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":5.6440000000000001,"5min":6.149,"15min":6.149},"last":0.29899999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:53:13 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.59599999999999997,"15min":0.61299999999999999},"min":{"1min":0.20000000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":4.3650000000000002,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.76000000000000001,"15min":0.89800000000000002},"min":{"1min":0.23400000000000001,"5min":0.224,"15min":0.224},"max":{"1min":4.2930000000000001,"5min":6.992,"15min":6.992},"last":0.309}]},{"osd":3,"last update":"Mon Feb 19 21:53:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0269999999999999,"15min":1.3089999999999999},"min":{"1min":0.28599999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":2.6819999999999999,"5min":6.9470000000000001,"15min":6.9470000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":1.181,"5min":0.94199999999999995,"15min":1.1759999999999999},"min":{"1min":0.27600000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":7.6669999999999998,"5min":7.6669999999999998,"15min":7.6669999999999998},"last":0.35099999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:53:13 2024","interfaces":[{"interface":"back","average":{"1min":1.841,"5min":1.476,"15min":1.9299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":8.843,"5min":8.843,"15min":8.843},"last":0.44400000000000001},{"interface":"front","average":{"1min":2.6240000000000001,"5min":1.573,"15min":1.829},"min":{"1min":0.30299999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":9.3300000000000001,"5min":9.3300000000000001,"15min":9.3300000000000001},"last":0.371}]},{"osd":5,"last update":"Mon Feb 19 21:53:13 2024","interfaces":[{"interface":"back","average":{"1min":2.8769999999999998,"5min":1.6970000000000001,"15min":1.758},"min":{"1min":0.42299999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":11.129,"5min":11.129,"15min":11.129},"last":0.41199999999999998},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.2490000000000001,"15min":1.6299999999999999},"min":{"1min":0.32200000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":4.9790000000000001,"5min":13.558,"15min":13.558},"last":0.38200000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:53:13 2024","interfaces":[{"interface":"back","average":{"1min":3.266,"5min":1.611,"15min":1.7050000000000001},"min":{"1min":0.42099999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":9.6720000000000006,"5min":9.6720000000000006,"15min":9.6720000000000006},"last":0.42299999999999999},{"interface":"front","average":{"1min":2.5470000000000002,"5min":1.1839999999999999,"15min":1.089},"min":{"1min":0.38100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":8.3629999999999995,"5min":8.3629999999999995,"15min":8.3629999999999995},"last":0.46600000000000003}]},{"osd":7,"last update":"Mon Feb 19 21:53:13 2024","interfaces":[{"interface":"back","average":{"1min":2.169,"5min":1.3200000000000001,"15min":1.409},"min":{"1min":0.36499999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":6.5949999999999998,"5min":6.5949999999999998,"15min":6.5949999999999998},"last":0.39800000000000002},{"interface":"front","average":{"1min":2.7370000000000001,"5min":1.105,"15min":0.93100000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":8.7780000000000005,"5min":8.7780000000000005,"15min":8.7780000000000005},"last":0.48399999999999999}]}]},{"osd":3,"up_from":0,"seq":111669149975,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":32,"seq":137438953744,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":855896,"kb_used_data":262096,"kb_used_omap":0,"kb_used_meta":593792,"kb_avail":92889256,"statfs":{"total":95995035648,"available":95118598144,"internally_reserved":0,"allocated":268386304,"data_stored":266946867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":608043008},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:52:34 2024","interfaces":[{"interface":"back","average":{"1min":1.9099999999999999,"5min":1.857,"15min":1.885},"min":{"1min":0.25900000000000001,"5min":0.219,"15min":0.219},"max":{"1min":9.923,"5min":53.936,"15min":53.936},"last":0.309},{"interface":"front","average":{"1min":1.595,"5min":2.012,"15min":1.972},"min":{"1min":0.27200000000000002,"5min":0.252,"15min":0.22600000000000001},"max":{"1min":10.140000000000001,"5min":54.405999999999999,"15min":54.405999999999999},"last":0.44900000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:52:34 2024","interfaces":[{"interface":"back","average":{"1min":2.0230000000000001,"5min":2.012,"15min":1.8260000000000001},"min":{"1min":0.26100000000000001,"5min":0.253,"15min":0.21199999999999999},"max":{"1min":12.439,"5min":54.731000000000002,"15min":54.731000000000002},"last":0.38100000000000001},{"interface":"front","average":{"1min":1.532,"5min":1.9330000000000001,"15min":1.704},"min":{"1min":0.29499999999999998,"5min":0.252,"15min":0.25},"max":{"1min":8.4689999999999994,"5min":52.490000000000002,"15min":52.490000000000002},"last":0.47599999999999998}]},{"osd":2,"last update":"Mon Feb 19 21:53:12 2024","interfaces":[{"interface":"back","average":{"1min":3.8029999999999999,"5min":1.79,"15min":1.9810000000000001},"min":{"1min":0.34000000000000002,"5min":0.255,"15min":0.255},"max":{"1min":12.516999999999999,"5min":12.516999999999999,"15min":12.516999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":3.8610000000000002,"5min":1.833,"15min":2.0190000000000001},"min":{"1min":0.377,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":12.541,"5min":12.541,"15min":12.541},"last":0.51300000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:52:34 2024","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.3480000000000001,"15min":1.702},"min":{"1min":0.35099999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":9.9529999999999994,"5min":9.9529999999999994,"15min":15.914999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":2.1560000000000001,"5min":1.4970000000000001,"15min":1.6950000000000001},"min":{"1min":0.36299999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":12.486000000000001,"5min":12.486000000000001,"15min":13.321},"last":0.41999999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:53:29 2024","interfaces":[{"interface":"back","average":{"1min":2.734,"5min":1.6779999999999999,"15min":2.0070000000000001},"min":{"1min":0.26900000000000002,"5min":0.23799999999999999,"15min":0.23400000000000001},"max":{"1min":10.445,"5min":13.805999999999999,"15min":18.916},"last":0.33900000000000002},{"interface":"front","average":{"1min":2.0819999999999999,"5min":1.5569999999999999,"15min":2.1419999999999999},"min":{"1min":0.33300000000000002,"5min":0.28299999999999997,"15min":0.253},"max":{"1min":12.644,"5min":14.532999999999999,"15min":14.840999999999999},"last":0.46800000000000003}]},{"osd":6,"last update":"Mon Feb 19 21:52:34 2024","interfaces":[{"interface":"back","average":{"1min":2.4369999999999998,"5min":1.698,"15min":1.7649999999999999},"min":{"1min":0.33600000000000002,"5min":0.28999999999999998,"15min":0.28599999999999998},"max":{"1min":10.233000000000001,"5min":10.233000000000001,"15min":13.27},"last":0.436},{"interface":"front","average":{"1min":2.4470000000000001,"5min":2.1699999999999999,"15min":1.9710000000000001},"min":{"1min":0.32900000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":13.433999999999999,"5min":18.670000000000002,"15min":18.670000000000002},"last":0.375}]},{"osd":7,"last update":"Mon Feb 19 21:53:06 2024","interfaces":[{"interface":"back","average":{"1min":3.1549999999999998,"5min":1.9119999999999999,"15min":1.9650000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.30399999999999999},"max":{"1min":13.398,"5min":16.763999999999999,"15min":16.763999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":2.8849999999999998,"5min":1.583,"15min":1.851},"min":{"1min":0.38700000000000001,"5min":0.33100000000000002,"15min":0.31},"max":{"1min":12.958,"5min":12.958,"15min":12.958},"last":0.49299999999999999}]}]},{"osd":5,"up_from":38,"seq":163208757516,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1110532,"kb_used_data":228284,"kb_used_omap":0,"kb_used_meta":882240,"kb_avail":92634620,"statfs":{"total":95995035648,"available":94857850880,"internally_reserved":0,"allocated":233762816,"data_stored":232335732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":903413760},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:53:14 2024","interfaces":[{"interface":"back","average":{"1min":3.0390000000000001,"5min":1.2330000000000001,"15min":1.6890000000000001},"min":{"1min":0.23599999999999999,"5min":0.23100000000000001,"15min":0.20599999999999999},"max":{"1min":10.534000000000001,"5min":10.534000000000001,"15min":19.236000000000001},"last":0.432},{"interface":"front","average":{"1min":2.3769999999999998,"5min":1.1619999999999999,"15min":1.835},"min":{"1min":0.24299999999999999,"5min":0.23699999999999999,"15min":0.20899999999999999},"max":{"1min":6.5449999999999999,"5min":6.5449999999999999,"15min":13.241},"last":0.41299999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:53:14 2024","interfaces":[{"interface":"back","average":{"1min":2.4089999999999998,"5min":1.145,"15min":1.734},"min":{"1min":0.27300000000000002,"5min":0.246,"15min":0.23100000000000001},"max":{"1min":6.625,"5min":6.625,"15min":10.42},"last":0.44600000000000001},{"interface":"front","average":{"1min":2.7709999999999999,"5min":1.113,"15min":1.5649999999999999},"min":{"1min":0.249,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":11.654,"5min":11.654,"15min":11.654},"last":0.44}]},{"osd":2,"last update":"Mon Feb 19 21:53:14 2024","interfaces":[{"interface":"back","average":{"1min":4.6879999999999997,"5min":1.7889999999999999,"15min":1.5269999999999999},"min":{"1min":0.29999999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":39.055,"5min":39.055,"15min":39.055},"last":0.40500000000000003},{"interface":"front","average":{"1min":4.1959999999999997,"5min":1.671,"15min":1.4319999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":39.012999999999998,"5min":39.012999999999998,"15min":39.012999999999998},"last":0.376}]},{"osd":3,"last update":"Mon Feb 19 21:53:14 2024","interfaces":[{"interface":"back","average":{"1min":3.1110000000000002,"5min":1.4350000000000001,"15min":1.948},"min":{"1min":0.379,"5min":0.30199999999999999,"15min":0.24099999999999999},"max":{"1min":10.561,"5min":13.182,"15min":19.321000000000002},"last":0.45800000000000002},{"interface":"front","average":{"1min":2.6789999999999998,"5min":1.298,"15min":1.9710000000000001},"min":{"1min":0.44400000000000001,"5min":0.33600000000000002,"15min":0.29499999999999998},"max":{"1min":6.577,"5min":6.577,"15min":9.5150000000000006},"last":0.47599999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:53:14 2024","interfaces":[{"interface":"back","average":{"1min":3.4300000000000002,"5min":1.335,"15min":1.5780000000000001},"min":{"1min":0.28599999999999998,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":12.228,"5min":12.228,"15min":21.577000000000002},"last":0.251},{"interface":"front","average":{"1min":3.4249999999999998,"5min":1.522,"15min":2.044},"min":{"1min":0.29599999999999999,"5min":0.26100000000000001,"15min":0.25600000000000001},"max":{"1min":10.586,"5min":10.586,"15min":19.274000000000001},"last":0.30499999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.641,"5min":1.954,"15min":1.9970000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.221},"max":{"1min":10.611000000000001,"5min":19.884,"15min":19.884},"last":0.34999999999999998},{"interface":"front","average":{"1min":1.8620000000000001,"5min":1.6599999999999999,"15min":1.9399999999999999},"min":{"1min":0.378,"5min":0.30199999999999999,"15min":0.23599999999999999},"max":{"1min":6.6500000000000004,"5min":10.260999999999999,"15min":13.532999999999999},"last":0.29099999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:52:55 2024","interfaces":[{"interface":"back","average":{"1min":2.7879999999999998,"5min":1.728,"15min":2.1669999999999998},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.27100000000000002},"max":{"1min":8.6590000000000007,"5min":11.486000000000001,"15min":12.962},"last":0.34000000000000002},{"interface":"front","average":{"1min":3.1040000000000001,"5min":1.6539999999999999,"15min":2.0089999999999999},"min":{"1min":0.35399999999999998,"5min":0.35099999999999998,"15min":0.221},"max":{"1min":10.18,"5min":15.593999999999999,"15min":17.759},"last":0.39500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:53:37.249 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2024-02-19T21:53:37.249 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:53:37.249 INFO:tasks.thrashosds.thrasher:Adding osd 3 2024-02-19T21:53:37.250 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd in 3 2024-02-19T21:53:37.358 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:53:37.362 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:37.362 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:53:37.363 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-02-19T21:53:37.375 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:53:37.388 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:53:37.463 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:53:37.491 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:37.589 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:53:37.591 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:37.179728+0000 mon.a (mon.0) 1864 : audit [INF] from='client.? 172.21.15.80:0/3064010174' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:53:37.591 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:37.592 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:53:37.592 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:37.179728+0000 mon.a (mon.0) 1864 : audit [INF] from='client.? 172.21.15.80:0/3064010174' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:53:37.693 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:53:37.719 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:37.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:37.179728+0000 mon.a (mon.0) 1864 : audit [INF] from='client.? 172.21.15.80:0/3064010174' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:53:37.819 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:53:37.823 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:37.823 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:53:37.924 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:53:37.951 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:38.049 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:53:38.053 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:38.053 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:53:38.154 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:53:38.181 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:38.362 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:53:38.384 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:53:38.388 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:38.388 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:53:38.489 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:53:38.514 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:37.233374+0000 mgr.y (mgr.14514) 806 : cluster [DBG] pgmap v1043: 122 pgs: 122 active+clean; 5.7 KiB data, 5.0 GiB used, 621 GiB / 626 GiB avail; 595 B/s rd, 0 op/s 2024-02-19T21:53:38.514 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:37.352143+0000 mon.a (mon.0) 1865 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:53:38.514 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:37.360683+0000 mon.a (mon.0) 1866 : audit [INF] from='client.? 172.21.15.80:0/3064010174' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:53:38.514 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:37.360719+0000 mon.a (mon.0) 1867 : cluster [DBG] osdmap e489: 8 total, 8 up, 7 in 2024-02-19T21:53:38.515 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:37.233374+0000 mgr.y (mgr.14514) 806 : cluster [DBG] pgmap v1043: 122 pgs: 122 active+clean; 5.7 KiB data, 5.0 GiB used, 621 GiB / 626 GiB avail; 595 B/s rd, 0 op/s 2024-02-19T21:53:38.515 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:37.352143+0000 mon.a (mon.0) 1865 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:53:38.515 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:37.360683+0000 mon.a (mon.0) 1866 : audit [INF] from='client.? 172.21.15.80:0/3064010174' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:53:38.515 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:37.360719+0000 mon.a (mon.0) 1867 : cluster [DBG] osdmap e489: 8 total, 8 up, 7 in 2024-02-19T21:53:38.516 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:38.618 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:53:38.619 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:53:38.620 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:53:38.621 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:38.622 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:53:38.723 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:53:38.752 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:37.233374+0000 mgr.y (mgr.14514) 806 : cluster [DBG] pgmap v1043: 122 pgs: 122 active+clean; 5.7 KiB data, 5.0 GiB used, 621 GiB / 626 GiB avail; 595 B/s rd, 0 op/s 2024-02-19T21:53:38.753 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:37.352143+0000 mon.a (mon.0) 1865 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:53:38.753 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:37.360683+0000 mon.a (mon.0) 1866 : audit [INF] from='client.? 172.21.15.80:0/3064010174' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:53:38.753 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:37.360719+0000 mon.a (mon.0) 1867 : cluster [DBG] osdmap e489: 8 total, 8 up, 7 in 2024-02-19T21:53:38.756 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:38.777 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:53:38.780 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:38.780 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:53:38.883 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:53:38.911 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:38.964 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:53:38.968 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:38.968 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:53:39.069 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:53:39.096 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:39.344 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:53:39.347 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:39.347 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:53:39.448 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:53:39.480 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:39.502 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:53:39.505 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:39.506 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:53:39.606 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:53:39.636 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:39.656 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:53:39.659 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:39.659 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:53:39.760 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:53:39.788 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:39.808 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:53:39.810 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:39.811 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:53:39.911 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:53:39.939 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:39.959 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:53:39.961 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:39.961 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:53:40.062 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:53:40.090 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:40.109 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:53:40.112 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:40.112 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:53:40.213 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:53:40.240 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:40.259 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:53:40.261 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:40.262 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:53:40.363 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:53:40.395 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:40.503 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:39.233660+0000 mgr.y (mgr.14514) 807 : cluster [DBG] pgmap v1045: 122 pgs: 122 active+clean; 5.7 KiB data, 5.0 GiB used, 621 GiB / 626 GiB avail; 649 B/s rd, 0 op/s 2024-02-19T21:53:40.503 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:39.428175+0000 osd.6 (osd.6) 244 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:53:40.503 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:39.428301+0000 osd.6 (osd.6) 245 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:53:40.504 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:39.233660+0000 mgr.y (mgr.14514) 807 : cluster [DBG] pgmap v1045: 122 pgs: 122 active+clean; 5.7 KiB data, 5.0 GiB used, 621 GiB / 626 GiB avail; 649 B/s rd, 0 op/s 2024-02-19T21:53:40.504 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:39.428175+0000 osd.6 (osd.6) 244 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:53:40.504 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:39.428301+0000 osd.6 (osd.6) 245 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:53:40.504 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:39.503638+0000 mon.a (mon.0) 1868 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:53:40.504 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:40.354882+0000 mon.a (mon.0) 1869 : cluster [DBG] osdmap e490: 8 total, 8 up, 7 in 2024-02-19T21:53:40.746 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:53:40.754 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:39.233660+0000 mgr.y (mgr.14514) 807 : cluster [DBG] pgmap v1045: 122 pgs: 122 active+clean; 5.7 KiB data, 5.0 GiB used, 621 GiB / 626 GiB avail; 649 B/s rd, 0 op/s 2024-02-19T21:53:40.754 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:39.428175+0000 osd.6 (osd.6) 244 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:53:40.754 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:39.428301+0000 osd.6 (osd.6) 245 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:53:40.755 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:39.503638+0000 mon.a (mon.0) 1868 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:53:40.755 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:40.354882+0000 mon.a (mon.0) 1869 : cluster [DBG] osdmap e490: 8 total, 8 up, 7 in 2024-02-19T21:53:40.755 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:40.756 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:53:40.805 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:39.503638+0000 mon.a (mon.0) 1868 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:53:40.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:40.354882+0000 mon.a (mon.0) 1869 : cluster [DBG] osdmap e490: 8 total, 8 up, 7 in 2024-02-19T21:53:40.856 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:53:40.885 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:41.084 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:53:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:53:40] "GET /metrics HTTP/1.1" 200 174179 "" "Prometheus/2.33.4" 2024-02-19T21:53:41.117 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:53:41.120 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:41.121 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:53:41.221 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:53:41.249 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:41.498 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:53:41.500 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:41.500 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:53:41.556 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:53:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:53:41.601 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:53:41.633 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:41.655 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:53:41.658 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:41.659 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:53:41.759 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:53:41.787 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:41.791 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset noscrub 2024-02-19T21:53:42.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:41.168292+0000 mgr.y (mgr.14514) 808 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:53:42.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:41.234049+0000 mgr.y (mgr.14514) 809 : cluster [DBG] pgmap v1047: 122 pgs: 122 active+clean; 5.7 KiB data, 5.0 GiB used, 621 GiB / 626 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-19T21:53:42.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:41.168292+0000 mgr.y (mgr.14514) 808 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:53:42.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:41.234049+0000 mgr.y (mgr.14514) 809 : cluster [DBG] pgmap v1047: 122 pgs: 122 active+clean; 5.7 KiB data, 5.0 GiB used, 621 GiB / 626 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-19T21:53:42.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:41.168292+0000 mgr.y (mgr.14514) 808 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:53:42.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:41.234049+0000 mgr.y (mgr.14514) 809 : cluster [DBG] pgmap v1047: 122 pgs: 122 active+clean; 5.7 KiB data, 5.0 GiB used, 621 GiB / 626 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-19T21:53:43.391 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:53:43.394 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:43.394 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:53:43.495 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:53:43.527 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:43.601 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:53:43.603 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:43.604 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:53:43.704 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:53:43.731 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:43.780 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:42.653597+0000 osd.4 (osd.4) 213 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:53:43.780 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:42.653703+0000 osd.4 (osd.4) 214 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:53:43.780 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:42.653597+0000 osd.4 (osd.4) 213 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:53:43.781 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:42.653703+0000 osd.4 (osd.4) 214 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:53:43.781 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T21:53:43.780+0000 7f2483437700 -1 mon.a@0(leader).osd e491 definitely_dead 0 2024-02-19T21:53:43.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:42.653597+0000 osd.4 (osd.4) 213 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:53:43.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:42.653703+0000 osd.4 (osd.4) 214 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:53:43.939 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:53:43.942 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:43.943 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:53:44.043 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:53:44.072 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:44.299 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:53:44.315 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:53:44.332 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:53:44.349 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:53:44.367 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:53:44.386 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:53:44.403 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:53:44.420 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:53:44.421 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:53:44.423 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:53:44.423 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:53:44.423 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:53:44.423 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:53:44.423 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:53:44.423 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:53:44.423 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:53:44.423 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:53:44.424 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:44.424 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:53:44.525 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:53:44.552 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:44.626 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:53:44.629 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:44.629 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:53:44.647 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'unique_pool_4' created 2024-02-19T21:53:44.648 INFO:teuthology.orchestra.run.smithi080.stderr:marked in osd.3. 2024-02-19T21:53:44.730 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:53:44.761 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:44.771 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:53:44.772 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-02-19T21:53:44.772 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-02-19T21:53:44.772 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-02-19T21:53:44.772 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:53:44.782 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:53:44.785 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:44.785 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:53:44.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:43.234409+0000 mgr.y (mgr.14514) 810 : cluster [DBG] pgmap v1048: 122 pgs: 122 active+clean; 5.7 KiB data, 5.0 GiB used, 621 GiB / 626 GiB avail; 649 B/s rd, 0 op/s 2024-02-19T21:53:44.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:43.519993+0000 mon.a (mon.0) 1870 : cluster [DBG] osdmap e491: 8 total, 8 up, 7 in 2024-02-19T21:53:44.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:43.781144+0000 mon.c (mon.2) 120 : audit [DBG] from='client.? 172.21.15.80:0/3592840899' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["3"]}]: dispatch 2024-02-19T21:53:44.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:43.781443+0000 mon.a (mon.0) 1871 : audit [DBG] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["3"]}]: dispatch 2024-02-19T21:53:44.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:44.280550+0000 mon.a (mon.0) 1872 : audit [DBG] from='client.? 172.21.15.80:0/3410734539' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:53:44.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:43.234409+0000 mgr.y (mgr.14514) 810 : cluster [DBG] pgmap v1048: 122 pgs: 122 active+clean; 5.7 KiB data, 5.0 GiB used, 621 GiB / 626 GiB avail; 649 B/s rd, 0 op/s 2024-02-19T21:53:44.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:43.519993+0000 mon.a (mon.0) 1870 : cluster [DBG] osdmap e491: 8 total, 8 up, 7 in 2024-02-19T21:53:44.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:43.781144+0000 mon.c (mon.2) 120 : audit [DBG] from='client.? 172.21.15.80:0/3592840899' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["3"]}]: dispatch 2024-02-19T21:53:44.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:43.781443+0000 mon.a (mon.0) 1871 : audit [DBG] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["3"]}]: dispatch 2024-02-19T21:53:44.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:44.280550+0000 mon.a (mon.0) 1872 : audit [DBG] from='client.? 172.21.15.80:0/3410734539' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:53:44.886 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:53:44.912 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:43.234409+0000 mgr.y (mgr.14514) 810 : cluster [DBG] pgmap v1048: 122 pgs: 122 active+clean; 5.7 KiB data, 5.0 GiB used, 621 GiB / 626 GiB avail; 649 B/s rd, 0 op/s 2024-02-19T21:53:44.912 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:43.519993+0000 mon.a (mon.0) 1870 : cluster [DBG] osdmap e491: 8 total, 8 up, 7 in 2024-02-19T21:53:44.912 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:43.781144+0000 mon.c (mon.2) 120 : audit [DBG] from='client.? 172.21.15.80:0/3592840899' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["3"]}]: dispatch 2024-02-19T21:53:44.912 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:43.781443+0000 mon.a (mon.0) 1871 : audit [DBG] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["3"]}]: dispatch 2024-02-19T21:53:44.912 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:44.280550+0000 mon.a (mon.0) 1872 : audit [DBG] from='client.? 172.21.15.80:0/3410734539' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:53:44.914 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:44.934 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:53:44.937 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:44.937 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:53:45.038 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:53:45.067 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:46.027 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:44.377864+0000 mon.c (mon.2) 121 : audit [INF] from='client.? 172.21.15.80:0/3372385169' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]: dispatch 2024-02-19T21:53:46.027 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:44.378167+0000 mon.a (mon.0) 1873 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]: dispatch 2024-02-19T21:53:46.027 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:44.630994+0000 mon.a (mon.0) 1874 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["3"]}]': finished 2024-02-19T21:53:46.027 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:44.631076+0000 mon.a (mon.0) 1875 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]': finished 2024-02-19T21:53:46.027 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:44.631145+0000 mon.a (mon.0) 1876 : cluster [DBG] osdmap e492: 8 total, 8 up, 8 in 2024-02-19T21:53:46.027 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:45.356227+0000 mon.a (mon.0) 1877 : cluster [DBG] osdmap e493: 8 total, 8 up, 8 in 2024-02-19T21:53:46.027 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:44.377864+0000 mon.c (mon.2) 121 : audit [INF] from='client.? 172.21.15.80:0/3372385169' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]: dispatch 2024-02-19T21:53:46.027 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:44.378167+0000 mon.a (mon.0) 1873 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]: dispatch 2024-02-19T21:53:46.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:44.630994+0000 mon.a (mon.0) 1874 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["3"]}]': finished 2024-02-19T21:53:46.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:44.631076+0000 mon.a (mon.0) 1875 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]': finished 2024-02-19T21:53:46.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:44.631145+0000 mon.a (mon.0) 1876 : cluster [DBG] osdmap e492: 8 total, 8 up, 8 in 2024-02-19T21:53:46.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:45.356227+0000 mon.a (mon.0) 1877 : cluster [DBG] osdmap e493: 8 total, 8 up, 8 in 2024-02-19T21:53:46.045 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_historic_ops 2024-02-19T21:53:46.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:53:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:53:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:53:46.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:44.377864+0000 mon.c (mon.2) 121 : audit [INF] from='client.? 172.21.15.80:0/3372385169' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]: dispatch 2024-02-19T21:53:46.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:44.378167+0000 mon.a (mon.0) 1873 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]: dispatch 2024-02-19T21:53:46.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:44.630994+0000 mon.a (mon.0) 1874 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["3"]}]': finished 2024-02-19T21:53:46.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:44.631076+0000 mon.a (mon.0) 1875 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]': finished 2024-02-19T21:53:46.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:44.631145+0000 mon.a (mon.0) 1876 : cluster [DBG] osdmap e492: 8 total, 8 up, 8 in 2024-02-19T21:53:46.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:45.356227+0000 mon.a (mon.0) 1877 : cluster [DBG] osdmap e493: 8 total, 8 up, 8 in 2024-02-19T21:53:46.817 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:53:46.820 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:46.821 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:53:46.922 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:53:46.935 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:45.234844+0000 mgr.y (mgr.14514) 811 : cluster [DBG] pgmap v1051: 138 pgs: 12 peering, 9 creating+peering, 7 unknown, 110 active+clean; 5.6 KiB data, 5.3 GiB used, 710 GiB / 715 GiB avail 2024-02-19T21:53:46.935 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:46.366907+0000 mon.a (mon.0) 1878 : cluster [DBG] osdmap e494: 8 total, 8 up, 8 in 2024-02-19T21:53:46.935 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:45.234844+0000 mgr.y (mgr.14514) 811 : cluster [DBG] pgmap v1051: 138 pgs: 12 peering, 9 creating+peering, 7 unknown, 110 active+clean; 5.6 KiB data, 5.3 GiB used, 710 GiB / 715 GiB avail 2024-02-19T21:53:46.936 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:46.366907+0000 mon.a (mon.0) 1878 : cluster [DBG] osdmap e494: 8 total, 8 up, 8 in 2024-02-19T21:53:46.950 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:47.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:45.234844+0000 mgr.y (mgr.14514) 811 : cluster [DBG] pgmap v1051: 138 pgs: 12 peering, 9 creating+peering, 7 unknown, 110 active+clean; 5.6 KiB data, 5.3 GiB used, 710 GiB / 715 GiB avail 2024-02-19T21:53:47.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:46.366907+0000 mon.a (mon.0) 1878 : cluster [DBG] osdmap e494: 8 total, 8 up, 8 in 2024-02-19T21:53:47.468 INFO:tasks.thrashosds.thrasher:Added osd 3 2024-02-19T21:53:47.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:46.365945+0000 osd.7 (osd.7) 252 : cluster [DBG] 6.8 starting backfill to osd.3 from (0'0,0'0] MAX to 66'1 2024-02-19T21:53:47.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:47.369060+0000 mon.a (mon.0) 1879 : cluster [DBG] osdmap e495: 8 total, 8 up, 8 in 2024-02-19T21:53:47.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:46.365945+0000 osd.7 (osd.7) 252 : cluster [DBG] 6.8 starting backfill to osd.3 from (0'0,0'0] MAX to 66'1 2024-02-19T21:53:47.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:47.369060+0000 mon.a (mon.0) 1879 : cluster [DBG] osdmap e495: 8 total, 8 up, 8 in 2024-02-19T21:53:47.774 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:53:47.798 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:53:47.801 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool application enable unique_pool_4 rados --yes-i-really-mean-it || true 2024-02-19T21:53:47.802 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:47.803 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:53:47.826 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:53:47.903 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:53:47.934 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:46.365945+0000 osd.7 (osd.7) 252 : cluster [DBG] 6.8 starting backfill to osd.3 from (0'0,0'0] MAX to 66'1 2024-02-19T21:53:47.934 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:47.369060+0000 mon.a (mon.0) 1879 : cluster [DBG] osdmap e495: 8 total, 8 up, 8 in 2024-02-19T21:53:47.936 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:47.960 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:53:47.961 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:47.961 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:53:48.062 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:53:48.091 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:48.112 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:53:48.114 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:48.115 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:53:48.215 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:53:48.243 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:48.342 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:53:48.345 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:48.346 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:53:48.447 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:53:48.473 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:48.827 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:53:48.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:47.235247+0000 mgr.y (mgr.14514) 812 : cluster [DBG] pgmap v1054: 138 pgs: 2 active+recovering+degraded, 18 peering, 13 creating+peering, 2 unknown, 103 active+clean; 5.6 KiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 11/540 objects misplaced (2.037%) 2024-02-19T21:53:48.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:47.650023+0000 mon.a (mon.0) 1880 : cluster [WRN] Health check failed: Degraded data redundancy: 2 pgs degraded (PG_DEGRADED) 2024-02-19T21:53:48.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:48.370677+0000 mon.a (mon.0) 1881 : cluster [DBG] osdmap e496: 8 total, 8 up, 8 in 2024-02-19T21:53:48.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:47.235247+0000 mgr.y (mgr.14514) 812 : cluster [DBG] pgmap v1054: 138 pgs: 2 active+recovering+degraded, 18 peering, 13 creating+peering, 2 unknown, 103 active+clean; 5.6 KiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 11/540 objects misplaced (2.037%) 2024-02-19T21:53:48.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:47.650023+0000 mon.a (mon.0) 1880 : cluster [WRN] Health check failed: Degraded data redundancy: 2 pgs degraded (PG_DEGRADED) 2024-02-19T21:53:48.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:48.370677+0000 mon.a (mon.0) 1881 : cluster [DBG] osdmap e496: 8 total, 8 up, 8 in 2024-02-19T21:53:49.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:47.235247+0000 mgr.y (mgr.14514) 812 : cluster [DBG] pgmap v1054: 138 pgs: 2 active+recovering+degraded, 18 peering, 13 creating+peering, 2 unknown, 103 active+clean; 5.6 KiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 11/540 objects misplaced (2.037%) 2024-02-19T21:53:49.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:47.650023+0000 mon.a (mon.0) 1880 : cluster [WRN] Health check failed: Degraded data redundancy: 2 pgs degraded (PG_DEGRADED) 2024-02-19T21:53:49.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:48.370677+0000 mon.a (mon.0) 1881 : cluster [DBG] osdmap e496: 8 total, 8 up, 8 in 2024-02-19T21:53:49.717 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:53:49.724 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:53:49.728 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:49.728 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:53:49.829 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:53:49.857 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:49.955 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:53:49.958 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:49.958 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:53:49.978 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:48.966977+0000 mon.a (mon.0) 1882 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:53:49.978 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:48.966977+0000 mon.a (mon.0) 1882 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:53:50.059 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:53:50.094 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:50.115 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:53:50.118 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:50.118 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:53:50.219 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:53:50.246 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:48.966977+0000 mon.a (mon.0) 1882 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:53:50.249 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:50.269 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:53:50.271 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:50.272 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:53:50.373 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:53:50.401 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:50.420 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:53:50.423 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:50.423 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:53:50.524 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:53:50.554 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:50.577 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:53:50.580 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:50.580 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:53:50.681 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:53:50.710 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:50.730 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:53:50.733 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:50.733 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:53:50.834 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:53:50.861 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:51.023 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:53:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:53:50] "GET /metrics HTTP/1.1" 200 176660 "" "Prometheus/2.33.4" 2024-02-19T21:53:51.023 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:49.235653+0000 mgr.y (mgr.14514) 813 : cluster [DBG] pgmap v1057: 138 pgs: 2 active+recovering+degraded, 18 peering, 13 creating+peering, 105 active+clean; 5.6 KiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 11/540 objects misplaced (2.037%) 2024-02-19T21:53:51.023 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:49.235653+0000 mgr.y (mgr.14514) 813 : cluster [DBG] pgmap v1057: 138 pgs: 2 active+recovering+degraded, 18 peering, 13 creating+peering, 105 active+clean; 5.6 KiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 11/540 objects misplaced (2.037%) 2024-02-19T21:53:51.029 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-02-19T21:53:51.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:49.235653+0000 mgr.y (mgr.14514) 813 : cluster [DBG] pgmap v1057: 138 pgs: 2 active+recovering+degraded, 18 peering, 13 creating+peering, 105 active+clean; 5.6 KiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 11/540 objects misplaced (2.037%) 2024-02-19T21:53:51.306 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:53:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:53:51.510 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:53:51.514 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:51.514 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:53:51.615 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:53:51.646 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:51.667 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:53:51.670 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:51.671 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:53:51.771 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:53:51.799 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:52.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:50.972090+0000 mon.c (mon.2) 122 : audit [INF] from='client.? 172.21.15.80:0/1821557707' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:53:52.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:50.972680+0000 mon.a (mon.0) 1883 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:53:52.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:51.023061+0000 mon.a (mon.0) 1884 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:53:52.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:51.027157+0000 mon.a (mon.0) 1885 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:53:52.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:51.027212+0000 mon.a (mon.0) 1886 : cluster [DBG] osdmap e497: 8 total, 8 up, 8 in 2024-02-19T21:53:52.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:50.972090+0000 mon.c (mon.2) 122 : audit [INF] from='client.? 172.21.15.80:0/1821557707' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:53:52.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:50.972680+0000 mon.a (mon.0) 1883 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:53:52.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:51.023061+0000 mon.a (mon.0) 1884 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:53:52.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:51.027157+0000 mon.a (mon.0) 1885 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:53:52.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:51.027212+0000 mon.a (mon.0) 1886 : cluster [DBG] osdmap e497: 8 total, 8 up, 8 in 2024-02-19T21:53:52.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:50.972090+0000 mon.c (mon.2) 122 : audit [INF] from='client.? 172.21.15.80:0/1821557707' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:53:52.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:50.972680+0000 mon.a (mon.0) 1883 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:53:52.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:51.023061+0000 mon.a (mon.0) 1884 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:53:52.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:51.027157+0000 mon.a (mon.0) 1885 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:53:52.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:51.027212+0000 mon.a (mon.0) 1886 : cluster [DBG] osdmap e497: 8 total, 8 up, 8 in 2024-02-19T21:53:52.469 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 4, 5, 6, 7, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 6, 7, 2] 2024-02-19T21:53:52.469 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:53:52.469 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-02-19T21:53:52.470 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd dump -f json-pretty 2024-02-19T21:53:52.604 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:53:53.052 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:53:53.058 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:53.058 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:53:53.159 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:53:53.188 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:53.203 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:51.179246+0000 mgr.y (mgr.14514) 814 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:53:53.203 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:51.236230+0000 mgr.y (mgr.14514) 815 : cluster [DBG] pgmap v1059: 138 pgs: 138 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 19 KiB/s rd, 210 B/s wr, 36 op/s; 180 B/s, 12 objects/s recovering 2024-02-19T21:53:53.203 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:51.240295+0000 osd.4 (osd.4) 215 : cluster [DBG] 4.1b scrub starts 2024-02-19T21:53:53.203 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:51.243737+0000 osd.4 (osd.4) 216 : cluster [DBG] 4.1b scrub ok 2024-02-19T21:53:53.203 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:51.506920+0000 osd.7 (osd.7) 253 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:53:53.203 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:51.509921+0000 osd.7 (osd.7) 254 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:53:53.203 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:51.709231+0000 osd.6 (osd.6) 246 : cluster [DBG] 2.c scrub starts 2024-02-19T21:53:53.204 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:51.712690+0000 osd.6 (osd.6) 247 : cluster [DBG] 2.c scrub ok 2024-02-19T21:53:53.204 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:52.024085+0000 mon.a (mon.0) 1887 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2 pgs degraded) 2024-02-19T21:53:53.204 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:52.026716+0000 mon.a (mon.0) 1888 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:53:53.204 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:52.102486+0000 osd.0 (osd.0) 273 : cluster [DBG] 4.16 scrub starts 2024-02-19T21:53:53.204 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:52.104279+0000 osd.0 (osd.0) 274 : cluster [DBG] 4.16 scrub ok 2024-02-19T21:53:53.204 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:51.179246+0000 mgr.y (mgr.14514) 814 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:53:53.204 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:51.236230+0000 mgr.y (mgr.14514) 815 : cluster [DBG] pgmap v1059: 138 pgs: 138 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 19 KiB/s rd, 210 B/s wr, 36 op/s; 180 B/s, 12 objects/s recovering 2024-02-19T21:53:53.204 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:51.240295+0000 osd.4 (osd.4) 215 : cluster [DBG] 4.1b scrub starts 2024-02-19T21:53:53.204 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:51.243737+0000 osd.4 (osd.4) 216 : cluster [DBG] 4.1b scrub ok 2024-02-19T21:53:53.204 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:51.506920+0000 osd.7 (osd.7) 253 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:53:53.204 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:51.509921+0000 osd.7 (osd.7) 254 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:53:53.204 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:51.709231+0000 osd.6 (osd.6) 246 : cluster [DBG] 2.c scrub starts 2024-02-19T21:53:53.205 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:51.712690+0000 osd.6 (osd.6) 247 : cluster [DBG] 2.c scrub ok 2024-02-19T21:53:53.205 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:52.024085+0000 mon.a (mon.0) 1887 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2 pgs degraded) 2024-02-19T21:53:53.205 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:52.026716+0000 mon.a (mon.0) 1888 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:53:53.205 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:52.102486+0000 osd.0 (osd.0) 273 : cluster [DBG] 4.16 scrub starts 2024-02-19T21:53:53.205 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:52.104279+0000 osd.0 (osd.0) 274 : cluster [DBG] 4.16 scrub ok 2024-02-19T21:53:53.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:51.179246+0000 mgr.y (mgr.14514) 814 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:53:53.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:51.236230+0000 mgr.y (mgr.14514) 815 : cluster [DBG] pgmap v1059: 138 pgs: 138 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 19 KiB/s rd, 210 B/s wr, 36 op/s; 180 B/s, 12 objects/s recovering 2024-02-19T21:53:53.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:51.240295+0000 osd.4 (osd.4) 215 : cluster [DBG] 4.1b scrub starts 2024-02-19T21:53:53.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:51.243737+0000 osd.4 (osd.4) 216 : cluster [DBG] 4.1b scrub ok 2024-02-19T21:53:53.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:51.506920+0000 osd.7 (osd.7) 253 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:53:53.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:51.509921+0000 osd.7 (osd.7) 254 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:53:53.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:51.709231+0000 osd.6 (osd.6) 246 : cluster [DBG] 2.c scrub starts 2024-02-19T21:53:53.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:51.712690+0000 osd.6 (osd.6) 247 : cluster [DBG] 2.c scrub ok 2024-02-19T21:53:53.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:52.024085+0000 mon.a (mon.0) 1887 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2 pgs degraded) 2024-02-19T21:53:53.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:52.026716+0000 mon.a (mon.0) 1888 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:53:53.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:52.102486+0000 osd.0 (osd.0) 273 : cluster [DBG] 4.16 scrub starts 2024-02-19T21:53:53.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:52.104279+0000 osd.0 (osd.0) 274 : cluster [DBG] 4.16 scrub ok 2024-02-19T21:53:54.188 INFO:teuthology.orchestra.run.smithi080.stderr:enabled application 'rados' on pool 'unique_pool_4' 2024-02-19T21:53:54.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:52.501955+0000 osd.3 (osd.3) 232 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:53:54.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:52.502927+0000 osd.3 (osd.3) 233 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:53:54.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:52.712545+0000 osd.6 (osd.6) 248 : cluster [DBG] 2.7 scrub starts 2024-02-19T21:53:54.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:52.715482+0000 osd.6 (osd.6) 249 : cluster [DBG] 2.7 scrub ok 2024-02-19T21:53:54.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:53.163677+0000 mon.a (mon.0) 1889 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:53:54.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:53.164379+0000 mon.a (mon.0) 1890 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:53:54.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:53.171516+0000 mon.a (mon.0) 1891 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:53:54.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:53.262676+0000 osd.2 (osd.2) 9 : cluster [DBG] 2.10 scrub starts 2024-02-19T21:53:54.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:53.263535+0000 osd.2 (osd.2) 10 : cluster [DBG] 2.10 scrub ok 2024-02-19T21:53:54.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:53.414738+0000 osd.5 (osd.5) 273 : cluster [DBG] 5.7 scrub starts 2024-02-19T21:53:54.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:53.417634+0000 osd.5 (osd.5) 274 : cluster [DBG] 5.7 scrub ok 2024-02-19T21:53:54.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:53.580237+0000 mon.a (mon.0) 1892 : audit [INF] from='client.? 172.21.15.80:0/2217322165' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T21:53:54.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:52.501955+0000 osd.3 (osd.3) 232 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:53:54.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:52.502927+0000 osd.3 (osd.3) 233 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:53:54.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:52.712545+0000 osd.6 (osd.6) 248 : cluster [DBG] 2.7 scrub starts 2024-02-19T21:53:54.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:52.715482+0000 osd.6 (osd.6) 249 : cluster [DBG] 2.7 scrub ok 2024-02-19T21:53:54.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:53.163677+0000 mon.a (mon.0) 1889 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:53:54.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:53.164379+0000 mon.a (mon.0) 1890 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:53:54.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:53.171516+0000 mon.a (mon.0) 1891 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:53:54.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:53.262676+0000 osd.2 (osd.2) 9 : cluster [DBG] 2.10 scrub starts 2024-02-19T21:53:54.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:53.263535+0000 osd.2 (osd.2) 10 : cluster [DBG] 2.10 scrub ok 2024-02-19T21:53:54.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:53.414738+0000 osd.5 (osd.5) 273 : cluster [DBG] 5.7 scrub starts 2024-02-19T21:53:54.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:53.417634+0000 osd.5 (osd.5) 274 : cluster [DBG] 5.7 scrub ok 2024-02-19T21:53:54.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:53.580237+0000 mon.a (mon.0) 1892 : audit [INF] from='client.? 172.21.15.80:0/2217322165' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T21:53:54.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:52.501955+0000 osd.3 (osd.3) 232 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:53:54.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:52.502927+0000 osd.3 (osd.3) 233 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:53:54.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:52.712545+0000 osd.6 (osd.6) 248 : cluster [DBG] 2.7 scrub starts 2024-02-19T21:53:54.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:52.715482+0000 osd.6 (osd.6) 249 : cluster [DBG] 2.7 scrub ok 2024-02-19T21:53:54.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:53.163677+0000 mon.a (mon.0) 1889 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:53:54.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:53.164379+0000 mon.a (mon.0) 1890 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:53:54.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:53.171516+0000 mon.a (mon.0) 1891 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:53:54.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:53.262676+0000 osd.2 (osd.2) 9 : cluster [DBG] 2.10 scrub starts 2024-02-19T21:53:54.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:53.263535+0000 osd.2 (osd.2) 10 : cluster [DBG] 2.10 scrub ok 2024-02-19T21:53:54.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:53.414738+0000 osd.5 (osd.5) 273 : cluster [DBG] 5.7 scrub starts 2024-02-19T21:53:54.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:53.417634+0000 osd.5 (osd.5) 274 : cluster [DBG] 5.7 scrub ok 2024-02-19T21:53:54.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:53.580237+0000 mon.a (mon.0) 1892 : audit [INF] from='client.? 172.21.15.80:0/2217322165' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T21:53:54.627 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-19T21:53:54.639 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:53:54.642 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:54.643 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:53:54.744 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:53:54.776 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:54.798 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:53:54.801 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:54.801 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:53:54.863 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:53:54.863 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:53:54.902 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:53:54.931 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:54.952 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:53:54.955 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:54.955 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:53:55.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:53.236618+0000 mgr.y (mgr.14514) 816 : cluster [DBG] pgmap v1060: 138 pgs: 138 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 15 KiB/s rd, 170 B/s wr, 29 op/s; 146 B/s, 9 objects/s recovering 2024-02-19T21:53:55.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:54.184468+0000 mon.a (mon.0) 1893 : audit [INF] from='client.? 172.21.15.80:0/2217322165' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-19T21:53:55.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:54.184535+0000 mon.a (mon.0) 1894 : cluster [DBG] osdmap e498: 8 total, 8 up, 8 in 2024-02-19T21:53:55.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:54.275135+0000 osd.2 (osd.2) 11 : cluster [DBG] 4.19 scrub starts 2024-02-19T21:53:55.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:54.277316+0000 osd.2 (osd.2) 12 : cluster [DBG] 4.19 scrub ok 2024-02-19T21:53:55.056 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:53:55.086 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:55.292 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:53:55.294 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:53.236618+0000 mgr.y (mgr.14514) 816 : cluster [DBG] pgmap v1060: 138 pgs: 138 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 15 KiB/s rd, 170 B/s wr, 29 op/s; 146 B/s, 9 objects/s recovering 2024-02-19T21:53:55.294 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:54.184468+0000 mon.a (mon.0) 1893 : audit [INF] from='client.? 172.21.15.80:0/2217322165' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-19T21:53:55.295 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:54.184535+0000 mon.a (mon.0) 1894 : cluster [DBG] osdmap e498: 8 total, 8 up, 8 in 2024-02-19T21:53:55.295 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:54.275135+0000 osd.2 (osd.2) 11 : cluster [DBG] 4.19 scrub starts 2024-02-19T21:53:55.295 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:54.277316+0000 osd.2 (osd.2) 12 : cluster [DBG] 4.19 scrub ok 2024-02-19T21:53:55.295 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:53.236618+0000 mgr.y (mgr.14514) 816 : cluster [DBG] pgmap v1060: 138 pgs: 138 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 15 KiB/s rd, 170 B/s wr, 29 op/s; 146 B/s, 9 objects/s recovering 2024-02-19T21:53:55.295 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:54.184468+0000 mon.a (mon.0) 1893 : audit [INF] from='client.? 172.21.15.80:0/2217322165' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-02-19T21:53:55.295 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:54.184535+0000 mon.a (mon.0) 1894 : cluster [DBG] osdmap e498: 8 total, 8 up, 8 in 2024-02-19T21:53:55.295 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:54.275135+0000 osd.2 (osd.2) 11 : cluster [DBG] 4.19 scrub starts 2024-02-19T21:53:55.295 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:54.277316+0000 osd.2 (osd.2) 12 : cluster [DBG] 4.19 scrub ok 2024-02-19T21:53:55.296 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:55.296 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:53:55.300 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:53:55.397 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:53:55.424 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:55.497 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:53:55.500 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:55.500 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:53:55.601 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:53:55.628 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:55.647 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:53:55.649 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:55.650 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:53:55.751 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:53:55.778 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:55.797 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:53:55.799 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:55.800 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:53:55.901 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:53:55.925 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:53:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:53:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:53:55.927 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:55.945 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:53:55.948 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:55.949 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:53:56.047 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:53:56.047 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:53:56.047 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:53:56.048 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:53:56.048 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:53:56.049 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:53:56.050 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:53:56.068 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:53:56.080 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:56.098 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:53:56.099 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:53:56.099 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:53:56.100 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:53:56.100 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:53:56.100 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:53:56.100 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:53:56.100 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:53:56.100 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:53:56.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:54.496765+0000 osd.3 (osd.3) 234 : cluster [DBG] 4.14 scrub starts 2024-02-19T21:53:56.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:54.498591+0000 osd.3 (osd.3) 235 : cluster [DBG] 4.14 scrub ok 2024-02-19T21:53:56.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:54.627006+0000 osd.6 (osd.6) 250 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:53:56.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:54.629903+0000 osd.6 (osd.6) 251 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:53:56.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:55.939511+0000 mon.a (mon.0) 1895 : audit [DBG] from='client.? 172.21.15.80:0/1800060784' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:53:56.345 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:54.496765+0000 osd.3 (osd.3) 234 : cluster [DBG] 4.14 scrub starts 2024-02-19T21:53:56.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:54.498591+0000 osd.3 (osd.3) 235 : cluster [DBG] 4.14 scrub ok 2024-02-19T21:53:56.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:54.627006+0000 osd.6 (osd.6) 250 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:53:56.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:54.629903+0000 osd.6 (osd.6) 251 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:53:56.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:55.939511+0000 mon.a (mon.0) 1895 : audit [DBG] from='client.? 172.21.15.80:0/1800060784' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:53:56.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:54.496765+0000 osd.3 (osd.3) 234 : cluster [DBG] 4.14 scrub starts 2024-02-19T21:53:56.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:54.498591+0000 osd.3 (osd.3) 235 : cluster [DBG] 4.14 scrub ok 2024-02-19T21:53:56.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:54.627006+0000 osd.6 (osd.6) 250 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:53:56.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:54.629903+0000 osd.6 (osd.6) 251 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:53:56.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:55.939511+0000 mon.a (mon.0) 1895 : audit [DBG] from='client.? 172.21.15.80:0/1800060784' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:53:57.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:55.237186+0000 mgr.y (mgr.14514) 817 : cluster [DBG] pgmap v1062: 138 pgs: 138 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 14 KiB/s rd, 149 B/s wr, 25 op/s; 128 B/s, 8 objects/s recovering 2024-02-19T21:53:57.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:55.244746+0000 osd.4 (osd.4) 217 : cluster [DBG] 6.e scrub starts 2024-02-19T21:53:57.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:55.275764+0000 osd.4 (osd.4) 218 : cluster [DBG] 6.e scrub ok 2024-02-19T21:53:57.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:55.476231+0000 osd.5 (osd.5) 275 : cluster [DBG] 5.f scrub starts 2024-02-19T21:53:57.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:55.479694+0000 osd.5 (osd.5) 276 : cluster [DBG] 5.f scrub ok 2024-02-19T21:53:57.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:55.568605+0000 osd.7 (osd.7) 255 : cluster [DBG] 5.4 scrub starts 2024-02-19T21:53:57.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:55.571578+0000 osd.7 (osd.7) 256 : cluster [DBG] 5.4 scrub ok 2024-02-19T21:53:57.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:55.594346+0000 osd.6 (osd.6) 252 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:53:57.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:55.597331+0000 osd.6 (osd.6) 253 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:53:57.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:56.233784+0000 osd.2 (osd.2) 13 : cluster [DBG] 5.8 scrub starts 2024-02-19T21:53:57.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:56.234546+0000 osd.2 (osd.2) 14 : cluster [DBG] 5.8 scrub ok 2024-02-19T21:53:57.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:56.365886+0000 osd.1 (osd.1) 252 : cluster [DBG] 3.0 scrub starts 2024-02-19T21:53:57.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:56.369586+0000 osd.1 (osd.1) 253 : cluster [DBG] 3.0 scrub ok 2024-02-19T21:53:57.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:56.584960+0000 osd.7 (osd.7) 257 : cluster [DBG] 5.14 scrub starts 2024-02-19T21:53:57.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:56.588417+0000 osd.7 (osd.7) 258 : cluster [DBG] 5.14 scrub ok 2024-02-19T21:53:57.330 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:53:57.334 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:57.335 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:53:57.335 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:55.237186+0000 mgr.y (mgr.14514) 817 : cluster [DBG] pgmap v1062: 138 pgs: 138 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 14 KiB/s rd, 149 B/s wr, 25 op/s; 128 B/s, 8 objects/s recovering 2024-02-19T21:53:57.335 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:55.244746+0000 osd.4 (osd.4) 217 : cluster [DBG] 6.e scrub starts 2024-02-19T21:53:57.335 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:55.275764+0000 osd.4 (osd.4) 218 : cluster [DBG] 6.e scrub ok 2024-02-19T21:53:57.335 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:55.476231+0000 osd.5 (osd.5) 275 : cluster [DBG] 5.f scrub starts 2024-02-19T21:53:57.335 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:55.479694+0000 osd.5 (osd.5) 276 : cluster [DBG] 5.f scrub ok 2024-02-19T21:53:57.335 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:55.568605+0000 osd.7 (osd.7) 255 : cluster [DBG] 5.4 scrub starts 2024-02-19T21:53:57.335 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:55.571578+0000 osd.7 (osd.7) 256 : cluster [DBG] 5.4 scrub ok 2024-02-19T21:53:57.335 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:55.594346+0000 osd.6 (osd.6) 252 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:53:57.335 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:55.597331+0000 osd.6 (osd.6) 253 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:53:57.335 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:56.233784+0000 osd.2 (osd.2) 13 : cluster [DBG] 5.8 scrub starts 2024-02-19T21:53:57.336 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:56.234546+0000 osd.2 (osd.2) 14 : cluster [DBG] 5.8 scrub ok 2024-02-19T21:53:57.336 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:56.365886+0000 osd.1 (osd.1) 252 : cluster [DBG] 3.0 scrub starts 2024-02-19T21:53:57.336 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:56.369586+0000 osd.1 (osd.1) 253 : cluster [DBG] 3.0 scrub ok 2024-02-19T21:53:57.336 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:56.584960+0000 osd.7 (osd.7) 257 : cluster [DBG] 5.14 scrub starts 2024-02-19T21:53:57.336 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:56.588417+0000 osd.7 (osd.7) 258 : cluster [DBG] 5.14 scrub ok 2024-02-19T21:53:57.336 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:55.237186+0000 mgr.y (mgr.14514) 817 : cluster [DBG] pgmap v1062: 138 pgs: 138 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 14 KiB/s rd, 149 B/s wr, 25 op/s; 128 B/s, 8 objects/s recovering 2024-02-19T21:53:57.336 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:55.244746+0000 osd.4 (osd.4) 217 : cluster [DBG] 6.e scrub starts 2024-02-19T21:53:57.336 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:55.275764+0000 osd.4 (osd.4) 218 : cluster [DBG] 6.e scrub ok 2024-02-19T21:53:57.336 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:55.476231+0000 osd.5 (osd.5) 275 : cluster [DBG] 5.f scrub starts 2024-02-19T21:53:57.336 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:55.479694+0000 osd.5 (osd.5) 276 : cluster [DBG] 5.f scrub ok 2024-02-19T21:53:57.336 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:55.568605+0000 osd.7 (osd.7) 255 : cluster [DBG] 5.4 scrub starts 2024-02-19T21:53:57.336 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:55.571578+0000 osd.7 (osd.7) 256 : cluster [DBG] 5.4 scrub ok 2024-02-19T21:53:57.337 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:55.594346+0000 osd.6 (osd.6) 252 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:53:57.337 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:55.597331+0000 osd.6 (osd.6) 253 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:53:57.337 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:56.233784+0000 osd.2 (osd.2) 13 : cluster [DBG] 5.8 scrub starts 2024-02-19T21:53:57.337 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:56.234546+0000 osd.2 (osd.2) 14 : cluster [DBG] 5.8 scrub ok 2024-02-19T21:53:57.337 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:56.365886+0000 osd.1 (osd.1) 252 : cluster [DBG] 3.0 scrub starts 2024-02-19T21:53:57.337 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:56.369586+0000 osd.1 (osd.1) 253 : cluster [DBG] 3.0 scrub ok 2024-02-19T21:53:57.337 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:56.584960+0000 osd.7 (osd.7) 257 : cluster [DBG] 5.14 scrub starts 2024-02-19T21:53:57.337 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:56.588417+0000 osd.7 (osd.7) 258 : cluster [DBG] 5.14 scrub ok 2024-02-19T21:53:57.436 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:53:57.468 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:57.490 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:53:57.492 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:57.493 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:53:57.593 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:53:57.622 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:57.643 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:53:57.645 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:57.646 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:53:57.747 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:53:57.777 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:57.842 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.1 dump_ops_in_flight 2024-02-19T21:53:57.925 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:53:57.930 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:57.930 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:53:58.031 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:53:58.057 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:56.427851+0000 osd.3 (osd.3) 236 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:53:58.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:56.431334+0000 osd.3 (osd.3) 237 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:53:58.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:56.580814+0000 osd.6 (osd.6) 254 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:53:58.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:56.583703+0000 osd.6 (osd.6) 255 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:53:58.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:57.589990+0000 osd.7 (osd.7) 259 : cluster [DBG] 6.12 scrub starts 2024-02-19T21:53:58.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:57.593315+0000 osd.7 (osd.7) 260 : cluster [DBG] 6.12 scrub ok 2024-02-19T21:53:58.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:56.427851+0000 osd.3 (osd.3) 236 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:53:58.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:56.431334+0000 osd.3 (osd.3) 237 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:53:58.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:56.580814+0000 osd.6 (osd.6) 254 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:53:58.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:56.583703+0000 osd.6 (osd.6) 255 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:53:58.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:57.589990+0000 osd.7 (osd.7) 259 : cluster [DBG] 6.12 scrub starts 2024-02-19T21:53:58.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:57.593315+0000 osd.7 (osd.7) 260 : cluster [DBG] 6.12 scrub ok 2024-02-19T21:53:58.061 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:58.227 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:53:58.227 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:53:58.227 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 498, 2024-02-19T21:53:58.227 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "6f763558-cf6d-11ee-95bb-87774f69a715", 2024-02-19T21:53:58.227 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2024-02-19T21:26:16.880265+0000", 2024-02-19T21:53:58.227 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2024-02-19T21:53:54.169763+0000", 2024-02-19T21:53:58.227 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2024-02-19T21:49:07.286446+0000", 2024-02-19T21:53:58.227 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2024-02-19T21:53:44.626155+0000", 2024-02-19T21:53:58.227 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-02-19T21:53:58.227 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5804032, 2024-02-19T21:53:58.227 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2024-02-19T21:53:58.228 INFO:teuthology.orchestra.run.smithi080.stdout: "nodeep-scrub", 2024-02-19T21:53:58.228 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2024-02-19T21:53:58.228 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2024-02-19T21:53:58.228 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2024-02-19T21:53:58.228 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2024-02-19T21:53:58.228 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:53:58.228 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 19, 2024-02-19T21:53:58.228 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2024-02-19T21:53:58.228 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-02-19T21:53:58.228 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2024-02-19T21:53:58.228 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2024-02-19T21:53:58.228 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 11, 2024-02-19T21:53:58.228 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2024-02-19T21:53:58.228 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "luminous", 2024-02-19T21:53:58.229 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "luminous", 2024-02-19T21:53:58.229 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "pacific", 2024-02-19T21:53:58.229 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2024-02-19T21:53:58.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.229 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2024-02-19T21:53:58.229 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "device_health_metrics", 2024-02-19T21:53:58.229 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:30:05.947623+0000", 2024-02-19T21:53:58.229 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:53:58.229 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:53:58.229 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:53:58.229 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:53:58.229 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:53:58.229 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:53:58.229 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:53:58.230 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:53:58.230 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:53:58.230 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:53:58.230 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:53:58.230 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:53:58.230 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 1, 2024-02-19T21:53:58.230 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 1, 2024-02-19T21:53:58.230 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 1, 2024-02-19T21:53:58.230 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 1, 2024-02-19T21:53:58.230 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 1, 2024-02-19T21:53:58.231 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:53:58.231 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:53:58.231 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:53:58.231 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:53:58.231 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:53:58.231 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:53:58.231 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:53:58.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.231 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "74", 2024-02-19T21:53:58.231 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:53:58.231 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:53:58.231 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:53:58.231 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:53:58.231 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:53:58.232 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:53:58.232 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:53:58.232 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:53:58.232 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:53:58.232 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:53:58.232 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:53:58.232 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:53:58.232 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:53:58.232 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:53:58.232 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:53:58.232 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:53:58.232 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:53:58.232 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:53:58.233 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:53:58.233 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:53:58.233 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:53:58.233 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:53:58.233 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:53:58.233 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:53:58.233 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:53:58.233 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:53:58.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.233 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:53:58.233 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:53:58.233 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:53:58.233 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:53:58.233 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:53:58.233 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:53:58.234 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:53:58.234 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:53:58.234 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:53:58.234 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:53:58.234 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:53:58.234 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2024-02-19T21:53:58.234 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_max": 32, 2024-02-19T21:53:58.234 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 1 2024-02-19T21:53:58.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.234 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:53:58.234 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_devicehealth": {} 2024-02-19T21:53:58.234 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.235 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 2, 2024-02-19T21:53:58.235 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": ".rgw.root", 2024-02-19T21:53:58.235 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:22.082250+0000", 2024-02-19T21:53:58.235 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:53:58.235 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:53:58.235 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:53:58.235 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:53:58.235 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:53:58.235 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:53:58.235 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:53:58.235 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:53:58.235 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:53:58.235 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:53:58.235 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:53:58.236 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:53:58.236 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:53:58.236 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:53:58.236 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:53:58.236 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:53:58.236 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:53:58.236 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:53:58.236 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:53:58.236 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:53:58.236 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:53:58.236 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:53:58.236 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:53:58.236 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:53:58.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.237 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "60", 2024-02-19T21:53:58.237 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:53:58.237 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:53:58.237 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:53:58.237 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:53:58.237 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:53:58.237 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:53:58.237 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:53:58.237 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:53:58.237 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:53:58.237 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:53:58.237 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:53:58.237 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:53:58.237 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:53:58.237 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:53:58.238 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:53:58.238 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:53:58.238 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:53:58.238 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:53:58.238 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:53:58.238 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:53:58.238 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:53:58.238 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:53:58.238 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:53:58.238 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:53:58.238 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:53:58.238 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:53:58.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.238 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:53:58.238 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:53:58.238 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:53:58.239 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:53:58.239 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:53:58.239 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:53:58.239 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:53:58.239 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:53:58.239 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:53:58.239 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:53:58.239 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:53:58.239 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:53:58.239 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:53:58.239 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:53:58.239 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.240 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 3, 2024-02-19T21:53:58.240 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "iscsi", 2024-02-19T21:53:58.240 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:22.333164+0000", 2024-02-19T21:53:58.240 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:53:58.240 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:53:58.240 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:53:58.240 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:53:58.240 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:53:58.240 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:53:58.240 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:53:58.240 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:53:58.240 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:53:58.240 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:53:58.240 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:53:58.241 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:53:58.241 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 3, 2024-02-19T21:53:58.241 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 3, 2024-02-19T21:53:58.241 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 3, 2024-02-19T21:53:58.241 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 3, 2024-02-19T21:53:58.241 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 3, 2024-02-19T21:53:58.241 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:53:58.241 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:53:58.241 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:53:58.241 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:53:58.241 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:53:58.241 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:53:58.241 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:53:58.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.241 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "62", 2024-02-19T21:53:58.242 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:53:58.242 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:53:58.242 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:53:58.242 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:53:58.242 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:53:58.242 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:53:58.242 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:53:58.242 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:53:58.242 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:53:58.242 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:53:58.242 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:53:58.242 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:53:58.242 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:53:58.242 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:53:58.242 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:53:58.242 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:53:58.243 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:53:58.243 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:53:58.243 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:53:58.243 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:53:58.243 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:53:58.243 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:53:58.243 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:53:58.243 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:53:58.243 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:53:58.243 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:53:58.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.243 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:53:58.243 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:53:58.243 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:53:58.243 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:53:58.244 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:53:58.244 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:53:58.244 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:53:58.244 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:53:58.244 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:53:58.244 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:53:58.244 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:53:58.244 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:53:58.244 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:53:58.244 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2024-02-19T21:53:58.244 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.245 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 4, 2024-02-19T21:53:58.245 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.log", 2024-02-19T21:53:58.245 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:23.632615+0000", 2024-02-19T21:53:58.245 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:53:58.245 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:53:58.245 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:53:58.245 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:53:58.245 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:53:58.245 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:53:58.245 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:53:58.245 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:53:58.245 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:53:58.245 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:53:58.245 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:53:58.246 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:53:58.246 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:53:58.246 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:53:58.246 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:53:58.246 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:53:58.246 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:53:58.246 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:53:58.246 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:53:58.246 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:53:58.246 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:53:58.246 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:53:58.246 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:53:58.246 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:53:58.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.247 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "62", 2024-02-19T21:53:58.247 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:53:58.247 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:53:58.247 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:53:58.247 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:53:58.247 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:53:58.247 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:53:58.247 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:53:58.247 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:53:58.247 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:53:58.247 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:53:58.247 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:53:58.247 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:53:58.247 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:53:58.247 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:53:58.248 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:53:58.248 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:53:58.248 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:53:58.248 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:53:58.248 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:53:58.248 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:53:58.248 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:53:58.248 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:53:58.248 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:53:58.248 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:53:58.248 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:53:58.248 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:53:58.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.248 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:53:58.248 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:53:58.249 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:53:58.249 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:53:58.249 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:53:58.249 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:53:58.249 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:53:58.249 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:53:58.249 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:53:58.249 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:53:58.249 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:53:58.249 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:53:58.249 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:53:58.249 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:53:58.249 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.249 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 5, 2024-02-19T21:53:58.250 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.control", 2024-02-19T21:53:58.250 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:25.600876+0000", 2024-02-19T21:53:58.250 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:53:58.250 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:53:58.250 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:53:58.250 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:53:58.250 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:53:58.250 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:53:58.250 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:53:58.250 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:53:58.250 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:53:58.250 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:53:58.250 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:53:58.250 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:53:58.251 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 22, 2024-02-19T21:53:58.251 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 22, 2024-02-19T21:53:58.251 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 22, 2024-02-19T21:53:58.251 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 22, 2024-02-19T21:53:58.251 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 22, 2024-02-19T21:53:58.251 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:53:58.251 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "5.16", 2024-02-19T21:53:58.251 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 298, 2024-02-19T21:53:58.251 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 297, 2024-02-19T21:53:58.251 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 297, 2024-02-19T21:53:58.251 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:53:58.251 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:53:58.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.251 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "325", 2024-02-19T21:53:58.251 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:53:58.251 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "298", 2024-02-19T21:53:58.252 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "296", 2024-02-19T21:53:58.252 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:53:58.252 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:53:58.252 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:53:58.252 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:53:58.252 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:53:58.252 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:53:58.252 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:53:58.252 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:53:58.252 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:53:58.252 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:53:58.252 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:53:58.252 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:53:58.252 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:53:58.253 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:53:58.253 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:53:58.253 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:53:58.253 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:53:58.253 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:53:58.253 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:53:58.253 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:53:58.253 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:53:58.253 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:53:58.253 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:53:58.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.253 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:53:58.253 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:53:58.253 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:53:58.253 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:53:58.253 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:53:58.253 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:53:58.254 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:53:58.254 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:53:58.254 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:53:58.254 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:53:58.254 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:53:58.254 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:53:58.254 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:53:58.254 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:53:58.254 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.254 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.254 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.254 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 6, 2024-02-19T21:53:58.254 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.meta", 2024-02-19T21:53:58.254 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:27.661242+0000", 2024-02-19T21:53:58.254 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:53:58.255 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:53:58.255 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:53:58.255 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:53:58.255 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:53:58.255 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:53:58.255 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:53:58.255 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:53:58.255 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:53:58.255 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:53:58.255 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:53:58.255 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:53:58.255 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:53:58.255 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:53:58.255 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:53:58.255 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:53:58.255 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:53:58.255 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:53:58.256 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "6.16", 2024-02-19T21:53:58.256 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 243, 2024-02-19T21:53:58.256 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 242, 2024-02-19T21:53:58.256 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 242, 2024-02-19T21:53:58.256 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:53:58.256 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:53:58.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.256 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "304", 2024-02-19T21:53:58.256 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:53:58.256 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "243", 2024-02-19T21:53:58.256 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "302", 2024-02-19T21:53:58.256 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:53:58.256 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:53:58.256 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:53:58.257 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:53:58.257 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:53:58.257 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:53:58.257 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:53:58.257 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:53:58.257 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:53:58.257 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:53:58.257 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:53:58.257 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:53:58.257 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:53:58.257 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:53:58.257 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:53:58.257 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:53:58.257 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:53:58.258 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:53:58.258 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:53:58.258 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:53:58.258 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:53:58.258 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:53:58.258 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:53:58.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.258 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:53:58.258 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:53:58.258 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:53:58.258 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:53:58.258 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:53:58.258 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:53:58.258 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:53:58.259 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:53:58.259 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:53:58.259 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:53:58.259 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:53:58.259 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2024-02-19T21:53:58.259 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4 2024-02-19T21:53:58.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.259 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:53:58.259 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:53:58.259 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.259 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 11, 2024-02-19T21:53:58.259 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "unique_pool_4", 2024-02-19T21:53:58.259 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:53:44.625837+0000", 2024-02-19T21:53:58.260 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:53:58.260 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:53:58.260 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:53:58.260 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:53:58.260 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:53:58.260 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:53:58.260 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:53:58.260 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:53:58.260 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:53:58.260 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:53:58.260 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:53:58.260 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:53:58.260 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 16, 2024-02-19T21:53:58.261 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 16, 2024-02-19T21:53:58.261 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 16, 2024-02-19T21:53:58.261 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 16, 2024-02-19T21:53:58.261 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 16, 2024-02-19T21:53:58.261 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:53:58.261 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:53:58.261 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:53:58.261 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:53:58.261 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:53:58.261 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:53:58.261 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:53:58.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.261 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "498", 2024-02-19T21:53:58.261 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:53:58.261 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:53:58.262 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:53:58.262 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:53:58.262 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:53:58.262 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:53:58.262 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:53:58.262 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:53:58.262 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:53:58.262 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:53:58.262 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:53:58.262 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:53:58.262 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:53:58.262 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:53:58.262 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:53:58.262 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:53:58.262 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:53:58.262 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:53:58.263 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:53:58.263 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:53:58.263 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:53:58.263 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:53:58.263 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:53:58.263 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:53:58.263 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:53:58.263 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:53:58.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.263 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:53:58.263 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:53:58.263 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:53:58.263 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:53:58.263 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:53:58.263 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:53:58.263 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:53:58.263 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:53:58.264 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:53:58.264 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:53:58.264 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:53:58.264 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:53:58.264 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:53:58.264 INFO:teuthology.orchestra.run.smithi080.stdout: "rados": {} 2024-02-19T21:53:58.264 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.264 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.264 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:53:58.264 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:53:58.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.264 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2024-02-19T21:53:58.264 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "a72c63f6-46b3-4202-99da-7b0c92b799a5", 2024-02-19T21:53:58.264 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:53:58.264 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:53:58.265 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:53:58.265 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:53:58.265 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:53:58.265 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:53:58.265 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 8, 2024-02-19T21:53:58.265 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 492, 2024-02-19T21:53:58.265 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:53:58.265 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:53:58.265 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:53:58.265 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.265 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.265 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.265 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2024-02-19T21:53:58.265 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:53:58.265 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.266 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.266 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.266 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2024-02-19T21:53:58.266 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:53:58.266 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.266 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.266 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.266 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:53:58.266 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.266 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.266 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.266 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2024-02-19T21:53:58.266 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:53:58.266 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.266 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.267 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.267 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2024-02-19T21:53:58.267 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:53:58.267 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.267 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.267 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.267 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:53:58.267 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.267 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.267 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.267 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2024-02-19T21:53:58.267 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:53:58.267 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.267 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.267 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.267 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2024-02-19T21:53:58.268 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:53:58.268 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.268 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.268 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:53:58.268 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.268 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.268 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2024-02-19T21:53:58.268 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:53:58.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.268 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.269 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2024-02-19T21:53:58.269 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:53:58.269 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.269 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.269 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6803/3531298825", 2024-02-19T21:53:58.269 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6805/3531298825", 2024-02-19T21:53:58.269 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6809/3531298825", 2024-02-19T21:53:58.269 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6807/3531298825", 2024-02-19T21:53:58.269 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:53:58.269 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:53:58.269 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:53:58.269 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.269 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2024-02-19T21:53:58.269 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "7d4e170e-b0ca-4e19-be35-4038ca126ee6", 2024-02-19T21:53:58.270 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:53:58.270 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:53:58.270 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:53:58.270 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:53:58.270 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:53:58.270 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:53:58.270 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-02-19T21:53:58.270 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 492, 2024-02-19T21:53:58.270 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:53:58.270 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:53:58.270 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:53:58.270 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.270 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.270 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.270 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2024-02-19T21:53:58.270 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:53:58.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.271 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.271 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.271 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2024-02-19T21:53:58.271 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:53:58.271 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.271 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.271 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:53:58.271 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.271 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.271 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.271 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2024-02-19T21:53:58.271 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:53:58.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.272 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.272 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.272 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2024-02-19T21:53:58.272 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:53:58.272 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.272 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.272 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:53:58.272 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.272 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.272 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.272 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2024-02-19T21:53:58.272 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:53:58.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.272 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.273 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.273 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2024-02-19T21:53:58.273 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:53:58.273 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.273 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.273 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:53:58.273 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.273 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.273 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.273 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2024-02-19T21:53:58.273 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:53:58.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.273 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.273 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.273 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2024-02-19T21:53:58.274 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:53:58.274 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.274 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.274 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6811/1497235950", 2024-02-19T21:53:58.274 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6813/1497235950", 2024-02-19T21:53:58.274 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6817/1497235950", 2024-02-19T21:53:58.274 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6815/1497235950", 2024-02-19T21:53:58.274 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:53:58.274 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:53:58.274 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:53:58.274 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.274 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.274 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2024-02-19T21:53:58.275 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "cf461b67-f3e8-45e9-b2f6-777752ba5574", 2024-02-19T21:53:58.275 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:53:58.275 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:53:58.275 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:53:58.275 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:53:58.275 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 18, 2024-02-19T21:53:58.275 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 369, 2024-02-19T21:53:58.275 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 394, 2024-02-19T21:53:58.275 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 492, 2024-02-19T21:53:58.275 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 370, 2024-02-19T21:53:58.275 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:53:58.275 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:53:58.275 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.275 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.276 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2024-02-19T21:53:58.276 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2441376667 2024-02-19T21:53:58.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.276 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.276 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.276 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2024-02-19T21:53:58.276 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2441376667 2024-02-19T21:53:58.276 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.276 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.276 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:53:58.276 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.276 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.276 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.276 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2024-02-19T21:53:58.277 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2441376667 2024-02-19T21:53:58.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.277 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.277 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.277 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2024-02-19T21:53:58.277 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2441376667 2024-02-19T21:53:58.277 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.277 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.277 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:53:58.277 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.277 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.277 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.277 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2024-02-19T21:53:58.277 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2441376667 2024-02-19T21:53:58.278 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.278 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.278 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.278 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2024-02-19T21:53:58.278 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2441376667 2024-02-19T21:53:58.278 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.278 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.278 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.278 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:53:58.278 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.278 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.278 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.278 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2024-02-19T21:53:58.278 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2441376667 2024-02-19T21:53:58.278 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.278 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.279 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.279 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2024-02-19T21:53:58.279 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2441376667 2024-02-19T21:53:58.279 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.279 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.279 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6819/2441376667", 2024-02-19T21:53:58.279 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6821/2441376667", 2024-02-19T21:53:58.279 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6825/2441376667", 2024-02-19T21:53:58.279 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6823/2441376667", 2024-02-19T21:53:58.279 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:53:58.279 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:53:58.279 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:53:58.279 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.279 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.280 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2024-02-19T21:53:58.280 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "76318cdd-5fce-4a40-95c9-300d55c34820", 2024-02-19T21:53:58.280 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:53:58.280 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:53:58.280 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 0.4183197021484375, 2024-02-19T21:53:58.280 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:53:58.280 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:53:58.280 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:53:58.280 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 26, 2024-02-19T21:53:58.280 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 492, 2024-02-19T21:53:58.280 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:53:58.280 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:53:58.280 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:53:58.280 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.280 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.281 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.281 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2024-02-19T21:53:58.281 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:53:58.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.281 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.281 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.281 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2024-02-19T21:53:58.281 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:53:58.281 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.281 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.281 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:53:58.281 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.281 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.281 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.282 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2024-02-19T21:53:58.282 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:53:58.282 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.282 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.282 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.282 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2024-02-19T21:53:58.282 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:53:58.282 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.282 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.282 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.282 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:53:58.282 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.282 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.282 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.282 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6832", 2024-02-19T21:53:58.283 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:53:58.283 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.283 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.283 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.283 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6833", 2024-02-19T21:53:58.283 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:53:58.283 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.283 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.283 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.283 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:53:58.283 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.283 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.283 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.283 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2024-02-19T21:53:58.283 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:53:58.283 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.284 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.284 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.284 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2024-02-19T21:53:58.284 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:53:58.284 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.284 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.284 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.284 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6827/2007978078", 2024-02-19T21:53:58.284 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6829/2007978078", 2024-02-19T21:53:58.284 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6833/2007978078", 2024-02-19T21:53:58.284 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6831/2007978078", 2024-02-19T21:53:58.284 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:53:58.284 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:53:58.284 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:53:58.284 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.285 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.285 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2024-02-19T21:53:58.285 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "6484964f-3391-4e1d-a56c-813f46124062", 2024-02-19T21:53:58.285 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:53:58.285 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:53:58.285 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:53:58.285 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:53:58.285 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:53:58.285 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:53:58.285 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 32, 2024-02-19T21:53:58.285 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 492, 2024-02-19T21:53:58.285 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:53:58.285 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:53:58.285 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:53:58.286 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.286 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.286 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.286 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6800", 2024-02-19T21:53:58.286 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:53:58.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.286 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.286 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.286 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6801", 2024-02-19T21:53:58.286 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:53:58.286 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.286 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.286 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:53:58.286 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.287 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.287 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.287 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6802", 2024-02-19T21:53:58.287 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:53:58.287 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.287 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.287 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.287 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6803", 2024-02-19T21:53:58.287 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:53:58.287 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.287 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.287 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.287 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:53:58.287 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.287 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.287 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.287 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6806", 2024-02-19T21:53:58.288 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:53:58.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.288 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.288 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.288 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6807", 2024-02-19T21:53:58.288 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:53:58.288 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.288 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.288 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:53:58.288 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.288 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.288 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.288 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6804", 2024-02-19T21:53:58.289 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:53:58.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.289 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.289 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6805", 2024-02-19T21:53:58.289 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:53:58.289 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.289 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.289 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6801/1922002860", 2024-02-19T21:53:58.289 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6803/1922002860", 2024-02-19T21:53:58.289 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6807/1922002860", 2024-02-19T21:53:58.289 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6805/1922002860", 2024-02-19T21:53:58.289 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:53:58.289 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:53:58.289 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:53:58.290 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.290 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.290 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2024-02-19T21:53:58.290 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "8c7e0309-8c3b-40b9-99d9-96620e52742f", 2024-02-19T21:53:58.290 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:53:58.290 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:53:58.290 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:53:58.290 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:53:58.290 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:53:58.290 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:53:58.290 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 38, 2024-02-19T21:53:58.290 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 492, 2024-02-19T21:53:58.290 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:53:58.290 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:53:58.290 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:53:58.290 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.291 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.291 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.291 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6808", 2024-02-19T21:53:58.291 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:53:58.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.291 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.291 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.291 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6809", 2024-02-19T21:53:58.291 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:53:58.291 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.291 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.291 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:53:58.291 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.291 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.291 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.292 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6810", 2024-02-19T21:53:58.292 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:53:58.292 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.292 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.292 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.292 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6811", 2024-02-19T21:53:58.292 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:53:58.292 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.292 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.292 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.292 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:53:58.292 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.292 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.292 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.293 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6814", 2024-02-19T21:53:58.293 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:53:58.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.293 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.293 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.293 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6815", 2024-02-19T21:53:58.293 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:53:58.293 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.293 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.293 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:53:58.293 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.293 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.293 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.294 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6812", 2024-02-19T21:53:58.294 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:53:58.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.294 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.294 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.294 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6813", 2024-02-19T21:53:58.294 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:53:58.294 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.294 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.294 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6809/960889603", 2024-02-19T21:53:58.294 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6811/960889603", 2024-02-19T21:53:58.294 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6815/960889603", 2024-02-19T21:53:58.294 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6813/960889603", 2024-02-19T21:53:58.294 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:53:58.294 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:53:58.294 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:53:58.295 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.295 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.295 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2024-02-19T21:53:58.295 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "5b7d44a3-197d-482c-bf9e-de5e9013a851", 2024-02-19T21:53:58.295 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:53:58.295 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:53:58.295 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:53:58.295 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:53:58.295 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:53:58.295 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:53:58.295 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 47, 2024-02-19T21:53:58.295 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 492, 2024-02-19T21:53:58.295 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:53:58.295 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:53:58.295 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:53:58.296 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.296 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.296 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6816", 2024-02-19T21:53:58.296 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:53:58.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.296 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.296 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6817", 2024-02-19T21:53:58.296 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:53:58.296 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.296 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.297 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:53:58.297 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.297 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.297 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.297 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6818", 2024-02-19T21:53:58.297 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:53:58.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.297 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.297 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.297 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6819", 2024-02-19T21:53:58.297 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:53:58.297 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.297 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.298 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:53:58.298 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.298 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.298 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.298 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6822", 2024-02-19T21:53:58.298 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:53:58.298 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.298 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.298 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.298 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6823", 2024-02-19T21:53:58.298 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:53:58.298 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.298 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.298 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.298 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:53:58.299 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.299 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.299 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.299 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6820", 2024-02-19T21:53:58.299 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:53:58.299 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.299 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.299 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.299 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6821", 2024-02-19T21:53:58.299 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:53:58.299 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.299 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.299 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.299 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6817/2598265223", 2024-02-19T21:53:58.299 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6819/2598265223", 2024-02-19T21:53:58.300 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6823/2598265223", 2024-02-19T21:53:58.300 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6821/2598265223", 2024-02-19T21:53:58.300 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:53:58.300 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:53:58.300 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:53:58.300 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.300 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.300 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.300 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2024-02-19T21:53:58.300 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "7e2d0287-928d-40f8-841b-6c2077fc08ac", 2024-02-19T21:53:58.300 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:53:58.300 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:53:58.300 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:53:58.300 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:53:58.300 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:53:58.301 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:53:58.301 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 55, 2024-02-19T21:53:58.301 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 495, 2024-02-19T21:53:58.301 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:53:58.301 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:53:58.301 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:53:58.301 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.301 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.301 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.301 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6824", 2024-02-19T21:53:58.301 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:53:58.301 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.301 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.301 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.301 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6825", 2024-02-19T21:53:58.301 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:53:58.301 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.302 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.302 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.302 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:53:58.302 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.302 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.302 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.302 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6826", 2024-02-19T21:53:58.302 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:53:58.302 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.302 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.302 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.302 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6827", 2024-02-19T21:53:58.302 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:53:58.302 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.302 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.302 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.303 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:53:58.303 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.303 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.303 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.303 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6830", 2024-02-19T21:53:58.303 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:53:58.303 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.303 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.303 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.303 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6831", 2024-02-19T21:53:58.303 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:53:58.303 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.303 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.303 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.303 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:53:58.303 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:53:58.304 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.304 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:53:58.304 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6828", 2024-02-19T21:53:58.304 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:53:58.304 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.304 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.304 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:53:58.304 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6829", 2024-02-19T21:53:58.304 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:53:58.304 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.304 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.304 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.304 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6825/3619345894", 2024-02-19T21:53:58.304 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6827/3619345894", 2024-02-19T21:53:58.304 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6831/3619345894", 2024-02-19T21:53:58.304 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6829/3619345894", 2024-02-19T21:53:58.305 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:53:58.305 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:53:58.305 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:53:58.305 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.305 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.305 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:53:58.305 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2024-02-19T21:53:58.305 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.305 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2024-02-19T21:53:58.305 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:53:58.305 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:53:58.305 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:53:58.305 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:53:58.305 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:53:58.305 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:52:58.701669+0000", 2024-02-19T21:53:58.305 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:53:58.305 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.306 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.306 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2024-02-19T21:53:58.306 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:53:58.306 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:53:58.306 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:53:58.306 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:53:58.306 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:53:58.306 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:53:29.631826+0000", 2024-02-19T21:53:58.306 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:53:58.306 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.306 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.306 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2024-02-19T21:53:58.306 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:53:58.306 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:53:58.307 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:53:58.307 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:53:58.307 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:53:58.307 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:53:11.058608+0000", 2024-02-19T21:53:58.307 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 369 2024-02-19T21:53:58.307 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.307 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.307 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2024-02-19T21:53:58.307 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:53:58.307 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:53:58.307 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:53:58.307 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:53:58.307 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:53:58.307 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:53:07.129350+0000", 2024-02-19T21:53:58.307 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:53:58.307 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.307 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.308 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2024-02-19T21:53:58.308 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:53:58.308 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:53:58.308 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:53:58.308 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:53:58.308 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:53:58.308 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:53:42.653710+0000", 2024-02-19T21:53:58.308 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:53:58.308 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.308 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.308 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2024-02-19T21:53:58.308 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:53:58.308 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:53:58.309 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:53:58.309 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:53:58.309 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:53:58.309 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:53:04.385626+0000", 2024-02-19T21:53:58.309 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:53:58.309 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.309 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.309 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2024-02-19T21:53:58.309 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:53:58.309 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:53:58.309 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:53:58.309 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:53:58.309 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:53:58.309 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:53:39.428304+0000", 2024-02-19T21:53:58.309 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:53:58.310 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.310 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.310 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2024-02-19T21:53:58.310 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:53:58.310 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:53:58.310 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:53:58.310 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:53:58.310 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:53:58.310 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:53:05.097637+0000", 2024-02-19T21:53:58.310 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:53:58.310 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.310 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:53:58.310 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [ 2024-02-19T21:53:58.310 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.310 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "2.c", 2024-02-19T21:53:58.310 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:53:58.310 INFO:teuthology.orchestra.run.smithi080.stdout: 6, 2024-02-19T21:53:58.311 INFO:teuthology.orchestra.run.smithi080.stdout: 7, 2024-02-19T21:53:58.311 INFO:teuthology.orchestra.run.smithi080.stdout: 2 2024-02-19T21:53:58.311 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.311 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.311 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.311 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.1", 2024-02-19T21:53:58.311 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:53:58.311 INFO:teuthology.orchestra.run.smithi080.stdout: 4, 2024-02-19T21:53:58.311 INFO:teuthology.orchestra.run.smithi080.stdout: 2, 2024-02-19T21:53:58.311 INFO:teuthology.orchestra.run.smithi080.stdout: 6 2024-02-19T21:53:58.311 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.311 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.311 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:53:58.311 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [ 2024-02-19T21:53:58.311 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.311 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.6", 2024-02-19T21:53:58.312 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:53:58.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.312 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:53:58.312 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 5 2024-02-19T21:53:58.312 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.312 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.312 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.e", 2024-02-19T21:53:58.312 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:53:58.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.312 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:53:58.312 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 7 2024-02-19T21:53:58.312 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.312 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.313 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.f", 2024-02-19T21:53:58.313 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:53:58.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.313 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:53:58.313 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 5 2024-02-19T21:53:58.313 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.313 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.313 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.1f", 2024-02-19T21:53:58.313 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:53:58.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.313 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:53:58.313 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 7 2024-02-19T21:53:58.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.314 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 6, 2024-02-19T21:53:58.314 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 0 2024-02-19T21:53:58.314 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.314 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.314 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "5.1", 2024-02-19T21:53:58.314 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:53:58.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.314 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 4, 2024-02-19T21:53:58.314 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 6 2024-02-19T21:53:58.314 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.314 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.315 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "5.13", 2024-02-19T21:53:58.315 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:53:58.315 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.315 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 0, 2024-02-19T21:53:58.315 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 6 2024-02-19T21:53:58.315 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.315 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.315 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.315 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "6.f", 2024-02-19T21:53:58.315 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:53:58.315 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:53:58.315 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 4, 2024-02-19T21:53:58.315 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 0 2024-02-19T21:53:58.315 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.315 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:53:58.315 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.316 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:53:58.316 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [], 2024-02-19T21:53:58.316 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2024-02-19T21:53:58.316 INFO:teuthology.orchestra.run.smithi080.stdout: "blocklist": { 2024-02-19T21:53:58.316 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6800/2867197629": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:53:58.316 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/1659656010": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:53:58.316 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6801/2272739550": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:53:58.316 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/867908385": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:53:58.316 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/398750494": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:53:58.316 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/2833137430": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:53:58.316 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/2520755315": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:53:58.316 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6800/2094869828": "2024-02-20T21:26:51.262073+0000", 2024-02-19T21:53:58.316 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6800/2272739550": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:53:58.316 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6801/2094869828": "2024-02-20T21:26:51.262073+0000", 2024-02-19T21:53:58.316 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/2130852198": "2024-02-20T21:26:51.262073+0000", 2024-02-19T21:53:58.317 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6801/2867197629": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:53:58.317 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/1952386920": "2024-02-20T21:26:51.262073+0000" 2024-02-19T21:53:58.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.317 INFO:teuthology.orchestra.run.smithi080.stdout: "range_blocklist": {}, 2024-02-19T21:53:58.317 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2024-02-19T21:53:58.317 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2024-02-19T21:53:58.317 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2024-02-19T21:53:58.317 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2024-02-19T21:53:58.317 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2024-02-19T21:53:58.317 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2024-02-19T21:53:58.317 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2024-02-19T21:53:58.317 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2024-02-19T21:53:58.317 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:53:58.317 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2024-02-19T21:53:58.317 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2024-02-19T21:53:58.317 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2024-02-19T21:53:58.318 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2024-02-19T21:53:58.318 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {}, 2024-02-19T21:53:58.318 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode": { 2024-02-19T21:53:58.318 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode_enabled": false, 2024-02-19T21:53:58.318 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_bucket_count": 0, 2024-02-19T21:53:58.318 INFO:teuthology.orchestra.run.smithi080.stdout: "degraded_stretch_mode": 0, 2024-02-19T21:53:58.318 INFO:teuthology.orchestra.run.smithi080.stdout: "recovering_stretch_mode": 0, 2024-02-19T21:53:58.318 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode_bucket": 0 2024-02-19T21:53:58.318 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:53:58.318 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:53:58.318 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:56.427851+0000 osd.3 (osd.3) 236 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:53:58.319 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:56.431334+0000 osd.3 (osd.3) 237 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:53:58.319 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:56.580814+0000 osd.6 (osd.6) 254 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:53:58.319 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:56.583703+0000 osd.6 (osd.6) 255 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:53:58.319 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:57.589990+0000 osd.7 (osd.7) 259 : cluster [DBG] 6.12 scrub starts 2024-02-19T21:53:58.319 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:57.593315+0000 osd.7 (osd.7) 260 : cluster [DBG] 6.12 scrub ok 2024-02-19T21:53:58.518 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:53:58.520 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:58.521 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:53:58.621 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:53:58.652 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:58.673 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:53:58.676 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:58.676 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:53:58.779 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:53:58.807 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:58.827 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:53:58.830 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:58.830 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:53:58.931 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:53:58.957 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:59.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:57.237728+0000 mgr.y (mgr.14514) 818 : cluster [DBG] pgmap v1063: 138 pgs: 138 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 12 KiB/s rd, 127 B/s wr, 22 op/s; 109 B/s, 7 objects/s recovering 2024-02-19T21:53:59.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:58.138142+0000 osd.0 (osd.0) 275 : cluster [DBG] 4.3 scrub starts 2024-02-19T21:53:59.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:58.140315+0000 osd.0 (osd.0) 276 : cluster [DBG] 4.3 scrub ok 2024-02-19T21:53:59.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:58.225601+0000 mon.c (mon.2) 123 : audit [DBG] from='client.? 172.21.15.80:0/1905907036' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-19T21:53:59.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:58.253334+0000 osd.2 (osd.2) 15 : cluster [DBG] 5.b scrub starts 2024-02-19T21:53:59.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:58.254338+0000 osd.2 (osd.2) 16 : cluster [DBG] 5.b scrub ok 2024-02-19T21:53:59.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:58.409521+0000 osd.5 (osd.5) 277 : cluster [DBG] 2.3 scrub starts 2024-02-19T21:53:59.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:58.410473+0000 osd.5 (osd.5) 278 : cluster [DBG] 2.3 scrub ok 2024-02-19T21:53:59.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:58.603591+0000 osd.7 (osd.7) 261 : cluster [DBG] 2.1c scrub starts 2024-02-19T21:53:59.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:53:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:58.606691+0000 osd.7 (osd.7) 262 : cluster [DBG] 2.1c scrub ok 2024-02-19T21:53:59.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:57.237728+0000 mgr.y (mgr.14514) 818 : cluster [DBG] pgmap v1063: 138 pgs: 138 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 12 KiB/s rd, 127 B/s wr, 22 op/s; 109 B/s, 7 objects/s recovering 2024-02-19T21:53:59.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:58.138142+0000 osd.0 (osd.0) 275 : cluster [DBG] 4.3 scrub starts 2024-02-19T21:53:59.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:58.140315+0000 osd.0 (osd.0) 276 : cluster [DBG] 4.3 scrub ok 2024-02-19T21:53:59.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:58.225601+0000 mon.c (mon.2) 123 : audit [DBG] from='client.? 172.21.15.80:0/1905907036' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-19T21:53:59.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:58.253334+0000 osd.2 (osd.2) 15 : cluster [DBG] 5.b scrub starts 2024-02-19T21:53:59.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:58.254338+0000 osd.2 (osd.2) 16 : cluster [DBG] 5.b scrub ok 2024-02-19T21:53:59.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:58.409521+0000 osd.5 (osd.5) 277 : cluster [DBG] 2.3 scrub starts 2024-02-19T21:53:59.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:58.410473+0000 osd.5 (osd.5) 278 : cluster [DBG] 2.3 scrub ok 2024-02-19T21:53:59.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:58.603591+0000 osd.7 (osd.7) 261 : cluster [DBG] 2.1c scrub starts 2024-02-19T21:53:59.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:53:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:58.606691+0000 osd.7 (osd.7) 262 : cluster [DBG] 2.1c scrub ok 2024-02-19T21:53:59.318 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:57.237728+0000 mgr.y (mgr.14514) 818 : cluster [DBG] pgmap v1063: 138 pgs: 138 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 12 KiB/s rd, 127 B/s wr, 22 op/s; 109 B/s, 7 objects/s recovering 2024-02-19T21:53:59.318 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:58.138142+0000 osd.0 (osd.0) 275 : cluster [DBG] 4.3 scrub starts 2024-02-19T21:53:59.318 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:58.140315+0000 osd.0 (osd.0) 276 : cluster [DBG] 4.3 scrub ok 2024-02-19T21:53:59.318 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:58.225601+0000 mon.c (mon.2) 123 : audit [DBG] from='client.? 172.21.15.80:0/1905907036' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-19T21:53:59.319 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:58.253334+0000 osd.2 (osd.2) 15 : cluster [DBG] 5.b scrub starts 2024-02-19T21:53:59.319 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:58.254338+0000 osd.2 (osd.2) 16 : cluster [DBG] 5.b scrub ok 2024-02-19T21:53:59.319 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:58.409521+0000 osd.5 (osd.5) 277 : cluster [DBG] 2.3 scrub starts 2024-02-19T21:53:59.319 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:58.410473+0000 osd.5 (osd.5) 278 : cluster [DBG] 2.3 scrub ok 2024-02-19T21:53:59.319 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:58.603591+0000 osd.7 (osd.7) 261 : cluster [DBG] 2.1c scrub starts 2024-02-19T21:53:59.319 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:53:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:58.606691+0000 osd.7 (osd.7) 262 : cluster [DBG] 2.1c scrub ok 2024-02-19T21:53:59.806 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:53:59.809 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:53:59.810 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:53:59.826 INFO:tasks.thrashosds.thrasher:j is {'epoch': 498, 'fsid': '6f763558-cf6d-11ee-95bb-87774f69a715', 'created': '2024-02-19T21:26:16.880265+0000', 'modified': '2024-02-19T21:53:54.169763+0000', 'last_up_change': '2024-02-19T21:49:07.286446+0000', 'last_in_change': '2024-02-19T21:53:44.626155+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 19, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 11, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-19T21:30:05.947623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2024-02-19T21:32:22.082250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2024-02-19T21:32:22.333164+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 3, 'pg_placement_num': 3, 'pg_placement_num_target': 3, 'pg_num_target': 3, 'pg_num_pending': 3, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2024-02-19T21:32:23.632615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2024-02-19T21:32:25.600876+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 22, 'pg_placement_num': 22, 'pg_placement_num_target': 22, 'pg_num_target': 22, 'pg_num_pending': 22, 'last_pg_merge_meta': {'source_pgid': '5.16', 'ready_epoch': 298, 'last_epoch_started': 297, 'last_epoch_clean': 297, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '325', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '298', 'last_force_op_resend_preluminous': '296', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2024-02-19T21:32:27.661242+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '6.16', 'ready_epoch': 243, 'last_epoch_started': 242, 'last_epoch_clean': 242, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '304', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '243', 'last_force_op_resend_preluminous': '302', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}}, {'pool': 11, 'pool_name': 'unique_pool_4', 'create_time': '2024-02-19T21:53:44.625837+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '498', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': 'a72c63f6-46b3-4202-99da-7b0c92b799a5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 492, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6802', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6803', 'nonce': 3531298825}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6804', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6805', 'nonce': 3531298825}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6808', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6809', 'nonce': 3531298825}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6806', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6807', 'nonce': 3531298825}]}, 'public_addr': '172.21.15.80:6803/3531298825', 'cluster_addr': '172.21.15.80:6805/3531298825', 'heartbeat_back_addr': '172.21.15.80:6809/3531298825', 'heartbeat_front_addr': '172.21.15.80:6807/3531298825', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7d4e170e-b0ca-4e19-be35-4038ca126ee6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 492, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6810', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6811', 'nonce': 1497235950}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6812', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6813', 'nonce': 1497235950}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6816', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6817', 'nonce': 1497235950}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6814', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6815', 'nonce': 1497235950}]}, 'public_addr': '172.21.15.80:6811/1497235950', 'cluster_addr': '172.21.15.80:6813/1497235950', 'heartbeat_back_addr': '172.21.15.80:6817/1497235950', 'heartbeat_front_addr': '172.21.15.80:6815/1497235950', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'cf461b67-f3e8-45e9-b2f6-777752ba5574', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 18, 'last_clean_end': 369, 'up_from': 394, 'up_thru': 492, 'down_at': 370, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6818', 'nonce': 2441376667}, {'type': 'v1', 'addr': '172.21.15.80:6819', 'nonce': 2441376667}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6820', 'nonce': 2441376667}, {'type': 'v1', 'addr': '172.21.15.80:6821', 'nonce': 2441376667}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6824', 'nonce': 2441376667}, {'type': 'v1', 'addr': '172.21.15.80:6825', 'nonce': 2441376667}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6822', 'nonce': 2441376667}, {'type': 'v1', 'addr': '172.21.15.80:6823', 'nonce': 2441376667}]}, 'public_addr': '172.21.15.80:6819/2441376667', 'cluster_addr': '172.21.15.80:6821/2441376667', 'heartbeat_back_addr': '172.21.15.80:6825/2441376667', 'heartbeat_front_addr': '172.21.15.80:6823/2441376667', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '76318cdd-5fce-4a40-95c9-300d55c34820', 'up': 1, 'in': 1, 'weight': 0.4183197021484375, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 26, 'up_thru': 492, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6826', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6827', 'nonce': 2007978078}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6828', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6829', 'nonce': 2007978078}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6832', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6833', 'nonce': 2007978078}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6830', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6831', 'nonce': 2007978078}]}, 'public_addr': '172.21.15.80:6827/2007978078', 'cluster_addr': '172.21.15.80:6829/2007978078', 'heartbeat_back_addr': '172.21.15.80:6833/2007978078', 'heartbeat_front_addr': '172.21.15.80:6831/2007978078', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '6484964f-3391-4e1d-a56c-813f46124062', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 32, 'up_thru': 492, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6800', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6801', 'nonce': 1922002860}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6802', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6803', 'nonce': 1922002860}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6806', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6807', 'nonce': 1922002860}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6804', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6805', 'nonce': 1922002860}]}, 'public_addr': '172.21.15.157:6801/1922002860', 'cluster_addr': '172.21.15.157:6803/1922002860', 'heartbeat_back_addr': '172.21.15.157:6807/1922002860', 'heartbeat_front_addr': '172.21.15.157:6805/1922002860', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '8c7e0309-8c3b-40b9-99d9-96620e52742f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 38, 'up_thru': 492, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6808', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6809', 'nonce': 960889603}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6810', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6811', 'nonce': 960889603}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6814', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6815', 'nonce': 960889603}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6812', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6813', 'nonce': 960889603}]}, 'public_addr': '172.21.15.157:6809/960889603', 'cluster_addr': '172.21.15.157:6811/960889603', 'heartbeat_back_addr': '172.21.15.157:6815/960889603', 'heartbeat_front_addr': '172.21.15.157:6813/960889603', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '5b7d44a3-197d-482c-bf9e-de5e9013a851', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 47, 'up_thru': 492, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6816', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6817', 'nonce': 2598265223}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6818', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6819', 'nonce': 2598265223}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6822', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6823', 'nonce': 2598265223}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6820', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6821', 'nonce': 2598265223}]}, 'public_addr': '172.21.15.157:6817/2598265223', 'cluster_addr': '172.21.15.157:6819/2598265223', 'heartbeat_back_addr': '172.21.15.157:6823/2598265223', 'heartbeat_front_addr': '172.21.15.157:6821/2598265223', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '7e2d0287-928d-40f8-841b-6c2077fc08ac', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 55, 'up_thru': 495, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6824', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6825', 'nonce': 3619345894}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6826', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6827', 'nonce': 3619345894}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6830', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6831', 'nonce': 3619345894}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6828', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6829', 'nonce': 3619345894}]}, 'public_addr': '172.21.15.157:6825/3619345894', 'cluster_addr': '172.21.15.157:6827/3619345894', 'heartbeat_back_addr': '172.21.15.157:6831/3619345894', 'heartbeat_front_addr': '172.21.15.157:6829/3619345894', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:52:58.701669+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:53:29.631826+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:53:11.058608+0000', 'dead_epoch': 369}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:53:07.129350+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:53:42.653710+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:53:04.385626+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:53:39.428304+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:53:05.097637+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.c', 'osds': [6, 7, 2]}, {'pgid': '4.1', 'osds': [4, 2, 6]}], 'pg_upmap_items': [{'pgid': '4.6', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.e', 'mappings': [{'from': 1, 'to': 7}]}, {'pgid': '4.f', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.1f', 'mappings': [{'from': 1, 'to': 7}, {'from': 6, 'to': 0}]}, {'pgid': '5.1', 'mappings': [{'from': 4, 'to': 6}]}, {'pgid': '5.13', 'mappings': [{'from': 0, 'to': 6}]}, {'pgid': '6.f', 'mappings': [{'from': 4, 'to': 0}]}], 'pg_temp': [], 'primary_temp': [], 'blocklist': {'172.21.15.80:6800/2867197629': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:0/1659656010': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:6801/2272739550': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:0/867908385': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:0/398750494': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:0/2833137430': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:0/2520755315': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:6800/2094869828': '2024-02-20T21:26:51.262073+0000', '172.21.15.80:6800/2272739550': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:6801/2094869828': '2024-02-20T21:26:51.262073+0000', '172.21.15.80:0/2130852198': '2024-02-20T21:26:51.262073+0000', '172.21.15.80:6801/2867197629': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:0/1952386920': '2024-02-20T21:26:51.262073+0000'}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-02-19T21:53:59.827 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:53:59.907 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:53:59.910 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:53:59.924 DEBUG:teuthology.orchestra.run.smithi080:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_4 bench 90 write' 2024-02-19T21:53:59.943 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:53:59.945 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-02-19T21:53:59.945 INFO:teuthology.orchestra.run:waiting for 3000 2024-02-19T21:53:59.950 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:54:00.097 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:hints = 1 2024-02-19T21:54:00.097 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-02-19T21:54:00.098 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Object prefix: benchmark_data_smithi080_184406 2024-02-19T21:54:00.098 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-19T21:54:00.098 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 0 0 0 0 0 0 - 0 2024-02-19T21:54:00.298 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:54:00.306 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:00.307 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:54:00.407 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:54:00.446 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:00.472 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:54:00.475 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:00.475 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:54:00.576 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:54:00.628 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:00.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:59.238187+0000 mgr.y (mgr.14514) 819 : cluster [DBG] pgmap v1064: 138 pgs: 138 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 623 B/s rd, 0 op/s 2024-02-19T21:54:00.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:59.297756+0000 osd.2 (osd.2) 17 : cluster [DBG] 5.6 scrub starts 2024-02-19T21:54:00.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:59.298894+0000 osd.2 (osd.2) 18 : cluster [DBG] 5.6 scrub ok 2024-02-19T21:54:00.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:59.328543+0000 osd.1 (osd.1) 254 : cluster [DBG] 6.1 scrub starts 2024-02-19T21:54:00.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:59.350622+0000 osd.1 (osd.1) 255 : cluster [DBG] 6.1 scrub ok 2024-02-19T21:54:00.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:53:59.521775+0000 mon.a (mon.0) 1896 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:54:00.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:59.545121+0000 osd.6 (osd.6) 256 : cluster [DBG] 4.5 scrub starts 2024-02-19T21:54:00.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:00.129461+0000 osd.0 (osd.0) 277 : cluster [DBG] 6.18 scrub starts 2024-02-19T21:54:00.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:00.131645+0000 osd.0 (osd.0) 278 : cluster [DBG] 6.18 scrub ok 2024-02-19T21:54:00.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:59.238187+0000 mgr.y (mgr.14514) 819 : cluster [DBG] pgmap v1064: 138 pgs: 138 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 623 B/s rd, 0 op/s 2024-02-19T21:54:00.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:59.297756+0000 osd.2 (osd.2) 17 : cluster [DBG] 5.6 scrub starts 2024-02-19T21:54:00.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:59.298894+0000 osd.2 (osd.2) 18 : cluster [DBG] 5.6 scrub ok 2024-02-19T21:54:00.841 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:59.328543+0000 osd.1 (osd.1) 254 : cluster [DBG] 6.1 scrub starts 2024-02-19T21:54:00.841 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:59.350622+0000 osd.1 (osd.1) 255 : cluster [DBG] 6.1 scrub ok 2024-02-19T21:54:00.841 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:53:59.521775+0000 mon.a (mon.0) 1896 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:54:00.841 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:59.545121+0000 osd.6 (osd.6) 256 : cluster [DBG] 4.5 scrub starts 2024-02-19T21:54:00.841 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:00.129461+0000 osd.0 (osd.0) 277 : cluster [DBG] 6.18 scrub starts 2024-02-19T21:54:00.841 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:00.131645+0000 osd.0 (osd.0) 278 : cluster [DBG] 6.18 scrub ok 2024-02-19T21:54:00.841 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:54:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:54:00] "GET /metrics HTTP/1.1" 200 176660 "" "Prometheus/2.33.4" 2024-02-19T21:54:00.842 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:59.238187+0000 mgr.y (mgr.14514) 819 : cluster [DBG] pgmap v1064: 138 pgs: 138 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 623 B/s rd, 0 op/s 2024-02-19T21:54:00.842 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:59.297756+0000 osd.2 (osd.2) 17 : cluster [DBG] 5.6 scrub starts 2024-02-19T21:54:00.842 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:59.298894+0000 osd.2 (osd.2) 18 : cluster [DBG] 5.6 scrub ok 2024-02-19T21:54:00.842 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:59.328543+0000 osd.1 (osd.1) 254 : cluster [DBG] 6.1 scrub starts 2024-02-19T21:54:00.842 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:59.350622+0000 osd.1 (osd.1) 255 : cluster [DBG] 6.1 scrub ok 2024-02-19T21:54:00.842 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:53:59.521775+0000 mon.a (mon.0) 1896 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:54:00.842 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:59.545121+0000 osd.6 (osd.6) 256 : cluster [DBG] 4.5 scrub starts 2024-02-19T21:54:00.842 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:00.129461+0000 osd.0 (osd.0) 277 : cluster [DBG] 6.18 scrub starts 2024-02-19T21:54:00.842 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:00.131645+0000 osd.0 (osd.0) 278 : cluster [DBG] 6.18 scrub ok 2024-02-19T21:54:01.098 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 1 16 3397 3381 211.301 211.312 0.0075695 0.00471863 2024-02-19T21:54:01.337 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:54:01.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:53:59.548839+0000 osd.6 (osd.6) 257 : cluster [DBG] 4.5 scrub ok 2024-02-19T21:54:01.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:00.312740+0000 osd.2 (osd.2) 19 : cluster [DBG] 6.f scrub starts 2024-02-19T21:54:01.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:00.420964+0000 osd.2 (osd.2) 20 : cluster [DBG] 6.f scrub ok 2024-02-19T21:54:01.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:01.107599+0000 osd.0 (osd.0) 279 : cluster [DBG] 2.13 scrub starts 2024-02-19T21:54:01.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:01.110158+0000 osd.0 (osd.0) 280 : cluster [DBG] 2.13 scrub ok 2024-02-19T21:54:01.541 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:54:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:54:01.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:53:59.548839+0000 osd.6 (osd.6) 257 : cluster [DBG] 4.5 scrub ok 2024-02-19T21:54:01.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:00.312740+0000 osd.2 (osd.2) 19 : cluster [DBG] 6.f scrub starts 2024-02-19T21:54:01.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:00.420964+0000 osd.2 (osd.2) 20 : cluster [DBG] 6.f scrub ok 2024-02-19T21:54:01.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:01.107599+0000 osd.0 (osd.0) 279 : cluster [DBG] 2.13 scrub starts 2024-02-19T21:54:01.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:01.110158+0000 osd.0 (osd.0) 280 : cluster [DBG] 2.13 scrub ok 2024-02-19T21:54:01.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:53:59.548839+0000 osd.6 (osd.6) 257 : cluster [DBG] 4.5 scrub ok 2024-02-19T21:54:01.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:00.312740+0000 osd.2 (osd.2) 19 : cluster [DBG] 6.f scrub starts 2024-02-19T21:54:01.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:00.420964+0000 osd.2 (osd.2) 20 : cluster [DBG] 6.f scrub ok 2024-02-19T21:54:01.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:01.107599+0000 osd.0 (osd.0) 279 : cluster [DBG] 2.13 scrub starts 2024-02-19T21:54:01.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:01.110158+0000 osd.0 (osd.0) 280 : cluster [DBG] 2.13 scrub ok 2024-02-19T21:54:02.097 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 2 16 6715 6699 209.327 207.375 0.00338761 0.00476772 2024-02-19T21:54:02.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:01.190023+0000 mgr.y (mgr.14514) 820 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:54:02.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:01.219078+0000 osd.4 (osd.4) 219 : cluster [DBG] 4.1 scrub starts 2024-02-19T21:54:02.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:01.223347+0000 osd.4 (osd.4) 220 : cluster [DBG] 4.1 scrub ok 2024-02-19T21:54:02.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:01.238932+0000 mgr.y (mgr.14514) 821 : cluster [DBG] pgmap v1065: 138 pgs: 138 active+clean; 18 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 1.8 MiB/s wr, 29 op/s 2024-02-19T21:54:02.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:01.562362+0000 osd.7 (osd.7) 263 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:54:02.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:01.641000+0000 osd.7 (osd.7) 264 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:54:02.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:02.394212+0000 osd.5 (osd.5) 279 : cluster [DBG] 6.19 scrub starts 2024-02-19T21:54:02.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:01.190023+0000 mgr.y (mgr.14514) 820 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:54:02.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:01.219078+0000 osd.4 (osd.4) 219 : cluster [DBG] 4.1 scrub starts 2024-02-19T21:54:02.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:01.223347+0000 osd.4 (osd.4) 220 : cluster [DBG] 4.1 scrub ok 2024-02-19T21:54:02.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:01.238932+0000 mgr.y (mgr.14514) 821 : cluster [DBG] pgmap v1065: 138 pgs: 138 active+clean; 18 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 1.8 MiB/s wr, 29 op/s 2024-02-19T21:54:02.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:01.562362+0000 osd.7 (osd.7) 263 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:54:02.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:01.641000+0000 osd.7 (osd.7) 264 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:54:02.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:02.394212+0000 osd.5 (osd.5) 279 : cluster [DBG] 6.19 scrub starts 2024-02-19T21:54:02.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:01.190023+0000 mgr.y (mgr.14514) 820 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:54:02.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:01.219078+0000 osd.4 (osd.4) 219 : cluster [DBG] 4.1 scrub starts 2024-02-19T21:54:02.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:01.223347+0000 osd.4 (osd.4) 220 : cluster [DBG] 4.1 scrub ok 2024-02-19T21:54:02.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:01.238932+0000 mgr.y (mgr.14514) 821 : cluster [DBG] pgmap v1065: 138 pgs: 138 active+clean; 18 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 1.8 MiB/s wr, 29 op/s 2024-02-19T21:54:02.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:01.562362+0000 osd.7 (osd.7) 263 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:54:02.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:01.641000+0000 osd.7 (osd.7) 264 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:54:02.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:02.394212+0000 osd.5 (osd.5) 279 : cluster [DBG] 6.19 scrub starts 2024-02-19T21:54:03.098 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 3 16 9770 9754 203.192 190.938 0.00377768 0.00491401 2024-02-19T21:54:03.394 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:54:03.399 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:03.399 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:54:03.455 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:54:03.501 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:54:03.549 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:03.593 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:54:03.599 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:03.599 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:54:03.700 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:54:03.755 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:03.776 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:54:03.778 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:03.778 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:54:03.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:02.454924+0000 osd.5 (osd.5) 280 : cluster [DBG] 6.19 scrub ok 2024-02-19T21:54:03.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:03.070785+0000 osd.0 (osd.0) 281 : cluster [DBG] 6.0 scrub starts 2024-02-19T21:54:03.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:03.090513+0000 osd.0 (osd.0) 282 : cluster [DBG] 6.0 scrub ok 2024-02-19T21:54:03.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:02.454924+0000 osd.5 (osd.5) 280 : cluster [DBG] 6.19 scrub ok 2024-02-19T21:54:03.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:03.070785+0000 osd.0 (osd.0) 281 : cluster [DBG] 6.0 scrub starts 2024-02-19T21:54:03.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:03.090513+0000 osd.0 (osd.0) 282 : cluster [DBG] 6.0 scrub ok 2024-02-19T21:54:03.879 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:54:03.921 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:02.454924+0000 osd.5 (osd.5) 280 : cluster [DBG] 6.19 scrub ok 2024-02-19T21:54:03.921 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:03.070785+0000 osd.0 (osd.0) 281 : cluster [DBG] 6.0 scrub starts 2024-02-19T21:54:03.921 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:03.090513+0000 osd.0 (osd.0) 282 : cluster [DBG] 6.0 scrub ok 2024-02-19T21:54:03.924 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:03.947 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:54:03.950 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:03.950 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:54:04.051 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:54:04.097 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:04.097 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 4 15 12219 12204 190.672 153.125 0.00663048 0.0052371 2024-02-19T21:54:04.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:02.563030+0000 osd.6 (osd.6) 258 : cluster [DBG] 5.2 scrub starts 2024-02-19T21:54:04.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:02.567393+0000 osd.6 (osd.6) 259 : cluster [DBG] 5.2 scrub ok 2024-02-19T21:54:04.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:03.239536+0000 mgr.y (mgr.14514) 822 : cluster [DBG] pgmap v1066: 138 pgs: 138 active+clean; 73 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 7.3 MiB/s wr, 118 op/s 2024-02-19T21:54:04.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:03.574592+0000 osd.7 (osd.7) 265 : cluster [DBG] 6.1c scrub starts 2024-02-19T21:54:04.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:03.580081+0000 osd.7 (osd.7) 266 : cluster [DBG] 6.1c scrub ok 2024-02-19T21:54:04.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:03.969311+0000 mon.a (mon.0) 1897 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:54:04.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:04.529701+0000 mon.a (mon.0) 1898 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:54:04.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:02.563030+0000 osd.6 (osd.6) 258 : cluster [DBG] 5.2 scrub starts 2024-02-19T21:54:04.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:02.567393+0000 osd.6 (osd.6) 259 : cluster [DBG] 5.2 scrub ok 2024-02-19T21:54:04.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:03.239536+0000 mgr.y (mgr.14514) 822 : cluster [DBG] pgmap v1066: 138 pgs: 138 active+clean; 73 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 7.3 MiB/s wr, 118 op/s 2024-02-19T21:54:04.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:03.574592+0000 osd.7 (osd.7) 265 : cluster [DBG] 6.1c scrub starts 2024-02-19T21:54:04.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:03.580081+0000 osd.7 (osd.7) 266 : cluster [DBG] 6.1c scrub ok 2024-02-19T21:54:04.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:03.969311+0000 mon.a (mon.0) 1897 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:54:04.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:04.529701+0000 mon.a (mon.0) 1898 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:54:05.054 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:54:05.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:02.563030+0000 osd.6 (osd.6) 258 : cluster [DBG] 5.2 scrub starts 2024-02-19T21:54:05.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:02.567393+0000 osd.6 (osd.6) 259 : cluster [DBG] 5.2 scrub ok 2024-02-19T21:54:05.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:03.239536+0000 mgr.y (mgr.14514) 822 : cluster [DBG] pgmap v1066: 138 pgs: 138 active+clean; 73 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 7.3 MiB/s wr, 118 op/s 2024-02-19T21:54:05.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:03.574592+0000 osd.7 (osd.7) 265 : cluster [DBG] 6.1c scrub starts 2024-02-19T21:54:05.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:03.580081+0000 osd.7 (osd.7) 266 : cluster [DBG] 6.1c scrub ok 2024-02-19T21:54:05.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:03.969311+0000 mon.a (mon.0) 1897 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:54:05.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:04.529701+0000 mon.a (mon.0) 1898 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:54:05.063 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:05.063 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:54:05.098 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 5 16 14808 14792 184.862 161.75 0.00643999 0.00540286 2024-02-19T21:54:05.164 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:54:05.206 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:05.241 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:54:05.245 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:05.245 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:54:05.346 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:54:05.410 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:05.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:04.291796+0000 osd.4 (osd.4) 221 : cluster [DBG] 6.2 scrub starts 2024-02-19T21:54:05.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:04.297381+0000 osd.4 (osd.4) 222 : cluster [DBG] 6.2 scrub ok 2024-02-19T21:54:05.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:04.340280+0000 osd.3 (osd.3) 238 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:54:05.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:04.345007+0000 osd.3 (osd.3) 239 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:54:05.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:04.366394+0000 osd.2 (osd.2) 21 : cluster [DBG] 4.1c scrub starts 2024-02-19T21:54:05.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:04.369427+0000 osd.2 (osd.2) 22 : cluster [DBG] 4.1c scrub ok 2024-02-19T21:54:05.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:05.429304+0000 osd.5 (osd.5) 281 : cluster [DBG] 6.7 scrub starts 2024-02-19T21:54:05.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:04.291796+0000 osd.4 (osd.4) 221 : cluster [DBG] 6.2 scrub starts 2024-02-19T21:54:05.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:04.297381+0000 osd.4 (osd.4) 222 : cluster [DBG] 6.2 scrub ok 2024-02-19T21:54:05.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:04.340280+0000 osd.3 (osd.3) 238 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:54:05.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:04.345007+0000 osd.3 (osd.3) 239 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:54:05.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:04.366394+0000 osd.2 (osd.2) 21 : cluster [DBG] 4.1c scrub starts 2024-02-19T21:54:05.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:04.369427+0000 osd.2 (osd.2) 22 : cluster [DBG] 4.1c scrub ok 2024-02-19T21:54:05.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:05.429304+0000 osd.5 (osd.5) 281 : cluster [DBG] 6.7 scrub starts 2024-02-19T21:54:06.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:54:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:54:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:54:06.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:04.291796+0000 osd.4 (osd.4) 221 : cluster [DBG] 6.2 scrub starts 2024-02-19T21:54:06.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:04.297381+0000 osd.4 (osd.4) 222 : cluster [DBG] 6.2 scrub ok 2024-02-19T21:54:06.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:04.340280+0000 osd.3 (osd.3) 238 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:54:06.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:04.345007+0000 osd.3 (osd.3) 239 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:54:06.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:04.366394+0000 osd.2 (osd.2) 21 : cluster [DBG] 4.1c scrub starts 2024-02-19T21:54:06.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:04.369427+0000 osd.2 (osd.2) 22 : cluster [DBG] 4.1c scrub ok 2024-02-19T21:54:06.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:05.429304+0000 osd.5 (osd.5) 281 : cluster [DBG] 6.7 scrub starts 2024-02-19T21:54:06.098 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 6 16 17152 17136 178.467 146.5 0.00823075 0.00559611 2024-02-19T21:54:06.593 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:05.240153+0000 mgr.y (mgr.14514) 823 : cluster [DBG] pgmap v1067: 138 pgs: 138 active+clean; 587 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 926 B/s rd, 53 MiB/s wr, 850 op/s 2024-02-19T21:54:06.594 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:05.253464+0000 osd.4 (osd.4) 223 : cluster [DBG] 4.d scrub starts 2024-02-19T21:54:06.594 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:05.257098+0000 osd.4 (osd.4) 224 : cluster [DBG] 4.d scrub ok 2024-02-19T21:54:06.594 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:05.543355+0000 osd.5 (osd.5) 282 : cluster [DBG] 6.7 scrub ok 2024-02-19T21:54:06.594 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:05.615695+0000 osd.0 (osd.0) 283 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:54:06.594 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:05.615746+0000 osd.0 (osd.0) 284 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:54:06.594 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:05.821050+0000 mon.a (mon.0) 1899 : audit [INF] from='client.? 172.21.15.80:0/3144978257' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:54:06.594 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:06.435567+0000 osd.5 (osd.5) 283 : cluster [DBG] 6.d scrub starts 2024-02-19T21:54:06.622 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-02-19T21:54:06.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:05.240153+0000 mgr.y (mgr.14514) 823 : cluster [DBG] pgmap v1067: 138 pgs: 138 active+clean; 587 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 926 B/s rd, 53 MiB/s wr, 850 op/s 2024-02-19T21:54:06.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:05.253464+0000 osd.4 (osd.4) 223 : cluster [DBG] 4.d scrub starts 2024-02-19T21:54:06.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:05.257098+0000 osd.4 (osd.4) 224 : cluster [DBG] 4.d scrub ok 2024-02-19T21:54:06.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:05.543355+0000 osd.5 (osd.5) 282 : cluster [DBG] 6.7 scrub ok 2024-02-19T21:54:06.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:05.615695+0000 osd.0 (osd.0) 283 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:54:06.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:05.615746+0000 osd.0 (osd.0) 284 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:54:06.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:05.821050+0000 mon.a (mon.0) 1899 : audit [INF] from='client.? 172.21.15.80:0/3144978257' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:54:06.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:06.435567+0000 osd.5 (osd.5) 283 : cluster [DBG] 6.d scrub starts 2024-02-19T21:54:07.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:05.240153+0000 mgr.y (mgr.14514) 823 : cluster [DBG] pgmap v1067: 138 pgs: 138 active+clean; 587 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 926 B/s rd, 53 MiB/s wr, 850 op/s 2024-02-19T21:54:07.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:05.253464+0000 osd.4 (osd.4) 223 : cluster [DBG] 4.d scrub starts 2024-02-19T21:54:07.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:05.257098+0000 osd.4 (osd.4) 224 : cluster [DBG] 4.d scrub ok 2024-02-19T21:54:07.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:05.543355+0000 osd.5 (osd.5) 282 : cluster [DBG] 6.7 scrub ok 2024-02-19T21:54:07.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:05.615695+0000 osd.0 (osd.0) 283 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:54:07.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:05.615746+0000 osd.0 (osd.0) 284 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:54:07.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:05.821050+0000 mon.a (mon.0) 1899 : audit [INF] from='client.? 172.21.15.80:0/3144978257' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:54:07.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:06.435567+0000 osd.5 (osd.5) 283 : cluster [DBG] 6.d scrub starts 2024-02-19T21:54:07.098 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 7 16 19574 19558 174.595 151.375 0.00596186 0.00572211 2024-02-19T21:54:08.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:06.345281+0000 osd.3 (osd.3) 240 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:54:08.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:06.348265+0000 osd.3 (osd.3) 241 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:54:08.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:06.529300+0000 osd.5 (osd.5) 284 : cluster [DBG] 6.d scrub ok 2024-02-19T21:54:08.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:06.575912+0000 mon.a (mon.0) 1900 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:54:08.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:06.575946+0000 mon.a (mon.0) 1901 : cluster [INF] Cluster is now healthy 2024-02-19T21:54:08.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:06.609186+0000 mon.a (mon.0) 1902 : audit [INF] from='client.? 172.21.15.80:0/3144978257' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:54:08.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:06.609243+0000 mon.a (mon.0) 1903 : cluster [DBG] osdmap e499: 8 total, 8 up, 8 in 2024-02-19T21:54:08.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:07.026330+0000 osd.0 (osd.0) 285 : cluster [DBG] 2.1f scrub starts 2024-02-19T21:54:08.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:07.029144+0000 osd.0 (osd.0) 286 : cluster [DBG] 2.1f scrub ok 2024-02-19T21:54:08.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:06.345281+0000 osd.3 (osd.3) 240 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:54:08.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:06.348265+0000 osd.3 (osd.3) 241 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:54:08.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:06.529300+0000 osd.5 (osd.5) 284 : cluster [DBG] 6.d scrub ok 2024-02-19T21:54:08.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:06.575912+0000 mon.a (mon.0) 1900 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:54:08.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:06.575946+0000 mon.a (mon.0) 1901 : cluster [INF] Cluster is now healthy 2024-02-19T21:54:08.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:06.609186+0000 mon.a (mon.0) 1902 : audit [INF] from='client.? 172.21.15.80:0/3144978257' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:54:08.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:06.609243+0000 mon.a (mon.0) 1903 : cluster [DBG] osdmap e499: 8 total, 8 up, 8 in 2024-02-19T21:54:08.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:07.026330+0000 osd.0 (osd.0) 285 : cluster [DBG] 2.1f scrub starts 2024-02-19T21:54:08.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:07.029144+0000 osd.0 (osd.0) 286 : cluster [DBG] 2.1f scrub ok 2024-02-19T21:54:08.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:06.345281+0000 osd.3 (osd.3) 240 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:54:08.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:06.348265+0000 osd.3 (osd.3) 241 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:54:08.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:06.529300+0000 osd.5 (osd.5) 284 : cluster [DBG] 6.d scrub ok 2024-02-19T21:54:08.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:06.575912+0000 mon.a (mon.0) 1900 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:54:08.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:06.575946+0000 mon.a (mon.0) 1901 : cluster [INF] Cluster is now healthy 2024-02-19T21:54:08.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:06.609186+0000 mon.a (mon.0) 1902 : audit [INF] from='client.? 172.21.15.80:0/3144978257' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:54:08.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:06.609243+0000 mon.a (mon.0) 1903 : cluster [DBG] osdmap e499: 8 total, 8 up, 8 in 2024-02-19T21:54:08.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:07.026330+0000 osd.0 (osd.0) 285 : cluster [DBG] 2.1f scrub starts 2024-02-19T21:54:08.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:07.029144+0000 osd.0 (osd.0) 286 : cluster [DBG] 2.1f scrub ok 2024-02-19T21:54:08.098 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 8 16 21724 21708 169.566 134.375 0.00663461 0.0058924 2024-02-19T21:54:08.745 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:54:08.745 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-02-19T21:54:08.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:08.745 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.25952.0:20034 11.3 e499/492 11:c3108eeb:::benchmark_data_smithi080_184406_object20033:head v 499'1340, mlcod=499'1338)", 2024-02-19T21:54:08.745 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:54:07.303796+0000", 2024-02-19T21:54:08.746 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0012804979999999999, 2024-02-19T21:54:08.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001320798, 2024-02-19T21:54:08.746 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:54:08.746 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:54:08.746 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:54:08.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:08.746 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:54:08.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:07.303796+0000", 2024-02-19T21:54:08.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:54:08.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:08.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:08.746 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:54:08.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:07.303796+0000", 2024-02-19T21:54:08.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:54:08.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:08.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:08.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:54:08.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:07.303795+0000", 2024-02-19T21:54:08.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3234e-05 2024-02-19T21:54:08.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:08.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:08.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:54:08.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:07.303838+0000", 2024-02-19T21:54:08.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3628999999999999e-05 2024-02-19T21:54:08.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:08.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:08.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:54:08.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:07.303852+0000", 2024-02-19T21:54:08.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2620000000000004e-06 2024-02-19T21:54:08.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:08.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:08.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:54:08.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:07.303858+0000", 2024-02-19T21:54:08.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6152999999999998e-05 2024-02-19T21:54:08.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:08.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:08.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:08.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:07.303894+0000", 2024-02-19T21:54:08.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6798000000000001e-05 2024-02-19T21:54:08.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:08.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:08.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:54:08.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:07.303911+0000", 2024-02-19T21:54:08.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115152 2024-02-19T21:54:08.749 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:08.749 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:08.749 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:08.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:08.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:08.749 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.25952.0:20039 11.3 e499/492 11:c459c686:::benchmark_data_smithi080_184406_object20038:head v 499'1341, mlcod=499'1338)", 2024-02-19T21:54:08.749 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:54:07.304813+0000", 2024-02-19T21:54:08.749 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.00026297000000000001, 2024-02-19T21:54:08.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034904899999999998, 2024-02-19T21:54:08.749 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:54:08.749 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:54:08.749 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:54:08.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:08.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:54:08.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:07.304813+0000", 2024-02-19T21:54:08.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:54:08.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:08.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:08.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:54:08.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:07.304813+0000", 2024-02-19T21:54:08.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:54:08.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:08.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:08.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:54:08.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:07.304812+0000", 2024-02-19T21:54:08.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3077999999999997e-05 2024-02-19T21:54:08.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:08.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:08.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:54:08.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:07.304846+0000", 2024-02-19T21:54:08.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1732e-05 2024-02-19T21:54:08.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:08.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:08.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:54:08.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:07.304857+0000", 2024-02-19T21:54:08.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1120000000000001e-06 2024-02-19T21:54:08.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:08.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:08.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:54:08.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:07.304863+0000", 2024-02-19T21:54:08.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1483999999999999e-05 2024-02-19T21:54:08.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:08.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:08.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:08.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:07.304895+0000", 2024-02-19T21:54:08.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2733e-05 2024-02-19T21:54:08.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:08.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:08.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:54:08.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:07.304908+0000", 2024-02-19T21:54:08.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4160999999999995e-05 2024-02-19T21:54:08.752 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:08.752 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:08.752 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:08.752 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:08.752 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:54:08.752 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 2 2024-02-19T21:54:08.752 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:54:09.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:07.240640+0000 mgr.y (mgr.14514) 824 : cluster [DBG] pgmap v1069: 138 pgs: 138 active+clean; 969 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 97 MiB/s wr, 1.55k op/s 2024-02-19T21:54:09.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:07.267696+0000 osd.4 (osd.4) 225 : cluster [DBG] 4.1a deep-scrub starts 2024-02-19T21:54:09.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:07.275891+0000 osd.4 (osd.4) 226 : cluster [DBG] 4.1a deep-scrub ok 2024-02-19T21:54:09.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:07.327182+0000 osd.2 (osd.2) 23 : cluster [DBG] 2.1 deep-scrub starts 2024-02-19T21:54:09.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:07.330450+0000 osd.2 (osd.2) 24 : cluster [DBG] 2.1 deep-scrub ok 2024-02-19T21:54:09.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:08.080437+0000 osd.0 (osd.0) 287 : cluster [DBG] 3.1 scrub starts 2024-02-19T21:54:09.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:08.083916+0000 osd.0 (osd.0) 288 : cluster [DBG] 3.1 scrub ok 2024-02-19T21:54:09.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:07.240640+0000 mgr.y (mgr.14514) 824 : cluster [DBG] pgmap v1069: 138 pgs: 138 active+clean; 969 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 97 MiB/s wr, 1.55k op/s 2024-02-19T21:54:09.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:07.267696+0000 osd.4 (osd.4) 225 : cluster [DBG] 4.1a deep-scrub starts 2024-02-19T21:54:09.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:07.275891+0000 osd.4 (osd.4) 226 : cluster [DBG] 4.1a deep-scrub ok 2024-02-19T21:54:09.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:07.327182+0000 osd.2 (osd.2) 23 : cluster [DBG] 2.1 deep-scrub starts 2024-02-19T21:54:09.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:07.330450+0000 osd.2 (osd.2) 24 : cluster [DBG] 2.1 deep-scrub ok 2024-02-19T21:54:09.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:08.080437+0000 osd.0 (osd.0) 287 : cluster [DBG] 3.1 scrub starts 2024-02-19T21:54:09.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:08.083916+0000 osd.0 (osd.0) 288 : cluster [DBG] 3.1 scrub ok 2024-02-19T21:54:09.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:07.240640+0000 mgr.y (mgr.14514) 824 : cluster [DBG] pgmap v1069: 138 pgs: 138 active+clean; 969 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 97 MiB/s wr, 1.55k op/s 2024-02-19T21:54:09.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:07.267696+0000 osd.4 (osd.4) 225 : cluster [DBG] 4.1a deep-scrub starts 2024-02-19T21:54:09.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:07.275891+0000 osd.4 (osd.4) 226 : cluster [DBG] 4.1a deep-scrub ok 2024-02-19T21:54:09.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:07.327182+0000 osd.2 (osd.2) 23 : cluster [DBG] 2.1 deep-scrub starts 2024-02-19T21:54:09.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:07.330450+0000 osd.2 (osd.2) 24 : cluster [DBG] 2.1 deep-scrub ok 2024-02-19T21:54:09.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:08.080437+0000 osd.0 (osd.0) 287 : cluster [DBG] 3.1 scrub starts 2024-02-19T21:54:09.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:08.083916+0000 osd.0 (osd.0) 288 : cluster [DBG] 3.1 scrub ok 2024-02-19T21:54:09.099 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 9 15 23811 23796 165.225 130.5 0.00777896 0.00604743 2024-02-19T21:54:09.314 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:54:09.319 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:09.320 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:54:09.329 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:54:09.420 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:54:09.482 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:09.511 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:54:09.515 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:09.515 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:54:09.616 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:54:09.665 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:09.695 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:54:09.698 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:09.699 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:54:09.799 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:54:09.805 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:08.310348+0000 osd.4 (osd.4) 227 : cluster [DBG] 6.17 scrub starts 2024-02-19T21:54:09.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:08.470646+0000 osd.4 (osd.4) 228 : cluster [DBG] 6.17 scrub ok 2024-02-19T21:54:09.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:09.343241+0000 osd.5 (osd.5) 285 : cluster [DBG] 6.a scrub starts 2024-02-19T21:54:09.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:09.344507+0000 osd.5 (osd.5) 286 : cluster [DBG] 6.a scrub ok 2024-02-19T21:54:09.850 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:10.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:08.310348+0000 osd.4 (osd.4) 227 : cluster [DBG] 6.17 scrub starts 2024-02-19T21:54:10.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:08.470646+0000 osd.4 (osd.4) 228 : cluster [DBG] 6.17 scrub ok 2024-02-19T21:54:10.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:09.343241+0000 osd.5 (osd.5) 285 : cluster [DBG] 6.a scrub starts 2024-02-19T21:54:10.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:09.344507+0000 osd.5 (osd.5) 286 : cluster [DBG] 6.a scrub ok 2024-02-19T21:54:10.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:08.310348+0000 osd.4 (osd.4) 227 : cluster [DBG] 6.17 scrub starts 2024-02-19T21:54:10.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:08.470646+0000 osd.4 (osd.4) 228 : cluster [DBG] 6.17 scrub ok 2024-02-19T21:54:10.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:09.343241+0000 osd.5 (osd.5) 285 : cluster [DBG] 6.a scrub starts 2024-02-19T21:54:10.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:09.344507+0000 osd.5 (osd.5) 286 : cluster [DBG] 6.a scrub ok 2024-02-19T21:54:10.099 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 10 16 25994 25978 162.339 136.375 0.00473676 0.00615517 2024-02-19T21:54:10.932 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:09.241047+0000 mgr.y (mgr.14514) 825 : cluster [DBG] pgmap v1070: 138 pgs: 138 active+clean; 969 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 97 MiB/s wr, 1.55k op/s 2024-02-19T21:54:10.932 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:09.299185+0000 osd.2 (osd.2) 25 : cluster [DBG] 5.a scrub starts 2024-02-19T21:54:10.932 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:09.300702+0000 osd.2 (osd.2) 26 : cluster [DBG] 5.a scrub ok 2024-02-19T21:54:10.932 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:10.372884+0000 mon.a (mon.0) 1904 : cluster [DBG] osdmap e500: 8 total, 8 up, 8 in 2024-02-19T21:54:10.933 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:54:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:54:10] "GET /metrics HTTP/1.1" 200 176738 "" "Prometheus/2.33.4" 2024-02-19T21:54:10.933 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:09.241047+0000 mgr.y (mgr.14514) 825 : cluster [DBG] pgmap v1070: 138 pgs: 138 active+clean; 969 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 97 MiB/s wr, 1.55k op/s 2024-02-19T21:54:10.933 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:09.299185+0000 osd.2 (osd.2) 25 : cluster [DBG] 5.a scrub starts 2024-02-19T21:54:10.933 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:09.300702+0000 osd.2 (osd.2) 26 : cluster [DBG] 5.a scrub ok 2024-02-19T21:54:10.933 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:10.372884+0000 mon.a (mon.0) 1904 : cluster [DBG] osdmap e500: 8 total, 8 up, 8 in 2024-02-19T21:54:11.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:09.241047+0000 mgr.y (mgr.14514) 825 : cluster [DBG] pgmap v1070: 138 pgs: 138 active+clean; 969 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 97 MiB/s wr, 1.55k op/s 2024-02-19T21:54:11.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:09.299185+0000 osd.2 (osd.2) 25 : cluster [DBG] 5.a scrub starts 2024-02-19T21:54:11.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:09.300702+0000 osd.2 (osd.2) 26 : cluster [DBG] 5.a scrub ok 2024-02-19T21:54:11.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:10.372884+0000 mon.a (mon.0) 1904 : cluster [DBG] osdmap e500: 8 total, 8 up, 8 in 2024-02-19T21:54:11.099 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 11 16 27774 27758 157.685 111.25 0.00583602 0.00633711 2024-02-19T21:54:11.152 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:54:11.156 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:11.157 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:54:11.258 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:54:11.305 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:11.327 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.1 dump_blocked_ops 2024-02-19T21:54:11.556 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:54:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:54:11.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:10.421833+0000 osd.3 (osd.3) 242 : cluster [DBG] 6.b scrub starts 2024-02-19T21:54:11.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:10.520193+0000 osd.3 (osd.3) 243 : cluster [DBG] 6.b scrub ok 2024-02-19T21:54:11.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:11.019154+0000 osd.0 (osd.0) 289 : cluster [DBG] 6.9 deep-scrub starts 2024-02-19T21:54:11.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:11.072265+0000 osd.0 (osd.0) 290 : cluster [DBG] 6.9 deep-scrub ok 2024-02-19T21:54:11.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:10.421833+0000 osd.3 (osd.3) 242 : cluster [DBG] 6.b scrub starts 2024-02-19T21:54:11.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:10.520193+0000 osd.3 (osd.3) 243 : cluster [DBG] 6.b scrub ok 2024-02-19T21:54:11.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:11.019154+0000 osd.0 (osd.0) 289 : cluster [DBG] 6.9 deep-scrub starts 2024-02-19T21:54:11.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:11.072265+0000 osd.0 (osd.0) 290 : cluster [DBG] 6.9 deep-scrub ok 2024-02-19T21:54:12.010 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:54:12.014 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:12.014 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:54:12.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:10.421833+0000 osd.3 (osd.3) 242 : cluster [DBG] 6.b scrub starts 2024-02-19T21:54:12.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:10.520193+0000 osd.3 (osd.3) 243 : cluster [DBG] 6.b scrub ok 2024-02-19T21:54:12.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:11.019154+0000 osd.0 (osd.0) 289 : cluster [DBG] 6.9 deep-scrub starts 2024-02-19T21:54:12.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:11.072265+0000 osd.0 (osd.0) 290 : cluster [DBG] 6.9 deep-scrub ok 2024-02-19T21:54:12.100 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 12 16 29740 29724 154.784 122.875 0.00705761 0.00645427 2024-02-19T21:54:12.115 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:54:12.163 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:12.193 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:54:12.196 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:12.197 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:54:12.297 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:54:12.344 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:12.579 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:54:12.617 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:54:12.654 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:54:12.690 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:54:12.724 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:54:12.762 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:54:12.796 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:54:12.843 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:54:12.850 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:54:12.850 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:54:12.850 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:54:12.850 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:54:12.850 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:54:12.851 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:54:12.851 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:54:12.851 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:54:13.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:11.199850+0000 mgr.y (mgr.14514) 826 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:54:13.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:11.241490+0000 mgr.y (mgr.14514) 827 : cluster [DBG] pgmap v1072: 138 pgs: 138 active+clean; 1.5 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 188 MiB/s wr, 3.01k op/s 2024-02-19T21:54:13.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:11.375981+0000 osd.4 (osd.4) 229 : cluster [DBG] 4.c scrub starts 2024-02-19T21:54:13.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:11.380951+0000 osd.4 (osd.4) 230 : cluster [DBG] 4.c scrub ok 2024-02-19T21:54:13.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:11.410363+0000 osd.7 (osd.7) 267 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:54:13.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:11.410414+0000 osd.7 (osd.7) 268 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:54:13.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:11.608001+0000 osd.7 (osd.7) 269 : cluster [DBG] 6.15 deep-scrub starts 2024-02-19T21:54:13.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:11.661516+0000 mon.a (mon.0) 1905 : cluster [DBG] osdmap e501: 8 total, 8 up, 8 in 2024-02-19T21:54:13.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:11.667865+0000 osd.7 (osd.7) 270 : cluster [DBG] 6.15 deep-scrub ok 2024-02-19T21:54:13.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:12.542595+0000 mon.c (mon.2) 124 : audit [DBG] from='client.? 172.21.15.80:0/3713596943' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:54:13.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:11.199850+0000 mgr.y (mgr.14514) 826 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:54:13.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:11.241490+0000 mgr.y (mgr.14514) 827 : cluster [DBG] pgmap v1072: 138 pgs: 138 active+clean; 1.5 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 188 MiB/s wr, 3.01k op/s 2024-02-19T21:54:13.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:11.375981+0000 osd.4 (osd.4) 229 : cluster [DBG] 4.c scrub starts 2024-02-19T21:54:13.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:11.380951+0000 osd.4 (osd.4) 230 : cluster [DBG] 4.c scrub ok 2024-02-19T21:54:13.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:11.410363+0000 osd.7 (osd.7) 267 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:54:13.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:11.410414+0000 osd.7 (osd.7) 268 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:54:13.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:11.608001+0000 osd.7 (osd.7) 269 : cluster [DBG] 6.15 deep-scrub starts 2024-02-19T21:54:13.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:11.661516+0000 mon.a (mon.0) 1905 : cluster [DBG] osdmap e501: 8 total, 8 up, 8 in 2024-02-19T21:54:13.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:11.667865+0000 osd.7 (osd.7) 270 : cluster [DBG] 6.15 deep-scrub ok 2024-02-19T21:54:13.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:12.542595+0000 mon.c (mon.2) 124 : audit [DBG] from='client.? 172.21.15.80:0/3713596943' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:54:13.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:11.199850+0000 mgr.y (mgr.14514) 826 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:54:13.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:11.241490+0000 mgr.y (mgr.14514) 827 : cluster [DBG] pgmap v1072: 138 pgs: 138 active+clean; 1.5 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 188 MiB/s wr, 3.01k op/s 2024-02-19T21:54:13.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:11.375981+0000 osd.4 (osd.4) 229 : cluster [DBG] 4.c scrub starts 2024-02-19T21:54:13.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:11.380951+0000 osd.4 (osd.4) 230 : cluster [DBG] 4.c scrub ok 2024-02-19T21:54:13.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:11.410363+0000 osd.7 (osd.7) 267 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:54:13.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:11.410414+0000 osd.7 (osd.7) 268 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:54:13.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:11.608001+0000 osd.7 (osd.7) 269 : cluster [DBG] 6.15 deep-scrub starts 2024-02-19T21:54:13.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:11.661516+0000 mon.a (mon.0) 1905 : cluster [DBG] osdmap e501: 8 total, 8 up, 8 in 2024-02-19T21:54:13.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:11.667865+0000 osd.7 (osd.7) 270 : cluster [DBG] 6.15 deep-scrub ok 2024-02-19T21:54:13.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:12.542595+0000 mon.c (mon.2) 124 : audit [DBG] from='client.? 172.21.15.80:0/3713596943' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:54:13.101 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 13 16 31553 31537 151.58 113.312 0.00421385 0.00659057 2024-02-19T21:54:13.214 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:54:13.224 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:13.224 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:54:13.325 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:54:13.380 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:13.411 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:54:13.415 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:13.415 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:54:13.516 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:54:13.561 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:13.586 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:54:13.591 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:13.592 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:54:13.692 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:54:13.747 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:13.781 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:54:13.789 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:13.789 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:54:13.890 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:54:13.961 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:12.291921+0000 osd.2 (osd.2) 27 : cluster [DBG] 5.d scrub starts 2024-02-19T21:54:13.961 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:12.298341+0000 osd.2 (osd.2) 28 : cluster [DBG] 5.d scrub ok 2024-02-19T21:54:13.962 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:12.447199+0000 osd.3 (osd.3) 244 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:54:13.962 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:12.582590+0000 osd.3 (osd.3) 245 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:54:13.962 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:12.802584+0000 osd.2 (osd.2) 29 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:54:13.962 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:12.802644+0000 osd.2 (osd.2) 30 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:54:13.962 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:12.291921+0000 osd.2 (osd.2) 27 : cluster [DBG] 5.d scrub starts 2024-02-19T21:54:13.962 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:12.298341+0000 osd.2 (osd.2) 28 : cluster [DBG] 5.d scrub ok 2024-02-19T21:54:13.962 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:12.447199+0000 osd.3 (osd.3) 244 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:54:13.962 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:12.582590+0000 osd.3 (osd.3) 245 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:54:13.962 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:12.802584+0000 osd.2 (osd.2) 29 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:54:13.962 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:12.802644+0000 osd.2 (osd.2) 30 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:54:13.967 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:14.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:12.291921+0000 osd.2 (osd.2) 27 : cluster [DBG] 5.d scrub starts 2024-02-19T21:54:14.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:12.298341+0000 osd.2 (osd.2) 28 : cluster [DBG] 5.d scrub ok 2024-02-19T21:54:14.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:12.447199+0000 osd.3 (osd.3) 244 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:54:14.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:12.582590+0000 osd.3 (osd.3) 245 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:54:14.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:12.802584+0000 osd.2 (osd.2) 29 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:54:14.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:12.802644+0000 osd.2 (osd.2) 30 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:54:14.102 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 14 16 33496 33480 149.411 121.438 0.00463723 0.00668818 2024-02-19T21:54:14.270 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set noscrub 2024-02-19T21:54:15.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:13.241968+0000 mgr.y (mgr.14514) 828 : cluster [DBG] pgmap v1074: 138 pgs: 138 active+clean; 1.6 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 771 B/s rd, 119 MiB/s wr, 1.90k op/s 2024-02-19T21:54:15.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:13.463849+0000 osd.4 (osd.4) 231 : cluster [DBG] 6.1a deep-scrub starts 2024-02-19T21:54:15.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:13.470422+0000 osd.4 (osd.4) 232 : cluster [DBG] 6.1a deep-scrub ok 2024-02-19T21:54:15.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:13.646981+0000 osd.7 (osd.7) 271 : cluster [DBG] 2.1d scrub starts 2024-02-19T21:54:15.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:13.655174+0000 osd.7 (osd.7) 272 : cluster [DBG] 2.1d scrub ok 2024-02-19T21:54:15.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:13.674040+0000 mon.a (mon.0) 1906 : cluster [DBG] osdmap e502: 8 total, 8 up, 8 in 2024-02-19T21:54:15.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:14.465878+0000 osd.1 (osd.1) 256 : cluster [DBG] 4.12 scrub starts 2024-02-19T21:54:15.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:14.469483+0000 osd.1 (osd.1) 257 : cluster [DBG] 4.12 scrub ok 2024-02-19T21:54:15.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:13.241968+0000 mgr.y (mgr.14514) 828 : cluster [DBG] pgmap v1074: 138 pgs: 138 active+clean; 1.6 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 771 B/s rd, 119 MiB/s wr, 1.90k op/s 2024-02-19T21:54:15.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:13.463849+0000 osd.4 (osd.4) 231 : cluster [DBG] 6.1a deep-scrub starts 2024-02-19T21:54:15.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:13.470422+0000 osd.4 (osd.4) 232 : cluster [DBG] 6.1a deep-scrub ok 2024-02-19T21:54:15.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:13.646981+0000 osd.7 (osd.7) 271 : cluster [DBG] 2.1d scrub starts 2024-02-19T21:54:15.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:13.655174+0000 osd.7 (osd.7) 272 : cluster [DBG] 2.1d scrub ok 2024-02-19T21:54:15.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:13.674040+0000 mon.a (mon.0) 1906 : cluster [DBG] osdmap e502: 8 total, 8 up, 8 in 2024-02-19T21:54:15.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:14.465878+0000 osd.1 (osd.1) 256 : cluster [DBG] 4.12 scrub starts 2024-02-19T21:54:15.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:14.469483+0000 osd.1 (osd.1) 257 : cluster [DBG] 4.12 scrub ok 2024-02-19T21:54:15.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:13.241968+0000 mgr.y (mgr.14514) 828 : cluster [DBG] pgmap v1074: 138 pgs: 138 active+clean; 1.6 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 771 B/s rd, 119 MiB/s wr, 1.90k op/s 2024-02-19T21:54:15.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:13.463849+0000 osd.4 (osd.4) 231 : cluster [DBG] 6.1a deep-scrub starts 2024-02-19T21:54:15.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:13.470422+0000 osd.4 (osd.4) 232 : cluster [DBG] 6.1a deep-scrub ok 2024-02-19T21:54:15.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:13.646981+0000 osd.7 (osd.7) 271 : cluster [DBG] 2.1d scrub starts 2024-02-19T21:54:15.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:13.655174+0000 osd.7 (osd.7) 272 : cluster [DBG] 2.1d scrub ok 2024-02-19T21:54:15.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:13.674040+0000 mon.a (mon.0) 1906 : cluster [DBG] osdmap e502: 8 total, 8 up, 8 in 2024-02-19T21:54:15.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:14.465878+0000 osd.1 (osd.1) 256 : cluster [DBG] 4.12 scrub starts 2024-02-19T21:54:15.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:14.469483+0000 osd.1 (osd.1) 257 : cluster [DBG] 4.12 scrub ok 2024-02-19T21:54:15.102 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 15 16 35285 35269 146.905 111.812 0.00803274 0.00680203 2024-02-19T21:54:16.057 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:54:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:54:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:54:16.103 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 16 16 37159 37143 145.036 117.125 0.0135813 0.00688943 2024-02-19T21:54:16.176 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:54:16.181 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:16.181 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:54:16.282 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:54:16.332 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:16.365 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:54:16.371 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:16.372 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:54:16.459 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:54:16.461 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:54:16.473 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:54:16.582 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:16.690 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:15.242538+0000 mgr.y (mgr.14514) 829 : cluster [DBG] pgmap v1076: 138 pgs: 138 active+clean; 1.9 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 853 B/s rd, 169 MiB/s wr, 2.71k op/s 2024-02-19T21:54:16.691 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:15.679533+0000 osd.7 (osd.7) 273 : cluster [DBG] 5.10 scrub starts 2024-02-19T21:54:16.691 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:15.684217+0000 osd.7 (osd.7) 274 : cluster [DBG] 5.10 scrub ok 2024-02-19T21:54:16.691 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:16.514423+0000 osd.1 (osd.1) 258 : cluster [DBG] 5.c scrub starts 2024-02-19T21:54:16.836 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:54:16.843 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:54:16.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:15.242538+0000 mgr.y (mgr.14514) 829 : cluster [DBG] pgmap v1076: 138 pgs: 138 active+clean; 1.9 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 853 B/s rd, 169 MiB/s wr, 2.71k op/s 2024-02-19T21:54:16.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:15.679533+0000 osd.7 (osd.7) 273 : cluster [DBG] 5.10 scrub starts 2024-02-19T21:54:16.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:15.684217+0000 osd.7 (osd.7) 274 : cluster [DBG] 5.10 scrub ok 2024-02-19T21:54:16.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:16.514423+0000 osd.1 (osd.1) 258 : cluster [DBG] 5.c scrub starts 2024-02-19T21:54:16.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:16.532962+0000 osd.1 (osd.1) 259 : cluster [DBG] 5.c scrub ok 2024-02-19T21:54:16.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:15.242538+0000 mgr.y (mgr.14514) 829 : cluster [DBG] pgmap v1076: 138 pgs: 138 active+clean; 1.9 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 853 B/s rd, 169 MiB/s wr, 2.71k op/s 2024-02-19T21:54:16.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:15.679533+0000 osd.7 (osd.7) 273 : cluster [DBG] 5.10 scrub starts 2024-02-19T21:54:16.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:15.684217+0000 osd.7 (osd.7) 274 : cluster [DBG] 5.10 scrub ok 2024-02-19T21:54:16.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:16.514423+0000 osd.1 (osd.1) 258 : cluster [DBG] 5.c scrub starts 2024-02-19T21:54:16.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:16.532962+0000 osd.1 (osd.1) 259 : cluster [DBG] 5.c scrub ok 2024-02-19T21:54:17.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:16.532962+0000 osd.1 (osd.1) 259 : cluster [DBG] 5.c scrub ok 2024-02-19T21:54:17.103 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 17 16 38810 38794 142.574 103.188 0.00859652 0.00700851 2024-02-19T21:54:17.898 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:54:18.029 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:16.356188+0000 osd.2 (osd.2) 31 : cluster [DBG] 2.e scrub starts 2024-02-19T21:54:18.029 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:16.360461+0000 osd.2 (osd.2) 32 : cluster [DBG] 2.e scrub ok 2024-02-19T21:54:18.029 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:16.700712+0000 osd.7 (osd.7) 275 : cluster [DBG] 2.8 scrub starts 2024-02-19T21:54:18.029 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:16.707853+0000 osd.7 (osd.7) 276 : cluster [DBG] 2.8 scrub ok 2024-02-19T21:54:18.029 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:16.813773+0000 mgr.y (mgr.14514) 830 : audit [DBG] from='client.25970 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:54:18.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:16.356188+0000 osd.2 (osd.2) 31 : cluster [DBG] 2.e scrub starts 2024-02-19T21:54:18.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:16.360461+0000 osd.2 (osd.2) 32 : cluster [DBG] 2.e scrub ok 2024-02-19T21:54:18.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:16.700712+0000 osd.7 (osd.7) 275 : cluster [DBG] 2.8 scrub starts 2024-02-19T21:54:18.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:16.707853+0000 osd.7 (osd.7) 276 : cluster [DBG] 2.8 scrub ok 2024-02-19T21:54:18.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:16.813773+0000 mgr.y (mgr.14514) 830 : audit [DBG] from='client.25970 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:54:18.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:16.356188+0000 osd.2 (osd.2) 31 : cluster [DBG] 2.e scrub starts 2024-02-19T21:54:18.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:16.360461+0000 osd.2 (osd.2) 32 : cluster [DBG] 2.e scrub ok 2024-02-19T21:54:18.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:16.700712+0000 osd.7 (osd.7) 275 : cluster [DBG] 2.8 scrub starts 2024-02-19T21:54:18.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:16.707853+0000 osd.7 (osd.7) 276 : cluster [DBG] 2.8 scrub ok 2024-02-19T21:54:18.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:16.813773+0000 mgr.y (mgr.14514) 830 : audit [DBG] from='client.25970 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:54:18.069 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:54:18.074 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:18.075 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:54:18.103 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 18 15 40558 40543 140.727 109.312 0.00956327 0.00710026 2024-02-19T21:54:18.175 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:54:18.226 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:18.259 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:54:18.266 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:18.266 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:54:18.367 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:54:18.408 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:18.439 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:54:18.444 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:18.444 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:54:18.545 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:54:18.597 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:18.631 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:54:18.634 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:18.634 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:54:18.735 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:54:18.799 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:18.835 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:54:18.841 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:18.841 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:54:18.942 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:54:18.998 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:17.243022+0000 mgr.y (mgr.14514) 831 : cluster [DBG] pgmap v1077: 138 pgs: 138 active+clean; 2.1 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 745 B/s rd, 91 MiB/s wr, 1.46k op/s 2024-02-19T21:54:18.998 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:17.712229+0000 osd.7 (osd.7) 277 : cluster [DBG] 2.0 scrub starts 2024-02-19T21:54:18.998 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:17.717897+0000 osd.7 (osd.7) 278 : cluster [DBG] 2.0 scrub ok 2024-02-19T21:54:18.998 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:17.960525+0000 osd.0 (osd.0) 291 : cluster [DBG] 6.10 deep-scrub starts 2024-02-19T21:54:18.998 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:17.964132+0000 osd.0 (osd.0) 292 : cluster [DBG] 6.10 deep-scrub ok 2024-02-19T21:54:18.998 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:17.243022+0000 mgr.y (mgr.14514) 831 : cluster [DBG] pgmap v1077: 138 pgs: 138 active+clean; 2.1 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 745 B/s rd, 91 MiB/s wr, 1.46k op/s 2024-02-19T21:54:18.998 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:17.712229+0000 osd.7 (osd.7) 277 : cluster [DBG] 2.0 scrub starts 2024-02-19T21:54:18.998 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:17.717897+0000 osd.7 (osd.7) 278 : cluster [DBG] 2.0 scrub ok 2024-02-19T21:54:18.998 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:17.960525+0000 osd.0 (osd.0) 291 : cluster [DBG] 6.10 deep-scrub starts 2024-02-19T21:54:18.998 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:17.964132+0000 osd.0 (osd.0) 292 : cluster [DBG] 6.10 deep-scrub ok 2024-02-19T21:54:19.001 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:19.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:17.243022+0000 mgr.y (mgr.14514) 831 : cluster [DBG] pgmap v1077: 138 pgs: 138 active+clean; 2.1 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 745 B/s rd, 91 MiB/s wr, 1.46k op/s 2024-02-19T21:54:19.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:17.712229+0000 osd.7 (osd.7) 277 : cluster [DBG] 2.0 scrub starts 2024-02-19T21:54:19.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:17.717897+0000 osd.7 (osd.7) 278 : cluster [DBG] 2.0 scrub ok 2024-02-19T21:54:19.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:17.960525+0000 osd.0 (osd.0) 291 : cluster [DBG] 6.10 deep-scrub starts 2024-02-19T21:54:19.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:17.964132+0000 osd.0 (osd.0) 292 : cluster [DBG] 6.10 deep-scrub ok 2024-02-19T21:54:19.104 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 19 16 41916 41900 137.784 84.8125 0.0114628 0.00721668 2024-02-19T21:54:19.986 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:18.387174+0000 osd.2 (osd.2) 33 : cluster [DBG] 6.14 deep-scrub starts 2024-02-19T21:54:19.986 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:18.393497+0000 osd.2 (osd.2) 34 : cluster [DBG] 6.14 deep-scrub ok 2024-02-19T21:54:19.987 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:18.666313+0000 osd.7 (osd.7) 279 : cluster [DBG] 6.1b scrub starts 2024-02-19T21:54:19.987 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:18.805814+0000 osd.7 (osd.7) 280 : cluster [DBG] 6.1b scrub ok 2024-02-19T21:54:19.987 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:18.921341+0000 osd.0 (osd.0) 293 : cluster [DBG] 4.6 scrub starts 2024-02-19T21:54:19.987 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:18.926251+0000 osd.0 (osd.0) 294 : cluster [DBG] 4.6 scrub ok 2024-02-19T21:54:19.987 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:18.970261+0000 mon.a (mon.0) 1907 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:54:19.987 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:19.344137+0000 osd.5 (osd.5) 287 : cluster [DBG] 2.2 scrub starts 2024-02-19T21:54:19.987 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:19.347903+0000 osd.5 (osd.5) 288 : cluster [DBG] 2.2 scrub ok 2024-02-19T21:54:19.987 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:18.387174+0000 osd.2 (osd.2) 33 : cluster [DBG] 6.14 deep-scrub starts 2024-02-19T21:54:19.987 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:18.393497+0000 osd.2 (osd.2) 34 : cluster [DBG] 6.14 deep-scrub ok 2024-02-19T21:54:19.987 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:18.666313+0000 osd.7 (osd.7) 279 : cluster [DBG] 6.1b scrub starts 2024-02-19T21:54:19.987 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:18.805814+0000 osd.7 (osd.7) 280 : cluster [DBG] 6.1b scrub ok 2024-02-19T21:54:19.988 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:18.921341+0000 osd.0 (osd.0) 293 : cluster [DBG] 4.6 scrub starts 2024-02-19T21:54:20.104 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:2024-02-19T21:54:20.105890+0000 min lat: 0.0011498 max lat: 0.168715 avg lat: 0.00734322 2024-02-19T21:54:20.104 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-19T21:54:20.104 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 20 16 43577 43561 136.083 103.812 0.00569263 0.00734322 2024-02-19T21:54:20.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:18.387174+0000 osd.2 (osd.2) 33 : cluster [DBG] 6.14 deep-scrub starts 2024-02-19T21:54:20.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:18.393497+0000 osd.2 (osd.2) 34 : cluster [DBG] 6.14 deep-scrub ok 2024-02-19T21:54:20.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:18.666313+0000 osd.7 (osd.7) 279 : cluster [DBG] 6.1b scrub starts 2024-02-19T21:54:20.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:18.805814+0000 osd.7 (osd.7) 280 : cluster [DBG] 6.1b scrub ok 2024-02-19T21:54:20.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:18.921341+0000 osd.0 (osd.0) 293 : cluster [DBG] 4.6 scrub starts 2024-02-19T21:54:20.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:18.926251+0000 osd.0 (osd.0) 294 : cluster [DBG] 4.6 scrub ok 2024-02-19T21:54:20.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:18.970261+0000 mon.a (mon.0) 1907 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:54:20.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:19.344137+0000 osd.5 (osd.5) 287 : cluster [DBG] 2.2 scrub starts 2024-02-19T21:54:20.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:19.347903+0000 osd.5 (osd.5) 288 : cluster [DBG] 2.2 scrub ok 2024-02-19T21:54:20.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:18.926251+0000 osd.0 (osd.0) 294 : cluster [DBG] 4.6 scrub ok 2024-02-19T21:54:20.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:18.970261+0000 mon.a (mon.0) 1907 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:54:20.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:19.344137+0000 osd.5 (osd.5) 287 : cluster [DBG] 2.2 scrub starts 2024-02-19T21:54:20.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:19.347903+0000 osd.5 (osd.5) 288 : cluster [DBG] 2.2 scrub ok 2024-02-19T21:54:20.361 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:54:20.370 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:20.371 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:54:20.471 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:54:20.521 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:20.549 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:54:20.552 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:20.553 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:54:20.654 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:54:20.699 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:20.725 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:54:20.732 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:20.732 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:54:20.833 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:54:20.884 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:20.976 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:54:20.985 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:20.986 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:54:21.004 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":1076,"stamp":"2024-02-19T21:54:15.242139+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2082084522,"num_objects":31962,"num_object_clones":0,"num_object_copies":95886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31962,"num_whiteouts":0,"num_read":2838,"num_read_kb":2590,"num_write":32767,"num_write_kb":2033319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":322,"num_bytes_recovered":7585,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32901,"ondisk_log_size":32901,"up":414,"acting":414,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":416,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":11456264,"kb_used_data":6077000,"kb_used_omap":0,"kb_used_meta":5379199,"kb_avail":738504952,"statfs":{"total":767960285184,"available":756229070848,"internally_reserved":0,"allocated":6222848000,"data_stored":6210781579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":5508299828},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,8,8,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1066074112,"num_objects":16267,"num_object_clones":0,"num_object_copies":48801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16267,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":16267,"num_write_kb":1041088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001277"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":98,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.665631+0000","last_change":"2024-02-19T21:49:54.492937+0000","last_active":"2024-02-19T21:54:11.665631+0000","last_peered":"2024-02-19T21:54:11.665631+0000","last_clean":"2024-02-19T21:54:11.665631+0000","last_became_active":"2024-02-19T21:49:54.492544+0000","last_became_peered":"2024-02-19T21:49:54.492544+0000","last_unstale":"2024-02-19T21:54:11.665631+0000","last_undegraded":"2024-02-19T21:54:11.665631+0000","last_fullsized":"2024-02-19T21:54:11.665631+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:21.643236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:48:21.643236+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":480,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.672593+0000","last_change":"2024-02-19T21:54:07.029225+0000","last_active":"2024-02-19T21:54:11.672593+0000","last_peered":"2024-02-19T21:54:11.672593+0000","last_clean":"2024-02-19T21:54:11.672593+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:54:11.672593+0000","last_undegraded":"2024-02-19T21:54:11.672593+0000","last_fullsized":"2024-02-19T21:54:11.672593+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:07.029148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:54:07.029148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"471'39","reported_seq":167,"reported_epoch":500,"state":"active+clean","last_fresh":"2024-02-19T21:54:10.381030+0000","last_change":"2024-02-19T21:53:54.277380+0000","last_active":"2024-02-19T21:54:10.381030+0000","last_peered":"2024-02-19T21:54:10.381030+0000","last_clean":"2024-02-19T21:54:10.381030+0000","last_became_active":"2024-02-19T21:49:08.327416+0000","last_became_peered":"2024-02-19T21:49:08.327416+0000","last_unstale":"2024-02-19T21:54:10.381030+0000","last_undegraded":"2024-02-19T21:54:10.381030+0000","last_fullsized":"2024-02-19T21:54:10.381030+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'39","last_scrub_stamp":"2024-02-19T21:53:54.277319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:53:54.277319+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":447,"reported_epoch":498,"state":"active+clean","last_fresh":"2024-02-19T21:53:54.178371+0000","last_change":"2024-02-19T21:48:30.516215+0000","last_active":"2024-02-19T21:53:54.178371+0000","last_peered":"2024-02-19T21:53:54.178371+0000","last_clean":"2024-02-19T21:53:54.178371+0000","last_became_active":"2024-02-19T21:47:46.250178+0000","last_became_peered":"2024-02-19T21:47:46.250178+0000","last_unstale":"2024-02-19T21:53:54.178371+0000","last_undegraded":"2024-02-19T21:53:54.178371+0000","last_fullsized":"2024-02-19T21:53:54.178371+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.516139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.516139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":24,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.662379+0000","last_change":"2024-02-19T21:53:52.503000+0000","last_active":"2024-02-19T21:54:11.662379+0000","last_peered":"2024-02-19T21:54:11.662379+0000","last_clean":"2024-02-19T21:54:11.662379+0000","last_became_active":"2024-02-19T21:53:45.368218+0000","last_became_peered":"2024-02-19T21:53:45.368218+0000","last_unstale":"2024-02-19T21:54:11.662379+0000","last_undegraded":"2024-02-19T21:54:11.662379+0000","last_fullsized":"2024-02-19T21:54:11.662379+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:52.502930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:53:52.502930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"470'25","reported_seq":552,"reported_epoch":498,"state":"active+clean","last_fresh":"2024-02-19T21:53:54.178181+0000","last_change":"2024-02-19T21:48:26.530234+0000","last_active":"2024-02-19T21:53:54.178181+0000","last_peered":"2024-02-19T21:53:54.178181+0000","last_clean":"2024-02-19T21:53:54.178181+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:53:54.178181+0000","last_undegraded":"2024-02-19T21:53:54.178181+0000","last_fullsized":"2024-02-19T21:53:54.178181+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'19","last_scrub_stamp":"2024-02-19T21:48:26.530160+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.530160+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":238,"reported_epoch":499,"state":"active+clean","last_fresh":"2024-02-19T21:54:06.616370+0000","last_change":"2024-02-19T21:54:02.455027+0000","last_active":"2024-02-19T21:54:06.616370+0000","last_peered":"2024-02-19T21:54:06.616370+0000","last_clean":"2024-02-19T21:54:06.616370+0000","last_became_active":"2024-02-19T21:49:08.331753+0000","last_became_peered":"2024-02-19T21:49:08.331753+0000","last_unstale":"2024-02-19T21:54:06.616370+0000","last_undegraded":"2024-02-19T21:54:06.616370+0000","last_fullsized":"2024-02-19T21:54:06.616370+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:02.454932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:02.454932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":495,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:13.655305+0000","last_change":"2024-02-19T21:54:13.655262+0000","last_active":"2024-02-19T21:54:13.655305+0000","last_peered":"2024-02-19T21:54:13.655305+0000","last_clean":"2024-02-19T21:54:13.655305+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:54:13.655305+0000","last_undegraded":"2024-02-19T21:54:13.655305+0000","last_fullsized":"2024-02-19T21:54:13.655305+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:13.655182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_clean_scrub_stamp":"2024-02-19T21:54:13.655182+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"470'11","reported_seq":526,"reported_epoch":498,"state":"active+clean","last_fresh":"2024-02-19T21:53:54.178673+0000","last_change":"2024-02-19T21:53:51.243831+0000","last_active":"2024-02-19T21:53:54.178673+0000","last_peered":"2024-02-19T21:53:54.178673+0000","last_clean":"2024-02-19T21:53:54.178673+0000","last_became_active":"2024-02-19T21:53:45.385837+0000","last_became_peered":"2024-02-19T21:53:45.385837+0000","last_unstale":"2024-02-19T21:53:54.178673+0000","last_undegraded":"2024-02-19T21:53:54.178673+0000","last_fullsized":"2024-02-19T21:53:54.178673+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'11","last_scrub_stamp":"2024-02-19T21:53:51.243743+0000","last_deep_scrub":"310'9","last_deep_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_clean_scrub_stamp":"2024-02-19T21:53:51.243743+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":414,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.672452+0000","last_change":"2024-02-19T21:54:00.131758+0000","last_active":"2024-02-19T21:54:11.672452+0000","last_peered":"2024-02-19T21:54:11.672452+0000","last_clean":"2024-02-19T21:54:11.672452+0000","last_became_active":"2024-02-19T21:46:31.204816+0000","last_became_peered":"2024-02-19T21:46:31.204816+0000","last_unstale":"2024-02-19T21:54:11.672452+0000","last_undegraded":"2024-02-19T21:54:11.672452+0000","last_fullsized":"2024-02-19T21:54:11.672452+0000","mapping_epoch":330,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":331,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:54:00.131654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:54:00.131654+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":517,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.666028+0000","last_change":"2024-02-19T21:53:58.606788+0000","last_active":"2024-02-19T21:54:11.666028+0000","last_peered":"2024-02-19T21:54:11.666028+0000","last_clean":"2024-02-19T21:54:11.666028+0000","last_became_active":"2024-02-19T21:49:08.329998+0000","last_became_peered":"2024-02-19T21:49:08.329998+0000","last_unstale":"2024-02-19T21:54:11.666028+0000","last_undegraded":"2024-02-19T21:54:11.666028+0000","last_fullsized":"2024-02-19T21:54:11.666028+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:58.606696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:58.606696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"470'25","reported_seq":386,"reported_epoch":499,"state":"active+clean","last_fresh":"2024-02-19T21:54:07.275961+0000","last_change":"2024-02-19T21:54:07.275961+0000","last_active":"2024-02-19T21:54:07.275961+0000","last_peered":"2024-02-19T21:54:07.275961+0000","last_clean":"2024-02-19T21:54:07.275961+0000","last_became_active":"2024-02-19T21:53:45.383294+0000","last_became_peered":"2024-02-19T21:53:45.383294+0000","last_unstale":"2024-02-19T21:54:07.275961+0000","last_undegraded":"2024-02-19T21:54:07.275961+0000","last_fullsized":"2024-02-19T21:54:07.275961+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'25","last_scrub_stamp":"2024-02-19T21:54:07.275895+0000","last_deep_scrub":"470'25","last_deep_scrub_stamp":"2024-02-19T21:54:07.275895+0000","last_clean_scrub_stamp":"2024-02-19T21:54:07.275895+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":24,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:12.582732+0000","last_change":"2024-02-19T21:54:12.582686+0000","last_active":"2024-02-19T21:54:12.582732+0000","last_peered":"2024-02-19T21:54:12.582732+0000","last_clean":"2024-02-19T21:54:12.582732+0000","last_became_active":"2024-02-19T21:53:45.369808+0000","last_became_peered":"2024-02-19T21:53:45.369808+0000","last_unstale":"2024-02-19T21:54:12.582732+0000","last_undegraded":"2024-02-19T21:54:12.582732+0000","last_fullsized":"2024-02-19T21:54:12.582732+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:12.582596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:12.582596+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":98,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.667694+0000","last_change":"2024-02-19T21:49:54.492767+0000","last_active":"2024-02-19T21:54:11.667694+0000","last_peered":"2024-02-19T21:54:11.667694+0000","last_clean":"2024-02-19T21:54:11.667694+0000","last_became_active":"2024-02-19T21:49:54.491745+0000","last_became_peered":"2024-02-19T21:49:54.491745+0000","last_unstale":"2024-02-19T21:54:11.667694+0000","last_undegraded":"2024-02-19T21:54:11.667694+0000","last_fullsized":"2024-02-19T21:54:11.667694+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.232539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.232539+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1d","version":"471'24","reported_seq":446,"reported_epoch":498,"state":"active+clean","last_fresh":"2024-02-19T21:53:54.185261+0000","last_change":"2024-02-19T21:48:25.734661+0000","last_active":"2024-02-19T21:53:54.185261+0000","last_peered":"2024-02-19T21:53:54.185261+0000","last_clean":"2024-02-19T21:53:54.185261+0000","last_became_active":"2024-02-19T21:38:31.247067+0000","last_became_peered":"2024-02-19T21:38:31.247067+0000","last_unstale":"2024-02-19T21:53:54.185261+0000","last_undegraded":"2024-02-19T21:53:54.185261+0000","last_fullsized":"2024-02-19T21:53:54.185261+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'18","last_scrub_stamp":"2024-02-19T21:48:25.734591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.734591+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":33,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,6],"acting":[1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":474,"reported_epoch":498,"state":"active+clean","last_fresh":"2024-02-19T21:53:54.179174+0000","last_change":"2024-02-19T21:48:40.528082+0000","last_active":"2024-02-19T21:53:54.179174+0000","last_peered":"2024-02-19T21:53:54.179174+0000","last_clean":"2024-02-19T21:53:54.179174+0000","last_became_active":"2024-02-19T21:44:58.788307+0000","last_became_peered":"2024-02-19T21:44:58.788307+0000","last_unstale":"2024-02-19T21:53:54.179174+0000","last_undegraded":"2024-02-19T21:53:54.179174+0000","last_fullsized":"2024-02-19T21:53:54.179174+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:40.527970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:48:40.527970+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":483,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.673942+0000","last_change":"2024-02-19T21:48:11.557832+0000","last_active":"2024-02-19T21:54:11.673942+0000","last_peered":"2024-02-19T21:54:11.673942+0000","last_clean":"2024-02-19T21:54:11.673942+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:54:11.673942+0000","last_undegraded":"2024-02-19T21:54:11.673942+0000","last_fullsized":"2024-02-19T21:54:11.673942+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.557736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:17.913620+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.557736+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"470'46","reported_seq":168,"reported_epoch":500,"state":"active+clean","last_fresh":"2024-02-19T21:54:10.381811+0000","last_change":"2024-02-19T21:54:04.369498+0000","last_active":"2024-02-19T21:54:10.381811+0000","last_peered":"2024-02-19T21:54:10.381811+0000","last_clean":"2024-02-19T21:54:10.381811+0000","last_became_active":"2024-02-19T21:49:08.331742+0000","last_became_peered":"2024-02-19T21:49:08.331742+0000","last_unstale":"2024-02-19T21:54:10.381811+0000","last_undegraded":"2024-02-19T21:54:10.381811+0000","last_fullsized":"2024-02-19T21:54:10.381811+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'46","last_scrub_stamp":"2024-02-19T21:54:04.369431+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:54:04.369431+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":494,"reported_epoch":498,"state":"active+clean","last_fresh":"2024-02-19T21:53:54.184768+0000","last_change":"2024-02-19T21:46:44.994389+0000","last_active":"2024-02-19T21:53:54.184768+0000","last_peered":"2024-02-19T21:53:54.184768+0000","last_clean":"2024-02-19T21:53:54.184768+0000","last_became_active":"2024-02-19T21:44:58.790669+0000","last_became_peered":"2024-02-19T21:44:58.790669+0000","last_unstale":"2024-02-19T21:53:54.184768+0000","last_undegraded":"2024-02-19T21:53:54.184768+0000","last_fullsized":"2024-02-19T21:53:54.184768+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.994296+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":436,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.669554+0000","last_change":"2024-02-19T21:53:55.597392+0000","last_active":"2024-02-19T21:54:11.669554+0000","last_peered":"2024-02-19T21:54:11.669554+0000","last_clean":"2024-02-19T21:54:11.669554+0000","last_became_active":"2024-02-19T21:49:08.329986+0000","last_became_peered":"2024-02-19T21:49:08.329986+0000","last_unstale":"2024-02-19T21:54:11.669554+0000","last_undegraded":"2024-02-19T21:54:11.669554+0000","last_fullsized":"2024-02-19T21:54:11.669554+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:55.597334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:55.597334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"471'27","reported_seq":391,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.671872+0000","last_change":"2024-02-19T21:48:26.366639+0000","last_active":"2024-02-19T21:54:11.671872+0000","last_peered":"2024-02-19T21:54:11.671872+0000","last_clean":"2024-02-19T21:54:11.671872+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:54:11.671872+0000","last_undegraded":"2024-02-19T21:54:11.671872+0000","last_fullsized":"2024-02-19T21:54:11.671872+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:26.366563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.366563+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":36,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":363,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.665841+0000","last_change":"2024-02-19T21:54:03.580153+0000","last_active":"2024-02-19T21:54:11.665841+0000","last_peered":"2024-02-19T21:54:11.665841+0000","last_clean":"2024-02-19T21:54:11.665841+0000","last_became_active":"2024-02-19T21:51:22.461599+0000","last_became_peered":"2024-02-19T21:51:22.461599+0000","last_unstale":"2024-02-19T21:54:11.665841+0000","last_undegraded":"2024-02-19T21:54:11.665841+0000","last_fullsized":"2024-02-19T21:54:11.665841+0000","mapping_epoch":445,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":446,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:54:03.580085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:54:03.580085+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":494,"reported_epoch":499,"state":"active+clean","last_fresh":"2024-02-19T21:54:06.616213+0000","last_change":"2024-02-19T21:49:54.491840+0000","last_active":"2024-02-19T21:54:06.616213+0000","last_peered":"2024-02-19T21:54:06.616213+0000","last_clean":"2024-02-19T21:54:06.616213+0000","last_became_active":"2024-02-19T21:49:54.491488+0000","last_became_peered":"2024-02-19T21:49:54.491488+0000","last_unstale":"2024-02-19T21:54:06.616213+0000","last_undegraded":"2024-02-19T21:54:06.616213+0000","last_fullsized":"2024-02-19T21:54:06.616213+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.803606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.803606+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"470'30","reported_seq":595,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.673509+0000","last_change":"2024-02-19T21:49:54.502402+0000","last_active":"2024-02-19T21:54:11.673509+0000","last_peered":"2024-02-19T21:54:11.673509+0000","last_clean":"2024-02-19T21:54:11.673509+0000","last_became_active":"2024-02-19T21:49:54.483748+0000","last_became_peered":"2024-02-19T21:49:54.483748+0000","last_unstale":"2024-02-19T21:54:11.673509+0000","last_undegraded":"2024-02-19T21:54:11.673509+0000","last_fullsized":"2024-02-19T21:54:11.673509+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:48:25.348437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.348437+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":415,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.673381+0000","last_change":"2024-02-19T21:49:08.328206+0000","last_active":"2024-02-19T21:54:11.673381+0000","last_peered":"2024-02-19T21:54:11.673381+0000","last_clean":"2024-02-19T21:54:11.673381+0000","last_became_active":"2024-02-19T21:49:08.327865+0000","last_became_peered":"2024-02-19T21:49:08.327865+0000","last_unstale":"2024-02-19T21:54:11.673381+0000","last_undegraded":"2024-02-19T21:54:11.673381+0000","last_fullsized":"2024-02-19T21:54:11.673381+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.230652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.230652+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":477,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.665379+0000","last_change":"2024-02-19T21:48:22.171667+0000","last_active":"2024-02-19T21:54:11.665379+0000","last_peered":"2024-02-19T21:54:11.665379+0000","last_clean":"2024-02-19T21:54:11.665379+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:54:11.665379+0000","last_undegraded":"2024-02-19T21:54:11.665379+0000","last_fullsized":"2024-02-19T21:54:11.665379+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.171600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.171600+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":516,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.673203+0000","last_change":"2024-02-19T21:53:54.630006+0000","last_active":"2024-02-19T21:54:11.673203+0000","last_peered":"2024-02-19T21:54:11.673203+0000","last_clean":"2024-02-19T21:54:11.673203+0000","last_became_active":"2024-02-19T21:49:08.330293+0000","last_became_peered":"2024-02-19T21:49:08.330293+0000","last_unstale":"2024-02-19T21:54:11.673203+0000","last_undegraded":"2024-02-19T21:54:11.673203+0000","last_fullsized":"2024-02-19T21:54:11.673203+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:54.629909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:54.629909+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"471'32","reported_seq":38,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.663071+0000","last_change":"2024-02-19T21:54:04.345127+0000","last_active":"2024-02-19T21:54:11.663071+0000","last_peered":"2024-02-19T21:54:11.663071+0000","last_clean":"2024-02-19T21:54:11.663071+0000","last_became_active":"2024-02-19T21:53:45.367870+0000","last_became_peered":"2024-02-19T21:53:45.367870+0000","last_unstale":"2024-02-19T21:54:11.663071+0000","last_undegraded":"2024-02-19T21:54:11.663071+0000","last_fullsized":"2024-02-19T21:54:11.663071+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'32","last_scrub_stamp":"2024-02-19T21:54:04.345011+0000","last_deep_scrub":"381'24","last_deep_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_clean_scrub_stamp":"2024-02-19T21:54:04.345011+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":510,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.665673+0000","last_change":"2024-02-19T21:53:57.593397+0000","last_active":"2024-02-19T21:54:11.665673+0000","last_peered":"2024-02-19T21:54:11.665673+0000","last_clean":"2024-02-19T21:54:11.665673+0000","last_became_active":"2024-02-19T21:49:08.333537+0000","last_became_peered":"2024-02-19T21:49:08.333537+0000","last_unstale":"2024-02-19T21:54:11.665673+0000","last_undegraded":"2024-02-19T21:54:11.665673+0000","last_fullsized":"2024-02-19T21:54:11.665673+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:57.593320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:53:57.593320+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":531,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.671522+0000","last_change":"2024-02-19T21:49:54.494561+0000","last_active":"2024-02-19T21:54:11.671522+0000","last_peered":"2024-02-19T21:54:11.671522+0000","last_clean":"2024-02-19T21:54:11.671522+0000","last_became_active":"2024-02-19T21:49:54.494146+0000","last_became_peered":"2024-02-19T21:49:54.494146+0000","last_unstale":"2024-02-19T21:54:11.671522+0000","last_undegraded":"2024-02-19T21:54:11.671522+0000","last_fullsized":"2024-02-19T21:54:11.671522+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.560066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":504,"reported_epoch":499,"state":"active+clean","last_fresh":"2024-02-19T21:54:06.616990+0000","last_change":"2024-02-19T21:49:09.765641+0000","last_active":"2024-02-19T21:54:06.616990+0000","last_peered":"2024-02-19T21:54:06.616990+0000","last_clean":"2024-02-19T21:54:06.616990+0000","last_became_active":"2024-02-19T21:49:08.331308+0000","last_became_peered":"2024-02-19T21:49:08.331308+0000","last_unstale":"2024-02-19T21:54:06.616990+0000","last_undegraded":"2024-02-19T21:54:06.616990+0000","last_fullsized":"2024-02-19T21:54:06.616990+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.765568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.765568+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"470'12","reported_seq":30,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.662311+0000","last_change":"2024-02-19T21:53:56.431405+0000","last_active":"2024-02-19T21:54:11.662311+0000","last_peered":"2024-02-19T21:54:11.662311+0000","last_clean":"2024-02-19T21:54:11.662311+0000","last_became_active":"2024-02-19T21:53:45.368256+0000","last_became_peered":"2024-02-19T21:53:45.368256+0000","last_unstale":"2024-02-19T21:54:11.662311+0000","last_undegraded":"2024-02-19T21:54:11.662311+0000","last_fullsized":"2024-02-19T21:54:11.662311+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'12","last_scrub_stamp":"2024-02-19T21:53:56.431339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:53:56.431339+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":415,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.672847+0000","last_change":"2024-02-19T21:49:08.918163+0000","last_active":"2024-02-19T21:54:11.672847+0000","last_peered":"2024-02-19T21:54:11.672847+0000","last_clean":"2024-02-19T21:54:11.672847+0000","last_became_active":"2024-02-19T21:49:08.328416+0000","last_became_peered":"2024-02-19T21:49:08.328416+0000","last_unstale":"2024-02-19T21:54:11.672847+0000","last_undegraded":"2024-02-19T21:54:11.672847+0000","last_fullsized":"2024-02-19T21:54:11.672847+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.918083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.918083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":492,"reported_epoch":498,"state":"active+clean","last_fresh":"2024-02-19T21:53:54.184260+0000","last_change":"2024-02-19T21:49:54.480716+0000","last_active":"2024-02-19T21:53:54.184260+0000","last_peered":"2024-02-19T21:53:54.184260+0000","last_clean":"2024-02-19T21:53:54.184260+0000","last_became_active":"2024-02-19T21:49:54.480368+0000","last_became_peered":"2024-02-19T21:49:54.480368+0000","last_unstale":"2024-02-19T21:53:54.184260+0000","last_undegraded":"2024-02-19T21:53:54.184260+0000","last_fullsized":"2024-02-19T21:53:54.184260+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:19.596775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:19.596775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":476,"reported_epoch":498,"state":"active+clean","last_fresh":"2024-02-19T21:53:54.184954+0000","last_change":"2024-02-19T21:49:05.012463+0000","last_active":"2024-02-19T21:53:54.184954+0000","last_peered":"2024-02-19T21:53:54.184954+0000","last_clean":"2024-02-19T21:53:54.184954+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:53:54.184954+0000","last_undegraded":"2024-02-19T21:53:54.184954+0000","last_fullsized":"2024-02-19T21:53:54.184954+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.012395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.012395+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"470'27","reported_seq":535,"reported_epoch":498,"state":"active+clean","last_fresh":"2024-02-19T21:53:54.178849+0000","last_change":"2024-02-19T21:48:38.529106+0000","last_active":"2024-02-19T21:53:54.178849+0000","last_peered":"2024-02-19T21:53:54.178849+0000","last_clean":"2024-02-19T21:53:54.178849+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:53:54.178849+0000","last_undegraded":"2024-02-19T21:53:54.178849+0000","last_fullsized":"2024-02-19T21:53:54.178849+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:38.528977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.528977+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":480,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.672204+0000","last_change":"2024-02-19T21:46:06.096531+0000","last_active":"2024-02-19T21:54:11.672204+0000","last_peered":"2024-02-19T21:54:11.672204+0000","last_clean":"2024-02-19T21:54:11.672204+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:54:11.672204+0000","last_undegraded":"2024-02-19T21:54:11.672204+0000","last_fullsized":"2024-02-19T21:54:11.672204+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:06.096422+0000","last_clean_scrub_stamp":"2024-02-19T21:46:06.096422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":24,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.662711+0000","last_change":"2024-02-19T21:54:06.348379+0000","last_active":"2024-02-19T21:54:11.662711+0000","last_peered":"2024-02-19T21:54:11.662711+0000","last_clean":"2024-02-19T21:54:11.662711+0000","last_became_active":"2024-02-19T21:53:45.369330+0000","last_became_peered":"2024-02-19T21:53:45.369330+0000","last_unstale":"2024-02-19T21:54:11.662711+0000","last_undegraded":"2024-02-19T21:54:11.662711+0000","last_fullsized":"2024-02-19T21:54:11.662711+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:06.348272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:54:06.348272+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":501,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.673806+0000","last_change":"2024-02-19T21:53:45.384838+0000","last_active":"2024-02-19T21:54:11.673806+0000","last_peered":"2024-02-19T21:54:11.673806+0000","last_clean":"2024-02-19T21:54:11.673806+0000","last_became_active":"2024-02-19T21:53:45.384501+0000","last_became_peered":"2024-02-19T21:53:45.384501+0000","last_unstale":"2024-02-19T21:54:11.673806+0000","last_undegraded":"2024-02-19T21:54:11.673806+0000","last_fullsized":"2024-02-19T21:54:11.673806+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:14.600285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.600285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"470'21","reported_seq":558,"reported_epoch":499,"state":"active+clean","last_fresh":"2024-02-19T21:54:08.452215+0000","last_change":"2024-02-19T21:54:08.452605+0000","last_active":"2024-02-19T21:54:08.452215+0000","last_peered":"2024-02-19T21:54:08.452215+0000","last_clean":"2024-02-19T21:54:08.452215+0000","last_became_active":"2024-02-19T21:49:08.333872+0000","last_became_peered":"2024-02-19T21:49:08.333872+0000","last_unstale":"2024-02-19T21:54:08.452215+0000","last_undegraded":"2024-02-19T21:54:08.452215+0000","last_fullsized":"2024-02-19T21:54:08.452215+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'15","last_scrub_stamp":"2024-02-19T21:45:08.678669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:08.678669+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":462,"reported_epoch":499,"state":"active+clean","last_fresh":"2024-02-19T21:54:08.470718+0000","last_change":"2024-02-19T21:54:08.470718+0000","last_active":"2024-02-19T21:54:08.470718+0000","last_peered":"2024-02-19T21:54:08.470718+0000","last_clean":"2024-02-19T21:54:08.470718+0000","last_became_active":"2024-02-19T21:49:08.329770+0000","last_became_peered":"2024-02-19T21:49:08.329770+0000","last_unstale":"2024-02-19T21:54:08.470718+0000","last_undegraded":"2024-02-19T21:54:08.470718+0000","last_fullsized":"2024-02-19T21:54:08.470718+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:08.470650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:54:08.470650+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"415'17","reported_seq":159,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:12.128042+0000","last_change":"2024-02-19T21:53:56.588487+0000","last_active":"2024-02-19T21:54:12.128042+0000","last_peered":"2024-02-19T21:54:12.128042+0000","last_clean":"2024-02-19T21:54:12.128042+0000","last_became_active":"2024-02-19T21:49:54.486304+0000","last_became_peered":"2024-02-19T21:49:54.486304+0000","last_unstale":"2024-02-19T21:54:12.128042+0000","last_undegraded":"2024-02-19T21:54:12.128042+0000","last_fullsized":"2024-02-19T21:54:12.128042+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"415'17","last_scrub_stamp":"2024-02-19T21:53:56.588421+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:53:56.588421+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":516,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.673674+0000","last_change":"2024-02-19T21:54:01.110262+0000","last_active":"2024-02-19T21:54:11.673674+0000","last_peered":"2024-02-19T21:54:11.673674+0000","last_clean":"2024-02-19T21:54:11.673674+0000","last_became_active":"2024-02-19T21:53:45.371729+0000","last_became_peered":"2024-02-19T21:53:45.371729+0000","last_unstale":"2024-02-19T21:54:11.673674+0000","last_undegraded":"2024-02-19T21:54:11.673674+0000","last_fullsized":"2024-02-19T21:54:11.673674+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:01.110166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_clean_scrub_stamp":"2024-02-19T21:54:01.110166+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"470'25","reported_seq":550,"reported_epoch":499,"state":"active+clean","last_fresh":"2024-02-19T21:54:06.616818+0000","last_change":"2024-02-19T21:53:45.398083+0000","last_active":"2024-02-19T21:54:06.616818+0000","last_peered":"2024-02-19T21:54:06.616818+0000","last_clean":"2024-02-19T21:54:06.616818+0000","last_became_active":"2024-02-19T21:53:45.384976+0000","last_became_peered":"2024-02-19T21:53:45.384976+0000","last_unstale":"2024-02-19T21:54:06.616818+0000","last_undegraded":"2024-02-19T21:54:06.616818+0000","last_fullsized":"2024-02-19T21:54:06.616818+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:27.719954+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:48:27.719954+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":219,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.673220+0000","last_change":"2024-02-19T21:49:54.484392+0000","last_active":"2024-02-19T21:54:11.673220+0000","last_peered":"2024-02-19T21:54:11.673220+0000","last_clean":"2024-02-19T21:54:11.673220+0000","last_became_active":"2024-02-19T21:49:54.484049+0000","last_became_peered":"2024-02-19T21:49:54.484049+0000","last_unstale":"2024-02-19T21:54:11.673220+0000","last_undegraded":"2024-02-19T21:54:11.673220+0000","last_fullsized":"2024-02-19T21:54:11.673220+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:04.121769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:46:04.121769+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":742,"reported_epoch":499,"state":"active+clean","last_fresh":"2024-02-19T21:54:07.127103+0000","last_change":"2024-02-19T21:48:38.723220+0000","last_active":"2024-02-19T21:54:07.127103+0000","last_peered":"2024-02-19T21:54:07.127103+0000","last_clean":"2024-02-19T21:54:07.127103+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:54:07.127103+0000","last_undegraded":"2024-02-19T21:54:07.127103+0000","last_fullsized":"2024-02-19T21:54:07.127103+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:48:38.723151+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:48:38.723151+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":514,"reported_epoch":499,"state":"active+clean","last_fresh":"2024-02-19T21:54:06.616279+0000","last_change":"2024-02-19T21:53:45.384547+0000","last_active":"2024-02-19T21:54:06.616279+0000","last_peered":"2024-02-19T21:54:06.616279+0000","last_clean":"2024-02-19T21:54:06.616279+0000","last_became_active":"2024-02-19T21:53:45.384012+0000","last_became_peered":"2024-02-19T21:53:45.384012+0000","last_unstale":"2024-02-19T21:54:06.616279+0000","last_undegraded":"2024-02-19T21:54:06.616279+0000","last_fullsized":"2024-02-19T21:54:06.616279+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:07.724097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:49:07.724097+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"470'35","reported_seq":36,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.662513+0000","last_change":"2024-02-19T21:53:54.498661+0000","last_active":"2024-02-19T21:54:11.662513+0000","last_peered":"2024-02-19T21:54:11.662513+0000","last_clean":"2024-02-19T21:54:11.662513+0000","last_became_active":"2024-02-19T21:53:45.367708+0000","last_became_peered":"2024-02-19T21:53:45.367708+0000","last_unstale":"2024-02-19T21:54:11.662513+0000","last_undegraded":"2024-02-19T21:54:11.662513+0000","last_fullsized":"2024-02-19T21:54:11.662513+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'35","last_scrub_stamp":"2024-02-19T21:53:54.498596+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:53:54.498596+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":482,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.667997+0000","last_change":"2024-02-19T21:54:11.667953+0000","last_active":"2024-02-19T21:54:11.667997+0000","last_peered":"2024-02-19T21:54:11.667997+0000","last_clean":"2024-02-19T21:54:11.667997+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:54:11.667997+0000","last_undegraded":"2024-02-19T21:54:11.667997+0000","last_fullsized":"2024-02-19T21:54:11.667997+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:11.667872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:11.667872+0000","last_clean_scrub_stamp":"2024-02-19T21:54:11.667872+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":487,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.669757+0000","last_change":"2024-02-19T21:53:56.583766+0000","last_active":"2024-02-19T21:54:11.669757+0000","last_peered":"2024-02-19T21:54:11.669757+0000","last_clean":"2024-02-19T21:54:11.669757+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:54:11.669757+0000","last_undegraded":"2024-02-19T21:54:11.669757+0000","last_fullsized":"2024-02-19T21:54:11.669757+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:56.583707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:56.583707+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"470'18","reported_seq":115,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.667069+0000","last_change":"2024-02-19T21:50:49.700758+0000","last_active":"2024-02-19T21:54:11.667069+0000","last_peered":"2024-02-19T21:54:11.667069+0000","last_clean":"2024-02-19T21:54:11.667069+0000","last_became_active":"2024-02-19T21:49:54.478094+0000","last_became_peered":"2024-02-19T21:49:54.478094+0000","last_unstale":"2024-02-19T21:54:11.667069+0000","last_undegraded":"2024-02-19T21:54:11.667069+0000","last_fullsized":"2024-02-19T21:54:11.667069+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'12","last_scrub_stamp":"2024-02-19T21:49:08.912638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.912638+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":23,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":128,"reported_epoch":500,"state":"active+clean","last_fresh":"2024-02-19T21:54:10.381862+0000","last_change":"2024-02-19T21:49:08.332757+0000","last_active":"2024-02-19T21:54:10.381862+0000","last_peered":"2024-02-19T21:54:10.381862+0000","last_clean":"2024-02-19T21:54:10.381862+0000","last_became_active":"2024-02-19T21:49:08.332176+0000","last_became_peered":"2024-02-19T21:49:08.332176+0000","last_unstale":"2024-02-19T21:54:10.381862+0000","last_undegraded":"2024-02-19T21:54:10.381862+0000","last_fullsized":"2024-02-19T21:54:10.381862+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:47:01.365477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:47:01.365477+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":133,"reported_epoch":500,"state":"active+clean","last_fresh":"2024-02-19T21:54:10.380819+0000","last_change":"2024-02-19T21:53:53.263606+0000","last_active":"2024-02-19T21:54:10.380819+0000","last_peered":"2024-02-19T21:54:10.380819+0000","last_clean":"2024-02-19T21:54:10.380819+0000","last_became_active":"2024-02-19T21:49:08.327826+0000","last_became_peered":"2024-02-19T21:49:08.327826+0000","last_unstale":"2024-02-19T21:54:10.380819+0000","last_undegraded":"2024-02-19T21:54:10.380819+0000","last_fullsized":"2024-02-19T21:54:10.380819+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:53.263540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:53:53.263540+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"470'21","reported_seq":638,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.673331+0000","last_change":"2024-02-19T21:53:52.104355+0000","last_active":"2024-02-19T21:54:11.673331+0000","last_peered":"2024-02-19T21:54:11.673331+0000","last_clean":"2024-02-19T21:54:11.673331+0000","last_became_active":"2024-02-19T21:49:54.483578+0000","last_became_peered":"2024-02-19T21:49:54.483578+0000","last_unstale":"2024-02-19T21:54:11.673331+0000","last_undegraded":"2024-02-19T21:54:11.673331+0000","last_fullsized":"2024-02-19T21:54:11.673331+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'21","last_scrub_stamp":"2024-02-19T21:53:52.104285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:53:52.104285+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"502'2226","reported_seq":2244,"reported_epoch":502,"state":"active+clean","last_fresh":"2024-02-19T21:54:14.801728+0000","last_change":"2024-02-19T21:53:45.368993+0000","last_active":"2024-02-19T21:54:14.801728+0000","last_peered":"2024-02-19T21:54:14.801728+0000","last_clean":"2024-02-19T21:54:14.801728+0000","last_became_active":"2024-02-19T21:53:45.368696+0000","last_became_peered":"2024-02-19T21:53:45.368696+0000","last_unstale":"2024-02-19T21:54:14.801728+0000","last_undegraded":"2024-02-19T21:54:14.801728+0000","last_fullsized":"2024-02-19T21:54:14.801728+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":2226,"ondisk_log_size":2226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":145883136,"num_objects":2226,"num_object_clones":0,"num_object_copies":6678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2226,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2226,"num_write_kb":142464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":24,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.662785+0000","last_change":"2024-02-19T21:54:10.520264+0000","last_active":"2024-02-19T21:54:11.662785+0000","last_peered":"2024-02-19T21:54:11.662785+0000","last_clean":"2024-02-19T21:54:11.662785+0000","last_became_active":"2024-02-19T21:53:45.368696+0000","last_became_peered":"2024-02-19T21:53:45.368696+0000","last_unstale":"2024-02-19T21:54:11.662785+0000","last_undegraded":"2024-02-19T21:54:11.662785+0000","last_fullsized":"2024-02-19T21:54:11.662785+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:10.520197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:54:10.520197+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"378'4","reported_seq":513,"reported_epoch":498,"state":"active+clean","last_fresh":"2024-02-19T21:53:54.179239+0000","last_change":"2024-02-19T21:48:28.510929+0000","last_active":"2024-02-19T21:53:54.179239+0000","last_peered":"2024-02-19T21:53:54.179239+0000","last_clean":"2024-02-19T21:53:54.179239+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:53:54.179239+0000","last_undegraded":"2024-02-19T21:53:54.179239+0000","last_fullsized":"2024-02-19T21:53:54.179239+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"378'4","last_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_deep_scrub":"378'4","last_deep_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_clean_scrub_stamp":"2024-02-19T21:48:28.510849+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"470'29","reported_seq":369,"reported_epoch":498,"state":"active+clean","last_fresh":"2024-02-19T21:53:54.178800+0000","last_change":"2024-02-19T21:48:22.519465+0000","last_active":"2024-02-19T21:53:54.178800+0000","last_peered":"2024-02-19T21:53:54.178800+0000","last_clean":"2024-02-19T21:53:54.178800+0000","last_became_active":"2024-02-19T21:47:46.252085+0000","last_became_peered":"2024-02-19T21:47:46.252085+0000","last_unstale":"2024-02-19T21:53:54.178800+0000","last_undegraded":"2024-02-19T21:53:54.178800+0000","last_fullsized":"2024-02-19T21:53:54.178800+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'23","last_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_deep_scrub":"200'23","last_deep_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.519381+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":33,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6],"acting":[4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":133,"reported_epoch":500,"state":"active+clean","last_fresh":"2024-02-19T21:54:10.381014+0000","last_change":"2024-02-19T21:53:56.234612+0000","last_active":"2024-02-19T21:54:10.381014+0000","last_peered":"2024-02-19T21:54:10.381014+0000","last_clean":"2024-02-19T21:54:10.381014+0000","last_became_active":"2024-02-19T21:49:08.328237+0000","last_became_peered":"2024-02-19T21:49:08.328237+0000","last_unstale":"2024-02-19T21:54:10.381014+0000","last_undegraded":"2024-02-19T21:54:10.381014+0000","last_fullsized":"2024-02-19T21:54:10.381014+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:56.234550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:53:56.234550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"501'1868","reported_seq":1885,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:12.248645+0000","last_change":"2024-02-19T21:53:45.366793+0000","last_active":"2024-02-19T21:54:12.248645+0000","last_peered":"2024-02-19T21:54:12.248645+0000","last_clean":"2024-02-19T21:54:12.248645+0000","last_became_active":"2024-02-19T21:53:45.366507+0000","last_became_peered":"2024-02-19T21:53:45.366507+0000","last_unstale":"2024-02-19T21:54:12.248645+0000","last_undegraded":"2024-02-19T21:54:12.248645+0000","last_fullsized":"2024-02-19T21:54:12.248645+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":1868,"ondisk_log_size":1868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":122421248,"num_objects":1868,"num_object_clones":0,"num_object_copies":5604,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1868,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1868,"num_write_kb":119552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6],"acting":[2,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":543,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.672249+0000","last_change":"2024-02-19T21:54:03.090621+0000","last_active":"2024-02-19T21:54:11.672249+0000","last_peered":"2024-02-19T21:54:11.672249+0000","last_clean":"2024-02-19T21:54:11.672249+0000","last_became_active":"2024-02-19T21:53:45.372402+0000","last_became_peered":"2024-02-19T21:53:45.372402+0000","last_unstale":"2024-02-19T21:54:11.672249+0000","last_undegraded":"2024-02-19T21:54:11.672249+0000","last_fullsized":"2024-02-19T21:54:11.672249+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:03.090525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:03.090525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":474,"reported_epoch":498,"state":"active+clean","last_fresh":"2024-02-19T21:53:54.184549+0000","last_change":"2024-02-19T21:48:37.789514+0000","last_active":"2024-02-19T21:53:54.184549+0000","last_peered":"2024-02-19T21:53:54.184549+0000","last_clean":"2024-02-19T21:53:54.184549+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:53:54.184549+0000","last_undegraded":"2024-02-19T21:53:54.184549+0000","last_fullsized":"2024-02-19T21:53:54.184549+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:37.789400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:37.789400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"470'30","reported_seq":395,"reported_epoch":498,"state":"active+clean","last_fresh":"2024-02-19T21:53:54.184182+0000","last_change":"2024-02-19T21:45:57.877936+0000","last_active":"2024-02-19T21:53:54.184182+0000","last_peered":"2024-02-19T21:53:54.184182+0000","last_clean":"2024-02-19T21:53:54.184182+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:53:54.184182+0000","last_undegraded":"2024-02-19T21:53:54.184182+0000","last_fullsized":"2024-02-19T21:53:54.184182+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:45:57.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:57.877856+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":748,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:12.129028+0000","last_change":"2024-02-19T21:49:01.011149+0000","last_active":"2024-02-19T21:54:12.129028+0000","last_peered":"2024-02-19T21:54:12.129028+0000","last_clean":"2024-02-19T21:54:12.129028+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:54:12.129028+0000","last_undegraded":"2024-02-19T21:54:12.129028+0000","last_fullsized":"2024-02-19T21:54:12.129028+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:49:01.011078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:49:01.011078+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"499'1553","reported_seq":1568,"reported_epoch":499,"state":"active+clean","last_fresh":"2024-02-19T21:54:10.274223+0000","last_change":"2024-02-19T21:53:45.371934+0000","last_active":"2024-02-19T21:54:10.274223+0000","last_peered":"2024-02-19T21:54:10.274223+0000","last_clean":"2024-02-19T21:54:10.274223+0000","last_became_active":"2024-02-19T21:53:45.371632+0000","last_became_peered":"2024-02-19T21:53:45.371632+0000","last_unstale":"2024-02-19T21:54:10.274223+0000","last_undegraded":"2024-02-19T21:54:10.274223+0000","last_fullsized":"2024-02-19T21:54:10.274223+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":1553,"ondisk_log_size":1553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":101777408,"num_objects":1553,"num_object_clones":0,"num_object_copies":4659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1553,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1553,"num_write_kb":99392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":423,"reported_epoch":498,"state":"active+clean","last_fresh":"2024-02-19T21:53:54.179337+0000","last_change":"2024-02-19T21:48:33.478821+0000","last_active":"2024-02-19T21:53:54.179337+0000","last_peered":"2024-02-19T21:53:54.179337+0000","last_clean":"2024-02-19T21:53:54.179337+0000","last_became_active":"2024-02-19T21:44:56.149476+0000","last_became_peered":"2024-02-19T21:44:56.149476+0000","last_unstale":"2024-02-19T21:53:54.179337+0000","last_undegraded":"2024-02-19T21:53:54.179337+0000","last_fullsized":"2024-02-19T21:53:54.179337+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:33.478715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:48:33.478715+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":484,"reported_epoch":499,"state":"active+clean","last_fresh":"2024-02-19T21:54:06.616335+0000","last_change":"2024-02-19T21:46:41.834315+0000","last_active":"2024-02-19T21:54:06.616335+0000","last_peered":"2024-02-19T21:54:06.616335+0000","last_clean":"2024-02-19T21:54:06.616335+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:54:06.616335+0000","last_undegraded":"2024-02-19T21:54:06.616335+0000","last_fullsized":"2024-02-19T21:54:06.616335+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:41.834246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:46:41.834246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"470'58","reported_seq":954,"reported_epoch":499,"state":"active+clean","last_fresh":"2024-02-19T21:54:06.618099+0000","last_change":"2024-02-19T21:49:08.335296+0000","last_active":"2024-02-19T21:54:06.618099+0000","last_peered":"2024-02-19T21:54:06.618099+0000","last_clean":"2024-02-19T21:54:06.618099+0000","last_became_active":"2024-02-19T21:49:08.334527+0000","last_became_peered":"2024-02-19T21:49:08.334527+0000","last_unstale":"2024-02-19T21:54:06.618099+0000","last_undegraded":"2024-02-19T21:54:06.618099+0000","last_fullsized":"2024-02-19T21:54:06.618099+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'43","last_scrub_stamp":"2024-02-19T21:45:04.755444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:04.755444+0000","log_size":58,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":50,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":471,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.672317+0000","last_change":"2024-02-19T21:46:45.252437+0000","last_active":"2024-02-19T21:54:11.672317+0000","last_peered":"2024-02-19T21:54:11.672317+0000","last_clean":"2024-02-19T21:54:11.672317+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:54:11.672317+0000","last_undegraded":"2024-02-19T21:54:11.672317+0000","last_fullsized":"2024-02-19T21:54:11.672317+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:45.252344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:46:45.252344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"502'2277","reported_seq":2295,"reported_epoch":502,"state":"active+clean","last_fresh":"2024-02-19T21:54:15.171584+0000","last_change":"2024-02-19T21:53:45.367105+0000","last_active":"2024-02-19T21:54:15.171584+0000","last_peered":"2024-02-19T21:54:15.171584+0000","last_clean":"2024-02-19T21:54:15.171584+0000","last_became_active":"2024-02-19T21:53:45.366773+0000","last_became_peered":"2024-02-19T21:53:45.366773+0000","last_unstale":"2024-02-19T21:54:15.171584+0000","last_undegraded":"2024-02-19T21:54:15.171584+0000","last_fullsized":"2024-02-19T21:54:15.171584+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":2277,"ondisk_log_size":2277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":149225472,"num_objects":2277,"num_object_clones":0,"num_object_copies":6831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2277,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2277,"num_write_kb":145728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":510,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.665888+0000","last_change":"2024-02-19T21:53:45.368651+0000","last_active":"2024-02-19T21:54:11.665888+0000","last_peered":"2024-02-19T21:54:11.665888+0000","last_clean":"2024-02-19T21:54:11.665888+0000","last_became_active":"2024-02-19T21:53:45.368343+0000","last_became_peered":"2024-02-19T21:53:45.368343+0000","last_unstale":"2024-02-19T21:54:11.665888+0000","last_undegraded":"2024-02-19T21:54:11.665888+0000","last_fullsized":"2024-02-19T21:54:11.665888+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.227355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.227355+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'6","reported_seq":1908,"reported_epoch":499,"state":"active+clean","last_fresh":"2024-02-19T21:54:08.992183+0000","last_change":"2024-02-19T21:53:56.369658+0000","last_active":"2024-02-19T21:54:08.992183+0000","last_peered":"2024-02-19T21:54:08.992183+0000","last_clean":"2024-02-19T21:54:08.992183+0000","last_became_active":"2024-02-19T21:49:08.331108+0000","last_became_peered":"2024-02-19T21:49:08.331108+0000","last_unstale":"2024-02-19T21:54:08.992183+0000","last_undegraded":"2024-02-19T21:54:08.992183+0000","last_fullsized":"2024-02-19T21:54:08.992183+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-02-19T21:53:56.369590+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_clean_scrub_stamp":"2024-02-19T21:53:56.369590+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1286,"num_read_kb":1281,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":500,"state":"active+clean","last_fresh":"2024-02-19T21:54:10.381198+0000","last_change":"2024-02-19T21:54:07.330521+0000","last_active":"2024-02-19T21:54:10.381198+0000","last_peered":"2024-02-19T21:54:10.381198+0000","last_clean":"2024-02-19T21:54:10.381198+0000","last_became_active":"2024-02-19T21:49:08.329378+0000","last_became_peered":"2024-02-19T21:49:08.329378+0000","last_unstale":"2024-02-19T21:54:10.381198+0000","last_undegraded":"2024-02-19T21:54:10.381198+0000","last_fullsized":"2024-02-19T21:54:10.381198+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:07.330454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:07.330454+0000","last_clean_scrub_stamp":"2024-02-19T21:54:07.330454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"470'21","reported_seq":537,"reported_epoch":498,"state":"active+clean","last_fresh":"2024-02-19T21:53:54.185374+0000","last_change":"2024-02-19T21:48:14.878933+0000","last_active":"2024-02-19T21:53:54.185374+0000","last_peered":"2024-02-19T21:53:54.185374+0000","last_clean":"2024-02-19T21:53:54.185374+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:53:54.185374+0000","last_undegraded":"2024-02-19T21:53:54.185374+0000","last_fullsized":"2024-02-19T21:53:54.185374+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'17","last_scrub_stamp":"2024-02-19T21:48:14.878857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.878857+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":31,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":133,"reported_epoch":500,"state":"active+clean","last_fresh":"2024-02-19T21:54:10.381783+0000","last_change":"2024-02-19T21:53:59.298965+0000","last_active":"2024-02-19T21:54:10.381783+0000","last_peered":"2024-02-19T21:54:10.381783+0000","last_clean":"2024-02-19T21:54:10.381783+0000","last_became_active":"2024-02-19T21:49:08.325127+0000","last_became_peered":"2024-02-19T21:49:08.325127+0000","last_unstale":"2024-02-19T21:54:10.381783+0000","last_undegraded":"2024-02-19T21:54:10.381783+0000","last_fullsized":"2024-02-19T21:54:10.381783+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:59.298898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:53:59.298898+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"502'2181","reported_seq":2198,"reported_epoch":502,"state":"active+clean","last_fresh":"2024-02-19T21:54:15.141139+0000","last_change":"2024-02-19T21:53:45.370224+0000","last_active":"2024-02-19T21:54:15.141139+0000","last_peered":"2024-02-19T21:54:15.141139+0000","last_clean":"2024-02-19T21:54:15.141139+0000","last_became_active":"2024-02-19T21:53:45.369947+0000","last_became_peered":"2024-02-19T21:53:45.369947+0000","last_unstale":"2024-02-19T21:54:15.141139+0000","last_undegraded":"2024-02-19T21:54:15.141139+0000","last_fullsized":"2024-02-19T21:54:15.141139+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":2181,"ondisk_log_size":2181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":142934016,"num_objects":2181,"num_object_clones":0,"num_object_copies":6543,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2181,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2181,"num_write_kb":139584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":515,"reported_epoch":499,"state":"active+clean","last_fresh":"2024-02-19T21:54:06.617255+0000","last_change":"2024-02-19T21:54:05.543474+0000","last_active":"2024-02-19T21:54:06.617255+0000","last_peered":"2024-02-19T21:54:06.617255+0000","last_clean":"2024-02-19T21:54:06.617255+0000","last_became_active":"2024-02-19T21:53:45.385423+0000","last_became_peered":"2024-02-19T21:53:45.385423+0000","last_unstale":"2024-02-19T21:54:06.617255+0000","last_undegraded":"2024-02-19T21:54:06.617255+0000","last_fullsized":"2024-02-19T21:54:06.617255+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:05.543362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_clean_scrub_stamp":"2024-02-19T21:54:05.543362+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":379,"reported_epoch":499,"state":"active+clean","last_fresh":"2024-02-19T21:54:06.616499+0000","last_change":"2024-02-19T21:49:05.746443+0000","last_active":"2024-02-19T21:54:06.616499+0000","last_peered":"2024-02-19T21:54:06.616499+0000","last_clean":"2024-02-19T21:54:06.616499+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:54:06.616499+0000","last_undegraded":"2024-02-19T21:54:06.616499+0000","last_fullsized":"2024-02-19T21:54:06.616499+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.746358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.746358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":536,"reported_epoch":499,"state":"active+clean","last_fresh":"2024-02-19T21:54:06.616263+0000","last_change":"2024-02-19T21:53:58.410557+0000","last_active":"2024-02-19T21:54:06.616263+0000","last_peered":"2024-02-19T21:54:06.616263+0000","last_clean":"2024-02-19T21:54:06.616263+0000","last_became_active":"2024-02-19T21:49:54.484956+0000","last_became_peered":"2024-02-19T21:49:54.484956+0000","last_unstale":"2024-02-19T21:54:06.616263+0000","last_undegraded":"2024-02-19T21:54:06.616263+0000","last_fullsized":"2024-02-19T21:54:06.616263+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:58.410478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:58.410478+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":103,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.665129+0000","last_change":"2024-02-19T21:53:51.510006+0000","last_active":"2024-02-19T21:54:11.665129+0000","last_peered":"2024-02-19T21:54:11.665129+0000","last_clean":"2024-02-19T21:54:11.665129+0000","last_became_active":"2024-02-19T21:49:54.483637+0000","last_became_peered":"2024-02-19T21:49:54.483637+0000","last_unstale":"2024-02-19T21:54:11.665129+0000","last_undegraded":"2024-02-19T21:54:11.665129+0000","last_fullsized":"2024-02-19T21:54:11.665129+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:51.509926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:53:51.509926+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"470'45","reported_seq":548,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.672596+0000","last_change":"2024-02-19T21:53:59.548929+0000","last_active":"2024-02-19T21:54:11.672596+0000","last_peered":"2024-02-19T21:54:11.672596+0000","last_clean":"2024-02-19T21:54:11.672596+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:54:11.672596+0000","last_undegraded":"2024-02-19T21:54:11.672596+0000","last_fullsized":"2024-02-19T21:54:11.672596+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'45","last_scrub_stamp":"2024-02-19T21:53:59.548843+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:53:59.548843+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":51,"num_write":37,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":103,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.666144+0000","last_change":"2024-02-19T21:53:55.571648+0000","last_active":"2024-02-19T21:54:11.666144+0000","last_peered":"2024-02-19T21:54:11.666144+0000","last_clean":"2024-02-19T21:54:11.666144+0000","last_became_active":"2024-02-19T21:49:54.477947+0000","last_became_peered":"2024-02-19T21:49:54.477947+0000","last_unstale":"2024-02-19T21:54:11.666144+0000","last_undegraded":"2024-02-19T21:54:11.666144+0000","last_fullsized":"2024-02-19T21:54:11.666144+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:55.571582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:53:55.571582+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"502'2137","reported_seq":2155,"reported_epoch":502,"state":"active+clean","last_fresh":"2024-02-19T21:54:15.178805+0000","last_change":"2024-02-19T21:53:45.367633+0000","last_active":"2024-02-19T21:54:15.178805+0000","last_peered":"2024-02-19T21:54:15.178805+0000","last_clean":"2024-02-19T21:54:15.178805+0000","last_became_active":"2024-02-19T21:53:45.367151+0000","last_became_peered":"2024-02-19T21:53:45.367151+0000","last_unstale":"2024-02-19T21:54:15.178805+0000","last_undegraded":"2024-02-19T21:54:15.178805+0000","last_fullsized":"2024-02-19T21:54:15.178805+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":2137,"ondisk_log_size":2137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":140050432,"num_objects":2137,"num_object_clones":0,"num_object_copies":6411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2137,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2137,"num_write_kb":136768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1],"acting":[6,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":472,"reported_epoch":498,"state":"active+clean","last_fresh":"2024-02-19T21:53:54.185609+0000","last_change":"2024-02-19T21:45:47.723650+0000","last_active":"2024-02-19T21:53:54.185609+0000","last_peered":"2024-02-19T21:53:54.185609+0000","last_clean":"2024-02-19T21:53:54.185609+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:53:54.185609+0000","last_undegraded":"2024-02-19T21:53:54.185609+0000","last_fullsized":"2024-02-19T21:53:54.185609+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.723550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.723550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":489,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.672759+0000","last_change":"2024-02-19T21:54:08.084019+0000","last_active":"2024-02-19T21:54:11.672759+0000","last_peered":"2024-02-19T21:54:11.672759+0000","last_clean":"2024-02-19T21:54:11.672759+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:54:11.672759+0000","last_undegraded":"2024-02-19T21:54:11.672759+0000","last_fullsized":"2024-02-19T21:54:11.672759+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:08.083923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:54:08.083923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":503,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.665223+0000","last_change":"2024-02-19T21:48:23.218358+0000","last_active":"2024-02-19T21:54:11.665223+0000","last_peered":"2024-02-19T21:54:11.665223+0000","last_clean":"2024-02-19T21:54:11.665223+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:54:11.665223+0000","last_undegraded":"2024-02-19T21:54:11.665223+0000","last_fullsized":"2024-02-19T21:54:11.665223+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:23.218282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.218282+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"470'42","reported_seq":646,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.673281+0000","last_change":"2024-02-19T21:49:08.330490+0000","last_active":"2024-02-19T21:54:11.673281+0000","last_peered":"2024-02-19T21:54:11.673281+0000","last_clean":"2024-02-19T21:54:11.673281+0000","last_became_active":"2024-02-19T21:49:08.329761+0000","last_became_peered":"2024-02-19T21:49:08.329761+0000","last_unstale":"2024-02-19T21:54:11.673281+0000","last_undegraded":"2024-02-19T21:54:11.673281+0000","last_fullsized":"2024-02-19T21:54:11.673281+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'30","last_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_deep_scrub":"324'30","last_deep_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_clean_scrub_stamp":"2024-02-19T21:46:08.110965+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":48,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":490,"reported_epoch":499,"state":"active+clean","last_fresh":"2024-02-19T21:54:06.617220+0000","last_change":"2024-02-19T21:53:53.417715+0000","last_active":"2024-02-19T21:54:06.617220+0000","last_peered":"2024-02-19T21:54:06.617220+0000","last_clean":"2024-02-19T21:54:06.617220+0000","last_became_active":"2024-02-19T21:44:42.624782+0000","last_became_peered":"2024-02-19T21:44:42.624782+0000","last_unstale":"2024-02-19T21:54:06.617220+0000","last_undegraded":"2024-02-19T21:54:06.617220+0000","last_fullsized":"2024-02-19T21:54:06.617220+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":295,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:53.417639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_clean_scrub_stamp":"2024-02-19T21:53:53.417639+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.c","version":"499'1685","reported_seq":1700,"reported_epoch":499,"state":"active+clean","last_fresh":"2024-02-19T21:54:10.164945+0000","last_change":"2024-02-19T21:53:45.366888+0000","last_active":"2024-02-19T21:54:10.164945+0000","last_peered":"2024-02-19T21:54:10.164945+0000","last_clean":"2024-02-19T21:54:10.164945+0000","last_became_active":"2024-02-19T21:53:45.366605+0000","last_became_peered":"2024-02-19T21:53:45.366605+0000","last_unstale":"2024-02-19T21:54:10.164945+0000","last_undegraded":"2024-02-19T21:54:10.164945+0000","last_fullsized":"2024-02-19T21:54:10.164945+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":1685,"ondisk_log_size":1685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110428160,"num_objects":1685,"num_object_clones":0,"num_object_copies":5055,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1685,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1685,"num_write_kb":107840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":510,"reported_epoch":498,"state":"active+clean","last_fresh":"2024-02-19T21:53:59.350751+0000","last_change":"2024-02-19T21:53:59.350715+0000","last_active":"2024-02-19T21:53:59.350751+0000","last_peered":"2024-02-19T21:53:59.350751+0000","last_clean":"2024-02-19T21:53:59.350751+0000","last_became_active":"2024-02-19T21:49:08.330648+0000","last_became_peered":"2024-02-19T21:49:08.330648+0000","last_unstale":"2024-02-19T21:53:59.350751+0000","last_undegraded":"2024-02-19T21:53:59.350751+0000","last_fullsized":"2024-02-19T21:53:59.350751+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:59.350627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:53:59.350627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":479,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.665957+0000","last_change":"2024-02-19T21:48:31.320229+0000","last_active":"2024-02-19T21:54:11.665957+0000","last_peered":"2024-02-19T21:54:11.665957+0000","last_clean":"2024-02-19T21:54:11.665957+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:54:11.665957+0000","last_undegraded":"2024-02-19T21:54:11.665957+0000","last_fullsized":"2024-02-19T21:54:11.665957+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:31.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:45.017696+0000","last_clean_scrub_stamp":"2024-02-19T21:48:31.320133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"470'47","reported_seq":552,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.673524+0000","last_change":"2024-02-19T21:53:58.140432+0000","last_active":"2024-02-19T21:54:11.673524+0000","last_peered":"2024-02-19T21:54:11.673524+0000","last_clean":"2024-02-19T21:54:11.673524+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:54:11.673524+0000","last_undegraded":"2024-02-19T21:54:11.673524+0000","last_fullsized":"2024-02-19T21:54:11.673524+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'47","last_scrub_stamp":"2024-02-19T21:53:58.140324+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:53:58.140324+0000","log_size":47,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":55,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":481,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.674068+0000","last_change":"2024-02-19T21:54:02.567491+0000","last_active":"2024-02-19T21:54:11.674068+0000","last_peered":"2024-02-19T21:54:11.674068+0000","last_clean":"2024-02-19T21:54:11.674068+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:54:11.674068+0000","last_undegraded":"2024-02-19T21:54:11.674068+0000","last_fullsized":"2024-02-19T21:54:11.674068+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:02.567400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:54:02.567400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"502'2189","reported_seq":2206,"reported_epoch":502,"state":"active+clean","last_fresh":"2024-02-19T21:54:14.857078+0000","last_change":"2024-02-19T21:53:45.370394+0000","last_active":"2024-02-19T21:54:14.857078+0000","last_peered":"2024-02-19T21:54:14.857078+0000","last_clean":"2024-02-19T21:54:14.857078+0000","last_became_active":"2024-02-19T21:53:45.370069+0000","last_became_peered":"2024-02-19T21:53:45.370069+0000","last_unstale":"2024-02-19T21:54:14.857078+0000","last_undegraded":"2024-02-19T21:54:14.857078+0000","last_fullsized":"2024-02-19T21:54:14.857078+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":2189,"ondisk_log_size":2189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":143458304,"num_objects":2189,"num_object_clones":0,"num_object_copies":6567,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2189,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2189,"num_write_kb":140096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":223,"reported_epoch":498,"state":"active+clean","last_fresh":"2024-02-19T21:54:04.297532+0000","last_change":"2024-02-19T21:54:04.297489+0000","last_active":"2024-02-19T21:54:04.297532+0000","last_peered":"2024-02-19T21:54:04.297532+0000","last_clean":"2024-02-19T21:54:04.297532+0000","last_became_active":"2024-02-19T21:49:08.326106+0000","last_became_peered":"2024-02-19T21:49:08.326106+0000","last_unstale":"2024-02-19T21:54:04.297532+0000","last_undegraded":"2024-02-19T21:54:04.297532+0000","last_fullsized":"2024-02-19T21:54:04.297532+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:04.297389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:04.297389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":478,"reported_epoch":498,"state":"active+clean","last_fresh":"2024-02-19T21:53:54.185047+0000","last_change":"2024-02-19T21:48:11.879787+0000","last_active":"2024-02-19T21:53:54.185047+0000","last_peered":"2024-02-19T21:53:54.185047+0000","last_clean":"2024-02-19T21:53:54.185047+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:53:54.185047+0000","last_undegraded":"2024-02-19T21:53:54.185047+0000","last_fullsized":"2024-02-19T21:53:54.185047+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.879687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.879687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"470'50","reported_seq":134,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.665325+0000","last_change":"2024-02-19T21:49:55.861358+0000","last_active":"2024-02-19T21:54:11.665325+0000","last_peered":"2024-02-19T21:54:11.665325+0000","last_clean":"2024-02-19T21:54:11.665325+0000","last_became_active":"2024-02-19T21:49:54.480413+0000","last_became_peered":"2024-02-19T21:49:54.480413+0000","last_unstale":"2024-02-19T21:54:11.665325+0000","last_undegraded":"2024-02-19T21:54:11.665325+0000","last_fullsized":"2024-02-19T21:54:11.665325+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":415,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'38","last_scrub_stamp":"2024-02-19T21:49:05.923627+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.923627+0000","log_size":50,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":57,"num_write":44,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":372,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.669969+0000","last_change":"2024-02-19T21:49:54.495134+0000","last_active":"2024-02-19T21:54:11.669969+0000","last_peered":"2024-02-19T21:54:11.669969+0000","last_clean":"2024-02-19T21:54:11.669969+0000","last_became_active":"2024-02-19T21:49:54.494802+0000","last_became_peered":"2024-02-19T21:49:54.494802+0000","last_unstale":"2024-02-19T21:54:11.669969+0000","last_undegraded":"2024-02-19T21:54:11.669969+0000","last_fullsized":"2024-02-19T21:54:11.669969+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:10.578408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:10.578408+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"499'1678","reported_seq":1693,"reported_epoch":499,"state":"active+clean","last_fresh":"2024-02-19T21:54:10.287624+0000","last_change":"2024-02-19T21:53:45.386994+0000","last_active":"2024-02-19T21:54:10.287624+0000","last_peered":"2024-02-19T21:54:10.287624+0000","last_clean":"2024-02-19T21:54:10.287624+0000","last_became_active":"2024-02-19T21:53:45.386670+0000","last_became_peered":"2024-02-19T21:53:45.386670+0000","last_unstale":"2024-02-19T21:54:10.287624+0000","last_undegraded":"2024-02-19T21:54:10.287624+0000","last_fullsized":"2024-02-19T21:54:10.287624+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":1678,"ondisk_log_size":1678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109969408,"num_objects":1678,"num_object_clones":0,"num_object_copies":5034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1678,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1678,"num_write_kb":107392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7],"acting":[4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":513,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.667892+0000","last_change":"2024-02-19T21:54:01.641103+0000","last_active":"2024-02-19T21:54:11.667892+0000","last_peered":"2024-02-19T21:54:11.667892+0000","last_clean":"2024-02-19T21:54:11.667892+0000","last_became_active":"2024-02-19T21:49:08.328529+0000","last_became_peered":"2024-02-19T21:49:08.328529+0000","last_unstale":"2024-02-19T21:54:11.667892+0000","last_undegraded":"2024-02-19T21:54:11.667892+0000","last_fullsized":"2024-02-19T21:54:11.667892+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:01.641007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:01.641007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":544,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.673281+0000","last_change":"2024-02-19T21:53:52.715548+0000","last_active":"2024-02-19T21:54:11.673281+0000","last_peered":"2024-02-19T21:54:11.673281+0000","last_clean":"2024-02-19T21:54:11.673281+0000","last_became_active":"2024-02-19T21:49:54.493041+0000","last_became_peered":"2024-02-19T21:49:54.493041+0000","last_unstale":"2024-02-19T21:54:11.673281+0000","last_undegraded":"2024-02-19T21:54:11.673281+0000","last_fullsized":"2024-02-19T21:54:11.673281+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:52.715486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:52.715486+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"470'42","reported_seq":371,"reported_epoch":498,"state":"active+clean","last_fresh":"2024-02-19T21:54:01.223521+0000","last_change":"2024-02-19T21:54:01.223459+0000","last_active":"2024-02-19T21:54:01.223521+0000","last_peered":"2024-02-19T21:54:01.223521+0000","last_clean":"2024-02-19T21:54:01.223521+0000","last_became_active":"2024-02-19T21:49:08.330477+0000","last_became_peered":"2024-02-19T21:49:08.330477+0000","last_unstale":"2024-02-19T21:54:01.223521+0000","last_undegraded":"2024-02-19T21:54:01.223521+0000","last_fullsized":"2024-02-19T21:54:01.223521+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'42","last_scrub_stamp":"2024-02-19T21:54:01.223355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:54:01.223355+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":595,"reported_epoch":499,"state":"active+clean","last_fresh":"2024-02-19T21:54:06.613718+0000","last_change":"2024-02-19T21:45:50.742626+0000","last_active":"2024-02-19T21:54:06.613718+0000","last_peered":"2024-02-19T21:54:06.613718+0000","last_clean":"2024-02-19T21:54:06.613718+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:54:06.613718+0000","last_undegraded":"2024-02-19T21:54:06.613718+0000","last_fullsized":"2024-02-19T21:54:06.613718+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'9","last_scrub_stamp":"2024-02-19T21:45:50.742526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:50.742526+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"502'2182","reported_seq":2200,"reported_epoch":502,"state":"active+clean","last_fresh":"2024-02-19T21:54:15.178676+0000","last_change":"2024-02-19T21:53:45.367451+0000","last_active":"2024-02-19T21:54:15.178676+0000","last_peered":"2024-02-19T21:54:15.178676+0000","last_clean":"2024-02-19T21:54:15.178676+0000","last_became_active":"2024-02-19T21:53:45.366735+0000","last_became_peered":"2024-02-19T21:53:45.366735+0000","last_unstale":"2024-02-19T21:54:15.178676+0000","last_undegraded":"2024-02-19T21:54:15.178676+0000","last_fullsized":"2024-02-19T21:54:15.178676+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":2182,"ondisk_log_size":2182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":142999552,"num_objects":2182,"num_object_clones":0,"num_object_copies":6546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2182,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2182,"num_write_kb":139648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"66'1","reported_seq":390,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.673938+0000","last_change":"2024-02-19T21:48:12.568842+0000","last_active":"2024-02-19T21:54:11.673938+0000","last_peered":"2024-02-19T21:54:11.673938+0000","last_clean":"2024-02-19T21:54:11.673938+0000","last_became_active":"2024-02-19T21:44:56.166670+0000","last_became_peered":"2024-02-19T21:44:56.166670+0000","last_unstale":"2024-02-19T21:54:11.673938+0000","last_undegraded":"2024-02-19T21:54:11.673938+0000","last_fullsized":"2024-02-19T21:54:11.673938+0000","mapping_epoch":165,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:48:12.568734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.568734+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"261'11","reported_seq":611,"reported_epoch":499,"state":"active+clean","last_fresh":"2024-02-19T21:54:07.126946+0000","last_change":"2024-02-19T21:53:55.479779+0000","last_active":"2024-02-19T21:54:07.126946+0000","last_peered":"2024-02-19T21:54:07.126946+0000","last_clean":"2024-02-19T21:54:07.126946+0000","last_became_active":"2024-02-19T21:44:08.123392+0000","last_became_peered":"2024-02-19T21:44:08.123392+0000","last_unstale":"2024-02-19T21:54:07.126946+0000","last_undegraded":"2024-02-19T21:54:07.126946+0000","last_fullsized":"2024-02-19T21:54:07.126946+0000","mapping_epoch":62,"log_start":"257'10","ondisk_log_start":"257'10","created":62,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-02-19T21:53:55.479699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:53:55.479699+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":490,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.665290+0000","last_change":"2024-02-19T21:48:19.186455+0000","last_active":"2024-02-19T21:54:11.665290+0000","last_peered":"2024-02-19T21:54:11.665290+0000","last_clean":"2024-02-19T21:54:11.665290+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:54:11.665290+0000","last_undegraded":"2024-02-19T21:54:11.665290+0000","last_fullsized":"2024-02-19T21:54:11.665290+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:48:19.186359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:19.186359+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"470'27","reported_seq":357,"reported_epoch":498,"state":"active+clean","last_fresh":"2024-02-19T21:53:54.179148+0000","last_change":"2024-02-19T21:48:34.485865+0000","last_active":"2024-02-19T21:53:54.179148+0000","last_peered":"2024-02-19T21:53:54.179148+0000","last_clean":"2024-02-19T21:53:54.179148+0000","last_became_active":"2024-02-19T21:47:46.251550+0000","last_became_peered":"2024-02-19T21:47:46.251550+0000","last_unstale":"2024-02-19T21:53:54.179148+0000","last_undegraded":"2024-02-19T21:53:54.179148+0000","last_fullsized":"2024-02-19T21:53:54.179148+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:34.485787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:34.485787+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7],"acting":[4,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.0","version":"499'1628","reported_seq":1643,"reported_epoch":499,"state":"active+clean","last_fresh":"2024-02-19T21:54:10.276770+0000","last_change":"2024-02-19T21:53:45.376702+0000","last_active":"2024-02-19T21:54:10.276770+0000","last_peered":"2024-02-19T21:54:10.276770+0000","last_clean":"2024-02-19T21:54:10.276770+0000","last_became_active":"2024-02-19T21:53:45.376392+0000","last_became_peered":"2024-02-19T21:53:45.376392+0000","last_unstale":"2024-02-19T21:54:10.276770+0000","last_undegraded":"2024-02-19T21:54:10.276770+0000","last_fullsized":"2024-02-19T21:54:10.276770+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":1628,"ondisk_log_size":1628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":106692608,"num_objects":1628,"num_object_clones":0,"num_object_copies":4884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1628,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1628,"num_write_kb":104192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,6],"acting":[1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":499,"reported_epoch":499,"state":"active+clean","last_fresh":"2024-02-19T21:54:06.617084+0000","last_change":"2024-02-19T21:54:06.529408+0000","last_active":"2024-02-19T21:54:06.617084+0000","last_peered":"2024-02-19T21:54:06.617084+0000","last_clean":"2024-02-19T21:54:06.617084+0000","last_became_active":"2024-02-19T21:44:56.155194+0000","last_became_peered":"2024-02-19T21:44:56.155194+0000","last_unstale":"2024-02-19T21:54:06.617084+0000","last_undegraded":"2024-02-19T21:54:06.617084+0000","last_fullsized":"2024-02-19T21:54:06.617084+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:06.529311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:06.529311+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"363'12","reported_seq":318,"reported_epoch":499,"state":"active+clean","last_fresh":"2024-02-19T21:54:06.615111+0000","last_change":"2024-02-19T21:48:25.487689+0000","last_active":"2024-02-19T21:54:06.615111+0000","last_peered":"2024-02-19T21:54:06.615111+0000","last_clean":"2024-02-19T21:54:06.615111+0000","last_became_active":"2024-02-19T21:47:46.260099+0000","last_became_peered":"2024-02-19T21:47:46.260099+0000","last_unstale":"2024-02-19T21:54:06.615111+0000","last_undegraded":"2024-02-19T21:54:06.615111+0000","last_fullsized":"2024-02-19T21:54:06.615111+0000","mapping_epoch":362,"log_start":"98'9","ondisk_log_start":"98'9","created":62,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"363'12","last_scrub_stamp":"2024-02-19T21:48:25.487608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.487608+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":507,"reported_epoch":498,"state":"active+clean","last_fresh":"2024-02-19T21:53:54.183911+0000","last_change":"2024-02-19T21:53:45.383252+0000","last_active":"2024-02-19T21:53:54.183911+0000","last_peered":"2024-02-19T21:53:54.183911+0000","last_clean":"2024-02-19T21:53:54.183911+0000","last_became_active":"2024-02-19T21:53:45.382885+0000","last_became_peered":"2024-02-19T21:53:45.382885+0000","last_unstale":"2024-02-19T21:53:54.183911+0000","last_undegraded":"2024-02-19T21:53:54.183911+0000","last_fullsized":"2024-02-19T21:53:54.183911+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:16.700887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:45:16.700887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"471'46","reported_seq":461,"reported_epoch":499,"state":"active+clean","last_fresh":"2024-02-19T21:54:06.617011+0000","last_change":"2024-02-19T21:53:45.989505+0000","last_active":"2024-02-19T21:54:06.617011+0000","last_peered":"2024-02-19T21:54:06.617011+0000","last_clean":"2024-02-19T21:54:06.617011+0000","last_became_active":"2024-02-19T21:53:45.384528+0000","last_became_peered":"2024-02-19T21:53:45.384528+0000","last_unstale":"2024-02-19T21:54:06.617011+0000","last_undegraded":"2024-02-19T21:54:06.617011+0000","last_fullsized":"2024-02-19T21:54:06.617011+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"270'34","last_scrub_stamp":"2024-02-19T21:46:44.789309+0000","last_deep_scrub":"270'34","last_deep_scrub_stamp":"2024-02-19T21:44:17.451151+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.789309+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"502'2420","reported_seq":2438,"reported_epoch":502,"state":"active+clean","last_fresh":"2024-02-19T21:54:15.186330+0000","last_change":"2024-02-19T21:53:45.368346+0000","last_active":"2024-02-19T21:54:15.186330+0000","last_peered":"2024-02-19T21:54:15.186330+0000","last_clean":"2024-02-19T21:54:15.186330+0000","last_became_active":"2024-02-19T21:53:45.368025+0000","last_became_peered":"2024-02-19T21:53:45.368025+0000","last_unstale":"2024-02-19T21:54:15.186330+0000","last_undegraded":"2024-02-19T21:54:15.186330+0000","last_fullsized":"2024-02-19T21:54:15.186330+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":2420,"ondisk_log_size":2420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":158597120,"num_objects":2420,"num_object_clones":0,"num_object_copies":7260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2420,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2420,"num_write_kb":154880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1],"acting":[6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":481,"reported_epoch":498,"state":"active+clean","last_fresh":"2024-02-19T21:53:55.275955+0000","last_change":"2024-02-19T21:53:55.275891+0000","last_active":"2024-02-19T21:53:55.275955+0000","last_peered":"2024-02-19T21:53:55.275955+0000","last_clean":"2024-02-19T21:53:55.275955+0000","last_became_active":"2024-02-19T21:49:08.328697+0000","last_became_peered":"2024-02-19T21:49:08.328697+0000","last_unstale":"2024-02-19T21:53:55.275955+0000","last_undegraded":"2024-02-19T21:53:55.275955+0000","last_fullsized":"2024-02-19T21:53:55.275955+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:55.275772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:53:55.275772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"397'17","reported_seq":449,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.672408+0000","last_change":"2024-02-19T21:49:08.325927+0000","last_active":"2024-02-19T21:54:11.672408+0000","last_peered":"2024-02-19T21:54:11.672408+0000","last_clean":"2024-02-19T21:54:11.672408+0000","last_became_active":"2024-02-19T21:49:08.325034+0000","last_became_peered":"2024-02-19T21:49:08.325034+0000","last_unstale":"2024-02-19T21:54:11.672408+0000","last_undegraded":"2024-02-19T21:54:11.672408+0000","last_fullsized":"2024-02-19T21:54:11.672408+0000","mapping_epoch":394,"log_start":"170'11","ondisk_log_start":"170'11","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"271'13","last_scrub_stamp":"2024-02-19T21:46:47.072988+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:46:47.072988+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":497,"reported_epoch":498,"state":"active+clean","last_fresh":"2024-02-19T21:53:54.183993+0000","last_change":"2024-02-19T21:53:45.383685+0000","last_active":"2024-02-19T21:53:54.183993+0000","last_peered":"2024-02-19T21:53:54.183993+0000","last_clean":"2024-02-19T21:53:54.183993+0000","last_became_active":"2024-02-19T21:53:45.383372+0000","last_became_peered":"2024-02-19T21:53:45.383372+0000","last_unstale":"2024-02-19T21:53:54.183993+0000","last_undegraded":"2024-02-19T21:53:54.183993+0000","last_fullsized":"2024-02-19T21:53:54.183993+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:03.987749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:49:03.987749+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"470'30","reported_seq":358,"reported_epoch":498,"state":"active+clean","last_fresh":"2024-02-19T21:53:54.178728+0000","last_change":"2024-02-19T21:53:46.000818+0000","last_active":"2024-02-19T21:53:54.178728+0000","last_peered":"2024-02-19T21:53:54.178728+0000","last_clean":"2024-02-19T21:53:54.178728+0000","last_became_active":"2024-02-19T21:53:45.387040+0000","last_became_peered":"2024-02-19T21:53:45.387040+0000","last_unstale":"2024-02-19T21:53:54.178728+0000","last_undegraded":"2024-02-19T21:53:54.178728+0000","last_fullsized":"2024-02-19T21:53:54.178728+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'20","last_scrub_stamp":"2024-02-19T21:48:12.628700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:12.628700+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":38,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"501'1884","reported_seq":1901,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:12.227191+0000","last_change":"2024-02-19T21:53:45.369471+0000","last_active":"2024-02-19T21:54:12.227191+0000","last_peered":"2024-02-19T21:54:12.227191+0000","last_clean":"2024-02-19T21:54:12.227191+0000","last_became_active":"2024-02-19T21:53:45.369133+0000","last_became_peered":"2024-02-19T21:53:45.369133+0000","last_unstale":"2024-02-19T21:54:12.227191+0000","last_undegraded":"2024-02-19T21:54:12.227191+0000","last_fullsized":"2024-02-19T21:54:12.227191+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":1884,"ondisk_log_size":1884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123469824,"num_objects":1884,"num_object_clones":0,"num_object_copies":5652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1884,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1884,"num_write_kb":120576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":133,"reported_epoch":500,"state":"active+clean","last_fresh":"2024-02-19T21:54:10.382586+0000","last_change":"2024-02-19T21:54:00.421089+0000","last_active":"2024-02-19T21:54:10.382586+0000","last_peered":"2024-02-19T21:54:10.382586+0000","last_clean":"2024-02-19T21:54:10.382586+0000","last_became_active":"2024-02-19T21:49:08.327172+0000","last_became_peered":"2024-02-19T21:49:08.327172+0000","last_unstale":"2024-02-19T21:54:10.382586+0000","last_undegraded":"2024-02-19T21:54:10.382586+0000","last_fullsized":"2024-02-19T21:54:10.382586+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:00.420978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:00.420978+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,6],"acting":[2,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":483,"reported_epoch":498,"state":"active+clean","last_fresh":"2024-02-19T21:53:54.185531+0000","last_change":"2024-02-19T21:45:01.798485+0000","last_active":"2024-02-19T21:53:54.185531+0000","last_peered":"2024-02-19T21:53:54.185531+0000","last_clean":"2024-02-19T21:53:54.185531+0000","last_became_active":"2024-02-19T21:44:22.245925+0000","last_became_peered":"2024-02-19T21:44:22.245925+0000","last_unstale":"2024-02-19T21:53:54.185531+0000","last_undegraded":"2024-02-19T21:53:54.185531+0000","last_fullsized":"2024-02-19T21:53:54.185531+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:01.798387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:45:01.798387+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":486,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.667774+0000","last_change":"2024-02-19T21:48:30.277397+0000","last_active":"2024-02-19T21:54:11.667774+0000","last_peered":"2024-02-19T21:54:11.667774+0000","last_clean":"2024-02-19T21:54:11.667774+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:54:11.667774+0000","last_undegraded":"2024-02-19T21:54:11.667774+0000","last_fullsized":"2024-02-19T21:54:11.667774+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:30.277322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:48:30.277322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"470'53","reported_seq":457,"reported_epoch":498,"state":"active+clean","last_fresh":"2024-02-19T21:54:05.257242+0000","last_change":"2024-02-19T21:54:05.257204+0000","last_active":"2024-02-19T21:54:05.257242+0000","last_peered":"2024-02-19T21:54:05.257242+0000","last_clean":"2024-02-19T21:54:05.257242+0000","last_became_active":"2024-02-19T21:49:08.325683+0000","last_became_peered":"2024-02-19T21:49:08.325683+0000","last_unstale":"2024-02-19T21:54:05.257242+0000","last_undegraded":"2024-02-19T21:54:05.257242+0000","last_fullsized":"2024-02-19T21:54:05.257242+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'53","last_scrub_stamp":"2024-02-19T21:54:05.257106+0000","last_deep_scrub":"337'39","last_deep_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_clean_scrub_stamp":"2024-02-19T21:54:05.257106+0000","log_size":53,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"502'2124","reported_seq":2142,"reported_epoch":502,"state":"active+clean","last_fresh":"2024-02-19T21:54:14.874243+0000","last_change":"2024-02-19T21:53:45.369602+0000","last_active":"2024-02-19T21:54:14.874243+0000","last_peered":"2024-02-19T21:54:14.874243+0000","last_clean":"2024-02-19T21:54:14.874243+0000","last_became_active":"2024-02-19T21:53:45.369204+0000","last_became_peered":"2024-02-19T21:53:45.369204+0000","last_unstale":"2024-02-19T21:54:14.874243+0000","last_undegraded":"2024-02-19T21:54:14.874243+0000","last_fullsized":"2024-02-19T21:54:14.874243+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":2124,"ondisk_log_size":2124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":139198464,"num_objects":2124,"num_object_clones":0,"num_object_copies":6372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2124,"num_write_kb":135936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.8","version":"66'1","reported_seq":347,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.665135+0000","last_change":"2024-02-19T21:53:48.374860+0000","last_active":"2024-02-19T21:54:11.665135+0000","last_peered":"2024-02-19T21:54:11.665135+0000","last_clean":"2024-02-19T21:54:11.665135+0000","last_became_active":"2024-02-19T21:53:48.374606+0000","last_became_peered":"2024-02-19T21:53:48.374606+0000","last_unstale":"2024-02-19T21:54:11.665135+0000","last_undegraded":"2024-02-19T21:54:11.665135+0000","last_fullsized":"2024-02-19T21:54:11.665135+0000","mapping_epoch":495,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":496,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:46:43.773486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:46:43.773486+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":133,"reported_epoch":500,"state":"active+clean","last_fresh":"2024-02-19T21:54:10.381391+0000","last_change":"2024-02-19T21:53:58.254466+0000","last_active":"2024-02-19T21:54:10.381391+0000","last_peered":"2024-02-19T21:54:10.381391+0000","last_clean":"2024-02-19T21:54:10.381391+0000","last_became_active":"2024-02-19T21:49:08.324835+0000","last_became_peered":"2024-02-19T21:49:08.324835+0000","last_unstale":"2024-02-19T21:54:10.381391+0000","last_undegraded":"2024-02-19T21:54:10.381391+0000","last_fullsized":"2024-02-19T21:54:10.381391+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:58.254346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_clean_scrub_stamp":"2024-02-19T21:53:58.254346+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":209,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.673761+0000","last_change":"2024-02-19T21:53:51.712781+0000","last_active":"2024-02-19T21:54:11.673761+0000","last_peered":"2024-02-19T21:54:11.673761+0000","last_clean":"2024-02-19T21:54:11.673761+0000","last_became_active":"2024-02-19T21:49:08.327186+0000","last_became_peered":"2024-02-19T21:49:08.327186+0000","last_unstale":"2024-02-19T21:54:11.673761+0000","last_undegraded":"2024-02-19T21:54:11.673761+0000","last_fullsized":"2024-02-19T21:54:11.673761+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:53:51.712694+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:53:51.712694+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"471'60","reported_seq":629,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.675536+0000","last_change":"2024-02-19T21:49:55.281324+0000","last_active":"2024-02-19T21:54:11.675536+0000","last_peered":"2024-02-19T21:54:11.675536+0000","last_clean":"2024-02-19T21:54:11.675536+0000","last_became_active":"2024-02-19T21:49:54.493167+0000","last_became_peered":"2024-02-19T21:49:54.493167+0000","last_unstale":"2024-02-19T21:54:11.675536+0000","last_undegraded":"2024-02-19T21:54:11.675536+0000","last_fullsized":"2024-02-19T21:54:11.675536+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'44","last_scrub_stamp":"2024-02-19T21:48:32.489084+0000","last_deep_scrub":"201'44","last_deep_scrub_stamp":"2024-02-19T21:44:16.255049+0000","last_clean_scrub_stamp":"2024-02-19T21:48:32.489084+0000","log_size":60,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":80,"num_read_kb":69,"num_write":52,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.4","version":"502'2166","reported_seq":2184,"reported_epoch":502,"state":"active+clean","last_fresh":"2024-02-19T21:54:14.815184+0000","last_change":"2024-02-19T21:53:45.370493+0000","last_active":"2024-02-19T21:54:14.815184+0000","last_peered":"2024-02-19T21:54:14.815184+0000","last_clean":"2024-02-19T21:54:14.815184+0000","last_became_active":"2024-02-19T21:53:45.370111+0000","last_became_peered":"2024-02-19T21:53:45.370111+0000","last_unstale":"2024-02-19T21:54:14.815184+0000","last_undegraded":"2024-02-19T21:54:14.815184+0000","last_fullsized":"2024-02-19T21:54:14.815184+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":2166,"ondisk_log_size":2166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":141950976,"num_objects":2166,"num_object_clones":0,"num_object_copies":6498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2166,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2166,"num_write_kb":138624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":534,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.672975+0000","last_change":"2024-02-19T21:54:11.072349+0000","last_active":"2024-02-19T21:54:11.672975+0000","last_peered":"2024-02-19T21:54:11.672975+0000","last_clean":"2024-02-19T21:54:11.672975+0000","last_became_active":"2024-02-19T21:49:08.328287+0000","last_became_peered":"2024-02-19T21:49:08.328287+0000","last_unstale":"2024-02-19T21:54:11.672975+0000","last_undegraded":"2024-02-19T21:54:11.672975+0000","last_fullsized":"2024-02-19T21:54:11.672975+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:11.072274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:11.072274+0000","last_clean_scrub_stamp":"2024-02-19T21:54:11.072274+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":133,"reported_epoch":500,"state":"active+clean","last_fresh":"2024-02-19T21:54:10.381518+0000","last_change":"2024-02-19T21:54:09.300812+0000","last_active":"2024-02-19T21:54:10.381518+0000","last_peered":"2024-02-19T21:54:10.381518+0000","last_clean":"2024-02-19T21:54:10.381518+0000","last_became_active":"2024-02-19T21:49:08.331451+0000","last_became_peered":"2024-02-19T21:49:08.331451+0000","last_unstale":"2024-02-19T21:54:10.381518+0000","last_undegraded":"2024-02-19T21:54:10.381518+0000","last_fullsized":"2024-02-19T21:54:10.381518+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:09.300710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.547129+0000","last_clean_scrub_stamp":"2024-02-19T21:54:09.300710+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":507,"reported_epoch":498,"state":"active+clean","last_fresh":"2024-02-19T21:53:54.185165+0000","last_change":"2024-02-19T21:53:45.384975+0000","last_active":"2024-02-19T21:53:54.185165+0000","last_peered":"2024-02-19T21:53:54.185165+0000","last_clean":"2024-02-19T21:53:54.185165+0000","last_became_active":"2024-02-19T21:53:45.384695+0000","last_became_peered":"2024-02-19T21:53:45.384695+0000","last_unstale":"2024-02-19T21:53:54.185165+0000","last_undegraded":"2024-02-19T21:53:54.185165+0000","last_fullsized":"2024-02-19T21:53:54.185165+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.978015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.978015+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"470'25","reported_seq":516,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:11.673753+0000","last_change":"2024-02-19T21:48:23.326608+0000","last_active":"2024-02-19T21:54:11.673753+0000","last_peered":"2024-02-19T21:54:11.673753+0000","last_clean":"2024-02-19T21:54:11.673753+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:54:11.673753+0000","last_undegraded":"2024-02-19T21:54:11.673753+0000","last_fullsized":"2024-02-19T21:54:11.673753+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"377'19","last_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_deep_scrub":"377'19","last_deep_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.326541+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"500'1572","reported_seq":1588,"reported_epoch":500,"state":"active+clean","last_fresh":"2024-02-19T21:54:10.391465+0000","last_change":"2024-02-19T21:53:45.368033+0000","last_active":"2024-02-19T21:54:10.391465+0000","last_peered":"2024-02-19T21:54:10.391465+0000","last_clean":"2024-02-19T21:54:10.391465+0000","last_became_active":"2024-02-19T21:53:45.367724+0000","last_became_peered":"2024-02-19T21:53:45.367724+0000","last_unstale":"2024-02-19T21:54:10.391465+0000","last_undegraded":"2024-02-19T21:54:10.391465+0000","last_fullsized":"2024-02-19T21:54:10.391465+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":1572,"ondisk_log_size":1572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":103022592,"num_objects":1572,"num_object_clones":0,"num_object_copies":4716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1572,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1572,"num_write_kb":100608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4],"acting":[5,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":497,"reported_epoch":499,"state":"active+clean","last_fresh":"2024-02-19T21:54:09.344634+0000","last_change":"2024-02-19T21:54:09.344599+0000","last_active":"2024-02-19T21:54:09.344634+0000","last_peered":"2024-02-19T21:54:09.344634+0000","last_clean":"2024-02-19T21:54:09.344634+0000","last_became_active":"2024-02-19T21:44:56.160521+0000","last_became_peered":"2024-02-19T21:44:56.160521+0000","last_unstale":"2024-02-19T21:54:09.344634+0000","last_undegraded":"2024-02-19T21:54:09.344634+0000","last_fullsized":"2024-02-19T21:54:09.344634+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:09.344514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:54:09.344514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":137,"reported_epoch":500,"state":"active+clean","last_fresh":"2024-02-19T21:54:10.381896+0000","last_change":"2024-02-19T21:49:54.485377+0000","last_active":"2024-02-19T21:54:10.381896+0000","last_peered":"2024-02-19T21:54:10.381896+0000","last_clean":"2024-02-19T21:54:10.381896+0000","last_became_active":"2024-02-19T21:49:54.485078+0000","last_became_peered":"2024-02-19T21:49:54.485078+0000","last_unstale":"2024-02-19T21:54:10.381896+0000","last_undegraded":"2024-02-19T21:54:10.381896+0000","last_fullsized":"2024-02-19T21:54:10.381896+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:52.107416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:46:52.107416+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"470'39","reported_seq":587,"reported_epoch":499,"state":"active+clean","last_fresh":"2024-02-19T21:54:06.616135+0000","last_change":"2024-02-19T21:49:55.109780+0000","last_active":"2024-02-19T21:54:06.616135+0000","last_peered":"2024-02-19T21:54:06.616135+0000","last_clean":"2024-02-19T21:54:06.616135+0000","last_became_active":"2024-02-19T21:49:54.486014+0000","last_became_peered":"2024-02-19T21:49:54.486014+0000","last_unstale":"2024-02-19T21:54:06.616135+0000","last_undegraded":"2024-02-19T21:54:06.616135+0000","last_fullsized":"2024-02-19T21:54:06.616135+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'27","last_scrub_stamp":"2024-02-19T21:48:24.665813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:24.665813+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"324'11","reported_seq":770,"reported_epoch":501,"state":"active+clean","last_fresh":"2024-02-19T21:54:12.129338+0000","last_change":"2024-02-19T21:48:26.293036+0000","last_active":"2024-02-19T21:54:12.129338+0000","last_peered":"2024-02-19T21:54:12.129338+0000","last_clean":"2024-02-19T21:54:12.129338+0000","last_became_active":"2024-02-19T21:44:34.385140+0000","last_became_peered":"2024-02-19T21:44:34.385140+0000","last_unstale":"2024-02-19T21:54:12.129338+0000","last_undegraded":"2024-02-19T21:54:12.129338+0000","last_fullsized":"2024-02-19T21:54:12.129338+0000","mapping_epoch":62,"log_start":"66'8","ondisk_log_start":"66'8","created":62,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'11","last_scrub_stamp":"2024-02-19T21:48:26.292909+0000","last_deep_scrub":"324'11","last_deep_scrub_stamp":"2024-02-19T21:46:05.210095+0000","last_clean_scrub_stamp":"2024-02-19T21:48:26.292909+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":16,"stat_sum":{"num_bytes":2082078720,"num_objects":31770,"num_object_clones":0,"num_object_copies":95310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31770,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31770,"num_write_kb":2033280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6106447872,"data_stored":6106447872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31770,"ondisk_log_size":31770,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1286,"num_read_kb":1281,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1535,"num_read_kb":1292,"num_write":989,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":311,"num_bytes_recovered":5722,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1062,"ondisk_log_size":1062,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":22,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":66,"acting":66,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":388,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201545,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1565624,"kb_used_data":980016,"kb_used_omap":0,"kb_used_meta":585600,"kb_avail":92179528,"statfs":{"total":95995035648,"available":94391836672,"internally_reserved":0,"allocated":1003536384,"data_stored":1002008628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":599654400},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:53:55 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.04,"15min":1.845},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.189},"max":{"1min":6.2569999999999997,"5min":11.653,"15min":70.477999999999994},"last":0.41799999999999998},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.302,"15min":1.9570000000000001},"min":{"1min":0.26500000000000001,"5min":0.23100000000000001,"15min":0.20999999999999999},"max":{"1min":4.7190000000000003,"5min":12.242000000000001,"15min":68.052000000000007},"last":3.5390000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:53:55 2024","interfaces":[{"interface":"back","average":{"1min":1.595,"5min":1.101,"15min":1.9350000000000001},"min":{"1min":0.29199999999999998,"5min":0.247,"15min":0.23799999999999999},"max":{"1min":6.5410000000000004,"5min":9.9440000000000008,"15min":68.168000000000006},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.871,"5min":1.282,"15min":2.0499999999999998},"min":{"1min":0.313,"5min":0.26300000000000001,"15min":0.223},"max":{"1min":2.9089999999999998,"5min":12.199,"15min":68.444000000000003},"last":2.0139999999999998}]},{"osd":2,"last update":"Mon Feb 19 21:53:17 2024","interfaces":[{"interface":"back","average":{"1min":2.1379999999999999,"5min":1.599,"15min":2.133},"min":{"1min":0.42299999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":9.9830000000000005,"5min":12.304,"15min":12.304},"last":1.9870000000000001},{"interface":"front","average":{"1min":2.6099999999999999,"5min":1.615,"15min":1.9139999999999999},"min":{"1min":0.32900000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":7.2750000000000004,"5min":11.69,"15min":11.69},"last":0.39300000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:53:55 2024","interfaces":[{"interface":"back","average":{"1min":1.552,"5min":1.538,"15min":1.986},"min":{"1min":0.36899999999999999,"5min":0.315,"15min":0.25900000000000001},"max":{"1min":6.4880000000000004,"5min":11.778,"15min":15.438000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.401,"5min":1.3049999999999999,"15min":1.6830000000000001},"min":{"1min":0.32300000000000001,"5min":0.312,"15min":0.29299999999999998},"max":{"1min":6.5780000000000003,"5min":13.196,"15min":13.473000000000001},"last":0.58699999999999997}]},{"osd":4,"last update":"Mon Feb 19 21:53:55 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":1.5249999999999999,"15min":1.6870000000000001},"min":{"1min":0.28799999999999998,"5min":0.27400000000000002,"15min":0.216},"max":{"1min":4.2640000000000002,"5min":17.716999999999999,"15min":17.716999999999999},"last":2.5259999999999998},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.865,"15min":2.0859999999999999},"min":{"1min":0.26700000000000002,"5min":0.26500000000000001,"15min":0.253},"max":{"1min":6.9379999999999997,"5min":15.961,"15min":17.690999999999999},"last":0.34000000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:53:55 2024","interfaces":[{"interface":"back","average":{"1min":1.6140000000000001,"5min":1.4339999999999999,"15min":1.752},"min":{"1min":0.29299999999999998,"5min":0.26300000000000001,"15min":0.24199999999999999},"max":{"1min":6.6040000000000001,"5min":12.210000000000001,"15min":29.021000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.879,"5min":1.6759999999999999,"15min":2.0790000000000002},"min":{"1min":0.34000000000000002,"5min":0.33800000000000002,"15min":0.28699999999999998},"max":{"1min":2.9430000000000001,"5min":17.670999999999999,"15min":29.091999999999999},"last":1.9470000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:53:55 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.7430000000000001,"15min":1.873},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.24299999999999999},"max":{"1min":8.0739999999999998,"5min":15.426,"15min":19.286000000000001},"last":2.04},{"interface":"front","average":{"1min":1.373,"5min":1.621,"15min":2.032},"min":{"1min":0.33000000000000002,"5min":0.314,"15min":0.26700000000000002},"max":{"1min":7.0049999999999999,"5min":11.722,"15min":18.364000000000001},"last":0.79600000000000004}]}]},{"osd":6,"up_from":47,"seq":201863463184,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2130356,"kb_used_data":1241324,"kb_used_omap":0,"kb_used_meta":889024,"kb_avail":91614796,"statfs":{"total":95995035648,"available":93813551104,"internally_reserved":0,"allocated":1271115776,"data_stored":1269591406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":910360576},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:53:34 2024","interfaces":[{"interface":"back","average":{"1min":1.7769999999999999,"5min":1.0169999999999999,"15min":1.5740000000000001},"min":{"1min":0.246,"5min":0.23400000000000001,"15min":0.20100000000000001},"max":{"1min":9.8659999999999997,"5min":9.8659999999999997,"15min":45.197000000000003},"last":1.024},{"interface":"front","average":{"1min":2.5960000000000001,"5min":1.4690000000000001,"15min":1.9470000000000001},"min":{"1min":0.27000000000000002,"5min":0.252,"15min":0.23499999999999999},"max":{"1min":10.038,"5min":10.038,"15min":44.753},"last":2.7679999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:53:34 2024","interfaces":[{"interface":"back","average":{"1min":1.984,"5min":1.0600000000000001,"15min":1.6279999999999999},"min":{"1min":0.246,"5min":0.24299999999999999,"15min":0.20799999999999999},"max":{"1min":9.8010000000000002,"5min":9.8010000000000002,"15min":45.231999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":2.6859999999999999,"5min":1.444,"15min":1.726},"min":{"1min":0.26900000000000002,"5min":0.26400000000000001,"15min":0.23100000000000001},"max":{"1min":15.215999999999999,"5min":15.215999999999999,"15min":45.097999999999999},"last":0.55200000000000005}]},{"osd":2,"last update":"Mon Feb 19 21:54:14 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":1.335,"15min":1.492},"min":{"1min":0.314,"5min":0.255,"15min":0.255},"max":{"1min":3.129,"5min":9.9369999999999994,"15min":9.9369999999999994},"last":2.8610000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.98399999999999999,"15min":1.1739999999999999},"min":{"1min":0.30499999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.1160000000000001,"5min":9.7829999999999995,"15min":9.7829999999999995},"last":1.1160000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:53:34 2024","interfaces":[{"interface":"back","average":{"1min":2.1230000000000002,"5min":1.179,"15min":1.498},"min":{"1min":0.36799999999999999,"5min":0.34000000000000002,"15min":0.25900000000000001},"max":{"1min":9.8460000000000001,"5min":9.8460000000000001,"15min":11.15},"last":1.0860000000000001},{"interface":"front","average":{"1min":2.7080000000000002,"5min":1.651,"15min":1.595},"min":{"1min":0.33000000000000002,"5min":0.30599999999999999,"15min":0.26400000000000001},"max":{"1min":15.175000000000001,"5min":15.175000000000001,"15min":15.175000000000001},"last":0.66900000000000004}]},{"osd":4,"last update":"Mon Feb 19 21:53:34 2024","interfaces":[{"interface":"back","average":{"1min":2.2269999999999999,"5min":1.8,"15min":1.9219999999999999},"min":{"1min":0.23999999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":8.8439999999999994,"5min":18.010000000000002,"15min":18.010000000000002},"last":2.8330000000000002},{"interface":"front","average":{"1min":2.8410000000000002,"5min":1.5600000000000001,"15min":1.901},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":9.8360000000000003,"5min":11.566000000000001,"15min":16.594999999999999},"last":1.415}]},{"osd":5,"last update":"Mon Feb 19 21:53:34 2024","interfaces":[{"interface":"back","average":{"1min":9.6319999999999997,"5min":3.2400000000000002,"15min":2.472},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":148.589,"5min":148.589,"15min":148.589},"last":2.8050000000000002},{"interface":"front","average":{"1min":8.8480000000000008,"5min":2.7719999999999998,"15min":2.512},"min":{"1min":0.29599999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":148.453,"5min":148.453,"15min":148.453},"last":1.048}]},{"osd":7,"last update":"Mon Feb 19 21:53:59 2024","interfaces":[{"interface":"back","average":{"1min":2.2570000000000001,"5min":1.675,"15min":2.0419999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.27200000000000002},"max":{"1min":9.7949999999999999,"5min":9.8170000000000002,"15min":14.721},"last":1.23},{"interface":"front","average":{"1min":2.3239999999999998,"5min":1.722,"15min":2.0840000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":9.8179999999999996,"5min":9.8309999999999995,"15min":14.744999999999999},"last":1.25}]}]},{"osd":1,"up_from":13,"seq":55834575145,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1799464,"kb_used_data":894752,"kb_used_omap":0,"kb_used_meta":904704,"kb_avail":91945688,"statfs":{"total":95995035648,"available":94152384512,"internally_reserved":0,"allocated":916226048,"data_stored":914690387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":926416896},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,4,3,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:53:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.627,"15min":1.204},"min":{"1min":0.19,"5min":0.16300000000000001,"15min":0.161},"max":{"1min":3.9649999999999999,"5min":5.7889999999999997,"15min":42.776000000000003},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.82199999999999995,"15min":1.347},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.16400000000000001},"max":{"1min":3.0880000000000001,"5min":5.7119999999999997,"15min":44.845999999999997},"last":0.42499999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:53:13 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.68600000000000005,"15min":0.94999999999999996},"min":{"1min":0.20499999999999999,"5min":0.189,"15min":0.189},"max":{"1min":1.093,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.79600000000000004,"15min":0.93999999999999995},"min":{"1min":0.20699999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":4.0179999999999998,"5min":4.452,"15min":4.452},"last":1.887}]},{"osd":3,"last update":"Mon Feb 19 21:53:22 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":0.77000000000000002,"15min":1.3069999999999999},"min":{"1min":0.26200000000000001,"5min":0.22800000000000001,"15min":0.20999999999999999},"max":{"1min":7.8250000000000002,"5min":7.8250000000000002,"15min":41.607999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":1.1220000000000001,"5min":0.70199999999999996,"15min":1.3120000000000001},"min":{"1min":0.26000000000000001,"5min":0.215,"15min":0.215},"max":{"1min":4.1130000000000004,"5min":4.1130000000000004,"15min":42.811999999999998},"last":0.441}]},{"osd":4,"last update":"Mon Feb 19 21:53:39 2024","interfaces":[{"interface":"back","average":{"1min":1.891,"5min":1.202,"15min":1.5600000000000001},"min":{"1min":0.40300000000000002,"5min":0.30099999999999999,"15min":0.251},"max":{"1min":5.7229999999999999,"5min":9.8759999999999994,"15min":15.853},"last":0.40200000000000002},{"interface":"front","average":{"1min":1.9570000000000001,"5min":1.1359999999999999,"15min":1.4790000000000001},"min":{"1min":0.378,"5min":0.28000000000000003,"15min":0.26500000000000001},"max":{"1min":5.7350000000000003,"5min":6.9800000000000004,"15min":15.861000000000001},"last":1.8260000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:53:07 2024","interfaces":[{"interface":"back","average":{"1min":1.665,"5min":0.95999999999999996,"15min":1.544},"min":{"1min":0.45000000000000001,"5min":0.29599999999999999,"15min":0.27900000000000003},"max":{"1min":3.891,"5min":4.0720000000000001,"15min":14.331},"last":1.865},{"interface":"front","average":{"1min":2.0129999999999999,"5min":1.0569999999999999,"15min":1.5700000000000001},"min":{"1min":0.33300000000000002,"5min":0.307,"15min":0.30099999999999999},"max":{"1min":10.148999999999999,"5min":10.148999999999999,"15min":14.496},"last":0.71799999999999997}]},{"osd":6,"last update":"Mon Feb 19 21:53:39 2024","interfaces":[{"interface":"back","average":{"1min":1.931,"5min":1.0740000000000001,"15min":1.6240000000000001},"min":{"1min":0.441,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":6.5579999999999998,"5min":8.8309999999999995,"15min":11.638999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":1.625,"5min":1.125,"15min":1.706},"min":{"1min":0.40799999999999997,"5min":0.34699999999999998,"15min":0.29699999999999999},"max":{"1min":7.7869999999999999,"5min":7.7869999999999999,"15min":12.199},"last":0.68200000000000005}]},{"osd":7,"last update":"Mon Feb 19 21:54:04 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.159,"15min":1.6459999999999999},"min":{"1min":0.40899999999999997,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":5.609,"5min":7.702,"15min":13.904},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.0960000000000001,"15min":1.623},"min":{"1min":0.42899999999999999,"5min":0.38900000000000001,"15min":0.32600000000000001},"max":{"1min":2.9590000000000001,"5min":7.6909999999999998,"15min":13.894},"last":0.46600000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738672,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1695604,"kb_used_data":797100,"kb_used_omap":0,"kb_used_meta":898496,"kb_avail":92049548,"statfs":{"total":95995035648,"available":94258737152,"internally_reserved":0,"allocated":816230400,"data_stored":814706079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":920059904},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:53:15 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.54100000000000004,"15min":0.90900000000000003},"min":{"1min":0.20899999999999999,"5min":0.189,"15min":0.153},"max":{"1min":3.226,"5min":3.4889999999999999,"15min":16.478000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":1.54,"5min":0.72599999999999998,"15min":1.083},"min":{"1min":0.20799999999999999,"5min":0.20100000000000001,"15min":0.17799999999999999},"max":{"1min":7.1669999999999998,"5min":7.1669999999999998,"15min":13.422000000000001},"last":0.52700000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":0.69799999999999995,"15min":0.67400000000000004},"min":{"1min":0.224,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":3.8439999999999999,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":0.26500000000000001},{"interface":"front","average":{"1min":1.3049999999999999,"5min":0.88800000000000001,"15min":1.0840000000000001},"min":{"1min":0.25600000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":5.9370000000000003,"5min":8.9960000000000004,"15min":8.9960000000000004},"last":0.27700000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:54:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.72999999999999998,"15min":1.0740000000000001},"min":{"1min":0.29199999999999998,"5min":0.255,"15min":0.21299999999999999},"max":{"1min":1.829,"5min":5.3570000000000002,"15min":13.292999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.77600000000000002,"15min":0.97199999999999998},"min":{"1min":0.318,"5min":0.26300000000000001,"15min":0.23400000000000001},"max":{"1min":5.968,"5min":5.968,"15min":8.4169999999999998},"last":0.33800000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:53:48 2024","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.208,"15min":1.5860000000000001},"min":{"1min":0.32500000000000001,"5min":0.29399999999999998,"15min":0.252},"max":{"1min":7.298,"5min":7.766,"15min":13.278},"last":0.438},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.1719999999999999,"15min":1.4650000000000001},"min":{"1min":0.38200000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":7.3079999999999998,"5min":9.0530000000000008,"15min":10.109},"last":0.39900000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:54:01 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":1.1220000000000001,"15min":1.7210000000000001},"min":{"1min":0.41499999999999998,"5min":0.317,"15min":0.27600000000000002},"max":{"1min":2.2970000000000002,"5min":8.1199999999999992,"15min":25.442},"last":0.45000000000000001},{"interface":"front","average":{"1min":1.083,"5min":1.3109999999999999,"15min":1.8220000000000001},"min":{"1min":0.35399999999999998,"5min":0.33200000000000002,"15min":0.27300000000000002},"max":{"1min":6.5839999999999996,"5min":8.5530000000000008,"15min":25.411999999999999},"last":0.317}]},{"osd":6,"last update":"Mon Feb 19 21:53:18 2024","interfaces":[{"interface":"back","average":{"1min":2.335,"5min":1.405,"15min":1.528},"min":{"1min":0.46300000000000002,"5min":0.33300000000000002,"15min":0.27000000000000002},"max":{"1min":12.364000000000001,"5min":12.364000000000001,"15min":12.364000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":2.77,"5min":1.333,"15min":1.8560000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.29599999999999999},"max":{"1min":11.269,"5min":11.269,"15min":13.289999999999999},"last":0.502}]},{"osd":7,"last update":"Mon Feb 19 21:53:56 2024","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.2010000000000001,"15min":1.5920000000000001},"min":{"1min":0.41499999999999998,"5min":0.36499999999999999,"15min":0.33700000000000002},"max":{"1min":5.8070000000000004,"5min":9.6460000000000008,"15min":15.688000000000001},"last":0.62},{"interface":"front","average":{"1min":1.321,"5min":1.2549999999999999,"15min":1.516},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.36399999999999999},"max":{"1min":5.8159999999999998,"5min":9.6389999999999993,"15min":10.470000000000001},"last":0.51600000000000001}]}]},{"osd":2,"up_from":394,"seq":1692217114685,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1117764,"kb_used_data":797820,"kb_used_omap":0,"kb_used_meta":319935,"kb_avail":92627388,"statfs":{"total":95995035648,"available":94850445312,"internally_reserved":0,"allocated":816967680,"data_stored":815475575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":327613492},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,5],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:53:13 2024","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":0.96099999999999997,"15min":1.0980000000000001},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":9.2629999999999999,"5min":9.2629999999999999,"15min":9.2629999999999999},"last":0.31},{"interface":"front","average":{"1min":1.034,"5min":0.83499999999999996,"15min":1.093},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":5.6440000000000001,"5min":6.149,"15min":6.149},"last":0.94999999999999996}]},{"osd":1,"last update":"Mon Feb 19 21:53:13 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.59599999999999997,"15min":0.61299999999999999},"min":{"1min":0.20000000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":4.3650000000000002,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":2.323},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.76000000000000001,"15min":0.89800000000000002},"min":{"1min":0.23400000000000001,"5min":0.224,"15min":0.224},"max":{"1min":4.2930000000000001,"5min":6.992,"15min":6.992},"last":1.5049999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:53:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0269999999999999,"15min":1.3089999999999999},"min":{"1min":0.28599999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":2.6819999999999999,"5min":6.9470000000000001,"15min":6.9470000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":1.181,"5min":0.94199999999999995,"15min":1.1759999999999999},"min":{"1min":0.27600000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":7.6669999999999998,"5min":7.6669999999999998,"15min":7.6669999999999998},"last":0.39800000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:53:13 2024","interfaces":[{"interface":"back","average":{"1min":1.841,"5min":1.476,"15min":1.9299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":8.843,"5min":8.843,"15min":8.843},"last":2.4249999999999998},{"interface":"front","average":{"1min":2.6240000000000001,"5min":1.573,"15min":1.829},"min":{"1min":0.30299999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":9.3300000000000001,"5min":9.3300000000000001,"15min":9.3300000000000001},"last":0.38800000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:53:13 2024","interfaces":[{"interface":"back","average":{"1min":2.8769999999999998,"5min":1.6970000000000001,"15min":1.758},"min":{"1min":0.42299999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":11.129,"5min":11.129,"15min":11.129},"last":0.37},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.2490000000000001,"15min":1.6299999999999999},"min":{"1min":0.32200000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":4.9790000000000001,"5min":13.558,"15min":13.558},"last":0.439}]},{"osd":6,"last update":"Mon Feb 19 21:53:13 2024","interfaces":[{"interface":"back","average":{"1min":3.266,"5min":1.611,"15min":1.7050000000000001},"min":{"1min":0.42099999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":9.6720000000000006,"5min":9.6720000000000006,"15min":9.6720000000000006},"last":0.92700000000000005},{"interface":"front","average":{"1min":2.5470000000000002,"5min":1.1839999999999999,"15min":1.089},"min":{"1min":0.38100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":8.3629999999999995,"5min":8.3629999999999995,"15min":8.3629999999999995},"last":2.355}]},{"osd":7,"last update":"Mon Feb 19 21:53:13 2024","interfaces":[{"interface":"back","average":{"1min":2.169,"5min":1.3200000000000001,"15min":1.409},"min":{"1min":0.36499999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":6.5949999999999998,"5min":6.5949999999999998,"15min":6.5949999999999998},"last":0.89700000000000002},{"interface":"front","average":{"1min":2.7370000000000001,"5min":1.105,"15min":0.93100000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":8.7780000000000005,"5min":8.7780000000000005,"15min":8.7780000000000005},"last":2.448}]}]},{"osd":3,"up_from":26,"seq":111669149984,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":438976,"kb_used_data":137656,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93306176,"statfs":{"total":95995035648,"available":95545524224,"internally_reserved":0,"allocated":140959744,"data_stored":139486703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:54:14 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64200000000000002,"15min":0.94299999999999995},"min":{"1min":0.216,"5min":0.193,"15min":0.17399999999999999},"max":{"1min":5.1310000000000002,"5min":5.1310000000000002,"15min":8.8529999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.78400000000000003,"15min":1.141},"min":{"1min":0.27700000000000002,"5min":0.23899999999999999,"15min":0.187},"max":{"1min":4.782,"5min":11.317,"15min":11.948},"last":2.5579999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:54:14 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56599999999999995,"15min":1.0589999999999999},"min":{"1min":0.26000000000000001,"5min":0.219,"15min":0.18099999999999999},"max":{"1min":4.4740000000000002,"5min":4.8600000000000003,"15min":66.677999999999997},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":1.091},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":3.4889999999999999,"5min":4.282,"15min":62.631},"last":0.186}]},{"osd":2,"last update":"Mon Feb 19 21:54:14 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.93999999999999995,"15min":0.84299999999999997},"min":{"1min":0.33700000000000002,"5min":0.216,"15min":0.216},"max":{"1min":1.831,"5min":32.323999999999998,"15min":32.323999999999998},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":1.133,"15min":1.4450000000000001},"min":{"1min":0.23300000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":2.5840000000000001,"5min":32.103999999999999,"15min":32.103999999999999},"last":2.5840000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.78100000000000003,"15min":1.226},"min":{"1min":0.33800000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":5.0049999999999999,"5min":5.1219999999999999,"15min":10.609999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.92100000000000004,"15min":1.361},"min":{"1min":0.34799999999999998,"5min":0.315,"15min":0.26700000000000002},"max":{"1min":3.0169999999999999,"5min":5.7930000000000001,"15min":9.6720000000000006},"last":0.40200000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:53:57 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.73999999999999999,"15min":1.4119999999999999},"min":{"1min":0.35399999999999998,"5min":0.29899999999999999,"15min":0.29099999999999998},"max":{"1min":5.46,"5min":5.46,"15min":12.257},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.92800000000000005,"15min":1.4830000000000001},"min":{"1min":0.33000000000000002,"5min":0.31,"15min":0.30299999999999999},"max":{"1min":4.6020000000000003,"5min":8.5440000000000005,"15min":12.635},"last":0.379}]},{"osd":6,"last update":"Mon Feb 19 21:53:25 2024","interfaces":[{"interface":"back","average":{"1min":2.8780000000000001,"5min":1.264,"15min":1.5209999999999999},"min":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.309},"max":{"1min":22.759,"5min":22.759,"15min":22.759},"last":0.78100000000000003},{"interface":"front","average":{"1min":2.5990000000000002,"5min":1.204,"15min":1.5700000000000001},"min":{"1min":0.41799999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":22.608000000000001,"5min":22.608000000000001,"15min":22.608000000000001},"last":0.42699999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:53:48 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1759999999999999,"15min":1.617},"min":{"1min":0.379,"5min":0.34399999999999997,"15min":0.28599999999999998},"max":{"1min":4.4139999999999997,"5min":9.3789999999999996,"15min":12.003},"last":2.371},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.88300000000000001,"15min":1.349},"min":{"1min":0.45900000000000002,"5min":0.36799999999999999,"15min":0.34599999999999997},"max":{"1min":4.6900000000000004,"5min":5.3339999999999996,"15min":9.3399999999999999},"last":0.75800000000000001}]}]},{"osd":4,"up_from":32,"seq":137438953752,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1259524,"kb_used_data":669820,"kb_used_omap":0,"kb_used_meta":589696,"kb_avail":92485628,"statfs":{"total":95995035648,"available":94705283072,"internally_reserved":0,"allocated":685895680,"data_stored":684394946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":603848704},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:53:34 2024","interfaces":[{"interface":"back","average":{"1min":1.7729999999999999,"5min":1.3260000000000001,"15min":1.929},"min":{"1min":0.309,"5min":0.219,"15min":0.219},"max":{"1min":10.173,"5min":10.173,"15min":53.936},"last":0.52100000000000002},{"interface":"front","average":{"1min":1.153,"5min":1.1539999999999999,"15min":1.95},"min":{"1min":0.27700000000000002,"5min":0.252,"15min":0.22600000000000001},"max":{"1min":4.4610000000000003,"5min":10.140000000000001,"15min":54.405999999999999},"last":0.68799999999999994}]},{"osd":1,"last update":"Mon Feb 19 21:53:34 2024","interfaces":[{"interface":"back","average":{"1min":2.1659999999999999,"5min":1.478,"15min":1.8819999999999999},"min":{"1min":0.36099999999999999,"5min":0.253,"15min":0.21199999999999999},"max":{"1min":10.134,"5min":12.439,"15min":54.731000000000002},"last":1.617},{"interface":"front","average":{"1min":1.3,"5min":1.2130000000000001,"15min":1.6559999999999999},"min":{"1min":0.30199999999999999,"5min":0.252,"15min":0.25},"max":{"1min":10.324999999999999,"5min":10.324999999999999,"15min":52.490000000000002},"last":0.54000000000000004}]},{"osd":2,"last update":"Mon Feb 19 21:53:12 2024","interfaces":[{"interface":"back","average":{"1min":3.8029999999999999,"5min":1.79,"15min":1.9810000000000001},"min":{"1min":0.34000000000000002,"5min":0.255,"15min":0.255},"max":{"1min":12.516999999999999,"5min":12.516999999999999,"15min":12.516999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":3.8610000000000002,"5min":1.833,"15min":2.0190000000000001},"min":{"1min":0.377,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":12.541,"5min":12.541,"15min":12.541},"last":0.76300000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:53:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.3400000000000001,"15min":1.579},"min":{"1min":0.33300000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":4.0439999999999996,"5min":9.9529999999999994,"15min":10.970000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":1.706,"5min":1.454,"15min":1.726},"min":{"1min":0.39900000000000002,"5min":0.30099999999999999,"15min":0.26900000000000002},"max":{"1min":10.226000000000001,"5min":12.486000000000001,"15min":13.321},"last":0.46999999999999997}]},{"osd":5,"last update":"Mon Feb 19 21:53:29 2024","interfaces":[{"interface":"back","average":{"1min":2.734,"5min":1.6779999999999999,"15min":2.0070000000000001},"min":{"1min":0.26900000000000002,"5min":0.23799999999999999,"15min":0.23400000000000001},"max":{"1min":10.445,"5min":13.805999999999999,"15min":18.916},"last":0.50900000000000001},{"interface":"front","average":{"1min":2.0819999999999999,"5min":1.5569999999999999,"15min":2.1419999999999999},"min":{"1min":0.33300000000000002,"5min":0.28299999999999997,"15min":0.253},"max":{"1min":12.644,"5min":14.532999999999999,"15min":14.840999999999999},"last":0.54900000000000004}]},{"osd":6,"last update":"Mon Feb 19 21:53:34 2024","interfaces":[{"interface":"back","average":{"1min":1.7749999999999999,"5min":1.7210000000000001,"15min":1.8360000000000001},"min":{"1min":0.375,"5min":0.28999999999999998,"15min":0.28599999999999998},"max":{"1min":6.6580000000000004,"5min":10.233000000000001,"15min":13.27},"last":0.48799999999999999},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.7330000000000001,"15min":2.0209999999999999},"min":{"1min":0.27800000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":5.2050000000000001,"5min":13.715,"15min":18.670000000000002},"last":0.56799999999999995}]},{"osd":7,"last update":"Mon Feb 19 21:54:06 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.7090000000000001,"15min":1.9730000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":5.1699999999999999,"5min":13.765000000000001,"15min":16.763999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":1.621,"15min":1.847},"min":{"1min":0.376,"5min":0.36299999999999999,"15min":0.31},"max":{"1min":3.6899999999999999,"5min":12.958,"15min":12.958},"last":0.58499999999999996}]}]},{"osd":5,"up_from":38,"seq":163208757524,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1448952,"kb_used_data":558512,"kb_used_omap":0,"kb_used_meta":890432,"kb_avail":92296200,"statfs":{"total":95995035648,"available":94511308800,"internally_reserved":0,"allocated":571916288,"data_stored":570427855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":911802368},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:53:14 2024","interfaces":[{"interface":"back","average":{"1min":3.0390000000000001,"5min":1.2330000000000001,"15min":1.6890000000000001},"min":{"1min":0.23599999999999999,"5min":0.23100000000000001,"15min":0.20599999999999999},"max":{"1min":10.534000000000001,"5min":10.534000000000001,"15min":19.236000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":2.3769999999999998,"5min":1.1619999999999999,"15min":1.835},"min":{"1min":0.24299999999999999,"5min":0.23699999999999999,"15min":0.20899999999999999},"max":{"1min":6.5449999999999999,"5min":6.5449999999999999,"15min":13.241},"last":0.49399999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:53:14 2024","interfaces":[{"interface":"back","average":{"1min":2.4089999999999998,"5min":1.145,"15min":1.734},"min":{"1min":0.27300000000000002,"5min":0.246,"15min":0.23100000000000001},"max":{"1min":6.625,"5min":6.625,"15min":10.42},"last":0.251},{"interface":"front","average":{"1min":2.7709999999999999,"5min":1.113,"15min":1.5649999999999999},"min":{"1min":0.249,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":11.654,"5min":11.654,"15min":11.654},"last":0.41199999999999998}]},{"osd":2,"last update":"Mon Feb 19 21:53:14 2024","interfaces":[{"interface":"back","average":{"1min":4.6879999999999997,"5min":1.7889999999999999,"15min":1.5269999999999999},"min":{"1min":0.29999999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":39.055,"5min":39.055,"15min":39.055},"last":0.32300000000000001},{"interface":"front","average":{"1min":4.1959999999999997,"5min":1.671,"15min":1.4319999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":39.012999999999998,"5min":39.012999999999998,"15min":39.012999999999998},"last":1.2729999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:53:14 2024","interfaces":[{"interface":"back","average":{"1min":3.1110000000000002,"5min":1.4350000000000001,"15min":1.948},"min":{"1min":0.379,"5min":0.30199999999999999,"15min":0.24099999999999999},"max":{"1min":10.561,"5min":13.182,"15min":19.321000000000002},"last":0.34899999999999998},{"interface":"front","average":{"1min":2.6789999999999998,"5min":1.298,"15min":1.9710000000000001},"min":{"1min":0.44400000000000001,"5min":0.33600000000000002,"15min":0.29499999999999998},"max":{"1min":6.577,"5min":6.577,"15min":9.5150000000000006},"last":0.51400000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:53:14 2024","interfaces":[{"interface":"back","average":{"1min":3.4300000000000002,"5min":1.335,"15min":1.5780000000000001},"min":{"1min":0.28599999999999998,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":12.228,"5min":12.228,"15min":21.577000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":3.4249999999999998,"5min":1.522,"15min":2.044},"min":{"1min":0.29599999999999999,"5min":0.26100000000000001,"15min":0.25600000000000001},"max":{"1min":10.586,"5min":10.586,"15min":19.274000000000001},"last":1.2869999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:53:38 2024","interfaces":[{"interface":"back","average":{"1min":3.4590000000000001,"5min":1.9079999999999999,"15min":2.1659999999999999},"min":{"1min":0.34999999999999998,"5min":0.26100000000000001,"15min":0.221},"max":{"1min":9.952,"5min":10.611000000000001,"15min":19.884},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.6910000000000001,"5min":1.4610000000000001,"15min":1.9890000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.26700000000000002},"max":{"1min":5.8760000000000003,"5min":10.260999999999999,"15min":13.532999999999999},"last":0.52900000000000003}]},{"osd":7,"last update":"Mon Feb 19 21:54:00 2024","interfaces":[{"interface":"back","average":{"1min":1.7110000000000001,"5min":1.552,"15min":2.2109999999999999},"min":{"1min":0.34000000000000002,"5min":0.33500000000000002,"15min":0.27100000000000002},"max":{"1min":8.5950000000000006,"5min":9.6300000000000008,"15min":12.962},"last":0.54500000000000004},{"interface":"front","average":{"1min":1.772,"5min":1.671,"15min":2.044},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.221},"max":{"1min":11.617000000000001,"5min":11.617000000000001,"15min":17.759},"last":0.61399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":1722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":850722816,"data_stored":850722816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":967245824,"data_stored":967245824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":866910208,"data_stored":866910208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":142934016,"data_stored":142934016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":531038208,"data_stored":531038208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":428998656,"data_stored":428998656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1309343744,"data_stored":1309343744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1009254400,"data_stored":1009254400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:54:21.010 INFO:tasks.thrashosds.thrasher:Setting 2.10 to [5, 3, 6, 7, 1, 4] 2024-02-19T21:54:21.010 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '2.10', '5', '3', '6', '7', '1', '4'] 2024-02-19T21:54:21.010 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pg-upmap-items 2.10 5 3 6 7 1 4 2024-02-19T21:54:21.082 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:54:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:54:20] "GET /metrics HTTP/1.1" 200 176757 "" "Prometheus/2.33.4" 2024-02-19T21:54:21.083 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:19.243464+0000 mgr.y (mgr.14514) 832 : cluster [DBG] pgmap v1078: 138 pgs: 138 active+clean; 2.2 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 639 B/s rd, 83 MiB/s wr, 1.32k op/s 2024-02-19T21:54:21.083 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:20.343296+0000 osd.5 (osd.5) 289 : cluster [DBG] 2.18 scrub starts 2024-02-19T21:54:21.083 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:20.347678+0000 osd.5 (osd.5) 290 : cluster [DBG] 2.18 scrub ok 2024-02-19T21:54:21.083 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:19.243464+0000 mgr.y (mgr.14514) 832 : cluster [DBG] pgmap v1078: 138 pgs: 138 active+clean; 2.2 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 639 B/s rd, 83 MiB/s wr, 1.32k op/s 2024-02-19T21:54:21.083 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:20.343296+0000 osd.5 (osd.5) 289 : cluster [DBG] 2.18 scrub starts 2024-02-19T21:54:21.083 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:20.347678+0000 osd.5 (osd.5) 290 : cluster [DBG] 2.18 scrub ok 2024-02-19T21:54:21.087 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:54:21.105 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 21 16 45209 45193 134.449 102 0.0133414 0.00743228 2024-02-19T21:54:21.137 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:21.306 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:54:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:54:21.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:19.243464+0000 mgr.y (mgr.14514) 832 : cluster [DBG] pgmap v1078: 138 pgs: 138 active+clean; 2.2 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 639 B/s rd, 83 MiB/s wr, 1.32k op/s 2024-02-19T21:54:21.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:20.343296+0000 osd.5 (osd.5) 289 : cluster [DBG] 2.18 scrub starts 2024-02-19T21:54:21.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:20.347678+0000 osd.5 (osd.5) 290 : cluster [DBG] 2.18 scrub ok 2024-02-19T21:54:22.106 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 22 16 46790 46774 132.83 98.8125 0.00811492 0.00752357 2024-02-19T21:54:23.106 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 23 16 48257 48241 131.041 91.6875 0.00634904 0.00762737 2024-02-19T21:54:23.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:21.210583+0000 mgr.y (mgr.14514) 833 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:54:23.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:21.246769+0000 mgr.y (mgr.14514) 834 : cluster [DBG] pgmap v1079: 138 pgs: 138 active+clean; 2.6 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.0 KiB/s rd, 116 MiB/s wr, 1.86k op/s 2024-02-19T21:54:23.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:21.751924+0000 osd.7 (osd.7) 281 : cluster [DBG] 5.9 scrub starts 2024-02-19T21:54:23.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:21.760252+0000 osd.7 (osd.7) 282 : cluster [DBG] 5.9 scrub ok 2024-02-19T21:54:23.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:21.924588+0000 osd.0 (osd.0) 295 : cluster [DBG] 6.16 scrub starts 2024-02-19T21:54:23.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:21.953462+0000 osd.0 (osd.0) 296 : cluster [DBG] 6.16 scrub ok 2024-02-19T21:54:23.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:21.210583+0000 mgr.y (mgr.14514) 833 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:54:23.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:21.246769+0000 mgr.y (mgr.14514) 834 : cluster [DBG] pgmap v1079: 138 pgs: 138 active+clean; 2.6 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.0 KiB/s rd, 116 MiB/s wr, 1.86k op/s 2024-02-19T21:54:23.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:21.751924+0000 osd.7 (osd.7) 281 : cluster [DBG] 5.9 scrub starts 2024-02-19T21:54:23.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:21.760252+0000 osd.7 (osd.7) 282 : cluster [DBG] 5.9 scrub ok 2024-02-19T21:54:23.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:21.924588+0000 osd.0 (osd.0) 295 : cluster [DBG] 6.16 scrub starts 2024-02-19T21:54:23.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:21.953462+0000 osd.0 (osd.0) 296 : cluster [DBG] 6.16 scrub ok 2024-02-19T21:54:23.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:21.210583+0000 mgr.y (mgr.14514) 833 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:54:23.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:21.246769+0000 mgr.y (mgr.14514) 834 : cluster [DBG] pgmap v1079: 138 pgs: 138 active+clean; 2.6 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.0 KiB/s rd, 116 MiB/s wr, 1.86k op/s 2024-02-19T21:54:23.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:21.751924+0000 osd.7 (osd.7) 281 : cluster [DBG] 5.9 scrub starts 2024-02-19T21:54:23.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:21.760252+0000 osd.7 (osd.7) 282 : cluster [DBG] 5.9 scrub ok 2024-02-19T21:54:23.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:21.924588+0000 osd.0 (osd.0) 295 : cluster [DBG] 6.16 scrub starts 2024-02-19T21:54:23.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:21.953462+0000 osd.0 (osd.0) 296 : cluster [DBG] 6.16 scrub ok 2024-02-19T21:54:23.500 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:54:23.507 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:23.507 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:54:23.608 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:54:23.656 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:23.692 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:54:23.698 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:23.698 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:54:23.799 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:54:23.898 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:24.020 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:22.686246+0000 osd.6 (osd.6) 260 : cluster [DBG] 2.1a scrub starts 2024-02-19T21:54:24.020 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:22.689139+0000 osd.6 (osd.6) 261 : cluster [DBG] 2.1a scrub ok 2024-02-19T21:54:24.020 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:22.784949+0000 osd.7 (osd.7) 283 : cluster [DBG] 2.b scrub starts 2024-02-19T21:54:24.020 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:22.795993+0000 osd.7 (osd.7) 284 : cluster [DBG] 2.b scrub ok 2024-02-19T21:54:24.020 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:23.546245+0000 osd.1 (osd.1) 260 : cluster [DBG] 4.4 scrub starts 2024-02-19T21:54:24.020 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:23.554331+0000 osd.1 (osd.1) 261 : cluster [DBG] 4.4 scrub ok 2024-02-19T21:54:24.106 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 24 16 49675 49659 129.274 88.625 0.0180577 0.00773012 2024-02-19T21:54:24.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:22.686246+0000 osd.6 (osd.6) 260 : cluster [DBG] 2.1a scrub starts 2024-02-19T21:54:24.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:22.689139+0000 osd.6 (osd.6) 261 : cluster [DBG] 2.1a scrub ok 2024-02-19T21:54:24.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:22.784949+0000 osd.7 (osd.7) 283 : cluster [DBG] 2.b scrub starts 2024-02-19T21:54:24.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:22.795993+0000 osd.7 (osd.7) 284 : cluster [DBG] 2.b scrub ok 2024-02-19T21:54:24.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:23.546245+0000 osd.1 (osd.1) 260 : cluster [DBG] 4.4 scrub starts 2024-02-19T21:54:24.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:23.554331+0000 osd.1 (osd.1) 261 : cluster [DBG] 4.4 scrub ok 2024-02-19T21:54:24.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:22.686246+0000 osd.6 (osd.6) 260 : cluster [DBG] 2.1a scrub starts 2024-02-19T21:54:24.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:22.689139+0000 osd.6 (osd.6) 261 : cluster [DBG] 2.1a scrub ok 2024-02-19T21:54:24.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:22.784949+0000 osd.7 (osd.7) 283 : cluster [DBG] 2.b scrub starts 2024-02-19T21:54:24.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:22.795993+0000 osd.7 (osd.7) 284 : cluster [DBG] 2.b scrub ok 2024-02-19T21:54:24.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:23.546245+0000 osd.1 (osd.1) 260 : cluster [DBG] 4.4 scrub starts 2024-02-19T21:54:24.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:23.554331+0000 osd.1 (osd.1) 261 : cluster [DBG] 4.4 scrub ok 2024-02-19T21:54:24.396 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:54:24.396 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:54:24.640 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:54:24.645 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:24.646 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:54:24.646 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:54:24.747 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:54:24.818 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:24.845 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:54:24.847 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:24.848 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:54:24.948 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:54:25.017 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:25.045 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-02-19T21:54:25.106 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 25 16 51164 51148 127.826 93.0625 0.00975159 0.00781842 2024-02-19T21:54:25.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:23.247247+0000 mgr.y (mgr.14514) 835 : cluster [DBG] pgmap v1080: 138 pgs: 138 active+clean; 2.7 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1023 B/s rd, 110 MiB/s wr, 1.76k op/s 2024-02-19T21:54:25.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:23.685966+0000 osd.6 (osd.6) 262 : cluster [DBG] 6.c scrub starts 2024-02-19T21:54:25.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:23.696933+0000 osd.6 (osd.6) 263 : cluster [DBG] 6.c scrub ok 2024-02-19T21:54:25.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:24.211212+0000 mon.b (mon.1) 75 : audit [INF] from='client.? 172.21.15.80:0/965117229' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:54:25.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:24.212802+0000 mon.a (mon.0) 1908 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:54:25.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:24.354433+0000 osd.5 (osd.5) 291 : cluster [DBG] 4.f scrub starts 2024-02-19T21:54:25.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:24.357925+0000 osd.5 (osd.5) 292 : cluster [DBG] 4.f scrub ok 2024-02-19T21:54:25.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:24.495433+0000 osd.1 (osd.1) 262 : cluster [DBG] 5.12 scrub starts 2024-02-19T21:54:25.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:24.498513+0000 osd.1 (osd.1) 263 : cluster [DBG] 5.12 scrub ok 2024-02-19T21:54:25.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:23.247247+0000 mgr.y (mgr.14514) 835 : cluster [DBG] pgmap v1080: 138 pgs: 138 active+clean; 2.7 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1023 B/s rd, 110 MiB/s wr, 1.76k op/s 2024-02-19T21:54:25.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:23.685966+0000 osd.6 (osd.6) 262 : cluster [DBG] 6.c scrub starts 2024-02-19T21:54:25.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:23.696933+0000 osd.6 (osd.6) 263 : cluster [DBG] 6.c scrub ok 2024-02-19T21:54:25.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:24.211212+0000 mon.b (mon.1) 75 : audit [INF] from='client.? 172.21.15.80:0/965117229' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:54:25.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:24.212802+0000 mon.a (mon.0) 1908 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:54:25.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:24.354433+0000 osd.5 (osd.5) 291 : cluster [DBG] 4.f scrub starts 2024-02-19T21:54:25.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:24.357925+0000 osd.5 (osd.5) 292 : cluster [DBG] 4.f scrub ok 2024-02-19T21:54:25.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:24.495433+0000 osd.1 (osd.1) 262 : cluster [DBG] 5.12 scrub starts 2024-02-19T21:54:25.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:24.498513+0000 osd.1 (osd.1) 263 : cluster [DBG] 5.12 scrub ok 2024-02-19T21:54:25.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:23.247247+0000 mgr.y (mgr.14514) 835 : cluster [DBG] pgmap v1080: 138 pgs: 138 active+clean; 2.7 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1023 B/s rd, 110 MiB/s wr, 1.76k op/s 2024-02-19T21:54:25.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:23.685966+0000 osd.6 (osd.6) 262 : cluster [DBG] 6.c scrub starts 2024-02-19T21:54:25.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:23.696933+0000 osd.6 (osd.6) 263 : cluster [DBG] 6.c scrub ok 2024-02-19T21:54:25.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:24.211212+0000 mon.b (mon.1) 75 : audit [INF] from='client.? 172.21.15.80:0/965117229' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:54:25.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:24.212802+0000 mon.a (mon.0) 1908 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:54:25.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:24.354433+0000 osd.5 (osd.5) 291 : cluster [DBG] 4.f scrub starts 2024-02-19T21:54:25.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:24.357925+0000 osd.5 (osd.5) 292 : cluster [DBG] 4.f scrub ok 2024-02-19T21:54:25.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:24.495433+0000 osd.1 (osd.1) 262 : cluster [DBG] 5.12 scrub starts 2024-02-19T21:54:25.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:24.498513+0000 osd.1 (osd.1) 263 : cluster [DBG] 5.12 scrub ok 2024-02-19T21:54:25.384 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:54:25.391 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:25.391 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:54:25.426 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.1 dump_historic_ops 2024-02-19T21:54:25.492 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:54:25.537 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:25.565 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:54:25.570 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:25.571 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:54:25.649 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:54:25.671 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:54:25.719 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:25.745 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:54:25.749 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:25.749 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:54:25.808 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:54:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:54:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:54:25.851 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:54:25.894 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:25.930 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:54:25.939 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:25.939 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:54:26.040 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:54:26.080 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:24.914978+0000 osd.0 (osd.0) 297 : cluster [DBG] 5.5 scrub starts 2024-02-19T21:54:26.081 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:24.918038+0000 osd.0 (osd.0) 298 : cluster [DBG] 5.5 scrub ok 2024-02-19T21:54:26.081 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:25.019590+0000 mon.a (mon.0) 1909 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:54:26.081 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:25.034545+0000 mon.a (mon.0) 1910 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:54:26.081 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:25.034622+0000 mon.a (mon.0) 1911 : cluster [DBG] osdmap e503: 8 total, 8 up, 8 in 2024-02-19T21:54:26.081 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:25.380619+0000 mon.a (mon.0) 1912 : cluster [DBG] osdmap e504: 8 total, 8 up, 8 in 2024-02-19T21:54:26.081 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:24.914978+0000 osd.0 (osd.0) 297 : cluster [DBG] 5.5 scrub starts 2024-02-19T21:54:26.081 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:24.918038+0000 osd.0 (osd.0) 298 : cluster [DBG] 5.5 scrub ok 2024-02-19T21:54:26.081 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:25.019590+0000 mon.a (mon.0) 1909 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:54:26.081 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:25.034545+0000 mon.a (mon.0) 1910 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:54:26.081 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:25.034622+0000 mon.a (mon.0) 1911 : cluster [DBG] osdmap e503: 8 total, 8 up, 8 in 2024-02-19T21:54:26.081 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:25.380619+0000 mon.a (mon.0) 1912 : cluster [DBG] osdmap e504: 8 total, 8 up, 8 in 2024-02-19T21:54:26.087 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:26.106 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 26 16 52484 52468 126.082 82.5 0.0147197 0.00792544 2024-02-19T21:54:26.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:24.914978+0000 osd.0 (osd.0) 297 : cluster [DBG] 5.5 scrub starts 2024-02-19T21:54:26.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:24.918038+0000 osd.0 (osd.0) 298 : cluster [DBG] 5.5 scrub ok 2024-02-19T21:54:26.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:25.019590+0000 mon.a (mon.0) 1909 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:54:26.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:25.034545+0000 mon.a (mon.0) 1910 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:54:26.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:25.034622+0000 mon.a (mon.0) 1911 : cluster [DBG] osdmap e503: 8 total, 8 up, 8 in 2024-02-19T21:54:26.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:25.380619+0000 mon.a (mon.0) 1912 : cluster [DBG] osdmap e504: 8 total, 8 up, 8 in 2024-02-19T21:54:27.108 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 27 16 53776 53760 124.404 80.75 0.00779814 0.00803335 2024-02-19T21:54:27.267 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:54:27.272 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:27.273 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:54:27.296 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:25.247755+0000 mgr.y (mgr.14514) 836 : cluster [DBG] pgmap v1082: 138 pgs: 138 active+clean; 2.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1023 B/s rd, 103 MiB/s wr, 1.65k op/s 2024-02-19T21:54:27.297 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:25.247755+0000 mgr.y (mgr.14514) 836 : cluster [DBG] pgmap v1082: 138 pgs: 138 active+clean; 2.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1023 B/s rd, 103 MiB/s wr, 1.65k op/s 2024-02-19T21:54:27.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:25.247755+0000 mgr.y (mgr.14514) 836 : cluster [DBG] pgmap v1082: 138 pgs: 138 active+clean; 2.9 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1023 B/s rd, 103 MiB/s wr, 1.65k op/s 2024-02-19T21:54:27.374 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:54:27.419 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:28.107 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 28 16 55235 55219 123.217 91.1875 0.0139151 0.00811129 2024-02-19T21:54:28.280 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:54:28.287 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:28.288 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:54:28.389 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:54:28.444 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:28.569 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:54:28.572 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:28.573 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:54:28.674 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:54:28.726 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:28.876 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:54:28.881 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:28.882 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:54:28.884 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:54:28.983 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:54:29.021 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:29.108 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 29 16 56629 56613 121.965 87.125 0.00523246 0.00819361 2024-02-19T21:54:29.111 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-19T21:54:29.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:27.248207+0000 mgr.y (mgr.14514) 837 : cluster [DBG] pgmap v1084: 138 pgs: 138 active+clean; 3.1 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 116 MiB/s wr, 1.86k op/s 2024-02-19T21:54:29.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:27.248207+0000 mgr.y (mgr.14514) 837 : cluster [DBG] pgmap v1084: 138 pgs: 138 active+clean; 3.1 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 116 MiB/s wr, 1.86k op/s 2024-02-19T21:54:29.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:27.248207+0000 mgr.y (mgr.14514) 837 : cluster [DBG] pgmap v1084: 138 pgs: 138 active+clean; 3.1 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 116 MiB/s wr, 1.86k op/s 2024-02-19T21:54:29.782 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:54:29.786 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:29.787 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:54:29.888 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:54:29.942 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:29.967 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:54:29.971 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:29.972 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:54:30.073 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:54:30.108 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 30 16 57989 57973 120.733 85 0.0216553 0.00827778 2024-02-19T21:54:30.124 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:30.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:28.586312+0000 osd.5 (osd.5) 293 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:54:30.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:28.586368+0000 osd.5 (osd.5) 294 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:54:30.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:29.057697+0000 mon.a (mon.0) 1913 : cluster [DBG] osdmap e505: 8 total, 8 up, 8 in 2024-02-19T21:54:30.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:28.586312+0000 osd.5 (osd.5) 293 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:54:30.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:28.586368+0000 osd.5 (osd.5) 294 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:54:30.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:29.057697+0000 mon.a (mon.0) 1913 : cluster [DBG] osdmap e505: 8 total, 8 up, 8 in 2024-02-19T21:54:30.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:28.586312+0000 osd.5 (osd.5) 293 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:54:30.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:28.586368+0000 osd.5 (osd.5) 294 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:54:30.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:29.057697+0000 mon.a (mon.0) 1913 : cluster [DBG] osdmap e505: 8 total, 8 up, 8 in 2024-02-19T21:54:30.483 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:54:30.488 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:30.489 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:54:30.555 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:54:30.585 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:54:30.590 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:54:30.615 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:54:30.647 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:54:30.648 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:30.683 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:54:30.683 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:54:30.687 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:30.687 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:54:30.723 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:54:30.751 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:54:30.773 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:54:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:54:30] "GET /metrics HTTP/1.1" 200 176757 "" "Prometheus/2.33.4" 2024-02-19T21:54:30.788 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:54:30.800 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:54:30.807 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:54:30.807 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:54:30.807 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:54:30.807 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:54:30.807 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:54:30.807 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:54:30.808 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:54:30.808 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:54:30.833 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:30.866 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:54:30.873 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:30.873 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:54:30.974 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:54:31.093 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:29.248590+0000 mgr.y (mgr.14514) 838 : cluster [DBG] pgmap v1086: 138 pgs: 138 active+clean; 3.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 853 B/s rd, 78 MiB/s wr, 1.25k op/s 2024-02-19T21:54:31.093 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:30.394805+0000 mon.a (mon.0) 1914 : cluster [DBG] osdmap e506: 8 total, 8 up, 8 in 2024-02-19T21:54:31.093 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:30.516536+0000 mon.a (mon.0) 1915 : audit [DBG] from='client.? 172.21.15.80:0/3972637863' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:54:31.100 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:31.108 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 31 16 59260 59244 119.401 79.4375 0.0124993 0.00836858 2024-02-19T21:54:31.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:29.248590+0000 mgr.y (mgr.14514) 838 : cluster [DBG] pgmap v1086: 138 pgs: 138 active+clean; 3.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 853 B/s rd, 78 MiB/s wr, 1.25k op/s 2024-02-19T21:54:31.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:30.394805+0000 mon.a (mon.0) 1914 : cluster [DBG] osdmap e506: 8 total, 8 up, 8 in 2024-02-19T21:54:31.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:30.516536+0000 mon.a (mon.0) 1915 : audit [DBG] from='client.? 172.21.15.80:0/3972637863' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:54:31.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:29.248590+0000 mgr.y (mgr.14514) 838 : cluster [DBG] pgmap v1086: 138 pgs: 138 active+clean; 3.1 GiB data, 15 GiB used, 700 GiB / 715 GiB avail; 853 B/s rd, 78 MiB/s wr, 1.25k op/s 2024-02-19T21:54:31.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:30.394805+0000 mon.a (mon.0) 1914 : cluster [DBG] osdmap e506: 8 total, 8 up, 8 in 2024-02-19T21:54:31.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:30.516536+0000 mon.a (mon.0) 1915 : audit [DBG] from='client.? 172.21.15.80:0/3972637863' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:54:31.557 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:54:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:54:31.660 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:54:31.666 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:31.667 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:54:31.767 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:54:31.826 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:31.860 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:54:31.867 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:31.868 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:54:31.969 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:54:32.044 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:32.111 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 32 16 60610 60594 118.298 84.375 0.0127257 0.0084486 2024-02-19T21:54:32.328 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:31.220827+0000 mgr.y (mgr.14514) 839 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:54:32.328 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:31.251018+0000 mgr.y (mgr.14514) 840 : cluster [DBG] pgmap v1088: 138 pgs: 138 active+clean; 3.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.7 KiB/s rd, 96 MiB/s wr, 1.54k op/s 2024-02-19T21:54:32.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:31.220827+0000 mgr.y (mgr.14514) 839 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:54:32.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:31.251018+0000 mgr.y (mgr.14514) 840 : cluster [DBG] pgmap v1088: 138 pgs: 138 active+clean; 3.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.7 KiB/s rd, 96 MiB/s wr, 1.54k op/s 2024-02-19T21:54:32.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:31.220827+0000 mgr.y (mgr.14514) 839 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:54:32.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:31.251018+0000 mgr.y (mgr.14514) 840 : cluster [DBG] pgmap v1088: 138 pgs: 138 active+clean; 3.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 1.7 KiB/s rd, 96 MiB/s wr, 1.54k op/s 2024-02-19T21:54:33.111 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 33 16 62009 61993 117.363 87.4375 0.0117919 0.00851647 2024-02-19T21:54:33.507 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:54:33.519 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:33.519 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:54:33.620 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:54:33.668 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:33.695 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:54:33.700 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:33.701 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:54:33.802 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:54:33.845 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:33.879 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:54:33.884 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:33.885 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:54:33.985 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:54:34.028 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:34.056 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:54:34.061 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:34.061 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:54:34.113 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 34 16 63274 63258 116.236 79.0625 0.0134918 0.00859923 2024-02-19T21:54:34.162 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:54:34.218 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:34.250 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:54:34.254 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:34.255 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:54:34.356 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:54:34.392 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:34.421 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:54:34.428 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:34.429 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:54:34.529 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:54:34.582 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:54:34.599 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:34.624 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:54:34.628 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:34.628 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:54:34.669 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:54:34.669 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-02-19T21:54:34.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-02-19T21:54:34.669 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-02-19T21:54:34.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.669 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:216529 9.4 9:25b2d936:::benchmark_data_smithi080_126364_object87937:head [delete] snapc 0=[] ondisk+write+known_if_redirected e354)", 2024-02-19T21:54:34.669 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:32.376570+0000", 2024-02-19T21:54:34.669 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 422.289952255, 2024-02-19T21:54:34.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1118081640000002, 2024-02-19T21:54:34.669 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:54:34.669 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:54:34.670 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:54:34.670 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:54:34.670 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:54:34.670 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216529 2024-02-19T21:54:34.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.670 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:54:34.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.670 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:54:34.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376570+0000", 2024-02-19T21:54:34.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:54:34.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.670 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:54:34.671 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376570+0000", 2024-02-19T21:54:34.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:54:34.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:54:34.672 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376569+0000", 2024-02-19T21:54:34.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4410000000000001e-06 2024-02-19T21:54:34.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:54:34.672 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376575+0000", 2024-02-19T21:54:34.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0769999999999997e-06 2024-02-19T21:54:34.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:54:34.672 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376584+0000", 2024-02-19T21:54:34.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.361e-06 2024-02-19T21:54:34.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:54:34.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376589+0000", 2024-02-19T21:54:34.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00062081599999999995 2024-02-19T21:54:34.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.377210+0000", 2024-02-19T21:54:34.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012205300000000001 2024-02-19T21:54:34.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:54:34.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.377332+0000", 2024-02-19T21:54:34.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000136787 2024-02-19T21:54:34.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,4", 2024-02-19T21:54:34.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.377469+0000", 2024-02-19T21:54:34.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011198336999999999 2024-02-19T21:54:34.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.388667+0000", 2024-02-19T21:54:34.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1060000000000006e-06 2024-02-19T21:54:34.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:54:34.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.388676+0000", 2024-02-19T21:54:34.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.99675825699999998 2024-02-19T21:54:34.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.385434+0000", 2024-02-19T21:54:34.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1522000000000001e-05 2024-02-19T21:54:34.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:54:34.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.385446+0000", 2024-02-19T21:54:34.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.102835834 2024-02-19T21:54:34.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.488282+0000", 2024-02-19T21:54:34.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6827e-05 2024-02-19T21:54:34.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.676 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:54:34.676 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.488379+0000", 2024-02-19T21:54:34.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1118081640000002 2024-02-19T21:54:34.676 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.676 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:34.676 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.676 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:216530 9.4 9:28f5fd9c:::benchmark_data_smithi080_126364_object87938:head [delete] snapc 0=[] ondisk+write+known_if_redirected e354)", 2024-02-19T21:54:34.676 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:32.376603+0000", 2024-02-19T21:54:34.676 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 422.28991986199998, 2024-02-19T21:54:34.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1241626120000001, 2024-02-19T21:54:34.676 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:54:34.677 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:54:34.677 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:54:34.677 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:54:34.677 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:54:34.677 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216530 2024-02-19T21:54:34.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.677 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:54:34.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.677 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:54:34.677 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376603+0000", 2024-02-19T21:54:34.677 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:54:34.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.677 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:54:34.677 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376603+0000", 2024-02-19T21:54:34.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:54:34.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:54:34.678 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376602+0000", 2024-02-19T21:54:34.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0580000000000002e-06 2024-02-19T21:54:34.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:54:34.678 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376605+0000", 2024-02-19T21:54:34.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8050000000000003e-06 2024-02-19T21:54:34.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:54:34.678 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376611+0000", 2024-02-19T21:54:34.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0430000000000001e-06 2024-02-19T21:54:34.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:54:34.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376615+0000", 2024-02-19T21:54:34.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036348930000000002 2024-02-19T21:54:34.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.380250+0000", 2024-02-19T21:54:34.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012296299999999999 2024-02-19T21:54:34.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:54:34.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.380373+0000", 2024-02-19T21:54:34.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000139472 2024-02-19T21:54:34.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3,4", 2024-02-19T21:54:34.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.380513+0000", 2024-02-19T21:54:34.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0081962920000000009 2024-02-19T21:54:34.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.388709+0000", 2024-02-19T21:54:34.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2509999999999997e-06 2024-02-19T21:54:34.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:54:34.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.388716+0000", 2024-02-19T21:54:34.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.99676181399999997 2024-02-19T21:54:34.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.385478+0000", 2024-02-19T21:54:34.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3409999999999997e-06 2024-02-19T21:54:34.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:54:34.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.385485+0000", 2024-02-19T21:54:34.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1032571179999999 2024-02-19T21:54:34.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.488742+0000", 2024-02-19T21:54:34.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9407000000000006e-05 2024-02-19T21:54:34.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for missing object", 2024-02-19T21:54:34.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.488842+0000", 2024-02-19T21:54:34.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011861345000000001 2024-02-19T21:54:34.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.683 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.500703+0000", 2024-02-19T21:54:34.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2373999999999996e-05 2024-02-19T21:54:34.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.683 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:54:34.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.500765+0000", 2024-02-19T21:54:34.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1241626120000001 2024-02-19T21:54:34.683 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.683 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:34.683 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.683 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:216531 9.4 9:2722ae18:::benchmark_data_smithi080_126364_object87939:head [delete] snapc 0=[] ondisk+write+known_if_redirected e354)", 2024-02-19T21:54:34.684 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:32.376620+0000", 2024-02-19T21:54:34.684 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 422.28990308300001, 2024-02-19T21:54:34.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1245084009999999, 2024-02-19T21:54:34.684 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:54:34.684 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:54:34.684 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:54:34.684 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:54:34.684 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:54:34.684 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216531 2024-02-19T21:54:34.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.684 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:54:34.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:54:34.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376620+0000", 2024-02-19T21:54:34.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:54:34.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:54:34.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376620+0000", 2024-02-19T21:54:34.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:54:34.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:54:34.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376619+0000", 2024-02-19T21:54:34.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4880000000000001e-06 2024-02-19T21:54:34.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:54:34.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376622+0000", 2024-02-19T21:54:34.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5450000000000003e-06 2024-02-19T21:54:34.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:54:34.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376627+0000", 2024-02-19T21:54:34.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6480000000000001e-06 2024-02-19T21:54:34.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:54:34.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376631+0000", 2024-02-19T21:54:34.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012146235999999999 2024-02-19T21:54:34.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.388777+0000", 2024-02-19T21:54:34.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8529999999999992e-06 2024-02-19T21:54:34.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:54:34.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.388785+0000", 2024-02-19T21:54:34.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.99672369199999999 2024-02-19T21:54:34.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.385509+0000", 2024-02-19T21:54:34.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9809999999999997e-06 2024-02-19T21:54:34.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:54:34.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.385516+0000", 2024-02-19T21:54:34.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.103355021 2024-02-19T21:54:34.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.488871+0000", 2024-02-19T21:54:34.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8314999999999997e-05 2024-02-19T21:54:34.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:54:34.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.488959+0000", 2024-02-19T21:54:34.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050823700000000003 2024-02-19T21:54:34.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,3,4", 2024-02-19T21:54:34.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.489467+0000", 2024-02-19T21:54:34.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0079199600000000002 2024-02-19T21:54:34.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.497387+0000", 2024-02-19T21:54:34.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4715000000000001e-05 2024-02-19T21:54:34.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:54:34.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.497402+0000", 2024-02-19T21:54:34.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029186379999999999 2024-02-19T21:54:34.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.500321+0000", 2024-02-19T21:54:34.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060752099999999997 2024-02-19T21:54:34.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.500928+0000", 2024-02-19T21:54:34.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2785999999999999e-05 2024-02-19T21:54:34.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:54:34.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.500981+0000", 2024-02-19T21:54:34.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014715299999999999 2024-02-19T21:54:34.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:54:34.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.501128+0000", 2024-02-19T21:54:34.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1245084009999999 2024-02-19T21:54:34.691 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.691 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:34.691 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.691 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:216532 9.4 9:24541b90:::benchmark_data_smithi080_126364_object87940:head [delete] snapc 0=[] ondisk+write+known_if_redirected e354)", 2024-02-19T21:54:34.691 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:32.376979+0000", 2024-02-19T21:54:34.691 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 422.289543788, 2024-02-19T21:54:34.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1245823119999998, 2024-02-19T21:54:34.691 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:54:34.691 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:54:34.691 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:54:34.691 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:54:34.691 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:54:34.692 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216532 2024-02-19T21:54:34.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.692 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:54:34.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:54:34.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376979+0000", 2024-02-19T21:54:34.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:54:34.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:54:34.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376979+0000", 2024-02-19T21:54:34.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:54:34.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:54:34.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376978+0000", 2024-02-19T21:54:34.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.224e-06 2024-02-19T21:54:34.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:54:34.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376984+0000", 2024-02-19T21:54:34.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1841000000000001e-05 2024-02-19T21:54:34.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:54:34.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.376996+0000", 2024-02-19T21:54:34.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5779999999999998e-06 2024-02-19T21:54:34.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:54:34.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.377002+0000", 2024-02-19T21:54:34.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011808366000000001 2024-02-19T21:54:34.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.388810+0000", 2024-02-19T21:54:34.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9026999999999999e-05 2024-02-19T21:54:34.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:54:34.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.388829+0000", 2024-02-19T21:54:34.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.99670936600000004 2024-02-19T21:54:34.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.385538+0000", 2024-02-19T21:54:34.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5630000000000003e-06 2024-02-19T21:54:34.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:54:34.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.385546+0000", 2024-02-19T21:54:34.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1088639279999999 2024-02-19T21:54:34.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.494410+0000", 2024-02-19T21:54:34.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000143475 2024-02-19T21:54:34.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:54:34.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.494553+0000", 2024-02-19T21:54:34.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018708099999999999 2024-02-19T21:54:34.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,3,4", 2024-02-19T21:54:34.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.494740+0000", 2024-02-19T21:54:34.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028465209999999999 2024-02-19T21:54:34.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.497587+0000", 2024-02-19T21:54:34.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.114e-05 2024-02-19T21:54:34.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:54:34.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.497598+0000", 2024-02-19T21:54:34.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032621999999999998 2024-02-19T21:54:34.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.500860+0000", 2024-02-19T21:54:34.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053707600000000005 2024-02-19T21:54:34.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.501397+0000", 2024-02-19T21:54:34.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1771999999999998e-05 2024-02-19T21:54:34.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:54:34.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.501449+0000", 2024-02-19T21:54:34.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112176 2024-02-19T21:54:34.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:54:34.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.501561+0000", 2024-02-19T21:54:34.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1245823119999998 2024-02-19T21:54:34.698 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.698 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:34.699 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.699 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:216533 9.4 9:28eba302:::benchmark_data_smithi080_126364_object87941:head [delete] snapc 0=[] ondisk+write+known_if_redirected e354)", 2024-02-19T21:54:34.699 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:32.377014+0000", 2024-02-19T21:54:34.699 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 422.28950876499999, 2024-02-19T21:54:34.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1247602990000001, 2024-02-19T21:54:34.699 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:54:34.699 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:54:34.699 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:54:34.699 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:54:34.699 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:54:34.699 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216533 2024-02-19T21:54:34.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.699 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:54:34.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:54:34.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.377014+0000", 2024-02-19T21:54:34.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:54:34.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:54:34.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.377014+0000", 2024-02-19T21:54:34.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:54:34.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:54:34.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.377013+0000", 2024-02-19T21:54:34.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9699999999999999e-06 2024-02-19T21:54:34.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:54:34.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.377016+0000", 2024-02-19T21:54:34.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4680000000000003e-06 2024-02-19T21:54:34.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:54:34.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.377021+0000", 2024-02-19T21:54:34.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.74e-06 2024-02-19T21:54:34.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:54:34.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.377024+0000", 2024-02-19T21:54:34.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012101628 2024-02-19T21:54:34.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.389125+0000", 2024-02-19T21:54:34.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1890000000000007e-06 2024-02-19T21:54:34.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:54:34.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.389133+0000", 2024-02-19T21:54:34.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.996446006 2024-02-19T21:54:34.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.385579+0000", 2024-02-19T21:54:34.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2999999999999998e-06 2024-02-19T21:54:34.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:54:34.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.385586+0000", 2024-02-19T21:54:34.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.112045682 2024-02-19T21:54:34.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.497631+0000", 2024-02-19T21:54:34.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010573099999999999 2024-02-19T21:54:34.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:54:34.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.497737+0000", 2024-02-19T21:54:34.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147577 2024-02-19T21:54:34.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,3,4", 2024-02-19T21:54:34.704 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.497885+0000", 2024-02-19T21:54:34.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029878159999999999 2024-02-19T21:54:34.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.704 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:54:34.704 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.500872+0000", 2024-02-19T21:54:34.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000324901 2024-02-19T21:54:34.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.704 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.704 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.501197+0000", 2024-02-19T21:54:34.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7369e-05 2024-02-19T21:54:34.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.501245+0000", 2024-02-19T21:54:34.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000377916 2024-02-19T21:54:34.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.501623+0000", 2024-02-19T21:54:34.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7428e-05 2024-02-19T21:54:34.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:54:34.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.501680+0000", 2024-02-19T21:54:34.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4160999999999995e-05 2024-02-19T21:54:34.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:54:34.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.501774+0000", 2024-02-19T21:54:34.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1247602990000001 2024-02-19T21:54:34.706 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.706 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:34.706 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.706 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:216544 9.4 9:2e84a0c0:::benchmark_data_smithi080_126364_object87952:head [delete] snapc 0=[] ondisk+write+known_if_redirected e355)", 2024-02-19T21:54:34.706 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:32.409289+0000", 2024-02-19T21:54:34.706 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 422.25723399999998, 2024-02-19T21:54:34.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1086239870000001, 2024-02-19T21:54:34.706 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:54:34.706 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:54:34.706 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:54:34.707 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:54:34.707 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:54:34.707 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216544 2024-02-19T21:54:34.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.707 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:54:34.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:54:34.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.409289+0000", 2024-02-19T21:54:34.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:54:34.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:54:34.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.409289+0000", 2024-02-19T21:54:34.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:54:34.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:54:34.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.409287+0000", 2024-02-19T21:54:34.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9800000000000001e-06 2024-02-19T21:54:34.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:54:34.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.409294+0000", 2024-02-19T21:54:34.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.079e-05 2024-02-19T21:54:34.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:54:34.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.409305+0000", 2024-02-19T21:54:34.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7599999999999997e-06 2024-02-19T21:54:34.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:54:34.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.409312+0000", 2024-02-19T21:54:34.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9539000000000002e-05 2024-02-19T21:54:34.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.409351+0000", 2024-02-19T21:54:34.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8030000000000003e-06 2024-02-19T21:54:34.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:54:34.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.409360+0000", 2024-02-19T21:54:34.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.97626832799999996 2024-02-19T21:54:34.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.710 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.710 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.385628+0000", 2024-02-19T21:54:34.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3319999999999998e-06 2024-02-19T21:54:34.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.710 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:54:34.710 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.385638+0000", 2024-02-19T21:54:34.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1162569330000001 2024-02-19T21:54:34.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.710 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.710 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.501895+0000", 2024-02-19T21:54:34.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010942000000000001 2024-02-19T21:54:34.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:54:34.711 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.502004+0000", 2024-02-19T21:54:34.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000122292 2024-02-19T21:54:34.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,3,4", 2024-02-19T21:54:34.711 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.502126+0000", 2024-02-19T21:54:34.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010202218000000001 2024-02-19T21:54:34.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:54:34.711 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.512329+0000", 2024-02-19T21:54:34.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053133190000000004 2024-02-19T21:54:34.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.712 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.712 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.517642+0000", 2024-02-19T21:54:34.712 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5588999999999999e-05 2024-02-19T21:54:34.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.712 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.712 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.517698+0000", 2024-02-19T21:54:34.712 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5012000000000003e-05 2024-02-19T21:54:34.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.712 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.517733+0000", 2024-02-19T21:54:34.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4095000000000003e-05 2024-02-19T21:54:34.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:54:34.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.517787+0000", 2024-02-19T21:54:34.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000126067 2024-02-19T21:54:34.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:54:34.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.517913+0000", 2024-02-19T21:54:34.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1086239870000001 2024-02-19T21:54:34.713 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.713 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:34.713 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.714 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:216551 9.4 9:200a70aa:::benchmark_data_smithi080_126364_object87959:head [delete] snapc 0=[] ondisk+write+known_if_redirected e355)", 2024-02-19T21:54:34.714 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:32.418387+0000", 2024-02-19T21:54:34.714 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 422.248135805, 2024-02-19T21:54:34.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1040447520000001, 2024-02-19T21:54:34.714 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:54:34.714 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:54:34.714 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:54:34.714 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:54:34.714 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:54:34.714 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216551 2024-02-19T21:54:34.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.714 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:54:34.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:54:34.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.418387+0000", 2024-02-19T21:54:34.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:54:34.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:54:34.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.418387+0000", 2024-02-19T21:54:34.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:54:34.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:54:34.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.418385+0000", 2024-02-19T21:54:34.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3219999999999998e-06 2024-02-19T21:54:34.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:54:34.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.418392+0000", 2024-02-19T21:54:34.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0550000000000001e-05 2024-02-19T21:54:34.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:54:34.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.418402+0000", 2024-02-19T21:54:34.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7039999999999997e-06 2024-02-19T21:54:34.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:54:34.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.418409+0000", 2024-02-19T21:54:34.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1557999999999996e-05 2024-02-19T21:54:34.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.717 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.418471+0000", 2024-02-19T21:54:34.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0101e-05 2024-02-19T21:54:34.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:54:34.717 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.418481+0000", 2024-02-19T21:54:34.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.96718870400000001 2024-02-19T21:54:34.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.717 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.385669+0000", 2024-02-19T21:54:34.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6860000000000006e-06 2024-02-19T21:54:34.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.718 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:54:34.718 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.385677+0000", 2024-02-19T21:54:34.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1191880869999999 2024-02-19T21:54:34.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.718 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.718 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.504865+0000", 2024-02-19T21:54:34.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3245999999999995e-05 2024-02-19T21:54:34.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.718 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:54:34.718 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.504948+0000", 2024-02-19T21:54:34.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4557999999999998e-05 2024-02-19T21:54:34.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.718 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,3,4", 2024-02-19T21:54:34.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.505043+0000", 2024-02-19T21:54:34.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0098739569999999992 2024-02-19T21:54:34.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.719 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:54:34.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.514917+0000", 2024-02-19T21:54:34.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030477479999999999 2024-02-19T21:54:34.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.719 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.517965+0000", 2024-02-19T21:54:34.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.773e-05 2024-02-19T21:54:34.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.719 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.518002+0000", 2024-02-19T21:54:34.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042432579999999998 2024-02-19T21:54:34.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.522246+0000", 2024-02-19T21:54:34.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7979999999999997e-05 2024-02-19T21:54:34.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:54:34.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.522304+0000", 2024-02-19T21:54:34.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012795499999999999 2024-02-19T21:54:34.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.721 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:54:34.721 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.522432+0000", 2024-02-19T21:54:34.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1040447520000001 2024-02-19T21:54:34.721 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.721 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:34.721 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.721 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.721 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:216569 9.4 9:292c1153:::benchmark_data_smithi080_126364_object87977:head [delete] snapc 0=[] ondisk+write+known_if_redirected e355)", 2024-02-19T21:54:34.721 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:32.443747+0000", 2024-02-19T21:54:34.721 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 422.22277550000001, 2024-02-19T21:54:34.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.078890017, 2024-02-19T21:54:34.721 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:54:34.721 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:54:34.722 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:54:34.722 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:54:34.722 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:54:34.722 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216569 2024-02-19T21:54:34.722 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.722 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:54:34.722 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.722 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:54:34.722 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.443747+0000", 2024-02-19T21:54:34.722 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:54:34.722 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.722 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.722 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:54:34.722 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.443747+0000", 2024-02-19T21:54:34.722 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:54:34.723 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.723 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.723 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:54:34.723 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.443746+0000", 2024-02-19T21:54:34.723 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9399999999999996e-06 2024-02-19T21:54:34.723 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.723 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.723 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:54:34.723 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.443753+0000", 2024-02-19T21:54:34.723 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0711e-05 2024-02-19T21:54:34.723 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.723 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.723 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:54:34.723 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.443763+0000", 2024-02-19T21:54:34.723 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2040000000000002e-06 2024-02-19T21:54:34.724 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.724 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:54:34.724 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.443770+0000", 2024-02-19T21:54:34.724 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6851000000000002e-05 2024-02-19T21:54:34.724 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.724 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.724 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.443826+0000", 2024-02-19T21:54:34.724 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0393e-05 2024-02-19T21:54:34.724 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.724 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:54:34.724 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.443837+0000", 2024-02-19T21:54:34.724 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.94288491699999999 2024-02-19T21:54:34.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.725 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.725 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.725 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.386722+0000", 2024-02-19T21:54:34.725 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1679999999999993e-06 2024-02-19T21:54:34.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.725 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.725 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:54:34.725 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.386731+0000", 2024-02-19T21:54:34.725 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.120589367 2024-02-19T21:54:34.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.725 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.725 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.725 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.507320+0000", 2024-02-19T21:54:34.725 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000127575 2024-02-19T21:54:34.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.726 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.726 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:54:34.726 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.507448+0000", 2024-02-19T21:54:34.726 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000150586 2024-02-19T21:54:34.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.726 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.726 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,3,4", 2024-02-19T21:54:34.726 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.507598+0000", 2024-02-19T21:54:34.726 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073286310000000004 2024-02-19T21:54:34.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.726 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.726 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:54:34.726 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.514927+0000", 2024-02-19T21:54:34.726 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031059529999999998 2024-02-19T21:54:34.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.727 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.727 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.727 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.518033+0000", 2024-02-19T21:54:34.727 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0213e-05 2024-02-19T21:54:34.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.727 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.727 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.727 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.518063+0000", 2024-02-19T21:54:34.727 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044069560000000001 2024-02-19T21:54:34.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.727 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.727 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.727 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.522470+0000", 2024-02-19T21:54:34.727 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5942000000000002e-05 2024-02-19T21:54:34.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.728 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.728 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:54:34.728 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.522516+0000", 2024-02-19T21:54:34.728 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121105 2024-02-19T21:54:34.728 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.728 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.728 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:54:34.728 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.522637+0000", 2024-02-19T21:54:34.728 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.078890017 2024-02-19T21:54:34.728 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.728 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:34.728 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.728 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.729 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:216593 9.4 9:2af0bab1:::benchmark_data_smithi080_126364_object88001:head [delete] snapc 0=[] ondisk+write+known_if_redirected e355)", 2024-02-19T21:54:34.729 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:32.501255+0000", 2024-02-19T21:54:34.729 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 422.165267685, 2024-02-19T21:54:34.729 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0215764570000001, 2024-02-19T21:54:34.729 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:54:34.729 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:54:34.729 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:54:34.729 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:54:34.729 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:54:34.729 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216593 2024-02-19T21:54:34.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.729 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:54:34.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.729 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:54:34.730 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.501255+0000", 2024-02-19T21:54:34.730 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:54:34.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.730 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.730 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:54:34.730 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.501255+0000", 2024-02-19T21:54:34.730 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:54:34.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.730 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.730 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:54:34.730 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.501254+0000", 2024-02-19T21:54:34.730 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8849999999999999e-06 2024-02-19T21:54:34.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.730 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.730 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:54:34.731 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.501261+0000", 2024-02-19T21:54:34.731 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3342e-05 2024-02-19T21:54:34.731 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.731 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:54:34.731 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.501275+0000", 2024-02-19T21:54:34.731 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5130000000000002e-06 2024-02-19T21:54:34.731 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.731 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:54:34.731 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.501281+0000", 2024-02-19T21:54:34.732 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8888999999999998e-05 2024-02-19T21:54:34.732 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.732 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.732 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.732 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.501340+0000", 2024-02-19T21:54:34.732 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2503999999999999e-05 2024-02-19T21:54:34.732 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.732 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.732 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:54:34.732 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.501353+0000", 2024-02-19T21:54:34.732 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.88541654299999994 2024-02-19T21:54:34.732 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.733 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.733 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.386769+0000", 2024-02-19T21:54:34.733 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.174e-06 2024-02-19T21:54:34.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.733 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:54:34.733 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.386777+0000", 2024-02-19T21:54:34.733 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1232325700000001 2024-02-19T21:54:34.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.733 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.733 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.510010+0000", 2024-02-19T21:54:34.733 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010353600000000001 2024-02-19T21:54:34.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.734 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:54:34.734 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.510113+0000", 2024-02-19T21:54:34.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4610000000000004e-05 2024-02-19T21:54:34.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.734 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,3,4", 2024-02-19T21:54:34.734 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.510208+0000", 2024-02-19T21:54:34.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047280830000000001 2024-02-19T21:54:34.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.734 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:54:34.734 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.514936+0000", 2024-02-19T21:54:34.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031638769999999998 2024-02-19T21:54:34.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.734 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.518100+0000", 2024-02-19T21:54:34.735 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012784890000000001 2024-02-19T21:54:34.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.519379+0000", 2024-02-19T21:54:34.735 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032947200000000001 2024-02-19T21:54:34.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.522673+0000", 2024-02-19T21:54:34.735 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2883000000000003e-05 2024-02-19T21:54:34.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:54:34.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.522716+0000", 2024-02-19T21:54:34.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115326 2024-02-19T21:54:34.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:54:34.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.522831+0000", 2024-02-19T21:54:34.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0215764570000001 2024-02-19T21:54:34.736 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.736 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:34.736 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.736 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:216606 9.4 9:247c1ef3:::benchmark_data_smithi080_126364_object88014:head [delete] snapc 0=[] ondisk+write+known_if_redirected e355)", 2024-02-19T21:54:34.736 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:32.555394+0000", 2024-02-19T21:54:34.737 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 422.11112854300001, 2024-02-19T21:54:34.737 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9752198839999999, 2024-02-19T21:54:34.737 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:54:34.737 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:54:34.737 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:54:34.737 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:54:34.737 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:54:34.737 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216606 2024-02-19T21:54:34.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.737 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:54:34.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.737 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:54:34.737 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.555394+0000", 2024-02-19T21:54:34.737 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:54:34.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.738 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.738 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:54:34.738 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.555394+0000", 2024-02-19T21:54:34.738 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:54:34.738 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.738 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.738 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:54:34.738 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.555393+0000", 2024-02-19T21:54:34.738 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8830000000000006e-06 2024-02-19T21:54:34.738 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.738 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.738 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:54:34.738 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.555400+0000", 2024-02-19T21:54:34.738 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2904e-05 2024-02-19T21:54:34.738 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.739 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:54:34.739 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.555413+0000", 2024-02-19T21:54:34.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.576e-06 2024-02-19T21:54:34.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.739 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:54:34.739 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.555421+0000", 2024-02-19T21:54:34.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2614999999999998e-05 2024-02-19T21:54:34.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.739 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.739 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.555464+0000", 2024-02-19T21:54:34.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2900000000000002e-06 2024-02-19T21:54:34.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.740 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:54:34.740 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:32.555472+0000", 2024-02-19T21:54:34.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.83144490999999998 2024-02-19T21:54:34.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.740 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.740 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.386917+0000", 2024-02-19T21:54:34.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.909e-06 2024-02-19T21:54:34.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.740 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:54:34.740 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:33.386925+0000", 2024-02-19T21:54:34.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.125429821 2024-02-19T21:54:34.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.512354+0000", 2024-02-19T21:54:34.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7803e-05 2024-02-19T21:54:34.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:54:34.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.512432+0000", 2024-02-19T21:54:34.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012552900000000001 2024-02-19T21:54:34.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,3,4", 2024-02-19T21:54:34.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.512558+0000", 2024-02-19T21:54:34.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.006776738 2024-02-19T21:54:34.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.519335+0000", 2024-02-19T21:54:34.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031526500000000001 2024-02-19T21:54:34.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.519650+0000", 2024-02-19T21:54:34.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010732574 2024-02-19T21:54:34.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.530382+0000", 2024-02-19T21:54:34.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8949999999999997e-05 2024-02-19T21:54:34.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:54:34.743 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.530431+0000", 2024-02-19T21:54:34.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3427000000000002e-05 2024-02-19T21:54:34.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:54:34.743 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.530485+0000", 2024-02-19T21:54:34.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012929799999999999 2024-02-19T21:54:34.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:54:34.743 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.530614+0000", 2024-02-19T21:54:34.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9752198839999999 2024-02-19T21:54:34.744 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.744 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:34.744 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.744 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:226005 9.4 9:2c4fc160:::benchmark_data_smithi080_126364_object97413:head [delete] snapc 0=[] ondisk+write+known_if_redirected e363)", 2024-02-19T21:54:34.744 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:46.316375+0000", 2024-02-19T21:54:34.744 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 408.35014784200001, 2024-02-19T21:54:34.744 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.95729776, 2024-02-19T21:54:34.744 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:54:34.744 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:54:34.744 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:54:34.744 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:54:34.744 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:54:34.745 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 226005 2024-02-19T21:54:34.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.745 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:54:34.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:54:34.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.316375+0000", 2024-02-19T21:54:34.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:54:34.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:54:34.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.316375+0000", 2024-02-19T21:54:34.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:54:34.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:54:34.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.316373+0000", 2024-02-19T21:54:34.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2240000000000001e-06 2024-02-19T21:54:34.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.746 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:54:34.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.316382+0000", 2024-02-19T21:54:34.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5271999999999999e-05 2024-02-19T21:54:34.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.746 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:54:34.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.316398+0000", 2024-02-19T21:54:34.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9090000000000003e-06 2024-02-19T21:54:34.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.746 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:54:34.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.316405+0000", 2024-02-19T21:54:34.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4798e-05 2024-02-19T21:54:34.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.316449+0000", 2024-02-19T21:54:34.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9519999999999994e-06 2024-02-19T21:54:34.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:54:34.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.316457+0000", 2024-02-19T21:54:34.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.95032962799999998 2024-02-19T21:54:34.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.266787+0000", 2024-02-19T21:54:34.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104298 2024-02-19T21:54:34.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:54:34.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.266891+0000", 2024-02-19T21:54:34.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4517000000000003e-05 2024-02-19T21:54:34.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:54:34.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.266986+0000", 2024-02-19T21:54:34.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022953370000000002 2024-02-19T21:54:34.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.269281+0000", 2024-02-19T21:54:34.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001367023 2024-02-19T21:54:34.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:54:34.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.270648+0000", 2024-02-19T21:54:34.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029505999999999998 2024-02-19T21:54:34.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.273599+0000", 2024-02-19T21:54:34.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1844000000000002e-05 2024-02-19T21:54:34.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:54:34.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.273631+0000", 2024-02-19T21:54:34.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2073000000000002e-05 2024-02-19T21:54:34.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:54:34.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.273673+0000", 2024-02-19T21:54:34.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.95729776 2024-02-19T21:54:34.750 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.750 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:34.750 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.750 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:226031 9.4 9:206880c1:::benchmark_data_smithi080_126364_object97439:head [delete] snapc 0=[] ondisk+write+known_if_redirected e363)", 2024-02-19T21:54:34.750 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:46.370750+0000", 2024-02-19T21:54:34.750 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 408.29577249099998, 2024-02-19T21:54:34.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.90307898399999997, 2024-02-19T21:54:34.751 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:54:34.751 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:54:34.751 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:54:34.751 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:54:34.751 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:54:34.751 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 226031 2024-02-19T21:54:34.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.751 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:54:34.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:54:34.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.370750+0000", 2024-02-19T21:54:34.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:54:34.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:54:34.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.370750+0000", 2024-02-19T21:54:34.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:54:34.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:54:34.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.370748+0000", 2024-02-19T21:54:34.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7689999999999996e-06 2024-02-19T21:54:34.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:54:34.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.370756+0000", 2024-02-19T21:54:34.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2668e-05 2024-02-19T21:54:34.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:54:34.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.370769+0000", 2024-02-19T21:54:34.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9449999999999998e-06 2024-02-19T21:54:34.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:54:34.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.370775+0000", 2024-02-19T21:54:34.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1214999999999998e-05 2024-02-19T21:54:34.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.370816+0000", 2024-02-19T21:54:34.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4910000000000002e-06 2024-02-19T21:54:34.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.754 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:54:34.754 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.370822+0000", 2024-02-19T21:54:34.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.89849280600000003 2024-02-19T21:54:34.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.754 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.754 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.269315+0000", 2024-02-19T21:54:34.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5833000000000005e-05 2024-02-19T21:54:34.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.754 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:54:34.754 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.269381+0000", 2024-02-19T21:54:34.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3440000000000001e-05 2024-02-19T21:54:34.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:54:34.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.269464+0000", 2024-02-19T21:54:34.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039180370000000001 2024-02-19T21:54:34.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.273383+0000", 2024-02-19T21:54:34.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030051600000000002 2024-02-19T21:54:34.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:54:34.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.273683+0000", 2024-02-19T21:54:34.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7463000000000001e-05 2024-02-19T21:54:34.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.273750+0000", 2024-02-19T21:54:34.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2928e-05 2024-02-19T21:54:34.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:54:34.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.273793+0000", 2024-02-19T21:54:34.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5763000000000003e-05 2024-02-19T21:54:34.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:54:34.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.273829+0000", 2024-02-19T21:54:34.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.90307898399999997 2024-02-19T21:54:34.757 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.757 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:34.757 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.757 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:226065 9.4 9:2e9761dc:::benchmark_data_smithi080_126364_object97473:head [delete] snapc 0=[] ondisk+write+known_if_redirected e363)", 2024-02-19T21:54:34.757 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:46.410512+0000", 2024-02-19T21:54:34.757 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 408.256010291, 2024-02-19T21:54:34.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.86630932800000005, 2024-02-19T21:54:34.757 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:54:34.757 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:54:34.757 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:54:34.757 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:54:34.757 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:54:34.758 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 226065 2024-02-19T21:54:34.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.758 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:54:34.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:54:34.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.410512+0000", 2024-02-19T21:54:34.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:54:34.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:54:34.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.410512+0000", 2024-02-19T21:54:34.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:54:34.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:54:34.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.410512+0000", 2024-02-19T21:54:34.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7179999999999998e-06 2024-02-19T21:54:34.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:54:34.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.410515+0000", 2024-02-19T21:54:34.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3140000000000004e-06 2024-02-19T21:54:34.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:54:34.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.410524+0000", 2024-02-19T21:54:34.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7809999999999996e-06 2024-02-19T21:54:34.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:54:34.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.410529+0000", 2024-02-19T21:54:34.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7425e-05 2024-02-19T21:54:34.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.410586+0000", 2024-02-19T21:54:34.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8990000000000001e-06 2024-02-19T21:54:34.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:54:34.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.410594+0000", 2024-02-19T21:54:34.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.86009007800000004 2024-02-19T21:54:34.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.270684+0000", 2024-02-19T21:54:34.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0001019 2024-02-19T21:54:34.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:54:34.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.270786+0000", 2024-02-19T21:54:34.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2132000000000006e-05 2024-02-19T21:54:34.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:54:34.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.270868+0000", 2024-02-19T21:54:34.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002818769 2024-02-19T21:54:34.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:54:34.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.273687+0000", 2024-02-19T21:54:34.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4419999999999999e-05 2024-02-19T21:54:34.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.273721+0000", 2024-02-19T21:54:34.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030467530000000001 2024-02-19T21:54:34.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.276768+0000", 2024-02-19T21:54:34.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0159999999999999e-05 2024-02-19T21:54:34.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:54:34.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.276798+0000", 2024-02-19T21:54:34.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3628000000000001e-05 2024-02-19T21:54:34.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:54:34.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.276822+0000", 2024-02-19T21:54:34.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.86630932800000005 2024-02-19T21:54:34.763 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.763 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:34.763 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.763 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:226077 9.4 9:2685a4dd:::benchmark_data_smithi080_126364_object97485:head [delete] snapc 0=[] ondisk+write+known_if_redirected e363)", 2024-02-19T21:54:34.763 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:46.421546+0000", 2024-02-19T21:54:34.763 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 408.24497626900001, 2024-02-19T21:54:34.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.85538825299999999, 2024-02-19T21:54:34.764 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:54:34.764 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:54:34.764 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:54:34.764 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:54:34.764 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:54:34.764 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 226077 2024-02-19T21:54:34.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.764 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:54:34.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:54:34.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.421546+0000", 2024-02-19T21:54:34.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:54:34.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:54:34.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.421546+0000", 2024-02-19T21:54:34.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:54:34.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:54:34.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.421545+0000", 2024-02-19T21:54:34.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0840000000000003e-06 2024-02-19T21:54:34.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:54:34.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.421552+0000", 2024-02-19T21:54:34.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.327e-05 2024-02-19T21:54:34.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.766 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:54:34.766 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.421566+0000", 2024-02-19T21:54:34.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8329999999999996e-06 2024-02-19T21:54:34.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.766 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:54:34.766 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.421572+0000", 2024-02-19T21:54:34.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2280000000000002e-05 2024-02-19T21:54:34.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.766 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.766 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.421615+0000", 2024-02-19T21:54:34.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3279999999999996e-06 2024-02-19T21:54:34.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:54:34.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.421620+0000", 2024-02-19T21:54:34.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.850279165 2024-02-19T21:54:34.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.271899+0000", 2024-02-19T21:54:34.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2007000000000002e-05 2024-02-19T21:54:34.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:54:34.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.271991+0000", 2024-02-19T21:54:34.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9845000000000005e-05 2024-02-19T21:54:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:54:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.272081+0000", 2024-02-19T21:54:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0017580149999999999 2024-02-19T21:54:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:54:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.273839+0000", 2024-02-19T21:54:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6344000000000002e-05 2024-02-19T21:54:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.273885+0000", 2024-02-19T21:54:34.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002978681 2024-02-19T21:54:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.276864+0000", 2024-02-19T21:54:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5762000000000001e-05 2024-02-19T21:54:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:54:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.276900+0000", 2024-02-19T21:54:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4836000000000003e-05 2024-02-19T21:54:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:54:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.276935+0000", 2024-02-19T21:54:34.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.85538825299999999 2024-02-19T21:54:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:226091 9.4 9:27b12d5c:::benchmark_data_smithi080_126364_object97499:head [delete] snapc 0=[] ondisk+write+known_if_redirected e363)", 2024-02-19T21:54:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:46.435564+0000", 2024-02-19T21:54:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 408.23095843999999, 2024-02-19T21:54:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.84576922700000001, 2024-02-19T21:54:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:54:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:54:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:54:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:54:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:54:34.770 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 226091 2024-02-19T21:54:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:54:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:54:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.435564+0000", 2024-02-19T21:54:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:54:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:54:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.435564+0000", 2024-02-19T21:54:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:54:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:54:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.435563+0000", 2024-02-19T21:54:34.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7490000000000001e-06 2024-02-19T21:54:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:54:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.435570+0000", 2024-02-19T21:54:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0606e-05 2024-02-19T21:54:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:54:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.435580+0000", 2024-02-19T21:54:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0040000000000002e-06 2024-02-19T21:54:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:54:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.435587+0000", 2024-02-19T21:54:34.772 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027718590000000002 2024-02-19T21:54:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.438359+0000", 2024-02-19T21:54:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1400000000000002e-06 2024-02-19T21:54:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:54:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.438366+0000", 2024-02-19T21:54:34.773 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:54:34.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.83555307000000001 2024-02-19T21:54:34.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.273919+0000", 2024-02-19T21:54:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1989000000000006e-05 2024-02-19T21:54:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:54:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.273981+0000", 2024-02-19T21:54:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8942000000000005e-05 2024-02-19T21:54:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:54:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.274050+0000", 2024-02-19T21:54:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029313379999999999 2024-02-19T21:54:34.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.276982+0000", 2024-02-19T21:54:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.229e-06 2024-02-19T21:54:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:54:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.276988+0000", 2024-02-19T21:54:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042792230000000004 2024-02-19T21:54:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.281267+0000", 2024-02-19T21:54:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9638e-05 2024-02-19T21:54:34.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:54:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.281297+0000", 2024-02-19T21:54:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6878999999999997e-05 2024-02-19T21:54:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:54:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.281333+0000", 2024-02-19T21:54:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.84576922700000001 2024-02-19T21:54:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.777 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:226128 9.4 9:290be770:::benchmark_data_smithi080_126364_object97536:head [delete] snapc 0=[] ondisk+write+known_if_redirected e363)", 2024-02-19T21:54:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:46.489677+0000", 2024-02-19T21:54:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 408.17684608500002, 2024-02-19T21:54:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.79177427899999997, 2024-02-19T21:54:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:54:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:54:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:54:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:54:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:54:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 226128 2024-02-19T21:54:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:54:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:54:34.778 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.489677+0000", 2024-02-19T21:54:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:54:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:54:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.489677+0000", 2024-02-19T21:54:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:54:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:54:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.489675+0000", 2024-02-19T21:54:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8089999999999998e-06 2024-02-19T21:54:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:54:34.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.489681+0000", 2024-02-19T21:54:34.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2183e-05 2024-02-19T21:54:34.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:54:34.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.489693+0000", 2024-02-19T21:54:34.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5939999999999996e-06 2024-02-19T21:54:34.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:54:34.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.489701+0000", 2024-02-19T21:54:34.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5311000000000001e-05 2024-02-19T21:54:34.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.489736+0000", 2024-02-19T21:54:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9540000000000003e-06 2024-02-19T21:54:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:54:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.489741+0000", 2024-02-19T21:54:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.78555000500000005 2024-02-19T21:54:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.275291+0000", 2024-02-19T21:54:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000100398 2024-02-19T21:54:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.781 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:54:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.275392+0000", 2024-02-19T21:54:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010252899999999999 2024-02-19T21:54:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:54:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.275494+0000", 2024-02-19T21:54:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015537109999999999 2024-02-19T21:54:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.277048+0000", 2024-02-19T21:54:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0017784890000000001 2024-02-19T21:54:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:54:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.278826+0000", 2024-02-19T21:54:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025460259999999998 2024-02-19T21:54:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.281372+0000", 2024-02-19T21:54:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2975000000000001e-05 2024-02-19T21:54:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:54:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.281415+0000", 2024-02-19T21:54:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5497000000000003e-05 2024-02-19T21:54:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:54:34.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.281451+0000", 2024-02-19T21:54:34.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.79177427899999997 2024-02-19T21:54:34.784 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.784 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:34.784 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.784 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:226139 9.4 9:20801f36:::benchmark_data_smithi080_126364_object97547:head [delete] snapc 0=[] ondisk+write+known_if_redirected e363)", 2024-02-19T21:54:34.784 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:46.502821+0000", 2024-02-19T21:54:34.784 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 408.163701801, 2024-02-19T21:54:34.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.785912045, 2024-02-19T21:54:34.784 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:54:34.784 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:54:34.784 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:54:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:54:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:54:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 226139 2024-02-19T21:54:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:54:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:54:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.502821+0000", 2024-02-19T21:54:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:54:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:54:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.502821+0000", 2024-02-19T21:54:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:54:34.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:54:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.502820+0000", 2024-02-19T21:54:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6490000000000002e-06 2024-02-19T21:54:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:54:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.502826+0000", 2024-02-19T21:54:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2104e-05 2024-02-19T21:54:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:54:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.502838+0000", 2024-02-19T21:54:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2469999999999999e-06 2024-02-19T21:54:34.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:54:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.502844+0000", 2024-02-19T21:54:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2051000000000002e-05 2024-02-19T21:54:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.502876+0000", 2024-02-19T21:54:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5080000000000002e-06 2024-02-19T21:54:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:54:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.502882+0000", 2024-02-19T21:54:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.77419403399999998 2024-02-19T21:54:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.787 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.277076+0000", 2024-02-19T21:54:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6303000000000005e-05 2024-02-19T21:54:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:54:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.277153+0000", 2024-02-19T21:54:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4896999999999998e-05 2024-02-19T21:54:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:54:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.277227+0000", 2024-02-19T21:54:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040033350000000002 2024-02-19T21:54:34.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.281231+0000", 2024-02-19T21:54:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.007380841 2024-02-19T21:54:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:54:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.288612+0000", 2024-02-19T21:54:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4524999999999997e-05 2024-02-19T21:54:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.288666+0000", 2024-02-19T21:54:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1702999999999998e-05 2024-02-19T21:54:34.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:54:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.288698+0000", 2024-02-19T21:54:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5088e-05 2024-02-19T21:54:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:54:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.288733+0000", 2024-02-19T21:54:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.785912045 2024-02-19T21:54:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.15345.0:226170 9.4 9:286852bd:::benchmark_data_smithi080_126364_object97578:head [delete] snapc 0=[] ondisk+write+known_if_redirected e363)", 2024-02-19T21:54:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:46.545528+0000", 2024-02-19T21:54:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 408.12099465, 2024-02-19T21:54:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.74331496900000005, 2024-02-19T21:54:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:54:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:54:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:54:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.15345", 2024-02-19T21:54:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:54:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 226170 2024-02-19T21:54:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:54:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:54:34.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.545528+0000", 2024-02-19T21:54:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:54:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:54:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.545528+0000", 2024-02-19T21:54:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:54:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:54:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.545527+0000", 2024-02-19T21:54:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9210000000000002e-06 2024-02-19T21:54:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:54:34.792 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.545531+0000", 2024-02-19T21:54:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8240000000000002e-06 2024-02-19T21:54:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:54:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.545538+0000", 2024-02-19T21:54:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3420000000000001e-06 2024-02-19T21:54:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:54:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.545542+0000", 2024-02-19T21:54:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4168000000000001e-05 2024-02-19T21:54:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.545587+0000", 2024-02-19T21:54:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1999999999999997e-06 2024-02-19T21:54:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-02-19T21:54:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:46.545594+0000", 2024-02-19T21:54:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.733272853 2024-02-19T21:54:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.278867+0000", 2024-02-19T21:54:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000110064 2024-02-19T21:54:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:54:34.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.278977+0000", 2024-02-19T21:54:34.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000136217 2024-02-19T21:54:34.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,4", 2024-02-19T21:54:34.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.279113+0000", 2024-02-19T21:54:34.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.009504495 2024-02-19T21:54:34.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:54:34.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.288617+0000", 2024-02-19T21:54:34.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6953000000000001e-05 2024-02-19T21:54:34.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.288644+0000", 2024-02-19T21:54:34.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015265400000000001 2024-02-19T21:54:34.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:54:34.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.288797+0000", 2024-02-19T21:54:34.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5210000000000001e-05 2024-02-19T21:54:34.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:54:34.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.288822+0000", 2024-02-19T21:54:34.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0761e-05 2024-02-19T21:54:34.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:54:34.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:47.288843+0000", 2024-02-19T21:54:34.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.74331496900000005 2024-02-19T21:54:34.797 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.797 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:34.797 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.797 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.25952.0:26140 11.6 e499/492 11:63bcaa11:::benchmark_data_smithi080_184406_object26139:head v 499'1692, mlcod=499'1689)", 2024-02-19T21:54:34.797 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:54:10.166846+0000", 2024-02-19T21:54:34.797 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.499677144, 2024-02-19T21:54:34.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.110941805, 2024-02-19T21:54:34.797 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:54:34.797 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:54:34.797 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:54:34.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:54:34.798 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:10.166846+0000", 2024-02-19T21:54:34.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:54:34.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:54:34.798 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:10.166846+0000", 2024-02-19T21:54:34.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:54:34.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:54:34.798 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:10.166845+0000", 2024-02-19T21:54:34.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1780000000000002e-05 2024-02-19T21:54:34.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:54:34.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:10.166867+0000", 2024-02-19T21:54:34.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0243e-05 2024-02-19T21:54:34.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:54:34.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:10.166877+0000", 2024-02-19T21:54:34.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7729999999999996e-06 2024-02-19T21:54:34.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:54:34.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:10.166883+0000", 2024-02-19T21:54:34.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8264999999999999e-05 2024-02-19T21:54:34.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:10.166941+0000", 2024-02-19T21:54:34.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8839e-05 2024-02-19T21:54:34.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:54:34.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:10.166960+0000", 2024-02-19T21:54:34.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.110788466 2024-02-19T21:54:34.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:54:34.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:10.277748+0000", 2024-02-19T21:54:34.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9202999999999997e-05 2024-02-19T21:54:34.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:54:34.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:10.277787+0000", 2024-02-19T21:54:34.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.110941805 2024-02-19T21:54:34.801 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.801 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:34.801 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.801 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.25952.0:26142 11.6 e499/492 11:64a58719:::benchmark_data_smithi080_184406_object26141:head v 499'1693, mlcod=499'1690)", 2024-02-19T21:54:34.801 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:54:10.167894+0000", 2024-02-19T21:54:34.801 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.498628789000001, 2024-02-19T21:54:34.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.10991920299999999, 2024-02-19T21:54:34.801 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:54:34.801 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:54:34.801 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:54:34.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:54:34.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:10.167894+0000", 2024-02-19T21:54:34.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:54:34.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:54:34.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:10.167894+0000", 2024-02-19T21:54:34.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:54:34.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:54:34.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:10.167893+0000", 2024-02-19T21:54:34.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0976e-05 2024-02-19T21:54:34.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:54:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:10.167914+0000", 2024-02-19T21:54:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.1060064 2024-02-19T21:54:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:54:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:10.273921+0000", 2024-02-19T21:54:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1700000000000003e-06 2024-02-19T21:54:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:54:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:10.273930+0000", 2024-02-19T21:54:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001107699 2024-02-19T21:54:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:10.275037+0000", 2024-02-19T21:54:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7405e-05 2024-02-19T21:54:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:54:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:10.275055+0000", 2024-02-19T21:54:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027385270000000001 2024-02-19T21:54:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:54:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:10.277793+0000", 2024-02-19T21:54:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9762000000000002e-05 2024-02-19T21:54:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:54:34.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:10.277813+0000", 2024-02-19T21:54:34.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.10991920299999999 2024-02-19T21:54:34.805 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.805 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:34.805 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.805 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:34.805 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:34.805 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:54:34.859 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:34.900 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:54:34.905 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:34.906 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:54:35.007 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:54:35.017 INFO:teuthology.orchestra.run.smithi080.stderr:set 2.10 pg_upmap_items mapping to [5->3,6->7,1->4] 2024-02-19T21:54:35.066 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:35.096 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:54:35.099 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:35.099 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:54:35.114 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 35 16 64460 64444 115.024 74.125 0.0109136 0.00868849 2024-02-19T21:54:35.200 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:54:35.225 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:33.252798+0000 mgr.y (mgr.14514) 841 : cluster [DBG] pgmap v1089: 138 pgs: 138 active+clean; 3.6 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 650 B/s rd, 65 MiB/s wr, 1.04k op/s 2024-02-19T21:54:35.225 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:33.985835+0000 mon.a (mon.0) 1916 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:54:35.225 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:34.086283+0000 mon.a (mon.0) 1917 : audit [INF] from='client.? 172.21.15.80:0/838111995' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "2.10", "id": [5, 3, 6, 7, 1, 4]}]: dispatch 2024-02-19T21:54:35.227 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:33.252798+0000 mgr.y (mgr.14514) 841 : cluster [DBG] pgmap v1089: 138 pgs: 138 active+clean; 3.6 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 650 B/s rd, 65 MiB/s wr, 1.04k op/s 2024-02-19T21:54:35.227 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:33.985835+0000 mon.a (mon.0) 1916 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:54:35.227 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:34.086283+0000 mon.a (mon.0) 1917 : audit [INF] from='client.? 172.21.15.80:0/838111995' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "2.10", "id": [5, 3, 6, 7, 1, 4]}]: dispatch 2024-02-19T21:54:35.263 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:33.252798+0000 mgr.y (mgr.14514) 841 : cluster [DBG] pgmap v1089: 138 pgs: 138 active+clean; 3.6 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 650 B/s rd, 65 MiB/s wr, 1.04k op/s 2024-02-19T21:54:35.263 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:33.985835+0000 mon.a (mon.0) 1916 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:54:35.263 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:34.086283+0000 mon.a (mon.0) 1917 : audit [INF] from='client.? 172.21.15.80:0/838111995' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "2.10", "id": [5, 3, 6, 7, 1, 4]}]: dispatch 2024-02-19T21:54:35.264 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:35.297 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:54:35.300 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:35.301 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:54:35.402 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:54:35.450 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:35.470 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:54:35.472 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:35.472 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:54:35.529 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:54:35.573 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:54:35.622 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:35.655 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:54:35.658 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:35.658 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:54:35.759 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:54:35.817 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:36.012 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:54:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:54:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:54:36.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:34.927932+0000 osd.3 (osd.3) 246 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:54:36.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:34.927995+0000 osd.3 (osd.3) 247 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:54:36.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:35.004175+0000 mon.a (mon.0) 1918 : audit [INF] from='client.? 172.21.15.80:0/838111995' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "2.10", "id": [5, 3, 6, 7, 1, 4]}]': finished 2024-02-19T21:54:36.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:35.004241+0000 mon.a (mon.0) 1919 : cluster [DBG] osdmap e507: 8 total, 8 up, 8 in 2024-02-19T21:54:36.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:35.390723+0000 mon.a (mon.0) 1920 : cluster [DBG] osdmap e508: 8 total, 8 up, 8 in 2024-02-19T21:54:36.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:34.927932+0000 osd.3 (osd.3) 246 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:54:36.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:34.927995+0000 osd.3 (osd.3) 247 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:54:36.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:35.004175+0000 mon.a (mon.0) 1918 : audit [INF] from='client.? 172.21.15.80:0/838111995' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "2.10", "id": [5, 3, 6, 7, 1, 4]}]': finished 2024-02-19T21:54:36.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:35.004241+0000 mon.a (mon.0) 1919 : cluster [DBG] osdmap e507: 8 total, 8 up, 8 in 2024-02-19T21:54:36.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:35.390723+0000 mon.a (mon.0) 1920 : cluster [DBG] osdmap e508: 8 total, 8 up, 8 in 2024-02-19T21:54:36.114 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 36 16 65544 65528 113.712 67.75 0.0398355 0.00878214 2024-02-19T21:54:36.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:34.927932+0000 osd.3 (osd.3) 246 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:54:36.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:34.927995+0000 osd.3 (osd.3) 247 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:54:36.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:35.004175+0000 mon.a (mon.0) 1918 : audit [INF] from='client.? 172.21.15.80:0/838111995' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "2.10", "id": [5, 3, 6, 7, 1, 4]}]': finished 2024-02-19T21:54:36.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:35.004241+0000 mon.a (mon.0) 1919 : cluster [DBG] osdmap e507: 8 total, 8 up, 8 in 2024-02-19T21:54:36.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:35.390723+0000 mon.a (mon.0) 1920 : cluster [DBG] osdmap e508: 8 total, 8 up, 8 in 2024-02-19T21:54:37.115 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 37 16 66876 66860 112.888 83.25 0.0154039 0.00885402 2024-02-19T21:54:37.157 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.3 dump_ops_in_flight 2024-02-19T21:54:37.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:35.253585+0000 mgr.y (mgr.14514) 842 : cluster [DBG] pgmap v1091: 138 pgs: 138 active+clean; 3.8 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 826 B/s rd, 105 MiB/s wr, 1.68k op/s 2024-02-19T21:54:37.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:35.253585+0000 mgr.y (mgr.14514) 842 : cluster [DBG] pgmap v1091: 138 pgs: 138 active+clean; 3.8 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 826 B/s rd, 105 MiB/s wr, 1.68k op/s 2024-02-19T21:54:37.349 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:35.253585+0000 mgr.y (mgr.14514) 842 : cluster [DBG] pgmap v1091: 138 pgs: 138 active+clean; 3.8 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 826 B/s rd, 105 MiB/s wr, 1.68k op/s 2024-02-19T21:54:38.114 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 38 16 68116 68100 111.957 77.5 0.00914654 0.00892658 2024-02-19T21:54:38.296 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:54:38.302 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:38.302 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:54:38.403 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:54:38.457 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:38.795 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:54:38.919 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:54:38.925 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:38.926 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:54:39.026 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:54:39.066 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:39.097 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:54:39.106 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:39.106 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:54:39.114 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 39 16 69333 69317 111.037 76.0625 0.013826 0.00900158 2024-02-19T21:54:39.207 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:54:39.271 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:39.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:37.255753+0000 mgr.y (mgr.14514) 843 : cluster [DBG] pgmap v1093: 138 pgs: 138 active+clean; 3.9 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 746 B/s rd, 63 MiB/s wr, 1.00k op/s 2024-02-19T21:54:39.319 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:37.255753+0000 mgr.y (mgr.14514) 843 : cluster [DBG] pgmap v1093: 138 pgs: 138 active+clean; 3.9 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 746 B/s rd, 63 MiB/s wr, 1.00k op/s 2024-02-19T21:54:39.320 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:37.255753+0000 mgr.y (mgr.14514) 843 : cluster [DBG] pgmap v1093: 138 pgs: 138 active+clean; 3.9 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 746 B/s rd, 63 MiB/s wr, 1.00k op/s 2024-02-19T21:54:39.436 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:54:39.439 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:39.439 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:54:39.540 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:54:39.620 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:39.680 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:54:39.682 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:39.683 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:54:39.783 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:54:39.837 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:39.867 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:54:39.871 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:39.872 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:54:39.973 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:54:40.017 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:40.062 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:54:40.067 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:40.067 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:54:40.094 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-02-19T21:54:40.114 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:2024-02-19T21:54:40.116159+0000 min lat: 0.0011498 max lat: 0.168715 avg lat: 0.00908262 2024-02-19T21:54:40.114 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-19T21:54:40.115 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 40 16 70472 70456 110.041 71.1875 0.00882138 0.00908262 2024-02-19T21:54:40.168 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:54:40.222 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:39.924628+0000 mon.b (mon.1) 76 : audit [INF] from='client.? 172.21.15.80:0/613850969' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:54:40.222 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:39.925242+0000 mon.a (mon.0) 1921 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:54:40.225 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:40.256 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:54:40.261 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:40.262 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:54:40.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:39.924628+0000 mon.b (mon.1) 76 : audit [INF] from='client.? 172.21.15.80:0/613850969' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:54:40.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:39.925242+0000 mon.a (mon.0) 1921 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:54:40.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:39.924628+0000 mon.b (mon.1) 76 : audit [INF] from='client.? 172.21.15.80:0/613850969' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:54:40.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:39.925242+0000 mon.a (mon.0) 1921 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:54:40.363 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:54:40.417 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:40.450 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:54:40.452 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:40.453 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:54:40.553 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:54:40.626 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:40.654 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:54:40.657 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:40.657 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:54:40.758 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:54:40.826 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:40.855 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:54:40.859 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:40.860 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:54:40.961 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:54:41.010 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:41.042 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:54:41.048 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:41.048 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:54:41.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:39.256566+0000 mgr.y (mgr.14514) 844 : cluster [DBG] pgmap v1094: 138 pgs: 138 active+clean; 4.0 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 639 B/s rd, 57 MiB/s wr, 914 op/s 2024-02-19T21:54:41.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:40.047603+0000 mon.a (mon.0) 1922 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:54:41.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:40.070007+0000 mon.a (mon.0) 1923 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:54:41.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:40.070074+0000 mon.a (mon.0) 1924 : cluster [DBG] osdmap e509: 8 total, 8 up, 8 in 2024-02-19T21:54:41.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:40.386532+0000 mon.a (mon.0) 1925 : cluster [DBG] osdmap e510: 8 total, 8 up, 8 in 2024-02-19T21:54:41.067 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:54:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:54:40] "GET /metrics HTTP/1.1" 200 176769 "" "Prometheus/2.33.4" 2024-02-19T21:54:41.115 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 41 16 71610 71594 109.091 71.125 0.010552 0.00916207 2024-02-19T21:54:41.149 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:54:41.207 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:41.239 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:54:41.241 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:41.242 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:54:41.306 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:54:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:54:41.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:39.256566+0000 mgr.y (mgr.14514) 844 : cluster [DBG] pgmap v1094: 138 pgs: 138 active+clean; 4.0 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 639 B/s rd, 57 MiB/s wr, 914 op/s 2024-02-19T21:54:41.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:40.047603+0000 mon.a (mon.0) 1922 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:54:41.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:40.070007+0000 mon.a (mon.0) 1923 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:54:41.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:40.070074+0000 mon.a (mon.0) 1924 : cluster [DBG] osdmap e509: 8 total, 8 up, 8 in 2024-02-19T21:54:41.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:40.386532+0000 mon.a (mon.0) 1925 : cluster [DBG] osdmap e510: 8 total, 8 up, 8 in 2024-02-19T21:54:41.343 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:54:41.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:39.256566+0000 mgr.y (mgr.14514) 844 : cluster [DBG] pgmap v1094: 138 pgs: 138 active+clean; 4.0 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 639 B/s rd, 57 MiB/s wr, 914 op/s 2024-02-19T21:54:41.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:40.047603+0000 mon.a (mon.0) 1922 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:54:41.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:40.070007+0000 mon.a (mon.0) 1923 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:54:41.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:40.070074+0000 mon.a (mon.0) 1924 : cluster [DBG] osdmap e509: 8 total, 8 up, 8 in 2024-02-19T21:54:41.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:40.386532+0000 mon.a (mon.0) 1925 : cluster [DBG] osdmap e510: 8 total, 8 up, 8 in 2024-02-19T21:54:41.489 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:42.116 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 42 16 72532 72516 107.863 57.625 0.00850444 0.00926628 2024-02-19T21:54:42.831 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:54:42.831 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-02-19T21:54:42.831 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:42.831 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:73064 11.a 11:547deb26:::benchmark_data_smithi080_184406_object73063:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e510)", 2024-02-19T21:54:42.831 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:54:42.575132+0000", 2024-02-19T21:54:42.831 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0019540780000000002, 2024-02-19T21:54:42.831 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0020057550000000001, 2024-02-19T21:54:42.831 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:54:42.832 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:54:42.832 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:54:42.832 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:54:42.832 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:54:42.832 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 73064 2024-02-19T21:54:42.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:42.832 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:54:42.832 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:42.832 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:54:42.832 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:42.575132+0000", 2024-02-19T21:54:42.832 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:54:42.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:42.832 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:42.833 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:54:42.833 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:42.575132+0000", 2024-02-19T21:54:42.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999971 2024-02-19T21:54:42.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:42.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:42.833 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:54:42.833 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:42.575130+0000", 2024-02-19T21:54:42.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1973999999999999e-05 2024-02-19T21:54:42.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:42.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:42.833 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:54:42.833 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:42.575202+0000", 2024-02-19T21:54:42.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9592000000000001e-05 2024-02-19T21:54:42.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:42.834 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:42.834 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:54:42.834 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:42.575221+0000", 2024-02-19T21:54:42.834 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8270000000000004e-06 2024-02-19T21:54:42.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:42.834 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:42.834 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:54:42.834 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:42.575230+0000", 2024-02-19T21:54:42.834 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9168e-05 2024-02-19T21:54:42.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:42.834 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:42.834 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:54:42.834 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:42.575289+0000", 2024-02-19T21:54:42.835 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014639399999999999 2024-02-19T21:54:42.835 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:42.835 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:42.835 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:54:42.835 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:42.575436+0000", 2024-02-19T21:54:42.835 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000169774 2024-02-19T21:54:42.835 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:42.835 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:42.835 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:54:42.835 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:42.575605+0000", 2024-02-19T21:54:42.835 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00047290599999999999 2024-02-19T21:54:42.835 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:42.835 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:42.836 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:42.836 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:42.836 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:54:42.836 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 1 2024-02-19T21:54:42.836 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:54:43.039 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:54:43.059 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:54:43.062 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:43.062 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:54:43.116 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 43 16 73705 73689 107.06 73.3125 0.0183934 0.00933573 2024-02-19T21:54:43.164 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:54:43.223 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:43.282 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:54:43.285 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:43.286 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:54:43.330 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:41.231785+0000 mgr.y (mgr.14514) 845 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:54:43.330 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:41.256950+0000 mgr.y (mgr.14514) 846 : cluster [DBG] pgmap v1097: 138 pgs: 138 active+clean; 4.3 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.7 KiB/s rd, 84 MiB/s wr, 1.35k op/s 2024-02-19T21:54:43.330 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:41.231785+0000 mgr.y (mgr.14514) 845 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:54:43.330 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:41.256950+0000 mgr.y (mgr.14514) 846 : cluster [DBG] pgmap v1097: 138 pgs: 138 active+clean; 4.3 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.7 KiB/s rd, 84 MiB/s wr, 1.35k op/s 2024-02-19T21:54:43.387 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:54:43.443 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:41.231785+0000 mgr.y (mgr.14514) 845 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:54:43.443 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:41.256950+0000 mgr.y (mgr.14514) 846 : cluster [DBG] pgmap v1097: 138 pgs: 138 active+clean; 4.3 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.7 KiB/s rd, 84 MiB/s wr, 1.35k op/s 2024-02-19T21:54:43.448 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:43.495 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:54:43.502 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:43.502 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:54:43.603 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:54:43.653 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:43.781 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 4, 5, 6, 7, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 6, 7, 2] 2024-02-19T21:54:43.782 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:54:43.782 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-02-19T21:54:43.782 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd dump -f json-pretty 2024-02-19T21:54:43.833 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:54:43.845 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:43.846 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:54:43.861 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.3 dump_blocked_ops 2024-02-19T21:54:43.947 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:54:44.021 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:44.116 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 44 16 74777 74761 106.149 67 0.0190757 0.00941504 2024-02-19T21:54:44.314 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:54:44.323 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:44.323 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:54:44.424 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:54:44.478 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:44.766 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset noscrub 2024-02-19T21:54:45.116 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 45 16 75891 75875 105.337 69.625 0.0119911 0.00948841 2024-02-19T21:54:45.153 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:54:45.157 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:45.157 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:54:45.258 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:54:45.259 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:54:45.407 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:43.257691+0000 mgr.y (mgr.14514) 847 : cluster [DBG] pgmap v1098: 138 pgs: 138 active+clean; 4.3 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 650 B/s rd, 57 MiB/s wr, 915 op/s 2024-02-19T21:54:45.413 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:45.421 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:43.257691+0000 mgr.y (mgr.14514) 847 : cluster [DBG] pgmap v1098: 138 pgs: 138 active+clean; 4.3 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 650 B/s rd, 57 MiB/s wr, 915 op/s 2024-02-19T21:54:45.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:43.257691+0000 mgr.y (mgr.14514) 847 : cluster [DBG] pgmap v1098: 138 pgs: 138 active+clean; 4.3 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 650 B/s rd, 57 MiB/s wr, 915 op/s 2024-02-19T21:54:46.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:54:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:54:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:54:46.117 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 46 16 76859 76843 104.363 60.5 0.0140646 0.00957721 2024-02-19T21:54:46.278 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:54:46.286 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:46.287 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:54:46.300 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:54:46.388 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:54:46.431 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:46.460 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:54:46.466 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:46.466 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:54:46.567 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:54:46.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:45.258192+0000 mgr.y (mgr.14514) 848 : cluster [DBG] pgmap v1099: 138 pgs: 138 active+clean; 4.5 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 639 B/s rd, 76 MiB/s wr, 1.22k op/s 2024-02-19T21:54:46.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:45.258192+0000 mgr.y (mgr.14514) 848 : cluster [DBG] pgmap v1099: 138 pgs: 138 active+clean; 4.5 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 639 B/s rd, 76 MiB/s wr, 1.22k op/s 2024-02-19T21:54:46.611 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:46.647 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:54:46.651 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:45.258192+0000 mgr.y (mgr.14514) 848 : cluster [DBG] pgmap v1099: 138 pgs: 138 active+clean; 4.5 GiB data, 19 GiB used, 697 GiB / 715 GiB avail; 639 B/s rd, 76 MiB/s wr, 1.22k op/s 2024-02-19T21:54:46.652 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:46.652 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:54:46.753 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:54:46.792 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:46.802 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:54:46.815 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:54:46.816 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:54:46.819 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:46.820 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:54:46.850 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:54:46.881 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:54:46.921 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:54:46.925 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:54:46.960 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:54:46.970 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:46.989 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:54:46.996 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:54:47.003 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:47.004 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:54:47.027 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:54:47.063 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:54:47.069 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:54:47.069 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:54:47.069 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:54:47.069 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:54:47.069 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:54:47.069 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:54:47.069 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:54:47.069 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:54:47.105 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:54:47.116 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 47 16 77899 77883 103.525 65 0.0120934 0.00965505 2024-02-19T21:54:47.160 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:47.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:46.748519+0000 mon.b (mon.1) 77 : audit [DBG] from='client.? 172.21.15.80:0/1913747403' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:54:47.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:46.748519+0000 mon.b (mon.1) 77 : audit [DBG] from='client.? 172.21.15.80:0/1913747403' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:54:47.825 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:54:47.825 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:46.748519+0000 mon.b (mon.1) 77 : audit [DBG] from='client.? 172.21.15.80:0/1913747403' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:54:47.833 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:47.834 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:54:47.934 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:54:47.994 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:48.033 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:54:48.038 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:48.038 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:54:48.118 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 48 16 79027 79011 102.834 70.5 0.0140581 0.00971996 2024-02-19T21:54:48.139 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:54:48.183 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:48.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:47.258699+0000 mgr.y (mgr.14514) 849 : cluster [DBG] pgmap v1100: 138 pgs: 138 active+clean; 4.6 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.2 KiB/s rd, 83 MiB/s wr, 1.32k op/s 2024-02-19T21:54:48.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:47.258699+0000 mgr.y (mgr.14514) 849 : cluster [DBG] pgmap v1100: 138 pgs: 138 active+clean; 4.6 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.2 KiB/s rd, 83 MiB/s wr, 1.32k op/s 2024-02-19T21:54:48.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:47.258699+0000 mgr.y (mgr.14514) 849 : cluster [DBG] pgmap v1100: 138 pgs: 138 active+clean; 4.6 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.2 KiB/s rd, 83 MiB/s wr, 1.32k op/s 2024-02-19T21:54:49.118 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 49 16 80181 80165 102.207 72.125 0.0138377 0.00977918 2024-02-19T21:54:49.293 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:54:49.301 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:49.302 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:54:49.403 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:54:49.466 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:49.601 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:54:49.605 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:49.605 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:54:49.706 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:54:49.754 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:49.838 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:54:49.840 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:49.841 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:54:49.943 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:54:49.989 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:50.026 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:54:50.030 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:50.030 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:54:50.119 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 50 16 81276 81260 101.532 68.4375 0.0146583 0.00984445 2024-02-19T21:54:50.131 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:54:50.185 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:50.227 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:54:50.234 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:50.234 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:54:50.335 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:54:50.393 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:50.420 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:54:50.423 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:50.423 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:54:50.435 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:49.241289+0000 osd.6 (osd.6) 264 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:54:50.435 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:49.241338+0000 osd.6 (osd.6) 265 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:54:50.435 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:49.259160+0000 mgr.y (mgr.14514) 850 : cluster [DBG] pgmap v1101: 138 pgs: 138 active+clean; 4.6 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.1 KiB/s rd, 66 MiB/s wr, 1.06k op/s 2024-02-19T21:54:50.435 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:49.433971+0000 mon.a (mon.0) 1926 : cluster [DBG] osdmap e511: 8 total, 8 up, 8 in 2024-02-19T21:54:50.435 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:50.391961+0000 mon.a (mon.0) 1927 : cluster [DBG] osdmap e512: 8 total, 8 up, 8 in 2024-02-19T21:54:50.524 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:54:50.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:49.241289+0000 osd.6 (osd.6) 264 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:54:50.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:49.241338+0000 osd.6 (osd.6) 265 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:54:50.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:49.259160+0000 mgr.y (mgr.14514) 850 : cluster [DBG] pgmap v1101: 138 pgs: 138 active+clean; 4.6 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.1 KiB/s rd, 66 MiB/s wr, 1.06k op/s 2024-02-19T21:54:50.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:49.433971+0000 mon.a (mon.0) 1926 : cluster [DBG] osdmap e511: 8 total, 8 up, 8 in 2024-02-19T21:54:50.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:50.391961+0000 mon.a (mon.0) 1927 : cluster [DBG] osdmap e512: 8 total, 8 up, 8 in 2024-02-19T21:54:50.573 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:50.773 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:54:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:54:50] "GET /metrics HTTP/1.1" 200 176773 "" "Prometheus/2.33.4" 2024-02-19T21:54:50.773 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:49.241289+0000 osd.6 (osd.6) 264 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:54:50.773 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:49.241338+0000 osd.6 (osd.6) 265 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:54:50.773 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:49.259160+0000 mgr.y (mgr.14514) 850 : cluster [DBG] pgmap v1101: 138 pgs: 138 active+clean; 4.6 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.1 KiB/s rd, 66 MiB/s wr, 1.06k op/s 2024-02-19T21:54:50.773 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:49.433971+0000 mon.a (mon.0) 1926 : cluster [DBG] osdmap e511: 8 total, 8 up, 8 in 2024-02-19T21:54:50.774 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:50.391961+0000 mon.a (mon.0) 1927 : cluster [DBG] osdmap e512: 8 total, 8 up, 8 in 2024-02-19T21:54:51.119 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 51 16 82386 82370 100.902 69.375 0.0135165 0.00990649 2024-02-19T21:54:51.145 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:54:51.150 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:51.151 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:54:51.251 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:54:51.296 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:51.326 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:54:51.561 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:50.218829+0000 osd.1 (osd.1) 264 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:54:51.562 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:50.218873+0000 osd.1 (osd.1) 265 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:54:51.562 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:50.557389+0000 mon.a (mon.0) 1928 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 1]}]: dispatch 2024-02-19T21:54:51.562 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:50.557632+0000 mon.a (mon.0) 1929 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2024-02-19T21:54:51.562 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:50.557815+0000 mon.a (mon.0) 1930 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-19T21:54:51.562 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:54:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:54:51.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:50.218829+0000 osd.1 (osd.1) 264 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:54:51.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:50.218873+0000 osd.1 (osd.1) 265 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:54:51.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:50.557389+0000 mon.a (mon.0) 1928 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 1]}]: dispatch 2024-02-19T21:54:51.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:50.557632+0000 mon.a (mon.0) 1929 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2024-02-19T21:54:51.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:50.557815+0000 mon.a (mon.0) 1930 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-19T21:54:51.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:50.218829+0000 osd.1 (osd.1) 264 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:54:51.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:50.218873+0000 osd.1 (osd.1) 265 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:54:51.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:50.557389+0000 mon.a (mon.0) 1928 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 1]}]: dispatch 2024-02-19T21:54:51.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:50.557632+0000 mon.a (mon.0) 1929 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2024-02-19T21:54:51.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:50.557815+0000 mon.a (mon.0) 1930 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-19T21:54:52.119 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 52 16 83315 83299 100.078 58.0625 0.00963043 0.00998724 2024-02-19T21:54:52.478 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:54:52.487 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:52.487 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:54:52.588 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:54:52.638 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:52.710 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:54:52.715 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:51.241757+0000 mgr.y (mgr.14514) 851 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:54:52.715 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:51.259642+0000 mgr.y (mgr.14514) 852 : cluster [DBG] pgmap v1104: 138 pgs: 138 active+clean; 4.9 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 79 MiB/s wr, 1.26k op/s 2024-02-19T21:54:52.715 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:51.448422+0000 mon.a (mon.0) 1931 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 1]}]': finished 2024-02-19T21:54:52.715 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:51.448504+0000 mon.a (mon.0) 1932 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]': finished 2024-02-19T21:54:52.716 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:51.448586+0000 mon.a (mon.0) 1933 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]': finished 2024-02-19T21:54:52.716 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:51.448654+0000 mon.a (mon.0) 1934 : cluster [DBG] osdmap e513: 8 total, 8 up, 8 in 2024-02-19T21:54:52.716 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:51.241757+0000 mgr.y (mgr.14514) 851 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:54:52.716 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:51.259642+0000 mgr.y (mgr.14514) 852 : cluster [DBG] pgmap v1104: 138 pgs: 138 active+clean; 4.9 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 79 MiB/s wr, 1.26k op/s 2024-02-19T21:54:52.716 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:51.448422+0000 mon.a (mon.0) 1931 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 1]}]': finished 2024-02-19T21:54:52.716 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:51.448504+0000 mon.a (mon.0) 1932 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]': finished 2024-02-19T21:54:52.716 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:51.448586+0000 mon.a (mon.0) 1933 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]': finished 2024-02-19T21:54:52.716 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:51.448654+0000 mon.a (mon.0) 1934 : cluster [DBG] osdmap e513: 8 total, 8 up, 8 in 2024-02-19T21:54:52.717 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:52.717 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:54:52.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:51.241757+0000 mgr.y (mgr.14514) 851 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:54:52.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:51.259642+0000 mgr.y (mgr.14514) 852 : cluster [DBG] pgmap v1104: 138 pgs: 138 active+clean; 4.9 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 79 MiB/s wr, 1.26k op/s 2024-02-19T21:54:52.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:51.448422+0000 mon.a (mon.0) 1931 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 1]}]': finished 2024-02-19T21:54:52.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:51.448504+0000 mon.a (mon.0) 1932 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]': finished 2024-02-19T21:54:52.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:51.448586+0000 mon.a (mon.0) 1933 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]': finished 2024-02-19T21:54:52.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:51.448654+0000 mon.a (mon.0) 1934 : cluster [DBG] osdmap e513: 8 total, 8 up, 8 in 2024-02-19T21:54:52.818 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:54:52.885 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:52.912 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:54:52.916 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:52.916 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:54:53.019 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:54:53.077 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:53.119 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 53 16 84353 84337 99.4137 64.875 0.0278048 0.0100538 2024-02-19T21:54:53.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:52.451477+0000 mon.a (mon.0) 1935 : cluster [DBG] osdmap e514: 8 total, 8 up, 8 in 2024-02-19T21:54:53.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:53.177892+0000 mon.a (mon.0) 1936 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:54:53.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:52.451477+0000 mon.a (mon.0) 1935 : cluster [DBG] osdmap e514: 8 total, 8 up, 8 in 2024-02-19T21:54:53.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:53.177892+0000 mon.a (mon.0) 1936 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:54:53.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:52.451477+0000 mon.a (mon.0) 1935 : cluster [DBG] osdmap e514: 8 total, 8 up, 8 in 2024-02-19T21:54:53.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:53.177892+0000 mon.a (mon.0) 1936 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:54:53.930 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:54:53.930 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:54:54.119 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 54 16 85387 85371 98.7696 64.625 0.00602931 0.0101201 2024-02-19T21:54:54.253 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:54:54.258 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:54.259 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:54:54.359 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:54:54.413 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:54.525 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:53.260045+0000 mgr.y (mgr.14514) 853 : cluster [DBG] pgmap v1107: 138 pgs: 2 peering, 136 active+clean; 5.0 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 84 MiB/s wr, 1.34k op/s 2024-02-19T21:54:54.525 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:53.260045+0000 mgr.y (mgr.14514) 853 : cluster [DBG] pgmap v1107: 138 pgs: 2 peering, 136 active+clean; 5.0 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 84 MiB/s wr, 1.34k op/s 2024-02-19T21:54:54.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:53.260045+0000 mgr.y (mgr.14514) 853 : cluster [DBG] pgmap v1107: 138 pgs: 2 peering, 136 active+clean; 5.0 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 84 MiB/s wr, 1.34k op/s 2024-02-19T21:54:55.064 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.3 dump_historic_ops 2024-02-19T21:54:55.119 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 55 16 86413 86397 98.1398 64.125 0.014038 0.0101851 2024-02-19T21:54:55.321 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:54:55.681 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:54:55.681 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:54:55.682 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 514, 2024-02-19T21:54:55.682 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "6f763558-cf6d-11ee-95bb-87774f69a715", 2024-02-19T21:54:55.682 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2024-02-19T21:26:16.880265+0000", 2024-02-19T21:54:55.682 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2024-02-19T21:54:52.444127+0000", 2024-02-19T21:54:55.682 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2024-02-19T21:49:07.286446+0000", 2024-02-19T21:54:55.682 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2024-02-19T21:53:44.626155+0000", 2024-02-19T21:54:55.682 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-02-19T21:54:55.682 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5806080, 2024-02-19T21:54:55.682 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2024-02-19T21:54:55.682 INFO:teuthology.orchestra.run.smithi080.stdout: "nodeep-scrub", 2024-02-19T21:54:55.682 INFO:teuthology.orchestra.run.smithi080.stdout: "noscrub", 2024-02-19T21:54:55.682 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2024-02-19T21:54:55.682 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2024-02-19T21:54:55.682 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2024-02-19T21:54:55.683 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2024-02-19T21:54:55.683 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:54:55.683 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 19, 2024-02-19T21:54:55.683 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2024-02-19T21:54:55.683 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-02-19T21:54:55.683 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2024-02-19T21:54:55.683 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2024-02-19T21:54:55.683 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 11, 2024-02-19T21:54:55.683 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2024-02-19T21:54:55.683 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "luminous", 2024-02-19T21:54:55.683 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "luminous", 2024-02-19T21:54:55.683 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "pacific", 2024-02-19T21:54:55.683 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2024-02-19T21:54:55.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.684 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2024-02-19T21:54:55.684 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "device_health_metrics", 2024-02-19T21:54:55.684 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:30:05.947623+0000", 2024-02-19T21:54:55.684 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:54:55.684 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:54:55.684 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:54:55.684 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:54:55.684 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:54:55.684 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:54:55.684 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:54:55.684 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:54:55.684 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:54:55.685 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:54:55.685 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:54:55.685 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:54:55.685 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 1, 2024-02-19T21:54:55.685 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 1, 2024-02-19T21:54:55.685 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 1, 2024-02-19T21:54:55.685 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 1, 2024-02-19T21:54:55.685 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 1, 2024-02-19T21:54:55.685 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:54:55.685 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:54:55.685 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:54:55.685 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:54:55.685 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:54:55.686 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:54:55.686 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:54:55.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.686 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "74", 2024-02-19T21:54:55.686 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:54:55.686 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:54:55.686 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:54:55.686 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:54:55.686 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:54:55.686 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:54:55.686 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:54:55.686 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:54:55.687 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:54:55.687 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:54:55.687 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:54:55.687 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:54:55.687 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:54:55.687 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:54:55.687 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:54:55.687 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:54:55.687 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:54:55.687 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:54:55.687 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:54:55.687 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:54:55.688 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:54:55.688 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:54:55.688 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:54:55.688 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:54:55.688 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:54:55.688 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:54:55.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.688 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:54:55.688 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:54:55.688 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:54:55.688 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:54:55.688 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:54:55.688 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:54:55.689 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:54:55.689 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:54:55.689 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:54:55.689 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:54:55.689 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:54:55.689 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2024-02-19T21:54:55.689 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_max": 32, 2024-02-19T21:54:55.689 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 1 2024-02-19T21:54:55.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.689 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:54:55.689 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_devicehealth": {} 2024-02-19T21:54:55.689 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.690 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 2, 2024-02-19T21:54:55.690 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": ".rgw.root", 2024-02-19T21:54:55.690 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:22.082250+0000", 2024-02-19T21:54:55.690 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:54:55.690 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:54:55.690 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:54:55.690 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:54:55.690 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:54:55.690 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:54:55.690 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:54:55.690 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:54:55.690 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:54:55.691 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:54:55.691 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:54:55.691 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:54:55.691 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:54:55.691 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:54:55.691 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:54:55.691 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:54:55.691 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:54:55.691 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:54:55.691 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:54:55.691 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:54:55.691 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:54:55.691 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:54:55.691 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:54:55.692 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:54:55.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.692 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "60", 2024-02-19T21:54:55.692 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:54:55.692 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:54:55.692 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:54:55.692 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:54:55.692 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:54:55.692 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:54:55.692 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:54:55.692 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:54:55.692 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:54:55.692 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:54:55.692 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:54:55.693 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:54:55.693 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:54:55.693 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:54:55.693 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:54:55.693 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:54:55.693 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:54:55.693 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:54:55.693 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:54:55.693 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:54:55.693 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:54:55.693 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:54:55.693 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:54:55.693 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:54:55.693 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:54:55.693 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:54:55.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.694 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:54:55.694 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:54:55.694 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:54:55.694 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:54:55.694 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:54:55.694 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:54:55.694 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:54:55.694 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:54:55.694 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:54:55.694 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:54:55.694 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:54:55.694 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:54:55.694 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:54:55.695 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:54:55.695 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.695 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 3, 2024-02-19T21:54:55.695 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "iscsi", 2024-02-19T21:54:55.695 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:22.333164+0000", 2024-02-19T21:54:55.695 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:54:55.695 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:54:55.695 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:54:55.695 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:54:55.695 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:54:55.696 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:54:55.696 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:54:55.696 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:54:55.696 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:54:55.696 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:54:55.696 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:54:55.696 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:54:55.696 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 3, 2024-02-19T21:54:55.696 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 3, 2024-02-19T21:54:55.696 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 3, 2024-02-19T21:54:55.696 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 3, 2024-02-19T21:54:55.696 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 3, 2024-02-19T21:54:55.696 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:54:55.696 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:54:55.696 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:54:55.697 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:54:55.697 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:54:55.697 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:54:55.697 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:54:55.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.697 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "62", 2024-02-19T21:54:55.697 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:54:55.697 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:54:55.697 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:54:55.697 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:54:55.697 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:54:55.697 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:54:55.697 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:54:55.697 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:54:55.697 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:54:55.698 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:54:55.698 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:54:55.698 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:54:55.698 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:54:55.698 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:54:55.698 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:54:55.698 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:54:55.698 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:54:55.698 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:54:55.698 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:54:55.698 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:54:55.698 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:54:55.698 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:54:55.698 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:54:55.699 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:54:55.699 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:54:55.699 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:54:55.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.699 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:54:55.699 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:54:55.699 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:54:55.699 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:54:55.699 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:54:55.699 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:54:55.699 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:54:55.699 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:54:55.699 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:54:55.699 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:54:55.700 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:54:55.700 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:54:55.700 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:54:55.700 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2024-02-19T21:54:55.700 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.700 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 4, 2024-02-19T21:54:55.700 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.log", 2024-02-19T21:54:55.700 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:23.632615+0000", 2024-02-19T21:54:55.700 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:54:55.700 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:54:55.700 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:54:55.700 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:54:55.701 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:54:55.701 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:54:55.701 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:54:55.701 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:54:55.701 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:54:55.701 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:54:55.701 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:54:55.701 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:54:55.701 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:54:55.701 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:54:55.701 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:54:55.701 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:54:55.701 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:54:55.701 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:54:55.701 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:54:55.702 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:54:55.702 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:54:55.702 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:54:55.702 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:54:55.702 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:54:55.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.702 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "62", 2024-02-19T21:54:55.702 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:54:55.702 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:54:55.702 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:54:55.702 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:54:55.702 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:54:55.702 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:54:55.702 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:54:55.702 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:54:55.703 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:54:55.703 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:54:55.703 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:54:55.703 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:54:55.703 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:54:55.703 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:54:55.703 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:54:55.703 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:54:55.703 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:54:55.703 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:54:55.703 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:54:55.703 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:54:55.703 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:54:55.704 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:54:55.704 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:54:55.704 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:54:55.704 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:54:55.704 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:54:55.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.704 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:54:55.704 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:54:55.704 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:54:55.704 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:54:55.704 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:54:55.704 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:54:55.704 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:54:55.704 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:54:55.705 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:54:55.705 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:54:55.705 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:54:55.705 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:54:55.705 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:54:55.705 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:54:55.705 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.705 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 5, 2024-02-19T21:54:55.705 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.control", 2024-02-19T21:54:55.705 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:25.600876+0000", 2024-02-19T21:54:55.705 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:54:55.705 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:54:55.706 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:54:55.706 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:54:55.706 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:54:55.706 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:54:55.706 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:54:55.706 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:54:55.706 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:54:55.706 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:54:55.706 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:54:55.706 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:54:55.706 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 22, 2024-02-19T21:54:55.706 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 22, 2024-02-19T21:54:55.706 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 22, 2024-02-19T21:54:55.706 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 22, 2024-02-19T21:54:55.707 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 22, 2024-02-19T21:54:55.707 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:54:55.707 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "5.16", 2024-02-19T21:54:55.707 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 298, 2024-02-19T21:54:55.707 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 297, 2024-02-19T21:54:55.707 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 297, 2024-02-19T21:54:55.707 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:54:55.707 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:54:55.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.707 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "325", 2024-02-19T21:54:55.707 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:54:55.707 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "298", 2024-02-19T21:54:55.707 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "296", 2024-02-19T21:54:55.707 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:54:55.708 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:54:55.708 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:54:55.708 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:54:55.708 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:54:55.708 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:54:55.708 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:54:55.708 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:54:55.708 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:54:55.708 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:54:55.708 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:54:55.708 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:54:55.708 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:54:55.708 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:54:55.708 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:54:55.709 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:54:55.709 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:54:55.709 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:54:55.709 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:54:55.709 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:54:55.709 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:54:55.709 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:54:55.709 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:54:55.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.709 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:54:55.709 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:54:55.709 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:54:55.709 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:54:55.709 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:54:55.709 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:54:55.709 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:54:55.710 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:54:55.710 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:54:55.710 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:54:55.710 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:54:55.710 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:54:55.710 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:54:55.710 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:54:55.710 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.710 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 6, 2024-02-19T21:54:55.710 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.meta", 2024-02-19T21:54:55.710 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:32:27.661242+0000", 2024-02-19T21:54:55.710 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:54:55.710 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:54:55.711 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:54:55.711 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:54:55.711 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:54:55.711 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:54:55.711 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:54:55.711 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:54:55.711 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:54:55.711 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:54:55.711 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:54:55.711 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:54:55.711 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-02-19T21:54:55.711 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-02-19T21:54:55.712 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-02-19T21:54:55.712 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-02-19T21:54:55.713 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-02-19T21:54:55.713 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:54:55.713 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "6.16", 2024-02-19T21:54:55.713 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 243, 2024-02-19T21:54:55.713 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 242, 2024-02-19T21:54:55.713 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 242, 2024-02-19T21:54:55.713 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:54:55.713 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:54:55.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.713 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "304", 2024-02-19T21:54:55.714 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:54:55.714 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "243", 2024-02-19T21:54:55.714 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "302", 2024-02-19T21:54:55.714 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:54:55.714 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:54:55.714 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:54:55.714 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:54:55.714 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:54:55.714 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:54:55.714 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:54:55.714 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:54:55.714 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:54:55.715 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:54:55.715 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:54:55.715 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:54:55.715 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:54:55.715 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:54:55.715 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:54:55.715 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:54:55.715 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:54:55.715 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:54:55.715 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:54:55.715 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:54:55.715 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:54:55.716 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:54:55.716 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:54:55.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.716 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:54:55.716 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:54:55.716 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:54:55.716 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:54:55.716 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:54:55.716 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:54:55.716 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:54:55.716 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:54:55.717 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:54:55.717 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:54:55.717 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:54:55.717 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2024-02-19T21:54:55.717 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4 2024-02-19T21:54:55.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.717 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:54:55.717 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-02-19T21:54:55.717 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.718 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 11, 2024-02-19T21:54:55.718 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "unique_pool_4", 2024-02-19T21:54:55.718 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-02-19T21:53:44.625837+0000", 2024-02-19T21:54:55.718 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-02-19T21:54:55.718 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-02-19T21:54:55.718 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-02-19T21:54:55.718 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 3, 2024-02-19T21:54:55.718 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 2, 2024-02-19T21:54:55.718 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-02-19T21:54:55.718 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-02-19T21:54:55.718 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-02-19T21:54:55.718 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-02-19T21:54:55.719 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-02-19T21:54:55.719 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-02-19T21:54:55.719 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-02-19T21:54:55.719 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 16, 2024-02-19T21:54:55.719 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 16, 2024-02-19T21:54:55.719 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 16, 2024-02-19T21:54:55.719 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 16, 2024-02-19T21:54:55.719 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 16, 2024-02-19T21:54:55.719 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-02-19T21:54:55.719 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-02-19T21:54:55.719 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-02-19T21:54:55.719 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-02-19T21:54:55.720 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-02-19T21:54:55.720 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-02-19T21:54:55.720 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-02-19T21:54:55.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.720 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "498", 2024-02-19T21:54:55.720 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-02-19T21:54:55.720 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-02-19T21:54:55.720 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-02-19T21:54:55.720 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-02-19T21:54:55.721 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-02-19T21:54:55.721 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-02-19T21:54:55.721 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-02-19T21:54:55.721 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-02-19T21:54:55.721 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-02-19T21:54:55.721 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-02-19T21:54:55.721 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-02-19T21:54:55.721 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-02-19T21:54:55.721 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-02-19T21:54:55.721 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-02-19T21:54:55.721 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-02-19T21:54:55.722 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-02-19T21:54:55.722 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-02-19T21:54:55.722 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-02-19T21:54:55.722 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-02-19T21:54:55.722 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-02-19T21:54:55.722 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-02-19T21:54:55.722 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-02-19T21:54:55.722 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-02-19T21:54:55.722 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-02-19T21:54:55.722 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-02-19T21:54:55.722 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-02-19T21:54:55.722 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.723 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-02-19T21:54:55.723 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-02-19T21:54:55.723 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-02-19T21:54:55.723 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-02-19T21:54:55.723 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-02-19T21:54:55.723 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-02-19T21:54:55.723 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-02-19T21:54:55.723 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-02-19T21:54:55.723 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-02-19T21:54:55.723 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-02-19T21:54:55.723 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-02-19T21:54:55.723 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-02-19T21:54:55.723 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-02-19T21:54:55.724 INFO:teuthology.orchestra.run.smithi080.stdout: "rados": {} 2024-02-19T21:54:55.724 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.724 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.724 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:54:55.724 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:54:55.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.724 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2024-02-19T21:54:55.724 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "a72c63f6-46b3-4202-99da-7b0c92b799a5", 2024-02-19T21:54:55.724 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:54:55.724 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:54:55.724 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:54:55.725 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:54:55.725 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:54:55.725 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:54:55.725 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 8, 2024-02-19T21:54:55.725 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 492, 2024-02-19T21:54:55.725 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:54:55.725 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:54:55.725 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:54:55.725 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.725 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.725 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.725 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2024-02-19T21:54:55.726 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:54:55.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.726 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.726 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.726 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2024-02-19T21:54:55.726 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:54:55.726 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.726 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.726 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:54:55.726 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.726 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.727 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.727 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2024-02-19T21:54:55.727 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:54:55.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.727 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.727 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.727 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2024-02-19T21:54:55.727 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:54:55.727 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.727 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.728 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:54:55.728 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.728 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.728 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.728 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2024-02-19T21:54:55.728 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:54:55.728 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.728 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.728 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.728 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2024-02-19T21:54:55.728 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:54:55.728 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.729 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.729 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:54:55.729 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.729 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.729 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2024-02-19T21:54:55.729 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:54:55.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.729 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.729 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2024-02-19T21:54:55.729 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3531298825 2024-02-19T21:54:55.730 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.730 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.730 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6803/3531298825", 2024-02-19T21:54:55.730 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6805/3531298825", 2024-02-19T21:54:55.730 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6809/3531298825", 2024-02-19T21:54:55.730 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6807/3531298825", 2024-02-19T21:54:55.730 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:54:55.730 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:54:55.730 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:54:55.730 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.731 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2024-02-19T21:54:55.731 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "7d4e170e-b0ca-4e19-be35-4038ca126ee6", 2024-02-19T21:54:55.731 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:54:55.731 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:54:55.731 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:54:55.731 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:54:55.731 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:54:55.731 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:54:55.731 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-02-19T21:54:55.731 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 492, 2024-02-19T21:54:55.731 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:54:55.732 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:54:55.732 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:54:55.732 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.732 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.732 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.732 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2024-02-19T21:54:55.732 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:54:55.732 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.732 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.732 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.732 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2024-02-19T21:54:55.732 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:54:55.733 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.733 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.733 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:54:55.733 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.733 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.733 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2024-02-19T21:54:55.733 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:54:55.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.733 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.734 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2024-02-19T21:54:55.734 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:54:55.734 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.734 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.734 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:54:55.734 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.734 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.734 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2024-02-19T21:54:55.734 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:54:55.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.735 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.735 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2024-02-19T21:54:55.735 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:54:55.735 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.735 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.735 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:54:55.735 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.735 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.735 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2024-02-19T21:54:55.736 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:54:55.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.736 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.736 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2024-02-19T21:54:55.736 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1497235950 2024-02-19T21:54:55.736 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.736 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.736 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6811/1497235950", 2024-02-19T21:54:55.736 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6813/1497235950", 2024-02-19T21:54:55.736 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6817/1497235950", 2024-02-19T21:54:55.737 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6815/1497235950", 2024-02-19T21:54:55.737 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:54:55.737 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:54:55.737 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:54:55.737 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.737 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2024-02-19T21:54:55.737 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "cf461b67-f3e8-45e9-b2f6-777752ba5574", 2024-02-19T21:54:55.737 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:54:55.737 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:54:55.737 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:54:55.737 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:54:55.738 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 18, 2024-02-19T21:54:55.738 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 369, 2024-02-19T21:54:55.738 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 394, 2024-02-19T21:54:55.738 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 513, 2024-02-19T21:54:55.738 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 370, 2024-02-19T21:54:55.738 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:54:55.738 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:54:55.738 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.738 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.738 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.738 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2024-02-19T21:54:55.738 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2441376667 2024-02-19T21:54:55.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.739 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.739 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2024-02-19T21:54:55.739 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2441376667 2024-02-19T21:54:55.739 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.739 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.739 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:54:55.739 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.740 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.740 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2024-02-19T21:54:55.740 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2441376667 2024-02-19T21:54:55.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.740 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.740 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2024-02-19T21:54:55.740 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2441376667 2024-02-19T21:54:55.740 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.740 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.741 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:54:55.741 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.741 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.741 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2024-02-19T21:54:55.741 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2441376667 2024-02-19T21:54:55.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.741 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.741 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2024-02-19T21:54:55.741 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2441376667 2024-02-19T21:54:55.742 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.742 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.742 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:54:55.742 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.742 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.742 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2024-02-19T21:54:55.742 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2441376667 2024-02-19T21:54:55.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.742 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.743 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2024-02-19T21:54:55.743 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2441376667 2024-02-19T21:54:55.743 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.743 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.743 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6819/2441376667", 2024-02-19T21:54:55.743 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6821/2441376667", 2024-02-19T21:54:55.743 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6825/2441376667", 2024-02-19T21:54:55.743 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6823/2441376667", 2024-02-19T21:54:55.743 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:54:55.743 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:54:55.743 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:54:55.743 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.744 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2024-02-19T21:54:55.744 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "76318cdd-5fce-4a40-95c9-300d55c34820", 2024-02-19T21:54:55.744 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:54:55.744 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:54:55.744 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 0.4183197021484375, 2024-02-19T21:54:55.744 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:54:55.744 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:54:55.744 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:54:55.744 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 26, 2024-02-19T21:54:55.745 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 492, 2024-02-19T21:54:55.745 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:54:55.745 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:54:55.745 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:54:55.745 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.745 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.745 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2024-02-19T21:54:55.745 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:54:55.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.746 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.746 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2024-02-19T21:54:55.746 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:54:55.746 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.746 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.746 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:54:55.746 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.746 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.746 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2024-02-19T21:54:55.746 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:54:55.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.747 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.747 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2024-02-19T21:54:55.747 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:54:55.747 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.747 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.747 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:54:55.747 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.747 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.747 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6832", 2024-02-19T21:54:55.747 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:54:55.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.748 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.748 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6833", 2024-02-19T21:54:55.748 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:54:55.748 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.748 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.748 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:54:55.748 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.748 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.748 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2024-02-19T21:54:55.748 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:54:55.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.749 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.749 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2024-02-19T21:54:55.749 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2007978078 2024-02-19T21:54:55.749 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.749 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.749 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6827/2007978078", 2024-02-19T21:54:55.749 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6829/2007978078", 2024-02-19T21:54:55.749 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6833/2007978078", 2024-02-19T21:54:55.749 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6831/2007978078", 2024-02-19T21:54:55.749 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:54:55.749 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:54:55.750 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:54:55.750 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.750 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2024-02-19T21:54:55.750 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "6484964f-3391-4e1d-a56c-813f46124062", 2024-02-19T21:54:55.750 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:54:55.750 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:54:55.750 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:54:55.750 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:54:55.750 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:54:55.750 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:54:55.750 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 32, 2024-02-19T21:54:55.751 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 492, 2024-02-19T21:54:55.751 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:54:55.751 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:54:55.751 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:54:55.751 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.751 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.751 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6800", 2024-02-19T21:54:55.751 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:54:55.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.751 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.751 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6801", 2024-02-19T21:54:55.751 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:54:55.752 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.752 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.752 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:54:55.752 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.752 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.752 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6802", 2024-02-19T21:54:55.752 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:54:55.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.752 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.752 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6803", 2024-02-19T21:54:55.753 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:54:55.753 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.753 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.753 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:54:55.753 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.753 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.753 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6806", 2024-02-19T21:54:55.753 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:54:55.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.753 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.753 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6807", 2024-02-19T21:54:55.754 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:54:55.754 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.754 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.754 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:54:55.754 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.754 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.754 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6804", 2024-02-19T21:54:55.754 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:54:55.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.754 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.754 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6805", 2024-02-19T21:54:55.754 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1922002860 2024-02-19T21:54:55.755 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.755 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.755 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6801/1922002860", 2024-02-19T21:54:55.755 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6803/1922002860", 2024-02-19T21:54:55.755 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6807/1922002860", 2024-02-19T21:54:55.755 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6805/1922002860", 2024-02-19T21:54:55.755 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:54:55.755 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:54:55.755 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:54:55.755 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.755 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2024-02-19T21:54:55.755 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "8c7e0309-8c3b-40b9-99d9-96620e52742f", 2024-02-19T21:54:55.756 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:54:55.756 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:54:55.756 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:54:55.756 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:54:55.756 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:54:55.756 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:54:55.756 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 38, 2024-02-19T21:54:55.756 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 513, 2024-02-19T21:54:55.756 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:54:55.756 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:54:55.756 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:54:55.756 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.756 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.756 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6808", 2024-02-19T21:54:55.757 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:54:55.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.757 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.757 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6809", 2024-02-19T21:54:55.757 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:54:55.757 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.757 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.757 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:54:55.757 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.757 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.758 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6810", 2024-02-19T21:54:55.758 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:54:55.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.758 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.758 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6811", 2024-02-19T21:54:55.758 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:54:55.758 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.758 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.758 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:54:55.758 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.758 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.759 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6814", 2024-02-19T21:54:55.759 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:54:55.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.759 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.759 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6815", 2024-02-19T21:54:55.759 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:54:55.759 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.759 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.759 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:54:55.759 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.759 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.759 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6812", 2024-02-19T21:54:55.760 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:54:55.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.760 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.760 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6813", 2024-02-19T21:54:55.760 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 960889603 2024-02-19T21:54:55.760 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.760 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.760 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6809/960889603", 2024-02-19T21:54:55.760 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6811/960889603", 2024-02-19T21:54:55.760 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6815/960889603", 2024-02-19T21:54:55.760 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6813/960889603", 2024-02-19T21:54:55.761 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:54:55.761 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:54:55.761 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:54:55.761 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.761 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2024-02-19T21:54:55.761 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "5b7d44a3-197d-482c-bf9e-de5e9013a851", 2024-02-19T21:54:55.761 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:54:55.761 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:54:55.761 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:54:55.761 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:54:55.761 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:54:55.762 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:54:55.762 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 47, 2024-02-19T21:54:55.762 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 492, 2024-02-19T21:54:55.762 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:54:55.762 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:54:55.762 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:54:55.762 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.762 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.762 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6816", 2024-02-19T21:54:55.762 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:54:55.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.762 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.763 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6817", 2024-02-19T21:54:55.763 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:54:55.763 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.763 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.763 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:54:55.763 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.763 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.763 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6818", 2024-02-19T21:54:55.763 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:54:55.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.763 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.763 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6819", 2024-02-19T21:54:55.764 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:54:55.764 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.764 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.764 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:54:55.764 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.764 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.764 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6822", 2024-02-19T21:54:55.764 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:54:55.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.764 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.764 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6823", 2024-02-19T21:54:55.765 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:54:55.765 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.765 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.765 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:54:55.765 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.765 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.765 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6820", 2024-02-19T21:54:55.765 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:54:55.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.766 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.766 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6821", 2024-02-19T21:54:55.766 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2598265223 2024-02-19T21:54:55.766 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.766 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.766 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6817/2598265223", 2024-02-19T21:54:55.766 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6819/2598265223", 2024-02-19T21:54:55.766 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6823/2598265223", 2024-02-19T21:54:55.766 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6821/2598265223", 2024-02-19T21:54:55.766 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:54:55.767 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:54:55.767 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:54:55.767 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.767 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2024-02-19T21:54:55.767 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "7e2d0287-928d-40f8-841b-6c2077fc08ac", 2024-02-19T21:54:55.767 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-02-19T21:54:55.767 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-02-19T21:54:55.767 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-02-19T21:54:55.767 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-02-19T21:54:55.767 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-02-19T21:54:55.767 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-02-19T21:54:55.767 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 55, 2024-02-19T21:54:55.768 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 495, 2024-02-19T21:54:55.768 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-02-19T21:54:55.768 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-02-19T21:54:55.768 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-02-19T21:54:55.768 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.768 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.768 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6824", 2024-02-19T21:54:55.768 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:54:55.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.768 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.768 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6825", 2024-02-19T21:54:55.769 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:54:55.769 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.769 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.769 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-02-19T21:54:55.769 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.769 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.769 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6826", 2024-02-19T21:54:55.769 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:54:55.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.769 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.769 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6827", 2024-02-19T21:54:55.770 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:54:55.770 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.770 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.770 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-02-19T21:54:55.770 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.770 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.770 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6830", 2024-02-19T21:54:55.770 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:54:55.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.770 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.770 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6831", 2024-02-19T21:54:55.770 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:54:55.771 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.771 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.771 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-02-19T21:54:55.771 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-02-19T21:54:55.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.771 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-02-19T21:54:55.771 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6828", 2024-02-19T21:54:55.771 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:54:55.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.771 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-02-19T21:54:55.771 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.157:6829", 2024-02-19T21:54:55.771 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3619345894 2024-02-19T21:54:55.772 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.772 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.772 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.157:6825/3619345894", 2024-02-19T21:54:55.772 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.157:6827/3619345894", 2024-02-19T21:54:55.772 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.157:6831/3619345894", 2024-02-19T21:54:55.772 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.157:6829/3619345894", 2024-02-19T21:54:55.772 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-02-19T21:54:55.772 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-02-19T21:54:55.772 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-02-19T21:54:55.772 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.772 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.772 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:54:55.773 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2024-02-19T21:54:55.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.773 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2024-02-19T21:54:55.773 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:54:55.773 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:54:55.773 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:54:55.773 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:54:55.773 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:54:55.773 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:54:05.615750+0000", 2024-02-19T21:54:55.773 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:54:55.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.773 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2024-02-19T21:54:55.773 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:54:55.774 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:54:55.774 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:54:55.774 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:54:55.774 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:54:55.774 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:54:50.218878+0000", 2024-02-19T21:54:55.774 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:54:55.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.774 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2024-02-19T21:54:55.774 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:54:55.774 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:54:55.774 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:54:55.774 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:54:55.774 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:54:55.775 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:54:12.802646+0000", 2024-02-19T21:54:55.775 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 369 2024-02-19T21:54:55.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.775 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2024-02-19T21:54:55.775 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:54:55.775 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:54:55.775 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:54:55.775 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:54:55.775 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:54:55.775 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:54:34.927998+0000", 2024-02-19T21:54:55.775 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:54:55.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.776 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2024-02-19T21:54:55.776 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:54:55.776 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:54:55.776 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:54:55.776 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:54:55.776 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:54:55.776 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:53:42.653710+0000", 2024-02-19T21:54:55.776 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:54:55.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.776 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2024-02-19T21:54:55.777 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:54:55.777 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:54:55.777 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:54:55.777 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:54:55.777 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:54:55.777 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:54:28.586371+0000", 2024-02-19T21:54:55.777 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:54:55.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.777 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2024-02-19T21:54:55.777 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:54:55.777 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:54:55.777 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:54:55.778 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:54:55.778 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:54:55.778 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:54:49.241341+0000", 2024-02-19T21:54:55.778 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:54:55.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.778 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2024-02-19T21:54:55.778 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-02-19T21:54:55.778 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-02-19T21:54:55.778 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-02-19T21:54:55.778 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138314316775423, 2024-02-19T21:54:55.778 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-02-19T21:54:55.778 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-02-19T21:54:11.410416+0000", 2024-02-19T21:54:55.779 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-02-19T21:54:55.779 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.779 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:54:55.779 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [ 2024-02-19T21:54:55.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.779 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "2.c", 2024-02-19T21:54:55.779 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:54:55.779 INFO:teuthology.orchestra.run.smithi080.stdout: 6, 2024-02-19T21:54:55.779 INFO:teuthology.orchestra.run.smithi080.stdout: 7, 2024-02-19T21:54:55.779 INFO:teuthology.orchestra.run.smithi080.stdout: 2 2024-02-19T21:54:55.779 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.779 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.1", 2024-02-19T21:54:55.779 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-02-19T21:54:55.780 INFO:teuthology.orchestra.run.smithi080.stdout: 4, 2024-02-19T21:54:55.780 INFO:teuthology.orchestra.run.smithi080.stdout: 2, 2024-02-19T21:54:55.780 INFO:teuthology.orchestra.run.smithi080.stdout: 6 2024-02-19T21:54:55.780 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.780 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.780 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:54:55.780 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [ 2024-02-19T21:54:55.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.780 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "2.3", 2024-02-19T21:54:55.780 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:54:55.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.780 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 7, 2024-02-19T21:54:55.780 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 1 2024-02-19T21:54:55.780 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.781 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.781 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "2.10", 2024-02-19T21:54:55.781 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:54:55.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.781 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:54:55.781 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 4 2024-02-19T21:54:55.781 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.781 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.781 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "2.1b", 2024-02-19T21:54:55.781 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:54:55.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.782 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 7, 2024-02-19T21:54:55.782 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 2 2024-02-19T21:54:55.782 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.782 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.782 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.6", 2024-02-19T21:54:55.782 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:54:55.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.782 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:54:55.782 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 5 2024-02-19T21:54:55.782 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.783 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.783 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.e", 2024-02-19T21:54:55.783 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:54:55.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.783 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:54:55.783 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 7 2024-02-19T21:54:55.783 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.783 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.783 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.f", 2024-02-19T21:54:55.783 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:54:55.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.783 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:54:55.784 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 5 2024-02-19T21:54:55.784 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.784 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.784 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.1d", 2024-02-19T21:54:55.784 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:54:55.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.784 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:54:55.784 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 2 2024-02-19T21:54:55.784 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.784 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.785 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.1f", 2024-02-19T21:54:55.785 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:54:55.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.785 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-02-19T21:54:55.785 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 7 2024-02-19T21:54:55.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.785 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 6, 2024-02-19T21:54:55.785 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 0 2024-02-19T21:54:55.785 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.785 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.785 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "5.1", 2024-02-19T21:54:55.786 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:54:55.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.786 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 4, 2024-02-19T21:54:55.786 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 6 2024-02-19T21:54:55.786 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.786 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.786 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "5.13", 2024-02-19T21:54:55.786 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:54:55.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.786 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 0, 2024-02-19T21:54:55.786 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 6 2024-02-19T21:54:55.786 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.786 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.787 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.787 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "6.f", 2024-02-19T21:54:55.787 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-02-19T21:54:55.787 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:54:55.787 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 4, 2024-02-19T21:54:55.787 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 0 2024-02-19T21:54:55.787 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.787 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:54:55.787 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.787 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:54:55.787 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [], 2024-02-19T21:54:55.787 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2024-02-19T21:54:55.787 INFO:teuthology.orchestra.run.smithi080.stdout: "blocklist": { 2024-02-19T21:54:55.788 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6800/2867197629": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:54:55.788 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/1659656010": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:54:55.788 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6801/2272739550": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:54:55.788 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/867908385": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:54:55.788 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/398750494": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:54:55.788 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/2833137430": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:54:55.788 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/2520755315": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:54:55.788 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6800/2094869828": "2024-02-20T21:26:51.262073+0000", 2024-02-19T21:54:55.788 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6800/2272739550": "2024-02-20T21:27:15.880876+0000", 2024-02-19T21:54:55.788 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6801/2094869828": "2024-02-20T21:26:51.262073+0000", 2024-02-19T21:54:55.788 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/2130852198": "2024-02-20T21:26:51.262073+0000", 2024-02-19T21:54:55.788 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6801/2867197629": "2024-02-20T21:32:48.748960+0000", 2024-02-19T21:54:55.788 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:0/1952386920": "2024-02-20T21:26:51.262073+0000" 2024-02-19T21:54:55.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.788 INFO:teuthology.orchestra.run.smithi080.stdout: "range_blocklist": {}, 2024-02-19T21:54:55.789 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2024-02-19T21:54:55.789 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2024-02-19T21:54:55.789 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2024-02-19T21:54:55.789 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2024-02-19T21:54:55.789 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2024-02-19T21:54:55.789 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2024-02-19T21:54:55.789 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2024-02-19T21:54:55.789 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2024-02-19T21:54:55.789 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:54:55.789 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2024-02-19T21:54:55.789 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2024-02-19T21:54:55.789 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2024-02-19T21:54:55.790 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2024-02-19T21:54:55.790 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {}, 2024-02-19T21:54:55.790 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode": { 2024-02-19T21:54:55.790 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode_enabled": false, 2024-02-19T21:54:55.790 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_bucket_count": 0, 2024-02-19T21:54:55.790 INFO:teuthology.orchestra.run.smithi080.stdout: "degraded_stretch_mode": 0, 2024-02-19T21:54:55.790 INFO:teuthology.orchestra.run.smithi080.stdout: "recovering_stretch_mode": 0, 2024-02-19T21:54:55.790 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode_bucket": 0 2024-02-19T21:54:55.790 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:54:55.790 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:54:56.059 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:54:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:54:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:54:56.072 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:54:56.076 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:56.077 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:54:56.119 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 56 16 87344 87328 97.4265 58.1875 0.0235493 0.0102595 2024-02-19T21:54:56.178 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:54:56.243 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:56.406 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:54:56.411 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:56.412 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:54:56.513 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:54:56.519 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:55.260698+0000 mgr.y (mgr.14514) 854 : cluster [DBG] pgmap v1108: 138 pgs: 2 peering, 136 active+clean; 5.2 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 89 MiB/s wr, 1.42k op/s 2024-02-19T21:54:56.519 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:55.679754+0000 mon.c (mon.2) 125 : audit [DBG] from='client.? 172.21.15.80:0/341138615' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-19T21:54:56.573 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:56.636 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:54:56.640 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:56.641 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:54:56.741 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:54:56.779 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:56.801 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:55.260698+0000 mgr.y (mgr.14514) 854 : cluster [DBG] pgmap v1108: 138 pgs: 2 peering, 136 active+clean; 5.2 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 89 MiB/s wr, 1.42k op/s 2024-02-19T21:54:56.801 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:55.679754+0000 mon.c (mon.2) 125 : audit [DBG] from='client.? 172.21.15.80:0/341138615' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-19T21:54:56.801 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:55.260698+0000 mgr.y (mgr.14514) 854 : cluster [DBG] pgmap v1108: 138 pgs: 2 peering, 136 active+clean; 5.2 GiB data, 21 GiB used, 695 GiB / 715 GiB avail; 89 MiB/s wr, 1.42k op/s 2024-02-19T21:54:56.801 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:55.679754+0000 mon.c (mon.2) 125 : audit [DBG] from='client.? 172.21.15.80:0/341138615' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-02-19T21:54:56.984 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:54:56.990 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:56.991 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:54:57.091 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:54:57.119 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 57 16 88297 88281 96.7623 59.5625 0.0122874 0.0103301 2024-02-19T21:54:57.137 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:57.513 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:56.881815+0000 mon.b (mon.1) 78 : audit [INF] from='client.? 172.21.15.80:0/3083975652' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:54:57.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:56.888230+0000 mon.a (mon.0) 1937 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:54:57.515 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:56.881815+0000 mon.b (mon.1) 78 : audit [INF] from='client.? 172.21.15.80:0/3083975652' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:54:57.515 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:56.888230+0000 mon.a (mon.0) 1937 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:54:57.551 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-02-19T21:54:57.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:56.881815+0000 mon.b (mon.1) 78 : audit [INF] from='client.? 172.21.15.80:0/3083975652' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:54:57.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:56.888230+0000 mon.a (mon.0) 1937 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:54:58.119 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 58 16 89336 89320 96.2137 64.9375 0.00467419 0.0103899 2024-02-19T21:54:58.300 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:54:58.305 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:58.306 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:54:58.406 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:54:58.465 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:58.504 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:54:58.508 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:58.509 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:54:58.595 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:57.261311+0000 mgr.y (mgr.14514) 855 : cluster [DBG] pgmap v1109: 138 pgs: 2 peering, 136 active+clean; 5.3 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 50 MiB/s wr, 795 op/s 2024-02-19T21:54:58.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:57.510798+0000 mon.a (mon.0) 1938 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:54:58.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:57.530362+0000 mon.a (mon.0) 1939 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:54:58.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:57.530428+0000 mon.a (mon.0) 1940 : cluster [DBG] osdmap e515: 8 total, 8 up, 8 in 2024-02-19T21:54:58.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:58.167525+0000 osd.5 (osd.5) 295 : cluster [DBG] 4.8 scrub starts 2024-02-19T21:54:58.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:58.172553+0000 osd.5 (osd.5) 296 : cluster [DBG] 4.8 scrub ok 2024-02-19T21:54:58.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:57.261311+0000 mgr.y (mgr.14514) 855 : cluster [DBG] pgmap v1109: 138 pgs: 2 peering, 136 active+clean; 5.3 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 50 MiB/s wr, 795 op/s 2024-02-19T21:54:58.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:57.510798+0000 mon.a (mon.0) 1938 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:54:58.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:57.530362+0000 mon.a (mon.0) 1939 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:54:58.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:57.530428+0000 mon.a (mon.0) 1940 : cluster [DBG] osdmap e515: 8 total, 8 up, 8 in 2024-02-19T21:54:58.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:58.167525+0000 osd.5 (osd.5) 295 : cluster [DBG] 4.8 scrub starts 2024-02-19T21:54:58.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:58.172553+0000 osd.5 (osd.5) 296 : cluster [DBG] 4.8 scrub ok 2024-02-19T21:54:58.609 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:54:58.654 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:57.261311+0000 mgr.y (mgr.14514) 855 : cluster [DBG] pgmap v1109: 138 pgs: 2 peering, 136 active+clean; 5.3 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 50 MiB/s wr, 795 op/s 2024-02-19T21:54:58.654 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:57.510798+0000 mon.a (mon.0) 1938 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:54:58.654 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:57.530362+0000 mon.a (mon.0) 1939 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:54:58.654 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:57.530428+0000 mon.a (mon.0) 1940 : cluster [DBG] osdmap e515: 8 total, 8 up, 8 in 2024-02-19T21:54:58.654 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:58.167525+0000 osd.5 (osd.5) 295 : cluster [DBG] 4.8 scrub starts 2024-02-19T21:54:58.654 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:58.172553+0000 osd.5 (osd.5) 296 : cluster [DBG] 4.8 scrub ok 2024-02-19T21:54:58.663 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:58.775 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:54:58.778 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:58.778 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:54:58.879 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:54:58.970 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:58.980 INFO:tasks.thrashosds.thrasher:j is {'epoch': 514, 'fsid': '6f763558-cf6d-11ee-95bb-87774f69a715', 'created': '2024-02-19T21:26:16.880265+0000', 'modified': '2024-02-19T21:54:52.444127+0000', 'last_up_change': '2024-02-19T21:49:07.286446+0000', 'last_in_change': '2024-02-19T21:53:44.626155+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 19, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 11, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-19T21:30:05.947623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2024-02-19T21:32:22.082250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2024-02-19T21:32:22.333164+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 3, 'pg_placement_num': 3, 'pg_placement_num_target': 3, 'pg_num_target': 3, 'pg_num_pending': 3, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2024-02-19T21:32:23.632615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2024-02-19T21:32:25.600876+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 22, 'pg_placement_num': 22, 'pg_placement_num_target': 22, 'pg_num_target': 22, 'pg_num_pending': 22, 'last_pg_merge_meta': {'source_pgid': '5.16', 'ready_epoch': 298, 'last_epoch_started': 297, 'last_epoch_clean': 297, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '325', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '298', 'last_force_op_resend_preluminous': '296', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2024-02-19T21:32:27.661242+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '6.16', 'ready_epoch': 243, 'last_epoch_started': 242, 'last_epoch_clean': 242, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '304', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '243', 'last_force_op_resend_preluminous': '302', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}}, {'pool': 11, 'pool_name': 'unique_pool_4', 'create_time': '2024-02-19T21:53:44.625837+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '498', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': 'a72c63f6-46b3-4202-99da-7b0c92b799a5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 492, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6802', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6803', 'nonce': 3531298825}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6804', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6805', 'nonce': 3531298825}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6808', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6809', 'nonce': 3531298825}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6806', 'nonce': 3531298825}, {'type': 'v1', 'addr': '172.21.15.80:6807', 'nonce': 3531298825}]}, 'public_addr': '172.21.15.80:6803/3531298825', 'cluster_addr': '172.21.15.80:6805/3531298825', 'heartbeat_back_addr': '172.21.15.80:6809/3531298825', 'heartbeat_front_addr': '172.21.15.80:6807/3531298825', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7d4e170e-b0ca-4e19-be35-4038ca126ee6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 492, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6810', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6811', 'nonce': 1497235950}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6812', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6813', 'nonce': 1497235950}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6816', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6817', 'nonce': 1497235950}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6814', 'nonce': 1497235950}, {'type': 'v1', 'addr': '172.21.15.80:6815', 'nonce': 1497235950}]}, 'public_addr': '172.21.15.80:6811/1497235950', 'cluster_addr': '172.21.15.80:6813/1497235950', 'heartbeat_back_addr': '172.21.15.80:6817/1497235950', 'heartbeat_front_addr': '172.21.15.80:6815/1497235950', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'cf461b67-f3e8-45e9-b2f6-777752ba5574', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 18, 'last_clean_end': 369, 'up_from': 394, 'up_thru': 513, 'down_at': 370, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6818', 'nonce': 2441376667}, {'type': 'v1', 'addr': '172.21.15.80:6819', 'nonce': 2441376667}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6820', 'nonce': 2441376667}, {'type': 'v1', 'addr': '172.21.15.80:6821', 'nonce': 2441376667}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6824', 'nonce': 2441376667}, {'type': 'v1', 'addr': '172.21.15.80:6825', 'nonce': 2441376667}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6822', 'nonce': 2441376667}, {'type': 'v1', 'addr': '172.21.15.80:6823', 'nonce': 2441376667}]}, 'public_addr': '172.21.15.80:6819/2441376667', 'cluster_addr': '172.21.15.80:6821/2441376667', 'heartbeat_back_addr': '172.21.15.80:6825/2441376667', 'heartbeat_front_addr': '172.21.15.80:6823/2441376667', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '76318cdd-5fce-4a40-95c9-300d55c34820', 'up': 1, 'in': 1, 'weight': 0.4183197021484375, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 26, 'up_thru': 492, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6826', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6827', 'nonce': 2007978078}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6828', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6829', 'nonce': 2007978078}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6832', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6833', 'nonce': 2007978078}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6830', 'nonce': 2007978078}, {'type': 'v1', 'addr': '172.21.15.80:6831', 'nonce': 2007978078}]}, 'public_addr': '172.21.15.80:6827/2007978078', 'cluster_addr': '172.21.15.80:6829/2007978078', 'heartbeat_back_addr': '172.21.15.80:6833/2007978078', 'heartbeat_front_addr': '172.21.15.80:6831/2007978078', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '6484964f-3391-4e1d-a56c-813f46124062', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 32, 'up_thru': 492, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6800', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6801', 'nonce': 1922002860}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6802', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6803', 'nonce': 1922002860}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6806', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6807', 'nonce': 1922002860}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6804', 'nonce': 1922002860}, {'type': 'v1', 'addr': '172.21.15.157:6805', 'nonce': 1922002860}]}, 'public_addr': '172.21.15.157:6801/1922002860', 'cluster_addr': '172.21.15.157:6803/1922002860', 'heartbeat_back_addr': '172.21.15.157:6807/1922002860', 'heartbeat_front_addr': '172.21.15.157:6805/1922002860', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '8c7e0309-8c3b-40b9-99d9-96620e52742f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 38, 'up_thru': 513, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6808', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6809', 'nonce': 960889603}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6810', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6811', 'nonce': 960889603}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6814', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6815', 'nonce': 960889603}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6812', 'nonce': 960889603}, {'type': 'v1', 'addr': '172.21.15.157:6813', 'nonce': 960889603}]}, 'public_addr': '172.21.15.157:6809/960889603', 'cluster_addr': '172.21.15.157:6811/960889603', 'heartbeat_back_addr': '172.21.15.157:6815/960889603', 'heartbeat_front_addr': '172.21.15.157:6813/960889603', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '5b7d44a3-197d-482c-bf9e-de5e9013a851', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 47, 'up_thru': 492, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6816', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6817', 'nonce': 2598265223}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6818', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6819', 'nonce': 2598265223}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6822', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6823', 'nonce': 2598265223}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6820', 'nonce': 2598265223}, {'type': 'v1', 'addr': '172.21.15.157:6821', 'nonce': 2598265223}]}, 'public_addr': '172.21.15.157:6817/2598265223', 'cluster_addr': '172.21.15.157:6819/2598265223', 'heartbeat_back_addr': '172.21.15.157:6823/2598265223', 'heartbeat_front_addr': '172.21.15.157:6821/2598265223', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '7e2d0287-928d-40f8-841b-6c2077fc08ac', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 55, 'up_thru': 495, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6824', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6825', 'nonce': 3619345894}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6826', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6827', 'nonce': 3619345894}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6830', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6831', 'nonce': 3619345894}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6828', 'nonce': 3619345894}, {'type': 'v1', 'addr': '172.21.15.157:6829', 'nonce': 3619345894}]}, 'public_addr': '172.21.15.157:6825/3619345894', 'cluster_addr': '172.21.15.157:6827/3619345894', 'heartbeat_back_addr': '172.21.15.157:6831/3619345894', 'heartbeat_front_addr': '172.21.15.157:6829/3619345894', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:54:05.615750+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:54:50.218878+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:54:12.802646+0000', 'dead_epoch': 369}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:54:34.927998+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:53:42.653710+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:54:28.586371+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:54:49.241341+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-02-19T21:54:11.410416+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.c', 'osds': [6, 7, 2]}, {'pgid': '4.1', 'osds': [4, 2, 6]}], 'pg_upmap_items': [{'pgid': '2.3', 'mappings': [{'from': 7, 'to': 1}]}, {'pgid': '2.10', 'mappings': [{'from': 1, 'to': 4}]}, {'pgid': '2.1b', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '4.6', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.e', 'mappings': [{'from': 1, 'to': 7}]}, {'pgid': '4.f', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.1d', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '4.1f', 'mappings': [{'from': 1, 'to': 7}, {'from': 6, 'to': 0}]}, {'pgid': '5.1', 'mappings': [{'from': 4, 'to': 6}]}, {'pgid': '5.13', 'mappings': [{'from': 0, 'to': 6}]}, {'pgid': '6.f', 'mappings': [{'from': 4, 'to': 0}]}], 'pg_temp': [], 'primary_temp': [], 'blocklist': {'172.21.15.80:6800/2867197629': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:0/1659656010': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:6801/2272739550': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:0/867908385': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:0/398750494': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:0/2833137430': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:0/2520755315': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:6800/2094869828': '2024-02-20T21:26:51.262073+0000', '172.21.15.80:6800/2272739550': '2024-02-20T21:27:15.880876+0000', '172.21.15.80:6801/2094869828': '2024-02-20T21:26:51.262073+0000', '172.21.15.80:0/2130852198': '2024-02-20T21:26:51.262073+0000', '172.21.15.80:6801/2867197629': '2024-02-20T21:32:48.748960+0000', '172.21.15.80:0/1952386920': '2024-02-20T21:26:51.262073+0000'}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-02-19T21:54:58.980 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:54:59.083 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:54:59.089 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:59.089 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:54:59.119 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 59 15 90338 90323 95.6455 62.6875 0.00905303 0.0104504 2024-02-19T21:54:59.190 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:54:59.248 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:59.283 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:54:59.290 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:59.291 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:54:59.392 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:54:59.475 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:59.690 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:54:59.698 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:59.698 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:54:59.799 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:54:59.859 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:54:59.893 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:54:59.897 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:54:59.898 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:54:59.998 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:55:00.038 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:00.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:58.443432+0000 osd.4 (osd.4) 233 : cluster [DBG] 2.f scrub starts 2024-02-19T21:55:00.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:58.444841+0000 osd.4 (osd.4) 234 : cluster [DBG] 2.f scrub ok 2024-02-19T21:55:00.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:58.720772+0000 osd.6 (osd.6) 266 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:55:00.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:58.727752+0000 osd.6 (osd.6) 267 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:55:00.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:54:58.811603+0000 mon.a (mon.0) 1941 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:55:00.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:58.889992+0000 osd.2 (osd.2) 35 : cluster [DBG] 4.1d scrub starts 2024-02-19T21:55:00.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:58.906970+0000 osd.2 (osd.2) 36 : cluster [DBG] 4.1d scrub ok 2024-02-19T21:55:00.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:59.155900+0000 osd.5 (osd.5) 297 : cluster [DBG] 4.15 scrub starts 2024-02-19T21:55:00.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:54:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:59.161521+0000 osd.5 (osd.5) 298 : cluster [DBG] 4.15 scrub ok 2024-02-19T21:55:00.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:58.443432+0000 osd.4 (osd.4) 233 : cluster [DBG] 2.f scrub starts 2024-02-19T21:55:00.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:58.444841+0000 osd.4 (osd.4) 234 : cluster [DBG] 2.f scrub ok 2024-02-19T21:55:00.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:58.720772+0000 osd.6 (osd.6) 266 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:55:00.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:58.727752+0000 osd.6 (osd.6) 267 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:55:00.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:54:58.811603+0000 mon.a (mon.0) 1941 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:55:00.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:58.889992+0000 osd.2 (osd.2) 35 : cluster [DBG] 4.1d scrub starts 2024-02-19T21:55:00.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:58.906970+0000 osd.2 (osd.2) 36 : cluster [DBG] 4.1d scrub ok 2024-02-19T21:55:00.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:59.155900+0000 osd.5 (osd.5) 297 : cluster [DBG] 4.15 scrub starts 2024-02-19T21:55:00.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:54:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:59.161521+0000 osd.5 (osd.5) 298 : cluster [DBG] 4.15 scrub ok 2024-02-19T21:55:00.119 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:2024-02-19T21:55:00.121269+0000 min lat: 0.0011498 max lat: 0.248972 avg lat: 0.0105124 2024-02-19T21:55:00.119 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-19T21:55:00.119 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 60 16 91329 91313 95.0828 61.875 0.0104075 0.0105124 2024-02-19T21:55:00.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:58.443432+0000 osd.4 (osd.4) 233 : cluster [DBG] 2.f scrub starts 2024-02-19T21:55:00.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:58.444841+0000 osd.4 (osd.4) 234 : cluster [DBG] 2.f scrub ok 2024-02-19T21:55:00.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:58.720772+0000 osd.6 (osd.6) 266 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:55:00.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:58.727752+0000 osd.6 (osd.6) 267 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:55:00.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:54:58.811603+0000 mon.a (mon.0) 1941 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:55:00.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:58.889992+0000 osd.2 (osd.2) 35 : cluster [DBG] 4.1d scrub starts 2024-02-19T21:55:00.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:58.906970+0000 osd.2 (osd.2) 36 : cluster [DBG] 4.1d scrub ok 2024-02-19T21:55:00.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:59.155900+0000 osd.5 (osd.5) 297 : cluster [DBG] 4.15 scrub starts 2024-02-19T21:55:00.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:54:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:59.161521+0000 osd.5 (osd.5) 298 : cluster [DBG] 4.15 scrub ok 2024-02-19T21:55:00.397 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:55:00.410 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:00.411 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:55:00.512 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:55:00.568 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:01.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:59.089219+0000 osd.7 (osd.7) 285 : cluster [DBG] 2.5 scrub starts 2024-02-19T21:55:01.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:59.095563+0000 osd.7 (osd.7) 286 : cluster [DBG] 2.5 scrub ok 2024-02-19T21:55:01.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:59.261703+0000 mgr.y (mgr.14514) 856 : cluster [DBG] pgmap v1111: 138 pgs: 138 active+clean; 5.3 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 654 B/s rd, 46 MiB/s wr, 738 op/s; 28 B/s, 0 objects/s recovering 2024-02-19T21:55:01.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:59.694935+0000 osd.6 (osd.6) 268 : cluster [DBG] 4.a scrub starts 2024-02-19T21:55:01.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:59.710562+0000 osd.6 (osd.6) 269 : cluster [DBG] 4.a scrub ok 2024-02-19T21:55:01.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:54:59.870539+0000 osd.0 (osd.0) 299 : cluster [DBG] 6.13 scrub starts 2024-02-19T21:55:01.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:00.074237+0000 osd.0 (osd.0) 300 : cluster [DBG] 6.13 scrub ok 2024-02-19T21:55:01.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:00.396610+0000 mon.a (mon.0) 1942 : cluster [DBG] osdmap e516: 8 total, 8 up, 8 in 2024-02-19T21:55:01.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:59.089219+0000 osd.7 (osd.7) 285 : cluster [DBG] 2.5 scrub starts 2024-02-19T21:55:01.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:59.095563+0000 osd.7 (osd.7) 286 : cluster [DBG] 2.5 scrub ok 2024-02-19T21:55:01.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:59.261703+0000 mgr.y (mgr.14514) 856 : cluster [DBG] pgmap v1111: 138 pgs: 138 active+clean; 5.3 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 654 B/s rd, 46 MiB/s wr, 738 op/s; 28 B/s, 0 objects/s recovering 2024-02-19T21:55:01.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:59.694935+0000 osd.6 (osd.6) 268 : cluster [DBG] 4.a scrub starts 2024-02-19T21:55:01.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:59.710562+0000 osd.6 (osd.6) 269 : cluster [DBG] 4.a scrub ok 2024-02-19T21:55:01.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:54:59.870539+0000 osd.0 (osd.0) 299 : cluster [DBG] 6.13 scrub starts 2024-02-19T21:55:01.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:00.074237+0000 osd.0 (osd.0) 300 : cluster [DBG] 6.13 scrub ok 2024-02-19T21:55:01.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:00.396610+0000 mon.a (mon.0) 1942 : cluster [DBG] osdmap e516: 8 total, 8 up, 8 in 2024-02-19T21:55:01.099 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:55:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:55:00] "GET /metrics HTTP/1.1" 200 176773 "" "Prometheus/2.33.4" 2024-02-19T21:55:01.119 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 61 16 92317 92301 94.5364 61.75 0.00717603 0.0105737 2024-02-19T21:55:01.251 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:55:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:55:01.253 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:59.089219+0000 osd.7 (osd.7) 285 : cluster [DBG] 2.5 scrub starts 2024-02-19T21:55:01.253 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:59.095563+0000 osd.7 (osd.7) 286 : cluster [DBG] 2.5 scrub ok 2024-02-19T21:55:01.253 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:59.261703+0000 mgr.y (mgr.14514) 856 : cluster [DBG] pgmap v1111: 138 pgs: 138 active+clean; 5.3 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 654 B/s rd, 46 MiB/s wr, 738 op/s; 28 B/s, 0 objects/s recovering 2024-02-19T21:55:01.253 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:59.694935+0000 osd.6 (osd.6) 268 : cluster [DBG] 4.a scrub starts 2024-02-19T21:55:01.253 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:59.710562+0000 osd.6 (osd.6) 269 : cluster [DBG] 4.a scrub ok 2024-02-19T21:55:01.253 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:54:59.870539+0000 osd.0 (osd.0) 299 : cluster [DBG] 6.13 scrub starts 2024-02-19T21:55:01.253 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:00.074237+0000 osd.0 (osd.0) 300 : cluster [DBG] 6.13 scrub ok 2024-02-19T21:55:01.253 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:00.396610+0000 mon.a (mon.0) 1942 : cluster [DBG] osdmap e516: 8 total, 8 up, 8 in 2024-02-19T21:55:01.273 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:55:01.274 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:55:01.279 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:01.280 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:55:01.340 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:55:01.381 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:55:01.416 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:01.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:00.532308+0000 osd.3 (osd.3) 248 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:55:01.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:00.544807+0000 osd.3 (osd.3) 249 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:55:01.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:00.959355+0000 osd.2 (osd.2) 37 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:55:01.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:00.964064+0000 osd.2 (osd.2) 38 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:55:01.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:00.532308+0000 osd.3 (osd.3) 248 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:55:01.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:00.544807+0000 osd.3 (osd.3) 249 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:55:01.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:00.959355+0000 osd.2 (osd.2) 37 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:55:01.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:00.964064+0000 osd.2 (osd.2) 38 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:55:02.120 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 62 16 93337 93321 94.0391 63.75 0.00822708 0.0106292 2024-02-19T21:55:02.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:00.532308+0000 osd.3 (osd.3) 248 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:55:02.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:00.544807+0000 osd.3 (osd.3) 249 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:55:02.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:00.959355+0000 osd.2 (osd.2) 37 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:55:02.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:00.964064+0000 osd.2 (osd.2) 38 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:55:02.399 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-19T21:55:02.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:01.251806+0000 mgr.y (mgr.14514) 857 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:55:02.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:01.262154+0000 mgr.y (mgr.14514) 858 : cluster [DBG] pgmap v1113: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 5.6 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 5.4 KiB/s rd, 74 MiB/s wr, 1.19k op/s; 54 B/s, 1 objects/s recovering 2024-02-19T21:55:02.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:02.551796+0000 osd.1 (osd.1) 266 : cluster [DBG] 2.9 scrub starts 2024-02-19T21:55:02.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:02.556424+0000 osd.1 (osd.1) 267 : cluster [DBG] 2.9 scrub ok 2024-02-19T21:55:03.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:01.251806+0000 mgr.y (mgr.14514) 857 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:55:03.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:01.262154+0000 mgr.y (mgr.14514) 858 : cluster [DBG] pgmap v1113: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 5.6 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 5.4 KiB/s rd, 74 MiB/s wr, 1.19k op/s; 54 B/s, 1 objects/s recovering 2024-02-19T21:55:03.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:02.551796+0000 osd.1 (osd.1) 266 : cluster [DBG] 2.9 scrub starts 2024-02-19T21:55:03.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:02.556424+0000 osd.1 (osd.1) 267 : cluster [DBG] 2.9 scrub ok 2024-02-19T21:55:03.120 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 63 16 94301 94285 93.5028 60.25 0.0198533 0.0106904 2024-02-19T21:55:03.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:01.251806+0000 mgr.y (mgr.14514) 857 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:55:03.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:01.262154+0000 mgr.y (mgr.14514) 858 : cluster [DBG] pgmap v1113: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 5.6 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 5.4 KiB/s rd, 74 MiB/s wr, 1.19k op/s; 54 B/s, 1 objects/s recovering 2024-02-19T21:55:03.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:02.551796+0000 osd.1 (osd.1) 266 : cluster [DBG] 2.9 scrub starts 2024-02-19T21:55:03.308 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:02.556424+0000 osd.1 (osd.1) 267 : cluster [DBG] 2.9 scrub ok 2024-02-19T21:55:03.450 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:55:03.492 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:55:03.522 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:55:03.553 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:55:03.591 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:55:03.629 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:55:03.658 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:55:03.687 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:55:03.697 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:55:03.697 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:55:03.697 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:55:03.697 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:55:03.697 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:55:03.697 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:55:03.697 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:55:03.697 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:55:04.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:02.535603+0000 osd.4 (osd.4) 235 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:55:04.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:02.539234+0000 osd.4 (osd.4) 236 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:55:04.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:02.695879+0000 osd.6 (osd.6) 270 : cluster [DBG] 2.14 scrub starts 2024-02-19T21:55:04.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:02.698791+0000 osd.6 (osd.6) 271 : cluster [DBG] 2.14 scrub ok 2024-02-19T21:55:04.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:02.831342+0000 osd.0 (osd.0) 301 : cluster [DBG] 4.1f scrub starts 2024-02-19T21:55:04.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:02.838845+0000 osd.0 (osd.0) 302 : cluster [DBG] 4.1f scrub ok 2024-02-19T21:55:04.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:03.393029+0000 mon.b (mon.1) 79 : audit [DBG] from='client.? 172.21.15.80:0/2709256677' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:55:04.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:02.535603+0000 osd.4 (osd.4) 235 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:55:04.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:02.539234+0000 osd.4 (osd.4) 236 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:55:04.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:02.695879+0000 osd.6 (osd.6) 270 : cluster [DBG] 2.14 scrub starts 2024-02-19T21:55:04.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:02.698791+0000 osd.6 (osd.6) 271 : cluster [DBG] 2.14 scrub ok 2024-02-19T21:55:04.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:02.831342+0000 osd.0 (osd.0) 301 : cluster [DBG] 4.1f scrub starts 2024-02-19T21:55:04.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:02.838845+0000 osd.0 (osd.0) 302 : cluster [DBG] 4.1f scrub ok 2024-02-19T21:55:04.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:03.393029+0000 mon.b (mon.1) 79 : audit [DBG] from='client.? 172.21.15.80:0/2709256677' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:55:04.120 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 64 16 95184 95168 92.9043 55.1875 0.00922119 0.010759 2024-02-19T21:55:04.288 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:55:04.291 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:04.292 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:55:04.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:02.535603+0000 osd.4 (osd.4) 235 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:55:04.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:02.539234+0000 osd.4 (osd.4) 236 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:55:04.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:02.695879+0000 osd.6 (osd.6) 270 : cluster [DBG] 2.14 scrub starts 2024-02-19T21:55:04.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:02.698791+0000 osd.6 (osd.6) 271 : cluster [DBG] 2.14 scrub ok 2024-02-19T21:55:04.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:02.831342+0000 osd.0 (osd.0) 301 : cluster [DBG] 4.1f scrub starts 2024-02-19T21:55:04.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:02.838845+0000 osd.0 (osd.0) 302 : cluster [DBG] 4.1f scrub ok 2024-02-19T21:55:04.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:03.393029+0000 mon.b (mon.1) 79 : audit [DBG] from='client.? 172.21.15.80:0/2709256677' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:55:04.393 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:55:04.443 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:05.120 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 65 16 96204 96188 92.4558 63.75 0.0172336 0.0108122 2024-02-19T21:55:05.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:03.262671+0000 mgr.y (mgr.14514) 859 : cluster [DBG] pgmap v1114: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 5.6 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 5.4 KiB/s rd, 56 MiB/s wr, 901 op/s; 54 B/s, 1 objects/s recovering 2024-02-19T21:55:05.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:03.497568+0000 osd.4 (osd.4) 237 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:55:05.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:03.508257+0000 osd.4 (osd.4) 238 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:55:05.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:03.581880+0000 osd.1 (osd.1) 268 : cluster [DBG] 5.0 scrub starts 2024-02-19T21:55:05.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:03.592949+0000 osd.1 (osd.1) 269 : cluster [DBG] 5.0 scrub ok 2024-02-19T21:55:05.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:03.712794+0000 osd.6 (osd.6) 272 : cluster [DBG] 5.11 scrub starts 2024-02-19T21:55:05.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:03.717075+0000 osd.6 (osd.6) 273 : cluster [DBG] 5.11 scrub ok 2024-02-19T21:55:05.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:03.798692+0000 osd.4 (osd.4) 239 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:55:05.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:03.798749+0000 osd.4 (osd.4) 240 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:55:05.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:03.851583+0000 mon.a (mon.0) 1943 : cluster [DBG] osdmap e517: 8 total, 8 up, 8 in 2024-02-19T21:55:05.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:03.936234+0000 osd.2 (osd.2) 39 : cluster [DBG] 11.d scrub starts 2024-02-19T21:55:05.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:03.262671+0000 mgr.y (mgr.14514) 859 : cluster [DBG] pgmap v1114: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 5.6 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 5.4 KiB/s rd, 56 MiB/s wr, 901 op/s; 54 B/s, 1 objects/s recovering 2024-02-19T21:55:05.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:03.497568+0000 osd.4 (osd.4) 237 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:55:05.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:03.508257+0000 osd.4 (osd.4) 238 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:55:05.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:03.581880+0000 osd.1 (osd.1) 268 : cluster [DBG] 5.0 scrub starts 2024-02-19T21:55:05.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:03.592949+0000 osd.1 (osd.1) 269 : cluster [DBG] 5.0 scrub ok 2024-02-19T21:55:05.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:03.712794+0000 osd.6 (osd.6) 272 : cluster [DBG] 5.11 scrub starts 2024-02-19T21:55:05.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:03.717075+0000 osd.6 (osd.6) 273 : cluster [DBG] 5.11 scrub ok 2024-02-19T21:55:05.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:03.798692+0000 osd.4 (osd.4) 239 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:55:05.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:03.798749+0000 osd.4 (osd.4) 240 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:55:05.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:03.851583+0000 mon.a (mon.0) 1943 : cluster [DBG] osdmap e517: 8 total, 8 up, 8 in 2024-02-19T21:55:05.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:03.936234+0000 osd.2 (osd.2) 39 : cluster [DBG] 11.d scrub starts 2024-02-19T21:55:05.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:03.262671+0000 mgr.y (mgr.14514) 859 : cluster [DBG] pgmap v1114: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 5.6 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 5.4 KiB/s rd, 56 MiB/s wr, 901 op/s; 54 B/s, 1 objects/s recovering 2024-02-19T21:55:05.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:03.497568+0000 osd.4 (osd.4) 237 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:55:05.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:03.508257+0000 osd.4 (osd.4) 238 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:55:05.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:03.581880+0000 osd.1 (osd.1) 268 : cluster [DBG] 5.0 scrub starts 2024-02-19T21:55:05.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:03.592949+0000 osd.1 (osd.1) 269 : cluster [DBG] 5.0 scrub ok 2024-02-19T21:55:05.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:03.712794+0000 osd.6 (osd.6) 272 : cluster [DBG] 5.11 scrub starts 2024-02-19T21:55:05.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:03.717075+0000 osd.6 (osd.6) 273 : cluster [DBG] 5.11 scrub ok 2024-02-19T21:55:05.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:03.798692+0000 osd.4 (osd.4) 239 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:55:05.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:03.798749+0000 osd.4 (osd.4) 240 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:55:05.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:03.851583+0000 mon.a (mon.0) 1943 : cluster [DBG] osdmap e517: 8 total, 8 up, 8 in 2024-02-19T21:55:05.349 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:03.936234+0000 osd.2 (osd.2) 39 : cluster [DBG] 11.d scrub starts 2024-02-19T21:55:06.058 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:55:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:55:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:55:06.121 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 66 16 97178 97162 91.9773 60.875 0.0138875 0.0108685 2024-02-19T21:55:06.310 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:55:06.319 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:06.320 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:55:06.333 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:55:06.421 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:55:06.563 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:06.598 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:55:06.600 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:06.601 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:55:06.602 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:04.893016+0000 osd.0 (osd.0) 303 : cluster [DBG] 4.1e scrub starts 2024-02-19T21:55:06.602 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:04.896699+0000 osd.0 (osd.0) 304 : cluster [DBG] 4.1e scrub ok 2024-02-19T21:55:06.602 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:05.263210+0000 mgr.y (mgr.14514) 860 : cluster [DBG] pgmap v1116: 138 pgs: 138 active+clean; 5.8 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 662 B/s rd, 62 MiB/s wr, 998 op/s 2024-02-19T21:55:06.602 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:05.366862+0000 osd.5 (osd.5) 299 : cluster [DBG] 5.15 scrub starts 2024-02-19T21:55:06.602 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:05.379443+0000 osd.5 (osd.5) 300 : cluster [DBG] 5.15 scrub ok 2024-02-19T21:55:06.602 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:05.405782+0000 mon.a (mon.0) 1944 : cluster [DBG] osdmap e518: 8 total, 8 up, 8 in 2024-02-19T21:55:06.603 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:04.893016+0000 osd.0 (osd.0) 303 : cluster [DBG] 4.1e scrub starts 2024-02-19T21:55:06.603 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:04.896699+0000 osd.0 (osd.0) 304 : cluster [DBG] 4.1e scrub ok 2024-02-19T21:55:06.603 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:05.263210+0000 mgr.y (mgr.14514) 860 : cluster [DBG] pgmap v1116: 138 pgs: 138 active+clean; 5.8 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 662 B/s rd, 62 MiB/s wr, 998 op/s 2024-02-19T21:55:06.603 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:05.366862+0000 osd.5 (osd.5) 299 : cluster [DBG] 5.15 scrub starts 2024-02-19T21:55:06.603 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:05.379443+0000 osd.5 (osd.5) 300 : cluster [DBG] 5.15 scrub ok 2024-02-19T21:55:06.603 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:05.405782+0000 mon.a (mon.0) 1944 : cluster [DBG] osdmap e518: 8 total, 8 up, 8 in 2024-02-19T21:55:06.701 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:55:06.760 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:06.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:04.893016+0000 osd.0 (osd.0) 303 : cluster [DBG] 4.1e scrub starts 2024-02-19T21:55:06.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:04.896699+0000 osd.0 (osd.0) 304 : cluster [DBG] 4.1e scrub ok 2024-02-19T21:55:06.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:05.263210+0000 mgr.y (mgr.14514) 860 : cluster [DBG] pgmap v1116: 138 pgs: 138 active+clean; 5.8 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 662 B/s rd, 62 MiB/s wr, 998 op/s 2024-02-19T21:55:06.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:05.366862+0000 osd.5 (osd.5) 299 : cluster [DBG] 5.15 scrub starts 2024-02-19T21:55:06.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:05.379443+0000 osd.5 (osd.5) 300 : cluster [DBG] 5.15 scrub ok 2024-02-19T21:55:06.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:05.405782+0000 mon.a (mon.0) 1944 : cluster [DBG] osdmap e518: 8 total, 8 up, 8 in 2024-02-19T21:55:07.048 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:55:07.121 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 67 16 98153 98137 91.5141 60.9375 0.0224516 0.010922 2024-02-19T21:55:07.126 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:55:07.137 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:07.137 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:55:07.239 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:55:07.338 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:07.589 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:06.318319+0000 osd.2 (osd.2) 40 : cluster [DBG] 11.d scrub ok 2024-02-19T21:55:07.590 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:06.318319+0000 osd.2 (osd.2) 40 : cluster [DBG] 11.d scrub ok 2024-02-19T21:55:07.805 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:06.318319+0000 osd.2 (osd.2) 40 : cluster [DBG] 11.d scrub ok 2024-02-19T21:55:08.121 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 68 16 98956 98940 90.9064 50.1875 0.00323365 0.0109911 2024-02-19T21:55:08.618 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:55:08.624 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:08.625 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:55:08.726 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:55:08.771 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:55:08.773 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:06.654347+0000 osd.1 (osd.1) 270 : cluster [DBG] 6.4 scrub starts 2024-02-19T21:55:08.773 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:06.665512+0000 osd.1 (osd.1) 271 : cluster [DBG] 6.4 scrub ok 2024-02-19T21:55:08.773 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:06.810235+0000 osd.0 (osd.0) 305 : cluster [DBG] 4.b scrub starts 2024-02-19T21:55:08.774 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:06.814585+0000 osd.0 (osd.0) 306 : cluster [DBG] 4.b scrub ok 2024-02-19T21:55:08.774 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:07.082568+0000 osd.2 (osd.2) 41 : cluster [DBG] 5.b scrub starts 2024-02-19T21:55:08.774 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:07.096178+0000 osd.2 (osd.2) 42 : cluster [DBG] 5.b scrub ok 2024-02-19T21:55:08.774 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:07.263795+0000 mgr.y (mgr.14514) 861 : cluster [DBG] pgmap v1118: 138 pgs: 138 active+clean; 5.9 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 596 B/s rd, 47 MiB/s wr, 755 op/s 2024-02-19T21:55:08.774 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:08.787 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:55:08.794 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:55:08.797 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:08.797 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:55:08.820 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:06.654347+0000 osd.1 (osd.1) 270 : cluster [DBG] 6.4 scrub starts 2024-02-19T21:55:08.820 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:06.665512+0000 osd.1 (osd.1) 271 : cluster [DBG] 6.4 scrub ok 2024-02-19T21:55:08.820 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:06.810235+0000 osd.0 (osd.0) 305 : cluster [DBG] 4.b scrub starts 2024-02-19T21:55:08.821 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:06.814585+0000 osd.0 (osd.0) 306 : cluster [DBG] 4.b scrub ok 2024-02-19T21:55:08.821 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:07.082568+0000 osd.2 (osd.2) 41 : cluster [DBG] 5.b scrub starts 2024-02-19T21:55:08.821 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:07.096178+0000 osd.2 (osd.2) 42 : cluster [DBG] 5.b scrub ok 2024-02-19T21:55:08.821 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:07.263795+0000 mgr.y (mgr.14514) 861 : cluster [DBG] pgmap v1118: 138 pgs: 138 active+clean; 5.9 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 596 B/s rd, 47 MiB/s wr, 755 op/s 2024-02-19T21:55:08.821 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:06.654347+0000 osd.1 (osd.1) 270 : cluster [DBG] 6.4 scrub starts 2024-02-19T21:55:08.821 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:06.665512+0000 osd.1 (osd.1) 271 : cluster [DBG] 6.4 scrub ok 2024-02-19T21:55:08.821 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:06.810235+0000 osd.0 (osd.0) 305 : cluster [DBG] 4.b scrub starts 2024-02-19T21:55:08.821 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:06.814585+0000 osd.0 (osd.0) 306 : cluster [DBG] 4.b scrub ok 2024-02-19T21:55:08.821 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:07.082568+0000 osd.2 (osd.2) 41 : cluster [DBG] 5.b scrub starts 2024-02-19T21:55:08.822 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:07.096178+0000 osd.2 (osd.2) 42 : cluster [DBG] 5.b scrub ok 2024-02-19T21:55:08.822 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:07.263795+0000 mgr.y (mgr.14514) 861 : cluster [DBG] pgmap v1118: 138 pgs: 138 active+clean; 5.9 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 596 B/s rd, 47 MiB/s wr, 755 op/s 2024-02-19T21:55:08.898 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:55:08.905 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:55:08.905 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-02-19T21:55:08.905 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-02-19T21:55:08.905 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-02-19T21:55:08.905 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.905 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.15345.0:216535 9.1 e357/356 9:86425105:::benchmark_data_smithi080_126364_object87943:head v 357'13463, mlcod=0'0)", 2024-02-19T21:55:08.905 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:34.581319+0000", 2024-02-19T21:55:08.905 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 452.43600468099999, 2024-02-19T21:55:08.905 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.045199969999999999, 2024-02-19T21:55:08.905 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:55:08.905 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:08.906 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:55:08.906 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.906 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:55:08.906 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.581319+0000", 2024-02-19T21:55:08.906 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:55:08.906 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.906 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.906 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:55:08.906 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.581319+0000", 2024-02-19T21:55:08.906 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:55:08.906 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.906 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.906 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:55:08.906 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.581318+0000", 2024-02-19T21:55:08.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9010000000000006e-06 2024-02-19T21:55:08.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.907 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.907 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:55:08.907 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.581328+0000", 2024-02-19T21:55:08.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.279e-05 2024-02-19T21:55:08.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.907 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.907 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:55:08.907 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.581341+0000", 2024-02-19T21:55:08.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3409999999999999e-06 2024-02-19T21:55:08.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.908 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.908 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:55:08.908 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.581347+0000", 2024-02-19T21:55:08.908 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5249e-05 2024-02-19T21:55:08.908 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.908 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.908 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:55:08.908 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.581392+0000", 2024-02-19T21:55:08.908 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7216000000000002e-05 2024-02-19T21:55:08.909 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.909 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.909 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:55:08.909 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.581419+0000", 2024-02-19T21:55:08.909 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.045052944999999997 2024-02-19T21:55:08.909 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.909 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.909 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:55:08.909 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.626472+0000", 2024-02-19T21:55:08.909 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6618e-05 2024-02-19T21:55:08.909 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.909 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.909 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:55:08.909 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:34.626519+0000", 2024-02-19T21:55:08.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.045199969999999999 2024-02-19T21:55:08.910 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.910 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:55:08.910 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.910 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.15345.0:225737 9.4 e362/356 9:2a3c6b5d:::benchmark_data_smithi080_126364_object97145:head v 362'14161, mlcod=361'14159)", 2024-02-19T21:55:08.910 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:45.267876+0000", 2024-02-19T21:55:08.910 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 441.74944801700002, 2024-02-19T21:55:08.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.038394027999999997, 2024-02-19T21:55:08.910 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:55:08.910 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:08.910 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:55:08.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:55:08.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.267876+0000", 2024-02-19T21:55:08.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:55:08.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.911 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:55:08.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.267876+0000", 2024-02-19T21:55:08.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:55:08.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.911 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:55:08.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.267874+0000", 2024-02-19T21:55:08.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4468e-05 2024-02-19T21:55:08.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.912 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.912 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:55:08.912 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.267899+0000", 2024-02-19T21:55:08.912 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3504000000000001e-05 2024-02-19T21:55:08.912 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.912 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.912 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:55:08.912 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.267922+0000", 2024-02-19T21:55:08.912 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5440000000000001e-06 2024-02-19T21:55:08.912 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.912 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.912 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:55:08.912 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.267930+0000", 2024-02-19T21:55:08.912 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9568000000000003e-05 2024-02-19T21:55:08.913 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.913 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.913 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:55:08.913 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.267989+0000", 2024-02-19T21:55:08.913 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9712e-05 2024-02-19T21:55:08.913 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.913 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.913 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:55:08.913 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.268009+0000", 2024-02-19T21:55:08.913 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.038208863000000003 2024-02-19T21:55:08.913 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.913 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.913 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:55:08.913 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.306218+0000", 2024-02-19T21:55:08.913 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1802000000000003e-05 2024-02-19T21:55:08.914 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.914 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.914 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:55:08.914 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.306270+0000", 2024-02-19T21:55:08.914 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.038394027999999997 2024-02-19T21:55:08.914 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.914 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:55:08.914 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.914 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.914 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.915 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.15345.0:225735 9.1 e362/356 9:84bfd385:::benchmark_data_smithi080_126364_object97143:head v 362'14000, mlcod=361'13998)", 2024-02-19T21:55:08.915 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:45.268417+0000", 2024-02-19T21:55:08.915 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 441.74890683500001, 2024-02-19T21:55:08.915 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.041499975000000001, 2024-02-19T21:55:08.915 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:55:08.915 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:08.915 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:55:08.915 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.915 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:55:08.915 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.268417+0000", 2024-02-19T21:55:08.915 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:55:08.915 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.915 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.915 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:55:08.916 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.268417+0000", 2024-02-19T21:55:08.916 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:55:08.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.916 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.916 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:55:08.916 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.268417+0000", 2024-02-19T21:55:08.916 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2019999999999997e-06 2024-02-19T21:55:08.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.916 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.916 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:55:08.916 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.268421+0000", 2024-02-19T21:55:08.916 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2697999999999999e-05 2024-02-19T21:55:08.917 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.917 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.917 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:55:08.917 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.268433+0000", 2024-02-19T21:55:08.917 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4759999999999997e-06 2024-02-19T21:55:08.917 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.917 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.917 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:55:08.917 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.268439+0000", 2024-02-19T21:55:08.917 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1921000000000003e-05 2024-02-19T21:55:08.917 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.917 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.917 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:55:08.917 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.268531+0000", 2024-02-19T21:55:08.918 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0839000000000002e-05 2024-02-19T21:55:08.918 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.918 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.918 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:55:08.918 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.268552+0000", 2024-02-19T21:55:08.918 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.041312763000000002 2024-02-19T21:55:08.918 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.918 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.918 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:55:08.918 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.309864+0000", 2024-02-19T21:55:08.919 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2336000000000002e-05 2024-02-19T21:55:08.919 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.919 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.919 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:55:08.919 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:45.309917+0000", 2024-02-19T21:55:08.919 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.041499975000000001 2024-02-19T21:55:08.919 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.919 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:55:08.919 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.919 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.919 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.919 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.15345.0:228828 9.1 e364/356 9:8a1f5058:::benchmark_data_smithi080_126364_object100236:head v 364'14198, mlcod=364'14196)", 2024-02-19T21:55:08.919 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:47:50.250828+0000", 2024-02-19T21:55:08.919 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 436.76649570000001, 2024-02-19T21:55:08.919 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.03925472, 2024-02-19T21:55:08.920 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:55:08.920 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:08.920 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:55:08.920 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.920 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:55:08.920 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:50.250828+0000", 2024-02-19T21:55:08.920 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:55:08.920 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.920 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.920 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:55:08.920 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:50.250828+0000", 2024-02-19T21:55:08.920 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:55:08.920 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.921 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.921 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:55:08.921 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:50.250826+0000", 2024-02-19T21:55:08.921 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5401e-05 2024-02-19T21:55:08.921 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.921 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.921 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:55:08.921 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:50.250842+0000", 2024-02-19T21:55:08.921 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9510000000000001e-05 2024-02-19T21:55:08.921 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.921 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.921 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:55:08.921 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:50.250861+0000", 2024-02-19T21:55:08.921 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9449999999999999e-06 2024-02-19T21:55:08.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.922 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.922 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:55:08.922 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:50.250870+0000", 2024-02-19T21:55:08.922 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4363999999999997e-05 2024-02-19T21:55:08.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.922 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.922 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:55:08.922 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:50.250914+0000", 2024-02-19T21:55:08.922 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2359000000000001e-05 2024-02-19T21:55:08.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.922 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.922 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:55:08.922 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:50.250937+0000", 2024-02-19T21:55:08.922 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.039103493000000003 2024-02-19T21:55:08.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.923 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.923 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:55:08.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:50.290040+0000", 2024-02-19T21:55:08.923 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2527999999999997e-05 2024-02-19T21:55:08.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.923 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.923 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:55:08.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:47:50.290083+0000", 2024-02-19T21:55:08.923 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.03925472 2024-02-19T21:55:08.923 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.923 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:55:08.923 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.923 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.923 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:15515 11.a 11:54459152:::benchmark_data_smithi080_184406_object15514:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e498)", 2024-02-19T21:55:08.924 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:54:05.404598+0000", 2024-02-19T21:55:08.924 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 61.612726010000003, 2024-02-19T21:55:08.924 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.052786052, 2024-02-19T21:55:08.924 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:55:08.924 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:08.924 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:55:08.924 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:55:08.924 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:55:08.924 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 15515 2024-02-19T21:55:08.924 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.924 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:55:08.924 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.924 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:55:08.924 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:05.404598+0000", 2024-02-19T21:55:08.925 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:55:08.925 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.925 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.925 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:55:08.925 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:05.404598+0000", 2024-02-19T21:55:08.925 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999971 2024-02-19T21:55:08.925 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.925 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.925 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:55:08.925 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:05.404595+0000", 2024-02-19T21:55:08.925 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9978e-05 2024-02-19T21:55:08.925 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.925 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.925 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:55:08.926 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:05.404625+0000", 2024-02-19T21:55:08.926 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6784999999999999e-05 2024-02-19T21:55:08.926 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.926 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.926 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:55:08.926 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:05.404652+0000", 2024-02-19T21:55:08.926 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6770000000000007e-06 2024-02-19T21:55:08.926 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.926 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.926 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:55:08.926 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:05.404661+0000", 2024-02-19T21:55:08.926 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2711999999999999e-05 2024-02-19T21:55:08.926 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.926 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.926 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:55:08.927 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:05.404714+0000", 2024-02-19T21:55:08.927 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012682500000000001 2024-02-19T21:55:08.927 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.927 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.927 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:55:08.927 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:05.404841+0000", 2024-02-19T21:55:08.927 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015411900000000001 2024-02-19T21:55:08.927 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.927 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.927 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:55:08.927 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:05.404995+0000", 2024-02-19T21:55:08.927 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0084874600000000005 2024-02-19T21:55:08.927 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.927 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.927 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:08.928 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:05.413483+0000", 2024-02-19T21:55:08.928 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001682998 2024-02-19T21:55:08.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.928 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:08.928 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:05.415166+0000", 2024-02-19T21:55:08.928 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.042125686000000002 2024-02-19T21:55:08.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.928 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:55:08.928 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:05.457291+0000", 2024-02-19T21:55:08.928 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8328999999999998e-05 2024-02-19T21:55:08.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:55:08.929 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:05.457340+0000", 2024-02-19T21:55:08.929 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4171000000000001e-05 2024-02-19T21:55:08.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:55:08.929 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:05.457384+0000", 2024-02-19T21:55:08.929 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.052786052 2024-02-19T21:55:08.929 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.929 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:55:08.929 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.929 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:64338 11.a 11:5a815dad:::benchmark_data_smithi080_184406_object64337:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e506)", 2024-02-19T21:55:08.929 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:54:35.006536+0000", 2024-02-19T21:55:08.930 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 32.010787188999998, 2024-02-19T21:55:08.930 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.047286742, 2024-02-19T21:55:08.930 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:55:08.930 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:08.930 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:55:08.930 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:55:08.930 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:55:08.930 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 64338 2024-02-19T21:55:08.930 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.930 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:55:08.930 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.930 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:55:08.930 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.006536+0000", 2024-02-19T21:55:08.930 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:55:08.930 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.931 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.931 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:55:08.931 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.006536+0000", 2024-02-19T21:55:08.931 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:55:08.931 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.931 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.931 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:55:08.931 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.006535+0000", 2024-02-19T21:55:08.931 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7004000000000001e-05 2024-02-19T21:55:08.931 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.931 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.931 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:55:08.931 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.006562+0000", 2024-02-19T21:55:08.931 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1232e-05 2024-02-19T21:55:08.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.932 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.932 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:55:08.932 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.006573+0000", 2024-02-19T21:55:08.932 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8930000000000002e-06 2024-02-19T21:55:08.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.932 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.932 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:55:08.932 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.006579+0000", 2024-02-19T21:55:08.932 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5371000000000003e-05 2024-02-19T21:55:08.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.932 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.932 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:55:08.932 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.006624+0000", 2024-02-19T21:55:08.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012634899999999999 2024-02-19T21:55:08.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:55:08.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.006750+0000", 2024-02-19T21:55:08.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014919600000000001 2024-02-19T21:55:08.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:55:08.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.006900+0000", 2024-02-19T21:55:08.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0048966210000000003 2024-02-19T21:55:08.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:55:08.934 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.011796+0000", 2024-02-19T21:55:08.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.039719275999999998 2024-02-19T21:55:08.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:08.934 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.051515+0000", 2024-02-19T21:55:08.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0021997499999999999 2024-02-19T21:55:08.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:08.934 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.053715+0000", 2024-02-19T21:55:08.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2186000000000004e-05 2024-02-19T21:55:08.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.935 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:55:08.935 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.053777+0000", 2024-02-19T21:55:08.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5849000000000001e-05 2024-02-19T21:55:08.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.935 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:55:08.935 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.053823+0000", 2024-02-19T21:55:08.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.047286742 2024-02-19T21:55:08.935 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.935 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:55:08.935 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.935 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:64340 11.a 11:5aa76131:::benchmark_data_smithi080_184406_object64339:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e506)", 2024-02-19T21:55:08.935 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:54:35.006592+0000", 2024-02-19T21:55:08.936 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 32.010731591000003, 2024-02-19T21:55:08.936 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.047350883000000003, 2024-02-19T21:55:08.936 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:55:08.936 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:08.936 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:55:08.936 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:55:08.936 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:55:08.936 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 64340 2024-02-19T21:55:08.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.936 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:55:08.936 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.936 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:55:08.936 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.006592+0000", 2024-02-19T21:55:08.936 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:55:08.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:55:08.937 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.006592+0000", 2024-02-19T21:55:08.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:55:08.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:55:08.937 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.006592+0000", 2024-02-19T21:55:08.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9341999999999999e-05 2024-02-19T21:55:08.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:55:08.937 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.006611+0000", 2024-02-19T21:55:08.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1080000000000004e-06 2024-02-19T21:55:08.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.938 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:55:08.938 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.006618+0000", 2024-02-19T21:55:08.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.997e-06 2024-02-19T21:55:08.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.938 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:55:08.938 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.006622+0000", 2024-02-19T21:55:08.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026368350000000001 2024-02-19T21:55:08.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.938 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:55:08.938 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.009259+0000", 2024-02-19T21:55:08.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015774699999999999 2024-02-19T21:55:08.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:55:08.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.009417+0000", 2024-02-19T21:55:08.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019890700000000001 2024-02-19T21:55:08.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:55:08.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.009615+0000", 2024-02-19T21:55:08.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0021872860000000001 2024-02-19T21:55:08.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:55:08.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.011803+0000", 2024-02-19T21:55:08.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.039791585999999997 2024-02-19T21:55:08.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:08.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.051594+0000", 2024-02-19T21:55:08.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022672349999999998 2024-02-19T21:55:08.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:08.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.053862+0000", 2024-02-19T21:55:08.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4354999999999998e-05 2024-02-19T21:55:08.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:55:08.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.053906+0000", 2024-02-19T21:55:08.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7064999999999998e-05 2024-02-19T21:55:08.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.941 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:55:08.941 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.053943+0000", 2024-02-19T21:55:08.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.047350883000000003 2024-02-19T21:55:08.941 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.941 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:55:08.941 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.941 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:64343 11.a 11:5ecefde8:::benchmark_data_smithi080_184406_object64342:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e507)", 2024-02-19T21:55:08.941 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:54:35.010302+0000", 2024-02-19T21:55:08.941 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 32.007021301999998, 2024-02-19T21:55:08.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.054592672000000002, 2024-02-19T21:55:08.941 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:55:08.942 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:08.942 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:55:08.942 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:55:08.942 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:55:08.942 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 64343 2024-02-19T21:55:08.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.942 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:55:08.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.942 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:55:08.942 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.010302+0000", 2024-02-19T21:55:08.942 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:55:08.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.942 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:55:08.942 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.010302+0000", 2024-02-19T21:55:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:55:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:55:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.010301+0000", 2024-02-19T21:55:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6550000000000002e-05 2024-02-19T21:55:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:55:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.010327+0000", 2024-02-19T21:55:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3281e-05 2024-02-19T21:55:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:55:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.010341+0000", 2024-02-19T21:55:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7309999999999998e-06 2024-02-19T21:55:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:55:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.010346+0000", 2024-02-19T21:55:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00121115 2024-02-19T21:55:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:55:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.011558+0000", 2024-02-19T21:55:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3939999999999998e-06 2024-02-19T21:55:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-02-19T21:55:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.011565+0000", 2024-02-19T21:55:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.042544724999999999 2024-02-19T21:55:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:55:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.054110+0000", 2024-02-19T21:55:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014235499999999999 2024-02-19T21:55:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:55:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.054252+0000", 2024-02-19T21:55:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000175613 2024-02-19T21:55:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:55:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.054428+0000", 2024-02-19T21:55:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046812399999999997 2024-02-19T21:55:08.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:55:08.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.059109+0000", 2024-02-19T21:55:08.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032330990000000001 2024-02-19T21:55:08.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:08.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.062342+0000", 2024-02-19T21:55:08.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024705349999999998 2024-02-19T21:55:08.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:08.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.064813+0000", 2024-02-19T21:55:08.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7830999999999997e-05 2024-02-19T21:55:08.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:55:08.947 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.064850+0000", 2024-02-19T21:55:08.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4718000000000001e-05 2024-02-19T21:55:08.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:55:08.947 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.064895+0000", 2024-02-19T21:55:08.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.054592672000000002 2024-02-19T21:55:08.947 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.947 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:55:08.947 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop_reply(client.25952.0:64338 11.a e507/492 ondisk, result = 0)", 2024-02-19T21:55:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:54:35.015073+0000", 2024-02-19T21:55:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 32.002250353000001, 2024-02-19T21:55:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.038755669999999999, 2024-02-19T21:55:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:55:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:55:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:55:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:55:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.015073+0000", 2024-02-19T21:55:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:55:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:55:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.015073+0000", 2024-02-19T21:55:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:55:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:55:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.015072+0000", 2024-02-19T21:55:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9859999999999997e-06 2024-02-19T21:55:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:55:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.015079+0000", 2024-02-19T21:55:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.038508923 2024-02-19T21:55:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:55:08.950 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.053588+0000", 2024-02-19T21:55:08.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9230000000000002e-06 2024-02-19T21:55:08.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:55:08.950 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.053596+0000", 2024-02-19T21:55:08.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101847 2024-02-19T21:55:08.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:55:08.950 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.053698+0000", 2024-02-19T21:55:08.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9809999999999992e-06 2024-02-19T21:55:08.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:55:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.053707+0000", 2024-02-19T21:55:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121885 2024-02-19T21:55:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:55:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.053829+0000", 2024-02-19T21:55:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.038755669999999999 2024-02-19T21:55:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:55:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop_reply(client.25952.0:64338 11.a e506/492 ondisk, result = 0)", 2024-02-19T21:55:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:54:35.018629+0000", 2024-02-19T21:55:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 31.998694338, 2024-02-19T21:55:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.032888711000000001, 2024-02-19T21:55:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:55:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:55:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:55:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:55:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.018629+0000", 2024-02-19T21:55:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:55:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:55:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.018629+0000", 2024-02-19T21:55:08.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:55:08.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.953 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:55:08.953 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.018628+0000", 2024-02-19T21:55:08.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0053e-05 2024-02-19T21:55:08.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.953 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:55:08.953 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.018638+0000", 2024-02-19T21:55:08.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.032806799999999997 2024-02-19T21:55:08.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.953 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:55:08.953 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.051445+0000", 2024-02-19T21:55:08.954 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3175e-05 2024-02-19T21:55:08.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.954 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:55:08.954 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.051458+0000", 2024-02-19T21:55:08.954 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0184e-05 2024-02-19T21:55:08.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.954 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:55:08.954 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.051498+0000", 2024-02-19T21:55:08.954 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9509999999999995e-06 2024-02-19T21:55:08.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.954 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:55:08.954 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.051507+0000", 2024-02-19T21:55:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1088e-05 2024-02-19T21:55:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:55:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.051518+0000", 2024-02-19T21:55:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.032888711000000001 2024-02-19T21:55:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:55:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:64854 11.a 11:5da294d4:::benchmark_data_smithi080_184406_object64853:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e508)", 2024-02-19T21:55:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:54:35.438645+0000", 2024-02-19T21:55:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 31.578678798999999, 2024-02-19T21:55:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.070227207, 2024-02-19T21:55:08.956 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:55:08.956 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:08.956 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:55:08.956 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:55:08.956 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:55:08.956 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 64854 2024-02-19T21:55:08.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.956 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:55:08.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.956 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:55:08.956 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.438645+0000", 2024-02-19T21:55:08.956 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:55:08.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.956 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:55:08.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.438645+0000", 2024-02-19T21:55:08.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999976 2024-02-19T21:55:08.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:55:08.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.438643+0000", 2024-02-19T21:55:08.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6633000000000001e-05 2024-02-19T21:55:08.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:55:08.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.438669+0000", 2024-02-19T21:55:08.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7487e-05 2024-02-19T21:55:08.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:55:08.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.438687+0000", 2024-02-19T21:55:08.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4390000000000003e-06 2024-02-19T21:55:08.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:55:08.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.438694+0000", 2024-02-19T21:55:08.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2873e-05 2024-02-19T21:55:08.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:55:08.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.438747+0000", 2024-02-19T21:55:08.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1768000000000006e-05 2024-02-19T21:55:08.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.959 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:55:08.959 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.438839+0000", 2024-02-19T21:55:08.959 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014302 2024-02-19T21:55:08.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.959 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.959 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:55:08.959 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.438982+0000", 2024-02-19T21:55:08.959 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034344969999999999 2024-02-19T21:55:08.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.959 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.959 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:08.959 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.442416+0000", 2024-02-19T21:55:08.959 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073146239999999996 2024-02-19T21:55:08.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:08.960 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.449731+0000", 2024-02-19T21:55:08.960 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.059037992999999997 2024-02-19T21:55:08.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:55:08.960 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.508769+0000", 2024-02-19T21:55:08.960 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9002000000000002e-05 2024-02-19T21:55:08.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:55:08.960 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.508828+0000", 2024-02-19T21:55:08.960 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4106000000000001e-05 2024-02-19T21:55:08.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.961 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:55:08.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:35.508872+0000", 2024-02-19T21:55:08.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.070227207 2024-02-19T21:55:08.961 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.961 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:55:08.961 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.961 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:65529 11.a 11:5ee32d78:::benchmark_data_smithi080_184406_object65528:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e508)", 2024-02-19T21:55:08.961 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:54:36.066641+0000", 2024-02-19T21:55:08.961 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 30.950682989000001, 2024-02-19T21:55:08.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.047969584000000003, 2024-02-19T21:55:08.961 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:55:08.961 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:08.962 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:55:08.962 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:55:08.962 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:55:08.962 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 65529 2024-02-19T21:55:08.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.962 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:55:08.962 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.962 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:55:08.962 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:36.066641+0000", 2024-02-19T21:55:08.962 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:55:08.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.962 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.962 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:55:08.962 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:36.066641+0000", 2024-02-19T21:55:08.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999976 2024-02-19T21:55:08.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:55:08.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:36.066638+0000", 2024-02-19T21:55:08.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4369999999999999e-05 2024-02-19T21:55:08.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:55:08.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:36.066663+0000", 2024-02-19T21:55:08.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8238000000000001e-05 2024-02-19T21:55:08.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:55:08.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:36.066681+0000", 2024-02-19T21:55:08.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2620000000000004e-06 2024-02-19T21:55:08.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:55:08.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:36.066687+0000", 2024-02-19T21:55:08.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8053999999999996e-05 2024-02-19T21:55:08.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:55:08.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:36.066755+0000", 2024-02-19T21:55:08.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000100997 2024-02-19T21:55:08.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:55:08.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:36.066856+0000", 2024-02-19T21:55:08.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109676 2024-02-19T21:55:08.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.965 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:55:08.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:36.066966+0000", 2024-02-19T21:55:08.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.006304685 2024-02-19T21:55:08.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.965 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:08.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:36.073271+0000", 2024-02-19T21:55:08.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043675700000000002 2024-02-19T21:55:08.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.965 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:08.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:36.073707+0000", 2024-02-19T21:55:08.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.040803758000000002 2024-02-19T21:55:08.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:55:08.966 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:36.114511+0000", 2024-02-19T21:55:08.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9410999999999998e-05 2024-02-19T21:55:08.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:55:08.966 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:36.114571+0000", 2024-02-19T21:55:08.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9687000000000001e-05 2024-02-19T21:55:08.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:55:08.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:36.114610+0000", 2024-02-19T21:55:08.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.047969584000000003 2024-02-19T21:55:08.967 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.967 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:55:08.967 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.967 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:65533 11.a 11:5102c773:::benchmark_data_smithi080_184406_object65532:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e508)", 2024-02-19T21:55:08.967 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:54:36.066702+0000", 2024-02-19T21:55:08.967 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 30.950621648999999, 2024-02-19T21:55:08.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.047995425000000001, 2024-02-19T21:55:08.967 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:55:08.967 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:08.967 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:55:08.967 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:55:08.968 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:55:08.968 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 65533 2024-02-19T21:55:08.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.968 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:55:08.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.968 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:55:08.968 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:36.066702+0000", 2024-02-19T21:55:08.968 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:55:08.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.968 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:55:08.968 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:36.066702+0000", 2024-02-19T21:55:08.968 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:55:08.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:55:08.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:36.066702+0000", 2024-02-19T21:55:08.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5540999999999999e-05 2024-02-19T21:55:08.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:55:08.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:36.066717+0000", 2024-02-19T21:55:08.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7169999999999996e-06 2024-02-19T21:55:08.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:55:08.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:36.066723+0000", 2024-02-19T21:55:08.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.695e-06 2024-02-19T21:55:08.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:55:08.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:36.066726+0000", 2024-02-19T21:55:08.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023878150000000002 2024-02-19T21:55:08.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:55:08.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:36.069113+0000", 2024-02-19T21:55:08.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014841999999999999 2024-02-19T21:55:08.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:55:08.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:36.069262+0000", 2024-02-19T21:55:08.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015889300000000001 2024-02-19T21:55:08.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:55:08.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:36.069421+0000", 2024-02-19T21:55:08.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038891799999999999 2024-02-19T21:55:08.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:08.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:36.073310+0000", 2024-02-19T21:55:08.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043337699999999998 2024-02-19T21:55:08.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:08.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:36.073743+0000", 2024-02-19T21:55:08.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.040876093000000002 2024-02-19T21:55:08.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:55:08.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:36.114619+0000", 2024-02-19T21:55:08.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3742000000000002e-05 2024-02-19T21:55:08.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:55:08.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:36.114663+0000", 2024-02-19T21:55:08.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4403000000000002e-05 2024-02-19T21:55:08.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:55:08.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:36.114697+0000", 2024-02-19T21:55:08.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.047995425000000001 2024-02-19T21:55:08.972 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.972 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:55:08.972 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.973 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:68053 11.a 11:59c57823:::benchmark_data_smithi080_184406_object68052:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e508)", 2024-02-19T21:55:08.973 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:54:38.056652+0000", 2024-02-19T21:55:08.973 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 28.960671675, 2024-02-19T21:55:08.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023691751, 2024-02-19T21:55:08.973 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:55:08.973 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:08.973 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:55:08.973 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:55:08.973 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:55:08.973 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 68053 2024-02-19T21:55:08.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.973 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:55:08.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.974 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:55:08.974 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:38.056652+0000", 2024-02-19T21:55:08.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:55:08.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.974 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:55:08.974 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:38.056652+0000", 2024-02-19T21:55:08.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:55:08.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.974 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:55:08.974 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:38.056651+0000", 2024-02-19T21:55:08.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2901e-05 2024-02-19T21:55:08.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:55:08.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:38.056674+0000", 2024-02-19T21:55:08.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2089999999999999e-05 2024-02-19T21:55:08.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:55:08.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:38.056686+0000", 2024-02-19T21:55:08.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6999999999999999e-06 2024-02-19T21:55:08.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:55:08.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:38.056691+0000", 2024-02-19T21:55:08.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0058259829999999999 2024-02-19T21:55:08.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:55:08.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:38.062517+0000", 2024-02-19T21:55:08.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018122099999999999 2024-02-19T21:55:08.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:55:08.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:38.062698+0000", 2024-02-19T21:55:08.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018736499999999999 2024-02-19T21:55:08.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:55:08.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:38.062886+0000", 2024-02-19T21:55:08.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022482629999999999 2024-02-19T21:55:08.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:55:08.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:38.065134+0000", 2024-02-19T21:55:08.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0072075230000000004 2024-02-19T21:55:08.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:08.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:38.072342+0000", 2024-02-19T21:55:08.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0079021000000000004 2024-02-19T21:55:08.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:08.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:38.080244+0000", 2024-02-19T21:55:08.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9825999999999999e-05 2024-02-19T21:55:08.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:55:08.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:38.080303+0000", 2024-02-19T21:55:08.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0323e-05 2024-02-19T21:55:08.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:55:08.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:38.080344+0000", 2024-02-19T21:55:08.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023691751 2024-02-19T21:55:08.978 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.978 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:55:08.978 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.979 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:70776 11.a 11:5a0aa4a3:::benchmark_data_smithi080_184406_object70775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e509)", 2024-02-19T21:55:08.979 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:54:40.367186+0000", 2024-02-19T21:55:08.979 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 26.65013794, 2024-02-19T21:55:08.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025759232, 2024-02-19T21:55:08.979 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:55:08.979 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:08.979 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:55:08.979 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:55:08.979 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:55:08.979 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 70776 2024-02-19T21:55:08.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.979 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:55:08.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:55:08.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:40.367186+0000", 2024-02-19T21:55:08.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:55:08.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:55:08.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:40.367186+0000", 2024-02-19T21:55:08.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:55:08.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:55:08.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:40.367184+0000", 2024-02-19T21:55:08.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2027000000000001e-05 2024-02-19T21:55:08.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:55:08.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:40.367206+0000", 2024-02-19T21:55:08.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4230000000000005e-06 2024-02-19T21:55:08.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:55:08.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:40.367215+0000", 2024-02-19T21:55:08.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4399999999999998e-06 2024-02-19T21:55:08.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:55:08.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:40.367219+0000", 2024-02-19T21:55:08.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031317739999999999 2024-02-19T21:55:08.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:55:08.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:40.370351+0000", 2024-02-19T21:55:08.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4491e-05 2024-02-19T21:55:08.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:55:08.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:40.370445+0000", 2024-02-19T21:55:08.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000146246 2024-02-19T21:55:08.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:55:08.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:40.370592+0000", 2024-02-19T21:55:08.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036278949999999999 2024-02-19T21:55:08.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:55:08.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:40.374220+0000", 2024-02-19T21:55:08.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087353359999999998 2024-02-19T21:55:08.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:08.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:40.382955+0000", 2024-02-19T21:55:08.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0099164879999999993 2024-02-19T21:55:08.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:08.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:40.392871+0000", 2024-02-19T21:55:08.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1699000000000002e-05 2024-02-19T21:55:08.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:55:08.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:40.392913+0000", 2024-02-19T21:55:08.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1838999999999998e-05 2024-02-19T21:55:08.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:55:08.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:40.392945+0000", 2024-02-19T21:55:08.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025759232 2024-02-19T21:55:08.984 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.985 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:55:08.985 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.985 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:76161 11.a 11:5f43add8:::benchmark_data_smithi080_184406_object76160:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e510)", 2024-02-19T21:55:08.985 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:54:45.430388+0000", 2024-02-19T21:55:08.985 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.586935882999999, 2024-02-19T21:55:08.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.058910441000000001, 2024-02-19T21:55:08.985 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:55:08.985 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:08.985 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:55:08.985 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:55:08.985 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:55:08.985 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 76161 2024-02-19T21:55:08.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.985 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:55:08.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:55:08.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:45.430388+0000", 2024-02-19T21:55:08.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:55:08.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:55:08.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:45.430388+0000", 2024-02-19T21:55:08.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999976 2024-02-19T21:55:08.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:55:08.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:45.430385+0000", 2024-02-19T21:55:08.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6239000000000003e-05 2024-02-19T21:55:08.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:55:08.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:45.430422+0000", 2024-02-19T21:55:08.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3025999999999999e-05 2024-02-19T21:55:08.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:55:08.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:45.430445+0000", 2024-02-19T21:55:08.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8729999999999996e-06 2024-02-19T21:55:08.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:55:08.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:45.430454+0000", 2024-02-19T21:55:08.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00073405300000000003 2024-02-19T21:55:08.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.988 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:55:08.988 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:45.431188+0000", 2024-02-19T21:55:08.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017094699999999999 2024-02-19T21:55:08.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.988 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:55:08.988 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:45.431359+0000", 2024-02-19T21:55:08.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000170543 2024-02-19T21:55:08.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.988 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:55:08.988 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:45.431529+0000", 2024-02-19T21:55:08.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050670359999999996 2024-02-19T21:55:08.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:08.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:45.436596+0000", 2024-02-19T21:55:08.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000254827 2024-02-19T21:55:08.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:08.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:45.436851+0000", 2024-02-19T21:55:08.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.052334885999999997 2024-02-19T21:55:08.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:55:08.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:45.489186+0000", 2024-02-19T21:55:08.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7910999999999994e-05 2024-02-19T21:55:08.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:55:08.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:45.489254+0000", 2024-02-19T21:55:08.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4484999999999998e-05 2024-02-19T21:55:08.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:55:08.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:45.489298+0000", 2024-02-19T21:55:08.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.058910441000000001 2024-02-19T21:55:08.990 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.990 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:55:08.990 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.991 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:76168 11.a 11:5af19dbc:::benchmark_data_smithi080_184406_object76167:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e510)", 2024-02-19T21:55:08.991 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:54:45.430472+0000", 2024-02-19T21:55:08.991 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.586851541000001, 2024-02-19T21:55:08.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.058902877999999999, 2024-02-19T21:55:08.991 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:55:08.991 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:08.991 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:55:08.991 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:55:08.991 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:55:08.991 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 76168 2024-02-19T21:55:08.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.991 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:55:08.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:55:08.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:45.430472+0000", 2024-02-19T21:55:08.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:55:08.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:55:08.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:45.430472+0000", 2024-02-19T21:55:08.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:55:08.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:55:08.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:45.430471+0000", 2024-02-19T21:55:08.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3765e-05 2024-02-19T21:55:08.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:55:08.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:45.430495+0000", 2024-02-19T21:55:08.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7830000000000004e-06 2024-02-19T21:55:08.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:55:08.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:45.430504+0000", 2024-02-19T21:55:08.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5800000000000002e-06 2024-02-19T21:55:08.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:55:08.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:45.430509+0000", 2024-02-19T21:55:08.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035525159999999999 2024-02-19T21:55:08.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:55:08.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:45.434061+0000", 2024-02-19T21:55:08.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016470699999999999 2024-02-19T21:55:08.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:55:08.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:45.434226+0000", 2024-02-19T21:55:08.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018706199999999999 2024-02-19T21:55:08.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:55:08.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:45.434413+0000", 2024-02-19T21:55:08.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039209570000000001 2024-02-19T21:55:08.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:08.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:45.438334+0000", 2024-02-19T21:55:08.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00098742399999999998 2024-02-19T21:55:08.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:08.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:45.439321+0000", 2024-02-19T21:55:08.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.049986927 2024-02-19T21:55:08.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:55:08.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:45.489308+0000", 2024-02-19T21:55:08.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0441999999999997e-05 2024-02-19T21:55:08.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:55:08.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:45.489349+0000", 2024-02-19T21:55:08.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6375000000000001e-05 2024-02-19T21:55:08.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:55:08.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:54:45.489375+0000", 2024-02-19T21:55:08.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.058902877999999999 2024-02-19T21:55:08.996 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.996 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:55:08.996 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:08.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.997 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:95563 11.a 11:51455774:::benchmark_data_smithi080_184406_object95562:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e517)", 2024-02-19T21:55:08.997 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:55:04.502123+0000", 2024-02-19T21:55:08.997 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 2.5152008339999998, 2024-02-19T21:55:08.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023673538000000001, 2024-02-19T21:55:08.997 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:55:08.997 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:08.997 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:55:08.997 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:55:08.997 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:55:08.997 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 95563 2024-02-19T21:55:08.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.997 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:55:08.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:55:08.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:04.502123+0000", 2024-02-19T21:55:08.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:55:08.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:55:08.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:04.502123+0000", 2024-02-19T21:55:08.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999971 2024-02-19T21:55:08.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:55:08.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:04.502120+0000", 2024-02-19T21:55:08.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1352000000000001e-05 2024-02-19T21:55:08.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:55:08.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:04.502152+0000", 2024-02-19T21:55:08.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0477000000000001e-05 2024-02-19T21:55:08.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:55:08.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:04.502172+0000", 2024-02-19T21:55:08.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4069999999999993e-06 2024-02-19T21:55:08.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:08.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:08.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:55:08.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:04.502180+0000", 2024-02-19T21:55:09.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6243999999999998e-05 2024-02-19T21:55:09.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.000 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:55:09.000 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:04.502247+0000", 2024-02-19T21:55:09.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015592000000000001 2024-02-19T21:55:09.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.000 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:55:09.000 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:04.502403+0000", 2024-02-19T21:55:09.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017035100000000001 2024-02-19T21:55:09.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.000 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:55:09.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:04.502573+0000", 2024-02-19T21:55:09.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0081783089999999999 2024-02-19T21:55:09.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:09.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:04.510751+0000", 2024-02-19T21:55:09.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000560974 2024-02-19T21:55:09.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:55:09.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:04.511312+0000", 2024-02-19T21:55:09.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014397312000000001 2024-02-19T21:55:09.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:09.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:04.525710+0000", 2024-02-19T21:55:09.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8767999999999998e-05 2024-02-19T21:55:09.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:55:09.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:04.525758+0000", 2024-02-19T21:55:09.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8053999999999999e-05 2024-02-19T21:55:09.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:55:09.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:04.525796+0000", 2024-02-19T21:55:09.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023673538000000001 2024-02-19T21:55:09.002 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:09.002 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:55:09.003 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:09.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.003 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:96503 11.a 11:5c2ec00a:::benchmark_data_smithi080_184406_object96502:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e518)", 2024-02-19T21:55:09.003 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:55:05.431603+0000", 2024-02-19T21:55:09.003 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.5857202319999999, 2024-02-19T21:55:09.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.028115194999999999, 2024-02-19T21:55:09.003 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:55:09.003 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:09.003 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:55:09.003 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:55:09.003 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:55:09.003 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 96503 2024-02-19T21:55:09.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.004 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:55:09.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:55:09.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.431603+0000", 2024-02-19T21:55:09.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:55:09.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:55:09.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.431603+0000", 2024-02-19T21:55:09.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:55:09.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:55:09.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.431602+0000", 2024-02-19T21:55:09.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6787999999999998e-05 2024-02-19T21:55:09.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:55:09.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.431628+0000", 2024-02-19T21:55:09.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9717000000000001e-05 2024-02-19T21:55:09.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:55:09.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.431648+0000", 2024-02-19T21:55:09.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2389999999999999e-06 2024-02-19T21:55:09.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:55:09.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.431654+0000", 2024-02-19T21:55:09.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9265999999999996e-05 2024-02-19T21:55:09.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:55:09.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.431734+0000", 2024-02-19T21:55:09.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.464e-06 2024-02-19T21:55:09.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-02-19T21:55:09.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.431738+0000", 2024-02-19T21:55:09.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010343191 2024-02-19T21:55:09.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:55:09.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.442081+0000", 2024-02-19T21:55:09.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000152528 2024-02-19T21:55:09.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:55:09.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.442234+0000", 2024-02-19T21:55:09.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016126500000000001 2024-02-19T21:55:09.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:55:09.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.442395+0000", 2024-02-19T21:55:09.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014172226 2024-02-19T21:55:09.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:55:09.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.456567+0000", 2024-02-19T21:55:09.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016399399999999999 2024-02-19T21:55:09.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:09.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.456731+0000", 2024-02-19T21:55:09.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028861020000000002 2024-02-19T21:55:09.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:09.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.459617+0000", 2024-02-19T21:55:09.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8498999999999997e-05 2024-02-19T21:55:09.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:55:09.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.459676+0000", 2024-02-19T21:55:09.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2669000000000001e-05 2024-02-19T21:55:09.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:55:09.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.459719+0000", 2024-02-19T21:55:09.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.028115194999999999 2024-02-19T21:55:09.009 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:09.009 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:55:09.009 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:09.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.009 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:96514 11.a 11:5b402d87:::benchmark_data_smithi080_184406_object96513:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e518)", 2024-02-19T21:55:09.009 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:55:05.453263+0000", 2024-02-19T21:55:09.009 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.5640609570000001, 2024-02-19T21:55:09.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.052097549999999999, 2024-02-19T21:55:09.009 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:55:09.010 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:09.010 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:55:09.010 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:55:09.010 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:55:09.010 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 96514 2024-02-19T21:55:09.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.010 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:55:09.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:55:09.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.453263+0000", 2024-02-19T21:55:09.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:55:09.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:55:09.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.453263+0000", 2024-02-19T21:55:09.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999976 2024-02-19T21:55:09.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:55:09.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.453260+0000", 2024-02-19T21:55:09.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6963999999999999e-05 2024-02-19T21:55:09.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:55:09.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.453317+0000", 2024-02-19T21:55:09.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9244e-05 2024-02-19T21:55:09.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:55:09.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.453346+0000", 2024-02-19T21:55:09.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2299999999999997e-06 2024-02-19T21:55:09.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.012 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:55:09.012 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.453356+0000", 2024-02-19T21:55:09.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7890000000000003e-05 2024-02-19T21:55:09.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.012 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:55:09.012 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.453414+0000", 2024-02-19T21:55:09.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000158061 2024-02-19T21:55:09.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.012 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:55:09.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.453572+0000", 2024-02-19T21:55:09.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000191342 2024-02-19T21:55:09.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.013 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:55:09.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.453763+0000", 2024-02-19T21:55:09.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0065924829999999997 2024-02-19T21:55:09.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.013 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:09.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.460355+0000", 2024-02-19T21:55:09.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00044605399999999998 2024-02-19T21:55:09.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.014 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:09.014 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.460801+0000", 2024-02-19T21:55:09.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.044450700000000003 2024-02-19T21:55:09.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.014 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:55:09.014 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.505252+0000", 2024-02-19T21:55:09.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3379000000000004e-05 2024-02-19T21:55:09.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.014 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:55:09.014 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.505316+0000", 2024-02-19T21:55:09.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4703000000000002e-05 2024-02-19T21:55:09.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:55:09.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:55:09.014 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:55:09.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:05.505360+0000", 2024-02-19T21:55:09.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.052097549999999999 2024-02-19T21:55:09.015 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:09.015 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:55:09.015 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:09.015 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:55:09.015 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:55:09.015 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:55:09.016 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:09.121 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 69 16 99954 99938 90.4929 62.375 0.00701713 0.0110469 2024-02-19T21:55:09.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:08.745791+0000 mgr.y (mgr.14514) 862 : audit [DBG] from='client.16104 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:55:09.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:08.745791+0000 mgr.y (mgr.14514) 862 : audit [DBG] from='client.16104 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:55:09.727 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.4 dump_ops_in_flight 2024-02-19T21:55:09.785 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:08.745791+0000 mgr.y (mgr.14514) 862 : audit [DBG] from='client.16104 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:55:10.121 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 70 16 100983 100967 90.1189 64.3125 0.0296437 0.0110921 2024-02-19T21:55:10.202 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:55:10.367 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:55:10.371 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:10.371 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:55:10.472 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:55:10.522 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:10.548 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:55:10.551 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:10.551 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:55:10.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:08.631395+0000 osd.1 (osd.1) 272 : cluster [DBG] 4.2 scrub starts 2024-02-19T21:55:10.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:08.637295+0000 osd.1 (osd.1) 273 : cluster [DBG] 4.2 scrub ok 2024-02-19T21:55:10.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:09.264276+0000 mgr.y (mgr.14514) 863 : cluster [DBG] pgmap v1119: 138 pgs: 138 active+clean; 5.9 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 511 B/s rd, 43 MiB/s wr, 684 op/s 2024-02-19T21:55:10.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:09.555444+0000 osd.4 (osd.4) 241 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:55:10.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:09.610103+0000 osd.4 (osd.4) 242 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:55:10.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:09.961801+0000 osd.2 (osd.2) 43 : cluster [DBG] 5.6 scrub starts 2024-02-19T21:55:10.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:09.965638+0000 osd.2 (osd.2) 44 : cluster [DBG] 5.6 scrub ok 2024-02-19T21:55:10.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:08.631395+0000 osd.1 (osd.1) 272 : cluster [DBG] 4.2 scrub starts 2024-02-19T21:55:10.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:08.637295+0000 osd.1 (osd.1) 273 : cluster [DBG] 4.2 scrub ok 2024-02-19T21:55:10.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:09.264276+0000 mgr.y (mgr.14514) 863 : cluster [DBG] pgmap v1119: 138 pgs: 138 active+clean; 5.9 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 511 B/s rd, 43 MiB/s wr, 684 op/s 2024-02-19T21:55:10.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:09.555444+0000 osd.4 (osd.4) 241 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:55:10.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:09.610103+0000 osd.4 (osd.4) 242 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:55:10.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:09.961801+0000 osd.2 (osd.2) 43 : cluster [DBG] 5.6 scrub starts 2024-02-19T21:55:10.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:09.965638+0000 osd.2 (osd.2) 44 : cluster [DBG] 5.6 scrub ok 2024-02-19T21:55:10.653 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:55:10.722 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:10.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:08.631395+0000 osd.1 (osd.1) 272 : cluster [DBG] 4.2 scrub starts 2024-02-19T21:55:10.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:08.637295+0000 osd.1 (osd.1) 273 : cluster [DBG] 4.2 scrub ok 2024-02-19T21:55:10.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:09.264276+0000 mgr.y (mgr.14514) 863 : cluster [DBG] pgmap v1119: 138 pgs: 138 active+clean; 5.9 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 511 B/s rd, 43 MiB/s wr, 684 op/s 2024-02-19T21:55:10.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:09.555444+0000 osd.4 (osd.4) 241 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:55:10.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:09.610103+0000 osd.4 (osd.4) 242 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:55:10.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:09.961801+0000 osd.2 (osd.2) 43 : cluster [DBG] 5.6 scrub starts 2024-02-19T21:55:10.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:09.965638+0000 osd.2 (osd.2) 44 : cluster [DBG] 5.6 scrub ok 2024-02-19T21:55:10.848 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:55:10.853 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:10.854 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:55:10.954 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:55:10.985 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:55:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:55:10] "GET /metrics HTTP/1.1" 200 176800 "" "Prometheus/2.33.4" 2024-02-19T21:55:11.021 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:11.082 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:55:11.084 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:11.085 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:55:11.122 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 71 16 101889 101873 89.6462 56.625 0.00932531 0.0111507 2024-02-19T21:55:11.186 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:55:11.242 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:11.347 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:55:11.364 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:11.365 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:55:11.465 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:55:11.514 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:55:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:55:11.529 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:11.538 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-02-19T21:55:11.744 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:55:11.748 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:11.749 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:55:11.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:10.064465+0000 osd.7 (osd.7) 287 : cluster [DBG] 4.17 scrub starts 2024-02-19T21:55:11.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:10.074179+0000 osd.7 (osd.7) 288 : cluster [DBG] 4.17 scrub ok 2024-02-19T21:55:11.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:10.532445+0000 osd.3 (osd.3) 250 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:55:11.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:10.537486+0000 osd.3 (osd.3) 251 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:55:11.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:10.584611+0000 osd.1 (osd.1) 274 : cluster [DBG] 2.d scrub starts 2024-02-19T21:55:11.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:10.585566+0000 osd.1 (osd.1) 275 : cluster [DBG] 2.d scrub ok 2024-02-19T21:55:11.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:11.448121+0000 mon.c (mon.2) 126 : audit [INF] from='client.? 172.21.15.80:0/4070194131' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:55:11.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:11.451277+0000 mon.a (mon.0) 1945 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:55:11.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:10.064465+0000 osd.7 (osd.7) 287 : cluster [DBG] 4.17 scrub starts 2024-02-19T21:55:11.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:10.074179+0000 osd.7 (osd.7) 288 : cluster [DBG] 4.17 scrub ok 2024-02-19T21:55:11.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:10.532445+0000 osd.3 (osd.3) 250 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:55:11.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:10.537486+0000 osd.3 (osd.3) 251 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:55:11.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:10.584611+0000 osd.1 (osd.1) 274 : cluster [DBG] 2.d scrub starts 2024-02-19T21:55:11.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:10.585566+0000 osd.1 (osd.1) 275 : cluster [DBG] 2.d scrub ok 2024-02-19T21:55:11.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:11.448121+0000 mon.c (mon.2) 126 : audit [INF] from='client.? 172.21.15.80:0/4070194131' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:55:11.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:11.451277+0000 mon.a (mon.0) 1945 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:55:11.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:10.064465+0000 osd.7 (osd.7) 287 : cluster [DBG] 4.17 scrub starts 2024-02-19T21:55:11.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:10.074179+0000 osd.7 (osd.7) 288 : cluster [DBG] 4.17 scrub ok 2024-02-19T21:55:11.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:10.532445+0000 osd.3 (osd.3) 250 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:55:11.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:10.537486+0000 osd.3 (osd.3) 251 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:55:11.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:10.584611+0000 osd.1 (osd.1) 274 : cluster [DBG] 2.d scrub starts 2024-02-19T21:55:11.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:10.585566+0000 osd.1 (osd.1) 275 : cluster [DBG] 2.d scrub ok 2024-02-19T21:55:11.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:11.448121+0000 mon.c (mon.2) 126 : audit [INF] from='client.? 172.21.15.80:0/4070194131' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:55:11.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:11.451277+0000 mon.a (mon.0) 1945 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:55:11.849 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:55:11.891 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:12.066 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:55:12.073 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:12.073 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:55:12.122 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 72 16 102842 102826 89.2278 59.5625 0.0205128 0.0112018 2024-02-19T21:55:12.174 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:55:12.235 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:12.268 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:55:12.274 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:12.275 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:55:12.289 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":1118,"stamp":"2024-02-19T21:55:07.263563+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6283728554,"num_objects":96074,"num_object_clones":0,"num_object_copies":288222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96074,"num_whiteouts":0,"num_read":2892,"num_read_kb":2644,"num_write":96879,"num_write_kb":6136487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":327,"num_bytes_recovered":7805,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86101,"ondisk_log_size":86101,"up":414,"acting":414,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":416,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":24116896,"kb_used_data":18451872,"kb_used_omap":0,"kb_used_meta":5664959,"kb_avail":725844320,"statfs":{"total":767960285184,"available":743264583680,"internally_reserved":0,"allocated":18894716928,"data_stored":18882124683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":5800918068},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,3,5,0,0,0,0,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":339804160,"num_objects":5185,"num_object_clones":0,"num_object_copies":15555,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5185,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5185,"num_write_kb":331840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.868318"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":118,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.409352+0000","last_change":"2024-02-19T21:54:18.805903+0000","last_active":"2024-02-19T21:55:00.409352+0000","last_peered":"2024-02-19T21:55:00.409352+0000","last_clean":"2024-02-19T21:55:00.409352+0000","last_became_active":"2024-02-19T21:49:54.492544+0000","last_became_peered":"2024-02-19T21:49:54.492544+0000","last_unstale":"2024-02-19T21:55:00.409352+0000","last_undegraded":"2024-02-19T21:55:00.409352+0000","last_fullsized":"2024-02-19T21:55:00.409352+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:18.805820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:54:18.805820+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":495,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.427646+0000","last_change":"2024-02-19T21:54:07.029225+0000","last_active":"2024-02-19T21:55:00.427646+0000","last_peered":"2024-02-19T21:55:00.427646+0000","last_clean":"2024-02-19T21:55:00.427646+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:55:00.427646+0000","last_undegraded":"2024-02-19T21:55:00.427646+0000","last_fullsized":"2024-02-19T21:55:00.427646+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:07.029148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:54:07.029148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"471'39","reported_seq":182,"reported_epoch":515,"state":"active+clean","last_fresh":"2024-02-19T21:54:57.542669+0000","last_change":"2024-02-19T21:53:54.277380+0000","last_active":"2024-02-19T21:54:57.542669+0000","last_peered":"2024-02-19T21:54:57.542669+0000","last_clean":"2024-02-19T21:54:57.542669+0000","last_became_active":"2024-02-19T21:49:08.327416+0000","last_became_peered":"2024-02-19T21:49:08.327416+0000","last_unstale":"2024-02-19T21:54:57.542669+0000","last_undegraded":"2024-02-19T21:54:57.542669+0000","last_fullsized":"2024-02-19T21:54:57.542669+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'39","last_scrub_stamp":"2024-02-19T21:53:54.277319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:53:54.277319+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":470,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.397043+0000","last_change":"2024-02-19T21:54:13.470532+0000","last_active":"2024-02-19T21:55:00.397043+0000","last_peered":"2024-02-19T21:55:00.397043+0000","last_clean":"2024-02-19T21:55:00.397043+0000","last_became_active":"2024-02-19T21:47:46.250178+0000","last_became_peered":"2024-02-19T21:47:46.250178+0000","last_unstale":"2024-02-19T21:55:00.397043+0000","last_undegraded":"2024-02-19T21:55:00.397043+0000","last_fullsized":"2024-02-19T21:55:00.397043+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:13.470431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:13.470431+0000","last_clean_scrub_stamp":"2024-02-19T21:54:13.470431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":39,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.434166+0000","last_change":"2024-02-19T21:53:52.503000+0000","last_active":"2024-02-19T21:55:00.434166+0000","last_peered":"2024-02-19T21:55:00.434166+0000","last_clean":"2024-02-19T21:55:00.434166+0000","last_became_active":"2024-02-19T21:53:45.368218+0000","last_became_peered":"2024-02-19T21:53:45.368218+0000","last_unstale":"2024-02-19T21:55:00.434166+0000","last_undegraded":"2024-02-19T21:55:00.434166+0000","last_fullsized":"2024-02-19T21:55:00.434166+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:52.502930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:53:52.502930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"470'25","reported_seq":575,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:03.508428+0000","last_change":"2024-02-19T21:55:03.508377+0000","last_active":"2024-02-19T21:55:03.508428+0000","last_peered":"2024-02-19T21:55:03.508428+0000","last_clean":"2024-02-19T21:55:03.508428+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:55:03.508428+0000","last_undegraded":"2024-02-19T21:55:03.508428+0000","last_fullsized":"2024-02-19T21:55:03.508428+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'25","last_scrub_stamp":"2024-02-19T21:55:03.508262+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:55:03.508262+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":255,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.403250+0000","last_change":"2024-02-19T21:54:02.455027+0000","last_active":"2024-02-19T21:55:00.403250+0000","last_peered":"2024-02-19T21:55:00.403250+0000","last_clean":"2024-02-19T21:55:00.403250+0000","last_became_active":"2024-02-19T21:49:08.331753+0000","last_became_peered":"2024-02-19T21:49:08.331753+0000","last_unstale":"2024-02-19T21:55:00.403250+0000","last_undegraded":"2024-02-19T21:55:00.403250+0000","last_fullsized":"2024-02-19T21:55:00.403250+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:02.454932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:02.454932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":510,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.409535+0000","last_change":"2024-02-19T21:54:13.655262+0000","last_active":"2024-02-19T21:55:00.409535+0000","last_peered":"2024-02-19T21:55:00.409535+0000","last_clean":"2024-02-19T21:55:00.409535+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:55:00.409535+0000","last_undegraded":"2024-02-19T21:55:00.409535+0000","last_fullsized":"2024-02-19T21:55:00.409535+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:13.655182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_clean_scrub_stamp":"2024-02-19T21:54:13.655182+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"470'11","reported_seq":544,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.396608+0000","last_change":"2024-02-19T21:53:51.243831+0000","last_active":"2024-02-19T21:55:00.396608+0000","last_peered":"2024-02-19T21:55:00.396608+0000","last_clean":"2024-02-19T21:55:00.396608+0000","last_became_active":"2024-02-19T21:53:45.385837+0000","last_became_peered":"2024-02-19T21:53:45.385837+0000","last_unstale":"2024-02-19T21:55:00.396608+0000","last_undegraded":"2024-02-19T21:55:00.396608+0000","last_fullsized":"2024-02-19T21:55:00.396608+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'11","last_scrub_stamp":"2024-02-19T21:53:51.243743+0000","last_deep_scrub":"310'9","last_deep_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_clean_scrub_stamp":"2024-02-19T21:53:51.243743+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":429,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.425834+0000","last_change":"2024-02-19T21:54:00.131758+0000","last_active":"2024-02-19T21:55:00.425834+0000","last_peered":"2024-02-19T21:55:00.425834+0000","last_clean":"2024-02-19T21:55:00.425834+0000","last_became_active":"2024-02-19T21:46:31.204816+0000","last_became_peered":"2024-02-19T21:46:31.204816+0000","last_unstale":"2024-02-19T21:55:00.425834+0000","last_undegraded":"2024-02-19T21:55:00.425834+0000","last_fullsized":"2024-02-19T21:55:00.425834+0000","mapping_epoch":330,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":331,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:54:00.131654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:54:00.131654+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":532,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.409187+0000","last_change":"2024-02-19T21:53:58.606788+0000","last_active":"2024-02-19T21:55:00.409187+0000","last_peered":"2024-02-19T21:55:00.409187+0000","last_clean":"2024-02-19T21:55:00.409187+0000","last_became_active":"2024-02-19T21:49:08.329998+0000","last_became_peered":"2024-02-19T21:49:08.329998+0000","last_unstale":"2024-02-19T21:55:00.409187+0000","last_undegraded":"2024-02-19T21:55:00.409187+0000","last_fullsized":"2024-02-19T21:55:00.409187+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:58.606696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:58.606696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"470'25","reported_seq":404,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.397224+0000","last_change":"2024-02-19T21:54:07.275961+0000","last_active":"2024-02-19T21:55:00.397224+0000","last_peered":"2024-02-19T21:55:00.397224+0000","last_clean":"2024-02-19T21:55:00.397224+0000","last_became_active":"2024-02-19T21:53:45.383294+0000","last_became_peered":"2024-02-19T21:53:45.383294+0000","last_unstale":"2024-02-19T21:55:00.397224+0000","last_undegraded":"2024-02-19T21:55:00.397224+0000","last_fullsized":"2024-02-19T21:55:00.397224+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'25","last_scrub_stamp":"2024-02-19T21:54:07.275895+0000","last_deep_scrub":"470'25","last_deep_scrub_stamp":"2024-02-19T21:54:07.275895+0000","last_clean_scrub_stamp":"2024-02-19T21:54:07.275895+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":39,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.434352+0000","last_change":"2024-02-19T21:54:12.582686+0000","last_active":"2024-02-19T21:55:00.434352+0000","last_peered":"2024-02-19T21:55:00.434352+0000","last_clean":"2024-02-19T21:55:00.434352+0000","last_became_active":"2024-02-19T21:53:45.369808+0000","last_became_peered":"2024-02-19T21:53:45.369808+0000","last_unstale":"2024-02-19T21:55:00.434352+0000","last_undegraded":"2024-02-19T21:55:00.434352+0000","last_fullsized":"2024-02-19T21:55:00.434352+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:12.582596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:12.582596+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":17,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.964172+0000","last_change":"2024-02-19T21:55:00.964172+0000","last_active":"2024-02-19T21:55:00.964172+0000","last_peered":"2024-02-19T21:55:00.964172+0000","last_clean":"2024-02-19T21:55:00.964172+0000","last_became_active":"2024-02-19T21:54:52.469938+0000","last_became_peered":"2024-02-19T21:54:52.469938+0000","last_unstale":"2024-02-19T21:55:00.964172+0000","last_undegraded":"2024-02-19T21:55:00.964172+0000","last_fullsized":"2024-02-19T21:55:00.964172+0000","mapping_epoch":513,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":514,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:00.964069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:55:00.964069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"471'24","reported_seq":29,"reported_epoch":515,"state":"active+clean","last_fresh":"2024-02-19T21:54:58.907119+0000","last_change":"2024-02-19T21:54:58.907072+0000","last_active":"2024-02-19T21:54:58.907119+0000","last_peered":"2024-02-19T21:54:58.907119+0000","last_clean":"2024-02-19T21:54:58.907119+0000","last_became_active":"2024-02-19T21:54:52.474005+0000","last_became_peered":"2024-02-19T21:54:52.474005+0000","last_unstale":"2024-02-19T21:54:58.907119+0000","last_undegraded":"2024-02-19T21:54:58.907119+0000","last_fullsized":"2024-02-19T21:54:58.907119+0000","mapping_epoch":513,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":514,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'24","last_scrub_stamp":"2024-02-19T21:54:58.906977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:54:58.906977+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":33,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6],"acting":[2,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":492,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.396819+0000","last_change":"2024-02-19T21:48:40.528082+0000","last_active":"2024-02-19T21:55:00.396819+0000","last_peered":"2024-02-19T21:55:00.396819+0000","last_clean":"2024-02-19T21:55:00.396819+0000","last_became_active":"2024-02-19T21:44:58.788307+0000","last_became_peered":"2024-02-19T21:44:58.788307+0000","last_unstale":"2024-02-19T21:55:00.396819+0000","last_undegraded":"2024-02-19T21:55:00.396819+0000","last_fullsized":"2024-02-19T21:55:00.396819+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:40.527970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:48:40.527970+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":505,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.415968+0000","last_change":"2024-02-19T21:54:22.689209+0000","last_active":"2024-02-19T21:55:00.415968+0000","last_peered":"2024-02-19T21:55:00.415968+0000","last_clean":"2024-02-19T21:55:00.415968+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:55:00.415968+0000","last_undegraded":"2024-02-19T21:55:00.415968+0000","last_fullsized":"2024-02-19T21:55:00.415968+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:22.689143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:17.913620+0000","last_clean_scrub_stamp":"2024-02-19T21:54:22.689143+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"470'46","reported_seq":183,"reported_epoch":515,"state":"active+clean","last_fresh":"2024-02-19T21:54:57.545252+0000","last_change":"2024-02-19T21:54:04.369498+0000","last_active":"2024-02-19T21:54:57.545252+0000","last_peered":"2024-02-19T21:54:57.545252+0000","last_clean":"2024-02-19T21:54:57.545252+0000","last_became_active":"2024-02-19T21:49:08.331742+0000","last_became_peered":"2024-02-19T21:49:08.331742+0000","last_unstale":"2024-02-19T21:54:57.545252+0000","last_undegraded":"2024-02-19T21:54:57.545252+0000","last_fullsized":"2024-02-19T21:54:57.545252+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'46","last_scrub_stamp":"2024-02-19T21:54:04.369431+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:54:04.369431+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":512,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.417710+0000","last_change":"2024-02-19T21:46:44.994389+0000","last_active":"2024-02-19T21:55:00.417710+0000","last_peered":"2024-02-19T21:55:00.417710+0000","last_clean":"2024-02-19T21:55:00.417710+0000","last_became_active":"2024-02-19T21:44:58.790669+0000","last_became_peered":"2024-02-19T21:44:58.790669+0000","last_unstale":"2024-02-19T21:55:00.417710+0000","last_undegraded":"2024-02-19T21:55:00.417710+0000","last_fullsized":"2024-02-19T21:55:00.417710+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.994296+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":451,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.417691+0000","last_change":"2024-02-19T21:53:55.597392+0000","last_active":"2024-02-19T21:55:00.417691+0000","last_peered":"2024-02-19T21:55:00.417691+0000","last_clean":"2024-02-19T21:55:00.417691+0000","last_became_active":"2024-02-19T21:49:08.329986+0000","last_became_peered":"2024-02-19T21:49:08.329986+0000","last_unstale":"2024-02-19T21:55:00.417691+0000","last_undegraded":"2024-02-19T21:55:00.417691+0000","last_fullsized":"2024-02-19T21:55:00.417691+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:55.597334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:55.597334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"471'27","reported_seq":411,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:02.838950+0000","last_change":"2024-02-19T21:55:02.838918+0000","last_active":"2024-02-19T21:55:02.838950+0000","last_peered":"2024-02-19T21:55:02.838950+0000","last_clean":"2024-02-19T21:55:02.838950+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:55:02.838950+0000","last_undegraded":"2024-02-19T21:55:02.838950+0000","last_fullsized":"2024-02-19T21:55:02.838950+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'27","last_scrub_stamp":"2024-02-19T21:55:02.838850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:55:02.838850+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":36,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":378,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.409032+0000","last_change":"2024-02-19T21:54:03.580153+0000","last_active":"2024-02-19T21:55:00.409032+0000","last_peered":"2024-02-19T21:55:00.409032+0000","last_clean":"2024-02-19T21:55:00.409032+0000","last_became_active":"2024-02-19T21:51:22.461599+0000","last_became_peered":"2024-02-19T21:51:22.461599+0000","last_unstale":"2024-02-19T21:55:00.409032+0000","last_undegraded":"2024-02-19T21:55:00.409032+0000","last_fullsized":"2024-02-19T21:55:00.409032+0000","mapping_epoch":445,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":446,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:54:03.580085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:54:03.580085+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":516,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.403225+0000","last_change":"2024-02-19T21:54:20.347780+0000","last_active":"2024-02-19T21:55:00.403225+0000","last_peered":"2024-02-19T21:55:00.403225+0000","last_clean":"2024-02-19T21:55:00.403225+0000","last_became_active":"2024-02-19T21:49:54.491488+0000","last_became_peered":"2024-02-19T21:49:54.491488+0000","last_unstale":"2024-02-19T21:55:00.403225+0000","last_undegraded":"2024-02-19T21:55:00.403225+0000","last_fullsized":"2024-02-19T21:55:00.403225+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:20.347685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:54:20.347685+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"470'30","reported_seq":615,"reported_epoch":517,"state":"active+clean","last_fresh":"2024-02-19T21:55:04.896812+0000","last_change":"2024-02-19T21:55:04.896812+0000","last_active":"2024-02-19T21:55:04.896812+0000","last_peered":"2024-02-19T21:55:04.896812+0000","last_clean":"2024-02-19T21:55:04.896812+0000","last_became_active":"2024-02-19T21:49:54.483748+0000","last_became_peered":"2024-02-19T21:49:54.483748+0000","last_unstale":"2024-02-19T21:55:04.896812+0000","last_undegraded":"2024-02-19T21:55:04.896812+0000","last_fullsized":"2024-02-19T21:55:04.896812+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'30","last_scrub_stamp":"2024-02-19T21:55:04.896705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:55:04.896705+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":435,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.425546+0000","last_change":"2024-02-19T21:55:00.074339+0000","last_active":"2024-02-19T21:55:00.425546+0000","last_peered":"2024-02-19T21:55:00.425546+0000","last_clean":"2024-02-19T21:55:00.425546+0000","last_became_active":"2024-02-19T21:49:08.327865+0000","last_became_peered":"2024-02-19T21:49:08.327865+0000","last_unstale":"2024-02-19T21:55:00.425546+0000","last_undegraded":"2024-02-19T21:55:00.425546+0000","last_fullsized":"2024-02-19T21:55:00.425546+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:00.074245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:55:00.074245+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":497,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.409101+0000","last_change":"2024-02-19T21:54:15.684329+0000","last_active":"2024-02-19T21:55:00.409101+0000","last_peered":"2024-02-19T21:55:00.409101+0000","last_clean":"2024-02-19T21:55:00.409101+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:55:00.409101+0000","last_undegraded":"2024-02-19T21:55:00.409101+0000","last_fullsized":"2024-02-19T21:55:00.409101+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:15.684224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:54:15.684224+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":531,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.416108+0000","last_change":"2024-02-19T21:53:54.630006+0000","last_active":"2024-02-19T21:55:00.416108+0000","last_peered":"2024-02-19T21:55:00.416108+0000","last_clean":"2024-02-19T21:55:00.416108+0000","last_became_active":"2024-02-19T21:49:08.330293+0000","last_became_peered":"2024-02-19T21:49:08.330293+0000","last_unstale":"2024-02-19T21:55:00.416108+0000","last_undegraded":"2024-02-19T21:55:00.416108+0000","last_fullsized":"2024-02-19T21:55:00.416108+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:54.629909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:54.629909+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"471'32","reported_seq":53,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.433533+0000","last_change":"2024-02-19T21:54:04.345127+0000","last_active":"2024-02-19T21:55:00.433533+0000","last_peered":"2024-02-19T21:55:00.433533+0000","last_clean":"2024-02-19T21:55:00.433533+0000","last_became_active":"2024-02-19T21:53:45.367870+0000","last_became_peered":"2024-02-19T21:53:45.367870+0000","last_unstale":"2024-02-19T21:55:00.433533+0000","last_undegraded":"2024-02-19T21:55:00.433533+0000","last_fullsized":"2024-02-19T21:55:00.433533+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'32","last_scrub_stamp":"2024-02-19T21:54:04.345011+0000","last_deep_scrub":"381'24","last_deep_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_clean_scrub_stamp":"2024-02-19T21:54:04.345011+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":525,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.409505+0000","last_change":"2024-02-19T21:53:57.593397+0000","last_active":"2024-02-19T21:55:00.409505+0000","last_peered":"2024-02-19T21:55:00.409505+0000","last_clean":"2024-02-19T21:55:00.409505+0000","last_became_active":"2024-02-19T21:49:08.333537+0000","last_became_peered":"2024-02-19T21:49:08.333537+0000","last_unstale":"2024-02-19T21:55:00.409505+0000","last_undegraded":"2024-02-19T21:55:00.409505+0000","last_fullsized":"2024-02-19T21:55:00.409505+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:57.593320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:53:57.593320+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":551,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:03.717234+0000","last_change":"2024-02-19T21:55:03.717187+0000","last_active":"2024-02-19T21:55:03.717234+0000","last_peered":"2024-02-19T21:55:03.717234+0000","last_clean":"2024-02-19T21:55:03.717234+0000","last_became_active":"2024-02-19T21:49:54.494146+0000","last_became_peered":"2024-02-19T21:49:54.494146+0000","last_unstale":"2024-02-19T21:55:03.717234+0000","last_undegraded":"2024-02-19T21:55:03.717234+0000","last_fullsized":"2024-02-19T21:55:03.717234+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:03.717083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_clean_scrub_stamp":"2024-02-19T21:55:03.717083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":521,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.403716+0000","last_change":"2024-02-19T21:49:09.765641+0000","last_active":"2024-02-19T21:55:00.403716+0000","last_peered":"2024-02-19T21:55:00.403716+0000","last_clean":"2024-02-19T21:55:00.403716+0000","last_became_active":"2024-02-19T21:49:08.331308+0000","last_became_peered":"2024-02-19T21:49:08.331308+0000","last_unstale":"2024-02-19T21:55:00.403716+0000","last_undegraded":"2024-02-19T21:55:00.403716+0000","last_fullsized":"2024-02-19T21:55:00.403716+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.765568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.765568+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"470'12","reported_seq":50,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.544921+0000","last_change":"2024-02-19T21:55:00.544889+0000","last_active":"2024-02-19T21:55:00.544921+0000","last_peered":"2024-02-19T21:55:00.544921+0000","last_clean":"2024-02-19T21:55:00.544921+0000","last_became_active":"2024-02-19T21:53:45.368256+0000","last_became_peered":"2024-02-19T21:53:45.368256+0000","last_unstale":"2024-02-19T21:55:00.544921+0000","last_undegraded":"2024-02-19T21:55:00.544921+0000","last_fullsized":"2024-02-19T21:55:00.544921+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'12","last_scrub_stamp":"2024-02-19T21:55:00.544815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:55:00.544815+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":430,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.426428+0000","last_change":"2024-02-19T21:49:08.918163+0000","last_active":"2024-02-19T21:55:00.426428+0000","last_peered":"2024-02-19T21:55:00.426428+0000","last_clean":"2024-02-19T21:55:00.426428+0000","last_became_active":"2024-02-19T21:49:08.328416+0000","last_became_peered":"2024-02-19T21:49:08.328416+0000","last_unstale":"2024-02-19T21:55:00.426428+0000","last_undegraded":"2024-02-19T21:55:00.426428+0000","last_fullsized":"2024-02-19T21:55:00.426428+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.918083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.918083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":515,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.412160+0000","last_change":"2024-02-19T21:54:24.498621+0000","last_active":"2024-02-19T21:55:00.412160+0000","last_peered":"2024-02-19T21:55:00.412160+0000","last_clean":"2024-02-19T21:55:00.412160+0000","last_became_active":"2024-02-19T21:49:54.480368+0000","last_became_peered":"2024-02-19T21:49:54.480368+0000","last_unstale":"2024-02-19T21:55:00.412160+0000","last_undegraded":"2024-02-19T21:55:00.412160+0000","last_fullsized":"2024-02-19T21:55:00.412160+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:24.498521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:54:24.498521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":494,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.417430+0000","last_change":"2024-02-19T21:49:05.012463+0000","last_active":"2024-02-19T21:55:00.417430+0000","last_peered":"2024-02-19T21:55:00.417430+0000","last_clean":"2024-02-19T21:55:00.417430+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:55:00.417430+0000","last_undegraded":"2024-02-19T21:55:00.417430+0000","last_fullsized":"2024-02-19T21:55:00.417430+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.012395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.012395+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"470'27","reported_seq":558,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:02.539388+0000","last_change":"2024-02-19T21:55:02.539346+0000","last_active":"2024-02-19T21:55:02.539388+0000","last_peered":"2024-02-19T21:55:02.539388+0000","last_clean":"2024-02-19T21:55:02.539388+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:55:02.539388+0000","last_undegraded":"2024-02-19T21:55:02.539388+0000","last_fullsized":"2024-02-19T21:55:02.539388+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'27","last_scrub_stamp":"2024-02-19T21:55:02.539241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:55:02.539241+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":500,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.425558+0000","last_change":"2024-02-19T21:54:17.964240+0000","last_active":"2024-02-19T21:55:00.425558+0000","last_peered":"2024-02-19T21:55:00.425558+0000","last_clean":"2024-02-19T21:55:00.425558+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:55:00.425558+0000","last_undegraded":"2024-02-19T21:55:00.425558+0000","last_fullsized":"2024-02-19T21:55:00.425558+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:17.964139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:17.964139+0000","last_clean_scrub_stamp":"2024-02-19T21:54:17.964139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.433768+0000","last_change":"2024-02-19T21:54:06.348379+0000","last_active":"2024-02-19T21:55:00.433768+0000","last_peered":"2024-02-19T21:55:00.433768+0000","last_clean":"2024-02-19T21:55:00.433768+0000","last_became_active":"2024-02-19T21:53:45.369330+0000","last_became_peered":"2024-02-19T21:53:45.369330+0000","last_unstale":"2024-02-19T21:55:00.433768+0000","last_undegraded":"2024-02-19T21:55:00.433768+0000","last_fullsized":"2024-02-19T21:55:00.433768+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:06.348272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:54:06.348272+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":521,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:02.698935+0000","last_change":"2024-02-19T21:55:02.698892+0000","last_active":"2024-02-19T21:55:02.698935+0000","last_peered":"2024-02-19T21:55:02.698935+0000","last_clean":"2024-02-19T21:55:02.698935+0000","last_became_active":"2024-02-19T21:53:45.384501+0000","last_became_peered":"2024-02-19T21:53:45.384501+0000","last_unstale":"2024-02-19T21:55:02.698935+0000","last_undegraded":"2024-02-19T21:55:02.698935+0000","last_fullsized":"2024-02-19T21:55:02.698935+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:02.698800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:55:02.698800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"470'21","reported_seq":581,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.411999+0000","last_change":"2024-02-19T21:54:14.469579+0000","last_active":"2024-02-19T21:55:00.411999+0000","last_peered":"2024-02-19T21:55:00.411999+0000","last_clean":"2024-02-19T21:55:00.411999+0000","last_became_active":"2024-02-19T21:49:08.333872+0000","last_became_peered":"2024-02-19T21:49:08.333872+0000","last_unstale":"2024-02-19T21:55:00.411999+0000","last_undegraded":"2024-02-19T21:55:00.411999+0000","last_fullsized":"2024-02-19T21:55:00.411999+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'21","last_scrub_stamp":"2024-02-19T21:54:14.469490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:54:14.469490+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":480,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.396781+0000","last_change":"2024-02-19T21:54:08.470718+0000","last_active":"2024-02-19T21:55:00.396781+0000","last_peered":"2024-02-19T21:55:00.396781+0000","last_clean":"2024-02-19T21:55:00.396781+0000","last_became_active":"2024-02-19T21:49:08.329770+0000","last_became_peered":"2024-02-19T21:49:08.329770+0000","last_unstale":"2024-02-19T21:55:00.396781+0000","last_undegraded":"2024-02-19T21:55:00.396781+0000","last_fullsized":"2024-02-19T21:55:00.396781+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:08.470650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:54:08.470650+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"415'17","reported_seq":184,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:02.138095+0000","last_change":"2024-02-19T21:53:56.588487+0000","last_active":"2024-02-19T21:55:02.138095+0000","last_peered":"2024-02-19T21:55:02.138095+0000","last_clean":"2024-02-19T21:55:02.138095+0000","last_became_active":"2024-02-19T21:49:54.486304+0000","last_became_peered":"2024-02-19T21:49:54.486304+0000","last_unstale":"2024-02-19T21:55:02.138095+0000","last_undegraded":"2024-02-19T21:55:02.138095+0000","last_fullsized":"2024-02-19T21:55:02.138095+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"415'17","last_scrub_stamp":"2024-02-19T21:53:56.588421+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:53:56.588421+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":531,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.428083+0000","last_change":"2024-02-19T21:54:01.110262+0000","last_active":"2024-02-19T21:55:00.428083+0000","last_peered":"2024-02-19T21:55:00.428083+0000","last_clean":"2024-02-19T21:55:00.428083+0000","last_became_active":"2024-02-19T21:53:45.371729+0000","last_became_peered":"2024-02-19T21:53:45.371729+0000","last_unstale":"2024-02-19T21:55:00.428083+0000","last_undegraded":"2024-02-19T21:55:00.428083+0000","last_fullsized":"2024-02-19T21:55:00.428083+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:01.110166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_clean_scrub_stamp":"2024-02-19T21:54:01.110166+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"470'25","reported_seq":572,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.403544+0000","last_change":"2024-02-19T21:54:59.161641+0000","last_active":"2024-02-19T21:55:00.403544+0000","last_peered":"2024-02-19T21:55:00.403544+0000","last_clean":"2024-02-19T21:55:00.403544+0000","last_became_active":"2024-02-19T21:53:45.384976+0000","last_became_peered":"2024-02-19T21:53:45.384976+0000","last_unstale":"2024-02-19T21:55:00.403544+0000","last_undegraded":"2024-02-19T21:55:00.403544+0000","last_fullsized":"2024-02-19T21:55:00.403544+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'25","last_scrub_stamp":"2024-02-19T21:54:59.161529+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:54:59.161529+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":239,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.431709+0000","last_change":"2024-02-19T21:54:21.953571+0000","last_active":"2024-02-19T21:55:00.431709+0000","last_peered":"2024-02-19T21:55:00.431709+0000","last_clean":"2024-02-19T21:55:00.431709+0000","last_became_active":"2024-02-19T21:49:54.484049+0000","last_became_peered":"2024-02-19T21:49:54.484049+0000","last_unstale":"2024-02-19T21:55:00.431709+0000","last_undegraded":"2024-02-19T21:55:00.431709+0000","last_fullsized":"2024-02-19T21:55:00.431709+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:21.953470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:54:21.953470+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":775,"reported_epoch":517,"state":"active+clean","last_fresh":"2024-02-19T21:55:05.379509+0000","last_change":"2024-02-19T21:55:05.379509+0000","last_active":"2024-02-19T21:55:05.379509+0000","last_peered":"2024-02-19T21:55:05.379509+0000","last_clean":"2024-02-19T21:55:05.379509+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:55:05.379509+0000","last_undegraded":"2024-02-19T21:55:05.379509+0000","last_fullsized":"2024-02-19T21:55:05.379509+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:55:05.379447+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:55:05.379447+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":531,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.404546+0000","last_change":"2024-02-19T21:53:45.384547+0000","last_active":"2024-02-19T21:55:00.404546+0000","last_peered":"2024-02-19T21:55:00.404546+0000","last_clean":"2024-02-19T21:55:00.404546+0000","last_became_active":"2024-02-19T21:53:45.384012+0000","last_became_peered":"2024-02-19T21:53:45.384012+0000","last_unstale":"2024-02-19T21:55:00.404546+0000","last_undegraded":"2024-02-19T21:55:00.404546+0000","last_fullsized":"2024-02-19T21:55:00.404546+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:07.724097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:19.763642+0000","last_clean_scrub_stamp":"2024-02-19T21:49:07.724097+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"470'35","reported_seq":51,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.434058+0000","last_change":"2024-02-19T21:53:54.498661+0000","last_active":"2024-02-19T21:55:00.434058+0000","last_peered":"2024-02-19T21:55:00.434058+0000","last_clean":"2024-02-19T21:55:00.434058+0000","last_became_active":"2024-02-19T21:53:45.367708+0000","last_became_peered":"2024-02-19T21:53:45.367708+0000","last_unstale":"2024-02-19T21:55:00.434058+0000","last_undegraded":"2024-02-19T21:55:00.434058+0000","last_fullsized":"2024-02-19T21:55:00.434058+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'35","last_scrub_stamp":"2024-02-19T21:53:54.498596+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:53:54.498596+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":497,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.409377+0000","last_change":"2024-02-19T21:54:11.667953+0000","last_active":"2024-02-19T21:55:00.409377+0000","last_peered":"2024-02-19T21:55:00.409377+0000","last_clean":"2024-02-19T21:55:00.409377+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:55:00.409377+0000","last_undegraded":"2024-02-19T21:55:00.409377+0000","last_fullsized":"2024-02-19T21:55:00.409377+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:11.667872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:11.667872+0000","last_clean_scrub_stamp":"2024-02-19T21:54:11.667872+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":502,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.417892+0000","last_change":"2024-02-19T21:53:56.583766+0000","last_active":"2024-02-19T21:55:00.417892+0000","last_peered":"2024-02-19T21:55:00.417892+0000","last_clean":"2024-02-19T21:55:00.417892+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:55:00.417892+0000","last_undegraded":"2024-02-19T21:55:00.417892+0000","last_fullsized":"2024-02-19T21:55:00.417892+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:56.583707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:56.583707+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"470'18","reported_seq":132,"reported_epoch":517,"state":"active+clean","last_fresh":"2024-02-19T21:55:04.055370+0000","last_change":"2024-02-19T21:55:04.056664+0000","last_active":"2024-02-19T21:55:04.055370+0000","last_peered":"2024-02-19T21:55:04.055370+0000","last_clean":"2024-02-19T21:55:04.055370+0000","last_became_active":"2024-02-19T21:49:54.478094+0000","last_became_peered":"2024-02-19T21:49:54.478094+0000","last_unstale":"2024-02-19T21:55:04.055370+0000","last_undegraded":"2024-02-19T21:55:04.055370+0000","last_fullsized":"2024-02-19T21:55:04.055370+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'12","last_scrub_stamp":"2024-02-19T21:49:08.912638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.912638+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":23,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":148,"reported_epoch":515,"state":"active+clean","last_fresh":"2024-02-19T21:54:57.545335+0000","last_change":"2024-02-19T21:54:18.393614+0000","last_active":"2024-02-19T21:54:57.545335+0000","last_peered":"2024-02-19T21:54:57.545335+0000","last_clean":"2024-02-19T21:54:57.545335+0000","last_became_active":"2024-02-19T21:49:08.332176+0000","last_became_peered":"2024-02-19T21:49:08.332176+0000","last_unstale":"2024-02-19T21:54:57.545335+0000","last_undegraded":"2024-02-19T21:54:57.545335+0000","last_fullsized":"2024-02-19T21:54:57.545335+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:18.393513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:18.393513+0000","last_clean_scrub_stamp":"2024-02-19T21:54:18.393513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":157,"reported_epoch":515,"state":"active+clean","last_fresh":"2024-02-19T21:54:57.542669+0000","last_change":"2024-02-19T21:54:35.409241+0000","last_active":"2024-02-19T21:54:57.542669+0000","last_peered":"2024-02-19T21:54:57.542669+0000","last_clean":"2024-02-19T21:54:57.542669+0000","last_became_active":"2024-02-19T21:54:35.408935+0000","last_became_peered":"2024-02-19T21:54:35.408935+0000","last_unstale":"2024-02-19T21:54:57.542669+0000","last_undegraded":"2024-02-19T21:54:57.542669+0000","last_fullsized":"2024-02-19T21:54:57.542669+0000","mapping_epoch":507,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":508,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:53.263540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:53:53.263540+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"470'21","reported_seq":653,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.431814+0000","last_change":"2024-02-19T21:53:52.104355+0000","last_active":"2024-02-19T21:55:00.431814+0000","last_peered":"2024-02-19T21:55:00.431814+0000","last_clean":"2024-02-19T21:55:00.431814+0000","last_became_active":"2024-02-19T21:49:54.483578+0000","last_became_peered":"2024-02-19T21:49:54.483578+0000","last_unstale":"2024-02-19T21:55:00.431814+0000","last_undegraded":"2024-02-19T21:55:00.431814+0000","last_fullsized":"2024-02-19T21:55:00.431814+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'21","last_scrub_stamp":"2024-02-19T21:53:52.104285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:53:52.104285+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"517'6081","reported_seq":6114,"reported_epoch":517,"state":"active+clean","last_fresh":"2024-02-19T21:55:05.031031+0000","last_change":"2024-02-19T21:53:45.368993+0000","last_active":"2024-02-19T21:55:05.031031+0000","last_peered":"2024-02-19T21:55:05.031031+0000","last_clean":"2024-02-19T21:55:05.031031+0000","last_became_active":"2024-02-19T21:53:45.368696+0000","last_became_peered":"2024-02-19T21:53:45.368696+0000","last_unstale":"2024-02-19T21:55:05.031031+0000","last_undegraded":"2024-02-19T21:55:05.031031+0000","last_fullsized":"2024-02-19T21:55:05.031031+0000","mapping_epoch":492,"log_start":"498'500","ondisk_log_start":"498'500","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":5581,"ondisk_log_size":5581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":398524416,"num_objects":6081,"num_object_clones":0,"num_object_copies":18243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6081,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6081,"num_write_kb":389184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":39,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.433850+0000","last_change":"2024-02-19T21:54:10.520264+0000","last_active":"2024-02-19T21:55:00.433850+0000","last_peered":"2024-02-19T21:55:00.433850+0000","last_clean":"2024-02-19T21:55:00.433850+0000","last_became_active":"2024-02-19T21:53:45.368696+0000","last_became_peered":"2024-02-19T21:53:45.368696+0000","last_unstale":"2024-02-19T21:55:00.433850+0000","last_undegraded":"2024-02-19T21:55:00.433850+0000","last_fullsized":"2024-02-19T21:55:00.433850+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:10.520197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:54:10.520197+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"378'4","reported_seq":536,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.397089+0000","last_change":"2024-02-19T21:54:58.444948+0000","last_active":"2024-02-19T21:55:00.397089+0000","last_peered":"2024-02-19T21:55:00.397089+0000","last_clean":"2024-02-19T21:55:00.397089+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:55:00.397089+0000","last_undegraded":"2024-02-19T21:55:00.397089+0000","last_fullsized":"2024-02-19T21:55:00.397089+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"378'4","last_scrub_stamp":"2024-02-19T21:54:58.444848+0000","last_deep_scrub":"378'4","last_deep_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_clean_scrub_stamp":"2024-02-19T21:54:58.444848+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"470'29","reported_seq":387,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.396603+0000","last_change":"2024-02-19T21:48:22.519465+0000","last_active":"2024-02-19T21:55:00.396603+0000","last_peered":"2024-02-19T21:55:00.396603+0000","last_clean":"2024-02-19T21:55:00.396603+0000","last_became_active":"2024-02-19T21:47:46.252085+0000","last_became_peered":"2024-02-19T21:47:46.252085+0000","last_unstale":"2024-02-19T21:55:00.396603+0000","last_undegraded":"2024-02-19T21:55:00.396603+0000","last_fullsized":"2024-02-19T21:55:00.396603+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'23","last_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_deep_scrub":"200'23","last_deep_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.519381+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":33,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6],"acting":[4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":148,"reported_epoch":515,"state":"active+clean","last_fresh":"2024-02-19T21:54:57.542694+0000","last_change":"2024-02-19T21:53:56.234612+0000","last_active":"2024-02-19T21:54:57.542694+0000","last_peered":"2024-02-19T21:54:57.542694+0000","last_clean":"2024-02-19T21:54:57.542694+0000","last_became_active":"2024-02-19T21:49:08.328237+0000","last_became_peered":"2024-02-19T21:49:08.328237+0000","last_unstale":"2024-02-19T21:54:57.542694+0000","last_undegraded":"2024-02-19T21:54:57.542694+0000","last_fullsized":"2024-02-19T21:54:57.542694+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:56.234550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:53:56.234550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"516'5876","reported_seq":5908,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:02.182297+0000","last_change":"2024-02-19T21:53:45.366793+0000","last_active":"2024-02-19T21:55:02.182297+0000","last_peered":"2024-02-19T21:55:02.182297+0000","last_clean":"2024-02-19T21:55:02.182297+0000","last_became_active":"2024-02-19T21:53:45.366507+0000","last_became_peered":"2024-02-19T21:53:45.366507+0000","last_unstale":"2024-02-19T21:55:02.182297+0000","last_undegraded":"2024-02-19T21:55:02.182297+0000","last_fullsized":"2024-02-19T21:55:02.182297+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":5876,"ondisk_log_size":5876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":385089536,"num_objects":5876,"num_object_clones":0,"num_object_copies":17628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5876,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5876,"num_write_kb":376064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6],"acting":[2,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":558,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.425625+0000","last_change":"2024-02-19T21:54:03.090621+0000","last_active":"2024-02-19T21:55:00.425625+0000","last_peered":"2024-02-19T21:55:00.425625+0000","last_clean":"2024-02-19T21:55:00.425625+0000","last_became_active":"2024-02-19T21:53:45.372402+0000","last_became_peered":"2024-02-19T21:53:45.372402+0000","last_unstale":"2024-02-19T21:55:00.425625+0000","last_undegraded":"2024-02-19T21:55:00.425625+0000","last_fullsized":"2024-02-19T21:55:00.425625+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:03.090525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:03.090525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":492,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.418014+0000","last_change":"2024-02-19T21:48:37.789514+0000","last_active":"2024-02-19T21:55:00.418014+0000","last_peered":"2024-02-19T21:55:00.418014+0000","last_clean":"2024-02-19T21:55:00.418014+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:55:00.418014+0000","last_undegraded":"2024-02-19T21:55:00.418014+0000","last_fullsized":"2024-02-19T21:55:00.418014+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:37.789400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:37.789400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"470'30","reported_seq":413,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.412078+0000","last_change":"2024-02-19T21:45:57.877936+0000","last_active":"2024-02-19T21:55:00.412078+0000","last_peered":"2024-02-19T21:55:00.412078+0000","last_clean":"2024-02-19T21:55:00.412078+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:55:00.412078+0000","last_undegraded":"2024-02-19T21:55:00.412078+0000","last_fullsized":"2024-02-19T21:55:00.412078+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'20","last_scrub_stamp":"2024-02-19T21:45:57.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:45:57.877856+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":773,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:02.137785+0000","last_change":"2024-02-19T21:49:01.011149+0000","last_active":"2024-02-19T21:55:02.137785+0000","last_peered":"2024-02-19T21:55:02.137785+0000","last_clean":"2024-02-19T21:55:02.137785+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:55:02.137785+0000","last_undegraded":"2024-02-19T21:55:02.137785+0000","last_fullsized":"2024-02-19T21:55:02.137785+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:49:01.011078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:49:01.011078+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"517'5928","reported_seq":5961,"reported_epoch":517,"state":"active+clean","last_fresh":"2024-02-19T21:55:05.287206+0000","last_change":"2024-02-19T21:53:45.371934+0000","last_active":"2024-02-19T21:55:05.287206+0000","last_peered":"2024-02-19T21:55:05.287206+0000","last_clean":"2024-02-19T21:55:05.287206+0000","last_became_active":"2024-02-19T21:53:45.371632+0000","last_became_peered":"2024-02-19T21:53:45.371632+0000","last_unstale":"2024-02-19T21:55:05.287206+0000","last_undegraded":"2024-02-19T21:55:05.287206+0000","last_fullsized":"2024-02-19T21:55:05.287206+0000","mapping_epoch":492,"log_start":"498'829","ondisk_log_start":"498'829","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":5099,"ondisk_log_size":5099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":388497408,"num_objects":5928,"num_object_clones":0,"num_object_copies":17784,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5928,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5928,"num_write_kb":379392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":441,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.397027+0000","last_change":"2024-02-19T21:48:33.478821+0000","last_active":"2024-02-19T21:55:00.397027+0000","last_peered":"2024-02-19T21:55:00.397027+0000","last_clean":"2024-02-19T21:55:00.397027+0000","last_became_active":"2024-02-19T21:44:56.149476+0000","last_became_peered":"2024-02-19T21:44:56.149476+0000","last_unstale":"2024-02-19T21:55:00.397027+0000","last_undegraded":"2024-02-19T21:55:00.397027+0000","last_fullsized":"2024-02-19T21:55:00.397027+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:33.478715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:48:33.478715+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":506,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.404587+0000","last_change":"2024-02-19T21:54:19.347995+0000","last_active":"2024-02-19T21:55:00.404587+0000","last_peered":"2024-02-19T21:55:00.404587+0000","last_clean":"2024-02-19T21:55:00.404587+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:55:00.404587+0000","last_undegraded":"2024-02-19T21:55:00.404587+0000","last_fullsized":"2024-02-19T21:55:00.404587+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:19.347909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:54:19.347909+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"470'58","reported_seq":988,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:02.137045+0000","last_change":"2024-02-19T21:54:23.554440+0000","last_active":"2024-02-19T21:55:02.137045+0000","last_peered":"2024-02-19T21:55:02.137045+0000","last_clean":"2024-02-19T21:55:02.137045+0000","last_became_active":"2024-02-19T21:49:08.334527+0000","last_became_peered":"2024-02-19T21:49:08.334527+0000","last_unstale":"2024-02-19T21:55:02.137045+0000","last_undegraded":"2024-02-19T21:55:02.137045+0000","last_fullsized":"2024-02-19T21:55:02.137045+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'58","last_scrub_stamp":"2024-02-19T21:54:23.554337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:54:23.554337+0000","log_size":58,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":50,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":491,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.427402+0000","last_change":"2024-02-19T21:54:24.918144+0000","last_active":"2024-02-19T21:55:00.427402+0000","last_peered":"2024-02-19T21:55:00.427402+0000","last_clean":"2024-02-19T21:55:00.427402+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:55:00.427402+0000","last_undegraded":"2024-02-19T21:55:00.427402+0000","last_fullsized":"2024-02-19T21:55:00.427402+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:24.918045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:54:24.918045+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"517'5931","reported_seq":5964,"reported_epoch":517,"state":"active+clean","last_fresh":"2024-02-19T21:55:05.213330+0000","last_change":"2024-02-19T21:53:45.367105+0000","last_active":"2024-02-19T21:55:05.213330+0000","last_peered":"2024-02-19T21:55:05.213330+0000","last_clean":"2024-02-19T21:55:05.213330+0000","last_became_active":"2024-02-19T21:53:45.366773+0000","last_became_peered":"2024-02-19T21:53:45.366773+0000","last_unstale":"2024-02-19T21:55:05.213330+0000","last_undegraded":"2024-02-19T21:55:05.213330+0000","last_fullsized":"2024-02-19T21:55:05.213330+0000","mapping_epoch":492,"log_start":"498'1000","ondisk_log_start":"498'1000","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":4931,"ondisk_log_size":4931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":388694016,"num_objects":5931,"num_object_clones":0,"num_object_copies":17793,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5931,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5931,"num_write_kb":379584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":525,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.409663+0000","last_change":"2024-02-19T21:53:45.368651+0000","last_active":"2024-02-19T21:55:00.409663+0000","last_peered":"2024-02-19T21:55:00.409663+0000","last_clean":"2024-02-19T21:55:00.409663+0000","last_became_active":"2024-02-19T21:53:45.368343+0000","last_became_peered":"2024-02-19T21:53:45.368343+0000","last_unstale":"2024-02-19T21:55:00.409663+0000","last_undegraded":"2024-02-19T21:55:00.409663+0000","last_fullsized":"2024-02-19T21:55:00.409663+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.227355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.227355+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'6","reported_seq":1980,"reported_epoch":517,"state":"active+clean","last_fresh":"2024-02-19T21:55:03.959462+0000","last_change":"2024-02-19T21:53:56.369658+0000","last_active":"2024-02-19T21:55:03.959462+0000","last_peered":"2024-02-19T21:55:03.959462+0000","last_clean":"2024-02-19T21:55:03.959462+0000","last_became_active":"2024-02-19T21:49:08.331108+0000","last_became_peered":"2024-02-19T21:49:08.331108+0000","last_unstale":"2024-02-19T21:55:03.959462+0000","last_undegraded":"2024-02-19T21:55:03.959462+0000","last_fullsized":"2024-02-19T21:55:03.959462+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-02-19T21:53:56.369590+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_clean_scrub_stamp":"2024-02-19T21:53:56.369590+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1340,"num_read_kb":1335,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":148,"reported_epoch":515,"state":"active+clean","last_fresh":"2024-02-19T21:54:57.543044+0000","last_change":"2024-02-19T21:54:07.330521+0000","last_active":"2024-02-19T21:54:57.543044+0000","last_peered":"2024-02-19T21:54:57.543044+0000","last_clean":"2024-02-19T21:54:57.543044+0000","last_became_active":"2024-02-19T21:49:08.329378+0000","last_became_peered":"2024-02-19T21:49:08.329378+0000","last_unstale":"2024-02-19T21:54:57.543044+0000","last_undegraded":"2024-02-19T21:54:57.543044+0000","last_fullsized":"2024-02-19T21:54:57.543044+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:07.330454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:07.330454+0000","last_clean_scrub_stamp":"2024-02-19T21:54:07.330454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"470'21","reported_seq":555,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.424207+0000","last_change":"2024-02-19T21:48:14.878933+0000","last_active":"2024-02-19T21:55:00.424207+0000","last_peered":"2024-02-19T21:55:00.424207+0000","last_clean":"2024-02-19T21:55:00.424207+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:55:00.424207+0000","last_undegraded":"2024-02-19T21:55:00.424207+0000","last_fullsized":"2024-02-19T21:55:00.424207+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'17","last_scrub_stamp":"2024-02-19T21:48:14.878857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.878857+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":31,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":148,"reported_epoch":515,"state":"active+clean","last_fresh":"2024-02-19T21:54:57.543031+0000","last_change":"2024-02-19T21:53:59.298965+0000","last_active":"2024-02-19T21:54:57.543031+0000","last_peered":"2024-02-19T21:54:57.543031+0000","last_clean":"2024-02-19T21:54:57.543031+0000","last_became_active":"2024-02-19T21:49:08.325127+0000","last_became_peered":"2024-02-19T21:49:08.325127+0000","last_unstale":"2024-02-19T21:54:57.543031+0000","last_undegraded":"2024-02-19T21:54:57.543031+0000","last_fullsized":"2024-02-19T21:54:57.543031+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:59.298898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:53:59.298898+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"517'6044","reported_seq":6077,"reported_epoch":517,"state":"active+clean","last_fresh":"2024-02-19T21:55:05.130502+0000","last_change":"2024-02-19T21:53:45.370224+0000","last_active":"2024-02-19T21:55:05.130502+0000","last_peered":"2024-02-19T21:55:05.130502+0000","last_clean":"2024-02-19T21:55:05.130502+0000","last_became_active":"2024-02-19T21:53:45.369947+0000","last_became_peered":"2024-02-19T21:53:45.369947+0000","last_unstale":"2024-02-19T21:55:05.130502+0000","last_undegraded":"2024-02-19T21:55:05.130502+0000","last_fullsized":"2024-02-19T21:55:05.130502+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":6044,"ondisk_log_size":6044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":396099584,"num_objects":6044,"num_object_clones":0,"num_object_copies":18132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6044,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6044,"num_write_kb":386816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":532,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.403961+0000","last_change":"2024-02-19T21:54:05.543474+0000","last_active":"2024-02-19T21:55:00.403961+0000","last_peered":"2024-02-19T21:55:00.403961+0000","last_clean":"2024-02-19T21:55:00.403961+0000","last_became_active":"2024-02-19T21:53:45.385423+0000","last_became_peered":"2024-02-19T21:53:45.385423+0000","last_unstale":"2024-02-19T21:55:00.403961+0000","last_undegraded":"2024-02-19T21:55:00.403961+0000","last_fullsized":"2024-02-19T21:55:00.403961+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:05.543362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_clean_scrub_stamp":"2024-02-19T21:54:05.543362+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":396,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.404715+0000","last_change":"2024-02-19T21:49:05.746443+0000","last_active":"2024-02-19T21:55:00.404715+0000","last_peered":"2024-02-19T21:55:00.404715+0000","last_clean":"2024-02-19T21:55:00.404715+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:55:00.404715+0000","last_undegraded":"2024-02-19T21:55:00.404715+0000","last_fullsized":"2024-02-19T21:55:00.404715+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.746358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.746358+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":562,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.404200+0000","last_change":"2024-02-19T21:54:52.479718+0000","last_active":"2024-02-19T21:55:00.404200+0000","last_peered":"2024-02-19T21:55:00.404200+0000","last_clean":"2024-02-19T21:55:00.404200+0000","last_became_active":"2024-02-19T21:54:52.479416+0000","last_became_peered":"2024-02-19T21:54:52.479416+0000","last_unstale":"2024-02-19T21:55:00.404200+0000","last_undegraded":"2024-02-19T21:55:00.404200+0000","last_fullsized":"2024-02-19T21:55:00.404200+0000","mapping_epoch":513,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":514,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:58.410478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:58.410478+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":118,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.408715+0000","last_change":"2024-02-19T21:53:51.510006+0000","last_active":"2024-02-19T21:55:00.408715+0000","last_peered":"2024-02-19T21:55:00.408715+0000","last_clean":"2024-02-19T21:55:00.408715+0000","last_became_active":"2024-02-19T21:49:54.483637+0000","last_became_peered":"2024-02-19T21:49:54.483637+0000","last_unstale":"2024-02-19T21:55:00.408715+0000","last_undegraded":"2024-02-19T21:55:00.408715+0000","last_fullsized":"2024-02-19T21:55:00.408715+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:51.509926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:53:51.509926+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"470'45","reported_seq":563,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.416110+0000","last_change":"2024-02-19T21:53:59.548929+0000","last_active":"2024-02-19T21:55:00.416110+0000","last_peered":"2024-02-19T21:55:00.416110+0000","last_clean":"2024-02-19T21:55:00.416110+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:55:00.416110+0000","last_undegraded":"2024-02-19T21:55:00.416110+0000","last_fullsized":"2024-02-19T21:55:00.416110+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'45","last_scrub_stamp":"2024-02-19T21:53:59.548843+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:53:59.548843+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":51,"num_write":37,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":118,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.409325+0000","last_change":"2024-02-19T21:53:55.571648+0000","last_active":"2024-02-19T21:55:00.409325+0000","last_peered":"2024-02-19T21:55:00.409325+0000","last_clean":"2024-02-19T21:55:00.409325+0000","last_became_active":"2024-02-19T21:49:54.477947+0000","last_became_peered":"2024-02-19T21:49:54.477947+0000","last_unstale":"2024-02-19T21:55:00.409325+0000","last_undegraded":"2024-02-19T21:55:00.409325+0000","last_fullsized":"2024-02-19T21:55:00.409325+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:55.571582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:53:55.571582+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"517'5940","reported_seq":5973,"reported_epoch":517,"state":"active+clean","last_fresh":"2024-02-19T21:55:05.194510+0000","last_change":"2024-02-19T21:53:45.367633+0000","last_active":"2024-02-19T21:55:05.194510+0000","last_peered":"2024-02-19T21:55:05.194510+0000","last_clean":"2024-02-19T21:55:05.194510+0000","last_became_active":"2024-02-19T21:53:45.367151+0000","last_became_peered":"2024-02-19T21:53:45.367151+0000","last_unstale":"2024-02-19T21:55:05.194510+0000","last_undegraded":"2024-02-19T21:55:05.194510+0000","last_fullsized":"2024-02-19T21:55:05.194510+0000","mapping_epoch":492,"log_start":"498'1000","ondisk_log_start":"498'1000","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":4940,"ondisk_log_size":4940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389283840,"num_objects":5940,"num_object_clones":0,"num_object_copies":17820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5940,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5940,"num_write_kb":380160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1],"acting":[6,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":490,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.418353+0000","last_change":"2024-02-19T21:45:47.723650+0000","last_active":"2024-02-19T21:55:00.418353+0000","last_peered":"2024-02-19T21:55:00.418353+0000","last_clean":"2024-02-19T21:55:00.418353+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:55:00.418353+0000","last_undegraded":"2024-02-19T21:55:00.418353+0000","last_fullsized":"2024-02-19T21:55:00.418353+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:45:47.723550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:45:47.723550+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":504,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.426348+0000","last_change":"2024-02-19T21:54:08.084019+0000","last_active":"2024-02-19T21:55:00.426348+0000","last_peered":"2024-02-19T21:55:00.426348+0000","last_clean":"2024-02-19T21:55:00.426348+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:55:00.426348+0000","last_undegraded":"2024-02-19T21:55:00.426348+0000","last_fullsized":"2024-02-19T21:55:00.426348+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:08.083923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:54:08.083923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":523,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.408857+0000","last_change":"2024-02-19T21:54:17.718006+0000","last_active":"2024-02-19T21:55:00.408857+0000","last_peered":"2024-02-19T21:55:00.408857+0000","last_clean":"2024-02-19T21:55:00.408857+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:55:00.408857+0000","last_undegraded":"2024-02-19T21:55:00.408857+0000","last_fullsized":"2024-02-19T21:55:00.408857+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:17.717904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:54:17.717904+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"470'42","reported_seq":666,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.431759+0000","last_change":"2024-02-19T21:54:18.926423+0000","last_active":"2024-02-19T21:55:00.431759+0000","last_peered":"2024-02-19T21:55:00.431759+0000","last_clean":"2024-02-19T21:55:00.431759+0000","last_became_active":"2024-02-19T21:49:08.329761+0000","last_became_peered":"2024-02-19T21:49:08.329761+0000","last_unstale":"2024-02-19T21:55:00.431759+0000","last_undegraded":"2024-02-19T21:55:00.431759+0000","last_fullsized":"2024-02-19T21:55:00.431759+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'42","last_scrub_stamp":"2024-02-19T21:54:18.926260+0000","last_deep_scrub":"324'30","last_deep_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_clean_scrub_stamp":"2024-02-19T21:54:18.926260+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":48,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":507,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.403970+0000","last_change":"2024-02-19T21:53:53.417715+0000","last_active":"2024-02-19T21:55:00.403970+0000","last_peered":"2024-02-19T21:55:00.403970+0000","last_clean":"2024-02-19T21:55:00.403970+0000","last_became_active":"2024-02-19T21:44:42.624782+0000","last_became_peered":"2024-02-19T21:44:42.624782+0000","last_unstale":"2024-02-19T21:55:00.403970+0000","last_undegraded":"2024-02-19T21:55:00.403970+0000","last_fullsized":"2024-02-19T21:55:00.403970+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":295,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:53.417639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_clean_scrub_stamp":"2024-02-19T21:53:53.417639+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.c","version":"517'6000","reported_seq":6031,"reported_epoch":517,"state":"active+clean","last_fresh":"2024-02-19T21:55:05.265475+0000","last_change":"2024-02-19T21:53:45.366888+0000","last_active":"2024-02-19T21:55:05.265475+0000","last_peered":"2024-02-19T21:55:05.265475+0000","last_clean":"2024-02-19T21:55:05.265475+0000","last_became_active":"2024-02-19T21:53:45.366605+0000","last_became_peered":"2024-02-19T21:53:45.366605+0000","last_unstale":"2024-02-19T21:55:05.265475+0000","last_undegraded":"2024-02-19T21:55:05.265475+0000","last_fullsized":"2024-02-19T21:55:05.265475+0000","mapping_epoch":492,"log_start":"498'832","ondisk_log_start":"498'832","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":5168,"ondisk_log_size":5168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":393216000,"num_objects":6000,"num_object_clones":0,"num_object_copies":18000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6000,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6000,"num_write_kb":384000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":528,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.411679+0000","last_change":"2024-02-19T21:53:59.350715+0000","last_active":"2024-02-19T21:55:00.411679+0000","last_peered":"2024-02-19T21:55:00.411679+0000","last_clean":"2024-02-19T21:55:00.411679+0000","last_became_active":"2024-02-19T21:49:08.330648+0000","last_became_peered":"2024-02-19T21:49:08.330648+0000","last_unstale":"2024-02-19T21:55:00.411679+0000","last_undegraded":"2024-02-19T21:55:00.411679+0000","last_fullsized":"2024-02-19T21:55:00.411679+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:59.350627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:53:59.350627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":499,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.409730+0000","last_change":"2024-02-19T21:54:59.095681+0000","last_active":"2024-02-19T21:55:00.409730+0000","last_peered":"2024-02-19T21:55:00.409730+0000","last_clean":"2024-02-19T21:55:00.409730+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:55:00.409730+0000","last_undegraded":"2024-02-19T21:55:00.409730+0000","last_fullsized":"2024-02-19T21:55:00.409730+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:59.095573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:45.017696+0000","last_clean_scrub_stamp":"2024-02-19T21:54:59.095573+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"470'47","reported_seq":567,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.427938+0000","last_change":"2024-02-19T21:53:58.140432+0000","last_active":"2024-02-19T21:55:00.427938+0000","last_peered":"2024-02-19T21:55:00.427938+0000","last_clean":"2024-02-19T21:55:00.427938+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:55:00.427938+0000","last_undegraded":"2024-02-19T21:55:00.427938+0000","last_fullsized":"2024-02-19T21:55:00.427938+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'47","last_scrub_stamp":"2024-02-19T21:53:58.140324+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:53:58.140324+0000","log_size":47,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":55,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":496,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.415783+0000","last_change":"2024-02-19T21:54:02.567491+0000","last_active":"2024-02-19T21:55:00.415783+0000","last_peered":"2024-02-19T21:55:00.415783+0000","last_clean":"2024-02-19T21:55:00.415783+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:55:00.415783+0000","last_undegraded":"2024-02-19T21:55:00.415783+0000","last_fullsized":"2024-02-19T21:55:00.415783+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:02.567400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:54:02.567400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"517'6070","reported_seq":6103,"reported_epoch":517,"state":"active+clean","last_fresh":"2024-02-19T21:55:04.875435+0000","last_change":"2024-02-19T21:53:45.370394+0000","last_active":"2024-02-19T21:55:04.875435+0000","last_peered":"2024-02-19T21:55:04.875435+0000","last_clean":"2024-02-19T21:55:04.875435+0000","last_became_active":"2024-02-19T21:53:45.370069+0000","last_became_peered":"2024-02-19T21:53:45.370069+0000","last_unstale":"2024-02-19T21:55:04.875435+0000","last_undegraded":"2024-02-19T21:55:04.875435+0000","last_fullsized":"2024-02-19T21:55:04.875435+0000","mapping_epoch":492,"log_start":"498'1100","ondisk_log_start":"498'1100","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":4970,"ondisk_log_size":4970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":397803520,"num_objects":6070,"num_object_clones":0,"num_object_copies":18210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6070,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6070,"num_write_kb":388480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":241,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.397418+0000","last_change":"2024-02-19T21:54:04.297489+0000","last_active":"2024-02-19T21:55:00.397418+0000","last_peered":"2024-02-19T21:55:00.397418+0000","last_clean":"2024-02-19T21:55:00.397418+0000","last_became_active":"2024-02-19T21:49:08.326106+0000","last_became_peered":"2024-02-19T21:49:08.326106+0000","last_unstale":"2024-02-19T21:55:00.397418+0000","last_undegraded":"2024-02-19T21:55:00.397418+0000","last_fullsized":"2024-02-19T21:55:00.397418+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:04.297389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:04.297389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":496,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.424634+0000","last_change":"2024-02-19T21:48:11.879787+0000","last_active":"2024-02-19T21:55:00.424634+0000","last_peered":"2024-02-19T21:55:00.424634+0000","last_clean":"2024-02-19T21:55:00.424634+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:55:00.424634+0000","last_undegraded":"2024-02-19T21:55:00.424634+0000","last_fullsized":"2024-02-19T21:55:00.424634+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.879687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.879687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"470'50","reported_seq":149,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.409025+0000","last_change":"2024-02-19T21:49:55.861358+0000","last_active":"2024-02-19T21:55:00.409025+0000","last_peered":"2024-02-19T21:55:00.409025+0000","last_clean":"2024-02-19T21:55:00.409025+0000","last_became_active":"2024-02-19T21:49:54.480413+0000","last_became_peered":"2024-02-19T21:49:54.480413+0000","last_unstale":"2024-02-19T21:55:00.409025+0000","last_undegraded":"2024-02-19T21:55:00.409025+0000","last_fullsized":"2024-02-19T21:55:00.409025+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":415,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'38","last_scrub_stamp":"2024-02-19T21:49:05.923627+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.923627+0000","log_size":50,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":57,"num_write":44,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":392,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.418004+0000","last_change":"2024-02-19T21:54:58.727836+0000","last_active":"2024-02-19T21:55:00.418004+0000","last_peered":"2024-02-19T21:55:00.418004+0000","last_clean":"2024-02-19T21:55:00.418004+0000","last_became_active":"2024-02-19T21:49:54.494802+0000","last_became_peered":"2024-02-19T21:49:54.494802+0000","last_unstale":"2024-02-19T21:55:00.418004+0000","last_undegraded":"2024-02-19T21:55:00.418004+0000","last_fullsized":"2024-02-19T21:55:00.418004+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:58.727756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:54:58.727756+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"517'6117","reported_seq":6150,"reported_epoch":517,"state":"active+clean","last_fresh":"2024-02-19T21:55:05.306973+0000","last_change":"2024-02-19T21:53:45.386994+0000","last_active":"2024-02-19T21:55:05.306973+0000","last_peered":"2024-02-19T21:55:05.306973+0000","last_clean":"2024-02-19T21:55:05.306973+0000","last_became_active":"2024-02-19T21:53:45.386670+0000","last_became_peered":"2024-02-19T21:53:45.386670+0000","last_unstale":"2024-02-19T21:55:05.306973+0000","last_undegraded":"2024-02-19T21:55:05.306973+0000","last_fullsized":"2024-02-19T21:55:05.306973+0000","mapping_epoch":492,"log_start":"498'600","ondisk_log_start":"498'600","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":5517,"ondisk_log_size":5517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":400883712,"num_objects":6117,"num_object_clones":0,"num_object_copies":18351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6117,"num_write_kb":391488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7],"acting":[4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":528,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.409608+0000","last_change":"2024-02-19T21:54:01.641103+0000","last_active":"2024-02-19T21:55:00.409608+0000","last_peered":"2024-02-19T21:55:00.409608+0000","last_clean":"2024-02-19T21:55:00.409608+0000","last_became_active":"2024-02-19T21:49:08.328529+0000","last_became_peered":"2024-02-19T21:49:08.328529+0000","last_unstale":"2024-02-19T21:55:00.409608+0000","last_undegraded":"2024-02-19T21:55:00.409608+0000","last_fullsized":"2024-02-19T21:55:00.409608+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:01.641007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:01.641007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":559,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.416030+0000","last_change":"2024-02-19T21:53:52.715548+0000","last_active":"2024-02-19T21:55:00.416030+0000","last_peered":"2024-02-19T21:55:00.416030+0000","last_clean":"2024-02-19T21:55:00.416030+0000","last_became_active":"2024-02-19T21:49:54.493041+0000","last_became_peered":"2024-02-19T21:49:54.493041+0000","last_unstale":"2024-02-19T21:55:00.416030+0000","last_undegraded":"2024-02-19T21:55:00.416030+0000","last_fullsized":"2024-02-19T21:55:00.416030+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:52.715486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:52.715486+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"470'42","reported_seq":389,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.396531+0000","last_change":"2024-02-19T21:54:01.223459+0000","last_active":"2024-02-19T21:55:00.396531+0000","last_peered":"2024-02-19T21:55:00.396531+0000","last_clean":"2024-02-19T21:55:00.396531+0000","last_became_active":"2024-02-19T21:49:08.330477+0000","last_became_peered":"2024-02-19T21:49:08.330477+0000","last_unstale":"2024-02-19T21:55:00.396531+0000","last_undegraded":"2024-02-19T21:55:00.396531+0000","last_fullsized":"2024-02-19T21:55:00.396531+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'42","last_scrub_stamp":"2024-02-19T21:54:01.223355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:54:01.223355+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":629,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:03.593059+0000","last_change":"2024-02-19T21:55:03.593029+0000","last_active":"2024-02-19T21:55:03.593059+0000","last_peered":"2024-02-19T21:55:03.593059+0000","last_clean":"2024-02-19T21:55:03.593059+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:55:03.593059+0000","last_undegraded":"2024-02-19T21:55:03.593059+0000","last_fullsized":"2024-02-19T21:55:03.593059+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'9","last_scrub_stamp":"2024-02-19T21:55:03.592953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:55:03.592953+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"517'6017","reported_seq":6050,"reported_epoch":517,"state":"active+clean","last_fresh":"2024-02-19T21:55:05.224318+0000","last_change":"2024-02-19T21:53:45.367451+0000","last_active":"2024-02-19T21:55:05.224318+0000","last_peered":"2024-02-19T21:55:05.224318+0000","last_clean":"2024-02-19T21:55:05.224318+0000","last_became_active":"2024-02-19T21:53:45.366735+0000","last_became_peered":"2024-02-19T21:53:45.366735+0000","last_unstale":"2024-02-19T21:55:05.224318+0000","last_undegraded":"2024-02-19T21:55:05.224318+0000","last_fullsized":"2024-02-19T21:55:05.224318+0000","mapping_epoch":492,"log_start":"498'1000","ondisk_log_start":"498'1000","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":5017,"ondisk_log_size":5017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":394330112,"num_objects":6017,"num_object_clones":0,"num_object_copies":18051,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6017,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6017,"num_write_kb":385088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"66'1","reported_seq":410,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.416098+0000","last_change":"2024-02-19T21:54:23.697006+0000","last_active":"2024-02-19T21:55:00.416098+0000","last_peered":"2024-02-19T21:55:00.416098+0000","last_clean":"2024-02-19T21:55:00.416098+0000","last_became_active":"2024-02-19T21:44:56.166670+0000","last_became_peered":"2024-02-19T21:44:56.166670+0000","last_unstale":"2024-02-19T21:55:00.416098+0000","last_undegraded":"2024-02-19T21:55:00.416098+0000","last_fullsized":"2024-02-19T21:55:00.416098+0000","mapping_epoch":165,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:54:23.696937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:54:23.696937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"261'11","reported_seq":639,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:02.137961+0000","last_change":"2024-02-19T21:53:55.479779+0000","last_active":"2024-02-19T21:55:02.137961+0000","last_peered":"2024-02-19T21:55:02.137961+0000","last_clean":"2024-02-19T21:55:02.137961+0000","last_became_active":"2024-02-19T21:44:08.123392+0000","last_became_peered":"2024-02-19T21:44:08.123392+0000","last_unstale":"2024-02-19T21:55:02.137961+0000","last_undegraded":"2024-02-19T21:55:02.137961+0000","last_fullsized":"2024-02-19T21:55:02.137961+0000","mapping_epoch":62,"log_start":"257'10","ondisk_log_start":"257'10","created":62,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-02-19T21:53:55.479699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:53:55.479699+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":510,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.408938+0000","last_change":"2024-02-19T21:54:16.707968+0000","last_active":"2024-02-19T21:55:00.408938+0000","last_peered":"2024-02-19T21:55:00.408938+0000","last_clean":"2024-02-19T21:55:00.408938+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:55:00.408938+0000","last_undegraded":"2024-02-19T21:55:00.408938+0000","last_fullsized":"2024-02-19T21:55:00.408938+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:54:16.707865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:54:16.707865+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"470'27","reported_seq":375,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.396920+0000","last_change":"2024-02-19T21:48:34.485865+0000","last_active":"2024-02-19T21:55:00.396920+0000","last_peered":"2024-02-19T21:55:00.396920+0000","last_clean":"2024-02-19T21:55:00.396920+0000","last_became_active":"2024-02-19T21:47:46.251550+0000","last_became_peered":"2024-02-19T21:47:46.251550+0000","last_unstale":"2024-02-19T21:55:00.396920+0000","last_undegraded":"2024-02-19T21:55:00.396920+0000","last_fullsized":"2024-02-19T21:55:00.396920+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:34.485787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:34.485787+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7],"acting":[4,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.0","version":"517'6024","reported_seq":6057,"reported_epoch":517,"state":"active+clean","last_fresh":"2024-02-19T21:55:05.264816+0000","last_change":"2024-02-19T21:53:45.376702+0000","last_active":"2024-02-19T21:55:05.264816+0000","last_peered":"2024-02-19T21:55:05.264816+0000","last_clean":"2024-02-19T21:55:05.264816+0000","last_became_active":"2024-02-19T21:53:45.376392+0000","last_became_peered":"2024-02-19T21:53:45.376392+0000","last_unstale":"2024-02-19T21:55:05.264816+0000","last_undegraded":"2024-02-19T21:55:05.264816+0000","last_fullsized":"2024-02-19T21:55:05.264816+0000","mapping_epoch":492,"log_start":"498'851","ondisk_log_start":"498'851","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":5173,"ondisk_log_size":5173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":394788864,"num_objects":6024,"num_object_clones":0,"num_object_copies":18072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6024,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6024,"num_write_kb":385536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,6],"acting":[1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":516,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.403693+0000","last_change":"2024-02-19T21:54:06.529408+0000","last_active":"2024-02-19T21:55:00.403693+0000","last_peered":"2024-02-19T21:55:00.403693+0000","last_clean":"2024-02-19T21:55:00.403693+0000","last_became_active":"2024-02-19T21:44:56.155194+0000","last_became_peered":"2024-02-19T21:44:56.155194+0000","last_unstale":"2024-02-19T21:55:00.403693+0000","last_undegraded":"2024-02-19T21:55:00.403693+0000","last_fullsized":"2024-02-19T21:55:00.403693+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:06.529311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:06.529311+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"363'12","reported_seq":347,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:02.140686+0000","last_change":"2024-02-19T21:48:25.487689+0000","last_active":"2024-02-19T21:55:02.140686+0000","last_peered":"2024-02-19T21:55:02.140686+0000","last_clean":"2024-02-19T21:55:02.140686+0000","last_became_active":"2024-02-19T21:47:46.260099+0000","last_became_peered":"2024-02-19T21:47:46.260099+0000","last_unstale":"2024-02-19T21:55:02.140686+0000","last_undegraded":"2024-02-19T21:55:02.140686+0000","last_fullsized":"2024-02-19T21:55:02.140686+0000","mapping_epoch":362,"log_start":"98'9","ondisk_log_start":"98'9","created":62,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"363'12","last_scrub_stamp":"2024-02-19T21:48:25.487608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.487608+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":530,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:02.556567+0000","last_change":"2024-02-19T21:55:02.556526+0000","last_active":"2024-02-19T21:55:02.556567+0000","last_peered":"2024-02-19T21:55:02.556567+0000","last_clean":"2024-02-19T21:55:02.556567+0000","last_became_active":"2024-02-19T21:53:45.382885+0000","last_became_peered":"2024-02-19T21:53:45.382885+0000","last_unstale":"2024-02-19T21:55:02.556567+0000","last_undegraded":"2024-02-19T21:55:02.556567+0000","last_fullsized":"2024-02-19T21:55:02.556567+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:02.556431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:55:02.556431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"471'46","reported_seq":483,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.403838+0000","last_change":"2024-02-19T21:54:24.358037+0000","last_active":"2024-02-19T21:55:00.403838+0000","last_peered":"2024-02-19T21:55:00.403838+0000","last_clean":"2024-02-19T21:55:00.403838+0000","last_became_active":"2024-02-19T21:53:45.384528+0000","last_became_peered":"2024-02-19T21:53:45.384528+0000","last_unstale":"2024-02-19T21:55:00.403838+0000","last_undegraded":"2024-02-19T21:55:00.403838+0000","last_fullsized":"2024-02-19T21:55:00.403838+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'46","last_scrub_stamp":"2024-02-19T21:54:24.357931+0000","last_deep_scrub":"270'34","last_deep_scrub_stamp":"2024-02-19T21:44:17.451151+0000","last_clean_scrub_stamp":"2024-02-19T21:54:24.357931+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"517'6207","reported_seq":6240,"reported_epoch":517,"state":"active+clean","last_fresh":"2024-02-19T21:55:05.126110+0000","last_change":"2024-02-19T21:53:45.368346+0000","last_active":"2024-02-19T21:55:05.126110+0000","last_peered":"2024-02-19T21:55:05.126110+0000","last_clean":"2024-02-19T21:55:05.126110+0000","last_became_active":"2024-02-19T21:53:45.368025+0000","last_became_peered":"2024-02-19T21:53:45.368025+0000","last_unstale":"2024-02-19T21:55:05.126110+0000","last_undegraded":"2024-02-19T21:55:05.126110+0000","last_fullsized":"2024-02-19T21:55:05.126110+0000","mapping_epoch":492,"log_start":"498'1200","ondisk_log_start":"498'1200","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":5007,"ondisk_log_size":5007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":406781952,"num_objects":6207,"num_object_clones":0,"num_object_copies":18621,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6207,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6207,"num_write_kb":397248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1],"acting":[6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":499,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.397190+0000","last_change":"2024-02-19T21:53:55.275891+0000","last_active":"2024-02-19T21:55:00.397190+0000","last_peered":"2024-02-19T21:55:00.397190+0000","last_clean":"2024-02-19T21:55:00.397190+0000","last_became_active":"2024-02-19T21:49:08.328697+0000","last_became_peered":"2024-02-19T21:49:08.328697+0000","last_unstale":"2024-02-19T21:55:00.397190+0000","last_undegraded":"2024-02-19T21:55:00.397190+0000","last_fullsized":"2024-02-19T21:55:00.397190+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:55.275772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:53:55.275772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"397'17","reported_seq":479,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.409158+0000","last_change":"2024-02-19T21:54:12.298455+0000","last_active":"2024-02-19T21:55:00.409158+0000","last_peered":"2024-02-19T21:55:00.409158+0000","last_clean":"2024-02-19T21:55:00.409158+0000","last_became_active":"2024-02-19T21:49:08.325034+0000","last_became_peered":"2024-02-19T21:49:08.325034+0000","last_unstale":"2024-02-19T21:55:00.409158+0000","last_undegraded":"2024-02-19T21:55:00.409158+0000","last_fullsized":"2024-02-19T21:55:00.409158+0000","mapping_epoch":394,"log_start":"170'11","ondisk_log_start":"170'11","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"397'17","last_scrub_stamp":"2024-02-19T21:54:12.298349+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:54:12.298349+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":515,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.411922+0000","last_change":"2024-02-19T21:53:45.383685+0000","last_active":"2024-02-19T21:55:00.411922+0000","last_peered":"2024-02-19T21:55:00.411922+0000","last_clean":"2024-02-19T21:55:00.411922+0000","last_became_active":"2024-02-19T21:53:45.383372+0000","last_became_peered":"2024-02-19T21:53:45.383372+0000","last_unstale":"2024-02-19T21:55:00.411922+0000","last_undegraded":"2024-02-19T21:55:00.411922+0000","last_fullsized":"2024-02-19T21:55:00.411922+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:03.987749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:49:03.987749+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"470'30","reported_seq":381,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.396642+0000","last_change":"2024-02-19T21:54:11.381056+0000","last_active":"2024-02-19T21:55:00.396642+0000","last_peered":"2024-02-19T21:55:00.396642+0000","last_clean":"2024-02-19T21:55:00.396642+0000","last_became_active":"2024-02-19T21:53:45.387040+0000","last_became_peered":"2024-02-19T21:53:45.387040+0000","last_unstale":"2024-02-19T21:55:00.396642+0000","last_undegraded":"2024-02-19T21:55:00.396642+0000","last_fullsized":"2024-02-19T21:55:00.396642+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'30","last_scrub_stamp":"2024-02-19T21:54:11.380958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:54:11.380958+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":38,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"516'5917","reported_seq":5949,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:02.245514+0000","last_change":"2024-02-19T21:53:45.369471+0000","last_active":"2024-02-19T21:55:02.245514+0000","last_peered":"2024-02-19T21:55:02.245514+0000","last_clean":"2024-02-19T21:55:02.245514+0000","last_became_active":"2024-02-19T21:53:45.369133+0000","last_became_peered":"2024-02-19T21:53:45.369133+0000","last_unstale":"2024-02-19T21:55:02.245514+0000","last_undegraded":"2024-02-19T21:55:02.245514+0000","last_fullsized":"2024-02-19T21:55:02.245514+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":5917,"ondisk_log_size":5917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":387776512,"num_objects":5917,"num_object_clones":0,"num_object_copies":17751,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5917,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5917,"num_write_kb":378688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":148,"reported_epoch":515,"state":"active+clean","last_fresh":"2024-02-19T21:54:57.542987+0000","last_change":"2024-02-19T21:54:00.421089+0000","last_active":"2024-02-19T21:54:57.542987+0000","last_peered":"2024-02-19T21:54:57.542987+0000","last_clean":"2024-02-19T21:54:57.542987+0000","last_became_active":"2024-02-19T21:49:08.327172+0000","last_became_peered":"2024-02-19T21:49:08.327172+0000","last_unstale":"2024-02-19T21:54:57.542987+0000","last_undegraded":"2024-02-19T21:54:57.542987+0000","last_fullsized":"2024-02-19T21:54:57.542987+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:00.420978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:00.420978+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,6],"acting":[2,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":506,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.418277+0000","last_change":"2024-02-19T21:54:16.533065+0000","last_active":"2024-02-19T21:55:00.418277+0000","last_peered":"2024-02-19T21:55:00.418277+0000","last_clean":"2024-02-19T21:55:00.418277+0000","last_became_active":"2024-02-19T21:44:22.245925+0000","last_became_peered":"2024-02-19T21:44:22.245925+0000","last_unstale":"2024-02-19T21:55:00.418277+0000","last_undegraded":"2024-02-19T21:55:00.418277+0000","last_fullsized":"2024-02-19T21:55:00.418277+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:16.532968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:54:16.532968+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":506,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.409481+0000","last_change":"2024-02-19T21:54:22.796082+0000","last_active":"2024-02-19T21:55:00.409481+0000","last_peered":"2024-02-19T21:55:00.409481+0000","last_clean":"2024-02-19T21:55:00.409481+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:55:00.409481+0000","last_undegraded":"2024-02-19T21:55:00.409481+0000","last_fullsized":"2024-02-19T21:55:00.409481+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:22.795999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:54:22.795999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"470'53","reported_seq":475,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.397094+0000","last_change":"2024-02-19T21:54:05.257204+0000","last_active":"2024-02-19T21:55:00.397094+0000","last_peered":"2024-02-19T21:55:00.397094+0000","last_clean":"2024-02-19T21:55:00.397094+0000","last_became_active":"2024-02-19T21:49:08.325683+0000","last_became_peered":"2024-02-19T21:49:08.325683+0000","last_unstale":"2024-02-19T21:55:00.397094+0000","last_undegraded":"2024-02-19T21:55:00.397094+0000","last_fullsized":"2024-02-19T21:55:00.397094+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'53","last_scrub_stamp":"2024-02-19T21:54:05.257106+0000","last_deep_scrub":"337'39","last_deep_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_clean_scrub_stamp":"2024-02-19T21:54:05.257106+0000","log_size":53,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"517'5858","reported_seq":5890,"reported_epoch":517,"state":"active+clean","last_fresh":"2024-02-19T21:55:04.890071+0000","last_change":"2024-02-19T21:53:45.369602+0000","last_active":"2024-02-19T21:55:04.890071+0000","last_peered":"2024-02-19T21:55:04.890071+0000","last_clean":"2024-02-19T21:55:04.890071+0000","last_became_active":"2024-02-19T21:53:45.369204+0000","last_became_peered":"2024-02-19T21:53:45.369204+0000","last_unstale":"2024-02-19T21:55:04.890071+0000","last_undegraded":"2024-02-19T21:55:04.890071+0000","last_fullsized":"2024-02-19T21:55:04.890071+0000","mapping_epoch":492,"log_start":"498'900","ondisk_log_start":"498'900","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":4958,"ondisk_log_size":4958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":383909888,"num_objects":5858,"num_object_clones":0,"num_object_copies":17574,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5858,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5858,"num_write_kb":374912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.8","version":"66'1","reported_seq":362,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.409444+0000","last_change":"2024-02-19T21:53:48.374860+0000","last_active":"2024-02-19T21:55:00.409444+0000","last_peered":"2024-02-19T21:55:00.409444+0000","last_clean":"2024-02-19T21:55:00.409444+0000","last_became_active":"2024-02-19T21:53:48.374606+0000","last_became_peered":"2024-02-19T21:53:48.374606+0000","last_unstale":"2024-02-19T21:55:00.409444+0000","last_undegraded":"2024-02-19T21:55:00.409444+0000","last_fullsized":"2024-02-19T21:55:00.409444+0000","mapping_epoch":495,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":496,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:46:43.773486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:46:43.773486+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":148,"reported_epoch":515,"state":"active+clean","last_fresh":"2024-02-19T21:54:57.544053+0000","last_change":"2024-02-19T21:53:58.254466+0000","last_active":"2024-02-19T21:54:57.544053+0000","last_peered":"2024-02-19T21:54:57.544053+0000","last_clean":"2024-02-19T21:54:57.544053+0000","last_became_active":"2024-02-19T21:49:08.324835+0000","last_became_peered":"2024-02-19T21:49:08.324835+0000","last_unstale":"2024-02-19T21:54:57.544053+0000","last_undegraded":"2024-02-19T21:54:57.544053+0000","last_fullsized":"2024-02-19T21:54:57.544053+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:58.254346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_clean_scrub_stamp":"2024-02-19T21:53:58.254346+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":224,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.415647+0000","last_change":"2024-02-19T21:53:51.712781+0000","last_active":"2024-02-19T21:55:00.415647+0000","last_peered":"2024-02-19T21:55:00.415647+0000","last_clean":"2024-02-19T21:55:00.415647+0000","last_became_active":"2024-02-19T21:49:08.327186+0000","last_became_peered":"2024-02-19T21:49:08.327186+0000","last_unstale":"2024-02-19T21:55:00.415647+0000","last_undegraded":"2024-02-19T21:55:00.415647+0000","last_fullsized":"2024-02-19T21:55:00.415647+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:53:51.712694+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:53:51.712694+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"471'60","reported_seq":649,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.415721+0000","last_change":"2024-02-19T21:54:59.710692+0000","last_active":"2024-02-19T21:55:00.415721+0000","last_peered":"2024-02-19T21:55:00.415721+0000","last_clean":"2024-02-19T21:55:00.415721+0000","last_became_active":"2024-02-19T21:49:54.493167+0000","last_became_peered":"2024-02-19T21:49:54.493167+0000","last_unstale":"2024-02-19T21:55:00.415721+0000","last_undegraded":"2024-02-19T21:55:00.415721+0000","last_fullsized":"2024-02-19T21:55:00.415721+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'60","last_scrub_stamp":"2024-02-19T21:54:59.710570+0000","last_deep_scrub":"201'44","last_deep_scrub_stamp":"2024-02-19T21:44:16.255049+0000","last_clean_scrub_stamp":"2024-02-19T21:54:59.710570+0000","log_size":60,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":80,"num_read_kb":69,"num_write":52,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.4","version":"517'5995","reported_seq":6028,"reported_epoch":517,"state":"active+clean","last_fresh":"2024-02-19T21:55:04.827982+0000","last_change":"2024-02-19T21:53:45.370493+0000","last_active":"2024-02-19T21:55:04.827982+0000","last_peered":"2024-02-19T21:55:04.827982+0000","last_clean":"2024-02-19T21:55:04.827982+0000","last_became_active":"2024-02-19T21:53:45.370111+0000","last_became_peered":"2024-02-19T21:53:45.370111+0000","last_unstale":"2024-02-19T21:55:04.827982+0000","last_undegraded":"2024-02-19T21:55:04.827982+0000","last_fullsized":"2024-02-19T21:55:04.827982+0000","mapping_epoch":492,"log_start":"498'1000","ondisk_log_start":"498'1000","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":4995,"ondisk_log_size":4995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":392888320,"num_objects":5995,"num_object_clones":0,"num_object_copies":17985,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5995,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5995,"num_write_kb":383680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":549,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.426567+0000","last_change":"2024-02-19T21:54:11.072349+0000","last_active":"2024-02-19T21:55:00.426567+0000","last_peered":"2024-02-19T21:55:00.426567+0000","last_clean":"2024-02-19T21:55:00.426567+0000","last_became_active":"2024-02-19T21:49:08.328287+0000","last_became_peered":"2024-02-19T21:49:08.328287+0000","last_unstale":"2024-02-19T21:55:00.426567+0000","last_undegraded":"2024-02-19T21:55:00.426567+0000","last_fullsized":"2024-02-19T21:55:00.426567+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:11.072274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:11.072274+0000","last_clean_scrub_stamp":"2024-02-19T21:54:11.072274+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":148,"reported_epoch":515,"state":"active+clean","last_fresh":"2024-02-19T21:54:57.542926+0000","last_change":"2024-02-19T21:54:09.300812+0000","last_active":"2024-02-19T21:54:57.542926+0000","last_peered":"2024-02-19T21:54:57.542926+0000","last_clean":"2024-02-19T21:54:57.542926+0000","last_became_active":"2024-02-19T21:49:08.331451+0000","last_became_peered":"2024-02-19T21:49:08.331451+0000","last_unstale":"2024-02-19T21:54:57.542926+0000","last_undegraded":"2024-02-19T21:54:57.542926+0000","last_fullsized":"2024-02-19T21:54:57.542926+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:09.300710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.547129+0000","last_clean_scrub_stamp":"2024-02-19T21:54:09.300710+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":525,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.417637+0000","last_change":"2024-02-19T21:53:45.384975+0000","last_active":"2024-02-19T21:55:00.417637+0000","last_peered":"2024-02-19T21:55:00.417637+0000","last_clean":"2024-02-19T21:55:00.417637+0000","last_became_active":"2024-02-19T21:53:45.384695+0000","last_became_peered":"2024-02-19T21:53:45.384695+0000","last_unstale":"2024-02-19T21:55:00.417637+0000","last_undegraded":"2024-02-19T21:55:00.417637+0000","last_fullsized":"2024-02-19T21:55:00.417637+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:46.978015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:46:46.978015+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"470'25","reported_seq":531,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.428177+0000","last_change":"2024-02-19T21:48:23.326608+0000","last_active":"2024-02-19T21:55:00.428177+0000","last_peered":"2024-02-19T21:55:00.428177+0000","last_clean":"2024-02-19T21:55:00.428177+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:55:00.428177+0000","last_undegraded":"2024-02-19T21:55:00.428177+0000","last_fullsized":"2024-02-19T21:55:00.428177+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"377'19","last_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_deep_scrub":"377'19","last_deep_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_clean_scrub_stamp":"2024-02-19T21:48:23.326541+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"517'5877","reported_seq":5910,"reported_epoch":517,"state":"active+clean","last_fresh":"2024-02-19T21:55:05.363326+0000","last_change":"2024-02-19T21:53:45.368033+0000","last_active":"2024-02-19T21:55:05.363326+0000","last_peered":"2024-02-19T21:55:05.363326+0000","last_clean":"2024-02-19T21:55:05.363326+0000","last_became_active":"2024-02-19T21:53:45.367724+0000","last_became_peered":"2024-02-19T21:53:45.367724+0000","last_unstale":"2024-02-19T21:55:05.363326+0000","last_undegraded":"2024-02-19T21:55:05.363326+0000","last_fullsized":"2024-02-19T21:55:05.363326+0000","mapping_epoch":492,"log_start":"498'100","ondisk_log_start":"498'100","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":5777,"ondisk_log_size":5777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":385155072,"num_objects":5877,"num_object_clones":0,"num_object_copies":17631,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5877,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5877,"num_write_kb":376128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4],"acting":[5,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":514,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.404499+0000","last_change":"2024-02-19T21:54:09.344599+0000","last_active":"2024-02-19T21:55:00.404499+0000","last_peered":"2024-02-19T21:55:00.404499+0000","last_clean":"2024-02-19T21:55:00.404499+0000","last_became_active":"2024-02-19T21:44:56.160521+0000","last_became_peered":"2024-02-19T21:44:56.160521+0000","last_unstale":"2024-02-19T21:55:00.404499+0000","last_undegraded":"2024-02-19T21:55:00.404499+0000","last_fullsized":"2024-02-19T21:55:00.404499+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:09.344514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:54:09.344514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":157,"reported_epoch":515,"state":"active+clean","last_fresh":"2024-02-19T21:54:57.543147+0000","last_change":"2024-02-19T21:54:16.360569+0000","last_active":"2024-02-19T21:54:57.543147+0000","last_peered":"2024-02-19T21:54:57.543147+0000","last_clean":"2024-02-19T21:54:57.543147+0000","last_became_active":"2024-02-19T21:49:54.485078+0000","last_became_peered":"2024-02-19T21:49:54.485078+0000","last_unstale":"2024-02-19T21:54:57.543147+0000","last_undegraded":"2024-02-19T21:54:57.543147+0000","last_fullsized":"2024-02-19T21:54:57.543147+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:16.360470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:54:16.360470+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"470'39","reported_seq":609,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:00.403187+0000","last_change":"2024-02-19T21:54:58.172666+0000","last_active":"2024-02-19T21:55:00.403187+0000","last_peered":"2024-02-19T21:55:00.403187+0000","last_clean":"2024-02-19T21:55:00.403187+0000","last_became_active":"2024-02-19T21:49:54.486014+0000","last_became_peered":"2024-02-19T21:49:54.486014+0000","last_unstale":"2024-02-19T21:55:00.403187+0000","last_undegraded":"2024-02-19T21:55:00.403187+0000","last_fullsized":"2024-02-19T21:55:00.403187+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'39","last_scrub_stamp":"2024-02-19T21:54:58.172560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:54:58.172560+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"324'11","reported_seq":802,"reported_epoch":516,"state":"active+clean","last_fresh":"2024-02-19T21:55:02.142207+0000","last_change":"2024-02-19T21:54:21.760361+0000","last_active":"2024-02-19T21:55:02.142207+0000","last_peered":"2024-02-19T21:55:02.142207+0000","last_clean":"2024-02-19T21:55:02.142207+0000","last_became_active":"2024-02-19T21:44:34.385140+0000","last_became_peered":"2024-02-19T21:44:34.385140+0000","last_unstale":"2024-02-19T21:55:02.142207+0000","last_undegraded":"2024-02-19T21:55:02.142207+0000","last_fullsized":"2024-02-19T21:55:02.142207+0000","mapping_epoch":62,"log_start":"66'8","ondisk_log_start":"66'8","created":62,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'11","last_scrub_stamp":"2024-02-19T21:54:21.760260+0000","last_deep_scrub":"324'11","last_deep_scrub_stamp":"2024-02-19T21:46:05.210095+0000","last_clean_scrub_stamp":"2024-02-19T21:54:21.760260+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":16,"stat_sum":{"num_bytes":6283722752,"num_objects":95882,"num_object_clones":0,"num_object_copies":287646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95882,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95882,"num_write_kb":6136448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18847039488,"data_stored":18847039488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84970,"ondisk_log_size":84970,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1340,"num_read_kb":1335,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1535,"num_read_kb":1292,"num_write":989,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":316,"num_bytes_recovered":5942,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1062,"ondisk_log_size":1062,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":22,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":66,"acting":66,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":388,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201555,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3271532,"kb_used_data":2685924,"kb_used_omap":0,"kb_used_meta":585600,"kb_avail":90473620,"statfs":{"total":95995035648,"available":92644986880,"internally_reserved":0,"allocated":2750386176,"data_stored":2748797809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":599654400},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":0.99299999999999999,"15min":1.8620000000000001},"min":{"1min":0.23999999999999999,"5min":0.20899999999999999,"15min":0.19},"max":{"1min":4.3319999999999999,"5min":6.2569999999999997,"15min":70.477999999999994},"last":1.405},{"interface":"front","average":{"1min":0.84199999999999997,"5min":1.0589999999999999,"15min":1.925},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.21199999999999999},"max":{"1min":3.5390000000000001,"5min":11.962999999999999,"15min":68.052000000000007},"last":0.317}]},{"osd":1,"last update":"Mon Feb 19 21:54:58 2024","interfaces":[{"interface":"back","average":{"1min":2.1499999999999999,"5min":1.286,"15min":1.9450000000000001},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.23799999999999999},"max":{"1min":8.2929999999999993,"5min":9.9440000000000008,"15min":68.168000000000006},"last":1.161},{"interface":"front","average":{"1min":1.3,"5min":1.0860000000000001,"15min":2.0760000000000001},"min":{"1min":0.30199999999999999,"5min":0.27300000000000002,"15min":0.23599999999999999},"max":{"1min":4.1219999999999999,"5min":9.9559999999999995,"15min":68.444000000000003},"last":0.34300000000000003}]},{"osd":2,"last update":"Mon Feb 19 21:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":1.272,"15min":2.024},"min":{"1min":0.32900000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.9870000000000001,"5min":12.304,"15min":12.304},"last":2.6619999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":1.369,"15min":1.8320000000000001},"min":{"1min":0.38900000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":2.859,"5min":11.69,"15min":11.69},"last":2.6709999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.474,"15min":1.9119999999999999},"min":{"1min":0.34699999999999998,"5min":0.315,"15min":0.25900000000000001},"max":{"1min":4.492,"5min":11.778,"15min":11.778},"last":2.448},{"interface":"front","average":{"1min":1.925,"5min":1.3939999999999999,"15min":1.6699999999999999},"min":{"1min":0.33800000000000002,"5min":0.312,"15min":0.29299999999999998},"max":{"1min":8.2560000000000002,"5min":13.196,"15min":13.473000000000001},"last":1.1970000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.163,"15min":1.72},"min":{"1min":0.254,"5min":0.254,"15min":0.216},"max":{"1min":3.948,"5min":10.656000000000001,"15min":17.716999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4810000000000001,"15min":2.129},"min":{"1min":0.34000000000000002,"5min":0.26700000000000002,"15min":0.253},"max":{"1min":5.1440000000000001,"5min":15.961,"15min":17.690999999999999},"last":1.3819999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.3100000000000001,"15min":1.7649999999999999},"min":{"1min":0.30499999999999999,"5min":0.26300000000000001,"15min":0.24199999999999999},"max":{"1min":8.3200000000000003,"5min":8.3200000000000003,"15min":29.021000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.363,"15min":2.097},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.28699999999999998},"max":{"1min":3.8029999999999999,"5min":9.9269999999999996,"15min":29.091999999999999},"last":0.51600000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.6719999999999999,"5min":1.4510000000000001,"15min":1.9350000000000001},"min":{"1min":0.45400000000000001,"5min":0.28299999999999997,"15min":0.24299999999999999},"max":{"1min":8.6560000000000006,"5min":15.426,"15min":19.286000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":2.141,"5min":1.5129999999999999,"15min":2.0790000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.26700000000000002},"max":{"1min":9.9730000000000008,"5min":9.9730000000000008,"15min":18.364000000000001},"last":1.355}]}]},{"osd":6,"up_from":47,"seq":201863463194,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":4341160,"kb_used_data":3448032,"kb_used_omap":0,"kb_used_meta":893120,"kb_avail":89403992,"statfs":{"total":95995035648,"available":91549687808,"internally_reserved":0,"allocated":3530784768,"data_stored":3529199787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":914554880},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:54:34 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.93500000000000005,"15min":1.4019999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.20100000000000001},"max":{"1min":1.05,"5min":9.8659999999999997,"15min":45.197000000000003},"last":0.44},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.4970000000000001,"15min":1.865},"min":{"1min":0.37,"5min":0.252,"15min":0.23499999999999999},"max":{"1min":4.1660000000000004,"5min":10.038,"15min":44.753},"last":0.28899999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:54:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.995,"15min":1.5149999999999999},"min":{"1min":0.28499999999999998,"5min":0.24299999999999999,"15min":0.20799999999999999},"max":{"1min":2.0640000000000001,"5min":9.8010000000000002,"15min":45.231999999999999},"last":11.569000000000001},{"interface":"front","average":{"1min":1.234,"5min":1.4730000000000001,"15min":1.617},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.23100000000000001},"max":{"1min":4.2069999999999999,"5min":15.215999999999999,"15min":45.097999999999999},"last":11.869}]},{"osd":2,"last update":"Mon Feb 19 21:54:14 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":1.335,"15min":1.492},"min":{"1min":0.314,"5min":0.255,"15min":0.255},"max":{"1min":3.129,"5min":9.9369999999999994,"15min":9.9369999999999994},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.98399999999999999,"15min":1.1739999999999999},"min":{"1min":0.30499999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.1160000000000001,"5min":9.7829999999999995,"15min":9.7829999999999995},"last":0.52900000000000003}]},{"osd":3,"last update":"Mon Feb 19 21:54:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":1.127,"15min":1.4159999999999999},"min":{"1min":0.39500000000000002,"5min":0.34000000000000002,"15min":0.25900000000000001},"max":{"1min":1.607,"5min":9.8460000000000001,"15min":10.630000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.6379999999999999,"15min":1.488},"min":{"1min":0.34399999999999997,"5min":0.30599999999999999,"15min":0.26400000000000001},"max":{"1min":6.7290000000000001,"5min":15.175000000000001,"15min":15.175000000000001},"last":0.379}]},{"osd":4,"last update":"Mon Feb 19 21:54:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":1.73,"15min":1.893},"min":{"1min":0.28599999999999998,"5min":0.23999999999999999,"15min":0.23000000000000001},"max":{"1min":2.8330000000000002,"5min":18.010000000000002,"15min":18.010000000000002},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":1.4399999999999999,"15min":1.825},"min":{"1min":0.312,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":3.706,"5min":9.8360000000000003,"15min":14.055},"last":0.46999999999999997}]},{"osd":5,"last update":"Mon Feb 19 21:54:34 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":3.1659999999999999,"15min":2.456},"min":{"1min":0.33900000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":4.351,"5min":148.589,"15min":148.589},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":2.6640000000000001,"15min":2.4300000000000002},"min":{"1min":0.315,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.4450000000000001,"5min":148.453,"15min":148.453},"last":0.502}]},{"osd":7,"last update":"Mon Feb 19 21:55:02 2024","interfaces":[{"interface":"back","average":{"1min":1.6419999999999999,"5min":1.663,"15min":2.0369999999999999},"min":{"1min":0.34999999999999998,"5min":0.29399999999999998,"15min":0.27200000000000002},"max":{"1min":4.5659999999999998,"5min":9.8170000000000002,"15min":14.721},"last":0.56100000000000005},{"interface":"front","average":{"1min":1.6830000000000001,"5min":1.7110000000000001,"15min":2.0779999999999998},"min":{"1min":0.42099999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":4.5869999999999997,"5min":9.8309999999999995,"15min":14.744999999999999},"last":0.75700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575156,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":4347256,"kb_used_data":3454832,"kb_used_omap":0,"kb_used_meta":892416,"kb_avail":89397896,"statfs":{"total":95995035648,"available":91543445504,"internally_reserved":0,"allocated":3537747968,"data_stored":3536147417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":913833984},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:54:25 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.60799999999999998,"15min":0.86499999999999999},"min":{"1min":0.22500000000000001,"5min":0.184,"15min":0.161},"max":{"1min":2.472,"5min":5.7889999999999997,"15min":11.305},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.84799999999999998,"15min":1.0800000000000001},"min":{"1min":0.23200000000000001,"5min":0.19500000000000001,"15min":0.16400000000000001},"max":{"1min":5.7839999999999998,"5min":5.7839999999999998,"15min":11.92},"last":0.20999999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:54:18 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58399999999999996,"15min":0.91600000000000004},"min":{"1min":0.22700000000000001,"5min":0.189,"15min":0.189},"max":{"1min":2.5139999999999998,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":1.145,"5min":0.82299999999999995,"15min":0.94899999999999995},"min":{"1min":0.221,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":8.234,"5min":8.234,"15min":8.234},"last":3.8199999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:54:25 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.77600000000000002,"15min":1.0489999999999999},"min":{"1min":0.252,"5min":0.22800000000000001,"15min":0.20999999999999999},"max":{"1min":4.0300000000000002,"5min":7.8250000000000002,"15min":8.3469999999999995},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.66600000000000004,"15min":1.0580000000000001},"min":{"1min":0.255,"5min":0.25,"15min":0.215},"max":{"1min":2.4950000000000001,"5min":4.1130000000000004,"15min":11.204000000000001},"last":0.29699999999999999}]},{"osd":4,"last update":"Mon Feb 19 21:54:42 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":1.1439999999999999,"15min":1.4550000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.251},"max":{"1min":2.27,"5min":9.8759999999999994,"15min":15.853},"last":3.3170000000000002},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.175,"15min":1.4350000000000001},"min":{"1min":0.29099999999999998,"5min":0.28000000000000003,"15min":0.26500000000000001},"max":{"1min":4.9950000000000001,"5min":6.9800000000000004,"15min":15.861000000000001},"last":3.9169999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:54:10 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0149999999999999,"15min":1.4690000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.27900000000000003},"max":{"1min":3.1459999999999999,"5min":4.0720000000000001,"15min":14.331},"last":3.9470000000000001},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.121,"15min":1.5249999999999999},"min":{"1min":0.37,"5min":0.307,"15min":0.307},"max":{"1min":5.0970000000000004,"5min":10.148999999999999,"15min":14.496},"last":0.80400000000000005}]},{"osd":6,"last update":"Mon Feb 19 21:54:42 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":1.0580000000000001,"15min":1.5109999999999999},"min":{"1min":0.40200000000000002,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":2.302,"5min":8.8309999999999995,"15min":11.638999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.085,"15min":1.627},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.29699999999999999},"max":{"1min":4.1109999999999998,"5min":7.7869999999999999,"15min":12.199},"last":1.1819999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:54:04 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.159,"15min":1.6459999999999999},"min":{"1min":0.40899999999999997,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":5.609,"5min":7.702,"15min":13.904},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.0960000000000001,"15min":1.623},"min":{"1min":0.42899999999999999,"5min":0.38900000000000001,"15min":0.32600000000000001},"max":{"1min":2.9590000000000001,"5min":7.6909999999999998,"15min":13.894},"last":0.52300000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738682,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3191528,"kb_used_data":2301216,"kb_used_omap":0,"kb_used_meta":890304,"kb_avail":90553624,"statfs":{"total":95995035648,"available":92726910976,"internally_reserved":0,"allocated":2356445184,"data_stored":2354860252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":911671296},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:54:16 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.56799999999999995,"15min":0.75900000000000001},"min":{"1min":0.23300000000000001,"5min":0.189,"15min":0.153},"max":{"1min":2.5750000000000002,"5min":3.226,"15min":16.478000000000002},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.80100000000000005,"15min":0.95599999999999996},"min":{"1min":0.221,"5min":0.20799999999999999,"15min":0.17799999999999999},"max":{"1min":4.0430000000000001,"5min":7.1669999999999998,"15min":8.0229999999999997},"last":0.41599999999999998}]},{"osd":2,"last update":"Mon Feb 19 21:54:16 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.72399999999999998,"15min":0.68200000000000005},"min":{"1min":0.253,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":2.9100000000000001,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":6.4640000000000004},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.74399999999999999,"15min":1.036},"min":{"1min":0.217,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":1.2250000000000001,"5min":8.9960000000000004,"15min":8.9960000000000004},"last":0.28599999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:55:04 2024","interfaces":[{"interface":"back","average":{"1min":1.655,"5min":0.877,"15min":1.1240000000000001},"min":{"1min":0.28499999999999998,"5min":0.255,"15min":0.21299999999999999},"max":{"1min":9.3010000000000002,"5min":9.3010000000000002,"15min":13.292999999999999},"last":1.466},{"interface":"front","average":{"1min":1.123,"5min":0.79800000000000004,"15min":0.92200000000000004},"min":{"1min":0.29799999999999999,"5min":0.26300000000000001,"15min":0.23400000000000001},"max":{"1min":4.6909999999999998,"5min":5.968,"15min":8.4169999999999998},"last":0.33300000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:54:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0029999999999999,"15min":1.512},"min":{"1min":0.33900000000000002,"5min":0.29399999999999998,"15min":0.252},"max":{"1min":2.3479999999999999,"5min":7.298,"15min":13.278},"last":1.502},{"interface":"front","average":{"1min":1.26,"5min":1.026,"15min":1.3999999999999999},"min":{"1min":0.39900000000000002,"5min":0.32500000000000001,"15min":0.28999999999999998},"max":{"1min":4.2249999999999996,"5min":9.0530000000000008,"15min":10.109},"last":0.504}]},{"osd":5,"last update":"Mon Feb 19 21:55:04 2024","interfaces":[{"interface":"back","average":{"1min":1.8819999999999999,"5min":1.175,"15min":1.7450000000000001},"min":{"1min":0.34000000000000002,"5min":0.318,"15min":0.27600000000000002},"max":{"1min":5.1859999999999999,"5min":7.2089999999999996,"15min":25.442},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.161,"15min":1.8089999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.27300000000000002},"max":{"1min":3.351,"5min":6.5839999999999996,"15min":25.411999999999999},"last":1.53}]},{"osd":6,"last update":"Mon Feb 19 21:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.321,"15min":1.4299999999999999},"min":{"1min":0.40300000000000002,"5min":0.33300000000000002,"15min":0.27000000000000002},"max":{"1min":4.1539999999999999,"5min":12.364000000000001,"15min":12.364000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.4179999999999999,"15min":1.752},"min":{"1min":0.41599999999999998,"5min":0.34000000000000002,"15min":0.29599999999999999},"max":{"1min":4.2199999999999998,"5min":11.269,"15min":13.289999999999999},"last":0.45000000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.2170000000000001,"15min":1.609},"min":{"1min":0.432,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":3.661,"5min":5.8070000000000004,"15min":15.688000000000001},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.6379999999999999,"5min":1.1870000000000001,"15min":1.502},"min":{"1min":0.41399999999999998,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":4.2969999999999997,"5min":5.8159999999999998,"15min":10.470000000000001},"last":0.91900000000000004}]}]},{"osd":2,"up_from":394,"seq":1692217114695,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2945228,"kb_used_data":2629380,"kb_used_omap":0,"kb_used_meta":315839,"kb_avail":90799924,"statfs":{"total":95995035648,"available":92979122176,"internally_reserved":0,"allocated":2692485120,"data_stored":2690920249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":323419188},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:54:14 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.81499999999999995,"15min":1.0489999999999999},"min":{"1min":0.22900000000000001,"5min":0.183,"15min":0.183},"max":{"1min":1.236,"5min":9.2629999999999999,"15min":9.2629999999999999},"last":0.192},{"interface":"front","average":{"1min":0.62,"5min":0.71499999999999997,"15min":1.0529999999999999},"min":{"1min":0.219,"5min":0.193,"15min":0.193},"max":{"1min":1.5389999999999999,"5min":6.149,"15min":6.149},"last":0.47499999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:54:14 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.24099999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":2.323,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":3.3969999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.68999999999999995,"15min":0.875},"min":{"1min":0.23100000000000001,"5min":0.224,"15min":0.224},"max":{"1min":2.383,"5min":6.992,"15min":6.992},"last":3.782}]},{"osd":3,"last update":"Mon Feb 19 21:54:14 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.86599999999999999,"15min":1.2549999999999999},"min":{"1min":0.26800000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":2.2170000000000001,"5min":6.9470000000000001,"15min":6.9470000000000001},"last":3.8820000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.84099999999999997,"15min":1.1419999999999999},"min":{"1min":0.33800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":4.1630000000000003,"5min":7.6669999999999998,"15min":7.6669999999999998},"last":3.3399999999999999}]},{"osd":4,"last update":"Mon Feb 19 21:54:14 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.2529999999999999,"15min":1.8560000000000001},"min":{"1min":0.34699999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":2.722,"5min":8.843,"15min":8.843},"last":2.0979999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":1.2829999999999999,"15min":1.732},"min":{"1min":0.371,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.93799999999999994,"5min":9.3300000000000001,"15min":9.3300000000000001},"last":3.851}]},{"osd":5,"last update":"Mon Feb 19 21:54:14 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.5680000000000001,"15min":1.7150000000000001},"min":{"1min":0.35399999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":8.1460000000000008,"5min":11.129,"15min":11.129},"last":3.8210000000000002},{"interface":"front","average":{"1min":0.85899999999999999,"5min":1.0569999999999999,"15min":1.5660000000000001},"min":{"1min":0.38200000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":4.2009999999999996,"5min":13.558,"15min":13.558},"last":0.44900000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:54:14 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.4990000000000001,"15min":1.667},"min":{"1min":0.42299999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.226,"5min":9.6720000000000006,"15min":9.6720000000000006},"last":0.505},{"interface":"front","average":{"1min":1.091,"5min":1.194,"15min":1.0920000000000001},"min":{"1min":0.374,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.7749999999999999,"5min":8.3629999999999995,"15min":8.3629999999999995},"last":2.1909999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:54:14 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.2669999999999999,"15min":1.391},"min":{"1min":0.39800000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":7.4089999999999998,"5min":7.4089999999999998,"15min":7.4089999999999998},"last":3.6989999999999998},{"interface":"front","average":{"1min":1.123,"5min":1.161,"15min":0.94999999999999996},"min":{"1min":0.40200000000000002,"5min":0.37,"15min":0.37},"max":{"1min":2.8100000000000001,"5min":8.7780000000000005,"15min":8.7780000000000005},"last":2.1219999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149994,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":689396,"kb_used_data":388076,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93055756,"statfs":{"total":95995035648,"available":95289094144,"internally_reserved":0,"allocated":397389824,"data_stored":395856172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:54:14 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64200000000000002,"15min":0.94299999999999995},"min":{"1min":0.216,"5min":0.193,"15min":0.17399999999999999},"max":{"1min":5.1310000000000002,"5min":5.1310000000000002,"15min":8.8529999999999998},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.78400000000000003,"15min":1.141},"min":{"1min":0.27700000000000002,"5min":0.23899999999999999,"15min":0.187},"max":{"1min":4.782,"5min":11.317,"15min":11.948},"last":1.0669999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:54:14 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56599999999999995,"15min":1.0589999999999999},"min":{"1min":0.26000000000000001,"5min":0.219,"15min":0.18099999999999999},"max":{"1min":4.4740000000000002,"5min":4.8600000000000003,"15min":66.677999999999997},"last":2.9590000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":1.091},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":3.4889999999999999,"5min":4.282,"15min":62.631},"last":4.1779999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:54:14 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.93999999999999995,"15min":0.84299999999999997},"min":{"1min":0.33700000000000002,"5min":0.216,"15min":0.216},"max":{"1min":1.831,"5min":32.323999999999998,"15min":32.323999999999998},"last":4.2720000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":1.133,"15min":1.4450000000000001},"min":{"1min":0.23300000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":2.5840000000000001,"5min":32.103999999999999,"15min":32.103999999999999},"last":1.3779999999999999}]},{"osd":4,"last update":"Mon Feb 19 21:54:50 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.77000000000000002,"15min":1.167},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.6680000000000001,"5min":5.1219999999999999,"15min":10.609999999999999},"last":0.308},{"interface":"front","average":{"1min":1.4650000000000001,"5min":0.95299999999999996,"15min":1.321},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.26700000000000002},"max":{"1min":4.6479999999999997,"5min":5.7930000000000001,"15min":9.6720000000000006},"last":0.86099999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":0.85099999999999998,"15min":1.411},"min":{"1min":0.32100000000000001,"5min":0.311,"15min":0.29099999999999998},"max":{"1min":2.7149999999999999,"5min":5.46,"15min":12.257},"last":2.988},{"interface":"front","average":{"1min":2.2040000000000002,"5min":1.159,"15min":1.5129999999999999},"min":{"1min":0.379,"5min":0.31,"15min":0.30299999999999999},"max":{"1min":6.0019999999999998,"5min":8.5440000000000005,"15min":12.635},"last":4.2460000000000004}]},{"osd":6,"last update":"Mon Feb 19 21:54:29 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":1.2729999999999999,"15min":1.466},"min":{"1min":0.39400000000000002,"5min":0.34899999999999998,"15min":0.309},"max":{"1min":1.464,"5min":22.759,"15min":22.759},"last":3.0110000000000001},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3120000000000001,"15min":1.514},"min":{"1min":0.39900000000000002,"5min":0.34100000000000003,"15min":0.29099999999999998},"max":{"1min":5.423,"5min":22.608000000000001,"15min":22.608000000000001},"last":4.218}]},{"osd":7,"last update":"Mon Feb 19 21:54:50 2024","interfaces":[{"interface":"back","average":{"1min":2.3620000000000001,"5min":1.284,"15min":1.6140000000000001},"min":{"1min":0.40799999999999997,"5min":0.34399999999999997,"15min":0.28599999999999998},"max":{"1min":12.494,"5min":12.494,"15min":12.494},"last":1.032},{"interface":"front","average":{"1min":1.1439999999999999,"5min":0.91500000000000004,"15min":1.3089999999999999},"min":{"1min":0.41699999999999998,"5min":0.40400000000000003,"15min":0.34599999999999997},"max":{"1min":3.319,"5min":5.3339999999999996,"15min":9.3399999999999999},"last":2.919}]}]},{"osd":4,"up_from":32,"seq":137438953763,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2886940,"kb_used_data":1986900,"kb_used_omap":0,"kb_used_meta":900032,"kb_avail":90858212,"statfs":{"total":95995035648,"available":93038809088,"internally_reserved":0,"allocated":2034585600,"data_stored":2033012004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":921632768},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:54:34 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":1.133,"15min":1.6220000000000001},"min":{"1min":0.23599999999999999,"5min":0.219,"15min":0.219},"max":{"1min":2.7250000000000001,"5min":10.173,"15min":53.936},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.752,"5min":1.125,"15min":1.675},"min":{"1min":0.30599999999999999,"5min":0.252,"15min":0.23000000000000001},"max":{"1min":2.4430000000000001,"5min":10.140000000000001,"15min":54.405999999999999},"last":0.26800000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:54:34 2024","interfaces":[{"interface":"back","average":{"1min":9.9600000000000009,"5min":3.105,"15min":2.379},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.21199999999999999},"max":{"1min":156.72999999999999,"5min":156.72999999999999,"15min":156.72999999999999},"last":1.254},{"interface":"front","average":{"1min":9.9730000000000008,"5min":3.0030000000000001,"15min":2.1829999999999998},"min":{"1min":0.314,"5min":0.255,"15min":0.25},"max":{"1min":156.83000000000001,"5min":156.83000000000001,"15min":156.83000000000001},"last":0.45100000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:54:14 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.569,"15min":1.907},"min":{"1min":0.29999999999999999,"5min":0.255,"15min":0.255},"max":{"1min":4.1289999999999996,"5min":12.516999999999999,"15min":12.516999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":1.012,"5min":1.613,"15min":1.946},"min":{"1min":0.36099999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":4.1559999999999997,"5min":12.541,"15min":12.541},"last":0.51800000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:54:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":1.1619999999999999,"15min":1.4590000000000001},"min":{"1min":0.32000000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.216,"5min":9.9529999999999994,"15min":10.970000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":1.2410000000000001,"15min":1.585},"min":{"1min":0.30199999999999999,"5min":0.30099999999999999,"15min":0.26900000000000002},"max":{"1min":2.746,"5min":12.486000000000001,"15min":12.486000000000001},"last":0.30399999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:54:30 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":1.6990000000000001,"15min":1.9670000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23400000000000001},"max":{"1min":2.4729999999999999,"5min":13.805999999999999,"15min":18.916},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":1.4490000000000001,"15min":2.121},"min":{"1min":0.30099999999999999,"5min":0.29599999999999999,"15min":0.253},"max":{"1min":1.982,"5min":14.532999999999999,"15min":14.840999999999999},"last":1.2290000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:54:34 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":1.571,"15min":1.7110000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":3.3069999999999999,"5min":10.233000000000001,"15min":10.622999999999999},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":1.516,"15min":1.9690000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.23699999999999999},"max":{"1min":2.7130000000000001,"5min":13.715,"15min":18.670000000000002},"last":0.318}]},{"osd":7,"last update":"Mon Feb 19 21:54:06 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.7090000000000001,"15min":1.9730000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":5.1699999999999999,"5min":13.765000000000001,"15min":16.763999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":1.621,"15min":1.847},"min":{"1min":0.376,"5min":0.36299999999999999,"15min":0.31},"max":{"1min":3.6899999999999999,"5min":12.958,"15min":12.958},"last":0.443}]}]},{"osd":5,"up_from":38,"seq":163208757535,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2443856,"kb_used_data":1557512,"kb_used_omap":0,"kb_used_meta":886336,"kb_avail":91301296,"statfs":{"total":95995035648,"available":93492527104,"internally_reserved":0,"allocated":1594892288,"data_stored":1593330993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":907608064},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:54:15 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.27,"15min":1.665},"min":{"1min":0.23899999999999999,"5min":0.23100000000000001,"15min":0.20599999999999999},"max":{"1min":8.9130000000000003,"5min":10.534000000000001,"15min":19.236000000000001},"last":4.5499999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":1.1339999999999999,"15min":1.768},"min":{"1min":0.371,"5min":0.23699999999999999,"15min":0.20899999999999999},"max":{"1min":1.5589999999999999,"5min":6.5449999999999999,"15min":13.241},"last":2.552}]},{"osd":1,"last update":"Mon Feb 19 21:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":1.1259999999999999,"15min":1.669},"min":{"1min":0.251,"5min":0.246,"15min":0.23100000000000001},"max":{"1min":2.1749999999999998,"5min":6.625,"15min":10.42},"last":2.5230000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":1.1699999999999999,"15min":1.4550000000000001},"min":{"1min":0.317,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":3.3599999999999999,"5min":11.654,"15min":11.654},"last":0.53000000000000003}]},{"osd":2,"last update":"Mon Feb 19 21:54:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.7490000000000001,"15min":1.514},"min":{"1min":0.316,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":8.9580000000000002,"5min":39.055,"15min":39.055},"last":4.5979999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":1.546,"15min":1.3899999999999999},"min":{"1min":0.36899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.55,"5min":39.012999999999998,"15min":39.012999999999998},"last":2.5720000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:54:15 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.482,"15min":1.895},"min":{"1min":0.34899999999999998,"5min":0.30199999999999999,"15min":0.24099999999999999},"max":{"1min":8.9749999999999996,"5min":13.182,"15min":19.321000000000002},"last":4.5789999999999997},{"interface":"front","average":{"1min":0.745,"5min":1.2749999999999999,"15min":1.861},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.29499999999999998},"max":{"1min":2.2240000000000002,"5min":6.577,"15min":9.5150000000000006},"last":2.5939999999999999}]},{"osd":4,"last update":"Mon Feb 19 21:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":1.2769999999999999,"15min":1.585},"min":{"1min":0.251,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":4.7800000000000002,"5min":12.228,"15min":21.577000000000002},"last":0.55700000000000005},{"interface":"front","average":{"1min":1.264,"5min":1.601,"15min":2.0680000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":8.9900000000000002,"5min":10.586,"15min":19.274000000000001},"last":4.6139999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:54:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.839,"15min":2.137},"min":{"1min":0.28599999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":4.6379999999999999,"5min":10.611000000000001,"15min":19.884},"last":9.3399999999999999},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.379,"15min":1.8680000000000001},"min":{"1min":0.315,"5min":0.29099999999999998,"15min":0.26700000000000002},"max":{"1min":3.5659999999999998,"5min":6.6500000000000004,"15min":13.532999999999999},"last":2.7559999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:55:03 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.456,"15min":2.145},"min":{"1min":0.39300000000000002,"5min":0.33500000000000002,"15min":0.27100000000000002},"max":{"1min":6.9210000000000003,"5min":8.6590000000000007,"15min":12.962},"last":2.468},{"interface":"front","average":{"1min":1.008,"5min":1.431,"15min":1.968},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.221},"max":{"1min":4.5590000000000002,"5min":11.617000000000001,"15min":15.593999999999999},"last":0.99399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":1722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2355429376,"data_stored":2355429376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3557425152,"data_stored":3557425152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2695692288,"data_stored":2695692288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":396230656,"data_stored":396230656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1964507136,"data_stored":1964507136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1559101440,"data_stored":1559101440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3547070464,"data_stored":3547070464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2771582976,"data_stored":2771582976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:55:12.298 INFO:tasks.thrashosds.thrasher:Setting 6.12 to [5, 7, 6] 2024-02-19T21:55:12.299 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '6.12', '5', '7', '6'] 2024-02-19T21:55:12.299 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pg-upmap 6.12 5 7 6 2024-02-19T21:55:12.376 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:55:12.443 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:12.467 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:55:12.467 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [], 2024-02-19T21:55:12.468 INFO:teuthology.orchestra.run.smithi157.stdout: "num_ops": 0 2024-02-19T21:55:12.468 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:55:12.485 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:55:12.496 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:12.496 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:55:12.517 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:11.261836+0000 mgr.y (mgr.14514) 864 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:55:12.517 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:11.271211+0000 mgr.y (mgr.14514) 865 : cluster [DBG] pgmap v1120: 138 pgs: 138 active+clean; 6.1 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.1 KiB/s rd, 71 MiB/s wr, 1.13k op/s 2024-02-19T21:55:12.517 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:11.497233+0000 mon.a (mon.0) 1946 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:55:12.517 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:11.497264+0000 mon.a (mon.0) 1947 : cluster [INF] Cluster is now healthy 2024-02-19T21:55:12.517 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:11.516681+0000 mon.a (mon.0) 1948 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:55:12.517 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:11.516741+0000 mon.a (mon.0) 1949 : cluster [DBG] osdmap e519: 8 total, 8 up, 8 in 2024-02-19T21:55:12.518 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:11.541127+0000 osd.3 (osd.3) 252 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:55:12.518 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:11.543111+0000 osd.3 (osd.3) 253 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:55:12.518 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:12.275980+0000 osd.5 (osd.5) 301 : cluster [DBG] 2.12 deep-scrub starts 2024-02-19T21:55:12.598 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:55:12.650 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:12.735 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:55:12.740 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:12.741 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:55:12.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:11.261836+0000 mgr.y (mgr.14514) 864 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:55:12.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:11.271211+0000 mgr.y (mgr.14514) 865 : cluster [DBG] pgmap v1120: 138 pgs: 138 active+clean; 6.1 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.1 KiB/s rd, 71 MiB/s wr, 1.13k op/s 2024-02-19T21:55:12.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:11.497233+0000 mon.a (mon.0) 1946 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:55:12.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:11.497264+0000 mon.a (mon.0) 1947 : cluster [INF] Cluster is now healthy 2024-02-19T21:55:12.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:11.516681+0000 mon.a (mon.0) 1948 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:55:12.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:11.516741+0000 mon.a (mon.0) 1949 : cluster [DBG] osdmap e519: 8 total, 8 up, 8 in 2024-02-19T21:55:12.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:11.541127+0000 osd.3 (osd.3) 252 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:55:12.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:11.543111+0000 osd.3 (osd.3) 253 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:55:12.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:12.275980+0000 osd.5 (osd.5) 301 : cluster [DBG] 2.12 deep-scrub starts 2024-02-19T21:55:12.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:12.286575+0000 osd.5 (osd.5) 302 : cluster [DBG] 2.12 deep-scrub ok 2024-02-19T21:55:12.842 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:55:12.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:12.286575+0000 osd.5 (osd.5) 302 : cluster [DBG] 2.12 deep-scrub ok 2024-02-19T21:55:12.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:11.261836+0000 mgr.y (mgr.14514) 864 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:55:12.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:11.271211+0000 mgr.y (mgr.14514) 865 : cluster [DBG] pgmap v1120: 138 pgs: 138 active+clean; 6.1 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.1 KiB/s rd, 71 MiB/s wr, 1.13k op/s 2024-02-19T21:55:12.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:11.497233+0000 mon.a (mon.0) 1946 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:55:12.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:11.497264+0000 mon.a (mon.0) 1947 : cluster [INF] Cluster is now healthy 2024-02-19T21:55:12.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:11.516681+0000 mon.a (mon.0) 1948 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:55:12.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:11.516741+0000 mon.a (mon.0) 1949 : cluster [DBG] osdmap e519: 8 total, 8 up, 8 in 2024-02-19T21:55:12.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:11.541127+0000 osd.3 (osd.3) 252 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:55:12.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:11.543111+0000 osd.3 (osd.3) 253 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:55:12.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:12.275980+0000 osd.5 (osd.5) 301 : cluster [DBG] 2.12 deep-scrub starts 2024-02-19T21:55:12.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:12.286575+0000 osd.5 (osd.5) 302 : cluster [DBG] 2.12 deep-scrub ok 2024-02-19T21:55:12.869 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:13.124 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 73 16 103740 103724 88.7722 56.125 0.00984766 0.0112601 2024-02-19T21:55:13.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:11.655202+0000 osd.6 (osd.6) 274 : cluster [DBG] 11.9 scrub starts 2024-02-19T21:55:13.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:11.655202+0000 osd.6 (osd.6) 274 : cluster [DBG] 11.9 scrub starts 2024-02-19T21:55:13.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:11.655202+0000 osd.6 (osd.6) 274 : cluster [DBG] 11.9 scrub starts 2024-02-19T21:55:14.124 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 74 16 104748 104732 88.4239 63 0.0181986 0.0113045 2024-02-19T21:55:14.218 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:55:14.504 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:55:14.508 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:14.509 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:55:14.610 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:55:14.647 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:14.714 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:55:14.717 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:14.717 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:55:14.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:13.271686+0000 mgr.y (mgr.14514) 866 : cluster [DBG] pgmap v1122: 138 pgs: 138 active+clean; 6.2 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.1 KiB/s rd, 54 MiB/s wr, 861 op/s 2024-02-19T21:55:14.818 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:55:14.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:13.271686+0000 mgr.y (mgr.14514) 866 : cluster [DBG] pgmap v1122: 138 pgs: 138 active+clean; 6.2 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.1 KiB/s rd, 54 MiB/s wr, 861 op/s 2024-02-19T21:55:14.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:13.271686+0000 mgr.y (mgr.14514) 866 : cluster [DBG] pgmap v1122: 138 pgs: 138 active+clean; 6.2 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.1 KiB/s rd, 54 MiB/s wr, 861 op/s 2024-02-19T21:55:14.885 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:15.098 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:55:15.101 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:15.101 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:55:15.124 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 75 16 105709 105693 88.0458 60.0625 0.00950726 0.0113536 2024-02-19T21:55:15.151 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.4 dump_blocked_ops 2024-02-19T21:55:15.203 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:55:15.252 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:15.624 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:55:15.928 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:55:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:55:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:55:16.124 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 76 16 106604 106588 87.6234 55.9375 0.0163971 0.0114074 2024-02-19T21:55:16.257 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set noscrub 2024-02-19T21:55:16.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:15.103536+0000 osd.6 (osd.6) 275 : cluster [DBG] 11.9 scrub ok 2024-02-19T21:55:16.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:15.272376+0000 mgr.y (mgr.14514) 867 : cluster [DBG] pgmap v1123: 138 pgs: 138 active+clean; 6.3 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 518 B/s rd, 52 MiB/s wr, 837 op/s 2024-02-19T21:55:16.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:15.370142+0000 osd.5 (osd.5) 303 : cluster [DBG] 3.2 scrub starts 2024-02-19T21:55:16.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:15.374457+0000 osd.5 (osd.5) 304 : cluster [DBG] 3.2 scrub ok 2024-02-19T21:55:16.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:15.409606+0000 mon.a (mon.0) 1950 : cluster [DBG] osdmap e520: 8 total, 8 up, 8 in 2024-02-19T21:55:16.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:15.494486+0000 osd.3 (osd.3) 254 : cluster [DBG] 11.a deep-scrub starts 2024-02-19T21:55:16.558 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:15.974079+0000 osd.2 (osd.2) 45 : cluster [DBG] 11.2 scrub starts 2024-02-19T21:55:16.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:15.103536+0000 osd.6 (osd.6) 275 : cluster [DBG] 11.9 scrub ok 2024-02-19T21:55:16.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:15.272376+0000 mgr.y (mgr.14514) 867 : cluster [DBG] pgmap v1123: 138 pgs: 138 active+clean; 6.3 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 518 B/s rd, 52 MiB/s wr, 837 op/s 2024-02-19T21:55:16.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:15.370142+0000 osd.5 (osd.5) 303 : cluster [DBG] 3.2 scrub starts 2024-02-19T21:55:16.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:15.374457+0000 osd.5 (osd.5) 304 : cluster [DBG] 3.2 scrub ok 2024-02-19T21:55:16.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:15.409606+0000 mon.a (mon.0) 1950 : cluster [DBG] osdmap e520: 8 total, 8 up, 8 in 2024-02-19T21:55:16.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:15.494486+0000 osd.3 (osd.3) 254 : cluster [DBG] 11.a deep-scrub starts 2024-02-19T21:55:16.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:15.974079+0000 osd.2 (osd.2) 45 : cluster [DBG] 11.2 scrub starts 2024-02-19T21:55:16.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:15.103536+0000 osd.6 (osd.6) 275 : cluster [DBG] 11.9 scrub ok 2024-02-19T21:55:16.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:15.272376+0000 mgr.y (mgr.14514) 867 : cluster [DBG] pgmap v1123: 138 pgs: 138 active+clean; 6.3 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 518 B/s rd, 52 MiB/s wr, 837 op/s 2024-02-19T21:55:16.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:15.370142+0000 osd.5 (osd.5) 303 : cluster [DBG] 3.2 scrub starts 2024-02-19T21:55:16.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:15.374457+0000 osd.5 (osd.5) 304 : cluster [DBG] 3.2 scrub ok 2024-02-19T21:55:16.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:15.409606+0000 mon.a (mon.0) 1950 : cluster [DBG] osdmap e520: 8 total, 8 up, 8 in 2024-02-19T21:55:16.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:15.494486+0000 osd.3 (osd.3) 254 : cluster [DBG] 11.a deep-scrub starts 2024-02-19T21:55:16.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:15.974079+0000 osd.2 (osd.2) 45 : cluster [DBG] 11.2 scrub starts 2024-02-19T21:55:17.125 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 77 16 107339 107323 87.0822 45.9375 0.0160604 0.011478 2024-02-19T21:55:17.226 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:55:17.236 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:17.236 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:55:17.277 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:55:17.338 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:55:17.392 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:17.601 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:55:17.604 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:17.604 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:55:17.643 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:55:17.643 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [], 2024-02-19T21:55:17.643 INFO:teuthology.orchestra.run.smithi157.stdout: "complaint_time": 30, 2024-02-19T21:55:17.643 INFO:teuthology.orchestra.run.smithi157.stdout: "num_blocked_ops": 0 2024-02-19T21:55:17.643 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:55:17.705 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:55:17.786 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:17.817 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:55:17.821 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:17.821 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:55:17.922 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:55:18.010 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:18.124 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 78 16 108060 108044 86.5435 45.0625 0.0150956 0.0115484 2024-02-19T21:55:18.271 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:17.256569+0000 mon.a (mon.0) 1951 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:55:18.271 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:17.272877+0000 mgr.y (mgr.14514) 868 : cluster [DBG] pgmap v1125: 138 pgs: 138 active+clean; 6.4 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1.2 KiB/s rd, 70 MiB/s wr, 1.11k op/s 2024-02-19T21:55:18.271 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:17.718181+0000 mon.a (mon.0) 1952 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:55:18.271 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:17.719507+0000 mon.a (mon.0) 1953 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:55:18.271 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:17.732835+0000 mon.a (mon.0) 1954 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:55:18.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:17.256569+0000 mon.a (mon.0) 1951 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:55:18.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:17.272877+0000 mgr.y (mgr.14514) 868 : cluster [DBG] pgmap v1125: 138 pgs: 138 active+clean; 6.4 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1.2 KiB/s rd, 70 MiB/s wr, 1.11k op/s 2024-02-19T21:55:18.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:17.718181+0000 mon.a (mon.0) 1952 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:55:18.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:17.719507+0000 mon.a (mon.0) 1953 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:55:18.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:17.732835+0000 mon.a (mon.0) 1954 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:55:18.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:17.256569+0000 mon.a (mon.0) 1951 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:55:18.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:17.272877+0000 mgr.y (mgr.14514) 868 : cluster [DBG] pgmap v1125: 138 pgs: 138 active+clean; 6.4 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1.2 KiB/s rd, 70 MiB/s wr, 1.11k op/s 2024-02-19T21:55:18.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:17.718181+0000 mon.a (mon.0) 1952 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:55:18.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:17.719507+0000 mon.a (mon.0) 1953 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:55:18.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:17.732835+0000 mon.a (mon.0) 1954 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:55:18.608 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:55:18.638 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:55:18.669 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:55:18.689 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:55:18.723 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:55:18.759 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:55:18.794 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:55:18.836 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:55:18.837 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:55:18.837 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:55:18.837 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:55:18.837 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:55:18.837 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:55:18.837 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:55:18.838 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:55:18.838 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:55:19.125 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 79 16 108908 108892 86.119 53 0.0139612 0.011606 2024-02-19T21:55:19.245 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:55:19.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:18.390735+0000 osd.2 (osd.2) 46 : cluster [DBG] 11.2 scrub ok 2024-02-19T21:55:19.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:18.580495+0000 mon.c (mon.2) 127 : audit [DBG] from='client.? 172.21.15.80:0/1530300489' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:55:19.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:18.965710+0000 osd.7 (osd.7) 289 : cluster [DBG] 4.0 scrub starts 2024-02-19T21:55:19.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:18.969532+0000 osd.7 (osd.7) 290 : cluster [DBG] 4.0 scrub ok 2024-02-19T21:55:19.559 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:18.978334+0000 mon.a (mon.0) 1955 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:55:19.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:18.390735+0000 osd.2 (osd.2) 46 : cluster [DBG] 11.2 scrub ok 2024-02-19T21:55:19.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:18.580495+0000 mon.c (mon.2) 127 : audit [DBG] from='client.? 172.21.15.80:0/1530300489' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:55:19.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:18.965710+0000 osd.7 (osd.7) 289 : cluster [DBG] 4.0 scrub starts 2024-02-19T21:55:19.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:18.969532+0000 osd.7 (osd.7) 290 : cluster [DBG] 4.0 scrub ok 2024-02-19T21:55:19.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:18.978334+0000 mon.a (mon.0) 1955 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:55:19.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:18.390735+0000 osd.2 (osd.2) 46 : cluster [DBG] 11.2 scrub ok 2024-02-19T21:55:19.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:18.580495+0000 mon.c (mon.2) 127 : audit [DBG] from='client.? 172.21.15.80:0/1530300489' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:55:19.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:18.965710+0000 osd.7 (osd.7) 289 : cluster [DBG] 4.0 scrub starts 2024-02-19T21:55:19.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:18.969532+0000 osd.7 (osd.7) 290 : cluster [DBG] 4.0 scrub ok 2024-02-19T21:55:19.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:18.978334+0000 mon.a (mon.0) 1955 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:55:19.639 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.4 dump_historic_ops 2024-02-19T21:55:19.698 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:55:19.703 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:19.703 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:55:19.804 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:55:19.882 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:19.915 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:55:19.921 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:19.922 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:55:20.022 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:55:20.101 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:20.125 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:2024-02-19T21:55:20.126578+0000 min lat: 0.0011498 max lat: 0.248972 avg lat: 0.0116689 2024-02-19T21:55:20.125 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-02-19T21:55:20.125 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 80 15 109700 109685 85.6621 49.5625 0.0169543 0.0116689 2024-02-19T21:55:20.126 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:55:20.128 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:55:20.134 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:20.134 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:55:20.235 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:55:20.298 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:20.443 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:55:20.450 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:20.451 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:55:20.551 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:55:20.599 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:20.845 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:55:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:55:20] "GET /metrics HTTP/1.1" 200 176790 "" "Prometheus/2.33.4" 2024-02-19T21:55:20.986 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:19.273710+0000 mgr.y (mgr.14514) 869 : cluster [DBG] pgmap v1126: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 6.5 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 639 B/s rd, 41 MiB/s wr, 660 op/s 2024-02-19T21:55:20.986 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:19.865167+0000 osd.2 (osd.2) 47 : cluster [DBG] 4.1c scrub starts 2024-02-19T21:55:20.986 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:19.874283+0000 osd.2 (osd.2) 48 : cluster [DBG] 4.1c scrub ok 2024-02-19T21:55:21.125 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 81 16 110520 110504 85.2365 51.1875 0.0131924 0.011727 2024-02-19T21:55:21.278 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:55:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:55:21.345 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:19.273710+0000 mgr.y (mgr.14514) 869 : cluster [DBG] pgmap v1126: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 6.5 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 639 B/s rd, 41 MiB/s wr, 660 op/s 2024-02-19T21:55:21.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:19.865167+0000 osd.2 (osd.2) 47 : cluster [DBG] 4.1c scrub starts 2024-02-19T21:55:21.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:19.874283+0000 osd.2 (osd.2) 48 : cluster [DBG] 4.1c scrub ok 2024-02-19T21:55:21.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:19.273710+0000 mgr.y (mgr.14514) 869 : cluster [DBG] pgmap v1126: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 6.5 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 639 B/s rd, 41 MiB/s wr, 660 op/s 2024-02-19T21:55:21.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:19.865167+0000 osd.2 (osd.2) 47 : cluster [DBG] 4.1c scrub starts 2024-02-19T21:55:21.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:19.874283+0000 osd.2 (osd.2) 48 : cluster [DBG] 4.1c scrub ok 2024-02-19T21:55:21.559 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:55:21.565 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:21.566 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:55:21.666 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:55:21.728 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:21.804 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:55:21.811 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:21.811 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:55:21.912 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:55:21.975 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:22.056 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:55:22.062 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:22.063 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:55:22.125 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 82 16 111347 111331 84.8275 51.6875 0.0156258 0.0117822 2024-02-19T21:55:22.163 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:55:22.191 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:55:22.192 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:55:22.243 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:22.298 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:55:22.304 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:22.305 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:55:22.405 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:55:22.468 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:set 6.12 pg_upmap mapping to [5,7,6] 2024-02-19T21:55:23.024 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:55:23.125 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 83 16 112168 112152 84.4237 51.3125 0.0414952 0.0118387 2024-02-19T21:55:23.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:21.274388+0000 mgr.y (mgr.14514) 870 : cluster [DBG] pgmap v1127: 138 pgs: 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 136 active+clean; 6.7 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1.0 KiB/s rd, 56 MiB/s wr, 895 op/s 2024-02-19T21:55:23.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:21.274496+0000 mgr.y (mgr.14514) 871 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:55:23.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:22.516837+0000 mon.a (mon.0) 1956 : audit [INF] from='client.? 172.21.15.80:0/2656454972' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "6.12", "id": [5, 7, 6]}]: dispatch 2024-02-19T21:55:23.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:21.274388+0000 mgr.y (mgr.14514) 870 : cluster [DBG] pgmap v1127: 138 pgs: 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 136 active+clean; 6.7 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1.0 KiB/s rd, 56 MiB/s wr, 895 op/s 2024-02-19T21:55:23.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:21.274496+0000 mgr.y (mgr.14514) 871 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:55:23.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:22.516837+0000 mon.a (mon.0) 1956 : audit [INF] from='client.? 172.21.15.80:0/2656454972' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "6.12", "id": [5, 7, 6]}]: dispatch 2024-02-19T21:55:23.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:21.274388+0000 mgr.y (mgr.14514) 870 : cluster [DBG] pgmap v1127: 138 pgs: 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 136 active+clean; 6.7 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1.0 KiB/s rd, 56 MiB/s wr, 895 op/s 2024-02-19T21:55:23.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:21.274496+0000 mgr.y (mgr.14514) 871 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:55:23.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:22.516837+0000 mon.a (mon.0) 1956 : audit [INF] from='client.? 172.21.15.80:0/2656454972' entity='client.admin' cmd=[{"prefix": "osd pg-upmap", "pgid": "6.12", "id": [5, 7, 6]}]: dispatch 2024-02-19T21:55:23.908 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.5 dump_ops_in_flight 2024-02-19T21:55:24.040 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:55:24.044 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:24.045 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:55:24.125 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 84 16 112969 112953 84.0147 50.0625 0.0210427 0.0118971 2024-02-19T21:55:24.146 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:55:24.221 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:22.790338+0000 osd.2 (osd.2) 49 : cluster [DBG] 5.8 deep-scrub starts 2024-02-19T21:55:24.221 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:22.791267+0000 osd.2 (osd.2) 50 : cluster [DBG] 5.8 deep-scrub ok 2024-02-19T21:55:24.221 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:23.000122+0000 mon.a (mon.0) 1957 : audit [INF] from='client.? 172.21.15.80:0/2656454972' entity='client.admin' cmd='[{"prefix": "osd pg-upmap", "pgid": "6.12", "id": [5, 7, 6]}]': finished 2024-02-19T21:55:24.221 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:23.000178+0000 mon.a (mon.0) 1958 : cluster [DBG] osdmap e521: 8 total, 8 up, 8 in 2024-02-19T21:55:24.233 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:24.265 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:55:24.274 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:24.275 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:55:24.345 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:22.790338+0000 osd.2 (osd.2) 49 : cluster [DBG] 5.8 deep-scrub starts 2024-02-19T21:55:24.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:22.791267+0000 osd.2 (osd.2) 50 : cluster [DBG] 5.8 deep-scrub ok 2024-02-19T21:55:24.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:23.000122+0000 mon.a (mon.0) 1957 : audit [INF] from='client.? 172.21.15.80:0/2656454972' entity='client.admin' cmd='[{"prefix": "osd pg-upmap", "pgid": "6.12", "id": [5, 7, 6]}]': finished 2024-02-19T21:55:24.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:23.000178+0000 mon.a (mon.0) 1958 : cluster [DBG] osdmap e521: 8 total, 8 up, 8 in 2024-02-19T21:55:24.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:22.790338+0000 osd.2 (osd.2) 49 : cluster [DBG] 5.8 deep-scrub starts 2024-02-19T21:55:24.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:22.791267+0000 osd.2 (osd.2) 50 : cluster [DBG] 5.8 deep-scrub ok 2024-02-19T21:55:24.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:23.000122+0000 mon.a (mon.0) 1957 : audit [INF] from='client.? 172.21.15.80:0/2656454972' entity='client.admin' cmd='[{"prefix": "osd pg-upmap", "pgid": "6.12", "id": [5, 7, 6]}]': finished 2024-02-19T21:55:24.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:23.000178+0000 mon.a (mon.0) 1958 : cluster [DBG] osdmap e521: 8 total, 8 up, 8 in 2024-02-19T21:55:24.376 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:55:24.437 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:24.458 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:55:24.520 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:55:24.535 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:24.535 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:55:24.636 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:55:24.695 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:24.752 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:55:24.761 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:24.762 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:55:24.863 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:55:24.923 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:25.024 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:23.274708+0000 mgr.y (mgr.14514) 872 : cluster [DBG] pgmap v1129: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 6.7 GiB data, 26 GiB used, 690 GiB / 715 GiB avail; 1.2 KiB/s rd, 48 MiB/s wr, 765 op/s 2024-02-19T21:55:25.024 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:24.016824+0000 mon.a (mon.0) 1959 : cluster [DBG] osdmap e522: 8 total, 8 up, 8 in 2024-02-19T21:55:25.125 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 85 16 113739 113723 83.5924 48.125 0.0108974 0.0119554 2024-02-19T21:55:25.202 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:55:25.206 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:23.274708+0000 mgr.y (mgr.14514) 872 : cluster [DBG] pgmap v1129: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 6.7 GiB data, 26 GiB used, 690 GiB / 715 GiB avail; 1.2 KiB/s rd, 48 MiB/s wr, 765 op/s 2024-02-19T21:55:25.206 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:24.016824+0000 mon.a (mon.0) 1959 : cluster [DBG] osdmap e522: 8 total, 8 up, 8 in 2024-02-19T21:55:25.206 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:23.274708+0000 mgr.y (mgr.14514) 872 : cluster [DBG] pgmap v1129: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 6.7 GiB data, 26 GiB used, 690 GiB / 715 GiB avail; 1.2 KiB/s rd, 48 MiB/s wr, 765 op/s 2024-02-19T21:55:25.207 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:24.016824+0000 mon.a (mon.0) 1959 : cluster [DBG] osdmap e522: 8 total, 8 up, 8 in 2024-02-19T21:55:25.207 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:25.207 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:55:25.306 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:55:25.309 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:55:25.353 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:25.393 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:55:25.399 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:25.399 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:55:25.500 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:55:25.533 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:25.958 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:55:25.962 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:25.963 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:55:25.964 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:55:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:55:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:55:26.064 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:55:26.125 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 86 16 114476 114460 83.1561 46.0625 0.0287152 0.0120199 2024-02-19T21:55:26.142 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:26.353 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:55:26.360 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:26.361 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:55:26.462 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:55:26.471 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-02-19T21:55:26.518 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:26.645 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:55:26.651 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:26.652 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:55:26.652 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:25.275263+0000 mgr.y (mgr.14514) 873 : cluster [DBG] pgmap v1131: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 6.8 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 639 B/s rd, 52 MiB/s wr, 826 op/s 2024-02-19T21:55:26.653 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:25.535503+0000 mon.c (mon.2) 128 : audit [INF] from='client.? 172.21.15.80:0/2116325159' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:55:26.653 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:25.541400+0000 mon.a (mon.0) 1960 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:55:26.689 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:55:26.689 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:55:26.753 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:55:26.792 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:25.275263+0000 mgr.y (mgr.14514) 873 : cluster [DBG] pgmap v1131: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 6.8 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 639 B/s rd, 52 MiB/s wr, 826 op/s 2024-02-19T21:55:26.792 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:25.535503+0000 mon.c (mon.2) 128 : audit [INF] from='client.? 172.21.15.80:0/2116325159' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:55:26.792 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:25.541400+0000 mon.a (mon.0) 1960 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:55:26.792 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:25.275263+0000 mgr.y (mgr.14514) 873 : cluster [DBG] pgmap v1131: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 6.8 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 639 B/s rd, 52 MiB/s wr, 826 op/s 2024-02-19T21:55:26.792 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:25.535503+0000 mon.c (mon.2) 128 : audit [INF] from='client.? 172.21.15.80:0/2116325159' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:55:26.792 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:25.541400+0000 mon.a (mon.0) 1960 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:55:26.794 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:26.841 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:55:26.851 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:26.852 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:55:26.952 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:55:27.007 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:27.087 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:55:27.100 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:27.101 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:55:27.125 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 87 16 115267 115251 82.7686 49.4375 0.0141017 0.0120781 2024-02-19T21:55:27.201 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:55:27.264 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:27.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:26.453611+0000 mon.a (mon.0) 1961 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:55:27.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:26.461037+0000 mon.a (mon.0) 1962 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:55:27.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:26.461111+0000 mon.a (mon.0) 1963 : cluster [DBG] osdmap e523: 8 total, 8 up, 8 in 2024-02-19T21:55:27.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:26.453611+0000 mon.a (mon.0) 1961 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:55:27.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:26.461037+0000 mon.a (mon.0) 1962 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:55:27.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:26.461111+0000 mon.a (mon.0) 1963 : cluster [DBG] osdmap e523: 8 total, 8 up, 8 in 2024-02-19T21:55:27.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:26.453611+0000 mon.a (mon.0) 1961 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:55:27.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:26.461037+0000 mon.a (mon.0) 1962 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:55:27.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:26.461111+0000 mon.a (mon.0) 1963 : cluster [DBG] osdmap e523: 8 total, 8 up, 8 in 2024-02-19T21:55:28.125 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 88 16 116113 116097 82.4289 52.875 0.00592087 0.0121249 2024-02-19T21:55:28.363 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:55:28.393 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:55:28.429 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:55:28.451 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:55:28.483 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:55:28.516 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:55:28.543 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:55:28.552 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:55:28.556 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:28.557 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:55:28.577 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.5 dump_blocked_ops 2024-02-19T21:55:28.580 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:55:28.597 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:55:28.597 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:55:28.597 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:55:28.597 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:55:28.597 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:55:28.598 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:55:28.598 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:55:28.598 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:55:28.658 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:55:28.700 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:28.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:27.275655+0000 mgr.y (mgr.14514) 874 : cluster [DBG] pgmap v1133: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 6.9 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 853 B/s rd, 42 MiB/s wr, 679 op/s 2024-02-19T21:55:28.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:27.496874+0000 osd.7 (osd.7) 291 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:55:28.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:27.496928+0000 osd.7 (osd.7) 292 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:55:28.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:28.331890+0000 mon.b (mon.1) 80 : audit [DBG] from='client.? 172.21.15.80:0/166320110' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:55:28.835 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:55:28.837 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:27.275655+0000 mgr.y (mgr.14514) 874 : cluster [DBG] pgmap v1133: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 6.9 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 853 B/s rd, 42 MiB/s wr, 679 op/s 2024-02-19T21:55:28.837 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:27.496874+0000 osd.7 (osd.7) 291 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:55:28.837 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:27.496928+0000 osd.7 (osd.7) 292 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:55:28.837 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:28.331890+0000 mon.b (mon.1) 80 : audit [DBG] from='client.? 172.21.15.80:0/166320110' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:55:28.838 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:28.838 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:55:28.838 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:27.275655+0000 mgr.y (mgr.14514) 874 : cluster [DBG] pgmap v1133: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 6.9 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 853 B/s rd, 42 MiB/s wr, 679 op/s 2024-02-19T21:55:28.839 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:27.496874+0000 osd.7 (osd.7) 291 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:55:28.839 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:27.496928+0000 osd.7 (osd.7) 292 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:55:28.839 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:28.331890+0000 mon.b (mon.1) 80 : audit [DBG] from='client.? 172.21.15.80:0/166320110' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:55:28.939 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:55:29.027 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:29.058 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:55:29.065 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:29.066 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:55:29.125 INFO:tasks.radosbench.radosbench.0.smithi080.stdout: 89 16 116881 116865 82.0421 48 0.0142562 0.0121843 2024-02-19T21:55:29.167 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:55:29.172 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:55:29.235 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:29.306 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-19T21:55:29.337 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:55:29.343 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:29.344 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:55:29.444 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:55:29.498 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:29.536 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:55:29.544 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:29.545 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:55:29.645 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:55:29.691 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:28.506320+0000 mon.a (mon.0) 1964 : cluster [DBG] osdmap e524: 8 total, 8 up, 8 in 2024-02-19T21:55:29.693 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:28.506320+0000 mon.a (mon.0) 1964 : cluster [DBG] osdmap e524: 8 total, 8 up, 8 in 2024-02-19T21:55:29.697 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:29.731 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:55:29.745 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:55:29.750 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:29.750 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:55:29.759 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:28.506320+0000 mon.a (mon.0) 1964 : cluster [DBG] osdmap e524: 8 total, 8 up, 8 in 2024-02-19T21:55:29.851 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:55:29.917 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:30.003 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 4, 5, 6, 7, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 6, 7, 2] 2024-02-19T21:55:30.004 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:55:30.004 INFO:tasks.thrashosds.thrasher:inject_pause on osd.6 2024-02-19T21:55:30.004 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-02-19T21:55:30.004 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-02-19T21:55:30.004 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.6 config set filestore_inject_stall 3 2024-02-19T21:55:30.126 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Total time run: 90.0151 2024-02-19T21:55:30.126 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Total writes made: 117606 2024-02-19T21:55:30.126 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Write size: 65536 2024-02-19T21:55:30.126 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Object size: 65536 2024-02-19T21:55:30.126 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Bandwidth (MB/sec): 81.6571 2024-02-19T21:55:30.126 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Stddev Bandwidth: 35.5771 2024-02-19T21:55:30.126 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Max bandwidth (MB/sec): 211.312 2024-02-19T21:55:30.126 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Min bandwidth (MB/sec): 45.0625 2024-02-19T21:55:30.127 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Average IOPS: 1306 2024-02-19T21:55:30.127 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Stddev IOPS: 569.234 2024-02-19T21:55:30.127 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Max IOPS: 3381 2024-02-19T21:55:30.127 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Min IOPS: 721 2024-02-19T21:55:30.127 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Average Latency(s): 0.0122422 2024-02-19T21:55:30.127 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Stddev Latency(s): 0.0104121 2024-02-19T21:55:30.127 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Max latency(s): 0.248972 2024-02-19T21:55:30.127 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Min latency(s): 0.0011498 2024-02-19T21:55:30.133 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Cleaning up (deleting benchmark objects) 2024-02-19T21:55:30.139 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:55:30.144 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:30.145 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:55:30.245 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:55:30.290 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:30.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:29.275997+0000 mgr.y (mgr.14514) 875 : cluster [DBG] pgmap v1135: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 7.0 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 853 B/s rd, 42 MiB/s wr, 672 op/s 2024-02-19T21:55:30.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:29.275997+0000 mgr.y (mgr.14514) 875 : cluster [DBG] pgmap v1135: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 7.0 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 853 B/s rd, 42 MiB/s wr, 672 op/s 2024-02-19T21:55:30.677 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:29.275997+0000 mgr.y (mgr.14514) 875 : cluster [DBG] pgmap v1135: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 7.0 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 853 B/s rd, 42 MiB/s wr, 672 op/s 2024-02-19T21:55:31.090 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:55:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:55:30] "GET /metrics HTTP/1.1" 200 176790 "" "Prometheus/2.33.4" 2024-02-19T21:55:31.146 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:55:31.149 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:31.149 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:55:31.250 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:55:31.287 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:55:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:55:31.328 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:31.363 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:55:31.363 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [], 2024-02-19T21:55:31.363 INFO:teuthology.orchestra.run.smithi157.stdout: "complaint_time": 30, 2024-02-19T21:55:31.364 INFO:teuthology.orchestra.run.smithi157.stdout: "num_blocked_ops": 0 2024-02-19T21:55:31.364 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:55:31.367 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:55:31.377 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:31.378 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:55:31.403 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:55:31.440 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:55:31.479 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:55:31.518 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:31.544 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:30.608137+0000 osd.2 (osd.2) 51 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:55:31.544 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:30.608198+0000 osd.2 (osd.2) 52 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:55:31.625 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:55:31.633 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:31.634 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:55:31.735 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:55:31.790 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:31.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:30.608137+0000 osd.2 (osd.2) 51 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:55:31.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:30.608198+0000 osd.2 (osd.2) 52 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:55:31.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:30.608137+0000 osd.2 (osd.2) 51 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:55:31.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:30.608198+0000 osd.2 (osd.2) 52 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:55:31.872 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:55:31.910 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:55:31.912 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:31.913 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:55:32.014 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:55:32.055 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:32.211 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:55:32.221 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:32.222 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:55:32.323 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:55:32.387 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.5 dump_historic_ops 2024-02-19T21:55:32.400 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:32.463 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:55:32.473 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:32.474 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:55:32.575 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:55:32.579 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-02-19T21:55:32.618 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:32.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:31.276613+0000 mgr.y (mgr.14514) 876 : cluster [DBG] pgmap v1136: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 7.2 GiB data, 27 GiB used, 688 GiB / 715 GiB avail; 1.4 KiB/s rd, 63 MiB/s wr, 1.02k op/s 2024-02-19T21:55:32.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:31.285982+0000 mgr.y (mgr.14514) 877 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:55:32.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:31.545170+0000 mon.a (mon.0) 1965 : cluster [DBG] osdmap e525: 8 total, 8 up, 8 in 2024-02-19T21:55:32.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:32.101105+0000 mon.b (mon.1) 81 : audit [INF] from='client.? 172.21.15.80:0/4116734857' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:55:32.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:32.108916+0000 mon.a (mon.0) 1966 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:55:32.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:32.466817+0000 osd.0 (osd.0) 307 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:55:32.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:32.466865+0000 osd.0 (osd.0) 308 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:55:32.826 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:55:32.829 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:32.830 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:55:32.830 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:31.276613+0000 mgr.y (mgr.14514) 876 : cluster [DBG] pgmap v1136: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 7.2 GiB data, 27 GiB used, 688 GiB / 715 GiB avail; 1.4 KiB/s rd, 63 MiB/s wr, 1.02k op/s 2024-02-19T21:55:32.830 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:31.285982+0000 mgr.y (mgr.14514) 877 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:55:32.831 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:31.545170+0000 mon.a (mon.0) 1965 : cluster [DBG] osdmap e525: 8 total, 8 up, 8 in 2024-02-19T21:55:32.831 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:32.101105+0000 mon.b (mon.1) 81 : audit [INF] from='client.? 172.21.15.80:0/4116734857' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:55:32.831 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:32.108916+0000 mon.a (mon.0) 1966 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:55:32.831 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:32.466817+0000 osd.0 (osd.0) 307 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:55:32.831 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:32.466865+0000 osd.0 (osd.0) 308 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:55:32.831 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:31.276613+0000 mgr.y (mgr.14514) 876 : cluster [DBG] pgmap v1136: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 7.2 GiB data, 27 GiB used, 688 GiB / 715 GiB avail; 1.4 KiB/s rd, 63 MiB/s wr, 1.02k op/s 2024-02-19T21:55:32.831 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:31.285982+0000 mgr.y (mgr.14514) 877 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:55:32.831 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:31.545170+0000 mon.a (mon.0) 1965 : cluster [DBG] osdmap e525: 8 total, 8 up, 8 in 2024-02-19T21:55:32.831 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:32.101105+0000 mon.b (mon.1) 81 : audit [INF] from='client.? 172.21.15.80:0/4116734857' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:55:32.831 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:32.108916+0000 mon.a (mon.0) 1966 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:55:32.831 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:32.466817+0000 osd.0 (osd.0) 307 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:55:32.832 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:32.466865+0000 osd.0 (osd.0) 308 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:55:32.931 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:55:32.983 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:33.045 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:55:33.049 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:33.050 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:55:33.151 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:55:33.192 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:33.665 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:55:33.670 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:33.670 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:55:33.771 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:55:33.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:32.550582+0000 mon.a (mon.0) 1967 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:55:33.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:32.570908+0000 mon.a (mon.0) 1968 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:55:33.812 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:32.570964+0000 mon.a (mon.0) 1969 : cluster [DBG] osdmap e526: 8 total, 8 up, 8 in 2024-02-19T21:55:33.820 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:32.550582+0000 mon.a (mon.0) 1967 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:55:33.820 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:32.570908+0000 mon.a (mon.0) 1968 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:55:33.820 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:32.570964+0000 mon.a (mon.0) 1969 : cluster [DBG] osdmap e526: 8 total, 8 up, 8 in 2024-02-19T21:55:33.821 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:32.550582+0000 mon.a (mon.0) 1967 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:55:33.821 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:32.570908+0000 mon.a (mon.0) 1968 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:55:33.821 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:32.570964+0000 mon.a (mon.0) 1969 : cluster [DBG] osdmap e526: 8 total, 8 up, 8 in 2024-02-19T21:55:33.822 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:33.857 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:55:33.911 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:55:33.911 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2024-02-19T21:55:33.911 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:55:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:55:34.190 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:34.190 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:55:34.291 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:55:34.344 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:34.380 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:55:34.382 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:34.383 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:55:34.484 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:55:34.550 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:34.861 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:55:34.893 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:55:34.921 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:55:34.962 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:55:34.994 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:55:35.030 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:55:35.096 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:55:35.134 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:55:35.156 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:55:35.156 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:55:35.157 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:55:35.157 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:55:35.157 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:55:35.157 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:55:35.157 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:55:35.157 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:55:35.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:33.277001+0000 mgr.y (mgr.14514) 878 : cluster [DBG] pgmap v1139: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 7.2 GiB data, 27 GiB used, 688 GiB / 715 GiB avail; 1023 B/s rd, 43 MiB/s wr, 730 op/s 2024-02-19T21:55:35.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:33.797661+0000 osd.5 (osd.5) 305 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:55:35.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:33.797721+0000 osd.5 (osd.5) 306 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:55:35.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:33.971733+0000 mon.a (mon.0) 1970 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:55:35.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:34.579232+0000 mon.a (mon.0) 1971 : cluster [DBG] osdmap e527: 8 total, 8 up, 8 in 2024-02-19T21:55:35.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:34.819468+0000 mon.a (mon.0) 1972 : audit [DBG] from='client.? 172.21.15.80:0/3068021251' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:55:35.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:33.277001+0000 mgr.y (mgr.14514) 878 : cluster [DBG] pgmap v1139: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 7.2 GiB data, 27 GiB used, 688 GiB / 715 GiB avail; 1023 B/s rd, 43 MiB/s wr, 730 op/s 2024-02-19T21:55:35.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:33.797661+0000 osd.5 (osd.5) 305 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:55:35.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:33.797721+0000 osd.5 (osd.5) 306 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:55:35.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:33.971733+0000 mon.a (mon.0) 1970 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:55:35.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:34.579232+0000 mon.a (mon.0) 1971 : cluster [DBG] osdmap e527: 8 total, 8 up, 8 in 2024-02-19T21:55:35.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:34.819468+0000 mon.a (mon.0) 1972 : audit [DBG] from='client.? 172.21.15.80:0/3068021251' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:55:35.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:33.277001+0000 mgr.y (mgr.14514) 878 : cluster [DBG] pgmap v1139: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 7.2 GiB data, 27 GiB used, 688 GiB / 715 GiB avail; 1023 B/s rd, 43 MiB/s wr, 730 op/s 2024-02-19T21:55:35.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:33.797661+0000 osd.5 (osd.5) 305 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:55:35.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:33.797721+0000 osd.5 (osd.5) 306 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:55:35.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:33.971733+0000 mon.a (mon.0) 1970 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:55:35.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:34.579232+0000 mon.a (mon.0) 1971 : cluster [DBG] osdmap e527: 8 total, 8 up, 8 in 2024-02-19T21:55:35.348 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:34.819468+0000 mon.a (mon.0) 1972 : audit [DBG] from='client.? 172.21.15.80:0/3068021251' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:55:35.621 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset noscrub 2024-02-19T21:55:36.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:55:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:55:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:55:36.109 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:55:36.535 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:55:36.540 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:36.540 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:55:36.641 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:55:36.676 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:35.277518+0000 mgr.y (mgr.14514) 879 : cluster [DBG] pgmap v1141: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 7.0 GiB data, 27 GiB used, 689 GiB / 715 GiB avail; 1023 B/s rd, 38 MiB/s wr, 1.03k op/s 2024-02-19T21:55:36.676 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:35.424657+0000 mon.a (mon.0) 1973 : cluster [DBG] osdmap e528: 8 total, 8 up, 8 in 2024-02-19T21:55:36.676 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:35.277518+0000 mgr.y (mgr.14514) 879 : cluster [DBG] pgmap v1141: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 7.0 GiB data, 27 GiB used, 689 GiB / 715 GiB avail; 1023 B/s rd, 38 MiB/s wr, 1.03k op/s 2024-02-19T21:55:36.676 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:35.424657+0000 mon.a (mon.0) 1973 : cluster [DBG] osdmap e528: 8 total, 8 up, 8 in 2024-02-19T21:55:36.695 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:36.775 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:35.277518+0000 mgr.y (mgr.14514) 879 : cluster [DBG] pgmap v1141: 138 pgs: 1 active+clean+scrubbing+deep, 137 active+clean; 7.0 GiB data, 27 GiB used, 689 GiB / 715 GiB avail; 1023 B/s rd, 38 MiB/s wr, 1.03k op/s 2024-02-19T21:55:36.775 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:35.424657+0000 mon.a (mon.0) 1973 : cluster [DBG] osdmap e528: 8 total, 8 up, 8 in 2024-02-19T21:55:36.964 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:55:36.968 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:36.968 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:55:37.069 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:55:37.118 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:37.156 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:55:37.163 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:37.164 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:55:37.265 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:55:37.316 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:38.036 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:55:38.296 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:55:38.296 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:55:38.696 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:37.277984+0000 mgr.y (mgr.14514) 880 : cluster [DBG] pgmap v1143: 138 pgs: 138 active+clean; 6.9 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 1.0 KiB/s rd, 3.2 MiB/s wr, 787 op/s 2024-02-19T21:55:38.795 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:37.277984+0000 mgr.y (mgr.14514) 880 : cluster [DBG] pgmap v1143: 138 pgs: 138 active+clean; 6.9 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 1.0 KiB/s rd, 3.2 MiB/s wr, 787 op/s 2024-02-19T21:55:38.795 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:37.277984+0000 mgr.y (mgr.14514) 880 : cluster [DBG] pgmap v1143: 138 pgs: 138 active+clean; 6.9 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 1.0 KiB/s rd, 3.2 MiB/s wr, 787 op/s 2024-02-19T21:55:38.906 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:55:38.928 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:38.929 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:55:39.029 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:55:39.057 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.6 dump_ops_in_flight 2024-02-19T21:55:39.098 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:39.133 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:55:39.138 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:39.139 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:55:39.240 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:55:39.312 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:39.368 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:55:39.372 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:39.373 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:55:39.474 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:55:39.553 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:39.572 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:55:39.590 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:55:39.595 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:39.596 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:55:39.696 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:55:39.724 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:40.495 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:55:40.497 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:40.498 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:55:40.598 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:55:40.642 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:40.770 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:39.278452+0000 mgr.y (mgr.14514) 881 : cluster [DBG] pgmap v1144: 138 pgs: 138 active+clean; 6.9 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 763 B/s rd, 210 KiB/s wr, 697 op/s 2024-02-19T21:55:40.771 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:39.278452+0000 mgr.y (mgr.14514) 881 : cluster [DBG] pgmap v1144: 138 pgs: 138 active+clean; 6.9 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 763 B/s rd, 210 KiB/s wr, 697 op/s 2024-02-19T21:55:40.772 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:55:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:55:40] "GET /metrics HTTP/1.1" 200 176799 "" "Prometheus/2.33.4" 2024-02-19T21:55:40.793 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:55:40.802 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:40.803 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:55:40.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:39.278452+0000 mgr.y (mgr.14514) 881 : cluster [DBG] pgmap v1144: 138 pgs: 138 active+clean; 6.9 GiB data, 26 GiB used, 689 GiB / 715 GiB avail; 763 B/s rd, 210 KiB/s wr, 697 op/s 2024-02-19T21:55:40.841 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:55:40.904 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:55:40.971 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:41.128 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:55:41.139 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:41.140 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:55:41.241 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:55:41.297 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:41.502 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:55:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:55:41.512 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-02-19T21:55:41.552 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 4, 5, 6, 7, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 6, 7, 2] 2024-02-19T21:55:41.552 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:55:41.552 INFO:tasks.thrashosds.thrasher:fixing pg num pool .rgw.root 2024-02-19T21:55:41.552 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:55:41.774 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:41.130671+0000 mon.a (mon.0) 1974 : audit [INF] from='client.? 172.21.15.80:0/547499520' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:55:41.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:41.130671+0000 mon.a (mon.0) 1974 : audit [INF] from='client.? 172.21.15.80:0/547499520' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:55:41.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:41.130671+0000 mon.a (mon.0) 1974 : audit [INF] from='client.? 172.21.15.80:0/547499520' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:55:42.262 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:55:42.270 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:42.270 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:55:42.371 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:55:42.428 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:42.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:41.279977+0000 mgr.y (mgr.14514) 882 : cluster [DBG] pgmap v1145: 138 pgs: 138 active+clean; 6.6 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1.2 KiB/s rd, 176 KiB/s wr, 1.15k op/s 2024-02-19T21:55:42.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:41.295789+0000 mgr.y (mgr.14514) 883 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:55:42.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:41.502122+0000 mon.a (mon.0) 1975 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:55:42.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:41.510319+0000 mon.a (mon.0) 1976 : audit [INF] from='client.? 172.21.15.80:0/547499520' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:55:42.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:41.510381+0000 mon.a (mon.0) 1977 : cluster [DBG] osdmap e529: 8 total, 8 up, 8 in 2024-02-19T21:55:42.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:41.279977+0000 mgr.y (mgr.14514) 882 : cluster [DBG] pgmap v1145: 138 pgs: 138 active+clean; 6.6 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1.2 KiB/s rd, 176 KiB/s wr, 1.15k op/s 2024-02-19T21:55:42.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:41.295789+0000 mgr.y (mgr.14514) 883 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:55:42.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:41.502122+0000 mon.a (mon.0) 1975 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:55:42.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:41.510319+0000 mon.a (mon.0) 1976 : audit [INF] from='client.? 172.21.15.80:0/547499520' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:55:42.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:41.510381+0000 mon.a (mon.0) 1977 : cluster [DBG] osdmap e529: 8 total, 8 up, 8 in 2024-02-19T21:55:42.697 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:55:42.700 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:42.700 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:55:42.801 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:55:42.816 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:41.279977+0000 mgr.y (mgr.14514) 882 : cluster [DBG] pgmap v1145: 138 pgs: 138 active+clean; 6.6 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1.2 KiB/s rd, 176 KiB/s wr, 1.15k op/s 2024-02-19T21:55:42.816 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:41.295789+0000 mgr.y (mgr.14514) 883 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:55:42.816 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:41.502122+0000 mon.a (mon.0) 1975 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:55:42.816 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:41.510319+0000 mon.a (mon.0) 1976 : audit [INF] from='client.? 172.21.15.80:0/547499520' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:55:42.816 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:41.510381+0000 mon.a (mon.0) 1977 : cluster [DBG] osdmap e529: 8 total, 8 up, 8 in 2024-02-19T21:55:42.816 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:55:42.816 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:55:42.883 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:43.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:41.882313+0000 osd.6 (osd.6) 276 : cluster [DBG] 11.8 scrub starts 2024-02-19T21:55:43.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:41.882313+0000 osd.6 (osd.6) 276 : cluster [DBG] 11.8 scrub starts 2024-02-19T21:55:43.821 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:41.882313+0000 osd.6 (osd.6) 276 : cluster [DBG] 11.8 scrub starts 2024-02-19T21:55:43.971 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:55:43.977 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:43.978 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:55:44.078 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:55:44.126 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:44.420 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:55:44.493 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:55:44.497 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:55:44.498 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.6 dump_blocked_ops 2024-02-19T21:55:44.499 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:44.499 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:55:44.533 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:55:44.556 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:55:44.580 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:55:44.600 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:55:44.624 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:55:44.660 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:44.664 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:55:44.699 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:55:44.705 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:55:44.711 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:44.711 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:55:44.740 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:55:44.741 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:55:44.741 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:55:44.741 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:55:44.741 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:55:44.742 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:55:44.742 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:55:44.742 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:55:44.742 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:55:44.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:43.280454+0000 mgr.y (mgr.14514) 884 : cluster [DBG] pgmap v1147: 138 pgs: 138 active+clean; 6.6 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 941 op/s 2024-02-19T21:55:44.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:44.455825+0000 mon.a (mon.0) 1978 : audit [DBG] from='client.? 172.21.15.80:0/2302035183' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:55:44.812 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:55:44.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:43.280454+0000 mgr.y (mgr.14514) 884 : cluster [DBG] pgmap v1147: 138 pgs: 138 active+clean; 6.6 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 941 op/s 2024-02-19T21:55:44.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:44.455825+0000 mon.a (mon.0) 1978 : audit [DBG] from='client.? 172.21.15.80:0/2302035183' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:55:44.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:43.280454+0000 mgr.y (mgr.14514) 884 : cluster [DBG] pgmap v1147: 138 pgs: 138 active+clean; 6.6 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 941 op/s 2024-02-19T21:55:44.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:44.455825+0000 mon.a (mon.0) 1978 : audit [DBG] from='client.? 172.21.15.80:0/2302035183' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:55:44.874 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:44.907 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:55:44.920 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:44.921 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:55:44.952 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:55:45.022 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:55:45.077 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:45.284 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:55:45.288 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:45.289 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:55:45.390 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:55:45.463 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:45.494 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:55:45.498 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:45.499 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:55:45.600 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:55:45.665 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:45.806 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:55:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:55:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:55:45.848 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-19T21:55:46.233 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:55:46.237 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:46.237 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:55:46.338 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:55:46.400 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:46.435 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:45.047009+0000 osd.6 (osd.6) 277 : cluster [DBG] 11.8 scrub ok 2024-02-19T21:55:46.436 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:45.281038+0000 mgr.y (mgr.14514) 885 : cluster [DBG] pgmap v1148: 138 pgs: 138 active+clean; 6.4 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 519 B/s rd, 0 B/s wr, 863 op/s 2024-02-19T21:55:46.436 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:45.428122+0000 mon.a (mon.0) 1979 : cluster [DBG] osdmap e530: 8 total, 8 up, 8 in 2024-02-19T21:55:46.436 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:45.547985+0000 osd.4 (osd.4) 243 : cluster [DBG] 4.9 scrub starts 2024-02-19T21:55:46.436 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:45.552703+0000 osd.4 (osd.4) 244 : cluster [DBG] 4.9 scrub ok 2024-02-19T21:55:46.436 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:45.790515+0000 osd.2 (osd.2) 53 : cluster [DBG] 4.19 scrub starts 2024-02-19T21:55:46.436 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:45.796874+0000 osd.2 (osd.2) 54 : cluster [DBG] 4.19 scrub ok 2024-02-19T21:55:46.436 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:45.047009+0000 osd.6 (osd.6) 277 : cluster [DBG] 11.8 scrub ok 2024-02-19T21:55:46.436 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:45.281038+0000 mgr.y (mgr.14514) 885 : cluster [DBG] pgmap v1148: 138 pgs: 138 active+clean; 6.4 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 519 B/s rd, 0 B/s wr, 863 op/s 2024-02-19T21:55:46.436 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:45.428122+0000 mon.a (mon.0) 1979 : cluster [DBG] osdmap e530: 8 total, 8 up, 8 in 2024-02-19T21:55:46.436 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:45.547985+0000 osd.4 (osd.4) 243 : cluster [DBG] 4.9 scrub starts 2024-02-19T21:55:46.437 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:45.552703+0000 osd.4 (osd.4) 244 : cluster [DBG] 4.9 scrub ok 2024-02-19T21:55:46.437 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:45.790515+0000 osd.2 (osd.2) 53 : cluster [DBG] 4.19 scrub starts 2024-02-19T21:55:46.437 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:45.796874+0000 osd.2 (osd.2) 54 : cluster [DBG] 4.19 scrub ok 2024-02-19T21:55:46.546 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:55:46.552 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:45.047009+0000 osd.6 (osd.6) 277 : cluster [DBG] 11.8 scrub ok 2024-02-19T21:55:46.552 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:45.281038+0000 mgr.y (mgr.14514) 885 : cluster [DBG] pgmap v1148: 138 pgs: 138 active+clean; 6.4 GiB data, 25 GiB used, 690 GiB / 715 GiB avail; 519 B/s rd, 0 B/s wr, 863 op/s 2024-02-19T21:55:46.552 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:45.428122+0000 mon.a (mon.0) 1979 : cluster [DBG] osdmap e530: 8 total, 8 up, 8 in 2024-02-19T21:55:46.552 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:45.547985+0000 osd.4 (osd.4) 243 : cluster [DBG] 4.9 scrub starts 2024-02-19T21:55:46.552 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:45.552703+0000 osd.4 (osd.4) 244 : cluster [DBG] 4.9 scrub ok 2024-02-19T21:55:46.552 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:45.790515+0000 osd.2 (osd.2) 53 : cluster [DBG] 4.19 scrub starts 2024-02-19T21:55:46.552 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:45.796874+0000 osd.2 (osd.2) 54 : cluster [DBG] 4.19 scrub ok 2024-02-19T21:55:46.555 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:46.556 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:55:46.656 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:55:46.714 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:46.878 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:55:46.878 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [], 2024-02-19T21:55:46.878 INFO:teuthology.orchestra.run.smithi157.stdout: "complaint_time": 30, 2024-02-19T21:55:46.878 INFO:teuthology.orchestra.run.smithi157.stdout: "num_blocked_ops": 0 2024-02-19T21:55:46.878 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:55:46.923 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:55:46.928 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:46.928 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:55:47.029 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:55:47.076 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:47.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:45.646903+0000 osd.0 (osd.0) 309 : cluster [DBG] 5.3 scrub starts 2024-02-19T21:55:47.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:45.663042+0000 osd.0 (osd.0) 310 : cluster [DBG] 5.3 scrub ok 2024-02-19T21:55:47.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:46.517545+0000 osd.4 (osd.4) 245 : cluster [DBG] 4.e scrub starts 2024-02-19T21:55:47.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:46.521255+0000 osd.4 (osd.4) 246 : cluster [DBG] 4.e scrub ok 2024-02-19T21:55:47.635 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:55:47.640 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:47.640 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:55:47.641 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:45.646903+0000 osd.0 (osd.0) 309 : cluster [DBG] 5.3 scrub starts 2024-02-19T21:55:47.641 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:45.663042+0000 osd.0 (osd.0) 310 : cluster [DBG] 5.3 scrub ok 2024-02-19T21:55:47.641 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:46.517545+0000 osd.4 (osd.4) 245 : cluster [DBG] 4.e scrub starts 2024-02-19T21:55:47.641 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:46.521255+0000 osd.4 (osd.4) 246 : cluster [DBG] 4.e scrub ok 2024-02-19T21:55:47.641 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:45.646903+0000 osd.0 (osd.0) 309 : cluster [DBG] 5.3 scrub starts 2024-02-19T21:55:47.641 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:45.663042+0000 osd.0 (osd.0) 310 : cluster [DBG] 5.3 scrub ok 2024-02-19T21:55:47.641 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:46.517545+0000 osd.4 (osd.4) 245 : cluster [DBG] 4.e scrub starts 2024-02-19T21:55:47.641 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:46.521255+0000 osd.4 (osd.4) 246 : cluster [DBG] 4.e scrub ok 2024-02-19T21:55:47.655 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.6 dump_historic_ops 2024-02-19T21:55:47.741 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:55:47.803 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:47.831 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:55:47.836 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:47.837 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:55:47.923 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:55:47.929 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:55:47.938 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:55:47.991 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:48.073 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:55:48.264 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:55:48.268 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:48.268 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:55:48.369 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:55:48.402 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:48.444 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:55:48.448 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:48.448 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:55:48.549 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:55:48.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:46.896838+0000 osd.6 (osd.6) 278 : cluster [DBG] 4.5 scrub starts 2024-02-19T21:55:48.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:46.908746+0000 osd.6 (osd.6) 279 : cluster [DBG] 4.5 scrub ok 2024-02-19T21:55:48.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:47.281520+0000 mgr.y (mgr.14514) 886 : cluster [DBG] pgmap v1150: 138 pgs: 138 active+clean; 6.3 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.16k op/s 2024-02-19T21:55:48.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:47.504755+0000 osd.4 (osd.4) 247 : cluster [DBG] 5.e scrub starts 2024-02-19T21:55:48.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:47.510566+0000 osd.4 (osd.4) 248 : cluster [DBG] 5.e scrub ok 2024-02-19T21:55:48.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:47.902163+0000 mgr.y (mgr.14514) 887 : audit [DBG] from='client.26048 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:55:48.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:46.896838+0000 osd.6 (osd.6) 278 : cluster [DBG] 4.5 scrub starts 2024-02-19T21:55:48.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:46.908746+0000 osd.6 (osd.6) 279 : cluster [DBG] 4.5 scrub ok 2024-02-19T21:55:48.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:47.281520+0000 mgr.y (mgr.14514) 886 : cluster [DBG] pgmap v1150: 138 pgs: 138 active+clean; 6.3 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.16k op/s 2024-02-19T21:55:48.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:47.504755+0000 osd.4 (osd.4) 247 : cluster [DBG] 5.e scrub starts 2024-02-19T21:55:48.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:47.510566+0000 osd.4 (osd.4) 248 : cluster [DBG] 5.e scrub ok 2024-02-19T21:55:48.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:47.902163+0000 mgr.y (mgr.14514) 887 : audit [DBG] from='client.26048 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:55:48.608 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:48.610 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:46.896838+0000 osd.6 (osd.6) 278 : cluster [DBG] 4.5 scrub starts 2024-02-19T21:55:48.610 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:46.908746+0000 osd.6 (osd.6) 279 : cluster [DBG] 4.5 scrub ok 2024-02-19T21:55:48.610 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:47.281520+0000 mgr.y (mgr.14514) 886 : cluster [DBG] pgmap v1150: 138 pgs: 138 active+clean; 6.3 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.16k op/s 2024-02-19T21:55:48.610 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:47.504755+0000 osd.4 (osd.4) 247 : cluster [DBG] 5.e scrub starts 2024-02-19T21:55:48.610 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:47.510566+0000 osd.4 (osd.4) 248 : cluster [DBG] 5.e scrub ok 2024-02-19T21:55:48.610 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:47.902163+0000 mgr.y (mgr.14514) 887 : audit [DBG] from='client.26048 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:55:48.652 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:55:48.657 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:48.657 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:55:48.758 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:55:48.806 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:48.891 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":1150,"stamp":"2024-02-19T21:55:47.281212+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6778197698,"num_objects":103620,"num_object_clones":0,"num_object_copies":310860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103620,"num_whiteouts":0,"num_read":2933,"num_read_kb":2685,"num_write":132783,"num_write_kb":7526824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":327,"num_bytes_recovered":7805,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":89989,"ondisk_log_size":89989,"up":414,"acting":414,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":415,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":25675896,"kb_used_data":19994040,"kb_used_omap":0,"kb_used_meta":5681343,"kb_avail":724285320,"statfs":{"total":767960285184,"available":741668167680,"internally_reserved":0,"allocated":20473896960,"data_stored":20460908756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":5817695284},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-605880320,"num_objects":-9245,"num_object_clones":0,"num_object_copies":-27735,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-9245,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":9245,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003069"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":130,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.446252+0000","last_change":"2024-02-19T21:54:18.805903+0000","last_active":"2024-02-19T21:55:35.446252+0000","last_peered":"2024-02-19T21:55:35.446252+0000","last_clean":"2024-02-19T21:55:35.446252+0000","last_became_active":"2024-02-19T21:49:54.492544+0000","last_became_peered":"2024-02-19T21:49:54.492544+0000","last_unstale":"2024-02-19T21:55:35.446252+0000","last_undegraded":"2024-02-19T21:55:35.446252+0000","last_fullsized":"2024-02-19T21:55:35.446252+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:18.805820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:54:18.805820+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":507,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.434851+0000","last_change":"2024-02-19T21:54:07.029225+0000","last_active":"2024-02-19T21:55:35.434851+0000","last_peered":"2024-02-19T21:55:35.434851+0000","last_clean":"2024-02-19T21:55:35.434851+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:55:35.434851+0000","last_undegraded":"2024-02-19T21:55:35.434851+0000","last_fullsized":"2024-02-19T21:55:35.434851+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:07.029148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:54:07.029148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"471'39","reported_seq":197,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.425203+0000","last_change":"2024-02-19T21:55:23.836140+0000","last_active":"2024-02-19T21:55:35.425203+0000","last_peered":"2024-02-19T21:55:35.425203+0000","last_clean":"2024-02-19T21:55:35.425203+0000","last_became_active":"2024-02-19T21:49:08.327416+0000","last_became_peered":"2024-02-19T21:49:08.327416+0000","last_unstale":"2024-02-19T21:55:35.425203+0000","last_undegraded":"2024-02-19T21:55:35.425203+0000","last_fullsized":"2024-02-19T21:55:35.425203+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'39","last_scrub_stamp":"2024-02-19T21:53:54.277319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:53:54.277319+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":482,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.425117+0000","last_change":"2024-02-19T21:54:13.470532+0000","last_active":"2024-02-19T21:55:35.425117+0000","last_peered":"2024-02-19T21:55:35.425117+0000","last_clean":"2024-02-19T21:55:35.425117+0000","last_became_active":"2024-02-19T21:47:46.250178+0000","last_became_peered":"2024-02-19T21:47:46.250178+0000","last_unstale":"2024-02-19T21:55:35.425117+0000","last_undegraded":"2024-02-19T21:55:35.425117+0000","last_fullsized":"2024-02-19T21:55:35.425117+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:13.470431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:13.470431+0000","last_clean_scrub_stamp":"2024-02-19T21:54:13.470431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":56,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.436779+0000","last_change":"2024-02-19T21:55:11.543232+0000","last_active":"2024-02-19T21:55:35.436779+0000","last_peered":"2024-02-19T21:55:35.436779+0000","last_clean":"2024-02-19T21:55:35.436779+0000","last_became_active":"2024-02-19T21:53:45.368218+0000","last_became_peered":"2024-02-19T21:53:45.368218+0000","last_unstale":"2024-02-19T21:55:35.436779+0000","last_undegraded":"2024-02-19T21:55:35.436779+0000","last_fullsized":"2024-02-19T21:55:35.436779+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:11.543119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:55:11.543119+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"470'25","reported_seq":587,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.425036+0000","last_change":"2024-02-19T21:55:03.508377+0000","last_active":"2024-02-19T21:55:35.425036+0000","last_peered":"2024-02-19T21:55:35.425036+0000","last_clean":"2024-02-19T21:55:35.425036+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:55:35.425036+0000","last_undegraded":"2024-02-19T21:55:35.425036+0000","last_fullsized":"2024-02-19T21:55:35.425036+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'25","last_scrub_stamp":"2024-02-19T21:55:03.508262+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:55:03.508262+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":267,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.431138+0000","last_change":"2024-02-19T21:54:02.455027+0000","last_active":"2024-02-19T21:55:35.431138+0000","last_peered":"2024-02-19T21:55:35.431138+0000","last_clean":"2024-02-19T21:55:35.431138+0000","last_became_active":"2024-02-19T21:49:08.331753+0000","last_became_peered":"2024-02-19T21:49:08.331753+0000","last_unstale":"2024-02-19T21:55:35.431138+0000","last_undegraded":"2024-02-19T21:55:35.431138+0000","last_fullsized":"2024-02-19T21:55:35.431138+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:02.454932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:02.454932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":522,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.437070+0000","last_change":"2024-02-19T21:54:13.655262+0000","last_active":"2024-02-19T21:55:35.437070+0000","last_peered":"2024-02-19T21:55:35.437070+0000","last_clean":"2024-02-19T21:55:35.437070+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:55:35.437070+0000","last_undegraded":"2024-02-19T21:55:35.437070+0000","last_fullsized":"2024-02-19T21:55:35.437070+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:13.655182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_clean_scrub_stamp":"2024-02-19T21:54:13.655182+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"470'11","reported_seq":556,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.425492+0000","last_change":"2024-02-19T21:53:51.243831+0000","last_active":"2024-02-19T21:55:35.425492+0000","last_peered":"2024-02-19T21:55:35.425492+0000","last_clean":"2024-02-19T21:55:35.425492+0000","last_became_active":"2024-02-19T21:53:45.385837+0000","last_became_peered":"2024-02-19T21:53:45.385837+0000","last_unstale":"2024-02-19T21:55:35.425492+0000","last_undegraded":"2024-02-19T21:55:35.425492+0000","last_fullsized":"2024-02-19T21:55:35.425492+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'11","last_scrub_stamp":"2024-02-19T21:53:51.243743+0000","last_deep_scrub":"310'9","last_deep_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_clean_scrub_stamp":"2024-02-19T21:53:51.243743+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":441,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.434454+0000","last_change":"2024-02-19T21:54:00.131758+0000","last_active":"2024-02-19T21:55:35.434454+0000","last_peered":"2024-02-19T21:55:35.434454+0000","last_clean":"2024-02-19T21:55:35.434454+0000","last_became_active":"2024-02-19T21:46:31.204816+0000","last_became_peered":"2024-02-19T21:46:31.204816+0000","last_unstale":"2024-02-19T21:55:35.434454+0000","last_undegraded":"2024-02-19T21:55:35.434454+0000","last_fullsized":"2024-02-19T21:55:35.434454+0000","mapping_epoch":330,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":331,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:54:00.131654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:54:00.131654+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":544,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.436989+0000","last_change":"2024-02-19T21:53:58.606788+0000","last_active":"2024-02-19T21:55:35.436989+0000","last_peered":"2024-02-19T21:55:35.436989+0000","last_clean":"2024-02-19T21:55:35.436989+0000","last_became_active":"2024-02-19T21:49:08.329998+0000","last_became_peered":"2024-02-19T21:49:08.329998+0000","last_unstale":"2024-02-19T21:55:35.436989+0000","last_undegraded":"2024-02-19T21:55:35.436989+0000","last_fullsized":"2024-02-19T21:55:35.436989+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:58.606696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:58.606696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"470'25","reported_seq":416,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.425246+0000","last_change":"2024-02-19T21:54:07.275961+0000","last_active":"2024-02-19T21:55:35.425246+0000","last_peered":"2024-02-19T21:55:35.425246+0000","last_clean":"2024-02-19T21:55:35.425246+0000","last_became_active":"2024-02-19T21:53:45.383294+0000","last_became_peered":"2024-02-19T21:53:45.383294+0000","last_unstale":"2024-02-19T21:55:35.425246+0000","last_undegraded":"2024-02-19T21:55:35.425246+0000","last_fullsized":"2024-02-19T21:55:35.425246+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'25","last_scrub_stamp":"2024-02-19T21:54:07.275895+0000","last_deep_scrub":"470'25","last_deep_scrub_stamp":"2024-02-19T21:54:07.275895+0000","last_clean_scrub_stamp":"2024-02-19T21:54:07.275895+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":51,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.436965+0000","last_change":"2024-02-19T21:54:12.582686+0000","last_active":"2024-02-19T21:55:35.436965+0000","last_peered":"2024-02-19T21:55:35.436965+0000","last_clean":"2024-02-19T21:55:35.436965+0000","last_became_active":"2024-02-19T21:53:45.369808+0000","last_became_peered":"2024-02-19T21:53:45.369808+0000","last_unstale":"2024-02-19T21:55:35.436965+0000","last_undegraded":"2024-02-19T21:55:35.436965+0000","last_fullsized":"2024-02-19T21:55:35.436965+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:12.582596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:12.582596+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":30,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.425529+0000","last_change":"2024-02-19T21:55:00.964172+0000","last_active":"2024-02-19T21:55:35.425529+0000","last_peered":"2024-02-19T21:55:35.425529+0000","last_clean":"2024-02-19T21:55:35.425529+0000","last_became_active":"2024-02-19T21:54:52.469938+0000","last_became_peered":"2024-02-19T21:54:52.469938+0000","last_unstale":"2024-02-19T21:55:35.425529+0000","last_undegraded":"2024-02-19T21:55:35.425529+0000","last_fullsized":"2024-02-19T21:55:35.425529+0000","mapping_epoch":513,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":514,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:00.964069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:55:00.964069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"471'24","reported_seq":42,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.426798+0000","last_change":"2024-02-19T21:54:58.907072+0000","last_active":"2024-02-19T21:55:35.426798+0000","last_peered":"2024-02-19T21:55:35.426798+0000","last_clean":"2024-02-19T21:55:35.426798+0000","last_became_active":"2024-02-19T21:54:52.474005+0000","last_became_peered":"2024-02-19T21:54:52.474005+0000","last_unstale":"2024-02-19T21:55:35.426798+0000","last_undegraded":"2024-02-19T21:55:35.426798+0000","last_fullsized":"2024-02-19T21:55:35.426798+0000","mapping_epoch":513,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":514,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'24","last_scrub_stamp":"2024-02-19T21:54:58.906977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:54:58.906977+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":33,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6],"acting":[2,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":504,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.425916+0000","last_change":"2024-02-19T21:48:40.528082+0000","last_active":"2024-02-19T21:55:35.425916+0000","last_peered":"2024-02-19T21:55:35.425916+0000","last_clean":"2024-02-19T21:55:35.425916+0000","last_became_active":"2024-02-19T21:44:58.788307+0000","last_became_peered":"2024-02-19T21:44:58.788307+0000","last_unstale":"2024-02-19T21:55:35.425916+0000","last_undegraded":"2024-02-19T21:55:35.425916+0000","last_fullsized":"2024-02-19T21:55:35.425916+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:40.527970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:48:40.527970+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":517,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.448239+0000","last_change":"2024-02-19T21:54:22.689209+0000","last_active":"2024-02-19T21:55:35.448239+0000","last_peered":"2024-02-19T21:55:35.448239+0000","last_clean":"2024-02-19T21:55:35.448239+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:55:35.448239+0000","last_undegraded":"2024-02-19T21:55:35.448239+0000","last_fullsized":"2024-02-19T21:55:35.448239+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:22.689143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:17.913620+0000","last_clean_scrub_stamp":"2024-02-19T21:54:22.689143+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"470'46","reported_seq":201,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.426541+0000","last_change":"2024-02-19T21:55:19.874401+0000","last_active":"2024-02-19T21:55:35.426541+0000","last_peered":"2024-02-19T21:55:35.426541+0000","last_clean":"2024-02-19T21:55:35.426541+0000","last_became_active":"2024-02-19T21:49:08.331742+0000","last_became_peered":"2024-02-19T21:49:08.331742+0000","last_unstale":"2024-02-19T21:55:35.426541+0000","last_undegraded":"2024-02-19T21:55:35.426541+0000","last_fullsized":"2024-02-19T21:55:35.426541+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'46","last_scrub_stamp":"2024-02-19T21:55:19.874292+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:55:19.874292+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":532,"reported_epoch":529,"state":"active+clean","last_fresh":"2024-02-19T21:55:42.736398+0000","last_change":"2024-02-19T21:55:42.747278+0000","last_active":"2024-02-19T21:55:42.736398+0000","last_peered":"2024-02-19T21:55:42.736398+0000","last_clean":"2024-02-19T21:55:42.736398+0000","last_became_active":"2024-02-19T21:44:58.790669+0000","last_became_peered":"2024-02-19T21:44:58.790669+0000","last_unstale":"2024-02-19T21:55:42.736398+0000","last_undegraded":"2024-02-19T21:55:42.736398+0000","last_fullsized":"2024-02-19T21:55:42.736398+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_clean_scrub_stamp":"2024-02-19T21:46:44.994296+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":463,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.430551+0000","last_change":"2024-02-19T21:53:55.597392+0000","last_active":"2024-02-19T21:55:35.430551+0000","last_peered":"2024-02-19T21:55:35.430551+0000","last_clean":"2024-02-19T21:55:35.430551+0000","last_became_active":"2024-02-19T21:49:08.329986+0000","last_became_peered":"2024-02-19T21:49:08.329986+0000","last_unstale":"2024-02-19T21:55:35.430551+0000","last_undegraded":"2024-02-19T21:55:35.430551+0000","last_fullsized":"2024-02-19T21:55:35.430551+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:55.597334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:55.597334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"471'27","reported_seq":423,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.434763+0000","last_change":"2024-02-19T21:55:02.838918+0000","last_active":"2024-02-19T21:55:35.434763+0000","last_peered":"2024-02-19T21:55:35.434763+0000","last_clean":"2024-02-19T21:55:35.434763+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:55:35.434763+0000","last_undegraded":"2024-02-19T21:55:35.434763+0000","last_fullsized":"2024-02-19T21:55:35.434763+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'27","last_scrub_stamp":"2024-02-19T21:55:02.838850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:55:02.838850+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":36,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":390,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.436826+0000","last_change":"2024-02-19T21:54:03.580153+0000","last_active":"2024-02-19T21:55:35.436826+0000","last_peered":"2024-02-19T21:55:35.436826+0000","last_clean":"2024-02-19T21:55:35.436826+0000","last_became_active":"2024-02-19T21:51:22.461599+0000","last_became_peered":"2024-02-19T21:51:22.461599+0000","last_unstale":"2024-02-19T21:55:35.436826+0000","last_undegraded":"2024-02-19T21:55:35.436826+0000","last_fullsized":"2024-02-19T21:55:35.436826+0000","mapping_epoch":445,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":446,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:54:03.580085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:54:03.580085+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":528,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.431101+0000","last_change":"2024-02-19T21:54:20.347780+0000","last_active":"2024-02-19T21:55:35.431101+0000","last_peered":"2024-02-19T21:55:35.431101+0000","last_clean":"2024-02-19T21:55:35.431101+0000","last_became_active":"2024-02-19T21:49:54.491488+0000","last_became_peered":"2024-02-19T21:49:54.491488+0000","last_unstale":"2024-02-19T21:55:35.431101+0000","last_undegraded":"2024-02-19T21:55:35.431101+0000","last_fullsized":"2024-02-19T21:55:35.431101+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:20.347685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:54:20.347685+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"470'30","reported_seq":627,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.435327+0000","last_change":"2024-02-19T21:55:04.896812+0000","last_active":"2024-02-19T21:55:35.435327+0000","last_peered":"2024-02-19T21:55:35.435327+0000","last_clean":"2024-02-19T21:55:35.435327+0000","last_became_active":"2024-02-19T21:49:54.483748+0000","last_became_peered":"2024-02-19T21:49:54.483748+0000","last_unstale":"2024-02-19T21:55:35.435327+0000","last_undegraded":"2024-02-19T21:55:35.435327+0000","last_fullsized":"2024-02-19T21:55:35.435327+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'30","last_scrub_stamp":"2024-02-19T21:55:04.896705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:55:04.896705+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":447,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.434341+0000","last_change":"2024-02-19T21:55:00.074339+0000","last_active":"2024-02-19T21:55:35.434341+0000","last_peered":"2024-02-19T21:55:35.434341+0000","last_clean":"2024-02-19T21:55:35.434341+0000","last_became_active":"2024-02-19T21:49:08.327865+0000","last_became_peered":"2024-02-19T21:49:08.327865+0000","last_unstale":"2024-02-19T21:55:35.434341+0000","last_undegraded":"2024-02-19T21:55:35.434341+0000","last_fullsized":"2024-02-19T21:55:35.434341+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:00.074245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:55:00.074245+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":509,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.428502+0000","last_change":"2024-02-19T21:54:15.684329+0000","last_active":"2024-02-19T21:55:35.428502+0000","last_peered":"2024-02-19T21:55:35.428502+0000","last_clean":"2024-02-19T21:55:35.428502+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:55:35.428502+0000","last_undegraded":"2024-02-19T21:55:35.428502+0000","last_fullsized":"2024-02-19T21:55:35.428502+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:15.684224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:54:15.684224+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":543,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.443537+0000","last_change":"2024-02-19T21:53:54.630006+0000","last_active":"2024-02-19T21:55:35.443537+0000","last_peered":"2024-02-19T21:55:35.443537+0000","last_clean":"2024-02-19T21:55:35.443537+0000","last_became_active":"2024-02-19T21:49:08.330293+0000","last_became_peered":"2024-02-19T21:49:08.330293+0000","last_unstale":"2024-02-19T21:55:35.443537+0000","last_undegraded":"2024-02-19T21:55:35.443537+0000","last_fullsized":"2024-02-19T21:55:35.443537+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:54.629909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:54.629909+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"471'32","reported_seq":65,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.436437+0000","last_change":"2024-02-19T21:54:04.345127+0000","last_active":"2024-02-19T21:55:35.436437+0000","last_peered":"2024-02-19T21:55:35.436437+0000","last_clean":"2024-02-19T21:55:35.436437+0000","last_became_active":"2024-02-19T21:53:45.367870+0000","last_became_peered":"2024-02-19T21:53:45.367870+0000","last_unstale":"2024-02-19T21:55:35.436437+0000","last_undegraded":"2024-02-19T21:55:35.436437+0000","last_fullsized":"2024-02-19T21:55:35.436437+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'32","last_scrub_stamp":"2024-02-19T21:54:04.345011+0000","last_deep_scrub":"381'24","last_deep_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_clean_scrub_stamp":"2024-02-19T21:54:04.345011+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":17,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.437228+0000","last_change":"2024-02-19T21:55:24.057416+0000","last_active":"2024-02-19T21:55:35.437228+0000","last_peered":"2024-02-19T21:55:35.437228+0000","last_clean":"2024-02-19T21:55:35.437228+0000","last_became_active":"2024-02-19T21:55:24.057099+0000","last_became_peered":"2024-02-19T21:55:24.057099+0000","last_unstale":"2024-02-19T21:55:35.437228+0000","last_undegraded":"2024-02-19T21:55:35.437228+0000","last_fullsized":"2024-02-19T21:55:35.437228+0000","mapping_epoch":521,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":522,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:57.593320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:53:57.593320+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":563,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.430637+0000","last_change":"2024-02-19T21:55:03.717187+0000","last_active":"2024-02-19T21:55:35.430637+0000","last_peered":"2024-02-19T21:55:35.430637+0000","last_clean":"2024-02-19T21:55:35.430637+0000","last_became_active":"2024-02-19T21:49:54.494146+0000","last_became_peered":"2024-02-19T21:49:54.494146+0000","last_unstale":"2024-02-19T21:55:35.430637+0000","last_undegraded":"2024-02-19T21:55:35.430637+0000","last_fullsized":"2024-02-19T21:55:35.430637+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:03.717083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_clean_scrub_stamp":"2024-02-19T21:55:03.717083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":533,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.437420+0000","last_change":"2024-02-19T21:49:09.765641+0000","last_active":"2024-02-19T21:55:35.437420+0000","last_peered":"2024-02-19T21:55:35.437420+0000","last_clean":"2024-02-19T21:55:35.437420+0000","last_became_active":"2024-02-19T21:49:08.331308+0000","last_became_peered":"2024-02-19T21:49:08.331308+0000","last_unstale":"2024-02-19T21:55:35.437420+0000","last_undegraded":"2024-02-19T21:55:35.437420+0000","last_fullsized":"2024-02-19T21:55:35.437420+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.765568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.765568+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"470'12","reported_seq":62,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.436354+0000","last_change":"2024-02-19T21:55:00.544889+0000","last_active":"2024-02-19T21:55:35.436354+0000","last_peered":"2024-02-19T21:55:35.436354+0000","last_clean":"2024-02-19T21:55:35.436354+0000","last_became_active":"2024-02-19T21:53:45.368256+0000","last_became_peered":"2024-02-19T21:53:45.368256+0000","last_unstale":"2024-02-19T21:55:35.436354+0000","last_undegraded":"2024-02-19T21:55:35.436354+0000","last_fullsized":"2024-02-19T21:55:35.436354+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'12","last_scrub_stamp":"2024-02-19T21:55:00.544815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:55:00.544815+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":442,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.434630+0000","last_change":"2024-02-19T21:49:08.918163+0000","last_active":"2024-02-19T21:55:35.434630+0000","last_peered":"2024-02-19T21:55:35.434630+0000","last_clean":"2024-02-19T21:55:35.434630+0000","last_became_active":"2024-02-19T21:49:08.328416+0000","last_became_peered":"2024-02-19T21:49:08.328416+0000","last_unstale":"2024-02-19T21:55:35.434630+0000","last_undegraded":"2024-02-19T21:55:35.434630+0000","last_fullsized":"2024-02-19T21:55:35.434630+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:08.918083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:49:08.918083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":527,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.428033+0000","last_change":"2024-02-19T21:54:24.498621+0000","last_active":"2024-02-19T21:55:35.428033+0000","last_peered":"2024-02-19T21:55:35.428033+0000","last_clean":"2024-02-19T21:55:35.428033+0000","last_became_active":"2024-02-19T21:49:54.480368+0000","last_became_peered":"2024-02-19T21:49:54.480368+0000","last_unstale":"2024-02-19T21:55:35.428033+0000","last_undegraded":"2024-02-19T21:55:35.428033+0000","last_fullsized":"2024-02-19T21:55:35.428033+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:24.498521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:54:24.498521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":506,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.428240+0000","last_change":"2024-02-19T21:49:05.012463+0000","last_active":"2024-02-19T21:55:35.428240+0000","last_peered":"2024-02-19T21:55:35.428240+0000","last_clean":"2024-02-19T21:55:35.428240+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:55:35.428240+0000","last_undegraded":"2024-02-19T21:55:35.428240+0000","last_fullsized":"2024-02-19T21:55:35.428240+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.012395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.012395+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"470'27","reported_seq":570,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.425543+0000","last_change":"2024-02-19T21:55:02.539346+0000","last_active":"2024-02-19T21:55:35.425543+0000","last_peered":"2024-02-19T21:55:35.425543+0000","last_clean":"2024-02-19T21:55:35.425543+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:55:35.425543+0000","last_undegraded":"2024-02-19T21:55:35.425543+0000","last_fullsized":"2024-02-19T21:55:35.425543+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'27","last_scrub_stamp":"2024-02-19T21:55:02.539241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:55:02.539241+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":512,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.434169+0000","last_change":"2024-02-19T21:54:17.964240+0000","last_active":"2024-02-19T21:55:35.434169+0000","last_peered":"2024-02-19T21:55:35.434169+0000","last_clean":"2024-02-19T21:55:35.434169+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:55:35.434169+0000","last_undegraded":"2024-02-19T21:55:35.434169+0000","last_fullsized":"2024-02-19T21:55:35.434169+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:17.964139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:17.964139+0000","last_clean_scrub_stamp":"2024-02-19T21:54:17.964139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":56,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.436637+0000","last_change":"2024-02-19T21:55:10.537616+0000","last_active":"2024-02-19T21:55:35.436637+0000","last_peered":"2024-02-19T21:55:35.436637+0000","last_clean":"2024-02-19T21:55:35.436637+0000","last_became_active":"2024-02-19T21:53:45.369330+0000","last_became_peered":"2024-02-19T21:53:45.369330+0000","last_unstale":"2024-02-19T21:55:35.436637+0000","last_undegraded":"2024-02-19T21:55:35.436637+0000","last_fullsized":"2024-02-19T21:55:35.436637+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:10.537495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:55:10.537495+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":533,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.437933+0000","last_change":"2024-02-19T21:55:02.698892+0000","last_active":"2024-02-19T21:55:35.437933+0000","last_peered":"2024-02-19T21:55:35.437933+0000","last_clean":"2024-02-19T21:55:35.437933+0000","last_became_active":"2024-02-19T21:53:45.384501+0000","last_became_peered":"2024-02-19T21:53:45.384501+0000","last_unstale":"2024-02-19T21:55:35.437933+0000","last_undegraded":"2024-02-19T21:55:35.437933+0000","last_fullsized":"2024-02-19T21:55:35.437933+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:02.698800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:55:02.698800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"470'21","reported_seq":593,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.427946+0000","last_change":"2024-02-19T21:54:14.469579+0000","last_active":"2024-02-19T21:55:35.427946+0000","last_peered":"2024-02-19T21:55:35.427946+0000","last_clean":"2024-02-19T21:55:35.427946+0000","last_became_active":"2024-02-19T21:49:08.333872+0000","last_became_peered":"2024-02-19T21:49:08.333872+0000","last_unstale":"2024-02-19T21:55:35.427946+0000","last_undegraded":"2024-02-19T21:55:35.427946+0000","last_fullsized":"2024-02-19T21:55:35.427946+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'21","last_scrub_stamp":"2024-02-19T21:54:14.469490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:54:14.469490+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":492,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.425880+0000","last_change":"2024-02-19T21:54:08.470718+0000","last_active":"2024-02-19T21:55:35.425880+0000","last_peered":"2024-02-19T21:55:35.425880+0000","last_clean":"2024-02-19T21:55:35.425880+0000","last_became_active":"2024-02-19T21:49:08.329770+0000","last_became_peered":"2024-02-19T21:49:08.329770+0000","last_unstale":"2024-02-19T21:55:35.425880+0000","last_undegraded":"2024-02-19T21:55:35.425880+0000","last_fullsized":"2024-02-19T21:55:35.425880+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:08.470650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:54:08.470650+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"415'17","reported_seq":204,"reported_epoch":529,"state":"active+clean","last_fresh":"2024-02-19T21:55:41.656766+0000","last_change":"2024-02-19T21:53:56.588487+0000","last_active":"2024-02-19T21:55:41.656766+0000","last_peered":"2024-02-19T21:55:41.656766+0000","last_clean":"2024-02-19T21:55:41.656766+0000","last_became_active":"2024-02-19T21:49:54.486304+0000","last_became_peered":"2024-02-19T21:49:54.486304+0000","last_unstale":"2024-02-19T21:55:41.656766+0000","last_undegraded":"2024-02-19T21:55:41.656766+0000","last_fullsized":"2024-02-19T21:55:41.656766+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"415'17","last_scrub_stamp":"2024-02-19T21:53:56.588421+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:53:56.588421+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":543,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.434609+0000","last_change":"2024-02-19T21:54:01.110262+0000","last_active":"2024-02-19T21:55:35.434609+0000","last_peered":"2024-02-19T21:55:35.434609+0000","last_clean":"2024-02-19T21:55:35.434609+0000","last_became_active":"2024-02-19T21:53:45.371729+0000","last_became_peered":"2024-02-19T21:53:45.371729+0000","last_unstale":"2024-02-19T21:55:35.434609+0000","last_undegraded":"2024-02-19T21:55:35.434609+0000","last_fullsized":"2024-02-19T21:55:35.434609+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:01.110166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_clean_scrub_stamp":"2024-02-19T21:54:01.110166+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"470'25","reported_seq":584,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.431642+0000","last_change":"2024-02-19T21:54:59.161641+0000","last_active":"2024-02-19T21:55:35.431642+0000","last_peered":"2024-02-19T21:55:35.431642+0000","last_clean":"2024-02-19T21:55:35.431642+0000","last_became_active":"2024-02-19T21:53:45.384976+0000","last_became_peered":"2024-02-19T21:53:45.384976+0000","last_unstale":"2024-02-19T21:55:35.431642+0000","last_undegraded":"2024-02-19T21:55:35.431642+0000","last_fullsized":"2024-02-19T21:55:35.431642+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'25","last_scrub_stamp":"2024-02-19T21:54:59.161529+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:54:59.161529+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":251,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.435064+0000","last_change":"2024-02-19T21:54:21.953571+0000","last_active":"2024-02-19T21:55:35.435064+0000","last_peered":"2024-02-19T21:55:35.435064+0000","last_clean":"2024-02-19T21:55:35.435064+0000","last_became_active":"2024-02-19T21:49:54.484049+0000","last_became_peered":"2024-02-19T21:49:54.484049+0000","last_unstale":"2024-02-19T21:55:35.435064+0000","last_undegraded":"2024-02-19T21:55:35.435064+0000","last_fullsized":"2024-02-19T21:55:35.435064+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:21.953470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:54:21.953470+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":795,"reported_epoch":529,"state":"active+clean","last_fresh":"2024-02-19T21:55:41.509239+0000","last_change":"2024-02-19T21:55:05.379509+0000","last_active":"2024-02-19T21:55:41.509239+0000","last_peered":"2024-02-19T21:55:41.509239+0000","last_clean":"2024-02-19T21:55:41.509239+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:55:41.509239+0000","last_undegraded":"2024-02-19T21:55:41.509239+0000","last_fullsized":"2024-02-19T21:55:41.509239+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:55:05.379447+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:55:05.379447+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":548,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.437448+0000","last_change":"2024-02-19T21:55:12.286687+0000","last_active":"2024-02-19T21:55:35.437448+0000","last_peered":"2024-02-19T21:55:35.437448+0000","last_clean":"2024-02-19T21:55:35.437448+0000","last_became_active":"2024-02-19T21:53:45.384012+0000","last_became_peered":"2024-02-19T21:53:45.384012+0000","last_unstale":"2024-02-19T21:55:35.437448+0000","last_undegraded":"2024-02-19T21:55:35.437448+0000","last_fullsized":"2024-02-19T21:55:35.437448+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:12.286582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:55:12.286582+0000","last_clean_scrub_stamp":"2024-02-19T21:55:12.286582+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"470'35","reported_seq":63,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.436539+0000","last_change":"2024-02-19T21:53:54.498661+0000","last_active":"2024-02-19T21:55:35.436539+0000","last_peered":"2024-02-19T21:55:35.436539+0000","last_clean":"2024-02-19T21:55:35.436539+0000","last_became_active":"2024-02-19T21:53:45.367708+0000","last_became_peered":"2024-02-19T21:53:45.367708+0000","last_unstale":"2024-02-19T21:55:35.436539+0000","last_undegraded":"2024-02-19T21:55:35.436539+0000","last_fullsized":"2024-02-19T21:55:35.436539+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'35","last_scrub_stamp":"2024-02-19T21:53:54.498596+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:53:54.498596+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":509,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.436890+0000","last_change":"2024-02-19T21:54:11.667953+0000","last_active":"2024-02-19T21:55:35.436890+0000","last_peered":"2024-02-19T21:55:35.436890+0000","last_clean":"2024-02-19T21:55:35.436890+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:55:35.436890+0000","last_undegraded":"2024-02-19T21:55:35.436890+0000","last_fullsized":"2024-02-19T21:55:35.436890+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:11.667872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:11.667872+0000","last_clean_scrub_stamp":"2024-02-19T21:54:11.667872+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":514,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.440993+0000","last_change":"2024-02-19T21:53:56.583766+0000","last_active":"2024-02-19T21:55:35.440993+0000","last_peered":"2024-02-19T21:55:35.440993+0000","last_clean":"2024-02-19T21:55:35.440993+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:55:35.440993+0000","last_undegraded":"2024-02-19T21:55:35.440993+0000","last_fullsized":"2024-02-19T21:55:35.440993+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:56.583707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:56.583707+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"470'18","reported_seq":151,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.443002+0000","last_change":"2024-02-19T21:55:10.074274+0000","last_active":"2024-02-19T21:55:35.443002+0000","last_peered":"2024-02-19T21:55:35.443002+0000","last_clean":"2024-02-19T21:55:35.443002+0000","last_became_active":"2024-02-19T21:49:54.478094+0000","last_became_peered":"2024-02-19T21:49:54.478094+0000","last_unstale":"2024-02-19T21:55:35.443002+0000","last_undegraded":"2024-02-19T21:55:35.443002+0000","last_fullsized":"2024-02-19T21:55:35.443002+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'18","last_scrub_stamp":"2024-02-19T21:55:10.074185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:55:10.074185+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":23,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":161,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.426613+0000","last_change":"2024-02-19T21:54:18.393614+0000","last_active":"2024-02-19T21:55:35.426613+0000","last_peered":"2024-02-19T21:55:35.426613+0000","last_clean":"2024-02-19T21:55:35.426613+0000","last_became_active":"2024-02-19T21:49:08.332176+0000","last_became_peered":"2024-02-19T21:49:08.332176+0000","last_unstale":"2024-02-19T21:55:35.426613+0000","last_undegraded":"2024-02-19T21:55:35.426613+0000","last_fullsized":"2024-02-19T21:55:35.426613+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:18.393513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:18.393513+0000","last_clean_scrub_stamp":"2024-02-19T21:54:18.393513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":170,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.425139+0000","last_change":"2024-02-19T21:54:35.409241+0000","last_active":"2024-02-19T21:55:35.425139+0000","last_peered":"2024-02-19T21:55:35.425139+0000","last_clean":"2024-02-19T21:55:35.425139+0000","last_became_active":"2024-02-19T21:54:35.408935+0000","last_became_peered":"2024-02-19T21:54:35.408935+0000","last_unstale":"2024-02-19T21:55:35.425139+0000","last_undegraded":"2024-02-19T21:55:35.425139+0000","last_fullsized":"2024-02-19T21:55:35.425139+0000","mapping_epoch":507,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":508,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:53.263540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:53:53.263540+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"470'21","reported_seq":665,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.435184+0000","last_change":"2024-02-19T21:53:52.104355+0000","last_active":"2024-02-19T21:55:35.435184+0000","last_peered":"2024-02-19T21:55:35.435184+0000","last_clean":"2024-02-19T21:55:35.435184+0000","last_became_active":"2024-02-19T21:49:54.483578+0000","last_became_peered":"2024-02-19T21:49:54.483578+0000","last_unstale":"2024-02-19T21:55:35.435184+0000","last_undegraded":"2024-02-19T21:55:35.435184+0000","last_fullsized":"2024-02-19T21:55:35.435184+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'21","last_scrub_stamp":"2024-02-19T21:53:52.104285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:53:52.104285+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"529'8390","reported_seq":8435,"reported_epoch":529,"state":"active+clean","last_fresh":"2024-02-19T21:55:45.056938+0000","last_change":"2024-02-19T21:53:45.368993+0000","last_active":"2024-02-19T21:55:45.056938+0000","last_peered":"2024-02-19T21:55:45.056938+0000","last_clean":"2024-02-19T21:55:45.056938+0000","last_became_active":"2024-02-19T21:53:45.368696+0000","last_became_peered":"2024-02-19T21:53:45.368696+0000","last_unstale":"2024-02-19T21:55:45.056938+0000","last_undegraded":"2024-02-19T21:55:45.056938+0000","last_fullsized":"2024-02-19T21:55:45.056938+0000","mapping_epoch":492,"log_start":"502'2800","ondisk_log_start":"502'2800","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":5590,"ondisk_log_size":5590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":422969344,"num_objects":6454,"num_object_clones":0,"num_object_copies":19362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6454,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8390,"num_write_kb":475008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":51,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.436717+0000","last_change":"2024-02-19T21:54:10.520264+0000","last_active":"2024-02-19T21:55:35.436717+0000","last_peered":"2024-02-19T21:55:35.436717+0000","last_clean":"2024-02-19T21:55:35.436717+0000","last_became_active":"2024-02-19T21:53:45.368696+0000","last_became_peered":"2024-02-19T21:53:45.368696+0000","last_unstale":"2024-02-19T21:55:35.436717+0000","last_undegraded":"2024-02-19T21:55:35.436717+0000","last_fullsized":"2024-02-19T21:55:35.436717+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:10.520197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:54:10.520197+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"378'4","reported_seq":548,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.437167+0000","last_change":"2024-02-19T21:54:58.444948+0000","last_active":"2024-02-19T21:55:35.437167+0000","last_peered":"2024-02-19T21:55:35.437167+0000","last_clean":"2024-02-19T21:55:35.437167+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:55:35.437167+0000","last_undegraded":"2024-02-19T21:55:35.437167+0000","last_fullsized":"2024-02-19T21:55:35.437167+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"378'4","last_scrub_stamp":"2024-02-19T21:54:58.444848+0000","last_deep_scrub":"378'4","last_deep_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_clean_scrub_stamp":"2024-02-19T21:54:58.444848+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"470'29","reported_seq":409,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.425341+0000","last_change":"2024-02-19T21:55:24.459257+0000","last_active":"2024-02-19T21:55:35.425341+0000","last_peered":"2024-02-19T21:55:35.425341+0000","last_clean":"2024-02-19T21:55:35.425341+0000","last_became_active":"2024-02-19T21:47:46.252085+0000","last_became_peered":"2024-02-19T21:47:46.252085+0000","last_unstale":"2024-02-19T21:55:35.425341+0000","last_undegraded":"2024-02-19T21:55:35.425341+0000","last_fullsized":"2024-02-19T21:55:35.425341+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'23","last_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_deep_scrub":"200'23","last_deep_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_clean_scrub_stamp":"2024-02-19T21:48:22.519381+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":33,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6],"acting":[4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":166,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.425170+0000","last_change":"2024-02-19T21:55:22.791336+0000","last_active":"2024-02-19T21:55:35.425170+0000","last_peered":"2024-02-19T21:55:35.425170+0000","last_clean":"2024-02-19T21:55:35.425170+0000","last_became_active":"2024-02-19T21:49:08.328237+0000","last_became_peered":"2024-02-19T21:49:08.328237+0000","last_unstale":"2024-02-19T21:55:35.425170+0000","last_undegraded":"2024-02-19T21:55:35.425170+0000","last_fullsized":"2024-02-19T21:55:35.425170+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:22.791271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:55:22.791271+0000","last_clean_scrub_stamp":"2024-02-19T21:55:22.791271+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"529'8148","reported_seq":8199,"reported_epoch":529,"state":"active+clean","last_fresh":"2024-02-19T21:55:42.275448+0000","last_change":"2024-02-19T21:55:06.318413+0000","last_active":"2024-02-19T21:55:42.275448+0000","last_peered":"2024-02-19T21:55:42.275448+0000","last_clean":"2024-02-19T21:55:42.275448+0000","last_became_active":"2024-02-19T21:53:45.366507+0000","last_became_peered":"2024-02-19T21:53:45.366507+0000","last_unstale":"2024-02-19T21:55:42.275448+0000","last_undegraded":"2024-02-19T21:55:42.275448+0000","last_fullsized":"2024-02-19T21:55:42.275448+0000","mapping_epoch":492,"log_start":"502'2100","ondisk_log_start":"502'2100","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"518'6109","last_scrub_stamp":"2024-02-19T21:55:06.318324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:55:06.318324+0000","log_size":6048,"ondisk_log_size":6048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":439156760,"num_objects":6702,"num_object_clones":0,"num_object_copies":20106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6702,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":8148,"num_write_kb":475137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6],"acting":[2,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":570,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.434171+0000","last_change":"2024-02-19T21:54:03.090621+0000","last_active":"2024-02-19T21:55:35.434171+0000","last_peered":"2024-02-19T21:55:35.434171+0000","last_clean":"2024-02-19T21:55:35.434171+0000","last_became_active":"2024-02-19T21:53:45.372402+0000","last_became_peered":"2024-02-19T21:53:45.372402+0000","last_unstale":"2024-02-19T21:55:35.434171+0000","last_undegraded":"2024-02-19T21:55:35.434171+0000","last_fullsized":"2024-02-19T21:55:35.434171+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:03.090525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:03.090525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":504,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.426508+0000","last_change":"2024-02-19T21:48:37.789514+0000","last_active":"2024-02-19T21:55:35.426508+0000","last_peered":"2024-02-19T21:55:35.426508+0000","last_clean":"2024-02-19T21:55:35.426508+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:55:35.426508+0000","last_undegraded":"2024-02-19T21:55:35.426508+0000","last_fullsized":"2024-02-19T21:55:35.426508+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:37.789400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:37.789400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"470'30","reported_seq":430,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.427991+0000","last_change":"2024-02-19T21:55:08.637400+0000","last_active":"2024-02-19T21:55:35.427991+0000","last_peered":"2024-02-19T21:55:35.427991+0000","last_clean":"2024-02-19T21:55:35.427991+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:55:35.427991+0000","last_undegraded":"2024-02-19T21:55:35.427991+0000","last_fullsized":"2024-02-19T21:55:35.427991+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'30","last_scrub_stamp":"2024-02-19T21:55:08.637308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:55:08.637308+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":799,"reported_epoch":529,"state":"active+clean","last_fresh":"2024-02-19T21:55:41.658936+0000","last_change":"2024-02-19T21:55:22.711786+0000","last_active":"2024-02-19T21:55:41.658936+0000","last_peered":"2024-02-19T21:55:41.658936+0000","last_clean":"2024-02-19T21:55:41.658936+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:55:41.658936+0000","last_undegraded":"2024-02-19T21:55:41.658936+0000","last_fullsized":"2024-02-19T21:55:41.658936+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:49:01.011078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:49:01.011078+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"529'8105","reported_seq":8150,"reported_epoch":529,"state":"active+clean","last_fresh":"2024-02-19T21:55:45.293268+0000","last_change":"2024-02-19T21:53:45.371934+0000","last_active":"2024-02-19T21:55:45.293268+0000","last_peered":"2024-02-19T21:55:45.293268+0000","last_clean":"2024-02-19T21:55:45.293268+0000","last_became_active":"2024-02-19T21:53:45.371632+0000","last_became_peered":"2024-02-19T21:53:45.371632+0000","last_unstale":"2024-02-19T21:55:45.293268+0000","last_undegraded":"2024-02-19T21:55:45.293268+0000","last_fullsized":"2024-02-19T21:55:45.293268+0000","mapping_epoch":492,"log_start":"502'2929","ondisk_log_start":"502'2929","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":5176,"ondisk_log_size":5176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":418054144,"num_objects":6379,"num_object_clones":0,"num_object_copies":19137,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6379,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8105,"num_write_kb":463488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":458,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.442654+0000","last_change":"2024-02-19T21:55:09.610198+0000","last_active":"2024-02-19T21:55:35.442654+0000","last_peered":"2024-02-19T21:55:35.442654+0000","last_clean":"2024-02-19T21:55:35.442654+0000","last_became_active":"2024-02-19T21:44:56.149476+0000","last_became_peered":"2024-02-19T21:44:56.149476+0000","last_unstale":"2024-02-19T21:55:35.442654+0000","last_undegraded":"2024-02-19T21:55:35.442654+0000","last_fullsized":"2024-02-19T21:55:35.442654+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:09.610109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:55:09.610109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":518,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.437526+0000","last_change":"2024-02-19T21:54:19.347995+0000","last_active":"2024-02-19T21:55:35.437526+0000","last_peered":"2024-02-19T21:55:35.437526+0000","last_clean":"2024-02-19T21:55:35.437526+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:55:35.437526+0000","last_undegraded":"2024-02-19T21:55:35.437526+0000","last_fullsized":"2024-02-19T21:55:35.437526+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:19.347909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:54:19.347909+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"470'58","reported_seq":1008,"reported_epoch":529,"state":"active+clean","last_fresh":"2024-02-19T21:55:41.652572+0000","last_change":"2024-02-19T21:54:23.554440+0000","last_active":"2024-02-19T21:55:41.652572+0000","last_peered":"2024-02-19T21:55:41.652572+0000","last_clean":"2024-02-19T21:55:41.652572+0000","last_became_active":"2024-02-19T21:49:08.334527+0000","last_became_peered":"2024-02-19T21:49:08.334527+0000","last_unstale":"2024-02-19T21:55:41.652572+0000","last_undegraded":"2024-02-19T21:55:41.652572+0000","last_fullsized":"2024-02-19T21:55:41.652572+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'58","last_scrub_stamp":"2024-02-19T21:54:23.554337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:54:23.554337+0000","log_size":58,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":50,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":503,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.434624+0000","last_change":"2024-02-19T21:54:24.918144+0000","last_active":"2024-02-19T21:55:35.434624+0000","last_peered":"2024-02-19T21:55:35.434624+0000","last_clean":"2024-02-19T21:55:35.434624+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:55:35.434624+0000","last_undegraded":"2024-02-19T21:55:35.434624+0000","last_fullsized":"2024-02-19T21:55:35.434624+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:24.918045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:54:24.918045+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"529'8198","reported_seq":8248,"reported_epoch":529,"state":"active+clean","last_fresh":"2024-02-19T21:55:45.215979+0000","last_change":"2024-02-19T21:55:45.047127+0000","last_active":"2024-02-19T21:55:45.215979+0000","last_peered":"2024-02-19T21:55:45.215979+0000","last_clean":"2024-02-19T21:55:45.215979+0000","last_became_active":"2024-02-19T21:53:45.366773+0000","last_became_peered":"2024-02-19T21:53:45.366773+0000","last_unstale":"2024-02-19T21:55:45.215979+0000","last_undegraded":"2024-02-19T21:55:45.215979+0000","last_fullsized":"2024-02-19T21:55:45.215979+0000","mapping_epoch":492,"log_start":"504'3303","ondisk_log_start":"504'3303","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"529'8180","last_scrub_stamp":"2024-02-19T21:55:45.047016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:55:45.047016+0000","log_size":4895,"ondisk_log_size":4895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":410517504,"num_objects":6264,"num_object_clones":0,"num_object_copies":18792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6264,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8198,"num_write_kb":462784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":547,"reported_epoch":529,"state":"active+clean","last_fresh":"2024-02-19T21:55:43.853170+0000","last_change":"2024-02-19T21:55:43.853808+0000","last_active":"2024-02-19T21:55:43.853170+0000","last_peered":"2024-02-19T21:55:43.853170+0000","last_clean":"2024-02-19T21:55:43.853170+0000","last_became_active":"2024-02-19T21:53:45.368343+0000","last_became_peered":"2024-02-19T21:53:45.368343+0000","last_unstale":"2024-02-19T21:55:43.853170+0000","last_undegraded":"2024-02-19T21:55:43.853170+0000","last_fullsized":"2024-02-19T21:55:43.853170+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:09.227355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:49:09.227355+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'6","reported_seq":2032,"reported_epoch":529,"state":"active+clean","last_fresh":"2024-02-19T21:55:43.666895+0000","last_change":"2024-02-19T21:53:56.369658+0000","last_active":"2024-02-19T21:55:43.666895+0000","last_peered":"2024-02-19T21:55:43.666895+0000","last_clean":"2024-02-19T21:55:43.666895+0000","last_became_active":"2024-02-19T21:49:08.331108+0000","last_became_peered":"2024-02-19T21:49:08.331108+0000","last_unstale":"2024-02-19T21:55:43.666895+0000","last_undegraded":"2024-02-19T21:55:43.666895+0000","last_fullsized":"2024-02-19T21:55:43.666895+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-02-19T21:53:56.369590+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_clean_scrub_stamp":"2024-02-19T21:53:56.369590+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1380,"num_read_kb":1375,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":161,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.425279+0000","last_change":"2024-02-19T21:54:07.330521+0000","last_active":"2024-02-19T21:55:35.425279+0000","last_peered":"2024-02-19T21:55:35.425279+0000","last_clean":"2024-02-19T21:55:35.425279+0000","last_became_active":"2024-02-19T21:49:08.329378+0000","last_became_peered":"2024-02-19T21:49:08.329378+0000","last_unstale":"2024-02-19T21:55:35.425279+0000","last_undegraded":"2024-02-19T21:55:35.425279+0000","last_fullsized":"2024-02-19T21:55:35.425279+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:07.330454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:07.330454+0000","last_clean_scrub_stamp":"2024-02-19T21:54:07.330454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"470'21","reported_seq":567,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.426890+0000","last_change":"2024-02-19T21:48:14.878933+0000","last_active":"2024-02-19T21:55:35.426890+0000","last_peered":"2024-02-19T21:55:35.426890+0000","last_clean":"2024-02-19T21:55:35.426890+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:55:35.426890+0000","last_undegraded":"2024-02-19T21:55:35.426890+0000","last_fullsized":"2024-02-19T21:55:35.426890+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'17","last_scrub_stamp":"2024-02-19T21:48:14.878857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.878857+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":31,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":166,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.425973+0000","last_change":"2024-02-19T21:55:09.965755+0000","last_active":"2024-02-19T21:55:35.425973+0000","last_peered":"2024-02-19T21:55:35.425973+0000","last_clean":"2024-02-19T21:55:35.425973+0000","last_became_active":"2024-02-19T21:49:08.325127+0000","last_became_peered":"2024-02-19T21:49:08.325127+0000","last_unstale":"2024-02-19T21:55:35.425973+0000","last_undegraded":"2024-02-19T21:55:35.425973+0000","last_fullsized":"2024-02-19T21:55:35.425973+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:09.965645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:55:09.965645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"529'10562","reported_seq":10614,"reported_epoch":529,"state":"active+clean","last_fresh":"2024-02-19T21:55:45.350775+0000","last_change":"2024-02-19T21:55:44.512181+0000","last_active":"2024-02-19T21:55:45.350775+0000","last_peered":"2024-02-19T21:55:45.350775+0000","last_clean":"2024-02-19T21:55:45.350775+0000","last_became_active":"2024-02-19T21:53:45.369947+0000","last_became_peered":"2024-02-19T21:53:45.369947+0000","last_unstale":"2024-02-19T21:55:45.350775+0000","last_undegraded":"2024-02-19T21:55:45.350775+0000","last_fullsized":"2024-02-19T21:55:45.350775+0000","mapping_epoch":492,"log_start":"498'500","ondisk_log_start":"498'500","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":10062,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":428343296,"num_objects":6536,"num_object_clones":0,"num_object_copies":19608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6536,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8304,"num_write_kb":474880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":544,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.439841+0000","last_change":"2024-02-19T21:54:05.543474+0000","last_active":"2024-02-19T21:55:35.439841+0000","last_peered":"2024-02-19T21:55:35.439841+0000","last_clean":"2024-02-19T21:55:35.439841+0000","last_became_active":"2024-02-19T21:53:45.385423+0000","last_became_peered":"2024-02-19T21:53:45.385423+0000","last_unstale":"2024-02-19T21:55:35.439841+0000","last_undegraded":"2024-02-19T21:55:35.439841+0000","last_fullsized":"2024-02-19T21:55:35.439841+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:05.543362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_clean_scrub_stamp":"2024-02-19T21:54:05.543362+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":413,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.437720+0000","last_change":"2024-02-19T21:55:15.374524+0000","last_active":"2024-02-19T21:55:35.437720+0000","last_peered":"2024-02-19T21:55:35.437720+0000","last_clean":"2024-02-19T21:55:35.437720+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:55:35.437720+0000","last_undegraded":"2024-02-19T21:55:35.437720+0000","last_fullsized":"2024-02-19T21:55:35.437720+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:15.374461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:55:15.374461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":574,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.431315+0000","last_change":"2024-02-19T21:54:52.479718+0000","last_active":"2024-02-19T21:55:35.431315+0000","last_peered":"2024-02-19T21:55:35.431315+0000","last_clean":"2024-02-19T21:55:35.431315+0000","last_became_active":"2024-02-19T21:54:52.479416+0000","last_became_peered":"2024-02-19T21:54:52.479416+0000","last_unstale":"2024-02-19T21:55:35.431315+0000","last_undegraded":"2024-02-19T21:55:35.431315+0000","last_fullsized":"2024-02-19T21:55:35.431315+0000","mapping_epoch":513,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":514,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:58.410478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:58.410478+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":130,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.428112+0000","last_change":"2024-02-19T21:53:51.510006+0000","last_active":"2024-02-19T21:55:35.428112+0000","last_peered":"2024-02-19T21:55:35.428112+0000","last_clean":"2024-02-19T21:55:35.428112+0000","last_became_active":"2024-02-19T21:49:54.483637+0000","last_became_peered":"2024-02-19T21:49:54.483637+0000","last_unstale":"2024-02-19T21:55:35.428112+0000","last_undegraded":"2024-02-19T21:55:35.428112+0000","last_fullsized":"2024-02-19T21:55:35.428112+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:51.509926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:53:51.509926+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"470'45","reported_seq":575,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.442571+0000","last_change":"2024-02-19T21:53:59.548929+0000","last_active":"2024-02-19T21:55:35.442571+0000","last_peered":"2024-02-19T21:55:35.442571+0000","last_clean":"2024-02-19T21:55:35.442571+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:55:35.442571+0000","last_undegraded":"2024-02-19T21:55:35.442571+0000","last_fullsized":"2024-02-19T21:55:35.442571+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'45","last_scrub_stamp":"2024-02-19T21:53:59.548843+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:53:59.548843+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":51,"num_write":37,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":130,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.437070+0000","last_change":"2024-02-19T21:53:55.571648+0000","last_active":"2024-02-19T21:55:35.437070+0000","last_peered":"2024-02-19T21:55:35.437070+0000","last_clean":"2024-02-19T21:55:35.437070+0000","last_became_active":"2024-02-19T21:49:54.477947+0000","last_became_peered":"2024-02-19T21:49:54.477947+0000","last_unstale":"2024-02-19T21:55:35.437070+0000","last_undegraded":"2024-02-19T21:55:35.437070+0000","last_fullsized":"2024-02-19T21:55:35.437070+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:55.571582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:53:55.571582+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"529'8082","reported_seq":8132,"reported_epoch":529,"state":"active+clean","last_fresh":"2024-02-19T21:55:45.229542+0000","last_change":"2024-02-19T21:55:15.103651+0000","last_active":"2024-02-19T21:55:45.229542+0000","last_peered":"2024-02-19T21:55:45.229542+0000","last_clean":"2024-02-19T21:55:45.229542+0000","last_became_active":"2024-02-19T21:53:45.367151+0000","last_became_peered":"2024-02-19T21:53:45.367151+0000","last_unstale":"2024-02-19T21:55:45.229542+0000","last_undegraded":"2024-02-19T21:55:45.229542+0000","last_fullsized":"2024-02-19T21:55:45.229542+0000","mapping_epoch":492,"log_start":"504'3200","ondisk_log_start":"504'3200","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"519'6500","last_scrub_stamp":"2024-02-19T21:55:15.103545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:55:15.103545+0000","log_size":4882,"ondisk_log_size":4882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":413532160,"num_objects":6310,"num_object_clones":0,"num_object_copies":18930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6310,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8082,"num_write_kb":460544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1],"acting":[6,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":509,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.426775+0000","last_change":"2024-02-19T21:55:06.665581+0000","last_active":"2024-02-19T21:55:35.426775+0000","last_peered":"2024-02-19T21:55:35.426775+0000","last_clean":"2024-02-19T21:55:35.426775+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:55:35.426775+0000","last_undegraded":"2024-02-19T21:55:35.426775+0000","last_fullsized":"2024-02-19T21:55:35.426775+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:06.665516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:55:06.665516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":516,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.434536+0000","last_change":"2024-02-19T21:54:08.084019+0000","last_active":"2024-02-19T21:55:35.434536+0000","last_peered":"2024-02-19T21:55:35.434536+0000","last_clean":"2024-02-19T21:55:35.434536+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:55:35.434536+0000","last_undegraded":"2024-02-19T21:55:35.434536+0000","last_fullsized":"2024-02-19T21:55:35.434536+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:08.083923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:54:08.083923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":535,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.428325+0000","last_change":"2024-02-19T21:54:17.718006+0000","last_active":"2024-02-19T21:55:35.428325+0000","last_peered":"2024-02-19T21:55:35.428325+0000","last_clean":"2024-02-19T21:55:35.428325+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:55:35.428325+0000","last_undegraded":"2024-02-19T21:55:35.428325+0000","last_fullsized":"2024-02-19T21:55:35.428325+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:17.717904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:54:17.717904+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"470'42","reported_seq":678,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.435123+0000","last_change":"2024-02-19T21:54:18.926423+0000","last_active":"2024-02-19T21:55:35.435123+0000","last_peered":"2024-02-19T21:55:35.435123+0000","last_clean":"2024-02-19T21:55:35.435123+0000","last_became_active":"2024-02-19T21:49:08.329761+0000","last_became_peered":"2024-02-19T21:49:08.329761+0000","last_unstale":"2024-02-19T21:55:35.435123+0000","last_undegraded":"2024-02-19T21:55:35.435123+0000","last_fullsized":"2024-02-19T21:55:35.435123+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'42","last_scrub_stamp":"2024-02-19T21:54:18.926260+0000","last_deep_scrub":"324'30","last_deep_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_clean_scrub_stamp":"2024-02-19T21:54:18.926260+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":48,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":519,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.439774+0000","last_change":"2024-02-19T21:53:53.417715+0000","last_active":"2024-02-19T21:55:35.439774+0000","last_peered":"2024-02-19T21:55:35.439774+0000","last_clean":"2024-02-19T21:55:35.439774+0000","last_became_active":"2024-02-19T21:44:42.624782+0000","last_became_peered":"2024-02-19T21:44:42.624782+0000","last_unstale":"2024-02-19T21:55:35.439774+0000","last_undegraded":"2024-02-19T21:55:35.439774+0000","last_fullsized":"2024-02-19T21:55:35.439774+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":295,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:53.417639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_clean_scrub_stamp":"2024-02-19T21:53:53.417639+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.c","version":"529'8255","reported_seq":8300,"reported_epoch":529,"state":"active+clean","last_fresh":"2024-02-19T21:55:45.325049+0000","last_change":"2024-02-19T21:53:45.366888+0000","last_active":"2024-02-19T21:55:45.325049+0000","last_peered":"2024-02-19T21:55:45.325049+0000","last_clean":"2024-02-19T21:55:45.325049+0000","last_became_active":"2024-02-19T21:53:45.366605+0000","last_became_peered":"2024-02-19T21:53:45.366605+0000","last_unstale":"2024-02-19T21:55:45.325049+0000","last_undegraded":"2024-02-19T21:55:45.325049+0000","last_fullsized":"2024-02-19T21:55:45.325049+0000","mapping_epoch":492,"log_start":"502'3132","ondisk_log_start":"502'3132","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":5123,"ondisk_log_size":5123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":420937728,"num_objects":6423,"num_object_clones":0,"num_object_copies":19269,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6423,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8255,"num_write_kb":469696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":540,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.426761+0000","last_change":"2024-02-19T21:53:59.350715+0000","last_active":"2024-02-19T21:55:35.426761+0000","last_peered":"2024-02-19T21:55:35.426761+0000","last_clean":"2024-02-19T21:55:35.426761+0000","last_became_active":"2024-02-19T21:49:08.330648+0000","last_became_peered":"2024-02-19T21:49:08.330648+0000","last_unstale":"2024-02-19T21:55:35.426761+0000","last_undegraded":"2024-02-19T21:55:35.426761+0000","last_fullsized":"2024-02-19T21:55:35.426761+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:59.350627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:53:59.350627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.437313+0000","last_change":"2024-02-19T21:54:59.095681+0000","last_active":"2024-02-19T21:55:35.437313+0000","last_peered":"2024-02-19T21:55:35.437313+0000","last_clean":"2024-02-19T21:55:35.437313+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:55:35.437313+0000","last_undegraded":"2024-02-19T21:55:35.437313+0000","last_fullsized":"2024-02-19T21:55:35.437313+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:59.095573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:45.017696+0000","last_clean_scrub_stamp":"2024-02-19T21:54:59.095573+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"470'47","reported_seq":579,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.434484+0000","last_change":"2024-02-19T21:53:58.140432+0000","last_active":"2024-02-19T21:55:35.434484+0000","last_peered":"2024-02-19T21:55:35.434484+0000","last_clean":"2024-02-19T21:55:35.434484+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:55:35.434484+0000","last_undegraded":"2024-02-19T21:55:35.434484+0000","last_fullsized":"2024-02-19T21:55:35.434484+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'47","last_scrub_stamp":"2024-02-19T21:53:58.140324+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:53:58.140324+0000","log_size":47,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":55,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":508,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.448332+0000","last_change":"2024-02-19T21:54:02.567491+0000","last_active":"2024-02-19T21:55:35.448332+0000","last_peered":"2024-02-19T21:55:35.448332+0000","last_clean":"2024-02-19T21:55:35.448332+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:55:35.448332+0000","last_undegraded":"2024-02-19T21:55:35.448332+0000","last_fullsized":"2024-02-19T21:55:35.448332+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:02.567400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:54:02.567400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"529'8299","reported_seq":8344,"reported_epoch":529,"state":"active+clean","last_fresh":"2024-02-19T21:55:44.902399+0000","last_change":"2024-02-19T21:53:45.370394+0000","last_active":"2024-02-19T21:55:44.902399+0000","last_peered":"2024-02-19T21:55:44.902399+0000","last_clean":"2024-02-19T21:55:44.902399+0000","last_became_active":"2024-02-19T21:53:45.370069+0000","last_became_peered":"2024-02-19T21:53:45.370069+0000","last_unstale":"2024-02-19T21:55:44.902399+0000","last_undegraded":"2024-02-19T21:55:44.902399+0000","last_fullsized":"2024-02-19T21:55:44.902399+0000","mapping_epoch":492,"log_start":"504'3300","ondisk_log_start":"504'3300","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":4999,"ondisk_log_size":4999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":426967040,"num_objects":6515,"num_object_clones":0,"num_object_copies":19545,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6515,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8299,"num_write_kb":474048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":253,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.425467+0000","last_change":"2024-02-19T21:54:04.297489+0000","last_active":"2024-02-19T21:55:35.425467+0000","last_peered":"2024-02-19T21:55:35.425467+0000","last_clean":"2024-02-19T21:55:35.425467+0000","last_became_active":"2024-02-19T21:49:08.326106+0000","last_became_peered":"2024-02-19T21:49:08.326106+0000","last_unstale":"2024-02-19T21:55:35.425467+0000","last_undegraded":"2024-02-19T21:55:35.425467+0000","last_fullsized":"2024-02-19T21:55:35.425467+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:04.297389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:04.297389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":508,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.427373+0000","last_change":"2024-02-19T21:48:11.879787+0000","last_active":"2024-02-19T21:55:35.427373+0000","last_peered":"2024-02-19T21:55:35.427373+0000","last_clean":"2024-02-19T21:55:35.427373+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:55:35.427373+0000","last_undegraded":"2024-02-19T21:55:35.427373+0000","last_fullsized":"2024-02-19T21:55:35.427373+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.879687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.879687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"470'50","reported_seq":166,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.428420+0000","last_change":"2024-02-19T21:55:18.969631+0000","last_active":"2024-02-19T21:55:35.428420+0000","last_peered":"2024-02-19T21:55:35.428420+0000","last_clean":"2024-02-19T21:55:35.428420+0000","last_became_active":"2024-02-19T21:49:54.480413+0000","last_became_peered":"2024-02-19T21:49:54.480413+0000","last_unstale":"2024-02-19T21:55:35.428420+0000","last_undegraded":"2024-02-19T21:55:35.428420+0000","last_fullsized":"2024-02-19T21:55:35.428420+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":415,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'50","last_scrub_stamp":"2024-02-19T21:55:18.969539+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:55:18.969539+0000","log_size":50,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":57,"num_write":44,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":404,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.441189+0000","last_change":"2024-02-19T21:54:58.727836+0000","last_active":"2024-02-19T21:55:35.441189+0000","last_peered":"2024-02-19T21:55:35.441189+0000","last_clean":"2024-02-19T21:55:35.441189+0000","last_became_active":"2024-02-19T21:49:54.494802+0000","last_became_peered":"2024-02-19T21:49:54.494802+0000","last_unstale":"2024-02-19T21:55:35.441189+0000","last_undegraded":"2024-02-19T21:55:35.441189+0000","last_fullsized":"2024-02-19T21:55:35.441189+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:58.727756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:54:58.727756+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"529'8357","reported_seq":8402,"reported_epoch":529,"state":"active+clean","last_fresh":"2024-02-19T21:55:45.308014+0000","last_change":"2024-02-19T21:53:45.386994+0000","last_active":"2024-02-19T21:55:45.308014+0000","last_peered":"2024-02-19T21:55:45.308014+0000","last_clean":"2024-02-19T21:55:45.308014+0000","last_became_active":"2024-02-19T21:53:45.386670+0000","last_became_peered":"2024-02-19T21:53:45.386670+0000","last_unstale":"2024-02-19T21:55:45.308014+0000","last_undegraded":"2024-02-19T21:55:45.308014+0000","last_fullsized":"2024-02-19T21:55:45.308014+0000","mapping_epoch":492,"log_start":"502'2800","ondisk_log_start":"502'2800","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":5557,"ondisk_log_size":5557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":427098112,"num_objects":6517,"num_object_clones":0,"num_object_copies":19551,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6517,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8357,"num_write_kb":475968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7],"acting":[4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":540,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.437454+0000","last_change":"2024-02-19T21:54:01.641103+0000","last_active":"2024-02-19T21:55:35.437454+0000","last_peered":"2024-02-19T21:55:35.437454+0000","last_clean":"2024-02-19T21:55:35.437454+0000","last_became_active":"2024-02-19T21:49:08.328529+0000","last_became_peered":"2024-02-19T21:49:08.328529+0000","last_unstale":"2024-02-19T21:55:35.437454+0000","last_undegraded":"2024-02-19T21:55:35.437454+0000","last_fullsized":"2024-02-19T21:55:35.437454+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:01.641007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:01.641007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":571,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.443605+0000","last_change":"2024-02-19T21:53:52.715548+0000","last_active":"2024-02-19T21:55:35.443605+0000","last_peered":"2024-02-19T21:55:35.443605+0000","last_clean":"2024-02-19T21:55:35.443605+0000","last_became_active":"2024-02-19T21:49:54.493041+0000","last_became_peered":"2024-02-19T21:49:54.493041+0000","last_unstale":"2024-02-19T21:55:35.443605+0000","last_undegraded":"2024-02-19T21:55:35.443605+0000","last_fullsized":"2024-02-19T21:55:35.443605+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:52.715486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:52.715486+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"470'42","reported_seq":401,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.425253+0000","last_change":"2024-02-19T21:54:01.223459+0000","last_active":"2024-02-19T21:55:35.425253+0000","last_peered":"2024-02-19T21:55:35.425253+0000","last_clean":"2024-02-19T21:55:35.425253+0000","last_became_active":"2024-02-19T21:49:08.330477+0000","last_became_peered":"2024-02-19T21:49:08.330477+0000","last_unstale":"2024-02-19T21:55:35.425253+0000","last_undegraded":"2024-02-19T21:55:35.425253+0000","last_fullsized":"2024-02-19T21:55:35.425253+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'42","last_scrub_stamp":"2024-02-19T21:54:01.223355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:54:01.223355+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":649,"reported_epoch":529,"state":"active+clean","last_fresh":"2024-02-19T21:55:41.652418+0000","last_change":"2024-02-19T21:55:03.593029+0000","last_active":"2024-02-19T21:55:41.652418+0000","last_peered":"2024-02-19T21:55:41.652418+0000","last_clean":"2024-02-19T21:55:41.652418+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:55:41.652418+0000","last_undegraded":"2024-02-19T21:55:41.652418+0000","last_fullsized":"2024-02-19T21:55:41.652418+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'9","last_scrub_stamp":"2024-02-19T21:55:03.592953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:55:03.592953+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"529'8266","reported_seq":8311,"reported_epoch":529,"state":"active+clean","last_fresh":"2024-02-19T21:55:45.250756+0000","last_change":"2024-02-19T21:53:45.367451+0000","last_active":"2024-02-19T21:55:45.250756+0000","last_peered":"2024-02-19T21:55:45.250756+0000","last_clean":"2024-02-19T21:55:45.250756+0000","last_became_active":"2024-02-19T21:53:45.366735+0000","last_became_peered":"2024-02-19T21:53:45.366735+0000","last_unstale":"2024-02-19T21:55:45.250756+0000","last_undegraded":"2024-02-19T21:55:45.250756+0000","last_fullsized":"2024-02-19T21:55:45.250756+0000","mapping_epoch":492,"log_start":"504'3400","ondisk_log_start":"504'3400","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":4866,"ondisk_log_size":4866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":420216832,"num_objects":6412,"num_object_clones":0,"num_object_copies":19236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6412,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8266,"num_write_kb":469696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"66'1","reported_seq":422,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.438139+0000","last_change":"2024-02-19T21:54:23.697006+0000","last_active":"2024-02-19T21:55:35.438139+0000","last_peered":"2024-02-19T21:55:35.438139+0000","last_clean":"2024-02-19T21:55:35.438139+0000","last_became_active":"2024-02-19T21:44:56.166670+0000","last_became_peered":"2024-02-19T21:44:56.166670+0000","last_unstale":"2024-02-19T21:55:35.438139+0000","last_undegraded":"2024-02-19T21:55:35.438139+0000","last_fullsized":"2024-02-19T21:55:35.438139+0000","mapping_epoch":165,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:54:23.696937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:54:23.696937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"261'11","reported_seq":659,"reported_epoch":529,"state":"active+clean","last_fresh":"2024-02-19T21:55:41.509452+0000","last_change":"2024-02-19T21:53:55.479779+0000","last_active":"2024-02-19T21:55:41.509452+0000","last_peered":"2024-02-19T21:55:41.509452+0000","last_clean":"2024-02-19T21:55:41.509452+0000","last_became_active":"2024-02-19T21:44:08.123392+0000","last_became_peered":"2024-02-19T21:44:08.123392+0000","last_unstale":"2024-02-19T21:55:41.509452+0000","last_undegraded":"2024-02-19T21:55:41.509452+0000","last_fullsized":"2024-02-19T21:55:41.509452+0000","mapping_epoch":62,"log_start":"257'10","ondisk_log_start":"257'10","created":62,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-02-19T21:53:55.479699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:53:55.479699+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":522,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.428416+0000","last_change":"2024-02-19T21:54:16.707968+0000","last_active":"2024-02-19T21:55:35.428416+0000","last_peered":"2024-02-19T21:55:35.428416+0000","last_clean":"2024-02-19T21:55:35.428416+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:55:35.428416+0000","last_undegraded":"2024-02-19T21:55:35.428416+0000","last_fullsized":"2024-02-19T21:55:35.428416+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:54:16.707865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:54:16.707865+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"470'27","reported_seq":387,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.442362+0000","last_change":"2024-02-19T21:48:34.485865+0000","last_active":"2024-02-19T21:55:35.442362+0000","last_peered":"2024-02-19T21:55:35.442362+0000","last_clean":"2024-02-19T21:55:35.442362+0000","last_became_active":"2024-02-19T21:47:46.251550+0000","last_became_peered":"2024-02-19T21:47:46.251550+0000","last_unstale":"2024-02-19T21:55:35.442362+0000","last_undegraded":"2024-02-19T21:55:35.442362+0000","last_fullsized":"2024-02-19T21:55:35.442362+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'19","last_scrub_stamp":"2024-02-19T21:48:34.485787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:34.485787+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7],"acting":[4,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.0","version":"529'8253","reported_seq":8297,"reported_epoch":529,"state":"active+clean","last_fresh":"2024-02-19T21:55:45.326745+0000","last_change":"2024-02-19T21:53:45.376702+0000","last_active":"2024-02-19T21:55:45.326745+0000","last_peered":"2024-02-19T21:55:45.326745+0000","last_clean":"2024-02-19T21:55:45.326745+0000","last_became_active":"2024-02-19T21:53:45.376392+0000","last_became_peered":"2024-02-19T21:53:45.376392+0000","last_unstale":"2024-02-19T21:55:45.326745+0000","last_undegraded":"2024-02-19T21:55:45.326745+0000","last_fullsized":"2024-02-19T21:55:45.326745+0000","mapping_epoch":492,"log_start":"502'3151","ondisk_log_start":"502'3151","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":5102,"ondisk_log_size":5102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":422117376,"num_objects":6441,"num_object_clones":0,"num_object_copies":19323,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6441,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8253,"num_write_kb":470208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,6],"acting":[1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":528,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.431790+0000","last_change":"2024-02-19T21:54:06.529408+0000","last_active":"2024-02-19T21:55:35.431790+0000","last_peered":"2024-02-19T21:55:35.431790+0000","last_clean":"2024-02-19T21:55:35.431790+0000","last_became_active":"2024-02-19T21:44:56.155194+0000","last_became_peered":"2024-02-19T21:44:56.155194+0000","last_unstale":"2024-02-19T21:55:35.431790+0000","last_undegraded":"2024-02-19T21:55:35.431790+0000","last_fullsized":"2024-02-19T21:55:35.431790+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:06.529311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:06.529311+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"363'12","reported_seq":367,"reported_epoch":529,"state":"active+clean","last_fresh":"2024-02-19T21:55:41.693281+0000","last_change":"2024-02-19T21:48:25.487689+0000","last_active":"2024-02-19T21:55:41.693281+0000","last_peered":"2024-02-19T21:55:41.693281+0000","last_clean":"2024-02-19T21:55:41.693281+0000","last_became_active":"2024-02-19T21:47:46.260099+0000","last_became_peered":"2024-02-19T21:47:46.260099+0000","last_unstale":"2024-02-19T21:55:41.693281+0000","last_undegraded":"2024-02-19T21:55:41.693281+0000","last_fullsized":"2024-02-19T21:55:41.693281+0000","mapping_epoch":362,"log_start":"98'9","ondisk_log_start":"98'9","created":62,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"363'12","last_scrub_stamp":"2024-02-19T21:48:25.487608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:48:25.487608+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":542,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.426679+0000","last_change":"2024-02-19T21:55:02.556526+0000","last_active":"2024-02-19T21:55:35.426679+0000","last_peered":"2024-02-19T21:55:35.426679+0000","last_clean":"2024-02-19T21:55:35.426679+0000","last_became_active":"2024-02-19T21:53:45.382885+0000","last_became_peered":"2024-02-19T21:53:45.382885+0000","last_unstale":"2024-02-19T21:55:35.426679+0000","last_undegraded":"2024-02-19T21:55:35.426679+0000","last_fullsized":"2024-02-19T21:55:35.426679+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:02.556431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:55:02.556431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"471'46","reported_seq":495,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.439487+0000","last_change":"2024-02-19T21:54:24.358037+0000","last_active":"2024-02-19T21:55:35.439487+0000","last_peered":"2024-02-19T21:55:35.439487+0000","last_clean":"2024-02-19T21:55:35.439487+0000","last_became_active":"2024-02-19T21:53:45.384528+0000","last_became_peered":"2024-02-19T21:53:45.384528+0000","last_unstale":"2024-02-19T21:55:35.439487+0000","last_undegraded":"2024-02-19T21:55:35.439487+0000","last_fullsized":"2024-02-19T21:55:35.439487+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'46","last_scrub_stamp":"2024-02-19T21:54:24.357931+0000","last_deep_scrub":"270'34","last_deep_scrub_stamp":"2024-02-19T21:44:17.451151+0000","last_clean_scrub_stamp":"2024-02-19T21:54:24.357931+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"529'8471","reported_seq":8516,"reported_epoch":529,"state":"active+clean","last_fresh":"2024-02-19T21:55:45.228790+0000","last_change":"2024-02-19T21:53:45.368346+0000","last_active":"2024-02-19T21:55:45.228790+0000","last_peered":"2024-02-19T21:55:45.228790+0000","last_clean":"2024-02-19T21:55:45.228790+0000","last_became_active":"2024-02-19T21:53:45.368025+0000","last_became_peered":"2024-02-19T21:53:45.368025+0000","last_unstale":"2024-02-19T21:55:45.228790+0000","last_undegraded":"2024-02-19T21:55:45.228790+0000","last_fullsized":"2024-02-19T21:55:45.228790+0000","mapping_epoch":492,"log_start":"504'3571","ondisk_log_start":"504'3571","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":4900,"ondisk_log_size":4900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":430112768,"num_objects":6563,"num_object_clones":0,"num_object_copies":19689,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6563,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8471,"num_write_kb":481088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1],"acting":[6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":511,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.442581+0000","last_change":"2024-02-19T21:53:55.275891+0000","last_active":"2024-02-19T21:55:35.442581+0000","last_peered":"2024-02-19T21:55:35.442581+0000","last_clean":"2024-02-19T21:55:35.442581+0000","last_became_active":"2024-02-19T21:49:08.328697+0000","last_became_peered":"2024-02-19T21:49:08.328697+0000","last_unstale":"2024-02-19T21:55:35.442581+0000","last_undegraded":"2024-02-19T21:55:35.442581+0000","last_fullsized":"2024-02-19T21:55:35.442581+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:55.275772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:53:55.275772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"397'17","reported_seq":500,"reported_epoch":529,"state":"active+clean","last_fresh":"2024-02-19T21:55:41.511455+0000","last_change":"2024-02-19T21:54:12.298455+0000","last_active":"2024-02-19T21:55:41.511455+0000","last_peered":"2024-02-19T21:55:41.511455+0000","last_clean":"2024-02-19T21:55:41.511455+0000","last_became_active":"2024-02-19T21:49:08.325034+0000","last_became_peered":"2024-02-19T21:49:08.325034+0000","last_unstale":"2024-02-19T21:55:41.511455+0000","last_undegraded":"2024-02-19T21:55:41.511455+0000","last_fullsized":"2024-02-19T21:55:41.511455+0000","mapping_epoch":394,"log_start":"170'11","ondisk_log_start":"170'11","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"397'17","last_scrub_stamp":"2024-02-19T21:54:12.298349+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:54:12.298349+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":527,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.427889+0000","last_change":"2024-02-19T21:53:45.383685+0000","last_active":"2024-02-19T21:55:35.427889+0000","last_peered":"2024-02-19T21:55:35.427889+0000","last_clean":"2024-02-19T21:55:35.427889+0000","last_became_active":"2024-02-19T21:53:45.383372+0000","last_became_peered":"2024-02-19T21:53:45.383372+0000","last_unstale":"2024-02-19T21:55:35.427889+0000","last_undegraded":"2024-02-19T21:55:35.427889+0000","last_fullsized":"2024-02-19T21:55:35.427889+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:03.987749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:49:03.987749+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"470'30","reported_seq":393,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.425744+0000","last_change":"2024-02-19T21:54:11.381056+0000","last_active":"2024-02-19T21:55:35.425744+0000","last_peered":"2024-02-19T21:55:35.425744+0000","last_clean":"2024-02-19T21:55:35.425744+0000","last_became_active":"2024-02-19T21:53:45.387040+0000","last_became_peered":"2024-02-19T21:53:45.387040+0000","last_unstale":"2024-02-19T21:55:35.425744+0000","last_undegraded":"2024-02-19T21:55:35.425744+0000","last_fullsized":"2024-02-19T21:55:35.425744+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'30","last_scrub_stamp":"2024-02-19T21:54:11.380958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:54:11.380958+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":38,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"529'8224","reported_seq":8274,"reported_epoch":529,"state":"active+clean","last_fresh":"2024-02-19T21:55:42.258243+0000","last_change":"2024-02-19T21:55:18.390850+0000","last_active":"2024-02-19T21:55:42.258243+0000","last_peered":"2024-02-19T21:55:42.258243+0000","last_clean":"2024-02-19T21:55:42.258243+0000","last_became_active":"2024-02-19T21:53:45.369133+0000","last_became_peered":"2024-02-19T21:53:45.369133+0000","last_unstale":"2024-02-19T21:55:42.258243+0000","last_undegraded":"2024-02-19T21:55:42.258243+0000","last_fullsized":"2024-02-19T21:55:42.258243+0000","mapping_epoch":492,"log_start":"502'2200","ondisk_log_start":"502'2200","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"520'6862","last_scrub_stamp":"2024-02-19T21:55:18.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:55:18.390740+0000","log_size":6024,"ondisk_log_size":6024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":442236928,"num_objects":6748,"num_object_clones":0,"num_object_copies":20244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6748,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8224,"num_write_kb":479104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":161,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.425959+0000","last_change":"2024-02-19T21:54:00.421089+0000","last_active":"2024-02-19T21:55:35.425959+0000","last_peered":"2024-02-19T21:55:35.425959+0000","last_clean":"2024-02-19T21:55:35.425959+0000","last_became_active":"2024-02-19T21:49:08.327172+0000","last_became_peered":"2024-02-19T21:49:08.327172+0000","last_unstale":"2024-02-19T21:55:35.425959+0000","last_undegraded":"2024-02-19T21:55:35.425959+0000","last_fullsized":"2024-02-19T21:55:35.425959+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:00.420978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:00.420978+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,6],"acting":[2,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":518,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.426744+0000","last_change":"2024-02-19T21:54:16.533065+0000","last_active":"2024-02-19T21:55:35.426744+0000","last_peered":"2024-02-19T21:55:35.426744+0000","last_clean":"2024-02-19T21:55:35.426744+0000","last_became_active":"2024-02-19T21:44:22.245925+0000","last_became_peered":"2024-02-19T21:44:22.245925+0000","last_unstale":"2024-02-19T21:55:35.426744+0000","last_undegraded":"2024-02-19T21:55:35.426744+0000","last_fullsized":"2024-02-19T21:55:35.426744+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:16.532968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:54:16.532968+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":518,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.437313+0000","last_change":"2024-02-19T21:54:22.796082+0000","last_active":"2024-02-19T21:55:35.437313+0000","last_peered":"2024-02-19T21:55:35.437313+0000","last_clean":"2024-02-19T21:55:35.437313+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:55:35.437313+0000","last_undegraded":"2024-02-19T21:55:35.437313+0000","last_fullsized":"2024-02-19T21:55:35.437313+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:22.795999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:54:22.795999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"470'53","reported_seq":487,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.437568+0000","last_change":"2024-02-19T21:54:05.257204+0000","last_active":"2024-02-19T21:55:35.437568+0000","last_peered":"2024-02-19T21:55:35.437568+0000","last_clean":"2024-02-19T21:55:35.437568+0000","last_became_active":"2024-02-19T21:49:08.325683+0000","last_became_peered":"2024-02-19T21:49:08.325683+0000","last_unstale":"2024-02-19T21:55:35.437568+0000","last_undegraded":"2024-02-19T21:55:35.437568+0000","last_fullsized":"2024-02-19T21:55:35.437568+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'53","last_scrub_stamp":"2024-02-19T21:54:05.257106+0000","last_deep_scrub":"337'39","last_deep_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_clean_scrub_stamp":"2024-02-19T21:54:05.257106+0000","log_size":53,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"529'8127","reported_seq":8170,"reported_epoch":529,"state":"active+clean","last_fresh":"2024-02-19T21:55:44.903512+0000","last_change":"2024-02-19T21:53:45.369602+0000","last_active":"2024-02-19T21:55:44.903512+0000","last_peered":"2024-02-19T21:55:44.903512+0000","last_clean":"2024-02-19T21:55:44.903512+0000","last_became_active":"2024-02-19T21:53:45.369204+0000","last_became_peered":"2024-02-19T21:53:45.369204+0000","last_unstale":"2024-02-19T21:55:44.903512+0000","last_undegraded":"2024-02-19T21:55:44.903512+0000","last_fullsized":"2024-02-19T21:55:44.903512+0000","mapping_epoch":492,"log_start":"504'3200","ondisk_log_start":"504'3200","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":4927,"ondisk_log_size":4927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":418054144,"num_objects":6379,"num_object_clones":0,"num_object_copies":19137,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6379,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8127,"num_write_kb":464192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.8","version":"66'1","reported_seq":374,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.428193+0000","last_change":"2024-02-19T21:53:48.374860+0000","last_active":"2024-02-19T21:55:35.428193+0000","last_peered":"2024-02-19T21:55:35.428193+0000","last_clean":"2024-02-19T21:55:35.428193+0000","last_became_active":"2024-02-19T21:53:48.374606+0000","last_became_peered":"2024-02-19T21:53:48.374606+0000","last_unstale":"2024-02-19T21:55:35.428193+0000","last_undegraded":"2024-02-19T21:55:35.428193+0000","last_fullsized":"2024-02-19T21:55:35.428193+0000","mapping_epoch":495,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":496,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:46:43.773486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:46:43.773486+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":166,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.425693+0000","last_change":"2024-02-19T21:55:07.096301+0000","last_active":"2024-02-19T21:55:35.425693+0000","last_peered":"2024-02-19T21:55:35.425693+0000","last_clean":"2024-02-19T21:55:35.425693+0000","last_became_active":"2024-02-19T21:49:08.324835+0000","last_became_peered":"2024-02-19T21:49:08.324835+0000","last_unstale":"2024-02-19T21:55:35.425693+0000","last_undegraded":"2024-02-19T21:55:35.425693+0000","last_fullsized":"2024-02-19T21:55:35.425693+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:07.096186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_clean_scrub_stamp":"2024-02-19T21:55:07.096186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":236,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.437791+0000","last_change":"2024-02-19T21:53:51.712781+0000","last_active":"2024-02-19T21:55:35.437791+0000","last_peered":"2024-02-19T21:55:35.437791+0000","last_clean":"2024-02-19T21:55:35.437791+0000","last_became_active":"2024-02-19T21:49:08.327186+0000","last_became_peered":"2024-02-19T21:49:08.327186+0000","last_unstale":"2024-02-19T21:55:35.437791+0000","last_undegraded":"2024-02-19T21:55:35.437791+0000","last_fullsized":"2024-02-19T21:55:35.437791+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:53:51.712694+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:53:51.712694+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"471'60","reported_seq":661,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.448239+0000","last_change":"2024-02-19T21:54:59.710692+0000","last_active":"2024-02-19T21:55:35.448239+0000","last_peered":"2024-02-19T21:55:35.448239+0000","last_clean":"2024-02-19T21:55:35.448239+0000","last_became_active":"2024-02-19T21:49:54.493167+0000","last_became_peered":"2024-02-19T21:49:54.493167+0000","last_unstale":"2024-02-19T21:55:35.448239+0000","last_undegraded":"2024-02-19T21:55:35.448239+0000","last_fullsized":"2024-02-19T21:55:35.448239+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'60","last_scrub_stamp":"2024-02-19T21:54:59.710570+0000","last_deep_scrub":"201'44","last_deep_scrub_stamp":"2024-02-19T21:44:16.255049+0000","last_clean_scrub_stamp":"2024-02-19T21:54:59.710570+0000","log_size":60,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":80,"num_read_kb":69,"num_write":52,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.4","version":"529'8228","reported_seq":8273,"reported_epoch":529,"state":"active+clean","last_fresh":"2024-02-19T21:55:44.926479+0000","last_change":"2024-02-19T21:53:45.370493+0000","last_active":"2024-02-19T21:55:44.926479+0000","last_peered":"2024-02-19T21:55:44.926479+0000","last_clean":"2024-02-19T21:55:44.926479+0000","last_became_active":"2024-02-19T21:53:45.370111+0000","last_became_peered":"2024-02-19T21:53:45.370111+0000","last_unstale":"2024-02-19T21:55:44.926479+0000","last_undegraded":"2024-02-19T21:55:44.926479+0000","last_fullsized":"2024-02-19T21:55:44.926479+0000","mapping_epoch":492,"log_start":"504'3300","ondisk_log_start":"504'3300","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":4928,"ondisk_log_size":4928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":424935424,"num_objects":6484,"num_object_clones":0,"num_object_copies":19452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6484,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8228,"num_write_kb":470784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":561,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.434775+0000","last_change":"2024-02-19T21:54:11.072349+0000","last_active":"2024-02-19T21:55:35.434775+0000","last_peered":"2024-02-19T21:55:35.434775+0000","last_clean":"2024-02-19T21:55:35.434775+0000","last_became_active":"2024-02-19T21:49:08.328287+0000","last_became_peered":"2024-02-19T21:49:08.328287+0000","last_unstale":"2024-02-19T21:55:35.434775+0000","last_undegraded":"2024-02-19T21:55:35.434775+0000","last_fullsized":"2024-02-19T21:55:35.434775+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:11.072274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:11.072274+0000","last_clean_scrub_stamp":"2024-02-19T21:54:11.072274+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":161,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.425616+0000","last_change":"2024-02-19T21:54:09.300812+0000","last_active":"2024-02-19T21:55:35.425616+0000","last_peered":"2024-02-19T21:55:35.425616+0000","last_clean":"2024-02-19T21:55:35.425616+0000","last_became_active":"2024-02-19T21:49:08.331451+0000","last_became_peered":"2024-02-19T21:49:08.331451+0000","last_unstale":"2024-02-19T21:55:35.425616+0000","last_undegraded":"2024-02-19T21:55:35.425616+0000","last_fullsized":"2024-02-19T21:55:35.425616+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:09.300710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.547129+0000","last_clean_scrub_stamp":"2024-02-19T21:54:09.300710+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":542,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.428333+0000","last_change":"2024-02-19T21:55:10.585700+0000","last_active":"2024-02-19T21:55:35.428333+0000","last_peered":"2024-02-19T21:55:35.428333+0000","last_clean":"2024-02-19T21:55:35.428333+0000","last_became_active":"2024-02-19T21:53:45.384695+0000","last_became_peered":"2024-02-19T21:53:45.384695+0000","last_unstale":"2024-02-19T21:55:35.428333+0000","last_undegraded":"2024-02-19T21:55:35.428333+0000","last_fullsized":"2024-02-19T21:55:35.428333+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:10.585574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:55:10.585574+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"470'25","reported_seq":550,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.434702+0000","last_change":"2024-02-19T21:55:06.814685+0000","last_active":"2024-02-19T21:55:35.434702+0000","last_peered":"2024-02-19T21:55:35.434702+0000","last_clean":"2024-02-19T21:55:35.434702+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:55:35.434702+0000","last_undegraded":"2024-02-19T21:55:35.434702+0000","last_fullsized":"2024-02-19T21:55:35.434702+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'25","last_scrub_stamp":"2024-02-19T21:55:06.814592+0000","last_deep_scrub":"377'19","last_deep_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_clean_scrub_stamp":"2024-02-19T21:55:06.814592+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"529'8079","reported_seq":8124,"reported_epoch":529,"state":"active+clean","last_fresh":"2024-02-19T21:55:45.401391+0000","last_change":"2024-02-19T21:53:45.368033+0000","last_active":"2024-02-19T21:55:45.401391+0000","last_peered":"2024-02-19T21:55:45.401391+0000","last_clean":"2024-02-19T21:55:45.401391+0000","last_became_active":"2024-02-19T21:53:45.367724+0000","last_became_peered":"2024-02-19T21:53:45.367724+0000","last_unstale":"2024-02-19T21:55:45.401391+0000","last_undegraded":"2024-02-19T21:55:45.401391+0000","last_fullsized":"2024-02-19T21:55:45.401391+0000","mapping_epoch":492,"log_start":"502'2300","ondisk_log_start":"502'2300","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":5779,"ondisk_log_size":5779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":412942336,"num_objects":6301,"num_object_clones":0,"num_object_copies":18903,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6301,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8079,"num_write_kb":460160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4],"acting":[5,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":526,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.437371+0000","last_change":"2024-02-19T21:54:09.344599+0000","last_active":"2024-02-19T21:55:35.437371+0000","last_peered":"2024-02-19T21:55:35.437371+0000","last_clean":"2024-02-19T21:55:35.437371+0000","last_became_active":"2024-02-19T21:44:56.160521+0000","last_became_peered":"2024-02-19T21:44:56.160521+0000","last_unstale":"2024-02-19T21:55:35.437371+0000","last_undegraded":"2024-02-19T21:55:35.437371+0000","last_fullsized":"2024-02-19T21:55:35.437371+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:09.344514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:54:09.344514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":170,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.426081+0000","last_change":"2024-02-19T21:54:16.360569+0000","last_active":"2024-02-19T21:55:35.426081+0000","last_peered":"2024-02-19T21:55:35.426081+0000","last_clean":"2024-02-19T21:55:35.426081+0000","last_became_active":"2024-02-19T21:49:54.485078+0000","last_became_peered":"2024-02-19T21:49:54.485078+0000","last_unstale":"2024-02-19T21:55:35.426081+0000","last_undegraded":"2024-02-19T21:55:35.426081+0000","last_fullsized":"2024-02-19T21:55:35.426081+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:16.360470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:54:16.360470+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"470'39","reported_seq":621,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-02-19T21:55:35.431096+0000","last_change":"2024-02-19T21:54:58.172666+0000","last_active":"2024-02-19T21:55:35.431096+0000","last_peered":"2024-02-19T21:55:35.431096+0000","last_clean":"2024-02-19T21:55:35.431096+0000","last_became_active":"2024-02-19T21:49:54.486014+0000","last_became_peered":"2024-02-19T21:49:54.486014+0000","last_unstale":"2024-02-19T21:55:35.431096+0000","last_undegraded":"2024-02-19T21:55:35.431096+0000","last_fullsized":"2024-02-19T21:55:35.431096+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'39","last_scrub_stamp":"2024-02-19T21:54:58.172560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:54:58.172560+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"324'11","reported_seq":822,"reported_epoch":529,"state":"active+clean","last_fresh":"2024-02-19T21:55:41.655664+0000","last_change":"2024-02-19T21:54:21.760361+0000","last_active":"2024-02-19T21:55:41.655664+0000","last_peered":"2024-02-19T21:55:41.655664+0000","last_clean":"2024-02-19T21:55:41.655664+0000","last_became_active":"2024-02-19T21:44:34.385140+0000","last_became_peered":"2024-02-19T21:44:34.385140+0000","last_unstale":"2024-02-19T21:55:41.655664+0000","last_undegraded":"2024-02-19T21:55:41.655664+0000","last_fullsized":"2024-02-19T21:55:41.655664+0000","mapping_epoch":62,"log_start":"66'8","ondisk_log_start":"66'8","created":62,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'11","last_scrub_stamp":"2024-02-19T21:54:21.760260+0000","last_deep_scrub":"324'11","last_deep_scrub_stamp":"2024-02-19T21:46:05.210095+0000","last_clean_scrub_stamp":"2024-02-19T21:54:21.760260+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":16,"stat_sum":{"num_bytes":6778191896,"num_objects":103428,"num_object_clones":0,"num_object_copies":310284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103428,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":131786,"num_write_kb":7526785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20346056704,"data_stored":20346044488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88858,"ondisk_log_size":88858,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1380,"num_read_kb":1375,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1535,"num_read_kb":1292,"num_write":989,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":316,"num_bytes_recovered":5942,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1062,"ondisk_log_size":1062,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":22,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":66,"acting":66,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":388,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201563,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3510524,"kb_used_data":2920756,"kb_used_omap":0,"kb_used_meta":589696,"kb_avail":90234628,"statfs":{"total":95995035648,"available":92400259072,"internally_reserved":0,"allocated":2990854144,"data_stored":2989218303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":603848704},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":0.99299999999999999,"15min":1.8620000000000001},"min":{"1min":0.23999999999999999,"5min":0.20899999999999999,"15min":0.19},"max":{"1min":4.3319999999999999,"5min":6.2569999999999997,"15min":70.477999999999994},"last":9.2200000000000006},{"interface":"front","average":{"1min":0.84199999999999997,"5min":1.0589999999999999,"15min":1.925},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.21199999999999999},"max":{"1min":3.5390000000000001,"5min":11.962999999999999,"15min":68.052000000000007},"last":0.39000000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:54:58 2024","interfaces":[{"interface":"back","average":{"1min":2.1499999999999999,"5min":1.286,"15min":1.9450000000000001},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.23799999999999999},"max":{"1min":8.2929999999999993,"5min":9.9440000000000008,"15min":68.168000000000006},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.3,"5min":1.0860000000000001,"15min":2.0760000000000001},"min":{"1min":0.30199999999999999,"5min":0.27300000000000002,"15min":0.23599999999999999},"max":{"1min":4.1219999999999999,"5min":9.9559999999999995,"15min":68.444000000000003},"last":0.42599999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:55:20 2024","interfaces":[{"interface":"back","average":{"1min":1.9239999999999999,"5min":1.1759999999999999,"15min":1.992},"min":{"1min":0.308,"5min":0.29099999999999998,"15min":0.28599999999999998},"max":{"1min":12.352,"5min":12.352,"15min":12.352},"last":0.48399999999999999},{"interface":"front","average":{"1min":2.0790000000000002,"5min":1.3720000000000001,"15min":1.833},"min":{"1min":0.30299999999999999,"5min":0.28299999999999997,"15min":0.28100000000000003},"max":{"1min":12.369,"5min":12.369,"15min":12.369},"last":9.3529999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.474,"15min":1.9119999999999999},"min":{"1min":0.34699999999999998,"5min":0.315,"15min":0.25900000000000001},"max":{"1min":4.492,"5min":11.778,"15min":11.778},"last":9.1099999999999994},{"interface":"front","average":{"1min":1.925,"5min":1.3939999999999999,"15min":1.6699999999999999},"min":{"1min":0.33800000000000002,"5min":0.312,"15min":0.29299999999999998},"max":{"1min":8.2560000000000002,"5min":13.196,"15min":13.473000000000001},"last":0.47199999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.163,"15min":1.72},"min":{"1min":0.254,"5min":0.254,"15min":0.216},"max":{"1min":3.948,"5min":10.656000000000001,"15min":17.716999999999999},"last":2.3029999999999999},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4810000000000001,"15min":2.129},"min":{"1min":0.34000000000000002,"5min":0.26700000000000002,"15min":0.253},"max":{"1min":5.1440000000000001,"5min":15.961,"15min":17.690999999999999},"last":12.164}]},{"osd":5,"last update":"Mon Feb 19 21:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.3100000000000001,"15min":1.7649999999999999},"min":{"1min":0.30499999999999999,"5min":0.26300000000000001,"15min":0.24199999999999999},"max":{"1min":8.3200000000000003,"5min":8.3200000000000003,"15min":29.021000000000001},"last":3.4689999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.363,"15min":2.097},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.28699999999999998},"max":{"1min":3.8029999999999999,"5min":9.9269999999999996,"15min":29.091999999999999},"last":6.0599999999999996}]},{"osd":6,"last update":"Mon Feb 19 21:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.6719999999999999,"5min":1.4510000000000001,"15min":1.9350000000000001},"min":{"1min":0.45400000000000001,"5min":0.28299999999999997,"15min":0.24299999999999999},"max":{"1min":8.6560000000000006,"5min":15.426,"15min":19.286000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":2.141,"5min":1.5129999999999999,"15min":2.0790000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.26700000000000002},"max":{"1min":9.9730000000000008,"5min":9.9730000000000008,"15min":18.364000000000001},"last":11.894}]}]},{"osd":6,"up_from":47,"seq":201863463202,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":4616636,"kb_used_data":3723124,"kb_used_omap":0,"kb_used_meta":893120,"kb_avail":89128516,"statfs":{"total":95995035648,"available":91267600384,"internally_reserved":0,"allocated":3812478976,"data_stored":3810842449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":914554880},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:55:37 2024","interfaces":[{"interface":"back","average":{"1min":1.786,"5min":1.1419999999999999,"15min":1.4710000000000001},"min":{"1min":0.22700000000000001,"5min":0.214,"15min":0.20100000000000001},"max":{"1min":4.5010000000000003,"5min":9.8659999999999997,"15min":45.197000000000003},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.958,"5min":1.6040000000000001,"15min":1.9219999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.23499999999999999},"max":{"1min":8.2100000000000009,"5min":10.038,"15min":44.753},"last":0.39900000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:55:37 2024","interfaces":[{"interface":"back","average":{"1min":2.3010000000000002,"5min":1.2929999999999999,"15min":1.5880000000000001},"min":{"1min":0.29099999999999998,"5min":0.24299999999999999,"15min":0.20799999999999999},"max":{"1min":11.569000000000001,"5min":11.569000000000001,"15min":45.231999999999999},"last":0.317},{"interface":"front","average":{"1min":4.1319999999999997,"5min":2.0289999999999999,"15min":1.8500000000000001},"min":{"1min":0.56100000000000005,"5min":0.26900000000000002,"15min":0.23100000000000001},"max":{"1min":11.869,"5min":15.215999999999999,"15min":45.097999999999999},"last":9.3780000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:55:19 2024","interfaces":[{"interface":"back","average":{"1min":4.2210000000000001,"5min":1.865,"15min":1.669},"min":{"1min":0.28499999999999998,"5min":0.255,"15min":0.255},"max":{"1min":52.920000000000002,"5min":52.920000000000002,"15min":52.920000000000002},"last":0.28399999999999997},{"interface":"front","average":{"1min":4.5369999999999999,"5min":1.637,"15min":1.391},"min":{"1min":0.33900000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":53.186999999999998,"5min":53.186999999999998,"15min":53.186999999999998},"last":2.5859999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:55:37 2024","interfaces":[{"interface":"back","average":{"1min":2.6949999999999998,"5min":1.4490000000000001,"15min":1.5429999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.25900000000000001},"max":{"1min":8.0990000000000002,"5min":9.8460000000000001,"15min":10.630000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":3.3900000000000001,"5min":1.9339999999999999,"15min":1.671},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.26400000000000001},"max":{"1min":10.742000000000001,"5min":15.175000000000001,"15min":15.175000000000001},"last":1.0740000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:55:37 2024","interfaces":[{"interface":"back","average":{"1min":2.3639999999999999,"5min":1.542,"15min":2.0009999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23000000000000001},"max":{"1min":7.1820000000000004,"5min":8.8439999999999994,"15min":18.010000000000002},"last":0.32800000000000001},{"interface":"front","average":{"1min":2.2759999999999998,"5min":1.548,"15min":1.9319999999999999},"min":{"1min":0.32000000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":6.6159999999999997,"5min":9.8360000000000003,"15min":14.055},"last":0.34100000000000003}]},{"osd":5,"last update":"Mon Feb 19 21:55:37 2024","interfaces":[{"interface":"back","average":{"1min":2.6280000000000001,"5min":3.2480000000000002,"15min":2.589},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":8.173,"5min":148.589,"15min":148.589},"last":0.36899999999999999},{"interface":"front","average":{"1min":2.0430000000000001,"5min":2.8460000000000001,"15min":2.52},"min":{"1min":0.373,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":5.4950000000000001,"5min":148.453,"15min":148.453},"last":0.36499999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:55:02 2024","interfaces":[{"interface":"back","average":{"1min":1.6419999999999999,"5min":1.663,"15min":2.0369999999999999},"min":{"1min":0.34999999999999998,"5min":0.29399999999999998,"15min":0.27200000000000002},"max":{"1min":4.5659999999999998,"5min":9.8170000000000002,"15min":14.721},"last":0.38600000000000001},{"interface":"front","average":{"1min":1.6830000000000001,"5min":1.7110000000000001,"15min":2.0779999999999998},"min":{"1min":0.42099999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":4.5869999999999997,"5min":9.8309999999999995,"15min":14.744999999999999},"last":0.40799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575164,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":4618184,"kb_used_data":3725760,"kb_used_omap":0,"kb_used_meta":892416,"kb_avail":89126968,"statfs":{"total":95995035648,"available":91266015232,"internally_reserved":0,"allocated":3815178240,"data_stored":3813530215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":913833984},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:55:25 2024","interfaces":[{"interface":"back","average":{"1min":1.887,"5min":0.72399999999999998,"15min":0.91100000000000003},"min":{"1min":0.26400000000000001,"5min":0.186,"15min":0.161},"max":{"1min":7.641,"5min":7.641,"15min":7.641},"last":0.33200000000000002},{"interface":"front","average":{"1min":2.3519999999999999,"5min":1.0880000000000001,"15min":1.1359999999999999},"min":{"1min":0.20999999999999999,"5min":0.19500000000000001,"15min":0.16400000000000001},"max":{"1min":14.493,"5min":14.493,"15min":14.493},"last":0.23499999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:55:21 2024","interfaces":[{"interface":"back","average":{"1min":2.081,"5min":0.78400000000000003,"15min":0.98199999999999998},"min":{"1min":0.19600000000000001,"5min":0.189,"15min":0.189},"max":{"1min":10.776999999999999,"5min":10.776999999999999,"15min":10.776999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":2.694,"5min":1.159,"15min":1.0609999999999999},"min":{"1min":0.214,"5min":0.20699999999999999,"15min":0.20399999999999999},"max":{"1min":19.199000000000002,"5min":19.199000000000002,"15min":19.199000000000002},"last":0.247}]},{"osd":3,"last update":"Mon Feb 19 21:55:25 2024","interfaces":[{"interface":"back","average":{"1min":3.5750000000000002,"5min":1.3360000000000001,"15min":1.2050000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":19.297999999999998,"5min":19.297999999999998,"15min":19.297999999999998},"last":0.308},{"interface":"front","average":{"1min":2.0209999999999999,"5min":0.93400000000000005,"15min":1.117},"min":{"1min":0.26700000000000002,"5min":0.255,"15min":0.215},"max":{"1min":13.029999999999999,"5min":13.029999999999999,"15min":13.029999999999999},"last":0.46300000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:55:44 2024","interfaces":[{"interface":"back","average":{"1min":3.0049999999999999,"5min":1.444,"15min":1.603},"min":{"1min":0.39600000000000002,"5min":0.30499999999999999,"15min":0.251},"max":{"1min":19.742000000000001,"5min":19.742000000000001,"15min":19.742000000000001},"last":1.9319999999999999},{"interface":"front","average":{"1min":3.383,"5min":1.6859999999999999,"15min":1.6020000000000001},"min":{"1min":0.32000000000000001,"5min":0.28100000000000003,"15min":0.26500000000000001},"max":{"1min":19.331,"5min":19.331,"15min":19.331},"last":1.897}]},{"osd":5,"last update":"Mon Feb 19 21:55:11 2024","interfaces":[{"interface":"back","average":{"1min":2.2149999999999999,"5min":1.212,"15min":1.5620000000000001},"min":{"1min":0.34100000000000003,"5min":0.29599999999999999,"15min":0.27900000000000003},"max":{"1min":5.867,"5min":5.867,"15min":14.331},"last":0.54500000000000004},{"interface":"front","average":{"1min":2.6800000000000002,"5min":1.381,"15min":1.6100000000000001},"min":{"1min":0.38800000000000001,"5min":0.313,"15min":0.307},"max":{"1min":19.388000000000002,"5min":19.388000000000002,"15min":19.388000000000002},"last":2.1909999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:55:44 2024","interfaces":[{"interface":"back","average":{"1min":2.3799999999999999,"5min":1.26,"15min":1.6140000000000001},"min":{"1min":0.35899999999999999,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":6.6859999999999999,"5min":6.6859999999999999,"15min":11.638999999999999},"last":1.577},{"interface":"front","average":{"1min":3.488,"5min":1.5469999999999999,"15min":1.8120000000000001},"min":{"1min":0.36599999999999999,"5min":0.32400000000000001,"15min":0.29699999999999999},"max":{"1min":19.359000000000002,"5min":19.359000000000002,"15min":19.359000000000002},"last":4.976}]},{"osd":7,"last update":"Mon Feb 19 21:55:07 2024","interfaces":[{"interface":"back","average":{"1min":2.722,"5min":1.2749999999999999,"15min":1.704},"min":{"1min":0.378,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":19.681999999999999,"5min":19.681999999999999,"15min":19.681999999999999},"last":1.466},{"interface":"front","average":{"1min":2.355,"5min":1.161,"15min":1.6659999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.32600000000000001},"max":{"1min":19.774000000000001,"5min":19.774000000000001,"15min":19.774000000000001},"last":1.476}]}]},{"osd":0,"up_from":8,"seq":34359738690,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3379320,"kb_used_data":2472624,"kb_used_omap":0,"kb_used_meta":906688,"kb_avail":90365832,"statfs":{"total":95995035648,"available":92534611968,"internally_reserved":0,"allocated":2531966976,"data_stored":2530334570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":928448512},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":0.755,"15min":0.82399999999999995},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.153},"max":{"1min":5.649,"5min":5.649,"15min":16.478000000000002},"last":3.1080000000000001},{"interface":"front","average":{"1min":2.4319999999999999,"5min":1.1839999999999999,"15min":1.0669999999999999},"min":{"1min":0.22500000000000001,"5min":0.20799999999999999,"15min":0.17799999999999999},"max":{"1min":5.9880000000000004,"5min":7.1669999999999998,"15min":8.0229999999999997},"last":2.6949999999999998}]},{"osd":2,"last update":"Mon Feb 19 21:55:17 2024","interfaces":[{"interface":"back","average":{"1min":2.0430000000000001,"5min":1,"15min":0.77400000000000002},"min":{"1min":0.22900000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":6.4640000000000004,"5min":6.4640000000000004,"15min":6.4640000000000004},"last":3.5339999999999998},{"interface":"front","average":{"1min":1.679,"5min":0.84399999999999997,"15min":1.069},"min":{"1min":0.26500000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":5.6909999999999998,"5min":5.9370000000000003,"15min":8.9960000000000004},"last":3.778}]},{"osd":3,"last update":"Mon Feb 19 21:55:04 2024","interfaces":[{"interface":"back","average":{"1min":1.655,"5min":0.877,"15min":1.1240000000000001},"min":{"1min":0.28499999999999998,"5min":0.255,"15min":0.21299999999999999},"max":{"1min":9.3010000000000002,"5min":9.3010000000000002,"15min":13.292999999999999},"last":3.2069999999999999},{"interface":"front","average":{"1min":1.123,"5min":0.79800000000000004,"15min":0.92200000000000004},"min":{"1min":0.29799999999999999,"5min":0.26300000000000001,"15min":0.23400000000000001},"max":{"1min":4.6909999999999998,"5min":5.968,"15min":8.4169999999999998},"last":3.0209999999999999}]},{"osd":4,"last update":"Mon Feb 19 21:54:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0029999999999999,"15min":1.512},"min":{"1min":0.33900000000000002,"5min":0.29399999999999998,"15min":0.252},"max":{"1min":2.3479999999999999,"5min":7.298,"15min":13.278},"last":3.1520000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.026,"15min":1.3999999999999999},"min":{"1min":0.39900000000000002,"5min":0.32500000000000001,"15min":0.28999999999999998},"max":{"1min":4.2249999999999996,"5min":9.0530000000000008,"15min":10.109},"last":2.8969999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:55:04 2024","interfaces":[{"interface":"back","average":{"1min":1.8819999999999999,"5min":1.175,"15min":1.7450000000000001},"min":{"1min":0.34000000000000002,"5min":0.318,"15min":0.27600000000000002},"max":{"1min":5.1859999999999999,"5min":7.2089999999999996,"15min":25.442},"last":2.9670000000000001},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.161,"15min":1.8089999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.27300000000000002},"max":{"1min":3.351,"5min":6.5839999999999996,"15min":25.411999999999999},"last":3.234}]},{"osd":6,"last update":"Mon Feb 19 21:55:23 2024","interfaces":[{"interface":"back","average":{"1min":2.3690000000000002,"5min":1.349,"15min":1.5329999999999999},"min":{"1min":0.33500000000000002,"5min":0.33300000000000002,"15min":0.27000000000000002},"max":{"1min":5.7149999999999999,"5min":12.364000000000001,"15min":12.364000000000001},"last":2.9489999999999998},{"interface":"front","average":{"1min":2.4359999999999999,"5min":1.526,"15min":1.8400000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.29599999999999999},"max":{"1min":6.3440000000000003,"5min":11.269,"15min":13.289999999999999},"last":0.72599999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.2170000000000001,"15min":1.609},"min":{"1min":0.432,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":3.661,"5min":5.8070000000000004,"15min":15.688000000000001},"last":3.181},{"interface":"front","average":{"1min":1.6379999999999999,"5min":1.1870000000000001,"15min":1.502},"min":{"1min":0.41399999999999998,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":4.2969999999999997,"5min":5.8159999999999998,"15min":10.470000000000001},"last":2.9889999999999999}]}]},{"osd":2,"up_from":394,"seq":1692217114703,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3318572,"kb_used_data":3002724,"kb_used_omap":0,"kb_used_meta":315839,"kb_avail":90426580,"statfs":{"total":95995035648,"available":92596817920,"internally_reserved":0,"allocated":3074789376,"data_stored":3073169008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":323419188},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:55:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":0.80400000000000005,"15min":1.046},"min":{"1min":0.192,"5min":0.183,"15min":0.183},"max":{"1min":4.1890000000000001,"5min":9.2629999999999999,"15min":9.2629999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":1.038,"5min":0.67800000000000005,"15min":1.0409999999999999},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":5.7000000000000002,"5min":5.7000000000000002,"15min":6.149},"last":0.55600000000000005}]},{"osd":1,"last update":"Mon Feb 19 21:55:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.69499999999999995,"15min":0.64600000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":3.7029999999999998,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.516,"5min":0.80000000000000004,"15min":0.91200000000000003},"min":{"1min":0.25800000000000001,"5min":0.224,"15min":0.224},"max":{"1min":4.9349999999999996,"5min":4.9349999999999996,"15min":6.992},"last":1.1819999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:55:16 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":0.83799999999999997,"15min":1.246},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":5.5410000000000004,"5min":6.0970000000000004,"15min":6.9470000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":1.153,"5min":0.81299999999999994,"15min":1.133},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":5.6600000000000001,"5min":7.6669999999999998,"15min":7.6669999999999998},"last":0.52100000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:55:16 2024","interfaces":[{"interface":"back","average":{"1min":1.7010000000000001,"5min":1.161,"15min":1.825},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":3.786,"5min":8.843,"15min":8.843},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.7130000000000001,"5min":1.234,"15min":1.716},"min":{"1min":0.32800000000000001,"5min":0.30299999999999999,"15min":0.26500000000000001},"max":{"1min":5.9550000000000001,"5min":9.3300000000000001,"15min":9.3300000000000001},"last":0.61899999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:55:16 2024","interfaces":[{"interface":"back","average":{"1min":1.907,"5min":1.591,"15min":1.7230000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":5.9969999999999999,"5min":11.129,"15min":11.129},"last":4.9950000000000001},{"interface":"front","average":{"1min":1.548,"5min":1.002,"15min":1.548},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":5.8540000000000001,"5min":5.8540000000000001,"15min":13.558},"last":0.57099999999999995}]},{"osd":6,"last update":"Mon Feb 19 21:55:16 2024","interfaces":[{"interface":"back","average":{"1min":1.9930000000000001,"5min":1.5469999999999999,"15min":1.6830000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33200000000000002},"max":{"1min":9.3040000000000003,"5min":9.6720000000000006,"15min":9.6720000000000006},"last":1.982},{"interface":"front","average":{"1min":1.8220000000000001,"5min":1.3500000000000001,"15min":1.1439999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":4.6289999999999996,"5min":8.3629999999999995,"15min":8.3629999999999995},"last":0.49099999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:55:16 2024","interfaces":[{"interface":"back","average":{"1min":1.946,"5min":1.3660000000000001,"15min":1.4239999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":5.7210000000000001,"5min":7.4089999999999998,"15min":7.4089999999999998},"last":3.327},{"interface":"front","average":{"1min":2.206,"5min":1.4330000000000001,"15min":1.0409999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":5.0899999999999999,"5min":8.7780000000000005,"15min":8.7780000000000005},"last":0.91200000000000003}]}]},{"osd":3,"up_from":26,"seq":111669150002,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":728068,"kb_used_data":426748,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93017084,"statfs":{"total":95995035648,"available":95249494016,"internally_reserved":0,"allocated":436989952,"data_stored":435408826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:55:19 2024","interfaces":[{"interface":"back","average":{"1min":2.141,"5min":0.91600000000000004,"15min":1.0429999999999999},"min":{"1min":0.27300000000000002,"5min":0.21199999999999999,"15min":0.17399999999999999},"max":{"1min":7.2699999999999996,"5min":7.2699999999999996,"15min":8.8529999999999998},"last":0.30599999999999999},{"interface":"front","average":{"1min":2.9380000000000002,"5min":1.083,"15min":1.2649999999999999},"min":{"1min":0.26400000000000001,"5min":0.23899999999999999,"15min":0.187},"max":{"1min":12.525,"5min":12.525,"15min":12.525},"last":0.27300000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:55:19 2024","interfaces":[{"interface":"back","average":{"1min":11.167999999999999,"5min":2.6629999999999998,"15min":1.736},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.18099999999999999},"max":{"1min":178.30000000000001,"5min":178.30000000000001,"15min":178.30000000000001},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.859,"5min":0.75800000000000001,"15min":1.1599999999999999},"min":{"1min":0.27300000000000002,"5min":0.186,"15min":0.186},"max":{"1min":4.9489999999999998,"5min":4.9489999999999998,"15min":62.631},"last":0.50800000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:55:19 2024","interfaces":[{"interface":"back","average":{"1min":2.1739999999999999,"5min":1.2150000000000001,"15min":0.93500000000000005},"min":{"1min":0.25,"5min":0.216,"15min":0.216},"max":{"1min":7.1120000000000001,"5min":32.323999999999998,"15min":32.323999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":2.407,"5min":1.294,"15min":1.498},"min":{"1min":0.29699999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":12.449,"5min":32.103999999999999,"15min":32.103999999999999},"last":0.59199999999999997}]},{"osd":4,"last update":"Mon Feb 19 21:54:50 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.77000000000000002,"15min":1.167},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.6680000000000001,"5min":5.1219999999999999,"15min":10.609999999999999},"last":0.34799999999999998},{"interface":"front","average":{"1min":1.4650000000000001,"5min":0.95299999999999996,"15min":1.321},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.26700000000000002},"max":{"1min":4.6479999999999997,"5min":5.7930000000000001,"15min":9.6720000000000006},"last":0.876}]},{"osd":5,"last update":"Mon Feb 19 21:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":0.85099999999999998,"15min":1.411},"min":{"1min":0.32100000000000001,"5min":0.311,"15min":0.29099999999999998},"max":{"1min":2.7149999999999999,"5min":5.46,"15min":12.257},"last":0.46999999999999997},{"interface":"front","average":{"1min":2.2040000000000002,"5min":1.159,"15min":1.5129999999999999},"min":{"1min":0.379,"5min":0.31,"15min":0.30299999999999999},"max":{"1min":6.0019999999999998,"5min":8.5440000000000005,"15min":12.635},"last":0.53800000000000003}]},{"osd":6,"last update":"Mon Feb 19 21:55:30 2024","interfaces":[{"interface":"back","average":{"1min":2.5249999999999999,"5min":1.472,"15min":1.583},"min":{"1min":0.441,"5min":0.36799999999999999,"15min":0.309},"max":{"1min":6.1509999999999998,"5min":22.759,"15min":22.759},"last":0.66400000000000003},{"interface":"front","average":{"1min":2.375,"5min":1.534,"15min":1.609},"min":{"1min":0.38500000000000001,"5min":0.34100000000000003,"15min":0.29099999999999998},"max":{"1min":7.3470000000000004,"5min":22.608000000000001,"15min":22.608000000000001},"last":0.94899999999999995}]},{"osd":7,"last update":"Mon Feb 19 21:54:50 2024","interfaces":[{"interface":"back","average":{"1min":2.3620000000000001,"5min":1.284,"15min":1.6140000000000001},"min":{"1min":0.40799999999999997,"5min":0.34399999999999997,"15min":0.28599999999999998},"max":{"1min":12.494,"5min":12.494,"15min":12.494},"last":0.72899999999999998},{"interface":"front","average":{"1min":1.1439999999999999,"5min":0.91500000000000004,"15min":1.3089999999999999},"min":{"1min":0.41699999999999998,"5min":0.40400000000000003,"15min":0.34599999999999997},"max":{"1min":3.319,"5min":5.3339999999999996,"15min":9.3399999999999999},"last":2.8919999999999999}]}]},{"osd":4,"up_from":32,"seq":137438953771,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2969968,"kb_used_data":2078120,"kb_used_omap":0,"kb_used_meta":891840,"kb_avail":90775184,"statfs":{"total":95995035648,"available":92953788416,"internally_reserved":0,"allocated":2127994880,"data_stored":2126369738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":913244160},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:55:38 2024","interfaces":[{"interface":"back","average":{"1min":2.4870000000000001,"5min":1.458,"15min":1.7430000000000001},"min":{"1min":0.23000000000000001,"5min":0.221,"15min":0.219},"max":{"1min":9.8800000000000008,"5min":10.173,"15min":53.936},"last":1.984},{"interface":"front","average":{"1min":3.0129999999999999,"5min":1.4710000000000001,"15min":1.806},"min":{"1min":0.26800000000000002,"5min":0.252,"15min":0.23000000000000001},"max":{"1min":11.683999999999999,"5min":11.683999999999999,"15min":54.405999999999999},"last":4.1230000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:55:38 2024","interfaces":[{"interface":"back","average":{"1min":3.5870000000000002,"5min":3.6459999999999999,"15min":2.569},"min":{"1min":0.25600000000000001,"5min":0.23799999999999999,"15min":0.21199999999999999},"max":{"1min":10.233000000000001,"5min":156.72999999999999,"15min":156.72999999999999},"last":0.38300000000000001},{"interface":"front","average":{"1min":3.3159999999999998,"5min":3.391,"15min":2.351},"min":{"1min":0.38900000000000001,"5min":0.28299999999999997,"15min":0.25},"max":{"1min":10.217000000000001,"5min":156.83000000000001,"15min":156.83000000000001},"last":4.1680000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:55:16 2024","interfaces":[{"interface":"back","average":{"1min":2.1680000000000001,"5min":1.587,"15min":1.913},"min":{"1min":0.32500000000000001,"5min":0.255,"15min":0.255},"max":{"1min":7.3170000000000002,"5min":12.516999999999999,"15min":12.516999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":2.1989999999999998,"5min":1.6299999999999999,"15min":1.952},"min":{"1min":0.375,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":7.4009999999999998,"5min":12.541,"15min":12.541},"last":0.44600000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:55:38 2024","interfaces":[{"interface":"back","average":{"1min":1.587,"5min":1.149,"15min":1.516},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":9.1850000000000005,"5min":9.9529999999999994,"15min":10.970000000000001},"last":1.8560000000000001},{"interface":"front","average":{"1min":3.1349999999999998,"5min":1.645,"15min":1.7410000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.26900000000000002},"max":{"1min":9.8070000000000004,"5min":12.486000000000001,"15min":12.486000000000001},"last":0.53700000000000003}]},{"osd":5,"last update":"Mon Feb 19 21:55:31 2024","interfaces":[{"interface":"back","average":{"1min":2.7519999999999998,"5min":1.831,"15min":2.0539999999999998},"min":{"1min":0.29199999999999998,"5min":0.23999999999999999,"15min":0.23400000000000001},"max":{"1min":10.278,"5min":13.458,"15min":18.916},"last":4.0650000000000004},{"interface":"front","average":{"1min":2.4550000000000001,"5min":1.5620000000000001,"15min":2.1789999999999998},"min":{"1min":0.309,"5min":0.29599999999999999,"15min":0.253},"max":{"1min":9.2560000000000002,"5min":14.532999999999999,"15min":14.840999999999999},"last":3.5960000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:55:38 2024","interfaces":[{"interface":"back","average":{"1min":2.1909999999999998,"5min":1.6579999999999999,"15min":1.7849999999999999},"min":{"1min":0.28100000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":9.2119999999999997,"5min":10.233000000000001,"15min":10.622999999999999},"last":1.8009999999999999},{"interface":"front","average":{"1min":4.3209999999999997,"5min":1.964,"15min":2.202},"min":{"1min":0.318,"5min":0.27300000000000002,"15min":0.23699999999999999},"max":{"1min":12.85,"5min":13.433999999999999,"15min":18.670000000000002},"last":4.1459999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:55:09 2024","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.4199999999999999,"15min":1.988},"min":{"1min":0.32300000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":5.609,"5min":13.398,"15min":16.763999999999999},"last":4.0979999999999999},{"interface":"front","average":{"1min":1.349,"5min":1.2869999999999999,"15min":1.7749999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.31},"max":{"1min":6.9619999999999997,"5min":12.958,"15min":12.958},"last":1.8340000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757543,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2534624,"kb_used_data":1644184,"kb_used_omap":0,"kb_used_meta":890432,"kb_avail":91210528,"statfs":{"total":95995035648,"available":93399580672,"internally_reserved":0,"allocated":1683644416,"data_stored":1682035647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":911802368},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.669,"5min":1.3999999999999999,"15min":1.669},"min":{"1min":0.221,"5min":0.221,"15min":0.20599999999999999},"max":{"1min":4.6289999999999996,"5min":10.534000000000001,"15min":19.236000000000001},"last":2.952},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.1080000000000001,"15min":1.7370000000000001},"min":{"1min":0.246,"5min":0.23699999999999999,"15min":0.20899999999999999},"max":{"1min":5.9889999999999999,"5min":6.5449999999999999,"15min":13.241},"last":0.26100000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.546,"5min":1.147,"15min":1.6859999999999999},"min":{"1min":0.27500000000000002,"5min":0.246,"15min":0.23100000000000001},"max":{"1min":5.9610000000000003,"5min":6.625,"15min":10.42},"last":0.29699999999999999},{"interface":"front","average":{"1min":1.611,"5min":1.262,"15min":1.4870000000000001},"min":{"1min":0.28799999999999998,"5min":0.249,"15min":0.23000000000000001},"max":{"1min":4.5229999999999997,"5min":11.654,"15min":11.654},"last":1.1859999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:55:19 2024","interfaces":[{"interface":"back","average":{"1min":5.4340000000000002,"5min":2.5569999999999999,"15min":1.7829999999999999},"min":{"1min":0.33900000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":79.257000000000005,"5min":79.257000000000005,"15min":79.257000000000005},"last":2.9769999999999999},{"interface":"front","average":{"1min":8.6530000000000005,"5min":3.0139999999999998,"15min":1.8799999999999999},"min":{"1min":0.40600000000000003,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":79.030000000000001,"5min":79.030000000000001,"15min":79.030000000000001},"last":1.383}]},{"osd":3,"last update":"Mon Feb 19 21:55:19 2024","interfaces":[{"interface":"back","average":{"1min":2.0790000000000002,"5min":1.5649999999999999,"15min":1.9330000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.24099999999999999},"max":{"1min":5.6600000000000001,"5min":10.561,"15min":19.321000000000002},"last":3.0019999999999998},{"interface":"front","average":{"1min":1.865,"5min":1.369,"15min":1.873},"min":{"1min":0.33800000000000002,"5min":0.31900000000000001,"15min":0.29499999999999998},"max":{"1min":6.0259999999999998,"5min":6.577,"15min":9.5150000000000006},"last":0.60799999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.3520000000000001,"15min":1.6160000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.20899999999999999},"max":{"1min":8.4730000000000008,"5min":12.228,"15min":21.577000000000002},"last":6.6130000000000004},{"interface":"front","average":{"1min":1.6000000000000001,"5min":1.47,"15min":2.0880000000000001},"min":{"1min":0.30199999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":4.71,"5min":10.586,"15min":19.274000000000001},"last":2.9239999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:55:42 2024","interfaces":[{"interface":"back","average":{"1min":2.3540000000000001,"5min":1.897,"15min":2.254},"min":{"1min":0.316,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":9.3930000000000007,"5min":10.611000000000001,"15min":19.884},"last":3.0259999999999998},{"interface":"front","average":{"1min":2.0680000000000001,"5min":1.4590000000000001,"15min":1.964},"min":{"1min":0.32100000000000001,"5min":0.29099999999999998,"15min":0.26700000000000002},"max":{"1min":9.8320000000000007,"5min":9.8320000000000007,"15min":13.532999999999999},"last":0.499}]},{"osd":7,"last update":"Mon Feb 19 21:55:03 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.456,"15min":2.145},"min":{"1min":0.39300000000000002,"5min":0.33500000000000002,"15min":0.27100000000000002},"max":{"1min":6.9210000000000003,"5min":8.6590000000000007,"15min":12.962},"last":0.32900000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.431,"15min":1.968},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.221},"max":{"1min":4.5590000000000002,"5min":11.617000000000001,"15min":15.593999999999999},"last":1.0760000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":1722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2519269376,"data_stored":2519269376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3791060992,"data_stored":3791060992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3056865280,"data_stored":3056861208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":428343296,"data_stored":428343296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2105413632,"data_stored":2105409560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1667104768,"data_stored":1667104768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3793620992,"data_stored":3793616920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2984378368,"data_stored":2984378368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:55:48.898 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool set .rgw.root pgp_num 32 2024-02-19T21:55:48.929 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:55:49.015 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:55:49.020 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:49.021 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:55:49.121 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:55:49.179 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:49.233 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:55:49.242 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:49.242 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:55:49.343 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:55:49.398 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:49.429 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:55:49.433 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:49.433 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:55:49.474 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:47.593643+0000 osd.5 (osd.5) 307 : cluster [DBG] 2.16 scrub starts 2024-02-19T21:55:49.474 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:47.600708+0000 osd.5 (osd.5) 308 : cluster [DBG] 2.16 scrub ok 2024-02-19T21:55:49.474 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:47.885811+0000 osd.6 (osd.6) 280 : cluster [DBG] 2.c scrub starts 2024-02-19T21:55:49.474 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:47.904294+0000 osd.6 (osd.6) 281 : cluster [DBG] 2.c scrub ok 2024-02-19T21:55:49.474 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:48.453553+0000 osd.3 (osd.3) 255 : cluster [DBG] 11.a scrub starts 2024-02-19T21:55:49.534 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:55:49.582 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:49.734 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:47.593643+0000 osd.5 (osd.5) 307 : cluster [DBG] 2.16 scrub starts 2024-02-19T21:55:49.734 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:47.600708+0000 osd.5 (osd.5) 308 : cluster [DBG] 2.16 scrub ok 2024-02-19T21:55:49.734 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:47.885811+0000 osd.6 (osd.6) 280 : cluster [DBG] 2.c scrub starts 2024-02-19T21:55:49.734 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:47.904294+0000 osd.6 (osd.6) 281 : cluster [DBG] 2.c scrub ok 2024-02-19T21:55:49.734 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:48.453553+0000 osd.3 (osd.3) 255 : cluster [DBG] 11.a scrub starts 2024-02-19T21:55:49.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:47.593643+0000 osd.5 (osd.5) 307 : cluster [DBG] 2.16 scrub starts 2024-02-19T21:55:49.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:47.600708+0000 osd.5 (osd.5) 308 : cluster [DBG] 2.16 scrub ok 2024-02-19T21:55:49.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:47.885811+0000 osd.6 (osd.6) 280 : cluster [DBG] 2.c scrub starts 2024-02-19T21:55:49.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:47.904294+0000 osd.6 (osd.6) 281 : cluster [DBG] 2.c scrub ok 2024-02-19T21:55:49.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:48.453553+0000 osd.3 (osd.3) 255 : cluster [DBG] 11.a scrub starts 2024-02-19T21:55:49.860 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:55:49.865 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:49.866 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:55:49.967 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:55:50.031 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:50.034 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:55:50.073 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:55:50.073 INFO:teuthology.orchestra.run.smithi157.stdout: "size": 20, 2024-02-19T21:55:50.073 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 600, 2024-02-19T21:55:50.074 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [ 2024-02-19T21:55:50.074 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.074 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:216516 9.1 9:8020748e:::benchmark_data_smithi080_126364_object87924:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e355)", 2024-02-19T21:55:50.074 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:47:32.391603+0000", 2024-02-19T21:55:50.074 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 497.67513892300002, 2024-02-19T21:55:50.074 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1874880449999998, 2024-02-19T21:55:50.074 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:55:50.074 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "reached pg", 2024-02-19T21:55:50.074 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:55:50.074 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:55:50.074 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:55:50.074 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 216516 2024-02-19T21:55:50.074 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.074 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:55:50.075 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.075 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:55:50.075 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391603+0000", 2024-02-19T21:55:50.075 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:55:50.075 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.075 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.075 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:55:50.075 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391603+0000", 2024-02-19T21:55:50.075 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:55:50.075 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.075 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.075 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:55:50.075 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391601+0000", 2024-02-19T21:55:50.075 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.0040000000000002e-06 2024-02-19T21:55:50.076 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.076 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.076 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:55:50.076 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391608+0000", 2024-02-19T21:55:50.076 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1270000000000001e-05 2024-02-19T21:55:50.076 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.076 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.076 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:55:50.076 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391619+0000", 2024-02-19T21:55:50.076 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.8329999999999996e-06 2024-02-19T21:55:50.076 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.076 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.076 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:55:50.076 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391626+0000", 2024-02-19T21:55:50.077 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.8105e-05 2024-02-19T21:55:50.077 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.077 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.077 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.077 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391684+0000", 2024-02-19T21:55:50.077 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.4050000000000003e-06 2024-02-19T21:55:50.077 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.077 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.077 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:55:50.077 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391692+0000", 2024-02-19T21:55:50.077 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99364586099999996 2024-02-19T21:55:50.077 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.077 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.077 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.078 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:33.385338+0000", 2024-02-19T21:55:50.078 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1124999999999999e-05 2024-02-19T21:55:50.078 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.078 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.078 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:55:50.078 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:33.385349+0000", 2024-02-19T21:55:50.078 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1912486499999999 2024-02-19T21:55:50.078 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.078 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.078 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.078 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.576597+0000", 2024-02-19T21:55:50.078 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0024935019999999999 2024-02-19T21:55:50.078 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.078 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.078 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:55:50.079 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.579091+0000", 2024-02-19T21:55:50.079 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1874880449999998 2024-02-19T21:55:50.079 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.079 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:55:50.079 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.079 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.079 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.079 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:216521 9.1 9:801b7e92:::benchmark_data_smithi080_126364_object87929:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e355)", 2024-02-19T21:55:50.079 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:47:32.391640+0000", 2024-02-19T21:55:50.079 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 497.67510200499999, 2024-02-19T21:55:50.079 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1875704169999999, 2024-02-19T21:55:50.079 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:55:50.079 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "reached pg", 2024-02-19T21:55:50.079 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:55:50.080 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:55:50.080 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:55:50.080 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 216521 2024-02-19T21:55:50.080 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.080 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:55:50.080 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.080 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:55:50.080 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391640+0000", 2024-02-19T21:55:50.080 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:55:50.080 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.080 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.080 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:55:50.080 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391640+0000", 2024-02-19T21:55:50.080 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:55:50.081 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.081 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.081 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:55:50.081 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391639+0000", 2024-02-19T21:55:50.081 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.0000000000000001e-06 2024-02-19T21:55:50.081 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.081 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.081 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:55:50.081 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391642+0000", 2024-02-19T21:55:50.081 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.3990000000000001e-06 2024-02-19T21:55:50.081 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.081 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.081 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:55:50.081 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391649+0000", 2024-02-19T21:55:50.082 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.9090000000000002e-06 2024-02-19T21:55:50.082 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.082 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.082 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:55:50.082 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391653+0000", 2024-02-19T21:55:50.082 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.6987e-05 2024-02-19T21:55:50.082 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.082 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.082 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.082 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391730+0000", 2024-02-19T21:55:50.082 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.3090000000000001e-06 2024-02-19T21:55:50.082 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.082 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.082 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:55:50.082 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391739+0000", 2024-02-19T21:55:50.083 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99363444899999998 2024-02-19T21:55:50.083 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.083 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.083 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.083 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:33.385373+0000", 2024-02-19T21:55:50.083 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.3329999999999999e-06 2024-02-19T21:55:50.083 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.083 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.083 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:55:50.083 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:33.385381+0000", 2024-02-19T21:55:50.083 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1937523780000001 2024-02-19T21:55:50.083 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.083 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.083 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.083 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.579133+0000", 2024-02-19T21:55:50.084 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.7134999999999999e-05 2024-02-19T21:55:50.084 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.084 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.084 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:55:50.084 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.579210+0000", 2024-02-19T21:55:50.084 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1875704169999999 2024-02-19T21:55:50.084 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.084 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:55:50.084 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.084 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.084 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.084 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:216535 9.1 9:86425105:::benchmark_data_smithi080_126364_object87943:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e355)", 2024-02-19T21:55:50.084 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:47:32.391658+0000", 2024-02-19T21:55:50.084 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 497.67508398899997, 2024-02-19T21:55:50.085 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.2627521640000001, 2024-02-19T21:55:50.085 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:55:50.085 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:50.085 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:55:50.085 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:55:50.085 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:55:50.085 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 216535 2024-02-19T21:55:50.085 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.085 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:55:50.085 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.085 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:55:50.085 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391658+0000", 2024-02-19T21:55:50.085 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:55:50.085 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.085 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.086 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:55:50.086 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391658+0000", 2024-02-19T21:55:50.086 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:55:50.086 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.086 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.086 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:55:50.086 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391657+0000", 2024-02-19T21:55:50.086 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.4600000000000002e-06 2024-02-19T21:55:50.086 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.086 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.086 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:55:50.086 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391660+0000", 2024-02-19T21:55:50.086 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.587e-06 2024-02-19T21:55:50.086 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.087 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.087 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:55:50.087 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391665+0000", 2024-02-19T21:55:50.087 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.895e-06 2024-02-19T21:55:50.087 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.087 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.087 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:55:50.087 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391669+0000", 2024-02-19T21:55:50.087 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.4252000000000006e-05 2024-02-19T21:55:50.087 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.087 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.087 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.087 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391754+0000", 2024-02-19T21:55:50.087 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0199999999999996e-06 2024-02-19T21:55:50.088 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.088 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.088 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:55:50.088 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391758+0000", 2024-02-19T21:55:50.088 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99364607000000005 2024-02-19T21:55:50.088 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.088 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.088 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.088 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:33.385404+0000", 2024-02-19T21:55:50.088 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.0169999999999999e-06 2024-02-19T21:55:50.088 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.088 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.088 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:55:50.088 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:33.385411+0000", 2024-02-19T21:55:50.089 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1938248819999999 2024-02-19T21:55:50.089 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.089 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.089 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.089 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.579236+0000", 2024-02-19T21:55:50.089 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00097764399999999995 2024-02-19T21:55:50.089 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.089 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.089 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:55:50.089 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.580213+0000", 2024-02-19T21:55:50.089 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00048398400000000002 2024-02-19T21:55:50.089 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.089 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.089 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 2,3,4", 2024-02-19T21:55:50.089 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.580697+0000", 2024-02-19T21:55:50.089 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.067799909000000005 2024-02-19T21:55:50.090 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.090 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.090 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:55:50.090 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.648497+0000", 2024-02-19T21:55:50.090 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0057387979999999998 2024-02-19T21:55:50.090 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.090 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.090 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.090 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654236+0000", 2024-02-19T21:55:50.090 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.0315000000000001e-05 2024-02-19T21:55:50.090 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.090 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.090 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.090 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654256+0000", 2024-02-19T21:55:50.091 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.8612e-05 2024-02-19T21:55:50.091 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.091 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.091 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.091 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654285+0000", 2024-02-19T21:55:50.091 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.9422999999999998e-05 2024-02-19T21:55:50.091 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.091 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.091 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:55:50.091 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654334+0000", 2024-02-19T21:55:50.091 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.5714e-05 2024-02-19T21:55:50.091 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.091 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.092 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:55:50.092 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654410+0000", 2024-02-19T21:55:50.092 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.2627521640000001 2024-02-19T21:55:50.092 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.092 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:55:50.092 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.092 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.092 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.092 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:216537 9.1 9:8be6914d:::benchmark_data_smithi080_126364_object87945:head [delete] snapc 0=[] ondisk+write+known_if_redirected e355)", 2024-02-19T21:55:50.092 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:47:32.391974+0000", 2024-02-19T21:55:50.092 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 497.67476804, 2024-02-19T21:55:50.092 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.26270266, 2024-02-19T21:55:50.092 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:55:50.092 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:50.093 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:55:50.093 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:55:50.093 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:55:50.093 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 216537 2024-02-19T21:55:50.093 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.093 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:55:50.093 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.093 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:55:50.093 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391974+0000", 2024-02-19T21:55:50.093 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:55:50.093 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.094 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.094 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:55:50.094 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391974+0000", 2024-02-19T21:55:50.094 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:55:50.094 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.094 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.094 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:55:50.094 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391973+0000", 2024-02-19T21:55:50.094 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.7809999999999999e-06 2024-02-19T21:55:50.094 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.094 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.095 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:55:50.095 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391977+0000", 2024-02-19T21:55:50.095 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.7260000000000002e-06 2024-02-19T21:55:50.095 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.095 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.095 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:55:50.095 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391985+0000", 2024-02-19T21:55:50.095 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.6129999999999997e-06 2024-02-19T21:55:50.095 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.095 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.095 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:55:50.095 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.391989+0000", 2024-02-19T21:55:50.095 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1888000000000001e-05 2024-02-19T21:55:50.095 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.096 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.096 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.096 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.392011+0000", 2024-02-19T21:55:50.096 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.5810000000000001e-06 2024-02-19T21:55:50.096 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.096 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.096 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:55:50.096 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.392015+0000", 2024-02-19T21:55:50.096 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.99341806200000005 2024-02-19T21:55:50.096 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.096 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.096 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.096 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:33.385433+0000", 2024-02-19T21:55:50.096 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.097e-06 2024-02-19T21:55:50.097 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.097 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.097 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:55:50.097 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:33.385440+0000", 2024-02-19T21:55:50.097 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.252371409 2024-02-19T21:55:50.097 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.097 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.097 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.097 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.637811+0000", 2024-02-19T21:55:50.097 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.6497999999999998e-05 2024-02-19T21:55:50.097 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.097 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.097 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:55:50.097 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.637898+0000", 2024-02-19T21:55:50.098 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014574100000000001 2024-02-19T21:55:50.098 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.098 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.098 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 2,3,4", 2024-02-19T21:55:50.098 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.638044+0000", 2024-02-19T21:55:50.098 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.010460565 2024-02-19T21:55:50.098 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.098 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.098 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:55:50.098 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.648504+0000", 2024-02-19T21:55:50.098 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0059303819999999997 2024-02-19T21:55:50.098 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.098 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.098 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.098 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654435+0000", 2024-02-19T21:55:50.099 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.9066e-05 2024-02-19T21:55:50.099 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.099 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.099 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.099 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654454+0000", 2024-02-19T21:55:50.099 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000106135 2024-02-19T21:55:50.099 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.099 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.099 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.099 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654560+0000", 2024-02-19T21:55:50.099 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.9955999999999999e-05 2024-02-19T21:55:50.099 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.099 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.099 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:55:50.099 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654590+0000", 2024-02-19T21:55:50.100 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.6743000000000006e-05 2024-02-19T21:55:50.100 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.100 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.100 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:55:50.100 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654676+0000", 2024-02-19T21:55:50.100 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.26270266 2024-02-19T21:55:50.100 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.100 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:55:50.100 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.100 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.100 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.100 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:216572 9.1 9:839b6075:::benchmark_data_smithi080_126364_object87980:head [delete] snapc 0=[] ondisk+write+known_if_redirected e355)", 2024-02-19T21:55:50.100 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:47:32.446303+0000", 2024-02-19T21:55:50.100 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 497.62043878700001, 2024-02-19T21:55:50.101 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.2085847759999999, 2024-02-19T21:55:50.101 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:55:50.101 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:50.101 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:55:50.101 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:55:50.101 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:55:50.101 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 216572 2024-02-19T21:55:50.101 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.101 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:55:50.101 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.101 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:55:50.101 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.446303+0000", 2024-02-19T21:55:50.101 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:55:50.101 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.102 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.102 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:55:50.102 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.446303+0000", 2024-02-19T21:55:50.102 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:55:50.102 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.102 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.102 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:55:50.102 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.446301+0000", 2024-02-19T21:55:50.102 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.5910000000000002e-06 2024-02-19T21:55:50.102 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.102 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.102 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:55:50.102 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.446311+0000", 2024-02-19T21:55:50.102 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.7887999999999999e-05 2024-02-19T21:55:50.102 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.103 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.103 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:55:50.103 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.446329+0000", 2024-02-19T21:55:50.103 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.1659999999999994e-06 2024-02-19T21:55:50.103 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.103 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.103 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:55:50.103 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.446337+0000", 2024-02-19T21:55:50.103 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.6020999999999998e-05 2024-02-19T21:55:50.103 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.103 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.103 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.103 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.446393+0000", 2024-02-19T21:55:50.103 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.401e-06 2024-02-19T21:55:50.104 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.104 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.104 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:55:50.104 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.446400+0000", 2024-02-19T21:55:50.104 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.93906151400000004 2024-02-19T21:55:50.104 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.104 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.104 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.104 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:33.385462+0000", 2024-02-19T21:55:50.104 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.131e-06 2024-02-19T21:55:50.104 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.104 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.105 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:55:50.105 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:33.385469+0000", 2024-02-19T21:55:50.105 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2550593160000001 2024-02-19T21:55:50.105 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.105 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.105 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.105 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.640528+0000", 2024-02-19T21:55:50.105 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000111433 2024-02-19T21:55:50.105 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.105 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.105 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:55:50.105 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.640640+0000", 2024-02-19T21:55:50.105 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000146148 2024-02-19T21:55:50.105 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.106 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.106 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 2,3,4", 2024-02-19T21:55:50.106 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.640786+0000", 2024-02-19T21:55:50.106 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0077245250000000003 2024-02-19T21:55:50.106 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.106 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.106 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:55:50.106 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.648510+0000", 2024-02-19T21:55:50.106 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0059610280000000002 2024-02-19T21:55:50.106 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.106 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.106 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.106 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654471+0000", 2024-02-19T21:55:50.106 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.7240000000000001e-05 2024-02-19T21:55:50.107 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.107 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.107 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.107 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654489+0000", 2024-02-19T21:55:50.107 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00030847300000000003 2024-02-19T21:55:50.107 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.107 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.107 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.107 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654797+0000", 2024-02-19T21:55:50.107 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.8161999999999999e-05 2024-02-19T21:55:50.107 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.107 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.107 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:55:50.107 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654825+0000", 2024-02-19T21:55:50.108 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.2558999999999995e-05 2024-02-19T21:55:50.108 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.108 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.108 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:55:50.108 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654888+0000", 2024-02-19T21:55:50.108 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.2085847759999999 2024-02-19T21:55:50.108 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.108 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:55:50.108 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.108 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.108 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.108 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.15345.0:216594 9.1 9:83201e12:::benchmark_data_smithi080_126364_object88002:head [delete] snapc 0=[] ondisk+write+known_if_redirected e355)", 2024-02-19T21:55:50.108 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:47:32.501232+0000", 2024-02-19T21:55:50.108 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 497.56551015600002, 2024-02-19T21:55:50.108 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1537618759999999, 2024-02-19T21:55:50.109 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:55:50.109 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:50.109 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:55:50.109 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.15345", 2024-02-19T21:55:50.109 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/1383268552", 2024-02-19T21:55:50.109 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 216594 2024-02-19T21:55:50.109 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.109 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:55:50.109 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.109 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:55:50.109 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.501232+0000", 2024-02-19T21:55:50.109 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:55:50.109 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.109 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.110 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:55:50.110 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.501232+0000", 2024-02-19T21:55:50.110 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:55:50.110 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.110 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.110 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:55:50.110 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.501230+0000", 2024-02-19T21:55:50.110 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0129000000000001e-05 2024-02-19T21:55:50.110 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.110 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.110 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:55:50.110 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.501240+0000", 2024-02-19T21:55:50.110 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.7666999999999999e-05 2024-02-19T21:55:50.111 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.111 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.111 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:55:50.111 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.501258+0000", 2024-02-19T21:55:50.111 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.2890000000000003e-06 2024-02-19T21:55:50.111 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.111 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.111 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:55:50.111 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.501264+0000", 2024-02-19T21:55:50.111 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.3189999999999996e-05 2024-02-19T21:55:50.111 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.111 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.111 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.111 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.501337+0000", 2024-02-19T21:55:50.112 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1871e-05 2024-02-19T21:55:50.112 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.112 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.112 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:55:50.112 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:32.501349+0000", 2024-02-19T21:55:50.112 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.88478064000000001 2024-02-19T21:55:50.112 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.112 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.112 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.112 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:33.386130+0000", 2024-02-19T21:55:50.112 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.8720000000000008e-06 2024-02-19T21:55:50.112 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.112 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.112 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:55:50.113 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:33.386138+0000", 2024-02-19T21:55:50.113 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2562803220000001 2024-02-19T21:55:50.113 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.113 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.113 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.113 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.642419+0000", 2024-02-19T21:55:50.113 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.6604000000000001e-05 2024-02-19T21:55:50.113 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.113 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.113 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:55:50.113 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.642485+0000", 2024-02-19T21:55:50.113 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.5158e-05 2024-02-19T21:55:50.113 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.113 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.113 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 2,3,4", 2024-02-19T21:55:50.114 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.642570+0000", 2024-02-19T21:55:50.114 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.005945868 2024-02-19T21:55:50.114 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.114 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.114 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:55:50.114 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.648516+0000", 2024-02-19T21:55:50.114 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0059971670000000003 2024-02-19T21:55:50.114 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.114 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.114 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.114 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654514+0000", 2024-02-19T21:55:50.114 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.8680999999999999e-05 2024-02-19T21:55:50.115 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.115 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.115 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.115 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654542+0000", 2024-02-19T21:55:50.115 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00036769100000000001 2024-02-19T21:55:50.115 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.115 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.115 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.115 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654910+0000", 2024-02-19T21:55:50.115 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.4502999999999999e-05 2024-02-19T21:55:50.115 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.115 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.115 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:55:50.115 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654934+0000", 2024-02-19T21:55:50.115 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.9169999999999998e-05 2024-02-19T21:55:50.116 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.116 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.116 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:55:50.116 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:47:34.654994+0000", 2024-02-19T21:55:50.116 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.1537618759999999 2024-02-19T21:55:50.116 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.116 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:55:50.116 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.116 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.116 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.116 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:79711 10.f 10:fbc66f72:::benchmark_data_smithi080_153340_object4961:head [delete] snapc 0=[] ondisk+write+known_if_redirected e440)", 2024-02-19T21:55:50.116 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:51:04.473413+0000", 2024-02-19T21:55:50.116 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 285.59332908900001, 2024-02-19T21:55:50.117 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.93658497500000004, 2024-02-19T21:55:50.117 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:55:50.117 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:50.117 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:55:50.117 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:55:50.117 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:55:50.117 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 79711 2024-02-19T21:55:50.117 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.117 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:55:50.117 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.117 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:55:50.117 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:04.473413+0000", 2024-02-19T21:55:50.117 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:55:50.117 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.117 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.118 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:55:50.118 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:04.473413+0000", 2024-02-19T21:55:50.118 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:55:50.118 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.118 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.118 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:55:50.118 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:04.473411+0000", 2024-02-19T21:55:50.118 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.1620000000000008e-06 2024-02-19T21:55:50.118 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.118 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.118 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:55:50.118 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:04.473419+0000", 2024-02-19T21:55:50.118 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.5668999999999999e-05 2024-02-19T21:55:50.118 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.118 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.119 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:55:50.119 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:04.473435+0000", 2024-02-19T21:55:50.119 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.9109999999999998e-06 2024-02-19T21:55:50.119 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.119 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.119 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:55:50.119 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:04.473441+0000", 2024-02-19T21:55:50.119 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.7632e-05 2024-02-19T21:55:50.119 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.119 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.119 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.119 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:04.473498+0000", 2024-02-19T21:55:50.119 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.0893999999999999e-05 2024-02-19T21:55:50.120 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.120 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.120 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:55:50.120 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:04.473509+0000", 2024-02-19T21:55:50.120 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.93029979600000001 2024-02-19T21:55:50.121 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.121 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.121 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.121 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.403809+0000", 2024-02-19T21:55:50.121 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000104923 2024-02-19T21:55:50.121 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.121 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.122 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:55:50.122 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.403914+0000", 2024-02-19T21:55:50.122 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.3839999999999996e-05 2024-02-19T21:55:50.122 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.122 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.122 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 2,4", 2024-02-19T21:55:50.123 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.404008+0000", 2024-02-19T21:55:50.123 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0055697730000000001 2024-02-19T21:55:50.123 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.123 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.123 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:55:50.124 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.409578+0000", 2024-02-19T21:55:50.124 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00021556 2024-02-19T21:55:50.124 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.124 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.124 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.124 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.409793+0000", 2024-02-19T21:55:50.124 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000108441 2024-02-19T21:55:50.125 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.125 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.125 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.125 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.409902+0000", 2024-02-19T21:55:50.125 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0413e-05 2024-02-19T21:55:50.125 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.125 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.126 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:55:50.126 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.409952+0000", 2024-02-19T21:55:50.126 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.5643999999999999e-05 2024-02-19T21:55:50.126 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.126 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.126 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:55:50.126 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.409998+0000", 2024-02-19T21:55:50.126 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.93658497500000004 2024-02-19T21:55:50.127 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.127 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:55:50.127 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.127 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.127 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.127 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:79802 10.f 10:f48ca55f:::benchmark_data_smithi080_153340_object5052:head [delete] snapc 0=[] ondisk+write+known_if_redirected e440)", 2024-02-19T21:55:50.127 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:51:05.228035+0000", 2024-02-19T21:55:50.128 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 284.83870647499998, 2024-02-19T21:55:50.128 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.182090638, 2024-02-19T21:55:50.128 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:55:50.128 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:50.128 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:55:50.128 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:55:50.128 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:55:50.129 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 79802 2024-02-19T21:55:50.129 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.129 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:55:50.129 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.129 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:55:50.129 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.228035+0000", 2024-02-19T21:55:50.129 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:55:50.130 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.130 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.130 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:55:50.130 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.228035+0000", 2024-02-19T21:55:50.130 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:55:50.130 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.130 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.131 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:55:50.131 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.228034+0000", 2024-02-19T21:55:50.131 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.1339999999999998e-06 2024-02-19T21:55:50.131 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.131 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.131 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:55:50.132 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.228041+0000", 2024-02-19T21:55:50.132 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1766999999999999e-05 2024-02-19T21:55:50.132 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.132 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.132 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:55:50.132 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.228053+0000", 2024-02-19T21:55:50.132 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.1329999999999998e-06 2024-02-19T21:55:50.132 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.132 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.133 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:55:50.133 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.228058+0000", 2024-02-19T21:55:50.133 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0040999999999998e-05 2024-02-19T21:55:50.133 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.133 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.133 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.133 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.228098+0000", 2024-02-19T21:55:50.133 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.1370000000000002e-06 2024-02-19T21:55:50.133 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.133 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.133 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for peered", 2024-02-19T21:55:50.134 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.228106+0000", 2024-02-19T21:55:50.134 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.17789721 2024-02-19T21:55:50.134 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.134 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.134 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.134 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.406003+0000", 2024-02-19T21:55:50.134 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000104949 2024-02-19T21:55:50.134 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.134 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.134 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:55:50.134 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.406108+0000", 2024-02-19T21:55:50.135 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.1636000000000002e-05 2024-02-19T21:55:50.135 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.135 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.135 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 2,4", 2024-02-19T21:55:50.135 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.406200+0000", 2024-02-19T21:55:50.135 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0036012940000000001 2024-02-19T21:55:50.136 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.136 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.136 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:55:50.136 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.409801+0000", 2024-02-19T21:55:50.136 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0569000000000003e-05 2024-02-19T21:55:50.136 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.136 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.136 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.136 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.409852+0000", 2024-02-19T21:55:50.137 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00021395299999999999 2024-02-19T21:55:50.137 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.137 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.137 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.137 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.410066+0000", 2024-02-19T21:55:50.137 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.6708999999999997e-05 2024-02-19T21:55:50.137 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.137 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.137 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:55:50.138 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.410103+0000", 2024-02-19T21:55:50.138 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.3492000000000001e-05 2024-02-19T21:55:50.138 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.138 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.138 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:55:50.138 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:51:05.410126+0000", 2024-02-19T21:55:50.138 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.182090638 2024-02-19T21:55:50.138 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.139 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:55:50.139 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.139 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.139 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.139 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:109349 10.a 10:515a8ea8:::benchmark_data_smithi080_153340_object34599:head [delete] snapc 0=[] ondisk+write+known_if_redirected e472)", 2024-02-19T21:55:50.139 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:52:37.929738+0000", 2024-02-19T21:55:50.139 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 192.13700360999999, 2024-02-19T21:55:50.139 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.220286757, 2024-02-19T21:55:50.140 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:55:50.140 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:50.140 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:55:50.140 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:55:50.140 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:55:50.140 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 109349 2024-02-19T21:55:50.140 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.141 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:55:50.141 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.141 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:55:50.141 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.929738+0000", 2024-02-19T21:55:50.141 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:55:50.141 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.141 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.142 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:55:50.142 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.929738+0000", 2024-02-19T21:55:50.142 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:55:50.142 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.142 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.142 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:55:50.143 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.929738+0000", 2024-02-19T21:55:50.143 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.6389999999999998e-06 2024-02-19T21:55:50.143 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.143 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.143 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:55:50.143 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.929741+0000", 2024-02-19T21:55:50.144 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.1570000000000003e-06 2024-02-19T21:55:50.144 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.144 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.144 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:55:50.144 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.929748+0000", 2024-02-19T21:55:50.144 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.7260000000000002e-06 2024-02-19T21:55:50.144 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.145 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.145 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:55:50.145 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.929753+0000", 2024-02-19T21:55:50.145 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.4177999999999997e-05 2024-02-19T21:55:50.145 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.145 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.145 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.145 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.929787+0000", 2024-02-19T21:55:50.145 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00010359 2024-02-19T21:55:50.145 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.145 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.145 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:55:50.145 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.929891+0000", 2024-02-19T21:55:50.146 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00011845699999999999 2024-02-19T21:55:50.146 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.146 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.146 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:55:50.146 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.930009+0000", 2024-02-19T21:55:50.146 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0049078660000000003 2024-02-19T21:55:50.146 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.147 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.147 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.147 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.934917+0000", 2024-02-19T21:55:50.147 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00073886600000000002 2024-02-19T21:55:50.147 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.147 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.148 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:55:50.148 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.935656+0000", 2024-02-19T21:55:50.148 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.214278995 2024-02-19T21:55:50.148 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.148 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.148 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.148 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:38.149935+0000", 2024-02-19T21:55:50.149 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0361000000000001e-05 2024-02-19T21:55:50.149 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.149 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.149 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:55:50.149 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:38.149985+0000", 2024-02-19T21:55:50.149 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.9505000000000002e-05 2024-02-19T21:55:50.150 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.150 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.150 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:55:50.150 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:38.150025+0000", 2024-02-19T21:55:50.150 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.220286757 2024-02-19T21:55:50.150 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.150 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:55:50.150 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.151 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.151 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.151 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:109363 10.7 10:e967b0cb:::benchmark_data_smithi080_153340_object34613:head [delete] snapc 0=[] ondisk+write+known_if_redirected e472)", 2024-02-19T21:55:50.151 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:52:37.939692+0000", 2024-02-19T21:55:50.151 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 192.12705013600001, 2024-02-19T21:55:50.151 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.205679572, 2024-02-19T21:55:50.151 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:55:50.151 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:50.151 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:55:50.152 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:55:50.152 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:55:50.152 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 109363 2024-02-19T21:55:50.152 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.152 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:55:50.152 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.152 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:55:50.152 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.939692+0000", 2024-02-19T21:55:50.153 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:55:50.153 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.153 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.153 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:55:50.153 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.939692+0000", 2024-02-19T21:55:50.153 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:55:50.153 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.153 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.153 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:55:50.154 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.939691+0000", 2024-02-19T21:55:50.154 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0810000000000001e-06 2024-02-19T21:55:50.154 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.154 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.154 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:55:50.154 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.939696+0000", 2024-02-19T21:55:50.154 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.6139999999999992e-06 2024-02-19T21:55:50.155 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.155 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.155 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:55:50.155 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.939705+0000", 2024-02-19T21:55:50.155 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.3659999999999997e-06 2024-02-19T21:55:50.155 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.155 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.155 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:55:50.156 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.939711+0000", 2024-02-19T21:55:50.156 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.5299999999999997e-05 2024-02-19T21:55:50.156 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.156 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.156 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.156 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.939746+0000", 2024-02-19T21:55:50.156 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.4979000000000002e-05 2024-02-19T21:55:50.156 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.156 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.156 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:55:50.156 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.939821+0000", 2024-02-19T21:55:50.156 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.6636000000000002e-05 2024-02-19T21:55:50.156 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.157 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.157 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 2,5", 2024-02-19T21:55:50.157 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.939908+0000", 2024-02-19T21:55:50.157 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0023383459999999998 2024-02-19T21:55:50.157 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.157 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.157 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:55:50.157 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.942246+0000", 2024-02-19T21:55:50.157 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.4654000000000005e-05 2024-02-19T21:55:50.157 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.157 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.157 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.157 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.942341+0000", 2024-02-19T21:55:50.157 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.20294132300000001 2024-02-19T21:55:50.157 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.158 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.158 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.158 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:38.145282+0000", 2024-02-19T21:55:50.158 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.8242000000000003e-05 2024-02-19T21:55:50.158 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.158 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.158 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:55:50.158 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:38.145330+0000", 2024-02-19T21:55:50.158 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0896000000000003e-05 2024-02-19T21:55:50.158 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.158 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.158 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:55:50.158 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:38.145371+0000", 2024-02-19T21:55:50.158 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.205679572 2024-02-19T21:55:50.158 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.159 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:55:50.159 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.159 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.159 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.159 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:109367 10.a 10:50cff11d:::benchmark_data_smithi080_153340_object34617:head [delete] snapc 0=[] ondisk+write+known_if_redirected e472)", 2024-02-19T21:55:50.159 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:52:37.944920+0000", 2024-02-19T21:55:50.159 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 192.12182136300001, 2024-02-19T21:55:50.159 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.211250562, 2024-02-19T21:55:50.159 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:55:50.159 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:50.160 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:55:50.160 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:55:50.160 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:55:50.160 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 109367 2024-02-19T21:55:50.160 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.160 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:55:50.161 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.161 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:55:50.161 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.944920+0000", 2024-02-19T21:55:50.161 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:55:50.161 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.161 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.161 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:55:50.162 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.944920+0000", 2024-02-19T21:55:50.162 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:55:50.162 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.162 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.162 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:55:50.162 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.944919+0000", 2024-02-19T21:55:50.162 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.7549999999999997e-06 2024-02-19T21:55:50.162 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.162 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.162 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:55:50.162 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.944926+0000", 2024-02-19T21:55:50.162 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1161e-05 2024-02-19T21:55:50.162 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.162 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.162 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:55:50.162 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.944937+0000", 2024-02-19T21:55:50.163 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.6609999999999999e-06 2024-02-19T21:55:50.163 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.163 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.163 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:55:50.163 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.944942+0000", 2024-02-19T21:55:50.163 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.6446999999999998e-05 2024-02-19T21:55:50.163 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.163 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.163 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.163 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.944978+0000", 2024-02-19T21:55:50.163 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.3213000000000004e-05 2024-02-19T21:55:50.163 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.163 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.163 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:55:50.163 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.945061+0000", 2024-02-19T21:55:50.164 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000114708 2024-02-19T21:55:50.164 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.164 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.164 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:55:50.164 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.945176+0000", 2024-02-19T21:55:50.164 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0021946489999999999 2024-02-19T21:55:50.164 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.164 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.164 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:55:50.164 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.947371+0000", 2024-02-19T21:55:50.164 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000392273 2024-02-19T21:55:50.164 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.164 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.164 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.165 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.947763+0000", 2024-02-19T21:55:50.165 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.20832546499999999 2024-02-19T21:55:50.165 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.165 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.165 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.165 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:38.156089+0000", 2024-02-19T21:55:50.165 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.265e-05 2024-02-19T21:55:50.165 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.165 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.165 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:55:50.166 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:38.156131+0000", 2024-02-19T21:55:50.166 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.9818999999999999e-05 2024-02-19T21:55:50.166 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.166 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.166 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:55:50.166 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:38.156171+0000", 2024-02-19T21:55:50.166 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.211250562 2024-02-19T21:55:50.166 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.166 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:55:50.166 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.166 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.166 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.166 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25511.0:109370 10.a 10:5b180d6a:::benchmark_data_smithi080_153340_object34620:head [delete] snapc 0=[] ondisk+write+known_if_redirected e472)", 2024-02-19T21:55:50.167 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:52:37.949038+0000", 2024-02-19T21:55:50.167 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 192.11770398600001, 2024-02-19T21:55:50.167 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.20775879799999999, 2024-02-19T21:55:50.167 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:55:50.167 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:50.167 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:55:50.167 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25511", 2024-02-19T21:55:50.167 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:55:50.167 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 109370 2024-02-19T21:55:50.167 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.167 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:55:50.167 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.167 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:55:50.167 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.949038+0000", 2024-02-19T21:55:50.167 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:55:50.167 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.168 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.168 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:55:50.168 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.949038+0000", 2024-02-19T21:55:50.168 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:55:50.168 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.168 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.168 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:55:50.168 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.949037+0000", 2024-02-19T21:55:50.168 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.4929999999999998e-06 2024-02-19T21:55:50.168 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.168 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.168 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:55:50.168 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.949042+0000", 2024-02-19T21:55:50.168 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2627e-05 2024-02-19T21:55:50.169 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.169 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.169 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:55:50.169 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.949055+0000", 2024-02-19T21:55:50.169 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.5819999999999998e-06 2024-02-19T21:55:50.169 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.169 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.169 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:55:50.169 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.949062+0000", 2024-02-19T21:55:50.169 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.2704000000000003e-05 2024-02-19T21:55:50.169 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.169 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.169 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.169 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.949104+0000", 2024-02-19T21:55:50.169 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000107923 2024-02-19T21:55:50.169 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.170 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.170 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:55:50.170 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.949212+0000", 2024-02-19T21:55:50.170 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013693399999999999 2024-02-19T21:55:50.170 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.170 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.170 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,5", 2024-02-19T21:55:50.170 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.949349+0000", 2024-02-19T21:55:50.170 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0023312939999999998 2024-02-19T21:55:50.170 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.170 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.170 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.170 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.951680+0000", 2024-02-19T21:55:50.170 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.5820999999999999e-05 2024-02-19T21:55:50.170 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.171 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.171 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:55:50.171 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:37.951706+0000", 2024-02-19T21:55:50.171 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.204998712 2024-02-19T21:55:50.171 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.171 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.171 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.171 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:38.156705+0000", 2024-02-19T21:55:50.171 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.8798999999999998e-05 2024-02-19T21:55:50.171 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.171 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.171 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:55:50.171 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:38.156754+0000", 2024-02-19T21:55:50.171 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.2877000000000003e-05 2024-02-19T21:55:50.171 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.172 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.172 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:55:50.172 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:52:38.156797+0000", 2024-02-19T21:55:50.172 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.20775879799999999 2024-02-19T21:55:50.172 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.172 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:55:50.172 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.172 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.172 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.172 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25952.0:71731 11.1 11:8066d4a7:::benchmark_data_smithi080_184406_object71730:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e510)", 2024-02-19T21:55:50.172 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:54:41.218445+0000", 2024-02-19T21:55:50.172 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 68.848297290999994, 2024-02-19T21:55:50.172 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.245158088, 2024-02-19T21:55:50.173 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:55:50.173 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:50.173 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:55:50.173 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25952", 2024-02-19T21:55:50.173 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:55:50.173 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 71731 2024-02-19T21:55:50.173 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.173 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:55:50.173 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.173 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:55:50.173 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.218445+0000", 2024-02-19T21:55:50.173 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:55:50.173 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.173 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.174 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:55:50.174 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.218445+0000", 2024-02-19T21:55:50.174 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:55:50.174 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.174 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.174 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:55:50.174 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.218444+0000", 2024-02-19T21:55:50.174 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.6602e-05 2024-02-19T21:55:50.174 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.174 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.174 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:55:50.174 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.218470+0000", 2024-02-19T21:55:50.174 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.3079999999999997e-06 2024-02-19T21:55:50.174 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.174 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.175 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:55:50.175 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.218479+0000", 2024-02-19T21:55:50.175 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.6519999999999997e-06 2024-02-19T21:55:50.175 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.175 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.175 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:55:50.175 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.218484+0000", 2024-02-19T21:55:50.175 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.002623907 2024-02-19T21:55:50.175 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.175 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.175 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.175 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.221108+0000", 2024-02-19T21:55:50.175 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.3502e-05 2024-02-19T21:55:50.176 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.176 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.176 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:55:50.176 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.221202+0000", 2024-02-19T21:55:50.176 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000119311 2024-02-19T21:55:50.176 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.176 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.176 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,2", 2024-02-19T21:55:50.176 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.221321+0000", 2024-02-19T21:55:50.176 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0077023430000000004 2024-02-19T21:55:50.176 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.177 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.177 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.177 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.229023+0000", 2024-02-19T21:55:50.177 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000158844 2024-02-19T21:55:50.177 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.177 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.177 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:55:50.177 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.229182+0000", 2024-02-19T21:55:50.177 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.23431769499999999 2024-02-19T21:55:50.177 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.178 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.178 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.178 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.463500+0000", 2024-02-19T21:55:50.178 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.5992999999999997e-05 2024-02-19T21:55:50.178 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.178 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.178 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:55:50.178 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.463556+0000", 2024-02-19T21:55:50.178 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.6913000000000003e-05 2024-02-19T21:55:50.178 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.178 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.178 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:55:50.179 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.463603+0000", 2024-02-19T21:55:50.179 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.245158088 2024-02-19T21:55:50.179 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.179 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:55:50.179 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.179 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.179 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.179 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25952.0:71732 11.1 11:83548464:::benchmark_data_smithi080_184406_object71731:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e510)", 2024-02-19T21:55:50.179 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:54:41.219304+0000", 2024-02-19T21:55:50.179 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 68.847438107000002, 2024-02-19T21:55:50.179 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.24759624599999999, 2024-02-19T21:55:50.179 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:55:50.179 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:50.179 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:55:50.180 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25952", 2024-02-19T21:55:50.180 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:55:50.180 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 71732 2024-02-19T21:55:50.180 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.180 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:55:50.180 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.180 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:55:50.180 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.219304+0000", 2024-02-19T21:55:50.180 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:55:50.180 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.180 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.180 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:55:50.180 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.219304+0000", 2024-02-19T21:55:50.180 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:55:50.181 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.181 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.181 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:55:50.181 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.219303+0000", 2024-02-19T21:55:50.181 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.5500000000000001e-05 2024-02-19T21:55:50.181 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.181 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.181 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:55:50.181 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.219358+0000", 2024-02-19T21:55:50.181 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.1236000000000001e-05 2024-02-19T21:55:50.181 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.181 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.181 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:55:50.181 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.219369+0000", 2024-02-19T21:55:50.182 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.3999999999999997e-06 2024-02-19T21:55:50.182 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.182 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.182 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:55:50.182 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.219376+0000", 2024-02-19T21:55:50.182 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0066811329999999997 2024-02-19T21:55:50.182 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.183 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.183 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.183 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.226057+0000", 2024-02-19T21:55:50.183 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00012360600000000001 2024-02-19T21:55:50.183 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.183 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.183 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:55:50.183 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.226181+0000", 2024-02-19T21:55:50.183 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00017114100000000001 2024-02-19T21:55:50.183 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.183 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.183 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,2", 2024-02-19T21:55:50.183 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.226352+0000", 2024-02-19T21:55:50.183 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0027069559999999999 2024-02-19T21:55:50.183 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.184 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.184 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.184 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.229059+0000", 2024-02-19T21:55:50.184 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00047015799999999998 2024-02-19T21:55:50.184 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.184 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.184 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:55:50.184 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.229529+0000", 2024-02-19T21:55:50.185 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.237253241 2024-02-19T21:55:50.185 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.185 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.185 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.185 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.466782+0000", 2024-02-19T21:55:50.185 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.5906000000000002e-05 2024-02-19T21:55:50.185 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.185 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.185 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:55:50.185 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.466848+0000", 2024-02-19T21:55:50.185 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.2065999999999999e-05 2024-02-19T21:55:50.185 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.186 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.186 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:55:50.186 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.466900+0000", 2024-02-19T21:55:50.186 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.24759624599999999 2024-02-19T21:55:50.186 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.186 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:55:50.186 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.186 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.186 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.186 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25952.0:71759 11.1 11:811b71a6:::benchmark_data_smithi080_184406_object71758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e510)", 2024-02-19T21:55:50.186 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:54:41.250130+0000", 2024-02-19T21:55:50.186 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 68.816611526000003, 2024-02-19T21:55:50.186 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.216903502, 2024-02-19T21:55:50.187 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:55:50.187 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:50.187 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:55:50.187 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25952", 2024-02-19T21:55:50.187 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:55:50.187 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 71759 2024-02-19T21:55:50.187 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.187 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:55:50.187 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.187 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:55:50.187 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.250130+0000", 2024-02-19T21:55:50.187 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:55:50.187 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.187 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.188 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:55:50.188 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.250130+0000", 2024-02-19T21:55:50.188 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:55:50.188 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.188 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.188 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:55:50.188 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.250129+0000", 2024-02-19T21:55:50.189 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.6515999999999999e-05 2024-02-19T21:55:50.189 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.189 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.189 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:55:50.189 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.250186+0000", 2024-02-19T21:55:50.189 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2948e-05 2024-02-19T21:55:50.189 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.189 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.189 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:55:50.189 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.250199+0000", 2024-02-19T21:55:50.189 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.3249999999999996e-06 2024-02-19T21:55:50.189 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.190 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.190 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:55:50.190 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.250205+0000", 2024-02-19T21:55:50.190 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.9685999999999998e-05 2024-02-19T21:55:50.190 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.190 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.190 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.190 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.250255+0000", 2024-02-19T21:55:50.190 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000127909 2024-02-19T21:55:50.190 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.190 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.190 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:55:50.190 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.250383+0000", 2024-02-19T21:55:50.190 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00015349600000000001 2024-02-19T21:55:50.190 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.191 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.191 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,2", 2024-02-19T21:55:50.191 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.250536+0000", 2024-02-19T21:55:50.191 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.002351765 2024-02-19T21:55:50.191 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.191 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.191 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.191 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.252888+0000", 2024-02-19T21:55:50.191 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.3078999999999998e-05 2024-02-19T21:55:50.191 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.191 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.191 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:55:50.191 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.252941+0000", 2024-02-19T21:55:50.191 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.21400550300000001 2024-02-19T21:55:50.191 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.192 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.192 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.192 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.466947+0000", 2024-02-19T21:55:50.192 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.9988999999999999e-05 2024-02-19T21:55:50.192 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.192 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.192 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:55:50.192 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.466997+0000", 2024-02-19T21:55:50.192 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.7233000000000001e-05 2024-02-19T21:55:50.193 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.193 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.193 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:55:50.193 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:54:41.467034+0000", 2024-02-19T21:55:50.193 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.216903502 2024-02-19T21:55:50.193 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.193 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:55:50.193 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.193 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.193 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.194 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25952.0:98808 11.3 11:cb6ab5e3:::benchmark_data_smithi080_184406_object98807:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e518)", 2024-02-19T21:55:50.194 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:55:07.806456+0000", 2024-02-19T21:55:50.194 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 42.260285932000002, 2024-02-19T21:55:50.194 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.17739488, 2024-02-19T21:55:50.194 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:55:50.194 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:50.194 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:55:50.194 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25952", 2024-02-19T21:55:50.194 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:55:50.195 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 98808 2024-02-19T21:55:50.195 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.195 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:55:50.195 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.195 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:55:50.195 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.806456+0000", 2024-02-19T21:55:50.195 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:55:50.195 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.196 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.196 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:55:50.196 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.806456+0000", 2024-02-19T21:55:50.196 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:55:50.196 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.196 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.196 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:55:50.196 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.806454+0000", 2024-02-19T21:55:50.196 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.1721999999999998e-05 2024-02-19T21:55:50.197 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.197 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.197 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:55:50.197 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.806496+0000", 2024-02-19T21:55:50.197 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2490999999999999e-05 2024-02-19T21:55:50.197 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.197 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.197 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:55:50.197 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.806508+0000", 2024-02-19T21:55:50.198 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.4159999999999998e-06 2024-02-19T21:55:50.198 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.198 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.198 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:55:50.198 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.806516+0000", 2024-02-19T21:55:50.198 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.001171971 2024-02-19T21:55:50.198 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.198 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.199 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.199 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.807688+0000", 2024-02-19T21:55:50.199 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000141061 2024-02-19T21:55:50.199 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.199 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.199 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:55:50.199 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.807829+0000", 2024-02-19T21:55:50.199 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00018173700000000001 2024-02-19T21:55:50.199 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.200 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.200 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 1,7", 2024-02-19T21:55:50.200 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.808011+0000", 2024-02-19T21:55:50.200 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0027273649999999998 2024-02-19T21:55:50.200 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.200 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.200 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:55:50.200 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.810738+0000", 2024-02-19T21:55:50.200 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 9.8047000000000005e-05 2024-02-19T21:55:50.201 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.201 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.201 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.201 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.810836+0000", 2024-02-19T21:55:50.201 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.172925778 2024-02-19T21:55:50.201 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.201 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.201 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.201 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.983762+0000", 2024-02-19T21:55:50.202 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.0309999999999998e-05 2024-02-19T21:55:50.202 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.202 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.202 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:55:50.202 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.983812+0000", 2024-02-19T21:55:50.202 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.8776000000000003e-05 2024-02-19T21:55:50.202 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.202 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.202 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:55:50.203 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.983851+0000", 2024-02-19T21:55:50.203 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.17739488 2024-02-19T21:55:50.203 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.203 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:55:50.203 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.203 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.203 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.203 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25952.0:98810 11.9 11:9d87bc04:::benchmark_data_smithi080_184406_object98809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e518)", 2024-02-19T21:55:50.203 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:55:07.811419+0000", 2024-02-19T21:55:50.204 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 42.255322691000003, 2024-02-19T21:55:50.204 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.17429333899999999, 2024-02-19T21:55:50.204 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:55:50.204 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:50.204 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:55:50.204 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25952", 2024-02-19T21:55:50.204 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:55:50.204 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 98810 2024-02-19T21:55:50.204 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.205 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:55:50.205 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.205 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:55:50.205 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.811419+0000", 2024-02-19T21:55:50.205 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:55:50.205 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.205 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.205 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:55:50.205 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.811419+0000", 2024-02-19T21:55:50.206 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:55:50.206 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.206 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.206 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:55:50.206 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.811418+0000", 2024-02-19T21:55:50.206 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 2.3983999999999999e-05 2024-02-19T21:55:50.206 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.206 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.206 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:55:50.207 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.811442+0000", 2024-02-19T21:55:50.207 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.1980000000000001e-06 2024-02-19T21:55:50.207 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.207 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.207 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:55:50.207 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.811450+0000", 2024-02-19T21:55:50.207 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.7260000000000002e-06 2024-02-19T21:55:50.207 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.207 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.207 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:55:50.207 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.811455+0000", 2024-02-19T21:55:50.207 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.5399999999999998e-05 2024-02-19T21:55:50.207 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.208 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.208 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.208 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.811510+0000", 2024-02-19T21:55:50.208 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00015324699999999999 2024-02-19T21:55:50.208 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.208 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.208 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:55:50.208 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.811664+0000", 2024-02-19T21:55:50.208 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00018393899999999999 2024-02-19T21:55:50.209 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.209 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.209 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:55:50.209 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.811847+0000", 2024-02-19T21:55:50.209 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0054490490000000001 2024-02-19T21:55:50.209 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.209 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.209 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:55:50.209 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.817297+0000", 2024-02-19T21:55:50.209 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0026912080000000001 2024-02-19T21:55:50.209 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.210 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.210 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.210 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.819988+0000", 2024-02-19T21:55:50.210 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.16563035800000001 2024-02-19T21:55:50.210 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.210 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.210 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.210 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.985618+0000", 2024-02-19T21:55:50.210 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.7062999999999999e-05 2024-02-19T21:55:50.210 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.210 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.210 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:55:50.210 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.985675+0000", 2024-02-19T21:55:50.210 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.7344e-05 2024-02-19T21:55:50.211 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.211 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.211 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:55:50.211 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.985712+0000", 2024-02-19T21:55:50.211 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.17429333899999999 2024-02-19T21:55:50.211 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.211 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:55:50.211 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.211 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.211 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.212 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25952.0:98811 11.9 11:9b6cff80:::benchmark_data_smithi080_184406_object98810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e518)", 2024-02-19T21:55:50.212 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:55:07.811706+0000", 2024-02-19T21:55:50.212 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 42.255035945000003, 2024-02-19T21:55:50.212 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.176524501, 2024-02-19T21:55:50.212 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:55:50.212 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:50.212 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:55:50.212 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25952", 2024-02-19T21:55:50.212 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:55:50.212 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 98811 2024-02-19T21:55:50.212 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.212 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:55:50.212 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.213 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:55:50.213 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.811706+0000", 2024-02-19T21:55:50.213 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:55:50.213 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.213 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.213 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:55:50.213 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.811706+0000", 2024-02-19T21:55:50.213 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:55:50.213 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.213 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.213 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:55:50.213 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.811705+0000", 2024-02-19T21:55:50.214 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.0927999999999995e-05 2024-02-19T21:55:50.214 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.214 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.214 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:55:50.214 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.811786+0000", 2024-02-19T21:55:50.214 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.381e-05 2024-02-19T21:55:50.214 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.214 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.215 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:55:50.215 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.811799+0000", 2024-02-19T21:55:50.215 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.7789999999999998e-06 2024-02-19T21:55:50.215 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.215 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.215 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:55:50.215 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.811806+0000", 2024-02-19T21:55:50.215 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0027138489999999999 2024-02-19T21:55:50.215 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.216 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.216 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.216 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.814520+0000", 2024-02-19T21:55:50.216 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000118097 2024-02-19T21:55:50.216 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.216 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.216 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:55:50.216 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.814638+0000", 2024-02-19T21:55:50.216 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014852800000000001 2024-02-19T21:55:50.216 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.217 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.217 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:55:50.217 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.814787+0000", 2024-02-19T21:55:50.217 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.005143941 2024-02-19T21:55:50.217 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.217 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.217 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:55:50.217 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.819931+0000", 2024-02-19T21:55:50.217 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00076808499999999995 2024-02-19T21:55:50.217 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.217 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.217 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.217 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.820699+0000", 2024-02-19T21:55:50.217 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.167442439 2024-02-19T21:55:50.217 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.217 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.218 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.218 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.988141+0000", 2024-02-19T21:55:50.218 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.7781000000000002e-05 2024-02-19T21:55:50.218 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.218 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.218 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:55:50.218 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.988189+0000", 2024-02-19T21:55:50.218 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.1430999999999997e-05 2024-02-19T21:55:50.218 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.218 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.218 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:55:50.218 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.988230+0000", 2024-02-19T21:55:50.218 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.176524501 2024-02-19T21:55:50.218 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.219 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:55:50.219 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.219 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.219 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.219 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25952.0:98813 11.9 11:9a174646:::benchmark_data_smithi080_184406_object98812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e518)", 2024-02-19T21:55:50.219 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:55:07.811820+0000", 2024-02-19T21:55:50.220 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 42.254922215000001, 2024-02-19T21:55:50.220 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.17667843799999999, 2024-02-19T21:55:50.220 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:55:50.220 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:50.220 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:55:50.220 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25952", 2024-02-19T21:55:50.220 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:55:50.220 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 98813 2024-02-19T21:55:50.220 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.220 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:55:50.220 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.220 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:55:50.220 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.811820+0000", 2024-02-19T21:55:50.221 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:55:50.221 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.221 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.221 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:55:50.221 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.811820+0000", 2024-02-19T21:55:50.221 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999995 2024-02-19T21:55:50.221 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.221 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.221 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:55:50.221 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.811819+0000", 2024-02-19T21:55:50.221 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.3544e-05 2024-02-19T21:55:50.221 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.221 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.221 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:55:50.221 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.811883+0000", 2024-02-19T21:55:50.222 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.0399999999999993e-06 2024-02-19T21:55:50.222 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.222 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.222 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:55:50.222 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.811891+0000", 2024-02-19T21:55:50.222 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.5650000000000003e-06 2024-02-19T21:55:50.222 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.222 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.222 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:55:50.222 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.811895+0000", 2024-02-19T21:55:50.222 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0054976110000000003 2024-02-19T21:55:50.222 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.222 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.222 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.222 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.817393+0000", 2024-02-19T21:55:50.223 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000132304 2024-02-19T21:55:50.223 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.223 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.223 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:55:50.223 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.817525+0000", 2024-02-19T21:55:50.223 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00017356199999999999 2024-02-19T21:55:50.223 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.223 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.223 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,1", 2024-02-19T21:55:50.223 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.817699+0000", 2024-02-19T21:55:50.223 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.002387517 2024-02-19T21:55:50.223 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.223 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.223 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:55:50.224 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.820086+0000", 2024-02-19T21:55:50.224 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00076763999999999999 2024-02-19T21:55:50.224 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.224 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.224 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.224 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.820854+0000", 2024-02-19T21:55:50.224 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.16755625299999999 2024-02-19T21:55:50.224 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.224 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.224 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.224 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.988410+0000", 2024-02-19T21:55:50.224 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.8038999999999999e-05 2024-02-19T21:55:50.224 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.224 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.225 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:55:50.225 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.988458+0000", 2024-02-19T21:55:50.225 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.0024000000000002e-05 2024-02-19T21:55:50.225 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.225 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.225 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:55:50.225 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:07.988498+0000", 2024-02-19T21:55:50.225 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.17667843799999999 2024-02-19T21:55:50.225 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.225 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:55:50.225 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.225 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.225 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.225 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25952.0:132890 11.1 11:857b4014:::benchmark_data_smithi080_184406_object15281:head [delete] snapc 0=[] ondisk+write+known_if_redirected e530)", 2024-02-19T21:55:50.225 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:55:45.958158+0000", 2024-02-19T21:55:50.226 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 4.1085838189999997, 2024-02-19T21:55:50.226 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.168887807, 2024-02-19T21:55:50.226 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:55:50.226 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:55:50.226 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:55:50.226 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25952", 2024-02-19T21:55:50.226 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:55:50.226 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 132890 2024-02-19T21:55:50.226 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.226 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:55:50.226 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.226 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:55:50.226 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:45.958158+0000", 2024-02-19T21:55:50.227 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:55:50.227 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.227 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.227 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:55:50.227 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:45.958158+0000", 2024-02-19T21:55:50.227 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.999999 2024-02-19T21:55:50.227 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.227 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.227 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:55:50.227 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:45.958157+0000", 2024-02-19T21:55:50.227 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.7979999999999996e-06 2024-02-19T21:55:50.228 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.228 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.228 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:55:50.228 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:45.958162+0000", 2024-02-19T21:55:50.228 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.8249999999999994e-06 2024-02-19T21:55:50.228 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.228 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.228 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:55:50.228 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:45.958171+0000", 2024-02-19T21:55:50.228 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.8319999999999996e-06 2024-02-19T21:55:50.228 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.228 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.228 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:55:50.228 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:45.958176+0000", 2024-02-19T21:55:50.229 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0061853719999999997 2024-02-19T21:55:50.229 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.229 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.229 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:50.229 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:45.964361+0000", 2024-02-19T21:55:50.229 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000117012 2024-02-19T21:55:50.229 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.229 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.229 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:55:50.230 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:45.964478+0000", 2024-02-19T21:55:50.230 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00013521799999999999 2024-02-19T21:55:50.230 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.230 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.230 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 0,2", 2024-02-19T21:55:50.230 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:45.964613+0000", 2024-02-19T21:55:50.230 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.003026043 2024-02-19T21:55:50.230 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.230 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.230 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:55:50.230 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:45.967639+0000", 2024-02-19T21:55:50.230 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0067290889999999997 2024-02-19T21:55:50.231 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.231 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.231 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.231 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:45.974368+0000", 2024-02-19T21:55:50.231 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.15258481099999999 2024-02-19T21:55:50.231 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.231 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.231 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:50.231 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:46.126953+0000", 2024-02-19T21:55:50.231 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 5.4014000000000002e-05 2024-02-19T21:55:50.231 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.231 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.231 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "commit_sent", 2024-02-19T21:55:50.232 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:46.127007+0000", 2024-02-19T21:55:50.232 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 3.8716e-05 2024-02-19T21:55:50.232 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:50.232 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:50.232 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "done", 2024-02-19T21:55:50.232 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:46.127046+0000", 2024-02-19T21:55:50.232 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.168887807 2024-02-19T21:55:50.232 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.232 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:55:50.232 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.232 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:50.232 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:55:50.232 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:55:50.485 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:49.284737+0000 mgr.y (mgr.14514) 888 : cluster [DBG] pgmap v1151: 138 pgs: 138 active+clean; 6.3 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 666 op/s 2024-02-19T21:55:50.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:49.284737+0000 mgr.y (mgr.14514) 888 : cluster [DBG] pgmap v1151: 138 pgs: 138 active+clean; 6.3 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 666 op/s 2024-02-19T21:55:50.773 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:49.284737+0000 mgr.y (mgr.14514) 888 : cluster [DBG] pgmap v1151: 138 pgs: 138 active+clean; 6.3 GiB data, 24 GiB used, 691 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 666 op/s 2024-02-19T21:55:50.773 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:55:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:55:50] "GET /metrics HTTP/1.1" 200 176816 "" "Prometheus/2.33.4" 2024-02-19T21:55:51.557 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:55:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:55:51.659 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:55:51.695 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:55:51.705 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:51.705 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:55:51.806 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:55:51.859 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:52.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:51.285470+0000 mgr.y (mgr.14514) 889 : cluster [DBG] pgmap v1152: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 6.0 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 968 op/s 2024-02-19T21:55:52.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:51.308175+0000 mgr.y (mgr.14514) 890 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:55:52.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:51.587362+0000 osd.3 (osd.3) 256 : cluster [DBG] 11.a scrub ok 2024-02-19T21:55:52.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:51.707980+0000 osd.0 (osd.0) 311 : cluster [DBG] 6.11 scrub starts 2024-02-19T21:55:52.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:51.733284+0000 osd.0 (osd.0) 312 : cluster [DBG] 6.11 scrub ok 2024-02-19T21:55:52.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:51.285470+0000 mgr.y (mgr.14514) 889 : cluster [DBG] pgmap v1152: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 6.0 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 968 op/s 2024-02-19T21:55:52.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:51.308175+0000 mgr.y (mgr.14514) 890 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:55:52.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:51.587362+0000 osd.3 (osd.3) 256 : cluster [DBG] 11.a scrub ok 2024-02-19T21:55:52.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:51.707980+0000 osd.0 (osd.0) 311 : cluster [DBG] 6.11 scrub starts 2024-02-19T21:55:52.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:51.733284+0000 osd.0 (osd.0) 312 : cluster [DBG] 6.11 scrub ok 2024-02-19T21:55:52.805 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:51.285470+0000 mgr.y (mgr.14514) 889 : cluster [DBG] pgmap v1152: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 6.0 GiB data, 24 GiB used, 692 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 968 op/s 2024-02-19T21:55:52.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:51.308175+0000 mgr.y (mgr.14514) 890 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:55:52.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:51.587362+0000 osd.3 (osd.3) 256 : cluster [DBG] 11.a scrub ok 2024-02-19T21:55:52.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:51.707980+0000 osd.0 (osd.0) 311 : cluster [DBG] 6.11 scrub starts 2024-02-19T21:55:52.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:51.733284+0000 osd.0 (osd.0) 312 : cluster [DBG] 6.11 scrub ok 2024-02-19T21:55:52.840 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:55:52.844 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:52.845 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:55:52.862 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.7 dump_ops_in_flight 2024-02-19T21:55:52.946 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:55:52.990 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:53.312 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:55:53.535 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-02-19T21:55:53.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:51.853253+0000 osd.1 (osd.1) 276 : cluster [DBG] 6.1d scrub starts 2024-02-19T21:55:53.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:51.949086+0000 osd.1 (osd.1) 277 : cluster [DBG] 6.1d scrub ok 2024-02-19T21:55:53.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:52.452970+0000 osd.3 (osd.3) 257 : cluster [DBG] 4.14 scrub starts 2024-02-19T21:55:53.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:52.454885+0000 osd.3 (osd.3) 258 : cluster [DBG] 4.14 scrub ok 2024-02-19T21:55:53.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:52.649352+0000 osd.2 (osd.2) 55 : cluster [DBG] 5.d scrub starts 2024-02-19T21:55:53.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:52.652377+0000 osd.2 (osd.2) 56 : cluster [DBG] 5.d scrub ok 2024-02-19T21:55:53.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:52.862264+0000 mon.b (mon.1) 82 : audit [INF] from='client.? 172.21.15.80:0/2421839617' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:55:53.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:52.862866+0000 mon.a (mon.0) 1980 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:55:53.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:52.892257+0000 osd.7 (osd.7) 293 : cluster [DBG] 6.5 scrub starts 2024-02-19T21:55:53.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:52.927929+0000 osd.7 (osd.7) 294 : cluster [DBG] 6.5 scrub ok 2024-02-19T21:55:53.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:51.853253+0000 osd.1 (osd.1) 276 : cluster [DBG] 6.1d scrub starts 2024-02-19T21:55:53.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:51.949086+0000 osd.1 (osd.1) 277 : cluster [DBG] 6.1d scrub ok 2024-02-19T21:55:53.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:52.452970+0000 osd.3 (osd.3) 257 : cluster [DBG] 4.14 scrub starts 2024-02-19T21:55:53.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:52.454885+0000 osd.3 (osd.3) 258 : cluster [DBG] 4.14 scrub ok 2024-02-19T21:55:53.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:52.649352+0000 osd.2 (osd.2) 55 : cluster [DBG] 5.d scrub starts 2024-02-19T21:55:53.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:52.652377+0000 osd.2 (osd.2) 56 : cluster [DBG] 5.d scrub ok 2024-02-19T21:55:53.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:52.862264+0000 mon.b (mon.1) 82 : audit [INF] from='client.? 172.21.15.80:0/2421839617' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:55:53.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:52.862866+0000 mon.a (mon.0) 1980 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:55:53.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:52.892257+0000 osd.7 (osd.7) 293 : cluster [DBG] 6.5 scrub starts 2024-02-19T21:55:53.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:52.927929+0000 osd.7 (osd.7) 294 : cluster [DBG] 6.5 scrub ok 2024-02-19T21:55:53.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:51.853253+0000 osd.1 (osd.1) 276 : cluster [DBG] 6.1d scrub starts 2024-02-19T21:55:53.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:51.949086+0000 osd.1 (osd.1) 277 : cluster [DBG] 6.1d scrub ok 2024-02-19T21:55:53.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:52.452970+0000 osd.3 (osd.3) 257 : cluster [DBG] 4.14 scrub starts 2024-02-19T21:55:53.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:52.454885+0000 osd.3 (osd.3) 258 : cluster [DBG] 4.14 scrub ok 2024-02-19T21:55:53.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:52.649352+0000 osd.2 (osd.2) 55 : cluster [DBG] 5.d scrub starts 2024-02-19T21:55:53.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:52.652377+0000 osd.2 (osd.2) 56 : cluster [DBG] 5.d scrub ok 2024-02-19T21:55:53.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:52.862264+0000 mon.b (mon.1) 82 : audit [INF] from='client.? 172.21.15.80:0/2421839617' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:55:53.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:52.862866+0000 mon.a (mon.0) 1980 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:55:53.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:52.892257+0000 osd.7 (osd.7) 293 : cluster [DBG] 6.5 scrub starts 2024-02-19T21:55:53.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:52.927929+0000 osd.7 (osd.7) 294 : cluster [DBG] 6.5 scrub ok 2024-02-19T21:55:54.725 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:53.286008+0000 mgr.y (mgr.14514) 891 : cluster [DBG] pgmap v1153: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 6.0 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 943 op/s 2024-02-19T21:55:54.726 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:53.490826+0000 mon.a (mon.0) 1981 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:55:54.726 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:53.490857+0000 mon.a (mon.0) 1982 : cluster [INF] Cluster is now healthy 2024-02-19T21:55:54.726 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:53.517748+0000 mon.a (mon.0) 1983 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:55:54.726 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:53.517792+0000 mon.a (mon.0) 1984 : cluster [DBG] osdmap e531: 8 total, 8 up, 8 in 2024-02-19T21:55:54.726 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:53.542585+0000 osd.5 (osd.5) 309 : cluster [DBG] 11.7 scrub starts 2024-02-19T21:55:54.726 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:53.690962+0000 osd.2 (osd.2) 57 : cluster [DBG] 6.f scrub starts 2024-02-19T21:55:54.726 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:53.801338+0000 osd.2 (osd.2) 58 : cluster [DBG] 6.f scrub ok 2024-02-19T21:55:54.796 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:53.286008+0000 mgr.y (mgr.14514) 891 : cluster [DBG] pgmap v1153: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 6.0 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 943 op/s 2024-02-19T21:55:54.797 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:53.490826+0000 mon.a (mon.0) 1981 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:55:54.797 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:53.490857+0000 mon.a (mon.0) 1982 : cluster [INF] Cluster is now healthy 2024-02-19T21:55:54.797 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:53.517748+0000 mon.a (mon.0) 1983 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:55:54.797 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:53.517792+0000 mon.a (mon.0) 1984 : cluster [DBG] osdmap e531: 8 total, 8 up, 8 in 2024-02-19T21:55:54.797 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:53.542585+0000 osd.5 (osd.5) 309 : cluster [DBG] 11.7 scrub starts 2024-02-19T21:55:54.797 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:53.690962+0000 osd.2 (osd.2) 57 : cluster [DBG] 6.f scrub starts 2024-02-19T21:55:54.797 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:53.801338+0000 osd.2 (osd.2) 58 : cluster [DBG] 6.f scrub ok 2024-02-19T21:55:54.797 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:53.286008+0000 mgr.y (mgr.14514) 891 : cluster [DBG] pgmap v1153: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 6.0 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 943 op/s 2024-02-19T21:55:54.797 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:53.490826+0000 mon.a (mon.0) 1981 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:55:54.797 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:53.490857+0000 mon.a (mon.0) 1982 : cluster [INF] Cluster is now healthy 2024-02-19T21:55:54.797 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:53.517748+0000 mon.a (mon.0) 1983 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:55:54.798 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:53.517792+0000 mon.a (mon.0) 1984 : cluster [DBG] osdmap e531: 8 total, 8 up, 8 in 2024-02-19T21:55:54.798 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:53.542585+0000 osd.5 (osd.5) 309 : cluster [DBG] 11.7 scrub starts 2024-02-19T21:55:54.798 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:53.690962+0000 osd.2 (osd.2) 57 : cluster [DBG] 6.f scrub starts 2024-02-19T21:55:54.798 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:53.801338+0000 osd.2 (osd.2) 58 : cluster [DBG] 6.f scrub ok 2024-02-19T21:55:55.411 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:55:55.411 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [ 2024-02-19T21:55:55.411 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:55.411 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25952.0:141788 11.5 11:aa8889f1:::benchmark_data_smithi080_184406_object24179:head [delete] snapc 0=[] ondisk+write+known_if_redirected e531)", 2024-02-19T21:55:55.411 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:55:55.394304+0000", 2024-02-19T21:55:55.412 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.016824526999999999, 2024-02-19T21:55:55.412 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.016849105, 2024-02-19T21:55:55.412 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:55:55.412 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:55:55.412 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:55:55.412 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25952", 2024-02-19T21:55:55.412 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:55:55.412 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 141788 2024-02-19T21:55:55.412 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:55.412 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:55:55.412 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:55.412 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:55:55.412 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:55.394304+0000", 2024-02-19T21:55:55.412 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:55:55.413 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:55.413 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:55.413 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:55:55.413 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:55.394304+0000", 2024-02-19T21:55:55.413 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999986 2024-02-19T21:55:55.413 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:55.413 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:55.413 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:55:55.413 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:55.394302+0000", 2024-02-19T21:55:55.413 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 7.3379999999999999e-06 2024-02-19T21:55:55.413 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:55.413 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:55.413 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:55:55.413 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:55.394310+0000", 2024-02-19T21:55:55.414 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2183e-05 2024-02-19T21:55:55.414 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:55.414 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:55.414 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:55:55.414 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:55.394322+0000", 2024-02-19T21:55:55.414 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.618e-06 2024-02-19T21:55:55.414 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:55.414 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:55.414 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:55:55.414 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:55.394329+0000", 2024-02-19T21:55:55.414 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0022825660000000002 2024-02-19T21:55:55.414 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:55.414 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:55.414 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:55.415 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:55.396611+0000", 2024-02-19T21:55:55.415 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000110748 2024-02-19T21:55:55.415 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:55.415 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:55.415 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:55:55.415 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:55.396722+0000", 2024-02-19T21:55:55.415 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00012379599999999999 2024-02-19T21:55:55.415 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:55.415 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:55.415 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:55:55.415 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:55.396846+0000", 2024-02-19T21:55:55.415 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0076928999999999999 2024-02-19T21:55:55.415 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:55.416 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:55.416 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:55:55.416 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:55.404539+0000", 2024-02-19T21:55:55.416 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.010234587 2024-02-19T21:55:55.416 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:55.416 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:55:55.416 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:55.416 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:55.416 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:55.416 INFO:teuthology.orchestra.run.smithi157.stdout: "description": "osd_op(client.25952.0:141789 11.4 11:2823d564:::benchmark_data_smithi080_184406_object24180:head [delete] snapc 0=[] ondisk+write+known_if_redirected e531)", 2024-02-19T21:55:55.416 INFO:teuthology.orchestra.run.smithi157.stdout: "initiated_at": "2024-02-19T21:55:55.399525+0000", 2024-02-19T21:55:55.416 INFO:teuthology.orchestra.run.smithi157.stdout: "age": 0.011603218, 2024-02-19T21:55:55.416 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.011683384999999999, 2024-02-19T21:55:55.416 INFO:teuthology.orchestra.run.smithi157.stdout: "type_data": { 2024-02-19T21:55:55.417 INFO:teuthology.orchestra.run.smithi157.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:55:55.417 INFO:teuthology.orchestra.run.smithi157.stdout: "client_info": { 2024-02-19T21:55:55.417 INFO:teuthology.orchestra.run.smithi157.stdout: "client": "client.25952", 2024-02-19T21:55:55.417 INFO:teuthology.orchestra.run.smithi157.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:55:55.417 INFO:teuthology.orchestra.run.smithi157.stdout: "tid": 141789 2024-02-19T21:55:55.417 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:55.417 INFO:teuthology.orchestra.run.smithi157.stdout: "events": [ 2024-02-19T21:55:55.417 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:55.417 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "initiated", 2024-02-19T21:55:55.417 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:55.399525+0000", 2024-02-19T21:55:55.417 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0 2024-02-19T21:55:55.417 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:55.417 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:55.417 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "throttled", 2024-02-19T21:55:55.417 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:55.399525+0000", 2024-02-19T21:55:55.418 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4294967295.9999981 2024-02-19T21:55:55.418 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:55.418 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:55.418 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "header_read", 2024-02-19T21:55:55.418 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:55.399523+0000", 2024-02-19T21:55:55.418 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 8.5280000000000003e-06 2024-02-19T21:55:55.418 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:55.418 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:55.418 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "all_read", 2024-02-19T21:55:55.418 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:55.399532+0000", 2024-02-19T21:55:55.418 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 1.2743e-05 2024-02-19T21:55:55.418 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:55.418 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:55.419 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "dispatched", 2024-02-19T21:55:55.419 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:55.399545+0000", 2024-02-19T21:55:55.419 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 6.5230000000000001e-06 2024-02-19T21:55:55.419 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:55.419 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:55.419 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "queued_for_pg", 2024-02-19T21:55:55.419 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:55.399551+0000", 2024-02-19T21:55:55.419 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 4.9611999999999999e-05 2024-02-19T21:55:55.419 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:55.419 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:55.419 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "reached_pg", 2024-02-19T21:55:55.420 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:55.399601+0000", 2024-02-19T21:55:55.420 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.000121511 2024-02-19T21:55:55.420 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:55.420 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:55.420 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "started", 2024-02-19T21:55:55.420 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:55.399722+0000", 2024-02-19T21:55:55.420 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.00014324699999999999 2024-02-19T21:55:55.420 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:55.420 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:55.420 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "waiting for subops from 2,6", 2024-02-19T21:55:55.420 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:55.399866+0000", 2024-02-19T21:55:55.420 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0051611340000000004 2024-02-19T21:55:55.420 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:55.420 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:55.421 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "op_commit", 2024-02-19T21:55:55.421 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:55.405027+0000", 2024-02-19T21:55:55.421 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0029283740000000001 2024-02-19T21:55:55.421 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-19T21:55:55.421 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-02-19T21:55:55.421 INFO:teuthology.orchestra.run.smithi157.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:55:55.421 INFO:teuthology.orchestra.run.smithi157.stdout: "time": "2024-02-19T21:55:55.407955+0000", 2024-02-19T21:55:55.421 INFO:teuthology.orchestra.run.smithi157.stdout: "duration": 0.0084298140000000008 2024-02-19T21:55:55.421 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:55.421 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-19T21:55:55.421 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:55.421 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-19T21:55:55.422 INFO:teuthology.orchestra.run.smithi157.stdout: ], 2024-02-19T21:55:55.422 INFO:teuthology.orchestra.run.smithi157.stdout: "num_ops": 2 2024-02-19T21:55:55.422 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:55:55.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:54.888004+0000 osd.7 (osd.7) 295 : cluster [DBG] 6.8 scrub starts 2024-02-19T21:55:55.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:54.932210+0000 osd.7 (osd.7) 296 : cluster [DBG] 6.8 scrub ok 2024-02-19T21:55:55.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:55.430528+0000 mon.a (mon.0) 1985 : cluster [DBG] osdmap e532: 8 total, 8 up, 8 in 2024-02-19T21:55:55.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:54.888004+0000 osd.7 (osd.7) 295 : cluster [DBG] 6.8 scrub starts 2024-02-19T21:55:55.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:54.932210+0000 osd.7 (osd.7) 296 : cluster [DBG] 6.8 scrub ok 2024-02-19T21:55:55.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:55.430528+0000 mon.a (mon.0) 1985 : cluster [DBG] osdmap e532: 8 total, 8 up, 8 in 2024-02-19T21:55:55.806 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:55:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:55:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:55:55.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:54.888004+0000 osd.7 (osd.7) 295 : cluster [DBG] 6.8 scrub starts 2024-02-19T21:55:55.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:54.932210+0000 osd.7 (osd.7) 296 : cluster [DBG] 6.8 scrub ok 2024-02-19T21:55:55.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:55.430528+0000 mon.a (mon.0) 1985 : cluster [DBG] osdmap e532: 8 total, 8 up, 8 in 2024-02-19T21:55:56.046 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:55:56.189 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:55:56.199 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:56.199 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:55:56.300 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:55:56.345 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:56.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:55.286466+0000 mgr.y (mgr.14514) 892 : cluster [DBG] pgmap v1155: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 5.8 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 519 B/s rd, 0 B/s wr, 808 op/s 2024-02-19T21:55:56.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:56.310990+0000 osd.5 (osd.5) 310 : cluster [DBG] 11.7 scrub ok 2024-02-19T21:55:56.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:55.286466+0000 mgr.y (mgr.14514) 892 : cluster [DBG] pgmap v1155: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 5.8 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 519 B/s rd, 0 B/s wr, 808 op/s 2024-02-19T21:55:56.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:56.310990+0000 osd.5 (osd.5) 310 : cluster [DBG] 11.7 scrub ok 2024-02-19T21:55:56.619 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:55:56.624 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:56.625 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:55:56.725 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:55:56.776 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:56.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:55.286466+0000 mgr.y (mgr.14514) 892 : cluster [DBG] pgmap v1155: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 5.8 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 519 B/s rd, 0 B/s wr, 808 op/s 2024-02-19T21:55:56.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:56.310990+0000 osd.5 (osd.5) 310 : cluster [DBG] 11.7 scrub ok 2024-02-19T21:55:57.249 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:55:57.252 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:57.253 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:55:57.353 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:55:57.435 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:57.501 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:55:57.505 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:57.505 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:55:57.532 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.7 dump_blocked_ops 2024-02-19T21:55:57.551 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:55.943025+0000 osd.6 (osd.6) 282 : cluster [DBG] 11.1 scrub starts 2024-02-19T21:55:57.552 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:56.616370+0000 mon.c (mon.2) 129 : audit [INF] from='client.? 172.21.15.80:0/2635916025' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pgp_num", "val": "32"}]: dispatch 2024-02-19T21:55:57.552 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:56.616800+0000 mon.a (mon.0) 1986 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pgp_num", "val": "32"}]: dispatch 2024-02-19T21:55:57.573 INFO:teuthology.orchestra.run.smithi080.stderr:set pool 2 pgp_num to 32 2024-02-19T21:55:57.606 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:55:57.685 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:57.717 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:55:57.721 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:57.722 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:55:57.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:55.943025+0000 osd.6 (osd.6) 282 : cluster [DBG] 11.1 scrub starts 2024-02-19T21:55:57.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:56.616370+0000 mon.c (mon.2) 129 : audit [INF] from='client.? 172.21.15.80:0/2635916025' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pgp_num", "val": "32"}]: dispatch 2024-02-19T21:55:57.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:56.616800+0000 mon.a (mon.0) 1986 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pgp_num", "val": "32"}]: dispatch 2024-02-19T21:55:57.822 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:55:57.838 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:55.943025+0000 osd.6 (osd.6) 282 : cluster [DBG] 11.1 scrub starts 2024-02-19T21:55:57.838 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:56.616370+0000 mon.c (mon.2) 129 : audit [INF] from='client.? 172.21.15.80:0/2635916025' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pgp_num", "val": "32"}]: dispatch 2024-02-19T21:55:57.838 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:56.616800+0000 mon.a (mon.0) 1986 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pgp_num", "val": "32"}]: dispatch 2024-02-19T21:55:57.871 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:57.991 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:55:58.068 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set noscrub 2024-02-19T21:55:58.332 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:55:58.335 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:58.336 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:55:58.437 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:55:58.495 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:58.729 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:55:58.760 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:55:58.788 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:55:58.821 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:55:58.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:57.288657+0000 mgr.y (mgr.14514) 893 : cluster [DBG] pgmap v1157: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 5.7 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.11k op/s 2024-02-19T21:55:58.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:57.554441+0000 mon.a (mon.0) 1987 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pgp_num", "val": "32"}]': finished 2024-02-19T21:55:58.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:57.554513+0000 mon.a (mon.0) 1988 : cluster [DBG] osdmap e533: 8 total, 8 up, 8 in 2024-02-19T21:55:58.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:57.288657+0000 mgr.y (mgr.14514) 893 : cluster [DBG] pgmap v1157: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 5.7 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.11k op/s 2024-02-19T21:55:58.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:57.554441+0000 mon.a (mon.0) 1987 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pgp_num", "val": "32"}]': finished 2024-02-19T21:55:58.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:57.554513+0000 mon.a (mon.0) 1988 : cluster [DBG] osdmap e533: 8 total, 8 up, 8 in 2024-02-19T21:55:58.858 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:55:58.862 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:55:58.865 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:58.865 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:57.288657+0000 mgr.y (mgr.14514) 893 : cluster [DBG] pgmap v1157: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 5.7 GiB data, 23 GiB used, 692 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.11k op/s 2024-02-19T21:55:58.865 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:57.554441+0000 mon.a (mon.0) 1987 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": ".rgw.root", "var": "pgp_num", "val": "32"}]': finished 2024-02-19T21:55:58.866 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:57.554513+0000 mon.a (mon.0) 1988 : cluster [DBG] osdmap e533: 8 total, 8 up, 8 in 2024-02-19T21:55:58.866 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:55:58.894 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:55:58.920 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:55:58.978 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:55:58.979 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:55:58.979 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:55:58.979 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:55:58.979 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:55:58.979 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:55:58.979 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:55:58.979 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:55:58.979 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:55:58.980 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:55:59.029 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:55:59.784 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:55:59.788 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:55:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:55:58.701457+0000 mon.b (mon.1) 83 : audit [DBG] from='client.? 172.21.15.80:0/149771041' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:55:59.788 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:55:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:55:58.701457+0000 mon.b (mon.1) 83 : audit [DBG] from='client.? 172.21.15.80:0/149771041' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:55:59.980 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:55:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:55:58.701457+0000 mon.b (mon.1) 83 : audit [DBG] from='client.? 172.21.15.80:0/149771041' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:55:59.982 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:55:59.992 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:55:59.992 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:56:00.093 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:56:00.145 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:00.335 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:56:00.344 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:00.345 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:56:00.446 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:56:00.505 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:00.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:58.927251+0000 osd.6 (osd.6) 283 : cluster [DBG] 11.1 scrub ok 2024-02-19T21:56:00.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:59.289021+0000 mgr.y (mgr.14514) 894 : cluster [DBG] pgmap v1159: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 5.7 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 788 op/s 2024-02-19T21:56:00.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:59.413252+0000 osd.3 (osd.3) 259 : cluster [DBG] 6.b scrub starts 2024-02-19T21:56:00.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:59.528720+0000 osd.4 (osd.4) 249 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:56:00.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:59.541401+0000 osd.3 (osd.3) 260 : cluster [DBG] 6.b scrub ok 2024-02-19T21:56:00.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:59.586082+0000 osd.4 (osd.4) 250 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:56:00.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:59.653056+0000 osd.2 (osd.2) 59 : cluster [DBG] 2.10 scrub starts 2024-02-19T21:56:00.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:55:59.666674+0000 osd.2 (osd.2) 60 : cluster [DBG] 2.10 scrub ok 2024-02-19T21:56:00.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:00.434650+0000 mon.a (mon.0) 1989 : cluster [DBG] osdmap e534: 8 total, 8 up, 8 in 2024-02-19T21:56:00.648 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:56:00.651 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:00.652 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:56:00.753 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:56:00.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:58.927251+0000 osd.6 (osd.6) 283 : cluster [DBG] 11.1 scrub ok 2024-02-19T21:56:00.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:59.289021+0000 mgr.y (mgr.14514) 894 : cluster [DBG] pgmap v1159: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 5.7 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 788 op/s 2024-02-19T21:56:00.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:59.413252+0000 osd.3 (osd.3) 259 : cluster [DBG] 6.b scrub starts 2024-02-19T21:56:00.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:59.528720+0000 osd.4 (osd.4) 249 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:56:00.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:59.541401+0000 osd.3 (osd.3) 260 : cluster [DBG] 6.b scrub ok 2024-02-19T21:56:00.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:59.586082+0000 osd.4 (osd.4) 250 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:56:00.775 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:59.653056+0000 osd.2 (osd.2) 59 : cluster [DBG] 2.10 scrub starts 2024-02-19T21:56:00.775 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:55:59.666674+0000 osd.2 (osd.2) 60 : cluster [DBG] 2.10 scrub ok 2024-02-19T21:56:00.775 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:00.434650+0000 mon.a (mon.0) 1989 : cluster [DBG] osdmap e534: 8 total, 8 up, 8 in 2024-02-19T21:56:00.775 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:56:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:56:00] "GET /metrics HTTP/1.1" 200 176816 "" "Prometheus/2.33.4" 2024-02-19T21:56:00.775 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:58.927251+0000 osd.6 (osd.6) 283 : cluster [DBG] 11.1 scrub ok 2024-02-19T21:56:00.775 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:59.289021+0000 mgr.y (mgr.14514) 894 : cluster [DBG] pgmap v1159: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 5.7 GiB data, 23 GiB used, 693 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 788 op/s 2024-02-19T21:56:00.775 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:59.413252+0000 osd.3 (osd.3) 259 : cluster [DBG] 6.b scrub starts 2024-02-19T21:56:00.775 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:59.528720+0000 osd.4 (osd.4) 249 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:56:00.776 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:59.541401+0000 osd.3 (osd.3) 260 : cluster [DBG] 6.b scrub ok 2024-02-19T21:56:00.776 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:59.586082+0000 osd.4 (osd.4) 250 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:56:00.776 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:59.653056+0000 osd.2 (osd.2) 59 : cluster [DBG] 2.10 scrub starts 2024-02-19T21:56:00.776 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:55:59.666674+0000 osd.2 (osd.2) 60 : cluster [DBG] 2.10 scrub ok 2024-02-19T21:56:00.776 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:00.434650+0000 mon.a (mon.0) 1989 : cluster [DBG] osdmap e534: 8 total, 8 up, 8 in 2024-02-19T21:56:00.819 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:01.000 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:56:01.000 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:56:01.283 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:56:01.286 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:01.286 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:56:01.387 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:56:01.469 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:01.607 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:00.396856+0000 osd.3 (osd.3) 261 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:56:01.607 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:00.410819+0000 osd.3 (osd.3) 262 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:56:01.607 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:00.565394+0000 osd.5 (osd.5) 311 : cluster [DBG] 5.7 scrub starts 2024-02-19T21:56:01.607 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:00.578717+0000 osd.5 (osd.5) 312 : cluster [DBG] 5.7 scrub ok 2024-02-19T21:56:01.607 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:00.720017+0000 osd.3 (osd.3) 263 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:56:01.607 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:00.720067+0000 osd.3 (osd.3) 264 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:56:01.607 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:00.721202+0000 osd.0 (osd.0) 313 : cluster [DBG] 6.18 scrub starts 2024-02-19T21:56:01.608 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:56:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:56:01.816 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:56:01.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:00.396856+0000 osd.3 (osd.3) 261 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:56:01.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:00.410819+0000 osd.3 (osd.3) 262 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:56:01.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:00.565394+0000 osd.5 (osd.5) 311 : cluster [DBG] 5.7 scrub starts 2024-02-19T21:56:01.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:00.578717+0000 osd.5 (osd.5) 312 : cluster [DBG] 5.7 scrub ok 2024-02-19T21:56:01.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:00.720017+0000 osd.3 (osd.3) 263 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:56:01.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:00.720067+0000 osd.3 (osd.3) 264 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:56:01.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:00.721202+0000 osd.0 (osd.0) 313 : cluster [DBG] 6.18 scrub starts 2024-02-19T21:56:01.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:00.723540+0000 osd.0 (osd.0) 314 : cluster [DBG] 6.18 scrub ok 2024-02-19T21:56:01.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:00.396856+0000 osd.3 (osd.3) 261 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:56:01.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:00.410819+0000 osd.3 (osd.3) 262 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:56:01.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:00.565394+0000 osd.5 (osd.5) 311 : cluster [DBG] 5.7 scrub starts 2024-02-19T21:56:01.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:00.578717+0000 osd.5 (osd.5) 312 : cluster [DBG] 5.7 scrub ok 2024-02-19T21:56:01.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:00.720017+0000 osd.3 (osd.3) 263 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:56:01.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:00.720067+0000 osd.3 (osd.3) 264 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:56:01.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:00.721202+0000 osd.0 (osd.0) 313 : cluster [DBG] 6.18 scrub starts 2024-02-19T21:56:01.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:00.723540+0000 osd.0 (osd.0) 314 : cluster [DBG] 6.18 scrub ok 2024-02-19T21:56:02.061 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:00.723540+0000 osd.0 (osd.0) 314 : cluster [DBG] 6.18 scrub ok 2024-02-19T21:56:02.239 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:56:02.585 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.7 dump_historic_ops 2024-02-19T21:56:02.643 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:56:02.648 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:02.649 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:56:02.652 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-02-19T21:56:02.752 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:56:02.805 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:02.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:00.910569+0000 osd.6 (osd.6) 284 : cluster [DBG] 11.3 scrub starts 2024-02-19T21:56:02.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:01.290897+0000 mgr.y (mgr.14514) 895 : cluster [DBG] pgmap v1161: 138 pgs: 138 active+clean; 5.4 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.10k op/s 2024-02-19T21:56:02.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:01.322036+0000 mgr.y (mgr.14514) 896 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:56:02.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:01.603139+0000 mon.a (mon.0) 1990 : cluster [DBG] osdmap e535: 8 total, 8 up, 8 in 2024-02-19T21:56:02.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:02.112114+0000 mon.a (mon.0) 1991 : audit [INF] from='client.? 172.21.15.80:0/2525999902' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:56:02.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:00.910569+0000 osd.6 (osd.6) 284 : cluster [DBG] 11.3 scrub starts 2024-02-19T21:56:02.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:01.290897+0000 mgr.y (mgr.14514) 895 : cluster [DBG] pgmap v1161: 138 pgs: 138 active+clean; 5.4 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.10k op/s 2024-02-19T21:56:02.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:01.322036+0000 mgr.y (mgr.14514) 896 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:56:02.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:01.603139+0000 mon.a (mon.0) 1990 : cluster [DBG] osdmap e535: 8 total, 8 up, 8 in 2024-02-19T21:56:02.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:02.112114+0000 mon.a (mon.0) 1991 : audit [INF] from='client.? 172.21.15.80:0/2525999902' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:56:02.851 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:56:02.856 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:02.857 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:56:02.858 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:00.910569+0000 osd.6 (osd.6) 284 : cluster [DBG] 11.3 scrub starts 2024-02-19T21:56:02.858 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:01.290897+0000 mgr.y (mgr.14514) 895 : cluster [DBG] pgmap v1161: 138 pgs: 138 active+clean; 5.4 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1.10k op/s 2024-02-19T21:56:02.859 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:01.322036+0000 mgr.y (mgr.14514) 896 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:56:02.859 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:01.603139+0000 mon.a (mon.0) 1990 : cluster [DBG] osdmap e535: 8 total, 8 up, 8 in 2024-02-19T21:56:02.859 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:02.112114+0000 mon.a (mon.0) 1991 : audit [INF] from='client.? 172.21.15.80:0/2525999902' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:56:02.957 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:56:03.010 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:03.039 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:56:03.122 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:56:03.126 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:03.127 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:56:03.227 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:56:03.279 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:03.325 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:56:03.333 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:03.334 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:56:03.435 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:56:03.486 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:03.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:02.599729+0000 mon.a (mon.0) 1992 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:56:03.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:02.619060+0000 mon.a (mon.0) 1993 : audit [INF] from='client.? 172.21.15.80:0/2525999902' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:56:03.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:02.619129+0000 mon.a (mon.0) 1994 : cluster [DBG] osdmap e536: 8 total, 8 up, 8 in 2024-02-19T21:56:03.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:02.599729+0000 mon.a (mon.0) 1992 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:56:03.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:02.619060+0000 mon.a (mon.0) 1993 : audit [INF] from='client.? 172.21.15.80:0/2525999902' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:56:03.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:02.619129+0000 mon.a (mon.0) 1994 : cluster [DBG] osdmap e536: 8 total, 8 up, 8 in 2024-02-19T21:56:04.038 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 4, 5, 6, 7, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 6, 7, 2] 2024-02-19T21:56:04.039 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:56:04.039 INFO:tasks.thrashosds.thrasher:Shrinking pool device_health_metrics 2024-02-19T21:56:04.039 INFO:tasks.cephadm.ceph_manager.ceph:contract_pool device_health_metrics by 10 min 8 2024-02-19T21:56:04.039 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:56:04.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:02.599729+0000 mon.a (mon.0) 1992 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:56:04.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:02.619060+0000 mon.a (mon.0) 1993 : audit [INF] from='client.? 172.21.15.80:0/2525999902' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:56:04.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:02.619129+0000 mon.a (mon.0) 1994 : cluster [DBG] osdmap e536: 8 total, 8 up, 8 in 2024-02-19T21:56:04.713 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:03.291291+0000 mgr.y (mgr.14514) 897 : cluster [DBG] pgmap v1164: 138 pgs: 138 active+clean; 5.4 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 892 B/s rd, 0 B/s wr, 850 op/s 2024-02-19T21:56:04.857 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:56:04.863 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:04.864 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:56:04.949 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:03.291291+0000 mgr.y (mgr.14514) 897 : cluster [DBG] pgmap v1164: 138 pgs: 138 active+clean; 5.4 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 892 B/s rd, 0 B/s wr, 850 op/s 2024-02-19T21:56:04.949 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:03.291291+0000 mgr.y (mgr.14514) 897 : cluster [DBG] pgmap v1164: 138 pgs: 138 active+clean; 5.4 GiB data, 22 GiB used, 693 GiB / 715 GiB avail; 892 B/s rd, 0 B/s wr, 850 op/s 2024-02-19T21:56:04.965 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:56:05.004 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:05.087 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:56:05.087 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:56:06.059 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:56:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:56:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:56:06.073 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:56:06.079 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:06.079 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:56:06.180 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:56:06.247 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:06.601 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.2 dump_ops_in_flight 2024-02-19T21:56:06.638 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:56:06.642 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:06.643 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:56:06.739 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:56:06.744 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:56:06.787 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:06.817 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:56:06.820 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:06.820 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:56:06.921 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:56:06.980 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:05.291887+0000 mgr.y (mgr.14514) 898 : cluster [DBG] pgmap v1165: 138 pgs: 138 active+clean; 5.2 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1.22k op/s 2024-02-19T21:56:06.983 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:06.999 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:05.291887+0000 mgr.y (mgr.14514) 898 : cluster [DBG] pgmap v1165: 138 pgs: 138 active+clean; 5.2 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1.22k op/s 2024-02-19T21:56:07.000 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:05.291887+0000 mgr.y (mgr.14514) 898 : cluster [DBG] pgmap v1165: 138 pgs: 138 active+clean; 5.2 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1.22k op/s 2024-02-19T21:56:07.010 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:56:07.016 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:07.017 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:56:07.118 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:56:07.173 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:07.235 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:56:07.241 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:07.241 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:56:07.342 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:56:07.379 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:07.409 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:56:07.414 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:07.414 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:56:07.515 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:56:07.577 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:56:07.579 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:07.613 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:56:07.656 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:07.529961+0000 mon.c (mon.2) 130 : audit [DBG] from='client.? 172.21.15.80:0/3180275325' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:56:07.657 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:56:07.693 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:56:07.726 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:56:07.759 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:56:07.790 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:56:07.824 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:56:07.827 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:56:07.827 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:56:07.827 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:56:07.827 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:56:07.827 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:56:07.827 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:56:07.827 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:56:07.827 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:56:07.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:07.529961+0000 mon.c (mon.2) 130 : audit [DBG] from='client.? 172.21.15.80:0/3180275325' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:56:07.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:07.529961+0000 mon.c (mon.2) 130 : audit [DBG] from='client.? 172.21.15.80:0/3180275325' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:56:07.881 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:56:07.885 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:07.885 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:56:07.986 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:56:08.035 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:08.129 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:56:08.135 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:08.135 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:56:08.236 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:56:08.291 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:08.333 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-19T21:56:08.663 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:07.292495+0000 mgr.y (mgr.14514) 899 : cluster [DBG] pgmap v1166: 138 pgs: 138 active+clean; 5.1 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 746 B/s rd, 0 B/s wr, 761 op/s 2024-02-19T21:56:09.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:07.292495+0000 mgr.y (mgr.14514) 899 : cluster [DBG] pgmap v1166: 138 pgs: 138 active+clean; 5.1 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 746 B/s rd, 0 B/s wr, 761 op/s 2024-02-19T21:56:09.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:07.292495+0000 mgr.y (mgr.14514) 899 : cluster [DBG] pgmap v1166: 138 pgs: 138 active+clean; 5.1 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 746 B/s rd, 0 B/s wr, 761 op/s 2024-02-19T21:56:09.929 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:56:10.240 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:56:10.242 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:10.243 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:56:10.343 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:56:10.393 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:10.679 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:56:10.683 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:10.683 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:56:10.784 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:56:10.828 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:10.860 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:56:10.863 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:10.864 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:56:10.914 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:56:10.917 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:56:10.945 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:09.292967+0000 mgr.y (mgr.14514) 900 : cluster [DBG] pgmap v1167: 138 pgs: 138 active+clean; 5.1 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 695 op/s 2024-02-19T21:56:10.945 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:09.496075+0000 osd.6 (osd.6) 285 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:56:10.945 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:09.496122+0000 osd.6 (osd.6) 286 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:56:10.945 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:09.681624+0000 mon.a (mon.0) 1995 : cluster [DBG] osdmap e537: 8 total, 8 up, 8 in 2024-02-19T21:56:10.946 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:10.438630+0000 mon.a (mon.0) 1996 : cluster [DBG] osdmap e538: 8 total, 8 up, 8 in 2024-02-19T21:56:10.946 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:56:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:56:10] "GET /metrics HTTP/1.1" 200 176816 "" "Prometheus/2.33.4" 2024-02-19T21:56:10.946 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:09.292967+0000 mgr.y (mgr.14514) 900 : cluster [DBG] pgmap v1167: 138 pgs: 138 active+clean; 5.1 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 695 op/s 2024-02-19T21:56:10.946 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:09.496075+0000 osd.6 (osd.6) 285 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:56:10.946 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:09.496122+0000 osd.6 (osd.6) 286 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:56:10.946 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:09.681624+0000 mon.a (mon.0) 1995 : cluster [DBG] osdmap e537: 8 total, 8 up, 8 in 2024-02-19T21:56:10.946 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:10.438630+0000 mon.a (mon.0) 1996 : cluster [DBG] osdmap e538: 8 total, 8 up, 8 in 2024-02-19T21:56:10.965 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:56:11.018 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:11.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:09.292967+0000 mgr.y (mgr.14514) 900 : cluster [DBG] pgmap v1167: 138 pgs: 138 active+clean; 5.1 GiB data, 21 GiB used, 694 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 695 op/s 2024-02-19T21:56:11.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:09.496075+0000 osd.6 (osd.6) 285 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:56:11.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:09.496122+0000 osd.6 (osd.6) 286 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:56:11.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:09.681624+0000 mon.a (mon.0) 1995 : cluster [DBG] osdmap e537: 8 total, 8 up, 8 in 2024-02-19T21:56:11.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:10.438630+0000 mon.a (mon.0) 1996 : cluster [DBG] osdmap e538: 8 total, 8 up, 8 in 2024-02-19T21:56:11.578 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:56:11.581 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:11.582 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:56:11.683 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:56:11.689 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:56:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:56:11.733 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:11.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:10.892222+0000 mgr.y (mgr.14514) 901 : audit [DBG] from='client.25792 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:56:11.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:10.892222+0000 mgr.y (mgr.14514) 901 : audit [DBG] from='client.25792 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:56:11.895 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:56:12.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:10.892222+0000 mgr.y (mgr.14514) 901 : audit [DBG] from='client.25792 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:56:12.300 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:56:12.337 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":1169,"stamp":"2024-02-19T21:56:10.437397+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5207299772,"num_objects":79650,"num_object_clones":0,"num_object_copies":238950,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79650,"num_whiteouts":0,"num_read":2958,"num_read_kb":2710,"num_write":156753,"num_write_kb":7526824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":327,"num_bytes_recovered":7805,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":90259,"ondisk_log_size":90259,"up":414,"acting":414,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":414,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":21104084,"kb_used_data":15401812,"kb_used_omap":0,"kb_used_meta":5701823,"kb_avail":728857132,"statfs":{"total":767960285184,"available":746349703168,"internally_reserved":0,"allocated":15771455488,"data_stored":15758228590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":5838666804},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,5,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-591921152,"num_objects":-9032,"num_object_clones":0,"num_object_copies":-27096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-9032,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":9032,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.821032"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":138,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.630042+0000","last_change":"2024-02-19T21:54:18.805903+0000","last_active":"2024-02-19T21:56:02.630042+0000","last_peered":"2024-02-19T21:56:02.630042+0000","last_clean":"2024-02-19T21:56:02.630042+0000","last_became_active":"2024-02-19T21:49:54.492544+0000","last_became_peered":"2024-02-19T21:49:54.492544+0000","last_unstale":"2024-02-19T21:56:02.630042+0000","last_undegraded":"2024-02-19T21:56:02.630042+0000","last_fullsized":"2024-02-19T21:56:02.630042+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:18.805820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:54:18.805820+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":515,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.623082+0000","last_change":"2024-02-19T21:54:07.029225+0000","last_active":"2024-02-19T21:56:02.623082+0000","last_peered":"2024-02-19T21:56:02.623082+0000","last_clean":"2024-02-19T21:56:02.623082+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:56:02.623082+0000","last_undegraded":"2024-02-19T21:56:02.623082+0000","last_fullsized":"2024-02-19T21:56:02.623082+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:07.029148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:54:07.029148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"471'39","reported_seq":213,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:01.607879+0000","last_change":"2024-02-19T21:55:45.796974+0000","last_active":"2024-02-19T21:56:01.607879+0000","last_peered":"2024-02-19T21:56:01.607879+0000","last_clean":"2024-02-19T21:56:01.607879+0000","last_became_active":"2024-02-19T21:49:08.327416+0000","last_became_peered":"2024-02-19T21:49:08.327416+0000","last_unstale":"2024-02-19T21:56:01.607879+0000","last_undegraded":"2024-02-19T21:56:01.607879+0000","last_fullsized":"2024-02-19T21:56:01.607879+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'39","last_scrub_stamp":"2024-02-19T21:55:45.796881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:55:45.796881+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":490,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.636744+0000","last_change":"2024-02-19T21:54:13.470532+0000","last_active":"2024-02-19T21:56:02.636744+0000","last_peered":"2024-02-19T21:56:02.636744+0000","last_clean":"2024-02-19T21:56:02.636744+0000","last_became_active":"2024-02-19T21:47:46.250178+0000","last_became_peered":"2024-02-19T21:47:46.250178+0000","last_unstale":"2024-02-19T21:56:02.636744+0000","last_undegraded":"2024-02-19T21:56:02.636744+0000","last_fullsized":"2024-02-19T21:56:02.636744+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:13.470431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:13.470431+0000","last_clean_scrub_stamp":"2024-02-19T21:54:13.470431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":64,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.618610+0000","last_change":"2024-02-19T21:55:11.543232+0000","last_active":"2024-02-19T21:56:02.618610+0000","last_peered":"2024-02-19T21:56:02.618610+0000","last_clean":"2024-02-19T21:56:02.618610+0000","last_became_active":"2024-02-19T21:53:45.368218+0000","last_became_peered":"2024-02-19T21:53:45.368218+0000","last_unstale":"2024-02-19T21:56:02.618610+0000","last_undegraded":"2024-02-19T21:56:02.618610+0000","last_fullsized":"2024-02-19T21:56:02.618610+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:11.543119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:55:11.543119+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"470'25","reported_seq":595,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.636641+0000","last_change":"2024-02-19T21:55:03.508377+0000","last_active":"2024-02-19T21:56:02.636641+0000","last_peered":"2024-02-19T21:56:02.636641+0000","last_clean":"2024-02-19T21:56:02.636641+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:56:02.636641+0000","last_undegraded":"2024-02-19T21:56:02.636641+0000","last_fullsized":"2024-02-19T21:56:02.636641+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'25","last_scrub_stamp":"2024-02-19T21:55:03.508262+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:55:03.508262+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":274,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:01.616006+0000","last_change":"2024-02-19T21:54:02.455027+0000","last_active":"2024-02-19T21:56:01.616006+0000","last_peered":"2024-02-19T21:56:01.616006+0000","last_clean":"2024-02-19T21:56:01.616006+0000","last_became_active":"2024-02-19T21:49:08.331753+0000","last_became_peered":"2024-02-19T21:49:08.331753+0000","last_unstale":"2024-02-19T21:56:01.616006+0000","last_undegraded":"2024-02-19T21:56:01.616006+0000","last_fullsized":"2024-02-19T21:56:01.616006+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:02.454932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:02.454932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":530,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.630500+0000","last_change":"2024-02-19T21:54:13.655262+0000","last_active":"2024-02-19T21:56:02.630500+0000","last_peered":"2024-02-19T21:56:02.630500+0000","last_clean":"2024-02-19T21:56:02.630500+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:56:02.630500+0000","last_undegraded":"2024-02-19T21:56:02.630500+0000","last_fullsized":"2024-02-19T21:56:02.630500+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:13.655182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_clean_scrub_stamp":"2024-02-19T21:54:13.655182+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"470'11","reported_seq":564,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.637236+0000","last_change":"2024-02-19T21:53:51.243831+0000","last_active":"2024-02-19T21:56:02.637236+0000","last_peered":"2024-02-19T21:56:02.637236+0000","last_clean":"2024-02-19T21:56:02.637236+0000","last_became_active":"2024-02-19T21:53:45.385837+0000","last_became_peered":"2024-02-19T21:53:45.385837+0000","last_unstale":"2024-02-19T21:56:02.637236+0000","last_undegraded":"2024-02-19T21:56:02.637236+0000","last_fullsized":"2024-02-19T21:56:02.637236+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'11","last_scrub_stamp":"2024-02-19T21:53:51.243743+0000","last_deep_scrub":"310'9","last_deep_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_clean_scrub_stamp":"2024-02-19T21:53:51.243743+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":456,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.621776+0000","last_change":"2024-02-19T21:56:00.723651+0000","last_active":"2024-02-19T21:56:02.621776+0000","last_peered":"2024-02-19T21:56:02.621776+0000","last_clean":"2024-02-19T21:56:02.621776+0000","last_became_active":"2024-02-19T21:46:31.204816+0000","last_became_peered":"2024-02-19T21:46:31.204816+0000","last_unstale":"2024-02-19T21:56:02.621776+0000","last_undegraded":"2024-02-19T21:56:02.621776+0000","last_fullsized":"2024-02-19T21:56:02.621776+0000","mapping_epoch":330,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":331,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:56:00.723548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:56:00.723548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":552,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.630440+0000","last_change":"2024-02-19T21:53:58.606788+0000","last_active":"2024-02-19T21:56:02.630440+0000","last_peered":"2024-02-19T21:56:02.630440+0000","last_clean":"2024-02-19T21:56:02.630440+0000","last_became_active":"2024-02-19T21:49:08.329998+0000","last_became_peered":"2024-02-19T21:49:08.329998+0000","last_unstale":"2024-02-19T21:56:02.630440+0000","last_undegraded":"2024-02-19T21:56:02.630440+0000","last_fullsized":"2024-02-19T21:56:02.630440+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:58.606696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:58.606696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"470'25","reported_seq":424,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.636869+0000","last_change":"2024-02-19T21:54:07.275961+0000","last_active":"2024-02-19T21:56:02.636869+0000","last_peered":"2024-02-19T21:56:02.636869+0000","last_clean":"2024-02-19T21:56:02.636869+0000","last_became_active":"2024-02-19T21:53:45.383294+0000","last_became_peered":"2024-02-19T21:53:45.383294+0000","last_unstale":"2024-02-19T21:56:02.636869+0000","last_undegraded":"2024-02-19T21:56:02.636869+0000","last_fullsized":"2024-02-19T21:56:02.636869+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'25","last_scrub_stamp":"2024-02-19T21:54:07.275895+0000","last_deep_scrub":"470'25","last_deep_scrub_stamp":"2024-02-19T21:54:07.275895+0000","last_clean_scrub_stamp":"2024-02-19T21:54:07.275895+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":61,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.618786+0000","last_change":"2024-02-19T21:56:02.371322+0000","last_active":"2024-02-19T21:56:02.618786+0000","last_peered":"2024-02-19T21:56:02.618786+0000","last_clean":"2024-02-19T21:56:02.618786+0000","last_became_active":"2024-02-19T21:53:45.369808+0000","last_became_peered":"2024-02-19T21:53:45.369808+0000","last_unstale":"2024-02-19T21:56:02.618786+0000","last_undegraded":"2024-02-19T21:56:02.618786+0000","last_fullsized":"2024-02-19T21:56:02.618786+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:12.582596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:12.582596+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":37,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:01.607620+0000","last_change":"2024-02-19T21:55:00.964172+0000","last_active":"2024-02-19T21:56:01.607620+0000","last_peered":"2024-02-19T21:56:01.607620+0000","last_clean":"2024-02-19T21:56:01.607620+0000","last_became_active":"2024-02-19T21:54:52.469938+0000","last_became_peered":"2024-02-19T21:54:52.469938+0000","last_unstale":"2024-02-19T21:56:01.607620+0000","last_undegraded":"2024-02-19T21:56:01.607620+0000","last_fullsized":"2024-02-19T21:56:01.607620+0000","mapping_epoch":513,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":514,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:00.964069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:55:00.964069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"471'24","reported_seq":49,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:01.607992+0000","last_change":"2024-02-19T21:54:58.907072+0000","last_active":"2024-02-19T21:56:01.607992+0000","last_peered":"2024-02-19T21:56:01.607992+0000","last_clean":"2024-02-19T21:56:01.607992+0000","last_became_active":"2024-02-19T21:54:52.474005+0000","last_became_peered":"2024-02-19T21:54:52.474005+0000","last_unstale":"2024-02-19T21:56:01.607992+0000","last_undegraded":"2024-02-19T21:56:01.607992+0000","last_fullsized":"2024-02-19T21:56:01.607992+0000","mapping_epoch":513,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":514,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'24","last_scrub_stamp":"2024-02-19T21:54:58.906977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:54:58.906977+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":33,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6],"acting":[2,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":523,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.638403+0000","last_change":"2024-02-19T21:55:59.586187+0000","last_active":"2024-02-19T21:56:02.638403+0000","last_peered":"2024-02-19T21:56:02.638403+0000","last_clean":"2024-02-19T21:56:02.638403+0000","last_became_active":"2024-02-19T21:44:58.788307+0000","last_became_peered":"2024-02-19T21:44:58.788307+0000","last_unstale":"2024-02-19T21:56:02.638403+0000","last_undegraded":"2024-02-19T21:56:02.638403+0000","last_fullsized":"2024-02-19T21:56:02.638403+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:59.586089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:55:59.586089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":525,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.624191+0000","last_change":"2024-02-19T21:54:22.689209+0000","last_active":"2024-02-19T21:56:02.624191+0000","last_peered":"2024-02-19T21:56:02.624191+0000","last_clean":"2024-02-19T21:56:02.624191+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:56:02.624191+0000","last_undegraded":"2024-02-19T21:56:02.624191+0000","last_fullsized":"2024-02-19T21:56:02.624191+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:22.689143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:17.913620+0000","last_clean_scrub_stamp":"2024-02-19T21:54:22.689143+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"470'46","reported_seq":208,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:01.607934+0000","last_change":"2024-02-19T21:55:19.874401+0000","last_active":"2024-02-19T21:56:01.607934+0000","last_peered":"2024-02-19T21:56:01.607934+0000","last_clean":"2024-02-19T21:56:01.607934+0000","last_became_active":"2024-02-19T21:49:08.331742+0000","last_became_peered":"2024-02-19T21:49:08.331742+0000","last_unstale":"2024-02-19T21:56:01.607934+0000","last_undegraded":"2024-02-19T21:56:01.607934+0000","last_fullsized":"2024-02-19T21:56:01.607934+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'46","last_scrub_stamp":"2024-02-19T21:55:19.874292+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:55:19.874292+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":547,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.630835+0000","last_change":"2024-02-19T21:55:51.949183+0000","last_active":"2024-02-19T21:56:02.630835+0000","last_peered":"2024-02-19T21:56:02.630835+0000","last_clean":"2024-02-19T21:56:02.630835+0000","last_became_active":"2024-02-19T21:44:58.790669+0000","last_became_peered":"2024-02-19T21:44:58.790669+0000","last_unstale":"2024-02-19T21:56:02.630835+0000","last_undegraded":"2024-02-19T21:56:02.630835+0000","last_fullsized":"2024-02-19T21:56:02.630835+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:51.949098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_clean_scrub_stamp":"2024-02-19T21:55:51.949098+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":471,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.623359+0000","last_change":"2024-02-19T21:53:55.597392+0000","last_active":"2024-02-19T21:56:02.623359+0000","last_peered":"2024-02-19T21:56:02.623359+0000","last_clean":"2024-02-19T21:56:02.623359+0000","last_became_active":"2024-02-19T21:49:08.329986+0000","last_became_peered":"2024-02-19T21:49:08.329986+0000","last_unstale":"2024-02-19T21:56:02.623359+0000","last_undegraded":"2024-02-19T21:56:02.623359+0000","last_fullsized":"2024-02-19T21:56:02.623359+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:55.597334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:55.597334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"471'27","reported_seq":431,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.623013+0000","last_change":"2024-02-19T21:55:02.838918+0000","last_active":"2024-02-19T21:56:02.623013+0000","last_peered":"2024-02-19T21:56:02.623013+0000","last_clean":"2024-02-19T21:56:02.623013+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:56:02.623013+0000","last_undegraded":"2024-02-19T21:56:02.623013+0000","last_fullsized":"2024-02-19T21:56:02.623013+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'27","last_scrub_stamp":"2024-02-19T21:55:02.838850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:55:02.838850+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":36,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":398,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.630336+0000","last_change":"2024-02-19T21:54:03.580153+0000","last_active":"2024-02-19T21:56:02.630336+0000","last_peered":"2024-02-19T21:56:02.630336+0000","last_clean":"2024-02-19T21:56:02.630336+0000","last_became_active":"2024-02-19T21:51:22.461599+0000","last_became_peered":"2024-02-19T21:51:22.461599+0000","last_unstale":"2024-02-19T21:56:02.630336+0000","last_undegraded":"2024-02-19T21:56:02.630336+0000","last_fullsized":"2024-02-19T21:56:02.630336+0000","mapping_epoch":445,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":446,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:54:03.580085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:54:03.580085+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":535,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:01.617065+0000","last_change":"2024-02-19T21:54:20.347780+0000","last_active":"2024-02-19T21:56:01.617065+0000","last_peered":"2024-02-19T21:56:01.617065+0000","last_clean":"2024-02-19T21:56:01.617065+0000","last_became_active":"2024-02-19T21:49:54.491488+0000","last_became_peered":"2024-02-19T21:49:54.491488+0000","last_unstale":"2024-02-19T21:56:01.617065+0000","last_undegraded":"2024-02-19T21:56:01.617065+0000","last_fullsized":"2024-02-19T21:56:01.617065+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:20.347685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:54:20.347685+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"470'30","reported_seq":635,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.623990+0000","last_change":"2024-02-19T21:55:04.896812+0000","last_active":"2024-02-19T21:56:02.623990+0000","last_peered":"2024-02-19T21:56:02.623990+0000","last_clean":"2024-02-19T21:56:02.623990+0000","last_became_active":"2024-02-19T21:49:54.483748+0000","last_became_peered":"2024-02-19T21:49:54.483748+0000","last_unstale":"2024-02-19T21:56:02.623990+0000","last_undegraded":"2024-02-19T21:56:02.623990+0000","last_fullsized":"2024-02-19T21:56:02.623990+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'30","last_scrub_stamp":"2024-02-19T21:55:04.896705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:55:04.896705+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":455,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.621876+0000","last_change":"2024-02-19T21:55:00.074339+0000","last_active":"2024-02-19T21:56:02.621876+0000","last_peered":"2024-02-19T21:56:02.621876+0000","last_clean":"2024-02-19T21:56:02.621876+0000","last_became_active":"2024-02-19T21:49:08.327865+0000","last_became_peered":"2024-02-19T21:49:08.327865+0000","last_unstale":"2024-02-19T21:56:02.621876+0000","last_undegraded":"2024-02-19T21:56:02.621876+0000","last_fullsized":"2024-02-19T21:56:02.621876+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:00.074245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:55:00.074245+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":517,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.631687+0000","last_change":"2024-02-19T21:54:15.684329+0000","last_active":"2024-02-19T21:56:02.631687+0000","last_peered":"2024-02-19T21:56:02.631687+0000","last_clean":"2024-02-19T21:56:02.631687+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:56:02.631687+0000","last_undegraded":"2024-02-19T21:56:02.631687+0000","last_fullsized":"2024-02-19T21:56:02.631687+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:15.684224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:54:15.684224+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":551,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.625246+0000","last_change":"2024-02-19T21:53:54.630006+0000","last_active":"2024-02-19T21:56:02.625246+0000","last_peered":"2024-02-19T21:56:02.625246+0000","last_clean":"2024-02-19T21:56:02.625246+0000","last_became_active":"2024-02-19T21:49:08.330293+0000","last_became_peered":"2024-02-19T21:49:08.330293+0000","last_unstale":"2024-02-19T21:56:02.625246+0000","last_undegraded":"2024-02-19T21:56:02.625246+0000","last_fullsized":"2024-02-19T21:56:02.625246+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:54.629909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:54.629909+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"471'32","reported_seq":78,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.617906+0000","last_change":"2024-02-19T21:56:00.410939+0000","last_active":"2024-02-19T21:56:02.617906+0000","last_peered":"2024-02-19T21:56:02.617906+0000","last_clean":"2024-02-19T21:56:02.617906+0000","last_became_active":"2024-02-19T21:53:45.367870+0000","last_became_peered":"2024-02-19T21:53:45.367870+0000","last_unstale":"2024-02-19T21:56:02.617906+0000","last_undegraded":"2024-02-19T21:56:02.617906+0000","last_fullsized":"2024-02-19T21:56:02.617906+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'32","last_scrub_stamp":"2024-02-19T21:56:00.410827+0000","last_deep_scrub":"381'24","last_deep_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_clean_scrub_stamp":"2024-02-19T21:56:00.410827+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":24,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:01.620000+0000","last_change":"2024-02-19T21:55:24.057416+0000","last_active":"2024-02-19T21:56:01.620000+0000","last_peered":"2024-02-19T21:56:01.620000+0000","last_clean":"2024-02-19T21:56:01.620000+0000","last_became_active":"2024-02-19T21:55:24.057099+0000","last_became_peered":"2024-02-19T21:55:24.057099+0000","last_unstale":"2024-02-19T21:56:01.620000+0000","last_undegraded":"2024-02-19T21:56:01.620000+0000","last_fullsized":"2024-02-19T21:56:01.620000+0000","mapping_epoch":521,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":522,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:57.593320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:53:57.593320+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":571,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.623405+0000","last_change":"2024-02-19T21:55:03.717187+0000","last_active":"2024-02-19T21:56:02.623405+0000","last_peered":"2024-02-19T21:56:02.623405+0000","last_clean":"2024-02-19T21:56:02.623405+0000","last_became_active":"2024-02-19T21:49:54.494146+0000","last_became_peered":"2024-02-19T21:49:54.494146+0000","last_unstale":"2024-02-19T21:56:02.623405+0000","last_undegraded":"2024-02-19T21:56:02.623405+0000","last_fullsized":"2024-02-19T21:56:02.623405+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:03.717083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_clean_scrub_stamp":"2024-02-19T21:55:03.717083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":545,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:01.617695+0000","last_change":"2024-02-19T21:55:47.600817+0000","last_active":"2024-02-19T21:56:01.617695+0000","last_peered":"2024-02-19T21:56:01.617695+0000","last_clean":"2024-02-19T21:56:01.617695+0000","last_became_active":"2024-02-19T21:49:08.331308+0000","last_became_peered":"2024-02-19T21:49:08.331308+0000","last_unstale":"2024-02-19T21:56:01.617695+0000","last_undegraded":"2024-02-19T21:56:01.617695+0000","last_fullsized":"2024-02-19T21:56:01.617695+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:47.600714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:55:47.600714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"470'12","reported_seq":70,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.617769+0000","last_change":"2024-02-19T21:55:00.544889+0000","last_active":"2024-02-19T21:56:02.617769+0000","last_peered":"2024-02-19T21:56:02.617769+0000","last_clean":"2024-02-19T21:56:02.617769+0000","last_became_active":"2024-02-19T21:53:45.368256+0000","last_became_peered":"2024-02-19T21:53:45.368256+0000","last_unstale":"2024-02-19T21:56:02.617769+0000","last_undegraded":"2024-02-19T21:56:02.617769+0000","last_fullsized":"2024-02-19T21:56:02.617769+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'12","last_scrub_stamp":"2024-02-19T21:55:00.544815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:55:00.544815+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":459,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.621039+0000","last_change":"2024-02-19T21:55:51.733348+0000","last_active":"2024-02-19T21:56:02.621039+0000","last_peered":"2024-02-19T21:56:02.621039+0000","last_clean":"2024-02-19T21:56:02.621039+0000","last_became_active":"2024-02-19T21:49:08.328416+0000","last_became_peered":"2024-02-19T21:49:08.328416+0000","last_unstale":"2024-02-19T21:56:02.621039+0000","last_undegraded":"2024-02-19T21:56:02.621039+0000","last_fullsized":"2024-02-19T21:56:02.621039+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:51.733288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:55:51.733288+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":535,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.631435+0000","last_change":"2024-02-19T21:54:24.498621+0000","last_active":"2024-02-19T21:56:02.631435+0000","last_peered":"2024-02-19T21:56:02.631435+0000","last_clean":"2024-02-19T21:56:02.631435+0000","last_became_active":"2024-02-19T21:49:54.480368+0000","last_became_peered":"2024-02-19T21:49:54.480368+0000","last_unstale":"2024-02-19T21:56:02.631435+0000","last_undegraded":"2024-02-19T21:56:02.631435+0000","last_fullsized":"2024-02-19T21:56:02.631435+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:24.498521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:54:24.498521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":514,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.631236+0000","last_change":"2024-02-19T21:49:05.012463+0000","last_active":"2024-02-19T21:56:02.631236+0000","last_peered":"2024-02-19T21:56:02.631236+0000","last_clean":"2024-02-19T21:56:02.631236+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:56:02.631236+0000","last_undegraded":"2024-02-19T21:56:02.631236+0000","last_fullsized":"2024-02-19T21:56:02.631236+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.012395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.012395+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"470'27","reported_seq":578,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.637370+0000","last_change":"2024-02-19T21:55:02.539346+0000","last_active":"2024-02-19T21:56:02.637370+0000","last_peered":"2024-02-19T21:56:02.637370+0000","last_clean":"2024-02-19T21:56:02.637370+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:56:02.637370+0000","last_undegraded":"2024-02-19T21:56:02.637370+0000","last_fullsized":"2024-02-19T21:56:02.637370+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'27","last_scrub_stamp":"2024-02-19T21:55:02.539241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:55:02.539241+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":520,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.621355+0000","last_change":"2024-02-19T21:54:17.964240+0000","last_active":"2024-02-19T21:56:02.621355+0000","last_peered":"2024-02-19T21:56:02.621355+0000","last_clean":"2024-02-19T21:56:02.621355+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:56:02.621355+0000","last_undegraded":"2024-02-19T21:56:02.621355+0000","last_fullsized":"2024-02-19T21:56:02.621355+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:17.964139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:17.964139+0000","last_clean_scrub_stamp":"2024-02-19T21:54:17.964139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":64,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.618081+0000","last_change":"2024-02-19T21:55:10.537616+0000","last_active":"2024-02-19T21:56:02.618081+0000","last_peered":"2024-02-19T21:56:02.618081+0000","last_clean":"2024-02-19T21:56:02.618081+0000","last_became_active":"2024-02-19T21:53:45.369330+0000","last_became_peered":"2024-02-19T21:53:45.369330+0000","last_unstale":"2024-02-19T21:56:02.618081+0000","last_undegraded":"2024-02-19T21:56:02.618081+0000","last_fullsized":"2024-02-19T21:56:02.618081+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:10.537495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:55:10.537495+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":541,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.623589+0000","last_change":"2024-02-19T21:55:02.698892+0000","last_active":"2024-02-19T21:56:02.623589+0000","last_peered":"2024-02-19T21:56:02.623589+0000","last_clean":"2024-02-19T21:56:02.623589+0000","last_became_active":"2024-02-19T21:53:45.384501+0000","last_became_peered":"2024-02-19T21:53:45.384501+0000","last_unstale":"2024-02-19T21:56:02.623589+0000","last_undegraded":"2024-02-19T21:56:02.623589+0000","last_fullsized":"2024-02-19T21:56:02.623589+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:02.698800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:55:02.698800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"470'21","reported_seq":601,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.631279+0000","last_change":"2024-02-19T21:54:14.469579+0000","last_active":"2024-02-19T21:56:02.631279+0000","last_peered":"2024-02-19T21:56:02.631279+0000","last_clean":"2024-02-19T21:56:02.631279+0000","last_became_active":"2024-02-19T21:49:08.333872+0000","last_became_peered":"2024-02-19T21:49:08.333872+0000","last_unstale":"2024-02-19T21:56:02.631279+0000","last_undegraded":"2024-02-19T21:56:02.631279+0000","last_fullsized":"2024-02-19T21:56:02.631279+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'21","last_scrub_stamp":"2024-02-19T21:54:14.469490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:54:14.469490+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":500,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.637374+0000","last_change":"2024-02-19T21:54:08.470718+0000","last_active":"2024-02-19T21:56:02.637374+0000","last_peered":"2024-02-19T21:56:02.637374+0000","last_clean":"2024-02-19T21:56:02.637374+0000","last_became_active":"2024-02-19T21:49:08.329770+0000","last_became_peered":"2024-02-19T21:49:08.329770+0000","last_unstale":"2024-02-19T21:56:02.637374+0000","last_undegraded":"2024-02-19T21:56:02.637374+0000","last_fullsized":"2024-02-19T21:56:02.637374+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:08.470650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:54:08.470650+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"415'17","reported_seq":217,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:07.153083+0000","last_change":"2024-02-19T21:53:56.588487+0000","last_active":"2024-02-19T21:56:07.153083+0000","last_peered":"2024-02-19T21:56:07.153083+0000","last_clean":"2024-02-19T21:56:07.153083+0000","last_became_active":"2024-02-19T21:49:54.486304+0000","last_became_peered":"2024-02-19T21:49:54.486304+0000","last_unstale":"2024-02-19T21:56:07.153083+0000","last_undegraded":"2024-02-19T21:56:07.153083+0000","last_fullsized":"2024-02-19T21:56:07.153083+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"415'17","last_scrub_stamp":"2024-02-19T21:53:56.588421+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:53:56.588421+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":551,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.622160+0000","last_change":"2024-02-19T21:54:01.110262+0000","last_active":"2024-02-19T21:56:02.622160+0000","last_peered":"2024-02-19T21:56:02.622160+0000","last_clean":"2024-02-19T21:56:02.622160+0000","last_became_active":"2024-02-19T21:53:45.371729+0000","last_became_peered":"2024-02-19T21:53:45.371729+0000","last_unstale":"2024-02-19T21:56:02.622160+0000","last_undegraded":"2024-02-19T21:56:02.622160+0000","last_fullsized":"2024-02-19T21:56:02.622160+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:01.110166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_clean_scrub_stamp":"2024-02-19T21:54:01.110166+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"470'25","reported_seq":591,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:01.618482+0000","last_change":"2024-02-19T21:54:59.161641+0000","last_active":"2024-02-19T21:56:01.618482+0000","last_peered":"2024-02-19T21:56:01.618482+0000","last_clean":"2024-02-19T21:56:01.618482+0000","last_became_active":"2024-02-19T21:53:45.384976+0000","last_became_peered":"2024-02-19T21:53:45.384976+0000","last_unstale":"2024-02-19T21:56:01.618482+0000","last_undegraded":"2024-02-19T21:56:01.618482+0000","last_fullsized":"2024-02-19T21:56:01.618482+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'25","last_scrub_stamp":"2024-02-19T21:54:59.161529+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:54:59.161529+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":259,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.623805+0000","last_change":"2024-02-19T21:54:21.953571+0000","last_active":"2024-02-19T21:56:02.623805+0000","last_peered":"2024-02-19T21:56:02.623805+0000","last_clean":"2024-02-19T21:56:02.623805+0000","last_became_active":"2024-02-19T21:49:54.484049+0000","last_became_peered":"2024-02-19T21:49:54.484049+0000","last_unstale":"2024-02-19T21:56:02.623805+0000","last_undegraded":"2024-02-19T21:56:02.623805+0000","last_fullsized":"2024-02-19T21:56:02.623805+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:21.953470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:54:21.953470+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":806,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.149579+0000","last_change":"2024-02-19T21:55:05.379509+0000","last_active":"2024-02-19T21:56:02.149579+0000","last_peered":"2024-02-19T21:56:02.149579+0000","last_clean":"2024-02-19T21:56:02.149579+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:56:02.149579+0000","last_undegraded":"2024-02-19T21:56:02.149579+0000","last_fullsized":"2024-02-19T21:56:02.149579+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:55:05.379447+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:55:05.379447+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":555,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:01.620197+0000","last_change":"2024-02-19T21:55:12.286687+0000","last_active":"2024-02-19T21:56:01.620197+0000","last_peered":"2024-02-19T21:56:01.620197+0000","last_clean":"2024-02-19T21:56:01.620197+0000","last_became_active":"2024-02-19T21:53:45.384012+0000","last_became_peered":"2024-02-19T21:53:45.384012+0000","last_unstale":"2024-02-19T21:56:01.620197+0000","last_undegraded":"2024-02-19T21:56:01.620197+0000","last_fullsized":"2024-02-19T21:56:01.620197+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:12.286582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:55:12.286582+0000","last_clean_scrub_stamp":"2024-02-19T21:55:12.286582+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"470'35","reported_seq":76,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.618345+0000","last_change":"2024-02-19T21:55:52.454979+0000","last_active":"2024-02-19T21:56:02.618345+0000","last_peered":"2024-02-19T21:56:02.618345+0000","last_clean":"2024-02-19T21:56:02.618345+0000","last_became_active":"2024-02-19T21:53:45.367708+0000","last_became_peered":"2024-02-19T21:53:45.367708+0000","last_unstale":"2024-02-19T21:56:02.618345+0000","last_undegraded":"2024-02-19T21:56:02.618345+0000","last_fullsized":"2024-02-19T21:56:02.618345+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'35","last_scrub_stamp":"2024-02-19T21:55:52.454890+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:55:52.454890+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":517,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.630351+0000","last_change":"2024-02-19T21:54:11.667953+0000","last_active":"2024-02-19T21:56:02.630351+0000","last_peered":"2024-02-19T21:56:02.630351+0000","last_clean":"2024-02-19T21:56:02.630351+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:56:02.630351+0000","last_undegraded":"2024-02-19T21:56:02.630351+0000","last_fullsized":"2024-02-19T21:56:02.630351+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:11.667872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:11.667872+0000","last_clean_scrub_stamp":"2024-02-19T21:54:11.667872+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":522,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.623476+0000","last_change":"2024-02-19T21:53:56.583766+0000","last_active":"2024-02-19T21:56:02.623476+0000","last_peered":"2024-02-19T21:56:02.623476+0000","last_clean":"2024-02-19T21:56:02.623476+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:56:02.623476+0000","last_undegraded":"2024-02-19T21:56:02.623476+0000","last_fullsized":"2024-02-19T21:56:02.623476+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:56.583707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:56.583707+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"470'18","reported_seq":159,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.631618+0000","last_change":"2024-02-19T21:55:10.074274+0000","last_active":"2024-02-19T21:56:02.631618+0000","last_peered":"2024-02-19T21:56:02.631618+0000","last_clean":"2024-02-19T21:56:02.631618+0000","last_became_active":"2024-02-19T21:49:54.478094+0000","last_became_peered":"2024-02-19T21:49:54.478094+0000","last_unstale":"2024-02-19T21:56:02.631618+0000","last_undegraded":"2024-02-19T21:56:02.631618+0000","last_fullsized":"2024-02-19T21:56:02.631618+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'18","last_scrub_stamp":"2024-02-19T21:55:10.074185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:55:10.074185+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":23,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":168,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:01.608013+0000","last_change":"2024-02-19T21:54:18.393614+0000","last_active":"2024-02-19T21:56:01.608013+0000","last_peered":"2024-02-19T21:56:01.608013+0000","last_clean":"2024-02-19T21:56:01.608013+0000","last_became_active":"2024-02-19T21:49:08.332176+0000","last_became_peered":"2024-02-19T21:49:08.332176+0000","last_unstale":"2024-02-19T21:56:01.608013+0000","last_undegraded":"2024-02-19T21:56:01.608013+0000","last_fullsized":"2024-02-19T21:56:01.608013+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:18.393513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:18.393513+0000","last_clean_scrub_stamp":"2024-02-19T21:54:18.393513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":184,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:01.607404+0000","last_change":"2024-02-19T21:55:59.666773+0000","last_active":"2024-02-19T21:56:01.607404+0000","last_peered":"2024-02-19T21:56:01.607404+0000","last_clean":"2024-02-19T21:56:01.607404+0000","last_became_active":"2024-02-19T21:54:35.408935+0000","last_became_peered":"2024-02-19T21:54:35.408935+0000","last_unstale":"2024-02-19T21:56:01.607404+0000","last_undegraded":"2024-02-19T21:56:01.607404+0000","last_fullsized":"2024-02-19T21:56:01.607404+0000","mapping_epoch":507,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":508,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:59.666682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:55:59.666682+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"470'21","reported_seq":673,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.623900+0000","last_change":"2024-02-19T21:53:52.104355+0000","last_active":"2024-02-19T21:56:02.623900+0000","last_peered":"2024-02-19T21:56:02.623900+0000","last_clean":"2024-02-19T21:56:02.623900+0000","last_became_active":"2024-02-19T21:49:54.483578+0000","last_became_peered":"2024-02-19T21:49:54.483578+0000","last_unstale":"2024-02-19T21:56:02.623900+0000","last_undegraded":"2024-02-19T21:56:02.623900+0000","last_fullsized":"2024-02-19T21:56:02.623900+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'21","last_scrub_stamp":"2024-02-19T21:53:52.104285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:53:52.104285+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"537'9900","reported_seq":9952,"reported_epoch":537,"state":"active+clean","last_fresh":"2024-02-19T21:56:10.072863+0000","last_change":"2024-02-19T21:53:45.368993+0000","last_active":"2024-02-19T21:56:10.072863+0000","last_peered":"2024-02-19T21:56:10.072863+0000","last_clean":"2024-02-19T21:56:10.072863+0000","last_became_active":"2024-02-19T21:53:45.368696+0000","last_became_peered":"2024-02-19T21:53:45.368696+0000","last_unstale":"2024-02-19T21:56:10.072863+0000","last_undegraded":"2024-02-19T21:56:10.072863+0000","last_fullsized":"2024-02-19T21:56:10.072863+0000","mapping_epoch":492,"log_start":"508'4300","ondisk_log_start":"508'4300","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":5600,"ondisk_log_size":5600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":324009984,"num_objects":4944,"num_object_clones":0,"num_object_copies":14832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4944,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9900,"num_write_kb":475008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":64,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.618164+0000","last_change":"2024-02-19T21:55:59.541514+0000","last_active":"2024-02-19T21:56:02.618164+0000","last_peered":"2024-02-19T21:56:02.618164+0000","last_clean":"2024-02-19T21:56:02.618164+0000","last_became_active":"2024-02-19T21:53:45.368696+0000","last_became_peered":"2024-02-19T21:53:45.368696+0000","last_unstale":"2024-02-19T21:56:02.618164+0000","last_undegraded":"2024-02-19T21:56:02.618164+0000","last_fullsized":"2024-02-19T21:56:02.618164+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:59.541410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:55:59.541410+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"378'4","reported_seq":556,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.637566+0000","last_change":"2024-02-19T21:54:58.444948+0000","last_active":"2024-02-19T21:56:02.637566+0000","last_peered":"2024-02-19T21:56:02.637566+0000","last_clean":"2024-02-19T21:56:02.637566+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:56:02.637566+0000","last_undegraded":"2024-02-19T21:56:02.637566+0000","last_fullsized":"2024-02-19T21:56:02.637566+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"378'4","last_scrub_stamp":"2024-02-19T21:54:58.444848+0000","last_deep_scrub":"378'4","last_deep_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_clean_scrub_stamp":"2024-02-19T21:54:58.444848+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"470'29","reported_seq":422,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.636957+0000","last_change":"2024-02-19T21:55:45.552813+0000","last_active":"2024-02-19T21:56:02.636957+0000","last_peered":"2024-02-19T21:56:02.636957+0000","last_clean":"2024-02-19T21:56:02.636957+0000","last_became_active":"2024-02-19T21:47:46.252085+0000","last_became_peered":"2024-02-19T21:47:46.252085+0000","last_unstale":"2024-02-19T21:56:02.636957+0000","last_undegraded":"2024-02-19T21:56:02.636957+0000","last_fullsized":"2024-02-19T21:56:02.636957+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'29","last_scrub_stamp":"2024-02-19T21:55:45.552710+0000","last_deep_scrub":"200'23","last_deep_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_clean_scrub_stamp":"2024-02-19T21:55:45.552710+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":33,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6],"acting":[4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":173,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:01.607455+0000","last_change":"2024-02-19T21:55:22.791336+0000","last_active":"2024-02-19T21:56:01.607455+0000","last_peered":"2024-02-19T21:56:01.607455+0000","last_clean":"2024-02-19T21:56:01.607455+0000","last_became_active":"2024-02-19T21:49:08.328237+0000","last_became_peered":"2024-02-19T21:49:08.328237+0000","last_unstale":"2024-02-19T21:56:01.607455+0000","last_undegraded":"2024-02-19T21:56:01.607455+0000","last_fullsized":"2024-02-19T21:56:01.607455+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:22.791271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:55:22.791271+0000","last_clean_scrub_stamp":"2024-02-19T21:55:22.791271+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"536'9684","reported_seq":9742,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:07.293954+0000","last_change":"2024-02-19T21:55:06.318413+0000","last_active":"2024-02-19T21:56:07.293954+0000","last_peered":"2024-02-19T21:56:07.293954+0000","last_clean":"2024-02-19T21:56:07.293954+0000","last_became_active":"2024-02-19T21:53:45.366507+0000","last_became_peered":"2024-02-19T21:53:45.366507+0000","last_unstale":"2024-02-19T21:56:07.293954+0000","last_undegraded":"2024-02-19T21:56:07.293954+0000","last_fullsized":"2024-02-19T21:56:07.293954+0000","mapping_epoch":492,"log_start":"506'3600","ondisk_log_start":"506'3600","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"518'6109","last_scrub_stamp":"2024-02-19T21:55:06.318324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:55:06.318324+0000","log_size":6084,"ondisk_log_size":6084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":338493464,"num_objects":5166,"num_object_clones":0,"num_object_copies":15498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5166,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9684,"num_write_kb":475137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6],"acting":[2,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":578,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.621434+0000","last_change":"2024-02-19T21:54:03.090621+0000","last_active":"2024-02-19T21:56:02.621434+0000","last_peered":"2024-02-19T21:56:02.621434+0000","last_clean":"2024-02-19T21:56:02.621434+0000","last_became_active":"2024-02-19T21:53:45.372402+0000","last_became_peered":"2024-02-19T21:53:45.372402+0000","last_unstale":"2024-02-19T21:56:02.621434+0000","last_undegraded":"2024-02-19T21:56:02.621434+0000","last_fullsized":"2024-02-19T21:56:02.621434+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:03.090525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:03.090525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":512,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.630752+0000","last_change":"2024-02-19T21:48:37.789514+0000","last_active":"2024-02-19T21:56:02.630752+0000","last_peered":"2024-02-19T21:56:02.630752+0000","last_clean":"2024-02-19T21:56:02.630752+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:56:02.630752+0000","last_undegraded":"2024-02-19T21:56:02.630752+0000","last_fullsized":"2024-02-19T21:56:02.630752+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:37.789400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:37.789400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"470'30","reported_seq":438,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.631361+0000","last_change":"2024-02-19T21:55:08.637400+0000","last_active":"2024-02-19T21:56:02.631361+0000","last_peered":"2024-02-19T21:56:02.631361+0000","last_clean":"2024-02-19T21:56:02.631361+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:56:02.631361+0000","last_undegraded":"2024-02-19T21:56:02.631361+0000","last_fullsized":"2024-02-19T21:56:02.631361+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'30","last_scrub_stamp":"2024-02-19T21:55:08.637308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:55:08.637308+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":817,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:07.149465+0000","last_change":"2024-02-19T21:55:45.663121+0000","last_active":"2024-02-19T21:56:07.149465+0000","last_peered":"2024-02-19T21:56:07.149465+0000","last_clean":"2024-02-19T21:56:07.149465+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:56:07.149465+0000","last_undegraded":"2024-02-19T21:56:07.149465+0000","last_fullsized":"2024-02-19T21:56:07.149465+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:55:45.663047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:55:45.663047+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"537'9573","reported_seq":9626,"reported_epoch":537,"state":"active+clean","last_fresh":"2024-02-19T21:56:10.310481+0000","last_change":"2024-02-19T21:53:45.371934+0000","last_active":"2024-02-19T21:56:10.310481+0000","last_peered":"2024-02-19T21:56:10.310481+0000","last_clean":"2024-02-19T21:56:10.310481+0000","last_became_active":"2024-02-19T21:53:45.371632+0000","last_became_peered":"2024-02-19T21:53:45.371632+0000","last_unstale":"2024-02-19T21:56:10.310481+0000","last_undegraded":"2024-02-19T21:56:10.310481+0000","last_fullsized":"2024-02-19T21:56:10.310481+0000","mapping_epoch":492,"log_start":"510'4429","ondisk_log_start":"510'4429","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":5144,"ondisk_log_size":5144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":321847296,"num_objects":4911,"num_object_clones":0,"num_object_copies":14733,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4911,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9573,"num_write_kb":463488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":466,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.638731+0000","last_change":"2024-02-19T21:55:09.610198+0000","last_active":"2024-02-19T21:56:02.638731+0000","last_peered":"2024-02-19T21:56:02.638731+0000","last_clean":"2024-02-19T21:56:02.638731+0000","last_became_active":"2024-02-19T21:44:56.149476+0000","last_became_peered":"2024-02-19T21:44:56.149476+0000","last_unstale":"2024-02-19T21:56:02.638731+0000","last_undegraded":"2024-02-19T21:56:02.638731+0000","last_fullsized":"2024-02-19T21:56:02.638731+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:09.610109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:55:09.610109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":525,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:01.620263+0000","last_change":"2024-02-19T21:54:19.347995+0000","last_active":"2024-02-19T21:56:01.620263+0000","last_peered":"2024-02-19T21:56:01.620263+0000","last_clean":"2024-02-19T21:56:01.620263+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:56:01.620263+0000","last_undegraded":"2024-02-19T21:56:01.620263+0000","last_fullsized":"2024-02-19T21:56:01.620263+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:19.347909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:54:19.347909+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"470'58","reported_seq":1021,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:07.150035+0000","last_change":"2024-02-19T21:54:23.554440+0000","last_active":"2024-02-19T21:56:07.150035+0000","last_peered":"2024-02-19T21:56:07.150035+0000","last_clean":"2024-02-19T21:56:07.150035+0000","last_became_active":"2024-02-19T21:49:08.334527+0000","last_became_peered":"2024-02-19T21:49:08.334527+0000","last_unstale":"2024-02-19T21:56:07.150035+0000","last_undegraded":"2024-02-19T21:56:07.150035+0000","last_fullsized":"2024-02-19T21:56:07.150035+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'58","last_scrub_stamp":"2024-02-19T21:54:23.554337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:54:23.554337+0000","log_size":58,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":50,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":511,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.621781+0000","last_change":"2024-02-19T21:54:24.918144+0000","last_active":"2024-02-19T21:56:02.621781+0000","last_peered":"2024-02-19T21:56:02.621781+0000","last_clean":"2024-02-19T21:56:02.621781+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:56:02.621781+0000","last_undegraded":"2024-02-19T21:56:02.621781+0000","last_fullsized":"2024-02-19T21:56:02.621781+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:24.918045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:54:24.918045+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"537'9725","reported_seq":9783,"reported_epoch":537,"state":"active+clean","last_fresh":"2024-02-19T21:56:10.264891+0000","last_change":"2024-02-19T21:55:45.047127+0000","last_active":"2024-02-19T21:56:10.264891+0000","last_peered":"2024-02-19T21:56:10.264891+0000","last_clean":"2024-02-19T21:56:10.264891+0000","last_became_active":"2024-02-19T21:53:45.366773+0000","last_became_peered":"2024-02-19T21:53:45.366773+0000","last_unstale":"2024-02-19T21:56:10.264891+0000","last_undegraded":"2024-02-19T21:56:10.264891+0000","last_fullsized":"2024-02-19T21:56:10.264891+0000","mapping_epoch":492,"log_start":"510'4803","ondisk_log_start":"510'4803","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"529'8180","last_scrub_stamp":"2024-02-19T21:55:45.047016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:55:45.047016+0000","log_size":4922,"ondisk_log_size":4922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":310444032,"num_objects":4737,"num_object_clones":0,"num_object_copies":14211,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4737,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9725,"num_write_kb":462784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":564,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.630625+0000","last_change":"2024-02-19T21:55:52.928038+0000","last_active":"2024-02-19T21:56:02.630625+0000","last_peered":"2024-02-19T21:56:02.630625+0000","last_clean":"2024-02-19T21:56:02.630625+0000","last_became_active":"2024-02-19T21:53:45.368343+0000","last_became_peered":"2024-02-19T21:53:45.368343+0000","last_unstale":"2024-02-19T21:56:02.630625+0000","last_undegraded":"2024-02-19T21:56:02.630625+0000","last_fullsized":"2024-02-19T21:56:02.630625+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:52.927933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:55:52.927933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'6","reported_seq":2065,"reported_epoch":537,"state":"active+clean","last_fresh":"2024-02-19T21:56:09.686699+0000","last_change":"2024-02-19T21:53:56.369658+0000","last_active":"2024-02-19T21:56:09.686699+0000","last_peered":"2024-02-19T21:56:09.686699+0000","last_clean":"2024-02-19T21:56:09.686699+0000","last_became_active":"2024-02-19T21:49:08.331108+0000","last_became_peered":"2024-02-19T21:49:08.331108+0000","last_unstale":"2024-02-19T21:56:09.686699+0000","last_undegraded":"2024-02-19T21:56:09.686699+0000","last_fullsized":"2024-02-19T21:56:09.686699+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-02-19T21:53:56.369590+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_clean_scrub_stamp":"2024-02-19T21:53:56.369590+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1405,"num_read_kb":1400,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":168,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:01.608014+0000","last_change":"2024-02-19T21:54:07.330521+0000","last_active":"2024-02-19T21:56:01.608014+0000","last_peered":"2024-02-19T21:56:01.608014+0000","last_clean":"2024-02-19T21:56:01.608014+0000","last_became_active":"2024-02-19T21:49:08.329378+0000","last_became_peered":"2024-02-19T21:49:08.329378+0000","last_unstale":"2024-02-19T21:56:01.608014+0000","last_undegraded":"2024-02-19T21:56:01.608014+0000","last_fullsized":"2024-02-19T21:56:01.608014+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:07.330454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:07.330454+0000","last_clean_scrub_stamp":"2024-02-19T21:54:07.330454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"470'21","reported_seq":575,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.638041+0000","last_change":"2024-02-19T21:48:14.878933+0000","last_active":"2024-02-19T21:56:02.638041+0000","last_peered":"2024-02-19T21:56:02.638041+0000","last_clean":"2024-02-19T21:56:02.638041+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:56:02.638041+0000","last_undegraded":"2024-02-19T21:56:02.638041+0000","last_fullsized":"2024-02-19T21:56:02.638041+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'17","last_scrub_stamp":"2024-02-19T21:48:14.878857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.878857+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":31,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":173,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:01.608526+0000","last_change":"2024-02-19T21:55:09.965755+0000","last_active":"2024-02-19T21:56:01.608526+0000","last_peered":"2024-02-19T21:56:01.608526+0000","last_clean":"2024-02-19T21:56:01.608526+0000","last_became_active":"2024-02-19T21:49:08.325127+0000","last_became_peered":"2024-02-19T21:49:08.325127+0000","last_unstale":"2024-02-19T21:56:01.608526+0000","last_undegraded":"2024-02-19T21:56:01.608526+0000","last_fullsized":"2024-02-19T21:56:01.608526+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:09.965645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:55:09.965645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"537'12089","reported_seq":12152,"reported_epoch":537,"state":"active+clean","last_fresh":"2024-02-19T21:56:10.363395+0000","last_change":"2024-02-19T21:55:51.587481+0000","last_active":"2024-02-19T21:56:10.363395+0000","last_peered":"2024-02-19T21:56:10.363395+0000","last_clean":"2024-02-19T21:56:10.363395+0000","last_became_active":"2024-02-19T21:53:45.369947+0000","last_became_peered":"2024-02-19T21:53:45.369947+0000","last_unstale":"2024-02-19T21:56:10.363395+0000","last_undegraded":"2024-02-19T21:56:10.363395+0000","last_fullsized":"2024-02-19T21:56:10.363395+0000","mapping_epoch":492,"log_start":"501'2000","ondisk_log_start":"501'2000","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"530'10927","last_scrub_stamp":"2024-02-19T21:55:51.587372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:55:51.587372+0000","log_size":10089,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":328269824,"num_objects":5009,"num_object_clones":0,"num_object_copies":15027,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5009,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9831,"num_write_kb":474880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":551,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:01.618150+0000","last_change":"2024-02-19T21:54:05.543474+0000","last_active":"2024-02-19T21:56:01.618150+0000","last_peered":"2024-02-19T21:56:01.618150+0000","last_clean":"2024-02-19T21:56:01.618150+0000","last_became_active":"2024-02-19T21:53:45.385423+0000","last_became_peered":"2024-02-19T21:53:45.385423+0000","last_unstale":"2024-02-19T21:56:01.618150+0000","last_undegraded":"2024-02-19T21:56:01.618150+0000","last_fullsized":"2024-02-19T21:56:01.618150+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:05.543362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_clean_scrub_stamp":"2024-02-19T21:54:05.543362+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":420,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:01.625621+0000","last_change":"2024-02-19T21:55:15.374524+0000","last_active":"2024-02-19T21:56:01.625621+0000","last_peered":"2024-02-19T21:56:01.625621+0000","last_clean":"2024-02-19T21:56:01.625621+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:56:01.625621+0000","last_undegraded":"2024-02-19T21:56:01.625621+0000","last_fullsized":"2024-02-19T21:56:01.625621+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:15.374461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:55:15.374461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":581,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:01.616326+0000","last_change":"2024-02-19T21:54:52.479718+0000","last_active":"2024-02-19T21:56:01.616326+0000","last_peered":"2024-02-19T21:56:01.616326+0000","last_clean":"2024-02-19T21:56:01.616326+0000","last_became_active":"2024-02-19T21:54:52.479416+0000","last_became_peered":"2024-02-19T21:54:52.479416+0000","last_unstale":"2024-02-19T21:56:01.616326+0000","last_undegraded":"2024-02-19T21:56:01.616326+0000","last_fullsized":"2024-02-19T21:56:01.616326+0000","mapping_epoch":513,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":514,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:58.410478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:58.410478+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":138,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.631315+0000","last_change":"2024-02-19T21:53:51.510006+0000","last_active":"2024-02-19T21:56:02.631315+0000","last_peered":"2024-02-19T21:56:02.631315+0000","last_clean":"2024-02-19T21:56:02.631315+0000","last_became_active":"2024-02-19T21:49:54.483637+0000","last_became_peered":"2024-02-19T21:49:54.483637+0000","last_unstale":"2024-02-19T21:56:02.631315+0000","last_undegraded":"2024-02-19T21:56:02.631315+0000","last_fullsized":"2024-02-19T21:56:02.631315+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:51.509926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:53:51.509926+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"470'45","reported_seq":588,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.624989+0000","last_change":"2024-02-19T21:55:46.908853+0000","last_active":"2024-02-19T21:56:02.624989+0000","last_peered":"2024-02-19T21:56:02.624989+0000","last_clean":"2024-02-19T21:56:02.624989+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:56:02.624989+0000","last_undegraded":"2024-02-19T21:56:02.624989+0000","last_fullsized":"2024-02-19T21:56:02.624989+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'45","last_scrub_stamp":"2024-02-19T21:55:46.908753+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:55:46.908753+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":51,"num_write":37,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":138,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.630513+0000","last_change":"2024-02-19T21:53:55.571648+0000","last_active":"2024-02-19T21:56:02.630513+0000","last_peered":"2024-02-19T21:56:02.630513+0000","last_clean":"2024-02-19T21:56:02.630513+0000","last_became_active":"2024-02-19T21:49:54.477947+0000","last_became_peered":"2024-02-19T21:49:54.477947+0000","last_unstale":"2024-02-19T21:56:02.630513+0000","last_undegraded":"2024-02-19T21:56:02.630513+0000","last_fullsized":"2024-02-19T21:56:02.630513+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:55.571582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:53:55.571582+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"537'9561","reported_seq":9619,"reported_epoch":537,"state":"active+clean","last_fresh":"2024-02-19T21:56:10.202031+0000","last_change":"2024-02-19T21:55:15.103651+0000","last_active":"2024-02-19T21:56:10.202031+0000","last_peered":"2024-02-19T21:56:10.202031+0000","last_clean":"2024-02-19T21:56:10.202031+0000","last_became_active":"2024-02-19T21:53:45.367151+0000","last_became_peered":"2024-02-19T21:53:45.367151+0000","last_unstale":"2024-02-19T21:56:10.202031+0000","last_undegraded":"2024-02-19T21:56:10.202031+0000","last_fullsized":"2024-02-19T21:56:10.202031+0000","mapping_epoch":492,"log_start":"510'4700","ondisk_log_start":"510'4700","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"519'6500","last_scrub_stamp":"2024-02-19T21:55:15.103545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:55:15.103545+0000","log_size":4861,"ondisk_log_size":4861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":316604416,"num_objects":4831,"num_object_clones":0,"num_object_copies":14493,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4831,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9561,"num_write_kb":460544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1],"acting":[6,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":517,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.631113+0000","last_change":"2024-02-19T21:55:06.665581+0000","last_active":"2024-02-19T21:56:02.631113+0000","last_peered":"2024-02-19T21:56:02.631113+0000","last_clean":"2024-02-19T21:56:02.631113+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:56:02.631113+0000","last_undegraded":"2024-02-19T21:56:02.631113+0000","last_fullsized":"2024-02-19T21:56:02.631113+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:06.665516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:55:06.665516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":524,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.620960+0000","last_change":"2024-02-19T21:54:08.084019+0000","last_active":"2024-02-19T21:56:02.620960+0000","last_peered":"2024-02-19T21:56:02.620960+0000","last_clean":"2024-02-19T21:56:02.620960+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:56:02.620960+0000","last_undegraded":"2024-02-19T21:56:02.620960+0000","last_fullsized":"2024-02-19T21:56:02.620960+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:08.083923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:54:08.083923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":543,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.631481+0000","last_change":"2024-02-19T21:54:17.718006+0000","last_active":"2024-02-19T21:56:02.631481+0000","last_peered":"2024-02-19T21:56:02.631481+0000","last_clean":"2024-02-19T21:56:02.631481+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:56:02.631481+0000","last_undegraded":"2024-02-19T21:56:02.631481+0000","last_fullsized":"2024-02-19T21:56:02.631481+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:17.717904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:54:17.717904+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"470'42","reported_seq":686,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.623846+0000","last_change":"2024-02-19T21:54:18.926423+0000","last_active":"2024-02-19T21:56:02.623846+0000","last_peered":"2024-02-19T21:56:02.623846+0000","last_clean":"2024-02-19T21:56:02.623846+0000","last_became_active":"2024-02-19T21:49:08.329761+0000","last_became_peered":"2024-02-19T21:49:08.329761+0000","last_unstale":"2024-02-19T21:56:02.623846+0000","last_undegraded":"2024-02-19T21:56:02.623846+0000","last_fullsized":"2024-02-19T21:56:02.623846+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'42","last_scrub_stamp":"2024-02-19T21:54:18.926260+0000","last_deep_scrub":"324'30","last_deep_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_clean_scrub_stamp":"2024-02-19T21:54:18.926260+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":48,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":533,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:01.618079+0000","last_change":"2024-02-19T21:56:00.578823+0000","last_active":"2024-02-19T21:56:01.618079+0000","last_peered":"2024-02-19T21:56:01.618079+0000","last_clean":"2024-02-19T21:56:01.618079+0000","last_became_active":"2024-02-19T21:44:42.624782+0000","last_became_peered":"2024-02-19T21:44:42.624782+0000","last_unstale":"2024-02-19T21:56:01.618079+0000","last_undegraded":"2024-02-19T21:56:01.618079+0000","last_fullsized":"2024-02-19T21:56:01.618079+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":295,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:56:00.578725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_clean_scrub_stamp":"2024-02-19T21:56:00.578725+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.c","version":"537'9829","reported_seq":9881,"reported_epoch":537,"state":"active+clean","last_fresh":"2024-02-19T21:56:10.328881+0000","last_change":"2024-02-19T21:53:45.366888+0000","last_active":"2024-02-19T21:56:10.328881+0000","last_peered":"2024-02-19T21:56:10.328881+0000","last_clean":"2024-02-19T21:56:10.328881+0000","last_became_active":"2024-02-19T21:53:45.366605+0000","last_became_peered":"2024-02-19T21:53:45.366605+0000","last_unstale":"2024-02-19T21:56:10.328881+0000","last_undegraded":"2024-02-19T21:56:10.328881+0000","last_fullsized":"2024-02-19T21:56:10.328881+0000","mapping_epoch":492,"log_start":"510'4732","ondisk_log_start":"510'4732","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":5097,"ondisk_log_size":5097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":317784064,"num_objects":4849,"num_object_clones":0,"num_object_copies":14547,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4849,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9829,"num_write_kb":469696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":548,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.630785+0000","last_change":"2024-02-19T21:53:59.350715+0000","last_active":"2024-02-19T21:56:02.630785+0000","last_peered":"2024-02-19T21:56:02.630785+0000","last_clean":"2024-02-19T21:56:02.630785+0000","last_became_active":"2024-02-19T21:49:08.330648+0000","last_became_peered":"2024-02-19T21:49:08.330648+0000","last_unstale":"2024-02-19T21:56:02.630785+0000","last_undegraded":"2024-02-19T21:56:02.630785+0000","last_fullsized":"2024-02-19T21:56:02.630785+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:59.350627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:53:59.350627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":519,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.630689+0000","last_change":"2024-02-19T21:54:59.095681+0000","last_active":"2024-02-19T21:56:02.630689+0000","last_peered":"2024-02-19T21:56:02.630689+0000","last_clean":"2024-02-19T21:56:02.630689+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:56:02.630689+0000","last_undegraded":"2024-02-19T21:56:02.630689+0000","last_fullsized":"2024-02-19T21:56:02.630689+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:59.095573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:45.017696+0000","last_clean_scrub_stamp":"2024-02-19T21:54:59.095573+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"470'47","reported_seq":587,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.622008+0000","last_change":"2024-02-19T21:53:58.140432+0000","last_active":"2024-02-19T21:56:02.622008+0000","last_peered":"2024-02-19T21:56:02.622008+0000","last_clean":"2024-02-19T21:56:02.622008+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:56:02.622008+0000","last_undegraded":"2024-02-19T21:56:02.622008+0000","last_fullsized":"2024-02-19T21:56:02.622008+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'47","last_scrub_stamp":"2024-02-19T21:53:58.140324+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:53:58.140324+0000","log_size":47,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":55,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":516,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.624263+0000","last_change":"2024-02-19T21:54:02.567491+0000","last_active":"2024-02-19T21:56:02.624263+0000","last_peered":"2024-02-19T21:56:02.624263+0000","last_clean":"2024-02-19T21:56:02.624263+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:56:02.624263+0000","last_undegraded":"2024-02-19T21:56:02.624263+0000","last_fullsized":"2024-02-19T21:56:02.624263+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:02.567400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:54:02.567400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"537'9828","reported_seq":9881,"reported_epoch":537,"state":"active+clean","last_fresh":"2024-02-19T21:56:09.845667+0000","last_change":"2024-02-19T21:53:45.370394+0000","last_active":"2024-02-19T21:56:09.845667+0000","last_peered":"2024-02-19T21:56:09.845667+0000","last_clean":"2024-02-19T21:56:09.845667+0000","last_became_active":"2024-02-19T21:53:45.370069+0000","last_became_peered":"2024-02-19T21:53:45.370069+0000","last_unstale":"2024-02-19T21:56:09.845667+0000","last_undegraded":"2024-02-19T21:56:09.845667+0000","last_fullsized":"2024-02-19T21:56:09.845667+0000","mapping_epoch":492,"log_start":"510'4900","ondisk_log_start":"510'4900","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":4928,"ondisk_log_size":4928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":326762496,"num_objects":4986,"num_object_clones":0,"num_object_copies":14958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4986,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9828,"num_write_kb":474048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":261,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.636961+0000","last_change":"2024-02-19T21:54:04.297489+0000","last_active":"2024-02-19T21:56:02.636961+0000","last_peered":"2024-02-19T21:56:02.636961+0000","last_clean":"2024-02-19T21:56:02.636961+0000","last_became_active":"2024-02-19T21:49:08.326106+0000","last_became_peered":"2024-02-19T21:49:08.326106+0000","last_unstale":"2024-02-19T21:56:02.636961+0000","last_undegraded":"2024-02-19T21:56:02.636961+0000","last_fullsized":"2024-02-19T21:56:02.636961+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:04.297389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:04.297389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":520,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.631674+0000","last_change":"2024-02-19T21:55:58.021460+0000","last_active":"2024-02-19T21:56:02.631674+0000","last_peered":"2024-02-19T21:56:02.631674+0000","last_clean":"2024-02-19T21:56:02.631674+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:56:02.631674+0000","last_undegraded":"2024-02-19T21:56:02.631674+0000","last_fullsized":"2024-02-19T21:56:02.631674+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.879687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.879687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"470'50","reported_seq":174,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.631608+0000","last_change":"2024-02-19T21:55:18.969631+0000","last_active":"2024-02-19T21:56:02.631608+0000","last_peered":"2024-02-19T21:56:02.631608+0000","last_clean":"2024-02-19T21:56:02.631608+0000","last_became_active":"2024-02-19T21:49:54.480413+0000","last_became_peered":"2024-02-19T21:49:54.480413+0000","last_unstale":"2024-02-19T21:56:02.631608+0000","last_undegraded":"2024-02-19T21:56:02.631608+0000","last_fullsized":"2024-02-19T21:56:02.631608+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":415,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'50","last_scrub_stamp":"2024-02-19T21:55:18.969539+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:55:18.969539+0000","log_size":50,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":57,"num_write":44,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":412,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.623587+0000","last_change":"2024-02-19T21:54:58.727836+0000","last_active":"2024-02-19T21:56:02.623587+0000","last_peered":"2024-02-19T21:56:02.623587+0000","last_clean":"2024-02-19T21:56:02.623587+0000","last_became_active":"2024-02-19T21:49:54.494802+0000","last_became_peered":"2024-02-19T21:49:54.494802+0000","last_unstale":"2024-02-19T21:56:02.623587+0000","last_undegraded":"2024-02-19T21:56:02.623587+0000","last_fullsized":"2024-02-19T21:56:02.623587+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:58.727756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:54:58.727756+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"537'9904","reported_seq":9957,"reported_epoch":537,"state":"active+clean","last_fresh":"2024-02-19T21:56:10.356497+0000","last_change":"2024-02-19T21:53:45.386994+0000","last_active":"2024-02-19T21:56:10.356497+0000","last_peered":"2024-02-19T21:56:10.356497+0000","last_clean":"2024-02-19T21:56:10.356497+0000","last_became_active":"2024-02-19T21:53:45.386670+0000","last_became_peered":"2024-02-19T21:53:45.386670+0000","last_unstale":"2024-02-19T21:56:10.356497+0000","last_undegraded":"2024-02-19T21:56:10.356497+0000","last_fullsized":"2024-02-19T21:56:10.356497+0000","mapping_epoch":492,"log_start":"508'4200","ondisk_log_start":"508'4200","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":5704,"ondisk_log_size":5704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":325713920,"num_objects":4970,"num_object_clones":0,"num_object_copies":14910,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4970,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9904,"num_write_kb":475968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7],"acting":[4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":548,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.630247+0000","last_change":"2024-02-19T21:54:01.641103+0000","last_active":"2024-02-19T21:56:02.630247+0000","last_peered":"2024-02-19T21:56:02.630247+0000","last_clean":"2024-02-19T21:56:02.630247+0000","last_became_active":"2024-02-19T21:49:08.328529+0000","last_became_peered":"2024-02-19T21:49:08.328529+0000","last_unstale":"2024-02-19T21:56:02.630247+0000","last_undegraded":"2024-02-19T21:56:02.630247+0000","last_fullsized":"2024-02-19T21:56:02.630247+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:01.641007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:01.641007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":579,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.625302+0000","last_change":"2024-02-19T21:53:52.715548+0000","last_active":"2024-02-19T21:56:02.625302+0000","last_peered":"2024-02-19T21:56:02.625302+0000","last_clean":"2024-02-19T21:56:02.625302+0000","last_became_active":"2024-02-19T21:49:54.493041+0000","last_became_peered":"2024-02-19T21:49:54.493041+0000","last_unstale":"2024-02-19T21:56:02.625302+0000","last_undegraded":"2024-02-19T21:56:02.625302+0000","last_fullsized":"2024-02-19T21:56:02.625302+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:52.715486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:52.715486+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"470'42","reported_seq":409,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.636873+0000","last_change":"2024-02-19T21:54:01.223459+0000","last_active":"2024-02-19T21:56:02.636873+0000","last_peered":"2024-02-19T21:56:02.636873+0000","last_clean":"2024-02-19T21:56:02.636873+0000","last_became_active":"2024-02-19T21:49:08.330477+0000","last_became_peered":"2024-02-19T21:49:08.330477+0000","last_unstale":"2024-02-19T21:56:02.636873+0000","last_undegraded":"2024-02-19T21:56:02.636873+0000","last_fullsized":"2024-02-19T21:56:02.636873+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'42","last_scrub_stamp":"2024-02-19T21:54:01.223355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:54:01.223355+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":662,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:07.151279+0000","last_change":"2024-02-19T21:55:03.593029+0000","last_active":"2024-02-19T21:56:07.151279+0000","last_peered":"2024-02-19T21:56:07.151279+0000","last_clean":"2024-02-19T21:56:07.151279+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:56:07.151279+0000","last_undegraded":"2024-02-19T21:56:07.151279+0000","last_fullsized":"2024-02-19T21:56:07.151279+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'9","last_scrub_stamp":"2024-02-19T21:55:03.592953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:55:03.592953+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"537'9725","reported_seq":9785,"reported_epoch":537,"state":"active+clean","last_fresh":"2024-02-19T21:56:10.240734+0000","last_change":"2024-02-19T21:55:58.927490+0000","last_active":"2024-02-19T21:56:10.240734+0000","last_peered":"2024-02-19T21:56:10.240734+0000","last_clean":"2024-02-19T21:56:10.240734+0000","last_became_active":"2024-02-19T21:53:45.366735+0000","last_became_peered":"2024-02-19T21:53:45.366735+0000","last_unstale":"2024-02-19T21:56:10.240734+0000","last_undegraded":"2024-02-19T21:56:10.240734+0000","last_fullsized":"2024-02-19T21:56:10.240734+0000","mapping_epoch":492,"log_start":"510'4800","ondisk_log_start":"510'4800","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"533'9018","last_scrub_stamp":"2024-02-19T21:55:58.927256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:55:58.927256+0000","log_size":4925,"ondisk_log_size":4925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":324599808,"num_objects":4953,"num_object_clones":0,"num_object_copies":14859,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4953,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9725,"num_write_kb":469696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"66'1","reported_seq":430,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.623694+0000","last_change":"2024-02-19T21:54:23.697006+0000","last_active":"2024-02-19T21:56:02.623694+0000","last_peered":"2024-02-19T21:56:02.623694+0000","last_clean":"2024-02-19T21:56:02.623694+0000","last_became_active":"2024-02-19T21:44:56.166670+0000","last_became_peered":"2024-02-19T21:44:56.166670+0000","last_unstale":"2024-02-19T21:56:02.623694+0000","last_undegraded":"2024-02-19T21:56:02.623694+0000","last_fullsized":"2024-02-19T21:56:02.623694+0000","mapping_epoch":165,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:54:23.696937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:54:23.696937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"261'11","reported_seq":672,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.498754+0000","last_change":"2024-02-19T21:56:02.498754+0000","last_active":"2024-02-19T21:56:02.498754+0000","last_peered":"2024-02-19T21:56:02.498754+0000","last_clean":"2024-02-19T21:56:02.498754+0000","last_became_active":"2024-02-19T21:44:08.123392+0000","last_became_peered":"2024-02-19T21:44:08.123392+0000","last_unstale":"2024-02-19T21:56:02.498754+0000","last_undegraded":"2024-02-19T21:56:02.498754+0000","last_fullsized":"2024-02-19T21:56:02.498754+0000","mapping_epoch":62,"log_start":"257'10","ondisk_log_start":"257'10","created":62,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-02-19T21:53:55.479699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:53:55.479699+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":530,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.631528+0000","last_change":"2024-02-19T21:54:16.707968+0000","last_active":"2024-02-19T21:56:02.631528+0000","last_peered":"2024-02-19T21:56:02.631528+0000","last_clean":"2024-02-19T21:56:02.631528+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:56:02.631528+0000","last_undegraded":"2024-02-19T21:56:02.631528+0000","last_fullsized":"2024-02-19T21:56:02.631528+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:54:16.707865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:54:16.707865+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"470'27","reported_seq":400,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.638477+0000","last_change":"2024-02-19T21:55:46.521391+0000","last_active":"2024-02-19T21:56:02.638477+0000","last_peered":"2024-02-19T21:56:02.638477+0000","last_clean":"2024-02-19T21:56:02.638477+0000","last_became_active":"2024-02-19T21:47:46.251550+0000","last_became_peered":"2024-02-19T21:47:46.251550+0000","last_unstale":"2024-02-19T21:56:02.638477+0000","last_undegraded":"2024-02-19T21:56:02.638477+0000","last_fullsized":"2024-02-19T21:56:02.638477+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'27","last_scrub_stamp":"2024-02-19T21:55:46.521264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:55:46.521264+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7],"acting":[4,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.0","version":"537'9748","reported_seq":9801,"reported_epoch":537,"state":"active+clean","last_fresh":"2024-02-19T21:56:10.341735+0000","last_change":"2024-02-19T21:53:45.376702+0000","last_active":"2024-02-19T21:56:10.341735+0000","last_peered":"2024-02-19T21:56:10.341735+0000","last_clean":"2024-02-19T21:56:10.341735+0000","last_became_active":"2024-02-19T21:53:45.376392+0000","last_became_peered":"2024-02-19T21:53:45.376392+0000","last_unstale":"2024-02-19T21:56:10.341735+0000","last_undegraded":"2024-02-19T21:56:10.341735+0000","last_fullsized":"2024-02-19T21:56:10.341735+0000","mapping_epoch":492,"log_start":"510'4651","ondisk_log_start":"510'4651","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":5097,"ondisk_log_size":5097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":324141056,"num_objects":4946,"num_object_clones":0,"num_object_copies":14838,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4946,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9748,"num_write_kb":470208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,6],"acting":[1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":535,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:01.618713+0000","last_change":"2024-02-19T21:54:06.529408+0000","last_active":"2024-02-19T21:56:01.618713+0000","last_peered":"2024-02-19T21:56:01.618713+0000","last_clean":"2024-02-19T21:56:01.618713+0000","last_became_active":"2024-02-19T21:44:56.155194+0000","last_became_peered":"2024-02-19T21:44:56.155194+0000","last_unstale":"2024-02-19T21:56:01.618713+0000","last_undegraded":"2024-02-19T21:56:01.618713+0000","last_fullsized":"2024-02-19T21:56:01.618713+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:06.529311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:06.529311+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"363'12","reported_seq":385,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:07.152563+0000","last_change":"2024-02-19T21:55:47.510672+0000","last_active":"2024-02-19T21:56:07.152563+0000","last_peered":"2024-02-19T21:56:07.152563+0000","last_clean":"2024-02-19T21:56:07.152563+0000","last_became_active":"2024-02-19T21:47:46.260099+0000","last_became_peered":"2024-02-19T21:47:46.260099+0000","last_unstale":"2024-02-19T21:56:07.152563+0000","last_undegraded":"2024-02-19T21:56:07.152563+0000","last_fullsized":"2024-02-19T21:56:07.152563+0000","mapping_epoch":362,"log_start":"98'9","ondisk_log_start":"98'9","created":62,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"363'12","last_scrub_stamp":"2024-02-19T21:55:47.510574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:55:47.510574+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":550,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.630709+0000","last_change":"2024-02-19T21:55:02.556526+0000","last_active":"2024-02-19T21:56:02.630709+0000","last_peered":"2024-02-19T21:56:02.630709+0000","last_clean":"2024-02-19T21:56:02.630709+0000","last_became_active":"2024-02-19T21:53:45.382885+0000","last_became_peered":"2024-02-19T21:53:45.382885+0000","last_unstale":"2024-02-19T21:56:02.630709+0000","last_undegraded":"2024-02-19T21:56:02.630709+0000","last_fullsized":"2024-02-19T21:56:02.630709+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:02.556431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:55:02.556431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"471'46","reported_seq":502,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:01.617789+0000","last_change":"2024-02-19T21:54:24.358037+0000","last_active":"2024-02-19T21:56:01.617789+0000","last_peered":"2024-02-19T21:56:01.617789+0000","last_clean":"2024-02-19T21:56:01.617789+0000","last_became_active":"2024-02-19T21:53:45.384528+0000","last_became_peered":"2024-02-19T21:53:45.384528+0000","last_unstale":"2024-02-19T21:56:01.617789+0000","last_undegraded":"2024-02-19T21:56:01.617789+0000","last_fullsized":"2024-02-19T21:56:01.617789+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'46","last_scrub_stamp":"2024-02-19T21:54:24.357931+0000","last_deep_scrub":"270'34","last_deep_scrub_stamp":"2024-02-19T21:44:17.451151+0000","last_clean_scrub_stamp":"2024-02-19T21:54:24.357931+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"537'10139","reported_seq":10192,"reported_epoch":537,"state":"active+clean","last_fresh":"2024-02-19T21:56:10.278227+0000","last_change":"2024-02-19T21:56:02.628871+0000","last_active":"2024-02-19T21:56:10.278227+0000","last_peered":"2024-02-19T21:56:10.278227+0000","last_clean":"2024-02-19T21:56:10.278227+0000","last_became_active":"2024-02-19T21:53:45.368025+0000","last_became_peered":"2024-02-19T21:53:45.368025+0000","last_unstale":"2024-02-19T21:56:10.278227+0000","last_undegraded":"2024-02-19T21:56:10.278227+0000","last_fullsized":"2024-02-19T21:56:10.278227+0000","mapping_epoch":492,"log_start":"511'5271","ondisk_log_start":"511'5271","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":4868,"ondisk_log_size":4868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":320798720,"num_objects":4895,"num_object_clones":0,"num_object_copies":14685,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4895,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10139,"num_write_kb":481088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1],"acting":[6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":519,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.638663+0000","last_change":"2024-02-19T21:53:55.275891+0000","last_active":"2024-02-19T21:56:02.638663+0000","last_peered":"2024-02-19T21:56:02.638663+0000","last_clean":"2024-02-19T21:56:02.638663+0000","last_became_active":"2024-02-19T21:49:08.328697+0000","last_became_peered":"2024-02-19T21:49:08.328697+0000","last_unstale":"2024-02-19T21:56:02.638663+0000","last_undegraded":"2024-02-19T21:56:02.638663+0000","last_fullsized":"2024-02-19T21:56:02.638663+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:55.275772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:53:55.275772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"397'17","reported_seq":521,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.633858+0000","last_change":"2024-02-19T21:55:52.652496+0000","last_active":"2024-02-19T21:56:02.633858+0000","last_peered":"2024-02-19T21:56:02.633858+0000","last_clean":"2024-02-19T21:56:02.633858+0000","last_became_active":"2024-02-19T21:49:08.325034+0000","last_became_peered":"2024-02-19T21:49:08.325034+0000","last_unstale":"2024-02-19T21:56:02.633858+0000","last_undegraded":"2024-02-19T21:56:02.633858+0000","last_fullsized":"2024-02-19T21:56:02.633858+0000","mapping_epoch":394,"log_start":"170'11","ondisk_log_start":"170'11","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"397'17","last_scrub_stamp":"2024-02-19T21:55:52.652385+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:55:52.652385+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":535,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.631189+0000","last_change":"2024-02-19T21:53:45.383685+0000","last_active":"2024-02-19T21:56:02.631189+0000","last_peered":"2024-02-19T21:56:02.631189+0000","last_clean":"2024-02-19T21:56:02.631189+0000","last_became_active":"2024-02-19T21:53:45.383372+0000","last_became_peered":"2024-02-19T21:53:45.383372+0000","last_unstale":"2024-02-19T21:56:02.631189+0000","last_undegraded":"2024-02-19T21:56:02.631189+0000","last_fullsized":"2024-02-19T21:56:02.631189+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:03.987749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:49:03.987749+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"470'30","reported_seq":401,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.636996+0000","last_change":"2024-02-19T21:54:11.381056+0000","last_active":"2024-02-19T21:56:02.636996+0000","last_peered":"2024-02-19T21:56:02.636996+0000","last_clean":"2024-02-19T21:56:02.636996+0000","last_became_active":"2024-02-19T21:53:45.387040+0000","last_became_peered":"2024-02-19T21:53:45.387040+0000","last_unstale":"2024-02-19T21:56:02.636996+0000","last_undegraded":"2024-02-19T21:56:02.636996+0000","last_fullsized":"2024-02-19T21:56:02.636996+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'30","last_scrub_stamp":"2024-02-19T21:54:11.380958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:54:11.380958+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":38,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"536'9728","reported_seq":9783,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:07.304316+0000","last_change":"2024-02-19T21:55:18.390850+0000","last_active":"2024-02-19T21:56:07.304316+0000","last_peered":"2024-02-19T21:56:07.304316+0000","last_clean":"2024-02-19T21:56:07.304316+0000","last_became_active":"2024-02-19T21:53:45.369133+0000","last_became_peered":"2024-02-19T21:53:45.369133+0000","last_unstale":"2024-02-19T21:56:07.304316+0000","last_undegraded":"2024-02-19T21:56:07.304316+0000","last_fullsized":"2024-02-19T21:56:07.304316+0000","mapping_epoch":492,"log_start":"505'3700","ondisk_log_start":"505'3700","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"520'6862","last_scrub_stamp":"2024-02-19T21:55:18.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:55:18.390740+0000","log_size":6028,"ondisk_log_size":6028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":343670784,"num_objects":5244,"num_object_clones":0,"num_object_copies":15732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5244,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9728,"num_write_kb":479104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":173,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:01.608319+0000","last_change":"2024-02-19T21:55:53.801441+0000","last_active":"2024-02-19T21:56:01.608319+0000","last_peered":"2024-02-19T21:56:01.608319+0000","last_clean":"2024-02-19T21:56:01.608319+0000","last_became_active":"2024-02-19T21:49:08.327172+0000","last_became_peered":"2024-02-19T21:49:08.327172+0000","last_unstale":"2024-02-19T21:56:01.608319+0000","last_undegraded":"2024-02-19T21:56:01.608319+0000","last_fullsized":"2024-02-19T21:56:01.608319+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:53.801346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:55:53.801346+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,6],"acting":[2,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":526,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.631023+0000","last_change":"2024-02-19T21:54:16.533065+0000","last_active":"2024-02-19T21:56:02.631023+0000","last_peered":"2024-02-19T21:56:02.631023+0000","last_clean":"2024-02-19T21:56:02.631023+0000","last_became_active":"2024-02-19T21:44:22.245925+0000","last_became_peered":"2024-02-19T21:44:22.245925+0000","last_unstale":"2024-02-19T21:56:02.631023+0000","last_undegraded":"2024-02-19T21:56:02.631023+0000","last_fullsized":"2024-02-19T21:56:02.631023+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:16.532968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:54:16.532968+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":526,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.630115+0000","last_change":"2024-02-19T21:54:22.796082+0000","last_active":"2024-02-19T21:56:02.630115+0000","last_peered":"2024-02-19T21:56:02.630115+0000","last_clean":"2024-02-19T21:56:02.630115+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:56:02.630115+0000","last_undegraded":"2024-02-19T21:56:02.630115+0000","last_fullsized":"2024-02-19T21:56:02.630115+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:22.795999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:54:22.795999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"470'53","reported_seq":495,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.637363+0000","last_change":"2024-02-19T21:54:05.257204+0000","last_active":"2024-02-19T21:56:02.637363+0000","last_peered":"2024-02-19T21:56:02.637363+0000","last_clean":"2024-02-19T21:56:02.637363+0000","last_became_active":"2024-02-19T21:49:08.325683+0000","last_became_peered":"2024-02-19T21:49:08.325683+0000","last_unstale":"2024-02-19T21:56:02.637363+0000","last_undegraded":"2024-02-19T21:56:02.637363+0000","last_fullsized":"2024-02-19T21:56:02.637363+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'53","last_scrub_stamp":"2024-02-19T21:54:05.257106+0000","last_deep_scrub":"337'39","last_deep_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_clean_scrub_stamp":"2024-02-19T21:54:05.257106+0000","log_size":53,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"537'9605","reported_seq":9662,"reported_epoch":537,"state":"active+clean","last_fresh":"2024-02-19T21:56:09.916448+0000","last_change":"2024-02-19T21:55:58.834453+0000","last_active":"2024-02-19T21:56:09.916448+0000","last_peered":"2024-02-19T21:56:09.916448+0000","last_clean":"2024-02-19T21:56:09.916448+0000","last_became_active":"2024-02-19T21:53:45.369204+0000","last_became_peered":"2024-02-19T21:53:45.369204+0000","last_unstale":"2024-02-19T21:56:09.916448+0000","last_undegraded":"2024-02-19T21:56:09.916448+0000","last_fullsized":"2024-02-19T21:56:09.916448+0000","mapping_epoch":492,"log_start":"510'4600","ondisk_log_start":"510'4600","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":5005,"ondisk_log_size":5005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":321191936,"num_objects":4901,"num_object_clones":0,"num_object_copies":14703,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4901,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9605,"num_write_kb":464192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.8","version":"66'1","reported_seq":387,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.631387+0000","last_change":"2024-02-19T21:55:54.932304+0000","last_active":"2024-02-19T21:56:02.631387+0000","last_peered":"2024-02-19T21:56:02.631387+0000","last_clean":"2024-02-19T21:56:02.631387+0000","last_became_active":"2024-02-19T21:53:48.374606+0000","last_became_peered":"2024-02-19T21:53:48.374606+0000","last_unstale":"2024-02-19T21:56:02.631387+0000","last_undegraded":"2024-02-19T21:56:02.631387+0000","last_fullsized":"2024-02-19T21:56:02.631387+0000","mapping_epoch":495,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":496,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:55:54.932216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:55:54.932216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":173,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:01.607787+0000","last_change":"2024-02-19T21:55:07.096301+0000","last_active":"2024-02-19T21:56:01.607787+0000","last_peered":"2024-02-19T21:56:01.607787+0000","last_clean":"2024-02-19T21:56:01.607787+0000","last_became_active":"2024-02-19T21:49:08.324835+0000","last_became_peered":"2024-02-19T21:49:08.324835+0000","last_unstale":"2024-02-19T21:56:01.607787+0000","last_undegraded":"2024-02-19T21:56:01.607787+0000","last_fullsized":"2024-02-19T21:56:01.607787+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:07.096186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_clean_scrub_stamp":"2024-02-19T21:55:07.096186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":249,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.623440+0000","last_change":"2024-02-19T21:55:47.904418+0000","last_active":"2024-02-19T21:56:02.623440+0000","last_peered":"2024-02-19T21:56:02.623440+0000","last_clean":"2024-02-19T21:56:02.623440+0000","last_became_active":"2024-02-19T21:49:08.327186+0000","last_became_peered":"2024-02-19T21:49:08.327186+0000","last_unstale":"2024-02-19T21:56:02.623440+0000","last_undegraded":"2024-02-19T21:56:02.623440+0000","last_fullsized":"2024-02-19T21:56:02.623440+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:55:47.904302+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:55:47.904302+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"471'60","reported_seq":669,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.624118+0000","last_change":"2024-02-19T21:54:59.710692+0000","last_active":"2024-02-19T21:56:02.624118+0000","last_peered":"2024-02-19T21:56:02.624118+0000","last_clean":"2024-02-19T21:56:02.624118+0000","last_became_active":"2024-02-19T21:49:54.493167+0000","last_became_peered":"2024-02-19T21:49:54.493167+0000","last_unstale":"2024-02-19T21:56:02.624118+0000","last_undegraded":"2024-02-19T21:56:02.624118+0000","last_fullsized":"2024-02-19T21:56:02.624118+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'60","last_scrub_stamp":"2024-02-19T21:54:59.710570+0000","last_deep_scrub":"201'44","last_deep_scrub_stamp":"2024-02-19T21:44:16.255049+0000","last_clean_scrub_stamp":"2024-02-19T21:54:59.710570+0000","log_size":60,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":80,"num_read_kb":69,"num_write":52,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.4","version":"537'9723","reported_seq":9776,"reported_epoch":537,"state":"active+clean","last_fresh":"2024-02-19T21:56:09.915965+0000","last_change":"2024-02-19T21:53:45.370493+0000","last_active":"2024-02-19T21:56:09.915965+0000","last_peered":"2024-02-19T21:56:09.915965+0000","last_clean":"2024-02-19T21:56:09.915965+0000","last_became_active":"2024-02-19T21:53:45.370111+0000","last_became_peered":"2024-02-19T21:53:45.370111+0000","last_unstale":"2024-02-19T21:56:09.915965+0000","last_undegraded":"2024-02-19T21:56:09.915965+0000","last_fullsized":"2024-02-19T21:56:09.915965+0000","mapping_epoch":492,"log_start":"510'4800","ondisk_log_start":"510'4800","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":4923,"ondisk_log_size":4923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":326959104,"num_objects":4989,"num_object_clones":0,"num_object_copies":14967,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4989,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9723,"num_write_kb":470784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":569,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.621196+0000","last_change":"2024-02-19T21:54:11.072349+0000","last_active":"2024-02-19T21:56:02.621196+0000","last_peered":"2024-02-19T21:56:02.621196+0000","last_clean":"2024-02-19T21:56:02.621196+0000","last_became_active":"2024-02-19T21:49:08.328287+0000","last_became_peered":"2024-02-19T21:49:08.328287+0000","last_unstale":"2024-02-19T21:56:02.621196+0000","last_undegraded":"2024-02-19T21:56:02.621196+0000","last_fullsized":"2024-02-19T21:56:02.621196+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:11.072274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:11.072274+0000","last_clean_scrub_stamp":"2024-02-19T21:54:11.072274+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":168,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:01.607501+0000","last_change":"2024-02-19T21:54:09.300812+0000","last_active":"2024-02-19T21:56:01.607501+0000","last_peered":"2024-02-19T21:56:01.607501+0000","last_clean":"2024-02-19T21:56:01.607501+0000","last_became_active":"2024-02-19T21:49:08.331451+0000","last_became_peered":"2024-02-19T21:49:08.331451+0000","last_unstale":"2024-02-19T21:56:01.607501+0000","last_undegraded":"2024-02-19T21:56:01.607501+0000","last_fullsized":"2024-02-19T21:56:01.607501+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:09.300710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.547129+0000","last_clean_scrub_stamp":"2024-02-19T21:54:09.300710+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":550,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.631193+0000","last_change":"2024-02-19T21:55:10.585700+0000","last_active":"2024-02-19T21:56:02.631193+0000","last_peered":"2024-02-19T21:56:02.631193+0000","last_clean":"2024-02-19T21:56:02.631193+0000","last_became_active":"2024-02-19T21:53:45.384695+0000","last_became_peered":"2024-02-19T21:53:45.384695+0000","last_unstale":"2024-02-19T21:56:02.631193+0000","last_undegraded":"2024-02-19T21:56:02.631193+0000","last_fullsized":"2024-02-19T21:56:02.631193+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:10.585574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:55:10.585574+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"470'25","reported_seq":558,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:02.622207+0000","last_change":"2024-02-19T21:55:06.814685+0000","last_active":"2024-02-19T21:56:02.622207+0000","last_peered":"2024-02-19T21:56:02.622207+0000","last_clean":"2024-02-19T21:56:02.622207+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:56:02.622207+0000","last_undegraded":"2024-02-19T21:56:02.622207+0000","last_fullsized":"2024-02-19T21:56:02.622207+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'25","last_scrub_stamp":"2024-02-19T21:55:06.814592+0000","last_deep_scrub":"377'19","last_deep_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_clean_scrub_stamp":"2024-02-19T21:55:06.814592+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"536'9253","reported_seq":9310,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:05.400742+0000","last_change":"2024-02-19T21:55:56.311097+0000","last_active":"2024-02-19T21:56:05.400742+0000","last_peered":"2024-02-19T21:56:05.400742+0000","last_clean":"2024-02-19T21:56:05.400742+0000","last_became_active":"2024-02-19T21:53:45.367724+0000","last_became_peered":"2024-02-19T21:53:45.367724+0000","last_unstale":"2024-02-19T21:56:05.400742+0000","last_undegraded":"2024-02-19T21:56:05.400742+0000","last_fullsized":"2024-02-19T21:56:05.400742+0000","mapping_epoch":492,"log_start":"504'3400","ondisk_log_start":"504'3400","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"532'8688","last_scrub_stamp":"2024-02-19T21:55:56.310997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:55:56.310997+0000","log_size":5853,"ondisk_log_size":5853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":336003072,"num_objects":5127,"num_object_clones":0,"num_object_copies":15381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5127,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9253,"num_write_kb":460160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4],"acting":[5,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":533,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:01.620126+0000","last_change":"2024-02-19T21:54:09.344599+0000","last_active":"2024-02-19T21:56:01.620126+0000","last_peered":"2024-02-19T21:56:01.620126+0000","last_clean":"2024-02-19T21:56:01.620126+0000","last_became_active":"2024-02-19T21:44:56.160521+0000","last_became_peered":"2024-02-19T21:44:56.160521+0000","last_unstale":"2024-02-19T21:56:01.620126+0000","last_undegraded":"2024-02-19T21:56:01.620126+0000","last_fullsized":"2024-02-19T21:56:01.620126+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:09.344514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:54:09.344514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":177,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:01.608625+0000","last_change":"2024-02-19T21:54:16.360569+0000","last_active":"2024-02-19T21:56:01.608625+0000","last_peered":"2024-02-19T21:56:01.608625+0000","last_clean":"2024-02-19T21:56:01.608625+0000","last_became_active":"2024-02-19T21:49:54.485078+0000","last_became_peered":"2024-02-19T21:49:54.485078+0000","last_unstale":"2024-02-19T21:56:01.608625+0000","last_undegraded":"2024-02-19T21:56:01.608625+0000","last_fullsized":"2024-02-19T21:56:01.608625+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:16.360470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:54:16.360470+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"470'39","reported_seq":628,"reported_epoch":535,"state":"active+clean","last_fresh":"2024-02-19T21:56:01.616991+0000","last_change":"2024-02-19T21:54:58.172666+0000","last_active":"2024-02-19T21:56:01.616991+0000","last_peered":"2024-02-19T21:56:01.616991+0000","last_clean":"2024-02-19T21:56:01.616991+0000","last_became_active":"2024-02-19T21:49:54.486014+0000","last_became_peered":"2024-02-19T21:49:54.486014+0000","last_unstale":"2024-02-19T21:56:01.616991+0000","last_undegraded":"2024-02-19T21:56:01.616991+0000","last_fullsized":"2024-02-19T21:56:01.616991+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'39","last_scrub_stamp":"2024-02-19T21:54:58.172560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:54:58.172560+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"324'11","reported_seq":835,"reported_epoch":536,"state":"active+clean","last_fresh":"2024-02-19T21:56:07.153178+0000","last_change":"2024-02-19T21:54:21.760361+0000","last_active":"2024-02-19T21:56:07.153178+0000","last_peered":"2024-02-19T21:56:07.153178+0000","last_clean":"2024-02-19T21:56:07.153178+0000","last_became_active":"2024-02-19T21:44:34.385140+0000","last_became_peered":"2024-02-19T21:44:34.385140+0000","last_unstale":"2024-02-19T21:56:07.153178+0000","last_undegraded":"2024-02-19T21:56:07.153178+0000","last_fullsized":"2024-02-19T21:56:07.153178+0000","mapping_epoch":62,"log_start":"66'8","ondisk_log_start":"66'8","created":62,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'11","last_scrub_stamp":"2024-02-19T21:54:21.760260+0000","last_deep_scrub":"324'11","last_deep_scrub_stamp":"2024-02-19T21:46:05.210095+0000","last_clean_scrub_stamp":"2024-02-19T21:54:21.760260+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":16,"stat_sum":{"num_bytes":5207293976,"num_objects":79458,"num_object_clones":0,"num_object_copies":238374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79458,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":155756,"num_write_kb":7526785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15651647488,"data_stored":15651635272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":89128,"ondisk_log_size":89128,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1405,"num_read_kb":1400,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1535,"num_read_kb":1292,"num_write":989,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":316,"num_bytes_recovered":5942,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1062,"ondisk_log_size":1062,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":22,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":66,"acting":66,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201568,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2827228,"kb_used_data":2237524,"kb_used_omap":0,"kb_used_meta":589696,"kb_avail":90917924,"statfs":{"total":95995035648,"available":93099954176,"internally_reserved":0,"allocated":2291224576,"data_stored":2289557429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":603848704},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:55:58 2024","interfaces":[{"interface":"back","average":{"1min":2.1960000000000002,"5min":1.3240000000000001,"15min":1.9430000000000001},"min":{"1min":0.25900000000000001,"5min":0.20899999999999999,"15min":0.19},"max":{"1min":9.2200000000000006,"5min":9.2200000000000006,"15min":70.477999999999994},"last":4.3650000000000002},{"interface":"front","average":{"1min":1.9299999999999999,"5min":1.2250000000000001,"15min":1.97},"min":{"1min":0.317,"5min":0.23899999999999999,"15min":0.21199999999999999},"max":{"1min":8.3710000000000004,"5min":9.8759999999999994,"15min":68.052000000000007},"last":0.28599999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:55:58 2024","interfaces":[{"interface":"back","average":{"1min":2.5680000000000001,"5min":1.605,"15min":2.04},"min":{"1min":0.28000000000000003,"5min":0.25,"15min":0.23799999999999999},"max":{"1min":8.9619999999999997,"5min":8.9619999999999997,"15min":68.168000000000006},"last":0.39100000000000001},{"interface":"front","average":{"1min":2.2679999999999998,"5min":1.333,"15min":2.1440000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":9.7289999999999992,"5min":9.9559999999999995,"15min":68.444000000000003},"last":0.47999999999999998}]},{"osd":2,"last update":"Mon Feb 19 21:55:20 2024","interfaces":[{"interface":"back","average":{"1min":1.9239999999999999,"5min":1.1759999999999999,"15min":1.992},"min":{"1min":0.308,"5min":0.29099999999999998,"15min":0.28599999999999998},"max":{"1min":12.352,"5min":12.352,"15min":12.352},"last":3.976},{"interface":"front","average":{"1min":2.0790000000000002,"5min":1.3720000000000001,"15min":1.833},"min":{"1min":0.30299999999999999,"5min":0.28299999999999997,"15min":0.28100000000000003},"max":{"1min":12.369,"5min":12.369,"15min":12.369},"last":4.0490000000000004}]},{"osd":3,"last update":"Mon Feb 19 21:55:58 2024","interfaces":[{"interface":"back","average":{"1min":2.1280000000000001,"5min":1.6739999999999999,"15min":1.9319999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.25900000000000001},"max":{"1min":9.1099999999999994,"5min":9.1099999999999994,"15min":11.778},"last":0.40600000000000003},{"interface":"front","average":{"1min":2.427,"5min":1.746,"15min":1.742},"min":{"1min":0.439,"5min":0.312,"15min":0.29299999999999998},"max":{"1min":8.9920000000000009,"5min":13.196,"15min":13.473000000000001},"last":0.35499999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:55:58 2024","interfaces":[{"interface":"back","average":{"1min":2.2130000000000001,"5min":1.4770000000000001,"15min":1.79},"min":{"1min":0.32400000000000001,"5min":0.254,"15min":0.216},"max":{"1min":8.6129999999999995,"5min":10.656000000000001,"15min":17.716999999999999},"last":0.255},{"interface":"front","average":{"1min":3.056,"5min":1.974,"15min":2.2440000000000002},"min":{"1min":0.312,"5min":0.26700000000000002,"15min":0.253},"max":{"1min":12.164,"5min":15.961,"15min":17.690999999999999},"last":0.30399999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:55:58 2024","interfaces":[{"interface":"back","average":{"1min":2.496,"5min":1.6839999999999999,"15min":1.853},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.24199999999999999},"max":{"1min":14.675000000000001,"5min":14.675000000000001,"15min":29.021000000000001},"last":0.31900000000000001},{"interface":"front","average":{"1min":2.609,"5min":1.7450000000000001,"15min":2.1469999999999998},"min":{"1min":0.34499999999999997,"5min":0.29399999999999998,"15min":0.28699999999999998},"max":{"1min":8.4320000000000004,"5min":9.9269999999999996,"15min":29.091999999999999},"last":0.33500000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:55:58 2024","interfaces":[{"interface":"back","average":{"1min":2.5089999999999999,"5min":1.8109999999999999,"15min":2.0179999999999998},"min":{"1min":0.374,"5min":0.28299999999999997,"15min":0.24299999999999999},"max":{"1min":8.4710000000000001,"5min":15.426,"15min":19.286000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":3.1539999999999999,"5min":2.0150000000000001,"15min":2.2010000000000001},"min":{"1min":0.39800000000000002,"5min":0.27500000000000002,"15min":0.26700000000000002},"max":{"1min":11.894,"5min":11.894,"15min":18.364000000000001},"last":0.34899999999999998}]}]},{"osd":6,"up_from":47,"seq":201863463207,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3732764,"kb_used_data":2847572,"kb_used_omap":0,"kb_used_meta":884928,"kb_avail":90012388,"statfs":{"total":95995035648,"available":92172685312,"internally_reserved":0,"allocated":2915913728,"data_stored":2914245895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":906166272},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,5],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:55:37 2024","interfaces":[{"interface":"back","average":{"1min":1.786,"5min":1.1419999999999999,"15min":1.4710000000000001},"min":{"1min":0.22700000000000001,"5min":0.214,"15min":0.20100000000000001},"max":{"1min":4.5010000000000003,"5min":9.8659999999999997,"15min":45.197000000000003},"last":2.9409999999999998},{"interface":"front","average":{"1min":1.958,"5min":1.6040000000000001,"15min":1.9219999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.23499999999999999},"max":{"1min":8.2100000000000009,"5min":10.038,"15min":44.753},"last":0.59199999999999997}]},{"osd":1,"last update":"Mon Feb 19 21:55:37 2024","interfaces":[{"interface":"back","average":{"1min":2.3010000000000002,"5min":1.2929999999999999,"15min":1.5880000000000001},"min":{"1min":0.29099999999999998,"5min":0.24299999999999999,"15min":0.20799999999999999},"max":{"1min":11.569000000000001,"5min":11.569000000000001,"15min":45.231999999999999},"last":0.30299999999999999},{"interface":"front","average":{"1min":4.1319999999999997,"5min":2.0289999999999999,"15min":1.8500000000000001},"min":{"1min":0.56100000000000005,"5min":0.26900000000000002,"15min":0.23100000000000001},"max":{"1min":11.869,"5min":15.215999999999999,"15min":45.097999999999999},"last":7.149}]},{"osd":2,"last update":"Mon Feb 19 21:55:19 2024","interfaces":[{"interface":"back","average":{"1min":4.2210000000000001,"5min":1.865,"15min":1.669},"min":{"1min":0.28499999999999998,"5min":0.255,"15min":0.255},"max":{"1min":52.920000000000002,"5min":52.920000000000002,"15min":52.920000000000002},"last":2.8319999999999999},{"interface":"front","average":{"1min":4.5369999999999999,"5min":1.637,"15min":1.391},"min":{"1min":0.33900000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":53.186999999999998,"5min":53.186999999999998,"15min":53.186999999999998},"last":0.39000000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:55:37 2024","interfaces":[{"interface":"back","average":{"1min":2.6949999999999998,"5min":1.4490000000000001,"15min":1.5429999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.25900000000000001},"max":{"1min":8.0990000000000002,"5min":9.8460000000000001,"15min":10.630000000000001},"last":4.0469999999999997},{"interface":"front","average":{"1min":3.3900000000000001,"5min":1.9339999999999999,"15min":1.671},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.26400000000000001},"max":{"1min":10.742000000000001,"5min":15.175000000000001,"15min":15.175000000000001},"last":2.7189999999999999}]},{"osd":4,"last update":"Mon Feb 19 21:55:37 2024","interfaces":[{"interface":"back","average":{"1min":2.3639999999999999,"5min":1.542,"15min":2.0009999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23000000000000001},"max":{"1min":7.1820000000000004,"5min":8.8439999999999994,"15min":18.010000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":2.2759999999999998,"5min":1.548,"15min":1.9319999999999999},"min":{"1min":0.32000000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":6.6159999999999997,"5min":9.8360000000000003,"15min":14.055},"last":0.42199999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:55:37 2024","interfaces":[{"interface":"back","average":{"1min":2.6280000000000001,"5min":3.2480000000000002,"15min":2.589},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":8.173,"5min":148.589,"15min":148.589},"last":0.432},{"interface":"front","average":{"1min":2.0430000000000001,"5min":2.8460000000000001,"15min":2.52},"min":{"1min":0.373,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":5.4950000000000001,"5min":148.453,"15min":148.453},"last":0.54700000000000004}]},{"osd":7,"last update":"Mon Feb 19 21:56:04 2024","interfaces":[{"interface":"back","average":{"1min":2.1669999999999998,"5min":1.8879999999999999,"15min":2.101},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":15.051,"5min":15.051,"15min":15.051},"last":0.50900000000000001},{"interface":"front","average":{"1min":2.2109999999999999,"5min":1.9350000000000001,"15min":2.1419999999999999},"min":{"1min":0.40300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":15.08,"5min":15.08,"15min":15.08},"last":0.52800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575169,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3737640,"kb_used_data":2832800,"kb_used_omap":0,"kb_used_meta":904704,"kb_avail":90007512,"statfs":{"total":95995035648,"available":92167692288,"internally_reserved":0,"allocated":2900787200,"data_stored":2899107869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":926416896},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:55:25 2024","interfaces":[{"interface":"back","average":{"1min":1.887,"5min":0.72399999999999998,"15min":0.91100000000000003},"min":{"1min":0.26400000000000001,"5min":0.186,"15min":0.161},"max":{"1min":7.641,"5min":7.641,"15min":7.641},"last":0.32500000000000001},{"interface":"front","average":{"1min":2.3519999999999999,"5min":1.0880000000000001,"15min":1.1359999999999999},"min":{"1min":0.20999999999999999,"5min":0.19500000000000001,"15min":0.16400000000000001},"max":{"1min":14.493,"5min":14.493,"15min":14.493},"last":0.25700000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:55:21 2024","interfaces":[{"interface":"back","average":{"1min":2.081,"5min":0.78400000000000003,"15min":0.98199999999999998},"min":{"1min":0.19600000000000001,"5min":0.189,"15min":0.189},"max":{"1min":10.776999999999999,"5min":10.776999999999999,"15min":10.776999999999999},"last":0.22700000000000001},{"interface":"front","average":{"1min":2.694,"5min":1.159,"15min":1.0609999999999999},"min":{"1min":0.214,"5min":0.20699999999999999,"15min":0.20399999999999999},"max":{"1min":19.199000000000002,"5min":19.199000000000002,"15min":19.199000000000002},"last":0.27200000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:55:25 2024","interfaces":[{"interface":"back","average":{"1min":3.5750000000000002,"5min":1.3360000000000001,"15min":1.2050000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":19.297999999999998,"5min":19.297999999999998,"15min":19.297999999999998},"last":0.311},{"interface":"front","average":{"1min":2.0209999999999999,"5min":0.93400000000000005,"15min":1.117},"min":{"1min":0.26700000000000002,"5min":0.255,"15min":0.215},"max":{"1min":13.029999999999999,"5min":13.029999999999999,"15min":13.029999999999999},"last":0.35299999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:55:44 2024","interfaces":[{"interface":"back","average":{"1min":3.0049999999999999,"5min":1.444,"15min":1.603},"min":{"1min":0.39600000000000002,"5min":0.30499999999999999,"15min":0.251},"max":{"1min":19.742000000000001,"5min":19.742000000000001,"15min":19.742000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":3.383,"5min":1.6859999999999999,"15min":1.6020000000000001},"min":{"1min":0.32000000000000001,"5min":0.28100000000000003,"15min":0.26500000000000001},"max":{"1min":19.331,"5min":19.331,"15min":19.331},"last":0.63700000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:55:11 2024","interfaces":[{"interface":"back","average":{"1min":2.2149999999999999,"5min":1.212,"15min":1.5620000000000001},"min":{"1min":0.34100000000000003,"5min":0.29599999999999999,"15min":0.27900000000000003},"max":{"1min":5.867,"5min":5.867,"15min":14.331},"last":0.54500000000000004},{"interface":"front","average":{"1min":2.6800000000000002,"5min":1.381,"15min":1.6100000000000001},"min":{"1min":0.38800000000000001,"5min":0.313,"15min":0.307},"max":{"1min":19.388000000000002,"5min":19.388000000000002,"15min":19.388000000000002},"last":0.70399999999999996}]},{"osd":6,"last update":"Mon Feb 19 21:55:44 2024","interfaces":[{"interface":"back","average":{"1min":2.3799999999999999,"5min":1.26,"15min":1.6140000000000001},"min":{"1min":0.35899999999999999,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":6.6859999999999999,"5min":6.6859999999999999,"15min":11.638999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":3.488,"5min":1.5469999999999999,"15min":1.8120000000000001},"min":{"1min":0.36599999999999999,"5min":0.32400000000000001,"15min":0.29699999999999999},"max":{"1min":19.359000000000002,"5min":19.359000000000002,"15min":19.359000000000002},"last":0.72699999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:55:07 2024","interfaces":[{"interface":"back","average":{"1min":2.722,"5min":1.2749999999999999,"15min":1.704},"min":{"1min":0.378,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":19.681999999999999,"5min":19.681999999999999,"15min":19.681999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":2.355,"5min":1.161,"15min":1.6659999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.32600000000000001},"max":{"1min":19.774000000000001,"5min":19.774000000000001,"15min":19.774000000000001},"last":0.68799999999999994}]}]},{"osd":0,"up_from":8,"seq":34359738695,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2801240,"kb_used_data":1898640,"kb_used_omap":0,"kb_used_meta":902592,"kb_avail":90943912,"statfs":{"total":95995035648,"available":93126565888,"internally_reserved":0,"allocated":1944207360,"data_stored":1942543648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":924254208},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":0.755,"15min":0.82399999999999995},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.153},"max":{"1min":5.649,"5min":5.649,"15min":16.478000000000002},"last":0.26400000000000001},{"interface":"front","average":{"1min":2.4319999999999999,"5min":1.1839999999999999,"15min":1.0669999999999999},"min":{"1min":0.22500000000000001,"5min":0.20799999999999999,"15min":0.17799999999999999},"max":{"1min":5.9880000000000004,"5min":7.1669999999999998,"15min":8.0229999999999997},"last":0.20200000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:55:17 2024","interfaces":[{"interface":"back","average":{"1min":2.0430000000000001,"5min":1,"15min":0.77400000000000002},"min":{"1min":0.22900000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":6.4640000000000004,"5min":6.4640000000000004,"15min":6.4640000000000004},"last":0.218},{"interface":"front","average":{"1min":1.679,"5min":0.84399999999999997,"15min":1.069},"min":{"1min":0.26500000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":5.6909999999999998,"5min":5.9370000000000003,"15min":8.9960000000000004},"last":0.44}]},{"osd":3,"last update":"Mon Feb 19 21:56:05 2024","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":1.083,"15min":1.135},"min":{"1min":0.27800000000000002,"5min":0.26400000000000001,"15min":0.21299999999999999},"max":{"1min":4.641,"5min":9.3010000000000002,"15min":12.691000000000001},"last":0.27800000000000002},{"interface":"front","average":{"1min":2.665,"5min":1.1930000000000001,"15min":1.0089999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.23400000000000001},"max":{"1min":9.1530000000000005,"5min":9.1530000000000005,"15min":9.1530000000000005},"last":0.318}]},{"osd":4,"last update":"Mon Feb 19 21:55:51 2024","interfaces":[{"interface":"back","average":{"1min":2.145,"5min":1.2869999999999999,"15min":1.599},"min":{"1min":0.36199999999999999,"5min":0.29399999999999998,"15min":0.252},"max":{"1min":5.2050000000000001,"5min":7.298,"15min":13.278},"last":0.42099999999999999},{"interface":"front","average":{"1min":2.431,"5min":1.3160000000000001,"15min":1.506},"min":{"1min":0.36099999999999999,"5min":0.32500000000000001,"15min":0.28999999999999998},"max":{"1min":5.7679999999999998,"5min":7.3079999999999998,"15min":10.109},"last":0.40300000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:56:05 2024","interfaces":[{"interface":"back","average":{"1min":1.6870000000000001,"5min":1.3420000000000001,"15min":1.7110000000000001},"min":{"1min":0.34300000000000003,"5min":0.318,"15min":0.27600000000000002},"max":{"1min":4.9500000000000002,"5min":7.2089999999999996,"15min":25.442},"last":0.45500000000000002},{"interface":"front","average":{"1min":1.629,"5min":1.3640000000000001,"15min":1.8},"min":{"1min":0.33500000000000002,"5min":0.317,"15min":0.27300000000000002},"max":{"1min":6.5419999999999998,"5min":6.5839999999999996,"15min":25.411999999999999},"last":0.38}]},{"osd":6,"last update":"Mon Feb 19 21:55:23 2024","interfaces":[{"interface":"back","average":{"1min":2.3690000000000002,"5min":1.349,"15min":1.5329999999999999},"min":{"1min":0.33500000000000002,"5min":0.33300000000000002,"15min":0.27000000000000002},"max":{"1min":5.7149999999999999,"5min":12.364000000000001,"15min":12.364000000000001},"last":8.7189999999999994},{"interface":"front","average":{"1min":2.4359999999999999,"5min":1.526,"15min":1.8400000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.29599999999999999},"max":{"1min":6.3440000000000003,"5min":11.269,"15min":13.289999999999999},"last":6.7000000000000002}]},{"osd":7,"last update":"Mon Feb 19 21:56:01 2024","interfaces":[{"interface":"back","average":{"1min":3.7400000000000002,"5min":1.8129999999999999,"15min":1.7949999999999999},"min":{"1min":0.44900000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":14.651999999999999,"5min":14.651999999999999,"15min":15.688000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":4.1150000000000002,"5min":1.859,"15min":1.7070000000000001},"min":{"1min":0.45700000000000002,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":14.592000000000001,"5min":14.592000000000001,"15min":14.592000000000001},"last":0.47899999999999998}]}]},{"osd":2,"up_from":394,"seq":1692217114708,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2645376,"kb_used_data":2325432,"kb_used_omap":0,"kb_used_meta":319935,"kb_avail":91099776,"statfs":{"total":95995035648,"available":93286170624,"internally_reserved":0,"allocated":2381242368,"data_stored":2379594612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":327613492},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:55:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":0.80400000000000005,"15min":1.046},"min":{"1min":0.192,"5min":0.183,"15min":0.183},"max":{"1min":4.1890000000000001,"5min":9.2629999999999999,"15min":9.2629999999999999},"last":3.8820000000000001},{"interface":"front","average":{"1min":1.038,"5min":0.67800000000000005,"15min":1.0409999999999999},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":5.7000000000000002,"5min":5.7000000000000002,"15min":6.149},"last":7.585}]},{"osd":1,"last update":"Mon Feb 19 21:55:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.69499999999999995,"15min":0.64600000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":3.7029999999999998,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":6.915},{"interface":"front","average":{"1min":1.516,"5min":0.80000000000000004,"15min":0.91200000000000003},"min":{"1min":0.25800000000000001,"5min":0.224,"15min":0.224},"max":{"1min":4.9349999999999996,"5min":4.9349999999999996,"15min":6.992},"last":0.313}]},{"osd":3,"last update":"Mon Feb 19 21:55:16 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":0.83799999999999997,"15min":1.246},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":5.5410000000000004,"5min":6.0970000000000004,"15min":6.9470000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.153,"5min":0.81299999999999994,"15min":1.133},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":5.6600000000000001,"5min":7.6669999999999998,"15min":7.6669999999999998},"last":13.537000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:55:16 2024","interfaces":[{"interface":"back","average":{"1min":1.7010000000000001,"5min":1.161,"15min":1.825},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":3.786,"5min":8.843,"15min":8.843},"last":6.8540000000000001},{"interface":"front","average":{"1min":1.7130000000000001,"5min":1.234,"15min":1.716},"min":{"1min":0.32800000000000001,"5min":0.30299999999999999,"15min":0.26500000000000001},"max":{"1min":5.9550000000000001,"5min":9.3300000000000001,"15min":9.3300000000000001},"last":0.38300000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:55:16 2024","interfaces":[{"interface":"back","average":{"1min":1.907,"5min":1.591,"15min":1.7230000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":5.9969999999999999,"5min":11.129,"15min":11.129},"last":0.40699999999999997},{"interface":"front","average":{"1min":1.548,"5min":1.002,"15min":1.548},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":5.8540000000000001,"5min":5.8540000000000001,"15min":13.558},"last":7.4749999999999996}]},{"osd":6,"last update":"Mon Feb 19 21:55:16 2024","interfaces":[{"interface":"back","average":{"1min":1.9930000000000001,"5min":1.5469999999999999,"15min":1.6830000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33200000000000002},"max":{"1min":9.3040000000000003,"5min":9.6720000000000006,"15min":9.6720000000000006},"last":7.5060000000000002},{"interface":"front","average":{"1min":1.8220000000000001,"5min":1.3500000000000001,"15min":1.1439999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":4.6289999999999996,"5min":8.3629999999999995,"15min":8.3629999999999995},"last":6.8239999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:55:16 2024","interfaces":[{"interface":"back","average":{"1min":1.946,"5min":1.3660000000000001,"15min":1.4239999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":5.7210000000000001,"5min":7.4089999999999998,"15min":7.4089999999999998},"last":7.5350000000000001},{"interface":"front","average":{"1min":2.206,"5min":1.4330000000000001,"15min":1.0409999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":5.0899999999999999,"5min":8.7780000000000005,"15min":8.7780000000000005},"last":6.8890000000000002}]}]},{"osd":3,"up_from":26,"seq":111669150007,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":635300,"kb_used_data":325788,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93109852,"statfs":{"total":95995035648,"available":95344488448,"internally_reserved":0,"allocated":333606912,"data_stored":331994480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:55:19 2024","interfaces":[{"interface":"back","average":{"1min":2.141,"5min":0.91600000000000004,"15min":1.0429999999999999},"min":{"1min":0.27300000000000002,"5min":0.21199999999999999,"15min":0.17399999999999999},"max":{"1min":7.2699999999999996,"5min":7.2699999999999996,"15min":8.8529999999999998},"last":1.9419999999999999},{"interface":"front","average":{"1min":2.9380000000000002,"5min":1.083,"15min":1.2649999999999999},"min":{"1min":0.26400000000000001,"5min":0.23899999999999999,"15min":0.187},"max":{"1min":12.525,"5min":12.525,"15min":12.525},"last":4.9720000000000004}]},{"osd":1,"last update":"Mon Feb 19 21:55:19 2024","interfaces":[{"interface":"back","average":{"1min":11.167999999999999,"5min":2.6629999999999998,"15min":1.736},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.18099999999999999},"max":{"1min":178.30000000000001,"5min":178.30000000000001,"15min":178.30000000000001},"last":5.0700000000000003},{"interface":"front","average":{"1min":1.859,"5min":0.75800000000000001,"15min":1.1599999999999999},"min":{"1min":0.27300000000000002,"5min":0.186,"15min":0.186},"max":{"1min":4.9489999999999998,"5min":4.9489999999999998,"15min":62.631},"last":1.2529999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:55:19 2024","interfaces":[{"interface":"back","average":{"1min":2.1739999999999999,"5min":1.2150000000000001,"15min":0.93500000000000005},"min":{"1min":0.25,"5min":0.216,"15min":0.216},"max":{"1min":7.1120000000000001,"5min":32.323999999999998,"15min":32.323999999999998},"last":1.458},{"interface":"front","average":{"1min":2.407,"5min":1.294,"15min":1.498},"min":{"1min":0.29699999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":12.449,"5min":32.103999999999999,"15min":32.103999999999999},"last":8.9009999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:55:51 2024","interfaces":[{"interface":"back","average":{"1min":3.1019999999999999,"5min":1.2989999999999999,"15min":1.3260000000000001},"min":{"1min":0.308,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":15.646000000000001,"5min":15.646000000000001,"15min":15.646000000000001},"last":1.5680000000000001},{"interface":"front","average":{"1min":2.6869999999999998,"5min":1.341,"15min":1.4399999999999999},"min":{"1min":0.40500000000000003,"5min":0.33500000000000002,"15min":0.26700000000000002},"max":{"1min":10.285,"5min":10.285,"15min":10.285},"last":1.996}]},{"osd":5,"last update":"Mon Feb 19 21:56:02 2024","interfaces":[{"interface":"back","average":{"1min":2.8610000000000002,"5min":1.3180000000000001,"15min":1.5369999999999999},"min":{"1min":0.33900000000000002,"5min":0.32100000000000001,"15min":0.29099999999999998},"max":{"1min":15.704000000000001,"5min":15.704000000000001,"15min":15.704000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":3.1389999999999998,"5min":1.6599999999999999,"15min":1.643},"min":{"1min":0.53000000000000003,"5min":0.31,"15min":0.30299999999999999},"max":{"1min":11.465,"5min":11.465,"15min":12.635},"last":1.3109999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:55:30 2024","interfaces":[{"interface":"back","average":{"1min":2.5249999999999999,"5min":1.472,"15min":1.583},"min":{"1min":0.441,"5min":0.36799999999999999,"15min":0.309},"max":{"1min":6.1509999999999998,"5min":22.759,"15min":22.759},"last":0.68600000000000005},{"interface":"front","average":{"1min":2.375,"5min":1.534,"15min":1.609},"min":{"1min":0.38500000000000001,"5min":0.34100000000000003,"15min":0.29099999999999998},"max":{"1min":7.3470000000000004,"5min":22.608000000000001,"15min":22.608000000000001},"last":1.284}]},{"osd":7,"last update":"Mon Feb 19 21:55:51 2024","interfaces":[{"interface":"back","average":{"1min":2.657,"5min":1.6399999999999999,"15min":1.696},"min":{"1min":0.48999999999999999,"5min":0.34399999999999997,"15min":0.28599999999999998},"max":{"1min":10.286,"5min":12.494,"15min":12.494},"last":2.3650000000000002},{"interface":"front","average":{"1min":3.3650000000000002,"5min":1.4490000000000001,"15min":1.478},"min":{"1min":0.502,"5min":0.40400000000000003,"15min":0.34599999999999997},"max":{"1min":15.749000000000001,"5min":15.749000000000001,"15min":15.749000000000001},"last":0.49399999999999999}]}]},{"osd":4,"up_from":32,"seq":137438953776,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2491012,"kb_used_data":1590972,"kb_used_omap":0,"kb_used_meta":900032,"kb_avail":91254140,"statfs":{"total":95995035648,"available":93444239360,"internally_reserved":0,"allocated":1629155328,"data_stored":1627502798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":921632768},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:55:38 2024","interfaces":[{"interface":"back","average":{"1min":2.4870000000000001,"5min":1.458,"15min":1.7430000000000001},"min":{"1min":0.23000000000000001,"5min":0.221,"15min":0.219},"max":{"1min":9.8800000000000008,"5min":10.173,"15min":53.936},"last":3.3010000000000002},{"interface":"front","average":{"1min":3.0129999999999999,"5min":1.4710000000000001,"15min":1.806},"min":{"1min":0.26800000000000002,"5min":0.252,"15min":0.23000000000000001},"max":{"1min":11.683999999999999,"5min":11.683999999999999,"15min":54.405999999999999},"last":2.5739999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:55:38 2024","interfaces":[{"interface":"back","average":{"1min":3.5870000000000002,"5min":3.6459999999999999,"15min":2.569},"min":{"1min":0.25600000000000001,"5min":0.23799999999999999,"15min":0.21199999999999999},"max":{"1min":10.233000000000001,"5min":156.72999999999999,"15min":156.72999999999999},"last":0.24399999999999999},{"interface":"front","average":{"1min":3.3159999999999998,"5min":3.391,"15min":2.351},"min":{"1min":0.38900000000000001,"5min":0.28299999999999997,"15min":0.25},"max":{"1min":10.217000000000001,"5min":156.83000000000001,"15min":156.83000000000001},"last":1.492}]},{"osd":2,"last update":"Mon Feb 19 21:55:16 2024","interfaces":[{"interface":"back","average":{"1min":2.1680000000000001,"5min":1.587,"15min":1.913},"min":{"1min":0.32500000000000001,"5min":0.255,"15min":0.255},"max":{"1min":7.3170000000000002,"5min":12.516999999999999,"15min":12.516999999999999},"last":3.3260000000000001},{"interface":"front","average":{"1min":2.1989999999999998,"5min":1.6299999999999999,"15min":1.952},"min":{"1min":0.375,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":7.4009999999999998,"5min":12.541,"15min":12.541},"last":3.343}]},{"osd":3,"last update":"Mon Feb 19 21:55:38 2024","interfaces":[{"interface":"back","average":{"1min":1.587,"5min":1.149,"15min":1.516},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":9.1850000000000005,"5min":9.9529999999999994,"15min":10.970000000000001},"last":0.378},{"interface":"front","average":{"1min":3.1349999999999998,"5min":1.645,"15min":1.7410000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.26900000000000002},"max":{"1min":9.8070000000000004,"5min":12.486000000000001,"15min":12.486000000000001},"last":0.39600000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:55:31 2024","interfaces":[{"interface":"back","average":{"1min":2.7519999999999998,"5min":1.831,"15min":2.0539999999999998},"min":{"1min":0.29199999999999998,"5min":0.23999999999999999,"15min":0.23400000000000001},"max":{"1min":10.278,"5min":13.458,"15min":18.916},"last":1.5209999999999999},{"interface":"front","average":{"1min":2.4550000000000001,"5min":1.5620000000000001,"15min":2.1789999999999998},"min":{"1min":0.309,"5min":0.29599999999999999,"15min":0.253},"max":{"1min":9.2560000000000002,"5min":14.532999999999999,"15min":14.840999999999999},"last":0.40999999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:55:38 2024","interfaces":[{"interface":"back","average":{"1min":2.1909999999999998,"5min":1.6579999999999999,"15min":1.7849999999999999},"min":{"1min":0.28100000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":9.2119999999999997,"5min":10.233000000000001,"15min":10.622999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":4.3209999999999997,"5min":1.964,"15min":2.202},"min":{"1min":0.318,"5min":0.27300000000000002,"15min":0.23699999999999999},"max":{"1min":12.85,"5min":13.433999999999999,"15min":18.670000000000002},"last":3.758}]},{"osd":7,"last update":"Mon Feb 19 21:55:09 2024","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.4199999999999999,"15min":1.988},"min":{"1min":0.32300000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":5.609,"5min":13.398,"15min":16.763999999999999},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.349,"5min":1.2869999999999999,"15min":1.7749999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.31},"max":{"1min":6.9619999999999997,"5min":12.958,"15min":12.958},"last":0.439}]}]},{"osd":5,"up_from":38,"seq":163208757547,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2233524,"kb_used_data":1343084,"kb_used_omap":0,"kb_used_meta":890432,"kb_avail":91511628,"statfs":{"total":95995035648,"available":93707907072,"internally_reserved":0,"allocated":1375318016,"data_stored":1373681859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":911802368},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.669,"5min":1.3999999999999999,"15min":1.669},"min":{"1min":0.221,"5min":0.221,"15min":0.20599999999999999},"max":{"1min":4.6289999999999996,"5min":10.534000000000001,"15min":19.236000000000001},"last":2.23},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.1080000000000001,"15min":1.7370000000000001},"min":{"1min":0.246,"5min":0.23699999999999999,"15min":0.20899999999999999},"max":{"1min":5.9889999999999999,"5min":6.5449999999999999,"15min":13.241},"last":0.57199999999999995}]},{"osd":1,"last update":"Mon Feb 19 21:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.546,"5min":1.147,"15min":1.6859999999999999},"min":{"1min":0.27500000000000002,"5min":0.246,"15min":0.23100000000000001},"max":{"1min":5.9610000000000003,"5min":6.625,"15min":10.42},"last":0.27000000000000002},{"interface":"front","average":{"1min":1.611,"5min":1.262,"15min":1.4870000000000001},"min":{"1min":0.28799999999999998,"5min":0.249,"15min":0.23000000000000001},"max":{"1min":4.5229999999999997,"5min":11.654,"15min":11.654},"last":0.75}]},{"osd":2,"last update":"Mon Feb 19 21:55:19 2024","interfaces":[{"interface":"back","average":{"1min":5.4340000000000002,"5min":2.5569999999999999,"15min":1.7829999999999999},"min":{"1min":0.33900000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":79.257000000000005,"5min":79.257000000000005,"15min":79.257000000000005},"last":0.70599999999999996},{"interface":"front","average":{"1min":8.6530000000000005,"5min":3.0139999999999998,"15min":1.8799999999999999},"min":{"1min":0.40600000000000003,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":79.030000000000001,"5min":79.030000000000001,"15min":79.030000000000001},"last":10.196}]},{"osd":3,"last update":"Mon Feb 19 21:55:19 2024","interfaces":[{"interface":"back","average":{"1min":2.0790000000000002,"5min":1.5649999999999999,"15min":1.9330000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.24099999999999999},"max":{"1min":5.6600000000000001,"5min":10.561,"15min":19.321000000000002},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.865,"5min":1.369,"15min":1.873},"min":{"1min":0.33800000000000002,"5min":0.31900000000000001,"15min":0.29499999999999998},"max":{"1min":6.0259999999999998,"5min":6.577,"15min":9.5150000000000006},"last":0.83799999999999997}]},{"osd":4,"last update":"Mon Feb 19 21:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.3520000000000001,"15min":1.6160000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.20899999999999999},"max":{"1min":8.4730000000000008,"5min":12.228,"15min":21.577000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":1.6000000000000001,"5min":1.47,"15min":2.0880000000000001},"min":{"1min":0.30199999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":4.71,"5min":10.586,"15min":19.274000000000001},"last":0.38900000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:55:42 2024","interfaces":[{"interface":"back","average":{"1min":2.3540000000000001,"5min":1.897,"15min":2.254},"min":{"1min":0.316,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":9.3930000000000007,"5min":10.611000000000001,"15min":19.884},"last":0.67600000000000005},{"interface":"front","average":{"1min":2.0680000000000001,"5min":1.4590000000000001,"15min":1.964},"min":{"1min":0.32100000000000001,"5min":0.29099999999999998,"15min":0.26700000000000002},"max":{"1min":9.8320000000000007,"5min":9.8320000000000007,"15min":13.532999999999999},"last":0.23499999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:55:03 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.456,"15min":2.145},"min":{"1min":0.39300000000000002,"5min":0.33500000000000002,"15min":0.27100000000000002},"max":{"1min":6.9210000000000003,"5min":8.6590000000000007,"15min":12.962},"last":0.36899999999999999},{"interface":"front","average":{"1min":1.008,"5min":1.431,"15min":1.968},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.221},"max":{"1min":4.5590000000000002,"5min":11.617000000000001,"15min":15.593999999999999},"last":0.435}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":1722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1932001280,"data_stored":1932001280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2889809920,"data_stored":2889809920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2361004032,"data_stored":2360999960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":328269824,"data_stored":328269824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1606553600,"data_stored":1606549528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1355415552,"data_stored":1355415552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2896564224,"data_stored":2896560152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2282029056,"data_stored":2282029056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:56:12.343 INFO:tasks.cephadm.ceph_manager.ceph:would drop below min_pgs, proj -9, currently 1 2024-02-19T21:56:13.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:11.293479+0000 mgr.y (mgr.14514) 902 : cluster [DBG] pgmap v1170: 138 pgs: 138 active+clean; 4.8 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.17k op/s 2024-02-19T21:56:13.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:11.331913+0000 mgr.y (mgr.14514) 903 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:56:13.106 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:11.293479+0000 mgr.y (mgr.14514) 902 : cluster [DBG] pgmap v1170: 138 pgs: 138 active+clean; 4.8 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.17k op/s 2024-02-19T21:56:13.106 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:11.331913+0000 mgr.y (mgr.14514) 903 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:56:13.106 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:11.293479+0000 mgr.y (mgr.14514) 902 : cluster [DBG] pgmap v1170: 138 pgs: 138 active+clean; 4.8 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.17k op/s 2024-02-19T21:56:13.106 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:11.331913+0000 mgr.y (mgr.14514) 903 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:56:13.415 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:56:13.421 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:13.421 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:56:13.522 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:56:13.576 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:13.702 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:56:13.710 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:13.711 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:56:13.812 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:56:13.851 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:14.147 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:56:14.512 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:56:14.512 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-02-19T21:56:14.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.512 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.25952.0:160990 11.c e538/492 11:32f7a839:::benchmark_data_smithi080_184406_object43381:head v 538'10089, mlcod=538'10087)", 2024-02-19T21:56:14.512 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:56:14.511214+0000", 2024-02-19T21:56:14.512 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.001603188, 2024-02-19T21:56:14.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016239570000000001, 2024-02-19T21:56:14.512 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:56:14.512 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:56:14.513 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:56:14.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:56:14.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.511214+0000", 2024-02-19T21:56:14.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:56:14.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:56:14.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.511214+0000", 2024-02-19T21:56:14.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:56:14.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:56:14.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.511213+0000", 2024-02-19T21:56:14.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.123e-06 2024-02-19T21:56:14.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:56:14.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.511221+0000", 2024-02-19T21:56:14.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0552e-05 2024-02-19T21:56:14.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:56:14.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.511231+0000", 2024-02-19T21:56:14.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.631e-06 2024-02-19T21:56:14.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:56:14.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.511237+0000", 2024-02-19T21:56:14.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.681e-05 2024-02-19T21:56:14.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:14.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.511294+0000", 2024-02-19T21:56:14.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8728000000000001e-05 2024-02-19T21:56:14.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:56:14.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.511313+0000", 2024-02-19T21:56:14.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8985000000000002e-05 2024-02-19T21:56:14.515 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:14.515 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:14.515 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:14.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.516 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:160988 11.2 11:4f8a15e8:::benchmark_data_smithi080_184406_object43379:head [delete] snapc 0=[] ondisk+write+known_if_redirected e538)", 2024-02-19T21:56:14.516 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:56:14.506629+0000", 2024-02-19T21:56:14.516 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0061878219999999999, 2024-02-19T21:56:14.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0062550469999999997, 2024-02-19T21:56:14.516 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:56:14.516 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "waiting for sub ops", 2024-02-19T21:56:14.516 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:56:14.516 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:56:14.516 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:56:14.516 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 160988 2024-02-19T21:56:14.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.516 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:56:14.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:56:14.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.506629+0000", 2024-02-19T21:56:14.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:56:14.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:56:14.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.506629+0000", 2024-02-19T21:56:14.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:56:14.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:56:14.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.506628+0000", 2024-02-19T21:56:14.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.092e-06 2024-02-19T21:56:14.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:56:14.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.506635+0000", 2024-02-19T21:56:14.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0519e-05 2024-02-19T21:56:14.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:56:14.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.506645+0000", 2024-02-19T21:56:14.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8340000000000004e-06 2024-02-19T21:56:14.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:56:14.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.506651+0000", 2024-02-19T21:56:14.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8322999999999998e-05 2024-02-19T21:56:14.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:14.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.506699+0000", 2024-02-19T21:56:14.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101667 2024-02-19T21:56:14.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:56:14.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.506801+0000", 2024-02-19T21:56:14.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115908 2024-02-19T21:56:14.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:56:14.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.506917+0000", 2024-02-19T21:56:14.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032487879999999998 2024-02-19T21:56:14.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:56:14.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.510166+0000", 2024-02-19T21:56:14.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035367369999999999 2024-02-19T21:56:14.520 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:14.520 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:14.520 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:14.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.520 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop_reply(client.25952.0:160988 11.2 e538/492)", 2024-02-19T21:56:14.520 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:56:14.510304+0000", 2024-02-19T21:56:14.520 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0025130220000000002, 2024-02-19T21:56:14.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026285150000000001, 2024-02-19T21:56:14.520 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:56:14.521 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "queued for pg", 2024-02-19T21:56:14.521 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:56:14.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:56:14.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.510304+0000", 2024-02-19T21:56:14.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:56:14.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:56:14.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.510304+0000", 2024-02-19T21:56:14.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:56:14.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:56:14.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.510303+0000", 2024-02-19T21:56:14.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.576e-06 2024-02-19T21:56:14.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:56:14.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.510310+0000", 2024-02-19T21:56:14.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0105999999999999e-05 2024-02-19T21:56:14.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:56:14.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.510320+0000", 2024-02-19T21:56:14.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2890000000000003e-06 2024-02-19T21:56:14.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:56:14.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.510327+0000", 2024-02-19T21:56:14.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2748999999999999e-05 2024-02-19T21:56:14.522 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:14.523 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:14.523 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:14.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.523 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:160996 11.2 11.1a905622 (undecoded) ondisk+write+known_if_redirected e538)", 2024-02-19T21:56:14.523 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:56:14.510663+0000", 2024-02-19T21:56:14.523 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0021538999999999998, 2024-02-19T21:56:14.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002297973, 2024-02-19T21:56:14.523 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:56:14.523 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "queued for pg", 2024-02-19T21:56:14.523 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:56:14.523 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:56:14.523 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:56:14.523 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 160996 2024-02-19T21:56:14.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.524 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:56:14.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:56:14.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.510663+0000", 2024-02-19T21:56:14.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:56:14.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:56:14.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.510663+0000", 2024-02-19T21:56:14.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:56:14.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:56:14.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.510661+0000", 2024-02-19T21:56:14.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7569999999999993e-06 2024-02-19T21:56:14.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:56:14.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.510670+0000", 2024-02-19T21:56:14.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3984e-05 2024-02-19T21:56:14.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:56:14.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.510684+0000", 2024-02-19T21:56:14.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9450000000000004e-06 2024-02-19T21:56:14.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:14.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:14.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:56:14.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:14.510691+0000", 2024-02-19T21:56:14.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7747999999999999e-05 2024-02-19T21:56:14.526 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:14.526 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:14.526 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:14.526 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:14.526 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:56:14.526 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 4 2024-02-19T21:56:14.526 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:56:14.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:13.296854+0000 mgr.y (mgr.14514) 904 : cluster [DBG] pgmap v1171: 138 pgs: 138 active+clean; 4.8 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 940 op/s 2024-02-19T21:56:14.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:13.296854+0000 mgr.y (mgr.14514) 904 : cluster [DBG] pgmap v1171: 138 pgs: 138 active+clean; 4.8 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 940 op/s 2024-02-19T21:56:15.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:13.296854+0000 mgr.y (mgr.14514) 904 : cluster [DBG] pgmap v1171: 138 pgs: 138 active+clean; 4.8 GiB data, 20 GiB used, 695 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 940 op/s 2024-02-19T21:56:16.042 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:56:16.052 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:16.053 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:56:16.055 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:56:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:56:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:56:16.153 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:56:16.212 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:16.248 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:56:16.254 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:16.255 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:56:16.355 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:56:16.406 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:17.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:15.025022+0000 osd.1 (osd.1) 278 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:56:17.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:15.025074+0000 osd.1 (osd.1) 279 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:56:17.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:15.297397+0000 mgr.y (mgr.14514) 905 : cluster [DBG] pgmap v1172: 138 pgs: 138 active+clean; 4.7 GiB data, 20 GiB used, 696 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 880 op/s 2024-02-19T21:56:17.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:15.716012+0000 mon.a (mon.0) 1997 : cluster [DBG] osdmap e539: 8 total, 8 up, 8 in 2024-02-19T21:56:17.095 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:15.025022+0000 osd.1 (osd.1) 278 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:56:17.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:15.025074+0000 osd.1 (osd.1) 279 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:56:17.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:15.297397+0000 mgr.y (mgr.14514) 905 : cluster [DBG] pgmap v1172: 138 pgs: 138 active+clean; 4.7 GiB data, 20 GiB used, 696 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 880 op/s 2024-02-19T21:56:17.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:15.716012+0000 mon.a (mon.0) 1997 : cluster [DBG] osdmap e539: 8 total, 8 up, 8 in 2024-02-19T21:56:17.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:15.025022+0000 osd.1 (osd.1) 278 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:56:17.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:15.025074+0000 osd.1 (osd.1) 279 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:56:17.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:15.297397+0000 mgr.y (mgr.14514) 905 : cluster [DBG] pgmap v1172: 138 pgs: 138 active+clean; 4.7 GiB data, 20 GiB used, 696 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 880 op/s 2024-02-19T21:56:17.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:15.716012+0000 mon.a (mon.0) 1997 : cluster [DBG] osdmap e539: 8 total, 8 up, 8 in 2024-02-19T21:56:17.345 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 4, 5, 6, 7, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 6, 7, 2] 2024-02-19T21:56:17.345 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:56:17.345 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_4 2024-02-19T21:56:17.346 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:56:17.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:17.504018+0000 mon.c (mon.2) 131 : audit [INF] from='client.? 172.21.15.80:0/3514772709' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:56:17.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:17.505662+0000 mon.a (mon.0) 1998 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:56:17.761 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-02-19T21:56:18.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:17.504018+0000 mon.c (mon.2) 131 : audit [INF] from='client.? 172.21.15.80:0/3514772709' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:56:18.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:17.505662+0000 mon.a (mon.0) 1998 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:56:18.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:17.504018+0000 mon.c (mon.2) 131 : audit [INF] from='client.? 172.21.15.80:0/3514772709' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:56:18.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:17.505662+0000 mon.a (mon.0) 1998 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:56:18.287 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:56:18.296 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:18.296 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:56:18.397 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:56:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:19.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:17.297785+0000 mgr.y (mgr.14514) 906 : cluster [DBG] pgmap v1174: 138 pgs: 138 active+clean; 4.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.27k op/s 2024-02-19T21:56:19.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:17.715788+0000 mon.a (mon.0) 1999 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:56:19.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:17.722949+0000 mon.a (mon.0) 2000 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:56:19.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:17.723007+0000 mon.a (mon.0) 2001 : cluster [DBG] osdmap e540: 8 total, 8 up, 8 in 2024-02-19T21:56:19.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:17.742930+0000 mon.a (mon.0) 2002 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:56:19.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:17.297785+0000 mgr.y (mgr.14514) 906 : cluster [DBG] pgmap v1174: 138 pgs: 138 active+clean; 4.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.27k op/s 2024-02-19T21:56:19.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:17.715788+0000 mon.a (mon.0) 1999 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:56:19.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:17.722949+0000 mon.a (mon.0) 2000 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:56:19.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:17.723007+0000 mon.a (mon.0) 2001 : cluster [DBG] osdmap e540: 8 total, 8 up, 8 in 2024-02-19T21:56:19.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:17.742930+0000 mon.a (mon.0) 2002 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:56:19.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:17.297785+0000 mgr.y (mgr.14514) 906 : cluster [DBG] pgmap v1174: 138 pgs: 138 active+clean; 4.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.27k op/s 2024-02-19T21:56:19.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:17.715788+0000 mon.a (mon.0) 1999 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:56:19.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:17.722949+0000 mon.a (mon.0) 2000 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:56:19.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:17.723007+0000 mon.a (mon.0) 2001 : cluster [DBG] osdmap e540: 8 total, 8 up, 8 in 2024-02-19T21:56:19.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:17.742930+0000 mon.a (mon.0) 2002 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:56:19.112 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:56:19.123 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:19.124 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:56:19.225 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:56:19.278 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:19.324 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:56:19.330 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:19.330 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:56:19.431 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:56:19.485 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:19.626 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:56:19.632 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:19.632 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:56:19.646 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.2 dump_blocked_ops 2024-02-19T21:56:19.733 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:56:19.773 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:19.797 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:56:19.802 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:19.803 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:56:19.904 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:56:19.950 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:19.985 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:56:19.993 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:19.994 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:56:20.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:19.617423+0000 mon.a (mon.0) 2003 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:56:20.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:19.620273+0000 mon.a (mon.0) 2004 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:56:20.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:19.636917+0000 mon.a (mon.0) 2005 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:56:20.095 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:56:20.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:19.617423+0000 mon.a (mon.0) 2003 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:56:20.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:19.620273+0000 mon.a (mon.0) 2004 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:56:20.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:19.636917+0000 mon.a (mon.0) 2005 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:56:20.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:19.617423+0000 mon.a (mon.0) 2003 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:56:20.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:19.620273+0000 mon.a (mon.0) 2004 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:56:20.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:19.636917+0000 mon.a (mon.0) 2005 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:56:20.144 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:20.174 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:56:20.181 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:20.182 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:56:20.282 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:56:20.339 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:20.386 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:56:20.392 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:20.393 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:56:20.494 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:56:20.520 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:20.552 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:56:20.556 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:20.556 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:56:20.657 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:56:20.739 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:20.752 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:19.298110+0000 mgr.y (mgr.14514) 907 : cluster [DBG] pgmap v1176: 138 pgs: 138 active+clean; 4.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 741 op/s 2024-02-19T21:56:20.765 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:56:20.772 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:56:20.772 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:20.773 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:56:20.775 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:56:20.859 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:56:20.873 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:56:20.881 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:56:20.908 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:56:20.936 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:56:20.936 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:20.970 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:56:20.977 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:20.978 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:56:20.978 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:56:21.022 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:56:21.059 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:56:21.078 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:56:21.086 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:19.298110+0000 mgr.y (mgr.14514) 907 : cluster [DBG] pgmap v1176: 138 pgs: 138 active+clean; 4.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 741 op/s 2024-02-19T21:56:21.086 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:56:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:56:20] "GET /metrics HTTP/1.1" 200 176825 "" "Prometheus/2.33.4" 2024-02-19T21:56:21.089 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:19.298110+0000 mgr.y (mgr.14514) 907 : cluster [DBG] pgmap v1176: 138 pgs: 138 active+clean; 4.5 GiB data, 19 GiB used, 696 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 741 op/s 2024-02-19T21:56:21.111 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:56:21.133 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:56:21.133 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:56:21.133 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:56:21.134 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:56:21.134 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:56:21.134 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:56:21.134 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:56:21.134 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:56:21.153 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:21.764 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:20.821123+0000 mon.b (mon.1) 84 : audit [DBG] from='client.? 172.21.15.80:0/566722938' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:56:21.764 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:56:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:56:22.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:20.821123+0000 mon.b (mon.1) 84 : audit [DBG] from='client.? 172.21.15.80:0/566722938' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:56:22.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:20.821123+0000 mon.b (mon.1) 84 : audit [DBG] from='client.? 172.21.15.80:0/566722938' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:56:22.152 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset noscrub 2024-02-19T21:56:23.025 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:56:23.033 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:23.033 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:56:23.034 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:21.300627+0000 mgr.y (mgr.14514) 908 : cluster [DBG] pgmap v1177: 138 pgs: 138 active+clean; 4.2 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s 2024-02-19T21:56:23.034 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:21.351231+0000 mgr.y (mgr.14514) 909 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:56:23.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:21.300627+0000 mgr.y (mgr.14514) 908 : cluster [DBG] pgmap v1177: 138 pgs: 138 active+clean; 4.2 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s 2024-02-19T21:56:23.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:21.351231+0000 mgr.y (mgr.14514) 909 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:56:23.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:21.300627+0000 mgr.y (mgr.14514) 908 : cluster [DBG] pgmap v1177: 138 pgs: 138 active+clean; 4.2 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s 2024-02-19T21:56:23.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:21.351231+0000 mgr.y (mgr.14514) 909 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:56:23.135 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:56:23.180 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:23.214 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:56:23.218 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:23.218 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:56:23.319 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:56:23.366 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:23.626 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:56:23.630 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:23.630 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:56:23.731 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:56:23.772 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:25.049 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:56:25.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:23.301084+0000 mgr.y (mgr.14514) 910 : cluster [DBG] pgmap v1178: 138 pgs: 138 active+clean; 4.2 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.10k op/s 2024-02-19T21:56:25.092 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:23.301084+0000 mgr.y (mgr.14514) 910 : cluster [DBG] pgmap v1178: 138 pgs: 138 active+clean; 4.2 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.10k op/s 2024-02-19T21:56:25.092 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:23.301084+0000 mgr.y (mgr.14514) 910 : cluster [DBG] pgmap v1178: 138 pgs: 138 active+clean; 4.2 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.10k op/s 2024-02-19T21:56:26.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:56:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:56:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:56:26.133 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:56:26.133 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:56:26.788 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:56:26.793 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:26.794 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:56:26.894 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:56:26.933 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:26.960 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:56:26.965 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:26.965 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:56:27.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:25.301531+0000 mgr.y (mgr.14514) 911 : cluster [DBG] pgmap v1179: 138 pgs: 138 active+clean; 4.1 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 534 B/s rd, 0 B/s wr, 715 op/s 2024-02-19T21:56:27.067 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:56:27.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:25.301531+0000 mgr.y (mgr.14514) 911 : cluster [DBG] pgmap v1179: 138 pgs: 138 active+clean; 4.1 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 534 B/s rd, 0 B/s wr, 715 op/s 2024-02-19T21:56:27.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:25.301531+0000 mgr.y (mgr.14514) 911 : cluster [DBG] pgmap v1179: 138 pgs: 138 active+clean; 4.1 GiB data, 18 GiB used, 697 GiB / 715 GiB avail; 534 B/s rd, 0 B/s wr, 715 op/s 2024-02-19T21:56:27.101 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:56:27.104 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T21:56:27.119 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:27.168 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:56:27.171 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:27.171 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:56:27.272 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:56:27.334 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:27.559 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:56:27.564 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:27.564 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:56:27.665 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:56:27.715 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:27.741 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.2 dump_historic_ops 2024-02-19T21:56:27.741 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:56:27.746 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:27.746 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:56:27.751 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:56:27.781 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:56:27.822 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:27.081728+0000 mgr.y (mgr.14514) 912 : audit [DBG] from='client.26084 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:56:27.822 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:27.081728+0000 mgr.y (mgr.14514) 912 : audit [DBG] from='client.26084 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:56:27.847 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:56:27.895 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:27.929 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:56:27.932 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:27.933 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:56:28.033 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:56:28.055 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:27.081728+0000 mgr.y (mgr.14514) 912 : audit [DBG] from='client.26084 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:56:28.089 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:28.639 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":1179,"stamp":"2024-02-19T21:56:25.301248+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4392031932,"num_objects":67210,"num_object_clones":0,"num_object_copies":201630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67210,"num_whiteouts":0,"num_read":2968,"num_read_kb":2720,"num_write":169193,"num_write_kb":7526824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":327,"num_bytes_recovered":7805,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":90299,"ondisk_log_size":90299,"up":414,"acting":414,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":414,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":18947352,"kb_used_data":12957336,"kb_used_omap":0,"kb_used_meta":5989503,"kb_avail":731013864,"statfs":{"total":767960285184,"available":748558196736,"internally_reserved":0,"allocated":13268312064,"data_stored":13254978580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":6133251124},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,4,2,6,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-448528384,"num_objects":-6844,"num_object_clones":0,"num_object_copies":-20532,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-6844,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6844,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.576037"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":141,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.737596+0000","last_change":"2024-02-19T21:54:18.805903+0000","last_active":"2024-02-19T21:56:15.737596+0000","last_peered":"2024-02-19T21:56:15.737596+0000","last_clean":"2024-02-19T21:56:15.737596+0000","last_became_active":"2024-02-19T21:49:54.492544+0000","last_became_peered":"2024-02-19T21:49:54.492544+0000","last_unstale":"2024-02-19T21:56:15.737596+0000","last_undegraded":"2024-02-19T21:56:15.737596+0000","last_fullsized":"2024-02-19T21:56:15.737596+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:18.805820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:54:18.805820+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":518,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.738693+0000","last_change":"2024-02-19T21:54:07.029225+0000","last_active":"2024-02-19T21:56:15.738693+0000","last_peered":"2024-02-19T21:56:15.738693+0000","last_clean":"2024-02-19T21:56:15.738693+0000","last_became_active":"2024-02-19T21:32:23.360810+0000","last_became_peered":"2024-02-19T21:32:23.360810+0000","last_unstale":"2024-02-19T21:56:15.738693+0000","last_undegraded":"2024-02-19T21:56:15.738693+0000","last_fullsized":"2024-02-19T21:56:15.738693+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:07.029148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:54:07.029148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"471'39","reported_seq":217,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.728522+0000","last_change":"2024-02-19T21:55:45.796974+0000","last_active":"2024-02-19T21:56:15.728522+0000","last_peered":"2024-02-19T21:56:15.728522+0000","last_clean":"2024-02-19T21:56:15.728522+0000","last_became_active":"2024-02-19T21:49:08.327416+0000","last_became_peered":"2024-02-19T21:49:08.327416+0000","last_unstale":"2024-02-19T21:56:15.728522+0000","last_undegraded":"2024-02-19T21:56:15.728522+0000","last_fullsized":"2024-02-19T21:56:15.728522+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'39","last_scrub_stamp":"2024-02-19T21:55:45.796881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:55:45.796881+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":493,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.716129+0000","last_change":"2024-02-19T21:54:13.470532+0000","last_active":"2024-02-19T21:56:15.716129+0000","last_peered":"2024-02-19T21:56:15.716129+0000","last_clean":"2024-02-19T21:56:15.716129+0000","last_became_active":"2024-02-19T21:47:46.250178+0000","last_became_peered":"2024-02-19T21:47:46.250178+0000","last_unstale":"2024-02-19T21:56:15.716129+0000","last_undegraded":"2024-02-19T21:56:15.716129+0000","last_fullsized":"2024-02-19T21:56:15.716129+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:13.470431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:13.470431+0000","last_clean_scrub_stamp":"2024-02-19T21:54:13.470431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":67,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.736577+0000","last_change":"2024-02-19T21:55:11.543232+0000","last_active":"2024-02-19T21:56:15.736577+0000","last_peered":"2024-02-19T21:56:15.736577+0000","last_clean":"2024-02-19T21:56:15.736577+0000","last_became_active":"2024-02-19T21:53:45.368218+0000","last_became_peered":"2024-02-19T21:53:45.368218+0000","last_unstale":"2024-02-19T21:56:15.736577+0000","last_undegraded":"2024-02-19T21:56:15.736577+0000","last_fullsized":"2024-02-19T21:56:15.736577+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:11.543119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:55:11.543119+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"470'25","reported_seq":598,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.716153+0000","last_change":"2024-02-19T21:55:03.508377+0000","last_active":"2024-02-19T21:56:15.716153+0000","last_peered":"2024-02-19T21:56:15.716153+0000","last_clean":"2024-02-19T21:56:15.716153+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T21:56:15.716153+0000","last_undegraded":"2024-02-19T21:56:15.716153+0000","last_fullsized":"2024-02-19T21:56:15.716153+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'25","last_scrub_stamp":"2024-02-19T21:55:03.508262+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T21:55:03.508262+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":278,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.724297+0000","last_change":"2024-02-19T21:54:02.455027+0000","last_active":"2024-02-19T21:56:15.724297+0000","last_peered":"2024-02-19T21:56:15.724297+0000","last_clean":"2024-02-19T21:56:15.724297+0000","last_became_active":"2024-02-19T21:49:08.331753+0000","last_became_peered":"2024-02-19T21:49:08.331753+0000","last_unstale":"2024-02-19T21:56:15.724297+0000","last_undegraded":"2024-02-19T21:56:15.724297+0000","last_fullsized":"2024-02-19T21:56:15.724297+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:02.454932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:02.454932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2],"acting":[5,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":533,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.735112+0000","last_change":"2024-02-19T21:54:13.655262+0000","last_active":"2024-02-19T21:56:15.735112+0000","last_peered":"2024-02-19T21:56:15.735112+0000","last_clean":"2024-02-19T21:56:15.735112+0000","last_became_active":"2024-02-19T21:32:23.363260+0000","last_became_peered":"2024-02-19T21:32:23.363260+0000","last_unstale":"2024-02-19T21:56:15.735112+0000","last_undegraded":"2024-02-19T21:56:15.735112+0000","last_fullsized":"2024-02-19T21:56:15.735112+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:13.655182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_clean_scrub_stamp":"2024-02-19T21:54:13.655182+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"470'11","reported_seq":567,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.716922+0000","last_change":"2024-02-19T21:53:51.243831+0000","last_active":"2024-02-19T21:56:15.716922+0000","last_peered":"2024-02-19T21:56:15.716922+0000","last_clean":"2024-02-19T21:56:15.716922+0000","last_became_active":"2024-02-19T21:53:45.385837+0000","last_became_peered":"2024-02-19T21:53:45.385837+0000","last_unstale":"2024-02-19T21:56:15.716922+0000","last_undegraded":"2024-02-19T21:56:15.716922+0000","last_fullsized":"2024-02-19T21:56:15.716922+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'11","last_scrub_stamp":"2024-02-19T21:53:51.243743+0000","last_deep_scrub":"310'9","last_deep_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_clean_scrub_stamp":"2024-02-19T21:53:51.243743+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"66'1","reported_seq":459,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.736212+0000","last_change":"2024-02-19T21:56:00.723651+0000","last_active":"2024-02-19T21:56:15.736212+0000","last_peered":"2024-02-19T21:56:15.736212+0000","last_clean":"2024-02-19T21:56:15.736212+0000","last_became_active":"2024-02-19T21:46:31.204816+0000","last_became_peered":"2024-02-19T21:46:31.204816+0000","last_unstale":"2024-02-19T21:56:15.736212+0000","last_undegraded":"2024-02-19T21:56:15.736212+0000","last_fullsized":"2024-02-19T21:56:15.736212+0000","mapping_epoch":330,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":331,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:56:00.723548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:56:00.723548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":555,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.736498+0000","last_change":"2024-02-19T21:53:58.606788+0000","last_active":"2024-02-19T21:56:15.736498+0000","last_peered":"2024-02-19T21:56:15.736498+0000","last_clean":"2024-02-19T21:56:15.736498+0000","last_became_active":"2024-02-19T21:49:08.329998+0000","last_became_peered":"2024-02-19T21:49:08.329998+0000","last_unstale":"2024-02-19T21:56:15.736498+0000","last_undegraded":"2024-02-19T21:56:15.736498+0000","last_fullsized":"2024-02-19T21:56:15.736498+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:58.606696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:58.606696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"470'25","reported_seq":427,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.716281+0000","last_change":"2024-02-19T21:54:07.275961+0000","last_active":"2024-02-19T21:56:15.716281+0000","last_peered":"2024-02-19T21:56:15.716281+0000","last_clean":"2024-02-19T21:56:15.716281+0000","last_became_active":"2024-02-19T21:53:45.383294+0000","last_became_peered":"2024-02-19T21:53:45.383294+0000","last_unstale":"2024-02-19T21:56:15.716281+0000","last_undegraded":"2024-02-19T21:56:15.716281+0000","last_fullsized":"2024-02-19T21:56:15.716281+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'25","last_scrub_stamp":"2024-02-19T21:54:07.275895+0000","last_deep_scrub":"470'25","last_deep_scrub_stamp":"2024-02-19T21:54:07.275895+0000","last_clean_scrub_stamp":"2024-02-19T21:54:07.275895+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":64,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.736799+0000","last_change":"2024-02-19T21:56:02.371322+0000","last_active":"2024-02-19T21:56:15.736799+0000","last_peered":"2024-02-19T21:56:15.736799+0000","last_clean":"2024-02-19T21:56:15.736799+0000","last_became_active":"2024-02-19T21:53:45.369808+0000","last_became_peered":"2024-02-19T21:53:45.369808+0000","last_unstale":"2024-02-19T21:56:15.736799+0000","last_undegraded":"2024-02-19T21:56:15.736799+0000","last_fullsized":"2024-02-19T21:56:15.736799+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:12.582596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:12.582596+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":41,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.728370+0000","last_change":"2024-02-19T21:55:00.964172+0000","last_active":"2024-02-19T21:56:15.728370+0000","last_peered":"2024-02-19T21:56:15.728370+0000","last_clean":"2024-02-19T21:56:15.728370+0000","last_became_active":"2024-02-19T21:54:52.469938+0000","last_became_peered":"2024-02-19T21:54:52.469938+0000","last_unstale":"2024-02-19T21:56:15.728370+0000","last_undegraded":"2024-02-19T21:56:15.728370+0000","last_fullsized":"2024-02-19T21:56:15.728370+0000","mapping_epoch":513,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":514,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:00.964069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:55:00.964069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"471'24","reported_seq":53,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.728390+0000","last_change":"2024-02-19T21:54:58.907072+0000","last_active":"2024-02-19T21:56:15.728390+0000","last_peered":"2024-02-19T21:56:15.728390+0000","last_clean":"2024-02-19T21:56:15.728390+0000","last_became_active":"2024-02-19T21:54:52.474005+0000","last_became_peered":"2024-02-19T21:54:52.474005+0000","last_unstale":"2024-02-19T21:56:15.728390+0000","last_undegraded":"2024-02-19T21:56:15.728390+0000","last_fullsized":"2024-02-19T21:56:15.728390+0000","mapping_epoch":513,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":514,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'24","last_scrub_stamp":"2024-02-19T21:54:58.906977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:54:58.906977+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":33,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6],"acting":[2,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":526,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.717437+0000","last_change":"2024-02-19T21:55:59.586187+0000","last_active":"2024-02-19T21:56:15.717437+0000","last_peered":"2024-02-19T21:56:15.717437+0000","last_clean":"2024-02-19T21:56:15.717437+0000","last_became_active":"2024-02-19T21:44:58.788307+0000","last_became_peered":"2024-02-19T21:44:58.788307+0000","last_unstale":"2024-02-19T21:56:15.717437+0000","last_undegraded":"2024-02-19T21:56:15.717437+0000","last_fullsized":"2024-02-19T21:56:15.717437+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:59.586089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:55:59.586089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":528,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.734821+0000","last_change":"2024-02-19T21:54:22.689209+0000","last_active":"2024-02-19T21:56:15.734821+0000","last_peered":"2024-02-19T21:56:15.734821+0000","last_clean":"2024-02-19T21:56:15.734821+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:56:15.734821+0000","last_undegraded":"2024-02-19T21:56:15.734821+0000","last_fullsized":"2024-02-19T21:56:15.734821+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:22.689143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:17.913620+0000","last_clean_scrub_stamp":"2024-02-19T21:54:22.689143+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"470'46","reported_seq":212,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.731050+0000","last_change":"2024-02-19T21:55:19.874401+0000","last_active":"2024-02-19T21:56:15.731050+0000","last_peered":"2024-02-19T21:56:15.731050+0000","last_clean":"2024-02-19T21:56:15.731050+0000","last_became_active":"2024-02-19T21:49:08.331742+0000","last_became_peered":"2024-02-19T21:49:08.331742+0000","last_unstale":"2024-02-19T21:56:15.731050+0000","last_undegraded":"2024-02-19T21:56:15.731050+0000","last_fullsized":"2024-02-19T21:56:15.731050+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'46","last_scrub_stamp":"2024-02-19T21:55:19.874292+0000","last_deep_scrub":"93'22","last_deep_scrub_stamp":"2024-02-19T21:40:36.287051+0000","last_clean_scrub_stamp":"2024-02-19T21:55:19.874292+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":550,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.736499+0000","last_change":"2024-02-19T21:55:51.949183+0000","last_active":"2024-02-19T21:56:15.736499+0000","last_peered":"2024-02-19T21:56:15.736499+0000","last_clean":"2024-02-19T21:56:15.736499+0000","last_became_active":"2024-02-19T21:44:58.790669+0000","last_became_peered":"2024-02-19T21:44:58.790669+0000","last_unstale":"2024-02-19T21:56:15.736499+0000","last_undegraded":"2024-02-19T21:56:15.736499+0000","last_fullsized":"2024-02-19T21:56:15.736499+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:51.949098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_clean_scrub_stamp":"2024-02-19T21:55:51.949098+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":474,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.733151+0000","last_change":"2024-02-19T21:53:55.597392+0000","last_active":"2024-02-19T21:56:15.733151+0000","last_peered":"2024-02-19T21:56:15.733151+0000","last_clean":"2024-02-19T21:56:15.733151+0000","last_became_active":"2024-02-19T21:49:08.329986+0000","last_became_peered":"2024-02-19T21:49:08.329986+0000","last_unstale":"2024-02-19T21:56:15.733151+0000","last_undegraded":"2024-02-19T21:56:15.733151+0000","last_fullsized":"2024-02-19T21:56:15.733151+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:55.597334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:55.597334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"471'27","reported_seq":434,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.738623+0000","last_change":"2024-02-19T21:55:02.838918+0000","last_active":"2024-02-19T21:56:15.738623+0000","last_peered":"2024-02-19T21:56:15.738623+0000","last_clean":"2024-02-19T21:56:15.738623+0000","last_became_active":"2024-02-19T21:39:51.536255+0000","last_became_peered":"2024-02-19T21:39:51.536255+0000","last_unstale":"2024-02-19T21:56:15.738623+0000","last_undegraded":"2024-02-19T21:56:15.738623+0000","last_fullsized":"2024-02-19T21:56:15.738623+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'27","last_scrub_stamp":"2024-02-19T21:55:02.838850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:55:02.838850+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":36,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":401,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.736302+0000","last_change":"2024-02-19T21:54:03.580153+0000","last_active":"2024-02-19T21:56:15.736302+0000","last_peered":"2024-02-19T21:56:15.736302+0000","last_clean":"2024-02-19T21:56:15.736302+0000","last_became_active":"2024-02-19T21:51:22.461599+0000","last_became_peered":"2024-02-19T21:51:22.461599+0000","last_unstale":"2024-02-19T21:56:15.736302+0000","last_undegraded":"2024-02-19T21:56:15.736302+0000","last_fullsized":"2024-02-19T21:56:15.736302+0000","mapping_epoch":445,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":446,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:54:03.580085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:54:03.580085+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":539,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.724408+0000","last_change":"2024-02-19T21:54:20.347780+0000","last_active":"2024-02-19T21:56:15.724408+0000","last_peered":"2024-02-19T21:56:15.724408+0000","last_clean":"2024-02-19T21:56:15.724408+0000","last_became_active":"2024-02-19T21:49:54.491488+0000","last_became_peered":"2024-02-19T21:49:54.491488+0000","last_unstale":"2024-02-19T21:56:15.724408+0000","last_undegraded":"2024-02-19T21:56:15.724408+0000","last_fullsized":"2024-02-19T21:56:15.724408+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:20.347685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:54:20.347685+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"470'30","reported_seq":638,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.738651+0000","last_change":"2024-02-19T21:55:04.896812+0000","last_active":"2024-02-19T21:56:15.738651+0000","last_peered":"2024-02-19T21:56:15.738651+0000","last_clean":"2024-02-19T21:56:15.738651+0000","last_became_active":"2024-02-19T21:49:54.483748+0000","last_became_peered":"2024-02-19T21:49:54.483748+0000","last_unstale":"2024-02-19T21:56:15.738651+0000","last_undegraded":"2024-02-19T21:56:15.738651+0000","last_fullsized":"2024-02-19T21:56:15.738651+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'30","last_scrub_stamp":"2024-02-19T21:55:04.896705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:55:04.896705+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":458,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.737315+0000","last_change":"2024-02-19T21:55:00.074339+0000","last_active":"2024-02-19T21:56:15.737315+0000","last_peered":"2024-02-19T21:56:15.737315+0000","last_clean":"2024-02-19T21:56:15.737315+0000","last_became_active":"2024-02-19T21:49:08.327865+0000","last_became_peered":"2024-02-19T21:49:08.327865+0000","last_unstale":"2024-02-19T21:56:15.737315+0000","last_undegraded":"2024-02-19T21:56:15.737315+0000","last_fullsized":"2024-02-19T21:56:15.737315+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:00.074245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:55:00.074245+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":520,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.735726+0000","last_change":"2024-02-19T21:54:15.684329+0000","last_active":"2024-02-19T21:56:15.735726+0000","last_peered":"2024-02-19T21:56:15.735726+0000","last_clean":"2024-02-19T21:56:15.735726+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:56:15.735726+0000","last_undegraded":"2024-02-19T21:56:15.735726+0000","last_fullsized":"2024-02-19T21:56:15.735726+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:15.684224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:54:15.684224+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":554,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.732954+0000","last_change":"2024-02-19T21:53:54.630006+0000","last_active":"2024-02-19T21:56:15.732954+0000","last_peered":"2024-02-19T21:56:15.732954+0000","last_clean":"2024-02-19T21:56:15.732954+0000","last_became_active":"2024-02-19T21:49:08.330293+0000","last_became_peered":"2024-02-19T21:49:08.330293+0000","last_unstale":"2024-02-19T21:56:15.732954+0000","last_undegraded":"2024-02-19T21:56:15.732954+0000","last_fullsized":"2024-02-19T21:56:15.732954+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:54.629909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:54.629909+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"471'32","reported_seq":81,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.735388+0000","last_change":"2024-02-19T21:56:00.410939+0000","last_active":"2024-02-19T21:56:15.735388+0000","last_peered":"2024-02-19T21:56:15.735388+0000","last_clean":"2024-02-19T21:56:15.735388+0000","last_became_active":"2024-02-19T21:53:45.367870+0000","last_became_peered":"2024-02-19T21:53:45.367870+0000","last_unstale":"2024-02-19T21:56:15.735388+0000","last_undegraded":"2024-02-19T21:56:15.735388+0000","last_fullsized":"2024-02-19T21:56:15.735388+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'32","last_scrub_stamp":"2024-02-19T21:56:00.410827+0000","last_deep_scrub":"381'24","last_deep_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_clean_scrub_stamp":"2024-02-19T21:56:00.410827+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":28,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.726711+0000","last_change":"2024-02-19T21:55:24.057416+0000","last_active":"2024-02-19T21:56:15.726711+0000","last_peered":"2024-02-19T21:56:15.726711+0000","last_clean":"2024-02-19T21:56:15.726711+0000","last_became_active":"2024-02-19T21:55:24.057099+0000","last_became_peered":"2024-02-19T21:55:24.057099+0000","last_unstale":"2024-02-19T21:56:15.726711+0000","last_undegraded":"2024-02-19T21:56:15.726711+0000","last_fullsized":"2024-02-19T21:56:15.726711+0000","mapping_epoch":521,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":522,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:57.593320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:53:57.593320+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":574,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.733032+0000","last_change":"2024-02-19T21:55:03.717187+0000","last_active":"2024-02-19T21:56:15.733032+0000","last_peered":"2024-02-19T21:56:15.733032+0000","last_clean":"2024-02-19T21:56:15.733032+0000","last_became_active":"2024-02-19T21:49:54.494146+0000","last_became_peered":"2024-02-19T21:49:54.494146+0000","last_unstale":"2024-02-19T21:56:15.733032+0000","last_undegraded":"2024-02-19T21:56:15.733032+0000","last_fullsized":"2024-02-19T21:56:15.733032+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:03.717083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:22.560066+0000","last_clean_scrub_stamp":"2024-02-19T21:55:03.717083+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":549,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.724740+0000","last_change":"2024-02-19T21:55:47.600817+0000","last_active":"2024-02-19T21:56:15.724740+0000","last_peered":"2024-02-19T21:56:15.724740+0000","last_clean":"2024-02-19T21:56:15.724740+0000","last_became_active":"2024-02-19T21:49:08.331308+0000","last_became_peered":"2024-02-19T21:49:08.331308+0000","last_unstale":"2024-02-19T21:56:15.724740+0000","last_undegraded":"2024-02-19T21:56:15.724740+0000","last_fullsized":"2024-02-19T21:56:15.724740+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:47.600714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:37.085374+0000","last_clean_scrub_stamp":"2024-02-19T21:55:47.600714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"470'12","reported_seq":73,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.735246+0000","last_change":"2024-02-19T21:55:00.544889+0000","last_active":"2024-02-19T21:56:15.735246+0000","last_peered":"2024-02-19T21:56:15.735246+0000","last_clean":"2024-02-19T21:56:15.735246+0000","last_became_active":"2024-02-19T21:53:45.368256+0000","last_became_peered":"2024-02-19T21:53:45.368256+0000","last_unstale":"2024-02-19T21:56:15.735246+0000","last_undegraded":"2024-02-19T21:56:15.735246+0000","last_fullsized":"2024-02-19T21:56:15.735246+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'12","last_scrub_stamp":"2024-02-19T21:55:00.544815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:55:00.544815+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":462,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.738267+0000","last_change":"2024-02-19T21:55:51.733348+0000","last_active":"2024-02-19T21:56:15.738267+0000","last_peered":"2024-02-19T21:56:15.738267+0000","last_clean":"2024-02-19T21:56:15.738267+0000","last_became_active":"2024-02-19T21:49:08.328416+0000","last_became_peered":"2024-02-19T21:49:08.328416+0000","last_unstale":"2024-02-19T21:56:15.738267+0000","last_undegraded":"2024-02-19T21:56:15.738267+0000","last_fullsized":"2024-02-19T21:56:15.738267+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:51.733288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:55:51.733288+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":538,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.734528+0000","last_change":"2024-02-19T21:54:24.498621+0000","last_active":"2024-02-19T21:56:15.734528+0000","last_peered":"2024-02-19T21:56:15.734528+0000","last_clean":"2024-02-19T21:56:15.734528+0000","last_became_active":"2024-02-19T21:49:54.480368+0000","last_became_peered":"2024-02-19T21:49:54.480368+0000","last_unstale":"2024-02-19T21:56:15.734528+0000","last_undegraded":"2024-02-19T21:56:15.734528+0000","last_fullsized":"2024-02-19T21:56:15.734528+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:24.498521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:54:24.498521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":517,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.736726+0000","last_change":"2024-02-19T21:49:05.012463+0000","last_active":"2024-02-19T21:56:15.736726+0000","last_peered":"2024-02-19T21:56:15.736726+0000","last_clean":"2024-02-19T21:56:15.736726+0000","last_became_active":"2024-02-19T21:32:23.357854+0000","last_became_peered":"2024-02-19T21:32:23.357854+0000","last_unstale":"2024-02-19T21:56:15.736726+0000","last_undegraded":"2024-02-19T21:56:15.736726+0000","last_fullsized":"2024-02-19T21:56:15.736726+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:05.012395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:49:05.012395+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"470'27","reported_seq":581,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.717054+0000","last_change":"2024-02-19T21:55:02.539346+0000","last_active":"2024-02-19T21:56:15.717054+0000","last_peered":"2024-02-19T21:56:15.717054+0000","last_clean":"2024-02-19T21:56:15.717054+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T21:56:15.717054+0000","last_undegraded":"2024-02-19T21:56:15.717054+0000","last_fullsized":"2024-02-19T21:56:15.717054+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'27","last_scrub_stamp":"2024-02-19T21:55:02.539241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:55:02.539241+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":523,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.735781+0000","last_change":"2024-02-19T21:54:17.964240+0000","last_active":"2024-02-19T21:56:15.735781+0000","last_peered":"2024-02-19T21:56:15.735781+0000","last_clean":"2024-02-19T21:56:15.735781+0000","last_became_active":"2024-02-19T21:32:29.375400+0000","last_became_peered":"2024-02-19T21:32:29.375400+0000","last_unstale":"2024-02-19T21:56:15.735781+0000","last_undegraded":"2024-02-19T21:56:15.735781+0000","last_fullsized":"2024-02-19T21:56:15.735781+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:17.964139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:17.964139+0000","last_clean_scrub_stamp":"2024-02-19T21:54:17.964139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":67,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.735741+0000","last_change":"2024-02-19T21:55:10.537616+0000","last_active":"2024-02-19T21:56:15.735741+0000","last_peered":"2024-02-19T21:56:15.735741+0000","last_clean":"2024-02-19T21:56:15.735741+0000","last_became_active":"2024-02-19T21:53:45.369330+0000","last_became_peered":"2024-02-19T21:53:45.369330+0000","last_unstale":"2024-02-19T21:56:15.735741+0000","last_undegraded":"2024-02-19T21:56:15.735741+0000","last_fullsized":"2024-02-19T21:56:15.735741+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:10.537495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:55:10.537495+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":544,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.734134+0000","last_change":"2024-02-19T21:55:02.698892+0000","last_active":"2024-02-19T21:56:15.734134+0000","last_peered":"2024-02-19T21:56:15.734134+0000","last_clean":"2024-02-19T21:56:15.734134+0000","last_became_active":"2024-02-19T21:53:45.384501+0000","last_became_peered":"2024-02-19T21:53:45.384501+0000","last_unstale":"2024-02-19T21:56:15.734134+0000","last_undegraded":"2024-02-19T21:56:15.734134+0000","last_fullsized":"2024-02-19T21:56:15.734134+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:02.698800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:55:02.698800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"470'21","reported_seq":604,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.734453+0000","last_change":"2024-02-19T21:54:14.469579+0000","last_active":"2024-02-19T21:56:15.734453+0000","last_peered":"2024-02-19T21:56:15.734453+0000","last_clean":"2024-02-19T21:56:15.734453+0000","last_became_active":"2024-02-19T21:49:08.333872+0000","last_became_peered":"2024-02-19T21:49:08.333872+0000","last_unstale":"2024-02-19T21:56:15.734453+0000","last_undegraded":"2024-02-19T21:56:15.734453+0000","last_fullsized":"2024-02-19T21:56:15.734453+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'21","last_scrub_stamp":"2024-02-19T21:54:14.469490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:54:14.469490+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":503,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.717578+0000","last_change":"2024-02-19T21:54:08.470718+0000","last_active":"2024-02-19T21:56:15.717578+0000","last_peered":"2024-02-19T21:56:15.717578+0000","last_clean":"2024-02-19T21:56:15.717578+0000","last_became_active":"2024-02-19T21:49:08.329770+0000","last_became_peered":"2024-02-19T21:49:08.329770+0000","last_unstale":"2024-02-19T21:56:15.717578+0000","last_undegraded":"2024-02-19T21:56:15.717578+0000","last_fullsized":"2024-02-19T21:56:15.717578+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:08.470650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:54:08.470650+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"415'17","reported_seq":223,"reported_epoch":540,"state":"active+clean","last_fresh":"2024-02-19T21:56:17.729586+0000","last_change":"2024-02-19T21:53:56.588487+0000","last_active":"2024-02-19T21:56:17.729586+0000","last_peered":"2024-02-19T21:56:17.729586+0000","last_clean":"2024-02-19T21:56:17.729586+0000","last_became_active":"2024-02-19T21:49:54.486304+0000","last_became_peered":"2024-02-19T21:49:54.486304+0000","last_unstale":"2024-02-19T21:56:17.729586+0000","last_undegraded":"2024-02-19T21:56:17.729586+0000","last_fullsized":"2024-02-19T21:56:17.729586+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"415'17","last_scrub_stamp":"2024-02-19T21:53:56.588421+0000","last_deep_scrub":"167'11","last_deep_scrub_stamp":"2024-02-19T21:39:46.054888+0000","last_clean_scrub_stamp":"2024-02-19T21:53:56.588421+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,1],"acting":[7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":554,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.737620+0000","last_change":"2024-02-19T21:54:01.110262+0000","last_active":"2024-02-19T21:56:15.737620+0000","last_peered":"2024-02-19T21:56:15.737620+0000","last_clean":"2024-02-19T21:56:15.737620+0000","last_became_active":"2024-02-19T21:53:45.371729+0000","last_became_peered":"2024-02-19T21:53:45.371729+0000","last_unstale":"2024-02-19T21:56:15.737620+0000","last_undegraded":"2024-02-19T21:56:15.737620+0000","last_fullsized":"2024-02-19T21:56:15.737620+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:01.110166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_clean_scrub_stamp":"2024-02-19T21:54:01.110166+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"470'25","reported_seq":595,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.726165+0000","last_change":"2024-02-19T21:54:59.161641+0000","last_active":"2024-02-19T21:56:15.726165+0000","last_peered":"2024-02-19T21:56:15.726165+0000","last_clean":"2024-02-19T21:56:15.726165+0000","last_became_active":"2024-02-19T21:53:45.384976+0000","last_became_peered":"2024-02-19T21:53:45.384976+0000","last_unstale":"2024-02-19T21:56:15.726165+0000","last_undegraded":"2024-02-19T21:56:15.726165+0000","last_fullsized":"2024-02-19T21:56:15.726165+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'25","last_scrub_stamp":"2024-02-19T21:54:59.161529+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T21:54:59.161529+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":262,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.738175+0000","last_change":"2024-02-19T21:54:21.953571+0000","last_active":"2024-02-19T21:56:15.738175+0000","last_peered":"2024-02-19T21:56:15.738175+0000","last_clean":"2024-02-19T21:56:15.738175+0000","last_became_active":"2024-02-19T21:49:54.484049+0000","last_became_peered":"2024-02-19T21:49:54.484049+0000","last_unstale":"2024-02-19T21:56:15.738175+0000","last_undegraded":"2024-02-19T21:56:15.738175+0000","last_fullsized":"2024-02-19T21:56:15.738175+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:21.953470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:54:21.953470+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"181'9","reported_seq":813,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:17.154226+0000","last_change":"2024-02-19T21:55:05.379509+0000","last_active":"2024-02-19T21:56:17.154226+0000","last_peered":"2024-02-19T21:56:17.154226+0000","last_clean":"2024-02-19T21:56:17.154226+0000","last_became_active":"2024-02-19T21:32:27.371794+0000","last_became_peered":"2024-02-19T21:32:27.371794+0000","last_unstale":"2024-02-19T21:56:17.154226+0000","last_undegraded":"2024-02-19T21:56:17.154226+0000","last_fullsized":"2024-02-19T21:56:17.154226+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'9","last_scrub_stamp":"2024-02-19T21:55:05.379447+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:55:05.379447+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":559,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.726852+0000","last_change":"2024-02-19T21:55:12.286687+0000","last_active":"2024-02-19T21:56:15.726852+0000","last_peered":"2024-02-19T21:56:15.726852+0000","last_clean":"2024-02-19T21:56:15.726852+0000","last_became_active":"2024-02-19T21:53:45.384012+0000","last_became_peered":"2024-02-19T21:53:45.384012+0000","last_unstale":"2024-02-19T21:56:15.726852+0000","last_undegraded":"2024-02-19T21:56:15.726852+0000","last_fullsized":"2024-02-19T21:56:15.726852+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:12.286582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:55:12.286582+0000","last_clean_scrub_stamp":"2024-02-19T21:55:12.286582+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"470'35","reported_seq":79,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.736425+0000","last_change":"2024-02-19T21:55:52.454979+0000","last_active":"2024-02-19T21:56:15.736425+0000","last_peered":"2024-02-19T21:56:15.736425+0000","last_clean":"2024-02-19T21:56:15.736425+0000","last_became_active":"2024-02-19T21:53:45.367708+0000","last_became_peered":"2024-02-19T21:53:45.367708+0000","last_unstale":"2024-02-19T21:56:15.736425+0000","last_undegraded":"2024-02-19T21:56:15.736425+0000","last_fullsized":"2024-02-19T21:56:15.736425+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'35","last_scrub_stamp":"2024-02-19T21:55:52.454890+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:55:52.454890+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":520,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.734961+0000","last_change":"2024-02-19T21:54:11.667953+0000","last_active":"2024-02-19T21:56:15.734961+0000","last_peered":"2024-02-19T21:56:15.734961+0000","last_clean":"2024-02-19T21:56:15.734961+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:56:15.734961+0000","last_undegraded":"2024-02-19T21:56:15.734961+0000","last_fullsized":"2024-02-19T21:56:15.734961+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:11.667872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:11.667872+0000","last_clean_scrub_stamp":"2024-02-19T21:54:11.667872+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":525,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.733366+0000","last_change":"2024-02-19T21:53:56.583766+0000","last_active":"2024-02-19T21:56:15.733366+0000","last_peered":"2024-02-19T21:56:15.733366+0000","last_clean":"2024-02-19T21:56:15.733366+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:56:15.733366+0000","last_undegraded":"2024-02-19T21:56:15.733366+0000","last_fullsized":"2024-02-19T21:56:15.733366+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:56.583707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:56.583707+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"470'18","reported_seq":162,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.737277+0000","last_change":"2024-02-19T21:55:10.074274+0000","last_active":"2024-02-19T21:56:15.737277+0000","last_peered":"2024-02-19T21:56:15.737277+0000","last_clean":"2024-02-19T21:56:15.737277+0000","last_became_active":"2024-02-19T21:49:54.478094+0000","last_became_peered":"2024-02-19T21:49:54.478094+0000","last_unstale":"2024-02-19T21:56:15.737277+0000","last_undegraded":"2024-02-19T21:56:15.737277+0000","last_fullsized":"2024-02-19T21:56:15.737277+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'18","last_scrub_stamp":"2024-02-19T21:55:10.074185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:55:10.074185+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":23,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":172,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.731125+0000","last_change":"2024-02-19T21:54:18.393614+0000","last_active":"2024-02-19T21:56:15.731125+0000","last_peered":"2024-02-19T21:56:15.731125+0000","last_clean":"2024-02-19T21:56:15.731125+0000","last_became_active":"2024-02-19T21:49:08.332176+0000","last_became_peered":"2024-02-19T21:49:08.332176+0000","last_unstale":"2024-02-19T21:56:15.731125+0000","last_undegraded":"2024-02-19T21:56:15.731125+0000","last_fullsized":"2024-02-19T21:56:15.731125+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:18.393513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:18.393513+0000","last_clean_scrub_stamp":"2024-02-19T21:54:18.393513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":188,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.728181+0000","last_change":"2024-02-19T21:55:59.666773+0000","last_active":"2024-02-19T21:56:15.728181+0000","last_peered":"2024-02-19T21:56:15.728181+0000","last_clean":"2024-02-19T21:56:15.728181+0000","last_became_active":"2024-02-19T21:54:35.408935+0000","last_became_peered":"2024-02-19T21:54:35.408935+0000","last_unstale":"2024-02-19T21:56:15.728181+0000","last_undegraded":"2024-02-19T21:56:15.728181+0000","last_fullsized":"2024-02-19T21:56:15.728181+0000","mapping_epoch":507,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":508,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:59.666682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:32.121205+0000","last_clean_scrub_stamp":"2024-02-19T21:55:59.666682+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"470'21","reported_seq":676,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.738502+0000","last_change":"2024-02-19T21:53:52.104355+0000","last_active":"2024-02-19T21:56:15.738502+0000","last_peered":"2024-02-19T21:56:15.738502+0000","last_clean":"2024-02-19T21:56:15.738502+0000","last_became_active":"2024-02-19T21:49:54.483578+0000","last_became_peered":"2024-02-19T21:49:54.483578+0000","last_unstale":"2024-02-19T21:56:15.738502+0000","last_undegraded":"2024-02-19T21:56:15.738502+0000","last_fullsized":"2024-02-19T21:56:15.738502+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":432,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'21","last_scrub_stamp":"2024-02-19T21:53:52.104285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:53:52.104285+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":550,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"540'10848","reported_seq":10904,"reported_epoch":540,"state":"active+clean","last_fresh":"2024-02-19T21:56:24.989381+0000","last_change":"2024-02-19T21:53:45.368993+0000","last_active":"2024-02-19T21:56:24.989381+0000","last_peered":"2024-02-19T21:56:24.989381+0000","last_clean":"2024-02-19T21:56:24.989381+0000","last_became_active":"2024-02-19T21:53:45.368696+0000","last_became_peered":"2024-02-19T21:53:45.368696+0000","last_unstale":"2024-02-19T21:56:24.989381+0000","last_undegraded":"2024-02-19T21:56:24.989381+0000","last_fullsized":"2024-02-19T21:56:24.989381+0000","mapping_epoch":492,"log_start":"512'5200","ondisk_log_start":"512'5200","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":5648,"ondisk_log_size":5648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":261881856,"num_objects":3996,"num_object_clones":0,"num_object_copies":11988,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3996,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10848,"num_write_kb":475008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":67,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.735825+0000","last_change":"2024-02-19T21:55:59.541514+0000","last_active":"2024-02-19T21:56:15.735825+0000","last_peered":"2024-02-19T21:56:15.735825+0000","last_clean":"2024-02-19T21:56:15.735825+0000","last_became_active":"2024-02-19T21:53:45.368696+0000","last_became_peered":"2024-02-19T21:53:45.368696+0000","last_unstale":"2024-02-19T21:56:15.735825+0000","last_undegraded":"2024-02-19T21:56:15.735825+0000","last_fullsized":"2024-02-19T21:56:15.735825+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:59.541410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:55:59.541410+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"378'4","reported_seq":559,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.717779+0000","last_change":"2024-02-19T21:54:58.444948+0000","last_active":"2024-02-19T21:56:15.717779+0000","last_peered":"2024-02-19T21:56:15.717779+0000","last_clean":"2024-02-19T21:56:15.717779+0000","last_became_active":"2024-02-19T21:32:23.361094+0000","last_became_peered":"2024-02-19T21:32:23.361094+0000","last_unstale":"2024-02-19T21:56:15.717779+0000","last_undegraded":"2024-02-19T21:56:15.717779+0000","last_fullsized":"2024-02-19T21:56:15.717779+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"378'4","last_scrub_stamp":"2024-02-19T21:54:58.444848+0000","last_deep_scrub":"378'4","last_deep_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_clean_scrub_stamp":"2024-02-19T21:54:58.444848+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"470'29","reported_seq":425,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.716482+0000","last_change":"2024-02-19T21:55:45.552813+0000","last_active":"2024-02-19T21:56:15.716482+0000","last_peered":"2024-02-19T21:56:15.716482+0000","last_clean":"2024-02-19T21:56:15.716482+0000","last_became_active":"2024-02-19T21:47:46.252085+0000","last_became_peered":"2024-02-19T21:47:46.252085+0000","last_unstale":"2024-02-19T21:56:15.716482+0000","last_undegraded":"2024-02-19T21:56:15.716482+0000","last_fullsized":"2024-02-19T21:56:15.716482+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'29","last_scrub_stamp":"2024-02-19T21:55:45.552710+0000","last_deep_scrub":"200'23","last_deep_scrub_stamp":"2024-02-19T21:48:22.519381+0000","last_clean_scrub_stamp":"2024-02-19T21:55:45.552710+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":33,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6],"acting":[4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":177,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.728227+0000","last_change":"2024-02-19T21:55:22.791336+0000","last_active":"2024-02-19T21:56:15.728227+0000","last_peered":"2024-02-19T21:56:15.728227+0000","last_clean":"2024-02-19T21:56:15.728227+0000","last_became_active":"2024-02-19T21:49:08.328237+0000","last_became_peered":"2024-02-19T21:49:08.328237+0000","last_unstale":"2024-02-19T21:56:15.728227+0000","last_undegraded":"2024-02-19T21:56:15.728227+0000","last_fullsized":"2024-02-19T21:56:15.728227+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:22.791271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:55:22.791271+0000","last_clean_scrub_stamp":"2024-02-19T21:55:22.791271+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"540'10587","reported_seq":10649,"reported_epoch":540,"state":"active+clean","last_fresh":"2024-02-19T21:56:22.284259+0000","last_change":"2024-02-19T21:55:06.318413+0000","last_active":"2024-02-19T21:56:22.284259+0000","last_peered":"2024-02-19T21:56:22.284259+0000","last_clean":"2024-02-19T21:56:22.284259+0000","last_became_active":"2024-02-19T21:53:45.366507+0000","last_became_peered":"2024-02-19T21:53:45.366507+0000","last_unstale":"2024-02-19T21:56:22.284259+0000","last_undegraded":"2024-02-19T21:56:22.284259+0000","last_fullsized":"2024-02-19T21:56:22.284259+0000","mapping_epoch":492,"log_start":"510'4500","ondisk_log_start":"510'4500","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"518'6109","last_scrub_stamp":"2024-02-19T21:55:06.318324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:55:06.318324+0000","log_size":6087,"ondisk_log_size":6087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":279314456,"num_objects":4263,"num_object_clones":0,"num_object_copies":12789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4263,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10587,"num_write_kb":475137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6],"acting":[2,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":581,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.735850+0000","last_change":"2024-02-19T21:54:03.090621+0000","last_active":"2024-02-19T21:56:15.735850+0000","last_peered":"2024-02-19T21:56:15.735850+0000","last_clean":"2024-02-19T21:56:15.735850+0000","last_became_active":"2024-02-19T21:53:45.372402+0000","last_became_peered":"2024-02-19T21:53:45.372402+0000","last_unstale":"2024-02-19T21:56:15.735850+0000","last_undegraded":"2024-02-19T21:56:15.735850+0000","last_fullsized":"2024-02-19T21:56:15.735850+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:03.090525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:03.090525+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":515,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.736530+0000","last_change":"2024-02-19T21:48:37.789514+0000","last_active":"2024-02-19T21:56:15.736530+0000","last_peered":"2024-02-19T21:56:15.736530+0000","last_clean":"2024-02-19T21:56:15.736530+0000","last_became_active":"2024-02-19T21:32:23.363046+0000","last_became_peered":"2024-02-19T21:32:23.363046+0000","last_unstale":"2024-02-19T21:56:15.736530+0000","last_undegraded":"2024-02-19T21:56:15.736530+0000","last_fullsized":"2024-02-19T21:56:15.736530+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:37.789400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:48:37.789400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"470'30","reported_seq":441,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.734519+0000","last_change":"2024-02-19T21:55:08.637400+0000","last_active":"2024-02-19T21:56:15.734519+0000","last_peered":"2024-02-19T21:56:15.734519+0000","last_clean":"2024-02-19T21:56:15.734519+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:56:15.734519+0000","last_undegraded":"2024-02-19T21:56:15.734519+0000","last_fullsized":"2024-02-19T21:56:15.734519+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'30","last_scrub_stamp":"2024-02-19T21:55:08.637308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:55:08.637308+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":823,"reported_epoch":540,"state":"active+clean","last_fresh":"2024-02-19T21:56:17.737614+0000","last_change":"2024-02-19T21:55:45.663121+0000","last_active":"2024-02-19T21:56:17.737614+0000","last_peered":"2024-02-19T21:56:17.737614+0000","last_clean":"2024-02-19T21:56:17.737614+0000","last_became_active":"2024-02-19T21:32:27.373088+0000","last_became_peered":"2024-02-19T21:32:27.373088+0000","last_unstale":"2024-02-19T21:56:17.737614+0000","last_undegraded":"2024-02-19T21:56:17.737614+0000","last_fullsized":"2024-02-19T21:56:17.737614+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-02-19T21:55:45.663047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:55:45.663047+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"540'10201","reported_seq":10257,"reported_epoch":540,"state":"active+clean","last_fresh":"2024-02-19T21:56:20.334714+0000","last_change":"2024-02-19T21:53:45.371934+0000","last_active":"2024-02-19T21:56:20.334714+0000","last_peered":"2024-02-19T21:56:20.334714+0000","last_clean":"2024-02-19T21:56:20.334714+0000","last_became_active":"2024-02-19T21:53:45.371632+0000","last_became_peered":"2024-02-19T21:53:45.371632+0000","last_unstale":"2024-02-19T21:56:20.334714+0000","last_undegraded":"2024-02-19T21:56:20.334714+0000","last_fullsized":"2024-02-19T21:56:20.334714+0000","mapping_epoch":492,"log_start":"512'5029","ondisk_log_start":"512'5029","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":5172,"ondisk_log_size":5172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":280690688,"num_objects":4283,"num_object_clones":0,"num_object_copies":12849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4283,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10201,"num_write_kb":463488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":469,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.717829+0000","last_change":"2024-02-19T21:55:09.610198+0000","last_active":"2024-02-19T21:56:15.717829+0000","last_peered":"2024-02-19T21:56:15.717829+0000","last_clean":"2024-02-19T21:56:15.717829+0000","last_became_active":"2024-02-19T21:44:56.149476+0000","last_became_peered":"2024-02-19T21:44:56.149476+0000","last_unstale":"2024-02-19T21:56:15.717829+0000","last_undegraded":"2024-02-19T21:56:15.717829+0000","last_fullsized":"2024-02-19T21:56:15.717829+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:09.610109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:55:09.610109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":529,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.726893+0000","last_change":"2024-02-19T21:54:19.347995+0000","last_active":"2024-02-19T21:56:15.726893+0000","last_peered":"2024-02-19T21:56:15.726893+0000","last_clean":"2024-02-19T21:56:15.726893+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:56:15.726893+0000","last_undegraded":"2024-02-19T21:56:15.726893+0000","last_fullsized":"2024-02-19T21:56:15.726893+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:19.347909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.683101+0000","last_clean_scrub_stamp":"2024-02-19T21:54:19.347909+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"470'58","reported_seq":1026,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:17.154697+0000","last_change":"2024-02-19T21:54:23.554440+0000","last_active":"2024-02-19T21:56:17.154697+0000","last_peered":"2024-02-19T21:56:17.154697+0000","last_clean":"2024-02-19T21:56:17.154697+0000","last_became_active":"2024-02-19T21:49:08.334527+0000","last_became_peered":"2024-02-19T21:49:08.334527+0000","last_unstale":"2024-02-19T21:56:17.154697+0000","last_undegraded":"2024-02-19T21:56:17.154697+0000","last_fullsized":"2024-02-19T21:56:17.154697+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'58","last_scrub_stamp":"2024-02-19T21:54:23.554337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:54:23.554337+0000","log_size":58,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":50,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":1432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":514,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.738362+0000","last_change":"2024-02-19T21:54:24.918144+0000","last_active":"2024-02-19T21:56:15.738362+0000","last_peered":"2024-02-19T21:56:15.738362+0000","last_clean":"2024-02-19T21:56:15.738362+0000","last_became_active":"2024-02-19T21:32:27.371535+0000","last_became_peered":"2024-02-19T21:32:27.371535+0000","last_unstale":"2024-02-19T21:56:15.738362+0000","last_undegraded":"2024-02-19T21:56:15.738362+0000","last_fullsized":"2024-02-19T21:56:15.738362+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:24.918045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:54:24.918045+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"540'10333","reported_seq":10394,"reported_epoch":540,"state":"active+clean","last_fresh":"2024-02-19T21:56:20.279766+0000","last_change":"2024-02-19T21:55:45.047127+0000","last_active":"2024-02-19T21:56:20.279766+0000","last_peered":"2024-02-19T21:56:20.279766+0000","last_clean":"2024-02-19T21:56:20.279766+0000","last_became_active":"2024-02-19T21:53:45.366773+0000","last_became_peered":"2024-02-19T21:53:45.366773+0000","last_unstale":"2024-02-19T21:56:20.279766+0000","last_undegraded":"2024-02-19T21:56:20.279766+0000","last_fullsized":"2024-02-19T21:56:20.279766+0000","mapping_epoch":492,"log_start":"514'5403","ondisk_log_start":"514'5403","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"529'8180","last_scrub_stamp":"2024-02-19T21:55:45.047016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:55:45.047016+0000","log_size":4930,"ondisk_log_size":4930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":270598144,"num_objects":4129,"num_object_clones":0,"num_object_copies":12387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4129,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10333,"num_write_kb":462784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":567,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.735232+0000","last_change":"2024-02-19T21:55:52.928038+0000","last_active":"2024-02-19T21:56:15.735232+0000","last_peered":"2024-02-19T21:56:15.735232+0000","last_clean":"2024-02-19T21:56:15.735232+0000","last_became_active":"2024-02-19T21:53:45.368343+0000","last_became_peered":"2024-02-19T21:53:45.368343+0000","last_unstale":"2024-02-19T21:56:15.735232+0000","last_undegraded":"2024-02-19T21:56:15.735232+0000","last_fullsized":"2024-02-19T21:56:15.735232+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:52.927933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:55:52.927933+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'6","reported_seq":2078,"reported_epoch":540,"state":"active+clean","last_fresh":"2024-02-19T21:56:18.807888+0000","last_change":"2024-02-19T21:53:56.369658+0000","last_active":"2024-02-19T21:56:18.807888+0000","last_peered":"2024-02-19T21:56:18.807888+0000","last_clean":"2024-02-19T21:56:18.807888+0000","last_became_active":"2024-02-19T21:49:08.331108+0000","last_became_peered":"2024-02-19T21:49:08.331108+0000","last_unstale":"2024-02-19T21:56:18.807888+0000","last_undegraded":"2024-02-19T21:56:18.807888+0000","last_fullsized":"2024-02-19T21:56:18.807888+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-02-19T21:53:56.369590+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_clean_scrub_stamp":"2024-02-19T21:53:56.369590+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1415,"num_read_kb":1410,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":172,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.728674+0000","last_change":"2024-02-19T21:54:07.330521+0000","last_active":"2024-02-19T21:56:15.728674+0000","last_peered":"2024-02-19T21:56:15.728674+0000","last_clean":"2024-02-19T21:56:15.728674+0000","last_became_active":"2024-02-19T21:49:08.329378+0000","last_became_peered":"2024-02-19T21:49:08.329378+0000","last_unstale":"2024-02-19T21:56:15.728674+0000","last_undegraded":"2024-02-19T21:56:15.728674+0000","last_fullsized":"2024-02-19T21:56:15.728674+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:07.330454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:07.330454+0000","last_clean_scrub_stamp":"2024-02-19T21:54:07.330454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"470'21","reported_seq":578,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.737222+0000","last_change":"2024-02-19T21:48:14.878933+0000","last_active":"2024-02-19T21:56:15.737222+0000","last_peered":"2024-02-19T21:56:15.737222+0000","last_clean":"2024-02-19T21:56:15.737222+0000","last_became_active":"2024-02-19T21:32:25.359686+0000","last_became_peered":"2024-02-19T21:32:25.359686+0000","last_unstale":"2024-02-19T21:56:15.737222+0000","last_undegraded":"2024-02-19T21:56:15.737222+0000","last_fullsized":"2024-02-19T21:56:15.737222+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"200'17","last_scrub_stamp":"2024-02-19T21:48:14.878857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:48:14.878857+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":31,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":177,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.729149+0000","last_change":"2024-02-19T21:55:09.965755+0000","last_active":"2024-02-19T21:56:15.729149+0000","last_peered":"2024-02-19T21:56:15.729149+0000","last_clean":"2024-02-19T21:56:15.729149+0000","last_became_active":"2024-02-19T21:49:08.325127+0000","last_became_peered":"2024-02-19T21:49:08.325127+0000","last_unstale":"2024-02-19T21:56:15.729149+0000","last_undegraded":"2024-02-19T21:56:15.729149+0000","last_fullsized":"2024-02-19T21:56:15.729149+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:09.965645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:55:09.965645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"540'12739","reported_seq":12807,"reported_epoch":540,"state":"active+clean","last_fresh":"2024-02-19T21:56:20.373037+0000","last_change":"2024-02-19T21:55:51.587481+0000","last_active":"2024-02-19T21:56:20.373037+0000","last_peered":"2024-02-19T21:56:20.373037+0000","last_clean":"2024-02-19T21:56:20.373037+0000","last_became_active":"2024-02-19T21:53:45.369947+0000","last_became_peered":"2024-02-19T21:53:45.369947+0000","last_unstale":"2024-02-19T21:56:20.373037+0000","last_undegraded":"2024-02-19T21:56:20.373037+0000","last_fullsized":"2024-02-19T21:56:20.373037+0000","mapping_epoch":492,"log_start":"502'2700","ondisk_log_start":"502'2700","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"530'10927","last_scrub_stamp":"2024-02-19T21:55:51.587372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:55:51.587372+0000","log_size":10039,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":285671424,"num_objects":4359,"num_object_clones":0,"num_object_copies":13077,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4359,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10481,"num_write_kb":474880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":555,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.726064+0000","last_change":"2024-02-19T21:54:05.543474+0000","last_active":"2024-02-19T21:56:15.726064+0000","last_peered":"2024-02-19T21:56:15.726064+0000","last_clean":"2024-02-19T21:56:15.726064+0000","last_became_active":"2024-02-19T21:53:45.385423+0000","last_became_peered":"2024-02-19T21:53:45.385423+0000","last_unstale":"2024-02-19T21:56:15.726064+0000","last_undegraded":"2024-02-19T21:56:15.726064+0000","last_fullsized":"2024-02-19T21:56:15.726064+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:05.543362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:04.035136+0000","last_clean_scrub_stamp":"2024-02-19T21:54:05.543362+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":424,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.732039+0000","last_change":"2024-02-19T21:55:15.374524+0000","last_active":"2024-02-19T21:56:15.732039+0000","last_peered":"2024-02-19T21:56:15.732039+0000","last_clean":"2024-02-19T21:56:15.732039+0000","last_became_active":"2024-02-19T21:38:31.246612+0000","last_became_peered":"2024-02-19T21:38:31.246612+0000","last_unstale":"2024-02-19T21:56:15.732039+0000","last_undegraded":"2024-02-19T21:56:15.732039+0000","last_fullsized":"2024-02-19T21:56:15.732039+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:15.374461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:01.507418+0000","last_clean_scrub_stamp":"2024-02-19T21:55:15.374461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,4],"acting":[5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":585,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.724571+0000","last_change":"2024-02-19T21:54:52.479718+0000","last_active":"2024-02-19T21:56:15.724571+0000","last_peered":"2024-02-19T21:56:15.724571+0000","last_clean":"2024-02-19T21:56:15.724571+0000","last_became_active":"2024-02-19T21:54:52.479416+0000","last_became_peered":"2024-02-19T21:54:52.479416+0000","last_unstale":"2024-02-19T21:56:15.724571+0000","last_undegraded":"2024-02-19T21:56:15.724571+0000","last_fullsized":"2024-02-19T21:56:15.724571+0000","mapping_epoch":513,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":514,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:58.410478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:58.410478+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":141,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.734718+0000","last_change":"2024-02-19T21:53:51.510006+0000","last_active":"2024-02-19T21:56:15.734718+0000","last_peered":"2024-02-19T21:56:15.734718+0000","last_clean":"2024-02-19T21:56:15.734718+0000","last_became_active":"2024-02-19T21:49:54.483637+0000","last_became_peered":"2024-02-19T21:49:54.483637+0000","last_unstale":"2024-02-19T21:56:15.734718+0000","last_undegraded":"2024-02-19T21:56:15.734718+0000","last_fullsized":"2024-02-19T21:56:15.734718+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:51.509926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:53:51.509926+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"470'45","reported_seq":591,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.732871+0000","last_change":"2024-02-19T21:55:46.908853+0000","last_active":"2024-02-19T21:56:15.732871+0000","last_peered":"2024-02-19T21:56:15.732871+0000","last_clean":"2024-02-19T21:56:15.732871+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:56:15.732871+0000","last_undegraded":"2024-02-19T21:56:15.732871+0000","last_fullsized":"2024-02-19T21:56:15.732871+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'45","last_scrub_stamp":"2024-02-19T21:55:46.908753+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:55:46.908753+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":51,"num_write":37,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":141,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.736638+0000","last_change":"2024-02-19T21:53:55.571648+0000","last_active":"2024-02-19T21:56:15.736638+0000","last_peered":"2024-02-19T21:56:15.736638+0000","last_clean":"2024-02-19T21:56:15.736638+0000","last_became_active":"2024-02-19T21:49:54.477947+0000","last_became_peered":"2024-02-19T21:49:54.477947+0000","last_unstale":"2024-02-19T21:56:15.736638+0000","last_undegraded":"2024-02-19T21:56:15.736638+0000","last_fullsized":"2024-02-19T21:56:15.736638+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:55.571582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:53:55.571582+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"540'10148","reported_seq":10209,"reported_epoch":540,"state":"active+clean","last_fresh":"2024-02-19T21:56:20.278916+0000","last_change":"2024-02-19T21:55:15.103651+0000","last_active":"2024-02-19T21:56:20.278916+0000","last_peered":"2024-02-19T21:56:20.278916+0000","last_clean":"2024-02-19T21:56:20.278916+0000","last_became_active":"2024-02-19T21:53:45.367151+0000","last_became_peered":"2024-02-19T21:53:45.367151+0000","last_unstale":"2024-02-19T21:56:20.278916+0000","last_undegraded":"2024-02-19T21:56:20.278916+0000","last_fullsized":"2024-02-19T21:56:20.278916+0000","mapping_epoch":492,"log_start":"514'5300","ondisk_log_start":"514'5300","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"519'6500","last_scrub_stamp":"2024-02-19T21:55:15.103545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:55:15.103545+0000","log_size":4848,"ondisk_log_size":4848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":278134784,"num_objects":4244,"num_object_clones":0,"num_object_copies":12732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4244,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10148,"num_write_kb":460544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1],"acting":[6,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":520,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.736888+0000","last_change":"2024-02-19T21:55:06.665581+0000","last_active":"2024-02-19T21:56:15.736888+0000","last_peered":"2024-02-19T21:56:15.736888+0000","last_clean":"2024-02-19T21:56:15.736888+0000","last_became_active":"2024-02-19T21:38:31.248702+0000","last_became_peered":"2024-02-19T21:38:31.248702+0000","last_unstale":"2024-02-19T21:56:15.736888+0000","last_undegraded":"2024-02-19T21:56:15.736888+0000","last_fullsized":"2024-02-19T21:56:15.736888+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:06.665516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T21:55:06.665516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6],"acting":[1,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":527,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.738190+0000","last_change":"2024-02-19T21:54:08.084019+0000","last_active":"2024-02-19T21:56:15.738190+0000","last_peered":"2024-02-19T21:56:15.738190+0000","last_clean":"2024-02-19T21:56:15.738190+0000","last_became_active":"2024-02-19T21:38:31.246765+0000","last_became_peered":"2024-02-19T21:38:31.246765+0000","last_unstale":"2024-02-19T21:56:15.738190+0000","last_undegraded":"2024-02-19T21:56:15.738190+0000","last_fullsized":"2024-02-19T21:56:15.738190+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:08.083923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:54:08.083923+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":546,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.735506+0000","last_change":"2024-02-19T21:54:17.718006+0000","last_active":"2024-02-19T21:56:15.735506+0000","last_peered":"2024-02-19T21:56:15.735506+0000","last_clean":"2024-02-19T21:56:15.735506+0000","last_became_active":"2024-02-19T21:32:23.359562+0000","last_became_peered":"2024-02-19T21:32:23.359562+0000","last_unstale":"2024-02-19T21:56:15.735506+0000","last_undegraded":"2024-02-19T21:56:15.735506+0000","last_fullsized":"2024-02-19T21:56:15.735506+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:17.717904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:54:17.717904+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"470'42","reported_seq":689,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.738491+0000","last_change":"2024-02-19T21:54:18.926423+0000","last_active":"2024-02-19T21:56:15.738491+0000","last_peered":"2024-02-19T21:56:15.738491+0000","last_clean":"2024-02-19T21:56:15.738491+0000","last_became_active":"2024-02-19T21:49:08.329761+0000","last_became_peered":"2024-02-19T21:49:08.329761+0000","last_unstale":"2024-02-19T21:56:15.738491+0000","last_undegraded":"2024-02-19T21:56:15.738491+0000","last_fullsized":"2024-02-19T21:56:15.738491+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'42","last_scrub_stamp":"2024-02-19T21:54:18.926260+0000","last_deep_scrub":"324'30","last_deep_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_clean_scrub_stamp":"2024-02-19T21:54:18.926260+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":48,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":537,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.725987+0000","last_change":"2024-02-19T21:56:00.578823+0000","last_active":"2024-02-19T21:56:15.725987+0000","last_peered":"2024-02-19T21:56:15.725987+0000","last_clean":"2024-02-19T21:56:15.725987+0000","last_became_active":"2024-02-19T21:44:42.624782+0000","last_became_peered":"2024-02-19T21:44:42.624782+0000","last_unstale":"2024-02-19T21:56:15.725987+0000","last_undegraded":"2024-02-19T21:56:15.725987+0000","last_fullsized":"2024-02-19T21:56:15.725987+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":295,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:56:00.578725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:09.918170+0000","last_clean_scrub_stamp":"2024-02-19T21:56:00.578725+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.c","version":"540'10431","reported_seq":10487,"reported_epoch":540,"state":"active+clean","last_fresh":"2024-02-19T21:56:20.318596+0000","last_change":"2024-02-19T21:53:45.366888+0000","last_active":"2024-02-19T21:56:20.318596+0000","last_peered":"2024-02-19T21:56:20.318596+0000","last_clean":"2024-02-19T21:56:20.318596+0000","last_became_active":"2024-02-19T21:53:45.366605+0000","last_became_peered":"2024-02-19T21:53:45.366605+0000","last_unstale":"2024-02-19T21:56:20.318596+0000","last_undegraded":"2024-02-19T21:56:20.318596+0000","last_fullsized":"2024-02-19T21:56:20.318596+0000","mapping_epoch":492,"log_start":"514'5332","ondisk_log_start":"514'5332","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":5099,"ondisk_log_size":5099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":278331392,"num_objects":4247,"num_object_clones":0,"num_object_copies":12741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4247,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10431,"num_write_kb":469696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":551,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.734753+0000","last_change":"2024-02-19T21:53:59.350715+0000","last_active":"2024-02-19T21:56:15.734753+0000","last_peered":"2024-02-19T21:56:15.734753+0000","last_clean":"2024-02-19T21:56:15.734753+0000","last_became_active":"2024-02-19T21:49:08.330648+0000","last_became_peered":"2024-02-19T21:49:08.330648+0000","last_unstale":"2024-02-19T21:56:15.734753+0000","last_undegraded":"2024-02-19T21:56:15.734753+0000","last_fullsized":"2024-02-19T21:56:15.734753+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:59.350627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:39:42.020832+0000","last_clean_scrub_stamp":"2024-02-19T21:53:59.350627+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":522,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.735305+0000","last_change":"2024-02-19T21:54:59.095681+0000","last_active":"2024-02-19T21:56:15.735305+0000","last_peered":"2024-02-19T21:56:15.735305+0000","last_clean":"2024-02-19T21:56:15.735305+0000","last_became_active":"2024-02-19T21:32:23.363621+0000","last_became_peered":"2024-02-19T21:32:23.363621+0000","last_unstale":"2024-02-19T21:56:15.735305+0000","last_undegraded":"2024-02-19T21:56:15.735305+0000","last_fullsized":"2024-02-19T21:56:15.735305+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:59.095573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:45.017696+0000","last_clean_scrub_stamp":"2024-02-19T21:54:59.095573+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"470'47","reported_seq":590,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.737439+0000","last_change":"2024-02-19T21:53:58.140432+0000","last_active":"2024-02-19T21:56:15.737439+0000","last_peered":"2024-02-19T21:56:15.737439+0000","last_clean":"2024-02-19T21:56:15.737439+0000","last_became_active":"2024-02-19T21:32:25.373753+0000","last_became_peered":"2024-02-19T21:32:25.373753+0000","last_unstale":"2024-02-19T21:56:15.737439+0000","last_undegraded":"2024-02-19T21:56:15.737439+0000","last_fullsized":"2024-02-19T21:56:15.737439+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'47","last_scrub_stamp":"2024-02-19T21:53:58.140324+0000","last_deep_scrub":"83'27","last_deep_scrub_stamp":"2024-02-19T21:33:48.591669+0000","last_clean_scrub_stamp":"2024-02-19T21:53:58.140324+0000","log_size":47,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":55,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":519,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.734895+0000","last_change":"2024-02-19T21:54:02.567491+0000","last_active":"2024-02-19T21:56:15.734895+0000","last_peered":"2024-02-19T21:56:15.734895+0000","last_clean":"2024-02-19T21:56:15.734895+0000","last_became_active":"2024-02-19T21:32:27.368644+0000","last_became_peered":"2024-02-19T21:32:27.368644+0000","last_unstale":"2024-02-19T21:56:15.734895+0000","last_undegraded":"2024-02-19T21:56:15.734895+0000","last_fullsized":"2024-02-19T21:56:15.734895+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:02.567400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:54:02.567400+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"540'10802","reported_seq":10858,"reported_epoch":540,"state":"active+clean","last_fresh":"2024-02-19T21:56:24.939881+0000","last_change":"2024-02-19T21:53:45.370394+0000","last_active":"2024-02-19T21:56:24.939881+0000","last_peered":"2024-02-19T21:56:24.939881+0000","last_clean":"2024-02-19T21:56:24.939881+0000","last_became_active":"2024-02-19T21:53:45.370069+0000","last_became_peered":"2024-02-19T21:53:45.370069+0000","last_unstale":"2024-02-19T21:56:24.939881+0000","last_undegraded":"2024-02-19T21:56:24.939881+0000","last_fullsized":"2024-02-19T21:56:24.939881+0000","mapping_epoch":492,"log_start":"516'5800","ondisk_log_start":"516'5800","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":5002,"ondisk_log_size":5002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":262930432,"num_objects":4012,"num_object_clones":0,"num_object_copies":12036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4012,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10802,"num_write_kb":474048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":264,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.716602+0000","last_change":"2024-02-19T21:54:04.297489+0000","last_active":"2024-02-19T21:56:15.716602+0000","last_peered":"2024-02-19T21:56:15.716602+0000","last_clean":"2024-02-19T21:56:15.716602+0000","last_became_active":"2024-02-19T21:49:08.326106+0000","last_became_peered":"2024-02-19T21:49:08.326106+0000","last_unstale":"2024-02-19T21:56:15.716602+0000","last_undegraded":"2024-02-19T21:56:15.716602+0000","last_fullsized":"2024-02-19T21:56:15.716602+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:04.297389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:04.297389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":523,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.736611+0000","last_change":"2024-02-19T21:55:58.021460+0000","last_active":"2024-02-19T21:56:15.736611+0000","last_peered":"2024-02-19T21:56:15.736611+0000","last_clean":"2024-02-19T21:56:15.736611+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:56:15.736611+0000","last_undegraded":"2024-02-19T21:56:15.736611+0000","last_fullsized":"2024-02-19T21:56:15.736611+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:48:11.879687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:38:28.036351+0000","last_clean_scrub_stamp":"2024-02-19T21:48:11.879687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"470'50","reported_seq":177,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.735658+0000","last_change":"2024-02-19T21:55:18.969631+0000","last_active":"2024-02-19T21:56:15.735658+0000","last_peered":"2024-02-19T21:56:15.735658+0000","last_clean":"2024-02-19T21:56:15.735658+0000","last_became_active":"2024-02-19T21:49:54.480413+0000","last_became_peered":"2024-02-19T21:49:54.480413+0000","last_unstale":"2024-02-19T21:56:15.735658+0000","last_undegraded":"2024-02-19T21:56:15.735658+0000","last_fullsized":"2024-02-19T21:56:15.735658+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":415,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'50","last_scrub_stamp":"2024-02-19T21:55:18.969539+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:55:18.969539+0000","log_size":50,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":57,"num_write":44,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":415,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.734076+0000","last_change":"2024-02-19T21:54:58.727836+0000","last_active":"2024-02-19T21:56:15.734076+0000","last_peered":"2024-02-19T21:56:15.734076+0000","last_clean":"2024-02-19T21:56:15.734076+0000","last_became_active":"2024-02-19T21:49:54.494802+0000","last_became_peered":"2024-02-19T21:49:54.494802+0000","last_unstale":"2024-02-19T21:56:15.734076+0000","last_undegraded":"2024-02-19T21:56:15.734076+0000","last_fullsized":"2024-02-19T21:56:15.734076+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:58.727756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:54:58.727756+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"540'10573","reported_seq":10629,"reported_epoch":540,"state":"active+clean","last_fresh":"2024-02-19T21:56:20.353563+0000","last_change":"2024-02-19T21:53:45.386994+0000","last_active":"2024-02-19T21:56:20.353563+0000","last_peered":"2024-02-19T21:56:20.353563+0000","last_clean":"2024-02-19T21:56:20.353563+0000","last_became_active":"2024-02-19T21:53:45.386670+0000","last_became_peered":"2024-02-19T21:53:45.386670+0000","last_unstale":"2024-02-19T21:56:20.353563+0000","last_undegraded":"2024-02-19T21:56:20.353563+0000","last_fullsized":"2024-02-19T21:56:20.353563+0000","mapping_epoch":492,"log_start":"510'4900","ondisk_log_start":"510'4900","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":5673,"ondisk_log_size":5673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":281870336,"num_objects":4301,"num_object_clones":0,"num_object_copies":12903,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4301,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10573,"num_write_kb":475968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7],"acting":[4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":551,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.737802+0000","last_change":"2024-02-19T21:54:01.641103+0000","last_active":"2024-02-19T21:56:15.737802+0000","last_peered":"2024-02-19T21:56:15.737802+0000","last_clean":"2024-02-19T21:56:15.737802+0000","last_became_active":"2024-02-19T21:49:08.328529+0000","last_became_peered":"2024-02-19T21:49:08.328529+0000","last_unstale":"2024-02-19T21:56:15.737802+0000","last_undegraded":"2024-02-19T21:56:15.737802+0000","last_fullsized":"2024-02-19T21:56:15.737802+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:01.641007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:01.641007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":582,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.733080+0000","last_change":"2024-02-19T21:53:52.715548+0000","last_active":"2024-02-19T21:56:15.733080+0000","last_peered":"2024-02-19T21:56:15.733080+0000","last_clean":"2024-02-19T21:56:15.733080+0000","last_became_active":"2024-02-19T21:49:54.493041+0000","last_became_peered":"2024-02-19T21:49:54.493041+0000","last_unstale":"2024-02-19T21:56:15.733080+0000","last_undegraded":"2024-02-19T21:56:15.733080+0000","last_fullsized":"2024-02-19T21:56:15.733080+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:52.715486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:53:52.715486+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"470'42","reported_seq":412,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.716377+0000","last_change":"2024-02-19T21:54:01.223459+0000","last_active":"2024-02-19T21:56:15.716377+0000","last_peered":"2024-02-19T21:56:15.716377+0000","last_clean":"2024-02-19T21:56:15.716377+0000","last_became_active":"2024-02-19T21:49:08.330477+0000","last_became_peered":"2024-02-19T21:49:08.330477+0000","last_unstale":"2024-02-19T21:56:15.716377+0000","last_undegraded":"2024-02-19T21:56:15.716377+0000","last_fullsized":"2024-02-19T21:56:15.716377+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'42","last_scrub_stamp":"2024-02-19T21:54:01.223355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:54:01.223355+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"145'9","reported_seq":667,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:17.154376+0000","last_change":"2024-02-19T21:55:03.593029+0000","last_active":"2024-02-19T21:56:17.154376+0000","last_peered":"2024-02-19T21:56:17.154376+0000","last_clean":"2024-02-19T21:56:17.154376+0000","last_became_active":"2024-02-19T21:38:31.247426+0000","last_became_peered":"2024-02-19T21:38:31.247426+0000","last_unstale":"2024-02-19T21:56:17.154376+0000","last_undegraded":"2024-02-19T21:56:17.154376+0000","last_fullsized":"2024-02-19T21:56:17.154376+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'9","last_scrub_stamp":"2024-02-19T21:55:03.592953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:55:03.592953+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"540'10398","reported_seq":10461,"reported_epoch":540,"state":"active+clean","last_fresh":"2024-02-19T21:56:20.301678+0000","last_change":"2024-02-19T21:55:58.927490+0000","last_active":"2024-02-19T21:56:20.301678+0000","last_peered":"2024-02-19T21:56:20.301678+0000","last_clean":"2024-02-19T21:56:20.301678+0000","last_became_active":"2024-02-19T21:53:45.366735+0000","last_became_peered":"2024-02-19T21:53:45.366735+0000","last_unstale":"2024-02-19T21:56:20.301678+0000","last_undegraded":"2024-02-19T21:56:20.301678+0000","last_fullsized":"2024-02-19T21:56:20.301678+0000","mapping_epoch":492,"log_start":"514'5500","ondisk_log_start":"514'5500","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"533'9018","last_scrub_stamp":"2024-02-19T21:55:58.927256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:55:58.927256+0000","log_size":4898,"ondisk_log_size":4898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":280494080,"num_objects":4280,"num_object_clones":0,"num_object_copies":12840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4280,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10398,"num_write_kb":469696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"66'1","reported_seq":433,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.734224+0000","last_change":"2024-02-19T21:54:23.697006+0000","last_active":"2024-02-19T21:56:15.734224+0000","last_peered":"2024-02-19T21:56:15.734224+0000","last_clean":"2024-02-19T21:56:15.734224+0000","last_became_active":"2024-02-19T21:44:56.166670+0000","last_became_peered":"2024-02-19T21:44:56.166670+0000","last_unstale":"2024-02-19T21:56:15.734224+0000","last_undegraded":"2024-02-19T21:56:15.734224+0000","last_fullsized":"2024-02-19T21:56:15.734224+0000","mapping_epoch":165,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:54:23.696937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:54:23.696937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,7],"acting":[6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"261'11","reported_seq":679,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:17.155969+0000","last_change":"2024-02-19T21:56:02.498754+0000","last_active":"2024-02-19T21:56:17.155969+0000","last_peered":"2024-02-19T21:56:17.155969+0000","last_clean":"2024-02-19T21:56:17.155969+0000","last_became_active":"2024-02-19T21:44:08.123392+0000","last_became_peered":"2024-02-19T21:44:08.123392+0000","last_unstale":"2024-02-19T21:56:17.155969+0000","last_undegraded":"2024-02-19T21:56:17.155969+0000","last_fullsized":"2024-02-19T21:56:17.155969+0000","mapping_epoch":62,"log_start":"257'10","ondisk_log_start":"257'10","created":62,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-02-19T21:53:55.479699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:53:55.479699+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"59'1","reported_seq":533,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.735580+0000","last_change":"2024-02-19T21:54:16.707968+0000","last_active":"2024-02-19T21:56:15.735580+0000","last_peered":"2024-02-19T21:56:15.735580+0000","last_clean":"2024-02-19T21:56:15.735580+0000","last_became_active":"2024-02-19T21:32:23.359190+0000","last_became_peered":"2024-02-19T21:32:23.359190+0000","last_unstale":"2024-02-19T21:56:15.735580+0000","last_undegraded":"2024-02-19T21:56:15.735580+0000","last_fullsized":"2024-02-19T21:56:15.735580+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-02-19T21:54:16.707865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:54:16.707865+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"470'27","reported_seq":403,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.717736+0000","last_change":"2024-02-19T21:55:46.521391+0000","last_active":"2024-02-19T21:56:15.717736+0000","last_peered":"2024-02-19T21:56:15.717736+0000","last_clean":"2024-02-19T21:56:15.717736+0000","last_became_active":"2024-02-19T21:47:46.251550+0000","last_became_peered":"2024-02-19T21:47:46.251550+0000","last_unstale":"2024-02-19T21:56:15.717736+0000","last_undegraded":"2024-02-19T21:56:15.717736+0000","last_fullsized":"2024-02-19T21:56:15.717736+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'27","last_scrub_stamp":"2024-02-19T21:55:46.521264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:55:46.521264+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7],"acting":[4,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.0","version":"540'10398","reported_seq":10454,"reported_epoch":540,"state":"active+clean","last_fresh":"2024-02-19T21:56:20.347870+0000","last_change":"2024-02-19T21:53:45.376702+0000","last_active":"2024-02-19T21:56:20.347870+0000","last_peered":"2024-02-19T21:56:20.347870+0000","last_clean":"2024-02-19T21:56:20.347870+0000","last_became_active":"2024-02-19T21:53:45.376392+0000","last_became_peered":"2024-02-19T21:53:45.376392+0000","last_unstale":"2024-02-19T21:56:20.347870+0000","last_undegraded":"2024-02-19T21:56:20.347870+0000","last_fullsized":"2024-02-19T21:56:20.347870+0000","mapping_epoch":492,"log_start":"514'5251","ondisk_log_start":"514'5251","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":5147,"ondisk_log_size":5147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":281542656,"num_objects":4296,"num_object_clones":0,"num_object_copies":12888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4296,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10398,"num_write_kb":470208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,6],"acting":[1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":539,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.726333+0000","last_change":"2024-02-19T21:54:06.529408+0000","last_active":"2024-02-19T21:56:15.726333+0000","last_peered":"2024-02-19T21:56:15.726333+0000","last_clean":"2024-02-19T21:56:15.726333+0000","last_became_active":"2024-02-19T21:44:56.155194+0000","last_became_peered":"2024-02-19T21:44:56.155194+0000","last_unstale":"2024-02-19T21:56:15.726333+0000","last_undegraded":"2024-02-19T21:56:15.726333+0000","last_fullsized":"2024-02-19T21:56:15.726333+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:06.529311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:54:06.529311+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"363'12","reported_seq":390,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:17.154209+0000","last_change":"2024-02-19T21:55:47.510672+0000","last_active":"2024-02-19T21:56:17.154209+0000","last_peered":"2024-02-19T21:56:17.154209+0000","last_clean":"2024-02-19T21:56:17.154209+0000","last_became_active":"2024-02-19T21:47:46.260099+0000","last_became_peered":"2024-02-19T21:47:46.260099+0000","last_unstale":"2024-02-19T21:56:17.154209+0000","last_undegraded":"2024-02-19T21:56:17.154209+0000","last_fullsized":"2024-02-19T21:56:17.154209+0000","mapping_epoch":362,"log_start":"98'9","ondisk_log_start":"98'9","created":62,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"363'12","last_scrub_stamp":"2024-02-19T21:55:47.510574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:55:47.510574+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":553,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.734669+0000","last_change":"2024-02-19T21:55:02.556526+0000","last_active":"2024-02-19T21:56:15.734669+0000","last_peered":"2024-02-19T21:56:15.734669+0000","last_clean":"2024-02-19T21:56:15.734669+0000","last_became_active":"2024-02-19T21:53:45.382885+0000","last_became_peered":"2024-02-19T21:53:45.382885+0000","last_unstale":"2024-02-19T21:56:15.734669+0000","last_undegraded":"2024-02-19T21:56:15.734669+0000","last_fullsized":"2024-02-19T21:56:15.734669+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:02.556431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:55:02.556431+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"471'46","reported_seq":506,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.725822+0000","last_change":"2024-02-19T21:54:24.358037+0000","last_active":"2024-02-19T21:56:15.725822+0000","last_peered":"2024-02-19T21:56:15.725822+0000","last_clean":"2024-02-19T21:56:15.725822+0000","last_became_active":"2024-02-19T21:53:45.384528+0000","last_became_peered":"2024-02-19T21:53:45.384528+0000","last_unstale":"2024-02-19T21:56:15.725822+0000","last_undegraded":"2024-02-19T21:56:15.725822+0000","last_fullsized":"2024-02-19T21:56:15.725822+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'46","last_scrub_stamp":"2024-02-19T21:54:24.357931+0000","last_deep_scrub":"270'34","last_deep_scrub_stamp":"2024-02-19T21:44:17.451151+0000","last_clean_scrub_stamp":"2024-02-19T21:54:24.357931+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"540'10764","reported_seq":10822,"reported_epoch":540,"state":"active+clean","last_fresh":"2024-02-19T21:56:20.302753+0000","last_change":"2024-02-19T21:56:02.628871+0000","last_active":"2024-02-19T21:56:20.302753+0000","last_peered":"2024-02-19T21:56:20.302753+0000","last_clean":"2024-02-19T21:56:20.302753+0000","last_became_active":"2024-02-19T21:53:45.368025+0000","last_became_peered":"2024-02-19T21:53:45.368025+0000","last_unstale":"2024-02-19T21:56:20.302753+0000","last_undegraded":"2024-02-19T21:56:20.302753+0000","last_fullsized":"2024-02-19T21:56:20.302753+0000","mapping_epoch":492,"log_start":"515'5871","ondisk_log_start":"515'5871","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":4893,"ondisk_log_size":4893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":279838720,"num_objects":4270,"num_object_clones":0,"num_object_copies":12810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4270,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10764,"num_write_kb":481088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1],"acting":[6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":522,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.717788+0000","last_change":"2024-02-19T21:53:55.275891+0000","last_active":"2024-02-19T21:56:15.717788+0000","last_peered":"2024-02-19T21:56:15.717788+0000","last_clean":"2024-02-19T21:56:15.717788+0000","last_became_active":"2024-02-19T21:49:08.328697+0000","last_became_peered":"2024-02-19T21:49:08.328697+0000","last_unstale":"2024-02-19T21:56:15.717788+0000","last_undegraded":"2024-02-19T21:56:15.717788+0000","last_fullsized":"2024-02-19T21:56:15.717788+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:55.275772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:53:55.275772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"397'17","reported_seq":528,"reported_epoch":540,"state":"active+clean","last_fresh":"2024-02-19T21:56:17.730367+0000","last_change":"2024-02-19T21:55:52.652496+0000","last_active":"2024-02-19T21:56:17.730367+0000","last_peered":"2024-02-19T21:56:17.730367+0000","last_clean":"2024-02-19T21:56:17.730367+0000","last_became_active":"2024-02-19T21:49:08.325034+0000","last_became_peered":"2024-02-19T21:49:08.325034+0000","last_unstale":"2024-02-19T21:56:17.730367+0000","last_undegraded":"2024-02-19T21:56:17.730367+0000","last_fullsized":"2024-02-19T21:56:17.730367+0000","mapping_epoch":394,"log_start":"170'11","ondisk_log_start":"170'11","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"397'17","last_scrub_stamp":"2024-02-19T21:55:52.652385+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:55:52.652385+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":538,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.734428+0000","last_change":"2024-02-19T21:53:45.383685+0000","last_active":"2024-02-19T21:56:15.734428+0000","last_peered":"2024-02-19T21:56:15.734428+0000","last_clean":"2024-02-19T21:56:15.734428+0000","last_became_active":"2024-02-19T21:53:45.383372+0000","last_became_peered":"2024-02-19T21:53:45.383372+0000","last_unstale":"2024-02-19T21:56:15.734428+0000","last_undegraded":"2024-02-19T21:56:15.734428+0000","last_fullsized":"2024-02-19T21:56:15.734428+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:49:03.987749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:49:03.987749+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"470'30","reported_seq":404,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.716957+0000","last_change":"2024-02-19T21:54:11.381056+0000","last_active":"2024-02-19T21:56:15.716957+0000","last_peered":"2024-02-19T21:56:15.716957+0000","last_clean":"2024-02-19T21:56:15.716957+0000","last_became_active":"2024-02-19T21:53:45.387040+0000","last_became_peered":"2024-02-19T21:53:45.387040+0000","last_unstale":"2024-02-19T21:56:15.716957+0000","last_undegraded":"2024-02-19T21:56:15.716957+0000","last_fullsized":"2024-02-19T21:56:15.716957+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'30","last_scrub_stamp":"2024-02-19T21:54:11.380958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:54:11.380958+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":38,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"540'10730","reported_seq":10791,"reported_epoch":540,"state":"active+clean","last_fresh":"2024-02-19T21:56:22.286425+0000","last_change":"2024-02-19T21:55:18.390850+0000","last_active":"2024-02-19T21:56:22.286425+0000","last_peered":"2024-02-19T21:56:22.286425+0000","last_clean":"2024-02-19T21:56:22.286425+0000","last_became_active":"2024-02-19T21:53:45.369133+0000","last_became_peered":"2024-02-19T21:53:45.369133+0000","last_unstale":"2024-02-19T21:56:22.286425+0000","last_undegraded":"2024-02-19T21:56:22.286425+0000","last_fullsized":"2024-02-19T21:56:22.286425+0000","mapping_epoch":492,"log_start":"510'4700","ondisk_log_start":"510'4700","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"520'6862","last_scrub_stamp":"2024-02-19T21:55:18.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:55:18.390740+0000","log_size":6030,"ondisk_log_size":6030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":278003712,"num_objects":4242,"num_object_clones":0,"num_object_copies":12726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4242,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10730,"num_write_kb":479104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":177,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.728700+0000","last_change":"2024-02-19T21:55:53.801441+0000","last_active":"2024-02-19T21:56:15.728700+0000","last_peered":"2024-02-19T21:56:15.728700+0000","last_clean":"2024-02-19T21:56:15.728700+0000","last_became_active":"2024-02-19T21:49:08.327172+0000","last_became_peered":"2024-02-19T21:49:08.327172+0000","last_unstale":"2024-02-19T21:56:15.728700+0000","last_undegraded":"2024-02-19T21:56:15.728700+0000","last_fullsized":"2024-02-19T21:56:15.728700+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:53.801346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:55:53.801346+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,6],"acting":[2,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":529,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.736804+0000","last_change":"2024-02-19T21:54:16.533065+0000","last_active":"2024-02-19T21:56:15.736804+0000","last_peered":"2024-02-19T21:56:15.736804+0000","last_clean":"2024-02-19T21:56:15.736804+0000","last_became_active":"2024-02-19T21:44:22.245925+0000","last_became_peered":"2024-02-19T21:44:22.245925+0000","last_unstale":"2024-02-19T21:56:15.736804+0000","last_undegraded":"2024-02-19T21:56:15.736804+0000","last_fullsized":"2024-02-19T21:56:15.736804+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:16.532968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:54:16.532968+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":529,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.737674+0000","last_change":"2024-02-19T21:54:22.796082+0000","last_active":"2024-02-19T21:56:15.737674+0000","last_peered":"2024-02-19T21:56:15.737674+0000","last_clean":"2024-02-19T21:56:15.737674+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T21:56:15.737674+0000","last_undegraded":"2024-02-19T21:56:15.737674+0000","last_fullsized":"2024-02-19T21:56:15.737674+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:22.795999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:39.415072+0000","last_clean_scrub_stamp":"2024-02-19T21:54:22.795999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"470'53","reported_seq":498,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.717426+0000","last_change":"2024-02-19T21:54:05.257204+0000","last_active":"2024-02-19T21:56:15.717426+0000","last_peered":"2024-02-19T21:56:15.717426+0000","last_clean":"2024-02-19T21:56:15.717426+0000","last_became_active":"2024-02-19T21:49:08.325683+0000","last_became_peered":"2024-02-19T21:49:08.325683+0000","last_unstale":"2024-02-19T21:56:15.717426+0000","last_undegraded":"2024-02-19T21:56:15.717426+0000","last_fullsized":"2024-02-19T21:56:15.717426+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'53","last_scrub_stamp":"2024-02-19T21:54:05.257106+0000","last_deep_scrub":"337'39","last_deep_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_clean_scrub_stamp":"2024-02-19T21:54:05.257106+0000","log_size":53,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"540'10575","reported_seq":10635,"reported_epoch":540,"state":"active+clean","last_fresh":"2024-02-19T21:56:24.943501+0000","last_change":"2024-02-19T21:55:58.834453+0000","last_active":"2024-02-19T21:56:24.943501+0000","last_peered":"2024-02-19T21:56:24.943501+0000","last_clean":"2024-02-19T21:56:24.943501+0000","last_became_active":"2024-02-19T21:53:45.369204+0000","last_became_peered":"2024-02-19T21:53:45.369204+0000","last_unstale":"2024-02-19T21:56:24.943501+0000","last_undegraded":"2024-02-19T21:56:24.943501+0000","last_fullsized":"2024-02-19T21:56:24.943501+0000","mapping_epoch":492,"log_start":"516'5600","ondisk_log_start":"516'5600","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":4975,"ondisk_log_size":4975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":257622016,"num_objects":3931,"num_object_clones":0,"num_object_copies":11793,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3931,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10575,"num_write_kb":464192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.8","version":"66'1","reported_seq":390,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.734803+0000","last_change":"2024-02-19T21:55:54.932304+0000","last_active":"2024-02-19T21:56:15.734803+0000","last_peered":"2024-02-19T21:56:15.734803+0000","last_clean":"2024-02-19T21:56:15.734803+0000","last_became_active":"2024-02-19T21:53:48.374606+0000","last_became_peered":"2024-02-19T21:53:48.374606+0000","last_unstale":"2024-02-19T21:56:15.734803+0000","last_undegraded":"2024-02-19T21:56:15.734803+0000","last_fullsized":"2024-02-19T21:56:15.734803+0000","mapping_epoch":495,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":496,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:55:54.932216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:55:54.932216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":177,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.728503+0000","last_change":"2024-02-19T21:55:07.096301+0000","last_active":"2024-02-19T21:56:15.728503+0000","last_peered":"2024-02-19T21:56:15.728503+0000","last_clean":"2024-02-19T21:56:15.728503+0000","last_became_active":"2024-02-19T21:49:08.324835+0000","last_became_peered":"2024-02-19T21:49:08.324835+0000","last_unstale":"2024-02-19T21:56:15.728503+0000","last_undegraded":"2024-02-19T21:56:15.728503+0000","last_fullsized":"2024-02-19T21:56:15.728503+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:07.096186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:12.163825+0000","last_clean_scrub_stamp":"2024-02-19T21:55:07.096186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":252,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.733867+0000","last_change":"2024-02-19T21:55:47.904418+0000","last_active":"2024-02-19T21:56:15.733867+0000","last_peered":"2024-02-19T21:56:15.733867+0000","last_clean":"2024-02-19T21:56:15.733867+0000","last_became_active":"2024-02-19T21:49:08.327186+0000","last_became_peered":"2024-02-19T21:49:08.327186+0000","last_unstale":"2024-02-19T21:56:15.733867+0000","last_undegraded":"2024-02-19T21:56:15.733867+0000","last_fullsized":"2024-02-19T21:56:15.733867+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:55:47.904302+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:55:47.904302+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"471'60","reported_seq":672,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.734744+0000","last_change":"2024-02-19T21:54:59.710692+0000","last_active":"2024-02-19T21:56:15.734744+0000","last_peered":"2024-02-19T21:56:15.734744+0000","last_clean":"2024-02-19T21:56:15.734744+0000","last_became_active":"2024-02-19T21:49:54.493167+0000","last_became_peered":"2024-02-19T21:49:54.493167+0000","last_unstale":"2024-02-19T21:56:15.734744+0000","last_undegraded":"2024-02-19T21:56:15.734744+0000","last_fullsized":"2024-02-19T21:56:15.734744+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'60","last_scrub_stamp":"2024-02-19T21:54:59.710570+0000","last_deep_scrub":"201'44","last_deep_scrub_stamp":"2024-02-19T21:44:16.255049+0000","last_clean_scrub_stamp":"2024-02-19T21:54:59.710570+0000","log_size":60,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":80,"num_read_kb":69,"num_write":52,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.4","version":"540'10744","reported_seq":10800,"reported_epoch":540,"state":"active+clean","last_fresh":"2024-02-19T21:56:24.901834+0000","last_change":"2024-02-19T21:53:45.370493+0000","last_active":"2024-02-19T21:56:24.901834+0000","last_peered":"2024-02-19T21:56:24.901834+0000","last_clean":"2024-02-19T21:56:24.901834+0000","last_became_active":"2024-02-19T21:53:45.370111+0000","last_became_peered":"2024-02-19T21:53:45.370111+0000","last_unstale":"2024-02-19T21:56:24.901834+0000","last_undegraded":"2024-02-19T21:56:24.901834+0000","last_fullsized":"2024-02-19T21:56:24.901834+0000","mapping_epoch":492,"log_start":"516'5800","ondisk_log_start":"516'5800","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:53:44.626155+0000","log_size":4944,"ondisk_log_size":4944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":260046848,"num_objects":3968,"num_object_clones":0,"num_object_copies":11904,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3968,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10744,"num_write_kb":470784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":572,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.738396+0000","last_change":"2024-02-19T21:54:11.072349+0000","last_active":"2024-02-19T21:56:15.738396+0000","last_peered":"2024-02-19T21:56:15.738396+0000","last_clean":"2024-02-19T21:56:15.738396+0000","last_became_active":"2024-02-19T21:49:08.328287+0000","last_became_peered":"2024-02-19T21:49:08.328287+0000","last_unstale":"2024-02-19T21:56:15.738396+0000","last_undegraded":"2024-02-19T21:56:15.738396+0000","last_fullsized":"2024-02-19T21:56:15.738396+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:11.072274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:11.072274+0000","last_clean_scrub_stamp":"2024-02-19T21:54:11.072274+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":172,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.731562+0000","last_change":"2024-02-19T21:54:09.300812+0000","last_active":"2024-02-19T21:56:15.731562+0000","last_peered":"2024-02-19T21:56:15.731562+0000","last_clean":"2024-02-19T21:56:15.731562+0000","last_became_active":"2024-02-19T21:49:08.331451+0000","last_became_peered":"2024-02-19T21:49:08.331451+0000","last_unstale":"2024-02-19T21:56:15.731562+0000","last_undegraded":"2024-02-19T21:56:15.731562+0000","last_fullsized":"2024-02-19T21:56:15.731562+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:09.300710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.547129+0000","last_clean_scrub_stamp":"2024-02-19T21:54:09.300710+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":553,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.736946+0000","last_change":"2024-02-19T21:55:10.585700+0000","last_active":"2024-02-19T21:56:15.736946+0000","last_peered":"2024-02-19T21:56:15.736946+0000","last_clean":"2024-02-19T21:56:15.736946+0000","last_became_active":"2024-02-19T21:53:45.384695+0000","last_became_peered":"2024-02-19T21:53:45.384695+0000","last_unstale":"2024-02-19T21:56:15.736946+0000","last_undegraded":"2024-02-19T21:56:15.736946+0000","last_fullsized":"2024-02-19T21:56:15.736946+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:55:10.585574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:55:10.585574+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"470'25","reported_seq":561,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.737723+0000","last_change":"2024-02-19T21:55:06.814685+0000","last_active":"2024-02-19T21:56:15.737723+0000","last_peered":"2024-02-19T21:56:15.737723+0000","last_clean":"2024-02-19T21:56:15.737723+0000","last_became_active":"2024-02-19T21:32:25.355735+0000","last_became_peered":"2024-02-19T21:32:25.355735+0000","last_unstale":"2024-02-19T21:56:15.737723+0000","last_undegraded":"2024-02-19T21:56:15.737723+0000","last_fullsized":"2024-02-19T21:56:15.737723+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'25","last_scrub_stamp":"2024-02-19T21:55:06.814592+0000","last_deep_scrub":"377'19","last_deep_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_clean_scrub_stamp":"2024-02-19T21:55:06.814592+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"540'10183","reported_seq":10244,"reported_epoch":540,"state":"active+clean","last_fresh":"2024-02-19T21:56:20.422690+0000","last_change":"2024-02-19T21:55:56.311097+0000","last_active":"2024-02-19T21:56:20.422690+0000","last_peered":"2024-02-19T21:56:20.422690+0000","last_clean":"2024-02-19T21:56:20.422690+0000","last_became_active":"2024-02-19T21:53:45.367724+0000","last_became_peered":"2024-02-19T21:53:45.367724+0000","last_unstale":"2024-02-19T21:56:20.422690+0000","last_undegraded":"2024-02-19T21:56:20.422690+0000","last_fullsized":"2024-02-19T21:56:20.422690+0000","mapping_epoch":492,"log_start":"510'4400","ondisk_log_start":"510'4400","created":492,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"532'8688","last_scrub_stamp":"2024-02-19T21:55:56.310997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:53:44.626155+0000","last_clean_scrub_stamp":"2024-02-19T21:55:56.310997+0000","log_size":5783,"ondisk_log_size":5783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":275054592,"num_objects":4197,"num_object_clones":0,"num_object_copies":12591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4197,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10183,"num_write_kb":460160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4],"acting":[5,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":537,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.726806+0000","last_change":"2024-02-19T21:54:09.344599+0000","last_active":"2024-02-19T21:56:15.726806+0000","last_peered":"2024-02-19T21:56:15.726806+0000","last_clean":"2024-02-19T21:56:15.726806+0000","last_became_active":"2024-02-19T21:44:56.160521+0000","last_became_peered":"2024-02-19T21:44:56.160521+0000","last_unstale":"2024-02-19T21:56:15.726806+0000","last_undegraded":"2024-02-19T21:56:15.726806+0000","last_fullsized":"2024-02-19T21:56:15.726806+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":303,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:09.344514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:54:09.344514+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":181,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.729217+0000","last_change":"2024-02-19T21:54:16.360569+0000","last_active":"2024-02-19T21:56:15.729217+0000","last_peered":"2024-02-19T21:56:15.729217+0000","last_clean":"2024-02-19T21:56:15.729217+0000","last_became_active":"2024-02-19T21:49:54.485078+0000","last_became_peered":"2024-02-19T21:49:54.485078+0000","last_unstale":"2024-02-19T21:56:15.729217+0000","last_undegraded":"2024-02-19T21:56:15.729217+0000","last_fullsized":"2024-02-19T21:56:15.729217+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:16.360470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:54:16.360470+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"470'39","reported_seq":632,"reported_epoch":539,"state":"active+clean","last_fresh":"2024-02-19T21:56:15.724333+0000","last_change":"2024-02-19T21:54:58.172666+0000","last_active":"2024-02-19T21:56:15.724333+0000","last_peered":"2024-02-19T21:56:15.724333+0000","last_clean":"2024-02-19T21:56:15.724333+0000","last_became_active":"2024-02-19T21:49:54.486014+0000","last_became_peered":"2024-02-19T21:49:54.486014+0000","last_unstale":"2024-02-19T21:56:15.724333+0000","last_undegraded":"2024-02-19T21:56:15.724333+0000","last_fullsized":"2024-02-19T21:56:15.724333+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'39","last_scrub_stamp":"2024-02-19T21:54:58.172560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:54:58.172560+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"324'11","reported_seq":841,"reported_epoch":540,"state":"active+clean","last_fresh":"2024-02-19T21:56:17.725187+0000","last_change":"2024-02-19T21:54:21.760361+0000","last_active":"2024-02-19T21:56:17.725187+0000","last_peered":"2024-02-19T21:56:17.725187+0000","last_clean":"2024-02-19T21:56:17.725187+0000","last_became_active":"2024-02-19T21:44:34.385140+0000","last_became_peered":"2024-02-19T21:44:34.385140+0000","last_unstale":"2024-02-19T21:56:17.725187+0000","last_undegraded":"2024-02-19T21:56:17.725187+0000","last_fullsized":"2024-02-19T21:56:17.725187+0000","mapping_epoch":62,"log_start":"66'8","ondisk_log_start":"66'8","created":62,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'11","last_scrub_stamp":"2024-02-19T21:54:21.760260+0000","last_deep_scrub":"324'11","last_deep_scrub_stamp":"2024-02-19T21:46:05.210095+0000","last_clean_scrub_stamp":"2024-02-19T21:54:21.760260+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":16,"stat_sum":{"num_bytes":4392026136,"num_objects":67018,"num_object_clones":0,"num_object_copies":201054,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67018,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":168196,"num_write_kb":7526785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13147975680,"data_stored":13147963464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":89168,"ondisk_log_size":89168,"up":48,"acting":48,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1415,"num_read_kb":1410,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1535,"num_read_kb":1292,"num_write":989,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":316,"num_bytes_recovered":5942,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1062,"ondisk_log_size":1062,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":22,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":66,"acting":66,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201571,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2699712,"kb_used_data":1797560,"kb_used_omap":0,"kb_used_meta":901952,"kb_avail":91045440,"statfs":{"total":95995035648,"available":93230530560,"internally_reserved":0,"allocated":1840701440,"data_stored":1839022439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":923598848},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:55:58 2024","interfaces":[{"interface":"back","average":{"1min":2.1960000000000002,"5min":1.3240000000000001,"15min":1.9430000000000001},"min":{"1min":0.25900000000000001,"5min":0.20899999999999999,"15min":0.19},"max":{"1min":9.2200000000000006,"5min":9.2200000000000006,"15min":70.477999999999994},"last":9.9860000000000007},{"interface":"front","average":{"1min":1.9299999999999999,"5min":1.2250000000000001,"15min":1.97},"min":{"1min":0.317,"5min":0.23899999999999999,"15min":0.21199999999999999},"max":{"1min":8.3710000000000004,"5min":9.8759999999999994,"15min":68.052000000000007},"last":2.8679999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:55:58 2024","interfaces":[{"interface":"back","average":{"1min":2.5680000000000001,"5min":1.605,"15min":2.04},"min":{"1min":0.28000000000000003,"5min":0.25,"15min":0.23799999999999999},"max":{"1min":8.9619999999999997,"5min":8.9619999999999997,"15min":68.168000000000006},"last":1.5960000000000001},{"interface":"front","average":{"1min":2.2679999999999998,"5min":1.333,"15min":2.1440000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":9.7289999999999992,"5min":9.9559999999999995,"15min":68.444000000000003},"last":2.0169999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:56:21 2024","interfaces":[{"interface":"back","average":{"1min":2.6070000000000002,"5min":1.589,"15min":2.0059999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.9669999999999996,"5min":12.352,"15min":12.352},"last":3.0310000000000001},{"interface":"front","average":{"1min":3.5539999999999998,"5min":1.9770000000000001,"15min":1.9319999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28100000000000003},"max":{"1min":9.3529999999999998,"5min":12.369,"15min":12.369},"last":10.064}]},{"osd":3,"last update":"Mon Feb 19 21:55:58 2024","interfaces":[{"interface":"back","average":{"1min":2.1280000000000001,"5min":1.6739999999999999,"15min":1.9319999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.25900000000000001},"max":{"1min":9.1099999999999994,"5min":9.1099999999999994,"15min":11.778},"last":9.5030000000000001},{"interface":"front","average":{"1min":2.427,"5min":1.746,"15min":1.742},"min":{"1min":0.439,"5min":0.312,"15min":0.29299999999999998},"max":{"1min":8.9920000000000009,"5min":13.196,"15min":13.473000000000001},"last":4.7409999999999997}]},{"osd":4,"last update":"Mon Feb 19 21:55:58 2024","interfaces":[{"interface":"back","average":{"1min":2.2130000000000001,"5min":1.4770000000000001,"15min":1.79},"min":{"1min":0.32400000000000001,"5min":0.254,"15min":0.216},"max":{"1min":8.6129999999999995,"5min":10.656000000000001,"15min":17.716999999999999},"last":1.988},{"interface":"front","average":{"1min":3.056,"5min":1.974,"15min":2.2440000000000002},"min":{"1min":0.312,"5min":0.26700000000000002,"15min":0.253},"max":{"1min":12.164,"5min":15.961,"15min":17.690999999999999},"last":9.4190000000000005}]},{"osd":5,"last update":"Mon Feb 19 21:55:58 2024","interfaces":[{"interface":"back","average":{"1min":2.496,"5min":1.6839999999999999,"15min":1.853},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.24199999999999999},"max":{"1min":14.675000000000001,"5min":14.675000000000001,"15min":29.021000000000001},"last":1.5569999999999999},{"interface":"front","average":{"1min":2.609,"5min":1.7450000000000001,"15min":2.1469999999999998},"min":{"1min":0.34499999999999997,"5min":0.29399999999999998,"15min":0.28699999999999998},"max":{"1min":8.4320000000000004,"5min":9.9269999999999996,"15min":29.091999999999999},"last":2.1970000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:55:58 2024","interfaces":[{"interface":"back","average":{"1min":2.5089999999999999,"5min":1.8109999999999999,"15min":2.0179999999999998},"min":{"1min":0.374,"5min":0.28299999999999997,"15min":0.24299999999999999},"max":{"1min":8.4710000000000001,"5min":15.426,"15min":19.286000000000001},"last":4.5129999999999999},{"interface":"front","average":{"1min":3.1539999999999999,"5min":2.0150000000000001,"15min":2.2010000000000001},"min":{"1min":0.39800000000000002,"5min":0.27500000000000002,"15min":0.26700000000000002},"max":{"1min":11.894,"5min":11.894,"15min":18.364000000000001},"last":14.606}]}]},{"osd":6,"up_from":47,"seq":201863463209,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3373504,"kb_used_data":2488568,"kb_used_omap":0,"kb_used_meta":884928,"kb_avail":90371648,"statfs":{"total":95995035648,"available":92540567552,"internally_reserved":0,"allocated":2548293632,"data_stored":2546613945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":906166272},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,0,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:55:37 2024","interfaces":[{"interface":"back","average":{"1min":1.786,"5min":1.1419999999999999,"15min":1.4710000000000001},"min":{"1min":0.22700000000000001,"5min":0.214,"15min":0.20100000000000001},"max":{"1min":4.5010000000000003,"5min":9.8659999999999997,"15min":45.197000000000003},"last":0.28199999999999997},{"interface":"front","average":{"1min":1.958,"5min":1.6040000000000001,"15min":1.9219999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.23499999999999999},"max":{"1min":8.2100000000000009,"5min":10.038,"15min":44.753},"last":4.4649999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:55:37 2024","interfaces":[{"interface":"back","average":{"1min":2.3010000000000002,"5min":1.2929999999999999,"15min":1.5880000000000001},"min":{"1min":0.29099999999999998,"5min":0.24299999999999999,"15min":0.20799999999999999},"max":{"1min":11.569000000000001,"5min":11.569000000000001,"15min":45.231999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":4.1319999999999997,"5min":2.0289999999999999,"15min":1.8500000000000001},"min":{"1min":0.56100000000000005,"5min":0.26900000000000002,"15min":0.23100000000000001},"max":{"1min":11.869,"5min":15.215999999999999,"15min":45.097999999999999},"last":0.98299999999999998}]},{"osd":2,"last update":"Mon Feb 19 21:56:19 2024","interfaces":[{"interface":"back","average":{"1min":2.9300000000000002,"5min":2.2650000000000001,"15min":1.7589999999999999},"min":{"1min":0.28399999999999997,"5min":0.255,"15min":0.255},"max":{"1min":21.206,"5min":52.920000000000002,"15min":52.920000000000002},"last":2.5049999999999999},{"interface":"front","average":{"1min":1.8320000000000001,"5min":1.8740000000000001,"15min":1.429},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":6.5800000000000001,"5min":53.186999999999998,"15min":53.186999999999998},"last":4.383}]},{"osd":3,"last update":"Mon Feb 19 21:55:37 2024","interfaces":[{"interface":"back","average":{"1min":2.6949999999999998,"5min":1.4490000000000001,"15min":1.5429999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.25900000000000001},"max":{"1min":8.0990000000000002,"5min":9.8460000000000001,"15min":10.630000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":3.3900000000000001,"5min":1.9339999999999999,"15min":1.671},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.26400000000000001},"max":{"1min":10.742000000000001,"5min":15.175000000000001,"15min":15.175000000000001},"last":0.30399999999999999}]},{"osd":4,"last update":"Mon Feb 19 21:55:37 2024","interfaces":[{"interface":"back","average":{"1min":2.3639999999999999,"5min":1.542,"15min":2.0009999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23000000000000001},"max":{"1min":7.1820000000000004,"5min":8.8439999999999994,"15min":18.010000000000002},"last":2.5350000000000001},{"interface":"front","average":{"1min":2.2759999999999998,"5min":1.548,"15min":1.9319999999999999},"min":{"1min":0.32000000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":6.6159999999999997,"5min":9.8360000000000003,"15min":14.055},"last":0.39600000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:55:37 2024","interfaces":[{"interface":"back","average":{"1min":2.6280000000000001,"5min":3.2480000000000002,"15min":2.589},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":8.173,"5min":148.589,"15min":148.589},"last":3.1040000000000001},{"interface":"front","average":{"1min":2.0430000000000001,"5min":2.8460000000000001,"15min":2.52},"min":{"1min":0.373,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":5.4950000000000001,"5min":148.453,"15min":148.453},"last":1.5669999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:56:04 2024","interfaces":[{"interface":"back","average":{"1min":2.1669999999999998,"5min":1.8879999999999999,"15min":2.101},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":15.051,"5min":15.051,"15min":15.051},"last":0.35099999999999998},{"interface":"front","average":{"1min":2.2109999999999999,"5min":1.9350000000000001,"15min":2.1419999999999999},"min":{"1min":0.40300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":15.08,"5min":15.08,"15min":15.08},"last":0.377}]}]},{"osd":1,"up_from":13,"seq":55834575171,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3381964,"kb_used_data":2473092,"kb_used_omap":0,"kb_used_meta":908800,"kb_avail":90363188,"statfs":{"total":95995035648,"available":92531904512,"internally_reserved":0,"allocated":2532446208,"data_stored":2530755023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":930611200},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,1,5],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:55:25 2024","interfaces":[{"interface":"back","average":{"1min":1.887,"5min":0.72399999999999998,"15min":0.91100000000000003},"min":{"1min":0.26400000000000001,"5min":0.186,"15min":0.161},"max":{"1min":7.641,"5min":7.641,"15min":7.641},"last":1.7549999999999999},{"interface":"front","average":{"1min":2.3519999999999999,"5min":1.0880000000000001,"15min":1.1359999999999999},"min":{"1min":0.20999999999999999,"5min":0.19500000000000001,"15min":0.16400000000000001},"max":{"1min":14.493,"5min":14.493,"15min":14.493},"last":0.37}]},{"osd":2,"last update":"Mon Feb 19 21:55:21 2024","interfaces":[{"interface":"back","average":{"1min":2.081,"5min":0.78400000000000003,"15min":0.98199999999999998},"min":{"1min":0.19600000000000001,"5min":0.189,"15min":0.189},"max":{"1min":10.776999999999999,"5min":10.776999999999999,"15min":10.776999999999999},"last":8.1039999999999992},{"interface":"front","average":{"1min":2.694,"5min":1.159,"15min":1.0609999999999999},"min":{"1min":0.214,"5min":0.20699999999999999,"15min":0.20399999999999999},"max":{"1min":19.199000000000002,"5min":19.199000000000002,"15min":19.199000000000002},"last":11.042}]},{"osd":3,"last update":"Mon Feb 19 21:55:25 2024","interfaces":[{"interface":"back","average":{"1min":3.5750000000000002,"5min":1.3360000000000001,"15min":1.2050000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":19.297999999999998,"5min":19.297999999999998,"15min":19.297999999999998},"last":4.8819999999999997},{"interface":"front","average":{"1min":2.0209999999999999,"5min":0.93400000000000005,"15min":1.117},"min":{"1min":0.26700000000000002,"5min":0.255,"15min":0.215},"max":{"1min":13.029999999999999,"5min":13.029999999999999,"15min":13.029999999999999},"last":1.6859999999999999}]},{"osd":4,"last update":"Mon Feb 19 21:55:44 2024","interfaces":[{"interface":"back","average":{"1min":3.0049999999999999,"5min":1.444,"15min":1.603},"min":{"1min":0.39600000000000002,"5min":0.30499999999999999,"15min":0.251},"max":{"1min":19.742000000000001,"5min":19.742000000000001,"15min":19.742000000000001},"last":1.712},{"interface":"front","average":{"1min":3.383,"5min":1.6859999999999999,"15min":1.6020000000000001},"min":{"1min":0.32000000000000001,"5min":0.28100000000000003,"15min":0.26500000000000001},"max":{"1min":19.331,"5min":19.331,"15min":19.331},"last":3.056}]},{"osd":5,"last update":"Mon Feb 19 21:56:12 2024","interfaces":[{"interface":"back","average":{"1min":1.8340000000000001,"5min":1.4670000000000001,"15min":1.587},"min":{"1min":0.30599999999999999,"5min":0.29599999999999999,"15min":0.27900000000000003},"max":{"1min":7.649,"5min":7.649,"15min":14.331},"last":3.0779999999999998},{"interface":"front","average":{"1min":1.752,"5min":1.6160000000000001,"15min":1.6299999999999999},"min":{"1min":0.32200000000000001,"5min":0.313,"15min":0.307},"max":{"1min":7.3540000000000001,"5min":19.388000000000002,"15min":19.388000000000002},"last":0.54600000000000004}]},{"osd":6,"last update":"Mon Feb 19 21:55:44 2024","interfaces":[{"interface":"back","average":{"1min":2.3799999999999999,"5min":1.26,"15min":1.6140000000000001},"min":{"1min":0.35899999999999999,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":6.6859999999999999,"5min":6.6859999999999999,"15min":11.638999999999999},"last":1.7310000000000001},{"interface":"front","average":{"1min":3.488,"5min":1.5469999999999999,"15min":1.8120000000000001},"min":{"1min":0.36599999999999999,"5min":0.32400000000000001,"15min":0.29699999999999999},"max":{"1min":19.359000000000002,"5min":19.359000000000002,"15min":19.359000000000002},"last":0.56999999999999995}]},{"osd":7,"last update":"Mon Feb 19 21:56:10 2024","interfaces":[{"interface":"back","average":{"1min":2.1469999999999998,"5min":1.5760000000000001,"15min":1.7809999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":7.3099999999999996,"5min":19.681999999999999,"15min":19.681999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":2.298,"5min":1.492,"15min":1.7370000000000001},"min":{"1min":0.434,"5min":0.373,"15min":0.32600000000000001},"max":{"1min":6.5419999999999998,"5min":19.774000000000001,"15min":19.774000000000001},"last":2.645}]}]},{"osd":0,"up_from":8,"seq":34359738698,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2419772,"kb_used_data":1529396,"kb_used_omap":0,"kb_used_meta":890304,"kb_avail":91325380,"statfs":{"total":95995035648,"available":93517189120,"internally_reserved":0,"allocated":1566101504,"data_stored":1564425938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":911671296},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:56:18 2024","interfaces":[{"interface":"back","average":{"1min":2.9169999999999998,"5min":1.2769999999999999,"15min":0.92900000000000005},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.153},"max":{"1min":16.844999999999999,"5min":16.844999999999999,"15min":16.844999999999999},"last":0.435},{"interface":"front","average":{"1min":1.224,"5min":1.2989999999999999,"15min":1.0549999999999999},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":3.5939999999999999,"5min":7.1669999999999998,"15min":7.1669999999999998},"last":0.16500000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:56:18 2024","interfaces":[{"interface":"back","average":{"1min":2.121,"5min":1.3460000000000001,"15min":0.872},"min":{"1min":0.218,"5min":0.218,"15min":0.20300000000000001},"max":{"1min":4.8239999999999998,"5min":6.4640000000000004,"15min":6.4640000000000004},"last":0.51300000000000001},{"interface":"front","average":{"1min":2.0270000000000001,"5min":1.1699999999999999,"15min":1.125},"min":{"1min":0.27300000000000002,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":6.2450000000000001,"5min":6.2450000000000001,"15min":8.9960000000000004},"last":2.452}]},{"osd":3,"last update":"Mon Feb 19 21:56:05 2024","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":1.083,"15min":1.135},"min":{"1min":0.27800000000000002,"5min":0.26400000000000001,"15min":0.21299999999999999},"max":{"1min":4.641,"5min":9.3010000000000002,"15min":12.691000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":2.665,"5min":1.1930000000000001,"15min":1.0089999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.23400000000000001},"max":{"1min":9.1530000000000005,"5min":9.1530000000000005,"15min":9.1530000000000005},"last":1.1100000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:55:51 2024","interfaces":[{"interface":"back","average":{"1min":2.145,"5min":1.2869999999999999,"15min":1.599},"min":{"1min":0.36199999999999999,"5min":0.29399999999999998,"15min":0.252},"max":{"1min":5.2050000000000001,"5min":7.298,"15min":13.278},"last":1.5569999999999999},{"interface":"front","average":{"1min":2.431,"5min":1.3160000000000001,"15min":1.506},"min":{"1min":0.36099999999999999,"5min":0.32500000000000001,"15min":0.28999999999999998},"max":{"1min":5.7679999999999998,"5min":7.3079999999999998,"15min":10.109},"last":1.5640000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:56:05 2024","interfaces":[{"interface":"back","average":{"1min":1.6870000000000001,"5min":1.3420000000000001,"15min":1.7110000000000001},"min":{"1min":0.34300000000000003,"5min":0.318,"15min":0.27600000000000002},"max":{"1min":4.9500000000000002,"5min":7.2089999999999996,"15min":25.442},"last":3.8250000000000002},{"interface":"front","average":{"1min":1.629,"5min":1.3640000000000001,"15min":1.8},"min":{"1min":0.33500000000000002,"5min":0.317,"15min":0.27300000000000002},"max":{"1min":6.5419999999999998,"5min":6.5839999999999996,"15min":25.411999999999999},"last":3.8359999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:56:23 2024","interfaces":[{"interface":"back","average":{"1min":2.117,"5min":1.665,"15min":1.5569999999999999},"min":{"1min":0.34399999999999997,"5min":0.33300000000000002,"15min":0.27000000000000002},"max":{"1min":8.7189999999999994,"5min":12.364000000000001,"15min":12.364000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":3.1459999999999999,"5min":2.012,"15min":1.8600000000000001},"min":{"1min":0.34999999999999998,"5min":0.30099999999999999,"15min":0.29599999999999999},"max":{"1min":8.7249999999999996,"5min":11.269,"15min":13.289999999999999},"last":2.802}]},{"osd":7,"last update":"Mon Feb 19 21:56:01 2024","interfaces":[{"interface":"back","average":{"1min":3.7400000000000002,"5min":1.8129999999999999,"15min":1.7949999999999999},"min":{"1min":0.44900000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":14.651999999999999,"5min":14.651999999999999,"15min":15.688000000000001},"last":5.3109999999999999},{"interface":"front","average":{"1min":4.1150000000000002,"5min":1.859,"15min":1.7070000000000001},"min":{"1min":0.45700000000000002,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":14.592000000000001,"5min":14.592000000000001,"15min":14.592000000000001},"last":5.2919999999999998}]}]},{"osd":2,"up_from":394,"seq":1692217114711,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2206384,"kb_used_data":1894568,"kb_used_omap":0,"kb_used_meta":311743,"kb_avail":91538768,"statfs":{"total":95995035648,"available":93735698432,"internally_reserved":0,"allocated":1940037632,"data_stored":1938374104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":319224884},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:56:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":0.96499999999999997,"15min":1.0580000000000001},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":4.2649999999999997,"5min":9.2629999999999999,"15min":9.2629999999999999},"last":0.224},{"interface":"front","average":{"1min":1.5660000000000001,"5min":0.91000000000000003,"15min":1.0640000000000001},"min":{"1min":0.21099999999999999,"5min":0.189,"15min":0.189},"max":{"1min":7.585,"5min":7.585,"15min":7.585},"last":0.21099999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:56:20 2024","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":0.89400000000000002,"15min":0.69399999999999995},"min":{"1min":0.20599999999999999,"5min":0.193,"15min":0.193},"max":{"1min":6.915,"5min":6.915,"15min":6.915},"last":0.40300000000000002},{"interface":"front","average":{"1min":1.262,"5min":0.92900000000000005,"15min":0.93100000000000005},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":4.4969999999999999,"5min":4.9349999999999996,"15min":6.992},"last":0.32300000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:56:20 2024","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":0.94699999999999995,"15min":1.238},"min":{"1min":0.254,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":6.9029999999999996,"5min":6.9029999999999996,"15min":6.9470000000000001},"last":0.372},{"interface":"front","average":{"1min":1.903,"5min":1.0780000000000001,"15min":1.173},"min":{"1min":0.26400000000000001,"5min":0.247,"15min":0.247},"max":{"1min":13.537000000000001,"5min":13.537000000000001,"15min":13.537000000000001},"last":0.34999999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:56:20 2024","interfaces":[{"interface":"back","average":{"1min":2.0150000000000001,"5min":1.423,"15min":1.8160000000000001},"min":{"1min":0.28899999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":6.8540000000000001,"5min":8.843,"15min":8.843},"last":1.792},{"interface":"front","average":{"1min":2.5790000000000002,"5min":1.5900000000000001,"15min":1.7569999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.26500000000000001},"max":{"1min":13.077999999999999,"5min":13.077999999999999,"15min":13.077999999999999},"last":0.499}]},{"osd":5,"last update":"Mon Feb 19 21:56:20 2024","interfaces":[{"interface":"back","average":{"1min":2.8559999999999999,"5min":1.9059999999999999,"15min":1.794},"min":{"1min":0.318,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":10.179,"5min":11.129,"15min":11.129},"last":1.6120000000000001},{"interface":"front","average":{"1min":1.829,"5min":1.242,"15min":1.548},"min":{"1min":0.29899999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":7.4749999999999996,"5min":7.4749999999999996,"15min":13.558},"last":0.29899999999999999}]},{"osd":6,"last update":"Mon Feb 19 21:56:20 2024","interfaces":[{"interface":"back","average":{"1min":2.2290000000000001,"5min":1.8340000000000001,"15min":1.7150000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":7.5060000000000002,"5min":9.6720000000000006,"15min":9.6720000000000006},"last":2.343},{"interface":"front","average":{"1min":2.1549999999999998,"5min":1.6419999999999999,"15min":1.2190000000000001},"min":{"1min":0.34000000000000002,"5min":0.312,"15min":0.312},"max":{"1min":6.8239999999999998,"5min":8.3629999999999995,"15min":8.3629999999999995},"last":0.34000000000000002}]},{"osd":7,"last update":"Mon Feb 19 21:56:20 2024","interfaces":[{"interface":"back","average":{"1min":1.8440000000000001,"5min":1.5229999999999999,"15min":1.45},"min":{"1min":0.34100000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":7.5350000000000001,"5min":7.5350000000000001,"15min":7.5350000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":1.9319999999999999,"5min":1.7150000000000001,"15min":1.113},"min":{"1min":0.42499999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":6.8890000000000002,"5min":8.7780000000000005,"15min":8.7780000000000005},"last":0.42499999999999999}]}]},{"osd":3,"up_from":26,"seq":111669150009,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":593608,"kb_used_data":284096,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93151544,"statfs":{"total":95995035648,"available":95387181056,"internally_reserved":0,"allocated":290914304,"data_stored":289290018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:55:19 2024","interfaces":[{"interface":"back","average":{"1min":2.141,"5min":0.91600000000000004,"15min":1.0429999999999999},"min":{"1min":0.27300000000000002,"5min":0.21199999999999999,"15min":0.17399999999999999},"max":{"1min":7.2699999999999996,"5min":7.2699999999999996,"15min":8.8529999999999998},"last":3.4049999999999998},{"interface":"front","average":{"1min":2.9380000000000002,"5min":1.083,"15min":1.2649999999999999},"min":{"1min":0.26400000000000001,"5min":0.23899999999999999,"15min":0.187},"max":{"1min":12.525,"5min":12.525,"15min":12.525},"last":3.2690000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:55:19 2024","interfaces":[{"interface":"back","average":{"1min":11.167999999999999,"5min":2.6629999999999998,"15min":1.736},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.18099999999999999},"max":{"1min":178.30000000000001,"5min":178.30000000000001,"15min":178.30000000000001},"last":1.427},{"interface":"front","average":{"1min":1.859,"5min":0.75800000000000001,"15min":1.1599999999999999},"min":{"1min":0.27300000000000002,"5min":0.186,"15min":0.186},"max":{"1min":4.9489999999999998,"5min":4.9489999999999998,"15min":62.631},"last":4.1959999999999997}]},{"osd":2,"last update":"Mon Feb 19 21:55:19 2024","interfaces":[{"interface":"back","average":{"1min":2.1739999999999999,"5min":1.2150000000000001,"15min":0.93500000000000005},"min":{"1min":0.25,"5min":0.216,"15min":0.216},"max":{"1min":7.1120000000000001,"5min":32.323999999999998,"15min":32.323999999999998},"last":5.7519999999999998},{"interface":"front","average":{"1min":2.407,"5min":1.294,"15min":1.498},"min":{"1min":0.29699999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":12.449,"5min":32.103999999999999,"15min":32.103999999999999},"last":1.593}]},{"osd":4,"last update":"Mon Feb 19 21:55:51 2024","interfaces":[{"interface":"back","average":{"1min":3.1019999999999999,"5min":1.2989999999999999,"15min":1.3260000000000001},"min":{"1min":0.308,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":15.646000000000001,"5min":15.646000000000001,"15min":15.646000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":2.6869999999999998,"5min":1.341,"15min":1.4399999999999999},"min":{"1min":0.40500000000000003,"5min":0.33500000000000002,"15min":0.26700000000000002},"max":{"1min":10.285,"5min":10.285,"15min":10.285},"last":3.5099999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:56:02 2024","interfaces":[{"interface":"back","average":{"1min":2.8610000000000002,"5min":1.3180000000000001,"15min":1.5369999999999999},"min":{"1min":0.33900000000000002,"5min":0.32100000000000001,"15min":0.29099999999999998},"max":{"1min":15.704000000000001,"5min":15.704000000000001,"15min":15.704000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":3.1389999999999998,"5min":1.6599999999999999,"15min":1.643},"min":{"1min":0.53000000000000003,"5min":0.31,"15min":0.30299999999999999},"max":{"1min":11.465,"5min":11.465,"15min":12.635},"last":3.5459999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:55:30 2024","interfaces":[{"interface":"back","average":{"1min":2.5249999999999999,"5min":1.472,"15min":1.583},"min":{"1min":0.441,"5min":0.36799999999999999,"15min":0.309},"max":{"1min":6.1509999999999998,"5min":22.759,"15min":22.759},"last":1.2589999999999999},{"interface":"front","average":{"1min":2.375,"5min":1.534,"15min":1.609},"min":{"1min":0.38500000000000001,"5min":0.34100000000000003,"15min":0.29099999999999998},"max":{"1min":7.3470000000000004,"5min":22.608000000000001,"15min":22.608000000000001},"last":3.6040000000000001}]},{"osd":7,"last update":"Mon Feb 19 21:55:51 2024","interfaces":[{"interface":"back","average":{"1min":2.657,"5min":1.6399999999999999,"15min":1.696},"min":{"1min":0.48999999999999999,"5min":0.34399999999999997,"15min":0.28599999999999998},"max":{"1min":10.286,"5min":12.494,"15min":12.494},"last":1.4059999999999999},{"interface":"front","average":{"1min":3.3650000000000002,"5min":1.4490000000000001,"15min":1.478},"min":{"1min":0.502,"5min":0.40400000000000003,"15min":0.34599999999999997},"max":{"1min":15.749000000000001,"5min":15.749000000000001,"15min":15.749000000000001},"last":0.70999999999999996}]}]},{"osd":4,"up_from":32,"seq":137438953778,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2287924,"kb_used_data":1391980,"kb_used_omap":0,"kb_used_meta":895936,"kb_avail":91457228,"statfs":{"total":95995035648,"available":93652201472,"internally_reserved":0,"allocated":1425387520,"data_stored":1423719218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":917438464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:55:38 2024","interfaces":[{"interface":"back","average":{"1min":2.4870000000000001,"5min":1.458,"15min":1.7430000000000001},"min":{"1min":0.23000000000000001,"5min":0.221,"15min":0.219},"max":{"1min":9.8800000000000008,"5min":10.173,"15min":53.936},"last":4.3789999999999996},{"interface":"front","average":{"1min":3.0129999999999999,"5min":1.4710000000000001,"15min":1.806},"min":{"1min":0.26800000000000002,"5min":0.252,"15min":0.23000000000000001},"max":{"1min":11.683999999999999,"5min":11.683999999999999,"15min":54.405999999999999},"last":3.8849999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:55:38 2024","interfaces":[{"interface":"back","average":{"1min":3.5870000000000002,"5min":3.6459999999999999,"15min":2.569},"min":{"1min":0.25600000000000001,"5min":0.23799999999999999,"15min":0.21199999999999999},"max":{"1min":10.233000000000001,"5min":156.72999999999999,"15min":156.72999999999999},"last":4.4029999999999996},{"interface":"front","average":{"1min":3.3159999999999998,"5min":3.391,"15min":2.351},"min":{"1min":0.38900000000000001,"5min":0.28299999999999997,"15min":0.25},"max":{"1min":10.217000000000001,"5min":156.83000000000001,"15min":156.83000000000001},"last":3.903}]},{"osd":2,"last update":"Mon Feb 19 21:56:19 2024","interfaces":[{"interface":"back","average":{"1min":2.9430000000000001,"5min":2.0670000000000002,"15min":1.9710000000000001},"min":{"1min":0.316,"5min":0.255,"15min":0.255},"max":{"1min":9.7690000000000001,"5min":12.516999999999999,"15min":12.516999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":2.9689999999999999,"5min":2.1070000000000002,"15min":2.0089999999999999},"min":{"1min":0.34300000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":9.7850000000000001,"5min":12.541,"15min":12.541},"last":0.44800000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:55:38 2024","interfaces":[{"interface":"back","average":{"1min":1.587,"5min":1.149,"15min":1.516},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":9.1850000000000005,"5min":9.9529999999999994,"15min":10.970000000000001},"last":3.5760000000000001},{"interface":"front","average":{"1min":3.1349999999999998,"5min":1.645,"15min":1.7410000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.26900000000000002},"max":{"1min":9.8070000000000004,"5min":12.486000000000001,"15min":12.486000000000001},"last":4.3449999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:55:31 2024","interfaces":[{"interface":"back","average":{"1min":2.7519999999999998,"5min":1.831,"15min":2.0539999999999998},"min":{"1min":0.29199999999999998,"5min":0.23999999999999999,"15min":0.23400000000000001},"max":{"1min":10.278,"5min":13.458,"15min":18.916},"last":0.375},{"interface":"front","average":{"1min":2.4550000000000001,"5min":1.5620000000000001,"15min":2.1789999999999998},"min":{"1min":0.309,"5min":0.29599999999999999,"15min":0.253},"max":{"1min":9.2560000000000002,"5min":14.532999999999999,"15min":14.840999999999999},"last":0.38700000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:55:38 2024","interfaces":[{"interface":"back","average":{"1min":2.1909999999999998,"5min":1.6579999999999999,"15min":1.7849999999999999},"min":{"1min":0.28100000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":9.2119999999999997,"5min":10.233000000000001,"15min":10.622999999999999},"last":3.6400000000000001},{"interface":"front","average":{"1min":4.3209999999999997,"5min":1.964,"15min":2.202},"min":{"1min":0.318,"5min":0.27300000000000002,"15min":0.23699999999999999},"max":{"1min":12.85,"5min":13.433999999999999,"15min":18.670000000000002},"last":3.851}]},{"osd":7,"last update":"Mon Feb 19 21:56:12 2024","interfaces":[{"interface":"back","average":{"1min":2.9910000000000001,"5min":1.873,"15min":2.1040000000000001},"min":{"1min":0.36599999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":10.250999999999999,"5min":13.398,"15min":16.763999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":2.2829999999999999,"5min":1.617,"15min":1.802},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":9.2349999999999994,"5min":12.958,"15min":12.958},"last":0.35499999999999998}]}]},{"osd":5,"up_from":38,"seq":163208757550,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1984484,"kb_used_data":1098076,"kb_used_omap":0,"kb_used_meta":886336,"kb_avail":91760668,"statfs":{"total":95995035648,"available":93962924032,"internally_reserved":0,"allocated":1124429824,"data_stored":1122777895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":907608064},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.669,"5min":1.3999999999999999,"15min":1.669},"min":{"1min":0.221,"5min":0.221,"15min":0.20599999999999999},"max":{"1min":4.6289999999999996,"5min":10.534000000000001,"15min":19.236000000000001},"last":4.9669999999999996},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.1080000000000001,"15min":1.7370000000000001},"min":{"1min":0.246,"5min":0.23699999999999999,"15min":0.20899999999999999},"max":{"1min":5.9889999999999999,"5min":6.5449999999999999,"15min":13.241},"last":0.315}]},{"osd":1,"last update":"Mon Feb 19 21:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.546,"5min":1.147,"15min":1.6859999999999999},"min":{"1min":0.27500000000000002,"5min":0.246,"15min":0.23100000000000001},"max":{"1min":5.9610000000000003,"5min":6.625,"15min":10.42},"last":0.371},{"interface":"front","average":{"1min":1.611,"5min":1.262,"15min":1.4870000000000001},"min":{"1min":0.28799999999999998,"5min":0.249,"15min":0.23000000000000001},"max":{"1min":4.5229999999999997,"5min":11.654,"15min":11.654},"last":0.95299999999999996}]},{"osd":2,"last update":"Mon Feb 19 21:55:19 2024","interfaces":[{"interface":"back","average":{"1min":5.4340000000000002,"5min":2.5569999999999999,"15min":1.7829999999999999},"min":{"1min":0.33900000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":79.257000000000005,"5min":79.257000000000005,"15min":79.257000000000005},"last":4.9349999999999996},{"interface":"front","average":{"1min":8.6530000000000005,"5min":3.0139999999999998,"15min":1.8799999999999999},"min":{"1min":0.40600000000000003,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":79.030000000000001,"5min":79.030000000000001,"15min":79.030000000000001},"last":0.34499999999999997}]},{"osd":3,"last update":"Mon Feb 19 21:55:19 2024","interfaces":[{"interface":"back","average":{"1min":2.0790000000000002,"5min":1.5649999999999999,"15min":1.9330000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.24099999999999999},"max":{"1min":5.6600000000000001,"5min":10.561,"15min":19.321000000000002},"last":4.9950000000000001},{"interface":"front","average":{"1min":1.865,"5min":1.369,"15min":1.873},"min":{"1min":0.33800000000000002,"5min":0.31900000000000001,"15min":0.29499999999999998},"max":{"1min":6.0259999999999998,"5min":6.577,"15min":9.5150000000000006},"last":4.673}]},{"osd":4,"last update":"Mon Feb 19 21:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.3520000000000001,"15min":1.6160000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.20899999999999999},"max":{"1min":8.4730000000000008,"5min":12.228,"15min":21.577000000000002},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.6000000000000001,"5min":1.47,"15min":2.0880000000000001},"min":{"1min":0.30199999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":4.71,"5min":10.586,"15min":19.274000000000001},"last":5.96}]},{"osd":6,"last update":"Mon Feb 19 21:55:42 2024","interfaces":[{"interface":"back","average":{"1min":2.3540000000000001,"5min":1.897,"15min":2.254},"min":{"1min":0.316,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":9.3930000000000007,"5min":10.611000000000001,"15min":19.884},"last":8.0139999999999993},{"interface":"front","average":{"1min":2.0680000000000001,"5min":1.4590000000000001,"15min":1.964},"min":{"1min":0.32100000000000001,"5min":0.29099999999999998,"15min":0.26700000000000002},"max":{"1min":9.8320000000000007,"5min":9.8320000000000007,"15min":13.532999999999999},"last":0.41799999999999998}]},{"osd":7,"last update":"Mon Feb 19 21:56:05 2024","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":1.607,"15min":2.1469999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.27100000000000002},"max":{"1min":7.1509999999999998,"5min":8.6590000000000007,"15min":12.962},"last":0.39100000000000001},{"interface":"front","average":{"1min":2.1299999999999999,"5min":1.732,"15min":2.0339999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.221},"max":{"1min":8.2219999999999995,"5min":11.617000000000001,"15min":15.593999999999999},"last":0.92100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":1722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1553858560,"data_stored":1553858560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2519728128,"data_stored":2519728128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1922830336,"data_stored":1922826264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":285605888,"data_stored":285605888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1403129856,"data_stored":1403125784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1108934656,"data_stored":1108934656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2523860992,"data_stored":2523856920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1830027264,"data_stored":1830027264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:56:28.645 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool set unique_pool_4 pgp_num 16 2024-02-19T21:56:29.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:27.302537+0000 mgr.y (mgr.14514) 913 : cluster [DBG] pgmap v1180: 138 pgs: 138 active+clean; 3.9 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.01k op/s 2024-02-19T21:56:29.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:27.302537+0000 mgr.y (mgr.14514) 913 : cluster [DBG] pgmap v1180: 138 pgs: 138 active+clean; 3.9 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.01k op/s 2024-02-19T21:56:29.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:27.302537+0000 mgr.y (mgr.14514) 913 : cluster [DBG] pgmap v1180: 138 pgs: 138 active+clean; 3.9 GiB data, 18 GiB used, 698 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.01k op/s 2024-02-19T21:56:30.012 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:56:30.015 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:30.015 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:56:30.116 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:56:30.175 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:31.095 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:56:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:56:30] "GET /metrics HTTP/1.1" 200 176825 "" "Prometheus/2.33.4" 2024-02-19T21:56:31.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:29.302995+0000 mgr.y (mgr.14514) 914 : cluster [DBG] pgmap v1181: 138 pgs: 138 active+clean; 3.9 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 884 B/s rd, 0 B/s wr, 871 op/s 2024-02-19T21:56:31.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:29.750596+0000 osd.4 (osd.4) 251 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:56:31.099 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:29.750648+0000 osd.4 (osd.4) 252 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:56:31.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:29.842916+0000 mon.a (mon.0) 2006 : cluster [DBG] osdmap e541: 8 total, 8 up, 8 in 2024-02-19T21:56:31.100 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:30.444446+0000 mon.a (mon.0) 2007 : cluster [DBG] osdmap e542: 8 total, 8 up, 8 in 2024-02-19T21:56:31.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:29.302995+0000 mgr.y (mgr.14514) 914 : cluster [DBG] pgmap v1181: 138 pgs: 138 active+clean; 3.9 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 884 B/s rd, 0 B/s wr, 871 op/s 2024-02-19T21:56:31.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:29.750596+0000 osd.4 (osd.4) 251 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:56:31.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:29.750648+0000 osd.4 (osd.4) 252 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:56:31.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:29.842916+0000 mon.a (mon.0) 2006 : cluster [DBG] osdmap e541: 8 total, 8 up, 8 in 2024-02-19T21:56:31.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:30.444446+0000 mon.a (mon.0) 2007 : cluster [DBG] osdmap e542: 8 total, 8 up, 8 in 2024-02-19T21:56:31.305 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:29.302995+0000 mgr.y (mgr.14514) 914 : cluster [DBG] pgmap v1181: 138 pgs: 138 active+clean; 3.9 GiB data, 17 GiB used, 698 GiB / 715 GiB avail; 884 B/s rd, 0 B/s wr, 871 op/s 2024-02-19T21:56:31.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:29.750596+0000 osd.4 (osd.4) 251 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:56:31.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:29.750648+0000 osd.4 (osd.4) 252 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:56:31.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:29.842916+0000 mon.a (mon.0) 2006 : cluster [DBG] osdmap e541: 8 total, 8 up, 8 in 2024-02-19T21:56:31.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:30.444446+0000 mon.a (mon.0) 2007 : cluster [DBG] osdmap e542: 8 total, 8 up, 8 in 2024-02-19T21:56:31.807 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:56:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:56:31.901 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-02-19T21:56:32.146 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:56:32.154 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:32.154 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:30.898897+0000 mon.c (mon.2) 132 : audit [INF] from='client.? 172.21.15.80:0/566356198' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:56:32.154 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:30.901943+0000 mon.a (mon.0) 2008 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:56:32.155 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:30.898897+0000 mon.c (mon.2) 132 : audit [INF] from='client.? 172.21.15.80:0/566356198' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:56:32.155 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:30.901943+0000 mon.a (mon.0) 2008 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:56:32.156 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:56:32.256 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:56:32.303 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:30.898897+0000 mon.c (mon.2) 132 : audit [INF] from='client.? 172.21.15.80:0/566356198' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:56:32.303 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:30.901943+0000 mon.a (mon.0) 2008 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:56:32.305 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:32.349 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:56:32.354 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:32.355 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:56:32.456 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:56:32.510 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:32.540 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:56:32.544 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:32.544 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:56:32.645 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:56:32.687 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:32.977 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:56:32.987 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:32.987 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:56:33.088 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:56:33.136 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:31.303369+0000 mgr.y (mgr.14514) 915 : cluster [DBG] pgmap v1184: 138 pgs: 138 active+clean; 3.6 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.23k op/s 2024-02-19T21:56:33.136 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:31.363703+0000 mgr.y (mgr.14514) 916 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:56:33.136 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:31.849526+0000 mon.a (mon.0) 2009 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:56:33.136 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:31.869803+0000 mon.a (mon.0) 2010 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:56:33.136 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:31.869866+0000 mon.a (mon.0) 2011 : cluster [DBG] osdmap e543: 8 total, 8 up, 8 in 2024-02-19T21:56:33.136 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:31.893901+0000 osd.2 (osd.2) 61 : cluster [DBG] 2.1 scrub starts 2024-02-19T21:56:33.136 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:31.899735+0000 osd.2 (osd.2) 62 : cluster [DBG] 2.1 scrub ok 2024-02-19T21:56:33.140 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:33.167 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:56:33.171 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:33.172 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:56:33.175 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:31.303369+0000 mgr.y (mgr.14514) 915 : cluster [DBG] pgmap v1184: 138 pgs: 138 active+clean; 3.6 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.23k op/s 2024-02-19T21:56:33.175 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:31.363703+0000 mgr.y (mgr.14514) 916 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:56:33.176 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:31.849526+0000 mon.a (mon.0) 2009 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:56:33.176 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:31.869803+0000 mon.a (mon.0) 2010 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:56:33.176 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:31.869866+0000 mon.a (mon.0) 2011 : cluster [DBG] osdmap e543: 8 total, 8 up, 8 in 2024-02-19T21:56:33.176 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:31.893901+0000 osd.2 (osd.2) 61 : cluster [DBG] 2.1 scrub starts 2024-02-19T21:56:33.176 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:31.899735+0000 osd.2 (osd.2) 62 : cluster [DBG] 2.1 scrub ok 2024-02-19T21:56:33.176 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:31.303369+0000 mgr.y (mgr.14514) 915 : cluster [DBG] pgmap v1184: 138 pgs: 138 active+clean; 3.6 GiB data, 17 GiB used, 699 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.23k op/s 2024-02-19T21:56:33.176 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:31.363703+0000 mgr.y (mgr.14514) 916 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:56:33.176 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:31.849526+0000 mon.a (mon.0) 2009 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:56:33.177 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:31.869803+0000 mon.a (mon.0) 2010 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:56:33.177 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:31.869866+0000 mon.a (mon.0) 2011 : cluster [DBG] osdmap e543: 8 total, 8 up, 8 in 2024-02-19T21:56:33.177 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:31.893901+0000 osd.2 (osd.2) 61 : cluster [DBG] 2.1 scrub starts 2024-02-19T21:56:33.177 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:31.899735+0000 osd.2 (osd.2) 62 : cluster [DBG] 2.1 scrub ok 2024-02-19T21:56:33.272 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:56:33.324 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:33.364 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:56:33.373 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:33.374 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:56:33.475 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:56:33.529 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:33.614 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:56:33.620 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:33.620 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:56:33.722 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:56:33.776 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:33.840 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:56:33.844 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:33.844 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:56:33.945 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:56:34.000 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:34.038 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:56:34.045 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:34.046 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:56:34.048 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:56:34.061 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:56:34.095 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:32.721025+0000 osd.7 (osd.7) 297 : cluster [DBG] 11.5 scrub starts 2024-02-19T21:56:34.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:32.721025+0000 osd.7 (osd.7) 297 : cluster [DBG] 11.5 scrub starts 2024-02-19T21:56:34.096 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:56:34.118 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:56:34.146 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:56:34.163 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:56:34.179 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:32.721025+0000 osd.7 (osd.7) 297 : cluster [DBG] 11.5 scrub starts 2024-02-19T21:56:34.182 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:34.198 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:56:34.208 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:56:34.211 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:34.212 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:56:34.230 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:56:34.265 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:56:34.298 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:56:34.313 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:56:34.344 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:56:34.353 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:34.360 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'true' 2024-02-19T21:56:34.360 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:56:34.360 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:56:34.360 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:56:34.360 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:56:34.360 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:56:34.360 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:56:34.360 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:56:34.381 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:56:34.384 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:34.384 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:56:34.485 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:56:34.548 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:35.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:33.303820+0000 mgr.y (mgr.14514) 917 : cluster [DBG] pgmap v1186: 138 pgs: 138 active+clean; 3.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 989 op/s 2024-02-19T21:56:35.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:33.781068+0000 osd.0 (osd.0) 315 : cluster [DBG] 11.6 scrub starts 2024-02-19T21:56:35.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:34.002553+0000 mon.a (mon.0) 2012 : audit [DBG] from='client.? 172.21.15.80:0/163692220' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:56:35.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:34.148915+0000 osd.7 (osd.7) 298 : cluster [DBG] 11.5 scrub ok 2024-02-19T21:56:35.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:33.303820+0000 mgr.y (mgr.14514) 917 : cluster [DBG] pgmap v1186: 138 pgs: 138 active+clean; 3.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 989 op/s 2024-02-19T21:56:35.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:33.781068+0000 osd.0 (osd.0) 315 : cluster [DBG] 11.6 scrub starts 2024-02-19T21:56:35.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:34.002553+0000 mon.a (mon.0) 2012 : audit [DBG] from='client.? 172.21.15.80:0/163692220' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:56:35.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:34.148915+0000 osd.7 (osd.7) 298 : cluster [DBG] 11.5 scrub ok 2024-02-19T21:56:35.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:33.303820+0000 mgr.y (mgr.14514) 917 : cluster [DBG] pgmap v1186: 138 pgs: 138 active+clean; 3.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 989 op/s 2024-02-19T21:56:35.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:33.781068+0000 osd.0 (osd.0) 315 : cluster [DBG] 11.6 scrub starts 2024-02-19T21:56:35.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:34.002553+0000 mon.a (mon.0) 2012 : audit [DBG] from='client.? 172.21.15.80:0/163692220' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:56:35.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:34.148915+0000 osd.7 (osd.7) 298 : cluster [DBG] 11.5 scrub ok 2024-02-19T21:56:35.761 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-19T21:56:36.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:56:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:56:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:56:36.211 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:56:36.216 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:36.217 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:56:36.318 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:56:36.386 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:36.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:35.240804+0000 osd.0 (osd.0) 316 : cluster [DBG] 11.6 scrub ok 2024-02-19T21:56:36.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:35.307103+0000 mgr.y (mgr.14514) 918 : cluster [DBG] pgmap v1187: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 3.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1.08k op/s 2024-02-19T21:56:36.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:35.448007+0000 mon.a (mon.0) 2013 : cluster [DBG] osdmap e544: 8 total, 8 up, 8 in 2024-02-19T21:56:36.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:35.755412+0000 osd.7 (osd.7) 299 : cluster [DBG] 5.14 scrub starts 2024-02-19T21:56:36.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:35.759847+0000 osd.7 (osd.7) 300 : cluster [DBG] 5.14 scrub ok 2024-02-19T21:56:36.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:35.240804+0000 osd.0 (osd.0) 316 : cluster [DBG] 11.6 scrub ok 2024-02-19T21:56:36.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:35.307103+0000 mgr.y (mgr.14514) 918 : cluster [DBG] pgmap v1187: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 3.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1.08k op/s 2024-02-19T21:56:36.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:35.448007+0000 mon.a (mon.0) 2013 : cluster [DBG] osdmap e544: 8 total, 8 up, 8 in 2024-02-19T21:56:36.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:35.755412+0000 osd.7 (osd.7) 299 : cluster [DBG] 5.14 scrub starts 2024-02-19T21:56:36.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:35.759847+0000 osd.7 (osd.7) 300 : cluster [DBG] 5.14 scrub ok 2024-02-19T21:56:36.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:35.240804+0000 osd.0 (osd.0) 316 : cluster [DBG] 11.6 scrub ok 2024-02-19T21:56:36.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:35.307103+0000 mgr.y (mgr.14514) 918 : cluster [DBG] pgmap v1187: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 3.5 GiB data, 16 GiB used, 699 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1.08k op/s 2024-02-19T21:56:36.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:35.448007+0000 mon.a (mon.0) 2013 : cluster [DBG] osdmap e544: 8 total, 8 up, 8 in 2024-02-19T21:56:36.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:35.755412+0000 osd.7 (osd.7) 299 : cluster [DBG] 5.14 scrub starts 2024-02-19T21:56:36.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:35.759847+0000 osd.7 (osd.7) 300 : cluster [DBG] 5.14 scrub ok 2024-02-19T21:56:36.849 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:56:36.858 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:36.859 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:56:36.960 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:56:37.013 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:37.282 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:56:37.286 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:37.286 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:56:37.387 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:56:37.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:35.625362+0000 osd.5 (osd.5) 313 : cluster [DBG] 5.f scrub starts 2024-02-19T21:56:37.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:35.641747+0000 osd.5 (osd.5) 314 : cluster [DBG] 5.f scrub ok 2024-02-19T21:56:37.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:35.775712+0000 osd.0 (osd.0) 317 : cluster [DBG] 4.16 scrub starts 2024-02-19T21:56:37.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:35.779074+0000 osd.0 (osd.0) 318 : cluster [DBG] 4.16 scrub ok 2024-02-19T21:56:37.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:35.851725+0000 osd.6 (osd.6) 287 : cluster [DBG] 11.3 scrub starts 2024-02-19T21:56:37.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:36.802216+0000 osd.2 (osd.2) 63 : cluster [DBG] 5.a scrub starts 2024-02-19T21:56:37.599 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:36.809676+0000 osd.2 (osd.2) 64 : cluster [DBG] 5.a scrub ok 2024-02-19T21:56:37.599 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:35.625362+0000 osd.5 (osd.5) 313 : cluster [DBG] 5.f scrub starts 2024-02-19T21:56:37.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:35.641747+0000 osd.5 (osd.5) 314 : cluster [DBG] 5.f scrub ok 2024-02-19T21:56:37.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:35.775712+0000 osd.0 (osd.0) 317 : cluster [DBG] 4.16 scrub starts 2024-02-19T21:56:37.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:35.779074+0000 osd.0 (osd.0) 318 : cluster [DBG] 4.16 scrub ok 2024-02-19T21:56:37.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:35.851725+0000 osd.6 (osd.6) 287 : cluster [DBG] 11.3 scrub starts 2024-02-19T21:56:37.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:36.802216+0000 osd.2 (osd.2) 63 : cluster [DBG] 5.a scrub starts 2024-02-19T21:56:37.600 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:36.809676+0000 osd.2 (osd.2) 64 : cluster [DBG] 5.a scrub ok 2024-02-19T21:56:37.680 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:56:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-02-19T21:56:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-02-19T21:56:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-02-19T21:56:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "MOSDPGPushReply(10.5 422/414 [PushReplyOp(10:a6bd2865:::benchmark_data_smithi080_153340_object84:head)])", 2024-02-19T21:56:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:19.214603+0000", 2024-02-19T21:56:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 378.46355012700002, 2024-02-19T21:56:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3320758279999998, 2024-02-19T21:56:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:56:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:56:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:56:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:56:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.214603+0000", 2024-02-19T21:56:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:56:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:56:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.214603+0000", 2024-02-19T21:56:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:56:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:56:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.214603+0000", 2024-02-19T21:56:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2960000000000001e-06 2024-02-19T21:56:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:56:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.214610+0000", 2024-02-19T21:56:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6269999999999995e-06 2024-02-19T21:56:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:56:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.214619+0000", 2024-02-19T21:56:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7320000000000001e-06 2024-02-19T21:56:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:56:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.214626+0000", 2024-02-19T21:56:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.311022989 2024-02-19T21:56:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.525649+0000", 2024-02-19T21:56:37.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021029994 2024-02-19T21:56:37.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:56:37.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.546679+0000", 2024-02-19T21:56:37.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3320758279999998 2024-02-19T21:56:37.684 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.684 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:37.684 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.684 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "MOSDPGPush(10.5 422/414 [PushOp(10:a9225f3a:::benchmark_data_smithi080_153340_object122:head, version: 392'8, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(10:a9225f3a:::benchmark_data_smithi080_153340_object122:head@392'8, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-02-19T21:56:37.684 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:19.967853+0000", 2024-02-19T21:56:37.684 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 377.71030014500002, 2024-02-19T21:56:37.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.356746711, 2024-02-19T21:56:37.685 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:56:37.685 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:56:37.685 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:56:37.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:56:37.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.967853+0000", 2024-02-19T21:56:37.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:56:37.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:56:37.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.967853+0000", 2024-02-19T21:56:37.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:56:37.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:56:37.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.967852+0000", 2024-02-19T21:56:37.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000105833 2024-02-19T21:56:37.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:56:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.967958+0000", 2024-02-19T21:56:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9928999999999998e-05 2024-02-19T21:56:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:56:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.967978+0000", 2024-02-19T21:56:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0701e-05 2024-02-19T21:56:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:56:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:19.967989+0000", 2024-02-19T21:56:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3380425790000001 2024-02-19T21:56:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.306031+0000", 2024-02-19T21:56:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053773899999999997 2024-02-19T21:56:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:56:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.306569+0000", 2024-02-19T21:56:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018030968000000001 2024-02-19T21:56:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:56:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:22.324600+0000", 2024-02-19T21:56:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.356746711 2024-02-19T21:56:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "MOSDPGPushReply(10.5 423/414 [PushReplyOp(10:a9225f3a:::benchmark_data_smithi080_153340_object122:head)])", 2024-02-19T21:56:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:24.735605+0000", 2024-02-19T21:56:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 372.94254820399999, 2024-02-19T21:56:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7245789189999998, 2024-02-19T21:56:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:56:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:56:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:56:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:56:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:24.735605+0000", 2024-02-19T21:56:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:56:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:56:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:24.735605+0000", 2024-02-19T21:56:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:56:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:56:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:24.735604+0000", 2024-02-19T21:56:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1189999999999999e-06 2024-02-19T21:56:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:56:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:24.735612+0000", 2024-02-19T21:56:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0118999999999999e-05 2024-02-19T21:56:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:56:37.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:24.735622+0000", 2024-02-19T21:56:37.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3629999999999999e-06 2024-02-19T21:56:37.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:56:37.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:24.735628+0000", 2024-02-19T21:56:37.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.703251786 2024-02-19T21:56:37.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:27.438880+0000", 2024-02-19T21:56:37.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021304416999999999 2024-02-19T21:56:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:56:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:27.460184+0000", 2024-02-19T21:56:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7245789189999998 2024-02-19T21:56:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "MOSDPGPushReply(10.5 424/414 [PushReplyOp(10:ad9f59d9:::benchmark_data_smithi080_153340_object132:head)])", 2024-02-19T21:56:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:26.048019+0000", 2024-02-19T21:56:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 371.63013475700001, 2024-02-19T21:56:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8187091569999998, 2024-02-19T21:56:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:56:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:56:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:56:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:56:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:26.048019+0000", 2024-02-19T21:56:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:56:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:56:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:26.048019+0000", 2024-02-19T21:56:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:56:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:56:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:26.048018+0000", 2024-02-19T21:56:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4859999999999999e-06 2024-02-19T21:56:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:56:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:26.048023+0000", 2024-02-19T21:56:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3839999999999999e-06 2024-02-19T21:56:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:56:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:26.048030+0000", 2024-02-19T21:56:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2399999999999998e-06 2024-02-19T21:56:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:56:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:26.048035+0000", 2024-02-19T21:56:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7975219770000002 2024-02-19T21:56:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:28.845557+0000", 2024-02-19T21:56:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021170510999999999 2024-02-19T21:56:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:56:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:28.866728+0000", 2024-02-19T21:56:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8187091569999998 2024-02-19T21:56:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:77494 10.5 10:afb0c4b2:::benchmark_data_smithi080_153340_object2744:head [delete] snapc 0=[] ondisk+write+known_if_redirected e432)", 2024-02-19T21:56:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:48.541104+0000", 2024-02-19T21:56:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 349.13704976399998, 2024-02-19T21:56:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.778750386, 2024-02-19T21:56:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:56:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:56:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:56:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:56:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:56:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 77494 2024-02-19T21:56:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:56:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:56:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:48.541104+0000", 2024-02-19T21:56:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:56:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:56:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:48.541104+0000", 2024-02-19T21:56:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:56:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:56:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:48.541102+0000", 2024-02-19T21:56:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4229999999999999e-06 2024-02-19T21:56:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:56:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:48.541109+0000", 2024-02-19T21:56:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2328e-05 2024-02-19T21:56:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:56:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:48.541122+0000", 2024-02-19T21:56:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3990000000000003e-06 2024-02-19T21:56:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:56:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:48.541127+0000", 2024-02-19T21:56:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.030766135 2024-02-19T21:56:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:48.571893+0000", 2024-02-19T21:56:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.005411674 2024-02-19T21:56:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for missing object", 2024-02-19T21:56:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:48.577305+0000", 2024-02-19T21:56:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.045243945000000001 2024-02-19T21:56:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:48.622549+0000", 2024-02-19T21:56:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.005086279 2024-02-19T21:56:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for rw locks", 2024-02-19T21:56:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:48.627635+0000", 2024-02-19T21:56:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5575577570000001 2024-02-19T21:56:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.185193+0000", 2024-02-19T21:56:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045951710000000003 2024-02-19T21:56:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:56:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.189788+0000", 2024-02-19T21:56:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010021159999999999 2024-02-19T21:56:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:56:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.199809+0000", 2024-02-19T21:56:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.052337702 2024-02-19T21:56:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.252147+0000", 2024-02-19T21:56:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00049766800000000005 2024-02-19T21:56:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:56:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.252645+0000", 2024-02-19T21:56:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.051576392999999998 2024-02-19T21:56:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.304221+0000", 2024-02-19T21:56:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025685259999999998 2024-02-19T21:56:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:56:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.306790+0000", 2024-02-19T21:56:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013064555 2024-02-19T21:56:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:56:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.319854+0000", 2024-02-19T21:56:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.778750386 2024-02-19T21:56:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:77570 10.5 10:abecb0ea:::benchmark_data_smithi080_153340_object2820:head [delete] snapc 0=[] ondisk+write+known_if_redirected e432)", 2024-02-19T21:56:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:49.007945+0000", 2024-02-19T21:56:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 348.670208355, 2024-02-19T21:56:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.745907044, 2024-02-19T21:56:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:56:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:56:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:56:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:56:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:56:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 77570 2024-02-19T21:56:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:56:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:56:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.007945+0000", 2024-02-19T21:56:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:56:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:56:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.007945+0000", 2024-02-19T21:56:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:56:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:56:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.007944+0000", 2024-02-19T21:56:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4420000000000001e-06 2024-02-19T21:56:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:56:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.007951+0000", 2024-02-19T21:56:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2391e-05 2024-02-19T21:56:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:56:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.007963+0000", 2024-02-19T21:56:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3690000000000001e-06 2024-02-19T21:56:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:56:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.007971+0000", 2024-02-19T21:56:37.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.105193511 2024-02-19T21:56:37.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.113164+0000", 2024-02-19T21:56:37.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.005510231 2024-02-19T21:56:37.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for missing object", 2024-02-19T21:56:37.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.118674+0000", 2024-02-19T21:56:37.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.030934554999999999 2024-02-19T21:56:37.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.149609+0000", 2024-02-19T21:56:37.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050755230000000002 2024-02-19T21:56:37.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for rw locks", 2024-02-19T21:56:37.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.154685+0000", 2024-02-19T21:56:37.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.553390212 2024-02-19T21:56:37.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.708075+0000", 2024-02-19T21:56:37.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046643919999999998 2024-02-19T21:56:37.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:56:37.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.712739+0000", 2024-02-19T21:56:37.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0095057930000000002 2024-02-19T21:56:37.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:56:37.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.722245+0000", 2024-02-19T21:56:37.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013143172 2024-02-19T21:56:37.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.735388+0000", 2024-02-19T21:56:37.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015347410000000001 2024-02-19T21:56:37.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.736923+0000", 2024-02-19T21:56:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00052146699999999996 2024-02-19T21:56:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:56:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.737444+0000", 2024-02-19T21:56:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029017280000000001 2024-02-19T21:56:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:56:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.740346+0000", 2024-02-19T21:56:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013506123 2024-02-19T21:56:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.710 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:56:37.710 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.753852+0000", 2024-02-19T21:56:37.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.745907044 2024-02-19T21:56:37.710 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.710 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:37.710 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.710 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:77593 10.5 10:ae03698c:::benchmark_data_smithi080_153340_object2843:head [delete] snapc 0=[] ondisk+write+known_if_redirected e432)", 2024-02-19T21:56:37.710 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:49.124179+0000", 2024-02-19T21:56:37.711 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 348.55397425899997, 2024-02-19T21:56:37.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7784922889999999, 2024-02-19T21:56:37.711 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:56:37.711 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:56:37.711 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:56:37.711 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:56:37.711 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:56:37.711 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 77593 2024-02-19T21:56:37.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.711 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:56:37.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:56:37.711 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.124179+0000", 2024-02-19T21:56:37.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:56:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:56:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.124179+0000", 2024-02-19T21:56:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:56:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:56:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.124178+0000", 2024-02-19T21:56:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7179999999999999e-06 2024-02-19T21:56:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:56:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.124184+0000", 2024-02-19T21:56:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6446000000000001e-05 2024-02-19T21:56:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:56:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.124201+0000", 2024-02-19T21:56:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9109999999999998e-06 2024-02-19T21:56:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:56:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.124207+0000", 2024-02-19T21:56:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.15568269000000001 2024-02-19T21:56:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.279890+0000", 2024-02-19T21:56:37.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054154750000000003 2024-02-19T21:56:37.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for missing object", 2024-02-19T21:56:37.714 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.285305+0000", 2024-02-19T21:56:37.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.031700320999999997 2024-02-19T21:56:37.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.714 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.317005+0000", 2024-02-19T21:56:37.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049576450000000001 2024-02-19T21:56:37.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for rw locks", 2024-02-19T21:56:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.321963+0000", 2024-02-19T21:56:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4976726899999999 2024-02-19T21:56:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.819636+0000", 2024-02-19T21:56:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040448059999999997 2024-02-19T21:56:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:56:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.823680+0000", 2024-02-19T21:56:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0086478930000000002 2024-02-19T21:56:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:56:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.832328+0000", 2024-02-19T21:56:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.051145287999999997 2024-02-19T21:56:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.883474+0000", 2024-02-19T21:56:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022417729999999999 2024-02-19T21:56:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.885715+0000", 2024-02-19T21:56:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00075996400000000002 2024-02-19T21:56:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:56:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.886475+0000", 2024-02-19T21:56:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035178399999999999 2024-02-19T21:56:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:56:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.889993+0000", 2024-02-19T21:56:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012678299000000001 2024-02-19T21:56:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:56:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.902672+0000", 2024-02-19T21:56:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7784922889999999 2024-02-19T21:56:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.718 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:77644 10.5 10:a2a30040:::benchmark_data_smithi080_153340_object2894:head [delete] snapc 0=[] ondisk+write+known_if_redirected e432)", 2024-02-19T21:56:37.718 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:49.284899+0000", 2024-02-19T21:56:37.718 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 348.393254598, 2024-02-19T21:56:37.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.76959394, 2024-02-19T21:56:37.718 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:56:37.718 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:56:37.718 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:56:37.718 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:56:37.718 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:56:37.718 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 77644 2024-02-19T21:56:37.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.718 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:56:37.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.719 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:56:37.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.284899+0000", 2024-02-19T21:56:37.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:56:37.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.719 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:56:37.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.284899+0000", 2024-02-19T21:56:37.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:56:37.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.719 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:56:37.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.284897+0000", 2024-02-19T21:56:37.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2389999999999996e-06 2024-02-19T21:56:37.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:56:37.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.284904+0000", 2024-02-19T21:56:37.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1488000000000001e-05 2024-02-19T21:56:37.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:56:37.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.284916+0000", 2024-02-19T21:56:37.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4330000000000003e-06 2024-02-19T21:56:37.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:56:37.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.284921+0000", 2024-02-19T21:56:37.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.12634256799999999 2024-02-19T21:56:37.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.721 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.721 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.721 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.411264+0000", 2024-02-19T21:56:37.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0075598200000000001 2024-02-19T21:56:37.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.721 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.721 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for missing object", 2024-02-19T21:56:37.721 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.418824+0000", 2024-02-19T21:56:37.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.042275455000000003 2024-02-19T21:56:37.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.721 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.721 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.721 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.461099+0000", 2024-02-19T21:56:37.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053375669999999997 2024-02-19T21:56:37.722 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.722 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.722 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for rw locks", 2024-02-19T21:56:37.722 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.466437+0000", 2024-02-19T21:56:37.722 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.521964425 2024-02-19T21:56:37.722 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.722 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.722 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.722 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.988401+0000", 2024-02-19T21:56:37.722 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041134159999999999 2024-02-19T21:56:37.722 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.722 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.722 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:56:37.722 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.992514+0000", 2024-02-19T21:56:37.722 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087920900000000007 2024-02-19T21:56:37.723 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.723 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.723 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:56:37.723 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.001307+0000", 2024-02-19T21:56:37.723 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.033974679000000001 2024-02-19T21:56:37.723 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.723 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.723 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.723 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.035281+0000", 2024-02-19T21:56:37.724 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015839630000000001 2024-02-19T21:56:37.724 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.724 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.724 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.036865+0000", 2024-02-19T21:56:37.724 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00070392199999999995 2024-02-19T21:56:37.724 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.724 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:56:37.724 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.037569+0000", 2024-02-19T21:56:37.724 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035811630000000001 2024-02-19T21:56:37.724 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.725 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:56:37.725 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.041150+0000", 2024-02-19T21:56:37.725 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013342542000000001 2024-02-19T21:56:37.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.725 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.725 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:56:37.725 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.054493+0000", 2024-02-19T21:56:37.725 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.76959394 2024-02-19T21:56:37.725 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.725 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:37.725 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.725 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.726 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:77651 10.5 10:af391e44:::benchmark_data_smithi080_153340_object2901:head [delete] snapc 0=[] ondisk+write+known_if_redirected e432)", 2024-02-19T21:56:37.726 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:49.309795+0000", 2024-02-19T21:56:37.726 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 348.36835845500002, 2024-02-19T21:56:37.726 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.909059259, 2024-02-19T21:56:37.726 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:56:37.726 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:56:37.726 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:56:37.726 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:56:37.726 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:56:37.726 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 77651 2024-02-19T21:56:37.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.726 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:56:37.726 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.726 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:56:37.726 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.309795+0000", 2024-02-19T21:56:37.727 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:56:37.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.727 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.727 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:56:37.727 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.309795+0000", 2024-02-19T21:56:37.727 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:56:37.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.727 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.727 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:56:37.727 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.309793+0000", 2024-02-19T21:56:37.727 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3790000000000006e-06 2024-02-19T21:56:37.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.727 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.727 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:56:37.727 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.309802+0000", 2024-02-19T21:56:37.727 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1644000000000001e-05 2024-02-19T21:56:37.728 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.728 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.728 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:56:37.728 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.309813+0000", 2024-02-19T21:56:37.728 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5099999999999998e-06 2024-02-19T21:56:37.728 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.728 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.728 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:56:37.728 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.309819+0000", 2024-02-19T21:56:37.728 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.109805638 2024-02-19T21:56:37.728 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.728 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.728 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.728 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.419624+0000", 2024-02-19T21:56:37.729 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0076326520000000002 2024-02-19T21:56:37.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.729 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for missing object", 2024-02-19T21:56:37.729 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.427257+0000", 2024-02-19T21:56:37.729 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.106876201 2024-02-19T21:56:37.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.729 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.729 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.534133+0000", 2024-02-19T21:56:37.729 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0051806450000000002 2024-02-19T21:56:37.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.729 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for rw locks", 2024-02-19T21:56:37.729 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.539314+0000", 2024-02-19T21:56:37.730 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5894258639999999 2024-02-19T21:56:37.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.730 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.730 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.730 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.128740+0000", 2024-02-19T21:56:37.730 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057823240000000001 2024-02-19T21:56:37.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.730 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.730 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:56:37.730 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.134522+0000", 2024-02-19T21:56:37.730 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010242883 2024-02-19T21:56:37.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.730 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.730 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:56:37.731 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.144765+0000", 2024-02-19T21:56:37.731 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.056949748000000001 2024-02-19T21:56:37.731 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.731 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.731 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.201715+0000", 2024-02-19T21:56:37.731 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00067740499999999996 2024-02-19T21:56:37.731 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.731 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:56:37.731 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.202392+0000", 2024-02-19T21:56:37.731 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023633170000000002 2024-02-19T21:56:37.731 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.731 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.732 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.204755+0000", 2024-02-19T21:56:37.732 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025764199999999998 2024-02-19T21:56:37.732 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.732 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.732 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:56:37.732 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.207332+0000", 2024-02-19T21:56:37.732 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011522401999999999 2024-02-19T21:56:37.732 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.732 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.732 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:56:37.732 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.218854+0000", 2024-02-19T21:56:37.732 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.909059259 2024-02-19T21:56:37.732 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.732 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:37.733 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.733 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:77701 10.5 10:a121d2d0:::benchmark_data_smithi080_153340_object2951:head [delete] snapc 0=[] ondisk+write+known_if_redirected e432)", 2024-02-19T21:56:37.733 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:49.615448+0000", 2024-02-19T21:56:37.733 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 348.06270563999999, 2024-02-19T21:56:37.733 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7707524779999999, 2024-02-19T21:56:37.733 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:56:37.733 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:56:37.733 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:56:37.733 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:56:37.733 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:56:37.733 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 77701 2024-02-19T21:56:37.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.734 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:56:37.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.734 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:56:37.734 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.615448+0000", 2024-02-19T21:56:37.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:56:37.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.734 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:56:37.734 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.615448+0000", 2024-02-19T21:56:37.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:56:37.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.734 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:56:37.734 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.615446+0000", 2024-02-19T21:56:37.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5529999999999998e-06 2024-02-19T21:56:37.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:56:37.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.615453+0000", 2024-02-19T21:56:37.735 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1260000000000001e-05 2024-02-19T21:56:37.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:56:37.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.615464+0000", 2024-02-19T21:56:37.735 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1189999999999999e-06 2024-02-19T21:56:37.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:56:37.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.615471+0000", 2024-02-19T21:56:37.735 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.10234760699999999 2024-02-19T21:56:37.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.717819+0000", 2024-02-19T21:56:37.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053565160000000004 2024-02-19T21:56:37.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for missing object", 2024-02-19T21:56:37.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.723175+0000", 2024-02-19T21:56:37.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.044701866 2024-02-19T21:56:37.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.767877+0000", 2024-02-19T21:56:37.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0096014220000000001 2024-02-19T21:56:37.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.737 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for rw locks", 2024-02-19T21:56:37.737 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.777478+0000", 2024-02-19T21:56:37.737 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.52776197 2024-02-19T21:56:37.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.737 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.737 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.305240+0000", 2024-02-19T21:56:37.737 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049843539999999999 2024-02-19T21:56:37.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.737 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:56:37.737 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.310225+0000", 2024-02-19T21:56:37.737 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0094393619999999998 2024-02-19T21:56:37.738 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.738 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.738 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:56:37.738 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.319664+0000", 2024-02-19T21:56:37.738 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.050469677999999997 2024-02-19T21:56:37.738 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.738 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.738 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:56:37.738 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.370134+0000", 2024-02-19T21:56:37.738 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001552023 2024-02-19T21:56:37.738 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.738 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.738 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.738 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.371686+0000", 2024-02-19T21:56:37.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001565767 2024-02-19T21:56:37.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.739 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.739 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.373252+0000", 2024-02-19T21:56:37.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002492588 2024-02-19T21:56:37.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.739 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:56:37.739 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.375744+0000", 2024-02-19T21:56:37.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010456131 2024-02-19T21:56:37.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.739 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:56:37.739 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.386200+0000", 2024-02-19T21:56:37.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7707524779999999 2024-02-19T21:56:37.740 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.740 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:37.740 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.740 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:77704 10.5 10:aa666643:::benchmark_data_smithi080_153340_object2954:head [delete] snapc 0=[] ondisk+write+known_if_redirected e432)", 2024-02-19T21:56:37.740 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:49.678507+0000", 2024-02-19T21:56:37.740 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 347.99964614200002, 2024-02-19T21:56:37.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.726157824, 2024-02-19T21:56:37.740 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:56:37.740 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:56:37.740 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:56:37.740 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:56:37.740 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:56:37.741 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 77704 2024-02-19T21:56:37.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.741 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:56:37.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:56:37.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.678507+0000", 2024-02-19T21:56:37.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:56:37.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:56:37.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.678507+0000", 2024-02-19T21:56:37.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:56:37.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:56:37.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.678506+0000", 2024-02-19T21:56:37.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7039999999999997e-06 2024-02-19T21:56:37.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:56:37.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.678512+0000", 2024-02-19T21:56:37.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6232999999999999e-05 2024-02-19T21:56:37.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:56:37.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.678529+0000", 2024-02-19T21:56:37.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2269999999999996e-06 2024-02-19T21:56:37.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:56:37.743 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.678536+0000", 2024-02-19T21:56:37.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.045303423000000002 2024-02-19T21:56:37.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.743 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.723839+0000", 2024-02-19T21:56:37.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0067555779999999999 2024-02-19T21:56:37.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for missing object", 2024-02-19T21:56:37.743 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.730595+0000", 2024-02-19T21:56:37.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.13565301399999999 2024-02-19T21:56:37.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.744 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.744 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.866248+0000", 2024-02-19T21:56:37.744 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0051335770000000003 2024-02-19T21:56:37.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.744 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for rw locks", 2024-02-19T21:56:37.744 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.871381+0000", 2024-02-19T21:56:37.744 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.478858486 2024-02-19T21:56:37.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.744 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.744 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.350240+0000", 2024-02-19T21:56:37.744 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040837180000000001 2024-02-19T21:56:37.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:56:37.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.354324+0000", 2024-02-19T21:56:37.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0089881820000000008 2024-02-19T21:56:37.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:56:37.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.363312+0000", 2024-02-19T21:56:37.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023394848999999999 2024-02-19T21:56:37.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:56:37.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.386707+0000", 2024-02-19T21:56:37.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0017200169999999999 2024-02-19T21:56:37.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.746 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.388427+0000", 2024-02-19T21:56:37.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00167756 2024-02-19T21:56:37.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.746 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.390104+0000", 2024-02-19T21:56:37.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026496409999999999 2024-02-19T21:56:37.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.746 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:56:37.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.392754+0000", 2024-02-19T21:56:37.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011911244 2024-02-19T21:56:37.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:56:37.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.404665+0000", 2024-02-19T21:56:37.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.726157824 2024-02-19T21:56:37.747 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.747 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:37.747 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.747 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:77719 10.5 10:aa725773:::benchmark_data_smithi080_153340_object2969:head [delete] snapc 0=[] ondisk+write+known_if_redirected e433)", 2024-02-19T21:56:37.747 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:49.779997+0000", 2024-02-19T21:56:37.747 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 347.89815694399999, 2024-02-19T21:56:37.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7590335509999999, 2024-02-19T21:56:37.748 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:56:37.748 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:56:37.748 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:56:37.748 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:56:37.748 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:56:37.748 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 77719 2024-02-19T21:56:37.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.748 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:56:37.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:56:37.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.779997+0000", 2024-02-19T21:56:37.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:56:37.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:56:37.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.779997+0000", 2024-02-19T21:56:37.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999976 2024-02-19T21:56:37.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:56:37.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.779994+0000", 2024-02-19T21:56:37.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0909e-05 2024-02-19T21:56:37.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:56:37.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.780005+0000", 2024-02-19T21:56:37.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5705999999999998e-05 2024-02-19T21:56:37.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:56:37.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.780021+0000", 2024-02-19T21:56:37.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2727e-05 2024-02-19T21:56:37.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:56:37.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.780034+0000", 2024-02-19T21:56:37.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.111366953 2024-02-19T21:56:37.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.891401+0000", 2024-02-19T21:56:37.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0052852730000000001 2024-02-19T21:56:37.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for missing object", 2024-02-19T21:56:37.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.896686+0000", 2024-02-19T21:56:37.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.039240352999999999 2024-02-19T21:56:37.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.935926+0000", 2024-02-19T21:56:37.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.005849908 2024-02-19T21:56:37.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for rw locks", 2024-02-19T21:56:37.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:49.941776+0000", 2024-02-19T21:56:37.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.53191345 2024-02-19T21:56:37.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.473690+0000", 2024-02-19T21:56:37.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050674910000000004 2024-02-19T21:56:37.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:56:37.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.478757+0000", 2024-02-19T21:56:37.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0094158669999999996 2024-02-19T21:56:37.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:56:37.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.488173+0000", 2024-02-19T21:56:37.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.033898902000000002 2024-02-19T21:56:37.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.522072+0000", 2024-02-19T21:56:37.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050706299999999998 2024-02-19T21:56:37.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:56:37.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.522579+0000", 2024-02-19T21:56:37.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032301610000000001 2024-02-19T21:56:37.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.525809+0000", 2024-02-19T21:56:37.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025259919999999999 2024-02-19T21:56:37.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.754 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:56:37.754 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.528335+0000", 2024-02-19T21:56:37.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010694976 2024-02-19T21:56:37.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.754 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:56:37.754 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.539030+0000", 2024-02-19T21:56:37.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7590335509999999 2024-02-19T21:56:37.754 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.754 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:37.754 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.755 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:77819 10.5 10:a2d5aa3a:::benchmark_data_smithi080_153340_object3069:head [delete] snapc 0=[] ondisk+write+known_if_redirected e434)", 2024-02-19T21:56:37.755 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:50.676376+0000", 2024-02-19T21:56:37.755 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 347.00177750799998, 2024-02-19T21:56:37.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7805934429999999, 2024-02-19T21:56:37.755 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:56:37.755 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:56:37.755 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:56:37.755 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:56:37.755 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:56:37.755 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 77819 2024-02-19T21:56:37.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.755 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:56:37.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:56:37.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.676376+0000", 2024-02-19T21:56:37.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:56:37.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:56:37.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.676376+0000", 2024-02-19T21:56:37.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:56:37.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:56:37.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.676374+0000", 2024-02-19T21:56:37.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3699999999999997e-06 2024-02-19T21:56:37.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:56:37.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.676382+0000", 2024-02-19T21:56:37.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1871e-05 2024-02-19T21:56:37.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:56:37.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.676394+0000", 2024-02-19T21:56:37.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3239999999999997e-06 2024-02-19T21:56:37.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:56:37.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.676401+0000", 2024-02-19T21:56:37.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.078198912999999995 2024-02-19T21:56:37.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.754600+0000", 2024-02-19T21:56:37.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0058572870000000001 2024-02-19T21:56:37.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for missing object", 2024-02-19T21:56:37.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.760457+0000", 2024-02-19T21:56:37.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.031323409000000003 2024-02-19T21:56:37.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.791781+0000", 2024-02-19T21:56:37.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0052456389999999999 2024-02-19T21:56:37.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for rw locks", 2024-02-19T21:56:37.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.797026+0000", 2024-02-19T21:56:37.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5261714020000001 2024-02-19T21:56:37.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.323198+0000", 2024-02-19T21:56:37.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041952880000000001 2024-02-19T21:56:37.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:56:37.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.327393+0000", 2024-02-19T21:56:37.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011131597 2024-02-19T21:56:37.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:56:37.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.338524+0000", 2024-02-19T21:56:37.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.048224269 2024-02-19T21:56:37.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:56:37.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.386749+0000", 2024-02-19T21:56:37.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028475829999999999 2024-02-19T21:56:37.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.389596+0000", 2024-02-19T21:56:37.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.053509914999999998 2024-02-19T21:56:37.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.443106+0000", 2024-02-19T21:56:37.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002461076 2024-02-19T21:56:37.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:56:37.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.445567+0000", 2024-02-19T21:56:37.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011402156 2024-02-19T21:56:37.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:56:37.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.456969+0000", 2024-02-19T21:56:37.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7805934429999999 2024-02-19T21:56:37.761 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.762 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:37.762 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.762 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:77848 10.5 10:a7a5ad04:::benchmark_data_smithi080_153340_object3098:head [delete] snapc 0=[] ondisk+write+known_if_redirected e434)", 2024-02-19T21:56:37.762 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:50.978936+0000", 2024-02-19T21:56:37.762 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 346.69921702699997, 2024-02-19T21:56:37.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7726466570000001, 2024-02-19T21:56:37.762 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:56:37.762 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:56:37.762 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:56:37.762 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:56:37.762 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:56:37.762 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 77848 2024-02-19T21:56:37.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.763 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:56:37.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:56:37.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.978936+0000", 2024-02-19T21:56:37.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:56:37.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:56:37.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.978936+0000", 2024-02-19T21:56:37.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:56:37.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:56:37.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.978935+0000", 2024-02-19T21:56:37.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0359999999999995e-06 2024-02-19T21:56:37.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:56:37.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.978944+0000", 2024-02-19T21:56:37.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2602999999999999e-05 2024-02-19T21:56:37.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:56:37.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.978956+0000", 2024-02-19T21:56:37.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.331e-06 2024-02-19T21:56:37.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:56:37.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:50.978963+0000", 2024-02-19T21:56:37.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.078430176000000004 2024-02-19T21:56:37.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.057393+0000", 2024-02-19T21:56:37.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053712380000000004 2024-02-19T21:56:37.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for missing object", 2024-02-19T21:56:37.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.062764+0000", 2024-02-19T21:56:37.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.034239988999999998 2024-02-19T21:56:37.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.766 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.097004+0000", 2024-02-19T21:56:37.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053787260000000003 2024-02-19T21:56:37.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.766 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for rw locks", 2024-02-19T21:56:37.766 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.102383+0000", 2024-02-19T21:56:37.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5231566220000001 2024-02-19T21:56:37.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.766 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.766 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.625539+0000", 2024-02-19T21:56:37.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004133945 2024-02-19T21:56:37.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.766 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:56:37.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.629673+0000", 2024-02-19T21:56:37.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085118429999999998 2024-02-19T21:56:37.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:56:37.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.638185+0000", 2024-02-19T21:56:37.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.054750193000000003 2024-02-19T21:56:37.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.692935+0000", 2024-02-19T21:56:37.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021800155000000002 2024-02-19T21:56:37.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:56:37.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.714736+0000", 2024-02-19T21:56:37.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023430612 2024-02-19T21:56:37.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.738166+0000", 2024-02-19T21:56:37.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030464749999999999 2024-02-19T21:56:37.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:56:37.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.741213+0000", 2024-02-19T21:56:37.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010370545 2024-02-19T21:56:37.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:56:37.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.751583+0000", 2024-02-19T21:56:37.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7726466570000001 2024-02-19T21:56:37.769 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.769 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:37.769 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.769 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:78014 10.5 10:a3653066:::benchmark_data_smithi080_153340_object3264:head [delete] snapc 0=[] ondisk+write+known_if_redirected e434)", 2024-02-19T21:56:37.769 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:51.927842+0000", 2024-02-19T21:56:37.769 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 345.75031162300002, 2024-02-19T21:56:37.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7459068790000001, 2024-02-19T21:56:37.769 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:56:37.769 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:56:37.769 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:56:37.770 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:56:37.770 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:56:37.770 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 78014 2024-02-19T21:56:37.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.770 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:56:37.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.770 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:56:37.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.927842+0000", 2024-02-19T21:56:37.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:56:37.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.770 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:56:37.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.927842+0000", 2024-02-19T21:56:37.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:56:37.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:56:37.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.927840+0000", 2024-02-19T21:56:37.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0820000000000001e-05 2024-02-19T21:56:37.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:56:37.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.927861+0000", 2024-02-19T21:56:37.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5959000000000001e-05 2024-02-19T21:56:37.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:56:37.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.927877+0000", 2024-02-19T21:56:37.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9000000000000006e-06 2024-02-19T21:56:37.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.772 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:56:37.772 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:51.927885+0000", 2024-02-19T21:56:37.772 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.15343663099999999 2024-02-19T21:56:37.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.772 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.772 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.081321+0000", 2024-02-19T21:56:37.772 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0069323040000000002 2024-02-19T21:56:37.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.772 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for missing object", 2024-02-19T21:56:37.772 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.088253+0000", 2024-02-19T21:56:37.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.088684124000000003 2024-02-19T21:56:37.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.176938+0000", 2024-02-19T21:56:37.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059936590000000001 2024-02-19T21:56:37.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for rw locks", 2024-02-19T21:56:37.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.182931+0000", 2024-02-19T21:56:37.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.402521927 2024-02-19T21:56:37.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:53.585453+0000", 2024-02-19T21:56:37.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040277430000000003 2024-02-19T21:56:37.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:56:37.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:53.589481+0000", 2024-02-19T21:56:37.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0096554829999999994 2024-02-19T21:56:37.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:56:37.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:53.599136+0000", 2024-02-19T21:56:37.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01442919 2024-02-19T21:56:37.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:53.613566+0000", 2024-02-19T21:56:37.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0021693989999999998 2024-02-19T21:56:37.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:53.615735+0000", 2024-02-19T21:56:37.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.044366783 2024-02-19T21:56:37.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:56:37.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:53.660102+0000", 2024-02-19T21:56:37.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024902150000000001 2024-02-19T21:56:37.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:56:37.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:53.662592+0000", 2024-02-19T21:56:37.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011156755000000001 2024-02-19T21:56:37.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:56:37.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:53.673749+0000", 2024-02-19T21:56:37.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7459068790000001 2024-02-19T21:56:37.776 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.776 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:37.776 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.776 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:78112 10.5 10:a2fb0ea7:::benchmark_data_smithi080_153340_object3362:head [delete] snapc 0=[] ondisk+write+known_if_redirected e434)", 2024-02-19T21:56:37.776 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:50:52.480146+0000", 2024-02-19T21:56:37.776 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 345.19800757500002, 2024-02-19T21:56:37.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.864151705, 2024-02-19T21:56:37.777 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:56:37.777 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:56:37.777 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:56:37.777 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:56:37.777 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:56:37.777 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 78112 2024-02-19T21:56:37.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.777 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:56:37.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.777 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:56:37.777 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.480146+0000", 2024-02-19T21:56:37.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:56:37.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:56:37.778 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.480146+0000", 2024-02-19T21:56:37.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:56:37.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:56:37.778 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.480144+0000", 2024-02-19T21:56:37.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1690000000000003e-06 2024-02-19T21:56:37.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:56:37.778 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.480151+0000", 2024-02-19T21:56:37.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2747e-05 2024-02-19T21:56:37.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:56:37.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.480164+0000", 2024-02-19T21:56:37.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0119999999999999e-06 2024-02-19T21:56:37.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:56:37.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.480171+0000", 2024-02-19T21:56:37.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022758469999999999 2024-02-19T21:56:37.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.502930+0000", 2024-02-19T21:56:37.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.005221982 2024-02-19T21:56:37.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for missing object", 2024-02-19T21:56:37.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.508152+0000", 2024-02-19T21:56:37.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.070966903999999997 2024-02-19T21:56:37.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.579119+0000", 2024-02-19T21:56:37.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0068636920000000002 2024-02-19T21:56:37.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for rw locks", 2024-02-19T21:56:37.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:52.585982+0000", 2024-02-19T21:56:37.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6341062159999999 2024-02-19T21:56:37.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.781 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.781 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:54.220088+0000", 2024-02-19T21:56:37.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0051943049999999998 2024-02-19T21:56:37.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.781 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:56:37.781 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:54.225283+0000", 2024-02-19T21:56:37.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0096394819999999996 2024-02-19T21:56:37.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.781 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:56:37.781 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:54.234922+0000", 2024-02-19T21:56:37.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012612249000000001 2024-02-19T21:56:37.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:54.247534+0000", 2024-02-19T21:56:37.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001505908 2024-02-19T21:56:37.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:54.249040+0000", 2024-02-19T21:56:37.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.079683932999999998 2024-02-19T21:56:37.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:56:37.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:54.328724+0000", 2024-02-19T21:56:37.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036522460000000001 2024-02-19T21:56:37.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:56:37.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:54.332377+0000", 2024-02-19T21:56:37.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011921088 2024-02-19T21:56:37.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:56:37.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:50:54.344298+0000", 2024-02-19T21:56:37.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.864151705 2024-02-19T21:56:37.783 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.783 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:37.783 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.783 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:79446 10.5 10:a160f90f:::benchmark_data_smithi080_153340_object4696:head [delete] snapc 0=[] ondisk+write+known_if_redirected e439)", 2024-02-19T21:56:37.784 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:51:02.623615+0000", 2024-02-19T21:56:37.784 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 335.05453816199997, 2024-02-19T21:56:37.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7454522589999999, 2024-02-19T21:56:37.784 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:56:37.784 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:56:37.784 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:56:37.784 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:56:37.784 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:56:37.784 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 79446 2024-02-19T21:56:37.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.784 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:56:37.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:56:37.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:02.623615+0000", 2024-02-19T21:56:37.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:56:37.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:56:37.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:02.623615+0000", 2024-02-19T21:56:37.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999976 2024-02-19T21:56:37.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:56:37.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:02.623613+0000", 2024-02-19T21:56:37.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1389000000000001e-05 2024-02-19T21:56:37.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.786 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:35.625362+0000 osd.5 (osd.5) 313 : cluster [DBG] 5.f scrub starts 2024-02-19T21:56:37.787 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:35.641747+0000 osd.5 (osd.5) 314 : cluster [DBG] 5.f scrub ok 2024-02-19T21:56:37.787 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:35.775712+0000 osd.0 (osd.0) 317 : cluster [DBG] 4.16 scrub starts 2024-02-19T21:56:37.787 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:35.779074+0000 osd.0 (osd.0) 318 : cluster [DBG] 4.16 scrub ok 2024-02-19T21:56:37.787 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:35.851725+0000 osd.6 (osd.6) 287 : cluster [DBG] 11.3 scrub starts 2024-02-19T21:56:37.787 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:36.802216+0000 osd.2 (osd.2) 63 : cluster [DBG] 5.a scrub starts 2024-02-19T21:56:37.787 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:36.809676+0000 osd.2 (osd.2) 64 : cluster [DBG] 5.a scrub ok 2024-02-19T21:56:37.787 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:37.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:56:37.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:02.623624+0000", 2024-02-19T21:56:37.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6373000000000001e-05 2024-02-19T21:56:37.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:56:37.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:02.623641+0000", 2024-02-19T21:56:37.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6309999999999998e-06 2024-02-19T21:56:37.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:56:37.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:02.623650+0000", 2024-02-19T21:56:37.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.045281868000000003 2024-02-19T21:56:37.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:02.668932+0000", 2024-02-19T21:56:37.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002455479 2024-02-19T21:56:37.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for missing object", 2024-02-19T21:56:37.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:02.671388+0000", 2024-02-19T21:56:37.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.080258665000000007 2024-02-19T21:56:37.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:02.751646+0000", 2024-02-19T21:56:37.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0051470800000000001 2024-02-19T21:56:37.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for rw locks", 2024-02-19T21:56:37.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:02.756793+0000", 2024-02-19T21:56:37.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.548556665 2024-02-19T21:56:37.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:04.305350+0000", 2024-02-19T21:56:37.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004206965 2024-02-19T21:56:37.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:56:37.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:04.309557+0000", 2024-02-19T21:56:37.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010005834999999999 2024-02-19T21:56:37.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:56:37.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:04.319563+0000", 2024-02-19T21:56:37.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.032137709 2024-02-19T21:56:37.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:56:37.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:04.351701+0000", 2024-02-19T21:56:37.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001582349 2024-02-19T21:56:37.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:04.353283+0000", 2024-02-19T21:56:37.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023186499999999998 2024-02-19T21:56:37.792 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.792 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.792 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.792 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:04.355602+0000", 2024-02-19T21:56:37.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025031469999999998 2024-02-19T21:56:37.792 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.792 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.792 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:56:37.792 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:04.358105+0000", 2024-02-19T21:56:37.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010962828000000001 2024-02-19T21:56:37.792 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.792 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.792 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:56:37.792 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:04.369068+0000", 2024-02-19T21:56:37.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7454522589999999 2024-02-19T21:56:37.793 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.793 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:37.793 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.793 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:79483 10.5 10:adccce7b:::benchmark_data_smithi080_153340_object4733:head [delete] snapc 0=[] ondisk+write+known_if_redirected e439)", 2024-02-19T21:56:37.793 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:51:03.036824+0000", 2024-02-19T21:56:37.793 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 334.64132902300003, 2024-02-19T21:56:37.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.782027359, 2024-02-19T21:56:37.793 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:56:37.793 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:56:37.793 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:56:37.793 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:56:37.793 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:56:37.794 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 79483 2024-02-19T21:56:37.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.794 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:56:37.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:56:37.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:03.036824+0000", 2024-02-19T21:56:37.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:56:37.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:56:37.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:03.036824+0000", 2024-02-19T21:56:37.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999976 2024-02-19T21:56:37.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:56:37.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:03.036822+0000", 2024-02-19T21:56:37.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4079e-05 2024-02-19T21:56:37.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:56:37.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:03.036836+0000", 2024-02-19T21:56:37.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6690000000000001e-05 2024-02-19T21:56:37.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:56:37.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:03.036853+0000", 2024-02-19T21:56:37.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6600000000000001e-06 2024-02-19T21:56:37.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:56:37.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:03.036861+0000", 2024-02-19T21:56:37.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.084979864000000002 2024-02-19T21:56:37.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:03.121841+0000", 2024-02-19T21:56:37.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049806039999999996 2024-02-19T21:56:37.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for missing object", 2024-02-19T21:56:37.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:03.126822+0000", 2024-02-19T21:56:37.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.077832355000000006 2024-02-19T21:56:37.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:03.204654+0000", 2024-02-19T21:56:37.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050883819999999998 2024-02-19T21:56:37.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for rw locks", 2024-02-19T21:56:37.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:03.209743+0000", 2024-02-19T21:56:37.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4906539480000001 2024-02-19T21:56:37.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:04.700396+0000", 2024-02-19T21:56:37.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040236869999999997 2024-02-19T21:56:37.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:56:37.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:04.704420+0000", 2024-02-19T21:56:37.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0086994020000000002 2024-02-19T21:56:37.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:56:37.798 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:04.713120+0000", 2024-02-19T21:56:37.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.048406526999999998 2024-02-19T21:56:37.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.798 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:04.761526+0000", 2024-02-19T21:56:37.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00048192999999999999 2024-02-19T21:56:37.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:56:37.798 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:04.762008+0000", 2024-02-19T21:56:37.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.043579087000000002 2024-02-19T21:56:37.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:04.805587+0000", 2024-02-19T21:56:37.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024664449999999998 2024-02-19T21:56:37.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:56:37.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:04.808054+0000", 2024-02-19T21:56:37.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010798278 2024-02-19T21:56:37.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:56:37.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:04.818852+0000", 2024-02-19T21:56:37.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.782027359 2024-02-19T21:56:37.800 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.800 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:37.800 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.800 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:80500 10.5 10:a77e6afa:::benchmark_data_smithi080_153340_object5750:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-02-19T21:56:37.800 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:51:10.050770+0000", 2024-02-19T21:56:37.800 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 327.62738351500002, 2024-02-19T21:56:37.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7405510180000001, 2024-02-19T21:56:37.800 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:56:37.800 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:56:37.800 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:56:37.800 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:56:37.801 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:56:37.801 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 80500 2024-02-19T21:56:37.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.801 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:56:37.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:56:37.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:10.050770+0000", 2024-02-19T21:56:37.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:56:37.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:56:37.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:10.050770+0000", 2024-02-19T21:56:37.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:56:37.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:56:37.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:10.050768+0000", 2024-02-19T21:56:37.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.323e-06 2024-02-19T21:56:37.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:56:37.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:10.050776+0000", 2024-02-19T21:56:37.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1545999999999999e-05 2024-02-19T21:56:37.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:56:37.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:10.050787+0000", 2024-02-19T21:56:37.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2340000000000002e-06 2024-02-19T21:56:37.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:56:37.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:10.050792+0000", 2024-02-19T21:56:37.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.075422874000000001 2024-02-19T21:56:37.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:10.126215+0000", 2024-02-19T21:56:37.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061552880000000001 2024-02-19T21:56:37.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for missing object", 2024-02-19T21:56:37.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:10.132371+0000", 2024-02-19T21:56:37.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.046685574000000001 2024-02-19T21:56:37.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:10.179056+0000", 2024-02-19T21:56:37.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0058596969999999996 2024-02-19T21:56:37.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for rw locks", 2024-02-19T21:56:37.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:10.184916+0000", 2024-02-19T21:56:37.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5257855220000001 2024-02-19T21:56:37.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:11.710701+0000", 2024-02-19T21:56:37.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003855055 2024-02-19T21:56:37.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:56:37.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:11.714556+0000", 2024-02-19T21:56:37.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0081373499999999998 2024-02-19T21:56:37.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:56:37.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:11.722694+0000", 2024-02-19T21:56:37.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.052179797999999999 2024-02-19T21:56:37.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:11.774874+0000", 2024-02-19T21:56:37.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00078851300000000002 2024-02-19T21:56:37.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:56:37.806 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:11.775662+0000", 2024-02-19T21:56:37.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002069703 2024-02-19T21:56:37.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.806 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:11.777732+0000", 2024-02-19T21:56:37.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027869259999999999 2024-02-19T21:56:37.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:56:37.806 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:11.780519+0000", 2024-02-19T21:56:37.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010802364 2024-02-19T21:56:37.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:56:37.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:11.791321+0000", 2024-02-19T21:56:37.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7405510180000001 2024-02-19T21:56:37.807 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.807 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:37.807 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.807 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25511.0:80957 10.5 10:aaf53660:::benchmark_data_smithi080_153340_object6207:head [delete] snapc 0=[] ondisk+write+known_if_redirected e442)", 2024-02-19T21:56:37.807 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:51:12.471254+0000", 2024-02-19T21:56:37.807 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 325.20689900600001, 2024-02-19T21:56:37.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.741169427, 2024-02-19T21:56:37.807 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:56:37.807 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:56:37.807 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:56:37.807 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25511", 2024-02-19T21:56:37.808 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3698160288", 2024-02-19T21:56:37.808 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 80957 2024-02-19T21:56:37.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.808 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:56:37.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:56:37.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:12.471254+0000", 2024-02-19T21:56:37.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:56:37.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:56:37.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:12.471254+0000", 2024-02-19T21:56:37.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:56:37.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:56:37.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:12.471252+0000", 2024-02-19T21:56:37.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0489999999999998e-06 2024-02-19T21:56:37.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:56:37.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:12.471260+0000", 2024-02-19T21:56:37.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1618e-05 2024-02-19T21:56:37.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:56:37.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:12.471271+0000", 2024-02-19T21:56:37.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3789999999999997e-06 2024-02-19T21:56:37.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:56:37.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:12.471277+0000", 2024-02-19T21:56:37.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.092275233999999998 2024-02-19T21:56:37.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:12.563552+0000", 2024-02-19T21:56:37.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059455690000000004 2024-02-19T21:56:37.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for missing object", 2024-02-19T21:56:37.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:12.569497+0000", 2024-02-19T21:56:37.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.029043502999999998 2024-02-19T21:56:37.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:12.598541+0000", 2024-02-19T21:56:37.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0048521060000000001 2024-02-19T21:56:37.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for rw locks", 2024-02-19T21:56:37.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:12.603393+0000", 2024-02-19T21:56:37.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.486461298 2024-02-19T21:56:37.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:37.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:14.089854+0000", 2024-02-19T21:56:37.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047704069999999999 2024-02-19T21:56:37.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:56:37.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:14.094625+0000", 2024-02-19T21:56:37.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.009107403 2024-02-19T21:56:37.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0,7", 2024-02-19T21:56:37.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:14.103732+0000", 2024-02-19T21:56:37.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.049727812000000003 2024-02-19T21:56:37.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:56:37.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:14.153460+0000", 2024-02-19T21:56:37.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001736731 2024-02-19T21:56:37.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:14.155197+0000", 2024-02-19T21:56:37.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.044860143999999998 2024-02-19T21:56:37.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:56:37.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:14.200057+0000", 2024-02-19T21:56:37.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002414696 2024-02-19T21:56:37.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:56:37.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:14.202471+0000", 2024-02-19T21:56:37.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0099524969999999994 2024-02-19T21:56:37.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:37.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:37.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:56:37.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:51:14.212424+0000", 2024-02-19T21:56:37.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.741169427 2024-02-19T21:56:37.814 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.814 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:37.814 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.814 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:37.814 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:37.814 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:56:37.814 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:37.815 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:56:37.815 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:56:37.916 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:56:38.130 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:38.162 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:56:38.169 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:38.169 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:56:38.270 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:56:38.326 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:38.468 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:37.308840+0000 mgr.y (mgr.14514) 919 : cluster [DBG] pgmap v1189: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 3.3 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 745 B/s rd, 0 B/s wr, 785 op/s 2024-02-19T21:56:38.468 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:37.371248+0000 osd.6 (osd.6) 288 : cluster [DBG] 11.3 scrub ok 2024-02-19T21:56:38.484 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:56:38.493 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:38.494 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:56:38.595 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:56:38.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:37.308840+0000 mgr.y (mgr.14514) 919 : cluster [DBG] pgmap v1189: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 3.3 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 745 B/s rd, 0 B/s wr, 785 op/s 2024-02-19T21:56:38.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:37.371248+0000 osd.6 (osd.6) 288 : cluster [DBG] 11.3 scrub ok 2024-02-19T21:56:38.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:37.308840+0000 mgr.y (mgr.14514) 919 : cluster [DBG] pgmap v1189: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 3.3 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 745 B/s rd, 0 B/s wr, 785 op/s 2024-02-19T21:56:38.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:37.371248+0000 osd.6 (osd.6) 288 : cluster [DBG] 11.3 scrub ok 2024-02-19T21:56:38.643 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:39.111 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:56:39.115 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:39.116 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:56:39.217 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:56:39.267 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:39.382 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:56:39.390 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:39.391 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:56:39.492 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:56:39.539 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:39.571 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:56:39.579 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:39.580 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:56:39.680 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:56:39.717 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:39.768 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:56:39.775 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:39.776 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:56:39.777 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:37.791986+0000 osd.0 (osd.0) 319 : cluster [DBG] 2.13 scrub starts 2024-02-19T21:56:39.777 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:37.801224+0000 osd.0 (osd.0) 320 : cluster [DBG] 2.13 scrub ok 2024-02-19T21:56:39.777 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:38.211762+0000 osd.3 (osd.3) 265 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:56:39.778 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:38.350031+0000 osd.3 (osd.3) 266 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:56:39.778 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:38.600886+0000 osd.4 (osd.4) 253 : cluster [DBG] 4.1b scrub starts 2024-02-19T21:56:39.778 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:38.608989+0000 osd.4 (osd.4) 254 : cluster [DBG] 4.1b scrub ok 2024-02-19T21:56:39.778 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:38.868637+0000 osd.2 (osd.2) 65 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:56:39.778 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:38.876332+0000 osd.2 (osd.2) 66 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:56:39.813 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:37.791986+0000 osd.0 (osd.0) 319 : cluster [DBG] 2.13 scrub starts 2024-02-19T21:56:39.813 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:37.801224+0000 osd.0 (osd.0) 320 : cluster [DBG] 2.13 scrub ok 2024-02-19T21:56:39.814 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:38.211762+0000 osd.3 (osd.3) 265 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:56:39.814 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:38.350031+0000 osd.3 (osd.3) 266 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:56:39.814 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:38.600886+0000 osd.4 (osd.4) 253 : cluster [DBG] 4.1b scrub starts 2024-02-19T21:56:39.814 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:38.608989+0000 osd.4 (osd.4) 254 : cluster [DBG] 4.1b scrub ok 2024-02-19T21:56:39.814 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:38.868637+0000 osd.2 (osd.2) 65 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:56:39.814 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:38.876332+0000 osd.2 (osd.2) 66 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:56:39.814 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:37.791986+0000 osd.0 (osd.0) 319 : cluster [DBG] 2.13 scrub starts 2024-02-19T21:56:39.814 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:37.801224+0000 osd.0 (osd.0) 320 : cluster [DBG] 2.13 scrub ok 2024-02-19T21:56:39.814 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:38.211762+0000 osd.3 (osd.3) 265 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:56:39.814 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:38.350031+0000 osd.3 (osd.3) 266 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:56:39.814 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:38.600886+0000 osd.4 (osd.4) 253 : cluster [DBG] 4.1b scrub starts 2024-02-19T21:56:39.814 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:38.608989+0000 osd.4 (osd.4) 254 : cluster [DBG] 4.1b scrub ok 2024-02-19T21:56:39.815 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:38.868637+0000 osd.2 (osd.2) 65 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:56:39.815 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:38.876332+0000 osd.2 (osd.2) 66 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:56:39.877 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:56:39.928 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:39.958 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:56:39.963 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:39.964 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:56:40.065 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:56:40.101 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:40.129 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:56:40.136 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:40.137 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:56:40.187 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_ops_in_flight 2024-02-19T21:56:40.238 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:56:40.297 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:40.361 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:56:40.367 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:40.367 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:56:40.468 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:56:40.488 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:38.795777+0000 osd.0 (osd.0) 321 : cluster [DBG] 6.0 scrub starts 2024-02-19T21:56:40.488 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:38.817155+0000 osd.0 (osd.0) 322 : cluster [DBG] 6.0 scrub ok 2024-02-19T21:56:40.489 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:39.309260+0000 mgr.y (mgr.14514) 920 : cluster [DBG] pgmap v1190: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 3.2 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 716 op/s 2024-02-19T21:56:40.489 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:39.710040+0000 osd.7 (osd.7) 301 : cluster [DBG] 11.f scrub starts 2024-02-19T21:56:40.514 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:56:40.516 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:40.543 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:56:40.549 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:40.550 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:56:40.600 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:56:40.651 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:56:40.708 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:38.795777+0000 osd.0 (osd.0) 321 : cluster [DBG] 6.0 scrub starts 2024-02-19T21:56:40.708 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:38.817155+0000 osd.0 (osd.0) 322 : cluster [DBG] 6.0 scrub ok 2024-02-19T21:56:40.708 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:39.309260+0000 mgr.y (mgr.14514) 920 : cluster [DBG] pgmap v1190: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 3.2 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 716 op/s 2024-02-19T21:56:40.708 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:39.710040+0000 osd.7 (osd.7) 301 : cluster [DBG] 11.f scrub starts 2024-02-19T21:56:40.712 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:40.751 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:56:40.755 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:40.755 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:56:40.772 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:56:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:56:40] "GET /metrics HTTP/1.1" 200 176851 "" "Prometheus/2.33.4" 2024-02-19T21:56:40.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:38.795777+0000 osd.0 (osd.0) 321 : cluster [DBG] 6.0 scrub starts 2024-02-19T21:56:40.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:38.817155+0000 osd.0 (osd.0) 322 : cluster [DBG] 6.0 scrub ok 2024-02-19T21:56:40.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:39.309260+0000 mgr.y (mgr.14514) 920 : cluster [DBG] pgmap v1190: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 3.2 GiB data, 16 GiB used, 700 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 716 op/s 2024-02-19T21:56:40.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:39.710040+0000 osd.7 (osd.7) 301 : cluster [DBG] 11.f scrub starts 2024-02-19T21:56:40.856 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:56:40.909 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:56:40.942 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:40.942 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:56:41.043 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:56:41.100 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:41.135 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:56:41.144 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:41.144 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:56:41.245 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:56:41.305 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:41.338 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:56:41.343 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:41.343 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:56:41.444 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:56:41.491 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:41.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:39.777595+0000 osd.0 (osd.0) 323 : cluster [DBG] 3.1 scrub starts 2024-02-19T21:56:41.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:39.780075+0000 osd.0 (osd.0) 324 : cluster [DBG] 3.1 scrub ok 2024-02-19T21:56:41.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:40.999039+0000 osd.7 (osd.7) 302 : cluster [DBG] 11.f scrub ok 2024-02-19T21:56:41.557 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:56:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:56:41.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:39.777595+0000 osd.0 (osd.0) 323 : cluster [DBG] 3.1 scrub starts 2024-02-19T21:56:41.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:39.780075+0000 osd.0 (osd.0) 324 : cluster [DBG] 3.1 scrub ok 2024-02-19T21:56:41.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:40.999039+0000 osd.7 (osd.7) 302 : cluster [DBG] 11.f scrub ok 2024-02-19T21:56:41.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:39.777595+0000 osd.0 (osd.0) 323 : cluster [DBG] 3.1 scrub starts 2024-02-19T21:56:41.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:39.780075+0000 osd.0 (osd.0) 324 : cluster [DBG] 3.1 scrub ok 2024-02-19T21:56:41.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:40.999039+0000 osd.7 (osd.7) 302 : cluster [DBG] 11.f scrub ok 2024-02-19T21:56:41.987 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:56:41.990 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:41.990 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:56:42.091 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:56:42.140 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:42.173 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:56:42.178 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:42.178 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:56:42.279 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:56:42.324 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:42.441 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:56:42.444 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:42.445 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:56:42.522 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:41.310022+0000 mgr.y (mgr.14514) 921 : cluster [DBG] pgmap v1191: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 3.0 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.08k op/s 2024-02-19T21:56:42.522 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:41.377043+0000 mgr.y (mgr.14514) 922 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:56:42.522 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:41.578490+0000 osd.4 (osd.4) 255 : cluster [DBG] 11.e scrub starts 2024-02-19T21:56:42.522 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:41.581441+0000 mon.a (mon.0) 2014 : audit [INF] from='client.? 172.21.15.80:0/1463774231' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pgp_num", "val": "16"}]: dispatch 2024-02-19T21:56:42.545 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:56:42.552 INFO:teuthology.orchestra.run.smithi080.stderr:set pool 11 pgp_num to 16 2024-02-19T21:56:42.584 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:41.310022+0000 mgr.y (mgr.14514) 921 : cluster [DBG] pgmap v1191: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 3.0 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.08k op/s 2024-02-19T21:56:42.584 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:41.377043+0000 mgr.y (mgr.14514) 922 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:56:42.584 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:41.578490+0000 osd.4 (osd.4) 255 : cluster [DBG] 11.e scrub starts 2024-02-19T21:56:42.584 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:41.581441+0000 mon.a (mon.0) 2014 : audit [INF] from='client.? 172.21.15.80:0/1463774231' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pgp_num", "val": "16"}]: dispatch 2024-02-19T21:56:42.584 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:41.310022+0000 mgr.y (mgr.14514) 921 : cluster [DBG] pgmap v1191: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 3.0 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1.08k op/s 2024-02-19T21:56:42.584 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:41.377043+0000 mgr.y (mgr.14514) 922 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:56:42.584 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:41.578490+0000 osd.4 (osd.4) 255 : cluster [DBG] 11.e scrub starts 2024-02-19T21:56:42.584 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:41.581441+0000 mon.a (mon.0) 2014 : audit [INF] from='client.? 172.21.15.80:0/1463774231' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pgp_num", "val": "16"}]: dispatch 2024-02-19T21:56:42.605 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:43.016 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:56:43.788 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:56:43.796 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:43.797 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:56:43.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:42.504608+0000 osd.7 (osd.7) 303 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:56:43.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:42.504648+0000 osd.7 (osd.7) 304 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:56:43.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:42.533404+0000 mon.a (mon.0) 2015 : audit [INF] from='client.? 172.21.15.80:0/1463774231' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pgp_num", "val": "16"}]': finished 2024-02-19T21:56:43.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:42.533466+0000 mon.a (mon.0) 2016 : cluster [DBG] osdmap e545: 8 total, 8 up, 8 in 2024-02-19T21:56:43.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:42.988792+0000 osd.4 (osd.4) 256 : cluster [DBG] 11.e scrub ok 2024-02-19T21:56:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:56:43.821 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:42.504608+0000 osd.7 (osd.7) 303 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:56:43.822 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:42.504648+0000 osd.7 (osd.7) 304 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:56:43.822 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:42.533404+0000 mon.a (mon.0) 2015 : audit [INF] from='client.? 172.21.15.80:0/1463774231' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pgp_num", "val": "16"}]': finished 2024-02-19T21:56:43.822 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:42.533466+0000 mon.a (mon.0) 2016 : cluster [DBG] osdmap e545: 8 total, 8 up, 8 in 2024-02-19T21:56:43.822 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:42.988792+0000 osd.4 (osd.4) 256 : cluster [DBG] 11.e scrub ok 2024-02-19T21:56:43.822 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:42.504608+0000 osd.7 (osd.7) 303 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:56:43.822 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:42.504648+0000 osd.7 (osd.7) 304 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:56:43.822 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:42.533404+0000 mon.a (mon.0) 2015 : audit [INF] from='client.? 172.21.15.80:0/1463774231' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pgp_num", "val": "16"}]': finished 2024-02-19T21:56:43.822 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:42.533466+0000 mon.a (mon.0) 2016 : cluster [DBG] osdmap e545: 8 total, 8 up, 8 in 2024-02-19T21:56:43.822 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:42.988792+0000 osd.4 (osd.4) 256 : cluster [DBG] 11.e scrub ok 2024-02-19T21:56:43.898 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:56:43.955 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:43.986 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:56:43.992 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:43.993 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:56:44.093 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:56:44.136 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:44.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:43.262762+0000 osd.1 (osd.1) 280 : cluster [DBG] 2.6 scrub starts 2024-02-19T21:56:44.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:43.263546+0000 osd.1 (osd.1) 281 : cluster [DBG] 2.6 scrub ok 2024-02-19T21:56:44.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:43.310422+0000 mgr.y (mgr.14514) 923 : cluster [DBG] pgmap v1193: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 2.9 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.11k op/s 2024-02-19T21:56:44.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:43.352120+0000 osd.5 (osd.5) 315 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:56:44.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:43.352170+0000 osd.5 (osd.5) 316 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:56:44.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:43.559651+0000 mon.a (mon.0) 2017 : cluster [DBG] osdmap e546: 8 total, 8 up, 8 in 2024-02-19T21:56:44.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:43.262762+0000 osd.1 (osd.1) 280 : cluster [DBG] 2.6 scrub starts 2024-02-19T21:56:44.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:43.263546+0000 osd.1 (osd.1) 281 : cluster [DBG] 2.6 scrub ok 2024-02-19T21:56:44.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:43.310422+0000 mgr.y (mgr.14514) 923 : cluster [DBG] pgmap v1193: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 2.9 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.11k op/s 2024-02-19T21:56:44.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:43.352120+0000 osd.5 (osd.5) 315 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:56:44.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:43.352170+0000 osd.5 (osd.5) 316 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:56:44.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:43.559651+0000 mon.a (mon.0) 2017 : cluster [DBG] osdmap e546: 8 total, 8 up, 8 in 2024-02-19T21:56:45.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:43.262762+0000 osd.1 (osd.1) 280 : cluster [DBG] 2.6 scrub starts 2024-02-19T21:56:45.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:43.263546+0000 osd.1 (osd.1) 281 : cluster [DBG] 2.6 scrub ok 2024-02-19T21:56:45.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:43.310422+0000 mgr.y (mgr.14514) 923 : cluster [DBG] pgmap v1193: 138 pgs: 1 active+clean+scrubbing, 137 active+clean; 2.9 GiB data, 15 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.11k op/s 2024-02-19T21:56:45.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:43.352120+0000 osd.5 (osd.5) 315 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:56:45.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:43.352170+0000 osd.5 (osd.5) 316 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:56:45.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:43.559651+0000 mon.a (mon.0) 2017 : cluster [DBG] osdmap e546: 8 total, 8 up, 8 in 2024-02-19T21:56:46.057 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:56:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:56:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:56:46.302 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:56:46.312 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:46.313 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:56:46.414 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:56:46.462 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:46.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:44.768244+0000 osd.0 (osd.0) 325 : cluster [DBG] 4.3 scrub starts 2024-02-19T21:56:46.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:44.771290+0000 osd.0 (osd.0) 326 : cluster [DBG] 4.3 scrub ok 2024-02-19T21:56:46.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:45.310938+0000 mgr.y (mgr.14514) 924 : cluster [DBG] pgmap v1195: 138 pgs: 138 active+clean; 2.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 870 op/s 2024-02-19T21:56:46.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:45.594719+0000 osd.4 (osd.4) 257 : cluster [DBG] 4.d scrub starts 2024-02-19T21:56:46.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:45.598851+0000 osd.4 (osd.4) 258 : cluster [DBG] 4.d scrub ok 2024-02-19T21:56:46.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:45.643588+0000 osd.7 (osd.7) 305 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:56:46.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:45.653227+0000 osd.7 (osd.7) 306 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:56:46.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:44.768244+0000 osd.0 (osd.0) 325 : cluster [DBG] 4.3 scrub starts 2024-02-19T21:56:46.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:44.771290+0000 osd.0 (osd.0) 326 : cluster [DBG] 4.3 scrub ok 2024-02-19T21:56:46.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:45.310938+0000 mgr.y (mgr.14514) 924 : cluster [DBG] pgmap v1195: 138 pgs: 138 active+clean; 2.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 870 op/s 2024-02-19T21:56:46.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:45.594719+0000 osd.4 (osd.4) 257 : cluster [DBG] 4.d scrub starts 2024-02-19T21:56:46.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:45.598851+0000 osd.4 (osd.4) 258 : cluster [DBG] 4.d scrub ok 2024-02-19T21:56:46.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:45.643588+0000 osd.7 (osd.7) 305 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:56:46.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:45.653227+0000 osd.7 (osd.7) 306 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:56:46.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:44.768244+0000 osd.0 (osd.0) 325 : cluster [DBG] 4.3 scrub starts 2024-02-19T21:56:46.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:44.771290+0000 osd.0 (osd.0) 326 : cluster [DBG] 4.3 scrub ok 2024-02-19T21:56:46.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:45.310938+0000 mgr.y (mgr.14514) 924 : cluster [DBG] pgmap v1195: 138 pgs: 138 active+clean; 2.8 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 870 op/s 2024-02-19T21:56:46.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:45.594719+0000 osd.4 (osd.4) 257 : cluster [DBG] 4.d scrub starts 2024-02-19T21:56:46.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:45.598851+0000 osd.4 (osd.4) 258 : cluster [DBG] 4.d scrub ok 2024-02-19T21:56:46.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:45.643588+0000 osd.7 (osd.7) 305 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:56:46.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:45.653227+0000 osd.7 (osd.7) 306 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:56:47.485 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:45.952244+0000 osd.6 (osd.6) 289 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:56:47.485 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:45.956444+0000 osd.6 (osd.6) 290 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:56:47.485 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:46.374033+0000 osd.3 (osd.3) 267 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:56:47.485 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:46.377719+0000 osd.3 (osd.3) 268 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:56:47.737 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:56:47.741 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:47.742 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:56:47.746 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:45.952244+0000 osd.6 (osd.6) 289 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:56:47.746 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:45.956444+0000 osd.6 (osd.6) 290 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:56:47.746 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:46.374033+0000 osd.3 (osd.3) 267 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:56:47.746 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:46.377719+0000 osd.3 (osd.3) 268 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:56:47.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:45.952244+0000 osd.6 (osd.6) 289 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:56:47.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:45.956444+0000 osd.6 (osd.6) 290 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:56:47.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:46.374033+0000 osd.3 (osd.3) 267 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:56:47.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:46.377719+0000 osd.3 (osd.3) 268 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:56:47.843 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0 2024-02-19T21:56:47.901 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:48.511 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-02-19T21:56:48.697 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:46.641873+0000 osd.5 (osd.5) 317 : cluster [DBG] 6.19 scrub starts 2024-02-19T21:56:48.697 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:46.709545+0000 osd.5 (osd.5) 318 : cluster [DBG] 6.19 scrub ok 2024-02-19T21:56:48.697 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:46.768996+0000 osd.0 (osd.0) 327 : cluster [DBG] 4.6 scrub starts 2024-02-19T21:56:48.697 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:46.773110+0000 osd.0 (osd.0) 328 : cluster [DBG] 4.6 scrub ok 2024-02-19T21:56:48.698 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:46.968106+0000 osd.6 (osd.6) 291 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:56:48.698 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:46.979944+0000 osd.6 (osd.6) 292 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:56:48.698 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:47.311511+0000 mgr.y (mgr.14514) 925 : cluster [DBG] pgmap v1196: 138 pgs: 138 active+clean; 2.6 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s 2024-02-19T21:56:48.698 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:47.877900+0000 mon.c (mon.2) 133 : audit [INF] from='client.? 172.21.15.80:0/1157267652' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:56:48.698 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:47.878332+0000 mon.a (mon.0) 2018 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:56:48.698 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:46.641873+0000 osd.5 (osd.5) 317 : cluster [DBG] 6.19 scrub starts 2024-02-19T21:56:48.698 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:46.709545+0000 osd.5 (osd.5) 318 : cluster [DBG] 6.19 scrub ok 2024-02-19T21:56:48.698 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:46.768996+0000 osd.0 (osd.0) 327 : cluster [DBG] 4.6 scrub starts 2024-02-19T21:56:48.698 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:46.773110+0000 osd.0 (osd.0) 328 : cluster [DBG] 4.6 scrub ok 2024-02-19T21:56:48.698 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:46.968106+0000 osd.6 (osd.6) 291 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:56:48.699 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:46.979944+0000 osd.6 (osd.6) 292 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:56:48.699 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:47.311511+0000 mgr.y (mgr.14514) 925 : cluster [DBG] pgmap v1196: 138 pgs: 138 active+clean; 2.6 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s 2024-02-19T21:56:48.699 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:47.877900+0000 mon.c (mon.2) 133 : audit [INF] from='client.? 172.21.15.80:0/1157267652' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:56:48.699 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:47.878332+0000 mon.a (mon.0) 2018 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:56:48.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:46.641873+0000 osd.5 (osd.5) 317 : cluster [DBG] 6.19 scrub starts 2024-02-19T21:56:48.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:46.709545+0000 osd.5 (osd.5) 318 : cluster [DBG] 6.19 scrub ok 2024-02-19T21:56:48.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:46.768996+0000 osd.0 (osd.0) 327 : cluster [DBG] 4.6 scrub starts 2024-02-19T21:56:48.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:46.773110+0000 osd.0 (osd.0) 328 : cluster [DBG] 4.6 scrub ok 2024-02-19T21:56:48.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:46.968106+0000 osd.6 (osd.6) 291 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:56:48.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:46.979944+0000 osd.6 (osd.6) 292 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:56:48.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:47.311511+0000 mgr.y (mgr.14514) 925 : cluster [DBG] pgmap v1196: 138 pgs: 138 active+clean; 2.6 GiB data, 14 GiB used, 701 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s 2024-02-19T21:56:48.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:47.877900+0000 mon.c (mon.2) 133 : audit [INF] from='client.? 172.21.15.80:0/1157267652' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:56:48.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:47.878332+0000 mon.a (mon.0) 2018 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:56:49.004 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:56:49.008 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:49.009 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0' 2024-02-19T21:56:49.110 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:56:49.171 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:56:49.172 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-02-19T21:56:49.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.172 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.25952.0:196391 11.9 e547/492 11:91aa4b60:::benchmark_data_smithi080_184406_object78782:head v 547'12036, mlcod=547'12034)", 2024-02-19T21:56:49.172 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:56:49.162706+0000", 2024-02-19T21:56:49.172 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0093689710000000002, 2024-02-19T21:56:49.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0094043410000000001, 2024-02-19T21:56:49.172 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:56:49.172 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:56:49.172 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:56:49.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:56:49.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.162706+0000", 2024-02-19T21:56:49.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:56:49.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:56:49.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.162706+0000", 2024-02-19T21:56:49.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:56:49.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:56:49.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.162704+0000", 2024-02-19T21:56:49.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4328000000000001e-05 2024-02-19T21:56:49.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:56:49.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.162719+0000", 2024-02-19T21:56:49.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3548e-05 2024-02-19T21:56:49.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:56:49.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.162732+0000", 2024-02-19T21:56:49.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2369999999999997e-06 2024-02-19T21:56:49.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:56:49.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.162739+0000", 2024-02-19T21:56:49.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1401000000000004e-05 2024-02-19T21:56:49.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:49.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.162800+0000", 2024-02-19T21:56:49.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1267999999999999e-05 2024-02-19T21:56:49.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:56:49.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.162831+0000", 2024-02-19T21:56:49.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125573 2024-02-19T21:56:49.175 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:49.175 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:49.175 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:49.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.176 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.25952.0:196393 11.1 e547/492 11:8f320daf:::benchmark_data_smithi080_184406_object78784:head v 547'12269, mlcod=547'12267)", 2024-02-19T21:56:49.176 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:56:49.162879+0000", 2024-02-19T21:56:49.176 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0091952779999999994, 2024-02-19T21:56:49.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0092908039999999997, 2024-02-19T21:56:49.176 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:56:49.176 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:56:49.176 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:56:49.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:56:49.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.162879+0000", 2024-02-19T21:56:49.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:56:49.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:56:49.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.162879+0000", 2024-02-19T21:56:49.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:56:49.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:56:49.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.162879+0000", 2024-02-19T21:56:49.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9079999999999995e-06 2024-02-19T21:56:49.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:56:49.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.162887+0000", 2024-02-19T21:56:49.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.435e-06 2024-02-19T21:56:49.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:56:49.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.162894+0000", 2024-02-19T21:56:49.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3390000000000003e-06 2024-02-19T21:56:49.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:56:49.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.162899+0000", 2024-02-19T21:56:49.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3479999999999997e-05 2024-02-19T21:56:49.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:49.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.162942+0000", 2024-02-19T21:56:49.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6208000000000001e-05 2024-02-19T21:56:49.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:56:49.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.162958+0000", 2024-02-19T21:56:49.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8790999999999998e-05 2024-02-19T21:56:49.179 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:49.179 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:49.179 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:49.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.180 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.25952.0:196400 11.1 e547/492 11:8f3b9e2e:::benchmark_data_smithi080_184406_object78791:head v 547'12270, mlcod=547'12267)", 2024-02-19T21:56:49.180 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:56:49.168178+0000", 2024-02-19T21:56:49.180 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0038966909999999999, 2024-02-19T21:56:49.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040536210000000003, 2024-02-19T21:56:49.180 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:56:49.180 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:56:49.180 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:56:49.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.180 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:56:49.180 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.168178+0000", 2024-02-19T21:56:49.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:56:49.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:56:49.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.168178+0000", 2024-02-19T21:56:49.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:56:49.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:56:49.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.168177+0000", 2024-02-19T21:56:49.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3394999999999999e-05 2024-02-19T21:56:49.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:56:49.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.168201+0000", 2024-02-19T21:56:49.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1423000000000001e-05 2024-02-19T21:56:49.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:56:49.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.168212+0000", 2024-02-19T21:56:49.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.896e-06 2024-02-19T21:56:49.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:56:49.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.168218+0000", 2024-02-19T21:56:49.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4523999999999993e-05 2024-02-19T21:56:49.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:49.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.168292+0000", 2024-02-19T21:56:49.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8164000000000001e-05 2024-02-19T21:56:49.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:56:49.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.168311+0000", 2024-02-19T21:56:49.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013265799999999999 2024-02-19T21:56:49.183 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:49.183 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:49.183 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:49.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.183 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.25952.0:196392 11.9 e547/492 11:995cb5da:::benchmark_data_smithi080_184406_object78783:head v 547'12037, mlcod=547'12034)", 2024-02-19T21:56:49.183 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:56:49.168232+0000", 2024-02-19T21:56:49.184 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0038426860000000001, 2024-02-19T21:56:49.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040625230000000002, 2024-02-19T21:56:49.184 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:56:49.184 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:56:49.184 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:56:49.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:56:49.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.168232+0000", 2024-02-19T21:56:49.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:56:49.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:56:49.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.168232+0000", 2024-02-19T21:56:49.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:56:49.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:56:49.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.168232+0000", 2024-02-19T21:56:49.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7369999999999997e-06 2024-02-19T21:56:49.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:56:49.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.168236+0000", 2024-02-19T21:56:49.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7150000000000003e-06 2024-02-19T21:56:49.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:56:49.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.168242+0000", 2024-02-19T21:56:49.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.512e-06 2024-02-19T21:56:49.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.186 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:56:49.186 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.168246+0000", 2024-02-19T21:56:49.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001931887 2024-02-19T21:56:49.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.186 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:56:49.186 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.170177+0000", 2024-02-19T21:56:49.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.895e-05 2024-02-19T21:56:49.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:56:49.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:56:49.186 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:56:49.186 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:56:49.170196+0000", 2024-02-19T21:56:49.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019644250000000001 2024-02-19T21:56:49.187 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:49.187 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:56:49.187 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:49.187 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:56:49.187 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-02-19T21:56:49.187 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 4 2024-02-19T21:56:49.187 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:56:49.187 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:49.215 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:56:49.219 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:49.220 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:56:49.321 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:56:49.375 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:49.404 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:56:49.406 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:49.407 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:56:49.500 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:47.627166+0000 osd.5 (osd.5) 319 : cluster [DBG] 6.a scrub starts 2024-02-19T21:56:49.500 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:47.631193+0000 osd.5 (osd.5) 320 : cluster [DBG] 6.a scrub ok 2024-02-19T21:56:49.500 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:48.477963+0000 mon.a (mon.0) 2019 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:56:49.500 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:48.477991+0000 mon.a (mon.0) 2020 : cluster [INF] Cluster is now healthy 2024-02-19T21:56:49.500 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:48.490018+0000 mon.a (mon.0) 2021 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:56:49.501 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:48.490075+0000 mon.a (mon.0) 2022 : cluster [DBG] osdmap e547: 8 total, 8 up, 8 in 2024-02-19T21:56:49.501 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:48.677913+0000 osd.4 (osd.4) 259 : cluster [DBG] 4.1a scrub starts 2024-02-19T21:56:49.501 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:48.682375+0000 osd.4 (osd.4) 260 : cluster [DBG] 4.1a scrub ok 2024-02-19T21:56:49.501 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:48.743642+0000 osd.7 (osd.7) 307 : cluster [DBG] 6.1c scrub starts 2024-02-19T21:56:49.501 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:48.750667+0000 osd.7 (osd.7) 308 : cluster [DBG] 6.1c scrub ok 2024-02-19T21:56:49.501 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:48.991529+0000 mon.a (mon.0) 2023 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:56:49.508 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:56:49.558 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:49.627 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:56:49.636 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:49.636 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:56:49.737 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:56:49.738 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:47.627166+0000 osd.5 (osd.5) 319 : cluster [DBG] 6.a scrub starts 2024-02-19T21:56:49.739 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:47.631193+0000 osd.5 (osd.5) 320 : cluster [DBG] 6.a scrub ok 2024-02-19T21:56:49.739 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:48.477963+0000 mon.a (mon.0) 2019 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:56:49.739 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:48.477991+0000 mon.a (mon.0) 2020 : cluster [INF] Cluster is now healthy 2024-02-19T21:56:49.739 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:48.490018+0000 mon.a (mon.0) 2021 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:56:49.739 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:48.490075+0000 mon.a (mon.0) 2022 : cluster [DBG] osdmap e547: 8 total, 8 up, 8 in 2024-02-19T21:56:49.739 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:48.677913+0000 osd.4 (osd.4) 259 : cluster [DBG] 4.1a scrub starts 2024-02-19T21:56:49.739 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:48.682375+0000 osd.4 (osd.4) 260 : cluster [DBG] 4.1a scrub ok 2024-02-19T21:56:49.739 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:48.743642+0000 osd.7 (osd.7) 307 : cluster [DBG] 6.1c scrub starts 2024-02-19T21:56:49.739 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:48.750667+0000 osd.7 (osd.7) 308 : cluster [DBG] 6.1c scrub ok 2024-02-19T21:56:49.739 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:48.991529+0000 mon.a (mon.0) 2023 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:56:49.739 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:47.627166+0000 osd.5 (osd.5) 319 : cluster [DBG] 6.a scrub starts 2024-02-19T21:56:49.739 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:47.631193+0000 osd.5 (osd.5) 320 : cluster [DBG] 6.a scrub ok 2024-02-19T21:56:49.740 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:48.477963+0000 mon.a (mon.0) 2019 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:56:49.740 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:48.477991+0000 mon.a (mon.0) 2020 : cluster [INF] Cluster is now healthy 2024-02-19T21:56:49.740 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:48.490018+0000 mon.a (mon.0) 2021 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:56:49.740 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:48.490075+0000 mon.a (mon.0) 2022 : cluster [DBG] osdmap e547: 8 total, 8 up, 8 in 2024-02-19T21:56:49.740 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:48.677913+0000 osd.4 (osd.4) 259 : cluster [DBG] 4.1a scrub starts 2024-02-19T21:56:49.740 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:48.682375+0000 osd.4 (osd.4) 260 : cluster [DBG] 4.1a scrub ok 2024-02-19T21:56:49.740 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:48.743642+0000 osd.7 (osd.7) 307 : cluster [DBG] 6.1c scrub starts 2024-02-19T21:56:49.740 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:48.750667+0000 osd.7 (osd.7) 308 : cluster [DBG] 6.1c scrub ok 2024-02-19T21:56:49.740 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:48.991529+0000 mon.a (mon.0) 2023 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:56:49.796 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:49.835 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:56:49.841 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:49.842 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:56:49.940 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 4, 5, 6, 7, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 6, 7, 2] 2024-02-19T21:56:49.940 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-02-19T21:56:49.940 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [0, 1, 3, 4, 5, 6, 7, 2] 2024-02-19T21:56:49.940 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-02-19T21:56:49.941 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.0 2024-02-19T21:56:49.943 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:56:49.982 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:49.995 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 21:56:49 smithi080 systemd[1]: Stopping Ceph osd.0 for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T21:56:50.014 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:56:50.017 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:50.018 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:56:50.119 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:56:50.207 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:50.221 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_blocked_ops 2024-02-19T21:56:50.245 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:56:50.253 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:50.254 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:56:50.354 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:56:50.387 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:50.411 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:56:50.416 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:50.416 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:56:50.516 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:49.198812+0000 osd.1 (osd.1) 282 : cluster [DBG] 4.7 scrub starts 2024-02-19T21:56:50.516 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:49.205224+0000 osd.1 (osd.1) 283 : cluster [DBG] 4.7 scrub ok 2024-02-19T21:56:50.516 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:49.311887+0000 mgr.y (mgr.14514) 926 : cluster [DBG] pgmap v1198: 138 pgs: 138 active+clean; 2.6 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 755 B/s rd, 0 B/s wr, 760 op/s 2024-02-19T21:56:50.517 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:56:50.526 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:49.198812+0000 osd.1 (osd.1) 282 : cluster [DBG] 4.7 scrub starts 2024-02-19T21:56:50.526 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:49.205224+0000 osd.1 (osd.1) 283 : cluster [DBG] 4.7 scrub ok 2024-02-19T21:56:50.526 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:49.311887+0000 mgr.y (mgr.14514) 926 : cluster [DBG] pgmap v1198: 138 pgs: 138 active+clean; 2.6 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 755 B/s rd, 0 B/s wr, 760 op/s 2024-02-19T21:56:50.527 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:49.886053+0000 osd.2 (osd.2) 67 : cluster [DBG] 2.e scrub starts 2024-02-19T21:56:50.527 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:49.894839+0000 osd.2 (osd.2) 68 : cluster [DBG] 2.e scrub ok 2024-02-19T21:56:50.527 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:50.457661+0000 mon.a (mon.0) 2024 : cluster [DBG] osdmap e548: 8 total, 8 up, 8 in 2024-02-19T21:56:50.527 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:50.480294+0000 mon.b (mon.1) 85 : audit [DBG] from='client.? 172.21.15.80:0/502691626' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:56:50.527 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:49.198812+0000 osd.1 (osd.1) 282 : cluster [DBG] 4.7 scrub starts 2024-02-19T21:56:50.527 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:49.205224+0000 osd.1 (osd.1) 283 : cluster [DBG] 4.7 scrub ok 2024-02-19T21:56:50.527 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:49.311887+0000 mgr.y (mgr.14514) 926 : cluster [DBG] pgmap v1198: 138 pgs: 138 active+clean; 2.6 GiB data, 14 GiB used, 702 GiB / 715 GiB avail; 755 B/s rd, 0 B/s wr, 760 op/s 2024-02-19T21:56:50.527 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:49.886053+0000 osd.2 (osd.2) 67 : cluster [DBG] 2.e scrub starts 2024-02-19T21:56:50.527 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:49.894839+0000 osd.2 (osd.2) 68 : cluster [DBG] 2.e scrub ok 2024-02-19T21:56:50.527 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:50.457661+0000 mon.a (mon.0) 2024 : cluster [DBG] osdmap e548: 8 total, 8 up, 8 in 2024-02-19T21:56:50.527 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:50.480294+0000 mon.b (mon.1) 85 : audit [DBG] from='client.? 172.21.15.80:0/502691626' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:56:50.536 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-02-19T21:56:50.563 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:50.566 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:56:50.586 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:56:50.620 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:56:50.653 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:56:50.690 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:56:50.731 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:56:50.757 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:56:50.773 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 21:56:50 smithi080 bash[198072]: Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T21:56:50.774 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = 'false' 2024-02-19T21:56:50.774 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:56:50.774 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:56:50.774 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:56:50.774 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:56:50.774 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:56:50.774 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:56:50.774 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:56:50.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:49.886053+0000 osd.2 (osd.2) 67 : cluster [DBG] 2.e scrub starts 2024-02-19T21:56:50.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:49.894839+0000 osd.2 (osd.2) 68 : cluster [DBG] 2.e scrub ok 2024-02-19T21:56:50.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:50.457661+0000 mon.a (mon.0) 2024 : cluster [DBG] osdmap e548: 8 total, 8 up, 8 in 2024-02-19T21:56:50.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:50.480294+0000 mon.b (mon.1) 85 : audit [DBG] from='client.? 172.21.15.80:0/502691626' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:56:51.096 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:56:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:56:50] "GET /metrics HTTP/1.1" 200 176844 "" "Prometheus/2.33.4" 2024-02-19T21:56:51.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:56:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:56:51.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:50.299124+0000 osd.3 (osd.3) 269 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:56:51.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:50.308008+0000 osd.3 (osd.3) 270 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:56:51.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:50.336601+0000 osd.2 (osd.2) 69 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:56:51.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:50.336665+0000 osd.2 (osd.2) 70 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:56:51.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:50.668424+0000 osd.7 (osd.7) 309 : cluster [DBG] 11.4 scrub starts 2024-02-19T21:56:51.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:50.299124+0000 osd.3 (osd.3) 269 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:56:51.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:50.308008+0000 osd.3 (osd.3) 270 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:56:51.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:50.336601+0000 osd.2 (osd.2) 69 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:56:51.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:50.336665+0000 osd.2 (osd.2) 70 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:56:51.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:50.668424+0000 osd.7 (osd.7) 309 : cluster [DBG] 11.4 scrub starts 2024-02-19T21:56:51.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:50.299124+0000 osd.3 (osd.3) 269 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:56:51.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:50.308008+0000 osd.3 (osd.3) 270 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:56:51.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:50.336601+0000 osd.2 (osd.2) 69 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:56:51.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:50.336665+0000 osd.2 (osd.2) 70 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:56:51.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:50.668424+0000 osd.7 (osd.7) 309 : cluster [DBG] 11.4 scrub starts 2024-02-19T21:56:52.522 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:56:52.529 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:52.529 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:56:52.543 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:51.315257+0000 mgr.y (mgr.14514) 927 : cluster [DBG] pgmap v1200: 138 pgs: 138 active+clean; 2.3 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.25k op/s 2024-02-19T21:56:52.543 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:56:51.394983+0000 mgr.y (mgr.14514) 928 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:56:52.543 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:51.650561+0000 osd.7 (osd.7) 310 : cluster [DBG] 11.4 scrub ok 2024-02-19T21:56:52.544 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:51.315257+0000 mgr.y (mgr.14514) 927 : cluster [DBG] pgmap v1200: 138 pgs: 138 active+clean; 2.3 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.25k op/s 2024-02-19T21:56:52.544 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:56:51.394983+0000 mgr.y (mgr.14514) 928 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:56:52.544 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:51.650561+0000 osd.7 (osd.7) 310 : cluster [DBG] 11.4 scrub ok 2024-02-19T21:56:52.630 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:56:52.677 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:52.713 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:56:52.719 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:52.719 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:56:52.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:51.315257+0000 mgr.y (mgr.14514) 927 : cluster [DBG] pgmap v1200: 138 pgs: 138 active+clean; 2.3 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1.25k op/s 2024-02-19T21:56:52.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:56:51.394983+0000 mgr.y (mgr.14514) 928 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:56:52.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:51.650561+0000 osd.7 (osd.7) 310 : cluster [DBG] 11.4 scrub ok 2024-02-19T21:56:52.820 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:56:52.874 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:53.146 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:56:53.149 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:53.150 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:56:53.171 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:56:53.251 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:56:53.290 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:53.327 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:56:53.332 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:53.333 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:56:53.433 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:56:53.472 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:53.506 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:53.507 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:56:53.507 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:56:53.540 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 21:56:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-0[48652]: debug 2024-02-19T21:56:53.332+0000 7f0b6ec8b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-19T21:56:53.540 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 21:56:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-0[48652]: debug 2024-02-19T21:56:53.332+0000 7f0b6ec8b700 -1 osd.0 549 *** Got signal Terminated *** 2024-02-19T21:56:53.541 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 21:56:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-0[48652]: debug 2024-02-19T21:56:53.333+0000 7f0b6ec8b700 -1 osd.0 549 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T21:56:53.541 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:52.182816+0000 osd.0 (osd.0) 329 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:56:53.541 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:52.182872+0000 osd.0 (osd.0) 330 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:56:53.541 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:52.253535+0000 osd.3 (osd.3) 271 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:56:53.541 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:52.254936+0000 osd.3 (osd.3) 272 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:56:53.542 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:52.290620+0000 osd.1 (osd.1) 284 : cluster [DBG] 2.4 scrub starts 2024-02-19T21:56:53.542 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:52.291711+0000 osd.1 (osd.1) 285 : cluster [DBG] 2.4 scrub ok 2024-02-19T21:56:53.542 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:52.555584+0000 mon.a (mon.0) 2025 : cluster [DBG] osdmap e549: 8 total, 8 up, 8 in 2024-02-19T21:56:53.542 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:53.335680+0000 mon.a (mon.0) 2026 : cluster [INF] osd.0 marked itself down and dead 2024-02-19T21:56:53.542 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:52.182816+0000 osd.0 (osd.0) 329 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:56:53.542 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:52.182872+0000 osd.0 (osd.0) 330 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:56:53.607 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:56:53.639 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:53.660 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:56:53.663 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:53.663 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:56:53.764 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:56:53.791 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:53.810 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:56:53.812 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:53.812 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:56:53.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:52.182816+0000 osd.0 (osd.0) 329 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:56:53.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:52.182872+0000 osd.0 (osd.0) 330 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:56:53.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:52.253535+0000 osd.3 (osd.3) 271 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:56:53.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:52.254936+0000 osd.3 (osd.3) 272 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:56:53.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:52.290620+0000 osd.1 (osd.1) 284 : cluster [DBG] 2.4 scrub starts 2024-02-19T21:56:53.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:52.291711+0000 osd.1 (osd.1) 285 : cluster [DBG] 2.4 scrub ok 2024-02-19T21:56:53.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:52.555584+0000 mon.a (mon.0) 2025 : cluster [DBG] osdmap e549: 8 total, 8 up, 8 in 2024-02-19T21:56:53.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:53.335680+0000 mon.a (mon.0) 2026 : cluster [INF] osd.0 marked itself down and dead 2024-02-19T21:56:53.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:52.253535+0000 osd.3 (osd.3) 271 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:56:53.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:52.254936+0000 osd.3 (osd.3) 272 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:56:53.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:52.290620+0000 osd.1 (osd.1) 284 : cluster [DBG] 2.4 scrub starts 2024-02-19T21:56:53.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:52.291711+0000 osd.1 (osd.1) 285 : cluster [DBG] 2.4 scrub ok 2024-02-19T21:56:53.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:52.555584+0000 mon.a (mon.0) 2025 : cluster [DBG] osdmap e549: 8 total, 8 up, 8 in 2024-02-19T21:56:53.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:53.335680+0000 mon.a (mon.0) 2026 : cluster [INF] osd.0 marked itself down and dead 2024-02-19T21:56:53.914 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:56:53.945 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:54.018 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:56:54.085 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:54.085 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:56:54.186 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:56:54.214 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:54.233 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:56:54.236 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:54.236 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:56:54.308 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set noscrub 2024-02-19T21:56:54.337 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:56:54.364 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:54.383 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:56:54.385 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:54.386 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:56:54.487 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:56:54.516 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:54.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:53.315647+0000 mgr.y (mgr.14514) 929 : cluster [DBG] pgmap v1202: 138 pgs: 138 active+clean; 2.3 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 978 op/s 2024-02-19T21:56:54.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:53.553961+0000 mon.a (mon.0) 2027 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T21:56:54.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:53.579934+0000 mon.a (mon.0) 2028 : cluster [DBG] osdmap e550: 8 total, 7 up, 8 in 2024-02-19T21:56:54.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:53.315647+0000 mgr.y (mgr.14514) 929 : cluster [DBG] pgmap v1202: 138 pgs: 138 active+clean; 2.3 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 978 op/s 2024-02-19T21:56:54.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:53.553961+0000 mon.a (mon.0) 2027 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T21:56:54.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:53.579934+0000 mon.a (mon.0) 2028 : cluster [DBG] osdmap e550: 8 total, 7 up, 8 in 2024-02-19T21:56:54.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:53.315647+0000 mgr.y (mgr.14514) 929 : cluster [DBG] pgmap v1202: 138 pgs: 138 active+clean; 2.3 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 978 op/s 2024-02-19T21:56:54.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:53.553961+0000 mon.a (mon.0) 2027 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T21:56:54.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:53.579934+0000 mon.a (mon.0) 2028 : cluster [DBG] osdmap e550: 8 total, 7 up, 8 in 2024-02-19T21:56:55.134 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:56:55.348 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 21:56:55 smithi080 bash[198294]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-0 2024-02-19T21:56:55.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:53.582642+0000 osd.5 (osd.5) 321 : cluster [DBG] 6.7 scrub starts 2024-02-19T21:56:55.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:53.702442+0000 osd.5 (osd.5) 322 : cluster [DBG] 6.7 scrub ok 2024-02-19T21:56:55.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:54.218009+0000 osd.1 (osd.1) 286 : cluster [DBG] 2.a scrub starts 2024-02-19T21:56:55.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:54.218897+0000 osd.1 (osd.1) 287 : cluster [DBG] 2.a scrub ok 2024-02-19T21:56:55.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:54.578359+0000 mon.a (mon.0) 2029 : cluster [DBG] osdmap e551: 8 total, 7 up, 8 in 2024-02-19T21:56:55.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:55.462558+0000 mon.a (mon.0) 2030 : cluster [DBG] osdmap e552: 8 total, 7 up, 8 in 2024-02-19T21:56:55.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:53.582642+0000 osd.5 (osd.5) 321 : cluster [DBG] 6.7 scrub starts 2024-02-19T21:56:55.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:53.702442+0000 osd.5 (osd.5) 322 : cluster [DBG] 6.7 scrub ok 2024-02-19T21:56:55.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:54.218009+0000 osd.1 (osd.1) 286 : cluster [DBG] 2.a scrub starts 2024-02-19T21:56:55.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:54.218897+0000 osd.1 (osd.1) 287 : cluster [DBG] 2.a scrub ok 2024-02-19T21:56:55.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:54.578359+0000 mon.a (mon.0) 2029 : cluster [DBG] osdmap e551: 8 total, 7 up, 8 in 2024-02-19T21:56:55.849 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:55.462558+0000 mon.a (mon.0) 2030 : cluster [DBG] osdmap e552: 8 total, 7 up, 8 in 2024-02-19T21:56:55.937 INFO:teuthology.orchestra.run.smithi080.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-02-19T21:56:55.948 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:56:55.966 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:56:55.968 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:56:55.974 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:55.975 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:56:56.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:56:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:56:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:56:56.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:53.582642+0000 osd.5 (osd.5) 321 : cluster [DBG] 6.7 scrub starts 2024-02-19T21:56:56.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:53.702442+0000 osd.5 (osd.5) 322 : cluster [DBG] 6.7 scrub ok 2024-02-19T21:56:56.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:54.218009+0000 osd.1 (osd.1) 286 : cluster [DBG] 2.a scrub starts 2024-02-19T21:56:56.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:54.218897+0000 osd.1 (osd.1) 287 : cluster [DBG] 2.a scrub ok 2024-02-19T21:56:56.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:54.578359+0000 mon.a (mon.0) 2029 : cluster [DBG] osdmap e551: 8 total, 7 up, 8 in 2024-02-19T21:56:56.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:55.462558+0000 mon.a (mon.0) 2030 : cluster [DBG] osdmap e552: 8 total, 7 up, 8 in 2024-02-19T21:56:56.075 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:56:56.114 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:56.202 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:56:56.206 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:56.206 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:56:56.308 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:56:56.367 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:56.386 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:56:56.393 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:56.394 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:56:56.495 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:56:56.551 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:56.580 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:56:56.584 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:56.585 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:56:56.685 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:56:56.752 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:55.317939+0000 mgr.y (mgr.14514) 930 : cluster [DBG] pgmap v1205: 138 pgs: 4 active+undersized+degraded, 7 active+undersized, 14 stale+active+clean, 113 active+clean; 2.2 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 0 B/s wr, 358 op/s; 18/110487 objects degraded (0.016%) 2024-02-19T21:56:56.752 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:55.575033+0000 mon.a (mon.0) 2031 : cluster [WRN] Health check failed: Degraded data redundancy: 18/110487 objects degraded (0.016%), 4 pgs degraded (PG_DEGRADED) 2024-02-19T21:56:56.761 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:56.777 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-02-19T21:56:56.778 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_historic_ops 2024-02-19T21:56:56.792 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:56:56.795 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:56.795 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:56:56.815 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:55.317939+0000 mgr.y (mgr.14514) 930 : cluster [DBG] pgmap v1205: 138 pgs: 4 active+undersized+degraded, 7 active+undersized, 14 stale+active+clean, 113 active+clean; 2.2 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 0 B/s wr, 358 op/s; 18/110487 objects degraded (0.016%) 2024-02-19T21:56:56.815 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:55.575033+0000 mon.a (mon.0) 2031 : cluster [WRN] Health check failed: Degraded data redundancy: 18/110487 objects degraded (0.016%), 4 pgs degraded (PG_DEGRADED) 2024-02-19T21:56:56.816 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:55.317939+0000 mgr.y (mgr.14514) 930 : cluster [DBG] pgmap v1205: 138 pgs: 4 active+undersized+degraded, 7 active+undersized, 14 stale+active+clean, 113 active+clean; 2.2 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 0 B/s wr, 358 op/s; 18/110487 objects degraded (0.016%) 2024-02-19T21:56:56.816 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:55.575033+0000 mon.a (mon.0) 2031 : cluster [WRN] Health check failed: Degraded data redundancy: 18/110487 objects degraded (0.016%), 4 pgs degraded (PG_DEGRADED) 2024-02-19T21:56:56.897 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:56:56.934 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:56.971 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:56:56.977 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:56.977 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:56:57.078 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:56:57.117 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:57.197 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:56:57.201 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:57.202 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:56:57.303 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:56:57.348 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:57.378 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:56:57.381 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:57.382 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:56:57.483 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:56:57.541 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:57.572 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:56:57.576 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:57.577 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:56:57.678 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:56:57.740 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:57.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:56.302522+0000 osd.1 (osd.1) 288 : cluster [DBG] 6.1 scrub starts 2024-02-19T21:56:57.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:56.333510+0000 osd.1 (osd.1) 289 : cluster [DBG] 6.1 scrub ok 2024-02-19T21:56:57.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:56.811206+0000 osd.4 (osd.4) 261 : cluster [DBG] 6.1a scrub starts 2024-02-19T21:56:57.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:56.814165+0000 osd.4 (osd.4) 262 : cluster [DBG] 6.1a scrub ok 2024-02-19T21:56:57.782 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:56:57.788 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:57.788 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:56:57.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:56.302522+0000 osd.1 (osd.1) 288 : cluster [DBG] 6.1 scrub starts 2024-02-19T21:56:57.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:56.333510+0000 osd.1 (osd.1) 289 : cluster [DBG] 6.1 scrub ok 2024-02-19T21:56:57.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:56.811206+0000 osd.4 (osd.4) 261 : cluster [DBG] 6.1a scrub starts 2024-02-19T21:56:57.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:56.814165+0000 osd.4 (osd.4) 262 : cluster [DBG] 6.1a scrub ok 2024-02-19T21:56:57.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:56.302522+0000 osd.1 (osd.1) 288 : cluster [DBG] 6.1 scrub starts 2024-02-19T21:56:57.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:56.333510+0000 osd.1 (osd.1) 289 : cluster [DBG] 6.1 scrub ok 2024-02-19T21:56:57.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:56.811206+0000 osd.4 (osd.4) 261 : cluster [DBG] 6.1a scrub starts 2024-02-19T21:56:57.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:56.814165+0000 osd.4 (osd.4) 262 : cluster [DBG] 6.1a scrub ok 2024-02-19T21:56:57.888 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:56:57.935 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:58.020 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:56:58.025 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:58.025 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:56:58.126 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:56:58.181 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:58.218 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:56:58.228 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:58.229 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:56:58.329 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:56:58.376 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:58.412 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:56:58.415 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:58.416 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:56:58.517 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:56:58.583 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:58.631 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:56:58.637 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:58.638 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:56:58.739 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:56:58.795 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:58.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:57.318421+0000 mgr.y (mgr.14514) 931 : cluster [DBG] pgmap v1207: 138 pgs: 20 active+undersized+degraded, 24 active+undersized, 1 stale+active+clean, 93 active+clean; 2.1 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 214 B/s wr, 703 op/s; 8246/102789 objects degraded (8.022%); 2 B/s, 0 objects/s recovering 2024-02-19T21:56:58.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:57.710357+0000 osd.7 (osd.7) 311 : cluster [DBG] 5.4 scrub starts 2024-02-19T21:56:58.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:57.716685+0000 osd.7 (osd.7) 312 : cluster [DBG] 5.4 scrub ok 2024-02-19T21:56:58.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:57.318421+0000 mgr.y (mgr.14514) 931 : cluster [DBG] pgmap v1207: 138 pgs: 20 active+undersized+degraded, 24 active+undersized, 1 stale+active+clean, 93 active+clean; 2.1 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 214 B/s wr, 703 op/s; 8246/102789 objects degraded (8.022%); 2 B/s, 0 objects/s recovering 2024-02-19T21:56:58.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:57.710357+0000 osd.7 (osd.7) 311 : cluster [DBG] 5.4 scrub starts 2024-02-19T21:56:58.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:57.716685+0000 osd.7 (osd.7) 312 : cluster [DBG] 5.4 scrub ok 2024-02-19T21:56:58.847 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:56:58.859 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:58.859 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:56:58.859 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:57.318421+0000 mgr.y (mgr.14514) 931 : cluster [DBG] pgmap v1207: 138 pgs: 20 active+undersized+degraded, 24 active+undersized, 1 stale+active+clean, 93 active+clean; 2.1 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 214 B/s wr, 703 op/s; 8246/102789 objects degraded (8.022%); 2 B/s, 0 objects/s recovering 2024-02-19T21:56:58.859 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:57.710357+0000 osd.7 (osd.7) 311 : cluster [DBG] 5.4 scrub starts 2024-02-19T21:56:58.860 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:57.716685+0000 osd.7 (osd.7) 312 : cluster [DBG] 5.4 scrub ok 2024-02-19T21:56:58.960 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:56:59.015 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:59.062 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:56:59.070 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:59.070 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:56:59.171 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:56:59.222 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:59.257 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:56:59.263 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:59.264 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:56:59.365 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:56:59.421 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:59.448 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.0.service' 2024-02-19T21:56:59.450 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:56:59.456 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:59.457 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:56:59.506 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T21:56:59.507 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-02-19T21:56:59.507 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.0 2024-02-19T21:56:59.507 INFO:tasks.thrashosds.thrasher:remote for osd 0 is ubuntu@smithi080.front.sepia.ceph.com 2024-02-19T21:56:59.507 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -n osd.0 --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph-objectstore-tool --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-0 --journal-path /var/lib/ceph/osd/ceph-0/journal --op list-pgs 2024-02-19T21:56:59.557 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:56:59.611 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:59.658 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:56:59.664 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:59.664 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:56:59.765 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:56:59.835 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:57.998435+0000 osd.6 (osd.6) 293 : cluster [DBG] 2.7 scrub starts 2024-02-19T21:56:59.836 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:58.008627+0000 osd.6 (osd.6) 294 : cluster [DBG] 2.7 scrub ok 2024-02-19T21:56:59.836 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:58.302872+0000 osd.1 (osd.1) 290 : cluster [DBG] 3.0 scrub starts 2024-02-19T21:56:59.836 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:58.306909+0000 osd.1 (osd.1) 291 : cluster [DBG] 3.0 scrub ok 2024-02-19T21:56:59.836 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:58.800597+0000 osd.4 (osd.4) 263 : cluster [DBG] 6.17 scrub starts 2024-02-19T21:56:59.836 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:56:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:58.977218+0000 osd.4 (osd.4) 264 : cluster [DBG] 6.17 scrub ok 2024-02-19T21:56:59.836 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:57.998435+0000 osd.6 (osd.6) 293 : cluster [DBG] 2.7 scrub starts 2024-02-19T21:56:59.836 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:58.008627+0000 osd.6 (osd.6) 294 : cluster [DBG] 2.7 scrub ok 2024-02-19T21:56:59.837 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:58.302872+0000 osd.1 (osd.1) 290 : cluster [DBG] 3.0 scrub starts 2024-02-19T21:56:59.837 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:58.306909+0000 osd.1 (osd.1) 291 : cluster [DBG] 3.0 scrub ok 2024-02-19T21:56:59.837 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:58.800597+0000 osd.4 (osd.4) 263 : cluster [DBG] 6.17 scrub starts 2024-02-19T21:56:59.837 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:56:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:58.977218+0000 osd.4 (osd.4) 264 : cluster [DBG] 6.17 scrub ok 2024-02-19T21:56:59.844 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:56:59.845 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:57.998435+0000 osd.6 (osd.6) 293 : cluster [DBG] 2.7 scrub starts 2024-02-19T21:56:59.845 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:58.008627+0000 osd.6 (osd.6) 294 : cluster [DBG] 2.7 scrub ok 2024-02-19T21:56:59.845 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:58.302872+0000 osd.1 (osd.1) 290 : cluster [DBG] 3.0 scrub starts 2024-02-19T21:56:59.845 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:58.306909+0000 osd.1 (osd.1) 291 : cluster [DBG] 3.0 scrub ok 2024-02-19T21:56:59.845 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:58.800597+0000 osd.4 (osd.4) 263 : cluster [DBG] 6.17 scrub starts 2024-02-19T21:56:59.845 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:56:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:58.977218+0000 osd.4 (osd.4) 264 : cluster [DBG] 6.17 scrub ok 2024-02-19T21:56:59.871 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:56:59.876 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:56:59.877 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:56:59.978 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:57:00.003 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/osd.0/config 2024-02-19T21:57:00.029 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:00.289 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:57:00.325 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:57:00.345 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:57:00.376 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:57:00.411 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:57:00.445 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:57:00.490 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:57:00.490 INFO:teuthology.orchestra.run.smithi080.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-02-19T21:57:00.490 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:57:00.490 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:57:00.490 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:57:00.490 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:57:00.490 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:57:00.490 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:57:00.490 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:57:00.771 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:59.319013+0000 mgr.y (mgr.14514) 932 : cluster [DBG] pgmap v1208: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 2.0 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 170 B/s wr, 713 op/s; 12274/99990 objects degraded (12.275%); 2 B/s, 0 objects/s recovering 2024-02-19T21:57:00.771 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:59.727929+0000 osd.7 (osd.7) 313 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:57:00.771 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:56:59.822094+0000 osd.7 (osd.7) 314 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:57:00.771 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:00.259366+0000 mon.a (mon.0) 2032 : audit [DBG] from='client.? 172.21.15.80:0/3232818248' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:57:00.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:59.319013+0000 mgr.y (mgr.14514) 932 : cluster [DBG] pgmap v1208: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 2.0 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 170 B/s wr, 713 op/s; 12274/99990 objects degraded (12.275%); 2 B/s, 0 objects/s recovering 2024-02-19T21:57:00.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:59.727929+0000 osd.7 (osd.7) 313 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:57:00.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:56:59.822094+0000 osd.7 (osd.7) 314 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:57:00.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:00.259366+0000 mon.a (mon.0) 2032 : audit [DBG] from='client.? 172.21.15.80:0/3232818248' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:57:00.772 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:57:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:57:00] "GET /metrics HTTP/1.1" 200 176844 "" "Prometheus/2.33.4" 2024-02-19T21:57:00.831 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:57:01.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:59.319013+0000 mgr.y (mgr.14514) 932 : cluster [DBG] pgmap v1208: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 2.0 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 170 B/s wr, 713 op/s; 12274/99990 objects degraded (12.275%); 2 B/s, 0 objects/s recovering 2024-02-19T21:57:01.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:59.727929+0000 osd.7 (osd.7) 313 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:57:01.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:56:59.822094+0000 osd.7 (osd.7) 314 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:57:01.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:00.259366+0000 mon.a (mon.0) 2032 : audit [DBG] from='client.? 172.21.15.80:0/3232818248' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:57:01.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:00.062205+0000 osd.6 (osd.6) 295 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:57:01.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:00.066728+0000 osd.6 (osd.6) 296 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:57:01.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:00.593683+0000 osd.5 (osd.5) 323 : cluster [DBG] 6.12 scrub starts 2024-02-19T21:57:01.810 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:00.604637+0000 osd.5 (osd.5) 324 : cluster [DBG] 6.12 scrub ok 2024-02-19T21:57:01.810 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:57:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:57:01.988 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:57:01.991 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:00.062205+0000 osd.6 (osd.6) 295 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:57:01.992 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:00.066728+0000 osd.6 (osd.6) 296 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:57:01.992 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:00.593683+0000 osd.5 (osd.5) 323 : cluster [DBG] 6.12 scrub starts 2024-02-19T21:57:01.992 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:00.604637+0000 osd.5 (osd.5) 324 : cluster [DBG] 6.12 scrub ok 2024-02-19T21:57:01.992 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:00.062205+0000 osd.6 (osd.6) 295 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:57:01.992 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:00.066728+0000 osd.6 (osd.6) 296 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:57:01.992 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:00.593683+0000 osd.5 (osd.5) 323 : cluster [DBG] 6.12 scrub starts 2024-02-19T21:57:01.992 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:00.604637+0000 osd.5 (osd.5) 324 : cluster [DBG] 6.12 scrub ok 2024-02-19T21:57:01.993 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:01.993 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:57:02.094 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:57:02.147 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:02.503 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:57:02.508 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:02.508 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:57:02.609 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:57:02.669 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:02.845 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:01.319811+0000 mgr.y (mgr.14514) 933 : cluster [DBG] pgmap v1209: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 1.8 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 529 B/s rd, 132 B/s wr, 1.11k op/s; 10975/87123 objects degraded (12.597%); 1 B/s, 0 objects/s recovering 2024-02-19T21:57:02.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:01.409763+0000 mgr.y (mgr.14514) 934 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:57:02.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:01.570184+0000 osd.5 (osd.5) 325 : cluster [DBG] 2.3 deep-scrub starts 2024-02-19T21:57:02.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:01.574920+0000 osd.5 (osd.5) 326 : cluster [DBG] 2.3 deep-scrub ok 2024-02-19T21:57:02.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:01.582968+0000 mon.a (mon.0) 2033 : cluster [WRN] Health check update: Degraded data redundancy: 10975/87123 objects degraded (12.597%), 24 pgs degraded (PG_DEGRADED) 2024-02-19T21:57:02.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:01.719018+0000 osd.7 (osd.7) 315 : cluster [DBG] 2.1c scrub starts 2024-02-19T21:57:02.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:01.731005+0000 osd.7 (osd.7) 316 : cluster [DBG] 2.1c scrub ok 2024-02-19T21:57:02.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:01.319811+0000 mgr.y (mgr.14514) 933 : cluster [DBG] pgmap v1209: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 1.8 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 529 B/s rd, 132 B/s wr, 1.11k op/s; 10975/87123 objects degraded (12.597%); 1 B/s, 0 objects/s recovering 2024-02-19T21:57:02.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:01.409763+0000 mgr.y (mgr.14514) 934 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:57:02.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:01.570184+0000 osd.5 (osd.5) 325 : cluster [DBG] 2.3 deep-scrub starts 2024-02-19T21:57:02.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:01.574920+0000 osd.5 (osd.5) 326 : cluster [DBG] 2.3 deep-scrub ok 2024-02-19T21:57:02.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:01.582968+0000 mon.a (mon.0) 2033 : cluster [WRN] Health check update: Degraded data redundancy: 10975/87123 objects degraded (12.597%), 24 pgs degraded (PG_DEGRADED) 2024-02-19T21:57:02.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:01.719018+0000 osd.7 (osd.7) 315 : cluster [DBG] 2.1c scrub starts 2024-02-19T21:57:02.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:01.731005+0000 osd.7 (osd.7) 316 : cluster [DBG] 2.1c scrub ok 2024-02-19T21:57:03.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:01.319811+0000 mgr.y (mgr.14514) 933 : cluster [DBG] pgmap v1209: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 1.8 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 529 B/s rd, 132 B/s wr, 1.11k op/s; 10975/87123 objects degraded (12.597%); 1 B/s, 0 objects/s recovering 2024-02-19T21:57:03.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:01.409763+0000 mgr.y (mgr.14514) 934 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:57:03.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:01.570184+0000 osd.5 (osd.5) 325 : cluster [DBG] 2.3 deep-scrub starts 2024-02-19T21:57:03.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:01.574920+0000 osd.5 (osd.5) 326 : cluster [DBG] 2.3 deep-scrub ok 2024-02-19T21:57:03.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:01.582968+0000 mon.a (mon.0) 2033 : cluster [WRN] Health check update: Degraded data redundancy: 10975/87123 objects degraded (12.597%), 24 pgs degraded (PG_DEGRADED) 2024-02-19T21:57:03.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:01.719018+0000 osd.7 (osd.7) 315 : cluster [DBG] 2.1c scrub starts 2024-02-19T21:57:03.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:01.731005+0000 osd.7 (osd.7) 316 : cluster [DBG] 2.1c scrub ok 2024-02-19T21:57:03.221 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-02-19T21:57:03.222 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-02-19T21:57:03.619 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:57:03.625 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:03.625 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:57:03.726 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:57:03.761 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:03.882 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:57:03.888 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:03.889 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:57:03.889 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:02.681068+0000 osd.7 (osd.7) 317 : cluster [DBG] 6.1b scrub starts 2024-02-19T21:57:03.889 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:02.809400+0000 osd.7 (osd.7) 318 : cluster [DBG] 6.1b scrub ok 2024-02-19T21:57:03.889 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:02.885127+0000 osd.2 (osd.2) 71 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:57:03.889 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:02.888732+0000 osd.2 (osd.2) 72 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:57:03.889 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:02.681068+0000 osd.7 (osd.7) 317 : cluster [DBG] 6.1b scrub starts 2024-02-19T21:57:03.889 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:02.809400+0000 osd.7 (osd.7) 318 : cluster [DBG] 6.1b scrub ok 2024-02-19T21:57:03.889 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:02.885127+0000 osd.2 (osd.2) 71 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:57:03.890 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:02.888732+0000 osd.2 (osd.2) 72 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:57:03.989 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:57:04.035 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:02.681068+0000 osd.7 (osd.7) 317 : cluster [DBG] 6.1b scrub starts 2024-02-19T21:57:04.036 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:02.809400+0000 osd.7 (osd.7) 318 : cluster [DBG] 6.1b scrub ok 2024-02-19T21:57:04.036 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:02.885127+0000 osd.2 (osd.2) 71 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:57:04.036 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:02.888732+0000 osd.2 (osd.2) 72 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:57:04.038 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:04.066 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:57:04.078 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:04.079 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:57:04.180 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:57:04.229 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:04.268 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:57:04.272 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:04.273 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:57:04.375 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:57:04.437 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:04.492 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:57:04.502 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:04.503 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:57:04.603 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:57:04.647 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:04.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:02.988017+0000 osd.6 (osd.6) 297 : cluster [DBG] 6.c scrub starts 2024-02-19T21:57:04.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:02.993580+0000 osd.6 (osd.6) 298 : cluster [DBG] 6.c scrub ok 2024-02-19T21:57:04.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:03.320408+0000 mgr.y (mgr.14514) 935 : cluster [DBG] pgmap v1210: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 1.7 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 468 B/s rd, 117 B/s wr, 1.10k op/s; 10260/83880 objects degraded (12.232%); 1 B/s, 0 objects/s recovering 2024-02-19T21:57:04.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:03.357915+0000 osd.1 (osd.1) 292 : cluster [DBG] 11.c scrub starts 2024-02-19T21:57:04.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:03.807044+0000 osd.1 (osd.1) 293 : cluster [DBG] 11.c scrub ok 2024-02-19T21:57:04.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:03.982145+0000 mon.a (mon.0) 2034 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:57:04.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:04.162114+0000 osd.3 (osd.3) 273 : cluster [DBG] 11.a scrub starts 2024-02-19T21:57:04.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:02.988017+0000 osd.6 (osd.6) 297 : cluster [DBG] 6.c scrub starts 2024-02-19T21:57:04.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:02.993580+0000 osd.6 (osd.6) 298 : cluster [DBG] 6.c scrub ok 2024-02-19T21:57:04.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:03.320408+0000 mgr.y (mgr.14514) 935 : cluster [DBG] pgmap v1210: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 1.7 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 468 B/s rd, 117 B/s wr, 1.10k op/s; 10260/83880 objects degraded (12.232%); 1 B/s, 0 objects/s recovering 2024-02-19T21:57:04.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:03.357915+0000 osd.1 (osd.1) 292 : cluster [DBG] 11.c scrub starts 2024-02-19T21:57:04.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:03.807044+0000 osd.1 (osd.1) 293 : cluster [DBG] 11.c scrub ok 2024-02-19T21:57:04.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:03.982145+0000 mon.a (mon.0) 2034 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:57:04.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:04.162114+0000 osd.3 (osd.3) 273 : cluster [DBG] 11.a scrub starts 2024-02-19T21:57:04.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:02.988017+0000 osd.6 (osd.6) 297 : cluster [DBG] 6.c scrub starts 2024-02-19T21:57:04.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:02.993580+0000 osd.6 (osd.6) 298 : cluster [DBG] 6.c scrub ok 2024-02-19T21:57:04.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:03.320408+0000 mgr.y (mgr.14514) 935 : cluster [DBG] pgmap v1210: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 1.7 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 468 B/s rd, 117 B/s wr, 1.10k op/s; 10260/83880 objects degraded (12.232%); 1 B/s, 0 objects/s recovering 2024-02-19T21:57:04.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:03.357915+0000 osd.1 (osd.1) 292 : cluster [DBG] 11.c scrub starts 2024-02-19T21:57:04.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:03.807044+0000 osd.1 (osd.1) 293 : cluster [DBG] 11.c scrub ok 2024-02-19T21:57:04.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:03.982145+0000 mon.a (mon.0) 2034 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:57:04.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:04.162114+0000 osd.3 (osd.3) 273 : cluster [DBG] 11.a scrub starts 2024-02-19T21:57:04.909 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:57:04.920 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:04.920 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:57:05.021 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:57:05.066 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:05.222 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:57:05.597 INFO:teuthology.orchestra.run.smithi080.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-02-19T21:57:05.835 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:57:05.846 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:05.847 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:57:05.850 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:04.987556+0000 osd.3 (osd.3) 274 : cluster [DBG] 11.a scrub ok 2024-02-19T21:57:05.851 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:04.987556+0000 osd.3 (osd.3) 274 : cluster [DBG] 11.a scrub ok 2024-02-19T21:57:05.948 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:57:06.007 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:04.987556+0000 osd.3 (osd.3) 274 : cluster [DBG] 11.a scrub ok 2024-02-19T21:57:06.007 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:57:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:57:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:57:06.008 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:06.060 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:57:06.065 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:06.066 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:57:06.167 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:57:06.218 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:06.252 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:57:06.259 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:06.259 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:57:06.360 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:57:06.425 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:06.449 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-02-19T21:57:06.450 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.3 dump_ops_in_flight 2024-02-19T21:57:06.467 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:57:06.469 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:57:06.472 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:06.473 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:57:06.573 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:57:06.622 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:06.678 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:05.323582+0000 mgr.y (mgr.14514) 936 : cluster [DBG] pgmap v1211: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 1.6 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 614 B/s rd, 102 B/s wr, 990 op/s; 10260/80775 objects degraded (12.702%); 1 B/s, 0 objects/s recovering 2024-02-19T21:57:06.678 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:05.621337+0000 osd.5 (osd.5) 327 : cluster [DBG] 2.18 scrub starts 2024-02-19T21:57:06.678 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:05.632115+0000 osd.5 (osd.5) 328 : cluster [DBG] 2.18 scrub ok 2024-02-19T21:57:06.678 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:05.724903+0000 mon.a (mon.0) 2035 : audit [INF] from='client.? 172.21.15.80:0/497895306' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:57:06.678 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:05.764674+0000 osd.4 (osd.4) 265 : cluster [DBG] 4.1 scrub starts 2024-02-19T21:57:06.678 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:05.774347+0000 osd.4 (osd.4) 266 : cluster [DBG] 4.1 scrub ok 2024-02-19T21:57:06.678 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:05.825555+0000 osd.2 (osd.2) 73 : cluster [DBG] 4.1d scrub starts 2024-02-19T21:57:06.678 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:05.827653+0000 osd.2 (osd.2) 74 : cluster [DBG] 4.1d scrub ok 2024-02-19T21:57:06.706 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-02-19T21:57:06.803 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:57:06.806 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:06.807 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:57:06.908 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:57:06.953 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:05.323582+0000 mgr.y (mgr.14514) 936 : cluster [DBG] pgmap v1211: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 1.6 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 614 B/s rd, 102 B/s wr, 990 op/s; 10260/80775 objects degraded (12.702%); 1 B/s, 0 objects/s recovering 2024-02-19T21:57:06.953 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:05.621337+0000 osd.5 (osd.5) 327 : cluster [DBG] 2.18 scrub starts 2024-02-19T21:57:06.953 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:05.632115+0000 osd.5 (osd.5) 328 : cluster [DBG] 2.18 scrub ok 2024-02-19T21:57:06.953 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:05.724903+0000 mon.a (mon.0) 2035 : audit [INF] from='client.? 172.21.15.80:0/497895306' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:57:06.954 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:05.764674+0000 osd.4 (osd.4) 265 : cluster [DBG] 4.1 scrub starts 2024-02-19T21:57:06.954 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:05.774347+0000 osd.4 (osd.4) 266 : cluster [DBG] 4.1 scrub ok 2024-02-19T21:57:06.954 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:05.825555+0000 osd.2 (osd.2) 73 : cluster [DBG] 4.1d scrub starts 2024-02-19T21:57:06.954 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:05.827653+0000 osd.2 (osd.2) 74 : cluster [DBG] 4.1d scrub ok 2024-02-19T21:57:06.956 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:07.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:05.323582+0000 mgr.y (mgr.14514) 936 : cluster [DBG] pgmap v1211: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 1.6 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 614 B/s rd, 102 B/s wr, 990 op/s; 10260/80775 objects degraded (12.702%); 1 B/s, 0 objects/s recovering 2024-02-19T21:57:07.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:05.621337+0000 osd.5 (osd.5) 327 : cluster [DBG] 2.18 scrub starts 2024-02-19T21:57:07.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:05.632115+0000 osd.5 (osd.5) 328 : cluster [DBG] 2.18 scrub ok 2024-02-19T21:57:07.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:05.724903+0000 mon.a (mon.0) 2035 : audit [INF] from='client.? 172.21.15.80:0/497895306' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-02-19T21:57:07.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:05.764674+0000 osd.4 (osd.4) 265 : cluster [DBG] 4.1 scrub starts 2024-02-19T21:57:07.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:05.774347+0000 osd.4 (osd.4) 266 : cluster [DBG] 4.1 scrub ok 2024-02-19T21:57:07.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:05.825555+0000 osd.2 (osd.2) 73 : cluster [DBG] 4.1d scrub starts 2024-02-19T21:57:07.059 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:05.827653+0000 osd.2 (osd.2) 74 : cluster [DBG] 4.1d scrub ok 2024-02-19T21:57:08.022 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:06.667759+0000 mon.a (mon.0) 2036 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:57:08.022 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:06.688609+0000 mon.a (mon.0) 2037 : audit [INF] from='client.? 172.21.15.80:0/497895306' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:57:08.022 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:06.688664+0000 mon.a (mon.0) 2038 : cluster [DBG] osdmap e553: 8 total, 7 up, 8 in 2024-02-19T21:57:08.023 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:06.667759+0000 mon.a (mon.0) 2036 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:57:08.023 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:06.688609+0000 mon.a (mon.0) 2037 : audit [INF] from='client.? 172.21.15.80:0/497895306' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:57:08.023 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:06.688664+0000 mon.a (mon.0) 2038 : cluster [DBG] osdmap e553: 8 total, 7 up, 8 in 2024-02-19T21:57:08.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:06.667759+0000 mon.a (mon.0) 2036 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:57:08.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:06.688609+0000 mon.a (mon.0) 2037 : audit [INF] from='client.? 172.21.15.80:0/497895306' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-02-19T21:57:08.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:06.688664+0000 mon.a (mon.0) 2038 : cluster [DBG] osdmap e553: 8 total, 7 up, 8 in 2024-02-19T21:57:08.420 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:57:08.424 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:08.425 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:57:08.526 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:57:08.579 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:08.618 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:57:08.623 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:08.623 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:57:08.724 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:57:08.769 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:08.798 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:57:08.805 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:08.806 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:57:08.907 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:57:08.943 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:07.324167+0000 mgr.y (mgr.14514) 937 : cluster [DBG] pgmap v1213: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 1.4 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.07k op/s; 8892/70524 objects degraded (12.608%) 2024-02-19T21:57:08.944 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:07.684854+0000 mon.a (mon.0) 2039 : cluster [WRN] Health check update: Degraded data redundancy: 8892/70524 objects degraded (12.608%), 24 pgs degraded (PG_DEGRADED) 2024-02-19T21:57:08.944 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:07.324167+0000 mgr.y (mgr.14514) 937 : cluster [DBG] pgmap v1213: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 1.4 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.07k op/s; 8892/70524 objects degraded (12.608%) 2024-02-19T21:57:08.944 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:07.684854+0000 mon.a (mon.0) 2039 : cluster [WRN] Health check update: Degraded data redundancy: 8892/70524 objects degraded (12.608%), 24 pgs degraded (PG_DEGRADED) 2024-02-19T21:57:08.948 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:09.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:07.324167+0000 mgr.y (mgr.14514) 937 : cluster [DBG] pgmap v1213: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 1.4 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.07k op/s; 8892/70524 objects degraded (12.608%) 2024-02-19T21:57:09.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:07.684854+0000 mon.a (mon.0) 2039 : cluster [WRN] Health check update: Degraded data redundancy: 8892/70524 objects degraded (12.608%), 24 pgs degraded (PG_DEGRADED) 2024-02-19T21:57:09.063 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:57:09.072 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:09.072 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:57:09.173 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:57:09.194 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:57:09.243 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:09.506 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:57:09.512 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:09.513 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:57:09.549 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:57:09.589 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:57:09.614 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:57:09.619 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:57:09.646 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:57:09.658 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:09.694 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:57:09.694 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:57:09.698 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:09.698 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:57:09.724 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:57:09.760 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:57:09.763 INFO:teuthology.orchestra.run.smithi080.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-02-19T21:57:09.763 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:57:09.763 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:57:09.763 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:57:09.763 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:57:09.763 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:57:09.763 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:57:09.763 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:57:09.795 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:09.518970+0000 mon.b (mon.1) 86 : audit [DBG] from='client.? 172.21.15.80:0/946647491' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:57:09.796 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:09.518970+0000 mon.b (mon.1) 86 : audit [DBG] from='client.? 172.21.15.80:0/946647491' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:57:09.799 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:57:09.845 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:09.877 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:57:09.882 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:09.883 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:57:09.984 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:57:10.025 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd set nodeep-scrub 2024-02-19T21:57:10.026 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:09.518970+0000 mon.b (mon.1) 86 : audit [DBG] from='client.? 172.21.15.80:0/946647491' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:57:10.031 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:10.063 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:57:10.065 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:10.066 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:57:10.167 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:57:10.211 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:10.246 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:57:10.248 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:10.248 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:57:10.349 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:57:10.401 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:10.430 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:57:10.434 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:10.434 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:57:10.535 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:57:10.570 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:10.614 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:57:10.628 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:10.629 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:57:10.720 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:09.325587+0000 mgr.y (mgr.14514) 938 : cluster [DBG] pgmap v1214: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 1.4 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.07k op/s; 8250/67728 objects degraded (12.181%) 2024-02-19T21:57:10.720 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:10.473579+0000 mon.a (mon.0) 2040 : cluster [DBG] osdmap e554: 8 total, 7 up, 8 in 2024-02-19T21:57:10.731 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:57:10.788 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:10.816 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:57:10.822 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:10.823 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:57:10.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:09.325587+0000 mgr.y (mgr.14514) 938 : cluster [DBG] pgmap v1214: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 1.4 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.07k op/s; 8250/67728 objects degraded (12.181%) 2024-02-19T21:57:10.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:10.473579+0000 mon.a (mon.0) 2040 : cluster [DBG] osdmap e554: 8 total, 7 up, 8 in 2024-02-19T21:57:10.846 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:57:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:57:10] "GET /metrics HTTP/1.1" 200 176854 "" "Prometheus/2.33.4" 2024-02-19T21:57:10.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:09.325587+0000 mgr.y (mgr.14514) 938 : cluster [DBG] pgmap v1214: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 1.4 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.07k op/s; 8250/67728 objects degraded (12.181%) 2024-02-19T21:57:10.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:10.473579+0000 mon.a (mon.0) 2040 : cluster [DBG] osdmap e554: 8 total, 7 up, 8 in 2024-02-19T21:57:10.924 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:57:10.970 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:11.002 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:57:11.012 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:11.013 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:57:11.090 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-02-19T21:57:11.091 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-02-19T21:57:11.114 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:57:11.180 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:11.218 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:57:11.223 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:11.223 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:57:11.324 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:57:11.381 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:11.438 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:57:11.442 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:11.443 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:57:11.543 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:57:11.602 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:11.629 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:57:11.636 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:11.637 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:57:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:57:11.637 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:57:11.738 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:57:11.769 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:57:11.836 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:11.916 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:57:11.924 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:11.925 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:57:12.026 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:57:12.073 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:12.104 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:57:12.107 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:12.108 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:57:12.209 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:57:12.262 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:12.291 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:57:12.296 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:12.296 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:57:12.397 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:57:12.448 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:12.474 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:57:12.480 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:12.481 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:57:12.581 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:57:12.613 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:57:12.613 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:57:12.654 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:12.731 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:11.326385+0000 mgr.y (mgr.14514) 939 : cluster [DBG] pgmap v1216: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 1.1 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s; 6965/55281 objects degraded (12.599%) 2024-02-19T21:57:12.731 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:11.419800+0000 mgr.y (mgr.14514) 940 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:57:13.072 INFO:teuthology.orchestra.run.smithi080.stdout:6.9 2024-02-19T21:57:13.072 INFO:teuthology.orchestra.run.smithi080.stdout:6.18 2024-02-19T21:57:13.072 INFO:teuthology.orchestra.run.smithi080.stdout:6.16 2024-02-19T21:57:13.072 INFO:teuthology.orchestra.run.smithi080.stdout:6.13 2024-02-19T21:57:13.073 INFO:teuthology.orchestra.run.smithi080.stdout:6.11 2024-02-19T21:57:13.073 INFO:teuthology.orchestra.run.smithi080.stdout:6.10 2024-02-19T21:57:13.073 INFO:teuthology.orchestra.run.smithi080.stdout:6.0 2024-02-19T21:57:13.073 INFO:teuthology.orchestra.run.smithi080.stdout:5.e 2024-02-19T21:57:13.073 INFO:teuthology.orchestra.run.smithi080.stdout:5.c 2024-02-19T21:57:13.073 INFO:teuthology.orchestra.run.smithi080.stdout:5.a 2024-02-19T21:57:13.073 INFO:teuthology.orchestra.run.smithi080.stdout:5.7 2024-02-19T21:57:13.073 INFO:teuthology.orchestra.run.smithi080.stdout:5.3 2024-02-19T21:57:13.073 INFO:teuthology.orchestra.run.smithi080.stdout:2.1f 2024-02-19T21:57:13.073 INFO:teuthology.orchestra.run.smithi080.stdout:2.10 2024-02-19T21:57:13.073 INFO:teuthology.orchestra.run.smithi080.stdout:6.d 2024-02-19T21:57:13.073 INFO:teuthology.orchestra.run.smithi080.stdout:2.15 2024-02-19T21:57:13.073 INFO:teuthology.orchestra.run.smithi080.stdout:2.1 2024-02-19T21:57:13.073 INFO:teuthology.orchestra.run.smithi080.stdout:5.b 2024-02-19T21:57:13.073 INFO:teuthology.orchestra.run.smithi080.stdout:5.5 2024-02-19T21:57:13.074 INFO:teuthology.orchestra.run.smithi080.stdout:2.8 2024-02-19T21:57:13.074 INFO:teuthology.orchestra.run.smithi080.stdout:11.b 2024-02-19T21:57:13.074 INFO:teuthology.orchestra.run.smithi080.stdout:2.1d 2024-02-19T21:57:13.074 INFO:teuthology.orchestra.run.smithi080.stdout:4.1c 2024-02-19T21:57:13.074 INFO:teuthology.orchestra.run.smithi080.stdout:11.1 2024-02-19T21:57:13.074 INFO:teuthology.orchestra.run.smithi080.stdout:2.13 2024-02-19T21:57:13.074 INFO:teuthology.orchestra.run.smithi080.stdout:2.0 2024-02-19T21:57:13.074 INFO:teuthology.orchestra.run.smithi080.stdout:11.8 2024-02-19T21:57:13.074 INFO:teuthology.orchestra.run.smithi080.stdout:5.1 2024-02-19T21:57:13.074 INFO:teuthology.orchestra.run.smithi080.stdout:2.1e 2024-02-19T21:57:13.074 INFO:teuthology.orchestra.run.smithi080.stdout:1.0 2024-02-19T21:57:13.074 INFO:teuthology.orchestra.run.smithi080.stdout:2.5 2024-02-19T21:57:13.074 INFO:teuthology.orchestra.run.smithi080.stdout:11.2 2024-02-19T21:57:13.074 INFO:teuthology.orchestra.run.smithi080.stdout:4.b 2024-02-19T21:57:13.074 INFO:teuthology.orchestra.run.smithi080.stdout:11.9 2024-02-19T21:57:13.075 INFO:teuthology.orchestra.run.smithi080.stdout:2.4 2024-02-19T21:57:13.075 INFO:teuthology.orchestra.run.smithi080.stdout:4.7 2024-02-19T21:57:13.075 INFO:teuthology.orchestra.run.smithi080.stdout:2.f 2024-02-19T21:57:13.075 INFO:teuthology.orchestra.run.smithi080.stdout:4.0 2024-02-19T21:57:13.075 INFO:teuthology.orchestra.run.smithi080.stdout:4.16 2024-02-19T21:57:13.075 INFO:teuthology.orchestra.run.smithi080.stdout:4.1e 2024-02-19T21:57:13.075 INFO:teuthology.orchestra.run.smithi080.stdout:5.8 2024-02-19T21:57:13.075 INFO:teuthology.orchestra.run.smithi080.stdout:3.1 2024-02-19T21:57:13.075 INFO:teuthology.orchestra.run.smithi080.stdout:4.19 2024-02-19T21:57:13.075 INFO:teuthology.orchestra.run.smithi080.stdout:2.19 2024-02-19T21:57:13.075 INFO:teuthology.orchestra.run.smithi080.stdout:11.6 2024-02-19T21:57:13.075 INFO:teuthology.orchestra.run.smithi080.stdout:4.1a 2024-02-19T21:57:13.075 INFO:teuthology.orchestra.run.smithi080.stdout:6.f 2024-02-19T21:57:13.075 INFO:teuthology.orchestra.run.smithi080.stdout:6.a 2024-02-19T21:57:13.075 INFO:teuthology.orchestra.run.smithi080.stdout:5.2 2024-02-19T21:57:13.076 INFO:teuthology.orchestra.run.smithi080.stdout:4.3 2024-02-19T21:57:13.076 INFO:teuthology.orchestra.run.smithi080.stdout:4.6 2024-02-19T21:57:13.076 INFO:teuthology.orchestra.run.smithi080.stdout:4.1f 2024-02-19T21:57:13.076 INFO:teuthology.orchestra.run.smithi080.stdout:5.0 2024-02-19T21:57:13.076 INFO:teuthology.orchestra.run.smithi080.stdout:5.15 2024-02-19T21:57:13.091 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-02-19T21:57:13.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:11.326385+0000 mgr.y (mgr.14514) 939 : cluster [DBG] pgmap v1216: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 1.1 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s; 6965/55281 objects degraded (12.599%) 2024-02-19T21:57:13.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:11.419800+0000 mgr.y (mgr.14514) 940 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:57:13.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:11.326385+0000 mgr.y (mgr.14514) 939 : cluster [DBG] pgmap v1216: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 1.1 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s; 6965/55281 objects degraded (12.599%) 2024-02-19T21:57:13.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:11.419800+0000 mgr.y (mgr.14514) 940 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:57:13.714 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:57:13.719 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:13.719 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:57:13.820 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:57:13.865 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:13.912 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:57:13.918 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:13.919 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:57:14.019 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:57:14.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:13.726594+0000 mon.a (mon.0) 2041 : cluster [WRN] Health check update: Degraded data redundancy: 6307/52305 objects degraded (12.058%), 24 pgs degraded (PG_DEGRADED) 2024-02-19T21:57:14.075 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:14.095 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:13.726594+0000 mon.a (mon.0) 2041 : cluster [WRN] Health check update: Degraded data redundancy: 6307/52305 objects degraded (12.058%), 24 pgs degraded (PG_DEGRADED) 2024-02-19T21:57:14.095 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:13.726594+0000 mon.a (mon.0) 2041 : cluster [WRN] Health check update: Degraded data redundancy: 6307/52305 objects degraded (12.058%), 24 pgs degraded (PG_DEGRADED) 2024-02-19T21:57:14.099 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:57:14.103 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:14.103 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:57:14.205 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:57:14.259 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:14.313 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:57:14.324 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:14.324 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:57:14.425 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:57:14.467 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:14.797 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:13.326993+0000 mgr.y (mgr.14514) 941 : cluster [DBG] pgmap v1217: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 1.1 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s; 6307/52305 objects degraded (12.058%) 2024-02-19T21:57:14.798 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:13.326993+0000 mgr.y (mgr.14514) 941 : cluster [DBG] pgmap v1217: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 1.1 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s; 6307/52305 objects degraded (12.058%) 2024-02-19T21:57:15.095 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:13.326993+0000 mgr.y (mgr.14514) 941 : cluster [DBG] pgmap v1217: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 1.1 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.19k op/s; 6307/52305 objects degraded (12.058%) 2024-02-19T21:57:16.057 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:57:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:57:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:57:17.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:15.327530+0000 mgr.y (mgr.14514) 942 : cluster [DBG] pgmap v1218: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 1014 MiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 592 B/s rd, 0 B/s wr, 822 op/s; 6307/49239 objects degraded (12.809%) 2024-02-19T21:57:17.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:15.327530+0000 mgr.y (mgr.14514) 942 : cluster [DBG] pgmap v1218: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 1014 MiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 592 B/s rd, 0 B/s wr, 822 op/s; 6307/49239 objects degraded (12.809%) 2024-02-19T21:57:17.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:15.327530+0000 mgr.y (mgr.14514) 942 : cluster [DBG] pgmap v1218: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 1014 MiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 592 B/s rd, 0 B/s wr, 822 op/s; 6307/49239 objects degraded (12.809%) 2024-02-19T21:57:18.123 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:57:18.128 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:18.128 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:57:18.229 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:57:18.283 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:18.318 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:57:18.332 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:18.332 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:57:18.433 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:57:18.472 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:18.731 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.3 dump_blocked_ops 2024-02-19T21:57:18.733 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:57:18.738 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:18.738 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:57:18.839 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:57:18.889 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:19.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:17.328273+0000 mgr.y (mgr.14514) 943 : cluster [DBG] pgmap v1219: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 804 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.04k op/s; 5034/39165 objects degraded (12.853%) 2024-02-19T21:57:19.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:17.328273+0000 mgr.y (mgr.14514) 943 : cluster [DBG] pgmap v1219: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 804 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.04k op/s; 5034/39165 objects degraded (12.853%) 2024-02-19T21:57:19.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:17.328273+0000 mgr.y (mgr.14514) 943 : cluster [DBG] pgmap v1219: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 804 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.04k op/s; 5034/39165 objects degraded (12.853%) 2024-02-19T21:57:19.547 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:57:19.551 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:19.551 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:57:19.559 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -n osd.0 --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph-objectstore-tool --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-0 --journal-path /var/lib/ceph/osd/ceph-0/journal --op export --pgid 5.b --file /var/log/ceph/exp.5.b.0 2024-02-19T21:57:19.653 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:57:19.696 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:19.730 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:57:19.740 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:19.741 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:57:19.841 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:57:19.848 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:57:19.875 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:19.910 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:57:19.917 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:19.918 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:57:20.019 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:57:20.078 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:20.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:18.988738+0000 mon.a (mon.0) 2042 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:57:20.098 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:19.648297+0000 mon.a (mon.0) 2043 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:57:20.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:18.988738+0000 mon.a (mon.0) 2042 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:57:20.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:19.648297+0000 mon.a (mon.0) 2043 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:57:20.112 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:57:20.115 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:20.116 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:57:20.140 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/osd.0/config 2024-02-19T21:57:20.216 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:57:20.257 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:20.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:18.988738+0000 mon.a (mon.0) 2042 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:57:20.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:19.648297+0000 mon.a (mon.0) 2043 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:57:21.049 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:57:21.095 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:57:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:57:20] "GET /metrics HTTP/1.1" 200 176853 "" "Prometheus/2.33.4" 2024-02-19T21:57:21.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:19.328727+0000 mgr.y (mgr.14514) 944 : cluster [DBG] pgmap v1220: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 733 MiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.06k op/s; 4277/35772 objects degraded (11.956%) 2024-02-19T21:57:21.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:19.986182+0000 mon.a (mon.0) 2044 : cluster [WRN] Health check update: Degraded data redundancy: 4277/35772 objects degraded (11.956%), 24 pgs degraded (PG_DEGRADED) 2024-02-19T21:57:21.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:20.441227+0000 mon.a (mon.0) 2045 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:57:21.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:20.442151+0000 mon.a (mon.0) 2046 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:57:21.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:20.452965+0000 mon.a (mon.0) 2047 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:57:21.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:20.704174+0000 mon.b (mon.1) 87 : audit [INF] from='client.? 172.21.15.80:0/4149119448' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:57:21.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:20.709465+0000 mon.a (mon.0) 2048 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:57:21.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:19.328727+0000 mgr.y (mgr.14514) 944 : cluster [DBG] pgmap v1220: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 733 MiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.06k op/s; 4277/35772 objects degraded (11.956%) 2024-02-19T21:57:21.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:19.986182+0000 mon.a (mon.0) 2044 : cluster [WRN] Health check update: Degraded data redundancy: 4277/35772 objects degraded (11.956%), 24 pgs degraded (PG_DEGRADED) 2024-02-19T21:57:21.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:20.441227+0000 mon.a (mon.0) 2045 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:57:21.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:20.442151+0000 mon.a (mon.0) 2046 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:57:21.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:20.452965+0000 mon.a (mon.0) 2047 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:57:21.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:20.704174+0000 mon.b (mon.1) 87 : audit [INF] from='client.? 172.21.15.80:0/4149119448' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:57:21.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:20.709465+0000 mon.a (mon.0) 2048 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:57:21.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:19.328727+0000 mgr.y (mgr.14514) 944 : cluster [DBG] pgmap v1220: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 733 MiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.06k op/s; 4277/35772 objects degraded (11.956%) 2024-02-19T21:57:21.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:19.986182+0000 mon.a (mon.0) 2044 : cluster [WRN] Health check update: Degraded data redundancy: 4277/35772 objects degraded (11.956%), 24 pgs degraded (PG_DEGRADED) 2024-02-19T21:57:21.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:20.441227+0000 mon.a (mon.0) 2045 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:57:21.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:20.442151+0000 mon.a (mon.0) 2046 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:57:21.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:20.452965+0000 mon.a (mon.0) 2047 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:57:21.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:20.704174+0000 mon.b (mon.1) 87 : audit [INF] from='client.? 172.21.15.80:0/4149119448' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:57:21.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:20.709465+0000 mon.a (mon.0) 2048 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:57:21.496 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-02-19T21:57:21.807 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:57:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:57:21.825 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:57:21.831 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:21.832 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:57:21.933 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:57:21.985 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:22.023 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:57:22.031 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:22.032 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:57:22.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:21.476673+0000 mon.a (mon.0) 2049 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:57:22.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:21.488507+0000 mon.a (mon.0) 2050 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:57:22.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:21.488570+0000 mon.a (mon.0) 2051 : cluster [DBG] osdmap e555: 8 total, 7 up, 8 in 2024-02-19T21:57:22.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:21.476673+0000 mon.a (mon.0) 2049 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:57:22.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:21.488507+0000 mon.a (mon.0) 2050 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:57:22.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:21.488570+0000 mon.a (mon.0) 2051 : cluster [DBG] osdmap e555: 8 total, 7 up, 8 in 2024-02-19T21:57:22.133 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:57:22.179 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:22.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:21.476673+0000 mon.a (mon.0) 2049 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:57:22.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:21.488507+0000 mon.a (mon.0) 2050 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-02-19T21:57:22.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:21.488570+0000 mon.a (mon.0) 2051 : cluster [DBG] osdmap e555: 8 total, 7 up, 8 in 2024-02-19T21:57:23.041 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:21.329387+0000 mgr.y (mgr.14514) 945 : cluster [DBG] pgmap v1221: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 450 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 943 B/s rd, 0 B/s wr, 1.04k op/s; 2923/22185 objects degraded (13.176%) 2024-02-19T21:57:23.041 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:21.435533+0000 mgr.y (mgr.14514) 946 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:57:23.234 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:57:23.238 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:23.239 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:57:23.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:21.329387+0000 mgr.y (mgr.14514) 945 : cluster [DBG] pgmap v1221: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 450 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 943 B/s rd, 0 B/s wr, 1.04k op/s; 2923/22185 objects degraded (13.176%) 2024-02-19T21:57:23.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:21.435533+0000 mgr.y (mgr.14514) 946 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:57:23.340 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:57:23.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:21.329387+0000 mgr.y (mgr.14514) 945 : cluster [DBG] pgmap v1221: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 450 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 943 B/s rd, 0 B/s wr, 1.04k op/s; 2923/22185 objects degraded (13.176%) 2024-02-19T21:57:23.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:21.435533+0000 mgr.y (mgr.14514) 946 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:57:23.379 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:23.633 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:57:23.640 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:23.640 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:57:23.741 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:57:23.803 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:23.845 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:57:23.853 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:23.853 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:57:23.954 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:57:23.999 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:24.034 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:57:24.039 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:24.040 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:57:24.141 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:57:24.207 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:24.248 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:57:24.260 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:24.261 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:57:24.361 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:57:24.412 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:24.443 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:57:24.448 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:24.449 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:57:24.549 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:57:24.602 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:24.629 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:57:24.636 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:24.637 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:57:24.737 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:57:24.799 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:24.825 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:57:24.832 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:24.832 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:57:24.933 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:57:25.004 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:25.042 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:57:25.051 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:25.051 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:57:25.095 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:23.329854+0000 mgr.y (mgr.14514) 947 : cluster [DBG] pgmap v1223: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 385 MiB data, 7.7 GiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.11k op/s; 2248/19065 objects degraded (11.791%) 2024-02-19T21:57:25.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:23.329854+0000 mgr.y (mgr.14514) 947 : cluster [DBG] pgmap v1223: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 385 MiB data, 7.7 GiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.11k op/s; 2248/19065 objects degraded (11.791%) 2024-02-19T21:57:25.131 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:57:25.131 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:57:25.151 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:57:25.186 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:25.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:23.329854+0000 mgr.y (mgr.14514) 947 : cluster [DBG] pgmap v1223: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 385 MiB data, 7.7 GiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1.11k op/s; 2248/19065 objects degraded (11.791%) 2024-02-19T21:57:26.057 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:57:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:57:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:57:26.085 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:57:26.092 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:26.093 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:57:26.109 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.3 dump_historic_ops 2024-02-19T21:57:26.194 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:57:26.259 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:26.278 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:57:26.280 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:26.280 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:57:26.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:24.781153+0000 osd.6 (osd.6) 299 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:57:26.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:24.781204+0000 osd.6 (osd.6) 300 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:57:26.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:25.070643+0000 mon.a (mon.0) 2052 : cluster [DBG] osdmap e556: 8 total, 7 up, 8 in 2024-02-19T21:57:26.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:25.471366+0000 mon.a (mon.0) 2053 : cluster [WRN] Health check update: Degraded data redundancy: 2248/19065 objects degraded (11.791%), 24 pgs degraded (PG_DEGRADED) 2024-02-19T21:57:26.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:24.781153+0000 osd.6 (osd.6) 299 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:57:26.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:24.781204+0000 osd.6 (osd.6) 300 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:57:26.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:25.070643+0000 mon.a (mon.0) 2052 : cluster [DBG] osdmap e556: 8 total, 7 up, 8 in 2024-02-19T21:57:26.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:25.471366+0000 mon.a (mon.0) 2053 : cluster [WRN] Health check update: Degraded data redundancy: 2248/19065 objects degraded (11.791%), 24 pgs degraded (PG_DEGRADED) 2024-02-19T21:57:26.381 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:57:26.420 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:24.781153+0000 osd.6 (osd.6) 299 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:57:26.420 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:24.781204+0000 osd.6 (osd.6) 300 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:57:26.420 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:25.070643+0000 mon.a (mon.0) 2052 : cluster [DBG] osdmap e556: 8 total, 7 up, 8 in 2024-02-19T21:57:26.420 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:25.471366+0000 mon.a (mon.0) 2053 : cluster [WRN] Health check update: Degraded data redundancy: 2248/19065 objects degraded (11.791%), 24 pgs degraded (PG_DEGRADED) 2024-02-19T21:57:26.426 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:26.460 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:57:26.468 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:26.469 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:57:26.501 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Removed 117606 objects 2024-02-19T21:57:26.501 INFO:tasks.radosbench.radosbench.0.smithi080.stdout:Clean up completed and total clean up time :116.368 2024-02-19T21:57:26.570 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:57:26.577 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset noscrub 2024-02-19T21:57:26.597 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:26.613 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:57:26.616 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:57:26.618 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:26.619 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:57:26.633 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:57:26.646 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:57:26.656 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:57:26.657 INFO:teuthology.orchestra.run.smithi080.stderr:Exporting 5.b info 5.b( empty local-lis/les=394/395 n=0 ec=62/62 lis/c=394/394 les/c/f=395/395/0 sis=394) 2024-02-19T21:57:26.659 INFO:teuthology.orchestra.run.smithi080.stderr:Export successful 2024-02-19T21:57:26.678 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:57:26.696 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:57:26.713 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:57:26.720 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:57:26.731 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:57:26.731 INFO:teuthology.orchestra.run.smithi080.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-02-19T21:57:26.731 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'true' 2024-02-19T21:57:26.731 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'true' 2024-02-19T21:57:26.731 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'true' 2024-02-19T21:57:26.731 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'true' 2024-02-19T21:57:26.731 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'true' 2024-02-19T21:57:26.731 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'true' 2024-02-19T21:57:26.731 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'true' 2024-02-19T21:57:26.746 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:26.765 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:57:26.767 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:26.768 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:57:26.869 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:57:26.896 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:26.916 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:57:26.918 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:26.919 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:57:27.019 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:57:27.047 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:27.066 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:57:27.069 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:27.070 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:57:27.170 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:57:27.192 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:25.330376+0000 mgr.y (mgr.14514) 948 : cluster [DBG] pgmap v1225: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 321 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 965 op/s; 2248/16002 objects degraded (14.048%) 2024-02-19T21:57:27.192 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:26.587905+0000 mon.c (mon.2) 134 : audit [DBG] from='client.? 172.21.15.80:0/1584610452' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:57:27.193 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:25.330376+0000 mgr.y (mgr.14514) 948 : cluster [DBG] pgmap v1225: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 321 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 965 op/s; 2248/16002 objects degraded (14.048%) 2024-02-19T21:57:27.193 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:26.587905+0000 mon.c (mon.2) 134 : audit [DBG] from='client.? 172.21.15.80:0/1584610452' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:57:27.197 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:27.216 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:57:27.218 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:27.219 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:57:27.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:25.330376+0000 mgr.y (mgr.14514) 948 : cluster [DBG] pgmap v1225: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 321 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 965 op/s; 2248/16002 objects degraded (14.048%) 2024-02-19T21:57:27.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:26.587905+0000 mon.c (mon.2) 134 : audit [DBG] from='client.? 172.21.15.80:0/1584610452' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:57:27.320 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:57:27.347 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:27.365 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:57:27.368 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:27.369 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:57:27.395 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_4 2024-02-19T21:57:27.396 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool rm unique_pool_4 unique_pool_4 --yes-i-really-really-mean-it 2024-02-19T21:57:27.469 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5 2024-02-19T21:57:27.496 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:27.515 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T21:57:27.518 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:27.518 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5' 2024-02-19T21:57:27.619 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:57:27.646 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:27.665 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:57:27.665 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-02-19T21:57:27.666 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-02-19T21:57:27.667 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:27.667 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:57:27.768 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:57:27.794 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:27.813 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:57:27.816 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:27.816 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:57:27.917 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7 2024-02-19T21:57:27.943 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:27.961 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T21:57:27.964 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:27.964 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7' 2024-02-19T21:57:28.065 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3 2024-02-19T21:57:28.094 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:28.217 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T21:57:28.220 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:28.221 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3' 2024-02-19T21:57:28.221 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -n osd.0 --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph-objectstore-tool --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-0 --journal-path /var/lib/ceph/osd/ceph-0/journal --force --op remove --pgid 5.b 2024-02-19T21:57:28.321 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:57:28.348 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:29.105 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:27.331363+0000 mgr.y (mgr.14514) 949 : cluster [DBG] pgmap v1226: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 110 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.25k op/s; 895/5880 objects degraded (15.221%) 2024-02-19T21:57:29.152 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:57:29.152 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:57:29.418 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:27.331363+0000 mgr.y (mgr.14514) 949 : cluster [DBG] pgmap v1226: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 110 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.25k op/s; 895/5880 objects degraded (15.221%) 2024-02-19T21:57:29.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:27.331363+0000 mgr.y (mgr.14514) 949 : cluster [DBG] pgmap v1226: 138 pgs: 24 active+undersized+degraded, 30 active+undersized, 84 active+clean; 110 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1.25k op/s; 895/5880 objects degraded (15.221%) 2024-02-19T21:57:29.667 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-02-19T21:57:30.554 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:28.863881+0000 osd.3 (osd.3) 275 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:57:30.554 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:28.863956+0000 osd.3 (osd.3) 276 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:57:30.554 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:29.101205+0000 mon.a (mon.0) 2054 : cluster [DBG] osdmap e557: 8 total, 7 up, 8 in 2024-02-19T21:57:30.554 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:28.863881+0000 osd.3 (osd.3) 275 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:57:30.554 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:28.863956+0000 osd.3 (osd.3) 276 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:57:30.554 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:29.101205+0000 mon.a (mon.0) 2054 : cluster [DBG] osdmap e557: 8 total, 7 up, 8 in 2024-02-19T21:57:30.555 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:28.863881+0000 osd.3 (osd.3) 275 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:57:30.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:28.863956+0000 osd.3 (osd.3) 276 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:57:30.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:29.101205+0000 mon.a (mon.0) 2054 : cluster [DBG] osdmap e557: 8 total, 7 up, 8 in 2024-02-19T21:57:30.833 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:57:30.833 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-02-19T21:57:30.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-02-19T21:57:30.833 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-02-19T21:57:30.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.833 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:107580 11.a 11:5bbdb51b:::benchmark_data_smithi080_184406_object107579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e520)", 2024-02-19T21:57:30.833 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:55:17.467169+0000", 2024-02-19T21:57:30.833 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 133.06232852299999, 2024-02-19T21:57:30.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.15526969500000001, 2024-02-19T21:57:30.833 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:57:30.834 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:57:30.834 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:57:30.834 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:57:30.834 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:57:30.834 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 107580 2024-02-19T21:57:30.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.834 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:57:30.834 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.834 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:57:30.834 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.467169+0000", 2024-02-19T21:57:30.834 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:57:30.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.834 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.835 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:57:30.835 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.467169+0000", 2024-02-19T21:57:30.835 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:57:30.835 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.835 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.835 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:57:30.835 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.467167+0000", 2024-02-19T21:57:30.835 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3742000000000001e-05 2024-02-19T21:57:30.835 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.835 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.835 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:57:30.835 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.467191+0000", 2024-02-19T21:57:30.835 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0589999999999992e-06 2024-02-19T21:57:30.835 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.836 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.836 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:57:30.836 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.467200+0000", 2024-02-19T21:57:30.836 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1109999999999999e-06 2024-02-19T21:57:30.836 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.836 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.836 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:57:30.836 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.467205+0000", 2024-02-19T21:57:30.836 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.074587938000000006 2024-02-19T21:57:30.836 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.836 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.836 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:57:30.836 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.541793+0000", 2024-02-19T21:57:30.836 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6545999999999994e-05 2024-02-19T21:57:30.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.837 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.837 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:57:30.837 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.541879+0000", 2024-02-19T21:57:30.837 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000103509 2024-02-19T21:57:30.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.837 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.837 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:57:30.837 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.541983+0000", 2024-02-19T21:57:30.837 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0078306480000000008 2024-02-19T21:57:30.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.837 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.837 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:57:30.837 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.549814+0000", 2024-02-19T21:57:30.838 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032728760000000001 2024-02-19T21:57:30.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.838 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.838 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.838 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.553086+0000", 2024-02-19T21:57:30.838 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.069248216000000001 2024-02-19T21:57:30.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.838 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.838 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.838 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.622335+0000", 2024-02-19T21:57:30.838 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7995999999999998e-05 2024-02-19T21:57:30.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.838 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.838 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:57:30.838 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.622393+0000", 2024-02-19T21:57:30.838 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5666e-05 2024-02-19T21:57:30.839 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.839 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.839 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:57:30.839 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.622438+0000", 2024-02-19T21:57:30.839 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.15526969500000001 2024-02-19T21:57:30.839 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.839 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:57:30.839 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.839 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.839 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.839 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:107660 11.a 11:5353514a:::benchmark_data_smithi080_184406_object107659:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e520)", 2024-02-19T21:57:30.839 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:55:17.577905+0000", 2024-02-19T21:57:30.839 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 132.95159248499999, 2024-02-19T21:57:30.840 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.13668588100000001, 2024-02-19T21:57:30.840 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:57:30.840 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:57:30.840 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:57:30.840 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:57:30.840 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:57:30.840 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 107660 2024-02-19T21:57:30.840 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.840 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:57:30.840 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.840 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:57:30.840 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.577905+0000", 2024-02-19T21:57:30.840 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:57:30.840 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.841 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.841 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:57:30.841 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.577905+0000", 2024-02-19T21:57:30.841 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999971 2024-02-19T21:57:30.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.841 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.841 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:57:30.841 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.577902+0000", 2024-02-19T21:57:30.841 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0759999999999997e-05 2024-02-19T21:57:30.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.841 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.841 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:57:30.841 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.577933+0000", 2024-02-19T21:57:30.841 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1124e-05 2024-02-19T21:57:30.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.842 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.842 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:57:30.842 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.577954+0000", 2024-02-19T21:57:30.842 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3139999999999993e-06 2024-02-19T21:57:30.842 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.842 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.842 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:57:30.842 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.577963+0000", 2024-02-19T21:57:30.842 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.045002892000000003 2024-02-19T21:57:30.842 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.842 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.842 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:57:30.842 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.622966+0000", 2024-02-19T21:57:30.842 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015176799999999999 2024-02-19T21:57:30.843 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.843 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.844 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:57:30.844 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.623118+0000", 2024-02-19T21:57:30.844 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018052300000000001 2024-02-19T21:57:30.844 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.844 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.844 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:57:30.844 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.623298+0000", 2024-02-19T21:57:30.844 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.091018287000000003 2024-02-19T21:57:30.844 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.844 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.844 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:57:30.844 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.714317+0000", 2024-02-19T21:57:30.845 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7176999999999999e-05 2024-02-19T21:57:30.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.845 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.845 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.845 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.714364+0000", 2024-02-19T21:57:30.845 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012715 2024-02-19T21:57:30.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.845 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.845 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.845 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.714491+0000", 2024-02-19T21:57:30.845 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7917000000000001e-05 2024-02-19T21:57:30.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.845 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.845 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:57:30.846 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.714549+0000", 2024-02-19T21:57:30.846 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1705999999999997e-05 2024-02-19T21:57:30.846 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.846 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.846 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:57:30.846 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.714591+0000", 2024-02-19T21:57:30.846 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.13668588100000001 2024-02-19T21:57:30.846 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.846 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:57:30.846 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.846 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.846 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.846 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:107753 11.a 11:59d87bf6:::benchmark_data_smithi080_184406_object107752:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e520)", 2024-02-19T21:57:30.846 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:55:17.732612+0000", 2024-02-19T21:57:30.847 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 132.79688539899999, 2024-02-19T21:57:30.847 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.132657996, 2024-02-19T21:57:30.847 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:57:30.847 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:57:30.847 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:57:30.847 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:57:30.847 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:57:30.847 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 107753 2024-02-19T21:57:30.847 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.847 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:57:30.847 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.847 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:57:30.847 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.732612+0000", 2024-02-19T21:57:30.847 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:57:30.847 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.847 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.848 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:57:30.848 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.732612+0000", 2024-02-19T21:57:30.848 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:57:30.848 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.848 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.848 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:57:30.848 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.732610+0000", 2024-02-19T21:57:30.848 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3186999999999999e-05 2024-02-19T21:57:30.848 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.848 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.848 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:57:30.848 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.732643+0000", 2024-02-19T21:57:30.848 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9542e-05 2024-02-19T21:57:30.848 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:57:30.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.732663+0000", 2024-02-19T21:57:30.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2799999999999998e-06 2024-02-19T21:57:30.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:57:30.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.732670+0000", 2024-02-19T21:57:30.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.056454911000000003 2024-02-19T21:57:30.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:57:30.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.789125+0000", 2024-02-19T21:57:30.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014053700000000001 2024-02-19T21:57:30.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.850 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.850 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:57:30.850 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.789265+0000", 2024-02-19T21:57:30.850 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000174828 2024-02-19T21:57:30.850 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.850 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.850 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:57:30.850 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.789440+0000", 2024-02-19T21:57:30.850 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011947407 2024-02-19T21:57:30.850 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.850 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.850 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:57:30.850 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.801388+0000", 2024-02-19T21:57:30.850 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.063650751000000005 2024-02-19T21:57:30.850 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.851 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.851 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.851 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.865038+0000", 2024-02-19T21:57:30.851 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014341399999999999 2024-02-19T21:57:30.851 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.851 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.851 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.851 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.865182+0000", 2024-02-19T21:57:30.851 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0179000000000002e-05 2024-02-19T21:57:30.851 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.851 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.851 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:57:30.851 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.865232+0000", 2024-02-19T21:57:30.851 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7798e-05 2024-02-19T21:57:30.852 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.852 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.852 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:57:30.852 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:17.865270+0000", 2024-02-19T21:57:30.852 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.132657996 2024-02-19T21:57:30.852 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.852 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:57:30.852 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.852 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.852 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.852 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:116586 11.a 11:5f9ef06a:::benchmark_data_smithi080_184406_object116585:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e524)", 2024-02-19T21:57:30.852 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:55:28.727075+0000", 2024-02-19T21:57:30.852 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 121.802421725, 2024-02-19T21:57:30.852 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.145296446, 2024-02-19T21:57:30.853 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:57:30.853 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:57:30.853 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:57:30.853 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:57:30.853 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:57:30.853 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 116586 2024-02-19T21:57:30.853 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.853 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:57:30.853 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.853 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:57:30.853 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:28.727075+0000", 2024-02-19T21:57:30.853 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:57:30.853 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.853 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.853 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:57:30.854 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:28.727075+0000", 2024-02-19T21:57:30.854 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:57:30.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.854 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:57:30.854 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:28.727074+0000", 2024-02-19T21:57:30.854 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0850999999999999e-05 2024-02-19T21:57:30.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.854 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:57:30.854 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:28.727115+0000", 2024-02-19T21:57:30.854 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6288999999999999e-05 2024-02-19T21:57:30.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.855 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:57:30.855 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:28.727131+0000", 2024-02-19T21:57:30.855 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.029e-06 2024-02-19T21:57:30.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.855 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:57:30.855 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:28.727138+0000", 2024-02-19T21:57:30.855 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.094352036 2024-02-19T21:57:30.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.855 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:57:30.855 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:28.821490+0000", 2024-02-19T21:57:30.855 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013074699999999999 2024-02-19T21:57:30.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.856 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.856 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:57:30.856 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:28.821621+0000", 2024-02-19T21:57:30.856 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000167858 2024-02-19T21:57:30.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.856 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.856 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:57:30.856 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:28.821789+0000", 2024-02-19T21:57:30.856 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0070559810000000002 2024-02-19T21:57:30.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.856 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.856 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:57:30.856 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:28.828845+0000", 2024-02-19T21:57:30.856 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023392745999999999 2024-02-19T21:57:30.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.857 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:28.852237+0000", 2024-02-19T21:57:30.857 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020040966 2024-02-19T21:57:30.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.857 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:28.872278+0000", 2024-02-19T21:57:30.857 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3062999999999997e-05 2024-02-19T21:57:30.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:57:30.857 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:28.872332+0000", 2024-02-19T21:57:30.857 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0339999999999997e-05 2024-02-19T21:57:30.858 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.858 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.858 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:57:30.858 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:28.872372+0000", 2024-02-19T21:57:30.858 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.145296446 2024-02-19T21:57:30.858 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.858 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:57:30.858 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.858 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.858 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.858 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:116636 11.a 11:5a0a37a6:::benchmark_data_smithi080_184406_object116635:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e524)", 2024-02-19T21:57:30.858 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:55:28.794675+0000", 2024-02-19T21:57:30.858 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 121.734822298, 2024-02-19T21:57:30.858 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.132891386, 2024-02-19T21:57:30.858 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:57:30.859 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:57:30.859 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:57:30.859 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:57:30.859 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:57:30.859 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 116636 2024-02-19T21:57:30.859 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.859 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:57:30.859 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.859 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:57:30.859 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:28.794675+0000", 2024-02-19T21:57:30.859 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:57:30.859 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.859 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.859 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:57:30.859 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:28.794675+0000", 2024-02-19T21:57:30.860 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:57:30.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.860 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:57:30.860 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:28.794673+0000", 2024-02-19T21:57:30.860 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4929000000000001e-05 2024-02-19T21:57:30.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.860 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:57:30.860 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:28.794698+0000", 2024-02-19T21:57:30.860 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8448999999999999e-05 2024-02-19T21:57:30.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.860 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:57:30.861 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:28.794716+0000", 2024-02-19T21:57:30.861 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4359999999999996e-06 2024-02-19T21:57:30.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.861 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:57:30.861 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:28.794724+0000", 2024-02-19T21:57:30.861 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.053363136999999998 2024-02-19T21:57:30.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.861 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:57:30.861 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:28.848087+0000", 2024-02-19T21:57:30.861 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5617000000000003e-05 2024-02-19T21:57:30.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.861 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:57:30.862 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:28.848182+0000", 2024-02-19T21:57:30.862 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011424 2024-02-19T21:57:30.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.862 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:57:30.862 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:28.848297+0000", 2024-02-19T21:57:30.862 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040780460000000001 2024-02-19T21:57:30.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.862 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:57:30.862 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:28.852375+0000", 2024-02-19T21:57:30.862 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.031584444000000003 2024-02-19T21:57:30.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.862 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.863 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:28.883959+0000", 2024-02-19T21:57:30.863 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.043504476 2024-02-19T21:57:30.863 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.863 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.863 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.863 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:28.927464+0000", 2024-02-19T21:57:30.863 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0640999999999998e-05 2024-02-19T21:57:30.863 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.863 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.863 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:57:30.863 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:28.927524+0000", 2024-02-19T21:57:30.863 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1878000000000001e-05 2024-02-19T21:57:30.863 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.863 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.863 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:57:30.864 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:28.927566+0000", 2024-02-19T21:57:30.864 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.132891386 2024-02-19T21:57:30.864 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.864 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:57:30.864 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.864 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.864 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.864 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:118131 11.a 11:5a095626:::benchmark_data_smithi080_184406_object522:head [delete] snapc 0=[] ondisk+write+known_if_redirected e524)", 2024-02-19T21:57:30.864 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:55:30.732963+0000", 2024-02-19T21:57:30.864 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 119.796534373, 2024-02-19T21:57:30.864 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.136431899, 2024-02-19T21:57:30.864 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:57:30.864 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:57:30.864 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:57:30.865 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:57:30.865 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:57:30.865 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 118131 2024-02-19T21:57:30.865 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.865 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:57:30.865 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.865 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:57:30.865 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:30.732963+0000", 2024-02-19T21:57:30.865 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:57:30.865 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.865 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.865 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:57:30.865 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:30.732963+0000", 2024-02-19T21:57:30.865 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:57:30.865 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.866 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.866 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:57:30.866 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:30.732961+0000", 2024-02-19T21:57:30.866 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7160000000000003e-06 2024-02-19T21:57:30.866 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.866 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.866 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:57:30.866 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:30.732969+0000", 2024-02-19T21:57:30.866 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5141e-05 2024-02-19T21:57:30.866 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.866 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.866 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:57:30.866 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:30.732984+0000", 2024-02-19T21:57:30.866 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2899999999999997e-06 2024-02-19T21:57:30.867 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.867 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.867 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:57:30.867 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:30.732991+0000", 2024-02-19T21:57:30.867 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.084770303000000005 2024-02-19T21:57:30.867 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.867 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.867 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:57:30.867 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:30.817761+0000", 2024-02-19T21:57:30.867 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9881000000000003e-05 2024-02-19T21:57:30.867 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.867 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.867 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:57:30.867 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:30.817841+0000", 2024-02-19T21:57:30.867 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2954999999999994e-05 2024-02-19T21:57:30.868 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.868 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.868 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:57:30.868 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:30.817924+0000", 2024-02-19T21:57:30.868 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039453459999999997 2024-02-19T21:57:30.868 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.868 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.868 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:57:30.868 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:30.821869+0000", 2024-02-19T21:57:30.868 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.028652740999999999 2024-02-19T21:57:30.868 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.868 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.868 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.868 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:30.850522+0000", 2024-02-19T21:57:30.869 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018813920000000001 2024-02-19T21:57:30.869 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.869 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.869 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.869 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:30.869336+0000", 2024-02-19T21:57:30.869 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3148999999999997e-05 2024-02-19T21:57:30.869 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.869 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.869 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:57:30.869 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:30.869369+0000", 2024-02-19T21:57:30.869 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5372999999999999e-05 2024-02-19T21:57:30.869 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.869 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.869 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:57:30.869 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:30.869395+0000", 2024-02-19T21:57:30.870 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.136431899 2024-02-19T21:57:30.870 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.870 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:57:30.870 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.870 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.870 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.870 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:118531 11.a 11:50a96a2a:::benchmark_data_smithi080_184406_object922:head [delete] snapc 0=[] ondisk+write+known_if_redirected e524)", 2024-02-19T21:57:30.870 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:55:31.192970+0000", 2024-02-19T21:57:30.870 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 119.33652703999999, 2024-02-19T21:57:30.870 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.183172155, 2024-02-19T21:57:30.870 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:57:30.870 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:57:30.870 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:57:30.870 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:57:30.871 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:57:30.871 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 118531 2024-02-19T21:57:30.871 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.871 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:57:30.871 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.871 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:57:30.871 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.192970+0000", 2024-02-19T21:57:30.871 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:57:30.871 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.871 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.871 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:57:30.871 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.192970+0000", 2024-02-19T21:57:30.871 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:57:30.871 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.871 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.872 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:57:30.872 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.192968+0000", 2024-02-19T21:57:30.872 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.071e-06 2024-02-19T21:57:30.872 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.872 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.872 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:57:30.872 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.192974+0000", 2024-02-19T21:57:30.872 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3016e-05 2024-02-19T21:57:30.872 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.872 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.872 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:57:30.872 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.192987+0000", 2024-02-19T21:57:30.872 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4389999999999997e-06 2024-02-19T21:57:30.872 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.873 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.873 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:57:30.873 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.192994+0000", 2024-02-19T21:57:30.873 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.091291616000000006 2024-02-19T21:57:30.873 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.873 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.873 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:57:30.873 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.284285+0000", 2024-02-19T21:57:30.873 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115251 2024-02-19T21:57:30.873 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.873 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.873 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:57:30.873 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.284401+0000", 2024-02-19T21:57:30.873 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000129815 2024-02-19T21:57:30.873 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.874 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.874 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:57:30.874 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.284531+0000", 2024-02-19T21:57:30.874 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041027119999999997 2024-02-19T21:57:30.874 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.874 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.874 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:57:30.874 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.288633+0000", 2024-02-19T21:57:30.874 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.057853566000000002 2024-02-19T21:57:30.874 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.874 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.874 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.874 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.346487+0000", 2024-02-19T21:57:30.874 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.029544105000000001 2024-02-19T21:57:30.875 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.875 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.875 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.875 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.376031+0000", 2024-02-19T21:57:30.875 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6847000000000006e-05 2024-02-19T21:57:30.875 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.875 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.875 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:57:30.875 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.376098+0000", 2024-02-19T21:57:30.875 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4462999999999998e-05 2024-02-19T21:57:30.875 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.875 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.875 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:57:30.875 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.376142+0000", 2024-02-19T21:57:30.876 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.183172155 2024-02-19T21:57:30.876 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.876 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:57:30.876 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.876 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.876 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.876 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:118535 11.a 11:57af0a2a:::benchmark_data_smithi080_184406_object926:head [delete] snapc 0=[] ondisk+write+known_if_redirected e524)", 2024-02-19T21:57:30.876 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:55:31.196478+0000", 2024-02-19T21:57:30.876 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 119.33301891000001, 2024-02-19T21:57:30.876 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.17978433199999999, 2024-02-19T21:57:30.876 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:57:30.876 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:57:30.876 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:57:30.876 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:57:30.877 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:57:30.877 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 118535 2024-02-19T21:57:30.877 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.877 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:57:30.877 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.877 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:57:30.877 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.196478+0000", 2024-02-19T21:57:30.877 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:57:30.877 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.877 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.877 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:57:30.877 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.196478+0000", 2024-02-19T21:57:30.877 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:57:30.877 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.877 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.878 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:57:30.878 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.196476+0000", 2024-02-19T21:57:30.878 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9419999999999995e-06 2024-02-19T21:57:30.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.878 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.878 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:57:30.878 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.196484+0000", 2024-02-19T21:57:30.878 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7156e-05 2024-02-19T21:57:30.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.878 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.878 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:57:30.878 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.196501+0000", 2024-02-19T21:57:30.878 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.888e-06 2024-02-19T21:57:30.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.878 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.879 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:57:30.879 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.196508+0000", 2024-02-19T21:57:30.879 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.092752192999999997 2024-02-19T21:57:30.879 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.879 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.879 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:57:30.879 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.289261+0000", 2024-02-19T21:57:30.879 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000126153 2024-02-19T21:57:30.879 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.879 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.879 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:57:30.879 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.289387+0000", 2024-02-19T21:57:30.879 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014567000000000001 2024-02-19T21:57:30.879 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.880 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.880 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:57:30.880 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.289532+0000", 2024-02-19T21:57:30.880 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018903970999999999 2024-02-19T21:57:30.880 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.880 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.880 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:57:30.880 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.308436+0000", 2024-02-19T21:57:30.880 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.050686734999999997 2024-02-19T21:57:30.880 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.880 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.880 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.880 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.359123+0000", 2024-02-19T21:57:30.880 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017066553000000002 2024-02-19T21:57:30.880 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.881 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.881 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.881 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.376190+0000", 2024-02-19T21:57:30.881 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6727999999999997e-05 2024-02-19T21:57:30.881 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.881 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.881 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:57:30.881 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.376236+0000", 2024-02-19T21:57:30.881 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6188000000000001e-05 2024-02-19T21:57:30.881 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.881 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.881 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:57:30.881 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.376263+0000", 2024-02-19T21:57:30.881 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.17978433199999999 2024-02-19T21:57:30.882 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.882 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:57:30.882 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.882 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.882 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.882 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:118549 11.a 11:5e8a53f9:::benchmark_data_smithi080_184406_object940:head [delete] snapc 0=[] ondisk+write+known_if_redirected e524)", 2024-02-19T21:57:30.882 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:55:31.216845+0000", 2024-02-19T21:57:30.882 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 119.312652296, 2024-02-19T21:57:30.882 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.15954743399999999, 2024-02-19T21:57:30.882 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:57:30.882 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:57:30.882 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:57:30.882 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:57:30.882 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:57:30.883 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 118549 2024-02-19T21:57:30.883 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.883 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:57:30.883 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.883 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:57:30.883 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.216845+0000", 2024-02-19T21:57:30.883 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:57:30.883 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.883 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.883 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:57:30.883 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.216845+0000", 2024-02-19T21:57:30.883 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:57:30.883 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.883 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.883 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:57:30.884 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.216843+0000", 2024-02-19T21:57:30.884 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2809999999999997e-06 2024-02-19T21:57:30.884 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.884 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.884 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:57:30.884 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.216850+0000", 2024-02-19T21:57:30.884 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.153e-05 2024-02-19T21:57:30.884 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.884 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.884 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:57:30.884 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.216861+0000", 2024-02-19T21:57:30.884 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2300000000000002e-06 2024-02-19T21:57:30.884 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.884 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.884 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:57:30.885 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.216868+0000", 2024-02-19T21:57:30.885 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.076399975999999994 2024-02-19T21:57:30.885 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.885 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.885 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:57:30.885 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.293268+0000", 2024-02-19T21:57:30.885 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010562599999999999 2024-02-19T21:57:30.885 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.885 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.885 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:57:30.885 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.293374+0000", 2024-02-19T21:57:30.885 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101141 2024-02-19T21:57:30.885 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.885 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.885 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:57:30.885 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.293475+0000", 2024-02-19T21:57:30.885 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014968189999999999 2024-02-19T21:57:30.886 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.886 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.886 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:57:30.886 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.308443+0000", 2024-02-19T21:57:30.886 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.050723957 2024-02-19T21:57:30.886 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.886 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.886 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.886 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.359167+0000", 2024-02-19T21:57:30.886 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01713926 2024-02-19T21:57:30.886 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.886 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.886 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.886 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.376307+0000", 2024-02-19T21:57:30.886 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6635999999999999e-05 2024-02-19T21:57:30.886 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.887 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.887 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:57:30.887 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.376353+0000", 2024-02-19T21:57:30.887 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9059e-05 2024-02-19T21:57:30.887 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.887 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.887 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:57:30.887 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.376392+0000", 2024-02-19T21:57:30.887 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.15954743399999999 2024-02-19T21:57:30.887 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.887 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:57:30.887 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.887 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.887 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.887 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:118558 11.a 11:5f7ba563:::benchmark_data_smithi080_184406_object949:head [delete] snapc 0=[] ondisk+write+known_if_redirected e524)", 2024-02-19T21:57:30.888 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:55:31.226235+0000", 2024-02-19T21:57:30.888 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 119.303262355, 2024-02-19T21:57:30.888 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.15028807799999999, 2024-02-19T21:57:30.888 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:57:30.888 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:57:30.888 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:57:30.888 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:57:30.888 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:57:30.888 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 118558 2024-02-19T21:57:30.888 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.888 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:57:30.888 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.888 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:57:30.888 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.226235+0000", 2024-02-19T21:57:30.889 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:57:30.889 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.889 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.889 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:57:30.889 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.226235+0000", 2024-02-19T21:57:30.889 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:57:30.889 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.889 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.889 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:57:30.889 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.226233+0000", 2024-02-19T21:57:30.889 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6580000000000008e-06 2024-02-19T21:57:30.889 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.889 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.889 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:57:30.890 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.226241+0000", 2024-02-19T21:57:30.890 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8953999999999998e-05 2024-02-19T21:57:30.890 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.890 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.890 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:57:30.890 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.226260+0000", 2024-02-19T21:57:30.890 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0634e-05 2024-02-19T21:57:30.890 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.890 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.890 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:57:30.890 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.226271+0000", 2024-02-19T21:57:30.890 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.070753653999999999 2024-02-19T21:57:30.890 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.890 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.891 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:57:30.891 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.297025+0000", 2024-02-19T21:57:30.891 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3768000000000001e-05 2024-02-19T21:57:30.891 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.891 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.891 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:57:30.891 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.297118+0000", 2024-02-19T21:57:30.891 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8714999999999993e-05 2024-02-19T21:57:30.891 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.891 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.891 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:57:30.891 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.297207+0000", 2024-02-19T21:57:30.891 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019163948 2024-02-19T21:57:30.891 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.891 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.892 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:57:30.892 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.316371+0000", 2024-02-19T21:57:30.892 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.042830695000000002 2024-02-19T21:57:30.892 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.892 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.892 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.892 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.359202+0000", 2024-02-19T21:57:30.892 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017238052 2024-02-19T21:57:30.892 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.892 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.892 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.893 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.376440+0000", 2024-02-19T21:57:30.893 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5160000000000001e-05 2024-02-19T21:57:30.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.893 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.893 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:57:30.893 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.376485+0000", 2024-02-19T21:57:30.893 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7857e-05 2024-02-19T21:57:30.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.893 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.893 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:57:30.893 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.376523+0000", 2024-02-19T21:57:30.893 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.15028807799999999 2024-02-19T21:57:30.893 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.894 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:57:30.894 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.894 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.894 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.894 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:118561 11.a 11:570e7491:::benchmark_data_smithi080_184406_object952:head [delete] snapc 0=[] ondisk+write+known_if_redirected e524)", 2024-02-19T21:57:30.894 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:55:31.233878+0000", 2024-02-19T21:57:30.894 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 119.295619401, 2024-02-19T21:57:30.894 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.142774181, 2024-02-19T21:57:30.894 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:57:30.894 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:57:30.894 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:57:30.894 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:57:30.894 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:57:30.894 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 118561 2024-02-19T21:57:30.894 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.895 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:57:30.895 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.895 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:57:30.895 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.233878+0000", 2024-02-19T21:57:30.895 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:57:30.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.895 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.895 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:57:30.895 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.233878+0000", 2024-02-19T21:57:30.895 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:57:30.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.895 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.895 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:57:30.895 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.233876+0000", 2024-02-19T21:57:30.896 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8529999999999992e-06 2024-02-19T21:57:30.896 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.896 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.896 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:57:30.896 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.233884+0000", 2024-02-19T21:57:30.896 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2557e-05 2024-02-19T21:57:30.896 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.896 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.896 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:57:30.896 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.233896+0000", 2024-02-19T21:57:30.896 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5509999999999996e-06 2024-02-19T21:57:30.896 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.896 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.896 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:57:30.896 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.233903+0000", 2024-02-19T21:57:30.897 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.066900035999999996 2024-02-19T21:57:30.897 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.897 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.897 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:57:30.897 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.300803+0000", 2024-02-19T21:57:30.897 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1118999999999994e-05 2024-02-19T21:57:30.897 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.897 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.897 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:57:30.897 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.300884+0000", 2024-02-19T21:57:30.897 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4244000000000002e-05 2024-02-19T21:57:30.897 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.897 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.897 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:57:30.897 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.300968+0000", 2024-02-19T21:57:30.898 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015411734999999999 2024-02-19T21:57:30.898 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.898 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.898 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:57:30.898 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.316380+0000", 2024-02-19T21:57:30.898 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.048041190999999997 2024-02-19T21:57:30.898 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.898 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.898 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.898 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.364421+0000", 2024-02-19T21:57:30.898 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012145417 2024-02-19T21:57:30.898 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.898 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.898 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.898 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.376567+0000", 2024-02-19T21:57:30.899 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3309000000000002e-05 2024-02-19T21:57:30.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.899 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.899 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:57:30.899 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.376610+0000", 2024-02-19T21:57:30.899 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2042999999999997e-05 2024-02-19T21:57:30.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.899 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.899 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:57:30.899 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.376652+0000", 2024-02-19T21:57:30.899 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.142774181 2024-02-19T21:57:30.899 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.899 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:57:30.899 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.900 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.900 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:118565 11.a 11:573298d1:::benchmark_data_smithi080_184406_object956:head [delete] snapc 0=[] ondisk+write+known_if_redirected e524)", 2024-02-19T21:57:30.900 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:55:31.238240+0000", 2024-02-19T21:57:30.900 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 119.291256776, 2024-02-19T21:57:30.900 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.13853797900000001, 2024-02-19T21:57:30.900 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:57:30.900 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:57:30.900 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:57:30.900 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:57:30.900 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:57:30.900 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 118565 2024-02-19T21:57:30.900 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.900 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:57:30.900 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:57:30.901 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.238240+0000", 2024-02-19T21:57:30.901 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:57:30.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.901 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:57:30.901 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.238240+0000", 2024-02-19T21:57:30.901 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:57:30.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.901 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:57:30.901 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.238239+0000", 2024-02-19T21:57:30.901 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2759999999999997e-06 2024-02-19T21:57:30.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.902 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.902 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:57:30.902 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.238245+0000", 2024-02-19T21:57:30.902 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7427000000000001e-05 2024-02-19T21:57:30.902 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.902 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.902 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:57:30.902 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.238262+0000", 2024-02-19T21:57:30.902 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7580000000000003e-06 2024-02-19T21:57:30.902 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.902 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.902 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:57:30.902 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.238269+0000", 2024-02-19T21:57:30.902 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.066190869999999999 2024-02-19T21:57:30.902 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.903 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.903 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:57:30.903 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.304460+0000", 2024-02-19T21:57:30.903 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5847000000000007e-05 2024-02-19T21:57:30.903 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.903 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.903 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:57:30.903 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.304546+0000", 2024-02-19T21:57:30.903 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6875999999999999e-05 2024-02-19T21:57:30.903 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.903 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.903 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:57:30.903 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.304643+0000", 2024-02-19T21:57:30.903 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01596409 2024-02-19T21:57:30.904 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.904 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.904 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:57:30.904 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.320607+0000", 2024-02-19T21:57:30.904 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.049266809000000002 2024-02-19T21:57:30.904 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.904 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.904 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.904 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.369874+0000", 2024-02-19T21:57:30.904 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0068205710000000001 2024-02-19T21:57:30.904 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.904 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.904 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.904 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.376694+0000", 2024-02-19T21:57:30.905 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4252999999999998e-05 2024-02-19T21:57:30.905 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.905 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.905 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:57:30.905 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.376738+0000", 2024-02-19T21:57:30.905 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9913999999999998e-05 2024-02-19T21:57:30.905 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.905 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.905 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:57:30.905 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.376778+0000", 2024-02-19T21:57:30.905 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.13853797900000001 2024-02-19T21:57:30.905 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.905 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:57:30.906 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.906 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.906 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.906 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:118781 11.a 11:5af33389:::benchmark_data_smithi080_184406_object1172:head [delete] snapc 0=[] ondisk+write+known_if_redirected e524)", 2024-02-19T21:57:30.906 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:55:31.557548+0000", 2024-02-19T21:57:30.906 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 118.971949479, 2024-02-19T21:57:30.906 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.13516409700000001, 2024-02-19T21:57:30.906 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:57:30.906 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:57:30.906 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:57:30.906 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:57:30.906 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:57:30.906 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 118781 2024-02-19T21:57:30.906 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.906 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:57:30.907 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.907 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:57:30.907 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.557548+0000", 2024-02-19T21:57:30.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:57:30.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.907 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.907 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:57:30.907 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.557548+0000", 2024-02-19T21:57:30.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:57:30.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.907 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.907 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:57:30.907 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.557546+0000", 2024-02-19T21:57:30.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8210000000000002e-06 2024-02-19T21:57:30.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.908 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.908 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:57:30.908 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.557554+0000", 2024-02-19T21:57:30.908 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6769000000000002e-05 2024-02-19T21:57:30.908 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.908 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.908 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:57:30.908 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.557570+0000", 2024-02-19T21:57:30.908 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1489999999999994e-06 2024-02-19T21:57:30.908 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.908 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.908 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:57:30.908 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.557579+0000", 2024-02-19T21:57:30.908 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.078398512000000004 2024-02-19T21:57:30.909 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.909 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.909 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:57:30.909 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.635977+0000", 2024-02-19T21:57:30.909 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013301 2024-02-19T21:57:30.909 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.909 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.909 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:57:30.909 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.636110+0000", 2024-02-19T21:57:30.909 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015910499999999999 2024-02-19T21:57:30.909 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.909 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.909 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:57:30.909 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.636269+0000", 2024-02-19T21:57:30.909 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012663565 2024-02-19T21:57:30.909 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:57:30.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.648933+0000", 2024-02-19T21:57:30.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023589689 2024-02-19T21:57:30.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.672522+0000", 2024-02-19T21:57:30.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020106453 2024-02-19T21:57:30.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.692629+0000", 2024-02-19T21:57:30.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7453999999999997e-05 2024-02-19T21:57:30.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.911 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:57:30.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.692676+0000", 2024-02-19T21:57:30.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5385000000000001e-05 2024-02-19T21:57:30.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.911 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:57:30.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.692712+0000", 2024-02-19T21:57:30.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.13516409700000001 2024-02-19T21:57:30.911 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.911 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:57:30.911 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.912 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.912 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:118898 11.a 11:51b4b372:::benchmark_data_smithi080_184406_object1289:head [delete] snapc 0=[] ondisk+write+known_if_redirected e525)", 2024-02-19T21:57:30.912 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:55:31.708838+0000", 2024-02-19T21:57:30.912 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 118.820658905, 2024-02-19T21:57:30.912 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.14336380600000001, 2024-02-19T21:57:30.912 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:57:30.912 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:57:30.912 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:57:30.912 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:57:30.912 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:57:30.912 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 118898 2024-02-19T21:57:30.912 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.912 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:57:30.912 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.913 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:57:30.913 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.708838+0000", 2024-02-19T21:57:30.913 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:57:30.913 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.913 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.913 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:57:30.913 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.708838+0000", 2024-02-19T21:57:30.913 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999976 2024-02-19T21:57:30.913 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.913 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.913 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:57:30.913 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.708836+0000", 2024-02-19T21:57:30.913 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0195e-05 2024-02-19T21:57:30.913 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.913 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.914 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:57:30.914 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.708846+0000", 2024-02-19T21:57:30.914 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4012000000000001e-05 2024-02-19T21:57:30.914 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.914 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.914 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:57:30.914 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.708860+0000", 2024-02-19T21:57:30.914 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1069999999999999e-06 2024-02-19T21:57:30.914 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.914 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.914 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:57:30.914 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.708867+0000", 2024-02-19T21:57:30.914 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022439723000000002 2024-02-19T21:57:30.914 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.914 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.915 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:57:30.915 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.731307+0000", 2024-02-19T21:57:30.915 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2693000000000003e-05 2024-02-19T21:57:30.915 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.915 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.915 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:57:30.915 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.731390+0000", 2024-02-19T21:57:30.915 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0674000000000006e-05 2024-02-19T21:57:30.915 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.915 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.915 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:57:30.915 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.731480+0000", 2024-02-19T21:57:30.915 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.120541458 2024-02-19T21:57:30.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.916 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.916 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:57:30.916 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.852022+0000", 2024-02-19T21:57:30.916 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7681000000000001e-05 2024-02-19T21:57:30.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.916 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.916 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.916 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.852049+0000", 2024-02-19T21:57:30.916 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8609000000000005e-05 2024-02-19T21:57:30.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.916 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.916 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.917 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.852138+0000", 2024-02-19T21:57:30.917 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7153000000000002e-05 2024-02-19T21:57:30.917 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.917 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.917 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:57:30.917 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.852175+0000", 2024-02-19T21:57:30.917 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6838e-05 2024-02-19T21:57:30.917 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.917 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.917 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:57:30.917 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.852202+0000", 2024-02-19T21:57:30.917 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.14336380600000001 2024-02-19T21:57:30.917 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.917 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:57:30.918 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.918 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.918 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.918 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:118923 11.a 11:57e2b0c6:::benchmark_data_smithi080_184406_object1314:head [delete] snapc 0=[] ondisk+write+known_if_redirected e525)", 2024-02-19T21:57:30.918 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:55:31.737128+0000", 2024-02-19T21:57:30.918 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 118.79236909799999, 2024-02-19T21:57:30.918 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.133928398, 2024-02-19T21:57:30.918 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:57:30.918 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:57:30.918 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:57:30.918 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:57:30.918 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:57:30.918 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 118923 2024-02-19T21:57:30.919 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.919 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:57:30.919 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.919 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:57:30.919 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.737128+0000", 2024-02-19T21:57:30.919 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:57:30.919 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.919 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.919 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:57:30.919 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.737128+0000", 2024-02-19T21:57:30.919 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999976 2024-02-19T21:57:30.919 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.919 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.919 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:57:30.919 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.737126+0000", 2024-02-19T21:57:30.920 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.064e-05 2024-02-19T21:57:30.920 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.920 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.920 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:57:30.920 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.737136+0000", 2024-02-19T21:57:30.920 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7995999999999998e-05 2024-02-19T21:57:30.920 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.920 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.920 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:57:30.920 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.737154+0000", 2024-02-19T21:57:30.920 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8310000000000001e-06 2024-02-19T21:57:30.920 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.920 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.920 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:57:30.921 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.737162+0000", 2024-02-19T21:57:30.921 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.11647656200000001 2024-02-19T21:57:30.921 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.921 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.921 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:57:30.921 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.853639+0000", 2024-02-19T21:57:30.921 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5939999999999995e-05 2024-02-19T21:57:30.921 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.921 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.921 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:57:30.921 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.853715+0000", 2024-02-19T21:57:30.921 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000103336 2024-02-19T21:57:30.921 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.921 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.921 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:57:30.921 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.853818+0000", 2024-02-19T21:57:30.922 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016843862000000001 2024-02-19T21:57:30.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.922 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.922 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:57:30.922 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.870662+0000", 2024-02-19T21:57:30.922 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025609899999999998 2024-02-19T21:57:30.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.922 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.922 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.922 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.870918+0000", 2024-02-19T21:57:30.922 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5599000000000001e-05 2024-02-19T21:57:30.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.922 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.922 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.870974+0000", 2024-02-19T21:57:30.923 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6866999999999997e-05 2024-02-19T21:57:30.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.923 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.923 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:57:30.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.871021+0000", 2024-02-19T21:57:30.923 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5837000000000003e-05 2024-02-19T21:57:30.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.923 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.923 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:57:30.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:31.871056+0000", 2024-02-19T21:57:30.923 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.133928398 2024-02-19T21:57:30.923 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.923 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:57:30.923 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.924 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.924 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:119200 11.a 11:52b71352:::benchmark_data_smithi080_184406_object1591:head [delete] snapc 0=[] ondisk+write+known_if_redirected e525)", 2024-02-19T21:57:30.924 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:55:32.101160+0000", 2024-02-19T21:57:30.924 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 118.428337425, 2024-02-19T21:57:30.924 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.13525120299999999, 2024-02-19T21:57:30.924 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:57:30.924 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:57:30.924 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:57:30.924 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:57:30.924 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:57:30.924 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 119200 2024-02-19T21:57:30.924 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.924 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:57:30.924 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.925 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:57:30.925 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.101160+0000", 2024-02-19T21:57:30.925 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:57:30.925 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.925 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.925 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:57:30.925 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.101160+0000", 2024-02-19T21:57:30.925 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:57:30.925 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.925 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.926 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:57:30.926 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.101158+0000", 2024-02-19T21:57:30.926 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3440000000000007e-06 2024-02-19T21:57:30.926 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.926 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.926 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:57:30.926 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.101167+0000", 2024-02-19T21:57:30.926 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1752000000000001e-05 2024-02-19T21:57:30.926 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.926 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.926 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:57:30.926 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.101189+0000", 2024-02-19T21:57:30.926 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4870000000000002e-06 2024-02-19T21:57:30.926 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.927 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.927 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:57:30.927 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.101197+0000", 2024-02-19T21:57:30.927 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.088993188000000001 2024-02-19T21:57:30.927 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.927 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.927 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:57:30.927 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.190191+0000", 2024-02-19T21:57:30.927 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119848 2024-02-19T21:57:30.927 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.927 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.927 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:57:30.927 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.190310+0000", 2024-02-19T21:57:30.927 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013735200000000001 2024-02-19T21:57:30.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.928 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:57:30.928 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.190448+0000", 2024-02-19T21:57:30.928 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.035573053 2024-02-19T21:57:30.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.928 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.928 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.226021+0000", 2024-02-19T21:57:30.928 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9277000000000005e-05 2024-02-19T21:57:30.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.928 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.928 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.226120+0000", 2024-02-19T21:57:30.929 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010006648999999999 2024-02-19T21:57:30.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:57:30.929 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.236127+0000", 2024-02-19T21:57:30.929 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6078000000000003e-05 2024-02-19T21:57:30.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:57:30.929 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.236163+0000", 2024-02-19T21:57:30.929 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024806600000000002 2024-02-19T21:57:30.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:57:30.929 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.236411+0000", 2024-02-19T21:57:30.930 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.13525120299999999 2024-02-19T21:57:30.930 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.930 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:57:30.930 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.930 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.930 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.930 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:119206 11.a 11:546d220a:::benchmark_data_smithi080_184406_object1597:head [delete] snapc 0=[] ondisk+write+known_if_redirected e525)", 2024-02-19T21:57:30.930 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:55:32.102454+0000", 2024-02-19T21:57:30.930 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 118.427042825, 2024-02-19T21:57:30.930 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.134180357, 2024-02-19T21:57:30.930 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:57:30.930 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:57:30.930 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:57:30.930 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:57:30.930 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:57:30.931 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 119206 2024-02-19T21:57:30.931 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.931 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:57:30.931 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.931 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:57:30.931 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.102454+0000", 2024-02-19T21:57:30.931 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:57:30.931 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.931 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.931 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:57:30.931 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.102454+0000", 2024-02-19T21:57:30.931 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:57:30.931 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.931 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.931 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:57:30.932 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.102453+0000", 2024-02-19T21:57:30.932 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3509999999999996e-06 2024-02-19T21:57:30.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.932 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.932 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:57:30.932 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.102460+0000", 2024-02-19T21:57:30.932 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3912e-05 2024-02-19T21:57:30.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.932 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.932 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:57:30.932 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.102474+0000", 2024-02-19T21:57:30.932 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4579999999999998e-06 2024-02-19T21:57:30.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.932 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:57:30.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.102480+0000", 2024-02-19T21:57:30.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.093172982000000001 2024-02-19T21:57:30.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:57:30.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.195653+0000", 2024-02-19T21:57:30.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000139006 2024-02-19T21:57:30.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:57:30.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.195792+0000", 2024-02-19T21:57:30.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013683599999999999 2024-02-19T21:57:30.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:57:30.934 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.195929+0000", 2024-02-19T21:57:30.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.030124763999999998 2024-02-19T21:57:30.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.934 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.226054+0000", 2024-02-19T21:57:30.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3089000000000003e-05 2024-02-19T21:57:30.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.934 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.226147+0000", 2024-02-19T21:57:30.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010428112 2024-02-19T21:57:30.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.935 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:57:30.935 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.236575+0000", 2024-02-19T21:57:30.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9502e-05 2024-02-19T21:57:30.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.935 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:57:30.935 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.236605+0000", 2024-02-19T21:57:30.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9878000000000001e-05 2024-02-19T21:57:30.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.935 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:57:30.935 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.236635+0000", 2024-02-19T21:57:30.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.134180357 2024-02-19T21:57:30.935 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.936 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:57:30.936 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.936 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.936 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:119377 11.a 11:5bdd7a67:::benchmark_data_smithi080_184406_object1768:head [delete] snapc 0=[] ondisk+write+known_if_redirected e525)", 2024-02-19T21:57:30.936 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:55:32.305230+0000", 2024-02-19T21:57:30.936 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 118.224266669, 2024-02-19T21:57:30.936 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.14492300799999999, 2024-02-19T21:57:30.936 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:57:30.936 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:57:30.936 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:57:30.936 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:57:30.936 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:57:30.936 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 119377 2024-02-19T21:57:30.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.937 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:57:30.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:57:30.937 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.305230+0000", 2024-02-19T21:57:30.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:57:30.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:57:30.937 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.305230+0000", 2024-02-19T21:57:30.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999976 2024-02-19T21:57:30.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:57:30.937 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.305228+0000", 2024-02-19T21:57:30.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1309999999999995e-06 2024-02-19T21:57:30.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.938 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:57:30.938 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.305237+0000", 2024-02-19T21:57:30.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4268e-05 2024-02-19T21:57:30.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.938 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:57:30.938 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.305252+0000", 2024-02-19T21:57:30.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1080000000000001e-05 2024-02-19T21:57:30.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.938 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:57:30.938 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.305263+0000", 2024-02-19T21:57:30.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.057683318999999997 2024-02-19T21:57:30.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:57:30.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.362946+0000", 2024-02-19T21:57:30.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012437700000000001 2024-02-19T21:57:30.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:57:30.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.363070+0000", 2024-02-19T21:57:30.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015147700000000001 2024-02-19T21:57:30.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:57:30.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.363222+0000", 2024-02-19T21:57:30.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013498962 2024-02-19T21:57:30.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:57:30.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.376721+0000", 2024-02-19T21:57:30.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.045406078000000002 2024-02-19T21:57:30.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.422127+0000", 2024-02-19T21:57:30.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.027941602999999999 2024-02-19T21:57:30.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.450069+0000", 2024-02-19T21:57:30.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4503999999999999e-05 2024-02-19T21:57:30.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.941 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:57:30.941 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.450113+0000", 2024-02-19T21:57:30.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0389999999999998e-05 2024-02-19T21:57:30.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.941 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:57:30.941 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.450153+0000", 2024-02-19T21:57:30.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.14492300799999999 2024-02-19T21:57:30.941 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.941 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:57:30.941 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.942 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:119529 11.a 11:55c09eab:::benchmark_data_smithi080_184406_object1920:head [delete] snapc 0=[] ondisk+write+known_if_redirected e525)", 2024-02-19T21:57:30.942 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:55:32.494325+0000", 2024-02-19T21:57:30.942 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 118.035171781, 2024-02-19T21:57:30.942 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.17241863299999999, 2024-02-19T21:57:30.942 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:57:30.942 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:57:30.942 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:57:30.942 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:57:30.942 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:57:30.942 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 119529 2024-02-19T21:57:30.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.942 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:57:30.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:57:30.943 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.494325+0000", 2024-02-19T21:57:30.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:57:30.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:57:30.943 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.494325+0000", 2024-02-19T21:57:30.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:57:30.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:57:30.943 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.494323+0000", 2024-02-19T21:57:30.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.242e-06 2024-02-19T21:57:30.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:57:30.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.494332+0000", 2024-02-19T21:57:30.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4266e-05 2024-02-19T21:57:30.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:57:30.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.494346+0000", 2024-02-19T21:57:30.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9370000000000004e-06 2024-02-19T21:57:30.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:57:30.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.494354+0000", 2024-02-19T21:57:30.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.094069600000000003 2024-02-19T21:57:30.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:57:30.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.588424+0000", 2024-02-19T21:57:30.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012465499999999999 2024-02-19T21:57:30.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:57:30.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.588548+0000", 2024-02-19T21:57:30.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015261499999999999 2024-02-19T21:57:30.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:57:30.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.588701+0000", 2024-02-19T21:57:30.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010237567 2024-02-19T21:57:30.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:57:30.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.598938+0000", 2024-02-19T21:57:30.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024827654000000001 2024-02-19T21:57:30.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.623766+0000", 2024-02-19T21:57:30.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.042867332000000001 2024-02-19T21:57:30.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.666633+0000", 2024-02-19T21:57:30.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2224000000000006e-05 2024-02-19T21:57:30.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:57:30.947 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.666696+0000", 2024-02-19T21:57:30.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8392e-05 2024-02-19T21:57:30.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:57:30.947 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.666744+0000", 2024-02-19T21:57:30.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.17241863299999999 2024-02-19T21:57:30.947 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.947 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:57:30.947 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.948 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.25952.0:119536 11.a 11:54134c8c:::benchmark_data_smithi080_184406_object1927:head [delete] snapc 0=[] ondisk+write+known_if_redirected e525)", 2024-02-19T21:57:30.948 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:55:32.503947+0000", 2024-02-19T21:57:30.948 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 118.025549672, 2024-02-19T21:57:30.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.16292800499999999, 2024-02-19T21:57:30.948 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:57:30.948 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:57:30.948 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:57:30.948 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.25952", 2024-02-19T21:57:30.948 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/343070858", 2024-02-19T21:57:30.948 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 119536 2024-02-19T21:57:30.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.948 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:57:30.948 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.948 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:57:30.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.503947+0000", 2024-02-19T21:57:30.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:57:30.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:57:30.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.503947+0000", 2024-02-19T21:57:30.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999981 2024-02-19T21:57:30.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:57:30.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.503946+0000", 2024-02-19T21:57:30.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7540000000000006e-06 2024-02-19T21:57:30.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:57:30.950 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.503953+0000", 2024-02-19T21:57:30.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5062000000000001e-05 2024-02-19T21:57:30.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:57:30.950 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.503968+0000", 2024-02-19T21:57:30.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6899999999999992e-06 2024-02-19T21:57:30.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:57:30.950 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.503976+0000", 2024-02-19T21:57:30.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.090204603999999994 2024-02-19T21:57:30.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:57:30.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.594181+0000", 2024-02-19T21:57:30.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5054000000000002e-05 2024-02-19T21:57:30.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:57:30.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.594276+0000", 2024-02-19T21:57:30.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000154308 2024-02-19T21:57:30.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5,6", 2024-02-19T21:57:30.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.594430+0000", 2024-02-19T21:57:30.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046906609999999996 2024-02-19T21:57:30.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.952 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-02-19T21:57:30.952 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.599121+0000", 2024-02-19T21:57:30.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024678067000000001 2024-02-19T21:57:30.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.952 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.952 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.623799+0000", 2024-02-19T21:57:30.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.042987974999999998 2024-02-19T21:57:30.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.952 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-02-19T21:57:30.952 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.666787+0000", 2024-02-19T21:57:30.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4236000000000001e-05 2024-02-19T21:57:30.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.953 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:57:30.953 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.666831+0000", 2024-02-19T21:57:30.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4452000000000001e-05 2024-02-19T21:57:30.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:57:30.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:57:30.953 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:57:30.953 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:55:32.666875+0000", 2024-02-19T21:57:30.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.16292800499999999 2024-02-19T21:57:30.953 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.953 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:57:30.953 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.953 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:57:30.953 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:57:30.953 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:57:30.954 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:57:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:57:30] "GET /metrics HTTP/1.1" 200 176853 "" "Prometheus/2.33.4" 2024-02-19T21:57:31.198 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:57:31.203 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/osd.0/config 2024-02-19T21:57:31.204 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:31.205 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:57:31.306 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:57:31.332 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:31.351 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:57:31.353 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:31.354 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:57:31.447 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:29.331804+0000 mgr.y (mgr.14514) 950 : cluster [DBG] pgmap v1228: 138 pgs: 23 active+undersized+degraded, 31 active+undersized, 84 active+clean; 58 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 652 B/s rd, 0 B/s wr, 800 op/s; 328/3363 objects degraded (9.753%) 2024-02-19T21:57:31.447 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:30.473355+0000 mon.a (mon.0) 2055 : cluster [WRN] Health check update: Degraded data redundancy: 328/3363 objects degraded (9.753%), 23 pgs degraded (PG_DEGRADED) 2024-02-19T21:57:31.448 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:30.481207+0000 mon.a (mon.0) 2056 : cluster [DBG] osdmap e558: 8 total, 7 up, 8 in 2024-02-19T21:57:31.455 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4 2024-02-19T21:57:31.482 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:31.501 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T21:57:31.503 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:31.504 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4' 2024-02-19T21:57:31.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:29.331804+0000 mgr.y (mgr.14514) 950 : cluster [DBG] pgmap v1228: 138 pgs: 23 active+undersized+degraded, 31 active+undersized, 84 active+clean; 58 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 652 B/s rd, 0 B/s wr, 800 op/s; 328/3363 objects degraded (9.753%) 2024-02-19T21:57:31.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:30.473355+0000 mon.a (mon.0) 2055 : cluster [WRN] Health check update: Degraded data redundancy: 328/3363 objects degraded (9.753%), 23 pgs degraded (PG_DEGRADED) 2024-02-19T21:57:31.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:30.481207+0000 mon.a (mon.0) 2056 : cluster [DBG] osdmap e558: 8 total, 7 up, 8 in 2024-02-19T21:57:31.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:29.331804+0000 mgr.y (mgr.14514) 950 : cluster [DBG] pgmap v1228: 138 pgs: 23 active+undersized+degraded, 31 active+undersized, 84 active+clean; 58 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 652 B/s rd, 0 B/s wr, 800 op/s; 328/3363 objects degraded (9.753%) 2024-02-19T21:57:31.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:30.473355+0000 mon.a (mon.0) 2055 : cluster [WRN] Health check update: Degraded data redundancy: 328/3363 objects degraded (9.753%), 23 pgs degraded (PG_DEGRADED) 2024-02-19T21:57:31.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:30.481207+0000 mon.a (mon.0) 2056 : cluster [DBG] osdmap e558: 8 total, 7 up, 8 in 2024-02-19T21:57:31.605 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:57:31.633 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:31.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:57:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:57:33.130 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.4 dump_ops_in_flight 2024-02-19T21:57:33.386 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:57:33.387 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:31.332513+0000 mgr.y (mgr.14514) 951 : cluster [DBG] pgmap v1230: 138 pgs: 19 active+undersized+degraded, 35 active+undersized, 84 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 822 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:33.387 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:31.448355+0000 mgr.y (mgr.14514) 952 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:57:33.387 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:31.332513+0000 mgr.y (mgr.14514) 951 : cluster [DBG] pgmap v1230: 138 pgs: 19 active+undersized+degraded, 35 active+undersized, 84 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 822 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:33.387 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:31.448355+0000 mgr.y (mgr.14514) 952 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:57:33.388 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:33.389 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:57:33.403 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:57:33.489 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:57:33.514 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:31.332513+0000 mgr.y (mgr.14514) 951 : cluster [DBG] pgmap v1230: 138 pgs: 19 active+undersized+degraded, 35 active+undersized, 84 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 822 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:33.514 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:31.448355+0000 mgr.y (mgr.14514) 952 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:57:33.516 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:33.616 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:57:33.621 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:33.621 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:57:33.722 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1 2024-02-19T21:57:33.752 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'unique_pool_4' removed 2024-02-19T21:57:34.211 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T21:57:34.216 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:34.217 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1' 2024-02-19T21:57:34.272 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:33.317145+0000 mon.c (mon.2) 135 : audit [INF] from='client.? 172.21.15.80:0/1276856657' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T21:57:34.272 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:33.317440+0000 mon.a (mon.0) 2057 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T21:57:34.318 DEBUG:teuthology.orchestra.run.smithi080:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2 2024-02-19T21:57:34.343 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:33.317145+0000 mon.c (mon.2) 135 : audit [INF] from='client.? 172.21.15.80:0/1276856657' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T21:57:34.343 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:33.317440+0000 mon.a (mon.0) 2057 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T21:57:34.343 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:33.317145+0000 mon.c (mon.2) 135 : audit [INF] from='client.? 172.21.15.80:0/1276856657' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T21:57:34.343 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:33.317440+0000 mon.a (mon.0) 2057 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T21:57:34.345 INFO:teuthology.orchestra.run.smithi080.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:34.895 INFO:teuthology.orchestra.run.smithi080.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T21:57:34.898 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:34.898 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi080 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2' 2024-02-19T21:57:34.999 DEBUG:teuthology.orchestra.run.smithi157:> sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6 2024-02-19T21:57:35.027 INFO:teuthology.orchestra.run.smithi157.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-02-19T21:57:35.139 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-02-19T21:57:35.154 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:33.333205+0000 mgr.y (mgr.14514) 953 : cluster [DBG] pgmap v1231: 138 pgs: 18 active+undersized+degraded, 36 active+undersized, 84 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 643 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:35.154 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:34.128440+0000 mon.a (mon.0) 2058 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]': finished 2024-02-19T21:57:35.154 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:34.128504+0000 mon.a (mon.0) 2059 : cluster [DBG] osdmap e559: 8 total, 7 up, 8 in 2024-02-19T21:57:35.154 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:34.213526+0000 mon.a (mon.0) 2060 : audit [INF] from='client.? 172.21.15.80:0/2883433588' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:57:35.154 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:33.333205+0000 mgr.y (mgr.14514) 953 : cluster [DBG] pgmap v1231: 138 pgs: 18 active+undersized+degraded, 36 active+undersized, 84 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 643 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:35.155 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:34.128440+0000 mon.a (mon.0) 2058 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]': finished 2024-02-19T21:57:35.155 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:34.128504+0000 mon.a (mon.0) 2059 : cluster [DBG] osdmap e559: 8 total, 7 up, 8 in 2024-02-19T21:57:35.155 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:34.213526+0000 mon.a (mon.0) 2060 : audit [INF] from='client.? 172.21.15.80:0/2883433588' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:57:35.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:33.333205+0000 mgr.y (mgr.14514) 953 : cluster [DBG] pgmap v1231: 138 pgs: 18 active+undersized+degraded, 36 active+undersized, 84 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 643 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:35.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:34.128440+0000 mon.a (mon.0) 2058 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]': finished 2024-02-19T21:57:35.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:34.128504+0000 mon.a (mon.0) 2059 : cluster [DBG] osdmap e559: 8 total, 7 up, 8 in 2024-02-19T21:57:35.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:34.213526+0000 mon.a (mon.0) 2060 : audit [INF] from='client.? 172.21.15.80:0/2883433588' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:57:35.568 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:57:36.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:57:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:57:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:57:36.057 INFO:teuthology.orchestra.run.smithi080.stdout: marking collection for removal 2024-02-19T21:57:36.057 INFO:teuthology.orchestra.run.smithi080.stdout:setting '_remove' omap key 2024-02-19T21:57:36.058 INFO:teuthology.orchestra.run.smithi080.stdout:finish_remove_pgs 5.b_head removing 5.b 2024-02-19T21:57:36.058 INFO:teuthology.orchestra.run.smithi080.stdout:Remove successful 2024-02-19T21:57:36.491 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:35.123083+0000 mon.a (mon.0) 2061 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:57:36.491 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:35.132921+0000 mon.a (mon.0) 2062 : audit [INF] from='client.? 172.21.15.80:0/2883433588' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:57:36.491 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:35.132969+0000 mon.a (mon.0) 2063 : cluster [DBG] osdmap e560: 8 total, 7 up, 8 in 2024-02-19T21:57:36.492 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:35.475029+0000 mon.a (mon.0) 2064 : cluster [WRN] Health check update: Degraded data redundancy: 71/576 objects degraded (12.326%), 18 pgs degraded (PG_DEGRADED) 2024-02-19T21:57:36.492 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:35.123083+0000 mon.a (mon.0) 2061 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:57:36.492 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:35.132921+0000 mon.a (mon.0) 2062 : audit [INF] from='client.? 172.21.15.80:0/2883433588' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:57:36.492 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:35.132969+0000 mon.a (mon.0) 2063 : cluster [DBG] osdmap e560: 8 total, 7 up, 8 in 2024-02-19T21:57:36.492 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:35.475029+0000 mon.a (mon.0) 2064 : cluster [WRN] Health check update: Degraded data redundancy: 71/576 objects degraded (12.326%), 18 pgs degraded (PG_DEGRADED) 2024-02-19T21:57:36.510 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-02-19T21:57:36.520 INFO:tasks.thrashosds:joining thrashosds 2024-02-19T21:57:36.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:35.123083+0000 mon.a (mon.0) 2061 : cluster [WRN] Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-02-19T21:57:36.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:35.132921+0000 mon.a (mon.0) 2062 : audit [INF] from='client.? 172.21.15.80:0/2883433588' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:57:36.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:35.132969+0000 mon.a (mon.0) 2063 : cluster [DBG] osdmap e560: 8 total, 7 up, 8 in 2024-02-19T21:57:36.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:35.475029+0000 mon.a (mon.0) 2064 : cluster [WRN] Health check update: Degraded data redundancy: 71/576 objects degraded (12.326%), 18 pgs degraded (PG_DEGRADED) 2024-02-19T21:57:36.578 INFO:teuthology.orchestra.run.smithi157.stderr:Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T21:57:36.584 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-02-19T21:57:36.584 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi157 with status 125: 'sudo docker kill -s 1 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6' 2024-02-19T21:57:36.951 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-19T21:57:36.951 INFO:teuthology.orchestra.run.smithi157.stdout: "ops": [], 2024-02-19T21:57:36.951 INFO:teuthology.orchestra.run.smithi157.stdout: "num_ops": 0 2024-02-19T21:57:36.951 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-19T21:57:37.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:35.333563+0000 mgr.y (mgr.14514) 954 : cluster [DBG] pgmap v1234: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 682 B/s rd, 0 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:37.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:35.603798+0000 osd.7 (osd.7) 319 : cluster [DBG] 5.10 scrub starts 2024-02-19T21:57:37.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:35.606689+0000 osd.7 (osd.7) 320 : cluster [DBG] 5.10 scrub ok 2024-02-19T21:57:37.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:36.063830+0000 osd.6 (osd.6) 301 : cluster [DBG] 2.1a scrub starts 2024-02-19T21:57:37.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:36.066774+0000 osd.6 (osd.6) 302 : cluster [DBG] 2.1a scrub ok 2024-02-19T21:57:37.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:36.198953+0000 osd.3 (osd.3) 277 : cluster [DBG] 4.14 scrub starts 2024-02-19T21:57:37.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:36.201147+0000 osd.3 (osd.3) 278 : cluster [DBG] 4.14 scrub ok 2024-02-19T21:57:37.345 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:35.333563+0000 mgr.y (mgr.14514) 954 : cluster [DBG] pgmap v1234: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 682 B/s rd, 0 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:37.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:35.603798+0000 osd.7 (osd.7) 319 : cluster [DBG] 5.10 scrub starts 2024-02-19T21:57:37.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:35.606689+0000 osd.7 (osd.7) 320 : cluster [DBG] 5.10 scrub ok 2024-02-19T21:57:37.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:36.063830+0000 osd.6 (osd.6) 301 : cluster [DBG] 2.1a scrub starts 2024-02-19T21:57:37.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:36.066774+0000 osd.6 (osd.6) 302 : cluster [DBG] 2.1a scrub ok 2024-02-19T21:57:37.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:36.198953+0000 osd.3 (osd.3) 277 : cluster [DBG] 4.14 scrub starts 2024-02-19T21:57:37.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:36.201147+0000 osd.3 (osd.3) 278 : cluster [DBG] 4.14 scrub ok 2024-02-19T21:57:37.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:35.333563+0000 mgr.y (mgr.14514) 954 : cluster [DBG] pgmap v1234: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 682 B/s rd, 0 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:37.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:35.603798+0000 osd.7 (osd.7) 319 : cluster [DBG] 5.10 scrub starts 2024-02-19T21:57:37.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:35.606689+0000 osd.7 (osd.7) 320 : cluster [DBG] 5.10 scrub ok 2024-02-19T21:57:37.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:36.063830+0000 osd.6 (osd.6) 301 : cluster [DBG] 2.1a scrub starts 2024-02-19T21:57:37.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:36.066774+0000 osd.6 (osd.6) 302 : cluster [DBG] 2.1a scrub ok 2024-02-19T21:57:37.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:36.198953+0000 osd.3 (osd.3) 277 : cluster [DBG] 4.14 scrub starts 2024-02-19T21:57:37.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:36.201147+0000 osd.3 (osd.3) 278 : cluster [DBG] 4.14 scrub ok 2024-02-19T21:57:37.638 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.4 dump_blocked_ops 2024-02-19T21:57:37.908 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:57:37.978 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -n osd.0 --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-0 --journal-path /var/lib/ceph/osd/ceph-0/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.5.b.0 2024-02-19T21:57:38.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:36.621400+0000 osd.7 (osd.7) 321 : cluster [DBG] 2.b scrub starts 2024-02-19T21:57:38.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:36.624337+0000 osd.7 (osd.7) 322 : cluster [DBG] 2.b scrub ok 2024-02-19T21:57:38.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:36.833290+0000 osd.2 (osd.2) 75 : cluster [DBG] 5.6 scrub starts 2024-02-19T21:57:38.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:36.834521+0000 osd.2 (osd.2) 76 : cluster [DBG] 5.6 scrub ok 2024-02-19T21:57:38.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:37.587834+0000 osd.1 (osd.1) 294 : cluster [DBG] 4.4 scrub starts 2024-02-19T21:57:38.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:37.589926+0000 osd.1 (osd.1) 295 : cluster [DBG] 4.4 scrub ok 2024-02-19T21:57:38.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:36.621400+0000 osd.7 (osd.7) 321 : cluster [DBG] 2.b scrub starts 2024-02-19T21:57:38.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:36.624337+0000 osd.7 (osd.7) 322 : cluster [DBG] 2.b scrub ok 2024-02-19T21:57:38.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:36.833290+0000 osd.2 (osd.2) 75 : cluster [DBG] 5.6 scrub starts 2024-02-19T21:57:38.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:36.834521+0000 osd.2 (osd.2) 76 : cluster [DBG] 5.6 scrub ok 2024-02-19T21:57:38.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:37.587834+0000 osd.1 (osd.1) 294 : cluster [DBG] 4.4 scrub starts 2024-02-19T21:57:38.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:37.589926+0000 osd.1 (osd.1) 295 : cluster [DBG] 4.4 scrub ok 2024-02-19T21:57:38.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:36.621400+0000 osd.7 (osd.7) 321 : cluster [DBG] 2.b scrub starts 2024-02-19T21:57:38.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:36.624337+0000 osd.7 (osd.7) 322 : cluster [DBG] 2.b scrub ok 2024-02-19T21:57:38.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:36.833290+0000 osd.2 (osd.2) 75 : cluster [DBG] 5.6 scrub starts 2024-02-19T21:57:38.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:36.834521+0000 osd.2 (osd.2) 76 : cluster [DBG] 5.6 scrub ok 2024-02-19T21:57:38.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:37.587834+0000 osd.1 (osd.1) 294 : cluster [DBG] 4.4 scrub starts 2024-02-19T21:57:38.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:37.589926+0000 osd.1 (osd.1) 295 : cluster [DBG] 4.4 scrub ok 2024-02-19T21:57:38.727 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/osd.0/config 2024-02-19T21:57:39.226 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:37.334165+0000 mgr.y (mgr.14514) 955 : cluster [DBG] pgmap v1235: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 597 B/s rd, 0 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:39.227 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:37.334165+0000 mgr.y (mgr.14514) 955 : cluster [DBG] pgmap v1235: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 597 B/s rd, 0 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:39.348 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:37.334165+0000 mgr.y (mgr.14514) 955 : cluster [DBG] pgmap v1235: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 597 B/s rd, 0 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:39.504 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset noscrub 2024-02-19T21:57:39.640 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:57:39.640 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:57:40.089 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-02-19T21:57:40.090 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-02-19T21:57:40.090 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-02-19T21:57:40.090 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-02-19T21:57:40.090 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-02-19T21:57:40.090 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-02-19T21:57:40.090 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-02-19T21:57:40.090 INFO:teuthology.orchestra.run.smithi080.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-02-19T21:57:40.090 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = 'false' 2024-02-19T21:57:40.090 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = 'false' 2024-02-19T21:57:40.090 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = 'false' 2024-02-19T21:57:40.091 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = 'false' 2024-02-19T21:57:40.091 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = 'false' 2024-02-19T21:57:40.091 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = 'false' 2024-02-19T21:57:40.091 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = 'false' 2024-02-19T21:57:40.209 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.4 dump_historic_ops 2024-02-19T21:57:40.235 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:39.455331+0000 mon.c (mon.2) 136 : audit [DBG] from='client.? 172.21.15.80:0/1629062338' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:57:40.236 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:39.562605+0000 osd.1 (osd.1) 296 : cluster [DBG] 4.12 scrub starts 2024-02-19T21:57:40.236 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:39.564348+0000 osd.1 (osd.1) 297 : cluster [DBG] 4.12 scrub ok 2024-02-19T21:57:40.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:39.455331+0000 mon.c (mon.2) 136 : audit [DBG] from='client.? 172.21.15.80:0/1629062338' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:57:40.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:39.562605+0000 osd.1 (osd.1) 296 : cluster [DBG] 4.12 scrub starts 2024-02-19T21:57:40.346 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:39.564348+0000 osd.1 (osd.1) 297 : cluster [DBG] 4.12 scrub ok 2024-02-19T21:57:40.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:39.455331+0000 mon.c (mon.2) 136 : audit [DBG] from='client.? 172.21.15.80:0/1629062338' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-02-19T21:57:40.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:39.562605+0000 osd.1 (osd.1) 296 : cluster [DBG] 4.12 scrub starts 2024-02-19T21:57:40.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:39.564348+0000 osd.1 (osd.1) 297 : cluster [DBG] 4.12 scrub ok 2024-02-19T21:57:40.507 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:57:40.750 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-02-19T21:57:40.750 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-02-19T21:57:41.095 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:57:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:57:40] "GET /metrics HTTP/1.1" 200 176836 "" "Prometheus/2.33.4" 2024-02-19T21:57:41.162 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:57:41.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:39.334594+0000 mgr.y (mgr.14514) 956 : cluster [DBG] pgmap v1236: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:41.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:39.494818+0000 osd.4 (osd.4) 267 : cluster [DBG] 6.e scrub starts 2024-02-19T21:57:41.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:39.534403+0000 osd.4 (osd.4) 268 : cluster [DBG] 6.e scrub ok 2024-02-19T21:57:41.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:39.621682+0000 osd.7 (osd.7) 323 : cluster [DBG] 6.15 scrub starts 2024-02-19T21:57:41.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:39.665482+0000 osd.7 (osd.7) 324 : cluster [DBG] 6.15 scrub ok 2024-02-19T21:57:41.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:39.836167+0000 osd.2 (osd.2) 77 : cluster [DBG] 5.d scrub starts 2024-02-19T21:57:41.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:39.837538+0000 osd.2 (osd.2) 78 : cluster [DBG] 5.d scrub ok 2024-02-19T21:57:41.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:39.855589+0000 osd.1 (osd.1) 298 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:57:41.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:39.855686+0000 osd.1 (osd.1) 299 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:57:41.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:40.153938+0000 mon.a (mon.0) 2065 : cluster [DBG] osdmap e561: 8 total, 7 up, 8 in 2024-02-19T21:57:41.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:40.432306+0000 osd.5 (osd.5) 329 : cluster [DBG] 2.2 scrub starts 2024-02-19T21:57:41.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:40.435967+0000 osd.5 (osd.5) 330 : cluster [DBG] 2.2 scrub ok 2024-02-19T21:57:41.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:40.484102+0000 mon.a (mon.0) 2066 : cluster [DBG] osdmap e562: 8 total, 7 up, 8 in 2024-02-19T21:57:41.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:40.590023+0000 osd.1 (osd.1) 300 : cluster [DBG] 5.12 scrub starts 2024-02-19T21:57:41.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:40.591030+0000 osd.1 (osd.1) 301 : cluster [DBG] 5.12 scrub ok 2024-02-19T21:57:41.417 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:39.334594+0000 mgr.y (mgr.14514) 956 : cluster [DBG] pgmap v1236: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:41.417 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:39.494818+0000 osd.4 (osd.4) 267 : cluster [DBG] 6.e scrub starts 2024-02-19T21:57:41.417 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:39.534403+0000 osd.4 (osd.4) 268 : cluster [DBG] 6.e scrub ok 2024-02-19T21:57:41.417 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:39.621682+0000 osd.7 (osd.7) 323 : cluster [DBG] 6.15 scrub starts 2024-02-19T21:57:41.417 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:39.665482+0000 osd.7 (osd.7) 324 : cluster [DBG] 6.15 scrub ok 2024-02-19T21:57:41.418 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:39.836167+0000 osd.2 (osd.2) 77 : cluster [DBG] 5.d scrub starts 2024-02-19T21:57:41.418 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:39.837538+0000 osd.2 (osd.2) 78 : cluster [DBG] 5.d scrub ok 2024-02-19T21:57:41.418 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:39.855589+0000 osd.1 (osd.1) 298 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:57:41.418 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:39.855686+0000 osd.1 (osd.1) 299 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:57:41.418 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:40.153938+0000 mon.a (mon.0) 2065 : cluster [DBG] osdmap e561: 8 total, 7 up, 8 in 2024-02-19T21:57:41.418 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:40.432306+0000 osd.5 (osd.5) 329 : cluster [DBG] 2.2 scrub starts 2024-02-19T21:57:41.418 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:40.435967+0000 osd.5 (osd.5) 330 : cluster [DBG] 2.2 scrub ok 2024-02-19T21:57:41.418 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:40.484102+0000 mon.a (mon.0) 2066 : cluster [DBG] osdmap e562: 8 total, 7 up, 8 in 2024-02-19T21:57:41.418 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:40.590023+0000 osd.1 (osd.1) 300 : cluster [DBG] 5.12 scrub starts 2024-02-19T21:57:41.418 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:40.591030+0000 osd.1 (osd.1) 301 : cluster [DBG] 5.12 scrub ok 2024-02-19T21:57:41.418 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:39.334594+0000 mgr.y (mgr.14514) 956 : cluster [DBG] pgmap v1236: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:41.419 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:39.494818+0000 osd.4 (osd.4) 267 : cluster [DBG] 6.e scrub starts 2024-02-19T21:57:41.419 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:39.534403+0000 osd.4 (osd.4) 268 : cluster [DBG] 6.e scrub ok 2024-02-19T21:57:41.419 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:39.621682+0000 osd.7 (osd.7) 323 : cluster [DBG] 6.15 scrub starts 2024-02-19T21:57:41.419 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:39.665482+0000 osd.7 (osd.7) 324 : cluster [DBG] 6.15 scrub ok 2024-02-19T21:57:41.419 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:39.836167+0000 osd.2 (osd.2) 77 : cluster [DBG] 5.d scrub starts 2024-02-19T21:57:41.419 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:39.837538+0000 osd.2 (osd.2) 78 : cluster [DBG] 5.d scrub ok 2024-02-19T21:57:41.419 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:39.855589+0000 osd.1 (osd.1) 298 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:57:41.419 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:39.855686+0000 osd.1 (osd.1) 299 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:57:41.419 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:40.153938+0000 mon.a (mon.0) 2065 : cluster [DBG] osdmap e561: 8 total, 7 up, 8 in 2024-02-19T21:57:41.419 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:40.432306+0000 osd.5 (osd.5) 329 : cluster [DBG] 2.2 scrub starts 2024-02-19T21:57:41.419 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:40.435967+0000 osd.5 (osd.5) 330 : cluster [DBG] 2.2 scrub ok 2024-02-19T21:57:41.419 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:40.484102+0000 mon.a (mon.0) 2066 : cluster [DBG] osdmap e562: 8 total, 7 up, 8 in 2024-02-19T21:57:41.419 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:40.590023+0000 osd.1 (osd.1) 300 : cluster [DBG] 5.12 scrub starts 2024-02-19T21:57:41.419 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:40.591030+0000 osd.1 (osd.1) 301 : cluster [DBG] 5.12 scrub ok 2024-02-19T21:57:41.798 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:57:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:57:42.162 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:40.470841+0000 osd.4 (osd.4) 269 : cluster [DBG] 6.2 scrub starts 2024-02-19T21:57:42.162 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:40.473826+0000 osd.4 (osd.4) 270 : cluster [DBG] 6.2 scrub ok 2024-02-19T21:57:42.162 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:40.599742+0000 osd.7 (osd.7) 325 : cluster [DBG] 5.9 scrub starts 2024-02-19T21:57:42.162 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:40.604956+0000 osd.7 (osd.7) 326 : cluster [DBG] 5.9 scrub ok 2024-02-19T21:57:42.358 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:57:42.358 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:57:42.378 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:40.470841+0000 osd.4 (osd.4) 269 : cluster [DBG] 6.2 scrub starts 2024-02-19T21:57:42.378 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:40.473826+0000 osd.4 (osd.4) 270 : cluster [DBG] 6.2 scrub ok 2024-02-19T21:57:42.378 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:40.599742+0000 osd.7 (osd.7) 325 : cluster [DBG] 5.9 scrub starts 2024-02-19T21:57:42.379 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:40.604956+0000 osd.7 (osd.7) 326 : cluster [DBG] 5.9 scrub ok 2024-02-19T21:57:42.439 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:40.470841+0000 osd.4 (osd.4) 269 : cluster [DBG] 6.2 scrub starts 2024-02-19T21:57:42.439 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:40.473826+0000 osd.4 (osd.4) 270 : cluster [DBG] 6.2 scrub ok 2024-02-19T21:57:42.439 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:40.599742+0000 osd.7 (osd.7) 325 : cluster [DBG] 5.9 scrub starts 2024-02-19T21:57:42.439 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:40.604956+0000 osd.7 (osd.7) 326 : cluster [DBG] 5.9 scrub ok 2024-02-19T21:57:42.742 INFO:teuthology.orchestra.run.smithi080.stdout:get_pg_num_history pg_num_history pg_num_history(e549 pg_nums {1={19=1},2={58=32},3={58=3},4={60=32},5={62=32,260=31,264=30,270=29,274=28,278=27,282=26,286=25,290=24,294=23,298=22},6={64=32,207=31,211=30,215=29,220=28,223=27,227=26,231=25,235=24,239=23,243=22,302=32},8={165=16},9={268=16},10={385=16},11={492=16}} deleted_pools 258,8,381,9,487,10) 2024-02-19T21:57:42.743 INFO:teuthology.orchestra.run.smithi080.stdout:Importing pgid 5.b 2024-02-19T21:57:42.743 INFO:teuthology.orchestra.run.smithi080.stdout:write_pg epoch 518 info 5.b( empty local-lis/les=394/395 n=0 ec=62/62 lis/c=394/394 les/c/f=395/395/0 sis=394) 2024-02-19T21:57:42.743 INFO:teuthology.orchestra.run.smithi080.stdout:Import successful 2024-02-19T21:57:43.056 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.5 dump_ops_in_flight 2024-02-19T21:57:43.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:41.335207+0000 mgr.y (mgr.14514) 957 : cluster [DBG] pgmap v1239: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:43.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:41.451938+0000 mgr.y (mgr.14514) 958 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:57:43.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:41.507228+0000 osd.4 (osd.4) 271 : cluster [DBG] 4.c scrub starts 2024-02-19T21:57:43.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:41.510702+0000 osd.4 (osd.4) 272 : cluster [DBG] 4.c scrub ok 2024-02-19T21:57:43.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:42.181220+0000 osd.3 (osd.3) 279 : cluster [DBG] 6.b scrub starts 2024-02-19T21:57:43.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:42.506276+0000 osd.1 (osd.1) 302 : cluster [DBG] 2.d scrub starts 2024-02-19T21:57:43.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:42.507127+0000 osd.1 (osd.1) 303 : cluster [DBG] 2.d scrub ok 2024-02-19T21:57:43.366 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:57:43.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:41.335207+0000 mgr.y (mgr.14514) 957 : cluster [DBG] pgmap v1239: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:43.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:41.451938+0000 mgr.y (mgr.14514) 958 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:57:43.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:41.507228+0000 osd.4 (osd.4) 271 : cluster [DBG] 4.c scrub starts 2024-02-19T21:57:43.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:41.510702+0000 osd.4 (osd.4) 272 : cluster [DBG] 4.c scrub ok 2024-02-19T21:57:43.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:42.181220+0000 osd.3 (osd.3) 279 : cluster [DBG] 6.b scrub starts 2024-02-19T21:57:43.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:42.506276+0000 osd.1 (osd.1) 302 : cluster [DBG] 2.d scrub starts 2024-02-19T21:57:43.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:42.507127+0000 osd.1 (osd.1) 303 : cluster [DBG] 2.d scrub ok 2024-02-19T21:57:43.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:41.335207+0000 mgr.y (mgr.14514) 957 : cluster [DBG] pgmap v1239: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:43.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:41.451938+0000 mgr.y (mgr.14514) 958 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:57:43.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:41.507228+0000 osd.4 (osd.4) 271 : cluster [DBG] 4.c scrub starts 2024-02-19T21:57:43.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:41.510702+0000 osd.4 (osd.4) 272 : cluster [DBG] 4.c scrub ok 2024-02-19T21:57:43.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:42.181220+0000 osd.3 (osd.3) 279 : cluster [DBG] 6.b scrub starts 2024-02-19T21:57:43.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:42.506276+0000 osd.1 (osd.1) 302 : cluster [DBG] 2.d scrub starts 2024-02-19T21:57:43.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:42.507127+0000 osd.1 (osd.1) 303 : cluster [DBG] 2.d scrub ok 2024-02-19T21:57:44.166 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f /var/log/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/exp.5.b.0 2024-02-19T21:57:44.174 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-02-19T21:57:44.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:42.282812+0000 osd.3 (osd.3) 280 : cluster [DBG] 6.b scrub ok 2024-02-19T21:57:44.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:43.165391+0000 osd.6 (osd.6) 303 : cluster [DBG] 4.a scrub starts 2024-02-19T21:57:44.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:43.168832+0000 osd.6 (osd.6) 304 : cluster [DBG] 4.a scrub ok 2024-02-19T21:57:44.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:43.513046+0000 osd.1 (osd.1) 304 : cluster [DBG] 2.9 scrub starts 2024-02-19T21:57:44.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:43.516136+0000 osd.1 (osd.1) 305 : cluster [DBG] 2.9 scrub ok 2024-02-19T21:57:44.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:43.594798+0000 mon.a (mon.0) 2067 : audit [INF] from='client.? 172.21.15.80:0/1699950692' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:57:44.585 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:42.282812+0000 osd.3 (osd.3) 280 : cluster [DBG] 6.b scrub ok 2024-02-19T21:57:44.586 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:43.165391+0000 osd.6 (osd.6) 303 : cluster [DBG] 4.a scrub starts 2024-02-19T21:57:44.586 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:43.168832+0000 osd.6 (osd.6) 304 : cluster [DBG] 4.a scrub ok 2024-02-19T21:57:44.586 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:43.513046+0000 osd.1 (osd.1) 304 : cluster [DBG] 2.9 scrub starts 2024-02-19T21:57:44.586 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:43.516136+0000 osd.1 (osd.1) 305 : cluster [DBG] 2.9 scrub ok 2024-02-19T21:57:44.586 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:43.594798+0000 mon.a (mon.0) 2067 : audit [INF] from='client.? 172.21.15.80:0/1699950692' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:57:44.586 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:42.282812+0000 osd.3 (osd.3) 280 : cluster [DBG] 6.b scrub ok 2024-02-19T21:57:44.586 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:43.165391+0000 osd.6 (osd.6) 303 : cluster [DBG] 4.a scrub starts 2024-02-19T21:57:44.586 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:43.168832+0000 osd.6 (osd.6) 304 : cluster [DBG] 4.a scrub ok 2024-02-19T21:57:44.586 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:43.513046+0000 osd.1 (osd.1) 304 : cluster [DBG] 2.9 scrub starts 2024-02-19T21:57:44.586 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:43.516136+0000 osd.1 (osd.1) 305 : cluster [DBG] 2.9 scrub ok 2024-02-19T21:57:44.586 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:43.594798+0000 mon.a (mon.0) 2067 : audit [INF] from='client.? 172.21.15.80:0/1699950692' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-02-19T21:57:44.854 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd unset nodeep-scrub 2024-02-19T21:57:45.121 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:57:45.261 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:57:45.261 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:57:45.286 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:43.335670+0000 mgr.y (mgr.14514) 959 : cluster [DBG] pgmap v1240: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:45.286 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:43.671225+0000 osd.7 (osd.7) 327 : cluster [DBG] 4.17 scrub starts 2024-02-19T21:57:45.286 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:43.672483+0000 osd.7 (osd.7) 328 : cluster [DBG] 4.17 scrub ok 2024-02-19T21:57:45.286 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:44.156178+0000 osd.6 (osd.6) 305 : cluster [DBG] 2.14 scrub starts 2024-02-19T21:57:45.286 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:44.159069+0000 osd.6 (osd.6) 306 : cluster [DBG] 2.14 scrub ok 2024-02-19T21:57:45.286 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:44.171140+0000 mon.a (mon.0) 2068 : audit [INF] from='client.? 172.21.15.80:0/1699950692' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:57:45.286 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:44.171194+0000 mon.a (mon.0) 2069 : cluster [DBG] osdmap e563: 8 total, 7 up, 8 in 2024-02-19T21:57:45.286 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:44.493070+0000 osd.1 (osd.1) 306 : cluster [DBG] 6.4 scrub starts 2024-02-19T21:57:45.286 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:44.493872+0000 osd.1 (osd.1) 307 : cluster [DBG] 6.4 scrub ok 2024-02-19T21:57:45.286 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:44.507024+0000 osd.5 (osd.5) 331 : cluster [DBG] 4.f scrub starts 2024-02-19T21:57:45.287 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:44.510497+0000 osd.5 (osd.5) 332 : cluster [DBG] 4.f scrub ok 2024-02-19T21:57:45.438 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:43.335670+0000 mgr.y (mgr.14514) 959 : cluster [DBG] pgmap v1240: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:45.438 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:43.671225+0000 osd.7 (osd.7) 327 : cluster [DBG] 4.17 scrub starts 2024-02-19T21:57:45.438 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:43.672483+0000 osd.7 (osd.7) 328 : cluster [DBG] 4.17 scrub ok 2024-02-19T21:57:45.438 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:44.156178+0000 osd.6 (osd.6) 305 : cluster [DBG] 2.14 scrub starts 2024-02-19T21:57:45.438 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:44.159069+0000 osd.6 (osd.6) 306 : cluster [DBG] 2.14 scrub ok 2024-02-19T21:57:45.438 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:44.171140+0000 mon.a (mon.0) 2068 : audit [INF] from='client.? 172.21.15.80:0/1699950692' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:57:45.438 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:44.171194+0000 mon.a (mon.0) 2069 : cluster [DBG] osdmap e563: 8 total, 7 up, 8 in 2024-02-19T21:57:45.438 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:44.493070+0000 osd.1 (osd.1) 306 : cluster [DBG] 6.4 scrub starts 2024-02-19T21:57:45.438 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:44.493872+0000 osd.1 (osd.1) 307 : cluster [DBG] 6.4 scrub ok 2024-02-19T21:57:45.438 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:44.507024+0000 osd.5 (osd.5) 331 : cluster [DBG] 4.f scrub starts 2024-02-19T21:57:45.439 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:44.510497+0000 osd.5 (osd.5) 332 : cluster [DBG] 4.f scrub ok 2024-02-19T21:57:45.439 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:43.335670+0000 mgr.y (mgr.14514) 959 : cluster [DBG] pgmap v1240: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:45.439 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:43.671225+0000 osd.7 (osd.7) 327 : cluster [DBG] 4.17 scrub starts 2024-02-19T21:57:45.439 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:43.672483+0000 osd.7 (osd.7) 328 : cluster [DBG] 4.17 scrub ok 2024-02-19T21:57:45.439 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:44.156178+0000 osd.6 (osd.6) 305 : cluster [DBG] 2.14 scrub starts 2024-02-19T21:57:45.439 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:44.159069+0000 osd.6 (osd.6) 306 : cluster [DBG] 2.14 scrub ok 2024-02-19T21:57:45.439 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:44.171140+0000 mon.a (mon.0) 2068 : audit [INF] from='client.? 172.21.15.80:0/1699950692' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-02-19T21:57:45.439 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:44.171194+0000 mon.a (mon.0) 2069 : cluster [DBG] osdmap e563: 8 total, 7 up, 8 in 2024-02-19T21:57:45.439 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:44.493070+0000 osd.1 (osd.1) 306 : cluster [DBG] 6.4 scrub starts 2024-02-19T21:57:45.439 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:44.493872+0000 osd.1 (osd.1) 307 : cluster [DBG] 6.4 scrub ok 2024-02-19T21:57:45.439 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:44.507024+0000 osd.5 (osd.5) 331 : cluster [DBG] 4.f scrub starts 2024-02-19T21:57:45.440 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:44.510497+0000 osd.5 (osd.5) 332 : cluster [DBG] 4.f scrub ok 2024-02-19T21:57:46.036 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:57:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:57:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:57:46.054 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.5 dump_blocked_ops 2024-02-19T21:57:46.325 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:57:46.665 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:45.336208+0000 mgr.y (mgr.14514) 960 : cluster [DBG] pgmap v1242: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:46.665 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:45.464186+0000 osd.4 (osd.4) 273 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:57:46.665 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:45.467863+0000 osd.4 (osd.4) 274 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:57:46.665 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:45.484275+0000 mon.a (mon.0) 2070 : cluster [DBG] osdmap e564: 8 total, 7 up, 8 in 2024-02-19T21:57:46.666 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:45.693621+0000 osd.7 (osd.7) 329 : cluster [DBG] 6.5 scrub starts 2024-02-19T21:57:46.666 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:45.748498+0000 osd.7 (osd.7) 330 : cluster [DBG] 6.5 scrub ok 2024-02-19T21:57:46.666 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:46.201923+0000 osd.3 (osd.3) 281 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:57:46.666 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:46.205573+0000 osd.3 (osd.3) 282 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:57:46.666 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:45.336208+0000 mgr.y (mgr.14514) 960 : cluster [DBG] pgmap v1242: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:46.666 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:45.464186+0000 osd.4 (osd.4) 273 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:57:46.666 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:45.467863+0000 osd.4 (osd.4) 274 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:57:46.666 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:45.484275+0000 mon.a (mon.0) 2070 : cluster [DBG] osdmap e564: 8 total, 7 up, 8 in 2024-02-19T21:57:46.666 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:45.693621+0000 osd.7 (osd.7) 329 : cluster [DBG] 6.5 scrub starts 2024-02-19T21:57:46.667 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:45.748498+0000 osd.7 (osd.7) 330 : cluster [DBG] 6.5 scrub ok 2024-02-19T21:57:46.667 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:46.201923+0000 osd.3 (osd.3) 281 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:57:46.667 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:46.205573+0000 osd.3 (osd.3) 282 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:57:46.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:45.336208+0000 mgr.y (mgr.14514) 960 : cluster [DBG] pgmap v1242: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:46.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:45.464186+0000 osd.4 (osd.4) 273 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:57:46.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:45.467863+0000 osd.4 (osd.4) 274 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:57:46.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:45.484275+0000 mon.a (mon.0) 2070 : cluster [DBG] osdmap e564: 8 total, 7 up, 8 in 2024-02-19T21:57:46.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:45.693621+0000 osd.7 (osd.7) 329 : cluster [DBG] 6.5 scrub starts 2024-02-19T21:57:46.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:45.748498+0000 osd.7 (osd.7) 330 : cluster [DBG] 6.5 scrub ok 2024-02-19T21:57:46.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:46.201923+0000 osd.3 (osd.3) 281 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:57:46.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:46.205573+0000 osd.3 (osd.3) 282 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:57:47.493 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-02-19T21:57:47.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:46.452705+0000 osd.4 (osd.4) 275 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:57:47.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:46.456178+0000 osd.4 (osd.4) 276 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:57:47.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:47.108891+0000 mon.a (mon.0) 2071 : audit [INF] from='client.? 172.21.15.80:0/1751963940' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:57:47.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:46.452705+0000 osd.4 (osd.4) 275 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:57:47.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:46.456178+0000 osd.4 (osd.4) 276 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:57:47.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:47.108891+0000 mon.a (mon.0) 2071 : audit [INF] from='client.? 172.21.15.80:0/1751963940' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:57:47.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:46.452705+0000 osd.4 (osd.4) 275 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:57:47.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:46.456178+0000 osd.4 (osd.4) 276 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:57:47.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:47.108891+0000 mon.a (mon.0) 2071 : audit [INF] from='client.? 172.21.15.80:0/1751963940' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-02-19T21:57:48.169 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:57:48.170 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:57:48.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:46.566486+0000 osd.5 (osd.5) 333 : cluster [DBG] 4.15 scrub starts 2024-02-19T21:57:48.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:46.568123+0000 osd.5 (osd.5) 334 : cluster [DBG] 4.15 scrub ok 2024-02-19T21:57:48.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:47.336687+0000 mgr.y (mgr.14514) 961 : cluster [DBG] pgmap v1244: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 746 B/s rd, 0 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:48.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:47.482505+0000 mon.a (mon.0) 2072 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:57:48.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:47.491616+0000 mon.a (mon.0) 2073 : audit [INF] from='client.? 172.21.15.80:0/1751963940' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:57:48.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:47.491681+0000 mon.a (mon.0) 2074 : cluster [DBG] osdmap e565: 8 total, 7 up, 8 in 2024-02-19T21:57:48.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:47.792221+0000 osd.2 (osd.2) 79 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:57:48.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:47.793130+0000 osd.2 (osd.2) 80 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:57:48.809 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.5 dump_historic_ops 2024-02-19T21:57:48.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:46.566486+0000 osd.5 (osd.5) 333 : cluster [DBG] 4.15 scrub starts 2024-02-19T21:57:48.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:46.568123+0000 osd.5 (osd.5) 334 : cluster [DBG] 4.15 scrub ok 2024-02-19T21:57:48.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:47.336687+0000 mgr.y (mgr.14514) 961 : cluster [DBG] pgmap v1244: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 746 B/s rd, 0 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:48.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:47.482505+0000 mon.a (mon.0) 2072 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:57:48.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:47.491616+0000 mon.a (mon.0) 2073 : audit [INF] from='client.? 172.21.15.80:0/1751963940' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:57:48.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:47.491681+0000 mon.a (mon.0) 2074 : cluster [DBG] osdmap e565: 8 total, 7 up, 8 in 2024-02-19T21:57:48.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:47.792221+0000 osd.2 (osd.2) 79 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:57:48.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:47.793130+0000 osd.2 (osd.2) 80 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:57:48.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:46.566486+0000 osd.5 (osd.5) 333 : cluster [DBG] 4.15 scrub starts 2024-02-19T21:57:48.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:46.568123+0000 osd.5 (osd.5) 334 : cluster [DBG] 4.15 scrub ok 2024-02-19T21:57:48.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:47.336687+0000 mgr.y (mgr.14514) 961 : cluster [DBG] pgmap v1244: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 746 B/s rd, 0 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:48.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:47.482505+0000 mon.a (mon.0) 2072 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-02-19T21:57:48.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:47.491616+0000 mon.a (mon.0) 2073 : audit [INF] from='client.? 172.21.15.80:0/1751963940' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-02-19T21:57:48.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:47.491681+0000 mon.a (mon.0) 2074 : cluster [DBG] osdmap e565: 8 total, 7 up, 8 in 2024-02-19T21:57:48.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:47.792221+0000 osd.2 (osd.2) 79 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:57:48.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:47.793130+0000 osd.2 (osd.2) 80 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:57:49.076 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:57:49.202 INFO:tasks.thrashosds.thrasher:reviving osd 2024-02-19T21:57:49.203 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-02-19T21:57:49.203 INFO:tasks.cephadm.osd.0:Restarting osd.0 (starting--it wasn't running)... 2024-02-19T21:57:49.203 DEBUG:teuthology.orchestra.run.smithi080:osd.0> sudo journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.0.service 2024-02-19T21:57:49.206 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl start ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.0 2024-02-19T21:57:49.244 INFO:journalctl@ceph.osd.0.smithi080.stdout:-- Logs begin at Mon 2024-02-19 21:10:15 UTC. -- 2024-02-19T21:57:49.490 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 21:57:49 smithi080 systemd[1]: Starting Ceph osd.0 for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T21:57:49.491 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:47.570655+0000 osd.5 (osd.5) 335 : cluster [DBG] 4.8 scrub starts 2024-02-19T21:57:49.491 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:47.574265+0000 osd.5 (osd.5) 336 : cluster [DBG] 4.8 scrub ok 2024-02-19T21:57:49.491 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:48.409183+0000 osd.4 (osd.4) 277 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:57:49.491 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:48.464318+0000 osd.4 (osd.4) 278 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:57:49.491 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:48.583796+0000 osd.1 (osd.1) 308 : cluster [DBG] 4.2 scrub starts 2024-02-19T21:57:49.491 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:48.585693+0000 osd.1 (osd.1) 309 : cluster [DBG] 4.2 scrub ok 2024-02-19T21:57:49.491 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:48.693060+0000 osd.7 (osd.7) 331 : cluster [DBG] 6.8 scrub starts 2024-02-19T21:57:49.491 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:48.724975+0000 osd.7 (osd.7) 332 : cluster [DBG] 6.8 scrub ok 2024-02-19T21:57:49.491 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:48.987226+0000 mon.a (mon.0) 2075 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:57:49.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:47.570655+0000 osd.5 (osd.5) 335 : cluster [DBG] 4.8 scrub starts 2024-02-19T21:57:49.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:47.574265+0000 osd.5 (osd.5) 336 : cluster [DBG] 4.8 scrub ok 2024-02-19T21:57:49.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:48.409183+0000 osd.4 (osd.4) 277 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:57:49.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:48.464318+0000 osd.4 (osd.4) 278 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:57:49.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:48.583796+0000 osd.1 (osd.1) 308 : cluster [DBG] 4.2 scrub starts 2024-02-19T21:57:49.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:48.585693+0000 osd.1 (osd.1) 309 : cluster [DBG] 4.2 scrub ok 2024-02-19T21:57:49.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:48.693060+0000 osd.7 (osd.7) 331 : cluster [DBG] 6.8 scrub starts 2024-02-19T21:57:49.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:48.724975+0000 osd.7 (osd.7) 332 : cluster [DBG] 6.8 scrub ok 2024-02-19T21:57:49.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:48.987226+0000 mon.a (mon.0) 2075 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:57:49.845 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:47.570655+0000 osd.5 (osd.5) 335 : cluster [DBG] 4.8 scrub starts 2024-02-19T21:57:49.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:47.574265+0000 osd.5 (osd.5) 336 : cluster [DBG] 4.8 scrub ok 2024-02-19T21:57:49.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:48.409183+0000 osd.4 (osd.4) 277 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:57:49.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:48.464318+0000 osd.4 (osd.4) 278 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:57:49.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:48.583796+0000 osd.1 (osd.1) 308 : cluster [DBG] 4.2 scrub starts 2024-02-19T21:57:49.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:48.585693+0000 osd.1 (osd.1) 309 : cluster [DBG] 4.2 scrub ok 2024-02-19T21:57:49.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:48.693060+0000 osd.7 (osd.7) 331 : cluster [DBG] 6.8 scrub starts 2024-02-19T21:57:49.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:48.724975+0000 osd.7 (osd.7) 332 : cluster [DBG] 6.8 scrub ok 2024-02-19T21:57:49.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:48.987226+0000 mon.a (mon.0) 2075 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:57:50.734 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:57:50.734 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:57:50.759 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:48.593226+0000 osd.5 (osd.5) 337 : cluster [DBG] 2.12 scrub starts 2024-02-19T21:57:50.759 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:48.594064+0000 osd.5 (osd.5) 338 : cluster [DBG] 2.12 scrub ok 2024-02-19T21:57:50.760 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:49.337322+0000 mgr.y (mgr.14514) 962 : cluster [DBG] pgmap v1246: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:50.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:48.593226+0000 osd.5 (osd.5) 337 : cluster [DBG] 2.12 scrub starts 2024-02-19T21:57:50.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:48.594064+0000 osd.5 (osd.5) 338 : cluster [DBG] 2.12 scrub ok 2024-02-19T21:57:50.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:49.337322+0000 mgr.y (mgr.14514) 962 : cluster [DBG] pgmap v1246: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:50.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:48.593226+0000 osd.5 (osd.5) 337 : cluster [DBG] 2.12 scrub starts 2024-02-19T21:57:50.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:48.594064+0000 osd.5 (osd.5) 338 : cluster [DBG] 2.12 scrub ok 2024-02-19T21:57:50.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:49.337322+0000 mgr.y (mgr.14514) 962 : cluster [DBG] pgmap v1246: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:50.773 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 21:57:50 smithi080 bash[204955]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-19T21:57:50.773 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 21:57:50 smithi080 bash[204955]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-19T21:57:50.773 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 21:57:50 smithi080 bash[204955]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2024-02-19T21:57:50.773 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 21:57:50 smithi080 bash[204955]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-19T21:57:50.773 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 21:57:50 smithi080 bash[204955]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2024-02-19T21:57:50.773 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 21:57:50 smithi080 bash[204955]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-19T21:57:50.773 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 21:57:50 smithi080 bash[204955]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-19T21:57:50.773 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 21:57:50 smithi080 bash[204955]: --> ceph-volume lvm activate successful for osd ID: 0 2024-02-19T21:57:51.095 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:57:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:57:50] "GET /metrics HTTP/1.1" 200 174452 "" "Prometheus/2.33.4" 2024-02-19T21:57:51.432 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.6 dump_ops_in_flight 2024-02-19T21:57:51.704 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:57:51.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:50.489901+0000 mon.a (mon.0) 2076 : cluster [DBG] osdmap e566: 8 total, 7 up, 8 in 2024-02-19T21:57:51.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:50.658466+0000 osd.1 (osd.1) 310 : cluster [DBG] 6.1d scrub starts 2024-02-19T21:57:51.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:50.759040+0000 osd.1 (osd.1) 311 : cluster [DBG] 6.1d scrub ok 2024-02-19T21:57:51.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:51.214743+0000 osd.3 (osd.3) 283 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:57:51.774 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:50.489901+0000 mon.a (mon.0) 2076 : cluster [DBG] osdmap e566: 8 total, 7 up, 8 in 2024-02-19T21:57:51.774 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:50.658466+0000 osd.1 (osd.1) 310 : cluster [DBG] 6.1d scrub starts 2024-02-19T21:57:51.774 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:50.759040+0000 osd.1 (osd.1) 311 : cluster [DBG] 6.1d scrub ok 2024-02-19T21:57:51.774 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:51.214743+0000 osd.3 (osd.3) 283 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:57:51.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:57:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:57:51.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:50.489901+0000 mon.a (mon.0) 2076 : cluster [DBG] osdmap e566: 8 total, 7 up, 8 in 2024-02-19T21:57:51.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:50.658466+0000 osd.1 (osd.1) 310 : cluster [DBG] 6.1d scrub starts 2024-02-19T21:57:51.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:50.759040+0000 osd.1 (osd.1) 311 : cluster [DBG] 6.1d scrub ok 2024-02-19T21:57:51.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:51.214743+0000 osd.3 (osd.3) 283 : cluster [DBG] 6.1f scrub starts 2024-02-19T21:57:52.008 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_ops_in_flight 2024-02-19T21:57:52.282 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:57:52.345 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 21:57:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-0[205215]: debug 2024-02-19T21:57:51.917+0000 7f3700242700 1 -- 172.21.15.80:0/610244751 <== mon.2 v2:172.21.15.80:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5572228ac680 con 0x557222873000 2024-02-19T21:57:52.346 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 21:57:52 smithi080 bash[205200]: 510ec74830fdee69c3e263289543c5d4693455a724b46295bff0ca389c5aa995 2024-02-19T21:57:52.346 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 21:57:52 smithi080 systemd[1]: Started Ceph osd.0 for 6f763558-cf6d-11ee-95bb-87774f69a715. 2024-02-19T21:57:52.771 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:51.067945+0000 osd.6 (osd.6) 307 : cluster [DBG] 5.11 deep-scrub starts 2024-02-19T21:57:52.771 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:51.071013+0000 osd.6 (osd.6) 308 : cluster [DBG] 5.11 deep-scrub ok 2024-02-19T21:57:52.771 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:51.321197+0000 osd.3 (osd.3) 284 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:57:52.771 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:51.337925+0000 mgr.y (mgr.14514) 963 : cluster [DBG] pgmap v1248: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:52.771 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:51.461775+0000 mgr.y (mgr.14514) 964 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:57:52.771 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:51.563312+0000 osd.5 (osd.5) 339 : cluster [DBG] 3.2 deep-scrub starts 2024-02-19T21:57:52.771 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:51.067945+0000 osd.6 (osd.6) 307 : cluster [DBG] 5.11 deep-scrub starts 2024-02-19T21:57:52.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:51.071013+0000 osd.6 (osd.6) 308 : cluster [DBG] 5.11 deep-scrub ok 2024-02-19T21:57:52.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:51.321197+0000 osd.3 (osd.3) 284 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:57:52.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:51.337925+0000 mgr.y (mgr.14514) 963 : cluster [DBG] pgmap v1248: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:52.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:51.461775+0000 mgr.y (mgr.14514) 964 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:57:52.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:51.563312+0000 osd.5 (osd.5) 339 : cluster [DBG] 3.2 deep-scrub starts 2024-02-19T21:57:52.772 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 21:57:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-0[205215]: debug 2024-02-19T21:57:52.438+0000 7f3707cd0380 -1 Falling back to public interface 2024-02-19T21:57:52.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:51.067945+0000 osd.6 (osd.6) 307 : cluster [DBG] 5.11 deep-scrub starts 2024-02-19T21:57:52.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:51.071013+0000 osd.6 (osd.6) 308 : cluster [DBG] 5.11 deep-scrub ok 2024-02-19T21:57:52.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:51.321197+0000 osd.3 (osd.3) 284 : cluster [DBG] 6.1f scrub ok 2024-02-19T21:57:52.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:51.337925+0000 mgr.y (mgr.14514) 963 : cluster [DBG] pgmap v1248: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:52.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:51.461775+0000 mgr.y (mgr.14514) 964 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:57:52.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:51.563312+0000 osd.5 (osd.5) 339 : cluster [DBG] 3.2 deep-scrub starts 2024-02-19T21:57:53.343 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:57:53.343 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:57:53.711 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:51.564117+0000 osd.5 (osd.5) 340 : cluster [DBG] 3.2 deep-scrub ok 2024-02-19T21:57:53.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:51.564117+0000 osd.5 (osd.5) 340 : cluster [DBG] 3.2 deep-scrub ok 2024-02-19T21:57:53.832 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:51.564117+0000 osd.5 (osd.5) 340 : cluster [DBG] 3.2 deep-scrub ok 2024-02-19T21:57:54.061 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.6 dump_blocked_ops 2024-02-19T21:57:54.076 INFO:teuthology.orchestra.run.smithi080.stderr:no valid command found; 10 closest matches: 2024-02-19T21:57:54.076 INFO:teuthology.orchestra.run.smithi080.stderr:0 2024-02-19T21:57:54.076 INFO:teuthology.orchestra.run.smithi080.stderr:1 2024-02-19T21:57:54.077 INFO:teuthology.orchestra.run.smithi080.stderr:2 2024-02-19T21:57:54.077 INFO:teuthology.orchestra.run.smithi080.stderr:abort 2024-02-19T21:57:54.077 INFO:teuthology.orchestra.run.smithi080.stderr:assert 2024-02-19T21:57:54.077 INFO:teuthology.orchestra.run.smithi080.stderr:config diff 2024-02-19T21:57:54.077 INFO:teuthology.orchestra.run.smithi080.stderr:config diff get 2024-02-19T21:57:54.077 INFO:teuthology.orchestra.run.smithi080.stderr:config get 2024-02-19T21:57:54.077 INFO:teuthology.orchestra.run.smithi080.stderr:config help [] 2024-02-19T21:57:54.077 INFO:teuthology.orchestra.run.smithi080.stderr:config set ... 2024-02-19T21:57:54.077 INFO:teuthology.orchestra.run.smithi080.stderr:admin_socket: invalid command 2024-02-19T21:57:54.331 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:57:54.731 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:53.338408+0000 mgr.y (mgr.14514) 965 : cluster [DBG] pgmap v1249: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 651 B/s rd, 0 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:54.732 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:53.338408+0000 mgr.y (mgr.14514) 965 : cluster [DBG] pgmap v1249: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 651 B/s rd, 0 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:54.751 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-02-19T21:57:54.751 INFO:tasks.cephadm.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-02-19T21:57:54.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:53.338408+0000 mgr.y (mgr.14514) 965 : cluster [DBG] pgmap v1249: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 651 B/s rd, 0 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:55.732 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:53.568217+0000 osd.5 (osd.5) 341 : cluster [DBG] 2.16 scrub starts 2024-02-19T21:57:55.732 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:53.571123+0000 osd.5 (osd.5) 342 : cluster [DBG] 2.16 scrub ok 2024-02-19T21:57:55.732 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:54.085345+0000 osd.6 (osd.6) 309 : cluster [DBG] 4.5 scrub starts 2024-02-19T21:57:55.732 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:54.088847+0000 osd.6 (osd.6) 310 : cluster [DBG] 4.5 scrub ok 2024-02-19T21:57:55.732 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:57:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:57:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:57:55.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:53.568217+0000 osd.5 (osd.5) 341 : cluster [DBG] 2.16 scrub starts 2024-02-19T21:57:55.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:53.571123+0000 osd.5 (osd.5) 342 : cluster [DBG] 2.16 scrub ok 2024-02-19T21:57:55.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:54.085345+0000 osd.6 (osd.6) 309 : cluster [DBG] 4.5 scrub starts 2024-02-19T21:57:55.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:54.088847+0000 osd.6 (osd.6) 310 : cluster [DBG] 4.5 scrub ok 2024-02-19T21:57:55.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:53.568217+0000 osd.5 (osd.5) 341 : cluster [DBG] 2.16 scrub starts 2024-02-19T21:57:55.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:53.571123+0000 osd.5 (osd.5) 342 : cluster [DBG] 2.16 scrub ok 2024-02-19T21:57:55.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:54.085345+0000 osd.6 (osd.6) 309 : cluster [DBG] 4.5 scrub starts 2024-02-19T21:57:55.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:54.088847+0000 osd.6 (osd.6) 310 : cluster [DBG] 4.5 scrub ok 2024-02-19T21:57:55.998 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:57:55.999 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:57:56.607 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:55.038867+0000 osd.6 (osd.6) 311 : cluster [DBG] 2.c scrub starts 2024-02-19T21:57:56.608 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:55.042334+0000 osd.6 (osd.6) 312 : cluster [DBG] 2.c scrub ok 2024-02-19T21:57:56.608 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:55.339127+0000 mgr.y (mgr.14514) 966 : cluster [DBG] pgmap v1250: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:56.608 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:55.423525+0000 osd.4 (osd.4) 279 : cluster [DBG] 4.9 scrub starts 2024-02-19T21:57:56.608 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:55.427049+0000 osd.4 (osd.4) 280 : cluster [DBG] 4.9 scrub ok 2024-02-19T21:57:56.608 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:55.503686+0000 mon.a (mon.0) 2077 : cluster [WRN] Health check update: Degraded data redundancy: 71/576 objects degraded (12.326%), 18 pgs degraded, 48 pgs undersized (PG_DEGRADED) 2024-02-19T21:57:56.608 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:56.517083+0000 mon.c (mon.2) 137 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/351222871,v1:172.21.15.80:6803/351222871]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-19T21:57:56.608 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:56.517442+0000 mon.a (mon.0) 2078 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-19T21:57:56.630 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.6 dump_historic_ops 2024-02-19T21:57:56.846 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 21:57:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-0[205215]: debug 2024-02-19T21:57:56.513+0000 7f3707cd0380 -1 osd.0 549 log_to_monitors {default=true} 2024-02-19T21:57:56.846 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 21:57:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-0[205215]: debug 2024-02-19T21:57:56.558+0000 7f36f89b6700 -1 osd.0 549 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T21:57:56.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:55.038867+0000 osd.6 (osd.6) 311 : cluster [DBG] 2.c scrub starts 2024-02-19T21:57:56.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:55.042334+0000 osd.6 (osd.6) 312 : cluster [DBG] 2.c scrub ok 2024-02-19T21:57:56.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:55.339127+0000 mgr.y (mgr.14514) 966 : cluster [DBG] pgmap v1250: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:56.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:55.423525+0000 osd.4 (osd.4) 279 : cluster [DBG] 4.9 scrub starts 2024-02-19T21:57:56.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:55.427049+0000 osd.4 (osd.4) 280 : cluster [DBG] 4.9 scrub ok 2024-02-19T21:57:56.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:55.503686+0000 mon.a (mon.0) 2077 : cluster [WRN] Health check update: Degraded data redundancy: 71/576 objects degraded (12.326%), 18 pgs degraded, 48 pgs undersized (PG_DEGRADED) 2024-02-19T21:57:56.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:56.517083+0000 mon.c (mon.2) 137 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/351222871,v1:172.21.15.80:6803/351222871]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-19T21:57:56.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:56.517442+0000 mon.a (mon.0) 2078 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-19T21:57:56.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:55.038867+0000 osd.6 (osd.6) 311 : cluster [DBG] 2.c scrub starts 2024-02-19T21:57:56.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:55.042334+0000 osd.6 (osd.6) 312 : cluster [DBG] 2.c scrub ok 2024-02-19T21:57:56.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:55.339127+0000 mgr.y (mgr.14514) 966 : cluster [DBG] pgmap v1250: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:56.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:55.423525+0000 osd.4 (osd.4) 279 : cluster [DBG] 4.9 scrub starts 2024-02-19T21:57:56.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:55.427049+0000 osd.4 (osd.4) 280 : cluster [DBG] 4.9 scrub ok 2024-02-19T21:57:56.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:55.503686+0000 mon.a (mon.0) 2077 : cluster [WRN] Health check update: Degraded data redundancy: 71/576 objects degraded (12.326%), 18 pgs degraded, 48 pgs undersized (PG_DEGRADED) 2024-02-19T21:57:56.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:56.517083+0000 mon.c (mon.2) 137 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/351222871,v1:172.21.15.80:6803/351222871]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-19T21:57:56.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:56.517442+0000 mon.a (mon.0) 2078 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-19T21:57:56.904 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:57:57.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:56.066716+0000 osd.6 (osd.6) 313 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:57:57.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:56.069596+0000 osd.6 (osd.6) 314 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:57:57.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:56.472771+0000 osd.4 (osd.4) 281 : cluster [DBG] 4.e scrub starts 2024-02-19T21:57:57.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:56.476282+0000 osd.4 (osd.4) 282 : cluster [DBG] 4.e scrub ok 2024-02-19T21:57:57.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:56.543497+0000 mon.a (mon.0) 2079 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-19T21:57:57.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:56.543562+0000 mon.a (mon.0) 2080 : cluster [DBG] osdmap e567: 8 total, 7 up, 8 in 2024-02-19T21:57:57.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:56.545141+0000 mon.c (mon.2) 138 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/351222871,v1:172.21.15.80:6803/351222871]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-19T21:57:57.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:56.545440+0000 mon.a (mon.0) 2081 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-19T21:57:57.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:56.066716+0000 osd.6 (osd.6) 313 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:57:57.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:56.069596+0000 osd.6 (osd.6) 314 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:57:57.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:56.472771+0000 osd.4 (osd.4) 281 : cluster [DBG] 4.e scrub starts 2024-02-19T21:57:57.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:56.476282+0000 osd.4 (osd.4) 282 : cluster [DBG] 4.e scrub ok 2024-02-19T21:57:57.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:56.543497+0000 mon.a (mon.0) 2079 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-19T21:57:57.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:56.543562+0000 mon.a (mon.0) 2080 : cluster [DBG] osdmap e567: 8 total, 7 up, 8 in 2024-02-19T21:57:57.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:56.545141+0000 mon.c (mon.2) 138 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/351222871,v1:172.21.15.80:6803/351222871]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-19T21:57:57.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:56.545440+0000 mon.a (mon.0) 2081 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-19T21:57:57.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:56.066716+0000 osd.6 (osd.6) 313 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:57:57.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:56.069596+0000 osd.6 (osd.6) 314 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:57:57.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:56.472771+0000 osd.4 (osd.4) 281 : cluster [DBG] 4.e scrub starts 2024-02-19T21:57:57.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:56.476282+0000 osd.4 (osd.4) 282 : cluster [DBG] 4.e scrub ok 2024-02-19T21:57:57.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:56.543497+0000 mon.a (mon.0) 2079 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-19T21:57:57.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:56.543562+0000 mon.a (mon.0) 2080 : cluster [DBG] osdmap e567: 8 total, 7 up, 8 in 2024-02-19T21:57:57.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:56.545141+0000 mon.c (mon.2) 138 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/351222871,v1:172.21.15.80:6803/351222871]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-19T21:57:57.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:56.545440+0000 mon.a (mon.0) 2081 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-19T21:57:58.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:57.339737+0000 mgr.y (mgr.14514) 967 : cluster [DBG] pgmap v1252: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:58.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:57.542451+0000 mon.a (mon.0) 2082 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T21:57:58.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:57.556818+0000 mon.a (mon.0) 2083 : cluster [INF] osd.0 [v2:172.21.15.80:6802/351222871,v1:172.21.15.80:6803/351222871] boot 2024-02-19T21:57:58.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:57.557078+0000 mon.a (mon.0) 2084 : cluster [DBG] osdmap e568: 8 total, 8 up, 8 in 2024-02-19T21:57:58.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:57:57.557759+0000 mon.a (mon.0) 2085 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:57:58.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:57.899839+0000 osd.4 (osd.4) 283 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:57:58.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:57.899892+0000 osd.4 (osd.4) 284 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:57:58.811 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:57:58.811 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:57:58.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:57.339737+0000 mgr.y (mgr.14514) 967 : cluster [DBG] pgmap v1252: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:58.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:57.542451+0000 mon.a (mon.0) 2082 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T21:57:58.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:57.556818+0000 mon.a (mon.0) 2083 : cluster [INF] osd.0 [v2:172.21.15.80:6802/351222871,v1:172.21.15.80:6803/351222871] boot 2024-02-19T21:57:58.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:57.557078+0000 mon.a (mon.0) 2084 : cluster [DBG] osdmap e568: 8 total, 8 up, 8 in 2024-02-19T21:57:58.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:57:57.557759+0000 mon.a (mon.0) 2085 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:57:58.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:57.899839+0000 osd.4 (osd.4) 283 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:57:58.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:57.899892+0000 osd.4 (osd.4) 284 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:57:58.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:57.339737+0000 mgr.y (mgr.14514) 967 : cluster [DBG] pgmap v1252: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:57:58.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:57.542451+0000 mon.a (mon.0) 2082 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T21:57:58.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:57.556818+0000 mon.a (mon.0) 2083 : cluster [INF] osd.0 [v2:172.21.15.80:6802/351222871,v1:172.21.15.80:6803/351222871] boot 2024-02-19T21:57:58.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:57.557078+0000 mon.a (mon.0) 2084 : cluster [DBG] osdmap e568: 8 total, 8 up, 8 in 2024-02-19T21:57:58.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:57:57.557759+0000 mon.a (mon.0) 2085 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:57:58.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:57.899839+0000 osd.4 (osd.4) 283 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:57:58.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:57.899892+0000 osd.4 (osd.4) 284 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:57:59.430 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.7 dump_ops_in_flight 2024-02-19T21:57:59.700 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:57:59.752 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_ops_in_flight 2024-02-19T21:57:59.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:58.484856+0000 osd.4 (osd.4) 285 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:57:59.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:58.522620+0000 osd.4 (osd.4) 286 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:57:59.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:57:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:58.556195+0000 mon.a (mon.0) 2086 : cluster [DBG] osdmap e569: 8 total, 8 up, 8 in 2024-02-19T21:57:59.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:58.484856+0000 osd.4 (osd.4) 285 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:57:59.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:58.522620+0000 osd.4 (osd.4) 286 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:57:59.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:57:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:58.556195+0000 mon.a (mon.0) 2086 : cluster [DBG] osdmap e569: 8 total, 8 up, 8 in 2024-02-19T21:57:59.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:58.484856+0000 osd.4 (osd.4) 285 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:57:59.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:58.522620+0000 osd.4 (osd.4) 286 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:57:59.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:57:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:58.556195+0000 mon.a (mon.0) 2086 : cluster [DBG] osdmap e569: 8 total, 8 up, 8 in 2024-02-19T21:58:00.036 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:58:00.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:58.589664+0000 osd.5 (osd.5) 343 : cluster [DBG] 6.d scrub starts 2024-02-19T21:58:00.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:58.642795+0000 osd.5 (osd.5) 344 : cluster [DBG] 6.d scrub ok 2024-02-19T21:58:00.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:59.042383+0000 osd.6 (osd.6) 315 : cluster [DBG] 5.2 scrub starts 2024-02-19T21:58:00.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:59.045554+0000 osd.6 (osd.6) 316 : cluster [DBG] 5.2 scrub ok 2024-02-19T21:58:00.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:59.340408+0000 mgr.y (mgr.14514) 968 : cluster [DBG] pgmap v1255: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:58:00.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:59.489210+0000 osd.4 (osd.4) 287 : cluster [DBG] 2.f scrub starts 2024-02-19T21:58:00.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:59.490502+0000 osd.4 (osd.4) 288 : cluster [DBG] 2.f scrub ok 2024-02-19T21:58:00.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:59.622149+0000 osd.2 (osd.2) 81 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:58:00.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:59.622209+0000 osd.2 (osd.2) 82 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:58:00.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:59.675603+0000 osd.2 (osd.2) 83 : cluster [DBG] 5.b scrub starts 2024-02-19T21:58:00.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:57:59.676496+0000 osd.2 (osd.2) 84 : cluster [DBG] 5.b scrub ok 2024-02-19T21:58:00.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:00.486701+0000 mon.a (mon.0) 2087 : cluster [DBG] osdmap e570: 8 total, 8 up, 8 in 2024-02-19T21:58:00.845 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:58:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:58:00] "GET /metrics HTTP/1.1" 200 174452 "" "Prometheus/2.33.4" 2024-02-19T21:58:00.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:58.589664+0000 osd.5 (osd.5) 343 : cluster [DBG] 6.d scrub starts 2024-02-19T21:58:00.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:58.642795+0000 osd.5 (osd.5) 344 : cluster [DBG] 6.d scrub ok 2024-02-19T21:58:00.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:59.042383+0000 osd.6 (osd.6) 315 : cluster [DBG] 5.2 scrub starts 2024-02-19T21:58:00.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:59.045554+0000 osd.6 (osd.6) 316 : cluster [DBG] 5.2 scrub ok 2024-02-19T21:58:00.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:59.340408+0000 mgr.y (mgr.14514) 968 : cluster [DBG] pgmap v1255: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:58:00.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:59.489210+0000 osd.4 (osd.4) 287 : cluster [DBG] 2.f scrub starts 2024-02-19T21:58:00.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:59.490502+0000 osd.4 (osd.4) 288 : cluster [DBG] 2.f scrub ok 2024-02-19T21:58:00.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:59.622149+0000 osd.2 (osd.2) 81 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:58:00.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:59.622209+0000 osd.2 (osd.2) 82 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:58:00.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:59.675603+0000 osd.2 (osd.2) 83 : cluster [DBG] 5.b scrub starts 2024-02-19T21:58:00.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:57:59.676496+0000 osd.2 (osd.2) 84 : cluster [DBG] 5.b scrub ok 2024-02-19T21:58:00.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:00.486701+0000 mon.a (mon.0) 2087 : cluster [DBG] osdmap e570: 8 total, 8 up, 8 in 2024-02-19T21:58:00.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:58.589664+0000 osd.5 (osd.5) 343 : cluster [DBG] 6.d scrub starts 2024-02-19T21:58:00.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:58.642795+0000 osd.5 (osd.5) 344 : cluster [DBG] 6.d scrub ok 2024-02-19T21:58:00.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:59.042383+0000 osd.6 (osd.6) 315 : cluster [DBG] 5.2 scrub starts 2024-02-19T21:58:00.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:59.045554+0000 osd.6 (osd.6) 316 : cluster [DBG] 5.2 scrub ok 2024-02-19T21:58:00.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:59.340408+0000 mgr.y (mgr.14514) 968 : cluster [DBG] pgmap v1255: 122 pgs: 18 active+undersized+degraded, 30 active+undersized, 74 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 71/576 objects degraded (12.326%) 2024-02-19T21:58:00.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:59.489210+0000 osd.4 (osd.4) 287 : cluster [DBG] 2.f scrub starts 2024-02-19T21:58:00.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:59.490502+0000 osd.4 (osd.4) 288 : cluster [DBG] 2.f scrub ok 2024-02-19T21:58:00.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:59.622149+0000 osd.2 (osd.2) 81 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:58:00.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:59.622209+0000 osd.2 (osd.2) 82 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:58:00.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:59.675603+0000 osd.2 (osd.2) 83 : cluster [DBG] 5.b scrub starts 2024-02-19T21:58:00.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:57:59.676496+0000 osd.2 (osd.2) 84 : cluster [DBG] 5.b scrub ok 2024-02-19T21:58:00.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:00.486701+0000 mon.a (mon.0) 2087 : cluster [DBG] osdmap e570: 8 total, 8 up, 8 in 2024-02-19T21:58:01.360 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:58:01.361 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:58:01.738 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:00.572071+0000 osd.5 (osd.5) 345 : cluster [DBG] 5.15 scrub starts 2024-02-19T21:58:01.738 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:00.573366+0000 osd.5 (osd.5) 346 : cluster [DBG] 5.15 scrub ok 2024-02-19T21:58:01.738 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:00.577215+0000 osd.0 (osd.0) 1 : cluster [DBG] 6.9 scrub starts 2024-02-19T21:58:01.738 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:00.602991+0000 osd.0 (osd.0) 2 : cluster [DBG] 6.9 scrub ok 2024-02-19T21:58:01.738 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:00.605499+0000 osd.1 (osd.1) 312 : cluster [DBG] 2.15 scrub starts 2024-02-19T21:58:01.738 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:00.606291+0000 osd.1 (osd.1) 313 : cluster [DBG] 2.15 scrub ok 2024-02-19T21:58:01.739 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:00.717149+0000 osd.7 (osd.7) 333 : cluster [DBG] 2.1d scrub starts 2024-02-19T21:58:01.739 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:00.720023+0000 osd.7 (osd.7) 334 : cluster [DBG] 2.1d scrub ok 2024-02-19T21:58:01.739 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:00.572071+0000 osd.5 (osd.5) 345 : cluster [DBG] 5.15 scrub starts 2024-02-19T21:58:01.739 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:00.573366+0000 osd.5 (osd.5) 346 : cluster [DBG] 5.15 scrub ok 2024-02-19T21:58:01.739 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:00.577215+0000 osd.0 (osd.0) 1 : cluster [DBG] 6.9 scrub starts 2024-02-19T21:58:01.739 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:00.602991+0000 osd.0 (osd.0) 2 : cluster [DBG] 6.9 scrub ok 2024-02-19T21:58:01.739 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:00.605499+0000 osd.1 (osd.1) 312 : cluster [DBG] 2.15 scrub starts 2024-02-19T21:58:01.739 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:00.606291+0000 osd.1 (osd.1) 313 : cluster [DBG] 2.15 scrub ok 2024-02-19T21:58:01.739 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:00.717149+0000 osd.7 (osd.7) 333 : cluster [DBG] 2.1d scrub starts 2024-02-19T21:58:01.739 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:00.720023+0000 osd.7 (osd.7) 334 : cluster [DBG] 2.1d scrub ok 2024-02-19T21:58:01.785 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:58:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:58:01.786 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:00.572071+0000 osd.5 (osd.5) 345 : cluster [DBG] 5.15 scrub starts 2024-02-19T21:58:01.786 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:00.573366+0000 osd.5 (osd.5) 346 : cluster [DBG] 5.15 scrub ok 2024-02-19T21:58:01.786 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:00.577215+0000 osd.0 (osd.0) 1 : cluster [DBG] 6.9 scrub starts 2024-02-19T21:58:01.786 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:00.602991+0000 osd.0 (osd.0) 2 : cluster [DBG] 6.9 scrub ok 2024-02-19T21:58:01.786 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:00.605499+0000 osd.1 (osd.1) 312 : cluster [DBG] 2.15 scrub starts 2024-02-19T21:58:01.786 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:00.606291+0000 osd.1 (osd.1) 313 : cluster [DBG] 2.15 scrub ok 2024-02-19T21:58:01.786 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:00.717149+0000 osd.7 (osd.7) 333 : cluster [DBG] 2.1d scrub starts 2024-02-19T21:58:01.786 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:00.720023+0000 osd.7 (osd.7) 334 : cluster [DBG] 2.1d scrub ok 2024-02-19T21:58:02.012 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:58:02.012 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-02-19T21:58:02.012 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-02-19T21:58:02.012 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:58:02.119 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.7 dump_blocked_ops 2024-02-19T21:58:02.391 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:58:02.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:01.340984+0000 mgr.y (mgr.14514) 969 : cluster [DBG] pgmap v1257: 122 pgs: 10 active+undersized+degraded, 16 active+undersized, 96 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 48/576 objects degraded (8.333%) 2024-02-19T21:58:02.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:01.471888+0000 mgr.y (mgr.14514) 970 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:58:02.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:01.546155+0000 osd.0 (osd.0) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:58:02.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:01.546269+0000 osd.0 (osd.0) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:58:02.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:01.557811+0000 osd.1 (osd.1) 314 : cluster [DBG] 5.c scrub starts 2024-02-19T21:58:02.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:01.558635+0000 osd.1 (osd.1) 315 : cluster [DBG] 5.c scrub ok 2024-02-19T21:58:02.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:01.561755+0000 osd.0 (osd.0) 5 : cluster [DBG] 6.10 scrub starts 2024-02-19T21:58:02.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:01.564688+0000 osd.0 (osd.0) 6 : cluster [DBG] 6.10 scrub ok 2024-02-19T21:58:02.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:01.571458+0000 mon.a (mon.0) 2088 : cluster [WRN] Health check update: Degraded data redundancy: 48/576 objects degraded (8.333%), 10 pgs degraded, 26 pgs undersized (PG_DEGRADED) 2024-02-19T21:58:02.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:01.578670+0000 mon.a (mon.0) 2089 : cluster [DBG] osdmap e571: 8 total, 8 up, 8 in 2024-02-19T21:58:02.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:01.679557+0000 osd.7 (osd.7) 335 : cluster [DBG] 2.8 deep-scrub starts 2024-02-19T21:58:02.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:01.684149+0000 osd.7 (osd.7) 336 : cluster [DBG] 2.8 deep-scrub ok 2024-02-19T21:58:02.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:01.340984+0000 mgr.y (mgr.14514) 969 : cluster [DBG] pgmap v1257: 122 pgs: 10 active+undersized+degraded, 16 active+undersized, 96 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 48/576 objects degraded (8.333%) 2024-02-19T21:58:02.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:01.471888+0000 mgr.y (mgr.14514) 970 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:58:02.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:01.546155+0000 osd.0 (osd.0) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:58:02.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:01.546269+0000 osd.0 (osd.0) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:58:02.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:01.557811+0000 osd.1 (osd.1) 314 : cluster [DBG] 5.c scrub starts 2024-02-19T21:58:02.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:01.558635+0000 osd.1 (osd.1) 315 : cluster [DBG] 5.c scrub ok 2024-02-19T21:58:02.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:01.561755+0000 osd.0 (osd.0) 5 : cluster [DBG] 6.10 scrub starts 2024-02-19T21:58:02.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:01.564688+0000 osd.0 (osd.0) 6 : cluster [DBG] 6.10 scrub ok 2024-02-19T21:58:02.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:01.571458+0000 mon.a (mon.0) 2088 : cluster [WRN] Health check update: Degraded data redundancy: 48/576 objects degraded (8.333%), 10 pgs degraded, 26 pgs undersized (PG_DEGRADED) 2024-02-19T21:58:02.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:01.578670+0000 mon.a (mon.0) 2089 : cluster [DBG] osdmap e571: 8 total, 8 up, 8 in 2024-02-19T21:58:02.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:01.679557+0000 osd.7 (osd.7) 335 : cluster [DBG] 2.8 deep-scrub starts 2024-02-19T21:58:02.598 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:01.684149+0000 osd.7 (osd.7) 336 : cluster [DBG] 2.8 deep-scrub ok 2024-02-19T21:58:02.764 INFO:tasks.thrashosds.thrasher:fixing pg num pool default.rgw.meta 2024-02-19T21:58:02.764 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd pool set default.rgw.meta pgp_num 32 2024-02-19T21:58:02.864 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:01.340984+0000 mgr.y (mgr.14514) 969 : cluster [DBG] pgmap v1257: 122 pgs: 10 active+undersized+degraded, 16 active+undersized, 96 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 48/576 objects degraded (8.333%) 2024-02-19T21:58:02.864 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:01.471888+0000 mgr.y (mgr.14514) 970 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:58:02.865 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:01.546155+0000 osd.0 (osd.0) 3 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:58:02.865 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:01.546269+0000 osd.0 (osd.0) 4 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:58:02.865 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:01.557811+0000 osd.1 (osd.1) 314 : cluster [DBG] 5.c scrub starts 2024-02-19T21:58:02.865 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:01.558635+0000 osd.1 (osd.1) 315 : cluster [DBG] 5.c scrub ok 2024-02-19T21:58:02.865 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:01.561755+0000 osd.0 (osd.0) 5 : cluster [DBG] 6.10 scrub starts 2024-02-19T21:58:02.865 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:01.564688+0000 osd.0 (osd.0) 6 : cluster [DBG] 6.10 scrub ok 2024-02-19T21:58:02.865 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:01.571458+0000 mon.a (mon.0) 2088 : cluster [WRN] Health check update: Degraded data redundancy: 48/576 objects degraded (8.333%), 10 pgs degraded, 26 pgs undersized (PG_DEGRADED) 2024-02-19T21:58:02.865 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:01.578670+0000 mon.a (mon.0) 2089 : cluster [DBG] osdmap e571: 8 total, 8 up, 8 in 2024-02-19T21:58:02.865 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:01.679557+0000 osd.7 (osd.7) 335 : cluster [DBG] 2.8 deep-scrub starts 2024-02-19T21:58:02.865 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:01.684149+0000 osd.7 (osd.7) 336 : cluster [DBG] 2.8 deep-scrub ok 2024-02-19T21:58:03.031 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:58:03.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:02.023221+0000 osd.6 (osd.6) 317 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:58:03.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:02.027008+0000 osd.6 (osd.6) 318 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:58:03.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:02.461422+0000 osd.4 (osd.4) 289 : cluster [DBG] 5.e scrub starts 2024-02-19T21:58:03.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:02.464903+0000 osd.4 (osd.4) 290 : cluster [DBG] 5.e scrub ok 2024-02-19T21:58:03.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:02.541910+0000 osd.1 (osd.1) 316 : cluster [DBG] 5.0 scrub starts 2024-02-19T21:58:03.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:02.545380+0000 osd.1 (osd.1) 317 : cluster [DBG] 5.0 scrub ok 2024-02-19T21:58:03.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:02.681567+0000 osd.2 (osd.2) 85 : cluster [DBG] 4.1c deep-scrub starts 2024-02-19T21:58:03.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:02.683331+0000 osd.2 (osd.2) 86 : cluster [DBG] 4.1c deep-scrub ok 2024-02-19T21:58:03.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:02.703186+0000 osd.7 (osd.7) 337 : cluster [DBG] 2.0 scrub starts 2024-02-19T21:58:03.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:02.706073+0000 osd.7 (osd.7) 338 : cluster [DBG] 2.0 scrub ok 2024-02-19T21:58:03.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:02.023221+0000 osd.6 (osd.6) 317 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:58:03.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:02.027008+0000 osd.6 (osd.6) 318 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:58:03.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:02.461422+0000 osd.4 (osd.4) 289 : cluster [DBG] 5.e scrub starts 2024-02-19T21:58:03.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:02.464903+0000 osd.4 (osd.4) 290 : cluster [DBG] 5.e scrub ok 2024-02-19T21:58:03.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:02.541910+0000 osd.1 (osd.1) 316 : cluster [DBG] 5.0 scrub starts 2024-02-19T21:58:03.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:02.545380+0000 osd.1 (osd.1) 317 : cluster [DBG] 5.0 scrub ok 2024-02-19T21:58:03.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:02.681567+0000 osd.2 (osd.2) 85 : cluster [DBG] 4.1c deep-scrub starts 2024-02-19T21:58:03.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:02.683331+0000 osd.2 (osd.2) 86 : cluster [DBG] 4.1c deep-scrub ok 2024-02-19T21:58:03.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:02.703186+0000 osd.7 (osd.7) 337 : cluster [DBG] 2.0 scrub starts 2024-02-19T21:58:03.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:02.706073+0000 osd.7 (osd.7) 338 : cluster [DBG] 2.0 scrub ok 2024-02-19T21:58:04.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:02.023221+0000 osd.6 (osd.6) 317 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:58:04.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:02.027008+0000 osd.6 (osd.6) 318 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:58:04.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:02.461422+0000 osd.4 (osd.4) 289 : cluster [DBG] 5.e scrub starts 2024-02-19T21:58:04.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:02.464903+0000 osd.4 (osd.4) 290 : cluster [DBG] 5.e scrub ok 2024-02-19T21:58:04.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:02.541910+0000 osd.1 (osd.1) 316 : cluster [DBG] 5.0 scrub starts 2024-02-19T21:58:04.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:02.545380+0000 osd.1 (osd.1) 317 : cluster [DBG] 5.0 scrub ok 2024-02-19T21:58:04.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:02.681567+0000 osd.2 (osd.2) 85 : cluster [DBG] 4.1c deep-scrub starts 2024-02-19T21:58:04.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:02.683331+0000 osd.2 (osd.2) 86 : cluster [DBG] 4.1c deep-scrub ok 2024-02-19T21:58:04.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:02.703186+0000 osd.7 (osd.7) 337 : cluster [DBG] 2.0 scrub starts 2024-02-19T21:58:04.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:02.706073+0000 osd.7 (osd.7) 338 : cluster [DBG] 2.0 scrub ok 2024-02-19T21:58:04.585 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:03.341488+0000 mgr.y (mgr.14514) 971 : cluster [DBG] pgmap v1259: 122 pgs: 122 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 884 B/s rd, 0 op/s 2024-02-19T21:58:04.585 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:03.576756+0000 mon.a (mon.0) 2090 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 48/576 objects degraded (8.333%), 10 pgs degraded, 26 pgs undersized) 2024-02-19T21:58:04.585 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:03.576808+0000 mon.a (mon.0) 2091 : cluster [INF] Cluster is now healthy 2024-02-19T21:58:04.585 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:03.681051+0000 osd.7 (osd.7) 339 : cluster [DBG] 2.5 scrub starts 2024-02-19T21:58:04.585 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:03.683971+0000 osd.7 (osd.7) 340 : cluster [DBG] 2.5 scrub ok 2024-02-19T21:58:04.585 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:03.986178+0000 mon.a (mon.0) 2092 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:58:04.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:03.341488+0000 mgr.y (mgr.14514) 971 : cluster [DBG] pgmap v1259: 122 pgs: 122 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 884 B/s rd, 0 op/s 2024-02-19T21:58:04.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:03.576756+0000 mon.a (mon.0) 2090 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 48/576 objects degraded (8.333%), 10 pgs degraded, 26 pgs undersized) 2024-02-19T21:58:04.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:03.576808+0000 mon.a (mon.0) 2091 : cluster [INF] Cluster is now healthy 2024-02-19T21:58:04.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:03.681051+0000 osd.7 (osd.7) 339 : cluster [DBG] 2.5 scrub starts 2024-02-19T21:58:04.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:03.683971+0000 osd.7 (osd.7) 340 : cluster [DBG] 2.5 scrub ok 2024-02-19T21:58:04.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:03.986178+0000 mon.a (mon.0) 2092 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:58:05.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:03.341488+0000 mgr.y (mgr.14514) 971 : cluster [DBG] pgmap v1259: 122 pgs: 122 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 884 B/s rd, 0 op/s 2024-02-19T21:58:05.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:03.576756+0000 mon.a (mon.0) 2090 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 48/576 objects degraded (8.333%), 10 pgs degraded, 26 pgs undersized) 2024-02-19T21:58:05.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:03.576808+0000 mon.a (mon.0) 2091 : cluster [INF] Cluster is now healthy 2024-02-19T21:58:05.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:03.681051+0000 osd.7 (osd.7) 339 : cluster [DBG] 2.5 scrub starts 2024-02-19T21:58:05.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:03.683971+0000 osd.7 (osd.7) 340 : cluster [DBG] 2.5 scrub ok 2024-02-19T21:58:05.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:03.986178+0000 mon.a (mon.0) 2092 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:58:05.492 INFO:teuthology.orchestra.run.smithi080.stderr:set pool 6 pgp_num to 32 2024-02-19T21:58:05.617 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:04.045946+0000 osd.6 (osd.6) 319 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:58:05.617 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:04.048884+0000 osd.6 (osd.6) 320 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:58:05.617 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:04.458964+0000 osd.4 (osd.4) 291 : cluster [DBG] 4.d scrub starts 2024-02-19T21:58:05.617 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:04.462422+0000 osd.4 (osd.4) 292 : cluster [DBG] 4.d scrub ok 2024-02-19T21:58:05.617 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:04.587097+0000 osd.5 (osd.5) 347 : cluster [DBG] 5.7 scrub starts 2024-02-19T21:58:05.617 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:04.590921+0000 osd.5 (osd.5) 348 : cluster [DBG] 5.7 scrub ok 2024-02-19T21:58:05.617 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:04.670398+0000 osd.2 (osd.2) 87 : cluster [DBG] 5.8 scrub starts 2024-02-19T21:58:05.617 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:04.671231+0000 osd.2 (osd.2) 88 : cluster [DBG] 5.8 scrub ok 2024-02-19T21:58:05.618 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:04.671605+0000 osd.7 (osd.7) 341 : cluster [DBG] 4.0 scrub starts 2024-02-19T21:58:05.618 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:04.675493+0000 osd.7 (osd.7) 342 : cluster [DBG] 4.0 scrub ok 2024-02-19T21:58:05.618 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:05.047192+0000 mon.c (mon.2) 139 : audit [INF] from='client.? 172.21.15.80:0/4292305050' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "32"}]: dispatch 2024-02-19T21:58:05.618 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:05.047504+0000 mon.a (mon.0) 2093 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "32"}]: dispatch 2024-02-19T21:58:05.618 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:05.488640+0000 mon.a (mon.0) 2094 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "32"}]': finished 2024-02-19T21:58:05.618 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:05.488716+0000 mon.a (mon.0) 2095 : cluster [DBG] osdmap e572: 8 total, 8 up, 8 in 2024-02-19T21:58:05.831 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:04.045946+0000 osd.6 (osd.6) 319 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:58:05.831 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:04.048884+0000 osd.6 (osd.6) 320 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:58:05.831 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:04.458964+0000 osd.4 (osd.4) 291 : cluster [DBG] 4.d scrub starts 2024-02-19T21:58:05.831 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:04.462422+0000 osd.4 (osd.4) 292 : cluster [DBG] 4.d scrub ok 2024-02-19T21:58:05.831 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:04.587097+0000 osd.5 (osd.5) 347 : cluster [DBG] 5.7 scrub starts 2024-02-19T21:58:05.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:04.590921+0000 osd.5 (osd.5) 348 : cluster [DBG] 5.7 scrub ok 2024-02-19T21:58:05.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:04.670398+0000 osd.2 (osd.2) 87 : cluster [DBG] 5.8 scrub starts 2024-02-19T21:58:05.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:04.671231+0000 osd.2 (osd.2) 88 : cluster [DBG] 5.8 scrub ok 2024-02-19T21:58:05.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:04.671605+0000 osd.7 (osd.7) 341 : cluster [DBG] 4.0 scrub starts 2024-02-19T21:58:05.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:04.675493+0000 osd.7 (osd.7) 342 : cluster [DBG] 4.0 scrub ok 2024-02-19T21:58:05.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:05.047192+0000 mon.c (mon.2) 139 : audit [INF] from='client.? 172.21.15.80:0/4292305050' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "32"}]: dispatch 2024-02-19T21:58:05.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:05.047504+0000 mon.a (mon.0) 2093 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "32"}]: dispatch 2024-02-19T21:58:05.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:05.488640+0000 mon.a (mon.0) 2094 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "32"}]': finished 2024-02-19T21:58:05.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:05.488716+0000 mon.a (mon.0) 2095 : cluster [DBG] osdmap e572: 8 total, 8 up, 8 in 2024-02-19T21:58:05.832 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:04.045946+0000 osd.6 (osd.6) 319 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:58:05.832 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:04.048884+0000 osd.6 (osd.6) 320 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:58:05.832 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:04.458964+0000 osd.4 (osd.4) 291 : cluster [DBG] 4.d scrub starts 2024-02-19T21:58:05.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:04.462422+0000 osd.4 (osd.4) 292 : cluster [DBG] 4.d scrub ok 2024-02-19T21:58:05.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:04.587097+0000 osd.5 (osd.5) 347 : cluster [DBG] 5.7 scrub starts 2024-02-19T21:58:05.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:04.590921+0000 osd.5 (osd.5) 348 : cluster [DBG] 5.7 scrub ok 2024-02-19T21:58:05.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:04.670398+0000 osd.2 (osd.2) 87 : cluster [DBG] 5.8 scrub starts 2024-02-19T21:58:05.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:04.671231+0000 osd.2 (osd.2) 88 : cluster [DBG] 5.8 scrub ok 2024-02-19T21:58:05.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:04.671605+0000 osd.7 (osd.7) 341 : cluster [DBG] 4.0 scrub starts 2024-02-19T21:58:05.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:04.675493+0000 osd.7 (osd.7) 342 : cluster [DBG] 4.0 scrub ok 2024-02-19T21:58:05.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:05.047192+0000 mon.c (mon.2) 139 : audit [INF] from='client.? 172.21.15.80:0/4292305050' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "32"}]: dispatch 2024-02-19T21:58:05.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:05.047504+0000 mon.a (mon.0) 2093 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "32"}]: dispatch 2024-02-19T21:58:05.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:05.488640+0000 mon.a (mon.0) 2094 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pgp_num", "val": "32"}]': finished 2024-02-19T21:58:05.833 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:05.488716+0000 mon.a (mon.0) 2095 : cluster [DBG] osdmap e572: 8 total, 8 up, 8 in 2024-02-19T21:58:05.926 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:58:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:58:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:58:06.072 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-02-19T21:58:06.181 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:58:06.181 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:58:06.341 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:58:06.805 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:05.342009+0000 mgr.y (mgr.14514) 972 : cluster [DBG] pgmap v1260: 122 pgs: 122 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 754 B/s rd, 0 op/s 2024-02-19T21:58:06.829 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.7 dump_historic_ops 2024-02-19T21:58:06.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:05.342009+0000 mgr.y (mgr.14514) 972 : cluster [DBG] pgmap v1260: 122 pgs: 122 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 754 B/s rd, 0 op/s 2024-02-19T21:58:06.845 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:05.342009+0000 mgr.y (mgr.14514) 972 : cluster [DBG] pgmap v1260: 122 pgs: 122 active+clean; 5.7 KiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 754 B/s rd, 0 op/s 2024-02-19T21:58:07.099 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.b/config 2024-02-19T21:58:07.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:06.503002+0000 osd.4 (osd.4) 293 : cluster [DBG] 6.1a deep-scrub starts 2024-02-19T21:58:07.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:06.505908+0000 osd.4 (osd.4) 294 : cluster [DBG] 6.1a deep-scrub ok 2024-02-19T21:58:07.968 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:06.503002+0000 osd.4 (osd.4) 293 : cluster [DBG] 6.1a deep-scrub starts 2024-02-19T21:58:07.968 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:06.505908+0000 osd.4 (osd.4) 294 : cluster [DBG] 6.1a deep-scrub ok 2024-02-19T21:58:08.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:06.503002+0000 osd.4 (osd.4) 293 : cluster [DBG] 6.1a deep-scrub starts 2024-02-19T21:58:08.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:06.505908+0000 osd.4 (osd.4) 294 : cluster [DBG] 6.1a deep-scrub ok 2024-02-19T21:58:08.246 INFO:teuthology.orchestra.run.smithi080.stdout:mon.a: {} 2024-02-19T21:58:08.256 INFO:teuthology.orchestra.run.smithi080.stdout:mon.b: {} 2024-02-19T21:58:08.265 INFO:teuthology.orchestra.run.smithi080.stdout:mon.c: {} 2024-02-19T21:58:08.266 INFO:teuthology.orchestra.run.smithi080.stderr:mon.a: mon_osd_down_out_interval = '600' (not observed, change may require restart) 2024-02-19T21:58:08.266 INFO:teuthology.orchestra.run.smithi080.stderr:mon.b: mon_osd_down_out_interval = '600' (not observed, change may require restart) 2024-02-19T21:58:08.266 INFO:teuthology.orchestra.run.smithi080.stderr:mon.c: mon_osd_down_out_interval = '600' (not observed, change may require restart) 2024-02-19T21:58:08.648 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:06.994457+0000 osd.6 (osd.6) 321 : cluster [DBG] 6.c scrub starts 2024-02-19T21:58:08.648 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:06.997336+0000 osd.6 (osd.6) 322 : cluster [DBG] 6.c scrub ok 2024-02-19T21:58:08.648 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:07.342548+0000 mgr.y (mgr.14514) 973 : cluster [DBG] pgmap v1262: 122 pgs: 122 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 746 B/s rd, 0 op/s 2024-02-19T21:58:08.648 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:08.237910+0000 mon.c (mon.2) 140 : audit [DBG] from='client.? 172.21.15.80:0/2389359675' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T21:58:08.938 INFO:teuthology.orchestra.run.smithi157.stdout:ERROR: (22) Invalid argument 2024-02-19T21:58:08.938 INFO:teuthology.orchestra.run.smithi157.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:58:08.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:06.994457+0000 osd.6 (osd.6) 321 : cluster [DBG] 6.c scrub starts 2024-02-19T21:58:08.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:06.997336+0000 osd.6 (osd.6) 322 : cluster [DBG] 6.c scrub ok 2024-02-19T21:58:08.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:07.342548+0000 mgr.y (mgr.14514) 973 : cluster [DBG] pgmap v1262: 122 pgs: 122 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 746 B/s rd, 0 op/s 2024-02-19T21:58:08.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:08.237910+0000 mon.c (mon.2) 140 : audit [DBG] from='client.? 172.21.15.80:0/2389359675' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T21:58:08.995 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:06.994457+0000 osd.6 (osd.6) 321 : cluster [DBG] 6.c scrub starts 2024-02-19T21:58:08.995 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:06.997336+0000 osd.6 (osd.6) 322 : cluster [DBG] 6.c scrub ok 2024-02-19T21:58:08.995 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:07.342548+0000 mgr.y (mgr.14514) 973 : cluster [DBG] pgmap v1262: 122 pgs: 122 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 746 B/s rd, 0 op/s 2024-02-19T21:58:08.995 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:08.237910+0000 mon.c (mon.2) 140 : audit [DBG] from='client.? 172.21.15.80:0/2389359675' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T21:58:09.013 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd reweight 1 1 2024-02-19T21:58:09.281 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:58:09.574 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.2 dump_ops_in_flight 2024-02-19T21:58:09.793 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:08.529015+0000 osd.1 (osd.1) 318 : cluster [DBG] 2.a scrub starts 2024-02-19T21:58:09.793 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:08.529859+0000 osd.1 (osd.1) 319 : cluster [DBG] 2.a scrub ok 2024-02-19T21:58:09.793 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:08.624772+0000 osd.0 (osd.0) 7 : cluster [DBG] 2.1f scrub starts 2024-02-19T21:58:09.793 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:08.625953+0000 osd.0 (osd.0) 8 : cluster [DBG] 2.1f scrub ok 2024-02-19T21:58:09.793 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:08.677477+0000 osd.7 (osd.7) 343 : cluster [DBG] 6.1c scrub starts 2024-02-19T21:58:09.793 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:08.680971+0000 osd.7 (osd.7) 344 : cluster [DBG] 6.1c scrub ok 2024-02-19T21:58:09.793 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:09.201950+0000 osd.5 (osd.5) 349 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:58:09.793 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:09.202027+0000 osd.5 (osd.5) 350 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:58:09.793 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:08.529015+0000 osd.1 (osd.1) 318 : cluster [DBG] 2.a scrub starts 2024-02-19T21:58:09.794 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:08.529859+0000 osd.1 (osd.1) 319 : cluster [DBG] 2.a scrub ok 2024-02-19T21:58:09.794 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:08.624772+0000 osd.0 (osd.0) 7 : cluster [DBG] 2.1f scrub starts 2024-02-19T21:58:09.794 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:08.625953+0000 osd.0 (osd.0) 8 : cluster [DBG] 2.1f scrub ok 2024-02-19T21:58:09.794 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:08.677477+0000 osd.7 (osd.7) 343 : cluster [DBG] 6.1c scrub starts 2024-02-19T21:58:09.794 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:08.680971+0000 osd.7 (osd.7) 344 : cluster [DBG] 6.1c scrub ok 2024-02-19T21:58:09.794 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:09.201950+0000 osd.5 (osd.5) 349 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:58:09.794 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:09.202027+0000 osd.5 (osd.5) 350 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:58:09.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:08.529015+0000 osd.1 (osd.1) 318 : cluster [DBG] 2.a scrub starts 2024-02-19T21:58:09.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:08.529859+0000 osd.1 (osd.1) 319 : cluster [DBG] 2.a scrub ok 2024-02-19T21:58:09.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:08.624772+0000 osd.0 (osd.0) 7 : cluster [DBG] 2.1f scrub starts 2024-02-19T21:58:09.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:08.625953+0000 osd.0 (osd.0) 8 : cluster [DBG] 2.1f scrub ok 2024-02-19T21:58:09.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:08.677477+0000 osd.7 (osd.7) 343 : cluster [DBG] 6.1c scrub starts 2024-02-19T21:58:09.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:08.680971+0000 osd.7 (osd.7) 344 : cluster [DBG] 6.1c scrub ok 2024-02-19T21:58:09.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:09.201950+0000 osd.5 (osd.5) 349 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:58:09.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:09.202027+0000 osd.5 (osd.5) 350 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:58:10.742 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:58:10.976 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:58:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:58:10] "GET /metrics HTTP/1.1" 200 174180 "" "Prometheus/2.33.4" 2024-02-19T21:58:10.976 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:09.343019+0000 mgr.y (mgr.14514) 974 : cluster [DBG] pgmap v1263: 122 pgs: 122 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:58:10.976 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:09.396063+0000 osd.7 (osd.7) 345 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:58:10.977 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:09.396112+0000 osd.7 (osd.7) 346 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:58:10.977 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:09.499110+0000 osd.4 (osd.4) 295 : cluster [DBG] 4.1b scrub starts 2024-02-19T21:58:10.977 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:09.502000+0000 osd.4 (osd.4) 296 : cluster [DBG] 4.1b scrub ok 2024-02-19T21:58:10.977 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:09.519837+0000 osd.1 (osd.1) 320 : cluster [DBG] 4.7 scrub starts 2024-02-19T21:58:10.977 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:09.521595+0000 osd.1 (osd.1) 321 : cluster [DBG] 4.7 scrub ok 2024-02-19T21:58:10.977 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:09.609110+0000 mon.a (mon.0) 2096 : cluster [DBG] osdmap e573: 8 total, 8 up, 8 in 2024-02-19T21:58:10.977 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:10.490732+0000 mon.a (mon.0) 2097 : cluster [DBG] osdmap e574: 8 total, 8 up, 8 in 2024-02-19T21:58:10.977 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:09.343019+0000 mgr.y (mgr.14514) 974 : cluster [DBG] pgmap v1263: 122 pgs: 122 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:58:10.977 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:09.396063+0000 osd.7 (osd.7) 345 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:58:10.977 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:09.396112+0000 osd.7 (osd.7) 346 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:58:10.977 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:09.499110+0000 osd.4 (osd.4) 295 : cluster [DBG] 4.1b scrub starts 2024-02-19T21:58:10.977 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:09.502000+0000 osd.4 (osd.4) 296 : cluster [DBG] 4.1b scrub ok 2024-02-19T21:58:10.978 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:09.519837+0000 osd.1 (osd.1) 320 : cluster [DBG] 4.7 scrub starts 2024-02-19T21:58:10.978 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:09.521595+0000 osd.1 (osd.1) 321 : cluster [DBG] 4.7 scrub ok 2024-02-19T21:58:10.978 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:09.609110+0000 mon.a (mon.0) 2096 : cluster [DBG] osdmap e573: 8 total, 8 up, 8 in 2024-02-19T21:58:10.978 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:10.490732+0000 mon.a (mon.0) 2097 : cluster [DBG] osdmap e574: 8 total, 8 up, 8 in 2024-02-19T21:58:11.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:09.343019+0000 mgr.y (mgr.14514) 974 : cluster [DBG] pgmap v1263: 122 pgs: 122 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:58:11.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:09.396063+0000 osd.7 (osd.7) 345 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:58:11.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:09.396112+0000 osd.7 (osd.7) 346 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:58:11.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:09.499110+0000 osd.4 (osd.4) 295 : cluster [DBG] 4.1b scrub starts 2024-02-19T21:58:11.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:09.502000+0000 osd.4 (osd.4) 296 : cluster [DBG] 4.1b scrub ok 2024-02-19T21:58:11.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:09.519837+0000 osd.1 (osd.1) 320 : cluster [DBG] 4.7 scrub starts 2024-02-19T21:58:11.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:09.521595+0000 osd.1 (osd.1) 321 : cluster [DBG] 4.7 scrub ok 2024-02-19T21:58:11.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:09.609110+0000 mon.a (mon.0) 2096 : cluster [DBG] osdmap e573: 8 total, 8 up, 8 in 2024-02-19T21:58:11.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:10.490732+0000 mon.a (mon.0) 2097 : cluster [DBG] osdmap e574: 8 total, 8 up, 8 in 2024-02-19T21:58:11.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:58:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:58:11.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:10.582058+0000 osd.0 (osd.0) 9 : cluster [DBG] 5.5 scrub starts 2024-02-19T21:58:11.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:10.583194+0000 osd.0 (osd.0) 10 : cluster [DBG] 5.5 scrub ok 2024-02-19T21:58:11.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:10.670428+0000 osd.5 (osd.5) 351 : cluster [DBG] 6.a scrub starts 2024-02-19T21:58:11.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:10.671990+0000 osd.5 (osd.5) 352 : cluster [DBG] 6.a scrub ok 2024-02-19T21:58:11.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:10.714901+0000 osd.2 (osd.2) 89 : cluster [DBG] 4.19 scrub starts 2024-02-19T21:58:11.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:10.717234+0000 osd.2 (osd.2) 90 : cluster [DBG] 4.19 scrub ok 2024-02-19T21:58:11.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:10.582058+0000 osd.0 (osd.0) 9 : cluster [DBG] 5.5 scrub starts 2024-02-19T21:58:11.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:10.583194+0000 osd.0 (osd.0) 10 : cluster [DBG] 5.5 scrub ok 2024-02-19T21:58:11.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:10.670428+0000 osd.5 (osd.5) 351 : cluster [DBG] 6.a scrub starts 2024-02-19T21:58:11.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:10.671990+0000 osd.5 (osd.5) 352 : cluster [DBG] 6.a scrub ok 2024-02-19T21:58:11.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:10.714901+0000 osd.2 (osd.2) 89 : cluster [DBG] 4.19 scrub starts 2024-02-19T21:58:11.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:10.717234+0000 osd.2 (osd.2) 90 : cluster [DBG] 4.19 scrub ok 2024-02-19T21:58:11.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:10.582058+0000 osd.0 (osd.0) 9 : cluster [DBG] 5.5 scrub starts 2024-02-19T21:58:11.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:10.583194+0000 osd.0 (osd.0) 10 : cluster [DBG] 5.5 scrub ok 2024-02-19T21:58:11.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:10.670428+0000 osd.5 (osd.5) 351 : cluster [DBG] 6.a scrub starts 2024-02-19T21:58:11.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:10.671990+0000 osd.5 (osd.5) 352 : cluster [DBG] 6.a scrub ok 2024-02-19T21:58:11.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:10.714901+0000 osd.2 (osd.2) 89 : cluster [DBG] 4.19 scrub starts 2024-02-19T21:58:11.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:10.717234+0000 osd.2 (osd.2) 90 : cluster [DBG] 4.19 scrub ok 2024-02-19T21:58:12.622 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.1 to 1 (10000) 2024-02-19T21:58:12.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:11.343558+0000 mgr.y (mgr.14514) 975 : cluster [DBG] pgmap v1266: 122 pgs: 122 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-19T21:58:12.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:11.482896+0000 mgr.y (mgr.14514) 976 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:58:12.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:11.641161+0000 mon.a (mon.0) 2098 : audit [INF] from='client.? 172.21.15.80:0/1694724637' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-02-19T21:58:12.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:11.689553+0000 osd.5 (osd.5) 353 : cluster [DBG] 5.f scrub starts 2024-02-19T21:58:12.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:11.692999+0000 osd.5 (osd.5) 354 : cluster [DBG] 5.f scrub ok 2024-02-19T21:58:12.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:11.343558+0000 mgr.y (mgr.14514) 975 : cluster [DBG] pgmap v1266: 122 pgs: 122 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-19T21:58:12.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:11.482896+0000 mgr.y (mgr.14514) 976 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:58:12.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:11.641161+0000 mon.a (mon.0) 2098 : audit [INF] from='client.? 172.21.15.80:0/1694724637' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-02-19T21:58:12.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:11.689553+0000 osd.5 (osd.5) 353 : cluster [DBG] 5.f scrub starts 2024-02-19T21:58:12.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:11.692999+0000 osd.5 (osd.5) 354 : cluster [DBG] 5.f scrub ok 2024-02-19T21:58:13.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:11.343558+0000 mgr.y (mgr.14514) 975 : cluster [DBG] pgmap v1266: 122 pgs: 122 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-19T21:58:13.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:11.482896+0000 mgr.y (mgr.14514) 976 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:58:13.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:11.641161+0000 mon.a (mon.0) 2098 : audit [INF] from='client.? 172.21.15.80:0/1694724637' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-02-19T21:58:13.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:11.689553+0000 osd.5 (osd.5) 353 : cluster [DBG] 5.f scrub starts 2024-02-19T21:58:13.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:11.692999+0000 osd.5 (osd.5) 354 : cluster [DBG] 5.f scrub ok 2024-02-19T21:58:13.481 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd primary-affinity 1 1 2024-02-19T21:58:13.598 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:58:13.598 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:58:13.845 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:12.445617+0000 osd.4 (osd.4) 297 : cluster [DBG] 4.1a scrub starts 2024-02-19T21:58:13.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:12.449133+0000 osd.4 (osd.4) 298 : cluster [DBG] 4.1a scrub ok 2024-02-19T21:58:13.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:12.570623+0000 osd.1 (osd.1) 322 : cluster [DBG] 2.6 scrub starts 2024-02-19T21:58:13.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:12.571852+0000 osd.1 (osd.1) 323 : cluster [DBG] 2.6 scrub ok 2024-02-19T21:58:13.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:12.597921+0000 osd.7 (osd.7) 347 : cluster [DBG] 5.14 deep-scrub starts 2024-02-19T21:58:13.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:12.601388+0000 osd.7 (osd.7) 348 : cluster [DBG] 5.14 deep-scrub ok 2024-02-19T21:58:13.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:12.619207+0000 mon.a (mon.0) 2099 : audit [INF] from='client.? 172.21.15.80:0/1694724637' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-02-19T21:58:13.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:12.619272+0000 mon.a (mon.0) 2100 : cluster [DBG] osdmap e575: 8 total, 8 up, 8 in 2024-02-19T21:58:13.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:12.445617+0000 osd.4 (osd.4) 297 : cluster [DBG] 4.1a scrub starts 2024-02-19T21:58:13.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:12.449133+0000 osd.4 (osd.4) 298 : cluster [DBG] 4.1a scrub ok 2024-02-19T21:58:13.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:12.570623+0000 osd.1 (osd.1) 322 : cluster [DBG] 2.6 scrub starts 2024-02-19T21:58:13.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:12.571852+0000 osd.1 (osd.1) 323 : cluster [DBG] 2.6 scrub ok 2024-02-19T21:58:13.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:12.597921+0000 osd.7 (osd.7) 347 : cluster [DBG] 5.14 deep-scrub starts 2024-02-19T21:58:13.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:12.601388+0000 osd.7 (osd.7) 348 : cluster [DBG] 5.14 deep-scrub ok 2024-02-19T21:58:13.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:12.619207+0000 mon.a (mon.0) 2099 : audit [INF] from='client.? 172.21.15.80:0/1694724637' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-02-19T21:58:13.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:12.619272+0000 mon.a (mon.0) 2100 : cluster [DBG] osdmap e575: 8 total, 8 up, 8 in 2024-02-19T21:58:14.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:12.445617+0000 osd.4 (osd.4) 297 : cluster [DBG] 4.1a scrub starts 2024-02-19T21:58:14.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:12.449133+0000 osd.4 (osd.4) 298 : cluster [DBG] 4.1a scrub ok 2024-02-19T21:58:14.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:12.570623+0000 osd.1 (osd.1) 322 : cluster [DBG] 2.6 scrub starts 2024-02-19T21:58:14.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:12.571852+0000 osd.1 (osd.1) 323 : cluster [DBG] 2.6 scrub ok 2024-02-19T21:58:14.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:12.597921+0000 osd.7 (osd.7) 347 : cluster [DBG] 5.14 deep-scrub starts 2024-02-19T21:58:14.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:12.601388+0000 osd.7 (osd.7) 348 : cluster [DBG] 5.14 deep-scrub ok 2024-02-19T21:58:14.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:12.619207+0000 mon.a (mon.0) 2099 : audit [INF] from='client.? 172.21.15.80:0/1694724637' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-02-19T21:58:14.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:12.619272+0000 mon.a (mon.0) 2100 : cluster [DBG] osdmap e575: 8 total, 8 up, 8 in 2024-02-19T21:58:14.249 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.2 dump_blocked_ops 2024-02-19T21:58:14.292 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:58:14.787 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:13.343930+0000 mgr.y (mgr.14514) 977 : cluster [DBG] pgmap v1268: 122 pgs: 122 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:58:14.787 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:13.607834+0000 osd.1 (osd.1) 324 : cluster [DBG] 2.4 scrub starts 2024-02-19T21:58:14.787 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:13.608655+0000 osd.1 (osd.1) 325 : cluster [DBG] 2.4 scrub ok 2024-02-19T21:58:14.788 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:13.343930+0000 mgr.y (mgr.14514) 977 : cluster [DBG] pgmap v1268: 122 pgs: 122 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:58:14.788 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:13.607834+0000 osd.1 (osd.1) 324 : cluster [DBG] 2.4 scrub starts 2024-02-19T21:58:14.788 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:13.608655+0000 osd.1 (osd.1) 325 : cluster [DBG] 2.4 scrub ok 2024-02-19T21:58:15.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:13.343930+0000 mgr.y (mgr.14514) 977 : cluster [DBG] pgmap v1268: 122 pgs: 122 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:58:15.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:13.607834+0000 osd.1 (osd.1) 324 : cluster [DBG] 2.4 scrub starts 2024-02-19T21:58:15.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:13.608655+0000 osd.1 (osd.1) 325 : cluster [DBG] 2.4 scrub ok 2024-02-19T21:58:15.119 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:58:15.990 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:14.549707+0000 osd.0 (osd.0) 11 : cluster [DBG] 6.16 scrub starts 2024-02-19T21:58:15.990 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:14.577551+0000 osd.0 (osd.0) 12 : cluster [DBG] 6.16 scrub ok 2024-02-19T21:58:15.990 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:14.951772+0000 osd.3 (osd.3) 285 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:58:15.990 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:14.955441+0000 osd.3 (osd.3) 286 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:58:15.990 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:15.492907+0000 mon.a (mon.0) 2101 : cluster [DBG] osdmap e576: 8 total, 8 up, 8 in 2024-02-19T21:58:15.991 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:14.549707+0000 osd.0 (osd.0) 11 : cluster [DBG] 6.16 scrub starts 2024-02-19T21:58:15.991 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:14.577551+0000 osd.0 (osd.0) 12 : cluster [DBG] 6.16 scrub ok 2024-02-19T21:58:15.991 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:14.951772+0000 osd.3 (osd.3) 285 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:58:15.991 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:14.955441+0000 osd.3 (osd.3) 286 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:58:15.991 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:15.492907+0000 mon.a (mon.0) 2101 : cluster [DBG] osdmap e576: 8 total, 8 up, 8 in 2024-02-19T21:58:16.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:58:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:58:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:58:16.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:14.549707+0000 osd.0 (osd.0) 11 : cluster [DBG] 6.16 scrub starts 2024-02-19T21:58:16.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:14.577551+0000 osd.0 (osd.0) 12 : cluster [DBG] 6.16 scrub ok 2024-02-19T21:58:16.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:14.951772+0000 osd.3 (osd.3) 285 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:58:16.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:14.955441+0000 osd.3 (osd.3) 286 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:58:16.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:15.492907+0000 mon.a (mon.0) 2101 : cluster [DBG] osdmap e576: 8 total, 8 up, 8 in 2024-02-19T21:58:16.914 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:15.344445+0000 mgr.y (mgr.14514) 978 : cluster [DBG] pgmap v1269: 122 pgs: 122 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:58:16.914 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:15.513661+0000 osd.4 (osd.4) 299 : cluster [DBG] 6.17 scrub starts 2024-02-19T21:58:16.914 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:15.653405+0000 osd.4 (osd.4) 300 : cluster [DBG] 6.17 scrub ok 2024-02-19T21:58:16.914 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:15.344445+0000 mgr.y (mgr.14514) 978 : cluster [DBG] pgmap v1269: 122 pgs: 122 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:58:16.914 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:15.513661+0000 osd.4 (osd.4) 299 : cluster [DBG] 6.17 scrub starts 2024-02-19T21:58:16.914 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:15.653405+0000 osd.4 (osd.4) 300 : cluster [DBG] 6.17 scrub ok 2024-02-19T21:58:17.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:15.344445+0000 mgr.y (mgr.14514) 978 : cluster [DBG] pgmap v1269: 122 pgs: 122 active+clean; 5.7 KiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:58:17.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:15.513661+0000 osd.4 (osd.4) 299 : cluster [DBG] 6.17 scrub starts 2024-02-19T21:58:17.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:15.653405+0000 osd.4 (osd.4) 300 : cluster [DBG] 6.17 scrub ok 2024-02-19T21:58:17.318 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:58:17.318 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:58:18.211 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.2 dump_historic_ops 2024-02-19T21:58:18.479 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:58:18.656 INFO:teuthology.orchestra.run.smithi080.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-02-19T21:58:19.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:17.344872+0000 mgr.y (mgr.14514) 979 : cluster [DBG] pgmap v1271: 122 pgs: 122 active+clean; 5.7 KiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 746 B/s rd, 0 op/s 2024-02-19T21:58:19.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:17.507027+0000 osd.7 (osd.7) 349 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:58:19.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:17.509940+0000 osd.7 (osd.7) 350 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:58:19.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:17.713049+0000 mon.a (mon.0) 2102 : audit [INF] from='client.? 172.21.15.80:0/3559328915' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]: dispatch 2024-02-19T21:58:19.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:17.344872+0000 mgr.y (mgr.14514) 979 : cluster [DBG] pgmap v1271: 122 pgs: 122 active+clean; 5.7 KiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 746 B/s rd, 0 op/s 2024-02-19T21:58:19.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:17.507027+0000 osd.7 (osd.7) 349 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:58:19.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:17.509940+0000 osd.7 (osd.7) 350 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:58:19.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:17.713049+0000 mon.a (mon.0) 2102 : audit [INF] from='client.? 172.21.15.80:0/3559328915' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]: dispatch 2024-02-19T21:58:19.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:17.344872+0000 mgr.y (mgr.14514) 979 : cluster [DBG] pgmap v1271: 122 pgs: 122 active+clean; 5.7 KiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 746 B/s rd, 0 op/s 2024-02-19T21:58:19.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:17.507027+0000 osd.7 (osd.7) 349 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:58:19.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:17.509940+0000 osd.7 (osd.7) 350 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:58:19.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:17.713049+0000 mon.a (mon.0) 2102 : audit [INF] from='client.? 172.21.15.80:0/3559328915' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]: dispatch 2024-02-19T21:58:19.559 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd reweight 3 1 2024-02-19T21:58:19.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:18.535235+0000 osd.2 (osd.2) 91 : cluster [DBG] 6.f scrub starts 2024-02-19T21:58:19.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:18.641649+0000 osd.2 (osd.2) 92 : cluster [DBG] 6.f scrub ok 2024-02-19T21:58:19.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:18.653205+0000 mon.a (mon.0) 2103 : audit [INF] from='client.? 172.21.15.80:0/3559328915' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]': finished 2024-02-19T21:58:19.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:18.653258+0000 mon.a (mon.0) 2104 : cluster [DBG] osdmap e577: 8 total, 8 up, 8 in 2024-02-19T21:58:19.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:18.682657+0000 osd.5 (osd.5) 355 : cluster [DBG] 6.12 scrub starts 2024-02-19T21:58:19.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:18.683473+0000 osd.5 (osd.5) 356 : cluster [DBG] 6.12 scrub ok 2024-02-19T21:58:19.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:19.480583+0000 osd.0 (osd.0) 13 : cluster [DBG] 4.1f scrub starts 2024-02-19T21:58:19.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:19.482584+0000 osd.0 (osd.0) 14 : cluster [DBG] 4.1f scrub ok 2024-02-19T21:58:19.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:18.535235+0000 osd.2 (osd.2) 91 : cluster [DBG] 6.f scrub starts 2024-02-19T21:58:19.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:18.641649+0000 osd.2 (osd.2) 92 : cluster [DBG] 6.f scrub ok 2024-02-19T21:58:19.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:18.653205+0000 mon.a (mon.0) 2103 : audit [INF] from='client.? 172.21.15.80:0/3559328915' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]': finished 2024-02-19T21:58:19.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:18.653258+0000 mon.a (mon.0) 2104 : cluster [DBG] osdmap e577: 8 total, 8 up, 8 in 2024-02-19T21:58:19.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:18.682657+0000 osd.5 (osd.5) 355 : cluster [DBG] 6.12 scrub starts 2024-02-19T21:58:19.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:18.683473+0000 osd.5 (osd.5) 356 : cluster [DBG] 6.12 scrub ok 2024-02-19T21:58:19.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:19.480583+0000 osd.0 (osd.0) 13 : cluster [DBG] 4.1f scrub starts 2024-02-19T21:58:19.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:19.482584+0000 osd.0 (osd.0) 14 : cluster [DBG] 4.1f scrub ok 2024-02-19T21:58:20.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:18.535235+0000 osd.2 (osd.2) 91 : cluster [DBG] 6.f scrub starts 2024-02-19T21:58:20.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:18.641649+0000 osd.2 (osd.2) 92 : cluster [DBG] 6.f scrub ok 2024-02-19T21:58:20.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:18.653205+0000 mon.a (mon.0) 2103 : audit [INF] from='client.? 172.21.15.80:0/3559328915' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]': finished 2024-02-19T21:58:20.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:18.653258+0000 mon.a (mon.0) 2104 : cluster [DBG] osdmap e577: 8 total, 8 up, 8 in 2024-02-19T21:58:20.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:18.682657+0000 osd.5 (osd.5) 355 : cluster [DBG] 6.12 scrub starts 2024-02-19T21:58:20.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:18.683473+0000 osd.5 (osd.5) 356 : cluster [DBG] 6.12 scrub ok 2024-02-19T21:58:20.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:19.480583+0000 osd.0 (osd.0) 13 : cluster [DBG] 4.1f scrub starts 2024-02-19T21:58:20.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:19.482584+0000 osd.0 (osd.0) 14 : cluster [DBG] 4.1f scrub ok 2024-02-19T21:58:20.771 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:18.908722+0000 osd.6 (osd.6) 323 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:58:20.771 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:18.911700+0000 osd.6 (osd.6) 324 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:58:20.771 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:19.345247+0000 mgr.y (mgr.14514) 980 : cluster [DBG] pgmap v1273: 122 pgs: 122 active+clean; 5.7 KiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 760 B/s rd, 0 op/s 2024-02-19T21:58:20.771 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:19.575255+0000 osd.7 (osd.7) 351 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:58:20.771 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:19.650635+0000 osd.7 (osd.7) 352 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:58:20.771 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:19.815497+0000 osd.3 (osd.3) 287 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:58:20.771 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:19.816390+0000 osd.3 (osd.3) 288 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:58:20.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:20.459090+0000 mon.a (mon.0) 2105 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:58:20.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:20.496314+0000 mon.a (mon.0) 2106 : cluster [DBG] osdmap e578: 8 total, 8 up, 8 in 2024-02-19T21:58:20.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:18.908722+0000 osd.6 (osd.6) 323 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:58:20.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:18.911700+0000 osd.6 (osd.6) 324 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:58:20.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:19.345247+0000 mgr.y (mgr.14514) 980 : cluster [DBG] pgmap v1273: 122 pgs: 122 active+clean; 5.7 KiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 760 B/s rd, 0 op/s 2024-02-19T21:58:20.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:19.575255+0000 osd.7 (osd.7) 351 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:58:20.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:19.650635+0000 osd.7 (osd.7) 352 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:58:20.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:19.815497+0000 osd.3 (osd.3) 287 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:58:20.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:19.816390+0000 osd.3 (osd.3) 288 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:58:20.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:20.459090+0000 mon.a (mon.0) 2105 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:58:20.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:20.496314+0000 mon.a (mon.0) 2106 : cluster [DBG] osdmap e578: 8 total, 8 up, 8 in 2024-02-19T21:58:20.942 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:58:20.998 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-02-19T21:58:20.998 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-02-19T21:58:21.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:18.908722+0000 osd.6 (osd.6) 323 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:58:21.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:18.911700+0000 osd.6 (osd.6) 324 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:58:21.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:19.345247+0000 mgr.y (mgr.14514) 980 : cluster [DBG] pgmap v1273: 122 pgs: 122 active+clean; 5.7 KiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 760 B/s rd, 0 op/s 2024-02-19T21:58:21.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:19.575255+0000 osd.7 (osd.7) 351 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:58:21.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:19.650635+0000 osd.7 (osd.7) 352 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:58:21.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:19.815497+0000 osd.3 (osd.3) 287 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:58:21.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:19.816390+0000 osd.3 (osd.3) 288 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:58:21.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:20.459090+0000 mon.a (mon.0) 2105 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:58:21.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:20.496314+0000 mon.a (mon.0) 2106 : cluster [DBG] osdmap e578: 8 total, 8 up, 8 in 2024-02-19T21:58:21.096 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:58:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:58:20] "GET /metrics HTTP/1.1" 200 174232 "" "Prometheus/2.33.4" 2024-02-19T21:58:21.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:58:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:58:21.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:20.571538+0000 osd.2 (osd.2) 93 : cluster [DBG] 2.10 scrub starts 2024-02-19T21:58:21.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:20.572586+0000 osd.2 (osd.2) 94 : cluster [DBG] 2.10 scrub ok 2024-02-19T21:58:21.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:20.602402+0000 osd.7 (osd.7) 353 : cluster [DBG] 5.4 scrub starts 2024-02-19T21:58:21.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:20.605273+0000 osd.7 (osd.7) 354 : cluster [DBG] 5.4 scrub ok 2024-02-19T21:58:21.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:20.734121+0000 osd.5 (osd.5) 357 : cluster [DBG] 6.19 scrub starts 2024-02-19T21:58:21.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:20.783221+0000 osd.5 (osd.5) 358 : cluster [DBG] 6.19 scrub ok 2024-02-19T21:58:21.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:20.811551+0000 osd.3 (osd.3) 289 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:58:21.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:20.812382+0000 osd.3 (osd.3) 290 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:58:21.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:20.843144+0000 mon.a (mon.0) 2107 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:58:21.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:20.843784+0000 mon.a (mon.0) 2108 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:58:21.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:20.847832+0000 mon.a (mon.0) 2109 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:58:21.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:20.571538+0000 osd.2 (osd.2) 93 : cluster [DBG] 2.10 scrub starts 2024-02-19T21:58:21.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:20.572586+0000 osd.2 (osd.2) 94 : cluster [DBG] 2.10 scrub ok 2024-02-19T21:58:21.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:20.602402+0000 osd.7 (osd.7) 353 : cluster [DBG] 5.4 scrub starts 2024-02-19T21:58:21.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:20.605273+0000 osd.7 (osd.7) 354 : cluster [DBG] 5.4 scrub ok 2024-02-19T21:58:21.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:20.734121+0000 osd.5 (osd.5) 357 : cluster [DBG] 6.19 scrub starts 2024-02-19T21:58:21.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:20.783221+0000 osd.5 (osd.5) 358 : cluster [DBG] 6.19 scrub ok 2024-02-19T21:58:21.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:20.811551+0000 osd.3 (osd.3) 289 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:58:21.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:20.812382+0000 osd.3 (osd.3) 290 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:58:21.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:20.843144+0000 mon.a (mon.0) 2107 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:58:21.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:20.843784+0000 mon.a (mon.0) 2108 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:58:21.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:20.847832+0000 mon.a (mon.0) 2109 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:58:21.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:20.571538+0000 osd.2 (osd.2) 93 : cluster [DBG] 2.10 scrub starts 2024-02-19T21:58:21.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:20.572586+0000 osd.2 (osd.2) 94 : cluster [DBG] 2.10 scrub ok 2024-02-19T21:58:21.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:20.602402+0000 osd.7 (osd.7) 353 : cluster [DBG] 5.4 scrub starts 2024-02-19T21:58:21.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:20.605273+0000 osd.7 (osd.7) 354 : cluster [DBG] 5.4 scrub ok 2024-02-19T21:58:21.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:20.734121+0000 osd.5 (osd.5) 357 : cluster [DBG] 6.19 scrub starts 2024-02-19T21:58:21.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:20.783221+0000 osd.5 (osd.5) 358 : cluster [DBG] 6.19 scrub ok 2024-02-19T21:58:21.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:20.811551+0000 osd.3 (osd.3) 289 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:58:21.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:20.812382+0000 osd.3 (osd.3) 290 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:58:21.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:20.843144+0000 mon.a (mon.0) 2107 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:58:21.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:20.843784+0000 mon.a (mon.0) 2108 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:58:21.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:20.847832+0000 mon.a (mon.0) 2109 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:58:21.895 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_ops_in_flight 2024-02-19T21:58:22.879 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:58:23.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:21.345789+0000 mgr.y (mgr.14514) 981 : cluster [DBG] pgmap v1275: 122 pgs: 122 active+clean; 5.7 KiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-19T21:58:23.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:21.486987+0000 mgr.y (mgr.14514) 982 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:58:23.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:21.345789+0000 mgr.y (mgr.14514) 981 : cluster [DBG] pgmap v1275: 122 pgs: 122 active+clean; 5.7 KiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-19T21:58:23.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:22 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:21.486987+0000 mgr.y (mgr.14514) 982 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:58:23.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:21.345789+0000 mgr.y (mgr.14514) 981 : cluster [DBG] pgmap v1275: 122 pgs: 122 active+clean; 5.7 KiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-19T21:58:23.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:21.486987+0000 mgr.y (mgr.14514) 982 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:58:24.177 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:22.536195+0000 osd.2 (osd.2) 95 : cluster [DBG] 5.a scrub starts 2024-02-19T21:58:24.177 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:22.537254+0000 osd.2 (osd.2) 96 : cluster [DBG] 5.a scrub ok 2024-02-19T21:58:24.177 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:22.552409+0000 osd.0 (osd.0) 15 : cluster [DBG] 6.13 scrub starts 2024-02-19T21:58:24.177 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:22.628139+0000 osd.0 (osd.0) 16 : cluster [DBG] 6.13 scrub ok 2024-02-19T21:58:24.178 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:22.742939+0000 osd.5 (osd.5) 359 : cluster [DBG] 2.3 scrub starts 2024-02-19T21:58:24.178 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:22.743753+0000 osd.5 (osd.5) 360 : cluster [DBG] 2.3 scrub ok 2024-02-19T21:58:24.178 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:22.807202+0000 osd.6 (osd.6) 325 : cluster [DBG] 2.7 scrub starts 2024-02-19T21:58:24.178 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:22.810104+0000 osd.6 (osd.6) 326 : cluster [DBG] 2.7 scrub ok 2024-02-19T21:58:24.178 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:22.536195+0000 osd.2 (osd.2) 95 : cluster [DBG] 5.a scrub starts 2024-02-19T21:58:24.178 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:22.537254+0000 osd.2 (osd.2) 96 : cluster [DBG] 5.a scrub ok 2024-02-19T21:58:24.178 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:22.552409+0000 osd.0 (osd.0) 15 : cluster [DBG] 6.13 scrub starts 2024-02-19T21:58:24.178 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:22.628139+0000 osd.0 (osd.0) 16 : cluster [DBG] 6.13 scrub ok 2024-02-19T21:58:24.178 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:22.742939+0000 osd.5 (osd.5) 359 : cluster [DBG] 2.3 scrub starts 2024-02-19T21:58:24.178 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:22.743753+0000 osd.5 (osd.5) 360 : cluster [DBG] 2.3 scrub ok 2024-02-19T21:58:24.178 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:22.807202+0000 osd.6 (osd.6) 325 : cluster [DBG] 2.7 scrub starts 2024-02-19T21:58:24.178 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:22.810104+0000 osd.6 (osd.6) 326 : cluster [DBG] 2.7 scrub ok 2024-02-19T21:58:24.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:22.536195+0000 osd.2 (osd.2) 95 : cluster [DBG] 5.a scrub starts 2024-02-19T21:58:24.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:22.537254+0000 osd.2 (osd.2) 96 : cluster [DBG] 5.a scrub ok 2024-02-19T21:58:24.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:22.552409+0000 osd.0 (osd.0) 15 : cluster [DBG] 6.13 scrub starts 2024-02-19T21:58:24.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:22.628139+0000 osd.0 (osd.0) 16 : cluster [DBG] 6.13 scrub ok 2024-02-19T21:58:24.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:22.742939+0000 osd.5 (osd.5) 359 : cluster [DBG] 2.3 scrub starts 2024-02-19T21:58:24.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:22.743753+0000 osd.5 (osd.5) 360 : cluster [DBG] 2.3 scrub ok 2024-02-19T21:58:24.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:22.807202+0000 osd.6 (osd.6) 325 : cluster [DBG] 2.7 scrub starts 2024-02-19T21:58:24.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:22.810104+0000 osd.6 (osd.6) 326 : cluster [DBG] 2.7 scrub ok 2024-02-19T21:58:24.881 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.3 to 1 (10000) 2024-02-19T21:58:25.095 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:23.346253+0000 mgr.y (mgr.14514) 983 : cluster [DBG] pgmap v1276: 122 pgs: 122 active+clean; 5.7 KiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 651 B/s rd, 0 op/s 2024-02-19T21:58:25.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:23.581481+0000 osd.0 (osd.0) 17 : cluster [DBG] 4.1e deep-scrub starts 2024-02-19T21:58:25.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:23.585841+0000 osd.0 (osd.0) 18 : cluster [DBG] 4.1e deep-scrub ok 2024-02-19T21:58:25.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:23.868986+0000 mon.c (mon.2) 141 : audit [INF] from='client.? 172.21.15.80:0/1288459558' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-02-19T21:58:25.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:23.869250+0000 mon.a (mon.0) 2110 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-02-19T21:58:25.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:23.346253+0000 mgr.y (mgr.14514) 983 : cluster [DBG] pgmap v1276: 122 pgs: 122 active+clean; 5.7 KiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 651 B/s rd, 0 op/s 2024-02-19T21:58:25.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:23.581481+0000 osd.0 (osd.0) 17 : cluster [DBG] 4.1e deep-scrub starts 2024-02-19T21:58:25.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:23.585841+0000 osd.0 (osd.0) 18 : cluster [DBG] 4.1e deep-scrub ok 2024-02-19T21:58:25.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:23.868986+0000 mon.c (mon.2) 141 : audit [INF] from='client.? 172.21.15.80:0/1288459558' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-02-19T21:58:25.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:23.869250+0000 mon.a (mon.0) 2110 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-02-19T21:58:25.139 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:58:25.139 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-02-19T21:58:25.139 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-02-19T21:58:25.139 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:58:25.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:23.346253+0000 mgr.y (mgr.14514) 983 : cluster [DBG] pgmap v1276: 122 pgs: 122 active+clean; 5.7 KiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 651 B/s rd, 0 op/s 2024-02-19T21:58:25.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:23.581481+0000 osd.0 (osd.0) 17 : cluster [DBG] 4.1e deep-scrub starts 2024-02-19T21:58:25.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:23.585841+0000 osd.0 (osd.0) 18 : cluster [DBG] 4.1e deep-scrub ok 2024-02-19T21:58:25.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:23.868986+0000 mon.c (mon.2) 141 : audit [INF] from='client.? 172.21.15.80:0/1288459558' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-02-19T21:58:25.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:23.869250+0000 mon.a (mon.0) 2110 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-02-19T21:58:25.878 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:58:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:58:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:58:26.204 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:24.549669+0000 osd.0 (osd.0) 19 : cluster [DBG] 4.b scrub starts 2024-02-19T21:58:26.204 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:24.553266+0000 osd.0 (osd.0) 20 : cluster [DBG] 4.b scrub ok 2024-02-19T21:58:26.204 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:24.561573+0000 osd.2 (osd.2) 97 : cluster [DBG] 2.1 scrub starts 2024-02-19T21:58:26.204 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:24.562368+0000 osd.2 (osd.2) 98 : cluster [DBG] 2.1 scrub ok 2024-02-19T21:58:26.207 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:24.807311+0000 osd.5 (osd.5) 361 : cluster [DBG] 2.18 scrub starts 2024-02-19T21:58:26.207 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:24.810272+0000 osd.5 (osd.5) 362 : cluster [DBG] 2.18 scrub ok 2024-02-19T21:58:26.207 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:24.860474+0000 mon.a (mon.0) 2111 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-02-19T21:58:26.207 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:24.860556+0000 mon.a (mon.0) 2112 : cluster [DBG] osdmap e579: 8 total, 8 up, 8 in 2024-02-19T21:58:26.207 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:25.499241+0000 mon.a (mon.0) 2113 : cluster [DBG] osdmap e580: 8 total, 8 up, 8 in 2024-02-19T21:58:26.207 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:24.549669+0000 osd.0 (osd.0) 19 : cluster [DBG] 4.b scrub starts 2024-02-19T21:58:26.207 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:24.553266+0000 osd.0 (osd.0) 20 : cluster [DBG] 4.b scrub ok 2024-02-19T21:58:26.208 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:24.561573+0000 osd.2 (osd.2) 97 : cluster [DBG] 2.1 scrub starts 2024-02-19T21:58:26.208 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:24.562368+0000 osd.2 (osd.2) 98 : cluster [DBG] 2.1 scrub ok 2024-02-19T21:58:26.208 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:24.807311+0000 osd.5 (osd.5) 361 : cluster [DBG] 2.18 scrub starts 2024-02-19T21:58:26.208 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:24.810272+0000 osd.5 (osd.5) 362 : cluster [DBG] 2.18 scrub ok 2024-02-19T21:58:26.208 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:24.860474+0000 mon.a (mon.0) 2111 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-02-19T21:58:26.208 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:24.860556+0000 mon.a (mon.0) 2112 : cluster [DBG] osdmap e579: 8 total, 8 up, 8 in 2024-02-19T21:58:26.208 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:25.499241+0000 mon.a (mon.0) 2113 : cluster [DBG] osdmap e580: 8 total, 8 up, 8 in 2024-02-19T21:58:26.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:24.549669+0000 osd.0 (osd.0) 19 : cluster [DBG] 4.b scrub starts 2024-02-19T21:58:26.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:24.553266+0000 osd.0 (osd.0) 20 : cluster [DBG] 4.b scrub ok 2024-02-19T21:58:26.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:24.561573+0000 osd.2 (osd.2) 97 : cluster [DBG] 2.1 scrub starts 2024-02-19T21:58:26.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:24.562368+0000 osd.2 (osd.2) 98 : cluster [DBG] 2.1 scrub ok 2024-02-19T21:58:26.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:24.807311+0000 osd.5 (osd.5) 361 : cluster [DBG] 2.18 scrub starts 2024-02-19T21:58:26.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:24.810272+0000 osd.5 (osd.5) 362 : cluster [DBG] 2.18 scrub ok 2024-02-19T21:58:26.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:24.860474+0000 mon.a (mon.0) 2111 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-02-19T21:58:26.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:24.860556+0000 mon.a (mon.0) 2112 : cluster [DBG] osdmap e579: 8 total, 8 up, 8 in 2024-02-19T21:58:26.307 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:25.499241+0000 mon.a (mon.0) 2113 : cluster [DBG] osdmap e580: 8 total, 8 up, 8 in 2024-02-19T21:58:26.651 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd primary-affinity 3 1 2024-02-19T21:58:26.997 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_blocked_ops 2024-02-19T21:58:27.060 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:58:27.277 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:25.346733+0000 mgr.y (mgr.14514) 984 : cluster [DBG] pgmap v1278: 122 pgs: 122 active+clean; 5.7 KiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 764 B/s rd, 0 op/s 2024-02-19T21:58:27.277 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:25.375871+0000 osd.4 (osd.4) 301 : cluster [DBG] 4.1 scrub starts 2024-02-19T21:58:27.277 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:25.379501+0000 osd.4 (osd.4) 302 : cluster [DBG] 4.1 scrub ok 2024-02-19T21:58:27.277 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:26.505792+0000 osd.5 (osd.5) 363 : cluster [DBG] 6.c starting backfill to osd.3 from (0'0,0'0] MAX to 66'1 2024-02-19T21:58:27.277 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:26.507632+0000 mon.a (mon.0) 2114 : cluster [DBG] osdmap e581: 8 total, 8 up, 8 in 2024-02-19T21:58:27.277 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:25.346733+0000 mgr.y (mgr.14514) 984 : cluster [DBG] pgmap v1278: 122 pgs: 122 active+clean; 5.7 KiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 764 B/s rd, 0 op/s 2024-02-19T21:58:27.278 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:25.375871+0000 osd.4 (osd.4) 301 : cluster [DBG] 4.1 scrub starts 2024-02-19T21:58:27.278 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:25.379501+0000 osd.4 (osd.4) 302 : cluster [DBG] 4.1 scrub ok 2024-02-19T21:58:27.278 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:26.505792+0000 osd.5 (osd.5) 363 : cluster [DBG] 6.c starting backfill to osd.3 from (0'0,0'0] MAX to 66'1 2024-02-19T21:58:27.278 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:26.507632+0000 mon.a (mon.0) 2114 : cluster [DBG] osdmap e581: 8 total, 8 up, 8 in 2024-02-19T21:58:27.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:25.346733+0000 mgr.y (mgr.14514) 984 : cluster [DBG] pgmap v1278: 122 pgs: 122 active+clean; 5.7 KiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 764 B/s rd, 0 op/s 2024-02-19T21:58:27.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:25.375871+0000 osd.4 (osd.4) 301 : cluster [DBG] 4.1 scrub starts 2024-02-19T21:58:27.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:25.379501+0000 osd.4 (osd.4) 302 : cluster [DBG] 4.1 scrub ok 2024-02-19T21:58:27.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:26.505792+0000 osd.5 (osd.5) 363 : cluster [DBG] 6.c starting backfill to osd.3 from (0'0,0'0] MAX to 66'1 2024-02-19T21:58:27.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:26.507632+0000 mon.a (mon.0) 2114 : cluster [DBG] osdmap e581: 8 total, 8 up, 8 in 2024-02-19T21:58:27.891 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:58:28.795 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:27.347188+0000 mgr.y (mgr.14514) 985 : cluster [DBG] pgmap v1281: 122 pgs: 1 activating, 1 remapped+peering, 19 peering, 101 active+clean; 5.3 KiB data, 5.7 GiB used, 710 GiB / 715 GiB avail 2024-02-19T21:58:28.795 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:27.508603+0000 mon.a (mon.0) 2115 : cluster [DBG] osdmap e582: 8 total, 8 up, 8 in 2024-02-19T21:58:28.796 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:27.623382+0000 osd.2 (osd.2) 99 : cluster [DBG] 2.e scrub starts 2024-02-19T21:58:28.796 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:27.624177+0000 osd.2 (osd.2) 100 : cluster [DBG] 2.e scrub ok 2024-02-19T21:58:28.796 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:27.661099+0000 osd.7 (osd.7) 355 : cluster [DBG] 2.1c scrub starts 2024-02-19T21:58:28.796 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:27.664016+0000 osd.7 (osd.7) 356 : cluster [DBG] 2.1c scrub ok 2024-02-19T21:58:28.796 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:27.881135+0000 mon.a (mon.0) 2116 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-19T21:58:28.796 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:27.347188+0000 mgr.y (mgr.14514) 985 : cluster [DBG] pgmap v1281: 122 pgs: 1 activating, 1 remapped+peering, 19 peering, 101 active+clean; 5.3 KiB data, 5.7 GiB used, 710 GiB / 715 GiB avail 2024-02-19T21:58:28.796 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:27.508603+0000 mon.a (mon.0) 2115 : cluster [DBG] osdmap e582: 8 total, 8 up, 8 in 2024-02-19T21:58:28.796 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:27.623382+0000 osd.2 (osd.2) 99 : cluster [DBG] 2.e scrub starts 2024-02-19T21:58:28.796 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:27.624177+0000 osd.2 (osd.2) 100 : cluster [DBG] 2.e scrub ok 2024-02-19T21:58:28.796 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:27.661099+0000 osd.7 (osd.7) 355 : cluster [DBG] 2.1c scrub starts 2024-02-19T21:58:28.797 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:27.664016+0000 osd.7 (osd.7) 356 : cluster [DBG] 2.1c scrub ok 2024-02-19T21:58:28.797 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:27.881135+0000 mon.a (mon.0) 2116 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-19T21:58:28.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:27.347188+0000 mgr.y (mgr.14514) 985 : cluster [DBG] pgmap v1281: 122 pgs: 1 activating, 1 remapped+peering, 19 peering, 101 active+clean; 5.3 KiB data, 5.7 GiB used, 710 GiB / 715 GiB avail 2024-02-19T21:58:28.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:27.508603+0000 mon.a (mon.0) 2115 : cluster [DBG] osdmap e582: 8 total, 8 up, 8 in 2024-02-19T21:58:28.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:27.623382+0000 osd.2 (osd.2) 99 : cluster [DBG] 2.e scrub starts 2024-02-19T21:58:28.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:27.624177+0000 osd.2 (osd.2) 100 : cluster [DBG] 2.e scrub ok 2024-02-19T21:58:28.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:27.661099+0000 osd.7 (osd.7) 355 : cluster [DBG] 2.1c scrub starts 2024-02-19T21:58:28.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:27.664016+0000 osd.7 (osd.7) 356 : cluster [DBG] 2.1c scrub ok 2024-02-19T21:58:28.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:27.881135+0000 mon.a (mon.0) 2116 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-19T21:58:29.519 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:28.509659+0000 mon.a (mon.0) 2117 : cluster [DBG] osdmap e583: 8 total, 8 up, 8 in 2024-02-19T21:58:29.520 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:28.653845+0000 osd.1 (osd.1) 326 : cluster [DBG] 6.1 deep-scrub starts 2024-02-19T21:58:29.520 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:28.719376+0000 osd.1 (osd.1) 327 : cluster [DBG] 6.1 deep-scrub ok 2024-02-19T21:58:29.520 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:28.509659+0000 mon.a (mon.0) 2117 : cluster [DBG] osdmap e583: 8 total, 8 up, 8 in 2024-02-19T21:58:29.520 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:28.653845+0000 osd.1 (osd.1) 326 : cluster [DBG] 6.1 deep-scrub starts 2024-02-19T21:58:29.520 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:28.719376+0000 osd.1 (osd.1) 327 : cluster [DBG] 6.1 deep-scrub ok 2024-02-19T21:58:29.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:28.509659+0000 mon.a (mon.0) 2117 : cluster [DBG] osdmap e583: 8 total, 8 up, 8 in 2024-02-19T21:58:29.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:28.653845+0000 osd.1 (osd.1) 326 : cluster [DBG] 6.1 deep-scrub starts 2024-02-19T21:58:29.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:28.719376+0000 osd.1 (osd.1) 327 : cluster [DBG] 6.1 deep-scrub ok 2024-02-19T21:58:30.102 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:58:30.102 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-02-19T21:58:30.102 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-02-19T21:58:30.102 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-02-19T21:58:30.102 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:58:30.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:29.347573+0000 mgr.y (mgr.14514) 986 : cluster [DBG] pgmap v1284: 122 pgs: 1 activating, 1 remapped+peering, 19 peering, 101 active+clean; 5.3 KiB data, 5.7 GiB used, 710 GiB / 715 GiB avail 2024-02-19T21:58:30.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:30.501918+0000 mon.a (mon.0) 2118 : cluster [DBG] osdmap e584: 8 total, 8 up, 8 in 2024-02-19T21:58:30.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:29.347573+0000 mgr.y (mgr.14514) 986 : cluster [DBG] pgmap v1284: 122 pgs: 1 activating, 1 remapped+peering, 19 peering, 101 active+clean; 5.3 KiB data, 5.7 GiB used, 710 GiB / 715 GiB avail 2024-02-19T21:58:30.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:30.501918+0000 mon.a (mon.0) 2118 : cluster [DBG] osdmap e584: 8 total, 8 up, 8 in 2024-02-19T21:58:30.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:29.347573+0000 mgr.y (mgr.14514) 986 : cluster [DBG] pgmap v1284: 122 pgs: 1 activating, 1 remapped+peering, 19 peering, 101 active+clean; 5.3 KiB data, 5.7 GiB used, 710 GiB / 715 GiB avail 2024-02-19T21:58:30.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:30.501918+0000 mon.a (mon.0) 2118 : cluster [DBG] osdmap e584: 8 total, 8 up, 8 in 2024-02-19T21:58:31.095 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:58:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:58:30] "GET /metrics HTTP/1.1" 200 174232 "" "Prometheus/2.33.4" 2024-02-19T21:58:31.343 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph daemon osd.0 dump_historic_ops 2024-02-19T21:58:31.529 INFO:teuthology.orchestra.run.smithi080.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-02-19T21:58:31.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:29.695700+0000 osd.5 (osd.5) 364 : cluster [DBG] 6.7 deep-scrub starts 2024-02-19T21:58:31.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:29.820222+0000 osd.5 (osd.5) 365 : cluster [DBG] 6.7 deep-scrub ok 2024-02-19T21:58:31.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:30.857488+0000 osd.3 (osd.3) 291 : cluster [DBG] 6.11 scrub starts 2024-02-19T21:58:31.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:30.860411+0000 osd.3 (osd.3) 292 : cluster [DBG] 6.11 scrub ok 2024-02-19T21:58:31.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:30.980648+0000 mon.a (mon.0) 2119 : audit [INF] from='client.? 172.21.15.80:0/4000237248' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]: dispatch 2024-02-19T21:58:31.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:29.695700+0000 osd.5 (osd.5) 364 : cluster [DBG] 6.7 deep-scrub starts 2024-02-19T21:58:31.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:29.820222+0000 osd.5 (osd.5) 365 : cluster [DBG] 6.7 deep-scrub ok 2024-02-19T21:58:31.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:30.857488+0000 osd.3 (osd.3) 291 : cluster [DBG] 6.11 scrub starts 2024-02-19T21:58:31.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:30.860411+0000 osd.3 (osd.3) 292 : cluster [DBG] 6.11 scrub ok 2024-02-19T21:58:31.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:30.980648+0000 mon.a (mon.0) 2119 : audit [INF] from='client.? 172.21.15.80:0/4000237248' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]: dispatch 2024-02-19T21:58:31.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:58:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:58:31.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:29.695700+0000 osd.5 (osd.5) 364 : cluster [DBG] 6.7 deep-scrub starts 2024-02-19T21:58:31.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:29.820222+0000 osd.5 (osd.5) 365 : cluster [DBG] 6.7 deep-scrub ok 2024-02-19T21:58:31.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:30.857488+0000 osd.3 (osd.3) 291 : cluster [DBG] 6.11 scrub starts 2024-02-19T21:58:31.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:30.860411+0000 osd.3 (osd.3) 292 : cluster [DBG] 6.11 scrub ok 2024-02-19T21:58:31.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:30.980648+0000 mon.a (mon.0) 2119 : audit [INF] from='client.? 172.21.15.80:0/4000237248' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]: dispatch 2024-02-19T21:58:32.260 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:58:32.263 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd reweight 4 1 2024-02-19T21:58:32.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:30.679904+0000 osd.0 (osd.0) 21 : cluster [DBG] 5.3 scrub starts 2024-02-19T21:58:32.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:30.683372+0000 osd.0 (osd.0) 22 : cluster [DBG] 5.3 scrub ok 2024-02-19T21:58:32.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:31.348023+0000 mgr.y (mgr.14514) 987 : cluster [DBG] pgmap v1286: 122 pgs: 122 active+clean; 5.8 KiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 34 KiB/s rd, 1.0 KiB/s wr, 67 op/s; 550 B/s, 24 objects/s recovering 2024-02-19T21:58:32.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:31.497948+0000 mgr.y (mgr.14514) 988 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:58:32.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:31.521044+0000 mon.a (mon.0) 2120 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-19T21:58:32.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:31.521077+0000 mon.a (mon.0) 2121 : cluster [INF] Cluster is now healthy 2024-02-19T21:58:32.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:31.525124+0000 mon.a (mon.0) 2122 : audit [INF] from='client.? 172.21.15.80:0/4000237248' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]': finished 2024-02-19T21:58:32.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:31.525192+0000 mon.a (mon.0) 2123 : cluster [DBG] osdmap e585: 8 total, 8 up, 8 in 2024-02-19T21:58:32.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:30.679904+0000 osd.0 (osd.0) 21 : cluster [DBG] 5.3 scrub starts 2024-02-19T21:58:32.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:30.683372+0000 osd.0 (osd.0) 22 : cluster [DBG] 5.3 scrub ok 2024-02-19T21:58:32.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:31.348023+0000 mgr.y (mgr.14514) 987 : cluster [DBG] pgmap v1286: 122 pgs: 122 active+clean; 5.8 KiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 34 KiB/s rd, 1.0 KiB/s wr, 67 op/s; 550 B/s, 24 objects/s recovering 2024-02-19T21:58:32.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:31.497948+0000 mgr.y (mgr.14514) 988 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:58:32.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:31.521044+0000 mon.a (mon.0) 2120 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-19T21:58:32.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:31.521077+0000 mon.a (mon.0) 2121 : cluster [INF] Cluster is now healthy 2024-02-19T21:58:32.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:31.525124+0000 mon.a (mon.0) 2122 : audit [INF] from='client.? 172.21.15.80:0/4000237248' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]': finished 2024-02-19T21:58:32.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:31.525192+0000 mon.a (mon.0) 2123 : cluster [DBG] osdmap e585: 8 total, 8 up, 8 in 2024-02-19T21:58:32.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:30.679904+0000 osd.0 (osd.0) 21 : cluster [DBG] 5.3 scrub starts 2024-02-19T21:58:32.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:30.683372+0000 osd.0 (osd.0) 22 : cluster [DBG] 5.3 scrub ok 2024-02-19T21:58:32.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:31.348023+0000 mgr.y (mgr.14514) 987 : cluster [DBG] pgmap v1286: 122 pgs: 122 active+clean; 5.8 KiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 34 KiB/s rd, 1.0 KiB/s wr, 67 op/s; 550 B/s, 24 objects/s recovering 2024-02-19T21:58:32.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:31.497948+0000 mgr.y (mgr.14514) 988 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:58:32.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:31.521044+0000 mon.a (mon.0) 2120 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-19T21:58:32.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:31.521077+0000 mon.a (mon.0) 2121 : cluster [INF] Cluster is now healthy 2024-02-19T21:58:32.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:31.525124+0000 mon.a (mon.0) 2122 : audit [INF] from='client.? 172.21.15.80:0/4000237248' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]': finished 2024-02-19T21:58:32.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:31.525192+0000 mon.a (mon.0) 2123 : cluster [DBG] osdmap e585: 8 total, 8 up, 8 in 2024-02-19T21:58:33.014 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:58:33.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:32.894924+0000 osd.3 (osd.3) 293 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:58:33.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:32.896154+0000 osd.3 (osd.3) 294 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:58:33.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:32.894924+0000 osd.3 (osd.3) 293 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:58:33.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:32.896154+0000 osd.3 (osd.3) 294 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:58:33.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:32.894924+0000 osd.3 (osd.3) 293 : cluster [DBG] 2.1b scrub starts 2024-02-19T21:58:33.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:32.896154+0000 osd.3 (osd.3) 294 : cluster [DBG] 2.1b scrub ok 2024-02-19T21:58:34.322 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-19T21:58:34.322 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-02-19T21:58:34.322 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-02-19T21:58:34.323 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-02-19T21:58:34.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.323 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(osd.7.0:81456 2.8 e571/568 2:13f55879:::zone_info.34a855d6-dbbc-4802-a6e9-a7d60f23c9d4:head v 571'2, mlcod=0'0)", 2024-02-19T21:58:34.323 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:58:01.682913+0000", 2024-02-19T21:58:34.323 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 32.638908469, 2024-02-19T21:58:34.323 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041051899999999998, 2024-02-19T21:58:34.323 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:58:34.323 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-02-19T21:58:34.323 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:58:34.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.323 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:58:34.323 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:01.682913+0000", 2024-02-19T21:58:34.323 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:58:34.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.324 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:58:34.324 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:01.682913+0000", 2024-02-19T21:58:34.324 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:58:34.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.324 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:58:34.324 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:01.682912+0000", 2024-02-19T21:58:34.324 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4749999999999993e-06 2024-02-19T21:58:34.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.324 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:58:34.324 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:01.682920+0000", 2024-02-19T21:58:34.325 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3905e-05 2024-02-19T21:58:34.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.325 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:58:34.325 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:01.682934+0000", 2024-02-19T21:58:34.325 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5889999999999999e-06 2024-02-19T21:58:34.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.325 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:58:34.325 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:01.682941+0000", 2024-02-19T21:58:34.325 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3109999999999999e-05 2024-02-19T21:58:34.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.325 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:58:34.326 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:01.682984+0000", 2024-02-19T21:58:34.326 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0166e-05 2024-02-19T21:58:34.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.326 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:58:34.326 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:01.683004+0000", 2024-02-19T21:58:34.326 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00029053100000000001 2024-02-19T21:58:34.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.326 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-02-19T21:58:34.326 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:01.683294+0000", 2024-02-19T21:58:34.326 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8679000000000001e-05 2024-02-19T21:58:34.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.326 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:58:34.327 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:01.683323+0000", 2024-02-19T21:58:34.327 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041051899999999998 2024-02-19T21:58:34.327 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.327 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:58:34.327 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.327 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24317.0:3464 5.3 5:c609908c:::notify.5:head [watch reconnect cookie 94140601340416 gen 3] snapc 0=[] ondisk+write+known_if_redirected e571)", 2024-02-19T21:58:34.327 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:58:02.173208+0000", 2024-02-19T21:58:34.327 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 32.148612641, 2024-02-19T21:58:34.327 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010454380000000001, 2024-02-19T21:58:34.327 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:58:34.327 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:58:34.327 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:58:34.328 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24317", 2024-02-19T21:58:34.328 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3365055276", 2024-02-19T21:58:34.328 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 3464 2024-02-19T21:58:34.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.328 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:58:34.328 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.328 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:58:34.328 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:02.173208+0000", 2024-02-19T21:58:34.328 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:58:34.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.328 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.328 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:58:34.328 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:02.173208+0000", 2024-02-19T21:58:34.328 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999986 2024-02-19T21:58:34.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.329 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.329 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:58:34.329 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:02.173207+0000", 2024-02-19T21:58:34.329 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.925e-06 2024-02-19T21:58:34.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.329 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.329 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:58:34.329 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:02.173213+0000", 2024-02-19T21:58:34.329 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7130000000000005e-06 2024-02-19T21:58:34.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.329 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.329 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:58:34.329 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:02.173221+0000", 2024-02-19T21:58:34.330 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5959999999999998e-06 2024-02-19T21:58:34.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.330 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:58:34.330 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:02.173228+0000", 2024-02-19T21:58:34.330 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0822000000000002e-05 2024-02-19T21:58:34.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.330 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:58:34.330 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:02.173279+0000", 2024-02-19T21:58:34.330 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121476 2024-02-19T21:58:34.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.330 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:58:34.330 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:02.173401+0000", 2024-02-19T21:58:34.331 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00085332300000000002 2024-02-19T21:58:34.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.331 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.331 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:58:34.331 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:02.174254+0000", 2024-02-19T21:58:34.331 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010454380000000001 2024-02-19T21:58:34.331 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.331 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:58:34.331 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.331 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.331 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "pg_update_log_missing(5.0 epoch 571/568 rep_tid 208829 entries 571'11 (0'0) error 5:5bf5b680:::notify.1:head by client.24317.0:3461 0.000000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-02-19T21:58:34.331 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:58:02.173329+0000", 2024-02-19T21:58:34.331 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 32.148492398999998, 2024-02-19T21:58:34.331 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035750799999999998, 2024-02-19T21:58:34.332 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:58:34.332 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:58:34.332 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:58:34.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.332 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:58:34.332 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:02.173329+0000", 2024-02-19T21:58:34.332 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:58:34.332 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.332 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:58:34.332 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:02.173329+0000", 2024-02-19T21:58:34.332 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967296 2024-02-19T21:58:34.332 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.333 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:58:34.333 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:02.173328+0000", 2024-02-19T21:58:34.333 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4840000000000001e-06 2024-02-19T21:58:34.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.333 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.333 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:58:34.333 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:02.173335+0000", 2024-02-19T21:58:34.333 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6709999999999994e-06 2024-02-19T21:58:34.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.333 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.333 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:58:34.333 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:02.173345+0000", 2024-02-19T21:58:34.333 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8679999999999998e-06 2024-02-19T21:58:34.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.333 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.334 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:58:34.334 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:02.173349+0000", 2024-02-19T21:58:34.334 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7757999999999998e-05 2024-02-19T21:58:34.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.334 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.334 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:58:34.334 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:02.173407+0000", 2024-02-19T21:58:34.334 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027894200000000001 2024-02-19T21:58:34.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.334 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.334 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:58:34.334 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:02.173686+0000", 2024-02-19T21:58:34.334 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035750799999999998 2024-02-19T21:58:34.334 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.335 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:58:34.335 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.335 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.335 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.335 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "pg_update_log_missing(5.e epoch 571/568 rep_tid 90781 entries 571'14 (0'0) error 5:7759931f:::notify.3:head by client.24317.0:3462 0.000000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-02-19T21:58:34.335 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:58:02.173404+0000", 2024-02-19T21:58:34.335 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 32.148416683999997, 2024-02-19T21:58:34.335 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040127099999999997, 2024-02-19T21:58:34.335 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:58:34.335 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:58:34.335 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:58:34.335 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.335 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:58:34.336 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:02.173404+0000", 2024-02-19T21:58:34.336 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:58:34.336 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.336 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.336 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:58:34.336 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:02.173404+0000", 2024-02-19T21:58:34.336 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:58:34.336 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.336 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.336 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:58:34.336 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:02.173404+0000", 2024-02-19T21:58:34.336 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2089999999999999e-06 2024-02-19T21:58:34.336 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.337 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.337 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:58:34.337 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:02.173411+0000", 2024-02-19T21:58:34.337 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5148e-05 2024-02-19T21:58:34.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.337 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.337 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:58:34.337 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:02.173426+0000", 2024-02-19T21:58:34.337 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5400000000000001e-06 2024-02-19T21:58:34.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.337 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.337 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:58:34.337 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:02.173436+0000", 2024-02-19T21:58:34.337 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6249999999999999e-05 2024-02-19T21:58:34.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.338 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.338 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:58:34.338 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:02.173482+0000", 2024-02-19T21:58:34.338 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032342999999999998 2024-02-19T21:58:34.338 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.338 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.338 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:58:34.338 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:02.173806+0000", 2024-02-19T21:58:34.338 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040127099999999997 2024-02-19T21:58:34.338 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.338 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:58:34.338 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.338 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.338 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.339 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "replica_scrub(pg: 5.7,from:0'0,to:0'0,epoch:571/568,start:5:e0000000::::0,end:MAX,chunky:1,deep:0,version:9,allow_preemption:1,priority=5)", 2024-02-19T21:58:34.339 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:58:04.588542+0000", 2024-02-19T21:58:34.339 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.733279074999999, 2024-02-19T21:58:34.339 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011108190000000001, 2024-02-19T21:58:34.339 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:58:34.339 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:58:34.339 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:58:34.339 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.339 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:58:34.339 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:04.588542+0000", 2024-02-19T21:58:34.339 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:58:34.339 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.339 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.339 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:58:34.339 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:04.588542+0000", 2024-02-19T21:58:34.340 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:58:34.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.340 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:58:34.340 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:04.588541+0000", 2024-02-19T21:58:34.340 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4320000000000002e-06 2024-02-19T21:58:34.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.340 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:58:34.340 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:04.588548+0000", 2024-02-19T21:58:34.340 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.694e-05 2024-02-19T21:58:34.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.340 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:58:34.341 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:04.588565+0000", 2024-02-19T21:58:34.341 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7579999999999992e-06 2024-02-19T21:58:34.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.341 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.341 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:58:34.341 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:04.588573+0000", 2024-02-19T21:58:34.341 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010545870000000001 2024-02-19T21:58:34.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.341 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.341 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:58:34.341 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:04.589628+0000", 2024-02-19T21:58:34.341 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4139999999999999e-06 2024-02-19T21:58:34.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.341 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.341 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:58:34.342 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:04.589634+0000", 2024-02-19T21:58:34.342 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8668000000000002e-05 2024-02-19T21:58:34.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.342 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.342 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:58:34.342 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:04.589653+0000", 2024-02-19T21:58:34.342 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011108190000000001 2024-02-19T21:58:34.342 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.342 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:58:34.342 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.342 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.342 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24317.0:3465 5.3 5:c609908c:::notify.5:head [watch ping cookie 94140601340416 gen 3] snapc 0=[] ondisk+write+known_if_redirected e571)", 2024-02-19T21:58:34.342 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:58:07.173256+0000", 2024-02-19T21:58:34.342 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 27.148565378000001, 2024-02-19T21:58:34.343 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034373100000000001, 2024-02-19T21:58:34.343 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:58:34.343 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:58:34.343 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:58:34.343 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24317", 2024-02-19T21:58:34.343 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3365055276", 2024-02-19T21:58:34.343 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 3465 2024-02-19T21:58:34.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.343 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:58:34.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.343 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:58:34.343 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:07.173256+0000", 2024-02-19T21:58:34.343 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:58:34.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.344 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:58:34.344 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:07.173256+0000", 2024-02-19T21:58:34.344 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999976 2024-02-19T21:58:34.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.344 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.344 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:58:34.344 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:07.173253+0000", 2024-02-19T21:58:34.344 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2487999999999999e-05 2024-02-19T21:58:34.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.344 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.344 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:58:34.344 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:07.173276+0000", 2024-02-19T21:58:34.344 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8131e-05 2024-02-19T21:58:34.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.345 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.345 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:58:34.345 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:07.173294+0000", 2024-02-19T21:58:34.345 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9990000000000003e-06 2024-02-19T21:58:34.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.345 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.345 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:58:34.345 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:07.173304+0000", 2024-02-19T21:58:34.345 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000110449 2024-02-19T21:58:34.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.345 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.345 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:58:34.345 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:07.173414+0000", 2024-02-19T21:58:34.345 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7438e-05 2024-02-19T21:58:34.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.346 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:58:34.346 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:07.173492+0000", 2024-02-19T21:58:34.346 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000107636 2024-02-19T21:58:34.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.346 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:58:34.346 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:07.173599+0000", 2024-02-19T21:58:34.346 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034373100000000001 2024-02-19T21:58:34.346 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.346 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:58:34.346 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.347 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.347 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24317.0:3483 5.3 5:c609908c:::notify.5:head [watch ping cookie 94140601340416 gen 3] snapc 0=[] ondisk+write+known_if_redirected e574)", 2024-02-19T21:58:34.347 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:58:17.175202+0000", 2024-02-19T21:58:34.347 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 17.146619451999999, 2024-02-19T21:58:34.347 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00052978400000000005, 2024-02-19T21:58:34.347 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:58:34.347 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:58:34.347 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:58:34.347 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24317", 2024-02-19T21:58:34.347 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3365055276", 2024-02-19T21:58:34.347 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 3483 2024-02-19T21:58:34.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.347 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:58:34.347 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.347 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:58:34.348 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:17.175202+0000", 2024-02-19T21:58:34.348 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:58:34.348 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.348 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.348 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:58:34.348 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:17.175202+0000", 2024-02-19T21:58:34.348 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999976 2024-02-19T21:58:34.348 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.348 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.348 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:58:34.348 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:17.175199+0000", 2024-02-19T21:58:34.348 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2665e-05 2024-02-19T21:58:34.348 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.348 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.349 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:58:34.349 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:17.175212+0000", 2024-02-19T21:58:34.349 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6962999999999999e-05 2024-02-19T21:58:34.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.349 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:58:34.349 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:17.175239+0000", 2024-02-19T21:58:34.349 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0006e-05 2024-02-19T21:58:34.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.349 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:58:34.349 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:17.175249+0000", 2024-02-19T21:58:34.349 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000282866 2024-02-19T21:58:34.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.350 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:58:34.350 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:17.175532+0000", 2024-02-19T21:58:34.350 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000103218 2024-02-19T21:58:34.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.355 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:58:34.355 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:17.175635+0000", 2024-02-19T21:58:34.355 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6527000000000006e-05 2024-02-19T21:58:34.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.356 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.356 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:58:34.356 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:17.175731+0000", 2024-02-19T21:58:34.356 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00052978400000000005 2024-02-19T21:58:34.356 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.356 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:58:34.357 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.357 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "MOSDScrubReserve(2.10 REQUEST e578)", 2024-02-19T21:58:34.357 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:58:20.569878+0000", 2024-02-19T21:58:34.357 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 13.751943009, 2024-02-19T21:58:34.358 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013889130000000001, 2024-02-19T21:58:34.358 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:58:34.358 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:58:34.358 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:58:34.358 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.359 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:58:34.359 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:20.569878+0000", 2024-02-19T21:58:34.359 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:58:34.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.359 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.359 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:58:34.359 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:20.569878+0000", 2024-02-19T21:58:34.360 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967296 2024-02-19T21:58:34.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.360 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.360 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:58:34.360 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:20.569878+0000", 2024-02-19T21:58:34.360 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.988e-06 2024-02-19T21:58:34.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.361 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.361 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:58:34.361 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:20.569881+0000", 2024-02-19T21:58:34.361 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1674999999999999e-05 2024-02-19T21:58:34.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.361 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.361 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:58:34.362 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:20.569893+0000", 2024-02-19T21:58:34.362 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1186999999999999e-05 2024-02-19T21:58:34.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.362 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.362 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:58:34.362 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:20.569914+0000", 2024-02-19T21:58:34.362 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0051e-05 2024-02-19T21:58:34.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.363 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.363 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:58:34.363 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:20.569954+0000", 2024-02-19T21:58:34.363 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0599999999999998e-06 2024-02-19T21:58:34.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.364 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-02-19T21:58:34.364 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:20.569959+0000", 2024-02-19T21:58:34.364 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012608610000000001 2024-02-19T21:58:34.364 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.364 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:58:34.365 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:20.571220+0000", 2024-02-19T21:58:34.365 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.347e-05 2024-02-19T21:58:34.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.365 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:58:34.365 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:20.571233+0000", 2024-02-19T21:58:34.365 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3784e-05 2024-02-19T21:58:34.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.366 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:58:34.366 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:20.571267+0000", 2024-02-19T21:58:34.366 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013889130000000001 2024-02-19T21:58:34.366 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.366 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:58:34.366 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.367 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.367 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.367 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24317.0:3492 5.3 5:c609908c:::notify.5:head [watch ping cookie 94140601340416 gen 3] snapc 0=[] ondisk+write+known_if_redirected e576)", 2024-02-19T21:58:34.367 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:58:22.176260+0000", 2024-02-19T21:58:34.367 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 12.145561008, 2024-02-19T21:58:34.367 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035763199999999998, 2024-02-19T21:58:34.367 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:58:34.367 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:58:34.368 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:58:34.368 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24317", 2024-02-19T21:58:34.368 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3365055276", 2024-02-19T21:58:34.368 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 3492 2024-02-19T21:58:34.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.368 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:58:34.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.369 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:58:34.369 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:22.176260+0000", 2024-02-19T21:58:34.369 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:58:34.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.369 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:58:34.369 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:22.176260+0000", 2024-02-19T21:58:34.370 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999971 2024-02-19T21:58:34.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.370 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:58:34.370 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:22.176257+0000", 2024-02-19T21:58:34.370 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4918e-05 2024-02-19T21:58:34.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.370 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:58:34.370 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:22.176272+0000", 2024-02-19T21:58:34.370 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2371999999999999e-05 2024-02-19T21:58:34.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.371 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:58:34.371 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:22.176294+0000", 2024-02-19T21:58:34.371 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3130000000000004e-06 2024-02-19T21:58:34.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.371 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:58:34.371 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:22.176304+0000", 2024-02-19T21:58:34.371 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116124 2024-02-19T21:58:34.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:58:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:22.176420+0000", 2024-02-19T21:58:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5920000000000004e-05 2024-02-19T21:58:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:58:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:22.176506+0000", 2024-02-19T21:58:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000111885 2024-02-19T21:58:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:58:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:22.176618+0000", 2024-02-19T21:58:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035763199999999998 2024-02-19T21:58:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:58:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop_reply(osd.0.0:1 4.1e e578/568 ondisk, result = 0)", 2024-02-19T21:58:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:58:23.584261+0000", 2024-02-19T21:58:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.737560468, 2024-02-19T21:58:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00078532799999999996, 2024-02-19T21:58:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:58:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:58:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:58:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:58:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584261+0000", 2024-02-19T21:58:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:58:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:58:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584261+0000", 2024-02-19T21:58:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:58:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:58:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584260+0000", 2024-02-19T21:58:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4819999999999996e-06 2024-02-19T21:58:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:58:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584265+0000", 2024-02-19T21:58:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.721e-06 2024-02-19T21:58:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:58:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584273+0000", 2024-02-19T21:58:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.369e-06 2024-02-19T21:58:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:58:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584278+0000", 2024-02-19T21:58:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00075264799999999997 2024-02-19T21:58:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:58:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585030+0000", 2024-02-19T21:58:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3059999999999997e-06 2024-02-19T21:58:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.376 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:58:34.376 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585036+0000", 2024-02-19T21:58:34.376 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0322999999999999e-05 2024-02-19T21:58:34.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.376 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:58:34.376 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585046+0000", 2024-02-19T21:58:34.377 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00078532799999999996 2024-02-19T21:58:34.377 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.377 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:58:34.377 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.377 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop_reply(osd.0.0:1 4.1e e578/568 ondisk, result = 0)", 2024-02-19T21:58:34.377 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:58:23.584372+0000", 2024-02-19T21:58:34.377 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.737449148, 2024-02-19T21:58:34.377 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00082328999999999996, 2024-02-19T21:58:34.377 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:58:34.377 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:58:34.377 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:58:34.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.378 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:58:34.378 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584372+0000", 2024-02-19T21:58:34.378 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:58:34.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.378 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:58:34.378 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584372+0000", 2024-02-19T21:58:34.378 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:58:34.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.378 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:58:34.378 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584371+0000", 2024-02-19T21:58:34.378 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.759e-06 2024-02-19T21:58:34.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:58:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584378+0000", 2024-02-19T21:58:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3780000000000001e-06 2024-02-19T21:58:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:58:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584386+0000", 2024-02-19T21:58:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8260000000000004e-06 2024-02-19T21:58:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:58:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584393+0000", 2024-02-19T21:58:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00068808400000000005 2024-02-19T21:58:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:58:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585081+0000", 2024-02-19T21:58:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6399999999999997e-06 2024-02-19T21:58:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:58:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585089+0000", 2024-02-19T21:58:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010634299999999999 2024-02-19T21:58:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:58:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585195+0000", 2024-02-19T21:58:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00082328999999999996 2024-02-19T21:58:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:58:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop_reply(osd.0.0:2 4.1e e578/568 ondisk, result = 0)", 2024-02-19T21:58:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:58:23.584568+0000", 2024-02-19T21:58:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.737253424, 2024-02-19T21:58:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00067466599999999998, 2024-02-19T21:58:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:58:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:58:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:58:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:58:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584568+0000", 2024-02-19T21:58:34.382 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:58:34.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.382 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:58:34.382 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584568+0000", 2024-02-19T21:58:34.382 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:58:34.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.382 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:58:34.382 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584567+0000", 2024-02-19T21:58:34.382 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3610000000000003e-06 2024-02-19T21:58:34.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.382 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:58:34.383 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584571+0000", 2024-02-19T21:58:34.383 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1189999999999997e-06 2024-02-19T21:58:34.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.383 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:58:34.383 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584579+0000", 2024-02-19T21:58:34.383 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3509999999999998e-06 2024-02-19T21:58:34.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.383 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:58:34.383 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584586+0000", 2024-02-19T21:58:34.383 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064569200000000001 2024-02-19T21:58:34.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.384 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:58:34.384 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585231+0000", 2024-02-19T21:58:34.384 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5700000000000003e-06 2024-02-19T21:58:34.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.384 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:58:34.384 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585236+0000", 2024-02-19T21:58:34.384 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2600000000000002e-06 2024-02-19T21:58:34.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.384 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:58:34.384 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585242+0000", 2024-02-19T21:58:34.384 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00067466599999999998 2024-02-19T21:58:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:58:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop_reply(osd.0.0:3 4.1e e578/568 ondisk, result = 0)", 2024-02-19T21:58:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:58:23.584797+0000", 2024-02-19T21:58:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.737023733000001, 2024-02-19T21:58:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00049502699999999999, 2024-02-19T21:58:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:58:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:58:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:58:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:58:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584797+0000", 2024-02-19T21:58:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:58:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:58:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584797+0000", 2024-02-19T21:58:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:58:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:58:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584797+0000", 2024-02-19T21:58:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8709999999999999e-06 2024-02-19T21:58:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:58:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584801+0000", 2024-02-19T21:58:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9500000000000004e-06 2024-02-19T21:58:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:58:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584808+0000", 2024-02-19T21:58:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.535e-06 2024-02-19T21:58:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:58:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584811+0000", 2024-02-19T21:58:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045756300000000002 2024-02-19T21:58:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.388 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:58:34.388 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585269+0000", 2024-02-19T21:58:34.388 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0290000000000002e-06 2024-02-19T21:58:34.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.388 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:58:34.388 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585275+0000", 2024-02-19T21:58:34.388 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7601999999999999e-05 2024-02-19T21:58:34.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.388 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:58:34.388 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585292+0000", 2024-02-19T21:58:34.388 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00049502699999999999 2024-02-19T21:58:34.388 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.389 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:58:34.389 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.389 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop_reply(osd.0.0:4 4.1e e578/568 ondisk, result = 0)", 2024-02-19T21:58:34.389 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:58:23.584901+0000", 2024-02-19T21:58:34.389 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.736920125999999, 2024-02-19T21:58:34.389 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00049333799999999996, 2024-02-19T21:58:34.389 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:58:34.389 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:58:34.389 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:58:34.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.389 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:58:34.389 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584901+0000", 2024-02-19T21:58:34.389 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:58:34.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.390 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:58:34.390 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584901+0000", 2024-02-19T21:58:34.390 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:58:34.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.390 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:58:34.390 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584901+0000", 2024-02-19T21:58:34.390 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.277e-06 2024-02-19T21:58:34.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.390 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:58:34.390 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584903+0000", 2024-02-19T21:58:34.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6980000000000003e-06 2024-02-19T21:58:34.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:58:34.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584909+0000", 2024-02-19T21:58:34.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7130000000000001e-06 2024-02-19T21:58:34.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:58:34.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.584911+0000", 2024-02-19T21:58:34.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00046295100000000002 2024-02-19T21:58:34.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:58:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585374+0000", 2024-02-19T21:58:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6810000000000004e-06 2024-02-19T21:58:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:58:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585383+0000", 2024-02-19T21:58:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1308000000000001e-05 2024-02-19T21:58:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:58:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585394+0000", 2024-02-19T21:58:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00049333799999999996 2024-02-19T21:58:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:58:34.393 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.393 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop_reply(osd.0.0:3 4.1e e578/568 ondisk, result = 0)", 2024-02-19T21:58:34.393 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:58:23.585079+0000", 2024-02-19T21:58:34.393 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.73674243, 2024-02-19T21:58:34.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041410999999999998, 2024-02-19T21:58:34.393 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:58:34.393 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:58:34.393 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:58:34.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:58:34.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585079+0000", 2024-02-19T21:58:34.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:58:34.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:58:34.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585079+0000", 2024-02-19T21:58:34.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:58:34.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:58:34.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585078+0000", 2024-02-19T21:58:34.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0729999999999999e-06 2024-02-19T21:58:34.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:58:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585080+0000", 2024-02-19T21:58:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0419999999999999e-06 2024-02-19T21:58:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:58:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585086+0000", 2024-02-19T21:58:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.642e-06 2024-02-19T21:58:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:58:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585090+0000", 2024-02-19T21:58:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00033418199999999998 2024-02-19T21:58:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:58:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585424+0000", 2024-02-19T21:58:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2710000000000003e-06 2024-02-19T21:58:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:58:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585432+0000", 2024-02-19T21:58:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1189e-05 2024-02-19T21:58:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:58:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585493+0000", 2024-02-19T21:58:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041410999999999998 2024-02-19T21:58:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:58:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop_reply(osd.0.0:5 4.1e e578/568 ondisk, result = 0)", 2024-02-19T21:58:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:58:23.585134+0000", 2024-02-19T21:58:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.736687094000001, 2024-02-19T21:58:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041504900000000002, 2024-02-19T21:58:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:58:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:58:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:58:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:58:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585134+0000", 2024-02-19T21:58:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:58:34.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.398 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:58:34.398 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585134+0000", 2024-02-19T21:58:34.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:58:34.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.398 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:58:34.398 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585133+0000", 2024-02-19T21:58:34.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1140000000000002e-06 2024-02-19T21:58:34.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.398 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:58:34.398 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585139+0000", 2024-02-19T21:58:34.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0779999999999996e-06 2024-02-19T21:58:34.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:58:34.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585147+0000", 2024-02-19T21:58:34.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8709999999999997e-06 2024-02-19T21:58:34.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:58:34.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585155+0000", 2024-02-19T21:58:34.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000373963 2024-02-19T21:58:34.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:58:34.400 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585529+0000", 2024-02-19T21:58:34.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7579999999999998e-06 2024-02-19T21:58:34.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.400 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:58:34.400 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585538+0000", 2024-02-19T21:58:34.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1117999999999999e-05 2024-02-19T21:58:34.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.400 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:58:34.400 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:23.585549+0000", 2024-02-19T21:58:34.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041504900000000002 2024-02-19T21:58:34.400 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.400 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:58:34.401 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.401 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "MOSDPGPushReply(4.1e 580/579 [PushReplyOp(4:7a5c7c5f:::obj_delete_at_hint.0000000049:head)])", 2024-02-19T21:58:34.401 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:58:25.612331+0000", 2024-02-19T21:58:34.401 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 8.7094896790000007, 2024-02-19T21:58:34.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00033280000000000001, 2024-02-19T21:58:34.401 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:58:34.401 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:58:34.401 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:58:34.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:58:34.401 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:25.612331+0000", 2024-02-19T21:58:34.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:58:34.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:58:34.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:25.612331+0000", 2024-02-19T21:58:34.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.999999 2024-02-19T21:58:34.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:58:34.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:25.612330+0000", 2024-02-19T21:58:34.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0129999999999999e-06 2024-02-19T21:58:34.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:58:34.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:25.612339+0000", 2024-02-19T21:58:34.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6946e-05 2024-02-19T21:58:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:58:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:25.612356+0000", 2024-02-19T21:58:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6320000000000008e-06 2024-02-19T21:58:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:58:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:25.612364+0000", 2024-02-19T21:58:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1248000000000006e-05 2024-02-19T21:58:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:58:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:25.612435+0000", 2024-02-19T21:58:34.404 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000229058 2024-02-19T21:58:34.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.404 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:58:34.404 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:25.612664+0000", 2024-02-19T21:58:34.404 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00033280000000000001 2024-02-19T21:58:34.404 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.404 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:58:34.404 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.404 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "MOSDPGPushReply(4.1e 580/579 [PushReplyOp(4:7db93595:::obj_delete_at_hint.0000000066:head)])", 2024-02-19T21:58:34.404 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:58:25.623775+0000", 2024-02-19T21:58:34.404 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 8.698046368, 2024-02-19T21:58:34.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035051199999999998, 2024-02-19T21:58:34.405 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:58:34.405 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-02-19T21:58:34.405 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:58:34.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.405 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:58:34.405 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:25.623775+0000", 2024-02-19T21:58:34.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:58:34.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.405 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:58:34.405 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:25.623775+0000", 2024-02-19T21:58:34.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999995 2024-02-19T21:58:34.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.406 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:58:34.406 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:25.623774+0000", 2024-02-19T21:58:34.406 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2089999999999999e-06 2024-02-19T21:58:34.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.406 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:58:34.406 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:25.623778+0000", 2024-02-19T21:58:34.406 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0628999999999999e-05 2024-02-19T21:58:34.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.406 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:58:34.406 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:25.623789+0000", 2024-02-19T21:58:34.406 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8699999999999997e-06 2024-02-19T21:58:34.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.407 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:58:34.407 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:25.623795+0000", 2024-02-19T21:58:34.407 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6725999999999996e-05 2024-02-19T21:58:34.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.407 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:58:34.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:25.623882+0000", 2024-02-19T21:58:34.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000243522 2024-02-19T21:58:34.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.408 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:58:34.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:25.624125+0000", 2024-02-19T21:58:34.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035051199999999998 2024-02-19T21:58:34.408 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.409 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:58:34.409 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.409 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24317.0:3501 5.3 5:c609908c:::notify.5:head [watch ping cookie 94140601340416 gen 3] snapc 0=[] ondisk+write+known_if_redirected e578)", 2024-02-19T21:58:34.409 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:58:27.177266+0000", 2024-02-19T21:58:34.409 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 7.1445548949999997, 2024-02-19T21:58:34.409 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035997500000000001, 2024-02-19T21:58:34.409 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:58:34.410 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:58:34.410 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:58:34.410 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24317", 2024-02-19T21:58:34.410 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3365055276", 2024-02-19T21:58:34.410 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 3501 2024-02-19T21:58:34.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.410 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:58:34.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.411 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:58:34.411 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:27.177266+0000", 2024-02-19T21:58:34.411 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:58:34.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.411 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:58:34.411 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:27.177266+0000", 2024-02-19T21:58:34.411 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999967 2024-02-19T21:58:34.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.412 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:58:34.412 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:27.177263+0000", 2024-02-19T21:58:34.412 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5583999999999999e-05 2024-02-19T21:58:34.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.412 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:58:34.413 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:27.177278+0000", 2024-02-19T21:58:34.415 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9612e-05 2024-02-19T21:58:34.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.415 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:58:34.415 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:27.177308+0000", 2024-02-19T21:58:34.415 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0162e-05 2024-02-19T21:58:34.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:58:34.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:27.177318+0000", 2024-02-19T21:58:34.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101234 2024-02-19T21:58:34.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:58:34.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:27.177419+0000", 2024-02-19T21:58:34.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6410999999999996e-05 2024-02-19T21:58:34.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:58:34.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:27.177516+0000", 2024-02-19T21:58:34.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000110257 2024-02-19T21:58:34.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.418 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:58:34.418 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:27.177626+0000", 2024-02-19T21:58:34.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035997500000000001 2024-02-19T21:58:34.418 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.418 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:58:34.418 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.418 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.24317.0:3513 5.3 5:c609908c:::notify.5:head [watch ping cookie 94140601340416 gen 3] snapc 0=[] ondisk+write+known_if_redirected e581)", 2024-02-19T21:58:34.418 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-02-19T21:58:32.177505+0000", 2024-02-19T21:58:34.418 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 2.144315813, 2024-02-19T21:58:34.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060466299999999997, 2024-02-19T21:58:34.418 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-02-19T21:58:34.419 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-02-19T21:58:34.419 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-02-19T21:58:34.419 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.24317", 2024-02-19T21:58:34.419 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3365055276", 2024-02-19T21:58:34.419 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 3513 2024-02-19T21:58:34.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.419 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-02-19T21:58:34.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-02-19T21:58:34.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:32.177505+0000", 2024-02-19T21:58:34.420 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-02-19T21:58:34.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-02-19T21:58:34.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:32.177505+0000", 2024-02-19T21:58:34.420 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4294967295.9999971 2024-02-19T21:58:34.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-02-19T21:58:34.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:32.177503+0000", 2024-02-19T21:58:34.420 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.303e-06 2024-02-19T21:58:34.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.421 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-02-19T21:58:34.421 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:32.177511+0000", 2024-02-19T21:58:34.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6322999999999999e-05 2024-02-19T21:58:34.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.421 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-02-19T21:58:34.421 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:32.177527+0000", 2024-02-19T21:58:34.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6879999999999999e-06 2024-02-19T21:58:34.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.421 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-02-19T21:58:34.421 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:32.177535+0000", 2024-02-19T21:58:34.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000417565 2024-02-19T21:58:34.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.422 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-02-19T21:58:34.422 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:32.177952+0000", 2024-02-19T21:58:34.422 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4554000000000004e-05 2024-02-19T21:58:34.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.422 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.422 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-02-19T21:58:34.422 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:32.178037+0000", 2024-02-19T21:58:34.422 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2923999999999995e-05 2024-02-19T21:58:34.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-02-19T21:58:34.422 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-02-19T21:58:34.422 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-02-19T21:58:34.422 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-02-19T21:58:32.178110+0000", 2024-02-19T21:58:34.422 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060466299999999997 2024-02-19T21:58:34.422 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.422 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:58:34.423 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.423 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-02-19T21:58:34.423 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-02-19T21:58:34.423 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-19T21:58:34.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:33.348459+0000 mgr.y (mgr.14514) 989 : cluster [DBG] pgmap v1288: 122 pgs: 122 active+clean; 5.8 KiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 29 KiB/s rd, 876 B/s wr, 56 op/s; 419 B/s, 17 objects/s recovering 2024-02-19T21:58:34.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:33.348459+0000 mgr.y (mgr.14514) 989 : cluster [DBG] pgmap v1288: 122 pgs: 122 active+clean; 5.8 KiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 29 KiB/s rd, 876 B/s wr, 56 op/s; 419 B/s, 17 objects/s recovering 2024-02-19T21:58:34.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:33.348459+0000 mgr.y (mgr.14514) 989 : cluster [DBG] pgmap v1288: 122 pgs: 122 active+clean; 5.8 KiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 29 KiB/s rd, 876 B/s wr, 56 op/s; 419 B/s, 17 objects/s recovering 2024-02-19T21:58:36.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:58:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:58:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:58:36.501 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:35.348988+0000 mgr.y (mgr.14514) 990 : cluster [DBG] pgmap v1289: 122 pgs: 122 active+clean; 5.8 KiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 24 KiB/s rd, 748 B/s wr, 47 op/s; 357 B/s, 14 objects/s recovering 2024-02-19T21:58:36.501 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:35.500839+0000 mon.a (mon.0) 2124 : cluster [DBG] osdmap e586: 8 total, 8 up, 8 in 2024-02-19T21:58:36.501 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:35.650435+0000 osd.1 (osd.1) 328 : cluster [DBG] 3.0 scrub starts 2024-02-19T21:58:36.501 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:35.654165+0000 osd.1 (osd.1) 329 : cluster [DBG] 3.0 scrub ok 2024-02-19T21:58:36.501 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:35.348988+0000 mgr.y (mgr.14514) 990 : cluster [DBG] pgmap v1289: 122 pgs: 122 active+clean; 5.8 KiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 24 KiB/s rd, 748 B/s wr, 47 op/s; 357 B/s, 14 objects/s recovering 2024-02-19T21:58:36.501 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:35.500839+0000 mon.a (mon.0) 2124 : cluster [DBG] osdmap e586: 8 total, 8 up, 8 in 2024-02-19T21:58:36.501 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:35.650435+0000 osd.1 (osd.1) 328 : cluster [DBG] 3.0 scrub starts 2024-02-19T21:58:36.501 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:35.654165+0000 osd.1 (osd.1) 329 : cluster [DBG] 3.0 scrub ok 2024-02-19T21:58:36.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:35.348988+0000 mgr.y (mgr.14514) 990 : cluster [DBG] pgmap v1289: 122 pgs: 122 active+clean; 5.8 KiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 24 KiB/s rd, 748 B/s wr, 47 op/s; 357 B/s, 14 objects/s recovering 2024-02-19T21:58:36.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:35.500839+0000 mon.a (mon.0) 2124 : cluster [DBG] osdmap e586: 8 total, 8 up, 8 in 2024-02-19T21:58:36.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:35.650435+0000 osd.1 (osd.1) 328 : cluster [DBG] 3.0 scrub starts 2024-02-19T21:58:36.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:35.654165+0000 osd.1 (osd.1) 329 : cluster [DBG] 3.0 scrub ok 2024-02-19T21:58:37.509 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.4 to 1 (10000) 2024-02-19T21:58:37.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:35.591002+0000 osd.0 (osd.0) 23 : cluster [DBG] 6.0 scrub starts 2024-02-19T21:58:37.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:35.593904+0000 osd.0 (osd.0) 24 : cluster [DBG] 6.0 scrub ok 2024-02-19T21:58:37.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:36.591745+0000 mon.a (mon.0) 2125 : audit [INF] from='client.? 172.21.15.80:0/1689583161' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-02-19T21:58:37.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:35.591002+0000 osd.0 (osd.0) 23 : cluster [DBG] 6.0 scrub starts 2024-02-19T21:58:37.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:35.593904+0000 osd.0 (osd.0) 24 : cluster [DBG] 6.0 scrub ok 2024-02-19T21:58:37.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:36.591745+0000 mon.a (mon.0) 2125 : audit [INF] from='client.? 172.21.15.80:0/1689583161' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-02-19T21:58:37.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:35.591002+0000 osd.0 (osd.0) 23 : cluster [DBG] 6.0 scrub starts 2024-02-19T21:58:37.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:35.593904+0000 osd.0 (osd.0) 24 : cluster [DBG] 6.0 scrub ok 2024-02-19T21:58:37.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:36.591745+0000 mon.a (mon.0) 2125 : audit [INF] from='client.? 172.21.15.80:0/1689583161' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-02-19T21:58:38.350 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd primary-affinity 4 1 2024-02-19T21:58:38.595 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:36.593602+0000 osd.0 (osd.0) 25 : cluster [DBG] 4.3 scrub starts 2024-02-19T21:58:38.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:36.597265+0000 osd.0 (osd.0) 26 : cluster [DBG] 4.3 scrub ok 2024-02-19T21:58:38.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:37.349451+0000 mgr.y (mgr.14514) 991 : cluster [DBG] pgmap v1291: 122 pgs: 122 active+clean; 5.8 KiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 747 B/s rd, 0 op/s 2024-02-19T21:58:38.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:37.506141+0000 mon.a (mon.0) 2126 : audit [INF] from='client.? 172.21.15.80:0/1689583161' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-02-19T21:58:38.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:37.506251+0000 mon.a (mon.0) 2127 : cluster [DBG] osdmap e587: 8 total, 8 up, 8 in 2024-02-19T21:58:38.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:36.593602+0000 osd.0 (osd.0) 25 : cluster [DBG] 4.3 scrub starts 2024-02-19T21:58:38.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:36.597265+0000 osd.0 (osd.0) 26 : cluster [DBG] 4.3 scrub ok 2024-02-19T21:58:38.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:37.349451+0000 mgr.y (mgr.14514) 991 : cluster [DBG] pgmap v1291: 122 pgs: 122 active+clean; 5.8 KiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 747 B/s rd, 0 op/s 2024-02-19T21:58:38.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:37.506141+0000 mon.a (mon.0) 2126 : audit [INF] from='client.? 172.21.15.80:0/1689583161' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-02-19T21:58:38.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:37.506251+0000 mon.a (mon.0) 2127 : cluster [DBG] osdmap e587: 8 total, 8 up, 8 in 2024-02-19T21:58:38.629 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:58:38.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:36.593602+0000 osd.0 (osd.0) 25 : cluster [DBG] 4.3 scrub starts 2024-02-19T21:58:38.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:36.597265+0000 osd.0 (osd.0) 26 : cluster [DBG] 4.3 scrub ok 2024-02-19T21:58:38.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:37.349451+0000 mgr.y (mgr.14514) 991 : cluster [DBG] pgmap v1291: 122 pgs: 122 active+clean; 5.8 KiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 747 B/s rd, 0 op/s 2024-02-19T21:58:38.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:37.506141+0000 mon.a (mon.0) 2126 : audit [INF] from='client.? 172.21.15.80:0/1689583161' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-02-19T21:58:38.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:37.506251+0000 mon.a (mon.0) 2127 : cluster [DBG] osdmap e587: 8 total, 8 up, 8 in 2024-02-19T21:58:40.771 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:38.622742+0000 osd.0 (osd.0) 27 : cluster [DBG] 4.16 scrub starts 2024-02-19T21:58:40.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:38.624724+0000 osd.0 (osd.0) 28 : cluster [DBG] 4.16 scrub ok 2024-02-19T21:58:40.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:39.349937+0000 mgr.y (mgr.14514) 992 : cluster [DBG] pgmap v1293: 122 pgs: 122 active+clean; 5.8 KiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 654 B/s rd, 0 op/s 2024-02-19T21:58:40.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:40.503623+0000 mon.a (mon.0) 2128 : cluster [DBG] osdmap e588: 8 total, 8 up, 8 in 2024-02-19T21:58:40.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:38.622742+0000 osd.0 (osd.0) 27 : cluster [DBG] 4.16 scrub starts 2024-02-19T21:58:40.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:38.624724+0000 osd.0 (osd.0) 28 : cluster [DBG] 4.16 scrub ok 2024-02-19T21:58:40.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:39.349937+0000 mgr.y (mgr.14514) 992 : cluster [DBG] pgmap v1293: 122 pgs: 122 active+clean; 5.8 KiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 654 B/s rd, 0 op/s 2024-02-19T21:58:40.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:40.503623+0000 mon.a (mon.0) 2128 : cluster [DBG] osdmap e588: 8 total, 8 up, 8 in 2024-02-19T21:58:40.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:38.622742+0000 osd.0 (osd.0) 27 : cluster [DBG] 4.16 scrub starts 2024-02-19T21:58:40.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:38.624724+0000 osd.0 (osd.0) 28 : cluster [DBG] 4.16 scrub ok 2024-02-19T21:58:40.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:39.349937+0000 mgr.y (mgr.14514) 992 : cluster [DBG] pgmap v1293: 122 pgs: 122 active+clean; 5.8 KiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 654 B/s rd, 0 op/s 2024-02-19T21:58:40.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:40.503623+0000 mon.a (mon.0) 2128 : cluster [DBG] osdmap e588: 8 total, 8 up, 8 in 2024-02-19T21:58:41.095 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:58:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:58:40] "GET /metrics HTTP/1.1" 200 174238 "" "Prometheus/2.33.4" 2024-02-19T21:58:41.519 INFO:teuthology.orchestra.run.smithi080.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-02-19T21:58:41.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:58:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:58:41.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:39.630494+0000 osd.0 (osd.0) 29 : cluster [DBG] 6.18 deep-scrub starts 2024-02-19T21:58:41.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:39.634644+0000 osd.0 (osd.0) 30 : cluster [DBG] 6.18 deep-scrub ok 2024-02-19T21:58:41.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:40.645583+0000 mon.a (mon.0) 2129 : audit [INF] from='client.? 172.21.15.80:0/3306855223' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]: dispatch 2024-02-19T21:58:41.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:40.961368+0000 osd.3 (osd.3) 295 : cluster [DBG] 6.1b scrub starts 2024-02-19T21:58:41.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:41.065418+0000 osd.3 (osd.3) 296 : cluster [DBG] 6.1b scrub ok 2024-02-19T21:58:41.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:39.630494+0000 osd.0 (osd.0) 29 : cluster [DBG] 6.18 deep-scrub starts 2024-02-19T21:58:41.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:39.634644+0000 osd.0 (osd.0) 30 : cluster [DBG] 6.18 deep-scrub ok 2024-02-19T21:58:41.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:40.645583+0000 mon.a (mon.0) 2129 : audit [INF] from='client.? 172.21.15.80:0/3306855223' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]: dispatch 2024-02-19T21:58:41.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:40.961368+0000 osd.3 (osd.3) 295 : cluster [DBG] 6.1b scrub starts 2024-02-19T21:58:41.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:41.065418+0000 osd.3 (osd.3) 296 : cluster [DBG] 6.1b scrub ok 2024-02-19T21:58:41.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:39.630494+0000 osd.0 (osd.0) 29 : cluster [DBG] 6.18 deep-scrub starts 2024-02-19T21:58:41.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:39.634644+0000 osd.0 (osd.0) 30 : cluster [DBG] 6.18 deep-scrub ok 2024-02-19T21:58:41.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:40.645583+0000 mon.a (mon.0) 2129 : audit [INF] from='client.? 172.21.15.80:0/3306855223' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]: dispatch 2024-02-19T21:58:41.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:40.961368+0000 osd.3 (osd.3) 295 : cluster [DBG] 6.1b scrub starts 2024-02-19T21:58:41.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:41.065418+0000 osd.3 (osd.3) 296 : cluster [DBG] 6.1b scrub ok 2024-02-19T21:58:42.274 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd reweight 5 1 2024-02-19T21:58:42.545 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:58:42.798 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:41.283585+0000 osd.3 (osd.3) 297 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:58:42.798 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:41.283658+0000 osd.3 (osd.3) 298 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:58:42.798 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:41.350554+0000 mgr.y (mgr.14514) 993 : cluster [DBG] pgmap v1295: 122 pgs: 122 active+clean; 5.8 KiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-19T21:58:42.798 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:41.507811+0000 mgr.y (mgr.14514) 994 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:58:42.798 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:41.516569+0000 mon.a (mon.0) 2130 : audit [INF] from='client.? 172.21.15.80:0/3306855223' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]': finished 2024-02-19T21:58:42.798 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:41.516637+0000 mon.a (mon.0) 2131 : cluster [DBG] osdmap e589: 8 total, 8 up, 8 in 2024-02-19T21:58:42.798 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:41.283585+0000 osd.3 (osd.3) 297 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:58:42.799 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:41.283658+0000 osd.3 (osd.3) 298 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:58:42.799 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:41.350554+0000 mgr.y (mgr.14514) 993 : cluster [DBG] pgmap v1295: 122 pgs: 122 active+clean; 5.8 KiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-19T21:58:42.799 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:41.507811+0000 mgr.y (mgr.14514) 994 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:58:42.799 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:41.516569+0000 mon.a (mon.0) 2130 : audit [INF] from='client.? 172.21.15.80:0/3306855223' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]': finished 2024-02-19T21:58:42.799 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:41.516637+0000 mon.a (mon.0) 2131 : cluster [DBG] osdmap e589: 8 total, 8 up, 8 in 2024-02-19T21:58:42.805 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:41.283585+0000 osd.3 (osd.3) 297 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:58:42.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:41.283658+0000 osd.3 (osd.3) 298 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:58:42.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:41.350554+0000 mgr.y (mgr.14514) 993 : cluster [DBG] pgmap v1295: 122 pgs: 122 active+clean; 5.8 KiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-19T21:58:42.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:41.507811+0000 mgr.y (mgr.14514) 994 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:58:42.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:41.516569+0000 mon.a (mon.0) 2130 : audit [INF] from='client.? 172.21.15.80:0/3306855223' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]': finished 2024-02-19T21:58:42.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:41.516637+0000 mon.a (mon.0) 2131 : cluster [DBG] osdmap e589: 8 total, 8 up, 8 in 2024-02-19T21:58:43.774 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:42.444121+0000 osd.5 (osd.5) 366 : cluster [DBG] 2.2 deep-scrub starts 2024-02-19T21:58:43.775 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:42.445185+0000 osd.5 (osd.5) 367 : cluster [DBG] 2.2 deep-scrub ok 2024-02-19T21:58:43.775 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:42.556773+0000 osd.0 (osd.0) 31 : cluster [DBG] 3.1 scrub starts 2024-02-19T21:58:43.775 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:42.559653+0000 osd.0 (osd.0) 32 : cluster [DBG] 3.1 scrub ok 2024-02-19T21:58:43.775 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:42.444121+0000 osd.5 (osd.5) 366 : cluster [DBG] 2.2 deep-scrub starts 2024-02-19T21:58:43.775 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:42.445185+0000 osd.5 (osd.5) 367 : cluster [DBG] 2.2 deep-scrub ok 2024-02-19T21:58:43.775 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:42.556773+0000 osd.0 (osd.0) 31 : cluster [DBG] 3.1 scrub starts 2024-02-19T21:58:43.775 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:42.559653+0000 osd.0 (osd.0) 32 : cluster [DBG] 3.1 scrub ok 2024-02-19T21:58:43.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:42.444121+0000 osd.5 (osd.5) 366 : cluster [DBG] 2.2 deep-scrub starts 2024-02-19T21:58:43.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:42.445185+0000 osd.5 (osd.5) 367 : cluster [DBG] 2.2 deep-scrub ok 2024-02-19T21:58:43.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:42.556773+0000 osd.0 (osd.0) 31 : cluster [DBG] 3.1 scrub starts 2024-02-19T21:58:43.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:42.559653+0000 osd.0 (osd.0) 32 : cluster [DBG] 3.1 scrub ok 2024-02-19T21:58:44.532 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.5 to 1 (10000) 2024-02-19T21:58:44.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:43.350949+0000 mgr.y (mgr.14514) 995 : cluster [DBG] pgmap v1297: 122 pgs: 122 active+clean; 5.8 KiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:58:44.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:44.428784+0000 mon.c (mon.2) 142 : audit [INF] from='client.? 172.21.15.80:0/748441406' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-19T21:58:44.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:44.429065+0000 mon.a (mon.0) 2132 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-19T21:58:44.827 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:43.350949+0000 mgr.y (mgr.14514) 995 : cluster [DBG] pgmap v1297: 122 pgs: 122 active+clean; 5.8 KiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:58:44.827 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:44.428784+0000 mon.c (mon.2) 142 : audit [INF] from='client.? 172.21.15.80:0/748441406' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-19T21:58:44.827 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:44.429065+0000 mon.a (mon.0) 2132 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-19T21:58:44.827 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:43.350949+0000 mgr.y (mgr.14514) 995 : cluster [DBG] pgmap v1297: 122 pgs: 122 active+clean; 5.8 KiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:58:44.827 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:44.428784+0000 mon.c (mon.2) 142 : audit [INF] from='client.? 172.21.15.80:0/748441406' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-19T21:58:44.827 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:44.429065+0000 mon.a (mon.0) 2132 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-02-19T21:58:45.193 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd primary-affinity 5 1 2024-02-19T21:58:45.463 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:58:45.974 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:44.529449+0000 mon.a (mon.0) 2133 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-02-19T21:58:45.974 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:44.529540+0000 mon.a (mon.0) 2134 : cluster [DBG] osdmap e590: 8 total, 8 up, 8 in 2024-02-19T21:58:45.974 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:44.541808+0000 osd.0 (osd.0) 33 : cluster [DBG] 2.13 scrub starts 2024-02-19T21:58:45.974 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:44.544688+0000 osd.0 (osd.0) 34 : cluster [DBG] 2.13 scrub ok 2024-02-19T21:58:45.975 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:44.719199+0000 osd.6 (osd.6) 327 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:58:45.975 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:44.719285+0000 osd.6 (osd.6) 328 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:58:45.975 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:44.529449+0000 mon.a (mon.0) 2133 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-02-19T21:58:45.975 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:44.529540+0000 mon.a (mon.0) 2134 : cluster [DBG] osdmap e590: 8 total, 8 up, 8 in 2024-02-19T21:58:45.975 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:44.541808+0000 osd.0 (osd.0) 33 : cluster [DBG] 2.13 scrub starts 2024-02-19T21:58:45.975 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:44.544688+0000 osd.0 (osd.0) 34 : cluster [DBG] 2.13 scrub ok 2024-02-19T21:58:45.975 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:44.719199+0000 osd.6 (osd.6) 327 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:58:45.975 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:44.719285+0000 osd.6 (osd.6) 328 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:58:46.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:58:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:58:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:58:46.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:44.529449+0000 mon.a (mon.0) 2133 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-02-19T21:58:46.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:44.529540+0000 mon.a (mon.0) 2134 : cluster [DBG] osdmap e590: 8 total, 8 up, 8 in 2024-02-19T21:58:46.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:44.541808+0000 osd.0 (osd.0) 33 : cluster [DBG] 2.13 scrub starts 2024-02-19T21:58:46.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:44.544688+0000 osd.0 (osd.0) 34 : cluster [DBG] 2.13 scrub ok 2024-02-19T21:58:46.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:44.719199+0000 osd.6 (osd.6) 327 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:58:46.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:44.719285+0000 osd.6 (osd.6) 328 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:58:46.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:45.351351+0000 mgr.y (mgr.14514) 996 : cluster [DBG] pgmap v1299: 122 pgs: 122 active+clean; 5.8 KiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:58:46.601 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:45.500060+0000 osd.4 (osd.4) 303 : cluster [DBG] 4.c scrub starts 2024-02-19T21:58:46.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:45.351351+0000 mgr.y (mgr.14514) 996 : cluster [DBG] pgmap v1299: 122 pgs: 122 active+clean; 5.8 KiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:58:46.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:45.500060+0000 osd.4 (osd.4) 303 : cluster [DBG] 4.c scrub starts 2024-02-19T21:58:46.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:45.503774+0000 osd.4 (osd.4) 304 : cluster [DBG] 4.c scrub ok 2024-02-19T21:58:46.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:45.604078+0000 mon.a (mon.0) 2135 : cluster [DBG] osdmap e591: 8 total, 8 up, 8 in 2024-02-19T21:58:46.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:46.416577+0000 osd.5 (osd.5) 368 : cluster [DBG] 4.f scrub starts 2024-02-19T21:58:46.601 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:46.420040+0000 osd.5 (osd.5) 369 : cluster [DBG] 4.f scrub ok 2024-02-19T21:58:46.602 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:46.569882+0000 osd.0 (osd.0) 35 : cluster [DBG] 4.6 scrub starts 2024-02-19T21:58:46.602 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:46.571716+0000 osd.0 (osd.0) 36 : cluster [DBG] 4.6 scrub ok 2024-02-19T21:58:47.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:45.503774+0000 osd.4 (osd.4) 304 : cluster [DBG] 4.c scrub ok 2024-02-19T21:58:47.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:45.604078+0000 mon.a (mon.0) 2135 : cluster [DBG] osdmap e591: 8 total, 8 up, 8 in 2024-02-19T21:58:47.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:46.416577+0000 osd.5 (osd.5) 368 : cluster [DBG] 4.f scrub starts 2024-02-19T21:58:47.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:46.420040+0000 osd.5 (osd.5) 369 : cluster [DBG] 4.f scrub ok 2024-02-19T21:58:47.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:46.569882+0000 osd.0 (osd.0) 35 : cluster [DBG] 4.6 scrub starts 2024-02-19T21:58:47.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:46.571716+0000 osd.0 (osd.0) 36 : cluster [DBG] 4.6 scrub ok 2024-02-19T21:58:47.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:45.351351+0000 mgr.y (mgr.14514) 996 : cluster [DBG] pgmap v1299: 122 pgs: 122 active+clean; 5.8 KiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:58:47.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:45.500060+0000 osd.4 (osd.4) 303 : cluster [DBG] 4.c scrub starts 2024-02-19T21:58:47.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:45.503774+0000 osd.4 (osd.4) 304 : cluster [DBG] 4.c scrub ok 2024-02-19T21:58:47.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:45.604078+0000 mon.a (mon.0) 2135 : cluster [DBG] osdmap e591: 8 total, 8 up, 8 in 2024-02-19T21:58:47.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:46.416577+0000 osd.5 (osd.5) 368 : cluster [DBG] 4.f scrub starts 2024-02-19T21:58:47.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:46.420040+0000 osd.5 (osd.5) 369 : cluster [DBG] 4.f scrub ok 2024-02-19T21:58:47.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:46.569882+0000 osd.0 (osd.0) 35 : cluster [DBG] 4.6 scrub starts 2024-02-19T21:58:47.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:46.571716+0000 osd.0 (osd.0) 36 : cluster [DBG] 4.6 scrub ok 2024-02-19T21:58:47.610 INFO:teuthology.orchestra.run.smithi080.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-02-19T21:58:47.985 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:47.444681+0000 mon.c (mon.2) 143 : audit [INF] from='client.? 172.21.15.80:0/2517985490' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]: dispatch 2024-02-19T21:58:47.985 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:47.444988+0000 mon.a (mon.0) 2136 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]: dispatch 2024-02-19T21:58:47.985 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:47.444681+0000 mon.c (mon.2) 143 : audit [INF] from='client.? 172.21.15.80:0/2517985490' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]: dispatch 2024-02-19T21:58:47.985 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:47.444988+0000 mon.a (mon.0) 2136 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]: dispatch 2024-02-19T21:58:48.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:47.444681+0000 mon.c (mon.2) 143 : audit [INF] from='client.? 172.21.15.80:0/2517985490' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]: dispatch 2024-02-19T21:58:48.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:47.444988+0000 mon.a (mon.0) 2136 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]: dispatch 2024-02-19T21:58:48.377 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd reweight 6 1 2024-02-19T21:58:48.612 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:47.351737+0000 mgr.y (mgr.14514) 997 : cluster [DBG] pgmap v1301: 122 pgs: 122 active+clean; 5.8 KiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:58:48.612 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:47.605230+0000 mon.a (mon.0) 2137 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]': finished 2024-02-19T21:58:48.612 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:47.605281+0000 mon.a (mon.0) 2138 : cluster [DBG] osdmap e592: 8 total, 8 up, 8 in 2024-02-19T21:58:48.612 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:48.435922+0000 osd.5 (osd.5) 370 : cluster [DBG] 4.15 scrub starts 2024-02-19T21:58:48.613 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:48.437676+0000 osd.5 (osd.5) 371 : cluster [DBG] 4.15 scrub ok 2024-02-19T21:58:48.645 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:58:48.888 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:47.351737+0000 mgr.y (mgr.14514) 997 : cluster [DBG] pgmap v1301: 122 pgs: 122 active+clean; 5.8 KiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:58:48.888 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:47.605230+0000 mon.a (mon.0) 2137 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]': finished 2024-02-19T21:58:48.888 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:47.605281+0000 mon.a (mon.0) 2138 : cluster [DBG] osdmap e592: 8 total, 8 up, 8 in 2024-02-19T21:58:48.888 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:48.435922+0000 osd.5 (osd.5) 370 : cluster [DBG] 4.15 scrub starts 2024-02-19T21:58:48.889 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:48.437676+0000 osd.5 (osd.5) 371 : cluster [DBG] 4.15 scrub ok 2024-02-19T21:58:49.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:47.351737+0000 mgr.y (mgr.14514) 997 : cluster [DBG] pgmap v1301: 122 pgs: 122 active+clean; 5.8 KiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:58:49.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:47.605230+0000 mon.a (mon.0) 2137 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]': finished 2024-02-19T21:58:49.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:47.605281+0000 mon.a (mon.0) 2138 : cluster [DBG] osdmap e592: 8 total, 8 up, 8 in 2024-02-19T21:58:49.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:48.435922+0000 osd.5 (osd.5) 370 : cluster [DBG] 4.15 scrub starts 2024-02-19T21:58:49.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:48.437676+0000 osd.5 (osd.5) 371 : cluster [DBG] 4.15 scrub ok 2024-02-19T21:58:49.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:48.941175+0000 osd.3 (osd.3) 299 : cluster [DBG] 6.c scrub starts 2024-02-19T21:58:49.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:48.942202+0000 osd.3 (osd.3) 300 : cluster [DBG] 6.c scrub ok 2024-02-19T21:58:49.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:48.941175+0000 osd.3 (osd.3) 299 : cluster [DBG] 6.c scrub starts 2024-02-19T21:58:49.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:48.942202+0000 osd.3 (osd.3) 300 : cluster [DBG] 6.c scrub ok 2024-02-19T21:58:50.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:48.941175+0000 osd.3 (osd.3) 299 : cluster [DBG] 6.c scrub starts 2024-02-19T21:58:50.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:48.942202+0000 osd.3 (osd.3) 300 : cluster [DBG] 6.c scrub ok 2024-02-19T21:58:51.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:49.352200+0000 mgr.y (mgr.14514) 998 : cluster [DBG] pgmap v1303: 122 pgs: 122 active+clean; 5.8 KiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:58:51.095 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:49.352200+0000 mgr.y (mgr.14514) 998 : cluster [DBG] pgmap v1303: 122 pgs: 122 active+clean; 5.8 KiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:58:51.096 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:58:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:58:50] "GET /metrics HTTP/1.1" 200 174216 "" "Prometheus/2.33.4" 2024-02-19T21:58:51.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:49.352200+0000 mgr.y (mgr.14514) 998 : cluster [DBG] pgmap v1303: 122 pgs: 122 active+clean; 5.8 KiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:58:51.632 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.6 to 1 (10000) 2024-02-19T21:58:51.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:58:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:58:51.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:50.408589+0000 osd.4 (osd.4) 305 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:58:51.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:50.412153+0000 osd.4 (osd.4) 306 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:58:51.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:50.657547+0000 mon.a (mon.0) 2139 : audit [INF] from='client.? 172.21.15.80:0/1663108299' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-02-19T21:58:51.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:50.764799+0000 osd.2 (osd.2) 101 : cluster [DBG] 5.d scrub starts 2024-02-19T21:58:51.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:50.766788+0000 osd.2 (osd.2) 102 : cluster [DBG] 5.d scrub ok 2024-02-19T21:58:51.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:50.976848+0000 osd.3 (osd.3) 301 : cluster [DBG] 4.1d scrub starts 2024-02-19T21:58:51.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:50.978876+0000 osd.3 (osd.3) 302 : cluster [DBG] 4.1d scrub ok 2024-02-19T21:58:52.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:50.408589+0000 osd.4 (osd.4) 305 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:58:52.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:50.412153+0000 osd.4 (osd.4) 306 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:58:52.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:50.657547+0000 mon.a (mon.0) 2139 : audit [INF] from='client.? 172.21.15.80:0/1663108299' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-02-19T21:58:52.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:50.764799+0000 osd.2 (osd.2) 101 : cluster [DBG] 5.d scrub starts 2024-02-19T21:58:52.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:50.766788+0000 osd.2 (osd.2) 102 : cluster [DBG] 5.d scrub ok 2024-02-19T21:58:52.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:50.976848+0000 osd.3 (osd.3) 301 : cluster [DBG] 4.1d scrub starts 2024-02-19T21:58:52.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:50.978876+0000 osd.3 (osd.3) 302 : cluster [DBG] 4.1d scrub ok 2024-02-19T21:58:52.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:50.408589+0000 osd.4 (osd.4) 305 : cluster [DBG] 4.18 scrub starts 2024-02-19T21:58:52.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:50.412153+0000 osd.4 (osd.4) 306 : cluster [DBG] 4.18 scrub ok 2024-02-19T21:58:52.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:50.657547+0000 mon.a (mon.0) 2139 : audit [INF] from='client.? 172.21.15.80:0/1663108299' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-02-19T21:58:52.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:50.764799+0000 osd.2 (osd.2) 101 : cluster [DBG] 5.d scrub starts 2024-02-19T21:58:52.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:50.766788+0000 osd.2 (osd.2) 102 : cluster [DBG] 5.d scrub ok 2024-02-19T21:58:52.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:50.976848+0000 osd.3 (osd.3) 301 : cluster [DBG] 4.1d scrub starts 2024-02-19T21:58:52.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:50.978876+0000 osd.3 (osd.3) 302 : cluster [DBG] 4.1d scrub ok 2024-02-19T21:58:52.515 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd primary-affinity 6 1 2024-02-19T21:58:52.794 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:58:52.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:51.352760+0000 mgr.y (mgr.14514) 999 : cluster [DBG] pgmap v1304: 122 pgs: 122 active+clean; 5.7 KiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-19T21:58:52.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:51.516715+0000 mgr.y (mgr.14514) 1000 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:58:52.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:51.628047+0000 mon.a (mon.0) 2140 : audit [INF] from='client.? 172.21.15.80:0/1663108299' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-02-19T21:58:52.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:51.628136+0000 mon.a (mon.0) 2141 : cluster [DBG] osdmap e593: 8 total, 8 up, 8 in 2024-02-19T21:58:52.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:51.352760+0000 mgr.y (mgr.14514) 999 : cluster [DBG] pgmap v1304: 122 pgs: 122 active+clean; 5.7 KiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-19T21:58:52.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:51.516715+0000 mgr.y (mgr.14514) 1000 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:58:52.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:51.628047+0000 mon.a (mon.0) 2140 : audit [INF] from='client.? 172.21.15.80:0/1663108299' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-02-19T21:58:52.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:51.628136+0000 mon.a (mon.0) 2141 : cluster [DBG] osdmap e593: 8 total, 8 up, 8 in 2024-02-19T21:58:53.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:51.352760+0000 mgr.y (mgr.14514) 999 : cluster [DBG] pgmap v1304: 122 pgs: 122 active+clean; 5.7 KiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-19T21:58:53.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:51.516715+0000 mgr.y (mgr.14514) 1000 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:58:53.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:51.628047+0000 mon.a (mon.0) 2140 : audit [INF] from='client.? 172.21.15.80:0/1663108299' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-02-19T21:58:53.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:51.628136+0000 mon.a (mon.0) 2141 : cluster [DBG] osdmap e593: 8 total, 8 up, 8 in 2024-02-19T21:58:53.981 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:52.447907+0000 osd.4 (osd.4) 307 : cluster [DBG] 6.2 scrub starts 2024-02-19T21:58:53.981 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:52.492590+0000 osd.4 (osd.4) 308 : cluster [DBG] 6.2 scrub ok 2024-02-19T21:58:53.982 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:52.447907+0000 osd.4 (osd.4) 307 : cluster [DBG] 6.2 scrub starts 2024-02-19T21:58:53.982 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:52.492590+0000 osd.4 (osd.4) 308 : cluster [DBG] 6.2 scrub ok 2024-02-19T21:58:54.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:52.447907+0000 osd.4 (osd.4) 307 : cluster [DBG] 6.2 scrub starts 2024-02-19T21:58:54.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:52.492590+0000 osd.4 (osd.4) 308 : cluster [DBG] 6.2 scrub ok 2024-02-19T21:58:55.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:53.353359+0000 mgr.y (mgr.14514) 1001 : cluster [DBG] pgmap v1306: 122 pgs: 122 active+clean; 5.7 KiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 660 B/s rd, 0 op/s 2024-02-19T21:58:55.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:53.594378+0000 osd.7 (osd.7) 357 : cluster [DBG] 2.b scrub starts 2024-02-19T21:58:55.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:53.597340+0000 osd.7 (osd.7) 358 : cluster [DBG] 2.b scrub ok 2024-02-19T21:58:55.095 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:53.353359+0000 mgr.y (mgr.14514) 1001 : cluster [DBG] pgmap v1306: 122 pgs: 122 active+clean; 5.7 KiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 660 B/s rd, 0 op/s 2024-02-19T21:58:55.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:53.594378+0000 osd.7 (osd.7) 357 : cluster [DBG] 2.b scrub starts 2024-02-19T21:58:55.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:53.597340+0000 osd.7 (osd.7) 358 : cluster [DBG] 2.b scrub ok 2024-02-19T21:58:55.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:53.353359+0000 mgr.y (mgr.14514) 1001 : cluster [DBG] pgmap v1306: 122 pgs: 122 active+clean; 5.7 KiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 660 B/s rd, 0 op/s 2024-02-19T21:58:55.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:53.594378+0000 osd.7 (osd.7) 357 : cluster [DBG] 2.b scrub starts 2024-02-19T21:58:55.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:53.597340+0000 osd.7 (osd.7) 358 : cluster [DBG] 2.b scrub ok 2024-02-19T21:58:55.515 INFO:teuthology.orchestra.run.smithi080.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-02-19T21:58:55.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:54.680879+0000 mon.c (mon.2) 144 : audit [INF] from='client.? 172.21.15.80:0/2097982292' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]: dispatch 2024-02-19T21:58:55.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:54.681137+0000 mon.a (mon.0) 2142 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]: dispatch 2024-02-19T21:58:55.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:54.975255+0000 osd.3 (osd.3) 303 : cluster [DBG] 4.14 scrub starts 2024-02-19T21:58:55.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:54.976904+0000 osd.3 (osd.3) 304 : cluster [DBG] 4.14 scrub ok 2024-02-19T21:58:55.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:55.419664+0000 osd.5 (osd.5) 372 : cluster [DBG] 4.8 scrub starts 2024-02-19T21:58:55.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:55.423325+0000 osd.5 (osd.5) 373 : cluster [DBG] 4.8 scrub ok 2024-02-19T21:58:55.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:55.509639+0000 mon.a (mon.0) 2143 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]': finished 2024-02-19T21:58:55.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:55.509743+0000 mon.a (mon.0) 2144 : cluster [DBG] osdmap e594: 8 total, 8 up, 8 in 2024-02-19T21:58:55.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:54.680879+0000 mon.c (mon.2) 144 : audit [INF] from='client.? 172.21.15.80:0/2097982292' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]: dispatch 2024-02-19T21:58:55.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:54.681137+0000 mon.a (mon.0) 2142 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]: dispatch 2024-02-19T21:58:55.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:54.975255+0000 osd.3 (osd.3) 303 : cluster [DBG] 4.14 scrub starts 2024-02-19T21:58:55.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:54.976904+0000 osd.3 (osd.3) 304 : cluster [DBG] 4.14 scrub ok 2024-02-19T21:58:55.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:55.419664+0000 osd.5 (osd.5) 372 : cluster [DBG] 4.8 scrub starts 2024-02-19T21:58:55.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:55.423325+0000 osd.5 (osd.5) 373 : cluster [DBG] 4.8 scrub ok 2024-02-19T21:58:55.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:55.509639+0000 mon.a (mon.0) 2143 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]': finished 2024-02-19T21:58:55.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:55.509743+0000 mon.a (mon.0) 2144 : cluster [DBG] osdmap e594: 8 total, 8 up, 8 in 2024-02-19T21:58:56.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:58:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:58:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:58:56.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:54.680879+0000 mon.c (mon.2) 144 : audit [INF] from='client.? 172.21.15.80:0/2097982292' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]: dispatch 2024-02-19T21:58:56.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:54.681137+0000 mon.a (mon.0) 2142 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]: dispatch 2024-02-19T21:58:56.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:54.975255+0000 osd.3 (osd.3) 303 : cluster [DBG] 4.14 scrub starts 2024-02-19T21:58:56.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:54.976904+0000 osd.3 (osd.3) 304 : cluster [DBG] 4.14 scrub ok 2024-02-19T21:58:56.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:55.419664+0000 osd.5 (osd.5) 372 : cluster [DBG] 4.8 scrub starts 2024-02-19T21:58:56.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:55.423325+0000 osd.5 (osd.5) 373 : cluster [DBG] 4.8 scrub ok 2024-02-19T21:58:56.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:55.509639+0000 mon.a (mon.0) 2143 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]': finished 2024-02-19T21:58:56.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:55.509743+0000 mon.a (mon.0) 2144 : cluster [DBG] osdmap e594: 8 total, 8 up, 8 in 2024-02-19T21:58:56.314 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd reweight 7 1 2024-02-19T21:58:56.585 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:58:56.928 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:54.955534+0000 osd.6 (osd.6) 329 : cluster [DBG] 5.11 scrub starts 2024-02-19T21:58:56.928 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:54.958569+0000 osd.6 (osd.6) 330 : cluster [DBG] 5.11 scrub ok 2024-02-19T21:58:56.929 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:55.353937+0000 mgr.y (mgr.14514) 1002 : cluster [DBG] pgmap v1307: 122 pgs: 122 active+clean; 5.7 KiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:58:56.929 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:55.810765+0000 osd.2 (osd.2) 103 : cluster [DBG] 5.6 deep-scrub starts 2024-02-19T21:58:56.929 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:55.811791+0000 osd.2 (osd.2) 104 : cluster [DBG] 5.6 deep-scrub ok 2024-02-19T21:58:56.929 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:54.955534+0000 osd.6 (osd.6) 329 : cluster [DBG] 5.11 scrub starts 2024-02-19T21:58:56.930 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:54.958569+0000 osd.6 (osd.6) 330 : cluster [DBG] 5.11 scrub ok 2024-02-19T21:58:56.930 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:55.353937+0000 mgr.y (mgr.14514) 1002 : cluster [DBG] pgmap v1307: 122 pgs: 122 active+clean; 5.7 KiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:58:56.930 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:55.810765+0000 osd.2 (osd.2) 103 : cluster [DBG] 5.6 deep-scrub starts 2024-02-19T21:58:56.930 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:55.811791+0000 osd.2 (osd.2) 104 : cluster [DBG] 5.6 deep-scrub ok 2024-02-19T21:58:57.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:54.955534+0000 osd.6 (osd.6) 329 : cluster [DBG] 5.11 scrub starts 2024-02-19T21:58:57.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:54.958569+0000 osd.6 (osd.6) 330 : cluster [DBG] 5.11 scrub ok 2024-02-19T21:58:57.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:55.353937+0000 mgr.y (mgr.14514) 1002 : cluster [DBG] pgmap v1307: 122 pgs: 122 active+clean; 5.7 KiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:58:57.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:55.810765+0000 osd.2 (osd.2) 103 : cluster [DBG] 5.6 deep-scrub starts 2024-02-19T21:58:57.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:55.811791+0000 osd.2 (osd.2) 104 : cluster [DBG] 5.6 deep-scrub ok 2024-02-19T21:58:59.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:56.971151+0000 osd.6 (osd.6) 331 : cluster [DBG] 4.5 scrub starts 2024-02-19T21:58:59.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:56.974880+0000 osd.6 (osd.6) 332 : cluster [DBG] 4.5 scrub ok 2024-02-19T21:58:59.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:57.354433+0000 mgr.y (mgr.14514) 1003 : cluster [DBG] pgmap v1309: 122 pgs: 122 active+clean; 5.7 KiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:58:59.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:57.415596+0000 osd.1 (osd.1) 330 : cluster [DBG] 6.4 scrub starts 2024-02-19T21:58:59.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:57.416387+0000 osd.1 (osd.1) 331 : cluster [DBG] 6.4 scrub ok 2024-02-19T21:58:59.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:57.539047+0000 osd.7 (osd.7) 359 : cluster [DBG] 6.5 scrub starts 2024-02-19T21:58:59.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:57.587493+0000 osd.7 (osd.7) 360 : cluster [DBG] 6.5 scrub ok 2024-02-19T21:58:59.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:56.971151+0000 osd.6 (osd.6) 331 : cluster [DBG] 4.5 scrub starts 2024-02-19T21:58:59.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:56.974880+0000 osd.6 (osd.6) 332 : cluster [DBG] 4.5 scrub ok 2024-02-19T21:58:59.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:57.354433+0000 mgr.y (mgr.14514) 1003 : cluster [DBG] pgmap v1309: 122 pgs: 122 active+clean; 5.7 KiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:58:59.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:57.415596+0000 osd.1 (osd.1) 330 : cluster [DBG] 6.4 scrub starts 2024-02-19T21:58:59.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:57.416387+0000 osd.1 (osd.1) 331 : cluster [DBG] 6.4 scrub ok 2024-02-19T21:58:59.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:57.539047+0000 osd.7 (osd.7) 359 : cluster [DBG] 6.5 scrub starts 2024-02-19T21:58:59.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:57.587493+0000 osd.7 (osd.7) 360 : cluster [DBG] 6.5 scrub ok 2024-02-19T21:58:59.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:56.971151+0000 osd.6 (osd.6) 331 : cluster [DBG] 4.5 scrub starts 2024-02-19T21:58:59.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:56.974880+0000 osd.6 (osd.6) 332 : cluster [DBG] 4.5 scrub ok 2024-02-19T21:58:59.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:57.354433+0000 mgr.y (mgr.14514) 1003 : cluster [DBG] pgmap v1309: 122 pgs: 122 active+clean; 5.7 KiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:58:59.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:57.415596+0000 osd.1 (osd.1) 330 : cluster [DBG] 6.4 scrub starts 2024-02-19T21:58:59.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:57.416387+0000 osd.1 (osd.1) 331 : cluster [DBG] 6.4 scrub ok 2024-02-19T21:58:59.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:57.539047+0000 osd.7 (osd.7) 359 : cluster [DBG] 6.5 scrub starts 2024-02-19T21:58:59.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:57.587493+0000 osd.7 (osd.7) 360 : cluster [DBG] 6.5 scrub ok 2024-02-19T21:58:59.663 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.7 to 1 (10000) 2024-02-19T21:59:00.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:58.464473+0000 osd.4 (osd.4) 309 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:59:00.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:58.468119+0000 osd.4 (osd.4) 310 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:59:00.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:58.650568+0000 mon.a (mon.0) 2145 : audit [INF] from='client.? 172.21.15.80:0/1746180007' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-02-19T21:59:00.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:59.004060+0000 osd.3 (osd.3) 305 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:59:00.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:58:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:59.028628+0000 osd.3 (osd.3) 306 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:59:00.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:58.464473+0000 osd.4 (osd.4) 309 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:59:00.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:58.468119+0000 osd.4 (osd.4) 310 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:59:00.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:58.650568+0000 mon.a (mon.0) 2145 : audit [INF] from='client.? 172.21.15.80:0/1746180007' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-02-19T21:59:00.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:59.004060+0000 osd.3 (osd.3) 305 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:59:00.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:58:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:59.028628+0000 osd.3 (osd.3) 306 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:59:00.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:58.464473+0000 osd.4 (osd.4) 309 : cluster [DBG] 4.13 scrub starts 2024-02-19T21:59:00.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:58.468119+0000 osd.4 (osd.4) 310 : cluster [DBG] 4.13 scrub ok 2024-02-19T21:59:00.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:58.650568+0000 mon.a (mon.0) 2145 : audit [INF] from='client.? 172.21.15.80:0/1746180007' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-02-19T21:59:00.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:59.004060+0000 osd.3 (osd.3) 305 : cluster [DBG] 6.6 scrub starts 2024-02-19T21:59:00.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:58:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:59.028628+0000 osd.3 (osd.3) 306 : cluster [DBG] 6.6 scrub ok 2024-02-19T21:59:00.363 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd primary-affinity 7 1 2024-02-19T21:59:00.647 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:59:00.920 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:59:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:59:00] "GET /metrics HTTP/1.1" 200 174216 "" "Prometheus/2.33.4" 2024-02-19T21:59:00.921 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:59.354881+0000 mgr.y (mgr.14514) 1004 : cluster [DBG] pgmap v1310: 122 pgs: 122 active+clean; 5.7 KiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:59:00.921 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:59.542995+0000 osd.7 (osd.7) 361 : cluster [DBG] 6.15 scrub starts 2024-02-19T21:59:00.921 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:59.594076+0000 osd.7 (osd.7) 362 : cluster [DBG] 6.15 scrub ok 2024-02-19T21:59:00.921 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:58:59.660654+0000 mon.a (mon.0) 2146 : audit [INF] from='client.? 172.21.15.80:0/1746180007' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-02-19T21:59:00.921 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:59.660716+0000 mon.a (mon.0) 2147 : cluster [DBG] osdmap e595: 8 total, 8 up, 8 in 2024-02-19T21:59:00.921 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:00.509984+0000 mon.a (mon.0) 2148 : cluster [DBG] osdmap e596: 8 total, 8 up, 8 in 2024-02-19T21:59:00.921 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:59.354881+0000 mgr.y (mgr.14514) 1004 : cluster [DBG] pgmap v1310: 122 pgs: 122 active+clean; 5.7 KiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:59:00.921 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:59.542995+0000 osd.7 (osd.7) 361 : cluster [DBG] 6.15 scrub starts 2024-02-19T21:59:00.921 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:59.594076+0000 osd.7 (osd.7) 362 : cluster [DBG] 6.15 scrub ok 2024-02-19T21:59:00.921 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:58:59.660654+0000 mon.a (mon.0) 2146 : audit [INF] from='client.? 172.21.15.80:0/1746180007' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-02-19T21:59:00.921 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:59.660716+0000 mon.a (mon.0) 2147 : cluster [DBG] osdmap e595: 8 total, 8 up, 8 in 2024-02-19T21:59:00.922 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:00.509984+0000 mon.a (mon.0) 2148 : cluster [DBG] osdmap e596: 8 total, 8 up, 8 in 2024-02-19T21:59:01.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:59.354881+0000 mgr.y (mgr.14514) 1004 : cluster [DBG] pgmap v1310: 122 pgs: 122 active+clean; 5.7 KiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T21:59:01.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:59.542995+0000 osd.7 (osd.7) 361 : cluster [DBG] 6.15 scrub starts 2024-02-19T21:59:01.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:59.594076+0000 osd.7 (osd.7) 362 : cluster [DBG] 6.15 scrub ok 2024-02-19T21:59:01.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:58:59.660654+0000 mon.a (mon.0) 2146 : audit [INF] from='client.? 172.21.15.80:0/1746180007' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-02-19T21:59:01.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:59.660716+0000 mon.a (mon.0) 2147 : cluster [DBG] osdmap e595: 8 total, 8 up, 8 in 2024-02-19T21:59:01.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:00.509984+0000 mon.a (mon.0) 2148 : cluster [DBG] osdmap e596: 8 total, 8 up, 8 in 2024-02-19T21:59:01.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:59:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:59:01.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:59.949800+0000 osd.6 (osd.6) 333 : cluster [DBG] 4.a scrub starts 2024-02-19T21:59:01.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:58:59.953322+0000 osd.6 (osd.6) 334 : cluster [DBG] 4.a scrub ok 2024-02-19T21:59:01.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:00.783984+0000 osd.1 (osd.1) 332 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:59:01.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:00.784060+0000 osd.1 (osd.1) 333 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:59:01.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:59.949800+0000 osd.6 (osd.6) 333 : cluster [DBG] 4.a scrub starts 2024-02-19T21:59:01.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:58:59.953322+0000 osd.6 (osd.6) 334 : cluster [DBG] 4.a scrub ok 2024-02-19T21:59:01.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:00.783984+0000 osd.1 (osd.1) 332 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:59:01.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:00.784060+0000 osd.1 (osd.1) 333 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:59:01.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:59.949800+0000 osd.6 (osd.6) 333 : cluster [DBG] 4.a scrub starts 2024-02-19T21:59:01.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:58:59.953322+0000 osd.6 (osd.6) 334 : cluster [DBG] 4.a scrub ok 2024-02-19T21:59:01.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:00.783984+0000 osd.1 (osd.1) 332 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:59:01.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:00.784060+0000 osd.1 (osd.1) 333 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:59:02.682 INFO:teuthology.orchestra.run.smithi080.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-02-19T21:59:03.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:01.355550+0000 mgr.y (mgr.14514) 1005 : cluster [DBG] pgmap v1313: 122 pgs: 122 active+clean; 5.7 KiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-19T21:59:03.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:01.527731+0000 mgr.y (mgr.14514) 1006 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:59:03.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:01.678359+0000 mon.a (mon.0) 2149 : cluster [DBG] osdmap e597: 8 total, 8 up, 8 in 2024-02-19T21:59:03.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:01.981114+0000 osd.3 (osd.3) 307 : cluster [DBG] 6.1f deep-scrub starts 2024-02-19T21:59:03.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:02.120061+0000 osd.3 (osd.3) 308 : cluster [DBG] 6.1f deep-scrub ok 2024-02-19T21:59:03.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:02.661815+0000 mon.c (mon.2) 145 : audit [INF] from='client.? 172.21.15.80:0/3230769014' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]: dispatch 2024-02-19T21:59:03.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:02.662117+0000 mon.a (mon.0) 2150 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]: dispatch 2024-02-19T21:59:03.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:01.355550+0000 mgr.y (mgr.14514) 1005 : cluster [DBG] pgmap v1313: 122 pgs: 122 active+clean; 5.7 KiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-19T21:59:03.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:01.527731+0000 mgr.y (mgr.14514) 1006 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:59:03.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:01.678359+0000 mon.a (mon.0) 2149 : cluster [DBG] osdmap e597: 8 total, 8 up, 8 in 2024-02-19T21:59:03.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:01.981114+0000 osd.3 (osd.3) 307 : cluster [DBG] 6.1f deep-scrub starts 2024-02-19T21:59:03.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:02.120061+0000 osd.3 (osd.3) 308 : cluster [DBG] 6.1f deep-scrub ok 2024-02-19T21:59:03.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:02.661815+0000 mon.c (mon.2) 145 : audit [INF] from='client.? 172.21.15.80:0/3230769014' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]: dispatch 2024-02-19T21:59:03.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:02.662117+0000 mon.a (mon.0) 2150 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]: dispatch 2024-02-19T21:59:03.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:01.355550+0000 mgr.y (mgr.14514) 1005 : cluster [DBG] pgmap v1313: 122 pgs: 122 active+clean; 5.7 KiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-19T21:59:03.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:01.527731+0000 mgr.y (mgr.14514) 1006 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:59:03.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:01.678359+0000 mon.a (mon.0) 2149 : cluster [DBG] osdmap e597: 8 total, 8 up, 8 in 2024-02-19T21:59:03.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:01.981114+0000 osd.3 (osd.3) 307 : cluster [DBG] 6.1f deep-scrub starts 2024-02-19T21:59:03.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:02.120061+0000 osd.3 (osd.3) 308 : cluster [DBG] 6.1f deep-scrub ok 2024-02-19T21:59:03.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:02.661815+0000 mon.c (mon.2) 145 : audit [INF] from='client.? 172.21.15.80:0/3230769014' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]: dispatch 2024-02-19T21:59:03.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:02.662117+0000 mon.a (mon.0) 2150 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]: dispatch 2024-02-19T21:59:03.347 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd reweight 2 1 2024-02-19T21:59:03.617 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:59:04.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:02.524240+0000 osd.4 (osd.4) 311 : cluster [DBG] 4.9 deep-scrub starts 2024-02-19T21:59:04.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:02.528224+0000 osd.4 (osd.4) 312 : cluster [DBG] 4.9 deep-scrub ok 2024-02-19T21:59:04.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:02.541754+0000 osd.7 (osd.7) 363 : cluster [DBG] 5.9 scrub starts 2024-02-19T21:59:04.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:02.545236+0000 osd.7 (osd.7) 364 : cluster [DBG] 5.9 scrub ok 2024-02-19T21:59:04.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:02.679908+0000 mon.a (mon.0) 2151 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]': finished 2024-02-19T21:59:04.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:02.679982+0000 mon.a (mon.0) 2152 : cluster [DBG] osdmap e598: 8 total, 8 up, 8 in 2024-02-19T21:59:04.088 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:02.524240+0000 osd.4 (osd.4) 311 : cluster [DBG] 4.9 deep-scrub starts 2024-02-19T21:59:04.089 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:02.528224+0000 osd.4 (osd.4) 312 : cluster [DBG] 4.9 deep-scrub ok 2024-02-19T21:59:04.089 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:02.541754+0000 osd.7 (osd.7) 363 : cluster [DBG] 5.9 scrub starts 2024-02-19T21:59:04.089 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:02.545236+0000 osd.7 (osd.7) 364 : cluster [DBG] 5.9 scrub ok 2024-02-19T21:59:04.089 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:02.679908+0000 mon.a (mon.0) 2151 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]': finished 2024-02-19T21:59:04.089 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:02.679982+0000 mon.a (mon.0) 2152 : cluster [DBG] osdmap e598: 8 total, 8 up, 8 in 2024-02-19T21:59:04.090 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:02.524240+0000 osd.4 (osd.4) 311 : cluster [DBG] 4.9 deep-scrub starts 2024-02-19T21:59:04.090 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:02.528224+0000 osd.4 (osd.4) 312 : cluster [DBG] 4.9 deep-scrub ok 2024-02-19T21:59:04.090 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:02.541754+0000 osd.7 (osd.7) 363 : cluster [DBG] 5.9 scrub starts 2024-02-19T21:59:04.090 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:02.545236+0000 osd.7 (osd.7) 364 : cluster [DBG] 5.9 scrub ok 2024-02-19T21:59:04.090 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:02.679908+0000 mon.a (mon.0) 2151 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]': finished 2024-02-19T21:59:04.090 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:03 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:02.679982+0000 mon.a (mon.0) 2152 : cluster [DBG] osdmap e598: 8 total, 8 up, 8 in 2024-02-19T21:59:04.820 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:03.355862+0000 mgr.y (mgr.14514) 1007 : cluster [DBG] pgmap v1316: 122 pgs: 122 active+clean; 5.7 KiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:59:04.820 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:03.418831+0000 osd.1 (osd.1) 334 : cluster [DBG] 5.12 deep-scrub starts 2024-02-19T21:59:04.820 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:03.420095+0000 osd.1 (osd.1) 335 : cluster [DBG] 5.12 deep-scrub ok 2024-02-19T21:59:04.820 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:03.478415+0000 osd.4 (osd.4) 313 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:59:04.821 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:03.528447+0000 osd.4 (osd.4) 314 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:59:04.821 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:04.045408+0000 osd.3 (osd.3) 309 : cluster [DBG] 4.17 scrub starts 2024-02-19T21:59:04.821 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:04.046871+0000 osd.3 (osd.3) 310 : cluster [DBG] 4.17 scrub ok 2024-02-19T21:59:04.821 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:04.578398+0000 osd.0 (osd.0) 37 : cluster [DBG] 6.10 scrub starts 2024-02-19T21:59:04.821 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:04.581289+0000 osd.0 (osd.0) 38 : cluster [DBG] 6.10 scrub ok 2024-02-19T21:59:04.821 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:03.355862+0000 mgr.y (mgr.14514) 1007 : cluster [DBG] pgmap v1316: 122 pgs: 122 active+clean; 5.7 KiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:59:04.821 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:03.418831+0000 osd.1 (osd.1) 334 : cluster [DBG] 5.12 deep-scrub starts 2024-02-19T21:59:04.822 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:03.420095+0000 osd.1 (osd.1) 335 : cluster [DBG] 5.12 deep-scrub ok 2024-02-19T21:59:04.822 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:03.478415+0000 osd.4 (osd.4) 313 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:59:04.822 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:03.528447+0000 osd.4 (osd.4) 314 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:59:04.822 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:04.045408+0000 osd.3 (osd.3) 309 : cluster [DBG] 4.17 scrub starts 2024-02-19T21:59:04.822 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:04.046871+0000 osd.3 (osd.3) 310 : cluster [DBG] 4.17 scrub ok 2024-02-19T21:59:04.822 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:04.578398+0000 osd.0 (osd.0) 37 : cluster [DBG] 6.10 scrub starts 2024-02-19T21:59:04.822 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:04.581289+0000 osd.0 (osd.0) 38 : cluster [DBG] 6.10 scrub ok 2024-02-19T21:59:05.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:03.355862+0000 mgr.y (mgr.14514) 1007 : cluster [DBG] pgmap v1316: 122 pgs: 122 active+clean; 5.7 KiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:59:05.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:03.418831+0000 osd.1 (osd.1) 334 : cluster [DBG] 5.12 deep-scrub starts 2024-02-19T21:59:05.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:03.420095+0000 osd.1 (osd.1) 335 : cluster [DBG] 5.12 deep-scrub ok 2024-02-19T21:59:05.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:03.478415+0000 osd.4 (osd.4) 313 : cluster [DBG] 6.1e scrub starts 2024-02-19T21:59:05.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:03.528447+0000 osd.4 (osd.4) 314 : cluster [DBG] 6.1e scrub ok 2024-02-19T21:59:05.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:04.045408+0000 osd.3 (osd.3) 309 : cluster [DBG] 4.17 scrub starts 2024-02-19T21:59:05.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:04.046871+0000 osd.3 (osd.3) 310 : cluster [DBG] 4.17 scrub ok 2024-02-19T21:59:05.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:04.578398+0000 osd.0 (osd.0) 37 : cluster [DBG] 6.10 scrub starts 2024-02-19T21:59:05.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:04.581289+0000 osd.0 (osd.0) 38 : cluster [DBG] 6.10 scrub ok 2024-02-19T21:59:06.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:59:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:59:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:59:06.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:04.412496+0000 osd.1 (osd.1) 336 : cluster [DBG] 4.4 deep-scrub starts 2024-02-19T21:59:06.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:04.419010+0000 osd.1 (osd.1) 337 : cluster [DBG] 4.4 deep-scrub ok 2024-02-19T21:59:06.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:04.498406+0000 osd.7 (osd.7) 365 : cluster [DBG] 5.10 scrub starts 2024-02-19T21:59:06.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:04.501321+0000 osd.7 (osd.7) 366 : cluster [DBG] 5.10 scrub ok 2024-02-19T21:59:06.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:05.524341+0000 mon.c (mon.2) 146 : audit [INF] from='client.? 172.21.15.80:0/2065413096' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-02-19T21:59:06.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:05.524671+0000 mon.a (mon.0) 2153 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-02-19T21:59:06.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:04.412496+0000 osd.1 (osd.1) 336 : cluster [DBG] 4.4 deep-scrub starts 2024-02-19T21:59:06.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:04.419010+0000 osd.1 (osd.1) 337 : cluster [DBG] 4.4 deep-scrub ok 2024-02-19T21:59:06.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:04.498406+0000 osd.7 (osd.7) 365 : cluster [DBG] 5.10 scrub starts 2024-02-19T21:59:06.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:04.501321+0000 osd.7 (osd.7) 366 : cluster [DBG] 5.10 scrub ok 2024-02-19T21:59:06.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:05.524341+0000 mon.c (mon.2) 146 : audit [INF] from='client.? 172.21.15.80:0/2065413096' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-02-19T21:59:06.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:05.524671+0000 mon.a (mon.0) 2153 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-02-19T21:59:06.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:04.412496+0000 osd.1 (osd.1) 336 : cluster [DBG] 4.4 deep-scrub starts 2024-02-19T21:59:06.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:04.419010+0000 osd.1 (osd.1) 337 : cluster [DBG] 4.4 deep-scrub ok 2024-02-19T21:59:06.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:04.498406+0000 osd.7 (osd.7) 365 : cluster [DBG] 5.10 scrub starts 2024-02-19T21:59:06.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:04.501321+0000 osd.7 (osd.7) 366 : cluster [DBG] 5.10 scrub ok 2024-02-19T21:59:06.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:05.524341+0000 mon.c (mon.2) 146 : audit [INF] from='client.? 172.21.15.80:0/2065413096' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-02-19T21:59:06.097 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:05 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:05.524671+0000 mon.a (mon.0) 2153 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-02-19T21:59:06.517 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.2 to 1 (10000) 2024-02-19T21:59:06.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:05.356223+0000 mgr.y (mgr.14514) 1008 : cluster [DBG] pgmap v1317: 122 pgs: 122 active+clean; 5.7 KiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 898 B/s rd, 0 op/s 2024-02-19T21:59:06.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:05.450142+0000 osd.1 (osd.1) 338 : cluster [DBG] 2.d scrub starts 2024-02-19T21:59:06.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:05.450999+0000 osd.1 (osd.1) 339 : cluster [DBG] 2.d scrub ok 2024-02-19T21:59:06.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:05.538406+0000 osd.7 (osd.7) 367 : cluster [DBG] 2.0 scrub starts 2024-02-19T21:59:06.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:05.541350+0000 osd.7 (osd.7) 368 : cluster [DBG] 2.0 scrub ok 2024-02-19T21:59:06.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:05.995086+0000 osd.3 (osd.3) 311 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:59:06.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:05.998853+0000 osd.3 (osd.3) 312 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:59:06.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:06.514672+0000 mon.a (mon.0) 2154 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-02-19T21:59:06.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:06.514756+0000 mon.a (mon.0) 2155 : cluster [DBG] osdmap e599: 8 total, 8 up, 8 in 2024-02-19T21:59:06.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:05.356223+0000 mgr.y (mgr.14514) 1008 : cluster [DBG] pgmap v1317: 122 pgs: 122 active+clean; 5.7 KiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 898 B/s rd, 0 op/s 2024-02-19T21:59:06.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:05.450142+0000 osd.1 (osd.1) 338 : cluster [DBG] 2.d scrub starts 2024-02-19T21:59:06.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:05.450999+0000 osd.1 (osd.1) 339 : cluster [DBG] 2.d scrub ok 2024-02-19T21:59:06.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:05.538406+0000 osd.7 (osd.7) 367 : cluster [DBG] 2.0 scrub starts 2024-02-19T21:59:06.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:05.541350+0000 osd.7 (osd.7) 368 : cluster [DBG] 2.0 scrub ok 2024-02-19T21:59:06.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:05.995086+0000 osd.3 (osd.3) 311 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:59:06.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:05.998853+0000 osd.3 (osd.3) 312 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:59:06.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:06.514672+0000 mon.a (mon.0) 2154 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-02-19T21:59:06.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:06.514756+0000 mon.a (mon.0) 2155 : cluster [DBG] osdmap e599: 8 total, 8 up, 8 in 2024-02-19T21:59:07.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:05.356223+0000 mgr.y (mgr.14514) 1008 : cluster [DBG] pgmap v1317: 122 pgs: 122 active+clean; 5.7 KiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 898 B/s rd, 0 op/s 2024-02-19T21:59:07.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:05.450142+0000 osd.1 (osd.1) 338 : cluster [DBG] 2.d scrub starts 2024-02-19T21:59:07.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:05.450999+0000 osd.1 (osd.1) 339 : cluster [DBG] 2.d scrub ok 2024-02-19T21:59:07.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:05.538406+0000 osd.7 (osd.7) 367 : cluster [DBG] 2.0 scrub starts 2024-02-19T21:59:07.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:05.541350+0000 osd.7 (osd.7) 368 : cluster [DBG] 2.0 scrub ok 2024-02-19T21:59:07.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:05.995086+0000 osd.3 (osd.3) 311 : cluster [DBG] 4.11 scrub starts 2024-02-19T21:59:07.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:05.998853+0000 osd.3 (osd.3) 312 : cluster [DBG] 4.11 scrub ok 2024-02-19T21:59:07.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:06.514672+0000 mon.a (mon.0) 2154 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-02-19T21:59:07.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:06.514756+0000 mon.a (mon.0) 2155 : cluster [DBG] osdmap e599: 8 total, 8 up, 8 in 2024-02-19T21:59:07.319 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd primary-affinity 2 1 2024-02-19T21:59:07.593 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:59:08.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:06.557332+0000 osd.7 (osd.7) 369 : cluster [DBG] 6.8 scrub starts 2024-02-19T21:59:08.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:06.560620+0000 osd.7 (osd.7) 370 : cluster [DBG] 6.8 scrub ok 2024-02-19T21:59:08.091 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:06.557332+0000 osd.7 (osd.7) 369 : cluster [DBG] 6.8 scrub starts 2024-02-19T21:59:08.091 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:06.560620+0000 osd.7 (osd.7) 370 : cluster [DBG] 6.8 scrub ok 2024-02-19T21:59:08.091 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:06.557332+0000 osd.7 (osd.7) 369 : cluster [DBG] 6.8 scrub starts 2024-02-19T21:59:08.091 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:06.560620+0000 osd.7 (osd.7) 370 : cluster [DBG] 6.8 scrub ok 2024-02-19T21:59:08.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:07.356643+0000 mgr.y (mgr.14514) 1009 : cluster [DBG] pgmap v1319: 122 pgs: 122 active+clean; 5.7 KiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:59:08.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:07.446922+0000 osd.1 (osd.1) 340 : cluster [DBG] 4.2 deep-scrub starts 2024-02-19T21:59:08.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:07.450876+0000 osd.1 (osd.1) 341 : cluster [DBG] 4.2 deep-scrub ok 2024-02-19T21:59:08.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:07.547788+0000 osd.7 (osd.7) 371 : cluster [DBG] 2.5 scrub starts 2024-02-19T21:59:08.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:07.550673+0000 osd.7 (osd.7) 372 : cluster [DBG] 2.5 scrub ok 2024-02-19T21:59:08.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:08.401512+0000 osd.5 (osd.5) 374 : cluster [DBG] 2.16 deep-scrub starts 2024-02-19T21:59:08.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:08.404484+0000 osd.5 (osd.5) 375 : cluster [DBG] 2.16 deep-scrub ok 2024-02-19T21:59:08.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:07.356643+0000 mgr.y (mgr.14514) 1009 : cluster [DBG] pgmap v1319: 122 pgs: 122 active+clean; 5.7 KiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:59:08.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:07.446922+0000 osd.1 (osd.1) 340 : cluster [DBG] 4.2 deep-scrub starts 2024-02-19T21:59:08.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:07.450876+0000 osd.1 (osd.1) 341 : cluster [DBG] 4.2 deep-scrub ok 2024-02-19T21:59:08.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:07.547788+0000 osd.7 (osd.7) 371 : cluster [DBG] 2.5 scrub starts 2024-02-19T21:59:08.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:07.550673+0000 osd.7 (osd.7) 372 : cluster [DBG] 2.5 scrub ok 2024-02-19T21:59:08.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:08.401512+0000 osd.5 (osd.5) 374 : cluster [DBG] 2.16 deep-scrub starts 2024-02-19T21:59:08.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:08.404484+0000 osd.5 (osd.5) 375 : cluster [DBG] 2.16 deep-scrub ok 2024-02-19T21:59:09.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:07.356643+0000 mgr.y (mgr.14514) 1009 : cluster [DBG] pgmap v1319: 122 pgs: 122 active+clean; 5.7 KiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:59:09.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:07.446922+0000 osd.1 (osd.1) 340 : cluster [DBG] 4.2 deep-scrub starts 2024-02-19T21:59:09.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:07.450876+0000 osd.1 (osd.1) 341 : cluster [DBG] 4.2 deep-scrub ok 2024-02-19T21:59:09.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:07.547788+0000 osd.7 (osd.7) 371 : cluster [DBG] 2.5 scrub starts 2024-02-19T21:59:09.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:07.550673+0000 osd.7 (osd.7) 372 : cluster [DBG] 2.5 scrub ok 2024-02-19T21:59:09.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:08.401512+0000 osd.5 (osd.5) 374 : cluster [DBG] 2.16 deep-scrub starts 2024-02-19T21:59:09.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:08.404484+0000 osd.5 (osd.5) 375 : cluster [DBG] 2.16 deep-scrub ok 2024-02-19T21:59:09.716 INFO:teuthology.orchestra.run.smithi080.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-02-19T21:59:10.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:08.427908+0000 osd.4 (osd.4) 315 : cluster [DBG] 6.e scrub starts 2024-02-19T21:59:10.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:08.482604+0000 osd.4 (osd.4) 316 : cluster [DBG] 6.e scrub ok 2024-02-19T21:59:10.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:09.357695+0000 osd.5 (osd.5) 376 : cluster [DBG] 6.d scrub starts 2024-02-19T21:59:10.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:09.439064+0000 osd.5 (osd.5) 377 : cluster [DBG] 6.d scrub ok 2024-02-19T21:59:10.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:09.650173+0000 mon.c (mon.2) 147 : audit [INF] from='client.? 172.21.15.80:0/1689888484' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]: dispatch 2024-02-19T21:59:10.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:09.650468+0000 mon.a (mon.0) 2156 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]: dispatch 2024-02-19T21:59:10.046 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:08.427908+0000 osd.4 (osd.4) 315 : cluster [DBG] 6.e scrub starts 2024-02-19T21:59:10.046 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:08.482604+0000 osd.4 (osd.4) 316 : cluster [DBG] 6.e scrub ok 2024-02-19T21:59:10.046 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:09.357695+0000 osd.5 (osd.5) 376 : cluster [DBG] 6.d scrub starts 2024-02-19T21:59:10.046 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:09.439064+0000 osd.5 (osd.5) 377 : cluster [DBG] 6.d scrub ok 2024-02-19T21:59:10.046 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:09.650173+0000 mon.c (mon.2) 147 : audit [INF] from='client.? 172.21.15.80:0/1689888484' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]: dispatch 2024-02-19T21:59:10.046 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:09.650468+0000 mon.a (mon.0) 2156 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]: dispatch 2024-02-19T21:59:10.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:08.427908+0000 osd.4 (osd.4) 315 : cluster [DBG] 6.e scrub starts 2024-02-19T21:59:10.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:08.482604+0000 osd.4 (osd.4) 316 : cluster [DBG] 6.e scrub ok 2024-02-19T21:59:10.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:09.357695+0000 osd.5 (osd.5) 376 : cluster [DBG] 6.d scrub starts 2024-02-19T21:59:10.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:09.439064+0000 osd.5 (osd.5) 377 : cluster [DBG] 6.d scrub ok 2024-02-19T21:59:10.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:09.650173+0000 mon.c (mon.2) 147 : audit [INF] from='client.? 172.21.15.80:0/1689888484' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]: dispatch 2024-02-19T21:59:10.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:09.650468+0000 mon.a (mon.0) 2156 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]: dispatch 2024-02-19T21:59:10.481 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd reweight 0 1 2024-02-19T21:59:10.721 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:09.357060+0000 mgr.y (mgr.14514) 1010 : cluster [DBG] pgmap v1320: 122 pgs: 122 active+clean; 5.7 KiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 666 B/s rd, 0 op/s 2024-02-19T21:59:10.721 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:09.711769+0000 mon.a (mon.0) 2157 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]': finished 2024-02-19T21:59:10.721 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:09.711840+0000 mon.a (mon.0) 2158 : cluster [DBG] osdmap e600: 8 total, 8 up, 8 in 2024-02-19T21:59:10.721 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:09.823214+0000 osd.2 (osd.2) 105 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:59:10.721 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:09.824802+0000 osd.2 (osd.2) 106 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:59:10.777 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:59:11.032 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:59:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:59:10] "GET /metrics HTTP/1.1" 200 174237 "" "Prometheus/2.33.4" 2024-02-19T21:59:11.033 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:09.357060+0000 mgr.y (mgr.14514) 1010 : cluster [DBG] pgmap v1320: 122 pgs: 122 active+clean; 5.7 KiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 666 B/s rd, 0 op/s 2024-02-19T21:59:11.033 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:09.711769+0000 mon.a (mon.0) 2157 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]': finished 2024-02-19T21:59:11.033 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:09.711840+0000 mon.a (mon.0) 2158 : cluster [DBG] osdmap e600: 8 total, 8 up, 8 in 2024-02-19T21:59:11.033 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:09.823214+0000 osd.2 (osd.2) 105 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:59:11.033 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:09.824802+0000 osd.2 (osd.2) 106 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:59:11.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:09.357060+0000 mgr.y (mgr.14514) 1010 : cluster [DBG] pgmap v1320: 122 pgs: 122 active+clean; 5.7 KiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 666 B/s rd, 0 op/s 2024-02-19T21:59:11.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:09.711769+0000 mon.a (mon.0) 2157 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]': finished 2024-02-19T21:59:11.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:09.711840+0000 mon.a (mon.0) 2158 : cluster [DBG] osdmap e600: 8 total, 8 up, 8 in 2024-02-19T21:59:11.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:09.823214+0000 osd.2 (osd.2) 105 : cluster [DBG] 6.14 scrub starts 2024-02-19T21:59:11.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:09.824802+0000 osd.2 (osd.2) 106 : cluster [DBG] 6.14 scrub ok 2024-02-19T21:59:11.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:59:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:59:11.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:10.391121+0000 osd.1 (osd.1) 342 : cluster [DBG] 4.12 scrub starts 2024-02-19T21:59:11.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:10.392899+0000 osd.1 (osd.1) 343 : cluster [DBG] 4.12 scrub ok 2024-02-19T21:59:11.976 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:10.391121+0000 osd.1 (osd.1) 342 : cluster [DBG] 4.12 scrub starts 2024-02-19T21:59:11.976 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:10.392899+0000 osd.1 (osd.1) 343 : cluster [DBG] 4.12 scrub ok 2024-02-19T21:59:11.976 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:10.391121+0000 osd.1 (osd.1) 342 : cluster [DBG] 4.12 scrub starts 2024-02-19T21:59:11.976 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:11 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:10.392899+0000 osd.1 (osd.1) 343 : cluster [DBG] 4.12 scrub ok 2024-02-19T21:59:13.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:10.999725+0000 osd.6 (osd.6) 335 : cluster [DBG] 2.1a scrub starts 2024-02-19T21:59:13.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:11.002633+0000 osd.6 (osd.6) 336 : cluster [DBG] 2.1a scrub ok 2024-02-19T21:59:13.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:11.357810+0000 mgr.y (mgr.14514) 1011 : cluster [DBG] pgmap v1322: 122 pgs: 122 active+clean; 5.7 KiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:59:13.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:11.475624+0000 osd.4 (osd.4) 317 : cluster [DBG] 4.e scrub starts 2024-02-19T21:59:13.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:11.479404+0000 osd.4 (osd.4) 318 : cluster [DBG] 4.e scrub ok 2024-02-19T21:59:13.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:11.532018+0000 mgr.y (mgr.14514) 1012 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:59:13.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:11.966376+0000 osd.3 (osd.3) 313 : cluster [DBG] 6.b scrub starts 2024-02-19T21:59:13.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:12.077378+0000 osd.3 (osd.3) 314 : cluster [DBG] 6.b scrub ok 2024-02-19T21:59:13.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:12.082942+0000 osd.5 (osd.5) 378 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:59:13.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:12.082987+0000 osd.5 (osd.5) 379 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:59:13.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:10.999725+0000 osd.6 (osd.6) 335 : cluster [DBG] 2.1a scrub starts 2024-02-19T21:59:13.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:11.002633+0000 osd.6 (osd.6) 336 : cluster [DBG] 2.1a scrub ok 2024-02-19T21:59:13.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:11.357810+0000 mgr.y (mgr.14514) 1011 : cluster [DBG] pgmap v1322: 122 pgs: 122 active+clean; 5.7 KiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:59:13.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:11.475624+0000 osd.4 (osd.4) 317 : cluster [DBG] 4.e scrub starts 2024-02-19T21:59:13.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:11.479404+0000 osd.4 (osd.4) 318 : cluster [DBG] 4.e scrub ok 2024-02-19T21:59:13.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:11.532018+0000 mgr.y (mgr.14514) 1012 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:59:13.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:11.966376+0000 osd.3 (osd.3) 313 : cluster [DBG] 6.b scrub starts 2024-02-19T21:59:13.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:12.077378+0000 osd.3 (osd.3) 314 : cluster [DBG] 6.b scrub ok 2024-02-19T21:59:13.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:12.082942+0000 osd.5 (osd.5) 378 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:59:13.097 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:12.082987+0000 osd.5 (osd.5) 379 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:59:13.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:10.999725+0000 osd.6 (osd.6) 335 : cluster [DBG] 2.1a scrub starts 2024-02-19T21:59:13.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:11.002633+0000 osd.6 (osd.6) 336 : cluster [DBG] 2.1a scrub ok 2024-02-19T21:59:13.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:11.357810+0000 mgr.y (mgr.14514) 1011 : cluster [DBG] pgmap v1322: 122 pgs: 122 active+clean; 5.7 KiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:59:13.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:11.475624+0000 osd.4 (osd.4) 317 : cluster [DBG] 4.e scrub starts 2024-02-19T21:59:13.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:11.479404+0000 osd.4 (osd.4) 318 : cluster [DBG] 4.e scrub ok 2024-02-19T21:59:13.098 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:11.532018+0000 mgr.y (mgr.14514) 1012 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:59:13.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:11.966376+0000 osd.3 (osd.3) 313 : cluster [DBG] 6.b scrub starts 2024-02-19T21:59:13.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:12.077378+0000 osd.3 (osd.3) 314 : cluster [DBG] 6.b scrub ok 2024-02-19T21:59:13.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:12.082942+0000 osd.5 (osd.5) 378 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:59:13.099 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:12.082987+0000 osd.5 (osd.5) 379 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:59:13.741 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.0 to 1 (10000) 2024-02-19T21:59:14.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:12.734082+0000 mon.a (mon.0) 2159 : cluster [DBG] osdmap e601: 8 total, 8 up, 8 in 2024-02-19T21:59:14.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:12.797181+0000 mon.c (mon.2) 148 : audit [INF] from='client.? 172.21.15.80:0/1260501692' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-19T21:59:14.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:12.797438+0000 mon.a (mon.0) 2160 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-19T21:59:14.095 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:12.734082+0000 mon.a (mon.0) 2159 : cluster [DBG] osdmap e601: 8 total, 8 up, 8 in 2024-02-19T21:59:14.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:12.797181+0000 mon.c (mon.2) 148 : audit [INF] from='client.? 172.21.15.80:0/1260501692' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-19T21:59:14.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:12.797438+0000 mon.a (mon.0) 2160 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-19T21:59:14.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:12.734082+0000 mon.a (mon.0) 2159 : cluster [DBG] osdmap e601: 8 total, 8 up, 8 in 2024-02-19T21:59:14.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:12.797181+0000 mon.c (mon.2) 148 : audit [INF] from='client.? 172.21.15.80:0/1260501692' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-19T21:59:14.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:12.797438+0000 mon.a (mon.0) 2160 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-02-19T21:59:14.549 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd primary-affinity 0 1 2024-02-19T21:59:14.823 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:59:14.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:13.358406+0000 mgr.y (mgr.14514) 1013 : cluster [DBG] pgmap v1324: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 747 B/s rd, 0 op/s 2024-02-19T21:59:14.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:13.736888+0000 mon.a (mon.0) 2161 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-02-19T21:59:14.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:13.736988+0000 mon.a (mon.0) 2162 : cluster [DBG] osdmap e602: 8 total, 8 up, 8 in 2024-02-19T21:59:14.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:13.358406+0000 mgr.y (mgr.14514) 1013 : cluster [DBG] pgmap v1324: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 747 B/s rd, 0 op/s 2024-02-19T21:59:14.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:13.736888+0000 mon.a (mon.0) 2161 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-02-19T21:59:14.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:13.736988+0000 mon.a (mon.0) 2162 : cluster [DBG] osdmap e602: 8 total, 8 up, 8 in 2024-02-19T21:59:15.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:13.358406+0000 mgr.y (mgr.14514) 1013 : cluster [DBG] pgmap v1324: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 747 B/s rd, 0 op/s 2024-02-19T21:59:15.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:13.736888+0000 mon.a (mon.0) 2161 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-02-19T21:59:15.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:13.736988+0000 mon.a (mon.0) 2162 : cluster [DBG] osdmap e602: 8 total, 8 up, 8 in 2024-02-19T21:59:16.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:14.628379+0000 osd.0 (osd.0) 39 : cluster [DBG] 2.1f scrub starts 2024-02-19T21:59:16.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:14.629481+0000 osd.0 (osd.0) 40 : cluster [DBG] 2.1f scrub ok 2024-02-19T21:59:16.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:59:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:59:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:59:16.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:14.628379+0000 osd.0 (osd.0) 39 : cluster [DBG] 2.1f scrub starts 2024-02-19T21:59:16.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:14.629481+0000 osd.0 (osd.0) 40 : cluster [DBG] 2.1f scrub ok 2024-02-19T21:59:16.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:14.628379+0000 osd.0 (osd.0) 39 : cluster [DBG] 2.1f scrub starts 2024-02-19T21:59:16.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:15 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:14.629481+0000 osd.0 (osd.0) 40 : cluster [DBG] 2.1f scrub ok 2024-02-19T21:59:17.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:15.358788+0000 mgr.y (mgr.14514) 1014 : cluster [DBG] pgmap v1326: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:59:17.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:15.648120+0000 osd.0 (osd.0) 41 : cluster [DBG] 6.9 deep-scrub starts 2024-02-19T21:59:17.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:15.681549+0000 osd.0 (osd.0) 42 : cluster [DBG] 6.9 deep-scrub ok 2024-02-19T21:59:17.095 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:15.358788+0000 mgr.y (mgr.14514) 1014 : cluster [DBG] pgmap v1326: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:59:17.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:15.648120+0000 osd.0 (osd.0) 41 : cluster [DBG] 6.9 deep-scrub starts 2024-02-19T21:59:17.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:15.681549+0000 osd.0 (osd.0) 42 : cluster [DBG] 6.9 deep-scrub ok 2024-02-19T21:59:17.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:15.358788+0000 mgr.y (mgr.14514) 1014 : cluster [DBG] pgmap v1326: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:59:17.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:15.648120+0000 osd.0 (osd.0) 41 : cluster [DBG] 6.9 deep-scrub starts 2024-02-19T21:59:17.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:15.681549+0000 osd.0 (osd.0) 42 : cluster [DBG] 6.9 deep-scrub ok 2024-02-19T21:59:17.756 INFO:teuthology.orchestra.run.smithi080.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-02-19T21:59:18.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:16.756801+0000 mon.c (mon.2) 149 : audit [INF] from='client.? 172.21.15.80:0/2995033565' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2024-02-19T21:59:18.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:16.757119+0000 mon.a (mon.0) 2163 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2024-02-19T21:59:18.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:16.988629+0000 osd.3 (osd.3) 315 : cluster [DBG] 3.2 scrub starts 2024-02-19T21:59:18.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:16.991912+0000 osd.3 (osd.3) 316 : cluster [DBG] 3.2 scrub ok 2024-02-19T21:59:18.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:17.455097+0000 osd.5 (osd.5) 380 : cluster [DBG] 6.a scrub starts 2024-02-19T21:59:18.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:17.456003+0000 osd.5 (osd.5) 381 : cluster [DBG] 6.a scrub ok 2024-02-19T21:59:18.069 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:16.756801+0000 mon.c (mon.2) 149 : audit [INF] from='client.? 172.21.15.80:0/2995033565' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2024-02-19T21:59:18.069 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:16.757119+0000 mon.a (mon.0) 2163 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2024-02-19T21:59:18.069 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:16.988629+0000 osd.3 (osd.3) 315 : cluster [DBG] 3.2 scrub starts 2024-02-19T21:59:18.069 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:16.991912+0000 osd.3 (osd.3) 316 : cluster [DBG] 3.2 scrub ok 2024-02-19T21:59:18.069 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:17.455097+0000 osd.5 (osd.5) 380 : cluster [DBG] 6.a scrub starts 2024-02-19T21:59:18.069 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:17.456003+0000 osd.5 (osd.5) 381 : cluster [DBG] 6.a scrub ok 2024-02-19T21:59:18.070 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:16.756801+0000 mon.c (mon.2) 149 : audit [INF] from='client.? 172.21.15.80:0/2995033565' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2024-02-19T21:59:18.070 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:16.757119+0000 mon.a (mon.0) 2163 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2024-02-19T21:59:18.070 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:16.988629+0000 osd.3 (osd.3) 315 : cluster [DBG] 3.2 scrub starts 2024-02-19T21:59:18.070 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:16.991912+0000 osd.3 (osd.3) 316 : cluster [DBG] 3.2 scrub ok 2024-02-19T21:59:18.071 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:17.455097+0000 osd.5 (osd.5) 380 : cluster [DBG] 6.a scrub starts 2024-02-19T21:59:18.071 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:17.456003+0000 osd.5 (osd.5) 381 : cluster [DBG] 6.a scrub ok 2024-02-19T21:59:18.500 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-02-19T21:59:18.500 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-02-19T21:59:18.500 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-02-19T21:59:18.500 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-02-19T21:59:18.500 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-02-19T21:59:18.501 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd dump --format=json 2024-02-19T21:59:18.755 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:17.359521+0000 mgr.y (mgr.14514) 1015 : cluster [DBG] pgmap v1327: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-19T21:59:18.755 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:17.450792+0000 osd.4 (osd.4) 319 : cluster [DBG] 4.d scrub starts 2024-02-19T21:59:18.755 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:17.454302+0000 osd.4 (osd.4) 320 : cluster [DBG] 4.d scrub ok 2024-02-19T21:59:18.755 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:17.752030+0000 mon.a (mon.0) 2164 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]': finished 2024-02-19T21:59:18.755 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:17.752131+0000 mon.a (mon.0) 2165 : cluster [DBG] osdmap e603: 8 total, 8 up, 8 in 2024-02-19T21:59:18.756 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:18.087804+0000 osd.6 (osd.6) 337 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:59:18.756 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:18.090743+0000 osd.6 (osd.6) 338 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:59:18.756 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:18.432247+0000 osd.5 (osd.5) 382 : cluster [DBG] 5.15 scrub starts 2024-02-19T21:59:18.756 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:18.433572+0000 osd.5 (osd.5) 383 : cluster [DBG] 5.15 scrub ok 2024-02-19T21:59:18.756 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:17.359521+0000 mgr.y (mgr.14514) 1015 : cluster [DBG] pgmap v1327: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-19T21:59:18.756 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:17.450792+0000 osd.4 (osd.4) 319 : cluster [DBG] 4.d scrub starts 2024-02-19T21:59:18.756 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:17.454302+0000 osd.4 (osd.4) 320 : cluster [DBG] 4.d scrub ok 2024-02-19T21:59:18.756 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:17.752030+0000 mon.a (mon.0) 2164 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]': finished 2024-02-19T21:59:18.756 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:17.752131+0000 mon.a (mon.0) 2165 : cluster [DBG] osdmap e603: 8 total, 8 up, 8 in 2024-02-19T21:59:18.756 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:18.087804+0000 osd.6 (osd.6) 337 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:59:18.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:18.090743+0000 osd.6 (osd.6) 338 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:59:18.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:18.432247+0000 osd.5 (osd.5) 382 : cluster [DBG] 5.15 scrub starts 2024-02-19T21:59:18.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:18.433572+0000 osd.5 (osd.5) 383 : cluster [DBG] 5.15 scrub ok 2024-02-19T21:59:18.775 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:59:19.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:17.359521+0000 mgr.y (mgr.14514) 1015 : cluster [DBG] pgmap v1327: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-19T21:59:19.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:17.450792+0000 osd.4 (osd.4) 319 : cluster [DBG] 4.d scrub starts 2024-02-19T21:59:19.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:17.454302+0000 osd.4 (osd.4) 320 : cluster [DBG] 4.d scrub ok 2024-02-19T21:59:19.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:17.752030+0000 mon.a (mon.0) 2164 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]': finished 2024-02-19T21:59:19.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:17.752131+0000 mon.a (mon.0) 2165 : cluster [DBG] osdmap e603: 8 total, 8 up, 8 in 2024-02-19T21:59:19.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:18.087804+0000 osd.6 (osd.6) 337 : cluster [DBG] 5.1 scrub starts 2024-02-19T21:59:19.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:18.090743+0000 osd.6 (osd.6) 338 : cluster [DBG] 5.1 scrub ok 2024-02-19T21:59:19.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:18.432247+0000 osd.5 (osd.5) 382 : cluster [DBG] 5.15 scrub starts 2024-02-19T21:59:19.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:18.433572+0000 osd.5 (osd.5) 383 : cluster [DBG] 5.15 scrub ok 2024-02-19T21:59:20.041 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:18.438978+0000 osd.4 (osd.4) 321 : cluster [DBG] 2.f scrub starts 2024-02-19T21:59:20.041 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:18.440249+0000 osd.4 (osd.4) 322 : cluster [DBG] 2.f scrub ok 2024-02-19T21:59:20.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:18.894783+0000 osd.2 (osd.2) 107 : cluster [DBG] 5.b deep-scrub starts 2024-02-19T21:59:20.042 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:18.895702+0000 osd.2 (osd.2) 108 : cluster [DBG] 5.b deep-scrub ok 2024-02-19T21:59:20.042 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:18.438978+0000 osd.4 (osd.4) 321 : cluster [DBG] 2.f scrub starts 2024-02-19T21:59:20.042 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:18.440249+0000 osd.4 (osd.4) 322 : cluster [DBG] 2.f scrub ok 2024-02-19T21:59:20.042 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:18.894783+0000 osd.2 (osd.2) 107 : cluster [DBG] 5.b deep-scrub starts 2024-02-19T21:59:20.043 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:18.895702+0000 osd.2 (osd.2) 108 : cluster [DBG] 5.b deep-scrub ok 2024-02-19T21:59:20.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:18.438978+0000 osd.4 (osd.4) 321 : cluster [DBG] 2.f scrub starts 2024-02-19T21:59:20.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:18.440249+0000 osd.4 (osd.4) 322 : cluster [DBG] 2.f scrub ok 2024-02-19T21:59:20.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:18.894783+0000 osd.2 (osd.2) 107 : cluster [DBG] 5.b deep-scrub starts 2024-02-19T21:59:20.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:18.895702+0000 osd.2 (osd.2) 108 : cluster [DBG] 5.b deep-scrub ok 2024-02-19T21:59:20.702 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:59:20.702 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":604,"fsid":"6f763558-cf6d-11ee-95bb-87774f69a715","created":"2024-02-19T21:26:16.880265+0000","modified":"2024-02-19T21:59:20.511830+0000","last_up_change":"2024-02-19T21:57:57.541697+0000","last_in_change":"2024-02-19T21:53:44.626155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-19T21:30:05.947623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-02-19T21:32:22.082250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"533","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2024-02-19T21:32:22.333164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2024-02-19T21:32:23.632615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-02-19T21:32:25.600876+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":22,"pg_placement_num":22,"pg_placement_num_target":22,"pg_num_target":22,"pg_num_pending":22,"last_pg_merge_meta":{"source_pgid":"5.16","ready_epoch":298,"last_epoch_started":297,"last_epoch_clean":297,"source_version":"0'0","target_version":"0'0"},"last_change":"325","last_force_op_resend":"0","last_force_op_resend_prenautilus":"298","last_force_op_resend_preluminous":"296","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-02-19T21:32:27.661242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"6.16","ready_epoch":243,"last_epoch_started":242,"last_epoch_clean":242,"source_version":"0'0","target_version":"0'0"},"last_change":"572","last_force_op_resend":"0","last_force_op_resend_prenautilus":"243","last_force_op_resend_preluminous":"302","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"a72c63f6-46b3-4202-99da-7b0c92b799a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":549,"up_from":568,"up_thru":579,"down_at":550,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":351222871},{"type":"v1","addr":"172.21.15.80:6803","nonce":351222871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":351222871},{"type":"v1","addr":"172.21.15.80:6805","nonce":351222871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":351222871},{"type":"v1","addr":"172.21.15.80:6809","nonce":351222871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":351222871},{"type":"v1","addr":"172.21.15.80:6807","nonce":351222871}]},"public_addr":"172.21.15.80:6803/351222871","cluster_addr":"172.21.15.80:6805/351222871","heartbeat_back_addr":"172.21.15.80:6809/351222871","heartbeat_front_addr":"172.21.15.80:6807/351222871","state":["exists","up"]},{"osd":1,"uuid":"7d4e170e-b0ca-4e19-be35-4038ca126ee6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":579,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1497235950},{"type":"v1","addr":"172.21.15.80:6811","nonce":1497235950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1497235950},{"type":"v1","addr":"172.21.15.80:6813","nonce":1497235950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1497235950},{"type":"v1","addr":"172.21.15.80:6817","nonce":1497235950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1497235950},{"type":"v1","addr":"172.21.15.80:6815","nonce":1497235950}]},"public_addr":"172.21.15.80:6811/1497235950","cluster_addr":"172.21.15.80:6813/1497235950","heartbeat_back_addr":"172.21.15.80:6817/1497235950","heartbeat_front_addr":"172.21.15.80:6815/1497235950","state":["exists","up"]},{"osd":2,"uuid":"cf461b67-f3e8-45e9-b2f6-777752ba5574","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":18,"last_clean_end":369,"up_from":394,"up_thru":579,"down_at":370,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2441376667},{"type":"v1","addr":"172.21.15.80:6819","nonce":2441376667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":2441376667},{"type":"v1","addr":"172.21.15.80:6821","nonce":2441376667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":2441376667},{"type":"v1","addr":"172.21.15.80:6825","nonce":2441376667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":2441376667},{"type":"v1","addr":"172.21.15.80:6823","nonce":2441376667}]},"public_addr":"172.21.15.80:6819/2441376667","cluster_addr":"172.21.15.80:6821/2441376667","heartbeat_back_addr":"172.21.15.80:6825/2441376667","heartbeat_front_addr":"172.21.15.80:6823/2441376667","state":["exists","up"]},{"osd":3,"uuid":"76318cdd-5fce-4a40-95c9-300d55c34820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":582,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2007978078},{"type":"v1","addr":"172.21.15.80:6827","nonce":2007978078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2007978078},{"type":"v1","addr":"172.21.15.80:6829","nonce":2007978078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2007978078},{"type":"v1","addr":"172.21.15.80:6833","nonce":2007978078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2007978078},{"type":"v1","addr":"172.21.15.80:6831","nonce":2007978078}]},"public_addr":"172.21.15.80:6827/2007978078","cluster_addr":"172.21.15.80:6829/2007978078","heartbeat_back_addr":"172.21.15.80:6833/2007978078","heartbeat_front_addr":"172.21.15.80:6831/2007978078","state":["exists","up"]},{"osd":4,"uuid":"6484964f-3391-4e1d-a56c-813f46124062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":579,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1922002860},{"type":"v1","addr":"172.21.15.157:6801","nonce":1922002860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1922002860},{"type":"v1","addr":"172.21.15.157:6803","nonce":1922002860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1922002860},{"type":"v1","addr":"172.21.15.157:6807","nonce":1922002860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1922002860},{"type":"v1","addr":"172.21.15.157:6805","nonce":1922002860}]},"public_addr":"172.21.15.157:6801/1922002860","cluster_addr":"172.21.15.157:6803/1922002860","heartbeat_back_addr":"172.21.15.157:6807/1922002860","heartbeat_front_addr":"172.21.15.157:6805/1922002860","state":["exists","up"]},{"osd":5,"uuid":"8c7e0309-8c3b-40b9-99d9-96620e52742f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":581,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":960889603},{"type":"v1","addr":"172.21.15.157:6809","nonce":960889603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":960889603},{"type":"v1","addr":"172.21.15.157:6811","nonce":960889603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":960889603},{"type":"v1","addr":"172.21.15.157:6815","nonce":960889603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":960889603},{"type":"v1","addr":"172.21.15.157:6813","nonce":960889603}]},"public_addr":"172.21.15.157:6809/960889603","cluster_addr":"172.21.15.157:6811/960889603","heartbeat_back_addr":"172.21.15.157:6815/960889603","heartbeat_front_addr":"172.21.15.157:6813/960889603","state":["exists","up"]},{"osd":6,"uuid":"5b7d44a3-197d-482c-bf9e-de5e9013a851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":579,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":2598265223},{"type":"v1","addr":"172.21.15.157:6817","nonce":2598265223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":2598265223},{"type":"v1","addr":"172.21.15.157:6819","nonce":2598265223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":2598265223},{"type":"v1","addr":"172.21.15.157:6823","nonce":2598265223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":2598265223},{"type":"v1","addr":"172.21.15.157:6821","nonce":2598265223}]},"public_addr":"172.21.15.157:6817/2598265223","cluster_addr":"172.21.15.157:6819/2598265223","heartbeat_back_addr":"172.21.15.157:6823/2598265223","heartbeat_front_addr":"172.21.15.157:6821/2598265223","state":["exists","up"]},{"osd":7,"uuid":"7e2d0287-928d-40f8-841b-6c2077fc08ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":568,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3619345894},{"type":"v1","addr":"172.21.15.157:6825","nonce":3619345894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3619345894},{"type":"v1","addr":"172.21.15.157:6827","nonce":3619345894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3619345894},{"type":"v1","addr":"172.21.15.157:6831","nonce":3619345894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3619345894},{"type":"v1","addr":"172.21.15.157:6829","nonce":3619345894}]},"public_addr":"172.21.15.157:6825/3619345894","cluster_addr":"172.21.15.157:6827/3619345894","heartbeat_back_addr":"172.21.15.157:6831/3619345894","heartbeat_front_addr":"172.21.15.157:6829/3619345894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:58:01.546272+0000","dead_epoch":549},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:59:00.784064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:57:59.622212+0000","dead_epoch":369},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:58:41.283662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:59:19.838392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:59:12.082990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:58:44.719312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:58:09.396114+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.c","osds":[6,7,2]},{"pgid":"4.1","osds":[4,2,6]},{"pgid":"6.12","osds":[5,7,6]}],"pg_upmap_items":[{"pgid":"2.3","mappings":[{"from":7,"to":1}]},{"pgid":"2.10","mappings":[{"from":1,"to":4}]},{"pgid":"2.1b","mappings":[{"from":7,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":7}]},{"pgid":"4.f","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":7},{"from":6,"to":0}]},{"pgid":"5.1","mappings":[{"from":4,"to":6}]},{"pgid":"5.13","mappings":[{"from":0,"to":6}]},{"pgid":"6.f","mappings":[{"from":4,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6800/2867197629":"2024-02-20T21:32:48.748960+0000","172.21.15.80:0/1659656010":"2024-02-20T21:32:48.748960+0000","172.21.15.80:6801/2272739550":"2024-02-20T21:27:15.880876+0000","172.21.15.80:0/867908385":"2024-02-20T21:27:15.880876+0000","172.21.15.80:0/398750494":"2024-02-20T21:32:48.748960+0000","172.21.15.80:0/2833137430":"2024-02-20T21:27:15.880876+0000","172.21.15.80:0/2520755315":"2024-02-20T21:32:48.748960+0000","172.21.15.80:6800/2094869828":"2024-02-20T21:26:51.262073+0000","172.21.15.80:6800/2272739550":"2024-02-20T21:27:15.880876+0000","172.21.15.80:6801/2094869828":"2024-02-20T21:26:51.262073+0000","172.21.15.80:0/2130852198":"2024-02-20T21:26:51.262073+0000","172.21.15.80:6801/2867197629":"2024-02-20T21:32:48.748960+0000","172.21.15.80:0/1952386920":"2024-02-20T21:26:51.262073+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T21:59:21.043 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:59:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:59:20] "GET /metrics HTTP/1.1" 200 174237 "" "Prometheus/2.33.4" 2024-02-19T21:59:21.043 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:19.359902+0000 mgr.y (mgr.14514) 1016 : cluster [DBG] pgmap v1329: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 772 B/s rd, 0 op/s 2024-02-19T21:59:21.043 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:19.606714+0000 osd.1 (osd.1) 344 : cluster [DBG] 2.9 scrub starts 2024-02-19T21:59:21.043 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:19.609956+0000 osd.1 (osd.1) 345 : cluster [DBG] 2.9 scrub ok 2024-02-19T21:59:21.043 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:19.660622+0000 osd.7 (osd.7) 373 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:59:21.044 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:19.663745+0000 osd.7 (osd.7) 374 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:59:21.044 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:19.838300+0000 osd.4 (osd.4) 323 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:59:21.044 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:19.838388+0000 osd.4 (osd.4) 324 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:59:21.044 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:20.492805+0000 osd.5 (osd.5) 384 : cluster [DBG] 2.12 scrub starts 2024-02-19T21:59:21.044 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:20.493795+0000 osd.5 (osd.5) 385 : cluster [DBG] 2.12 scrub ok 2024-02-19T21:59:21.044 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:20.518645+0000 mon.a (mon.0) 2166 : cluster [DBG] osdmap e604: 8 total, 8 up, 8 in 2024-02-19T21:59:21.044 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:20.702069+0000 mon.c (mon.2) 150 : audit [DBG] from='client.? 172.21.15.80:0/259471232' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:59:21.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:19.359902+0000 mgr.y (mgr.14514) 1016 : cluster [DBG] pgmap v1329: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 772 B/s rd, 0 op/s 2024-02-19T21:59:21.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:19.606714+0000 osd.1 (osd.1) 344 : cluster [DBG] 2.9 scrub starts 2024-02-19T21:59:21.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:19.609956+0000 osd.1 (osd.1) 345 : cluster [DBG] 2.9 scrub ok 2024-02-19T21:59:21.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:19.660622+0000 osd.7 (osd.7) 373 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:59:21.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:19.663745+0000 osd.7 (osd.7) 374 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:59:21.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:19.838300+0000 osd.4 (osd.4) 323 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:59:21.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:19.838388+0000 osd.4 (osd.4) 324 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:59:21.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:20.492805+0000 osd.5 (osd.5) 384 : cluster [DBG] 2.12 scrub starts 2024-02-19T21:59:21.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:20.493795+0000 osd.5 (osd.5) 385 : cluster [DBG] 2.12 scrub ok 2024-02-19T21:59:21.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:20.518645+0000 mon.a (mon.0) 2166 : cluster [DBG] osdmap e604: 8 total, 8 up, 8 in 2024-02-19T21:59:21.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:20.702069+0000 mon.c (mon.2) 150 : audit [DBG] from='client.? 172.21.15.80:0/259471232' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:59:21.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:19.359902+0000 mgr.y (mgr.14514) 1016 : cluster [DBG] pgmap v1329: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 772 B/s rd, 0 op/s 2024-02-19T21:59:21.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:19.606714+0000 osd.1 (osd.1) 344 : cluster [DBG] 2.9 scrub starts 2024-02-19T21:59:21.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:19.609956+0000 osd.1 (osd.1) 345 : cluster [DBG] 2.9 scrub ok 2024-02-19T21:59:21.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:19.660622+0000 osd.7 (osd.7) 373 : cluster [DBG] 1.0 scrub starts 2024-02-19T21:59:21.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:19.663745+0000 osd.7 (osd.7) 374 : cluster [DBG] 1.0 scrub ok 2024-02-19T21:59:21.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:19.838300+0000 osd.4 (osd.4) 323 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:59:21.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:19.838388+0000 osd.4 (osd.4) 324 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:59:21.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:20.492805+0000 osd.5 (osd.5) 384 : cluster [DBG] 2.12 scrub starts 2024-02-19T21:59:21.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:20.493795+0000 osd.5 (osd.5) 385 : cluster [DBG] 2.12 scrub ok 2024-02-19T21:59:21.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:20.518645+0000 mon.a (mon.0) 2166 : cluster [DBG] osdmap e604: 8 total, 8 up, 8 in 2024-02-19T21:59:21.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:20.702069+0000 mon.c (mon.2) 150 : audit [DBG] from='client.? 172.21.15.80:0/259471232' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:59:21.371 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-02-19T21:59:21.371 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd dump --format=json 2024-02-19T21:59:21.645 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:59:21.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:59:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:59:21.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:20.851968+0000 mon.a (mon.0) 2167 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:59:21.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:20.902898+0000 osd.2 (osd.2) 109 : cluster [DBG] 5.8 scrub starts 2024-02-19T21:59:21.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:20.903794+0000 osd.2 (osd.2) 110 : cluster [DBG] 5.8 scrub ok 2024-02-19T21:59:21.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:21.109322+0000 mon.a (mon.0) 2168 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:59:21.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:21.481731+0000 mon.a (mon.0) 2169 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:59:21.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:21.482409+0000 mon.a (mon.0) 2170 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:59:21.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:21.486829+0000 mon.a (mon.0) 2171 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:59:22.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:20.851968+0000 mon.a (mon.0) 2167 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:59:22.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:20.902898+0000 osd.2 (osd.2) 109 : cluster [DBG] 5.8 scrub starts 2024-02-19T21:59:22.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:20.903794+0000 osd.2 (osd.2) 110 : cluster [DBG] 5.8 scrub ok 2024-02-19T21:59:22.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:21.109322+0000 mon.a (mon.0) 2168 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:59:22.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:21.481731+0000 mon.a (mon.0) 2169 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:59:22.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:21.482409+0000 mon.a (mon.0) 2170 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:59:22.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:21.486829+0000 mon.a (mon.0) 2171 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:59:22.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:20.851968+0000 mon.a (mon.0) 2167 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:59:22.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:20.902898+0000 osd.2 (osd.2) 109 : cluster [DBG] 5.8 scrub starts 2024-02-19T21:59:22.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:20.903794+0000 osd.2 (osd.2) 110 : cluster [DBG] 5.8 scrub ok 2024-02-19T21:59:22.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:21.109322+0000 mon.a (mon.0) 2168 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:59:22.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:21.481731+0000 mon.a (mon.0) 2169 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:59:22.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:21.482409+0000 mon.a (mon.0) 2170 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:59:22.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:21.486829+0000 mon.a (mon.0) 2171 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T21:59:23.275 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:21.360285+0000 mgr.y (mgr.14514) 1017 : cluster [DBG] pgmap v1331: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-19T21:59:23.275 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:21.533557+0000 mgr.y (mgr.14514) 1018 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:59:23.275 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:21.615158+0000 osd.2 (osd.2) 111 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:59:23.275 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:21.615230+0000 osd.2 (osd.2) 112 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:59:23.276 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:22.489369+0000 mon.a (mon.0) 2172 : cluster [DBG] osdmap e605: 8 total, 8 up, 8 in 2024-02-19T21:59:23.276 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:22.502098+0000 osd.5 (osd.5) 386 : cluster [DBG] 5.f scrub starts 2024-02-19T21:59:23.276 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:22.506340+0000 osd.5 (osd.5) 387 : cluster [DBG] 5.f scrub ok 2024-02-19T21:59:23.276 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:21.360285+0000 mgr.y (mgr.14514) 1017 : cluster [DBG] pgmap v1331: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-19T21:59:23.276 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:21.533557+0000 mgr.y (mgr.14514) 1018 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:59:23.277 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:21.615158+0000 osd.2 (osd.2) 111 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:59:23.277 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:21.615230+0000 osd.2 (osd.2) 112 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:59:23.277 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:22.489369+0000 mon.a (mon.0) 2172 : cluster [DBG] osdmap e605: 8 total, 8 up, 8 in 2024-02-19T21:59:23.277 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:22.502098+0000 osd.5 (osd.5) 386 : cluster [DBG] 5.f scrub starts 2024-02-19T21:59:23.277 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:22.506340+0000 osd.5 (osd.5) 387 : cluster [DBG] 5.f scrub ok 2024-02-19T21:59:23.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:21.360285+0000 mgr.y (mgr.14514) 1017 : cluster [DBG] pgmap v1331: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-19T21:59:23.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:21.533557+0000 mgr.y (mgr.14514) 1018 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:59:23.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:21.615158+0000 osd.2 (osd.2) 111 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:59:23.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:21.615230+0000 osd.2 (osd.2) 112 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:59:23.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:22.489369+0000 mon.a (mon.0) 2172 : cluster [DBG] osdmap e605: 8 total, 8 up, 8 in 2024-02-19T21:59:23.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:22.502098+0000 osd.5 (osd.5) 386 : cluster [DBG] 5.f scrub starts 2024-02-19T21:59:23.557 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:22.506340+0000 osd.5 (osd.5) 387 : cluster [DBG] 5.f scrub ok 2024-02-19T21:59:23.701 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T21:59:23.702 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":605,"fsid":"6f763558-cf6d-11ee-95bb-87774f69a715","created":"2024-02-19T21:26:16.880265+0000","modified":"2024-02-19T21:59:22.485043+0000","last_up_change":"2024-02-19T21:57:57.541697+0000","last_in_change":"2024-02-19T21:53:44.626155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-19T21:30:05.947623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-02-19T21:32:22.082250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"533","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2024-02-19T21:32:22.333164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2024-02-19T21:32:23.632615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-02-19T21:32:25.600876+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":22,"pg_placement_num":22,"pg_placement_num_target":22,"pg_num_target":22,"pg_num_pending":22,"last_pg_merge_meta":{"source_pgid":"5.16","ready_epoch":298,"last_epoch_started":297,"last_epoch_clean":297,"source_version":"0'0","target_version":"0'0"},"last_change":"325","last_force_op_resend":"0","last_force_op_resend_prenautilus":"298","last_force_op_resend_preluminous":"296","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-02-19T21:32:27.661242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"6.16","ready_epoch":243,"last_epoch_started":242,"last_epoch_clean":242,"source_version":"0'0","target_version":"0'0"},"last_change":"572","last_force_op_resend":"0","last_force_op_resend_prenautilus":"243","last_force_op_resend_preluminous":"302","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"a72c63f6-46b3-4202-99da-7b0c92b799a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":549,"up_from":568,"up_thru":579,"down_at":550,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":351222871},{"type":"v1","addr":"172.21.15.80:6803","nonce":351222871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":351222871},{"type":"v1","addr":"172.21.15.80:6805","nonce":351222871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":351222871},{"type":"v1","addr":"172.21.15.80:6809","nonce":351222871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":351222871},{"type":"v1","addr":"172.21.15.80:6807","nonce":351222871}]},"public_addr":"172.21.15.80:6803/351222871","cluster_addr":"172.21.15.80:6805/351222871","heartbeat_back_addr":"172.21.15.80:6809/351222871","heartbeat_front_addr":"172.21.15.80:6807/351222871","state":["exists","up"]},{"osd":1,"uuid":"7d4e170e-b0ca-4e19-be35-4038ca126ee6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":579,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1497235950},{"type":"v1","addr":"172.21.15.80:6811","nonce":1497235950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1497235950},{"type":"v1","addr":"172.21.15.80:6813","nonce":1497235950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1497235950},{"type":"v1","addr":"172.21.15.80:6817","nonce":1497235950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1497235950},{"type":"v1","addr":"172.21.15.80:6815","nonce":1497235950}]},"public_addr":"172.21.15.80:6811/1497235950","cluster_addr":"172.21.15.80:6813/1497235950","heartbeat_back_addr":"172.21.15.80:6817/1497235950","heartbeat_front_addr":"172.21.15.80:6815/1497235950","state":["exists","up"]},{"osd":2,"uuid":"cf461b67-f3e8-45e9-b2f6-777752ba5574","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":18,"last_clean_end":369,"up_from":394,"up_thru":579,"down_at":370,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2441376667},{"type":"v1","addr":"172.21.15.80:6819","nonce":2441376667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":2441376667},{"type":"v1","addr":"172.21.15.80:6821","nonce":2441376667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":2441376667},{"type":"v1","addr":"172.21.15.80:6825","nonce":2441376667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":2441376667},{"type":"v1","addr":"172.21.15.80:6823","nonce":2441376667}]},"public_addr":"172.21.15.80:6819/2441376667","cluster_addr":"172.21.15.80:6821/2441376667","heartbeat_back_addr":"172.21.15.80:6825/2441376667","heartbeat_front_addr":"172.21.15.80:6823/2441376667","state":["exists","up"]},{"osd":3,"uuid":"76318cdd-5fce-4a40-95c9-300d55c34820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":582,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2007978078},{"type":"v1","addr":"172.21.15.80:6827","nonce":2007978078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2007978078},{"type":"v1","addr":"172.21.15.80:6829","nonce":2007978078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2007978078},{"type":"v1","addr":"172.21.15.80:6833","nonce":2007978078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2007978078},{"type":"v1","addr":"172.21.15.80:6831","nonce":2007978078}]},"public_addr":"172.21.15.80:6827/2007978078","cluster_addr":"172.21.15.80:6829/2007978078","heartbeat_back_addr":"172.21.15.80:6833/2007978078","heartbeat_front_addr":"172.21.15.80:6831/2007978078","state":["exists","up"]},{"osd":4,"uuid":"6484964f-3391-4e1d-a56c-813f46124062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":579,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1922002860},{"type":"v1","addr":"172.21.15.157:6801","nonce":1922002860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1922002860},{"type":"v1","addr":"172.21.15.157:6803","nonce":1922002860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1922002860},{"type":"v1","addr":"172.21.15.157:6807","nonce":1922002860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1922002860},{"type":"v1","addr":"172.21.15.157:6805","nonce":1922002860}]},"public_addr":"172.21.15.157:6801/1922002860","cluster_addr":"172.21.15.157:6803/1922002860","heartbeat_back_addr":"172.21.15.157:6807/1922002860","heartbeat_front_addr":"172.21.15.157:6805/1922002860","state":["exists","up"]},{"osd":5,"uuid":"8c7e0309-8c3b-40b9-99d9-96620e52742f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":581,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":960889603},{"type":"v1","addr":"172.21.15.157:6809","nonce":960889603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":960889603},{"type":"v1","addr":"172.21.15.157:6811","nonce":960889603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":960889603},{"type":"v1","addr":"172.21.15.157:6815","nonce":960889603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":960889603},{"type":"v1","addr":"172.21.15.157:6813","nonce":960889603}]},"public_addr":"172.21.15.157:6809/960889603","cluster_addr":"172.21.15.157:6811/960889603","heartbeat_back_addr":"172.21.15.157:6815/960889603","heartbeat_front_addr":"172.21.15.157:6813/960889603","state":["exists","up"]},{"osd":6,"uuid":"5b7d44a3-197d-482c-bf9e-de5e9013a851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":579,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":2598265223},{"type":"v1","addr":"172.21.15.157:6817","nonce":2598265223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":2598265223},{"type":"v1","addr":"172.21.15.157:6819","nonce":2598265223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":2598265223},{"type":"v1","addr":"172.21.15.157:6823","nonce":2598265223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":2598265223},{"type":"v1","addr":"172.21.15.157:6821","nonce":2598265223}]},"public_addr":"172.21.15.157:6817/2598265223","cluster_addr":"172.21.15.157:6819/2598265223","heartbeat_back_addr":"172.21.15.157:6823/2598265223","heartbeat_front_addr":"172.21.15.157:6821/2598265223","state":["exists","up"]},{"osd":7,"uuid":"7e2d0287-928d-40f8-841b-6c2077fc08ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":568,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3619345894},{"type":"v1","addr":"172.21.15.157:6825","nonce":3619345894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3619345894},{"type":"v1","addr":"172.21.15.157:6827","nonce":3619345894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3619345894},{"type":"v1","addr":"172.21.15.157:6831","nonce":3619345894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3619345894},{"type":"v1","addr":"172.21.15.157:6829","nonce":3619345894}]},"public_addr":"172.21.15.157:6825/3619345894","cluster_addr":"172.21.15.157:6827/3619345894","heartbeat_back_addr":"172.21.15.157:6831/3619345894","heartbeat_front_addr":"172.21.15.157:6829/3619345894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:58:01.546272+0000","dead_epoch":549},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:59:00.784064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:59:21.615233+0000","dead_epoch":369},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:58:41.283662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:59:19.838392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:59:12.082990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:58:44.719312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:58:09.396114+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.c","osds":[6,7,2]},{"pgid":"4.1","osds":[4,2,6]},{"pgid":"6.12","osds":[5,7,6]}],"pg_upmap_items":[{"pgid":"2.3","mappings":[{"from":7,"to":1}]},{"pgid":"2.10","mappings":[{"from":1,"to":4}]},{"pgid":"2.1b","mappings":[{"from":7,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":7}]},{"pgid":"4.f","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":7},{"from":6,"to":0}]},{"pgid":"5.1","mappings":[{"from":4,"to":6}]},{"pgid":"5.13","mappings":[{"from":0,"to":6}]},{"pgid":"6.f","mappings":[{"from":4,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6800/2867197629":"2024-02-20T21:32:48.748960+0000","172.21.15.80:0/1659656010":"2024-02-20T21:32:48.748960+0000","172.21.15.80:6801/2272739550":"2024-02-20T21:27:15.880876+0000","172.21.15.80:0/867908385":"2024-02-20T21:27:15.880876+0000","172.21.15.80:0/398750494":"2024-02-20T21:32:48.748960+0000","172.21.15.80:0/2833137430":"2024-02-20T21:27:15.880876+0000","172.21.15.80:0/2520755315":"2024-02-20T21:32:48.748960+0000","172.21.15.80:6800/2094869828":"2024-02-20T21:26:51.262073+0000","172.21.15.80:6800/2272739550":"2024-02-20T21:27:15.880876+0000","172.21.15.80:6801/2094869828":"2024-02-20T21:26:51.262073+0000","172.21.15.80:0/2130852198":"2024-02-20T21:26:51.262073+0000","172.21.15.80:6801/2867197629":"2024-02-20T21:32:48.748960+0000","172.21.15.80:0/1952386920":"2024-02-20T21:26:51.262073+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T21:59:24.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:22.431888+0000 osd.4 (osd.4) 325 : cluster [DBG] 4.1a scrub starts 2024-02-19T21:59:24.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:22.435458+0000 osd.4 (osd.4) 326 : cluster [DBG] 4.1a scrub ok 2024-02-19T21:59:24.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:22.882828+0000 osd.3 (osd.3) 317 : cluster [DBG] 4.0 scrub starts 2024-02-19T21:59:24.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:22.886493+0000 osd.3 (osd.3) 318 : cluster [DBG] 4.0 scrub ok 2024-02-19T21:59:24.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:23.537436+0000 osd.0 (osd.0) 43 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:59:24.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:23.537505+0000 osd.0 (osd.0) 44 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:59:24.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:23.701380+0000 mon.c (mon.2) 151 : audit [DBG] from='client.? 172.21.15.80:0/4212946417' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:59:24.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:22.431888+0000 osd.4 (osd.4) 325 : cluster [DBG] 4.1a scrub starts 2024-02-19T21:59:24.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:22.435458+0000 osd.4 (osd.4) 326 : cluster [DBG] 4.1a scrub ok 2024-02-19T21:59:24.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:22.882828+0000 osd.3 (osd.3) 317 : cluster [DBG] 4.0 scrub starts 2024-02-19T21:59:24.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:22.886493+0000 osd.3 (osd.3) 318 : cluster [DBG] 4.0 scrub ok 2024-02-19T21:59:24.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:23.537436+0000 osd.0 (osd.0) 43 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:59:24.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:23.537505+0000 osd.0 (osd.0) 44 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:59:24.347 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:24 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:23.701380+0000 mon.c (mon.2) 151 : audit [DBG] from='client.? 172.21.15.80:0/4212946417' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:59:24.388 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-02-19T21:59:24.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:22.431888+0000 osd.4 (osd.4) 325 : cluster [DBG] 4.1a scrub starts 2024-02-19T21:59:24.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:22.435458+0000 osd.4 (osd.4) 326 : cluster [DBG] 4.1a scrub ok 2024-02-19T21:59:24.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:22.882828+0000 osd.3 (osd.3) 317 : cluster [DBG] 4.0 scrub starts 2024-02-19T21:59:24.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:22.886493+0000 osd.3 (osd.3) 318 : cluster [DBG] 4.0 scrub ok 2024-02-19T21:59:24.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:23.537436+0000 osd.0 (osd.0) 43 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:59:24.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:23.537505+0000 osd.0 (osd.0) 44 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:59:24.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:23.701380+0000 mon.c (mon.2) 151 : audit [DBG] from='client.? 172.21.15.80:0/4212946417' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:59:24.657 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:59:25.187 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:23.360600+0000 mgr.y (mgr.14514) 1019 : cluster [DBG] pgmap v1333: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:59:25.188 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:23.459069+0000 osd.4 (osd.4) 327 : cluster [DBG] 5.e scrub starts 2024-02-19T21:59:25.188 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:23.462536+0000 osd.4 (osd.4) 328 : cluster [DBG] 5.e scrub ok 2024-02-19T21:59:25.188 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:24.123786+0000 mon.a (mon.0) 2173 : cluster [DBG] osdmap e606: 8 total, 8 up, 8 in 2024-02-19T21:59:25.188 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:24.716078+0000 osd.1 (osd.1) 346 : cluster [DBG] 2.15 scrub starts 2024-02-19T21:59:25.188 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:24.717194+0000 osd.1 (osd.1) 347 : cluster [DBG] 2.15 scrub ok 2024-02-19T21:59:25.188 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:23.360600+0000 mgr.y (mgr.14514) 1019 : cluster [DBG] pgmap v1333: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:59:25.189 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:23.459069+0000 osd.4 (osd.4) 327 : cluster [DBG] 5.e scrub starts 2024-02-19T21:59:25.189 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:23.462536+0000 osd.4 (osd.4) 328 : cluster [DBG] 5.e scrub ok 2024-02-19T21:59:25.189 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:24.123786+0000 mon.a (mon.0) 2173 : cluster [DBG] osdmap e606: 8 total, 8 up, 8 in 2024-02-19T21:59:25.189 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:24.716078+0000 osd.1 (osd.1) 346 : cluster [DBG] 2.15 scrub starts 2024-02-19T21:59:25.189 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:25 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:24.717194+0000 osd.1 (osd.1) 347 : cluster [DBG] 2.15 scrub ok 2024-02-19T21:59:25.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:23.360600+0000 mgr.y (mgr.14514) 1019 : cluster [DBG] pgmap v1333: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:59:25.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:23.459069+0000 osd.4 (osd.4) 327 : cluster [DBG] 5.e scrub starts 2024-02-19T21:59:25.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:23.462536+0000 osd.4 (osd.4) 328 : cluster [DBG] 5.e scrub ok 2024-02-19T21:59:25.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:24.123786+0000 mon.a (mon.0) 2173 : cluster [DBG] osdmap e606: 8 total, 8 up, 8 in 2024-02-19T21:59:25.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:24.716078+0000 osd.1 (osd.1) 346 : cluster [DBG] 2.15 scrub starts 2024-02-19T21:59:25.556 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:24.717194+0000 osd.1 (osd.1) 347 : cluster [DBG] 2.15 scrub ok 2024-02-19T21:59:26.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:59:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:59:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:59:26.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:25.361082+0000 mgr.y (mgr.14514) 1020 : cluster [DBG] pgmap v1335: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:59:26.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:25.561215+0000 osd.7 (osd.7) 375 : cluster [DBG] 2.8 scrub starts 2024-02-19T21:59:26.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:25.564667+0000 osd.7 (osd.7) 376 : cluster [DBG] 2.8 scrub ok 2024-02-19T21:59:26.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:25.764570+0000 osd.1 (osd.1) 348 : cluster [DBG] 6.1d scrub starts 2024-02-19T21:59:26.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:25.851269+0000 osd.3 (osd.3) 319 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:59:26.551 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:25.854226+0000 osd.3 (osd.3) 320 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:59:26.551 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:25.361082+0000 mgr.y (mgr.14514) 1020 : cluster [DBG] pgmap v1335: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:59:26.551 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:25.561215+0000 osd.7 (osd.7) 375 : cluster [DBG] 2.8 scrub starts 2024-02-19T21:59:26.551 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:25.564667+0000 osd.7 (osd.7) 376 : cluster [DBG] 2.8 scrub ok 2024-02-19T21:59:26.551 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:25.764570+0000 osd.1 (osd.1) 348 : cluster [DBG] 6.1d scrub starts 2024-02-19T21:59:26.551 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:25.851269+0000 osd.3 (osd.3) 319 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:59:26.551 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:25.854226+0000 osd.3 (osd.3) 320 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:59:26.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:25.361082+0000 mgr.y (mgr.14514) 1020 : cluster [DBG] pgmap v1335: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T21:59:26.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:25.561215+0000 osd.7 (osd.7) 375 : cluster [DBG] 2.8 scrub starts 2024-02-19T21:59:26.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:25.564667+0000 osd.7 (osd.7) 376 : cluster [DBG] 2.8 scrub ok 2024-02-19T21:59:26.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:25.764570+0000 osd.1 (osd.1) 348 : cluster [DBG] 6.1d scrub starts 2024-02-19T21:59:26.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:25.851269+0000 osd.3 (osd.3) 319 : cluster [DBG] 2.19 scrub starts 2024-02-19T21:59:26.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:26 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:25.854226+0000 osd.3 (osd.3) 320 : cluster [DBG] 2.19 scrub ok 2024-02-19T21:59:27.216 INFO:teuthology.orchestra.run.smithi080.stdout:2439541424147 2024-02-19T21:59:27.216 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-02-19T21:59:27.484 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:59:27.780 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:25.674647+0000 osd.0 (osd.0) 45 : cluster [DBG] 6.16 scrub starts 2024-02-19T21:59:27.780 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:25.675747+0000 osd.0 (osd.0) 46 : cluster [DBG] 6.16 scrub ok 2024-02-19T21:59:27.780 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:25.912296+0000 osd.1 (osd.1) 349 : cluster [DBG] 6.1d scrub ok 2024-02-19T21:59:27.780 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:26.133777+0000 osd.6 (osd.6) 339 : cluster [DBG] 2.14 scrub starts 2024-02-19T21:59:27.780 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:26.136711+0000 osd.6 (osd.6) 340 : cluster [DBG] 2.14 scrub ok 2024-02-19T21:59:27.780 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:26.811920+0000 osd.3 (osd.3) 321 : cluster [DBG] 5.0 deep-scrub starts 2024-02-19T21:59:27.780 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:26.816054+0000 osd.3 (osd.3) 322 : cluster [DBG] 5.0 deep-scrub ok 2024-02-19T21:59:27.781 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:25.674647+0000 osd.0 (osd.0) 45 : cluster [DBG] 6.16 scrub starts 2024-02-19T21:59:27.781 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:25.675747+0000 osd.0 (osd.0) 46 : cluster [DBG] 6.16 scrub ok 2024-02-19T21:59:27.781 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:25.912296+0000 osd.1 (osd.1) 349 : cluster [DBG] 6.1d scrub ok 2024-02-19T21:59:27.781 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:26.133777+0000 osd.6 (osd.6) 339 : cluster [DBG] 2.14 scrub starts 2024-02-19T21:59:27.781 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:26.136711+0000 osd.6 (osd.6) 340 : cluster [DBG] 2.14 scrub ok 2024-02-19T21:59:27.781 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:26.811920+0000 osd.3 (osd.3) 321 : cluster [DBG] 5.0 deep-scrub starts 2024-02-19T21:59:27.781 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:27 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:26.816054+0000 osd.3 (osd.3) 322 : cluster [DBG] 5.0 deep-scrub ok 2024-02-19T21:59:27.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:25.674647+0000 osd.0 (osd.0) 45 : cluster [DBG] 6.16 scrub starts 2024-02-19T21:59:27.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:25.675747+0000 osd.0 (osd.0) 46 : cluster [DBG] 6.16 scrub ok 2024-02-19T21:59:27.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:25.912296+0000 osd.1 (osd.1) 349 : cluster [DBG] 6.1d scrub ok 2024-02-19T21:59:27.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:26.133777+0000 osd.6 (osd.6) 339 : cluster [DBG] 2.14 scrub starts 2024-02-19T21:59:27.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:26.136711+0000 osd.6 (osd.6) 340 : cluster [DBG] 2.14 scrub ok 2024-02-19T21:59:27.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:26.811920+0000 osd.3 (osd.3) 321 : cluster [DBG] 5.0 deep-scrub starts 2024-02-19T21:59:27.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:27 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:26.816054+0000 osd.3 (osd.3) 322 : cluster [DBG] 5.0 deep-scrub ok 2024-02-19T21:59:28.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:27.092864+0000 osd.6 (osd.6) 341 : cluster [DBG] 2.c scrub starts 2024-02-19T21:59:28.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:27.096337+0000 osd.6 (osd.6) 342 : cluster [DBG] 2.c scrub ok 2024-02-19T21:59:28.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:27.361596+0000 mgr.y (mgr.14514) 1021 : cluster [DBG] pgmap v1336: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 748 B/s rd, 0 op/s 2024-02-19T21:59:28.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:27.092864+0000 osd.6 (osd.6) 341 : cluster [DBG] 2.c scrub starts 2024-02-19T21:59:28.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:27.096337+0000 osd.6 (osd.6) 342 : cluster [DBG] 2.c scrub ok 2024-02-19T21:59:28.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:27.361596+0000 mgr.y (mgr.14514) 1021 : cluster [DBG] pgmap v1336: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 748 B/s rd, 0 op/s 2024-02-19T21:59:28.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:27.092864+0000 osd.6 (osd.6) 341 : cluster [DBG] 2.c scrub starts 2024-02-19T21:59:28.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:27.096337+0000 osd.6 (osd.6) 342 : cluster [DBG] 2.c scrub ok 2024-02-19T21:59:28.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:28 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:27.361596+0000 mgr.y (mgr.14514) 1021 : cluster [DBG] pgmap v1336: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 748 B/s rd, 0 op/s 2024-02-19T21:59:29.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:28.478035+0000 osd.7 (osd.7) 377 : cluster [DBG] 2.1d scrub starts 2024-02-19T21:59:29.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:28.480983+0000 osd.7 (osd.7) 378 : cluster [DBG] 2.1d scrub ok 2024-02-19T21:59:29.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:28.504552+0000 osd.4 (osd.4) 329 : cluster [DBG] 6.17 scrub starts 2024-02-19T21:59:29.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:28.649212+0000 osd.4 (osd.4) 330 : cluster [DBG] 6.17 scrub ok 2024-02-19T21:59:29.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:28.837245+0000 osd.1 (osd.1) 350 : cluster [DBG] 2.a scrub starts 2024-02-19T21:59:29.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:28.861842+0000 osd.3 (osd.3) 323 : cluster [DBG] 5.14 deep-scrub starts 2024-02-19T21:59:29.596 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:28.863349+0000 osd.3 (osd.3) 324 : cluster [DBG] 5.14 deep-scrub ok 2024-02-19T21:59:29.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:28.478035+0000 osd.7 (osd.7) 377 : cluster [DBG] 2.1d scrub starts 2024-02-19T21:59:29.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:28.480983+0000 osd.7 (osd.7) 378 : cluster [DBG] 2.1d scrub ok 2024-02-19T21:59:29.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:28.504552+0000 osd.4 (osd.4) 329 : cluster [DBG] 6.17 scrub starts 2024-02-19T21:59:29.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:28.649212+0000 osd.4 (osd.4) 330 : cluster [DBG] 6.17 scrub ok 2024-02-19T21:59:29.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:28.837245+0000 osd.1 (osd.1) 350 : cluster [DBG] 2.a scrub starts 2024-02-19T21:59:29.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:28.861842+0000 osd.3 (osd.3) 323 : cluster [DBG] 5.14 deep-scrub starts 2024-02-19T21:59:29.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:29 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:28.863349+0000 osd.3 (osd.3) 324 : cluster [DBG] 5.14 deep-scrub ok 2024-02-19T21:59:29.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:28.478035+0000 osd.7 (osd.7) 377 : cluster [DBG] 2.1d scrub starts 2024-02-19T21:59:29.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:28.480983+0000 osd.7 (osd.7) 378 : cluster [DBG] 2.1d scrub ok 2024-02-19T21:59:29.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:28.504552+0000 osd.4 (osd.4) 329 : cluster [DBG] 6.17 scrub starts 2024-02-19T21:59:29.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:28.649212+0000 osd.4 (osd.4) 330 : cluster [DBG] 6.17 scrub ok 2024-02-19T21:59:29.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:28.837245+0000 osd.1 (osd.1) 350 : cluster [DBG] 2.a scrub starts 2024-02-19T21:59:29.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:28.861842+0000 osd.3 (osd.3) 323 : cluster [DBG] 5.14 deep-scrub starts 2024-02-19T21:59:29.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:29 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:28.863349+0000 osd.3 (osd.3) 324 : cluster [DBG] 5.14 deep-scrub ok 2024-02-19T21:59:29.946 INFO:teuthology.orchestra.run.smithi080.stdout:55834575209 2024-02-19T21:59:29.947 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-02-19T21:59:30.215 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:59:30.771 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:28.838330+0000 osd.1 (osd.1) 351 : cluster [DBG] 2.a scrub ok 2024-02-19T21:59:30.771 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:29.362011+0000 mgr.y (mgr.14514) 1022 : cluster [DBG] pgmap v1337: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:59:30.771 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:29.470678+0000 osd.7 (osd.7) 379 : cluster [DBG] 6.1c scrub starts 2024-02-19T21:59:30.771 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:29.474140+0000 osd.7 (osd.7) 380 : cluster [DBG] 6.1c scrub ok 2024-02-19T21:59:30.771 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:28.838330+0000 osd.1 (osd.1) 351 : cluster [DBG] 2.a scrub ok 2024-02-19T21:59:30.771 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:29.362011+0000 mgr.y (mgr.14514) 1022 : cluster [DBG] pgmap v1337: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:59:30.771 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:29.470678+0000 osd.7 (osd.7) 379 : cluster [DBG] 6.1c scrub starts 2024-02-19T21:59:30.772 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:29.474140+0000 osd.7 (osd.7) 380 : cluster [DBG] 6.1c scrub ok 2024-02-19T21:59:30.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:28.838330+0000 osd.1 (osd.1) 351 : cluster [DBG] 2.a scrub ok 2024-02-19T21:59:30.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:29.362011+0000 mgr.y (mgr.14514) 1022 : cluster [DBG] pgmap v1337: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:59:30.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:29.470678+0000 osd.7 (osd.7) 379 : cluster [DBG] 6.1c scrub starts 2024-02-19T21:59:30.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:30 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:29.474140+0000 osd.7 (osd.7) 380 : cluster [DBG] 6.1c scrub ok 2024-02-19T21:59:31.053 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:59:30 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:59:30] "GET /metrics HTTP/1.1" 200 174237 "" "Prometheus/2.33.4" 2024-02-19T21:59:31.667 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:30.438345+0000 osd.7 (osd.7) 381 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:59:31.667 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:30.438434+0000 osd.7 (osd.7) 382 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:59:31.667 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:30.536994+0000 mon.a (mon.0) 2174 : cluster [DBG] osdmap e607: 8 total, 8 up, 8 in 2024-02-19T21:59:31.668 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:30.438345+0000 osd.7 (osd.7) 381 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:59:31.668 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:30.438434+0000 osd.7 (osd.7) 382 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:59:31.668 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:31 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:30.536994+0000 mon.a (mon.0) 2174 : cluster [DBG] osdmap e607: 8 total, 8 up, 8 in 2024-02-19T21:59:31.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:59:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:59:31.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:30.438345+0000 osd.7 (osd.7) 381 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:59:31.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:30.438434+0000 osd.7 (osd.7) 382 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:59:31.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:31 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:30.536994+0000 mon.a (mon.0) 2174 : cluster [DBG] osdmap e607: 8 total, 8 up, 8 in 2024-02-19T21:59:32.759 INFO:teuthology.orchestra.run.smithi080.stdout:1692217114749 2024-02-19T21:59:32.760 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-02-19T21:59:32.790 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:31.014743+0000 osd.6 (osd.6) 343 : cluster [DBG] 5.2 scrub starts 2024-02-19T21:59:32.790 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:31.018212+0000 osd.6 (osd.6) 344 : cluster [DBG] 5.2 scrub ok 2024-02-19T21:59:32.790 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:31.362466+0000 mgr.y (mgr.14514) 1023 : cluster [DBG] pgmap v1339: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:59:32.791 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:31.543876+0000 mgr.y (mgr.14514) 1024 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:59:32.791 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:31.014743+0000 osd.6 (osd.6) 343 : cluster [DBG] 5.2 scrub starts 2024-02-19T21:59:32.791 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:31.018212+0000 osd.6 (osd.6) 344 : cluster [DBG] 5.2 scrub ok 2024-02-19T21:59:32.791 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:31.362466+0000 mgr.y (mgr.14514) 1023 : cluster [DBG] pgmap v1339: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:59:32.791 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:32 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:31.543876+0000 mgr.y (mgr.14514) 1024 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:59:32.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:31.014743+0000 osd.6 (osd.6) 343 : cluster [DBG] 5.2 scrub starts 2024-02-19T21:59:32.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:31.018212+0000 osd.6 (osd.6) 344 : cluster [DBG] 5.2 scrub ok 2024-02-19T21:59:32.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:31.362466+0000 mgr.y (mgr.14514) 1023 : cluster [DBG] pgmap v1339: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:59:32.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:32 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:31.543876+0000 mgr.y (mgr.14514) 1024 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:59:33.032 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:59:33.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:31.843202+0000 osd.1 (osd.1) 352 : cluster [DBG] 5.c scrub starts 2024-02-19T21:59:33.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:31.844181+0000 osd.1 (osd.1) 353 : cluster [DBG] 5.c scrub ok 2024-02-19T21:59:33.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:32.848795+0000 osd.3 (osd.3) 325 : cluster [DBG] 4.19 scrub starts 2024-02-19T21:59:33.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:32.852263+0000 osd.3 (osd.3) 326 : cluster [DBG] 4.19 scrub ok 2024-02-19T21:59:33.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:33.174598+0000 osd.2 (osd.2) 113 : cluster [DBG] 5.a scrub starts 2024-02-19T21:59:33.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:33 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:33.175516+0000 osd.2 (osd.2) 114 : cluster [DBG] 5.a scrub ok 2024-02-19T21:59:33.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:31.843202+0000 osd.1 (osd.1) 352 : cluster [DBG] 5.c scrub starts 2024-02-19T21:59:33.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:31.844181+0000 osd.1 (osd.1) 353 : cluster [DBG] 5.c scrub ok 2024-02-19T21:59:33.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:32.848795+0000 osd.3 (osd.3) 325 : cluster [DBG] 4.19 scrub starts 2024-02-19T21:59:33.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:32.852263+0000 osd.3 (osd.3) 326 : cluster [DBG] 4.19 scrub ok 2024-02-19T21:59:33.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:33.174598+0000 osd.2 (osd.2) 113 : cluster [DBG] 5.a scrub starts 2024-02-19T21:59:33.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:33.175516+0000 osd.2 (osd.2) 114 : cluster [DBG] 5.a scrub ok 2024-02-19T21:59:33.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:31.843202+0000 osd.1 (osd.1) 352 : cluster [DBG] 5.c scrub starts 2024-02-19T21:59:33.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:31.844181+0000 osd.1 (osd.1) 353 : cluster [DBG] 5.c scrub ok 2024-02-19T21:59:33.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:32.848795+0000 osd.3 (osd.3) 325 : cluster [DBG] 4.19 scrub starts 2024-02-19T21:59:33.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:32.852263+0000 osd.3 (osd.3) 326 : cluster [DBG] 4.19 scrub ok 2024-02-19T21:59:33.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:33.174598+0000 osd.2 (osd.2) 113 : cluster [DBG] 5.a scrub starts 2024-02-19T21:59:33.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:33 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:33.175516+0000 osd.2 (osd.2) 114 : cluster [DBG] 5.a scrub ok 2024-02-19T21:59:34.731 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:33.363074+0000 mgr.y (mgr.14514) 1025 : cluster [DBG] pgmap v1340: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-19T21:59:34.731 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:33.521869+0000 osd.0 (osd.0) 47 : cluster [DBG] 5.5 scrub starts 2024-02-19T21:59:34.731 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:33.522810+0000 osd.0 (osd.0) 48 : cluster [DBG] 5.5 scrub ok 2024-02-19T21:59:34.731 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:33.834404+0000 osd.3 (osd.3) 327 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:59:34.731 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:33.835271+0000 osd.3 (osd.3) 328 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:59:34.731 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:33.363074+0000 mgr.y (mgr.14514) 1025 : cluster [DBG] pgmap v1340: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-19T21:59:34.732 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:33.521869+0000 osd.0 (osd.0) 47 : cluster [DBG] 5.5 scrub starts 2024-02-19T21:59:34.732 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:33.522810+0000 osd.0 (osd.0) 48 : cluster [DBG] 5.5 scrub ok 2024-02-19T21:59:34.732 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:33.834404+0000 osd.3 (osd.3) 327 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:59:34.732 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:33.835271+0000 osd.3 (osd.3) 328 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:59:34.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:33.363074+0000 mgr.y (mgr.14514) 1025 : cluster [DBG] pgmap v1340: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-19T21:59:34.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:33.521869+0000 osd.0 (osd.0) 47 : cluster [DBG] 5.5 scrub starts 2024-02-19T21:59:34.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:33.522810+0000 osd.0 (osd.0) 48 : cluster [DBG] 5.5 scrub ok 2024-02-19T21:59:34.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:33.834404+0000 osd.3 (osd.3) 327 : cluster [DBG] 5.13 scrub starts 2024-02-19T21:59:34.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:34 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:33.835271+0000 osd.3 (osd.3) 328 : cluster [DBG] 5.13 scrub ok 2024-02-19T21:59:35.665 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:34.472312+0000 osd.4 (osd.4) 331 : cluster [DBG] 6.1a deep-scrub starts 2024-02-19T21:59:35.665 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:34.530857+0000 osd.4 (osd.4) 332 : cluster [DBG] 6.1a deep-scrub ok 2024-02-19T21:59:35.665 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:35.523666+0000 mon.a (mon.0) 2175 : cluster [DBG] osdmap e608: 8 total, 8 up, 8 in 2024-02-19T21:59:35.666 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:34.472312+0000 osd.4 (osd.4) 331 : cluster [DBG] 6.1a deep-scrub starts 2024-02-19T21:59:35.666 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:34.530857+0000 osd.4 (osd.4) 332 : cluster [DBG] 6.1a deep-scrub ok 2024-02-19T21:59:35.666 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:35 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:35.523666+0000 mon.a (mon.0) 2175 : cluster [DBG] osdmap e608: 8 total, 8 up, 8 in 2024-02-19T21:59:35.685 INFO:teuthology.orchestra.run.smithi080.stdout:111669150048 2024-02-19T21:59:35.685 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-02-19T21:59:35.806 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:59:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:59:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:59:35.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:34.472312+0000 osd.4 (osd.4) 331 : cluster [DBG] 6.1a deep-scrub starts 2024-02-19T21:59:35.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:34.530857+0000 osd.4 (osd.4) 332 : cluster [DBG] 6.1a deep-scrub ok 2024-02-19T21:59:35.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:35 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:35.523666+0000 mon.a (mon.0) 2175 : cluster [DBG] osdmap e608: 8 total, 8 up, 8 in 2024-02-19T21:59:35.994 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:59:36.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:35.002542+0000 osd.6 (osd.6) 345 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:59:36.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:35.005429+0000 osd.6 (osd.6) 346 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:59:36.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:35.363504+0000 mgr.y (mgr.14514) 1026 : cluster [DBG] pgmap v1341: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:59:36.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:35.766339+0000 osd.1 (osd.1) 354 : cluster [DBG] 2.4 scrub starts 2024-02-19T21:59:36.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:36 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:35.767120+0000 osd.1 (osd.1) 355 : cluster [DBG] 2.4 scrub ok 2024-02-19T21:59:36.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:35.002542+0000 osd.6 (osd.6) 345 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:59:36.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:35.005429+0000 osd.6 (osd.6) 346 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:59:36.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:35.363504+0000 mgr.y (mgr.14514) 1026 : cluster [DBG] pgmap v1341: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:59:36.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:35.766339+0000 osd.1 (osd.1) 354 : cluster [DBG] 2.4 scrub starts 2024-02-19T21:59:36.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:35.767120+0000 osd.1 (osd.1) 355 : cluster [DBG] 2.4 scrub ok 2024-02-19T21:59:36.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:35.002542+0000 osd.6 (osd.6) 345 : cluster [DBG] 2.11 scrub starts 2024-02-19T21:59:36.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:35.005429+0000 osd.6 (osd.6) 346 : cluster [DBG] 2.11 scrub ok 2024-02-19T21:59:36.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:35.363504+0000 mgr.y (mgr.14514) 1026 : cluster [DBG] pgmap v1341: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:59:36.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:35.766339+0000 osd.1 (osd.1) 354 : cluster [DBG] 2.4 scrub starts 2024-02-19T21:59:36.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:36 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:35.767120+0000 osd.1 (osd.1) 355 : cluster [DBG] 2.4 scrub ok 2024-02-19T21:59:37.824 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:35.957784+0000 osd.6 (osd.6) 347 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:59:37.824 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:35.960962+0000 osd.6 (osd.6) 348 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:59:37.825 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:35.957784+0000 osd.6 (osd.6) 347 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:59:37.825 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:37 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:35.960962+0000 osd.6 (osd.6) 348 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:59:38.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:35.957784+0000 osd.6 (osd.6) 347 : cluster [DBG] 2.17 scrub starts 2024-02-19T21:59:38.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:37 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:35.960962+0000 osd.6 (osd.6) 348 : cluster [DBG] 2.17 scrub ok 2024-02-19T21:59:38.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:37.363972+0000 mgr.y (mgr.14514) 1027 : cluster [DBG] pgmap v1343: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 895 B/s rd, 0 op/s 2024-02-19T21:59:38.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:37.404429+0000 osd.4 (osd.4) 333 : cluster [DBG] 4.1b scrub starts 2024-02-19T21:59:38.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:37.407896+0000 osd.4 (osd.4) 334 : cluster [DBG] 4.1b scrub ok 2024-02-19T21:59:38.585 INFO:teuthology.orchestra.run.smithi080.stdout:137438953818 2024-02-19T21:59:38.585 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-02-19T21:59:38.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:37.363972+0000 mgr.y (mgr.14514) 1027 : cluster [DBG] pgmap v1343: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 895 B/s rd, 0 op/s 2024-02-19T21:59:38.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:37.404429+0000 osd.4 (osd.4) 333 : cluster [DBG] 4.1b scrub starts 2024-02-19T21:59:38.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:38 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:37.407896+0000 osd.4 (osd.4) 334 : cluster [DBG] 4.1b scrub ok 2024-02-19T21:59:38.853 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:59:39.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:37.363972+0000 mgr.y (mgr.14514) 1027 : cluster [DBG] pgmap v1343: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 895 B/s rd, 0 op/s 2024-02-19T21:59:39.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:37.404429+0000 osd.4 (osd.4) 333 : cluster [DBG] 4.1b scrub starts 2024-02-19T21:59:39.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:38 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:37.407896+0000 osd.4 (osd.4) 334 : cluster [DBG] 4.1b scrub ok 2024-02-19T21:59:39.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:39.186068+0000 osd.2 (osd.2) 115 : cluster [DBG] 4.1c scrub starts 2024-02-19T21:59:39.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:39.187527+0000 osd.2 (osd.2) 116 : cluster [DBG] 4.1c scrub ok 2024-02-19T21:59:39.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:39.186068+0000 osd.2 (osd.2) 115 : cluster [DBG] 4.1c scrub starts 2024-02-19T21:59:39.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:39 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:39.187527+0000 osd.2 (osd.2) 116 : cluster [DBG] 4.1c scrub ok 2024-02-19T21:59:40.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:39.186068+0000 osd.2 (osd.2) 115 : cluster [DBG] 4.1c scrub starts 2024-02-19T21:59:40.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:39.187527+0000 osd.2 (osd.2) 116 : cluster [DBG] 4.1c scrub ok 2024-02-19T21:59:40.655 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:38.942369+0000 osd.6 (osd.6) 349 : cluster [DBG] 2.7 scrub starts 2024-02-19T21:59:40.655 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:38.945431+0000 osd.6 (osd.6) 350 : cluster [DBG] 2.7 scrub ok 2024-02-19T21:59:40.655 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:39.364454+0000 mgr.y (mgr.14514) 1028 : cluster [DBG] pgmap v1344: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 579 B/s rd, 0 op/s 2024-02-19T21:59:40.655 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:39.408219+0000 osd.7 (osd.7) 383 : cluster [DBG] 5.4 scrub starts 2024-02-19T21:59:40.655 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:39.411131+0000 osd.7 (osd.7) 384 : cluster [DBG] 5.4 scrub ok 2024-02-19T21:59:40.655 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:39.577477+0000 osd.5 (osd.5) 388 : cluster [DBG] 5.7 deep-scrub starts 2024-02-19T21:59:40.655 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:39.892263+0000 osd.3 (osd.3) 329 : cluster [DBG] 6.13 scrub starts 2024-02-19T21:59:40.655 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:39.962076+0000 osd.3 (osd.3) 330 : cluster [DBG] 6.13 scrub ok 2024-02-19T21:59:40.656 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:38.942369+0000 osd.6 (osd.6) 349 : cluster [DBG] 2.7 scrub starts 2024-02-19T21:59:40.656 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:38.945431+0000 osd.6 (osd.6) 350 : cluster [DBG] 2.7 scrub ok 2024-02-19T21:59:40.656 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:39.364454+0000 mgr.y (mgr.14514) 1028 : cluster [DBG] pgmap v1344: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 579 B/s rd, 0 op/s 2024-02-19T21:59:40.656 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:39.408219+0000 osd.7 (osd.7) 383 : cluster [DBG] 5.4 scrub starts 2024-02-19T21:59:40.656 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:39.411131+0000 osd.7 (osd.7) 384 : cluster [DBG] 5.4 scrub ok 2024-02-19T21:59:40.656 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:39.577477+0000 osd.5 (osd.5) 388 : cluster [DBG] 5.7 deep-scrub starts 2024-02-19T21:59:40.656 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:39.892263+0000 osd.3 (osd.3) 329 : cluster [DBG] 6.13 scrub starts 2024-02-19T21:59:40.657 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:39.962076+0000 osd.3 (osd.3) 330 : cluster [DBG] 6.13 scrub ok 2024-02-19T21:59:41.022 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:59:40 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:59:40] "GET /metrics HTTP/1.1" 200 174235 "" "Prometheus/2.33.4" 2024-02-19T21:59:41.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:38.942369+0000 osd.6 (osd.6) 349 : cluster [DBG] 2.7 scrub starts 2024-02-19T21:59:41.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:38.945431+0000 osd.6 (osd.6) 350 : cluster [DBG] 2.7 scrub ok 2024-02-19T21:59:41.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:39.364454+0000 mgr.y (mgr.14514) 1028 : cluster [DBG] pgmap v1344: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 579 B/s rd, 0 op/s 2024-02-19T21:59:41.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:39.408219+0000 osd.7 (osd.7) 383 : cluster [DBG] 5.4 scrub starts 2024-02-19T21:59:41.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:39.411131+0000 osd.7 (osd.7) 384 : cluster [DBG] 5.4 scrub ok 2024-02-19T21:59:41.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:39.577477+0000 osd.5 (osd.5) 388 : cluster [DBG] 5.7 deep-scrub starts 2024-02-19T21:59:41.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:39.892263+0000 osd.3 (osd.3) 329 : cluster [DBG] 6.13 scrub starts 2024-02-19T21:59:41.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:40 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:39.962076+0000 osd.3 (osd.3) 330 : cluster [DBG] 6.13 scrub ok 2024-02-19T21:59:41.469 INFO:teuthology.orchestra.run.smithi080.stdout:163208757591 2024-02-19T21:59:41.469 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2024-02-19T21:59:41.746 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:59:41.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:59:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:59:41.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:39.580430+0000 osd.5 (osd.5) 389 : cluster [DBG] 5.7 deep-scrub ok 2024-02-19T21:59:41.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:41 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:40.541896+0000 osd.5 (osd.5) 390 : cluster [DBG] 6.7 scrub starts 2024-02-19T21:59:41.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:39.580430+0000 osd.5 (osd.5) 389 : cluster [DBG] 5.7 deep-scrub ok 2024-02-19T21:59:41.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:40.541896+0000 osd.5 (osd.5) 390 : cluster [DBG] 6.7 scrub starts 2024-02-19T21:59:41.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:39.580430+0000 osd.5 (osd.5) 389 : cluster [DBG] 5.7 deep-scrub ok 2024-02-19T21:59:41.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:40.541896+0000 osd.5 (osd.5) 390 : cluster [DBG] 6.7 scrub starts 2024-02-19T21:59:42.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:40.662993+0000 osd.5 (osd.5) 391 : cluster [DBG] 6.7 scrub ok 2024-02-19T21:59:42.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:41.365155+0000 mgr.y (mgr.14514) 1029 : cluster [DBG] pgmap v1345: 122 pgs: 1 active+clean+scrubbing, 121 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:59:42.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:41.451873+0000 osd.0 (osd.0) 49 : cluster [DBG] 4.1f scrub starts 2024-02-19T21:59:42.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:41.454149+0000 osd.0 (osd.0) 50 : cluster [DBG] 4.1f scrub ok 2024-02-19T21:59:42.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:41.539860+0000 osd.5 (osd.5) 392 : cluster [DBG] 6.12 scrub starts 2024-02-19T21:59:42.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:41.540789+0000 osd.5 (osd.5) 393 : cluster [DBG] 6.12 scrub ok 2024-02-19T21:59:42.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:41.554705+0000 mgr.y (mgr.14514) 1030 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:59:42.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:41.909154+0000 osd.3 (osd.3) 331 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:59:42.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:41.912623+0000 osd.3 (osd.3) 332 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:59:42.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:42.123458+0000 osd.2 (osd.2) 117 : cluster [DBG] 2.10 deep-scrub starts 2024-02-19T21:59:42.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:42.124457+0000 osd.2 (osd.2) 118 : cluster [DBG] 2.10 deep-scrub ok 2024-02-19T21:59:42.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:40.662993+0000 osd.5 (osd.5) 391 : cluster [DBG] 6.7 scrub ok 2024-02-19T21:59:42.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:41.365155+0000 mgr.y (mgr.14514) 1029 : cluster [DBG] pgmap v1345: 122 pgs: 1 active+clean+scrubbing, 121 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:59:42.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:41.451873+0000 osd.0 (osd.0) 49 : cluster [DBG] 4.1f scrub starts 2024-02-19T21:59:42.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:41.454149+0000 osd.0 (osd.0) 50 : cluster [DBG] 4.1f scrub ok 2024-02-19T21:59:42.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:41.539860+0000 osd.5 (osd.5) 392 : cluster [DBG] 6.12 scrub starts 2024-02-19T21:59:42.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:41.540789+0000 osd.5 (osd.5) 393 : cluster [DBG] 6.12 scrub ok 2024-02-19T21:59:42.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:41.554705+0000 mgr.y (mgr.14514) 1030 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:59:42.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:41.909154+0000 osd.3 (osd.3) 331 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:59:42.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:41.912623+0000 osd.3 (osd.3) 332 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:59:42.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:42.123458+0000 osd.2 (osd.2) 117 : cluster [DBG] 2.10 deep-scrub starts 2024-02-19T21:59:42.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:42.124457+0000 osd.2 (osd.2) 118 : cluster [DBG] 2.10 deep-scrub ok 2024-02-19T21:59:43.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:40.662993+0000 osd.5 (osd.5) 391 : cluster [DBG] 6.7 scrub ok 2024-02-19T21:59:43.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:41.365155+0000 mgr.y (mgr.14514) 1029 : cluster [DBG] pgmap v1345: 122 pgs: 1 active+clean+scrubbing, 121 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:59:43.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:41.451873+0000 osd.0 (osd.0) 49 : cluster [DBG] 4.1f scrub starts 2024-02-19T21:59:43.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:41.454149+0000 osd.0 (osd.0) 50 : cluster [DBG] 4.1f scrub ok 2024-02-19T21:59:43.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:41.539860+0000 osd.5 (osd.5) 392 : cluster [DBG] 6.12 scrub starts 2024-02-19T21:59:43.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:41.540789+0000 osd.5 (osd.5) 393 : cluster [DBG] 6.12 scrub ok 2024-02-19T21:59:43.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:41.554705+0000 mgr.y (mgr.14514) 1030 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:59:43.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:41.909154+0000 osd.3 (osd.3) 331 : cluster [DBG] 4.10 scrub starts 2024-02-19T21:59:43.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:41.912623+0000 osd.3 (osd.3) 332 : cluster [DBG] 4.10 scrub ok 2024-02-19T21:59:43.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:42.123458+0000 osd.2 (osd.2) 117 : cluster [DBG] 2.10 deep-scrub starts 2024-02-19T21:59:43.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:42 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:42.124457+0000 osd.2 (osd.2) 118 : cluster [DBG] 2.10 deep-scrub ok 2024-02-19T21:59:43.830 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:42.425560+0000 osd.0 (osd.0) 51 : cluster [DBG] 6.0 scrub starts 2024-02-19T21:59:43.831 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:42.428459+0000 osd.0 (osd.0) 52 : cluster [DBG] 6.0 scrub ok 2024-02-19T21:59:43.831 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:42.548123+0000 osd.5 (osd.5) 394 : cluster [DBG] 2.3 deep-scrub starts 2024-02-19T21:59:43.831 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:42.549161+0000 osd.5 (osd.5) 395 : cluster [DBG] 2.3 deep-scrub ok 2024-02-19T21:59:43.831 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:43.128358+0000 osd.2 (osd.2) 119 : cluster [DBG] 6.f scrub starts 2024-02-19T21:59:43.831 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:42.425560+0000 osd.0 (osd.0) 51 : cluster [DBG] 6.0 scrub starts 2024-02-19T21:59:43.831 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:42.428459+0000 osd.0 (osd.0) 52 : cluster [DBG] 6.0 scrub ok 2024-02-19T21:59:43.831 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:42.548123+0000 osd.5 (osd.5) 394 : cluster [DBG] 2.3 deep-scrub starts 2024-02-19T21:59:43.831 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:42.549161+0000 osd.5 (osd.5) 395 : cluster [DBG] 2.3 deep-scrub ok 2024-02-19T21:59:43.831 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:43 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:43.128358+0000 osd.2 (osd.2) 119 : cluster [DBG] 6.f scrub starts 2024-02-19T21:59:44.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:42.425560+0000 osd.0 (osd.0) 51 : cluster [DBG] 6.0 scrub starts 2024-02-19T21:59:44.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:42.428459+0000 osd.0 (osd.0) 52 : cluster [DBG] 6.0 scrub ok 2024-02-19T21:59:44.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:42.548123+0000 osd.5 (osd.5) 394 : cluster [DBG] 2.3 deep-scrub starts 2024-02-19T21:59:44.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:42.549161+0000 osd.5 (osd.5) 395 : cluster [DBG] 2.3 deep-scrub ok 2024-02-19T21:59:44.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:43 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:43.128358+0000 osd.2 (osd.2) 119 : cluster [DBG] 6.f scrub starts 2024-02-19T21:59:44.570 INFO:teuthology.orchestra.run.smithi080.stdout:201863463250 2024-02-19T21:59:44.571 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2024-02-19T21:59:44.840 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:59:44.845 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:43.211600+0000 osd.2 (osd.2) 120 : cluster [DBG] 6.f scrub ok 2024-02-19T21:59:44.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:43.365668+0000 mgr.y (mgr.14514) 1031 : cluster [DBG] pgmap v1346: 122 pgs: 1 active+clean+scrubbing, 121 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:59:44.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:43.891461+0000 osd.3 (osd.3) 333 : cluster [DBG] 6.11 scrub starts 2024-02-19T21:59:44.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:43.894514+0000 osd.3 (osd.3) 334 : cluster [DBG] 6.11 scrub ok 2024-02-19T21:59:44.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:44.569673+0000 osd.5 (osd.5) 396 : cluster [DBG] 2.18 scrub starts 2024-02-19T21:59:44.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:44.572662+0000 osd.5 (osd.5) 397 : cluster [DBG] 2.18 scrub ok 2024-02-19T21:59:44.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:43.211600+0000 osd.2 (osd.2) 120 : cluster [DBG] 6.f scrub ok 2024-02-19T21:59:44.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:43.365668+0000 mgr.y (mgr.14514) 1031 : cluster [DBG] pgmap v1346: 122 pgs: 1 active+clean+scrubbing, 121 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:59:44.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:43.891461+0000 osd.3 (osd.3) 333 : cluster [DBG] 6.11 scrub starts 2024-02-19T21:59:44.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:43.894514+0000 osd.3 (osd.3) 334 : cluster [DBG] 6.11 scrub ok 2024-02-19T21:59:44.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:44.569673+0000 osd.5 (osd.5) 396 : cluster [DBG] 2.18 scrub starts 2024-02-19T21:59:44.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:44 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:44.572662+0000 osd.5 (osd.5) 397 : cluster [DBG] 2.18 scrub ok 2024-02-19T21:59:45.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:43.211600+0000 osd.2 (osd.2) 120 : cluster [DBG] 6.f scrub ok 2024-02-19T21:59:45.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:43.365668+0000 mgr.y (mgr.14514) 1031 : cluster [DBG] pgmap v1346: 122 pgs: 1 active+clean+scrubbing, 121 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:59:45.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:43.891461+0000 osd.3 (osd.3) 333 : cluster [DBG] 6.11 scrub starts 2024-02-19T21:59:45.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:43.894514+0000 osd.3 (osd.3) 334 : cluster [DBG] 6.11 scrub ok 2024-02-19T21:59:45.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:44.569673+0000 osd.5 (osd.5) 396 : cluster [DBG] 2.18 scrub starts 2024-02-19T21:59:45.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:44 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:44.572662+0000 osd.5 (osd.5) 397 : cluster [DBG] 2.18 scrub ok 2024-02-19T21:59:46.041 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:43.857215+0000 osd.1 (osd.1) 356 : cluster [DBG] 4.7 scrub starts 2024-02-19T21:59:46.041 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:43.859380+0000 osd.1 (osd.1) 357 : cluster [DBG] 4.7 scrub ok 2024-02-19T21:59:46.041 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:43.857215+0000 osd.1 (osd.1) 356 : cluster [DBG] 4.7 scrub starts 2024-02-19T21:59:46.041 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:45 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:43.859380+0000 osd.1 (osd.1) 357 : cluster [DBG] 4.7 scrub ok 2024-02-19T21:59:46.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:59:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:59:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:59:46.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:43.857215+0000 osd.1 (osd.1) 356 : cluster [DBG] 4.7 scrub starts 2024-02-19T21:59:46.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:43.859380+0000 osd.1 (osd.1) 357 : cluster [DBG] 4.7 scrub ok 2024-02-19T21:59:46.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:45.366178+0000 mgr.y (mgr.14514) 1032 : cluster [DBG] pgmap v1347: 122 pgs: 1 active+clean+scrubbing, 121 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:59:46.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:45.446888+0000 osd.0 (osd.0) 53 : cluster [DBG] 4.b scrub starts 2024-02-19T21:59:46.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:45.450624+0000 osd.0 (osd.0) 54 : cluster [DBG] 4.b scrub ok 2024-02-19T21:59:46.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:45.366178+0000 mgr.y (mgr.14514) 1032 : cluster [DBG] pgmap v1347: 122 pgs: 1 active+clean+scrubbing, 121 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:59:46.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:45.446888+0000 osd.0 (osd.0) 53 : cluster [DBG] 4.b scrub starts 2024-02-19T21:59:46.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:46 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:45.450624+0000 osd.0 (osd.0) 54 : cluster [DBG] 4.b scrub ok 2024-02-19T21:59:47.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:45.366178+0000 mgr.y (mgr.14514) 1032 : cluster [DBG] pgmap v1347: 122 pgs: 1 active+clean+scrubbing, 121 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:59:47.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:45.446888+0000 osd.0 (osd.0) 53 : cluster [DBG] 4.b scrub starts 2024-02-19T21:59:47.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:46 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:45.450624+0000 osd.0 (osd.0) 54 : cluster [DBG] 4.b scrub ok 2024-02-19T21:59:47.308 INFO:teuthology.orchestra.run.smithi080.stdout:236223201612 2024-02-19T21:59:47.308 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-02-19T21:59:47.576 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:59:47.887 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:45.866579+0000 osd.1 (osd.1) 358 : cluster [DBG] 2.6 deep-scrub starts 2024-02-19T21:59:47.888 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:45.867488+0000 osd.1 (osd.1) 359 : cluster [DBG] 2.6 deep-scrub ok 2024-02-19T21:59:47.888 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:46.566234+0000 osd.6 (osd.6) 351 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:59:47.888 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:46.566331+0000 osd.6 (osd.6) 352 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:59:47.888 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:46.620066+0000 mon.a (mon.0) 2176 : cluster [DBG] osdmap e609: 8 total, 8 up, 8 in 2024-02-19T21:59:47.888 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:46.924457+0000 osd.3 (osd.3) 335 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:59:47.888 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:46.925279+0000 osd.3 (osd.3) 336 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:59:47.888 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:47.119341+0000 osd.2 (osd.2) 121 : cluster [DBG] 2.1 scrub starts 2024-02-19T21:59:47.888 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:47.120135+0000 osd.2 (osd.2) 122 : cluster [DBG] 2.1 scrub ok 2024-02-19T21:59:47.888 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:47.578137+0000 osd.5 (osd.5) 398 : cluster [DBG] 6.19 scrub starts 2024-02-19T21:59:47.889 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:45.866579+0000 osd.1 (osd.1) 358 : cluster [DBG] 2.6 deep-scrub starts 2024-02-19T21:59:47.889 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:45.867488+0000 osd.1 (osd.1) 359 : cluster [DBG] 2.6 deep-scrub ok 2024-02-19T21:59:47.889 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:46.566234+0000 osd.6 (osd.6) 351 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:59:47.889 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:46.566331+0000 osd.6 (osd.6) 352 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:59:47.889 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:46.620066+0000 mon.a (mon.0) 2176 : cluster [DBG] osdmap e609: 8 total, 8 up, 8 in 2024-02-19T21:59:47.889 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:46.924457+0000 osd.3 (osd.3) 335 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:59:47.889 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:46.925279+0000 osd.3 (osd.3) 336 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:59:47.889 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:47.119341+0000 osd.2 (osd.2) 121 : cluster [DBG] 2.1 scrub starts 2024-02-19T21:59:47.890 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:47.120135+0000 osd.2 (osd.2) 122 : cluster [DBG] 2.1 scrub ok 2024-02-19T21:59:47.890 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:47 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:47.578137+0000 osd.5 (osd.5) 398 : cluster [DBG] 6.19 scrub starts 2024-02-19T21:59:48.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:45.866579+0000 osd.1 (osd.1) 358 : cluster [DBG] 2.6 deep-scrub starts 2024-02-19T21:59:48.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:45.867488+0000 osd.1 (osd.1) 359 : cluster [DBG] 2.6 deep-scrub ok 2024-02-19T21:59:48.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:46.566234+0000 osd.6 (osd.6) 351 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:59:48.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:46.566331+0000 osd.6 (osd.6) 352 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:59:48.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:46.620066+0000 mon.a (mon.0) 2176 : cluster [DBG] osdmap e609: 8 total, 8 up, 8 in 2024-02-19T21:59:48.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:46.924457+0000 osd.3 (osd.3) 335 : cluster [DBG] 2.1e scrub starts 2024-02-19T21:59:48.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:46.925279+0000 osd.3 (osd.3) 336 : cluster [DBG] 2.1e scrub ok 2024-02-19T21:59:48.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:47.119341+0000 osd.2 (osd.2) 121 : cluster [DBG] 2.1 scrub starts 2024-02-19T21:59:48.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:47.120135+0000 osd.2 (osd.2) 122 : cluster [DBG] 2.1 scrub ok 2024-02-19T21:59:48.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:47 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:47.578137+0000 osd.5 (osd.5) 398 : cluster [DBG] 6.19 scrub starts 2024-02-19T21:59:48.713 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:47.366533+0000 mgr.y (mgr.14514) 1033 : cluster [DBG] pgmap v1349: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:59:48.714 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:47.663030+0000 osd.5 (osd.5) 399 : cluster [DBG] 6.19 scrub ok 2024-02-19T21:59:48.714 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:47.366533+0000 mgr.y (mgr.14514) 1033 : cluster [DBG] pgmap v1349: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:59:48.714 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:48 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:47.663030+0000 osd.5 (osd.5) 399 : cluster [DBG] 6.19 scrub ok 2024-02-19T21:59:49.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:47.366533+0000 mgr.y (mgr.14514) 1033 : cluster [DBG] pgmap v1349: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:59:49.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:48 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:47.663030+0000 osd.5 (osd.5) 399 : cluster [DBG] 6.19 scrub ok 2024-02-19T21:59:49.384 INFO:teuthology.orchestra.run.smithi080.stdout:2439541424152 2024-02-19T21:59:49.731 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:49.385485+0000 mon.c (mon.2) 152 : audit [DBG] from='client.? 172.21.15.80:0/20368623' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-19T21:59:49.731 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:49.385485+0000 mon.c (mon.2) 152 : audit [DBG] from='client.? 172.21.15.80:0/20368623' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-19T21:59:50.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:49 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:49.385485+0000 mon.c (mon.2) 152 : audit [DBG] from='client.? 172.21.15.80:0/20368623' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-19T21:59:50.116 INFO:tasks.cephadm.ceph_manager.ceph:need seq 2439541424147 got 2439541424152 for osd.0 2024-02-19T21:59:50.117 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-02-19T21:59:50.385 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:59:51.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:48.851680+0000 osd.1 (osd.1) 360 : cluster [DBG] 6.1 scrub starts 2024-02-19T21:59:51.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:48.913858+0000 osd.1 (osd.1) 361 : cluster [DBG] 6.1 scrub ok 2024-02-19T21:59:51.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:49.366921+0000 mgr.y (mgr.14514) 1034 : cluster [DBG] pgmap v1350: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:59:51.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:50 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:50.525276+0000 mon.a (mon.0) 2177 : cluster [DBG] osdmap e610: 8 total, 8 up, 8 in 2024-02-19T21:59:51.095 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 21:59:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:59:50] "GET /metrics HTTP/1.1" 200 174239 "" "Prometheus/2.33.4" 2024-02-19T21:59:51.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:48.851680+0000 osd.1 (osd.1) 360 : cluster [DBG] 6.1 scrub starts 2024-02-19T21:59:51.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:48.913858+0000 osd.1 (osd.1) 361 : cluster [DBG] 6.1 scrub ok 2024-02-19T21:59:51.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:49.366921+0000 mgr.y (mgr.14514) 1034 : cluster [DBG] pgmap v1350: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:59:51.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:50.525276+0000 mon.a (mon.0) 2177 : cluster [DBG] osdmap e610: 8 total, 8 up, 8 in 2024-02-19T21:59:51.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:48.851680+0000 osd.1 (osd.1) 360 : cluster [DBG] 6.1 scrub starts 2024-02-19T21:59:51.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:48.913858+0000 osd.1 (osd.1) 361 : cluster [DBG] 6.1 scrub ok 2024-02-19T21:59:51.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:49.366921+0000 mgr.y (mgr.14514) 1034 : cluster [DBG] pgmap v1350: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:59:51.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:50 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:50.525276+0000 mon.a (mon.0) 2177 : cluster [DBG] osdmap e610: 8 total, 8 up, 8 in 2024-02-19T21:59:52.056 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 21:59:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T21:59:52.258 INFO:teuthology.orchestra.run.smithi080.stdout:55834575214 2024-02-19T21:59:53.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:51.367282+0000 mgr.y (mgr.14514) 1035 : cluster [DBG] pgmap v1352: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:59:53.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:51.458482+0000 osd.7 (osd.7) 385 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:59:53.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:51.536031+0000 osd.7 (osd.7) 386 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:59:53.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:51.565513+0000 mgr.y (mgr.14514) 1036 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:59:53.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:52.259421+0000 mon.a (mon.0) 2178 : audit [DBG] from='client.? 172.21.15.80:0/3886089389' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-19T21:59:53.095 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:51.367282+0000 mgr.y (mgr.14514) 1035 : cluster [DBG] pgmap v1352: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:59:53.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:51.458482+0000 osd.7 (osd.7) 385 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:59:53.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:51.536031+0000 osd.7 (osd.7) 386 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:59:53.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:51.565513+0000 mgr.y (mgr.14514) 1036 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:59:53.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:52.259421+0000 mon.a (mon.0) 2178 : audit [DBG] from='client.? 172.21.15.80:0/3886089389' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-19T21:59:53.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:51.367282+0000 mgr.y (mgr.14514) 1035 : cluster [DBG] pgmap v1352: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:59:53.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:51.458482+0000 osd.7 (osd.7) 385 : cluster [DBG] 6.3 scrub starts 2024-02-19T21:59:53.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:51.536031+0000 osd.7 (osd.7) 386 : cluster [DBG] 6.3 scrub ok 2024-02-19T21:59:53.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:51.565513+0000 mgr.y (mgr.14514) 1036 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T21:59:53.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:52.259421+0000 mon.a (mon.0) 2178 : audit [DBG] from='client.? 172.21.15.80:0/3886089389' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-19T21:59:53.123 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834575209 got 55834575214 for osd.1 2024-02-19T21:59:53.123 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-02-19T21:59:53.395 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:59:54.816 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:53.367796+0000 mgr.y (mgr.14514) 1037 : cluster [DBG] pgmap v1353: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:59:54.816 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:54.287754+0000 osd.0 (osd.0) 55 : cluster [DBG] 4.3 deep-scrub starts 2024-02-19T21:59:54.817 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:54.291766+0000 osd.0 (osd.0) 56 : cluster [DBG] 4.3 deep-scrub ok 2024-02-19T21:59:54.817 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:54.486825+0000 osd.5 (osd.5) 400 : cluster [DBG] 4.f scrub starts 2024-02-19T21:59:54.817 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:54.490297+0000 osd.5 (osd.5) 401 : cluster [DBG] 4.f scrub ok 2024-02-19T21:59:54.817 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:53.367796+0000 mgr.y (mgr.14514) 1037 : cluster [DBG] pgmap v1353: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:59:54.817 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:54.287754+0000 osd.0 (osd.0) 55 : cluster [DBG] 4.3 deep-scrub starts 2024-02-19T21:59:54.817 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:54.291766+0000 osd.0 (osd.0) 56 : cluster [DBG] 4.3 deep-scrub ok 2024-02-19T21:59:54.817 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:54.486825+0000 osd.5 (osd.5) 400 : cluster [DBG] 4.f scrub starts 2024-02-19T21:59:54.817 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:54 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:54.490297+0000 osd.5 (osd.5) 401 : cluster [DBG] 4.f scrub ok 2024-02-19T21:59:55.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:53.367796+0000 mgr.y (mgr.14514) 1037 : cluster [DBG] pgmap v1353: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T21:59:55.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:54.287754+0000 osd.0 (osd.0) 55 : cluster [DBG] 4.3 deep-scrub starts 2024-02-19T21:59:55.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:54.291766+0000 osd.0 (osd.0) 56 : cluster [DBG] 4.3 deep-scrub ok 2024-02-19T21:59:55.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:54.486825+0000 osd.5 (osd.5) 400 : cluster [DBG] 4.f scrub starts 2024-02-19T21:59:55.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:54.490297+0000 osd.5 (osd.5) 401 : cluster [DBG] 4.f scrub ok 2024-02-19T21:59:55.202 INFO:teuthology.orchestra.run.smithi080.stdout:1692217114754 2024-02-19T21:59:55.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:55.203916+0000 mon.a (mon.0) 2179 : audit [DBG] from='client.? 172.21.15.80:0/624598542' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-19T21:59:55.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:55 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:55.203916+0000 mon.a (mon.0) 2179 : audit [DBG] from='client.? 172.21.15.80:0/624598542' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-19T21:59:55.876 INFO:tasks.cephadm.ceph_manager.ceph:need seq 1692217114749 got 1692217114754 for osd.2 2024-02-19T21:59:55.876 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-02-19T21:59:56.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:55.203916+0000 mon.a (mon.0) 2179 : audit [DBG] from='client.? 172.21.15.80:0/624598542' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-19T21:59:56.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 21:59:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:21:59:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T21:59:56.142 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T21:59:56.649 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:55.368250+0000 mgr.y (mgr.14514) 1038 : cluster [DBG] pgmap v1354: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 585 B/s rd, 0 op/s 2024-02-19T21:59:56.649 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:55.497336+0000 osd.4 (osd.4) 335 : cluster [DBG] 4.1 scrub starts 2024-02-19T21:59:56.649 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:55.500943+0000 osd.4 (osd.4) 336 : cluster [DBG] 4.1 scrub ok 2024-02-19T21:59:56.650 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:55.368250+0000 mgr.y (mgr.14514) 1038 : cluster [DBG] pgmap v1354: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 585 B/s rd, 0 op/s 2024-02-19T21:59:56.650 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:55.497336+0000 osd.4 (osd.4) 335 : cluster [DBG] 4.1 scrub starts 2024-02-19T21:59:56.650 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:56 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:55.500943+0000 osd.4 (osd.4) 336 : cluster [DBG] 4.1 scrub ok 2024-02-19T21:59:57.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:55.368250+0000 mgr.y (mgr.14514) 1038 : cluster [DBG] pgmap v1354: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 585 B/s rd, 0 op/s 2024-02-19T21:59:57.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:55.497336+0000 osd.4 (osd.4) 335 : cluster [DBG] 4.1 scrub starts 2024-02-19T21:59:57.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:55.500943+0000 osd.4 (osd.4) 336 : cluster [DBG] 4.1 scrub ok 2024-02-19T21:59:57.696 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:55.841251+0000 osd.1 (osd.1) 362 : cluster [DBG] 3.0 scrub starts 2024-02-19T21:59:57.696 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:55.844897+0000 osd.1 (osd.1) 363 : cluster [DBG] 3.0 scrub ok 2024-02-19T21:59:57.696 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:56.952029+0000 osd.2 (osd.2) 123 : cluster [DBG] 2.e scrub starts 2024-02-19T21:59:57.696 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:56.953064+0000 osd.2 (osd.2) 124 : cluster [DBG] 2.e scrub ok 2024-02-19T21:59:57.697 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:55.841251+0000 osd.1 (osd.1) 362 : cluster [DBG] 3.0 scrub starts 2024-02-19T21:59:57.697 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:55.844897+0000 osd.1 (osd.1) 363 : cluster [DBG] 3.0 scrub ok 2024-02-19T21:59:57.697 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:56.952029+0000 osd.2 (osd.2) 123 : cluster [DBG] 2.e scrub starts 2024-02-19T21:59:57.697 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:57 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:56.953064+0000 osd.2 (osd.2) 124 : cluster [DBG] 2.e scrub ok 2024-02-19T21:59:58.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:55.841251+0000 osd.1 (osd.1) 362 : cluster [DBG] 3.0 scrub starts 2024-02-19T21:59:58.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:55.844897+0000 osd.1 (osd.1) 363 : cluster [DBG] 3.0 scrub ok 2024-02-19T21:59:58.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:56.952029+0000 osd.2 (osd.2) 123 : cluster [DBG] 2.e scrub starts 2024-02-19T21:59:58.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:56.953064+0000 osd.2 (osd.2) 124 : cluster [DBG] 2.e scrub ok 2024-02-19T21:59:58.129 INFO:teuthology.orchestra.run.smithi080.stdout:111669150053 2024-02-19T21:59:58.803 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:57.368917+0000 mgr.y (mgr.14514) 1039 : cluster [DBG] pgmap v1355: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:59:58.804 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T21:59:58.130596+0000 mon.c (mon.2) 153 : audit [DBG] from='client.? 172.21.15.80:0/3692925646' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-19T21:59:58.804 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:57.368917+0000 mgr.y (mgr.14514) 1039 : cluster [DBG] pgmap v1355: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:59:58.804 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:58 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T21:59:58.130596+0000 mon.c (mon.2) 153 : audit [DBG] from='client.? 172.21.15.80:0/3692925646' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-19T21:59:58.823 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669150048 got 111669150053 for osd.3 2024-02-19T21:59:58.823 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-02-19T21:59:59.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:57.368917+0000 mgr.y (mgr.14514) 1039 : cluster [DBG] pgmap v1355: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T21:59:59.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T21:59:58.130596+0000 mon.c (mon.2) 153 : audit [DBG] from='client.? 172.21.15.80:0/3692925646' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-19T21:59:59.091 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T22:00:00.013 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:58.463781+0000 osd.7 (osd.7) 387 : cluster [DBG] 2.1c scrub starts 2024-02-19T22:00:00.013 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:58.466694+0000 osd.7 (osd.7) 388 : cluster [DBG] 2.1c scrub ok 2024-02-19T22:00:00.013 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:59.253054+0000 osd.0 (osd.0) 57 : cluster [DBG] 5.3 scrub starts 2024-02-19T22:00:00.013 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 21:59:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:59.256675+0000 osd.0 (osd.0) 58 : cluster [DBG] 5.3 scrub ok 2024-02-19T22:00:00.013 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:58.463781+0000 osd.7 (osd.7) 387 : cluster [DBG] 2.1c scrub starts 2024-02-19T22:00:00.014 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:58.466694+0000 osd.7 (osd.7) 388 : cluster [DBG] 2.1c scrub ok 2024-02-19T22:00:00.014 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:59.253054+0000 osd.0 (osd.0) 57 : cluster [DBG] 5.3 scrub starts 2024-02-19T22:00:00.014 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 21:59:59 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:59.256675+0000 osd.0 (osd.0) 58 : cluster [DBG] 5.3 scrub ok 2024-02-19T22:00:00.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:58.463781+0000 osd.7 (osd.7) 387 : cluster [DBG] 2.1c scrub starts 2024-02-19T22:00:00.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:58.466694+0000 osd.7 (osd.7) 388 : cluster [DBG] 2.1c scrub ok 2024-02-19T22:00:00.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:59.253054+0000 osd.0 (osd.0) 57 : cluster [DBG] 5.3 scrub starts 2024-02-19T22:00:00.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 21:59:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:59.256675+0000 osd.0 (osd.0) 58 : cluster [DBG] 5.3 scrub ok 2024-02-19T22:00:01.048 INFO:teuthology.orchestra.run.smithi080.stdout:137438953822 2024-02-19T22:00:01.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T21:59:59.369444+0000 mgr.y (mgr.14514) 1040 : cluster [DBG] pgmap v1356: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T22:00:01.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:00.000147+0000 mon.a (mon.0) 2180 : cluster [INF] overall HEALTH_OK 2024-02-19T22:00:01.080 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 22:00:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:22:00:00] "GET /metrics HTTP/1.1" 200 174239 "" "Prometheus/2.33.4" 2024-02-19T22:00:01.080 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T21:59:59.369444+0000 mgr.y (mgr.14514) 1040 : cluster [DBG] pgmap v1356: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T22:00:01.080 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:00.000147+0000 mon.a (mon.0) 2180 : cluster [INF] overall HEALTH_OK 2024-02-19T22:00:01.081 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T21:59:59.369444+0000 mgr.y (mgr.14514) 1040 : cluster [DBG] pgmap v1356: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T22:00:01.081 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:00 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:00.000147+0000 mon.a (mon.0) 2180 : cluster [INF] overall HEALTH_OK 2024-02-19T22:00:01.717 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:00.936110+0000 osd.3 (osd.3) 337 : cluster [DBG] 2.1b scrub starts 2024-02-19T22:00:01.717 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:00.937424+0000 osd.3 (osd.3) 338 : cluster [DBG] 2.1b scrub ok 2024-02-19T22:00:01.717 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T22:00:01.048775+0000 mon.c (mon.2) 154 : audit [DBG] from='client.? 172.21.15.80:0/3798905181' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-19T22:00:01.718 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:00.936110+0000 osd.3 (osd.3) 337 : cluster [DBG] 2.1b scrub starts 2024-02-19T22:00:01.718 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:00.937424+0000 osd.3 (osd.3) 338 : cluster [DBG] 2.1b scrub ok 2024-02-19T22:00:01.718 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:01 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T22:00:01.048775+0000 mon.c (mon.2) 154 : audit [DBG] from='client.? 172.21.15.80:0/3798905181' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-19T22:00:01.739 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953818 got 137438953822 for osd.4 2024-02-19T22:00:01.739 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-02-19T22:00:02.010 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T22:00:02.056 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 22:00:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T22:00:02.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:00.936110+0000 osd.3 (osd.3) 337 : cluster [DBG] 2.1b scrub starts 2024-02-19T22:00:02.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:00.937424+0000 osd.3 (osd.3) 338 : cluster [DBG] 2.1b scrub ok 2024-02-19T22:00:02.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T22:00:01.048775+0000 mon.c (mon.2) 154 : audit [DBG] from='client.? 172.21.15.80:0/3798905181' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-19T22:00:02.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:01.362798+0000 osd.4 (osd.4) 337 : cluster [DBG] 4.18 scrub starts 2024-02-19T22:00:02.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:01.366336+0000 osd.4 (osd.4) 338 : cluster [DBG] 4.18 scrub ok 2024-02-19T22:00:02.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:01.370109+0000 mgr.y (mgr.14514) 1041 : cluster [DBG] pgmap v1357: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 944 B/s rd, 0 op/s 2024-02-19T22:00:02.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:01.430071+0000 osd.7 (osd.7) 389 : cluster [DBG] 2.b deep-scrub starts 2024-02-19T22:00:02.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:01.433141+0000 osd.7 (osd.7) 390 : cluster [DBG] 2.b deep-scrub ok 2024-02-19T22:00:02.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T22:00:01.568164+0000 mgr.y (mgr.14514) 1042 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T22:00:02.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:01.923372+0000 osd.3 (osd.3) 339 : cluster [DBG] 6.1b scrub starts 2024-02-19T22:00:02.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:02.036029+0000 osd.3 (osd.3) 340 : cluster [DBG] 6.1b scrub ok 2024-02-19T22:00:02.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:02.212701+0000 osd.0 (osd.0) 59 : cluster [DBG] 4.16 deep-scrub starts 2024-02-19T22:00:02.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:02.216771+0000 osd.0 (osd.0) 60 : cluster [DBG] 4.16 deep-scrub ok 2024-02-19T22:00:02.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:02.388102+0000 osd.5 (osd.5) 402 : cluster [DBG] 4.15 scrub starts 2024-02-19T22:00:02.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:02.389830+0000 osd.5 (osd.5) 403 : cluster [DBG] 4.15 scrub ok 2024-02-19T22:00:02.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:01.362798+0000 osd.4 (osd.4) 337 : cluster [DBG] 4.18 scrub starts 2024-02-19T22:00:02.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:01.366336+0000 osd.4 (osd.4) 338 : cluster [DBG] 4.18 scrub ok 2024-02-19T22:00:02.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:01.370109+0000 mgr.y (mgr.14514) 1041 : cluster [DBG] pgmap v1357: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 944 B/s rd, 0 op/s 2024-02-19T22:00:02.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:01.430071+0000 osd.7 (osd.7) 389 : cluster [DBG] 2.b deep-scrub starts 2024-02-19T22:00:02.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:01.433141+0000 osd.7 (osd.7) 390 : cluster [DBG] 2.b deep-scrub ok 2024-02-19T22:00:02.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T22:00:01.568164+0000 mgr.y (mgr.14514) 1042 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T22:00:02.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:01.923372+0000 osd.3 (osd.3) 339 : cluster [DBG] 6.1b scrub starts 2024-02-19T22:00:02.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:02.036029+0000 osd.3 (osd.3) 340 : cluster [DBG] 6.1b scrub ok 2024-02-19T22:00:02.847 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:02.212701+0000 osd.0 (osd.0) 59 : cluster [DBG] 4.16 deep-scrub starts 2024-02-19T22:00:02.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:02.216771+0000 osd.0 (osd.0) 60 : cluster [DBG] 4.16 deep-scrub ok 2024-02-19T22:00:02.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:02.388102+0000 osd.5 (osd.5) 402 : cluster [DBG] 4.15 scrub starts 2024-02-19T22:00:02.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:02 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:02.389830+0000 osd.5 (osd.5) 403 : cluster [DBG] 4.15 scrub ok 2024-02-19T22:00:03.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:01.362798+0000 osd.4 (osd.4) 337 : cluster [DBG] 4.18 scrub starts 2024-02-19T22:00:03.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:01.366336+0000 osd.4 (osd.4) 338 : cluster [DBG] 4.18 scrub ok 2024-02-19T22:00:03.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:01.370109+0000 mgr.y (mgr.14514) 1041 : cluster [DBG] pgmap v1357: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 944 B/s rd, 0 op/s 2024-02-19T22:00:03.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:01.430071+0000 osd.7 (osd.7) 389 : cluster [DBG] 2.b deep-scrub starts 2024-02-19T22:00:03.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:01.433141+0000 osd.7 (osd.7) 390 : cluster [DBG] 2.b deep-scrub ok 2024-02-19T22:00:03.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T22:00:01.568164+0000 mgr.y (mgr.14514) 1042 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T22:00:03.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:01.923372+0000 osd.3 (osd.3) 339 : cluster [DBG] 6.1b scrub starts 2024-02-19T22:00:03.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:02.036029+0000 osd.3 (osd.3) 340 : cluster [DBG] 6.1b scrub ok 2024-02-19T22:00:03.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:02.212701+0000 osd.0 (osd.0) 59 : cluster [DBG] 4.16 deep-scrub starts 2024-02-19T22:00:03.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:02.216771+0000 osd.0 (osd.0) 60 : cluster [DBG] 4.16 deep-scrub ok 2024-02-19T22:00:03.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:02.388102+0000 osd.5 (osd.5) 402 : cluster [DBG] 4.15 scrub starts 2024-02-19T22:00:03.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:02.389830+0000 osd.5 (osd.5) 403 : cluster [DBG] 4.15 scrub ok 2024-02-19T22:00:03.928 INFO:teuthology.orchestra.run.smithi080.stdout:163208757595 2024-02-19T22:00:04.727 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757591 got 163208757595 for osd.5 2024-02-19T22:00:04.736 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.6 2024-02-19T22:00:05.007 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T22:00:05.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:03.370709+0000 mgr.y (mgr.14514) 1043 : cluster [DBG] pgmap v1358: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T22:00:05.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T22:00:03.929403+0000 mon.a (mon.0) 2181 : audit [DBG] from='client.? 172.21.15.80:0/2711689425' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-19T22:00:05.095 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:03.370709+0000 mgr.y (mgr.14514) 1043 : cluster [DBG] pgmap v1358: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T22:00:05.096 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T22:00:03.929403+0000 mon.a (mon.0) 2181 : audit [DBG] from='client.? 172.21.15.80:0/2711689425' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-19T22:00:05.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:03.370709+0000 mgr.y (mgr.14514) 1043 : cluster [DBG] pgmap v1358: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T22:00:05.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:04 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T22:00:03.929403+0000 mon.a (mon.0) 2181 : audit [DBG] from='client.? 172.21.15.80:0/2711689425' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-19T22:00:06.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 22:00:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:22:00:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T22:00:06.843 INFO:teuthology.orchestra.run.smithi080.stdout:201863463254 2024-02-19T22:00:06.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:05.371060+0000 mgr.y (mgr.14514) 1044 : cluster [DBG] pgmap v1359: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T22:00:06.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:05.475388+0000 osd.4 (osd.4) 339 : cluster [DBG] 4.13 scrub starts 2024-02-19T22:00:06.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:05.478909+0000 osd.4 (osd.4) 340 : cluster [DBG] 4.13 scrub ok 2024-02-19T22:00:06.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:05.371060+0000 mgr.y (mgr.14514) 1044 : cluster [DBG] pgmap v1359: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T22:00:06.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:05.475388+0000 osd.4 (osd.4) 339 : cluster [DBG] 4.13 scrub starts 2024-02-19T22:00:06.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:06 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:05.478909+0000 osd.4 (osd.4) 340 : cluster [DBG] 4.13 scrub ok 2024-02-19T22:00:07.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:05.371060+0000 mgr.y (mgr.14514) 1044 : cluster [DBG] pgmap v1359: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-19T22:00:07.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:05.475388+0000 osd.4 (osd.4) 339 : cluster [DBG] 4.13 scrub starts 2024-02-19T22:00:07.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:05.478909+0000 osd.4 (osd.4) 340 : cluster [DBG] 4.13 scrub ok 2024-02-19T22:00:07.524 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863463250 got 201863463254 for osd.6 2024-02-19T22:00:07.524 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.7 2024-02-19T22:00:07.794 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T22:00:07.845 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:06.696379+0000 osd.1 (osd.1) 364 : cluster [DBG] 6.4 scrub starts 2024-02-19T22:00:07.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:06.697197+0000 osd.1 (osd.1) 365 : cluster [DBG] 6.4 scrub ok 2024-02-19T22:00:07.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T22:00:06.844822+0000 mon.a (mon.0) 2182 : audit [DBG] from='client.? 172.21.15.80:0/1770759057' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-19T22:00:07.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:07.167448+0000 osd.0 (osd.0) 61 : cluster [DBG] 3.1 scrub starts 2024-02-19T22:00:07.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:07.170341+0000 osd.0 (osd.0) 62 : cluster [DBG] 3.1 scrub ok 2024-02-19T22:00:07.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:06.696379+0000 osd.1 (osd.1) 364 : cluster [DBG] 6.4 scrub starts 2024-02-19T22:00:07.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:06.697197+0000 osd.1 (osd.1) 365 : cluster [DBG] 6.4 scrub ok 2024-02-19T22:00:07.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T22:00:06.844822+0000 mon.a (mon.0) 2182 : audit [DBG] from='client.? 172.21.15.80:0/1770759057' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-19T22:00:07.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:07.167448+0000 osd.0 (osd.0) 61 : cluster [DBG] 3.1 scrub starts 2024-02-19T22:00:07.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:07 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:07.170341+0000 osd.0 (osd.0) 62 : cluster [DBG] 3.1 scrub ok 2024-02-19T22:00:08.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:06.696379+0000 osd.1 (osd.1) 364 : cluster [DBG] 6.4 scrub starts 2024-02-19T22:00:08.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:06.697197+0000 osd.1 (osd.1) 365 : cluster [DBG] 6.4 scrub ok 2024-02-19T22:00:08.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T22:00:06.844822+0000 mon.a (mon.0) 2182 : audit [DBG] from='client.? 172.21.15.80:0/1770759057' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-19T22:00:08.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:07.167448+0000 osd.0 (osd.0) 61 : cluster [DBG] 3.1 scrub starts 2024-02-19T22:00:08.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:07.170341+0000 osd.0 (osd.0) 62 : cluster [DBG] 3.1 scrub ok 2024-02-19T22:00:08.935 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:07.371743+0000 mgr.y (mgr.14514) 1045 : cluster [DBG] pgmap v1360: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T22:00:08.935 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:07.420978+0000 osd.4 (osd.4) 341 : cluster [DBG] 6.2 scrub starts 2024-02-19T22:00:08.935 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:07.467727+0000 osd.4 (osd.4) 342 : cluster [DBG] 6.2 scrub ok 2024-02-19T22:00:08.935 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:08.166101+0000 osd.0 (osd.0) 63 : cluster [DBG] 2.13 scrub starts 2024-02-19T22:00:08.935 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:08.169177+0000 osd.0 (osd.0) 64 : cluster [DBG] 2.13 scrub ok 2024-02-19T22:00:08.935 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:07.371743+0000 mgr.y (mgr.14514) 1045 : cluster [DBG] pgmap v1360: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T22:00:08.936 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:07.420978+0000 osd.4 (osd.4) 341 : cluster [DBG] 6.2 scrub starts 2024-02-19T22:00:08.936 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:07.467727+0000 osd.4 (osd.4) 342 : cluster [DBG] 6.2 scrub ok 2024-02-19T22:00:08.936 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:08.166101+0000 osd.0 (osd.0) 63 : cluster [DBG] 2.13 scrub starts 2024-02-19T22:00:08.936 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:08 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:08.169177+0000 osd.0 (osd.0) 64 : cluster [DBG] 2.13 scrub ok 2024-02-19T22:00:09.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:07.371743+0000 mgr.y (mgr.14514) 1045 : cluster [DBG] pgmap v1360: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T22:00:09.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:07.420978+0000 osd.4 (osd.4) 341 : cluster [DBG] 6.2 scrub starts 2024-02-19T22:00:09.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:07.467727+0000 osd.4 (osd.4) 342 : cluster [DBG] 6.2 scrub ok 2024-02-19T22:00:09.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:08.166101+0000 osd.0 (osd.0) 63 : cluster [DBG] 2.13 scrub starts 2024-02-19T22:00:09.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:08.169177+0000 osd.0 (osd.0) 64 : cluster [DBG] 2.13 scrub ok 2024-02-19T22:00:09.645 INFO:teuthology.orchestra.run.smithi080.stdout:236223201616 2024-02-19T22:00:09.995 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:08.366091+0000 osd.3 (osd.3) 341 : cluster [DBG] purged_snaps scrub starts 2024-02-19T22:00:09.995 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:08.366181+0000 osd.3 (osd.3) 342 : cluster [DBG] purged_snaps scrub ok 2024-02-19T22:00:09.995 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:08.692472+0000 mon.a (mon.0) 2183 : cluster [DBG] osdmap e611: 8 total, 8 up, 8 in 2024-02-19T22:00:09.996 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:08.883707+0000 osd.2 (osd.2) 125 : cluster [DBG] 5.d scrub starts 2024-02-19T22:00:09.996 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:08.885425+0000 osd.2 (osd.2) 126 : cluster [DBG] 5.d scrub ok 2024-02-19T22:00:09.996 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:09.003981+0000 osd.3 (osd.3) 343 : cluster [DBG] 6.c scrub starts 2024-02-19T22:00:09.996 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:09.005177+0000 osd.3 (osd.3) 344 : cluster [DBG] 6.c scrub ok 2024-02-19T22:00:09.996 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T22:00:09.646636+0000 mon.a (mon.0) 2184 : audit [DBG] from='client.? 172.21.15.80:0/2795597609' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-19T22:00:09.996 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:08.366091+0000 osd.3 (osd.3) 341 : cluster [DBG] purged_snaps scrub starts 2024-02-19T22:00:09.996 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:08.366181+0000 osd.3 (osd.3) 342 : cluster [DBG] purged_snaps scrub ok 2024-02-19T22:00:09.997 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:08.692472+0000 mon.a (mon.0) 2183 : cluster [DBG] osdmap e611: 8 total, 8 up, 8 in 2024-02-19T22:00:09.997 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:08.883707+0000 osd.2 (osd.2) 125 : cluster [DBG] 5.d scrub starts 2024-02-19T22:00:09.997 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:08.885425+0000 osd.2 (osd.2) 126 : cluster [DBG] 5.d scrub ok 2024-02-19T22:00:09.997 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:09.003981+0000 osd.3 (osd.3) 343 : cluster [DBG] 6.c scrub starts 2024-02-19T22:00:09.997 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:09.005177+0000 osd.3 (osd.3) 344 : cluster [DBG] 6.c scrub ok 2024-02-19T22:00:09.997 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:09 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T22:00:09.646636+0000 mon.a (mon.0) 2184 : audit [DBG] from='client.? 172.21.15.80:0/2795597609' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-19T22:00:10.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:08.366091+0000 osd.3 (osd.3) 341 : cluster [DBG] purged_snaps scrub starts 2024-02-19T22:00:10.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:08.366181+0000 osd.3 (osd.3) 342 : cluster [DBG] purged_snaps scrub ok 2024-02-19T22:00:10.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:08.692472+0000 mon.a (mon.0) 2183 : cluster [DBG] osdmap e611: 8 total, 8 up, 8 in 2024-02-19T22:00:10.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:08.883707+0000 osd.2 (osd.2) 125 : cluster [DBG] 5.d scrub starts 2024-02-19T22:00:10.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:08.885425+0000 osd.2 (osd.2) 126 : cluster [DBG] 5.d scrub ok 2024-02-19T22:00:10.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:09.003981+0000 osd.3 (osd.3) 343 : cluster [DBG] 6.c scrub starts 2024-02-19T22:00:10.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:09.005177+0000 osd.3 (osd.3) 344 : cluster [DBG] 6.c scrub ok 2024-02-19T22:00:10.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T22:00:09.646636+0000 mon.a (mon.0) 2184 : audit [DBG] from='client.? 172.21.15.80:0/2795597609' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-19T22:00:10.270 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201612 got 236223201616 for osd.7 2024-02-19T22:00:10.270 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2024-02-19T22:00:10.270 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T22:00:10.544 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T22:00:11.027 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:09.025325+0000 osd.6 (osd.6) 353 : cluster [DBG] 4.a scrub starts 2024-02-19T22:00:11.027 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:09.028883+0000 osd.6 (osd.6) 354 : cluster [DBG] 4.a scrub ok 2024-02-19T22:00:11.027 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:09.357498+0000 osd.4 (osd.4) 343 : cluster [DBG] 4.c scrub starts 2024-02-19T22:00:11.027 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:09.361029+0000 osd.4 (osd.4) 344 : cluster [DBG] 4.c scrub ok 2024-02-19T22:00:11.027 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:09.372271+0000 mgr.y (mgr.14514) 1046 : cluster [DBG] pgmap v1362: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T22:00:11.027 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:10.532978+0000 mon.a (mon.0) 2185 : cluster [DBG] osdmap e612: 8 total, 8 up, 8 in 2024-02-19T22:00:11.027 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 22:00:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:22:00:10] "GET /metrics HTTP/1.1" 200 174243 "" "Prometheus/2.33.4" 2024-02-19T22:00:11.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:09.025325+0000 osd.6 (osd.6) 353 : cluster [DBG] 4.a scrub starts 2024-02-19T22:00:11.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:09.028883+0000 osd.6 (osd.6) 354 : cluster [DBG] 4.a scrub ok 2024-02-19T22:00:11.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:09.357498+0000 osd.4 (osd.4) 343 : cluster [DBG] 4.c scrub starts 2024-02-19T22:00:11.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:09.361029+0000 osd.4 (osd.4) 344 : cluster [DBG] 4.c scrub ok 2024-02-19T22:00:11.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:09.372271+0000 mgr.y (mgr.14514) 1046 : cluster [DBG] pgmap v1362: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T22:00:11.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:10 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:10.532978+0000 mon.a (mon.0) 2185 : cluster [DBG] osdmap e612: 8 total, 8 up, 8 in 2024-02-19T22:00:11.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:09.025325+0000 osd.6 (osd.6) 353 : cluster [DBG] 4.a scrub starts 2024-02-19T22:00:11.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:09.028883+0000 osd.6 (osd.6) 354 : cluster [DBG] 4.a scrub ok 2024-02-19T22:00:11.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:09.357498+0000 osd.4 (osd.4) 343 : cluster [DBG] 4.c scrub starts 2024-02-19T22:00:11.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:09.361029+0000 osd.4 (osd.4) 344 : cluster [DBG] 4.c scrub ok 2024-02-19T22:00:11.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:09.372271+0000 mgr.y (mgr.14514) 1046 : cluster [DBG] pgmap v1362: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-19T22:00:11.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:10.532978+0000 mon.a (mon.0) 2185 : cluster [DBG] osdmap e612: 8 total, 8 up, 8 in 2024-02-19T22:00:12.055 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 22:00:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T22:00:12.451 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T22:00:12.453 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T22:00:12.826 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:11.360198+0000 osd.4 (osd.4) 345 : cluster [DBG] 6.e scrub starts 2024-02-19T22:00:12.826 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:11.372577+0000 mgr.y (mgr.14514) 1047 : cluster [DBG] pgmap v1364: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T22:00:12.826 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:11.414594+0000 osd.4 (osd.4) 346 : cluster [DBG] 6.e scrub ok 2024-02-19T22:00:12.826 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T22:00:11.579139+0000 mgr.y (mgr.14514) 1048 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T22:00:12.826 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:11.860232+0000 osd.2 (osd.2) 127 : cluster [DBG] 6.14 scrub starts 2024-02-19T22:00:12.826 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:11.861084+0000 osd.2 (osd.2) 128 : cluster [DBG] 6.14 scrub ok 2024-02-19T22:00:12.826 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:12.073089+0000 osd.3 (osd.3) 345 : cluster [DBG] 6.1f scrub starts 2024-02-19T22:00:12.826 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:12.192622+0000 osd.3 (osd.3) 346 : cluster [DBG] 6.1f scrub ok 2024-02-19T22:00:12.827 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:12.356384+0000 osd.5 (osd.5) 404 : cluster [DBG] 2.2 scrub starts 2024-02-19T22:00:12.827 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:12.357204+0000 osd.5 (osd.5) 405 : cluster [DBG] 2.2 scrub ok 2024-02-19T22:00:12.827 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:11.360198+0000 osd.4 (osd.4) 345 : cluster [DBG] 6.e scrub starts 2024-02-19T22:00:12.827 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:11.372577+0000 mgr.y (mgr.14514) 1047 : cluster [DBG] pgmap v1364: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T22:00:12.827 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:11.414594+0000 osd.4 (osd.4) 346 : cluster [DBG] 6.e scrub ok 2024-02-19T22:00:12.827 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T22:00:11.579139+0000 mgr.y (mgr.14514) 1048 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T22:00:12.827 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:11.860232+0000 osd.2 (osd.2) 127 : cluster [DBG] 6.14 scrub starts 2024-02-19T22:00:12.827 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:11.861084+0000 osd.2 (osd.2) 128 : cluster [DBG] 6.14 scrub ok 2024-02-19T22:00:12.827 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:12.073089+0000 osd.3 (osd.3) 345 : cluster [DBG] 6.1f scrub starts 2024-02-19T22:00:12.827 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:12.192622+0000 osd.3 (osd.3) 346 : cluster [DBG] 6.1f scrub ok 2024-02-19T22:00:12.827 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:12.356384+0000 osd.5 (osd.5) 404 : cluster [DBG] 2.2 scrub starts 2024-02-19T22:00:12.827 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:12 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:12.357204+0000 osd.5 (osd.5) 405 : cluster [DBG] 2.2 scrub ok 2024-02-19T22:00:13.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:11.360198+0000 osd.4 (osd.4) 345 : cluster [DBG] 6.e scrub starts 2024-02-19T22:00:13.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:11.372577+0000 mgr.y (mgr.14514) 1047 : cluster [DBG] pgmap v1364: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T22:00:13.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:11.414594+0000 osd.4 (osd.4) 346 : cluster [DBG] 6.e scrub ok 2024-02-19T22:00:13.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T22:00:11.579139+0000 mgr.y (mgr.14514) 1048 : audit [DBG] from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-19T22:00:13.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:11.860232+0000 osd.2 (osd.2) 127 : cluster [DBG] 6.14 scrub starts 2024-02-19T22:00:13.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:11.861084+0000 osd.2 (osd.2) 128 : cluster [DBG] 6.14 scrub ok 2024-02-19T22:00:13.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:12.073089+0000 osd.3 (osd.3) 345 : cluster [DBG] 6.1f scrub starts 2024-02-19T22:00:13.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:12.192622+0000 osd.3 (osd.3) 346 : cluster [DBG] 6.1f scrub ok 2024-02-19T22:00:13.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:12.356384+0000 osd.5 (osd.5) 404 : cluster [DBG] 2.2 scrub starts 2024-02-19T22:00:13.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:12.357204+0000 osd.5 (osd.5) 405 : cluster [DBG] 2.2 scrub ok 2024-02-19T22:00:13.228 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":1364,"stamp":"2024-02-19T22:00:11.372413+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5796,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":3188,"num_read_kb":2940,"num_write":997,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":382,"num_bytes_recovered":9153,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1169,"ondisk_log_size":1169,"up":366,"acting":366,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":366,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":5487156,"kb_used_data":44020,"kb_used_omap":1,"kb_used_meta":5443070,"kb_avail":744474060,"statfs":{"total":767960285184,"available":762341437440,"internally_reserved":0,"allocated":45076480,"data_stored":29376914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1944,"internal_metadata":5573703784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002089"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":50,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:02.036163+0000","last_change":"2024-02-19T22:00:02.036131+0000","last_active":"2024-02-19T22:00:02.036163+0000","last_peered":"2024-02-19T22:00:02.036163+0000","last_clean":"2024-02-19T22:00:02.036163+0000","last_became_active":"2024-02-19T21:58:25.591460+0000","last_became_peered":"2024-02-19T21:58:25.591460+0000","last_unstale":"2024-02-19T22:00:02.036163+0000","last_undegraded":"2024-02-19T22:00:02.036163+0000","last_fullsized":"2024-02-19T22:00:02.036163+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T22:00:02.036033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T22:00:02.036033+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":582,"reported_epoch":609,"state":"active+clean","last_fresh":"2024-02-19T21:59:46.873565+0000","last_change":"2024-02-19T21:59:14.629596+0000","last_active":"2024-02-19T21:59:46.873565+0000","last_peered":"2024-02-19T21:59:46.873565+0000","last_clean":"2024-02-19T21:59:46.873565+0000","last_became_active":"2024-02-19T21:57:58.567529+0000","last_became_peered":"2024-02-19T21:57:58.567529+0000","last_unstale":"2024-02-19T21:59:46.873565+0000","last_undegraded":"2024-02-19T21:59:46.873565+0000","last_fullsized":"2024-02-19T21:59:46.873565+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:14.629489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:59:14.629489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"471'39","reported_seq":61,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.526911+0000","last_change":"2024-02-19T21:59:32.852338+0000","last_active":"2024-02-19T21:59:50.526911+0000","last_peered":"2024-02-19T21:59:50.526911+0000","last_clean":"2024-02-19T21:59:50.526911+0000","last_became_active":"2024-02-19T21:58:25.593642+0000","last_became_peered":"2024-02-19T21:58:25.593642+0000","last_unstale":"2024-02-19T21:59:50.526911+0000","last_undegraded":"2024-02-19T21:59:50.526911+0000","last_fullsized":"2024-02-19T21:59:50.526911+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":581,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'39","last_scrub_stamp":"2024-02-19T21:59:32.852266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:59:32.852266+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":60,"num_read_kb":51,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":578,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.525475+0000","last_change":"2024-02-19T21:59:34.530960+0000","last_active":"2024-02-19T21:59:50.525475+0000","last_peered":"2024-02-19T21:59:50.525475+0000","last_clean":"2024-02-19T21:59:50.525475+0000","last_became_active":"2024-02-19T21:47:46.250178+0000","last_became_peered":"2024-02-19T21:47:46.250178+0000","last_unstale":"2024-02-19T21:59:50.525475+0000","last_undegraded":"2024-02-19T21:59:50.525475+0000","last_fullsized":"2024-02-19T21:59:50.525475+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:34.530863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:59:34.530863+0000","last_clean_scrub_stamp":"2024-02-19T21:59:34.530863+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":166,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.527489+0000","last_change":"2024-02-19T21:59:46.925343+0000","last_active":"2024-02-19T21:59:50.527489+0000","last_peered":"2024-02-19T21:59:50.527489+0000","last_clean":"2024-02-19T21:59:50.527489+0000","last_became_active":"2024-02-19T21:57:58.571888+0000","last_became_peered":"2024-02-19T21:57:58.571888+0000","last_unstale":"2024-02-19T21:59:50.527489+0000","last_undegraded":"2024-02-19T21:59:50.527489+0000","last_fullsized":"2024-02-19T21:59:50.527489+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:46.925283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:59:46.925283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"470'25","reported_seq":683,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:01.366458+0000","last_change":"2024-02-19T22:00:01.366423+0000","last_active":"2024-02-19T22:00:01.366458+0000","last_peered":"2024-02-19T22:00:01.366458+0000","last_clean":"2024-02-19T22:00:01.366458+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T22:00:01.366458+0000","last_undegraded":"2024-02-19T22:00:01.366458+0000","last_fullsized":"2024-02-19T22:00:01.366458+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'25","last_scrub_stamp":"2024-02-19T22:00:01.366342+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T22:00:01.366342+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":374,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.471327+0000","last_change":"2024-02-19T21:59:47.663137+0000","last_active":"2024-02-19T21:59:51.471327+0000","last_peered":"2024-02-19T21:59:51.471327+0000","last_clean":"2024-02-19T21:59:51.471327+0000","last_became_active":"2024-02-19T21:58:25.594482+0000","last_became_peered":"2024-02-19T21:58:25.594482+0000","last_unstale":"2024-02-19T21:59:51.471327+0000","last_undegraded":"2024-02-19T21:59:51.471327+0000","last_fullsized":"2024-02-19T21:59:51.471327+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:47.663036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:59:47.663036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":628,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.939797+0000","last_change":"2024-02-19T21:59:28.481069+0000","last_active":"2024-02-19T21:59:50.939797+0000","last_peered":"2024-02-19T21:59:50.939797+0000","last_clean":"2024-02-19T21:59:50.939797+0000","last_became_active":"2024-02-19T21:57:58.569220+0000","last_became_peered":"2024-02-19T21:57:58.569220+0000","last_unstale":"2024-02-19T21:59:50.939797+0000","last_undegraded":"2024-02-19T21:59:50.939797+0000","last_fullsized":"2024-02-19T21:59:50.939797+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:28.480989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_clean_scrub_stamp":"2024-02-19T21:59:28.480989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"470'11","reported_seq":656,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.525794+0000","last_change":"2024-02-19T21:59:37.407999+0000","last_active":"2024-02-19T21:59:50.525794+0000","last_peered":"2024-02-19T21:59:50.525794+0000","last_clean":"2024-02-19T21:59:50.525794+0000","last_became_active":"2024-02-19T21:53:45.385837+0000","last_became_peered":"2024-02-19T21:53:45.385837+0000","last_unstale":"2024-02-19T21:59:50.525794+0000","last_undegraded":"2024-02-19T21:59:50.525794+0000","last_fullsized":"2024-02-19T21:59:50.525794+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'11","last_scrub_stamp":"2024-02-19T21:59:37.407901+0000","last_deep_scrub":"310'9","last_deep_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_clean_scrub_stamp":"2024-02-19T21:59:37.407901+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"587'2","reported_seq":512,"reported_epoch":609,"state":"active+clean","last_fresh":"2024-02-19T21:59:46.874105+0000","last_change":"2024-02-19T21:58:39.634715+0000","last_active":"2024-02-19T21:59:46.874105+0000","last_peered":"2024-02-19T21:59:46.874105+0000","last_clean":"2024-02-19T21:59:46.874105+0000","last_became_active":"2024-02-19T21:57:58.572215+0000","last_became_peered":"2024-02-19T21:57:58.572215+0000","last_unstale":"2024-02-19T21:59:46.874105+0000","last_undegraded":"2024-02-19T21:59:46.874105+0000","last_fullsized":"2024-02-19T21:59:46.874105+0000","mapping_epoch":568,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":5,"last_scrub":"587'2","last_scrub_stamp":"2024-02-19T21:58:39.634650+0000","last_deep_scrub":"587'2","last_deep_scrub_stamp":"2024-02-19T21:58:39.634650+0000","last_clean_scrub_stamp":"2024-02-19T21:58:39.634650+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":640,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:58.466857+0000","last_change":"2024-02-19T21:59:58.466817+0000","last_active":"2024-02-19T21:59:58.466857+0000","last_peered":"2024-02-19T21:59:58.466857+0000","last_clean":"2024-02-19T21:59:58.466857+0000","last_became_active":"2024-02-19T21:49:08.329998+0000","last_became_peered":"2024-02-19T21:49:08.329998+0000","last_unstale":"2024-02-19T21:59:58.466857+0000","last_undegraded":"2024-02-19T21:59:58.466857+0000","last_fullsized":"2024-02-19T21:59:58.466857+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:58.466718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:59:58.466718+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"470'25","reported_seq":527,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.525577+0000","last_change":"2024-02-19T21:59:22.435554+0000","last_active":"2024-02-19T21:59:50.525577+0000","last_peered":"2024-02-19T21:59:50.525577+0000","last_clean":"2024-02-19T21:59:50.525577+0000","last_became_active":"2024-02-19T21:57:58.567361+0000","last_became_peered":"2024-02-19T21:57:58.567361+0000","last_unstale":"2024-02-19T21:59:50.525577+0000","last_undegraded":"2024-02-19T21:59:50.525577+0000","last_fullsized":"2024-02-19T21:59:50.525577+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'25","last_scrub_stamp":"2024-02-19T21:59:22.435463+0000","last_deep_scrub":"470'25","last_deep_scrub_stamp":"2024-02-19T21:54:07.275895+0000","last_clean_scrub_stamp":"2024-02-19T21:59:22.435463+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":148,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.527677+0000","last_change":"2024-02-19T21:59:02.120212+0000","last_active":"2024-02-19T21:59:50.527677+0000","last_peered":"2024-02-19T21:59:50.527677+0000","last_clean":"2024-02-19T21:59:50.527677+0000","last_became_active":"2024-02-19T21:53:45.369808+0000","last_became_peered":"2024-02-19T21:53:45.369808+0000","last_unstale":"2024-02-19T21:59:50.527677+0000","last_undegraded":"2024-02-19T21:59:50.527677+0000","last_fullsized":"2024-02-19T21:59:50.527677+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:02.120070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:59:02.120070+0000","last_clean_scrub_stamp":"2024-02-19T21:59:02.120070+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":50,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:00.937568+0000","last_change":"2024-02-19T22:00:00.937530+0000","last_active":"2024-02-19T22:00:00.937568+0000","last_peered":"2024-02-19T22:00:00.937568+0000","last_clean":"2024-02-19T22:00:00.937568+0000","last_became_active":"2024-02-19T21:58:25.591374+0000","last_became_peered":"2024-02-19T21:58:25.591374+0000","last_unstale":"2024-02-19T22:00:00.937568+0000","last_undegraded":"2024-02-19T22:00:00.937568+0000","last_fullsized":"2024-02-19T22:00:00.937568+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T22:00:00.937433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T22:00:00.937433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"471'24","reported_seq":57,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.527175+0000","last_change":"2024-02-19T21:58:50.978948+0000","last_active":"2024-02-19T21:59:50.527175+0000","last_peered":"2024-02-19T21:59:50.527175+0000","last_clean":"2024-02-19T21:59:50.527175+0000","last_became_active":"2024-02-19T21:58:25.590719+0000","last_became_peered":"2024-02-19T21:58:25.590719+0000","last_unstale":"2024-02-19T21:59:50.527175+0000","last_undegraded":"2024-02-19T21:59:50.527175+0000","last_fullsized":"2024-02-19T21:59:50.527175+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'24","last_scrub_stamp":"2024-02-19T21:58:50.978880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:58:50.978880+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":33,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4],"acting":[3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":606,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.525981+0000","last_change":"2024-02-19T21:59:03.528550+0000","last_active":"2024-02-19T21:59:50.525981+0000","last_peered":"2024-02-19T21:59:50.525981+0000","last_clean":"2024-02-19T21:59:50.525981+0000","last_became_active":"2024-02-19T21:44:58.788307+0000","last_became_peered":"2024-02-19T21:44:58.788307+0000","last_unstale":"2024-02-19T21:59:50.525981+0000","last_undegraded":"2024-02-19T21:59:50.525981+0000","last_fullsized":"2024-02-19T21:59:50.525981+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:03.528453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:59:03.528453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":609,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.458060+0000","last_change":"2024-02-19T21:59:11.002738+0000","last_active":"2024-02-19T21:59:51.458060+0000","last_peered":"2024-02-19T21:59:51.458060+0000","last_clean":"2024-02-19T21:59:51.458060+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:59:51.458060+0000","last_undegraded":"2024-02-19T21:59:51.458060+0000","last_fullsized":"2024-02-19T21:59:51.458060+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:11.002637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:17.913620+0000","last_clean_scrub_stamp":"2024-02-19T21:59:11.002637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"470'46","reported_seq":332,"reported_epoch":609,"state":"active+clean","last_fresh":"2024-02-19T21:59:46.623426+0000","last_change":"2024-02-19T21:59:39.187599+0000","last_active":"2024-02-19T21:59:46.623426+0000","last_peered":"2024-02-19T21:59:46.623426+0000","last_clean":"2024-02-19T21:59:46.623426+0000","last_became_active":"2024-02-19T21:58:25.596602+0000","last_became_peered":"2024-02-19T21:58:25.596602+0000","last_unstale":"2024-02-19T21:59:46.623426+0000","last_undegraded":"2024-02-19T21:59:46.623426+0000","last_fullsized":"2024-02-19T21:59:46.623426+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'46","last_scrub_stamp":"2024-02-19T21:59:39.187531+0000","last_deep_scrub":"470'46","last_deep_scrub_stamp":"2024-02-19T21:58:02.683336+0000","last_clean_scrub_stamp":"2024-02-19T21:59:39.187531+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":631,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.839843+0000","last_change":"2024-02-19T21:59:25.912383+0000","last_active":"2024-02-19T21:59:50.839843+0000","last_peered":"2024-02-19T21:59:50.839843+0000","last_clean":"2024-02-19T21:59:50.839843+0000","last_became_active":"2024-02-19T21:44:58.790669+0000","last_became_peered":"2024-02-19T21:44:58.790669+0000","last_unstale":"2024-02-19T21:59:50.839843+0000","last_undegraded":"2024-02-19T21:59:50.839843+0000","last_fullsized":"2024-02-19T21:59:50.839843+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:25.912300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_clean_scrub_stamp":"2024-02-19T21:59:25.912300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":45,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.526753+0000","last_change":"2024-02-19T21:59:25.854301+0000","last_active":"2024-02-19T21:59:50.526753+0000","last_peered":"2024-02-19T21:59:50.526753+0000","last_clean":"2024-02-19T21:59:50.526753+0000","last_became_active":"2024-02-19T21:58:25.593161+0000","last_became_peered":"2024-02-19T21:58:25.593161+0000","last_unstale":"2024-02-19T21:59:50.526753+0000","last_undegraded":"2024-02-19T21:59:50.526753+0000","last_fullsized":"2024-02-19T21:59:50.526753+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:25.854230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:59:25.854230+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"471'27","reported_seq":473,"reported_epoch":609,"state":"active+clean","last_fresh":"2024-02-19T21:59:46.873408+0000","last_change":"2024-02-19T21:59:41.454237+0000","last_active":"2024-02-19T21:59:46.873408+0000","last_peered":"2024-02-19T21:59:46.873408+0000","last_clean":"2024-02-19T21:59:46.873408+0000","last_became_active":"2024-02-19T21:57:58.573690+0000","last_became_peered":"2024-02-19T21:57:58.573690+0000","last_unstale":"2024-02-19T21:59:46.873408+0000","last_undegraded":"2024-02-19T21:59:46.873408+0000","last_fullsized":"2024-02-19T21:59:46.873408+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'27","last_scrub_stamp":"2024-02-19T21:59:41.454154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:59:41.454154+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":486,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.939831+0000","last_change":"2024-02-19T21:59:29.474237+0000","last_active":"2024-02-19T21:59:50.939831+0000","last_peered":"2024-02-19T21:59:50.939831+0000","last_clean":"2024-02-19T21:59:50.939831+0000","last_became_active":"2024-02-19T21:51:22.461599+0000","last_became_peered":"2024-02-19T21:51:22.461599+0000","last_unstale":"2024-02-19T21:59:50.939831+0000","last_undegraded":"2024-02-19T21:59:50.939831+0000","last_fullsized":"2024-02-19T21:59:50.939831+0000","mapping_epoch":445,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":446,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:59:29.474144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:59:29.474144+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":624,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.471279+0000","last_change":"2024-02-19T21:59:44.572800+0000","last_active":"2024-02-19T21:59:51.471279+0000","last_peered":"2024-02-19T21:59:51.471279+0000","last_clean":"2024-02-19T21:59:51.471279+0000","last_became_active":"2024-02-19T21:49:54.491488+0000","last_became_peered":"2024-02-19T21:49:54.491488+0000","last_unstale":"2024-02-19T21:59:51.471279+0000","last_undegraded":"2024-02-19T21:59:51.471279+0000","last_fullsized":"2024-02-19T21:59:51.471279+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:44.572671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:59:44.572671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"578'35","reported_seq":699,"reported_epoch":609,"state":"active+clean","last_fresh":"2024-02-19T21:59:46.873459+0000","last_change":"2024-02-19T21:58:25.624334+0000","last_active":"2024-02-19T21:59:46.873459+0000","last_peered":"2024-02-19T21:59:46.873459+0000","last_clean":"2024-02-19T21:59:46.873459+0000","last_became_active":"2024-02-19T21:58:25.599420+0000","last_became_peered":"2024-02-19T21:58:25.599420+0000","last_unstale":"2024-02-19T21:59:46.873459+0000","last_undegraded":"2024-02-19T21:59:46.873459+0000","last_fullsized":"2024-02-19T21:59:46.873459+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"578'35","last_scrub_stamp":"2024-02-19T21:58:23.585847+0000","last_deep_scrub":"578'35","last_deep_scrub_stamp":"2024-02-19T21:58:23.585847+0000","last_clean_scrub_stamp":"2024-02-19T21:58:23.585847+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":45,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.527054+0000","last_change":"2024-02-19T21:59:39.962179+0000","last_active":"2024-02-19T21:59:50.527054+0000","last_peered":"2024-02-19T21:59:50.527054+0000","last_clean":"2024-02-19T21:59:50.527054+0000","last_became_active":"2024-02-19T21:58:25.592090+0000","last_became_peered":"2024-02-19T21:58:25.592090+0000","last_unstale":"2024-02-19T21:59:50.527054+0000","last_undegraded":"2024-02-19T21:59:50.527054+0000","last_fullsized":"2024-02-19T21:59:50.527054+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:39.962081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:59:39.962081+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":602,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.939599+0000","last_change":"2024-02-19T21:59:04.501403+0000","last_active":"2024-02-19T21:59:50.939599+0000","last_peered":"2024-02-19T21:59:50.939599+0000","last_clean":"2024-02-19T21:59:50.939599+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T21:59:50.939599+0000","last_undegraded":"2024-02-19T21:59:50.939599+0000","last_fullsized":"2024-02-19T21:59:50.939599+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:04.501326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T21:59:04.501326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":640,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.458433+0000","last_change":"2024-02-19T21:59:35.961105+0000","last_active":"2024-02-19T21:59:51.458433+0000","last_peered":"2024-02-19T21:59:51.458433+0000","last_clean":"2024-02-19T21:59:51.458433+0000","last_became_active":"2024-02-19T21:49:08.330293+0000","last_became_peered":"2024-02-19T21:49:08.330293+0000","last_unstale":"2024-02-19T21:59:51.458433+0000","last_undegraded":"2024-02-19T21:59:51.458433+0000","last_fullsized":"2024-02-19T21:59:51.458433+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:35.960989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:59:35.960989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"471'32","reported_seq":160,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.527133+0000","last_change":"2024-02-19T21:59:05.998938+0000","last_active":"2024-02-19T21:59:50.527133+0000","last_peered":"2024-02-19T21:59:50.527133+0000","last_clean":"2024-02-19T21:59:50.527133+0000","last_became_active":"2024-02-19T21:53:45.367870+0000","last_became_peered":"2024-02-19T21:53:45.367870+0000","last_unstale":"2024-02-19T21:59:50.527133+0000","last_undegraded":"2024-02-19T21:59:50.527133+0000","last_fullsized":"2024-02-19T21:59:50.527133+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'32","last_scrub_stamp":"2024-02-19T21:59:05.998857+0000","last_deep_scrub":"381'24","last_deep_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_clean_scrub_stamp":"2024-02-19T21:59:05.998857+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":113,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.471343+0000","last_change":"2024-02-19T21:59:41.540876+0000","last_active":"2024-02-19T21:59:51.471343+0000","last_peered":"2024-02-19T21:59:51.471343+0000","last_clean":"2024-02-19T21:59:51.471343+0000","last_became_active":"2024-02-19T21:55:24.057099+0000","last_became_peered":"2024-02-19T21:55:24.057099+0000","last_unstale":"2024-02-19T21:59:51.471343+0000","last_undegraded":"2024-02-19T21:59:51.471343+0000","last_fullsized":"2024-02-19T21:59:51.471343+0000","mapping_epoch":521,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":522,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:41.540795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:59:41.540795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":655,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.457814+0000","last_change":"2024-02-19T21:58:54.958664+0000","last_active":"2024-02-19T21:59:51.457814+0000","last_peered":"2024-02-19T21:59:51.457814+0000","last_clean":"2024-02-19T21:59:51.457814+0000","last_became_active":"2024-02-19T21:49:54.494146+0000","last_became_peered":"2024-02-19T21:49:54.494146+0000","last_unstale":"2024-02-19T21:59:51.457814+0000","last_undegraded":"2024-02-19T21:59:51.457814+0000","last_fullsized":"2024-02-19T21:59:51.457814+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:58:54.958575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:57:51.071020+0000","last_clean_scrub_stamp":"2024-02-19T21:58:54.958575+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":629,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.472066+0000","last_change":"2024-02-19T21:59:08.404563+0000","last_active":"2024-02-19T21:59:51.472066+0000","last_peered":"2024-02-19T21:59:51.472066+0000","last_clean":"2024-02-19T21:59:51.472066+0000","last_became_active":"2024-02-19T21:49:08.331308+0000","last_became_peered":"2024-02-19T21:49:08.331308+0000","last_unstale":"2024-02-19T21:59:51.472066+0000","last_undegraded":"2024-02-19T21:59:51.472066+0000","last_fullsized":"2024-02-19T21:59:51.472066+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:08.404489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:59:08.404489+0000","last_clean_scrub_stamp":"2024-02-19T21:59:08.404489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"470'12","reported_seq":157,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.526804+0000","last_change":"2024-02-19T21:59:41.912698+0000","last_active":"2024-02-19T21:59:50.526804+0000","last_peered":"2024-02-19T21:59:50.526804+0000","last_clean":"2024-02-19T21:59:50.526804+0000","last_became_active":"2024-02-19T21:53:45.368256+0000","last_became_peered":"2024-02-19T21:53:45.368256+0000","last_unstale":"2024-02-19T21:59:50.526804+0000","last_undegraded":"2024-02-19T21:59:50.526804+0000","last_fullsized":"2024-02-19T21:59:50.526804+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'12","last_scrub_stamp":"2024-02-19T21:59:41.912629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:59:41.912629+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":50,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.526864+0000","last_change":"2024-02-19T21:59:43.894606+0000","last_active":"2024-02-19T21:59:50.526864+0000","last_peered":"2024-02-19T21:59:50.526864+0000","last_clean":"2024-02-19T21:59:50.526864+0000","last_became_active":"2024-02-19T21:58:25.592744+0000","last_became_peered":"2024-02-19T21:58:25.592744+0000","last_unstale":"2024-02-19T21:59:50.526864+0000","last_undegraded":"2024-02-19T21:59:50.526864+0000","last_fullsized":"2024-02-19T21:59:50.526864+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:43.894518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:59:43.894518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":628,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.839857+0000","last_change":"2024-02-19T21:59:03.420212+0000","last_active":"2024-02-19T21:59:50.839857+0000","last_peered":"2024-02-19T21:59:50.839857+0000","last_clean":"2024-02-19T21:59:50.839857+0000","last_became_active":"2024-02-19T21:58:25.592554+0000","last_became_peered":"2024-02-19T21:58:25.592554+0000","last_unstale":"2024-02-19T21:59:50.839857+0000","last_undegraded":"2024-02-19T21:59:50.839857+0000","last_fullsized":"2024-02-19T21:59:50.839857+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:03.420105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:59:03.420105+0000","last_clean_scrub_stamp":"2024-02-19T21:59:03.420105+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":613,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.839996+0000","last_change":"2024-02-19T21:59:24.717263+0000","last_active":"2024-02-19T21:59:50.839996+0000","last_peered":"2024-02-19T21:59:50.839996+0000","last_clean":"2024-02-19T21:59:50.839996+0000","last_became_active":"2024-02-19T21:57:58.571134+0000","last_became_peered":"2024-02-19T21:57:58.571134+0000","last_unstale":"2024-02-19T21:59:50.839996+0000","last_undegraded":"2024-02-19T21:59:50.839996+0000","last_fullsized":"2024-02-19T21:59:50.839996+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:24.717198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:59:24.717198+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"470'27","reported_seq":666,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:05.479059+0000","last_change":"2024-02-19T22:00:05.479007+0000","last_active":"2024-02-19T22:00:05.479059+0000","last_peered":"2024-02-19T22:00:05.479059+0000","last_clean":"2024-02-19T22:00:05.479059+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T22:00:05.479059+0000","last_undegraded":"2024-02-19T22:00:05.479059+0000","last_fullsized":"2024-02-19T22:00:05.479059+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'27","last_scrub_stamp":"2024-02-19T22:00:05.478915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T22:00:05.478915+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":591,"reported_epoch":609,"state":"active+clean","last_fresh":"2024-02-19T21:59:46.872943+0000","last_change":"2024-02-19T21:59:04.581362+0000","last_active":"2024-02-19T21:59:46.872943+0000","last_peered":"2024-02-19T21:59:46.872943+0000","last_clean":"2024-02-19T21:59:46.872943+0000","last_became_active":"2024-02-19T21:57:58.571928+0000","last_became_peered":"2024-02-19T21:57:58.571928+0000","last_unstale":"2024-02-19T21:59:46.872943+0000","last_undegraded":"2024-02-19T21:59:46.872943+0000","last_fullsized":"2024-02-19T21:59:46.872943+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:04.581293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:17.964139+0000","last_clean_scrub_stamp":"2024-02-19T21:59:04.581293+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":151,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.527340+0000","last_change":"2024-02-19T21:59:33.835400+0000","last_active":"2024-02-19T21:59:50.527340+0000","last_peered":"2024-02-19T21:59:50.527340+0000","last_clean":"2024-02-19T21:59:50.527340+0000","last_became_active":"2024-02-19T21:53:45.369330+0000","last_became_peered":"2024-02-19T21:53:45.369330+0000","last_unstale":"2024-02-19T21:59:50.527340+0000","last_undegraded":"2024-02-19T21:59:50.527340+0000","last_fullsized":"2024-02-19T21:59:50.527340+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:33.835279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:59:33.835279+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":625,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.458261+0000","last_change":"2024-02-19T21:59:26.136797+0000","last_active":"2024-02-19T21:59:51.458261+0000","last_peered":"2024-02-19T21:59:51.458261+0000","last_clean":"2024-02-19T21:59:51.458261+0000","last_became_active":"2024-02-19T21:53:45.384501+0000","last_became_peered":"2024-02-19T21:53:45.384501+0000","last_unstale":"2024-02-19T21:59:51.458261+0000","last_undegraded":"2024-02-19T21:59:51.458261+0000","last_fullsized":"2024-02-19T21:59:51.458261+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:26.136716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:59:26.136716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"470'21","reported_seq":685,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.839705+0000","last_change":"2024-02-19T21:59:10.392973+0000","last_active":"2024-02-19T21:59:50.839705+0000","last_peered":"2024-02-19T21:59:50.839705+0000","last_clean":"2024-02-19T21:59:50.839705+0000","last_became_active":"2024-02-19T21:49:08.333872+0000","last_became_peered":"2024-02-19T21:49:08.333872+0000","last_unstale":"2024-02-19T21:59:50.839705+0000","last_undegraded":"2024-02-19T21:59:50.839705+0000","last_fullsized":"2024-02-19T21:59:50.839705+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'21","last_scrub_stamp":"2024-02-19T21:59:10.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:59:10.392904+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":588,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.526110+0000","last_change":"2024-02-19T21:59:28.649311+0000","last_active":"2024-02-19T21:59:50.526110+0000","last_peered":"2024-02-19T21:59:50.526110+0000","last_clean":"2024-02-19T21:59:50.526110+0000","last_became_active":"2024-02-19T21:49:08.329770+0000","last_became_peered":"2024-02-19T21:49:08.329770+0000","last_unstale":"2024-02-19T21:59:50.526110+0000","last_undegraded":"2024-02-19T21:59:50.526110+0000","last_fullsized":"2024-02-19T21:59:50.526110+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:28.649218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:59:28.649218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"581'18","reported_seq":70,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:07.194737+0000","last_change":"2024-02-19T21:59:28.863416+0000","last_active":"2024-02-19T22:00:07.194737+0000","last_peered":"2024-02-19T22:00:07.194737+0000","last_clean":"2024-02-19T22:00:07.194737+0000","last_became_active":"2024-02-19T21:58:25.594528+0000","last_became_peered":"2024-02-19T21:58:25.594528+0000","last_unstale":"2024-02-19T22:00:07.194737+0000","last_undegraded":"2024-02-19T22:00:07.194737+0000","last_fullsized":"2024-02-19T22:00:07.194737+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"581'18","last_scrub_stamp":"2024-02-19T21:59:28.863354+0000","last_deep_scrub":"581'18","last_deep_scrub_stamp":"2024-02-19T21:59:28.863354+0000","last_clean_scrub_stamp":"2024-02-19T21:59:28.863354+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":621,"reported_epoch":609,"state":"active+clean","last_fresh":"2024-02-19T21:59:46.874115+0000","last_change":"2024-02-19T21:58:44.544756+0000","last_active":"2024-02-19T21:59:46.874115+0000","last_peered":"2024-02-19T21:59:46.874115+0000","last_clean":"2024-02-19T21:59:46.874115+0000","last_became_active":"2024-02-19T21:57:58.571538+0000","last_became_peered":"2024-02-19T21:57:58.571538+0000","last_unstale":"2024-02-19T21:59:46.874115+0000","last_undegraded":"2024-02-19T21:59:46.874115+0000","last_fullsized":"2024-02-19T21:59:46.874115+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:58:44.544692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_clean_scrub_stamp":"2024-02-19T21:58:44.544692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"470'25","reported_seq":680,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:02.389945+0000","last_change":"2024-02-19T22:00:02.389911+0000","last_active":"2024-02-19T22:00:02.389945+0000","last_peered":"2024-02-19T22:00:02.389945+0000","last_clean":"2024-02-19T22:00:02.389945+0000","last_became_active":"2024-02-19T21:53:45.384976+0000","last_became_peered":"2024-02-19T21:53:45.384976+0000","last_unstale":"2024-02-19T22:00:02.389945+0000","last_undegraded":"2024-02-19T22:00:02.389945+0000","last_fullsized":"2024-02-19T22:00:02.389945+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'25","last_scrub_stamp":"2024-02-19T22:00:02.389835+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T22:00:02.389835+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":339,"reported_epoch":609,"state":"active+clean","last_fresh":"2024-02-19T21:59:46.873340+0000","last_change":"2024-02-19T21:59:25.675817+0000","last_active":"2024-02-19T21:59:46.873340+0000","last_peered":"2024-02-19T21:59:46.873340+0000","last_clean":"2024-02-19T21:59:46.873340+0000","last_became_active":"2024-02-19T21:58:25.598914+0000","last_became_peered":"2024-02-19T21:58:25.598914+0000","last_unstale":"2024-02-19T21:59:46.873340+0000","last_undegraded":"2024-02-19T21:59:46.873340+0000","last_fullsized":"2024-02-19T21:59:46.873340+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:25.675752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:59:25.675752+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"571'11","reported_seq":956,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:07.194602+0000","last_change":"2024-02-19T21:59:18.433698+0000","last_active":"2024-02-19T22:00:07.194602+0000","last_peered":"2024-02-19T22:00:07.194602+0000","last_clean":"2024-02-19T22:00:07.194602+0000","last_became_active":"2024-02-19T21:57:58.569413+0000","last_became_peered":"2024-02-19T21:57:58.569413+0000","last_unstale":"2024-02-19T22:00:07.194602+0000","last_undegraded":"2024-02-19T22:00:07.194602+0000","last_fullsized":"2024-02-19T22:00:07.194602+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"571'11","last_scrub_stamp":"2024-02-19T21:59:18.433582+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:59:18.433582+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":639,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.471532+0000","last_change":"2024-02-19T21:59:20.493884+0000","last_active":"2024-02-19T21:59:51.471532+0000","last_peered":"2024-02-19T21:59:51.471532+0000","last_clean":"2024-02-19T21:59:51.471532+0000","last_became_active":"2024-02-19T21:53:45.384012+0000","last_became_peered":"2024-02-19T21:53:45.384012+0000","last_unstale":"2024-02-19T21:59:51.471532+0000","last_undegraded":"2024-02-19T21:59:51.471532+0000","last_fullsized":"2024-02-19T21:59:51.471532+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:20.493799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:55:12.286582+0000","last_clean_scrub_stamp":"2024-02-19T21:59:20.493799+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"470'35","reported_seq":158,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.527581+0000","last_change":"2024-02-19T21:58:54.976976+0000","last_active":"2024-02-19T21:59:50.527581+0000","last_peered":"2024-02-19T21:59:50.527581+0000","last_clean":"2024-02-19T21:59:50.527581+0000","last_became_active":"2024-02-19T21:53:45.367708+0000","last_became_peered":"2024-02-19T21:53:45.367708+0000","last_unstale":"2024-02-19T21:59:50.527581+0000","last_undegraded":"2024-02-19T21:59:50.527581+0000","last_fullsized":"2024-02-19T21:59:50.527581+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'35","last_scrub_stamp":"2024-02-19T21:58:54.976909+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:58:54.976909+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":600,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.939795+0000","last_change":"2024-02-19T21:58:59.594173+0000","last_active":"2024-02-19T21:59:50.939795+0000","last_peered":"2024-02-19T21:59:50.939795+0000","last_clean":"2024-02-19T21:59:50.939795+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T21:59:50.939795+0000","last_undegraded":"2024-02-19T21:59:50.939795+0000","last_fullsized":"2024-02-19T21:59:50.939795+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:58:59.594081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:11.667872+0000","last_clean_scrub_stamp":"2024-02-19T21:58:59.594081+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":611,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.457818+0000","last_change":"2024-02-19T21:59:35.005506+0000","last_active":"2024-02-19T21:59:51.457818+0000","last_peered":"2024-02-19T21:59:51.457818+0000","last_clean":"2024-02-19T21:59:51.457818+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:59:51.457818+0000","last_undegraded":"2024-02-19T21:59:51.457818+0000","last_fullsized":"2024-02-19T21:59:51.457818+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:35.005433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:59:35.005433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"470'18","reported_seq":53,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.527482+0000","last_change":"2024-02-19T21:59:04.046943+0000","last_active":"2024-02-19T21:59:50.527482+0000","last_peered":"2024-02-19T21:59:50.527482+0000","last_clean":"2024-02-19T21:59:50.527482+0000","last_became_active":"2024-02-19T21:58:25.591403+0000","last_became_peered":"2024-02-19T21:58:25.591403+0000","last_unstale":"2024-02-19T21:59:50.527482+0000","last_undegraded":"2024-02-19T21:59:50.527482+0000","last_fullsized":"2024-02-19T21:59:50.527482+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'18","last_scrub_stamp":"2024-02-19T21:59:04.046874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:59:04.046874+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":22,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":257,"reported_epoch":609,"state":"active+clean","last_fresh":"2024-02-19T21:59:46.623499+0000","last_change":"2024-02-19T21:59:09.824863+0000","last_active":"2024-02-19T21:59:46.623499+0000","last_peered":"2024-02-19T21:59:46.623499+0000","last_clean":"2024-02-19T21:59:46.623499+0000","last_became_active":"2024-02-19T21:49:08.332176+0000","last_became_peered":"2024-02-19T21:49:08.332176+0000","last_unstale":"2024-02-19T21:59:46.623499+0000","last_undegraded":"2024-02-19T21:59:46.623499+0000","last_fullsized":"2024-02-19T21:59:46.623499+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:09.824805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:18.393513+0000","last_clean_scrub_stamp":"2024-02-19T21:59:09.824805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":283,"reported_epoch":609,"state":"active+clean","last_fresh":"2024-02-19T21:59:46.622738+0000","last_change":"2024-02-19T21:59:42.124548+0000","last_active":"2024-02-19T21:59:46.622738+0000","last_peered":"2024-02-19T21:59:46.622738+0000","last_clean":"2024-02-19T21:59:46.622738+0000","last_became_active":"2024-02-19T21:57:58.573260+0000","last_became_peered":"2024-02-19T21:57:58.573260+0000","last_unstale":"2024-02-19T21:59:46.622738+0000","last_undegraded":"2024-02-19T21:59:46.622738+0000","last_fullsized":"2024-02-19T21:59:46.622738+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:42.124462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:59:42.124462+0000","last_clean_scrub_stamp":"2024-02-19T21:59:42.124462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"610'25","reported_seq":771,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:02.216840+0000","last_change":"2024-02-19T22:00:02.216840+0000","last_active":"2024-02-19T22:00:02.216840+0000","last_peered":"2024-02-19T22:00:02.216840+0000","last_clean":"2024-02-19T22:00:02.216840+0000","last_became_active":"2024-02-19T21:58:25.599955+0000","last_became_peered":"2024-02-19T21:58:25.599955+0000","last_unstale":"2024-02-19T22:00:02.216840+0000","last_undegraded":"2024-02-19T22:00:02.216840+0000","last_fullsized":"2024-02-19T22:00:02.216840+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"610'25","last_scrub_stamp":"2024-02-19T22:00:02.216775+0000","last_deep_scrub":"610'25","last_deep_scrub_stamp":"2024-02-19T22:00:02.216775+0000","last_clean_scrub_stamp":"2024-02-19T22:00:02.216775+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":146,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.527417+0000","last_change":"2024-02-19T21:59:12.077470+0000","last_active":"2024-02-19T21:59:50.527417+0000","last_peered":"2024-02-19T21:59:50.527417+0000","last_clean":"2024-02-19T21:59:50.527417+0000","last_became_active":"2024-02-19T21:53:45.368696+0000","last_became_peered":"2024-02-19T21:53:45.368696+0000","last_unstale":"2024-02-19T21:59:50.527417+0000","last_undegraded":"2024-02-19T21:59:50.527417+0000","last_fullsized":"2024-02-19T21:59:50.527417+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:12.077382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:59:12.077382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"378'4","reported_seq":654,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.526265+0000","last_change":"2024-02-19T21:59:18.440350+0000","last_active":"2024-02-19T21:59:50.526265+0000","last_peered":"2024-02-19T21:59:50.526265+0000","last_clean":"2024-02-19T21:59:50.526265+0000","last_became_active":"2024-02-19T21:57:58.568734+0000","last_became_peered":"2024-02-19T21:57:58.568734+0000","last_unstale":"2024-02-19T21:59:50.526265+0000","last_undegraded":"2024-02-19T21:59:50.526265+0000","last_fullsized":"2024-02-19T21:59:50.526265+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"378'4","last_scrub_stamp":"2024-02-19T21:59:18.440255+0000","last_deep_scrub":"378'4","last_deep_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_clean_scrub_stamp":"2024-02-19T21:59:18.440255+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"470'29","reported_seq":526,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.525629+0000","last_change":"2024-02-19T21:59:02.528308+0000","last_active":"2024-02-19T21:59:50.525629+0000","last_peered":"2024-02-19T21:59:50.525629+0000","last_clean":"2024-02-19T21:59:50.525629+0000","last_became_active":"2024-02-19T21:58:25.592551+0000","last_became_peered":"2024-02-19T21:58:25.592551+0000","last_unstale":"2024-02-19T21:59:50.525629+0000","last_undegraded":"2024-02-19T21:59:50.525629+0000","last_fullsized":"2024-02-19T21:59:50.525629+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'29","last_scrub_stamp":"2024-02-19T21:59:02.528230+0000","last_deep_scrub":"470'29","last_deep_scrub_stamp":"2024-02-19T21:59:02.528230+0000","last_clean_scrub_stamp":"2024-02-19T21:59:02.528230+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":33,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":274,"reported_epoch":609,"state":"active+clean","last_fresh":"2024-02-19T21:59:46.622813+0000","last_change":"2024-02-19T21:59:20.903892+0000","last_active":"2024-02-19T21:59:46.622813+0000","last_peered":"2024-02-19T21:59:46.622813+0000","last_clean":"2024-02-19T21:59:46.622813+0000","last_became_active":"2024-02-19T21:57:58.573677+0000","last_became_peered":"2024-02-19T21:57:58.573677+0000","last_unstale":"2024-02-19T21:59:46.622813+0000","last_undegraded":"2024-02-19T21:59:46.622813+0000","last_fullsized":"2024-02-19T21:59:46.622813+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:20.903802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:55:22.791271+0000","last_clean_scrub_stamp":"2024-02-19T21:59:20.903802+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":653,"reported_epoch":609,"state":"active+clean","last_fresh":"2024-02-19T21:59:46.874104+0000","last_change":"2024-02-19T21:59:42.428535+0000","last_active":"2024-02-19T21:59:46.874104+0000","last_peered":"2024-02-19T21:59:46.874104+0000","last_clean":"2024-02-19T21:59:46.874104+0000","last_became_active":"2024-02-19T21:57:58.571584+0000","last_became_peered":"2024-02-19T21:57:58.571584+0000","last_unstale":"2024-02-19T21:59:46.874104+0000","last_undegraded":"2024-02-19T21:59:46.874104+0000","last_fullsized":"2024-02-19T21:59:46.874104+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:42.428463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:59:42.428463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":616,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.839769+0000","last_change":"2024-02-19T21:59:35.767189+0000","last_active":"2024-02-19T21:59:50.839769+0000","last_peered":"2024-02-19T21:59:50.839769+0000","last_clean":"2024-02-19T21:59:50.839769+0000","last_became_active":"2024-02-19T21:57:58.576857+0000","last_became_peered":"2024-02-19T21:57:58.576857+0000","last_unstale":"2024-02-19T21:59:50.839769+0000","last_undegraded":"2024-02-19T21:59:50.839769+0000","last_fullsized":"2024-02-19T21:59:50.839769+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:35.767124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:59:35.767124+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"599'35","reported_seq":527,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.839800+0000","last_change":"2024-02-19T21:59:07.450942+0000","last_active":"2024-02-19T21:59:50.839800+0000","last_peered":"2024-02-19T21:59:50.839800+0000","last_clean":"2024-02-19T21:59:50.839800+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:59:50.839800+0000","last_undegraded":"2024-02-19T21:59:50.839800+0000","last_fullsized":"2024-02-19T21:59:50.839800+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"599'35","last_scrub_stamp":"2024-02-19T21:59:07.450881+0000","last_deep_scrub":"599'35","last_deep_scrub_stamp":"2024-02-19T21:59:07.450881+0000","last_clean_scrub_stamp":"2024-02-19T21:59:07.450881+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"571'10","reported_seq":893,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:59.256784+0000","last_change":"2024-02-19T21:59:59.256754+0000","last_active":"2024-02-19T21:59:59.256784+0000","last_peered":"2024-02-19T21:59:59.256784+0000","last_clean":"2024-02-19T21:59:59.256784+0000","last_became_active":"2024-02-19T21:57:58.568406+0000","last_became_peered":"2024-02-19T21:57:58.568406+0000","last_unstale":"2024-02-19T21:59:59.256784+0000","last_undegraded":"2024-02-19T21:59:59.256784+0000","last_fullsized":"2024-02-19T21:59:59.256784+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"571'10","last_scrub_stamp":"2024-02-19T21:59:59.256680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:59:59.256680+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":45,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.527425+0000","last_change":"2024-02-19T21:58:59.028765+0000","last_active":"2024-02-19T21:59:50.527425+0000","last_peered":"2024-02-19T21:59:50.527425+0000","last_clean":"2024-02-19T21:59:50.527425+0000","last_became_active":"2024-02-19T21:58:25.578213+0000","last_became_peered":"2024-02-19T21:58:25.578213+0000","last_unstale":"2024-02-19T21:59:50.527425+0000","last_undegraded":"2024-02-19T21:59:50.527425+0000","last_fullsized":"2024-02-19T21:59:50.527425+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:58:59.028640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:58:59.028640+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":609,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.471620+0000","last_change":"2024-02-19T21:58:42.445310+0000","last_active":"2024-02-19T21:59:51.471620+0000","last_peered":"2024-02-19T21:59:51.471620+0000","last_clean":"2024-02-19T21:59:51.471620+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:59:51.471620+0000","last_undegraded":"2024-02-19T21:59:51.471620+0000","last_fullsized":"2024-02-19T21:59:51.471620+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:58:42.445193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:58:42.445193+0000","last_clean_scrub_stamp":"2024-02-19T21:58:42.445193+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"598'69","reported_seq":1194,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:07.194716+0000","last_change":"2024-02-19T21:59:04.419081+0000","last_active":"2024-02-19T22:00:07.194716+0000","last_peered":"2024-02-19T22:00:07.194716+0000","last_clean":"2024-02-19T22:00:07.194716+0000","last_became_active":"2024-02-19T21:58:25.592912+0000","last_became_peered":"2024-02-19T21:58:25.592912+0000","last_unstale":"2024-02-19T22:00:07.194716+0000","last_undegraded":"2024-02-19T22:00:07.194716+0000","last_fullsized":"2024-02-19T22:00:07.194716+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"598'69","last_scrub_stamp":"2024-02-19T21:59:04.419016+0000","last_deep_scrub":"598'69","last_deep_scrub_stamp":"2024-02-19T21:59:04.419016+0000","last_clean_scrub_stamp":"2024-02-19T21:59:04.419016+0000","log_size":69,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":50,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":1790,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":582,"reported_epoch":609,"state":"active+clean","last_fresh":"2024-02-19T21:59:46.873252+0000","last_change":"2024-02-19T21:59:33.522888+0000","last_active":"2024-02-19T21:59:46.873252+0000","last_peered":"2024-02-19T21:59:46.873252+0000","last_clean":"2024-02-19T21:59:46.873252+0000","last_became_active":"2024-02-19T21:57:58.571507+0000","last_became_peered":"2024-02-19T21:57:58.571507+0000","last_unstale":"2024-02-19T21:59:46.873252+0000","last_undegraded":"2024-02-19T21:59:46.873252+0000","last_fullsized":"2024-02-19T21:59:46.873252+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:33.522814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:59:33.522814+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":647,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.939931+0000","last_change":"2024-02-19T21:58:57.587630+0000","last_active":"2024-02-19T21:59:50.939931+0000","last_peered":"2024-02-19T21:59:50.939931+0000","last_clean":"2024-02-19T21:59:50.939931+0000","last_became_active":"2024-02-19T21:53:45.368343+0000","last_became_peered":"2024-02-19T21:53:45.368343+0000","last_unstale":"2024-02-19T21:59:50.939931+0000","last_undegraded":"2024-02-19T21:59:50.939931+0000","last_fullsized":"2024-02-19T21:59:50.939931+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:58:57.587501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:58:57.587501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'6","reported_seq":2394,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:09.376077+0000","last_change":"2024-02-19T21:59:55.844974+0000","last_active":"2024-02-19T22:00:09.376077+0000","last_peered":"2024-02-19T22:00:09.376077+0000","last_clean":"2024-02-19T22:00:09.376077+0000","last_became_active":"2024-02-19T21:49:08.331108+0000","last_became_peered":"2024-02-19T21:49:08.331108+0000","last_unstale":"2024-02-19T22:00:09.376077+0000","last_undegraded":"2024-02-19T22:00:09.376077+0000","last_fullsized":"2024-02-19T22:00:09.376077+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-02-19T21:59:55.844901+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_clean_scrub_stamp":"2024-02-19T21:59:55.844901+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1645,"num_read_kb":1640,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":281,"reported_epoch":609,"state":"active+clean","last_fresh":"2024-02-19T21:59:47.120229+0000","last_change":"2024-02-19T21:59:47.120203+0000","last_active":"2024-02-19T21:59:47.120229+0000","last_peered":"2024-02-19T21:59:47.120229+0000","last_clean":"2024-02-19T21:59:47.120229+0000","last_became_active":"2024-02-19T21:58:25.596054+0000","last_became_peered":"2024-02-19T21:58:25.596054+0000","last_unstale":"2024-02-19T21:59:47.120229+0000","last_undegraded":"2024-02-19T21:59:47.120229+0000","last_fullsized":"2024-02-19T21:59:47.120229+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:47.120139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:07.330454+0000","last_clean_scrub_stamp":"2024-02-19T21:59:47.120139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"470'21","reported_seq":679,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.839939+0000","last_change":"2024-02-19T21:59:43.859454+0000","last_active":"2024-02-19T21:59:50.839939+0000","last_peered":"2024-02-19T21:59:50.839939+0000","last_clean":"2024-02-19T21:59:50.839939+0000","last_became_active":"2024-02-19T21:57:58.579855+0000","last_became_peered":"2024-02-19T21:57:58.579855+0000","last_unstale":"2024-02-19T21:59:50.839939+0000","last_undegraded":"2024-02-19T21:59:50.839939+0000","last_fullsized":"2024-02-19T21:59:50.839939+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'21","last_scrub_stamp":"2024-02-19T21:59:43.859384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:59:43.859384+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":31,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":257,"reported_epoch":609,"state":"active+clean","last_fresh":"2024-02-19T21:59:46.623195+0000","last_change":"2024-02-19T21:58:55.811892+0000","last_active":"2024-02-19T21:59:46.623195+0000","last_peered":"2024-02-19T21:59:46.623195+0000","last_clean":"2024-02-19T21:59:46.623195+0000","last_became_active":"2024-02-19T21:49:08.325127+0000","last_became_peered":"2024-02-19T21:49:08.325127+0000","last_unstale":"2024-02-19T21:59:46.623195+0000","last_undegraded":"2024-02-19T21:59:46.623195+0000","last_fullsized":"2024-02-19T21:59:46.623195+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:58:55.811800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:58:55.811800+0000","last_clean_scrub_stamp":"2024-02-19T21:58:55.811800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":640,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.472340+0000","last_change":"2024-02-19T21:59:40.663102+0000","last_active":"2024-02-19T21:59:51.472340+0000","last_peered":"2024-02-19T21:59:51.472340+0000","last_clean":"2024-02-19T21:59:51.472340+0000","last_became_active":"2024-02-19T21:53:45.385423+0000","last_became_peered":"2024-02-19T21:53:45.385423+0000","last_unstale":"2024-02-19T21:59:51.472340+0000","last_undegraded":"2024-02-19T21:59:51.472340+0000","last_fullsized":"2024-02-19T21:59:51.472340+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:40.662998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:58:29.820226+0000","last_clean_scrub_stamp":"2024-02-19T21:59:40.662998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":45,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.526851+0000","last_change":"2024-02-19T21:59:16.992000+0000","last_active":"2024-02-19T21:59:50.526851+0000","last_peered":"2024-02-19T21:59:50.526851+0000","last_clean":"2024-02-19T21:59:50.526851+0000","last_became_active":"2024-02-19T21:58:25.589847+0000","last_became_peered":"2024-02-19T21:58:25.589847+0000","last_unstale":"2024-02-19T21:59:50.526851+0000","last_undegraded":"2024-02-19T21:59:50.526851+0000","last_fullsized":"2024-02-19T21:59:50.526851+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:16.991916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:57:51.564121+0000","last_clean_scrub_stamp":"2024-02-19T21:59:16.991916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":670,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.471752+0000","last_change":"2024-02-19T21:59:42.549244+0000","last_active":"2024-02-19T21:59:51.471752+0000","last_peered":"2024-02-19T21:59:51.471752+0000","last_clean":"2024-02-19T21:59:51.471752+0000","last_became_active":"2024-02-19T21:54:52.479416+0000","last_became_peered":"2024-02-19T21:54:52.479416+0000","last_unstale":"2024-02-19T21:59:51.471752+0000","last_undegraded":"2024-02-19T21:59:51.471752+0000","last_fullsized":"2024-02-19T21:59:51.471752+0000","mapping_epoch":513,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":514,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:42.549166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:59:42.549166+0000","last_clean_scrub_stamp":"2024-02-19T21:59:42.549166+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":241,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.939249+0000","last_change":"2024-02-19T21:59:19.663818+0000","last_active":"2024-02-19T21:59:50.939249+0000","last_peered":"2024-02-19T21:59:50.939249+0000","last_clean":"2024-02-19T21:59:50.939249+0000","last_became_active":"2024-02-19T21:57:58.578344+0000","last_became_peered":"2024-02-19T21:57:58.578344+0000","last_unstale":"2024-02-19T21:59:50.939249+0000","last_undegraded":"2024-02-19T21:59:50.939249+0000","last_fullsized":"2024-02-19T21:59:50.939249+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:19.663748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:59:19.663748+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"470'45","reported_seq":672,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.458212+0000","last_change":"2024-02-19T21:58:56.974989+0000","last_active":"2024-02-19T21:59:51.458212+0000","last_peered":"2024-02-19T21:59:51.458212+0000","last_clean":"2024-02-19T21:59:51.458212+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:59:51.458212+0000","last_undegraded":"2024-02-19T21:59:51.458212+0000","last_fullsized":"2024-02-19T21:59:51.458212+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'45","last_scrub_stamp":"2024-02-19T21:58:56.974886+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:58:56.974886+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":51,"num_write":37,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":226,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.940145+0000","last_change":"2024-02-19T21:59:39.411213+0000","last_active":"2024-02-19T21:59:50.940145+0000","last_peered":"2024-02-19T21:59:50.940145+0000","last_clean":"2024-02-19T21:59:50.940145+0000","last_became_active":"2024-02-19T21:49:54.477947+0000","last_became_peered":"2024-02-19T21:49:54.477947+0000","last_unstale":"2024-02-19T21:59:50.940145+0000","last_undegraded":"2024-02-19T21:59:50.940145+0000","last_fullsized":"2024-02-19T21:59:50.940145+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:39.411136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:59:39.411136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":615,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:06.697289+0000","last_change":"2024-02-19T22:00:06.697267+0000","last_active":"2024-02-19T22:00:06.697289+0000","last_peered":"2024-02-19T22:00:06.697289+0000","last_clean":"2024-02-19T22:00:06.697289+0000","last_became_active":"2024-02-19T21:58:25.593111+0000","last_became_peered":"2024-02-19T21:58:25.593111+0000","last_unstale":"2024-02-19T22:00:06.697289+0000","last_undegraded":"2024-02-19T22:00:06.697289+0000","last_fullsized":"2024-02-19T22:00:06.697289+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T22:00:06.697201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T22:00:06.697201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":603,"reported_epoch":609,"state":"active+clean","last_fresh":"2024-02-19T21:59:46.873668+0000","last_change":"2024-02-19T21:58:42.559735+0000","last_active":"2024-02-19T21:59:46.873668+0000","last_peered":"2024-02-19T21:59:46.873668+0000","last_clean":"2024-02-19T21:59:46.873668+0000","last_became_active":"2024-02-19T21:58:25.597262+0000","last_became_peered":"2024-02-19T21:58:25.597262+0000","last_unstale":"2024-02-19T21:59:46.873668+0000","last_undegraded":"2024-02-19T21:59:46.873668+0000","last_fullsized":"2024-02-19T21:59:46.873668+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:58:42.559657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:58:42.559657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":641,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.939387+0000","last_change":"2024-02-19T21:59:05.541439+0000","last_active":"2024-02-19T21:59:50.939387+0000","last_peered":"2024-02-19T21:59:50.939387+0000","last_clean":"2024-02-19T21:59:50.939387+0000","last_became_active":"2024-02-19T21:57:58.578754+0000","last_became_peered":"2024-02-19T21:57:58.578754+0000","last_unstale":"2024-02-19T21:59:50.939387+0000","last_undegraded":"2024-02-19T21:59:50.939387+0000","last_fullsized":"2024-02-19T21:59:50.939387+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:05.541355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:59:05.541355+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"470'42","reported_seq":758,"reported_epoch":609,"state":"active+clean","last_fresh":"2024-02-19T21:59:46.873257+0000","last_change":"2024-02-19T21:58:46.571798+0000","last_active":"2024-02-19T21:59:46.873257+0000","last_peered":"2024-02-19T21:59:46.873257+0000","last_clean":"2024-02-19T21:59:46.873257+0000","last_became_active":"2024-02-19T21:57:58.571414+0000","last_became_peered":"2024-02-19T21:57:58.571414+0000","last_unstale":"2024-02-19T21:59:46.873257+0000","last_undegraded":"2024-02-19T21:59:46.873257+0000","last_fullsized":"2024-02-19T21:59:46.873257+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'42","last_scrub_stamp":"2024-02-19T21:58:46.571721+0000","last_deep_scrub":"324'30","last_deep_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_clean_scrub_stamp":"2024-02-19T21:58:46.571721+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":47,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":632,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.472304+0000","last_change":"2024-02-19T21:59:39.580543+0000","last_active":"2024-02-19T21:59:51.472304+0000","last_peered":"2024-02-19T21:59:51.472304+0000","last_clean":"2024-02-19T21:59:51.472304+0000","last_became_active":"2024-02-19T21:57:58.570197+0000","last_became_peered":"2024-02-19T21:57:58.570197+0000","last_unstale":"2024-02-19T21:59:51.472304+0000","last_undegraded":"2024-02-19T21:59:51.472304+0000","last_fullsized":"2024-02-19T21:59:51.472304+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:39.580439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:59:39.580439+0000","last_clean_scrub_stamp":"2024-02-19T21:59:39.580439+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":637,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.839831+0000","last_change":"2024-02-19T21:59:48.913954+0000","last_active":"2024-02-19T21:59:50.839831+0000","last_peered":"2024-02-19T21:59:50.839831+0000","last_clean":"2024-02-19T21:59:50.839831+0000","last_became_active":"2024-02-19T21:49:08.330648+0000","last_became_peered":"2024-02-19T21:49:08.330648+0000","last_unstale":"2024-02-19T21:59:50.839831+0000","last_undegraded":"2024-02-19T21:59:50.839831+0000","last_fullsized":"2024-02-19T21:59:50.839831+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:48.913862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:58:28.719381+0000","last_clean_scrub_stamp":"2024-02-19T21:59:48.913862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":617,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.939174+0000","last_change":"2024-02-19T21:59:07.550763+0000","last_active":"2024-02-19T21:59:50.939174+0000","last_peered":"2024-02-19T21:59:50.939174+0000","last_clean":"2024-02-19T21:59:50.939174+0000","last_became_active":"2024-02-19T21:57:58.566881+0000","last_became_peered":"2024-02-19T21:57:58.566881+0000","last_unstale":"2024-02-19T21:59:50.939174+0000","last_undegraded":"2024-02-19T21:59:50.939174+0000","last_fullsized":"2024-02-19T21:59:50.939174+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:07.550678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:45.017696+0000","last_clean_scrub_stamp":"2024-02-19T21:59:07.550678+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"470'47","reported_seq":666,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:54.291844+0000","last_change":"2024-02-19T21:59:54.291844+0000","last_active":"2024-02-19T21:59:54.291844+0000","last_peered":"2024-02-19T21:59:54.291844+0000","last_clean":"2024-02-19T21:59:54.291844+0000","last_became_active":"2024-02-19T21:57:58.568175+0000","last_became_peered":"2024-02-19T21:57:58.568175+0000","last_unstale":"2024-02-19T21:59:54.291844+0000","last_undegraded":"2024-02-19T21:59:54.291844+0000","last_fullsized":"2024-02-19T21:59:54.291844+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'47","last_scrub_stamp":"2024-02-19T21:59:54.291772+0000","last_deep_scrub":"470'47","last_deep_scrub_stamp":"2024-02-19T21:59:54.291772+0000","last_clean_scrub_stamp":"2024-02-19T21:59:54.291772+0000","log_size":47,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":68,"num_read_kb":54,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":615,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.458165+0000","last_change":"2024-02-19T21:59:31.018345+0000","last_active":"2024-02-19T21:59:51.458165+0000","last_peered":"2024-02-19T21:59:51.458165+0000","last_clean":"2024-02-19T21:59:51.458165+0000","last_became_active":"2024-02-19T21:57:58.566809+0000","last_became_peered":"2024-02-19T21:57:58.566809+0000","last_unstale":"2024-02-19T21:59:51.458165+0000","last_undegraded":"2024-02-19T21:59:51.458165+0000","last_fullsized":"2024-02-19T21:59:51.458165+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:31.018220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:59:31.018220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":358,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:07.467888+0000","last_change":"2024-02-19T22:00:07.467844+0000","last_active":"2024-02-19T22:00:07.467888+0000","last_peered":"2024-02-19T22:00:07.467888+0000","last_clean":"2024-02-19T22:00:07.467888+0000","last_became_active":"2024-02-19T21:58:25.591252+0000","last_became_peered":"2024-02-19T21:58:25.591252+0000","last_unstale":"2024-02-19T22:00:07.467888+0000","last_undegraded":"2024-02-19T22:00:07.467888+0000","last_fullsized":"2024-02-19T22:00:07.467888+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T22:00:07.467732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T22:00:07.467732+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":611,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.839882+0000","last_change":"2024-02-19T21:59:45.867561+0000","last_active":"2024-02-19T21:59:50.839882+0000","last_peered":"2024-02-19T21:59:50.839882+0000","last_clean":"2024-02-19T21:59:50.839882+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:59:50.839882+0000","last_undegraded":"2024-02-19T21:59:50.839882+0000","last_fullsized":"2024-02-19T21:59:50.839882+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:45.867493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:59:45.867493+0000","last_clean_scrub_stamp":"2024-02-19T21:59:45.867493+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"470'50","reported_seq":63,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.526629+0000","last_change":"2024-02-19T21:59:22.886591+0000","last_active":"2024-02-19T21:59:50.526629+0000","last_peered":"2024-02-19T21:59:50.526629+0000","last_clean":"2024-02-19T21:59:50.526629+0000","last_became_active":"2024-02-19T21:58:25.592388+0000","last_became_peered":"2024-02-19T21:58:25.592388+0000","last_unstale":"2024-02-19T21:59:50.526629+0000","last_undegraded":"2024-02-19T21:59:50.526629+0000","last_fullsized":"2024-02-19T21:59:50.526629+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":581,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'50","last_scrub_stamp":"2024-02-19T21:59:22.886497+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:59:22.886497+0000","log_size":50,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":44,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":520,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.458074+0000","last_change":"2024-02-19T21:59:18.090833+0000","last_active":"2024-02-19T21:59:51.458074+0000","last_peered":"2024-02-19T21:59:51.458074+0000","last_clean":"2024-02-19T21:59:51.458074+0000","last_became_active":"2024-02-19T21:58:25.592211+0000","last_became_peered":"2024-02-19T21:58:25.592211+0000","last_unstale":"2024-02-19T21:59:51.458074+0000","last_undegraded":"2024-02-19T21:59:51.458074+0000","last_fullsized":"2024-02-19T21:59:51.458074+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:18.090748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:59:18.090748+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":638,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.536170+0000","last_change":"2024-02-19T21:59:51.536136+0000","last_active":"2024-02-19T21:59:51.536170+0000","last_peered":"2024-02-19T21:59:51.536170+0000","last_clean":"2024-02-19T21:59:51.536170+0000","last_became_active":"2024-02-19T21:49:08.328529+0000","last_became_peered":"2024-02-19T21:49:08.328529+0000","last_unstale":"2024-02-19T21:59:51.536170+0000","last_undegraded":"2024-02-19T21:59:51.536170+0000","last_fullsized":"2024-02-19T21:59:51.536170+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:51.536035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:59:51.536035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":668,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.458484+0000","last_change":"2024-02-19T21:59:38.945553+0000","last_active":"2024-02-19T21:59:51.458484+0000","last_peered":"2024-02-19T21:59:51.458484+0000","last_clean":"2024-02-19T21:59:51.458484+0000","last_became_active":"2024-02-19T21:49:54.493041+0000","last_became_peered":"2024-02-19T21:49:54.493041+0000","last_unstale":"2024-02-19T21:59:51.458484+0000","last_undegraded":"2024-02-19T21:59:51.458484+0000","last_fullsized":"2024-02-19T21:59:51.458484+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:38.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:59:38.945441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"470'42","reported_seq":497,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:55.501064+0000","last_change":"2024-02-19T21:59:55.501029+0000","last_active":"2024-02-19T21:59:55.501064+0000","last_peered":"2024-02-19T21:59:55.501064+0000","last_clean":"2024-02-19T21:59:55.501064+0000","last_became_active":"2024-02-19T21:49:08.330477+0000","last_became_peered":"2024-02-19T21:49:08.330477+0000","last_unstale":"2024-02-19T21:59:55.501064+0000","last_undegraded":"2024-02-19T21:59:55.501064+0000","last_fullsized":"2024-02-19T21:59:55.501064+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'42","last_scrub_stamp":"2024-02-19T21:59:55.500948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:59:55.500948+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"606'13","reported_seq":71,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:07.194715+0000","last_change":"2024-02-19T21:59:26.816123+0000","last_active":"2024-02-19T22:00:07.194715+0000","last_peered":"2024-02-19T22:00:07.194715+0000","last_clean":"2024-02-19T22:00:07.194715+0000","last_became_active":"2024-02-19T21:58:25.591608+0000","last_became_peered":"2024-02-19T21:58:25.591608+0000","last_unstale":"2024-02-19T22:00:07.194715+0000","last_undegraded":"2024-02-19T22:00:07.194715+0000","last_fullsized":"2024-02-19T22:00:07.194715+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"606'13","last_scrub_stamp":"2024-02-19T21:59:26.816058+0000","last_deep_scrub":"606'13","last_deep_scrub_stamp":"2024-02-19T21:59:26.816058+0000","last_clean_scrub_stamp":"2024-02-19T21:59:26.816058+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"66'1","reported_seq":129,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:09.005248+0000","last_change":"2024-02-19T22:00:09.005248+0000","last_active":"2024-02-19T22:00:09.005248+0000","last_peered":"2024-02-19T22:00:09.005248+0000","last_clean":"2024-02-19T22:00:09.005248+0000","last_became_active":"2024-02-19T21:58:28.515039+0000","last_became_peered":"2024-02-19T21:58:28.515039+0000","last_unstale":"2024-02-19T22:00:09.005248+0000","last_undegraded":"2024-02-19T22:00:09.005248+0000","last_fullsized":"2024-02-19T22:00:09.005248+0000","mapping_epoch":582,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":583,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T22:00:09.005182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T22:00:09.005182+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"261'11","reported_seq":810,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:07.194584+0000","last_change":"2024-02-19T21:59:22.506434+0000","last_active":"2024-02-19T22:00:07.194584+0000","last_peered":"2024-02-19T22:00:07.194584+0000","last_clean":"2024-02-19T22:00:07.194584+0000","last_became_active":"2024-02-19T21:44:08.123392+0000","last_became_peered":"2024-02-19T21:44:08.123392+0000","last_unstale":"2024-02-19T22:00:07.194584+0000","last_undegraded":"2024-02-19T22:00:07.194584+0000","last_fullsized":"2024-02-19T22:00:07.194584+0000","mapping_epoch":62,"log_start":"257'10","ondisk_log_start":"257'10","created":62,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-02-19T21:59:22.506345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:59:22.506345+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"571'2","reported_seq":629,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.939473+0000","last_change":"2024-02-19T21:59:25.564757+0000","last_active":"2024-02-19T21:59:50.939473+0000","last_peered":"2024-02-19T21:59:50.939473+0000","last_clean":"2024-02-19T21:59:50.939473+0000","last_became_active":"2024-02-19T21:57:58.579213+0000","last_became_peered":"2024-02-19T21:57:58.579213+0000","last_unstale":"2024-02-19T21:59:50.939473+0000","last_undegraded":"2024-02-19T21:59:50.939473+0000","last_fullsized":"2024-02-19T21:59:50.939473+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"571'2","last_scrub_stamp":"2024-02-19T21:59:25.564671+0000","last_deep_scrub":"571'2","last_deep_scrub_stamp":"2024-02-19T21:58:01.684155+0000","last_clean_scrub_stamp":"2024-02-19T21:59:25.564671+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"470'27","reported_seq":483,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.526094+0000","last_change":"2024-02-19T21:59:11.479523+0000","last_active":"2024-02-19T21:59:50.526094+0000","last_peered":"2024-02-19T21:59:50.526094+0000","last_clean":"2024-02-19T21:59:50.526094+0000","last_became_active":"2024-02-19T21:47:46.251550+0000","last_became_peered":"2024-02-19T21:47:46.251550+0000","last_unstale":"2024-02-19T21:59:50.526094+0000","last_undegraded":"2024-02-19T21:59:50.526094+0000","last_fullsized":"2024-02-19T21:59:50.526094+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'27","last_scrub_stamp":"2024-02-19T21:59:11.479412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:59:11.479412+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7],"acting":[4,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":634,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.472082+0000","last_change":"2024-02-19T21:59:09.439166+0000","last_active":"2024-02-19T21:59:51.472082+0000","last_peered":"2024-02-19T21:59:51.472082+0000","last_clean":"2024-02-19T21:59:51.472082+0000","last_became_active":"2024-02-19T21:57:58.569584+0000","last_became_peered":"2024-02-19T21:57:58.569584+0000","last_unstale":"2024-02-19T21:59:51.472082+0000","last_undegraded":"2024-02-19T21:59:51.472082+0000","last_fullsized":"2024-02-19T21:59:51.472082+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:09.439069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:59:09.439069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"571'14","reported_seq":533,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:07.194588+0000","last_change":"2024-02-19T21:59:23.462656+0000","last_active":"2024-02-19T22:00:07.194588+0000","last_peered":"2024-02-19T22:00:07.194588+0000","last_clean":"2024-02-19T22:00:07.194588+0000","last_became_active":"2024-02-19T21:57:58.571667+0000","last_became_peered":"2024-02-19T21:57:58.571667+0000","last_unstale":"2024-02-19T22:00:07.194588+0000","last_undegraded":"2024-02-19T22:00:07.194588+0000","last_fullsized":"2024-02-19T22:00:07.194588+0000","mapping_epoch":568,"log_start":"98'9","ondisk_log_start":"98'9","created":62,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"571'14","last_scrub_stamp":"2024-02-19T21:59:23.462543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:59:23.462543+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":634,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.839667+0000","last_change":"2024-02-19T21:59:19.610042+0000","last_active":"2024-02-19T21:59:50.839667+0000","last_peered":"2024-02-19T21:59:50.839667+0000","last_clean":"2024-02-19T21:59:50.839667+0000","last_became_active":"2024-02-19T21:53:45.382885+0000","last_became_peered":"2024-02-19T21:53:45.382885+0000","last_unstale":"2024-02-19T21:59:50.839667+0000","last_undegraded":"2024-02-19T21:59:50.839667+0000","last_fullsized":"2024-02-19T21:59:50.839667+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:19.609965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:59:19.609965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"471'46","reported_seq":591,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:54.490441+0000","last_change":"2024-02-19T21:59:54.490388+0000","last_active":"2024-02-19T21:59:54.490441+0000","last_peered":"2024-02-19T21:59:54.490441+0000","last_clean":"2024-02-19T21:59:54.490441+0000","last_became_active":"2024-02-19T21:53:45.384528+0000","last_became_peered":"2024-02-19T21:53:45.384528+0000","last_unstale":"2024-02-19T21:59:54.490441+0000","last_undegraded":"2024-02-19T21:59:54.490441+0000","last_fullsized":"2024-02-19T21:59:54.490441+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'46","last_scrub_stamp":"2024-02-19T21:59:54.490302+0000","last_deep_scrub":"270'34","last_deep_scrub_stamp":"2024-02-19T21:44:17.451151+0000","last_clean_scrub_stamp":"2024-02-19T21:59:54.490302+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":602,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.526189+0000","last_change":"2024-02-19T21:59:08.482713+0000","last_active":"2024-02-19T21:59:50.526189+0000","last_peered":"2024-02-19T21:59:50.526189+0000","last_clean":"2024-02-19T21:59:50.526189+0000","last_became_active":"2024-02-19T21:49:08.328697+0000","last_became_peered":"2024-02-19T21:49:08.328697+0000","last_unstale":"2024-02-19T21:59:50.526189+0000","last_undegraded":"2024-02-19T21:59:50.526189+0000","last_fullsized":"2024-02-19T21:59:50.526189+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:08.482609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:59:08.482609+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"397'17","reported_seq":653,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:02.193698+0000","last_change":"2024-02-19T21:58:50.766858+0000","last_active":"2024-02-19T22:00:02.193698+0000","last_peered":"2024-02-19T22:00:02.193698+0000","last_clean":"2024-02-19T22:00:02.193698+0000","last_became_active":"2024-02-19T21:49:08.325034+0000","last_became_peered":"2024-02-19T21:49:08.325034+0000","last_unstale":"2024-02-19T22:00:02.193698+0000","last_undegraded":"2024-02-19T22:00:02.193698+0000","last_fullsized":"2024-02-19T22:00:02.193698+0000","mapping_epoch":394,"log_start":"170'11","ondisk_log_start":"170'11","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"397'17","last_scrub_stamp":"2024-02-19T21:58:50.766792+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T21:58:50.766792+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":624,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.839756+0000","last_change":"2024-02-19T21:59:28.838397+0000","last_active":"2024-02-19T21:59:50.839756+0000","last_peered":"2024-02-19T21:59:50.839756+0000","last_clean":"2024-02-19T21:59:50.839756+0000","last_became_active":"2024-02-19T21:53:45.383372+0000","last_became_peered":"2024-02-19T21:53:45.383372+0000","last_unstale":"2024-02-19T21:59:50.839756+0000","last_undegraded":"2024-02-19T21:59:50.839756+0000","last_fullsized":"2024-02-19T21:59:50.839756+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:28.838334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:59:28.838334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"470'30","reported_seq":489,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:09.361125+0000","last_change":"2024-02-19T22:00:09.361125+0000","last_active":"2024-02-19T22:00:09.361125+0000","last_peered":"2024-02-19T22:00:09.361125+0000","last_clean":"2024-02-19T22:00:09.361125+0000","last_became_active":"2024-02-19T21:53:45.387040+0000","last_became_peered":"2024-02-19T21:53:45.387040+0000","last_unstale":"2024-02-19T22:00:09.361125+0000","last_undegraded":"2024-02-19T22:00:09.361125+0000","last_fullsized":"2024-02-19T22:00:09.361125+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'30","last_scrub_stamp":"2024-02-19T22:00:09.361034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T22:00:09.361034+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":38,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":281,"reported_epoch":609,"state":"active+clean","last_fresh":"2024-02-19T21:59:46.623218+0000","last_change":"2024-02-19T21:59:43.211689+0000","last_active":"2024-02-19T21:59:46.623218+0000","last_peered":"2024-02-19T21:59:46.623218+0000","last_clean":"2024-02-19T21:59:46.623218+0000","last_became_active":"2024-02-19T21:58:25.594694+0000","last_became_peered":"2024-02-19T21:58:25.594694+0000","last_unstale":"2024-02-19T21:59:46.623218+0000","last_undegraded":"2024-02-19T21:59:46.623218+0000","last_fullsized":"2024-02-19T21:59:46.623218+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:43.211604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:59:43.211604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":625,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.839285+0000","last_change":"2024-02-19T21:59:31.844252+0000","last_active":"2024-02-19T21:59:50.839285+0000","last_peered":"2024-02-19T21:59:50.839285+0000","last_clean":"2024-02-19T21:59:50.839285+0000","last_became_active":"2024-02-19T21:57:58.571126+0000","last_became_peered":"2024-02-19T21:57:58.571126+0000","last_unstale":"2024-02-19T21:59:50.839285+0000","last_undegraded":"2024-02-19T21:59:50.839285+0000","last_fullsized":"2024-02-19T21:59:50.839285+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:31.844186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:59:31.844186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":614,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:01.433320+0000","last_change":"2024-02-19T22:00:01.433247+0000","last_active":"2024-02-19T22:00:01.433320+0000","last_peered":"2024-02-19T22:00:01.433320+0000","last_clean":"2024-02-19T22:00:01.433320+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T22:00:01.433320+0000","last_undegraded":"2024-02-19T22:00:01.433320+0000","last_fullsized":"2024-02-19T22:00:01.433320+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T22:00:01.433150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T22:00:01.433150+0000","last_clean_scrub_stamp":"2024-02-19T22:00:01.433150+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"470'53","reported_seq":583,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.526103+0000","last_change":"2024-02-19T21:59:17.454388+0000","last_active":"2024-02-19T21:59:50.526103+0000","last_peered":"2024-02-19T21:59:50.526103+0000","last_clean":"2024-02-19T21:59:50.526103+0000","last_became_active":"2024-02-19T21:49:08.325683+0000","last_became_peered":"2024-02-19T21:49:08.325683+0000","last_unstale":"2024-02-19T21:59:50.526103+0000","last_undegraded":"2024-02-19T21:59:50.526103+0000","last_fullsized":"2024-02-19T21:59:50.526103+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'53","last_scrub_stamp":"2024-02-19T21:59:17.454309+0000","last_deep_scrub":"337'39","last_deep_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_clean_scrub_stamp":"2024-02-19T21:59:17.454309+0000","log_size":53,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"66'1","reported_seq":470,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.939262+0000","last_change":"2024-02-19T21:59:06.560716+0000","last_active":"2024-02-19T21:59:50.939262+0000","last_peered":"2024-02-19T21:59:50.939262+0000","last_clean":"2024-02-19T21:59:50.939262+0000","last_became_active":"2024-02-19T21:53:48.374606+0000","last_became_peered":"2024-02-19T21:53:48.374606+0000","last_unstale":"2024-02-19T21:59:50.939262+0000","last_undegraded":"2024-02-19T21:59:50.939262+0000","last_fullsized":"2024-02-19T21:59:50.939262+0000","mapping_epoch":495,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":496,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:59:06.560625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:59:06.560625+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":272,"reported_epoch":609,"state":"active+clean","last_fresh":"2024-02-19T21:59:46.623311+0000","last_change":"2024-02-19T21:59:18.895768+0000","last_active":"2024-02-19T21:59:46.623311+0000","last_peered":"2024-02-19T21:59:46.623311+0000","last_clean":"2024-02-19T21:59:46.623311+0000","last_became_active":"2024-02-19T21:57:58.573947+0000","last_became_peered":"2024-02-19T21:57:58.573947+0000","last_unstale":"2024-02-19T21:59:46.623311+0000","last_undegraded":"2024-02-19T21:59:46.623311+0000","last_fullsized":"2024-02-19T21:59:46.623311+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:18.895707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:59:18.895707+0000","last_clean_scrub_stamp":"2024-02-19T21:59:18.895707+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":333,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.458026+0000","last_change":"2024-02-19T21:59:27.096460+0000","last_active":"2024-02-19T21:59:51.458026+0000","last_peered":"2024-02-19T21:59:51.458026+0000","last_clean":"2024-02-19T21:59:51.458026+0000","last_became_active":"2024-02-19T21:49:08.327186+0000","last_became_peered":"2024-02-19T21:49:08.327186+0000","last_unstale":"2024-02-19T21:59:51.458026+0000","last_undegraded":"2024-02-19T21:59:51.458026+0000","last_fullsized":"2024-02-19T21:59:51.458026+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:59:27.096349+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:59:27.096349+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"471'60","reported_seq":758,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:09.028969+0000","last_change":"2024-02-19T22:00:09.028969+0000","last_active":"2024-02-19T22:00:09.028969+0000","last_peered":"2024-02-19T22:00:09.028969+0000","last_clean":"2024-02-19T22:00:09.028969+0000","last_became_active":"2024-02-19T21:49:54.493167+0000","last_became_peered":"2024-02-19T21:49:54.493167+0000","last_unstale":"2024-02-19T22:00:09.028969+0000","last_undegraded":"2024-02-19T22:00:09.028969+0000","last_fullsized":"2024-02-19T22:00:09.028969+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'60","last_scrub_stamp":"2024-02-19T22:00:09.028888+0000","last_deep_scrub":"201'44","last_deep_scrub_stamp":"2024-02-19T21:44:16.255049+0000","last_clean_scrub_stamp":"2024-02-19T22:00:09.028888+0000","log_size":60,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":80,"num_read_kb":69,"num_write":52,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":638,"reported_epoch":609,"state":"active+clean","last_fresh":"2024-02-19T21:59:46.873708+0000","last_change":"2024-02-19T21:59:15.681687+0000","last_active":"2024-02-19T21:59:46.873708+0000","last_peered":"2024-02-19T21:59:46.873708+0000","last_clean":"2024-02-19T21:59:46.873708+0000","last_became_active":"2024-02-19T21:57:58.570562+0000","last_became_peered":"2024-02-19T21:57:58.570562+0000","last_unstale":"2024-02-19T21:59:46.873708+0000","last_undegraded":"2024-02-19T21:59:46.873708+0000","last_fullsized":"2024-02-19T21:59:46.873708+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:15.681557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:59:15.681557+0000","last_clean_scrub_stamp":"2024-02-19T21:59:15.681557+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":283,"reported_epoch":609,"state":"active+clean","last_fresh":"2024-02-19T21:59:46.622967+0000","last_change":"2024-02-19T21:59:33.175583+0000","last_active":"2024-02-19T21:59:46.622967+0000","last_peered":"2024-02-19T21:59:46.622967+0000","last_clean":"2024-02-19T21:59:46.622967+0000","last_became_active":"2024-02-19T21:58:25.595009+0000","last_became_peered":"2024-02-19T21:58:25.595009+0000","last_unstale":"2024-02-19T21:59:46.622967+0000","last_undegraded":"2024-02-19T21:59:46.622967+0000","last_fullsized":"2024-02-19T21:59:46.622967+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:33.175519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.547129+0000","last_clean_scrub_stamp":"2024-02-19T21:59:33.175519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":634,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.840074+0000","last_change":"2024-02-19T21:59:05.451067+0000","last_active":"2024-02-19T21:59:50.840074+0000","last_peered":"2024-02-19T21:59:50.840074+0000","last_clean":"2024-02-19T21:59:50.840074+0000","last_became_active":"2024-02-19T21:53:45.384695+0000","last_became_peered":"2024-02-19T21:53:45.384695+0000","last_unstale":"2024-02-19T21:59:50.840074+0000","last_undegraded":"2024-02-19T21:59:50.840074+0000","last_fullsized":"2024-02-19T21:59:50.840074+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:05.451003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:59:05.451003+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"470'25","reported_seq":602,"reported_epoch":609,"state":"active+clean","last_fresh":"2024-02-19T21:59:46.874204+0000","last_change":"2024-02-19T21:59:45.450726+0000","last_active":"2024-02-19T21:59:46.874204+0000","last_peered":"2024-02-19T21:59:46.874204+0000","last_clean":"2024-02-19T21:59:46.874204+0000","last_became_active":"2024-02-19T21:57:58.572050+0000","last_became_peered":"2024-02-19T21:57:58.572050+0000","last_unstale":"2024-02-19T21:59:46.874204+0000","last_undegraded":"2024-02-19T21:59:46.874204+0000","last_fullsized":"2024-02-19T21:59:46.874204+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'25","last_scrub_stamp":"2024-02-19T21:59:45.450632+0000","last_deep_scrub":"377'19","last_deep_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_clean_scrub_stamp":"2024-02-19T21:59:45.450632+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":637,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.471482+0000","last_change":"2024-02-19T21:59:17.456086+0000","last_active":"2024-02-19T21:59:51.471482+0000","last_peered":"2024-02-19T21:59:51.471482+0000","last_clean":"2024-02-19T21:59:51.471482+0000","last_became_active":"2024-02-19T21:57:58.567315+0000","last_became_peered":"2024-02-19T21:57:58.567315+0000","last_unstale":"2024-02-19T21:59:51.471482+0000","last_undegraded":"2024-02-19T21:59:51.471482+0000","last_fullsized":"2024-02-19T21:59:51.471482+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:17.456007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:59:17.456007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":277,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:56.953144+0000","last_change":"2024-02-19T21:59:56.953144+0000","last_active":"2024-02-19T21:59:56.953144+0000","last_peered":"2024-02-19T21:59:56.953144+0000","last_clean":"2024-02-19T21:59:56.953144+0000","last_became_active":"2024-02-19T21:58:25.594931+0000","last_became_peered":"2024-02-19T21:58:25.594931+0000","last_unstale":"2024-02-19T21:59:56.953144+0000","last_undegraded":"2024-02-19T21:59:56.953144+0000","last_fullsized":"2024-02-19T21:59:56.953144+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:56.953067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:59:56.953067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"470'39","reported_seq":712,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.471281+0000","last_change":"2024-02-19T21:58:55.423420+0000","last_active":"2024-02-19T21:59:51.471281+0000","last_peered":"2024-02-19T21:59:51.471281+0000","last_clean":"2024-02-19T21:59:51.471281+0000","last_became_active":"2024-02-19T21:49:54.486014+0000","last_became_peered":"2024-02-19T21:49:54.486014+0000","last_unstale":"2024-02-19T21:59:51.471281+0000","last_undegraded":"2024-02-19T21:59:51.471281+0000","last_fullsized":"2024-02-19T21:59:51.471281+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'39","last_scrub_stamp":"2024-02-19T21:58:55.423330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:58:55.423330+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"324'11","reported_seq":966,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:07.194592+0000","last_change":"2024-02-19T21:59:02.545323+0000","last_active":"2024-02-19T22:00:07.194592+0000","last_peered":"2024-02-19T22:00:07.194592+0000","last_clean":"2024-02-19T22:00:07.194592+0000","last_became_active":"2024-02-19T21:44:34.385140+0000","last_became_peered":"2024-02-19T21:44:34.385140+0000","last_unstale":"2024-02-19T22:00:07.194592+0000","last_undegraded":"2024-02-19T22:00:07.194592+0000","last_fullsized":"2024-02-19T22:00:07.194592+0000","mapping_epoch":62,"log_start":"66'8","ondisk_log_start":"66'8","created":62,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'11","last_scrub_stamp":"2024-02-19T21:59:02.545240+0000","last_deep_scrub":"324'11","last_deep_scrub_stamp":"2024-02-19T21:46:05.210095+0000","last_clean_scrub_stamp":"2024-02-19T21:59:02.545240+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1645,"num_read_kb":1640,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1526,"num_read_kb":1283,"num_write":989,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":370,"num_bytes_recovered":7290,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1087,"ondisk_log_size":1087,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":22,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":67,"ondisk_log_size":67,"up":66,"acting":66,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201617,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":899288,"kb_used_data":5520,"kb_used_omap":0,"kb_used_meta":893760,"kb_avail":92845864,"statfs":{"total":95995035648,"available":95074164736,"internally_reserved":0,"allocated":5652480,"data_stored":3675121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":915210240},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 22:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.436,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.65900000000000003}]},{"osd":1,"last update":"Mon Feb 19 22:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":1.355,"15min":1.794},"min":{"1min":0.371,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.63,"5min":8.9619999999999997,"15min":68.168000000000006},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":1.256,"15min":1.8799999999999999},"min":{"1min":0.376,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.79000000000000004,"5min":9.7289999999999992,"15min":68.444000000000003},"last":0.63400000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:59:26 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":1.5820000000000001,"15min":1.7509999999999999},"min":{"1min":0.30599999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.76900000000000002,"5min":12.352,"15min":12.352},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":2.0899999999999999,"15min":1.841},"min":{"1min":0.36599999999999999,"5min":0.29599999999999999,"15min":0.28100000000000003},"max":{"1min":0.76500000000000001,"5min":19.129000000000001,"15min":19.129000000000001},"last":0.57799999999999996}]},{"osd":3,"last update":"Mon Feb 19 22:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":1.7969999999999999,"15min":1.7969999999999999},"min":{"1min":0.39100000000000001,"5min":0.30399999999999999,"15min":0.25900000000000001},"max":{"1min":0.78600000000000003,"5min":19.253,"15min":19.253},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":1.409,"15min":1.516},"min":{"1min":0.42299999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.68600000000000005,"5min":8.9920000000000009,"15min":13.473000000000001},"last":0.54800000000000004}]},{"osd":4,"last update":"Mon Feb 19 22:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":1.5309999999999999,"15min":1.589},"min":{"1min":0.371,"5min":0.255,"15min":0.216},"max":{"1min":0.65800000000000003,"5min":12.375,"15min":17.716999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":2.0369999999999999,"15min":1.99},"min":{"1min":0.39200000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.70399999999999996,"5min":19.225000000000001,"15min":19.225000000000001},"last":0.42199999999999999}]},{"osd":5,"last update":"Mon Feb 19 22:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":1.5640000000000001,"15min":1.677},"min":{"1min":0.41499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.75700000000000001,"5min":14.675000000000001,"15min":29.021000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":1.4470000000000001,"15min":1.774},"min":{"1min":0.45600000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.876,"5min":8.4320000000000004,"15min":29.091999999999999},"last":0.67800000000000005}]},{"osd":6,"last update":"Mon Feb 19 22:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":1.6459999999999999,"15min":1.8500000000000001},"min":{"1min":0.42799999999999999,"5min":0.31900000000000001,"15min":0.24299999999999999},"max":{"1min":0.79700000000000004,"5min":8.7430000000000003,"15min":19.286000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.623,"5min":2.3130000000000002,"15min":2.0550000000000002},"min":{"1min":0.40500000000000003,"5min":0.28899999999999998,"15min":0.26700000000000002},"max":{"1min":0.83099999999999996,"5min":27.899000000000001,"15min":27.899000000000001},"last":0.60699999999999998}]}]},{"osd":6,"up_from":47,"seq":201863463256,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":894516,"kb_used_data":5484,"kb_used_omap":0,"kb_used_meta":889024,"kb_avail":92850636,"statfs":{"total":95995035648,"available":95079051264,"internally_reserved":0,"allocated":5615616,"data_stored":3673613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":910360576},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:59:59 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54500000000000004,"15min":0.54600000000000004},"min":{"1min":0.40699999999999997,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.72399999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.751},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60299999999999998,"15min":0.61099999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.752,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.79100000000000004}]},{"osd":1,"last update":"Mon Feb 19 21:59:48 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":1.516,"15min":1.3540000000000001},"min":{"1min":0.26500000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.81499999999999995,"5min":30.719999999999999,"15min":30.719999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":2.335,"15min":1.7749999999999999},"min":{"1min":0.32000000000000001,"5min":0.27400000000000002,"15min":0.245},"max":{"1min":0.64400000000000002,"5min":31.177,"15min":31.177},"last":0.69799999999999995}]},{"osd":2,"last update":"Mon Feb 19 21:59:28 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":2.1539999999999999,"15min":1.6859999999999999},"min":{"1min":0.35999999999999999,"5min":0.28399999999999997,"15min":0.255},"max":{"1min":0.86499999999999999,"5min":52.920000000000002,"15min":52.920000000000002},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":1.919,"15min":1.3899999999999999},"min":{"1min":0.40999999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.94999999999999996,"5min":53.186999999999998,"15min":53.186999999999998},"last":0.83999999999999997}]},{"osd":3,"last update":"Mon Feb 19 21:59:48 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":1.3160000000000001,"15min":1.298},"min":{"1min":0.38900000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.85199999999999998,"5min":8.0990000000000002,"15min":9.8460000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.53500000000000003,"5min":2.0299999999999998,"15min":1.704},"min":{"1min":0.44700000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.71199999999999997,"5min":21.73,"15min":21.73},"last":0.77800000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:59:48 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":1.3779999999999999,"15min":1.663},"min":{"1min":0.34599999999999997,"5min":0.23100000000000001,"15min":0.23000000000000001},"max":{"1min":0.75700000000000001,"5min":15.134,"15min":18.010000000000002},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":1.2949999999999999,"15min":1.5449999999999999},"min":{"1min":0.35999999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.78500000000000003,"5min":6.6159999999999997,"15min":11.566000000000001},"last":0.65600000000000003}]},{"osd":5,"last update":"Mon Feb 19 21:59:48 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":1.2110000000000001,"15min":2.1749999999999998},"min":{"1min":0.38300000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.73399999999999999,"5min":8.173,"15min":148.589},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.57199999999999995,"5min":1.288,"15min":2.0640000000000001},"min":{"1min":0.35899999999999999,"5min":0.28699999999999998,"15min":0.28399999999999997},"max":{"1min":0.81699999999999995,"5min":16.001000000000001,"15min":148.453},"last":0.71399999999999997}]},{"osd":7,"last update":"Mon Feb 19 21:59:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":1.4930000000000001,"15min":1.7250000000000001},"min":{"1min":0.39900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.71499999999999997,"5min":15.051,"15min":15.051},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":1.5489999999999999,"15min":1.772},"min":{"1min":0.501,"5min":0.34999999999999998,"15min":0.33000000000000002},"max":{"1min":0.90500000000000003,"5min":15.08,"15min":15.08},"last":0.89000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575218,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":914332,"kb_used_data":5524,"kb_used_omap":0,"kb_used_meta":908800,"kb_avail":92830820,"statfs":{"total":95995035648,"available":95058759680,"internally_reserved":0,"allocated":5656576,"data_stored":3675005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":930611200},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:59:58 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.313,"15min":0.309},"min":{"1min":0.215,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.45500000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.37,"15min":0.36599999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.374}]},{"osd":2,"last update":"Mon Feb 19 21:59:34 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":1.262,"15min":0.97599999999999998},"min":{"1min":0.26100000000000001,"5min":0.191,"15min":0.189},"max":{"1min":0.58999999999999997,"5min":10.776999999999999,"15min":10.776999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.33100000000000002,"5min":1.5089999999999999,"15min":1.1140000000000001},"min":{"1min":0.249,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.56799999999999995,"5min":19.199000000000002,"15min":19.199000000000002},"last":0.25800000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:59:34 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":1.4830000000000001,"15min":1.1479999999999999},"min":{"1min":0.245,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.47399999999999998,"5min":19.297999999999998,"15min":19.297999999999998},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":1.2150000000000001,"15min":1.0529999999999999},"min":{"1min":0.32100000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.64700000000000002,"5min":13.029999999999999,"15min":13.029999999999999},"last":0.39700000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":1.5389999999999999,"15min":1.462},"min":{"1min":0.377,"5min":0.25700000000000001,"15min":0.251},"max":{"1min":0.79500000000000004,"5min":19.742000000000001,"15min":19.742000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.61099999999999999,"5min":1.7210000000000001,"15min":1.55},"min":{"1min":0.41099999999999998,"5min":0.32000000000000001,"15min":0.28000000000000003},"max":{"1min":0.81599999999999995,"5min":19.331,"15min":19.331},"last":0.57899999999999996}]},{"osd":5,"last update":"Mon Feb 19 21:59:21 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":1.617,"15min":1.417},"min":{"1min":0.39100000000000001,"5min":0.28199999999999997,"15min":0.27900000000000003},"max":{"1min":0.79100000000000004,"5min":7.649,"15min":14.331},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":1.552,"15min":1.4950000000000001},"min":{"1min":0.41299999999999998,"5min":0.311,"15min":0.307},"max":{"1min":0.80400000000000005,"5min":19.388000000000002,"15min":19.388000000000002},"last":0.46600000000000003}]},{"osd":6,"last update":"Mon Feb 19 21:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":1.577,"15min":1.431},"min":{"1min":0.35899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85199999999999998,"5min":6.6859999999999999,"15min":10.456},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":1.6850000000000001,"15min":1.5289999999999999},"min":{"1min":0.38600000000000001,"5min":0.30399999999999999,"15min":0.29699999999999999},"max":{"1min":0.73399999999999999,"5min":19.359000000000002,"15min":19.359000000000002},"last":0.53800000000000003}]},{"osd":7,"last update":"Mon Feb 19 21:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":1.6950000000000001,"15min":1.5580000000000001},"min":{"1min":0.49399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.83599999999999997,"5min":19.681999999999999,"15min":19.681999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":1.72,"15min":1.548},"min":{"1min":0.50800000000000001,"5min":0.373,"15min":0.35499999999999998},"max":{"1min":0.91000000000000003,"5min":19.774000000000001,"15min":19.774000000000001},"last":0.58499999999999996}]}]},{"osd":0,"up_from":568,"seq":2439541424156,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":365764,"kb_used_data":5500,"kb_used_omap":0,"kb_used_meta":360255,"kb_avail":93379388,"statfs":{"total":95995035648,"available":95620493312,"internally_reserved":0,"allocated":5632000,"data_stored":3666345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":368901172},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 22:00:01 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.254,"5min":0.214,"15min":0.214},"max":{"1min":0.45800000000000002,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.371,"15min":0.374},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.41199999999999998,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.24199999999999999}]},{"osd":2,"last update":"Mon Feb 19 22:00:01 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.39200000000000002,"15min":0.39700000000000002},"min":{"1min":0.26100000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53000000000000003,"5min":0.624,"15min":0.624},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.39500000000000002,"15min":0.40000000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.45500000000000002,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.38300000000000001}]},{"osd":3,"last update":"Mon Feb 19 22:00:01 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.38300000000000001,"15min":0.38800000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.501,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.41299999999999998,"15min":0.41999999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.51500000000000001,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.29799999999999999}]},{"osd":4,"last update":"Mon Feb 19 22:00:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.435,"5min":0.432,"15min":0.432},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41399999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.54500000000000004}]},{"osd":5,"last update":"Mon Feb 19 22:00:01 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.437,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.66900000000000004}]},{"osd":6,"last update":"Mon Feb 19 22:00:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.622,"15min":0.63},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.76800000000000002,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60999999999999999,"15min":0.61399999999999999},"min":{"1min":0.45300000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.53800000000000003}]},{"osd":7,"last update":"Mon Feb 19 22:00:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.59099999999999997,"15min":0.58499999999999996},"min":{"1min":0.46000000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.63300000000000001}]}]},{"osd":2,"up_from":394,"seq":1692217114757,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":325428,"kb_used_data":5484,"kb_used_omap":0,"kb_used_meta":319935,"kb_avail":93419724,"statfs":{"total":95995035648,"available":95661797376,"internally_reserved":0,"allocated":5615616,"data_stored":3666071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":327613492},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:59:59 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.32900000000000001,"15min":0.33100000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.34399999999999997,"15min":0.35099999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.43099999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:59:24 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.94599999999999995,"15min":0.72699999999999998},"min":{"1min":0.255,"5min":0.193,"15min":0.193},"max":{"1min":0.47299999999999998,"5min":15.413,"15min":15.413},"last":0.501},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.82999999999999996,"15min":0.82899999999999996},"min":{"1min":0.27900000000000003,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.58199999999999996,"5min":4.9349999999999996,"15min":6.992},"last":0.50900000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:59:24 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.83499999999999996,"15min":1.05},"min":{"1min":0.29999999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.64300000000000002,"5min":6.9029999999999996,"15min":6.9470000000000001},"last":0.442},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.93100000000000005,"15min":1.0209999999999999},"min":{"1min":0.26600000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.61899999999999999,"5min":13.537000000000001,"15min":13.537000000000001},"last":0.52000000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:59:24 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":1.387,"15min":1.599},"min":{"1min":0.40500000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.86299999999999999,"5min":9.4540000000000006,"15min":9.4540000000000006},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":1.296,"15min":1.512},"min":{"1min":0.39000000000000001,"5min":0.27600000000000002,"15min":0.26500000000000001},"max":{"1min":0.88,"5min":13.077999999999999,"15min":13.077999999999999},"last":0.73299999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:59:24 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":1.4530000000000001,"15min":1.603},"min":{"1min":0.47799999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.86399999999999999,"5min":10.179,"15min":11.129},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":1.123,"15min":1.333},"min":{"1min":0.376,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.79600000000000004,"5min":7.4749999999999996,"15min":13.558},"last":0.66300000000000003}]},{"osd":6,"last update":"Mon Feb 19 21:59:24 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":1.508,"15min":1.5860000000000001},"min":{"1min":0.42199999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76800000000000002,"5min":9.3040000000000003,"15min":9.6720000000000006},"last":0.751},{"interface":"front","average":{"1min":0.60899999999999999,"5min":1.476,"15min":1.2370000000000001},"min":{"1min":0.43099999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.80800000000000005,"5min":9.7149999999999999,"15min":9.7149999999999999},"last":0.68700000000000006}]},{"osd":7,"last update":"Mon Feb 19 21:59:24 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":1.2869999999999999,"15min":1.3360000000000001},"min":{"1min":0.40400000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83899999999999997,"5min":7.5350000000000001,"15min":7.5350000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":1.3560000000000001,"15min":1.1200000000000001},"min":{"1min":0.48399999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.91600000000000004,"5min":6.8890000000000002,"15min":8.7780000000000005},"last":0.74199999999999999}]}]},{"osd":3,"up_from":26,"seq":111669150056,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":302740,"kb_used_data":5516,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93442412,"statfs":{"total":95995035648,"available":95685029888,"internally_reserved":0,"allocated":5648384,"data_stored":3673840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:59:59 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.42499999999999999,"15min":0.44},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.55100000000000005,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.40500000000000003,"15min":0.41299999999999998},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.505,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.36199999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:59:27 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":3.081,"15min":1.7669999999999999},"min":{"1min":0.22,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.51700000000000002,"5min":178.30000000000001,"15min":178.30000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.373,"5min":1.258,"15min":1.1439999999999999},"min":{"1min":0.23999999999999999,"5min":0.19,"15min":0.186},"max":{"1min":0.57999999999999996,"5min":9.7089999999999996,"15min":62.631},"last":0.28299999999999997}]},{"osd":2,"last update":"Mon Feb 19 21:59:27 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":1.419,"15min":1.0509999999999999},"min":{"1min":0.25800000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.55700000000000005,"5min":10.318,"15min":32.323999999999998},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":1.4419999999999999,"15min":1.3919999999999999},"min":{"1min":0.28399999999999997,"5min":0.187,"15min":0.187},"max":{"1min":0.54500000000000004,"5min":12.449,"15min":32.103999999999999},"last":0.32300000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":1.367,"15min":1.2190000000000001},"min":{"1min":0.43099999999999999,"5min":0.27600000000000002,"15min":0.25700000000000001},"max":{"1min":0.89000000000000001,"5min":15.646000000000001,"15min":15.646000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":1.4179999999999999,"15min":1.2310000000000001},"min":{"1min":0.379,"5min":0.308,"15min":0.26700000000000002},"max":{"1min":0.76600000000000001,"5min":10.285,"15min":10.285},"last":0.41199999999999998}]},{"osd":5,"last update":"Mon Feb 19 22:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":1.339,"15min":1.3009999999999999},"min":{"1min":0.41099999999999998,"5min":0.30499999999999999,"15min":0.29899999999999999},"max":{"1min":0.748,"5min":15.704000000000001,"15min":15.704000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":1.468,"15min":1.3899999999999999},"min":{"1min":0.38800000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78900000000000003,"5min":11.465,"15min":12.635},"last":0.442}]},{"osd":6,"last update":"Mon Feb 19 21:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":1.54,"15min":1.5089999999999999},"min":{"1min":0.41799999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.95799999999999996,"5min":15.779,"15min":22.759},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.622,"5min":1.5229999999999999,"15min":1.46},"min":{"1min":0.44,"5min":0.308,"15min":0.29099999999999998},"max":{"1min":0.879,"5min":9.1419999999999995,"15min":22.608000000000001},"last":0.54500000000000004}]},{"osd":7,"last update":"Mon Feb 19 21:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":1.5349999999999999,"15min":1.5549999999999999},"min":{"1min":0.437,"5min":0.35899999999999999,"15min":0.28599999999999998},"max":{"1min":0.86799999999999999,"5min":10.286,"15min":12.494},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":1.46,"15min":1.3720000000000001},"min":{"1min":0.44,"5min":0.38300000000000001,"15min":0.34599999999999997},"max":{"1min":0.98399999999999999,"5min":15.749000000000001,"15min":15.749000000000001},"last":0.53300000000000003}]}]},{"osd":4,"up_from":32,"seq":137438953825,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":897352,"kb_used_data":5504,"kb_used_omap":0,"kb_used_meta":891840,"kb_avail":92847800,"statfs":{"total":95995035648,"available":95076147200,"internally_reserved":0,"allocated":5636096,"data_stored":3673508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":913244160},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 22:00:02 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.57299999999999995,"15min":0.56499999999999995},"min":{"1min":0.48499999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.47199999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.64300000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:59:46 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":1.851,"15min":2.4260000000000002},"min":{"1min":0.38600000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.85399999999999998,"5min":10.233000000000001,"15min":156.72999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":1.7290000000000001,"15min":2.302},"min":{"1min":0.32400000000000001,"5min":0.28299999999999997,"15min":0.252},"max":{"1min":0.75600000000000001,"5min":10.217000000000001,"15min":156.83000000000001},"last":0.65400000000000003}]},{"osd":2,"last update":"Mon Feb 19 21:59:25 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":1.6970000000000001,"15min":1.7809999999999999},"min":{"1min":0.34100000000000003,"5min":0.28999999999999998,"15min":0.255},"max":{"1min":0.89300000000000002,"5min":9.7690000000000001,"15min":12.516999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":1.7270000000000001,"15min":1.8169999999999999},"min":{"1min":0.38800000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.79500000000000004,"5min":9.7850000000000001,"15min":12.541},"last":0.68200000000000005}]},{"osd":3,"last update":"Mon Feb 19 21:59:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":1.109,"15min":1.2669999999999999},"min":{"1min":0.39200000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.871,"5min":9.1850000000000005,"15min":9.9529999999999994},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":1.5860000000000001,"15min":1.526},"min":{"1min":0.443,"5min":0.253,"15min":0.253},"max":{"1min":0.67700000000000005,"5min":9.8070000000000004,"15min":12.486000000000001},"last":0.70799999999999996}]},{"osd":5,"last update":"Mon Feb 19 21:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":1.542,"15min":1.7929999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.23400000000000001},"max":{"1min":0.63100000000000001,"5min":10.278,"15min":16.731999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":1.4179999999999999,"15min":1.663},"min":{"1min":0.35899999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.71099999999999997,"5min":9.2989999999999995,"15min":14.532999999999999},"last":0.50600000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:59:46 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":1.331,"15min":1.5669999999999999},"min":{"1min":0.34799999999999998,"5min":0.27600000000000002,"15min":0.27200000000000002},"max":{"1min":0.70999999999999996,"5min":9.3409999999999993,"15min":10.233000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":2.0419999999999998,"15min":1.978},"min":{"1min":0.38500000000000001,"5min":0.29799999999999999,"15min":0.23699999999999999},"max":{"1min":0.746,"5min":12.85,"15min":18.670000000000002},"last":0.52600000000000002}]},{"osd":7,"last update":"Mon Feb 19 21:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":1.5609999999999999,"15min":1.7869999999999999},"min":{"1min":0.41299999999999998,"5min":0.32100000000000001,"15min":0.30199999999999999},"max":{"1min":1.0960000000000001,"5min":10.250999999999999,"15min":16.763999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.64800000000000002,"5min":1.419,"15min":1.4870000000000001},"min":{"1min":0.45700000000000002,"5min":0.218,"15min":0.218},"max":{"1min":1.2050000000000001,"5min":9.3659999999999997,"15min":12.958},"last":0.55000000000000004}]}]},{"osd":5,"up_from":38,"seq":163208757597,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":887736,"kb_used_data":5488,"kb_used_omap":0,"kb_used_meta":882240,"kb_avail":92857416,"statfs":{"total":95995035648,"available":95085993984,"internally_reserved":0,"allocated":5619712,"data_stored":3673411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":903413760},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 22:00:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65000000000000002,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.60599999999999998,"15min":0.60299999999999998},"min":{"1min":0.56599999999999995,"5min":0.441,"15min":0.441},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.66700000000000004}]},{"osd":1,"last update":"Mon Feb 19 21:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":1.2569999999999999,"15min":1.3560000000000001},"min":{"1min":0.41099999999999998,"5min":0.23599999999999999,"15min":0.23100000000000001},"max":{"1min":0.72599999999999998,"5min":9.7560000000000002,"15min":9.7560000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":1.5680000000000001,"15min":1.512},"min":{"1min":0.39800000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.65800000000000003,"5min":7.1449999999999996,"15min":11.654},"last":0.58599999999999997}]},{"osd":2,"last update":"Mon Feb 19 21:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":2.0960000000000001,"15min":1.7470000000000001},"min":{"1min":0.46500000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.67200000000000004,"5min":79.257000000000005,"15min":79.257000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":2.742,"15min":1.867},"min":{"1min":0.42799999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.75,"5min":79.030000000000001,"15min":79.030000000000001},"last":0.68700000000000006}]},{"osd":3,"last update":"Mon Feb 19 21:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":1.5129999999999999,"15min":1.6679999999999999},"min":{"1min":0.38500000000000001,"5min":0.26200000000000001,"15min":0.26100000000000001},"max":{"1min":0.68999999999999995,"5min":10.743,"15min":19.321000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":1.4550000000000001,"15min":1.5289999999999999},"min":{"1min":0.39300000000000002,"5min":0.318,"15min":0.311},"max":{"1min":0.79500000000000004,"5min":7.5780000000000003,"15min":9.0269999999999992},"last":0.70599999999999996}]},{"osd":4,"last update":"Mon Feb 19 21:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":1.476,"15min":1.5009999999999999},"min":{"1min":0.33300000000000002,"5min":0.224,"15min":0.20899999999999999},"max":{"1min":0.97899999999999998,"5min":16.748000000000001,"15min":16.748000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":1.5920000000000001,"15min":1.7290000000000001},"min":{"1min":0.36399999999999999,"5min":0.26800000000000002,"15min":0.23899999999999999},"max":{"1min":0.80800000000000005,"5min":12.691000000000001,"15min":19.274000000000001},"last":0.45200000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:59:48 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":1.6379999999999999,"15min":1.9279999999999999},"min":{"1min":0.34899999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.91400000000000003,"5min":10.779,"15min":19.884},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":1.5189999999999999,"15min":1.6419999999999999},"min":{"1min":0.36399999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.84399999999999997,"5min":12.428000000000001,"15min":12.428000000000001},"last":0.61699999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:59:13 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":1.2909999999999999,"15min":1.671},"min":{"1min":0.377,"5min":0.29899999999999999,"15min":0.27100000000000002},"max":{"1min":0.95899999999999996,"5min":7.5300000000000002,"15min":12.611000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":1.5569999999999999,"15min":1.7569999999999999},"min":{"1min":0.443,"5min":0.29299999999999998,"15min":0.221},"max":{"1min":0.89200000000000002,"5min":10.324,"15min":15.593999999999999},"last":0.63}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T22:00:13.235 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T22:00:13.503 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T22:00:14.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:12.349861+0000 osd.7 (osd.7) 391 : cluster [DBG] 5.10 scrub starts 2024-02-19T22:00:14.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:12.352756+0000 osd.7 (osd.7) 392 : cluster [DBG] 5.10 scrub ok 2024-02-19T22:00:14.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T22:00:12.438483+0000 mgr.y (mgr.14514) 1049 : audit [DBG] from='client.16482 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T22:00:14.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:12.732930+0000 osd.1 (osd.1) 366 : cluster [DBG] 5.12 scrub starts 2024-02-19T22:00:14.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:12.733844+0000 osd.1 (osd.1) 367 : cluster [DBG] 5.12 scrub ok 2024-02-19T22:00:14.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:12.349861+0000 osd.7 (osd.7) 391 : cluster [DBG] 5.10 scrub starts 2024-02-19T22:00:14.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:12.352756+0000 osd.7 (osd.7) 392 : cluster [DBG] 5.10 scrub ok 2024-02-19T22:00:14.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T22:00:12.438483+0000 mgr.y (mgr.14514) 1049 : audit [DBG] from='client.16482 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T22:00:14.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:12.732930+0000 osd.1 (osd.1) 366 : cluster [DBG] 5.12 scrub starts 2024-02-19T22:00:14.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:12.733844+0000 osd.1 (osd.1) 367 : cluster [DBG] 5.12 scrub ok 2024-02-19T22:00:14.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:12.349861+0000 osd.7 (osd.7) 391 : cluster [DBG] 5.10 scrub starts 2024-02-19T22:00:14.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:12.352756+0000 osd.7 (osd.7) 392 : cluster [DBG] 5.10 scrub ok 2024-02-19T22:00:14.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T22:00:12.438483+0000 mgr.y (mgr.14514) 1049 : audit [DBG] from='client.16482 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T22:00:14.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:12.732930+0000 osd.1 (osd.1) 366 : cluster [DBG] 5.12 scrub starts 2024-02-19T22:00:14.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:13 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:12.733844+0000 osd.1 (osd.1) 367 : cluster [DBG] 5.12 scrub ok 2024-02-19T22:00:14.732 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:12.935249+0000 osd.6 (osd.6) 355 : cluster [DBG] 4.5 scrub starts 2024-02-19T22:00:14.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:12.939029+0000 osd.6 (osd.6) 356 : cluster [DBG] 4.5 scrub ok 2024-02-19T22:00:14.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:13.373005+0000 mgr.y (mgr.14514) 1050 : cluster [DBG] pgmap v1365: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T22:00:14.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:13.716711+0000 osd.1 (osd.1) 368 : cluster [DBG] 2.d scrub starts 2024-02-19T22:00:14.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:13.717604+0000 osd.1 (osd.1) 369 : cluster [DBG] 2.d scrub ok 2024-02-19T22:00:14.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:14.108087+0000 osd.0 (osd.0) 65 : cluster [DBG] 4.1e scrub starts 2024-02-19T22:00:14.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:14.110113+0000 osd.0 (osd.0) 66 : cluster [DBG] 4.1e scrub ok 2024-02-19T22:00:14.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:14.375957+0000 osd.5 (osd.5) 406 : cluster [DBG] 4.8 scrub starts 2024-02-19T22:00:14.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:14.379616+0000 osd.5 (osd.5) 407 : cluster [DBG] 4.8 scrub ok 2024-02-19T22:00:14.733 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:12.935249+0000 osd.6 (osd.6) 355 : cluster [DBG] 4.5 scrub starts 2024-02-19T22:00:14.733 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:12.939029+0000 osd.6 (osd.6) 356 : cluster [DBG] 4.5 scrub ok 2024-02-19T22:00:14.734 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:13.373005+0000 mgr.y (mgr.14514) 1050 : cluster [DBG] pgmap v1365: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T22:00:14.734 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:13.716711+0000 osd.1 (osd.1) 368 : cluster [DBG] 2.d scrub starts 2024-02-19T22:00:14.734 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:13.717604+0000 osd.1 (osd.1) 369 : cluster [DBG] 2.d scrub ok 2024-02-19T22:00:14.734 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:14.108087+0000 osd.0 (osd.0) 65 : cluster [DBG] 4.1e scrub starts 2024-02-19T22:00:14.734 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:14.110113+0000 osd.0 (osd.0) 66 : cluster [DBG] 4.1e scrub ok 2024-02-19T22:00:14.734 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:14.375957+0000 osd.5 (osd.5) 406 : cluster [DBG] 4.8 scrub starts 2024-02-19T22:00:14.734 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:14 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:14.379616+0000 osd.5 (osd.5) 407 : cluster [DBG] 4.8 scrub ok 2024-02-19T22:00:15.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:12.935249+0000 osd.6 (osd.6) 355 : cluster [DBG] 4.5 scrub starts 2024-02-19T22:00:15.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:12.939029+0000 osd.6 (osd.6) 356 : cluster [DBG] 4.5 scrub ok 2024-02-19T22:00:15.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:13.373005+0000 mgr.y (mgr.14514) 1050 : cluster [DBG] pgmap v1365: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T22:00:15.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:13.716711+0000 osd.1 (osd.1) 368 : cluster [DBG] 2.d scrub starts 2024-02-19T22:00:15.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:13.717604+0000 osd.1 (osd.1) 369 : cluster [DBG] 2.d scrub ok 2024-02-19T22:00:15.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:14.108087+0000 osd.0 (osd.0) 65 : cluster [DBG] 4.1e scrub starts 2024-02-19T22:00:15.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:14.110113+0000 osd.0 (osd.0) 66 : cluster [DBG] 4.1e scrub ok 2024-02-19T22:00:15.056 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:14.375957+0000 osd.5 (osd.5) 406 : cluster [DBG] 4.8 scrub starts 2024-02-19T22:00:15.057 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:14.379616+0000 osd.5 (osd.5) 407 : cluster [DBG] 4.8 scrub ok 2024-02-19T22:00:15.450 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-19T22:00:15.452 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-19T22:00:16.056 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 22:00:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x[41064]: ::ffff:172.21.15.157 - - [19/Feb/2024:22:00:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-19T22:00:16.252 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":1366,"stamp":"2024-02-19T22:00:15.373180+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5796,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":3188,"num_read_kb":2940,"num_write":997,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":382,"num_bytes_recovered":9153,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1169,"ondisk_log_size":1169,"up":366,"acting":366,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":366,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":5487216,"kb_used_data":44080,"kb_used_omap":1,"kb_used_meta":5443070,"kb_avail":744474000,"statfs":{"total":767960285184,"available":762341376000,"internally_reserved":0,"allocated":45137920,"data_stored":29416789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1944,"internal_metadata":5573703784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001928"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":50,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:02.036163+0000","last_change":"2024-02-19T22:00:02.036131+0000","last_active":"2024-02-19T22:00:02.036163+0000","last_peered":"2024-02-19T22:00:02.036163+0000","last_clean":"2024-02-19T22:00:02.036163+0000","last_became_active":"2024-02-19T21:58:25.591460+0000","last_became_peered":"2024-02-19T21:58:25.591460+0000","last_unstale":"2024-02-19T22:00:02.036163+0000","last_undegraded":"2024-02-19T22:00:02.036163+0000","last_fullsized":"2024-02-19T22:00:02.036163+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T22:00:02.036033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T22:00:02.036033+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":584,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.756915+0000","last_change":"2024-02-19T21:59:14.629596+0000","last_active":"2024-02-19T22:00:08.756915+0000","last_peered":"2024-02-19T22:00:08.756915+0000","last_clean":"2024-02-19T22:00:08.756915+0000","last_became_active":"2024-02-19T21:57:58.567529+0000","last_became_peered":"2024-02-19T21:57:58.567529+0000","last_unstale":"2024-02-19T22:00:08.756915+0000","last_undegraded":"2024-02-19T22:00:08.756915+0000","last_fullsized":"2024-02-19T22:00:08.756915+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:14.629489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:59:14.629489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"471'39","reported_seq":61,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.526911+0000","last_change":"2024-02-19T21:59:32.852338+0000","last_active":"2024-02-19T21:59:50.526911+0000","last_peered":"2024-02-19T21:59:50.526911+0000","last_clean":"2024-02-19T21:59:50.526911+0000","last_became_active":"2024-02-19T21:58:25.593642+0000","last_became_peered":"2024-02-19T21:58:25.593642+0000","last_unstale":"2024-02-19T21:59:50.526911+0000","last_undegraded":"2024-02-19T21:59:50.526911+0000","last_fullsized":"2024-02-19T21:59:50.526911+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":581,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'39","last_scrub_stamp":"2024-02-19T21:59:32.852266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:59:32.852266+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":60,"num_read_kb":51,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":578,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.525475+0000","last_change":"2024-02-19T21:59:34.530960+0000","last_active":"2024-02-19T21:59:50.525475+0000","last_peered":"2024-02-19T21:59:50.525475+0000","last_clean":"2024-02-19T21:59:50.525475+0000","last_became_active":"2024-02-19T21:47:46.250178+0000","last_became_peered":"2024-02-19T21:47:46.250178+0000","last_unstale":"2024-02-19T21:59:50.525475+0000","last_undegraded":"2024-02-19T21:59:50.525475+0000","last_fullsized":"2024-02-19T21:59:50.525475+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:34.530863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:59:34.530863+0000","last_clean_scrub_stamp":"2024-02-19T21:59:34.530863+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":166,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.527489+0000","last_change":"2024-02-19T21:59:46.925343+0000","last_active":"2024-02-19T21:59:50.527489+0000","last_peered":"2024-02-19T21:59:50.527489+0000","last_clean":"2024-02-19T21:59:50.527489+0000","last_became_active":"2024-02-19T21:57:58.571888+0000","last_became_peered":"2024-02-19T21:57:58.571888+0000","last_unstale":"2024-02-19T21:59:50.527489+0000","last_undegraded":"2024-02-19T21:59:50.527489+0000","last_fullsized":"2024-02-19T21:59:50.527489+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:46.925283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.668438+0000","last_clean_scrub_stamp":"2024-02-19T21:59:46.925283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"470'25","reported_seq":683,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:01.366458+0000","last_change":"2024-02-19T22:00:01.366423+0000","last_active":"2024-02-19T22:00:01.366458+0000","last_peered":"2024-02-19T22:00:01.366458+0000","last_clean":"2024-02-19T22:00:01.366458+0000","last_became_active":"2024-02-19T21:32:25.361612+0000","last_became_peered":"2024-02-19T21:32:25.361612+0000","last_unstale":"2024-02-19T22:00:01.366458+0000","last_undegraded":"2024-02-19T22:00:01.366458+0000","last_fullsized":"2024-02-19T22:00:01.366458+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'25","last_scrub_stamp":"2024-02-19T22:00:01.366342+0000","last_deep_scrub":"92'13","last_deep_scrub_stamp":"2024-02-19T21:34:49.331650+0000","last_clean_scrub_stamp":"2024-02-19T22:00:01.366342+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":374,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.471327+0000","last_change":"2024-02-19T21:59:47.663137+0000","last_active":"2024-02-19T21:59:51.471327+0000","last_peered":"2024-02-19T21:59:51.471327+0000","last_clean":"2024-02-19T21:59:51.471327+0000","last_became_active":"2024-02-19T21:58:25.594482+0000","last_became_peered":"2024-02-19T21:58:25.594482+0000","last_unstale":"2024-02-19T21:59:51.471327+0000","last_undegraded":"2024-02-19T21:59:51.471327+0000","last_fullsized":"2024-02-19T21:59:51.471327+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:47.663036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:59:47.663036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":629,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.691821+0000","last_change":"2024-02-19T21:59:28.481069+0000","last_active":"2024-02-19T22:00:08.691821+0000","last_peered":"2024-02-19T22:00:08.691821+0000","last_clean":"2024-02-19T22:00:08.691821+0000","last_became_active":"2024-02-19T21:57:58.569220+0000","last_became_peered":"2024-02-19T21:57:58.569220+0000","last_unstale":"2024-02-19T22:00:08.691821+0000","last_undegraded":"2024-02-19T22:00:08.691821+0000","last_fullsized":"2024-02-19T22:00:08.691821+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:28.480989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:48:28.326938+0000","last_clean_scrub_stamp":"2024-02-19T21:59:28.480989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"470'11","reported_seq":656,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.525794+0000","last_change":"2024-02-19T21:59:37.407999+0000","last_active":"2024-02-19T21:59:50.525794+0000","last_peered":"2024-02-19T21:59:50.525794+0000","last_clean":"2024-02-19T21:59:50.525794+0000","last_became_active":"2024-02-19T21:53:45.385837+0000","last_became_peered":"2024-02-19T21:53:45.385837+0000","last_unstale":"2024-02-19T21:59:50.525794+0000","last_undegraded":"2024-02-19T21:59:50.525794+0000","last_fullsized":"2024-02-19T21:59:50.525794+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'11","last_scrub_stamp":"2024-02-19T21:59:37.407901+0000","last_deep_scrub":"310'9","last_deep_scrub_stamp":"2024-02-19T21:45:20.506188+0000","last_clean_scrub_stamp":"2024-02-19T21:59:37.407901+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"587'2","reported_seq":514,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.756510+0000","last_change":"2024-02-19T21:58:39.634715+0000","last_active":"2024-02-19T22:00:08.756510+0000","last_peered":"2024-02-19T22:00:08.756510+0000","last_clean":"2024-02-19T22:00:08.756510+0000","last_became_active":"2024-02-19T21:57:58.572215+0000","last_became_peered":"2024-02-19T21:57:58.572215+0000","last_unstale":"2024-02-19T22:00:08.756510+0000","last_undegraded":"2024-02-19T22:00:08.756510+0000","last_fullsized":"2024-02-19T22:00:08.756510+0000","mapping_epoch":568,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":5,"last_scrub":"587'2","last_scrub_stamp":"2024-02-19T21:58:39.634650+0000","last_deep_scrub":"587'2","last_deep_scrub_stamp":"2024-02-19T21:58:39.634650+0000","last_clean_scrub_stamp":"2024-02-19T21:58:39.634650+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":641,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.691925+0000","last_change":"2024-02-19T21:59:58.466817+0000","last_active":"2024-02-19T22:00:08.691925+0000","last_peered":"2024-02-19T22:00:08.691925+0000","last_clean":"2024-02-19T22:00:08.691925+0000","last_became_active":"2024-02-19T21:49:08.329998+0000","last_became_peered":"2024-02-19T21:49:08.329998+0000","last_unstale":"2024-02-19T22:00:08.691925+0000","last_undegraded":"2024-02-19T22:00:08.691925+0000","last_fullsized":"2024-02-19T22:00:08.691925+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:58.466718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:59:58.466718+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"470'25","reported_seq":527,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.525577+0000","last_change":"2024-02-19T21:59:22.435554+0000","last_active":"2024-02-19T21:59:50.525577+0000","last_peered":"2024-02-19T21:59:50.525577+0000","last_clean":"2024-02-19T21:59:50.525577+0000","last_became_active":"2024-02-19T21:57:58.567361+0000","last_became_peered":"2024-02-19T21:57:58.567361+0000","last_unstale":"2024-02-19T21:59:50.525577+0000","last_undegraded":"2024-02-19T21:59:50.525577+0000","last_fullsized":"2024-02-19T21:59:50.525577+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'25","last_scrub_stamp":"2024-02-19T21:59:22.435463+0000","last_deep_scrub":"470'25","last_deep_scrub_stamp":"2024-02-19T21:54:07.275895+0000","last_clean_scrub_stamp":"2024-02-19T21:59:22.435463+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":148,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.527677+0000","last_change":"2024-02-19T21:59:02.120212+0000","last_active":"2024-02-19T21:59:50.527677+0000","last_peered":"2024-02-19T21:59:50.527677+0000","last_clean":"2024-02-19T21:59:50.527677+0000","last_became_active":"2024-02-19T21:53:45.369808+0000","last_became_peered":"2024-02-19T21:53:45.369808+0000","last_unstale":"2024-02-19T21:59:50.527677+0000","last_undegraded":"2024-02-19T21:59:50.527677+0000","last_fullsized":"2024-02-19T21:59:50.527677+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:02.120070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:59:02.120070+0000","last_clean_scrub_stamp":"2024-02-19T21:59:02.120070+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":50,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:00.937568+0000","last_change":"2024-02-19T22:00:00.937530+0000","last_active":"2024-02-19T22:00:00.937568+0000","last_peered":"2024-02-19T22:00:00.937568+0000","last_clean":"2024-02-19T22:00:00.937568+0000","last_became_active":"2024-02-19T21:58:25.591374+0000","last_became_peered":"2024-02-19T21:58:25.591374+0000","last_unstale":"2024-02-19T22:00:00.937568+0000","last_undegraded":"2024-02-19T22:00:00.937568+0000","last_fullsized":"2024-02-19T22:00:00.937568+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T22:00:00.937433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T22:00:00.937433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"471'24","reported_seq":57,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.527175+0000","last_change":"2024-02-19T21:58:50.978948+0000","last_active":"2024-02-19T21:59:50.527175+0000","last_peered":"2024-02-19T21:59:50.527175+0000","last_clean":"2024-02-19T21:59:50.527175+0000","last_became_active":"2024-02-19T21:58:25.590719+0000","last_became_peered":"2024-02-19T21:58:25.590719+0000","last_unstale":"2024-02-19T21:59:50.527175+0000","last_undegraded":"2024-02-19T21:59:50.527175+0000","last_fullsized":"2024-02-19T21:59:50.527175+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'24","last_scrub_stamp":"2024-02-19T21:58:50.978880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:58:50.978880+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":33,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4],"acting":[3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":606,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.525981+0000","last_change":"2024-02-19T21:59:03.528550+0000","last_active":"2024-02-19T21:59:50.525981+0000","last_peered":"2024-02-19T21:59:50.525981+0000","last_clean":"2024-02-19T21:59:50.525981+0000","last_became_active":"2024-02-19T21:44:58.788307+0000","last_became_peered":"2024-02-19T21:44:58.788307+0000","last_unstale":"2024-02-19T21:59:50.525981+0000","last_undegraded":"2024-02-19T21:59:50.525981+0000","last_fullsized":"2024-02-19T21:59:50.525981+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:03.528453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:59:03.528453+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":609,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.458060+0000","last_change":"2024-02-19T21:59:11.002738+0000","last_active":"2024-02-19T21:59:51.458060+0000","last_peered":"2024-02-19T21:59:51.458060+0000","last_clean":"2024-02-19T21:59:51.458060+0000","last_became_active":"2024-02-19T21:32:23.360322+0000","last_became_peered":"2024-02-19T21:32:23.360322+0000","last_unstale":"2024-02-19T21:59:51.458060+0000","last_undegraded":"2024-02-19T21:59:51.458060+0000","last_fullsized":"2024-02-19T21:59:51.458060+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:11.002637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:17.913620+0000","last_clean_scrub_stamp":"2024-02-19T21:59:11.002637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"470'46","reported_seq":334,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.692256+0000","last_change":"2024-02-19T21:59:39.187599+0000","last_active":"2024-02-19T22:00:08.692256+0000","last_peered":"2024-02-19T22:00:08.692256+0000","last_clean":"2024-02-19T22:00:08.692256+0000","last_became_active":"2024-02-19T21:58:25.596602+0000","last_became_peered":"2024-02-19T21:58:25.596602+0000","last_unstale":"2024-02-19T22:00:08.692256+0000","last_undegraded":"2024-02-19T22:00:08.692256+0000","last_fullsized":"2024-02-19T22:00:08.692256+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'46","last_scrub_stamp":"2024-02-19T21:59:39.187531+0000","last_deep_scrub":"470'46","last_deep_scrub_stamp":"2024-02-19T21:58:02.683336+0000","last_clean_scrub_stamp":"2024-02-19T21:59:39.187531+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":631,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.839843+0000","last_change":"2024-02-19T21:59:25.912383+0000","last_active":"2024-02-19T21:59:50.839843+0000","last_peered":"2024-02-19T21:59:50.839843+0000","last_clean":"2024-02-19T21:59:50.839843+0000","last_became_active":"2024-02-19T21:44:58.790669+0000","last_became_peered":"2024-02-19T21:44:58.790669+0000","last_unstale":"2024-02-19T21:59:50.839843+0000","last_undegraded":"2024-02-19T21:59:50.839843+0000","last_fullsized":"2024-02-19T21:59:50.839843+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:25.912300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:44.994296+0000","last_clean_scrub_stamp":"2024-02-19T21:59:25.912300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":45,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.526753+0000","last_change":"2024-02-19T21:59:25.854301+0000","last_active":"2024-02-19T21:59:50.526753+0000","last_peered":"2024-02-19T21:59:50.526753+0000","last_clean":"2024-02-19T21:59:50.526753+0000","last_became_active":"2024-02-19T21:58:25.593161+0000","last_became_peered":"2024-02-19T21:58:25.593161+0000","last_unstale":"2024-02-19T21:59:50.526753+0000","last_undegraded":"2024-02-19T21:59:50.526753+0000","last_fullsized":"2024-02-19T21:59:50.526753+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:25.854230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:59:25.854230+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"471'27","reported_seq":475,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.756755+0000","last_change":"2024-02-19T21:59:41.454237+0000","last_active":"2024-02-19T22:00:08.756755+0000","last_peered":"2024-02-19T22:00:08.756755+0000","last_clean":"2024-02-19T22:00:08.756755+0000","last_became_active":"2024-02-19T21:57:58.573690+0000","last_became_peered":"2024-02-19T21:57:58.573690+0000","last_unstale":"2024-02-19T22:00:08.756755+0000","last_undegraded":"2024-02-19T22:00:08.756755+0000","last_fullsized":"2024-02-19T22:00:08.756755+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'27","last_scrub_stamp":"2024-02-19T21:59:41.454154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:59:41.454154+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":487,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.691846+0000","last_change":"2024-02-19T21:59:29.474237+0000","last_active":"2024-02-19T22:00:08.691846+0000","last_peered":"2024-02-19T22:00:08.691846+0000","last_clean":"2024-02-19T22:00:08.691846+0000","last_became_active":"2024-02-19T21:51:22.461599+0000","last_became_peered":"2024-02-19T21:51:22.461599+0000","last_unstale":"2024-02-19T22:00:08.691846+0000","last_undegraded":"2024-02-19T22:00:08.691846+0000","last_fullsized":"2024-02-19T22:00:08.691846+0000","mapping_epoch":445,"log_start":"66'1","ondisk_log_start":"66'1","created":302,"last_epoch_clean":446,"parent":"0.0","parent_split_bits":5,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:59:29.474144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T21:59:29.474144+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":624,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.471279+0000","last_change":"2024-02-19T21:59:44.572800+0000","last_active":"2024-02-19T21:59:51.471279+0000","last_peered":"2024-02-19T21:59:51.471279+0000","last_clean":"2024-02-19T21:59:51.471279+0000","last_became_active":"2024-02-19T21:49:54.491488+0000","last_became_peered":"2024-02-19T21:49:54.491488+0000","last_unstale":"2024-02-19T21:59:51.471279+0000","last_undegraded":"2024-02-19T21:59:51.471279+0000","last_fullsized":"2024-02-19T21:59:51.471279+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:44.572671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:08.666908+0000","last_clean_scrub_stamp":"2024-02-19T21:59:44.572671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"578'35","reported_seq":701,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.757037+0000","last_change":"2024-02-19T21:58:25.624334+0000","last_active":"2024-02-19T22:00:08.757037+0000","last_peered":"2024-02-19T22:00:08.757037+0000","last_clean":"2024-02-19T22:00:08.757037+0000","last_became_active":"2024-02-19T21:58:25.599420+0000","last_became_peered":"2024-02-19T21:58:25.599420+0000","last_unstale":"2024-02-19T22:00:08.757037+0000","last_undegraded":"2024-02-19T22:00:08.757037+0000","last_fullsized":"2024-02-19T22:00:08.757037+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"578'35","last_scrub_stamp":"2024-02-19T21:58:23.585847+0000","last_deep_scrub":"578'35","last_deep_scrub_stamp":"2024-02-19T21:58:23.585847+0000","last_clean_scrub_stamp":"2024-02-19T21:58:23.585847+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":45,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.527054+0000","last_change":"2024-02-19T21:59:39.962179+0000","last_active":"2024-02-19T21:59:50.527054+0000","last_peered":"2024-02-19T21:59:50.527054+0000","last_clean":"2024-02-19T21:59:50.527054+0000","last_became_active":"2024-02-19T21:58:25.592090+0000","last_became_peered":"2024-02-19T21:58:25.592090+0000","last_unstale":"2024-02-19T21:59:50.527054+0000","last_undegraded":"2024-02-19T21:59:50.527054+0000","last_fullsized":"2024-02-19T21:59:50.527054+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:39.962081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:16.590436+0000","last_clean_scrub_stamp":"2024-02-19T21:59:39.962081+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":608,"reported_epoch":612,"state":"active+clean","last_fresh":"2024-02-19T22:00:12.352828+0000","last_change":"2024-02-19T22:00:12.352828+0000","last_active":"2024-02-19T22:00:12.352828+0000","last_peered":"2024-02-19T22:00:12.352828+0000","last_clean":"2024-02-19T22:00:12.352828+0000","last_became_active":"2024-02-19T21:32:27.367932+0000","last_became_peered":"2024-02-19T21:32:27.367932+0000","last_unstale":"2024-02-19T22:00:12.352828+0000","last_undegraded":"2024-02-19T22:00:12.352828+0000","last_fullsized":"2024-02-19T22:00:12.352828+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T22:00:12.352760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:03.457856+0000","last_clean_scrub_stamp":"2024-02-19T22:00:12.352760+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":640,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.458433+0000","last_change":"2024-02-19T21:59:35.961105+0000","last_active":"2024-02-19T21:59:51.458433+0000","last_peered":"2024-02-19T21:59:51.458433+0000","last_clean":"2024-02-19T21:59:51.458433+0000","last_became_active":"2024-02-19T21:49:08.330293+0000","last_became_peered":"2024-02-19T21:49:08.330293+0000","last_unstale":"2024-02-19T21:59:51.458433+0000","last_undegraded":"2024-02-19T21:59:51.458433+0000","last_fullsized":"2024-02-19T21:59:51.458433+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:35.960989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:59:35.960989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"471'32","reported_seq":160,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.527133+0000","last_change":"2024-02-19T21:59:05.998938+0000","last_active":"2024-02-19T21:59:50.527133+0000","last_peered":"2024-02-19T21:59:50.527133+0000","last_clean":"2024-02-19T21:59:50.527133+0000","last_became_active":"2024-02-19T21:53:45.367870+0000","last_became_peered":"2024-02-19T21:53:45.367870+0000","last_unstale":"2024-02-19T21:59:50.527133+0000","last_undegraded":"2024-02-19T21:59:50.527133+0000","last_fullsized":"2024-02-19T21:59:50.527133+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'32","last_scrub_stamp":"2024-02-19T21:59:05.998857+0000","last_deep_scrub":"381'24","last_deep_scrub_stamp":"2024-02-19T21:48:39.382725+0000","last_clean_scrub_stamp":"2024-02-19T21:59:05.998857+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":113,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.471343+0000","last_change":"2024-02-19T21:59:41.540876+0000","last_active":"2024-02-19T21:59:51.471343+0000","last_peered":"2024-02-19T21:59:51.471343+0000","last_clean":"2024-02-19T21:59:51.471343+0000","last_became_active":"2024-02-19T21:55:24.057099+0000","last_became_peered":"2024-02-19T21:55:24.057099+0000","last_unstale":"2024-02-19T21:59:51.471343+0000","last_undegraded":"2024-02-19T21:59:51.471343+0000","last_fullsized":"2024-02-19T21:59:51.471343+0000","mapping_epoch":521,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":522,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:41.540795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:34:01.539921+0000","last_clean_scrub_stamp":"2024-02-19T21:59:41.540795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":655,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.457814+0000","last_change":"2024-02-19T21:58:54.958664+0000","last_active":"2024-02-19T21:59:51.457814+0000","last_peered":"2024-02-19T21:59:51.457814+0000","last_clean":"2024-02-19T21:59:51.457814+0000","last_became_active":"2024-02-19T21:49:54.494146+0000","last_became_peered":"2024-02-19T21:49:54.494146+0000","last_unstale":"2024-02-19T21:59:51.457814+0000","last_undegraded":"2024-02-19T21:59:51.457814+0000","last_fullsized":"2024-02-19T21:59:51.457814+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:58:54.958575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:57:51.071020+0000","last_clean_scrub_stamp":"2024-02-19T21:58:54.958575+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":629,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.472066+0000","last_change":"2024-02-19T21:59:08.404563+0000","last_active":"2024-02-19T21:59:51.472066+0000","last_peered":"2024-02-19T21:59:51.472066+0000","last_clean":"2024-02-19T21:59:51.472066+0000","last_became_active":"2024-02-19T21:49:08.331308+0000","last_became_peered":"2024-02-19T21:49:08.331308+0000","last_unstale":"2024-02-19T21:59:51.472066+0000","last_undegraded":"2024-02-19T21:59:51.472066+0000","last_fullsized":"2024-02-19T21:59:51.472066+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:08.404489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:59:08.404489+0000","last_clean_scrub_stamp":"2024-02-19T21:59:08.404489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"470'12","reported_seq":157,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.526804+0000","last_change":"2024-02-19T21:59:41.912698+0000","last_active":"2024-02-19T21:59:50.526804+0000","last_peered":"2024-02-19T21:59:50.526804+0000","last_clean":"2024-02-19T21:59:50.526804+0000","last_became_active":"2024-02-19T21:53:45.368256+0000","last_became_peered":"2024-02-19T21:53:45.368256+0000","last_unstale":"2024-02-19T21:59:50.526804+0000","last_undegraded":"2024-02-19T21:59:50.526804+0000","last_fullsized":"2024-02-19T21:59:50.526804+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'12","last_scrub_stamp":"2024-02-19T21:59:41.912629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:59:41.912629+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":50,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.526864+0000","last_change":"2024-02-19T21:59:43.894606+0000","last_active":"2024-02-19T21:59:50.526864+0000","last_peered":"2024-02-19T21:59:50.526864+0000","last_clean":"2024-02-19T21:59:50.526864+0000","last_became_active":"2024-02-19T21:58:25.592744+0000","last_became_peered":"2024-02-19T21:58:25.592744+0000","last_unstale":"2024-02-19T21:59:50.526864+0000","last_undegraded":"2024-02-19T21:59:50.526864+0000","last_fullsized":"2024-02-19T21:59:50.526864+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:43.894518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:22.516711+0000","last_clean_scrub_stamp":"2024-02-19T21:59:43.894518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":628,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.839857+0000","last_change":"2024-02-19T21:59:03.420212+0000","last_active":"2024-02-19T21:59:50.839857+0000","last_peered":"2024-02-19T21:59:50.839857+0000","last_clean":"2024-02-19T21:59:50.839857+0000","last_became_active":"2024-02-19T21:58:25.592554+0000","last_became_peered":"2024-02-19T21:58:25.592554+0000","last_unstale":"2024-02-19T21:59:50.839857+0000","last_undegraded":"2024-02-19T21:59:50.839857+0000","last_fullsized":"2024-02-19T21:59:50.839857+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:03.420105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:59:03.420105+0000","last_clean_scrub_stamp":"2024-02-19T21:59:03.420105+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":613,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.839996+0000","last_change":"2024-02-19T21:59:24.717263+0000","last_active":"2024-02-19T21:59:50.839996+0000","last_peered":"2024-02-19T21:59:50.839996+0000","last_clean":"2024-02-19T21:59:50.839996+0000","last_became_active":"2024-02-19T21:57:58.571134+0000","last_became_peered":"2024-02-19T21:57:58.571134+0000","last_unstale":"2024-02-19T21:59:50.839996+0000","last_undegraded":"2024-02-19T21:59:50.839996+0000","last_fullsized":"2024-02-19T21:59:50.839996+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:24.717198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:52.933689+0000","last_clean_scrub_stamp":"2024-02-19T21:59:24.717198+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"470'27","reported_seq":666,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:05.479059+0000","last_change":"2024-02-19T22:00:05.479007+0000","last_active":"2024-02-19T22:00:05.479059+0000","last_peered":"2024-02-19T22:00:05.479059+0000","last_clean":"2024-02-19T22:00:05.479059+0000","last_became_active":"2024-02-19T21:32:25.360878+0000","last_became_peered":"2024-02-19T21:32:25.360878+0000","last_unstale":"2024-02-19T22:00:05.479059+0000","last_undegraded":"2024-02-19T22:00:05.479059+0000","last_fullsized":"2024-02-19T22:00:05.479059+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'27","last_scrub_stamp":"2024-02-19T22:00:05.478915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T22:00:05.478915+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":593,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.756878+0000","last_change":"2024-02-19T21:59:04.581362+0000","last_active":"2024-02-19T22:00:08.756878+0000","last_peered":"2024-02-19T22:00:08.756878+0000","last_clean":"2024-02-19T22:00:08.756878+0000","last_became_active":"2024-02-19T21:57:58.571928+0000","last_became_peered":"2024-02-19T21:57:58.571928+0000","last_unstale":"2024-02-19T22:00:08.756878+0000","last_undegraded":"2024-02-19T22:00:08.756878+0000","last_fullsized":"2024-02-19T22:00:08.756878+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:04.581293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:17.964139+0000","last_clean_scrub_stamp":"2024-02-19T21:59:04.581293+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":151,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.527340+0000","last_change":"2024-02-19T21:59:33.835400+0000","last_active":"2024-02-19T21:59:50.527340+0000","last_peered":"2024-02-19T21:59:50.527340+0000","last_clean":"2024-02-19T21:59:50.527340+0000","last_became_active":"2024-02-19T21:53:45.369330+0000","last_became_peered":"2024-02-19T21:53:45.369330+0000","last_unstale":"2024-02-19T21:59:50.527340+0000","last_undegraded":"2024-02-19T21:59:50.527340+0000","last_fullsized":"2024-02-19T21:59:50.527340+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:33.835279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:59:33.835279+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":625,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.458261+0000","last_change":"2024-02-19T21:59:26.136797+0000","last_active":"2024-02-19T21:59:51.458261+0000","last_peered":"2024-02-19T21:59:51.458261+0000","last_clean":"2024-02-19T21:59:51.458261+0000","last_became_active":"2024-02-19T21:53:45.384501+0000","last_became_peered":"2024-02-19T21:53:45.384501+0000","last_unstale":"2024-02-19T21:59:51.458261+0000","last_undegraded":"2024-02-19T21:59:51.458261+0000","last_fullsized":"2024-02-19T21:59:51.458261+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:26.136716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.917584+0000","last_clean_scrub_stamp":"2024-02-19T21:59:26.136716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"470'21","reported_seq":685,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.839705+0000","last_change":"2024-02-19T21:59:10.392973+0000","last_active":"2024-02-19T21:59:50.839705+0000","last_peered":"2024-02-19T21:59:50.839705+0000","last_clean":"2024-02-19T21:59:50.839705+0000","last_became_active":"2024-02-19T21:49:08.333872+0000","last_became_peered":"2024-02-19T21:49:08.333872+0000","last_unstale":"2024-02-19T21:59:50.839705+0000","last_undegraded":"2024-02-19T21:59:50.839705+0000","last_fullsized":"2024-02-19T21:59:50.839705+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'21","last_scrub_stamp":"2024-02-19T21:59:10.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:59:10.392904+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":588,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.526110+0000","last_change":"2024-02-19T21:59:28.649311+0000","last_active":"2024-02-19T21:59:50.526110+0000","last_peered":"2024-02-19T21:59:50.526110+0000","last_clean":"2024-02-19T21:59:50.526110+0000","last_became_active":"2024-02-19T21:49:08.329770+0000","last_became_peered":"2024-02-19T21:49:08.329770+0000","last_unstale":"2024-02-19T21:59:50.526110+0000","last_undegraded":"2024-02-19T21:59:50.526110+0000","last_fullsized":"2024-02-19T21:59:50.526110+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:28.649218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:49.500205+0000","last_clean_scrub_stamp":"2024-02-19T21:59:28.649218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"581'18","reported_seq":70,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:07.194737+0000","last_change":"2024-02-19T21:59:28.863416+0000","last_active":"2024-02-19T22:00:07.194737+0000","last_peered":"2024-02-19T22:00:07.194737+0000","last_clean":"2024-02-19T22:00:07.194737+0000","last_became_active":"2024-02-19T21:58:25.594528+0000","last_became_peered":"2024-02-19T21:58:25.594528+0000","last_unstale":"2024-02-19T22:00:07.194737+0000","last_undegraded":"2024-02-19T22:00:07.194737+0000","last_fullsized":"2024-02-19T22:00:07.194737+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"581'18","last_scrub_stamp":"2024-02-19T21:59:28.863354+0000","last_deep_scrub":"581'18","last_deep_scrub_stamp":"2024-02-19T21:59:28.863354+0000","last_clean_scrub_stamp":"2024-02-19T21:59:28.863354+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":628,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.757084+0000","last_change":"2024-02-19T22:00:08.169255+0000","last_active":"2024-02-19T22:00:08.757084+0000","last_peered":"2024-02-19T22:00:08.757084+0000","last_clean":"2024-02-19T22:00:08.757084+0000","last_became_active":"2024-02-19T21:57:58.571538+0000","last_became_peered":"2024-02-19T21:57:58.571538+0000","last_unstale":"2024-02-19T22:00:08.757084+0000","last_undegraded":"2024-02-19T22:00:08.757084+0000","last_fullsized":"2024-02-19T22:00:08.757084+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T22:00:08.169181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:45:20.157478+0000","last_clean_scrub_stamp":"2024-02-19T22:00:08.169181+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"470'25","reported_seq":680,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:02.389945+0000","last_change":"2024-02-19T22:00:02.389911+0000","last_active":"2024-02-19T22:00:02.389945+0000","last_peered":"2024-02-19T22:00:02.389945+0000","last_clean":"2024-02-19T22:00:02.389945+0000","last_became_active":"2024-02-19T21:53:45.384976+0000","last_became_peered":"2024-02-19T21:53:45.384976+0000","last_unstale":"2024-02-19T22:00:02.389945+0000","last_undegraded":"2024-02-19T22:00:02.389945+0000","last_fullsized":"2024-02-19T22:00:02.389945+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'25","last_scrub_stamp":"2024-02-19T22:00:02.389835+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-02-19T21:40:37.730197+0000","last_clean_scrub_stamp":"2024-02-19T22:00:02.389835+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":341,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.756948+0000","last_change":"2024-02-19T21:59:25.675817+0000","last_active":"2024-02-19T22:00:08.756948+0000","last_peered":"2024-02-19T22:00:08.756948+0000","last_clean":"2024-02-19T22:00:08.756948+0000","last_became_active":"2024-02-19T21:58:25.598914+0000","last_became_peered":"2024-02-19T21:58:25.598914+0000","last_unstale":"2024-02-19T22:00:08.756948+0000","last_undegraded":"2024-02-19T22:00:08.756948+0000","last_fullsized":"2024-02-19T22:00:08.756948+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":302,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:25.675752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:59:25.675752+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"571'11","reported_seq":956,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:07.194602+0000","last_change":"2024-02-19T21:59:18.433698+0000","last_active":"2024-02-19T22:00:07.194602+0000","last_peered":"2024-02-19T22:00:07.194602+0000","last_clean":"2024-02-19T22:00:07.194602+0000","last_became_active":"2024-02-19T21:57:58.569413+0000","last_became_peered":"2024-02-19T21:57:58.569413+0000","last_unstale":"2024-02-19T22:00:07.194602+0000","last_undegraded":"2024-02-19T22:00:07.194602+0000","last_fullsized":"2024-02-19T22:00:07.194602+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"571'11","last_scrub_stamp":"2024-02-19T21:59:18.433582+0000","last_deep_scrub":"181'9","last_deep_scrub_stamp":"2024-02-19T21:40:32.678933+0000","last_clean_scrub_stamp":"2024-02-19T21:59:18.433582+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":639,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.471532+0000","last_change":"2024-02-19T21:59:20.493884+0000","last_active":"2024-02-19T21:59:51.471532+0000","last_peered":"2024-02-19T21:59:51.471532+0000","last_clean":"2024-02-19T21:59:51.471532+0000","last_became_active":"2024-02-19T21:53:45.384012+0000","last_became_peered":"2024-02-19T21:53:45.384012+0000","last_unstale":"2024-02-19T21:59:51.471532+0000","last_undegraded":"2024-02-19T21:59:51.471532+0000","last_fullsized":"2024-02-19T21:59:51.471532+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:20.493799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:55:12.286582+0000","last_clean_scrub_stamp":"2024-02-19T21:59:20.493799+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"470'35","reported_seq":158,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.527581+0000","last_change":"2024-02-19T21:58:54.976976+0000","last_active":"2024-02-19T21:59:50.527581+0000","last_peered":"2024-02-19T21:59:50.527581+0000","last_clean":"2024-02-19T21:59:50.527581+0000","last_became_active":"2024-02-19T21:53:45.367708+0000","last_became_peered":"2024-02-19T21:53:45.367708+0000","last_unstale":"2024-02-19T21:59:50.527581+0000","last_undegraded":"2024-02-19T21:59:50.527581+0000","last_fullsized":"2024-02-19T21:59:50.527581+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'35","last_scrub_stamp":"2024-02-19T21:58:54.976909+0000","last_deep_scrub":"182'15","last_deep_scrub_stamp":"2024-02-19T21:40:39.591994+0000","last_clean_scrub_stamp":"2024-02-19T21:58:54.976909+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":601,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.691836+0000","last_change":"2024-02-19T21:58:59.594173+0000","last_active":"2024-02-19T22:00:08.691836+0000","last_peered":"2024-02-19T22:00:08.691836+0000","last_clean":"2024-02-19T22:00:08.691836+0000","last_became_active":"2024-02-19T21:32:29.599276+0000","last_became_peered":"2024-02-19T21:32:29.599276+0000","last_unstale":"2024-02-19T22:00:08.691836+0000","last_undegraded":"2024-02-19T22:00:08.691836+0000","last_fullsized":"2024-02-19T22:00:08.691836+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:58:59.594081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:11.667872+0000","last_clean_scrub_stamp":"2024-02-19T21:58:59.594081+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":611,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.457818+0000","last_change":"2024-02-19T21:59:35.005506+0000","last_active":"2024-02-19T21:59:51.457818+0000","last_peered":"2024-02-19T21:59:51.457818+0000","last_clean":"2024-02-19T21:59:51.457818+0000","last_became_active":"2024-02-19T21:32:23.357886+0000","last_became_peered":"2024-02-19T21:32:23.357886+0000","last_unstale":"2024-02-19T21:59:51.457818+0000","last_undegraded":"2024-02-19T21:59:51.457818+0000","last_fullsized":"2024-02-19T21:59:51.457818+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:35.005433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:59:35.005433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"470'18","reported_seq":53,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.527482+0000","last_change":"2024-02-19T21:59:04.046943+0000","last_active":"2024-02-19T21:59:50.527482+0000","last_peered":"2024-02-19T21:59:50.527482+0000","last_clean":"2024-02-19T21:59:50.527482+0000","last_became_active":"2024-02-19T21:58:25.591403+0000","last_became_peered":"2024-02-19T21:58:25.591403+0000","last_unstale":"2024-02-19T21:59:50.527482+0000","last_undegraded":"2024-02-19T21:59:50.527482+0000","last_fullsized":"2024-02-19T21:59:50.527482+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'18","last_scrub_stamp":"2024-02-19T21:59:04.046874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:59:04.046874+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":22,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":264,"reported_epoch":612,"state":"active+clean","last_fresh":"2024-02-19T22:00:11.861156+0000","last_change":"2024-02-19T22:00:11.861156+0000","last_active":"2024-02-19T22:00:11.861156+0000","last_peered":"2024-02-19T22:00:11.861156+0000","last_clean":"2024-02-19T22:00:11.861156+0000","last_became_active":"2024-02-19T21:49:08.332176+0000","last_became_peered":"2024-02-19T21:49:08.332176+0000","last_unstale":"2024-02-19T22:00:11.861156+0000","last_undegraded":"2024-02-19T22:00:11.861156+0000","last_fullsized":"2024-02-19T22:00:11.861156+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T22:00:11.861088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:18.393513+0000","last_clean_scrub_stamp":"2024-02-19T22:00:11.861088+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":285,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.692019+0000","last_change":"2024-02-19T21:59:42.124548+0000","last_active":"2024-02-19T22:00:08.692019+0000","last_peered":"2024-02-19T22:00:08.692019+0000","last_clean":"2024-02-19T22:00:08.692019+0000","last_became_active":"2024-02-19T21:57:58.573260+0000","last_became_peered":"2024-02-19T21:57:58.573260+0000","last_unstale":"2024-02-19T22:00:08.692019+0000","last_undegraded":"2024-02-19T22:00:08.692019+0000","last_fullsized":"2024-02-19T22:00:08.692019+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:42.124462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:59:42.124462+0000","last_clean_scrub_stamp":"2024-02-19T21:59:42.124462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"610'25","reported_seq":773,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.756855+0000","last_change":"2024-02-19T22:00:02.216840+0000","last_active":"2024-02-19T22:00:08.756855+0000","last_peered":"2024-02-19T22:00:08.756855+0000","last_clean":"2024-02-19T22:00:08.756855+0000","last_became_active":"2024-02-19T21:58:25.599955+0000","last_became_peered":"2024-02-19T21:58:25.599955+0000","last_unstale":"2024-02-19T22:00:08.756855+0000","last_undegraded":"2024-02-19T22:00:08.756855+0000","last_fullsized":"2024-02-19T22:00:08.756855+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"610'25","last_scrub_stamp":"2024-02-19T22:00:02.216775+0000","last_deep_scrub":"610'25","last_deep_scrub_stamp":"2024-02-19T22:00:02.216775+0000","last_clean_scrub_stamp":"2024-02-19T22:00:02.216775+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":146,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.527417+0000","last_change":"2024-02-19T21:59:12.077470+0000","last_active":"2024-02-19T21:59:50.527417+0000","last_peered":"2024-02-19T21:59:50.527417+0000","last_clean":"2024-02-19T21:59:50.527417+0000","last_became_active":"2024-02-19T21:53:45.368696+0000","last_became_peered":"2024-02-19T21:53:45.368696+0000","last_unstale":"2024-02-19T21:59:50.527417+0000","last_undegraded":"2024-02-19T21:59:50.527417+0000","last_fullsized":"2024-02-19T21:59:50.527417+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:12.077382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:07.519531+0000","last_clean_scrub_stamp":"2024-02-19T21:59:12.077382+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"378'4","reported_seq":654,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.526265+0000","last_change":"2024-02-19T21:59:18.440350+0000","last_active":"2024-02-19T21:59:50.526265+0000","last_peered":"2024-02-19T21:59:50.526265+0000","last_clean":"2024-02-19T21:59:50.526265+0000","last_became_active":"2024-02-19T21:57:58.568734+0000","last_became_peered":"2024-02-19T21:57:58.568734+0000","last_unstale":"2024-02-19T21:59:50.526265+0000","last_undegraded":"2024-02-19T21:59:50.526265+0000","last_fullsized":"2024-02-19T21:59:50.526265+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"378'4","last_scrub_stamp":"2024-02-19T21:59:18.440255+0000","last_deep_scrub":"378'4","last_deep_scrub_stamp":"2024-02-19T21:48:28.510849+0000","last_clean_scrub_stamp":"2024-02-19T21:59:18.440255+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"470'29","reported_seq":526,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.525629+0000","last_change":"2024-02-19T21:59:02.528308+0000","last_active":"2024-02-19T21:59:50.525629+0000","last_peered":"2024-02-19T21:59:50.525629+0000","last_clean":"2024-02-19T21:59:50.525629+0000","last_became_active":"2024-02-19T21:58:25.592551+0000","last_became_peered":"2024-02-19T21:58:25.592551+0000","last_unstale":"2024-02-19T21:59:50.525629+0000","last_undegraded":"2024-02-19T21:59:50.525629+0000","last_fullsized":"2024-02-19T21:59:50.525629+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'29","last_scrub_stamp":"2024-02-19T21:59:02.528230+0000","last_deep_scrub":"470'29","last_deep_scrub_stamp":"2024-02-19T21:59:02.528230+0000","last_clean_scrub_stamp":"2024-02-19T21:59:02.528230+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":33,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":276,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.692108+0000","last_change":"2024-02-19T21:59:20.903892+0000","last_active":"2024-02-19T22:00:08.692108+0000","last_peered":"2024-02-19T22:00:08.692108+0000","last_clean":"2024-02-19T22:00:08.692108+0000","last_became_active":"2024-02-19T21:57:58.573677+0000","last_became_peered":"2024-02-19T21:57:58.573677+0000","last_unstale":"2024-02-19T22:00:08.692108+0000","last_undegraded":"2024-02-19T22:00:08.692108+0000","last_fullsized":"2024-02-19T22:00:08.692108+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:20.903802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:55:22.791271+0000","last_clean_scrub_stamp":"2024-02-19T21:59:20.903802+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":655,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.756630+0000","last_change":"2024-02-19T21:59:42.428535+0000","last_active":"2024-02-19T22:00:08.756630+0000","last_peered":"2024-02-19T22:00:08.756630+0000","last_clean":"2024-02-19T22:00:08.756630+0000","last_became_active":"2024-02-19T21:57:58.571584+0000","last_became_peered":"2024-02-19T21:57:58.571584+0000","last_unstale":"2024-02-19T22:00:08.756630+0000","last_undegraded":"2024-02-19T22:00:08.756630+0000","last_fullsized":"2024-02-19T22:00:08.756630+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:42.428463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:59:42.428463+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":616,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.839769+0000","last_change":"2024-02-19T21:59:35.767189+0000","last_active":"2024-02-19T21:59:50.839769+0000","last_peered":"2024-02-19T21:59:50.839769+0000","last_clean":"2024-02-19T21:59:50.839769+0000","last_became_active":"2024-02-19T21:57:58.576857+0000","last_became_peered":"2024-02-19T21:57:58.576857+0000","last_unstale":"2024-02-19T21:59:50.839769+0000","last_undegraded":"2024-02-19T21:59:50.839769+0000","last_fullsized":"2024-02-19T21:59:50.839769+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:35.767124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:59:35.767124+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"599'35","reported_seq":527,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.839800+0000","last_change":"2024-02-19T21:59:07.450942+0000","last_active":"2024-02-19T21:59:50.839800+0000","last_peered":"2024-02-19T21:59:50.839800+0000","last_clean":"2024-02-19T21:59:50.839800+0000","last_became_active":"2024-02-19T21:39:39.480061+0000","last_became_peered":"2024-02-19T21:39:39.480061+0000","last_unstale":"2024-02-19T21:59:50.839800+0000","last_undegraded":"2024-02-19T21:59:50.839800+0000","last_fullsized":"2024-02-19T21:59:50.839800+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"599'35","last_scrub_stamp":"2024-02-19T21:59:07.450881+0000","last_deep_scrub":"599'35","last_deep_scrub_stamp":"2024-02-19T21:59:07.450881+0000","last_clean_scrub_stamp":"2024-02-19T21:59:07.450881+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"571'10","reported_seq":896,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.756996+0000","last_change":"2024-02-19T21:59:59.256754+0000","last_active":"2024-02-19T22:00:08.756996+0000","last_peered":"2024-02-19T22:00:08.756996+0000","last_clean":"2024-02-19T22:00:08.756996+0000","last_became_active":"2024-02-19T21:57:58.568406+0000","last_became_peered":"2024-02-19T21:57:58.568406+0000","last_unstale":"2024-02-19T22:00:08.756996+0000","last_undegraded":"2024-02-19T22:00:08.756996+0000","last_fullsized":"2024-02-19T22:00:08.756996+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"571'10","last_scrub_stamp":"2024-02-19T21:59:59.256680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:59:59.256680+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":45,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.527425+0000","last_change":"2024-02-19T21:58:59.028765+0000","last_active":"2024-02-19T21:59:50.527425+0000","last_peered":"2024-02-19T21:59:50.527425+0000","last_clean":"2024-02-19T21:59:50.527425+0000","last_became_active":"2024-02-19T21:58:25.578213+0000","last_became_peered":"2024-02-19T21:58:25.578213+0000","last_unstale":"2024-02-19T21:59:50.527425+0000","last_undegraded":"2024-02-19T21:59:50.527425+0000","last_fullsized":"2024-02-19T21:59:50.527425+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:58:59.028640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:12.609170+0000","last_clean_scrub_stamp":"2024-02-19T21:58:59.028640+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":609,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.471620+0000","last_change":"2024-02-19T21:58:42.445310+0000","last_active":"2024-02-19T21:59:51.471620+0000","last_peered":"2024-02-19T21:59:51.471620+0000","last_clean":"2024-02-19T21:59:51.471620+0000","last_became_active":"2024-02-19T21:32:23.355457+0000","last_became_peered":"2024-02-19T21:32:23.355457+0000","last_unstale":"2024-02-19T21:59:51.471620+0000","last_undegraded":"2024-02-19T21:59:51.471620+0000","last_fullsized":"2024-02-19T21:59:51.471620+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:58:42.445193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:58:42.445193+0000","last_clean_scrub_stamp":"2024-02-19T21:58:42.445193+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"598'69","reported_seq":1194,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:07.194716+0000","last_change":"2024-02-19T21:59:04.419081+0000","last_active":"2024-02-19T22:00:07.194716+0000","last_peered":"2024-02-19T22:00:07.194716+0000","last_clean":"2024-02-19T22:00:07.194716+0000","last_became_active":"2024-02-19T21:58:25.592912+0000","last_became_peered":"2024-02-19T21:58:25.592912+0000","last_unstale":"2024-02-19T22:00:07.194716+0000","last_undegraded":"2024-02-19T22:00:07.194716+0000","last_fullsized":"2024-02-19T22:00:07.194716+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"598'69","last_scrub_stamp":"2024-02-19T21:59:04.419016+0000","last_deep_scrub":"598'69","last_deep_scrub_stamp":"2024-02-19T21:59:04.419016+0000","last_clean_scrub_stamp":"2024-02-19T21:59:04.419016+0000","log_size":69,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":50,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":1790,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":584,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.756752+0000","last_change":"2024-02-19T21:59:33.522888+0000","last_active":"2024-02-19T22:00:08.756752+0000","last_peered":"2024-02-19T22:00:08.756752+0000","last_clean":"2024-02-19T22:00:08.756752+0000","last_became_active":"2024-02-19T21:57:58.571507+0000","last_became_peered":"2024-02-19T21:57:58.571507+0000","last_unstale":"2024-02-19T22:00:08.756752+0000","last_undegraded":"2024-02-19T22:00:08.756752+0000","last_fullsized":"2024-02-19T22:00:08.756752+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:33.522814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:59:33.522814+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":648,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.691993+0000","last_change":"2024-02-19T21:58:57.587630+0000","last_active":"2024-02-19T22:00:08.691993+0000","last_peered":"2024-02-19T22:00:08.691993+0000","last_clean":"2024-02-19T22:00:08.691993+0000","last_became_active":"2024-02-19T21:53:45.368343+0000","last_became_peered":"2024-02-19T21:53:45.368343+0000","last_unstale":"2024-02-19T22:00:08.691993+0000","last_undegraded":"2024-02-19T22:00:08.691993+0000","last_fullsized":"2024-02-19T22:00:08.691993+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:58:57.587501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:58:57.587501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'6","reported_seq":2394,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:09.376077+0000","last_change":"2024-02-19T21:59:55.844974+0000","last_active":"2024-02-19T22:00:09.376077+0000","last_peered":"2024-02-19T22:00:09.376077+0000","last_clean":"2024-02-19T22:00:09.376077+0000","last_became_active":"2024-02-19T21:49:08.331108+0000","last_became_peered":"2024-02-19T21:49:08.331108+0000","last_unstale":"2024-02-19T22:00:09.376077+0000","last_undegraded":"2024-02-19T22:00:09.376077+0000","last_fullsized":"2024-02-19T22:00:09.376077+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-02-19T21:59:55.844901+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-02-19T21:44:13.678341+0000","last_clean_scrub_stamp":"2024-02-19T21:59:55.844901+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1645,"num_read_kb":1640,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":283,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.693313+0000","last_change":"2024-02-19T21:59:47.120203+0000","last_active":"2024-02-19T22:00:08.693313+0000","last_peered":"2024-02-19T22:00:08.693313+0000","last_clean":"2024-02-19T22:00:08.693313+0000","last_became_active":"2024-02-19T21:58:25.596054+0000","last_became_peered":"2024-02-19T21:58:25.596054+0000","last_unstale":"2024-02-19T22:00:08.693313+0000","last_undegraded":"2024-02-19T22:00:08.693313+0000","last_fullsized":"2024-02-19T22:00:08.693313+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:47.120139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:07.330454+0000","last_clean_scrub_stamp":"2024-02-19T21:59:47.120139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"470'21","reported_seq":679,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.839939+0000","last_change":"2024-02-19T21:59:43.859454+0000","last_active":"2024-02-19T21:59:50.839939+0000","last_peered":"2024-02-19T21:59:50.839939+0000","last_clean":"2024-02-19T21:59:50.839939+0000","last_became_active":"2024-02-19T21:57:58.579855+0000","last_became_peered":"2024-02-19T21:57:58.579855+0000","last_unstale":"2024-02-19T21:59:50.839939+0000","last_undegraded":"2024-02-19T21:59:50.839939+0000","last_fullsized":"2024-02-19T21:59:50.839939+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'21","last_scrub_stamp":"2024-02-19T21:59:43.859384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:59:43.859384+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":31,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":259,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.692852+0000","last_change":"2024-02-19T21:58:55.811892+0000","last_active":"2024-02-19T22:00:08.692852+0000","last_peered":"2024-02-19T22:00:08.692852+0000","last_clean":"2024-02-19T22:00:08.692852+0000","last_became_active":"2024-02-19T21:49:08.325127+0000","last_became_peered":"2024-02-19T21:49:08.325127+0000","last_unstale":"2024-02-19T22:00:08.692852+0000","last_undegraded":"2024-02-19T22:00:08.692852+0000","last_fullsized":"2024-02-19T22:00:08.692852+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:58:55.811800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:58:55.811800+0000","last_clean_scrub_stamp":"2024-02-19T21:58:55.811800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":640,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.472340+0000","last_change":"2024-02-19T21:59:40.663102+0000","last_active":"2024-02-19T21:59:51.472340+0000","last_peered":"2024-02-19T21:59:51.472340+0000","last_clean":"2024-02-19T21:59:51.472340+0000","last_became_active":"2024-02-19T21:53:45.385423+0000","last_became_peered":"2024-02-19T21:53:45.385423+0000","last_unstale":"2024-02-19T21:59:51.472340+0000","last_undegraded":"2024-02-19T21:59:51.472340+0000","last_fullsized":"2024-02-19T21:59:51.472340+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:40.662998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:58:29.820226+0000","last_clean_scrub_stamp":"2024-02-19T21:59:40.662998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":45,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.526851+0000","last_change":"2024-02-19T21:59:16.992000+0000","last_active":"2024-02-19T21:59:50.526851+0000","last_peered":"2024-02-19T21:59:50.526851+0000","last_clean":"2024-02-19T21:59:50.526851+0000","last_became_active":"2024-02-19T21:58:25.589847+0000","last_became_peered":"2024-02-19T21:58:25.589847+0000","last_unstale":"2024-02-19T21:59:50.526851+0000","last_undegraded":"2024-02-19T21:59:50.526851+0000","last_fullsized":"2024-02-19T21:59:50.526851+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:16.991916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:57:51.564121+0000","last_clean_scrub_stamp":"2024-02-19T21:59:16.991916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":670,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.471752+0000","last_change":"2024-02-19T21:59:42.549244+0000","last_active":"2024-02-19T21:59:51.471752+0000","last_peered":"2024-02-19T21:59:51.471752+0000","last_clean":"2024-02-19T21:59:51.471752+0000","last_became_active":"2024-02-19T21:54:52.479416+0000","last_became_peered":"2024-02-19T21:54:52.479416+0000","last_unstale":"2024-02-19T21:59:51.471752+0000","last_undegraded":"2024-02-19T21:59:51.471752+0000","last_fullsized":"2024-02-19T21:59:51.471752+0000","mapping_epoch":513,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":514,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:42.549166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:59:42.549166+0000","last_clean_scrub_stamp":"2024-02-19T21:59:42.549166+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":242,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.691264+0000","last_change":"2024-02-19T21:59:19.663818+0000","last_active":"2024-02-19T22:00:08.691264+0000","last_peered":"2024-02-19T22:00:08.691264+0000","last_clean":"2024-02-19T22:00:08.691264+0000","last_became_active":"2024-02-19T21:57:58.578344+0000","last_became_peered":"2024-02-19T21:57:58.578344+0000","last_unstale":"2024-02-19T22:00:08.691264+0000","last_undegraded":"2024-02-19T22:00:08.691264+0000","last_fullsized":"2024-02-19T22:00:08.691264+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:19.663748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:30:06.699689+0000","last_clean_scrub_stamp":"2024-02-19T21:59:19.663748+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"470'45","reported_seq":672,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.458212+0000","last_change":"2024-02-19T21:58:56.974989+0000","last_active":"2024-02-19T21:59:51.458212+0000","last_peered":"2024-02-19T21:59:51.458212+0000","last_clean":"2024-02-19T21:59:51.458212+0000","last_became_active":"2024-02-19T21:32:25.372296+0000","last_became_peered":"2024-02-19T21:32:25.372296+0000","last_unstale":"2024-02-19T21:59:51.458212+0000","last_undegraded":"2024-02-19T21:59:51.458212+0000","last_fullsized":"2024-02-19T21:59:51.458212+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'45","last_scrub_stamp":"2024-02-19T21:58:56.974886+0000","last_deep_scrub":"143'21","last_deep_scrub_stamp":"2024-02-19T21:38:28.363073+0000","last_clean_scrub_stamp":"2024-02-19T21:58:56.974886+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":51,"num_write":37,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":227,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.692208+0000","last_change":"2024-02-19T21:59:39.411213+0000","last_active":"2024-02-19T22:00:08.692208+0000","last_peered":"2024-02-19T22:00:08.692208+0000","last_clean":"2024-02-19T22:00:08.692208+0000","last_became_active":"2024-02-19T21:49:54.477947+0000","last_became_peered":"2024-02-19T21:49:54.477947+0000","last_unstale":"2024-02-19T22:00:08.692208+0000","last_undegraded":"2024-02-19T22:00:08.692208+0000","last_fullsized":"2024-02-19T22:00:08.692208+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:39.411136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:59:39.411136+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":615,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:06.697289+0000","last_change":"2024-02-19T22:00:06.697267+0000","last_active":"2024-02-19T22:00:06.697289+0000","last_peered":"2024-02-19T22:00:06.697289+0000","last_clean":"2024-02-19T22:00:06.697289+0000","last_became_active":"2024-02-19T21:58:25.593111+0000","last_became_peered":"2024-02-19T21:58:25.593111+0000","last_unstale":"2024-02-19T22:00:06.697289+0000","last_undegraded":"2024-02-19T22:00:06.697289+0000","last_fullsized":"2024-02-19T22:00:06.697289+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T22:00:06.697201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.250599+0000","last_clean_scrub_stamp":"2024-02-19T22:00:06.697201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":610,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.756652+0000","last_change":"2024-02-19T22:00:07.170449+0000","last_active":"2024-02-19T22:00:08.756652+0000","last_peered":"2024-02-19T22:00:08.756652+0000","last_clean":"2024-02-19T22:00:08.756652+0000","last_became_active":"2024-02-19T21:58:25.597262+0000","last_became_peered":"2024-02-19T21:58:25.597262+0000","last_unstale":"2024-02-19T22:00:08.756652+0000","last_undegraded":"2024-02-19T22:00:08.756652+0000","last_fullsized":"2024-02-19T22:00:08.756652+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T22:00:07.170362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T22:00:07.170362+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":642,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.691436+0000","last_change":"2024-02-19T21:59:05.541439+0000","last_active":"2024-02-19T22:00:08.691436+0000","last_peered":"2024-02-19T22:00:08.691436+0000","last_clean":"2024-02-19T22:00:08.691436+0000","last_became_active":"2024-02-19T21:57:58.578754+0000","last_became_peered":"2024-02-19T21:57:58.578754+0000","last_unstale":"2024-02-19T22:00:08.691436+0000","last_undegraded":"2024-02-19T22:00:08.691436+0000","last_fullsized":"2024-02-19T22:00:08.691436+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:05.541355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:59:05.541355+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"470'42","reported_seq":760,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.756741+0000","last_change":"2024-02-19T21:58:46.571798+0000","last_active":"2024-02-19T22:00:08.756741+0000","last_peered":"2024-02-19T22:00:08.756741+0000","last_clean":"2024-02-19T22:00:08.756741+0000","last_became_active":"2024-02-19T21:57:58.571414+0000","last_became_peered":"2024-02-19T21:57:58.571414+0000","last_unstale":"2024-02-19T22:00:08.756741+0000","last_undegraded":"2024-02-19T22:00:08.756741+0000","last_fullsized":"2024-02-19T22:00:08.756741+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'42","last_scrub_stamp":"2024-02-19T21:58:46.571721+0000","last_deep_scrub":"324'30","last_deep_scrub_stamp":"2024-02-19T21:46:08.110965+0000","last_clean_scrub_stamp":"2024-02-19T21:58:46.571721+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":47,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":632,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.472304+0000","last_change":"2024-02-19T21:59:39.580543+0000","last_active":"2024-02-19T21:59:51.472304+0000","last_peered":"2024-02-19T21:59:51.472304+0000","last_clean":"2024-02-19T21:59:51.472304+0000","last_became_active":"2024-02-19T21:57:58.570197+0000","last_became_peered":"2024-02-19T21:57:58.570197+0000","last_unstale":"2024-02-19T21:59:51.472304+0000","last_undegraded":"2024-02-19T21:59:51.472304+0000","last_fullsized":"2024-02-19T21:59:51.472304+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:39.580439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:59:39.580439+0000","last_clean_scrub_stamp":"2024-02-19T21:59:39.580439+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":637,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.839831+0000","last_change":"2024-02-19T21:59:48.913954+0000","last_active":"2024-02-19T21:59:50.839831+0000","last_peered":"2024-02-19T21:59:50.839831+0000","last_clean":"2024-02-19T21:59:50.839831+0000","last_became_active":"2024-02-19T21:49:08.330648+0000","last_became_peered":"2024-02-19T21:49:08.330648+0000","last_unstale":"2024-02-19T21:59:50.839831+0000","last_undegraded":"2024-02-19T21:59:50.839831+0000","last_fullsized":"2024-02-19T21:59:50.839831+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:48.913862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:58:28.719381+0000","last_clean_scrub_stamp":"2024-02-19T21:59:48.913862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":618,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.692035+0000","last_change":"2024-02-19T21:59:07.550763+0000","last_active":"2024-02-19T22:00:08.692035+0000","last_peered":"2024-02-19T22:00:08.692035+0000","last_clean":"2024-02-19T22:00:08.692035+0000","last_became_active":"2024-02-19T21:57:58.566881+0000","last_became_peered":"2024-02-19T21:57:58.566881+0000","last_unstale":"2024-02-19T22:00:08.692035+0000","last_undegraded":"2024-02-19T22:00:08.692035+0000","last_fullsized":"2024-02-19T22:00:08.692035+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:07.550678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:46:45.017696+0000","last_clean_scrub_stamp":"2024-02-19T21:59:07.550678+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"470'47","reported_seq":668,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.756808+0000","last_change":"2024-02-19T21:59:54.291844+0000","last_active":"2024-02-19T22:00:08.756808+0000","last_peered":"2024-02-19T22:00:08.756808+0000","last_clean":"2024-02-19T22:00:08.756808+0000","last_became_active":"2024-02-19T21:57:58.568175+0000","last_became_peered":"2024-02-19T21:57:58.568175+0000","last_unstale":"2024-02-19T22:00:08.756808+0000","last_undegraded":"2024-02-19T22:00:08.756808+0000","last_fullsized":"2024-02-19T22:00:08.756808+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'47","last_scrub_stamp":"2024-02-19T21:59:54.291772+0000","last_deep_scrub":"470'47","last_deep_scrub_stamp":"2024-02-19T21:59:54.291772+0000","last_clean_scrub_stamp":"2024-02-19T21:59:54.291772+0000","log_size":47,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":68,"num_read_kb":54,"num_write":42,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":615,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.458165+0000","last_change":"2024-02-19T21:59:31.018345+0000","last_active":"2024-02-19T21:59:51.458165+0000","last_peered":"2024-02-19T21:59:51.458165+0000","last_clean":"2024-02-19T21:59:51.458165+0000","last_became_active":"2024-02-19T21:57:58.566809+0000","last_became_peered":"2024-02-19T21:57:58.566809+0000","last_unstale":"2024-02-19T21:59:51.458165+0000","last_undegraded":"2024-02-19T21:59:51.458165+0000","last_fullsized":"2024-02-19T21:59:51.458165+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:31.018220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:38.208037+0000","last_clean_scrub_stamp":"2024-02-19T21:59:31.018220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":358,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:07.467888+0000","last_change":"2024-02-19T22:00:07.467844+0000","last_active":"2024-02-19T22:00:07.467888+0000","last_peered":"2024-02-19T22:00:07.467888+0000","last_clean":"2024-02-19T22:00:07.467888+0000","last_became_active":"2024-02-19T21:58:25.591252+0000","last_became_peered":"2024-02-19T21:58:25.591252+0000","last_unstale":"2024-02-19T22:00:07.467888+0000","last_undegraded":"2024-02-19T22:00:07.467888+0000","last_fullsized":"2024-02-19T22:00:07.467888+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T22:00:07.467732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T22:00:07.467732+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":611,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.839882+0000","last_change":"2024-02-19T21:59:45.867561+0000","last_active":"2024-02-19T21:59:50.839882+0000","last_peered":"2024-02-19T21:59:50.839882+0000","last_clean":"2024-02-19T21:59:50.839882+0000","last_became_active":"2024-02-19T21:32:23.355006+0000","last_became_peered":"2024-02-19T21:32:23.355006+0000","last_unstale":"2024-02-19T21:59:50.839882+0000","last_undegraded":"2024-02-19T21:59:50.839882+0000","last_fullsized":"2024-02-19T21:59:50.839882+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:45.867493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:59:45.867493+0000","last_clean_scrub_stamp":"2024-02-19T21:59:45.867493+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"470'50","reported_seq":63,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.526629+0000","last_change":"2024-02-19T21:59:22.886591+0000","last_active":"2024-02-19T21:59:50.526629+0000","last_peered":"2024-02-19T21:59:50.526629+0000","last_clean":"2024-02-19T21:59:50.526629+0000","last_became_active":"2024-02-19T21:58:25.592388+0000","last_became_peered":"2024-02-19T21:58:25.592388+0000","last_unstale":"2024-02-19T21:59:50.526629+0000","last_undegraded":"2024-02-19T21:59:50.526629+0000","last_fullsized":"2024-02-19T21:59:50.526629+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":581,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'50","last_scrub_stamp":"2024-02-19T21:59:22.886497+0000","last_deep_scrub":"168'26","last_deep_scrub_stamp":"2024-02-19T21:39:48.004702+0000","last_clean_scrub_stamp":"2024-02-19T21:59:22.886497+0000","log_size":50,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":44,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":520,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.458074+0000","last_change":"2024-02-19T21:59:18.090833+0000","last_active":"2024-02-19T21:59:51.458074+0000","last_peered":"2024-02-19T21:59:51.458074+0000","last_clean":"2024-02-19T21:59:51.458074+0000","last_became_active":"2024-02-19T21:58:25.592211+0000","last_became_peered":"2024-02-19T21:58:25.592211+0000","last_unstale":"2024-02-19T21:59:51.458074+0000","last_undegraded":"2024-02-19T21:59:51.458074+0000","last_fullsized":"2024-02-19T21:59:51.458074+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:18.090748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:59:18.090748+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":639,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.691725+0000","last_change":"2024-02-19T21:59:51.536136+0000","last_active":"2024-02-19T22:00:08.691725+0000","last_peered":"2024-02-19T22:00:08.691725+0000","last_clean":"2024-02-19T22:00:08.691725+0000","last_became_active":"2024-02-19T21:49:08.328529+0000","last_became_peered":"2024-02-19T21:49:08.328529+0000","last_unstale":"2024-02-19T22:00:08.691725+0000","last_undegraded":"2024-02-19T22:00:08.691725+0000","last_fullsized":"2024-02-19T22:00:08.691725+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:51.536035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:59:51.536035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":668,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.458484+0000","last_change":"2024-02-19T21:59:38.945553+0000","last_active":"2024-02-19T21:59:51.458484+0000","last_peered":"2024-02-19T21:59:51.458484+0000","last_clean":"2024-02-19T21:59:51.458484+0000","last_became_active":"2024-02-19T21:49:54.493041+0000","last_became_peered":"2024-02-19T21:49:54.493041+0000","last_unstale":"2024-02-19T21:59:51.458484+0000","last_undegraded":"2024-02-19T21:59:51.458484+0000","last_fullsized":"2024-02-19T21:59:51.458484+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:38.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:59:38.945441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"470'42","reported_seq":497,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:55.501064+0000","last_change":"2024-02-19T21:59:55.501029+0000","last_active":"2024-02-19T21:59:55.501064+0000","last_peered":"2024-02-19T21:59:55.501064+0000","last_clean":"2024-02-19T21:59:55.501064+0000","last_became_active":"2024-02-19T21:49:08.330477+0000","last_became_peered":"2024-02-19T21:49:08.330477+0000","last_unstale":"2024-02-19T21:59:55.501064+0000","last_undegraded":"2024-02-19T21:59:55.501064+0000","last_fullsized":"2024-02-19T21:59:55.501064+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'42","last_scrub_stamp":"2024-02-19T21:59:55.500948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:59:55.500948+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":61,"num_read_kb":54,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"606'13","reported_seq":71,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:07.194715+0000","last_change":"2024-02-19T21:59:26.816123+0000","last_active":"2024-02-19T22:00:07.194715+0000","last_peered":"2024-02-19T22:00:07.194715+0000","last_clean":"2024-02-19T22:00:07.194715+0000","last_became_active":"2024-02-19T21:58:25.591608+0000","last_became_peered":"2024-02-19T21:58:25.591608+0000","last_unstale":"2024-02-19T22:00:07.194715+0000","last_undegraded":"2024-02-19T22:00:07.194715+0000","last_fullsized":"2024-02-19T22:00:07.194715+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"606'13","last_scrub_stamp":"2024-02-19T21:59:26.816058+0000","last_deep_scrub":"606'13","last_deep_scrub_stamp":"2024-02-19T21:59:26.816058+0000","last_clean_scrub_stamp":"2024-02-19T21:59:26.816058+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"66'1","reported_seq":129,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:09.005248+0000","last_change":"2024-02-19T22:00:09.005248+0000","last_active":"2024-02-19T22:00:09.005248+0000","last_peered":"2024-02-19T22:00:09.005248+0000","last_clean":"2024-02-19T22:00:09.005248+0000","last_became_active":"2024-02-19T21:58:28.515039+0000","last_became_peered":"2024-02-19T21:58:28.515039+0000","last_unstale":"2024-02-19T22:00:09.005248+0000","last_undegraded":"2024-02-19T22:00:09.005248+0000","last_fullsized":"2024-02-19T22:00:09.005248+0000","mapping_epoch":582,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":583,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T22:00:09.005182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:19.569440+0000","last_clean_scrub_stamp":"2024-02-19T22:00:09.005182+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"261'11","reported_seq":810,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:07.194584+0000","last_change":"2024-02-19T21:59:22.506434+0000","last_active":"2024-02-19T22:00:07.194584+0000","last_peered":"2024-02-19T22:00:07.194584+0000","last_clean":"2024-02-19T22:00:07.194584+0000","last_became_active":"2024-02-19T21:44:08.123392+0000","last_became_peered":"2024-02-19T21:44:08.123392+0000","last_unstale":"2024-02-19T22:00:07.194584+0000","last_undegraded":"2024-02-19T22:00:07.194584+0000","last_fullsized":"2024-02-19T22:00:07.194584+0000","mapping_epoch":62,"log_start":"257'10","ondisk_log_start":"257'10","created":62,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-02-19T21:59:22.506345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:59:22.506345+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"571'2","reported_seq":630,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.691506+0000","last_change":"2024-02-19T21:59:25.564757+0000","last_active":"2024-02-19T22:00:08.691506+0000","last_peered":"2024-02-19T22:00:08.691506+0000","last_clean":"2024-02-19T22:00:08.691506+0000","last_became_active":"2024-02-19T21:57:58.579213+0000","last_became_peered":"2024-02-19T21:57:58.579213+0000","last_unstale":"2024-02-19T22:00:08.691506+0000","last_undegraded":"2024-02-19T22:00:08.691506+0000","last_fullsized":"2024-02-19T22:00:08.691506+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"571'2","last_scrub_stamp":"2024-02-19T21:59:25.564671+0000","last_deep_scrub":"571'2","last_deep_scrub_stamp":"2024-02-19T21:58:01.684155+0000","last_clean_scrub_stamp":"2024-02-19T21:59:25.564671+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"470'27","reported_seq":483,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.526094+0000","last_change":"2024-02-19T21:59:11.479523+0000","last_active":"2024-02-19T21:59:50.526094+0000","last_peered":"2024-02-19T21:59:50.526094+0000","last_clean":"2024-02-19T21:59:50.526094+0000","last_became_active":"2024-02-19T21:47:46.251550+0000","last_became_peered":"2024-02-19T21:47:46.251550+0000","last_unstale":"2024-02-19T21:59:50.526094+0000","last_undegraded":"2024-02-19T21:59:50.526094+0000","last_fullsized":"2024-02-19T21:59:50.526094+0000","mapping_epoch":362,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":363,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'27","last_scrub_stamp":"2024-02-19T21:59:11.479412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:59:11.479412+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7],"acting":[4,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":634,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.472082+0000","last_change":"2024-02-19T21:59:09.439166+0000","last_active":"2024-02-19T21:59:51.472082+0000","last_peered":"2024-02-19T21:59:51.472082+0000","last_clean":"2024-02-19T21:59:51.472082+0000","last_became_active":"2024-02-19T21:57:58.569584+0000","last_became_peered":"2024-02-19T21:57:58.569584+0000","last_unstale":"2024-02-19T21:59:51.472082+0000","last_undegraded":"2024-02-19T21:59:51.472082+0000","last_fullsized":"2024-02-19T21:59:51.472082+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:09.439069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:59:09.439069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"571'14","reported_seq":533,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T22:00:07.194588+0000","last_change":"2024-02-19T21:59:23.462656+0000","last_active":"2024-02-19T22:00:07.194588+0000","last_peered":"2024-02-19T22:00:07.194588+0000","last_clean":"2024-02-19T22:00:07.194588+0000","last_became_active":"2024-02-19T21:57:58.571667+0000","last_became_peered":"2024-02-19T21:57:58.571667+0000","last_unstale":"2024-02-19T22:00:07.194588+0000","last_undegraded":"2024-02-19T22:00:07.194588+0000","last_fullsized":"2024-02-19T22:00:07.194588+0000","mapping_epoch":568,"log_start":"98'9","ondisk_log_start":"98'9","created":62,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"571'14","last_scrub_stamp":"2024-02-19T21:59:23.462543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:59:23.462543+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":634,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.839667+0000","last_change":"2024-02-19T21:59:19.610042+0000","last_active":"2024-02-19T21:59:50.839667+0000","last_peered":"2024-02-19T21:59:50.839667+0000","last_clean":"2024-02-19T21:59:50.839667+0000","last_became_active":"2024-02-19T21:53:45.382885+0000","last_became_peered":"2024-02-19T21:53:45.382885+0000","last_unstale":"2024-02-19T21:59:50.839667+0000","last_undegraded":"2024-02-19T21:59:50.839667+0000","last_fullsized":"2024-02-19T21:59:50.839667+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:19.609965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:33:37.911143+0000","last_clean_scrub_stamp":"2024-02-19T21:59:19.609965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"471'46","reported_seq":591,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:54.490441+0000","last_change":"2024-02-19T21:59:54.490388+0000","last_active":"2024-02-19T21:59:54.490441+0000","last_peered":"2024-02-19T21:59:54.490441+0000","last_clean":"2024-02-19T21:59:54.490441+0000","last_became_active":"2024-02-19T21:53:45.384528+0000","last_became_peered":"2024-02-19T21:53:45.384528+0000","last_unstale":"2024-02-19T21:59:54.490441+0000","last_undegraded":"2024-02-19T21:59:54.490441+0000","last_fullsized":"2024-02-19T21:59:54.490441+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'46","last_scrub_stamp":"2024-02-19T21:59:54.490302+0000","last_deep_scrub":"270'34","last_deep_scrub_stamp":"2024-02-19T21:44:17.451151+0000","last_clean_scrub_stamp":"2024-02-19T21:59:54.490302+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":602,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.526189+0000","last_change":"2024-02-19T21:59:08.482713+0000","last_active":"2024-02-19T21:59:50.526189+0000","last_peered":"2024-02-19T21:59:50.526189+0000","last_clean":"2024-02-19T21:59:50.526189+0000","last_became_active":"2024-02-19T21:49:08.328697+0000","last_became_peered":"2024-02-19T21:49:08.328697+0000","last_unstale":"2024-02-19T21:59:50.526189+0000","last_undegraded":"2024-02-19T21:59:50.526189+0000","last_fullsized":"2024-02-19T21:59:50.526189+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:08.482609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:59:08.482609+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"397'17","reported_seq":661,"reported_epoch":612,"state":"active+clean","last_fresh":"2024-02-19T22:00:10.534586+0000","last_change":"2024-02-19T22:00:08.885497+0000","last_active":"2024-02-19T22:00:10.534586+0000","last_peered":"2024-02-19T22:00:10.534586+0000","last_clean":"2024-02-19T22:00:10.534586+0000","last_became_active":"2024-02-19T21:49:08.325034+0000","last_became_peered":"2024-02-19T21:49:08.325034+0000","last_unstale":"2024-02-19T22:00:10.534586+0000","last_undegraded":"2024-02-19T22:00:10.534586+0000","last_fullsized":"2024-02-19T22:00:10.534586+0000","mapping_epoch":394,"log_start":"170'11","ondisk_log_start":"170'11","created":62,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"397'17","last_scrub_stamp":"2024-02-19T22:00:08.885430+0000","last_deep_scrub":"83'9","last_deep_scrub_stamp":"2024-02-19T21:33:49.121238+0000","last_clean_scrub_stamp":"2024-02-19T22:00:08.885430+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":624,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.839756+0000","last_change":"2024-02-19T21:59:28.838397+0000","last_active":"2024-02-19T21:59:50.839756+0000","last_peered":"2024-02-19T21:59:50.839756+0000","last_clean":"2024-02-19T21:59:50.839756+0000","last_became_active":"2024-02-19T21:53:45.383372+0000","last_became_peered":"2024-02-19T21:53:45.383372+0000","last_unstale":"2024-02-19T21:59:50.839756+0000","last_undegraded":"2024-02-19T21:59:50.839756+0000","last_fullsized":"2024-02-19T21:59:50.839756+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:28.838334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:35:04.767979+0000","last_clean_scrub_stamp":"2024-02-19T21:59:28.838334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"470'30","reported_seq":489,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:09.361125+0000","last_change":"2024-02-19T22:00:09.361125+0000","last_active":"2024-02-19T22:00:09.361125+0000","last_peered":"2024-02-19T22:00:09.361125+0000","last_clean":"2024-02-19T22:00:09.361125+0000","last_became_active":"2024-02-19T21:53:45.387040+0000","last_became_peered":"2024-02-19T21:53:45.387040+0000","last_unstale":"2024-02-19T22:00:09.361125+0000","last_undegraded":"2024-02-19T22:00:09.361125+0000","last_fullsized":"2024-02-19T22:00:09.361125+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'30","last_scrub_stamp":"2024-02-19T22:00:09.361034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T22:00:09.361034+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":38,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":283,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.693210+0000","last_change":"2024-02-19T21:59:43.211689+0000","last_active":"2024-02-19T22:00:08.693210+0000","last_peered":"2024-02-19T22:00:08.693210+0000","last_clean":"2024-02-19T22:00:08.693210+0000","last_became_active":"2024-02-19T21:58:25.594694+0000","last_became_peered":"2024-02-19T21:58:25.594694+0000","last_unstale":"2024-02-19T22:00:08.693210+0000","last_undegraded":"2024-02-19T22:00:08.693210+0000","last_fullsized":"2024-02-19T22:00:08.693210+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:43.211604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:28.351044+0000","last_clean_scrub_stamp":"2024-02-19T21:59:43.211604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":625,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.839285+0000","last_change":"2024-02-19T21:59:31.844252+0000","last_active":"2024-02-19T21:59:50.839285+0000","last_peered":"2024-02-19T21:59:50.839285+0000","last_clean":"2024-02-19T21:59:50.839285+0000","last_became_active":"2024-02-19T21:57:58.571126+0000","last_became_peered":"2024-02-19T21:57:58.571126+0000","last_unstale":"2024-02-19T21:59:50.839285+0000","last_undegraded":"2024-02-19T21:59:50.839285+0000","last_fullsized":"2024-02-19T21:59:50.839285+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:31.844186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:26.347399+0000","last_clean_scrub_stamp":"2024-02-19T21:59:31.844186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":615,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.691683+0000","last_change":"2024-02-19T22:00:01.433247+0000","last_active":"2024-02-19T22:00:08.691683+0000","last_peered":"2024-02-19T22:00:08.691683+0000","last_clean":"2024-02-19T22:00:08.691683+0000","last_became_active":"2024-02-19T21:32:23.358704+0000","last_became_peered":"2024-02-19T21:32:23.358704+0000","last_unstale":"2024-02-19T22:00:08.691683+0000","last_undegraded":"2024-02-19T22:00:08.691683+0000","last_fullsized":"2024-02-19T22:00:08.691683+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T22:00:01.433150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T22:00:01.433150+0000","last_clean_scrub_stamp":"2024-02-19T22:00:01.433150+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"470'53","reported_seq":583,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.526103+0000","last_change":"2024-02-19T21:59:17.454388+0000","last_active":"2024-02-19T21:59:50.526103+0000","last_peered":"2024-02-19T21:59:50.526103+0000","last_clean":"2024-02-19T21:59:50.526103+0000","last_became_active":"2024-02-19T21:49:08.325683+0000","last_became_peered":"2024-02-19T21:49:08.325683+0000","last_unstale":"2024-02-19T21:59:50.526103+0000","last_undegraded":"2024-02-19T21:59:50.526103+0000","last_fullsized":"2024-02-19T21:59:50.526103+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'53","last_scrub_stamp":"2024-02-19T21:59:17.454309+0000","last_deep_scrub":"337'39","last_deep_scrub_stamp":"2024-02-19T21:46:48.923809+0000","last_clean_scrub_stamp":"2024-02-19T21:59:17.454309+0000","log_size":53,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":46,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"66'1","reported_seq":471,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.691309+0000","last_change":"2024-02-19T21:59:06.560716+0000","last_active":"2024-02-19T22:00:08.691309+0000","last_peered":"2024-02-19T22:00:08.691309+0000","last_clean":"2024-02-19T22:00:08.691309+0000","last_became_active":"2024-02-19T21:53:48.374606+0000","last_became_peered":"2024-02-19T21:53:48.374606+0000","last_unstale":"2024-02-19T22:00:08.691309+0000","last_undegraded":"2024-02-19T22:00:08.691309+0000","last_fullsized":"2024-02-19T22:00:08.691309+0000","mapping_epoch":495,"log_start":"66'1","ondisk_log_start":"66'1","created":64,"last_epoch_clean":496,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2024-02-19T21:59:06.560625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:37:29.936139+0000","last_clean_scrub_stamp":"2024-02-19T21:59:06.560625+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":274,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.692421+0000","last_change":"2024-02-19T21:59:18.895768+0000","last_active":"2024-02-19T22:00:08.692421+0000","last_peered":"2024-02-19T22:00:08.692421+0000","last_clean":"2024-02-19T22:00:08.692421+0000","last_became_active":"2024-02-19T21:57:58.573947+0000","last_became_peered":"2024-02-19T21:57:58.573947+0000","last_unstale":"2024-02-19T22:00:08.692421+0000","last_undegraded":"2024-02-19T22:00:08.692421+0000","last_fullsized":"2024-02-19T22:00:08.692421+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:18.895707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:59:18.895707+0000","last_clean_scrub_stamp":"2024-02-19T21:59:18.895707+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"179'2","reported_seq":333,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.458026+0000","last_change":"2024-02-19T21:59:27.096460+0000","last_active":"2024-02-19T21:59:51.458026+0000","last_peered":"2024-02-19T21:59:51.458026+0000","last_clean":"2024-02-19T21:59:51.458026+0000","last_became_active":"2024-02-19T21:49:08.327186+0000","last_became_peered":"2024-02-19T21:49:08.327186+0000","last_unstale":"2024-02-19T21:59:51.458026+0000","last_undegraded":"2024-02-19T21:59:51.458026+0000","last_fullsized":"2024-02-19T21:59:51.458026+0000","mapping_epoch":394,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":395,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'2","last_scrub_stamp":"2024-02-19T21:59:27.096349+0000","last_deep_scrub":"179'2","last_deep_scrub_stamp":"2024-02-19T21:40:28.696783+0000","last_clean_scrub_stamp":"2024-02-19T21:59:27.096349+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"471'60","reported_seq":758,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:09.028969+0000","last_change":"2024-02-19T22:00:09.028969+0000","last_active":"2024-02-19T22:00:09.028969+0000","last_peered":"2024-02-19T22:00:09.028969+0000","last_clean":"2024-02-19T22:00:09.028969+0000","last_became_active":"2024-02-19T21:49:54.493167+0000","last_became_peered":"2024-02-19T21:49:54.493167+0000","last_unstale":"2024-02-19T22:00:09.028969+0000","last_undegraded":"2024-02-19T22:00:09.028969+0000","last_fullsized":"2024-02-19T22:00:09.028969+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"471'60","last_scrub_stamp":"2024-02-19T22:00:09.028888+0000","last_deep_scrub":"201'44","last_deep_scrub_stamp":"2024-02-19T21:44:16.255049+0000","last_clean_scrub_stamp":"2024-02-19T22:00:09.028888+0000","log_size":60,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":80,"num_read_kb":69,"num_write":52,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":640,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.756546+0000","last_change":"2024-02-19T21:59:15.681687+0000","last_active":"2024-02-19T22:00:08.756546+0000","last_peered":"2024-02-19T22:00:08.756546+0000","last_clean":"2024-02-19T22:00:08.756546+0000","last_became_active":"2024-02-19T21:57:58.570562+0000","last_became_peered":"2024-02-19T21:57:58.570562+0000","last_unstale":"2024-02-19T22:00:08.756546+0000","last_undegraded":"2024-02-19T22:00:08.756546+0000","last_fullsized":"2024-02-19T22:00:08.756546+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:15.681557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:59:15.681557+0000","last_clean_scrub_stamp":"2024-02-19T21:59:15.681557+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":285,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.692997+0000","last_change":"2024-02-19T21:59:33.175583+0000","last_active":"2024-02-19T22:00:08.692997+0000","last_peered":"2024-02-19T22:00:08.692997+0000","last_clean":"2024-02-19T22:00:08.692997+0000","last_became_active":"2024-02-19T21:58:25.595009+0000","last_became_peered":"2024-02-19T21:58:25.595009+0000","last_unstale":"2024-02-19T22:00:08.692997+0000","last_undegraded":"2024-02-19T22:00:08.692997+0000","last_fullsized":"2024-02-19T22:00:08.692997+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:33.175519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:44:15.547129+0000","last_clean_scrub_stamp":"2024-02-19T21:59:33.175519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":634,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:50.840074+0000","last_change":"2024-02-19T21:59:05.451067+0000","last_active":"2024-02-19T21:59:50.840074+0000","last_peered":"2024-02-19T21:59:50.840074+0000","last_clean":"2024-02-19T21:59:50.840074+0000","last_became_active":"2024-02-19T21:53:45.384695+0000","last_became_peered":"2024-02-19T21:53:45.384695+0000","last_unstale":"2024-02-19T21:59:50.840074+0000","last_undegraded":"2024-02-19T21:59:50.840074+0000","last_fullsized":"2024-02-19T21:59:50.840074+0000","mapping_epoch":492,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":493,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:05.451003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:22.333517+0000","last_clean_scrub_stamp":"2024-02-19T21:59:05.451003+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"470'25","reported_seq":604,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.757088+0000","last_change":"2024-02-19T21:59:45.450726+0000","last_active":"2024-02-19T22:00:08.757088+0000","last_peered":"2024-02-19T22:00:08.757088+0000","last_clean":"2024-02-19T22:00:08.757088+0000","last_became_active":"2024-02-19T21:57:58.572050+0000","last_became_peered":"2024-02-19T21:57:58.572050+0000","last_unstale":"2024-02-19T22:00:08.757088+0000","last_undegraded":"2024-02-19T22:00:08.757088+0000","last_fullsized":"2024-02-19T22:00:08.757088+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'25","last_scrub_stamp":"2024-02-19T21:59:45.450632+0000","last_deep_scrub":"377'19","last_deep_scrub_stamp":"2024-02-19T21:48:23.326541+0000","last_clean_scrub_stamp":"2024-02-19T21:59:45.450632+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":28,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":637,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.471482+0000","last_change":"2024-02-19T21:59:17.456086+0000","last_active":"2024-02-19T21:59:51.471482+0000","last_peered":"2024-02-19T21:59:51.471482+0000","last_clean":"2024-02-19T21:59:51.471482+0000","last_became_active":"2024-02-19T21:57:58.567315+0000","last_became_peered":"2024-02-19T21:57:58.567315+0000","last_unstale":"2024-02-19T21:59:51.471482+0000","last_undegraded":"2024-02-19T21:59:51.471482+0000","last_fullsized":"2024-02-19T21:59:51.471482+0000","mapping_epoch":568,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":569,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:17.456007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:36:14.779443+0000","last_clean_scrub_stamp":"2024-02-19T21:59:17.456007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":279,"reported_epoch":611,"state":"active+clean","last_fresh":"2024-02-19T22:00:08.692941+0000","last_change":"2024-02-19T21:59:56.953144+0000","last_active":"2024-02-19T22:00:08.692941+0000","last_peered":"2024-02-19T22:00:08.692941+0000","last_clean":"2024-02-19T22:00:08.692941+0000","last_became_active":"2024-02-19T21:58:25.594931+0000","last_became_peered":"2024-02-19T21:58:25.594931+0000","last_unstale":"2024-02-19T22:00:08.692941+0000","last_undegraded":"2024-02-19T22:00:08.692941+0000","last_fullsized":"2024-02-19T22:00:08.692941+0000","mapping_epoch":579,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":580,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:59:56.953067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:40:29.858805+0000","last_clean_scrub_stamp":"2024-02-19T21:59:56.953067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"470'39","reported_seq":712,"reported_epoch":610,"state":"active+clean","last_fresh":"2024-02-19T21:59:51.471281+0000","last_change":"2024-02-19T21:58:55.423420+0000","last_active":"2024-02-19T21:59:51.471281+0000","last_peered":"2024-02-19T21:59:51.471281+0000","last_clean":"2024-02-19T21:59:51.471281+0000","last_became_active":"2024-02-19T21:49:54.486014+0000","last_became_peered":"2024-02-19T21:49:54.486014+0000","last_unstale":"2024-02-19T21:59:51.471281+0000","last_undegraded":"2024-02-19T21:59:51.471281+0000","last_fullsized":"2024-02-19T21:59:51.471281+0000","mapping_epoch":413,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":414,"parent":"0.0","parent_split_bits":0,"last_scrub":"470'39","last_scrub_stamp":"2024-02-19T21:58:55.423330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:32:24.344047+0000","last_clean_scrub_stamp":"2024-02-19T21:58:55.423330+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":53,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"324'11","reported_seq":968,"reported_epoch":612,"state":"active+clean","last_fresh":"2024-02-19T22:00:11.006139+0000","last_change":"2024-02-19T21:59:02.545323+0000","last_active":"2024-02-19T22:00:11.006139+0000","last_peered":"2024-02-19T22:00:11.006139+0000","last_clean":"2024-02-19T22:00:11.006139+0000","last_became_active":"2024-02-19T21:44:34.385140+0000","last_became_peered":"2024-02-19T21:44:34.385140+0000","last_unstale":"2024-02-19T22:00:11.006139+0000","last_undegraded":"2024-02-19T22:00:11.006139+0000","last_fullsized":"2024-02-19T22:00:11.006139+0000","mapping_epoch":62,"log_start":"66'8","ondisk_log_start":"66'8","created":62,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"324'11","last_scrub_stamp":"2024-02-19T21:59:02.545240+0000","last_deep_scrub":"324'11","last_deep_scrub_stamp":"2024-02-19T21:46:05.210095+0000","last_clean_scrub_stamp":"2024-02-19T21:59:02.545240+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":716,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1645,"num_read_kb":1640,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":778,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":1526,"num_read_kb":1283,"num_write":989,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":370,"num_bytes_recovered":7290,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1087,"ondisk_log_size":1087,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":22,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":67,"ondisk_log_size":67,"up":66,"acting":66,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":369,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201618,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":899300,"kb_used_data":5532,"kb_used_omap":0,"kb_used_meta":893760,"kb_avail":92845852,"statfs":{"total":95995035648,"available":95074152448,"internally_reserved":0,"allocated":5664768,"data_stored":3683076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":915210240},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 22:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.436,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.54600000000000004}]},{"osd":1,"last update":"Mon Feb 19 22:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":1.355,"15min":1.794},"min":{"1min":0.371,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.63,"5min":8.9619999999999997,"15min":68.168000000000006},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":1.256,"15min":1.8799999999999999},"min":{"1min":0.376,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.79000000000000004,"5min":9.7289999999999992,"15min":68.444000000000003},"last":0.56499999999999995}]},{"osd":2,"last update":"Mon Feb 19 21:59:26 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":1.5820000000000001,"15min":1.7509999999999999},"min":{"1min":0.30599999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.76900000000000002,"5min":12.352,"15min":12.352},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":2.0899999999999999,"15min":1.841},"min":{"1min":0.36599999999999999,"5min":0.29599999999999999,"15min":0.28100000000000003},"max":{"1min":0.76500000000000001,"5min":19.129000000000001,"15min":19.129000000000001},"last":0.47999999999999998}]},{"osd":3,"last update":"Mon Feb 19 22:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":1.7969999999999999,"15min":1.7969999999999999},"min":{"1min":0.39100000000000001,"5min":0.30399999999999999,"15min":0.25900000000000001},"max":{"1min":0.78600000000000003,"5min":19.253,"15min":19.253},"last":0.504},{"interface":"front","average":{"1min":0.53400000000000003,"5min":1.409,"15min":1.516},"min":{"1min":0.42299999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.68600000000000005,"5min":8.9920000000000009,"15min":13.473000000000001},"last":0.51600000000000001}]},{"osd":4,"last update":"Mon Feb 19 22:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":1.5309999999999999,"15min":1.589},"min":{"1min":0.371,"5min":0.255,"15min":0.216},"max":{"1min":0.65800000000000003,"5min":12.375,"15min":17.716999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":2.0369999999999999,"15min":1.99},"min":{"1min":0.39200000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.70399999999999996,"5min":19.225000000000001,"15min":19.225000000000001},"last":0.436}]},{"osd":5,"last update":"Mon Feb 19 22:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":1.5640000000000001,"15min":1.677},"min":{"1min":0.41499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.75700000000000001,"5min":14.675000000000001,"15min":29.021000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":1.4470000000000001,"15min":1.774},"min":{"1min":0.45600000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.876,"5min":8.4320000000000004,"15min":29.091999999999999},"last":0.48899999999999999}]},{"osd":6,"last update":"Mon Feb 19 22:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":1.6459999999999999,"15min":1.8500000000000001},"min":{"1min":0.42799999999999999,"5min":0.31900000000000001,"15min":0.24299999999999999},"max":{"1min":0.79700000000000004,"5min":8.7430000000000003,"15min":19.286000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.623,"5min":2.3130000000000002,"15min":2.0550000000000002},"min":{"1min":0.40500000000000003,"5min":0.28899999999999998,"15min":0.26700000000000002},"max":{"1min":0.83099999999999996,"5min":27.899000000000001,"15min":27.899000000000001},"last":0.57399999999999995}]}]},{"osd":6,"up_from":47,"seq":201863463256,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":894516,"kb_used_data":5484,"kb_used_omap":0,"kb_used_meta":889024,"kb_avail":92850636,"statfs":{"total":95995035648,"available":95079051264,"internally_reserved":0,"allocated":5615616,"data_stored":3673613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":910360576},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:59:59 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54500000000000004,"15min":0.54600000000000004},"min":{"1min":0.40699999999999997,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.72399999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.751},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60299999999999998,"15min":0.61099999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.752,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.79100000000000004}]},{"osd":1,"last update":"Mon Feb 19 21:59:48 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":1.516,"15min":1.3540000000000001},"min":{"1min":0.26500000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.81499999999999995,"5min":30.719999999999999,"15min":30.719999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":2.335,"15min":1.7749999999999999},"min":{"1min":0.32000000000000001,"5min":0.27400000000000002,"15min":0.245},"max":{"1min":0.64400000000000002,"5min":31.177,"15min":31.177},"last":0.69799999999999995}]},{"osd":2,"last update":"Mon Feb 19 21:59:28 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":2.1539999999999999,"15min":1.6859999999999999},"min":{"1min":0.35999999999999999,"5min":0.28399999999999997,"15min":0.255},"max":{"1min":0.86499999999999999,"5min":52.920000000000002,"15min":52.920000000000002},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":1.919,"15min":1.3899999999999999},"min":{"1min":0.40999999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.94999999999999996,"5min":53.186999999999998,"15min":53.186999999999998},"last":0.83999999999999997}]},{"osd":3,"last update":"Mon Feb 19 21:59:48 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":1.3160000000000001,"15min":1.298},"min":{"1min":0.38900000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.85199999999999998,"5min":8.0990000000000002,"15min":9.8460000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.53500000000000003,"5min":2.0299999999999998,"15min":1.704},"min":{"1min":0.44700000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.71199999999999997,"5min":21.73,"15min":21.73},"last":0.77800000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:59:48 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":1.3779999999999999,"15min":1.663},"min":{"1min":0.34599999999999997,"5min":0.23100000000000001,"15min":0.23000000000000001},"max":{"1min":0.75700000000000001,"5min":15.134,"15min":18.010000000000002},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":1.2949999999999999,"15min":1.5449999999999999},"min":{"1min":0.35999999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.78500000000000003,"5min":6.6159999999999997,"15min":11.566000000000001},"last":0.65600000000000003}]},{"osd":5,"last update":"Mon Feb 19 21:59:48 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":1.2110000000000001,"15min":2.1749999999999998},"min":{"1min":0.38300000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.73399999999999999,"5min":8.173,"15min":148.589},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.57199999999999995,"5min":1.288,"15min":2.0640000000000001},"min":{"1min":0.35899999999999999,"5min":0.28699999999999998,"15min":0.28399999999999997},"max":{"1min":0.81699999999999995,"5min":16.001000000000001,"15min":148.453},"last":0.71399999999999997}]},{"osd":7,"last update":"Mon Feb 19 21:59:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":1.4930000000000001,"15min":1.7250000000000001},"min":{"1min":0.39900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.71499999999999997,"5min":15.051,"15min":15.051},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":1.5489999999999999,"15min":1.772},"min":{"1min":0.501,"5min":0.34999999999999998,"15min":0.33000000000000002},"max":{"1min":0.90500000000000003,"5min":15.08,"15min":15.08},"last":0.89000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575218,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":914332,"kb_used_data":5524,"kb_used_omap":0,"kb_used_meta":908800,"kb_avail":92830820,"statfs":{"total":95995035648,"available":95058759680,"internally_reserved":0,"allocated":5656576,"data_stored":3675005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":930611200},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:59:58 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.313,"15min":0.309},"min":{"1min":0.215,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.45500000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.37,"15min":0.36599999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.374}]},{"osd":2,"last update":"Mon Feb 19 21:59:34 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":1.262,"15min":0.97599999999999998},"min":{"1min":0.26100000000000001,"5min":0.191,"15min":0.189},"max":{"1min":0.58999999999999997,"5min":10.776999999999999,"15min":10.776999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.33100000000000002,"5min":1.5089999999999999,"15min":1.1140000000000001},"min":{"1min":0.249,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.56799999999999995,"5min":19.199000000000002,"15min":19.199000000000002},"last":0.25800000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:59:34 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":1.4830000000000001,"15min":1.1479999999999999},"min":{"1min":0.245,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.47399999999999998,"5min":19.297999999999998,"15min":19.297999999999998},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":1.2150000000000001,"15min":1.0529999999999999},"min":{"1min":0.32100000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.64700000000000002,"5min":13.029999999999999,"15min":13.029999999999999},"last":0.39700000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":1.5389999999999999,"15min":1.462},"min":{"1min":0.377,"5min":0.25700000000000001,"15min":0.251},"max":{"1min":0.79500000000000004,"5min":19.742000000000001,"15min":19.742000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.61099999999999999,"5min":1.7210000000000001,"15min":1.55},"min":{"1min":0.41099999999999998,"5min":0.32000000000000001,"15min":0.28000000000000003},"max":{"1min":0.81599999999999995,"5min":19.331,"15min":19.331},"last":0.57899999999999996}]},{"osd":5,"last update":"Mon Feb 19 21:59:21 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":1.617,"15min":1.417},"min":{"1min":0.39100000000000001,"5min":0.28199999999999997,"15min":0.27900000000000003},"max":{"1min":0.79100000000000004,"5min":7.649,"15min":14.331},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":1.552,"15min":1.4950000000000001},"min":{"1min":0.41299999999999998,"5min":0.311,"15min":0.307},"max":{"1min":0.80400000000000005,"5min":19.388000000000002,"15min":19.388000000000002},"last":0.46600000000000003}]},{"osd":6,"last update":"Mon Feb 19 21:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":1.577,"15min":1.431},"min":{"1min":0.35899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85199999999999998,"5min":6.6859999999999999,"15min":10.456},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":1.6850000000000001,"15min":1.5289999999999999},"min":{"1min":0.38600000000000001,"5min":0.30399999999999999,"15min":0.29699999999999999},"max":{"1min":0.73399999999999999,"5min":19.359000000000002,"15min":19.359000000000002},"last":0.53800000000000003}]},{"osd":7,"last update":"Mon Feb 19 21:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":1.6950000000000001,"15min":1.5580000000000001},"min":{"1min":0.49399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.83599999999999997,"5min":19.681999999999999,"15min":19.681999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":1.72,"15min":1.548},"min":{"1min":0.50800000000000001,"5min":0.373,"15min":0.35499999999999998},"max":{"1min":0.91000000000000003,"5min":19.774000000000001,"15min":19.774000000000001},"last":0.58499999999999996}]}]},{"osd":0,"up_from":568,"seq":2439541424157,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":365788,"kb_used_data":5524,"kb_used_omap":0,"kb_used_meta":360255,"kb_avail":93379364,"statfs":{"total":95995035648,"available":95620468736,"internally_reserved":0,"allocated":5656576,"data_stored":3682305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":368901172},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 22:00:01 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.254,"5min":0.214,"15min":0.214},"max":{"1min":0.45800000000000002,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.371,"15min":0.374},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.41199999999999998,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.35899999999999999}]},{"osd":2,"last update":"Mon Feb 19 22:00:01 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.39200000000000002,"15min":0.39700000000000002},"min":{"1min":0.26100000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53000000000000003,"5min":0.624,"15min":0.624},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.39500000000000002,"15min":0.40000000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.45500000000000002,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.32000000000000001}]},{"osd":3,"last update":"Mon Feb 19 22:00:01 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.38300000000000001,"15min":0.38800000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.501,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.41299999999999998,"15min":0.41999999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.51500000000000001,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.36799999999999999}]},{"osd":4,"last update":"Mon Feb 19 22:00:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.435,"5min":0.432,"15min":0.432},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41399999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.54100000000000004}]},{"osd":5,"last update":"Mon Feb 19 22:00:01 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.437,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.42799999999999999}]},{"osd":6,"last update":"Mon Feb 19 22:00:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.622,"15min":0.63},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.76800000000000002,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60999999999999999,"15min":0.61399999999999999},"min":{"1min":0.45300000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.47399999999999998}]},{"osd":7,"last update":"Mon Feb 19 22:00:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.59099999999999997,"15min":0.58499999999999996},"min":{"1min":0.46000000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.51200000000000001}]}]},{"osd":2,"up_from":394,"seq":1692217114758,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":325452,"kb_used_data":5508,"kb_used_omap":0,"kb_used_meta":319935,"kb_avail":93419700,"statfs":{"total":95995035648,"available":95661772800,"internally_reserved":0,"allocated":5640192,"data_stored":3682031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":972,"internal_metadata":327613492},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:59:59 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.32900000000000001,"15min":0.33100000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.218},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.34399999999999997,"15min":0.35099999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.24099999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:59:24 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.94599999999999995,"15min":0.72699999999999998},"min":{"1min":0.255,"5min":0.193,"15min":0.193},"max":{"1min":0.47299999999999998,"5min":15.413,"15min":15.413},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.82999999999999996,"15min":0.82899999999999996},"min":{"1min":0.27900000000000003,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.58199999999999996,"5min":4.9349999999999996,"15min":6.992},"last":0.26800000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:59:24 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.83499999999999996,"15min":1.05},"min":{"1min":0.29999999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.64300000000000002,"5min":6.9029999999999996,"15min":6.9470000000000001},"last":0.311},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.93100000000000005,"15min":1.0209999999999999},"min":{"1min":0.26600000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.61899999999999999,"5min":13.537000000000001,"15min":13.537000000000001},"last":0.28399999999999997}]},{"osd":4,"last update":"Mon Feb 19 21:59:24 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":1.387,"15min":1.599},"min":{"1min":0.40500000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.86299999999999999,"5min":9.4540000000000006,"15min":9.4540000000000006},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":1.296,"15min":1.512},"min":{"1min":0.39000000000000001,"5min":0.27600000000000002,"15min":0.26500000000000001},"max":{"1min":0.88,"5min":13.077999999999999,"15min":13.077999999999999},"last":0.64400000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:59:24 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":1.4530000000000001,"15min":1.603},"min":{"1min":0.47799999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.86399999999999999,"5min":10.179,"15min":11.129},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":1.123,"15min":1.333},"min":{"1min":0.376,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.79600000000000004,"5min":7.4749999999999996,"15min":13.558},"last":0.751}]},{"osd":6,"last update":"Mon Feb 19 21:59:24 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":1.508,"15min":1.5860000000000001},"min":{"1min":0.42199999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76800000000000002,"5min":9.3040000000000003,"15min":9.6720000000000006},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":1.476,"15min":1.2370000000000001},"min":{"1min":0.43099999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.80800000000000005,"5min":9.7149999999999999,"15min":9.7149999999999999},"last":0.58199999999999996}]},{"osd":7,"last update":"Mon Feb 19 21:59:24 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":1.2869999999999999,"15min":1.3360000000000001},"min":{"1min":0.40400000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83899999999999997,"5min":7.5350000000000001,"15min":7.5350000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":1.3560000000000001,"15min":1.1200000000000001},"min":{"1min":0.48399999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.91600000000000004,"5min":6.8890000000000002,"15min":8.7780000000000005},"last":0.64900000000000002}]}]},{"osd":3,"up_from":26,"seq":111669150056,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":302740,"kb_used_data":5516,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93442412,"statfs":{"total":95995035648,"available":95685029888,"internally_reserved":0,"allocated":5648384,"data_stored":3673840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:59:59 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.42499999999999999,"15min":0.44},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.55100000000000005,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.40500000000000003,"15min":0.41299999999999998},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.505,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.36199999999999999}]},{"osd":1,"last update":"Mon Feb 19 21:59:27 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":3.081,"15min":1.7669999999999999},"min":{"1min":0.22,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.51700000000000002,"5min":178.30000000000001,"15min":178.30000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.373,"5min":1.258,"15min":1.1439999999999999},"min":{"1min":0.23999999999999999,"5min":0.19,"15min":0.186},"max":{"1min":0.57999999999999996,"5min":9.7089999999999996,"15min":62.631},"last":0.28299999999999997}]},{"osd":2,"last update":"Mon Feb 19 21:59:27 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":1.419,"15min":1.0509999999999999},"min":{"1min":0.25800000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.55700000000000005,"5min":10.318,"15min":32.323999999999998},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":1.4419999999999999,"15min":1.3919999999999999},"min":{"1min":0.28399999999999997,"5min":0.187,"15min":0.187},"max":{"1min":0.54500000000000004,"5min":12.449,"15min":32.103999999999999},"last":0.32300000000000001}]},{"osd":4,"last update":"Mon Feb 19 21:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":1.367,"15min":1.2190000000000001},"min":{"1min":0.43099999999999999,"5min":0.27600000000000002,"15min":0.25700000000000001},"max":{"1min":0.89000000000000001,"5min":15.646000000000001,"15min":15.646000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":1.4179999999999999,"15min":1.2310000000000001},"min":{"1min":0.379,"5min":0.308,"15min":0.26700000000000002},"max":{"1min":0.76600000000000001,"5min":10.285,"15min":10.285},"last":0.41199999999999998}]},{"osd":5,"last update":"Mon Feb 19 22:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":1.339,"15min":1.3009999999999999},"min":{"1min":0.41099999999999998,"5min":0.30499999999999999,"15min":0.29899999999999999},"max":{"1min":0.748,"5min":15.704000000000001,"15min":15.704000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":1.468,"15min":1.3899999999999999},"min":{"1min":0.38800000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78900000000000003,"5min":11.465,"15min":12.635},"last":0.442}]},{"osd":6,"last update":"Mon Feb 19 21:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":1.54,"15min":1.5089999999999999},"min":{"1min":0.41799999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.95799999999999996,"5min":15.779,"15min":22.759},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.622,"5min":1.5229999999999999,"15min":1.46},"min":{"1min":0.44,"5min":0.308,"15min":0.29099999999999998},"max":{"1min":0.879,"5min":9.1419999999999995,"15min":22.608000000000001},"last":0.54500000000000004}]},{"osd":7,"last update":"Mon Feb 19 21:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":1.5349999999999999,"15min":1.5549999999999999},"min":{"1min":0.437,"5min":0.35899999999999999,"15min":0.28599999999999998},"max":{"1min":0.86799999999999999,"5min":10.286,"15min":12.494},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":1.46,"15min":1.3720000000000001},"min":{"1min":0.44,"5min":0.38300000000000001,"15min":0.34599999999999997},"max":{"1min":0.98399999999999999,"5min":15.749000000000001,"15min":15.749000000000001},"last":0.53300000000000003}]}]},{"osd":4,"up_from":32,"seq":137438953825,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":897352,"kb_used_data":5504,"kb_used_omap":0,"kb_used_meta":891840,"kb_avail":92847800,"statfs":{"total":95995035648,"available":95076147200,"internally_reserved":0,"allocated":5636096,"data_stored":3673508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":913244160},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 22:00:02 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.57299999999999995,"15min":0.56499999999999995},"min":{"1min":0.48499999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.47199999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.64300000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:59:46 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":1.851,"15min":2.4260000000000002},"min":{"1min":0.38600000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.85399999999999998,"5min":10.233000000000001,"15min":156.72999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":1.7290000000000001,"15min":2.302},"min":{"1min":0.32400000000000001,"5min":0.28299999999999997,"15min":0.252},"max":{"1min":0.75600000000000001,"5min":10.217000000000001,"15min":156.83000000000001},"last":0.65400000000000003}]},{"osd":2,"last update":"Mon Feb 19 21:59:25 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":1.6970000000000001,"15min":1.7809999999999999},"min":{"1min":0.34100000000000003,"5min":0.28999999999999998,"15min":0.255},"max":{"1min":0.89300000000000002,"5min":9.7690000000000001,"15min":12.516999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":1.7270000000000001,"15min":1.8169999999999999},"min":{"1min":0.38800000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.79500000000000004,"5min":9.7850000000000001,"15min":12.541},"last":0.68200000000000005}]},{"osd":3,"last update":"Mon Feb 19 21:59:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":1.109,"15min":1.2669999999999999},"min":{"1min":0.39200000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.871,"5min":9.1850000000000005,"15min":9.9529999999999994},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":1.5860000000000001,"15min":1.526},"min":{"1min":0.443,"5min":0.253,"15min":0.253},"max":{"1min":0.67700000000000005,"5min":9.8070000000000004,"15min":12.486000000000001},"last":0.70799999999999996}]},{"osd":5,"last update":"Mon Feb 19 21:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":1.542,"15min":1.7929999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.23400000000000001},"max":{"1min":0.63100000000000001,"5min":10.278,"15min":16.731999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":1.4179999999999999,"15min":1.663},"min":{"1min":0.35899999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.71099999999999997,"5min":9.2989999999999995,"15min":14.532999999999999},"last":0.50600000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:59:46 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":1.331,"15min":1.5669999999999999},"min":{"1min":0.34799999999999998,"5min":0.27600000000000002,"15min":0.27200000000000002},"max":{"1min":0.70999999999999996,"5min":9.3409999999999993,"15min":10.233000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":2.0419999999999998,"15min":1.978},"min":{"1min":0.38500000000000001,"5min":0.29799999999999999,"15min":0.23699999999999999},"max":{"1min":0.746,"5min":12.85,"15min":18.670000000000002},"last":0.52600000000000002}]},{"osd":7,"last update":"Mon Feb 19 21:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":1.5609999999999999,"15min":1.7869999999999999},"min":{"1min":0.41299999999999998,"5min":0.32100000000000001,"15min":0.30199999999999999},"max":{"1min":1.0960000000000001,"5min":10.250999999999999,"15min":16.763999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.64800000000000002,"5min":1.419,"15min":1.4870000000000001},"min":{"1min":0.45700000000000002,"5min":0.218,"15min":0.218},"max":{"1min":1.2050000000000001,"5min":9.3659999999999997,"15min":12.958},"last":0.55000000000000004}]}]},{"osd":5,"up_from":38,"seq":163208757597,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":887736,"kb_used_data":5488,"kb_used_omap":0,"kb_used_meta":882240,"kb_avail":92857416,"statfs":{"total":95995035648,"available":95085993984,"internally_reserved":0,"allocated":5619712,"data_stored":3673411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":903413760},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 22:00:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65000000000000002,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.60599999999999998,"15min":0.60299999999999998},"min":{"1min":0.56599999999999995,"5min":0.441,"15min":0.441},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.66700000000000004}]},{"osd":1,"last update":"Mon Feb 19 21:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":1.2569999999999999,"15min":1.3560000000000001},"min":{"1min":0.41099999999999998,"5min":0.23599999999999999,"15min":0.23100000000000001},"max":{"1min":0.72599999999999998,"5min":9.7560000000000002,"15min":9.7560000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":1.5680000000000001,"15min":1.512},"min":{"1min":0.39800000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.65800000000000003,"5min":7.1449999999999996,"15min":11.654},"last":0.58599999999999997}]},{"osd":2,"last update":"Mon Feb 19 21:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":2.0960000000000001,"15min":1.7470000000000001},"min":{"1min":0.46500000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.67200000000000004,"5min":79.257000000000005,"15min":79.257000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":2.742,"15min":1.867},"min":{"1min":0.42799999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.75,"5min":79.030000000000001,"15min":79.030000000000001},"last":0.68700000000000006}]},{"osd":3,"last update":"Mon Feb 19 21:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":1.5129999999999999,"15min":1.6679999999999999},"min":{"1min":0.38500000000000001,"5min":0.26200000000000001,"15min":0.26100000000000001},"max":{"1min":0.68999999999999995,"5min":10.743,"15min":19.321000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":1.4550000000000001,"15min":1.5289999999999999},"min":{"1min":0.39300000000000002,"5min":0.318,"15min":0.311},"max":{"1min":0.79500000000000004,"5min":7.5780000000000003,"15min":9.0269999999999992},"last":0.70599999999999996}]},{"osd":4,"last update":"Mon Feb 19 21:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":1.476,"15min":1.5009999999999999},"min":{"1min":0.33300000000000002,"5min":0.224,"15min":0.20899999999999999},"max":{"1min":0.97899999999999998,"5min":16.748000000000001,"15min":16.748000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":1.5920000000000001,"15min":1.7290000000000001},"min":{"1min":0.36399999999999999,"5min":0.26800000000000002,"15min":0.23899999999999999},"max":{"1min":0.80800000000000005,"5min":12.691000000000001,"15min":19.274000000000001},"last":0.45200000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:59:48 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":1.6379999999999999,"15min":1.9279999999999999},"min":{"1min":0.34899999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.91400000000000003,"5min":10.779,"15min":19.884},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":1.5189999999999999,"15min":1.6419999999999999},"min":{"1min":0.36399999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.84399999999999997,"5min":12.428000000000001,"15min":12.428000000000001},"last":0.61699999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:59:13 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":1.2909999999999999,"15min":1.671},"min":{"1min":0.377,"5min":0.29899999999999999,"15min":0.27100000000000002},"max":{"1min":0.95899999999999996,"5min":7.5300000000000002,"15min":12.611000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":1.5569999999999999,"15min":1.7569999999999999},"min":{"1min":0.443,"5min":0.29299999999999998,"15min":0.221},"max":{"1min":0.89200000000000002,"5min":10.324,"15min":15.593999999999999},"last":0.63}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T22:00:16.258 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2024-02-19T22:00:16.258 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 -- ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-02-19T22:00:16.526 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/mon.a/config 2024-02-19T22:00:16.804 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:14.860809+0000 osd.6 (osd.6) 357 : cluster [DBG] 5.11 scrub starts 2024-02-19T22:00:16.804 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:14.863723+0000 osd.6 (osd.6) 358 : cluster [DBG] 5.11 scrub ok 2024-02-19T22:00:16.804 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:15.124832+0000 osd.0 (osd.0) 67 : cluster [DBG] 6.18 scrub starts 2024-02-19T22:00:16.804 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:15.128511+0000 osd.0 (osd.0) 68 : cluster [DBG] 6.18 scrub ok 2024-02-19T22:00:16.804 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:15.373397+0000 mgr.y (mgr.14514) 1051 : cluster [DBG] pgmap v1366: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T22:00:16.805 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T22:00:15.438072+0000 mgr.y (mgr.14514) 1052 : audit [DBG] from='client.16488 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T22:00:16.805 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:14.860809+0000 osd.6 (osd.6) 357 : cluster [DBG] 5.11 scrub starts 2024-02-19T22:00:16.805 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:14.863723+0000 osd.6 (osd.6) 358 : cluster [DBG] 5.11 scrub ok 2024-02-19T22:00:16.805 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:15.124832+0000 osd.0 (osd.0) 67 : cluster [DBG] 6.18 scrub starts 2024-02-19T22:00:16.805 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:15.128511+0000 osd.0 (osd.0) 68 : cluster [DBG] 6.18 scrub ok 2024-02-19T22:00:16.805 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:15.373397+0000 mgr.y (mgr.14514) 1051 : cluster [DBG] pgmap v1366: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T22:00:16.805 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:16 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T22:00:15.438072+0000 mgr.y (mgr.14514) 1052 : audit [DBG] from='client.16488 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T22:00:16.805 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:14.860809+0000 osd.6 (osd.6) 357 : cluster [DBG] 5.11 scrub starts 2024-02-19T22:00:16.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:14.863723+0000 osd.6 (osd.6) 358 : cluster [DBG] 5.11 scrub ok 2024-02-19T22:00:16.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:15.124832+0000 osd.0 (osd.0) 67 : cluster [DBG] 6.18 scrub starts 2024-02-19T22:00:16.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:15.128511+0000 osd.0 (osd.0) 68 : cluster [DBG] 6.18 scrub ok 2024-02-19T22:00:16.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:15.373397+0000 mgr.y (mgr.14514) 1051 : cluster [DBG] pgmap v1366: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-19T22:00:16.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T22:00:15.438072+0000 mgr.y (mgr.14514) 1052 : audit [DBG] from='client.16488 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T22:00:17.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:16.150375+0000 osd.0 (osd.0) 69 : cluster [DBG] 4.6 scrub starts 2024-02-19T22:00:17.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:16.152437+0000 osd.0 (osd.0) 70 : cluster [DBG] 4.6 scrub ok 2024-02-19T22:00:17.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:16.939028+0000 osd.2 (osd.2) 129 : cluster [DBG] 5.6 scrub starts 2024-02-19T22:00:17.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:16.940255+0000 osd.2 (osd.2) 130 : cluster [DBG] 5.6 scrub ok 2024-02-19T22:00:17.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:16.150375+0000 osd.0 (osd.0) 69 : cluster [DBG] 4.6 scrub starts 2024-02-19T22:00:17.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:16.152437+0000 osd.0 (osd.0) 70 : cluster [DBG] 4.6 scrub ok 2024-02-19T22:00:17.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:16.939028+0000 osd.2 (osd.2) 129 : cluster [DBG] 5.6 scrub starts 2024-02-19T22:00:17.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:16.940255+0000 osd.2 (osd.2) 130 : cluster [DBG] 5.6 scrub ok 2024-02-19T22:00:17.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:16.150375+0000 osd.0 (osd.0) 69 : cluster [DBG] 4.6 scrub starts 2024-02-19T22:00:17.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:16.152437+0000 osd.0 (osd.0) 70 : cluster [DBG] 4.6 scrub ok 2024-02-19T22:00:17.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:16.939028+0000 osd.2 (osd.2) 129 : cluster [DBG] 5.6 scrub starts 2024-02-19T22:00:17.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:17 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:16.940255+0000 osd.2 (osd.2) 130 : cluster [DBG] 5.6 scrub ok 2024-02-19T22:00:18.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:17.157873+0000 osd.0 (osd.0) 71 : cluster [DBG] 6.10 scrub starts 2024-02-19T22:00:18.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:17.160861+0000 osd.0 (osd.0) 72 : cluster [DBG] 6.10 scrub ok 2024-02-19T22:00:18.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:17.374186+0000 mgr.y (mgr.14514) 1053 : cluster [DBG] pgmap v1367: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T22:00:18.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T22:00:18.520595+0000 mon.c (mon.2) 155 : audit [INF] from='client.? 172.21.15.80:0/2623138570' entity='client.admin' cmd=[{"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"}]: dispatch 2024-02-19T22:00:18.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T22:00:18.521013+0000 mon.a (mon.0) 2186 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"}]: dispatch 2024-02-19T22:00:18.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T22:00:18.524751+0000 mon.a (mon.0) 2187 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"}]': finished 2024-02-19T22:00:18.845 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:17.157873+0000 osd.0 (osd.0) 71 : cluster [DBG] 6.10 scrub starts 2024-02-19T22:00:18.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:17.160861+0000 osd.0 (osd.0) 72 : cluster [DBG] 6.10 scrub ok 2024-02-19T22:00:18.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:17.374186+0000 mgr.y (mgr.14514) 1053 : cluster [DBG] pgmap v1367: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T22:00:18.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T22:00:18.520595+0000 mon.c (mon.2) 155 : audit [INF] from='client.? 172.21.15.80:0/2623138570' entity='client.admin' cmd=[{"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"}]: dispatch 2024-02-19T22:00:18.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T22:00:18.521013+0000 mon.a (mon.0) 2186 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"}]: dispatch 2024-02-19T22:00:18.846 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T22:00:18.524751+0000 mon.a (mon.0) 2187 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"}]': finished 2024-02-19T22:00:18.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:17.157873+0000 osd.0 (osd.0) 71 : cluster [DBG] 6.10 scrub starts 2024-02-19T22:00:18.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:17.160861+0000 osd.0 (osd.0) 72 : cluster [DBG] 6.10 scrub ok 2024-02-19T22:00:18.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:17.374186+0000 mgr.y (mgr.14514) 1053 : cluster [DBG] pgmap v1367: 122 pgs: 122 active+clean; 5.7 KiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-19T22:00:18.846 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T22:00:18.520595+0000 mon.c (mon.2) 155 : audit [INF] from='client.? 172.21.15.80:0/2623138570' entity='client.admin' cmd=[{"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"}]: dispatch 2024-02-19T22:00:18.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T22:00:18.521013+0000 mon.a (mon.0) 2186 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"}]: dispatch 2024-02-19T22:00:18.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T22:00:18.524751+0000 mon.a (mon.0) 2187 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"}]': finished 2024-02-19T22:00:18.847 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 22:00:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:22:00:18] ENGINE Bus STOPPING 2024-02-19T22:00:18.847 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 22:00:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:22:00:18] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-19T22:00:18.847 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 22:00:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:22:00:18] ENGINE Bus STOPPED 2024-02-19T22:00:18.847 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 22:00:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:22:00:18] ENGINE Bus STARTING 2024-02-19T22:00:18.847 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 22:00:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:22:00:18] ENGINE Serving on http://:::9283 2024-02-19T22:00:18.847 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 22:00:18 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:22:00:18] ENGINE Bus STARTED 2024-02-19T22:00:19.315 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-02-19T22:00:19.325 INFO:tasks.cephadm:Teardown begin 2024-02-19T22:00:19.325 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-19T22:00:19.374 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-19T22:00:19.421 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-02-19T22:00:19.421 DEBUG:teuthology.orchestra.run.smithi080:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-19T22:00:19.438 DEBUG:teuthology.orchestra.run.smithi157:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-19T22:00:19.458 INFO:tasks.cephadm:Stopping all daemons... 2024-02-19T22:00:19.458 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-02-19T22:00:19.458 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-6f763558-cf6d-11ee-95bb-87774f69a715@mon.a 2024-02-19T22:00:19.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:18.281812+0000 osd.7 (osd.7) 393 : cluster [DBG] 2.5 deep-scrub starts 2024-02-19T22:00:19.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:18.284720+0000 osd.7 (osd.7) 394 : cluster [DBG] 2.5 deep-scrub ok 2024-02-19T22:00:19.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T22:00:18.574085+0000 mon.a (mon.0) 2188 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:00:19.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T22:00:18.820892+0000 mon.a (mon.0) 2189 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T22:00:19.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T22:00:18.821729+0000 mon.a (mon.0) 2190 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:00:19.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T22:00:18.822276+0000 mon.a (mon.0) 2191 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:00:19.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: audit 2024-02-19T22:00:18.825987+0000 mon.a (mon.0) 2192 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T22:00:19.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:18.985917+0000 osd.3 (osd.3) 347 : cluster [DBG] 4.11 deep-scrub starts 2024-02-19T22:00:19.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: cluster 2024-02-19T22:00:18.989721+0000 osd.3 (osd.3) 348 : cluster [DBG] 4.11 deep-scrub ok 2024-02-19T22:00:19.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:19 smithi080 systemd[1]: Stopping Ceph mon.a for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T22:00:19.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:19 smithi080 bash[216056]: Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon.a" found: no such container 2024-02-19T22:00:19.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:18.281812+0000 osd.7 (osd.7) 393 : cluster [DBG] 2.5 deep-scrub starts 2024-02-19T22:00:19.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:18.284720+0000 osd.7 (osd.7) 394 : cluster [DBG] 2.5 deep-scrub ok 2024-02-19T22:00:19.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T22:00:18.574085+0000 mon.a (mon.0) 2188 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:00:19.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T22:00:18.820892+0000 mon.a (mon.0) 2189 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T22:00:19.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T22:00:18.821729+0000 mon.a (mon.0) 2190 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:00:19.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T22:00:18.822276+0000 mon.a (mon.0) 2191 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:00:19.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: audit 2024-02-19T22:00:18.825987+0000 mon.a (mon.0) 2192 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T22:00:19.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:18.985917+0000 osd.3 (osd.3) 347 : cluster [DBG] 4.11 deep-scrub starts 2024-02-19T22:00:19.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: cluster 2024-02-19T22:00:18.989721+0000 osd.3 (osd.3) 348 : cluster [DBG] 4.11 deep-scrub ok 2024-02-19T22:00:19.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:18.281812+0000 osd.7 (osd.7) 393 : cluster [DBG] 2.5 deep-scrub starts 2024-02-19T22:00:19.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:18.284720+0000 osd.7 (osd.7) 394 : cluster [DBG] 2.5 deep-scrub ok 2024-02-19T22:00:19.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T22:00:18.574085+0000 mon.a (mon.0) 2188 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:00:19.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T22:00:18.820892+0000 mon.a (mon.0) 2189 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T22:00:19.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T22:00:18.821729+0000 mon.a (mon.0) 2190 : audit [DBG] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:00:19.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T22:00:18.822276+0000 mon.a (mon.0) 2191 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:00:19.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: audit 2024-02-19T22:00:18.825987+0000 mon.a (mon.0) 2192 : audit [INF] from='mgr.14514 172.21.15.80:0/3890192514' entity='mgr.y' 2024-02-19T22:00:19.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:18.985917+0000 osd.3 (osd.3) 347 : cluster [DBG] 4.11 deep-scrub starts 2024-02-19T22:00:19.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: cluster 2024-02-19T22:00:18.989721+0000 osd.3 (osd.3) 348 : cluster [DBG] 4.11 deep-scrub ok 2024-02-19T22:00:20.095 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T22:00:19.784+0000 7f2489c44700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-19T22:00:20.108 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a[38220]: debug 2024-02-19T22:00:19.784+0000 7f2489c44700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-02-19T22:00:20.109 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 22:00:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:22:00:19] ENGINE Bus STOPPING 2024-02-19T22:00:20.109 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 22:00:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:22:00:19] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-19T22:00:20.109 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 22:00:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:22:00:19] ENGINE Bus STOPPED 2024-02-19T22:00:20.109 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 22:00:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:22:00:19] ENGINE Bus STARTING 2024-02-19T22:00:20.109 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 22:00:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:22:00:19] ENGINE Serving on http://:::9283 2024-02-19T22:00:20.109 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 22:00:19 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:22:00:19] ENGINE Bus STARTED 2024-02-19T22:00:20.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 19 22:00:20 smithi080 bash[216097]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-a 2024-02-19T22:00:20.802 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@mon.a.service' 2024-02-19T22:00:20.842 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T22:00:20.842 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-02-19T22:00:20.842 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2024-02-19T22:00:20.842 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-6f763558-cf6d-11ee-95bb-87774f69a715@mon.c 2024-02-19T22:00:21.095 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 22:00:20 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: ::ffff:172.21.15.157 - - [19/Feb/2024:22:00:20] "GET /metrics HTTP/1.1" 200 174243 "" "Prometheus/2.33.4" 2024-02-19T22:00:21.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:20 smithi080 systemd[1]: Stopping Ceph mon.c for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T22:00:21.096 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:20 smithi080 bash[216226]: Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon.c" found: no such container 2024-02-19T22:00:21.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T22:00:21.186+0000 7f1b7dba0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-19T22:00:21.596 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c[45159]: debug 2024-02-19T22:00:21.186+0000 7f1b7dba0700 -1 mon.c@2(peon) e3 *** Got Signal Terminated *** 2024-02-19T22:00:21.596 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 22:00:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:22:00:21] ENGINE Bus STOPPING 2024-02-19T22:00:21.596 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 22:00:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:22:00:21] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-19T22:00:21.596 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 22:00:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:22:00:21] ENGINE Bus STOPPED 2024-02-19T22:00:21.596 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 22:00:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:22:00:21] ENGINE Bus STARTING 2024-02-19T22:00:21.596 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 22:00:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:22:00:21] ENGINE Serving on http://:::9283 2024-02-19T22:00:21.596 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 22:00:21 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: [19/Feb/2024:22:00:21] ENGINE Bus STARTED 2024-02-19T22:00:22.056 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 22:00:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug there is no tcmu-runner data available 2024-02-19T22:00:22.095 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 19 22:00:21 smithi080 bash[216266]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-c 2024-02-19T22:00:22.126 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@mon.c.service' 2024-02-19T22:00:22.162 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T22:00:22.162 INFO:tasks.cephadm.mon.b:Stopped mon.c 2024-02-19T22:00:22.163 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-02-19T22:00:22.163 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-6f763558-cf6d-11ee-95bb-87774f69a715@mon.b 2024-02-19T22:00:22.547 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:22 smithi157 systemd[1]: Stopping Ceph mon.b for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T22:00:22.547 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:22 smithi157 bash[129263]: Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon.b" found: no such container 2024-02-19T22:00:22.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T22:00:22.547+0000 7f019703d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-19T22:00:22.806 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b[39569]: debug 2024-02-19T22:00:22.547+0000 7f019703d700 -1 mon.b@1(peon) e3 *** Got Signal Terminated *** 2024-02-19T22:00:23.306 INFO:journalctl@ceph.mon.b.smithi157.stdout:Feb 19 22:00:23 smithi157 bash[129303]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mon-b 2024-02-19T22:00:23.601 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@mon.b.service' 2024-02-19T22:00:23.643 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T22:00:23.643 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-02-19T22:00:23.644 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-02-19T22:00:23.644 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-6f763558-cf6d-11ee-95bb-87774f69a715@mgr.y 2024-02-19T22:00:23.951 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 22:00:23 smithi080 systemd[1]: Stopping Ceph mgr.y for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T22:00:23.951 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 22:00:23 smithi080 bash[216395]: Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr.y" found: no such container 2024-02-19T22:00:23.951 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 22:00:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T22:00:23.950+0000 7fb10d4b6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-19T22:00:23.951 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 22:00:23 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y[38496]: debug 2024-02-19T22:00:23.950+0000 7fb10d4b6700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-02-19T22:00:24.595 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 19 22:00:24 smithi080 bash[216434]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-y 2024-02-19T22:00:24.821 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@mgr.y.service' 2024-02-19T22:00:24.859 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T22:00:24.859 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-02-19T22:00:24.859 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-02-19T22:00:24.859 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-6f763558-cf6d-11ee-95bb-87774f69a715@mgr.x 2024-02-19T22:00:25.306 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 22:00:24 smithi157 systemd[1]: Stopping Ceph mgr.x for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T22:00:25.306 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 22:00:24 smithi157 bash[129424]: Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr.x" found: no such container 2024-02-19T22:00:25.806 INFO:journalctl@ceph.mgr.x.smithi157.stdout:Feb 19 22:00:25 smithi157 bash[129464]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715-mgr-x 2024-02-19T22:00:26.047 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@mgr.x.service' 2024-02-19T22:00:26.083 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T22:00:26.083 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-02-19T22:00:26.083 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-02-19T22:00:26.083 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.0 2024-02-19T22:00:26.406 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 22:00:26 smithi080 systemd[1]: Stopping Ceph osd.0 for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T22:00:26.406 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 22:00:26 smithi080 bash[216553]: Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T22:00:26.845 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 22:00:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-0[205215]: debug 2024-02-19T22:00:26.406+0000 7f36ff240700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-19T22:00:26.846 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 22:00:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-0[205215]: debug 2024-02-19T22:00:26.406+0000 7f36ff240700 -1 osd.0 612 *** Got signal Terminated *** 2024-02-19T22:00:26.846 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 22:00:26 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-0[205215]: debug 2024-02-19T22:00:26.406+0000 7f36ff240700 -1 osd.0 612 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T22:00:32.096 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 19 22:00:31 smithi080 bash[216592]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-0 2024-02-19T22:00:33.798 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.0.service' 2024-02-19T22:00:33.838 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T22:00:33.839 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-02-19T22:00:33.839 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-02-19T22:00:33.839 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.1 2024-02-19T22:00:34.096 INFO:journalctl@ceph.osd.1.smithi080.stdout:Feb 19 22:00:33 smithi080 systemd[1]: Stopping Ceph osd.1 for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T22:00:34.096 INFO:journalctl@ceph.osd.1.smithi080.stdout:Feb 19 22:00:33 smithi080 bash[216825]: Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T22:00:34.595 INFO:journalctl@ceph.osd.1.smithi080.stdout:Feb 19 22:00:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-1[53250]: debug 2024-02-19T22:00:34.224+0000 7f8b8f729700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-19T22:00:34.595 INFO:journalctl@ceph.osd.1.smithi080.stdout:Feb 19 22:00:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-1[53250]: debug 2024-02-19T22:00:34.224+0000 7f8b8f729700 -1 osd.1 612 *** Got signal Terminated *** 2024-02-19T22:00:34.596 INFO:journalctl@ceph.osd.1.smithi080.stdout:Feb 19 22:00:34 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-1[53250]: debug 2024-02-19T22:00:34.224+0000 7f8b8f729700 -1 osd.1 612 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T22:00:40.095 INFO:journalctl@ceph.osd.1.smithi080.stdout:Feb 19 22:00:39 smithi080 bash[216866]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-1 2024-02-19T22:00:41.735 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.1.service' 2024-02-19T22:00:41.776 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T22:00:41.776 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-02-19T22:00:41.776 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-02-19T22:00:41.777 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.2 2024-02-19T22:00:42.082 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 22:00:41 smithi080 systemd[1]: Stopping Ceph osd.2 for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T22:00:42.083 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 22:00:41 smithi080 bash[217118]: Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T22:00:42.345 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 22:00:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-2[153400]: debug 2024-02-19T22:00:42.082+0000 7f158be7e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-19T22:00:42.346 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 22:00:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-2[153400]: debug 2024-02-19T22:00:42.082+0000 7f158be7e700 -1 osd.2 612 *** Got signal Terminated *** 2024-02-19T22:00:42.346 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 22:00:42 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-2[153400]: debug 2024-02-19T22:00:42.082+0000 7f158be7e700 -1 osd.2 612 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T22:00:47.846 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 19 22:00:47 smithi080 bash[217158]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-2 2024-02-19T22:00:49.495 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.2.service' 2024-02-19T22:00:49.537 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T22:00:49.537 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-02-19T22:00:49.537 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-02-19T22:00:49.537 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.3 2024-02-19T22:00:49.846 INFO:journalctl@ceph.osd.3.smithi080.stdout:Feb 19 22:00:49 smithi080 systemd[1]: Stopping Ceph osd.3 for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T22:00:49.846 INFO:journalctl@ceph.osd.3.smithi080.stdout:Feb 19 22:00:49 smithi080 bash[217392]: Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T22:00:50.345 INFO:journalctl@ceph.osd.3.smithi080.stdout:Feb 19 22:00:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-3[62193]: debug 2024-02-19T22:00:49.870+0000 7f1a77f1d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-19T22:00:50.346 INFO:journalctl@ceph.osd.3.smithi080.stdout:Feb 19 22:00:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-3[62193]: debug 2024-02-19T22:00:49.870+0000 7f1a77f1d700 -1 osd.3 612 *** Got signal Terminated *** 2024-02-19T22:00:50.346 INFO:journalctl@ceph.osd.3.smithi080.stdout:Feb 19 22:00:49 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-3[62193]: debug 2024-02-19T22:00:49.870+0000 7f1a77f1d700 -1 osd.3 612 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T22:00:52.306 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:00:51 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:00:51.912+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:27.205222+0000 front 2024-02-19T22:00:27.205285+0000 (oldest deadline 2024-02-19T22:00:51.904957+0000) 2024-02-19T22:00:52.345 INFO:journalctl@ceph.osd.3.smithi080.stdout:Feb 19 22:00:51 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-3[62193]: debug 2024-02-19T22:00:51.977+0000 7f1a7569b700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:30.059393+0000 front 2024-02-19T22:00:30.059476+0000 (oldest deadline 2024-02-19T22:00:51.759585+0000) 2024-02-19T22:00:53.306 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:00:52 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:00:52.956+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:27.205222+0000 front 2024-02-19T22:00:27.205285+0000 (oldest deadline 2024-02-19T22:00:51.904957+0000) 2024-02-19T22:00:53.345 INFO:journalctl@ceph.osd.3.smithi080.stdout:Feb 19 22:00:52 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-3[62193]: debug 2024-02-19T22:00:52.970+0000 7f1a7569b700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:30.059393+0000 front 2024-02-19T22:00:30.059476+0000 (oldest deadline 2024-02-19T22:00:51.759585+0000) 2024-02-19T22:00:54.250 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:00:53 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:00:53.983+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:27.205222+0000 front 2024-02-19T22:00:27.205285+0000 (oldest deadline 2024-02-19T22:00:51.904957+0000) 2024-02-19T22:00:54.346 INFO:journalctl@ceph.osd.3.smithi080.stdout:Feb 19 22:00:53 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-3[62193]: debug 2024-02-19T22:00:53.980+0000 7f1a7569b700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:30.059393+0000 front 2024-02-19T22:00:30.059476+0000 (oldest deadline 2024-02-19T22:00:51.759585+0000) 2024-02-19T22:00:54.556 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 19 22:00:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-4[43854]: debug 2024-02-19T22:00:54.250+0000 7f778a01a700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:30.876116+0000 front 2024-02-19T22:00:30.876284+0000 (oldest deadline 2024-02-19T22:00:53.776113+0000) 2024-02-19T22:00:54.556 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:00:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T22:00:54.251+0000 7f32cc87f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:28.736613+0000 front 2024-02-19T22:00:28.736635+0000 (oldest deadline 2024-02-19T22:00:54.036467+0000) 2024-02-19T22:00:54.557 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:00:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:00:54.297+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:00:55.248 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 19 22:00:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-4[43854]: debug 2024-02-19T22:00:55.218+0000 7f778a01a700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:30.876116+0000 front 2024-02-19T22:00:30.876284+0000 (oldest deadline 2024-02-19T22:00:53.776113+0000) 2024-02-19T22:00:55.249 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:00:54 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:00:54.974+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:27.205222+0000 front 2024-02-19T22:00:27.205285+0000 (oldest deadline 2024-02-19T22:00:51.904957+0000) 2024-02-19T22:00:55.249 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:00:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T22:00:55.211+0000 7f32cc87f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:28.736613+0000 front 2024-02-19T22:00:28.736635+0000 (oldest deadline 2024-02-19T22:00:54.036467+0000) 2024-02-19T22:00:55.555 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:00:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:00:55.248+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:00:55.595 INFO:journalctl@ceph.osd.3.smithi080.stdout:Feb 19 22:00:55 smithi080 bash[217430]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-3 2024-02-19T22:00:56.206 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:00:55 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:00:55.940+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:27.205222+0000 front 2024-02-19T22:00:27.205285+0000 (oldest deadline 2024-02-19T22:00:51.904957+0000) 2024-02-19T22:00:56.556 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:00:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T22:00:56.217+0000 7f32cc87f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:28.736613+0000 front 2024-02-19T22:00:28.736635+0000 (oldest deadline 2024-02-19T22:00:54.036467+0000) 2024-02-19T22:00:56.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:00:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:00:56.206+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:00:56.556 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 19 22:00:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-4[43854]: debug 2024-02-19T22:00:56.209+0000 7f778a01a700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:30.876116+0000 front 2024-02-19T22:00:30.876284+0000 (oldest deadline 2024-02-19T22:00:53.776113+0000) 2024-02-19T22:00:57.054 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.3.service' 2024-02-19T22:00:57.096 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T22:00:57.096 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-02-19T22:00:57.096 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-02-19T22:00:57.096 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.4 2024-02-19T22:00:57.306 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:00:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T22:00:57.189+0000 7f32cc87f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:28.736613+0000 front 2024-02-19T22:00:28.736635+0000 (oldest deadline 2024-02-19T22:00:54.036467+0000) 2024-02-19T22:00:57.306 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:00:56 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:00:56.987+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:27.205222+0000 front 2024-02-19T22:00:27.205285+0000 (oldest deadline 2024-02-19T22:00:51.904957+0000) 2024-02-19T22:00:57.306 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:00:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:00:57.196+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:00:57.307 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 19 22:00:57 smithi157 systemd[1]: Stopping Ceph osd.4 for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T22:00:57.307 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 19 22:00:57 smithi157 bash[129596]: Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T22:00:57.307 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 19 22:00:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-4[43854]: debug 2024-02-19T22:00:57.192+0000 7f778a01a700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:30.876116+0000 front 2024-02-19T22:00:30.876284+0000 (oldest deadline 2024-02-19T22:00:53.776113+0000) 2024-02-19T22:00:57.806 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 19 22:00:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-4[43854]: debug 2024-02-19T22:00:57.420+0000 7f778c89c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-19T22:00:57.806 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 19 22:00:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-4[43854]: debug 2024-02-19T22:00:57.420+0000 7f778c89c700 -1 osd.4 612 *** Got signal Terminated *** 2024-02-19T22:00:57.806 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 19 22:00:57 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-4[43854]: debug 2024-02-19T22:00:57.420+0000 7f778c89c700 -1 osd.4 612 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T22:00:58.306 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 19 22:00:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-4[43854]: debug 2024-02-19T22:00:58.194+0000 7f778a01a700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:30.876116+0000 front 2024-02-19T22:00:30.876284+0000 (oldest deadline 2024-02-19T22:00:53.776113+0000) 2024-02-19T22:00:58.306 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:00:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:00:58.166+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:00:58.306 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:00:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T22:00:58.227+0000 7f32cc87f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:28.736613+0000 front 2024-02-19T22:00:28.736635+0000 (oldest deadline 2024-02-19T22:00:54.036467+0000) 2024-02-19T22:00:58.307 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:00:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:00:58.029+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:27.205222+0000 front 2024-02-19T22:00:27.205285+0000 (oldest deadline 2024-02-19T22:00:51.904957+0000) 2024-02-19T22:00:59.306 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 19 22:00:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-4[43854]: debug 2024-02-19T22:00:59.231+0000 7f778a01a700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:30.876116+0000 front 2024-02-19T22:00:30.876284+0000 (oldest deadline 2024-02-19T22:00:53.776113+0000) 2024-02-19T22:00:59.306 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:00:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:00:59.024+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:27.205222+0000 front 2024-02-19T22:00:27.205285+0000 (oldest deadline 2024-02-19T22:00:51.904957+0000) 2024-02-19T22:00:59.306 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:00:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:00:59.154+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:00:59.307 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:00:59 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T22:00:59.265+0000 7f32cc87f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:28.736613+0000 front 2024-02-19T22:00:28.736635+0000 (oldest deadline 2024-02-19T22:00:54.036467+0000) 2024-02-19T22:01:00.556 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 19 22:01:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-4[43854]: debug 2024-02-19T22:01:00.213+0000 7f778a01a700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:30.876116+0000 front 2024-02-19T22:00:30.876284+0000 (oldest deadline 2024-02-19T22:00:53.776113+0000) 2024-02-19T22:01:00.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:00.065+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:27.205222+0000 front 2024-02-19T22:00:27.205285+0000 (oldest deadline 2024-02-19T22:00:51.904957+0000) 2024-02-19T22:01:00.557 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:00.202+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:01:00.557 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:01:00 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T22:01:00.244+0000 7f32cc87f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:28.736613+0000 front 2024-02-19T22:00:28.736635+0000 (oldest deadline 2024-02-19T22:00:54.036467+0000) 2024-02-19T22:01:01.556 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:01:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T22:01:01.279+0000 7f32cc87f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:28.736613+0000 front 2024-02-19T22:00:28.736635+0000 (oldest deadline 2024-02-19T22:00:54.036467+0000) 2024-02-19T22:01:01.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:01.081+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:27.205222+0000 front 2024-02-19T22:00:27.205285+0000 (oldest deadline 2024-02-19T22:00:51.904957+0000) 2024-02-19T22:01:01.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:01.227+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:01:01.556 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 19 22:01:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-4[43854]: debug 2024-02-19T22:01:01.167+0000 7f778a01a700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:30.876116+0000 front 2024-02-19T22:00:30.876284+0000 (oldest deadline 2024-02-19T22:00:53.776113+0000) 2024-02-19T22:01:01.557 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 19 22:01:01 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-4[43854]: debug 2024-02-19T22:01:01.167+0000 7f778a01a700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:38.477277+0000 front 2024-02-19T22:00:38.477330+0000 (oldest deadline 2024-02-19T22:01:00.777117+0000) 2024-02-19T22:01:02.556 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 19 22:01:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-4[43854]: debug 2024-02-19T22:01:02.168+0000 7f778a01a700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:30.876116+0000 front 2024-02-19T22:00:30.876284+0000 (oldest deadline 2024-02-19T22:00:53.776113+0000) 2024-02-19T22:01:02.556 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 19 22:01:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-4[43854]: debug 2024-02-19T22:01:02.168+0000 7f778a01a700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:38.477277+0000 front 2024-02-19T22:00:38.477330+0000 (oldest deadline 2024-02-19T22:01:00.777117+0000) 2024-02-19T22:01:02.557 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:01:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T22:01:02.232+0000 7f32cc87f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:28.736613+0000 front 2024-02-19T22:00:28.736635+0000 (oldest deadline 2024-02-19T22:00:54.036467+0000) 2024-02-19T22:01:02.557 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:02.125+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:27.205222+0000 front 2024-02-19T22:00:27.205285+0000 (oldest deadline 2024-02-19T22:00:51.904957+0000) 2024-02-19T22:01:02.558 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:02.202+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:01:02.558 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:02 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:02.202+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:35.944171+0000 front 2024-02-19T22:00:35.944086+0000 (oldest deadline 2024-02-19T22:01:01.244094+0000) 2024-02-19T22:01:03.121 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 19 22:01:02 smithi157 bash[129635]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-4 2024-02-19T22:01:03.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:03.121+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:27.205222+0000 front 2024-02-19T22:00:27.205285+0000 (oldest deadline 2024-02-19T22:00:51.904957+0000) 2024-02-19T22:01:03.556 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:01:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T22:01:03.187+0000 7f32cc87f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:28.736613+0000 front 2024-02-19T22:00:28.736635+0000 (oldest deadline 2024-02-19T22:00:54.036467+0000) 2024-02-19T22:01:03.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:03.180+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:01:03.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:03 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:03.180+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:35.944171+0000 front 2024-02-19T22:00:35.944086+0000 (oldest deadline 2024-02-19T22:01:01.244094+0000) 2024-02-19T22:01:04.470 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:04.148+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:27.205222+0000 front 2024-02-19T22:00:27.205285+0000 (oldest deadline 2024-02-19T22:00:51.904957+0000) 2024-02-19T22:01:04.470 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:04.149+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:38.906650+0000 front 2024-02-19T22:00:38.906526+0000 (oldest deadline 2024-02-19T22:01:03.606464+0000) 2024-02-19T22:01:04.470 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:01:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T22:01:04.233+0000 7f32cc87f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:28.736613+0000 front 2024-02-19T22:00:28.736635+0000 (oldest deadline 2024-02-19T22:00:54.036467+0000) 2024-02-19T22:01:04.470 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:01:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T22:01:04.233+0000 7f32cc87f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:38.137618+0000 front 2024-02-19T22:00:38.137589+0000 (oldest deadline 2024-02-19T22:01:04.037387+0000) 2024-02-19T22:01:04.471 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:04.180+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:01:04.471 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:04 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:04.180+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:35.944171+0000 front 2024-02-19T22:00:35.944086+0000 (oldest deadline 2024-02-19T22:01:01.244094+0000) 2024-02-19T22:01:04.831 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.4.service' 2024-02-19T22:01:04.871 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T22:01:04.871 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-02-19T22:01:04.872 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-02-19T22:01:04.872 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.5 2024-02-19T22:01:05.143 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:01:04 smithi157 systemd[1]: Stopping Ceph osd.5 for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T22:01:05.144 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:01:04 smithi157 bash[129886]: Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T22:01:05.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:05.154+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:27.205222+0000 front 2024-02-19T22:00:27.205285+0000 (oldest deadline 2024-02-19T22:00:51.904957+0000) 2024-02-19T22:01:05.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:05.154+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:38.906650+0000 front 2024-02-19T22:00:38.906526+0000 (oldest deadline 2024-02-19T22:01:03.606464+0000) 2024-02-19T22:01:05.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:05.142+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:01:05.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:05.142+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:35.944171+0000 front 2024-02-19T22:00:35.944086+0000 (oldest deadline 2024-02-19T22:01:01.244094+0000) 2024-02-19T22:01:05.556 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:01:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T22:01:05.193+0000 7f32d1906700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-19T22:01:05.556 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:01:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T22:01:05.193+0000 7f32d1906700 -1 osd.5 612 *** Got signal Terminated *** 2024-02-19T22:01:05.557 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:01:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T22:01:05.193+0000 7f32d1906700 -1 osd.5 612 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T22:01:05.557 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:01:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T22:01:05.241+0000 7f32cc87f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:28.736613+0000 front 2024-02-19T22:00:28.736635+0000 (oldest deadline 2024-02-19T22:00:54.036467+0000) 2024-02-19T22:01:05.557 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:01:05 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T22:01:05.241+0000 7f32cc87f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:38.137618+0000 front 2024-02-19T22:00:38.137589+0000 (oldest deadline 2024-02-19T22:01:04.037387+0000) 2024-02-19T22:01:06.556 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:01:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T22:01:06.256+0000 7f32cc87f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:28.736613+0000 front 2024-02-19T22:00:28.736635+0000 (oldest deadline 2024-02-19T22:00:54.036467+0000) 2024-02-19T22:01:06.556 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:01:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T22:01:06.256+0000 7f32cc87f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:38.137618+0000 front 2024-02-19T22:00:38.137589+0000 (oldest deadline 2024-02-19T22:01:04.037387+0000) 2024-02-19T22:01:06.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:06.150+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:27.205222+0000 front 2024-02-19T22:00:27.205285+0000 (oldest deadline 2024-02-19T22:00:51.904957+0000) 2024-02-19T22:01:06.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:06.150+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:38.906650+0000 front 2024-02-19T22:00:38.906526+0000 (oldest deadline 2024-02-19T22:01:03.606464+0000) 2024-02-19T22:01:06.557 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:06.133+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:01:06.557 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:06 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:06.133+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:35.944171+0000 front 2024-02-19T22:00:35.944086+0000 (oldest deadline 2024-02-19T22:01:01.244094+0000) 2024-02-19T22:01:07.556 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:01:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T22:01:07.215+0000 7f32cc87f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:28.736613+0000 front 2024-02-19T22:00:28.736635+0000 (oldest deadline 2024-02-19T22:00:54.036467+0000) 2024-02-19T22:01:07.556 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:01:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T22:01:07.215+0000 7f32cc87f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:38.137618+0000 front 2024-02-19T22:00:38.137589+0000 (oldest deadline 2024-02-19T22:01:04.037387+0000) 2024-02-19T22:01:07.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:07.137+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:27.205222+0000 front 2024-02-19T22:00:27.205285+0000 (oldest deadline 2024-02-19T22:00:51.904957+0000) 2024-02-19T22:01:07.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:07.137+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:38.906650+0000 front 2024-02-19T22:00:38.906526+0000 (oldest deadline 2024-02-19T22:01:03.606464+0000) 2024-02-19T22:01:07.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:07.179+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:01:07.557 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:07 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:07.179+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:35.944171+0000 front 2024-02-19T22:00:35.944086+0000 (oldest deadline 2024-02-19T22:01:01.244094+0000) 2024-02-19T22:01:08.556 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:01:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T22:01:08.229+0000 7f32cc87f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:28.736613+0000 front 2024-02-19T22:00:28.736635+0000 (oldest deadline 2024-02-19T22:00:54.036467+0000) 2024-02-19T22:01:08.556 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:01:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T22:01:08.229+0000 7f32cc87f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:38.137618+0000 front 2024-02-19T22:00:38.137589+0000 (oldest deadline 2024-02-19T22:01:04.037387+0000) 2024-02-19T22:01:08.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:08.175+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:27.205222+0000 front 2024-02-19T22:00:27.205285+0000 (oldest deadline 2024-02-19T22:00:51.904957+0000) 2024-02-19T22:01:08.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:08.175+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:38.906650+0000 front 2024-02-19T22:00:38.906526+0000 (oldest deadline 2024-02-19T22:01:03.606464+0000) 2024-02-19T22:01:08.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:08.215+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:01:08.557 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:08 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:08.215+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:35.944171+0000 front 2024-02-19T22:00:35.944086+0000 (oldest deadline 2024-02-19T22:01:01.244094+0000) 2024-02-19T22:01:09.556 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:01:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T22:01:09.229+0000 7f32cc87f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:28.736613+0000 front 2024-02-19T22:00:28.736635+0000 (oldest deadline 2024-02-19T22:00:54.036467+0000) 2024-02-19T22:01:09.556 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:01:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T22:01:09.229+0000 7f32cc87f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:38.137618+0000 front 2024-02-19T22:00:38.137589+0000 (oldest deadline 2024-02-19T22:01:04.037387+0000) 2024-02-19T22:01:09.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:09.174+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:27.205222+0000 front 2024-02-19T22:00:27.205285+0000 (oldest deadline 2024-02-19T22:00:51.904957+0000) 2024-02-19T22:01:09.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:09.174+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:38.906650+0000 front 2024-02-19T22:00:38.906526+0000 (oldest deadline 2024-02-19T22:01:03.606464+0000) 2024-02-19T22:01:09.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:09.205+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:01:09.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:09.205+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:35.944171+0000 front 2024-02-19T22:00:35.944086+0000 (oldest deadline 2024-02-19T22:01:01.244094+0000) 2024-02-19T22:01:09.557 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:09 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:09.205+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-19T22:00:43.545037+0000 front 2024-02-19T22:00:43.545078+0000 (oldest deadline 2024-02-19T22:01:08.244927+0000) 2024-02-19T22:01:10.556 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:01:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T22:01:10.190+0000 7f32cc87f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:28.736613+0000 front 2024-02-19T22:00:28.736635+0000 (oldest deadline 2024-02-19T22:00:54.036467+0000) 2024-02-19T22:01:10.556 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:01:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T22:01:10.190+0000 7f32cc87f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:38.137618+0000 front 2024-02-19T22:00:38.137589+0000 (oldest deadline 2024-02-19T22:01:04.037387+0000) 2024-02-19T22:01:10.556 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:01:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5[48470]: debug 2024-02-19T22:01:10.190+0000 7f32cc87f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-19T22:00:44.037901+0000 front 2024-02-19T22:00:44.037919+0000 (oldest deadline 2024-02-19T22:01:09.937819+0000) 2024-02-19T22:01:10.557 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:10.193+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:27.205222+0000 front 2024-02-19T22:00:27.205285+0000 (oldest deadline 2024-02-19T22:00:51.904957+0000) 2024-02-19T22:01:10.557 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:10.193+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:38.906650+0000 front 2024-02-19T22:00:38.906526+0000 (oldest deadline 2024-02-19T22:01:03.606464+0000) 2024-02-19T22:01:10.557 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:10.193+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-19T22:00:43.606936+0000 front 2024-02-19T22:00:43.607005+0000 (oldest deadline 2024-02-19T22:01:09.407249+0000) 2024-02-19T22:01:10.557 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:10.185+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:01:10.557 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:10.185+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:35.944171+0000 front 2024-02-19T22:00:35.944086+0000 (oldest deadline 2024-02-19T22:01:01.244094+0000) 2024-02-19T22:01:10.557 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:10 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:10.185+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-19T22:00:43.545037+0000 front 2024-02-19T22:00:43.545078+0000 (oldest deadline 2024-02-19T22:01:08.244927+0000) 2024-02-19T22:01:11.056 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:01:10 smithi157 bash[129926]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-5 2024-02-19T22:01:11.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:11.219+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:01:11.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:11.219+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:35.944171+0000 front 2024-02-19T22:00:35.944086+0000 (oldest deadline 2024-02-19T22:01:01.244094+0000) 2024-02-19T22:01:11.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:11.219+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-19T22:00:43.545037+0000 front 2024-02-19T22:00:43.545078+0000 (oldest deadline 2024-02-19T22:01:08.244927+0000) 2024-02-19T22:01:11.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:11.153+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:27.205222+0000 front 2024-02-19T22:00:27.205285+0000 (oldest deadline 2024-02-19T22:00:51.904957+0000) 2024-02-19T22:01:11.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:11.153+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:38.906650+0000 front 2024-02-19T22:00:38.906526+0000 (oldest deadline 2024-02-19T22:01:03.606464+0000) 2024-02-19T22:01:11.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:11 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:11.153+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-19T22:00:43.606936+0000 front 2024-02-19T22:00:43.607005+0000 (oldest deadline 2024-02-19T22:01:09.407249+0000) 2024-02-19T22:01:12.306 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:12.185+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:27.205222+0000 front 2024-02-19T22:00:27.205285+0000 (oldest deadline 2024-02-19T22:00:51.904957+0000) 2024-02-19T22:01:12.306 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:12.185+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:38.906650+0000 front 2024-02-19T22:00:38.906526+0000 (oldest deadline 2024-02-19T22:01:03.606464+0000) 2024-02-19T22:01:12.306 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:12.185+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-19T22:00:43.606936+0000 front 2024-02-19T22:00:43.607005+0000 (oldest deadline 2024-02-19T22:01:09.407249+0000) 2024-02-19T22:01:12.306 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:12.230+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:01:12.306 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:12.230+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:35.944171+0000 front 2024-02-19T22:00:35.944086+0000 (oldest deadline 2024-02-19T22:01:01.244094+0000) 2024-02-19T22:01:12.306 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:12.230+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-19T22:00:43.545037+0000 front 2024-02-19T22:00:43.545078+0000 (oldest deadline 2024-02-19T22:01:08.244927+0000) 2024-02-19T22:01:12.550 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.5.service' 2024-02-19T22:01:12.579 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:01:12 smithi157 systemd[1]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.5.service: Succeeded. 2024-02-19T22:01:12.579 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 19 22:01:12 smithi157 systemd[1]: Stopped Ceph osd.5 for 6f763558-cf6d-11ee-95bb-87774f69a715. 2024-02-19T22:01:12.594 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T22:01:12.594 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-02-19T22:01:12.594 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-02-19T22:01:12.594 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.6 2024-02-19T22:01:12.925 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:12 smithi157 systemd[1]: Stopping Ceph osd.6 for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T22:01:12.925 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:12 smithi157 bash[130166]: Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T22:01:13.179 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:12.925+0000 7f6ad6404700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-19T22:01:13.179 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:12.925+0000 7f6ad6404700 -1 osd.6 612 *** Got signal Terminated *** 2024-02-19T22:01:13.179 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:12 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:12.925+0000 7f6ad6404700 -1 osd.6 612 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T22:01:13.179 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:13.180+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:27.205222+0000 front 2024-02-19T22:00:27.205285+0000 (oldest deadline 2024-02-19T22:00:51.904957+0000) 2024-02-19T22:01:13.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:13.180+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:38.906650+0000 front 2024-02-19T22:00:38.906526+0000 (oldest deadline 2024-02-19T22:01:03.606464+0000) 2024-02-19T22:01:13.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:13.180+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-19T22:00:43.606936+0000 front 2024-02-19T22:00:43.607005+0000 (oldest deadline 2024-02-19T22:01:09.407249+0000) 2024-02-19T22:01:13.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:13.215+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:01:13.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:13.215+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:35.944171+0000 front 2024-02-19T22:00:35.944086+0000 (oldest deadline 2024-02-19T22:01:01.244094+0000) 2024-02-19T22:01:13.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:13 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:13.215+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-19T22:00:43.545037+0000 front 2024-02-19T22:00:43.545078+0000 (oldest deadline 2024-02-19T22:01:08.244927+0000) 2024-02-19T22:01:14.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:14.181+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:27.205222+0000 front 2024-02-19T22:00:27.205285+0000 (oldest deadline 2024-02-19T22:00:51.904957+0000) 2024-02-19T22:01:14.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:14.181+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:38.906650+0000 front 2024-02-19T22:00:38.906526+0000 (oldest deadline 2024-02-19T22:01:03.606464+0000) 2024-02-19T22:01:14.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:14.181+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-19T22:00:43.606936+0000 front 2024-02-19T22:00:43.607005+0000 (oldest deadline 2024-02-19T22:01:09.407249+0000) 2024-02-19T22:01:14.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:14.192+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:01:14.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:14.192+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:35.944171+0000 front 2024-02-19T22:00:35.944086+0000 (oldest deadline 2024-02-19T22:01:01.244094+0000) 2024-02-19T22:01:14.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:14 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:14.192+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-19T22:00:43.545037+0000 front 2024-02-19T22:00:43.545078+0000 (oldest deadline 2024-02-19T22:01:08.244927+0000) 2024-02-19T22:01:15.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:15.194+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:27.205222+0000 front 2024-02-19T22:00:27.205285+0000 (oldest deadline 2024-02-19T22:00:51.904957+0000) 2024-02-19T22:01:15.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:15.194+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:38.906650+0000 front 2024-02-19T22:00:38.906526+0000 (oldest deadline 2024-02-19T22:01:03.606464+0000) 2024-02-19T22:01:15.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:15.194+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-19T22:00:43.606936+0000 front 2024-02-19T22:00:43.607005+0000 (oldest deadline 2024-02-19T22:01:09.407249+0000) 2024-02-19T22:01:15.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:15.161+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:01:15.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:15.161+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:35.944171+0000 front 2024-02-19T22:00:35.944086+0000 (oldest deadline 2024-02-19T22:01:01.244094+0000) 2024-02-19T22:01:15.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:15 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:15.161+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-19T22:00:43.545037+0000 front 2024-02-19T22:00:43.545078+0000 (oldest deadline 2024-02-19T22:01:08.244927+0000) 2024-02-19T22:01:16.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:16.172+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:27.205222+0000 front 2024-02-19T22:00:27.205285+0000 (oldest deadline 2024-02-19T22:00:51.904957+0000) 2024-02-19T22:01:16.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:16.172+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:38.906650+0000 front 2024-02-19T22:00:38.906526+0000 (oldest deadline 2024-02-19T22:01:03.606464+0000) 2024-02-19T22:01:16.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:16.172+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-19T22:00:43.606936+0000 front 2024-02-19T22:00:43.607005+0000 (oldest deadline 2024-02-19T22:01:09.407249+0000) 2024-02-19T22:01:16.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:16.188+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:01:16.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:16.188+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:35.944171+0000 front 2024-02-19T22:00:35.944086+0000 (oldest deadline 2024-02-19T22:01:01.244094+0000) 2024-02-19T22:01:16.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:16 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:16.188+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-19T22:00:43.545037+0000 front 2024-02-19T22:00:43.545078+0000 (oldest deadline 2024-02-19T22:01:08.244927+0000) 2024-02-19T22:01:17.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:17.158+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:27.205222+0000 front 2024-02-19T22:00:27.205285+0000 (oldest deadline 2024-02-19T22:00:51.904957+0000) 2024-02-19T22:01:17.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:17.158+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:38.906650+0000 front 2024-02-19T22:00:38.906526+0000 (oldest deadline 2024-02-19T22:01:03.606464+0000) 2024-02-19T22:01:17.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:17.158+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-19T22:00:43.606936+0000 front 2024-02-19T22:00:43.607005+0000 (oldest deadline 2024-02-19T22:01:09.407249+0000) 2024-02-19T22:01:17.556 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6[52926]: debug 2024-02-19T22:01:17.158+0000 7f6acf379700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.80:6830 osd.3 since back 2024-02-19T22:00:52.908365+0000 front 2024-02-19T22:00:52.908342+0000 (oldest deadline 2024-02-19T22:01:17.008304+0000) 2024-02-19T22:01:17.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:17.195+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:01:17.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:17.195+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:35.944171+0000 front 2024-02-19T22:00:35.944086+0000 (oldest deadline 2024-02-19T22:01:01.244094+0000) 2024-02-19T22:01:17.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:17 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:17.195+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-19T22:00:43.545037+0000 front 2024-02-19T22:00:43.545078+0000 (oldest deadline 2024-02-19T22:01:08.244927+0000) 2024-02-19T22:01:18.475 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:18.202+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:01:18.475 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:18.202+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:35.944171+0000 front 2024-02-19T22:00:35.944086+0000 (oldest deadline 2024-02-19T22:01:01.244094+0000) 2024-02-19T22:01:18.475 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:18 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:18.202+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-19T22:00:43.545037+0000 front 2024-02-19T22:00:43.545078+0000 (oldest deadline 2024-02-19T22:01:08.244927+0000) 2024-02-19T22:01:18.806 INFO:journalctl@ceph.osd.6.smithi157.stdout:Feb 19 22:01:18 smithi157 bash[130206]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-6 2024-02-19T22:01:19.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:19.211+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:01:19.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:19.211+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:35.944171+0000 front 2024-02-19T22:00:35.944086+0000 (oldest deadline 2024-02-19T22:01:01.244094+0000) 2024-02-19T22:01:19.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:19.211+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-19T22:00:43.545037+0000 front 2024-02-19T22:00:43.545078+0000 (oldest deadline 2024-02-19T22:01:08.244927+0000) 2024-02-19T22:01:19.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:19 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:19.211+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6830 osd.3 since back 2024-02-19T22:00:53.545985+0000 front 2024-02-19T22:00:53.545998+0000 (oldest deadline 2024-02-19T22:01:18.845925+0000) 2024-02-19T22:01:20.218 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.6.service' 2024-02-19T22:01:20.260 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T22:01:20.260 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-02-19T22:01:20.261 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-02-19T22:01:20.261 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.7 2024-02-19T22:01:20.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:20.201+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:01:20.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:20.201+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:35.944171+0000 front 2024-02-19T22:00:35.944086+0000 (oldest deadline 2024-02-19T22:01:01.244094+0000) 2024-02-19T22:01:20.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:20.201+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-19T22:00:43.545037+0000 front 2024-02-19T22:00:43.545078+0000 (oldest deadline 2024-02-19T22:01:08.244927+0000) 2024-02-19T22:01:20.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:20.201+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6830 osd.3 since back 2024-02-19T22:00:53.545985+0000 front 2024-02-19T22:00:53.545998+0000 (oldest deadline 2024-02-19T22:01:18.845925+0000) 2024-02-19T22:01:20.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:20 smithi157 systemd[1]: Stopping Ceph osd.7 for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T22:01:20.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:20 smithi157 bash[130448]: Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T22:01:21.055 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:20.593+0000 7f477ffac700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-19T22:01:21.056 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:20.593+0000 7f477ffac700 -1 osd.7 612 *** Got signal Terminated *** 2024-02-19T22:01:21.056 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:20 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:20.593+0000 7f477ffac700 -1 osd.7 612 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T22:01:21.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:21.203+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:01:21.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:21.203+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:35.944171+0000 front 2024-02-19T22:00:35.944086+0000 (oldest deadline 2024-02-19T22:01:01.244094+0000) 2024-02-19T22:01:21.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:21.203+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-19T22:00:43.545037+0000 front 2024-02-19T22:00:43.545078+0000 (oldest deadline 2024-02-19T22:01:08.244927+0000) 2024-02-19T22:01:21.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:21 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:21.203+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6830 osd.3 since back 2024-02-19T22:00:53.545985+0000 front 2024-02-19T22:00:53.545998+0000 (oldest deadline 2024-02-19T22:01:18.845925+0000) 2024-02-19T22:01:22.555 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:22.158+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:01:22.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:22.158+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:35.944171+0000 front 2024-02-19T22:00:35.944086+0000 (oldest deadline 2024-02-19T22:01:01.244094+0000) 2024-02-19T22:01:22.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:22.158+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-19T22:00:43.545037+0000 front 2024-02-19T22:00:43.545078+0000 (oldest deadline 2024-02-19T22:01:08.244927+0000) 2024-02-19T22:01:22.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:22 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:22.158+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6830 osd.3 since back 2024-02-19T22:00:53.545985+0000 front 2024-02-19T22:00:53.545998+0000 (oldest deadline 2024-02-19T22:01:18.845925+0000) 2024-02-19T22:01:23.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:23.148+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:01:23.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:23.148+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:35.944171+0000 front 2024-02-19T22:00:35.944086+0000 (oldest deadline 2024-02-19T22:01:01.244094+0000) 2024-02-19T22:01:23.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:23.148+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-19T22:00:43.545037+0000 front 2024-02-19T22:00:43.545078+0000 (oldest deadline 2024-02-19T22:01:08.244927+0000) 2024-02-19T22:01:23.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:23 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:23.148+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6830 osd.3 since back 2024-02-19T22:00:53.545985+0000 front 2024-02-19T22:00:53.545998+0000 (oldest deadline 2024-02-19T22:01:18.845925+0000) 2024-02-19T22:01:24.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:24.170+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:01:24.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:24.170+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:35.944171+0000 front 2024-02-19T22:00:35.944086+0000 (oldest deadline 2024-02-19T22:01:01.244094+0000) 2024-02-19T22:01:24.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:24.170+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-19T22:00:43.545037+0000 front 2024-02-19T22:00:43.545078+0000 (oldest deadline 2024-02-19T22:01:08.244927+0000) 2024-02-19T22:01:24.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:24.170+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6830 osd.3 since back 2024-02-19T22:00:53.545985+0000 front 2024-02-19T22:00:53.545998+0000 (oldest deadline 2024-02-19T22:01:18.845925+0000) 2024-02-19T22:01:24.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:24 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:24.170+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.157:6804 osd.4 since back 2024-02-19T22:00:58.846202+0000 front 2024-02-19T22:00:58.846236+0000 (oldest deadline 2024-02-19T22:01:24.146390+0000) 2024-02-19T22:01:25.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:25.181+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-19T22:00:29.543044+0000 front 2024-02-19T22:00:29.542968+0000 (oldest deadline 2024-02-19T22:00:53.642954+0000) 2024-02-19T22:01:25.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:25.181+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-19T22:00:35.944171+0000 front 2024-02-19T22:00:35.944086+0000 (oldest deadline 2024-02-19T22:01:01.244094+0000) 2024-02-19T22:01:25.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:25.181+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-19T22:00:43.545037+0000 front 2024-02-19T22:00:43.545078+0000 (oldest deadline 2024-02-19T22:01:08.244927+0000) 2024-02-19T22:01:25.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:25.181+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.80:6830 osd.3 since back 2024-02-19T22:00:53.545985+0000 front 2024-02-19T22:00:53.545998+0000 (oldest deadline 2024-02-19T22:01:18.845925+0000) 2024-02-19T22:01:25.556 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:25 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7[57403]: debug 2024-02-19T22:01:25.181+0000 7f477d72a700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.157:6804 osd.4 since back 2024-02-19T22:00:58.846202+0000 front 2024-02-19T22:00:58.846236+0000 (oldest deadline 2024-02-19T22:01:24.146390+0000) 2024-02-19T22:01:26.306 INFO:journalctl@ceph.osd.7.smithi157.stdout:Feb 19 22:01:26 smithi157 bash[130489]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715-osd-7 2024-02-19T22:01:27.702 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@osd.7.service' 2024-02-19T22:01:27.743 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T22:01:27.743 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-02-19T22:01:27.743 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopping rgw.foo.a... 2024-02-19T22:01:27.743 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-6f763558-cf6d-11ee-95bb-87774f69a715@rgw.foo.a 2024-02-19T22:01:28.057 INFO:journalctl@ceph.rgw.foo.a.smithi080.stdout:Feb 19 22:01:27 smithi080 systemd[1]: Stopping Ceph rgw.foo.a for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T22:01:28.058 INFO:journalctl@ceph.rgw.foo.a.smithi080.stdout:Feb 19 22:01:27 smithi080 bash[217679]: Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-rgw.foo.a" found: no such container 2024-02-19T22:01:28.345 INFO:journalctl@ceph.rgw.foo.a.smithi080.stdout:Feb 19 22:01:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-rgw-foo-a[65024]: debug 2024-02-19T22:01:28.056+0000 7ff3e2f75700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/radosgw -n client.rgw.foo.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-19T22:01:28.345 INFO:journalctl@ceph.rgw.foo.a.smithi080.stdout:Feb 19 22:01:28 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-rgw-foo-a[65024]: debug 2024-02-19T22:01:28.056+0000 7ff3fa03f880 -1 shutting down 2024-02-19T22:01:38.346 INFO:journalctl@ceph.rgw.foo.a.smithi080.stdout:Feb 19 22:01:38 smithi080 bash[217718]: time="2024-02-19T22:01:38Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-6f763558-cf6d-11ee-95bb-87774f69a715-rgw-foo-a in 10 seconds, resorting to SIGKILL" 2024-02-19T22:01:39.068 INFO:journalctl@ceph.rgw.foo.a.smithi080.stdout:Feb 19 22:01:38 smithi080 bash[217718]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715-rgw-foo-a 2024-02-19T22:01:39.068 INFO:journalctl@ceph.rgw.foo.a.smithi080.stdout:Feb 19 22:01:38 smithi080 systemd[1]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715@rgw.foo.a.service: Main process exited, code=exited, status=137/n/a 2024-02-19T22:01:39.074 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@rgw.foo.a.service' 2024-02-19T22:01:39.112 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T22:01:39.112 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopped rgw.foo.a 2024-02-19T22:01:39.113 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-02-19T22:01:39.113 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-6f763558-cf6d-11ee-95bb-87774f69a715@prometheus.a 2024-02-19T22:01:39.556 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 22:01:39 smithi157 systemd[1]: Stopping Ceph prometheus.a for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T22:01:39.556 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 22:01:39 smithi157 bash[130735]: Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus.a" found: no such container 2024-02-19T22:01:39.556 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 22:01:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T22:01:39.393Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-02-19T22:01:39.556 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 22:01:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T22:01:39.393Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-02-19T22:01:39.556 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 22:01:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T22:01:39.393Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-02-19T22:01:39.556 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 22:01:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T22:01:39.393Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-02-19T22:01:39.556 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 22:01:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T22:01:39.393Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-02-19T22:01:39.557 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 22:01:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T22:01:39.393Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-02-19T22:01:39.557 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 22:01:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T22:01:39.394Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-02-19T22:01:39.557 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 22:01:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T22:01:39.394Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-02-19T22:01:39.557 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 22:01:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T22:01:39.394Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-02-19T22:01:39.557 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 22:01:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T22:01:39.395Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-02-19T22:01:39.557 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 22:01:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T22:01:39.395Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-02-19T22:01:39.557 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 22:01:39 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a[63118]: ts=2024-02-19T22:01:39.395Z caller=main.go:1066 level=info msg="See you next time!" 2024-02-19T22:01:40.056 INFO:journalctl@ceph.prometheus.a.smithi157.stdout:Feb 19 22:01:39 smithi157 bash[130775]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715-prometheus-a 2024-02-19T22:01:40.178 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f763558-cf6d-11ee-95bb-87774f69a715@prometheus.a.service' 2024-02-19T22:01:40.214 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T22:01:40.215 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-02-19T22:01:40.215 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 --force --keep-logs 2024-02-19T22:01:41.596 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 22:01:41 smithi080 systemd[1]: Stopping Ceph alertmanager.a for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T22:01:41.596 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 22:01:41 smithi080 bash[218149]: Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-alertmanager.a" found: no such container 2024-02-19T22:01:41.928 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 22:01:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-alertmanager-a[71459]: level=warn ts=2024-02-19T22:01:41.625Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-19T22:01:41.928 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 22:01:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-alertmanager-a[71459]: level=info ts=2024-02-19T22:01:41.626Z caller=main.go:557 msg="Received SIGTERM, exiting gracefully..." 2024-02-19T22:01:41.928 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 22:01:41 smithi080 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-alertmanager-a[71459]: level=warn ts=2024-02-19T22:01:41.626Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi157.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.157:8443: connect: connection refused" 2024-02-19T22:01:42.345 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 22:01:42 smithi080 bash[218190]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715-alertmanager-a 2024-02-19T22:01:42.846 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 22:01:42 smithi080 systemd[1]: Stopping Ceph node-exporter.a for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T22:01:42.846 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 22:01:42 smithi080 bash[218292]: Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter.a" found: no such container 2024-02-19T22:01:42.846 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 22:01:42 smithi080 systemd[1]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715@alertmanager.a.service: Succeeded. 2024-02-19T22:01:42.846 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 19 22:01:42 smithi080 systemd[1]: Stopped Ceph alertmanager.a for 6f763558-cf6d-11ee-95bb-87774f69a715. 2024-02-19T22:01:43.441 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 22:01:43 smithi080 bash[218329]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-a 2024-02-19T22:01:43.731 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 22:01:43 smithi080 systemd[1]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-02-19T22:01:43.731 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 22:01:43 smithi080 systemd[1]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715@node-exporter.a.service: Failed with result 'exit-code'. 2024-02-19T22:01:43.731 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 19 22:01:43 smithi080 systemd[1]: Stopped Ceph node-exporter.a for 6f763558-cf6d-11ee-95bb-87774f69a715. 2024-02-19T22:01:44.036 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 --force --keep-logs 2024-02-19T22:01:45.306 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 22:01:45 smithi157 systemd[1]: Stopping Ceph iscsi.iscsi.a for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T22:01:45.306 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 22:01:45 smithi157 bash[131129]: Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi.iscsi.a" found: no such container 2024-02-19T22:01:45.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 22:01:45 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a[60869]: debug Shutdown received 2024-02-19T22:01:55.640 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 22:01:55 smithi157 bash[131170]: time="2024-02-19T22:01:55Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a in 10 seconds, resorting to SIGKILL" 2024-02-19T22:01:56.016 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 22:01:55 smithi157 bash[131170]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a 2024-02-19T22:01:56.305 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 22:01:56 smithi157 systemd[1]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715@iscsi.iscsi.a.service: Main process exited, code=exited, status=137/n/a 2024-02-19T22:01:56.769 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 22:01:56 smithi157 systemd[1]: Stopping Ceph node-exporter.b for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T22:01:56.770 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 22:01:56 smithi157 bash[131243]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715-iscsi-iscsi-a-tcmu 2024-02-19T22:01:56.770 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 22:01:56 smithi157 systemd[1]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-02-19T22:01:56.770 INFO:journalctl@ceph.iscsi.iscsi.a.smithi157.stdout:Feb 19 22:01:56 smithi157 systemd[1]: Stopped Ceph iscsi.iscsi.a for 6f763558-cf6d-11ee-95bb-87774f69a715. 2024-02-19T22:01:57.056 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 22:01:56 smithi157 bash[131319]: Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter.b" found: no such container 2024-02-19T22:01:57.539 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 22:01:57 smithi157 bash[131360]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715-node-exporter-b 2024-02-19T22:01:57.805 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 22:01:57 smithi157 systemd[1]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-02-19T22:01:57.805 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 22:01:57 smithi157 systemd[1]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715@node-exporter.b.service: Failed with result 'exit-code'. 2024-02-19T22:01:57.806 INFO:journalctl@ceph.node-exporter.b.smithi157.stdout:Feb 19 22:01:57 smithi157 systemd[1]: Stopped Ceph node-exporter.b for 6f763558-cf6d-11ee-95bb-87774f69a715. 2024-02-19T22:01:58.056 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 22:01:57 smithi157 systemd[1]: Stopping Ceph grafana.a for 6f763558-cf6d-11ee-95bb-87774f69a715... 2024-02-19T22:01:58.056 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 22:01:57 smithi157 bash[131494]: Error: no container with name or ID "ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana.a" found: no such container 2024-02-19T22:01:58.415 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 22:01:58 smithi157 ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a[63489]: t=2024-02-19T22:01:58+0000 lvl=info msg="Shutdown started" logger=server reason="System signal: terminated" 2024-02-19T22:01:58.781 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 22:01:58 smithi157 bash[131535]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715-grafana-a 2024-02-19T22:01:59.050 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 22:01:58 smithi157 systemd[1]: ceph-6f763558-cf6d-11ee-95bb-87774f69a715@grafana.a.service: Succeeded. 2024-02-19T22:01:59.050 INFO:journalctl@ceph.grafana.a.smithi157.stdout:Feb 19 22:01:58 smithi157 systemd[1]: Stopped Ceph grafana.a for 6f763558-cf6d-11ee-95bb-87774f69a715. 2024-02-19T22:01:59.201 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-19T22:01:59.241 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-19T22:01:59.271 INFO:tasks.cephadm:Archiving crash dumps... 2024-02-19T22:01:59.273 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/crash to /home/teuthworker/archive/yuriw-2024-02-19_19:25:49-rados-pacific-release-distro-default-smithi/7566756/remote/ubuntu@smithi080.front.sepia.ceph.com/crash 2024-02-19T22:01:59.274 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/crash -- . 2024-02-19T22:01:59.348 INFO:teuthology.orchestra.run.smithi080.stderr:tar: /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/crash: Cannot open: No such file or directory 2024-02-19T22:01:59.348 INFO:teuthology.orchestra.run.smithi080.stderr:tar: Error is not recoverable: exiting now 2024-02-19T22:01:59.350 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/crash to /home/teuthworker/archive/yuriw-2024-02-19_19:25:49-rados-pacific-release-distro-default-smithi/7566756/remote/ubuntu@smithi157.front.sepia.ceph.com/crash 2024-02-19T22:01:59.351 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/crash -- . 2024-02-19T22:01:59.419 INFO:teuthology.orchestra.run.smithi157.stderr:tar: /var/lib/ceph/6f763558-cf6d-11ee-95bb-87774f69a715/crash: Cannot open: No such file or directory 2024-02-19T22:01:59.419 INFO:teuthology.orchestra.run.smithi157.stderr:tar: Error is not recoverable: exiting now 2024-02-19T22:01:59.420 INFO:tasks.cephadm:Checking cluster log for badness... 2024-02-19T22:01:59.420 INFO:tasks.cephadm:Removing cluster... 2024-02-19T22:01:59.420 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 --force 2024-02-19T22:02:03.007 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6f763558-cf6d-11ee-95bb-87774f69a715 --force 2024-02-19T22:02:06.447 INFO:tasks.cephadm:Removing cephadm ... 2024-02-19T22:02:06.448 DEBUG:teuthology.orchestra.run.smithi080:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-19T22:02:06.470 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-19T22:02:06.488 INFO:tasks.cephadm:Teardown complete 2024-02-19T22:02:06.489 ERROR:teuthology.run_tasks:Manager failed: cephadm Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_81bd20d634209c7cb82c18be12b4b5a05643ebf1/qa/tasks/cephadm.py", line 1508, in task log.info('Teardown begin') File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_81bd20d634209c7cb82c18be12b4b5a05643ebf1/qa/tasks/cephadm.py", line 1376, in initialize_config yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_81bd20d634209c7cb82c18be12b4b5a05643ebf1/qa/tasks/cephadm.py", line 238, in ceph_log if first_in_ceph_log('\[ERR\]|\[WRN\]|\[SEC\]', File "/home/teuthworker/src/github.com_ceph_ceph-c_81bd20d634209c7cb82c18be12b4b5a05643ebf1/qa/tasks/cephadm.py", line 229, in first_in_ceph_log r = ctx.ceph[cluster_name].bootstrap_remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 447, in run r = RemoteProcess(client, args, check_status=check_status, hostname=name, File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 65, in __init__ self.command = quote(args) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 257, in quote return ' '.join(_quote(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 255, in _quote yield pipes.quote(a) File "/usr/lib/python3.8/shlex.py", line 325, in quote if _find_unsafe(s) is None: TypeError: expected string or bytes-like object 2024-02-19T22:02:06.490 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-19T22:02:06.500 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_81bd20d634209c7cb82c18be12b4b5a05643ebf1/qa/tasks/cephadm.py", line 1508, in task log.info('Teardown begin') File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_81bd20d634209c7cb82c18be12b4b5a05643ebf1/qa/tasks/cephadm.py", line 1376, in initialize_config yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_81bd20d634209c7cb82c18be12b4b5a05643ebf1/qa/tasks/cephadm.py", line 238, in ceph_log if first_in_ceph_log('\[ERR\]|\[WRN\]|\[SEC\]', File "/home/teuthworker/src/github.com_ceph_ceph-c_81bd20d634209c7cb82c18be12b4b5a05643ebf1/qa/tasks/cephadm.py", line 229, in first_in_ceph_log r = ctx.ceph[cluster_name].bootstrap_remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 447, in run r = RemoteProcess(client, args, check_status=check_status, hostname=name, File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 65, in __init__ self.command = quote(args) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 257, in quote return ' '.join(_quote(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 255, in _quote yield pipes.quote(a) File "/usr/lib/python3.8/shlex.py", line 325, in quote if _find_unsafe(s) is None: TypeError: expected string or bytes-like object 2024-02-19T22:02:06.501 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-19T22:02:06.501 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-19T22:02:06.513 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-19T22:02:06.632 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-19T22:02:06.641 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-19T22:02:06.641 DEBUG:teuthology.orchestra.run.smithi080:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-19T22:02:06.644 DEBUG:teuthology.orchestra.run.smithi157:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-19T22:02:06.660 INFO:teuthology.orchestra.run.smithi157.stderr:bash: ntpq: command not found 2024-02-19T22:02:06.662 INFO:teuthology.orchestra.run.smithi080.stderr:bash: ntpq: command not found 2024-02-19T22:02:06.680 INFO:teuthology.orchestra.run.smithi080.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-19T22:02:06.681 INFO:teuthology.orchestra.run.smithi080.stdout:=============================================================================== 2024-02-19T22:02:06.681 INFO:teuthology.orchestra.run.smithi080.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 57 +905us[ +996us] +/- 82ms 2024-02-19T22:02:06.681 INFO:teuthology.orchestra.run.smithi080.stdout:^* hv02.front.sepia.ceph.com 3 6 377 56 -1497us[-1406us] +/- 78ms 2024-02-19T22:02:06.681 INFO:teuthology.orchestra.run.smithi080.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 60 +584us[ +674us] +/- 68ms 2024-02-19T22:02:06.681 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T22:02:06.685 INFO:teuthology.orchestra.run.smithi157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-19T22:02:06.686 INFO:teuthology.orchestra.run.smithi157.stdout:=============================================================================== 2024-02-19T22:02:06.686 INFO:teuthology.orchestra.run.smithi157.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 62 +927us[ +987us] +/- 82ms 2024-02-19T22:02:06.686 INFO:teuthology.orchestra.run.smithi157.stdout:^* hv02.front.sepia.ceph.com 3 6 377 59 -1488us[-1428us] +/- 78ms 2024-02-19T22:02:06.686 INFO:teuthology.orchestra.run.smithi157.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 +574us[ +634us] +/- 68ms 2024-02-19T22:02:06.686 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T22:02:06.687 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-19T22:02:06.696 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-19T22:02:06.696 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-19T22:02:06.705 DEBUG:teuthology.orchestra.run.smithi080:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-19T22:02:06.913 DEBUG:teuthology.orchestra.run.smithi157:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-19T22:02:07.067 DEBUG:teuthology.orchestra.run.smithi080:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-19T22:02:07.101 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T22:02:07.102 DEBUG:teuthology.orchestra.run.smithi157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-19T22:02:07.133 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T22:02:07.134 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-19T22:02:07.144 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-19T22:02:07.227 INFO:teuthology.task.internal:Duration was 3086.285822 seconds 2024-02-19T22:02:07.227 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-19T22:02:07.245 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-19T22:02:07.245 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-19T22:02:07.247 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-19T22:02:07.328 INFO:teuthology.orchestra.run.smithi080.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-19T22:02:07.330 INFO:teuthology.orchestra.run.smithi157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-19T22:02:07.581 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-19T22:02:07.581 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi080.front.sepia.ceph.com 2024-02-19T22:02:07.581 DEBUG:teuthology.orchestra.run.smithi080:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-19T22:02:07.613 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi157.front.sepia.ceph.com 2024-02-19T22:02:07.613 DEBUG:teuthology.orchestra.run.smithi157:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-19T22:02:07.636 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-19T22:02:07.636 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-19T22:02:07.655 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-19T22:02:07.787 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-19T22:02:07.787 DEBUG:teuthology.orchestra.run.smithi080:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-19T22:02:07.789 DEBUG:teuthology.orchestra.run.smithi157:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-19T22:02:08.050 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-19T22:02:08.060 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-19T22:02:08.060 DEBUG:teuthology.orchestra.run.smithi080:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-19T22:02:08.103 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-19T22:02:08.146 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-19T22:02:08.155 DEBUG:teuthology.orchestra.run.smithi080:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-19T22:02:08.158 DEBUG:teuthology.orchestra.run.smithi157:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-19T22:02:08.189 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = core 2024-02-19T22:02:08.221 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = core 2024-02-19T22:02:08.235 DEBUG:teuthology.orchestra.run.smithi080:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-19T22:02:08.265 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T22:02:08.265 DEBUG:teuthology.orchestra.run.smithi157:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-19T22:02:08.292 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T22:02:08.293 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-19T22:02:08.302 INFO:teuthology.task.internal:Transferring archived files... 2024-02-19T22:02:08.303 DEBUG:teuthology.misc:Transferring archived files from smithi080:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-19_19:25:49-rados-pacific-release-distro-default-smithi/7566756/remote/smithi080 2024-02-19T22:02:08.304 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-19T22:02:08.363 DEBUG:teuthology.misc:Transferring archived files from smithi157:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-19_19:25:49-rados-pacific-release-distro-default-smithi/7566756/remote/smithi157 2024-02-19T22:02:08.364 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-19T22:02:08.412 INFO:teuthology.task.internal:Removing archive directory... 2024-02-19T22:02:08.412 DEBUG:teuthology.orchestra.run.smithi080:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-19T22:02:08.414 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-19T22:02:08.460 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-19T22:02:08.472 INFO:teuthology.task.internal:Not uploading archives. 2024-02-19T22:02:08.472 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-19T22:02:08.481 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-19T22:02:08.481 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-19T22:02:08.483 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-19T22:02:08.499 INFO:teuthology.orchestra.run.smithi080.stdout: 525357 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 19 22:02 /home/ubuntu/cephtest 2024-02-19T22:02:08.518 INFO:teuthology.orchestra.run.smithi157.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 19 22:02 /home/ubuntu/cephtest 2024-02-19T22:02:08.519 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-19T22:02:08.528 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-19T22:02:08.540 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: TypeError: expected string or bytes-like object 2024-02-19T22:02:08.540 INFO:teuthology.nuke:Checking targets against current locks 2024-02-19T22:02:08.566 DEBUG:teuthology.nuke:shortname: smithi080 2024-02-19T22:02:08.567 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-19T22:02:08.589 DEBUG:teuthology.nuke:shortname: smithi157 2024-02-19T22:02:08.589 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-19T22:02:08.592 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-19_19:25:49-rados-pacific-release-distro-default-smithi/7566756', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-19 20:59:35.872406', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE1xQ9LkYG6xoTRTY0IPhqUJRe9mMMC2O6N+C/8e/6K9M0mKeLdAH/rVLICKrQ/ChjD0CvjTsHA41Wa5uk11lRk='} 2024-02-19T22:02:08.610 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-19_19:25:49-rados-pacific-release-distro-default-smithi/7566756', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-19 20:59:35.870433', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOR5P2f4oz2tMNmlBw8vtjlVgQ2Put/SYHDMPs91lwfIpR8Ub3P+Wk+Huv05lEsnwz1199PHt40N7FXjLa1Yl1E='} 2024-02-19T22:02:08.642 INFO:teuthology.orchestra.console.smithi080:Power off 2024-02-19T22:02:08.642 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T22:02:08.657 INFO:teuthology.orchestra.console.smithi157:Power off 2024-02-19T22:02:08.658 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T22:02:08.666 DEBUG:teuthology.orchestra.console.smithi080:power off output: Chassis Power Control: Down/Off 2024-02-19T22:02:08.667 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T22:02:08.679 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2024-02-19T22:02:08.680 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T22:02:08.689 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-02-19T22:02:08.703 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2024-02-19T22:02:12.690 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T22:02:12.715 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T22:02:12.817 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-02-19T22:02:12.825 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2024-02-19T22:02:16.820 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T22:02:16.828 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T22:02:16.930 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2024-02-19T22:02:16.937 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2024-02-19T22:02:17.032 INFO:teuthology.orchestra.console.smithi080:Power off completed 2024-02-19T22:02:17.038 INFO:teuthology.orchestra.console.smithi157:Power off completed 2024-02-19T22:02:17.143 INFO:teuthology.run:Summary data: description: rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} duration: 3086.285821914673 failure_reason: expected string or bytes-like object flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2024-02-19T22:02:17.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T22:02:17.229 INFO:teuthology.run:FAIL